2025-09-30T14:50:11.594031Z :BasicWriteSession INFO: Random seed for debugging is 1759243811594023
2025-09-30T14:50:11.723992Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7555894634774330524:2081];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:11.724044Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-09-30T14:50:11.730220Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7555894636980404974:2084];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:11.730463Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-09-30T14:50:11.732517Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/rk13/00262b/r3tmp/tmpjQEmrD/pdisk_1.dat
2025-09-30T14:50:11.733153Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-09-30T14:50:11.801955Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-09-30T14:50:11.806360Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-09-30T14:50:11.813304Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-09-30T14:50:11.815749Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-09-30T14:50:11.815781Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-09-30T14:50:11.820187Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-09-30T14:50:11.823685Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-09-30T14:50:11.832092Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-09-30T14:50:11.832117Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
TServer::EnableGrpc on GrpcPort 27566, node 1
2025-09-30T14:50:11.836237Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-09-30T14:50:11.840677Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/rk13/00262b/r3tmp/yandexFBRWz6.tmp
2025-09-30T14:50:11.840693Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/rk13/00262b/r3tmp/yandexFBRWz6.tmp
2025-09-30T14:50:11.840779Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/rk13/00262b/r3tmp/yandexFBRWz6.tmp
2025-09-30T14:50:11.840838Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-09-30T14:50:11.845504Z INFO: TTestServer started on Port 13929 GrpcPort 27566
TClient is connected to server localhost:13929
PQClient connected to localhost:27566
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-09-30T14:50:11.881654Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-09-30T14:50:11.991393Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-09-30T14:50:12.056140Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-09-30T14:50:12.152287Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7555894641275372568:2296], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.152312Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7555894641275372574:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.152321Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.153631Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-09-30T14:50:12.157571Z node 2 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [2:7555894641275372582:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715657 completed, doublechecking }
2025-09-30T14:50:12.271797Z node 2 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [2:7555894641275372621:2137] txid# 281474976715658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-09-30T14:50:12.277767Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [1:7555894639069298813:2330], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-09-30T14:50:12.277886Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=1&id=YjBlMmRmZWYtZGQxMDUyZTctY2EyOTg5Y2ItMmQyMDA5OGQ=, ActorId: [1:7555894639069298787:2323], ActorState: ExecuteState, TraceId: 01k6dhmfbt5hgw01ejg36sdvtw, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-09-30T14:50:12.277935Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:50:12.278451Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-09-30T14:50:12.278504Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [2:7555894641275372634:2305], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-09-30T14:50:12.278575Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=2&id=OWVhOWNhM2EtOTdlMzQxNGEtZmFjZWNmNWItN2U0ZTQwZjc=, ActorId: [2:7555894641275372566:2295], ActorState: ExecuteState, TraceId: 01k6dhmf9q0shejpw2yd0xev8b, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-09-30T14:50:12.278709Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-09-30T14:50:12.304326Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:50:12.333171Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:27566", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-09-30T14:50:12.371048Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720664. Ctx: { TraceId: 01k6dhmffyef1pehszv91f6ra9, Database: , SessionId: ydb://session/3?node_id=1&id=NzNhYmFiYzYtZDUzNTJjMWUtZTRmMmJiMDgtYjNiNzg3ZDM=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7555894639069299262:2983] 
2025-09-30T14:50:12.730047Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-09-30T14:50:12.732079Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-09-30T14:50:16.724157Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7555894634774330524:2081];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:16.724201Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-09-30T14:50:16.730286Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7555894636980404974:2084];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:16.730322Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-09-30T14:50:17.517129Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:27566
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:17.538209Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:27566
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720677
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-09-30T14:50:17.546404Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7555894660544136298:3303] connected; active server actors: 1
2025-09-30T14:50:17.546650Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-09-30T14:50:17.546828Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-09-30T14:50:17.547326Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-09-30T14:50:17.548343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:17.549325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:17.549411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-09-30T14:50:17.549435Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:17.549455Z node 1 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-09-30T14:50:17.549542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894660544136297:3302], now have 1 active actors on pipe
2025-09-30T14:50:17.549552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7555894662750209544:2384], now have 1 active actors on pipe
2025-09-30T14:50:17.549761Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1
2025-09-30T14:50:17.549807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:17.550678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:17.552445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894660544136378:3363], now have 1 active actors on pipe
2025-09-30T14:50:17.552515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:17.553250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:17.553463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:17.553493Z node 1 :PERSQUEUE DEBUG: partition.cpp:1271: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-09-30T14:50:17.553542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:17.553615Z node 1 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7555894660544136389:2465]
2025-09-30T14:50:17.554396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:17.554408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:17.554413Z node 1 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [1:7555894660544136389:2465]
2025-09-30T14:50:17.554419Z node 1 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-09-30T14:50:17.554713Z node 1 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-09-30T14:50:17.554726Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.554763Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.554767Z node 1 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:17.554770Z node 1 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-09-30T14:50:17.554773Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.554774Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.554776Z node 1 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-09-30T14:50:17.554783Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:17.554854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:17.554890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:17.555945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:17.555980Z node 1 :PERSQUEUE DEBUG: partition.cpp:1375: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759243817597, TxId 281474976720677
2025-09-30T14:50:17.555984Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.555985Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.556007Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:17.556059Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:17.556532Z node 1 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:17.556601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:17.556614Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.556616Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.556626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:17.556632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:17.556742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-09-30T14:50:17.556765Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:17.556820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:17.557723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:17.557742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:17.558126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:17.560589Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720678. Ctx: { TraceId: 01k6dhmmj851fre6p8ed15p085, Database: , SessionId: ydb://session/3?node_id=1&id=YjYxOTA3ZGMtYTFhNmI5MzEtODBmMDQzZGItNzBmNjQzNDM=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1759243817597
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1759243817597
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:27566
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:17.568289Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-09-30T14:50:17.654964Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.654983Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.654986Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:17.755327Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.755344Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.755347Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:17.855650Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.855667Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.855671Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:17.956022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.956038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.956040Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.056662Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.056676Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.056679Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:27566
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:18.069630Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-09-30T14:50:18.157243Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.157257Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.157259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.257590Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.257604Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.257606Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.357951Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.357966Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.357969Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.458288Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.458303Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.458307Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.559329Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.559350Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.559352Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:27566
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:18.572438Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-09-30T14:50:18.576684Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-09-30T14:50:18.576973Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-09-30T14:50:18.576979Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:27566
2025-09-30T14:50:18.577558Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:18.577571Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-09-30T14:50:18.579206Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-09-30T14:50:18.579498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-09-30T14:50:18.579571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:59852
2025-09-30T14:50:18.579582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:59852 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:18.579588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:18.580069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-09-30T14:50:18.580122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:18.580129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:18.580131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:18.580150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894664839103870:2498] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:18.580763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894664839103870:2498] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:18.614278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7555894664839103870:2498] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-09-30T14:50:18.614443Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894664839103917:2498] connected; active server actors: 1
2025-09-30T14:50:18.614663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7555894664839103870:2498] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-09-30T14:50:18.614679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894664839103870:2498] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:18.614839Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894664839103917:2498] disconnected; active server actors: 1
2025-09-30T14:50:18.614853Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894664839103917:2498] disconnected no session
2025-09-30T14:50:18.636304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894664839103870:2498] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:18.636326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894664839103870:2498] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-09-30T14:50:18.636331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894664839103870:2498] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:18.636342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:18.636582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1
2025-09-30T14:50:18.636583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894664839103937:2498], now have 1 active actors on pipe
2025-09-30T14:50:18.636594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.636603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.636641Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|7272d108-e8a2f789-dd3d22f-7d17d510_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-09-30T14:50:18.636658Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.636670Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.636673Z node 1 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:18.636688Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.636715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:18.636738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:18.636792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.636815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.636845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:18.636904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|7272d108-e8a2f789-dd3d22f-7d17d510_0
2025-09-30T14:50:18.639349Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759243818639 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:50:18.639402Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|7272d108-e8a2f789-dd3d22f-7d17d510_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:18.639610Z :INFO: [] MessageGroupId [src] SessionId [src|7272d108-e8a2f789-dd3d22f-7d17d510_0] Write session: close. Timeout = 0 ms
2025-09-30T14:50:18.639623Z :INFO: [] MessageGroupId [src] SessionId [src|7272d108-e8a2f789-dd3d22f-7d17d510_0] Write session will now close
2025-09-30T14:50:18.639631Z :DEBUG: [] MessageGroupId [src] SessionId [src|7272d108-e8a2f789-dd3d22f-7d17d510_0] Write session: aborting
2025-09-30T14:50:18.640120Z :INFO: [] MessageGroupId [src] SessionId [src|7272d108-e8a2f789-dd3d22f-7d17d510_0] Write session: gracefully shut down, all writes complete
2025-09-30T14:50:18.640093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|7272d108-e8a2f789-dd3d22f-7d17d510_0 grpc read done: success: 0 data: 
2025-09-30T14:50:18.640148Z :DEBUG: [] MessageGroupId [src] SessionId [src|7272d108-e8a2f789-dd3d22f-7d17d510_0] Write session is aborting and will not restart
2025-09-30T14:50:18.640107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|7272d108-e8a2f789-dd3d22f-7d17d510_0 grpc read failed
2025-09-30T14:50:18.640119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|7272d108-e8a2f789-dd3d22f-7d17d510_0 grpc closed
2025-09-30T14:50:18.640125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|7272d108-e8a2f789-dd3d22f-7d17d510_0 is DEAD
2025-09-30T14:50:18.640168Z :DEBUG: [] MessageGroupId [src] SessionId [src|7272d108-e8a2f789-dd3d22f-7d17d510_0] Write session: destroy
2025-09-30T14:50:18.640478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-09-30T14:50:18.640584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7555894664839103937:2498] destroyed
2025-09-30T14:50:18.640603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-09-30T14:50:18.640617Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.640624Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.640627Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
Got new write session event: ReadyToAcceptEvent
Got new write session event: ReadyToAcceptEvent
2025-09-30T14:50:18.659533Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.659550Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.659553Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-09-30T14:50:18.696351Z :INFO: [/Root] [] [] Start federated write session to database 'dc1' (previous was <empty>) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:27566" location: "dc1" status: AVAILABLE weight: 1000 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:27566" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:27566" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-09-30T14:50:18.698547Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-09-30T14:50:18.698795Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-09-30T14:50:18.756198Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-09-30T14:50:18.756451Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:18.756468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-09-30T14:50:18.758390Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:18.758644Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-09-30T14:50:18.758790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:18.758852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51574
2025-09-30T14:50:18.758864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="topic server" ip=ipv6:[::1]:51574 proto=topic  topic=test-topic durationSec=0
2025-09-30T14:50:18.758870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:18.759433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-09-30T14:50:18.759469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:18.759476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:18.759478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:18.759485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894664839103955:2517] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:18.759802Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.759812Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.759815Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.760091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894664839103955:2517] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:18.773249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7555894664839103955:2517] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-09-30T14:50:18.773391Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894664839103974:2517] connected; active server actors: 1
2025-09-30T14:50:18.773547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7555894664839103955:2517] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-09-30T14:50:18.773570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894664839103955:2517] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:18.773814Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894664839103974:2517] disconnected; active server actors: 1
2025-09-30T14:50:18.773827Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894664839103974:2517] disconnected no session
2025-09-30T14:50:18.780351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894664839103955:2517] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:18.780369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894664839103955:2517] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-09-30T14:50:18.780373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894664839103955:2517] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:18.780381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:18.781315Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-09-30T14:50:18.781348Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759243818781 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:50:18.781396Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: session_id: "src_id|7373baa-f6d0074-230db21c-7a6c5e3a_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-09-30T14:50:18.781488Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7373baa-f6d0074-230db21c-7a6c5e3a_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
2025-09-30T14:50:18.781678Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7373baa-f6d0074-230db21c-7a6c5e3a_0]  MessageGroupId [src_id] Write session: try to update token
2025-09-30T14:50:18.781695Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7373baa-f6d0074-230db21c-7a6c5e3a_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 1
2025-09-30T14:50:18.784246Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7373baa-f6d0074-230db21c-7a6c5e3a_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-09-30T14:50:18.784461Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7373baa-f6d0074-230db21c-7a6c5e3a_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 1 written { } } write_statistics { persisting_time { } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-09-30T14:50:18.784470Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7373baa-f6d0074-230db21c-7a6c5e3a_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-09-30T14:50:18.784476Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7373baa-f6d0074-230db21c-7a6c5e3a_0]  MessageGroupId [src_id] Write session: acknoledged message 1
Got new write session event: AcksEvent: { seqNo : 1, State : EES_WRITTEN, offset : 0, partitionId : 0 } write stat: Write time 0.000000s minimal time in partition queue 0.000000s maximal time in partition queue 0.000000s partition quoted time 0.000000s topic quoted time 0.000000s
2025-09-30T14:50:18.784702Z :INFO: [/Root]  TraceId []  SessionId [src_id|7373baa-f6d0074-230db21c-7a6c5e3a_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-09-30T14:50:18.784709Z :INFO: [/Root]  TraceId []  SessionId [src_id|7373baa-f6d0074-230db21c-7a6c5e3a_0]  MessageGroupId [src_id] Write session will now close
2025-09-30T14:50:18.784722Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7373baa-f6d0074-230db21c-7a6c5e3a_0]  MessageGroupId [src_id] Write session: aborting
2025-09-30T14:50:18.784872Z :INFO: [/Root]  TraceId []  SessionId [src_id|7373baa-f6d0074-230db21c-7a6c5e3a_0]  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-09-30T14:50:18.784878Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7373baa-f6d0074-230db21c-7a6c5e3a_0]  MessageGroupId [src_id] Write session: destroy
2025-09-30T14:50:18.780590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1
2025-09-30T14:50:18.780614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894664839103988:2517], now have 1 active actors on pipe
2025-09-30T14:50:18.780624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.780630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.780657Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7373baa-f6d0074-230db21c-7a6c5e3a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:18.780667Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.780672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.780675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:18.780686Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.780702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:18.780721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:18.780805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.780821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.780866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:18.780925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|7373baa-f6d0074-230db21c-7a6c5e3a_0
2025-09-30T14:50:18.781936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|7373baa-f6d0074-230db21c-7a6c5e3a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.782067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.782113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.782118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.782150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:18.782167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:50:18.782190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.782192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.782313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size 96 offset: -1
2025-09-30T14:50:18.782321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.782339Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.782346Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.782349Z node 1 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:18.782383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-09-30T14:50:18.782449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 170 count 1 nextOffset 1 batches 1
2025-09-30T14:50:18.782456Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.782508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 158 WTime 1759243818782
2025-09-30T14:50:18.782546Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.782558Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 158
2025-09-30T14:50:18.783682Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 158 actorID [1:7555894660544136344:2465]
2025-09-30T14:50:18.783707Z node 1 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.783725Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 158
2025-09-30T14:50:18.783733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 103 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:18.783744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.783764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-09-30T14:50:18.783800Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:18.783808Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:18.783813Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.783815Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.783818Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.783827Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:50:18.783830Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 158 bytes (158)
2025-09-30T14:50:18.783835Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 158 (8388608)
2025-09-30T14:50:18.783846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-09-30T14:50:18.783894Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-09-30T14:50:18.783903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:50:18.783910Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 158 count 1 last offset 0, current partition end offset: 1
2025-09-30T14:50:18.783914Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:18.783925Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 158 accessed 0 times before, last time 2025-09-30T14:50:18.000000Z
2025-09-30T14:50:18.783938Z node 1 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-09-30T14:50:18.783953Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:18.783963Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-09-30T14:50:18.783969Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 138 from pos 0 cbcount 1
2025-09-30T14:50:18.783989Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818782 queuesize 0 startOffset 0
2025-09-30T14:50:18.785048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|7373baa-f6d0074-230db21c-7a6c5e3a_0 grpc read done: success: 0 data: 
2025-09-30T14:50:18.785053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|7373baa-f6d0074-230db21c-7a6c5e3a_0 grpc read failed
2025-09-30T14:50:18.785062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|7373baa-f6d0074-230db21c-7a6c5e3a_0 grpc closed
2025-09-30T14:50:18.785067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|7373baa-f6d0074-230db21c-7a6c5e3a_0 is DEAD
2025-09-30T14:50:18.785362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-09-30T14:50:18.785654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7555894664839103988:2517] destroyed
2025-09-30T14:50:18.785665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-09-30T14:50:18.785674Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.785677Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.785679Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.860222Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.860236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.860254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.960582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.960607Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.960610Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.060932Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.060950Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.060953Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.259098Z :CloseWriteSessionImmediately INFO: Random seed for debugging is 1759243819259089
2025-09-30T14:50:19.337325Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7555894669610688679:2157];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:19.337371Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-09-30T14:50:19.338482Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7555894669854686624:2075];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:19.338505Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-09-30T14:50:19.339401Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-09-30T14:50:19.339521Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-09-30T14:50:19.341521Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-09-30T14:50:19.342001Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/rk13/00262b/r3tmp/tmpXZYXui/pdisk_1.dat
2025-09-30T14:50:19.359655Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-09-30T14:50:19.365399Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-09-30T14:50:19.365424Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-09-30T14:50:19.366093Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-09-30T14:50:19.366311Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 1143, node 3
2025-09-30T14:50:19.377168Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/rk13/00262b/r3tmp/yandexvQgrtq.tmp
2025-09-30T14:50:19.377181Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/rk13/00262b/r3tmp/yandexvQgrtq.tmp
2025-09-30T14:50:19.377241Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/rk13/00262b/r3tmp/yandexvQgrtq.tmp
2025-09-30T14:50:19.377341Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-09-30T14:50:19.380805Z INFO: TTestServer started on Port 13238 GrpcPort 1143
TClient is connected to server localhost:13238
PQClient connected to localhost:1143
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-09-30T14:50:19.439048Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-09-30T14:50:19.439101Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-09-30T14:50:19.440893Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-09-30T14:50:19.441421Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-09-30T14:50:19.456067Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976720658, at schemeshard: 72057594046644480
waiting...
waiting...
2025-09-30T14:50:19.496643Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-09-30T14:50:19.525425Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-09-30T14:50:19.807153Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7555894669610689506:2325], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:19.807179Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:19.807282Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7555894669610689532:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:19.808261Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-09-30T14:50:19.810864Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7555894669610689566:2331], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:19.810897Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:19.818403Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:50:19.821918Z node 3 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [3:7555894669610689534:2329], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720661 completed, doublechecking }
2025-09-30T14:50:19.829767Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [4:7555894669854686956:2301], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-09-30T14:50:19.830636Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=4&id=NzIxMDExMDItNjkwODI4YjktMzUzZWIzZGUtYWZiM2UyNTU=, ActorId: [4:7555894669854686939:2295], ActorState: ExecuteState, TraceId: 01k6dhmps88ad0xtna7csg7nwc, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-09-30T14:50:19.830824Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-09-30T14:50:19.845592Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:50:19.901798Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:50:19.919342Z node 3 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [3:7555894669610689986:2953] txid# 281474976720665, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:1143", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-09-30T14:50:19.962049Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720666. Ctx: { TraceId: 01k6dhmpx04gyn5nmyv49zcrag, Database: , SessionId: ydb://session/3?node_id=3&id=YjgzMzQ4ZWMtYjg1MGQ3MGQtMmQzYzI3YzItZjQyYTZlZDA=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7555894669610690086:3011] 
2025-09-30T14:50:20.338872Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-09-30T14:50:20.341045Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-09-30T14:50:24.337599Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7555894669610688679:2157];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:24.337646Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-09-30T14:50:24.338612Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7555894669854686624:2075];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:24.338647Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-09-30T14:50:25.243034Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720681:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:1143
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:1143
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
2025-09-30T14:50:25.267985Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720682
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-09-30T14:50:25.279581Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7555894695380494479:3359] connected; active server actors: 1
2025-09-30T14:50:25.279818Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-09-30T14:50:25.279946Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-09-30T14:50:25.280888Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-09-30T14:50:25.281074Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:25.281762Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:25.281845Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-09-30T14:50:25.281870Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:25.281886Z node 3 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-09-30T14:50:25.281937Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7555894695380494478:3358], now have 1 active actors on pipe
2025-09-30T14:50:25.281955Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [4:7555894695624491186:2381], now have 1 active actors on pipe
2025-09-30T14:50:25.282125Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 3, Generation 1
2025-09-30T14:50:25.282149Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:25.283045Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:25.284722Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7555894695380494537:3406], now have 1 active actors on pipe
2025-09-30T14:50:25.284808Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:25.285572Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:25.285729Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:25.285746Z node 3 :PERSQUEUE DEBUG: partition.cpp:1271: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-09-30T14:50:25.285794Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:25.285835Z node 3 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [3:7555894695380494557:2474]
2025-09-30T14:50:25.286659Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:25.286667Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:25.286672Z node 3 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [3:7555894695380494557:2474]
2025-09-30T14:50:25.286679Z node 3 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-09-30T14:50:25.286996Z node 3 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-09-30T14:50:25.287007Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.287023Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.287030Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:25.287034Z node 3 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-09-30T14:50:25.287036Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.287038Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.287040Z node 3 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-09-30T14:50:25.287051Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:25.287121Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:25.287150Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:25.288156Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:25.288204Z node 3 :PERSQUEUE DEBUG: partition.cpp:1375: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759243825332, TxId 281474976720682
2025-09-30T14:50:25.288213Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.288215Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.288245Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.288303Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:25.288791Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:25.288855Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:25.288869Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.288875Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.288877Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.288882Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:25.288994Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-09-30T14:50:25.289019Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:25.289074Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:25.290119Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:25.290145Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:25.290632Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:25.297794Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720683. Ctx: { TraceId: 01k6dhmw41ae0bve22aqs3mc53, Database: , SessionId: ydb://session/3?node_id=3&id=NGY4Y2UzZDktMTYzY2E4N2ItOTI4NWMzNmItZDgwNTJmNDY=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720682
    CreateStep: 1759243825332
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720682
    CreateStep: 1759243825332
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:1143
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:25.306473Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-09-30T14:50:25.387206Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.387225Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.387228Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.491731Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.491748Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.491751Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.592166Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.592181Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.592185Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.692339Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.692356Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.692359Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.792695Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.792711Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.792714Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:1143
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:25.807651Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-09-30T14:50:25.893021Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.893036Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.893040Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.993404Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.993422Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.993425Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.093756Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.093772Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.093775Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.194088Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.194106Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.194110Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.294428Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.294446Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.294449Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:1143
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:26.309539Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-09-30T14:50:26.310850Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-09-30T14:50:26.311092Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-09-30T14:50:26.311097Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:1143
2025-09-30T14:50:26.311524Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-09-30T14:50:26.311590Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:26.311604Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-09-30T14:50:26.311800Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-09-30T14:50:26.311840Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:59210
2025-09-30T14:50:26.311849Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:59210 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:26.311852Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:26.312300Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-09-30T14:50:26.312341Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:26.312348Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:26.312351Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:26.312356Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7555894699675462062:2515] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:26.312989Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7555894699675462062:2515] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:26.335305Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7555894699675462062:2515] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-09-30T14:50:26.335462Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894699675462093:2515] connected; active server actors: 1
2025-09-30T14:50:26.335553Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7555894699675462062:2515] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-09-30T14:50:26.335565Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7555894699675462062:2515] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:26.335709Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894699675462093:2515] disconnected; active server actors: 1
2025-09-30T14:50:26.335718Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894699675462093:2515] disconnected no session
2025-09-30T14:50:26.354637Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7555894699675462062:2515] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:26.354654Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7555894699675462062:2515] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-09-30T14:50:26.354658Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7555894699675462062:2515] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:26.354667Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:26.354841Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7555894699675462120:2515], now have 1 active actors on pipe
2025-09-30T14:50:26.354847Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-09-30T14:50:26.354854Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:26.354862Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:26.354889Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|1a0ac435-b34313a5-127cebb0-3647d558_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-09-30T14:50:26.354901Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.354911Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.354914Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:26.354927Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.354947Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:26.354969Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:26.355019Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:26.355028Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:26.355040Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:26.355072Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|1a0ac435-b34313a5-127cebb0-3647d558_0
2025-09-30T14:50:26.355439Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759243826355 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:50:26.355482Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|1a0ac435-b34313a5-127cebb0-3647d558_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:26.355597Z :INFO: [] MessageGroupId [src] SessionId [src|1a0ac435-b34313a5-127cebb0-3647d558_0] Write session: close. Timeout = 0 ms
2025-09-30T14:50:26.355609Z :INFO: [] MessageGroupId [src] SessionId [src|1a0ac435-b34313a5-127cebb0-3647d558_0] Write session will now close
2025-09-30T14:50:26.355618Z :DEBUG: [] MessageGroupId [src] SessionId [src|1a0ac435-b34313a5-127cebb0-3647d558_0] Write session: aborting
2025-09-30T14:50:26.355787Z :INFO: [] MessageGroupId [src] SessionId [src|1a0ac435-b34313a5-127cebb0-3647d558_0] Write session: gracefully shut down, all writes complete
2025-09-30T14:50:26.355793Z :DEBUG: [] MessageGroupId [src] SessionId [src|1a0ac435-b34313a5-127cebb0-3647d558_0] Write session: destroy
2025-09-30T14:50:26.355994Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|1a0ac435-b34313a5-127cebb0-3647d558_0 grpc read done: success: 0 data: 
2025-09-30T14:50:26.356005Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|1a0ac435-b34313a5-127cebb0-3647d558_0 grpc read failed
2025-09-30T14:50:26.356012Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|1a0ac435-b34313a5-127cebb0-3647d558_0 grpc closed
2025-09-30T14:50:26.356017Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|1a0ac435-b34313a5-127cebb0-3647d558_0 is DEAD
2025-09-30T14:50:26.356287Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-09-30T14:50:26.356410Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7555894699675462120:2515] destroyed
2025-09-30T14:50:26.356426Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-09-30T14:50:26.356433Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.356439Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.356442Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-09-30T14:50:26.394822Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.394839Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.394841Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.495174Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.495192Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.495195Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.595516Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.595531Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.595534Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.695859Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.695873Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.695877Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:12.154238Z :FallbackToSingleDb INFO: Random seed for debugging is 1759243812154231
2025-09-30T14:50:12.257137Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7555894638919241283:2171];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:12.257161Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-09-30T14:50:12.260812Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-09-30T14:50:12.261657Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7555894642213266078:2159];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:12.261741Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/rk13/002613/r3tmp/tmpEakeYQ/pdisk_1.dat
2025-09-30T14:50:12.263703Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-09-30T14:50:12.302361Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-09-30T14:50:12.302564Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-09-30T14:50:12.317018Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 4099, node 1
2025-09-30T14:50:12.328284Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/rk13/002613/r3tmp/yandexXMsWQl.tmp
2025-09-30T14:50:12.328315Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/rk13/002613/r3tmp/yandexXMsWQl.tmp
2025-09-30T14:50:12.328410Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/rk13/002613/r3tmp/yandexXMsWQl.tmp
2025-09-30T14:50:12.328478Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-09-30T14:50:12.332217Z INFO: TTestServer started on Port 2738 GrpcPort 4099
TClient is connected to server localhost:2738
PQClient connected to localhost:4099
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-09-30T14:50:12.358084Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-09-30T14:50:12.358120Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-09-30T14:50:12.359784Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-09-30T14:50:12.362680Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-09-30T14:50:12.362703Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-09-30T14:50:12.363398Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
2025-09-30T14:50:12.363834Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-09-30T14:50:12.364088Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
waiting...
waiting...
waiting...
waiting...
2025-09-30T14:50:12.470811Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-09-30T14:50:12.474589Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-09-30T14:50:12.729187Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7555894642213266301:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.729222Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7555894642213266290:2296], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.729307Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.731129Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7555894642213266331:2301], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.731160Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.731293Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7555894642213266333:2302], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.731323Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.731323Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-09-30T14:50:12.752028Z node 2 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [2:7555894642213266304:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715657 completed, doublechecking }
2025-09-30T14:50:12.817681Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [1:7555894638919242180:2330], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-09-30T14:50:12.818404Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=1&id=YjgxNjUzNzYtN2IzZDUyZmQtZWVkYWU0ZDEtYmNmOTE2ZTg=, ActorId: [1:7555894638919242152:2322], ActorState: ExecuteState, TraceId: 01k6dhmfwt4egh71dbyxzsvkzg, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-09-30T14:50:12.819098Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-09-30T14:50:12.822223Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:50:12.842089Z node 2 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [2:7555894642213266371:2158] txid# 281474976715658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-09-30T14:50:12.857588Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [2:7555894642213266382:2308], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-09-30T14:50:12.858322Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=2&id=NWM0M2YzZGMtNzQ0ZWYyNTctZDhmMGE3Y2QtYmJhYWMxYjk=, ActorId: [2:7555894642213266288:2295], ActorState: ExecuteState, TraceId: 01k6dhmfvrdmwc2a4wmqjczwnc, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-09-30T14:50:12.858491Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-09-30T14:50:12.874634Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:50:12.916256Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:4099", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-09-30T14:50:12.961551Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720664. Ctx: { TraceId: 01k6dhmg297fgxdr89s76pccjd, Database: , SessionId: ydb://session/3?node_id=1&id=MjRmMjAzMGYtZDdkZThiMjgtOWJlM2ZmYmEtYzJjMDM2MTU=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7555894638919242569:2948] 
2025-09-30T14:50:13.258947Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-09-30T14:50:13.263547Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-09-30T14:50:17.257249Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7555894638919241283:2171];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:17.257301Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-09-30T14:50:17.263293Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7555894642213266078:2159];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:17.263338Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-09-30T14:50:18.071786Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:4099
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:18.093188Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:4099
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720677
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-09-30T14:50:18.100060Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7555894664689046852:3247] connected; active server actors: 1
2025-09-30T14:50:18.100122Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-09-30T14:50:18.100243Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-09-30T14:50:18.100641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-09-30T14:50:18.103791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:18.104386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:18.104450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-09-30T14:50:18.104463Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:18.104476Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-09-30T14:50:18.104552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894664689046878:2447], now have 1 active actors on pipe
2025-09-30T14:50:18.104562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894664689046851:3246], now have 1 active actors on pipe
2025-09-30T14:50:18.104602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-09-30T14:50:18.104730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:18.105649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:18.107459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894664689046912:3294], now have 1 active actors on pipe
2025-09-30T14:50:18.107529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:18.108425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:18.108643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:18.108680Z node 2 :PERSQUEUE DEBUG: partition.cpp:1271: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-09-30T14:50:18.108736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:18.108801Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894667983070685:2397]
2025-09-30T14:50:18.109584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:18.109592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:18.109597Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7555894667983070685:2397]
2025-09-30T14:50:18.109603Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-09-30T14:50:18.109905Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-09-30T14:50:18.109917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.109947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.109953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:18.109956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-09-30T14:50:18.109959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.109960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.109962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-09-30T14:50:18.109972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:18.110090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:18.110126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:18.111226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:18.111298Z node 2 :PERSQUEUE DEBUG: partition.cpp:1375: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759243818150, TxId 281474976720677
2025-09-30T14:50:18.111309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.111312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.111355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.111424Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.111985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.112045Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:18.112061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.112063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.112065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.112071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:18.112186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-09-30T14:50:18.112212Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:18.112256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:18.113365Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720678. Ctx: { TraceId: 01k6dhmn3j1zqg0ykre7f9d1k2, Database: , SessionId: ydb://session/3?node_id=1&id=MTUwZGNjNzctODEwNDk5YjItMmNlOGM1Y2MtNjZjMmM4ZmE=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-09-30T14:50:18.113455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:18.113484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:18.113986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1759243818150
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1759243818150
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:4099
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:18.119782Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-09-30T14:50:18.210016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.210034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.210038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.310350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.310371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.310375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.410715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.410732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.410735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.511340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.511356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.511361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.611911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.611928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.611931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:4099
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:18.621164Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-09-30T14:50:18.712269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.712288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.712292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.812599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.812619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.812622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.912957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.912976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.912979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.013346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.013364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.013367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.113648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.113663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.113665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:4099
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:19.123087Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-09-30T14:50:19.124830Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-09-30T14:50:19.125105Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-09-30T14:50:19.125113Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:4099
2025-09-30T14:50:19.125732Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:19.125750Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-09-30T14:50:19.127449Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-09-30T14:50:19.127773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-09-30T14:50:19.127824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:54408
2025-09-30T14:50:19.127836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54408 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:19.127842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:19.128343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-09-30T14:50:19.128399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:19.128407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:19.128409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:19.128437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894668984014387:2482] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:19.128988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894668984014387:2482] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:19.158109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7555894668984014387:2482] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-09-30T14:50:19.158192Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894668984014418:2482] connected; active server actors: 1
2025-09-30T14:50:19.158204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7555894668984014387:2482] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-09-30T14:50:19.158208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894668984014387:2482] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:19.158322Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894668984014418:2482] disconnected; active server actors: 1
2025-09-30T14:50:19.158329Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894668984014418:2482] disconnected no session
2025-09-30T14:50:19.176317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894668984014387:2482] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:19.176336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894668984014387:2482] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-09-30T14:50:19.176339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894668984014387:2482] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:19.176348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:19.176647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894668984014441:2482], now have 1 active actors on pipe
2025-09-30T14:50:19.176708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-09-30T14:50:19.176831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.176845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.176870Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|87861a65-14576f9f-4a451a44-33ceb794_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-09-30T14:50:19.176886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.176895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.176900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:19.176912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.176927Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:19.176946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:19.177134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.177148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.177173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:19.177292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|87861a65-14576f9f-4a451a44-33ceb794_0
2025-09-30T14:50:19.177684Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759243819177 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:50:19.177735Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|87861a65-14576f9f-4a451a44-33ceb794_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:19.177861Z :INFO: [] MessageGroupId [src] SessionId [src|87861a65-14576f9f-4a451a44-33ceb794_0] Write session: close. Timeout = 0 ms
2025-09-30T14:50:19.177880Z :INFO: [] MessageGroupId [src] SessionId [src|87861a65-14576f9f-4a451a44-33ceb794_0] Write session will now close
2025-09-30T14:50:19.177889Z :DEBUG: [] MessageGroupId [src] SessionId [src|87861a65-14576f9f-4a451a44-33ceb794_0] Write session: aborting
2025-09-30T14:50:19.178045Z :INFO: [] MessageGroupId [src] SessionId [src|87861a65-14576f9f-4a451a44-33ceb794_0] Write session: gracefully shut down, all writes complete
2025-09-30T14:50:19.178050Z :DEBUG: [] MessageGroupId [src] SessionId [src|87861a65-14576f9f-4a451a44-33ceb794_0] Write session: destroy
2025-09-30T14:50:19.178224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|87861a65-14576f9f-4a451a44-33ceb794_0 grpc read done: success: 0 data: 
2025-09-30T14:50:19.178233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|87861a65-14576f9f-4a451a44-33ceb794_0 grpc read failed
2025-09-30T14:50:19.178241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|87861a65-14576f9f-4a451a44-33ceb794_0 grpc closed
2025-09-30T14:50:19.178246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|87861a65-14576f9f-4a451a44-33ceb794_0 is DEAD
2025-09-30T14:50:19.178569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-09-30T14:50:19.180615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7555894668984014441:2482] destroyed
Session was created
2025-09-30T14:50:19.180636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-09-30T14:50:19.180646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.180649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.180652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.182016Z :INFO: [/Root] OnFederationDiscovery fall back to single mode, database=/Root
2025-09-30T14:50:19.182067Z :INFO: [/Root] [] [fab31685-f91c031e-b9e3633-547b43ac] Open read subsessions to databases: { name: , endpoint: localhost:4099, path: /Root }
2025-09-30T14:50:19.182146Z :INFO: [/Root] [/Root] [be48d690-ccd00b16-345dc534-45972d99] Starting read session
2025-09-30T14:50:19.182165Z :DEBUG: [/Root] [/Root] [be48d690-ccd00b16-345dc534-45972d99] Starting single session
2025-09-30T14:50:19.182495Z :DEBUG: [/Root] [/Root] [be48d690-ccd00b16-345dc534-45972d99] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:50:19.182502Z :DEBUG: [/Root] [/Root] [be48d690-ccd00b16-345dc534-45972d99] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:50:19.182506Z :DEBUG: [/Root] [/Root] [be48d690-ccd00b16-345dc534-45972d99] [] Reconnecting session to cluster  in 0.000000s
2025-09-30T14:50:19.183909Z :DEBUG: [/Root] [/Root] [be48d690-ccd00b16-345dc534-45972d99] [] Successfully connected. Initializing session
2025-09-30T14:50:19.184179Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:50:19.184194Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-09-30T14:50:19.186235Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:50:19.186327Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_1_1_4139115122823202478_v1 read init: from# ipv6:[::1]:57454, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:50:19.186431Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_4139115122823202478_v1 auth for : user
2025-09-30T14:50:19.186632Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_4139115122823202478_v1 Handle describe topics response
2025-09-30T14:50:19.186662Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_4139115122823202478_v1 auth is DEAD
2025-09-30T14:50:19.186671Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_1_1_4139115122823202478_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:50:19.187034Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_1_1_4139115122823202478_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:50:19.187158Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894668984014449:2495] connected; active server actors: 1
2025-09-30T14:50:19.187173Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555894668984014449:2495] session shared/user_1_1_4139115122823202478_v1
2025-09-30T14:50:19.187183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:50:19.187195Z :INFO: [/Root] [/Root] [be48d690-ccd00b16-345dc534-45972d99] [] Got InitResponse. ReadSessionId: shared/user_1_1_4139115122823202478_v1
2025-09-30T14:50:19.187226Z :DEBUG: [/Root] [/Root] [be48d690-ccd00b16-345dc534-45972d99] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:50:19.187199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:50:19.187206Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_1_4139115122823202478_v1" (Sender=[1:7555894668984014446:2495], Pipe=[1:7555894668984014449:2495], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:50:19.187210Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:50:19.187221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:50:19.187229Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_1_4139115122823202478_v1" (Sender=[1:7555894668984014446:2495], Pipe=[1:7555894668984014449:2495], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:50:19.187239Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_1_4139115122823202478_v1" sender [1:7555894668984014446:2495] lock partition 0 for ReadingSession "shared/user_1_1_4139115122823202478_v1" (Sender=[1:7555894668984014446:2495], Pipe=[1:7555894668984014449:2495], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-09-30T14:50:19.187294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:50:19.187299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000074s
2025-09-30T14:50:19.187394Z :DEBUG: [/Root] [/Root] [be48d690-ccd00b16-345dc534-45972d99] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-09-30T14:50:19.187563Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_4139115122823202478_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_1_1_4139115122823202478_v1" ClientId: "user" PipeClient { RawX1: 7555894668984014449 RawX2: 4503603922340287 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:50:19.187589Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_4139115122823202478_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-09-30T14:50:19.187596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_4139115122823202478_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:50:19.187654Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_4139115122823202478_v1 got read request: guid# d4e530f3-f5c2e8e1-275e2f3e-a6407598
2025-09-30T14:50:19.187792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894668984014452:2498], now have 1 active actors on pipe
2025-09-30T14:50:19.187852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_4139115122823202478_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7555894668984014452:2498]
2025-09-30T14:50:19.187938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.187964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.187981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_4139115122823202478_v1 on pipe: [1:7555894668984014452:2498]
2025-09-30T14:50:19.188009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.188020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.188023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:19.188033Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_4139115122823202478_v1:1 with generation 1
2025-09-30T14:50:19.188046Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_1_4139115122823202478_v1
2025-09-30T14:50:19.188050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.188083Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:19.189232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:19.189278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:19.189289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.189292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.189294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.189301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:19.189313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:50:19.189481Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_4139115122823202478_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759243819180 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:50:19.189512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_4139115122823202478_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-09-30T14:50:19.189536Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_4139115122823202478_v1 sending to client partition status
Got new read session event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name:  Database path: /Root Database id:  CommittedOffset: 0 EndOffset: 0 }
2025-09-30T14:50:19.189878Z :INFO: [/Root] [/Root] [be48d690-ccd00b16-345dc534-45972d99] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-09-30T14:50:19.189962Z :INFO: [/Root] [/Root] [be48d690-ccd00b16-345dc534-45972d99] Closing read session. Close timeout: 0.010000s
2025-09-30T14:50:19.189972Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-09-30T14:50:19.189981Z :INFO: [/Root] [/Root] [be48d690-ccd00b16-345dc534-45972d99] Counters: { Errors: 0 CurrentSessionLifetimeMs: 7 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:50:19.190085Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_4139115122823202478_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-09-30T14:50:19.190117Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_4139115122823202478_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# (empty maybe)
2025-09-30T14:50:19.190136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_4139115122823202478_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-09-30T14:50:19.190145Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_4139115122823202478_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-09-30T14:50:19.190227Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_1_1_4139115122823202478_v1 grpc closed
2025-09-30T14:50:19.190244Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_1_1_4139115122823202478_v1 is DEAD
2025-09-30T14:50:19.190277Z :INFO: [/Root] [/Root] [be48d690-ccd00b16-345dc534-45972d99] Closing read session. Close timeout: 0.000000s
2025-09-30T14:50:19.190301Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-09-30T14:50:19.190307Z :INFO: [/Root] [/Root] [be48d690-ccd00b16-345dc534-45972d99] Counters: { Errors: 0 CurrentSessionLifetimeMs: 8 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:50:19.190314Z :INFO: [/Root] [/Root] [be48d690-ccd00b16-345dc534-45972d99] Closing read session. Close timeout: 0.000000s
2025-09-30T14:50:19.190317Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-09-30T14:50:19.190319Z :INFO: [/Root] [/Root] [be48d690-ccd00b16-345dc534-45972d99] Counters: { Errors: 0 CurrentSessionLifetimeMs: 8 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:50:19.190332Z :NOTICE: [/Root] [/Root] [be48d690-ccd00b16-345dc534-45972d99] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-09-30T14:50:19.190310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_4139115122823202478_v1
2025-09-30T14:50:19.190332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7555894668984014452:2498] destroyed
2025-09-30T14:50:19.190355Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_4139115122823202478_v1
2025-09-30T14:50:19.190553Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894668984014449:2495] disconnected; active server actors: 1
2025-09-30T14:50:19.190560Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894668984014449:2495] client user disconnected session shared/user_1_1_4139115122823202478_v1
2025-09-30T14:50:19.214040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.214058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.214061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.598278Z :FallbackToSingleDbAfterBadRequest INFO: Random seed for debugging is 1759243819598270
2025-09-30T14:50:19.664564Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7555894671264065484:2080];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:19.664712Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-09-30T14:50:19.667451Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-09-30T14:50:19.667597Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7555894669020964251:2154];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:19.667667Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-09-30T14:50:19.667708Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/rk13/002613/r3tmp/tmpehkyIK/pdisk_1.dat
2025-09-30T14:50:19.671819Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-09-30T14:50:19.675459Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-09-30T14:50:19.690240Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-09-30T14:50:19.692713Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-09-30T14:50:19.692735Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-09-30T14:50:19.694526Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-09-30T14:50:19.694777Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 16847, node 3
2025-09-30T14:50:19.701322Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/rk13/002613/r3tmp/yandexujPKfv.tmp
2025-09-30T14:50:19.701333Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/rk13/002613/r3tmp/yandexujPKfv.tmp
2025-09-30T14:50:19.701409Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/rk13/002613/r3tmp/yandexujPKfv.tmp
2025-09-30T14:50:19.701463Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-09-30T14:50:19.704941Z INFO: TTestServer started on Port 18521 GrpcPort 16847
TClient is connected to server localhost:18521
PQClient connected to localhost:16847
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-09-30T14:50:19.766726Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-09-30T14:50:19.766782Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-09-30T14:50:19.768889Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-09-30T14:50:19.769098Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-09-30T14:50:19.892319Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-09-30T14:50:19.932056Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-09-30T14:50:20.109201Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7555894675559033686:2325], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:20.109229Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:20.109414Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7555894675559033713:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:20.110238Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-09-30T14:50:20.112917Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7555894673315931765:2296], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:20.112964Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7555894673315931782:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:20.112973Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:20.113434Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7555894675559033747:2331], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:20.113461Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:20.113495Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7555894675559033750:2332], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:20.113502Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:20.114972Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7555894673315931826:2301], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:20.115011Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:20.115074Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7555894673315931828:2302], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:20.115089Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:20.115612Z node 4 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [4:7555894673315931800:2128] txid# 281474976715657, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exists but creating right now (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateCreate), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-09-30T14:50:20.119509Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:50:20.127605Z node 3 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [3:7555894675559033715:2329], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720661 completed, doublechecking }
2025-09-30T14:50:20.127718Z node 4 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [4:7555894673315931798:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720661 completed, doublechecking }
2025-09-30T14:50:20.144853Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:50:20.188889Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:16847", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-09-30T14:50:20.212075Z node 3 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [3:7555894675559034185:2962] txid# 281474976720665, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-09-30T14:50:20.215695Z node 4 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [4:7555894673315931895:2175] txid# 281474976715658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-09-30T14:50:20.232242Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720666. Ctx: { TraceId: 01k6dhmq5me61x6affj8zmwtbs, Database: , SessionId: ydb://session/3?node_id=3&id=NGFlYzBkN2QtOGQyY2FlNjUtYTU2MzBlZDUtYzA1OGUxOGY=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7555894675559034259:3005] 
2025-09-30T14:50:20.667584Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-09-30T14:50:20.669503Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-09-30T14:50:24.664794Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7555894671264065484:2080];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:24.664855Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-09-30T14:50:24.666317Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7555894669020964251:2154];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:24.666356Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-09-30T14:50:25.542994Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720681:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:16847
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:25.560552Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:16847
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720682
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-09-30T14:50:25.572126Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:25.572439Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7555894697033871364:3351] connected; active server actors: 1
2025-09-30T14:50:25.572545Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-09-30T14:50:25.572701Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-09-30T14:50:25.573021Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:25.573092Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-09-30T14:50:25.573105Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:25.573122Z node 3 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-09-30T14:50:25.573153Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7555894697033871363:3350], now have 1 active actors on pipe
2025-09-30T14:50:25.573248Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:25.573259Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [4:7555894694790768802:2393], now have 1 active actors on pipe
2025-09-30T14:50:25.573262Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 3, Generation 1
2025-09-30T14:50:25.573306Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-09-30T14:50:25.574280Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:25.576070Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7555894697033871422:3398], now have 1 active actors on pipe
2025-09-30T14:50:25.576153Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:25.576864Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:25.577064Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:25.577083Z node 3 :PERSQUEUE DEBUG: partition.cpp:1271: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-09-30T14:50:25.577150Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:25.577196Z node 3 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [3:7555894697033871434:2478]
2025-09-30T14:50:25.577951Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:25.577968Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:25.577974Z node 3 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [3:7555894697033871434:2478]
2025-09-30T14:50:25.577982Z node 3 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-09-30T14:50:25.578325Z node 3 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-09-30T14:50:25.578342Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.578364Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.578367Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:25.578371Z node 3 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-09-30T14:50:25.578374Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.578376Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.578377Z node 3 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-09-30T14:50:25.578393Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:25.578488Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:25.578528Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:25.579709Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:25.579757Z node 3 :PERSQUEUE DEBUG: partition.cpp:1375: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759243825619, TxId 281474976720682
2025-09-30T14:50:25.579763Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.579765Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.579807Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.579851Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:25.580295Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:25.580360Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:25.580374Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.580380Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.580382Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.580388Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:25.580503Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-09-30T14:50:25.580530Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:25.580578Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:25.581770Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:25.581806Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:25.582346Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:25.583349Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720683. Ctx: { TraceId: 01k6dhmwcya93jpcvfq83qd8fb, Database: , SessionId: ydb://session/3?node_id=3&id=MjE1NmE1ODktMmViYzU2MzgtMTJmNWJjOGQtMTNjMjk0Zg==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720682
    CreateStep: 1759243825619
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720682
    CreateStep: 1759243825619
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:16847
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:25.589771Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-09-30T14:50:25.678501Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.678519Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.678522Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.778881Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.778900Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.778903Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.879266Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.879285Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.879288Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.979597Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.979615Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.979618Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.079945Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.079961Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.079964Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:16847
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:26.091369Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-09-30T14:50:26.180310Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.180329Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.180333Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.280631Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.280648Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.280651Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.380975Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.380990Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.380994Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.481368Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.481396Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.481399Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.581704Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.581722Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.581725Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:16847
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:26.593003Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-09-30T14:50:26.594491Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-09-30T14:50:26.594692Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-09-30T14:50:26.594699Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:16847
2025-09-30T14:50:26.595056Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-09-30T14:50:26.595163Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:26.595178Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-09-30T14:50:26.595318Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-09-30T14:50:26.595369Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:33878
2025-09-30T14:50:26.595378Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:33878 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:26.595383Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:26.595784Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-09-30T14:50:26.595818Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:26.595825Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:26.595826Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:26.595831Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7555894701328838927:2515] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:26.596402Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7555894701328838927:2515] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:26.632223Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7555894701328838927:2515] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-09-30T14:50:26.632560Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894701328838964:2515] connected; active server actors: 1
2025-09-30T14:50:26.632898Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7555894701328838927:2515] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-09-30T14:50:26.632907Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7555894701328838927:2515] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:26.633131Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894701328838964:2515] disconnected; active server actors: 1
2025-09-30T14:50:26.633139Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894701328838964:2515] disconnected no session
2025-09-30T14:50:26.649186Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7555894701328838927:2515] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:26.649201Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7555894701328838927:2515] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-09-30T14:50:26.649205Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7555894701328838927:2515] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:26.649214Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:26.649373Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-09-30T14:50:26.649386Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7555894701328838985:2515], now have 1 active actors on pipe
2025-09-30T14:50:26.649396Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:26.649403Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:26.649439Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|2aba23c4-34e4777f-b0c836cd-6439d304_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-09-30T14:50:26.649463Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.649469Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.649472Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:26.649486Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.649503Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:26.649530Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:26.649571Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:26.649573Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:26.649586Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:26.649615Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|2aba23c4-34e4777f-b0c836cd-6439d304_0
2025-09-30T14:50:26.650242Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759243826650 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:50:26.650287Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|2aba23c4-34e4777f-b0c836cd-6439d304_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:26.650412Z :INFO: [] MessageGroupId [src] SessionId [src|2aba23c4-34e4777f-b0c836cd-6439d304_0] Write session: close. Timeout = 0 ms
2025-09-30T14:50:26.650425Z :INFO: [] MessageGroupId [src] SessionId [src|2aba23c4-34e4777f-b0c836cd-6439d304_0] Write session will now close
2025-09-30T14:50:26.650431Z :DEBUG: [] MessageGroupId [src] SessionId [src|2aba23c4-34e4777f-b0c836cd-6439d304_0] Write session: aborting
2025-09-30T14:50:26.650601Z :INFO: [] MessageGroupId [src] SessionId [src|2aba23c4-34e4777f-b0c836cd-6439d304_0] Write session: gracefully shut down, all writes complete
2025-09-30T14:50:26.650608Z :DEBUG: [] MessageGroupId [src] SessionId [src|2aba23c4-34e4777f-b0c836cd-6439d304_0] Write session: destroy
2025-09-30T14:50:26.650788Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|2aba23c4-34e4777f-b0c836cd-6439d304_0 grpc read done: success: 0 data: 
2025-09-30T14:50:26.650798Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|2aba23c4-34e4777f-b0c836cd-6439d304_0 grpc read failed
2025-09-30T14:50:26.650807Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|2aba23c4-34e4777f-b0c836cd-6439d304_0 grpc closed
2025-09-30T14:50:26.650820Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|2aba23c4-34e4777f-b0c836cd-6439d304_0 is DEAD
PORTS 16847 22259
2025-09-30T14:50:26.651101Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-09-30T14:50:26.651151Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7555894701328838985:2515] destroyed
2025-09-30T14:50:26.651170Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-09-30T14:50:26.651180Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.651182Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.651184Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-09-30T14:50:26.682060Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.682081Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.682084Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.782440Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.782460Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.782464Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.882803Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.882821Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.882824Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.983125Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.983143Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.983147Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.083486Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.083505Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.083508Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.183820Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.183840Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.183843Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.284160Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.284179Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.284181Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.384803Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.384821Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.384824Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.484890Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.484908Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.484910Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.585236Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.585255Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.585258Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-09-30T14:50:27.660032Z :INFO: [/Root] OnFederationDiscovery fall back to single mode, database=/Root
2025-09-30T14:50:27.660064Z :INFO: [/Root] [] [30734a4b-99d16e9c-d9f6dc1d-42c1097] Open read subsessions to databases: { name: , endpoint: localhost:22259, path: /Root }
2025-09-30T14:50:27.660129Z :INFO: [/Root] [/Root] [751fc20a-96e5ecfb-5d3ca632-2e35853c] Starting read session
2025-09-30T14:50:27.660134Z :DEBUG: [/Root] [/Root] [751fc20a-96e5ecfb-5d3ca632-2e35853c] Starting single session
2025-09-30T14:50:27.660378Z :DEBUG: [/Root] [/Root] [751fc20a-96e5ecfb-5d3ca632-2e35853c] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:50:27.660384Z :DEBUG: [/Root] [/Root] [751fc20a-96e5ecfb-5d3ca632-2e35853c] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:50:27.660389Z :DEBUG: [/Root] [/Root] [751fc20a-96e5ecfb-5d3ca632-2e35853c] [] Reconnecting session to cluster  in 0.000000s
2025-09-30T14:50:27.660438Z :ERROR: [/Root] [/Root] [751fc20a-96e5ecfb-5d3ca632-2e35853c] [] Got error. Status: CLIENT_CALL_UNIMPLEMENTED. Description: <main>: Error: GRpc error: (12):  <main>: Error: Grpc error response on endpoint localhost:22259 <main>: Error: Endpoint list is empty for database /Root, cluster endpoint localhost:22259. 
2025-09-30T14:50:27.660445Z :DEBUG: [/Root] [/Root] [751fc20a-96e5ecfb-5d3ca632-2e35853c] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:50:27.660447Z :DEBUG: [/Root] [/Root] [751fc20a-96e5ecfb-5d3ca632-2e35853c] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:50:27.660478Z :INFO: [/Root] [/Root] [751fc20a-96e5ecfb-5d3ca632-2e35853c] [] Closing session to cluster: SessionClosed { Status: CLIENT_CALL_UNIMPLEMENTED Issues: "<main>: Error: Failed to establish connection to server "localhost:22259" ( cluster ). Attempts done: 1     <main>: Error: GRpc error: (12):      <main>: Error: Grpc error response on endpoint localhost:22259     <main>: Error: Endpoint list is empty for database /Root, cluster endpoint localhost:22259. " }
2025-09-30T14:50:27.660570Z :NOTICE: [/Root] [/Root] [751fc20a-96e5ecfb-5d3ca632-2e35853c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-09-30T14:50:27.660595Z :DEBUG: [/Root] [/Root] [751fc20a-96e5ecfb-5d3ca632-2e35853c] [] Abort session to cluster
Got new read session event: SessionClosed { Status: CLIENT_CALL_UNIMPLEMENTED Issues: "<main>: Error: Failed to establish connection to server "localhost:22259" ( cluster ). Attempts done: 1     <main>: Error: GRpc error: (12):      <main>: Error: Grpc error response on endpoint localhost:22259     <main>: Error: Endpoint list is empty for database /Root, cluster endpoint localhost:22259. " }
2025-09-30T14:50:27.660618Z :INFO: [/Root] [/Root] [751fc20a-96e5ecfb-5d3ca632-2e35853c] Closing read session. Close timeout: 0.010000s
2025-09-30T14:50:27.660629Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-09-30T14:50:27.660637Z :INFO: [/Root] [/Root] [751fc20a-96e5ecfb-5d3ca632-2e35853c] Counters: { Errors: 1 CurrentSessionLifetimeMs: 0 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:50:27.660643Z :INFO: [/Root] [/Root] [751fc20a-96e5ecfb-5d3ca632-2e35853c] Closing read session. Close timeout: 0.000000s
2025-09-30T14:50:27.660656Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-09-30T14:50:27.660659Z :INFO: [/Root] [/Root] [751fc20a-96e5ecfb-5d3ca632-2e35853c] Counters: { Errors: 1 CurrentSessionLifetimeMs: 0 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:50:27.660664Z :INFO: [/Root] [/Root] [751fc20a-96e5ecfb-5d3ca632-2e35853c] Closing read session. Close timeout: 0.000000s
2025-09-30T14:50:27.660669Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-09-30T14:50:27.660672Z :INFO: [/Root] [/Root] [751fc20a-96e5ecfb-5d3ca632-2e35853c] Counters: { Errors: 1 CurrentSessionLifetimeMs: 0 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:50:27.660677Z :NOTICE: [/Root] [/Root] [751fc20a-96e5ecfb-5d3ca632-2e35853c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-09-30T14:50:27.685585Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.685605Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.685609Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.785933Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.785949Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.785952Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.886268Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.886287Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.886291Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:11.336358Z :GetAllStartPartitionSessions INFO: Random seed for debugging is 1759243811336350
2025-09-30T14:50:11.450456Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7555894634330717995:2078];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:11.452709Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-09-30T14:50:11.457368Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7555894635984987812:2085];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:11.459112Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/rk13/00263c/r3tmp/tmp0P69Ee/pdisk_1.dat
2025-09-30T14:50:11.461482Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-09-30T14:50:11.464693Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-09-30T14:50:11.509618Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-09-30T14:50:11.515326Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-09-30T14:50:11.520164Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-09-30T14:50:11.520188Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-09-30T14:50:11.524353Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-09-30T14:50:11.524647Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-09-30T14:50:11.527098Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 29859, node 1
2025-09-30T14:50:11.545052Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/rk13/00263c/r3tmp/yandexAcRAnc.tmp
2025-09-30T14:50:11.545075Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/rk13/00263c/r3tmp/yandexAcRAnc.tmp
2025-09-30T14:50:11.545150Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/rk13/00263c/r3tmp/yandexAcRAnc.tmp
2025-09-30T14:50:11.545223Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-09-30T14:50:11.549716Z INFO: TTestServer started on Port 29819 GrpcPort 29859
2025-09-30T14:50:11.553662Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-09-30T14:50:11.553699Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-09-30T14:50:11.555237Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
TClient is connected to server localhost:29819
PQClient connected to localhost:29859
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-09-30T14:50:11.583494Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
2025-09-30T14:50:11.591878Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976720657, at schemeshard: 72057594046644480
waiting...
waiting...
waiting...
2025-09-30T14:50:11.678291Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-09-30T14:50:11.734249Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-09-30T14:50:11.892546Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7555894634330718960:2326], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:11.892590Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:11.892810Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7555894634330718983:2330], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:11.892836Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7555894634330718982:2329], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:11.892846Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:11.893973Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-09-30T14:50:11.902989Z node 1 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [1:7555894634330718986:2331], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720661 completed, doublechecking }
2025-09-30T14:50:11.941524Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:50:11.941757Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [2:7555894635984988125:2301], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-09-30T14:50:11.941902Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=2&id=ODBmNWIzZjQtOTc5Y2QyM2UtMTY1MzY5NjgtNzZmNGUzNDk=, ActorId: [2:7555894635984988084:2294], ActorState: ExecuteState, TraceId: 01k6dhmf2042rr2bf36z9nj63v, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-09-30T14:50:11.942783Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-09-30T14:50:11.982059Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:50:11.990266Z node 1 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [1:7555894634330719259:2819] txid# 281474976720664, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-09-30T14:50:12.000030Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [1:7555894634330719278:2347], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-09-30T14:50:12.000238Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=1&id=N2JiZTk3NTAtODgwMmMxMDQtMzM0NjVlZTktMTJkYTVmMmQ=, ActorId: [1:7555894634330718938:2320], ActorState: ExecuteState, TraceId: 01k6dhmf18dwjwnspxb910aaj0, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-09-30T14:50:12.000390Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-09-30T14:50:12.011173Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:29859", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-09-30T14:50:12.062409Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720666. Ctx: { TraceId: 01k6dhmf67ee4k7mr47kq4r2n5, Database: , SessionId: ydb://session/3?node_id=1&id=NTAzMTU2ZmMtMzBhM2EzMDUtODU3ZGQ5Yy05NWEzNGMxYQ==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7555894638625686811:3000] 
2025-09-30T14:50:12.453035Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-09-30T14:50:12.459687Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-09-30T14:50:16.450763Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7555894634330717995:2078];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:16.450808Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-09-30T14:50:16.457915Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7555894635984987812:2085];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:16.457964Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-09-30T14:50:17.247760Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720678:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 5 partitions
CallPersQueueGRPC request to localhost:29859
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:17.280215Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:29859
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 5
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720679
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-09-30T14:50:17.309241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:17.309993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:17.310070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-09-30T14:50:17.310085Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:17.310099Z node 1 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-09-30T14:50:17.310185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894660100523851:3324], now have 1 active actors on pipe
2025-09-30T14:50:17.310482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:17.311400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:17.318072Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720680. Ctx: { TraceId: 01k6dhmmaj9ge1yr6rr3kc8134, Database: , SessionId: ydb://session/3?node_id=1&id=NWY3ZjcwOWYtZmNlYWNkMi1jY2MwNTc2Yy01MmUwNDZkYw==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 128
StatusCode: PATH_NOT_EXIST
Issues {
  message: "Path not exist"
  issue_code: 200200
  severity: 1
}
SchemeStatus: 2
ErrorReason: "Path not found"
GetTopicVersionFromPath:  record Status: 128
StatusCode: PATH_NOT_EXIST
Issues {
  message: "Path not exist"
  issue_code: 200200
  severity: 1
}
SchemeStatus: 2
ErrorReason: "Path not found"
 name rt3.dc1--test-topic version0
2025-09-30T14:50:17.349661Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7555894660100523852:3325] connected; active server actors: 1
2025-09-30T14:50:17.349765Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [1, 2, 3, 4, 0]
2025-09-30T14:50:17.350011Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-09-30T14:50:17.350348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7555894661754792335:2378], now have 1 active actors on pipe
2025-09-30T14:50:17.350405Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1
2025-09-30T14:50:17.350935Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) (1, 72075186224037892) (2, 72075186224037892) (3, 72075186224037892) (4, 72075186224037892) 
2025-09-30T14:50:17.353358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894660100523968:3400], now have 1 active actors on pipe
2025-09-30T14:50:17.353463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:17.354448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:17.355161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:1:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:17.355184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:2:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:17.355189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:3:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:17.355192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:4:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:17.355195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:17.355216Z node 1 :PERSQUEUE DEBUG: partition.cpp:1271: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-09-30T14:50:17.355219Z node 1 :PERSQUEUE DEBUG: partition.cpp:1271: [72075186224037892][Partition][2][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-09-30T14:50:17.355222Z node 1 :PERSQUEUE DEBUG: partition.cpp:1271: [72075186224037892][Partition][3][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-09-30T14:50:17.355224Z node 1 :PERSQUEUE DEBUG: partition.cpp:1271: [72075186224037892][Partition][1][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-09-30T14:50:17.355226Z node 1 :PERSQUEUE DEBUG: partition.cpp:1271: [72075186224037892][Partition][4][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-09-30T14:50:17.355376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:1:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:17.355461Z node 1 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][1][StateInit] bootstrapping 1 [1:7555894660100523980:2470]
2025-09-30T14:50:17.356357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:1:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:17.356366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:1:Initializer] Initializing completed.
2025-09-30T14:50:17.356371Z node 1 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][1][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 1 generation 1 [1:7555894660100523980:2470]
2025-09-30T14:50:17.356378Z node 1 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][1][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 1 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-09-30T14:50:17.356726Z node 1 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][1][StateIdle] Process pending events. Count 1
2025-09-30T14:50:17.356740Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.356770Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.356773Z node 1 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-09-30T14:50:17.356777Z node 1 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][1][StateIdle] Still pending for come commits
2025-09-30T14:50:17.356779Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.356781Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.356782Z node 1 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][1][StateIdle] Still pending for come commits
2025-09-30T14:50:17.356792Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--test-topic' partition 1 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:17.356828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:2:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:17.356863Z node 1 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][2][StateInit] bootstrapping 2 [1:7555894660100523982:2470]
2025-09-30T14:50:17.357453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:2:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:17.357460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:2:Initializer] Initializing completed.
2025-09-30T14:50:17.357462Z node 1 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][2][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 2 generation 1 [1:7555894660100523982:2470]
2025-09-30T14:50:17.357466Z node 1 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][2][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 2 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-09-30T14:50:17.357699Z node 1 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][2][StateIdle] Process pending events. Count 1
2025-09-30T14:50:17.357705Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.357719Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.357721Z node 1 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][2][StateIdle] Batch completed (1)
2025-09-30T14:50:17.357724Z node 1 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][2][StateIdle] Still pending for come commits
2025-09-30T14:50:17.357727Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.357729Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.357730Z node 1 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][2][StateIdle] Still pending for come commits
2025-09-30T14:50:17.357734Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][2][StateIdle] Topic 'rt3.dc1--test-topic' partition 2 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:17.357759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:3:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:17.357793Z node 1 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][3][StateInit] bootstrapping 3 [1:7555894660100523983:2470]
2025-09-30T14:50:17.358367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:3:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:17.358374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:3:Initializer] Initializing completed.
2025-09-30T14:50:17.358376Z node 1 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][3][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 3 generation 1 [1:7555894660100523983:2470]
2025-09-30T14:50:17.358379Z node 1 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][3][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 3 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-09-30T14:50:17.358614Z node 1 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][3][StateIdle] Process pending events. Count 1
2025-09-30T14:50:17.358621Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.358631Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.358633Z node 1 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][3][StateIdle] Batch completed (1)
2025-09-30T14:50:17.358635Z node 1 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][3][StateIdle] Still pending for come commits
2025-09-30T14:50:17.358638Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.358640Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.358641Z node 1 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][3][StateIdle] Still pending for come commits
2025-09-30T14:50:17.358646Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][3][StateIdle] Topic 'rt3.dc1--test-topic' partition 3 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:17.358669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:4:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:17.358697Z node 1 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][4][StateInit] bootstrapping 4 [1:7555894660100523984:2470]
2025-09-30T14:50:17.359357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:4:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:17.359370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:4:Initializer] Initializing completed.
2025-09-30T14:50:17.359384Z node 1 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][4][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 4 generation 1 [1:7555894660100523984:2470]
2025-09-30T14:50:17.359396Z node 1 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][4][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 4 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-09-30T14:50:17.359676Z node 1 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][4][StateIdle] Process pending events. Count 1
2025-09-30T14:50:17.359687Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.359708Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.359714Z node 1 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][4][StateIdle] Batch completed (1)
2025-09-30T14:50:17.359717Z node 1 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][4][StateIdle] Still pending for come commits
2025-09-30T14:50:17.359720Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.359722Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.359724Z node 1 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][4][StateIdle] Still pending for come commits
2025-09-30T14:50:17.359730Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][4][StateIdle] Topic 'rt3.dc1--test-topic' partition 4 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:17.359772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:17.359820Z node 1 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7555894660100523985:2470]
2025-09-30T14:50:17.360389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:17.360398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:17.360402Z node 1 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [1:7555894660100523985:2470]
2025-09-30T14:50:17.360407Z node 1 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-09-30T14:50:17.360641Z node 1 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-09-30T14:50:17.360645Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.360662Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.360665Z node 1 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:17.360668Z node 1 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-09-30T14:50:17.360670Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.360672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.360674Z node 1 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-09-30T14:50:17.360679Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:17.360851Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-09-30T14:50:17.360911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][2][StateIdle] No data for blobs compaction
2025-09-30T14:50:17.360942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][3][StateIdle] No data for blobs compaction
2025-09-30T14:50:17.360974Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][4][StateIdle] No data for blobs compaction
2025-09-30T14:50:17.361056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:17.361078Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:17.362170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:17.362238Z node 1 :PERSQUEUE DEBUG: partition.cpp:1375: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759243817401, TxId 281474976720679
2025-09-30T14:50:17.362252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.362254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.362309Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:17.362385Z node 1 :PERSQUEUE DEBUG: partition.cpp:1375: [72075186224037892][Partition][1][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759243817401, TxId 281474976720679
2025-09-30T14:50:17.362398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.362400Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.362418Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Try persist
2025-09-30T14:50:17.362437Z node 1 :PERSQUEUE DEBUG: partition.cpp:1375: [72075186224037892][Partition][2][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759243817401, TxId 281474976720679
2025-09-30T14:50:17.362440Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.362441Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.362459Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][2][StateIdle] Try persist
2025-09-30T14:50:17.362482Z node 1 :PERSQUEUE DEBUG: partition.cpp:1375: [72075186224037892][Partition][3][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759243817401, TxId 281474976720679
2025-09-30T14:50:17.362491Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.362493Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.362508Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][3][StateIdle] Try persist
2025-09-30T14:50:17.362525Z node 1 :PERSQUEUE DEBUG: partition.cpp:1375: [72075186224037892][Partition][4][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759243817401, TxId 281474976720679
2025-09-30T14:50:17.362527Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.362529Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.362546Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][4][StateIdle] Try persist
2025-09-30T14:50:17.362565Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:17.362580Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:17.362584Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:17.362587Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:17.362590Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:17.363816Z node 1 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:17.363903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:17.363920Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.363922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.363924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:17.363931Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:17.363937Z node 1 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:17.363978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:17.363980Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.363981Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.363982Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Try persist
2025-09-30T14:50:17.363985Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-09-30T14:50:17.363990Z node 1 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][2][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:17.364030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][2][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:17.364032Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.364033Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.364034Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][2][StateIdle] Try persist
2025-09-30T14:50:17.364037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][2][StateIdle] No data for blobs compaction
2025-09-30T14:50:17.364040Z node 1 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][3][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:17.364072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][3][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:17.364074Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.364076Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.364077Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][3][StateIdle] Try persist
2025-09-30T14:50:17.364094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][3][StateIdle] No data for blobs compaction
2025-09-30T14:50:17.364098Z node 1 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][4][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:17.364128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][4][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:17.364130Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.364131Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.364132Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][4][StateIdle] Try persist
2025-09-30T14:50:17.364134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][4][StateIdle] No data for blobs compaction
2025-09-30T14:50:17.364332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 5 SourceIdMaxCounts: 6000000 } PartitionIds: 1 PartitionIds: 2 PartitionIds: 3 PartitionIds: 4 PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 1 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 2 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 3 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 4 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 1 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 2 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 3 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 4 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-09-30T14:50:17.364353Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:17.364414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:17.365645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:17.365692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:17.366297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:17.456847Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.456859Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.456862Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Try persist
2025-09-30T14:50:17.457293Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.457298Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.457299Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][2][StateIdle] Try persist
2025-09-30T14:50:17.458850Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.458861Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.458863Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][3][StateIdle] Try persist
2025-09-30T14:50:17.459888Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.459895Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.459898Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][4][StateIdle] Try persist
2025-09-30T14:50:17.460980Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.460991Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.460994Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:17.557164Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.557176Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.557179Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Try persist
2025-09-30T14:50:17.557669Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.557679Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.557681Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][2][StateIdle] Try persist
2025-09-30T14:50:17.559234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.559260Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.559263Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][3][StateIdle] Try persist
2025-09-30T14:50:17.560227Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.560239Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.560241Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][4][StateIdle] Try persist
2025-09-30T14:50:17.561242Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.561252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.561254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:17.657536Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.657550Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.657553Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Try persist
2025-09-30T14:50:17.658023Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.658041Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.658044Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][2][StateIdle] Try persist
2025-09-30T14:50:17.659549Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.659562Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.659565Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][3][StateIdle] Try persist
2025-09-30T14:50:17.660590Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.660599Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.660602Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][4][StateIdle] Try persist
2025-09-30T14:50:17.661608Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.661622Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.661624Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:17.757904Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.757918Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.757921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Try persist
2025-09-30T14:50:17.759342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.759357Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.759360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][2][StateIdle] Try persist
2025-09-30T14:50:17.760752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.760765Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.760791Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][3][StateIdle] Try persist
2025-09-30T14:50:17.760983Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.760993Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.760996Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][4][StateIdle] Try persist
2025-09-30T14:50:17.761952Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.761960Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.761962Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720679
    CreateStep: 1759243817401
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 5
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720679
    CreateStep: 1759243817401
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 5
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 1
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 2
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 3
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 4
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 5
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 5
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:29859
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:17.828573Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-09-30T14:50:17.858256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.858272Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.858275Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Try persist
2025-09-30T14:50:17.859732Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.859760Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.859763Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][2][StateIdle] Try persist
2025-09-30T14:50:17.861313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.861342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.861345Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][3][StateIdle] Try persist
2025-09-30T14:50:17.861374Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.861376Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.861377Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][4][StateIdle] Try persist
2025-09-30T14:50:17.862658Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.862671Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.862674Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:17.958593Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.958607Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.958611Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Try persist
2025-09-30T14:50:17.960113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.960125Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.960128Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][2][StateIdle] Try persist
2025-09-30T14:50:17.961647Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.961660Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.961663Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][3][StateIdle] Try persist
2025-09-30T14:50:17.961674Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.961677Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.961679Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][4][StateIdle] Try persist
2025-09-30T14:50:17.962688Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.962700Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.962702Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.058933Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.058951Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.058954Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Try persist
2025-09-30T14:50:18.060479Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.060492Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.060495Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][2][StateIdle] Try persist
2025-09-30T14:50:18.061985Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.061995Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.062001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][3][StateIdle] Try persist
2025-09-30T14:50:18.062010Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.062013Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.062015Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][4][StateIdle] Try persist
2025-09-30T14:50:18.063028Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.063039Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.063042Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.159314Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.159347Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.159350Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Try persist
2025-09-30T14:50:18.160816Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.160828Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.160830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][2][StateIdle] Try persist
2025-09-30T14:50:18.162355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.162369Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.162372Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][3][StateIdle] Try persist
2025-09-30T14:50:18.162391Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.162393Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.162394Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][4][StateIdle] Try persist
2025-09-30T14:50:18.163379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.163399Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.163401Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.259657Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.259676Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.259678Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Try persist
2025-09-30T14:50:18.261147Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.261161Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.261164Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][2][StateIdle] Try persist
2025-09-30T14:50:18.262730Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.262759Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.262762Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][3][StateIdle] Try persist
2025-09-30T14:50:18.262778Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.262781Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.262783Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][4][StateIdle] Try persist
2025-09-30T14:50:18.263716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.263728Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.263730Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:29859
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:18.330375Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 5
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-09-30T14:50:18.332068Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-09-30T14:50:18.332299Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-09-30T14:50:18.332306Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:29859
2025-09-30T14:50:18.333062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:18.333077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-09-30T14:50:18.334768Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-09-30T14:50:18.335005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-09-30T14:50:18.335068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:34854
2025-09-30T14:50:18.335089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34854 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:18.335097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:18.335650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-09-30T14:50:18.335703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:18.335709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:18.335712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:18.335729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894664395491474:2507] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:18.336357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894664395491474:2507] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:18.359991Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.360003Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.360005Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Try persist
2025-09-30T14:50:18.361505Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.361518Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.361521Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][2][StateIdle] Try persist
2025-09-30T14:50:18.362999Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.363009Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.363011Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][3][StateIdle] Try persist
2025-09-30T14:50:18.363021Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.363023Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.363025Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][4][StateIdle] Try persist
2025-09-30T14:50:18.364095Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.364104Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.364107Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.369045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7555894664395491474:2507] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-09-30T14:50:18.369259Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894664395491505:2507] connected; active server actors: 1
2025-09-30T14:50:18.369396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7555894664395491474:2507] (SourceId=src, PreferedPartition=(NULL)) Received partition 2 from PQRB for SourceId=src
2025-09-30T14:50:18.369408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894664395491474:2507] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:18.369552Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894664395491505:2507] disconnected; active server actors: 1
2025-09-30T14:50:18.369563Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894664395491505:2507] disconnected no session
2025-09-30T14:50:18.390805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894664395491474:2507] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:18.390823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894664395491474:2507] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=2, SeqNo=(NULL)
2025-09-30T14:50:18.390827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894664395491474:2507] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:18.390836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 2 expectedGeneration: (NULL)
2025-09-30T14:50:18.390982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=2) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1
2025-09-30T14:50:18.391002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894664395491526:2507], now have 1 active actors on pipe
2025-09-30T14:50:18.391010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.391017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 2
2025-09-30T14:50:18.391048Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|151f1c6e-7411abb1-8ee29d22-ee4c5600_0 generated for partition 2 topic 'rt3.dc1--test-topic' owner src
2025-09-30T14:50:18.391068Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.391074Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.391077Z node 1 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][2][StateIdle] Batch completed (1)
2025-09-30T14:50:18.391094Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][2][StateIdle] Try persist
2025-09-30T14:50:18.391110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][2][StateIdle] TPartition::ReplyOwnerOk. Partition: 2
2025-09-30T14:50:18.391129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 2 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:18.391163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.391165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 2
2025-09-30T14:50:18.391177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 2 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:18.391220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 2 MaxSeqNo: 0 sessionId: src|151f1c6e-7411abb1-8ee29d22-ee4c5600_0
2025-09-30T14:50:18.391597Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759243818391 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:50:18.391656Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|151f1c6e-7411abb1-8ee29d22-ee4c5600_0" topic: "test-topic" cluster: "dc1" partition_id: 2 supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:18.391795Z :INFO: [] MessageGroupId [src] SessionId [src|151f1c6e-7411abb1-8ee29d22-ee4c5600_0] Write session: close. Timeout = 0 ms
2025-09-30T14:50:18.391806Z :INFO: [] MessageGroupId [src] SessionId [src|151f1c6e-7411abb1-8ee29d22-ee4c5600_0] Write session will now close
2025-09-30T14:50:18.391813Z :DEBUG: [] MessageGroupId [src] SessionId [src|151f1c6e-7411abb1-8ee29d22-ee4c5600_0] Write session: aborting
2025-09-30T14:50:18.391996Z :INFO: [] MessageGroupId [src] SessionId [src|151f1c6e-7411abb1-8ee29d22-ee4c5600_0] Write session: gracefully shut down, all writes complete
2025-09-30T14:50:18.392002Z :DEBUG: [] MessageGroupId [src] SessionId [src|151f1c6e-7411abb1-8ee29d22-ee4c5600_0] Write session: destroy
2025-09-30T14:50:18.392267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|151f1c6e-7411abb1-8ee29d22-ee4c5600_0 grpc read done: success: 0 data: 
2025-09-30T14:50:18.392278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|151f1c6e-7411abb1-8ee29d22-ee4c5600_0 grpc read failed
2025-09-30T14:50:18.392288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|151f1c6e-7411abb1-8ee29d22-ee4c5600_0 grpc closed
2025-09-30T14:50:18.392294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|151f1c6e-7411abb1-8ee29d22-ee4c5600_0 is DEAD
2025-09-30T14:50:18.392572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=2) Received event: NActors::TEvents::TEvPoison
2025-09-30T14:50:18.393277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7555894664395491526:2507] destroyed
2025-09-30T14:50:18.393294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][2][StateIdle] TPartition::DropOwner.
2025-09-30T14:50:18.393301Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.393304Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.393306Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][2][StateIdle] Try persist
Session was created
2025-09-30T14:50:18.460355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.460372Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.460375Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Try persist
2025-09-30T14:50:18.461852Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.461865Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.461868Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][2][StateIdle] Try persist
2025-09-30T14:50:18.463400Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.463407Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.463409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][3][StateIdle] Try persist
2025-09-30T14:50:18.463422Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.463425Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.463427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][4][StateIdle] Try persist
2025-09-30T14:50:18.464425Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.464433Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.464436Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.560717Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.560733Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.560736Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Try persist
2025-09-30T14:50:18.562224Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.562234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.562237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][2][StateIdle] Try persist
2025-09-30T14:50:18.563766Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.563778Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.563781Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][3][StateIdle] Try persist
2025-09-30T14:50:18.563795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.563798Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.563801Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][4][StateIdle] Try persist
2025-09-30T14:50:18.564907Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.564919Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.564922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.661062Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.661077Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.661081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Try persist
2025-09-30T14:50:18.662583Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.662598Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.662601Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][2][StateIdle] Try persist
2025-09-30T14:50:18.664079Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.664089Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.664092Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][3][StateIdle] Try persist
2025-09-30T14:50:18.664103Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.664106Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.664108Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][4][StateIdle] Try persist
2025-09-30T14:50:18.665084Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.665093Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.665096Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.761371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.761386Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.761389Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Try persist
2025-09-30T14:50:18.762938Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.762950Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.762952Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][2][StateIdle] Try persist
2025-09-30T14:50:18.764474Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.764487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.764489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][3][StateIdle] Try persist
2025-09-30T14:50:18.764506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.764509Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.764510Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][4][StateIdle] Try persist
2025-09-30T14:50:18.765503Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.765514Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.765517Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.861765Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.861780Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.861784Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Try persist
2025-09-30T14:50:18.863279Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.863287Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.863293Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][2][StateIdle] Try persist
2025-09-30T14:50:18.864787Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.864794Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.864797Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][3][StateIdle] Try persist
2025-09-30T14:50:18.864805Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.864807Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.864810Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][4][StateIdle] Try persist
2025-09-30T14:50:18.865821Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.865828Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.865830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.962107Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.962123Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.962126Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Try persist
2025-09-30T14:50:18.963658Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.963674Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.963678Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][2][StateIdle] Try persist
2025-09-30T14:50:18.965387Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.965401Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.965404Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][3][StateIdle] Try persist
2025-09-30T14:50:18.965421Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.965422Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.965423Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][4][StateIdle] Try persist
2025-09-30T14:50:18.966161Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.966169Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.966184Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.062478Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.062497Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.062501Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Try persist
2025-09-30T14:50:19.063983Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.063992Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.063993Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][2][StateIdle] Try persist
2025-09-30T14:50:19.065530Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.065538Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.065539Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][3][StateIdle] Try persist
2025-09-30T14:50:19.065551Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.065552Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.065554Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][4][StateIdle] Try persist
2025-09-30T14:50:19.066553Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.066566Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.066569Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.162824Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.162841Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.162843Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Try persist
2025-09-30T14:50:19.164337Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.164346Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.164348Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][2][StateIdle] Try persist
2025-09-30T14:50:19.165847Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.165856Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.165858Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][3][StateIdle] Try persist
2025-09-30T14:50:19.165868Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.165870Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.165872Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][4][StateIdle] Try persist
2025-09-30T14:50:19.166885Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.166895Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.166897Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.264207Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.264223Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.264226Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Try persist
2025-09-30T14:50:19.266992Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.267006Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.267008Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][2][StateIdle] Try persist
2025-09-30T14:50:19.267033Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.267036Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.267038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][3][StateIdle] Try persist
2025-09-30T14:50:19.267048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.267050Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.267052Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][4][StateIdle] Try persist
2025-09-30T14:50:19.267264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.267281Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.267282Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.366327Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.366337Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.366339Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Try persist
2025-09-30T14:50:19.367082Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.367086Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.367088Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][2][StateIdle] Try persist
2025-09-30T14:50:19.367099Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.367101Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.367103Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][3][StateIdle] Try persist
2025-09-30T14:50:19.367121Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.367123Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.367125Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][4][StateIdle] Try persist
2025-09-30T14:50:19.367589Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.367593Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.367594Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-09-30T14:50:19.401676Z :INFO: [/Root] [] [55f373a3-80f212ca-11ac151b-c5dbd5ce] Open read subsessions to databases: { name: dc1, endpoint: localhost:29859, path: /Root }, { name: dc2, endpoint: localhost:29859, path: /Root }
2025-09-30T14:50:19.404075Z :INFO: [/Root] [/Root] [1aa6b6cc-4f054b1f-ddcecbf-57b9af7a] Starting read session
2025-09-30T14:50:19.404101Z :DEBUG: [/Root] [/Root] [1aa6b6cc-4f054b1f-ddcecbf-57b9af7a] Starting single session
2025-09-30T14:50:19.404340Z :DEBUG: [/Root] [/Root] [1aa6b6cc-4f054b1f-ddcecbf-57b9af7a] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:50:19.404347Z :DEBUG: [/Root] [/Root] [1aa6b6cc-4f054b1f-ddcecbf-57b9af7a] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:50:19.404352Z :DEBUG: [/Root] [/Root] [1aa6b6cc-4f054b1f-ddcecbf-57b9af7a] [] Reconnecting session to cluster  in 0.000000s
2025-09-30T14:50:19.404998Z :INFO: [/Root] [/Root] [c22a3850-ea958d17-d8dbb232-a095932c] Starting read session
2025-09-30T14:50:19.405006Z :DEBUG: [/Root] [/Root] [c22a3850-ea958d17-d8dbb232-a095932c] Starting single session
2025-09-30T14:50:19.405030Z :DEBUG: [/Root] [/Root] [c22a3850-ea958d17-d8dbb232-a095932c] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:50:19.405033Z :DEBUG: [/Root] [/Root] [c22a3850-ea958d17-d8dbb232-a095932c] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:50:19.405037Z :DEBUG: [/Root] [/Root] [c22a3850-ea958d17-d8dbb232-a095932c] [] Reconnecting session to cluster  in 0.000000s
2025-09-30T14:50:19.444952Z :DEBUG: [/Root] [/Root] [c22a3850-ea958d17-d8dbb232-a095932c] [] Successfully connected. Initializing session
2025-09-30T14:50:19.444962Z :DEBUG: [/Root] [/Root] [1aa6b6cc-4f054b1f-ddcecbf-57b9af7a] [] Successfully connected. Initializing session
2025-09-30T14:50:19.448284Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:50:19.448299Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-09-30T14:50:19.448332Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:50:19.448334Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 2
2025-09-30T14:50:19.450730Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:50:19.450734Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:50:19.450827Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 2 consumer shared/user session shared/user_1_2_13831686098661369801_v1 read init: from# ipv6:[::1]:32802, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:50:19.450842Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 read init: from# ipv6:[::1]:32802, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:50:19.450917Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 auth for : user
2025-09-30T14:50:19.450924Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_1_2_13831686098661369801_v1 auth for : user
2025-09-30T14:50:19.451090Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 Handle describe topics response
2025-09-30T14:50:19.451099Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_1_2_13831686098661369801_v1 Handle describe topics response
2025-09-30T14:50:19.451109Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 auth is DEAD
2025-09-30T14:50:19.451119Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_1_2_13831686098661369801_v1 auth is DEAD
2025-09-30T14:50:19.451128Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:50:19.451151Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 2 consumer shared/user session shared/user_1_2_13831686098661369801_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:50:19.451414Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 2 consumer shared/user session shared/user_1_2_13831686098661369801_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:50:19.451428Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:50:19.451883Z :INFO: [/Root] [/Root] [1aa6b6cc-4f054b1f-ddcecbf-57b9af7a] [] Got InitResponse. ReadSessionId: shared/user_1_2_13831686098661369801_v1
2025-09-30T14:50:19.451900Z :DEBUG: [/Root] [/Root] [1aa6b6cc-4f054b1f-ddcecbf-57b9af7a] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:50:19.451965Z :DEBUG: [/Root] [/Root] [1aa6b6cc-4f054b1f-ddcecbf-57b9af7a] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-09-30T14:50:19.451991Z :INFO: [/Root] [/Root] [c22a3850-ea958d17-d8dbb232-a095932c] [] Got InitResponse. ReadSessionId: shared/user_1_1_1925820975600623554_v1
2025-09-30T14:50:19.451994Z :DEBUG: [/Root] [/Root] [c22a3850-ea958d17-d8dbb232-a095932c] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:50:19.452028Z :DEBUG: [/Root] [/Root] [c22a3850-ea958d17-d8dbb232-a095932c] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-09-30T14:50:19.452325Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 assign: record# { Partition: 4 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_1_1_1925820975600623554_v1" ClientId: "user" PipeClient { RawX1: 7555894668690458919 RawX2: 4503603922340328 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:50:19.452361Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 assign: record# { Partition: 2 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 3 Session: "shared/user_1_1_1925820975600623554_v1" ClientId: "user" PipeClient { RawX1: 7555894668690458919 RawX2: 4503603922340328 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:50:19.452389Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 5 Session: "shared/user_1_1_1925820975600623554_v1" ClientId: "user" PipeClient { RawX1: 7555894668690458919 RawX2: 4503603922340328 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:50:19.451647Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894668690458918:2537] connected; active server actors: 1
2025-09-30T14:50:19.452406Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-09-30T14:50:19.451684Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894668690458919:2536] connected; active server actors: 1
2025-09-30T14:50:19.451801Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555894668690458919:2536] session shared/user_1_1_1925820975600623554_v1
2025-09-30T14:50:19.451815Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:50:19.451831Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:50:19.451834Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 1
2025-09-30T14:50:19.451840Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=2 (Status=Free, Partitions=[1])
2025-09-30T14:50:19.451843Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 2
2025-09-30T14:50:19.451849Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=3 (Status=Free, Partitions=[2])
2025-09-30T14:50:19.451851Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 3
2025-09-30T14:50:19.451856Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=4 (Status=Free, Partitions=[3])
2025-09-30T14:50:19.451859Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 4
2025-09-30T14:50:19.451876Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=5 (Status=Free, Partitions=[4])
2025-09-30T14:50:19.451884Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_1_1925820975600623554_v1" (Sender=[1:7555894668690458912:2536], Pipe=[1:7555894668690458919:2536], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:50:19.451889Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:50:19.451900Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555894668690458918:2537] session shared/user_1_2_13831686098661369801_v1
2025-09-30T14:50:19.452478Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 got read request: guid# 39ed380-5f04faea-f186d3b7-48a6c8c7
2025-09-30T14:50:19.451904Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_2_13831686098661369801_v1" (Sender=[1:7555894668690458913:2537], Pipe=[1:7555894668690458918:2537], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:50:19.451917Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=2, Families=5, UnradableFamilies=5 [5 (4), 4 (3), 3 (2), 2 (1), 1 (0), ], RequireBalancing=0 []
2025-09-30T14:50:19.451929Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=5 (Status=Free, Partitions=[4]) for ReadingSession "shared/user_1_1_1925820975600623554_v1" (Sender=[1:7555894668690458912:2536], Pipe=[1:7555894668690458919:2536], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:50:19.451951Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 5 status Active partitions [4] session "shared/user_1_1_1925820975600623554_v1" sender [1:7555894668690458912:2536] lock partition 4 for ReadingSession "shared/user_1_1_1925820975600623554_v1" (Sender=[1:7555894668690458912:2536], Pipe=[1:7555894668690458919:2536], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-09-30T14:50:19.451969Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=4 (Status=Free, Partitions=[3]) for ReadingSession "shared/user_1_2_13831686098661369801_v1" (Sender=[1:7555894668690458913:2537], Pipe=[1:7555894668690458918:2537], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:50:19.451974Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 4 status Active partitions [3] session "shared/user_1_2_13831686098661369801_v1" sender [1:7555894668690458913:2537] lock partition 3 for ReadingSession "shared/user_1_2_13831686098661369801_v1" (Sender=[1:7555894668690458913:2537], Pipe=[1:7555894668690458918:2537], Partitions=[], ActiveFamilyCount=1) generation 1 step 2
2025-09-30T14:50:19.451982Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=3 (Status=Free, Partitions=[2]) for ReadingSession "shared/user_1_1_1925820975600623554_v1" (Sender=[1:7555894668690458912:2536], Pipe=[1:7555894668690458919:2536], Partitions=[], ActiveFamilyCount=1)
2025-09-30T14:50:19.451995Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 3 status Active partitions [2] session "shared/user_1_1_1925820975600623554_v1" sender [1:7555894668690458912:2536] lock partition 2 for ReadingSession "shared/user_1_1_1925820975600623554_v1" (Sender=[1:7555894668690458912:2536], Pipe=[1:7555894668690458919:2536], Partitions=[], ActiveFamilyCount=2) generation 1 step 3
2025-09-30T14:50:19.452503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1)
2025-09-30T14:50:19.452529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:2)
2025-09-30T14:50:19.452538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:3)
2025-09-30T14:50:19.452003Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=2 (Status=Free, Partitions=[1]) for ReadingSession "shared/user_1_2_13831686098661369801_v1" (Sender=[1:7555894668690458913:2537], Pipe=[1:7555894668690458918:2537], Partitions=[], ActiveFamilyCount=1)
2025-09-30T14:50:19.452009Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 2 status Active partitions [1] session "shared/user_1_2_13831686098661369801_v1" sender [1:7555894668690458913:2537] lock partition 1 for ReadingSession "shared/user_1_2_13831686098661369801_v1" (Sender=[1:7555894668690458913:2537], Pipe=[1:7555894668690458918:2537], Partitions=[], ActiveFamilyCount=2) generation 1 step 4
2025-09-30T14:50:19.452017Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_1_1925820975600623554_v1" (Sender=[1:7555894668690458912:2536], Pipe=[1:7555894668690458919:2536], Partitions=[], ActiveFamilyCount=2)
2025-09-30T14:50:19.452023Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_1_1925820975600623554_v1" sender [1:7555894668690458912:2536] lock partition 0 for ReadingSession "shared/user_1_1_1925820975600623554_v1" (Sender=[1:7555894668690458912:2536], Pipe=[1:7555894668690458919:2536], Partitions=[], ActiveFamilyCount=3) generation 1 step 5
2025-09-30T14:50:19.452028Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=5, sessionCount=2, desiredFamilyCount=2, allowPlusOne=1
2025-09-30T14:50:19.452033Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000114s
2025-09-30T14:50:19.452606Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_1_2_13831686098661369801_v1 assign: record# { Partition: 3 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 2 Session: "shared/user_1_2_13831686098661369801_v1" ClientId: "user" PipeClient { RawX1: 7555894668690458918 RawX2: 4503603922340329 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:50:19.452620Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_13831686098661369801_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-09-30T14:50:19.452651Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_1_2_13831686098661369801_v1 assign: record# { Partition: 1 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 4 Session: "shared/user_1_2_13831686098661369801_v1" ClientId: "user" PipeClient { RawX1: 7555894668690458918 RawX2: 4503603922340329 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:50:19.452667Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_1_2_13831686098661369801_v1 got read request: guid# 8d6dae73-13fd37c6-7b2e78eb-7280a05a
2025-09-30T14:50:19.452693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7555894668690458924:2543]
2025-09-30T14:50:19.452705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:2) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7555894668690458925:2544]
2025-09-30T14:50:19.452715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_13831686098661369801_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2)
2025-09-30T14:50:19.452733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894668690458924:2543], now have 1 active actors on pipe
2025-09-30T14:50:19.452737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894668690458925:2544], now have 1 active actors on pipe
2025-09-30T14:50:19.452740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894668690458926:2545], now have 1 active actors on pipe
2025-09-30T14:50:19.452748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.452755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 4
2025-09-30T14:50:19.452779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_1925820975600623554_v1 on pipe: [1:7555894668690458924:2543]
2025-09-30T14:50:19.452793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.452795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 2
2025-09-30T14:50:19.452799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_1925820975600623554_v1 on pipe: [1:7555894668690458925:2544]
2025-09-30T14:50:19.452816Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.452828Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.452830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][4][StateIdle] Batch completed (1)
2025-09-30T14:50:19.452851Z node 1 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][4][StateIdle] Topic 'rt3.dc1--test-topic' partition 4 user user session is set to 0 (startOffset 0) session shared/user_1_1_1925820975600623554_v1
2025-09-30T14:50:19.452859Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][4][StateIdle] Try persist
2025-09-30T14:50:19.452892Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.452898Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.452900Z node 1 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][2][StateIdle] Batch completed (1)
2025-09-30T14:50:19.452910Z node 1 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][2][StateIdle] Topic 'rt3.dc1--test-topic' partition 2 user user session is set to 0 (startOffset 0) session shared/user_1_1_1925820975600623554_v1
2025-09-30T14:50:19.452917Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][2][StateIdle] Try persist
2025-09-30T14:50:19.452930Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:19.452943Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:19.453171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:3) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7555894668690458926:2545]
2025-09-30T14:50:19.453183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_13831686098661369801_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:1)
2025-09-30T14:50:19.453197Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_1925820975600623554_v1:1 with generation 1
2025-09-30T14:50:19.453210Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_1925820975600623554_v1:2 with generation 1
2025-09-30T14:50:19.453298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.453310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.453320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_1925820975600623554_v1 on pipe: [1:7555894668690458926:2545]
2025-09-30T14:50:19.453332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894668690458931:2546], now have 1 active actors on pipe
2025-09-30T14:50:19.453347Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.453356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.453359Z node 1 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:19.453372Z node 1 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_1_1925820975600623554_v1
2025-09-30T14:50:19.453380Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.453404Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:19.453440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13831686098661369801_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7555894668690458931:2546]
2025-09-30T14:50:19.453449Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_1925820975600623554_v1:3 with generation 1
2025-09-30T14:50:19.453464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13831686098661369801_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7555894668690458935:2542]
2025-09-30T14:50:19.453515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.453537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 1
2025-09-30T14:50:19.453542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_2_13831686098661369801_v1 on pipe: [1:7555894668690458931:2546]
2025-09-30T14:50:19.453556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894668690458935:2542], now have 1 active actors on pipe
2025-09-30T14:50:19.453559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.453561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 3
2025-09-30T14:50:19.453565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_2_13831686098661369801_v1 on pipe: [1:7555894668690458935:2542]
2025-09-30T14:50:19.453573Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.453577Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.453579Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_2_13831686098661369801_v1:2 with generation 1
2025-09-30T14:50:19.453579Z node 1 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-09-30T14:50:19.453583Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_2_13831686098661369801_v1:1 with generation 1
2025-09-30T14:50:19.453588Z node 1 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--test-topic' partition 1 user user session is set to 0 (startOffset 0) session shared/user_1_2_13831686098661369801_v1
2025-09-30T14:50:19.453590Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Try persist
2025-09-30T14:50:19.453606Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.453609Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.453610Z node 1 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][3][StateIdle] Batch completed (1)
2025-09-30T14:50:19.453617Z node 1 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][3][StateIdle] Topic 'rt3.dc1--test-topic' partition 3 user user session is set to 0 (startOffset 0) session shared/user_1_2_13831686098661369801_v1
2025-09-30T14:50:19.453620Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][3][StateIdle] Try persist
2025-09-30T14:50:19.453629Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:19.453636Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:19.453791Z node 1 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][4][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:19.453822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][4][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:19.453835Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.453842Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.453843Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][4][StateIdle] Try persist
2025-09-30T14:50:19.453847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][4][StateIdle] No data for blobs compaction
2025-09-30T14:50:19.453851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][2][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:19.453865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][2][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:19.453871Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.453873Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.453874Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][2][StateIdle] Try persist
2025-09-30T14:50:19.453877Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][2][StateIdle] No data for blobs compaction
2025-09-30T14:50:19.453887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 4 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:50:19.453903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 2 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:50:19.453932Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759243819367 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:50:19.453938Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:2) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759243819367 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:50:19.453941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-09-30T14:50:19.453946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:2) EndOffset 0 readOffset 0 committedOffset 0
2025-09-30T14:50:19.453965Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 sending to client partition status
2025-09-30T14:50:19.453994Z node 1 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:19.454016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:19.454022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.454024Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.454026Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.454032Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:19.454040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:50:19.454056Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:3) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759243819367 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:50:19.454060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:3) EndOffset 0 readOffset 0 committedOffset 0
2025-09-30T14:50:19.454077Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 sending to client partition status
2025-09-30T14:50:19.454096Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 sending to client partition status
2025-09-30T14:50:19.454164Z node 1 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:19.454186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:19.454193Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.454195Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.454196Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Try persist
2025-09-30T14:50:19.454201Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-09-30T14:50:19.454204Z node 1 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][3][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:19.454220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][3][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:19.454233Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.454237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.454239Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][3][StateIdle] Try persist
2025-09-30T14:50:19.454241Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][3][StateIdle] No data for blobs compaction
2025-09-30T14:50:19.454247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 1 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:50:19.454253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 3 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:50:19.454278Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_13831686098661369801_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759243819366 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:50:19.454287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_1_2_13831686098661369801_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2) EndOffset 0 readOffset 0 committedOffset 0
Got new read session event: 2025-09-30T14:50:19.454301Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_13831686098661369801_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759243819367 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 4 Database name: dc2 Database path: /Root Database id: account-dc2 CommittedOffset: 0 EndOffset: 0 }2025-09-30T14:50:19.454309Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_1_2_13831686098661369801_v1 sending to client partition status
2025-09-30T14:50:19.454314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_1_2_13831686098661369801_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-09-30T14:50:19.454354Z :INFO: [/Root] [/Root] [c22a3850-ea958d17-d8dbb232-a095932c] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 4. Read offset: (NULL)
Got new read session event: StartPartitionSession { Partition session id: 2 Topic: "test-topic" Partition: 2 Database name: dc2 Database path: /Root Database id: account-dc2 CommittedOffset: 0 EndOffset: 0 }
2025-09-30T14:50:19.454467Z :INFO: [/Root] [/Root] [c22a3850-ea958d17-d8dbb232-a095932c] [] Confirm partition stream create. Partition stream id: 2. Cluster: "-". Topic: "test-topic". Partition: 2. Read offset: (NULL)
Got new read session event: StartPartitionSession { Partition session id: 3 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 CommittedOffset: 0 EndOffset: 0 }
2025-09-30T14:50:19.454505Z :INFO: [/Root] [/Root] [c22a3850-ea958d17-d8dbb232-a095932c] [] Confirm partition stream create. Partition stream id: 3. Cluster: "-". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-09-30T14:50:19.454433Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_1_2_13831686098661369801_v1 sending to client partition status
2025-09-30T14:50:19.454545Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-09-30T14:50:19.454575Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1), readOffset# 0, commitOffset# (empty maybe)
2025-09-30T14:50:19.454588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-09-30T14:50:19.454602Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) wait data in partition inited, cookie 1 from offset 0
Got new read session event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 1 Database name: dc1 Database path: /Root Database id: account-dc1 CommittedOffset: 0 EndOffset: 0 }
2025-09-30T14:50:19.454631Z :INFO: [/Root] [/Root] [1aa6b6cc-4f054b1f-ddcecbf-57b9af7a] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 1. Read offset: (NULL)
Got new read session event: StartPartitionSession { Partition session id: 2 Topic: "test-topic" Partition: 3 Database name: dc1 Database path: /Root Database id: account-dc1 CommittedOffset: 0 EndOffset: 0 }
2025-09-30T14:50:19.454661Z :INFO: [/Root] [/Root] [1aa6b6cc-4f054b1f-ddcecbf-57b9af7a] [] Confirm partition stream create. Partition stream id: 2. Cluster: "-". Topic: "test-topic". Partition: 3. Read offset: (NULL)
2025-09-30T14:50:19.454669Z :INFO: [/Root] [/Root] [1aa6b6cc-4f054b1f-ddcecbf-57b9af7a] Closing read session. Close timeout: 0.010000s
2025-09-30T14:50:19.454682Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:3:2:0:0 -:test-topic:1:1:0:0
2025-09-30T14:50:19.454648Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 2 } }
2025-09-30T14:50:19.454689Z :INFO: [/Root] [/Root] [1aa6b6cc-4f054b1f-ddcecbf-57b9af7a] Counters: { Errors: 0 CurrentSessionLifetimeMs: 50 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:50:19.454701Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:2), readOffset# 0, commitOffset# (empty maybe)
2025-09-30T14:50:19.454721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:2) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-09-30T14:50:19.454732Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:2) wait data in partition inited, cookie 1 from offset 0
2025-09-30T14:50:19.454762Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 3 } }
2025-09-30T14:50:19.454818Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:3), readOffset# 0, commitOffset# (empty maybe)
2025-09-30T14:50:19.454837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:3) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-09-30T14:50:19.454847Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:3) wait data in partition inited, cookie 1 from offset 0
2025-09-30T14:50:19.454858Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_13831686098661369801_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 2 } }
2025-09-30T14:50:19.454898Z :INFO: [/Root] [/Root] [c22a3850-ea958d17-d8dbb232-a095932c] Closing read session. Close timeout: 0.010000s
2025-09-30T14:50:19.454909Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:3:0:0 -:test-topic:2:2:0:0 -:test-topic:4:1:0:0
2025-09-30T14:50:19.454915Z :INFO: [/Root] [/Root] [c22a3850-ea958d17-d8dbb232-a095932c] Counters: { Errors: 0 CurrentSessionLifetimeMs: 49 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:50:19.454881Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 2 consumer shared/user session shared/user_1_2_13831686098661369801_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2), readOffset# 0, commitOffset# (empty maybe)
2025-09-30T14:50:19.454906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 2 consumer shared/user session shared/user_1_2_13831686098661369801_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-09-30T14:50:19.454911Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_1_2_13831686098661369801_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2) wait data in partition inited, cookie 1 from offset 0
2025-09-30T14:50:19.455012Z :INFO: [/Root] [/Root] [1aa6b6cc-4f054b1f-ddcecbf-57b9af7a] Closing read session. Close timeout: 0.000000s
2025-09-30T14:50:19.455018Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:3:2:0:0 -:test-topic:1:1:0:0
2025-09-30T14:50:19.455022Z :INFO: [/Root] [/Root] [1aa6b6cc-4f054b1f-ddcecbf-57b9af7a] Counters: { Errors: 0 CurrentSessionLifetimeMs: 50 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:50:19.455027Z :INFO: [/Root] [/Root] [c22a3850-ea958d17-d8dbb232-a095932c] Closing read session. Close timeout: 0.000000s
2025-09-30T14:50:19.455031Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:3:0:0 -:test-topic:2:2:0:0 -:test-topic:4:1:0:0
2025-09-30T14:50:19.455034Z :INFO: [/Root] [/Root] [c22a3850-ea958d17-d8dbb232-a095932c] Counters: { Errors: 0 CurrentSessionLifetimeMs: 50 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:50:19.455038Z :INFO: [/Root] [/Root] [c22a3850-ea958d17-d8dbb232-a095932c] Closing read session. Close timeout: 0.000000s
2025-09-30T14:50:19.455030Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 2 consumer shared/user session shared/user_1_2_13831686098661369801_v1 grpc closed
2025-09-30T14:50:19.455042Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:3:0:0 -:test-topic:2:2:0:0 -:test-topic:4:1:0:0
2025-09-30T14:50:19.455057Z :INFO: [/Root] [/Root] [c22a3850-ea958d17-d8dbb232-a095932c] Counters: { Errors: 0 CurrentSessionLifetimeMs: 50 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:50:19.455048Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_1_2_13831686098661369801_v1 is DEAD
2025-09-30T14:50:19.455071Z :NOTICE: [/Root] [/Root] [c22a3850-ea958d17-d8dbb232-a095932c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-09-30T14:50:19.455095Z :INFO: [/Root] [/Root] [1aa6b6cc-4f054b1f-ddcecbf-57b9af7a] Closing read session. Close timeout: 0.000000s
2025-09-30T14:50:19.455099Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:3:2:0:0 -:test-topic:1:1:0:0
2025-09-30T14:50:19.455101Z :INFO: [/Root] [/Root] [1aa6b6cc-4f054b1f-ddcecbf-57b9af7a] Counters: { Errors: 0 CurrentSessionLifetimeMs: 51 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:50:19.455106Z :NOTICE: [/Root] [/Root] [1aa6b6cc-4f054b1f-ddcecbf-57b9af7a] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-09-30T14:50:19.455138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_2_13831686098661369801_v1
2025-09-30T14:50:19.455150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7555894668690458931:2546] destroyed
2025-09-30T14:50:19.455154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_2_13831686098661369801_v1
2025-09-30T14:50:19.455157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7555894668690458935:2542] destroyed
2025-09-30T14:50:19.455171Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_2_13831686098661369801_v1
2025-09-30T14:50:19.455179Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_2_13831686098661369801_v1
2025-09-30T14:50:19.455202Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 grpc read done: success# 0, data# {  }
2025-09-30T14:50:19.455209Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 grpc read failed
2025-09-30T14:50:19.455213Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 grpc closed
2025-09-30T14:50:19.455221Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_1_1_1925820975600623554_v1 is DEAD
2025-09-30T14:50:19.455391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_1925820975600623554_v1
2025-09-30T14:50:19.455401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7555894668690458926:2545] destroyed
2025-09-30T14:50:19.455405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_1925820975600623554_v1
2025-09-30T14:50:19.455407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7555894668690458925:2544] destroyed
2025-09-30T14:50:19.455410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_1925820975600623554_v1
2025-09-30T14:50:19.455413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7555894668690458924:2543] destroyed
2025-09-30T14:50:19.455426Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_1925820975600623554_v1
2025-09-30T14:50:19.455429Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_1925820975600623554_v1
2025-09-30T14:50:19.455432Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_1925820975600623554_v1
2025-09-30T14:50:19.455450Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894668690458918:2537] disconnected; active server actors: 1
2025-09-30T14:50:19.455465Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894668690458918:2537] client user disconnected session shared/user_1_2_13831686098661369801_v1
2025-09-30T14:50:19.455495Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:50:19.455514Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=5, UnradableFamilies=2 [2 (1), 4 (3), ], RequireBalancing=0 []
2025-09-30T14:50:19.455528Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=4 (Status=Free, Partitions=[3]) for ReadingSession "shared/user_1_1_1925820975600623554_v1" (Sender=[1:7555894668690458912:2536], Pipe=[1:7555894668690458919:2536], Partitions=[], ActiveFamilyCount=3)
2025-09-30T14:50:19.455540Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 4 status Active partitions [3] session "shared/user_1_1_1925820975600623554_v1" sender [1:7555894668690458912:2536] lock partition 3 for ReadingSession "shared/user_1_1_1925820975600623554_v1" (Sender=[1:7555894668690458912:2536], Pipe=[1:7555894668690458919:2536], Partitions=[], ActiveFamilyCount=4) generation 1 step 6
2025-09-30T14:50:19.455555Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=2 (Status=Free, Partitions=[1]) for ReadingSession "shared/user_1_1_1925820975600623554_v1" (Sender=[1:7555894668690458912:2536], Pipe=[1:7555894668690458919:2536], Partitions=[], ActiveFamilyCount=4)
2025-09-30T14:50:19.455559Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 2 status Active partitions [1] session "shared/user_1_1_1925820975600623554_v1" sender [1:7555894668690458912:2536] lock partition 1 for ReadingSession "shared/user_1_1_1925820975600623554_v1" (Sender=[1:7555894668690458912:2536], Pipe=[1:7555894668690458919:2536], Partitions=[], ActiveFamilyCount=5) generation 1 step 7
2025-09-30T14:50:19.455566Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=5, sessionCount=1, desiredFamilyCount=5, allowPlusOne=0
2025-09-30T14:50:19.455571Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000054s
2025-09-30T14:50:19.455744Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894668690458919:2536] disconnected; active server actors: 1
2025-09-30T14:50:19.455757Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894668690458919:2536] client user disconnected session shared/user_1_1_1925820975600623554_v1
2025-09-30T14:50:19.466439Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.466454Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.466457Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Try persist
2025-09-30T14:50:19.467445Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.467460Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.467463Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][2][StateIdle] Try persist
2025-09-30T14:50:19.467477Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.467480Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.467481Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][3][StateIdle] Try persist
2025-09-30T14:50:19.467491Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.467493Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.467494Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][4][StateIdle] Try persist
2025-09-30T14:50:19.467934Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.467945Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.467947Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.566818Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.566834Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.566837Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Try persist
2025-09-30T14:50:19.567788Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.567808Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.567811Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][2][StateIdle] Try persist
2025-09-30T14:50:19.567826Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.567833Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.567835Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][3][StateIdle] Try persist
2025-09-30T14:50:19.567843Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.567845Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.567847Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][4][StateIdle] Try persist
2025-09-30T14:50:19.568280Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.568289Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.568291Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.667343Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.667360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.667363Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Try persist
2025-09-30T14:50:19.668605Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.668615Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.668618Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][2][StateIdle] Try persist
2025-09-30T14:50:19.668633Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.668635Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.668637Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][3][StateIdle] Try persist
2025-09-30T14:50:19.668644Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.668646Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.668648Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][4][StateIdle] Try persist
2025-09-30T14:50:19.668655Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.668657Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.668659Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.767489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.767507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.767510Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][1][StateIdle] Try persist
2025-09-30T14:50:19.768561Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.768581Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.768584Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][2][StateIdle] Try persist
2025-09-30T14:50:19.769028Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.769037Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.769040Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][3][StateIdle] Try persist
2025-09-30T14:50:19.769050Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.769055Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.769057Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][4][StateIdle] Try persist
2025-09-30T14:50:19.769065Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.769068Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.769071Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.002195Z :PreferredDatabaseNoFallback INFO: Random seed for debugging is 1759243820002185
2025-09-30T14:50:20.073739Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7555894673649586380:2154];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:20.073878Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-09-30T14:50:20.074864Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7555894673072369656:2075];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:20.074902Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/rk13/00263c/r3tmp/tmpPRrSSL/pdisk_1.dat
2025-09-30T14:50:20.076325Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-09-30T14:50:20.076960Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-09-30T14:50:20.077438Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-09-30T14:50:20.077521Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-09-30T14:50:20.094015Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-09-30T14:50:20.099960Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-09-30T14:50:20.099985Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-09-30T14:50:20.104380Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-09-30T14:50:20.104662Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 18467, node 3
2025-09-30T14:50:20.117878Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/rk13/00263c/r3tmp/yandexgJk7pO.tmp
2025-09-30T14:50:20.117894Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/rk13/00263c/r3tmp/yandexgJk7pO.tmp
2025-09-30T14:50:20.117982Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/rk13/00263c/r3tmp/yandexgJk7pO.tmp
2025-09-30T14:50:20.118039Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-09-30T14:50:20.121279Z INFO: TTestServer started on Port 11839 GrpcPort 18467
TClient is connected to server localhost:11839
PQClient connected to localhost:18467
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-09-30T14:50:20.137328Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-09-30T14:50:20.175229Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-09-30T14:50:20.175285Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-09-30T14:50:20.179882Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-09-30T14:50:20.340881Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-09-30T14:50:20.361418Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-09-30T14:50:20.486010Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7555894673072369953:2295], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:20.486036Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7555894673072369979:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:20.486053Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:20.486438Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7555894673072369984:2301], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:20.486455Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:20.487738Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-09-30T14:50:20.496706Z node 4 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [4:7555894673072369983:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720657 completed, doublechecking }
2025-09-30T14:50:20.522915Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [3:7555894673649587272:2330], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-09-30T14:50:20.523625Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=3&id=NTMwODE0MzMtMTY1ZGRiNGQtZDQwZjNhZWYtOWM2ZWIxNWI=, ActorId: [3:7555894673649587230:2322], ActorState: ExecuteState, TraceId: 01k6dhmqf48qdc8qtaj156xdk3, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-09-30T14:50:20.523796Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-09-30T14:50:20.525090Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:50:20.547446Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:50:20.570059Z node 4 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [4:7555894673072370049:2159] txid# 281474976720658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-09-30T14:50:20.577499Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [4:7555894673072370069:2307], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-09-30T14:50:20.578463Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=4&id=YzkyY2NjNy0zODQ5OTg0ZC01ZjNmODA1Ni00MTEwN2IwOA==, ActorId: [4:7555894673072369951:2294], ActorState: ExecuteState, TraceId: 01k6dhmqe3fj13nfexxb7b478c, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-09-30T14:50:20.578649Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-09-30T14:50:20.617389Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:18467", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-09-30T14:50:20.660689Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715664. Ctx: { TraceId: 01k6dhmqk11sqswvjzn2stc89a, Database: , SessionId: ydb://session/3?node_id=3&id=OGJmZjE3MS0xZGQ1OWUxLWExZjZiMTdiLTk3MThiZTE3, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7555894673649587719:2972] 
2025-09-30T14:50:21.075646Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-09-30T14:50:21.077166Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-09-30T14:50:25.073842Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7555894673649586380:2154];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:25.073888Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-09-30T14:50:25.075395Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7555894673072369656:2075];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:25.075463Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-09-30T14:50:25.789170Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:18467
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:25.805304Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:18467
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715677
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-09-30T14:50:25.812757Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:25.812910Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7555894695124424767:3304] connected; active server actors: 1
2025-09-30T14:50:25.813275Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-09-30T14:50:25.813416Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-09-30T14:50:25.814104Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:25.814221Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-09-30T14:50:25.814238Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:25.814250Z node 3 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-09-30T14:50:25.814346Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7555894695124424766:3303], now have 1 active actors on pipe
2025-09-30T14:50:25.814360Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [4:7555894694547206930:2384], now have 1 active actors on pipe
2025-09-30T14:50:25.814521Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-09-30T14:50:25.814602Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 3, Generation 1
2025-09-30T14:50:25.814585Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:25.815606Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:25.816823Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7555894695124424832:3355], now have 1 active actors on pipe
2025-09-30T14:50:25.816882Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:25.817570Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:25.817718Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:25.817736Z node 3 :PERSQUEUE DEBUG: partition.cpp:1271: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-09-30T14:50:25.817786Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:25.817820Z node 3 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [3:7555894695124424844:2461]
2025-09-30T14:50:25.818559Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:25.818568Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:25.818572Z node 3 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [3:7555894695124424844:2461]
2025-09-30T14:50:25.818579Z node 3 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-09-30T14:50:25.818865Z node 3 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-09-30T14:50:25.818877Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.818895Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.818901Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:25.818905Z node 3 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-09-30T14:50:25.818907Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.818910Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.818912Z node 3 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-09-30T14:50:25.818919Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:25.818992Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:25.819020Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:25.819863Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:25.819901Z node 3 :PERSQUEUE DEBUG: partition.cpp:1375: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759243825864, TxId 281474976715677
2025-09-30T14:50:25.819905Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.819907Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.819931Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.819971Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:25.820490Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:25.820558Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:25.820568Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.820571Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.820572Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.820578Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:25.820690Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-09-30T14:50:25.820713Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:25.820763Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:25.821762Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:25.821786Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:25.822205Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:25.825464Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715678. Ctx: { TraceId: 01k6dhmwmj6spy5x44raq71r00, Database: , SessionId: ydb://session/3?node_id=3&id=Y2M0YTkxMTctMzdmMTgzNjMtZDRmNjFkZTYtNWUyNTllZjQ=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715677
    CreateStep: 1759243825864
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715677
    CreateStep: 1759243825864
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:18467
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:25.832043Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-09-30T14:50:25.919183Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.919202Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.919205Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.019538Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.019553Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.019556Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.119878Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.119892Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.119895Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.220212Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.220232Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.220235Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.320575Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.320589Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.320592Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:18467
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:26.333242Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-09-30T14:50:26.420950Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.420966Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.420969Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.521268Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.521286Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.521289Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.622052Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.622082Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.622085Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.721955Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.721969Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.721973Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.822320Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.822336Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.822339Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:18467
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:26.835148Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-09-30T14:50:26.836678Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-09-30T14:50:26.836941Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-09-30T14:50:26.836947Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:18467
2025-09-30T14:50:26.837318Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-09-30T14:50:26.837495Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:26.837511Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-09-30T14:50:26.837643Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-09-30T14:50:26.837677Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:41300
2025-09-30T14:50:26.837686Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:41300 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:26.837697Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:26.838140Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-09-30T14:50:26.838173Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:26.838182Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:26.838184Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:26.838190Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7555894699419392349:2500] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:26.838836Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7555894699419392349:2500] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:26.864719Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7555894699419392349:2500] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-09-30T14:50:26.864914Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894699419392380:2500] connected; active server actors: 1
2025-09-30T14:50:26.865072Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7555894699419392349:2500] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-09-30T14:50:26.865084Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7555894699419392349:2500] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:26.865210Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894699419392380:2500] disconnected; active server actors: 1
2025-09-30T14:50:26.865221Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894699419392380:2500] disconnected no session
2025-09-30T14:50:26.884109Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7555894699419392349:2500] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:26.884129Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7555894699419392349:2500] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-09-30T14:50:26.884133Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7555894699419392349:2500] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:26.884142Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:26.884307Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-09-30T14:50:26.884332Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7555894699419392400:2500], now have 1 active actors on pipe
2025-09-30T14:50:26.884342Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:26.884351Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:26.884383Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|9dcaa2e7-8245b3db-da988641-a2a45d76_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-09-30T14:50:26.884394Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.884399Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.884401Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:26.884414Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.884428Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:26.884446Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:26.884484Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:26.884488Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:26.884508Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:26.884539Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|9dcaa2e7-8245b3db-da988641-a2a45d76_0
2025-09-30T14:50:26.884901Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759243826884 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:50:26.884944Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|9dcaa2e7-8245b3db-da988641-a2a45d76_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:26.885099Z :INFO: [] MessageGroupId [src] SessionId [src|9dcaa2e7-8245b3db-da988641-a2a45d76_0] Write session: close. Timeout = 0 ms
2025-09-30T14:50:26.885112Z :INFO: [] MessageGroupId [src] SessionId [src|9dcaa2e7-8245b3db-da988641-a2a45d76_0] Write session will now close
2025-09-30T14:50:26.885126Z :DEBUG: [] MessageGroupId [src] SessionId [src|9dcaa2e7-8245b3db-da988641-a2a45d76_0] Write session: aborting
2025-09-30T14:50:26.885307Z :INFO: [] MessageGroupId [src] SessionId [src|9dcaa2e7-8245b3db-da988641-a2a45d76_0] Write session: gracefully shut down, all writes complete
2025-09-30T14:50:26.885313Z :DEBUG: [] MessageGroupId [src] SessionId [src|9dcaa2e7-8245b3db-da988641-a2a45d76_0] Write session: destroy
2025-09-30T14:50:26.885486Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|9dcaa2e7-8245b3db-da988641-a2a45d76_0 grpc read done: success: 0 data: 
2025-09-30T14:50:26.885496Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|9dcaa2e7-8245b3db-da988641-a2a45d76_0 grpc read failed
2025-09-30T14:50:26.885506Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|9dcaa2e7-8245b3db-da988641-a2a45d76_0 grpc closed
2025-09-30T14:50:26.885511Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|9dcaa2e7-8245b3db-da988641-a2a45d76_0 is DEAD
2025-09-30T14:50:26.885745Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-09-30T14:50:26.885812Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7555894699419392400:2500] destroyed
2025-09-30T14:50:26.885825Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-09-30T14:50:26.885831Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.885833Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.885835Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
====TYdbPqTestRetryPolicy()
====ExpectBreakDown
2025-09-30T14:50:26.922690Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.922705Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.922708Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
=== Session was created, waiting for retries
>>> Ready to answer: ok
====CreateRetryState
====CreateRetryState Initialized
Test retry state: get retry delay
2025-09-30T14:50:26.943183Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-09-30T14:50:27.023010Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.023033Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.023036Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.123453Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.123472Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.123474Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.226878Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.226897Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.226901Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.327303Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.327320Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.327323Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.427498Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.427519Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.427522Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.527862Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.527886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.527888Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.628222Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.628241Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.628244Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.728583Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.728601Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.728604Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.828930Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.828947Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.828950Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.929274Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.929292Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.929296Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.029631Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.029650Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.029652Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.130063Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.130081Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.130085Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.230341Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.230360Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.230364Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.330707Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.330741Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.330744Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.431027Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.431048Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.431051Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.531403Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.531423Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.531426Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.631741Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.631758Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.631761Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.732170Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.732189Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.732205Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.832448Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.832465Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.832468Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.933503Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.933523Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.933526Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-09-30T14:50:28.943430Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-09-30T14:50:29.033673Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.033691Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.033695Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.134010Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.134027Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.134042Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.234377Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.234392Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.234396Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.334736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.334756Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.334758Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.435080Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.435098Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.435101Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.535368Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.535386Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.535399Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.637185Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.637202Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.637205Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.737681Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.737699Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.737702Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.841841Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.841863Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.841866Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.943319Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.943337Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.943341Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.043325Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.043344Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.043347Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.143676Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.143704Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.143707Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.244025Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.244046Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.244050Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.344416Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.344435Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.344439Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.447409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.447425Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.447429Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.547637Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.547655Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.547658Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.647999Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.648014Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.648017Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
E0930 14:50:30.697718185 2233229 chttp2_transport.cc:1143]             ipv4:127.0.0.1:14933: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-09-30T14:50:30.748339Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.748358Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.748361Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.819055Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:30.848710Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.848728Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.848731Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-09-30T14:50:30.947343Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
=== In the next federation discovery response dc2 will be available
2025-09-30T14:50:30.949265Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.949288Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.949300Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.049478Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.049499Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.049502Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.149758Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.149775Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.149778Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.250111Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.250127Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.250130Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.350471Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.350491Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.350494Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.450824Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.450848Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.450851Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.551177Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.551198Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.551202Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.651667Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.651687Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.651690Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.751886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.751907Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.751910Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.852192Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.852224Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.852228Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.954120Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.954147Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.954151Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.054475Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.054492Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.054496Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.154816Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.154846Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.154850Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.255800Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.255817Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.255821Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.356063Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.356084Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.356088Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.457433Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.457452Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.457456Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.557785Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.557805Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.557809Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.658112Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.658132Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.658135Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.760255Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.760274Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.760277Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.861735Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.861763Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.861766Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-09-30T14:50:32.948430Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-09-30T14:50:32.963550Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.963570Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.963573Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.064111Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.064128Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.064132Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.164501Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.164521Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.164524Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.264844Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.264862Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.264866Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.365181Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.365200Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.365203Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.465539Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.465560Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.465563Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.565893Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.565910Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.565913Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.666221Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.666239Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.666242Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.766618Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.766639Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.766642Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.868166Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.868186Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.868190Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.968334Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.968361Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.968365Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.068657Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.068673Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.068676Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.169019Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.169039Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.169043Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.269378Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.269397Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.269399Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.369708Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.369726Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.369729Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.470090Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.470108Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.470111Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.570427Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.570445Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.570450Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.670760Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.670775Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.670777Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.771163Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.771185Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.771187Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.871474Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.871496Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.871499Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-09-30T14:50:34.949439Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-09-30T14:50:34.974720Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.974742Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.974746Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.074776Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.074794Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.074797Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.087538Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7721: Cannot get console configs
2025-09-30T14:50:35.087557Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-09-30T14:50:35.179378Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.179398Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.179401Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.279534Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.279554Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.279557Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.379901Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.379921Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.379925Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.480269Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.480306Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.480308Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.580592Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.580611Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.580614Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.680950Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.680969Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.680971Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.781310Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.781339Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.781342Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.819296Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:35.881677Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.881696Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.881699Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.982021Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.982038Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.982041Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.082365Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.082380Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.082383Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.183310Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.183328Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.183331Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.283564Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.283582Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.283585Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.383929Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.383948Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.383952Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.484302Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.484318Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.484322Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.584644Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.584660Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.584664Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.684991Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.685008Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.685011Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.785360Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.785376Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.785392Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.885685Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.885704Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.885708Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
E0930 14:50:36.895261467 2224332 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:14933: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
Test retry state: get retry delay
2025-09-30T14:50:36.950766Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-09-30T14:50:36.986064Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.986083Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.986086Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.086399Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.086415Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.086418Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.186790Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.186811Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.186814Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.287090Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.287104Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.287108Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.387457Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.387476Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.387479Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.487818Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.487845Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.487848Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.588624Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.588643Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.588647Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.689033Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.689053Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.689056Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.790619Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.790638Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.790641Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.891892Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.891911Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.891915Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.994649Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.994667Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.994670Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.097948Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.097968Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.097972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.198015Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.198038Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.198041Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.298343Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.298361Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.298366Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.398660Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.398691Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.398694Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.498976Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.498994Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.499006Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.599340Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.599357Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.599361Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.699712Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.699730Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.699733Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.800072Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.800096Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.800100Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.900434Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.900454Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.900458Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-09-30T14:50:38.955407Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-09-30T14:50:39.000791Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.000812Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.000816Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.101134Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.101164Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.101167Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.201476Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.201499Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.201503Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.301832Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.301859Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.301862Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.402169Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.402190Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.402193Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.502471Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.502491Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.502506Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.602891Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.602911Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.602914Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.703273Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.703295Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.703299Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.803590Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.803611Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.803614Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.903943Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.903964Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.903968Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.004288Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.004304Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.004307Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.104643Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.104666Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.104670Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.205005Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.205025Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.205029Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.305346Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.305369Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.305373Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.405781Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.405804Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.405807Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.506074Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.506100Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.506105Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.606409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.606427Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.606431Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.706772Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.706794Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.706797Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.807100Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.807118Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.807121Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.819464Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:40.907484Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.907507Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.907510Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-09-30T14:50:40.956426Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-09-30T14:50:41.007811Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.007831Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.007835Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.108158Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.108184Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.108188Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.208534Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.208555Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.208558Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.308882Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.308902Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.308906Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.409225Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.409247Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.409250Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.509568Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.509607Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.509610Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.609923Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.609961Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.609964Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.710279Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.710302Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.710306Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.810699Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.810721Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.810725Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.910993Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.911014Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.911017Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.011339Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.011361Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.011365Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.111703Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.111726Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.111730Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.212022Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.212043Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.212046Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.312343Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.312363Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.312366Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.412748Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.412769Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.412772Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.513108Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.513129Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.513133Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.613434Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.613451Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.613455Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.713806Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.713832Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.713836Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.814118Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.814138Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.814142Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.914514Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.914538Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.914542Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-09-30T14:50:42.957441Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-09-30T14:50:43.014856Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.014876Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.014880Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.115194Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.115218Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.115222Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.215593Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.215633Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.215653Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.315924Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.315954Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.315972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.416268Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.416302Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.416319Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.516626Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.516650Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.516671Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.616939Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.616957Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.616961Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.717325Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.717373Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.717376Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.817667Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.817689Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.817692Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.918010Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.918043Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.918047Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.018396Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.018415Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.018419Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.118724Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.118747Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.118751Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.219086Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.219105Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.219108Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.319431Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.319450Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.319454Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.419779Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.419797Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.419800Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.520148Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.520169Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.520172Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.620469Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.620487Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.620491Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.720834Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.720853Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.720856Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.821152Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.821167Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.821170Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.921536Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.921553Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.921557Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-09-30T14:50:44.958546Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-09-30T14:50:45.021898Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.021914Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.021917Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.122253Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.122272Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.122276Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.222589Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.222607Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.222610Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.322940Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.322957Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.322961Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.423342Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.423367Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.423369Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.523642Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.523658Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.523662Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.623972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.623991Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.623994Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.724358Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.724376Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.724379Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.820235Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:45.824655Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.824679Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.824683Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.925061Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.925080Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.925083Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.025439Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.025458Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.025462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.125777Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.125802Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.125805Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.226109Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.226130Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.226133Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.326464Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.326485Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.326488Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.426784Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.426803Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.426807Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.527142Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.527161Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.527164Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.627520Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.627539Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.627542Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.727878Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.727896Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.727899Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.828182Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.828197Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.828201Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.928576Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.928596Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.928599Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-09-30T14:50:46.959372Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-09-30T14:50:47.028942Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.028959Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.028962Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.129312Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.129332Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.129335Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.229627Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.229644Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.229647Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.329996Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.330014Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.330017Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.430364Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.430390Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.430393Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.530665Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.530690Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.530692Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.631068Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.631087Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.631089Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.735312Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.735334Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.735337Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.835323Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.835343Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.835346Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.935685Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.935703Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.935706Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.036039Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.036059Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.036062Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.136381Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.136400Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.136404Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.236762Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.236795Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.236798Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.337091Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.337117Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.337121Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.437462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.437481Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.437485Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.537797Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.537812Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.537816Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.638148Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.638166Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.638170Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.738501Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.738520Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.738524Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.838871Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.838890Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.838894Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.939198Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.939217Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.939220Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-09-30T14:50:48.960418Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-09-30T14:50:49.039538Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.039558Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.039560Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.139916Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.139935Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.139938Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.240263Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.240286Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.240289Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.340605Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.340625Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.340628Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.440968Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.440986Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.440989Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.541305Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.541324Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.541327Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.641669Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.641692Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.641696Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.742026Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.742045Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.742049Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.842441Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.842470Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.842473Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.942727Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.942743Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.942746Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.043073Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.043094Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.043097Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.143434Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.143460Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.143463Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.243757Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.243773Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.243776Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.344144Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.344162Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.344165Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.444486Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.444504Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.444507Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.544837Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.544856Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.544859Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.645140Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.645158Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.645162Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.745525Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.745539Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.745542Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.819813Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:50.845914Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.845933Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.845937Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.946209Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.946228Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.946231Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-09-30T14:50:50.961404Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-09-30T14:50:51.046568Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.046592Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.046595Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.146952Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.146972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.146975Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.247320Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.247338Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.247341Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.347664Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.347686Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.347689Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.447991Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.448012Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.448016Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.548347Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.548367Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.548370Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.648741Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.648761Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.648764Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.749052Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.749070Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.749073Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.849416Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.849435Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.849438Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.949763Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.949780Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.949783Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.050103Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.050119Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.050123Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.150450Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.150470Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.150474Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.250784Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.250811Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.250815Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.351162Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.351179Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.351183Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.451523Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.451539Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.451542Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.551856Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.551874Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.551878Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.652223Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.652239Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.652242Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.752573Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.752590Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.752594Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.852923Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.852940Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.852944Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.953277Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.953297Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.953300Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-09-30T14:50:52.962401Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-09-30T14:50:53.053616Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.053633Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.053636Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.153968Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.153989Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.153992Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.254313Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.254330Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.254334Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.354691Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.354707Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.354710Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.454994Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.455014Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.455017Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.555404Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.555420Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.555423Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.655741Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.655760Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.655763Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.756098Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.756115Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.756117Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.856503Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.856525Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.856527Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.956784Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.956799Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.956802Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.057180Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.057198Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.057202Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.157516Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.157534Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.157537Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.257861Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.257879Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.257883Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.358208Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.358229Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.358233Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.458545Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.458561Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.458564Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.558884Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.558901Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.558904Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.659276Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.659292Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.659296Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.759628Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.759645Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.759648Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.859970Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.859988Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.859991Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.960332Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.960349Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.960351Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-09-30T14:50:54.963447Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-09-30T14:50:55.060676Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.060694Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.060698Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.161013Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.161045Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.161047Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.261395Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.261415Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.261418Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.361698Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.361715Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.361718Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.462065Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.462082Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.462097Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.562449Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.562468Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.562471Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.662735Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.662752Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.662755Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.763104Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.763126Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.763129Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.814277Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-09-30T14:50:55.814337Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-09-30T14:50:55.814712Z node 3 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:50:55.815042Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 1 DataSize: 0 UsedReserveSize: 0
2025-09-30T14:50:55.815266Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:50:55.815518Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72057594046644480, NodeId 3, Generation 2
2025-09-30T14:50:55.820014Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:55.863476Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.863495Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.863499Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.963825Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.963842Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.963845Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.064188Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.064205Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.064209Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.164497Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.164529Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.164533Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.264871Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.264891Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.264894Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.365236Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.365255Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.365258Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.465584Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.465601Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.465605Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.565942Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.565959Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.565963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.666296Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.666314Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.666317Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.766671Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.766693Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.766696Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.867033Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.867052Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.867056Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
E0930 14:50:56.895853315 2224333 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:14933: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 2500ms
Test retry state: get retry delay
2025-09-30T14:50:56.964395Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-09-30T14:50:56.967322Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.967343Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.967347Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
=== Waiting for repair
>>> Ready to answer: ok
2025-09-30T14:50:57.067703Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.067723Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.067726Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.168068Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.168087Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.168090Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.268416Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.268435Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.268438Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.368819Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.368840Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.368843Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.469115Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.469135Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.469138Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.569441Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.569456Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.569458Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.669826Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.669845Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.669849Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.770169Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.770188Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.770191Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.870529Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.870560Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.870564Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.970892Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.970911Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.970914Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.071233Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.071269Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.071272Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.171593Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.171614Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.171617Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.271905Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.271921Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.271924Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.372284Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.372298Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.372301Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.472618Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.472633Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.472636Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.572993Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.573013Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.573017Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.673326Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.673341Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.673344Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.773687Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.773703Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.773705Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.874044Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.874063Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.874066Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
=== Closing the session
2025-09-30T14:50:58.965483Z :INFO: [/Root] [] [] Start federated write session to database 'dc2' (previous was <empty>) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:18467" location: "dc1" status: AVAILABLE weight: 1000 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:18467" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:18467" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-09-30T14:50:58.968352Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-09-30T14:50:58.968588Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-09-30T14:50:58.969758Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-09-30T14:50:58.969774Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session will now close
2025-09-30T14:50:58.969795Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: aborting
2025-09-30T14:50:58.969979Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-09-30T14:50:58.970459Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:58.970505Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-09-30T14:50:58.970489Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-09-30T14:50:58.970589Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:58.970577Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId:  grpc closed
2025-09-30T14:50:58.970585Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId:  is DEAD
2025-09-30T14:50:58.970640Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: destroy
2025-09-30T14:50:58.974365Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.974381Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.974383Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.074756Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.074784Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.074787Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.175096Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.175114Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.175117Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:10.801070Z :PropagateSessionClosed INFO: Random seed for debugging is 1759243810801059
2025-09-30T14:50:10.931507Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7555894631657194415:2082];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:10.931899Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-09-30T14:50:10.936560Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-09-30T14:50:10.936884Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7555894631567473407:2079];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:10.937217Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/rk13/002667/r3tmp/tmpWNzj7b/pdisk_1.dat
2025-09-30T14:50:10.939375Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-09-30T14:50:10.982158Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-09-30T14:50:10.997926Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-09-30T14:50:11.001926Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TServer::EnableGrpc on GrpcPort 64460, node 1
2025-09-30T14:50:11.008767Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/rk13/002667/r3tmp/yandex0USY9Y.tmp
2025-09-30T14:50:11.008779Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/rk13/002667/r3tmp/yandex0USY9Y.tmp
2025-09-30T14:50:11.008852Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/rk13/002667/r3tmp/yandex0USY9Y.tmp
2025-09-30T14:50:11.008904Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-09-30T14:50:11.013970Z INFO: TTestServer started on Port 15396 GrpcPort 64460
TClient is connected to server localhost:15396
PQClient connected to localhost:64460
WaitRootIsUp 'Root'...
TClient::Ls request: Root
2025-09-30T14:50:11.033116Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-09-30T14:50:11.033150Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
TClient::Ls response: 2025-09-30T14:50:11.034686Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-09-30T14:50:11.040274Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-09-30T14:50:11.040297Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-09-30T14:50:11.041600Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-09-30T14:50:11.041877Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-09-30T14:50:11.046409Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-09-30T14:50:11.153150Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-09-30T14:50:11.402932Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7555894635952162612:2325], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:11.402936Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7555894635952162636:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:11.402958Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:11.403041Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7555894635952162639:2329], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:11.403055Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:11.403577Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7555894635952162668:2332], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:11.403596Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:11.403629Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7555894635952162672:2333], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:11.403634Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:11.404014Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-09-30T14:50:11.414477Z node 1 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [1:7555894635952162640:2330], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720661 completed, doublechecking }
2025-09-30T14:50:11.455482Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [2:7555894635862441024:2301], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-09-30T14:50:11.456134Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=2&id=NDdiM2ExMmYtZjc2MjBjZGYtNjJmMDUzOWItNzI1MjRlOGY=, ActorId: [2:7555894635862440983:2294], ActorState: ExecuteState, TraceId: 01k6dhmeje4k638xpnt341xz7x, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-09-30T14:50:11.456559Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-09-30T14:50:11.456179Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:50:11.506113Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:50:11.513256Z node 1 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [1:7555894635952162850:2764] txid# 281474976720664, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-09-30T14:50:11.519447Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [1:7555894635952162891:2347], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-09-30T14:50:11.519548Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=1&id=NzI5NTE4YmEtYjVjODNjNzAtMjBkMDJmZC03MGE3MmFlMw==, ActorId: [1:7555894635952162606:2322], ActorState: ExecuteState, TraceId: 01k6dhmej7dzx8qk0398b9qrej, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-09-30T14:50:11.519729Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-09-30T14:50:11.553603Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:64460", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-09-30T14:50:11.602403Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720666. Ctx: { TraceId: 01k6dhmeqq457d6j782k51r3vt, Database: , SessionId: ydb://session/3?node_id=1&id=ODc3NTk0NjktMjcxMDQzNTAtMTlkMzVlODAtN2JjZmQ3ODc=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7555894635952163127:2955] 
2025-09-30T14:50:11.933850Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-09-30T14:50:11.939059Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-09-30T14:50:15.931564Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7555894631657194415:2082];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:15.931603Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-09-30T14:50:15.937193Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7555894631567473407:2079];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:15.937225Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-09-30T14:50:16.779178Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720678:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:64460
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:16.803649Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:64460
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720679
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-09-30T14:50:16.813663Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7555894657427000128:3266] connected; active server actors: 1
2025-09-30T14:50:16.813750Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-09-30T14:50:16.813871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-09-30T14:50:16.814425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-09-30T14:50:16.815438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:16.816311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:16.816378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-09-30T14:50:16.816405Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:16.816426Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-09-30T14:50:16.816538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894657427000127:3265], now have 1 active actors on pipe
2025-09-30T14:50:16.816549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894657427000151:2454], now have 1 active actors on pipe
2025-09-30T14:50:16.816587Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-09-30T14:50:16.816739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:16.817887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:16.819808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894657427000185:3312], now have 1 active actors on pipe
2025-09-30T14:50:16.820011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:16.821401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:16.821655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:16.821699Z node 2 :PERSQUEUE DEBUG: partition.cpp:1271: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-09-30T14:50:16.821783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:16.821885Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894657337278073:2397]
2025-09-30T14:50:16.822745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:16.822768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:16.822775Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7555894657337278073:2397]
2025-09-30T14:50:16.822783Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-09-30T14:50:16.823134Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-09-30T14:50:16.823147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:16.823182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:16.823189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:16.823193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-09-30T14:50:16.823195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:16.823197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:16.823199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-09-30T14:50:16.823208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:16.823345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:16.823379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:16.824687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:16.824736Z node 2 :PERSQUEUE DEBUG: partition.cpp:1375: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759243816862, TxId 281474976720679
2025-09-30T14:50:16.824747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:16.824749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:16.824781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:16.824850Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:16.825624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:16.825703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:16.825719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:16.825725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:16.825728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:16.825737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:16.825880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-09-30T14:50:16.825917Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:16.825988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:16.827220Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720680. Ctx: { TraceId: 01k6dhmkv9cke2thxzxz0r4gy4, Database: , SessionId: ydb://session/3?node_id=1&id=OWQ5ZWY3ZWItYTA2MWExYjQtZTAxYTk5ZjEtMzQ3N2NhOTg=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-09-30T14:50:16.827647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:16.827684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:16.828339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720679
    CreateStep: 1759243816862
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720679
    CreateStep: 1759243816862
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:64460
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:16.834425Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-09-30T14:50:16.923317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:16.923337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:16.923340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:17.023877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.023901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.023904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:17.124590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.124609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.124613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:17.224887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.224902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.224905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:17.325300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.325319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.325323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:64460
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-09-30T14:50:17.335888Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-09-30T14:50:17.425589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.425606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.425609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:17.525953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.525967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.525971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:17.626276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.626292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.626294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:17.726665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.726681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.726684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:17.827030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.827046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.827049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:64460
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:17.837903Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-09-30T14:50:17.839746Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-09-30T14:50:17.839984Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-09-30T14:50:17.839992Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:17.840682Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:17.840701Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-09-30T14:50:17.842515Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-09-30T14:50:17.842792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-09-30T14:50:17.842863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:54574
2025-09-30T14:50:17.842875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54574 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:17.842880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:17.843441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-09-30T14:50:17.843503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:17.843506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:17.843509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:17.843525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894661721967658:2489] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:17.844157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894661721967658:2489] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:17.877162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7555894661721967658:2489] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-09-30T14:50:17.877272Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894661721967689:2489] connected; active server actors: 1
2025-09-30T14:50:17.877289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7555894661721967658:2489] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-09-30T14:50:17.877294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894661721967658:2489] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:17.877364Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894661721967689:2489] disconnected; active server actors: 1
2025-09-30T14:50:17.877367Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894661721967689:2489] disconnected no session
2025-09-30T14:50:17.895935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894661721967658:2489] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:17.895954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894661721967658:2489] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-09-30T14:50:17.895958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894661721967658:2489] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:17.895966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:17.896251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894661721967712:2489], now have 1 active actors on pipe
2025-09-30T14:50:17.896398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:17.896320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-09-30T14:50:17.896414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:17.896456Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|587290b0-c0ddc66b-a36877e5-2a0328ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-09-30T14:50:17.896474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.896483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.896486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:17.896497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:17.896510Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:17.896530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:17.896764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:17.896773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:17.896790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:17.896869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|587290b0-c0ddc66b-a36877e5-2a0328ba_0
2025-09-30T14:50:17.897270Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759243817897 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:50:17.897312Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|587290b0-c0ddc66b-a36877e5-2a0328ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:17.897472Z :INFO: [] MessageGroupId [src] SessionId [src|587290b0-c0ddc66b-a36877e5-2a0328ba_0] Write session: close. Timeout = 0 ms
2025-09-30T14:50:17.897482Z :INFO: [] MessageGroupId [src] SessionId [src|587290b0-c0ddc66b-a36877e5-2a0328ba_0] Write session will now close
2025-09-30T14:50:17.897489Z :DEBUG: [] MessageGroupId [src] SessionId [src|587290b0-c0ddc66b-a36877e5-2a0328ba_0] Write session: aborting
2025-09-30T14:50:17.897670Z :INFO: [] MessageGroupId [src] SessionId [src|587290b0-c0ddc66b-a36877e5-2a0328ba_0] Write session: gracefully shut down, all writes complete
2025-09-30T14:50:17.897675Z :DEBUG: [] MessageGroupId [src] SessionId [src|587290b0-c0ddc66b-a36877e5-2a0328ba_0] Write session: destroy
2025-09-30T14:50:17.897807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|587290b0-c0ddc66b-a36877e5-2a0328ba_0 grpc read done: success: 0 data: 
2025-09-30T14:50:17.897816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|587290b0-c0ddc66b-a36877e5-2a0328ba_0 grpc read failed
2025-09-30T14:50:17.897824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|587290b0-c0ddc66b-a36877e5-2a0328ba_0 grpc closed
2025-09-30T14:50:17.897829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|587290b0-c0ddc66b-a36877e5-2a0328ba_0 is DEAD
2025-09-30T14:50:17.898061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-09-30T14:50:17.898194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7555894661721967712:2489] destroyed
2025-09-30T14:50:17.898212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-09-30T14:50:17.898221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.898224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.898226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-09-30T14:50:17.927333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.927362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.927365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-09-30T14:50:17.953616Z :INFO: [/Root] [] [25922826-656e8983-b63bbea2-c6ef17fc] Open read subsessions to databases: { name: dc1, endpoint: localhost:64460, path: /Root }, { name: dc2, endpoint: localhost:64460, path: /Invalid }
2025-09-30T14:50:17.954447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: try to update token
2025-09-30T14:50:17.954603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session: Do CDS request
2025-09-30T14:50:17.954622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:17.955453Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] Starting read session
2025-09-30T14:50:17.955479Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] Starting single session
2025-09-30T14:50:17.955770Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:50:17.955776Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:50:17.955780Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.000000s
2025-09-30T14:50:18.008016Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:50:18.008182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:18.008233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:18.008252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-09-30T14:50:18.008284Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:50:18.008288Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-09-30T14:50:18.008519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:18.008555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:18.008565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:18.008570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:18.008704Z :INFO: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Starting read session
2025-09-30T14:50:18.008714Z :DEBUG: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Starting single session
2025-09-30T14:50:18.008758Z :DEBUG: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:50:18.008762Z :DEBUG: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:50:18.008768Z :DEBUG: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] [] Reconnecting session to cluster  in 0.000000s
2025-09-30T14:50:18.008797Z :ERROR: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] [] Got error. Status: NOT_FOUND. Description: <main>: Error: Database Invalid does not exist, code: 200202 <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. 
2025-09-30T14:50:18.008803Z :DEBUG: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:50:18.008806Z :DEBUG: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:50:18.008834Z :INFO: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] [] Closing session to cluster: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.008961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-09-30T14:50:18.009002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:18.009011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:18.009014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:18.009020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894666016935040:2510] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:18.009637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894666016935040:2510] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:18.010382Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:50:18.010468Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:50:18.010560Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 auth for : user
2025-09-30T14:50:18.010710Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 Handle describe topics response
2025-09-30T14:50:18.010738Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 auth is DEAD
2025-09-30T14:50:18.010769Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:50:18.011120Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:50:18.011240Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894666016935058:2511] connected; active server actors: 1
2025-09-30T14:50:18.011294Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_1_8923399920190016107_v1
2025-09-30T14:50:18.011282Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555894666016935058:2511] session shared/user_1_1_8923399920190016107_v1
2025-09-30T14:50:18.011290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:50:18.011308Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:50:18.011300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:50:18.011307Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_1_8923399920190016107_v1" (Sender=[1:7555894666016935037:2511], Pipe=[1:7555894666016935058:2511], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:50:18.011312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:50:18.011323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:50:18.011331Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_1_8923399920190016107_v1" (Sender=[1:7555894666016935037:2511], Pipe=[1:7555894666016935058:2511], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:50:18.011347Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_1_8923399920190016107_v1" sender [1:7555894666016935037:2511] lock partition 0 for ReadingSession "shared/user_1_1_8923399920190016107_v1" (Sender=[1:7555894666016935037:2511], Pipe=[1:7555894666016935058:2511], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-09-30T14:50:18.011446Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-09-30T14:50:18.011948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894666016935062:2517], now have 1 active actors on pipe
2025-09-30T14:50:18.012065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.012079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.012097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_8923399920190016107_v1 on pipe: [1:7555894666016935062:2517]
2025-09-30T14:50:18.012128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.012136Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_8923399920190016107_v1:1 with generation 1
2025-09-30T14:50:18.012141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.012144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:18.012165Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_1_8923399920190016107_v1
2025-09-30T14:50:18.012169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.011370Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:50:18.011380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000054s
2025-09-30T14:50:18.012202Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.011631Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_1_1_8923399920190016107_v1" ClientId: "user" PipeClient { RawX1: 7555894666016935058 RawX2: 4503603922340303 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:50:18.011647Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-09-30T14:50:18.011709Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 got read request: guid# c776aad8-4791c6d9-7904601d-7b9ffeaa
2025-09-30T14:50:18.011727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:50:18.011863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7555894666016935040:2510] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-09-30T14:50:18.011920Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894666016935063:2510] connected; active server actors: 1
2025-09-30T14:50:18.011932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7555894666016935040:2510] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-09-30T14:50:18.011936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894666016935040:2510] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:18.011977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7555894666016935062:2517]
2025-09-30T14:50:18.011983Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894666016935063:2510] disconnected; active server actors: 1
2025-09-30T14:50:18.011986Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894666016935063:2510] disconnected no session
2025-09-30T14:50:18.013331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.013368Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:18.013382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.013387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.013389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.013396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:18.013420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:50:18.013521Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759243817927 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:50:18.013539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-09-30T14:50:18.013564Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 sending to client partition status
2025-09-30T14:50:18.014845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894666016935040:2510] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:18.014864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894666016935040:2510] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-09-30T14:50:18.014868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894666016935040:2510] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:18.014879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:18.015516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894666016935080:2510], now have 1 active actors on pipe
2025-09-30T14:50:18.015572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-09-30T14:50:18.015633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.015651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.015678Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:18.015692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.015711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.015718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:18.015729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.015745Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:18.015766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:18.016031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.016045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.016067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:18.016180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0
2025-09-30T14:50:18.016481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759243818016 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:50:18.016536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session established. Init response: session_id: "src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:18.018631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 1 to 1
2025-09-30T14:50:18.020534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.020551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 1
>>> Got event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 CommittedOffset: 0 EndOffset: 0 }
2025-09-30T14:50:18.022951Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-09-30T14:50:18.023983Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-09-30T14:50:18.024138Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# (empty maybe)
2025-09-30T14:50:18.024168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-09-30T14:50:18.024178Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-09-30T14:50:18.025759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.027673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.027689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.027692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.027925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.028117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.028134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 2 to 2
2025-09-30T14:50:18.028146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.028180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:18.028276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.030061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.030078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 2
2025-09-30T14:50:18.032950Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-09-30T14:50:18.032967Z :DEBUG: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] [] Abort session to cluster
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.032964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.032989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.033232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:18.033298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:18.033360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:18.033831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:18.033973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 4 messageNo: 1 size: 205039
2025-09-30T14:50:18.033983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 4 messageNo: 1 size 205039 offset: -1
2025-09-30T14:50:18.034012Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.034046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.034061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.034064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-09-30T14:50:18.034099Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-09-30T14:50:18.034117Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 1
2025-09-30T14:50:18.034120Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 2
2025-09-30T14:50:18.034125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 3
2025-09-30T14:50:18.034137Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 4
2025-09-30T14:50:18.035562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.035750Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2253229 count 1 nextOffset 1 batches 5
2025-09-30T14:50:18.035775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.035922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.036004Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00004? size 2253219 WTime 1759243818035
2025-09-30T14:50:18.037939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.037955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.037971Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.037985Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 2253219
2025-09-30T14:50:18.038053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-09-30T14:50:18.038091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 3 to 3
2025-09-30T14:50:18.038182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.040014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.040031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 3
2025-09-30T14:50:18.040960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.040977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.041123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 3 size: 511959
2025-09-30T14:50:18.041173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 1 messageNo: 3 size: 511959
2025-09-30T14:50:18.041227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 2 messageNo: 3 size: 511959
2025-09-30T14:50:18.041373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 3 messageNo: 3 size: 511959
2025-09-30T14:50:18.041542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 4 messageNo: 3 size: 205039
2025-09-30T14:50:18.041550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 4 messageNo: 3 size 205039 offset: -1
2025-09-30T14:50:18.041583Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.041601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.042503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 2253219 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.042520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.042541Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:18.042549Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.042553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-09-30T14:50:18.042557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-09-30T14:50:18.042560Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.042572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 1, Offset: 0 is stored on disk
2025-09-30T14:50:18.042576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.042579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 2, Offset: 0 is stored on disk
2025-09-30T14:50:18.042580Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.042583Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 3, Offset: 0 is stored on disk
2025-09-30T14:50:18.042587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.042590Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 4, Offset: 0 is stored on disk
2025-09-30T14:50:18.042627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:18.042638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:18.042642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.042652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.042655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-09-30T14:50:18.042671Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-09-30T14:50:18.042683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 1
2025-09-30T14:50:18.042691Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-09-30T14:50:18.042689Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 2
>>> Got event: 2025-09-30T14:50:18.042692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 3
2025-09-30T14:50:18.042694Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 4
SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.042733Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-09-30T14:50:18.042759Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 1
2025-09-30T14:50:18.042791Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 1, WTime# 0, sizeLag# 2253219
2025-09-30T14:50:18.042794Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1TEvPartitionReady. Aval parts: 1
2025-09-30T14:50:18.042809Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 performing read request: guid# c8bb3ae0-a5b98b2d-3d4fb5e4-bade3411, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:50:18.042858Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid c8bb3ae0-a5b98b2d-3d4fb5e4-bade3411
2025-09-30T14:50:18.043307Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 4 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 2253229 count 1 nextOffset 2 batches 5
2025-09-30T14:50:18.043323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.043405Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00004? size 2253219 WTime 1759243818042
2025-09-30T14:50:18.044899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.045098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00004?
2025-09-30T14:50:18.045112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 2253219 bytes (2253219)
2025-09-30T14:50:18.045118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 2253219 (8388608)
2025-09-30T14:50:18.045150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-09-30T14:50:18.045226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.045238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.045251Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.045265Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 2253219
2025-09-30T14:50:18.045246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.045271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.045319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-09-30T14:50:18.045331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 2253219 count 1 last offset 0, current partition end offset: 1
2025-09-30T14:50:18.045334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:18.045356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-09-30T14:50:18.000000Z
2025-09-30T14:50:18.045363Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-09-30T14:50:18.045371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 524288 endOffset 1 max time lag 0ms effective offset 0
2025-09-30T14:50:18.045383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 2253219 count 1 last offset 0, current partition end offset: 1
2025-09-30T14:50:18.045391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-09-30T14:50:18.045398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:18.045398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-09-30T14:50:18.045569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:18.045648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 8 }
2025-09-30T14:50:18.045664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 1
2025-09-30T14:50:18.045712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.046227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.046368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.046455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-09-30T14:50:18.046484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-09-30T14:50:18.000000Z
2025-09-30T14:50:18.046499Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-09-30T14:50:18.046515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.046519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-09-30T14:50:18.046521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.046533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:18.046551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:18.046613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 4 to 4
2025-09-30T14:50:18.046784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:18.046959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.047101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.047265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.047454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-09-30T14:50:18.047516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:18.047536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-09-30T14:50:18.047649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.048627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.048642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 4
2025-09-30T14:50:18.051162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.051185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.051302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 5 size: 511959
2025-09-30T14:50:18.051346Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.051374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 1 messageNo: 5 size: 511959
2025-09-30T14:50:18.051449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 2 messageNo: 5 size: 511959
2025-09-30T14:50:18.051536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 3 messageNo: 5 size: 511959
2025-09-30T14:50:18.051585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 4 messageNo: 5 size: 205039
2025-09-30T14:50:18.051595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 4 messageNo: 5 size 205039 offset: -1
2025-09-30T14:50:18.051791Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.051821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.052748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 2253219 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.052772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.052785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-09-30T14:50:18.052794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:18.052801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.052811Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-09-30T14:50:18.052817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.052822Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 1, Offset: 1 is stored on disk
2025-09-30T14:50:18.052824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.052829Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 2, Offset: 1 is stored on disk
2025-09-30T14:50:18.052831Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.052835Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 3, Offset: 1 is stored on disk
2025-09-30T14:50:18.052841Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.052847Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 4, Offset: 1 is stored on disk
2025-09-30T14:50:18.052825Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 1 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759243818033 CreateTimestampMS: 1759243818016 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 110 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-09-30T14:50:18.052898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.052913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.052920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-09-30T14:50:18.052942Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-09-30T14:50:18.052960Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 1
2025-09-30T14:50:18.052969Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 2
2025-09-30T14:50:18.052973Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 3
2025-09-30T14:50:18.052978Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 4
2025-09-30T14:50:18.053303Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 2 from offset 1
2025-09-30T14:50:18.053329Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 ReadOffset 1 ReadGuid c8bb3ae0-a5b98b2d-3d4fb5e4-bade3411 has messages 1
2025-09-30T14:50:18.053379Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 read done: guid# c8bb3ae0-a5b98b2d-3d4fb5e4-bade3411, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252974
2025-09-30T14:50:18.053390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.053399Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 response to read: guid# c8bb3ae0-a5b98b2d-3d4fb5e4-bade3411
2025-09-30T14:50:18.053453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 4 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 2253229 count 1 nextOffset 3 batches 5
2025-09-30T14:50:18.053481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.053594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00004? size 2253219 WTime 1759243818053
2025-09-30T14:50:18.053780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.054971Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 Process answer. Aval parts: 0
2025-09-30T14:50:18.055694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00004?
2025-09-30T14:50:18.055709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00004?
2025-09-30T14:50:18.055713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 4506438 bytes (4506438)
2025-09-30T14:50:18.055717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 4506438 (8388608)
2025-09-30T14:50:18.055759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-09-30T14:50:18.055887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.055813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.055822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.055836Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.055851Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 2253219
2025-09-30T14:50:18.055918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 6  requestId: <none> cookie: 4
2025-09-30T14:50:18.055937Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 2 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-09-30T14:50:18.055959Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 1 endOffset 2
2025-09-30T14:50:18.055975Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 1, endOffset# 2, WTime# 1759243818033, sizeLag# 2253219
2025-09-30T14:50:18.055978Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1TEvPartitionReady. Aval parts: 1
2025-09-30T14:50:18.056085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.056457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 5 to 5
2025-09-30T14:50:18.056609Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got ReadResponse, serverBytesSize = 2252974, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728686
2025-09-30T14:50:18.056715Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (0-0)
2025-09-30T14:50:18.056732Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Returning serverBytesSize = 2252974 to budget
2025-09-30T14:50:18.058130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.058144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 5
2025-09-30T14:50:18.058650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.058677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.058870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 0 messageNo: 7 size: 511959
2025-09-30T14:50:18.059334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 1 messageNo: 7 size: 511959
2025-09-30T14:50:18.059403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 2 messageNo: 7 size: 511959
2025-09-30T14:50:18.059467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 3 messageNo: 7 size: 511959
2025-09-30T14:50:18.059521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 4 messageNo: 7 size: 205039
2025-09-30T14:50:18.059535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 4 messageNo: 7 size 205039 offset: -1
2025-09-30T14:50:18.059564Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-09-30T14:50:18.059589Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-09-30T14:50:18.059582Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.059602Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252974, ReadSizeServerDelta = -1728686
2025-09-30T14:50:18.059610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.059687Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-09-30T14:50:18.059699Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:50:18.059845Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252974 } }
2025-09-30T14:50:18.059946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.059969Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 got read request: guid# 805cb9c9-dde78cbf-1ff2057b-7bb297e5
2025-09-30T14:50:18.059988Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 performing read request: guid# c62a0df9-68bd9dd4-b48274a2-dd9f43ce, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:50:18.060009Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid c62a0df9-68bd9dd4-b48274a2-dd9f43ce
2025-09-30T14:50:18.060159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.060171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.060210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--test-topic' partition 0 user user offset 1 count 1 size 524288 endOffset 2 max time lag 0ms effective offset 1
2025-09-30T14:50:18.060234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 2253219 count 1 last offset 1, current partition end offset: 2
2025-09-30T14:50:18.060244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-09-30T14:50:18.060257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-09-30T14:50:18.000000Z
2025-09-30T14:50:18.060268Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-09-30T14:50:18.060285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:18.060297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63'
2025-09-30T14:50:18.060477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 0 ProducerId: "src_id" SeqNo: 1 CreateTime: 2025-09-30T14:50:18.016000Z WriteTime: 2025-09-30T14:50:18.033000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:54586", "_ip": "ipv6:[::1]:54586", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-09-30T14:50:18.060647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.060804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.060845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 2 offsets: 1 already_written: false write_statistics { persist_duration_ms: 10 queued_in_partition_duration_ms: 1 }
2025-09-30T14:50:18.060872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 2
2025-09-30T14:50:18.060969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.061171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 1 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-09-30T14:50:18.061283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:18.061315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 2253219 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.061349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-09-30T14:50:18.061942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.063047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.063080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:18.063086Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.063097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-09-30T14:50:18.063102Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.063107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 1, Offset: 2 is stored on disk
2025-09-30T14:50:18.063109Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.063114Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 2, Offset: 2 is stored on disk
2025-09-30T14:50:18.063115Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.063119Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 3, Offset: 2 is stored on disk
2025-09-30T14:50:18.063126Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.063130Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 4, Offset: 2 is stored on disk
2025-09-30T14:50:18.063906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.063933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.063936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-09-30T14:50:18.063965Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-09-30T14:50:18.063986Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 1
2025-09-30T14:50:18.063990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 2
2025-09-30T14:50:18.063994Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 3
2025-09-30T14:50:18.063998Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 4
2025-09-30T14:50:18.064223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 6 to 6
2025-09-30T14:50:18.064518Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 4 partNo 4 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 2253229 count 1 nextOffset 4 batches 5
2025-09-30T14:50:18.064543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.064667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00004? size 2253219 WTime 1759243818064
2025-09-30T14:50:18.065178Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 1 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 2 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759243818042 CreateTimestampMS: 1759243818026 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 110 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 2 StartOffset: 0 } Cookie: 1 }
2025-09-30T14:50:18.066173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.066192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 6
2025-09-30T14:50:18.066780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00004?
2025-09-30T14:50:18.066793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00004?
2025-09-30T14:50:18.066796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000002_00000_0000000001_00004?
2025-09-30T14:50:18.066800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 6759657 bytes (6759657)
2025-09-30T14:50:18.066804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 3, size 6759657 (8388608)
2025-09-30T14:50:18.066836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.066848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.066879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-09-30T14:50:18.066903Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.066921Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 2253219
2025-09-30T14:50:18.066979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 8  requestId: <none> cookie: 5
2025-09-30T14:50:18.067041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.067091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.067167Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 3 from offset 2
2025-09-30T14:50:18.067187Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 ReadOffset 2 ReadGuid c62a0df9-68bd9dd4-b48274a2-dd9f43ce has messages 1
2025-09-30T14:50:18.067241Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 read done: guid# c62a0df9-68bd9dd4-b48274a2-dd9f43ce, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252976
2025-09-30T14:50:18.067276Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 response to read: guid# c62a0df9-68bd9dd4-b48274a2-dd9f43ce
2025-09-30T14:50:18.067442Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.068282Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 2 EndOffset 2 newEndOffset 3 commitOffset 0 clientCommitOffset 0 cookie 3 readingFinished 0 firstRead 0
2025-09-30T14:50:18.068300Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 2 endOffset 3
2025-09-30T14:50:18.068603Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 Process answer. Aval parts: 0
2025-09-30T14:50:18.068645Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 2, endOffset# 3, WTime# 1759243818042, sizeLag# 2253219
2025-09-30T14:50:18.068654Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1TEvPartitionReady. Aval parts: 1
2025-09-30T14:50:18.068903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 3 offsets: 2 already_written: false write_statistics { persist_duration_ms: 10 queued_in_partition_duration_ms: 1 }
2025-09-30T14:50:18.068928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 3
2025-09-30T14:50:18.069245Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got ReadResponse, serverBytesSize = 2252976, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728688
2025-09-30T14:50:18.069333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.069369Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (1-1)
2025-09-30T14:50:18.069391Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Returning serverBytesSize = 2252976 to budget
2025-09-30T14:50:18.069685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.069844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.069867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.069986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 0 messageNo: 9 size: 511959
2025-09-30T14:50:18.070089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 1 messageNo: 9 size: 511959
2025-09-30T14:50:18.070157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 2 messageNo: 9 size: 511959
2025-09-30T14:50:18.070225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 3 messageNo: 9 size: 511959
2025-09-30T14:50:18.070273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 4 messageNo: 9 size: 205039
2025-09-30T14:50:18.070284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 4 messageNo: 9 size 205039 offset: -1
2025-09-30T14:50:18.070316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.070324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.070349Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.070374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.070541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 10  requestId: <none> cookie: 6
2025-09-30T14:50:18.070633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.071175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 7 to 7
2025-09-30T14:50:18.071282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 2253219 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.071307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.071326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-09-30T14:50:18.071328Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:18.071334Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.071344Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-09-30T14:50:18.071349Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.071354Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 1, Offset: 3 is stored on disk
2025-09-30T14:50:18.071357Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.071361Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 2, Offset: 3 is stored on disk
2025-09-30T14:50:18.071363Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.071367Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 3, Offset: 3 is stored on disk
2025-09-30T14:50:18.071373Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.071377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 4, Offset: 3 is stored on disk
2025-09-30T14:50:18.071418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.071435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.071437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-09-30T14:50:18.071460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-09-30T14:50:18.071480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.071478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 1
2025-09-30T14:50:18.071483Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 2
2025-09-30T14:50:18.071492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 7
2025-09-30T14:50:18.071487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 3
2025-09-30T14:50:18.071490Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 4
2025-09-30T14:50:18.072145Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 5 partNo 4 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 2253229 count 1 nextOffset 5 batches 5
2025-09-30T14:50:18.072168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.072283Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00004? size 2253219 WTime 1759243818071
2025-09-30T14:50:18.072608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00004?
2025-09-30T14:50:18.072623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00004?
2025-09-30T14:50:18.072626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000002_00000_0000000001_00004?
2025-09-30T14:50:18.072628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000003_00000_0000000001_00004?
2025-09-30T14:50:18.072632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 9012876 bytes (9012876)
2025-09-30T14:50:18.072634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 4 blobs
2025-09-30T14:50:18.072664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-09-30T14:50:18.073147Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (1-1)
2025-09-30T14:50:18.073170Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-09-30T14:50:18.073181Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252976, ReadSizeServerDelta = -1728688
2025-09-30T14:50:18.073270Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-09-30T14:50:18.073282Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:50:18.073393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.073498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.073517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.073590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 0 messageNo: 11 size: 511959
2025-09-30T14:50:18.073593Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252976 } }
2025-09-30T14:50:18.073623Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 got read request: guid# bdeda195-bfdaf3f3-154c5fc1-793e4d61
2025-09-30T14:50:18.073646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 4 offsets: 3 already_written: false write_statistics { persist_duration_ms: 7 queued_in_partition_duration_ms: 4 }
2025-09-30T14:50:18.073648Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 performing read request: guid# 2ecd21dd-dc7b32af-1c77a2c8-dda599b0, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:50:18.073654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 1 messageNo: 11 size: 511959
2025-09-30T14:50:18.073668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 4
2025-09-30T14:50:18.073674Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 3 ClientCommitOffset 0 committedOffset 0 Guid 2ecd21dd-dc7b32af-1c77a2c8-dda599b0
2025-09-30T14:50:18.073719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 2 messageNo: 11 size: 511959
2025-09-30T14:50:18.073784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 3 messageNo: 11 size: 511959
2025-09-30T14:50:18.073829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 4 messageNo: 11 size: 205039
2025-09-30T14:50:18.073838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 4 messageNo: 11 size 205039 offset: -1
2025-09-30T14:50:18.073860Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.073882Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 1 size 2253219
2025-09-30T14:50:18.073898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-09-30T14:50:18.073906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000000_00000_0000000001_00004?
2025-09-30T14:50:18.073917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000001_00000_0000000001_00004?
2025-09-30T14:50:18.073935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000002_00000_0000000001_00004?
2025-09-30T14:50:18.073958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000003_00000_0000000001_00004?
2025-09-30T14:50:18.073972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-09-30T14:50:18.074001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.074008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.074020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.074044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
>>> Got event: 2025-09-30T14:50:18.074101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 2 times before, last time 2025-09-30T14:50:18.000000Z
2025-09-30T14:50:18.074109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-09-30T14:50:18.000000Z
2025-09-30T14:50:18.074113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-09-30T14:50:18.000000Z
2025-09-30T14:50:18.074118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-09-30T14:50:18.000000Z
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 1 ProducerId: "src_id" SeqNo: 2 CreateTime: 2025-09-30T14:50:18.026000Z WriteTime: 2025-09-30T14:50:18.042000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:54586", "logtype": "unknown", "server": "ipv6:[::1]:54586" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-09-30T14:50:18.074130Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 4 blobs are from cache.
2025-09-30T14:50:18.074149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-09-30T14:50:18.074172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63'
2025-09-30T14:50:18.074179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:18.074180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63'
2025-09-30T14:50:18.074182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000000_00000_0000000001_00004?
2025-09-30T14:50:18.074184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 4 suffix '63'
2025-09-30T14:50:18.074185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:18.074335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-09-30T14:50:18.074501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 1
2025-09-30T14:50:18.074561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.074673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 2
2025-09-30T14:50:18.074856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 3
2025-09-30T14:50:18.074889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.074942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 4
2025-09-30T14:50:18.076408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 1 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2253229 count 1 nextOffset 1 batches 5
2025-09-30T14:50:18.076436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000001_00000_0000000001_00004?
2025-09-30T14:50:18.076439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:18.076571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-09-30T14:50:18.077102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 1
2025-09-30T14:50:18.077277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 2
2025-09-30T14:50:18.077427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 3
2025-09-30T14:50:18.077526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 4
2025-09-30T14:50:18.077554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 8 to 8
2025-09-30T14:50:18.077835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.077847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 8
2025-09-30T14:50:18.079531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 2 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 4506426 count 2 nextOffset 2 batches 9
2025-09-30T14:50:18.079556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000002_00000_0000000001_00004?
2025-09-30T14:50:18.079558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:18.079695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-09-30T14:50:18.080226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 1
2025-09-30T14:50:18.080393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 2
2025-09-30T14:50:18.080546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 3
2025-09-30T14:50:18.080609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 4
2025-09-30T14:50:18.080643Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.081279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 3 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 6759623 count 3 nextOffset 3 batches 13
2025-09-30T14:50:18.081305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000003_00000_0000000001_00004?
2025-09-30T14:50:18.081307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:18.081627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-09-30T14:50:18.081782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 1
2025-09-30T14:50:18.081923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 2
2025-09-30T14:50:18.082074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 3
2025-09-30T14:50:18.085806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 9 to 9
2025-09-30T14:50:18.087705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.087723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 9
2025-09-30T14:50:18.090093Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.090167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 4 partNo 3 result is x0000000000_00000000000000000000_00000_0000000003_00015 size 8295635
2025-09-30T14:50:18.090267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 4
2025-09-30T14:50:18.090284Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000000_00000_0000000003_00015 new key d0000000000_00000000000000000000_00000_0000000003_00015 size 8295635 WTime 1759243818090
2025-09-30T14:50:18.090415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 4 partNo 4 FormedBlobsCount 1 NewHead: Offset 3 PartNo 3 PackedSize 717144 count 1 nextOffset 4 batches 2
2025-09-30T14:50:18.090512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:550: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 3,1 HeadOffset 0 endOffset 0 curOffset 4 d0000000000_00000000000000000003_00003_0000000001_00001| size 717134 WTime 1759243818090
2025-09-30T14:50:18.090680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.090692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.090721Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.090731Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 3 size 8295635
2025-09-30T14:50:18.090757Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 3 count 1 size 717134
2025-09-30T14:50:18.090774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--test-topic' partition 0 user user offset 2 count 1 size 524288 endOffset 4 max time lag 0ms effective offset 2
2025-09-30T14:50:18.090790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 1 blobs, size 2253219 count 1 last offset 2, current partition end offset: 4
2025-09-30T14:50:18.090798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-09-30T14:50:18.090982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-09-30T14:50:18.000000Z
2025-09-30T14:50:18.090992Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-09-30T14:50:18.091005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 12  requestId: <none> cookie: 7
2025-09-30T14:50:18.091014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63'
2025-09-30T14:50:18.091031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:18.091115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.091209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:18.091382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.091540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.091703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.091783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 2 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-09-30T14:50:18.091884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-09-30T14:50:18.091912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 1 size 2253219 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.091954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-09-30T14:50:18.093036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.093143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 10 to 10
2025-09-30T14:50:18.093355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.094342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.094375Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:18.094385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.094397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 4 is stored on disk
2025-09-30T14:50:18.094409Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.094417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 1, Offset: 4 is stored on disk
2025-09-30T14:50:18.094426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.094432Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 2, Offset: 4 is stored on disk
2025-09-30T14:50:18.094434Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.094441Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 3, Offset: 4 is stored on disk
2025-09-30T14:50:18.094447Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.094453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 4, Offset: 4 is stored on disk
2025-09-30T14:50:18.094493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.094514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.094522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-09-30T14:50:18.094550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-09-30T14:50:18.094577Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 1
2025-09-30T14:50:18.094581Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 2
2025-09-30T14:50:18.094585Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 3
2025-09-30T14:50:18.094589Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 4
2025-09-30T14:50:18.095014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.095028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 10
2025-09-30T14:50:18.095325Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 6 partNo 4 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 2253229 count 1 nextOffset 6 batches 5
2025-09-30T14:50:18.095355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.095478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 5,1 HeadOffset 5 endOffset 5 curOffset 6 d0000000000_00000000000000000005_00000_0000000001_00004? size 2253219 WTime 1759243818095
2025-09-30T14:50:18.096215Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.096341Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 4 Result { Offset: 2 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 3 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759243818052 CreateTimestampMS: 1759243818036 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 2253329 RealReadOffset: 2 WaitQuotaTimeMs: 0 EndOffset: 4 StartOffset: 0 } Cookie: 2 }
2025-09-30T14:50:18.097518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:50:18.098239Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 3 endOffset 4
2025-09-30T14:50:18.098276Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 4 ReadOffset 3 ReadGuid 2ecd21dd-dc7b32af-1c77a2c8-dda599b0 has messages 1
2025-09-30T14:50:18.098313Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 3, endOffset# 4, WTime# 1759243818052, sizeLag# 2253329
2025-09-30T14:50:18.098326Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1TEvPartitionReady. Aval parts: 0
2025-09-30T14:50:18.098345Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 read done: guid# 2ecd21dd-dc7b32af-1c77a2c8-dda599b0, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252976
2025-09-30T14:50:18.098361Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 response to read: guid# 2ecd21dd-dc7b32af-1c77a2c8-dda599b0
2025-09-30T14:50:18.099440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 11 to 11
2025-09-30T14:50:18.099835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.099846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 11
2025-09-30T14:50:18.099900Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.099929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.099954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.100051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 0 messageNo: 13 size: 511959
2025-09-30T14:50:18.100329Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 Process answer. Aval parts: 1
2025-09-30T14:50:18.100525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 1 messageNo: 13 size: 511959
2025-09-30T14:50:18.100599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 2 messageNo: 13 size: 511959
2025-09-30T14:50:18.101069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 3 messageNo: 13 size: 511959
2025-09-30T14:50:18.101348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.101418Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got ReadResponse, serverBytesSize = 2252976, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728688
2025-09-30T14:50:18.101136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 4 messageNo: 13 size: 205039
2025-09-30T14:50:18.101149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 4 messageNo: 13 size 205039 offset: -1
2025-09-30T14:50:18.101204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.101211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.101249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 9  requestId: <none> cookie: 5
2025-09-30T14:50:18.101272Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.101294Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 1 size 2253219
2025-09-30T14:50:18.101316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.101343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.101400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 14  requestId: <none> cookie: 8
2025-09-30T14:50:18.101496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.101617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 5 offsets: 4 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 1 }
2025-09-30T14:50:18.101629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 5
2025-09-30T14:50:18.102813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 12 to 12
2025-09-30T14:50:18.103058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.103094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.103107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 12
2025-09-30T14:50:18.103279Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (2-2)
2025-09-30T14:50:18.103297Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Returning serverBytesSize = 2252976 to budget
2025-09-30T14:50:18.104083Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (2-2)
2025-09-30T14:50:18.104105Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-09-30T14:50:18.104114Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252976, ReadSizeServerDelta = -1728688
2025-09-30T14:50:18.104220Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-09-30T14:50:18.104231Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:50:18.104349Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252976 } }
2025-09-30T14:50:18.104413Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 got read request: guid# 2c45c57d-4cef9ae7-a2433aa0-f010c136
2025-09-30T14:50:18.104437Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 performing read request: guid# 9f3b71cf-e01f8e99-b8a5d9f-d48ba26c, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:50:18.104458Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 3 EndOffset 4 ClientCommitOffset 0 committedOffset 0 Guid 9f3b71cf-e01f8e99-b8a5d9f-d48ba26c
2025-09-30T14:50:18.105083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.105510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.105530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.105727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 0 messageNo: 15 size: 511959
2025-09-30T14:50:18.105795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 1 messageNo: 15 size: 511959
2025-09-30T14:50:18.106270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 2 messageNo: 15 size: 511959
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 2 ProducerId: "src_id" SeqNo: 3 CreateTime: 2025-09-30T14:50:18.036000Z WriteTime: 2025-09-30T14:50:18.052000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:54586", "server": "ipv6:[::1]:54586", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-09-30T14:50:18.106735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 3 messageNo: 15 size: 511959
2025-09-30T14:50:18.106800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 4 messageNo: 15 size: 205039
2025-09-30T14:50:18.106809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 4 messageNo: 15 size 205039 offset: -1
2025-09-30T14:50:18.106935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.106947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.106977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.106984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.106995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.107024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.107041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.107046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 717134 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.107098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:18.107111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 1 parts 1 suffix '124' size 717134
2025-09-30T14:50:18.107209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.107216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:471: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-09-30T14:50:18.107759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.107770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000004_00000_0000000001_00004?
2025-09-30T14:50:18.107774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 2253219 bytes (2253219)
2025-09-30T14:50:18.107778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 2253219 (8388608)
2025-09-30T14:50:18.107803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 16  requestId: <none> cookie: 9
2025-09-30T14:50:18.107835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--test-topic' partition 0 user user offset 3 count 1 size 524288 endOffset 5 max time lag 0ms effective offset 3
2025-09-30T14:50:18.107855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 1 blobs, size 0 count 0 last offset 0, current partition end offset: 5
2025-09-30T14:50:18.107899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.109666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.109980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.107958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. Send blob request.
2025-09-30T14:50:18.107978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 3 parts_count 15 source 1 size 8295635 accessed 0 times before, last time 2025-09-30T14:50:18.000000Z
2025-09-30T14:50:18.107984Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 7. All 1 blobs are from cache.
2025-09-30T14:50:18.108007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:18.108007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0'
2025-09-30T14:50:18.111884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 13 to 13
2025-09-30T14:50:18.113519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.113534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 13
2025-09-30T14:50:18.113595Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.111706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 3 totakecount 3 count 0 size 1536000 from pos 0 cbcount 3
2025-09-30T14:50:18.112793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.112805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.112894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 0 messageNo: 17 size: 511959
2025-09-30T14:50:18.113048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 1 messageNo: 17 size: 511959
2025-09-30T14:50:18.113110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 2 messageNo: 17 size: 511959
2025-09-30T14:50:18.113170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 3 messageNo: 17 size: 511959
2025-09-30T14:50:18.113214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 4 messageNo: 17 size: 205039
2025-09-30T14:50:18.113219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 4 messageNo: 17 size 205039 offset: -1
2025-09-30T14:50:18.113269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.113272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.113290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 3
2025-09-30T14:50:18.113323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 5 count 1 size 2253219 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.113341Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.113363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.113381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-09-30T14:50:18.114506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.114534Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:18.114542Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.114553Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 0, Offset: 5 is stored on disk
2025-09-30T14:50:18.114559Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.114575Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 1, Offset: 5 is stored on disk
2025-09-30T14:50:18.114578Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.114586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 2, Offset: 5 is stored on disk
2025-09-30T14:50:18.114589Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.114593Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 3, Offset: 5 is stored on disk
2025-09-30T14:50:18.114600Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.114604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 4, Offset: 5 is stored on disk
2025-09-30T14:50:18.115131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.115148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.115150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-09-30T14:50:18.115175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-09-30T14:50:18.115187Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 1
2025-09-30T14:50:18.115191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 2
2025-09-30T14:50:18.115195Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 3
2025-09-30T14:50:18.115199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 4
2025-09-30T14:50:18.115900Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 7 partNo 4 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 2253229 count 1 nextOffset 7 batches 5
2025-09-30T14:50:18.115930Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-09-30T14:50:18.115938Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 1
2025-09-30T14:50:18.115942Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 2
2025-09-30T14:50:18.115947Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 3
2025-09-30T14:50:18.115950Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 4
2025-09-30T14:50:18.116534Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 8 partNo 4 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 4506426 count 2 nextOffset 8 batches 9
2025-09-30T14:50:18.116556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-09-30T14:50:18.116562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 1
2025-09-30T14:50:18.116566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 2
2025-09-30T14:50:18.116569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 3
2025-09-30T14:50:18.116573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 4
2025-09-30T14:50:18.116907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 14 to 14
2025-09-30T14:50:18.117883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 9 partNo 4 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 6759623 count 3 nextOffset 9 batches 13
2025-09-30T14:50:18.117912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.118027Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 6,3 HeadOffset 6 endOffset 6 curOffset 9 d0000000000_00000000000000000006_00000_0000000003_00012? size 6759613 WTime 1759243818117
2025-09-30T14:50:18.118688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.118704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 14
2025-09-30T14:50:18.118779Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.123989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 15 to 15
2025-09-30T14:50:18.124065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000004_00000_0000000001_00004?
2025-09-30T14:50:18.124086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000005_00000_0000000001_00004?
2025-09-30T14:50:18.124094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 4506438 bytes (4506438)
2025-09-30T14:50:18.124100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 4506438 (8388608)
2025-09-30T14:50:18.124146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 18  requestId: <none> cookie: 10
2025-09-30T14:50:18.124177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: __TMP__REQUEST__MARKER__
2025-09-30T14:50:18.124190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.124240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 11  requestId: <none> cookie: 6
2025-09-30T14:50:18.124255Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.124274Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 3 size 6759613
2025-09-30T14:50:18.124284Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000000_00000_0000000001_00004?(+) to d0000000000_00000000000000000000_00000_0000000001_00004?(+)
2025-09-30T14:50:18.124286Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000001_00000_0000000001_00004?(+) to d0000000000_00000000000000000001_00000_0000000001_00004?(+)
2025-09-30T14:50:18.124289Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000002_00000_0000000001_00004?(+) to d0000000000_00000000000000000002_00000_0000000001_00004?(+)
2025-09-30T14:50:18.124291Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00000_0000000001_00004?(+) to d0000000000_00000000000000000003_00000_0000000001_00004?(+)
2025-09-30T14:50:18.124290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.124330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 15
2025-09-30T14:50:18.124338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Estimated memory usage 22528015[B] reached maximum (20971520[B])
2025-09-30T14:50:18.124388Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.124393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 8 Topic 'rt3.dc1--test-topic' partition 0 user user offset 3 count 1 size 26214400 endOffset 6 max time lag 0ms effective offset 3
2025-09-30T14:50:18.124402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 8 added 0 blobs, size 0 count 0 last offset 3, current partition end offset: 6
2025-09-30T14:50:18.124529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1088: [72075186224037892][Partition][0][StateIdle] Reading cookie 8. All data is from uncompacted head.
2025-09-30T14:50:18.124539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 0 blobs
2025-09-30T14:50:18.124572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: __TMP__REQUEST__MARKER__ cookie: 3
2025-09-30T14:50:18.124606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.124643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.125997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 6 offsets: 5 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 23 }
2025-09-30T14:50:18.126013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 6
2025-09-30T14:50:18.126019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Estimated memory usage got back to normal 20275214[B]
2025-09-30T14:50:18.126256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.126561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.127480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.127503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.127590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 0 messageNo: 19 size: 511959
2025-09-30T14:50:18.127659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 1 messageNo: 19 size: 511959
2025-09-30T14:50:18.127765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 2 messageNo: 19 size: 511959
2025-09-30T14:50:18.127827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 3 messageNo: 19 size: 511959
2025-09-30T14:50:18.127854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 4 messageNo: 19 size: 205039
2025-09-30T14:50:18.127861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 4 messageNo: 19 size 205039 offset: -1
2025-09-30T14:50:18.127887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.127890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.127901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.127923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.127936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 20  requestId: <none> cookie: 11
2025-09-30T14:50:18.128048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.128038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.128502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 16 to 16
2025-09-30T14:50:18.128508Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 6 Result { Offset: 3 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 4 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759243818063 CreateTimestampMS: 1759243818046 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 3789348 RealReadOffset: 3 WaitQuotaTimeMs: 0 EndOffset: 6 StartOffset: 0 } Cookie: 3 }
2025-09-30T14:50:18.128757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.128767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 16
2025-09-30T14:50:18.128778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Estimated memory usage 22528016[B] reached maximum (20971520[B])
2025-09-30T14:50:18.128819Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.129712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.130369Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 4 endOffset 6
2025-09-30T14:50:18.130390Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 6 ReadOffset 4 ReadGuid 9f3b71cf-e01f8e99-b8a5d9f-d48ba26c has messages 1
2025-09-30T14:50:18.130424Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 4, endOffset# 6, WTime# 1759243818063, sizeLag# 3789348
2025-09-30T14:50:18.130433Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1TEvPartitionReady. Aval parts: 0
2025-09-30T14:50:18.130445Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 read done: guid# 9f3b71cf-e01f8e99-b8a5d9f-d48ba26c, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252976
2025-09-30T14:50:18.130456Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 response to read: guid# 9f3b71cf-e01f8e99-b8a5d9f-d48ba26c
2025-09-30T14:50:18.131799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.132065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.132086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.132557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 0 messageNo: 21 size: 511959
2025-09-30T14:50:18.133022Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 Process answer. Aval parts: 1
2025-09-30T14:50:18.133030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 1 messageNo: 21 size: 511959
2025-09-30T14:50:18.133100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 2 messageNo: 21 size: 511959
2025-09-30T14:50:18.133167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 3 messageNo: 21 size: 511959
2025-09-30T14:50:18.133212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 4 messageNo: 21 size: 205040
2025-09-30T14:50:18.133223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 4 messageNo: 21 size 205040 offset: -1
2025-09-30T14:50:18.133260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.133269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.133299Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.133327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.133537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 22  requestId: <none> cookie: 12
2025-09-30T14:50:18.133656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.134119Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got ReadResponse, serverBytesSize = 2252976, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728688
2025-09-30T14:50:18.134213Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (3-3)
2025-09-30T14:50:18.134228Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Returning serverBytesSize = 2252976 to budget
2025-09-30T14:50:18.134408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 0 count 1 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.134422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 1 count 1 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.134427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 2 count 1 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.134433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 3 count 1 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.134439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 3 size 6759613 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.134469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.134477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-09-30T14:50:18.134493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 6758730 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:18.134494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-09-30T14:50:18.134501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.134503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-09-30T14:50:18.134509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-09-30T14:50:18.134511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 0, Offset: 6 is stored on disk
2025-09-30T14:50:18.134516Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.134517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 3 parts 12 suffix '63' size 6759613
2025-09-30T14:50:18.134521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 1, Offset: 6 is stored on disk
2025-09-30T14:50:18.134522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.134527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 2, Offset: 6 is stored on disk
2025-09-30T14:50:18.134529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.134534Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 3, Offset: 6 is stored on disk
2025-09-30T14:50:18.134540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.134547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 4, Offset: 6 is stored on disk
2025-09-30T14:50:18.134551Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.134555Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 0, Offset: 7 is stored on disk
2025-09-30T14:50:18.134563Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.134569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 1, Offset: 7 is stored on disk
2025-09-30T14:50:18.134571Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.134577Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 2, Offset: 7 is stored on disk
2025-09-30T14:50:18.134579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.134582Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 3, Offset: 7 is stored on disk
2025-09-30T14:50:18.134584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.134587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 4, Offset: 7 is stored on disk
2025-09-30T14:50:18.134588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.134592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 0, Offset: 8 is stored on disk
2025-09-30T14:50:18.134593Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.134597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 1, Offset: 8 is stored on disk
2025-09-30T14:50:18.134599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.134603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 2, Offset: 8 is stored on disk
2025-09-30T14:50:18.134604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.134608Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 3, Offset: 8 is stored on disk
2025-09-30T14:50:18.134610Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.134613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 4, Offset: 8 is stored on disk
2025-09-30T14:50:18.134660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.134676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.134679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-09-30T14:50:18.134701Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-09-30T14:50:18.134717Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 1
2025-09-30T14:50:18.134725Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 2
2025-09-30T14:50:18.134728Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 3
2025-09-30T14:50:18.134731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 4
2025-09-30T14:50:18.135173Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 10 partNo 4 FormedBlobsCount 0 NewHead: Offset 9 PartNo 0 PackedSize 2253229 count 1 nextOffset 10 batches 5
2025-09-30T14:50:18.135209Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-09-30T14:50:18.135216Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 1
2025-09-30T14:50:18.135220Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 2
2025-09-30T14:50:18.135224Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 3
2025-09-30T14:50:18.135227Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 4
2025-09-30T14:50:18.135431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.135748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.135984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 11 partNo 4 FormedBlobsCount 0 NewHead: Offset 9 PartNo 0 PackedSize 4506427 count 2 nextOffset 11 batches 9
2025-09-30T14:50:18.136008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.136121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 9,2 HeadOffset 9 endOffset 9 curOffset 11 d0000000000_00000000000000000009_00000_0000000002_00008? size 4506417 WTime 1759243818135
2025-09-30T14:50:18.136957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000004_00000_0000000001_00004?
2025-09-30T14:50:18.136968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000005_00000_0000000001_00004?
2025-09-30T14:50:18.136973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000006_00000_0000000003_00012?
2025-09-30T14:50:18.136977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 11266051 bytes (11266051)
2025-09-30T14:50:18.136980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:18.137019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 13  requestId: <none> cookie: 7
2025-09-30T14:50:18.137052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 15  requestId: <none> cookie: 8
2025-09-30T14:50:18.137078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 17  requestId: <none> cookie: 9
2025-09-30T14:50:18.137129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.137164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.137172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.137531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 7 offsets: 6 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 14 }
2025-09-30T14:50:18.137547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 7
2025-09-30T14:50:18.137553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Estimated memory usage got back to normal 20275215[B]
2025-09-30T14:50:18.137687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 8 offsets: 7 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 8 }
2025-09-30T14:50:18.137701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 8
2025-09-30T14:50:18.137990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 17 to 17
2025-09-30T14:50:18.137977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.137994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.138075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 0 messageNo: 23 size: 511959
2025-09-30T14:50:18.138141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 1 messageNo: 23 size: 511959
2025-09-30T14:50:18.138204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 2 messageNo: 23 size: 511959
2025-09-30T14:50:18.138255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.138268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 17
2025-09-30T14:50:18.138269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 3 messageNo: 23 size: 511959
2025-09-30T14:50:18.138305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 4 messageNo: 23 size: 205040
2025-09-30T14:50:18.138314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 4 messageNo: 23 size 205040 offset: -1
2025-09-30T14:50:18.138343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.138350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.138360Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.138381Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 9 partNo 0 count 2 size 4506417
2025-09-30T14:50:18.138397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:18.138404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000004_00000_0000000001_00004?
2025-09-30T14:50:18.138416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000005_00000_0000000001_00004?
2025-09-30T14:50:18.138431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000006_00000_0000000003_00012?
2025-09-30T14:50:18.138444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 9 offsets: 8 already_written: false write_statistics { persist_duration_ms: 17 queued_in_partition_duration_ms: 3 }
2025-09-30T14:50:18.138453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 9
2025-09-30T14:50:18.138450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:18.138492Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.138516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.138567Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (3-3)
2025-09-30T14:50:18.138586Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-09-30T14:50:18.138571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-09-30T14:50:18.000000Z
2025-09-30T14:50:18.138582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-09-30T14:50:18.000000Z
2025-09-30T14:50:18.138597Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252976, ReadSizeServerDelta = -1728688
2025-09-30T14:50:18.138586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 3 parts_count 12 source 1 size 6759613 accessed 0 times before, last time 2025-09-30T14:50:18.000000Z
2025-09-30T14:50:18.138598Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 3 blobs are from cache.
2025-09-30T14:50:18.138625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 24  requestId: <none> cookie: 13
2025-09-30T14:50:18.138631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 4 suffix '63'
2025-09-30T14:50:18.138637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 4 suffix '63'
2025-09-30T14:50:18.138640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 3 parts 12 suffix '63'
2025-09-30T14:50:18.138655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:18.138660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000004_00000_0000000001_00004?
2025-09-30T14:50:18.138663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:18.138716Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-09-30T14:50:18.138729Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:50:18.138729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.138867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-09-30T14:50:18.138894Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252976 } }
2025-09-30T14:50:18.138966Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 got read request: guid# 9235cb5e-790fd8d9-d7fda07f-ff88a3b9
2025-09-30T14:50:18.138991Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 performing read request: guid# 92412659-e0707397-996a0c56-e6bc1377, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:50:18.139016Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 4 EndOffset 6 ClientCommitOffset 0 committedOffset 0 Guid 92412659-e0707397-996a0c56-e6bc1377
2025-09-30T14:50:18.139035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 1
2025-09-30T14:50:18.139195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 2
2025-09-30T14:50:18.139463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 3
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 3 ProducerId: "src_id" SeqNo: 4 CreateTime: 2025-09-30T14:50:18.046000Z WriteTime: 2025-09-30T14:50:18.063000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:54586", "logtype": "unknown", "_ip": "ipv6:[::1]:54586" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-09-30T14:50:18.139645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 4
2025-09-30T14:50:18.140089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 5 partNo 4 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 2253229 count 1 nextOffset 5 batches 5
2025-09-30T14:50:18.140129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000005_00000_0000000001_00004?
2025-09-30T14:50:18.140136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:18.140268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-09-30T14:50:18.140422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 1
2025-09-30T14:50:18.140488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.140638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 2
2025-09-30T14:50:18.140817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.140857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 3
2025-09-30T14:50:18.140971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 4
2025-09-30T14:50:18.142568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 6 partNo 4 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 4506426 count 2 nextOffset 6 batches 9
2025-09-30T14:50:18.142595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000006_00000_0000000003_00012?
2025-09-30T14:50:18.142597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:18.142740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-09-30T14:50:18.142899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 1
2025-09-30T14:50:18.143042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 2
2025-09-30T14:50:18.143191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 3
2025-09-30T14:50:18.143938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 18 to 18
2025-09-30T14:50:18.143921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 4
2025-09-30T14:50:18.144192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.144204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 18
2025-09-30T14:50:18.144256Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.145523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 7 partNo 4 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 6759623 count 3 nextOffset 7 batches 13
2025-09-30T14:50:18.145542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-09-30T14:50:18.145677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 1
2025-09-30T14:50:18.148050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 8 partNo 1 result is x0000000000_00000000000000000003_00003_0000000004_00014 size 7988778
2025-09-30T14:50:18.148196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 2
2025-09-30T14:50:18.148341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 3
2025-09-30T14:50:18.148548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 19 to 19
2025-09-30T14:50:18.148633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 4
2025-09-30T14:50:18.148655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000003_00003_0000000004_00014 new key d0000000000_00000000000000000003_00003_0000000004_00014 size 7988778 WTime 1759243818148
2025-09-30T14:50:18.148812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.148825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 19
2025-09-30T14:50:18.148833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Estimated memory usage 22528019[B] reached maximum (20971520[B])
2025-09-30T14:50:18.148875Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.148990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 8 partNo 4 FormedBlobsCount 1 NewHead: Offset 7 PartNo 1 PackedSize 1741198 count 1 nextOffset 8 batches 4
2025-09-30T14:50:18.149011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-09-30T14:50:18.149162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 1
2025-09-30T14:50:18.149323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 2
2025-09-30T14:50:18.149485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 3
2025-09-30T14:50:18.149562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 4
2025-09-30T14:50:18.150078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 9 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 1 PackedSize 3994395 count 2 nextOffset 9 batches 8
2025-09-30T14:50:18.150192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:550: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 7,2 HeadOffset 3 endOffset 4 curOffset 9 d0000000000_00000000000000000007_00001_0000000002_00007| size 3994385 WTime 1759243818150
2025-09-30T14:50:18.151069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.151084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.152152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.152172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.152265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 0 messageNo: 25 size: 511959
2025-09-30T14:50:18.152337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 1 messageNo: 25 size: 511959
2025-09-30T14:50:18.152403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 2 messageNo: 25 size: 511959
2025-09-30T14:50:18.152465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 3 messageNo: 25 size: 511959
2025-09-30T14:50:18.152504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 4 messageNo: 25 size: 205040
2025-09-30T14:50:18.152514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 4 messageNo: 25 size 205040 offset: -1
2025-09-30T14:50:18.152546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.152554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.152588Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.152611Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 3 count 4 size 7988778
2025-09-30T14:50:18.152622Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 1 count 2 size 3994385
2025-09-30T14:50:18.152641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.152673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.152903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 26  requestId: <none> cookie: 14
2025-09-30T14:50:18.152937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 9 Topic 'rt3.dc1--test-topic' partition 0 user user offset 4 count 2 size 524288 endOffset 9 max time lag 0ms effective offset 4
2025-09-30T14:50:18.152965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 9 added 1 blobs, size 2253219 count 1 last offset 4, current partition end offset: 9
2025-09-30T14:50:18.152970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 9. Send blob request.
2025-09-30T14:50:18.152981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-09-30T14:50:18.000000Z
2025-09-30T14:50:18.152986Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 9. All 1 blobs are from cache.
2025-09-30T14:50:18.153002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:18.153036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 4 suffix '63'
2025-09-30T14:50:18.153039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.153415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 4 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:18.153578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 4 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.153733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 4 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.154122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 4 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.154211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 4 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-09-30T14:50:18.154315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 4
2025-09-30T14:50:18.154344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 9 count 2 size 4506417 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.154393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 2 parts 8 suffix '63' size 4506417
2025-09-30T14:50:18.154925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.155268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.155981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.156012Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505821 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:18.156019Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.156030Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 0, Offset: 9 is stored on disk
2025-09-30T14:50:18.156035Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.156041Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 1, Offset: 9 is stored on disk
2025-09-30T14:50:18.156043Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.156050Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 2, Offset: 9 is stored on disk
2025-09-30T14:50:18.156052Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.156056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 3, Offset: 9 is stored on disk
2025-09-30T14:50:18.156061Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.156069Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 4, Offset: 9 is stored on disk
2025-09-30T14:50:18.156071Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.156075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 0, Offset: 10 is stored on disk
2025-09-30T14:50:18.156077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.156081Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 1, Offset: 10 is stored on disk
2025-09-30T14:50:18.156083Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.156087Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 2, Offset: 10 is stored on disk
2025-09-30T14:50:18.156089Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.156094Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 3, Offset: 10 is stored on disk
2025-09-30T14:50:18.156095Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.156099Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 4, Offset: 10 is stored on disk
2025-09-30T14:50:18.156143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.156162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.156169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-09-30T14:50:18.156191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-09-30T14:50:18.156208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 1
2025-09-30T14:50:18.156215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 2
2025-09-30T14:50:18.156218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 3
2025-09-30T14:50:18.156222Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 4
2025-09-30T14:50:18.156693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 12 partNo 4 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 2253230 count 1 nextOffset 12 batches 5
2025-09-30T14:50:18.156718Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-09-30T14:50:18.156723Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 1
2025-09-30T14:50:18.156725Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 2
2025-09-30T14:50:18.156727Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 3
2025-09-30T14:50:18.156731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 4
2025-09-30T14:50:18.157256Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 13 partNo 4 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 4506428 count 2 nextOffset 13 batches 9
2025-09-30T14:50:18.157282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.157378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 11,2 HeadOffset 11 endOffset 11 curOffset 13 d0000000000_00000000000000000011_00000_0000000002_00008? size 4506418 WTime 1759243818157
2025-09-30T14:50:18.157596Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 9 Result { Offset: 4 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 5 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759243818071 CreateTimestampMS: 1759243818054 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 4506548 RealReadOffset: 4 WaitQuotaTimeMs: 0 EndOffset: 9 StartOffset: 0 } Cookie: 4 }
2025-09-30T14:50:18.157841Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 5 endOffset 9
2025-09-30T14:50:18.157860Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 9 ReadOffset 5 ReadGuid 92412659-e0707397-996a0c56-e6bc1377 has messages 1
2025-09-30T14:50:18.157887Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 5, endOffset# 9, WTime# 1759243818071, sizeLag# 4506548
2025-09-30T14:50:18.157897Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1TEvPartitionReady. Aval parts: 0
2025-09-30T14:50:18.157913Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 read done: guid# 92412659-e0707397-996a0c56-e6bc1377, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252976
2025-09-30T14:50:18.157927Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 response to read: guid# 92412659-e0707397-996a0c56-e6bc1377
2025-09-30T14:50:18.159137Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 Process answer. Aval parts: 1
2025-09-30T14:50:18.159272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:50:18.159906Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got ReadResponse, serverBytesSize = 2252976, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728688
2025-09-30T14:50:18.160013Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (4-4)
2025-09-30T14:50:18.160033Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Returning serverBytesSize = 2252976 to budget
2025-09-30T14:50:18.160172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.160191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.160280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 0 messageNo: 27 size: 511959
2025-09-30T14:50:18.160345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 1 messageNo: 27 size: 511959
2025-09-30T14:50:18.160417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 2 messageNo: 27 size: 511959
2025-09-30T14:50:18.160486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 3 messageNo: 27 size: 511959
2025-09-30T14:50:18.160540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 4 messageNo: 27 size: 205040
2025-09-30T14:50:18.160548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 4 messageNo: 27 size 205040 offset: -1
2025-09-30T14:50:18.160583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.160594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.160626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 19  requestId: <none> cookie: 10
2025-09-30T14:50:18.160668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 21  requestId: <none> cookie: 11
2025-09-30T14:50:18.160694Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.160711Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 11 partNo 0 count 2 size 4506418
2025-09-30T14:50:18.160721Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.160741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.160764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.160801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.160791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 28  requestId: <none> cookie: 15
2025-09-30T14:50:18.160961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.161075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 10 offsets: 9 already_written: false write_statistics { persist_duration_ms: 20 queued_in_partition_duration_ms: 7 }
2025-09-30T14:50:18.161087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 10
2025-09-30T14:50:18.161093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Estimated memory usage got back to normal 20275218[B]
2025-09-30T14:50:18.161238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 11 offsets: 10 already_written: false write_statistics { persist_duration_ms: 20 queued_in_partition_duration_ms: 2 }
2025-09-30T14:50:18.161251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 11
2025-09-30T14:50:18.161552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 20 to 20
2025-09-30T14:50:18.161814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.161826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 20
2025-09-30T14:50:18.162087Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (4-4)
2025-09-30T14:50:18.162104Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-09-30T14:50:18.162113Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252976, ReadSizeServerDelta = -1728688
2025-09-30T14:50:18.162153Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-09-30T14:50:18.162164Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:50:18.162526Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252976 } }
2025-09-30T14:50:18.162557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.162581Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 got read request: guid# e398a932-1e74ec28-7bc6d846-2c8e6095
2025-09-30T14:50:18.162608Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 performing read request: guid# 8ca539d8-a20cfb94-c66bd7cb-b02f21d7, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 4, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:50:18.162627Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 4 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 5 EndOffset 9 ClientCommitOffset 0 committedOffset 0 Guid 8ca539d8-a20cfb94-c66bd7cb-b02f21d7
2025-09-30T14:50:18.162831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.162846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.162897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 4 ProducerId: "src_id" SeqNo: 5 CreateTime: 2025-09-30T14:50:18.054000Z WriteTime: 2025-09-30T14:50:18.071000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:54586", "server": "ipv6:[::1]:54586", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-09-30T14:50:18.163671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.163686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.163824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 0 messageNo: 29 size: 511959
2025-09-30T14:50:18.163897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 1 messageNo: 29 size: 511959
2025-09-30T14:50:18.163968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 2 messageNo: 29 size: 511959
2025-09-30T14:50:18.164039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 3 messageNo: 29 size: 511959
2025-09-30T14:50:18.164079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 4 messageNo: 29 size: 205040
2025-09-30T14:50:18.164088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 4 messageNo: 29 size 205040 offset: -1
2025-09-30T14:50:18.164125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.164133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.164140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.164157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.164182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 10 Topic 'rt3.dc1--test-topic' partition 0 user user offset 5 count 4 size 524288 endOffset 11 max time lag 0ms effective offset 5
2025-09-30T14:50:18.164208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 10 added 1 blobs, size 2253219 count 1 last offset 5, current partition end offset: 11
2025-09-30T14:50:18.164217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 10. Send blob request.
2025-09-30T14:50:18.164226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 30  requestId: <none> cookie: 16
2025-09-30T14:50:18.164253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-09-30T14:50:18.000000Z
2025-09-30T14:50:18.164267Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 10. All 1 blobs are from cache.
2025-09-30T14:50:18.164283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:18.164289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 4 suffix '63'
2025-09-30T14:50:18.164321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.164544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 5 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:18.164699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 5 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.164837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 5 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.164981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 5 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.165195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 5 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-09-30T14:50:18.165248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 5
2025-09-30T14:50:18.165970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.166290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.166940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.166957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.167040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 0 messageNo: 31 size: 511959
2025-09-30T14:50:18.167103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 1 messageNo: 31 size: 511959
2025-09-30T14:50:18.167171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 2 messageNo: 31 size: 511959
2025-09-30T14:50:18.167190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 21 to 21
2025-09-30T14:50:18.167259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 3 messageNo: 31 size: 511959
2025-09-30T14:50:18.167303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 4 messageNo: 31 size: 205040
2025-09-30T14:50:18.167317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 4 messageNo: 31 size 205040 offset: -1
2025-09-30T14:50:18.167347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.167350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.167375Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.167399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.167559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 32  requestId: <none> cookie: 17
2025-09-30T14:50:18.167640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.168009Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 11 Result { Offset: 5 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 6 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759243818094 CreateTimestampMS: 1759243818063 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 9012942 RealReadOffset: 5 WaitQuotaTimeMs: 0 EndOffset: 11 StartOffset: 0 } Cookie: 5 }
2025-09-30T14:50:18.168298Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 6 endOffset 11
2025-09-30T14:50:18.168314Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 11 ReadOffset 6 ReadGuid 8ca539d8-a20cfb94-c66bd7cb-b02f21d7 has messages 1
2025-09-30T14:50:18.168347Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 6, endOffset# 11, WTime# 1759243818094, sizeLag# 9012942
2025-09-30T14:50:18.168357Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1TEvPartitionReady. Aval parts: 0
2025-09-30T14:50:18.168369Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 read done: guid# 8ca539d8-a20cfb94-c66bd7cb-b02f21d7, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252976
2025-09-30T14:50:18.168381Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 response to read: guid# 8ca539d8-a20cfb94-c66bd7cb-b02f21d7
2025-09-30T14:50:18.169227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.169241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 21
2025-09-30T14:50:18.169250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-09-30T14:50:18.169313Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.169458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 4 size 7988778 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.169471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 2 size 3994385 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.169502Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 Process answer. Aval parts: 1
2025-09-30T14:50:18.169508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.169511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0' size 7988778
2025-09-30T14:50:18.169516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:471: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-09-30T14:50:18.169521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 1 parts 1 suffix '124' size 717134
2025-09-30T14:50:18.169525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:18.169529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 2 parts 7 suffix '124' size 3994385
2025-09-30T14:50:18.170431Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got ReadResponse, serverBytesSize = 2252976, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728688
2025-09-30T14:50:18.170511Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (5-5)
2025-09-30T14:50:18.170525Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Returning serverBytesSize = 2252976 to budget
2025-09-30T14:50:18.171656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.170817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.170838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000009_00000_0000000002_00008?
2025-09-30T14:50:18.170842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 4506417 bytes (4506417)
2025-09-30T14:50:18.170848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 4506417 (8388608)
2025-09-30T14:50:18.170864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 3 size 717134 cause it's been evicted from L2. Actual L1 size: 7
2025-09-30T14:50:18.170867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 0 size 8295635 cause it's been evicted from L2. Actual L1 size: 6
2025-09-30T14:50:18.170872Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-09-30T14:50:18.171824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.171842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.171932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.171923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 0 messageNo: 33 size: 511959
2025-09-30T14:50:18.171979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 1 messageNo: 33 size: 511959
2025-09-30T14:50:18.172037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 2 messageNo: 33 size: 511959
2025-09-30T14:50:18.172102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 3 messageNo: 33 size: 511959
2025-09-30T14:50:18.172139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 4 messageNo: 33 size: 205040
2025-09-30T14:50:18.172144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 4 messageNo: 33 size 205040 offset: -1
2025-09-30T14:50:18.172173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.172176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.172185Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.172205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.172218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 34  requestId: <none> cookie: 18
2025-09-30T14:50:18.172335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.173637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 11 count 2 size 4506418 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.173664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.173686Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:18.173698Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.173708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 0, Offset: 11 is stored on disk
2025-09-30T14:50:18.173717Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.173721Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 1, Offset: 11 is stored on disk
2025-09-30T14:50:18.173724Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.173729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 2, Offset: 11 is stored on disk
2025-09-30T14:50:18.173731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.173739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 3, Offset: 11 is stored on disk
2025-09-30T14:50:18.173750Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.173753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 4, Offset: 11 is stored on disk
2025-09-30T14:50:18.173759Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.173762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 0, Offset: 12 is stored on disk
2025-09-30T14:50:18.173764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.173768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 1, Offset: 12 is stored on disk
2025-09-30T14:50:18.173770Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.173773Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 2, Offset: 12 is stored on disk
2025-09-30T14:50:18.173774Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.173778Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 3, Offset: 12 is stored on disk
2025-09-30T14:50:18.173780Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.173784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 4, Offset: 12 is stored on disk
2025-09-30T14:50:18.173831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.173865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.173874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (20)
2025-09-30T14:50:18.173898Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-09-30T14:50:18.173913Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 1
2025-09-30T14:50:18.173921Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 2
2025-09-30T14:50:18.173925Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 3
2025-09-30T14:50:18.173929Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 4
2025-09-30T14:50:18.173931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.173977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:18.174231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.174411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 14 partNo 4 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 2253230 count 1 nextOffset 14 batches 5
2025-09-30T14:50:18.174448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-09-30T14:50:18.174460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 1
2025-09-30T14:50:18.174463Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 2
2025-09-30T14:50:18.174466Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 3
2025-09-30T14:50:18.174470Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 4
2025-09-30T14:50:18.175050Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 15 partNo 4 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 4506428 count 2 nextOffset 15 batches 9
2025-09-30T14:50:18.175077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-09-30T14:50:18.175082Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 1
2025-09-30T14:50:18.175085Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 2
2025-09-30T14:50:18.175088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 3
2025-09-30T14:50:18.175093Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 4
2025-09-30T14:50:18.175592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 16 partNo 4 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 6759626 count 3 nextOffset 16 batches 13
2025-09-30T14:50:18.175611Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-09-30T14:50:18.175616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 1
2025-09-30T14:50:18.175618Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 2
2025-09-30T14:50:18.175620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 3
2025-09-30T14:50:18.177893Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 17 partNo 3 result is x0000000000_00000000000000000013_00000_0000000003_00015? size 8295638
2025-09-30T14:50:18.177913Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 4
2025-09-30T14:50:18.177924Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000013_00000_0000000003_00015? new key d0000000000_00000000000000000013_00000_0000000003_00015? size 8295638 WTime 1759243818177
2025-09-30T14:50:18.178044Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 17 partNo 4 FormedBlobsCount 1 NewHead: Offset 16 PartNo 3 PackedSize 717145 count 1 nextOffset 17 batches 2
2025-09-30T14:50:18.178057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.178165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 16,1 HeadOffset 13 endOffset 13 curOffset 17 d0000000000_00000000000000000016_00003_0000000001_00001? size 717135 WTime 1759243818177
2025-09-30T14:50:18.178332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000009_00000_0000000002_00008?
2025-09-30T14:50:18.178343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000011_00000_0000000002_00008?
2025-09-30T14:50:18.178349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 9012835 bytes (9012835)
2025-09-30T14:50:18.178352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-09-30T14:50:18.178398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 23  requestId: <none> cookie: 12
2025-09-30T14:50:18.178450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 25  requestId: <none> cookie: 13
2025-09-30T14:50:18.178810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.178859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.179281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 12 offsets: 11 already_written: false write_statistics { persist_duration_ms: 17 queued_in_partition_duration_ms: 17 }
2025-09-30T14:50:18.179302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 12
2025-09-30T14:50:18.179308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Estimated memory usage got back to normal 20275218[B]
2025-09-30T14:50:18.179457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 13 offsets: 12 already_written: false write_statistics { persist_duration_ms: 16 queued_in_partition_duration_ms: 4 }
2025-09-30T14:50:18.179470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 13
2025-09-30T14:50:18.179668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.179689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.179789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 35 size: 511959
2025-09-30T14:50:18.179862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 35 size: 511959
2025-09-30T14:50:18.179879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 22 to 22
2025-09-30T14:50:18.180176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.180191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 22
2025-09-30T14:50:18.180404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.180515Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (5-5)
2025-09-30T14:50:18.180536Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-09-30T14:50:18.180548Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252976, ReadSizeServerDelta = -1728688
2025-09-30T14:50:18.180661Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-09-30T14:50:18.180674Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:50:18.180880Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252976 } }
2025-09-30T14:50:18.180969Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 got read request: guid# 3eedafea-77d12d41-f2c6929-509328db
2025-09-30T14:50:18.181001Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 performing read request: guid# 49f585ad-afb80a5c-bf338a13-6d3d19a7, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 6, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:50:18.181027Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 6 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 6 EndOffset 11 ClientCommitOffset 0 committedOffset 0 Guid 49f585ad-afb80a5c-bf338a13-6d3d19a7
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 5 ProducerId: "src_id" SeqNo: 6 CreateTime: 2025-09-30T14:50:18.063000Z WriteTime: 2025-09-30T14:50:18.094000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:54586", "logtype": "unknown", "_ip": "ipv6:[::1]:54586" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-09-30T14:50:18.182453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.182846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.179932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 35 size: 511959
2025-09-30T14:50:18.180006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 35 size: 511959
2025-09-30T14:50:18.180041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 35 size: 205040
2025-09-30T14:50:18.180046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 35 size 205040 offset: -1
2025-09-30T14:50:18.180077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.180080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.180090Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.180108Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 13 partNo 0 count 3 size 8295638
2025-09-30T14:50:18.180118Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 16 partNo 3 count 1 size 717135
2025-09-30T14:50:18.180124Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000004_00000_0000000001_00004?(+) to d0000000000_00000000000000000004_00000_0000000001_00004?(+)
2025-09-30T14:50:18.180127Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000005_00000_0000000001_00004?(+) to d0000000000_00000000000000000005_00000_0000000001_00004?(+)
2025-09-30T14:50:18.180130Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000006_00000_0000000003_00012?(+) to d0000000000_00000000000000000006_00000_0000000003_00012?(+)
2025-09-30T14:50:18.180133Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00003_0000000001_00001|(+) to d0000000000_00000000000000000003_00003_0000000001_00001|(+)
2025-09-30T14:50:18.180146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-09-30T14:50:18.180150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000009_00000_0000000002_00008?
2025-09-30T14:50:18.180160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000011_00000_0000000002_00008?
2025-09-30T14:50:18.180172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-09-30T14:50:18.180175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.180196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.180266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 9 partno 0 count 2 parts_count 8 source 1 size 4506417 accessed 0 times before, last time 2025-09-30T14:50:18.000000Z
2025-09-30T14:50:18.180269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 11 partno 0 count 2 parts_count 8 source 1 size 4506418 accessed 0 times before, last time 2025-09-30T14:50:18.000000Z
2025-09-30T14:50:18.180275Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-09-30T14:50:18.180298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 36  requestId: <none> cookie: 19
2025-09-30T14:50:18.180308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 2 parts 8 suffix '63'
2025-09-30T14:50:18.180314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 2 parts 8 suffix '63'
2025-09-30T14:50:18.180324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:18.180330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000009_00000_0000000002_00008?
2025-09-30T14:50:18.180332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:18.180491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-09-30T14:50:18.180640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 1
2025-09-30T14:50:18.180794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 2
2025-09-30T14:50:18.180946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 3
2025-09-30T14:50:18.181175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 4
2025-09-30T14:50:18.181608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 10 partNo 4 FormedBlobsCount 0 NewHead: Offset 9 PartNo 0 PackedSize 2253229 count 1 nextOffset 10 batches 5
2025-09-30T14:50:18.181618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-09-30T14:50:18.181759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 1
2025-09-30T14:50:18.181916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 2
2025-09-30T14:50:18.182081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 3
2025-09-30T14:50:18.182163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 4
2025-09-30T14:50:18.185521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 23 to 23
2025-09-30T14:50:18.185824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.185837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 23
2025-09-30T14:50:18.185847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-09-30T14:50:18.185899Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.187238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 11 partNo 4 result is x0000000000_00000000000000000007_00001_0000000003_00015 size 8295601
2025-09-30T14:50:18.187278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000007_00001_0000000003_00015 new key d0000000000_00000000000000000007_00001_0000000003_00015 size 8295601 WTime 1759243818186
2025-09-30T14:50:18.187306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 11 partNo 4 FormedBlobsCount 1 NewHead: Offset 10 PartNo 4 PackedSize 205118 count 1 nextOffset 11 batches 1
2025-09-30T14:50:18.187318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000011_00000_0000000002_00008?
2025-09-30T14:50:18.187320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:18.187461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-09-30T14:50:18.187600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 1
2025-09-30T14:50:18.187752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 2
2025-09-30T14:50:18.187900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 3
2025-09-30T14:50:18.188124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 4
2025-09-30T14:50:18.188635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 12 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 4 PackedSize 2458316 count 2 nextOffset 12 batches 5
2025-09-30T14:50:18.188653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-09-30T14:50:18.188793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 1
2025-09-30T14:50:18.188958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 2
2025-09-30T14:50:18.189118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 3
2025-09-30T14:50:18.189197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 4
2025-09-30T14:50:18.189728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 13 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 4 PackedSize 4711514 count 3 nextOffset 13 batches 9
2025-09-30T14:50:18.189830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:550: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 10,3 HeadOffset 7 endOffset 9 curOffset 13 d0000000000_00000000000000000010_00004_0000000003_00008| size 4711504 WTime 1759243818189
2025-09-30T14:50:18.192276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.192293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.193159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.193190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.193271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 37 size: 511959
2025-09-30T14:50:18.193328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 37 size: 511959
2025-09-30T14:50:18.193394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 37 size: 511959
2025-09-30T14:50:18.193454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 37 size: 511959
2025-09-30T14:50:18.193492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 37 size: 205040
2025-09-30T14:50:18.193503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 37 size 205040 offset: -1
2025-09-30T14:50:18.193547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.193561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.193584Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.193603Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 1 count 3 size 8295601
2025-09-30T14:50:18.193614Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 4 count 3 size 4711504
2025-09-30T14:50:18.193639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.193666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.193936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 38  requestId: <none> cookie: 20
2025-09-30T14:50:18.193968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 11 Topic 'rt3.dc1--test-topic' partition 0 user user offset 6 count 6 size 524288 endOffset 13 max time lag 0ms effective offset 6
2025-09-30T14:50:18.193992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 11 added 1 blobs, size 0 count 1 last offset 3, current partition end offset: 13
2025-09-30T14:50:18.194047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.194325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 11. Send blob request.
2025-09-30T14:50:18.194349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 3 count 4 parts_count 14 source 1 size 7988778 accessed 0 times before, last time 2025-09-30T14:50:18.000000Z
2025-09-30T14:50:18.194365Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 11. All 1 blobs are from cache.
2025-09-30T14:50:18.194382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0'
2025-09-30T14:50:18.194393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:18.196083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.196217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 5 totakecount 4 count 1 size 717094 from pos 1 cbcount 2
2025-09-30T14:50:18.196398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 6 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.196490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.196654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 6 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.196818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 6 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.196899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 6 totakecount 4 count 1 size 205085 from pos 0 cbcount 1
2025-09-30T14:50:18.197247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 7 totakecount 4 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:18.198289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.198307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.198390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 39 size: 511959
2025-09-30T14:50:18.198452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 39 size: 511959
2025-09-30T14:50:18.198524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 39 size: 511959
2025-09-30T14:50:18.198587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 39 size: 511959
2025-09-30T14:50:18.198625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 39 size: 205040
2025-09-30T14:50:18.198633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 39 size 205040 offset: -1
2025-09-30T14:50:18.198663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.198671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.198695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 6
2025-09-30T14:50:18.198767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 4 count 1 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.198778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 5 count 1 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.198783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 6 count 3 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.198791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 13 count 3 size 8295638 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.198799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 16 count 1 size 717135 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.198816Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.198836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-09-30T14:50:18.198845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.198851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-09-30T14:50:18.198856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 3 parts 12 suffix '63' size 6759613
2025-09-30T14:50:18.198871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-09-30T14:50:18.198876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 16 partno 3 count 1 parts 1 suffix '63' size 717135
2025-09-30T14:50:18.200718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.200756Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 9011644 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:18.200762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.200774Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 0, Offset: 13 is stored on disk
2025-09-30T14:50:18.200779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.200783Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 1, Offset: 13 is stored on disk
2025-09-30T14:50:18.200786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.200789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 2, Offset: 13 is stored on disk
2025-09-30T14:50:18.200791Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.200796Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 3, Offset: 13 is stored on disk
2025-09-30T14:50:18.200800Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.200808Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 4, Offset: 13 is stored on disk
2025-09-30T14:50:18.200809Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.200813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 0, Offset: 14 is stored on disk
2025-09-30T14:50:18.200814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.200819Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 1, Offset: 14 is stored on disk
2025-09-30T14:50:18.200821Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.200824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 2, Offset: 14 is stored on disk
2025-09-30T14:50:18.200825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.200828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 3, Offset: 14 is stored on disk
2025-09-30T14:50:18.200830Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.200833Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 4, Offset: 14 is stored on disk
2025-09-30T14:50:18.200833Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.200836Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 0, Offset: 15 is stored on disk
2025-09-30T14:50:18.200838Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.200841Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 1, Offset: 15 is stored on disk
2025-09-30T14:50:18.200842Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.200845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 2, Offset: 15 is stored on disk
2025-09-30T14:50:18.200846Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.200848Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 3, Offset: 15 is stored on disk
2025-09-30T14:50:18.200849Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.200851Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 4, Offset: 15 is stored on disk
2025-09-30T14:50:18.200861Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.200865Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 0, Offset: 16 is stored on disk
2025-09-30T14:50:18.200866Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.200868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 1, Offset: 16 is stored on disk
2025-09-30T14:50:18.200869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.200872Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 2, Offset: 16 is stored on disk
2025-09-30T14:50:18.200873Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.200877Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 3, Offset: 16 is stored on disk
2025-09-30T14:50:18.200878Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.200884Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 4, Offset: 16 is stored on disk
2025-09-30T14:50:18.200910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.200925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.200930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-09-30T14:50:18.200947Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-09-30T14:50:18.200964Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-09-30T14:50:18.200966Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-09-30T14:50:18.200969Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-09-30T14:50:18.200971Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-09-30T14:50:18.201428Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-09-30T14:50:18.201451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-09-30T14:50:18.201456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-09-30T14:50:18.201460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-09-30T14:50:18.201465Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-09-30T14:50:18.201470Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-09-30T14:50:18.201952Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-09-30T14:50:18.201977Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-09-30T14:50:18.201983Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-09-30T14:50:18.201987Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-09-30T14:50:18.201990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-09-30T14:50:18.201992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-09-30T14:50:18.202480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-09-30T14:50:18.202502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.202608Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 17,3 HeadOffset 17 endOffset 17 curOffset 20 d0000000000_00000000000000000017_00000_0000000003_00012? size 6759616 WTime 1759243818202
2025-09-30T14:50:18.207922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:50:18.207982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 40  requestId: <none> cookie: 21
2025-09-30T14:50:18.208123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: __TMP__REQUEST__MARKER__
2025-09-30T14:50:18.208133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.208123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.208171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 27  requestId: <none> cookie: 14
2025-09-30T14:50:18.208194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 29  requestId: <none> cookie: 15
2025-09-30T14:50:18.208211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 31  requestId: <none> cookie: 16
2025-09-30T14:50:18.208233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 33  requestId: <none> cookie: 17
2025-09-30T14:50:18.208251Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.208265Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 6759616
2025-09-30T14:50:18.208372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 12 Topic 'rt3.dc1--test-topic' partition 0 user user offset 7 count 1 size 26214400 endOffset 17 max time lag 0ms effective offset 7
2025-09-30T14:50:18.208380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 12 added 0 blobs, size 0 count 0 last offset 7, current partition end offset: 17
2025-09-30T14:50:18.208992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1088: [72075186224037892][Partition][0][StateIdle] Reading cookie 12. All data is from uncompacted head.
2025-09-30T14:50:18.209011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 0 blobs
2025-09-30T14:50:18.209120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: __TMP__REQUEST__MARKER__ cookie: 6
2025-09-30T14:50:18.209142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 3 size 8295601 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.209146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 3 size 4711504 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.209192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 2 parts 7 suffix '124' size 3994385
2025-09-30T14:50:18.209203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 2 parts 8 suffix '63' size 4506417
2025-09-30T14:50:18.209207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295601
2025-09-30T14:50:18.209215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:18.209219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 3 parts 8 suffix '124' size 4711504
2025-09-30T14:50:18.209572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.209599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.209606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.209613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.210028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 14 offsets: 13 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 13 }
2025-09-30T14:50:18.210043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 14
2025-09-30T14:50:18.210059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Estimated memory usage got back to normal 20275218[B]
2025-09-30T14:50:18.210135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 15 offsets: 14 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 10 }
2025-09-30T14:50:18.210139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 15
2025-09-30T14:50:18.210251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.210474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 24 to 24
2025-09-30T14:50:18.210587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.210848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.210863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 24
2025-09-30T14:50:18.211293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.211306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:471: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-09-30T14:50:18.212098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.212113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000013_00000_0000000003_00015?
2025-09-30T14:50:18.212118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000016_00003_0000000001_00001?
2025-09-30T14:50:18.212122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 9012773 bytes (9012773)
2025-09-30T14:50:18.212125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-09-30T14:50:18.212144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 7 size 3994385 cause it's been evicted from L2. Actual L1 size: 7
2025-09-30T14:50:18.212148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 9 size 4506417 cause it's been evicted from L2. Actual L1 size: 6
2025-09-30T14:50:18.212152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 11 size 4506418 cause it's been evicted from L2. Actual L1 size: 5
2025-09-30T14:50:18.212157Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-09-30T14:50:18.212209Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.213046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 16 offsets: 15 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 7 }
2025-09-30T14:50:18.213062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 16
2025-09-30T14:50:18.213108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.213127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.213200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 17 offsets: 16 already_written: false write_statistics { persist_duration_ms: 25 queued_in_partition_duration_ms: 3 }
2025-09-30T14:50:18.213210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 17
2025-09-30T14:50:18.213210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 41 size: 511959
2025-09-30T14:50:18.213267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 41 size: 511959
2025-09-30T14:50:18.213337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 41 size: 511959
2025-09-30T14:50:18.213400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 41 size: 511959
2025-09-30T14:50:18.213434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 41 size: 205040
2025-09-30T14:50:18.213441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 41 size 205040 offset: -1
2025-09-30T14:50:18.213466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.213474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.213483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-09-30T14:50:18.213486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000013_00000_0000000003_00015?
2025-09-30T14:50:18.213497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000016_00003_0000000001_00001?
2025-09-30T14:50:18.213510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-09-30T14:50:18.213528Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.213555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.213577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 13 partno 0 count 3 parts_count 15 source 1 size 8295638 accessed 0 times before, last time 2025-09-30T14:50:18.000000Z
2025-09-30T14:50:18.213581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 16 partno 3 count 1 parts_count 1 source 1 size 717135 accessed 0 times before, last time 2025-09-30T14:50:18.000000Z
2025-09-30T14:50:18.213593Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-09-30T14:50:18.213613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 3 parts 15 suffix '63'
2025-09-30T14:50:18.213630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 16 partno 3 count 1 parts 1 suffix '63'
2025-09-30T14:50:18.213770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 42  requestId: <none> cookie: 22
2025-09-30T14:50:18.213791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:18.213796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000013_00000_0000000003_00015?
2025-09-30T14:50:18.213798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:18.213901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.213934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-09-30T14:50:18.214075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 1
2025-09-30T14:50:18.214523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 2
2025-09-30T14:50:18.215012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 3
2025-09-30T14:50:18.215059Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 17 Result { Offset: 6 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 7 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759243818114 CreateTimestampMS: 1759243818070 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 7 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 8 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759243818115 CreateTimestampMS: 1759243818077 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20073790 RealReadOffset: 7 WaitQuotaTimeMs: 0 EndOffset: 17 StartOffset: 0 } Cookie: 6 }
2025-09-30T14:50:18.215199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 4
2025-09-30T14:50:18.215665Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 8 endOffset 17
2025-09-30T14:50:18.215698Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 ReadOffset 8 ReadGuid 49f585ad-afb80a5c-bf338a13-6d3d19a7 has messages 1
2025-09-30T14:50:18.215730Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 8, endOffset# 17, WTime# 1759243818115, sizeLag# 20073790
2025-09-30T14:50:18.215741Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1TEvPartitionReady. Aval parts: 0
2025-09-30T14:50:18.215779Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 read done: guid# 49f585ad-afb80a5c-bf338a13-6d3d19a7, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 4505936
2025-09-30T14:50:18.215794Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 response to read: guid# 49f585ad-afb80a5c-bf338a13-6d3d19a7
2025-09-30T14:50:18.215822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.215963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 14 partNo 4 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 2253230 count 1 nextOffset 14 batches 5
2025-09-30T14:50:18.215982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-09-30T14:50:18.216167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.216274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 1
2025-09-30T14:50:18.216422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 2
2025-09-30T14:50:18.216708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 25 to 25
2025-09-30T14:50:18.216991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.217003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 25
2025-09-30T14:50:18.217796Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 Process answer. Aval parts: 1
2025-09-30T14:50:18.217937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 15 partNo 2 result is x0000000000_00000000000000000010_00004_0000000004_00014 size 7988760
2025-09-30T14:50:18.218075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 3
2025-09-30T14:50:18.218273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 4
2025-09-30T14:50:18.218293Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000010_00004_0000000004_00014 new key d0000000000_00000000000000000010_00004_0000000004_00014 size 7988760 WTime 1759243818218
2025-09-30T14:50:18.218523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 15 partNo 4 FormedBlobsCount 1 NewHead: Offset 14 PartNo 2 PackedSize 1229172 count 1 nextOffset 15 batches 3
2025-09-30T14:50:18.218540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-09-30T14:50:18.218679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 1
2025-09-30T14:50:18.219177Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: 2025-09-30T14:50:18.219189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 2
SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.219352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 3
2025-09-30T14:50:18.219423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 4
2025-09-30T14:50:18.219479Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got ReadResponse, serverBytesSize = 4505936, now ReadSizeBudget = 0, ReadSizeServerDelta = -3981648
2025-09-30T14:50:18.219592Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (6-6)
2025-09-30T14:50:18.219610Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Returning serverBytesSize = 4505936 to budget
2025-09-30T14:50:18.219972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 16 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 2 PackedSize 3482370 count 2 nextOffset 16 batches 7
2025-09-30T14:50:18.222470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 26 to 26
2025-09-30T14:50:18.220423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-09-30T14:50:18.220440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 1
2025-09-30T14:50:18.220444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 2
2025-09-30T14:50:18.220453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000016_00003_0000000001_00001?
2025-09-30T14:50:18.220456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:18.220611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 3
2025-09-30T14:50:18.220680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 4
2025-09-30T14:50:18.221905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 17 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 2 PackedSize 5735568 count 3 nextOffset 17 batches 11
2025-09-30T14:50:18.221993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:550: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 14,3 HeadOffset 10 endOffset 13 curOffset 17 d0000000000_00000000000000000014_00002_0000000003_00010| size 5735558 WTime 1759243818221
2025-09-30T14:50:18.224481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.224503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 26
2025-09-30T14:50:18.226651Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (6-6)
2025-09-30T14:50:18.226681Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-09-30T14:50:18.226741Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (7-7)
2025-09-30T14:50:18.226771Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:50:18.226803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.226840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.226942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 43 size: 511959
2025-09-30T14:50:18.227012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 43 size: 511959
2025-09-30T14:50:18.227094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 43 size: 511959
2025-09-30T14:50:18.227166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 43 size: 511959
2025-09-30T14:50:18.227214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 43 size: 205040
2025-09-30T14:50:18.227224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 43 size 205040 offset: -1
2025-09-30T14:50:18.227293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.227302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.227316Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.227344Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 4 count 4 size 7988760
2025-09-30T14:50:18.227358Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 2 count 3 size 5735558
2025-09-30T14:50:18.227380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 17 count 3 size 6759616 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.227411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.227445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.227453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0' size 7988778
2025-09-30T14:50:18.227462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 17 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-09-30T14:50:18.227496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.227523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 6758733 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:18.227529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.227540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 0, Offset: 17 is stored on disk
2025-09-30T14:50:18.227550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.227560Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 1, Offset: 17 is stored on disk
2025-09-30T14:50:18.227563Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.227569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 2, Offset: 17 is stored on disk
2025-09-30T14:50:18.227576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.227582Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 3, Offset: 17 is stored on disk
2025-09-30T14:50:18.227588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.227599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 4, Offset: 17 is stored on disk
2025-09-30T14:50:18.227603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.227608Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 0, Offset: 18 is stored on disk
2025-09-30T14:50:18.227610Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.227614Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 1, Offset: 18 is stored on disk
2025-09-30T14:50:18.227616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.227620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 2, Offset: 18 is stored on disk
2025-09-30T14:50:18.227622Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.227626Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 3, Offset: 18 is stored on disk
2025-09-30T14:50:18.227628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.227633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 4, Offset: 18 is stored on disk
2025-09-30T14:50:18.227634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.227638Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 0, Offset: 19 is stored on disk
2025-09-30T14:50:18.227640Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.227644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 1, Offset: 19 is stored on disk
2025-09-30T14:50:18.227646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.227651Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 2, Offset: 19 is stored on disk
2025-09-30T14:50:18.227653Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.227656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 3, Offset: 19 is stored on disk
2025-09-30T14:50:18.227662Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.227666Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 4, Offset: 19 is stored on disk
2025-09-30T14:50:18.227714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.227733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.227735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-09-30T14:50:18.227759Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-09-30T14:50:18.227780Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-09-30T14:50:18.227784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-09-30T14:50:18.227787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-09-30T14:50:18.227790Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-09-30T14:50:18.228295Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 2253230 count 1 nextOffset 21 batches 5
2025-09-30T14:50:18.228324Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-09-30T14:50:18.228332Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-09-30T14:50:18.228335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-09-30T14:50:18.228338Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-09-30T14:50:18.228341Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-09-30T14:50:18.228946Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 4506428 count 2 nextOffset 22 batches 9
2025-09-30T14:50:18.228968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.229088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 20,2 HeadOffset 20 endOffset 20 curOffset 22 d0000000000_00000000000000000020_00000_0000000002_00008? size 4506418 WTime 1759243818227
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 6 ProducerId: "src_id" SeqNo: 7 CreateTime: 2025-09-30T14:50:18.070000Z WriteTime: 2025-09-30T14:50:18.114000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:54586", "logtype": "unknown", "_ip": "ipv6:[::1]:54586", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-09-30T14:50:18.232977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:50:18.233021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 44  requestId: <none> cookie: 23
2025-09-30T14:50:18.233058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 3 size 7988778 cause it's been evicted from L2. Actual L1 size: 5
2025-09-30T14:50:18.233063Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-09-30T14:50:18.233136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 35  requestId: <none> cookie: 18
2025-09-30T14:50:18.233167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 37  requestId: <none> cookie: 19
2025-09-30T14:50:18.233189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 39  requestId: <none> cookie: 20
2025-09-30T14:50:18.233208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.233211Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.233226Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 0 count 2 size 4506418
2025-09-30T14:50:18.233232Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000009_00000_0000000002_00008?(+) to d0000000000_00000000000000000009_00000_0000000002_00008?(+)
2025-09-30T14:50:18.233196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.233243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.233255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.233235Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000011_00000_0000000002_00008?(+) to d0000000000_00000000000000000011_00000_0000000002_00008?(+)
2025-09-30T14:50:18.233236Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000007_00001_0000000002_00007|(+) to d0000000000_00000000000000000007_00001_0000000002_00007|(+)
2025-09-30T14:50:18.234546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.235972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 27 to 27
2025-09-30T14:50:18.236247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.236260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 27
2025-09-30T14:50:18.236267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-09-30T14:50:18.236317Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.236590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 18 offsets: 17 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 20 }
2025-09-30T14:50:18.236546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.236604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 18
2025-09-30T14:50:18.236625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Estimated memory usage got back to normal 20275218[B]
2025-09-30T14:50:18.236722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 19 offsets: 18 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 7 }
2025-09-30T14:50:18.236726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 19
2025-09-30T14:50:18.236756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 20 offsets: 19 already_written: false write_statistics { persist_duration_ms: 25 queued_in_partition_duration_ms: 3 }
2025-09-30T14:50:18.236760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 20
2025-09-30T14:50:18.236884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.238193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.238219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.238313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 45 size: 511959
2025-09-30T14:50:18.238384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 45 size: 511959
2025-09-30T14:50:18.238464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 45 size: 511959
2025-09-30T14:50:18.238541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 45 size: 511959
2025-09-30T14:50:18.238592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 45 size: 205040
2025-09-30T14:50:18.238603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 45 size 205040 offset: -1
2025-09-30T14:50:18.238646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.238658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.238683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.238712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.238733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 46  requestId: <none> cookie: 24
2025-09-30T14:50:18.238855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.240186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 28 to 28
2025-09-30T14:50:18.240474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.240485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 28
2025-09-30T14:50:18.240752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.240867Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (7-7)
2025-09-30T14:50:18.240886Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-09-30T14:50:18.240897Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In ContinueReadingDataImpl, ReadSizeBudget = 4505936, ReadSizeServerDelta = -3981648
2025-09-30T14:50:18.240941Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-09-30T14:50:18.240952Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:50:18.241097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.241851Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 grpc read done: success# 1, data# { read_request { bytes_size: 4505936 } }
2025-09-30T14:50:18.241925Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 got read request: guid# a6df0c59-57f44eba-e214fa07-6b5bcbbb
2025-09-30T14:50:18.241953Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 performing read request: guid# 3d2b6672-5caf1c8-6e88a0f9-8d62789d, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 10, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:50:18.241989Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 10 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 8 EndOffset 17 ClientCommitOffset 0 committedOffset 0 Guid 3d2b6672-5caf1c8-6e88a0f9-8d62789d
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 7 ProducerId: "src_id" SeqNo: 8 CreateTime: 2025-09-30T14:50:18.077000Z WriteTime: 2025-09-30T14:50:18.115000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:54586", "logtype": "unknown", "server": "ipv6:[::1]:54586" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-09-30T14:50:18.241867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.241893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.242002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 47 size: 511959
2025-09-30T14:50:18.242070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 47 size: 511959
2025-09-30T14:50:18.242142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 47 size: 511959
2025-09-30T14:50:18.242210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 47 size: 511959
2025-09-30T14:50:18.242261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 47 size: 205040
2025-09-30T14:50:18.242267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 47 size 205040 offset: -1
2025-09-30T14:50:18.242315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.242318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.242341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.242344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.242360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.242387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.242410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 48  requestId: <none> cookie: 25
2025-09-30T14:50:18.242451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 13 Topic 'rt3.dc1--test-topic' partition 0 user user offset 8 count 10 size 524288 endOffset 20 max time lag 0ms effective offset 8
2025-09-30T14:50:18.242479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 13 added 1 blobs, size 0 count 2 last offset 7, current partition end offset: 20
2025-09-30T14:50:18.242539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.243428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 13. Send blob request.
2025-09-30T14:50:18.243459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 1 count 3 parts_count 15 source 1 size 8295601 accessed 0 times before, last time 2025-09-30T14:50:18.000000Z
2025-09-30T14:50:18.243474Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 13. All 1 blobs are from cache.
2025-09-30T14:50:18.243504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:18.243589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0'
2025-09-30T14:50:18.244224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 7 totakecount 3 count 1 size 717094 from pos 1 cbcount 2
2025-09-30T14:50:18.244407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 8 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.244647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 8 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.244389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.244707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.244813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 8 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.244916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 8 totakecount 3 count 1 size 205085 from pos 0 cbcount 1
2025-09-30T14:50:18.244977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 29 to 29
2025-09-30T14:50:18.245107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 9 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:18.245263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.245274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 29
2025-09-30T14:50:18.245293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 9 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.245321Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.245464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 9 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.245637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 9 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.245723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 9 totakecount 3 count 1 size 205085 from pos 0 cbcount 1
2025-09-30T14:50:18.247781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 10 totakecount 3 count 0 size 2047975 from pos 0 cbcount 4
2025-09-30T14:50:18.248899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.248926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.248991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 30 to 30
2025-09-30T14:50:18.249023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 49 size: 511959
2025-09-30T14:50:18.249100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 49 size: 511959
2025-09-30T14:50:18.249174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 49 size: 511959
2025-09-30T14:50:18.249265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.249277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 30
2025-09-30T14:50:18.249251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 49 size: 511959
2025-09-30T14:50:18.249284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-09-30T14:50:18.249332Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-09-30T14:50:18.249301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 49 size: 205040
2025-09-30T14:50:18.249312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 49 size 205040 offset: -1
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.249350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.249360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.249399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 8
2025-09-30T14:50:18.249597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.249625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.252700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 50  requestId: <none> cookie: 26
2025-09-30T14:50:18.252782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 4 size 7988760 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.252790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 3 size 5735558 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.252805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.252813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:471: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-09-30T14:50:18.252816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 3 parts 8 suffix '124' size 4711504
2025-09-30T14:50:18.252822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988760
2025-09-30T14:50:18.252831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-09-30T14:50:18.252836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 3 parts 10 suffix '124' size 5735558
2025-09-30T14:50:18.253748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.253765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000017_00000_0000000003_00012?
2025-09-30T14:50:18.253769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 6759616 bytes (6759616)
2025-09-30T14:50:18.253775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 6759616 (8388608)
2025-09-30T14:50:18.253792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 10 size 4711504 cause it's been evicted from L2. Actual L1 size: 6
2025-09-30T14:50:18.253795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 13 size 8295638 cause it's been evicted from L2. Actual L1 size: 5
2025-09-30T14:50:18.253800Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-09-30T14:50:18.254675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.255418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 20 count 2 size 4506418 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.255462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.255476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 16 partno 3 count 1 parts 1 suffix '63' size 717135
2025-09-30T14:50:18.255486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:18.255487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:18.255495Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.255505Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 0, Offset: 20 is stored on disk
2025-09-30T14:50:18.255515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.255521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 1, Offset: 20 is stored on disk
2025-09-30T14:50:18.255522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.255529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 2, Offset: 20 is stored on disk
2025-09-30T14:50:18.255533Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.255537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 3, Offset: 20 is stored on disk
2025-09-30T14:50:18.255544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.255548Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 4, Offset: 20 is stored on disk
2025-09-30T14:50:18.255550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.255555Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 0, Offset: 21 is stored on disk
2025-09-30T14:50:18.255557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.255561Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 1, Offset: 21 is stored on disk
2025-09-30T14:50:18.255563Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.255568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 2, Offset: 21 is stored on disk
2025-09-30T14:50:18.255570Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.255574Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 3, Offset: 21 is stored on disk
2025-09-30T14:50:18.255579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.255584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 4, Offset: 21 is stored on disk
2025-09-30T14:50:18.255625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.255647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.255649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-09-30T14:50:18.255673Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-09-30T14:50:18.255687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-09-30T14:50:18.255695Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-09-30T14:50:18.255699Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-09-30T14:50:18.255702Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-09-30T14:50:18.256567Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 20 Result { Offset: 8 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 9 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759243818116 CreateTimestampMS: 1759243818083 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 9 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 10 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759243818134 CreateTimestampMS: 1759243818092 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 10754169 RealReadOffset: 9 WaitQuotaTimeMs: 0 EndOffset: 20 StartOffset: 0 } Cookie: 8 }
2025-09-30T14:50:18.256974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.257197Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 10 endOffset 20
2025-09-30T14:50:18.257227Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 20 ReadOffset 10 ReadGuid 3d2b6672-5caf1c8-6e88a0f9-8d62789d has messages 1
2025-09-30T14:50:18.256127Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 2253230 count 1 nextOffset 23 batches 5
2025-09-30T14:50:18.256159Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-09-30T14:50:18.256168Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-09-30T14:50:18.256171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-09-30T14:50:18.256174Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-09-30T14:50:18.256178Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-09-30T14:50:18.257271Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 10, endOffset# 20, WTime# 1759243818134, sizeLag# 10754169
2025-09-30T14:50:18.256743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 4506428 count 2 nextOffset 24 batches 9
2025-09-30T14:50:18.257280Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1TEvPartitionReady. Aval parts: 0
2025-09-30T14:50:18.256761Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-09-30T14:50:18.257293Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 read done: guid# 3d2b6672-5caf1c8-6e88a0f9-8d62789d, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 4505936
2025-09-30T14:50:18.257309Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 response to read: guid# 3d2b6672-5caf1c8-6e88a0f9-8d62789d
2025-09-30T14:50:18.256768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-09-30T14:50:18.256772Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-09-30T14:50:18.256776Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-09-30T14:50:18.256779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-09-30T14:50:18.257451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.258035Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 6759626 count 3 nextOffset 25 batches 13
2025-09-30T14:50:18.258061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.258179Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 22,3 HeadOffset 22 endOffset 22 curOffset 25 d0000000000_00000000000000000022_00000_0000000003_00012? size 6759616 WTime 1759243818258
2025-09-30T14:50:18.259141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000017_00000_0000000003_00012?
2025-09-30T14:50:18.259157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000020_00000_0000000002_00008?
2025-09-30T14:50:18.259161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 11266034 bytes (11266034)
2025-09-30T14:50:18.259164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-09-30T14:50:18.259190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 16 size 717135 cause it's been evicted from L2. Actual L1 size: 5
2025-09-30T14:50:18.259199Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-09-30T14:50:18.259234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 41  requestId: <none> cookie: 21
2025-09-30T14:50:18.259296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 43  requestId: <none> cookie: 22
2025-09-30T14:50:18.259386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.259431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.259791Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 Process answer. Aval parts: 1
2025-09-30T14:50:18.260214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.260227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 21 offsets: 20 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 13 }
2025-09-30T14:50:18.260238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.260265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 21
2025-09-30T14:50:18.260288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Estimated memory usage got back to normal 20275218[B]
2025-09-30T14:50:18.260322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 51 size: 511959
2025-09-30T14:50:18.260386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 22 offsets: 21 already_written: false write_statistics { persist_duration_ms: 27 }
2025-09-30T14:50:18.260387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 51 size: 511959
2025-09-30T14:50:18.260410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 22
2025-09-30T14:50:18.260450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 51 size: 511959
2025-09-30T14:50:18.260512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 51 size: 511959
2025-09-30T14:50:18.260559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 51 size: 205040
2025-09-30T14:50:18.260569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 51 size 205040 offset: -1
2025-09-30T14:50:18.260723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 31 to 31
2025-09-30T14:50:18.260723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.260732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.260742Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.260759Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 22 partNo 0 count 3 size 6759616
2025-09-30T14:50:18.260769Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000013_00000_0000000003_00015?(+) to d0000000000_00000000000000000013_00000_0000000003_00015?(+)
2025-09-30T14:50:18.260773Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000016_00003_0000000001_00001?(+) to d0000000000_00000000000000000016_00003_0000000001_00001?(+)
2025-09-30T14:50:18.260779Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000010_00004_0000000003_00008|(+) to d0000000000_00000000000000000010_00004_0000000003_00008|(+)
2025-09-30T14:50:18.260791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-09-30T14:50:18.260799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000017_00000_0000000003_00012?
2025-09-30T14:50:18.260810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000020_00000_0000000002_00008?
2025-09-30T14:50:18.260825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-09-30T14:50:18.260839Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.260864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.260936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 17 partno 0 count 3 parts_count 12 source 1 size 6759616 accessed 0 times before, last time 2025-09-30T14:50:18.000000Z
2025-09-30T14:50:18.260946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 20 partno 0 count 2 parts_count 8 source 1 size 4506418 accessed 0 times before, last time 2025-09-30T14:50:18.000000Z
2025-09-30T14:50:18.260952Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-09-30T14:50:18.260967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 17 partno 0 count 3 parts 12 suffix '63'
2025-09-30T14:50:18.260972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 2 parts 8 suffix '63'
2025-09-30T14:50:18.260980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 52  requestId: <none> cookie: 27
2025-09-30T14:50:18.261000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:18.261010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000017_00000_0000000003_00012?
2025-09-30T14:50:18.261013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:18.261061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.261075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 31
2025-09-30T14:50:18.261053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.261137Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: 2025-09-30T14:50:18.261147Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got ReadResponse, serverBytesSize = 4505936, now ReadSizeBudget = 0, ReadSizeServerDelta = -3981648
SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.261161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-09-30T14:50:18.261243Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (8-8)
2025-09-30T14:50:18.261263Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Returning serverBytesSize = 4505936 to budget
2025-09-30T14:50:18.261333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-09-30T14:50:18.261494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-09-30T14:50:18.261668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-09-30T14:50:18.262090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-09-30T14:50:18.262526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-09-30T14:50:18.262548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-09-30T14:50:18.264036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.264408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.264848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 32 to 32
2025-09-30T14:50:18.265183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.265197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 32
2025-09-30T14:50:18.265205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-09-30T14:50:18.265675Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (8-8)
2025-09-30T14:50:18.265696Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-09-30T14:50:18.265744Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (9-9)
2025-09-30T14:50:18.265762Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:50:18.266209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 19 partNo 0 result is x0000000000_00000000000000000014_00002_0000000004_00014 size 7988778
2025-09-30T14:50:18.266359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-09-30T14:50:18.266515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-09-30T14:50:18.266737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-09-30T14:50:18.266966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-09-30T14:50:18.266993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000014_00002_0000000004_00014 new key d0000000000_00000000000000000014_00002_0000000004_00014 size 7988778 WTime 1759243818266
2025-09-30T14:50:18.267444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 19 partNo 4 FormedBlobsCount 1 NewHead: Offset 18 PartNo 0 PackedSize 2253230 count 1 nextOffset 19 batches 5
2025-09-30T14:50:18.267466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-09-30T14:50:18.267609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-09-30T14:50:18.267757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-09-30T14:50:18.267892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-09-30T14:50:18.267968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 8 ProducerId: "src_id" SeqNo: 9 CreateTime: 2025-09-30T14:50:18.083000Z WriteTime: 2025-09-30T14:50:18.116000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:54586", "_ip": "ipv6:[::1]:54586", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-09-30T14:50:18.268496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 18 PartNo 0 PackedSize 4506428 count 2 nextOffset 20 batches 9
2025-09-30T14:50:18.268517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000020_00000_0000000002_00008?
2025-09-30T14:50:18.268524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:18.268670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-09-30T14:50:18.268817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-09-30T14:50:18.268954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-09-30T14:50:18.269099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-09-30T14:50:18.269310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-09-30T14:50:18.270592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 21 partNo 4 FormedBlobsCount 0 NewHead: Offset 18 PartNo 0 PackedSize 6759626 count 3 nextOffset 21 batches 13
2025-09-30T14:50:18.270609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-09-30T14:50:18.270760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-09-30T14:50:18.270914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-09-30T14:50:18.271088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-09-30T14:50:18.274493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 22 partNo 3 result is x0000000000_00000000000000000018_00000_0000000003_00015 size 8295638
2025-09-30T14:50:18.274589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-09-30T14:50:18.274605Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000018_00000_0000000003_00015 new key d0000000000_00000000000000000018_00000_0000000003_00015 size 8295638 WTime 1759243818274
2025-09-30T14:50:18.274733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 22 partNo 4 FormedBlobsCount 1 NewHead: Offset 21 PartNo 3 PackedSize 717145 count 1 nextOffset 22 batches 2
2025-09-30T14:50:18.274853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:550: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 21,1 HeadOffset 14 endOffset 17 curOffset 22 d0000000000_00000000000000000021_00003_0000000001_00001| size 717135 WTime 1759243818274
2025-09-30T14:50:18.276226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.276249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.276345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 53 size: 511959
2025-09-30T14:50:18.276408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 53 size: 511959
2025-09-30T14:50:18.276468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 53 size: 511959
2025-09-30T14:50:18.276531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 53 size: 511959
2025-09-30T14:50:18.276569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 53 size: 205040
2025-09-30T14:50:18.276579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 53 size 205040 offset: -1
2025-09-30T14:50:18.276613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.276625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.276657Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.276681Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 2 count 4 size 7988778
2025-09-30T14:50:18.276688Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 18 partNo 0 count 3 size 8295638
2025-09-30T14:50:18.276696Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 21 partNo 3 count 1 size 717135
2025-09-30T14:50:18.276708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.276732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.276944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 54  requestId: <none> cookie: 28
2025-09-30T14:50:18.277082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.277907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 22 count 3 size 6759616 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.277947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.277970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295601
2025-09-30T14:50:18.277975Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 6758733 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:18.277982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-09-30T14:50:18.277984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.277994Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 0, Offset: 22 is stored on disk
2025-09-30T14:50:18.277998Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.278005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 1, Offset: 22 is stored on disk
2025-09-30T14:50:18.278017Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.278022Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 2, Offset: 22 is stored on disk
2025-09-30T14:50:18.278024Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.278028Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 3, Offset: 22 is stored on disk
2025-09-30T14:50:18.278033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.278037Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 4, Offset: 22 is stored on disk
2025-09-30T14:50:18.278040Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.278045Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 0, Offset: 23 is stored on disk
2025-09-30T14:50:18.278048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.278052Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 1, Offset: 23 is stored on disk
2025-09-30T14:50:18.278054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.278057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 2, Offset: 23 is stored on disk
2025-09-30T14:50:18.278059Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.278064Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 3, Offset: 23 is stored on disk
2025-09-30T14:50:18.278066Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.278070Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 4, Offset: 23 is stored on disk
2025-09-30T14:50:18.278072Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.278075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 0, Offset: 24 is stored on disk
2025-09-30T14:50:18.278077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.278081Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 1, Offset: 24 is stored on disk
2025-09-30T14:50:18.278083Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.278090Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 2, Offset: 24 is stored on disk
2025-09-30T14:50:18.278092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.278106Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 3, Offset: 24 is stored on disk
2025-09-30T14:50:18.278112Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.278116Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 4, Offset: 24 is stored on disk
2025-09-30T14:50:18.278161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.278178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.278184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-09-30T14:50:18.278206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-09-30T14:50:18.278220Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-09-30T14:50:18.278224Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-09-30T14:50:18.278226Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-09-30T14:50:18.278230Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-09-30T14:50:18.278762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 25 PartNo 0 PackedSize 2253230 count 1 nextOffset 26 batches 5
2025-09-30T14:50:18.278794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-09-30T14:50:18.278804Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-09-30T14:50:18.278814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-09-30T14:50:18.278823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-09-30T14:50:18.278832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-09-30T14:50:18.279200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.279443Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 25 PartNo 0 PackedSize 4506428 count 2 nextOffset 27 batches 9
2025-09-30T14:50:18.279463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.279567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.279587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 25,2 HeadOffset 25 endOffset 25 curOffset 27 d0000000000_00000000000000000025_00000_0000000002_00008? size 4506418 WTime 1759243818279
2025-09-30T14:50:18.283381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:50:18.283443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 7 size 8295601 cause it's been evicted from L2. Actual L1 size: 5
2025-09-30T14:50:18.283455Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-09-30T14:50:18.283487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 45  requestId: <none> cookie: 23
2025-09-30T14:50:18.283525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 47  requestId: <none> cookie: 24
2025-09-30T14:50:18.283547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 49  requestId: <none> cookie: 25
2025-09-30T14:50:18.283638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.283675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.283682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.284053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 23 offsets: 22 already_written: false write_statistics { persist_duration_ms: 22 queued_in_partition_duration_ms: 16 }
2025-09-30T14:50:18.284070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 23
2025-09-30T14:50:18.284076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Estimated memory usage got back to normal 20275218[B]
2025-09-30T14:50:18.284211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 24 offsets: 23 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 13 }
2025-09-30T14:50:18.284232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 24
2025-09-30T14:50:18.284635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 33 to 33
2025-09-30T14:50:18.284955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.284972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 33
2025-09-30T14:50:18.285043Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.285651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.285675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.285772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 25 offsets: 24 already_written: false write_statistics { persist_duration_ms: 20 queued_in_partition_duration_ms: 7 }
2025-09-30T14:50:18.285782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 25
2025-09-30T14:50:18.285770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 0 messageNo: 55 size: 511959
2025-09-30T14:50:18.285836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 1 messageNo: 55 size: 511959
2025-09-30T14:50:18.285905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 2 messageNo: 55 size: 511959
2025-09-30T14:50:18.285969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 3 messageNo: 55 size: 511959
2025-09-30T14:50:18.286026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 4 messageNo: 55 size: 205040
2025-09-30T14:50:18.286035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 4 messageNo: 55 size 205040 offset: -1
2025-09-30T14:50:18.286181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.286192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.286204Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.286224Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 25 partNo 0 count 2 size 4506418
2025-09-30T14:50:18.286251Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.286277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.286337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 56  requestId: <none> cookie: 29
2025-09-30T14:50:18.286534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.288384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 34 to 34
2025-09-30T14:50:18.288712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.288817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.288833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 34
2025-09-30T14:50:18.289128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.289605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.289630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.289728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 0 messageNo: 57 size: 511959
2025-09-30T14:50:18.289803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 1 messageNo: 57 size: 511959
2025-09-30T14:50:18.289813Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (9-9)
2025-09-30T14:50:18.289838Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-09-30T14:50:18.289849Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In ContinueReadingDataImpl, ReadSizeBudget = 4505936, ReadSizeServerDelta = -3981648
2025-09-30T14:50:18.289883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 2 messageNo: 57 size: 511959
2025-09-30T14:50:18.289956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 3 messageNo: 57 size: 511959
2025-09-30T14:50:18.289991Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-09-30T14:50:18.290007Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:50:18.289998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 4 messageNo: 57 size: 205040
2025-09-30T14:50:18.290008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 4 messageNo: 57 size 205040 offset: -1
2025-09-30T14:50:18.290043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.290054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.290104Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.290135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.290156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 58  requestId: <none> cookie: 30
2025-09-30T14:50:18.290145Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 grpc read done: success# 1, data# { read_request { bytes_size: 4505936 } }
2025-09-30T14:50:18.290240Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 got read request: guid# 2384b67b-6485e0fd-6978d78d-7c66cf97
2025-09-30T14:50:18.290257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.290268Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 performing read request: guid# 17475ca6-63f2b4a-9dd3e56b-55748e1b, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 12, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:50:18.290289Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 12 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 10 EndOffset 20 ClientCommitOffset 0 committedOffset 0 Guid 17475ca6-63f2b4a-9dd3e56b-55748e1b
2025-09-30T14:50:18.290489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.290504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.290561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 14 Topic 'rt3.dc1--test-topic' partition 0 user user offset 10 count 12 size 524288 endOffset 25 max time lag 0ms effective offset 10
2025-09-30T14:50:18.290605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 14 added 2 blobs, size 7988760 count 4 last offset 10, current partition end offset: 25
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 9 ProducerId: "src_id" SeqNo: 10 CreateTime: 2025-09-30T14:50:18.092000Z WriteTime: 2025-09-30T14:50:18.134000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:54586", "_ip": "ipv6:[::1]:54586", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-09-30T14:50:18.291028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 14. Send blob request.
2025-09-30T14:50:18.291057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 7 partno 1 count 3 parts_count 15 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.291065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 4 count 4 parts_count 14 source 1 size 7988760 accessed 0 times before, last time 2025-09-30T14:50:18.000000Z
2025-09-30T14:50:18.291082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 14. Have to read 1 of 2 from KV
2025-09-30T14:50:18.291117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0'
2025-09-30T14:50:18.291129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 7 partno 1 count 3 parts_count 15
2025-09-30T14:50:18.292289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.292659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.293072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.293089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.293195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 0 messageNo: 59 size: 511959
2025-09-30T14:50:18.293268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 1 messageNo: 59 size: 511959
2025-09-30T14:50:18.293343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 2 messageNo: 59 size: 511959
2025-09-30T14:50:18.293406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 3 messageNo: 59 size: 511959
2025-09-30T14:50:18.293447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 4 messageNo: 59 size: 205040
2025-09-30T14:50:18.293458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 4 messageNo: 59 size 205040 offset: -1
2025-09-30T14:50:18.293487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.293495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.293651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.293509Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.293533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.293546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 60  requestId: <none> cookie: 31
2025-09-30T14:50:18.294386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 35 to 35
2025-09-30T14:50:18.294740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.294775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 35
2025-09-30T14:50:18.294784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-09-30T14:50:18.294839Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.295580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.295943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.296189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.296214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.296304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 0 messageNo: 61 size: 511959
2025-09-30T14:50:18.296383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 1 messageNo: 61 size: 511959
2025-09-30T14:50:18.296462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 2 messageNo: 61 size: 511959
2025-09-30T14:50:18.296534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 3 messageNo: 61 size: 511959
2025-09-30T14:50:18.296585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 4 messageNo: 61 size: 205040
2025-09-30T14:50:18.296597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 4 messageNo: 61 size 205040 offset: -1
2025-09-30T14:50:18.296624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.296631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.296643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.296668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.296685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 62  requestId: <none> cookie: 32
2025-09-30T14:50:18.296789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.298558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.298889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.299290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.299308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.299390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 0 messageNo: 63 size: 511959
2025-09-30T14:50:18.299451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 1 messageNo: 63 size: 511959
2025-09-30T14:50:18.299874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 2 messageNo: 63 size: 511959
2025-09-30T14:50:18.300302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 3 messageNo: 63 size: 511959
2025-09-30T14:50:18.300349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 4 messageNo: 63 size: 205040
2025-09-30T14:50:18.300357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 4 messageNo: 63 size 205040 offset: -1
2025-09-30T14:50:18.300389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.300399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.300422Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.300446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.300465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 64  requestId: <none> cookie: 33
2025-09-30T14:50:18.300561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.302298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.302664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.302966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.302983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.303064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 0 messageNo: 65 size: 511959
2025-09-30T14:50:18.303499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 1 messageNo: 65 size: 511959
2025-09-30T14:50:18.303576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 2 messageNo: 65 size: 511959
2025-09-30T14:50:18.303636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 3 messageNo: 65 size: 511959
2025-09-30T14:50:18.303677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 4 messageNo: 65 size: 205040
2025-09-30T14:50:18.303689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 4 messageNo: 65 size 205040 offset: -1
2025-09-30T14:50:18.303722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.303729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.303741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.303766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.303785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 66  requestId: <none> cookie: 34
2025-09-30T14:50:18.303889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.305428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.305759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.306163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.306179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.306254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 0 messageNo: 67 size: 511959
2025-09-30T14:50:18.306311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 1 messageNo: 67 size: 511959
2025-09-30T14:50:18.306374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 2 messageNo: 67 size: 511959
2025-09-30T14:50:18.306434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 3 messageNo: 67 size: 511959
2025-09-30T14:50:18.306479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 4 messageNo: 67 size: 205040
2025-09-30T14:50:18.306487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 4 messageNo: 67 size 205040 offset: -1
2025-09-30T14:50:18.306513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.306520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.306531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.306553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.306569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 68  requestId: <none> cookie: 35
2025-09-30T14:50:18.306672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.308907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.308924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.308993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 0 messageNo: 69 size: 511959
2025-09-30T14:50:18.309056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 1 messageNo: 69 size: 511959
2025-09-30T14:50:18.309479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 2 messageNo: 69 size: 511959
2025-09-30T14:50:18.309925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 3 messageNo: 69 size: 511959
2025-09-30T14:50:18.309978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 4 messageNo: 69 size: 205040
2025-09-30T14:50:18.309990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 4 messageNo: 69 size 205040 offset: -1
2025-09-30T14:50:18.310039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.310064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.314006Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 2 from KV. Status 1
2025-09-30T14:50:18.314019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:18.314031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 7 count 3 size 8295601 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.314083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 3 parts 10 suffix '124' size 5735558
2025-09-30T14:50:18.314096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 17 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-09-30T14:50:18.314100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295601
2025-09-30T14:50:18.314172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 4 size 7988778 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.314180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 18 count 3 size 8295638 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.314184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 21 count 1 size 717135 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.314205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 2 blobs
2025-09-30T14:50:18.314216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:18.314228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-09-30T14:50:18.314242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-09-30T14:50:18.314249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 15 suffix '0' size 8295638
2025-09-30T14:50:18.314253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 1 parts 1 suffix '124' size 717135
2025-09-30T14:50:18.318102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 10 totakecount 3 count 0 size 2047975 from pos 0 cbcount 4
2025-09-30T14:50:18.318419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 10 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-09-30T14:50:18.318600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 11 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.318780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 11 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.318940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 11 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.319177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 11 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-09-30T14:50:18.319427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 12 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.319581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 12 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.319727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 12 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.319805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 12 totakecount 4 count 1 size 205086 from pos 0 cbcount 1
2025-09-30T14:50:18.319940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 13 totakecount 4 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:18.320093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 13 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.320239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 13 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.320396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 13 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.320505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 13 totakecount 4 count 1 size 205086 from pos 0 cbcount 1
2025-09-30T14:50:18.321022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 14 totakecount 4 count 0 size 1024014 from pos 0 cbcount 2
2025-09-30T14:50:18.321113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 17 size 6759616 cause it's been evicted from L2. Actual L1 size: 8
2025-09-30T14:50:18.321120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 14 size 5735558 cause it's been evicted from L2. Actual L1 size: 7
2025-09-30T14:50:18.321125Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-09-30T14:50:18.321142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.321150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:471: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-09-30T14:50:18.321310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.321322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000022_00000_0000000003_00012?
2025-09-30T14:50:18.321329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 6759616 bytes (6759616)
2025-09-30T14:50:18.321333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 6759616 (8388608)
2025-09-30T14:50:18.321345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 22 size 6759616 cause it's been evicted from L2. Actual L1 size: 6
2025-09-30T14:50:18.321348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 20 size 4506418 cause it's been evicted from L2. Actual L1 size: 5
2025-09-30T14:50:18.321351Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-09-30T14:50:18.321442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 10
2025-09-30T14:50:18.321477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 25 count 2 size 4506418 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.321544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988760
2025-09-30T14:50:18.321556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 25 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:18.339735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.339809Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:18.339818Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.339831Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 0, Offset: 25 is stored on disk
2025-09-30T14:50:18.339837Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.339843Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 1, Offset: 25 is stored on disk
2025-09-30T14:50:18.339856Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.339862Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 2, Offset: 25 is stored on disk
2025-09-30T14:50:18.339865Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.339870Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 3, Offset: 25 is stored on disk
2025-09-30T14:50:18.339877Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.339882Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 4, Offset: 25 is stored on disk
2025-09-30T14:50:18.339884Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.339889Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 0, Offset: 26 is stored on disk
2025-09-30T14:50:18.339891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.339896Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 1, Offset: 26 is stored on disk
2025-09-30T14:50:18.339898Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.339903Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 2, Offset: 26 is stored on disk
2025-09-30T14:50:18.339905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.339920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 3, Offset: 26 is stored on disk
2025-09-30T14:50:18.339923Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.339927Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 4, Offset: 26 is stored on disk
2025-09-30T14:50:18.339986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.340035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.340037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (40)
2025-09-30T14:50:18.340065Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-09-30T14:50:18.340078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 1
2025-09-30T14:50:18.340082Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 2
2025-09-30T14:50:18.340086Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 3
2025-09-30T14:50:18.340090Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 4
2025-09-30T14:50:18.343833Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 28 partNo 4 FormedBlobsCount 0 NewHead: Offset 27 PartNo 0 PackedSize 2253230 count 1 nextOffset 28 batches 5
2025-09-30T14:50:18.343881Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-09-30T14:50:18.343894Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 1
2025-09-30T14:50:18.343897Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 2
2025-09-30T14:50:18.343900Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 3
2025-09-30T14:50:18.343903Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 4
2025-09-30T14:50:18.347301Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 29 partNo 4 FormedBlobsCount 0 NewHead: Offset 27 PartNo 0 PackedSize 4506428 count 2 nextOffset 29 batches 9
2025-09-30T14:50:18.347345Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-09-30T14:50:18.347363Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 1
2025-09-30T14:50:18.347367Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 2
2025-09-30T14:50:18.347370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 3
2025-09-30T14:50:18.347375Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 4
2025-09-30T14:50:18.349509Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 30 partNo 4 FormedBlobsCount 0 NewHead: Offset 27 PartNo 0 PackedSize 6759626 count 3 nextOffset 30 batches 13
2025-09-30T14:50:18.349557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-09-30T14:50:18.349572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 1
2025-09-30T14:50:18.349583Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 2
2025-09-30T14:50:18.349587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 3
2025-09-30T14:50:18.355985Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 31 partNo 3 result is x0000000000_00000000000000000027_00000_0000000003_00015? size 8295638
2025-09-30T14:50:18.356025Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 4
2025-09-30T14:50:18.356046Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000027_00000_0000000003_00015? new key d0000000000_00000000000000000027_00000_0000000003_00015? size 8295638 WTime 1759243818355
2025-09-30T14:50:18.357799Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 31 partNo 4 FormedBlobsCount 1 NewHead: Offset 30 PartNo 3 PackedSize 717145 count 1 nextOffset 31 batches 2
2025-09-30T14:50:18.357845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-09-30T14:50:18.357858Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 1
2025-09-30T14:50:18.357862Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 2
2025-09-30T14:50:18.357866Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 3
2025-09-30T14:50:18.357870Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 4
2025-09-30T14:50:18.359083Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 25 Result { Offset: 10 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 11 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1759243818135 CreateTimestampMS: 1759243818099 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 11 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 12 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1759243818156 CreateTimestampMS: 1759243818102 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 12 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 13 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1759243818156 CreateTimestampMS: 1759243818110 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 13 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 14 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1759243818173 CreateTimestampMS: 1759243818116 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 1 BlobsFromCache: 1 SizeLag: 7989196 RealReadOffset: 13 WaitQuotaTimeMs: 0 EndOffset: 25 StartOffset: 0 } Cookie: 10 }
2025-09-30T14:50:18.360470Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 32 partNo 4 FormedBlobsCount 0 NewHead: Offset 30 PartNo 3 PackedSize 2970343 count 2 nextOffset 32 batches 6
2025-09-30T14:50:18.360507Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
2025-09-30T14:50:18.360517Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 1
2025-09-30T14:50:18.360525Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 2
2025-09-30T14:50:18.360529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 3
2025-09-30T14:50:18.360533Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 4
2025-09-30T14:50:18.361938Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 33 partNo 4 FormedBlobsCount 0 NewHead: Offset 30 PartNo 3 PackedSize 5223541 count 3 nextOffset 33 batches 10
2025-09-30T14:50:18.361970Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 0
2025-09-30T14:50:18.361979Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 1
2025-09-30T14:50:18.361986Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 2
2025-09-30T14:50:18.361990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 3
2025-09-30T14:50:18.361993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 4
2025-09-30T14:50:18.364033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 34 partNo 4 FormedBlobsCount 0 NewHead: Offset 30 PartNo 3 PackedSize 7476739 count 4 nextOffset 34 batches 14
2025-09-30T14:50:18.364067Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 0
2025-09-30T14:50:18.364074Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 1
2025-09-30T14:50:18.368402Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 14 endOffset 25
2025-09-30T14:50:18.368444Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 25 ReadOffset 14 ReadGuid 17475ca6-63f2b4a-9dd3e56b-55748e1b has messages 1
2025-09-30T14:50:18.368485Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 14, endOffset# 25, WTime# 1759243818173, sizeLag# 7989196
2025-09-30T14:50:18.368500Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1TEvPartitionReady. Aval parts: 0
2025-09-30T14:50:18.368538Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 read done: guid# 17475ca6-63f2b4a-9dd3e56b-55748e1b, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 9011741
2025-09-30T14:50:18.368556Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 response to read: guid# 17475ca6-63f2b4a-9dd3e56b-55748e1b
2025-09-30T14:50:18.373524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.373584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.371514Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 35 partNo 1 result is x0000000000_00000000000000000030_00003_0000000004_00014? size 7988760
2025-09-30T14:50:18.371551Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 2
2025-09-30T14:50:18.371563Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 3
2025-09-30T14:50:18.371568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 4
2025-09-30T14:50:18.371581Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000030_00003_0000000004_00014? new key d0000000000_00000000000000000030_00003_0000000004_00014? size 7988760 WTime 1759243818371
2025-09-30T14:50:18.372488Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 35 partNo 4 FormedBlobsCount 1 NewHead: Offset 34 PartNo 1 PackedSize 1741199 count 1 nextOffset 35 batches 4
2025-09-30T14:50:18.372509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.372628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 34,1 HeadOffset 27 endOffset 27 curOffset 35 d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189 WTime 1759243818372
2025-09-30T14:50:18.373188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000022_00000_0000000003_00012?
2025-09-30T14:50:18.373193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000002_00008?
2025-09-30T14:50:18.373197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 11266034 bytes (11266034)
2025-09-30T14:50:18.373200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-09-30T14:50:18.373258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 10 size 7988760 cause it's been evicted from L2. Actual L1 size: 5
2025-09-30T14:50:18.373272Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-09-30T14:50:18.373299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.373337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 51  requestId: <none> cookie: 26
2025-09-30T14:50:18.373383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 53  requestId: <none> cookie: 27
2025-09-30T14:50:18.373390Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.373403Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 27 partNo 0 count 3 size 8295638
2025-09-30T14:50:18.373410Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 30 partNo 3 count 4 size 7988760
2025-09-30T14:50:18.373418Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 34 partNo 1 count 1 size 1741189
2025-09-30T14:50:18.373423Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000017_00000_0000000003_00012?(+) to d0000000000_00000000000000000017_00000_0000000003_00012?(+)
2025-09-30T14:50:18.373425Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000020_00000_0000000002_00008?(+) to d0000000000_00000000000000000020_00000_0000000002_00008?(+)
2025-09-30T14:50:18.373426Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000014_00002_0000000003_00010|(+) to d0000000000_00000000000000000014_00002_0000000003_00010|(+)
2025-09-30T14:50:18.373435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-09-30T14:50:18.373438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000022_00000_0000000003_00012?
2025-09-30T14:50:18.373447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000025_00000_0000000002_00008?
2025-09-30T14:50:18.373460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-09-30T14:50:18.373545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 22 partno 0 count 3 parts_count 12 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.373552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 25 partno 0 count 2 parts_count 8 source 1 size 4506418 accessed 0 times before, last time 2025-09-30T14:50:18.000000Z
2025-09-30T14:50:18.373566Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 1 of 2 from KV
2025-09-30T14:50:18.373591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 25 partno 0 count 2 parts 8 suffix '63'
2025-09-30T14:50:18.373601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 22 partno 0 count 3 parts_count 12
2025-09-30T14:50:18.374049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 26 offsets: 25 already_written: false write_statistics { persist_duration_ms: 61 queued_in_partition_duration_ms: 17 }
2025-09-30T14:50:18.374061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 26
2025-09-30T14:50:18.374068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Estimated memory usage got back to normal 20275218[B]
2025-09-30T14:50:18.374151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 27 offsets: 26 already_written: false write_statistics { persist_duration_ms: 60 queued_in_partition_duration_ms: 2 }
2025-09-30T14:50:18.374156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 27
2025-09-30T14:50:18.376729Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 Process answer. Aval parts: 1
2025-09-30T14:50:18.378919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 36 to 36
2025-09-30T14:50:18.379237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.379449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 36
2025-09-30T14:50:18.380391Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.384134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 37 to 37
2025-09-30T14:50:18.384472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.384489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 37
2025-09-30T14:50:18.385663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-09-30T14:50:18.385718Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.387150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.387640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.389181Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got ReadResponse, serverBytesSize = 9011741, now ReadSizeBudget = 0, ReadSizeServerDelta = -8487453
2025-09-30T14:50:18.389302Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (10-10)
2025-09-30T14:50:18.389329Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Returning serverBytesSize = 9011741 to budget
2025-09-30T14:50:18.389434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.389459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.389503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 70  requestId: <none> cookie: 36
2025-09-30T14:50:18.390072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.392445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.398319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.398330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.398357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.398466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 0 messageNo: 71 size: 511959
2025-09-30T14:50:18.398516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 1 messageNo: 71 size: 511959
2025-09-30T14:50:18.398571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 2 messageNo: 71 size: 511959
2025-09-30T14:50:18.398624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 3 messageNo: 71 size: 511959
2025-09-30T14:50:18.398669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 4 messageNo: 71 size: 205040
2025-09-30T14:50:18.398675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 4 messageNo: 71 size 205040 offset: -1
2025-09-30T14:50:18.398706Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 2 from KV. Status 1
2025-09-30T14:50:18.398708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:18.398715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 22 count 3 size 6759616 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.398780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295601
2025-09-30T14:50:18.398787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-09-30T14:50:18.398796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.398801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.398814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.398840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.398844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:18.398850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000022_00000_0000000003_00012?
2025-09-30T14:50:18.398852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:18.399060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-09-30T14:50:18.399225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-09-30T14:50:18.399579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-09-30T14:50:18.399952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-09-30T14:50:18.400215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-09-30T14:50:18.400615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 2253230 count 1 nextOffset 23 batches 5
2025-09-30T14:50:18.400626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-09-30T14:50:18.400762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-09-30T14:50:18.400907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-09-30T14:50:18.401148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-09-30T14:50:18.401326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-09-30T14:50:18.402308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 4506428 count 2 nextOffset 24 batches 9
2025-09-30T14:50:18.402315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-09-30T14:50:18.402436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-09-30T14:50:18.402559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-09-30T14:50:18.402683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-09-30T14:50:18.402735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-09-30T14:50:18.403420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 25 partNo 4 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 6759626 count 3 nextOffset 25 batches 13
2025-09-30T14:50:18.403436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000025_00000_0000000002_00008?
2025-09-30T14:50:18.403437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:18.403732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-09-30T14:50:18.404050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-09-30T14:50:18.406332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 26 partNo 1 result is x0000000000_00000000000000000021_00003_0000000004_00014 size 7988782
2025-09-30T14:50:18.406625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-09-30T14:50:18.406944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-09-30T14:50:18.407381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-09-30T14:50:18.407408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000021_00003_0000000004_00014 new key d0000000000_00000000000000000021_00003_0000000004_00014 size 7988782 WTime 1759243818407
2025-09-30T14:50:18.408655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 26 partNo 4 FormedBlobsCount 1 NewHead: Offset 25 PartNo 1 PackedSize 1741199 count 1 nextOffset 26 batches 4
2025-09-30T14:50:18.408677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-09-30T14:50:18.408983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-09-30T14:50:18.409309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-09-30T14:50:18.409620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-09-30T14:50:18.409784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-09-30T14:50:18.410375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 25 PartNo 1 PackedSize 3994397 count 2 nextOffset 27 batches 8
2025-09-30T14:50:18.410482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:550: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 25,2 HeadOffset 21 endOffset 22 curOffset 27 d0000000000_00000000000000000025_00001_0000000002_00007| size 3994387 WTime 1759243818410
2025-09-30T14:50:18.411780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 7 size 8295601 cause it's been evicted from L2. Actual L1 size: 5
2025-09-30T14:50:18.411794Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-09-30T14:50:18.411817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:194: [72075186224037892][Partition][0][StateIdle] Reserve processing: maxWriteInflightSize riched. Partition: 0
2025-09-30T14:50:18.411855Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.411869Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 21 partNo 3 count 4 size 7988782
2025-09-30T14:50:18.411875Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 25 partNo 1 count 2 size 3994387
2025-09-30T14:50:18.415042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 27 count 3 size 8295638 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.415047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 30 count 4 size 7988760 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.415051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.415071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.415085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-09-30T14:50:18.415091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-09-30T14:50:18.415094Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 18023288 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:18.415095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 15 suffix '0' size 8295638
2025-09-30T14:50:18.415097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 4 parts 14 suffix '63' size 7988760
2025-09-30T14:50:18.415100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:18.415103Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415114Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 0, Offset: 27 is stored on disk
2025-09-30T14:50:18.415122Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415127Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 1, Offset: 27 is stored on disk
2025-09-30T14:50:18.415129Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415134Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 2, Offset: 27 is stored on disk
2025-09-30T14:50:18.415135Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 3, Offset: 27 is stored on disk
2025-09-30T14:50:18.415147Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415153Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 4, Offset: 27 is stored on disk
2025-09-30T14:50:18.415156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 0, Offset: 28 is stored on disk
2025-09-30T14:50:18.415164Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 1, Offset: 28 is stored on disk
2025-09-30T14:50:18.415173Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415178Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 2, Offset: 28 is stored on disk
2025-09-30T14:50:18.415179Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415184Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 3, Offset: 28 is stored on disk
2025-09-30T14:50:18.415186Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415190Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 4, Offset: 28 is stored on disk
2025-09-30T14:50:18.415192Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415197Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 0, Offset: 29 is stored on disk
2025-09-30T14:50:18.415199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415202Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 1, Offset: 29 is stored on disk
2025-09-30T14:50:18.415204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 2, Offset: 29 is stored on disk
2025-09-30T14:50:18.415210Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415234Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 3, Offset: 29 is stored on disk
2025-09-30T14:50:18.415237Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415240Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 4, Offset: 29 is stored on disk
2025-09-30T14:50:18.415265Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 0, Offset: 30 is stored on disk
2025-09-30T14:50:18.415274Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415283Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 1, Offset: 30 is stored on disk
2025-09-30T14:50:18.415285Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415290Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 2, Offset: 30 is stored on disk
2025-09-30T14:50:18.415291Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415295Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 3, Offset: 30 is stored on disk
2025-09-30T14:50:18.415297Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415300Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 4, Offset: 30 is stored on disk
2025-09-30T14:50:18.415302Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415305Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 0, Offset: 31 is stored on disk
2025-09-30T14:50:18.415307Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415311Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 1, Offset: 31 is stored on disk
2025-09-30T14:50:18.415312Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 2, Offset: 31 is stored on disk
2025-09-30T14:50:18.415318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415322Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 3, Offset: 31 is stored on disk
2025-09-30T14:50:18.415324Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415328Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 4, Offset: 31 is stored on disk
2025-09-30T14:50:18.415331Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415336Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 0, Offset: 32 is stored on disk
2025-09-30T14:50:18.415337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415342Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 1, Offset: 32 is stored on disk
2025-09-30T14:50:18.415344Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415349Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 2, Offset: 32 is stored on disk
2025-09-30T14:50:18.415351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415356Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 3, Offset: 32 is stored on disk
2025-09-30T14:50:18.415358Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415363Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 4, Offset: 32 is stored on disk
2025-09-30T14:50:18.415365Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415369Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 0, Offset: 33 is stored on disk
2025-09-30T14:50:18.415372Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 1, Offset: 33 is stored on disk
2025-09-30T14:50:18.415379Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 2, Offset: 33 is stored on disk
2025-09-30T14:50:18.415385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415390Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 3, Offset: 33 is stored on disk
2025-09-30T14:50:18.415392Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415396Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 4, Offset: 33 is stored on disk
2025-09-30T14:50:18.415398Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415403Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 0, Offset: 34 is stored on disk
2025-09-30T14:50:18.415404Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415409Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 1, Offset: 34 is stored on disk
2025-09-30T14:50:18.415411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415415Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 2, Offset: 34 is stored on disk
2025-09-30T14:50:18.415417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415420Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 3, Offset: 34 is stored on disk
2025-09-30T14:50:18.415423Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.415425Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 4, Offset: 34 is stored on disk
2025-09-30T14:50:18.415469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.415480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.415483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-09-30T14:50:18.415504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 0
2025-09-30T14:50:18.415519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 1
2025-09-30T14:50:18.415522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 2
2025-09-30T14:50:18.415525Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 3
2025-09-30T14:50:18.415528Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 4
2025-09-30T14:50:18.416013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 36 partNo 4 FormedBlobsCount 0 NewHead: Offset 35 PartNo 0 PackedSize 2253230 count 1 nextOffset 36 batches 5
2025-09-30T14:50:18.416045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.416171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 35,1 HeadOffset 35 endOffset 35 curOffset 36 d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220 WTime 1759243818415
2025-09-30T14:50:18.417268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:50:18.417308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 18 size 8295638 cause it's been evicted from L2. Actual L1 size: 7
2025-09-30T14:50:18.417317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 14 size 7988778 cause it's been evicted from L2. Actual L1 size: 6
2025-09-30T14:50:18.417320Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-09-30T14:50:18.417363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 55  requestId: <none> cookie: 28
2025-09-30T14:50:18.417402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 57  requestId: <none> cookie: 29
2025-09-30T14:50:18.417427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 59  requestId: <none> cookie: 30
2025-09-30T14:50:18.417449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 61  requestId: <none> cookie: 31
2025-09-30T14:50:18.417477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 63  requestId: <none> cookie: 32
2025-09-30T14:50:18.417492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 65  requestId: <none> cookie: 33
2025-09-30T14:50:18.417510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 67  requestId: <none> cookie: 34
2025-09-30T14:50:18.417526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 69  requestId: <none> cookie: 35
2025-09-30T14:50:18.417534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 72  requestId: <none> cookie: 37
2025-09-30T14:50:18.417665Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.417684Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 35 partNo 0 count 1 size 2253220
2025-09-30T14:50:18.417746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.417799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.417808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.417813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.417820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.417829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.417835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.417840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.417847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.419530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 28 offsets: 27 already_written: false write_statistics { persist_duration_ms: 74 queued_in_partition_duration_ms: 53 }
2025-09-30T14:50:18.419547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 28
2025-09-30T14:50:18.419554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Estimated memory usage got back to normal 20275218[B]
2025-09-30T14:50:18.419672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 29 offsets: 28 already_written: false write_statistics { persist_duration_ms: 71 queued_in_partition_duration_ms: 53 }
2025-09-30T14:50:18.419685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 29
2025-09-30T14:50:18.420006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 38 to 38
2025-09-30T14:50:18.424192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.424223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.424338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.424322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 73 size: 511959
2025-09-30T14:50:18.424359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 38
2025-09-30T14:50:18.424414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 73 size: 511959
2025-09-30T14:50:18.424492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 73 size: 511959
2025-09-30T14:50:18.424560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 73 size: 511959
2025-09-30T14:50:18.424621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 73 size: 205040
2025-09-30T14:50:18.424631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 73 size 205040 offset: -1
2025-09-30T14:50:18.424670Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.424704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.425966Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (10-10)
2025-09-30T14:50:18.425991Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-09-30T14:50:18.426083Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (11-11)
2025-09-30T14:50:18.426112Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:50:18.426291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.426609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.426935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.426955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.426993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 74  requestId: <none> cookie: 38
2025-09-30T14:50:18.427145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.427976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 30 offsets: 29 already_written: false write_statistics { persist_duration_ms: 67 queued_in_partition_duration_ms: 53 }
2025-09-30T14:50:18.427994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 30
2025-09-30T14:50:18.428112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 31 offsets: 30 already_written: false write_statistics { persist_duration_ms: 65 queued_in_partition_duration_ms: 52 }
2025-09-30T14:50:18.428117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 31
2025-09-30T14:50:18.428152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 32 offsets: 31 already_written: false write_statistics { persist_duration_ms: 57 queued_in_partition_duration_ms: 57 }
2025-09-30T14:50:18.428156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 32
2025-09-30T14:50:18.428182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 33 offsets: 32 already_written: false write_statistics { persist_duration_ms: 54 queued_in_partition_duration_ms: 56 }
2025-09-30T14:50:18.428186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 33
2025-09-30T14:50:18.428208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 34 offsets: 33 already_written: false write_statistics { persist_duration_ms: 53 queued_in_partition_duration_ms: 55 }
2025-09-30T14:50:18.428211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 34
2025-09-30T14:50:18.428232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 35 offsets: 34 already_written: false write_statistics { persist_duration_ms: 50 queued_in_partition_duration_ms: 54 }
2025-09-30T14:50:18.428235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 35
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 10 ProducerId: "src_id" SeqNo: 11 CreateTime: 2025-09-30T14:50:18.099000Z WriteTime: 2025-09-30T14:50:18.135000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:54586", "logtype": "unknown", "server": "ipv6:[::1]:54586", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-09-30T14:50:18.434548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 39 to 39
2025-09-30T14:50:18.434853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.434865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 39
2025-09-30T14:50:18.435264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.435292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.435386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 75 size: 511959
2025-09-30T14:50:18.435446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 75 size: 511959
2025-09-30T14:50:18.435504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 75 size: 511959
2025-09-30T14:50:18.435565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 75 size: 511959
2025-09-30T14:50:18.435602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 75 size: 205040
2025-09-30T14:50:18.435608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 75 size 205040 offset: -1
2025-09-30T14:50:18.435832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.435858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.436273Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.437211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.437680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.438606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 40 to 40
2025-09-30T14:50:18.438902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.438912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 40
2025-09-30T14:50:18.440480Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (11-11)
2025-09-30T14:50:18.440498Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-09-30T14:50:18.440551Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (12-12)
2025-09-30T14:50:18.440569Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 11 ProducerId: "src_id" SeqNo: 12 CreateTime: 2025-09-30T14:50:18.102000Z WriteTime: 2025-09-30T14:50:18.156000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:54586", "logtype": "unknown", "server": "ipv6:[::1]:54586" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-09-30T14:50:18.437496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 21 count 4 size 7988782 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.437509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 25 count 2 size 3994387 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.437523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.437532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.437538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:471: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-09-30T14:50:18.437848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 1 parts 1 suffix '124' size 717135
2025-09-30T14:50:18.437856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 25 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:18.437862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 4 parts 14 suffix '0' size 7988782
2025-09-30T14:50:18.437867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-09-30T14:50:18.437871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 25 partno 1 count 2 parts 7 suffix '124' size 3994387
2025-09-30T14:50:18.437889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:18.438200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.438207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000027_00000_0000000003_00015?
2025-09-30T14:50:18.438210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000004_00014?
2025-09-30T14:50:18.438214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 16284398 bytes (16284398)
2025-09-30T14:50:18.438217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-09-30T14:50:18.438227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.438252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252911 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:18.438260Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.438276Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 0, Offset: 35 is stored on disk
2025-09-30T14:50:18.438282Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.438288Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 1, Offset: 35 is stored on disk
2025-09-30T14:50:18.438290Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.438295Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 2, Offset: 35 is stored on disk
2025-09-30T14:50:18.438297Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.438301Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 3, Offset: 35 is stored on disk
2025-09-30T14:50:18.438308Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.438313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 4, Offset: 35 is stored on disk
2025-09-30T14:50:18.438341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.438356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.438358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-09-30T14:50:18.438384Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 0
2025-09-30T14:50:18.438399Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 1
2025-09-30T14:50:18.438404Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 2
2025-09-30T14:50:18.438408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 3
2025-09-30T14:50:18.438411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 4
2025-09-30T14:50:18.438921Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 37 partNo 4 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 2253230 count 1 nextOffset 37 batches 5
2025-09-30T14:50:18.438939Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 0
2025-09-30T14:50:18.438948Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 1
2025-09-30T14:50:18.438952Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 2
2025-09-30T14:50:18.438957Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 3
2025-09-30T14:50:18.438962Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 4
2025-09-30T14:50:18.439553Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 38 partNo 4 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 4506428 count 2 nextOffset 38 batches 9
2025-09-30T14:50:18.439568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.439871Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 36,2 HeadOffset 36 endOffset 36 curOffset 38 d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418 WTime 1759243818439
2025-09-30T14:50:18.446234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 41 to 41
2025-09-30T14:50:18.449642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:50:18.449729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 25 size 4506418 cause it's been evicted from L2. Actual L1 size: 8
2025-09-30T14:50:18.449744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 22 size 6759616 cause it's been evicted from L2. Actual L1 size: 7
2025-09-30T14:50:18.449750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 21 size 717135 cause it's been evicted from L2. Actual L1 size: 6
2025-09-30T14:50:18.449756Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-09-30T14:50:18.449824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.449848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.449875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-09-30T14:50:18.449881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000027_00000_0000000003_00015?
2025-09-30T14:50:18.449900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000004_00014?
2025-09-30T14:50:18.449918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-09-30T14:50:18.449970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 71  requestId: <none> cookie: 36
2025-09-30T14:50:18.450013Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.450040Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 36 partNo 0 count 2 size 4506418
2025-09-30T14:50:18.450053Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000022_00000_0000000003_00012?(+) to d0000000000_00000000000000000022_00000_0000000003_00012?(+)
2025-09-30T14:50:18.450056Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000025_00000_0000000002_00008?(+) to d0000000000_00000000000000000025_00000_0000000002_00008?(+)
2025-09-30T14:50:18.450059Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000021_00003_0000000001_00001|(+) to d0000000000_00000000000000000021_00003_0000000001_00001|(+)
2025-09-30T14:50:18.450092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 27 partno 0 count 3 parts_count 15 source 1 size 8295638 accessed 0 times before, last time 2025-09-30T14:50:18.000000Z
2025-09-30T14:50:18.450280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.450097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 30 partno 3 count 4 parts_count 14 source 1 size 7988760 accessed 0 times before, last time 2025-09-30T14:50:18.000000Z
2025-09-30T14:50:18.450122Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-09-30T14:50:18.450157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 3 parts 15 suffix '63'
2025-09-30T14:50:18.450174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 4 parts 14 suffix '63'
2025-09-30T14:50:18.450299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 41
2025-09-30T14:50:18.450234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 76  requestId: <none> cookie: 39
2025-09-30T14:50:18.450258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:18.450265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000027_00000_0000000003_00015?
2025-09-30T14:50:18.450268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:18.450645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-09-30T14:50:18.450972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 1
2025-09-30T14:50:18.451616Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.451649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 36 offsets: 35 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 16 }
2025-09-30T14:50:18.451665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 36
2025-09-30T14:50:18.450183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.450457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.452778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.453131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.451312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 2
2025-09-30T14:50:18.451532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 3
2025-09-30T14:50:18.452092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 4
2025-09-30T14:50:18.452542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 28 partNo 4 FormedBlobsCount 0 NewHead: Offset 27 PartNo 0 PackedSize 2253230 count 1 nextOffset 28 batches 5
2025-09-30T14:50:18.452555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-09-30T14:50:18.452704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 1
2025-09-30T14:50:18.452850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 2
2025-09-30T14:50:18.453003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 3
2025-09-30T14:50:18.453219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 4
2025-09-30T14:50:18.455727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 42 to 42
2025-09-30T14:50:18.455990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.456000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 42
2025-09-30T14:50:18.457291Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (12-12)
2025-09-30T14:50:18.457309Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-09-30T14:50:18.457993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 29 partNo 4 result is x0000000000_00000000000000000025_00001_0000000003_00015 size 8295604
2025-09-30T14:50:18.458019Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000025_00001_0000000003_00015 new key d0000000000_00000000000000000025_00001_0000000003_00015 size 8295604 WTime 1759243818457
2025-09-30T14:50:18.458046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 29 partNo 4 FormedBlobsCount 1 NewHead: Offset 28 PartNo 4 PackedSize 205118 count 1 nextOffset 29 batches 1
>>> Got event: 2025-09-30T14:50:18.458057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 12 ProducerId: "src_id" SeqNo: 13 CreateTime: 2025-09-30T14:50:18.110000Z WriteTime: 2025-09-30T14:50:18.156000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:54586", "logtype": "unknown", "server": "ipv6:[::1]:54586" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-09-30T14:50:18.458191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 1
2025-09-30T14:50:18.458336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 2
2025-09-30T14:50:18.458481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 3
2025-09-30T14:50:18.458553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 4
2025-09-30T14:50:18.459180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 30 partNo 4 FormedBlobsCount 0 NewHead: Offset 28 PartNo 4 PackedSize 2458316 count 2 nextOffset 30 batches 5
2025-09-30T14:50:18.459949Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (13-13)
2025-09-30T14:50:18.459966Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:50:18.460312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-09-30T14:50:18.460329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 1
2025-09-30T14:50:18.460332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 2
2025-09-30T14:50:18.460345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000004_00014?
2025-09-30T14:50:18.460348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:18.460487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 3
2025-09-30T14:50:18.460692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 4
2025-09-30T14:50:18.461256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 31 partNo 4 FormedBlobsCount 0 NewHead: Offset 28 PartNo 4 PackedSize 4711514 count 3 nextOffset 31 batches 9
2025-09-30T14:50:18.461278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-09-30T14:50:18.461430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 1
2025-09-30T14:50:18.461589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 2
2025-09-30T14:50:18.462397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 43 to 43
2025-09-30T14:50:18.462681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.462695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:18.462760Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.461737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 3
2025-09-30T14:50:18.462017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 4
2025-09-30T14:50:18.462613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 32 partNo 4 FormedBlobsCount 0 NewHead: Offset 28 PartNo 4 PackedSize 6964712 count 4 nextOffset 32 batches 13
2025-09-30T14:50:18.462623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
2025-09-30T14:50:18.462794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 1
2025-09-30T14:50:18.462939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 2
2025-09-30T14:50:18.469700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 44 to 44
2025-09-30T14:50:18.470013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.470030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 44
2025-09-30T14:50:18.470416Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (13-13)
2025-09-30T14:50:18.470435Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-09-30T14:50:18.470450Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In ContinueReadingDataImpl, ReadSizeBudget = 9011741, ReadSizeServerDelta = -8487453
2025-09-30T14:50:18.470634Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-09-30T14:50:18.470645Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:50:18.471028Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 grpc read done: success# 1, data# { read_request { bytes_size: 9011741 } }
2025-09-30T14:50:18.471133Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 got read request: guid# 2c6674e-4e75170b-f24cc28f-25f7d003
2025-09-30T14:50:18.471158Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 performing read request: guid# b285cf37-def1a891-968e2d6d-44aa5e15, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 13, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:50:18.471204Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 13 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 14 EndOffset 25 ClientCommitOffset 0 committedOffset 0 Guid b285cf37-def1a891-968e2d6d-44aa5e15
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 13 ProducerId: "src_id" SeqNo: 14 CreateTime: 2025-09-30T14:50:18.116000Z WriteTime: 2025-09-30T14:50:18.173000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:54586", "logtype": "unknown", "server": "ipv6:[::1]:54586" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-09-30T14:50:18.473384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 33 partNo 2 result is x0000000000_00000000000000000028_00004_0000000004_00014 size 7988738
2025-09-30T14:50:18.473554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 3
2025-09-30T14:50:18.474038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 4
2025-09-30T14:50:18.474055Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000028_00004_0000000004_00014 new key d0000000000_00000000000000000028_00004_0000000004_00014 size 7988738 WTime 1759243818473
2025-09-30T14:50:18.474292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 33 partNo 4 FormedBlobsCount 1 NewHead: Offset 32 PartNo 2 PackedSize 1229172 count 1 nextOffset 33 batches 3
2025-09-30T14:50:18.474302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 0
2025-09-30T14:50:18.474448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 1
2025-09-30T14:50:18.474597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 2
2025-09-30T14:50:18.474740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 3
2025-09-30T14:50:18.474837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 4
2025-09-30T14:50:18.475542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 34 partNo 4 FormedBlobsCount 0 NewHead: Offset 32 PartNo 2 PackedSize 3482370 count 2 nextOffset 34 batches 7
2025-09-30T14:50:18.475699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 0
2025-09-30T14:50:18.475810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:550: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 32,2 HeadOffset 25 endOffset 27 curOffset 34 d0000000000_00000000000000000032_00002_0000000002_00006| size 3482360 WTime 1759243818475
2025-09-30T14:50:18.477684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.477709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.477797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 77 size: 511959
2025-09-30T14:50:18.477860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 77 size: 511959
2025-09-30T14:50:18.477934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 77 size: 511959
2025-09-30T14:50:18.478025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 77 size: 511959
2025-09-30T14:50:18.478062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 77 size: 205040
2025-09-30T14:50:18.478070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 77 size 205040 offset: -1
2025-09-30T14:50:18.478105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.478114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.478139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.478145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.478156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 45 to 45
2025-09-30T14:50:18.478165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.478172Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.478195Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 25 partNo 1 count 3 size 8295604
2025-09-30T14:50:18.478206Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 28 partNo 4 count 4 size 7988738
2025-09-30T14:50:18.478213Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 32 partNo 2 count 2 size 3482360
2025-09-30T14:50:18.478227Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.478249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.478319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 78  requestId: <none> cookie: 40
2025-09-30T14:50:18.478377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 15 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 13 size 524288 endOffset 36 max time lag 0ms effective offset 14
2025-09-30T14:50:18.478407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 15 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 36
2025-09-30T14:50:18.478415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 15. Send blob request.
2025-09-30T14:50:18.478424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.478426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.478432Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 15. Have to read 2 of 2 from KV
2025-09-30T14:50:18.478501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.478513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 45
2025-09-30T14:50:18.478456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.478510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-09-30T14:50:18.478522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-09-30T14:50:18.478566Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.481800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 46 to 46
2025-09-30T14:50:18.481950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.481973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.482074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 79 size: 511959
2025-09-30T14:50:18.482121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.482135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 46
2025-09-30T14:50:18.482145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-09-30T14:50:18.482197Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: 2025-09-30T14:50:18.482186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 79 size: 511959
SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.482256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 79 size: 511959
2025-09-30T14:50:18.482327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 79 size: 511959
2025-09-30T14:50:18.482372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 79 size: 205040
2025-09-30T14:50:18.482382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 79 size 205040 offset: -1
2025-09-30T14:50:18.482409Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.482439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.484727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.485275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.485668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.485492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.485523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.485556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 80  requestId: <none> cookie: 41
2025-09-30T14:50:18.487903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.492742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.492245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.492275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.492425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 81 size: 511959
2025-09-30T14:50:18.492493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 81 size: 511959
2025-09-30T14:50:18.492564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 81 size: 511959
2025-09-30T14:50:18.492626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 81 size: 511959
2025-09-30T14:50:18.492667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 81 size: 205040
2025-09-30T14:50:18.492674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 81 size 205040 offset: -1
2025-09-30T14:50:18.492734Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.492761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.493109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.493123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.493148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 82  requestId: <none> cookie: 42
2025-09-30T14:50:18.493307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.495160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.495515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.496560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.496585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.496666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 83 size: 511959
2025-09-30T14:50:18.496785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 83 size: 511959
2025-09-30T14:50:18.496847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 83 size: 511959
2025-09-30T14:50:18.496910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 83 size: 511959
2025-09-30T14:50:18.497050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 83 size: 205040
2025-09-30T14:50:18.497059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 83 size 205040 offset: -1
2025-09-30T14:50:18.497103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.497113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.497204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.497238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.497250Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:194: [72075186224037892][Partition][0][StateIdle] Reserve processing: maxWriteInflightSize riched. Partition: 0
2025-09-30T14:50:18.497280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.497302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.497325Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:18.497337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.497347Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 0, Offset: 36 is stored on disk
2025-09-30T14:50:18.497356Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.497362Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 1, Offset: 36 is stored on disk
2025-09-30T14:50:18.497365Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.497370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 2, Offset: 36 is stored on disk
2025-09-30T14:50:18.497373Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.497377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 3, Offset: 36 is stored on disk
2025-09-30T14:50:18.497383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.497387Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 4, Offset: 36 is stored on disk
2025-09-30T14:50:18.497388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.497393Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 0, Offset: 37 is stored on disk
2025-09-30T14:50:18.497394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.497398Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 1, Offset: 37 is stored on disk
2025-09-30T14:50:18.497399Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.497403Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 2, Offset: 37 is stored on disk
2025-09-30T14:50:18.497405Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.497409Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 3, Offset: 37 is stored on disk
2025-09-30T14:50:18.497412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.497416Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 4, Offset: 37 is stored on disk
2025-09-30T14:50:18.497455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.497474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.497477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (20)
2025-09-30T14:50:18.497501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 0
2025-09-30T14:50:18.497518Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 1
2025-09-30T14:50:18.497526Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 2
2025-09-30T14:50:18.497529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 3
2025-09-30T14:50:18.497533Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 4
2025-09-30T14:50:18.497974Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 39 partNo 4 FormedBlobsCount 0 NewHead: Offset 38 PartNo 0 PackedSize 2253230 count 1 nextOffset 39 batches 5
2025-09-30T14:50:18.498007Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 0
2025-09-30T14:50:18.498026Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 1
2025-09-30T14:50:18.498035Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 2
2025-09-30T14:50:18.498038Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 3
2025-09-30T14:50:18.498042Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 4
2025-09-30T14:50:18.498595Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 40 partNo 4 FormedBlobsCount 0 NewHead: Offset 38 PartNo 0 PackedSize 4506428 count 2 nextOffset 40 batches 9
2025-09-30T14:50:18.498620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-09-30T14:50:18.498632Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 1
2025-09-30T14:50:18.498636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 2
2025-09-30T14:50:18.498639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 3
2025-09-30T14:50:18.498642Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 4
2025-09-30T14:50:18.499191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 4 FormedBlobsCount 0 NewHead: Offset 38 PartNo 0 PackedSize 6759626 count 3 nextOffset 41 batches 13
2025-09-30T14:50:18.499218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-09-30T14:50:18.499226Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 1
2025-09-30T14:50:18.499229Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 2
2025-09-30T14:50:18.499234Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 3
2025-09-30T14:50:18.503442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:18.503467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 4 parts 14 suffix '0' size 7988782
2025-09-30T14:50:18.503472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:18.504256Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 42 partNo 3 result is x0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
2025-09-30T14:50:18.504287Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 4
2025-09-30T14:50:18.504309Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000038_00000_0000000003_00015? new key d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638 WTime 1759243818503
2025-09-30T14:50:18.504478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 4 FormedBlobsCount 1 NewHead: Offset 41 PartNo 3 PackedSize 717145 count 1 nextOffset 42 batches 2
2025-09-30T14:50:18.504496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.504640Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 41,1 HeadOffset 38 endOffset 38 curOffset 42 d0000000000_00000000000000000041_00003_0000000001_00001? size 717135 WTime 1759243818504
2025-09-30T14:50:18.504990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.504763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:50:18.504832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 73  requestId: <none> cookie: 37
2025-09-30T14:50:18.504873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 75  requestId: <none> cookie: 38
2025-09-30T14:50:18.504886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 21 size 7988782 cause it's been evicted from L2. Actual L1 size: 6
2025-09-30T14:50:18.504891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 34 size 1741189 cause it's been evicted from L2. Actual L1 size: 5
2025-09-30T14:50:18.504896Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-09-30T14:50:18.504907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 84  requestId: <none> cookie: 43
2025-09-30T14:50:18.504913Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.504925Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 38 partNo 0 count 3 size 8295638
2025-09-30T14:50:18.504932Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 41 partNo 3 count 1 size 717135
2025-09-30T14:50:18.506980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 37 offsets: 36 already_written: false write_statistics { persist_duration_ms: 61 queued_in_partition_duration_ms: 10 }
2025-09-30T14:50:18.506996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 37
2025-09-30T14:50:18.507004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Estimated memory usage got back to normal 20275218[B]
2025-09-30T14:50:18.505055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.505067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.507362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.507510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 47 to 47
2025-09-30T14:50:18.507763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.508109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.508133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.508228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 85 size: 511959
2025-09-30T14:50:18.508299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 85 size: 511959
2025-09-30T14:50:18.508362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 85 size: 511959
2025-09-30T14:50:18.508427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 85 size: 511959
2025-09-30T14:50:18.508479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 85 size: 205040
2025-09-30T14:50:18.508499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 85 size 205040 offset: -1
2025-09-30T14:50:18.508533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.508541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.508552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.508579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.508600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 86  requestId: <none> cookie: 44
2025-09-30T14:50:18.508723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.508859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.508874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 47
2025-09-30T14:50:18.508882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-09-30T14:50:18.508940Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.509327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 38 offsets: 37 already_written: false write_statistics { persist_duration_ms: 61 }
2025-09-30T14:50:18.509340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 38
2025-09-30T14:50:18.509345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Estimated memory usage got back to normal 20275218[B]
2025-09-30T14:50:18.510640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.511012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.511529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.511549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.511636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 87 size: 511959
2025-09-30T14:50:18.511705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 87 size: 511959
2025-09-30T14:50:18.511775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 87 size: 511959
2025-09-30T14:50:18.511847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 87 size: 511959
2025-09-30T14:50:18.512000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 87 size: 205040
2025-09-30T14:50:18.512006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 87 size 205040 offset: -1
2025-09-30T14:50:18.512037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.512039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.512053Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.512081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.512096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 88  requestId: <none> cookie: 45
2025-09-30T14:50:18.512214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.513351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 48 to 48
2025-09-30T14:50:18.514255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.514649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.517543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.517570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 48
2025-09-30T14:50:18.517580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-09-30T14:50:18.517641Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.527057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.527087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.527202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 89 size: 511959
2025-09-30T14:50:18.527329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 89 size: 511959
2025-09-30T14:50:18.527403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 89 size: 511959
2025-09-30T14:50:18.527468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 89 size: 511959
2025-09-30T14:50:18.527509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 89 size: 205040
2025-09-30T14:50:18.527518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 89 size 205040 offset: -1
2025-09-30T14:50:18.527556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.527560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.527597Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-09-30T14:50:18.527600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:18.527603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:18.527612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7988760 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.527616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 4 size 7988778 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.527684Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.527682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 25 partno 1 count 2 parts 7 suffix '124' size 3994387
2025-09-30T14:50:18.527692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988760
2025-09-30T14:50:18.527698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:18.527703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-09-30T14:50:18.527706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-09-30T14:50:18.527711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.527856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 2 blobs
2025-09-30T14:50:18.530427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 14 totakecount 4 count 0 size 1024014 from pos 0 cbcount 2
2025-09-30T14:50:18.530626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 14 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.530785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 14 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.530992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 14 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-09-30T14:50:18.531126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 15 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.531600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 15 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.531750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 15 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.532144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 15 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-09-30T14:50:18.532431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 16 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.532585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 16 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.532733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 16 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.533123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 16 totakecount 4 count 1 size 205086 from pos 0 cbcount 1
2025-09-30T14:50:18.533264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 17 totakecount 4 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:18.533445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 17 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.533623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 17 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.533775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 17 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.533869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 17 totakecount 4 count 1 size 205086 from pos 0 cbcount 1
2025-09-30T14:50:18.533933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 35 size 2253220 cause it's been evicted from L2. Actual L1 size: 6
2025-09-30T14:50:18.533938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 25 size 3994387 cause it's been evicted from L2. Actual L1 size: 5
2025-09-30T14:50:18.533943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 27 size 8295638 cause it's been evicted from L2. Actual L1 size: 4
2025-09-30T14:50:18.533949Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-09-30T14:50:18.533982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 90  requestId: <none> cookie: 46
2025-09-30T14:50:18.534128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 14
2025-09-30T14:50:18.534160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 25 count 3 size 8295604 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.534165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 28 count 4 size 7988738 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.534169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 32 count 2 size 3482360 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.534211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 4 parts 14 suffix '63' size 7988760
2025-09-30T14:50:18.534221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 25 partno 1 count 3 parts 15 suffix '0' size 8295604
2025-09-30T14:50:18.534227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:18.534233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 28 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-09-30T14:50:18.534246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988760
2025-09-30T14:50:18.534250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 32 partno 2 count 2 parts 6 suffix '124' size 3482360
2025-09-30T14:50:18.534148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.537967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.538296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.540685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.540701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:471: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-09-30T14:50:18.541192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.541209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:18.541213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:18.541215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:18.541220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:18.541223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:18.541246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 10 size 7988760 cause it's been evicted from L2. Actual L1 size: 6
2025-09-30T14:50:18.541251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 36 size 4506418 cause it's been evicted from L2. Actual L1 size: 5
2025-09-30T14:50:18.541255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 30 size 7988760 cause it's been evicted from L2. Actual L1 size: 4
2025-09-30T14:50:18.541261Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-09-30T14:50:18.542158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.542181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.542263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 91 size: 511959
2025-09-30T14:50:18.542325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 91 size: 511959
2025-09-30T14:50:18.542390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 91 size: 511959
2025-09-30T14:50:18.542472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 91 size: 511959
2025-09-30T14:50:18.542513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 91 size: 205040
2025-09-30T14:50:18.542522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 91 size 205040 offset: -1
2025-09-30T14:50:18.542552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.542559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.542571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:18.542579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:18.542596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:18.542613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:18.542633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:18.542651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 38 count 3 size 8295638 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.542659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 41 count 1 size 717135 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.542678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.542707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.542724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.542730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.542732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.542740Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:18.542766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.542793Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 9011644 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:18.542804Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.542816Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 0, Offset: 38 is stored on disk
2025-09-30T14:50:18.542824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.542828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 1, Offset: 38 is stored on disk
2025-09-30T14:50:18.542831Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.542835Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 2, Offset: 38 is stored on disk
2025-09-30T14:50:18.542841Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.542845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 3, Offset: 38 is stored on disk
2025-09-30T14:50:18.542851Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.542856Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 4, Offset: 38 is stored on disk
2025-09-30T14:50:18.542858Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.542862Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 0, Offset: 39 is stored on disk
2025-09-30T14:50:18.542867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.542872Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 1, Offset: 39 is stored on disk
2025-09-30T14:50:18.542874Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.542879Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 2, Offset: 39 is stored on disk
2025-09-30T14:50:18.542881Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.542885Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 3, Offset: 39 is stored on disk
2025-09-30T14:50:18.542890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.542897Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 4, Offset: 39 is stored on disk
2025-09-30T14:50:18.542904Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.542908Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 0, Offset: 40 is stored on disk
2025-09-30T14:50:18.542911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.542915Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 1, Offset: 40 is stored on disk
2025-09-30T14:50:18.542920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.542924Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 2, Offset: 40 is stored on disk
2025-09-30T14:50:18.542926Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.542930Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 3, Offset: 40 is stored on disk
2025-09-30T14:50:18.542932Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.542937Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 4, Offset: 40 is stored on disk
2025-09-30T14:50:18.542939Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.542943Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 0, Offset: 41 is stored on disk
2025-09-30T14:50:18.542948Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.542952Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 1, Offset: 41 is stored on disk
2025-09-30T14:50:18.542954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.542959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 2, Offset: 41 is stored on disk
2025-09-30T14:50:18.542961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.542967Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 3, Offset: 41 is stored on disk
2025-09-30T14:50:18.542973Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.542977Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 4, Offset: 41 is stored on disk
2025-09-30T14:50:18.543007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.543025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.543030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (20)
2025-09-30T14:50:18.543052Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-09-30T14:50:18.543069Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 1
2025-09-30T14:50:18.543077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 2
2025-09-30T14:50:18.543080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 3
2025-09-30T14:50:18.543083Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 4
2025-09-30T14:50:18.543350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-09-30T14:50:18.543362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 38 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-09-30T14:50:18.543368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 41 partno 3 count 1 parts 1 suffix '63' size 717135
2025-09-30T14:50:18.543378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:18.543381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:18.543383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:18.543582Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 4 FormedBlobsCount 0 NewHead: Offset 42 PartNo 0 PackedSize 2253230 count 1 nextOffset 43 batches 5
2025-09-30T14:50:18.543603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-09-30T14:50:18.543609Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 1
2025-09-30T14:50:18.543612Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 2
2025-09-30T14:50:18.543616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 3
2025-09-30T14:50:18.543621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 4
2025-09-30T14:50:18.544111Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 4 FormedBlobsCount 0 NewHead: Offset 42 PartNo 0 PackedSize 4506428 count 2 nextOffset 44 batches 9
2025-09-30T14:50:18.544137Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-09-30T14:50:18.544143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 1
2025-09-30T14:50:18.544148Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 2
2025-09-30T14:50:18.544151Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 3
2025-09-30T14:50:18.544154Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 4
2025-09-30T14:50:18.544643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 4 FormedBlobsCount 0 NewHead: Offset 42 PartNo 0 PackedSize 6759626 count 3 nextOffset 45 batches 13
2025-09-30T14:50:18.544662Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-09-30T14:50:18.544668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-09-30T14:50:18.544671Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-09-30T14:50:18.544679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-09-30T14:50:18.548583Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 46 partNo 3 result is x0000000000_00000000000000000042_00000_0000000003_00015? size 8295638
2025-09-30T14:50:18.548608Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-09-30T14:50:18.548629Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000042_00000_0000000003_00015? new key d0000000000_00000000000000000042_00000_0000000003_00015? size 8295638 WTime 1759243818548
2025-09-30T14:50:18.548932Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 1 NewHead: Offset 45 PartNo 3 PackedSize 717145 count 1 nextOffset 46 batches 2
2025-09-30T14:50:18.548950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.549277Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 45,1 HeadOffset 42 endOffset 42 curOffset 46 d0000000000_00000000000000000045_00003_0000000001_00001? size 717135 WTime 1759243818548
2025-09-30T14:50:18.549396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:50:18.549430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 92  requestId: <none> cookie: 47
2025-09-30T14:50:18.549519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 77  requestId: <none> cookie: 39
2025-09-30T14:50:18.549542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 79  requestId: <none> cookie: 40
2025-09-30T14:50:18.549562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 81  requestId: <none> cookie: 41
2025-09-30T14:50:18.549583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 83  requestId: <none> cookie: 42
2025-09-30T14:50:18.549599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 14 size 7988778 cause it's been evicted from L2. Actual L1 size: 5
2025-09-30T14:50:18.549606Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-09-30T14:50:18.549651Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.549666Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 42 partNo 0 count 3 size 8295638
2025-09-30T14:50:18.549674Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 45 partNo 3 count 1 size 717135
2025-09-30T14:50:18.549683Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000027_00000_0000000003_00015?(+) to d0000000000_00000000000000000027_00000_0000000003_00015?(+)
2025-09-30T14:50:18.549685Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000030_00003_0000000004_00014?(+) to d0000000000_00000000000000000030_00003_0000000004_00014?(+)
2025-09-30T14:50:18.549688Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000025_00001_0000000002_00007|(+) to d0000000000_00000000000000000025_00001_0000000002_00007|(+)
2025-09-30T14:50:18.548762Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 38 Result { Offset: 14 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 15 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1759243818174 CreateTimestampMS: 1759243818123 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 15 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 16 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1759243818174 CreateTimestampMS: 1759243818128 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 16 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 17 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1759243818175 CreateTimestampMS: 1759243818137 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 17 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 18 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1759243818200 CreateTimestampMS: 1759243818143 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 2 BlobsFromCache: 0 SizeLag: 19562005 RealReadOffset: 17 WaitQuotaTimeMs: 0 EndOffset: 38 StartOffset: 0 } Cookie: 14 }
2025-09-30T14:50:18.549866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.549892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.549903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.549909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.549914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.549952Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 18 endOffset 38
2025-09-30T14:50:18.549966Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 38 ReadOffset 18 ReadGuid b285cf37-def1a891-968e2d6d-44aa5e15 has messages 1
2025-09-30T14:50:18.550006Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 18, endOffset# 38, WTime# 1759243818200, sizeLag# 19562005
2025-09-30T14:50:18.550010Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1TEvPartitionReady. Aval parts: 0
2025-09-30T14:50:18.550024Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 read done: guid# b285cf37-def1a891-968e2d6d-44aa5e15, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 9011741
2025-09-30T14:50:18.550037Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 response to read: guid# b285cf37-def1a891-968e2d6d-44aa5e15
2025-09-30T14:50:18.551568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 39 offsets: 38 already_written: false write_statistics { persist_duration_ms: 45 queued_in_partition_duration_ms: 18 }
2025-09-30T14:50:18.551584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 39
2025-09-30T14:50:18.551591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Estimated memory usage got back to normal 20275218[B]
2025-09-30T14:50:18.551666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 40 offsets: 39 already_written: false write_statistics { persist_duration_ms: 45 queued_in_partition_duration_ms: 15 }
2025-09-30T14:50:18.551670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 40
2025-09-30T14:50:18.551699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 41 offsets: 40 already_written: false write_statistics { persist_duration_ms: 44 queued_in_partition_duration_ms: 6 }
2025-09-30T14:50:18.551702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 41
2025-09-30T14:50:18.551721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session got write response: sequence_numbers: 42 offsets: 41 already_written: false write_statistics { persist_duration_ms: 43 queued_in_partition_duration_ms: 2 }
2025-09-30T14:50:18.551724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: acknoledged message 42
2025-09-30T14:50:18.551896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.552210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.552372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.552393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.552473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 93 size: 511959
2025-09-30T14:50:18.552543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 93 size: 511959
2025-09-30T14:50:18.552626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 93 size: 511959
2025-09-30T14:50:18.552696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 93 size: 511959
2025-09-30T14:50:18.552744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 93 size: 205040
2025-09-30T14:50:18.552755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 93 size 205040 offset: -1
2025-09-30T14:50:18.552783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.552791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.552803Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.552827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.552847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 94  requestId: <none> cookie: 48
2025-09-30T14:50:18.552965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.555207Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 Process answer. Aval parts: 1
2025-09-30T14:50:18.555577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 49 to 49
2025-09-30T14:50:18.555857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.555870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 49
2025-09-30T14:50:18.555642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.555661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.555761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 95 size: 511959
2025-09-30T14:50:18.555838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 95 size: 511959
2025-09-30T14:50:18.555921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 95 size: 511959
2025-09-30T14:50:18.555976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 95 size: 511959
2025-09-30T14:50:18.556019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 95 size: 205040
2025-09-30T14:50:18.556023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 95 size 205040 offset: -1
2025-09-30T14:50:18.556050Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.556075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.557354Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.560956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.561341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.561590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.561614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.561665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 96  requestId: <none> cookie: 49
2025-09-30T14:50:18.561767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.562065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 50 to 50
2025-09-30T14:50:18.562505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.562522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 50
2025-09-30T14:50:18.563340Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got ReadResponse, serverBytesSize = 9011741, now ReadSizeBudget = 0, ReadSizeServerDelta = -8487453
2025-09-30T14:50:18.563467Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (14-14)
2025-09-30T14:50:18.563480Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Returning serverBytesSize = 9011741 to budget
2025-09-30T14:50:18.564185Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (14-14)
2025-09-30T14:50:18.564204Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-09-30T14:50:18.564240Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (15-15)
2025-09-30T14:50:18.564255Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 14 ProducerId: "src_id" SeqNo: 15 CreateTime: 2025-09-30T14:50:18.123000Z WriteTime: 2025-09-30T14:50:18.174000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:54586", "server": "ipv6:[::1]:54586", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-09-30T14:50:18.565123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.564782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.564811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.564936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 97 size: 511959
2025-09-30T14:50:18.565163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 97 size: 511959
2025-09-30T14:50:18.565239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 97 size: 511959
2025-09-30T14:50:18.565314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 97 size: 511959
2025-09-30T14:50:18.565367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 97 size: 205040
2025-09-30T14:50:18.565372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 97 size 205040 offset: -1
2025-09-30T14:50:18.565409Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.565437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.565519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.571859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.571890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.571936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 98  requestId: <none> cookie: 50
2025-09-30T14:50:18.573556Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:18.573573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:18.573576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:18.573579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:18.573591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.573595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.573600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894657337278056:2397]
2025-09-30T14:50:18.573647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:18.573660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:18.573660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:18.573666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:18.573669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:18.573676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 25 partno 1 count 3 parts 15 suffix '0' size 8295604
2025-09-30T14:50:18.573680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:18.574183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 1
2025-09-30T14:50:18.574552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 2
2025-09-30T14:50:18.574709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 3
2025-09-30T14:50:18.574811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 4
2025-09-30T14:50:18.575357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:18.576692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 51 to 51
2025-09-30T14:50:18.576987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.577007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 51
2025-09-30T14:50:18.575424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 35 partNo 4 FormedBlobsCount 0 NewHead: Offset 34 PartNo 1 PackedSize 2253230 count 1 nextOffset 35 batches 5
2025-09-30T14:50:18.575445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:18.575447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:18.575613Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:18.578339Z :NOTICE: [/Invalid] [/Invalid] [3f611030-5f4cdae3-97916edd-8ec9b688] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:64460" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:64460. " }
2025-09-30T14:50:18.579742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.580147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.582192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write 1 messages with Id from 52 to 52
2025-09-30T14:50:18.582519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: try to update token
2025-09-30T14:50:18.582534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Send 1 message(s) (0 left), first sequence number is 52
2025-09-30T14:50:18.583724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-09-30T14:50:18.584073Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (15-15)
2025-09-30T14:50:18.584092Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 15 ProducerId: "src_id" SeqNo: 16 CreateTime: 2025-09-30T14:50:18.128000Z WriteTime: 2025-09-30T14:50:18.174000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:54586", "server": "ipv6:[::1]:54586", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-09-30T14:50:18.587293Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (16-16)
2025-09-30T14:50:18.587313Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:50:18.730267Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::ExecRequestForCompaction(NKikimr::NPQ::TWriteMsg&, NKikimr::NPQ::TPartition::TProcessParametersBase&, NKikimr::TEvKeyValue::TEvRequest*, TInstant)+1759 (0x241AF1DF)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+981 (0x241B4B15)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:18.730630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 25 size 8295604 cause it's been evicted from L2. Actual L1 size: 7
2025-09-30T14:50:18.730645Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-09-30T14:50:18.732327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.732347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.732442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 99 size: 511959
2025-09-30T14:50:18.732509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 99 size: 511959
2025-09-30T14:50:18.732570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 99 size: 511959
2025-09-30T14:50:18.732633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 99 size: 511959
2025-09-30T14:50:18.732675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 99 size: 205040
2025-09-30T14:50:18.732687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 99 size 205040 offset: -1
2025-09-30T14:50:18.732761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.732769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.733085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:18.733098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:18.733097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894666016935062:2517]
2025-09-30T14:50:18.733136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:18.733206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2 reason: error at write: Disconnected sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0
2025-09-30T14:50:18.733478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0 is DEAD
2025-09-30T14:50:18.733016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_8923399920190016107_v1
2025-09-30T14:50:18.733037Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 85 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:18.733044Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 87 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:18.733047Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 89 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:18.733054Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 91 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:18.733058Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 93 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:18.733062Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 95 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:18.733066Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 97 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:18.733069Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 99 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:18.733072Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 100 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:18.733439Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_8923399920190016107_v1
2025-09-30T14:50:18.733630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:18.733640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session will restart in 0.008264s
2025-09-30T14:50:18.733671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: Do CDS request
2025-09-30T14:50:18.733677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:18.742007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:18.742539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:18.742687Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:18.742699Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:18.742709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:18.742768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:18.742830Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894665927213020:2431]
2025-09-30T14:50:18.742910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:18.742990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:18.743003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-09-30T14:50:18.743538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:18.743709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:18.743768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:18.743793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:18.743798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:18.743852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:18.743893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:18.744303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-09-30T14:50:18.744347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:18.744354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:18.744357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:18.744362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894666016935219:2520] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:18.744539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:18.744637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:18.744643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:18.744644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:18.744647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:18.744649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:18.744650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:18.744651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:18.744652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000002_00007|
2025-09-30T14:50:18.744654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:18.744655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:18.744656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:18.744657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000027_00000_0000000003_00015?
2025-09-30T14:50:18.744658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000030_00003_0000000004_00014?
2025-09-30T14:50:18.744659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:18.744661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:18.744662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[15]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:18.744664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[16]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:18.744665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[17]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:18.744671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:18.744680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:18.744685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:18.744689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:18.744692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:18.744696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:18.744699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:18.744703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000002_00007|
2025-09-30T14:50:18.744707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:575: replace key d0000000000_00000000000000000025_00001_0000000002_00007| to d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:18.744710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:18.744714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:18.744717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:593: ignore key d0000000000_00000000000000000027_00000_0000000003_00015?
2025-09-30T14:50:18.744720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:593: ignore key d0000000000_00000000000000000030_00003_0000000004_00014?
2025-09-30T14:50:18.744723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:18.744727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:18.744730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:18.744733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:18.744738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:18.744745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:18.744752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:18.744759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:18.744766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:18.744771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:18.744776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:18.744780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:18.744785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:18.744790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:18.744794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:18.744798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:18.744802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:18.744807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:18.744811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:18.744814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000002_00007|
2025-09-30T14:50:18.744819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:655: [rt3.dc1--test-topic:0:TInitDataRangeStep] unknown key d0000000000_00000000000000000025_00001_0000000002_00007| will be deleted
2025-09-30T14:50:18.744824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:18.744828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:18.744833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000027_00000_0000000003_00015?
2025-09-30T14:50:18.744837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:655: [rt3.dc1--test-topic:0:TInitDataRangeStep] unknown key d0000000000_00000000000000000027_00000_0000000003_00015? will be deleted
2025-09-30T14:50:18.744839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:18.744844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:18.744848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000004_00014?
2025-09-30T14:50:18.744852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:655: [rt3.dc1--test-topic:0:TInitDataRangeStep] unknown key d0000000000_00000000000000000030_00003_0000000004_00014? will be deleted
2025-09-30T14:50:18.744854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:18.744858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:18.744864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:18.744869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:18.744874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:18.744879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:18.744890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:18.744895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:18.744899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:18.744903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:18.744911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:18.744917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:18.744962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:18.744958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894666016935219:2520] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:18.747010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894666016935219:2520] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:18.751474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894666016935219:2520] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:18.751490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894666016935219:2520] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:18.751494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894666016935219:2520] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:18.751503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:18.753371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:18.754352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:18.754374Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:18.754378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:18.754382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:18.754391Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2 [2:7555894665927213020:2431]
2025-09-30T14:50:18.754411Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:18.754434Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:18.754443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.754446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.754449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.754483Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:18.754490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:18.754498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:18.754538Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.754551Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000030_00003_0000000004_00014?(+) to d0000000000_00000000000000000030_00003_0000000004_00014?(+)
2025-09-30T14:50:18.754554Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000027_00000_0000000003_00015?(+) to d0000000000_00000000000000000027_00000_0000000003_00015?(+)
2025-09-30T14:50:18.754558Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000025_00001_0000000002_00007|(+) to d0000000000_00000000000000000025_00001_0000000002_00007|(+)
2025-09-30T14:50:18.754596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:18.754603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:18.754605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:18.754608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:18.754610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:18.754723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:18.754730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:18.754758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:18.754773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:18.754794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:18.754831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894666016935256:2520], now have 1 active actors on pipe
2025-09-30T14:50:18.754839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894666016935199:2454], now have 1 active actors on pipe
2025-09-30T14:50:18.754845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894665927213015:2431]
2025-09-30T14:50:18.754848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894665927213015:2431]
2025-09-30T14:50:18.754850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894665927213015:2431]
2025-09-30T14:50:18.754850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2
2025-09-30T14:50:18.754855Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2
2025-09-30T14:50:18.754867Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:18.754882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:18.754885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:18.754885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:18.754888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:18.754901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:18.754904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:18.755073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.755087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.755104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894665927213015:2431]
2025-09-30T14:50:18.755108Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:18.755130Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0f6cbac-b3a935a8-616ba6ca-4e507770_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:18.755138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:18.755143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:18.756032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.756056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:18.756066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.756071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.756075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:18.756086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.756098Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:18.756111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:50:18.756121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:18.756574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.756586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.756606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:18.756696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 42 sessionId: src_id|a0f6cbac-b3a935a8-616ba6ca-4e507770_0
2025-09-30T14:50:18.757131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa73614-f79f79c7-e9267453-4d4224cb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a0f6cbac-b3a935a8-616ba6ca-4e507770_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:18.760352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0f6cbac-b3a935a8-616ba6ca-4e507770_0] Write session: try to update token
2025-09-30T14:50:18.760370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0f6cbac-b3a935a8-616ba6ca-4e507770_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:18.774038Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:18.774058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:18.774060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:18.774063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:18.774071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894665927213015:2431]
2025-09-30T14:50:18.774076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894665927213015:2431]
2025-09-30T14:50:18.774080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894665927213015:2431]
2025-09-30T14:50:18.774122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:18.774126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:18.774129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:18.774132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:18.774134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:18.774148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:18.774608Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:18.785938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: src_id|a0f6cbac-b3a935a8-616ba6ca-4e507770_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.797533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.833081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894666016935278:2517]
2025-09-30T14:50:18.833443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2, pipe: [1:7555894666016935278:2517]
2025-09-30T14:50:18.887427Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:18.888375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.888394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.888426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894666016935278:2517], now have 1 active actors on pipe
2025-09-30T14:50:18.891055Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:18.891101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:18.891127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:18.891228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3 reason: error at write: Disconnected sessionId: src_id|a0f6cbac-b3a935a8-616ba6ca-4e507770_0
2025-09-30T14:50:18.891415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:18.891457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: src_id|a0f6cbac-b3a935a8-616ba6ca-4e507770_0 is DEAD
2025-09-30T14:50:18.891477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894666016935278:2517]
2025-09-30T14:50:18.891680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0f6cbac-b3a935a8-616ba6ca-4e507770_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:18.891688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0f6cbac-b3a935a8-616ba6ca-4e507770_0] Write session will restart in 0.006321s
2025-09-30T14:50:18.891714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0f6cbac-b3a935a8-616ba6ca-4e507770_0] Write session: Do CDS request
2025-09-30T14:50:18.891720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0f6cbac-b3a935a8-616ba6ca-4e507770_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:18.898982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0f6cbac-b3a935a8-616ba6ca-4e507770_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:18.899018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:18.899034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-09-30T14:50:18.899272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:18.899310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:18.899315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:18.899321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:18.899790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-09-30T14:50:18.899829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:18.899835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:18.899837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:18.899844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894666016935310:2531] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:18.900420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894666016935310:2531] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:18.902686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894666016935310:2531] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:18.904058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:18.904635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:18.904820Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:18.904831Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:18.904841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:18.904889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:18.904930Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894665927213122:2446]
2025-09-30T14:50:18.905414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894666016935310:2531] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:18.905430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894666016935310:2531] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:18.905434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894666016935310:2531] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:18.905443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:18.905621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:18.905887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:18.905939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:18.906288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:18.906375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:18.906387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:18.906388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:18.906389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:18.906391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:18.906392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:18.906393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:18.906395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:18.906397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:18.906398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:18.906400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:18.906401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:18.906402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:18.906404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:18.906406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:18.906412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:18.906424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:18.906428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:18.906433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:18.906438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:18.906443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:18.906448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:18.906452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:18.906456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:18.906462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:18.906467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:18.906471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:18.906475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:18.906480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:18.906485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:18.906493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:18.906500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:18.906506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:18.906511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:18.906521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:18.906527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:18.906533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:18.906544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:18.906550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:18.906560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:18.906564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:18.906568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:18.906578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:18.906585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:18.906591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:18.906598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:18.906607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:18.906612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:18.906617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:18.906621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:18.906626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:18.906631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:18.906636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:18.906646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:18.906651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:18.906657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:18.906666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:18.906673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:18.906682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:18.906687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:18.906739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:18.915920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:18.916822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:18.916839Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:18.916841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:18.916845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:18.916854Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3 [2:7555894665927213122:2446]
2025-09-30T14:50:18.916875Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:18.916897Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:18.916904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.916907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.916910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.916927Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:18.916939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:18.916946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:18.917021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:18.917028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:18.917031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:18.917035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:18.917037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:18.917110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:18.917119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:18.917131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:18.917143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:18.917160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:18.917183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894665927213117:2446]
2025-09-30T14:50:18.917189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894665927213117:2446]
2025-09-30T14:50:18.917191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894665927213117:2446]
2025-09-30T14:50:18.917204Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:18.917220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894666016935343:2531], now have 1 active actors on pipe
2025-09-30T14:50:18.917229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894666016935292:2454], now have 1 active actors on pipe
2025-09-30T14:50:18.917229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:18.917233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:18.917235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:18.917238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:18.917253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:18.917261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:18.917303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894665927213117:2446]
2025-09-30T14:50:18.917276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3
2025-09-30T14:50:18.917314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:18.917290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3
2025-09-30T14:50:18.917330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:18.917354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.917359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.917388Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d26e3d5-af8b15fc-7af9dd1e-4425e9b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:18.917400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.917404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.917411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:18.917421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.917435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:18.917453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:18.917616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.917628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.917650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:18.917751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 42 sessionId: src_id|9d26e3d5-af8b15fc-7af9dd1e-4425e9b8_0
2025-09-30T14:50:18.918223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0f6cbac-b3a935a8-616ba6ca-4e507770_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9d26e3d5-af8b15fc-7af9dd1e-4425e9b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:18.929812Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:18.929834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:18.929845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894665927213117:2446]
2025-09-30T14:50:18.929908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:18.929918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 28 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-09-30T14:50:18.929925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:18.930093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:18.930249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.930396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.930594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:18.930825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:18.930875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:18.932779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d26e3d5-af8b15fc-7af9dd1e-4425e9b8_0] Write session: try to update token
2025-09-30T14:50:18.932804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d26e3d5-af8b15fc-7af9dd1e-4425e9b8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:18.947966Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:18.947990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:18.947993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:18.947995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:18.948006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894665927213117:2446]
2025-09-30T14:50:18.948011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894665927213117:2446]
2025-09-30T14:50:18.948015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894665927213117:2446]
2025-09-30T14:50:18.948063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:18.948071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:18.948073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:18.948082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:18.948101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:18.948106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:18.948368Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:18.956404Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:17:0
2025-09-30T14:50:18.956432Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1000 BytesRead: 38297624 MessagesRead: 17 BytesReadCompressed: 38297624 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 2252802 BytesInflightTotal: 4505604 MessagesInflight: 2 }
2025-09-30T14:50:18.958658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: src_id|9d26e3d5-af8b15fc-7af9dd1e-4425e9b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.968942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.991823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894666016935361:2517]
2025-09-30T14:50:18.992104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 3, pipe: [1:7555894666016935361:2517]
2025-09-30T14:50:19.065831Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:19.067154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.067175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.067198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894666016935361:2517], now have 1 active actors on pipe
2025-09-30T14:50:19.067415Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:19.067474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894666016935361:2517]
2025-09-30T14:50:19.067507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:19.068302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:19.068390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 4 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9d26e3d5-af8b15fc-7af9dd1e-4425e9b8_0
2025-09-30T14:50:19.068639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: src_id|9d26e3d5-af8b15fc-7af9dd1e-4425e9b8_0 is DEAD
2025-09-30T14:50:19.068808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d26e3d5-af8b15fc-7af9dd1e-4425e9b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:19.068818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d26e3d5-af8b15fc-7af9dd1e-4425e9b8_0] Write session will restart in 0.006543s
2025-09-30T14:50:19.068855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d26e3d5-af8b15fc-7af9dd1e-4425e9b8_0] Write session: Do CDS request
2025-09-30T14:50:19.068863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d26e3d5-af8b15fc-7af9dd1e-4425e9b8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:19.076736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:19.076866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d26e3d5-af8b15fc-7af9dd1e-4425e9b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:19.076993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:19.077009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 5
2025-09-30T14:50:19.077157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:19.077195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 5 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:19.077206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=5 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:19.077210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:19.077357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:19.077577Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:19.077590Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:19.077604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:19.077671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:19.077721Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894670222180480:2450]
2025-09-30T14:50:19.077737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 5 sessionId:  describe result for acl check
2025-09-30T14:50:19.077794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:19.077801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:19.077804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:19.077812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894670311902683:2537] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:19.078320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894670311902683:2537] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:19.078337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:19.078721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:19.078797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:19.079154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:19.079209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:19.079215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:19.079215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:19.079216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:19.079217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:19.079218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:19.079219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:19.079220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:19.079220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:19.079221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:19.079222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.079223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.079223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.079224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:19.079225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:19.079229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:19.079236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:19.079239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:19.079263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:19.079268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:19.079271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:19.079275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:19.079279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:19.079283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:19.079287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:19.079291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.079294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.079299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.079302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:19.079306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:19.079314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:19.079323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:19.079329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:19.079333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:19.079336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:19.079339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:19.079342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:19.079345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:19.079348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:19.079351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:19.079354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:19.079357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:19.079361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:19.079367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:19.079372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:19.079376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:19.079381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:19.079385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:19.079389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:19.079394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:19.079399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.079403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.079408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.079413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.079417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.079423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.079427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:19.079432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:19.079436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:19.079441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:19.079483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:19.080547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894670311902683:2537] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:19.085020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894670311902683:2537] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:19.085035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894670311902683:2537] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:19.085039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894670311902683:2537] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:19.085049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 5 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:19.085760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:19.086888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:19.086906Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:19.086909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:19.086913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:19.086924Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 4 [2:7555894670222180480:2450]
2025-09-30T14:50:19.086943Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:19.086960Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:19.086964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.086967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.086970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.086989Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:19.086995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:19.087002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:19.087054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.087061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.087063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.087066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:19.087076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:19.087155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:19.087163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.087176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.087189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.087210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:19.087258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894670311902722:2537], now have 1 active actors on pipe
2025-09-30T14:50:19.087271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894670311902663:2454], now have 1 active actors on pipe
2025-09-30T14:50:19.087279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894670222180475:2450]
2025-09-30T14:50:19.087282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894670222180475:2450]
2025-09-30T14:50:19.087284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894670222180475:2450]
2025-09-30T14:50:19.087297Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:19.087314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:19.087306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 4
2025-09-30T14:50:19.087318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:19.087309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 4
2025-09-30T14:50:19.087322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:19.087324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:19.087329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:19.087332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:19.087374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894670222180475:2450]
2025-09-30T14:50:19.087377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:19.087379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:19.087394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.087399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.087459Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dcbb3e9f-372a077b-65c41827-56c32386_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:19.087479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.087488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.087490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:19.087504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.087515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:19.087541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:19.087773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.087789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.087806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:19.087886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 5 partition: 0 MaxSeqNo: 42 sessionId: src_id|dcbb3e9f-372a077b-65c41827-56c32386_0
2025-09-30T14:50:19.088319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d26e3d5-af8b15fc-7af9dd1e-4425e9b8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dcbb3e9f-372a077b-65c41827-56c32386_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:19.091532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcbb3e9f-372a077b-65c41827-56c32386_0] Write session: try to update token
2025-09-30T14:50:19.091554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcbb3e9f-372a077b-65c41827-56c32386_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:19.101028Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:19.101044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:19.101047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:19.101049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:19.101060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894670222180475:2450]
2025-09-30T14:50:19.101066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894670222180475:2450]
2025-09-30T14:50:19.101069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894670222180475:2450]
2025-09-30T14:50:19.101113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:19.101121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.101125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:19.101150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:19.101161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:19.101166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:19.101288Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:19.111672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: src_id|dcbb3e9f-372a077b-65c41827-56c32386_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:19.115574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:19.167424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894670311902729:2517]
2025-09-30T14:50:19.167736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 4, pipe: [1:7555894670311902729:2517]
2025-09-30T14:50:19.226153Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:19.226534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.226550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.226576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894670311902729:2517], now have 1 active actors on pipe
2025-09-30T14:50:19.226840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:19.226845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:19.226850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:19.226912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894670311902729:2517]
2025-09-30T14:50:19.226922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 5 reason: error at write: Disconnected sessionId: src_id|dcbb3e9f-372a077b-65c41827-56c32386_0
2025-09-30T14:50:19.226873Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:19.227140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 5 sessionId: src_id|dcbb3e9f-372a077b-65c41827-56c32386_0 is DEAD
2025-09-30T14:50:19.227363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcbb3e9f-372a077b-65c41827-56c32386_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:19.227374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcbb3e9f-372a077b-65c41827-56c32386_0] Write session will restart in 0.007196s
2025-09-30T14:50:19.227401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcbb3e9f-372a077b-65c41827-56c32386_0] Write session: Do CDS request
2025-09-30T14:50:19.227409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcbb3e9f-372a077b-65c41827-56c32386_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:19.235898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcbb3e9f-372a077b-65c41827-56c32386_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:19.235977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:19.235995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 6
2025-09-30T14:50:19.236141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:19.236200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 6 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:19.236210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=6 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:19.236215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:19.236741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 6 sessionId:  describe result for acl check
2025-09-30T14:50:19.236781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:19.236788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:19.236790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:19.236797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894670311902748:2541] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:19.237432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894670311902748:2541] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:19.239447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:19.239910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894670311902748:2541] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:19.241513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:19.241727Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:19.241737Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:19.241751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:19.241806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:19.241853Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894670222180541:2452]
2025-09-30T14:50:19.242537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:19.242917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:19.242969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:19.243108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894670311902748:2541] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:19.243122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894670311902748:2541] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:19.243127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894670311902748:2541] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:19.243137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 6 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:19.243335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:19.243416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:19.243422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:19.243423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:19.243424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:19.243425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:19.243426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:19.243427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:19.243428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:19.243430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:19.243431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:19.243432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.243433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.243434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.243436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:19.243437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:19.243443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:19.243454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:19.243458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:19.243462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:19.243466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:19.243469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:19.243472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:19.243476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:19.243480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:19.243483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:19.243487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.243491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.243494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.243498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:19.243501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:19.243510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:19.243517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:19.243524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:19.243530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:19.243535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:19.243540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:19.243550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:19.243554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:19.243563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:19.243568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:19.243577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:19.243582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:19.243586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:19.243593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:19.243604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:19.243613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:19.243618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:19.243628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:19.243637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:19.243641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:19.243646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.243650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.243658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.243663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.243667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.243677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.243681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:19.243690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:19.243695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:19.243703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:19.243747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:19.249776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:19.250931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:19.250951Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:19.250955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:19.250959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:19.250967Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 5 [2:7555894670222180541:2452]
2025-09-30T14:50:19.250985Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:19.251002Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:19.251006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.251010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.251013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.251035Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:19.251048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:19.251057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:19.251127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.251137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.251140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.251143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:19.251146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:19.251228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:19.251231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.251264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.251274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.251289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:19.251311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894670222180536:2452]
2025-09-30T14:50:19.251313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894670222180536:2452]
2025-09-30T14:50:19.251315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894670222180536:2452]
2025-09-30T14:50:19.251326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:19.251343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:19.251361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:19.251365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:19.251381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:19.251384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:19.251387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:19.251407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894670222180536:2452]
2025-09-30T14:50:19.251411Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:19.251498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:19.251711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894670311902731:2454], now have 1 active actors on pipe
2025-09-30T14:50:19.251725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894670311902788:2541], now have 1 active actors on pipe
2025-09-30T14:50:19.251685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 5
2025-09-30T14:50:19.251692Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 5
2025-09-30T14:50:19.251878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.251893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.251927Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74d86ec1-4a245ce-77369cd0-bc4e4f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:19.251943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.251951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.251954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:19.251969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.251988Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:19.252015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:19.252263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.252271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.252288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:19.252519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 6 partition: 0 MaxSeqNo: 42 sessionId: src_id|74d86ec1-4a245ce-77369cd0-bc4e4f9_0
2025-09-30T14:50:19.252994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcbb3e9f-372a077b-65c41827-56c32386_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|74d86ec1-4a245ce-77369cd0-bc4e4f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:19.256424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74d86ec1-4a245ce-77369cd0-bc4e4f9_0] Write session: try to update token
2025-09-30T14:50:19.256448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74d86ec1-4a245ce-77369cd0-bc4e4f9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:19.265634Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:19.265659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:19.265662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:19.265664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:19.265676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894670222180536:2452]
2025-09-30T14:50:19.265681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894670222180536:2452]
2025-09-30T14:50:19.265686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894670222180536:2452]
2025-09-30T14:50:19.265735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:19.265748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.265751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:19.265748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:19.265758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:19.265763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:19.266035Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:19.279180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId: src_id|74d86ec1-4a245ce-77369cd0-bc4e4f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:19.282531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:19.327172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894670311902798:2517]
2025-09-30T14:50:19.327681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 5, pipe: [1:7555894670311902798:2517]
2025-09-30T14:50:19.398284Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:19.399496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.399537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.399560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894670311902798:2517], now have 1 active actors on pipe
2025-09-30T14:50:19.400293Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:19.400485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894670311902798:2517]
2025-09-30T14:50:19.400518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:19.400523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:19.400773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 6 reason: error at write: Disconnected sessionId: src_id|74d86ec1-4a245ce-77369cd0-bc4e4f9_0
2025-09-30T14:50:19.400971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 6 sessionId: src_id|74d86ec1-4a245ce-77369cd0-bc4e4f9_0 is DEAD
2025-09-30T14:50:19.400719Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:19.401719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74d86ec1-4a245ce-77369cd0-bc4e4f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:19.401746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74d86ec1-4a245ce-77369cd0-bc4e4f9_0] Write session will restart in 0.005404s
2025-09-30T14:50:19.401778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74d86ec1-4a245ce-77369cd0-bc4e4f9_0] Write session: Do CDS request
2025-09-30T14:50:19.401790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74d86ec1-4a245ce-77369cd0-bc4e4f9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:19.409230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74d86ec1-4a245ce-77369cd0-bc4e4f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:19.409360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:19.409433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 7
2025-09-30T14:50:19.409632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:19.409749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 7 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:19.409756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=7 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:19.409771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:19.410929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 7 sessionId:  describe result for acl check
2025-09-30T14:50:19.410979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:19.410982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:19.410992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:19.410998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894670311902811:2546] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:19.411938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894670311902811:2546] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:19.414910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894670311902811:2546] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:19.417994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:19.418171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894670311902811:2546] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:19.418188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894670311902811:2546] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:19.418191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894670311902811:2546] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:19.418201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 7 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:19.418566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:19.418804Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:19.418807Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:19.418817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:19.418874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:19.418911Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894670222180605:2454]
2025-09-30T14:50:19.419604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:19.420215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:19.420305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:19.420810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:19.420894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:19.420902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:19.420904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:19.420906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:19.420907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:19.420908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:19.420910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:19.420912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:19.420913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:19.420914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:19.420914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.420915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.420917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.420918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:19.420919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:19.420926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:19.420937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:19.420942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:19.420946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:19.420950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:19.420958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:19.420962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:19.420966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:19.420971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:19.420976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:19.420980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.420984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.420988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.420992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:19.420996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:19.421006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:19.421015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:19.421022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:19.421034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:19.421039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:19.421051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:19.421056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:19.421062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:19.421083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:19.421094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:19.421100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:19.421105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:19.421111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:19.421123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:19.421129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:19.421141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:19.421147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:19.421156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:19.421161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:19.421168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:19.421187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.421192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.421207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.421223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.421228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.421233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.421237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:19.421243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:19.421255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:19.421263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:19.421310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:19.430436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:19.433261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:19.433282Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:19.433285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:19.433290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:19.433299Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 6 [2:7555894670222180605:2454]
2025-09-30T14:50:19.433320Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:19.433344Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:19.433348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.433352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.433354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.433377Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:19.433391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:19.433402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:19.433476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.433483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.433485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.433489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:19.433493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:19.433582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:19.433591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.433606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.433616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.433631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:19.433652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894670222180599:2454]
2025-09-30T14:50:19.433659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894670222180599:2454]
2025-09-30T14:50:19.433661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894670222180599:2454]
2025-09-30T14:50:19.433671Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:19.433698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:19.433707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:19.433708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:19.433710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:19.433722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:19.433725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:19.433737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894670311902800:2454], now have 1 active actors on pipe
2025-09-30T14:50:19.433741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894670311902860:2546], now have 1 active actors on pipe
2025-09-30T14:50:19.433791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894670222180599:2454]
2025-09-30T14:50:19.433804Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:19.433846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:19.433999Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 6
2025-09-30T14:50:19.434061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 6
2025-09-30T14:50:19.434331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.434359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.434391Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35cb8ad3-c7aabbae-d2886b72-f47ab6b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:19.434406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.434414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.434417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:19.434447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.434466Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:19.434500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:19.434733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.434760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.434782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:19.434898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 7 partition: 0 MaxSeqNo: 42 sessionId: src_id|35cb8ad3-c7aabbae-d2886b72-f47ab6b8_0
2025-09-30T14:50:19.435429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74d86ec1-4a245ce-77369cd0-bc4e4f9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|35cb8ad3-c7aabbae-d2886b72-f47ab6b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:19.446927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35cb8ad3-c7aabbae-d2886b72-f47ab6b8_0] Write session: try to update token
2025-09-30T14:50:19.446956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35cb8ad3-c7aabbae-d2886b72-f47ab6b8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:19.450876Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:19.450894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:19.450904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894670222180599:2454]
2025-09-30T14:50:19.450954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:19.450962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:19.451162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:19.451367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:19.451552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:19.451877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:19.452720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:19.452774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:19.471955Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:19.471973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:19.471976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:19.471980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:19.471992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894670222180599:2454]
2025-09-30T14:50:19.471996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894670222180599:2454]
2025-09-30T14:50:19.472000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894670222180599:2454]
2025-09-30T14:50:19.472048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:19.472055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.472058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:19.472078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:19.472085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:19.472089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:19.472236Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:19.478680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: src_id|35cb8ad3-c7aabbae-d2886b72-f47ab6b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:19.481708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:19.501568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894670311902871:2517]
2025-09-30T14:50:19.502106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 6, pipe: [1:7555894670311902871:2517]
2025-09-30T14:50:19.599416Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:19.599749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.599764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.599785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894670311902871:2517], now have 1 active actors on pipe
2025-09-30T14:50:19.600032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894670311902871:2517]
2025-09-30T14:50:19.600065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:19.600068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:19.600077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:19.600130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 7 reason: error at write: Disconnected sessionId: src_id|35cb8ad3-c7aabbae-d2886b72-f47ab6b8_0
2025-09-30T14:50:19.600077Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:19.600380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 7 sessionId: src_id|35cb8ad3-c7aabbae-d2886b72-f47ab6b8_0 is DEAD
2025-09-30T14:50:19.600711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35cb8ad3-c7aabbae-d2886b72-f47ab6b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:19.600722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35cb8ad3-c7aabbae-d2886b72-f47ab6b8_0] Write session will restart in 0.008619s
2025-09-30T14:50:19.600751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35cb8ad3-c7aabbae-d2886b72-f47ab6b8_0] Write session: Do CDS request
2025-09-30T14:50:19.600759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35cb8ad3-c7aabbae-d2886b72-f47ab6b8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:19.610932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35cb8ad3-c7aabbae-d2886b72-f47ab6b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:19.611022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:19.611038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 8
2025-09-30T14:50:19.611196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:19.611257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 8 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:19.611267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=8 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:19.611273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:19.611721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 8 sessionId:  describe result for acl check
2025-09-30T14:50:19.611754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:19.611760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:19.611763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:19.611770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894670311902894:2550] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:19.612345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894670311902894:2550] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:19.614423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:19.615196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:19.615422Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:19.615432Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:19.615444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:19.615498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:19.615579Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894670222180679:2458]
2025-09-30T14:50:19.616297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:19.616777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:19.616837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:19.617248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:19.617309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:19.617315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:19.617316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:19.617318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:19.617319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:19.617320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:19.617321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:19.617323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:19.617324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:19.617325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:19.617326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.617328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.617329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.617330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:19.617331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:19.617337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:19.617347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:19.617351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:19.617356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:19.617360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:19.617365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:19.617369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:19.617374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:19.617378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:19.617382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:19.617386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.617390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.617398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.617403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:19.617406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:19.617415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:19.617424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:19.617430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:19.617436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:19.617442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:19.617449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:19.617460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:19.617466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:19.617470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:19.617476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:19.617483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:19.617492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:19.617497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:19.617508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:19.617513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:19.617518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:19.617528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:19.617533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:19.617542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:19.617548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:19.617556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.617563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.617568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.617578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.617584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.617594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.617599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:19.617609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:19.617619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:19.617625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:19.617675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:19.617795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894670311902894:2550] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:19.623074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894670311902894:2550] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:19.623095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894670311902894:2550] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:19.623099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894670311902894:2550] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:19.623109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 8 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:19.625967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:19.627072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:19.627089Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:19.627092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:19.627096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:19.627104Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 7 [2:7555894670222180679:2458]
2025-09-30T14:50:19.627125Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:19.627144Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:19.627148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.627151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.627155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.627173Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:19.627185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:19.627197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:19.627606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.627622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.627635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.627640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:19.627643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:19.627746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:19.627753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.627772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.627790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.627809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:19.627835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894670311902936:2550], now have 1 active actors on pipe
2025-09-30T14:50:19.627844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894670311902874:2454], now have 1 active actors on pipe
2025-09-30T14:50:19.627851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894670222180673:2458]
2025-09-30T14:50:19.627853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894670222180673:2458]
2025-09-30T14:50:19.627856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894670222180673:2458]
2025-09-30T14:50:19.627869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:19.627892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:19.627913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:19.627919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:19.627961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894670222180673:2458]
2025-09-30T14:50:19.627967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:19.628017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:19.628027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:19.628030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:19.628038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:19.628234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 7
2025-09-30T14:50:19.628273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 7
2025-09-30T14:50:19.628428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.628435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.628471Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47d373d4-c9cdc5ad-8b705341-49824d81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:19.628479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.628483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.628485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:19.628507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.628524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:19.628542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:19.631519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.631536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.631568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:19.631899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 8 partition: 0 MaxSeqNo: 42 sessionId: src_id|47d373d4-c9cdc5ad-8b705341-49824d81_0
2025-09-30T14:50:19.632335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35cb8ad3-c7aabbae-d2886b72-f47ab6b8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|47d373d4-c9cdc5ad-8b705341-49824d81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:19.635643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47d373d4-c9cdc5ad-8b705341-49824d81_0] Write session: try to update token
2025-09-30T14:50:19.635664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47d373d4-c9cdc5ad-8b705341-49824d81_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:19.645808Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:19.645826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:19.645832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:19.645835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:19.645844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894670222180673:2458]
2025-09-30T14:50:19.645852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894670222180673:2458]
2025-09-30T14:50:19.645856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894670222180673:2458]
2025-09-30T14:50:19.645897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:19.645905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.645908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:19.645941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:19.645955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:19.645960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:19.646195Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:19.669598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId: src_id|47d373d4-c9cdc5ad-8b705341-49824d81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:19.672892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:19.700449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894670311902956:2517]
2025-09-30T14:50:19.700789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 7, pipe: [1:7555894670311902956:2517]
2025-09-30T14:50:19.773826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47d373d4-c9cdc5ad-8b705341-49824d81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:19.773841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47d373d4-c9cdc5ad-8b705341-49824d81_0] Write session will restart in 0.009668s
2025-09-30T14:50:19.773867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47d373d4-c9cdc5ad-8b705341-49824d81_0] Write session: Do CDS request
2025-09-30T14:50:19.773873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47d373d4-c9cdc5ad-8b705341-49824d81_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:19.773294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894670311902956:2517]
2025-09-30T14:50:19.773331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:19.773334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:19.773419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 8 reason: error at write: Disconnected sessionId: src_id|47d373d4-c9cdc5ad-8b705341-49824d81_0
2025-09-30T14:50:19.773637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 8 sessionId: src_id|47d373d4-c9cdc5ad-8b705341-49824d81_0 is DEAD
2025-09-30T14:50:19.773686Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:19.772537Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:19.772932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.772944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.772964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894670311902956:2517], now have 1 active actors on pipe
2025-09-30T14:50:19.775468Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:19.782507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:19.783043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:19.783226Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:19.783238Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:19.783268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:19.783317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:19.783366Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894670222180741:2460]
2025-09-30T14:50:19.784018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:19.784338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:19.784383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:19.784842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47d373d4-c9cdc5ad-8b705341-49824d81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:19.785038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:19.785053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 9
2025-09-30T14:50:19.784733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:19.784807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:19.784808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:19.784809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:19.784810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:19.784812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:19.784813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:19.784814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:19.784815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:19.784816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:19.784818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:19.784819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.784820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.784821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.784822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:19.784822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:19.784828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:19.784837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:19.784843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:19.784846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:19.784850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:19.784853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:19.784856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:19.784859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:19.784863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:19.784867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:19.784870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.784874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.784877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.784880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:19.784883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:19.784890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:19.784898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:19.784904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:19.784910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:19.784917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:19.784922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:19.784926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:19.784930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:19.784935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:19.784939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:19.784943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:19.784948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:19.784953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:19.784958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:19.784961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:19.784966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:19.784969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:19.784973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:19.784980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:19.784985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:19.784990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.784995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.784998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.785003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.785007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.785013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.785016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:19.785020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:19.785024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:19.785029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:19.785067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:19.785335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:19.785383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 9 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:19.785390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=9 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:19.785394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:19.785866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 9 sessionId:  describe result for acl check
2025-09-30T14:50:19.785898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:19.785904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:19.785907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:19.785915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894670311902987:2555] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:19.786507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894670311902987:2555] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:19.788932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894670311902987:2555] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:19.792160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894670311902987:2555] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:19.792178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894670311902987:2555] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:19.792181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894670311902987:2555] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:19.792190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 9 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:19.793375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:19.794339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:19.794358Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:19.794362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:19.794366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:19.794373Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 8 [2:7555894670222180741:2460]
2025-09-30T14:50:19.794392Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:19.794411Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:19.794414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.794418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.794420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.794437Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:19.794451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:19.794459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:19.794531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.794542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.794544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.794548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:19.794550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:19.794648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:19.794656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.794670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.794687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.794706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:19.794731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894670311903020:2555], now have 1 active actors on pipe
2025-09-30T14:50:19.794751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894670311902957:2454], now have 1 active actors on pipe
2025-09-30T14:50:19.794760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894670222180736:2460]
2025-09-30T14:50:19.794762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894670222180736:2460]
2025-09-30T14:50:19.794765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894670222180736:2460]
2025-09-30T14:50:19.794779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:19.794799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:19.794801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:19.794813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:19.794816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:19.794816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:19.794819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:19.794871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894670222180736:2460]
2025-09-30T14:50:19.794879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:19.794895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:19.794855Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 8
2025-09-30T14:50:19.794860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 8
2025-09-30T14:50:19.794917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.794927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.794960Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0f36d0-76bafd28-6d1ce8b9-c8f14957_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:19.794973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.794981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.794984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:19.794998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.795012Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:19.795033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:19.795183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.795191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.795205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:19.795341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 9 partition: 0 MaxSeqNo: 42 sessionId: src_id|b0f36d0-76bafd28-6d1ce8b9-c8f14957_0
2025-09-30T14:50:19.795758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47d373d4-c9cdc5ad-8b705341-49824d81_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b0f36d0-76bafd28-6d1ce8b9-c8f14957_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:19.799065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0f36d0-76bafd28-6d1ce8b9-c8f14957_0] Write session: try to update token
2025-09-30T14:50:19.799086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0f36d0-76bafd28-6d1ce8b9-c8f14957_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:19.811330Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:19.811348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:19.811353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:19.811356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:19.811368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894670222180736:2460]
2025-09-30T14:50:19.811373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894670222180736:2460]
2025-09-30T14:50:19.811378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894670222180736:2460]
2025-09-30T14:50:19.811424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:19.811432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.811434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:19.811443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:19.811451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:19.811455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:19.811605Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:19.819159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId: src_id|b0f36d0-76bafd28-6d1ce8b9-c8f14957_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:19.852901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:19.873541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894670311903029:2517]
2025-09-30T14:50:19.875031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 8, pipe: [1:7555894670311903029:2517]
2025-09-30T14:50:19.929157Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:19.929560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.929571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.929589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894670311903029:2517], now have 1 active actors on pipe
2025-09-30T14:50:19.929902Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:19.930521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:19.930581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894670311903029:2517]
2025-09-30T14:50:19.930612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:19.931176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0f36d0-76bafd28-6d1ce8b9-c8f14957_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:19.931191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0f36d0-76bafd28-6d1ce8b9-c8f14957_0] Write session will restart in 0.009045s
2025-09-30T14:50:19.931223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0f36d0-76bafd28-6d1ce8b9-c8f14957_0] Write session: Do CDS request
2025-09-30T14:50:19.931228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0f36d0-76bafd28-6d1ce8b9-c8f14957_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:19.930684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 9 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b0f36d0-76bafd28-6d1ce8b9-c8f14957_0
2025-09-30T14:50:19.930881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 9 sessionId: src_id|b0f36d0-76bafd28-6d1ce8b9-c8f14957_0 is DEAD
2025-09-30T14:50:19.939566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:19.940750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:19.940990Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:19.940994Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:19.941002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:19.941059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:19.941098Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894670222180843:2474]
2025-09-30T14:50:19.941745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:19.943163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0f36d0-76bafd28-6d1ce8b9-c8f14957_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:19.942525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:19.942569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:19.942948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:19.943024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:19.943025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:19.943026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:19.943026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:19.943027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:19.943028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:19.943029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:19.943030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:19.943031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:19.943032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:19.943033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.943034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.943035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.943036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:19.943037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:19.943041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:19.943049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:19.943051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:19.943054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:19.943056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:19.943059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:19.943061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:19.943064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:19.943067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:19.943072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:19.943079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.943084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.943087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.943091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:19.943094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:19.943102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:19.943111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:19.943118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:19.943124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:19.943129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:19.943135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:19.943139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:19.943145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:19.943150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:19.943156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:19.943160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:19.943166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:19.943171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:19.943178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:19.943182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:19.943187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:19.943192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:19.943198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:19.943203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:19.943208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:19.943214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.943219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.943223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.943227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.943234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.943240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.943262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:19.943266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:19.943271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:19.943276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:19.943325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:19.944154Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:19.944169Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 10
2025-09-30T14:50:19.944335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:19.944368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 10 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:19.944375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=10 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:19.944380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:19.944890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 10 sessionId:  describe result for acl check
2025-09-30T14:50:19.944928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:19.944930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:19.944932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:19.944938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894670311903092:2568] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:19.945515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894670311903092:2568] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:19.947754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894670311903092:2568] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:19.950657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:19.951691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:19.951698Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:19.951701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:19.951706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:19.951715Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 9 [2:7555894670222180843:2474]
2025-09-30T14:50:19.951734Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:19.951752Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:19.951756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.951759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.951762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.951779Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:19.951790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:19.951797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:19.951870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.951873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.951875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.951878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:19.951884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:19.951958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:19.951961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.951975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:19.951987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:19.952003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:19.952019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894670222180836:2474]
2025-09-30T14:50:19.952021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894670222180836:2474]
2025-09-30T14:50:19.952023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894670222180836:2474]
2025-09-30T14:50:19.952051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:19.952064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:19.952066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894670311903055:2454], now have 1 active actors on pipe
2025-09-30T14:50:19.952067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:19.952069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:19.952074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:19.952089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:19.952093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:19.952131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894670222180836:2474]
2025-09-30T14:50:19.952138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:19.952143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:19.952293Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 9
2025-09-30T14:50:19.953071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894670311903092:2568] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:19.953080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894670311903092:2568] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:19.953083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894670311903092:2568] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:19.953089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 10 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:19.955552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894670311903126:2568], now have 1 active actors on pipe
2025-09-30T14:50:19.955860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 9
2025-09-30T14:50:19.956124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.956144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.956171Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d4a2ff8-a8a9943c-188fdd95-24b50487_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:19.956188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.956201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.956204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:19.956219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.956239Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:19.956280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:19.960082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.960106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.960154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:19.960298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 10 partition: 0 MaxSeqNo: 42 sessionId: src_id|9d4a2ff8-a8a9943c-188fdd95-24b50487_0
2025-09-30T14:50:19.960707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0f36d0-76bafd28-6d1ce8b9-c8f14957_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9d4a2ff8-a8a9943c-188fdd95-24b50487_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:19.973193Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:19.973217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:19.973220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:19.973222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:19.973237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894670222180836:2474]
2025-09-30T14:50:19.973241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894670222180836:2474]
2025-09-30T14:50:19.973244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894670222180836:2474]
2025-09-30T14:50:19.973298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:19.973308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:19.973314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:19.973316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:19.973325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:19.973330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:19.973487Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:19.976297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d4a2ff8-a8a9943c-188fdd95-24b50487_0] Write session: try to update token
2025-09-30T14:50:19.976315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d4a2ff8-a8a9943c-188fdd95-24b50487_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:20.005158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId: src_id|9d4a2ff8-a8a9943c-188fdd95-24b50487_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:20.008387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:20.030686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894674606870430:2517]
2025-09-30T14:50:20.031033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 9, pipe: [1:7555894674606870430:2517]
2025-09-30T14:50:20.101652Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:20.102004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:20.102016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:20.102041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894674606870430:2517], now have 1 active actors on pipe
2025-09-30T14:50:20.102349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894674606870430:2517]
2025-09-30T14:50:20.102389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:20.102393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:20.102469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 10 reason: error at write: Disconnected sessionId: src_id|9d4a2ff8-a8a9943c-188fdd95-24b50487_0
2025-09-30T14:50:20.102318Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:20.102586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:20.102639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 10 sessionId: src_id|9d4a2ff8-a8a9943c-188fdd95-24b50487_0 is DEAD
2025-09-30T14:50:20.103076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d4a2ff8-a8a9943c-188fdd95-24b50487_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:20.103088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d4a2ff8-a8a9943c-188fdd95-24b50487_0] Write session will restart in 0.009474s
2025-09-30T14:50:20.103119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d4a2ff8-a8a9943c-188fdd95-24b50487_0] Write session: Do CDS request
2025-09-30T14:50:20.103130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d4a2ff8-a8a9943c-188fdd95-24b50487_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:20.113931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d4a2ff8-a8a9943c-188fdd95-24b50487_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:20.114157Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:20.114171Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 11
2025-09-30T14:50:20.115340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 11 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:20.115404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 11 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:20.115415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=11 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:20.115420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:20.115881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 11 sessionId:  describe result for acl check
2025-09-30T14:50:20.115915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:20.115922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:20.115924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:20.115930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894674606870456:2572] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:20.116472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894674606870456:2572] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:20.117615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:20.118296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:20.118500Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:20.118507Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:20.118519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:20.118567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:20.118610Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894674517148208:2478]
2025-09-30T14:50:20.119277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894674606870456:2572] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:20.119319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:20.119648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:20.119701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:20.120094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:20.120155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:20.120161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:20.120162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:20.120164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:20.120166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:20.120167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:20.120169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:20.120170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:20.120172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:20.120173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:20.120174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.120175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:20.120179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:20.120180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:20.120181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:20.120187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:20.120199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:20.120204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:20.120208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:20.120212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:20.120216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:20.120220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:20.120225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:20.120229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:20.120234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:20.120238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.120241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:20.120245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:20.120250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:20.120254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:20.120262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:20.120272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:20.120278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:20.120284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:20.120289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:20.120298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:20.120304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:20.120316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:20.120323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:20.120334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:20.120338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:20.120344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:20.120351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:20.120357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:20.120361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:20.120367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:20.120371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:20.120377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:20.120381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:20.120386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:20.120391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.120396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.120400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:20.120405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:20.120409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:20.120415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:20.120420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:20.120426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:20.120430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:20.120436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:20.120486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:20.127968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894674606870456:2572] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:20.127987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894674606870456:2572] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:20.127991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894674606870456:2572] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:20.128002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 11 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:20.128277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:20.129249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:20.129273Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:20.129276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:20.129280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:20.129288Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 10 [2:7555894674517148208:2478]
2025-09-30T14:50:20.129308Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:20.129324Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:20.129327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.129331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.129334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.129352Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:20.129363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:20.129373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:20.129440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.129442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:20.129443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:20.129447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:20.129450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:20.129528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:20.129533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.129545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:20.129557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:20.129574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:20.129593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894674606870432:2454], now have 1 active actors on pipe
2025-09-30T14:50:20.129596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894674606870496:2572], now have 1 active actors on pipe
2025-09-30T14:50:20.129603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894674517148203:2478]
2025-09-30T14:50:20.129605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894674517148203:2478]
2025-09-30T14:50:20.129607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894674517148203:2478]
2025-09-30T14:50:20.129620Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:20.129636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:20.129650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:20.129653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:20.129658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:20.129663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:20.129666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:20.129691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894674517148203:2478]
2025-09-30T14:50:20.129695Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:20.129711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:20.129698Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 10
2025-09-30T14:50:20.129702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 10
2025-09-30T14:50:20.129734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:20.129739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:20.129767Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|799af875-779f0cec-7179614d-911a280c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:20.129776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.129780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.129782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:20.129791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.129801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:20.129816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:20.130202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:20.130213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:20.130229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:20.130839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d4a2ff8-a8a9943c-188fdd95-24b50487_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|799af875-779f0cec-7179614d-911a280c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:20.130422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 11 partition: 0 MaxSeqNo: 42 sessionId: src_id|799af875-779f0cec-7179614d-911a280c_0
2025-09-30T14:50:20.133756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|799af875-779f0cec-7179614d-911a280c_0] Write session: try to update token
2025-09-30T14:50:20.133776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|799af875-779f0cec-7179614d-911a280c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:20.158696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 11 sessionId: src_id|799af875-779f0cec-7179614d-911a280c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:20.160513Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:20.160532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:20.160541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894674517148203:2478]
2025-09-30T14:50:20.160585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:20.160801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:20.161002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:20.161240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:20.161396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:20.161629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:20.161668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:20.161750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:20.188030Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:20.188055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:20.188058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:20.188060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:20.188075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894674517148203:2478]
2025-09-30T14:50:20.188079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894674517148203:2478]
2025-09-30T14:50:20.188083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894674517148203:2478]
2025-09-30T14:50:20.188140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:20.188144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:20.188148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.188152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:20.188152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:20.188157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:20.188325Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:20.188606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:20.200636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894674606870504:2517]
2025-09-30T14:50:20.200972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 10, pipe: [1:7555894674606870504:2517]
2025-09-30T14:50:20.332161Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:20.332522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:20.332541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:20.332570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894674606870504:2517], now have 1 active actors on pipe
2025-09-30T14:50:20.332819Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:20.332838Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:20.332852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894674606870504:2517]
2025-09-30T14:50:20.332906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:20.332916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:20.333012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 11 reason: error at write: Disconnected sessionId: src_id|799af875-779f0cec-7179614d-911a280c_0
2025-09-30T14:50:20.333269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 11 sessionId: src_id|799af875-779f0cec-7179614d-911a280c_0 is DEAD
2025-09-30T14:50:20.334369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|799af875-779f0cec-7179614d-911a280c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:20.334382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|799af875-779f0cec-7179614d-911a280c_0] Write session will restart in 0.009324s
2025-09-30T14:50:20.334412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|799af875-779f0cec-7179614d-911a280c_0] Write session: Do CDS request
2025-09-30T14:50:20.334423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|799af875-779f0cec-7179614d-911a280c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:20.342533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:20.343086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:20.343334Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:20.343346Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:20.343359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:20.343422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:20.343464Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894674517148273:2480]
2025-09-30T14:50:20.344169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:20.344616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:20.344694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:20.344855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|799af875-779f0cec-7179614d-911a280c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:20.344962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:20.344980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 12
2025-09-30T14:50:20.345149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:20.345220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:20.345207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 12 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:20.345227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:20.345228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:20.345229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:20.345231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:20.345232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:20.345234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:20.345256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 12 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:20.345235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:20.345267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=12 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:20.345236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:20.345238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:20.345272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:20.345239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.345241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:20.345242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:20.345243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:20.345245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:20.345253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:20.345265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:20.345270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:20.345277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:20.345281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:20.345285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:20.345289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:20.345294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:20.345298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:20.345303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:20.345308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.345313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:20.345329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:20.345333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:20.345339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:20.345347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:20.345357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:20.345365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:20.345371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:20.345376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:20.345382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:20.345387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:20.345404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:20.345412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:20.345425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:20.345430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:20.345442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:20.345452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:20.345459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:20.345469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:20.345476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:20.345486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:20.345492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:20.345501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:20.345508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:20.345520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.345528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.345532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:20.345539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:20.345543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:20.345549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:20.345554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:20.345560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:20.345572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:20.345578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:20.345633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:20.345773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 12 sessionId:  describe result for acl check
2025-09-30T14:50:20.345811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:20.345818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:20.345820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:20.345827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894674606870536:2576] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:20.346514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894674606870536:2576] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:20.349051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894674606870536:2576] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:20.352279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894674606870536:2576] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:20.352298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894674606870536:2576] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:20.352302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894674606870536:2576] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:20.352315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 12 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:20.352331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:20.353456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:20.353476Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:20.353479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:20.353483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:20.353491Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 11 [2:7555894674517148273:2480]
2025-09-30T14:50:20.353509Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:20.353529Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:20.353539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.353542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.353545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.353565Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:20.353573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:20.353588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:20.353679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.353690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:20.353692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:20.353697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:20.353700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:20.353781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:20.353789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.353804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:20.353820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:20.353843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:20.353873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894674606870506:2454], now have 1 active actors on pipe
2025-09-30T14:50:20.353882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894674606870572:2576], now have 1 active actors on pipe
2025-09-30T14:50:20.353891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894674517148268:2480]
2025-09-30T14:50:20.353898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894674517148268:2480]
2025-09-30T14:50:20.353901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894674517148268:2480]
2025-09-30T14:50:20.353915Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:20.353934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:20.353945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:20.353955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:20.353956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:20.353958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:20.353959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:20.354003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894674517148268:2480]
2025-09-30T14:50:20.354018Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:20.354024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:20.354030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 11
2025-09-30T14:50:20.354080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 11
2025-09-30T14:50:20.354147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:20.354163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:20.354200Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6890709-9db65ca1-701e53ab-5c1138a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:20.354218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.354223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.354225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:20.354240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.354254Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:20.354280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:20.354467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:20.354475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:20.354494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:20.354587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 12 partition: 0 MaxSeqNo: 42 sessionId: src_id|6890709-9db65ca1-701e53ab-5c1138a_0
2025-09-30T14:50:20.355064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|799af875-779f0cec-7179614d-911a280c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6890709-9db65ca1-701e53ab-5c1138a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:20.358255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6890709-9db65ca1-701e53ab-5c1138a_0] Write session: try to update token
2025-09-30T14:50:20.358280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6890709-9db65ca1-701e53ab-5c1138a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:20.374609Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:20.374633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:20.374635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:20.374637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:20.374644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894674517148268:2480]
2025-09-30T14:50:20.374647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894674517148268:2480]
2025-09-30T14:50:20.374650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894674517148268:2480]
2025-09-30T14:50:20.374686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:20.374694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.374697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:20.374705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:20.374712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:20.374716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:20.374871Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:20.380587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 12 sessionId: src_id|6890709-9db65ca1-701e53ab-5c1138a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:20.383992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:20.433085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894674606870582:2517]
2025-09-30T14:50:20.433571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 11, pipe: [1:7555894674606870582:2517]
2025-09-30T14:50:20.500972Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:20.501271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:20.501286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:20.501339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894674606870582:2517], now have 1 active actors on pipe
2025-09-30T14:50:20.501584Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:20.502547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6890709-9db65ca1-701e53ab-5c1138a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:20.502562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6890709-9db65ca1-701e53ab-5c1138a_0] Write session will restart in 0.007303s
2025-09-30T14:50:20.502588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6890709-9db65ca1-701e53ab-5c1138a_0] Write session: Do CDS request
2025-09-30T14:50:20.502595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6890709-9db65ca1-701e53ab-5c1138a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:20.501648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894674606870582:2517]
2025-09-30T14:50:20.501689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:20.501781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 12 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6890709-9db65ca1-701e53ab-5c1138a_0
2025-09-30T14:50:20.501818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:20.502030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 12 sessionId: src_id|6890709-9db65ca1-701e53ab-5c1138a_0 is DEAD
2025-09-30T14:50:20.511041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6890709-9db65ca1-701e53ab-5c1138a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:20.512627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:20.513282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:20.513609Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:20.513633Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:20.513648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:20.513725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:20.513773Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894674517148342:2483]
2025-09-30T14:50:20.514476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:20.515051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:20.515113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:20.512019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:20.512036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 13
2025-09-30T14:50:20.512271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 13 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:20.512312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 13 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:20.512318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=13 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:20.512325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:20.512841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 13 sessionId:  describe result for acl check
2025-09-30T14:50:20.512873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:20.512876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:20.512878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:20.512885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894674606870611:2581] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:20.513494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894674606870611:2581] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:20.515559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:20.515649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:20.515658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:20.515659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:20.515662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:20.515663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:20.515665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:20.515666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:20.515667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:20.515668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:20.515669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:20.515670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.515671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:20.515672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:20.515674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:20.515675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:20.515682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:20.515692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:20.515696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:20.515700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:20.515703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:20.515707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:20.515710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:20.515714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:20.515717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:20.515722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:20.515726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.515731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:20.515735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:20.515739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:20.515742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:20.515750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:20.515757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:20.515764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:20.515771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:20.515777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:20.515782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:20.515786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:20.515792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:20.515797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:20.515802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:20.515806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:20.515811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:20.515816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:20.515822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:20.515827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:20.515832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:20.515836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:20.515842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:20.515847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:20.515859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:20.515864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.515869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.515873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:20.515879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:20.515884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:20.515889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:20.515894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:20.515900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:20.515905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:20.515909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:20.515960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:20.516593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894674606870611:2581] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:20.528287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894674606870611:2581] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:20.528314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894674606870611:2581] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:20.528319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894674606870611:2581] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:20.528332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 13 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:20.528954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:20.529890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:20.529913Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:20.529917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:20.529921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:20.529929Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 12 [2:7555894674517148342:2483]
2025-09-30T14:50:20.529954Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:20.529972Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:20.529980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.529983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.529986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.530003Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:20.530009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:20.530018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:20.530093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.530103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:20.530106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:20.530110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:20.530113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:20.530186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:20.530195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.530212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:20.530225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:20.530249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:20.530275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894674606870583:2454], now have 1 active actors on pipe
2025-09-30T14:50:20.530284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894674606870650:2581], now have 1 active actors on pipe
2025-09-30T14:50:20.530291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894674517148337:2483]
2025-09-30T14:50:20.530293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894674517148337:2483]
2025-09-30T14:50:20.530295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894674517148337:2483]
2025-09-30T14:50:20.530310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:20.530330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:20.530332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:20.530338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:20.530341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:20.530351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:20.530359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:20.530349Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 12
2025-09-30T14:50:20.530371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 12
2025-09-30T14:50:20.530398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894674517148337:2483]
2025-09-30T14:50:20.530410Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:20.530440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:20.530584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:20.530589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:20.530616Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24408010-34133097-597ccccb-18c0a78b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:20.530624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.530628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.530631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:20.530642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.530658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:20.530677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:20.530867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:20.530876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:20.530895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:20.531010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 13 partition: 0 MaxSeqNo: 42 sessionId: src_id|24408010-34133097-597ccccb-18c0a78b_0
2025-09-30T14:50:20.531502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6890709-9db65ca1-701e53ab-5c1138a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|24408010-34133097-597ccccb-18c0a78b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:20.534687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24408010-34133097-597ccccb-18c0a78b_0] Write session: try to update token
2025-09-30T14:50:20.534711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24408010-34133097-597ccccb-18c0a78b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:20.556068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 13 sessionId: src_id|24408010-34133097-597ccccb-18c0a78b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:20.559528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:20.559918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:20.559946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:20.559993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:20.560103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:20.576475Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:20.576499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:20.576510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894674517148337:2483]
2025-09-30T14:50:20.576560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:20.576583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:20.576749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:20.576919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:20.577116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:20.577273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:20.577484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:20.577529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:20.602144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894674606870658:2517]
2025-09-30T14:50:20.602605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 12, pipe: [1:7555894674606870658:2517]
2025-09-30T14:50:20.602125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:20.602154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:20.602367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:20.602432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:20.602502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:20.602570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:20.602623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:20.602628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:20.602706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:20.602786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:20.602850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:20.602944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:20.602990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:20.602997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:20.603109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:20.603591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:20.603671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:20.603738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:20.603881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:20.603885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:20.603960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:20.604026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:20.604268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:20.604482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:20.604627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:20.604632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:20.604709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:20.604772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:20.604843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:20.604911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:20.604955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:20.604957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:20.605034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:20.605095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:20.605157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:20.605220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:20.605284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:20.605288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:20.605359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:20.605415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:20.605480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:20.605539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:20.605733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:20.605736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:20.605812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:20.605882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:20.605949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:20.606016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:20.606086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:20.606088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:20.606160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:20.606218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:20.606278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:20.606340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:20.606399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:20.606402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:20.606471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:20.606534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:20.606594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:20.606658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:20.606705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:20.606708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:20.606835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894674606870658:2517], now have 1 active actors on pipe
2025-09-30T14:50:20.606846Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:20.606914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.606938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.606942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-09-30T14:50:20.606976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-09-30T14:50:20.606992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 1
2025-09-30T14:50:20.606995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 2
2025-09-30T14:50:20.606999Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 3
2025-09-30T14:50:20.607001Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 4
2025-09-30T14:50:20.608741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 4 FormedBlobsCount 0 NewHead: Offset 42 PartNo 0 PackedSize 2253230 count 1 nextOffset 43 batches 5
2025-09-30T14:50:20.608783Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-09-30T14:50:20.608794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 1
2025-09-30T14:50:20.608801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 2
2025-09-30T14:50:20.608805Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 3
2025-09-30T14:50:20.608808Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 4
2025-09-30T14:50:20.609416Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 4 FormedBlobsCount 0 NewHead: Offset 42 PartNo 0 PackedSize 4506428 count 2 nextOffset 44 batches 9
2025-09-30T14:50:20.609433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-09-30T14:50:20.609441Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 1
2025-09-30T14:50:20.609445Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 2
2025-09-30T14:50:20.609449Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 3
2025-09-30T14:50:20.609453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 4
2025-09-30T14:50:20.609943Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 4 FormedBlobsCount 0 NewHead: Offset 42 PartNo 0 PackedSize 6759626 count 3 nextOffset 45 batches 13
2025-09-30T14:50:20.609957Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-09-30T14:50:20.609964Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-09-30T14:50:20.609969Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-09-30T14:50:20.609972Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-09-30T14:50:20.611747Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 46 partNo 3 result is x0000000000_00000000000000000042_00000_0000000003_00015? size 8295638
2025-09-30T14:50:20.611768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-09-30T14:50:20.611784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000042_00000_0000000003_00015? new key d0000000000_00000000000000000042_00000_0000000003_00015? size 8295638 WTime 1759243820611
2025-09-30T14:50:20.612490Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 1 NewHead: Offset 45 PartNo 3 PackedSize 717145 count 1 nextOffset 46 batches 2
2025-09-30T14:50:20.612503Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-09-30T14:50:20.612512Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-09-30T14:50:20.612516Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-09-30T14:50:20.612521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-09-30T14:50:20.612525Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-09-30T14:50:20.613037Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 3 PackedSize 2970343 count 2 nextOffset 47 batches 6
2025-09-30T14:50:20.613051Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-09-30T14:50:20.613058Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-09-30T14:50:20.613061Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-09-30T14:50:20.613065Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-09-30T14:50:20.613068Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-09-30T14:50:20.613592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 3 PackedSize 5223541 count 3 nextOffset 48 batches 10
2025-09-30T14:50:20.613606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 0
2025-09-30T14:50:20.613613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 1
2025-09-30T14:50:20.613617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 2
2025-09-30T14:50:20.613621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 3
2025-09-30T14:50:20.613626Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 4
2025-09-30T14:50:20.614141Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 49 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 3 PackedSize 7476739 count 4 nextOffset 49 batches 14
2025-09-30T14:50:20.614157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 0
2025-09-30T14:50:20.614163Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 1
2025-09-30T14:50:20.615814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 50 partNo 1 result is x0000000000_00000000000000000045_00003_0000000004_00014? size 7988760
2025-09-30T14:50:20.615831Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 2
2025-09-30T14:50:20.615836Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 3
2025-09-30T14:50:20.615840Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 4
2025-09-30T14:50:20.615851Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000045_00003_0000000004_00014? new key d0000000000_00000000000000000045_00003_0000000004_00014? size 7988760 WTime 1759243820615
2025-09-30T14:50:20.616403Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 50 partNo 4 FormedBlobsCount 1 NewHead: Offset 49 PartNo 1 PackedSize 1741199 count 1 nextOffset 50 batches 4
2025-09-30T14:50:20.616417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 0
2025-09-30T14:50:20.616423Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 1
2025-09-30T14:50:20.616427Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 2
2025-09-30T14:50:20.616432Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 3
2025-09-30T14:50:20.616436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 4
2025-09-30T14:50:20.616933Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 51 partNo 4 FormedBlobsCount 0 NewHead: Offset 49 PartNo 1 PackedSize 3994397 count 2 nextOffset 51 batches 8
2025-09-30T14:50:20.616944Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 52 partNo 0
2025-09-30T14:50:20.616954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 52 partNo 1
2025-09-30T14:50:20.616959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 52 partNo 2
2025-09-30T14:50:20.616963Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 52 partNo 3
2025-09-30T14:50:20.616967Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 52 partNo 4
2025-09-30T14:50:20.617552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 52 partNo 4 FormedBlobsCount 0 NewHead: Offset 49 PartNo 1 PackedSize 6247595 count 3 nextOffset 52 batches 12
2025-09-30T14:50:20.617562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.617686Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 49,3 HeadOffset 42 endOffset 42 curOffset 52 d0000000000_00000000000000000049_00001_0000000003_00011? size 6247585 WTime 1759243820617
2025-09-30T14:50:20.623587Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:20.623625Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 42 partNo 0 count 3 size 8295638
2025-09-30T14:50:20.623634Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 45 partNo 3 count 4 size 7988760
2025-09-30T14:50:20.623643Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 49 partNo 1 count 3 size 6247585
2025-09-30T14:50:20.623659Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:20.623662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:20.623665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:20.623667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:20.623675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894674517148337:2483]
2025-09-30T14:50:20.623680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894674517148337:2483]
2025-09-30T14:50:20.623684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894674517148337:2483]
2025-09-30T14:50:20.623764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:20.623770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.623772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:20.623916Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:20.627478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:20.627491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:20.627496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:20.764706Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:20.765417Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:20.765486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:20.765513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:20.765545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894674606870658:2517]
2025-09-30T14:50:20.765571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 13 reason: status is not ok: tablet will be restarted right now sessionId: src_id|24408010-34133097-597ccccb-18c0a78b_0
2025-09-30T14:50:20.765921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 13 sessionId: src_id|24408010-34133097-597ccccb-18c0a78b_0 is DEAD
2025-09-30T14:50:20.766128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24408010-34133097-597ccccb-18c0a78b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:20.766139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24408010-34133097-597ccccb-18c0a78b_0] Write session will restart in 0.006088s
2025-09-30T14:50:20.766162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24408010-34133097-597ccccb-18c0a78b_0] Write session: Do CDS request
2025-09-30T14:50:20.766168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24408010-34133097-597ccccb-18c0a78b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:20.773496Z node 2 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [f9b1ba1ed996401c] Result# TEvPutResult {Id# [72075186224037892:12:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-09-30T14:50:20.773828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24408010-34133097-597ccccb-18c0a78b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:20.773785Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:12:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-09-30T14:50:20.773912Z node 2 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [d8053477538d80df] Result# TEvPutResult {Id# [72075186224037892:12:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-09-30T14:50:20.773961Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:12:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-09-30T14:50:20.774059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:20.774073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 14
2025-09-30T14:50:20.774219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 14 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:20.774254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 14 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:20.774266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=14 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:20.774270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:20.774713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 14 sessionId:  describe result for acl check
2025-09-30T14:50:20.774759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:20.774761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:20.774763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:20.774769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894674606870695:2586] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:20.775323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894674606870695:2586] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:20.777178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:20.777708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:20.777794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894674606870695:2586] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:20.777950Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:20.777960Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:20.777970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:20.778027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:20.778080Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894674517148429:2486]
2025-09-30T14:50:20.778763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:20.779159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:20.779213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:20.779627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:20.779709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:20.779717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:20.779718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:20.779719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:20.779720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:20.779721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:20.779723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:20.779724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:20.779726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:20.779727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:20.779728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.779729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:20.779731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:20.779732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:20.779733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:20.779740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:20.779751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:20.779756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:20.779761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:20.779766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:20.779770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:20.779775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:20.779782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:20.779786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:20.779791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:20.779796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.779801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:20.779806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:20.779811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:20.779816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:20.779823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:20.779831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:20.779836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:20.779842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:20.779847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:20.779853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:20.779858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:20.779864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:20.779871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:20.779877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:20.779881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:20.779887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:20.779892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:20.779898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:20.779903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:20.779923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:20.779929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:20.779934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:20.779940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:20.779945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:20.779949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.779955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.779959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:20.779965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:20.779969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:20.779974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:20.779977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:20.779982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:20.779989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:20.779994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:20.780048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:20.780785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894674606870695:2586] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:20.780799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894674606870695:2586] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:20.780804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894674606870695:2586] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:20.780813Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 14 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:20.787865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:20.788947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:20.788966Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:20.788970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:20.788974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:20.788983Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 13 [2:7555894674517148429:2486]
2025-09-30T14:50:20.788999Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:20.789017Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:20.789020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.789024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.789027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.789046Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:20.789058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:20.789065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:20.789136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.789149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:20.789151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:20.789155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:20.789158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:20.789240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:20.789248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.789263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:20.789280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:20.789296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:20.789313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894674517148423:2486]
2025-09-30T14:50:20.789315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894674517148423:2486]
2025-09-30T14:50:20.789317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894674517148423:2486]
2025-09-30T14:50:20.789332Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:20.789349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:20.789364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:20.789369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:20.789449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894674517148423:2486]
2025-09-30T14:50:20.789461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:20.789801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:20.789822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:20.789825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:20.789832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:20.789914Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 13
2025-09-30T14:50:20.789975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 13
2025-09-30T14:50:20.790083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894674606870673:2454], now have 1 active actors on pipe
2025-09-30T14:50:20.790096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894674606870742:2586], now have 1 active actors on pipe
2025-09-30T14:50:20.790237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:20.790248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:20.790273Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e2d5d1a-e9006553-3a0474f1-743a0f93_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:20.790288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.790292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.790295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:20.790307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.790319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:20.790342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:20.790614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:20.790625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:20.790641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:20.790786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 14 partition: 0 MaxSeqNo: 42 sessionId: src_id|5e2d5d1a-e9006553-3a0474f1-743a0f93_0
2025-09-30T14:50:20.792196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24408010-34133097-597ccccb-18c0a78b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5e2d5d1a-e9006553-3a0474f1-743a0f93_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:20.795040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e2d5d1a-e9006553-3a0474f1-743a0f93_0] Write session: try to update token
2025-09-30T14:50:20.795062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e2d5d1a-e9006553-3a0474f1-743a0f93_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:20.809863Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:20.809888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:20.809915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894674517148423:2486]
2025-09-30T14:50:20.809966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:20.809980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:20.810156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:20.810306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:20.810452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:20.810606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:20.810834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:20.810884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:20.817550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 14 sessionId: src_id|5e2d5d1a-e9006553-3a0474f1-743a0f93_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:20.821043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:20.821331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:20.821360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:20.821401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:20.821580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:20.824357Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:20.824375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:20.824378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:20.824381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:20.824392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894674517148423:2486]
2025-09-30T14:50:20.824397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894674517148423:2486]
2025-09-30T14:50:20.824401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894674517148423:2486]
2025-09-30T14:50:20.824443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:20.824451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.824457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:20.824457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:20.824466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:20.824470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:20.824617Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:20.867519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894674606870750:2517]
2025-09-30T14:50:20.867885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 13, pipe: [1:7555894674606870750:2517]
2025-09-30T14:50:20.945182Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:20.954587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:20.954618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:20.954823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:20.954894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:20.954975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:20.955045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:20.955108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:20.955119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:20.955198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:20.955306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:20.955430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:20.955502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:20.955557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:20.955563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:20.955646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:20.955726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:20.955802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:20.955880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:20.955929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:20.955935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:20.956013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:20.956084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:20.956152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:20.956222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:20.956270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:20.956276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:20.956366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:20.956432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:20.956501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:20.956570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:20.956624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:20.956632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:20.956706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:20.956776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:20.956851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:20.956927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:20.956978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:20.956985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:20.957065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:20.957274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:20.957357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:20.957433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:20.957487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:20.957494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:20.957573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:20.957642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:20.957718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:20.957795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:20.957874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:20.957883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:20.957958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:20.958025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:20.958095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:20.958175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:20.958225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:20.958231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:20.958306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:20.958385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:20.958469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:20.958554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:20.958606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:20.958609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:20.958692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894674606870750:2517], now have 1 active actors on pipe
2025-09-30T14:50:20.958933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:20.958993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894674606870750:2517]
2025-09-30T14:50:20.959017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:20.959020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:20.959047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 14 reason: error at write: Disconnected sessionId: src_id|5e2d5d1a-e9006553-3a0474f1-743a0f93_0
2025-09-30T14:50:20.959241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 14 sessionId: src_id|5e2d5d1a-e9006553-3a0474f1-743a0f93_0 is DEAD
2025-09-30T14:50:20.959412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e2d5d1a-e9006553-3a0474f1-743a0f93_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:20.959425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e2d5d1a-e9006553-3a0474f1-743a0f93_0] Write session will restart in 0.006053s
2025-09-30T14:50:20.959450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e2d5d1a-e9006553-3a0474f1-743a0f93_0] Write session: Do CDS request
2025-09-30T14:50:20.959457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e2d5d1a-e9006553-3a0474f1-743a0f93_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:20.959613Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:20.966848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e2d5d1a-e9006553-3a0474f1-743a0f93_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:20.966998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:20.967015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 15
2025-09-30T14:50:20.967135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 15 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:20.967189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 15 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:20.967201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=15 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:20.967205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:20.967617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 15 sessionId:  describe result for acl check
2025-09-30T14:50:20.967671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:20.967679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:20.967681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:20.967686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894674606870807:2598] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:20.967941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:20.968238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894674606870807:2598] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:20.968438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:20.968656Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:20.968667Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:20.968677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:20.968750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:20.968792Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894674517148531:2500]
2025-09-30T14:50:20.969389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:20.969737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:20.969817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:20.970201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:20.970265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:20.970271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:20.970272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:20.970273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:20.970274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:20.970275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:20.970276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:20.970277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:20.970278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:20.970279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:20.970280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.970282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:20.970282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:20.970283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:20.970284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:20.970290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:20.970299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:20.970303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:20.970307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:20.970311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:20.970315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:20.970319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:20.970323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:20.970327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:20.970331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:20.970344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.970348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:20.970352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:20.970356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:20.970360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:20.970367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:20.970376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:20.970382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:20.970387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:20.970407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:20.970418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:20.970422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:20.970427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:20.970436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:20.970442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:20.970451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:20.970456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:20.970460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:20.970465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:20.970470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:20.970475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:20.970480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:20.970485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:20.970489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:20.970495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:20.970500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.970510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.970514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:20.970520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:20.970524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:20.970534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:20.970546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:20.970556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:20.970560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:20.970567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:20.970615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:20.970812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894674606870807:2598] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:20.976366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894674606870807:2598] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:20.976382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894674606870807:2598] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:20.976386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894674606870807:2598] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:20.976394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 15 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:20.976713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:20.977633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:20.977647Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:20.977650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:20.977654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:20.977661Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 14 [2:7555894674517148531:2500]
2025-09-30T14:50:20.977678Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:20.977694Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:20.977698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.977701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.977704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.977720Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:20.977732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:20.977738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:20.977800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.977807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:20.977808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:20.977811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:20.977813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:20.977881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:20.977888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.977902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:20.977918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:20.977938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:20.977961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894674606870843:2598], now have 1 active actors on pipe
2025-09-30T14:50:20.977969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894674606870778:2454], now have 1 active actors on pipe
2025-09-30T14:50:20.977975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894674517148526:2500]
2025-09-30T14:50:20.977978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894674517148526:2500]
2025-09-30T14:50:20.977980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894674517148526:2500]
2025-09-30T14:50:20.977994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:20.977988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 14
2025-09-30T14:50:20.978010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:20.978029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 14
2025-09-30T14:50:20.978011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:20.978014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:20.978017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:20.978025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:20.978029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:20.978070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:20.978080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:20.978091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894674517148526:2500]
2025-09-30T14:50:20.978102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:20.978119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:20.978134Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff362d34-50ab5f7e-d3f4b1e4-7d33beec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:20.978144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.978147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.978149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:20.978159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.978171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:20.978198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:20.978329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:20.978335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:20.978348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:20.978409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 15 partition: 0 MaxSeqNo: 42 sessionId: src_id|ff362d34-50ab5f7e-d3f4b1e4-7d33beec_0
2025-09-30T14:50:20.978757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e2d5d1a-e9006553-3a0474f1-743a0f93_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ff362d34-50ab5f7e-d3f4b1e4-7d33beec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:20.981461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff362d34-50ab5f7e-d3f4b1e4-7d33beec_0] Write session: try to update token
2025-09-30T14:50:20.981473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff362d34-50ab5f7e-d3f4b1e4-7d33beec_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:20.991480Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:20.991495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:20.991498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:20.991500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:20.991510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894674517148526:2500]
2025-09-30T14:50:20.991513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894674517148526:2500]
2025-09-30T14:50:20.991518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894674517148526:2500]
2025-09-30T14:50:20.991558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:20.991566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:20.991570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:20.991584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:20.991590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:20.991594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:20.991719Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:20.999796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 15 sessionId: src_id|ff362d34-50ab5f7e-d3f4b1e4-7d33beec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:21.002937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:21.059365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894678901838163:2517]
2025-09-30T14:50:21.059738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 14, pipe: [1:7555894678901838163:2517]
2025-09-30T14:50:21.101858Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:21.102333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:21.102347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:21.102368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894678901838163:2517], now have 1 active actors on pipe
2025-09-30T14:50:21.102592Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:21.102649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:21.102666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:21.102668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894678901838163:2517]
2025-09-30T14:50:21.102689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:21.102763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 15 reason: error at write: Disconnected sessionId: src_id|ff362d34-50ab5f7e-d3f4b1e4-7d33beec_0
2025-09-30T14:50:21.102989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 15 sessionId: src_id|ff362d34-50ab5f7e-d3f4b1e4-7d33beec_0 is DEAD
2025-09-30T14:50:21.103230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff362d34-50ab5f7e-d3f4b1e4-7d33beec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:21.103265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff362d34-50ab5f7e-d3f4b1e4-7d33beec_0] Write session will restart in 0.006021s
2025-09-30T14:50:21.103297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff362d34-50ab5f7e-d3f4b1e4-7d33beec_0] Write session: Do CDS request
2025-09-30T14:50:21.103308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff362d34-50ab5f7e-d3f4b1e4-7d33beec_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:21.110765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff362d34-50ab5f7e-d3f4b1e4-7d33beec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:21.111549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:21.112026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:21.112043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 16
2025-09-30T14:50:21.112194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 16 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:21.112230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 16 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:21.112242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=16 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:21.112247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:21.112744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 16 sessionId:  describe result for acl check
2025-09-30T14:50:21.112775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:21.112782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:21.112783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:21.112798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894678901838197:2603] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:21.112258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:21.112475Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:21.112479Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:21.112489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:21.112551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:21.112597Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894678812115904:2504]
2025-09-30T14:50:21.113289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:21.113369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894678901838197:2603] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:21.113615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:21.113681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:21.114080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:21.114169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:21.114177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:21.114178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:21.114179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:21.114180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:21.114181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:21.114183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:21.114184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:21.114185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:21.114187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:21.114188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.114189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.114191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.114192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:21.114193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:21.114200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:21.114210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:21.114214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:21.114217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:21.114221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:21.114225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:21.114229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:21.114233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:21.114237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:21.114242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:21.114246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.114250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.114254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.114258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:21.114263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:21.114272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:21.114280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:21.114286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:21.114306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:21.114316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:21.114322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:21.114330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:21.114335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:21.114344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:21.114350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:21.114360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:21.114369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:21.114374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:21.114384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:21.114389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:21.114398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:21.114404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:21.114414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:21.114420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:21.114425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:21.114435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.114440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.114448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.114453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.114458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.114468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.114472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:21.114482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:21.114487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:21.114496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:21.114543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:21.116266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894678901838197:2603] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:21.120730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894678901838197:2603] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:21.120748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894678901838197:2603] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:21.120752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894678901838197:2603] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:21.120761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 16 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:21.121107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:21.122064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:21.122086Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:21.122089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:21.122094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:21.122102Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 15 [2:7555894678812115904:2504]
2025-09-30T14:50:21.122124Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:21.122140Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:21.122144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.122147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.122150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.122167Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:21.122174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:21.122183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:21.122271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.122279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.122282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.122286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:21.122288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:21.122364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:21.122372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.122387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.122399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.122416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:21.122529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 15
2025-09-30T14:50:21.122440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894678901838236:2603], now have 1 active actors on pipe
2025-09-30T14:50:21.122445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894678901838166:2454], now have 1 active actors on pipe
2025-09-30T14:50:21.122451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894678812115899:2504]
2025-09-30T14:50:21.122457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894678812115899:2504]
2025-09-30T14:50:21.122539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 15
2025-09-30T14:50:21.122459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894678812115899:2504]
2025-09-30T14:50:21.122474Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:21.122488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:21.122500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:21.122504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:21.122507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:21.122507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:21.122510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:21.122546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894678812115899:2504]
2025-09-30T14:50:21.122553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:21.122562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:21.122706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:21.122716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:21.122757Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40e657c6-5a44ba62-ce9c8047-77d38fbd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:21.122769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.122773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.122775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:21.122785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.122793Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:21.122809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:21.122987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:21.122994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:21.123007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:21.123103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 16 partition: 0 MaxSeqNo: 42 sessionId: src_id|40e657c6-5a44ba62-ce9c8047-77d38fbd_0
2025-09-30T14:50:21.123660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff362d34-50ab5f7e-d3f4b1e4-7d33beec_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|40e657c6-5a44ba62-ce9c8047-77d38fbd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:21.130322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40e657c6-5a44ba62-ce9c8047-77d38fbd_0] Write session: try to update token
2025-09-30T14:50:21.130353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40e657c6-5a44ba62-ce9c8047-77d38fbd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:21.136953Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:21.136974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:21.136979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:21.136982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:21.136991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894678812115899:2504]
2025-09-30T14:50:21.136995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894678812115899:2504]
2025-09-30T14:50:21.137002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894678812115899:2504]
2025-09-30T14:50:21.137040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:21.137047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.137050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:21.137062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:21.137076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:21.137081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:21.137198Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:21.154063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 16 sessionId: src_id|40e657c6-5a44ba62-ce9c8047-77d38fbd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:21.157559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:21.202663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894678901838244:2517]
2025-09-30T14:50:21.203144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 15, pipe: [1:7555894678901838244:2517]
2025-09-30T14:50:21.250100Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:21.250519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:21.250539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:21.250563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894678901838244:2517], now have 1 active actors on pipe
2025-09-30T14:50:21.250849Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:21.250899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894678901838244:2517]
2025-09-30T14:50:21.250929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:21.250980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:21.251061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 16 reason: status is not ok: tablet will be restarted right now sessionId: src_id|40e657c6-5a44ba62-ce9c8047-77d38fbd_0
2025-09-30T14:50:21.251284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 16 sessionId: src_id|40e657c6-5a44ba62-ce9c8047-77d38fbd_0 is DEAD
2025-09-30T14:50:21.251503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40e657c6-5a44ba62-ce9c8047-77d38fbd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:21.251511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40e657c6-5a44ba62-ce9c8047-77d38fbd_0] Write session will restart in 0.007830s
2025-09-30T14:50:21.251530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40e657c6-5a44ba62-ce9c8047-77d38fbd_0] Write session: Do CDS request
2025-09-30T14:50:21.251535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40e657c6-5a44ba62-ce9c8047-77d38fbd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:21.260873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40e657c6-5a44ba62-ce9c8047-77d38fbd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:21.261112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:21.261140Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 17
2025-09-30T14:50:21.263570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 17 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:21.263628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 17 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:21.263633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=17 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:21.263639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:21.266662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 17 sessionId:  describe result for acl check
2025-09-30T14:50:21.266696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:21.266699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:21.266701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:21.266708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894678901838259:2607] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:21.267304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894678901838259:2607] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:21.276697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894678901838259:2607] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:21.283066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:21.280350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894678901838259:2607] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:21.280365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894678901838259:2607] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:21.280369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894678901838259:2607] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:21.280378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 17 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:21.287439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:21.287704Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:21.287720Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:21.287731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:21.287786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:21.287836Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894678812115977:2506]
2025-09-30T14:50:21.288550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:21.289285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:21.289374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:21.289820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:21.289890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:21.289891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:21.289893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:21.289895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:21.289896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:21.289898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:21.289900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:21.289902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:21.289903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:21.289905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:21.289907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.289908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.289910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.289912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:21.289914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:21.289921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:21.289932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:21.289937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:21.289942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:21.289947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:21.289955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:21.289960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:21.289964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:21.289969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:21.289975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:21.289979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.289984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.289989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.290009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:21.290014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:21.290022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:21.290032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:21.290039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:21.290046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:21.290051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:21.290057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:21.290063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:21.290069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:21.290076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:21.290082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:21.290088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:21.290094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:21.290099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:21.290106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:21.290120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:21.290126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:21.290131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:21.290136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:21.290141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:21.290147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:21.290151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.290158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.290163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.290169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.290174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.290182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.290186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:21.290192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:21.290200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:21.290207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:21.290270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:21.300972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40e657c6-5a44ba62-ce9c8047-77d38fbd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c1ee7ee2-a0e89011-fb4981f7-6c03b74c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:21.299671Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 16
2025-09-30T14:50:21.299719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 16
2025-09-30T14:50:21.300497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 17 partition: 0 MaxSeqNo: 42 sessionId: src_id|c1ee7ee2-a0e89011-fb4981f7-6c03b74c_0
2025-09-30T14:50:21.297981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:21.298949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:21.298957Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:21.298961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:21.298964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:21.298972Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 16 [2:7555894678812115977:2506]
2025-09-30T14:50:21.298993Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:21.299015Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:21.299019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.299023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.299025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.299044Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:21.299052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:21.299059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:21.299136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.299139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.299141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.299144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:21.299148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:21.299276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:21.299283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.299298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.299312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.299332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:21.299351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894678812115971:2506]
2025-09-30T14:50:21.299354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894678812115971:2506]
2025-09-30T14:50:21.299356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894678812115971:2506]
2025-09-30T14:50:21.299371Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:21.299385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:21.299403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:21.299406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:21.299412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:21.299417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:21.299419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:21.299447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894678812115971:2506]
2025-09-30T14:50:21.299451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:21.299497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:21.299597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894678901838245:2454], now have 1 active actors on pipe
2025-09-30T14:50:21.299603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894678901838310:2607], now have 1 active actors on pipe
2025-09-30T14:50:21.299997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:21.300003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:21.300035Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1ee7ee2-a0e89011-fb4981f7-6c03b74c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:21.300044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.300049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.300052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:21.300063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.300077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:21.300093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:21.300339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:21.300345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:21.300361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:21.303756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ee7ee2-a0e89011-fb4981f7-6c03b74c_0] Write session: try to update token
2025-09-30T14:50:21.303776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ee7ee2-a0e89011-fb4981f7-6c03b74c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:21.317158Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:21.317195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:21.317198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:21.317200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:21.317211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894678812115971:2506]
2025-09-30T14:50:21.317216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894678812115971:2506]
2025-09-30T14:50:21.317221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894678812115971:2506]
2025-09-30T14:50:21.317268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:21.317275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.317278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:21.317287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:21.317294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:21.317299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:21.317419Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:21.334394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 17 sessionId: src_id|c1ee7ee2-a0e89011-fb4981f7-6c03b74c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:21.338439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:21.349618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894678901838323:2517]
2025-09-30T14:50:21.350130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 16, pipe: [1:7555894678901838323:2517]
2025-09-30T14:50:21.438892Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:21.439270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:21.439284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:21.439305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894678901838323:2517], now have 1 active actors on pipe
2025-09-30T14:50:21.439716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894678901838323:2517]
2025-09-30T14:50:21.439765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:21.439807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:21.439810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:21.439878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 17 reason: error at write: Disconnected sessionId: src_id|c1ee7ee2-a0e89011-fb4981f7-6c03b74c_0
2025-09-30T14:50:21.439545Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:21.440117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 17 sessionId: src_id|c1ee7ee2-a0e89011-fb4981f7-6c03b74c_0 is DEAD
2025-09-30T14:50:21.443769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ee7ee2-a0e89011-fb4981f7-6c03b74c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:21.443788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ee7ee2-a0e89011-fb4981f7-6c03b74c_0] Write session will restart in 0.005351s
2025-09-30T14:50:21.443821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ee7ee2-a0e89011-fb4981f7-6c03b74c_0] Write session: Do CDS request
2025-09-30T14:50:21.443833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ee7ee2-a0e89011-fb4981f7-6c03b74c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:21.451075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ee7ee2-a0e89011-fb4981f7-6c03b74c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:21.451315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:21.451332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 18
2025-09-30T14:50:21.451931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 18 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:21.451980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 18 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:21.451987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=18 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:21.451994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:21.452494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 18 sessionId:  describe result for acl check
2025-09-30T14:50:21.452534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:21.452536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:21.452539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:21.452547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894678901838351:2612] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:21.453167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894678901838351:2612] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:21.456057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894678901838351:2612] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:21.462057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894678901838351:2612] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:21.462073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894678901838351:2612] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:21.462077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894678901838351:2612] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:21.462094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 18 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:21.463763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:21.465793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:21.466110Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:21.466126Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:21.466157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:21.466241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:21.466292Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894678812116051:2509]
2025-09-30T14:50:21.467075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:21.467635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:21.467708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:21.468121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:21.468225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:21.468233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:21.468234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:21.468235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:21.468236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:21.468238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:21.468239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:21.468240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:21.468242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:21.468243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:21.468244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.468246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.468247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.468248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:21.468250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:21.468257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:21.468269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:21.468273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:21.468278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:21.468282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:21.468286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:21.468290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:21.468295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:21.468299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:21.468304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:21.468308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.468313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.468317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.468321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:21.468326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:21.468335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:21.468346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:21.468354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:21.468360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:21.468365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:21.468372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:21.468377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:21.468383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:21.468391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:21.468397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:21.468402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:21.468408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:21.468413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:21.468418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:21.468423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:21.468429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:21.468434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:21.468440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:21.468444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:21.468450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:21.468456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.468462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.468467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.468473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.468478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.468484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.468489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:21.468495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:21.468500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:21.468506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:21.468565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:21.478136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:21.479181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:21.479198Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:21.479206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:21.479211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:21.479219Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 17 [2:7555894678812116051:2509]
2025-09-30T14:50:21.479258Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:21.479280Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:21.479287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.479291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.479293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.479311Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:21.479322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:21.479329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:21.479404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.479412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.479414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.479417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:21.479420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:21.479510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:21.479517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.479534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.479544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.479559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:21.479577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894678812116046:2509]
2025-09-30T14:50:21.479579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894678812116046:2509]
2025-09-30T14:50:21.479581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894678812116046:2509]
2025-09-30T14:50:21.479596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:21.479611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:21.479625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:21.479633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:21.479673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894678812116046:2509]
2025-09-30T14:50:21.479681Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:21.481206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:21.481218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:21.481221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:21.481228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:21.481718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 17
2025-09-30T14:50:21.481766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 17
2025-09-30T14:50:21.484862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894678901838394:2612], now have 1 active actors on pipe
2025-09-30T14:50:21.484890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894678901838327:2454], now have 1 active actors on pipe
2025-09-30T14:50:21.484916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:21.484924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:21.484961Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2e86301-526c2390-899b4495-e67d621c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:21.484976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.484981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.484984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:21.485001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.485017Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:21.485038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:21.485456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:21.485463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:21.485479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:21.486141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ee7ee2-a0e89011-fb4981f7-6c03b74c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e2e86301-526c2390-899b4495-e67d621c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:21.489101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2e86301-526c2390-899b4495-e67d621c_0] Write session: try to update token
2025-09-30T14:50:21.489121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2e86301-526c2390-899b4495-e67d621c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:21.485628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 18 partition: 0 MaxSeqNo: 42 sessionId: src_id|e2e86301-526c2390-899b4495-e67d621c_0
2025-09-30T14:50:21.499960Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:21.499981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:21.499985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:21.499987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:21.499998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894678812116046:2509]
2025-09-30T14:50:21.500004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894678812116046:2509]
2025-09-30T14:50:21.500012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894678812116046:2509]
2025-09-30T14:50:21.500059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:21.500072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.500075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:21.500096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:21.500102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:21.500105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:21.500235Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:21.522517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 18 sessionId: src_id|e2e86301-526c2390-899b4495-e67d621c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:21.525540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:21.540055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894678901838409:2517]
2025-09-30T14:50:21.540370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 17, pipe: [1:7555894678901838409:2517]
2025-09-30T14:50:21.646305Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:21.646645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:21.646660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:21.646700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894678901838409:2517], now have 1 active actors on pipe
2025-09-30T14:50:21.646958Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:21.647529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2e86301-526c2390-899b4495-e67d621c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:21.646955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894678901838409:2517]
2025-09-30T14:50:21.647543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2e86301-526c2390-899b4495-e67d621c_0] Write session will restart in 0.005173s
2025-09-30T14:50:21.646973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:21.646978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:21.646986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:21.647040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 18 reason: error at write: Disconnected sessionId: src_id|e2e86301-526c2390-899b4495-e67d621c_0
2025-09-30T14:50:21.647271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 18 sessionId: src_id|e2e86301-526c2390-899b4495-e67d621c_0 is DEAD
2025-09-30T14:50:21.647589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2e86301-526c2390-899b4495-e67d621c_0] Write session: Do CDS request
2025-09-30T14:50:21.647598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2e86301-526c2390-899b4495-e67d621c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:21.653799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2e86301-526c2390-899b4495-e67d621c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:21.653958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:21.653979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 19
2025-09-30T14:50:21.654096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 19 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:21.654137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 19 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:21.654148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=19 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:21.654152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:21.654624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 19 sessionId:  describe result for acl check
2025-09-30T14:50:21.654659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:21.654665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:21.654667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:21.654673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894678901838455:2617] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:21.655265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894678901838455:2617] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:21.655594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:21.656448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:21.656640Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:21.656651Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:21.656661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:21.656713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:21.656771Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894678812116137:2514]
2025-09-30T14:50:21.657433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894678901838455:2617] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:21.657515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:21.657794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:21.657840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:21.658209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:21.658273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:21.658279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:21.658280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:21.658281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:21.658282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:21.658283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:21.658285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:21.658286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:21.658287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:21.658288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:21.658289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.658291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.658293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.658294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:21.658295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:21.658301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:21.658311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:21.658316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:21.658321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:21.658325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:21.658330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:21.658334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:21.658339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:21.658342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:21.658346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:21.658351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.658355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.658360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.658364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:21.658369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:21.658375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:21.658384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:21.658390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:21.658395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:21.658399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:21.658403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:21.658407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:21.658411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:21.658416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:21.658425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:21.658430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:21.658434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:21.658444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:21.658449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:21.658452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:21.658457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:21.658461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:21.658466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:21.658470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:21.658475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:21.658479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.658483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.658489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.658497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.658501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.658510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.658514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:21.658520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:21.658525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:21.658531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:21.658577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:21.665440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:21.666384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:21.666403Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:21.666407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:21.666411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:21.666420Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 18 [2:7555894678812116137:2514]
2025-09-30T14:50:21.666438Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:21.666460Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:21.666464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.666468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.666471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.666492Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:21.666504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:21.666512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:21.666578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.666586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.666588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.666592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:21.666595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:21.664991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894678901838455:2617] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:21.665019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894678901838455:2617] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:21.665023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894678901838455:2617] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:21.665040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 19 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:21.666668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:21.666675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.666688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.666705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.666725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:21.666759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894678812116132:2514]
2025-09-30T14:50:21.666766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894678812116132:2514]
2025-09-30T14:50:21.666768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894678812116132:2514]
2025-09-30T14:50:21.666782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:21.666800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894678901838497:2617], now have 1 active actors on pipe
2025-09-30T14:50:21.666808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894678901838412:2454], now have 1 active actors on pipe
2025-09-30T14:50:21.666816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:21.666829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:21.666840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:21.666876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894678812116132:2514]
2025-09-30T14:50:21.666883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:21.666982Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 18
2025-09-30T14:50:21.666982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 18
2025-09-30T14:50:21.666965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:21.666973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:21.666976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:21.666981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:21.667079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:21.667087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:21.667115Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd907017-32080d4b-b8c9db37-62f74b39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:21.667124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.667128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.667142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:21.667153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.667164Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:21.667179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:21.667404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:21.667420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:21.667445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:21.667591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 19 partition: 0 MaxSeqNo: 42 sessionId: src_id|fd907017-32080d4b-b8c9db37-62f74b39_0
2025-09-30T14:50:21.668061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2e86301-526c2390-899b4495-e67d621c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fd907017-32080d4b-b8c9db37-62f74b39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:21.671040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd907017-32080d4b-b8c9db37-62f74b39_0] Write session: try to update token
2025-09-30T14:50:21.671060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd907017-32080d4b-b8c9db37-62f74b39_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:21.686054Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:21.686076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:21.686079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:21.686082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:21.686093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894678812116132:2514]
2025-09-30T14:50:21.686097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894678812116132:2514]
2025-09-30T14:50:21.686104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894678812116132:2514]
2025-09-30T14:50:21.686148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:21.686155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.686158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:21.686307Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:21.691349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:21.691371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:21.691376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:21.694092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 19 sessionId: src_id|fd907017-32080d4b-b8c9db37-62f74b39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:21.697228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
E0930 14:50:21.707178014 2211637 chttp2_transport.cc:1143]             ipv4:127.0.0.1:11802: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-09-30T14:50:21.746897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894678901838505:2517]
2025-09-30T14:50:21.747222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 18, pipe: [1:7555894678901838505:2517]
2025-09-30T14:50:21.807352Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:21.807695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:21.807711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:21.807752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894678901838505:2517], now have 1 active actors on pipe
2025-09-30T14:50:21.808026Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:21.808144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:21.808157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:21.808170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894678901838505:2517]
2025-09-30T14:50:21.808211Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:21.808220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 19 reason: error at write: Disconnected sessionId: src_id|fd907017-32080d4b-b8c9db37-62f74b39_0
2025-09-30T14:50:21.808736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd907017-32080d4b-b8c9db37-62f74b39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:21.808746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd907017-32080d4b-b8c9db37-62f74b39_0] Write session will restart in 0.005602s
2025-09-30T14:50:21.808388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 19 sessionId: src_id|fd907017-32080d4b-b8c9db37-62f74b39_0 is DEAD
2025-09-30T14:50:21.808770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd907017-32080d4b-b8c9db37-62f74b39_0] Write session: Do CDS request
2025-09-30T14:50:21.808779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd907017-32080d4b-b8c9db37-62f74b39_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:21.815879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd907017-32080d4b-b8c9db37-62f74b39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:21.816011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:21.816031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 20
2025-09-30T14:50:21.816207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 20 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:21.816242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 20 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:21.816252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=20 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:21.816257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:21.816783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 20 sessionId:  describe result for acl check
2025-09-30T14:50:21.816823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:21.816830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:21.816832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:21.816839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894678901838539:2621] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:21.817420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894678901838539:2621] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:21.818954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:21.819648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:21.819851Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:21.819865Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:21.819876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:21.819944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:21.819987Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894678812116211:2516]
2025-09-30T14:50:21.820710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:21.820843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894678901838539:2621] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:21.821017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:21.821075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:21.821424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:21.821514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:21.821521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:21.821523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:21.821524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:21.821525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:21.821526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:21.821527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:21.821528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:21.821530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:21.821531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:21.821533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.821534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.821535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.821536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:21.821537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:21.821543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:21.821553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:21.821557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:21.821561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:21.821565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:21.821570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:21.821575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:21.821580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:21.821583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:21.821588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:21.821591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.821594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.821598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.821602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:21.821605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:21.821614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:21.821622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:21.821627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:21.821633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:21.821637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:21.821642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:21.821647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:21.821652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:21.821657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:21.821661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:21.821665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:21.821670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:21.821674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:21.821679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:21.821683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:21.821688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:21.821699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:21.821704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:21.821708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:21.821713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:21.821722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.821727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.821735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.821741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.821746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.821755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.821759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:21.821764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:21.821768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:21.821777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:21.821819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:21.827318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894678901838539:2621] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:21.827334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894678901838539:2621] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:21.827338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894678901838539:2621] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:21.827356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 20 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:21.827647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:21.828641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:21.828659Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:21.828662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:21.828667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:21.828674Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 19 [2:7555894678812116211:2516]
2025-09-30T14:50:21.828692Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:21.828710Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:21.828714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.828717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.828720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.828737Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:21.828750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:21.828760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:21.828829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.828836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.828839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.828846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:21.828848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:21.828927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:21.828934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.828949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.828965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.828988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:21.829011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894678901838581:2621], now have 1 active actors on pipe
2025-09-30T14:50:21.829019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894678901838507:2454], now have 1 active actors on pipe
2025-09-30T14:50:21.829026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894678812116206:2516]
2025-09-30T14:50:21.829032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894678812116206:2516]
2025-09-30T14:50:21.829034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894678812116206:2516]
2025-09-30T14:50:21.829047Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:21.829043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 19
2025-09-30T14:50:21.829064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:21.829078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:21.829083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:21.829083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:21.829086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:21.829086Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 19
2025-09-30T14:50:21.829087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:21.829141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:21.829151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:21.829168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894678812116206:2516]
2025-09-30T14:50:21.829176Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:21.829198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:21.829207Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0332c6b-b4051cfe-16cba0af-75088f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:21.829214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.829218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.829222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:21.829233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.829247Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:21.829271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:21.829479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:21.829492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:21.829513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:21.829596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 20 partition: 0 MaxSeqNo: 42 sessionId: src_id|f0332c6b-b4051cfe-16cba0af-75088f7_0
2025-09-30T14:50:21.830036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd907017-32080d4b-b8c9db37-62f74b39_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f0332c6b-b4051cfe-16cba0af-75088f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:21.832995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0332c6b-b4051cfe-16cba0af-75088f7_0] Write session: try to update token
2025-09-30T14:50:21.833015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0332c6b-b4051cfe-16cba0af-75088f7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:21.841954Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:21.841977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:21.841982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:21.841984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:21.841994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894678812116206:2516]
2025-09-30T14:50:21.841999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894678812116206:2516]
2025-09-30T14:50:21.842006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894678812116206:2516]
2025-09-30T14:50:21.842050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:21.842056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.842057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:21.842060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:21.842064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:21.842068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:21.842208Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:21.849214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 20 sessionId: src_id|f0332c6b-b4051cfe-16cba0af-75088f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:21.852323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:21.908183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894678901838589:2517]
2025-09-30T14:50:21.908514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 19, pipe: [1:7555894678901838589:2517]
2025-09-30T14:50:21.959303Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:21.959630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:21.959648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:21.959671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894678901838589:2517], now have 1 active actors on pipe
2025-09-30T14:50:21.959977Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:21.960128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:21.960136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894678901838589:2517]
2025-09-30T14:50:21.960141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:21.960157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:21.960227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 20 reason: error at write: Disconnected sessionId: src_id|f0332c6b-b4051cfe-16cba0af-75088f7_0
2025-09-30T14:50:21.960431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 20 sessionId: src_id|f0332c6b-b4051cfe-16cba0af-75088f7_0 is DEAD
2025-09-30T14:50:21.960566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0332c6b-b4051cfe-16cba0af-75088f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:21.960577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0332c6b-b4051cfe-16cba0af-75088f7_0] Write session will restart in 0.005929s
2025-09-30T14:50:21.960601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0332c6b-b4051cfe-16cba0af-75088f7_0] Write session: Do CDS request
2025-09-30T14:50:21.960606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0332c6b-b4051cfe-16cba0af-75088f7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:21.968056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0332c6b-b4051cfe-16cba0af-75088f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:21.968478Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:21.968493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 21
2025-09-30T14:50:21.968649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 21 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:21.968680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 21 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:21.968686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=21 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:21.968690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:21.969217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 21 sessionId:  describe result for acl check
2025-09-30T14:50:21.969262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:21.969264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:21.969266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:21.969271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894678901838625:2627] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:21.969781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894678901838625:2627] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:21.972713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894678901838625:2627] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:21.977759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:21.980415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894678901838625:2627] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:21.980434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894678901838625:2627] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:21.980438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894678901838625:2627] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:21.980447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 21 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:21.981890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:21.982185Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:21.982190Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:21.982205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:21.982281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:21.982329Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894678812116303:2525]
2025-09-30T14:50:21.983510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:21.983893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:21.983971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:21.984339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:21.984414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:21.984416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:21.984417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:21.984419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:21.984420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:21.984422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:21.984423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:21.984424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:21.984425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:21.984427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:21.984428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.984429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.984431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.984432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:21.984433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:21.984439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:21.984449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:21.984453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:21.984457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:21.984460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:21.984467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:21.984472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:21.984476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:21.984480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:21.984485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:21.984489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.984493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.984497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.984501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:21.984505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:21.984524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:21.984533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:21.984539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:21.984546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:21.984554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:21.984560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:21.984565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:21.984570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:21.984575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:21.984580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:21.984585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:21.984590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:21.984595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:21.984600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:21.984605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:21.984611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:21.984616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:21.984621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:21.984626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:21.984632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:21.984636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.984652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.984658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.984663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.984668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.984676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.984683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:21.984688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:21.984693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:21.984698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:21.984744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:21.990690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:21.991616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:21.991631Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:21.991633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:21.991644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:21.991651Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 20 [2:7555894678812116303:2525]
2025-09-30T14:50:21.991669Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:21.991687Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:21.991695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.991699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.991702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.991716Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:21.991723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:21.991730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:21.991785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.991794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.991796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.991800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:21.991802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:21.992104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 20
2025-09-30T14:50:21.992112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 20
2025-09-30T14:50:21.991870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:21.991877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:21.991891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:21.991901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:21.991918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:21.991937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894678901838604:2454], now have 1 active actors on pipe
2025-09-30T14:50:21.991943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894678812116297:2525]
2025-09-30T14:50:21.991946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894678812116297:2525]
2025-09-30T14:50:21.991948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894678812116297:2525]
2025-09-30T14:50:21.991963Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:21.991972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894678901838672:2627], now have 1 active actors on pipe
2025-09-30T14:50:21.991976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:21.991979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:21.991980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:21.991982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:21.991994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:21.991997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:21.992030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894678812116297:2525]
2025-09-30T14:50:21.992036Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:21.992042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:21.992597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:21.992610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:21.992639Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48b9ba1a-e9c26df5-1e546a0a-12e7a90e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:21.992646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.992650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.992652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:21.992663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.992674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:21.992688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:21.998852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:21.998881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:21.998916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:21.999292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 21 partition: 0 MaxSeqNo: 42 sessionId: src_id|48b9ba1a-e9c26df5-1e546a0a-12e7a90e_0
2025-09-30T14:50:21.999704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0332c6b-b4051cfe-16cba0af-75088f7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|48b9ba1a-e9c26df5-1e546a0a-12e7a90e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:22.002485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48b9ba1a-e9c26df5-1e546a0a-12e7a90e_0] Write session: try to update token
2025-09-30T14:50:22.002506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48b9ba1a-e9c26df5-1e546a0a-12e7a90e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:22.012669Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:22.012689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:22.012693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:22.012695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:22.012703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894678812116297:2525]
2025-09-30T14:50:22.012708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894678812116297:2525]
2025-09-30T14:50:22.012712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894678812116297:2525]
2025-09-30T14:50:22.012765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:22.012775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.012778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:22.012787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:22.012792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:22.012796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:22.012952Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:22.031738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 21 sessionId: src_id|48b9ba1a-e9c26df5-1e546a0a-12e7a90e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:22.034480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:22.063357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894683196806005:2517]
2025-09-30T14:50:22.063624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 20, pipe: [1:7555894683196806005:2517]
2025-09-30T14:50:22.137679Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:22.138114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:22.138134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:22.138160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894683196806005:2517], now have 1 active actors on pipe
2025-09-30T14:50:22.138401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:22.138430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:22.138455Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:22.138926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48b9ba1a-e9c26df5-1e546a0a-12e7a90e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:22.138937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48b9ba1a-e9c26df5-1e546a0a-12e7a90e_0] Write session will restart in 0.005619s
2025-09-30T14:50:22.138961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48b9ba1a-e9c26df5-1e546a0a-12e7a90e_0] Write session: Do CDS request
2025-09-30T14:50:22.138966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48b9ba1a-e9c26df5-1e546a0a-12e7a90e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:22.138497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 21 reason: error at write: Disconnected sessionId: src_id|48b9ba1a-e9c26df5-1e546a0a-12e7a90e_0
2025-09-30T14:50:22.138697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 21 sessionId: src_id|48b9ba1a-e9c26df5-1e546a0a-12e7a90e_0 is DEAD
2025-09-30T14:50:22.138713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:22.138772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894683196806005:2517]
2025-09-30T14:50:22.145855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48b9ba1a-e9c26df5-1e546a0a-12e7a90e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:22.145945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:22.145960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 22
2025-09-30T14:50:22.146114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 22 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:22.146149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 22 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:22.146172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=22 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:22.146182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:22.146696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 22 sessionId:  describe result for acl check
2025-09-30T14:50:22.146741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:22.146748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:22.146750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:22.146757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894683196806023:2638] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:22.147341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894683196806023:2638] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:22.149965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894683196806023:2638] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:22.150331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:22.150969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:22.151176Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:22.151186Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:22.151198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:22.152973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894683196806023:2638] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:22.152990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894683196806023:2638] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:22.152994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894683196806023:2638] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:22.151273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:22.153003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 22 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:22.151318Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894683107083697:2533]
2025-09-30T14:50:22.152048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:22.152567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:22.152622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:22.153032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:22.153091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:22.153100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:22.153101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:22.153103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:22.153104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:22.153106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:22.153107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:22.153108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:22.153109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:22.153111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:22.153112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.153113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.153114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.153115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:22.153116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:22.153122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:22.153134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:22.153139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:22.153143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:22.153147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:22.153151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:22.153155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:22.153159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:22.153162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:22.153166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:22.153170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.153173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.153178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.153182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:22.153186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:22.153196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:22.153206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:22.153211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:22.153217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:22.153222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:22.153228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:22.153232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:22.153248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:22.153254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:22.153259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:22.153263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:22.153268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:22.153272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:22.153278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:22.153284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:22.153291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:22.153296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:22.153302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:22.153306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:22.153315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:22.153321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.153327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.153331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.153338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.153343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.153349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.153354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:22.153364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:22.153369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:22.153374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:22.153423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:22.159783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:22.160722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:22.160740Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:22.160744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:22.160748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:22.160756Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 21 [2:7555894683107083697:2533]
2025-09-30T14:50:22.160772Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:22.160787Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:22.160789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:22.160792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:22.160794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:22.160807Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:22.160813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:22.160818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:22.160881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.160891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.160893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.160895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:22.160899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:22.160956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:22.160962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.160970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.160977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.160987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:22.160999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894683107083692:2533]
2025-09-30T14:50:22.161004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894683107083692:2533]
2025-09-30T14:50:22.161007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894683107083692:2533]
2025-09-30T14:50:22.161014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:22.161024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:22.161026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:22.161041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:22.161043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:22.161044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:22.161046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:22.161053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894683196806007:2454], now have 1 active actors on pipe
2025-09-30T14:50:22.161057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894683196806081:2638], now have 1 active actors on pipe
2025-09-30T14:50:22.161091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894683107083692:2533]
2025-09-30T14:50:22.161105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:22.161111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:22.161127Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 21
2025-09-30T14:50:22.161145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 21
2025-09-30T14:50:22.161190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:22.161200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:22.161226Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71572830-5547c24a-4ef79485-c32912e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:22.161237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:22.161241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:22.161244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:22.161252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:22.161267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:22.161282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:22.161456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:22.161465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:22.161477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:22.161622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 22 partition: 0 MaxSeqNo: 42 sessionId: src_id|71572830-5547c24a-4ef79485-c32912e_0
2025-09-30T14:50:22.162039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48b9ba1a-e9c26df5-1e546a0a-12e7a90e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|71572830-5547c24a-4ef79485-c32912e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:22.166116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71572830-5547c24a-4ef79485-c32912e_0] Write session: try to update token
2025-09-30T14:50:22.166139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71572830-5547c24a-4ef79485-c32912e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:22.174236Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:22.174256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:22.174267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894683107083692:2533]
2025-09-30T14:50:22.174313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:22.174322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:22.174583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:22.174751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:22.174909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:22.175078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:22.175320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:22.175373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:22.187088Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:22.187109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:22.187113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:22.187116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:22.187128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894683107083692:2533]
2025-09-30T14:50:22.187133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894683107083692:2533]
2025-09-30T14:50:22.187137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894683107083692:2533]
2025-09-30T14:50:22.187183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:22.187197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.187204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:22.187210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:22.187226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:22.187231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:22.187388Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:22.187839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 22 sessionId: src_id|71572830-5547c24a-4ef79485-c32912e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:22.190991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:22.237385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894683196806091:2517]
2025-09-30T14:50:22.237677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 21, pipe: [1:7555894683196806091:2517]
2025-09-30T14:50:22.304871Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:22.305227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:22.305239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:22.305261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894683196806091:2517], now have 1 active actors on pipe
2025-09-30T14:50:22.305540Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:22.305553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894683196806091:2517]
2025-09-30T14:50:22.305595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:22.305598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:22.305606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:22.305659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 22 reason: error at write: Disconnected sessionId: src_id|71572830-5547c24a-4ef79485-c32912e_0
2025-09-30T14:50:22.305871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 22 sessionId: src_id|71572830-5547c24a-4ef79485-c32912e_0 is DEAD
2025-09-30T14:50:22.306928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71572830-5547c24a-4ef79485-c32912e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:22.306941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71572830-5547c24a-4ef79485-c32912e_0] Write session will restart in 0.006274s
2025-09-30T14:50:22.306967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71572830-5547c24a-4ef79485-c32912e_0] Write session: Do CDS request
2025-09-30T14:50:22.306976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71572830-5547c24a-4ef79485-c32912e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:22.314930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71572830-5547c24a-4ef79485-c32912e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:22.314996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:22.315011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 23
2025-09-30T14:50:22.315202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 23 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:22.315234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 23 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:22.315239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=23 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:22.315258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:22.315693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 23 sessionId:  describe result for acl check
2025-09-30T14:50:22.315728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:22.315735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:22.315736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:22.315742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894683196806130:2642] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:22.316298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894683196806130:2642] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:22.316884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:22.318280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:22.318518Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:22.318528Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:22.318539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:22.318592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:22.318625Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894683107083774:2535]
2025-09-30T14:50:22.319441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:22.320056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:22.320135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:22.320555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:22.320638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894683196806130:2642] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:22.320629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:22.320637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:22.320639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:22.320640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:22.320641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:22.320642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:22.320644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:22.320645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:22.320647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:22.320648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:22.320650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.320651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.320652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.320654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:22.320655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:22.320661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:22.320671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:22.320676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:22.320680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:22.320685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:22.320689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:22.320693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:22.320697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:22.320701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:22.320706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:22.320710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.320715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.320721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.320726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:22.320730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:22.320737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:22.320746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:22.320752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:22.320759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:22.320764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:22.320770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:22.320775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:22.320782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:22.320788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:22.320794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:22.320800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:22.320806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:22.320811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:22.320818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:22.320824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:22.320830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:22.320836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:22.320843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:22.320848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:22.320854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:22.320860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.320866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.320871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.320878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.320883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.320889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.320894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:22.320901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:22.320908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:22.320914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:22.320981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:22.326927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894683196806130:2642] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:22.326946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894683196806130:2642] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:22.326949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894683196806130:2642] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:22.326961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 23 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:22.327269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:22.328191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:22.328210Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:22.328214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:22.328218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:22.328225Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 22 [2:7555894683107083774:2535]
2025-09-30T14:50:22.328242Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:22.328258Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:22.328266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:22.328269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:22.328272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:22.328301Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:22.328315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:22.328321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:22.328398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.328405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.328408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.328411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:22.328413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:22.328489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:22.328497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.328510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.328527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.328547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:22.328571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894683196806170:2642], now have 1 active actors on pipe
2025-09-30T14:50:22.328579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894683196806092:2454], now have 1 active actors on pipe
2025-09-30T14:50:22.328585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894683107083768:2535]
2025-09-30T14:50:22.328587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894683107083768:2535]
2025-09-30T14:50:22.328589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894683107083768:2535]
2025-09-30T14:50:22.328603Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:22.328621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:22.328626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:22.328629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:22.328632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:22.328639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:22.328643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:22.328625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 22
2025-09-30T14:50:22.328631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 22
2025-09-30T14:50:22.328680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894683107083768:2535]
2025-09-30T14:50:22.328691Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:22.328697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:22.328725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:22.328730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:22.328783Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb491f26-43f1f113-926bbdb3-e593e6e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:22.328794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:22.328798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:22.328800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:22.328812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:22.328827Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:22.328860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:22.329074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:22.329086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:22.329105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:22.329203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 23 partition: 0 MaxSeqNo: 42 sessionId: src_id|fb491f26-43f1f113-926bbdb3-e593e6e9_0
2025-09-30T14:50:22.329653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71572830-5547c24a-4ef79485-c32912e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fb491f26-43f1f113-926bbdb3-e593e6e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:22.332612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb491f26-43f1f113-926bbdb3-e593e6e9_0] Write session: try to update token
2025-09-30T14:50:22.332633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb491f26-43f1f113-926bbdb3-e593e6e9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:22.350121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 23 sessionId: src_id|fb491f26-43f1f113-926bbdb3-e593e6e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:22.350840Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:22.350863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:22.350865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:22.350867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:22.350879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894683107083768:2535]
2025-09-30T14:50:22.350884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894683107083768:2535]
2025-09-30T14:50:22.350888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894683107083768:2535]
2025-09-30T14:50:22.350932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:22.350944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.350947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:22.350954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:22.350962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:22.350966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:22.351098Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:22.353340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:22.405940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894683196806178:2517]
2025-09-30T14:50:22.406274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 22, pipe: [1:7555894683196806178:2517]
2025-09-30T14:50:22.468624Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:22.468953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:22.468969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:22.469011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894683196806178:2517], now have 1 active actors on pipe
2025-09-30T14:50:22.469262Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:22.469766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb491f26-43f1f113-926bbdb3-e593e6e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:22.469776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb491f26-43f1f113-926bbdb3-e593e6e9_0] Write session will restart in 0.006599s
2025-09-30T14:50:22.469801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb491f26-43f1f113-926bbdb3-e593e6e9_0] Write session: Do CDS request
2025-09-30T14:50:22.469806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb491f26-43f1f113-926bbdb3-e593e6e9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:22.469273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:22.469272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894683196806178:2517]
2025-09-30T14:50:22.469287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:22.469296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:22.469371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 23 reason: error at write: Disconnected sessionId: src_id|fb491f26-43f1f113-926bbdb3-e593e6e9_0
2025-09-30T14:50:22.469621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 23 sessionId: src_id|fb491f26-43f1f113-926bbdb3-e593e6e9_0 is DEAD
2025-09-30T14:50:22.478057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb491f26-43f1f113-926bbdb3-e593e6e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:22.478456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:22.479291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:22.479173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:22.479190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 24
2025-09-30T14:50:22.479381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 24 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:22.479418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 24 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:22.479424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=24 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:22.479430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:22.479537Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:22.479549Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:22.479563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:22.479630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:22.479674Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894683107083853:2538]
2025-09-30T14:50:22.479893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 24 sessionId:  describe result for acl check
2025-09-30T14:50:22.479928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:22.479931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:22.479933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:22.479939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894683196806220:2647] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:22.480367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:22.480776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:22.480839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:22.481204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:22.481283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:22.481290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:22.481291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:22.481292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:22.481294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:22.481295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:22.481296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:22.481298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:22.481299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:22.481300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:22.481302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.481303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.481093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894683196806220:2647] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:22.481304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.481305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:22.481306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:22.481312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:22.481322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:22.481326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:22.481329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:22.481333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:22.481337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:22.481340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:22.481344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:22.481348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:22.481353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:22.481357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.481361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.481365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.481369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:22.481373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:22.481381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:22.481390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:22.481396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:22.481404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:22.481409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:22.481414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:22.481419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:22.481424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:22.481430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:22.481435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:22.481439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:22.481445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:22.481450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:22.481455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:22.481467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:22.481473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:22.481478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:22.481486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:22.481491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:22.481501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:22.481505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.481511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.481520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.481525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.481529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.481535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.481539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:22.481545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:22.481550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:22.481555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:22.481608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:22.483545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894683196806220:2647] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:22.487213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894683196806220:2647] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:22.487228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894683196806220:2647] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:22.487257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894683196806220:2647] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:22.487284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 24 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:22.487666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:22.488538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:22.488554Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:22.488558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:22.488562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:22.488573Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 23 [2:7555894683107083853:2538]
2025-09-30T14:50:22.488590Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:22.488608Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:22.488618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:22.488621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:22.488624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:22.488641Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:22.488648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:22.488655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:22.488713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.488721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.488723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.488726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:22.488729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:22.488800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:22.488808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.488822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.488848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.488869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:22.488893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894683196806181:2454], now have 1 active actors on pipe
2025-09-30T14:50:22.488901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894683196806259:2647], now have 1 active actors on pipe
2025-09-30T14:50:22.488907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894683107083848:2538]
2025-09-30T14:50:22.488909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894683107083848:2538]
2025-09-30T14:50:22.488911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894683107083848:2538]
2025-09-30T14:50:22.488891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 23
2025-09-30T14:50:22.488920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:22.488921Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 23
2025-09-30T14:50:22.488932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:22.488939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:22.488942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:22.488944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:22.488954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:22.488961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:22.488977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:22.488986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:22.489038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894683107083848:2538]
2025-09-30T14:50:22.489049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:22.489063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:22.489068Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9fe68a6-945d563b-9d10cffe-a4ae776c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:22.489076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:22.489079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:22.489081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:22.489090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:22.489103Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:22.489145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:22.489327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:22.489338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:22.489368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:22.489455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 24 partition: 0 MaxSeqNo: 42 sessionId: src_id|c9fe68a6-945d563b-9d10cffe-a4ae776c_0
2025-09-30T14:50:22.489839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb491f26-43f1f113-926bbdb3-e593e6e9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c9fe68a6-945d563b-9d10cffe-a4ae776c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:22.492789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9fe68a6-945d563b-9d10cffe-a4ae776c_0] Write session: try to update token
2025-09-30T14:50:22.492811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9fe68a6-945d563b-9d10cffe-a4ae776c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:22.502493Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:22.502515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:22.502526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894683107083848:2538]
2025-09-30T14:50:22.502572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:22.502577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:22.502817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:22.502975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:22.503147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:22.503335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:22.503537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:22.503591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:22.515351Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:22.515368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:22.515375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:22.515377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:22.515387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894683107083848:2538]
2025-09-30T14:50:22.515391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894683107083848:2538]
2025-09-30T14:50:22.515395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894683107083848:2538]
2025-09-30T14:50:22.515437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:22.515445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.515447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:22.515553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:22.515566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:22.515571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:22.515595Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:22.516529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 24 sessionId: src_id|c9fe68a6-945d563b-9d10cffe-a4ae776c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:22.519824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:22.569177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894683196806267:2517]
2025-09-30T14:50:22.569511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 23, pipe: [1:7555894683196806267:2517]
2025-09-30T14:50:22.638946Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:22.639236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:22.639268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:22.639289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894683196806267:2517], now have 1 active actors on pipe
2025-09-30T14:50:22.639529Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:22.639555Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:22.639616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:22.639623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:22.639690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 24 reason: error at write: Disconnected sessionId: src_id|c9fe68a6-945d563b-9d10cffe-a4ae776c_0
2025-09-30T14:50:22.639864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894683196806267:2517]
2025-09-30T14:50:22.639885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 24 sessionId: src_id|c9fe68a6-945d563b-9d10cffe-a4ae776c_0 is DEAD
2025-09-30T14:50:22.641607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9fe68a6-945d563b-9d10cffe-a4ae776c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:22.641620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9fe68a6-945d563b-9d10cffe-a4ae776c_0] Write session will restart in 0.007067s
2025-09-30T14:50:22.641645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9fe68a6-945d563b-9d10cffe-a4ae776c_0] Write session: Do CDS request
2025-09-30T14:50:22.641654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9fe68a6-945d563b-9d10cffe-a4ae776c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:22.649765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9fe68a6-945d563b-9d10cffe-a4ae776c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:22.648811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:22.649338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:22.649516Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:22.649520Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:22.649531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:22.649581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:22.649630Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894683107083944:2541]
2025-09-30T14:50:22.650133Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:22.650147Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 25
2025-09-30T14:50:22.650266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 25 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:22.650302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 25 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:22.650313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=25 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:22.650318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:22.650318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:22.650757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:22.650819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:22.651165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:22.651225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:22.651228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:22.651230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:22.651231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:22.651232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:22.651233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:22.651235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:22.651236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:22.651237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:22.651239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:22.651240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.651256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.651258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.651259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:22.651261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:22.651266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:22.651276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:22.651280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:22.651284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:22.651287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:22.651292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:22.651296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:22.651299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:22.651302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:22.651306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:22.651310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.651315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.651320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.651324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:22.651328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:22.651335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:22.651342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:22.651347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:22.651351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:22.651355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:22.651361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:22.651365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:22.651370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:22.651375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:22.651380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:22.651385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:22.651400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:22.651405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:22.651409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:22.651414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:22.651418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:22.651424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:22.651429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:22.651432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:22.651437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:22.651442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.651458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.651462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.651468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.651473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.651478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.651484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:22.651489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:22.651495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:22.651499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:22.651547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:22.650770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 25 sessionId:  describe result for acl check
2025-09-30T14:50:22.650807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:22.650809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:22.650811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:22.650817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894683196806319:2652] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:22.651261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894683196806319:2652] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:22.652478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894683196806319:2652] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:22.657613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894683196806319:2652] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:22.657631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894683196806319:2652] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:22.657635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894683196806319:2652] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:22.657644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 25 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:22.660378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:22.661391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:22.661411Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:22.661415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:22.661420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:22.661427Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 24 [2:7555894683107083944:2541]
2025-09-30T14:50:22.661448Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:22.661469Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:22.661477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:22.661482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:22.661485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:22.661505Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:22.661513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:22.661524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:22.661635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.661650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.661653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.661657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:22.661660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:22.661749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:22.661758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.661772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.661784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.661808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:22.661834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894683196806268:2454], now have 1 active actors on pipe
2025-09-30T14:50:22.661842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894683196806360:2652], now have 1 active actors on pipe
2025-09-30T14:50:22.661850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894683107083939:2541]
2025-09-30T14:50:22.661854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894683107083939:2541]
2025-09-30T14:50:22.661856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894683107083939:2541]
2025-09-30T14:50:22.661872Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:22.661893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:22.661899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:22.661905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:22.661907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:22.661912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:22.661915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:22.661893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 24
2025-09-30T14:50:22.661944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 24
2025-09-30T14:50:22.661961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894683107083939:2541]
2025-09-30T14:50:22.661970Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:22.661973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:22.662005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:22.662017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:22.662055Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|edd2ee3f-188c3b8a-68ec0057-acf6c16d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:22.662070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:22.662075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:22.662078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:22.662088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:22.662100Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:22.662119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:22.662401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:22.662425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:22.662454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:22.662618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 25 partition: 0 MaxSeqNo: 42 sessionId: src_id|edd2ee3f-188c3b8a-68ec0057-acf6c16d_0
2025-09-30T14:50:22.663059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9fe68a6-945d563b-9d10cffe-a4ae776c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|edd2ee3f-188c3b8a-68ec0057-acf6c16d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:22.666208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edd2ee3f-188c3b8a-68ec0057-acf6c16d_0] Write session: try to update token
2025-09-30T14:50:22.666229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edd2ee3f-188c3b8a-68ec0057-acf6c16d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:22.675435Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:22.675454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:22.675457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:22.675459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:22.675473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894683107083939:2541]
2025-09-30T14:50:22.675478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894683107083939:2541]
2025-09-30T14:50:22.675482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894683107083939:2541]
2025-09-30T14:50:22.675529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:22.675533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:22.675536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.675539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:22.675540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:22.675544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:22.675692Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:22.683932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 25 sessionId: src_id|edd2ee3f-188c3b8a-68ec0057-acf6c16d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:22.686911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:22.743340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894683196806368:2517]
2025-09-30T14:50:22.746194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 24, pipe: [1:7555894683196806368:2517]
2025-09-30T14:50:22.792624Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:22.792995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:22.793006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:22.793026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894683196806368:2517], now have 1 active actors on pipe
2025-09-30T14:50:22.793275Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:22.793330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894683196806368:2517]
2025-09-30T14:50:22.793357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:22.793386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:22.793389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:22.793450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 25 reason: error at write: Disconnected sessionId: src_id|edd2ee3f-188c3b8a-68ec0057-acf6c16d_0
2025-09-30T14:50:22.793606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 25 sessionId: src_id|edd2ee3f-188c3b8a-68ec0057-acf6c16d_0 is DEAD
2025-09-30T14:50:22.795330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edd2ee3f-188c3b8a-68ec0057-acf6c16d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:22.795345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edd2ee3f-188c3b8a-68ec0057-acf6c16d_0] Write session will restart in 0.007112s
2025-09-30T14:50:22.795374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edd2ee3f-188c3b8a-68ec0057-acf6c16d_0] Write session: Do CDS request
2025-09-30T14:50:22.795380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edd2ee3f-188c3b8a-68ec0057-acf6c16d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:22.807748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edd2ee3f-188c3b8a-68ec0057-acf6c16d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:22.807893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:22.807908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 26
2025-09-30T14:50:22.808074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 26 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:22.808128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 26 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:22.808138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=26 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:22.808143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:22.808578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 26 sessionId:  describe result for acl check
2025-09-30T14:50:22.808612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:22.808617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:22.808619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:22.808625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894683196806410:2656] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:22.809191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894683196806410:2656] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:22.809883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:22.810672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:22.810888Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:22.810897Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:22.810908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:22.810958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:22.811000Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894683107084025:2543]
2025-09-30T14:50:22.811327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894683196806410:2656] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:22.811718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:22.812068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:22.812120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:22.812487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:22.812571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:22.812577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:22.812579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:22.812580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:22.812581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:22.812582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:22.812583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:22.812585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:22.812587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:22.812588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:22.812589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.812590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.812592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.812593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:22.812594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:22.812601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:22.812611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:22.812616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:22.812620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:22.812624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:22.812628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:22.812632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:22.812637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:22.812641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:22.812646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:22.812650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.812654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.812658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.812662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:22.812667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:22.812676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:22.812683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:22.812690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:22.812695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:22.812700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:22.812704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:22.812708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:22.812714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:22.812718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:22.812723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:22.812727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:22.812734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:22.812740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:22.812750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:22.812755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:22.812760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:22.812768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:22.812774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:22.812780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:22.812785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:22.812797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.812802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.812806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.812811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.812815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.812820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.812830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:22.812836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:22.812845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:22.812850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:22.812912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:22.818665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894683196806410:2656] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:22.818691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894683196806410:2656] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:22.818695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894683196806410:2656] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:22.818718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 26 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:22.818710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:22.819695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:22.819712Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:22.819714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:22.819717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:22.819722Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 25 [2:7555894683107084025:2543]
2025-09-30T14:50:22.819738Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:22.819753Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:22.819757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:22.819761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:22.819763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:22.819780Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:22.819788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:22.819796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:22.819863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.819871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.819873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.819877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:22.819880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:22.819952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:22.819954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.819963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.819974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.819984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:22.820003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894683107084020:2543]
2025-09-30T14:50:22.820012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894683107084020:2543]
2025-09-30T14:50:22.820015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894683107084020:2543]
2025-09-30T14:50:22.820023Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:22.820035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:22.820038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:22.820045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:22.820047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:22.820052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:22.820055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:22.820065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894683196806449:2656], now have 1 active actors on pipe
2025-09-30T14:50:22.820074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894683196806369:2454], now have 1 active actors on pipe
2025-09-30T14:50:22.820108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894683107084020:2543]
2025-09-30T14:50:22.820121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:22.820152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:22.820163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:22.820168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:22.820117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 25
2025-09-30T14:50:22.820149Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 25
2025-09-30T14:50:22.820195Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7bc8a0ca-4a92fd50-79b166bf-3e52b88d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:22.820206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:22.820217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:22.820219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:22.820230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:22.820243Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:22.820261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:22.820444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:22.820454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:22.820472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:22.820555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 26 partition: 0 MaxSeqNo: 42 sessionId: src_id|7bc8a0ca-4a92fd50-79b166bf-3e52b88d_0
2025-09-30T14:50:22.820946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edd2ee3f-188c3b8a-68ec0057-acf6c16d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7bc8a0ca-4a92fd50-79b166bf-3e52b88d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:22.823963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc8a0ca-4a92fd50-79b166bf-3e52b88d_0] Write session: try to update token
2025-09-30T14:50:22.823984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc8a0ca-4a92fd50-79b166bf-3e52b88d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:22.832917Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:22.832936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:22.832938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:22.832940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:22.832949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894683107084020:2543]
2025-09-30T14:50:22.832953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894683107084020:2543]
2025-09-30T14:50:22.832961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894683107084020:2543]
2025-09-30T14:50:22.833009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:22.833013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:22.833016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.833019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:22.833020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:22.833024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:22.833164Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:22.841193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 26 sessionId: src_id|7bc8a0ca-4a92fd50-79b166bf-3e52b88d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:22.844033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:22.893267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894683196806457:2517]
2025-09-30T14:50:22.893623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 25, pipe: [1:7555894683196806457:2517]
E0930 14:50:22.906972722 2221260 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:11802: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-09-30T14:50:22.949092Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:22.949474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:22.949494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:22.949515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894683196806457:2517], now have 1 active actors on pipe
2025-09-30T14:50:22.949780Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:22.949778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:22.949795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:22.949862Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:22.949907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 26 reason: error at write: Disconnected sessionId: src_id|7bc8a0ca-4a92fd50-79b166bf-3e52b88d_0
2025-09-30T14:50:22.949912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894683196806457:2517]
2025-09-30T14:50:22.950187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 26 sessionId: src_id|7bc8a0ca-4a92fd50-79b166bf-3e52b88d_0 is DEAD
2025-09-30T14:50:22.951335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc8a0ca-4a92fd50-79b166bf-3e52b88d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:22.951348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc8a0ca-4a92fd50-79b166bf-3e52b88d_0] Write session will restart in 0.005780s
2025-09-30T14:50:22.951374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc8a0ca-4a92fd50-79b166bf-3e52b88d_0] Write session: Do CDS request
2025-09-30T14:50:22.951386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc8a0ca-4a92fd50-79b166bf-3e52b88d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:22.958724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc8a0ca-4a92fd50-79b166bf-3e52b88d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:22.958915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:22.958931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 27
2025-09-30T14:50:22.959314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 27 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:22.959359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 27 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:22.959365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=27 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:22.959370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:22.959728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:22.960441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:22.960660Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:22.960672Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:22.960683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:22.960745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:22.960823Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894683107084107:2545]
2025-09-30T14:50:22.959890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 27 sessionId:  describe result for acl check
2025-09-30T14:50:22.959940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:22.959943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:22.959945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:22.959952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894683196806509:2662] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:22.960582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894683196806509:2662] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:22.961516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:22.961993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:22.962047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:22.962439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:22.962515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:22.962517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:22.962518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:22.962519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:22.962521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:22.962523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:22.962524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:22.962525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:22.962526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:22.962527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:22.962528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.962530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.962531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.962532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:22.962533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:22.962540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:22.962550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:22.962555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:22.962559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:22.962563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:22.962567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:22.962572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:22.962576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:22.962580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:22.962585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:22.962588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.962591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.962595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.962598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:22.962602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:22.962610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:22.962621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:22.962627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:22.962632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:22.962640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:22.962646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:22.962650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:22.962655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:22.962661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:22.962666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:22.962683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:22.962688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:22.962694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:22.962699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:22.962703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:22.962708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:22.962713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:22.962718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:22.962723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:22.962742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:22.962747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.962754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.962759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.962765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.962770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.962776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.962780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:22.962786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:22.962791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:22.962795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:22.963085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894683196806509:2662] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:22.962851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:22.969373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894683196806509:2662] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:22.969392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894683196806509:2662] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:22.969396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894683196806509:2662] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:22.969405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 27 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:22.969710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:22.970692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:22.970710Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:22.970713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:22.970718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:22.970737Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 26 [2:7555894683107084107:2545]
2025-09-30T14:50:22.970760Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:22.970778Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:22.970785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:22.970789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:22.970793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:22.970809Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:22.970820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:22.970828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:22.970901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.970911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.970913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.970917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:22.970920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:22.970996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:22.971005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.971020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:22.971032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:22.971049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:22.971075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894683196806465:2454], now have 1 active actors on pipe
2025-09-30T14:50:22.971084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894683196806545:2662], now have 1 active actors on pipe
2025-09-30T14:50:22.971092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894683107084100:2545]
2025-09-30T14:50:22.971094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894683107084100:2545]
2025-09-30T14:50:22.971095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894683107084100:2545]
2025-09-30T14:50:22.971109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:22.971131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:22.971138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:22.971143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:22.971147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:22.971151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:22.971155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:22.971167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 26
2025-09-30T14:50:22.971175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 26
2025-09-30T14:50:22.971196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894683107084100:2545]
2025-09-30T14:50:22.971205Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:22.971209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:22.971233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:22.971265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:22.971314Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9e6c0f5-d789923e-3a46f62f-7328f414_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:22.971329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:22.971333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:22.971335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:22.971347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:22.971357Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:22.971391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:22.971583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:22.971592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:22.971609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:22.971698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 27 partition: 0 MaxSeqNo: 42 sessionId: src_id|f9e6c0f5-d789923e-3a46f62f-7328f414_0
2025-09-30T14:50:22.972093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc8a0ca-4a92fd50-79b166bf-3e52b88d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f9e6c0f5-d789923e-3a46f62f-7328f414_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:22.975066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9e6c0f5-d789923e-3a46f62f-7328f414_0] Write session: try to update token
2025-09-30T14:50:22.975085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9e6c0f5-d789923e-3a46f62f-7328f414_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:22.985253Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:22.985270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:22.985273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:22.985275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:22.985287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894683107084100:2545]
2025-09-30T14:50:22.985291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894683107084100:2545]
2025-09-30T14:50:22.985295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894683107084100:2545]
2025-09-30T14:50:22.985334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:22.985341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:22.985346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:22.985363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:22.985371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:22.985375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:22.985516Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:22.993762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 27 sessionId: src_id|f9e6c0f5-d789923e-3a46f62f-7328f414_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:22.996979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:23.049872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894687491773856:2517]
2025-09-30T14:50:23.050243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 26, pipe: [1:7555894687491773856:2517]
2025-09-30T14:50:23.103621Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:23.103913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:23.103933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:23.103953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894687491773856:2517], now have 1 active actors on pipe
2025-09-30T14:50:23.104156Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:23.104814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9e6c0f5-d789923e-3a46f62f-7328f414_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:23.104825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9e6c0f5-d789923e-3a46f62f-7328f414_0] Write session will restart in 0.007354s
2025-09-30T14:50:23.104849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9e6c0f5-d789923e-3a46f62f-7328f414_0] Write session: Do CDS request
2025-09-30T14:50:23.104855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9e6c0f5-d789923e-3a46f62f-7328f414_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:23.104119Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:23.104163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:23.104167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:23.104172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894687491773856:2517]
2025-09-30T14:50:23.104235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 27 reason: error at write: Disconnected sessionId: src_id|f9e6c0f5-d789923e-3a46f62f-7328f414_0
2025-09-30T14:50:23.104430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 27 sessionId: src_id|f9e6c0f5-d789923e-3a46f62f-7328f414_0 is DEAD
2025-09-30T14:50:23.113157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:23.113588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:23.113780Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:23.113789Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:23.113800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:23.113853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:23.114052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9e6c0f5-d789923e-3a46f62f-7328f414_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:23.113915Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894687402051521:2560]
2025-09-30T14:50:23.114098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:23.114112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 28
2025-09-30T14:50:23.114339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 28 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:23.114371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 28 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:23.114377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=28 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:23.114382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:23.114623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:23.114862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 28 sessionId:  describe result for acl check
2025-09-30T14:50:23.114918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:23.114926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:23.114928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:23.114934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894687491773927:2675] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:23.114981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:23.115040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:23.115465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:23.115546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:23.115553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:23.115554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:23.115555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:23.115557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:23.115476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894687491773927:2675] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:23.115558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:23.115560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:23.115561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:23.115562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:23.115563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:23.115564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.115566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.115567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.115569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:23.115570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:23.115577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:23.115587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:23.115593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:23.115597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:23.115602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:23.115606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:23.115612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:23.115616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:23.115622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:23.115627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:23.115631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.115635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.115639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.115643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:23.115647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:23.115656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:23.115664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:23.115669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:23.115675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:23.115686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:23.115703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:23.115710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:23.115715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:23.115720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:23.115726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:23.115731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:23.115736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:23.115741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:23.115746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:23.115755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:23.115761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:23.115770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:23.115776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:23.115784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:23.115790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:23.115797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.115803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.115808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.115818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.115824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.115834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.115839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:23.115848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:23.115853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:23.115862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:23.115909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:23.117282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894687491773927:2675] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:23.121200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894687491773927:2675] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:23.121217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894687491773927:2675] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:23.121223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894687491773927:2675] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:23.121232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 28 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:23.121627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:23.122522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:23.122539Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:23.122542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:23.122547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:23.122554Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 27 [2:7555894687402051521:2560]
2025-09-30T14:50:23.122571Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:23.122587Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:23.122594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:23.122598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:23.122601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:23.122619Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:23.122631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:23.122638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:23.122700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.122712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.122714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.122717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:23.122719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:23.122805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:23.122807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.122819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.122829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.122842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:23.122859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894687491773961:2675], now have 1 active actors on pipe
2025-09-30T14:50:23.122862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894687491773874:2454], now have 1 active actors on pipe
2025-09-30T14:50:23.122869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894687402051516:2560]
2025-09-30T14:50:23.122870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894687402051516:2560]
2025-09-30T14:50:23.122872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894687402051516:2560]
2025-09-30T14:50:23.122886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:23.122898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:23.122900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:23.122936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 27
2025-09-30T14:50:23.122901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:23.122962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 27
2025-09-30T14:50:23.122904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:23.122914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:23.122918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:23.122951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894687402051516:2560]
2025-09-30T14:50:23.122959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:23.122983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:23.123015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:23.123028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:23.123059Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5de9e5e-2102e0e4-6f46d692-165f8b63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:23.123066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:23.123076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:23.123078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:23.123088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:23.123098Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:23.123112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:23.123316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:23.123329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:23.123352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:23.123451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 28 partition: 0 MaxSeqNo: 42 sessionId: src_id|c5de9e5e-2102e0e4-6f46d692-165f8b63_0
2025-09-30T14:50:23.123886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9e6c0f5-d789923e-3a46f62f-7328f414_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c5de9e5e-2102e0e4-6f46d692-165f8b63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:23.127466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5de9e5e-2102e0e4-6f46d692-165f8b63_0] Write session: try to update token
2025-09-30T14:50:23.127492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5de9e5e-2102e0e4-6f46d692-165f8b63_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:23.135578Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:23.135594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:23.135607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894687402051516:2560]
2025-09-30T14:50:23.135649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:23.135651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:23.135833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:23.135990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:23.136157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:23.136308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:23.136514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:23.136565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:23.146807Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:23.146826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:23.146829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:23.146834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 28 sessionId: src_id|c5de9e5e-2102e0e4-6f46d692-165f8b63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:23.146831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:23.146842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894687402051516:2560]
2025-09-30T14:50:23.146847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894687402051516:2560]
2025-09-30T14:50:23.146851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894687402051516:2560]
2025-09-30T14:50:23.146893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:23.146897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:23.146904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.146904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:23.146907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:23.146908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:23.147074Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:23.150170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:23.204586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894687491773969:2517]
2025-09-30T14:50:23.204941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 27, pipe: [1:7555894687491773969:2517]
2025-09-30T14:50:23.265108Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:23.265562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:23.265578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:23.265601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894687491773969:2517], now have 1 active actors on pipe
2025-09-30T14:50:23.265847Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:23.267151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:23.267268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 28 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c5de9e5e-2102e0e4-6f46d692-165f8b63_0
2025-09-30T14:50:23.267505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 28 sessionId: src_id|c5de9e5e-2102e0e4-6f46d692-165f8b63_0 is DEAD
2025-09-30T14:50:23.267710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5de9e5e-2102e0e4-6f46d692-165f8b63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:23.267720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5de9e5e-2102e0e4-6f46d692-165f8b63_0] Write session will restart in 0.008899s
2025-09-30T14:50:23.267744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5de9e5e-2102e0e4-6f46d692-165f8b63_0] Write session: Do CDS request
2025-09-30T14:50:23.267750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5de9e5e-2102e0e4-6f46d692-165f8b63_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:23.267768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894687491773969:2517]
2025-09-30T14:50:23.267792Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:23.276591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:23.277136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:23.277337Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:23.277347Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:23.277358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:23.277410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:23.277456Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894687402051604:2562]
2025-09-30T14:50:23.277802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5de9e5e-2102e0e4-6f46d692-165f8b63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:23.277950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:23.277964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 29
2025-09-30T14:50:23.278079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 29 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:23.278108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 29 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:23.278119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=29 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:23.278124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:23.278212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:23.278579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:23.278614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 29 sessionId:  describe result for acl check
2025-09-30T14:50:23.278652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:23.278658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:23.278660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:23.278666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894687491774017:2679] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:23.278663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:23.279088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:23.279172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:23.279174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:23.279175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:23.279176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:23.279178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:23.279179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:23.279180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:23.279182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:23.279183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:23.279184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:23.279185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.279187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.279188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.279190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:23.279191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:23.279198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:23.279210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:23.279213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:23.279218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:23.279223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:23.279226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:23.279231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:23.279318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894687491774017:2679] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:23.279235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:23.279239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:23.279262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:23.279266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.279269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.279274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.279277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:23.279282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:23.279293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:23.279302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:23.279308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:23.279314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:23.279320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:23.279327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:23.279331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:23.279337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:23.279343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:23.279348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:23.279353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:23.279361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:23.279366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:23.279371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:23.279376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:23.279381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:23.279386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:23.279393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:23.279398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:23.279403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:23.279407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.279413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.279417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.279422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.279427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.279432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.279437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:23.279441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:23.279445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:23.279452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:23.279500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:23.283811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894687491774017:2679] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:23.286979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894687491774017:2679] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:23.287012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894687491774017:2679] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:23.287016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894687491774017:2679] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:23.287027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 29 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:23.288441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:23.289346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:23.289362Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:23.289366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:23.289370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:23.289378Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 28 [2:7555894687402051604:2562]
2025-09-30T14:50:23.289395Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:23.289413Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:23.289421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:23.289425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:23.289428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:23.289448Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:23.289455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:23.289462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:23.289530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.289538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.289541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.289544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:23.289548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:23.289624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:23.289632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.289647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.289665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.289686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:23.289706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894687402051599:2562]
2025-09-30T14:50:23.289714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894687402051599:2562]
2025-09-30T14:50:23.289716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894687402051599:2562]
2025-09-30T14:50:23.289729Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:23.289747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:23.289762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:23.289770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:23.289809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894687402051599:2562]
2025-09-30T14:50:23.289815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:23.289848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894687491774053:2679], now have 1 active actors on pipe
2025-09-30T14:50:23.289853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894687491773970:2454], now have 1 active actors on pipe
2025-09-30T14:50:23.289949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:23.289957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:23.289960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:23.289966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:23.290142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 28
2025-09-30T14:50:23.290183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 28
2025-09-30T14:50:23.295451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:23.295475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:23.295522Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e922a04d-a28d8edb-b5bf3564-80a9be52_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:23.295536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:23.295540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:23.295544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:23.295563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:23.295587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:23.295612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:23.295895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:23.295921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:23.295951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:23.296076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 29 partition: 0 MaxSeqNo: 42 sessionId: src_id|e922a04d-a28d8edb-b5bf3564-80a9be52_0
2025-09-30T14:50:23.296522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5de9e5e-2102e0e4-6f46d692-165f8b63_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e922a04d-a28d8edb-b5bf3564-80a9be52_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:23.299939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e922a04d-a28d8edb-b5bf3564-80a9be52_0] Write session: try to update token
2025-09-30T14:50:23.299962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e922a04d-a28d8edb-b5bf3564-80a9be52_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:23.303118Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:23.303137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:23.303140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:23.303143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:23.303153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894687402051599:2562]
2025-09-30T14:50:23.303158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894687402051599:2562]
2025-09-30T14:50:23.303163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894687402051599:2562]
2025-09-30T14:50:23.303209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:23.303217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.303215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:23.303221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:23.303223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:23.303240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:23.303399Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:23.318581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 29 sessionId: src_id|e922a04d-a28d8edb-b5bf3564-80a9be52_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:23.321804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:23.367854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894687491774062:2517]
2025-09-30T14:50:23.368107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 28, pipe: [1:7555894687491774062:2517]
2025-09-30T14:50:23.424743Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:23.425114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:23.425132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:23.425152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894687491774062:2517], now have 1 active actors on pipe
2025-09-30T14:50:23.425412Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:23.425864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e922a04d-a28d8edb-b5bf3564-80a9be52_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:23.425880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e922a04d-a28d8edb-b5bf3564-80a9be52_0] Write session will restart in 0.005662s
2025-09-30T14:50:23.425392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:23.425421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:23.425424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:23.425469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894687491774062:2517]
2025-09-30T14:50:23.425493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 29 reason: error at write: Disconnected sessionId: src_id|e922a04d-a28d8edb-b5bf3564-80a9be52_0
2025-09-30T14:50:23.425668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 29 sessionId: src_id|e922a04d-a28d8edb-b5bf3564-80a9be52_0 is DEAD
2025-09-30T14:50:23.425904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e922a04d-a28d8edb-b5bf3564-80a9be52_0] Write session: Do CDS request
2025-09-30T14:50:23.425929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e922a04d-a28d8edb-b5bf3564-80a9be52_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:23.432788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e922a04d-a28d8edb-b5bf3564-80a9be52_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:23.432870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:23.432885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 30
2025-09-30T14:50:23.433296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 30 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:23.433333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 30 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:23.433339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=30 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:23.433343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:23.433952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 30 sessionId:  describe result for acl check
2025-09-30T14:50:23.433988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:23.433996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:23.433997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:23.434004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894687491774101:2684] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:23.434560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894687491774101:2684] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:23.435668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:23.436872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894687491774101:2684] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:23.436394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:23.436607Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:23.436610Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:23.436619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:23.436675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:23.436710Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894687402051690:2565]
2025-09-30T14:50:23.437353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:23.437660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:23.437711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:23.438148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:23.438240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:23.438241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:23.438243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:23.438244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:23.438246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:23.438247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:23.438248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:23.438250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:23.438251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:23.438252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:23.438253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.438255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.438256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.438258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:23.438259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:23.438266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:23.438276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:23.438280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:23.438283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:23.438287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:23.438291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:23.438294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:23.438298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:23.438302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:23.438307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:23.438310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.438314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.438317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.438321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:23.438325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:23.438332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:23.438340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:23.438346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:23.438351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:23.438355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:23.438361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:23.438366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:23.438373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:23.438378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:23.438384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:23.438389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:23.438393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:23.438398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:23.438404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:23.438409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:23.438415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:23.438420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:23.438425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:23.438429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:23.438434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:23.438439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.438444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.438448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.438453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.438457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.438463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.438467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:23.438473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:23.438477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:23.438486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:23.438532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:23.444866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894687491774101:2684] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:23.444884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894687491774101:2684] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:23.444889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894687491774101:2684] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:23.444920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 30 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:23.446996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:23.448058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:23.448081Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:23.448084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:23.448089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:23.448096Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 29 [2:7555894687402051690:2565]
2025-09-30T14:50:23.448115Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:23.448133Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:23.448139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:23.448142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:23.448145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:23.448163Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:23.448170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:23.448183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:23.448260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.448271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.448274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.448278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:23.448281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:23.448569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 29
2025-09-30T14:50:23.448571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 29
2025-09-30T14:50:23.448362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:23.448371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.448384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.448398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.448414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:23.448433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894687402051685:2565]
2025-09-30T14:50:23.448436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894687402051685:2565]
2025-09-30T14:50:23.448438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894687402051685:2565]
2025-09-30T14:50:23.448447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:23.448461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:23.448464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:23.448467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:23.448470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:23.448478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:23.448482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:23.448492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894687491774149:2684], now have 1 active actors on pipe
2025-09-30T14:50:23.448496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894687491774065:2454], now have 1 active actors on pipe
2025-09-30T14:50:23.448534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894687402051685:2565]
2025-09-30T14:50:23.448545Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:23.448557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:23.448611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:23.448616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:23.448645Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d4bfce-2a7f646c-2afb39e6-f3d3cbd8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:23.448652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:23.448656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:23.448659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:23.448669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:23.448678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:23.448693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:23.448909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:23.448918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:23.448932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:23.449036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 30 partition: 0 MaxSeqNo: 42 sessionId: src_id|8d4bfce-2a7f646c-2afb39e6-f3d3cbd8_0
2025-09-30T14:50:23.449430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e922a04d-a28d8edb-b5bf3564-80a9be52_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8d4bfce-2a7f646c-2afb39e6-f3d3cbd8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:23.452363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d4bfce-2a7f646c-2afb39e6-f3d3cbd8_0] Write session: try to update token
2025-09-30T14:50:23.452387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d4bfce-2a7f646c-2afb39e6-f3d3cbd8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:23.465322Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:23.465341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:23.465352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894687402051685:2565]
2025-09-30T14:50:23.465397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:23.465588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:23.465750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:23.465908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:23.465955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:23.466062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:23.466269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:23.466315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:23.468467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 30 sessionId: src_id|8d4bfce-2a7f646c-2afb39e6-f3d3cbd8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:23.471407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:23.471659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:23.471689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:23.471727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:23.471833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:23.477329Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:23.477352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:23.477355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:23.477361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:23.477373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894687402051685:2565]
2025-09-30T14:50:23.477378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894687402051685:2565]
2025-09-30T14:50:23.477382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894687402051685:2565]
2025-09-30T14:50:23.477432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:23.477439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.477443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:23.477515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:23.477530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:23.477535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:23.477586Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:23.525604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894687491774156:2517]
2025-09-30T14:50:23.525885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 29, pipe: [1:7555894687491774156:2517]
2025-09-30T14:50:23.595659Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:23.605549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:23.605577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:23.605764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:23.605843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:23.605917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:23.605994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:23.606044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:23.606054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:23.606133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:23.606206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:23.606286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:23.606367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:23.606420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:23.606427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:23.606515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:23.606591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:23.606669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:23.606758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:23.606811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:23.606819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:23.606892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:23.607017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:23.607094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:23.607164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:23.607222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:23.607225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:23.607353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:23.607421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:23.607490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:23.607556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:23.607604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:23.607611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:23.607683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:23.607753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:23.607827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:23.607899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:23.607949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:23.607958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:23.608141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:23.608223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:23.608296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:23.608377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:23.608426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:23.608437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:23.608514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:23.608590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:23.608663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:23.608739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:23.608848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:23.608857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:23.608932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:23.609003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:23.609073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:23.609142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:23.609205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:23.609216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:23.609291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:23.609958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:23.609971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:23.610006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 30 reason: error at write: Disconnected sessionId: src_id|8d4bfce-2a7f646c-2afb39e6-f3d3cbd8_0
2025-09-30T14:50:23.610222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 30 sessionId: src_id|8d4bfce-2a7f646c-2afb39e6-f3d3cbd8_0 is DEAD
2025-09-30T14:50:23.610304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894687491774156:2517]
2025-09-30T14:50:23.610340Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:23.610381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d4bfce-2a7f646c-2afb39e6-f3d3cbd8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:23.610397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d4bfce-2a7f646c-2afb39e6-f3d3cbd8_0] Write session will restart in 0.006420s
2025-09-30T14:50:23.610434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d4bfce-2a7f646c-2afb39e6-f3d3cbd8_0] Write session: Do CDS request
2025-09-30T14:50:23.610441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d4bfce-2a7f646c-2afb39e6-f3d3cbd8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:23.609388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:23.609517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:23.609591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:23.609639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:23.609643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:23.609716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894687491774156:2517], now have 1 active actors on pipe
2025-09-30T14:50:23.610899Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:23.617846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d4bfce-2a7f646c-2afb39e6-f3d3cbd8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:23.617984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:23.617997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 31
2025-09-30T14:50:23.618804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 31 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:23.618846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 31 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:23.618852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=31 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:23.618857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:23.619357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 31 sessionId:  describe result for acl check
2025-09-30T14:50:23.619394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:23.619399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:23.619403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:23.619409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894687491774202:2688] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:23.620013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894687491774202:2688] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:23.620847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:23.621738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:23.622425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894687491774202:2688] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:23.621956Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:23.621970Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:23.621981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:23.622040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:23.622081Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894687402051787:2568]
2025-09-30T14:50:23.622838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:23.623155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:23.623202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:23.623607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:23.623686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:23.623692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:23.623694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:23.623695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:23.623696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:23.623697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:23.623699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:23.623700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:23.623701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:23.623702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:23.623703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.623705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.623706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.623707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:23.623708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:23.623714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:23.623723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:23.623727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:23.623731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:23.623735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:23.623739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:23.623743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:23.623747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:23.623751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:23.623756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:23.623760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.623765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.623769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.623773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:23.623777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:23.623786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:23.623794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:23.623800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:23.623807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:23.623811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:23.623816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:23.623820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:23.623827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:23.623832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:23.623837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:23.623841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:23.623846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:23.623851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:23.623856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:23.623860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:23.623865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:23.623870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:23.623875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:23.623879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:23.623883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:23.623888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.623892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.623896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.623901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.623905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.623910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.623914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:23.623919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:23.623924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:23.623929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:23.623973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:23.629582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894687491774202:2688] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:23.629598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894687491774202:2688] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:23.629601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894687491774202:2688] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:23.629608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 31 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:23.629900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:23.630927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:23.630944Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:23.630948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:23.630951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:23.630963Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 30 [2:7555894687402051787:2568]
2025-09-30T14:50:23.630980Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:23.630997Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:23.631001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:23.631005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:23.631008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:23.631026Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:23.631038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:23.631045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:23.631110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.631118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.631121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.631124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:23.631126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:23.631214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:23.631225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.631239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.631268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.631284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:23.631309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894687491774159:2454], now have 1 active actors on pipe
2025-09-30T14:50:23.631318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894687491774243:2688], now have 1 active actors on pipe
2025-09-30T14:50:23.631324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894687402051782:2568]
2025-09-30T14:50:23.631326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894687402051782:2568]
2025-09-30T14:50:23.631328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894687402051782:2568]
2025-09-30T14:50:23.631345Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:23.631360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:23.631369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:23.631373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:23.631376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:23.631378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:23.631382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:23.631421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894687402051782:2568]
2025-09-30T14:50:23.631428Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:23.631404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 30
2025-09-30T14:50:23.631420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 30
2025-09-30T14:50:23.631442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:23.631477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:23.631488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:23.631513Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a685c5c-691f7f6c-1760dd8c-d5c9bbfa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:23.631525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:23.631533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:23.631535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:23.631547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:23.631557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:23.631573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:23.631768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:23.631782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:23.631808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:23.631897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 31 partition: 0 MaxSeqNo: 42 sessionId: src_id|5a685c5c-691f7f6c-1760dd8c-d5c9bbfa_0
2025-09-30T14:50:23.632321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d4bfce-2a7f646c-2afb39e6-f3d3cbd8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5a685c5c-691f7f6c-1760dd8c-d5c9bbfa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:23.636151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a685c5c-691f7f6c-1760dd8c-d5c9bbfa_0] Write session: try to update token
2025-09-30T14:50:23.636177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a685c5c-691f7f6c-1760dd8c-d5c9bbfa_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:23.643894Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:23.643912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:23.643915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:23.643918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:23.643929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894687402051782:2568]
2025-09-30T14:50:23.643933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894687402051782:2568]
2025-09-30T14:50:23.643939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894687402051782:2568]
2025-09-30T14:50:23.643981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:23.643992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:23.643996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.643999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:23.644007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:23.644011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:23.644155Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:23.657979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 31 sessionId: src_id|5a685c5c-691f7f6c-1760dd8c-d5c9bbfa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:23.661325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:23.710416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894687491774264:2517]
2025-09-30T14:50:23.710745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 30, pipe: [1:7555894687491774264:2517]
2025-09-30T14:50:23.764027Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:23.764429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:23.764444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:23.764465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894687491774264:2517], now have 1 active actors on pipe
2025-09-30T14:50:23.764689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:23.764702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:23.764712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894687491774264:2517]
2025-09-30T14:50:23.764734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:23.764766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 31 reason: error at write: Disconnected sessionId: src_id|5a685c5c-691f7f6c-1760dd8c-d5c9bbfa_0
2025-09-30T14:50:23.764954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 31 sessionId: src_id|5a685c5c-691f7f6c-1760dd8c-d5c9bbfa_0 is DEAD
2025-09-30T14:50:23.764710Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:23.765121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a685c5c-691f7f6c-1760dd8c-d5c9bbfa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:23.765141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a685c5c-691f7f6c-1760dd8c-d5c9bbfa_0] Write session will restart in 0.007248s
2025-09-30T14:50:23.765165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a685c5c-691f7f6c-1760dd8c-d5c9bbfa_0] Write session: Do CDS request
2025-09-30T14:50:23.765175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a685c5c-691f7f6c-1760dd8c-d5c9bbfa_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:23.774034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a685c5c-691f7f6c-1760dd8c-d5c9bbfa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:23.774125Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:23.774142Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 32
2025-09-30T14:50:23.774270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 32 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:23.774303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 32 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:23.774309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=32 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:23.774314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:23.774912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 32 sessionId:  describe result for acl check
2025-09-30T14:50:23.774956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:23.774963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:23.774966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:23.774985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894687491774294:2693] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:23.775625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894687491774294:2693] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:23.777587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:23.778286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:23.778527Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:23.778538Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:23.778552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:23.778618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:23.778670Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894687402051873:2570]
2025-09-30T14:50:23.779459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:23.779953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:23.780021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:23.780419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:23.780518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:23.780525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:23.780526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:23.780527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:23.780529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:23.780530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:23.780532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:23.780533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:23.780534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:23.780535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:23.780536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.780537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.780539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.780540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:23.780541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:23.780548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:23.780558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:23.780562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:23.780566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:23.780569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:23.780573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:23.780577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:23.780581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:23.780586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:23.780590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:23.780594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.780597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.780601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.780605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:23.780609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:23.780618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:23.780630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:23.780637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:23.780642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:23.780646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:23.780652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:23.780656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:23.780661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:23.780665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:23.780670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:23.780674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:23.780679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:23.780684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:23.780689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:23.780693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:23.780698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:23.780702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:23.780707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:23.780712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:23.780718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:23.780723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.780728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.780733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.780738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.780743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.780748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.780639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894687491774294:2693] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:23.780752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:23.780756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:23.780761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:23.780765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:23.780809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:23.786440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894687491774294:2693] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:23.786459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894687491774294:2693] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:23.786463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894687491774294:2693] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:23.786499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 32 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:23.786793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:23.787682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:23.787699Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:23.787705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:23.787709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:23.787715Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 31 [2:7555894687402051873:2570]
2025-09-30T14:50:23.787733Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:23.787750Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:23.787758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:23.787761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:23.787763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:23.787781Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:23.787794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:23.787802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:23.787873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.787885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.787887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.787891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:23.787893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:23.787968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:23.787978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.787992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.788005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.788022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:23.788045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894687491774265:2454], now have 1 active actors on pipe
2025-09-30T14:50:23.788055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894687491774350:2693], now have 1 active actors on pipe
2025-09-30T14:50:23.788061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894687402051868:2570]
2025-09-30T14:50:23.788068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894687402051868:2570]
2025-09-30T14:50:23.788071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894687402051868:2570]
2025-09-30T14:50:23.788087Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:23.788101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:23.788110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:23.788115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:23.788118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:23.788122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:23.788125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:23.788110Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 31
2025-09-30T14:50:23.788111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 31
2025-09-30T14:50:23.788165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894687402051868:2570]
2025-09-30T14:50:23.788175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:23.788179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:23.788191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:23.788197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:23.788250Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1dc5cf4e-356201e7-3c07e4bf-61672665_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:23.788263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:23.788267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:23.788269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:23.788280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:23.788289Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:23.788319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:23.788461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:23.788468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:23.788481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:23.788559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 32 partition: 0 MaxSeqNo: 42 sessionId: src_id|1dc5cf4e-356201e7-3c07e4bf-61672665_0
2025-09-30T14:50:23.788959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a685c5c-691f7f6c-1760dd8c-d5c9bbfa_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1dc5cf4e-356201e7-3c07e4bf-61672665_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:23.791862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dc5cf4e-356201e7-3c07e4bf-61672665_0] Write session: try to update token
2025-09-30T14:50:23.791881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dc5cf4e-356201e7-3c07e4bf-61672665_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:23.805018Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:23.805043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:23.805046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:23.805048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:23.805058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894687402051868:2570]
2025-09-30T14:50:23.805067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894687402051868:2570]
2025-09-30T14:50:23.805071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894687402051868:2570]
2025-09-30T14:50:23.805121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:23.805128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.805137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:23.805136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:23.805169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:23.805184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:23.805296Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:23.809699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 32 sessionId: src_id|1dc5cf4e-356201e7-3c07e4bf-61672665_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:23.812923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:23.865035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894687491774359:2517]
2025-09-30T14:50:23.865501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 31, pipe: [1:7555894687491774359:2517]
2025-09-30T14:50:23.923437Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:23.923777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:23.923797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:23.924473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:23.924525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:23.924528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:23.924531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894687491774359:2517]
2025-09-30T14:50:23.925030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dc5cf4e-356201e7-3c07e4bf-61672665_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:23.925043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dc5cf4e-356201e7-3c07e4bf-61672665_0] Write session will restart in 0.005919s
2025-09-30T14:50:23.925067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dc5cf4e-356201e7-3c07e4bf-61672665_0] Write session: Do CDS request
2025-09-30T14:50:23.925086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dc5cf4e-356201e7-3c07e4bf-61672665_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:23.923852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894687491774359:2517], now have 1 active actors on pipe
2025-09-30T14:50:23.926145Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:23.924597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 32 reason: error at write: Disconnected sessionId: src_id|1dc5cf4e-356201e7-3c07e4bf-61672665_0
2025-09-30T14:50:23.924829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 32 sessionId: src_id|1dc5cf4e-356201e7-3c07e4bf-61672665_0 is DEAD
2025-09-30T14:50:23.931771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dc5cf4e-356201e7-3c07e4bf-61672665_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:23.931899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:23.931926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 33
2025-09-30T14:50:23.932053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 33 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:23.932084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 33 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:23.932094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=33 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:23.932098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:23.932625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 33 sessionId:  describe result for acl check
2025-09-30T14:50:23.932666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:23.932672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:23.932674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:23.932683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894687491774381:2697] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:23.933287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894687491774381:2697] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:23.935361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:23.935791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894687491774381:2697] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:23.935967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:23.936187Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:23.936197Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:23.936210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:23.936264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:23.936317Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894687402051959:2572]
2025-09-30T14:50:23.937031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:23.937708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:23.937763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:23.938129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:23.938223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:23.938229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:23.938230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:23.938231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:23.938232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:23.938233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:23.938235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:23.938236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:23.938237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:23.938238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:23.938239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.938240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.938241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.938243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:23.938244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:23.938250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:23.938259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:23.938263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:23.938266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:23.938270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:23.938273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:23.938276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:23.938279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:23.938283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:23.938287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:23.938290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.938293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.938296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.938300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:23.938303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:23.938311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:23.938319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:23.938324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:23.938329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:23.938333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:23.938337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:23.938342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:23.938347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:23.938352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:23.938357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:23.938362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:23.938366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:23.938372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:23.938377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:23.938381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:23.938386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:23.938391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:23.938396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:23.938401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:23.938406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:23.938410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.938414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.938419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.938424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.938429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.938433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.938437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:23.938441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:23.938446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:23.938459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:23.938507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:23.939917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894687491774381:2697] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:23.939940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894687491774381:2697] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:23.939944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894687491774381:2697] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:23.939954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 33 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:23.944910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:23.945861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:23.945881Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:23.945885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:23.945890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:23.945897Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 32 [2:7555894687402051959:2572]
2025-09-30T14:50:23.945916Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:23.945934Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:23.945938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:23.945941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:23.945944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:23.945963Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:23.946372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 32
2025-09-30T14:50:23.946425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 32
2025-09-30T14:50:23.945970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:23.945977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:23.946056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.946058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.946061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.946064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:23.946067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:23.946143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:23.946146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.946161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:23.946174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:23.946191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:23.946208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894687402051954:2572]
2025-09-30T14:50:23.946211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894687402051954:2572]
2025-09-30T14:50:23.946213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894687402051954:2572]
2025-09-30T14:50:23.946223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:23.946233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:23.946237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:23.946239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:23.946239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:23.946254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:23.946257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:23.946271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894687491774360:2454], now have 1 active actors on pipe
2025-09-30T14:50:23.946276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894687491774453:2697], now have 1 active actors on pipe
2025-09-30T14:50:23.946311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894687402051954:2572]
2025-09-30T14:50:23.946319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:23.946540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:23.947428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:23.947447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:23.947477Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cbd1f5b5-13ba8843-d6b4a066-13b29298_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:23.947492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:23.947502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:23.947504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:23.947516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:23.947537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:23.947555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:23.947798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:23.947810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:23.947833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:23.947961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 33 partition: 0 MaxSeqNo: 42 sessionId: src_id|cbd1f5b5-13ba8843-d6b4a066-13b29298_0
2025-09-30T14:50:23.951418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dc5cf4e-356201e7-3c07e4bf-61672665_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cbd1f5b5-13ba8843-d6b4a066-13b29298_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:23.954311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbd1f5b5-13ba8843-d6b4a066-13b29298_0] Write session: try to update token
2025-09-30T14:50:23.954332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbd1f5b5-13ba8843-d6b4a066-13b29298_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:23.960842Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:23.960863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:23.960867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:23.960869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:23.960880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894687402051954:2572]
2025-09-30T14:50:23.960885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894687402051954:2572]
2025-09-30T14:50:23.960889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894687402051954:2572]
2025-09-30T14:50:23.960937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:23.960953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:23.960961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:23.961113Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:23.962334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:23.962348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:23.962353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:23.981934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 33 sessionId: src_id|cbd1f5b5-13ba8843-d6b4a066-13b29298_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:23.984879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:24.024778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894691786741760:2517]
2025-09-30T14:50:24.025363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 32, pipe: [1:7555894691786741760:2517]
2025-09-30T14:50:24.082139Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:24.082497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:24.082516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:24.082537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894691786741760:2517], now have 1 active actors on pipe
2025-09-30T14:50:24.082898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894691786741760:2517]
2025-09-30T14:50:24.082911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:24.082938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:24.082941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:24.083019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 33 reason: error at write: Disconnected sessionId: src_id|cbd1f5b5-13ba8843-d6b4a066-13b29298_0
2025-09-30T14:50:24.083011Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:24.083213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 33 sessionId: src_id|cbd1f5b5-13ba8843-d6b4a066-13b29298_0 is DEAD
2025-09-30T14:50:24.083357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbd1f5b5-13ba8843-d6b4a066-13b29298_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:24.083367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbd1f5b5-13ba8843-d6b4a066-13b29298_0] Write session will restart in 0.007176s
2025-09-30T14:50:24.083391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbd1f5b5-13ba8843-d6b4a066-13b29298_0] Write session: Do CDS request
2025-09-30T14:50:24.083400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbd1f5b5-13ba8843-d6b4a066-13b29298_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:24.095756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbd1f5b5-13ba8843-d6b4a066-13b29298_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:24.095871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:24.095890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 34
2025-09-30T14:50:24.095961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:24.096079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 34 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:24.096113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 34 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:24.096118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=34 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:24.096129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:24.096532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 34 sessionId:  describe result for acl check
2025-09-30T14:50:24.096564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:24.096571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:24.096573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:24.096580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894691786741812:2703] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:24.096620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:24.096860Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:24.096870Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:24.096881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:24.096945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:24.096985Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894691697019359:2581]
2025-09-30T14:50:24.097100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894691786741812:2703] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:24.097869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:24.098255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:24.098321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:24.098709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:24.098793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:24.098799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:24.098800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:24.098802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:24.098803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:24.098804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:24.098805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:24.098807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:24.098808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:24.098809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:24.098810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.098811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.098813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.098814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:24.098815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:24.098821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:24.098831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:24.098835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:24.098838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:24.098841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:24.098845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:24.098849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:24.098852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:24.098856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:24.098860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:24.098864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.098868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.098872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.098875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:24.098879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:24.098890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:24.098899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:24.098905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:24.098916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:24.098921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:24.098927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:24.098937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:24.098943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:24.098948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:24.098955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:24.098960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:24.098970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:24.098975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:24.098980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:24.098985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:24.098996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:24.099001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:24.099007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:24.099012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:24.099017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:24.099021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.099026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.099030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.099036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.099043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.099048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.099052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:24.099056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:24.099061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:24.099068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:24.099122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:24.099463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894691786741812:2703] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:24.104796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894691786741812:2703] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:24.104817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894691786741812:2703] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:24.104822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894691786741812:2703] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:24.104832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 34 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:24.108692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:24.109690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:24.109710Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:24.109714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:24.109718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:24.109727Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 33 [2:7555894691697019359:2581]
2025-09-30T14:50:24.109745Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:24.109762Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:24.109765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:24.109768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:24.109771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:24.109790Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:24.109807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:24.109816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:24.109920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.109939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.109941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.109945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:24.109948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:24.110081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:24.110085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.110107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.110119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.110135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:24.110159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894691786741762:2454], now have 1 active actors on pipe
2025-09-30T14:50:24.110162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894691786741850:2703], now have 1 active actors on pipe
2025-09-30T14:50:24.110169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894691697019354:2581]
2025-09-30T14:50:24.110172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894691697019354:2581]
2025-09-30T14:50:24.110174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894691697019354:2581]
2025-09-30T14:50:24.110192Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:24.110209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:24.110219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:24.110223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:24.110224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:24.110225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:24.110227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:24.110266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894691697019354:2581]
2025-09-30T14:50:24.110285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:24.110329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:24.110414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:24.110422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:24.110461Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c1b4d66-dbbb74-b060451e-bd034a18_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:24.110471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:24.110475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:24.110478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:24.110496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:24.110511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:24.110531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:24.110751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:24.110765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:24.110787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:24.110219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 33
2025-09-30T14:50:24.110256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 33
2025-09-30T14:50:24.111776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbd1f5b5-13ba8843-d6b4a066-13b29298_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2c1b4d66-dbbb74-b060451e-bd034a18_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:24.111353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 34 partition: 0 MaxSeqNo: 42 sessionId: src_id|2c1b4d66-dbbb74-b060451e-bd034a18_0
2025-09-30T14:50:24.114753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1b4d66-dbbb74-b060451e-bd034a18_0] Write session: try to update token
2025-09-30T14:50:24.114772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1b4d66-dbbb74-b060451e-bd034a18_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:24.124075Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:24.124097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:24.124099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:24.124101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:24.124110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894691697019354:2581]
2025-09-30T14:50:24.124114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894691697019354:2581]
2025-09-30T14:50:24.124118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894691697019354:2581]
2025-09-30T14:50:24.124161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:24.124168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.124170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:24.124179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:24.124186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:24.124191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:24.124324Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:24.142844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 34 sessionId: src_id|2c1b4d66-dbbb74-b060451e-bd034a18_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:24.145572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:24.182477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894691786741879:2517]
2025-09-30T14:50:24.182810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 33, pipe: [1:7555894691786741879:2517]
2025-09-30T14:50:24.260024Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:24.260489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:24.260513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:24.260541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894691786741879:2517], now have 1 active actors on pipe
2025-09-30T14:50:24.260807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:24.260823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:24.260852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894691786741879:2517]
2025-09-30T14:50:24.260885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:24.260902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 34 reason: error at write: Disconnected sessionId: src_id|2c1b4d66-dbbb74-b060451e-bd034a18_0
2025-09-30T14:50:24.261081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 34 sessionId: src_id|2c1b4d66-dbbb74-b060451e-bd034a18_0 is DEAD
2025-09-30T14:50:24.261284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1b4d66-dbbb74-b060451e-bd034a18_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:24.261297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1b4d66-dbbb74-b060451e-bd034a18_0] Write session will restart in 0.005153s
2025-09-30T14:50:24.261332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1b4d66-dbbb74-b060451e-bd034a18_0] Write session: Do CDS request
2025-09-30T14:50:24.261338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1b4d66-dbbb74-b060451e-bd034a18_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:24.262181Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:24.270458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1b4d66-dbbb74-b060451e-bd034a18_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:24.270664Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:24.270678Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 35
2025-09-30T14:50:24.270830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 35 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:24.270865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 35 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:24.270875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=35 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:24.270879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:24.271453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 35 sessionId:  describe result for acl check
2025-09-30T14:50:24.271493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:24.271496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:24.271498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:24.271505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894691786741929:2714] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:24.272113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894691786741929:2714] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:24.273102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:24.273977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:24.274201Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:24.274206Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:24.274217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:24.274276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:24.274327Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894691697019471:2589]
2025-09-30T14:50:24.275055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:24.275370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:24.275436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:24.275979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:24.276066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:24.276067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:24.276092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894691786741929:2714] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:24.276069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:24.276070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:24.276072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:24.276073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:24.276075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:24.276076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:24.276077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:24.276078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:24.276080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.276082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.276083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.276084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:24.276086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:24.276092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:24.276104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:24.276108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:24.276113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:24.276118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:24.276122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:24.276126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:24.276131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:24.276136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:24.276140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:24.276156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.276160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.276164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.276168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:24.276171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:24.276180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:24.276188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:24.276194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:24.276200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:24.276204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:24.276209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:24.276214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:24.276220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:24.276224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:24.276229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:24.276233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:24.276239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:24.276247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:24.276252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:24.276257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:24.276262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:24.276267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:24.276272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:24.276276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:24.276281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:24.276286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.276291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.276295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.276300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.276306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.276311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.276316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:24.276322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:24.276326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:24.276331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:24.276377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:24.282222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894691786741929:2714] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:24.282240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894691786741929:2714] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:24.282244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894691786741929:2714] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:24.282253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 35 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:24.282608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:24.283578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:24.283596Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:24.283599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:24.283603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:24.283610Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 34 [2:7555894691697019471:2589]
2025-09-30T14:50:24.283629Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:24.283645Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:24.283653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:24.283656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:24.283659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:24.283681Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:24.283695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:24.283702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:24.283768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.283776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.283778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.283781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:24.283784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:24.283852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:24.283859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.283872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.283885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.283908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:24.283931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894691697019466:2589]
2025-09-30T14:50:24.283941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894691697019466:2589]
2025-09-30T14:50:24.283943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894691697019466:2589]
2025-09-30T14:50:24.283952Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:24.283966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:24.283978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:24.283981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:24.283984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:24.283993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:24.283997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:24.284026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894691786741971:2714], now have 1 active actors on pipe
2025-09-30T14:50:24.284039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894691786741881:2454], now have 1 active actors on pipe
2025-09-30T14:50:24.284042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894691697019466:2589]
2025-09-30T14:50:24.284049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:24.284065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:24.284140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 34
2025-09-30T14:50:24.284141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 34
2025-09-30T14:50:24.284242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:24.284258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:24.284305Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de92ec5b-91368bb-b3cabe80-a2feae87_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:24.284321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:24.284325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:24.284328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:24.284340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:24.284351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:24.284368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:24.284618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:24.284634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:24.284660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:24.284781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 35 partition: 0 MaxSeqNo: 42 sessionId: src_id|de92ec5b-91368bb-b3cabe80-a2feae87_0
2025-09-30T14:50:24.285184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1b4d66-dbbb74-b060451e-bd034a18_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|de92ec5b-91368bb-b3cabe80-a2feae87_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:24.288206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de92ec5b-91368bb-b3cabe80-a2feae87_0] Write session: try to update token
2025-09-30T14:50:24.288225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de92ec5b-91368bb-b3cabe80-a2feae87_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:24.296976Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:24.296996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:24.296999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:24.297002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:24.297026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894691697019466:2589]
2025-09-30T14:50:24.297032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894691697019466:2589]
2025-09-30T14:50:24.297037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894691697019466:2589]
2025-09-30T14:50:24.297084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:24.297093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.297100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:24.297280Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:24.298533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:24.298547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:24.298551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:24.304321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 35 sessionId: src_id|de92ec5b-91368bb-b3cabe80-a2feae87_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:24.310930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:24.361183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894691786741978:2517]
2025-09-30T14:50:24.361461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 34, pipe: [1:7555894691786741978:2517]
2025-09-30T14:50:24.418402Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:24.418788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:24.418805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:24.418828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894691786741978:2517], now have 1 active actors on pipe
2025-09-30T14:50:24.419101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:24.419119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:24.419196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 35 reason: error at write: Disconnected sessionId: src_id|de92ec5b-91368bb-b3cabe80-a2feae87_0
2025-09-30T14:50:24.419058Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:24.419415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 35 sessionId: src_id|de92ec5b-91368bb-b3cabe80-a2feae87_0 is DEAD
2025-09-30T14:50:24.419603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de92ec5b-91368bb-b3cabe80-a2feae87_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:24.419612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de92ec5b-91368bb-b3cabe80-a2feae87_0] Write session will restart in 0.008657s
2025-09-30T14:50:24.419638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de92ec5b-91368bb-b3cabe80-a2feae87_0] Write session: Do CDS request
2025-09-30T14:50:24.419644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de92ec5b-91368bb-b3cabe80-a2feae87_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:24.419515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:24.419576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894691786741978:2517]
2025-09-30T14:50:24.428431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:24.429111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:24.429351Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:24.429363Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:24.429376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:24.429444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:24.429485Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894691697019562:2592]
2025-09-30T14:50:24.429810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de92ec5b-91368bb-b3cabe80-a2feae87_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:24.429905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:24.429920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 36
2025-09-30T14:50:24.430109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 36 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:24.430151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 36 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:24.430160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=36 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:24.430165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:24.430173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:24.430550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:24.430599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:24.430635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 36 sessionId:  describe result for acl check
2025-09-30T14:50:24.430682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:24.430689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:24.430691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:24.430699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894691786742035:2719] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:24.430992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:24.431074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:24.431081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:24.431082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:24.431084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:24.431085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:24.431086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:24.431087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:24.431089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:24.431090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:24.431091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:24.431092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.431093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.431094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.431095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:24.431097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:24.431102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:24.431112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:24.431116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:24.431119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:24.431122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:24.431125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:24.431128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:24.431131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:24.431135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:24.431138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:24.431141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.431145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.431148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.431152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:24.431156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:24.431163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:24.431171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:24.431177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:24.431183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:24.431188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:24.431194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:24.431198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:24.431204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:24.431209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:24.431217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:24.431221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:24.431226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:24.431230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:24.431235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:24.431239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:24.431258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:24.431264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:24.431269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:24.431272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:24.431276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:24.431281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.431285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.431289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.431294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.431298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.431303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.431307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:24.431292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894691786742035:2719] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:24.431322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:24.431326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:24.431331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:24.431375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:24.433685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894691786742035:2719] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:24.437318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894691786742035:2719] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:24.437335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894691786742035:2719] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:24.437339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894691786742035:2719] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:24.437347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 36 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:24.437793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:24.439096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:24.439111Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:24.439114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:24.439118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:24.439125Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 35 [2:7555894691697019562:2592]
2025-09-30T14:50:24.439142Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:24.439159Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:24.439163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:24.439167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:24.439169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:24.439184Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:24.439197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:24.439204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:24.439285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.439293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.439295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.439299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:24.439302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:24.439375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:24.439383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.439398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.439414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.439432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:24.439454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894691786741982:2454], now have 1 active actors on pipe
2025-09-30T14:50:24.439464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894691786742071:2719], now have 1 active actors on pipe
2025-09-30T14:50:24.439471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894691697019557:2592]
2025-09-30T14:50:24.439474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894691697019557:2592]
2025-09-30T14:50:24.439476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894691697019557:2592]
2025-09-30T14:50:24.439486Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:24.439504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:24.439505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:24.439512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:24.439515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:24.439520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:24.439523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:24.439563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894691697019557:2592]
2025-09-30T14:50:24.439570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:24.439580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:24.439624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 35
2025-09-30T14:50:24.439651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 35
2025-09-30T14:50:24.439743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:24.439754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:24.439782Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f484aaa-7c7e1d6c-6260b072-b398eda1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:24.439796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:24.439805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:24.439807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:24.439819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:24.439831Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:24.439848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:24.440292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:24.440305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:24.440328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:24.440428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 36 partition: 0 MaxSeqNo: 42 sessionId: src_id|2f484aaa-7c7e1d6c-6260b072-b398eda1_0
2025-09-30T14:50:24.440869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de92ec5b-91368bb-b3cabe80-a2feae87_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2f484aaa-7c7e1d6c-6260b072-b398eda1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:24.443561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f484aaa-7c7e1d6c-6260b072-b398eda1_0] Write session: try to update token
2025-09-30T14:50:24.443577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f484aaa-7c7e1d6c-6260b072-b398eda1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:24.456700Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:24.456721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:24.456731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894691697019557:2592]
2025-09-30T14:50:24.456780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:24.456782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:24.456954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:24.457101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:24.457243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:24.457384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:24.457574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:24.457619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:24.468835Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:24.468853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:24.468856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:24.468858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:24.468869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894691697019557:2592]
2025-09-30T14:50:24.468873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894691697019557:2592]
2025-09-30T14:50:24.468878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894691697019557:2592]
2025-09-30T14:50:24.468920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:24.468927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.468926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:24.468930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:24.468934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:24.468939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:24.469084Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:24.474072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 36 sessionId: src_id|2f484aaa-7c7e1d6c-6260b072-b398eda1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:24.477130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:24.519845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894691786742079:2517]
2025-09-30T14:50:24.520105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 35, pipe: [1:7555894691786742079:2517]
2025-09-30T14:50:24.590357Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:24.590741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:24.590759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:24.590785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894691786742079:2517], now have 1 active actors on pipe
2025-09-30T14:50:24.591010Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:24.591112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:24.591163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:24.591165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:24.591226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 36 reason: error at write: Disconnected sessionId: src_id|2f484aaa-7c7e1d6c-6260b072-b398eda1_0
2025-09-30T14:50:24.591428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 36 sessionId: src_id|2f484aaa-7c7e1d6c-6260b072-b398eda1_0 is DEAD
2025-09-30T14:50:24.591575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f484aaa-7c7e1d6c-6260b072-b398eda1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:24.591587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f484aaa-7c7e1d6c-6260b072-b398eda1_0] Write session will restart in 0.008525s
2025-09-30T14:50:24.591610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f484aaa-7c7e1d6c-6260b072-b398eda1_0] Write session: Do CDS request
2025-09-30T14:50:24.591617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f484aaa-7c7e1d6c-6260b072-b398eda1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:24.591935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894691786742079:2517]
2025-09-30T14:50:24.601800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f484aaa-7c7e1d6c-6260b072-b398eda1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:24.601905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:24.601920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 37
2025-09-30T14:50:24.602031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 37 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:24.602064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 37 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:24.602074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=37 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:24.602078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:24.602781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 37 sessionId:  describe result for acl check
2025-09-30T14:50:24.602828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:24.602830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:24.602832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:24.602838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894691786742108:2723] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:24.603371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894691786742108:2723] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:24.606033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894691786742108:2723] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:24.605576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:24.606807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:24.607081Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:24.607087Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:24.607104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:24.607176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:24.607222Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894691697019655:2594]
2025-09-30T14:50:24.607940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:24.608289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:24.608354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:24.608780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:24.608845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:24.608847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:24.608848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:24.608850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:24.608851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:24.608852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:24.608853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:24.608854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:24.608856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:24.608857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:24.608858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.608859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.608861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.608862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:24.608863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:24.608869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:24.608878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:24.608883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:24.608887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:24.608891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:24.608895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:24.608898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:24.608903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:24.608908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:24.608913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:24.608917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.608922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.608926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.608931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:24.608936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:24.608944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:24.608953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:24.608960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:24.608966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:24.608970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:24.608976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:24.608981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:24.608988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:24.608993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:24.608999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:24.609004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:24.609010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:24.609016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:24.609022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:24.609027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:24.609033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:24.609039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:24.609045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:24.609050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:24.609056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:24.609061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.609068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.609073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.609079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.609085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.609091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.609096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:24.609103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:24.609120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:24.609126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:24.609177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:24.611959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894691786742108:2723] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:24.611978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894691786742108:2723] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:24.611981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894691786742108:2723] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:24.612009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 37 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:24.615154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:24.616319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:24.616338Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:24.616341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:24.616345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:24.616352Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 36 [2:7555894691697019655:2594]
2025-09-30T14:50:24.616373Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:24.616390Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:24.616393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:24.616397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:24.616400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:24.616419Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:24.616431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:24.616445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:24.616514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.616521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.616524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.616527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:24.616531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:24.616625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:24.616633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.616647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.616663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.616681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:24.616701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894691786742172:2723], now have 1 active actors on pipe
2025-09-30T14:50:24.616709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894691786742081:2454], now have 1 active actors on pipe
2025-09-30T14:50:24.616716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894691697019648:2594]
2025-09-30T14:50:24.616720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894691697019648:2594]
2025-09-30T14:50:24.616722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894691697019648:2594]
2025-09-30T14:50:24.616736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:24.616752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:24.616755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:24.616759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:24.616762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:24.616767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:24.616770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:24.616752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 36
2025-09-30T14:50:24.616755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 36
2025-09-30T14:50:24.616815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894691697019648:2594]
2025-09-30T14:50:24.616828Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:24.616835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:24.616843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:24.616848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:24.616901Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|743ae8f7-be88e6ad-2dfbd56-70f4ee28_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:24.616912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:24.616921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:24.616924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:24.616936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:24.616952Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:24.616970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:24.617173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:24.617188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:24.617320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 37 partition: 0 MaxSeqNo: 42 sessionId: src_id|743ae8f7-be88e6ad-2dfbd56-70f4ee28_0
2025-09-30T14:50:24.617227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:24.617716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f484aaa-7c7e1d6c-6260b072-b398eda1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|743ae8f7-be88e6ad-2dfbd56-70f4ee28_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:24.621173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|743ae8f7-be88e6ad-2dfbd56-70f4ee28_0] Write session: try to update token
2025-09-30T14:50:24.621193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|743ae8f7-be88e6ad-2dfbd56-70f4ee28_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:24.630492Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:24.630514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:24.630517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:24.630520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:24.630530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894691697019648:2594]
2025-09-30T14:50:24.630536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894691697019648:2594]
2025-09-30T14:50:24.630540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894691697019648:2594]
2025-09-30T14:50:24.630588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:24.630596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.630605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:24.630761Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:24.631989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:24.632004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:24.632010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:24.642786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 37 sessionId: src_id|743ae8f7-be88e6ad-2dfbd56-70f4ee28_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:24.645755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:24.690371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894691786742192:2517]
2025-09-30T14:50:24.690671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 36, pipe: [1:7555894691786742192:2517]
2025-09-30T14:50:24.751324Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:24.751765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:24.751786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:24.751818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894691786742192:2517], now have 1 active actors on pipe
2025-09-30T14:50:24.752143Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:24.752166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:24.752180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:24.752255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 37 reason: error at write: Disconnected sessionId: src_id|743ae8f7-be88e6ad-2dfbd56-70f4ee28_0
2025-09-30T14:50:24.752457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 37 sessionId: src_id|743ae8f7-be88e6ad-2dfbd56-70f4ee28_0 is DEAD
2025-09-30T14:50:24.752604Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:24.752617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894691786742192:2517]
2025-09-30T14:50:24.755575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|743ae8f7-be88e6ad-2dfbd56-70f4ee28_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:24.755589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|743ae8f7-be88e6ad-2dfbd56-70f4ee28_0] Write session will restart in 0.006114s
2025-09-30T14:50:24.755612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|743ae8f7-be88e6ad-2dfbd56-70f4ee28_0] Write session: Do CDS request
2025-09-30T14:50:24.755618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|743ae8f7-be88e6ad-2dfbd56-70f4ee28_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:24.762901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|743ae8f7-be88e6ad-2dfbd56-70f4ee28_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:24.762918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:24.762934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 38
2025-09-30T14:50:24.763157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 38 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:24.763198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 38 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:24.763209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=38 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:24.763214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:24.763821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:24.764126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 38 sessionId:  describe result for acl check
2025-09-30T14:50:24.764163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:24.764169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:24.764171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:24.764177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894691786742246:2728] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:24.764532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:24.764704Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:24.764712Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:24.764722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:24.764728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894691786742246:2728] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:24.764765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:24.764808Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894691697019757:2597]
2025-09-30T14:50:24.765533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:24.766050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:24.766121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:24.766502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:24.766582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:24.766588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:24.766590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:24.766591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:24.766592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:24.766593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:24.766594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:24.766596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:24.766597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:24.766598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:24.766599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.766600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.766602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.766604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:24.766605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:24.766611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:24.766621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:24.766625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:24.766629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:24.766632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:24.766636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:24.766639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:24.766643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:24.766647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:24.766651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:24.766655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.766658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.766662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.766665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:24.766669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:24.766678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:24.766685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:24.766692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:24.766697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:24.766701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:24.766707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:24.766711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:24.766716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:24.766731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:24.766736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:24.766741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:24.766745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:24.766750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:24.766754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:24.766759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:24.766764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:24.766769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:24.766773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:24.766777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:24.766781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:24.766786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.766791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.766801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.766813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.766818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.766822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.766826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:24.766830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:24.766834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:24.766839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:24.766885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:24.766904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894691786742246:2728] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:24.772902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894691786742246:2728] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:24.772921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894691786742246:2728] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:24.772925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894691786742246:2728] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:24.772935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 38 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:24.773058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:24.774106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:24.774124Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:24.774127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:24.774132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:24.774139Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 37 [2:7555894691697019757:2597]
2025-09-30T14:50:24.774157Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:24.774179Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:24.774186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:24.774190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:24.774193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:24.774212Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:24.774223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:24.774231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:24.774297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.774304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.774306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.774310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:24.774312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:24.774380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:24.774387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.774400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.774417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.774439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:24.774463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894691786742194:2454], now have 1 active actors on pipe
2025-09-30T14:50:24.774471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894691786742286:2728], now have 1 active actors on pipe
2025-09-30T14:50:24.774478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894691697019752:2597]
2025-09-30T14:50:24.774483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894691697019752:2597]
2025-09-30T14:50:24.774490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894691697019752:2597]
2025-09-30T14:50:24.774504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:24.774513Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 37
2025-09-30T14:50:24.774532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 37
2025-09-30T14:50:24.774524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:24.774530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:24.774535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:24.774537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:24.774550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:24.774553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:24.774606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:24.774611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:24.774628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894691697019752:2597]
2025-09-30T14:50:24.774636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:24.774650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:24.774665Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f69e9625-42488892-a101ca71-a92fbf28_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:24.774673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:24.774676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:24.774678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:24.774689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:24.774699Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:24.774735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:24.774898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:24.774905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:24.774920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:24.775027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 38 partition: 0 MaxSeqNo: 42 sessionId: src_id|f69e9625-42488892-a101ca71-a92fbf28_0
2025-09-30T14:50:24.775443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|743ae8f7-be88e6ad-2dfbd56-70f4ee28_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f69e9625-42488892-a101ca71-a92fbf28_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:24.778522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f69e9625-42488892-a101ca71-a92fbf28_0] Write session: try to update token
2025-09-30T14:50:24.778542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f69e9625-42488892-a101ca71-a92fbf28_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:24.787463Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:24.787486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:24.787488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:24.787491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:24.787501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894691697019752:2597]
2025-09-30T14:50:24.787508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894691697019752:2597]
2025-09-30T14:50:24.787516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894691697019752:2597]
2025-09-30T14:50:24.787559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:24.787565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.787568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:24.787572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:24.787579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:24.787584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:24.787716Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:24.795121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 38 sessionId: src_id|f69e9625-42488892-a101ca71-a92fbf28_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:24.798206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:24.852704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894691786742293:2517]
2025-09-30T14:50:24.853032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 37, pipe: [1:7555894691786742293:2517]
2025-09-30T14:50:24.905033Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:24.905484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:24.905498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:24.905519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894691786742293:2517], now have 1 active actors on pipe
2025-09-30T14:50:24.905769Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:24.905878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894691786742293:2517]
2025-09-30T14:50:24.905925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:24.905928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:24.906001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 38 reason: error at write: Disconnected sessionId: src_id|f69e9625-42488892-a101ca71-a92fbf28_0
2025-09-30T14:50:24.906111Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:24.906194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 38 sessionId: src_id|f69e9625-42488892-a101ca71-a92fbf28_0 is DEAD
2025-09-30T14:50:24.906378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f69e9625-42488892-a101ca71-a92fbf28_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:24.906387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f69e9625-42488892-a101ca71-a92fbf28_0] Write session will restart in 0.008504s
2025-09-30T14:50:24.906414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f69e9625-42488892-a101ca71-a92fbf28_0] Write session: Do CDS request
2025-09-30T14:50:24.906425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f69e9625-42488892-a101ca71-a92fbf28_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:24.915832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f69e9625-42488892-a101ca71-a92fbf28_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:24.916449Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:24.916467Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 39
2025-09-30T14:50:24.916624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 39 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:24.916686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 39 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:24.916697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=39 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:24.916702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:24.917215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 39 sessionId:  describe result for acl check
2025-09-30T14:50:24.917252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:24.917260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:24.917264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:24.917271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894691786742348:2732] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:24.917788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:24.917837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894691786742348:2732] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:24.918492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:24.918689Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:24.918699Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:24.918708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:24.918775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:24.918814Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894691697019850:2599]
2025-09-30T14:50:24.919516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:24.919834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:24.919877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:24.920209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:24.920284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:24.920286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:24.920287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:24.920288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:24.920289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:24.920290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:24.920291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:24.920293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:24.920294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:24.920295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:24.920296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.920297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.920298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.920299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:24.920300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:24.920306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:24.920315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:24.920320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:24.920324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:24.920327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:24.920332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:24.920336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:24.920340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:24.920345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:24.920349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:24.920352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.920356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.920360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.920363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:24.920367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:24.920374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:24.920381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:24.920387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:24.920394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:24.920399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:24.920406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:24.920410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:24.920414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:24.920419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:24.920424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:24.920427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:24.920433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:24.920439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:24.920444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:24.920448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:24.920453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:24.920458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:24.920464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:24.920468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:24.920473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:24.920477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.920482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.920487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.920494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.920498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.920503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.920508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:24.920513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:24.920518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:24.920523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:24.920568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:24.920716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894691786742348:2732] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:24.926155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894691786742348:2732] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:24.926172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894691786742348:2732] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:24.926177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894691786742348:2732] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:24.926185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 39 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:24.926484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:24.927477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:24.927497Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:24.927500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:24.927503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:24.927511Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 38 [2:7555894691697019850:2599]
2025-09-30T14:50:24.927529Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:24.927546Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:24.927550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:24.927553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:24.927555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:24.927573Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:24.927585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:24.927592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:24.927662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.927673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.927677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.927680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:24.927683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:24.927769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:24.927778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.927791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:24.927802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:24.927823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:24.927846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894691786742388:2732], now have 1 active actors on pipe
2025-09-30T14:50:24.927854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894691786742295:2454], now have 1 active actors on pipe
2025-09-30T14:50:24.927861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894691697019845:2599]
2025-09-30T14:50:24.927868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894691697019845:2599]
2025-09-30T14:50:24.927870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894691697019845:2599]
2025-09-30T14:50:24.927883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:24.927902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:24.927911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:24.927916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:24.927919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:24.927920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:24.927921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:24.927955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894691697019845:2599]
2025-09-30T14:50:24.927966Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:24.927905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 38
2025-09-30T14:50:24.927983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:24.927936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 38
2025-09-30T14:50:24.928060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:24.928076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:24.928110Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79edf5a4-d32b08f3-b7333389-5ba08d92_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:24.928127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:24.928132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:24.928135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:24.928147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:24.928160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:24.928178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:24.928433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:24.928446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:24.928466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:24.928552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 39 partition: 0 MaxSeqNo: 42 sessionId: src_id|79edf5a4-d32b08f3-b7333389-5ba08d92_0
2025-09-30T14:50:24.928937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f69e9625-42488892-a101ca71-a92fbf28_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|79edf5a4-d32b08f3-b7333389-5ba08d92_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:24.931953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79edf5a4-d32b08f3-b7333389-5ba08d92_0] Write session: try to update token
2025-09-30T14:50:24.931977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79edf5a4-d32b08f3-b7333389-5ba08d92_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:24.940529Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:24.940571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:24.940581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894691697019845:2599]
2025-09-30T14:50:24.940624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:24.940630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:24.940832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:24.941000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:24.941228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:24.941397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:24.941662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:24.941715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:24.949357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 39 sessionId: src_id|79edf5a4-d32b08f3-b7333389-5ba08d92_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:24.952112Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:24.952132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:24.952134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:24.952137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:24.952147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894691697019845:2599]
2025-09-30T14:50:24.952151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894691697019845:2599]
2025-09-30T14:50:24.952156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894691697019845:2599]
2025-09-30T14:50:24.952201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:24.952208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:24.952209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:24.952211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:24.952215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:24.952218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:24.952364Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:24.952631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:25.005791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894696081709698:2517]
2025-09-30T14:50:25.006123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 38, pipe: [1:7555894696081709698:2517]
2025-09-30T14:50:25.063720Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:25.064169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:25.064188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:25.064213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894696081709698:2517], now have 1 active actors on pipe
2025-09-30T14:50:25.064496Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:25.064921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79edf5a4-d32b08f3-b7333389-5ba08d92_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:25.064933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79edf5a4-d32b08f3-b7333389-5ba08d92_0] Write session will restart in 0.008344s
2025-09-30T14:50:25.064959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79edf5a4-d32b08f3-b7333389-5ba08d92_0] Write session: Do CDS request
2025-09-30T14:50:25.064965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79edf5a4-d32b08f3-b7333389-5ba08d92_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:25.064468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:25.064484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:25.064530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894696081709698:2517]
2025-09-30T14:50:25.064552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 39 reason: error at write: Disconnected sessionId: src_id|79edf5a4-d32b08f3-b7333389-5ba08d92_0
2025-09-30T14:50:25.064572Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:25.064768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 39 sessionId: src_id|79edf5a4-d32b08f3-b7333389-5ba08d92_0 is DEAD
2025-09-30T14:50:25.074850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79edf5a4-d32b08f3-b7333389-5ba08d92_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:25.074922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:25.074942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 40
2025-09-30T14:50:25.075197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 40 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:25.075231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 40 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:25.075256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=40 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:25.075261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:25.075713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 40 sessionId:  describe result for acl check
2025-09-30T14:50:25.075746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:25.075748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:25.075749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:25.075756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894696081709757:2738] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:25.075765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:25.076297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894696081709757:2738] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:25.076292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:25.076483Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:25.076493Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:25.076503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:25.076553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:25.076595Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894695991987242:2602]
2025-09-30T14:50:25.077302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:25.077591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:25.077641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:25.078003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:25.078067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:25.078073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:25.078074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:25.078076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:25.078077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:25.078078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:25.078079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:25.078080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:25.078082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:25.078083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:25.078085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.078086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.078087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.078089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:25.078090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:25.078096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:25.078106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:25.078111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:25.078115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:25.078119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:25.078124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:25.078128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:25.078132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:25.078136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:25.078140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:25.078145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.078149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.078153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.078157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:25.078160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:25.078168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:25.078176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:25.078183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:25.078188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:25.078194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:25.078199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:25.078204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:25.078210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:25.078217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:25.078223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:25.078232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:25.078237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:25.078242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:25.078251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:25.078256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:25.078261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:25.078270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:25.078275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:25.078284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:25.078290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:25.078299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.078306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.078315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.078320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.078329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.078335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.078339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:25.078349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:25.078355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:25.078364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:25.078359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894696081709757:2738] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:25.078408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:25.083923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894696081709757:2738] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:25.083942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894696081709757:2738] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:25.083946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894696081709757:2738] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:25.083955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 40 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:25.084295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:25.085383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:25.085405Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:25.085408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:25.085413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:25.085421Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 39 [2:7555894695991987242:2602]
2025-09-30T14:50:25.085441Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:25.085461Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:25.085475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.085479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.085481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.085499Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:25.085507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:25.085515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:25.085590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.085599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.085601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.085605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:25.085608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:25.085688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:25.085697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.085711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.085731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.085743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:25.085761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894696081709703:2454], now have 1 active actors on pipe
2025-09-30T14:50:25.085767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894696081709796:2738], now have 1 active actors on pipe
2025-09-30T14:50:25.085772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894695991987237:2602]
2025-09-30T14:50:25.085774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894695991987237:2602]
2025-09-30T14:50:25.085776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894695991987237:2602]
2025-09-30T14:50:25.085786Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:25.085798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:25.085800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:25.085803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:25.085806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:25.085812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:25.085815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:25.085853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894695991987237:2602]
2025-09-30T14:50:25.085862Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:25.085871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:25.085847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 39
2025-09-30T14:50:25.085857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 39
2025-09-30T14:50:25.085904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:25.085918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:25.085946Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2574a2ae-6527ce8d-873c17ca-422b8aeb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:25.085953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.085956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.085957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:25.085966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.085975Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:25.085991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:25.086122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:25.086129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:25.086141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:25.086229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 40 partition: 0 MaxSeqNo: 42 sessionId: src_id|2574a2ae-6527ce8d-873c17ca-422b8aeb_0
2025-09-30T14:50:25.086634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79edf5a4-d32b08f3-b7333389-5ba08d92_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2574a2ae-6527ce8d-873c17ca-422b8aeb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:25.089635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2574a2ae-6527ce8d-873c17ca-422b8aeb_0] Write session: try to update token
2025-09-30T14:50:25.089656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2574a2ae-6527ce8d-873c17ca-422b8aeb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:25.102504Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:25.102523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:25.102534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894695991987237:2602]
2025-09-30T14:50:25.102576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:25.102580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:25.102764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:25.102920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:25.103089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:25.103277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:25.103522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:25.103578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:25.108543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 40 sessionId: src_id|2574a2ae-6527ce8d-873c17ca-422b8aeb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:25.112055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:25.112359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:25.112386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:25.112440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:25.116034Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:25.116057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:25.116061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:25.116063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:25.116075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894695991987237:2602]
2025-09-30T14:50:25.116081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894695991987237:2602]
2025-09-30T14:50:25.116086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894695991987237:2602]
2025-09-30T14:50:25.116136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:25.116144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:25.116148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.116151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:25.116151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:25.116156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:25.116335Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:25.112541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:25.164541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894696081709808:2517]
2025-09-30T14:50:25.164834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 39, pipe: [1:7555894696081709808:2517]
2025-09-30T14:50:25.234181Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:25.242968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:25.243009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:25.243377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:25.243460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:25.243537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:25.243619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:25.243674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:25.243684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:25.243801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:25.243884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:25.243964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:25.244049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:25.244102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:25.244108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:25.244197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:25.244295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:25.244381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:25.244457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:25.244510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:25.244514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:25.244596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:25.244673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:25.244747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:25.244824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:25.244871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:25.244874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:25.244953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:25.245020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:25.245084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:25.245153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:25.245196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:25.245200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:25.245277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:25.245343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:25.245399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:25.245463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:25.245509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:25.245512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:25.245578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:25.245632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:25.245687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:25.245742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:25.245791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:25.245794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:25.245868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:25.245922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:25.245978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:25.246047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:25.246087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:25.246089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:25.246153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:25.246205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:25.246261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:25.246705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:25.246785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:25.246788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:25.246870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:25.246965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:25.247065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:25.247154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:25.247216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:25.247219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:25.247322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894696081709808:2517], now have 1 active actors on pipe
2025-09-30T14:50:25.251535Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:25.252409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:25.252461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894696081709808:2517]
2025-09-30T14:50:25.252481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:25.252520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 40 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2574a2ae-6527ce8d-873c17ca-422b8aeb_0
2025-09-30T14:50:25.252702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 40 sessionId: src_id|2574a2ae-6527ce8d-873c17ca-422b8aeb_0 is DEAD
2025-09-30T14:50:25.253214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2574a2ae-6527ce8d-873c17ca-422b8aeb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:25.253225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2574a2ae-6527ce8d-873c17ca-422b8aeb_0] Write session will restart in 0.009052s
2025-09-30T14:50:25.253254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2574a2ae-6527ce8d-873c17ca-422b8aeb_0] Write session: Do CDS request
2025-09-30T14:50:25.253259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2574a2ae-6527ce8d-873c17ca-422b8aeb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:25.267197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:25.267710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2574a2ae-6527ce8d-873c17ca-422b8aeb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:25.267833Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:25.267850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 41
2025-09-30T14:50:25.268001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:25.268161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 41 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:25.268206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 41 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:25.268216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=41 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:25.268221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:25.268307Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:25.268322Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:25.268338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:25.268417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:25.268468Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894695991987374:2616]
2025-09-30T14:50:25.269450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:25.270422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 41 sessionId:  describe result for acl check
2025-09-30T14:50:25.270469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:25.270475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:25.270477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:25.270483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894696081709890:2749] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:25.271072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894696081709890:2749] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:25.271279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:25.271353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:25.271768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:25.271869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:25.271875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:25.271877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:25.271879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:25.271881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:25.271883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:25.271885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:25.271886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:25.271888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:25.271890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:25.271892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.271893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.271895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.271896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:25.271898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:25.271905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:25.271916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:25.271920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:25.271925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:25.271929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:25.271934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:25.271938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:25.271942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:25.271947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:25.271951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:25.271956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.271960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.271964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.271969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:25.271973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:25.271981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:25.271991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:25.271998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:25.272006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:25.272012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:25.272018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:25.272022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:25.272027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:25.272034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:25.272039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:25.272043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:25.272049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:25.272055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:25.272060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:25.272065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:25.272070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:25.272077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:25.272082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:25.272086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:25.272092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:25.272098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.272104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.272110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.272116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.272121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.272127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.272132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:25.272137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:25.272143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:25.272148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:25.272196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:25.273488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894696081709890:2749] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:25.278067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894696081709890:2749] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:25.278091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894696081709890:2749] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:25.278095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894696081709890:2749] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:25.278106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 41 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:25.278637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:25.279573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:25.279589Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:25.279593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:25.279597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:25.279605Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 40 [2:7555894695991987374:2616]
2025-09-30T14:50:25.279622Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:25.279639Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:25.279642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.279646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.279648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.279665Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:25.279673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:25.279680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:25.279743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.279745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.279748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.279752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:25.279755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:25.279828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:25.279831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.279844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.279855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.279872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:25.279889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894696081709831:2454], now have 1 active actors on pipe
2025-09-30T14:50:25.279894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894696081709922:2749], now have 1 active actors on pipe
2025-09-30T14:50:25.279900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894695991987368:2616]
2025-09-30T14:50:25.279902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894695991987368:2616]
2025-09-30T14:50:25.279904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894695991987368:2616]
2025-09-30T14:50:25.279918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:25.279931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:25.279931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:25.279935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:25.279936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:25.279944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:25.279947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:25.279984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894695991987368:2616]
2025-09-30T14:50:25.279992Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:25.280004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:25.281554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 40
2025-09-30T14:50:25.281586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 40
2025-09-30T14:50:25.282217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 41 partition: 0 MaxSeqNo: 42 sessionId: src_id|350678c8-171249eb-a0e720d3-cf847a12_0
2025-09-30T14:50:25.283857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2574a2ae-6527ce8d-873c17ca-422b8aeb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|350678c8-171249eb-a0e720d3-cf847a12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:25.286836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|350678c8-171249eb-a0e720d3-cf847a12_0] Write session: try to update token
2025-09-30T14:50:25.286858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|350678c8-171249eb-a0e720d3-cf847a12_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:25.281811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:25.281827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:25.281858Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|350678c8-171249eb-a0e720d3-cf847a12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:25.281869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.281873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.281876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:25.281889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.281903Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:25.281921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:25.282115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:25.282120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:25.282137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:25.294676Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:25.294694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:25.294702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:25.294704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:25.294715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894695991987368:2616]
2025-09-30T14:50:25.294734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894695991987368:2616]
2025-09-30T14:50:25.294738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894695991987368:2616]
2025-09-30T14:50:25.294784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:25.294791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.294794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:25.294955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:25.294962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:25.294968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:25.295048Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:25.325594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 41 sessionId: src_id|350678c8-171249eb-a0e720d3-cf847a12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:25.328656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:25.352432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894696081709930:2517]
2025-09-30T14:50:25.352824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 40, pipe: [1:7555894696081709930:2517]
2025-09-30T14:50:25.411927Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:25.412389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:25.412412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:25.412434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894696081709930:2517], now have 1 active actors on pipe
2025-09-30T14:50:25.412665Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:25.412920Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:25.412961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:25.413045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 41 reason: status is not ok: tablet will be restarted right now sessionId: src_id|350678c8-171249eb-a0e720d3-cf847a12_0
2025-09-30T14:50:25.413205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 41 sessionId: src_id|350678c8-171249eb-a0e720d3-cf847a12_0 is DEAD
2025-09-30T14:50:25.413374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|350678c8-171249eb-a0e720d3-cf847a12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:25.413389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|350678c8-171249eb-a0e720d3-cf847a12_0] Write session will restart in 0.008916s
2025-09-30T14:50:25.413421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|350678c8-171249eb-a0e720d3-cf847a12_0] Write session: Do CDS request
2025-09-30T14:50:25.413427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|350678c8-171249eb-a0e720d3-cf847a12_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:25.413452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894696081709930:2517]
2025-09-30T14:50:25.423887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|350678c8-171249eb-a0e720d3-cf847a12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:25.424043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:25.424062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 42
2025-09-30T14:50:25.424320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 42 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:25.424361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 42 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:25.424372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=42 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:25.424377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:25.424684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:25.424916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 42 sessionId:  describe result for acl check
2025-09-30T14:50:25.424965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:25.424968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:25.424970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:25.424977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894696081709992:2754] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:25.425656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894696081709992:2754] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:25.426069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:25.426293Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:25.426306Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:25.426319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:25.426380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:25.426427Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894695991987472:2619]
2025-09-30T14:50:25.428465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894696081709992:2754] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:25.432445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894696081709992:2754] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:25.432465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894696081709992:2754] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:25.432469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894696081709992:2754] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:25.432479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 42 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:25.427142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:25.427842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:25.427896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:25.428274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:25.428348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:25.428349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:25.428351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:25.428352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:25.428354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:25.428356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:25.428357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:25.428359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:25.428360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:25.428361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:25.428363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.428365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.428365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.428366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:25.428367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:25.428374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:25.428385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:25.428390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:25.428394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:25.428399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:25.428403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:25.428408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:25.428413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:25.428416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:25.428422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:25.428427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.428431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.428435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.428440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:25.428444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:25.428452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:25.428462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:25.428469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:25.428474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:25.428480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:25.428486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:25.428493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:25.428498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:25.428504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:25.428510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:25.428516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:25.428522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:25.428528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:25.428533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:25.428539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:25.428546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:25.428552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:25.428558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:25.428563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:25.428568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:25.428572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.428579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.428584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.428589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.428594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.428599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.428605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:25.428610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:25.428617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:25.428622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:25.428672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:25.437820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:25.439037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:25.439061Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:25.439065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:25.439074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:25.439083Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 41 [2:7555894695991987472:2619]
2025-09-30T14:50:25.439103Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:25.439123Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:25.439133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.439136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.439139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.439158Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:25.439170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:25.439178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:25.439310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.439317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.439320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.439323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:25.439326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:25.439413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:25.439423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.439441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.439459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.439483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:25.439507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894695991987466:2619]
2025-09-30T14:50:25.439514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894695991987466:2619]
2025-09-30T14:50:25.439517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894695991987466:2619]
2025-09-30T14:50:25.439535Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:25.439560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:25.439587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:25.439590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:25.439597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:25.439601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:25.439604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:25.439636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894695991987466:2619]
2025-09-30T14:50:25.439645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:25.439706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:25.439769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894696081710030:2754], now have 1 active actors on pipe
2025-09-30T14:50:25.439782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894696081709935:2454], now have 1 active actors on pipe
2025-09-30T14:50:25.440244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 41
2025-09-30T14:50:25.440276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 41
2025-09-30T14:50:25.440370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:25.440382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:25.440409Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c752ffc-39d1e3e-5033ae4e-2650be14_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:25.440426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.440431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.440433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:25.440447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.440458Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:25.440474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:25.441222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:25.441235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:25.441258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:25.441406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 42 partition: 0 MaxSeqNo: 42 sessionId: src_id|3c752ffc-39d1e3e-5033ae4e-2650be14_0
2025-09-30T14:50:25.441779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|350678c8-171249eb-a0e720d3-cf847a12_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3c752ffc-39d1e3e-5033ae4e-2650be14_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:25.444760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c752ffc-39d1e3e-5033ae4e-2650be14_0] Write session: try to update token
2025-09-30T14:50:25.444781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c752ffc-39d1e3e-5033ae4e-2650be14_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:25.452340Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:25.452363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:25.452373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894695991987466:2619]
2025-09-30T14:50:25.452418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:25.452421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:25.452582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:25.452731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:25.452873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:25.453018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:25.453221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:25.453275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:25.463720Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:25.463736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:25.463739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:25.463742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:25.463753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894695991987466:2619]
2025-09-30T14:50:25.463758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894695991987466:2619]
2025-09-30T14:50:25.463762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894695991987466:2619]
2025-09-30T14:50:25.463804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:25.463811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.463814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:25.463991Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:25.464043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:25.464063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:25.464067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:25.464261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 42 sessionId: src_id|3c752ffc-39d1e3e-5033ae4e-2650be14_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:25.467444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:25.513792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894696081710038:2517]
2025-09-30T14:50:25.514303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 41, pipe: [1:7555894696081710038:2517]
2025-09-30T14:50:25.579330Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:25.579683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:25.579693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:25.579713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894696081710038:2517], now have 1 active actors on pipe
2025-09-30T14:50:25.579956Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:25.580467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:25.581026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c752ffc-39d1e3e-5033ae4e-2650be14_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:25.581041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c752ffc-39d1e3e-5033ae4e-2650be14_0] Write session will restart in 0.007582s
2025-09-30T14:50:25.581076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c752ffc-39d1e3e-5033ae4e-2650be14_0] Write session: Do CDS request
2025-09-30T14:50:25.581083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c752ffc-39d1e3e-5033ae4e-2650be14_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:25.580525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894696081710038:2517]
2025-09-30T14:50:25.580551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:25.580630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 42 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3c752ffc-39d1e3e-5033ae4e-2650be14_0
2025-09-30T14:50:25.580807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 42 sessionId: src_id|3c752ffc-39d1e3e-5033ae4e-2650be14_0 is DEAD
2025-09-30T14:50:25.589827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c752ffc-39d1e3e-5033ae4e-2650be14_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:25.589881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:25.589896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 43
2025-09-30T14:50:25.590156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 43 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:25.590212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 43 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:25.590222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=43 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:25.590230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:25.590692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 43 sessionId:  describe result for acl check
2025-09-30T14:50:25.590734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:25.590740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:25.590742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:25.590758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894696081710052:2758] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:25.591306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894696081710052:2758] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:25.593309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894696081710052:2758] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:25.596284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894696081710052:2758] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:25.596299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894696081710052:2758] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:25.596303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894696081710052:2758] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:25.596319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 43 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:25.597512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:25.598169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:25.598355Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:25.598367Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:25.598378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:25.598439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:25.598478Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894695991987570:2621]
2025-09-30T14:50:25.599282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:25.599578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:25.599623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:25.599958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:25.600030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:25.600038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:25.600039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:25.600040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:25.600042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:25.600043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:25.600044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:25.600046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:25.600048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:25.600049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:25.600050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.600051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.600052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.600054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:25.600055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:25.600061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:25.600072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:25.600076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:25.600081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:25.600085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:25.600090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:25.600094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:25.600098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:25.600103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:25.600107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:25.600112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.600116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.600137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.600141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:25.600145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:25.600153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:25.600161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:25.600167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:25.600173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:25.600184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:25.600190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:25.600200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:25.600206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:25.600212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:25.600218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:25.600223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:25.600235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:25.600240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:25.600246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:25.600251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:25.600257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:25.600262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:25.600268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:25.600274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:25.600279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:25.600285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.600290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.600296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.600301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.600306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.600317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.600322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:25.600327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:25.600335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:25.600341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:25.600393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:25.607019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:25.607947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:25.607967Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:25.607971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:25.607976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:25.607983Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 42 [2:7555894695991987570:2621]
2025-09-30T14:50:25.608001Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:25.608019Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:25.608028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.608032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.608034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.608052Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:25.608059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:25.608070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:25.608143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.608151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.608153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.608156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:25.608159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:25.608228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:25.608233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.608246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.608254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.608264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:25.608280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894696081710040:2454], now have 1 active actors on pipe
2025-09-30T14:50:25.608283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894696081710131:2758], now have 1 active actors on pipe
2025-09-30T14:50:25.608287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894695991987564:2621]
2025-09-30T14:50:25.608289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894695991987564:2621]
2025-09-30T14:50:25.608291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894695991987564:2621]
2025-09-30T14:50:25.608306Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:25.608320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:25.608385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 42
2025-09-30T14:50:25.608333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:25.608431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 42
2025-09-30T14:50:25.608337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:25.608371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894695991987564:2621]
2025-09-30T14:50:25.608374Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:25.608598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:25.608608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:25.608610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:25.608616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:25.608694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:25.608705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:25.608732Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b997182-4a8988fe-b300e508-f6adcf08_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:25.608743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.608747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.608750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:25.608761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.608779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:25.608800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:25.608954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:25.608961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:25.608977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:25.609063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 43 partition: 0 MaxSeqNo: 42 sessionId: src_id|3b997182-4a8988fe-b300e508-f6adcf08_0
2025-09-30T14:50:25.609441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c752ffc-39d1e3e-5033ae4e-2650be14_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3b997182-4a8988fe-b300e508-f6adcf08_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:25.612888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b997182-4a8988fe-b300e508-f6adcf08_0] Write session: try to update token
2025-09-30T14:50:25.612912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b997182-4a8988fe-b300e508-f6adcf08_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:25.621506Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:25.621523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:25.621525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:25.621528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:25.621538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894695991987564:2621]
2025-09-30T14:50:25.621543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894695991987564:2621]
2025-09-30T14:50:25.621548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894695991987564:2621]
2025-09-30T14:50:25.621596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:25.621602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:25.621607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:25.621607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:25.621614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.621617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:25.621753Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:25.634978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 43 sessionId: src_id|3b997182-4a8988fe-b300e508-f6adcf08_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:25.637703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:25.680627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894696081710156:2517]
2025-09-30T14:50:25.681023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 42, pipe: [1:7555894696081710156:2517]
2025-09-30T14:50:25.735832Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:25.736187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:25.736202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:25.736222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894696081710156:2517], now have 1 active actors on pipe
2025-09-30T14:50:25.736450Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:25.736453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:25.736454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894696081710156:2517]
2025-09-30T14:50:25.736478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:25.736481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:25.736553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 43 reason: error at write: Disconnected sessionId: src_id|3b997182-4a8988fe-b300e508-f6adcf08_0
2025-09-30T14:50:25.736886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b997182-4a8988fe-b300e508-f6adcf08_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:25.736897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b997182-4a8988fe-b300e508-f6adcf08_0] Write session will restart in 0.005443s
2025-09-30T14:50:25.736926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b997182-4a8988fe-b300e508-f6adcf08_0] Write session: Do CDS request
2025-09-30T14:50:25.736931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b997182-4a8988fe-b300e508-f6adcf08_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:25.736736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 43 sessionId: src_id|3b997182-4a8988fe-b300e508-f6adcf08_0 is DEAD
2025-09-30T14:50:25.743759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b997182-4a8988fe-b300e508-f6adcf08_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:25.743865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:25.743880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 44
2025-09-30T14:50:25.744003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 44 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:25.744038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 44 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:25.744048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=44 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:25.744052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:25.744565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 44 sessionId:  describe result for acl check
2025-09-30T14:50:25.744602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:25.744609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:25.744611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:25.744618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894696081710195:2763] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:25.745187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894696081710195:2763] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:25.746676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:25.747491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:25.747718Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:25.747733Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:25.747745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:25.747802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:25.747852Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894695991987678:2624]
2025-09-30T14:50:25.748353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894696081710195:2763] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:25.748432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:25.748717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:25.748752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:25.749129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:25.749210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:25.749211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:25.749212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:25.749213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:25.749214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:25.749215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:25.749216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:25.749216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:25.749217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:25.749218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:25.749219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.749220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.749221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.749221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:25.749222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:25.749226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:25.749234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:25.749236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:25.749239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:25.749241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:25.749244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:25.749246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:25.749249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:25.749251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:25.749254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:25.749256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.749259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.749261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.749264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:25.749266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:25.749273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:25.749280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:25.749288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:25.749294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:25.749299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:25.749305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:25.749309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:25.749315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:25.749320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:25.749326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:25.749330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:25.749336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:25.749341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:25.749347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:25.749351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:25.749357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:25.749364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:25.749370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:25.749375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:25.749380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:25.749385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.749391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.749396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.749401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.749406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.749411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.749416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:25.749422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:25.749428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:25.749434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:25.749470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:25.751983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894696081710195:2763] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:25.752001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894696081710195:2763] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:25.752006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894696081710195:2763] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:25.752016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 44 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:25.757355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:25.758370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:25.758388Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:25.758392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:25.758398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:25.758408Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 43 [2:7555894695991987678:2624]
2025-09-30T14:50:25.758429Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:25.758453Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:25.758461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.758465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.758468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.758488Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:25.758504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:25.758517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:25.758598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.758608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.758610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.758614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:25.758617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:25.758944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 43
2025-09-30T14:50:25.758986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 43
2025-09-30T14:50:25.759294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:25.759317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.759339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.759360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.759379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:25.759410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894696081710256:2763], now have 1 active actors on pipe
2025-09-30T14:50:25.759423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894696081710158:2454], now have 1 active actors on pipe
2025-09-30T14:50:25.759445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:25.759453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:25.759477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894695991987673:2624]
2025-09-30T14:50:25.759480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894695991987673:2624]
2025-09-30T14:50:25.759482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894695991987673:2624]
2025-09-30T14:50:25.759514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:25.759532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:25.759544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:25.759545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:25.759547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:25.759565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:25.759568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:25.759586Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79670589-ab706596-b9a3147f-d62a972e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:25.759602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.759608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.759618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:25.759630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.759644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:25.759698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894695991987673:2624]
2025-09-30T14:50:25.759714Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:25.759728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:25.759756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:25.759982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:25.760001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:25.760039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:25.760197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 44 partition: 0 MaxSeqNo: 42 sessionId: src_id|79670589-ab706596-b9a3147f-d62a972e_0
2025-09-30T14:50:25.760744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b997182-4a8988fe-b300e508-f6adcf08_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|79670589-ab706596-b9a3147f-d62a972e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:25.763803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79670589-ab706596-b9a3147f-d62a972e_0] Write session: try to update token
2025-09-30T14:50:25.763824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79670589-ab706596-b9a3147f-d62a972e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:25.773005Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:25.773029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:25.773032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:25.773034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:25.773045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894695991987673:2624]
2025-09-30T14:50:25.773051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894695991987673:2624]
2025-09-30T14:50:25.773056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894695991987673:2624]
2025-09-30T14:50:25.773107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:25.773115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.773118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:25.773292Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:25.774828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:25.774845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:25.774850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:25.781481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 44 sessionId: src_id|79670589-ab706596-b9a3147f-d62a972e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:25.784618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:25.836777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894696081710263:2517]
2025-09-30T14:50:25.837119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 43, pipe: [1:7555894696081710263:2517]
2025-09-30T14:50:25.894409Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:25.894927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:25.894950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:25.894987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894696081710263:2517], now have 1 active actors on pipe
2025-09-30T14:50:25.895276Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:25.895267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:25.895281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:25.895335Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:25.895356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 44 reason: error at write: Disconnected sessionId: src_id|79670589-ab706596-b9a3147f-d62a972e_0
2025-09-30T14:50:25.895406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894696081710263:2517]
2025-09-30T14:50:25.895545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 44 sessionId: src_id|79670589-ab706596-b9a3147f-d62a972e_0 is DEAD
2025-09-30T14:50:25.895710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79670589-ab706596-b9a3147f-d62a972e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:25.895723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79670589-ab706596-b9a3147f-d62a972e_0] Write session will restart in 0.008187s
2025-09-30T14:50:25.895747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79670589-ab706596-b9a3147f-d62a972e_0] Write session: Do CDS request
2025-09-30T14:50:25.895753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79670589-ab706596-b9a3147f-d62a972e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:25.904771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79670589-ab706596-b9a3147f-d62a972e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:25.904951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:25.904968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 45
2025-09-30T14:50:25.905177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 45 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:25.905221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 45 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:25.905232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=45 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:25.905246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:25.905947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:25.905781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 45 sessionId:  describe result for acl check
2025-09-30T14:50:25.905821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:25.905824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:25.905826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:25.905832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894696081710324:2767] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:25.906394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894696081710324:2767] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:25.906569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:25.906801Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:25.906806Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:25.906820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:25.906893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:25.906935Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894695991987777:2626]
2025-09-30T14:50:25.907654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:25.908002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:25.908063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:25.908157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894696081710324:2767] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:25.908471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:25.908542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:25.908549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:25.908550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:25.908551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:25.908553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:25.908554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:25.908555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:25.908556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:25.908558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:25.908559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:25.908560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.908561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.908562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.908564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:25.908565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:25.908572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:25.908583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:25.908587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:25.908592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:25.908596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:25.908601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:25.908606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:25.908610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:25.908615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:25.908620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:25.908624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.908628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.908632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.908637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:25.908641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:25.908649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:25.908658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:25.908666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:25.908673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:25.908678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:25.908684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:25.908689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:25.908694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:25.908699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:25.908705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:25.908710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:25.908716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:25.908721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:25.908728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:25.908732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:25.908738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:25.908748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:25.908754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:25.908759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:25.908765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:25.908770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.908776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.908785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.908791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.908801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.908807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.908816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:25.908822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:25.908827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:25.908833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:25.908883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:25.914469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894696081710324:2767] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:25.914484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894696081710324:2767] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:25.914488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894696081710324:2767] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:25.914499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 45 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:25.915046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:25.916230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:25.916249Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:25.916252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:25.916256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:25.916265Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 44 [2:7555894695991987777:2626]
2025-09-30T14:50:25.916284Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:25.916303Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:25.916311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.916315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.916318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.916338Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:25.916352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:25.916364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:25.916437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.916448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.916450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.916455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:25.916459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:25.916544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:25.916553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.916567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:25.916581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:25.916598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:25.916620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894695991987772:2626]
2025-09-30T14:50:25.916628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894695991987772:2626]
2025-09-30T14:50:25.916630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894695991987772:2626]
2025-09-30T14:50:25.916644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:25.916654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:25.916658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:25.916661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:25.916665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:25.916681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:25.916685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:25.916697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894696081710364:2767], now have 1 active actors on pipe
2025-09-30T14:50:25.916709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894696081710265:2454], now have 1 active actors on pipe
2025-09-30T14:50:25.916730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 44
2025-09-30T14:50:25.916730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 44
2025-09-30T14:50:25.916750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894695991987772:2626]
2025-09-30T14:50:25.916761Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:25.916787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:25.916820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:25.916825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:25.916854Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27ce422-98936edd-c56da0bc-1d8bf6a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:25.916862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.916869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.916871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:25.916883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.916894Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:25.916909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:25.917123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:25.917132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:25.917147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:25.917245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 45 partition: 0 MaxSeqNo: 42 sessionId: src_id|27ce422-98936edd-c56da0bc-1d8bf6a0_0
2025-09-30T14:50:25.917609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79670589-ab706596-b9a3147f-d62a972e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|27ce422-98936edd-c56da0bc-1d8bf6a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:25.920351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27ce422-98936edd-c56da0bc-1d8bf6a0_0] Write session: try to update token
2025-09-30T14:50:25.920369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27ce422-98936edd-c56da0bc-1d8bf6a0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:25.931171Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:25.931191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:25.931200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894695991987772:2626]
2025-09-30T14:50:25.931269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:25.931296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:25.931481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:25.931633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:25.931789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:25.931943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:25.932165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:25.932226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:25.936654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 45 sessionId: src_id|27ce422-98936edd-c56da0bc-1d8bf6a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:25.939450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:25.939666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:25.939699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:25.939731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:25.939841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:25.942633Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:25.942654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:25.942657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:25.942659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:25.942671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894695991987772:2626]
2025-09-30T14:50:25.942675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894695991987772:2626]
2025-09-30T14:50:25.942680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894695991987772:2626]
2025-09-30T14:50:25.942744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:25.942751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:25.942758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:25.942760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:25.942761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:25.942765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:25.942948Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:25.975952Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7721: Cannot get console configs
2025-09-30T14:50:25.975968Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-09-30T14:50:25.995504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894696081710378:2517]
2025-09-30T14:50:25.997661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 44, pipe: [1:7555894696081710378:2517]
2025-09-30T14:50:26.064544Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:26.073037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:26.073073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:26.073267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:26.073341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:26.073418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:26.073491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:26.073547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:26.073558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:26.073634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:26.073708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:26.073790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:26.073883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:26.074227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:26.074241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:26.074411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:26.074493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:26.074567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:26.074640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:26.074692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:26.074704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:26.074798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:26.074869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:26.074945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:26.075015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:26.075067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:26.075075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:26.075151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:26.075221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:26.075310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:26.075384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:26.075432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:26.075440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:26.075511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:26.075576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:26.075645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:26.075719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:26.075770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:26.075778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:26.075849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:26.075916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:26.075992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:26.076062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:26.076112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:26.076120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:26.076191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:26.076261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:26.076334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:26.076410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:26.076454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:26.076464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:26.076540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:26.076606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:26.076675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:26.076746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:26.076797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:26.076804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:26.076878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:26.076955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:26.077036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:26.077114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:26.077174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:26.077186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:26.077265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894696081710378:2517], now have 1 active actors on pipe
2025-09-30T14:50:26.077493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:26.077497Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:26.077504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:26.077537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 45 reason: error at write: Disconnected sessionId: src_id|27ce422-98936edd-c56da0bc-1d8bf6a0_0
2025-09-30T14:50:26.077549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894696081710378:2517]
2025-09-30T14:50:26.077740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 45 sessionId: src_id|27ce422-98936edd-c56da0bc-1d8bf6a0_0 is DEAD
2025-09-30T14:50:26.077862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27ce422-98936edd-c56da0bc-1d8bf6a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:26.077871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27ce422-98936edd-c56da0bc-1d8bf6a0_0] Write session will restart in 0.007599s
2025-09-30T14:50:26.077896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27ce422-98936edd-c56da0bc-1d8bf6a0_0] Write session: Do CDS request
2025-09-30T14:50:26.077901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27ce422-98936edd-c56da0bc-1d8bf6a0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:26.078147Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:26.087879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:26.088463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:26.088655Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:26.088665Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:26.088675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:26.088729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:26.088774Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894700286955175:2629]
2025-09-30T14:50:26.089531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:26.089835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:26.089879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:26.090248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:26.090319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:26.090326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:26.090328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:26.090329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:26.090331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:26.090333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:26.090334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:26.090336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:26.090337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:26.090339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:26.090340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.090342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.090343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.090344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:26.090346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:26.090352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:26.090363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:26.090368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:26.090373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:26.090378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:26.090383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:26.090387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:26.090391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:26.090395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:26.090399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:26.090402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.090406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.090409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.090414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:26.090419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:26.090427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:26.090435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:26.090442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:26.090449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:26.090455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:26.090461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:26.090466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:26.090474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:26.090479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:26.090485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:26.090489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:26.090494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:26.090499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:26.090504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:26.090508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:26.090513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:26.090517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:26.090523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:26.090532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:26.090538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:26.090543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.090548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.090553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.090558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.090563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.090568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.090581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:26.090587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:26.090592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:26.090599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:26.090653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:26.091797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27ce422-98936edd-c56da0bc-1d8bf6a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:26.091926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:26.091942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 46
2025-09-30T14:50:26.092099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 46 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:26.092135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 46 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:26.092141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=46 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:26.092145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:26.092843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 46 sessionId:  describe result for acl check
2025-09-30T14:50:26.092886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:26.092888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:26.092890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:26.092897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894700376677750:2773] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:26.093527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894700376677750:2773] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:26.096672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894700376677750:2773] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:26.096788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:26.097771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:26.097792Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:26.097795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:26.097799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:26.097807Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 45 [2:7555894700286955175:2629]
2025-09-30T14:50:26.097823Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:26.097837Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:26.097840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.097844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.097846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.097861Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:26.097867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:26.097874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:26.097930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.097936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.097937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.097940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:26.097942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:26.098025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:26.098033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.098046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.098063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.098091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:26.098111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894700376677684:2454], now have 1 active actors on pipe
2025-09-30T14:50:26.098117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894700286955170:2629]
2025-09-30T14:50:26.098120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894700286955170:2629]
2025-09-30T14:50:26.098122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894700286955170:2629]
2025-09-30T14:50:26.098138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:26.098151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:26.098160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:26.098165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:26.098167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:26.098170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:26.098174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:26.098209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894700286955170:2629]
2025-09-30T14:50:26.098192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 45
2025-09-30T14:50:26.098218Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:26.098223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:26.103869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894700376677750:2773] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:26.103888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894700376677750:2773] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:26.103892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894700376677750:2773] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:26.103901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 46 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:26.104315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894700376677788:2773], now have 1 active actors on pipe
2025-09-30T14:50:26.104370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 45
2025-09-30T14:50:26.104478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:26.104505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:26.104549Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1489fad-7af4ec1c-e701d79b-a51947a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:26.104564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.104570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.104573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:26.104588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.104608Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:26.104629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:26.104821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:26.104839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:26.104867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:26.104995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 46 partition: 0 MaxSeqNo: 42 sessionId: src_id|c1489fad-7af4ec1c-e701d79b-a51947a6_0
2025-09-30T14:50:26.105491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27ce422-98936edd-c56da0bc-1d8bf6a0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c1489fad-7af4ec1c-e701d79b-a51947a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:26.108284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1489fad-7af4ec1c-e701d79b-a51947a6_0] Write session: try to update token
2025-09-30T14:50:26.108305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1489fad-7af4ec1c-e701d79b-a51947a6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:26.110492Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:26.110516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:26.110526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894700286955170:2629]
2025-09-30T14:50:26.110574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:26.110585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:26.110804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:26.110979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:26.111149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:26.111339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:26.111590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:26.111643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:26.123558Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:26.123581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:26.123583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:26.123587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:26.123598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894700286955170:2629]
2025-09-30T14:50:26.123602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894700286955170:2629]
2025-09-30T14:50:26.123606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894700286955170:2629]
2025-09-30T14:50:26.123650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:26.123663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.123663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:26.123666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:26.123671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:26.123675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:26.123690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 46 sessionId: src_id|c1489fad-7af4ec1c-e701d79b-a51947a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:26.123804Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:26.126854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:26.177190Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894700376677791:2517]
2025-09-30T14:50:26.177545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 45, pipe: [1:7555894700376677791:2517]
2025-09-30T14:50:26.243744Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:26.244025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:26.244042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:26.244062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894700376677791:2517], now have 1 active actors on pipe
2025-09-30T14:50:26.244241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:26.244296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894700376677791:2517]
2025-09-30T14:50:26.244299Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:26.244326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:26.244335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:26.244394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 46 reason: error at write: Disconnected sessionId: src_id|c1489fad-7af4ec1c-e701d79b-a51947a6_0
2025-09-30T14:50:26.244592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 46 sessionId: src_id|c1489fad-7af4ec1c-e701d79b-a51947a6_0 is DEAD
2025-09-30T14:50:26.244766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1489fad-7af4ec1c-e701d79b-a51947a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:26.244777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1489fad-7af4ec1c-e701d79b-a51947a6_0] Write session will restart in 0.007696s
2025-09-30T14:50:26.244807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1489fad-7af4ec1c-e701d79b-a51947a6_0] Write session: Do CDS request
2025-09-30T14:50:26.244816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1489fad-7af4ec1c-e701d79b-a51947a6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:26.253768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1489fad-7af4ec1c-e701d79b-a51947a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:26.253910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:26.253927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 47
2025-09-30T14:50:26.254149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 47 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:26.254180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 47 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:26.254186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=47 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:26.254190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:26.254706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 47 sessionId:  describe result for acl check
2025-09-30T14:50:26.254767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:26.254778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:26.254780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:26.254787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894700376677868:2783] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:26.255450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894700376677868:2783] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:26.255531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:26.256416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:26.256688Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:26.256701Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:26.256714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:26.256801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:26.256848Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894700286955305:2641]
2025-09-30T14:50:26.257530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:26.257735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894700376677868:2783] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:26.257947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:26.258021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:26.258415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:26.258504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:26.258514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:26.258515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:26.258517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:26.258518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:26.258520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:26.258521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:26.258522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:26.258524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:26.258525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:26.258526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.258527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.258529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.258530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:26.258532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:26.258553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:26.258565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:26.258569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:26.258573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:26.258577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:26.258581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:26.258585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:26.258589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:26.258592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:26.258597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:26.258601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.258604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.258608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.258613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:26.258617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:26.258625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:26.258635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:26.258641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:26.258647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:26.258651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:26.258658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:26.258662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:26.258669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:26.258677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:26.258684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:26.258689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:26.258694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:26.258699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:26.258705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:26.258709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:26.258715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:26.258739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:26.258745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:26.258750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:26.258756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:26.258768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.258774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.258780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.258793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.258799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.258806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.258817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:26.258822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:26.258827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:26.258834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:26.258891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:26.272613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894700376677868:2783] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:26.272633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894700376677868:2783] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:26.272637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894700376677868:2783] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:26.272646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 47 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:26.273084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:26.274130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:26.274153Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:26.274155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:26.274160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:26.274168Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 46 [2:7555894700286955305:2641]
2025-09-30T14:50:26.274188Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:26.274206Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:26.274217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.274221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.274224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.274244Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:26.274261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:26.274270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:26.274345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.274356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.274359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.274363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:26.274367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:26.274452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:26.274465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.274480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.274493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.274512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:26.274539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894700286955299:2641]
2025-09-30T14:50:26.274549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894700286955299:2641]
2025-09-30T14:50:26.274551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894700286955299:2641]
2025-09-30T14:50:26.274561Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:26.274581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:26.274594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:26.274598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:26.274601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:26.274606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:26.274609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:26.274647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894700286955299:2641]
2025-09-30T14:50:26.274666Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:26.274677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894700376677915:2783], now have 1 active actors on pipe
2025-09-30T14:50:26.274682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894700376677809:2454], now have 1 active actors on pipe
2025-09-30T14:50:26.274683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:26.274741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 46
2025-09-30T14:50:26.274752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 46
2025-09-30T14:50:26.274921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:26.274934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:26.274969Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4e205c4-bdf0344b-8c1f4a99-57180691_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:26.274986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.274997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.275000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:26.275017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.275029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:26.275050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:26.275267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:26.275280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:26.275296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:26.275387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 47 partition: 0 MaxSeqNo: 42 sessionId: src_id|d4e205c4-bdf0344b-8c1f4a99-57180691_0
2025-09-30T14:50:26.275911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1489fad-7af4ec1c-e701d79b-a51947a6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d4e205c4-bdf0344b-8c1f4a99-57180691_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:26.279406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4e205c4-bdf0344b-8c1f4a99-57180691_0] Write session: try to update token
2025-09-30T14:50:26.279429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4e205c4-bdf0344b-8c1f4a99-57180691_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:26.287849Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:26.287873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:26.287876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:26.287879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:26.287890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894700286955299:2641]
2025-09-30T14:50:26.287898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894700286955299:2641]
2025-09-30T14:50:26.287903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894700286955299:2641]
2025-09-30T14:50:26.287949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:26.287956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.287957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:26.287959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:26.287965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:26.287968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:26.288123Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:26.299759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 47 sessionId: src_id|d4e205c4-bdf0344b-8c1f4a99-57180691_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:26.302969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:26.344665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894700376677923:2517]
2025-09-30T14:50:26.345014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 46, pipe: [1:7555894700376677923:2517]
2025-09-30T14:50:26.406376Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:26.406835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:26.406850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:26.406869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894700376677923:2517], now have 1 active actors on pipe
2025-09-30T14:50:26.407299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894700376677923:2517]
2025-09-30T14:50:26.407325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:26.407333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:26.407336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:26.407419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 47 reason: error at write: Disconnected sessionId: src_id|d4e205c4-bdf0344b-8c1f4a99-57180691_0
2025-09-30T14:50:26.407609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 47 sessionId: src_id|d4e205c4-bdf0344b-8c1f4a99-57180691_0 is DEAD
2025-09-30T14:50:26.407785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4e205c4-bdf0344b-8c1f4a99-57180691_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:26.407793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4e205c4-bdf0344b-8c1f4a99-57180691_0] Write session will restart in 0.007768s
2025-09-30T14:50:26.407817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4e205c4-bdf0344b-8c1f4a99-57180691_0] Write session: Do CDS request
2025-09-30T14:50:26.407823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4e205c4-bdf0344b-8c1f4a99-57180691_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:26.408154Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:26.417155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4e205c4-bdf0344b-8c1f4a99-57180691_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:26.417218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:26.417234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 48
2025-09-30T14:50:26.417459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 48 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:26.417496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 48 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:26.417506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=48 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:26.417510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:26.417580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:26.417973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 48 sessionId:  describe result for acl check
2025-09-30T14:50:26.418018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:26.418024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:26.418026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:26.418043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894700376677992:2789] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:26.418239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:26.418442Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:26.418454Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:26.418463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:26.418514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:26.418557Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894700286955415:2645]
2025-09-30T14:50:26.418624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894700376677992:2789] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:26.419359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:26.419621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:26.419667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:26.420053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:26.420109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:26.420110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:26.420112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:26.420113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:26.420114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:26.420115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:26.420116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:26.420117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:26.420118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:26.420119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:26.420121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.420122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.420123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.420125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:26.420126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:26.420131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:26.420139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:26.420143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:26.420148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:26.420153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:26.420157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:26.420162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:26.420167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:26.420171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:26.420176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:26.420181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.420186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.420190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.420194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:26.420199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:26.420207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:26.420214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:26.420221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:26.420227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:26.420232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:26.420238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:26.420242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:26.420247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:26.420253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:26.420259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:26.420264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:26.420270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:26.420276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:26.420281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:26.420287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:26.420293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:26.420298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:26.420304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:26.420309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:26.420315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:26.420320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.420326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.420331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.420337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.420343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.420349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.420353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:26.420358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:26.420363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:26.420368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:26.420434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:26.421492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894700376677992:2789] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:26.426752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894700376677992:2789] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:26.426767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894700376677992:2789] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:26.426771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894700376677992:2789] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:26.426781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 48 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:26.427144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:26.428020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:26.428038Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:26.428041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:26.428045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:26.428052Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 47 [2:7555894700286955415:2645]
2025-09-30T14:50:26.428070Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:26.428091Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:26.428098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.428102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.428104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.428120Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:26.428132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:26.428139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:26.428210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.428218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.428220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.428224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:26.428227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:26.428457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 47
2025-09-30T14:50:26.428461Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 47
2025-09-30T14:50:26.428295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:26.428307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.428319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.428331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.428348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:26.428365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894700376678031:2789], now have 1 active actors on pipe
2025-09-30T14:50:26.428369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894700376677926:2454], now have 1 active actors on pipe
2025-09-30T14:50:26.428376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894700286955410:2645]
2025-09-30T14:50:26.428379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894700286955410:2645]
2025-09-30T14:50:26.428381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894700286955410:2645]
2025-09-30T14:50:26.428394Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:26.428408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:26.428411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:26.428413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:26.428415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:26.428428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:26.428431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:26.428463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894700286955410:2645]
2025-09-30T14:50:26.428473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:26.428479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:26.428504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:26.428509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:26.428541Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63a073b7-28dc6eef-5e0f14da-b7825be3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:26.428548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.428552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.428554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:26.428567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.428576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:26.428591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:26.428750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:26.428758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:26.428781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:26.428871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 48 partition: 0 MaxSeqNo: 42 sessionId: src_id|63a073b7-28dc6eef-5e0f14da-b7825be3_0
2025-09-30T14:50:26.429245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4e205c4-bdf0344b-8c1f4a99-57180691_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|63a073b7-28dc6eef-5e0f14da-b7825be3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:26.432373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63a073b7-28dc6eef-5e0f14da-b7825be3_0] Write session: try to update token
2025-09-30T14:50:26.432396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63a073b7-28dc6eef-5e0f14da-b7825be3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:26.441068Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:26.441091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:26.441102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894700286955410:2645]
2025-09-30T14:50:26.441157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:26.441292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:26.441370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:26.441516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:26.441660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:26.441812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:26.442053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:26.442109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:26.449212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 48 sessionId: src_id|63a073b7-28dc6eef-5e0f14da-b7825be3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:26.452027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:26.452494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:26.452523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:26.452543Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:26.452546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:26.452550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:26.452553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:26.452562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894700286955410:2645]
2025-09-30T14:50:26.452566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894700286955410:2645]
2025-09-30T14:50:26.452571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894700286955410:2645]
2025-09-30T14:50:26.452605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:26.452618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:26.452620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:26.452622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:26.452629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.452632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:26.452760Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:26.507445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894700376678039:2517]
2025-09-30T14:50:26.508021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 47, pipe: [1:7555894700376678039:2517]
2025-09-30T14:50:26.576501Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:26.576817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:26.576857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894700376678039:2517], now have 1 active actors on pipe
2025-09-30T14:50:26.577083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:26.577184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:26.577192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:26.577218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894700376678039:2517]
2025-09-30T14:50:26.577258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 48 reason: error at write: Disconnected sessionId: src_id|63a073b7-28dc6eef-5e0f14da-b7825be3_0
2025-09-30T14:50:26.577262Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:26.577403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 48 sessionId: src_id|63a073b7-28dc6eef-5e0f14da-b7825be3_0 is DEAD
2025-09-30T14:50:26.583375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63a073b7-28dc6eef-5e0f14da-b7825be3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:26.583395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63a073b7-28dc6eef-5e0f14da-b7825be3_0] Write session will restart in 0.006071s
2025-09-30T14:50:26.583426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63a073b7-28dc6eef-5e0f14da-b7825be3_0] Write session: Do CDS request
2025-09-30T14:50:26.583448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63a073b7-28dc6eef-5e0f14da-b7825be3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:26.587648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:26.588297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:26.588507Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:26.588519Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:26.588529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:26.588583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:26.588624Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894700286955521:2648]
2025-09-30T14:50:26.589289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:26.589607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:26.589654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:26.590130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:26.590214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:26.590215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:26.590216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:26.590217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:26.590218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:26.590220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:26.590221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:26.590222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:26.590223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:26.590224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:26.590225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.590226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.590227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.590228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:26.590230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:26.590235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:26.590245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:26.590248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:26.590252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:26.590255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:26.590258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:26.590261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:26.590265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:26.590268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:26.590271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:26.590274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.590278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.590281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.590284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:26.590287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:26.590295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:26.590302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:26.590308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:26.590313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:26.590319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:26.590324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:26.590330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:26.590336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:26.590340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:26.590346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:26.590350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:26.590356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:26.590361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:26.590366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:26.590370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:26.590375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:26.590380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:26.590384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:26.590388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:26.590392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:26.590397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.590402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.590406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.590411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.590416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.590421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.590425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:26.590445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:26.590450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:26.590455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:26.590498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:26.590794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63a073b7-28dc6eef-5e0f14da-b7825be3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:26.590844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:26.590859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 49
2025-09-30T14:50:26.591043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 49 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:26.591085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 49 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:26.591096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=49 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:26.591101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:26.591997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 49 sessionId:  describe result for acl check
2025-09-30T14:50:26.592033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:26.592035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:26.592037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:26.592042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894700376678117:2794] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:26.592559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894700376678117:2794] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:26.594879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894700376678117:2794] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:26.596211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:26.597030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:26.597044Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:26.597046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:26.597049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:26.597053Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 48 [2:7555894700286955521:2648]
2025-09-30T14:50:26.597066Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:26.597079Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:26.597081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.597083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.597084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.597094Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:26.597099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:26.597104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:26.597146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.597152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.597154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.597158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:26.597160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:26.597210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:26.597216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.597224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.597231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.597246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:26.597261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894700286955516:2648]
2025-09-30T14:50:26.597266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894700286955516:2648]
2025-09-30T14:50:26.597267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894700286955516:2648]
2025-09-30T14:50:26.597276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:26.597290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894700376678047:2454], now have 1 active actors on pipe
2025-09-30T14:50:26.597293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:26.597298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:26.597301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:26.597302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:26.597310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:26.597316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:26.597342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894700286955516:2648]
2025-09-30T14:50:26.597352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:26.597383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:26.597413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 48
2025-09-30T14:50:26.598007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894700376678117:2794] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:26.598019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894700376678117:2794] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:26.598022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894700376678117:2794] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:26.598028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 49 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:26.602526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894700376678154:2794], now have 1 active actors on pipe
2025-09-30T14:50:26.602604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 48
2025-09-30T14:50:26.602698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:26.602712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:26.602751Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42c3cab2-d1d4cf79-c658d777-20b2af7e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:26.602768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.602777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.602781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:26.602794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.602814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:26.602837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:26.604782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:26.604799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:26.604824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:26.605076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 49 partition: 0 MaxSeqNo: 42 sessionId: src_id|42c3cab2-d1d4cf79-c658d777-20b2af7e_0
2025-09-30T14:50:26.605456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63a073b7-28dc6eef-5e0f14da-b7825be3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|42c3cab2-d1d4cf79-c658d777-20b2af7e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:26.608193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42c3cab2-d1d4cf79-c658d777-20b2af7e_0] Write session: try to update token
2025-09-30T14:50:26.608211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42c3cab2-d1d4cf79-c658d777-20b2af7e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:26.612874Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:26.612900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:26.612911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894700286955516:2648]
2025-09-30T14:50:26.612958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:26.613133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:26.613186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:26.613363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:26.613530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:26.613696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:26.613935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:26.613976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:26.626087Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:26.626109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:26.626111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:26.626114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:26.626123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894700286955516:2648]
2025-09-30T14:50:26.626126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894700286955516:2648]
2025-09-30T14:50:26.626130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894700286955516:2648]
2025-09-30T14:50:26.626166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:26.626173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.626176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:26.626313Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:26.628151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:26.628165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:26.628170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:26.627365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 49 sessionId: src_id|42c3cab2-d1d4cf79-c658d777-20b2af7e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:26.630141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:26.677451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894700376678170:2517]
2025-09-30T14:50:26.677702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 48, pipe: [1:7555894700376678170:2517]
2025-09-30T14:50:26.743195Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:26.743744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:26.743762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:26.743783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894700376678170:2517], now have 1 active actors on pipe
2025-09-30T14:50:26.744028Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:26.744491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:26.744578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 49 reason: status is not ok: tablet will be restarted right now sessionId: src_id|42c3cab2-d1d4cf79-c658d777-20b2af7e_0
2025-09-30T14:50:26.744744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 49 sessionId: src_id|42c3cab2-d1d4cf79-c658d777-20b2af7e_0 is DEAD
2025-09-30T14:50:26.744886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894700376678170:2517]
2025-09-30T14:50:26.744900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:26.747384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42c3cab2-d1d4cf79-c658d777-20b2af7e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:26.747397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42c3cab2-d1d4cf79-c658d777-20b2af7e_0] Write session will restart in 0.008455s
2025-09-30T14:50:26.747421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42c3cab2-d1d4cf79-c658d777-20b2af7e_0] Write session: Do CDS request
2025-09-30T14:50:26.747428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42c3cab2-d1d4cf79-c658d777-20b2af7e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:26.755401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:26.755909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:26.756112Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:26.756122Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:26.756132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:26.756180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:26.756232Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894700286955637:2651]
2025-09-30T14:50:26.756783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42c3cab2-d1d4cf79-c658d777-20b2af7e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:26.756867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:26.756881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 50
2025-09-30T14:50:26.756917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:26.756994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 50 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:26.757029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 50 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:26.757034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=50 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:26.757039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:26.757266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:26.757339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:26.757422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 50 sessionId:  describe result for acl check
2025-09-30T14:50:26.757457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:26.757464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:26.757466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:26.757472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894700376678240:2799] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:26.757686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:26.757759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:26.757765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:26.757766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:26.757767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:26.757768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:26.757770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:26.757771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:26.757772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:26.757774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:26.757775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:26.757776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.757777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.757778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.757779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:26.757781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:26.757786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:26.757796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:26.757800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:26.757805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:26.757808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:26.757813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:26.757817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:26.757820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:26.757824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:26.757829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:26.757833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.757837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.757841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.757845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:26.757849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:26.757857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:26.757864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:26.757870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:26.757876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:26.757881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:26.757886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:26.757891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:26.757896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:26.757901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:26.757907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:26.757911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:26.757916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:26.757921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:26.757927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:26.757931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:26.757936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:26.757941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:26.757946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:26.757955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:26.757961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:26.757970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.757976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.757985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.757990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.757994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.758003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.758008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:26.758004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894700376678240:2799] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:26.758018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:26.758023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:26.758028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:26.758057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:26.760143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894700376678240:2799] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:26.763074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894700376678240:2799] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:26.763086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894700376678240:2799] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:26.763090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894700376678240:2799] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:26.763098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 50 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:26.764381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:26.765136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:26.765148Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:26.765150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:26.765154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:26.765158Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 49 [2:7555894700286955637:2651]
2025-09-30T14:50:26.765171Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:26.765182Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:26.765184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.765187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.765188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.765199Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:26.765204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:26.765213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:26.765257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.765263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.765264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.765267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:26.765268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:26.765318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:26.765327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.765336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.765342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.765352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:26.765366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894700376678276:2799], now have 1 active actors on pipe
2025-09-30T14:50:26.765369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894700376678172:2454], now have 1 active actors on pipe
2025-09-30T14:50:26.765373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894700286955632:2651]
2025-09-30T14:50:26.765375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894700286955632:2651]
2025-09-30T14:50:26.765377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894700286955632:2651]
2025-09-30T14:50:26.765386Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:26.765397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:26.765400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:26.765410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:26.765412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:26.765412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:26.765415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:26.765438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894700286955632:2651]
2025-09-30T14:50:26.765444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:26.765430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 49
2025-09-30T14:50:26.765436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 49
2025-09-30T14:50:26.765450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:26.765482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:26.765487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:26.765513Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|adf06d12-b2e94afe-2b471355-2b0bfaef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:26.765526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.765534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.765536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:26.765546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.765562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:26.765579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:26.765700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:26.765706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:26.765717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:26.765834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 50 partition: 0 MaxSeqNo: 42 sessionId: src_id|adf06d12-b2e94afe-2b471355-2b0bfaef_0
2025-09-30T14:50:26.766175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42c3cab2-d1d4cf79-c658d777-20b2af7e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|adf06d12-b2e94afe-2b471355-2b0bfaef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:26.769195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adf06d12-b2e94afe-2b471355-2b0bfaef_0] Write session: try to update token
2025-09-30T14:50:26.769215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adf06d12-b2e94afe-2b471355-2b0bfaef_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:26.777119Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:26.777136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:26.777146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894700286955632:2651]
2025-09-30T14:50:26.777191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:26.777376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:26.777515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:26.777529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:26.777670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:26.777818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:26.778028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:26.778080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:26.785326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 50 sessionId: src_id|adf06d12-b2e94afe-2b471355-2b0bfaef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:26.788197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:26.788700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:26.788721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:26.788736Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:26.788739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:26.788740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:26.788741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:26.788748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894700286955632:2651]
2025-09-30T14:50:26.788754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894700286955632:2651]
2025-09-30T14:50:26.788758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894700286955632:2651]
2025-09-30T14:50:26.788794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:26.788806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:26.788806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:26.788810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:26.788812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.788814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:26.788941Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:26.844831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894700376678285:2517]
2025-09-30T14:50:26.845069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 49, pipe: [1:7555894700376678285:2517]
2025-09-30T14:50:26.901348Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:26.901646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:26.901681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894700376678285:2517], now have 1 active actors on pipe
2025-09-30T14:50:26.901852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:26.901952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:26.901956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:26.902027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 50 reason: error at write: Disconnected sessionId: src_id|adf06d12-b2e94afe-2b471355-2b0bfaef_0
2025-09-30T14:50:26.902154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 50 sessionId: src_id|adf06d12-b2e94afe-2b471355-2b0bfaef_0 is DEAD
2025-09-30T14:50:26.902271Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:26.902301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894700376678285:2517]
2025-09-30T14:50:26.903501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adf06d12-b2e94afe-2b471355-2b0bfaef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:26.903512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adf06d12-b2e94afe-2b471355-2b0bfaef_0] Write session will restart in 0.009005s
2025-09-30T14:50:26.903535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adf06d12-b2e94afe-2b471355-2b0bfaef_0] Write session: Do CDS request
2025-09-30T14:50:26.903541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adf06d12-b2e94afe-2b471355-2b0bfaef_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:26.913779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adf06d12-b2e94afe-2b471355-2b0bfaef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:26.913864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:26.913878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 51
2025-09-30T14:50:26.913997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 51 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:26.914035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 51 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:26.914039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=51 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:26.914044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:26.914482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 51 sessionId:  describe result for acl check
2025-09-30T14:50:26.914518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:26.914525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:26.914527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:26.914533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894700376678335:2804] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:26.915057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894700376678335:2804] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:26.916535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:26.916979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894700376678335:2804] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:26.917197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:26.917386Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:26.917395Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:26.917404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:26.917460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:26.917497Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894700286955743:2653]
2025-09-30T14:50:26.918191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:26.918428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:26.918457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:26.918779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:26.918852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:26.918856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:26.918857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:26.918858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:26.918859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:26.918859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:26.918860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:26.918861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:26.918861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:26.918862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:26.918863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.918864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.918864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.918865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:26.918866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:26.918869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:26.918875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:26.918877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:26.918880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:26.918883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:26.918885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:26.918887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:26.918890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:26.918892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:26.918894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:26.918897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.918899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.918902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.918904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:26.918906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:26.918912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:26.918916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:26.918920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:26.918924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:26.918926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:26.918929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:26.918932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:26.918935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:26.918939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:26.918942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:26.918945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:26.918948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:26.918950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:26.918953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:26.918955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:26.918959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:26.918964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:26.918969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:26.918974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:26.918979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:26.918983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.918989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.918993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.918999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.919003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.919010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.919015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:26.919020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:26.919025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:26.919030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:26.919073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:26.919123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894700376678335:2804] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:26.919136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894700376678335:2804] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:26.919139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894700376678335:2804] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:26.919147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 51 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:26.924542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:26.925411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:26.925428Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:26.925431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:26.925435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:26.925442Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 50 [2:7555894700286955743:2653]
2025-09-30T14:50:26.925461Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:26.925478Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:26.925485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.925489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.925492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.925509Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:26.925521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:26.925529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:26.925582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.925589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.925591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.925594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:26.925596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:26.925669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:26.925676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.925685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:26.925691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:26.925701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:26.925714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894700286955738:2653]
2025-09-30T14:50:26.925716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894700286955738:2653]
2025-09-30T14:50:26.925718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894700286955738:2653]
2025-09-30T14:50:26.925724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:26.925734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:26.925737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:26.925737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:26.925739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:26.925751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:26.925754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:26.925764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894700376678390:2804], now have 1 active actors on pipe
2025-09-30T14:50:26.925768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894700376678287:2454], now have 1 active actors on pipe
2025-09-30T14:50:26.925796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894700286955738:2653]
2025-09-30T14:50:26.925809Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:26.925821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:26.925817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 50
2025-09-30T14:50:26.925818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 50
2025-09-30T14:50:26.925929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:26.925938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:26.925960Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44cc0f7d-95ce8a20-77b913d9-9b74343c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:26.925968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.925972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.925975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:26.925985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.925994Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:26.926007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:26.926143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:26.926155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:26.926189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:26.926287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 51 partition: 0 MaxSeqNo: 42 sessionId: src_id|44cc0f7d-95ce8a20-77b913d9-9b74343c_0
2025-09-30T14:50:26.926657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adf06d12-b2e94afe-2b471355-2b0bfaef_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|44cc0f7d-95ce8a20-77b913d9-9b74343c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:26.929516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44cc0f7d-95ce8a20-77b913d9-9b74343c_0] Write session: try to update token
2025-09-30T14:50:26.929533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44cc0f7d-95ce8a20-77b913d9-9b74343c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:26.938377Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:26.938397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:26.938400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:26.938402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:26.938415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894700286955738:2653]
2025-09-30T14:50:26.938419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894700286955738:2653]
2025-09-30T14:50:26.938423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894700286955738:2653]
2025-09-30T14:50:26.938469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:26.938476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:26.938479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:26.938480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:26.938486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:26.938491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:26.938620Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:26.946087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 51 sessionId: src_id|44cc0f7d-95ce8a20-77b913d9-9b74343c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:26.948800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:27.002579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894704671645704:2517]
2025-09-30T14:50:27.002878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 50, pipe: [1:7555894704671645704:2517]
2025-09-30T14:50:27.059365Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:27.059910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:27.059931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:27.059952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894704671645704:2517], now have 1 active actors on pipe
2025-09-30T14:50:27.060198Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:27.060208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894704671645704:2517]
2025-09-30T14:50:27.060240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:27.060243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:27.060310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 51 reason: error at write: Disconnected sessionId: src_id|44cc0f7d-95ce8a20-77b913d9-9b74343c_0
2025-09-30T14:50:27.060517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 51 sessionId: src_id|44cc0f7d-95ce8a20-77b913d9-9b74343c_0 is DEAD
2025-09-30T14:50:27.060578Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:27.060707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44cc0f7d-95ce8a20-77b913d9-9b74343c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:27.060720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44cc0f7d-95ce8a20-77b913d9-9b74343c_0] Write session will restart in 0.007142s
2025-09-30T14:50:27.060745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44cc0f7d-95ce8a20-77b913d9-9b74343c_0] Write session: Do CDS request
2025-09-30T14:50:27.060755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44cc0f7d-95ce8a20-77b913d9-9b74343c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:27.068969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44cc0f7d-95ce8a20-77b913d9-9b74343c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:27.069073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:27.069087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 52
2025-09-30T14:50:27.069216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 52 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:27.069248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 52 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:27.069258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=52 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:27.069264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:27.069741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 52 sessionId:  describe result for acl check
2025-09-30T14:50:27.069779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:27.069787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:27.069789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:27.069796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894704671645758:2810] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:27.070344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894704671645758:2810] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:27.071938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:27.072665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:27.072707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894704671645758:2810] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:27.072865Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:27.072875Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:27.072886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:27.072937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:27.072978Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894704581923147:2656]
2025-09-30T14:50:27.073717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:27.074024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:27.074069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:27.074441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:27.074501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:27.074507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:27.074508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:27.074509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:27.074511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:27.074512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:27.074513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:27.074514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:27.074516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:27.074517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:27.074518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.074519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.074520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.074522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:27.074523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:27.074528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:27.074539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:27.074544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:27.074548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:27.074553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:27.074557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:27.074561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:27.074566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:27.074570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:27.074574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:27.074578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.074583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.074587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.074592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:27.074596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:27.074607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:27.074616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:27.074626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:27.074637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:27.074642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:27.074652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:27.074657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:27.074667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:27.074672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:27.074683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:27.074690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:27.074695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:27.074704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:27.074710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:27.074726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:27.074736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:27.074741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:27.074751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:27.074756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:27.074766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:27.074771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.074776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.074783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.074792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.074797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.074808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.074813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:27.074822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:27.074827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:27.074833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:27.074882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:27.075482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894704671645758:2810] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:27.075496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894704671645758:2810] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:27.075500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894704671645758:2810] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:27.075507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 52 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:27.080665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:27.081582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:27.081600Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:27.081602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:27.081608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:27.081616Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 51 [2:7555894704581923147:2656]
2025-09-30T14:50:27.081634Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:27.081650Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:27.081653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.081657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.081660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.081677Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:27.081689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:27.081698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:27.081772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.081779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.081781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.081785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:27.081787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:27.081864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:27.081872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.081889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.081904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.081925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:27.081949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894704671645815:2810], now have 1 active actors on pipe
2025-09-30T14:50:27.081956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894704671645709:2454], now have 1 active actors on pipe
2025-09-30T14:50:27.081963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894704581923141:2656]
2025-09-30T14:50:27.081964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894704581923141:2656]
2025-09-30T14:50:27.081966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894704581923141:2656]
2025-09-30T14:50:27.081979Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:27.081993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:27.081997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:27.081997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:27.081998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:27.082011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:27.082019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:27.082054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894704581923141:2656]
2025-09-30T14:50:27.082061Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:27.082012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 51
2025-09-30T14:50:27.082064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:27.082076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:27.082082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:27.082019Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 51
2025-09-30T14:50:27.082133Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b35e20d-dc93c8fa-ee42cb53-55148bd0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:27.082144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.082148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.082150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:27.082158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.082172Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:27.082199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:27.082350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:27.082365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:27.082392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:27.082481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 52 partition: 0 MaxSeqNo: 42 sessionId: src_id|6b35e20d-dc93c8fa-ee42cb53-55148bd0_0
2025-09-30T14:50:27.082879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44cc0f7d-95ce8a20-77b913d9-9b74343c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6b35e20d-dc93c8fa-ee42cb53-55148bd0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:27.085807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b35e20d-dc93c8fa-ee42cb53-55148bd0_0] Write session: try to update token
2025-09-30T14:50:27.085827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b35e20d-dc93c8fa-ee42cb53-55148bd0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:27.095928Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:27.095950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:27.095954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:27.095957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:27.095970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894704581923141:2656]
2025-09-30T14:50:27.095975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894704581923141:2656]
2025-09-30T14:50:27.095980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894704581923141:2656]
2025-09-30T14:50:27.096028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:27.096030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:27.096036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.096038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:27.096038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:27.096042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:27.096188Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:27.101822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 52 sessionId: src_id|6b35e20d-dc93c8fa-ee42cb53-55148bd0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:27.105069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:27.160261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894704671645822:2517]
2025-09-30T14:50:27.160542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 51, pipe: [1:7555894704671645822:2517]
2025-09-30T14:50:27.211057Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:27.211409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:27.211425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:27.211463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894704671645822:2517], now have 1 active actors on pipe
2025-09-30T14:50:27.211910Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:27.212061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894704671645822:2517]
2025-09-30T14:50:27.212097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:27.212100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:27.212167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 52 reason: error at write: Disconnected sessionId: src_id|6b35e20d-dc93c8fa-ee42cb53-55148bd0_0
2025-09-30T14:50:27.212501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b35e20d-dc93c8fa-ee42cb53-55148bd0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:27.212516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b35e20d-dc93c8fa-ee42cb53-55148bd0_0] Write session will restart in 0.005617s
2025-09-30T14:50:27.212541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b35e20d-dc93c8fa-ee42cb53-55148bd0_0] Write session: Do CDS request
2025-09-30T14:50:27.212547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b35e20d-dc93c8fa-ee42cb53-55148bd0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:27.212332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 52 sessionId: src_id|6b35e20d-dc93c8fa-ee42cb53-55148bd0_0 is DEAD
2025-09-30T14:50:27.212516Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:27.219762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b35e20d-dc93c8fa-ee42cb53-55148bd0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:27.223432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:27.223450Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 53
2025-09-30T14:50:27.223604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 53 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:27.223644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 53 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:27.223655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=53 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:27.223660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:27.223653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:27.224077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 53 sessionId:  describe result for acl check
2025-09-30T14:50:27.224112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:27.224118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:27.224120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:27.224126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894704671645892:2814] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:27.224689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894704671645892:2814] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:27.226568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894704671645892:2814] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:27.228074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:27.228321Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:27.228333Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:27.228345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:27.228405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:27.228450Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894704581923253:2658]
2025-09-30T14:50:27.229255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:27.229568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:27.229570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894704671645892:2814] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:27.229585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894704671645892:2814] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:27.229589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894704671645892:2814] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:27.229598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 53 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:27.229637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:27.230062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:27.230134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:27.230141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:27.230143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:27.230144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:27.230146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:27.230147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:27.230148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:27.230150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:27.230151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:27.230152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:27.230154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.230155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.230156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.230158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:27.230159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:27.230166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:27.230179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:27.230184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:27.230190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:27.230195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:27.230200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:27.230204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:27.230209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:27.230214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:27.230220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:27.230225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.230229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.230234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.230629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:27.230649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:27.230663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:27.230673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:27.230681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:27.230687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:27.230693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:27.230706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:27.230711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:27.230731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:27.230743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:27.230749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:27.230773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:27.230783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:27.230789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:27.230794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:27.230803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:27.230809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:27.230824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:27.230835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:27.230841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:27.230852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:27.230858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.230870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.230880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.230885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.230890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.230895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.230901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:27.230905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:27.230911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:27.230916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:27.230960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:27.238255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:27.239166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:27.239173Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:27.239177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:27.239181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:27.239190Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 52 [2:7555894704581923253:2658]
2025-09-30T14:50:27.239210Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:27.239231Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:27.239236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.239240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.239262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.239283Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:27.239290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:27.239298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:27.239374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.239378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.239380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.239385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:27.239387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:27.239468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:27.239471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.239486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.239498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.239514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:27.239532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894704581923247:2658]
2025-09-30T14:50:27.239536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894704581923247:2658]
2025-09-30T14:50:27.239539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894704581923247:2658]
2025-09-30T14:50:27.239554Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:27.239570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:27.239587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:27.239590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:27.239592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:27.239596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:27.239599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:27.239634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894704581923247:2658]
2025-09-30T14:50:27.239637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:27.239687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:27.239978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894704671645824:2454], now have 1 active actors on pipe
2025-09-30T14:50:27.239992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894704671645928:2814], now have 1 active actors on pipe
2025-09-30T14:50:27.241116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 52
2025-09-30T14:50:27.241161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 52
2025-09-30T14:50:27.241233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:27.241247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:27.241277Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af89ad9d-bdf08e2d-ddb782d4-a0c3e127_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:27.241287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.241292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.241295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:27.241307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.241319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:27.241337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:27.241539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:27.241547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:27.241563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:27.241679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 53 partition: 0 MaxSeqNo: 42 sessionId: src_id|af89ad9d-bdf08e2d-ddb782d4-a0c3e127_0
2025-09-30T14:50:27.243422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b35e20d-dc93c8fa-ee42cb53-55148bd0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|af89ad9d-bdf08e2d-ddb782d4-a0c3e127_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:27.246250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af89ad9d-bdf08e2d-ddb782d4-a0c3e127_0] Write session: try to update token
2025-09-30T14:50:27.246271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af89ad9d-bdf08e2d-ddb782d4-a0c3e127_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:27.259370Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:27.259395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:27.259404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894704581923247:2658]
2025-09-30T14:50:27.259453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:27.259465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:27.259645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:27.259913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:27.260079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:27.260240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:27.260462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:27.260507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:27.265850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 53 sessionId: src_id|af89ad9d-bdf08e2d-ddb782d4-a0c3e127_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:27.268738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:27.269015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:27.269038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:27.269079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:27.269173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:27.276771Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:27.276796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:27.276798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:27.276800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:27.276810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894704581923247:2658]
2025-09-30T14:50:27.276814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894704581923247:2658]
2025-09-30T14:50:27.276818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894704581923247:2658]
2025-09-30T14:50:27.276864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:27.276871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.276875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:27.277015Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:27.279349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:27.279367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:27.279372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:27.315319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894704671645951:2517]
2025-09-30T14:50:27.317223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 52, pipe: [1:7555894704671645951:2517]
2025-09-30T14:50:27.398521Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:27.407593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:27.407621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:27.407809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:27.407877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:27.407950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:27.408031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:27.408523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:27.408534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:27.408615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:27.408678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:27.408744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:27.408870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:27.408917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:27.408921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:27.408997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:27.409057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:27.409125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:27.409191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:27.409232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:27.409234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:27.409305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:27.409369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:27.409430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:27.409491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:27.409531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:27.409534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:27.409607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:27.409742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:27.409802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:27.409866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:27.409960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:27.409965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:27.410034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:27.410095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:27.410156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:27.410217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:27.410258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:27.410260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:27.410332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:27.410392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:27.410456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:27.410516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:27.410558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:27.410560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:27.410629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:27.410692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:27.411007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:27.411080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:27.411126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:27.411128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:27.411203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:27.411291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:27.411352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:27.411417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:27.411463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:27.411465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:27.411535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:27.411605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:27.411681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:27.411764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:27.411814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:27.411817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:27.411891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894704671645951:2517], now have 1 active actors on pipe
2025-09-30T14:50:27.412501Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:27.413492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af89ad9d-bdf08e2d-ddb782d4-a0c3e127_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:27.413502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af89ad9d-bdf08e2d-ddb782d4-a0c3e127_0] Write session will restart in 0.007552s
2025-09-30T14:50:27.413523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af89ad9d-bdf08e2d-ddb782d4-a0c3e127_0] Write session: Do CDS request
2025-09-30T14:50:27.413530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af89ad9d-bdf08e2d-ddb782d4-a0c3e127_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:27.412949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894704671645951:2517]
2025-09-30T14:50:27.412977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:27.413011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:27.413013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:27.413039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 53 reason: error at write: Disconnected sessionId: src_id|af89ad9d-bdf08e2d-ddb782d4-a0c3e127_0
2025-09-30T14:50:27.413205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 53 sessionId: src_id|af89ad9d-bdf08e2d-ddb782d4-a0c3e127_0 is DEAD
2025-09-30T14:50:27.421946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af89ad9d-bdf08e2d-ddb782d4-a0c3e127_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:27.423515Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:27.423530Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 54
2025-09-30T14:50:27.423754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 54 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:27.423793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 54 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:27.423798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=54 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:27.423804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:27.424229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 54 sessionId:  describe result for acl check
2025-09-30T14:50:27.424252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:27.424254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:27.424255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:27.424260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894704671645978:2826] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:27.424828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894704671645978:2826] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:27.427590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894704671645978:2826] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:27.431221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894704671645978:2826] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:27.431237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894704671645978:2826] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:27.431261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894704671645978:2826] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:27.431271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 54 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:27.432126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:27.432649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:27.432907Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:27.432916Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:27.432929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:27.432982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:27.433031Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894704581923401:2673]
2025-09-30T14:50:27.433719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:27.434048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:27.434096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:27.434442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:27.434508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:27.434515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:27.434516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:27.434517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:27.434518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:27.434520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:27.434521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:27.434522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:27.434524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:27.434525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:27.434527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.434528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.434529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.434531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:27.434532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:27.434538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:27.434548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:27.434552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:27.434557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:27.434561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:27.434565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:27.434570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:27.434573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:27.434578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:27.434582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:27.434586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.434589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.434593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.434597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:27.434601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:27.434609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:27.434617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:27.434624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:27.434632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:27.434643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:27.434648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:27.434671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:27.434682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:27.434687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:27.434697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:27.434701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:27.434706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:27.434711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:27.434730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:27.434734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:27.434745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:27.434750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:27.434756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:27.434766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:27.434772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:27.434777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.434788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.434792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.434797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.434807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.434813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.434817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:27.434823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:27.434832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:27.434837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:27.434882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:27.444062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:27.445193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:27.445213Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:27.445217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:27.445221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:27.445229Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 53 [2:7555894704581923401:2673]
2025-09-30T14:50:27.445245Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:27.445261Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:27.445265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.445269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.445272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.445288Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:27.445300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:27.445313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:27.445380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.445389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.445391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.445395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:27.445398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:27.445488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:27.445499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.445512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.445526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.445546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:27.445565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894704671646067:2826], now have 1 active actors on pipe
2025-09-30T14:50:27.445576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894704671645963:2454], now have 1 active actors on pipe
2025-09-30T14:50:27.445582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894704581923396:2673]
2025-09-30T14:50:27.445584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894704581923396:2673]
2025-09-30T14:50:27.445587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894704581923396:2673]
2025-09-30T14:50:27.445600Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:27.445614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:27.445618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:27.445622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:27.445624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:27.445629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:27.445632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:27.445667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894704581923396:2673]
2025-09-30T14:50:27.445682Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:27.445700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:27.445838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 53
2025-09-30T14:50:27.445881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 53
2025-09-30T14:50:27.446017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:27.446028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:27.446057Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e73621c-f000e686-c95c991a-17107a42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:27.446071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.446076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.446079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:27.446088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.446098Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:27.446115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:27.446309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:27.446315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:27.446329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:27.446413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 54 partition: 0 MaxSeqNo: 42 sessionId: src_id|e73621c-f000e686-c95c991a-17107a42_0
2025-09-30T14:50:27.446788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af89ad9d-bdf08e2d-ddb782d4-a0c3e127_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e73621c-f000e686-c95c991a-17107a42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:27.449556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e73621c-f000e686-c95c991a-17107a42_0] Write session: try to update token
2025-09-30T14:50:27.449574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e73621c-f000e686-c95c991a-17107a42_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:27.460585Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:27.460605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:27.460615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894704581923396:2673]
2025-09-30T14:50:27.460667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:27.460680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:27.460848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:27.461006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:27.461153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:27.461304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:27.461507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:27.461546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:27.467237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 54 sessionId: src_id|e73621c-f000e686-c95c991a-17107a42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:27.470130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:27.470532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:27.470556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:27.471832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:27.471870Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:27.471874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:27.471876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:27.471878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:27.471888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894704581923396:2673]
2025-09-30T14:50:27.471892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894704581923396:2673]
2025-09-30T14:50:27.471895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894704581923396:2673]
2025-09-30T14:50:27.471926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:27.471937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:27.471938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:27.471942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:27.471978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:27.471945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.471948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:27.472085Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:27.513053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894704671646080:2517]
2025-09-30T14:50:27.513360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 53, pipe: [1:7555894704671646080:2517]
2025-09-30T14:50:27.586751Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:27.595258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:27.595282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:27.595448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:27.595514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:27.595584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:27.595648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:27.595694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:27.595702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:27.595769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:27.595830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:27.595896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:27.595970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:27.596020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:27.596027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:27.596094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:27.596156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:27.596227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:27.596294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:27.596343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:27.596352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:27.596423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:27.596495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:27.596567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:27.596636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:27.596681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:27.596688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:27.596763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:27.596828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:27.596889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:27.596954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:27.597001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:27.597007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:27.597071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:27.597133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:27.597193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:27.597253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:27.597301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:27.597308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:27.597376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:27.597435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:27.597498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:27.597568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:27.597613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:27.597620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:27.597693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:27.597760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:27.597831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:27.597896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:27.597949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:27.597956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:27.598025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:27.598089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:27.598158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:27.598226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:27.598274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:27.598282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:27.598349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:27.598573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:27.598650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:27.598737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:27.598883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:27.598890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:27.598956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894704671646080:2517], now have 1 active actors on pipe
2025-09-30T14:50:27.599228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894704671646080:2517]
2025-09-30T14:50:27.599297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:27.599300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:27.599340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 54 reason: error at write: Disconnected sessionId: src_id|e73621c-f000e686-c95c991a-17107a42_0
2025-09-30T14:50:27.599541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 54 sessionId: src_id|e73621c-f000e686-c95c991a-17107a42_0 is DEAD
2025-09-30T14:50:27.599588Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:27.599779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e73621c-f000e686-c95c991a-17107a42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:27.599798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e73621c-f000e686-c95c991a-17107a42_0] Write session will restart in 0.007660s
2025-09-30T14:50:27.599829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e73621c-f000e686-c95c991a-17107a42_0] Write session: Do CDS request
2025-09-30T14:50:27.599838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e73621c-f000e686-c95c991a-17107a42_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:27.600194Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:27.608927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e73621c-f000e686-c95c991a-17107a42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:27.609036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:27.609053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 55
2025-09-30T14:50:27.609237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 55 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:27.609272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 55 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:27.609284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=55 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:27.609289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:27.609712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 55 sessionId:  describe result for acl check
2025-09-30T14:50:27.609749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:27.609752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:27.609753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:27.609760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894704671646152:2830] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:27.610375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894704671646152:2830] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:27.610299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:27.611101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:27.611298Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:27.611307Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:27.611318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:27.611366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:27.611406Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894704581923508:2675]
2025-09-30T14:50:27.612112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:27.612404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:27.612448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:27.612798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:27.612861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:27.612866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:27.612867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:27.612868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:27.612869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:27.612870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:27.612872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:27.612873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:27.612874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:27.612875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:27.612877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.612879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.612880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.612882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:27.612883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:27.612888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:27.612898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:27.612902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:27.612905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:27.612909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:27.612913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:27.612917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:27.612921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:27.612925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:27.612930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:27.612935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.612939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.612944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.612948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:27.612953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:27.612961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:27.612980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:27.612992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:27.612997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:27.612996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894704671646152:2830] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:27.613002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:27.613007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:27.613013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:27.613018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:27.613023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:27.613028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:27.613032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:27.613038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:27.613042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:27.613047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:27.613053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:27.613058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:27.613063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:27.613068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:27.613072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:27.613077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:27.613081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.613085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.613090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.613096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.613100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.613106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.613110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:27.613115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:27.613120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:27.613125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:27.613167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:27.618573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894704671646152:2830] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:27.618589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894704671646152:2830] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:27.618593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894704671646152:2830] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:27.618601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 55 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:27.618699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:27.619601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:27.619617Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:27.619621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:27.619625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:27.619631Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 54 [2:7555894704581923508:2675]
2025-09-30T14:50:27.619648Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:27.619663Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:27.619666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.619670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.619673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.619690Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:27.619698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:27.619704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:27.619760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.619772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.619774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.619778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:27.619781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:27.619849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:27.619857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.619870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.619889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.619912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:27.619935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894704671646192:2830], now have 1 active actors on pipe
2025-09-30T14:50:27.619943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894704671646083:2454], now have 1 active actors on pipe
2025-09-30T14:50:27.619949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894704581923503:2675]
2025-09-30T14:50:27.619952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894704581923503:2675]
2025-09-30T14:50:27.619955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894704581923503:2675]
2025-09-30T14:50:27.619969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:27.619988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:27.619992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 54
2025-09-30T14:50:27.620003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:27.620006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 54
2025-09-30T14:50:27.620006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:27.620010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:27.620013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:27.620013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:27.620045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894704581923503:2675]
2025-09-30T14:50:27.620052Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:27.620060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:27.620082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:27.620091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:27.620121Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5cc23e44-99be9628-724cd850-35eff343_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:27.620133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.620136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.620138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:27.620148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.620156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:27.620176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:27.620358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:27.620366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:27.620379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:27.620483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 55 partition: 0 MaxSeqNo: 42 sessionId: src_id|5cc23e44-99be9628-724cd850-35eff343_0
2025-09-30T14:50:27.620891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e73621c-f000e686-c95c991a-17107a42_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5cc23e44-99be9628-724cd850-35eff343_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:27.623711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cc23e44-99be9628-724cd850-35eff343_0] Write session: try to update token
2025-09-30T14:50:27.623729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cc23e44-99be9628-724cd850-35eff343_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:27.632420Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:27.632437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:27.632440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:27.632443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:27.632452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894704581923503:2675]
2025-09-30T14:50:27.632457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894704581923503:2675]
2025-09-30T14:50:27.632462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894704581923503:2675]
2025-09-30T14:50:27.632504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:27.632509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:27.632512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.632515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:27.632516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:27.632520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:27.632678Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:27.642051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 55 sessionId: src_id|5cc23e44-99be9628-724cd850-35eff343_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:27.644823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:27.699406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894704671646211:2517]
2025-09-30T14:50:27.699803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 54, pipe: [1:7555894704671646211:2517]
2025-09-30T14:50:27.748934Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:27.749387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:27.749404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:27.749426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894704671646211:2517], now have 1 active actors on pipe
2025-09-30T14:50:27.749685Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:27.749753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894704671646211:2517]
2025-09-30T14:50:27.749788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:27.749875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 55 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5cc23e44-99be9628-724cd850-35eff343_0
2025-09-30T14:50:27.750081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 55 sessionId: src_id|5cc23e44-99be9628-724cd850-35eff343_0 is DEAD
2025-09-30T14:50:27.750284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cc23e44-99be9628-724cd850-35eff343_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:27.750301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cc23e44-99be9628-724cd850-35eff343_0] Write session will restart in 0.005670s
2025-09-30T14:50:27.750331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cc23e44-99be9628-724cd850-35eff343_0] Write session: Do CDS request
2025-09-30T14:50:27.750247Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:27.750340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cc23e44-99be9628-724cd850-35eff343_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:27.757096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cc23e44-99be9628-724cd850-35eff343_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:27.757038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:27.757055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 56
2025-09-30T14:50:27.757465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 56 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:27.757507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 56 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:27.757514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=56 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:27.757520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:27.758862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 56 sessionId:  describe result for acl check
2025-09-30T14:50:27.758903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:27.758905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:27.758907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:27.758913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894704671646245:2835] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:27.759458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894704671646245:2835] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:27.761995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:27.761942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894704671646245:2835] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:27.762566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:27.762774Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:27.762778Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:27.762788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:27.762837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:27.762869Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894704581923630:2678]
2025-09-30T14:50:27.763589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:27.764261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:27.764306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:27.764659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:27.764722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:27.764724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:27.764725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:27.764726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:27.764727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:27.764728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:27.764729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:27.764730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:27.764732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:27.764733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:27.764734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.764735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.764736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.764737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:27.764739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:27.764743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:27.764753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:27.764756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:27.764760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:27.764763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:27.764767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:27.764786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:27.764789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:27.764793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:27.764797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:27.764800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.764805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.764808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.764811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:27.764814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:27.764821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:27.764828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:27.764834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:27.764839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:27.764845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:27.764850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:27.764854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:27.764858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:27.764863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:27.764868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:27.764871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:27.764875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:27.764879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:27.764884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:27.764887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:27.764891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:27.764895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:27.764900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:27.764904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:27.764909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:27.764913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.764918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.764922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.764927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.764931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.764936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.764940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:27.764944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:27.764949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:27.764954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:27.764995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:27.771847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894704671646245:2835] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:27.771863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894704671646245:2835] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:27.771867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894704671646245:2835] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:27.771876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 56 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:27.772492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:27.773341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:27.773346Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:27.773349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:27.773353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:27.773360Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 55 [2:7555894704581923630:2678]
2025-09-30T14:50:27.773377Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:27.773391Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:27.773395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.773397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.773399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.773412Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:27.773417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:27.773422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:27.773483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.773487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.773489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.773492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:27.773495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:27.773571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:27.773574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.773586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.773599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.773618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:27.773635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894704581923625:2678]
2025-09-30T14:50:27.773638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894704581923625:2678]
2025-09-30T14:50:27.773640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894704581923625:2678]
2025-09-30T14:50:27.773649Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:27.773665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894704671646213:2454], now have 1 active actors on pipe
2025-09-30T14:50:27.773668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894704671646322:2835], now have 1 active actors on pipe
2025-09-30T14:50:27.773668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:27.773672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:27.773674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:27.773674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:27.773689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:27.773692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:27.773727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894704581923625:2678]
2025-09-30T14:50:27.773735Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:27.773759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:27.775118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 55
2025-09-30T14:50:27.775156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 55
2025-09-30T14:50:27.776185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cc23e44-99be9628-724cd850-35eff343_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7140e29b-3deaaaf3-81c29c15-984766b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:27.775307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:27.775323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:27.775352Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7140e29b-3deaaaf3-81c29c15-984766b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:27.775362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.775366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.775369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:27.775381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.775394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:27.775410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:27.775640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:27.775643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:27.775656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:27.778810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7140e29b-3deaaaf3-81c29c15-984766b9_0] Write session: try to update token
2025-09-30T14:50:27.778826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7140e29b-3deaaaf3-81c29c15-984766b9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:27.775825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 56 partition: 0 MaxSeqNo: 42 sessionId: src_id|7140e29b-3deaaaf3-81c29c15-984766b9_0
2025-09-30T14:50:27.797083Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:27.797102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:27.797105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:27.797107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:27.797119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894704581923625:2678]
2025-09-30T14:50:27.797124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894704581923625:2678]
2025-09-30T14:50:27.797128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894704581923625:2678]
2025-09-30T14:50:27.797170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:27.797177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.797178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:27.797180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:27.797185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:27.797190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:27.797317Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:27.804882Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 56 sessionId: src_id|7140e29b-3deaaaf3-81c29c15-984766b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:27.808138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:27.850864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894704671646330:2517]
2025-09-30T14:50:27.851413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 55, pipe: [1:7555894704671646330:2517]
2025-09-30T14:50:27.915290Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:27.915634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:27.915648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:27.915668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894704671646330:2517], now have 1 active actors on pipe
2025-09-30T14:50:27.915930Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:27.915939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894704671646330:2517]
2025-09-30T14:50:27.915975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:27.915978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:27.915987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:27.916051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 56 reason: error at write: Disconnected sessionId: src_id|7140e29b-3deaaaf3-81c29c15-984766b9_0
2025-09-30T14:50:27.916230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 56 sessionId: src_id|7140e29b-3deaaaf3-81c29c15-984766b9_0 is DEAD
2025-09-30T14:50:27.916356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7140e29b-3deaaaf3-81c29c15-984766b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:27.916371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7140e29b-3deaaaf3-81c29c15-984766b9_0] Write session will restart in 0.005494s
2025-09-30T14:50:27.916393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7140e29b-3deaaaf3-81c29c15-984766b9_0] Write session: Do CDS request
2025-09-30T14:50:27.916402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7140e29b-3deaaaf3-81c29c15-984766b9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:27.922805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7140e29b-3deaaaf3-81c29c15-984766b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:27.922976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:27.922990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 57
2025-09-30T14:50:27.923164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 57 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:27.923199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 57 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:27.923210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=57 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:27.923215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:27.923737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 57 sessionId:  describe result for acl check
2025-09-30T14:50:27.923780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:27.923785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:27.923787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:27.923793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894704671646351:2839] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:27.924397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894704671646351:2839] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:27.927134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894704671646351:2839] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:27.927788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:27.928471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:27.928672Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:27.928681Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:27.928691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:27.928738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:27.928778Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894704581923742:2680]
2025-09-30T14:50:27.929460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:27.929805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:27.929853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:27.930048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894704671646351:2839] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:27.930069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894704671646351:2839] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:27.930072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894704671646351:2839] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:27.930082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 57 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:27.930193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:27.930264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:27.930271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:27.930272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:27.930273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:27.930274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:27.930275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:27.930277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:27.930278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:27.930280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:27.930281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:27.930282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.930284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.930285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.930286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:27.930287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:27.930293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:27.930303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:27.930308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:27.930312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:27.930316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:27.930320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:27.930324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:27.930328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:27.930332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:27.930337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:27.930341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.930345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.930349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.930354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:27.930358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:27.930365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:27.930374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:27.930380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:27.930385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:27.930390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:27.930395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:27.930399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:27.930404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:27.930408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:27.930413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:27.930417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:27.930421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:27.930426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:27.930431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:27.930435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:27.930439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:27.930443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:27.930448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:27.930452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:27.930460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:27.930465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.930469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.930474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.930478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.930483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.930488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.930492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:27.930497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:27.930501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:27.930506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:27.930548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:27.937597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:27.938519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:27.938536Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:27.938539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:27.938543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:27.938550Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 56 [2:7555894704581923742:2680]
2025-09-30T14:50:27.938569Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:27.938586Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:27.938596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.938599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.938602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.938619Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:27.938631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:27.938639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:27.938701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.938709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.938722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.938726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:27.938729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:27.938804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:27.938812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.938826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:27.938839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:27.938861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:27.938883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894704581923736:2680]
2025-09-30T14:50:27.938890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894704581923736:2680]
2025-09-30T14:50:27.938893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894704581923736:2680]
2025-09-30T14:50:27.938910Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:27.938932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:27.938948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:27.938953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:27.938971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:27.938981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:27.938986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:27.938989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894704581923736:2680]
2025-09-30T14:50:27.938992Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:27.938993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:27.939197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894704671646332:2454], now have 1 active actors on pipe
2025-09-30T14:50:27.939207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894704671646441:2839], now have 1 active actors on pipe
2025-09-30T14:50:27.939327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 56
2025-09-30T14:50:27.939353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 56
2025-09-30T14:50:27.939413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:27.939427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:27.939457Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|506c8d0a-67dbb5f9-5b94b914-a3a1bc30_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:27.939470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.939479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.939481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:27.939494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.939512Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:27.939533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:27.939924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:27.939934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:27.939953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:27.940104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 57 partition: 0 MaxSeqNo: 42 sessionId: src_id|506c8d0a-67dbb5f9-5b94b914-a3a1bc30_0
2025-09-30T14:50:27.940574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7140e29b-3deaaaf3-81c29c15-984766b9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|506c8d0a-67dbb5f9-5b94b914-a3a1bc30_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:27.943979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|506c8d0a-67dbb5f9-5b94b914-a3a1bc30_0] Write session: try to update token
2025-09-30T14:50:27.944001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|506c8d0a-67dbb5f9-5b94b914-a3a1bc30_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:27.953536Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:27.953553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:27.953556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:27.953559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:27.953569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894704581923736:2680]
2025-09-30T14:50:27.953575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894704581923736:2680]
2025-09-30T14:50:27.953584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894704581923736:2680]
2025-09-30T14:50:27.953628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:27.953630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:27.953638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:27.953639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:27.953642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:27.953643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:27.953798Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:27.968033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 57 sessionId: src_id|506c8d0a-67dbb5f9-5b94b914-a3a1bc30_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:27.971008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:28.016317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894708966613763:2517]
2025-09-30T14:50:28.016624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 56, pipe: [1:7555894708966613763:2517]
2025-09-30T14:50:28.071081Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:28.071456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:28.071471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:28.071491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894708966613763:2517], now have 1 active actors on pipe
2025-09-30T14:50:28.071679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:28.071685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:28.071689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:28.071744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894708966613763:2517]
2025-09-30T14:50:28.071749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 57 reason: error at write: Disconnected sessionId: src_id|506c8d0a-67dbb5f9-5b94b914-a3a1bc30_0
2025-09-30T14:50:28.071940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 57 sessionId: src_id|506c8d0a-67dbb5f9-5b94b914-a3a1bc30_0 is DEAD
2025-09-30T14:50:28.071708Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:28.072175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|506c8d0a-67dbb5f9-5b94b914-a3a1bc30_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:28.072202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|506c8d0a-67dbb5f9-5b94b914-a3a1bc30_0] Write session will restart in 0.006766s
2025-09-30T14:50:28.072236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|506c8d0a-67dbb5f9-5b94b914-a3a1bc30_0] Write session: Do CDS request
2025-09-30T14:50:28.072243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|506c8d0a-67dbb5f9-5b94b914-a3a1bc30_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:28.079956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|506c8d0a-67dbb5f9-5b94b914-a3a1bc30_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:28.080098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:28.080116Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 58
2025-09-30T14:50:28.080246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 58 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:28.080293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 58 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:28.080306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=58 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:28.080311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:28.080948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 58 sessionId:  describe result for acl check
2025-09-30T14:50:28.081018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:28.081030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:28.081033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:28.081041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894708966613824:2847] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:28.081846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894708966613824:2847] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:28.083008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:28.083913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:28.084130Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:28.084140Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:28.084153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:28.084212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:28.084257Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894708876891152:2683]
2025-09-30T14:50:28.084350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894708966613824:2847] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:28.085025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:28.085360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:28.085408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:28.085764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:28.085842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:28.085849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:28.085850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:28.085851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:28.085853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:28.085854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:28.085856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:28.085857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:28.085858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:28.085860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:28.085861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.085863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.085864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.085865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:28.085866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:28.085872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:28.085883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:28.085887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:28.085891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:28.085895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:28.085899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:28.085903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:28.085907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:28.085911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:28.085915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:28.085919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.085924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.085928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.085932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:28.085937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:28.085946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:28.085956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:28.085963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:28.085970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:28.085976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:28.085981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:28.085987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:28.085992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:28.086003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:28.086009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:28.086018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:28.086023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:28.086028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:28.086038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:28.086042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:28.086046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:28.086053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:28.086062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:28.086068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:28.086079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:28.086084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.086094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.086100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.086105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.086115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.086121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.086132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:28.086138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:28.086148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:28.086153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:28.086203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:28.091888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894708966613824:2847] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:28.091907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894708966613824:2847] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:28.091911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894708966613824:2847] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:28.091921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 58 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:28.092195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:28.093195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:28.093255Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:28.093263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:28.093267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:28.093275Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 57 [2:7555894708876891152:2683]
2025-09-30T14:50:28.093294Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:28.093316Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:28.093324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.093327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.093330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.093347Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:28.093359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:28.093371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:28.093436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.093444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.093446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.093450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:28.093453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:28.093527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:28.093538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.093553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.093567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.093588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:28.093612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894708966613876:2847], now have 1 active actors on pipe
2025-09-30T14:50:28.093621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894708966613765:2454], now have 1 active actors on pipe
2025-09-30T14:50:28.093627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894708876891146:2683]
2025-09-30T14:50:28.093630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894708876891146:2683]
2025-09-30T14:50:28.093633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894708876891146:2683]
2025-09-30T14:50:28.093648Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:28.093665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:28.093669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:28.093640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 57
2025-09-30T14:50:28.093662Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 57
2025-09-30T14:50:28.093674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:28.093676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:28.093680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:28.093683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:28.093735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:28.093745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:28.093765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894708876891146:2683]
2025-09-30T14:50:28.093779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:28.093796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:28.093812Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83782dff-3ed60cd9-cdab5eb8-25879e8a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:28.093818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.093822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.093825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:28.093835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.093844Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:28.093873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:28.094067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:28.094079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:28.094095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:28.094208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 58 partition: 0 MaxSeqNo: 42 sessionId: src_id|83782dff-3ed60cd9-cdab5eb8-25879e8a_0
2025-09-30T14:50:28.094647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|506c8d0a-67dbb5f9-5b94b914-a3a1bc30_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|83782dff-3ed60cd9-cdab5eb8-25879e8a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:28.098140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83782dff-3ed60cd9-cdab5eb8-25879e8a_0] Write session: try to update token
2025-09-30T14:50:28.098161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83782dff-3ed60cd9-cdab5eb8-25879e8a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:28.106135Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:28.106152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:28.106155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:28.106157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:28.106167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894708876891146:2683]
2025-09-30T14:50:28.106172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894708876891146:2683]
2025-09-30T14:50:28.106176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894708876891146:2683]
2025-09-30T14:50:28.106221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:28.106231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.106229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:28.106236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:28.106237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:28.106256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:28.106378Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:28.116798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 58 sessionId: src_id|83782dff-3ed60cd9-cdab5eb8-25879e8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:28.119893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:28.171943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894708966613884:2517]
2025-09-30T14:50:28.172330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 57, pipe: [1:7555894708966613884:2517]
2025-09-30T14:50:28.221033Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:28.221406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:28.221428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:28.221448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894708966613884:2517], now have 1 active actors on pipe
2025-09-30T14:50:28.221702Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:28.222395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83782dff-3ed60cd9-cdab5eb8-25879e8a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:28.222413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83782dff-3ed60cd9-cdab5eb8-25879e8a_0] Write session will restart in 0.008673s
2025-09-30T14:50:28.222444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83782dff-3ed60cd9-cdab5eb8-25879e8a_0] Write session: Do CDS request
2025-09-30T14:50:28.222452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83782dff-3ed60cd9-cdab5eb8-25879e8a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:28.221851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:28.221878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894708966613884:2517]
2025-09-30T14:50:28.221899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:28.221998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 58 reason: status is not ok: tablet will be restarted right now sessionId: src_id|83782dff-3ed60cd9-cdab5eb8-25879e8a_0
2025-09-30T14:50:28.222189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 58 sessionId: src_id|83782dff-3ed60cd9-cdab5eb8-25879e8a_0 is DEAD
2025-09-30T14:50:28.232919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83782dff-3ed60cd9-cdab5eb8-25879e8a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:28.233071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:28.233087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 59
2025-09-30T14:50:28.233322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 59 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:28.233373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 59 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:28.233384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=59 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:28.233389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:28.233969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 59 sessionId:  describe result for acl check
2025-09-30T14:50:28.234008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:28.234016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:28.234018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:28.234024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894708966613900:2851] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:28.234553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894708966613900:2851] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:28.237176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894708966613900:2851] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:28.240731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894708966613900:2851] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:28.240746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894708966613900:2851] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:28.240750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894708966613900:2851] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:28.240759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 59 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:28.244070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:28.244859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:28.245076Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:28.245087Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:28.245098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:28.245158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:28.245204Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894708876891266:2685]
2025-09-30T14:50:28.245908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:28.246356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:28.246422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:28.246825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:28.246907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:28.246913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:28.246915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:28.246916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:28.246918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:28.246919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:28.246921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:28.246922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:28.246924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:28.246925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:28.246926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.246928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.246929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.246930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:28.246932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:28.246938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:28.246948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:28.246952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:28.246957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:28.246961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:28.246966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:28.246970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:28.246974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:28.246978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:28.246982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:28.246986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.246990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.246994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.246997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:28.247001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:28.247011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:28.247019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:28.247026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:28.247032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:28.247037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:28.247043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:28.247048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:28.247053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:28.247058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:28.247066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:28.247071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:28.247077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:28.247083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:28.247089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:28.247093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:28.247098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:28.247104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:28.247110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:28.247114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:28.247119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:28.247124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.247137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.247143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.247148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.247153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.247159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.247163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:28.247169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:28.247174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:28.247180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:28.247258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:28.253341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:28.254366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:28.254385Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:28.254388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:28.254392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:28.254400Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 58 [2:7555894708876891266:2685]
2025-09-30T14:50:28.254420Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:28.254438Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:28.254446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.254450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.254453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.254470Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:28.254486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:28.254493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:28.254565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.254574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.254577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.254581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:28.254584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:28.254662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:28.254670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.254686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.254703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.254735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:28.254752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894708876891260:2685]
2025-09-30T14:50:28.254761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894708876891260:2685]
2025-09-30T14:50:28.254763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894708876891260:2685]
2025-09-30T14:50:28.254780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:28.254796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:28.254811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:28.254814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:28.254845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:28.254849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:28.254852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:28.254853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894708876891260:2685]
2025-09-30T14:50:28.254856Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:28.254859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:28.255021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894708966613886:2454], now have 1 active actors on pipe
2025-09-30T14:50:28.255037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894708966613992:2851], now have 1 active actors on pipe
2025-09-30T14:50:28.255091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 58
2025-09-30T14:50:28.255091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 58
2025-09-30T14:50:28.255163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:28.255176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:28.255210Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8fcb0012-9b597ec8-1250e055-52356969_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:28.255220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.255225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.255228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:28.255240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.255273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:28.255292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:28.255497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:28.255503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:28.255523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:28.255664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 59 partition: 0 MaxSeqNo: 42 sessionId: src_id|8fcb0012-9b597ec8-1250e055-52356969_0
2025-09-30T14:50:28.256123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83782dff-3ed60cd9-cdab5eb8-25879e8a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8fcb0012-9b597ec8-1250e055-52356969_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:28.259806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fcb0012-9b597ec8-1250e055-52356969_0] Write session: try to update token
2025-09-30T14:50:28.259830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fcb0012-9b597ec8-1250e055-52356969_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:28.271222Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:28.271237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:28.271265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894708876891260:2685]
2025-09-30T14:50:28.271314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:28.271317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:28.271505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:28.271670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:28.271826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:28.271985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:28.272190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:28.272228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:28.283098Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:28.283117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:28.283120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:28.283121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:28.283135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894708876891260:2685]
2025-09-30T14:50:28.283139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894708876891260:2685]
2025-09-30T14:50:28.283142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894708876891260:2685]
2025-09-30T14:50:28.283182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:28.283189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.283192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:28.283194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:28.283201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:28.283206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:28.280217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 59 sessionId: src_id|8fcb0012-9b597ec8-1250e055-52356969_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:28.283356Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:28.283441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:28.321990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894708966614006:2517]
2025-09-30T14:50:28.322264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 58, pipe: [1:7555894708966614006:2517]
2025-09-30T14:50:28.397439Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:28.397844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:28.397862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:28.397898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894708966614006:2517], now have 1 active actors on pipe
2025-09-30T14:50:28.398880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fcb0012-9b597ec8-1250e055-52356969_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:28.398895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fcb0012-9b597ec8-1250e055-52356969_0] Write session will restart in 0.006414s
2025-09-30T14:50:28.398925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fcb0012-9b597ec8-1250e055-52356969_0] Write session: Do CDS request
2025-09-30T14:50:28.398932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fcb0012-9b597ec8-1250e055-52356969_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:28.398161Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:28.398260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894708966614006:2517]
2025-09-30T14:50:28.398306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:28.398350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:28.398353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:28.398410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 59 reason: error at write: Disconnected sessionId: src_id|8fcb0012-9b597ec8-1250e055-52356969_0
2025-09-30T14:50:28.398618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 59 sessionId: src_id|8fcb0012-9b597ec8-1250e055-52356969_0 is DEAD
2025-09-30T14:50:28.406790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fcb0012-9b597ec8-1250e055-52356969_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:28.406850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:28.406871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 60
2025-09-30T14:50:28.407359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 60 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:28.407398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 60 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:28.407416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=60 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:28.407426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:28.407824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 60 sessionId:  describe result for acl check
2025-09-30T14:50:28.407858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:28.407860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:28.407862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:28.407870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894708966614063:2862] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:28.408423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894708966614063:2862] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:28.410845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894708966614063:2862] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:28.412361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:28.412933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:28.413122Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:28.413134Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:28.413143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:28.413195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:28.413237Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894708876891414:2699]
2025-09-30T14:50:28.413697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894708966614063:2862] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:28.413711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894708966614063:2862] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:28.413714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894708966614063:2862] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:28.413741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 60 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:28.413961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:28.414242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:28.414292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:28.414667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:28.414743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:28.414745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:28.414746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:28.414747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:28.414748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:28.414749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:28.414751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:28.414752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:28.414753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:28.414754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:28.414756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.414757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.414758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.414759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:28.414760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:28.414766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:28.414775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:28.414779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:28.414783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:28.414786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:28.414790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:28.414793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:28.414797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:28.414800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:28.414807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:28.414811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.414816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.414819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.414824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:28.414829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:28.414836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:28.414845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:28.414852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:28.414858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:28.414863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:28.414869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:28.414874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:28.414880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:28.414885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:28.414891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:28.414896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:28.414903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:28.414908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:28.414914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:28.414919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:28.414924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:28.414929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:28.414935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:28.414940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:28.414945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:28.414950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.414955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.414959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.414964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.414968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.414973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.414978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:28.414983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:28.414988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:28.414994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:28.415042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:28.420919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:28.421843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:28.421861Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:28.421865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:28.421869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:28.421876Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 59 [2:7555894708876891414:2699]
2025-09-30T14:50:28.421893Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:28.421909Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:28.421913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.421916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.421919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.421936Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:28.421948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:28.421955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:28.422025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.422033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.422036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.422039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:28.422042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:28.422114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:28.422123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.422135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.422148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.422168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:28.422192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894708966614140:2862], now have 1 active actors on pipe
2025-09-30T14:50:28.422201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894708966614033:2454], now have 1 active actors on pipe
2025-09-30T14:50:28.422207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894708876891409:2699]
2025-09-30T14:50:28.422213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894708876891409:2699]
2025-09-30T14:50:28.422216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894708876891409:2699]
2025-09-30T14:50:28.422232Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:28.422251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:28.422260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:28.422264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:28.422273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:28.422273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:28.422278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:28.422289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 59
2025-09-30T14:50:28.422291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 59
2025-09-30T14:50:28.422314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894708876891409:2699]
2025-09-30T14:50:28.422325Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:28.422332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:28.422363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:28.422374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:28.422409Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3518d73-56177a08-e9254e9-e6e9f4b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:28.422423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.422428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.422430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:28.422441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.422451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:28.422465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:28.422618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:28.422625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:28.422638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:28.422770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 60 partition: 0 MaxSeqNo: 42 sessionId: src_id|3518d73-56177a08-e9254e9-e6e9f4b2_0
2025-09-30T14:50:28.423177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fcb0012-9b597ec8-1250e055-52356969_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3518d73-56177a08-e9254e9-e6e9f4b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:28.426320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3518d73-56177a08-e9254e9-e6e9f4b2_0] Write session: try to update token
2025-09-30T14:50:28.426340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3518d73-56177a08-e9254e9-e6e9f4b2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:28.435287Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:28.435304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:28.435307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:28.435308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:28.435322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894708876891409:2699]
2025-09-30T14:50:28.435327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894708876891409:2699]
2025-09-30T14:50:28.435331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894708876891409:2699]
2025-09-30T14:50:28.435373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:28.435382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.435384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:28.435389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:28.435395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:28.435400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:28.435534Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:28.447853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 60 sessionId: src_id|3518d73-56177a08-e9254e9-e6e9f4b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:28.450704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:28.498667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894708966614153:2517]
2025-09-30T14:50:28.498969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 59, pipe: [1:7555894708966614153:2517]
2025-09-30T14:50:28.586154Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:28.586675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:28.586691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:28.586727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894708966614153:2517], now have 1 active actors on pipe
2025-09-30T14:50:28.587027Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:28.587025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:28.587042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:28.587113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 60 reason: error at write: Disconnected sessionId: src_id|3518d73-56177a08-e9254e9-e6e9f4b2_0
2025-09-30T14:50:28.587303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:28.587321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 60 sessionId: src_id|3518d73-56177a08-e9254e9-e6e9f4b2_0 is DEAD
2025-09-30T14:50:28.587355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894708966614153:2517]
2025-09-30T14:50:28.587723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3518d73-56177a08-e9254e9-e6e9f4b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:28.587734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3518d73-56177a08-e9254e9-e6e9f4b2_0] Write session will restart in 0.006784s
2025-09-30T14:50:28.587756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3518d73-56177a08-e9254e9-e6e9f4b2_0] Write session: Do CDS request
2025-09-30T14:50:28.587766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3518d73-56177a08-e9254e9-e6e9f4b2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:28.595779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3518d73-56177a08-e9254e9-e6e9f4b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:28.598105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:28.598629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:28.598827Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:28.598836Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:28.598846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:28.598892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:28.598943Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894708876891530:2702]
2025-09-30T14:50:28.599700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:28.600035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:28.600079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:28.600448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:28.600509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:28.600510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:28.600512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:28.600513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:28.600514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:28.600515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:28.600516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:28.600518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:28.600519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:28.600520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:28.600521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.600523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.600524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.600525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:28.600527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:28.600532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:28.600542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:28.600545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:28.600550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:28.600555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:28.600560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:28.600565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:28.600569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:28.600574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:28.600579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:28.600583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.600586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.600590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.600594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:28.600597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:28.600604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:28.600611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:28.600618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:28.600624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:28.600629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:28.600635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:28.600639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:28.600645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:28.600651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:28.600657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:28.600661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:28.600667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:28.600673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:28.600679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:28.600683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:28.600689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:28.600694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:28.600702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:28.600706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:28.600712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:28.600717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.600722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.600726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.600731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.600736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.600740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.600744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:28.600749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:28.600753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:28.600758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:28.600807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:28.599391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:28.599416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 61
2025-09-30T14:50:28.599595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 61 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:28.599624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 61 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:28.599630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=61 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:28.599635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:28.600119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 61 sessionId:  describe result for acl check
2025-09-30T14:50:28.600161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:28.600164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:28.600166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:28.600171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894708966614235:2867] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:28.600725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894708966614235:2867] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:28.603054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894708966614235:2867] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:28.607227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:28.605992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894708966614235:2867] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:28.606008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894708966614235:2867] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:28.606011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894708966614235:2867] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:28.606019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 61 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:28.608149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:28.608166Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:28.608169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:28.608173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:28.608180Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 60 [2:7555894708876891530:2702]
2025-09-30T14:50:28.608196Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:28.608211Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:28.608214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.608217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.608219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.608236Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:28.608244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:28.608250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:28.608312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.608321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.608322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.608324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:28.608326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:28.608383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:28.608389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.608398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.608408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.608418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:28.608436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894708876891524:2702]
2025-09-30T14:50:28.608441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894708876891524:2702]
2025-09-30T14:50:28.608444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894708876891524:2702]
2025-09-30T14:50:28.608456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:28.608471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:28.608474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894708966614271:2867], now have 1 active actors on pipe
2025-09-30T14:50:28.608479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894708966614156:2454], now have 1 active actors on pipe
2025-09-30T14:50:28.608482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:28.608484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:28.608489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:28.608499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:28.608501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:28.608528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894708876891524:2702]
2025-09-30T14:50:28.608534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:28.608553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:28.608573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 60
2025-09-30T14:50:28.608594Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 60
2025-09-30T14:50:28.608716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:28.608725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:28.608746Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3c97a00-f49b2c17-685735d6-d73f0505_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:28.608751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.608755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.608757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:28.608763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.608771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:28.608781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:28.608934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:28.608942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:28.608956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:28.609046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 61 partition: 0 MaxSeqNo: 42 sessionId: src_id|b3c97a00-f49b2c17-685735d6-d73f0505_0
2025-09-30T14:50:28.609381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3518d73-56177a08-e9254e9-e6e9f4b2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b3c97a00-f49b2c17-685735d6-d73f0505_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:28.612223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3c97a00-f49b2c17-685735d6-d73f0505_0] Write session: try to update token
2025-09-30T14:50:28.612243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3c97a00-f49b2c17-685735d6-d73f0505_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:28.621662Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:28.621680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:28.621683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:28.621685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:28.621694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894708876891524:2702]
2025-09-30T14:50:28.621699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894708876891524:2702]
2025-09-30T14:50:28.621704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894708876891524:2702]
2025-09-30T14:50:28.621743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:28.621748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:28.621750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.621754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:28.621753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:28.621758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:28.621897Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:28.632497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 61 sessionId: src_id|b3c97a00-f49b2c17-685735d6-d73f0505_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:28.635209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:28.687048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894708966614290:2517]
2025-09-30T14:50:28.687407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 60, pipe: [1:7555894708966614290:2517]
2025-09-30T14:50:28.743472Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:28.743832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:28.743849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:28.743869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894708966614290:2517], now have 1 active actors on pipe
2025-09-30T14:50:28.744105Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:28.744129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894708966614290:2517]
2025-09-30T14:50:28.744147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:28.744166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:28.744169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:28.744246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 61 reason: error at write: Disconnected sessionId: src_id|b3c97a00-f49b2c17-685735d6-d73f0505_0
2025-09-30T14:50:28.744419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 61 sessionId: src_id|b3c97a00-f49b2c17-685735d6-d73f0505_0 is DEAD
2025-09-30T14:50:28.744593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3c97a00-f49b2c17-685735d6-d73f0505_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:28.744616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3c97a00-f49b2c17-685735d6-d73f0505_0] Write session will restart in 0.006564s
2025-09-30T14:50:28.744639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3c97a00-f49b2c17-685735d6-d73f0505_0] Write session: Do CDS request
2025-09-30T14:50:28.744645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3c97a00-f49b2c17-685735d6-d73f0505_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:28.752873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3c97a00-f49b2c17-685735d6-d73f0505_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:28.752935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:28.752953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 62
2025-09-30T14:50:28.753122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 62 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:28.753163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 62 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:28.753176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=62 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:28.753180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:28.753707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 62 sessionId:  describe result for acl check
2025-09-30T14:50:28.753745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:28.753752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:28.753755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:28.753761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894708966614366:2872] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:28.754339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894708966614366:2872] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:28.755337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:28.756306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:28.756548Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:28.756565Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:28.756576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:28.756639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:28.756683Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894708876891657:2705]
2025-09-30T14:50:28.756731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894708966614366:2872] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:28.757392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:28.757811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:28.757861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:28.758225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:28.758286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:28.758292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:28.758293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:28.758294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:28.758296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:28.758298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:28.758299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:28.758301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:28.758302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:28.758303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:28.758305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.758306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.758308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.758309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:28.758310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:28.758316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:28.758327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:28.758332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:28.758337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:28.758341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:28.758346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:28.758351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:28.758355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:28.758360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:28.758365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:28.758369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.758374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.758378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.758383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:28.758387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:28.758395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:28.758403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:28.758415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:28.758421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:28.758426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:28.758432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:28.758441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:28.758447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:28.758457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:28.758463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:28.758473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:28.758478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:28.758489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:28.758497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:28.758506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:28.758512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:28.758521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:28.758527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:28.758535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:28.758541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:28.758548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.758558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.758563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.758570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.758578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.758584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.758592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:28.758597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:28.758602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:28.758607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:28.758659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:28.759853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894708966614366:2872] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:28.759867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894708966614366:2872] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:28.759871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894708966614366:2872] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:28.759880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 62 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:28.764714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:28.765716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:28.765732Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:28.765735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:28.765739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:28.765746Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 61 [2:7555894708876891657:2705]
2025-09-30T14:50:28.765765Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:28.765782Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:28.765790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.765794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.765797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.765814Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:28.765829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:28.765836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:28.765902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.765910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.765912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.765918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:28.765921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:28.765993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:28.766002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.766015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.766029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.766053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:28.766076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894708966614292:2454], now have 1 active actors on pipe
2025-09-30T14:50:28.766085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894708966614408:2872], now have 1 active actors on pipe
2025-09-30T14:50:28.766091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894708876891651:2705]
2025-09-30T14:50:28.766097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894708876891651:2705]
2025-09-30T14:50:28.766100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894708876891651:2705]
2025-09-30T14:50:28.766113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:28.766128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:28.766133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:28.766136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:28.766139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:28.766148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:28.766152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:28.766184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894708876891651:2705]
2025-09-30T14:50:28.766195Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:28.766200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:28.766182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 61
2025-09-30T14:50:28.766184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 61
2025-09-30T14:50:28.766329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:28.766340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:28.766370Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79924c8b-c7487181-b409850a-21fdc34f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:28.766383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.766391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.766393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:28.766403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.766416Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:28.766436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:28.766589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:28.766597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:28.766610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:28.766757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 62 partition: 0 MaxSeqNo: 42 sessionId: src_id|79924c8b-c7487181-b409850a-21fdc34f_0
2025-09-30T14:50:28.767345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3c97a00-f49b2c17-685735d6-d73f0505_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|79924c8b-c7487181-b409850a-21fdc34f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:28.770381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79924c8b-c7487181-b409850a-21fdc34f_0] Write session: try to update token
2025-09-30T14:50:28.770405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79924c8b-c7487181-b409850a-21fdc34f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:28.778995Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:28.779018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:28.779021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:28.779023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:28.779034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894708876891651:2705]
2025-09-30T14:50:28.779040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894708876891651:2705]
2025-09-30T14:50:28.779044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894708876891651:2705]
2025-09-30T14:50:28.779089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:28.779097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.779100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:28.779107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:28.779115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:28.779120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:28.779291Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:28.786234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 62 sessionId: src_id|79924c8b-c7487181-b409850a-21fdc34f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:28.789192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:28.844247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894708966614415:2517]
2025-09-30T14:50:28.844574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 61, pipe: [1:7555894708966614415:2517]
2025-09-30T14:50:28.895305Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:28.895620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:28.895637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:28.895677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894708966614415:2517], now have 1 active actors on pipe
2025-09-30T14:50:28.895942Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:28.895942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894708966614415:2517]
2025-09-30T14:50:28.895965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:28.895969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:28.895970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:28.896054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 62 reason: error at write: Disconnected sessionId: src_id|79924c8b-c7487181-b409850a-21fdc34f_0
2025-09-30T14:50:28.896282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 62 sessionId: src_id|79924c8b-c7487181-b409850a-21fdc34f_0 is DEAD
2025-09-30T14:50:28.896576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79924c8b-c7487181-b409850a-21fdc34f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:28.896591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79924c8b-c7487181-b409850a-21fdc34f_0] Write session will restart in 0.007509s
2025-09-30T14:50:28.896632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79924c8b-c7487181-b409850a-21fdc34f_0] Write session: Do CDS request
2025-09-30T14:50:28.896643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79924c8b-c7487181-b409850a-21fdc34f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:28.905882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79924c8b-c7487181-b409850a-21fdc34f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:28.905990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:28.906007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 63
2025-09-30T14:50:28.906213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 63 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:28.906256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 63 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:28.906266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=63 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:28.906270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:28.906346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:28.906745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 63 sessionId:  describe result for acl check
2025-09-30T14:50:28.906784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:28.906785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:28.906787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:28.906792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894708966614495:2876] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:28.906956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:28.907142Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:28.907150Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:28.907161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:28.907209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:28.907297Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894708876891772:2707]
2025-09-30T14:50:28.907383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894708966614495:2876] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:28.907982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:28.908326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:28.908388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:28.908773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:28.908839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:28.908846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:28.908848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:28.908849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:28.908850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:28.908851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:28.908853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:28.908855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:28.908856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:28.908857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:28.908858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.908860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.908861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.908862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:28.908864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:28.908870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:28.908881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:28.908885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:28.908890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:28.908895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:28.908899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:28.908903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:28.908907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:28.908911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:28.908917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:28.908921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.908925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.908929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.908934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:28.908939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:28.908947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:28.908955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:28.908962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:28.908969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:28.908974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:28.908981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:28.908985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:28.908992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:28.908997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:28.909003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:28.909008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:28.909014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:28.909019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:28.909025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:28.909030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:28.909035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:28.909042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:28.909047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:28.909052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:28.909058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:28.909065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.909070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.909076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.909081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.909085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.909091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.909095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:28.909101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:28.909106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:28.909112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:28.909165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:28.909520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894708966614495:2876] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:28.914449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894708966614495:2876] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:28.914464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894708966614495:2876] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:28.914468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894708966614495:2876] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:28.914476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 63 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:28.914856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:28.915858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:28.915876Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:28.915879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:28.915882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:28.915889Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 62 [2:7555894708876891772:2707]
2025-09-30T14:50:28.915905Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:28.915920Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:28.915924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.915927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.915930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.915945Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:28.915960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:28.915967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:28.916150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.916158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.916161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.916165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:28.916167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:28.916251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:28.916263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.916275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:28.916286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:28.916302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:28.916322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894708966614534:2876], now have 1 active actors on pipe
2025-09-30T14:50:28.916330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894708966614417:2454], now have 1 active actors on pipe
2025-09-30T14:50:28.916338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894708876891767:2707]
2025-09-30T14:50:28.916340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894708876891767:2707]
2025-09-30T14:50:28.916342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894708876891767:2707]
2025-09-30T14:50:28.916356Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:28.916374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:28.916372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:28.916384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:28.916386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:28.916394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:28.916398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:28.916434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894708876891767:2707]
2025-09-30T14:50:28.916445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:28.916451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:28.916505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 62
2025-09-30T14:50:28.916534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 62
2025-09-30T14:50:28.917132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:28.917146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:28.917172Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c17a865e-866fded8-dc95170b-10b84e31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:28.917186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.917196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.917198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:28.917208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.917220Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:28.917240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:28.917477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:28.917486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:28.917502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:28.917667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 63 partition: 0 MaxSeqNo: 42 sessionId: src_id|c17a865e-866fded8-dc95170b-10b84e31_0
2025-09-30T14:50:28.918102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79924c8b-c7487181-b409850a-21fdc34f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c17a865e-866fded8-dc95170b-10b84e31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:28.921589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c17a865e-866fded8-dc95170b-10b84e31_0] Write session: try to update token
2025-09-30T14:50:28.921612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c17a865e-866fded8-dc95170b-10b84e31_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:28.928920Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:28.928933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:28.928944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894708876891767:2707]
2025-09-30T14:50:28.928989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:28.928997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:28.929177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:28.929334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:28.929480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:28.929627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:28.929827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:28.929873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:28.941312Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:28.941328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:28.941330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:28.941333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:28.941343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894708876891767:2707]
2025-09-30T14:50:28.941348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894708876891767:2707]
2025-09-30T14:50:28.941353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894708876891767:2707]
2025-09-30T14:50:28.941394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:28.941401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:28.941407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:28.941512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:28.941523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:28.941527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:28.941546Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:28.943852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 63 sessionId: src_id|c17a865e-866fded8-dc95170b-10b84e31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:28.947046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:28.996284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894708966614548:2517]
2025-09-30T14:50:28.996629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 62, pipe: [1:7555894708966614548:2517]
2025-09-30T14:50:29.059356Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:29.059890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:29.059907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:29.059926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894708966614548:2517], now have 1 active actors on pipe
2025-09-30T14:50:29.060182Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:29.060788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894708966614548:2517]
2025-09-30T14:50:29.060814Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:29.060817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:29.060822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:29.061021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 63 reason: error at write: Disconnected sessionId: src_id|c17a865e-866fded8-dc95170b-10b84e31_0
2025-09-30T14:50:29.061206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 63 sessionId: src_id|c17a865e-866fded8-dc95170b-10b84e31_0 is DEAD
2025-09-30T14:50:29.061406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c17a865e-866fded8-dc95170b-10b84e31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:29.061416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c17a865e-866fded8-dc95170b-10b84e31_0] Write session will restart in 0.009919s
2025-09-30T14:50:29.061442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c17a865e-866fded8-dc95170b-10b84e31_0] Write session: Do CDS request
2025-09-30T14:50:29.061448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c17a865e-866fded8-dc95170b-10b84e31_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:29.072605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:29.072809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c17a865e-866fded8-dc95170b-10b84e31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:29.072944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:29.072960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 64
2025-09-30T14:50:29.073150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 64 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:29.073195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 64 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:29.073201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=64 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:29.073211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:29.073529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:29.073681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 64 sessionId:  describe result for acl check
2025-09-30T14:50:29.073708Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:29.073717Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:29.073721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:29.073728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:29.073727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:29.073730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:29.073737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894713261581929:2882] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:29.073790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:29.073830Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894713171859188:2710]
2025-09-30T14:50:29.074342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894713261581929:2882] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:29.074529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:29.074843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:29.074888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:29.075214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:29.075288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:29.075295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:29.075296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:29.075298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:29.075299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:29.075300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:29.075302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:29.075303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:29.075304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:29.075305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:29.075306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.075307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.075308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.075309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:29.075310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:29.075316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:29.075324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:29.075328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:29.075332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:29.075336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:29.075340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:29.075344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:29.075348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:29.075352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:29.075357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:29.075360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.075364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.075367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.075371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:29.075375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:29.075383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:29.075391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:29.075397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:29.075402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:29.075406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:29.075412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:29.075416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:29.075421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:29.075425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:29.075430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:29.075435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:29.075440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:29.075444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:29.075449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:29.075453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:29.075458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:29.075463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:29.075468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:29.075472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:29.075476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:29.075480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.075485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.075489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.075493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.075498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.075504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.075514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:29.075519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:29.075524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:29.075535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:29.075582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:29.077005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894713261581929:2882] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:29.080909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894713261581929:2882] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:29.080927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894713261581929:2882] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:29.080931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894713261581929:2882] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:29.080940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 64 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:29.081311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:29.083922Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 63
2025-09-30T14:50:29.083475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:29.083969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 63
2025-09-30T14:50:29.083492Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:29.083495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:29.083499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:29.083506Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 63 [2:7555894713171859188:2710]
2025-09-30T14:50:29.083525Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:29.083540Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:29.083543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.083547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.083549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.083565Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:29.083573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:29.083581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:29.083647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.083650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.083652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.083657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:29.083660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:29.083736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:29.083738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.083753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.083766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.083784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:29.083801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894713171859182:2710]
2025-09-30T14:50:29.083803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894713171859182:2710]
2025-09-30T14:50:29.083806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894713171859182:2710]
2025-09-30T14:50:29.083816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:29.083830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:29.083834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:29.083838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:29.083840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:29.083846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:29.083849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:29.083858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894713261581849:2454], now have 1 active actors on pipe
2025-09-30T14:50:29.083861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894713261581967:2882], now have 1 active actors on pipe
2025-09-30T14:50:29.083899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894713171859182:2710]
2025-09-30T14:50:29.083907Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:29.083915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:29.084071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:29.084080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:29.084116Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f5724c6-54c3f32a-12e144ee-eef3fd4a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:29.084125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.084129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.084132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:29.084142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.084153Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:29.084182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:29.084388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:29.084397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:29.084410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:29.084546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 64 partition: 0 MaxSeqNo: 42 sessionId: src_id|2f5724c6-54c3f32a-12e144ee-eef3fd4a_0
2025-09-30T14:50:29.084904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c17a865e-866fded8-dc95170b-10b84e31_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2f5724c6-54c3f32a-12e144ee-eef3fd4a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:29.093732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5724c6-54c3f32a-12e144ee-eef3fd4a_0] Write session: try to update token
2025-09-30T14:50:29.093755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5724c6-54c3f32a-12e144ee-eef3fd4a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:29.100301Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:29.100321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:29.100334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894713171859182:2710]
2025-09-30T14:50:29.100383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:29.100390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:29.100991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:29.101352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:29.101680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:29.101831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:29.102048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:29.102100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:29.108681Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:29.108696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:29.108699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:29.108701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:29.108711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894713171859182:2710]
2025-09-30T14:50:29.108716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894713171859182:2710]
2025-09-30T14:50:29.108721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894713171859182:2710]
2025-09-30T14:50:29.108761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:29.108769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.108770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:29.108772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:29.108776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:29.108781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:29.109284Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:29.116487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 64 sessionId: src_id|2f5724c6-54c3f32a-12e144ee-eef3fd4a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:29.119560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:29.161176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894713261581974:2517]
2025-09-30T14:50:29.161510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 63, pipe: [1:7555894713261581974:2517]
2025-09-30T14:50:29.227264Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:29.227700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:29.227715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:29.227736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894713261581974:2517], now have 1 active actors on pipe
2025-09-30T14:50:29.227962Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:29.228143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:29.228197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894713261581974:2517]
2025-09-30T14:50:29.228215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:29.228347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 64 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2f5724c6-54c3f32a-12e144ee-eef3fd4a_0
2025-09-30T14:50:29.228535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 64 sessionId: src_id|2f5724c6-54c3f32a-12e144ee-eef3fd4a_0 is DEAD
2025-09-30T14:50:29.228709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5724c6-54c3f32a-12e144ee-eef3fd4a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:29.228722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5724c6-54c3f32a-12e144ee-eef3fd4a_0] Write session will restart in 0.008678s
2025-09-30T14:50:29.228750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5724c6-54c3f32a-12e144ee-eef3fd4a_0] Write session: Do CDS request
2025-09-30T14:50:29.228756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5724c6-54c3f32a-12e144ee-eef3fd4a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:29.238808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5724c6-54c3f32a-12e144ee-eef3fd4a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:29.238908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:29.238924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 65
2025-09-30T14:50:29.239843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 65 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:29.239889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 65 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:29.239899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=65 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:29.239904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:29.240408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 65 sessionId:  describe result for acl check
2025-09-30T14:50:29.240442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:29.240449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:29.240452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:29.240457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894713261582056:2886] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:29.241011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894713261582056:2886] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:29.243106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894713261582056:2886] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:29.243935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:29.246133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:29.246281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894713261582056:2886] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:29.246297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894713261582056:2886] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:29.246300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894713261582056:2886] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:29.246309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 65 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:29.246350Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:29.246360Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:29.246371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:29.246425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:29.246467Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894713171859306:2712]
2025-09-30T14:50:29.247190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:29.247497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:29.247545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:29.247910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:29.247980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:29.247981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:29.247982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:29.247983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:29.247984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:29.247986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:29.247987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:29.247988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:29.247989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:29.247990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:29.247991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.247992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.247994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.247995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:29.247996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:29.248001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:29.248012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:29.248016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:29.248020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:29.248024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:29.248027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:29.248032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:29.248035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:29.248039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:29.248044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:29.248047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.248051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.248055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.248059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:29.248063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:29.248073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:29.248082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:29.248089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:29.248095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:29.248099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:29.248104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:29.248109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:29.248116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:29.248124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:29.248130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:29.248135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:29.248141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:29.248146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:29.248153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:29.248158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:29.248163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:29.248168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:29.248173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:29.248178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:29.248184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:29.248190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.248196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.248201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.248207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.248212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.248218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.248223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:29.248229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:29.248234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:29.248240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:29.248289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:29.255165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:29.256457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:29.256465Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:29.256468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:29.256474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:29.256483Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 64 [2:7555894713171859306:2712]
2025-09-30T14:50:29.256505Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:29.256523Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:29.256527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.256531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.256534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.256552Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:29.256560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:29.256568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:29.256642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.256645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.256647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.256651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:29.256653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:29.256731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:29.256733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.256748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.256759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.256776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:29.256794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894713171859301:2712]
2025-09-30T14:50:29.256796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894713171859301:2712]
2025-09-30T14:50:29.256799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894713171859301:2712]
2025-09-30T14:50:29.256813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:29.256831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:29.256846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:29.256849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:29.256889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894713171859301:2712]
2025-09-30T14:50:29.256892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:29.257610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:29.257616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:29.257619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:29.257625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:29.258132Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 64
2025-09-30T14:50:29.258178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 64
2025-09-30T14:50:29.258498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894713261581976:2454], now have 1 active actors on pipe
2025-09-30T14:50:29.258509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894713261582091:2886], now have 1 active actors on pipe
2025-09-30T14:50:29.258530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:29.258536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:29.258564Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4ba0ddc-1d64eba-f0319581-1d7d8c86_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:29.258584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.258588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.258591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:29.258602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.258615Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:29.258634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:29.259136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:29.259143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:29.259159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:29.259319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 65 partition: 0 MaxSeqNo: 42 sessionId: src_id|f4ba0ddc-1d64eba-f0319581-1d7d8c86_0
2025-09-30T14:50:29.259769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5724c6-54c3f32a-12e144ee-eef3fd4a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f4ba0ddc-1d64eba-f0319581-1d7d8c86_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:29.262580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4ba0ddc-1d64eba-f0319581-1d7d8c86_0] Write session: try to update token
2025-09-30T14:50:29.262597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4ba0ddc-1d64eba-f0319581-1d7d8c86_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:29.284848Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:29.284867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:29.284870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:29.284872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:29.284882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894713171859301:2712]
2025-09-30T14:50:29.284886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894713171859301:2712]
2025-09-30T14:50:29.284891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894713171859301:2712]
2025-09-30T14:50:29.284944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:29.284951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.284953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:29.285098Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:29.285526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:29.285540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:29.285544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:29.297496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 65 sessionId: src_id|f4ba0ddc-1d64eba-f0319581-1d7d8c86_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:29.300561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:29.328542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894713261582102:2517]
2025-09-30T14:50:29.328838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 64, pipe: [1:7555894713261582102:2517]
2025-09-30T14:50:29.426628Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:29.427130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:29.427148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:29.427168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894713261582102:2517], now have 1 active actors on pipe
2025-09-30T14:50:29.427527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:29.427541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894713261582102:2517]
2025-09-30T14:50:29.427544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:29.427570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:29.427629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 65 reason: error at write: Disconnected sessionId: src_id|f4ba0ddc-1d64eba-f0319581-1d7d8c86_0
2025-09-30T14:50:29.427644Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:29.427815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 65 sessionId: src_id|f4ba0ddc-1d64eba-f0319581-1d7d8c86_0 is DEAD
2025-09-30T14:50:29.428069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4ba0ddc-1d64eba-f0319581-1d7d8c86_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:29.428080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4ba0ddc-1d64eba-f0319581-1d7d8c86_0] Write session will restart in 0.009208s
2025-09-30T14:50:29.428104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4ba0ddc-1d64eba-f0319581-1d7d8c86_0] Write session: Do CDS request
2025-09-30T14:50:29.428114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4ba0ddc-1d64eba-f0319581-1d7d8c86_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:29.439714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4ba0ddc-1d64eba-f0319581-1d7d8c86_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:29.439604Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:29.439620Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 66
2025-09-30T14:50:29.439966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 66 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:29.440004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 66 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:29.440010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=66 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:29.440015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:29.440562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 66 sessionId:  describe result for acl check
2025-09-30T14:50:29.440601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:29.440608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:29.440611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:29.440618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894713261582212:2898] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:29.441031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:29.441248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894713261582212:2898] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:29.442126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:29.442347Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:29.442358Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:29.442370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:29.442452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:29.442503Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894713171859464:2727]
2025-09-30T14:50:29.443233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:29.443677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:29.443744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:29.444148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:29.444225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:29.444232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:29.444234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:29.444235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:29.444236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:29.444238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:29.444239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:29.444240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:29.444241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:29.444242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:29.444245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.444246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.444247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.444249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:29.444250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:29.444257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:29.444268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:29.444272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:29.444277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:29.444282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:29.444287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:29.444291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:29.444296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:29.444301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:29.444306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:29.444311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.444315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.444320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.444325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:29.444328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:29.444337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:29.444345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:29.444352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:29.444357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:29.444362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:29.444368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:29.444373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:29.444378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:29.444384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:29.444392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:29.444397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:29.444403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:29.444408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:29.444413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:29.444417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:29.444422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:29.444427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:29.444432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:29.444436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:29.444442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:29.444447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.444452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.444457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.444461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.444466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.444472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.444476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:29.444481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:29.444486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:29.444491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:29.444550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:29.444535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894713261582212:2898] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:29.449968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894713261582212:2898] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:29.449984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894713261582212:2898] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:29.449988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894713261582212:2898] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:29.449996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 66 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:29.450381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:29.451720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:29.451739Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:29.451742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:29.451746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:29.451754Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 65 [2:7555894713171859464:2727]
2025-09-30T14:50:29.451773Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:29.451791Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:29.451794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.451797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.451799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.451816Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:29.451829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:29.451837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:29.451905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.451913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.451915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.451918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:29.451921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:29.451987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:29.451994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.452008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.452024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.452045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:29.452068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894713261582248:2898], now have 1 active actors on pipe
2025-09-30T14:50:29.452075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894713261582131:2454], now have 1 active actors on pipe
2025-09-30T14:50:29.452082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894713171859459:2727]
2025-09-30T14:50:29.452087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894713171859459:2727]
2025-09-30T14:50:29.452089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894713171859459:2727]
2025-09-30T14:50:29.452103Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:29.452120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:29.452120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:29.452125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:29.452127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:29.452139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:29.452146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:29.452136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 65
2025-09-30T14:50:29.452144Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 65
2025-09-30T14:50:29.452185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894713171859459:2727]
2025-09-30T14:50:29.452192Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:29.452203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:29.452226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:29.452234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:29.452268Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9ae3b4a-8c03c972-47834bd5-bb4bed09_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:29.452279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.452287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.452289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:29.452300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.452313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:29.452341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:29.452504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:29.452512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:29.452528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:29.452597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 66 partition: 0 MaxSeqNo: 42 sessionId: src_id|a9ae3b4a-8c03c972-47834bd5-bb4bed09_0
2025-09-30T14:50:29.452976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4ba0ddc-1d64eba-f0319581-1d7d8c86_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a9ae3b4a-8c03c972-47834bd5-bb4bed09_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:29.455935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9ae3b4a-8c03c972-47834bd5-bb4bed09_0] Write session: try to update token
2025-09-30T14:50:29.455957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9ae3b4a-8c03c972-47834bd5-bb4bed09_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:29.465252Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:29.465276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:29.465279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:29.465281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:29.465292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894713171859459:2727]
2025-09-30T14:50:29.465297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894713171859459:2727]
2025-09-30T14:50:29.465303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894713171859459:2727]
2025-09-30T14:50:29.465348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:29.465357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.465361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:29.465362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:29.465370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:29.465381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:29.465589Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:29.477099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 66 sessionId: src_id|a9ae3b4a-8c03c972-47834bd5-bb4bed09_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:29.480211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:29.531158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894713261582255:2517]
2025-09-30T14:50:29.531617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 65, pipe: [1:7555894713261582255:2517]
2025-09-30T14:50:29.589103Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:29.589603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:29.589614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:29.589636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894713261582255:2517], now have 1 active actors on pipe
2025-09-30T14:50:29.589906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894713261582255:2517]
2025-09-30T14:50:29.589938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:29.589941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:29.590013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 66 reason: error at write: Disconnected sessionId: src_id|a9ae3b4a-8c03c972-47834bd5-bb4bed09_0
2025-09-30T14:50:29.590212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 66 sessionId: src_id|a9ae3b4a-8c03c972-47834bd5-bb4bed09_0 is DEAD
2025-09-30T14:50:29.589914Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:29.590337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9ae3b4a-8c03c972-47834bd5-bb4bed09_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:29.590348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9ae3b4a-8c03c972-47834bd5-bb4bed09_0] Write session will restart in 0.009650s
2025-09-30T14:50:29.590372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9ae3b4a-8c03c972-47834bd5-bb4bed09_0] Write session: Do CDS request
2025-09-30T14:50:29.590378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9ae3b4a-8c03c972-47834bd5-bb4bed09_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:29.590372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:29.600794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9ae3b4a-8c03c972-47834bd5-bb4bed09_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:29.600892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:29.600915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 67
2025-09-30T14:50:29.601037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 67 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:29.601070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 67 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:29.601079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=67 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:29.601085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:29.601551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 67 sessionId:  describe result for acl check
2025-09-30T14:50:29.601591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:29.601597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:29.601599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:29.601605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894713261582290:2902] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:29.602160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894713261582290:2902] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:29.606392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894713261582290:2902] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:29.607824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:29.608738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:29.609149Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:29.609160Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:29.609172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:29.609240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:29.609313Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894713171859585:2729]
2025-09-30T14:50:29.609410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894713261582290:2902] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:29.609439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894713261582290:2902] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:29.609442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894713261582290:2902] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:29.609450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 67 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:29.610003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:29.610444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:29.610514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:29.610933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:29.611010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:29.611018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:29.611019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:29.611020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:29.611021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:29.611023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:29.611025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:29.611026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:29.611027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:29.611028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:29.611030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.611031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.611032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.611033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:29.611034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:29.611041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:29.611051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:29.611055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:29.611059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:29.611064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:29.611069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:29.611073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:29.611078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:29.611082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:29.611088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:29.611092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.611096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.611100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.611104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:29.611109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:29.611117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:29.611126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:29.611148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:29.611155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:29.611161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:29.611166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:29.611177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:29.611183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:29.611190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:29.611196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:29.611202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:29.611208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:29.611215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:29.611220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:29.611225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:29.611230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:29.611236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:29.611255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:29.611266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:29.611271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:29.611276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.611282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.611286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.611291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.611297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.611303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.611308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:29.611313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:29.611318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:29.611324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:29.611375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:29.618579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:29.619698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:29.619716Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:29.619720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:29.619724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:29.619731Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 66 [2:7555894713171859585:2729]
2025-09-30T14:50:29.619749Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:29.619767Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:29.619771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.619774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.619779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.619796Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:29.619804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:29.619811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:29.619878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.619882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.619884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.619887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:29.619890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:29.619966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:29.619969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.619984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.619995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.620012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:29.620028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894713171859580:2729]
2025-09-30T14:50:29.620030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894713171859580:2729]
2025-09-30T14:50:29.620032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894713171859580:2729]
2025-09-30T14:50:29.620046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:29.620061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:29.620075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:29.620078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:29.620120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894713171859580:2729]
2025-09-30T14:50:29.620122Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:29.620356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:29.620362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:29.620364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:29.620369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:29.620738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 66
2025-09-30T14:50:29.620779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 66
2025-09-30T14:50:29.620876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894713261582258:2454], now have 1 active actors on pipe
2025-09-30T14:50:29.620884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894713261582375:2902], now have 1 active actors on pipe
2025-09-30T14:50:29.620903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:29.620908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:29.620935Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4aa4bbd1-d4627f55-68c9f634-912b5665_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:29.620946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.620950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.620953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:29.620965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.620977Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:29.620991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:29.621283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:29.621290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:29.621307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:29.621430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 67 partition: 0 MaxSeqNo: 42 sessionId: src_id|4aa4bbd1-d4627f55-68c9f634-912b5665_0
2025-09-30T14:50:29.621807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9ae3b4a-8c03c972-47834bd5-bb4bed09_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4aa4bbd1-d4627f55-68c9f634-912b5665_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:29.624763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4aa4bbd1-d4627f55-68c9f634-912b5665_0] Write session: try to update token
2025-09-30T14:50:29.624785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4aa4bbd1-d4627f55-68c9f634-912b5665_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:29.633777Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:29.633800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:29.633803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:29.633805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:29.633815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894713171859580:2729]
2025-09-30T14:50:29.633820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894713171859580:2729]
2025-09-30T14:50:29.633824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894713171859580:2729]
2025-09-30T14:50:29.633866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:29.633873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.633876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:29.633881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:29.633890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:29.633894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:29.634020Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:29.643302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 67 sessionId: src_id|4aa4bbd1-d4627f55-68c9f634-912b5665_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:29.646187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:29.690582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894713261582398:2517]
2025-09-30T14:50:29.691112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 66, pipe: [1:7555894713261582398:2517]
2025-09-30T14:50:29.758375Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:29.758943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:29.758962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:29.758982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894713261582398:2517], now have 1 active actors on pipe
2025-09-30T14:50:29.759210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894713261582398:2517]
2025-09-30T14:50:29.759219Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:29.759229Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:29.759258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:29.759261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:29.759327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 67 reason: error at write: Disconnected sessionId: src_id|4aa4bbd1-d4627f55-68c9f634-912b5665_0
2025-09-30T14:50:29.759526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 67 sessionId: src_id|4aa4bbd1-d4627f55-68c9f634-912b5665_0 is DEAD
2025-09-30T14:50:29.759899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4aa4bbd1-d4627f55-68c9f634-912b5665_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:29.759908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4aa4bbd1-d4627f55-68c9f634-912b5665_0] Write session will restart in 0.008501s
2025-09-30T14:50:29.759930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4aa4bbd1-d4627f55-68c9f634-912b5665_0] Write session: Do CDS request
2025-09-30T14:50:29.759939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4aa4bbd1-d4627f55-68c9f634-912b5665_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:29.772376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4aa4bbd1-d4627f55-68c9f634-912b5665_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:29.772517Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:29.772530Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 68
2025-09-30T14:50:29.772758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 68 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:29.772794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 68 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:29.772800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=68 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:29.772804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:29.773345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 68 sessionId:  describe result for acl check
2025-09-30T14:50:29.773387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:29.773399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:29.773401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:29.773407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894713261582482:2907] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:29.774001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894713261582482:2907] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:29.774471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:29.775929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:29.776136Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:29.776150Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:29.776164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:29.776230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:29.776278Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894713171859719:2732]
2025-09-30T14:50:29.776674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894713261582482:2907] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:29.777012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:29.777380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:29.777459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:29.777875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:29.777969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:29.777976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:29.777978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:29.777979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:29.777981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:29.777983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:29.777984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:29.777986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:29.777987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:29.777988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:29.777990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.777991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.777993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.777994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:29.777995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:29.778002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:29.778012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:29.778017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:29.778022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:29.778027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:29.778031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:29.778036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:29.778040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:29.778045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:29.778050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:29.778055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.778059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.778064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.778069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:29.778073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:29.778082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:29.778091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:29.778099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:29.778106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:29.778114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:29.778126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:29.778132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:29.778138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:29.778144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:29.778154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:29.778160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:29.778180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:29.778185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:29.778192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:29.778203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:29.778210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:29.778220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:29.778227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:29.778236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:29.778242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:29.778254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.778265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.778270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.778277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.778283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.778298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.778303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:29.778309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:29.778314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:29.778321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:29.778371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:29.783009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894713261582482:2907] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:29.783027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894713261582482:2907] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:29.783030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894713261582482:2907] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:29.783040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 68 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:29.784944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:29.786426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:29.786445Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:29.786447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:29.786451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:29.786459Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 67 [2:7555894713171859719:2732]
2025-09-30T14:50:29.786485Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:29.786502Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:29.786510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.786513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.786515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.786533Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:29.786544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:29.786551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:29.786624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.786631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.786633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.786637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:29.786640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:29.786720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:29.786727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.786743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.786758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.786778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:29.786801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894713261582522:2907], now have 1 active actors on pipe
2025-09-30T14:50:29.786809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894713261582400:2454], now have 1 active actors on pipe
2025-09-30T14:50:29.786816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894713171859713:2732]
2025-09-30T14:50:29.786818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894713171859713:2732]
2025-09-30T14:50:29.786821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894713171859713:2732]
2025-09-30T14:50:29.786833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:29.786849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:29.786851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:29.786859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:29.786861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:29.786866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:29.786870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:29.786906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894713171859713:2732]
2025-09-30T14:50:29.786916Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:29.786923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:29.786947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 67
2025-09-30T14:50:29.786950Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 67
2025-09-30T14:50:29.787105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:29.787130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:29.787161Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|157c82-48bac1e9-8e66cc8c-c4505848_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:29.787175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.787184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.787186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:29.787197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.787210Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:29.787231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:29.787435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:29.787442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:29.787455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:29.787571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 68 partition: 0 MaxSeqNo: 42 sessionId: src_id|157c82-48bac1e9-8e66cc8c-c4505848_0
2025-09-30T14:50:29.790320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4aa4bbd1-d4627f55-68c9f634-912b5665_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|157c82-48bac1e9-8e66cc8c-c4505848_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:29.793233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|157c82-48bac1e9-8e66cc8c-c4505848_0] Write session: try to update token
2025-09-30T14:50:29.793257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|157c82-48bac1e9-8e66cc8c-c4505848_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:29.802272Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:29.802292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:29.802294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:29.802296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:29.802305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894713171859713:2732]
2025-09-30T14:50:29.802310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894713171859713:2732]
2025-09-30T14:50:29.802313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894713171859713:2732]
2025-09-30T14:50:29.802355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:29.802360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:29.802362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.802365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:29.802368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:29.802373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:29.802564Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:29.819376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 68 sessionId: src_id|157c82-48bac1e9-8e66cc8c-c4505848_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:29.822159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:29.862543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894713261582530:2517]
2025-09-30T14:50:29.867450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 67, pipe: [1:7555894713261582530:2517]
2025-09-30T14:50:29.920275Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:29.920675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:29.920693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:29.920716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894713261582530:2517], now have 1 active actors on pipe
2025-09-30T14:50:29.921008Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:29.921314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894713261582530:2517]
2025-09-30T14:50:29.921335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:29.921345Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:29.921444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 68 reason: status is not ok: tablet will be restarted right now sessionId: src_id|157c82-48bac1e9-8e66cc8c-c4505848_0
2025-09-30T14:50:29.921643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 68 sessionId: src_id|157c82-48bac1e9-8e66cc8c-c4505848_0 is DEAD
2025-09-30T14:50:29.921877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|157c82-48bac1e9-8e66cc8c-c4505848_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:29.921902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|157c82-48bac1e9-8e66cc8c-c4505848_0] Write session will restart in 0.008370s
2025-09-30T14:50:29.921926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|157c82-48bac1e9-8e66cc8c-c4505848_0] Write session: Do CDS request
2025-09-30T14:50:29.921932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|157c82-48bac1e9-8e66cc8c-c4505848_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:29.931792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|157c82-48bac1e9-8e66cc8c-c4505848_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:29.931875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:29.931899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 69
2025-09-30T14:50:29.932065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 69 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:29.932109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 69 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:29.932119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=69 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:29.932124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:29.932653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 69 sessionId:  describe result for acl check
2025-09-30T14:50:29.932693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:29.932695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:29.932697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:29.932703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894713261582544:2911] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:29.933328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894713261582544:2911] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:29.937342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894713261582544:2911] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:29.942802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894713261582544:2911] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:29.942817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894713261582544:2911] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:29.942824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894713261582544:2911] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:29.942835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 69 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:29.947454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:29.948586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:29.948900Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:29.948912Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:29.948926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:29.948992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:29.949043Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894713171859843:2734]
2025-09-30T14:50:29.949808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:29.950166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:29.950220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:29.950584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:29.950655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:29.950657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:29.950658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:29.950659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:29.950661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:29.950663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:29.950664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:29.950666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:29.950668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:29.950670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:29.950671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.950672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.950674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.950675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:29.950676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:29.950681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:29.950691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:29.950695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:29.950700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:29.950717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:29.950721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:29.950726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:29.950730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:29.950733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:29.950737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:29.950741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.950744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.950750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.950754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:29.950758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:29.950767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:29.950774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:29.950780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:29.950786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:29.950795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:29.950800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:29.950807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:29.950811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:29.950819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:29.950824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:29.950827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:29.950832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:29.950836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:29.950840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:29.950843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:29.950848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:29.950852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:29.950857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:29.950861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:29.950866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:29.950870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.950874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.950878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.950884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.950890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.950895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.950900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:29.950905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:29.950912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:29.950917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:29.950956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:29.958098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:29.959076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:29.959084Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:29.959087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:29.959092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:29.959100Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 68 [2:7555894713171859843:2734]
2025-09-30T14:50:29.959121Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:29.959138Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:29.959142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.959145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.959148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.959166Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:29.959173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:29.959180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:29.959262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.959266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.959269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.959276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:29.959279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:29.959366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:29.959369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.959383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:29.959394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:29.959410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:29.959429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894713171859837:2734]
2025-09-30T14:50:29.959431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894713171859837:2734]
2025-09-30T14:50:29.959434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894713171859837:2734]
2025-09-30T14:50:29.959443Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:29.959458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:29.959457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:29.959462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:29.959464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:29.959475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:29.959478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:29.959489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894713261582532:2454], now have 1 active actors on pipe
2025-09-30T14:50:29.959526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894713261582656:2911], now have 1 active actors on pipe
2025-09-30T14:50:29.959529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894713171859837:2734]
2025-09-30T14:50:29.959541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:29.959578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:29.959612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 68
2025-09-30T14:50:29.959658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 68
2025-09-30T14:50:29.959864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:29.959879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:29.959909Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe0a9a6c-88e5fdb0-b5e89448-ada090de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:29.959923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.959934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.959937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:29.959949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.959976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:29.959995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:29.960188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:29.960202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:29.960226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:29.960338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 69 partition: 0 MaxSeqNo: 42 sessionId: src_id|fe0a9a6c-88e5fdb0-b5e89448-ada090de_0
2025-09-30T14:50:29.960808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|157c82-48bac1e9-8e66cc8c-c4505848_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fe0a9a6c-88e5fdb0-b5e89448-ada090de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:29.970966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe0a9a6c-88e5fdb0-b5e89448-ada090de_0] Write session: try to update token
2025-09-30T14:50:29.970995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe0a9a6c-88e5fdb0-b5e89448-ada090de_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:29.975902Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:29.975940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:29.975951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:29.975970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:29.976069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894713171859837:2734]
2025-09-30T14:50:29.976077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894713171859837:2734]
2025-09-30T14:50:29.976083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894713171859837:2734]
2025-09-30T14:50:29.976154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:29.976182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:29.976196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:29.976198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:29.976207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:29.976226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:29.976417Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:29.995594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 69 sessionId: src_id|fe0a9a6c-88e5fdb0-b5e89448-ada090de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:29.998738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:30.021362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894717556549968:2517]
2025-09-30T14:50:30.021925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 68, pipe: [1:7555894717556549968:2517]
2025-09-30T14:50:30.093861Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:30.094934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:30.094966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:30.094987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894717556549968:2517], now have 1 active actors on pipe
2025-09-30T14:50:30.095376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894717556549968:2517]
2025-09-30T14:50:30.095438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:30.095446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:30.095531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 69 reason: error at write: Disconnected sessionId: src_id|fe0a9a6c-88e5fdb0-b5e89448-ada090de_0
2025-09-30T14:50:30.095666Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:30.095724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 69 sessionId: src_id|fe0a9a6c-88e5fdb0-b5e89448-ada090de_0 is DEAD
2025-09-30T14:50:30.095966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe0a9a6c-88e5fdb0-b5e89448-ada090de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:30.095976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe0a9a6c-88e5fdb0-b5e89448-ada090de_0] Write session will restart in 0.006551s
2025-09-30T14:50:30.096014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe0a9a6c-88e5fdb0-b5e89448-ada090de_0] Write session: Do CDS request
2025-09-30T14:50:30.096024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe0a9a6c-88e5fdb0-b5e89448-ada090de_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:30.096120Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:30.103863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe0a9a6c-88e5fdb0-b5e89448-ada090de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:30.103978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:30.103993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 70
2025-09-30T14:50:30.104233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 70 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:30.104278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 70 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:30.104288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=70 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:30.104292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:30.104891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 70 sessionId:  describe result for acl check
2025-09-30T14:50:30.104928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:30.104936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:30.104937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:30.104943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894717556549995:2917] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:30.105629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894717556549995:2917] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:30.108561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894717556549995:2917] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:30.109584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:30.110286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:30.110606Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:30.110615Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:30.110626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:30.110685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:30.110755Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894717466827264:2737]
2025-09-30T14:50:30.111219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894717556549995:2917] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:30.111239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894717556549995:2917] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:30.111287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894717556549995:2917] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:30.111296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 70 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:30.111545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:30.111863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:30.111908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:30.112293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:30.112349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:30.112353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:30.112354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:30.112354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:30.112355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:30.112356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:30.112356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:30.112357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:30.112358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:30.112358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:30.112359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.112360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.112361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.112361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:30.112362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:30.112366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:30.112372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:30.112375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:30.112377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:30.112380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:30.112384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:30.112389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:30.112393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:30.112396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:30.112401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:30.112404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.112408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.112412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.112416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:30.112419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:30.112426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:30.112431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:30.112435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:30.112438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:30.112441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:30.112444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:30.112446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:30.112449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:30.112452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:30.112455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:30.112458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:30.112461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:30.112464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:30.112467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:30.112469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:30.112472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:30.112476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:30.112479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:30.112482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:30.112485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:30.112487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.112490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.112492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.112495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.112498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.112501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.112503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:30.112506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:30.112509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:30.112512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:30.112548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:30.118649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:30.119778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:30.119793Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:30.119797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:30.119801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:30.119809Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 69 [2:7555894717466827264:2737]
2025-09-30T14:50:30.119830Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:30.119850Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:30.119857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.119861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.119863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.119880Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:30.119892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:30.119903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:30.120138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.120148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.120150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.120154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:30.120157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:30.120239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:30.120246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.120262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.120273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.120292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:30.120310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894717466827259:2737]
2025-09-30T14:50:30.120317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894717466827259:2737]
2025-09-30T14:50:30.120319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894717466827259:2737]
2025-09-30T14:50:30.120331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:30.120350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:30.120356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:30.120361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:30.120363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:30.120370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:30.120373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:30.120506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 69
2025-09-30T14:50:30.120518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 69
2025-09-30T14:50:30.120411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894717466827259:2737]
2025-09-30T14:50:30.120420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:30.120430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894717556549970:2454], now have 1 active actors on pipe
2025-09-30T14:50:30.120432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:30.120433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894717556550091:2917], now have 1 active actors on pipe
2025-09-30T14:50:30.120778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:30.120792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:30.120822Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a8c9f4c-f98ff3be-4b45b4d-e6e44d2a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:30.120837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.120842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.120844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:30.120854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.120866Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:30.120885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:30.121157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:30.121170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:30.121193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:30.121750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe0a9a6c-88e5fdb0-b5e89448-ada090de_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2a8c9f4c-f98ff3be-4b45b4d-e6e44d2a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:30.121300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 70 partition: 0 MaxSeqNo: 42 sessionId: src_id|2a8c9f4c-f98ff3be-4b45b4d-e6e44d2a_0
2025-09-30T14:50:30.126560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a8c9f4c-f98ff3be-4b45b4d-e6e44d2a_0] Write session: try to update token
2025-09-30T14:50:30.126583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a8c9f4c-f98ff3be-4b45b4d-e6e44d2a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:30.132619Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:30.132639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:30.132650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894717466827259:2737]
2025-09-30T14:50:30.132700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:30.132726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:30.132964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:30.133116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:30.133275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:30.133451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:30.133741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:30.133788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:30.144685Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:30.144706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:30.144709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:30.144711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:30.144722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894717466827259:2737]
2025-09-30T14:50:30.144727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894717466827259:2737]
2025-09-30T14:50:30.144731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894717466827259:2737]
2025-09-30T14:50:30.144771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:30.144780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.144783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:30.144785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:30.144791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:30.144800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:30.145102Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:30.145407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 70 sessionId: src_id|2a8c9f4c-f98ff3be-4b45b4d-e6e44d2a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:30.148415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:30.195421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894717556550102:2517]
2025-09-30T14:50:30.195871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 69, pipe: [1:7555894717556550102:2517]
2025-09-30T14:50:30.258376Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:30.258762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:30.258778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:30.258798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894717556550102:2517], now have 1 active actors on pipe
2025-09-30T14:50:30.259015Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:30.259047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:30.259116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:30.259210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894717556550102:2517]
2025-09-30T14:50:30.259214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 70 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2a8c9f4c-f98ff3be-4b45b4d-e6e44d2a_0
2025-09-30T14:50:30.259413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 70 sessionId: src_id|2a8c9f4c-f98ff3be-4b45b4d-e6e44d2a_0 is DEAD
2025-09-30T14:50:30.259589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a8c9f4c-f98ff3be-4b45b4d-e6e44d2a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:30.259601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a8c9f4c-f98ff3be-4b45b4d-e6e44d2a_0] Write session will restart in 0.005568s
2025-09-30T14:50:30.259624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a8c9f4c-f98ff3be-4b45b4d-e6e44d2a_0] Write session: Do CDS request
2025-09-30T14:50:30.259630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a8c9f4c-f98ff3be-4b45b4d-e6e44d2a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:30.266863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a8c9f4c-f98ff3be-4b45b4d-e6e44d2a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:30.267013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:30.267132Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 71
2025-09-30T14:50:30.267311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 71 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:30.267354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 71 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:30.267359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=71 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:30.267364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:30.267871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 71 sessionId:  describe result for acl check
2025-09-30T14:50:30.267908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:30.267919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:30.267921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:30.267927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894717556550182:2921] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:30.268491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894717556550182:2921] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:30.269454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:30.270183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:30.270409Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:30.270419Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:30.270431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:30.270489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:30.270528Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894717466827388:2739]
2025-09-30T14:50:30.270544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894717556550182:2921] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:30.271198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:30.271536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:30.271591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:30.271988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:30.272056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:30.272064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:30.272065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:30.272067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:30.272068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:30.272069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:30.272070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:30.272071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:30.272072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:30.272073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:30.272075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.272075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.272077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.272078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:30.272079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:30.272084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:30.272094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:30.272099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:30.272103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:30.272107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:30.272111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:30.272115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:30.272119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:30.272123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:30.272127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:30.272131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.272134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.272138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.272142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:30.272146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:30.272153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:30.272161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:30.272167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:30.272173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:30.272178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:30.272183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:30.272188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:30.272193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:30.272199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:30.272204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:30.272208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:30.272214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:30.272218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:30.272224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:30.272234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:30.272241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:30.272247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:30.272252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:30.272260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:30.272266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:30.272276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.272290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.272298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.272302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.272306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.272312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.272321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:30.272326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:30.272335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:30.272340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:30.272387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:30.277805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894717556550182:2921] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:30.277821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894717556550182:2921] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:30.277830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894717556550182:2921] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:30.277839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 71 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:30.278168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:30.279118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:30.279137Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:30.279140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:30.279143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:30.279149Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 70 [2:7555894717466827388:2739]
2025-09-30T14:50:30.279167Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:30.279181Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:30.279184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.279187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.279189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.279205Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:30.279211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:30.279219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:30.279302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.279310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.279312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.279315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:30.279318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:30.279395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:30.279403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.279416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.279432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.279456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:30.279478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894717556550228:2921], now have 1 active actors on pipe
2025-09-30T14:50:30.279486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894717556550104:2454], now have 1 active actors on pipe
2025-09-30T14:50:30.279493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894717466827383:2739]
2025-09-30T14:50:30.279499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894717466827383:2739]
2025-09-30T14:50:30.279501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894717466827383:2739]
2025-09-30T14:50:30.279517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:30.279531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:30.279535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:30.279539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:30.279509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 70
2025-09-30T14:50:30.279542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:30.279538Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 70
2025-09-30T14:50:30.279548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:30.279552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:30.279582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894717466827383:2739]
2025-09-30T14:50:30.279590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:30.279592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:30.279607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:30.279615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:30.279672Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ada16275-ad19ad8-7a2afa64-8908632e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:30.279683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.279688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.279690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:30.279698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.279710Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:30.279729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:30.279872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:30.279879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:30.279889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:30.279983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 71 partition: 0 MaxSeqNo: 42 sessionId: src_id|ada16275-ad19ad8-7a2afa64-8908632e_0
2025-09-30T14:50:30.280310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a8c9f4c-f98ff3be-4b45b4d-e6e44d2a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ada16275-ad19ad8-7a2afa64-8908632e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:30.283002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ada16275-ad19ad8-7a2afa64-8908632e_0] Write session: try to update token
2025-09-30T14:50:30.283018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ada16275-ad19ad8-7a2afa64-8908632e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:30.292450Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:30.292469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:30.292472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:30.292474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:30.292482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894717466827383:2739]
2025-09-30T14:50:30.292486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894717466827383:2739]
2025-09-30T14:50:30.292489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894717466827383:2739]
2025-09-30T14:50:30.292530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:30.292537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.292541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:30.292556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:30.292570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:30.292574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:30.292686Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:30.298033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 71 sessionId: src_id|ada16275-ad19ad8-7a2afa64-8908632e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:30.301105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:30.359266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894717556550236:2517]
2025-09-30T14:50:30.359591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 70, pipe: [1:7555894717556550236:2517]
2025-09-30T14:50:30.406194Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:30.406521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:30.406534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:30.406575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894717556550236:2517], now have 1 active actors on pipe
2025-09-30T14:50:30.406843Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:30.406968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:30.406971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:30.406981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:30.407031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894717556550236:2517]
2025-09-30T14:50:30.407045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 71 reason: error at write: Disconnected sessionId: src_id|ada16275-ad19ad8-7a2afa64-8908632e_0
2025-09-30T14:50:30.407225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 71 sessionId: src_id|ada16275-ad19ad8-7a2afa64-8908632e_0 is DEAD
2025-09-30T14:50:30.407352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ada16275-ad19ad8-7a2afa64-8908632e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:30.407363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ada16275-ad19ad8-7a2afa64-8908632e_0] Write session will restart in 0.006078s
2025-09-30T14:50:30.407397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ada16275-ad19ad8-7a2afa64-8908632e_0] Write session: Do CDS request
2025-09-30T14:50:30.407402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ada16275-ad19ad8-7a2afa64-8908632e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:30.414831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ada16275-ad19ad8-7a2afa64-8908632e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:30.414929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:30.414942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 72
2025-09-30T14:50:30.415100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 72 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:30.415139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 72 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:30.415148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=72 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:30.415153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:30.415628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 72 sessionId:  describe result for acl check
2025-09-30T14:50:30.415663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:30.415669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:30.415671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:30.415679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894717556550262:2925] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:30.416319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894717556550262:2925] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:30.419893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:30.419961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894717556550262:2925] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:30.420503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:30.420718Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:30.420729Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:30.420741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:30.420797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:30.420865Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894717466827530:2743]
2025-09-30T14:50:30.421485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:30.422051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:30.422110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:30.422526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:30.422597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:30.422603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:30.422604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:30.422605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:30.422606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:30.422607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:30.422608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:30.422609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:30.422610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:30.422611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:30.422613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.422614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.422615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.422616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:30.422617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:30.422623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:30.422632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:30.422636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:30.422640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:30.422644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:30.422648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:30.422652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:30.422656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:30.422660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:30.422665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:30.422669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.422672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.422676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.422680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:30.422684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:30.422690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:30.422699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:30.422725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:30.422730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:30.422735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:30.422741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:30.422745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:30.422750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:30.422755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:30.422761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:30.422765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:30.422769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:30.422774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:30.422779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:30.422783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:30.422788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:30.422793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:30.422798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:30.422806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:30.422816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:30.422820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.422826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.422834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.422840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.422845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.422855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.422861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:30.422881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:30.422910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:30.422915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:30.422955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:30.423034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894717556550262:2925] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:30.423047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894717556550262:2925] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:30.423051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894717556550262:2925] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:30.423059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 72 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:30.432988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:30.433942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:30.433956Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:30.433958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:30.433962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:30.433968Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 71 [2:7555894717466827530:2743]
2025-09-30T14:50:30.433984Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:30.433999Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:30.434007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.434010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.434012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.434027Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:30.434037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:30.434047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:30.434103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.434110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.434111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.434115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:30.434117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:30.434181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:30.434192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.434204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.434215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.434229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:30.434247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894717556550376:2925], now have 1 active actors on pipe
2025-09-30T14:50:30.434258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894717466827525:2743]
2025-09-30T14:50:30.434260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894717466827525:2743]
2025-09-30T14:50:30.434262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894717466827525:2743]
2025-09-30T14:50:30.434279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:30.434292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894717556550238:2454], now have 1 active actors on pipe
2025-09-30T14:50:30.434298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:30.434302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:30.434303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:30.434304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:30.434316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:30.434319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:30.434354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894717466827525:2743]
2025-09-30T14:50:30.434367Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:30.434377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:30.434370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 71
2025-09-30T14:50:30.434405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 71
2025-09-30T14:50:30.434414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:30.434422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:30.434444Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af7b01e3-62a3b346-ed791972-5aa20539_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:30.434454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.434459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.434463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:30.434471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.434482Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:30.434502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:30.434695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:30.434726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:30.434764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:30.434868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 72 partition: 0 MaxSeqNo: 42 sessionId: src_id|af7b01e3-62a3b346-ed791972-5aa20539_0
2025-09-30T14:50:30.435266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ada16275-ad19ad8-7a2afa64-8908632e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|af7b01e3-62a3b346-ed791972-5aa20539_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:30.437990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af7b01e3-62a3b346-ed791972-5aa20539_0] Write session: try to update token
2025-09-30T14:50:30.438007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af7b01e3-62a3b346-ed791972-5aa20539_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:30.454104Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:30.454127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:30.454129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:30.454131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:30.454138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894717466827525:2743]
2025-09-30T14:50:30.454142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894717466827525:2743]
2025-09-30T14:50:30.454147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894717466827525:2743]
2025-09-30T14:50:30.454183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:30.454184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:30.454188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.454190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:30.454191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:30.454194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:30.454365Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:30.454552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 72 sessionId: src_id|af7b01e3-62a3b346-ed791972-5aa20539_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:30.457255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:30.507211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894717556550395:2517]
2025-09-30T14:50:30.507576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 71, pipe: [1:7555894717556550395:2517]
2025-09-30T14:50:30.568430Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:30.568813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:30.568831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:30.568870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894717556550395:2517], now have 1 active actors on pipe
2025-09-30T14:50:30.569188Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:30.569130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:30.569142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:30.569209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 72 reason: error at write: Disconnected sessionId: src_id|af7b01e3-62a3b346-ed791972-5aa20539_0
2025-09-30T14:50:30.569375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 72 sessionId: src_id|af7b01e3-62a3b346-ed791972-5aa20539_0 is DEAD
2025-09-30T14:50:30.569529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:30.569560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894717556550395:2517]
2025-09-30T14:50:30.571432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af7b01e3-62a3b346-ed791972-5aa20539_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:30.571446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af7b01e3-62a3b346-ed791972-5aa20539_0] Write session will restart in 0.005637s
2025-09-30T14:50:30.571470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af7b01e3-62a3b346-ed791972-5aa20539_0] Write session: Do CDS request
2025-09-30T14:50:30.571478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af7b01e3-62a3b346-ed791972-5aa20539_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:30.579713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af7b01e3-62a3b346-ed791972-5aa20539_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:30.580064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:30.580087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 73
2025-09-30T14:50:30.580195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 73 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:30.580227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 73 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:30.580234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=73 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:30.580242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:30.580652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 73 sessionId:  describe result for acl check
2025-09-30T14:50:30.580681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:30.580688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:30.580690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:30.580696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894717556550484:2937] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:30.581225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:30.581219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894717556550484:2937] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:30.582184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:30.582410Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:30.582415Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:30.582426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:30.582478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:30.582510Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894717466827680:2756]
2025-09-30T14:50:30.583117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:30.583428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:30.583925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894717556550484:2937] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:30.583473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:30.583791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:30.583846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:30.583846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:30.583847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:30.583848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:30.583849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:30.583850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:30.583852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:30.583853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:30.583854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:30.583855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:30.583856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.583857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.583858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.583859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:30.583860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:30.583864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:30.583874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:30.583877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:30.583880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:30.583884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:30.583887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:30.583890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:30.583894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:30.583897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:30.583900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:30.583904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.583907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.583910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.583914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:30.583917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:30.583923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:30.583931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:30.583937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:30.583942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:30.583946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:30.583950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:30.583954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:30.583958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:30.583964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:30.583969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:30.583973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:30.583977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:30.583981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:30.583985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:30.583989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:30.583993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:30.583997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:30.584001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:30.584005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:30.584010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:30.584014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.584018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.584022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.584026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.584029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.584034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.584037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:30.584042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:30.584046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:30.584051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:30.584088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:30.591434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894717556550484:2937] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:30.591448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894717556550484:2937] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:30.591452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894717556550484:2937] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:30.591460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 73 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:30.591927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:30.592950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:30.592965Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:30.592967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:30.592973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:30.592980Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 72 [2:7555894717466827680:2756]
2025-09-30T14:50:30.592996Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:30.593012Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:30.593017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.593021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.593023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.593359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 72
2025-09-30T14:50:30.593039Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:30.593046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:30.593052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:30.593111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.593113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.593116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.593121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:30.593123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:30.593207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:30.593210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.593223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.593236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.593254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:30.593272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894717556550397:2454], now have 1 active actors on pipe
2025-09-30T14:50:30.593276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894717556550524:2937], now have 1 active actors on pipe
2025-09-30T14:50:30.593283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894717466827674:2756]
2025-09-30T14:50:30.593285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894717466827674:2756]
2025-09-30T14:50:30.593287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894717466827674:2756]
2025-09-30T14:50:30.593303Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:30.593318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:30.593323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:30.593328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:30.593330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:30.593332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:30.593335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:30.593373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894717466827674:2756]
2025-09-30T14:50:30.593383Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:30.593407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:30.593360Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 72
2025-09-30T14:50:30.593564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:30.593577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:30.593605Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1834460-17f40d5f-926e7af6-c3813d37_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:30.593618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.593626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.593628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:30.593640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.593655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:30.593675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:30.593831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:30.593848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:30.593871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:30.594004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 73 partition: 0 MaxSeqNo: 42 sessionId: src_id|c1834460-17f40d5f-926e7af6-c3813d37_0
2025-09-30T14:50:30.594390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af7b01e3-62a3b346-ed791972-5aa20539_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c1834460-17f40d5f-926e7af6-c3813d37_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:30.597314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1834460-17f40d5f-926e7af6-c3813d37_0] Write session: try to update token
2025-09-30T14:50:30.597333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1834460-17f40d5f-926e7af6-c3813d37_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:30.613509Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:30.613525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:30.613537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894717466827674:2756]
2025-09-30T14:50:30.613585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:30.613769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:30.613931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:30.614071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:30.614206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:30.614401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:30.614435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:30.617251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 73 sessionId: src_id|c1834460-17f40d5f-926e7af6-c3813d37_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:30.617665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:30.620309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:30.620327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:30.620360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:30.620085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:30.620545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:30.635220Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:30.635237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:30.635240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:30.635350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:30.635391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894717466827674:2756]
2025-09-30T14:50:30.635409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894717466827674:2756]
2025-09-30T14:50:30.635413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894717466827674:2756]
2025-09-30T14:50:30.635459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:30.635590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:30.635617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:30.635811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:30.635826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.635828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:30.636021Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:30.670035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894717556550531:2517]
2025-09-30T14:50:30.670407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 72, pipe: [1:7555894717556550531:2517]
2025-09-30T14:50:30.751661Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:30.773313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:30.773340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:30.773502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:30.773562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:30.773621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:30.773690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:30.773740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:30.773749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:30.773821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:30.773889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:30.773958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:30.774020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:30.774064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:30.774070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:30.774142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:30.774213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:30.774282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:30.774348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:30.774890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:30.774893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:30.774958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:30.775021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:30.775084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:30.775157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:30.775205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:30.775208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:30.775415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:30.775505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:30.775616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:30.775689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:30.775823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:30.775832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:30.775899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:30.775964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:30.776029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:30.776096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:30.776144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:30.776151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:30.776219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:30.777928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:30.777931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894717556550531:2517]
2025-09-30T14:50:30.777957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:30.777960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:30.777986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 73 reason: error at write: Disconnected sessionId: src_id|c1834460-17f40d5f-926e7af6-c3813d37_0
2025-09-30T14:50:30.778198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 73 sessionId: src_id|c1834460-17f40d5f-926e7af6-c3813d37_0 is DEAD
2025-09-30T14:50:30.778362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1834460-17f40d5f-926e7af6-c3813d37_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:30.778373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1834460-17f40d5f-926e7af6-c3813d37_0] Write session will restart in 0.005348s
2025-09-30T14:50:30.778412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1834460-17f40d5f-926e7af6-c3813d37_0] Write session: Do CDS request
2025-09-30T14:50:30.778418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1834460-17f40d5f-926e7af6-c3813d37_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:30.776290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:30.776359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:30.776419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:30.776547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:30.776550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:30.776618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:30.776674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:30.776735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:30.776795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:30.776859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:30.776862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:30.776938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:30.776998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:30.777056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:30.777115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:30.777300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:30.777303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:30.777374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:30.777426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:30.777478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:30.777532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:30.777581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:30.777582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:30.777639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894717556550531:2517], now have 1 active actors on pipe
2025-09-30T14:50:30.778190Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:30.784778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1834460-17f40d5f-926e7af6-c3813d37_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:30.784879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:30.784892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 74
2025-09-30T14:50:30.785051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 74 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:30.785100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 74 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:30.785108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=74 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:30.785112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:30.785840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 74 sessionId:  describe result for acl check
2025-09-30T14:50:30.785877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:30.785879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:30.785881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:30.785887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894717556550560:2942] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:30.786458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894717556550560:2942] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:30.788470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894717556550560:2942] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:30.791867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894717556550560:2942] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:30.791884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894717556550560:2942] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:30.791888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894717556550560:2942] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:30.791896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 74 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:30.791801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:30.792609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:30.792833Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:30.792844Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:30.792855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:30.792922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:30.792962Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894717466827821:2759]
2025-09-30T14:50:30.793498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:30.793779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:30.793808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:30.794044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:30.794085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:30.794096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:30.794096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:30.794097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:30.794098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:30.794099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:30.794099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:30.794100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:30.794100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:30.794101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:30.794101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.794102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.794103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.794105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:30.794106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:30.794110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:30.794120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:30.794124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:30.794128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:30.794131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:30.794135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:30.794138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:30.794142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:30.794145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:30.794150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:30.794153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.794156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.794160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.794164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:30.794167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:30.794173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:30.794180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:30.794184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:30.794189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:30.794194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:30.794199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:30.794203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:30.794207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:30.794211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:30.794216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:30.794219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:30.794224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:30.794228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:30.794233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:30.794237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:30.794241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:30.794246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:30.794250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:30.794253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:30.794257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:30.794260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.794265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.794268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.794272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.794276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.794280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.794283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:30.794289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:30.794293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:30.794297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:30.794333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:30.802891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:30.803832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:30.803847Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:30.803849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:30.803853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:30.803859Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 73 [2:7555894717466827821:2759]
2025-09-30T14:50:30.803880Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:30.803904Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:30.803910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.803912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.803914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.803926Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:30.803931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:30.803938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:30.803998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.804004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.804005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.804008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:30.804011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:30.804074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:30.804086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.804099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.804111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.804122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:30.804136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894717556550670:2942], now have 1 active actors on pipe
2025-09-30T14:50:30.804141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894717466827815:2759]
2025-09-30T14:50:30.804144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894717466827815:2759]
2025-09-30T14:50:30.804146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894717466827815:2759]
2025-09-30T14:50:30.804155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:30.804167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894717556550546:2454], now have 1 active actors on pipe
2025-09-30T14:50:30.804177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:30.804178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:30.804182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:30.804185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:30.804192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:30.804195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:30.804232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894717466827815:2759]
2025-09-30T14:50:30.804244Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:30.804267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:30.804249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 73
2025-09-30T14:50:30.804266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 73
2025-09-30T14:50:30.804292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:30.804301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:30.804329Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad2c6b2e-ff0b1197-dafc86fa-5e195f94_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:30.804340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.804343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.804345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:30.804354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.804368Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:30.804387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:30.804688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:30.804701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:30.804724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:30.804844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 74 partition: 0 MaxSeqNo: 42 sessionId: src_id|ad2c6b2e-ff0b1197-dafc86fa-5e195f94_0
2025-09-30T14:50:30.805264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1834460-17f40d5f-926e7af6-c3813d37_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ad2c6b2e-ff0b1197-dafc86fa-5e195f94_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:30.812080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad2c6b2e-ff0b1197-dafc86fa-5e195f94_0] Write session: try to update token
2025-09-30T14:50:30.812104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad2c6b2e-ff0b1197-dafc86fa-5e195f94_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:30.820332Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:30.820347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:30.820358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894717466827815:2759]
2025-09-30T14:50:30.820405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:30.820405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:30.820601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:30.820802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:30.820963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:30.821124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:30.821390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:30.821440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:30.828885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 74 sessionId: src_id|ad2c6b2e-ff0b1197-dafc86fa-5e195f94_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:30.833064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:30.833325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:30.833349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:30.833386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:30.833473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:30.842335Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:30.842353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:30.842356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:30.842358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:30.842369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894717466827815:2759]
2025-09-30T14:50:30.842373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894717466827815:2759]
2025-09-30T14:50:30.842379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894717466827815:2759]
2025-09-30T14:50:30.842423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:30.842433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.842437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:30.842441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:30.842443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:30.842447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:30.842578Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:30.877899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894717556550681:2517]
2025-09-30T14:50:30.878182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 73, pipe: [1:7555894717556550681:2517]
2025-09-30T14:50:30.957032Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:30.965819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:30.965847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:30.966002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:30.966059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:30.966119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:30.966193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:30.966247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:30.966256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:30.966329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:30.966394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:30.966455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:30.966521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:30.966570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:30.966583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:30.966687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:30.966772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:30.966837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:30.966909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:30.966951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:30.966953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:30.967103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:30.967185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:30.967329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:30.967444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:30.967489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:30.967495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:30.967592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:30.967682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:30.967752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:30.967819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:30.967883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:30.967889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:30.967954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:30.968015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:30.968074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:30.968159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:30.968208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:30.968218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:30.969905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894717556550681:2517]
2025-09-30T14:50:30.969945Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:30.970135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:30.970140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:30.970169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 74 reason: error at write: Disconnected sessionId: src_id|ad2c6b2e-ff0b1197-dafc86fa-5e195f94_0
2025-09-30T14:50:30.970520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 74 sessionId: src_id|ad2c6b2e-ff0b1197-dafc86fa-5e195f94_0 is DEAD
2025-09-30T14:50:30.968290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:30.968360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:30.968423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:30.968532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:30.968592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:30.968595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:30.968660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:30.968751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:30.968814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:30.968875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:30.968916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:30.968918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:30.968990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:30.969048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:30.969110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:30.969175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:30.969218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:30.969221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:30.969293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:30.969352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:30.969416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:30.969476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:30.969514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:30.969517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:30.969587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894717556550681:2517], now have 1 active actors on pipe
2025-09-30T14:50:30.970730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad2c6b2e-ff0b1197-dafc86fa-5e195f94_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:30.970751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad2c6b2e-ff0b1197-dafc86fa-5e195f94_0] Write session will restart in 0.008602s
2025-09-30T14:50:30.970774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad2c6b2e-ff0b1197-dafc86fa-5e195f94_0] Write session: Do CDS request
2025-09-30T14:50:30.970780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad2c6b2e-ff0b1197-dafc86fa-5e195f94_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:30.970884Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:30.981052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad2c6b2e-ff0b1197-dafc86fa-5e195f94_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:30.981826Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:30.981848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 75
2025-09-30T14:50:30.982080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 75 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:30.982172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 75 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:30.982179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=75 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:30.982184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:30.982760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 75 sessionId:  describe result for acl check
2025-09-30T14:50:30.982796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:30.982806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:30.982810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:30.982816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894717556550785:2948] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:30.983466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894717556550785:2948] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:30.985960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894717556550785:2948] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:30.988908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:30.989071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894717556550785:2948] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:30.989088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894717556550785:2948] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:30.989092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894717556550785:2948] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:30.989101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 75 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:30.989792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:30.990029Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:30.990043Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:30.990057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:30.990122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:30.990177Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894717466827953:2762]
2025-09-30T14:50:30.991026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:30.991433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:30.991506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:30.991925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:30.992001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:30.992009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:30.992011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:30.992012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:30.992014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:30.992016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:30.992017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:30.992019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:30.992021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:30.992022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:30.992023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.992026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.992028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.992029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:30.992031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:30.992038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:30.992050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:30.992056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:30.992061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:30.992066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:30.992071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:30.992076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:30.992080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:30.992086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:30.992091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:30.992096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.992102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.992107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.992112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:30.992116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:30.992125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:30.992135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:30.992143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:30.992149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:30.992168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:30.992175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:30.992180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:30.992187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:30.992193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:30.992206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:30.992212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:30.992218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:30.992230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:30.992237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:30.992243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:30.992255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:30.992262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:30.992269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:30.992281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:30.992287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:30.992294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.992300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:30.992312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.992319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:30.992326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.992340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:30.992345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:30.992352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:30.992364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:30.992371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:30.992424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:31.004003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:31.005245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:31.005266Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:31.005270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:31.005274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:31.005282Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 74 [2:7555894717466827953:2762]
2025-09-30T14:50:31.005302Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:31.005322Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:31.005325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.005329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.005332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.005349Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:31.005363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:31.005378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:31.005460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.005468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:31.005470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:31.005473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:31.005476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:31.005551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:31.005558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.005575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:31.005595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:31.005613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:31.005629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894717466827947:2762]
2025-09-30T14:50:31.005631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894717466827947:2762]
2025-09-30T14:50:31.005634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894717466827947:2762]
2025-09-30T14:50:31.005643Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:31.005657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:31.005672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:31.005675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:31.005678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:31.005682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:31.005684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:31.005720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894717556550819:2948], now have 1 active actors on pipe
2025-09-30T14:50:31.005724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894717556550695:2454], now have 1 active actors on pipe
2025-09-30T14:50:31.005727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894717466827947:2762]
2025-09-30T14:50:31.005740Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:31.005785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:31.006109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:31.006120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:31.006151Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd195ffa-a7dd694c-c0a9526e-1e90216f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:31.006163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.006174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.006176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:31.006188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.006206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:31.006227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:31.005776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 74
2025-09-30T14:50:31.005802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 74
2025-09-30T14:50:31.006591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:31.006603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:31.006627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:31.006756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 75 partition: 0 MaxSeqNo: 42 sessionId: src_id|cd195ffa-a7dd694c-c0a9526e-1e90216f_0
2025-09-30T14:50:31.007123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad2c6b2e-ff0b1197-dafc86fa-5e195f94_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cd195ffa-a7dd694c-c0a9526e-1e90216f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:31.010031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd195ffa-a7dd694c-c0a9526e-1e90216f_0] Write session: try to update token
2025-09-30T14:50:31.010049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd195ffa-a7dd694c-c0a9526e-1e90216f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:31.023304Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:31.023321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:31.023324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:31.023326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:31.023337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894717466827947:2762]
2025-09-30T14:50:31.023342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894717466827947:2762]
2025-09-30T14:50:31.023347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894717466827947:2762]
2025-09-30T14:50:31.023390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:31.023393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:31.023399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.023400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:31.023402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:31.023404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:31.023543Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:31.026485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 75 sessionId: src_id|cd195ffa-a7dd694c-c0a9526e-1e90216f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:31.029602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:31.069917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894721851518131:2517]
2025-09-30T14:50:31.070209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 74, pipe: [1:7555894721851518131:2517]
2025-09-30T14:50:31.139341Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:31.139745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:31.139766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:31.139807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894721851518131:2517], now have 1 active actors on pipe
2025-09-30T14:50:31.140076Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:31.140081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894721851518131:2517]
2025-09-30T14:50:31.140109Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:31.140148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:31.140152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:31.140214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 75 reason: error at write: Disconnected sessionId: src_id|cd195ffa-a7dd694c-c0a9526e-1e90216f_0
2025-09-30T14:50:31.140401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 75 sessionId: src_id|cd195ffa-a7dd694c-c0a9526e-1e90216f_0 is DEAD
2025-09-30T14:50:31.141773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd195ffa-a7dd694c-c0a9526e-1e90216f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:31.141787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd195ffa-a7dd694c-c0a9526e-1e90216f_0] Write session will restart in 0.006563s
2025-09-30T14:50:31.141811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd195ffa-a7dd694c-c0a9526e-1e90216f_0] Write session: Do CDS request
2025-09-30T14:50:31.141817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd195ffa-a7dd694c-c0a9526e-1e90216f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:31.149832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd195ffa-a7dd694c-c0a9526e-1e90216f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:31.150017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:31.150044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 76
2025-09-30T14:50:31.150278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 76 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:31.150330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 76 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:31.150340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=76 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:31.150344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:31.150869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 76 sessionId:  describe result for acl check
2025-09-30T14:50:31.150908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:31.150914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:31.150916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:31.150923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894721851518181:2952] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:31.151623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894721851518181:2952] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:31.155477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:31.155841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894721851518181:2952] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:31.156434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:31.156743Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:31.156762Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:31.156789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:31.156943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:31.157009Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894721761795378:2764]
2025-09-30T14:50:31.157688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:31.158052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:31.158106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:31.158497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:31.158568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:31.158576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:31.158577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:31.158578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:31.158580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:31.158581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:31.158582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:31.158584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:31.158585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:31.158587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:31.158589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.158590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:31.158591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:31.158593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:31.158595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:31.158602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:31.158613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:31.158618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:31.158622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:31.158626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:31.158631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:31.158635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:31.158639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:31.158643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:31.158648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:31.158653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.158657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:31.158661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:31.158666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:31.158670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:31.158679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:31.158688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:31.158694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:31.158711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:31.158717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:31.158723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:31.158728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:31.158734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:31.158739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:31.158745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:31.158750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:31.158758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:31.158771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:31.158777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:31.158781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:31.158787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:31.158792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:31.158798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:31.158802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:31.158808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:31.158814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.158820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.158830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:31.158835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:31.158839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:31.158845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:31.158849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:31.158854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:31.158859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:31.158865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:31.158911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:31.159534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894721851518181:2952] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:31.159551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894721851518181:2952] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:31.159555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894721851518181:2952] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:31.159566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 76 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:31.168543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:31.169412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:31.169430Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:31.169434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:31.169438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:31.169446Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 75 [2:7555894721761795378:2764]
2025-09-30T14:50:31.169465Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:31.169480Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:31.169483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.169487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.169489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.169508Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:31.169515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:31.169522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:31.169582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.169590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:31.169593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:31.169596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:31.169599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:31.169671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:31.169679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.169691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:31.169708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:31.169730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:31.169749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894721761795373:2764]
2025-09-30T14:50:31.169758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894721761795373:2764]
2025-09-30T14:50:31.169761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894721761795373:2764]
2025-09-30T14:50:31.169771Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:31.169786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:31.169791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:31.169791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:31.169794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:31.169804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:31.169807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:31.169818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894721851518133:2454], now have 1 active actors on pipe
2025-09-30T14:50:31.169823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894721851518262:2952], now have 1 active actors on pipe
2025-09-30T14:50:31.169858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894721761795373:2764]
2025-09-30T14:50:31.169870Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:31.169881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:31.169919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 75
2025-09-30T14:50:31.169922Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 75
2025-09-30T14:50:31.170024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:31.170044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:31.170097Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f96e293-209046b1-3f706c11-de9d4c41_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:31.170108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.170114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.170117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:31.170135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.170153Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:31.170174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:31.170409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:31.170418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:31.170436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:31.170559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 76 partition: 0 MaxSeqNo: 42 sessionId: src_id|2f96e293-209046b1-3f706c11-de9d4c41_0
2025-09-30T14:50:31.171029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd195ffa-a7dd694c-c0a9526e-1e90216f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2f96e293-209046b1-3f706c11-de9d4c41_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:31.173916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f96e293-209046b1-3f706c11-de9d4c41_0] Write session: try to update token
2025-09-30T14:50:31.173934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f96e293-209046b1-3f706c11-de9d4c41_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:31.188979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 76 sessionId: src_id|2f96e293-209046b1-3f706c11-de9d4c41_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:31.189991Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:31.190014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:31.190018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:31.190020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:31.190031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894721761795373:2764]
2025-09-30T14:50:31.190037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894721761795373:2764]
2025-09-30T14:50:31.190041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894721761795373:2764]
2025-09-30T14:50:31.190089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:31.190097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.190101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:31.190375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:31.190392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:31.190396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:31.190395Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:31.191885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:31.240391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894721851518271:2517]
2025-09-30T14:50:31.240803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 75, pipe: [1:7555894721851518271:2517]
2025-09-30T14:50:31.304518Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:31.305010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:31.305029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:31.305068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894721851518271:2517], now have 1 active actors on pipe
2025-09-30T14:50:31.305476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:31.305547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:31.305548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894721851518271:2517]
2025-09-30T14:50:31.305554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:31.305622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 76 reason: error at write: Disconnected sessionId: src_id|2f96e293-209046b1-3f706c11-de9d4c41_0
2025-09-30T14:50:31.305607Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:31.305833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 76 sessionId: src_id|2f96e293-209046b1-3f706c11-de9d4c41_0 is DEAD
2025-09-30T14:50:31.306023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f96e293-209046b1-3f706c11-de9d4c41_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:31.306033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f96e293-209046b1-3f706c11-de9d4c41_0] Write session will restart in 0.006745s
2025-09-30T14:50:31.306052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f96e293-209046b1-3f706c11-de9d4c41_0] Write session: Do CDS request
2025-09-30T14:50:31.306069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f96e293-209046b1-3f706c11-de9d4c41_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:31.315645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f96e293-209046b1-3f706c11-de9d4c41_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:31.315789Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:31.315818Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 77
2025-09-30T14:50:31.315934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 77 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:31.315962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 77 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:31.315967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=77 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:31.315971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:31.316570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 77 sessionId:  describe result for acl check
2025-09-30T14:50:31.316607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:31.316612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:31.316615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:31.316621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894721851518286:2956] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:31.317226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894721851518286:2956] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:31.320405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894721851518286:2956] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:31.323194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894721851518286:2956] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:31.323211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894721851518286:2956] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:31.323215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894721851518286:2956] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:31.323223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 77 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:31.323812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:31.324482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:31.324713Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:31.324726Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:31.324740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:31.324824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:31.324870Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894721761795510:2766]
2025-09-30T14:50:31.325510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:31.325839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:31.325903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:31.326262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:31.326323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:31.326329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:31.326330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:31.326331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:31.326332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:31.326333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:31.326335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:31.326336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:31.326337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:31.326339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:31.326340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.326341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:31.326342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:31.326343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:31.326345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:31.326351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:31.326362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:31.326367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:31.326371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:31.326376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:31.326380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:31.326384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:31.326388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:31.326392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:31.326397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:31.326407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.326411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:31.326419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:31.326423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:31.326432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:31.326440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:31.326453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:31.326463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:31.326473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:31.326477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:31.326482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:31.326491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:31.326501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:31.326506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:31.326516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:31.326521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:31.326527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:31.326536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:31.326541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:31.326546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:31.326553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:31.326557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:31.326564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:31.326569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:31.326574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:31.326579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.326590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.326595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:31.326605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:31.326610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:31.326619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:31.326624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:31.326631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:31.326636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:31.326646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:31.326688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:31.333350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:31.334251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:31.334274Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:31.334277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:31.334281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:31.334289Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 76 [2:7555894721761795510:2766]
2025-09-30T14:50:31.334307Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:31.334323Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:31.334326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.334329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.334331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.334347Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:31.334362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:31.334370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:31.334437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.334446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:31.334448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:31.334452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:31.334454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:31.334523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:31.334532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.334545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:31.334558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:31.334575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:31.334592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894721761795505:2766]
2025-09-30T14:50:31.334594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894721761795505:2766]
2025-09-30T14:50:31.334597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894721761795505:2766]
2025-09-30T14:50:31.334613Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:31.334628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894721851518272:2454], now have 1 active actors on pipe
2025-09-30T14:50:31.334632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894721851518398:2956], now have 1 active actors on pipe
2025-09-30T14:50:31.334639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:31.334645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:31.334649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:31.334652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:31.334654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:31.334657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:31.334690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894721761795505:2766]
2025-09-30T14:50:31.334719Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:31.334727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:31.334737Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 76
2025-09-30T14:50:31.334809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 76
2025-09-30T14:50:31.334986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:31.334996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:31.335022Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|849721fe-fdb53917-bd6d3d95-6cbd3422_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:31.335037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.335040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.335043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:31.335053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.335063Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:31.335076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:31.335237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:31.335256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:31.335271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:31.335427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 77 partition: 0 MaxSeqNo: 42 sessionId: src_id|849721fe-fdb53917-bd6d3d95-6cbd3422_0
2025-09-30T14:50:31.335894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f96e293-209046b1-3f706c11-de9d4c41_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|849721fe-fdb53917-bd6d3d95-6cbd3422_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:31.338978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|849721fe-fdb53917-bd6d3d95-6cbd3422_0] Write session: try to update token
2025-09-30T14:50:31.338999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|849721fe-fdb53917-bd6d3d95-6cbd3422_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:31.349666Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:31.349696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:31.349710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894721761795505:2766]
2025-09-30T14:50:31.349775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:31.350201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:31.350383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:31.350563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:31.350777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:31.350996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:31.351044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:31.351977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:31.357094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 77 sessionId: src_id|849721fe-fdb53917-bd6d3d95-6cbd3422_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:31.360066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:31.360373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:31.360393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:31.360427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:31.360527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:31.362434Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:31.362458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:31.362460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:31.362463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:31.362474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894721761795505:2766]
2025-09-30T14:50:31.362479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894721761795505:2766]
2025-09-30T14:50:31.362484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894721761795505:2766]
2025-09-30T14:50:31.362532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:31.362534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:31.362540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:31.362545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:31.362545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.362548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:31.362767Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:31.405778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894721851518412:2517]
2025-09-30T14:50:31.406057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 76, pipe: [1:7555894721851518412:2517]
2025-09-30T14:50:31.480038Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:31.488397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:31.488424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:31.488600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:31.488665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:31.488737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:31.488810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:31.488861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:31.488866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:31.488939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:31.489001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:31.489067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:31.489176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:31.489215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:31.489219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:31.489288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:31.489346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:31.489407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:31.489467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:31.489510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:31.489512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:31.489586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:31.489649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:31.489711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:31.489777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:31.489819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:31.489823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:31.489894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:31.489954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:31.490018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:31.490080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:31.490125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:31.490129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:31.490208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:31.490273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:31.490335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:31.490399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:31.490506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:31.490510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:31.490582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:31.490645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:31.490729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:31.490793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:31.490857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:31.490861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:31.490931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:31.490994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:31.491060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:31.491127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:31.491169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:31.491172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:31.491441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:31.491513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:31.491580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:31.491650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:31.491714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:31.491721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:31.491790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:31.491858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:31.491922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:31.491986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:31.492047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:31.492054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:31.492114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894721851518412:2517], now have 1 active actors on pipe
2025-09-30T14:50:31.493278Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:31.495327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:31.495390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894721851518412:2517]
2025-09-30T14:50:31.495416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:31.495461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 77 reason: status is not ok: tablet will be restarted right now sessionId: src_id|849721fe-fdb53917-bd6d3d95-6cbd3422_0
2025-09-30T14:50:31.495815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|849721fe-fdb53917-bd6d3d95-6cbd3422_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:31.495828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|849721fe-fdb53917-bd6d3d95-6cbd3422_0] Write session will restart in 0.008950s
2025-09-30T14:50:31.495650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 77 sessionId: src_id|849721fe-fdb53917-bd6d3d95-6cbd3422_0 is DEAD
2025-09-30T14:50:31.495851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|849721fe-fdb53917-bd6d3d95-6cbd3422_0] Write session: Do CDS request
2025-09-30T14:50:31.495856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|849721fe-fdb53917-bd6d3d95-6cbd3422_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:31.505177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:31.505803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|849721fe-fdb53917-bd6d3d95-6cbd3422_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:31.505959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:31.505975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 78
2025-09-30T14:50:31.506090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 78 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:31.506121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 78 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:31.506126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=78 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:31.506130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:31.506272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:31.506525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 78 sessionId:  describe result for acl check
2025-09-30T14:50:31.506558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:31.506560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:31.506562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:31.506567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894721851518524:2967] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:31.506696Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:31.506729Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:31.506743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:31.506823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:31.506869Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894721761795671:2775]
2025-09-30T14:50:31.507238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894721851518524:2967] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:31.507570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:31.507907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:31.507961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:31.508351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:31.508411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:31.508417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:31.508418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:31.508419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:31.508420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:31.508421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:31.508422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:31.508423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:31.508424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:31.508426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:31.508427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.508427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:31.508428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:31.508429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:31.508430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:31.508437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:31.508446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:31.508450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:31.508455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:31.508459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:31.508463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:31.508467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:31.508471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:31.508475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:31.508479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:31.508483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.508487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:31.508491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:31.508495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:31.508498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:31.508506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:31.508514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:31.508519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:31.508525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:31.508529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:31.508535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:31.508539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:31.508544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:31.508549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:31.508555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:31.508559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:31.508564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:31.508568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:31.508573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:31.508578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:31.508583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:31.508586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:31.508592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:31.508596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:31.508602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:31.508606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.508611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.508616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:31.508621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:31.508625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:31.508630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:31.508635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:31.508640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:31.508644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:31.508650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:31.508693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:31.509464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894721851518524:2967] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:31.514849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894721851518524:2967] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:31.514866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894721851518524:2967] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:31.514870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894721851518524:2967] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:31.514878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 78 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:31.518313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:31.519362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:31.519382Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:31.519385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:31.519389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:31.519400Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 77 [2:7555894721761795671:2775]
2025-09-30T14:50:31.519420Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:31.519440Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:31.519445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.519450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.519460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.519478Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:31.519490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:31.519498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:31.519565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.519572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:31.519574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:31.519578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:31.519581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:31.519657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:31.519665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.519679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:31.519693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:31.519714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:31.519743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894721851518567:2967], now have 1 active actors on pipe
2025-09-30T14:50:31.519756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894721851518431:2454], now have 1 active actors on pipe
2025-09-30T14:50:31.519763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894721761795655:2775]
2025-09-30T14:50:31.519765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894721761795655:2775]
2025-09-30T14:50:31.519767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894721761795655:2775]
2025-09-30T14:50:31.519786Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:31.519804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:31.519820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:31.519823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:31.519831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:31.519834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:31.519836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:31.519863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894721761795655:2775]
2025-09-30T14:50:31.519844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 77
2025-09-30T14:50:31.519876Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:31.519878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 77
2025-09-30T14:50:31.519879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:31.520080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:31.520093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:31.520123Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|641d7267-fc6151ef-dfa84bf2-9acbf4a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:31.520136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.520145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.520147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:31.520158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.520169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:31.520191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:31.520487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:31.520495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:31.520512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:31.520651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 78 partition: 0 MaxSeqNo: 42 sessionId: src_id|641d7267-fc6151ef-dfa84bf2-9acbf4a1_0
2025-09-30T14:50:31.521216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|849721fe-fdb53917-bd6d3d95-6cbd3422_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|641d7267-fc6151ef-dfa84bf2-9acbf4a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:31.524052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|641d7267-fc6151ef-dfa84bf2-9acbf4a1_0] Write session: try to update token
2025-09-30T14:50:31.524075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|641d7267-fc6151ef-dfa84bf2-9acbf4a1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:31.532161Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:31.532177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:31.532185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894721761795655:2775]
2025-09-30T14:50:31.532229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:31.532236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:31.532404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:31.532556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:31.532753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:31.532898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:31.533107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:31.533150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:31.539068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 78 sessionId: src_id|641d7267-fc6151ef-dfa84bf2-9acbf4a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:31.542021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:31.542598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:31.542616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:31.543953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:31.543982Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:31.543985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:31.543987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:31.543989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:31.543998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894721761795655:2775]
2025-09-30T14:50:31.544002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894721761795655:2775]
2025-09-30T14:50:31.544006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894721761795655:2775]
2025-09-30T14:50:31.544032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:31.544037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:31.544044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.544048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:31.544054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:31.544058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:31.544089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:31.544210Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:31.595711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894721851518576:2517]
2025-09-30T14:50:31.596030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 77, pipe: [1:7555894721851518576:2517]
2025-09-30T14:50:31.661387Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:31.669724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:31.669751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:31.669913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:31.669973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:31.670036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:31.670100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:31.670144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:31.670152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:31.670218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:31.670278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:31.670340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:31.670402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:31.670447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:31.670453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:31.670521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:31.670581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:31.670651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:31.670732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:31.670775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:31.670780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:31.670846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:31.670911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:31.670973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:31.671032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:31.671077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:31.671083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:31.671153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:31.671220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:31.671305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:31.671377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:31.671439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:31.671447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:31.671514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:31.671588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:31.671648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:31.671743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:31.671788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:31.671796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:31.671860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:31.671918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:31.671983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:31.672044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:31.672103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:31.672108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:31.672173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:31.672229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:31.672287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:31.672355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:31.672415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:31.672422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:31.672486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:31.672554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:31.672615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:31.672677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:31.672730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:31.672735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:31.672802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:31.672871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:31.672936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:31.673003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:31.673072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:31.673079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:31.673141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894721851518576:2517], now have 1 active actors on pipe
2025-09-30T14:50:31.673401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:31.673448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894721851518576:2517]
2025-09-30T14:50:31.673457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:31.673462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:31.673491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 78 reason: error at write: Disconnected sessionId: src_id|641d7267-fc6151ef-dfa84bf2-9acbf4a1_0
2025-09-30T14:50:31.673721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 78 sessionId: src_id|641d7267-fc6151ef-dfa84bf2-9acbf4a1_0 is DEAD
2025-09-30T14:50:31.673867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|641d7267-fc6151ef-dfa84bf2-9acbf4a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:31.673879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|641d7267-fc6151ef-dfa84bf2-9acbf4a1_0] Write session will restart in 0.006506s
2025-09-30T14:50:31.673919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|641d7267-fc6151ef-dfa84bf2-9acbf4a1_0] Write session: Do CDS request
2025-09-30T14:50:31.673924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|641d7267-fc6151ef-dfa84bf2-9acbf4a1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:31.674190Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:31.681869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|641d7267-fc6151ef-dfa84bf2-9acbf4a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:31.681891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:31.681908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 79
2025-09-30T14:50:31.682103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 79 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:31.682138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 79 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:31.682149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=79 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:31.682153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:31.682570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 79 sessionId:  describe result for acl check
2025-09-30T14:50:31.682609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:31.682611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:31.682613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:31.682619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894721851518615:2973] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:31.683187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894721851518615:2973] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:31.686046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894721851518615:2973] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:31.687881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:31.689133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894721851518615:2973] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:31.689146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894721851518615:2973] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:31.689149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894721851518615:2973] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:31.689165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 79 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:31.688644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:31.688912Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:31.688916Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:31.688928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:31.688990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:31.689026Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894721761795825:2784]
2025-09-30T14:50:31.689665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:31.689997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:31.690056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:31.690400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:31.690469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:31.690474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:31.690475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:31.690476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:31.690477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:31.690478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:31.690480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:31.690480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:31.690482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:31.690483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:31.690484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.690485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:31.690486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:31.690487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:31.690488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:31.690493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:31.690503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:31.690507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:31.690510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:31.690514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:31.690518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:31.690521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:31.690525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:31.690529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:31.690533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:31.690537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.690540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:31.690544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:31.690547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:31.690551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:31.690558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:31.690566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:31.690571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:31.690577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:31.690581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:31.690586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:31.690590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:31.690595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:31.690599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:31.690604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:31.690607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:31.690612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:31.690616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:31.690621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:31.690626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:31.690630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:31.690635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:31.690640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:31.690644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:31.690650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:31.690654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.690659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.690663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:31.690683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:31.690687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:31.690692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:31.690713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:31.690719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:31.690723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:31.690728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:31.690784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:31.697119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:31.698114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:31.698131Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:31.698135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:31.698139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:31.698147Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 78 [2:7555894721761795825:2784]
2025-09-30T14:50:31.698164Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:31.698183Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:31.698186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.698189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.698192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.698209Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:31.698216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:31.698231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:31.698319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.698327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:31.698329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:31.698333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:31.698335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:31.698409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:31.698417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.698432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:31.698445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:31.698468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:31.698491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894721851518578:2454], now have 1 active actors on pipe
2025-09-30T14:50:31.698500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894721851518718:2973], now have 1 active actors on pipe
2025-09-30T14:50:31.698506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894721761795820:2784]
2025-09-30T14:50:31.698509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894721761795820:2784]
2025-09-30T14:50:31.698511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894721761795820:2784]
2025-09-30T14:50:31.698525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:31.698541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:31.698557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:31.698566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:31.698548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 78
2025-09-30T14:50:31.698577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 78
2025-09-30T14:50:31.698590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:31.698599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:31.698601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:31.698603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894721761795820:2784]
2025-09-30T14:50:31.698605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:31.698607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:31.698627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:31.698636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:31.698685Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|847a9c9d-b8ad8ec0-4dfdd81f-eedd628_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:31.698696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.698715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.698717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:31.698726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.698738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:31.698760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:31.698905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:31.698912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:31.698925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:31.699029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 79 partition: 0 MaxSeqNo: 42 sessionId: src_id|847a9c9d-b8ad8ec0-4dfdd81f-eedd628_0
2025-09-30T14:50:31.699429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|641d7267-fc6151ef-dfa84bf2-9acbf4a1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|847a9c9d-b8ad8ec0-4dfdd81f-eedd628_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:31.702209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|847a9c9d-b8ad8ec0-4dfdd81f-eedd628_0] Write session: try to update token
2025-09-30T14:50:31.702230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|847a9c9d-b8ad8ec0-4dfdd81f-eedd628_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:31.711580Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:31.711598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:31.711601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:31.711603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:31.711613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894721761795820:2784]
2025-09-30T14:50:31.711617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894721761795820:2784]
2025-09-30T14:50:31.711620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894721761795820:2784]
2025-09-30T14:50:31.711662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:31.711669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.711669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:31.711672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:31.711681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:31.711685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:31.711816Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:31.717699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 79 sessionId: src_id|847a9c9d-b8ad8ec0-4dfdd81f-eedd628_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:31.720616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:31.773398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894721851518731:2517]
2025-09-30T14:50:31.773670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 78, pipe: [1:7555894721851518731:2517]
2025-09-30T14:50:31.824407Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:31.824739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:31.824756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:31.824797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894721851518731:2517], now have 1 active actors on pipe
2025-09-30T14:50:31.825028Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:31.825046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:31.825082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894721851518731:2517]
2025-09-30T14:50:31.825099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:31.825584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|847a9c9d-b8ad8ec0-4dfdd81f-eedd628_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:31.825600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|847a9c9d-b8ad8ec0-4dfdd81f-eedd628_0] Write session will restart in 0.008232s
2025-09-30T14:50:31.825189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 79 reason: status is not ok: tablet will be restarted right now sessionId: src_id|847a9c9d-b8ad8ec0-4dfdd81f-eedd628_0
2025-09-30T14:50:31.825395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 79 sessionId: src_id|847a9c9d-b8ad8ec0-4dfdd81f-eedd628_0 is DEAD
2025-09-30T14:50:31.825623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|847a9c9d-b8ad8ec0-4dfdd81f-eedd628_0] Write session: Do CDS request
2025-09-30T14:50:31.825629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|847a9c9d-b8ad8ec0-4dfdd81f-eedd628_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:31.834847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|847a9c9d-b8ad8ec0-4dfdd81f-eedd628_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:31.834927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:31.834955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 80
2025-09-30T14:50:31.835125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 80 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:31.835173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 80 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:31.835183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=80 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:31.835187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:31.835687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 80 sessionId:  describe result for acl check
2025-09-30T14:50:31.835732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:31.835734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:31.835736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:31.835742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894721851518827:2977] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:31.836279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894721851518827:2977] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:31.836512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:31.837141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:31.837321Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:31.837329Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:31.837340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:31.837394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:31.837454Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894721761795959:2786]
2025-09-30T14:50:31.838111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:31.838135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894721851518827:2977] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:31.838393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:31.838433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:31.838756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:31.838851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:31.838859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:31.838860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:31.838861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:31.838862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:31.838864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:31.838865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:31.838866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:31.838867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:31.838868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:31.838869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.838870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:31.838871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:31.838872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:31.838873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:31.838879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:31.838888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:31.838892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:31.838896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:31.838900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:31.838904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:31.838908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:31.838911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:31.838915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:31.838919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:31.838924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.838927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:31.838931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:31.838935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:31.838939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:31.838946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:31.838954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:31.838960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:31.838964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:31.838969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:31.838974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:31.838978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:31.838982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:31.838987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:31.838992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:31.838998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:31.839002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:31.839007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:31.839011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:31.839016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:31.839020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:31.839025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:31.839030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:31.839034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:31.839038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:31.839042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.839048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.839051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:31.839055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:31.839059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:31.839063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:31.839067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:31.839071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:31.839076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:31.839080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:31.839118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:31.844513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894721851518827:2977] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:31.844531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894721851518827:2977] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:31.844535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894721851518827:2977] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:31.844545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 80 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:31.844750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:31.845592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:31.845606Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:31.845609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:31.845613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:31.845620Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 79 [2:7555894721761795959:2786]
2025-09-30T14:50:31.845636Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:31.845655Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:31.845663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.845667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.845669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.845685Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:31.845696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:31.845702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:31.845764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.845772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:31.845775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:31.845778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:31.845781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:31.845842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:31.845854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.845869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:31.845880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:31.845897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:31.845916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894721761795953:2786]
2025-09-30T14:50:31.845922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894721761795953:2786]
2025-09-30T14:50:31.845924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894721761795953:2786]
2025-09-30T14:50:31.845932Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:31.845946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894721851518869:2977], now have 1 active actors on pipe
2025-09-30T14:50:31.845945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:31.845949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:31.845953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:31.845958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:31.845971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:31.845974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:31.845979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894721851518735:2454], now have 1 active actors on pipe
2025-09-30T14:50:31.846008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894721761795953:2786]
2025-09-30T14:50:31.846021Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:31.846024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 79
2025-09-30T14:50:31.846060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 79
2025-09-30T14:50:31.846054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:31.846133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:31.846143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:31.846168Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c2136f8-74a0b3ea-8e6fb867-a8646c1f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:31.846179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.846188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.846190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:31.846199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.846212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:31.846230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:31.846400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:31.846419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:31.846444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:31.846548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 80 partition: 0 MaxSeqNo: 42 sessionId: src_id|7c2136f8-74a0b3ea-8e6fb867-a8646c1f_0
2025-09-30T14:50:31.846924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|847a9c9d-b8ad8ec0-4dfdd81f-eedd628_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7c2136f8-74a0b3ea-8e6fb867-a8646c1f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:31.849628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c2136f8-74a0b3ea-8e6fb867-a8646c1f_0] Write session: try to update token
2025-09-30T14:50:31.849647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c2136f8-74a0b3ea-8e6fb867-a8646c1f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:31.858636Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:31.858653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:31.858663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894721761795953:2786]
2025-09-30T14:50:31.858714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:31.858723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:31.859001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:31.859158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:31.859329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:31.859485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:31.859820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:31.859859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:31.864439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 80 sessionId: src_id|7c2136f8-74a0b3ea-8e6fb867-a8646c1f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:31.867422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:31.867632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:31.867653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:31.867692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:31.867763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:31.872097Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:31.872113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:31.872116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:31.872118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:31.872128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894721761795953:2786]
2025-09-30T14:50:31.872132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894721761795953:2786]
2025-09-30T14:50:31.872135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894721761795953:2786]
2025-09-30T14:50:31.872170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:31.872177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:31.872180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:31.872181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:31.872202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:31.872207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:31.872321Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:31.925457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894721851518876:2517]
2025-09-30T14:50:31.929748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 79, pipe: [1:7555894721851518876:2517]
2025-09-30T14:50:31.991187Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:31.999802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:31.999829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:32.000010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:32.000081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:32.000144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:32.000207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:32.000253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:32.000258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:32.000330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:32.000391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:32.000451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:32.000513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:32.000552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:32.000558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:32.000625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:32.000688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:32.000750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:32.000817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:32.000857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:32.000860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:32.000930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:32.000995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:32.001062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:32.001125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:32.001167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:32.001169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:32.001239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:32.001300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:32.001364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:32.001425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:32.001467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:32.001470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:32.001538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:32.001594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:32.001655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:32.001720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:32.001763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:32.001766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:32.001840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:32.001898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:32.001963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:32.002025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:32.002063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:32.002066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:32.002130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:32.002193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:32.002256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:32.002321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:32.002360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:32.002363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:32.002430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:32.002488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:32.002549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:32.002611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:32.002657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:32.002659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:32.002742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:32.002802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:32.002865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:32.002928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:32.002970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:32.002973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:32.003043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894721851518876:2517], now have 1 active actors on pipe
2025-09-30T14:50:32.003488Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:32.003545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894721851518876:2517]
2025-09-30T14:50:32.003583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:32.003593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:32.003633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 80 reason: error at write: Disconnected sessionId: src_id|7c2136f8-74a0b3ea-8e6fb867-a8646c1f_0
2025-09-30T14:50:32.003847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 80 sessionId: src_id|7c2136f8-74a0b3ea-8e6fb867-a8646c1f_0 is DEAD
2025-09-30T14:50:32.003994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c2136f8-74a0b3ea-8e6fb867-a8646c1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:32.004005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c2136f8-74a0b3ea-8e6fb867-a8646c1f_0] Write session will restart in 0.009958s
2025-09-30T14:50:32.004028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c2136f8-74a0b3ea-8e6fb867-a8646c1f_0] Write session: Do CDS request
2025-09-30T14:50:32.004034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c2136f8-74a0b3ea-8e6fb867-a8646c1f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:32.004271Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:32.014807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c2136f8-74a0b3ea-8e6fb867-a8646c1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:32.019458Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:32.019474Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 81
2025-09-30T14:50:32.019628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 81 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:32.019657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 81 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:32.019663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=81 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:32.019667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:32.021217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:32.022146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:32.022323Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:32.022333Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:32.022343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:32.022394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:32.022437Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894726056763392:2789]
2025-09-30T14:50:32.023018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:32.020063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 81 sessionId:  describe result for acl check
2025-09-30T14:50:32.020094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:32.020096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:32.020099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:32.020105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894726146486279:2983] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:32.020560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894726146486279:2983] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:32.023352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:32.023395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:32.023705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:32.023776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:32.023777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:32.023778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:32.023780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:32.023781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:32.023782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:32.023784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:32.023785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:32.023786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:32.023787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:32.023788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.023789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.023791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.023792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:32.023793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:32.023798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:32.023808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:32.023812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:32.023816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:32.023819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:32.023823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:32.023827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:32.023830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:32.023834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:32.023838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:32.023841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.023845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.023848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.023852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:32.023855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:32.023863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:32.023870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:32.023878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:32.023884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:32.023888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:32.023893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:32.023897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:32.023902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:32.023906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:32.023911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:32.023914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:32.023919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:32.023923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:32.023929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:32.023934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:32.023939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:32.023944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:32.023949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:32.023953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:32.023958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:32.023964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.023968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.023973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.023977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.023983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.023988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.023992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:32.023997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:32.024002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:32.024007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:32.024048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:32.028219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894726146486279:2983] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:32.031307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894726146486279:2983] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:32.031324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894726146486279:2983] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:32.031327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894726146486279:2983] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:32.031335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 81 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:32.031663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:32.032570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:32.032587Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:32.032591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:32.032595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:32.032601Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 80 [2:7555894726056763392:2789]
2025-09-30T14:50:32.032617Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:32.032632Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:32.032635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.032639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.032641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.032659Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:32.032671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:32.032679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:32.032744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.032750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.032753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.032756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:32.032758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:32.032822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:32.032833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.032846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.032859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.032876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:32.032896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894726146486181:2454], now have 1 active actors on pipe
2025-09-30T14:50:32.032905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894726146486320:2983], now have 1 active actors on pipe
2025-09-30T14:50:32.032910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894726056763386:2789]
2025-09-30T14:50:32.032913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894726056763386:2789]
2025-09-30T14:50:32.032915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894726056763386:2789]
2025-09-30T14:50:32.032926Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:32.032940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:32.032941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:32.032944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:32.032946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:32.032952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 80
2025-09-30T14:50:32.032959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 80
2025-09-30T14:50:32.032956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:32.032959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:32.032994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894726056763386:2789]
2025-09-30T14:50:32.033004Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:32.033010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:32.033023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:32.033028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:32.033076Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e800e17-4827d3bb-8879d8ff-e1e14171_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:32.033088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.033091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.033094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:32.033102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.033111Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:32.033127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:32.033310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:32.033329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:32.033345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:32.033423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 81 partition: 0 MaxSeqNo: 42 sessionId: src_id|8e800e17-4827d3bb-8879d8ff-e1e14171_0
2025-09-30T14:50:32.033796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c2136f8-74a0b3ea-8e6fb867-a8646c1f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8e800e17-4827d3bb-8879d8ff-e1e14171_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:32.036634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e800e17-4827d3bb-8879d8ff-e1e14171_0] Write session: try to update token
2025-09-30T14:50:32.036651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e800e17-4827d3bb-8879d8ff-e1e14171_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:32.046379Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:32.046398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:32.046408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894726056763386:2789]
2025-09-30T14:50:32.046454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:32.046630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:32.046799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:32.046980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:32.047073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:32.047119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:32.047338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:32.047378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:32.051757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 81 sessionId: src_id|8e800e17-4827d3bb-8879d8ff-e1e14171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:32.054505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:32.055032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:32.055055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:32.055093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:32.055207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:32.060025Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:32.060045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:32.060048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:32.060050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:32.060059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894726056763386:2789]
2025-09-30T14:50:32.060064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894726056763386:2789]
2025-09-30T14:50:32.060068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894726056763386:2789]
2025-09-30T14:50:32.060109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:32.060114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:32.060121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:32.060122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.060125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:32.060125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:32.060266Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:32.103658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894726146486327:2517]
2025-09-30T14:50:32.104150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 80, pipe: [1:7555894726146486327:2517]
2025-09-30T14:50:32.175602Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:32.183579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:32.183604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:32.183775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:32.183843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:32.183906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:32.183977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:32.184031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:32.184042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:32.184111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:32.184172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:32.184241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:32.184303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:32.184345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:32.184352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:32.184417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:32.184477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:32.184536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:32.184594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:32.184644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:32.184651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:32.184722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:32.184780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:32.184839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:32.184905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:32.184945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:32.184953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:32.185013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:32.185069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:32.185130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:32.185199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:32.185245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:32.185250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:32.185314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:32.185371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:32.185530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:32.185592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:32.185639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:32.185647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:32.185761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:32.185816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:32.185876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:32.185949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:32.186004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:32.186008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:32.186075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:32.186125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:32.186189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:32.186251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:32.186375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:32.186377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:32.186442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:32.186496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:32.186554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:32.186613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:32.186651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:32.186655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:32.186740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:32.186797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:32.186853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:32.186912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:32.187048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:32.187051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:32.187118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894726146486327:2517], now have 1 active actors on pipe
2025-09-30T14:50:32.187363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894726146486327:2517]
2025-09-30T14:50:32.187387Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:32.187396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:32.187400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:32.187428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 81 reason: error at write: Disconnected sessionId: src_id|8e800e17-4827d3bb-8879d8ff-e1e14171_0
2025-09-30T14:50:32.187631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 81 sessionId: src_id|8e800e17-4827d3bb-8879d8ff-e1e14171_0 is DEAD
2025-09-30T14:50:32.187824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e800e17-4827d3bb-8879d8ff-e1e14171_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:32.187834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e800e17-4827d3bb-8879d8ff-e1e14171_0] Write session will restart in 0.007710s
2025-09-30T14:50:32.187858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e800e17-4827d3bb-8879d8ff-e1e14171_0] Write session: Do CDS request
2025-09-30T14:50:32.187863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e800e17-4827d3bb-8879d8ff-e1e14171_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:32.188139Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:32.196806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e800e17-4827d3bb-8879d8ff-e1e14171_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:32.196938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:32.196955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 82
2025-09-30T14:50:32.197067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 82 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:32.197101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 82 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:32.197112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=82 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:32.197118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:32.197532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 82 sessionId:  describe result for acl check
2025-09-30T14:50:32.197562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:32.197564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:32.197566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:32.197572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894726146486397:2987] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:32.198084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894726146486397:2987] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:32.200262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:32.200786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894726146486397:2987] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:32.201284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:32.201464Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:32.201474Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:32.201484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:32.201540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:32.201577Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894726056763528:2791]
2025-09-30T14:50:32.202267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:32.202576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:32.202618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:32.202988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:32.203062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:32.203068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:32.203070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:32.203071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:32.203072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:32.203074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:32.203075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:32.203076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:32.203077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:32.203079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:32.203080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.203081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.203083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.203084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:32.203085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:32.203091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:32.203103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:32.203107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:32.203112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:32.203116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:32.203121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:32.203126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:32.203130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:32.203134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:32.203139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:32.203143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.203148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.203152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.203157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:32.203161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:32.203168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:32.203177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:32.203183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:32.203190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:32.203195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:32.203200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:32.203206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:32.203211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:32.203217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:32.203222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:32.203231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:32.203237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:32.203267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:32.203274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:32.203279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:32.203290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:32.203295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:32.203305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:32.203310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:32.203316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:32.203326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.203333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.203340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.203346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.203355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.203361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.203366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:32.203376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:32.203380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:32.203390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:32.203440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:32.204132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894726146486397:2987] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:32.204147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894726146486397:2987] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:32.204151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894726146486397:2987] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:32.204160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 82 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:32.209007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:32.209890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:32.209904Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:32.209907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:32.209912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:32.209918Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 81 [2:7555894726056763528:2791]
2025-09-30T14:50:32.209936Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:32.209951Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:32.209959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.209963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.209966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.209981Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:32.209993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:32.210001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:32.210064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.210071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.210074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.210077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:32.210080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:32.210144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:32.210153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.210166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.210179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.210199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:32.210225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894726146486329:2454], now have 1 active actors on pipe
2025-09-30T14:50:32.210229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894726146486466:2987], now have 1 active actors on pipe
2025-09-30T14:50:32.210235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894726056763523:2791]
2025-09-30T14:50:32.210238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894726056763523:2791]
2025-09-30T14:50:32.210240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894726056763523:2791]
2025-09-30T14:50:32.210253Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:32.210267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:32.210271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:32.210271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:32.210273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:32.210246Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 81
2025-09-30T14:50:32.210286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:32.210268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 81
2025-09-30T14:50:32.210289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:32.210340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:32.210350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:32.210362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894726056763523:2791]
2025-09-30T14:50:32.210370Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:32.210382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:32.210402Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50cd8b3-f18941d-5bca3f65-9107313_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:32.210413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.210416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.210418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:32.210429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.210443Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:32.210470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:32.210661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:32.210668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:32.210682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:32.210795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 82 partition: 0 MaxSeqNo: 42 sessionId: src_id|50cd8b3-f18941d-5bca3f65-9107313_0
2025-09-30T14:50:32.211188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e800e17-4827d3bb-8879d8ff-e1e14171_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|50cd8b3-f18941d-5bca3f65-9107313_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:32.214142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50cd8b3-f18941d-5bca3f65-9107313_0] Write session: try to update token
2025-09-30T14:50:32.214165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50cd8b3-f18941d-5bca3f65-9107313_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:32.222822Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:32.222840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:32.222842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:32.222844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:32.222853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894726056763523:2791]
2025-09-30T14:50:32.222858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894726056763523:2791]
2025-09-30T14:50:32.222862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894726056763523:2791]
2025-09-30T14:50:32.222900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:32.222907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.222907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:32.222909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:32.222913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:32.222916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:32.223039Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:32.230965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 82 sessionId: src_id|50cd8b3-f18941d-5bca3f65-9107313_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:32.233891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:32.287894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894726146486473:2517]
2025-09-30T14:50:32.291472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 81, pipe: [1:7555894726146486473:2517]
2025-09-30T14:50:32.341427Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:32.342000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:32.342012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:32.342033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894726146486473:2517], now have 1 active actors on pipe
2025-09-30T14:50:32.343517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894726146486473:2517]
2025-09-30T14:50:32.343557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:32.343630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 82 reason: status is not ok: tablet will be restarted right now sessionId: src_id|50cd8b3-f18941d-5bca3f65-9107313_0
2025-09-30T14:50:32.343677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:32.343474Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:32.343812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 82 sessionId: src_id|50cd8b3-f18941d-5bca3f65-9107313_0 is DEAD
2025-09-30T14:50:32.343968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50cd8b3-f18941d-5bca3f65-9107313_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:32.343977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50cd8b3-f18941d-5bca3f65-9107313_0] Write session will restart in 0.009463s
2025-09-30T14:50:32.343996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50cd8b3-f18941d-5bca3f65-9107313_0] Write session: Do CDS request
2025-09-30T14:50:32.344001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50cd8b3-f18941d-5bca3f65-9107313_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:32.354854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50cd8b3-f18941d-5bca3f65-9107313_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:32.355501Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:32.355518Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 83
2025-09-30T14:50:32.355653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 83 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:32.355680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 83 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:32.355686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=83 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:32.355690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:32.359647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 83 sessionId:  describe result for acl check
2025-09-30T14:50:32.359684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:32.359685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:32.359688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:32.359693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894726146486490:2991] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:32.360221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894726146486490:2991] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:32.363975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894726146486490:2991] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:32.384540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894726146486490:2991] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:32.384557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894726146486490:2991] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:32.384561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894726146486490:2991] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:32.384570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 83 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:32.395777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:32.398744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:32.398986Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:32.399001Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:32.399012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:32.399073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:32.399110Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894726056763666:2793]
2025-09-30T14:50:32.399819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:32.407417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:32.407520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:32.407926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:32.408002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:32.408004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:32.408005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:32.408007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:32.408009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:32.408010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:32.408012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:32.408013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:32.408016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:32.408017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:32.408018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.408020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.408021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.408022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:32.408023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:32.408030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:32.408040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:32.408045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:32.408049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:32.408053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:32.408057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:32.408061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:32.408066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:32.408070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:32.408074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:32.408078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.408081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.408086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.408090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:32.408093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:32.408102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:32.408111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:32.408118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:32.408124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:32.408129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:32.408135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:32.408140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:32.408147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:32.408153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:32.408157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:32.408161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:32.408166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:32.408172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:32.408177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:32.408181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:32.408186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:32.408191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:32.408196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:32.408200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:32.408207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:32.408212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.408217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.408221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.408226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.408231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.408236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.408240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:32.408245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:32.408250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:32.408255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:32.408301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:32.422693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:32.424802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 82
2025-09-30T14:50:32.424846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 82
2025-09-30T14:50:32.425660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 83 partition: 0 MaxSeqNo: 42 sessionId: src_id|6a025fe5-8b203adb-84b1ce2-22df285b_0
2025-09-30T14:50:32.426551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50cd8b3-f18941d-5bca3f65-9107313_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6a025fe5-8b203adb-84b1ce2-22df285b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:32.423787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:32.423804Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:32.423807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:32.423812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:32.423820Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 82 [2:7555894726056763666:2793]
2025-09-30T14:50:32.423840Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:32.423856Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:32.423860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.423863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.423866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.423882Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:32.423889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:32.423896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:32.423966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.423968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.423969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.423974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:32.423977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:32.424047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:32.424050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.424064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.424075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.424089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:32.424107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894726056763660:2793]
2025-09-30T14:50:32.424109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894726056763660:2793]
2025-09-30T14:50:32.424111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894726056763660:2793]
2025-09-30T14:50:32.424128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:32.424142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:32.424156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:32.424159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:32.424209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894726056763660:2793]
2025-09-30T14:50:32.424211Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:32.424445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:32.424447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:32.424449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:32.424453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:32.424725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894726146486586:2991], now have 1 active actors on pipe
2025-09-30T14:50:32.424730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894726146486475:2454], now have 1 active actors on pipe
2025-09-30T14:50:32.424974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:32.424979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:32.425011Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a025fe5-8b203adb-84b1ce2-22df285b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:32.425025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.425032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.425035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:32.425046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.425058Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:32.425074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:32.425486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:32.425491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:32.425510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:32.429438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a025fe5-8b203adb-84b1ce2-22df285b_0] Write session: try to update token
2025-09-30T14:50:32.429459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a025fe5-8b203adb-84b1ce2-22df285b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:32.444016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894726146486621:2517]
2025-09-30T14:50:32.445202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 82, pipe: [1:7555894726146486621:2517]
2025-09-30T14:50:32.444920Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:32.444938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:32.444941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:32.444948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:32.444956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894726056763660:2793]
2025-09-30T14:50:32.444960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894726056763660:2793]
2025-09-30T14:50:32.444963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894726056763660:2793]
2025-09-30T14:50:32.445001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:32.445008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.445010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:32.445035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:32.445043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:32.445048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:32.445149Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:32.460830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 83 sessionId: src_id|6a025fe5-8b203adb-84b1ce2-22df285b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:32.463698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:32.563639Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:32.564026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894726146486621:2517], now have 1 active actors on pipe
2025-09-30T14:50:32.564069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:32.564076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:32.564349Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:32.564325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:32.564340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:32.564362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894726146486621:2517]
2025-09-30T14:50:32.564391Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:32.564402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 83 reason: error at write: Disconnected sessionId: src_id|6a025fe5-8b203adb-84b1ce2-22df285b_0
2025-09-30T14:50:32.564579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 83 sessionId: src_id|6a025fe5-8b203adb-84b1ce2-22df285b_0 is DEAD
2025-09-30T14:50:32.564711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a025fe5-8b203adb-84b1ce2-22df285b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:32.564719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a025fe5-8b203adb-84b1ce2-22df285b_0] Write session will restart in 0.009257s
2025-09-30T14:50:32.564741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a025fe5-8b203adb-84b1ce2-22df285b_0] Write session: Do CDS request
2025-09-30T14:50:32.564749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a025fe5-8b203adb-84b1ce2-22df285b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:32.574818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a025fe5-8b203adb-84b1ce2-22df285b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:32.574902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:32.574917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 84
2025-09-30T14:50:32.575061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 84 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:32.575095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 84 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:32.575105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=84 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:32.575110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:32.575594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 84 sessionId:  describe result for acl check
2025-09-30T14:50:32.575627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:32.575629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:32.575632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:32.575638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894726146486747:3003] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:32.575988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:32.576151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894726146486747:3003] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:32.576770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:32.576957Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:32.576967Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:32.576977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:32.577031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:32.577069Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894726056763841:2808]
2025-09-30T14:50:32.577746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:32.577887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894726146486747:3003] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:32.578012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:32.578052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:32.578334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:32.578397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:32.578403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:32.578404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:32.578405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:32.578406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:32.578407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:32.578409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:32.578410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:32.578411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:32.578413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:32.578414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.578415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.578416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.578417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:32.578418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:32.578424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:32.578434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:32.578439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:32.578444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:32.578449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:32.578453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:32.578458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:32.578462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:32.578465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:32.578470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:32.578475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.578479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.578484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.578488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:32.578495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:32.578502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:32.578514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:32.578520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:32.578525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:32.578530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:32.578535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:32.578540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:32.578545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:32.578550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:32.578560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:32.578564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:32.578570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:32.578575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:32.578585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:32.578589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:32.578595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:32.578603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:32.578608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:32.578612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:32.578618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:32.578623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.578628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.578633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.578640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.578648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.578653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.578662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:32.578668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:32.578676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:32.578682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:32.578737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:32.584042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894726146486747:3003] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:32.584058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894726146486747:3003] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:32.584061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894726146486747:3003] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:32.584070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 84 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:32.584301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:32.585492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:32.585506Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:32.585509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:32.585513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:32.585521Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 83 [2:7555894726056763841:2808]
2025-09-30T14:50:32.585537Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:32.585551Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:32.585554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.585557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.585559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.585575Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:32.585581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:32.585588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:32.585649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.585658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.585660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.585664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:32.585667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:32.585730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:32.585737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.585752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.585770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.585794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:32.585816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894726146486784:3003], now have 1 active actors on pipe
2025-09-30T14:50:32.585824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894726146486649:2454], now have 1 active actors on pipe
2025-09-30T14:50:32.585831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894726056763835:2808]
2025-09-30T14:50:32.585836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894726056763835:2808]
2025-09-30T14:50:32.585839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894726056763835:2808]
2025-09-30T14:50:32.585852Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:32.585870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:32.585877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:32.585881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:32.585883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:32.585891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:32.585875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 83
2025-09-30T14:50:32.585894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:32.585926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894726056763835:2808]
2025-09-30T14:50:32.585929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:32.585881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 83
2025-09-30T14:50:32.585931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:32.585948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:32.585959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:32.586004Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d4a960e-130c993b-2d370fa2-976ea66f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:32.586015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.586019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.586021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:32.586031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.586039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:32.586067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:32.586217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:32.586225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:32.586238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:32.586339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 84 partition: 0 MaxSeqNo: 42 sessionId: src_id|1d4a960e-130c993b-2d370fa2-976ea66f_0
2025-09-30T14:50:32.586692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a025fe5-8b203adb-84b1ce2-22df285b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1d4a960e-130c993b-2d370fa2-976ea66f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:32.589621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d4a960e-130c993b-2d370fa2-976ea66f_0] Write session: try to update token
2025-09-30T14:50:32.589640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d4a960e-130c993b-2d370fa2-976ea66f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:32.601492Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:32.601514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:32.601516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:32.601519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:32.601530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894726056763835:2808]
2025-09-30T14:50:32.601535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894726056763835:2808]
2025-09-30T14:50:32.601539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894726056763835:2808]
2025-09-30T14:50:32.601576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:32.601583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.601585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:32.601593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:32.601618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:32.601629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:32.601729Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:32.604819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 84 sessionId: src_id|1d4a960e-130c993b-2d370fa2-976ea66f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:32.607770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:32.664772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894726146486792:2517]
2025-09-30T14:50:32.665036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 83, pipe: [1:7555894726146486792:2517]
2025-09-30T14:50:32.716859Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:32.717278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:32.717290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:32.717324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894726146486792:2517], now have 1 active actors on pipe
2025-09-30T14:50:32.717598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:32.717612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:32.717612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:32.717657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894726146486792:2517]
2025-09-30T14:50:32.717688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 84 reason: error at write: Disconnected sessionId: src_id|1d4a960e-130c993b-2d370fa2-976ea66f_0
2025-09-30T14:50:32.717902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 84 sessionId: src_id|1d4a960e-130c993b-2d370fa2-976ea66f_0 is DEAD
2025-09-30T14:50:32.718488Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:32.719326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d4a960e-130c993b-2d370fa2-976ea66f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:32.719339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d4a960e-130c993b-2d370fa2-976ea66f_0] Write session will restart in 0.006856s
2025-09-30T14:50:32.719365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d4a960e-130c993b-2d370fa2-976ea66f_0] Write session: Do CDS request
2025-09-30T14:50:32.719373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d4a960e-130c993b-2d370fa2-976ea66f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:32.727820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d4a960e-130c993b-2d370fa2-976ea66f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:32.728242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:32.728258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 85
2025-09-30T14:50:32.728463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 85 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:32.728497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 85 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:32.728502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=85 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:32.728506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:32.728929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 85 sessionId:  describe result for acl check
2025-09-30T14:50:32.728961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:32.728967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:32.728969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:32.728975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894726146486895:3008] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:32.729480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894726146486895:3008] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:32.730520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:32.731715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894726146486895:3008] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:32.734914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894726146486895:3008] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:32.734932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894726146486895:3008] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:32.734936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894726146486895:3008] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:32.734945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 85 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:32.731556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:32.731747Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:32.731751Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:32.731761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:32.731813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:32.731847Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894726056763992:2811]
2025-09-30T14:50:32.732449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:32.732750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:32.732801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:32.733150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:32.733201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:32.733202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:32.733203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:32.733204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:32.733205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:32.733206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:32.733207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:32.733208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:32.733210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:32.733211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:32.733212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.733213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.733214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.733215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:32.733217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:32.733222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:32.733231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:32.733236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:32.733240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:32.733244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:32.733248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:32.733253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:32.733256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:32.733261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:32.733265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:32.733269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.733273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.733277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.733282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:32.733285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:32.733292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:32.733300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:32.733306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:32.733312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:32.733317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:32.733323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:32.733327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:32.733332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:32.733337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:32.733343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:32.733347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:32.733351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:32.733355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:32.733359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:32.733364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:32.733368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:32.733372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:32.733377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:32.733380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:32.733385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:32.733390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.733395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.733399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.733405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.733409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.733415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.733419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:32.733424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:32.733429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:32.733434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:32.733478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:32.739751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:32.740715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:32.740737Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:32.740739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:32.740743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:32.740750Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 84 [2:7555894726056763992:2811]
2025-09-30T14:50:32.740770Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:32.740786Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:32.740790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.740793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.740797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.740813Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:32.740826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:32.740833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:32.740897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.740909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.740911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.740915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:32.740917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:32.741000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:32.741010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.741026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.741045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.741071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:32.741090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894726056763987:2811]
2025-09-30T14:50:32.741092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894726056763987:2811]
2025-09-30T14:50:32.741094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894726056763987:2811]
2025-09-30T14:50:32.741113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:32.741134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:32.741147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:32.741155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:32.741159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:32.741160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:32.741162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:32.741196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894726056763987:2811]
2025-09-30T14:50:32.741206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:32.741254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:32.741390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894726146486805:2454], now have 1 active actors on pipe
2025-09-30T14:50:32.741401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894726146486945:3008], now have 1 active actors on pipe
2025-09-30T14:50:32.741609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 84
2025-09-30T14:50:32.741662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 84
2025-09-30T14:50:32.741802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:32.741813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:32.741840Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed830797-f530a9e5-f9256fba-3682c578_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:32.741850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.741854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.741857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:32.741869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.741881Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:32.741908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:32.742826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:32.742839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:32.742862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:32.742965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 85 partition: 0 MaxSeqNo: 42 sessionId: src_id|ed830797-f530a9e5-f9256fba-3682c578_0
2025-09-30T14:50:32.747362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d4a960e-130c993b-2d370fa2-976ea66f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ed830797-f530a9e5-f9256fba-3682c578_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:32.750132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed830797-f530a9e5-f9256fba-3682c578_0] Write session: try to update token
2025-09-30T14:50:32.750153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed830797-f530a9e5-f9256fba-3682c578_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:32.754489Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:32.754510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:32.754520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894726056763987:2811]
2025-09-30T14:50:32.754569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:32.754579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:32.754774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:32.754948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:32.755098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:32.755237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:32.755476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:32.755522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:32.775474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 85 sessionId: src_id|ed830797-f530a9e5-f9256fba-3682c578_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:32.778432Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:32.778454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:32.778457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:32.778459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:32.778469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894726056763987:2811]
2025-09-30T14:50:32.778473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894726056763987:2811]
2025-09-30T14:50:32.778476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894726056763987:2811]
2025-09-30T14:50:32.778517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:32.778525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.778528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:32.778559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:32.778676Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:32.778690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:32.778705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:32.778709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:32.818413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894726146486953:2517]
2025-09-30T14:50:32.820402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 84, pipe: [1:7555894726146486953:2517]
2025-09-30T14:50:32.899140Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:32.899778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:32.899798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:32.899819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894726146486953:2517], now have 1 active actors on pipe
2025-09-30T14:50:32.900120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894726146486953:2517]
2025-09-30T14:50:32.900151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:32.900234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 85 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ed830797-f530a9e5-f9256fba-3682c578_0
2025-09-30T14:50:32.900017Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:32.900472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 85 sessionId: src_id|ed830797-f530a9e5-f9256fba-3682c578_0 is DEAD
2025-09-30T14:50:32.900534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:32.900627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed830797-f530a9e5-f9256fba-3682c578_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:32.900638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed830797-f530a9e5-f9256fba-3682c578_0] Write session will restart in 0.006017s
2025-09-30T14:50:32.900677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed830797-f530a9e5-f9256fba-3682c578_0] Write session: Do CDS request
2025-09-30T14:50:32.900684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed830797-f530a9e5-f9256fba-3682c578_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:32.907644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed830797-f530a9e5-f9256fba-3682c578_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:32.907708Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:32.907726Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 86
2025-09-30T14:50:32.907886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 86 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:32.907932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 86 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:32.907943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=86 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:32.907947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:32.908437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 86 sessionId:  describe result for acl check
2025-09-30T14:50:32.908477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:32.908485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:32.908487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:32.908494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894726146486969:3012] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:32.909020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894726146486969:3012] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:32.910871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894726146486969:3012] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:32.913977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894726146486969:3012] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:32.913998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894726146486969:3012] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:32.914002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894726146486969:3012] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:32.914011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 86 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:32.914990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:32.915809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:32.916014Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:32.916018Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:32.916027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:32.916069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:32.916107Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894726056764135:2813]
2025-09-30T14:50:32.916644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:32.917003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:32.917054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:32.917403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:32.917486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:32.917487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:32.917488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:32.917489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:32.917490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:32.917491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:32.917492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:32.917493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:32.917495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:32.917496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:32.917497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.917498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.917499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.917500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:32.917502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:32.917508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:32.917518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:32.917522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:32.917526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:32.917530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:32.917534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:32.917538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:32.917542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:32.917545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:32.917550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:32.917553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.917557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.917560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.917563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:32.917566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:32.917574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:32.917583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:32.917589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:32.917594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:32.917598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:32.917603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:32.917607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:32.917612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:32.917616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:32.917622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:32.917626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:32.917631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:32.917636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:32.917642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:32.917647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:32.917652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:32.917657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:32.917662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:32.917666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:32.917671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:32.917676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.917681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.917685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.917690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.917695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.917699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.917705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:32.917709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:32.917713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:32.917718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:32.917763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:32.923374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:32.924297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:32.924318Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:32.924322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:32.924325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:32.924333Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 85 [2:7555894726056764135:2813]
2025-09-30T14:50:32.924351Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:32.924367Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:32.924370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.924373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.924375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.924392Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:32.924404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:32.924411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:32.924475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.924483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.924485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.924489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:32.924492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:32.924561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:32.924569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.924582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:32.924595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:32.924617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:32.924636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894726056764130:2813]
2025-09-30T14:50:32.924638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894726056764130:2813]
2025-09-30T14:50:32.924641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894726056764130:2813]
2025-09-30T14:50:32.924652Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:32.924668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894726146487088:3012], now have 1 active actors on pipe
2025-09-30T14:50:32.924668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:32.924671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:32.924672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894726146486955:2454], now have 1 active actors on pipe
2025-09-30T14:50:32.924674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:32.924679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:32.924693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:32.924697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:32.924730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894726056764130:2813]
2025-09-30T14:50:32.924739Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:32.924746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:32.924714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 85
2025-09-30T14:50:32.924777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 85
2025-09-30T14:50:32.924797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:32.924807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:32.924835Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d68312c-8160834f-52f49ed2-76e6d7a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:32.924848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.924852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.924854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:32.924866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.924875Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:32.924897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:32.925060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:32.925068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:32.925082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:32.925182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 86 partition: 0 MaxSeqNo: 42 sessionId: src_id|d68312c-8160834f-52f49ed2-76e6d7a9_0
2025-09-30T14:50:32.925534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed830797-f530a9e5-f9256fba-3682c578_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d68312c-8160834f-52f49ed2-76e6d7a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:32.928489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d68312c-8160834f-52f49ed2-76e6d7a9_0] Write session: try to update token
2025-09-30T14:50:32.928512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d68312c-8160834f-52f49ed2-76e6d7a9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:32.936781Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:32.936799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:32.936810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894726056764130:2813]
2025-09-30T14:50:32.936856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:32.936859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:32.937032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:32.937190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:32.937333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:32.937487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:32.937704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:32.937752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:32.943666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 86 sessionId: src_id|d68312c-8160834f-52f49ed2-76e6d7a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:32.946387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:32.946607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:32.946628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:32.946675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:32.946786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:32.947977Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:32.947992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:32.947995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:32.947997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:32.948007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894726056764130:2813]
2025-09-30T14:50:32.948011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894726056764130:2813]
2025-09-30T14:50:32.948015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894726056764130:2813]
2025-09-30T14:50:32.948052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:32.948058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:32.948061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:32.948063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:32.948069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:32.948076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:32.948244Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:33.000130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894730441454408:2517]
2025-09-30T14:50:33.000432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 85, pipe: [1:7555894730441454408:2517]
2025-09-30T14:50:33.060344Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:33.068789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:33.068822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:33.069012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:33.069086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:33.069159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:33.069233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:33.069287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:33.069299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:33.069378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:33.069449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:33.069520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:33.069590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:33.069638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:33.069649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:33.069720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:33.069785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:33.069901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:33.069972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:33.070019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:33.070027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:33.070097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:33.070212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:33.070307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:33.070377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:33.070422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:33.070431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:33.070503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:33.070573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:33.070670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:33.070756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:33.070806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:33.070816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:33.070892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:33.070958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:33.071031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:33.071094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:33.071136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:33.071139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:33.071215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:33.071342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:33.071436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:33.071505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:33.071553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:33.071561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:33.071634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:33.071704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:33.071775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:33.071840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:33.071907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:33.071917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:33.071987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:33.072057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:33.072123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:33.072192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:33.072241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:33.072250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:33.072321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:33.072387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:33.072453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:33.072523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:33.072592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:33.072602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:33.072665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894730441454408:2517], now have 1 active actors on pipe
2025-09-30T14:50:33.072918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:33.072932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:33.072963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 86 reason: error at write: Disconnected sessionId: src_id|d68312c-8160834f-52f49ed2-76e6d7a9_0
2025-09-30T14:50:33.073005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894730441454408:2517]
2025-09-30T14:50:33.073036Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:33.073217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 86 sessionId: src_id|d68312c-8160834f-52f49ed2-76e6d7a9_0 is DEAD
2025-09-30T14:50:33.073311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68312c-8160834f-52f49ed2-76e6d7a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:33.073323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68312c-8160834f-52f49ed2-76e6d7a9_0] Write session will restart in 0.008748s
2025-09-30T14:50:33.073351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68312c-8160834f-52f49ed2-76e6d7a9_0] Write session: Do CDS request
2025-09-30T14:50:33.073358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68312c-8160834f-52f49ed2-76e6d7a9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:33.073729Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:33.083845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d68312c-8160834f-52f49ed2-76e6d7a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:33.083928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:33.084174Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:33.084190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 87
2025-09-30T14:50:33.084321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 87 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:33.084352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 87 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:33.084364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=87 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:33.084378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:33.084833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 87 sessionId:  describe result for acl check
2025-09-30T14:50:33.084868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:33.084874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:33.084876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:33.084883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894730441454519:3020] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:33.084990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:33.085184Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:33.085194Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:33.085205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:33.085252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:33.085289Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894730351731573:2816]
2025-09-30T14:50:33.085412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894730441454519:3020] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:33.085855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:33.086214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:33.086272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:33.086551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:33.086610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:33.086616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:33.086617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:33.086618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:33.086619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:33.086620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:33.086622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:33.086623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:33.086624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:33.086625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:33.086626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.086626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.086627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.086628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:33.086629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:33.086633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:33.086639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:33.086641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:33.086644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:33.086646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:33.086648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:33.086650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:33.086653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:33.086655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:33.086658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:33.086660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.086662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.086664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.086667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:33.086669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:33.086674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:33.086679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:33.086683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:33.086687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:33.086689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:33.086692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:33.086711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:33.086714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:33.086717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:33.086720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:33.086722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:33.086726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:33.086731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:33.086737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:33.086741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:33.086746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:33.086751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:33.086755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:33.086760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:33.086766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:33.086770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.086775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.086780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.086785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.086788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.086791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.086794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:33.086796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:33.086800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:33.086803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:33.086826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:33.087740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894730441454519:3020] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:33.092117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894730441454519:3020] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:33.092146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894730441454519:3020] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:33.092150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894730441454519:3020] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:33.092163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 87 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:33.092538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:33.093477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:33.093496Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:33.093499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:33.093503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:33.093511Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 86 [2:7555894730351731573:2816]
2025-09-30T14:50:33.093529Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:33.093546Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:33.093556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.093559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.093561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.093576Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:33.093588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:33.093596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:33.093668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.093677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.093679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.093682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:33.093685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:33.093755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:33.093765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.093779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.093790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.093807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:33.093829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894730441454415:2454], now have 1 active actors on pipe
2025-09-30T14:50:33.093838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894730441454557:3020], now have 1 active actors on pipe
2025-09-30T14:50:33.093844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894730351731567:2816]
2025-09-30T14:50:33.093847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894730351731567:2816]
2025-09-30T14:50:33.093849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894730351731567:2816]
2025-09-30T14:50:33.093862Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:33.093880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:33.093881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:33.093887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:33.093870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 86
2025-09-30T14:50:33.093890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:33.093896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:33.093899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:33.093935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894730351731567:2816]
2025-09-30T14:50:33.093928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 86
2025-09-30T14:50:33.093943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:33.093945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:33.093963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:33.093972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:33.094020Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38ec7a75-e7642005-816ef88e-db565e66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:33.094032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.094035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.094038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:33.094048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.094063Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:33.094087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:33.094243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:33.094257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:33.094284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:33.094399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 87 partition: 0 MaxSeqNo: 42 sessionId: src_id|38ec7a75-e7642005-816ef88e-db565e66_0
2025-09-30T14:50:33.094795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68312c-8160834f-52f49ed2-76e6d7a9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|38ec7a75-e7642005-816ef88e-db565e66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:33.097760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38ec7a75-e7642005-816ef88e-db565e66_0] Write session: try to update token
2025-09-30T14:50:33.097781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38ec7a75-e7642005-816ef88e-db565e66_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:33.106350Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:33.106367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:33.106370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:33.106372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:33.106382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894730351731567:2816]
2025-09-30T14:50:33.106387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894730351731567:2816]
2025-09-30T14:50:33.106391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894730351731567:2816]
2025-09-30T14:50:33.106432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:33.106440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.106439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:33.106446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:33.106448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:33.106450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:33.106579Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:33.113307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 87 sessionId: src_id|38ec7a75-e7642005-816ef88e-db565e66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:33.116246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:33.173198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894730441454565:2517]
2025-09-30T14:50:33.173587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 86, pipe: [1:7555894730441454565:2517]
2025-09-30T14:50:33.222543Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:33.223093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:33.223103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:33.223124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894730441454565:2517], now have 1 active actors on pipe
2025-09-30T14:50:33.223397Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:33.223873Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:33.223929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894730441454565:2517]
2025-09-30T14:50:33.223967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:33.224045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 87 reason: status is not ok: tablet will be restarted right now sessionId: src_id|38ec7a75-e7642005-816ef88e-db565e66_0
2025-09-30T14:50:33.224222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 87 sessionId: src_id|38ec7a75-e7642005-816ef88e-db565e66_0 is DEAD
2025-09-30T14:50:33.227659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38ec7a75-e7642005-816ef88e-db565e66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:33.227676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38ec7a75-e7642005-816ef88e-db565e66_0] Write session will restart in 0.005431s
2025-09-30T14:50:33.227701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38ec7a75-e7642005-816ef88e-db565e66_0] Write session: Do CDS request
2025-09-30T14:50:33.227707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38ec7a75-e7642005-816ef88e-db565e66_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:33.234796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38ec7a75-e7642005-816ef88e-db565e66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:33.235162Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:33.235177Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 88
2025-09-30T14:50:33.235451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 88 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:33.235496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 88 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:33.235506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=88 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:33.235510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:33.235936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 88 sessionId:  describe result for acl check
2025-09-30T14:50:33.235978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:33.235985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:33.235987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:33.235993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894730441454645:3024] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:33.236552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894730441454645:3024] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:33.238035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:33.238774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:33.238975Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:33.238985Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:33.238975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894730441454645:3024] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:33.239003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:33.239063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:33.239099Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894730351731713:2818]
2025-09-30T14:50:33.239730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:33.240106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:33.240163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:33.240543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:33.240609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:33.240615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:33.240616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:33.240617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:33.240618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:33.240619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:33.240621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:33.240622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:33.240623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:33.240624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:33.240625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.240627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.240628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.240630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:33.240631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:33.240638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:33.240648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:33.240653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:33.240657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:33.240662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:33.240666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:33.240670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:33.240675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:33.240679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:33.240684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:33.240688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.240693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.240697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.240701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:33.240705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:33.240714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:33.240723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:33.240733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:33.240739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:33.240749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:33.240755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:33.240763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:33.240769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:33.240774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:33.240787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:33.240792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:33.240797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:33.240803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:33.240809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:33.240814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:33.240820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:33.240830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:33.240848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:33.240857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:33.240863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:33.240868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.240874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.240879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.240884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.240895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.240901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.240910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:33.240916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:33.240923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:33.240928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:33.240990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:33.241685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894730441454645:3024] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:33.241700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894730441454645:3024] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:33.241705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894730441454645:3024] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:33.241714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 88 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:33.246671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:33.247650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:33.247666Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:33.247669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:33.247674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:33.247681Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 87 [2:7555894730351731713:2818]
2025-09-30T14:50:33.247699Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:33.247722Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:33.247730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.247734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.247736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.247754Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:33.247765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:33.247774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:33.247840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.247847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.247849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.247854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:33.247857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:33.247922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:33.247929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.247942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.247959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.247980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:33.248003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894730441454708:3024], now have 1 active actors on pipe
2025-09-30T14:50:33.248013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894730441454566:2454], now have 1 active actors on pipe
2025-09-30T14:50:33.248019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894730351731708:2818]
2025-09-30T14:50:33.248021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894730351731708:2818]
2025-09-30T14:50:33.248023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894730351731708:2818]
2025-09-30T14:50:33.248035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:33.248047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:33.248049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:33.248053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:33.248055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:33.248061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:33.248065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:33.248100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894730351731708:2818]
2025-09-30T14:50:33.248113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:33.248099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 87
2025-09-30T14:50:33.248110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 87
2025-09-30T14:50:33.248143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:33.248206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:33.248220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:33.248261Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c344792-edb04afa-591adc92-59a585dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:33.248275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.248283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.248286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:33.248296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.248314Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:33.248350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:33.248495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:33.248508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:33.248525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:33.248641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 88 partition: 0 MaxSeqNo: 42 sessionId: src_id|9c344792-edb04afa-591adc92-59a585dc_0
2025-09-30T14:50:33.249045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38ec7a75-e7642005-816ef88e-db565e66_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9c344792-edb04afa-591adc92-59a585dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:33.251878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c344792-edb04afa-591adc92-59a585dc_0] Write session: try to update token
2025-09-30T14:50:33.251904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c344792-edb04afa-591adc92-59a585dc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:33.260073Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:33.260095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:33.260107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894730351731708:2818]
2025-09-30T14:50:33.260153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:33.260164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:33.260317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:33.260478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:33.260649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:33.260845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:33.261186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:33.261227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:33.267237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 88 sessionId: src_id|9c344792-edb04afa-591adc92-59a585dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:33.269888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:33.270266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:33.270290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:33.270329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:33.270422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:33.271981Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:33.271998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:33.272001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:33.272003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:33.272014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894730351731708:2818]
2025-09-30T14:50:33.272018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894730351731708:2818]
2025-09-30T14:50:33.272022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894730351731708:2818]
2025-09-30T14:50:33.272066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:33.272081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.272088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:33.272227Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:33.275307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:33.275325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:33.275333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:33.323736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894730441454716:2517]
2025-09-30T14:50:33.324077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 87, pipe: [1:7555894730441454716:2517]
2025-09-30T14:50:33.393505Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:33.401451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:33.401482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:33.401653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:33.401717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:33.401786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:33.401854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:33.401901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:33.401913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:33.401982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:33.402046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:33.402123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:33.402202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:33.402251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:33.402259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:33.402335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:33.402403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:33.402501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:33.402572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:33.402619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:33.402629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:33.402724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:33.402802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:33.402869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:33.402933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:33.402981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:33.402989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:33.403063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:33.403132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:33.403204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:33.403293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:33.403341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:33.403349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:33.403425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:33.403493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:33.403572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:33.403646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:33.403719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:33.403731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:33.403846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:33.403906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:33.403999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:33.404069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:33.404117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:33.404125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:33.404192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:33.404269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:33.404344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:33.404417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:33.404457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:33.404465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:33.404536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:33.404603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:33.404670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:33.404740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:33.404790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:33.404797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:33.404870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:33.404942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:33.405013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:33.405083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:33.405132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:33.405140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:33.405210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894730441454716:2517], now have 1 active actors on pipe
2025-09-30T14:50:33.405402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894730441454716:2517]
2025-09-30T14:50:33.405407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:33.405411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:33.405434Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:33.405440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 88 reason: error at write: Disconnected sessionId: src_id|9c344792-edb04afa-591adc92-59a585dc_0
2025-09-30T14:50:33.405639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 88 sessionId: src_id|9c344792-edb04afa-591adc92-59a585dc_0 is DEAD
2025-09-30T14:50:33.405802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c344792-edb04afa-591adc92-59a585dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:33.405810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c344792-edb04afa-591adc92-59a585dc_0] Write session will restart in 0.006412s
2025-09-30T14:50:33.405833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c344792-edb04afa-591adc92-59a585dc_0] Write session: Do CDS request
2025-09-30T14:50:33.405839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c344792-edb04afa-591adc92-59a585dc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:33.406245Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:33.413806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c344792-edb04afa-591adc92-59a585dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:33.413825Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:33.413842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 89
2025-09-30T14:50:33.414035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 89 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:33.414088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 89 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:33.414099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=89 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:33.414108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:33.414541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 89 sessionId:  describe result for acl check
2025-09-30T14:50:33.414570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:33.414577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:33.414578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:33.414584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894730441454796:3028] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:33.415100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894730441454796:3028] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:33.416460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:33.417089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:33.417308Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:33.417321Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:33.417332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:33.417382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:33.417421Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894730351731858:2820]
2025-09-30T14:50:33.417650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894730441454796:3028] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:33.418059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:33.418439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:33.418508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:33.418882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:33.418947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:33.418954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:33.418955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:33.418956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:33.418957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:33.418958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:33.418959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:33.418971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:33.418973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:33.418974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:33.418975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.418976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.418978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.418978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:33.418979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:33.418986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:33.418995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:33.418999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:33.419003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:33.419007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:33.419011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:33.419015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:33.419019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:33.419023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:33.419027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:33.419031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.419035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.419039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.419043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:33.419047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:33.419054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:33.419063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:33.419069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:33.419076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:33.419081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:33.419087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:33.419091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:33.419097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:33.419101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:33.419106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:33.419111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:33.419116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:33.419122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:33.419127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:33.419131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:33.419137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:33.419148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:33.419153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:33.419162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:33.419177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:33.419186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.419191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.419196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.419200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.419204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.419208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.419212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:33.419217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:33.419233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:33.419268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:33.419317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:33.424785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894730441454796:3028] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:33.424803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894730441454796:3028] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:33.424806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894730441454796:3028] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:33.424818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 89 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:33.425007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:33.425899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:33.425917Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:33.425919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:33.425924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:33.425931Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 88 [2:7555894730351731858:2820]
2025-09-30T14:50:33.425947Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:33.425962Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:33.425965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.425967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.425970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.425985Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:33.425991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:33.425998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:33.426052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.426059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.426061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.426064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:33.426067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:33.426128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:33.426135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.426147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.426161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.426181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:33.426202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894730441454718:2454], now have 1 active actors on pipe
2025-09-30T14:50:33.426210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894730441454862:3028], now have 1 active actors on pipe
2025-09-30T14:50:33.426217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894730351731852:2820]
2025-09-30T14:50:33.426219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894730351731852:2820]
2025-09-30T14:50:33.426221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894730351731852:2820]
2025-09-30T14:50:33.426232Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:33.426246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:33.426249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:33.426256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:33.426259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:33.426263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:33.426266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:33.426266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 88
2025-09-30T14:50:33.426286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 88
2025-09-30T14:50:33.426297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894730351731852:2820]
2025-09-30T14:50:33.426305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:33.426307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:33.426322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:33.426326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:33.426372Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49dd40dc-6d1f35f0-4c5867ed-9b836164_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:33.426383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.426386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.426388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:33.426396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.426411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:33.426431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:33.426624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:33.426632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:33.426646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:33.426741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 89 partition: 0 MaxSeqNo: 42 sessionId: src_id|49dd40dc-6d1f35f0-4c5867ed-9b836164_0
2025-09-30T14:50:33.427119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c344792-edb04afa-591adc92-59a585dc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|49dd40dc-6d1f35f0-4c5867ed-9b836164_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:33.429836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49dd40dc-6d1f35f0-4c5867ed-9b836164_0] Write session: try to update token
2025-09-30T14:50:33.429853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49dd40dc-6d1f35f0-4c5867ed-9b836164_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:33.438995Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:33.439016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:33.439018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:33.439020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:33.439031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894730351731852:2820]
2025-09-30T14:50:33.439036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894730351731852:2820]
2025-09-30T14:50:33.439040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894730351731852:2820]
2025-09-30T14:50:33.439076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:33.439082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.439086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:33.439086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:33.439092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:33.439097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:33.439218Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:33.447052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 89 sessionId: src_id|49dd40dc-6d1f35f0-4c5867ed-9b836164_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:33.449681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:33.505447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894730441454871:2517]
2025-09-30T14:50:33.505749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 88, pipe: [1:7555894730441454871:2517]
2025-09-30T14:50:33.553352Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:33.553821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:33.553842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:33.553862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894730441454871:2517], now have 1 active actors on pipe
2025-09-30T14:50:33.554098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:33.554111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:33.554126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894730441454871:2517]
2025-09-30T14:50:33.554143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:33.554177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 89 reason: error at write: Disconnected sessionId: src_id|49dd40dc-6d1f35f0-4c5867ed-9b836164_0
2025-09-30T14:50:33.554077Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:33.554352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 89 sessionId: src_id|49dd40dc-6d1f35f0-4c5867ed-9b836164_0 is DEAD
2025-09-30T14:50:33.554496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49dd40dc-6d1f35f0-4c5867ed-9b836164_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:33.554504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49dd40dc-6d1f35f0-4c5867ed-9b836164_0] Write session will restart in 0.008575s
2025-09-30T14:50:33.554527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49dd40dc-6d1f35f0-4c5867ed-9b836164_0] Write session: Do CDS request
2025-09-30T14:50:33.554534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49dd40dc-6d1f35f0-4c5867ed-9b836164_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:33.564876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49dd40dc-6d1f35f0-4c5867ed-9b836164_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:33.566932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:33.567322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:33.567340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 90
2025-09-30T14:50:33.567520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 90 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:33.567566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 90 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:33.567575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=90 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:33.567579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:33.567918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:33.568027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 90 sessionId:  describe result for acl check
2025-09-30T14:50:33.568072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:33.568078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:33.568080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:33.568085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894730441454990:3039] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:33.568159Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:33.568172Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:33.568184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:33.568248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:33.568287Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894730351732016:2823]
2025-09-30T14:50:33.568557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894730441454990:3039] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:33.568894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:33.569203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:33.569253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:33.569585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:33.569674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:33.569680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:33.569681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:33.569682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:33.569684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:33.569685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:33.569686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:33.569687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:33.569688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:33.569690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:33.569691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.569692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.569693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.569694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:33.569695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:33.569701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:33.569711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:33.569714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:33.569718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:33.569722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:33.569726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:33.569730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:33.569733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:33.569737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:33.569742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:33.569745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.569749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.569753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.569757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:33.569761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:33.569768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:33.569777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:33.569783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:33.569789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:33.569794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:33.569800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:33.569804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:33.569809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:33.569816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:33.569821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:33.569826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:33.569831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:33.569835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:33.569839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:33.569851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:33.569855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:33.569860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:33.569866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:33.569870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:33.569876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:33.569881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.569887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.569891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.569897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.569902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.569908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.569912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:33.569918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:33.569923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:33.569929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:33.569976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:33.570953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894730441454990:3039] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:33.575240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894730441454990:3039] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:33.575273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894730441454990:3039] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:33.575277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894730441454990:3039] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:33.575285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 90 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:33.575650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:33.576684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:33.576701Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:33.576704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:33.576708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:33.576715Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 89 [2:7555894730351732016:2823]
2025-09-30T14:50:33.576729Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:33.576745Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:33.576748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.576751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.576754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.576768Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:33.576783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:33.576790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:33.576844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.576852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.576854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.576857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:33.576860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:33.576925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:33.576931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.576945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.576959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.576978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:33.577000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894730441455027:3039], now have 1 active actors on pipe
2025-09-30T14:50:33.577008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894730441454872:2454], now have 1 active actors on pipe
2025-09-30T14:50:33.577014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894730351732010:2823]
2025-09-30T14:50:33.577017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894730351732010:2823]
2025-09-30T14:50:33.577019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894730351732010:2823]
2025-09-30T14:50:33.577031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:33.577043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:33.577053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:33.577056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:33.577058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:33.577061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:33.577063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:33.577098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894730351732010:2823]
2025-09-30T14:50:33.577109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:33.577091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 89
2025-09-30T14:50:33.577121Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 89
2025-09-30T14:50:33.577123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:33.577219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:33.577233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:33.577259Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8cd35a17-8b13d01e-20d6395f-727ac89c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:33.577266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.577270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.577272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:33.577281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.577292Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:33.577315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:33.577471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:33.577479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:33.577492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:33.577575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 90 partition: 0 MaxSeqNo: 42 sessionId: src_id|8cd35a17-8b13d01e-20d6395f-727ac89c_0
2025-09-30T14:50:33.577944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49dd40dc-6d1f35f0-4c5867ed-9b836164_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8cd35a17-8b13d01e-20d6395f-727ac89c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:33.580855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cd35a17-8b13d01e-20d6395f-727ac89c_0] Write session: try to update token
2025-09-30T14:50:33.580873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cd35a17-8b13d01e-20d6395f-727ac89c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:33.589580Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:33.589597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:33.589599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:33.589601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:33.589610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894730351732010:2823]
2025-09-30T14:50:33.589614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894730351732010:2823]
2025-09-30T14:50:33.589617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894730351732010:2823]
2025-09-30T14:50:33.589658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:33.589664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.589667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:33.589679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:33.589694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:33.589701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:33.589803Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:33.595572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 90 sessionId: src_id|8cd35a17-8b13d01e-20d6395f-727ac89c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:33.598467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:33.654542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894730441455045:2517]
2025-09-30T14:50:33.654843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 89, pipe: [1:7555894730441455045:2517]
2025-09-30T14:50:33.705059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:33.705066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:33.705070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:33.705115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894730441455045:2517]
2025-09-30T14:50:33.705134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 90 reason: error at write: Disconnected sessionId: src_id|8cd35a17-8b13d01e-20d6395f-727ac89c_0
2025-09-30T14:50:33.705311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 90 sessionId: src_id|8cd35a17-8b13d01e-20d6395f-727ac89c_0 is DEAD
2025-09-30T14:50:33.704275Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:33.704699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:33.704711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:33.704751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894730441455045:2517], now have 1 active actors on pipe
2025-09-30T14:50:33.705188Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:33.705626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cd35a17-8b13d01e-20d6395f-727ac89c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:33.705635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cd35a17-8b13d01e-20d6395f-727ac89c_0] Write session will restart in 0.005263s
2025-09-30T14:50:33.705658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cd35a17-8b13d01e-20d6395f-727ac89c_0] Write session: Do CDS request
2025-09-30T14:50:33.705664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cd35a17-8b13d01e-20d6395f-727ac89c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:33.711724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cd35a17-8b13d01e-20d6395f-727ac89c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:33.711820Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:33.711835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 91
2025-09-30T14:50:33.711970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 91 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:33.712002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 91 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:33.712012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=91 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:33.712016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:33.712713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 91 sessionId:  describe result for acl check
2025-09-30T14:50:33.712748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:33.712763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:33.712769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:33.712775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894730441455085:3045] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:33.713296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894730441455085:3045] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:33.715857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894730441455085:3045] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:33.716863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:33.717646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:33.717831Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:33.717847Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:33.717858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:33.717917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:33.717960Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894730351732195:2838]
2025-09-30T14:50:33.718483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:33.718576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894730441455085:3045] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:33.718588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894730441455085:3045] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:33.718592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894730441455085:3045] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:33.718599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 91 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:33.718771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:33.718815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:33.719138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:33.719195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:33.719201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:33.719202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:33.719203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:33.719204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:33.719205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:33.719207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:33.719208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:33.719209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:33.719210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:33.719211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.719212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.719213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.719214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:33.719216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:33.719221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:33.719231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:33.719235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:33.719240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:33.719263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:33.719267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:33.719271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:33.719275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:33.719279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:33.719284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:33.719288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.719292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.719296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.719300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:33.719304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:33.719310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:33.719321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:33.719328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:33.719334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:33.719339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:33.719345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:33.719350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:33.719355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:33.719360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:33.719365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:33.719370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:33.719375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:33.719380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:33.719385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:33.719390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:33.719395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:33.719407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:33.719412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:33.719417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:33.719422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:33.719427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.719432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.719437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.719444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.719448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.719453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.719456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:33.719459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:33.719462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:33.719465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:33.719488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:33.727071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 90
2025-09-30T14:50:33.727078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 90
2025-09-30T14:50:33.725501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:33.726668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:33.726674Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:33.726677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:33.726680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:33.726688Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 90 [2:7555894730351732195:2838]
2025-09-30T14:50:33.726716Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:33.726730Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:33.726734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.726737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.726740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.726758Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:33.726765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:33.726772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:33.726827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.726830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.726832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.726836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:33.726838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:33.726908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:33.726911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.726923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.726935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.726953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:33.726970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894730441455201:3045], now have 1 active actors on pipe
2025-09-30T14:50:33.726974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894730441455058:2454], now have 1 active actors on pipe
2025-09-30T14:50:33.726980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894730351732190:2838]
2025-09-30T14:50:33.726982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894730351732190:2838]
2025-09-30T14:50:33.726984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894730351732190:2838]
2025-09-30T14:50:33.726998Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:33.727010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:33.727025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:33.727028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:33.727030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:33.727034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:33.727036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:33.727061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894730351732190:2838]
2025-09-30T14:50:33.727068Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:33.727085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:33.727163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:33.727171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:33.727199Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|595e9239-aff078b-19002158-10c69cff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:33.727206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.727210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.727213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:33.727225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.727236Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:33.727273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:33.727467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:33.727477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:33.727493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:33.727580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 91 partition: 0 MaxSeqNo: 42 sessionId: src_id|595e9239-aff078b-19002158-10c69cff_0
2025-09-30T14:50:33.727948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cd35a17-8b13d01e-20d6395f-727ac89c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|595e9239-aff078b-19002158-10c69cff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:33.730539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|595e9239-aff078b-19002158-10c69cff_0] Write session: try to update token
2025-09-30T14:50:33.730556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|595e9239-aff078b-19002158-10c69cff_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:33.739458Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:33.739478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:33.739489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894730351732190:2838]
2025-09-30T14:50:33.739539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:33.739538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:33.739720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:33.739866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:33.740015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:33.740167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:33.740363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:33.740404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:33.746497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 91 sessionId: src_id|595e9239-aff078b-19002158-10c69cff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:33.749195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:33.749356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:33.749378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:33.749414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:33.749494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:33.753173Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:33.753190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:33.753192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:33.753193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:33.753203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894730351732190:2838]
2025-09-30T14:50:33.753206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894730351732190:2838]
2025-09-30T14:50:33.753209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894730351732190:2838]
2025-09-30T14:50:33.753251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:33.753259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.753261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:33.753264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:33.753268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:33.753276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:33.753395Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:33.805507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894730441455211:2517]
2025-09-30T14:50:33.805843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 90, pipe: [1:7555894730441455211:2517]
2025-09-30T14:50:33.866745Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:33.875450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:33.875479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:33.875657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:33.875730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:33.875805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:33.875882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:33.875931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:33.875944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:33.876020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:33.876088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:33.876160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:33.876231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:33.876278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:33.876286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:33.876360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:33.876426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:33.876494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:33.876624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:33.876681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:33.876689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:33.876758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:33.876828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:33.877029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:33.877106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:33.877156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:33.877163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:33.877242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:33.877320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:33.877394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:33.877470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:33.877541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:33.877551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:33.877623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:33.877690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:33.877761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:33.877837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:33.877908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:33.877916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:33.877989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:33.878054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:33.878188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:33.878343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:33.878428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:33.878442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:33.878529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:33.878604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:33.878679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:33.878764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:33.878814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:33.878821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:33.878893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:33.878962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:33.879036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:33.879112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:33.879177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:33.879181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:33.879283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:33.879369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:33.879441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:33.879508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:33.879571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:33.879579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:33.879655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894730441455211:2517], now have 1 active actors on pipe
2025-09-30T14:50:33.879949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:33.879952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894730441455211:2517]
2025-09-30T14:50:33.879985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:33.879988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:33.880016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 91 reason: error at write: Disconnected sessionId: src_id|595e9239-aff078b-19002158-10c69cff_0
2025-09-30T14:50:33.880217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 91 sessionId: src_id|595e9239-aff078b-19002158-10c69cff_0 is DEAD
2025-09-30T14:50:33.880375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|595e9239-aff078b-19002158-10c69cff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:33.880385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|595e9239-aff078b-19002158-10c69cff_0] Write session will restart in 0.005887s
2025-09-30T14:50:33.880408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|595e9239-aff078b-19002158-10c69cff_0] Write session: Do CDS request
2025-09-30T14:50:33.880422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|595e9239-aff078b-19002158-10c69cff_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:33.880893Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:33.887743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|595e9239-aff078b-19002158-10c69cff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:33.887843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:33.887858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 92
2025-09-30T14:50:33.888022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 92 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:33.888051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 92 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:33.888056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=92 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:33.888060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:33.888455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 92 sessionId:  describe result for acl check
2025-09-30T14:50:33.888487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:33.888493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:33.888495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:33.888501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894730441455229:3049] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:33.889006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894730441455229:3049] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:33.892221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894730441455229:3049] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:33.893486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:33.894198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:33.894379Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:33.894390Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:33.894402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:33.894455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:33.894496Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894730351732340:2840]
2025-09-30T14:50:33.895183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:33.895467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:33.895472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894730441455229:3049] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:33.895496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894730441455229:3049] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:33.895499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894730441455229:3049] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:33.895510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 92 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:33.895511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:33.895851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:33.895912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:33.895920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:33.895921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:33.895922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:33.895924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:33.895925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:33.895926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:33.895928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:33.895929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:33.895930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:33.895931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.895933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.895934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.895935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:33.895936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:33.895941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:33.895952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:33.895957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:33.895961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:33.895965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:33.895970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:33.895974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:33.895979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:33.895983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:33.895988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:33.895992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.895997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.896001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.896006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:33.896010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:33.896017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:33.896025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:33.896032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:33.896038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:33.896049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:33.896054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:33.896064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:33.896071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:33.896080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:33.896086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:33.896091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:33.896097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:33.896102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:33.896108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:33.896112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:33.896117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:33.896122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:33.896128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:33.896138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:33.896144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:33.896148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.896158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.896162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.896168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.896177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.896183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.896187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:33.896193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:33.896199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:33.896204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:33.896255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:33.901941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:33.902818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:33.902833Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:33.902836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:33.902839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:33.902846Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 91 [2:7555894730351732340:2840]
2025-09-30T14:50:33.902863Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:33.902886Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:33.902890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.902893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.902896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.902911Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:33.902919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:33.902926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:33.902985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.902992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.902995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.903000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:33.903003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:33.903067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:33.903074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.903086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:33.903102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:33.903125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:33.903143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894730441455212:2454], now have 1 active actors on pipe
2025-09-30T14:50:33.903151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894730441455357:3049], now have 1 active actors on pipe
2025-09-30T14:50:33.903157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894730351732335:2840]
2025-09-30T14:50:33.903160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894730351732335:2840]
2025-09-30T14:50:33.903161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894730351732335:2840]
2025-09-30T14:50:33.903173Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:33.903190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:33.903190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:33.903192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:33.903196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:33.903209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:33.903212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:33.903207Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 91
2025-09-30T14:50:33.903263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894730351732335:2840]
2025-09-30T14:50:33.903274Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:33.903208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 91
2025-09-30T14:50:33.903281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:33.903294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:33.903299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:33.903349Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce3e40ce-b1c9fbda-547d38dc-250f4449_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:33.903357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.903361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.903363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:33.903371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.903379Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:33.903408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:33.903554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:33.903562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:33.903575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:33.903661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 92 partition: 0 MaxSeqNo: 42 sessionId: src_id|ce3e40ce-b1c9fbda-547d38dc-250f4449_0
2025-09-30T14:50:33.904010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|595e9239-aff078b-19002158-10c69cff_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ce3e40ce-b1c9fbda-547d38dc-250f4449_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:33.907000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce3e40ce-b1c9fbda-547d38dc-250f4449_0] Write session: try to update token
2025-09-30T14:50:33.907019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce3e40ce-b1c9fbda-547d38dc-250f4449_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:33.915690Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:33.915710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:33.915713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:33.915715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:33.915724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894730351732335:2840]
2025-09-30T14:50:33.915729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894730351732335:2840]
2025-09-30T14:50:33.915732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894730351732335:2840]
2025-09-30T14:50:33.915776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:33.915783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:33.915786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:33.915787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:33.915795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:33.915800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:33.915927Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:33.921895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 92 sessionId: src_id|ce3e40ce-b1c9fbda-547d38dc-250f4449_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:33.924684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:33.980894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894730441455378:2517]
2025-09-30T14:50:33.981178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 91, pipe: [1:7555894730441455378:2517]
2025-09-30T14:50:34.030709Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:34.031255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:34.031274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:34.031313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894730441455378:2517], now have 1 active actors on pipe
2025-09-30T14:50:34.031566Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:34.031566Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:34.031585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894730441455378:2517]
2025-09-30T14:50:34.031608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:34.031749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 92 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ce3e40ce-b1c9fbda-547d38dc-250f4449_0
2025-09-30T14:50:34.031934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 92 sessionId: src_id|ce3e40ce-b1c9fbda-547d38dc-250f4449_0 is DEAD
2025-09-30T14:50:34.032122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce3e40ce-b1c9fbda-547d38dc-250f4449_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:34.032130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce3e40ce-b1c9fbda-547d38dc-250f4449_0] Write session will restart in 0.007003s
2025-09-30T14:50:34.032153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce3e40ce-b1c9fbda-547d38dc-250f4449_0] Write session: Do CDS request
2025-09-30T14:50:34.032158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce3e40ce-b1c9fbda-547d38dc-250f4449_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:34.040773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce3e40ce-b1c9fbda-547d38dc-250f4449_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:34.040937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:34.040953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 93
2025-09-30T14:50:34.041206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 93 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:34.041244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 93 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:34.041249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=93 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:34.041253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:34.041680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 93 sessionId:  describe result for acl check
2025-09-30T14:50:34.041717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:34.041725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:34.041727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:34.041732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894734736422749:3055] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:34.042306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894734736422749:3055] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:34.043718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:34.044447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:34.044520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894734736422749:3055] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:34.044620Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:34.044629Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:34.044638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:34.044682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:34.044717Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894734646699784:2843]
2025-09-30T14:50:34.045252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:34.045474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:34.045506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:34.045782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:34.045844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:34.045850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:34.045851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:34.045852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:34.045853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:34.045854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:34.045855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:34.045856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:34.045857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:34.045858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:34.045859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.045860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.045861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.045861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:34.045862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:34.045867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:34.045875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:34.045879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:34.045883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:34.045886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:34.045889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:34.045893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:34.045897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:34.045901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:34.045904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:34.045907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.045910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.045913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.045916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:34.045919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:34.045926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:34.045933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:34.045939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:34.045943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:34.045947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:34.045952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:34.045955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:34.045960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:34.045965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:34.045969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:34.045973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:34.045977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:34.045982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:34.045986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:34.045990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:34.045996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:34.046007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:34.046012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:34.046017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:34.046025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:34.046030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.046039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.046043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.046047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.046056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.046060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.046063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:34.046067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:34.046076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:34.046080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:34.046127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:34.046946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894734736422749:3055] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:34.046958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894734736422749:3055] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:34.046961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894734736422749:3055] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:34.046968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 93 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:34.051734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:34.053572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:34.053585Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:34.053587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:34.053590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:34.053597Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 92 [2:7555894734646699784:2843]
2025-09-30T14:50:34.053614Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:34.053630Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:34.053632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.053634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.053637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.053650Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:34.053655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:34.053661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:34.053718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.053727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.053730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.053733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:34.053736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:34.053809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:34.053816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.053825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.053832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.053841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:34.053860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894734646699779:2843]
2025-09-30T14:50:34.053868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894734646699779:2843]
2025-09-30T14:50:34.053871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894734646699779:2843]
2025-09-30T14:50:34.053883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:34.053896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894734736422678:2454], now have 1 active actors on pipe
2025-09-30T14:50:34.053900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894734736422825:3055], now have 1 active actors on pipe
2025-09-30T14:50:34.053908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:34.053907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:34.053911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:34.053913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:34.053922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:34.053924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:34.053952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894734646699779:2843]
2025-09-30T14:50:34.053960Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:34.053967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:34.053974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 92
2025-09-30T14:50:34.053975Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 92
2025-09-30T14:50:34.054010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:34.054017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:34.054040Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9767e3a4-9222f17c-a5123c4a-2b018353_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:34.054048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.054051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.054053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:34.054060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.054066Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:34.054081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:34.054223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:34.054230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:34.054243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:34.054354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 93 partition: 0 MaxSeqNo: 42 sessionId: src_id|9767e3a4-9222f17c-a5123c4a-2b018353_0
2025-09-30T14:50:34.054753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce3e40ce-b1c9fbda-547d38dc-250f4449_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9767e3a4-9222f17c-a5123c4a-2b018353_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:34.062729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9767e3a4-9222f17c-a5123c4a-2b018353_0] Write session: try to update token
2025-09-30T14:50:34.062752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9767e3a4-9222f17c-a5123c4a-2b018353_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:34.071209Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:34.071229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:34.071239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894734646699779:2843]
2025-09-30T14:50:34.071305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:34.071308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:34.071480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:34.071791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:34.071936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:34.072079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:34.072276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:34.072322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:34.078485Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:34.078510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:34.078512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:34.078514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:34.078524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894734646699779:2843]
2025-09-30T14:50:34.078529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894734646699779:2843]
2025-09-30T14:50:34.078533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894734646699779:2843]
2025-09-30T14:50:34.078572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:34.078573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:34.078576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:34.078581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.078581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:34.078584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:34.079587Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:34.083732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 93 sessionId: src_id|9767e3a4-9222f17c-a5123c4a-2b018353_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:34.086362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:34.131639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894734736422833:2517]
2025-09-30T14:50:34.131924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 92, pipe: [1:7555894734736422833:2517]
2025-09-30T14:50:34.193297Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:34.193628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:34.193644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:34.193666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894734736422833:2517], now have 1 active actors on pipe
2025-09-30T14:50:34.193895Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:34.193909Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:34.193925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894734736422833:2517]
2025-09-30T14:50:34.193943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:34.193946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:34.194005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 93 reason: error at write: Disconnected sessionId: src_id|9767e3a4-9222f17c-a5123c4a-2b018353_0
2025-09-30T14:50:34.194179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 93 sessionId: src_id|9767e3a4-9222f17c-a5123c4a-2b018353_0 is DEAD
2025-09-30T14:50:34.194324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9767e3a4-9222f17c-a5123c4a-2b018353_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:34.194335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9767e3a4-9222f17c-a5123c4a-2b018353_0] Write session will restart in 0.007748s
2025-09-30T14:50:34.194359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9767e3a4-9222f17c-a5123c4a-2b018353_0] Write session: Do CDS request
2025-09-30T14:50:34.194365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9767e3a4-9222f17c-a5123c4a-2b018353_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:34.203770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9767e3a4-9222f17c-a5123c4a-2b018353_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:34.203859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:34.203874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 94
2025-09-30T14:50:34.204027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 94 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:34.204061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 94 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:34.204067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=94 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:34.204071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:34.204522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 94 sessionId:  describe result for acl check
2025-09-30T14:50:34.204561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:34.204583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:34.204585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:34.204592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894734736422940:3059] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:34.205174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894734736422940:3059] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:34.205684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:34.206536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:34.206745Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:34.206755Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:34.206765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:34.206825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:34.206865Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894734646699931:2845]
2025-09-30T14:50:34.207322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894734736422940:3059] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:34.207525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:34.207859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:34.207920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:34.208264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:34.208339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:34.208345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:34.208347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:34.208348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:34.208349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:34.208350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:34.208352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:34.208353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:34.208354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:34.208355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:34.208356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.208357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.208358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.208359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:34.208361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:34.208366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:34.208376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:34.208379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:34.208383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:34.208386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:34.208390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:34.208394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:34.208398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:34.208401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:34.208407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:34.208410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.208414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.208417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.208421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:34.208424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:34.208432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:34.208439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:34.208445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:34.208451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:34.208454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:34.208459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:34.208464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:34.208469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:34.208474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:34.208478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:34.208482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:34.208487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:34.208492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:34.208497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:34.208501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:34.208506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:34.208510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:34.208514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:34.208518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:34.208522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:34.208527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.208532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.208536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.208540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.208544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.208550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.208554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:34.208559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:34.208563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:34.208567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:34.208608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:34.213877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894734736422940:3059] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:34.213893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894734736422940:3059] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:34.213901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894734736422940:3059] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:34.213910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 94 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:34.214205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:34.215425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:34.215444Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:34.215447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:34.215451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:34.215460Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 93 [2:7555894734646699931:2845]
2025-09-30T14:50:34.215477Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:34.215493Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:34.215497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.215502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.215505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.215522Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:34.215529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:34.215536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:34.215608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.215616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.215618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.215622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:34.215625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:34.215691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:34.215703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.215718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.215730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.215748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:34.215774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894734736422982:3059], now have 1 active actors on pipe
2025-09-30T14:50:34.215782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894734736422834:2454], now have 1 active actors on pipe
2025-09-30T14:50:34.215788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894734646699926:2845]
2025-09-30T14:50:34.215791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894734646699926:2845]
2025-09-30T14:50:34.215793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894734646699926:2845]
2025-09-30T14:50:34.215805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:34.215819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:34.215822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:34.215823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:34.215825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:34.215839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:34.215849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:34.215883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894734646699926:2845]
2025-09-30T14:50:34.215898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:34.215871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 93
2025-09-30T14:50:34.215905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:34.215875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 93
2025-09-30T14:50:34.215943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:34.215956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:34.215991Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cba3dbac-359a06f2-185c95f9-f0ef6db2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:34.216002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.216005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.216008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:34.216017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.216027Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:34.216042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:34.216232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:34.216245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:34.216270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:34.216368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 94 partition: 0 MaxSeqNo: 42 sessionId: src_id|cba3dbac-359a06f2-185c95f9-f0ef6db2_0
2025-09-30T14:50:34.216744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9767e3a4-9222f17c-a5123c4a-2b018353_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cba3dbac-359a06f2-185c95f9-f0ef6db2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:34.219580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cba3dbac-359a06f2-185c95f9-f0ef6db2_0] Write session: try to update token
2025-09-30T14:50:34.219601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cba3dbac-359a06f2-185c95f9-f0ef6db2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:34.228383Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:34.228401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:34.228404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:34.228406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:34.228415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894734646699926:2845]
2025-09-30T14:50:34.228420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894734646699926:2845]
2025-09-30T14:50:34.228424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894734646699926:2845]
2025-09-30T14:50:34.228468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:34.228481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.228480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:34.228483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:34.228488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:34.228492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:34.228638Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:34.240824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 94 sessionId: src_id|cba3dbac-359a06f2-185c95f9-f0ef6db2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:34.244059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:34.293955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894734736422989:2517]
2025-09-30T14:50:34.294224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 93, pipe: [1:7555894734736422989:2517]
2025-09-30T14:50:34.342849Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:34.343174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:34.343190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:34.343210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894734736422989:2517], now have 1 active actors on pipe
2025-09-30T14:50:34.343476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:34.343487Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:34.343495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:34.343533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894734736422989:2517]
2025-09-30T14:50:34.343581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 94 reason: error at write: Disconnected sessionId: src_id|cba3dbac-359a06f2-185c95f9-f0ef6db2_0
2025-09-30T14:50:34.343790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 94 sessionId: src_id|cba3dbac-359a06f2-185c95f9-f0ef6db2_0 is DEAD
2025-09-30T14:50:34.343943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cba3dbac-359a06f2-185c95f9-f0ef6db2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:34.343953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cba3dbac-359a06f2-185c95f9-f0ef6db2_0] Write session will restart in 0.008910s
2025-09-30T14:50:34.343975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cba3dbac-359a06f2-185c95f9-f0ef6db2_0] Write session: Do CDS request
2025-09-30T14:50:34.343992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cba3dbac-359a06f2-185c95f9-f0ef6db2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:34.344029Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:34.353830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cba3dbac-359a06f2-185c95f9-f0ef6db2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:34.353924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:34.353940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 95
2025-09-30T14:50:34.354046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 95 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:34.354073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 95 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:34.354079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=95 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:34.354084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:34.354491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 95 sessionId:  describe result for acl check
2025-09-30T14:50:34.354519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:34.354521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:34.354523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:34.354529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894734736423088:3063] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:34.355061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894734736423088:3063] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:34.356653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:34.357071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894734736423088:3063] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:34.360408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:34.360507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894734736423088:3063] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:34.360522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894734736423088:3063] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:34.360526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894734736423088:3063] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:34.360534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 95 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:34.360629Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:34.360641Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:34.360651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:34.360713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:34.360760Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894734646700079:2847]
2025-09-30T14:50:34.361416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:34.361715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:34.361762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:34.362078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:34.362158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:34.362167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:34.362168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:34.362169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:34.362171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:34.362173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:34.362174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:34.362175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:34.362177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:34.362178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:34.362179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.362180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.362181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.362182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:34.362184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:34.362190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:34.362200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:34.362205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:34.362208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:34.362212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:34.362215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:34.362219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:34.362223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:34.362226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:34.362230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:34.362234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.362237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.362240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.362249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:34.362253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:34.362271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:34.362279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:34.362286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:34.362293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:34.362297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:34.362308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:34.362313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:34.362319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:34.362324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:34.362329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:34.362333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:34.362338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:34.362342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:34.362347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:34.362352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:34.362358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:34.362364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:34.362378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:34.362383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:34.362393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:34.362398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.362403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.362411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.362416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.362420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.362425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.362433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:34.362438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:34.362443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:34.362448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:34.362492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:34.368076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:34.369048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:34.369068Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:34.369071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:34.369075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:34.369083Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 94 [2:7555894734646700079:2847]
2025-09-30T14:50:34.369099Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:34.369121Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:34.369125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.369128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.369131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.369146Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:34.369158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:34.369164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:34.369224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.369232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.369234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.369238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:34.369241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:34.369292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:34.369298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.369307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.369313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.369326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:34.369342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894734646700074:2847]
2025-09-30T14:50:34.369347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894734646700074:2847]
2025-09-30T14:50:34.369349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894734646700074:2847]
2025-09-30T14:50:34.369354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:34.369364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:34.369364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:34.369368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:34.369370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:34.369373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:34.369375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:34.369383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894734736423136:3063], now have 1 active actors on pipe
2025-09-30T14:50:34.369385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894734736422991:2454], now have 1 active actors on pipe
2025-09-30T14:50:34.369412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894734646700074:2847]
2025-09-30T14:50:34.369424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:34.369479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 94
2025-09-30T14:50:34.369470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:34.369481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 94
2025-09-30T14:50:34.369607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:34.369618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:34.369641Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55cc6d4f-fb7efb1c-c6495d71-cbcca943_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:34.369647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.369655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.369661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:34.369671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.369685Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:34.369706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:34.369863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:34.369873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:34.369889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:34.369983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 95 partition: 0 MaxSeqNo: 42 sessionId: src_id|55cc6d4f-fb7efb1c-c6495d71-cbcca943_0
2025-09-30T14:50:34.370346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cba3dbac-359a06f2-185c95f9-f0ef6db2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|55cc6d4f-fb7efb1c-c6495d71-cbcca943_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:34.373224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55cc6d4f-fb7efb1c-c6495d71-cbcca943_0] Write session: try to update token
2025-09-30T14:50:34.373241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55cc6d4f-fb7efb1c-c6495d71-cbcca943_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:34.381920Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:34.381940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:34.381949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894734646700074:2847]
2025-09-30T14:50:34.381995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:34.382389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:34.382776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:34.383298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:34.383319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:34.383652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:34.384135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:34.384191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:34.389627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 95 sessionId: src_id|55cc6d4f-fb7efb1c-c6495d71-cbcca943_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:34.392313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:34.395317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:34.395345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:34.395384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:34.395518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:34.399401Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:34.399417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:34.399419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:34.399421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:34.399432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894734646700074:2847]
2025-09-30T14:50:34.399436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894734646700074:2847]
2025-09-30T14:50:34.399440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894734646700074:2847]
2025-09-30T14:50:34.399478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:34.399484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.399484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:34.399487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:34.399495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:34.399499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:34.399617Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:34.443457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894734736423149:2517]
2025-09-30T14:50:34.443769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 94, pipe: [1:7555894734736423149:2517]
2025-09-30T14:50:34.517325Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:34.528760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:34.528800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:34.529101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:34.529333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:34.529406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:34.529473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:34.529662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:34.529677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:34.530076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:34.530601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:34.530680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:34.530811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:34.530954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:34.530967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:34.531049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:34.531115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:34.531191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:34.531694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:34.531874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:34.531882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:34.532546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:34.532815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:34.533077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:34.533194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:34.533246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:34.533259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:34.533375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:34.533449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:34.533544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:34.533789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:34.533922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:34.533940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:34.534177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:34.534431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:34.534707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:34.534965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:34.535098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:34.535104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:34.538968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894734736423149:2517]
2025-09-30T14:50:34.539026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:34.539028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:34.539118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 95 reason: error at write: Disconnected sessionId: src_id|55cc6d4f-fb7efb1c-c6495d71-cbcca943_0
2025-09-30T14:50:34.535456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:34.539265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:34.535711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:34.535812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:34.535873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:34.535933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:34.535939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:34.536037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:34.536294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:34.536567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:34.536634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:34.536766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:34.536773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:34.536847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:34.537083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:34.537323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:34.537582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:34.537710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:34.537716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:34.537977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:34.538076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:34.538138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:34.538202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:34.538343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:34.538346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:34.538434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894734736423149:2517], now have 1 active actors on pipe
2025-09-30T14:50:34.539378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 95 sessionId: src_id|55cc6d4f-fb7efb1c-c6495d71-cbcca943_0 is DEAD
2025-09-30T14:50:34.539997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55cc6d4f-fb7efb1c-c6495d71-cbcca943_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:34.540026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55cc6d4f-fb7efb1c-c6495d71-cbcca943_0] Write session will restart in 0.008351s
2025-09-30T14:50:34.540063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55cc6d4f-fb7efb1c-c6495d71-cbcca943_0] Write session: Do CDS request
2025-09-30T14:50:34.540071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55cc6d4f-fb7efb1c-c6495d71-cbcca943_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:34.540374Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:34.549873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55cc6d4f-fb7efb1c-c6495d71-cbcca943_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:34.550009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:34.550034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 96
2025-09-30T14:50:34.550932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 96 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:34.550975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 96 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:34.550983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=96 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:34.550988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:34.551881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 96 sessionId:  describe result for acl check
2025-09-30T14:50:34.551944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:34.551951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:34.551953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:34.551959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894734736423166:3068] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:34.552675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894734736423166:3068] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:34.556001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894734736423166:3068] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:34.560341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894734736423166:3068] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:34.560356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894734736423166:3068] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:34.560379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894734736423166:3068] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:34.560388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 96 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:34.561376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:34.562190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:34.562451Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:34.562462Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:34.562473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:34.562531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:34.562572Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894734646700231:2850]
2025-09-30T14:50:34.563279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:34.563647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:34.563712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:34.564126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:34.564201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:34.564202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:34.564203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:34.564204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:34.564205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:34.564206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:34.564207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:34.564208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:34.564209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:34.564211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:34.564211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.564212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.564213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.564215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:34.564216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:34.564221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:34.564232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:34.564236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:34.564240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:34.564245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:34.564249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:34.564253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:34.564257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:34.564261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:34.564264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:34.564267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.564271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.564274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.564278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:34.564282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:34.564291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:34.564298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:34.564303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:34.564308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:34.564313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:34.564317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:34.564321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:34.564326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:34.564331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:34.564336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:34.564344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:34.564349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:34.564353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:34.564359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:34.564363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:34.564368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:34.564373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:34.564379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:34.564383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:34.564389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:34.564393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.564399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.564403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.564408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.564413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.564419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.564423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:34.564429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:34.564434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:34.564439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:34.564482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:34.570514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:34.571581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:34.571599Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:34.571602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:34.571606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:34.571613Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 95 [2:7555894734646700231:2850]
2025-09-30T14:50:34.571632Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:34.571650Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:34.571653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.571657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.571659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.571675Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:34.571683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:34.571689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:34.571761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.571770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.571772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.571775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:34.571778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:34.571882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:34.571885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.571898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.571908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.571923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:34.571940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894734646700226:2850]
2025-09-30T14:50:34.571942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894734646700226:2850]
2025-09-30T14:50:34.571945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894734646700226:2850]
2025-09-30T14:50:34.571960Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:34.571975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:34.571988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:34.571991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:34.572027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894734646700226:2850]
2025-09-30T14:50:34.572029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:34.572178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:34.572189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:34.572191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:34.572196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:34.572207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894734736423152:2454], now have 1 active actors on pipe
2025-09-30T14:50:34.572214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894734736423295:3068], now have 1 active actors on pipe
2025-09-30T14:50:34.572283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 95
2025-09-30T14:50:34.572283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 95
2025-09-30T14:50:34.572368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:34.572381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:34.572407Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8882cbd-e1b81cad-7400c8cc-3051739c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:34.572415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.572425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.572428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:34.572437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.572447Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:34.572460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:34.572600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:34.572608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:34.572621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:34.572759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 96 partition: 0 MaxSeqNo: 42 sessionId: src_id|b8882cbd-e1b81cad-7400c8cc-3051739c_0
2025-09-30T14:50:34.573233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55cc6d4f-fb7efb1c-c6495d71-cbcca943_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b8882cbd-e1b81cad-7400c8cc-3051739c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:34.578536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8882cbd-e1b81cad-7400c8cc-3051739c_0] Write session: try to update token
2025-09-30T14:50:34.578555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8882cbd-e1b81cad-7400c8cc-3051739c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:34.587522Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:34.587538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:34.587548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894734646700226:2850]
2025-09-30T14:50:34.587596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:34.587625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:34.587789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:34.587936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:34.588085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:34.588420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:34.588623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:34.588663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:34.598256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 96 sessionId: src_id|b8882cbd-e1b81cad-7400c8cc-3051739c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:34.598323Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:34.598342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:34.598344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:34.598346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:34.598354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894734646700226:2850]
2025-09-30T14:50:34.598357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894734646700226:2850]
2025-09-30T14:50:34.598360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894734646700226:2850]
2025-09-30T14:50:34.598392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:34.598397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.598399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:34.598410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:34.598421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:34.598440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:34.598816Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:34.601023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:34.639043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894734736423323:2517]
2025-09-30T14:50:34.639686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 95, pipe: [1:7555894734736423323:2517]
2025-09-30T14:50:34.712265Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:34.712620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:34.712634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:34.712654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894734736423323:2517], now have 1 active actors on pipe
2025-09-30T14:50:34.712949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:34.712980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894734736423323:2517]
2025-09-30T14:50:34.712988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:34.712990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:34.713049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 96 reason: error at write: Disconnected sessionId: src_id|b8882cbd-e1b81cad-7400c8cc-3051739c_0
2025-09-30T14:50:34.713210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 96 sessionId: src_id|b8882cbd-e1b81cad-7400c8cc-3051739c_0 is DEAD
2025-09-30T14:50:34.712881Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:34.715566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8882cbd-e1b81cad-7400c8cc-3051739c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:34.715576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8882cbd-e1b81cad-7400c8cc-3051739c_0] Write session will restart in 0.007644s
2025-09-30T14:50:34.715599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8882cbd-e1b81cad-7400c8cc-3051739c_0] Write session: Do CDS request
2025-09-30T14:50:34.715605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8882cbd-e1b81cad-7400c8cc-3051739c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:34.725137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8882cbd-e1b81cad-7400c8cc-3051739c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:34.725594Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:34.725607Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 97
2025-09-30T14:50:34.725777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 97 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:34.725805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 97 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:34.725811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=97 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:34.725814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:34.726148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 97 sessionId:  describe result for acl check
2025-09-30T14:50:34.726173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:34.726178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:34.726179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:34.726183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894734736423435:3080] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:34.726610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894734736423435:3080] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:34.728779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894734736423435:3080] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:34.729614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:34.735773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:34.735992Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:34.736003Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:34.736013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:34.736073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:34.736109Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894734646700429:2865]
2025-09-30T14:50:34.736435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894734736423435:3080] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:34.736451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894734736423435:3080] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:34.736454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894734736423435:3080] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:34.736463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 97 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:34.736749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:34.737069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:34.737115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:34.737477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:34.737541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:34.737548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:34.737549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:34.737550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:34.737552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:34.737553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:34.737555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:34.737556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:34.737557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:34.737559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:34.737560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.737562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.737563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.737564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:34.737565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:34.737571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:34.737582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:34.737587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:34.737592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:34.737597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:34.737601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:34.737606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:34.737610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:34.737614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:34.737618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:34.737622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.737627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.737632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.737637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:34.737641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:34.737649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:34.737657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:34.737668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:34.737675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:34.737684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:34.737690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:34.737697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:34.737702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:34.737711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:34.737717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:34.737727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:34.737733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:34.737738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:34.737744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:34.737748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:34.737754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:34.737758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:34.737768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:34.737773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:34.737779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:34.737788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.737793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.737798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.737803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.737808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.737814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.737822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:34.737828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:34.737837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:34.737843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:34.737892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:34.745614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:34.746485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:34.746501Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:34.746504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:34.746508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:34.746516Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 96 [2:7555894734646700429:2865]
2025-09-30T14:50:34.746533Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:34.746549Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:34.746557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.746561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.746563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.746579Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:34.746586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:34.746594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:34.746653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.746662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.746665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.746668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:34.746671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:34.746747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:34.746755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.746785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.746807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.746831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:34.746855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894734736423492:3080], now have 1 active actors on pipe
2025-09-30T14:50:34.746863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894734736423345:2454], now have 1 active actors on pipe
2025-09-30T14:50:34.746869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894734646700424:2865]
2025-09-30T14:50:34.746876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894734646700424:2865]
2025-09-30T14:50:34.746878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894734646700424:2865]
2025-09-30T14:50:34.746894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:34.746908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:34.746929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:34.746938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:34.746928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 96
2025-09-30T14:50:34.746932Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 96
2025-09-30T14:50:34.746973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894734646700424:2865]
2025-09-30T14:50:34.746981Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:34.747046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:34.747053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:34.747055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:34.747060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:34.747211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:34.747229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:34.747301Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22380240-f6e84296-1b50dd56-4f0d60e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:34.747309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.747313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.747315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:34.747325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.747337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:34.747353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:34.747537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:34.747552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:34.747573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:34.747648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 97 partition: 0 MaxSeqNo: 42 sessionId: src_id|22380240-f6e84296-1b50dd56-4f0d60e4_0
2025-09-30T14:50:34.748031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8882cbd-e1b81cad-7400c8cc-3051739c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|22380240-f6e84296-1b50dd56-4f0d60e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:34.750854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22380240-f6e84296-1b50dd56-4f0d60e4_0] Write session: try to update token
2025-09-30T14:50:34.750872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22380240-f6e84296-1b50dd56-4f0d60e4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:34.766656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 97 sessionId: src_id|22380240-f6e84296-1b50dd56-4f0d60e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:34.763534Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:34.763553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:34.763556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:34.763559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:34.763569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894734646700424:2865]
2025-09-30T14:50:34.763574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894734646700424:2865]
2025-09-30T14:50:34.763577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894734646700424:2865]
2025-09-30T14:50:34.763623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:34.763631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.763634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:34.763625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:34.763645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:34.763650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:34.763818Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:34.769421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:34.813100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894734736423505:2517]
2025-09-30T14:50:34.813530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 96, pipe: [1:7555894734736423505:2517]
2025-09-30T14:50:34.881533Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:34.882043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:34.882054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:34.882092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894734736423505:2517], now have 1 active actors on pipe
2025-09-30T14:50:34.882428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894734736423505:2517]
2025-09-30T14:50:34.882436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:34.882441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:34.882459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:34.882450Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:34.882504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 97 reason: error at write: Disconnected sessionId: src_id|22380240-f6e84296-1b50dd56-4f0d60e4_0
2025-09-30T14:50:34.882709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 97 sessionId: src_id|22380240-f6e84296-1b50dd56-4f0d60e4_0 is DEAD
2025-09-30T14:50:34.882883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22380240-f6e84296-1b50dd56-4f0d60e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:34.882894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22380240-f6e84296-1b50dd56-4f0d60e4_0] Write session will restart in 0.008500s
2025-09-30T14:50:34.882932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22380240-f6e84296-1b50dd56-4f0d60e4_0] Write session: Do CDS request
2025-09-30T14:50:34.882941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22380240-f6e84296-1b50dd56-4f0d60e4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:34.892739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22380240-f6e84296-1b50dd56-4f0d60e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:34.895389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:34.895408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 98
2025-09-30T14:50:34.899374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 98 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:34.899437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 98 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:34.899451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=98 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:34.899463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:34.899994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 98 sessionId:  describe result for acl check
2025-09-30T14:50:34.900049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:34.900056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:34.900058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:34.900065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894734736423537:3084] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:34.900691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894734736423537:3084] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:34.904313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894734736423537:3084] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:34.907842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894734736423537:3084] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:34.907861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894734736423537:3084] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:34.907867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894734736423537:3084] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:34.907892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 98 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:34.911487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:34.912676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:34.912863Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:34.912867Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:34.912877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:34.912925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:34.912958Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894734646700582:2867]
2025-09-30T14:50:34.913602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:34.913979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:34.914043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:34.914433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:34.914499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:34.914506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:34.914507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:34.914508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:34.914509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:34.914510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:34.914511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:34.914513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:34.914514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:34.914515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:34.914516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.914517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.914519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.914520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:34.914521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:34.914527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:34.914536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:34.914540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:34.914544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:34.914548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:34.914552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:34.914557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:34.914561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:34.914565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:34.914570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:34.914581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.914586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.914590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.914594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:34.914598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:34.914606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:34.914614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:34.914621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:34.914627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:34.914631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:34.914637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:34.914642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:34.914648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:34.914653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:34.914659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:34.914664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:34.914670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:34.914681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:34.914717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:34.914728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:34.914734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:34.914739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:34.914749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:34.914758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:34.914768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:34.914773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.914779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.914783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.914789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.914800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.914810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.914819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:34.914825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:34.914832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:34.914842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:34.914891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:34.922027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:34.922959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:34.922976Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:34.922979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:34.922984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:34.922990Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 97 [2:7555894734646700582:2867]
2025-09-30T14:50:34.923008Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:34.923025Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:34.923028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.923032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.923034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.923050Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:34.923063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:34.923070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:34.923134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.923148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.923150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.923154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:34.923157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:34.923229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:34.923237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.923299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:34.923317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:34.923337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:34.923361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894734736423506:2454], now have 1 active actors on pipe
2025-09-30T14:50:34.923369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894734736423641:3084], now have 1 active actors on pipe
2025-09-30T14:50:34.923375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894734646700576:2867]
2025-09-30T14:50:34.923377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894734646700576:2867]
2025-09-30T14:50:34.923379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894734646700576:2867]
2025-09-30T14:50:34.923396Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:34.923416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:34.923419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:34.923424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:34.923400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 97
2025-09-30T14:50:34.923427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:34.923419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 97
2025-09-30T14:50:34.923435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:34.923440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:34.923476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894734646700576:2867]
2025-09-30T14:50:34.923490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:34.923496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:34.923507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:34.923516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:34.923566Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f37dece6-ef50a0fc-fc7026c7-54b800ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:34.923577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.923582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.923584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:34.923592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.923607Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:34.923634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:34.923888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:34.923897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:34.923912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:34.923994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 98 partition: 0 MaxSeqNo: 42 sessionId: src_id|f37dece6-ef50a0fc-fc7026c7-54b800ef_0
2025-09-30T14:50:34.924344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22380240-f6e84296-1b50dd56-4f0d60e4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f37dece6-ef50a0fc-fc7026c7-54b800ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:34.927236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f37dece6-ef50a0fc-fc7026c7-54b800ef_0] Write session: try to update token
2025-09-30T14:50:34.927278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f37dece6-ef50a0fc-fc7026c7-54b800ef_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:34.942999Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:34.943020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:34.943023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:34.943025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:34.943034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894734646700576:2867]
2025-09-30T14:50:34.943040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894734646700576:2867]
2025-09-30T14:50:34.943045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894734646700576:2867]
2025-09-30T14:50:34.943091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:34.943099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:34.943102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:34.943139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:34.943146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:34.943150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:34.943238Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:34.947723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 98 sessionId: src_id|f37dece6-ef50a0fc-fc7026c7-54b800ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:34.950752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:34.982586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894734736423674:2517]
2025-09-30T14:50:34.982903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 97, pipe: [1:7555894734736423674:2517]
2025-09-30T14:50:35.065846Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:35.066192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:35.066207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:35.066247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894734736423674:2517], now have 1 active actors on pipe
2025-09-30T14:50:35.066518Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:35.066660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:35.066730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894734736423674:2517]
2025-09-30T14:50:35.066748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:35.066842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 98 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f37dece6-ef50a0fc-fc7026c7-54b800ef_0
2025-09-30T14:50:35.067021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 98 sessionId: src_id|f37dece6-ef50a0fc-fc7026c7-54b800ef_0 is DEAD
2025-09-30T14:50:35.067213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f37dece6-ef50a0fc-fc7026c7-54b800ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:35.067224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f37dece6-ef50a0fc-fc7026c7-54b800ef_0] Write session will restart in 0.009829s
2025-09-30T14:50:35.067281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f37dece6-ef50a0fc-fc7026c7-54b800ef_0] Write session: Do CDS request
2025-09-30T14:50:35.067290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f37dece6-ef50a0fc-fc7026c7-54b800ef_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:35.078849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f37dece6-ef50a0fc-fc7026c7-54b800ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:35.079319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:35.079340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 99
2025-09-30T14:50:35.079505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 99 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:35.079545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 99 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:35.079553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=99 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:35.079558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:35.080082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 99 sessionId:  describe result for acl check
2025-09-30T14:50:35.080117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:35.080119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:35.080121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:35.080126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894739031391087:3090] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:35.080848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894739031391087:3090] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:35.082888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894739031391087:3090] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:35.083074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:35.084807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:35.085023Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:35.085034Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:35.085045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:35.085105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:35.085143Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894738941668033:2870]
2025-09-30T14:50:35.085777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:35.086044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:35.086087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:35.086398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:35.086477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:35.086484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:35.086486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:35.086487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:35.086488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:35.086490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:35.086491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:35.086492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:35.086494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:35.086495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:35.086496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.086497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.086498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.086499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:35.086500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:35.086506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:35.086515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:35.086519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:35.086522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:35.086526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:35.086530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:35.086533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:35.086537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:35.086541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:35.086544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:35.086548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.086551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.086555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.086558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:35.086562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:35.086569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:35.086576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:35.086582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:35.086587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:35.086593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:35.086598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:35.086028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894739031391087:3090] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:35.086602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:35.086042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894739031391087:3090] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:35.086607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:35.086045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894739031391087:3090] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:35.086611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:35.086616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:35.086620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:35.086625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:35.086053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 99 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:35.086629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:35.086634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:35.086639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:35.086644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:35.086649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:35.086655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:35.086659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:35.086664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:35.086669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.086675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.086680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.086685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.086705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.086710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.086715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:35.086720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:35.086725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:35.086731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:35.086779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:35.097820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:35.098807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:35.098823Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:35.098827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:35.098831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:35.098839Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 98 [2:7555894738941668033:2870]
2025-09-30T14:50:35.098857Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:35.098874Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:35.098881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.098884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.098887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.098903Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:35.098916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:35.098927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:35.098995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.099002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.099004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.099008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:35.099011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:35.099078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:35.099086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.099099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.099117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.099138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:35.099163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894739031390974:2454], now have 1 active actors on pipe
2025-09-30T14:50:35.099167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894739031391126:3090], now have 1 active actors on pipe
2025-09-30T14:50:35.099173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894738941668027:2870]
2025-09-30T14:50:35.099176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894738941668027:2870]
2025-09-30T14:50:35.099178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894738941668027:2870]
2025-09-30T14:50:35.099197Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:35.099212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:35.099212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:35.099216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:35.099218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:35.099233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:35.099236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:35.099291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894738941668027:2870]
2025-09-30T14:50:35.099302Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:35.099292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 98
2025-09-30T14:50:35.099336Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 98
2025-09-30T14:50:35.099323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:35.099337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:35.099343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:35.099370Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|510d123a-1a31e844-15986830-212d5f81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:35.099381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.099390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.099392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:35.099402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.099414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:35.099441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:35.099636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:35.099644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:35.099659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:35.099755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 99 partition: 0 MaxSeqNo: 42 sessionId: src_id|510d123a-1a31e844-15986830-212d5f81_0
2025-09-30T14:50:35.100147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f37dece6-ef50a0fc-fc7026c7-54b800ef_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|510d123a-1a31e844-15986830-212d5f81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:35.102930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|510d123a-1a31e844-15986830-212d5f81_0] Write session: try to update token
2025-09-30T14:50:35.102948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|510d123a-1a31e844-15986830-212d5f81_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:35.116912Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:35.116936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:35.116939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:35.116941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:35.116952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894738941668027:2870]
2025-09-30T14:50:35.116957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894738941668027:2870]
2025-09-30T14:50:35.116961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894738941668027:2870]
2025-09-30T14:50:35.117002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:35.117014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.117016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:35.117178Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:35.119425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:35.119439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:35.119448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:35.119602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 99 sessionId: src_id|510d123a-1a31e844-15986830-212d5f81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:35.122412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:35.166910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894739031391136:2517]
2025-09-30T14:50:35.167391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 98, pipe: [1:7555894739031391136:2517]
2025-09-30T14:50:35.234061Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:35.234668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:35.234698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:35.234738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894739031391136:2517], now have 1 active actors on pipe
2025-09-30T14:50:35.234995Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:35.235546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:35.235601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894739031391136:2517]
2025-09-30T14:50:35.235621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:35.235700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 99 reason: status is not ok: tablet will be restarted right now sessionId: src_id|510d123a-1a31e844-15986830-212d5f81_0
2025-09-30T14:50:35.235887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 99 sessionId: src_id|510d123a-1a31e844-15986830-212d5f81_0 is DEAD
2025-09-30T14:50:35.236055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|510d123a-1a31e844-15986830-212d5f81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:35.236076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|510d123a-1a31e844-15986830-212d5f81_0] Write session will restart in 0.009934s
2025-09-30T14:50:35.236099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|510d123a-1a31e844-15986830-212d5f81_0] Write session: Do CDS request
2025-09-30T14:50:35.236105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|510d123a-1a31e844-15986830-212d5f81_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:35.246915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|510d123a-1a31e844-15986830-212d5f81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:35.247101Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:35.247113Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 100
2025-09-30T14:50:35.247260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 100 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:35.247304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 100 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:35.247314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=100 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:35.247318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:35.247814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 100 sessionId:  describe result for acl check
2025-09-30T14:50:35.247852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:35.247858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:35.247860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:35.247866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894739031391178:3094] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:35.248408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894739031391178:3094] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:35.250997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894739031391178:3094] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:35.252021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:35.253245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:35.253486Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:35.253515Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:35.253531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:35.253609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:35.253653Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894738941668187:2872]
2025-09-30T14:50:35.253933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894739031391178:3094] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:35.253958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894739031391178:3094] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:35.253961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894739031391178:3094] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:35.253970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 100 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:35.254329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:35.254594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:35.254639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:35.254994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:35.255058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:35.255064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:35.255065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:35.255067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:35.255068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:35.255069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:35.255071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:35.255072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:35.255073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:35.255074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:35.255076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.255077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.255078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.255079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:35.255080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:35.255086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:35.255097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:35.255101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:35.255106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:35.255110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:35.255114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:35.255118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:35.255122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:35.255127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:35.255143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:35.255146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.255149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.255152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.255156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:35.255159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:35.255166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:35.255174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:35.255181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:35.255190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:35.255195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:35.255201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:35.255205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:35.255212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:35.255217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:35.255223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:35.255227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:35.255234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:35.255238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:35.255259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:35.255265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:35.255275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:35.255280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:35.255285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:35.255293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:35.255299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:35.255304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.255313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.255319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.255328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.255333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.255338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.255347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:35.255353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:35.255357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:35.255363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:35.255408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:35.263376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:35.264281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:35.264298Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:35.264301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:35.264306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:35.264313Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 99 [2:7555894738941668187:2872]
2025-09-30T14:50:35.264329Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:35.264345Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:35.264347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.264350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.264353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.264369Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:35.264375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:35.264382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:35.264443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.264452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.264454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.264458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:35.264460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:35.264532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:35.264542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.264554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.264570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.264589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:35.264612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894739031391288:3094], now have 1 active actors on pipe
2025-09-30T14:50:35.264621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894739031391137:2454], now have 1 active actors on pipe
2025-09-30T14:50:35.264628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894738941668182:2872]
2025-09-30T14:50:35.264631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894738941668182:2872]
2025-09-30T14:50:35.264633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894738941668182:2872]
2025-09-30T14:50:35.264649Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:35.264662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:35.264676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:35.264679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:35.264680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:35.264685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:35.264688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:35.264715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894738941668182:2872]
2025-09-30T14:50:35.264718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:35.264730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:35.264759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:35.264690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 99
2025-09-30T14:50:35.264769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:35.264731Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 99
2025-09-30T14:50:35.264792Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e03aa85b-30002b2c-88823744-e0495951_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:35.264803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.264807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.264809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:35.264818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.264827Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:35.264840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:35.265069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:35.265079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:35.265095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:35.265223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 100 partition: 0 MaxSeqNo: 42 sessionId: src_id|e03aa85b-30002b2c-88823744-e0495951_0
2025-09-30T14:50:35.265666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|510d123a-1a31e844-15986830-212d5f81_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e03aa85b-30002b2c-88823744-e0495951_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:35.268693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e03aa85b-30002b2c-88823744-e0495951_0] Write session: try to update token
2025-09-30T14:50:35.268722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e03aa85b-30002b2c-88823744-e0495951_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:35.280796Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:35.280816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:35.280825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894738941668182:2872]
2025-09-30T14:50:35.280869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:35.280871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:35.281068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:35.281242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:35.281391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:35.281581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:35.281785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:35.281832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:35.292133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 100 sessionId: src_id|e03aa85b-30002b2c-88823744-e0495951_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:35.295241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:35.295619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:35.295643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:35.295694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:35.296941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:35.297872Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:35.297892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:35.297895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:35.297897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:35.297906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894738941668182:2872]
2025-09-30T14:50:35.297911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894738941668182:2872]
2025-09-30T14:50:35.297915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894738941668182:2872]
2025-09-30T14:50:35.297956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:35.297963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.297962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:35.297965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:35.297970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:35.297974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:35.298153Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:35.332774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894739031391300:2517]
2025-09-30T14:50:35.333130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 99, pipe: [1:7555894739031391300:2517]
2025-09-30T14:50:35.408505Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:35.416695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:35.416727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:35.416915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:35.416987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:35.417058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:35.417136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:35.417192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:35.417202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:35.417274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:35.417337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:35.417562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:35.417639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:35.417747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:35.417756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:35.417833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:35.417900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:35.417980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:35.418091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:35.418139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:35.418151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:35.418243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:35.418342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:35.418457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:35.418529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:35.418578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:35.418587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:35.418660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:35.418744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:35.418817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:35.418891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:35.418938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:35.418947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:35.419018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:35.419122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:35.419235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:35.419324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:35.419369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:35.419377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:35.419449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:35.419513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:35.419585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:35.419656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:35.419703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:35.419714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:35.419791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:35.419909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:35.420017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:35.420088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:35.420243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:35.420254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:35.420331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:35.420401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:35.420475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:35.420549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:35.420612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:35.420621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:35.420691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:35.420762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:35.420830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:35.420902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:35.420951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:35.420957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:35.421012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894739031391300:2517], now have 1 active actors on pipe
2025-09-30T14:50:35.421256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:35.421301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:35.421305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:35.421307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894739031391300:2517]
2025-09-30T14:50:35.421335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 100 reason: error at write: Disconnected sessionId: src_id|e03aa85b-30002b2c-88823744-e0495951_0
2025-09-30T14:50:35.421512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 100 sessionId: src_id|e03aa85b-30002b2c-88823744-e0495951_0 is DEAD
2025-09-30T14:50:35.421679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e03aa85b-30002b2c-88823744-e0495951_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:35.421692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e03aa85b-30002b2c-88823744-e0495951_0] Write session will restart in 0.005727s
2025-09-30T14:50:35.421725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e03aa85b-30002b2c-88823744-e0495951_0] Write session: Do CDS request
2025-09-30T14:50:35.421732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e03aa85b-30002b2c-88823744-e0495951_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:35.422052Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:35.428779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e03aa85b-30002b2c-88823744-e0495951_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:35.428873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:35.428898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 101
2025-09-30T14:50:35.429038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 101 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:35.429081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 101 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:35.429090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=101 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:35.429094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:35.429598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 101 sessionId:  describe result for acl check
2025-09-30T14:50:35.429646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:35.429653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:35.429655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:35.429661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894739031391339:3099] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:35.430198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894739031391339:3099] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:35.432810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894739031391339:3099] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:35.435658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894739031391339:3099] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:35.435675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894739031391339:3099] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:35.435679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894739031391339:3099] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:35.435687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 101 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:35.436373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:35.437181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:35.437423Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:35.437431Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:35.437440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:35.437483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:35.437517Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894738941668345:2875]
2025-09-30T14:50:35.438058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:35.438371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:35.438420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:35.438764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:35.438827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:35.438834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:35.438835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:35.438836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:35.438837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:35.438837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:35.438838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:35.438839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:35.438839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:35.438840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:35.438841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.438842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.438842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.438843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:35.438844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:35.438848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:35.438855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:35.438857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:35.438860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:35.438862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:35.438864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:35.438867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:35.438869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:35.438871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:35.438874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:35.438876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.438879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.438881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.438883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:35.438885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:35.438893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:35.438898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:35.438902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:35.438905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:35.438908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:35.438912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:35.438914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:35.438918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:35.438921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:35.438925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:35.438928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:35.438930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:35.438933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:35.438936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:35.438939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:35.438944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:35.438948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:35.438954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:35.438958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:35.438965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:35.438969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.438974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.438979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.438984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.438989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.438992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.438994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:35.438997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:35.439000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:35.439002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:35.439036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:35.446774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:35.447707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:35.447728Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:35.447731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:35.447736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:35.447744Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 100 [2:7555894738941668345:2875]
2025-09-30T14:50:35.447763Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:35.447780Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:35.447783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.447786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.447789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.447805Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:35.447812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:35.447819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:35.447885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.447893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.447895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.447899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:35.447902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:35.447975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:35.447983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.447999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.448017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.448038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:35.448065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894739031391454:3099], now have 1 active actors on pipe
2025-09-30T14:50:35.448076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894739031391302:2454], now have 1 active actors on pipe
2025-09-30T14:50:35.448082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894738941668340:2875]
2025-09-30T14:50:35.448084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894738941668340:2875]
2025-09-30T14:50:35.448087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894738941668340:2875]
2025-09-30T14:50:35.448100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:35.448114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:35.448117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:35.448120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:35.448123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:35.448134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:35.448136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:35.448131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 100
2025-09-30T14:50:35.448174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894738941668340:2875]
2025-09-30T14:50:35.448138Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 100
2025-09-30T14:50:35.448184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:35.448191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:35.448214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:35.448224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:35.448262Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b527b4ed-c14aca66-ab78cc02-f99d1508_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:35.448274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.448278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.448280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:35.448290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.448301Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:35.448318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:35.448539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:35.448547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:35.448563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:35.448634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 101 partition: 0 MaxSeqNo: 42 sessionId: src_id|b527b4ed-c14aca66-ab78cc02-f99d1508_0
2025-09-30T14:50:35.449026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e03aa85b-30002b2c-88823744-e0495951_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b527b4ed-c14aca66-ab78cc02-f99d1508_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:35.451910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b527b4ed-c14aca66-ab78cc02-f99d1508_0] Write session: try to update token
2025-09-30T14:50:35.451927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b527b4ed-c14aca66-ab78cc02-f99d1508_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:35.466497Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:35.466516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:35.466518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:35.466519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:35.466528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894738941668340:2875]
2025-09-30T14:50:35.466532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894738941668340:2875]
2025-09-30T14:50:35.466535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894738941668340:2875]
2025-09-30T14:50:35.466568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:35.466574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.466576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:35.466581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:35.466588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:35.466593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:35.466722Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:35.467655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 101 sessionId: src_id|b527b4ed-c14aca66-ab78cc02-f99d1508_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:35.470392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:35.521226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 18 EndOffset 38 InitDone 1 WaitForData 0, pipe: [1:7555894739031391467:2517]
2025-09-30T14:50:35.521510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 100, pipe: [1:7555894739031391467:2517]
2025-09-30T14:50:35.582830Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:35.583327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:35.583343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:35.583375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894739031391467:2517], now have 1 active actors on pipe
2025-09-30T14:50:35.583594Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:35.583667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:35.583681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894739031391467:2517]
2025-09-30T14:50:35.583686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:35.583701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:35.583743Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:50:35.583753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 101 reason: error at write: Disconnected sessionId: src_id|b527b4ed-c14aca66-ab78cc02-f99d1508_0
2025-09-30T14:50:35.583864Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_1_1_8923399920190016107_v1 is DEAD
2025-09-30T14:50:35.583942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 101 sessionId: src_id|b527b4ed-c14aca66-ab78cc02-f99d1508_0 is DEAD
2025-09-30T14:50:35.584010Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894666016935058:2511] disconnected; active server actors: 1
2025-09-30T14:50:35.584017Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894666016935058:2511] client user disconnected session shared/user_1_1_8923399920190016107_v1
2025-09-30T14:50:35.584109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b527b4ed-c14aca66-ab78cc02-f99d1508_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:35.584121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b527b4ed-c14aca66-ab78cc02-f99d1508_0] Write session will restart in 0.008392s
2025-09-30T14:50:35.584146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b527b4ed-c14aca66-ab78cc02-f99d1508_0] Write session: Do CDS request
2025-09-30T14:50:35.584152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b527b4ed-c14aca66-ab78cc02-f99d1508_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:35.584198Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:50:35.584374Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 9011741, ReadSizeServerDelta = -8487453
2025-09-30T14:50:35.584380Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:50:35.584421Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.005873s
2025-09-30T14:50:35.591631Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:50:35.591902Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:50:35.591916Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 2
2025-09-30T14:50:35.592113Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:50:35.592166Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:50:35.592385Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 auth for : user
2025-09-30T14:50:35.592751Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 Handle describe topics response
2025-09-30T14:50:35.592786Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 auth is DEAD
2025-09-30T14:50:35.592791Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:50:35.593053Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:50:35.593153Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_2_10823260805113802020_v1
2025-09-30T14:50:35.593274Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894739031391497:3103] connected; active server actors: 1
2025-09-30T14:50:35.593296Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555894739031391497:3103] session shared/user_1_2_10823260805113802020_v1
2025-09-30T14:50:35.593305Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:50:35.593317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:50:35.593324Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_2_10823260805113802020_v1" (Sender=[1:7555894739031391482:3103], Pipe=[1:7555894739031391497:3103], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:50:35.593342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:50:35.593358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:50:35.593365Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_2_10823260805113802020_v1" (Sender=[1:7555894739031391482:3103], Pipe=[1:7555894739031391497:3103], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:50:35.593375Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_2_10823260805113802020_v1" sender [1:7555894739031391482:3103] lock partition 0 for ReadingSession "shared/user_1_2_10823260805113802020_v1" (Sender=[1:7555894739031391482:3103], Pipe=[1:7555894739031391497:3103], Partitions=[], ActiveFamilyCount=1) generation 1 step 2
2025-09-30T14:50:35.593390Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:50:35.593398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000037s
2025-09-30T14:50:35.593665Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 2 Session: "shared/user_1_2_10823260805113802020_v1" ClientId: "user" PipeClient { RawX1: 7555894739031391497 RawX2: 4503603922340895 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:50:35.593690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b527b4ed-c14aca66-ab78cc02-f99d1508_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:35.593691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:50:35.593782Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:35.593792Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 102
2025-09-30T14:50:35.593906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 102 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:35.593934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 102 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:35.593944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=102 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:35.593947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:35.594293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 102 sessionId:  describe result for acl check
2025-09-30T14:50:35.594325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:35.594327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:35.594329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:35.594334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894739031391531:3107] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:35.594877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894739031391531:3107] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:35.596981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894739031391531:3107] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:35.597382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:35.598196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:35.598401Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:35.598410Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:35.598421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:35.598473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:35.598517Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894738941668501:2877]
2025-09-30T14:50:35.599144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894739031391531:3107] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:35.599156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894739031391531:3107] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:35.599160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894739031391531:3107] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:35.599167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 102 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:35.599186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:35.599514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:35.599578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:35.599956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:35.600036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:35.600043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:35.600044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:35.600045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:35.600046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:35.600048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:35.600049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:35.600051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:35.600052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:35.600053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:35.600054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.600055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.600057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.600058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:35.600059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:35.600064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:35.600074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:35.600078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:35.600082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:35.600086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:35.600090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:35.600094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:35.600098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:35.600102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:35.600106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:35.600109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.600113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.600117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.600121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:35.600124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:35.600132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:35.600141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:35.600147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:35.600153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:35.600157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:35.600162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:35.600167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:35.600171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:35.600176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:35.600181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:35.600186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:35.600190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:35.600195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:35.600200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:35.600204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:35.600209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:35.600213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:35.600226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:35.600230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:35.600236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:35.600240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.600247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.600251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.600257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.600262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.600268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.600272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:35.600277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:35.600281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:35.600286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:35.600328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:35.608986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:35.609910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:35.609925Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:35.609928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:35.609932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:35.609939Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 101 [2:7555894738941668501:2877]
2025-09-30T14:50:35.609959Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:35.609976Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:35.609984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.609987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.609990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.610007Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:35.610019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:35.610030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:35.610094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.610101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.610104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.610108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:35.610111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:35.610178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:35.610187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.610202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.610214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.610231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:35.610253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894738941668496:2877]
2025-09-30T14:50:35.610260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894738941668496:2877]
2025-09-30T14:50:35.610263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894738941668496:2877]
2025-09-30T14:50:35.610276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:35.610291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894739031391468:2454], now have 1 active actors on pipe
2025-09-30T14:50:35.610290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:35.610294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:35.610300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894739031391627:3107], now have 1 active actors on pipe
2025-09-30T14:50:35.610303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894739031391514:3106], now have 1 active actors on pipe
2025-09-30T14:50:35.610310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:35.610311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:35.610324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:35.610328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:35.610365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894738941668496:2877]
2025-09-30T14:50:35.610377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:35.610363Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 101
2025-09-30T14:50:35.610394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:35.610410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 101
2025-09-30T14:50:35.610451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 101, pipe: [1:7555894739031391514:3106]
2025-09-30T14:50:35.610457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:35.610466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:35.610493Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1261b210-1a5769a2-4bd9acf4-28a75351_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:35.610500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.610508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.610510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:35.610520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.610534Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:35.610554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:35.610561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:35.610568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_2_10823260805113802020_v1 on pipe: [1:7555894739031391514:3106]
2025-09-30T14:50:35.610611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:35.610636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.610645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.610646Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_2_10823260805113802020_v1:1 with generation 101
2025-09-30T14:50:35.610647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:35.610661Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_2_10823260805113802020_v1
2025-09-30T14:50:35.610664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.610683Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:35.610805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:35.610812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:35.610826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:35.610921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 102 partition: 0 MaxSeqNo: 42 sessionId: src_id|1261b210-1a5769a2-4bd9acf4-28a75351_0
2025-09-30T14:50:35.611357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b527b4ed-c14aca66-ab78cc02-f99d1508_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1261b210-1a5769a2-4bd9acf4-28a75351_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:35.616472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:35.616530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:35.616541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.616544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.616547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.616559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:50:35.616579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:50:35.616764Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759243835610 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:50:35.616802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:50:35.616839Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 sending to client partition status
2025-09-30T14:50:35.622868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1261b210-1a5769a2-4bd9acf4-28a75351_0] Write session: try to update token
2025-09-30T14:50:35.622897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1261b210-1a5769a2-4bd9acf4-28a75351_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:35.627487Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:35.627506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:35.627509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:35.627512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:35.627522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894738941668496:2877]
2025-09-30T14:50:35.627528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894738941668496:2877]
2025-09-30T14:50:35.627532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894738941668496:2877]
2025-09-30T14:50:35.627577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:35.627584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.627587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:35.627623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:35.627637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:35.627642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:35.627739Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:35.644868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 102 sessionId: src_id|1261b210-1a5769a2-4bd9acf4-28a75351_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:35.651721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:35.743770Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:35.744349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:35.744358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:35.744785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_2_10823260805113802020_v1
2025-09-30T14:50:35.744803Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:35.744834Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_2_10823260805113802020_v1
2025-09-30T14:50:35.747544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:35.747594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:35.747669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 102 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1261b210-1a5769a2-4bd9acf4-28a75351_0
2025-09-30T14:50:35.747853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 102 sessionId: src_id|1261b210-1a5769a2-4bd9acf4-28a75351_0 is DEAD
2025-09-30T14:50:35.748037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894739031391514:3106]
2025-09-30T14:50:35.748231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1261b210-1a5769a2-4bd9acf4-28a75351_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:35.748242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1261b210-1a5769a2-4bd9acf4-28a75351_0] Write session will restart in 0.006213s
2025-09-30T14:50:35.748265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1261b210-1a5769a2-4bd9acf4-28a75351_0] Write session: Do CDS request
2025-09-30T14:50:35.748274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1261b210-1a5769a2-4bd9acf4-28a75351_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:35.755721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1261b210-1a5769a2-4bd9acf4-28a75351_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:35.760221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:35.760236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 103
2025-09-30T14:50:35.760376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 103 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:35.760404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 103 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:35.760410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=103 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:35.760414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:35.761539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 103 sessionId:  describe result for acl check
2025-09-30T14:50:35.761577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:35.761580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:35.761582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:35.761589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894739031391764:3119] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:35.762135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894739031391764:3119] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:35.764579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894739031391764:3119] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:35.764758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:35.766125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:35.766472Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:35.766489Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:35.766514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:35.766630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:35.766721Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894738941668708:2892]
2025-09-30T14:50:35.767380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:35.767718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894739031391764:3119] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:35.767737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894739031391764:3119] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:35.767740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894739031391764:3119] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:35.767750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 103 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:35.767723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:35.767783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:35.768108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:35.768190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:35.768196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:35.768197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:35.768198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:35.768200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:35.768201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:35.768202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:35.768203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:35.768205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:35.768206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:35.768207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.768208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.768209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.768210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:35.768212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:35.768218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:35.768228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:35.768232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:35.768236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:35.768240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:35.768243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:35.768247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:35.768251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:35.768255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:35.768259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:35.768262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.768266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.768269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.768273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:35.768276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:35.768284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:35.768293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:35.768299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:35.768304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:35.768309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:35.768315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:35.768319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:35.768325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:35.768331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:35.768336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:35.768341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:35.768346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:35.768351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:35.768357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:35.768362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:35.768367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:35.768372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:35.768387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:35.768392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:35.768398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:35.768403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.768410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.768415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.768420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.768425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.768431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.768436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:35.768442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:35.768446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:35.768458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:35.768505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:35.774658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:35.775626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:35.775645Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:35.775649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:35.775653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:35.775659Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 102 [2:7555894738941668708:2892]
2025-09-30T14:50:35.775677Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:35.775693Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:35.775696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.775700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.775702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.775718Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:35.775725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:35.775732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:35.775797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.775806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.775809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.775812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:35.775815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:35.775885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:35.775892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.775905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.775920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.775941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:35.775965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894739031391830:3119], now have 1 active actors on pipe
2025-09-30T14:50:35.775975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894739031391674:2454], now have 1 active actors on pipe
2025-09-30T14:50:35.775982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894738941668702:2892]
2025-09-30T14:50:35.775984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894738941668702:2892]
2025-09-30T14:50:35.775986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894738941668702:2892]
2025-09-30T14:50:35.776002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:35.776016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:35.776021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:35.776025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:35.776029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:35.776033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:35.776036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:35.776040Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 102
2025-09-30T14:50:35.776070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894738941668702:2892]
2025-09-30T14:50:35.776070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 102
2025-09-30T14:50:35.776080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:35.776082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:35.776105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:35.776114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:35.776150Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9db1a12-d93c2a6-5280900b-6bee12c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:35.776162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.776172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.776174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:35.776184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.776198Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:35.776230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:35.776390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:35.776396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:35.776409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:35.776505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 103 partition: 0 MaxSeqNo: 42 sessionId: src_id|d9db1a12-d93c2a6-5280900b-6bee12c2_0
2025-09-30T14:50:35.776851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1261b210-1a5769a2-4bd9acf4-28a75351_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d9db1a12-d93c2a6-5280900b-6bee12c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:35.779573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9db1a12-d93c2a6-5280900b-6bee12c2_0] Write session: try to update token
2025-09-30T14:50:35.779595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9db1a12-d93c2a6-5280900b-6bee12c2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:35.789384Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:35.789405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:35.789408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:35.789411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:35.789424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894738941668702:2892]
2025-09-30T14:50:35.789429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894738941668702:2892]
2025-09-30T14:50:35.789434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894738941668702:2892]
2025-09-30T14:50:35.789480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:35.789486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.789490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:35.789493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:35.789501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:35.789504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:35.789732Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:35.802004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 103 sessionId: src_id|d9db1a12-d93c2a6-5280900b-6bee12c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:35.805459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:35.848387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894739031391840:3106]
2025-09-30T14:50:35.848722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 102, pipe: [1:7555894739031391840:3106]
2025-09-30T14:50:35.904132Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:35.904456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:35.904469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:35.904511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894739031391840:3106], now have 1 active actors on pipe
2025-09-30T14:50:35.904770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:35.904783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894739031391840:3106]
2025-09-30T14:50:35.904793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:35.904804Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:35.904854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 103 reason: error at write: Disconnected sessionId: src_id|d9db1a12-d93c2a6-5280900b-6bee12c2_0
2025-09-30T14:50:35.905051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 103 sessionId: src_id|d9db1a12-d93c2a6-5280900b-6bee12c2_0 is DEAD
2025-09-30T14:50:35.905206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9db1a12-d93c2a6-5280900b-6bee12c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:35.905221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9db1a12-d93c2a6-5280900b-6bee12c2_0] Write session will restart in 0.008561s
2025-09-30T14:50:35.904715Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:35.905243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9db1a12-d93c2a6-5280900b-6bee12c2_0] Write session: Do CDS request
2025-09-30T14:50:35.905252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9db1a12-d93c2a6-5280900b-6bee12c2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:35.914790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9db1a12-d93c2a6-5280900b-6bee12c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:35.914848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:35.914864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 104
2025-09-30T14:50:35.915062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 104 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:35.915095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 104 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:35.915104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=104 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:35.915109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:35.916147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 104 sessionId:  describe result for acl check
2025-09-30T14:50:35.916187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:35.916190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:35.916191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:35.916198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894739031391856:3123] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:35.916743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894739031391856:3123] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:35.921589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894739031391856:3123] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:35.925026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:35.925304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894739031391856:3123] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:35.925321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894739031391856:3123] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:35.925324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894739031391856:3123] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:35.925333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 104 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:35.926448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:35.926666Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:35.926674Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:35.926697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:35.926749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:35.926799Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894738941668867:2894]
2025-09-30T14:50:35.927446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:35.927779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:35.927832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:35.928172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:35.928228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:35.928229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:35.928231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:35.928232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:35.928233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:35.928234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:35.928236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:35.928237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:35.928238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:35.928239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:35.928240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.928242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.928243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.928244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:35.928245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:35.928250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:35.928261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:35.928265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:35.928270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:35.928274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:35.928278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:35.928282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:35.928286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:35.928290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:35.928295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:35.928299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.928302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.928306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.928311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:35.928314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:35.928321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:35.928329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:35.928336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:35.928340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:35.928344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:35.928349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:35.928352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:35.928357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:35.928361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:35.928367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:35.928372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:35.928377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:35.928381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:35.928386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:35.928391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:35.928395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:35.928401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:35.928406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:35.928409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:35.928415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:35.928419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.928423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.928426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.928431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.928435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.928440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.928444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:35.928449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:35.928454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:35.928459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:35.928503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:35.934805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:35.935713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:35.935727Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:35.935729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:35.935733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:35.935740Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 103 [2:7555894738941668867:2894]
2025-09-30T14:50:35.935770Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:35.935787Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:35.935790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.935792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.935794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.935807Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:35.935813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:35.935818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:35.935865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.935867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.936157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 103
2025-09-30T14:50:35.935868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.935871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:35.936201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 103
2025-09-30T14:50:35.935874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:35.935944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:35.935946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.935955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:35.935962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:35.935971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:35.935985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894738941668861:2894]
2025-09-30T14:50:35.935986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894738941668861:2894]
2025-09-30T14:50:35.935988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894738941668861:2894]
2025-09-30T14:50:35.935994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:35.936005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:35.936022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:35.936025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:35.936026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:35.936028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:35.936029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:35.936059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894738941668861:2894]
2025-09-30T14:50:35.936061Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:35.936064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:35.936068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894739031391841:2454], now have 1 active actors on pipe
2025-09-30T14:50:35.936070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894739031391995:3123], now have 1 active actors on pipe
2025-09-30T14:50:35.936320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:35.936328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:35.936350Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27ddb002-6a360758-d03a56f6-2c4c526d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:35.936356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.936358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.936359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:35.936367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.936375Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:35.936387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:35.936751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 104 partition: 0 MaxSeqNo: 42 sessionId: src_id|27ddb002-6a360758-d03a56f6-2c4c526d_0
2025-09-30T14:50:35.936647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:35.936660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:35.936671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:35.937150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9db1a12-d93c2a6-5280900b-6bee12c2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|27ddb002-6a360758-d03a56f6-2c4c526d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:35.940044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27ddb002-6a360758-d03a56f6-2c4c526d_0] Write session: try to update token
2025-09-30T14:50:35.940065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27ddb002-6a360758-d03a56f6-2c4c526d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:35.953009Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:35.953030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:35.953033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:35.953035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:35.953044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894738941668861:2894]
2025-09-30T14:50:35.953048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894738941668861:2894]
2025-09-30T14:50:35.953053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894738941668861:2894]
2025-09-30T14:50:35.953108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:35.953115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:35.953118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:35.953256Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:35.955340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:35.955351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:35.955356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:35.960222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 104 sessionId: src_id|27ddb002-6a360758-d03a56f6-2c4c526d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:35.963434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:36.005057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894743326359310:3106]
2025-09-30T14:50:36.005361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 103, pipe: [1:7555894743326359310:3106]
2025-09-30T14:50:36.071809Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:36.072389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:36.072398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:36.072438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894743326359310:3106], now have 1 active actors on pipe
2025-09-30T14:50:36.072747Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:36.072815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:36.072824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:36.072869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894743326359310:3106]
2025-09-30T14:50:36.072889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 104 reason: error at write: Disconnected sessionId: src_id|27ddb002-6a360758-d03a56f6-2c4c526d_0
2025-09-30T14:50:36.072679Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:36.073102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 104 sessionId: src_id|27ddb002-6a360758-d03a56f6-2c4c526d_0 is DEAD
2025-09-30T14:50:36.073272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27ddb002-6a360758-d03a56f6-2c4c526d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:36.073283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27ddb002-6a360758-d03a56f6-2c4c526d_0] Write session will restart in 0.009814s
2025-09-30T14:50:36.073306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27ddb002-6a360758-d03a56f6-2c4c526d_0] Write session: Do CDS request
2025-09-30T14:50:36.073315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27ddb002-6a360758-d03a56f6-2c4c526d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:36.085801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:36.086747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:36.086944Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:36.086953Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:36.086963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:36.087019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:36.087060Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894743236636323:2897]
2025-09-30T14:50:36.087752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27ddb002-6a360758-d03a56f6-2c4c526d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:36.087740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:36.087850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:36.087864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 105
2025-09-30T14:50:36.088048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:36.088091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:36.088426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:36.088487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:36.088493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:36.088494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:36.088495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:36.088497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:36.088498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:36.088499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:36.088500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:36.088502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:36.088503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:36.088504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.088505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.088506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.088507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:36.088509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:36.088514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:36.088525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:36.088529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:36.088534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:36.088538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:36.088543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:36.088547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:36.088552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:36.088555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:36.088559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:36.088562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.088566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.088570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.088575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:36.088579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:36.088587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:36.088595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:36.088601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:36.088607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:36.088611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:36.088622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:36.088626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:36.088632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:36.088637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:36.088642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:36.088647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:36.088653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:36.088657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:36.088668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:36.088673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:36.088685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:36.088690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:36.088695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:36.088700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:36.088706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:36.088712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.088717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.088726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.088731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.088736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.088746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.088750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:36.088756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:36.088764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:36.088769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:36.088814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:36.091571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 105 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:36.091630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 105 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:36.091637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=105 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:36.091642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:36.092118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 105 sessionId:  describe result for acl check
2025-09-30T14:50:36.092151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:36.092157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:36.092159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:36.092166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894743326359441:3129] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:36.092747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894743326359441:3129] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:36.094843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:36.095967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:36.095985Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:36.095988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:36.095992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:36.095998Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 104 [2:7555894743236636323:2897]
2025-09-30T14:50:36.096015Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:36.096030Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:36.096033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.096036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.096038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.096053Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:36.096065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:36.096072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:36.096134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.096142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.096145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.096148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:36.096150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:36.096219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:36.096226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.096240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.096257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.096280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:36.096302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894743326359314:2454], now have 1 active actors on pipe
2025-09-30T14:50:36.096313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894743236636317:2897]
2025-09-30T14:50:36.096320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894743236636317:2897]
2025-09-30T14:50:36.096322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894743236636317:2897]
2025-09-30T14:50:36.096336Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:36.096341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:36.096345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:36.096348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:36.096354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:36.096369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:36.096372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:36.096415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894743236636317:2897]
2025-09-30T14:50:36.096426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:36.096434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:36.096303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 104
2025-09-30T14:50:36.097033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894743326359441:3129] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:36.101997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894743326359441:3129] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:36.102015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894743326359441:3129] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:36.102018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894743326359441:3129] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:36.102028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 105 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:36.103547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 104
2025-09-30T14:50:36.103484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894743326359479:3129], now have 1 active actors on pipe
2025-09-30T14:50:36.103611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:36.103627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:36.103655Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|211ffaf0-e0e11fb9-265079f2-5e5fa33e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:36.103670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.103680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.103683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:36.103696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.103716Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:36.103737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:36.103928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:36.103935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:36.103949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:36.104107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 105 partition: 0 MaxSeqNo: 42 sessionId: src_id|211ffaf0-e0e11fb9-265079f2-5e5fa33e_0
2025-09-30T14:50:36.104449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27ddb002-6a360758-d03a56f6-2c4c526d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|211ffaf0-e0e11fb9-265079f2-5e5fa33e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:36.107337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|211ffaf0-e0e11fb9-265079f2-5e5fa33e_0] Write session: try to update token
2025-09-30T14:50:36.107359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|211ffaf0-e0e11fb9-265079f2-5e5fa33e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:36.109173Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:36.109190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:36.109200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894743236636317:2897]
2025-09-30T14:50:36.109247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:36.109263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:36.109428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:36.109579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:36.109719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:36.109855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:36.110040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:36.110067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:36.121447Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:36.121468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:36.121470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:36.121472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:36.121484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894743236636317:2897]
2025-09-30T14:50:36.121488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894743236636317:2897]
2025-09-30T14:50:36.121492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894743236636317:2897]
2025-09-30T14:50:36.121534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:36.121540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.121544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:36.121547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:36.121564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:36.121569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:36.121699Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:36.128363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 105 sessionId: src_id|211ffaf0-e0e11fb9-265079f2-5e5fa33e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:36.131215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:36.172999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894743326359483:3106]
2025-09-30T14:50:36.173396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 104, pipe: [1:7555894743326359483:3106]
2025-09-30T14:50:36.236029Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:36.236548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:36.236564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:36.236586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894743326359483:3106], now have 1 active actors on pipe
2025-09-30T14:50:36.236777Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:36.236856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:36.236873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:36.236878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:36.236926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894743326359483:3106]
2025-09-30T14:50:36.236950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 105 reason: error at write: Disconnected sessionId: src_id|211ffaf0-e0e11fb9-265079f2-5e5fa33e_0
2025-09-30T14:50:36.237174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 105 sessionId: src_id|211ffaf0-e0e11fb9-265079f2-5e5fa33e_0 is DEAD
2025-09-30T14:50:36.237320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|211ffaf0-e0e11fb9-265079f2-5e5fa33e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:36.237332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|211ffaf0-e0e11fb9-265079f2-5e5fa33e_0] Write session will restart in 0.007783s
2025-09-30T14:50:36.237367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|211ffaf0-e0e11fb9-265079f2-5e5fa33e_0] Write session: Do CDS request
2025-09-30T14:50:36.237376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|211ffaf0-e0e11fb9-265079f2-5e5fa33e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:36.246773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|211ffaf0-e0e11fb9-265079f2-5e5fa33e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:36.246902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:36.246919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 106
2025-09-30T14:50:36.247064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 106 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:36.247099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 106 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:36.247105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=106 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:36.247109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:36.247511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 106 sessionId:  describe result for acl check
2025-09-30T14:50:36.247545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:36.247549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:36.247550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:36.247556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894743326359515:3133] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:36.248073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894743326359515:3133] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:36.250434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894743326359515:3133] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:36.253001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894743326359515:3133] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:36.253017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894743326359515:3133] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:36.253021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894743326359515:3133] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:36.253030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 106 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:36.253420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:36.254502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:36.254709Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:36.254729Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:36.254744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:36.254806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:36.254854Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894743236636484:2899]
2025-09-30T14:50:36.255550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:36.255869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:36.255943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:36.256297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:36.256380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:36.256389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:36.256390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:36.256392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:36.256393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:36.256394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:36.256395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:36.256397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:36.256398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:36.256400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:36.256401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.256402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.256403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.256404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:36.256405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:36.256412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:36.256422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:36.256427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:36.256430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:36.256434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:36.256438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:36.256441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:36.256445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:36.256449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:36.256453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:36.256457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.256461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.256465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.256470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:36.256475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:36.256482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:36.256490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:36.256498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:36.256504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:36.256508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:36.256514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:36.256520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:36.256525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:36.256530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:36.256536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:36.256541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:36.256545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:36.256550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:36.256556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:36.256560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:36.256566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:36.256570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:36.256599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:36.256608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:36.256613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:36.256622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.256627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.256631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.256637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.256643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.256648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.256657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:36.256662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:36.256679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:36.256689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:36.256736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:36.263215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:36.264139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:36.264159Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:36.264163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:36.264175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:36.264183Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 105 [2:7555894743236636484:2899]
2025-09-30T14:50:36.264202Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:36.264219Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:36.264227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.264230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.264233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.264251Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:36.264263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:36.264270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:36.264333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.264340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.264342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.264346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:36.264349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:36.264419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:36.264429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.264442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.264453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.264471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:36.264486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894743236636478:2899]
2025-09-30T14:50:36.264495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894743236636478:2899]
2025-09-30T14:50:36.264497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894743236636478:2899]
2025-09-30T14:50:36.264505Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:36.264516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:36.264522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894743326359484:2454], now have 1 active actors on pipe
2025-09-30T14:50:36.264526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894743326359639:3133], now have 1 active actors on pipe
2025-09-30T14:50:36.264527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:36.264529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:36.264531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:36.264549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:36.264557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:36.264597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894743236636478:2899]
2025-09-30T14:50:36.264611Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:36.264612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 105
2025-09-30T14:50:36.264628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 105
2025-09-30T14:50:36.264640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:36.264770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:36.264781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:36.264810Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c880f450-3c510f53-69296901-12745b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:36.264823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.264826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.264830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:36.264841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.264857Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:36.264877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:36.265030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:36.265041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:36.265057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:36.265520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|211ffaf0-e0e11fb9-265079f2-5e5fa33e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c880f450-3c510f53-69296901-12745b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:36.265175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 106 partition: 0 MaxSeqNo: 42 sessionId: src_id|c880f450-3c510f53-69296901-12745b5_0
2025-09-30T14:50:36.268388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c880f450-3c510f53-69296901-12745b5_0] Write session: try to update token
2025-09-30T14:50:36.268408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c880f450-3c510f53-69296901-12745b5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:36.281150Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:36.281184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:36.281187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:36.281189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:36.281199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894743236636478:2899]
2025-09-30T14:50:36.281204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894743236636478:2899]
2025-09-30T14:50:36.281207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894743236636478:2899]
2025-09-30T14:50:36.281249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:36.281257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.281257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:36.281263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:36.281264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:36.281272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:36.281423Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:36.284197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 106 sessionId: src_id|c880f450-3c510f53-69296901-12745b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:36.286921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:36.336833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894743326359652:3106]
2025-09-30T14:50:36.337112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 105, pipe: [1:7555894743326359652:3106]
2025-09-30T14:50:36.396294Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:36.396829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:36.396839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:36.396878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894743326359652:3106], now have 1 active actors on pipe
2025-09-30T14:50:36.397098Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:36.397264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894743326359652:3106]
2025-09-30T14:50:36.397303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:36.397372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 106 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c880f450-3c510f53-69296901-12745b5_0
2025-09-30T14:50:36.397575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 106 sessionId: src_id|c880f450-3c510f53-69296901-12745b5_0 is DEAD
2025-09-30T14:50:36.397629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:36.397832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c880f450-3c510f53-69296901-12745b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:36.397843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c880f450-3c510f53-69296901-12745b5_0] Write session will restart in 0.006744s
2025-09-30T14:50:36.397869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c880f450-3c510f53-69296901-12745b5_0] Write session: Do CDS request
2025-09-30T14:50:36.397875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c880f450-3c510f53-69296901-12745b5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:36.405735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c880f450-3c510f53-69296901-12745b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:36.406206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:36.406218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 107
2025-09-30T14:50:36.406374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 107 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:36.406409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 107 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:36.406414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=107 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:36.406418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:36.406879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 107 sessionId:  describe result for acl check
2025-09-30T14:50:36.406915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:36.406918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:36.406920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:36.406927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894743326359682:3137] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:36.407559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894743326359682:3137] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:36.410232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894743326359682:3137] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:36.414294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894743326359682:3137] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:36.414308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894743326359682:3137] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:36.414312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894743326359682:3137] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:36.414320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 107 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:36.416390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:36.418297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:36.418502Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:36.418507Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:36.418516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:36.418573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:36.418607Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894743236636644:2901]
2025-09-30T14:50:36.419277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:36.419598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:36.419655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:36.419981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:36.420065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:36.420072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:36.420074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:36.420075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:36.420077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:36.420078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:36.420079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:36.420080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:36.420082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:36.420083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:36.420084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.420085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.420086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.420088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:36.420089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:36.420095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:36.420106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:36.420111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:36.420115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:36.420120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:36.420124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:36.420128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:36.420133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:36.420137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:36.420142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:36.420146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.420151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.420156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.420160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:36.420165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:36.420174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:36.420182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:36.420188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:36.420193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:36.420197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:36.420209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:36.420213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:36.420219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:36.420225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:36.420236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:36.420241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:36.420247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:36.420253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:36.420260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:36.420264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:36.420270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:36.420280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:36.420285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:36.420290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:36.420296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:36.420302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.420307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.420312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.420317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.420324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.420330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.420335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:36.420345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:36.420350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:36.420357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:36.420398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:36.430063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 106
2025-09-30T14:50:36.430106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 106
2025-09-30T14:50:36.430633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 107 partition: 0 MaxSeqNo: 42 sessionId: src_id|e2ac2b3d-f4370d1d-c64de628-6c365d14_0
2025-09-30T14:50:36.431057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c880f450-3c510f53-69296901-12745b5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e2ac2b3d-f4370d1d-c64de628-6c365d14_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:36.428009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:36.429338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:36.429345Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:36.429347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:36.429351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:36.429358Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 106 [2:7555894743236636644:2901]
2025-09-30T14:50:36.429374Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:36.429388Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:36.429393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.429396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.429398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.429415Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:36.429421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:36.429428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:36.429496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.429498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.429501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.429505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:36.429508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:36.429577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:36.429579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.429592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.429602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.429618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:36.429636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894743236636638:2901]
2025-09-30T14:50:36.429639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894743236636638:2901]
2025-09-30T14:50:36.429641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894743236636638:2901]
2025-09-30T14:50:36.429648Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:36.429663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:36.429677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:36.429679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:36.429680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:36.429684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:36.429686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:36.429716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894743236636638:2901]
2025-09-30T14:50:36.429719Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:36.429721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:36.429729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894743326359653:2454], now have 1 active actors on pipe
2025-09-30T14:50:36.429732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894743326359807:3137], now have 1 active actors on pipe
2025-09-30T14:50:36.430228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:36.430234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:36.430273Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2ac2b3d-f4370d1d-c64de628-6c365d14_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:36.430283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.430287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.430289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:36.430299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.430309Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:36.430329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:36.430497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:36.430502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:36.430518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:36.433791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2ac2b3d-f4370d1d-c64de628-6c365d14_0] Write session: try to update token
2025-09-30T14:50:36.433809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2ac2b3d-f4370d1d-c64de628-6c365d14_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:36.444836Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:36.444853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:36.444855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:36.444857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:36.444864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894743236636638:2901]
2025-09-30T14:50:36.444868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894743236636638:2901]
2025-09-30T14:50:36.444872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894743236636638:2901]
2025-09-30T14:50:36.444909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:36.444916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.444919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:36.444961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:36.444969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:36.444973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:36.445071Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:36.450823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 107 sessionId: src_id|e2ac2b3d-f4370d1d-c64de628-6c365d14_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:36.453698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:36.497606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894743326359824:3106]
2025-09-30T14:50:36.497845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 106, pipe: [1:7555894743326359824:3106]
2025-09-30T14:50:36.565718Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:36.566071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:36.566091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:36.566137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894743326359824:3106], now have 1 active actors on pipe
2025-09-30T14:50:36.566409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:36.566439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:36.566444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:36.566477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894743326359824:3106]
2025-09-30T14:50:36.566520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 107 reason: error at write: Disconnected sessionId: src_id|e2ac2b3d-f4370d1d-c64de628-6c365d14_0
2025-09-30T14:50:36.566714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 107 sessionId: src_id|e2ac2b3d-f4370d1d-c64de628-6c365d14_0 is DEAD
2025-09-30T14:50:36.566360Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:36.566869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2ac2b3d-f4370d1d-c64de628-6c365d14_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:36.566889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2ac2b3d-f4370d1d-c64de628-6c365d14_0] Write session will restart in 0.006750s
2025-09-30T14:50:36.566912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2ac2b3d-f4370d1d-c64de628-6c365d14_0] Write session: Do CDS request
2025-09-30T14:50:36.566917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2ac2b3d-f4370d1d-c64de628-6c365d14_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:36.575001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2ac2b3d-f4370d1d-c64de628-6c365d14_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:36.575085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:36.575100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 108
2025-09-30T14:50:36.575298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 108 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:36.575359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 108 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:36.575369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=108 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:36.575374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:36.575875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 108 sessionId:  describe result for acl check
2025-09-30T14:50:36.575908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:36.575919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:36.575921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:36.575927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894743326359840:3142] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:36.576486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894743326359840:3142] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:36.578840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894743326359840:3142] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:36.582004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894743326359840:3142] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:36.582017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894743326359840:3142] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:36.582021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894743326359840:3142] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:36.582029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 108 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:36.582245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:36.583046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:36.583226Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:36.583235Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:36.583258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:36.583305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:36.583342Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894743236636809:2904]
2025-09-30T14:50:36.583998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:36.584316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:36.584373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:36.584744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:36.584807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:36.584812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:36.584813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:36.584815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:36.584816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:36.584817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:36.584818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:36.584819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:36.584820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:36.584821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:36.584822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.584823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.584825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.584826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:36.584827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:36.584833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:36.584843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:36.584848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:36.584852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:36.584857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:36.584861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:36.584865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:36.584869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:36.584873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:36.584877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:36.584881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.584885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.584890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.584893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:36.584897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:36.584904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:36.584928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:36.584934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:36.584939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:36.584944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:36.584949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:36.584954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:36.584959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:36.584964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:36.584970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:36.584974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:36.584980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:36.584985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:36.584990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:36.585001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:36.585006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:36.585011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:36.585015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:36.585019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:36.585024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:36.585029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.585034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.585044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.585049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.585060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.585069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.585073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:36.585078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:36.585083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:36.585088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:36.585128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:36.590765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:36.591736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:36.591751Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:36.591754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:36.591758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:36.591765Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 107 [2:7555894743236636809:2904]
2025-09-30T14:50:36.591784Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:36.591799Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:36.591808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.591811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.591813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.591828Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:36.591835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:36.591842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:36.591902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.591911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.591914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.591917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:36.591919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:36.591984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:36.591992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.592004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.592016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.592037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:36.592064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894743326359983:3142], now have 1 active actors on pipe
2025-09-30T14:50:36.592067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894743326359825:2454], now have 1 active actors on pipe
2025-09-30T14:50:36.592073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894743236636803:2904]
2025-09-30T14:50:36.592076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894743236636803:2904]
2025-09-30T14:50:36.592078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894743236636803:2904]
2025-09-30T14:50:36.592089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:36.592103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:36.592116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:36.592121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:36.592124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:36.592126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:36.592129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:36.592158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894743236636803:2904]
2025-09-30T14:50:36.592171Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:36.592178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:36.594068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:36.594084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:36.594118Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cdcc61d-67baba97-ab34b6cf-81921567_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:36.593944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 107
2025-09-30T14:50:36.593975Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 107
2025-09-30T14:50:36.594128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.594133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.594135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:36.594146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.594158Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:36.594175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:36.594510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 108 partition: 0 MaxSeqNo: 42 sessionId: src_id|cdcc61d-67baba97-ab34b6cf-81921567_0
2025-09-30T14:50:36.594378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:36.594386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:36.594399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:36.594900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2ac2b3d-f4370d1d-c64de628-6c365d14_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cdcc61d-67baba97-ab34b6cf-81921567_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:36.597691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdcc61d-67baba97-ab34b6cf-81921567_0] Write session: try to update token
2025-09-30T14:50:36.597711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdcc61d-67baba97-ab34b6cf-81921567_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:36.606373Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:36.606392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:36.606402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894743236636803:2904]
2025-09-30T14:50:36.606452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:36.606641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:36.606800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:36.606934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:36.607070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:36.607287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:36.607334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:36.607413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:36.614469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 108 sessionId: src_id|cdcc61d-67baba97-ab34b6cf-81921567_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:36.617075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:36.620374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:36.620401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:36.620422Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:36.620425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:36.620428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:36.620430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:36.620439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894743236636803:2904]
2025-09-30T14:50:36.620443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894743236636803:2904]
2025-09-30T14:50:36.620447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894743236636803:2904]
2025-09-30T14:50:36.620499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:36.620499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:36.620506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:36.620510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:36.620512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.620515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:36.620654Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:36.666554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894743326359996:3106]
2025-09-30T14:50:36.666777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 107, pipe: [1:7555894743326359996:3106]
2025-09-30T14:50:36.737159Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:36.737466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:36.737511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894743326359996:3106], now have 1 active actors on pipe
2025-09-30T14:50:36.737960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:36.738056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:36.738065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:36.738130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 108 reason: error at write: Disconnected sessionId: src_id|cdcc61d-67baba97-ab34b6cf-81921567_0
2025-09-30T14:50:36.738329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 108 sessionId: src_id|cdcc61d-67baba97-ab34b6cf-81921567_0 is DEAD
2025-09-30T14:50:36.738484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdcc61d-67baba97-ab34b6cf-81921567_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:36.738491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdcc61d-67baba97-ab34b6cf-81921567_0] Write session will restart in 0.008813s
2025-09-30T14:50:36.738500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:36.738514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdcc61d-67baba97-ab34b6cf-81921567_0] Write session: Do CDS request
2025-09-30T14:50:36.738520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdcc61d-67baba97-ab34b6cf-81921567_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:36.738545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894743326359996:3106]
2025-09-30T14:50:36.748722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdcc61d-67baba97-ab34b6cf-81921567_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:36.749039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:36.749073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 109
2025-09-30T14:50:36.749206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 109 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:36.749246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 109 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:36.749255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=109 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:36.749259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:36.749664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 109 sessionId:  describe result for acl check
2025-09-30T14:50:36.749696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:36.749704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:36.749705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:36.749713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894743326360144:3153] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:36.750220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894743326360144:3153] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:36.751488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:36.752325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894743326360144:3153] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:36.752659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:36.752857Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:36.752866Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:36.752884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:36.752954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:36.752994Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894743236636996:2913]
2025-09-30T14:50:36.753625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:36.753921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:36.753968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:36.754338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:36.754403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:36.754408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:36.754409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:36.754410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:36.754412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:36.754413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:36.754414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:36.754415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:36.754416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:36.754418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:36.754419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.754420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.754421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.754422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:36.754423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:36.754428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:36.754438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:36.754442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:36.754446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:36.754450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:36.754454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:36.754458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:36.754461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:36.754464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:36.754470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:36.754474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.754477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.754480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.754484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:36.754488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:36.754494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:36.754502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:36.754507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:36.754512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:36.754516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:36.754521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:36.754525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:36.754529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:36.754534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:36.754538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:36.754542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:36.754547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:36.754551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:36.754555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:36.754559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:36.754563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:36.754567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:36.754572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:36.754578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:36.754582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:36.754586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.754590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.754594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.754598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.754612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.754617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.754621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:36.754625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:36.754629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:36.754633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:36.754695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:36.754841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894743326360144:3153] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:36.754857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894743326360144:3153] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:36.754860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894743326360144:3153] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:36.754899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 109 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:36.760805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:36.761775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:36.761796Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:36.761798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:36.761801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:36.761807Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 108 [2:7555894743236636996:2913]
2025-09-30T14:50:36.761820Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:36.761834Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:36.761837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.761839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.761841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.761857Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:36.761870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:36.761877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:36.761939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.761948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.761949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.761952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:36.761955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:36.762010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:36.762017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.762029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.762045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.762061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:36.762080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894743236636990:2913]
2025-09-30T14:50:36.762086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894743236636990:2913]
2025-09-30T14:50:36.762088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894743236636990:2913]
2025-09-30T14:50:36.762096Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:36.762109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:36.762119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:36.762125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:36.762128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:36.762130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:36.762133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:36.762139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894743326360022:2454], now have 1 active actors on pipe
2025-09-30T14:50:36.762146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894743326360184:3153], now have 1 active actors on pipe
2025-09-30T14:50:36.762155Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 108
2025-09-30T14:50:36.762200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 108
2025-09-30T14:50:36.762178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894743236636990:2913]
2025-09-30T14:50:36.762187Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:36.762188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:36.762245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:36.762249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:36.762271Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c01f98a-c2af384-92b84ac5-69f5e245_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:36.762278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.762283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.762287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:36.762296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.762310Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:36.762326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:36.762527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:36.762542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:36.762565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:36.762673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 109 partition: 0 MaxSeqNo: 42 sessionId: src_id|6c01f98a-c2af384-92b84ac5-69f5e245_0
2025-09-30T14:50:36.763068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdcc61d-67baba97-ab34b6cf-81921567_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6c01f98a-c2af384-92b84ac5-69f5e245_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:36.765844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c01f98a-c2af384-92b84ac5-69f5e245_0] Write session: try to update token
2025-09-30T14:50:36.765863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c01f98a-c2af384-92b84ac5-69f5e245_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:36.779039Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:36.779060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:36.779062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:36.779065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:36.779075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894743236636990:2913]
2025-09-30T14:50:36.779080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894743236636990:2913]
2025-09-30T14:50:36.779085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894743236636990:2913]
2025-09-30T14:50:36.779128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:36.779135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.779138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:36.779155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:36.779164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:36.779169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:36.779362Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:36.780869Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 109 sessionId: src_id|6c01f98a-c2af384-92b84ac5-69f5e245_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:36.783548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:36.838612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894743326360202:3106]
2025-09-30T14:50:36.838978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 108, pipe: [1:7555894743326360202:3106]
2025-09-30T14:50:36.892358Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:36.892791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:36.892807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:36.892848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894743326360202:3106], now have 1 active actors on pipe
2025-09-30T14:50:36.893064Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:36.893173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894743326360202:3106]
2025-09-30T14:50:36.893221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:36.893295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 109 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6c01f98a-c2af384-92b84ac5-69f5e245_0
2025-09-30T14:50:36.893598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c01f98a-c2af384-92b84ac5-69f5e245_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:36.893606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c01f98a-c2af384-92b84ac5-69f5e245_0] Write session will restart in 0.007033s
2025-09-30T14:50:36.893644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c01f98a-c2af384-92b84ac5-69f5e245_0] Write session: Do CDS request
2025-09-30T14:50:36.893651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c01f98a-c2af384-92b84ac5-69f5e245_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:36.893476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 109 sessionId: src_id|6c01f98a-c2af384-92b84ac5-69f5e245_0 is DEAD
2025-09-30T14:50:36.893478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:36.901790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c01f98a-c2af384-92b84ac5-69f5e245_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:36.901844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:36.901861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 110
2025-09-30T14:50:36.902054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 110 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:36.902088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 110 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:36.902097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=110 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:36.902101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:36.902553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 110 sessionId:  describe result for acl check
2025-09-30T14:50:36.902594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:36.902596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:36.902598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:36.902604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894743326360217:3158] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:36.903153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894743326360217:3158] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:36.905889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894743326360217:3158] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:36.909279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894743326360217:3158] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:36.909294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894743326360217:3158] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:36.909297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894743326360217:3158] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:36.909306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 110 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:36.913033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:36.913637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:36.913841Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:36.913845Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:36.913855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:36.913894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:36.913927Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894743236637184:2921]
2025-09-30T14:50:36.914442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:36.914772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:36.914815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:36.915143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:36.915197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:36.915197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:36.915198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:36.915199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:36.915200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:36.915201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:36.915201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:36.915202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:36.915203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:36.915204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:36.915204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.915205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.915206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.915207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:36.915208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:36.915211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:36.915219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:36.915222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:36.915224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:36.915226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:36.915229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:36.915231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:36.915234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:36.915236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:36.915240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:36.915258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.915262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.915267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.915271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:36.915274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:36.915283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:36.915291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:36.915298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:36.915303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:36.915308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:36.915313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:36.915317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:36.915323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:36.915330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:36.915335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:36.915340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:36.915346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:36.915353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:36.915357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:36.915362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:36.915368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:36.915374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:36.915380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:36.915388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:36.915392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:36.915397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.915403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.915408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.915413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.915419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.915425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.915430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:36.915434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:36.915439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:36.915446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:36.915498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:36.922165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:36.923887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:36.923896Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:36.923900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:36.923904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:36.923912Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 109 [2:7555894743236637184:2921]
2025-09-30T14:50:36.923942Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:36.923962Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:36.923965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.923969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.923972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.923993Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:36.924019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:36.924028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:36.924121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.924123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.924125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.924129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:36.924132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:36.924219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:36.924222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.924241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:36.924253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:36.924270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:36.924296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894743236637179:2921]
2025-09-30T14:50:36.924298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894743236637179:2921]
2025-09-30T14:50:36.924300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894743236637179:2921]
2025-09-30T14:50:36.924316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:36.924335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:36.924350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:36.924353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:36.924398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894743236637179:2921]
2025-09-30T14:50:36.924400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:36.924584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894743326360330:3158], now have 1 active actors on pipe
2025-09-30T14:50:36.924607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894743326360203:2454], now have 1 active actors on pipe
2025-09-30T14:50:36.924636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:36.924639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:36.924641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:36.924647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:36.924751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 109
2025-09-30T14:50:36.924808Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 109
2025-09-30T14:50:36.924848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:36.924864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:36.924903Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bde17a74-bdf1d0dc-3c730bd9-9b89df48_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:36.924921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.924926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.924930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:36.924952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.924973Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:36.924998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:36.925317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:36.925336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:36.925367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:36.925535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 110 partition: 0 MaxSeqNo: 42 sessionId: src_id|bde17a74-bdf1d0dc-3c730bd9-9b89df48_0
2025-09-30T14:50:36.926081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c01f98a-c2af384-92b84ac5-69f5e245_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bde17a74-bdf1d0dc-3c730bd9-9b89df48_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:36.928860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bde17a74-bdf1d0dc-3c730bd9-9b89df48_0] Write session: try to update token
2025-09-30T14:50:36.928879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bde17a74-bdf1d0dc-3c730bd9-9b89df48_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:36.939964Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:36.939986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:36.939989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:36.939991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:36.940001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894743236637179:2921]
2025-09-30T14:50:36.940006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894743236637179:2921]
2025-09-30T14:50:36.940011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894743236637179:2921]
2025-09-30T14:50:36.940055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:36.940062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:36.940065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:36.940078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:36.940100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:36.940105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:36.940216Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:36.948380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 110 sessionId: src_id|bde17a74-bdf1d0dc-3c730bd9-9b89df48_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:36.951223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:36.993319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894743326360382:3106]
2025-09-30T14:50:36.993667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 109, pipe: [1:7555894743326360382:3106]
2025-09-30T14:50:37.054816Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:37.055320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:37.055335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:37.055360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894743326360382:3106], now have 1 active actors on pipe
2025-09-30T14:50:37.055559Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:37.056111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:37.056188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 110 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bde17a74-bdf1d0dc-3c730bd9-9b89df48_0
2025-09-30T14:50:37.056357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 110 sessionId: src_id|bde17a74-bdf1d0dc-3c730bd9-9b89df48_0 is DEAD
2025-09-30T14:50:37.056478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:37.056507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894743326360382:3106]
2025-09-30T14:50:37.059444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde17a74-bdf1d0dc-3c730bd9-9b89df48_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:37.059456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde17a74-bdf1d0dc-3c730bd9-9b89df48_0] Write session will restart in 0.008413s
2025-09-30T14:50:37.059480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde17a74-bdf1d0dc-3c730bd9-9b89df48_0] Write session: Do CDS request
2025-09-30T14:50:37.059486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde17a74-bdf1d0dc-3c730bd9-9b89df48_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:37.068751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bde17a74-bdf1d0dc-3c730bd9-9b89df48_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:37.071371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:37.071389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 111
2025-09-30T14:50:37.071606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 111 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:37.071634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 111 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:37.071639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=111 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:37.071647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:37.072149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 111 sessionId:  describe result for acl check
2025-09-30T14:50:37.072183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:37.072185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:37.072187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:37.072194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894747621327733:3164] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:37.072780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894747621327733:3164] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:37.075314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894747621327733:3164] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:37.082208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:37.083170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:37.079751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894747621327733:3164] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:37.079765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894747621327733:3164] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:37.079769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894747621327733:3164] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:37.079778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 111 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:37.083357Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:37.083366Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:37.083377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:37.083427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:37.083553Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894747531604647:2924]
2025-09-30T14:50:37.084212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:37.084561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:37.084606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:37.084928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:37.084987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:37.084994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:37.084996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:37.084997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:37.084998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:37.084999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:37.085000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:37.085002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:37.085003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:37.085004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:37.085005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.085007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.085008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.085009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:37.085010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:37.085016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:37.085027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:37.085031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:37.085035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:37.085039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:37.085043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:37.085047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:37.085051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:37.085055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:37.085061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:37.085065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.085070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.085073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.085077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:37.085081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:37.085088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:37.085096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:37.085101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:37.085107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:37.085112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:37.085118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:37.085123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:37.085128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:37.085133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:37.085138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:37.085145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:37.085151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:37.085155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:37.085161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:37.085165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:37.085170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:37.085175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:37.085180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:37.085185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:37.085190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:37.085195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.085200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.085204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.085209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.085214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.085219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.085223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:37.085229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:37.085233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:37.085238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:37.085287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:37.091297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:37.092366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:37.092386Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:37.092388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:37.092392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:37.092414Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 110 [2:7555894747531604647:2924]
2025-09-30T14:50:37.092432Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:37.092448Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:37.092460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.092464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.092466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.092484Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:37.092497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:37.092505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:37.092581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.092588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.092591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.092594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:37.092597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:37.092666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:37.092681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.092698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.092714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.092734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:37.092754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894747621327682:2454], now have 1 active actors on pipe
2025-09-30T14:50:37.092763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894747621327829:3164], now have 1 active actors on pipe
2025-09-30T14:50:37.092770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894747531604641:2924]
2025-09-30T14:50:37.092777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894747531604641:2924]
2025-09-30T14:50:37.092778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894747531604641:2924]
2025-09-30T14:50:37.092792Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:37.092805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:37.092805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:37.092808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:37.092810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:37.092825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:37.092829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:37.092868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894747531604641:2924]
2025-09-30T14:50:37.092879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:37.092900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:37.093030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:37.093043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:37.093068Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|487794da-803c3221-765ec441-7239de80_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:37.093082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.093086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.093089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:37.093098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.093110Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:37.093132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:37.093458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:37.093473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:37.093504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:37.094025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde17a74-bdf1d0dc-3c730bd9-9b89df48_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|487794da-803c3221-765ec441-7239de80_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:37.092839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 110
2025-09-30T14:50:37.092859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 110
2025-09-30T14:50:37.093654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 111 partition: 0 MaxSeqNo: 42 sessionId: src_id|487794da-803c3221-765ec441-7239de80_0
2025-09-30T14:50:37.096969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|487794da-803c3221-765ec441-7239de80_0] Write session: try to update token
2025-09-30T14:50:37.096990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|487794da-803c3221-765ec441-7239de80_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:37.106129Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:37.106150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:37.106153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:37.106155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:37.106165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894747531604641:2924]
2025-09-30T14:50:37.106170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894747531604641:2924]
2025-09-30T14:50:37.106174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894747531604641:2924]
2025-09-30T14:50:37.106216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:37.106225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.106227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:37.106343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:37.106366Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:37.106367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:37.106371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:37.114273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 111 sessionId: src_id|487794da-803c3221-765ec441-7239de80_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:37.117292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:37.156547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894747621327855:3106]
2025-09-30T14:50:37.156793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 110, pipe: [1:7555894747621327855:3106]
2025-09-30T14:50:37.218152Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:37.218538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:37.218552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:37.218574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894747621327855:3106], now have 1 active actors on pipe
2025-09-30T14:50:37.218765Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:37.218847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894747621327855:3106]
2025-09-30T14:50:37.218858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:37.218882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:37.218954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 111 reason: status is not ok: tablet will be restarted right now sessionId: src_id|487794da-803c3221-765ec441-7239de80_0
2025-09-30T14:50:37.219135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 111 sessionId: src_id|487794da-803c3221-765ec441-7239de80_0 is DEAD
2025-09-30T14:50:37.219236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|487794da-803c3221-765ec441-7239de80_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:37.219261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|487794da-803c3221-765ec441-7239de80_0] Write session will restart in 0.007284s
2025-09-30T14:50:37.219285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|487794da-803c3221-765ec441-7239de80_0] Write session: Do CDS request
2025-09-30T14:50:37.219290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|487794da-803c3221-765ec441-7239de80_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:37.227781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|487794da-803c3221-765ec441-7239de80_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:37.227886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:37.227901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 112
2025-09-30T14:50:37.228007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 112 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:37.228033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 112 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:37.228038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=112 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:37.228042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:37.228533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 112 sessionId:  describe result for acl check
2025-09-30T14:50:37.228570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:37.228572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:37.228574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:37.228580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894747621327903:3168] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:37.229139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894747621327903:3168] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:37.231380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894747621327903:3168] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:37.232477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:37.233436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:37.233775Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:37.233787Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:37.233800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:37.233855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:37.233893Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894747531604812:2926]
2025-09-30T14:50:37.234037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894747621327903:3168] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:37.234048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894747621327903:3168] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:37.234051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894747621327903:3168] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:37.234060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 112 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:37.234516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:37.234845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:37.234902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:37.235290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:37.235371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:37.235378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:37.235379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:37.235381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:37.235382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:37.235383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:37.235384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:37.235385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:37.235386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:37.235387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:37.235389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.235390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.235391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.235392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:37.235394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:37.235399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:37.235410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:37.235414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:37.235418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:37.235423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:37.235427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:37.235431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:37.235435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:37.235439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:37.235444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:37.235448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.235452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.235456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.235460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:37.235464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:37.235471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:37.235479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:37.235484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:37.235489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:37.235493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:37.235498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:37.235501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:37.235506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:37.235511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:37.235515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:37.235519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:37.235524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:37.235529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:37.235535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:37.235539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:37.235544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:37.235549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:37.235554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:37.235558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:37.235565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:37.235569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.235575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.235579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.235584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.235591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.235597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.235601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:37.235607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:37.235611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:37.235616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:37.235661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:37.241337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:37.242331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:37.242349Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:37.242351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:37.242356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:37.242362Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 111 [2:7555894747531604812:2926]
2025-09-30T14:50:37.242378Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:37.242394Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:37.242397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.242400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.242402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.242418Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:37.242430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:37.242436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:37.242586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.242594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.242596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.242599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:37.242602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:37.242665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:37.242672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.242697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.242712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.242730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:37.242755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894747621327856:2454], now have 1 active actors on pipe
2025-09-30T14:50:37.242758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894747621328017:3168], now have 1 active actors on pipe
2025-09-30T14:50:37.242764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894747531604807:2926]
2025-09-30T14:50:37.242766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894747531604807:2926]
2025-09-30T14:50:37.242770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894747531604807:2926]
2025-09-30T14:50:37.242781Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:37.242795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:37.242802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:37.242805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:37.242807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:37.242814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:37.242817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:37.242840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 111
2025-09-30T14:50:37.242857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894747531604807:2926]
2025-09-30T14:50:37.242869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:37.242892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:37.242845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 111
2025-09-30T14:50:37.243027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:37.243038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:37.243066Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e33a892b-11979e-475afd42-cab306fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:37.243078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.243081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.243089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:37.243098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.243115Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:37.243133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:37.243325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:37.243346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:37.243373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:37.243516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 112 partition: 0 MaxSeqNo: 42 sessionId: src_id|e33a892b-11979e-475afd42-cab306fc_0
2025-09-30T14:50:37.243901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|487794da-803c3221-765ec441-7239de80_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e33a892b-11979e-475afd42-cab306fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:37.246786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e33a892b-11979e-475afd42-cab306fc_0] Write session: try to update token
2025-09-30T14:50:37.246805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e33a892b-11979e-475afd42-cab306fc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:37.254917Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:37.254935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:37.254945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894747531604807:2926]
2025-09-30T14:50:37.254987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:37.254989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:37.255169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:37.255343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:37.255496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:37.255648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:37.255866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:37.255920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:37.262153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 112 sessionId: src_id|e33a892b-11979e-475afd42-cab306fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:37.265013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:37.265229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:37.265252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:37.265288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:37.265369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:37.266608Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:37.266625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:37.266627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:37.266629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:37.266639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894747531604807:2926]
2025-09-30T14:50:37.266648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894747531604807:2926]
2025-09-30T14:50:37.266652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894747531604807:2926]
2025-09-30T14:50:37.266708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:37.266721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.266724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:37.266873Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:37.271369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:37.271387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:37.271392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:37.318858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894747621328030:3106]
2025-09-30T14:50:37.319164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 111, pipe: [1:7555894747621328030:3106]
2025-09-30T14:50:37.381302Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:37.389282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:37.389309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:37.389488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:37.389553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:37.389622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:37.389694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:37.389747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:37.389757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:37.389826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:37.389892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:37.389958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:37.390035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:37.390079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:37.390086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:37.390182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:37.390245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:37.390315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:37.390385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:37.390432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:37.390438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:37.390509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:37.390823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:37.390893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:37.390959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:37.391001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:37.391013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:37.391089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:37.391152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:37.391221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:37.391307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:37.391354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:37.391363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:37.391435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:37.391503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:37.391569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:37.391633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:37.391675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:37.391677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:37.391751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:37.391814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:37.391885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:37.391953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:37.392001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:37.392008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:37.392075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:37.392139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:37.392206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:37.392267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:37.392311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:37.392317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:37.392384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:37.392445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:37.393306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894747621328030:3106]
2025-09-30T14:50:37.393353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:37.393356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:37.393384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 112 reason: error at write: Disconnected sessionId: src_id|e33a892b-11979e-475afd42-cab306fc_0
2025-09-30T14:50:37.393400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:37.393566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 112 sessionId: src_id|e33a892b-11979e-475afd42-cab306fc_0 is DEAD
2025-09-30T14:50:37.392510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:37.392581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:37.392621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:37.392623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:37.392688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:37.392749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:37.392811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:37.392873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:37.392933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:37.392936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:37.393004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894747621328030:3106], now have 1 active actors on pipe
2025-09-30T14:50:37.393918Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:37.395466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e33a892b-11979e-475afd42-cab306fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:37.395478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e33a892b-11979e-475afd42-cab306fc_0] Write session will restart in 0.008819s
2025-09-30T14:50:37.395503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e33a892b-11979e-475afd42-cab306fc_0] Write session: Do CDS request
2025-09-30T14:50:37.395510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e33a892b-11979e-475afd42-cab306fc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:37.405775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e33a892b-11979e-475afd42-cab306fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:37.405877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:37.405893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 113
2025-09-30T14:50:37.406047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 113 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:37.406090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 113 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:37.406096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=113 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:37.406101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:37.406564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 113 sessionId:  describe result for acl check
2025-09-30T14:50:37.406595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:37.406598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:37.406600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:37.406606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894747621328158:3172] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:37.407134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894747621328158:3172] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:37.407653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:37.408628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:37.408805Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:37.408813Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:37.408824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:37.408877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:37.408912Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894747531604979:2928]
2025-09-30T14:50:37.409551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:37.409723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894747621328158:3172] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:37.409928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:37.409974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:37.410301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:37.410364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:37.410370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:37.410371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:37.410372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:37.410373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:37.410374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:37.410375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:37.410376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:37.410378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:37.410379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:37.410381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.410382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.410383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.410384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:37.410385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:37.410391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:37.410401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:37.410404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:37.410408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:37.410413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:37.410416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:37.410421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:37.410425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:37.410429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:37.410434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:37.410438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.410442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.410447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.410451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:37.410455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:37.410463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:37.410472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:37.410478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:37.410489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:37.410494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:37.410503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:37.410508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:37.410516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:37.410521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:37.410527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:37.410532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:37.410538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:37.410544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:37.410553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:37.410557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:37.410563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:37.410573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:37.410578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:37.410589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:37.410594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:37.410598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.410604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.410609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.410614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.410619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.410624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.410628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:37.410645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:37.410654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:37.410659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:37.410706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:37.415831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894747621328158:3172] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:37.415851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894747621328158:3172] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:37.415855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894747621328158:3172] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:37.415864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 113 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:37.416213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:37.417481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:37.417497Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:37.417499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:37.417503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:37.417509Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 112 [2:7555894747531604979:2928]
2025-09-30T14:50:37.417524Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:37.417538Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:37.417545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.417549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.417551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.417567Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:37.417577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:37.417584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:37.417649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.417655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.417657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.417661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:37.417663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:37.417735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:37.417747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.417759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.417770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.417786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:37.417804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894747621328031:2454], now have 1 active actors on pipe
2025-09-30T14:50:37.417812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894747621328199:3172], now have 1 active actors on pipe
2025-09-30T14:50:37.417818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894747531604974:2928]
2025-09-30T14:50:37.417821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894747531604974:2928]
2025-09-30T14:50:37.417824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894747531604974:2928]
2025-09-30T14:50:37.417844Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:37.417845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:37.417848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:37.417819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 112
2025-09-30T14:50:37.417849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:37.417861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:37.417848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 112
2025-09-30T14:50:37.417875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:37.417878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:37.417924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:37.417935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:37.417947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894747531604974:2928]
2025-09-30T14:50:37.417955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:37.417979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:37.417985Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2e6c2a5-ce9dbb24-379c7a5c-7d38634e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:37.417991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.417995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.417997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:37.418009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.418019Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:37.418046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:37.418234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:37.418249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:37.418272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:37.418364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 113 partition: 0 MaxSeqNo: 42 sessionId: src_id|f2e6c2a5-ce9dbb24-379c7a5c-7d38634e_0
2025-09-30T14:50:37.418735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e33a892b-11979e-475afd42-cab306fc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f2e6c2a5-ce9dbb24-379c7a5c-7d38634e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:37.421695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2e6c2a5-ce9dbb24-379c7a5c-7d38634e_0] Write session: try to update token
2025-09-30T14:50:37.421719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2e6c2a5-ce9dbb24-379c7a5c-7d38634e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:37.430787Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:37.430809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:37.430811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:37.430813Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:37.430826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894747531604974:2928]
2025-09-30T14:50:37.430830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894747531604974:2928]
2025-09-30T14:50:37.430834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894747531604974:2928]
2025-09-30T14:50:37.430878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:37.430885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.430888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:37.430910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:37.430925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:37.430932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:37.431048Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:37.437959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 113 sessionId: src_id|f2e6c2a5-ce9dbb24-379c7a5c-7d38634e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:37.440619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:37.493474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894747621328209:3106]
2025-09-30T14:50:37.493837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 112, pipe: [1:7555894747621328209:3106]
2025-09-30T14:50:37.545215Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:37.545515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:37.545525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:37.545564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894747621328209:3106], now have 1 active actors on pipe
2025-09-30T14:50:37.545834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:37.545848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:37.545857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:37.545903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894747621328209:3106]
2025-09-30T14:50:37.545911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 113 reason: error at write: Disconnected sessionId: src_id|f2e6c2a5-ce9dbb24-379c7a5c-7d38634e_0
2025-09-30T14:50:37.546080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 113 sessionId: src_id|f2e6c2a5-ce9dbb24-379c7a5c-7d38634e_0 is DEAD
2025-09-30T14:50:37.545824Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:37.546212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2e6c2a5-ce9dbb24-379c7a5c-7d38634e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:37.546222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2e6c2a5-ce9dbb24-379c7a5c-7d38634e_0] Write session will restart in 0.009477s
2025-09-30T14:50:37.546246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2e6c2a5-ce9dbb24-379c7a5c-7d38634e_0] Write session: Do CDS request
2025-09-30T14:50:37.546255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2e6c2a5-ce9dbb24-379c7a5c-7d38634e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:37.556817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2e6c2a5-ce9dbb24-379c7a5c-7d38634e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:37.556880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:37.556892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 114
2025-09-30T14:50:37.559441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 114 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:37.559497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 114 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:37.559507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=114 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:37.559511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:37.559704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:37.559946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 114 sessionId:  describe result for acl check
2025-09-30T14:50:37.559983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:37.559990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:37.559991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:37.559997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894747621328339:3177] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:37.560516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894747621328339:3177] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:37.560786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:37.560974Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:37.560986Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:37.560997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:37.561049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:37.561086Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894747531605149:2931]
2025-09-30T14:50:37.561775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:37.562060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:37.562112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:37.562249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894747621328339:3177] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:37.562412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:37.562497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:37.562504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:37.562505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:37.562506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:37.562507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:37.562508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:37.562509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:37.562511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:37.562512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:37.562513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:37.562514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.562515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.562516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.562518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:37.562519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:37.562524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:37.562534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:37.562538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:37.562542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:37.562546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:37.562550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:37.562552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:37.562555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:37.562557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:37.562560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:37.562562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.562564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.562566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.562569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:37.562571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:37.562576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:37.562581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:37.562585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:37.562589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:37.562591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:37.562594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:37.562597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:37.562600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:37.562603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:37.562606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:37.562609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:37.562612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:37.562614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:37.562618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:37.562620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:37.562623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:37.562625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:37.562628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:37.562630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:37.562633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:37.562636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.562639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.562642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.562645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.562647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.562650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.562653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:37.562656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:37.562658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:37.562661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:37.562710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:37.568063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894747621328339:3177] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:37.568079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894747621328339:3177] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:37.568083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894747621328339:3177] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:37.568107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 114 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:37.568429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:37.569317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:37.569333Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:37.569336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:37.569340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:37.569347Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 113 [2:7555894747531605149:2931]
2025-09-30T14:50:37.569363Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:37.569380Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:37.569389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.569393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.569396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.569412Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:37.569423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:37.569430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:37.569495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.569506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.569508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.569512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:37.569514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:37.569582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:37.569589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.569602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.569615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.569637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:37.569659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894747621328378:3177], now have 1 active actors on pipe
2025-09-30T14:50:37.569663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894747621328210:2454], now have 1 active actors on pipe
2025-09-30T14:50:37.569670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894747531605144:2931]
2025-09-30T14:50:37.569678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894747531605144:2931]
2025-09-30T14:50:37.569681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894747531605144:2931]
2025-09-30T14:50:37.569692Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:37.569705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:37.569707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:37.569709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:37.569712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:37.569723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:37.569726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:37.569709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 113
2025-09-30T14:50:37.569715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 113
2025-09-30T14:50:37.569761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894747531605144:2931]
2025-09-30T14:50:37.569773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:37.569777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:37.569789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:37.569794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:37.569844Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe68bbab-5cc8de60-1ab9450-82089eaf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:37.569860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.569864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.569866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:37.569876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.569884Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:37.569900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:37.570309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:37.570321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:37.570338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:37.570436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 114 partition: 0 MaxSeqNo: 42 sessionId: src_id|fe68bbab-5cc8de60-1ab9450-82089eaf_0
2025-09-30T14:50:37.570876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2e6c2a5-ce9dbb24-379c7a5c-7d38634e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fe68bbab-5cc8de60-1ab9450-82089eaf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:37.573777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe68bbab-5cc8de60-1ab9450-82089eaf_0] Write session: try to update token
2025-09-30T14:50:37.573801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe68bbab-5cc8de60-1ab9450-82089eaf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:37.585094Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:37.585114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:37.585117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:37.585119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:37.585129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894747531605144:2931]
2025-09-30T14:50:37.585134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894747531605144:2931]
2025-09-30T14:50:37.585138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894747531605144:2931]
2025-09-30T14:50:37.585175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:37.585177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:37.585181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:37.585182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.585185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:37.585186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:37.585342Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:37.589905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 114 sessionId: src_id|fe68bbab-5cc8de60-1ab9450-82089eaf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:37.592646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:37.647357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894747621328386:3106]
2025-09-30T14:50:37.647660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 113, pipe: [1:7555894747621328386:3106]
2025-09-30T14:50:37.700156Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:37.700721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:37.700732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:37.700775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894747621328386:3106], now have 1 active actors on pipe
2025-09-30T14:50:37.703551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:37.703565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:37.703637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 114 reason: error at write: Disconnected sessionId: src_id|fe68bbab-5cc8de60-1ab9450-82089eaf_0
2025-09-30T14:50:37.703813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 114 sessionId: src_id|fe68bbab-5cc8de60-1ab9450-82089eaf_0 is DEAD
2025-09-30T14:50:37.703576Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:37.703956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:37.703993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894747621328386:3106]
2025-09-30T14:50:37.704322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe68bbab-5cc8de60-1ab9450-82089eaf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:37.704332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe68bbab-5cc8de60-1ab9450-82089eaf_0] Write session will restart in 0.005482s
2025-09-30T14:50:37.704349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe68bbab-5cc8de60-1ab9450-82089eaf_0] Write session: Do CDS request
2025-09-30T14:50:37.704353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe68bbab-5cc8de60-1ab9450-82089eaf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:37.710782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe68bbab-5cc8de60-1ab9450-82089eaf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:37.710912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:37.710928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 115
2025-09-30T14:50:37.711392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 115 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:37.711465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 115 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:37.711475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=115 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:37.711479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:37.712060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 115 sessionId:  describe result for acl check
2025-09-30T14:50:37.712095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:37.712097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:37.712099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:37.712104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894747621328413:3181] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:37.712475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894747621328413:3181] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:37.716056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894747621328413:3181] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:37.719081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894747621328413:3181] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:37.719097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894747621328413:3181] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:37.719101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894747621328413:3181] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:37.719109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 115 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:37.720162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:37.721406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:37.721579Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:37.721588Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:37.721599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:37.721649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:37.721686Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894747531605331:2934]
2025-09-30T14:50:37.722337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:37.722720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:37.722781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:37.723117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:37.723193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:37.723194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:37.723195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:37.723197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:37.723198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:37.723199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:37.723201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:37.723203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:37.723204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:37.723205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:37.723206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.723207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.723208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.723209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:37.723210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:37.723216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:37.723228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:37.723232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:37.723237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:37.723259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:37.723264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:37.723268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:37.723272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:37.723276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:37.723280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:37.723284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.723287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.723291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.723294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:37.723298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:37.723306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:37.723315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:37.723321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:37.723327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:37.723332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:37.723337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:37.723342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:37.723347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:37.723354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:37.723359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:37.723363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:37.723369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:37.723373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:37.723377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:37.723382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:37.723387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:37.723392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:37.723398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:37.723403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:37.723408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:37.723413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.723418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.723422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.723426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.723432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.723437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.723441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:37.723446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:37.723451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:37.723456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:37.723514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:37.729613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:37.730493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:37.730512Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:37.730515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:37.730519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:37.730527Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 114 [2:7555894747531605331:2934]
2025-09-30T14:50:37.730546Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:37.730563Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:37.730570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.730573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.730574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.730590Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:37.730603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:37.730614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:37.730676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.730696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.730698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.730702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:37.730704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:37.730779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:37.730788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.730802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.730815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.730834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:37.730850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894747531605325:2934]
2025-09-30T14:50:37.730854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894747531605325:2934]
2025-09-30T14:50:37.730856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894747531605325:2934]
2025-09-30T14:50:37.730871Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:37.730884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:37.730899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:37.730902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:37.730920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:37.730924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:37.730926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:37.730936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894747531605325:2934]
2025-09-30T14:50:37.730939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:37.730943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:37.731084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894747621328387:2454], now have 1 active actors on pipe
2025-09-30T14:50:37.731092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894747621328560:3181], now have 1 active actors on pipe
2025-09-30T14:50:37.731265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 114
2025-09-30T14:50:37.731287Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 114
2025-09-30T14:50:37.731372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:37.731385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:37.731414Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dab6b9e8-1813ef8b-3063cd5b-b7ff5a0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:37.731423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.731427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.731429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:37.731441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.731452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:37.731470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:37.731985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:37.732000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:37.732021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:37.732140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 115 partition: 0 MaxSeqNo: 42 sessionId: src_id|dab6b9e8-1813ef8b-3063cd5b-b7ff5a0c_0
2025-09-30T14:50:37.732526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe68bbab-5cc8de60-1ab9450-82089eaf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dab6b9e8-1813ef8b-3063cd5b-b7ff5a0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:37.735412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dab6b9e8-1813ef8b-3063cd5b-b7ff5a0c_0] Write session: try to update token
2025-09-30T14:50:37.735433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dab6b9e8-1813ef8b-3063cd5b-b7ff5a0c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:37.749616Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:37.749638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:37.749640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:37.749642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:37.749652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894747531605325:2934]
2025-09-30T14:50:37.749657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894747531605325:2934]
2025-09-30T14:50:37.749661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894747531605325:2934]
2025-09-30T14:50:37.749703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:37.749710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.749712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:37.749860Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:37.750059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:37.750067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:37.750071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:37.761037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 115 sessionId: src_id|dab6b9e8-1813ef8b-3063cd5b-b7ff5a0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:37.763903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:37.803925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894747621328588:3106]
2025-09-30T14:50:37.804242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 114, pipe: [1:7555894747621328588:3106]
2025-09-30T14:50:37.876880Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:37.877441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:37.877452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:37.877472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894747621328588:3106], now have 1 active actors on pipe
2025-09-30T14:50:37.878625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:37.878676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:37.878703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:37.878765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 115 reason: error at write: Disconnected sessionId: src_id|dab6b9e8-1813ef8b-3063cd5b-b7ff5a0c_0
2025-09-30T14:50:37.878819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894747621328588:3106]
2025-09-30T14:50:37.879099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dab6b9e8-1813ef8b-3063cd5b-b7ff5a0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:37.879110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dab6b9e8-1813ef8b-3063cd5b-b7ff5a0c_0] Write session will restart in 0.007342s
2025-09-30T14:50:37.879134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dab6b9e8-1813ef8b-3063cd5b-b7ff5a0c_0] Write session: Do CDS request
2025-09-30T14:50:37.879140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dab6b9e8-1813ef8b-3063cd5b-b7ff5a0c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:37.878969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 115 sessionId: src_id|dab6b9e8-1813ef8b-3063cd5b-b7ff5a0c_0 is DEAD
2025-09-30T14:50:37.878436Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:37.887731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dab6b9e8-1813ef8b-3063cd5b-b7ff5a0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:37.889765Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:37.889780Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 116
2025-09-30T14:50:37.889927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 116 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:37.889958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 116 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:37.889965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=116 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:37.889969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:37.890934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 116 sessionId:  describe result for acl check
2025-09-30T14:50:37.890973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:37.890979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:37.890981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:37.890987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894747621328623:3193] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:37.891594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894747621328623:3193] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:37.899544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894747621328623:3193] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:37.905472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894747621328623:3193] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:37.905489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894747621328623:3193] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:37.905493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894747621328623:3193] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:37.905501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 116 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:37.907235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:37.908337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:37.908505Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:37.908516Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:37.908526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:37.908575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:37.908615Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894747531605537:2948]
2025-09-30T14:50:37.909309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:37.909623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:37.909666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:37.909985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:37.910043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:37.910049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:37.910050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:37.910051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:37.910052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:37.910053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:37.910055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:37.910056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:37.910057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:37.910059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:37.910060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.910061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.910062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.910064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:37.910065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:37.910070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:37.910080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:37.910084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:37.910088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:37.910092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:37.910095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:37.910099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:37.910104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:37.910108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:37.910112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:37.910115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.910118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.910121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.910125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:37.910129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:37.910137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:37.910146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:37.910152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:37.910157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:37.910161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:37.910167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:37.910172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:37.910177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:37.910182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:37.910189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:37.910193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:37.910198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:37.910203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:37.910208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:37.910219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:37.910225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:37.910229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:37.910234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:37.910239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:37.910245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:37.910249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.910254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.910259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.910264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.910269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.910274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.910279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:37.910283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:37.910288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:37.910294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:37.910338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:37.916208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:37.917134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:37.917151Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:37.917154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:37.917159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:37.917166Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 115 [2:7555894747531605537:2948]
2025-09-30T14:50:37.917182Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:37.917198Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:37.917201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.917204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.917206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.917220Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:37.917227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:37.917235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:37.917293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.917302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.917304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.917308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:37.917311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:37.917382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:37.917391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.917405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:37.917418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:37.917437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:37.917459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894747531605532:2948]
2025-09-30T14:50:37.917472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894747531605532:2948]
2025-09-30T14:50:37.917474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894747531605532:2948]
2025-09-30T14:50:37.917487Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:37.917502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:37.917522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:37.917530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:37.917550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:37.917561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:37.917564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:37.917567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894747531605532:2948]
2025-09-30T14:50:37.917570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:37.917643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:37.917705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894747621328598:2454], now have 1 active actors on pipe
2025-09-30T14:50:37.917733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894747621328762:3193], now have 1 active actors on pipe
2025-09-30T14:50:37.917928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 115
2025-09-30T14:50:37.917956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 115
2025-09-30T14:50:37.918072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:37.918085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:37.918111Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63a6febd-318b6f2e-167f182d-4e4d97bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:37.918123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.918127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.918134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:37.918144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.918157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:37.918176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:37.918408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:37.918419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:37.918433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:37.918566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 116 partition: 0 MaxSeqNo: 42 sessionId: src_id|63a6febd-318b6f2e-167f182d-4e4d97bb_0
2025-09-30T14:50:37.918967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dab6b9e8-1813ef8b-3063cd5b-b7ff5a0c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|63a6febd-318b6f2e-167f182d-4e4d97bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:37.921881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63a6febd-318b6f2e-167f182d-4e4d97bb_0] Write session: try to update token
2025-09-30T14:50:37.921901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63a6febd-318b6f2e-167f182d-4e4d97bb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:37.930569Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:37.930591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:37.930593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:37.930596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:37.930605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894747531605532:2948]
2025-09-30T14:50:37.930610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894747531605532:2948]
2025-09-30T14:50:37.930614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894747531605532:2948]
2025-09-30T14:50:37.930652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:37.930659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:37.930658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:37.930664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:37.930665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:37.930668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:37.930827Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:37.945005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 116 sessionId: src_id|63a6febd-318b6f2e-167f182d-4e4d97bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:37.947897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:37.978306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894747621328784:3106]
2025-09-30T14:50:37.978581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 115, pipe: [1:7555894747621328784:3106]
2025-09-30T14:50:38.052638Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:38.053124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:38.053140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:38.053160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894747621328784:3106], now have 1 active actors on pipe
2025-09-30T14:50:38.053414Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:38.053442Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:38.053454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894747621328784:3106]
2025-09-30T14:50:38.053478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:38.053481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:38.053553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 116 reason: error at write: Disconnected sessionId: src_id|63a6febd-318b6f2e-167f182d-4e4d97bb_0
2025-09-30T14:50:38.053777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 116 sessionId: src_id|63a6febd-318b6f2e-167f182d-4e4d97bb_0 is DEAD
2025-09-30T14:50:38.053994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63a6febd-318b6f2e-167f182d-4e4d97bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:38.054006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63a6febd-318b6f2e-167f182d-4e4d97bb_0] Write session will restart in 0.007417s
2025-09-30T14:50:38.054028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63a6febd-318b6f2e-167f182d-4e4d97bb_0] Write session: Do CDS request
2025-09-30T14:50:38.054037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63a6febd-318b6f2e-167f182d-4e4d97bb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:38.062778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63a6febd-318b6f2e-167f182d-4e4d97bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:38.065698Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:38.065715Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 117
2025-09-30T14:50:38.065953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 117 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:38.065999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 117 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:38.066010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=117 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:38.066014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:38.066462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 117 sessionId:  describe result for acl check
2025-09-30T14:50:38.066496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:38.066501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:38.066504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:38.066510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894751916296109:3201] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:38.067074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894751916296109:3201] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:38.070484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894751916296109:3201] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:38.074658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:38.074888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894751916296109:3201] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:38.074903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894751916296109:3201] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:38.074908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894751916296109:3201] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:38.074916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 117 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:38.075685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:38.075859Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:38.075870Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:38.075880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:38.075934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:38.075980Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894751826573006:2951]
2025-09-30T14:50:38.076677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:38.077018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:38.077078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:38.077445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:38.077517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:38.077523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:38.077524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:38.077526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:38.077527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:38.077528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:38.077530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:38.077531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:38.077532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:38.077533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:38.077534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.077536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.077537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.077538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:38.077539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:38.077545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:38.077556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:38.077561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:38.077565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:38.077569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:38.077573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:38.077577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:38.077581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:38.077585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:38.077591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:38.077595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.077599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.077603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.077607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:38.077611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:38.077618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:38.077626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:38.077633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:38.077648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:38.077657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:38.077661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:38.077665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:38.077670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:38.077675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:38.077680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:38.077685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:38.077690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:38.077699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:38.077705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:38.077709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:38.077714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:38.077723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:38.077728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:38.077733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:38.077742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:38.077748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.077758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.077762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.077767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.077772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.077781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.077786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:38.077791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:38.077800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:38.077805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:38.077849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:38.083605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:38.084502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:38.084515Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:38.084517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:38.084521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:38.084526Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 116 [2:7555894751826573006:2951]
2025-09-30T14:50:38.084539Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:38.084552Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:38.084554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.084556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.084558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.084570Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:38.084576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:38.084583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:38.084627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.084632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.084634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.084636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:38.084638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:38.084697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:38.084703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.084712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.084718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.084727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:38.084742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894751826573000:2951]
2025-09-30T14:50:38.084748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894751826573000:2951]
2025-09-30T14:50:38.084750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894751826573000:2951]
2025-09-30T14:50:38.084757Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:38.084769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:38.084774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:38.084779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:38.084782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:38.084787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:38.084790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:38.084800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894751916296255:3201], now have 1 active actors on pipe
2025-09-30T14:50:38.084804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894751916296087:2454], now have 1 active actors on pipe
2025-09-30T14:50:38.084834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894751826573000:2951]
2025-09-30T14:50:38.084851Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:38.084873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:38.084905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 116
2025-09-30T14:50:38.084949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 116
2025-09-30T14:50:38.085066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:38.085078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:38.085107Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca32b7e3-45d609f8-88efcc0a-e1168a22_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:38.085120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.085126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.085128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:38.085140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.085154Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:38.085175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:38.085434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:38.085445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:38.085462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:38.085743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 117 partition: 0 MaxSeqNo: 42 sessionId: src_id|ca32b7e3-45d609f8-88efcc0a-e1168a22_0
2025-09-30T14:50:38.086203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63a6febd-318b6f2e-167f182d-4e4d97bb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ca32b7e3-45d609f8-88efcc0a-e1168a22_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:38.089144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca32b7e3-45d609f8-88efcc0a-e1168a22_0] Write session: try to update token
2025-09-30T14:50:38.089163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca32b7e3-45d609f8-88efcc0a-e1168a22_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:38.101257Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:38.101277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:38.101279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:38.101282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:38.101292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894751826573000:2951]
2025-09-30T14:50:38.101297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894751826573000:2951]
2025-09-30T14:50:38.101301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894751826573000:2951]
2025-09-30T14:50:38.101342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:38.101349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.101348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:38.101351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:38.101356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:38.101361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:38.101487Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:38.106136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 117 sessionId: src_id|ca32b7e3-45d609f8-88efcc0a-e1168a22_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:38.108933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:38.153586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894751916296267:3106]
2025-09-30T14:50:38.153979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 116, pipe: [1:7555894751916296267:3106]
2025-09-30T14:50:38.220228Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:38.221157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:38.221177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:38.221218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894751916296267:3106], now have 1 active actors on pipe
2025-09-30T14:50:38.221457Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:38.221489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:38.221492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:38.221519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894751916296267:3106]
2025-09-30T14:50:38.221558Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:38.221601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 117 reason: error at write: Disconnected sessionId: src_id|ca32b7e3-45d609f8-88efcc0a-e1168a22_0
2025-09-30T14:50:38.221786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 117 sessionId: src_id|ca32b7e3-45d609f8-88efcc0a-e1168a22_0 is DEAD
2025-09-30T14:50:38.221956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca32b7e3-45d609f8-88efcc0a-e1168a22_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:38.221967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca32b7e3-45d609f8-88efcc0a-e1168a22_0] Write session will restart in 0.008788s
2025-09-30T14:50:38.221995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca32b7e3-45d609f8-88efcc0a-e1168a22_0] Write session: Do CDS request
2025-09-30T14:50:38.222003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca32b7e3-45d609f8-88efcc0a-e1168a22_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:38.231774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca32b7e3-45d609f8-88efcc0a-e1168a22_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:38.231861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:38.231877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 118
2025-09-30T14:50:38.232024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 118 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:38.232060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 118 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:38.232065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=118 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:38.232069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:38.232543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 118 sessionId:  describe result for acl check
2025-09-30T14:50:38.232591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:38.232598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:38.232603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:38.232608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894751916296288:3205] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:38.233189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894751916296288:3205] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:38.236410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894751916296288:3205] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:38.239545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894751916296288:3205] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:38.239562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894751916296288:3205] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:38.239565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894751916296288:3205] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:38.239575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 118 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:38.241626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:38.242730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:38.243029Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:38.243041Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:38.243056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:38.243133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:38.243192Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894751826573178:2953]
2025-09-30T14:50:38.243899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:38.244292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:38.244359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:38.244745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:38.244816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:38.244823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:38.244824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:38.244825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:38.244827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:38.244829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:38.244831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:38.244832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:38.244833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:38.244835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:38.244836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.244837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.244839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.244840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:38.244842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:38.244849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:38.244862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:38.244867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:38.244871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:38.244875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:38.244880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:38.244885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:38.244889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:38.244894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:38.244899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:38.244904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.244909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.244914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.244918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:38.244923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:38.244931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:38.244941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:38.244947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:38.244954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:38.244960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:38.244971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:38.244978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:38.244989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:38.244995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:38.245001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:38.245006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:38.245012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:38.245017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:38.245030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:38.245035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:38.245045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:38.245051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:38.245062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:38.245066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:38.245072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:38.245077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.245082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.245088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.245093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.245099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.245104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.245109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:38.245115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:38.245120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:38.245126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:38.245170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:38.251381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:38.253879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:38.253906Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:38.253910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:38.253914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:38.253922Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 117 [2:7555894751826573178:2953]
2025-09-30T14:50:38.253942Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:38.253959Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:38.253962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.253966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.253969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.253986Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:38.253994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:38.254001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:38.254080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.254092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.254094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.254100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:38.254103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:38.254181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:38.254193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.254207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.254218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.254237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:38.254262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894751916296268:2454], now have 1 active actors on pipe
2025-09-30T14:50:38.254266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894751916296432:3205], now have 1 active actors on pipe
2025-09-30T14:50:38.254273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894751826573173:2953]
2025-09-30T14:50:38.254281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894751826573173:2953]
2025-09-30T14:50:38.254284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894751826573173:2953]
2025-09-30T14:50:38.254297Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:38.254311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:38.254318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:38.254322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:38.254325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:38.254331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:38.254335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:38.254376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894751826573173:2953]
2025-09-30T14:50:38.254385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:38.254388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:38.254355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 117
2025-09-30T14:50:38.254381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 117
2025-09-30T14:50:38.254426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:38.254434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:38.254694Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4c4dd4e6-46101dca-aca1f50f-2ece96f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:38.254709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.254713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.254716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:38.254727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.254738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:38.254763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:38.254995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:38.255009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:38.255033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:38.255201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 118 partition: 0 MaxSeqNo: 42 sessionId: src_id|4c4dd4e6-46101dca-aca1f50f-2ece96f6_0
2025-09-30T14:50:38.255610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca32b7e3-45d609f8-88efcc0a-e1168a22_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4c4dd4e6-46101dca-aca1f50f-2ece96f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:38.264596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c4dd4e6-46101dca-aca1f50f-2ece96f6_0] Write session: try to update token
2025-09-30T14:50:38.264625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c4dd4e6-46101dca-aca1f50f-2ece96f6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:38.269272Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:38.269296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:38.269299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:38.269302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:38.269312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894751826573173:2953]
2025-09-30T14:50:38.269317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894751826573173:2953]
2025-09-30T14:50:38.269322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894751826573173:2953]
2025-09-30T14:50:38.269371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:38.269378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.269381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:38.269387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:38.269395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:38.269399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:38.269565Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:38.293847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 118 sessionId: src_id|4c4dd4e6-46101dca-aca1f50f-2ece96f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:38.296940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:38.321885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894751916296448:3106]
2025-09-30T14:50:38.322215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 117, pipe: [1:7555894751916296448:3106]
2025-09-30T14:50:38.390805Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:38.391371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:38.391389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:38.391408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894751916296448:3106], now have 1 active actors on pipe
2025-09-30T14:50:38.391607Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:38.391660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:38.391695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894751916296448:3106]
2025-09-30T14:50:38.391708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:38.391780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 118 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4c4dd4e6-46101dca-aca1f50f-2ece96f6_0
2025-09-30T14:50:38.391956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 118 sessionId: src_id|4c4dd4e6-46101dca-aca1f50f-2ece96f6_0 is DEAD
2025-09-30T14:50:38.392131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c4dd4e6-46101dca-aca1f50f-2ece96f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:38.392143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c4dd4e6-46101dca-aca1f50f-2ece96f6_0] Write session will restart in 0.005163s
2025-09-30T14:50:38.392169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c4dd4e6-46101dca-aca1f50f-2ece96f6_0] Write session: Do CDS request
2025-09-30T14:50:38.392175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c4dd4e6-46101dca-aca1f50f-2ece96f6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:38.398856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c4dd4e6-46101dca-aca1f50f-2ece96f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:38.398976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:38.398993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 119
2025-09-30T14:50:38.399854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 119 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:38.399901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 119 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:38.399907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=119 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:38.399913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:38.400400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 119 sessionId:  describe result for acl check
2025-09-30T14:50:38.400432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:38.400439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:38.400441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:38.400447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894751916296463:3209] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:38.400992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894751916296463:3209] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:38.404148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894751916296463:3209] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:38.407945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894751916296463:3209] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:38.407968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894751916296463:3209] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:38.407972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894751916296463:3209] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:38.407981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 119 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:38.409873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:38.410952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:38.411180Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:38.411193Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:38.411208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:38.411299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:38.411348Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894751826573351:2955]
2025-09-30T14:50:38.411963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:38.412287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:38.412341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:38.412671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:38.412740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:38.412757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:38.412758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:38.412759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:38.412761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:38.412762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:38.412763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:38.412765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:38.412766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:38.412767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:38.412768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.412770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.412771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.412772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:38.412773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:38.412779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:38.412790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:38.412795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:38.412800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:38.412804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:38.412808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:38.412812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:38.412816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:38.412821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:38.412825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:38.412829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.412834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.412838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.412842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:38.412846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:38.412854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:38.412862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:38.412868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:38.412873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:38.412877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:38.412881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:38.412886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:38.412890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:38.412894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:38.412899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:38.412904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:38.412909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:38.412915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:38.412921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:38.412926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:38.412931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:38.412936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:38.412941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:38.412946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:38.412952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:38.412964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.412969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.412974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.412980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.412991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.412997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.413001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:38.413006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:38.413011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:38.413016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:38.413062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:38.418821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:38.419791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:38.419810Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:38.419813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:38.419817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:38.419825Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 118 [2:7555894751826573351:2955]
2025-09-30T14:50:38.419843Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:38.419862Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:38.419865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.419867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.419870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.419887Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:38.419900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:38.419907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:38.419977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.419987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.419989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.419992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:38.419995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:38.420160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:38.420179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.420193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.420205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.420224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:38.420244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894751916296449:2454], now have 1 active actors on pipe
2025-09-30T14:50:38.420248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894751916296616:3209], now have 1 active actors on pipe
2025-09-30T14:50:38.420256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894751826573346:2955]
2025-09-30T14:50:38.420258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894751826573346:2955]
2025-09-30T14:50:38.420260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894751826573346:2955]
2025-09-30T14:50:38.420269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:38.420278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:38.420282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:38.420283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:38.420285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:38.420298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:38.420301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:38.420344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894751826573346:2955]
2025-09-30T14:50:38.420352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:38.420359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:38.420509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:38.420522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:38.420211Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 118
2025-09-30T14:50:38.420548Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2d3216a-2ccf856b-5cb975e6-44cc5606_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:38.420260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 118
2025-09-30T14:50:38.420561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.420572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.420580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:38.420589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.420615Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:38.420630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:38.420843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:38.420856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:38.420879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:38.420965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 119 partition: 0 MaxSeqNo: 42 sessionId: src_id|a2d3216a-2ccf856b-5cb975e6-44cc5606_0
2025-09-30T14:50:38.421500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c4dd4e6-46101dca-aca1f50f-2ece96f6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a2d3216a-2ccf856b-5cb975e6-44cc5606_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:38.424293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2d3216a-2ccf856b-5cb975e6-44cc5606_0] Write session: try to update token
2025-09-30T14:50:38.424310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2d3216a-2ccf856b-5cb975e6-44cc5606_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:38.433016Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:38.433041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:38.433043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:38.433045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:38.433056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894751826573346:2955]
2025-09-30T14:50:38.433061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894751826573346:2955]
2025-09-30T14:50:38.433065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894751826573346:2955]
2025-09-30T14:50:38.433108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:38.433115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.433114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:38.433118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:38.433129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:38.433133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:38.433528Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:38.446738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 119 sessionId: src_id|a2d3216a-2ccf856b-5cb975e6-44cc5606_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:38.449610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:38.491827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894751916296633:3106]
2025-09-30T14:50:38.492085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 118, pipe: [1:7555894751916296633:3106]
2025-09-30T14:50:38.548419Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:38.548767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:38.548787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:38.548807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894751916296633:3106], now have 1 active actors on pipe
2025-09-30T14:50:38.549023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894751916296633:3106]
2025-09-30T14:50:38.549054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:38.549041Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:38.549084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:38.549091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:38.549145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 119 reason: error at write: Disconnected sessionId: src_id|a2d3216a-2ccf856b-5cb975e6-44cc5606_0
2025-09-30T14:50:38.549363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 119 sessionId: src_id|a2d3216a-2ccf856b-5cb975e6-44cc5606_0 is DEAD
2025-09-30T14:50:38.549538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2d3216a-2ccf856b-5cb975e6-44cc5606_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:38.549549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2d3216a-2ccf856b-5cb975e6-44cc5606_0] Write session will restart in 0.006173s
2025-09-30T14:50:38.549587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2d3216a-2ccf856b-5cb975e6-44cc5606_0] Write session: Do CDS request
2025-09-30T14:50:38.549596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2d3216a-2ccf856b-5cb975e6-44cc5606_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:38.556755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2d3216a-2ccf856b-5cb975e6-44cc5606_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:38.556853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:38.556868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 120
2025-09-30T14:50:38.557013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 120 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:38.557052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 120 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:38.557061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=120 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:38.557065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:38.557503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 120 sessionId:  describe result for acl check
2025-09-30T14:50:38.557534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:38.557540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:38.557542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:38.557547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894751916296649:3214] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:38.558078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894751916296649:3214] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:38.560875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894751916296649:3214] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:38.565064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894751916296649:3214] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:38.565080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894751916296649:3214] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:38.565083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894751916296649:3214] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:38.565092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 120 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:38.565116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:38.566335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:38.566552Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:38.566563Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:38.566574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:38.566627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:38.566668Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894751826573527:2958]
2025-09-30T14:50:38.567412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:38.567790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:38.567843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:38.568202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:38.568282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:38.568293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:38.568294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:38.568295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:38.568296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:38.568297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:38.568299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:38.568301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:38.568302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:38.568303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:38.568305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.568306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.568307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.568309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:38.568310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:38.568316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:38.568327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:38.568331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:38.568335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:38.568339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:38.568342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:38.568347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:38.568351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:38.568354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:38.568358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:38.568362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.568366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.568369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.568372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:38.568376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:38.568384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:38.568393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:38.568399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:38.568404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:38.568410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:38.568415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:38.568419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:38.568424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:38.568429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:38.568434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:38.568438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:38.568443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:38.568448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:38.568453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:38.568458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:38.568463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:38.568468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:38.568474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:38.568478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:38.568483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:38.568488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.568496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.568501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.568506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.568512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.568520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.568523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:38.568528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:38.568532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:38.568536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:38.568591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:38.574593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:38.575662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:38.575680Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:38.575684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:38.575688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:38.575695Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 119 [2:7555894751826573527:2958]
2025-09-30T14:50:38.575713Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:38.575730Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:38.575733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.575737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.575739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.575756Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:38.575767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:38.575774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:38.575838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.575850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.575852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.575855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:38.575858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:38.575929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:38.575937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.575951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.575970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.575998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:38.576025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894751916296802:3214], now have 1 active actors on pipe
2025-09-30T14:50:38.576034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894751916296634:2454], now have 1 active actors on pipe
2025-09-30T14:50:38.576041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894751826573521:2958]
2025-09-30T14:50:38.576044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894751826573521:2958]
2025-09-30T14:50:38.576046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894751826573521:2958]
2025-09-30T14:50:38.576059Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:38.576072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:38.576076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:38.576080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:38.576082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:38.576093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:38.576096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:38.576131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894751826573521:2958]
2025-09-30T14:50:38.576139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:38.576141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:38.576154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:38.576163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:38.576100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 119
2025-09-30T14:50:38.576106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 119
2025-09-30T14:50:38.576212Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f396ab70-3f243854-f126b43d-96f2e92_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:38.576224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.576228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.576231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:38.576239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.576247Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:38.576269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:38.576511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:38.576522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:38.576537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:38.576637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 120 partition: 0 MaxSeqNo: 42 sessionId: src_id|f396ab70-3f243854-f126b43d-96f2e92_0
2025-09-30T14:50:38.576974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2d3216a-2ccf856b-5cb975e6-44cc5606_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f396ab70-3f243854-f126b43d-96f2e92_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:38.579700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f396ab70-3f243854-f126b43d-96f2e92_0] Write session: try to update token
2025-09-30T14:50:38.579720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f396ab70-3f243854-f126b43d-96f2e92_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:38.588480Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:38.588503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:38.588505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:38.588508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:38.588519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894751826573521:2958]
2025-09-30T14:50:38.588523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894751826573521:2958]
2025-09-30T14:50:38.588527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894751826573521:2958]
2025-09-30T14:50:38.588569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:38.588576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.588579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:38.588760Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:38.591177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:38.591209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:38.591213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:38.595823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 120 sessionId: src_id|f396ab70-3f243854-f126b43d-96f2e92_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:38.598734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:38.648998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894751916296816:3106]
2025-09-30T14:50:38.649339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 119, pipe: [1:7555894751916296816:3106]
2025-09-30T14:50:38.708455Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:38.708862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:38.708878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:38.708898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894751916296816:3106], now have 1 active actors on pipe
2025-09-30T14:50:38.709098Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:38.709164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:38.709180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:38.709256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 120 reason: error at write: Disconnected sessionId: src_id|f396ab70-3f243854-f126b43d-96f2e92_0
2025-09-30T14:50:38.709442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 120 sessionId: src_id|f396ab70-3f243854-f126b43d-96f2e92_0 is DEAD
2025-09-30T14:50:38.709510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894751916296816:3106]
2025-09-30T14:50:38.709550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:38.709597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f396ab70-3f243854-f126b43d-96f2e92_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:38.709607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f396ab70-3f243854-f126b43d-96f2e92_0] Write session will restart in 0.007563s
2025-09-30T14:50:38.709638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f396ab70-3f243854-f126b43d-96f2e92_0] Write session: Do CDS request
2025-09-30T14:50:38.709645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f396ab70-3f243854-f126b43d-96f2e92_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:38.718784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f396ab70-3f243854-f126b43d-96f2e92_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:38.718928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:38.718945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 121
2025-09-30T14:50:38.719079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 121 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:38.719112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 121 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:38.719123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=121 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:38.719127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:38.719688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 121 sessionId:  describe result for acl check
2025-09-30T14:50:38.719724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:38.719731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:38.719733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:38.719739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894751916296934:3219] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:38.720269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894751916296934:3219] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:38.721601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:38.722042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894751916296934:3219] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:38.722488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:38.722687Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:38.722697Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:38.722706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:38.722759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:38.722798Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894751826573713:2961]
2025-09-30T14:50:38.723430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:38.723778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:38.723837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:38.724198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:38.724261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:38.724267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:38.724268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:38.724269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:38.724270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:38.724271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:38.724272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:38.724273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:38.724274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:38.724276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:38.724278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.724279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.724280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.724281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:38.724282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:38.724288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:38.724298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:38.724302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:38.724305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:38.724309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:38.724313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:38.724316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:38.724319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:38.724323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:38.724327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:38.724330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.724335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.724339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.724343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:38.724347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:38.724354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:38.724362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:38.724367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:38.724373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:38.724377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:38.724383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:38.724387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:38.724392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:38.724397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:38.724403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:38.724407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:38.724412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:38.724417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:38.724422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:38.724427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:38.724432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:38.724436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:38.724441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:38.724446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:38.724451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:38.724457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.724462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.724466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.724470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.724475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.724480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.724484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:38.724499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:38.724503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:38.724508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:38.724552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:38.725569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894751916296934:3219] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:38.725584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894751916296934:3219] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:38.725588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894751916296934:3219] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:38.725600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 121 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:38.730165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:38.731409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:38.731426Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:38.731429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:38.731433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:38.731439Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 120 [2:7555894751826573713:2961]
2025-09-30T14:50:38.731454Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:38.731470Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:38.731473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.731477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.731479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.731493Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:38.731501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:38.731507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:38.731574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.731584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.731586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.731590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:38.731592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:38.731658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:38.731665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.731679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.731696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.731720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:38.731743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894751916297003:3219], now have 1 active actors on pipe
2025-09-30T14:50:38.731751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894751916296817:2454], now have 1 active actors on pipe
2025-09-30T14:50:38.731758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894751826573708:2961]
2025-09-30T14:50:38.731761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894751826573708:2961]
2025-09-30T14:50:38.731763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894751826573708:2961]
2025-09-30T14:50:38.731777Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:38.731790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:38.731795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:38.731798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:38.731801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:38.731807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:38.731810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:38.731823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 120
2025-09-30T14:50:38.731824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 120
2025-09-30T14:50:38.731844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894751826573708:2961]
2025-09-30T14:50:38.731853Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:38.731855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:38.731883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:38.731889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:38.731920Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ffcaec0-374bfe91-309f9cde-f06fdb59_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:38.731927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.731931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.731934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:38.731943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.731952Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:38.731968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:38.732171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:38.732179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:38.732194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:38.732340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 121 partition: 0 MaxSeqNo: 42 sessionId: src_id|1ffcaec0-374bfe91-309f9cde-f06fdb59_0
2025-09-30T14:50:38.732702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f396ab70-3f243854-f126b43d-96f2e92_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1ffcaec0-374bfe91-309f9cde-f06fdb59_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:38.735562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ffcaec0-374bfe91-309f9cde-f06fdb59_0] Write session: try to update token
2025-09-30T14:50:38.735584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ffcaec0-374bfe91-309f9cde-f06fdb59_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:38.744221Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:38.744243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:38.744246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:38.744248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:38.744259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894751826573708:2961]
2025-09-30T14:50:38.744265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894751826573708:2961]
2025-09-30T14:50:38.744269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894751826573708:2961]
2025-09-30T14:50:38.744312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:38.744320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.744322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:38.744323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:38.744329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:38.744332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:38.744493Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:38.751062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 121 sessionId: src_id|1ffcaec0-374bfe91-309f9cde-f06fdb59_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:38.753933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:38.809812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894751916297011:3106]
2025-09-30T14:50:38.810240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 120, pipe: [1:7555894751916297011:3106]
2025-09-30T14:50:38.864450Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:38.865052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:38.865074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:38.865094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894751916297011:3106], now have 1 active actors on pipe
2025-09-30T14:50:38.865404Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:38.865853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ffcaec0-374bfe91-309f9cde-f06fdb59_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:38.865863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ffcaec0-374bfe91-309f9cde-f06fdb59_0] Write session will restart in 0.005555s
2025-09-30T14:50:38.865388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894751916297011:3106]
2025-09-30T14:50:38.865896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ffcaec0-374bfe91-309f9cde-f06fdb59_0] Write session: Do CDS request
2025-09-30T14:50:38.865424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:38.865426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:38.865904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ffcaec0-374bfe91-309f9cde-f06fdb59_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:38.865486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 121 reason: error at write: Disconnected sessionId: src_id|1ffcaec0-374bfe91-309f9cde-f06fdb59_0
2025-09-30T14:50:38.865670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 121 sessionId: src_id|1ffcaec0-374bfe91-309f9cde-f06fdb59_0 is DEAD
2025-09-30T14:50:38.865736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:38.872855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ffcaec0-374bfe91-309f9cde-f06fdb59_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:38.872985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:38.873001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 122
2025-09-30T14:50:38.873119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 122 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:38.873154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 122 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:38.873164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=122 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:38.873170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:38.873737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 122 sessionId:  describe result for acl check
2025-09-30T14:50:38.873794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:38.873801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:38.873803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:38.873809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894751916297051:3230] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:38.874368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894751916297051:3230] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:38.877974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894751916297051:3230] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:38.880759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:38.880822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894751916297051:3230] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:38.880837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894751916297051:3230] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:38.880840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894751916297051:3230] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:38.880851Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 122 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:38.881858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:38.882061Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:38.882070Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:38.882080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:38.882134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:38.882169Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894751826573925:2975]
2025-09-30T14:50:38.882729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:38.882994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:38.883025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:38.883296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:38.883342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:38.883346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:38.883347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:38.883348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:38.883348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:38.883349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:38.883349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:38.883350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:38.883351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:38.883351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:38.883352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.883353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.883354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.883354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:38.883355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:38.883358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:38.883365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:38.883368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:38.883370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:38.883372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:38.883375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:38.883377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:38.883379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:38.883382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:38.883385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:38.883387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.883389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.883391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.883393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:38.883396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:38.883401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:38.883405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:38.883409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:38.883413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:38.883415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:38.883418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:38.883421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:38.883424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:38.883427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:38.883430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:38.883432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:38.883435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:38.883438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:38.883441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:38.883443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:38.883447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:38.883449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:38.883452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:38.883455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:38.883459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:38.883463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.883468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.883473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.883477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.883482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.883487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.883492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:38.883497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:38.883501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:38.883507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:38.883543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:38.890209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:38.892023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:38.892039Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:38.892041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:38.892044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:38.892050Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 121 [2:7555894751826573925:2975]
2025-09-30T14:50:38.892061Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:38.892074Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:38.892076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.892079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.892080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.892093Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:38.892099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:38.892104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:38.892155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.892164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.892166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.892170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:38.892173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:38.892238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:38.892245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.892259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:38.892277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:38.892299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:38.892322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894751916297205:3230], now have 1 active actors on pipe
2025-09-30T14:50:38.892331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894751916297037:2454], now have 1 active actors on pipe
2025-09-30T14:50:38.892337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894751826573919:2975]
2025-09-30T14:50:38.892340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894751826573919:2975]
2025-09-30T14:50:38.892342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894751826573919:2975]
2025-09-30T14:50:38.892352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:38.892367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:38.892369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:38.892373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:38.892375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:38.892379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:38.892381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:38.892412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894751826573919:2975]
2025-09-30T14:50:38.892423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:38.892430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:38.892448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 121
2025-09-30T14:50:38.892483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 121
2025-09-30T14:50:38.892551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:38.892562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:38.892588Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b9c38ae-4f310a23-41e65a8f-1a1153bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:38.892602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.892608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.892610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:38.892617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.892625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:38.892642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:38.892953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:38.892961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:38.892975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:38.893094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 122 partition: 0 MaxSeqNo: 42 sessionId: src_id|2b9c38ae-4f310a23-41e65a8f-1a1153bf_0
2025-09-30T14:50:38.893448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ffcaec0-374bfe91-309f9cde-f06fdb59_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2b9c38ae-4f310a23-41e65a8f-1a1153bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:38.898830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b9c38ae-4f310a23-41e65a8f-1a1153bf_0] Write session: try to update token
2025-09-30T14:50:38.898853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b9c38ae-4f310a23-41e65a8f-1a1153bf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:38.908101Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:38.908121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:38.908124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:38.908126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:38.908137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894751826573919:2975]
2025-09-30T14:50:38.908142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894751826573919:2975]
2025-09-30T14:50:38.908146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894751826573919:2975]
2025-09-30T14:50:38.908191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:38.908199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:38.908208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:38.908210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:38.908214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:38.908218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:38.908643Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:38.920337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 122 sessionId: src_id|2b9c38ae-4f310a23-41e65a8f-1a1153bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:38.923312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:38.967326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894751916297226:3106]
2025-09-30T14:50:38.971396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 121, pipe: [1:7555894751916297226:3106]
2025-09-30T14:50:39.029178Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:39.029463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:39.029480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:39.029516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894751916297226:3106], now have 1 active actors on pipe
2025-09-30T14:50:39.029721Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:39.029734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:39.029747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:39.029747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894751916297226:3106]
2025-09-30T14:50:39.029765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:39.029809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 122 reason: error at write: Disconnected sessionId: src_id|2b9c38ae-4f310a23-41e65a8f-1a1153bf_0
2025-09-30T14:50:39.029971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 122 sessionId: src_id|2b9c38ae-4f310a23-41e65a8f-1a1153bf_0 is DEAD
2025-09-30T14:50:39.030110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b9c38ae-4f310a23-41e65a8f-1a1153bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:39.030121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b9c38ae-4f310a23-41e65a8f-1a1153bf_0] Write session will restart in 0.005563s
2025-09-30T14:50:39.030143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b9c38ae-4f310a23-41e65a8f-1a1153bf_0] Write session: Do CDS request
2025-09-30T14:50:39.030149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b9c38ae-4f310a23-41e65a8f-1a1153bf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:39.038014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b9c38ae-4f310a23-41e65a8f-1a1153bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:39.038105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:39.038120Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 123
2025-09-30T14:50:39.038247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 123 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:39.038279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 123 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:39.038288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=123 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:39.038304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:39.038776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 123 sessionId:  describe result for acl check
2025-09-30T14:50:39.038820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:39.038827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:39.038829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:39.038835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894756211264542:3236] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:39.039396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894756211264542:3236] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:39.044982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894756211264542:3236] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:39.047178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:39.048441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:39.048634Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:39.048647Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:39.048657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:39.048706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:39.048746Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894756121541398:2978]
2025-09-30T14:50:39.049221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894756211264542:3236] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:39.049237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894756211264542:3236] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:39.049241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894756211264542:3236] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:39.049251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 123 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:39.049453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:39.049765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:39.049818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:39.050303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:39.050384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:39.050392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:39.050393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:39.050394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:39.050395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:39.050396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:39.050397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:39.050398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:39.050399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:39.050400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:39.050401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.050402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.050403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.050404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:39.050405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:39.050411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:39.050420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:39.050424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:39.050427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:39.050430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:39.050434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:39.050437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:39.050442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:39.050445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:39.050449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:39.050452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.050455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.050458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.050462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:39.050465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:39.050474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:39.050482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:39.050488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:39.050493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:39.050497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:39.050501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:39.050505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:39.050510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:39.050515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:39.050519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:39.050523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:39.050528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:39.050532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:39.050536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:39.050540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:39.050544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:39.050548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:39.050553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:39.050557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:39.050562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:39.050566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.050570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.050574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.050579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.050583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.050588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.050592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:39.050609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:39.050618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:39.050624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:39.050667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:39.061283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:39.062307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:39.062325Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:39.062328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:39.062332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:39.062343Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 122 [2:7555894756121541398:2978]
2025-09-30T14:50:39.062358Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:39.062374Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:39.062378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.062381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.062384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.062399Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:39.062405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:39.062412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:39.062461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.062471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.062472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.062475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:39.062477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:39.062545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:39.062553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.062566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.062581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.062601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:39.062625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894756211264528:2454], now have 1 active actors on pipe
2025-09-30T14:50:39.062629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894756211264700:3236], now have 1 active actors on pipe
2025-09-30T14:50:39.062634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894756121541393:2978]
2025-09-30T14:50:39.062641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894756121541393:2978]
2025-09-30T14:50:39.062642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894756121541393:2978]
2025-09-30T14:50:39.062653Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:39.062667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:39.062670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:39.062671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:39.062672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:39.062702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:39.062710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:39.062699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 122
2025-09-30T14:50:39.062754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894756121541393:2978]
2025-09-30T14:50:39.062766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:39.062769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:39.062800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:39.062805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:39.062830Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b16f1345-dc576d3e-23f56b38-808efda0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:39.062837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.062841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.062842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:39.062853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.062861Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:39.062876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:39.062752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 122
2025-09-30T14:50:39.063198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:39.063210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:39.063240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:39.063674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 123 partition: 0 MaxSeqNo: 42 sessionId: src_id|b16f1345-dc576d3e-23f56b38-808efda0_0
2025-09-30T14:50:39.064019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b9c38ae-4f310a23-41e65a8f-1a1153bf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b16f1345-dc576d3e-23f56b38-808efda0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:39.066742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b16f1345-dc576d3e-23f56b38-808efda0_0] Write session: try to update token
2025-09-30T14:50:39.066762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b16f1345-dc576d3e-23f56b38-808efda0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:39.086386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 123 sessionId: src_id|b16f1345-dc576d3e-23f56b38-808efda0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:39.083779Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:39.083797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:39.083811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894756121541393:2978]
2025-09-30T14:50:39.083855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:39.083858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:39.084040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:39.084231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:39.084432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:39.084664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:39.084873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:39.084912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:39.089246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:39.089572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:39.089590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:39.089619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:39.089725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:39.093524Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:39.093550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:39.093553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:39.093555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:39.093565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894756121541393:2978]
2025-09-30T14:50:39.093568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894756121541393:2978]
2025-09-30T14:50:39.093572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894756121541393:2978]
2025-09-30T14:50:39.093614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:39.093621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.093625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:39.093632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:39.093633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:39.093636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:39.093843Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:39.129779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894756211264712:3106]
2025-09-30T14:50:39.130110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 122, pipe: [1:7555894756211264712:3106]
2025-09-30T14:50:39.207955Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:39.215460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:39.215484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:39.215658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:39.215729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:39.215803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:39.215871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:39.216110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:39.216121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:39.216203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:39.216257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:39.216315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:39.216375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:39.216416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:39.216422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:39.216489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:39.216555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:39.216643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:39.216729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:39.216842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:39.216848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:39.216938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:39.217006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:39.217089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:39.217148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:39.217191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:39.217197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:39.217258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:39.217341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:39.217414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:39.217472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:39.217524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:39.217529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:39.217602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:39.217657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:39.217732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:39.217799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:39.217858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:39.217866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:39.217945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:39.218077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:39.218223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:39.218314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:39.218366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:39.218371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:39.218454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:39.218535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:39.218594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:39.218652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:39.218723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:39.218731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:39.218834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:39.218904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:39.218967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:39.219032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:39.219076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:39.219082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:39.219147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:39.219204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:39.219280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:39.219343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:39.219382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:39.219387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:39.219447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894756211264712:3106], now have 1 active actors on pipe
2025-09-30T14:50:39.219690Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:39.219693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894756211264712:3106]
2025-09-30T14:50:39.220113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:39.220120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:39.220144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 123 reason: error at write: Disconnected sessionId: src_id|b16f1345-dc576d3e-23f56b38-808efda0_0
2025-09-30T14:50:39.220291Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:39.220302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 123 sessionId: src_id|b16f1345-dc576d3e-23f56b38-808efda0_0 is DEAD
2025-09-30T14:50:39.220446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b16f1345-dc576d3e-23f56b38-808efda0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:39.220460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b16f1345-dc576d3e-23f56b38-808efda0_0] Write session will restart in 0.007863s
2025-09-30T14:50:39.220482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b16f1345-dc576d3e-23f56b38-808efda0_0] Write session: Do CDS request
2025-09-30T14:50:39.220501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b16f1345-dc576d3e-23f56b38-808efda0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:39.229759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b16f1345-dc576d3e-23f56b38-808efda0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:39.229867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:39.229890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 124
2025-09-30T14:50:39.230022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 124 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:39.230053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 124 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:39.230063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=124 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:39.230067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:39.230482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 124 sessionId:  describe result for acl check
2025-09-30T14:50:39.230520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:39.230527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:39.230528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:39.230534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894756211264812:3240] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:39.231107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894756211264812:3240] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:39.233053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:39.233996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:39.234162Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:39.234174Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:39.234183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:39.234235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:39.234273Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894756121541575:2980]
2025-09-30T14:50:39.234785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:39.235259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:39.235311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:39.235754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:39.235832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:39.235836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:39.235837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:39.235837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:39.235840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:39.235840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:39.235841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:39.235842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:39.235843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:39.235843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:39.235844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.235845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.235845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.235846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:39.235846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:39.235851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:39.235860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:39.235866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:39.235871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:39.235876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:39.235880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:39.235884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:39.235888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:39.235892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:39.235896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:39.235900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.235904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.235908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.235912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:39.235924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:39.235934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:39.235942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:39.235949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:39.235958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:39.235966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:39.235974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:39.235982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:39.235989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:39.235994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:39.236001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:39.236007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:39.236011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:39.236017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:39.236023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:39.236027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:39.236032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:39.236037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:39.236043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:39.236047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:39.236052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:39.236057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.236062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.236079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.236085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.236092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.236100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.236105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:39.236122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:39.236131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:39.236137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:39.236180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:39.237552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894756211264812:3240] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:39.244764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894756211264812:3240] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:39.244783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894756211264812:3240] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:39.244787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894756211264812:3240] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:39.244801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 124 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:39.245118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:39.246143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:39.246159Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:39.246162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:39.246167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:39.246174Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 123 [2:7555894756121541575:2980]
2025-09-30T14:50:39.246190Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:39.246204Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:39.246212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.246216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.246218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.246235Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:39.246246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:39.246254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:39.246326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.246333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.246336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.246339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:39.246342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:39.246412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:39.246421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.246435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.246448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.246469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:39.246489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894756211264893:3240], now have 1 active actors on pipe
2025-09-30T14:50:39.246498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894756211264715:2454], now have 1 active actors on pipe
2025-09-30T14:50:39.246504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894756121541570:2980]
2025-09-30T14:50:39.246507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894756121541570:2980]
2025-09-30T14:50:39.246509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894756121541570:2980]
2025-09-30T14:50:39.246523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:39.246537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:39.246548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:39.246552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:39.246554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:39.246558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:39.246561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:39.246537Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 123
2025-09-30T14:50:39.246551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 123
2025-09-30T14:50:39.246609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894756121541570:2980]
2025-09-30T14:50:39.246638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:39.246651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:39.246752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:39.246764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:39.246814Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e71b720e-9245eda-1ebb7138-560e2b9b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:39.246827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.246830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.246832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:39.246841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.246850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:39.246874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:39.247048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:39.247061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:39.247081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:39.247158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 124 partition: 0 MaxSeqNo: 42 sessionId: src_id|e71b720e-9245eda-1ebb7138-560e2b9b_0
2025-09-30T14:50:39.247647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b16f1345-dc576d3e-23f56b38-808efda0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e71b720e-9245eda-1ebb7138-560e2b9b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:39.250419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e71b720e-9245eda-1ebb7138-560e2b9b_0] Write session: try to update token
2025-09-30T14:50:39.250437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e71b720e-9245eda-1ebb7138-560e2b9b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:39.266174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 124 sessionId: src_id|e71b720e-9245eda-1ebb7138-560e2b9b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:39.266481Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:39.266505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:39.266507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:39.266510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:39.266519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894756121541570:2980]
2025-09-30T14:50:39.266527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894756121541570:2980]
2025-09-30T14:50:39.266530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894756121541570:2980]
2025-09-30T14:50:39.266572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:39.266578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:39.266583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:39.266587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:39.266587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.266590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:39.266753Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:39.268923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:39.319756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894756211264901:3106]
2025-09-30T14:50:39.320099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 123, pipe: [1:7555894756211264901:3106]
2025-09-30T14:50:39.386836Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:39.387306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:39.387329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:39.387378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894756211264901:3106], now have 1 active actors on pipe
2025-09-30T14:50:39.387676Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:39.387698Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:39.387703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894756211264901:3106]
2025-09-30T14:50:39.387741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:39.387744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:39.387816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 124 reason: error at write: Disconnected sessionId: src_id|e71b720e-9245eda-1ebb7138-560e2b9b_0
2025-09-30T14:50:39.388059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 124 sessionId: src_id|e71b720e-9245eda-1ebb7138-560e2b9b_0 is DEAD
2025-09-30T14:50:39.388306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e71b720e-9245eda-1ebb7138-560e2b9b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:39.388331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e71b720e-9245eda-1ebb7138-560e2b9b_0] Write session will restart in 0.007614s
2025-09-30T14:50:39.388362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e71b720e-9245eda-1ebb7138-560e2b9b_0] Write session: Do CDS request
2025-09-30T14:50:39.388373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e71b720e-9245eda-1ebb7138-560e2b9b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:39.397876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e71b720e-9245eda-1ebb7138-560e2b9b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:39.397965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:39.397981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 125
2025-09-30T14:50:39.398081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 125 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:39.398110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 125 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:39.398120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=125 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:39.398125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:39.398664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 125 sessionId:  describe result for acl check
2025-09-30T14:50:39.398726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:39.398733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:39.398735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:39.398743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894756211264953:3244] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:39.399372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894756211264953:3244] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:39.401852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894756211264953:3244] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:39.402907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:39.403999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:39.404167Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:39.404175Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:39.404192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:39.404229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:39.404345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894756211264953:3244] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:39.404357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894756211264953:3244] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:39.404364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894756211264953:3244] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:39.404381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 125 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:39.404375Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894756121541753:2982]
2025-09-30T14:50:39.404871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:39.405152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:39.405193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:39.405508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:39.405557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:39.405563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:39.405564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:39.405565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:39.405566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:39.405567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:39.405569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:39.405570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:39.405571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:39.405572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:39.405574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.405575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.405576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.405577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:39.405578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:39.405583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:39.405593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:39.405598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:39.405602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:39.405606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:39.405610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:39.405614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:39.405618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:39.405622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:39.405626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:39.405630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.405634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.405638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.405642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:39.405646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:39.405652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:39.405660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:39.405665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:39.405670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:39.405675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:39.405680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:39.405685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:39.405690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:39.405696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:39.405701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:39.405707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:39.405712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:39.405718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:39.405723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:39.405728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:39.405733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:39.405737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:39.405742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:39.405752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:39.405757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:39.405761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.405771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.405776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.405781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.405789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.405795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.405799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:39.405804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:39.405808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:39.405813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:39.405856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:39.416826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:39.417662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:39.417678Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:39.417681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:39.417685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:39.417691Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 124 [2:7555894756121541753:2982]
2025-09-30T14:50:39.417709Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:39.417726Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:39.417734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.417737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.417739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.417754Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:39.417765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:39.417774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:39.417839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.417846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.417849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.417853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:39.417857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:39.417919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:39.417930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.417944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.417958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.417978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:39.417996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894756211264902:2454], now have 1 active actors on pipe
2025-09-30T14:50:39.418004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894756211265077:3244], now have 1 active actors on pipe
2025-09-30T14:50:39.418010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894756121541748:2982]
2025-09-30T14:50:39.418012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894756121541748:2982]
2025-09-30T14:50:39.418015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894756121541748:2982]
2025-09-30T14:50:39.418030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:39.418043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:39.418044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:39.418047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:39.418050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:39.418058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:39.418065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:39.418036Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 124
2025-09-30T14:50:39.418071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 124
2025-09-30T14:50:39.418098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894756121541748:2982]
2025-09-30T14:50:39.418105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:39.418108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:39.418139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:39.418148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:39.418179Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b59f17b-cf4559f6-31fb00db-fb88a663_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:39.418192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.418195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.418197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:39.418207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.418215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:39.418238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:39.418392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:39.418400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:39.418414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:39.418537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 125 partition: 0 MaxSeqNo: 42 sessionId: src_id|7b59f17b-cf4559f6-31fb00db-fb88a663_0
2025-09-30T14:50:39.418922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e71b720e-9245eda-1ebb7138-560e2b9b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7b59f17b-cf4559f6-31fb00db-fb88a663_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:39.421677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b59f17b-cf4559f6-31fb00db-fb88a663_0] Write session: try to update token
2025-09-30T14:50:39.421695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b59f17b-cf4559f6-31fb00db-fb88a663_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:39.433655Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:39.433682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:39.433684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:39.433687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:39.433696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894756121541748:2982]
2025-09-30T14:50:39.433701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894756121541748:2982]
2025-09-30T14:50:39.433705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894756121541748:2982]
2025-09-30T14:50:39.433745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:39.433753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.433753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:39.433759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:39.433763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:39.433764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:39.433946Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:39.436529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 125 sessionId: src_id|7b59f17b-cf4559f6-31fb00db-fb88a663_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:39.439429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:39.487677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894756211265091:3106]
2025-09-30T14:50:39.487977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 124, pipe: [1:7555894756211265091:3106]
2025-09-30T14:50:39.554539Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:39.555029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:39.555047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:39.555090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894756211265091:3106], now have 1 active actors on pipe
2025-09-30T14:50:39.555342Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:39.555376Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:39.555393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:39.555397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:39.555428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894756211265091:3106]
2025-09-30T14:50:39.555453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 125 reason: error at write: Disconnected sessionId: src_id|7b59f17b-cf4559f6-31fb00db-fb88a663_0
2025-09-30T14:50:39.555628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 125 sessionId: src_id|7b59f17b-cf4559f6-31fb00db-fb88a663_0 is DEAD
2025-09-30T14:50:39.555805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b59f17b-cf4559f6-31fb00db-fb88a663_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:39.555818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b59f17b-cf4559f6-31fb00db-fb88a663_0] Write session will restart in 0.008610s
2025-09-30T14:50:39.555841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b59f17b-cf4559f6-31fb00db-fb88a663_0] Write session: Do CDS request
2025-09-30T14:50:39.555847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b59f17b-cf4559f6-31fb00db-fb88a663_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:39.565733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b59f17b-cf4559f6-31fb00db-fb88a663_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:39.565865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:39.565890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 126
2025-09-30T14:50:39.566028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 126 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:39.566061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 126 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:39.566067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=126 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:39.566071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:39.566573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 126 sessionId:  describe result for acl check
2025-09-30T14:50:39.566610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:39.566612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:39.566613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:39.566619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894756211265184:3249] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:39.567163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894756211265184:3249] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:39.569618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894756211265184:3249] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:39.569826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:39.571106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:39.571357Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:39.571366Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:39.571377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:39.571439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:39.571474Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894756121541934:2985]
2025-09-30T14:50:39.572160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:39.572624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894756211265184:3249] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:39.572639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894756211265184:3249] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:39.572643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894756211265184:3249] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:39.572657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 126 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:39.573206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:39.573280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:39.573671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:39.573752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:39.573759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:39.573761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:39.573762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:39.573763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:39.573764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:39.573765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:39.573767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:39.573768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:39.573769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:39.573770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.573771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.573772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.573773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:39.573775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:39.573781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:39.573792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:39.573796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:39.573800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:39.573804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:39.573808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:39.573813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:39.573816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:39.573820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:39.573824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:39.573828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.573832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.573836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.573841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:39.573846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:39.573853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:39.573868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:39.573879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:39.573885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:39.573891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:39.573897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:39.573901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:39.573907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:39.573912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:39.573917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:39.573922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:39.573927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:39.573933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:39.573938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:39.573943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:39.573949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:39.573959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:39.573965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:39.573975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:39.573981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:39.573990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.573995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.574004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.574009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.574018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.574024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.574033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:39.574039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:39.574049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:39.574055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:39.574119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:39.581375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:39.582656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:39.582685Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:39.582689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:39.582694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:39.582701Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 125 [2:7555894756121541934:2985]
2025-09-30T14:50:39.582719Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:39.582736Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:39.582740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.582743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.582746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.582761Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:39.582775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:39.582786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:39.582847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.582854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.582857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.582861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:39.582863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:39.582935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:39.582938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.582951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.582963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.582979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:39.583002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894756121541928:2985]
2025-09-30T14:50:39.583009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894756121541928:2985]
2025-09-30T14:50:39.583012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894756121541928:2985]
2025-09-30T14:50:39.583020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:39.583041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894756211265269:3249], now have 1 active actors on pipe
2025-09-30T14:50:39.583047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:39.583051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:39.583052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:39.583053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:39.583066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:39.583073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:39.583080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894756211265092:2454], now have 1 active actors on pipe
2025-09-30T14:50:39.583111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894756121541928:2985]
2025-09-30T14:50:39.583123Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:39.583147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:39.583284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 125
2025-09-30T14:50:39.583318Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 125
2025-09-30T14:50:39.583811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 126 partition: 0 MaxSeqNo: 42 sessionId: src_id|2a84b0d2-10d1e56e-18efa646-bfa0b97f_0
2025-09-30T14:50:39.584218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b59f17b-cf4559f6-31fb00db-fb88a663_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2a84b0d2-10d1e56e-18efa646-bfa0b97f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:39.583398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:39.583410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:39.583442Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a84b0d2-10d1e56e-18efa646-bfa0b97f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:39.583450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.583453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.583455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:39.583465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.583475Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:39.583492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:39.583660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:39.583668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:39.583692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:39.587140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a84b0d2-10d1e56e-18efa646-bfa0b97f_0] Write session: try to update token
2025-09-30T14:50:39.587160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a84b0d2-10d1e56e-18efa646-bfa0b97f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:39.600399Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:39.600424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:39.600426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:39.600429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:39.600438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894756121541928:2985]
2025-09-30T14:50:39.600443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894756121541928:2985]
2025-09-30T14:50:39.600447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894756121541928:2985]
2025-09-30T14:50:39.600488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:39.600501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.600501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:39.600504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:39.600508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:39.600512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:39.600636Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:39.603702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 126 sessionId: src_id|2a84b0d2-10d1e56e-18efa646-bfa0b97f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:39.606452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:39.655603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894756211265281:3106]
2025-09-30T14:50:39.655918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 125, pipe: [1:7555894756211265281:3106]
2025-09-30T14:50:39.719722Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:39.719958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:39.719970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:39.720001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894756211265281:3106], now have 1 active actors on pipe
2025-09-30T14:50:39.720157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894756211265281:3106]
2025-09-30T14:50:39.720183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:39.720187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:39.720187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:39.720190Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:39.720261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 126 reason: error at write: Disconnected sessionId: src_id|2a84b0d2-10d1e56e-18efa646-bfa0b97f_0
2025-09-30T14:50:39.720460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 126 sessionId: src_id|2a84b0d2-10d1e56e-18efa646-bfa0b97f_0 is DEAD
2025-09-30T14:50:39.720619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a84b0d2-10d1e56e-18efa646-bfa0b97f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:39.720628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a84b0d2-10d1e56e-18efa646-bfa0b97f_0] Write session will restart in 0.005265s
2025-09-30T14:50:39.720650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a84b0d2-10d1e56e-18efa646-bfa0b97f_0] Write session: Do CDS request
2025-09-30T14:50:39.720674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a84b0d2-10d1e56e-18efa646-bfa0b97f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:39.726781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a84b0d2-10d1e56e-18efa646-bfa0b97f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:39.726833Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:39.726848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 127
2025-09-30T14:50:39.727021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 127 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:39.727063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 127 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:39.727072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=127 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:39.727077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:39.727543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 127 sessionId:  describe result for acl check
2025-09-30T14:50:39.727578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:39.727585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:39.727587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:39.727594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894756211265308:3254] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:39.728111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894756211265308:3254] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:39.730799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894756211265308:3254] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:39.733441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894756211265308:3254] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:39.733455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894756211265308:3254] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:39.733458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894756211265308:3254] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:39.733465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 127 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:39.735224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:39.736112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:39.736307Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:39.736317Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:39.736327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:39.736374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:39.736410Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894756121542127:2988]
2025-09-30T14:50:39.736884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:39.737163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:39.737198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:39.737445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:39.737489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:39.737494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:39.737494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:39.737495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:39.737496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:39.737496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:39.737497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:39.737498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:39.737498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:39.737499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:39.737500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.737500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.737501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.737502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:39.737502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:39.737506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:39.737512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:39.737514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:39.737517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:39.737519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:39.737522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:39.737524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:39.737526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:39.737528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:39.737531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:39.737533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.737536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.737538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.737540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:39.737542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:39.737548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:39.737553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:39.737556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:39.737560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:39.737562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:39.737565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:39.737568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:39.737571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:39.737574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:39.737577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:39.737579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:39.737582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:39.737585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:39.737588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:39.737590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:39.737593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:39.737596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:39.737610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:39.737614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:39.737619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:39.737623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.737628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.737632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.737637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.737642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.737647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.737651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:39.737654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:39.737657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:39.737660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:39.737683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:39.743647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:39.744764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:39.744780Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:39.744783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:39.744787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:39.744793Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 126 [2:7555894756121542127:2988]
2025-09-30T14:50:39.744808Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:39.744822Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:39.744831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.744834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.744836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.744852Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:39.744863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:39.744870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:39.744926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.744934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.744936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.744941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:39.744943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:39.745010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:39.745018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.745031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.745049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.745072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:39.745094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894756211265294:2454], now have 1 active actors on pipe
2025-09-30T14:50:39.745102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894756211265458:3254], now have 1 active actors on pipe
2025-09-30T14:50:39.745109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894756121542122:2988]
2025-09-30T14:50:39.745112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894756121542122:2988]
2025-09-30T14:50:39.745115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894756121542122:2988]
2025-09-30T14:50:39.745128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:39.745146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:39.745159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:39.745163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:39.745163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:39.745165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:39.745166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:39.745195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894756121542122:2988]
2025-09-30T14:50:39.745198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:39.745212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:39.745240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:39.745245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:39.745162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 126
2025-09-30T14:50:39.745163Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 126
2025-09-30T14:50:39.745276Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|451b82a6-63d33ef1-1694c41b-538c6eab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:39.745291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.745294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.745296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:39.745306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.745314Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:39.745328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:39.745516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:39.745527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:39.745542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:39.745623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 127 partition: 0 MaxSeqNo: 42 sessionId: src_id|451b82a6-63d33ef1-1694c41b-538c6eab_0
2025-09-30T14:50:39.745992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a84b0d2-10d1e56e-18efa646-bfa0b97f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|451b82a6-63d33ef1-1694c41b-538c6eab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:39.748837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|451b82a6-63d33ef1-1694c41b-538c6eab_0] Write session: try to update token
2025-09-30T14:50:39.748854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|451b82a6-63d33ef1-1694c41b-538c6eab_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:39.757750Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:39.757773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:39.757776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:39.757778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:39.757787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894756121542122:2988]
2025-09-30T14:50:39.757791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894756121542122:2988]
2025-09-30T14:50:39.757795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894756121542122:2988]
2025-09-30T14:50:39.757833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:39.757840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.757839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:39.757843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:39.757846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:39.757850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:39.757999Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:39.768481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 127 sessionId: src_id|451b82a6-63d33ef1-1694c41b-538c6eab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:39.771171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:39.820495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894756211265483:3106]
2025-09-30T14:50:39.820797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 126, pipe: [1:7555894756211265483:3106]
2025-09-30T14:50:39.872168Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:39.872438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:39.872455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:39.872479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894756211265483:3106], now have 1 active actors on pipe
2025-09-30T14:50:39.872640Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:39.872865Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:39.872926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894756211265483:3106]
2025-09-30T14:50:39.872948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:39.873435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|451b82a6-63d33ef1-1694c41b-538c6eab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:39.873447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|451b82a6-63d33ef1-1694c41b-538c6eab_0] Write session will restart in 0.005514s
2025-09-30T14:50:39.873469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|451b82a6-63d33ef1-1694c41b-538c6eab_0] Write session: Do CDS request
2025-09-30T14:50:39.873475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|451b82a6-63d33ef1-1694c41b-538c6eab_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:39.873062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 127 reason: status is not ok: tablet will be restarted right now sessionId: src_id|451b82a6-63d33ef1-1694c41b-538c6eab_0
2025-09-30T14:50:39.873306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 127 sessionId: src_id|451b82a6-63d33ef1-1694c41b-538c6eab_0 is DEAD
2025-09-30T14:50:39.883684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|451b82a6-63d33ef1-1694c41b-538c6eab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:39.883790Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:39.883804Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 128
2025-09-30T14:50:39.884089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 128 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:39.884135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 128 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:39.884144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=128 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:39.884148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:39.885863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 128 sessionId:  describe result for acl check
2025-09-30T14:50:39.885901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:39.885908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:39.885910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:39.885916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894756211265638:3264] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:39.886448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894756211265638:3264] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:39.887085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:39.888165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:39.888362Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:39.888373Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:39.888384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:39.888441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:39.888447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894756211265638:3264] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:39.888484Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894756121542320:2996]
2025-09-30T14:50:39.889120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:39.889431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:39.889481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:39.889859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:39.889913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:39.889919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:39.889920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:39.889922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:39.889923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:39.889924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:39.889925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:39.889926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:39.889927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:39.889928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:39.889930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.889931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.889931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.889933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:39.889934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:39.889939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:39.889948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:39.889952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:39.889957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:39.889961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:39.889965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:39.889969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:39.889973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:39.889977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:39.889981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:39.889985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.889989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.889992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.889995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:39.889999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:39.890006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:39.890013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:39.890019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:39.890024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:39.890029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:39.890034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:39.890038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:39.890043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:39.890048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:39.890052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:39.890056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:39.890061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:39.890065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:39.890069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:39.890073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:39.890089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:39.890098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:39.890103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:39.890107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:39.890116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:39.890121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.890125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.890129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.890134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.890138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.890144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.890148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:39.890157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:39.890162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:39.890172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:39.890216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:39.890812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894756211265638:3264] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:39.890823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894756211265638:3264] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:39.890826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894756211265638:3264] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:39.890833Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 128 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:39.896098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:39.897292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:39.897311Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:39.897314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:39.897317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:39.897323Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 127 [2:7555894756121542320:2996]
2025-09-30T14:50:39.897337Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:39.897350Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:39.897354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.897356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.897358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.897373Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:39.897380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:39.897386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:39.897443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.897450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.897452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.897455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:39.897458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:39.897520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:39.897527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.897540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:39.897552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:39.897569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:39.897593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894756211265497:2454], now have 1 active actors on pipe
2025-09-30T14:50:39.897601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894756211265678:3264], now have 1 active actors on pipe
2025-09-30T14:50:39.897606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894756121542315:2996]
2025-09-30T14:50:39.897608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894756121542315:2996]
2025-09-30T14:50:39.897610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894756121542315:2996]
2025-09-30T14:50:39.897622Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:39.897636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:39.897640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:39.897645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:39.897648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:39.897654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:39.897657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:39.897686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894756121542315:2996]
2025-09-30T14:50:39.897697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:39.897700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:39.897679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 127
2025-09-30T14:50:39.897724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 127
2025-09-30T14:50:39.897832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:39.897848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:39.897874Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|899318a7-de0fc6d9-81a8d7a-3fc7afc3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:39.897887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.897895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.897897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:39.897908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.897924Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:39.897940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:39.898115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:39.898126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:39.898140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:39.898236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 128 partition: 0 MaxSeqNo: 42 sessionId: src_id|899318a7-de0fc6d9-81a8d7a-3fc7afc3_0
2025-09-30T14:50:39.898607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|451b82a6-63d33ef1-1694c41b-538c6eab_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|899318a7-de0fc6d9-81a8d7a-3fc7afc3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:39.901397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|899318a7-de0fc6d9-81a8d7a-3fc7afc3_0] Write session: try to update token
2025-09-30T14:50:39.901414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|899318a7-de0fc6d9-81a8d7a-3fc7afc3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:39.918042Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:39.918067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:39.918069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:39.918071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:39.918080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894756121542315:2996]
2025-09-30T14:50:39.918083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894756121542315:2996]
2025-09-30T14:50:39.918086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894756121542315:2996]
2025-09-30T14:50:39.918120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:39.918125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:39.918125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:39.918127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:39.918131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:39.918135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:39.918261Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:39.929171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 128 sessionId: src_id|899318a7-de0fc6d9-81a8d7a-3fc7afc3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:39.940383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:39.973065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894756211265706:3106]
2025-09-30T14:50:39.973320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 127, pipe: [1:7555894756211265706:3106]
2025-09-30T14:50:40.032836Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:40.033403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:40.033418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:40.033438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894756211265706:3106], now have 1 active actors on pipe
2025-09-30T14:50:40.033654Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:40.033709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894756211265706:3106]
2025-09-30T14:50:40.033730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:40.033743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:40.033822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 128 reason: status is not ok: tablet will be restarted right now sessionId: src_id|899318a7-de0fc6d9-81a8d7a-3fc7afc3_0
2025-09-30T14:50:40.034032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 128 sessionId: src_id|899318a7-de0fc6d9-81a8d7a-3fc7afc3_0 is DEAD
2025-09-30T14:50:40.034168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|899318a7-de0fc6d9-81a8d7a-3fc7afc3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:40.034178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|899318a7-de0fc6d9-81a8d7a-3fc7afc3_0] Write session will restart in 0.008012s
2025-09-30T14:50:40.034215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|899318a7-de0fc6d9-81a8d7a-3fc7afc3_0] Write session: Do CDS request
2025-09-30T14:50:40.034221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|899318a7-de0fc6d9-81a8d7a-3fc7afc3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:40.043805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|899318a7-de0fc6d9-81a8d7a-3fc7afc3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:40.043865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:40.043896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 129
2025-09-30T14:50:40.044036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 129 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:40.044070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 129 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:40.044081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=129 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:40.044085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:40.044526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 129 sessionId:  describe result for acl check
2025-09-30T14:50:40.044562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:40.044568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:40.044570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:40.044576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894760506233085:3271] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:40.045115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894760506233085:3271] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:40.047661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894760506233085:3271] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:40.047658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:40.048491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:40.048676Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:40.048684Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:40.048695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:40.048740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:40.048778Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894760416509824:3005]
2025-09-30T14:50:40.049431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:40.049698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:40.049738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:40.050052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:40.050126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:40.050132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:40.050132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:40.050133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:40.050134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:40.050135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:40.050136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:40.050137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:40.050138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:40.050140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:40.050140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.050141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.050142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.050154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:40.050155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:40.050160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:40.050169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:40.050173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:40.050177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:40.050180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:40.050184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:40.050187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:40.050191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:40.050194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:40.050198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:40.050201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.050205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.050208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.050212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:40.050215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:40.050222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:40.050229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:40.050234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:40.050239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:40.050243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:40.050248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:40.050252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:40.050256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:40.050261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:40.050266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:40.050270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:40.050275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:40.050279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:40.050284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:40.050293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:40.050299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:40.050303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:40.050308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:40.050314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:40.050320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:40.050330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.050335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.050339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.050344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.050352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.050357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.050361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:40.050366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:40.050374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:40.050379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:40.050428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:40.050690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894760506233085:3271] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:40.050703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894760506233085:3271] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:40.050706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894760506233085:3271] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:40.050717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 129 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:40.056940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:40.057838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:40.057852Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:40.057854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:40.057859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:40.057866Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 128 [2:7555894760416509824:3005]
2025-09-30T14:50:40.057883Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:40.057900Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:40.057903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.057906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.057908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.057928Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:40.057939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:40.057946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:40.058004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.058010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.058012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.058016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:40.058018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:40.058085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:40.058092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.058106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.058121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.058138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:40.058157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894760506233189:3271], now have 1 active actors on pipe
2025-09-30T14:50:40.058166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894760506233007:2454], now have 1 active actors on pipe
2025-09-30T14:50:40.058171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894760416509819:3005]
2025-09-30T14:50:40.058173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894760416509819:3005]
2025-09-30T14:50:40.058175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894760416509819:3005]
2025-09-30T14:50:40.058190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:40.058202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:40.058221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:40.058226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:40.058228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:40.058230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:40.058234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:40.058227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 128
2025-09-30T14:50:40.058268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894760416509819:3005]
2025-09-30T14:50:40.058275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:40.058228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 128
2025-09-30T14:50:40.058295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:40.058301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:40.058306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:40.058340Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60a5e661-55ddf11d-fb77199b-d3df4fcd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:40.058352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.058355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.058357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:40.058368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.058382Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:40.058405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:40.058518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:40.058525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:40.058536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:40.058600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 129 partition: 0 MaxSeqNo: 42 sessionId: src_id|60a5e661-55ddf11d-fb77199b-d3df4fcd_0
2025-09-30T14:50:40.059018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|899318a7-de0fc6d9-81a8d7a-3fc7afc3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|60a5e661-55ddf11d-fb77199b-d3df4fcd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:40.061874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60a5e661-55ddf11d-fb77199b-d3df4fcd_0] Write session: try to update token
2025-09-30T14:50:40.061897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60a5e661-55ddf11d-fb77199b-d3df4fcd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:40.070849Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:40.070867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:40.070869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:40.070872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:40.070881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894760416509819:3005]
2025-09-30T14:50:40.070886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894760416509819:3005]
2025-09-30T14:50:40.070890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894760416509819:3005]
2025-09-30T14:50:40.070932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:40.070938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.070940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:40.070948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:40.070954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:40.070959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:40.071083Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:40.083686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 129 sessionId: src_id|60a5e661-55ddf11d-fb77199b-d3df4fcd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:40.087052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:40.133832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894760506233197:3106]
2025-09-30T14:50:40.134149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 128, pipe: [1:7555894760506233197:3106]
2025-09-30T14:50:40.188251Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:40.188856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:40.188876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:40.188897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894760506233197:3106], now have 1 active actors on pipe
2025-09-30T14:50:40.189110Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:40.189114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894760506233197:3106]
2025-09-30T14:50:40.189133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:40.189137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:40.189142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:40.189198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 129 reason: error at write: Disconnected sessionId: src_id|60a5e661-55ddf11d-fb77199b-d3df4fcd_0
2025-09-30T14:50:40.189446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 129 sessionId: src_id|60a5e661-55ddf11d-fb77199b-d3df4fcd_0 is DEAD
2025-09-30T14:50:40.189590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a5e661-55ddf11d-fb77199b-d3df4fcd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:40.189610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a5e661-55ddf11d-fb77199b-d3df4fcd_0] Write session will restart in 0.005658s
2025-09-30T14:50:40.189634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a5e661-55ddf11d-fb77199b-d3df4fcd_0] Write session: Do CDS request
2025-09-30T14:50:40.189642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a5e661-55ddf11d-fb77199b-d3df4fcd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:40.196813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60a5e661-55ddf11d-fb77199b-d3df4fcd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:40.196933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:40.196948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 130
2025-09-30T14:50:40.197576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 130 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:40.197618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 130 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:40.197628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=130 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:40.197632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:40.198107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 130 sessionId:  describe result for acl check
2025-09-30T14:50:40.198142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:40.198146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:40.198148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:40.198154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894760506233225:3275] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:40.198659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894760506233225:3275] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:40.201176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894760506233225:3275] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:40.203806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894760506233225:3275] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:40.203821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894760506233225:3275] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:40.203824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894760506233225:3275] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:40.203832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 130 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:40.204378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:40.205514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:40.205717Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:40.205736Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:40.205747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:40.205806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:40.205850Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894760416510009:3007]
2025-09-30T14:50:40.206469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:40.206845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:40.206907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:40.207332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:40.207423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:40.207429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:40.207431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:40.207432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:40.207433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:40.207434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:40.207435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:40.207437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:40.207438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:40.207439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:40.207440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.207442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.207443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.207444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:40.207445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:40.207455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:40.207467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:40.207471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:40.207475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:40.207480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:40.207484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:40.207488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:40.207492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:40.207496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:40.207500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:40.207504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.207507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.207511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.207514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:40.207518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:40.207525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:40.207534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:40.207540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:40.207546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:40.207557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:40.207563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:40.207573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:40.207584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:40.207589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:40.207595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:40.207600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:40.207606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:40.207616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:40.207621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:40.207641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:40.207653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:40.207658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:40.207663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:40.207668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:40.207674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:40.207679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.207685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.207690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.207695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.207700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.207706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.207710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:40.207716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:40.207721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:40.207726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:40.207772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:40.214013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:40.214942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:40.214959Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:40.214962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:40.214967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:40.214974Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 129 [2:7555894760416510009:3007]
2025-09-30T14:50:40.214992Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:40.215009Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:40.215017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.215021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.215023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.215040Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:40.215051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:40.215058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:40.215118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.215125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.215128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.215131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:40.215134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:40.215206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:40.215214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.215226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.215256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.215273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:40.215295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894760506233199:2454], now have 1 active actors on pipe
2025-09-30T14:50:40.215303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894760506233378:3275], now have 1 active actors on pipe
2025-09-30T14:50:40.215310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894760416510004:3007]
2025-09-30T14:50:40.215317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894760416510004:3007]
2025-09-30T14:50:40.215319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894760416510004:3007]
2025-09-30T14:50:40.215334Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:40.215349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:40.215355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:40.215359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:40.215362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:40.215369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:40.215371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:40.215408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894760416510004:3007]
2025-09-30T14:50:40.215420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:40.215413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 129
2025-09-30T14:50:40.215420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 129
2025-09-30T14:50:40.215433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:40.215464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:40.215469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:40.215496Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b82c7c2-32810bca-ef13ab59-7b6f5afb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:40.215508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.215512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.215514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:40.215525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.215534Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:40.215547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:40.215695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:40.215710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:40.215734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:40.215824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 130 partition: 0 MaxSeqNo: 42 sessionId: src_id|b82c7c2-32810bca-ef13ab59-7b6f5afb_0
2025-09-30T14:50:40.216202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a5e661-55ddf11d-fb77199b-d3df4fcd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b82c7c2-32810bca-ef13ab59-7b6f5afb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:40.218992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b82c7c2-32810bca-ef13ab59-7b6f5afb_0] Write session: try to update token
2025-09-30T14:50:40.219008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b82c7c2-32810bca-ef13ab59-7b6f5afb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:40.227603Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:40.227625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:40.227636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894760416510004:3007]
2025-09-30T14:50:40.227679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:40.227682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:40.227898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:40.228046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:40.228209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:40.228374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:40.228582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:40.228627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:40.234080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 130 sessionId: src_id|b82c7c2-32810bca-ef13ab59-7b6f5afb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:40.237563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:40.237601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:40.237637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:40.237308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:40.237738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:40.247312Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:40.247333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:40.247336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:40.247338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:40.247349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894760416510004:3007]
2025-09-30T14:50:40.247352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894760416510004:3007]
2025-09-30T14:50:40.247356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894760416510004:3007]
2025-09-30T14:50:40.247395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:40.247403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.247406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:40.247408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:40.247417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:40.247422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:40.247563Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:40.289453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894760506233390:3106]
2025-09-30T14:50:40.289760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 129, pipe: [1:7555894760506233390:3106]
2025-09-30T14:50:40.361513Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:40.370245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:40.370282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:40.370466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:40.370540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:40.370611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:40.370702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:40.370757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:40.370768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:40.370889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:40.370958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:40.371030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:40.371110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:40.371163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:40.371172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:40.371270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:40.371338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:40.371446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:40.371515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:40.371563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:40.371571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:40.371651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:40.371722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:40.371812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:40.371882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:40.371930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:40.371940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:40.372020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:40.372087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:40.372184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:40.372252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:40.372304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:40.372312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:40.374753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b82c7c2-32810bca-ef13ab59-7b6f5afb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:40.374765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b82c7c2-32810bca-ef13ab59-7b6f5afb_0] Write session will restart in 0.005372s
2025-09-30T14:50:40.374789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b82c7c2-32810bca-ef13ab59-7b6f5afb_0] Write session: Do CDS request
2025-09-30T14:50:40.374795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b82c7c2-32810bca-ef13ab59-7b6f5afb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:40.374330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:40.374346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:40.374348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894760506233390:3106]
2025-09-30T14:50:40.374375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:40.374379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 130 reason: error at write: Disconnected sessionId: src_id|b82c7c2-32810bca-ef13ab59-7b6f5afb_0
2025-09-30T14:50:40.374588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 130 sessionId: src_id|b82c7c2-32810bca-ef13ab59-7b6f5afb_0 is DEAD
2025-09-30T14:50:40.372384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:40.372454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:40.372518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:40.372581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:40.372624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:40.372628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:40.372700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:40.372763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:40.372832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:40.372897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:40.372939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:40.372942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:40.373014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:40.373075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:40.373139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:40.373203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:40.373262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:40.373265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:40.373336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:40.373397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:40.373463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:40.373529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:40.373570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:40.373573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:40.373643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:40.373705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:40.373770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:40.373836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:40.373970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:40.373973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:40.374049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894760506233390:3106], now have 1 active actors on pipe
2025-09-30T14:50:40.375496Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:40.381839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b82c7c2-32810bca-ef13ab59-7b6f5afb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:40.381947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:40.381961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 131
2025-09-30T14:50:40.382103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 131 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:40.382157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 131 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:40.382168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=131 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:40.382173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:40.382624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 131 sessionId:  describe result for acl check
2025-09-30T14:50:40.382658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:40.382661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:40.382687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:40.382696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894760506233408:3279] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:40.383283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894760506233408:3279] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:40.386569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894760506233408:3279] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:40.390153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894760506233408:3279] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:40.390169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894760506233408:3279] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:40.390172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894760506233408:3279] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:40.390182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 131 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:40.392476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:40.394269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:40.394554Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:40.394567Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:40.394579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:40.394648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:40.394694Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894760416510194:3009]
2025-09-30T14:50:40.395329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:40.395688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:40.395749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:40.396135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:40.396197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:40.396204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:40.396205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:40.396206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:40.396207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:40.396208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:40.396210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:40.396211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:40.396212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:40.396214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:40.396215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.396217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.396218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.396219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:40.396221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:40.396226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:40.396237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:40.396242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:40.396247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:40.396251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:40.396254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:40.396259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:40.396263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:40.396268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:40.396273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:40.396277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.396281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.396286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.396290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:40.396295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:40.396303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:40.396311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:40.396317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:40.396323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:40.396329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:40.396334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:40.396339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:40.396354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:40.396359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:40.396370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:40.396374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:40.396385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:40.396394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:40.396401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:40.396406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:40.396412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:40.396417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:40.396422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:40.396431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:40.396437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:40.396447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.396453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.396459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.396465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.396474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.396479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.396486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:40.396492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:40.396501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:40.396507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:40.396559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:40.402532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:40.403449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:40.403476Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:40.403479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:40.403484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:40.403491Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 130 [2:7555894760416510194:3009]
2025-09-30T14:50:40.403514Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:40.403536Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:40.403545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.403549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.403551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.403568Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:40.403574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:40.403582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:40.403651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.403659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.403661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.403665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:40.403667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:40.403736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:40.403744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.403757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.403771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.403795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:40.403818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894760506233393:2454], now have 1 active actors on pipe
2025-09-30T14:50:40.403822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894760506233557:3279], now have 1 active actors on pipe
2025-09-30T14:50:40.403828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894760416510188:3009]
2025-09-30T14:50:40.403830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894760416510188:3009]
2025-09-30T14:50:40.403833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894760416510188:3009]
2025-09-30T14:50:40.403846Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:40.403865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:40.403885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:40.403887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:40.403921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894760416510188:3009]
2025-09-30T14:50:40.403925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:40.403961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:40.403972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:40.403974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:40.403981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:40.405144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:40.405156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:40.405179Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d05ba9c4-a71a9cf-ed5e5dc2-318a881_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:40.405188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.405191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.405192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:40.405209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.405219Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:40.405233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:40.405054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 130
2025-09-30T14:50:40.405572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:40.405577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:40.405595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:40.405089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 130
2025-09-30T14:50:40.405720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 131 partition: 0 MaxSeqNo: 42 sessionId: src_id|d05ba9c4-a71a9cf-ed5e5dc2-318a881_0
2025-09-30T14:50:40.406125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b82c7c2-32810bca-ef13ab59-7b6f5afb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d05ba9c4-a71a9cf-ed5e5dc2-318a881_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:40.409237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d05ba9c4-a71a9cf-ed5e5dc2-318a881_0] Write session: try to update token
2025-09-30T14:50:40.409259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d05ba9c4-a71a9cf-ed5e5dc2-318a881_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:40.417748Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:40.417768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:40.417771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:40.417774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:40.417783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894760416510188:3009]
2025-09-30T14:50:40.417792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894760416510188:3009]
2025-09-30T14:50:40.417796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894760416510188:3009]
2025-09-30T14:50:40.417839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:40.417847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.417845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:40.417850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:40.417852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:40.417856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:40.417992Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:40.430160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 131 sessionId: src_id|d05ba9c4-a71a9cf-ed5e5dc2-318a881_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:40.433063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:40.474297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894760506233587:3106]
2025-09-30T14:50:40.474582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 130, pipe: [1:7555894760506233587:3106]
2025-09-30T14:50:40.536953Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:40.537489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:40.537504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:40.537523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894760506233587:3106], now have 1 active actors on pipe
2025-09-30T14:50:40.537762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894760506233587:3106]
2025-09-30T14:50:40.537764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:40.537794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:40.537835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 131 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d05ba9c4-a71a9cf-ed5e5dc2-318a881_0
2025-09-30T14:50:40.537719Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:40.538007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 131 sessionId: src_id|d05ba9c4-a71a9cf-ed5e5dc2-318a881_0 is DEAD
2025-09-30T14:50:40.538219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d05ba9c4-a71a9cf-ed5e5dc2-318a881_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:40.538227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d05ba9c4-a71a9cf-ed5e5dc2-318a881_0] Write session will restart in 0.005560s
2025-09-30T14:50:40.538249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d05ba9c4-a71a9cf-ed5e5dc2-318a881_0] Write session: Do CDS request
2025-09-30T14:50:40.538254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d05ba9c4-a71a9cf-ed5e5dc2-318a881_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:40.545717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d05ba9c4-a71a9cf-ed5e5dc2-318a881_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:40.545779Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:40.545795Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 132
2025-09-30T14:50:40.545962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 132 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:40.546007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 132 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:40.546014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=132 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:40.546023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:40.546501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 132 sessionId:  describe result for acl check
2025-09-30T14:50:40.546551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:40.546558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:40.546560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:40.546566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894760506233609:3284] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:40.547150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894760506233609:3284] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:40.549879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894760506233609:3284] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:40.553092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894760506233609:3284] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:40.553111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894760506233609:3284] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:40.553115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894760506233609:3284] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:40.553125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 132 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:40.553485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:40.554652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:40.554866Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:40.554877Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:40.554887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:40.554954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:40.554993Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894760416510382:3012]
2025-09-30T14:50:40.555541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:40.555813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:40.555846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:40.556168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:40.556229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:40.556235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:40.556236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:40.556238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:40.556239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:40.556240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:40.556241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:40.556242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:40.556243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:40.556244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:40.556246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.556247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.556248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.556249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:40.556250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:40.556255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:40.556266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:40.556271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:40.556275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:40.556280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:40.556284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:40.556288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:40.556291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:40.556296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:40.556300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:40.556304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.556308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.556312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.556316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:40.556321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:40.556327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:40.556336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:40.556342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:40.556353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:40.556357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:40.556367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:40.556372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:40.556378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:40.556383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:40.556389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:40.556393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:40.556399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:40.556404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:40.556413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:40.556418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:40.556423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:40.556433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:40.556438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:40.556442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:40.556448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:40.556452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.556459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.556468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.556473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.556478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.556488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.556493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:40.556502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:40.556507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:40.556512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:40.556560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:40.562415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:40.563393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:40.563412Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:40.563416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:40.563420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:40.563428Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 131 [2:7555894760416510382:3012]
2025-09-30T14:50:40.563444Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:40.563464Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:40.563468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.563471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.563474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.563490Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:40.563502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:40.563510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:40.563578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.563585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.563588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.563591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:40.563594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:40.563670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:40.563678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.563691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.563708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.563730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:40.563755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894760506233770:3284], now have 1 active actors on pipe
2025-09-30T14:50:40.563759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894760506233589:2454], now have 1 active actors on pipe
2025-09-30T14:50:40.563765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894760416510377:3012]
2025-09-30T14:50:40.563767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894760416510377:3012]
2025-09-30T14:50:40.563769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894760416510377:3012]
2025-09-30T14:50:40.563782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:40.563797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:40.563803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:40.563819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:40.563822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:40.563823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:40.563826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:40.563860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894760416510377:3012]
2025-09-30T14:50:40.563821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 131
2025-09-30T14:50:40.563864Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:40.563866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:40.563881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:40.563887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:40.563820Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 131
2025-09-30T14:50:40.563938Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a948306-dd512bf8-9050ba80-fc537fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:40.563952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.563957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.563965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:40.563974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.563983Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:40.564002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:40.564270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:40.564283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:40.564317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:40.564400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 132 partition: 0 MaxSeqNo: 42 sessionId: src_id|7a948306-dd512bf8-9050ba80-fc537fb_0
2025-09-30T14:50:40.564775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d05ba9c4-a71a9cf-ed5e5dc2-318a881_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7a948306-dd512bf8-9050ba80-fc537fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:40.567579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a948306-dd512bf8-9050ba80-fc537fb_0] Write session: try to update token
2025-09-30T14:50:40.567597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a948306-dd512bf8-9050ba80-fc537fb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:40.576015Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:40.576037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:40.576052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894760416510377:3012]
2025-09-30T14:50:40.576099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:40.576110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:40.576306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:40.576467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:40.576626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:40.576775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:40.577002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:40.577052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:40.582623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 132 sessionId: src_id|7a948306-dd512bf8-9050ba80-fc537fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:40.585449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:40.585640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:40.585663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:40.585701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:40.585802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:40.587725Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:40.587746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:40.587748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:40.587750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:40.587760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894760416510377:3012]
2025-09-30T14:50:40.587764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894760416510377:3012]
2025-09-30T14:50:40.587768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894760416510377:3012]
2025-09-30T14:50:40.587805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:40.587810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:40.587815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.587818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:40.587825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:40.587829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:40.587967Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:40.638152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894760506233782:3106]
2025-09-30T14:50:40.638417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 131, pipe: [1:7555894760506233782:3106]
2025-09-30T14:50:40.696723Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:40.704597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:40.704630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:40.704804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:40.704873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:40.704944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:40.705012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:40.705060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:40.705070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:40.705151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:40.705220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:40.705292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:40.705365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:40.705413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:40.705422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:40.705499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:40.705570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:40.705689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:40.705795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:40.705841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:40.705849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:40.705919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:40.705983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:40.706052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:40.706113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:40.706154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:40.706159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:40.706232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:40.706299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:40.706363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:40.706424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:40.706518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:40.706523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:40.706593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:40.706684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:40.706744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:40.706814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:40.706855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:40.706860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:40.706924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:40.706979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:40.707040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:40.707103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:40.707147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:40.707154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:40.707216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:40.707297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:40.707357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:40.707417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:40.707461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:40.707468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:40.707529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:40.707588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:40.707646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:40.707734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:40.707776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:40.707781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:40.707840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:40.707896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:40.707954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:40.708010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:40.708051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:40.708061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:40.708116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894760506233782:3106], now have 1 active actors on pipe
2025-09-30T14:50:40.708404Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:40.708420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:40.708423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:40.708451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 132 reason: error at write: Disconnected sessionId: src_id|7a948306-dd512bf8-9050ba80-fc537fb_0
2025-09-30T14:50:40.708468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894760506233782:3106]
2025-09-30T14:50:40.708629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 132 sessionId: src_id|7a948306-dd512bf8-9050ba80-fc537fb_0 is DEAD
2025-09-30T14:50:40.708785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a948306-dd512bf8-9050ba80-fc537fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:40.708796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a948306-dd512bf8-9050ba80-fc537fb_0] Write session will restart in 0.007794s
2025-09-30T14:50:40.708824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a948306-dd512bf8-9050ba80-fc537fb_0] Write session: Do CDS request
2025-09-30T14:50:40.708831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a948306-dd512bf8-9050ba80-fc537fb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:40.708950Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:40.717742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a948306-dd512bf8-9050ba80-fc537fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:40.718108Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:40.718123Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 133
2025-09-30T14:50:40.718267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 133 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:40.718313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 133 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:40.718323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=133 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:40.718330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:40.718772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 133 sessionId:  describe result for acl check
2025-09-30T14:50:40.718807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:40.718813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:40.718814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:40.718820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894760506233847:3288] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:40.719386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894760506233847:3288] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:40.721699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894760506233847:3288] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:40.722978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:40.724022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:40.724295Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:40.724303Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:40.724315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:40.724298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894760506233847:3288] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:40.724324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894760506233847:3288] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:40.724326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894760506233847:3288] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:40.724332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 133 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:40.724369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:40.724408Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894760416510580:3015]
2025-09-30T14:50:40.725012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:40.725284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:40.725326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:40.725637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:40.725698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:40.725704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:40.725705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:40.725705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:40.725707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:40.725708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:40.725709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:40.725710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:40.725711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:40.725712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:40.725713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.725714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.725715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.725716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:40.725717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:40.725722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:40.725731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:40.725735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:40.725739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:40.725743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:40.725746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:40.725750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:40.725753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:40.725756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:40.725760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:40.725763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.725766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.725770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.725774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:40.725777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:40.725783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:40.725790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:40.725795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:40.725799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:40.725803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:40.725808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:40.725812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:40.725817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:40.725821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:40.725825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:40.725829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:40.725833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:40.725837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:40.725841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:40.725844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:40.725848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:40.725852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:40.725856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:40.725861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:40.725865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:40.725869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.725873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.725877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.725881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.725885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.725889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.725893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:40.725897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:40.725902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:40.725906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:40.725944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:40.731596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:40.732423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:40.732439Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:40.732442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:40.732446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:40.732453Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 132 [2:7555894760416510580:3015]
2025-09-30T14:50:40.732469Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:40.732485Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:40.732493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.732496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.732499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.732514Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:40.732525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:40.732535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:40.732592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.732600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.732603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.732607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:40.732609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:40.732668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:40.732678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.732690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.732702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.732716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:40.732737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894760506233980:3288], now have 1 active actors on pipe
2025-09-30T14:50:40.732746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894760506233784:2454], now have 1 active actors on pipe
2025-09-30T14:50:40.732753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894760416510575:3015]
2025-09-30T14:50:40.732759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894760416510575:3015]
2025-09-30T14:50:40.732761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894760416510575:3015]
2025-09-30T14:50:40.732773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:40.732786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:40.732787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:40.732790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:40.732792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:40.732804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:40.732807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:40.732838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894760416510575:3015]
2025-09-30T14:50:40.732816Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 132
2025-09-30T14:50:40.732848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:40.732827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 132
2025-09-30T14:50:40.732850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:40.732876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:40.732881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:40.732912Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8dbc4223-ca85f8f5-29fc11f2-7a5f4290_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:40.732925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.732929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.732935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:40.732944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.732957Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:40.732974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:40.733146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:40.733153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:40.733167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:40.733281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 133 partition: 0 MaxSeqNo: 42 sessionId: src_id|8dbc4223-ca85f8f5-29fc11f2-7a5f4290_0
2025-09-30T14:50:40.733634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a948306-dd512bf8-9050ba80-fc537fb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8dbc4223-ca85f8f5-29fc11f2-7a5f4290_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:40.736498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dbc4223-ca85f8f5-29fc11f2-7a5f4290_0] Write session: try to update token
2025-09-30T14:50:40.736522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dbc4223-ca85f8f5-29fc11f2-7a5f4290_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:40.745083Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:40.745103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:40.745105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:40.745107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:40.745117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894760416510575:3015]
2025-09-30T14:50:40.745121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894760416510575:3015]
2025-09-30T14:50:40.745125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894760416510575:3015]
2025-09-30T14:50:40.745166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:40.745173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.745173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:40.745176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:40.745181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:40.745185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:40.745320Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:40.751021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 133 sessionId: src_id|8dbc4223-ca85f8f5-29fc11f2-7a5f4290_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:40.753781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:40.808567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894760506233992:3106]
2025-09-30T14:50:40.808801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 132, pipe: [1:7555894760506233992:3106]
2025-09-30T14:50:40.858950Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:40.859459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:40.859478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:40.859518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894760506233992:3106], now have 1 active actors on pipe
2025-09-30T14:50:40.859734Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:40.859754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:40.859771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:40.859839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 133 reason: error at write: Disconnected sessionId: src_id|8dbc4223-ca85f8f5-29fc11f2-7a5f4290_0
2025-09-30T14:50:40.859876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894760506233992:3106]
2025-09-30T14:50:40.859903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:40.860040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 133 sessionId: src_id|8dbc4223-ca85f8f5-29fc11f2-7a5f4290_0 is DEAD
2025-09-30T14:50:40.860161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dbc4223-ca85f8f5-29fc11f2-7a5f4290_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:40.860172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dbc4223-ca85f8f5-29fc11f2-7a5f4290_0] Write session will restart in 0.007758s
2025-09-30T14:50:40.860199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dbc4223-ca85f8f5-29fc11f2-7a5f4290_0] Write session: Do CDS request
2025-09-30T14:50:40.860204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dbc4223-ca85f8f5-29fc11f2-7a5f4290_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:40.868795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dbc4223-ca85f8f5-29fc11f2-7a5f4290_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:40.868882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:40.868897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 134
2025-09-30T14:50:40.869125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 134 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:40.869163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 134 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:40.869174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=134 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:40.869178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:40.869706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 134 sessionId:  describe result for acl check
2025-09-30T14:50:40.869742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:40.869743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:40.869745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:40.869750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894760506234031:3293] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:40.870273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894760506234031:3293] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:40.873373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894760506234031:3293] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:40.875310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:40.875907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894760506234031:3293] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:40.875935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894760506234031:3293] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:40.875939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894760506234031:3293] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:40.875950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 134 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:40.876458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:40.876659Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:40.876672Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:40.876682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:40.876738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:40.876782Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894760416510769:3017]
2025-09-30T14:50:40.877469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:40.877803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:40.877852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:40.878190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:40.878259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:40.878266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:40.878268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:40.878269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:40.878270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:40.878272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:40.878273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:40.878274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:40.878276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:40.878277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:40.878279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.878280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.878281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.878282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:40.878283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:40.878289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:40.878301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:40.878305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:40.878310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:40.878315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:40.878320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:40.878325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:40.878330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:40.878334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:40.878340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:40.878344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.878349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.878353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.878358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:40.878363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:40.878371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:40.878380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:40.878386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:40.878393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:40.878398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:40.878404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:40.878409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:40.878420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:40.878426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:40.878432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:40.878437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:40.878444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:40.878456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:40.878461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:40.878470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:40.878476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:40.878486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:40.878491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:40.878503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:40.878509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:40.878518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.878524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.878529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.878535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.878540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.878546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.878550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:40.878556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:40.878561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:40.878567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:40.878621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:40.884325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:40.885232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:40.885252Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:40.885255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:40.885259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:40.885265Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 133 [2:7555894760416510769:3017]
2025-09-30T14:50:40.885285Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:40.885302Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:40.885305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.885309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.885311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.885327Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:40.885335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:40.885342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:40.885408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.885419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.885421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.885425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:40.885428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:40.885496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:40.885504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.885518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:40.885535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:40.885559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:40.885583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894760506234176:3293], now have 1 active actors on pipe
2025-09-30T14:50:40.885595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894760506233993:2454], now have 1 active actors on pipe
2025-09-30T14:50:40.885601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894760416510763:3017]
2025-09-30T14:50:40.885604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894760416510763:3017]
2025-09-30T14:50:40.885606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894760416510763:3017]
2025-09-30T14:50:40.885619Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:40.885633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:40.885648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:40.885651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:40.885653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:40.885674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:40.885685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:40.885687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894760416510763:3017]
2025-09-30T14:50:40.885690Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:40.885693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:40.885681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 133
2025-09-30T14:50:40.885681Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 133
2025-09-30T14:50:40.885732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:40.885743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:40.885774Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c15cfd7a-e39dbe77-6c5328c5-c28c203a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:40.885786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.885790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.885792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:40.885802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.885817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:40.885835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:40.885996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:40.886005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:40.886019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:40.886118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 134 partition: 0 MaxSeqNo: 42 sessionId: src_id|c15cfd7a-e39dbe77-6c5328c5-c28c203a_0
2025-09-30T14:50:40.886543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dbc4223-ca85f8f5-29fc11f2-7a5f4290_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c15cfd7a-e39dbe77-6c5328c5-c28c203a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:40.889333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c15cfd7a-e39dbe77-6c5328c5-c28c203a_0] Write session: try to update token
2025-09-30T14:50:40.889353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c15cfd7a-e39dbe77-6c5328c5-c28c203a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:40.897498Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:40.897518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:40.897528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894760416510763:3017]
2025-09-30T14:50:40.897574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:40.897587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:40.897762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:40.897951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:40.898108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:40.898424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:40.898990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:40.899041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:40.903896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 134 sessionId: src_id|c15cfd7a-e39dbe77-6c5328c5-c28c203a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:40.906603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:40.906807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:40.906829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:40.906878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:40.906946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:40.908553Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:40.908572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:40.908574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:40.908577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:40.908586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894760416510763:3017]
2025-09-30T14:50:40.908591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894760416510763:3017]
2025-09-30T14:50:40.908594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894760416510763:3017]
2025-09-30T14:50:40.908631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:40.908641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:40.908644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:40.908645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:40.908651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:40.908656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:40.908778Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:40.960196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894760506234210:3106]
2025-09-30T14:50:40.960403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 133, pipe: [1:7555894760506234210:3106]
2025-09-30T14:50:41.022772Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:41.031258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:41.031289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:41.031466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:41.031539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:41.031607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:41.031675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:41.031724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:41.031737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:41.031814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:41.031900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:41.031966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:41.032043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:41.032091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:41.032098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:41.032174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:41.032239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:41.032305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:41.032369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:41.032420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:41.032429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:41.032495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:41.032563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:41.032632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:41.032703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:41.032747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:41.032755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:41.032826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:41.032890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:41.032961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:41.033027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:41.033074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:41.033083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:41.033152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:41.033221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:41.033287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:41.033355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:41.033402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:41.033410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:41.033482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:41.033550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:41.033623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:41.033690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:41.033745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:41.033757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:41.033829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:41.033895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:41.033966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:41.034035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:41.034078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:41.034085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:41.034154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:41.034220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:41.034287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:41.034396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:41.034445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:41.034452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:41.034522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:41.034585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:41.034655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:41.034738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:41.034785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:41.034793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:41.034859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894760506234210:3106], now have 1 active actors on pipe
2025-09-30T14:50:41.035135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894760506234210:3106]
2025-09-30T14:50:41.035155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:41.035159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:41.035168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:41.035188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 134 reason: error at write: Disconnected sessionId: src_id|c15cfd7a-e39dbe77-6c5328c5-c28c203a_0
2025-09-30T14:50:41.035377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 134 sessionId: src_id|c15cfd7a-e39dbe77-6c5328c5-c28c203a_0 is DEAD
2025-09-30T14:50:41.035495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c15cfd7a-e39dbe77-6c5328c5-c28c203a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:41.035504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c15cfd7a-e39dbe77-6c5328c5-c28c203a_0] Write session will restart in 0.007896s
2025-09-30T14:50:41.035526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c15cfd7a-e39dbe77-6c5328c5-c28c203a_0] Write session: Do CDS request
2025-09-30T14:50:41.035531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c15cfd7a-e39dbe77-6c5328c5-c28c203a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:41.036009Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:41.044733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c15cfd7a-e39dbe77-6c5328c5-c28c203a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:41.044870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:41.044897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 135
2025-09-30T14:50:41.045017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 135 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:41.045048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 135 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:41.045057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=135 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:41.045060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:41.045545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 135 sessionId:  describe result for acl check
2025-09-30T14:50:41.045583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:41.045591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:41.045593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:41.045599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894764801201609:3306] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:41.046168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894764801201609:3306] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:41.048375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:41.048413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894764801201609:3306] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:41.049261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:41.049421Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:41.049433Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:41.049440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:41.049475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:41.049500Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894764711478292:3032]
2025-09-30T14:50:41.049978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:41.050255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:41.050320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:41.050585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:41.050630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:41.050635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:41.050635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:41.050636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:41.050637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:41.050638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:41.050638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:41.050639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:41.050639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:41.050640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:41.050641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.050641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.050642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.050643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:41.050643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:41.050647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:41.050653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:41.050656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:41.050658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:41.050661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:41.050663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:41.050665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:41.050680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:41.050683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:41.050688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:41.050690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.050692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.050695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.050697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:41.050700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:41.050704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:41.050711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:41.050715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:41.050718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:41.050720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:41.050723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:41.050726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:41.050729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:41.050731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:41.050734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:41.050737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:41.050740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:41.050742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:41.050745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:41.050747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:41.050750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:41.050752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:41.050755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:41.050757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:41.050760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:41.050762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.050765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.050767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.050770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.050772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.050775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.050777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:41.050780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:41.050783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:41.050786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:41.050809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:41.051063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894764801201609:3306] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:41.051086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894764801201609:3306] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:41.051090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894764801201609:3306] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:41.051102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 135 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:41.056417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:41.057514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:41.057533Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:41.057536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:41.057541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:41.057548Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 134 [2:7555894764711478292:3032]
2025-09-30T14:50:41.057567Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:41.057585Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:41.057589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.057592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.057595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.057611Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:41.057619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:41.057626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:41.057705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.057713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.057716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.057720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:41.057722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:41.057791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:41.057799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.057815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.057831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.057855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:41.057881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894764801201715:3306], now have 1 active actors on pipe
2025-09-30T14:50:41.057885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894764801201525:2454], now have 1 active actors on pipe
2025-09-30T14:50:41.057891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894764711478287:3032]
2025-09-30T14:50:41.057893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894764711478287:3032]
2025-09-30T14:50:41.057895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894764711478287:3032]
2025-09-30T14:50:41.057911Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:41.057925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:41.057934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:41.057939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:41.057942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:41.057947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:41.057950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:41.057990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894764711478287:3032]
2025-09-30T14:50:41.057999Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:41.058004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:41.057975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 134
2025-09-30T14:50:41.057977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 134
2025-09-30T14:50:41.058034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:41.058043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:41.058074Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfcc0996-b505cb71-7605fa92-8fc7a97e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:41.058085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.058089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.058090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:41.058100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.058109Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:41.058126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:41.058281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:41.058289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:41.058302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:41.058374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 135 partition: 0 MaxSeqNo: 42 sessionId: src_id|cfcc0996-b505cb71-7605fa92-8fc7a97e_0
2025-09-30T14:50:41.058770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c15cfd7a-e39dbe77-6c5328c5-c28c203a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cfcc0996-b505cb71-7605fa92-8fc7a97e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:41.061710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfcc0996-b505cb71-7605fa92-8fc7a97e_0] Write session: try to update token
2025-09-30T14:50:41.061728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfcc0996-b505cb71-7605fa92-8fc7a97e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:41.070075Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:41.070096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:41.070106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894764711478287:3032]
2025-09-30T14:50:41.070156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:41.070159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:41.070340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:41.070499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:41.070645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:41.070810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:41.071028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:41.071074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:41.077555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 135 sessionId: src_id|cfcc0996-b505cb71-7605fa92-8fc7a97e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:41.080163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:41.081875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:41.081899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:41.081919Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:41.081922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:41.081924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:41.081927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:41.081936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894764711478287:3032]
2025-09-30T14:50:41.081940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894764711478287:3032]
2025-09-30T14:50:41.081944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894764711478287:3032]
2025-09-30T14:50:41.081989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:41.081996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:41.082002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.082005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:41.082012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:41.082017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:41.082142Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:41.135323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894764801201722:3106]
2025-09-30T14:50:41.135652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 134, pipe: [1:7555894764801201722:3106]
2025-09-30T14:50:41.194308Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:41.194835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:41.194872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894764801201722:3106], now have 1 active actors on pipe
2025-09-30T14:50:41.194994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:41.195032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894764801201722:3106]
2025-09-30T14:50:41.195051Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:41.195170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:41.195181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:41.195264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 135 reason: error at write: Disconnected sessionId: src_id|cfcc0996-b505cb71-7605fa92-8fc7a97e_0
2025-09-30T14:50:41.195471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 135 sessionId: src_id|cfcc0996-b505cb71-7605fa92-8fc7a97e_0 is DEAD
2025-09-30T14:50:41.195597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfcc0996-b505cb71-7605fa92-8fc7a97e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:41.195607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfcc0996-b505cb71-7605fa92-8fc7a97e_0] Write session will restart in 0.006997s
2025-09-30T14:50:41.195631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfcc0996-b505cb71-7605fa92-8fc7a97e_0] Write session: Do CDS request
2025-09-30T14:50:41.195636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfcc0996-b505cb71-7605fa92-8fc7a97e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:41.203810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfcc0996-b505cb71-7605fa92-8fc7a97e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:41.203881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:41.203895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 136
2025-09-30T14:50:41.204100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 136 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:41.204154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 136 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:41.204166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=136 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:41.204171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:41.204787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 136 sessionId:  describe result for acl check
2025-09-30T14:50:41.204824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:41.204831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:41.204833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:41.204838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894764801201758:3310] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:41.205357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894764801201758:3310] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:41.207993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894764801201758:3310] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:41.210856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:41.210942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894764801201758:3310] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:41.210967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894764801201758:3310] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:41.210970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894764801201758:3310] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:41.210981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 136 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:41.211928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:41.212094Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:41.212101Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:41.212109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:41.212146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:41.212177Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894764711478483:3034]
2025-09-30T14:50:41.212653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:41.212911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:41.212940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:41.213224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:41.213281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:41.213287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:41.213288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:41.213288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:41.213289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:41.213290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:41.213291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:41.213291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:41.213292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:41.213293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:41.213294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.213294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.213295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.213296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:41.213296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:41.213300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:41.213307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:41.213309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:41.213312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:41.213314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:41.213317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:41.213319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:41.213322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:41.213324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:41.213328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:41.213331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.213333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.213335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.213337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:41.213340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:41.213345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:41.213350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:41.213354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:41.213357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:41.213359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:41.213363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:41.213365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:41.213368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:41.213371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:41.213376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:41.213381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:41.213386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:41.213390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:41.213395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:41.213400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:41.213405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:41.213410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:41.213414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:41.213417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:41.213419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:41.213422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.213424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.213427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.213430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.213432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.213435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.213437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:41.213440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:41.213443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:41.213445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:41.213469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:41.218947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:41.219773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:41.219787Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:41.219789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:41.219792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:41.219797Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 135 [2:7555894764711478483:3034]
2025-09-30T14:50:41.219812Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:41.219828Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:41.219831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.219834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.219835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.219847Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:41.219855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:41.219860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:41.219902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.219907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.219908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.219911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:41.219912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:41.219960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:41.219966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.219975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.219981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.219991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:41.220007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894764711478477:3034]
2025-09-30T14:50:41.220012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894764711478477:3034]
2025-09-30T14:50:41.220014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894764711478477:3034]
2025-09-30T14:50:41.220019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:41.220029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:41.220038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:41.220042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:41.220044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:41.220045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:41.220048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:41.220052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894764801201917:3310], now have 1 active actors on pipe
2025-09-30T14:50:41.220054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894764801201724:2454], now have 1 active actors on pipe
2025-09-30T14:50:41.220082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894764711478477:3034]
2025-09-30T14:50:41.220093Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:41.220102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:41.220137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 135
2025-09-30T14:50:41.220160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 135
2025-09-30T14:50:41.220201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:41.220211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:41.220235Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6b49d17-6cad92b7-ebc48b62-da88acff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:41.220244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.220247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.220249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:41.220267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.220279Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:41.220291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:41.220434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:41.220440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:41.220451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:41.220575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 136 partition: 0 MaxSeqNo: 42 sessionId: src_id|d6b49d17-6cad92b7-ebc48b62-da88acff_0
2025-09-30T14:50:41.220948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfcc0996-b505cb71-7605fa92-8fc7a97e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d6b49d17-6cad92b7-ebc48b62-da88acff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:41.224023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b49d17-6cad92b7-ebc48b62-da88acff_0] Write session: try to update token
2025-09-30T14:50:41.224043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b49d17-6cad92b7-ebc48b62-da88acff_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:41.232237Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:41.232253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:41.232256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:41.232258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:41.232266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894764711478477:3034]
2025-09-30T14:50:41.232272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894764711478477:3034]
2025-09-30T14:50:41.232276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894764711478477:3034]
2025-09-30T14:50:41.232315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:41.232321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.232324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:41.232334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:41.232341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:41.232345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:41.232464Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:41.239409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 136 sessionId: src_id|d6b49d17-6cad92b7-ebc48b62-da88acff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:41.242183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:41.295046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894764801201928:3106]
2025-09-30T14:50:41.295434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 135, pipe: [1:7555894764801201928:3106]
2025-09-30T14:50:41.346821Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:41.347438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:41.347454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:41.347472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894764801201928:3106], now have 1 active actors on pipe
2025-09-30T14:50:41.347670Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:41.347701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:41.347711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:41.347718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894764801201928:3106]
2025-09-30T14:50:41.347738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:41.347776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 136 reason: error at write: Disconnected sessionId: src_id|d6b49d17-6cad92b7-ebc48b62-da88acff_0
2025-09-30T14:50:41.347979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 136 sessionId: src_id|d6b49d17-6cad92b7-ebc48b62-da88acff_0 is DEAD
2025-09-30T14:50:41.348093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b49d17-6cad92b7-ebc48b62-da88acff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:41.348104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b49d17-6cad92b7-ebc48b62-da88acff_0] Write session will restart in 0.008946s
2025-09-30T14:50:41.348128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b49d17-6cad92b7-ebc48b62-da88acff_0] Write session: Do CDS request
2025-09-30T14:50:41.348136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b49d17-6cad92b7-ebc48b62-da88acff_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:41.357802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b49d17-6cad92b7-ebc48b62-da88acff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:41.357865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:41.357881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 137
2025-09-30T14:50:41.358057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 137 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:41.358108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 137 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:41.358117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=137 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:41.358121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:41.358698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 137 sessionId:  describe result for acl check
2025-09-30T14:50:41.358730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:41.358732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:41.358733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:41.358738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894764801201998:3314] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:41.359295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894764801201998:3314] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:41.361567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894764801201998:3314] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:41.364067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:41.364241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894764801201998:3314] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:41.364257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894764801201998:3314] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:41.364260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894764801201998:3314] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:41.364272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 137 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:41.364991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:41.365191Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:41.365201Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:41.365210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:41.365260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:41.365299Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894764711478674:3036]
2025-09-30T14:50:41.365934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:41.366215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:41.366261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:41.366602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:41.366680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:41.366686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:41.366687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:41.366688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:41.366690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:41.366691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:41.366692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:41.366694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:41.366695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:41.366696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:41.366697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.366698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.366700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.366701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:41.366702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:41.366707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:41.366718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:41.366723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:41.366728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:41.366733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:41.366737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:41.366741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:41.366745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:41.366749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:41.366754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:41.366758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.366762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.366767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.366771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:41.366774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:41.366782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:41.366790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:41.366797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:41.366802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:41.366811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:41.366817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:41.366822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:41.366827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:41.366833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:41.366838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:41.366842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:41.366846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:41.366851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:41.366857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:41.366868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:41.366873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:41.366884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:41.366890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:41.366899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:41.366904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:41.366913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.366918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.366927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.366933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.366941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.366947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.366952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:41.366961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:41.366966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:41.366971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:41.367021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:41.372672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:41.373583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:41.373603Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:41.373606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:41.373610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:41.373617Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 136 [2:7555894764711478674:3036]
2025-09-30T14:50:41.373634Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:41.373651Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:41.373654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.373657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.373659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.373675Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:41.373683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:41.373690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:41.373755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.373765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.373767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.373771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:41.373773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:41.373845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:41.373852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.373865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.373879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.373899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:41.373925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894764801201930:2454], now have 1 active actors on pipe
2025-09-30T14:50:41.373934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894764801202117:3314], now have 1 active actors on pipe
2025-09-30T14:50:41.373941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894764711478668:3036]
2025-09-30T14:50:41.373948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894764711478668:3036]
2025-09-30T14:50:41.373951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894764711478668:3036]
2025-09-30T14:50:41.373966Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:41.373984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:41.373997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:41.374002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:41.374005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:41.374006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:41.374008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:41.373997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 136
2025-09-30T14:50:41.374041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894764711478668:3036]
2025-09-30T14:50:41.374050Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:41.374037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 136
2025-09-30T14:50:41.374067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:41.374181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:41.374191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:41.374217Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4a5ff55-4b1c6a5e-e5179996-b66e2912_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:41.374227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.374233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.374234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:41.374243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.374260Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:41.374276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:41.374456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:41.374462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:41.374474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:41.374573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 137 partition: 0 MaxSeqNo: 42 sessionId: src_id|b4a5ff55-4b1c6a5e-e5179996-b66e2912_0
2025-09-30T14:50:41.374988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b49d17-6cad92b7-ebc48b62-da88acff_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b4a5ff55-4b1c6a5e-e5179996-b66e2912_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:41.377841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4a5ff55-4b1c6a5e-e5179996-b66e2912_0] Write session: try to update token
2025-09-30T14:50:41.377858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4a5ff55-4b1c6a5e-e5179996-b66e2912_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:41.386707Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:41.386725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:41.386728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:41.386730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:41.386739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894764711478668:3036]
2025-09-30T14:50:41.386743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894764711478668:3036]
2025-09-30T14:50:41.386748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894764711478668:3036]
2025-09-30T14:50:41.386792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:41.386805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:41.386807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.386810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:41.386812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:41.386816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:41.386954Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:41.393520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 137 sessionId: src_id|b4a5ff55-4b1c6a5e-e5179996-b66e2912_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:41.396488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:41.448125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894764801202130:3106]
2025-09-30T14:50:41.448390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 136, pipe: [1:7555894764801202130:3106]
2025-09-30T14:50:41.500876Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:41.501330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:41.501348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:41.501367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894764801202130:3106], now have 1 active actors on pipe
2025-09-30T14:50:41.501575Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:41.501907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:41.501966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894764801202130:3106]
2025-09-30T14:50:41.502002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:41.502072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 137 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b4a5ff55-4b1c6a5e-e5179996-b66e2912_0
2025-09-30T14:50:41.502277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 137 sessionId: src_id|b4a5ff55-4b1c6a5e-e5179996-b66e2912_0 is DEAD
2025-09-30T14:50:41.502455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4a5ff55-4b1c6a5e-e5179996-b66e2912_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:41.502468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4a5ff55-4b1c6a5e-e5179996-b66e2912_0] Write session will restart in 0.009185s
2025-09-30T14:50:41.502493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4a5ff55-4b1c6a5e-e5179996-b66e2912_0] Write session: Do CDS request
2025-09-30T14:50:41.502499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4a5ff55-4b1c6a5e-e5179996-b66e2912_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:41.513199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4a5ff55-4b1c6a5e-e5179996-b66e2912_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:41.513372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:41.513387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 138
2025-09-30T14:50:41.513522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 138 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:41.513557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 138 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:41.513563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=138 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:41.513567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:41.514048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 138 sessionId:  describe result for acl check
2025-09-30T14:50:41.514095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:41.514102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:41.514104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:41.514111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894764801202214:3319] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:41.514648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894764801202214:3319] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:41.516887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894764801202214:3319] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:41.520076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894764801202214:3319] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:41.520094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894764801202214:3319] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:41.520098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894764801202214:3319] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:41.520114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 138 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:41.519994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:41.521642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:41.521866Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:41.521876Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:41.521887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:41.521944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:41.522000Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894764711478870:3039]
2025-09-30T14:50:41.522533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:41.522909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:41.522969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:41.523346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:41.523418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:41.523424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:41.523426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:41.523427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:41.523428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:41.523429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:41.523430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:41.523432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:41.523433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:41.523434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:41.523435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.523437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.523438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.523439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:41.523440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:41.523446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:41.523457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:41.523462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:41.523466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:41.523470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:41.523475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:41.523479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:41.523483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:41.523487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:41.523492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:41.523496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.523500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.523505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.523509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:41.523514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:41.523522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:41.523530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:41.523536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:41.523542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:41.523551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:41.523562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:41.523570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:41.523575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:41.523579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:41.523594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:41.523602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:41.523607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:41.523616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:41.523620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:41.523625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:41.523630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:41.523639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:41.523644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:41.523652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:41.523656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:41.523660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.523665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.523669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.523674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.523678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.523683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.523691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:41.523696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:41.523702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:41.523710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:41.523751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:41.529382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:41.530291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:41.530304Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:41.530307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:41.530312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:41.530319Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 137 [2:7555894764711478870:3039]
2025-09-30T14:50:41.530335Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:41.530353Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:41.530361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.530365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.530367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.530382Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:41.530389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:41.530397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:41.530452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.530459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.530462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.530466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:41.530468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:41.530535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:41.530543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.530556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.530575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.530592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:41.530611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894764801202318:3319], now have 1 active actors on pipe
2025-09-30T14:50:41.530620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894764801202133:2454], now have 1 active actors on pipe
2025-09-30T14:50:41.530627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894764711478863:3039]
2025-09-30T14:50:41.530629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894764711478863:3039]
2025-09-30T14:50:41.530632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894764711478863:3039]
2025-09-30T14:50:41.530644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:41.530658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:41.530660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:41.530674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:41.530677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:41.530686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:41.530693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:41.530727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894764711478863:3039]
2025-09-30T14:50:41.530742Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:41.530718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 137
2025-09-30T14:50:41.530745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:41.530757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 137
2025-09-30T14:50:41.530773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:41.530782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:41.530812Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|742c9f7e-28be6770-44d4d6b4-aa4c58e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:41.530825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.530829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.530831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:41.530842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.530852Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:41.530865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:41.531095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:41.531104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:41.531118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:41.531215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 138 partition: 0 MaxSeqNo: 42 sessionId: src_id|742c9f7e-28be6770-44d4d6b4-aa4c58e2_0
2025-09-30T14:50:41.531611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4a5ff55-4b1c6a5e-e5179996-b66e2912_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|742c9f7e-28be6770-44d4d6b4-aa4c58e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:41.534280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|742c9f7e-28be6770-44d4d6b4-aa4c58e2_0] Write session: try to update token
2025-09-30T14:50:41.534298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|742c9f7e-28be6770-44d4d6b4-aa4c58e2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:41.542584Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:41.542596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:41.542598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:41.542600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:41.542607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894764711478863:3039]
2025-09-30T14:50:41.542611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894764711478863:3039]
2025-09-30T14:50:41.542614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894764711478863:3039]
2025-09-30T14:50:41.542650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:41.542654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.542656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:41.542656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:41.542661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:41.542680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:41.542813Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:41.548583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 138 sessionId: src_id|742c9f7e-28be6770-44d4d6b4-aa4c58e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:41.551308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:41.602202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894764801202335:3106]
2025-09-30T14:50:41.602518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 137, pipe: [1:7555894764801202335:3106]
2025-09-30T14:50:41.656529Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:41.657073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:41.657084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:41.657118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894764801202335:3106], now have 1 active actors on pipe
2025-09-30T14:50:41.657242Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:41.657299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:41.657323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894764801202335:3106]
2025-09-30T14:50:41.657341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:41.657408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 138 reason: status is not ok: tablet will be restarted right now sessionId: src_id|742c9f7e-28be6770-44d4d6b4-aa4c58e2_0
2025-09-30T14:50:41.657599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 138 sessionId: src_id|742c9f7e-28be6770-44d4d6b4-aa4c58e2_0 is DEAD
2025-09-30T14:50:41.657752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|742c9f7e-28be6770-44d4d6b4-aa4c58e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:41.657761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|742c9f7e-28be6770-44d4d6b4-aa4c58e2_0] Write session will restart in 0.005245s
2025-09-30T14:50:41.657778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|742c9f7e-28be6770-44d4d6b4-aa4c58e2_0] Write session: Do CDS request
2025-09-30T14:50:41.657782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|742c9f7e-28be6770-44d4d6b4-aa4c58e2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:41.663714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|742c9f7e-28be6770-44d4d6b4-aa4c58e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:41.663826Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:41.663853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 139
2025-09-30T14:50:41.663971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 139 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:41.664002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 139 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:41.664011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=139 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:41.664016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:41.664475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 139 sessionId:  describe result for acl check
2025-09-30T14:50:41.664509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:41.664516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:41.664518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:41.664523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894764801202352:3323] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:41.665046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894764801202352:3323] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:41.667560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894764801202352:3323] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:41.670084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894764801202352:3323] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:41.670099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894764801202352:3323] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:41.670103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894764801202352:3323] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:41.670115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 139 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:41.671353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:41.672311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:41.672498Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:41.672505Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:41.672514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:41.672560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:41.672597Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894764711479064:3041]
2025-09-30T14:50:41.673268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:41.673644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:41.673706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:41.674059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:41.674121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:41.674130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:41.674131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:41.674132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:41.674133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:41.674135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:41.674136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:41.674137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:41.674138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:41.674139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:41.674140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.674141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.674142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.674143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:41.674146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:41.674150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:41.674158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:41.674162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:41.674165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:41.674169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:41.674172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:41.674176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:41.674179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:41.674182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:41.674186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:41.674190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.674193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.674196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.674200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:41.674204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:41.674212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:41.674220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:41.674225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:41.674230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:41.674234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:41.674240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:41.674244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:41.674249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:41.674254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:41.674260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:41.674264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:41.674269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:41.674274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:41.674279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:41.674284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:41.674289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:41.674295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:41.674299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:41.674303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:41.674309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:41.674317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.674323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.674328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.674342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.674347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.674353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.674357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:41.674362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:41.674366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:41.674371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:41.674415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:41.679923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:41.681002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:41.681019Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:41.681022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:41.681026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:41.681032Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 138 [2:7555894764711479064:3041]
2025-09-30T14:50:41.681048Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:41.681066Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:41.681073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.681076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.681083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.681099Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:41.681110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:41.681117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:41.681174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.681182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.681184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.681188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:41.681190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:41.681253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:41.681260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.681275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.681291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.681312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:41.681335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894764801202337:2454], now have 1 active actors on pipe
2025-09-30T14:50:41.681343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894764801202523:3323], now have 1 active actors on pipe
2025-09-30T14:50:41.681349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894764711479059:3041]
2025-09-30T14:50:41.681351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894764711479059:3041]
2025-09-30T14:50:41.681353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894764711479059:3041]
2025-09-30T14:50:41.681367Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:41.681384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:41.681362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 138
2025-09-30T14:50:41.681384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:41.681387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:41.681389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:41.681404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:41.681407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:41.681375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 138
2025-09-30T14:50:41.681451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:41.681459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:41.681472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894764711479059:3041]
2025-09-30T14:50:41.681487Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:41.681502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:41.681526Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31ddc74c-78e504b1-5e338b47-4c5b669_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:41.681533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.681537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.681539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:41.681549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.681559Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:41.681583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:41.681719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:41.681729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:41.681742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:41.681840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 139 partition: 0 MaxSeqNo: 42 sessionId: src_id|31ddc74c-78e504b1-5e338b47-4c5b669_0
2025-09-30T14:50:41.682198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|742c9f7e-28be6770-44d4d6b4-aa4c58e2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|31ddc74c-78e504b1-5e338b47-4c5b669_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:41.684971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31ddc74c-78e504b1-5e338b47-4c5b669_0] Write session: try to update token
2025-09-30T14:50:41.684985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31ddc74c-78e504b1-5e338b47-4c5b669_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:41.693666Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:41.693684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:41.693686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:41.693688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:41.693701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894764711479059:3041]
2025-09-30T14:50:41.693707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894764711479059:3041]
2025-09-30T14:50:41.693711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894764711479059:3041]
2025-09-30T14:50:41.693752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:41.693766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.693769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:41.693785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:41.693792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:41.693796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:41.693917Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:41.699193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 139 sessionId: src_id|31ddc74c-78e504b1-5e338b47-4c5b669_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:41.701784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:41.757380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894764801202549:3106]
2025-09-30T14:50:41.757714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 138, pipe: [1:7555894764801202549:3106]
2025-09-30T14:50:41.814117Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:41.814510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:41.814524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:41.814574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894764801202549:3106], now have 1 active actors on pipe
2025-09-30T14:50:41.814829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:41.814841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:41.814843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:41.814890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894764801202549:3106]
2025-09-30T14:50:41.814914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 139 reason: error at write: Disconnected sessionId: src_id|31ddc74c-78e504b1-5e338b47-4c5b669_0
2025-09-30T14:50:41.815098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 139 sessionId: src_id|31ddc74c-78e504b1-5e338b47-4c5b669_0 is DEAD
2025-09-30T14:50:41.814801Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:41.815270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31ddc74c-78e504b1-5e338b47-4c5b669_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:41.815277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31ddc74c-78e504b1-5e338b47-4c5b669_0] Write session will restart in 0.005772s
2025-09-30T14:50:41.815301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31ddc74c-78e504b1-5e338b47-4c5b669_0] Write session: Do CDS request
2025-09-30T14:50:41.815307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31ddc74c-78e504b1-5e338b47-4c5b669_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:41.821716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31ddc74c-78e504b1-5e338b47-4c5b669_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:41.821801Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:41.821816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 140
2025-09-30T14:50:41.821954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 140 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:41.821982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 140 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:41.821987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=140 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:41.821991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:41.822373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 140 sessionId:  describe result for acl check
2025-09-30T14:50:41.822402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:41.822406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:41.822408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:41.822413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894764801202565:3328] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:41.822999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894764801202565:3328] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:41.825741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894764801202565:3328] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:41.828938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894764801202565:3328] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:41.828954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894764801202565:3328] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:41.828958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894764801202565:3328] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:41.828966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 140 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:41.830262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:41.831506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:41.831697Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:41.831705Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:41.831715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:41.831788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:41.831827Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894764711479271:3044]
2025-09-30T14:50:41.832461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:41.832756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:41.832801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:41.833099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:41.833174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:41.833179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:41.833181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:41.833182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:41.833183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:41.833184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:41.833185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:41.833186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:41.833187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:41.833188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:41.833189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.833190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.833192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.833193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:41.833193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:41.833198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:41.833208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:41.833211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:41.833215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:41.833219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:41.833222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:41.833226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:41.833230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:41.833233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:41.833237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:41.833241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.833245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.833249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.833253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:41.833257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:41.833264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:41.833272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:41.833278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:41.833283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:41.833287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:41.833291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:41.833295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:41.833301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:41.833305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:41.833310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:41.833314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:41.833319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:41.833324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:41.833328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:41.833333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:41.833338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:41.833342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:41.833346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:41.833350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:41.833356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:41.833361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.833367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.833382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.833387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.833391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.833396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.833400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:41.833404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:41.833408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:41.833413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:41.833457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:41.839095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:41.840377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:41.840392Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:41.840395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:41.840398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:41.840404Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 139 [2:7555894764711479271:3044]
2025-09-30T14:50:41.840421Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:41.840436Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:41.840439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.840441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.840444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.840458Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:41.840469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:41.840475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:41.840539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.840546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.840548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.840552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:41.840554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:41.840625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:41.840633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.840647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:41.840664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:41.840684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:41.840702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894764801202551:2454], now have 1 active actors on pipe
2025-09-30T14:50:41.840710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894764801202738:3328], now have 1 active actors on pipe
2025-09-30T14:50:41.840715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894764711479266:3044]
2025-09-30T14:50:41.840717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894764711479266:3044]
2025-09-30T14:50:41.840719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894764711479266:3044]
2025-09-30T14:50:41.840731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:41.840747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:41.840749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:41.840764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:41.840764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:41.840766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:41.840767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:41.840798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894764711479266:3044]
2025-09-30T14:50:41.840813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:41.840807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 139
2025-09-30T14:50:41.840809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 139
2025-09-30T14:50:41.840836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:41.840855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:41.840859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:41.840884Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a9ada11-26c5c01-a4c00f8e-8209bade_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:41.840896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.840900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.840903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:41.840910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.840919Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:41.840937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:41.841159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:41.841179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:41.841203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:41.841300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 140 partition: 0 MaxSeqNo: 42 sessionId: src_id|5a9ada11-26c5c01-a4c00f8e-8209bade_0
2025-09-30T14:50:41.841651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31ddc74c-78e504b1-5e338b47-4c5b669_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5a9ada11-26c5c01-a4c00f8e-8209bade_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:41.844487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a9ada11-26c5c01-a4c00f8e-8209bade_0] Write session: try to update token
2025-09-30T14:50:41.844507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a9ada11-26c5c01-a4c00f8e-8209bade_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:41.852768Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:41.852787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:41.852797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894764711479266:3044]
2025-09-30T14:50:41.852849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:41.852850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:41.853029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:41.853174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:41.853312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:41.853446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:41.853682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:41.853717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:41.860843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 140 sessionId: src_id|5a9ada11-26c5c01-a4c00f8e-8209bade_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:41.863643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:41.863887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:41.863909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:41.863946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:41.864036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:41.865101Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:41.865115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:41.865117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:41.865119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:41.865129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894764711479266:3044]
2025-09-30T14:50:41.865132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894764711479266:3044]
2025-09-30T14:50:41.865136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894764711479266:3044]
2025-09-30T14:50:41.865172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:41.865176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:41.865183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:41.865184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:41.865186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:41.865188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:41.865319Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:41.915087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894764801202752:3106]
2025-09-30T14:50:41.915355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 139, pipe: [1:7555894764801202752:3106]
2025-09-30T14:50:41.980571Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:41.988748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:41.988775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:41.988936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:41.988998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:41.989058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:41.989125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:41.989357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:41.989370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:41.989456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:41.989515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:41.989578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:41.989644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:41.989690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:41.989698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:41.989769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:41.989830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:41.989895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:41.989960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:41.990004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:41.990011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:41.990077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:41.990146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:41.990210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:41.990277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:41.990320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:41.990328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:41.990395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:41.990459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:41.990521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:41.990589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:41.990632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:41.990641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:41.990717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:41.990778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:41.990840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:41.990905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:41.990968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:41.990975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:41.991043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:41.991103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:41.991178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:41.991238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:41.991307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:41.991314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:41.991380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:41.991439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:41.991504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:41.991570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:41.991612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:41.991620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:41.991683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:41.991742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:41.992527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894764801202752:3106]
2025-09-30T14:50:41.992579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:41.992582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:41.992606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 140 reason: error at write: Disconnected sessionId: src_id|5a9ada11-26c5c01-a4c00f8e-8209bade_0
2025-09-30T14:50:41.992777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 140 sessionId: src_id|5a9ada11-26c5c01-a4c00f8e-8209bade_0 is DEAD
2025-09-30T14:50:41.992922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a9ada11-26c5c01-a4c00f8e-8209bade_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:41.992934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a9ada11-26c5c01-a4c00f8e-8209bade_0] Write session will restart in 0.008325s
2025-09-30T14:50:41.992956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a9ada11-26c5c01-a4c00f8e-8209bade_0] Write session: Do CDS request
2025-09-30T14:50:41.992962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a9ada11-26c5c01-a4c00f8e-8209bade_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:41.993059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:41.991805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:41.991871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:41.991909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:41.991912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:41.991976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:41.992033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:41.992091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:41.992189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:41.992242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:41.992245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:41.992297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894764801202752:3106], now have 1 active actors on pipe
2025-09-30T14:50:41.993249Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:42.002821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a9ada11-26c5c01-a4c00f8e-8209bade_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:42.003815Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:42.003831Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 141
2025-09-30T14:50:42.003928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 141 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:42.003956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 141 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:42.003960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=141 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:42.003964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:42.004424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 141 sessionId:  describe result for acl check
2025-09-30T14:50:42.004468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:42.004477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:42.004480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:42.004487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894769096170137:3340] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:42.005015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894769096170137:3340] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:42.007156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894769096170137:3340] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:42.009194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:42.010291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:42.010506Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:42.010514Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:42.010524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:42.010495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894769096170137:3340] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:42.010508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894769096170137:3340] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:42.010511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894769096170137:3340] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:42.010521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 141 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:42.010574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:42.010610Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894769006446776:3053]
2025-09-30T14:50:42.011281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:42.011566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:42.011610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:42.011948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:42.012003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:42.012010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:42.012011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:42.012012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:42.012013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:42.012015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:42.012016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:42.012017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:42.012018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:42.012019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:42.012020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.012021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.012022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.012023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:42.012024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:42.012029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:42.012040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:42.012044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:42.012048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:42.012052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:42.012057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:42.012061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:42.012064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:42.012068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:42.012073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:42.012077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.012081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.012085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.012089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:42.012093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:42.012099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:42.012106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:42.012113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:42.012119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:42.012123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:42.012129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:42.012133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:42.012139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:42.012143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:42.012149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:42.012153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:42.012158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:42.012163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:42.012169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:42.012172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:42.012178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:42.012183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:42.012188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:42.012192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:42.012198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:42.012203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.012208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.012213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.012218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.012223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.012228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.012233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:42.012237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:42.012251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:42.012260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:42.012301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:42.017782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:42.018707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:42.018721Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:42.018724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:42.018727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:42.018733Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 140 [2:7555894769006446776:3053]
2025-09-30T14:50:42.018749Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:42.018764Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:42.018768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.018770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.018773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.018787Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:42.018795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:42.018807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:42.018861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.018868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.018870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.018873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:42.018876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:42.018937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:42.018946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.018959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.018971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.018989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:42.019011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894769096170260:3340], now have 1 active actors on pipe
2025-09-30T14:50:42.019019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894764801202778:2454], now have 1 active actors on pipe
2025-09-30T14:50:42.019024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894769006446771:3053]
2025-09-30T14:50:42.019027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894769006446771:3053]
2025-09-30T14:50:42.019029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894769006446771:3053]
2025-09-30T14:50:42.019043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:42.019055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:42.019064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:42.019069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:42.019071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:42.019075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:42.019077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:42.019106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894769006446771:3053]
2025-09-30T14:50:42.019117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:42.019122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:42.019115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 140
2025-09-30T14:50:42.019145Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 140
2025-09-30T14:50:42.019216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:42.019238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:42.019283Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25d50b23-49482bd4-b9fc57e6-301d4f4f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:42.019296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.019300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.019303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:42.019322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.019337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:42.019359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:42.019599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:42.019617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:42.019637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:42.019716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 141 partition: 0 MaxSeqNo: 42 sessionId: src_id|25d50b23-49482bd4-b9fc57e6-301d4f4f_0
2025-09-30T14:50:42.020099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a9ada11-26c5c01-a4c00f8e-8209bade_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|25d50b23-49482bd4-b9fc57e6-301d4f4f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:42.022872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25d50b23-49482bd4-b9fc57e6-301d4f4f_0] Write session: try to update token
2025-09-30T14:50:42.022889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25d50b23-49482bd4-b9fc57e6-301d4f4f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:42.031124Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:42.031143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:42.031145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:42.031147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:42.031155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894769006446771:3053]
2025-09-30T14:50:42.031159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894769006446771:3053]
2025-09-30T14:50:42.031162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894769006446771:3053]
2025-09-30T14:50:42.031200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:42.031203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:42.031205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.031208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:42.031208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:42.031211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:42.031371Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:42.037234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 141 sessionId: src_id|25d50b23-49482bd4-b9fc57e6-301d4f4f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:42.040102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:42.092851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894769096170284:3106]
2025-09-30T14:50:42.093119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 140, pipe: [1:7555894769096170284:3106]
2025-09-30T14:50:42.151047Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:42.151661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:42.151675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:42.151694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894769096170284:3106], now have 1 active actors on pipe
2025-09-30T14:50:42.151891Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:42.151912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:42.151932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:42.151931Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:42.151983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894769096170284:3106]
2025-09-30T14:50:42.151997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 141 reason: error at write: Disconnected sessionId: src_id|25d50b23-49482bd4-b9fc57e6-301d4f4f_0
2025-09-30T14:50:42.152189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 141 sessionId: src_id|25d50b23-49482bd4-b9fc57e6-301d4f4f_0 is DEAD
2025-09-30T14:50:42.152327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25d50b23-49482bd4-b9fc57e6-301d4f4f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:42.152339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25d50b23-49482bd4-b9fc57e6-301d4f4f_0] Write session will restart in 0.005008s
2025-09-30T14:50:42.152364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25d50b23-49482bd4-b9fc57e6-301d4f4f_0] Write session: Do CDS request
2025-09-30T14:50:42.152372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25d50b23-49482bd4-b9fc57e6-301d4f4f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:42.158781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25d50b23-49482bd4-b9fc57e6-301d4f4f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:42.158875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:42.158891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 142
2025-09-30T14:50:42.159034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 142 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:42.159079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 142 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:42.159089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=142 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:42.159094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:42.159545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 142 sessionId:  describe result for acl check
2025-09-30T14:50:42.159583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:42.159585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:42.159587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:42.159592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894769096170301:3345] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:42.160098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894769096170301:3345] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:42.165188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894769096170301:3345] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:42.167510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:42.168605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:42.168752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894769096170301:3345] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:42.168783Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:42.168766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894769096170301:3345] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:42.168769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894769096170301:3345] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:42.168794Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:42.168777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 142 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:42.168804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:42.168856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:42.168898Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894769006446996:3061]
2025-09-30T14:50:42.169534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:42.169831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:42.169894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:42.170211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:42.170279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:42.170285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:42.170286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:42.170288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:42.170289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:42.170290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:42.170291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:42.170293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:42.170294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:42.170295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:42.170296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.170298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.170299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.170300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:42.170301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:42.170307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:42.170318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:42.170322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:42.170327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:42.170331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:42.170335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:42.170339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:42.170343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:42.170348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:42.170352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:42.170356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.170360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.170364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.170368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:42.170372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:42.170380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:42.170387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:42.170393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:42.170399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:42.170404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:42.170409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:42.170414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:42.170419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:42.170426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:42.170437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:42.170441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:42.170455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:42.170464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:42.170469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:42.170478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:42.170482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:42.170487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:42.170493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:42.170497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:42.170507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:42.170512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.170522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.170526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.170536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.170540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.170549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.170553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:42.170559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:42.170564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:42.170569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:42.170615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:42.176058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:42.176944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:42.176964Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:42.176966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:42.176970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:42.176976Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 141 [2:7555894769006446996:3061]
2025-09-30T14:50:42.176992Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:42.177008Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:42.177011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.177014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.177017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.177034Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:42.177048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:42.177055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:42.177109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.177118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.177120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.177123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:42.177126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:42.177190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:42.177201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.177216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.177228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.177244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:42.177268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894769096170478:3345], now have 1 active actors on pipe
2025-09-30T14:50:42.177275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894769096170287:2454], now have 1 active actors on pipe
2025-09-30T14:50:42.177282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894769006446991:3061]
2025-09-30T14:50:42.177284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894769006446991:3061]
2025-09-30T14:50:42.177287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894769006446991:3061]
2025-09-30T14:50:42.177299Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:42.177311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:42.177331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:42.177338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:42.177331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 141
2025-09-30T14:50:42.177363Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 141
2025-09-30T14:50:42.177367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894769006446991:3061]
2025-09-30T14:50:42.177374Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:42.177402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:42.177411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:42.177412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:42.177418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:42.177563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:42.177574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:42.177600Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4472a099-d399106b-21ed5486-42a1fbd1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:42.177612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.177620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.177623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:42.177632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.177646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:42.177667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:42.177846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:42.177859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:42.177883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:42.177991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 142 partition: 0 MaxSeqNo: 42 sessionId: src_id|4472a099-d399106b-21ed5486-42a1fbd1_0
2025-09-30T14:50:42.178371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25d50b23-49482bd4-b9fc57e6-301d4f4f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4472a099-d399106b-21ed5486-42a1fbd1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:42.181073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4472a099-d399106b-21ed5486-42a1fbd1_0] Write session: try to update token
2025-09-30T14:50:42.181092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4472a099-d399106b-21ed5486-42a1fbd1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:42.189560Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:42.189579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:42.189582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:42.189584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:42.189593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894769006446991:3061]
2025-09-30T14:50:42.189598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894769006446991:3061]
2025-09-30T14:50:42.189602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894769006446991:3061]
2025-09-30T14:50:42.189640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:42.189647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.189650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:42.189662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:42.189668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:42.189673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:42.189781Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:42.195993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 142 sessionId: src_id|4472a099-d399106b-21ed5486-42a1fbd1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:42.198810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:42.251992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894769096170489:3106]
2025-09-30T14:50:42.252293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 141, pipe: [1:7555894769096170489:3106]
2025-09-30T14:50:42.304188Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:42.304733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:42.304747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:42.304785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894769096170489:3106], now have 1 active actors on pipe
2025-09-30T14:50:42.304977Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:42.305024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894769096170489:3106]
2025-09-30T14:50:42.305047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:42.305056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:42.305138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 142 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4472a099-d399106b-21ed5486-42a1fbd1_0
2025-09-30T14:50:42.305335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 142 sessionId: src_id|4472a099-d399106b-21ed5486-42a1fbd1_0 is DEAD
2025-09-30T14:50:42.305450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4472a099-d399106b-21ed5486-42a1fbd1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:42.305461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4472a099-d399106b-21ed5486-42a1fbd1_0] Write session will restart in 0.007173s
2025-09-30T14:50:42.305494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4472a099-d399106b-21ed5486-42a1fbd1_0] Write session: Do CDS request
2025-09-30T14:50:42.305499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4472a099-d399106b-21ed5486-42a1fbd1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:42.315705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4472a099-d399106b-21ed5486-42a1fbd1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:42.315816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:42.315834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 143
2025-09-30T14:50:42.315976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 143 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:42.316006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 143 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:42.316012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=143 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:42.316020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:42.316535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 143 sessionId:  describe result for acl check
2025-09-30T14:50:42.316573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:42.316575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:42.316577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:42.316584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894769096170563:3349] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:42.317140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894769096170563:3349] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:42.319765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894769096170563:3349] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:42.320752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:42.321821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:42.322004Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:42.322014Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:42.322024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:42.322071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:42.322110Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894769006447192:3063]
2025-09-30T14:50:42.322125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894769096170563:3349] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:42.322148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894769096170563:3349] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:42.322151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894769096170563:3349] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:42.322160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 143 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:42.322784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:42.323114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:42.323167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:42.323547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:42.323624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:42.323631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:42.323632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:42.323633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:42.323634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:42.323635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:42.323636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:42.323637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:42.323638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:42.323639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:42.323641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.323642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.323643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.323645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:42.323646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:42.323651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:42.323662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:42.323666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:42.323670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:42.323673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:42.323679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:42.323683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:42.323687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:42.323691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:42.323695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:42.323700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.323703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.323707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.323711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:42.323715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:42.323723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:42.323731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:42.323738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:42.323743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:42.323748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:42.323753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:42.323758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:42.323764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:42.323769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:42.323775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:42.323779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:42.323784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:42.323790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:42.323801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:42.323805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:42.323810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:42.323815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:42.323821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:42.323825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:42.323831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:42.323837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.323843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.323847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.323859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.323863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.323868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.323872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:42.323877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:42.323885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:42.323891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:42.323934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:42.329491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:42.330499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:42.330514Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:42.330517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:42.330521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:42.330527Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 142 [2:7555894769006447192:3063]
2025-09-30T14:50:42.330544Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:42.330564Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:42.330570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.330574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.330576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.330591Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:42.330598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:42.330605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:42.330660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.330675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.330678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.330681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:42.330685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:42.330753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:42.330763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.330776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.330788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.330805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:42.330821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894769096170684:3349], now have 1 active actors on pipe
2025-09-30T14:50:42.330830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894769096170490:2454], now have 1 active actors on pipe
2025-09-30T14:50:42.330836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894769006447187:3063]
2025-09-30T14:50:42.330839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894769006447187:3063]
2025-09-30T14:50:42.330841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894769006447187:3063]
2025-09-30T14:50:42.330854Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:42.330864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:42.330868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:42.330870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:42.330870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:42.330884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:42.330888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:42.330922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894769006447187:3063]
2025-09-30T14:50:42.330931Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:42.330936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:42.330932Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 142
2025-09-30T14:50:42.330934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 142
2025-09-30T14:50:42.330976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:42.330985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:42.331021Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ae12b5b-f0dc8b89-32e8a7c2-3cfa02ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:42.331031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.331034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.331037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:42.331049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.331063Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:42.331080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:42.331233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:42.331260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:42.331277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:42.331386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 143 partition: 0 MaxSeqNo: 42 sessionId: src_id|7ae12b5b-f0dc8b89-32e8a7c2-3cfa02ac_0
2025-09-30T14:50:42.331810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4472a099-d399106b-21ed5486-42a1fbd1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7ae12b5b-f0dc8b89-32e8a7c2-3cfa02ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:42.334681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ae12b5b-f0dc8b89-32e8a7c2-3cfa02ac_0] Write session: try to update token
2025-09-30T14:50:42.334702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ae12b5b-f0dc8b89-32e8a7c2-3cfa02ac_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:42.342888Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:42.342910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:42.342923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894769006447187:3063]
2025-09-30T14:50:42.342963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:42.342967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:42.343154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:42.343353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:42.343511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:42.343661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:42.343883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:42.343923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:42.349885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 143 sessionId: src_id|7ae12b5b-f0dc8b89-32e8a7c2-3cfa02ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:42.352886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:42.354156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:42.354178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:42.354198Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:42.354201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:42.354203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:42.354205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:42.354214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894769006447187:3063]
2025-09-30T14:50:42.354219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894769006447187:3063]
2025-09-30T14:50:42.354222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894769006447187:3063]
2025-09-30T14:50:42.354260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:42.354271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:42.354272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:42.354275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:42.354278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.354281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:42.354431Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:42.405057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894769096170695:3106]
2025-09-30T14:50:42.405314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 142, pipe: [1:7555894769096170695:3106]
2025-09-30T14:50:42.461673Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:42.461964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:42.461998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894769096170695:3106], now have 1 active actors on pipe
2025-09-30T14:50:42.462124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:42.462168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894769096170695:3106]
2025-09-30T14:50:42.462186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:42.462225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:42.462233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:42.462301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 143 reason: error at write: Disconnected sessionId: src_id|7ae12b5b-f0dc8b89-32e8a7c2-3cfa02ac_0
2025-09-30T14:50:42.462480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 143 sessionId: src_id|7ae12b5b-f0dc8b89-32e8a7c2-3cfa02ac_0 is DEAD
2025-09-30T14:50:42.462638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ae12b5b-f0dc8b89-32e8a7c2-3cfa02ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:42.462651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ae12b5b-f0dc8b89-32e8a7c2-3cfa02ac_0] Write session will restart in 0.006609s
2025-09-30T14:50:42.462693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ae12b5b-f0dc8b89-32e8a7c2-3cfa02ac_0] Write session: Do CDS request
2025-09-30T14:50:42.462700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ae12b5b-f0dc8b89-32e8a7c2-3cfa02ac_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:42.470842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ae12b5b-f0dc8b89-32e8a7c2-3cfa02ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:42.470974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:42.470990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 144
2025-09-30T14:50:42.471147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 144 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:42.471181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 144 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:42.471200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=144 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:42.471204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:42.471720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 144 sessionId:  describe result for acl check
2025-09-30T14:50:42.471759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:42.471767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:42.471769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:42.471776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894769096170715:3354] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:42.472349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894769096170715:3354] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:42.475345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894769096170715:3354] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:42.478756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894769096170715:3354] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:42.478774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894769096170715:3354] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:42.478777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894769096170715:3354] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:42.478795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 144 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:42.479075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:42.480377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:42.480638Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:42.480642Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:42.480655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:42.480716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:42.480768Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894769006447393:3066]
2025-09-30T14:50:42.481477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:42.481837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:42.481896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:42.482322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:42.482399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:42.482400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:42.482401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:42.482403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:42.482405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:42.482406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:42.482407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:42.482409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:42.482410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:42.482412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:42.482414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.482415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.482416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.482418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:42.482419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:42.482426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:42.482436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:42.482440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:42.482445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:42.482449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:42.482454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:42.482458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:42.482462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:42.482466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:42.482472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:42.482476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.482480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.482484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.482488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:42.482492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:42.482502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:42.482511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:42.482517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:42.482524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:42.482529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:42.482535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:42.482542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:42.482548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:42.482554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:42.482560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:42.482564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:42.482570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:42.482575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:42.482581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:42.482586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:42.482592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:42.482598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:42.482603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:42.482608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:42.482614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:42.482620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.482625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.482631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.482636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.482642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.482647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.482654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:42.482659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:42.482682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:42.482688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:42.482739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:42.488542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:42.489628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:42.489646Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:42.489650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:42.489654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:42.489662Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 143 [2:7555894769006447393:3066]
2025-09-30T14:50:42.489679Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:42.489696Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:42.489699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.489703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.489705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.489722Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:42.489735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:42.489742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:42.489816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.489824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.489827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.489831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:42.489834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:42.489903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:42.489912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.489928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.489940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.489958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:42.489977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894769096170892:3354], now have 1 active actors on pipe
2025-09-30T14:50:42.489981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894769096170698:2454], now have 1 active actors on pipe
2025-09-30T14:50:42.489989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894769006447387:3066]
2025-09-30T14:50:42.489997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894769006447387:3066]
2025-09-30T14:50:42.490000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894769006447387:3066]
2025-09-30T14:50:42.490014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:42.490027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:42.490029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:42.490030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:42.490036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:42.490045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:42.490048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:42.490089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894769006447387:3066]
2025-09-30T14:50:42.490099Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:42.490101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:42.490127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:42.490136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:42.490063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 143
2025-09-30T14:50:42.490175Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1118898c-e4dba350-e053e931-da21175d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:42.490186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.490112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 143
2025-09-30T14:50:42.490191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.490193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:42.490203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.490218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:42.490239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:42.490648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:42.490675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:42.490696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:42.490815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 144 partition: 0 MaxSeqNo: 42 sessionId: src_id|1118898c-e4dba350-e053e931-da21175d_0
2025-09-30T14:50:42.491207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ae12b5b-f0dc8b89-32e8a7c2-3cfa02ac_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1118898c-e4dba350-e053e931-da21175d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:42.494005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1118898c-e4dba350-e053e931-da21175d_0] Write session: try to update token
2025-09-30T14:50:42.494027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1118898c-e4dba350-e053e931-da21175d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:42.505865Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:42.505891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:42.505895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:42.505898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:42.505910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894769006447387:3066]
2025-09-30T14:50:42.505917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894769006447387:3066]
2025-09-30T14:50:42.505923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894769006447387:3066]
2025-09-30T14:50:42.505976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:42.505978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:42.505985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:42.505990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:42.506007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.506011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:42.506479Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:42.514545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 144 sessionId: src_id|1118898c-e4dba350-e053e931-da21175d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:42.517410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:42.562246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894769096170904:3106]
2025-09-30T14:50:42.562531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 143, pipe: [1:7555894769096170904:3106]
2025-09-30T14:50:42.623237Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:42.623856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:42.623872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:42.623892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894769096170904:3106], now have 1 active actors on pipe
2025-09-30T14:50:42.624120Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:42.624161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894769096170904:3106]
2025-09-30T14:50:42.624160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:42.624164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:42.624187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:42.624267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 144 reason: error at write: Disconnected sessionId: src_id|1118898c-e4dba350-e053e931-da21175d_0
2025-09-30T14:50:42.624458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 144 sessionId: src_id|1118898c-e4dba350-e053e931-da21175d_0 is DEAD
2025-09-30T14:50:42.624635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1118898c-e4dba350-e053e931-da21175d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:42.624643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1118898c-e4dba350-e053e931-da21175d_0] Write session will restart in 0.008327s
2025-09-30T14:50:42.624664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1118898c-e4dba350-e053e931-da21175d_0] Write session: Do CDS request
2025-09-30T14:50:42.624671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1118898c-e4dba350-e053e931-da21175d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:42.633902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1118898c-e4dba350-e053e931-da21175d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:42.633928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:42.633956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 145
2025-09-30T14:50:42.634128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 145 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:42.634184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 145 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:42.634189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=145 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:42.634194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:42.634579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 145 sessionId:  describe result for acl check
2025-09-30T14:50:42.634625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:42.634631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:42.634634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:42.634641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894769096170926:3358] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:42.635144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894769096170926:3358] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:42.637693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894769096170926:3358] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:42.641858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:42.643278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:42.643478Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:42.643489Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:42.643499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:42.643554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:42.643591Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894769006447591:3068]
2025-09-30T14:50:42.643578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894769096170926:3358] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:42.643593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894769096170926:3358] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:42.643596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894769096170926:3358] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:42.643606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 145 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:42.644227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:42.644543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:42.644612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:42.644961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:42.645058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:42.645064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:42.645066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:42.645067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:42.645068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:42.645070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:42.645071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:42.645073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:42.645074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:42.645075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:42.645076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.645078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.645079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.645080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:42.645081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:42.645087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:42.645098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:42.645103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:42.645108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:42.645112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:42.645116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:42.645120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:42.645125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:42.645129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:42.645134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:42.645149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.645153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.645158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.645163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:42.645167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:42.645178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:42.645192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:42.645198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:42.645209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:42.645214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:42.645221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:42.645226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:42.645236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:42.645243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:42.645253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:42.645257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:42.645263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:42.645270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:42.645276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:42.645283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:42.645288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:42.645303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:42.645313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:42.645318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:42.645327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:42.645332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.645338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.645343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.645348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.645352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.645358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.645363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:42.645369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:42.645384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:42.645392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:42.645434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:42.651239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:42.652236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:42.652255Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:42.652257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:42.652262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:42.652268Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 144 [2:7555894769006447591:3068]
2025-09-30T14:50:42.652287Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:42.652304Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:42.652307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.652310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.652312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.652328Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:42.652334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:42.652341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:42.652422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.652430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.652432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.652436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:42.652439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:42.652666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 144
2025-09-30T14:50:42.652715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 144
2025-09-30T14:50:42.652506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:42.652518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.652534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.652547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.652576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:42.652596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894769096170905:2454], now have 1 active actors on pipe
2025-09-30T14:50:42.652600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894769096171100:3358], now have 1 active actors on pipe
2025-09-30T14:50:42.652606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894769006447585:3068]
2025-09-30T14:50:42.652609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894769006447585:3068]
2025-09-30T14:50:42.652611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894769006447585:3068]
2025-09-30T14:50:42.652626Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:42.652640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:42.652642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:42.652645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:42.652648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:42.652655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:42.652658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:42.652693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894769006447585:3068]
2025-09-30T14:50:42.652697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:42.652707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:42.652860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:42.652874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:42.652911Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4c1d91c-5a1e2619-8947b2ec-1b8efeab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:42.652925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.652929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.652931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:42.652944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.652959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:42.652980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:42.653305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:42.653317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:42.653335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:42.653461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 145 partition: 0 MaxSeqNo: 42 sessionId: src_id|d4c1d91c-5a1e2619-8947b2ec-1b8efeab_0
2025-09-30T14:50:42.653849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1118898c-e4dba350-e053e931-da21175d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d4c1d91c-5a1e2619-8947b2ec-1b8efeab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:42.656661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4c1d91c-5a1e2619-8947b2ec-1b8efeab_0] Write session: try to update token
2025-09-30T14:50:42.656682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4c1d91c-5a1e2619-8947b2ec-1b8efeab_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:42.665675Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:42.665693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:42.665702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894769006447585:3068]
2025-09-30T14:50:42.665749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:42.665748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:42.665927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:42.666087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:42.666231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:42.666375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:42.666565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:42.666607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:42.671718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 145 sessionId: src_id|d4c1d91c-5a1e2619-8947b2ec-1b8efeab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:42.674497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:42.674695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:42.674716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:42.674749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:42.674824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:42.676571Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:42.676592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:42.676595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:42.676596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:42.676606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894769006447585:3068]
2025-09-30T14:50:42.676609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894769006447585:3068]
2025-09-30T14:50:42.676614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894769006447585:3068]
2025-09-30T14:50:42.676648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:42.676654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.676657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:42.676660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:42.676666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:42.676670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:42.676796Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:42.724531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894769096171112:3106]
2025-09-30T14:50:42.724765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 144, pipe: [1:7555894769096171112:3106]
2025-09-30T14:50:42.797043Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:42.805757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:42.805793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:42.805979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:42.806048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:42.806116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:42.806186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:42.806753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:42.806770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:42.806843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:42.806906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:42.806974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:42.807048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:42.807092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:42.807103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:42.807175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:42.807259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:42.807329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:42.807395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:42.807440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:42.807448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:42.807520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:42.807590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:42.807659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:42.807721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:42.807767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:42.807774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:42.807853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:42.807919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:42.807991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:42.808059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:42.808107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:42.808115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:42.808186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:42.808251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:42.808317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:42.808383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:42.808428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:42.808437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:42.808504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:42.808610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:42.808680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:42.808744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:42.808877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:42.808886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:42.808955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:42.809024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:42.809091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:42.809156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:42.809204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:42.809213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:42.809284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:42.809352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:42.809421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:42.809490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:42.809542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:42.809550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:42.809620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:42.809686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:42.809751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:42.809817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:42.809863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:42.809870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:42.809932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894769096171112:3106], now have 1 active actors on pipe
2025-09-30T14:50:42.810333Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:42.810399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:42.810406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:42.810411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894769096171112:3106]
2025-09-30T14:50:42.810436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 145 reason: error at write: Disconnected sessionId: src_id|d4c1d91c-5a1e2619-8947b2ec-1b8efeab_0
2025-09-30T14:50:42.810579Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:42.810654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 145 sessionId: src_id|d4c1d91c-5a1e2619-8947b2ec-1b8efeab_0 is DEAD
2025-09-30T14:50:42.810860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4c1d91c-5a1e2619-8947b2ec-1b8efeab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:42.810872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4c1d91c-5a1e2619-8947b2ec-1b8efeab_0] Write session will restart in 0.009415s
2025-09-30T14:50:42.810895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4c1d91c-5a1e2619-8947b2ec-1b8efeab_0] Write session: Do CDS request
2025-09-30T14:50:42.810901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4c1d91c-5a1e2619-8947b2ec-1b8efeab_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:42.821780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4c1d91c-5a1e2619-8947b2ec-1b8efeab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:42.821878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:42.821895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 146
2025-09-30T14:50:42.822024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 146 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:42.822059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 146 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:42.822075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=146 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:42.822078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:42.822529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 146 sessionId:  describe result for acl check
2025-09-30T14:50:42.822563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:42.822570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:42.822571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:42.822578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894769096171229:3363] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:42.823138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894769096171229:3363] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:42.825974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894769096171229:3363] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:42.826356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:42.827593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:42.827758Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:42.827766Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:42.827775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:42.827815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:42.827860Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894769006447803:3071]
2025-09-30T14:50:42.828482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:42.828678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894769096171229:3363] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:42.828692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894769096171229:3363] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:42.828696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894769096171229:3363] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:42.828704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 146 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:42.828722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:42.828761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:42.829058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:42.829125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:42.829131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:42.829132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:42.829133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:42.829134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:42.829136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:42.829137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:42.829138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:42.829139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:42.829140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:42.829141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.829142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.829143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.829144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:42.829145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:42.829150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:42.829160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:42.829164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:42.829167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:42.829171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:42.829175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:42.829178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:42.829181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:42.829185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:42.829189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:42.829193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.829196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.829200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.829204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:42.829208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:42.829216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:42.829223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:42.829229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:42.829234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:42.829238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:42.829243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:42.829247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:42.829251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:42.829256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:42.829261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:42.829265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:42.829269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:42.829274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:42.829279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:42.829283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:42.829288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:42.829292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:42.829297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:42.829301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:42.829305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:42.829309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.829314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.829318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.829323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.829327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.829332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.829336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:42.829341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:42.829345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:42.829350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:42.829387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:42.834864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:42.835848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:42.835862Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:42.835865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:42.835869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:42.835874Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 145 [2:7555894769006447803:3071]
2025-09-30T14:50:42.835890Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:42.835905Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:42.835907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.835910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.835913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.835928Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:42.835934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:42.835946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:42.836004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.836013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.836015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.836020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:42.836023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:42.836093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:42.836101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.836113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.836125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.836146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:42.836169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894769096171126:2454], now have 1 active actors on pipe
2025-09-30T14:50:42.836177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894769096171325:3363], now have 1 active actors on pipe
2025-09-30T14:50:42.836183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894769006447798:3071]
2025-09-30T14:50:42.836186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894769006447798:3071]
2025-09-30T14:50:42.836188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894769006447798:3071]
2025-09-30T14:50:42.836200Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:42.836213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:42.836219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:42.836231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:42.836233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:42.836234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:42.836237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:42.836267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894769006447798:3071]
2025-09-30T14:50:42.836275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:42.836265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 145
2025-09-30T14:50:42.836286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 145
2025-09-30T14:50:42.836282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:42.836317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:42.836325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:42.836347Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95fd0a5a-9c66db3-d7673c28-1c57fa44_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:42.836358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.836362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.836364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:42.836373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.836386Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:42.836399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:42.836567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:42.836576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:42.836589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:42.836690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 146 partition: 0 MaxSeqNo: 42 sessionId: src_id|95fd0a5a-9c66db3-d7673c28-1c57fa44_0
2025-09-30T14:50:42.837050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4c1d91c-5a1e2619-8947b2ec-1b8efeab_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|95fd0a5a-9c66db3-d7673c28-1c57fa44_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:42.839814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95fd0a5a-9c66db3-d7673c28-1c57fa44_0] Write session: try to update token
2025-09-30T14:50:42.839834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95fd0a5a-9c66db3-d7673c28-1c57fa44_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:42.848311Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:42.848329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:42.848331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:42.848333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:42.848343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894769006447798:3071]
2025-09-30T14:50:42.848347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894769006447798:3071]
2025-09-30T14:50:42.848352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894769006447798:3071]
2025-09-30T14:50:42.848389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:42.848395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.848395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:42.848398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:42.848403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:42.848407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:42.848560Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:42.854559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 146 sessionId: src_id|95fd0a5a-9c66db3-d7673c28-1c57fa44_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:42.857328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:42.910415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894769096171334:3106]
2025-09-30T14:50:42.910706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 145, pipe: [1:7555894769096171334:3106]
2025-09-30T14:50:42.965832Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:42.966354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:42.966365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:42.966404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894769096171334:3106], now have 1 active actors on pipe
2025-09-30T14:50:42.966729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:42.966751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:42.966756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:42.966774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894769096171334:3106]
2025-09-30T14:50:42.966813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 146 reason: error at write: Disconnected sessionId: src_id|95fd0a5a-9c66db3-d7673c28-1c57fa44_0
2025-09-30T14:50:42.966998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 146 sessionId: src_id|95fd0a5a-9c66db3-d7673c28-1c57fa44_0 is DEAD
2025-09-30T14:50:42.967209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95fd0a5a-9c66db3-d7673c28-1c57fa44_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:42.967220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95fd0a5a-9c66db3-d7673c28-1c57fa44_0] Write session will restart in 0.009203s
2025-09-30T14:50:42.967258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95fd0a5a-9c66db3-d7673c28-1c57fa44_0] Write session: Do CDS request
2025-09-30T14:50:42.967264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95fd0a5a-9c66db3-d7673c28-1c57fa44_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:42.966841Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:42.977758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95fd0a5a-9c66db3-d7673c28-1c57fa44_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:42.977879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:42.977894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 147
2025-09-30T14:50:42.978065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 147 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:42.978108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 147 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:42.978113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=147 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:42.978118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:42.978539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 147 sessionId:  describe result for acl check
2025-09-30T14:50:42.978584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:42.978588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:42.978590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:42.978597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894769096171416:3369] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:42.979143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894769096171416:3369] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:42.981545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894769096171416:3369] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:42.984209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:42.984435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894769096171416:3369] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:42.984450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894769096171416:3369] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:42.984454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894769096171416:3369] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:42.984468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 147 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:42.985404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:42.985614Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:42.985625Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:42.985636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:42.985718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:42.985755Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894769006448007:3073]
2025-09-30T14:50:42.986376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:42.986644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:42.986710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:42.987044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:42.987119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:42.987126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:42.987127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:42.987128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:42.987130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:42.987131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:42.987132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:42.987133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:42.987134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:42.987136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:42.987137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.987139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.987140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.987141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:42.987142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:42.987148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:42.987159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:42.987163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:42.987167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:42.987171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:42.987176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:42.987180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:42.987184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:42.987189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:42.987193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:42.987201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.987206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.987209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.987213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:42.987221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:42.987229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:42.987241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:42.987268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:42.987274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:42.987279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:42.987285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:42.987288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:42.987294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:42.987299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:42.987304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:42.987308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:42.987313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:42.987318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:42.987324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:42.987334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:42.987340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:42.987345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:42.987350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:42.987355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:42.987363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:42.987372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.987377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.987385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.987391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.987400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.987405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.987413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:42.987418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:42.987423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:42.987429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:42.987479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:42.992851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:42.994006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:42.994024Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:42.994027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:42.994031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:42.994037Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 146 [2:7555894769006448007:3073]
2025-09-30T14:50:42.994055Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:42.994071Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:42.994074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.994077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.994079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.994093Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:42.994105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:42.994112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:42.994169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.994175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.994177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.994180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:42.994183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:42.994242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:42.994252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:42.994264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:42.994275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:42.994290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:42.994314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894769096171540:3369], now have 1 active actors on pipe
2025-09-30T14:50:42.994322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894769096171345:2454], now have 1 active actors on pipe
2025-09-30T14:50:42.994328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894769006448000:3073]
2025-09-30T14:50:42.994330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894769006448000:3073]
2025-09-30T14:50:42.994332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894769006448000:3073]
2025-09-30T14:50:42.994343Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:42.994362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:42.994366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:42.994370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:42.994372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:42.994381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:42.994384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:42.994416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894769006448000:3073]
2025-09-30T14:50:42.994430Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:42.994442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:42.994428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 146
2025-09-30T14:50:42.994478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:42.994488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:42.994429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 146
2025-09-30T14:50:42.994510Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cae4eed4-3eaa60f9-2ebe9b4e-e0e873d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:42.994522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.994530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.994531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:42.994542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.994550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:42.994571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:42.994762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:42.994770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:42.994784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:42.994883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 147 partition: 0 MaxSeqNo: 42 sessionId: src_id|cae4eed4-3eaa60f9-2ebe9b4e-e0e873d4_0
2025-09-30T14:50:42.995266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95fd0a5a-9c66db3-d7673c28-1c57fa44_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cae4eed4-3eaa60f9-2ebe9b4e-e0e873d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:42.998291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cae4eed4-3eaa60f9-2ebe9b4e-e0e873d4_0] Write session: try to update token
2025-09-30T14:50:42.998315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cae4eed4-3eaa60f9-2ebe9b4e-e0e873d4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:43.006277Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:43.006294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:43.006304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894769006448000:3073]
2025-09-30T14:50:43.006343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:43.006346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:43.006513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:43.006678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:43.006826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:43.006971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:43.007181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:43.007226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:43.013428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 147 sessionId: src_id|cae4eed4-3eaa60f9-2ebe9b4e-e0e873d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:43.016322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:43.016630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:43.016650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:43.016683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:43.016766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:43.022353Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:43.022369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:43.022371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:43.022373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:43.022382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894769006448000:3073]
2025-09-30T14:50:43.022387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894769006448000:3073]
2025-09-30T14:50:43.022393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894769006448000:3073]
2025-09-30T14:50:43.022429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:43.022434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:43.022436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.022439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:43.022441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:43.022444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:43.022575Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:43.066577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894773391138866:3106]
2025-09-30T14:50:43.067061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 146, pipe: [1:7555894773391138866:3106]
2025-09-30T14:50:43.135861Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:43.148292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:43.148318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:43.148678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:43.148940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:43.149178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:43.149247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:43.149303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:43.149313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:43.149577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:43.149810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:43.149909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:43.149985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:43.150034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:43.150041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:43.150304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:43.150559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:43.150626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:43.150713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:43.150842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:43.150850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:43.150919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:43.151146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:43.151214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:43.151473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:43.151517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:43.151527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:43.151779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:43.151843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:43.151918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:43.151982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:43.152044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:43.152054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:43.152120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:43.152187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:43.152449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:43.152713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:43.152765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:43.152775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:43.153006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:43.153241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:43.153501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:43.153749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:43.153873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:43.153878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:43.153942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:43.153997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:43.154251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:43.154526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:43.154588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:43.154594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:43.154864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:43.155109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:43.155449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:43.155703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:43.155828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:43.155838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:43.156074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:43.157002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:43.157017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894773391138866:3106]
2025-09-30T14:50:43.157018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:43.157037Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:43.157048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 147 reason: error at write: Disconnected sessionId: src_id|cae4eed4-3eaa60f9-2ebe9b4e-e0e873d4_0
2025-09-30T14:50:43.157286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 147 sessionId: src_id|cae4eed4-3eaa60f9-2ebe9b4e-e0e873d4_0 is DEAD
2025-09-30T14:50:43.157459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cae4eed4-3eaa60f9-2ebe9b4e-e0e873d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:43.157471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cae4eed4-3eaa60f9-2ebe9b4e-e0e873d4_0] Write session will restart in 0.006790s
2025-09-30T14:50:43.157498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cae4eed4-3eaa60f9-2ebe9b4e-e0e873d4_0] Write session: Do CDS request
2025-09-30T14:50:43.157506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cae4eed4-3eaa60f9-2ebe9b4e-e0e873d4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:43.156320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:43.156564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:43.156627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:43.156668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:43.156671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:43.156744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894773391138866:3106], now have 1 active actors on pipe
2025-09-30T14:50:43.157856Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:43.165795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cae4eed4-3eaa60f9-2ebe9b4e-e0e873d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:43.166041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:43.166058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 148
2025-09-30T14:50:43.166207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 148 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:43.166242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 148 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:43.166251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=148 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:43.166256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:43.166728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 148 sessionId:  describe result for acl check
2025-09-30T14:50:43.166776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:43.166780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:43.166782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:43.166788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894773391138895:3382] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:43.167380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894773391138895:3382] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:43.170751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894773391138895:3382] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:43.173835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894773391138895:3382] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:43.173850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894773391138895:3382] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:43.173853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894773391138895:3382] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:43.173862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 148 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:43.174137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:43.175354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:43.175537Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:43.175549Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:43.175559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:43.175608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:43.175646Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894773301415542:3088]
2025-09-30T14:50:43.176336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:43.176656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:43.176700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:43.177039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:43.177096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:43.177102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:43.177104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:43.177105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:43.177106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:43.177107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:43.177109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:43.177110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:43.177111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:43.177112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:43.177113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.177115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.177116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.177117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:43.177118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:43.177123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:43.177132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:43.177135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:43.177140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:43.177144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:43.177149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:43.177154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:43.177158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:43.177162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:43.177167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:43.177171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.177176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.177180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.177183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:43.177187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:43.177193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:43.177201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:43.177206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:43.177212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:43.177217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:43.177223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:43.177227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:43.177232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:43.177236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:43.177241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:43.177245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:43.177250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:43.177255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:43.177260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:43.177265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:43.177276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:43.177282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:43.177289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:43.177298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:43.177305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:43.177311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.177317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.177325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.177332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.177336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.177342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.177346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:43.177352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:43.177357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:43.177363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:43.177410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:43.182996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:43.184074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:43.184090Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:43.184093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:43.184097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:43.184103Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 147 [2:7555894773301415542:3088]
2025-09-30T14:50:43.184118Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:43.184135Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:43.184138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.184141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.184143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.184159Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:43.184166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:43.184173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:43.184245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.184254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.184257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.184261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:43.184264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:43.184325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:43.184332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.184345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.184363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.184386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:43.184411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894773391138880:2454], now have 1 active actors on pipe
2025-09-30T14:50:43.184419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894773391139074:3382], now have 1 active actors on pipe
2025-09-30T14:50:43.184425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894773301415537:3088]
2025-09-30T14:50:43.184427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894773301415537:3088]
2025-09-30T14:50:43.184430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894773301415537:3088]
2025-09-30T14:50:43.184446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:43.184460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:43.184461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:43.184465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:43.184467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:43.184481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:43.184489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:43.184493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 147
2025-09-30T14:50:43.184519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894773301415537:3088]
2025-09-30T14:50:43.184527Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:43.184502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 147
2025-09-30T14:50:43.184529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:43.184561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:43.184566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:43.184597Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|233d1d45-cf91935b-d8fbfdd5-4e9907aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:43.184622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.184626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.184628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:43.184639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.184648Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:43.184664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:43.184778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:43.184785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:43.184798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:43.184918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 148 partition: 0 MaxSeqNo: 42 sessionId: src_id|233d1d45-cf91935b-d8fbfdd5-4e9907aa_0
2025-09-30T14:50:43.185300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cae4eed4-3eaa60f9-2ebe9b4e-e0e873d4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|233d1d45-cf91935b-d8fbfdd5-4e9907aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:43.193991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|233d1d45-cf91935b-d8fbfdd5-4e9907aa_0] Write session: try to update token
2025-09-30T14:50:43.194013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|233d1d45-cf91935b-d8fbfdd5-4e9907aa_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:43.197432Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:43.197453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:43.197456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:43.197458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:43.197467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894773301415537:3088]
2025-09-30T14:50:43.197472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894773301415537:3088]
2025-09-30T14:50:43.197479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894773301415537:3088]
2025-09-30T14:50:43.197518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:43.197523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:43.197530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:43.197531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.197534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:43.197535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:43.197676Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:43.214777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 148 sessionId: src_id|233d1d45-cf91935b-d8fbfdd5-4e9907aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:43.217487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:43.257046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894773391139087:3106]
2025-09-30T14:50:43.257309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 147, pipe: [1:7555894773391139087:3106]
2025-09-30T14:50:43.310985Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:43.311539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:43.311555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:43.311574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894773391139087:3106], now have 1 active actors on pipe
2025-09-30T14:50:43.311771Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:43.311856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:43.311870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:43.311871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:43.311915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894773391139087:3106]
2025-09-30T14:50:43.311930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 148 reason: error at write: Disconnected sessionId: src_id|233d1d45-cf91935b-d8fbfdd5-4e9907aa_0
2025-09-30T14:50:43.312086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 148 sessionId: src_id|233d1d45-cf91935b-d8fbfdd5-4e9907aa_0 is DEAD
2025-09-30T14:50:43.312222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|233d1d45-cf91935b-d8fbfdd5-4e9907aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:43.312232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|233d1d45-cf91935b-d8fbfdd5-4e9907aa_0] Write session will restart in 0.005607s
2025-09-30T14:50:43.312254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|233d1d45-cf91935b-d8fbfdd5-4e9907aa_0] Write session: Do CDS request
2025-09-30T14:50:43.312261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|233d1d45-cf91935b-d8fbfdd5-4e9907aa_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:43.318766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|233d1d45-cf91935b-d8fbfdd5-4e9907aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:43.318946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:43.318962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 149
2025-09-30T14:50:43.319083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 149 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:43.319114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 149 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:43.319124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=149 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:43.319128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:43.319618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 149 sessionId:  describe result for acl check
2025-09-30T14:50:43.319655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:43.319661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:43.319663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:43.319669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894773391139104:3386] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:43.320183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894773391139104:3386] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:43.322869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894773391139104:3386] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:43.325631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894773391139104:3386] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:43.325646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894773391139104:3386] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:43.325658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894773391139104:3386] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:43.325666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 149 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:43.327446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:43.328479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:43.328681Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:43.328691Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:43.328703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:43.328768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:43.328805Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894773301415744:3090]
2025-09-30T14:50:43.329500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:43.329781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:43.329825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:43.330164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:43.330233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:43.330239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:43.330240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:43.330241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:43.330242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:43.330244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:43.330245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:43.330246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:43.330247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:43.330248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:43.330250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.330251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.330252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.330253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:43.330254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:43.330260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:43.330271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:43.330275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:43.330280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:43.330284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:43.330289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:43.330293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:43.330297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:43.330301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:43.330306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:43.330311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.330315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.330319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.330323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:43.330328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:43.330335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:43.330343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:43.330349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:43.330355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:43.330360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:43.330366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:43.330370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:43.330376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:43.330381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:43.330387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:43.330391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:43.330397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:43.330402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:43.330412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:43.330416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:43.330422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:43.330427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:43.330433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:43.330438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:43.330443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:43.330449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.330459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.330465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.330471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.330478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.330484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.330494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:43.330500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:43.330506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:43.330515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:43.330563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:43.336048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:43.336890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:43.336910Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:43.336912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:43.336916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:43.336923Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 148 [2:7555894773301415744:3090]
2025-09-30T14:50:43.336941Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:43.336957Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:43.336960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.336963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.336966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.336982Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:43.336995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:43.337002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:43.337058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.337066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.337069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.337073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:43.337075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:43.337158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:43.337165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.337179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.337192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.337211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:43.337231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894773391139088:2454], now have 1 active actors on pipe
2025-09-30T14:50:43.337234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894773391139275:3386], now have 1 active actors on pipe
2025-09-30T14:50:43.337241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894773301415739:3090]
2025-09-30T14:50:43.337243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894773301415739:3090]
2025-09-30T14:50:43.337246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894773301415739:3090]
2025-09-30T14:50:43.337259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:43.337273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:43.337279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:43.337283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:43.337285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:43.337289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:43.337285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 148
2025-09-30T14:50:43.337292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:43.337336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894773301415739:3090]
2025-09-30T14:50:43.337345Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:43.337323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 148
2025-09-30T14:50:43.337361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:43.337385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:43.337394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:43.337424Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c88fa8b1-dfcc1f43-9fd8700-63e93d3f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:43.337435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.337439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.337441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:43.337451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.337465Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:43.337478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:43.337652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:43.337661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:43.337676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:43.337781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 149 partition: 0 MaxSeqNo: 42 sessionId: src_id|c88fa8b1-dfcc1f43-9fd8700-63e93d3f_0
2025-09-30T14:50:43.338168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|233d1d45-cf91935b-d8fbfdd5-4e9907aa_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c88fa8b1-dfcc1f43-9fd8700-63e93d3f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:43.340988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c88fa8b1-dfcc1f43-9fd8700-63e93d3f_0] Write session: try to update token
2025-09-30T14:50:43.341010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c88fa8b1-dfcc1f43-9fd8700-63e93d3f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:43.349528Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:43.349546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:43.349548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:43.349551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:43.349560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894773301415739:3090]
2025-09-30T14:50:43.349564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894773301415739:3090]
2025-09-30T14:50:43.349569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894773301415739:3090]
2025-09-30T14:50:43.349606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:43.349614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.349617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:43.349627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:43.349634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:43.349638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:43.349753Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:43.359636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 149 sessionId: src_id|c88fa8b1-dfcc1f43-9fd8700-63e93d3f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:43.362232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:43.412187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894773391139299:3106]
2025-09-30T14:50:43.412491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 148, pipe: [1:7555894773391139299:3106]
2025-09-30T14:50:43.469460Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:43.469934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:43.469946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:43.469962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894773391139299:3106], now have 1 active actors on pipe
2025-09-30T14:50:43.470124Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:43.470193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894773391139299:3106]
2025-09-30T14:50:43.470221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:43.470253Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:43.470279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 149 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c88fa8b1-dfcc1f43-9fd8700-63e93d3f_0
2025-09-30T14:50:43.470421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 149 sessionId: src_id|c88fa8b1-dfcc1f43-9fd8700-63e93d3f_0 is DEAD
2025-09-30T14:50:43.470546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c88fa8b1-dfcc1f43-9fd8700-63e93d3f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:43.470556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c88fa8b1-dfcc1f43-9fd8700-63e93d3f_0] Write session will restart in 0.006652s
2025-09-30T14:50:43.470579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c88fa8b1-dfcc1f43-9fd8700-63e93d3f_0] Write session: Do CDS request
2025-09-30T14:50:43.470585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c88fa8b1-dfcc1f43-9fd8700-63e93d3f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:43.478792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c88fa8b1-dfcc1f43-9fd8700-63e93d3f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:43.478806Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:43.478822Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 150
2025-09-30T14:50:43.479054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 150 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:43.479092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 150 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:43.479098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=150 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:43.479102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:43.479581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 150 sessionId:  describe result for acl check
2025-09-30T14:50:43.479621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:43.479624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:43.479626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:43.479632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894773391139335:3391] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:43.480217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894773391139335:3391] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:43.482873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894773391139335:3391] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:43.485748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:43.485954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894773391139335:3391] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:43.485982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894773391139335:3391] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:43.485985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894773391139335:3391] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:43.485993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 150 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:43.487023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:43.487200Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:43.487210Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:43.487221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:43.487289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:43.487330Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894773301415950:3093]
2025-09-30T14:50:43.487939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:43.488247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:43.488290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:43.488602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:43.488665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:43.488671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:43.488672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:43.488674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:43.488675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:43.488676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:43.488677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:43.488678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:43.488679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:43.488681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:43.488682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.488683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.488684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.488685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:43.488686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:43.488692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:43.488702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:43.488707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:43.488710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:43.488714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:43.488719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:43.488722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:43.488726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:43.488729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:43.488733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:43.488736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.488739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.488743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.488747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:43.488751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:43.488758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:43.488766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:43.488771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:43.488777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:43.488782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:43.488787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:43.488791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:43.488797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:43.488801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:43.488806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:43.488812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:43.488817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:43.488822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:43.488827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:43.488831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:43.488836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:43.488840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:43.488845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:43.488849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:43.488854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:43.488858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.488863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.488867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.488872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.488877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.488882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.488886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:43.488891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:43.488902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:43.488907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:43.488953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:43.494366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:43.495385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:43.495401Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:43.495404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:43.495407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:43.495414Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 149 [2:7555894773301415950:3093]
2025-09-30T14:50:43.495431Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:43.495447Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:43.495451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.495454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.495456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.495472Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:43.495480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:43.495487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:43.495550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.495552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.495555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.495559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:43.495562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:43.495629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:43.495637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.495650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.495667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.495685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:43.495712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894773391139503:3391], now have 1 active actors on pipe
2025-09-30T14:50:43.495720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894773391139302:2454], now have 1 active actors on pipe
2025-09-30T14:50:43.495726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894773301415943:3093]
2025-09-30T14:50:43.495729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894773301415943:3093]
2025-09-30T14:50:43.495731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894773301415943:3093]
2025-09-30T14:50:43.495739Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:43.495748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:43.495752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:43.495754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:43.495755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:43.495770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:43.495777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:43.495810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894773301415943:3093]
2025-09-30T14:50:43.495821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:43.495835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:43.495816Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 149
2025-09-30T14:50:43.495815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 149
2025-09-30T14:50:43.495878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:43.495889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:43.495913Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69a6dec8-79b47023-92562c05-f5e711d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:43.495919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.495923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.495925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:43.495935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.495943Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:43.495955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:43.496163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:43.496177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:43.496199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:43.496316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 150 partition: 0 MaxSeqNo: 42 sessionId: src_id|69a6dec8-79b47023-92562c05-f5e711d0_0
2025-09-30T14:50:43.496722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c88fa8b1-dfcc1f43-9fd8700-63e93d3f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|69a6dec8-79b47023-92562c05-f5e711d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:43.499526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69a6dec8-79b47023-92562c05-f5e711d0_0] Write session: try to update token
2025-09-30T14:50:43.499543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69a6dec8-79b47023-92562c05-f5e711d0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:43.510378Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:43.510410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:43.510422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894773301415943:3093]
2025-09-30T14:50:43.510475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:43.510488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:43.510756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:43.510946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:43.511105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:43.511277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:43.511494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:43.511541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:43.517185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 150 sessionId: src_id|69a6dec8-79b47023-92562c05-f5e711d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:43.519941Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:43.519960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:43.519963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:43.519965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:43.519976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894773301415943:3093]
2025-09-30T14:50:43.519980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894773301415943:3093]
2025-09-30T14:50:43.519985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894773301415943:3093]
2025-09-30T14:50:43.520026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:43.520033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.520033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:43.520036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:43.520039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:43.520043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:43.520184Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:43.520353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:43.570368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894773391139514:3106]
2025-09-30T14:50:43.570686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 149, pipe: [1:7555894773391139514:3106]
2025-09-30T14:50:43.631702Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:43.632028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:43.632049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:43.632071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894773391139514:3106], now have 1 active actors on pipe
2025-09-30T14:50:43.632301Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:43.632360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:43.632377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:43.632384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894773391139514:3106]
2025-09-30T14:50:43.632405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:43.632455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 150 reason: error at write: Disconnected sessionId: src_id|69a6dec8-79b47023-92562c05-f5e711d0_0
2025-09-30T14:50:43.632639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 150 sessionId: src_id|69a6dec8-79b47023-92562c05-f5e711d0_0 is DEAD
2025-09-30T14:50:43.632829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69a6dec8-79b47023-92562c05-f5e711d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:43.632840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69a6dec8-79b47023-92562c05-f5e711d0_0] Write session will restart in 0.007937s
2025-09-30T14:50:43.632864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69a6dec8-79b47023-92562c05-f5e711d0_0] Write session: Do CDS request
2025-09-30T14:50:43.632872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69a6dec8-79b47023-92562c05-f5e711d0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:43.641754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69a6dec8-79b47023-92562c05-f5e711d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:43.641844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:43.641869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 151
2025-09-30T14:50:43.642003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 151 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:43.642034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 151 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:43.642053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=151 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:43.642062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:43.642548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 151 sessionId:  describe result for acl check
2025-09-30T14:50:43.642588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:43.642590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:43.642593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:43.642599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894773391139530:3395] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:43.643159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894773391139530:3395] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:43.646110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894773391139530:3395] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:43.649023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894773391139530:3395] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:43.649037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894773391139530:3395] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:43.649040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894773391139530:3395] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:43.649048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 151 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:43.650143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:43.651431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:43.651662Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:43.651679Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:43.651692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:43.651778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:43.651828Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894773301416155:3095]
2025-09-30T14:50:43.652467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:43.652837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:43.652889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:43.653265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:43.653360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:43.653365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:43.653366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:43.653367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:43.653368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:43.653369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:43.653370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:43.653371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:43.653373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:43.653374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:43.653375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.653376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.653377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.653378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:43.653379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:43.653384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:43.653394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:43.653397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:43.653401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:43.653404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:43.653407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:43.653410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:43.653414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:43.653417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:43.653420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:43.653424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.653427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.653430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.653433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:43.653437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:43.653445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:43.653452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:43.653457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:43.653462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:43.653466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:43.653471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:43.653477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:43.653481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:43.653485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:43.653490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:43.653494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:43.653498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:43.653504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:43.653514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:43.653519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:43.653529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:43.653534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:43.653544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:43.653553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:43.653559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:43.653569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.653579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.653584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.653593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.653598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.653607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.653612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:43.653622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:43.653627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:43.653636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:43.653679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:43.659363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:43.660260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:43.660278Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:43.660281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:43.660284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:43.660289Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 150 [2:7555894773301416155:3095]
2025-09-30T14:50:43.660303Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:43.660322Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:43.660326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.660330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.660333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.660350Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:43.660363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:43.660370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:43.660461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.660469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.660471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.660474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:43.660477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:43.660558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:43.660566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.660582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.660599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.660622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:43.660644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894773391139515:2454], now have 1 active actors on pipe
2025-09-30T14:50:43.660652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894773391139713:3395], now have 1 active actors on pipe
2025-09-30T14:50:43.660659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894773301416150:3095]
2025-09-30T14:50:43.660662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894773301416150:3095]
2025-09-30T14:50:43.660664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894773301416150:3095]
2025-09-30T14:50:43.660677Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:43.660696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:43.660697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:43.660700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:43.660702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:43.660714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:43.660718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:43.660697Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 150
2025-09-30T14:50:43.660701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 150
2025-09-30T14:50:43.660753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894773301416150:3095]
2025-09-30T14:50:43.660763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:43.660779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:43.660783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:43.660801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:43.661078Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1bf68f91-e9372fc2-e2a61eaf-704b90b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:43.661092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.661095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.661098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:43.661108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.661121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:43.661147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:43.661325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:43.661333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:43.661350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:43.661463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 151 partition: 0 MaxSeqNo: 42 sessionId: src_id|1bf68f91-e9372fc2-e2a61eaf-704b90b3_0
2025-09-30T14:50:43.661855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69a6dec8-79b47023-92562c05-f5e711d0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1bf68f91-e9372fc2-e2a61eaf-704b90b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:43.664858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bf68f91-e9372fc2-e2a61eaf-704b90b3_0] Write session: try to update token
2025-09-30T14:50:43.664877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bf68f91-e9372fc2-e2a61eaf-704b90b3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:43.672975Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:43.672995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:43.672997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:43.672999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:43.673009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894773301416150:3095]
2025-09-30T14:50:43.673014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894773301416150:3095]
2025-09-30T14:50:43.673018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894773301416150:3095]
2025-09-30T14:50:43.673056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:43.673058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:43.673061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:43.673064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.673065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:43.673067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:43.673258Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:43.681784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 151 sessionId: src_id|1bf68f91-e9372fc2-e2a61eaf-704b90b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:43.684538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:43.732642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894773391139740:3106]
2025-09-30T14:50:43.732898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 150, pipe: [1:7555894773391139740:3106]
2025-09-30T14:50:43.785763Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:43.786090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:43.786106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:43.786124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894773391139740:3106], now have 1 active actors on pipe
2025-09-30T14:50:43.786360Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:43.786393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894773391139740:3106]
2025-09-30T14:50:43.786423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:43.786456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:43.786549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 151 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1bf68f91-e9372fc2-e2a61eaf-704b90b3_0
2025-09-30T14:50:43.786745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 151 sessionId: src_id|1bf68f91-e9372fc2-e2a61eaf-704b90b3_0 is DEAD
2025-09-30T14:50:43.786890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bf68f91-e9372fc2-e2a61eaf-704b90b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:43.786900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bf68f91-e9372fc2-e2a61eaf-704b90b3_0] Write session will restart in 0.007135s
2025-09-30T14:50:43.786923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bf68f91-e9372fc2-e2a61eaf-704b90b3_0] Write session: Do CDS request
2025-09-30T14:50:43.786928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bf68f91-e9372fc2-e2a61eaf-704b90b3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:43.794802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bf68f91-e9372fc2-e2a61eaf-704b90b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:43.794919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:43.794935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 152
2025-09-30T14:50:43.795054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 152 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:43.795088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 152 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:43.795098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=152 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:43.795103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:43.795583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 152 sessionId:  describe result for acl check
2025-09-30T14:50:43.795625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:43.795632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:43.795634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:43.795640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894773391139756:3400] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:43.796199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894773391139756:3400] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:43.798588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894773391139756:3400] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:43.801787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894773391139756:3400] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:43.801806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894773391139756:3400] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:43.801809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894773391139756:3400] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:43.801818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 152 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:43.803116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:43.804253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:43.804427Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:43.804440Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:43.804450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:43.804507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:43.804547Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894773301416373:3098]
2025-09-30T14:50:43.805151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:43.805507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:43.805557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:43.805865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:43.805940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:43.805947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:43.805948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:43.805949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:43.805950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:43.805951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:43.805952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:43.805953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:43.805954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:43.805955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:43.805956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.805957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.805958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.805959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:43.805960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:43.805965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:43.805975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:43.805979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:43.805983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:43.805987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:43.805990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:43.805994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:43.805998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:43.806002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:43.806006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:43.806010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.806014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.806018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.806022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:43.806026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:43.806033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:43.806042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:43.806048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:43.806055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:43.806060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:43.806066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:43.806070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:43.806076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:43.806081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:43.806087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:43.806091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:43.806097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:43.806102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:43.806108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:43.806112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:43.806124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:43.806130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:43.806139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:43.806144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:43.806149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:43.806155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.806160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.806170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.806176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.806185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.806190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.806199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:43.806205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:43.806214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:43.806220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:43.806266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:43.811758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:43.812643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:43.812659Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:43.812662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:43.812666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:43.812673Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 151 [2:7555894773301416373:3098]
2025-09-30T14:50:43.812689Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:43.812704Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:43.812713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.812716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.812719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.812733Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:43.812745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:43.812756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:43.812823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.812831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.812833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.812837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:43.812840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:43.812908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:43.812916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.812928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.812940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.812956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:43.812974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894773391139940:3400], now have 1 active actors on pipe
2025-09-30T14:50:43.812983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894773391139741:2454], now have 1 active actors on pipe
2025-09-30T14:50:43.812989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894773301416368:3098]
2025-09-30T14:50:43.812992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894773301416368:3098]
2025-09-30T14:50:43.812994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894773301416368:3098]
2025-09-30T14:50:43.813007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:43.813025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:43.813044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:43.813051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:43.813056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 151
2025-09-30T14:50:43.813058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 151
2025-09-30T14:50:43.813084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894773301416368:3098]
2025-09-30T14:50:43.813095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:43.813108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:43.813111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:43.813113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:43.813119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:43.813168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:43.813178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:43.813204Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea7792b3-38919203-4880eb26-4a20795d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:43.813212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.813215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.813217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:43.813226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.813236Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:43.813249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:43.813575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:43.813580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:43.813601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:43.813898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 152 partition: 0 MaxSeqNo: 42 sessionId: src_id|ea7792b3-38919203-4880eb26-4a20795d_0
2025-09-30T14:50:43.814320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bf68f91-e9372fc2-e2a61eaf-704b90b3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ea7792b3-38919203-4880eb26-4a20795d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:43.817095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea7792b3-38919203-4880eb26-4a20795d_0] Write session: try to update token
2025-09-30T14:50:43.817114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea7792b3-38919203-4880eb26-4a20795d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:43.825117Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:43.825136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:43.825138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:43.825140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:43.825150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894773301416368:3098]
2025-09-30T14:50:43.825154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894773301416368:3098]
2025-09-30T14:50:43.825158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894773301416368:3098]
2025-09-30T14:50:43.825200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:43.825200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:43.825206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:43.825208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.825210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:43.825211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:43.825351Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:43.832566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 152 sessionId: src_id|ea7792b3-38919203-4880eb26-4a20795d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:43.835457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:43.886780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894773391139955:3106]
2025-09-30T14:50:43.887097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 151, pipe: [1:7555894773391139955:3106]
2025-09-30T14:50:43.935978Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:43.936601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:43.936617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:43.936637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894773391139955:3106], now have 1 active actors on pipe
2025-09-30T14:50:43.936834Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:43.936910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:43.936914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894773391139955:3106]
2025-09-30T14:50:43.936927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:43.936932Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:43.937002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 152 reason: error at write: Disconnected sessionId: src_id|ea7792b3-38919203-4880eb26-4a20795d_0
2025-09-30T14:50:43.937223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 152 sessionId: src_id|ea7792b3-38919203-4880eb26-4a20795d_0 is DEAD
2025-09-30T14:50:43.937405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea7792b3-38919203-4880eb26-4a20795d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:43.937413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea7792b3-38919203-4880eb26-4a20795d_0] Write session will restart in 0.009752s
2025-09-30T14:50:43.937436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea7792b3-38919203-4880eb26-4a20795d_0] Write session: Do CDS request
2025-09-30T14:50:43.937442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea7792b3-38919203-4880eb26-4a20795d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:43.948810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea7792b3-38919203-4880eb26-4a20795d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:43.948872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:43.948885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 153
2025-09-30T14:50:43.949067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 153 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:43.949106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 153 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:43.949117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=153 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:43.949121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:43.949708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 153 sessionId:  describe result for acl check
2025-09-30T14:50:43.949757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:43.949764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:43.949767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:43.949773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894773391140066:3406] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:43.950338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894773391140066:3406] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:43.953945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894773391140066:3406] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:43.954514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:43.955908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:43.956114Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:43.956123Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:43.956133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:43.956181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:43.956220Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894773301416579:3100]
2025-09-30T14:50:43.956525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894773391140066:3406] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:43.956541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894773391140066:3406] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:43.956544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894773391140066:3406] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:43.956552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 153 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:43.956855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:43.957094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:43.957136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:43.957406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:43.957456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:43.957461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:43.957462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:43.957463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:43.957463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:43.957465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:43.957466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:43.957467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:43.957468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:43.957470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:43.957471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.957472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.957474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.957475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:43.957476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:43.957482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:43.957492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:43.957497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:43.957501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:43.957505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:43.957509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:43.957513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:43.957517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:43.957521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:43.957526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:43.957530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.957534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.957538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.957542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:43.957546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:43.957553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:43.957561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:43.957567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:43.957573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:43.957578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:43.957581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:43.957584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:43.957587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:43.957590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:43.957593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:43.957595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:43.957598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:43.957601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:43.957604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:43.957606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:43.957609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:43.957611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:43.957614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:43.957616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:43.957619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:43.957621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.957624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.957627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.957629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.957632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.957634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.957637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:43.957640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:43.957642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:43.957645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:43.957669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:43.963230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:43.964149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:43.964165Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:43.964168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:43.964172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:43.964179Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 152 [2:7555894773301416579:3100]
2025-09-30T14:50:43.964197Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:43.964212Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:43.964215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.964218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.964221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.964237Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:43.964248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:43.964255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:43.964314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.964321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.964324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.964328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:43.964331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:43.964406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:43.964416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.964428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:43.964440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:43.964455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:43.964475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894773391140166:3406], now have 1 active actors on pipe
2025-09-30T14:50:43.964483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894773391139956:2454], now have 1 active actors on pipe
2025-09-30T14:50:43.964491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894773301416574:3100]
2025-09-30T14:50:43.964497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894773301416574:3100]
2025-09-30T14:50:43.964500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894773301416574:3100]
2025-09-30T14:50:43.964511Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:43.964528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:43.964535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:43.964538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:43.964540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:43.964547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:43.964550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:43.964570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 152
2025-09-30T14:50:43.964581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894773301416574:3100]
2025-09-30T14:50:43.964570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 152
2025-09-30T14:50:43.964593Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:43.964632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:43.964686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:43.964701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:43.964727Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ceb6807-88c64cf0-3a12f274-22acc5e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:43.964735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.964744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.964746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:43.964757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.964770Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:43.964787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:43.964965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:43.964974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:43.964989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:43.965111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 153 partition: 0 MaxSeqNo: 42 sessionId: src_id|9ceb6807-88c64cf0-3a12f274-22acc5e1_0
2025-09-30T14:50:43.965464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea7792b3-38919203-4880eb26-4a20795d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9ceb6807-88c64cf0-3a12f274-22acc5e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:43.968330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ceb6807-88c64cf0-3a12f274-22acc5e1_0] Write session: try to update token
2025-09-30T14:50:43.968370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ceb6807-88c64cf0-3a12f274-22acc5e1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:43.977216Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:43.977237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:43.977249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894773301416574:3100]
2025-09-30T14:50:43.977295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:43.977299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:43.977574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:43.977765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:43.977953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:43.978132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:43.978377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:43.978420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:43.984429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 153 sessionId: src_id|9ceb6807-88c64cf0-3a12f274-22acc5e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:43.987112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:43.987891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:43.987913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:43.987932Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:43.987936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:43.987938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:43.987941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:43.987949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894773301416574:3100]
2025-09-30T14:50:43.987953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894773301416574:3100]
2025-09-30T14:50:43.987957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894773301416574:3100]
2025-09-30T14:50:43.988006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:43.988006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:43.988013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:43.988016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:43.988017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:43.988019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:43.988159Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:44.037317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894777686107477:3106]
2025-09-30T14:50:44.037962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 152, pipe: [1:7555894777686107477:3106]
2025-09-30T14:50:44.103291Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:44.103761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:44.103801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894777686107477:3106], now have 1 active actors on pipe
2025-09-30T14:50:44.104047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:44.104134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:44.104142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:44.104209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 153 reason: error at write: Disconnected sessionId: src_id|9ceb6807-88c64cf0-3a12f274-22acc5e1_0
2025-09-30T14:50:44.104369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 153 sessionId: src_id|9ceb6807-88c64cf0-3a12f274-22acc5e1_0 is DEAD
2025-09-30T14:50:44.104703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:44.104737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894777686107477:3106]
2025-09-30T14:50:44.107361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ceb6807-88c64cf0-3a12f274-22acc5e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:44.107373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ceb6807-88c64cf0-3a12f274-22acc5e1_0] Write session will restart in 0.009964s
2025-09-30T14:50:44.107393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ceb6807-88c64cf0-3a12f274-22acc5e1_0] Write session: Do CDS request
2025-09-30T14:50:44.107399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ceb6807-88c64cf0-3a12f274-22acc5e1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:44.118775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ceb6807-88c64cf0-3a12f274-22acc5e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:44.118865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:44.118881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 154
2025-09-30T14:50:44.119059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 154 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:44.119094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 154 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:44.119102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=154 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:44.119106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:44.119525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 154 sessionId:  describe result for acl check
2025-09-30T14:50:44.119563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:44.119566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:44.119567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:44.119573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894777686107629:3416] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:44.120120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894777686107629:3416] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:44.121901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:44.122299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894777686107629:3416] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:44.123346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:44.123569Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:44.123580Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:44.123590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:44.123643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:44.123678Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894777596384102:3109]
2025-09-30T14:50:44.124347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:44.124653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:44.124715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:44.124986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:44.125052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:44.125059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:44.125060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:44.125062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:44.125063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:44.125064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:44.125066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:44.125067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:44.125068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:44.125070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:44.125071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.125072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.125073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.125074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:44.125075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:44.125081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:44.125087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:44.125089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:44.125091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:44.125094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:44.125098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:44.125102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:44.125105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:44.125109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:44.125113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:44.125117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.125121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.125126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.125130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:44.125134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:44.125141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:44.125146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:44.125149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:44.125153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:44.125156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:44.125159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:44.125161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:44.125166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:44.125173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:44.125177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:44.125181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:44.125186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:44.125190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:44.125194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:44.125199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:44.125203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:44.125208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:44.125213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:44.125217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:44.125221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:44.125225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.125229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.125233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.125238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.125241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.125246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.125249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:44.125254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:44.125257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:44.125261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:44.125299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:44.126001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894777686107629:3416] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:44.126017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894777686107629:3416] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:44.126021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894777686107629:3416] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:44.126029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 154 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:44.131093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:44.131972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:44.131988Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:44.131991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:44.131995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:44.132002Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 153 [2:7555894777596384102:3109]
2025-09-30T14:50:44.132019Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:44.132034Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:44.132037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.132041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.132043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.132060Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:44.132067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:44.132073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:44.132128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.132137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.132140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.132144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:44.132146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:44.132211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:44.132218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.132232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.132244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.132265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:44.132288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894777686107491:2454], now have 1 active actors on pipe
2025-09-30T14:50:44.132292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894777686107708:3416], now have 1 active actors on pipe
2025-09-30T14:50:44.132312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894777596384093:3109]
2025-09-30T14:50:44.132314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894777596384093:3109]
2025-09-30T14:50:44.132316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894777596384093:3109]
2025-09-30T14:50:44.132327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:44.132345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:44.132360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:44.132362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:44.132343Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 153
2025-09-30T14:50:44.132374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:44.132385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:44.132349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 153
2025-09-30T14:50:44.132387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:44.132394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894777596384093:3109]
2025-09-30T14:50:44.132397Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:44.132441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:44.132485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:44.132499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:44.132524Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f368021-bdb60d8a-6cd4adac-927574b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:44.132541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.132544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.132547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:44.132561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.132574Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:44.132603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:44.132800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:44.132813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:44.132845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:44.132959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 154 partition: 0 MaxSeqNo: 42 sessionId: src_id|1f368021-bdb60d8a-6cd4adac-927574b4_0
2025-09-30T14:50:44.133302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ceb6807-88c64cf0-3a12f274-22acc5e1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1f368021-bdb60d8a-6cd4adac-927574b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:44.136045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f368021-bdb60d8a-6cd4adac-927574b4_0] Write session: try to update token
2025-09-30T14:50:44.136065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f368021-bdb60d8a-6cd4adac-927574b4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:44.144987Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:44.145008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:44.145018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894777596384093:3109]
2025-09-30T14:50:44.145070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:44.145097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:44.145244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:44.145389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:44.145526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:44.145671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:44.145942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:44.145998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:44.150786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 154 sessionId: src_id|1f368021-bdb60d8a-6cd4adac-927574b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:44.153449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:44.153676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:44.153698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:44.153728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:44.153828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:44.156618Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:44.156638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:44.156640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:44.156642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:44.156651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894777596384093:3109]
2025-09-30T14:50:44.156655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894777596384093:3109]
2025-09-30T14:50:44.156660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894777596384093:3109]
2025-09-30T14:50:44.156703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:44.156717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.156720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:44.156854Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:44.159366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:44.159382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:44.159386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:44.204718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894777686107717:3106]
2025-09-30T14:50:44.205038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 153, pipe: [1:7555894777686107717:3106]
2025-09-30T14:50:44.269564Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:44.278172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:44.278206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:44.278383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:44.278447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:44.278522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:44.278588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:44.278633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:44.278645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:44.278732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:44.278840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:44.278946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:44.279016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:44.279058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:44.279066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:44.279137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:44.279192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:44.279271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:44.279332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:44.279376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:44.279385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:44.279453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:44.279523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:44.279588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:44.279650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:44.279693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:44.279698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:44.279768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:44.279829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:44.279889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:44.279950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:44.279992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:44.279997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:44.280057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:44.280123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:44.280182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:44.280238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:44.280279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:44.280285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:44.280351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:44.280421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:44.280493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:44.280559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:44.280605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:44.280614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:44.280678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:44.280732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:44.280788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:44.280855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:44.280919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:44.280927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:44.280991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:44.281045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:44.281107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:44.281172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:44.281214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:44.281221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:44.281282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:44.281347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:44.281410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:44.281468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:44.281592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:44.281599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:44.281662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894777686107717:3106], now have 1 active actors on pipe
2025-09-30T14:50:44.281892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:44.281901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894777686107717:3106]
2025-09-30T14:50:44.281932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:44.281935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:44.281978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 154 reason: error at write: Disconnected sessionId: src_id|1f368021-bdb60d8a-6cd4adac-927574b4_0
2025-09-30T14:50:44.282207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 154 sessionId: src_id|1f368021-bdb60d8a-6cd4adac-927574b4_0 is DEAD
2025-09-30T14:50:44.282504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f368021-bdb60d8a-6cd4adac-927574b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:44.282521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f368021-bdb60d8a-6cd4adac-927574b4_0] Write session will restart in 0.008038s
2025-09-30T14:50:44.282552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f368021-bdb60d8a-6cd4adac-927574b4_0] Write session: Do CDS request
2025-09-30T14:50:44.282558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f368021-bdb60d8a-6cd4adac-927574b4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:44.282956Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:44.291760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f368021-bdb60d8a-6cd4adac-927574b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:44.291931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:44.291947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 155
2025-09-30T14:50:44.292139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 155 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:44.292176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 155 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:44.292181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=155 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:44.292186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:44.292754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 155 sessionId:  describe result for acl check
2025-09-30T14:50:44.292789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:44.292797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:44.292799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:44.292805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894777686107760:3421] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:44.293341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894777686107760:3421] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:44.297524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894777686107760:3421] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:44.301481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894777686107760:3421] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:44.301504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894777686107760:3421] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:44.301509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894777686107760:3421] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:44.301520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 155 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:44.299901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:44.301102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:44.301293Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:44.301297Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:44.301309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:44.301374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:44.301408Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894777596384330:3117]
2025-09-30T14:50:44.302045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:44.302379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:44.302421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:44.302801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:44.302857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:44.302859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:44.302860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:44.302861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:44.302862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:44.302863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:44.302864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:44.302866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:44.302867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:44.302868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:44.302869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.302870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.302872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.302873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:44.302874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:44.302880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:44.302890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:44.302894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:44.302899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:44.302903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:44.302907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:44.302911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:44.302914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:44.302916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:44.302919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:44.302921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.302923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.302926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.302928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:44.302930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:44.302936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:44.302941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:44.302945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:44.302951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:44.302955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:44.302960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:44.302965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:44.302971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:44.302976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:44.302981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:44.302983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:44.302987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:44.302989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:44.302992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:44.302995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:44.302997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:44.303000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:44.303003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:44.303005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:44.303008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:44.303011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.303014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.303016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.303019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.303021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.303024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.303026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:44.303029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:44.303033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:44.303036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:44.303059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:44.309281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:44.310239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:44.310253Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:44.310256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:44.310260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:44.310267Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 154 [2:7555894777596384330:3117]
2025-09-30T14:50:44.310286Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:44.310304Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:44.310308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.310311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.310314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.310334Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:44.310342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:44.310354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:44.310420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.310428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.310430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.310434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:44.310436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:44.310500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:44.310506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.310515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.310522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.310531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:44.310551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894777686107718:2454], now have 1 active actors on pipe
2025-09-30T14:50:44.310560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894777596384325:3117]
2025-09-30T14:50:44.310562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894777596384325:3117]
2025-09-30T14:50:44.310563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894777596384325:3117]
2025-09-30T14:50:44.310570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:44.310577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894777686107924:3421], now have 1 active actors on pipe
2025-09-30T14:50:44.310583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:44.310583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:44.310587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:44.310590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:44.310592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:44.310595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:44.310625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894777596384325:3117]
2025-09-30T14:50:44.310635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:44.310672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:44.310647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 154
2025-09-30T14:50:44.310676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 154
2025-09-30T14:50:44.310749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:44.310757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:44.310777Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0401260-7c7827b8-573477ca-bd40c400_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:44.310785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.310787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.310789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:44.310797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.310804Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:44.310822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:44.310955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:44.310965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:44.310982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:44.311085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 155 partition: 0 MaxSeqNo: 42 sessionId: src_id|f0401260-7c7827b8-573477ca-bd40c400_0
2025-09-30T14:50:44.316459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f368021-bdb60d8a-6cd4adac-927574b4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f0401260-7c7827b8-573477ca-bd40c400_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:44.322158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0401260-7c7827b8-573477ca-bd40c400_0] Write session: try to update token
2025-09-30T14:50:44.322186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0401260-7c7827b8-573477ca-bd40c400_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:44.323890Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:44.323913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:44.323926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894777596384325:3117]
2025-09-30T14:50:44.323983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:44.323990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:44.324375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:44.324538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:44.324900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:44.325055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:44.325264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:44.325320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:44.336554Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:44.336575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:44.336581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:44.336583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:44.336597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894777596384325:3117]
2025-09-30T14:50:44.336603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894777596384325:3117]
2025-09-30T14:50:44.336608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894777596384325:3117]
2025-09-30T14:50:44.336653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:44.336670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.336670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:44.336675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:44.336684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:44.336690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:44.336814Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:44.344104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 155 sessionId: src_id|f0401260-7c7827b8-573477ca-bd40c400_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:44.347032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:44.381922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894777686107936:3106]
2025-09-30T14:50:44.382237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 154, pipe: [1:7555894777686107936:3106]
2025-09-30T14:50:44.450953Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:44.451930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:44.451946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:44.451965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894777686107936:3106], now have 1 active actors on pipe
2025-09-30T14:50:44.452247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:44.452251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894777686107936:3106]
2025-09-30T14:50:44.452260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:44.452277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:44.452349Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:44.452333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 155 reason: error at write: Disconnected sessionId: src_id|f0401260-7c7827b8-573477ca-bd40c400_0
2025-09-30T14:50:44.452520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 155 sessionId: src_id|f0401260-7c7827b8-573477ca-bd40c400_0 is DEAD
2025-09-30T14:50:44.452648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0401260-7c7827b8-573477ca-bd40c400_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:44.452657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0401260-7c7827b8-573477ca-bd40c400_0] Write session will restart in 0.008689s
2025-09-30T14:50:44.452681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0401260-7c7827b8-573477ca-bd40c400_0] Write session: Do CDS request
2025-09-30T14:50:44.452690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0401260-7c7827b8-573477ca-bd40c400_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:44.462838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0401260-7c7827b8-573477ca-bd40c400_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:44.462949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:44.462983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 156
2025-09-30T14:50:44.463123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 156 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:44.463155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 156 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:44.463167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=156 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:44.463187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:44.463714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 156 sessionId:  describe result for acl check
2025-09-30T14:50:44.463751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:44.463753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:44.463755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:44.463761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894777686108016:3426] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:44.464271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894777686108016:3426] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:44.466679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894777686108016:3426] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:44.468672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:44.469949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:44.470061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894777686108016:3426] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:44.470075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894777686108016:3426] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:44.470079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894777686108016:3426] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:44.470087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 156 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:44.470172Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:44.470183Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:44.470194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:44.470247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:44.470318Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894777596384542:3120]
2025-09-30T14:50:44.470979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:44.471259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:44.471302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:44.471647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:44.471709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:44.471714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:44.471715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:44.471716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:44.471717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:44.471719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:44.471720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:44.471721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:44.471722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:44.471724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:44.471725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.471726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.471728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.471729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:44.471730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:44.471736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:44.471746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:44.471750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:44.471755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:44.471759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:44.471763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:44.471767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:44.471770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:44.471774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:44.471779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:44.471784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.471788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.471793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.471797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:44.471802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:44.471810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:44.471824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:44.471833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:44.471839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:44.471852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:44.471857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:44.471862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:44.471868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:44.471872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:44.471878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:44.471881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:44.471887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:44.471893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:44.471898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:44.471902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:44.471907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:44.471912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:44.471916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:44.471920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:44.471925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:44.471930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.471938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.471942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.471952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.471959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.471965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.471969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:44.471974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:44.471978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:44.471983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:44.472030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:44.478389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:44.479315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:44.479331Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:44.479334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:44.479337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:44.479345Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 155 [2:7555894777596384542:3120]
2025-09-30T14:50:44.479364Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:44.479379Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:44.479388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.479392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.479394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.479411Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:44.479422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:44.479431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:44.479490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.479496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.479499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.479503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:44.479506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:44.479570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:44.479577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.479589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.479605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.479628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:44.479650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894777686108146:3426], now have 1 active actors on pipe
2025-09-30T14:50:44.479658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894777686107939:2454], now have 1 active actors on pipe
2025-09-30T14:50:44.479666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894777596384536:3120]
2025-09-30T14:50:44.479668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894777596384536:3120]
2025-09-30T14:50:44.479670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894777596384536:3120]
2025-09-30T14:50:44.479685Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:44.479702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:44.479715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:44.479720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:44.479723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:44.479727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:44.479730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:44.479758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894777596384536:3120]
2025-09-30T14:50:44.479767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:44.479773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:44.479731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 155
2025-09-30T14:50:44.479732Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 155
2025-09-30T14:50:44.479801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:44.479812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:44.479838Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58ad62e4-d779f751-93f369b7-2043cdf5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:44.479850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.479855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.479857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:44.479866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.479875Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:44.479888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:44.480014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:44.480022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:44.480034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:44.480124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 156 partition: 0 MaxSeqNo: 42 sessionId: src_id|58ad62e4-d779f751-93f369b7-2043cdf5_0
2025-09-30T14:50:44.480499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0401260-7c7827b8-573477ca-bd40c400_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|58ad62e4-d779f751-93f369b7-2043cdf5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:44.483526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58ad62e4-d779f751-93f369b7-2043cdf5_0] Write session: try to update token
2025-09-30T14:50:44.483546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58ad62e4-d779f751-93f369b7-2043cdf5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:44.494472Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:44.494495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:44.494498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:44.494500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:44.494509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894777596384536:3120]
2025-09-30T14:50:44.494514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894777596384536:3120]
2025-09-30T14:50:44.494518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894777596384536:3120]
2025-09-30T14:50:44.494556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:44.494560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:44.494563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.494566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:44.494566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:44.494570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:44.494720Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:44.498565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 156 sessionId: src_id|58ad62e4-d779f751-93f369b7-2043cdf5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:44.501203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:44.552396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894777686108158:3106]
2025-09-30T14:50:44.552703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 155, pipe: [1:7555894777686108158:3106]
2025-09-30T14:50:44.609805Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:44.610179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:44.610192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:44.610238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894777686108158:3106], now have 1 active actors on pipe
2025-09-30T14:50:44.610520Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:44.610530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:44.610557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:44.610687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:44.610694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 156 reason: error at write: Disconnected sessionId: src_id|58ad62e4-d779f751-93f369b7-2043cdf5_0
2025-09-30T14:50:44.610764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894777686108158:3106]
2025-09-30T14:50:44.610956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 156 sessionId: src_id|58ad62e4-d779f751-93f369b7-2043cdf5_0 is DEAD
2025-09-30T14:50:44.611080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58ad62e4-d779f751-93f369b7-2043cdf5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:44.611092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58ad62e4-d779f751-93f369b7-2043cdf5_0] Write session will restart in 0.007712s
2025-09-30T14:50:44.611117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58ad62e4-d779f751-93f369b7-2043cdf5_0] Write session: Do CDS request
2025-09-30T14:50:44.611124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58ad62e4-d779f751-93f369b7-2043cdf5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:44.620105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58ad62e4-d779f751-93f369b7-2043cdf5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:44.620230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:44.620246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 157
2025-09-30T14:50:44.620396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 157 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:44.620430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 157 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:44.620434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=157 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:44.620439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:44.620918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 157 sessionId:  describe result for acl check
2025-09-30T14:50:44.620954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:44.620956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:44.620959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:44.620964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894777686108179:3430] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:44.621646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894777686108179:3430] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:44.624725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894777686108179:3430] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:44.628419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:44.628478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894777686108179:3430] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:44.628495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894777686108179:3430] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:44.628499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894777686108179:3430] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:44.628506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 157 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:44.629662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:44.629894Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:44.629906Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:44.629918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:44.629974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:44.630018Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894777596384754:3122]
2025-09-30T14:50:44.630741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:44.631013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:44.631059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:44.631397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:44.631448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:44.631455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:44.631456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:44.631457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:44.631459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:44.631460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:44.631461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:44.631463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:44.631464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:44.631465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:44.631466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.631467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.631469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.631469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:44.631470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:44.631476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:44.631485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:44.631489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:44.631493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:44.631496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:44.631500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:44.631504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:44.631507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:44.631512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:44.631516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:44.631520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.631524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.631528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.631532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:44.631536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:44.631542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:44.631550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:44.631557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:44.631563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:44.631567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:44.631572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:44.631575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:44.631580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:44.631584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:44.631589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:44.631593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:44.631597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:44.631602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:44.631606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:44.631610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:44.631615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:44.631619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:44.631624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:44.631628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:44.631633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:44.631637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.631642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.631646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.631651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.631655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.631660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.631664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:44.631669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:44.631673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:44.631677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:44.631717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:44.638409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:44.639259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:44.639273Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:44.639275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:44.639278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:44.639284Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 156 [2:7555894777596384754:3122]
2025-09-30T14:50:44.639299Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:44.639316Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:44.639322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.639324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.639325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.639338Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:44.639344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:44.639350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:44.639423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.639429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.639431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.639434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:44.639435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:44.639486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:44.639492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.639500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.639507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.639517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:44.639532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894777596384748:3122]
2025-09-30T14:50:44.639538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894777596384748:3122]
2025-09-30T14:50:44.639540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894777596384748:3122]
2025-09-30T14:50:44.639553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:44.639570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:44.639572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:44.639574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:44.639575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894777686108365:3430], now have 1 active actors on pipe
2025-09-30T14:50:44.639579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894777686108159:2454], now have 1 active actors on pipe
2025-09-30T14:50:44.639587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:44.639601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:44.639605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:44.639637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894777596384748:3122]
2025-09-30T14:50:44.639652Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:44.639637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 156
2025-09-30T14:50:44.639646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 156
2025-09-30T14:50:44.639673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:44.639697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:44.639702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:44.639734Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92642a1e-d693474-b29714e6-f980ce6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:44.639741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.639745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.639747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:44.639756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.639769Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:44.639789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:44.639956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:44.639962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:44.639975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:44.640046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 157 partition: 0 MaxSeqNo: 42 sessionId: src_id|92642a1e-d693474-b29714e6-f980ce6b_0
2025-09-30T14:50:44.640463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58ad62e4-d779f751-93f369b7-2043cdf5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|92642a1e-d693474-b29714e6-f980ce6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:44.643342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92642a1e-d693474-b29714e6-f980ce6b_0] Write session: try to update token
2025-09-30T14:50:44.643362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92642a1e-d693474-b29714e6-f980ce6b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:44.655829Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:44.655846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:44.655849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:44.655851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:44.655859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894777596384748:3122]
2025-09-30T14:50:44.655863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894777596384748:3122]
2025-09-30T14:50:44.655870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894777596384748:3122]
2025-09-30T14:50:44.655909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:44.655916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.655920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:44.655919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:44.655926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:44.655940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:44.656090Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:44.657761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 157 sessionId: src_id|92642a1e-d693474-b29714e6-f980ce6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:44.660368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:44.711086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894777686108378:3106]
2025-09-30T14:50:44.711376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 156, pipe: [1:7555894777686108378:3106]
2025-09-30T14:50:44.760323Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:44.760801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:44.760814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:44.760843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894777686108378:3106], now have 1 active actors on pipe
2025-09-30T14:50:44.761006Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:44.761057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:44.761072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:44.761096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894777686108378:3106]
2025-09-30T14:50:44.761118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:44.761142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 157 reason: error at write: Disconnected sessionId: src_id|92642a1e-d693474-b29714e6-f980ce6b_0
2025-09-30T14:50:44.761349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 157 sessionId: src_id|92642a1e-d693474-b29714e6-f980ce6b_0 is DEAD
2025-09-30T14:50:44.761538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92642a1e-d693474-b29714e6-f980ce6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:44.761559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92642a1e-d693474-b29714e6-f980ce6b_0] Write session will restart in 0.008616s
2025-09-30T14:50:44.761582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92642a1e-d693474-b29714e6-f980ce6b_0] Write session: Do CDS request
2025-09-30T14:50:44.761587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92642a1e-d693474-b29714e6-f980ce6b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:44.771746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92642a1e-d693474-b29714e6-f980ce6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:44.771847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:44.771865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 158
2025-09-30T14:50:44.771996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 158 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:44.772028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 158 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:44.772037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=158 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:44.772042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:44.772501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 158 sessionId:  describe result for acl check
2025-09-30T14:50:44.772539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:44.772542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:44.772544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:44.772550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894777686108491:3435] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:44.773110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894777686108491:3435] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:44.775351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894777686108491:3435] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:44.776216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:44.777288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:44.777454Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:44.777461Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:44.777468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:44.777516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:44.777547Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894777596384977:3125]
2025-09-30T14:50:44.777737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894777686108491:3435] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:44.777751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894777686108491:3435] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:44.777754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894777686108491:3435] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:44.777763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 158 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:44.778083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:44.778339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:44.778370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:44.778641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:44.778717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:44.778723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:44.778724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:44.778725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:44.778726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:44.778727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:44.778729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:44.778730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:44.778731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:44.778732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:44.778733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.778734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.778735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.778736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:44.778737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:44.778742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:44.778751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:44.778755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:44.778759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:44.778762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:44.778766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:44.778771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:44.778775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:44.778779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:44.778783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:44.778787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.778792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.778795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.778798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:44.778801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:44.778806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:44.778812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:44.778816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:44.778819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:44.778821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:44.778824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:44.778827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:44.778830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:44.778832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:44.778835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:44.778837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:44.778840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:44.778843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:44.778846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:44.778848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:44.778852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:44.778854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:44.778857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:44.778860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:44.778863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:44.778867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.778870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.778873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.778876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.778878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.778881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.778883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:44.778886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:44.778889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:44.778892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:44.778915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:44.787132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:44.788058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:44.788074Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:44.788077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:44.788081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:44.788088Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 157 [2:7555894777596384977:3125]
2025-09-30T14:50:44.788103Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:44.788121Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:44.788130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.788133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.788135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.788152Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:44.788164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:44.788172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:44.788240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.788248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.788251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.788255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:44.788257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:44.788330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:44.788338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.788350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.788361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.788378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:44.788403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894777686108391:2454], now have 1 active actors on pipe
2025-09-30T14:50:44.788411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894777686108599:3435], now have 1 active actors on pipe
2025-09-30T14:50:44.788417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894777596384972:3125]
2025-09-30T14:50:44.788420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894777596384972:3125]
2025-09-30T14:50:44.788422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894777596384972:3125]
2025-09-30T14:50:44.788437Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:44.788453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:44.788455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:44.788463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:44.788465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:44.788470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:44.788438Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 157
2025-09-30T14:50:44.788473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:44.788484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 157
2025-09-30T14:50:44.788515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894777596384972:3125]
2025-09-30T14:50:44.788528Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:44.788547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:44.788550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:44.788554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:44.788599Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|880ce8a9-de297583-3a602ee3-c0dcc34e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:44.788612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.788616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.788618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:44.788628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.788641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:44.788662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:44.788815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:44.788824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:44.788839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:44.788929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 158 partition: 0 MaxSeqNo: 42 sessionId: src_id|880ce8a9-de297583-3a602ee3-c0dcc34e_0
2025-09-30T14:50:44.789307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92642a1e-d693474-b29714e6-f980ce6b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|880ce8a9-de297583-3a602ee3-c0dcc34e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:44.792171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|880ce8a9-de297583-3a602ee3-c0dcc34e_0] Write session: try to update token
2025-09-30T14:50:44.792193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|880ce8a9-de297583-3a602ee3-c0dcc34e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:44.803605Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:44.803627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:44.803629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:44.803632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:44.803641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894777596384972:3125]
2025-09-30T14:50:44.803648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894777596384972:3125]
2025-09-30T14:50:44.803652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894777596384972:3125]
2025-09-30T14:50:44.803688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:44.803693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:44.803693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:44.803699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.803702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:44.803709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:44.803844Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:44.806217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 158 sessionId: src_id|880ce8a9-de297583-3a602ee3-c0dcc34e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:44.809055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:44.861141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894777686108611:3106]
2025-09-30T14:50:44.861444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 157, pipe: [1:7555894777686108611:3106]
2025-09-30T14:50:44.914849Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:44.915159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:44.915180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:44.915236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894777686108611:3106], now have 1 active actors on pipe
2025-09-30T14:50:44.915465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:44.915485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:44.915558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 158 reason: error at write: Disconnected sessionId: src_id|880ce8a9-de297583-3a602ee3-c0dcc34e_0
2025-09-30T14:50:44.915558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894777686108611:3106]
2025-09-30T14:50:44.915578Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:44.915755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 158 sessionId: src_id|880ce8a9-de297583-3a602ee3-c0dcc34e_0 is DEAD
2025-09-30T14:50:44.915915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|880ce8a9-de297583-3a602ee3-c0dcc34e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:44.915924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|880ce8a9-de297583-3a602ee3-c0dcc34e_0] Write session will restart in 0.007676s
2025-09-30T14:50:44.915947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|880ce8a9-de297583-3a602ee3-c0dcc34e_0] Write session: Do CDS request
2025-09-30T14:50:44.915953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|880ce8a9-de297583-3a602ee3-c0dcc34e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:44.915482Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:44.924788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|880ce8a9-de297583-3a602ee3-c0dcc34e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:44.924876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:44.924895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 159
2025-09-30T14:50:44.925025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 159 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:44.925055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 159 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:44.925066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=159 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:44.925079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:44.925476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 159 sessionId:  describe result for acl check
2025-09-30T14:50:44.925507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:44.925512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:44.925513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:44.925518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894777686108688:3439] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:44.925983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894777686108688:3439] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:44.928588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894777686108688:3439] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:44.930347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:44.931557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:44.931780Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:44.931793Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:44.931804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:44.931860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:44.931899Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894777596385190:3127]
2025-09-30T14:50:44.931922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894777686108688:3439] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:44.931939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894777686108688:3439] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:44.931943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894777686108688:3439] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:44.931951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 159 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:44.932580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:44.932888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:44.932940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:44.933280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:44.933354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:44.933376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:44.933377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:44.933378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:44.933380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:44.933381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:44.933383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:44.933384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:44.933385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:44.933387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:44.933388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.933390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.933391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.933393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:44.933394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:44.933400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:44.933415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:44.933420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:44.933424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:44.933428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:44.933433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:44.933437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:44.933441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:44.933446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:44.933451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:44.933456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.933460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.933464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.933469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:44.933474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:44.933483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:44.933495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:44.933504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:44.933510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:44.933517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:44.933523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:44.933528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:44.933535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:44.933541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:44.933546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:44.933556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:44.933561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:44.933567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:44.933574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:44.933579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:44.933585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:44.933594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:44.933601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:44.933607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:44.933613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:44.933618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.933623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.933629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.933635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.933640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.933648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.933653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:44.933664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:44.933669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:44.933675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:44.933728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:44.940515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:44.941397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:44.941413Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:44.941416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:44.941420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:44.941427Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 158 [2:7555894777596385190:3127]
2025-09-30T14:50:44.941443Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:44.941460Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:44.941463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.941466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.941469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.941484Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:44.941492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:44.941508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:44.941573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.941584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.941586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.941590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:44.941593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:44.941668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:44.941675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.941689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:44.941705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:44.941728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:44.941754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894777686108612:2454], now have 1 active actors on pipe
2025-09-30T14:50:44.941757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894777686108829:3439], now have 1 active actors on pipe
2025-09-30T14:50:44.941763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894777596385185:3127]
2025-09-30T14:50:44.941766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894777596385185:3127]
2025-09-30T14:50:44.941769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894777596385185:3127]
2025-09-30T14:50:44.941782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:44.941795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:44.941805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:44.941808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:44.941811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:44.941797Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 158
2025-09-30T14:50:44.941815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:44.941818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:44.941839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 158
2025-09-30T14:50:44.941855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894777596385185:3127]
2025-09-30T14:50:44.941866Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:44.941873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:44.941880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:44.941884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:44.941928Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e6fa41e-c193b89e-67aa10d3-d3e4328c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:44.941940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.941943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.941945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:44.941954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.941964Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:44.941981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:44.942112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:44.942122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:44.942136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:44.942219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 159 partition: 0 MaxSeqNo: 42 sessionId: src_id|3e6fa41e-c193b89e-67aa10d3-d3e4328c_0
2025-09-30T14:50:44.942614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|880ce8a9-de297583-3a602ee3-c0dcc34e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3e6fa41e-c193b89e-67aa10d3-d3e4328c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:44.945435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e6fa41e-c193b89e-67aa10d3-d3e4328c_0] Write session: try to update token
2025-09-30T14:50:44.945455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e6fa41e-c193b89e-67aa10d3-d3e4328c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:44.958072Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:44.958095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:44.958098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:44.958100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:44.958109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894777596385185:3127]
2025-09-30T14:50:44.958114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894777596385185:3127]
2025-09-30T14:50:44.958118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894777596385185:3127]
2025-09-30T14:50:44.958159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:44.958166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:44.958173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:44.958174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:44.958182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:44.958193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:44.958312Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:44.962041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 159 sessionId: src_id|3e6fa41e-c193b89e-67aa10d3-d3e4328c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:44.964666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:45.015756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894781981076146:3106]
2025-09-30T14:50:45.016110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 158, pipe: [1:7555894781981076146:3106]
2025-09-30T14:50:45.070867Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:45.071499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:45.071516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:45.071551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894781981076146:3106], now have 1 active actors on pipe
2025-09-30T14:50:45.071774Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:45.071868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:45.071890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:45.071891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894781981076146:3106]
2025-09-30T14:50:45.071911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:45.071964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 159 reason: error at write: Disconnected sessionId: src_id|3e6fa41e-c193b89e-67aa10d3-d3e4328c_0
2025-09-30T14:50:45.072175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 159 sessionId: src_id|3e6fa41e-c193b89e-67aa10d3-d3e4328c_0 is DEAD
2025-09-30T14:50:45.072320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e6fa41e-c193b89e-67aa10d3-d3e4328c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:45.072331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e6fa41e-c193b89e-67aa10d3-d3e4328c_0] Write session will restart in 0.008636s
2025-09-30T14:50:45.072354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e6fa41e-c193b89e-67aa10d3-d3e4328c_0] Write session: Do CDS request
2025-09-30T14:50:45.072360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e6fa41e-c193b89e-67aa10d3-d3e4328c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:45.081817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e6fa41e-c193b89e-67aa10d3-d3e4328c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:45.081947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:45.081964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 160
2025-09-30T14:50:45.082100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 160 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:45.082123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 160 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:45.082137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=160 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:45.082140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:45.082618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 160 sessionId:  describe result for acl check
2025-09-30T14:50:45.082651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:45.082664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:45.082666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:45.082673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894781981076209:3445] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:45.083234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894781981076209:3445] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:45.085444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894781981076209:3445] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:45.087432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:45.087582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894781981076209:3445] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:45.087592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894781981076209:3445] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:45.087596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894781981076209:3445] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:45.087602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 160 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:45.088464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:45.088658Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:45.088671Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:45.088683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:45.088741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:45.088784Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894781891352703:3130]
2025-09-30T14:50:45.089423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:45.089804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:45.089858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:45.090222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:45.090305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:45.090316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:45.090317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:45.090319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:45.090320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:45.090321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:45.090322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:45.090323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:45.090325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:45.090326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:45.090327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.090328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.090329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.090331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:45.090332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:45.090339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:45.090349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:45.090354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:45.090359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:45.090364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:45.090368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:45.090372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:45.090376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:45.090381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:45.090386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:45.090390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.090394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.090398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.090402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:45.090407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:45.090415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:45.090423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:45.090429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:45.090442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:45.090447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:45.090453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:45.090463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:45.090469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:45.090479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:45.090488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:45.090497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:45.090507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:45.090517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:45.090527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:45.090536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:45.090546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:45.090556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:45.090562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:45.090570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:45.090576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:45.090585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.090591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.090595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.090605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.090614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.090620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.090625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:45.090630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:45.090635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:45.090643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:45.090702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:45.100025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:45.101022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:45.101042Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:45.101046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:45.101050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:45.101058Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 159 [2:7555894781891352703:3130]
2025-09-30T14:50:45.101076Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:45.101101Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:45.101104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.101108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.101111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.101127Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:45.101139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:45.101151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:45.101227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.101234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.101237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.101240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:45.101243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:45.101312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:45.101320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.101337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.101355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.101377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:45.101401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894781981076359:3445], now have 1 active actors on pipe
2025-09-30T14:50:45.101412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894781891352697:3130]
2025-09-30T14:50:45.101419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894781891352697:3130]
2025-09-30T14:50:45.101421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894781891352697:3130]
2025-09-30T14:50:45.101437Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:45.101452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894781981076150:2454], now have 1 active actors on pipe
2025-09-30T14:50:45.101465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:45.101467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:45.101471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:45.101472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:45.101486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:45.101461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 159
2025-09-30T14:50:45.101490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:45.101479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 159
2025-09-30T14:50:45.101535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894781891352697:3130]
2025-09-30T14:50:45.101548Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:45.101556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:45.101571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:45.101581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:45.101640Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0239184-e8cf975e-ee470348-cbbe5ce2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:45.101652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.101662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.101664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:45.101674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.101690Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:45.101715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:45.101905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:45.101921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:45.101939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:45.102061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 160 partition: 0 MaxSeqNo: 42 sessionId: src_id|f0239184-e8cf975e-ee470348-cbbe5ce2_0
2025-09-30T14:50:45.102432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e6fa41e-c193b89e-67aa10d3-d3e4328c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f0239184-e8cf975e-ee470348-cbbe5ce2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:45.112937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0239184-e8cf975e-ee470348-cbbe5ce2_0] Write session: try to update token
2025-09-30T14:50:45.112961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0239184-e8cf975e-ee470348-cbbe5ce2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:45.118629Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:45.118667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:45.118670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:45.118672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:45.118681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894781891352697:3130]
2025-09-30T14:50:45.118685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894781891352697:3130]
2025-09-30T14:50:45.118690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894781891352697:3130]
2025-09-30T14:50:45.118739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:45.118752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.118755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:45.118758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:45.118764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:45.118771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:45.118905Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:45.127992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 160 sessionId: src_id|f0239184-e8cf975e-ee470348-cbbe5ce2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:45.136220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:45.171896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894781981076394:3106]
2025-09-30T14:50:45.172085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 159, pipe: [1:7555894781981076394:3106]
2025-09-30T14:50:45.238305Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:45.238689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:45.238707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:45.238728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894781981076394:3106], now have 1 active actors on pipe
2025-09-30T14:50:45.238962Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:45.238978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:45.239010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894781981076394:3106]
2025-09-30T14:50:45.239032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:45.239118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 160 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f0239184-e8cf975e-ee470348-cbbe5ce2_0
2025-09-30T14:50:45.239327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 160 sessionId: src_id|f0239184-e8cf975e-ee470348-cbbe5ce2_0 is DEAD
2025-09-30T14:50:45.239480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0239184-e8cf975e-ee470348-cbbe5ce2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:45.239487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0239184-e8cf975e-ee470348-cbbe5ce2_0] Write session will restart in 0.006452s
2025-09-30T14:50:45.239509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0239184-e8cf975e-ee470348-cbbe5ce2_0] Write session: Do CDS request
2025-09-30T14:50:45.239514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0239184-e8cf975e-ee470348-cbbe5ce2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:45.246866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0239184-e8cf975e-ee470348-cbbe5ce2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:45.246967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:45.246993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 161
2025-09-30T14:50:45.247159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 161 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:45.247192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 161 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:45.247202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=161 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:45.247206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:45.247663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 161 sessionId:  describe result for acl check
2025-09-30T14:50:45.247697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:45.247703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:45.247705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:45.247713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894781981076410:3456] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:45.248194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894781981076410:3456] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:45.250757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894781981076410:3456] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:45.253995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894781981076410:3456] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:45.254012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894781981076410:3456] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:45.254015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894781981076410:3456] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:45.254023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 161 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:45.254131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:45.255048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:45.255171Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:45.255179Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:45.255186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:45.255216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:45.255258Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894781891352953:3144]
2025-09-30T14:50:45.255705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:45.256203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:45.256248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:45.256471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:45.256513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:45.256518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:45.256518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:45.256519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:45.256520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:45.256520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:45.256521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:45.256522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:45.256523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:45.256524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:45.256525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.256525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.256526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.256526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:45.256527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:45.256531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:45.256537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:45.256540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:45.256542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:45.256545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:45.256547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:45.256549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:45.256551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:45.256554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:45.256556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:45.256559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.256561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.256563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.256565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:45.256568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:45.256573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:45.256578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:45.256582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:45.256586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:45.256588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:45.256591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:45.256594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:45.256597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:45.256600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:45.256602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:45.256605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:45.256608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:45.256611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:45.256614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:45.256617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:45.256620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:45.256622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:45.256625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:45.256627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:45.256630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:45.256633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.256635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.256637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.256640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.256643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.256647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.256649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:45.256652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:45.256654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:45.256657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:45.256680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:45.261875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:45.262792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:45.262805Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:45.262807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:45.262810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:45.262816Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 160 [2:7555894781891352953:3144]
2025-09-30T14:50:45.262827Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:45.262838Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:45.262840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.262842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.262843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.262854Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:45.262860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:45.262868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:45.262921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.262929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.262931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.262935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:45.262938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:45.263011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:45.263019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.263030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.263047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.263069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:45.263091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894781981076395:2454], now have 1 active actors on pipe
2025-09-30T14:50:45.263099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894781981076605:3456], now have 1 active actors on pipe
2025-09-30T14:50:45.263105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894781891352947:3144]
2025-09-30T14:50:45.263112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894781891352947:3144]
2025-09-30T14:50:45.263114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894781891352947:3144]
2025-09-30T14:50:45.263127Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:45.263140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:45.263144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:45.263149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:45.263151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:45.263159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:45.263162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:45.263186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894781891352947:3144]
2025-09-30T14:50:45.263189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 160
2025-09-30T14:50:45.263198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:45.263214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:45.263192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 160
2025-09-30T14:50:45.263269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:45.263278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:45.263303Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dfa2ce51-1d1b7119-9b4af339-bce99ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:45.263313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.263320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.263322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:45.263331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.263343Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:45.263360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:45.263504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:45.263511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:45.263523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:45.263618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 161 partition: 0 MaxSeqNo: 42 sessionId: src_id|dfa2ce51-1d1b7119-9b4af339-bce99ae_0
2025-09-30T14:50:45.263971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0239184-e8cf975e-ee470348-cbbe5ce2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dfa2ce51-1d1b7119-9b4af339-bce99ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:45.266696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfa2ce51-1d1b7119-9b4af339-bce99ae_0] Write session: try to update token
2025-09-30T14:50:45.266713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfa2ce51-1d1b7119-9b4af339-bce99ae_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:45.281473Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:45.281497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:45.281508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894781891352947:3144]
2025-09-30T14:50:45.281561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:45.281569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:45.281772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:45.281929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:45.281920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 161 sessionId: src_id|dfa2ce51-1d1b7119-9b4af339-bce99ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:45.282069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:45.282211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:45.282468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:45.282510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:45.284918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:45.285146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:45.285166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:45.285198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:45.285282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:45.289533Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:45.289549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:45.289551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:45.289553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:45.289561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894781891352947:3144]
2025-09-30T14:50:45.289564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894781891352947:3144]
2025-09-30T14:50:45.289567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894781891352947:3144]
2025-09-30T14:50:45.289598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:45.289603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.289605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:45.289604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:45.289609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:45.289621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:45.289731Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:45.339344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894781981076618:3106]
2025-09-30T14:50:45.339638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 160, pipe: [1:7555894781981076618:3106]
2025-09-30T14:50:45.400500Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:45.408451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:45.408480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:45.408653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:45.408730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:45.408810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:45.408895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:45.408946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:45.408956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:45.409038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:45.409111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:45.409190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:45.409269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:45.409319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:45.409326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:45.409408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:45.409482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:45.409560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:45.409657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:45.409807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:45.409818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:45.409896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:45.409977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:45.410082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:45.410159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:45.410214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:45.410222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:45.410298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:45.410371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:45.410448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:45.410526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:45.410574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:45.410581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:45.410649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:45.410724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:45.410793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:45.410858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:45.410998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:45.411006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:45.411076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:45.411139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:45.411209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:45.411294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:45.411485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:45.411494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:45.411563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:45.411627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:45.411690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:45.411758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:45.411806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:45.411814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:45.411881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:45.411943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:45.412009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:45.412075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:45.412198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:45.412205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:45.412277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:45.412339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:45.412402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:45.412567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:45.412626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:45.412634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:45.412698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894781981076618:3106], now have 1 active actors on pipe
2025-09-30T14:50:45.412918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894781981076618:3106]
2025-09-30T14:50:45.412918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:45.412959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:45.412962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:45.412988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 161 reason: error at write: Disconnected sessionId: src_id|dfa2ce51-1d1b7119-9b4af339-bce99ae_0
2025-09-30T14:50:45.413164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 161 sessionId: src_id|dfa2ce51-1d1b7119-9b4af339-bce99ae_0 is DEAD
2025-09-30T14:50:45.413311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfa2ce51-1d1b7119-9b4af339-bce99ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:45.413327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfa2ce51-1d1b7119-9b4af339-bce99ae_0] Write session will restart in 0.006589s
2025-09-30T14:50:45.413350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfa2ce51-1d1b7119-9b4af339-bce99ae_0] Write session: Do CDS request
2025-09-30T14:50:45.413355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfa2ce51-1d1b7119-9b4af339-bce99ae_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:45.413731Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:45.420978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfa2ce51-1d1b7119-9b4af339-bce99ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:45.421085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:45.421104Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 162
2025-09-30T14:50:45.421287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 162 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:45.421326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 162 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:45.421331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=162 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:45.421335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:45.421758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 162 sessionId:  describe result for acl check
2025-09-30T14:50:45.421795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:45.421804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:45.421808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:45.421820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894781981076653:3460] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:45.422397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894781981076653:3460] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:45.425034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894781981076653:3460] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:45.427718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894781981076653:3460] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:45.427730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894781981076653:3460] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:45.427734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894781981076653:3460] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:45.427742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 162 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:45.427832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:45.428844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:45.429007Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:45.429014Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:45.429021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:45.429056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:45.429086Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894781891353170:3146]
2025-09-30T14:50:45.429546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:45.429978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:45.430046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:45.430427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:45.430491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:45.430497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:45.430499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:45.430500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:45.430501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:45.430503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:45.430504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:45.430505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:45.430507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:45.430509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:45.430511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.430512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.430514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.430516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:45.430517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:45.430523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:45.430535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:45.430539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:45.430544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:45.430548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:45.430553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:45.430558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:45.430563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:45.430567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:45.430572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:45.430577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.430581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.430585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.430590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:45.430594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:45.430601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:45.430610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:45.430622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:45.430628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:45.430634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:45.430639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:45.430644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:45.430650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:45.430676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:45.430682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:45.430692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:45.430697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:45.430702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:45.430713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:45.430717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:45.430723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:45.430732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:45.430738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:45.430747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:45.430753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:45.430760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.430766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.430771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.430786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.430796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.430803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.430811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:45.430817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:45.430822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:45.430832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:45.430879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:45.436696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:45.437553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:45.437570Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:45.437573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:45.437577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:45.437585Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 161 [2:7555894781891353170:3146]
2025-09-30T14:50:45.437602Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:45.437619Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:45.437622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.437626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.437628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.437643Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:45.437655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:45.437666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:45.437720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.437727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.437729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.437733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:45.437736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:45.437804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:45.437810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.437824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.437839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.437863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:45.437883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894781981076619:2454], now have 1 active actors on pipe
2025-09-30T14:50:45.437888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894781981076830:3460], now have 1 active actors on pipe
2025-09-30T14:50:45.437902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894781891353164:3146]
2025-09-30T14:50:45.437904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894781891353164:3146]
2025-09-30T14:50:45.437906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894781891353164:3146]
2025-09-30T14:50:45.437918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:45.437925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:45.437928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:45.437930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:45.437932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:45.437942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:45.437943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:45.437919Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 161
2025-09-30T14:50:45.437925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 161
2025-09-30T14:50:45.437977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894781891353164:3146]
2025-09-30T14:50:45.437986Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:45.437992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:45.437998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:45.438002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:45.438039Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a60727f-59b6719a-30ce7040-245431f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:45.438048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.438051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.438053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:45.438062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.438070Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:45.438088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:45.438203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:45.438209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:45.438218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:45.438307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 162 partition: 0 MaxSeqNo: 42 sessionId: src_id|4a60727f-59b6719a-30ce7040-245431f7_0
2025-09-30T14:50:45.438677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfa2ce51-1d1b7119-9b4af339-bce99ae_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4a60727f-59b6719a-30ce7040-245431f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:45.441673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a60727f-59b6719a-30ce7040-245431f7_0] Write session: try to update token
2025-09-30T14:50:45.441694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a60727f-59b6719a-30ce7040-245431f7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:45.450473Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:45.450493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:45.450495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:45.450497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:45.450508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894781891353164:3146]
2025-09-30T14:50:45.450512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894781891353164:3146]
2025-09-30T14:50:45.450516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894781891353164:3146]
2025-09-30T14:50:45.450556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:45.450562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.450561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:45.450564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:45.450568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:45.450573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:45.450732Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:45.457260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 162 sessionId: src_id|4a60727f-59b6719a-30ce7040-245431f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:45.460497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:45.512908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894781981076846:3106]
2025-09-30T14:50:45.513190Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 161, pipe: [1:7555894781981076846:3106]
2025-09-30T14:50:45.558040Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:45.558450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:45.558466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:45.558506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894781981076846:3106], now have 1 active actors on pipe
2025-09-30T14:50:45.558673Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:45.558759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:45.558772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:45.558775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894781981076846:3106]
2025-09-30T14:50:45.558791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:45.558823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 162 reason: error at write: Disconnected sessionId: src_id|4a60727f-59b6719a-30ce7040-245431f7_0
2025-09-30T14:50:45.559007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 162 sessionId: src_id|4a60727f-59b6719a-30ce7040-245431f7_0 is DEAD
2025-09-30T14:50:45.559220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a60727f-59b6719a-30ce7040-245431f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:45.559237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a60727f-59b6719a-30ce7040-245431f7_0] Write session will restart in 0.005676s
2025-09-30T14:50:45.559282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a60727f-59b6719a-30ce7040-245431f7_0] Write session: Do CDS request
2025-09-30T14:50:45.559294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a60727f-59b6719a-30ce7040-245431f7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:45.565938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a60727f-59b6719a-30ce7040-245431f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:45.566022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:45.566035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 163
2025-09-30T14:50:45.566213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 163 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:45.566252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 163 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:45.566262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=163 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:45.566265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:45.566800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 163 sessionId:  describe result for acl check
2025-09-30T14:50:45.566833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:45.566839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:45.566841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:45.566848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894781981076875:3465] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:45.567415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894781981076875:3465] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:45.569972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894781981076875:3465] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:45.572349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894781981076875:3465] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:45.572359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894781981076875:3465] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:45.572362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894781981076875:3465] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:45.572367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 163 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:45.572886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:45.573258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:45.573382Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:45.573390Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:45.573398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:45.573427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:45.573456Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894781891353385:3149]
2025-09-30T14:50:45.573870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:45.574122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:45.574147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:45.574347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:45.574384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:45.574389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:45.574390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:45.574390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:45.574391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:45.574392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:45.574393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:45.574393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:45.574394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:45.574394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:45.574395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.574395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.574396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.574397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:45.574398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:45.574401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:45.574407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:45.574410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:45.574412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:45.574414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:45.574416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:45.574419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:45.574421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:45.574423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:45.574426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:45.574428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.574430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.574433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.574435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:45.574437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:45.574442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:45.574447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:45.574451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:45.574454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:45.574456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:45.574459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:45.574462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:45.574465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:45.574468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:45.574471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:45.574475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:45.574478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:45.574480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:45.574483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:45.574486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:45.574488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:45.574493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:45.574496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:45.574498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:45.574501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:45.574504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.574507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.574509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.574512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.574514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.574517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.574519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:45.574522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:45.574525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:45.574528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:45.574550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:45.579981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:45.580799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:45.580811Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:45.580813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:45.580815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:45.580820Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 162 [2:7555894781891353385:3149]
2025-09-30T14:50:45.580833Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:45.580845Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:45.580850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.580852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.580854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.580865Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:45.580870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:45.580876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:45.580932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.580937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.580938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.580941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:45.580942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:45.580998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:45.581004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.581014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.581021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.581035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:45.581051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894781981076847:2454], now have 1 active actors on pipe
2025-09-30T14:50:45.581057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894781981077057:3465], now have 1 active actors on pipe
2025-09-30T14:50:45.581061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894781891353380:3149]
2025-09-30T14:50:45.581062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894781891353380:3149]
2025-09-30T14:50:45.581064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894781891353380:3149]
2025-09-30T14:50:45.581072Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:45.581082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:45.581088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:45.581091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:45.581093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:45.581094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:45.581096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:45.581117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894781891353380:3149]
2025-09-30T14:50:45.581128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:45.581124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 162
2025-09-30T14:50:45.581125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 162
2025-09-30T14:50:45.581156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:45.581169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:45.581173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:45.581198Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45df4a3b-11dbfe91-8f0e04ec-459562b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:45.581206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.581208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.581210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:45.581218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.581226Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:45.581244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:45.581346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:45.581351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:45.581360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:45.581422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 163 partition: 0 MaxSeqNo: 42 sessionId: src_id|45df4a3b-11dbfe91-8f0e04ec-459562b3_0
2025-09-30T14:50:45.581818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a60727f-59b6719a-30ce7040-245431f7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|45df4a3b-11dbfe91-8f0e04ec-459562b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:45.585057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45df4a3b-11dbfe91-8f0e04ec-459562b3_0] Write session: try to update token
2025-09-30T14:50:45.585080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45df4a3b-11dbfe91-8f0e04ec-459562b3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:45.592255Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:45.592275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:45.592285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894781891353380:3149]
2025-09-30T14:50:45.592329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:45.592339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:45.592498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:45.592645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:45.592778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:45.592930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:45.593135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:45.593170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:45.602037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 163 sessionId: src_id|45df4a3b-11dbfe91-8f0e04ec-459562b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:45.604627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:45.605604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:45.605628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:45.605647Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:45.605649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:45.605652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:45.605654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:45.605661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894781891353380:3149]
2025-09-30T14:50:45.605665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894781891353380:3149]
2025-09-30T14:50:45.605669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894781891353380:3149]
2025-09-30T14:50:45.605703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:45.605706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:45.605712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.605713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:45.605715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:45.605719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:45.605877Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:45.658858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894781981077072:3106]
2025-09-30T14:50:45.659101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 162, pipe: [1:7555894781981077072:3106]
2025-09-30T14:50:45.712124Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:45.712664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:45.712695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894781981077072:3106], now have 1 active actors on pipe
2025-09-30T14:50:45.712797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:45.712865Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:45.712906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894781981077072:3106]
2025-09-30T14:50:45.723329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:45.723341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:45.723363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 163 reason: error at write: Disconnected sessionId: src_id|45df4a3b-11dbfe91-8f0e04ec-459562b3_0
2025-09-30T14:50:45.723557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 163 sessionId: src_id|45df4a3b-11dbfe91-8f0e04ec-459562b3_0 is DEAD
2025-09-30T14:50:45.723747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45df4a3b-11dbfe91-8f0e04ec-459562b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:45.723756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45df4a3b-11dbfe91-8f0e04ec-459562b3_0] Write session will restart in 0.007658s
2025-09-30T14:50:45.723774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45df4a3b-11dbfe91-8f0e04ec-459562b3_0] Write session: Do CDS request
2025-09-30T14:50:45.723778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45df4a3b-11dbfe91-8f0e04ec-459562b3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:45.730084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:45.730469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:45.730596Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:45.730603Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:45.730610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:45.730643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:45.730683Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894781891353613:3152]
2025-09-30T14:50:45.731092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:45.731369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:45.731401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:45.731615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:45.731652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:45.731658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:45.731658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:45.731659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:45.731660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:45.731660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:45.731661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:45.731661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:45.731662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:45.731663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:45.731664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.731664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.731665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.731665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:45.731666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:45.731669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:45.731675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:45.731678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:45.731680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:45.731682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:45.731684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:45.731687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:45.731689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:45.731691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:45.731693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:45.731696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.731698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.731700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.731702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:45.731704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:45.731709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:45.731714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:45.731718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:45.731721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:45.731724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:45.731727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:45.731729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:45.731732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:45.731735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:45.731738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:45.731740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:45.731743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:45.731746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:45.731748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:45.731751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:45.731755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:45.731757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:45.731760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:45.731762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:45.731765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:45.731767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.731770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.731772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.731775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.731778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.731780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.731782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:45.731785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:45.731788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:45.731790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:45.731813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:45.732724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45df4a3b-11dbfe91-8f0e04ec-459562b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:45.732857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:45.732871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 164
2025-09-30T14:50:45.732980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 164 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:45.733011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 164 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:45.733029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=164 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:45.733039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:45.733400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 164 sessionId:  describe result for acl check
2025-09-30T14:50:45.733435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:45.733438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:45.733440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:45.733444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894781981077268:3470] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:45.733879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894781981077268:3470] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:45.735567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894781981077268:3470] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:45.737354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:45.737735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894781981077268:3470] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:45.737745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894781981077268:3470] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:45.737747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894781981077268:3470] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:45.737769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 164 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:45.738231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:45.738246Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:45.738248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:45.738252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:45.738258Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 163 [2:7555894781891353613:3152]
2025-09-30T14:50:45.738274Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:45.738288Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:45.738295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.738298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.738300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.738314Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:45.738320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:45.738326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:45.738381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.738388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.738390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.738393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:45.738396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:45.738463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:45.738470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.738482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.738498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.738521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:45.738541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894781981077303:3470], now have 1 active actors on pipe
2025-09-30T14:50:45.738545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894781981077073:2454], now have 1 active actors on pipe
2025-09-30T14:50:45.738550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894781891353608:3152]
2025-09-30T14:50:45.738553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894781891353608:3152]
2025-09-30T14:50:45.738555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894781891353608:3152]
2025-09-30T14:50:45.738566Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:45.738579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:45.738580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:45.738583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:45.738593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:45.738585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:45.738596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:45.738566Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 163
2025-09-30T14:50:45.738615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 163
2025-09-30T14:50:45.738632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894781891353608:3152]
2025-09-30T14:50:45.738641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:45.738672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:45.738680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:45.738684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:45.738709Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|645ed7e9-5851e7ce-64a17843-a9f6eeec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:45.738720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.738724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.738726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:45.738735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.738747Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:45.738764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:45.738872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:45.738883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:45.738899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:45.739028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 164 partition: 0 MaxSeqNo: 42 sessionId: src_id|645ed7e9-5851e7ce-64a17843-a9f6eeec_0
2025-09-30T14:50:45.739386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45df4a3b-11dbfe91-8f0e04ec-459562b3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|645ed7e9-5851e7ce-64a17843-a9f6eeec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:45.742303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|645ed7e9-5851e7ce-64a17843-a9f6eeec_0] Write session: try to update token
2025-09-30T14:50:45.742318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|645ed7e9-5851e7ce-64a17843-a9f6eeec_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:45.751462Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:45.751479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:45.751482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:45.751484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:45.751493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894781891353608:3152]
2025-09-30T14:50:45.751498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894781891353608:3152]
2025-09-30T14:50:45.751502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894781891353608:3152]
2025-09-30T14:50:45.751550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:45.751556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:45.751563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.751563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:45.751566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:45.751577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:45.751711Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:45.757377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 164 sessionId: src_id|645ed7e9-5851e7ce-64a17843-a9f6eeec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:45.760077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:45.812930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894781981077310:3106]
2025-09-30T14:50:45.813165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 163, pipe: [1:7555894781981077310:3106]
2025-09-30T14:50:45.862921Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:45.863538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:45.863558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:45.863597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894781981077310:3106], now have 1 active actors on pipe
2025-09-30T14:50:45.863795Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:45.863804Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:45.863813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894781981077310:3106]
2025-09-30T14:50:45.863835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:45.863837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:45.863910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 164 reason: error at write: Disconnected sessionId: src_id|645ed7e9-5851e7ce-64a17843-a9f6eeec_0
2025-09-30T14:50:45.864120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 164 sessionId: src_id|645ed7e9-5851e7ce-64a17843-a9f6eeec_0 is DEAD
2025-09-30T14:50:45.864280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|645ed7e9-5851e7ce-64a17843-a9f6eeec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:45.864288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|645ed7e9-5851e7ce-64a17843-a9f6eeec_0] Write session will restart in 0.009408s
2025-09-30T14:50:45.864316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|645ed7e9-5851e7ce-64a17843-a9f6eeec_0] Write session: Do CDS request
2025-09-30T14:50:45.864324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|645ed7e9-5851e7ce-64a17843-a9f6eeec_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:45.874813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|645ed7e9-5851e7ce-64a17843-a9f6eeec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:45.874894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:45.874907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 165
2025-09-30T14:50:45.875055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 165 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:45.875090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 165 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:45.875100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=165 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:45.875104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:45.875637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 165 sessionId:  describe result for acl check
2025-09-30T14:50:45.875674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:45.875681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:45.875684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:45.875690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894781981077402:3474] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:45.876246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894781981077402:3474] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:45.878628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894781981077402:3474] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:45.880140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:45.881238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:45.881401Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:45.881409Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:45.881417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:45.881456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:45.881487Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894781891353831:3154]
2025-09-30T14:50:45.881552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894781981077402:3474] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:45.881566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894781981077402:3474] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:45.881570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894781981077402:3474] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:45.881578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 165 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:45.881946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:45.882215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:45.882267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:45.882607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:45.882688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:45.882695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:45.882696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:45.882696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:45.882697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:45.882698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:45.882698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:45.882699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:45.882700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:45.882700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:45.882701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.882702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.882702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.882703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:45.882704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:45.882708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:45.882715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:45.882717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:45.882720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:45.882722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:45.882724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:45.882727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:45.882729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:45.882731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:45.882734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:45.882737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.882739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.882741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.882744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:45.882746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:45.882753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:45.882758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:45.882763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:45.882766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:45.882769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:45.882772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:45.882775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:45.882778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:45.882780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:45.882784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:45.882786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:45.882789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:45.882792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:45.882795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:45.882797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:45.882800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:45.882803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:45.882806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:45.882809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:45.882812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:45.882814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.882817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.882819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.882822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.882824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.882827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.882830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:45.882833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:45.882835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:45.882838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:45.882864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:45.888616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:45.889537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:45.889551Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:45.889554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:45.889557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:45.889563Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 164 [2:7555894781891353831:3154]
2025-09-30T14:50:45.889576Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:45.889594Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:45.889597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.889601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.889603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.889621Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:45.889633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:45.889639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:45.889710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.889717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.889720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.889723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:45.889726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:45.889786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:45.889793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.889802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:45.889809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:45.889831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:45.889855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894781981077312:2454], now have 1 active actors on pipe
2025-09-30T14:50:45.889862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894781981077527:3474], now have 1 active actors on pipe
2025-09-30T14:50:45.889869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894781891353826:3154]
2025-09-30T14:50:45.889871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894781891353826:3154]
2025-09-30T14:50:45.889873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894781891353826:3154]
2025-09-30T14:50:45.889881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:45.889895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:45.889897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:45.889904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:45.889906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:45.889913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:45.889916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:45.889951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894781891353826:3154]
2025-09-30T14:50:45.889959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:45.889968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:45.889950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 164
2025-09-30T14:50:45.889955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 164
2025-09-30T14:50:45.889996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:45.890006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:45.890032Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|986feacd-c7688ea4-3321c10d-4342ed2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:45.890042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.890046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.890048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:45.890058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.890071Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:45.890092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:45.890267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:45.890275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:45.890289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:45.890413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 165 partition: 0 MaxSeqNo: 42 sessionId: src_id|986feacd-c7688ea4-3321c10d-4342ed2_0
2025-09-30T14:50:45.890809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|645ed7e9-5851e7ce-64a17843-a9f6eeec_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|986feacd-c7688ea4-3321c10d-4342ed2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:45.893508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|986feacd-c7688ea4-3321c10d-4342ed2_0] Write session: try to update token
2025-09-30T14:50:45.893527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|986feacd-c7688ea4-3321c10d-4342ed2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:45.905223Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:45.905246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:45.905257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894781891353826:3154]
2025-09-30T14:50:45.905306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:45.905317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:45.905483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:45.905644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:45.905791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:45.905963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:45.906163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:45.906221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:45.908141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 165 sessionId: src_id|986feacd-c7688ea4-3321c10d-4342ed2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:45.910812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:45.910957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:45.910980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:45.911011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:45.911094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:45.914840Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:45.914854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:45.914856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:45.914858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:45.914866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894781891353826:3154]
2025-09-30T14:50:45.914869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894781891353826:3154]
2025-09-30T14:50:45.914872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894781891353826:3154]
2025-09-30T14:50:45.914904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:45.914910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:45.914912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:45.914926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:45.914933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:45.914937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:45.915040Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:45.963950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894781981077549:3106]
2025-09-30T14:50:45.964153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 164, pipe: [1:7555894781981077549:3106]
2025-09-30T14:50:46.019641Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:46.027455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:46.027481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:46.027653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:46.027713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:46.027775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:46.027834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:46.027881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:46.027884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:46.027958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:46.028023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:46.028117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:46.028181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:46.028226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:46.028230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:46.028297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:46.028359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:46.028430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:46.028498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:46.028542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:46.028548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:46.028643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:46.028706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:46.028801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:46.028892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:46.028937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:46.028945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:46.029045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:46.029106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:46.029169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:46.029260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:46.029301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:46.029307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:46.029368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:46.029447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:46.029510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:46.029578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:46.029628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:46.029635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:46.029705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:46.029763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:46.029824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:46.029882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:46.029925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:46.029933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:46.030002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:46.030057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:46.030116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:46.030188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:46.030237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:46.030247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:46.030320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:46.030384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:46.030448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:46.030516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:46.030557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:46.030563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:46.030632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:46.030704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:46.030766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:46.030828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:46.030871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:46.030878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:46.030936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894781981077549:3106], now have 1 active actors on pipe
2025-09-30T14:50:46.031180Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:46.031233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894781981077549:3106]
2025-09-30T14:50:46.031258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:46.031262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:46.031290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 165 reason: error at write: Disconnected sessionId: src_id|986feacd-c7688ea4-3321c10d-4342ed2_0
2025-09-30T14:50:46.031504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 165 sessionId: src_id|986feacd-c7688ea4-3321c10d-4342ed2_0 is DEAD
2025-09-30T14:50:46.031686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|986feacd-c7688ea4-3321c10d-4342ed2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:46.031695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|986feacd-c7688ea4-3321c10d-4342ed2_0] Write session will restart in 0.009471s
2025-09-30T14:50:46.031720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|986feacd-c7688ea4-3321c10d-4342ed2_0] Write session: Do CDS request
2025-09-30T14:50:46.031724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|986feacd-c7688ea4-3321c10d-4342ed2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:46.032190Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:46.042735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|986feacd-c7688ea4-3321c10d-4342ed2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:46.042883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:46.042907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 166
2025-09-30T14:50:46.043078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 166 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:46.043114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 166 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:46.043123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=166 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:46.043127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:46.043541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 166 sessionId:  describe result for acl check
2025-09-30T14:50:46.043603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:46.043610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:46.043612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:46.043618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894786276044947:3480] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:46.044162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894786276044947:3480] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:46.046738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894786276044947:3480] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:46.047577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:46.048745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:46.049001Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:46.049011Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:46.049021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:46.049075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:46.049116Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894786186321348:3157]
2025-09-30T14:50:46.049101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894786276044947:3480] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:46.049116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894786276044947:3480] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:46.049119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894786276044947:3480] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:46.049127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 166 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:46.049812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:46.050055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:46.050095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:46.050463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:46.050523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:46.050529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:46.050531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:46.050532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:46.050533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:46.050535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:46.050536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:46.050538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:46.050539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:46.050541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:46.050542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.050543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.050544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.050546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:46.050547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:46.050552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:46.050564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:46.050569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:46.050574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:46.050579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:46.050584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:46.050589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:46.050594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:46.050599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:46.050605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:46.050609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.050614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.050619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.050623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:46.050627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:46.050633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:46.050642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:46.050649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:46.050667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:46.050672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:46.050678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:46.050689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:46.050695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:46.050700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:46.050711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:46.050716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:46.050726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:46.050736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:46.050742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:46.050752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:46.050758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:46.050767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:46.050773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:46.050783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:46.050789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:46.050798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.050804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.050813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.050819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.050829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.050834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.050843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:46.050849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:46.050855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:46.050865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:46.050921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:46.056526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:46.057492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:46.057510Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:46.057513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:46.057517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:46.057524Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 165 [2:7555894786186321348:3157]
2025-09-30T14:50:46.057541Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:46.057557Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:46.057561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.057564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.057566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.057582Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:46.057589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:46.057596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:46.057662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.057670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.057672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.057675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:46.057679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:46.057748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:46.057756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.057770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.057782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.057798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:46.057824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894786276044850:2454], now have 1 active actors on pipe
2025-09-30T14:50:46.057832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894786276045067:3480], now have 1 active actors on pipe
2025-09-30T14:50:46.057839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894786186321343:3157]
2025-09-30T14:50:46.057841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894786186321343:3157]
2025-09-30T14:50:46.057843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894786186321343:3157]
2025-09-30T14:50:46.057859Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:46.057872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:46.057882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:46.057887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:46.057889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:46.057892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:46.057868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 165
2025-09-30T14:50:46.057896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:46.057871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 165
2025-09-30T14:50:46.057931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894786186321343:3157]
2025-09-30T14:50:46.057942Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:46.057948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:46.057956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:46.057961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:46.058009Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8bbd1784-5db8dcd4-d5fd9386-49516405_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:46.058022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.058026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.058028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:46.058037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.058046Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:46.058072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:46.058245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:46.058255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:46.058273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:46.058376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 166 partition: 0 MaxSeqNo: 42 sessionId: src_id|8bbd1784-5db8dcd4-d5fd9386-49516405_0
2025-09-30T14:50:46.058830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|986feacd-c7688ea4-3321c10d-4342ed2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8bbd1784-5db8dcd4-d5fd9386-49516405_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:46.061627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bbd1784-5db8dcd4-d5fd9386-49516405_0] Write session: try to update token
2025-09-30T14:50:46.061650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bbd1784-5db8dcd4-d5fd9386-49516405_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:46.070761Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:46.070785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:46.070788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:46.070790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:46.070801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894786186321343:3157]
2025-09-30T14:50:46.070806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894786186321343:3157]
2025-09-30T14:50:46.070810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894786186321343:3157]
2025-09-30T14:50:46.070854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:46.070858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:46.070865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:46.070867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.070869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:46.070870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:46.071028Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:46.077439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 166 sessionId: src_id|8bbd1784-5db8dcd4-d5fd9386-49516405_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:46.080493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:46.131439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894786276045078:3106]
2025-09-30T14:50:46.131772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 165, pipe: [1:7555894786276045078:3106]
2025-09-30T14:50:46.191671Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:46.191967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:46.191987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:46.192007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894786276045078:3106], now have 1 active actors on pipe
2025-09-30T14:50:46.192175Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:46.193115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894786276045078:3106]
2025-09-30T14:50:46.193156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:46.193192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:46.193267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 166 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8bbd1784-5db8dcd4-d5fd9386-49516405_0
2025-09-30T14:50:46.193455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 166 sessionId: src_id|8bbd1784-5db8dcd4-d5fd9386-49516405_0 is DEAD
2025-09-30T14:50:46.193617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bbd1784-5db8dcd4-d5fd9386-49516405_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:46.193624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bbd1784-5db8dcd4-d5fd9386-49516405_0] Write session will restart in 0.008148s
2025-09-30T14:50:46.193645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bbd1784-5db8dcd4-d5fd9386-49516405_0] Write session: Do CDS request
2025-09-30T14:50:46.193650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bbd1784-5db8dcd4-d5fd9386-49516405_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:46.202791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bbd1784-5db8dcd4-d5fd9386-49516405_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:46.202918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:46.202935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 167
2025-09-30T14:50:46.203056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 167 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:46.203084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 167 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:46.203092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=167 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:46.203096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:46.203538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 167 sessionId:  describe result for acl check
2025-09-30T14:50:46.203585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:46.203593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:46.203595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:46.203602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894786276045115:3490] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:46.204165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894786276045115:3490] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:46.206355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894786276045115:3490] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:46.209634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894786276045115:3490] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:46.209660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894786276045115:3490] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:46.209663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894786276045115:3490] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:46.209671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 167 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:46.211320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:46.212432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:46.212617Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:46.212626Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:46.212637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:46.212688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:46.212730Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894786186321590:3165]
2025-09-30T14:50:46.213394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:46.213697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:46.213744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:46.214089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:46.214154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:46.214163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:46.214164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:46.214166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:46.214167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:46.214169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:46.214170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:46.214171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:46.214173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:46.214174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:46.214175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.214176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.214177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.214178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:46.214179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:46.214185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:46.214194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:46.214198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:46.214202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:46.214206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:46.214210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:46.214214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:46.214218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:46.214222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:46.214226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:46.214230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.214235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.214239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.214244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:46.214249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:46.214256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:46.214265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:46.214271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:46.214284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:46.214293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:46.214299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:46.214304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:46.214310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:46.214319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:46.214325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:46.214330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:46.214336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:46.214342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:46.214351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:46.214357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:46.214367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:46.214372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:46.214383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:46.214392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:46.214398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:46.214403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.214408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.214413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.214419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.214429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.214434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.214442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:46.214448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:46.214457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:46.214462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:46.214511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:46.220551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:46.221443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:46.221462Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:46.221465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:46.221469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:46.221475Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 166 [2:7555894786186321590:3165]
2025-09-30T14:50:46.221492Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:46.221508Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:46.221516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.221520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.221522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.221538Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:46.221549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:46.221556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:46.221618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.221625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.221627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.221631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:46.221633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:46.221862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 166
2025-09-30T14:50:46.222030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:46.222044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.222059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.222075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.222099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:46.222129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894786276045299:3490], now have 1 active actors on pipe
2025-09-30T14:50:46.222133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894786276045093:2454], now have 1 active actors on pipe
2025-09-30T14:50:46.222148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:46.222159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:46.222175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894786186321577:3165]
2025-09-30T14:50:46.222182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894786186321577:3165]
2025-09-30T14:50:46.222186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894786186321577:3165]
2025-09-30T14:50:46.222200Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:46.222215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:46.222228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:46.222232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:46.222233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:46.222235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:46.222236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:46.222252Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e27f2115-4df739bb-378c6af4-90ce0f2f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:46.222259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.222263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.222265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:46.222274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.222284Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:46.222319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894786186321577:3165]
2025-09-30T14:50:46.222335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:46.222350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:46.222359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:46.222405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 166
2025-09-30T14:50:46.222511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:46.222521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:46.222538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:46.222634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 167 partition: 0 MaxSeqNo: 42 sessionId: src_id|e27f2115-4df739bb-378c6af4-90ce0f2f_0
2025-09-30T14:50:46.223083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bbd1784-5db8dcd4-d5fd9386-49516405_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e27f2115-4df739bb-378c6af4-90ce0f2f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:46.225774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e27f2115-4df739bb-378c6af4-90ce0f2f_0] Write session: try to update token
2025-09-30T14:50:46.225794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e27f2115-4df739bb-378c6af4-90ce0f2f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:46.234097Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:46.234116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:46.234126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894786186321577:3165]
2025-09-30T14:50:46.234171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:46.234174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:46.234348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:46.234502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:46.234647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:46.234839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:46.235043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:46.235094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:46.240817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 167 sessionId: src_id|e27f2115-4df739bb-378c6af4-90ce0f2f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:46.243594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:46.243832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:46.243859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:46.243894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:46.243969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:46.245102Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:46.245120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:46.245122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:46.245124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:46.245134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894786186321577:3165]
2025-09-30T14:50:46.245138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894786186321577:3165]
2025-09-30T14:50:46.245141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894786186321577:3165]
2025-09-30T14:50:46.245178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:46.245189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.245192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:46.245193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:46.245198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:46.245201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:46.245376Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:46.293169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894786276045330:3106]
2025-09-30T14:50:46.293414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 166, pipe: [1:7555894786276045330:3106]
2025-09-30T14:50:46.365969Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:46.374321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:46.374356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:46.374533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:46.374611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:46.374693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:46.374758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:46.374804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:46.374815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:46.374887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:46.374950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:46.375017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:46.375089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:46.375137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:46.375145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:46.375215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:46.375300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:46.375368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:46.375434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:46.375479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:46.375488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:46.375556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:46.375625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:46.375690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:46.375754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:46.375797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:46.375804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:46.375876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:46.375939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:46.376004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:46.376071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:46.376126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:46.376135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:46.376205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:46.376269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:46.376332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:46.376404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:46.376451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:46.376459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:46.376530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:46.376598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:46.376666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:46.376732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:46.376797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:46.376805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:46.376877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:46.376943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:46.377009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:46.377074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:46.377121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:46.377132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:46.377201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:46.377262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:46.377326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:46.377393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:46.377444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:46.377453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:46.377521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:46.377584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:46.377647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:46.377716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:46.377781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:46.377789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:46.377848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894786276045330:3106], now have 1 active actors on pipe
2025-09-30T14:50:46.378090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:46.378114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:46.378145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894786276045330:3106]
2025-09-30T14:50:46.378147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 167 reason: error at write: Disconnected sessionId: src_id|e27f2115-4df739bb-378c6af4-90ce0f2f_0
2025-09-30T14:50:46.378169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:46.378366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 167 sessionId: src_id|e27f2115-4df739bb-378c6af4-90ce0f2f_0 is DEAD
2025-09-30T14:50:46.378528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e27f2115-4df739bb-378c6af4-90ce0f2f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:46.378540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e27f2115-4df739bb-378c6af4-90ce0f2f_0] Write session will restart in 0.009861s
2025-09-30T14:50:46.378575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e27f2115-4df739bb-378c6af4-90ce0f2f_0] Write session: Do CDS request
2025-09-30T14:50:46.378581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e27f2115-4df739bb-378c6af4-90ce0f2f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:46.378815Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:46.390172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e27f2115-4df739bb-378c6af4-90ce0f2f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:46.390334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:46.390352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 168
2025-09-30T14:50:46.390499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 168 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:46.390544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 168 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:46.390554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=168 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:46.390559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:46.391176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 168 sessionId:  describe result for acl check
2025-09-30T14:50:46.391217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:46.391220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:46.391221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:46.391230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894786276045420:3495] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:46.391776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894786276045420:3495] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:46.394055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894786276045420:3495] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:46.396547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:46.397209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:46.397446Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:46.397460Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:46.397471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:46.397525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:46.397576Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894786186321828:3173]
2025-09-30T14:50:46.398214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:46.398472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894786276045420:3495] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:46.398491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894786276045420:3495] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:46.398495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894786276045420:3495] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:46.398515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 168 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:46.398593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:46.398642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:46.398994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:46.399062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:46.399072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:46.399073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:46.399074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:46.399075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:46.399076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:46.399077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:46.399078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:46.399079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:46.399080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:46.399081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.399082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.399083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.399084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:46.399085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:46.399090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:46.399100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:46.399104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:46.399108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:46.399112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:46.399116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:46.399120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:46.399124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:46.399128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:46.399133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:46.399137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.399141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.399145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.399149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:46.399153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:46.399160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:46.399169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:46.399175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:46.399182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:46.399187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:46.399192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:46.399196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:46.399201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:46.399206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:46.399211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:46.399216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:46.399221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:46.399225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:46.399229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:46.399233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:46.399238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:46.399260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:46.399265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:46.399269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:46.399275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:46.399280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.399285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.399290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.399294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.399298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.399302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.399307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:46.399312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:46.399316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:46.399326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:46.399370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:46.405111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:46.406024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:46.406045Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:46.406048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:46.406052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:46.406060Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 167 [2:7555894786186321828:3173]
2025-09-30T14:50:46.406077Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:46.406095Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:46.406099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.406102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.406105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.406120Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:46.406133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:46.406140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:46.406206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.406214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.406217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.406220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:46.406223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:46.406298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:46.406307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.406319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.406336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.406352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:46.406374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894786276045333:2454], now have 1 active actors on pipe
2025-09-30T14:50:46.406383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894786276045553:3495], now have 1 active actors on pipe
2025-09-30T14:50:46.406389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894786186321823:3173]
2025-09-30T14:50:46.406391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894786186321823:3173]
2025-09-30T14:50:46.406394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894786186321823:3173]
2025-09-30T14:50:46.406405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 167
2025-09-30T14:50:46.406408Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:46.406428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:46.406438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:46.406441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:46.406442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:46.406444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:46.406444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:46.406447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 167
2025-09-30T14:50:46.406480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894786186321823:3173]
2025-09-30T14:50:46.406495Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:46.406525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:46.406599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:46.406610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:46.406635Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ea51da2-93338668-d08030a0-ef11de71_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:46.406646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.406669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.406672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:46.406683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.406693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:46.406712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:46.406860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:46.406868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:46.406882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:46.406953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 168 partition: 0 MaxSeqNo: 42 sessionId: src_id|2ea51da2-93338668-d08030a0-ef11de71_0
2025-09-30T14:50:46.407408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e27f2115-4df739bb-378c6af4-90ce0f2f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2ea51da2-93338668-d08030a0-ef11de71_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:46.410264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea51da2-93338668-d08030a0-ef11de71_0] Write session: try to update token
2025-09-30T14:50:46.410283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea51da2-93338668-d08030a0-ef11de71_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:46.419033Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:46.419052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:46.419055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:46.419057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:46.419067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894786186321823:3173]
2025-09-30T14:50:46.419072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894786186321823:3173]
2025-09-30T14:50:46.419076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894786186321823:3173]
2025-09-30T14:50:46.419113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:46.419116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:46.419118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:46.419122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:46.419124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.419127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:46.419284Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:46.425493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 168 sessionId: src_id|2ea51da2-93338668-d08030a0-ef11de71_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:46.428371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:46.478546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894786276045565:3106]
2025-09-30T14:50:46.478845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 167, pipe: [1:7555894786276045565:3106]
2025-09-30T14:50:46.532186Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:46.532481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:46.532495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:46.532535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894786276045565:3106], now have 1 active actors on pipe
2025-09-30T14:50:46.532732Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:46.532810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894786276045565:3106]
2025-09-30T14:50:46.532829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:46.532858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:46.532905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 168 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2ea51da2-93338668-d08030a0-ef11de71_0
2025-09-30T14:50:46.533126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 168 sessionId: src_id|2ea51da2-93338668-d08030a0-ef11de71_0 is DEAD
2025-09-30T14:50:46.533253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea51da2-93338668-d08030a0-ef11de71_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:46.533265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea51da2-93338668-d08030a0-ef11de71_0] Write session will restart in 0.008564s
2025-09-30T14:50:46.533287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea51da2-93338668-d08030a0-ef11de71_0] Write session: Do CDS request
2025-09-30T14:50:46.533293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea51da2-93338668-d08030a0-ef11de71_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:46.542775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea51da2-93338668-d08030a0-ef11de71_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:46.542852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:46.542866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 169
2025-09-30T14:50:46.543044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 169 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:46.543080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 169 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:46.543089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=169 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:46.543095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:46.543631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 169 sessionId:  describe result for acl check
2025-09-30T14:50:46.543665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:46.543667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:46.543669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:46.543674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894786276045614:3500] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:46.544185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894786276045614:3500] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:46.547229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894786276045614:3500] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:46.549960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894786276045614:3500] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:46.549975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894786276045614:3500] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:46.549979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894786276045614:3500] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:46.549991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 169 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:46.550034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:46.551318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:46.551496Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:46.551507Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:46.551518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:46.551564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:46.551612Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894786186322054:3176]
2025-09-30T14:50:46.552328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:46.552707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:46.552774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:46.553189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:46.553276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:46.553283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:46.553284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:46.553285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:46.553287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:46.553288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:46.553289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:46.553291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:46.553292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:46.553294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:46.553295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.553296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.553298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.553299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:46.553300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:46.553307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:46.553318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:46.553323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:46.553328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:46.553332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:46.553337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:46.553341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:46.553346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:46.553350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:46.553355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:46.553358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.553363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.553367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.553371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:46.553375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:46.553383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:46.553390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:46.553409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:46.553420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:46.553424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:46.553430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:46.553440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:46.553446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:46.553451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:46.553462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:46.553468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:46.553481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:46.553487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:46.553493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:46.553502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:46.553508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:46.553513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:46.553523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:46.553529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:46.553539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:46.553544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.553554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.553559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.553570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.553574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.553585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.553590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:46.553595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:46.553604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:46.553620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:46.553675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:46.559240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:46.560118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:46.560135Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:46.560138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:46.560142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:46.560149Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 168 [2:7555894786186322054:3176]
2025-09-30T14:50:46.560166Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:46.560189Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:46.560192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.560196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.560198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.560213Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:46.560221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:46.560233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:46.560292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.560300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.560302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.560306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:46.560309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:46.560375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:46.560383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.560395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.560411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.560433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:46.560457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894786276045785:3500], now have 1 active actors on pipe
2025-09-30T14:50:46.560466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894786276045567:2454], now have 1 active actors on pipe
2025-09-30T14:50:46.560473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894786186322048:3176]
2025-09-30T14:50:46.560475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894786186322048:3176]
2025-09-30T14:50:46.560478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894786186322048:3176]
2025-09-30T14:50:46.560493Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:46.560511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:46.560510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:46.560514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:46.560515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:46.560532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:46.560535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:46.560509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 168
2025-09-30T14:50:46.560510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 168
2025-09-30T14:50:46.560570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894786186322048:3176]
2025-09-30T14:50:46.560580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:46.560582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:46.560600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:46.560605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:46.560653Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30c42df4-f441cdd1-daaaf8c0-339bbeea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:46.560664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.560668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.560670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:46.560680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.560689Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:46.560711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:46.560925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:46.560934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:46.560947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:46.561053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 169 partition: 0 MaxSeqNo: 42 sessionId: src_id|30c42df4-f441cdd1-daaaf8c0-339bbeea_0
2025-09-30T14:50:46.561455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea51da2-93338668-d08030a0-ef11de71_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|30c42df4-f441cdd1-daaaf8c0-339bbeea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:46.564309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30c42df4-f441cdd1-daaaf8c0-339bbeea_0] Write session: try to update token
2025-09-30T14:50:46.564333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30c42df4-f441cdd1-daaaf8c0-339bbeea_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:46.573411Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:46.573433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:46.573435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:46.573437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:46.573446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894786186322048:3176]
2025-09-30T14:50:46.573452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894786186322048:3176]
2025-09-30T14:50:46.573456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894786186322048:3176]
2025-09-30T14:50:46.573499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:46.573508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.573512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:46.573653Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:46.575296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:46.575313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:46.575317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:46.579376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 169 sessionId: src_id|30c42df4-f441cdd1-daaaf8c0-339bbeea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:46.582209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:46.633162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894786276045797:3106]
2025-09-30T14:50:46.633490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 168, pipe: [1:7555894786276045797:3106]
2025-09-30T14:50:46.691714Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:46.691992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:46.692004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:46.692041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894786276045797:3106], now have 1 active actors on pipe
2025-09-30T14:50:46.692233Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:46.692261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:46.692279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:46.692366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 169 reason: error at write: Disconnected sessionId: src_id|30c42df4-f441cdd1-daaaf8c0-339bbeea_0
2025-09-30T14:50:46.692484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:46.692541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894786276045797:3106]
2025-09-30T14:50:46.692558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 169 sessionId: src_id|30c42df4-f441cdd1-daaaf8c0-339bbeea_0 is DEAD
2025-09-30T14:50:46.692711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30c42df4-f441cdd1-daaaf8c0-339bbeea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:46.692719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30c42df4-f441cdd1-daaaf8c0-339bbeea_0] Write session will restart in 0.006921s
2025-09-30T14:50:46.692741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30c42df4-f441cdd1-daaaf8c0-339bbeea_0] Write session: Do CDS request
2025-09-30T14:50:46.692751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30c42df4-f441cdd1-daaaf8c0-339bbeea_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:46.700773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30c42df4-f441cdd1-daaaf8c0-339bbeea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:46.700921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:46.700940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 170
2025-09-30T14:50:46.701133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 170 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:46.701178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 170 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:46.701188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=170 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:46.701193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:46.701616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 170 sessionId:  describe result for acl check
2025-09-30T14:50:46.701650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:46.701656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:46.701658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:46.701664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894786276045814:3504] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:46.702210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894786276045814:3504] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:46.705052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894786276045814:3504] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:46.708432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894786276045814:3504] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:46.708448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894786276045814:3504] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:46.708452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894786276045814:3504] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:46.708460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 170 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:46.711429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:46.712831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:46.713037Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:46.713052Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:46.713063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:46.713115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:46.713156Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894786186322289:3179]
2025-09-30T14:50:46.713830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:46.714195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:46.714244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:46.714581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:46.714645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:46.714664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:46.714665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:46.714666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:46.714667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:46.714669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:46.714670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:46.714671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:46.714672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:46.714674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:46.714675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.714676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.714677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.714678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:46.714679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:46.714684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:46.714694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:46.714699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:46.714704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:46.714708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:46.714713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:46.714717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:46.714722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:46.714726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:46.714731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:46.714736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.714741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.714745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.714749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:46.714754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:46.714762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:46.714770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:46.714777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:46.714783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:46.714792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:46.714798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:46.714803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:46.714815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:46.714820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:46.714826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:46.714831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:46.714841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:46.714847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:46.714855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:46.714859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:46.714864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:46.714869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:46.714875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:46.714880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:46.714885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:46.714895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.714900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.714909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.714915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.714920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.714925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.714930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:46.714936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:46.714941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:46.714952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:46.714998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:46.720738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:46.721644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:46.721662Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:46.721665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:46.721669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:46.721677Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 169 [2:7555894786186322289:3179]
2025-09-30T14:50:46.721694Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:46.721711Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:46.721718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.721722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.721724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.721742Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:46.721757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:46.721768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:46.721829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.721836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.721839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.721842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:46.721845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:46.721913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:46.721923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.721937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.721950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.721970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:46.721995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894786276045799:2454], now have 1 active actors on pipe
2025-09-30T14:50:46.722004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894786276045977:3504], now have 1 active actors on pipe
2025-09-30T14:50:46.722011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894786186322284:3179]
2025-09-30T14:50:46.722014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894786186322284:3179]
2025-09-30T14:50:46.722016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894786186322284:3179]
2025-09-30T14:50:46.722029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:46.722047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:46.722053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 169
2025-09-30T14:50:46.722061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:46.722064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:46.722066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:46.722069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:46.722073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 169
2025-09-30T14:50:46.722072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:46.722105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894786186322284:3179]
2025-09-30T14:50:46.722112Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:46.722128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:46.722130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:46.722132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:46.722175Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e9d29a5-80d2982a-62fbe044-b6fbb5bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:46.722189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.722193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.722195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:46.722206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.722221Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:46.722239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:46.722491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:46.722500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:46.722514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:46.722607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 170 partition: 0 MaxSeqNo: 42 sessionId: src_id|1e9d29a5-80d2982a-62fbe044-b6fbb5bc_0
2025-09-30T14:50:46.723015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30c42df4-f441cdd1-daaaf8c0-339bbeea_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1e9d29a5-80d2982a-62fbe044-b6fbb5bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:46.725699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e9d29a5-80d2982a-62fbe044-b6fbb5bc_0] Write session: try to update token
2025-09-30T14:50:46.725720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e9d29a5-80d2982a-62fbe044-b6fbb5bc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:46.734617Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:46.734636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:46.734638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:46.734640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:46.734664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894786186322284:3179]
2025-09-30T14:50:46.734669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894786186322284:3179]
2025-09-30T14:50:46.734673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894786186322284:3179]
2025-09-30T14:50:46.734710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:46.734711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:46.734714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:46.734717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.734718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:46.734720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:46.734860Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:46.740461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 170 sessionId: src_id|1e9d29a5-80d2982a-62fbe044-b6fbb5bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:46.743383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:46.792866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894786276046044:3106]
2025-09-30T14:50:46.793160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 169, pipe: [1:7555894786276046044:3106]
2025-09-30T14:50:46.814367Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-09-30T14:50:46.814401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-09-30T14:50:46.843960Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:46.844305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:46.844321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:46.844359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894786276046044:3106], now have 1 active actors on pipe
2025-09-30T14:50:46.844604Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:46.844706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:46.844708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894786276046044:3106]
2025-09-30T14:50:46.844729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:46.844741Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-09-30T14:50:46.844805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 170 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1e9d29a5-80d2982a-62fbe044-b6fbb5bc_0
2025-09-30T14:50:46.845028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 170 sessionId: src_id|1e9d29a5-80d2982a-62fbe044-b6fbb5bc_0 is DEAD
2025-09-30T14:50:46.845244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e9d29a5-80d2982a-62fbe044-b6fbb5bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:46.845256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e9d29a5-80d2982a-62fbe044-b6fbb5bc_0] Write session will restart in 0.008132s
2025-09-30T14:50:46.845275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e9d29a5-80d2982a-62fbe044-b6fbb5bc_0] Write session: Do CDS request
2025-09-30T14:50:46.845280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e9d29a5-80d2982a-62fbe044-b6fbb5bc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:46.854861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e9d29a5-80d2982a-62fbe044-b6fbb5bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:46.854890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:46.854907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 171
2025-09-30T14:50:46.855146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 171 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:46.855189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 171 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:46.855194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=171 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:46.855198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:46.855718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 171 sessionId:  describe result for acl check
2025-09-30T14:50:46.855756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:46.855762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:46.855764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:46.855770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894786276046104:3509] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:46.856309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894786276046104:3509] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:46.858691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894786276046104:3509] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:46.861419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894786276046104:3509] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:46.861433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894786276046104:3509] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:46.861437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894786276046104:3509] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:46.861445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 171 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:46.862746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:46.864088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:46.864296Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:46.864306Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:46.864317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:46.864377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:46.864421Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894786186322515:3182]
2025-09-30T14:50:46.865141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:46.865429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:46.865472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:46.865810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:46.865884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:46.865890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:46.865891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:46.865893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:46.865895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:46.865896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:46.865898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:46.865899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:46.865900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:46.865902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:46.865904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.865905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.865906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.865907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:46.865909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:46.865915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:46.865926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:46.865931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:46.865936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:46.865941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:46.865946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:46.865950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:46.865955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:46.865959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:46.865964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:46.865969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.865973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.865978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.865982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:46.865987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:46.865993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:46.866002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:46.866008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:46.866015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:46.866020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:46.866026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:46.866031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:46.866037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:46.866048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:46.866054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:46.866059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:46.866065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:46.866075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:46.866081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:46.866091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:46.866097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:46.866103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:46.866109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:46.866114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:46.866120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:46.866124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.866135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.866140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.866149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.866153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.866158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.866166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:46.866172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:46.866182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:46.866188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:46.866239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:46.871852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:46.872724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:46.872745Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:46.872748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:46.872752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:46.872760Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 170 [2:7555894786186322515:3182]
2025-09-30T14:50:46.872779Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:46.872796Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:46.872807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.872811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.872813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.872829Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:46.872836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:46.872844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:46.872918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.872928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.872931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.872935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:46.872937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:46.873006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:46.873014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.873029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:46.873047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:46.873073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:46.873097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894786276046263:3509], now have 1 active actors on pipe
2025-09-30T14:50:46.873101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894786276046045:2454], now have 1 active actors on pipe
2025-09-30T14:50:46.873107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894786186322510:3182]
2025-09-30T14:50:46.873109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894786186322510:3182]
2025-09-30T14:50:46.873111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894786186322510:3182]
2025-09-30T14:50:46.873124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:46.873139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:46.873141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:46.873143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:46.873145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:46.873157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:46.873159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:46.873194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894786186322510:3182]
2025-09-30T14:50:46.873203Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:46.873166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 170
2025-09-30T14:50:46.873169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 170
2025-09-30T14:50:46.873214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:46.873236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:46.873241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:46.873292Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f22c4557-875df783-f03de4d7-31967441_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:46.873305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.873309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.873311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:46.873320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.873330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:46.873387Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 85826639 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:50:46.873416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:46.873592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:46.873602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:46.873616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:46.873634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 1 DataSize: 85826639 UsedReserveSize: 0
2025-09-30T14:50:46.873710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 171 partition: 0 MaxSeqNo: 42 sessionId: src_id|f22c4557-875df783-f03de4d7-31967441_0
2025-09-30T14:50:46.873798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:50:46.873852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72057594046644480, NodeId 1, Generation 2
2025-09-30T14:50:46.874110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e9d29a5-80d2982a-62fbe044-b6fbb5bc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f22c4557-875df783-f03de4d7-31967441_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:46.876757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f22c4557-875df783-f03de4d7-31967441_0] Write session: try to update token
2025-09-30T14:50:46.876774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f22c4557-875df783-f03de4d7-31967441_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:46.885244Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:46.885266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:46.885269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:46.885271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:46.885280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894786186322510:3182]
2025-09-30T14:50:46.885284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894786186322510:3182]
2025-09-30T14:50:46.885288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894786186322510:3182]
2025-09-30T14:50:46.885329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:46.885335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:46.885338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:46.885345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:46.885352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:46.885356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:46.885476Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:46.891116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 171 sessionId: src_id|f22c4557-875df783-f03de4d7-31967441_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:46.893942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:46.944954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894786276046282:3106]
2025-09-30T14:50:46.945177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 170, pipe: [1:7555894786276046282:3106]
2025-09-30T14:50:46.993915Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:46.994163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:46.994175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:46.994211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894786276046282:3106], now have 1 active actors on pipe
2025-09-30T14:50:46.994485Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:46.994489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:46.994494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:46.994551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894786276046282:3106]
2025-09-30T14:50:46.994557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 171 reason: error at write: Disconnected sessionId: src_id|f22c4557-875df783-f03de4d7-31967441_0
2025-09-30T14:50:46.994727Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:46.994790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 171 sessionId: src_id|f22c4557-875df783-f03de4d7-31967441_0 is DEAD
2025-09-30T14:50:46.994908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f22c4557-875df783-f03de4d7-31967441_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:46.994916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f22c4557-875df783-f03de4d7-31967441_0] Write session will restart in 0.006101s
2025-09-30T14:50:46.994940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f22c4557-875df783-f03de4d7-31967441_0] Write session: Do CDS request
2025-09-30T14:50:46.994948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f22c4557-875df783-f03de4d7-31967441_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:47.001810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f22c4557-875df783-f03de4d7-31967441_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:47.001916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:47.001931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 172
2025-09-30T14:50:47.002059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 172 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:47.002091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 172 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:47.002101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=172 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:47.002113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:47.002544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 172 sessionId:  describe result for acl check
2025-09-30T14:50:47.002576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:47.002578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:47.002580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:47.002585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894790571013605:3515] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:47.003172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894790571013605:3515] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:47.005874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894790571013605:3515] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:47.008603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894790571013605:3515] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:47.008615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894790571013605:3515] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:47.008628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894790571013605:3515] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:47.008634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 172 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:47.009560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:47.010867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:47.011028Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:47.011035Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:47.011043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:47.011077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:47.011105Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894790481290040:3186]
2025-09-30T14:50:47.011889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:47.012215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:47.012289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:47.012658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:47.012748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:47.012756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:47.012758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:47.012759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:47.012761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:47.012762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:47.012763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:47.012764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:47.012766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:47.012767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:47.012768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.012769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.012770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.012771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:47.012773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:47.012779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:47.012790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:47.012795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:47.012799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:47.012804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:47.012808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:47.012812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:47.012817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:47.012821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:47.012826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:47.012830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.012834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.012838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.012842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:47.012847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:47.012859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:47.012867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:47.012874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:47.012880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:47.012884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:47.012890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:47.012895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:47.012901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:47.012906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:47.012911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:47.012917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:47.012923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:47.012928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:47.012957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:47.012967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:47.012973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:47.012984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:47.012990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:47.012995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:47.013006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:47.013012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.013023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.013028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.013038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.013046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.013055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.013060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:47.013070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:47.013075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:47.013081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:47.013134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:47.018788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:47.019717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:47.019733Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:47.019736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:47.019740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:47.019746Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 171 [2:7555894790481290040:3186]
2025-09-30T14:50:47.019761Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:47.019776Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:47.019778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.019781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.019784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.019798Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:47.019804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:47.019811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:47.019870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.019877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.019880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.019883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:47.019885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:47.019950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:47.019957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.019968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.019983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.020004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:47.020030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894786276046294:2454], now have 1 active actors on pipe
2025-09-30T14:50:47.020033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894790571013809:3515], now have 1 active actors on pipe
2025-09-30T14:50:47.020040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894790481290035:3186]
2025-09-30T14:50:47.020042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894790481290035:3186]
2025-09-30T14:50:47.020045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894790481290035:3186]
2025-09-30T14:50:47.020057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:47.020069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:47.020078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:47.020082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:47.020085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:47.020085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:47.020089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:47.020119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894790481290035:3186]
2025-09-30T14:50:47.020126Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:47.020132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:47.020101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 171
2025-09-30T14:50:47.020106Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 171
2025-09-30T14:50:47.020183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:47.020195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:47.020227Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1bbea03c-7749fbec-1280a4f4-69f0ab0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:47.020239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.020242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.020244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:47.020253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.020267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:47.020285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:47.020462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:47.020473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:47.020489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:47.020595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 172 partition: 0 MaxSeqNo: 42 sessionId: src_id|1bbea03c-7749fbec-1280a4f4-69f0ab0e_0
2025-09-30T14:50:47.020977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f22c4557-875df783-f03de4d7-31967441_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1bbea03c-7749fbec-1280a4f4-69f0ab0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:47.023778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bbea03c-7749fbec-1280a4f4-69f0ab0e_0] Write session: try to update token
2025-09-30T14:50:47.023799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bbea03c-7749fbec-1280a4f4-69f0ab0e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:47.031841Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:47.031863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:47.031865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:47.031868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:47.031877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894790481290035:3186]
2025-09-30T14:50:47.031882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894790481290035:3186]
2025-09-30T14:50:47.031886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894790481290035:3186]
2025-09-30T14:50:47.031920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:47.031929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.031934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:47.031932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:47.031939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:47.031943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:47.032080Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:47.038912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 172 sessionId: src_id|1bbea03c-7749fbec-1280a4f4-69f0ab0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:47.041762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:47.094471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894790571013826:3106]
2025-09-30T14:50:47.094724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 171, pipe: [1:7555894790571013826:3106]
2025-09-30T14:50:47.136896Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:47.137532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:47.137547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:47.137567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894790571013826:3106], now have 1 active actors on pipe
2025-09-30T14:50:47.137760Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:47.137778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:47.137809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:47.137813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:47.137843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894790571013826:3106]
2025-09-30T14:50:47.137879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 172 reason: error at write: Disconnected sessionId: src_id|1bbea03c-7749fbec-1280a4f4-69f0ab0e_0
2025-09-30T14:50:47.138122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 172 sessionId: src_id|1bbea03c-7749fbec-1280a4f4-69f0ab0e_0 is DEAD
2025-09-30T14:50:47.138249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bbea03c-7749fbec-1280a4f4-69f0ab0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:47.138260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bbea03c-7749fbec-1280a4f4-69f0ab0e_0] Write session will restart in 0.006782s
2025-09-30T14:50:47.138282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bbea03c-7749fbec-1280a4f4-69f0ab0e_0] Write session: Do CDS request
2025-09-30T14:50:47.138288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bbea03c-7749fbec-1280a4f4-69f0ab0e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:47.145827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bbea03c-7749fbec-1280a4f4-69f0ab0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:47.145885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:47.145898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 173
2025-09-30T14:50:47.146116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 173 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:47.146151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 173 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:47.146157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=173 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:47.146161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:47.146691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 173 sessionId:  describe result for acl check
2025-09-30T14:50:47.146733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:47.146740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:47.146742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:47.146748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894790571013851:3519] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:47.147394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894790571013851:3519] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:47.149979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894790571013851:3519] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:47.153052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894790571013851:3519] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:47.153070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894790571013851:3519] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:47.153073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894790571013851:3519] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:47.153084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 173 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:47.153840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:47.154916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:47.155077Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:47.155085Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:47.155092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:47.155123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:47.155162Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894790481290267:3188]
2025-09-30T14:50:47.155774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:47.156035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:47.156075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:47.156368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:47.156417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:47.156424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:47.156425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:47.156425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:47.156426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:47.156427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:47.156428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:47.156429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:47.156430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:47.156431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:47.156432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.156433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.156434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.156435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:47.156436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:47.156440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:47.156450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:47.156453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:47.156456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:47.156459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:47.156463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:47.156466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:47.156469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:47.156473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:47.156476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:47.156478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.156481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.156485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.156488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:47.156491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:47.156499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:47.156505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:47.156511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:47.156516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:47.156520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:47.156525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:47.156529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:47.156534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:47.156538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:47.156542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:47.156546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:47.156550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:47.156554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:47.156558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:47.156562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:47.156566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:47.156570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:47.156574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:47.156578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:47.156583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:47.156587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.156591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.156595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.156599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.156602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.156606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.156610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:47.156614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:47.156618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:47.156622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:47.156657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:47.162135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:47.163021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:47.163036Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:47.163037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:47.163040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:47.163045Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 172 [2:7555894790481290267:3188]
2025-09-30T14:50:47.163056Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:47.163068Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:47.163073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.163075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.163077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.163088Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:47.163093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:47.163098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:47.163141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.163151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.163153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.163156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:47.163158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:47.163209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:47.163220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.163231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.163239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.163273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:47.163296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894790571014048:3519], now have 1 active actors on pipe
2025-09-30T14:50:47.163303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894790571013828:2454], now have 1 active actors on pipe
2025-09-30T14:50:47.163308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894790481290262:3188]
2025-09-30T14:50:47.163310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894790481290262:3188]
2025-09-30T14:50:47.163312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894790481290262:3188]
2025-09-30T14:50:47.163325Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:47.163337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:47.163341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:47.163356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:47.163359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:47.163359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:47.163361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:47.163354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 172
2025-09-30T14:50:47.163386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894790481290262:3188]
2025-09-30T14:50:47.163373Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 172
2025-09-30T14:50:47.163389Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:47.163391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:47.163404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:47.163408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:47.163454Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23d2f44b-b287fdde-a59687a5-870a2e5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:47.163465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.163469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.163471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:47.163479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.163492Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:47.163511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:47.163667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:47.163682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:47.163705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:47.163803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 173 partition: 0 MaxSeqNo: 42 sessionId: src_id|23d2f44b-b287fdde-a59687a5-870a2e5c_0
2025-09-30T14:50:47.164190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bbea03c-7749fbec-1280a4f4-69f0ab0e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|23d2f44b-b287fdde-a59687a5-870a2e5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:47.166937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23d2f44b-b287fdde-a59687a5-870a2e5c_0] Write session: try to update token
2025-09-30T14:50:47.166953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23d2f44b-b287fdde-a59687a5-870a2e5c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:47.175596Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:47.175615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:47.175617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:47.175619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:47.175628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894790481290262:3188]
2025-09-30T14:50:47.175633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894790481290262:3188]
2025-09-30T14:50:47.175638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894790481290262:3188]
2025-09-30T14:50:47.175678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:47.175684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.175684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:47.175687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:47.175691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:47.175695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:47.175833Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:47.181037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 173 sessionId: src_id|23d2f44b-b287fdde-a59687a5-870a2e5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:47.183586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:47.237823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894790571014075:3106]
2025-09-30T14:50:47.238091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 172, pipe: [1:7555894790571014075:3106]
2025-09-30T14:50:47.280135Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:47.280802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:47.280816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:47.280849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894790571014075:3106], now have 1 active actors on pipe
2025-09-30T14:50:47.281029Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:47.281123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:47.281127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894790571014075:3106]
2025-09-30T14:50:47.281155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:47.281225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 173 reason: status is not ok: tablet will be restarted right now sessionId: src_id|23d2f44b-b287fdde-a59687a5-870a2e5c_0
2025-09-30T14:50:47.281382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 173 sessionId: src_id|23d2f44b-b287fdde-a59687a5-870a2e5c_0 is DEAD
2025-09-30T14:50:47.281583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23d2f44b-b287fdde-a59687a5-870a2e5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:47.281595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23d2f44b-b287fdde-a59687a5-870a2e5c_0] Write session will restart in 0.009995s
2025-09-30T14:50:47.281619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23d2f44b-b287fdde-a59687a5-870a2e5c_0] Write session: Do CDS request
2025-09-30T14:50:47.281624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23d2f44b-b287fdde-a59687a5-870a2e5c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:47.292758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23d2f44b-b287fdde-a59687a5-870a2e5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:47.292844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:47.292861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 174
2025-09-30T14:50:47.292972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 174 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:47.293003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 174 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:47.293013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=174 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:47.293016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:47.293447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 174 sessionId:  describe result for acl check
2025-09-30T14:50:47.293482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:47.293490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:47.293492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:47.293498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894790571014183:3530] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:47.294015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894790571014183:3530] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:47.296726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894790571014183:3530] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:47.297617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:47.298789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:47.298965Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:47.298974Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:47.298984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:47.299032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:47.299072Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894790481290530:3202]
2025-09-30T14:50:47.299101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894790571014183:3530] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:47.299112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894790571014183:3530] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:47.299115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894790571014183:3530] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:47.299123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 174 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:47.299859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:47.300149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:47.300192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:47.300521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:47.300579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:47.300586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:47.300587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:47.300588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:47.300590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:47.300591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:47.300592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:47.300593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:47.300595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:47.300596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:47.300597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.300598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.300600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.300601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:47.300602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:47.300607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:47.300616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:47.300620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:47.300624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:47.300628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:47.300632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:47.300635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:47.300639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:47.300642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:47.300650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:47.300654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.300659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.300663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.300667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:47.300671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:47.300678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:47.300686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:47.300698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:47.300708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:47.300734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:47.300744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:47.300749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:47.300754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:47.300760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:47.300767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:47.300776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:47.300782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:47.300791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:47.300798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:47.300807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:47.300815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:47.300824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:47.300829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:47.300837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:47.300842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:47.300851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.300861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.300865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.300875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.300884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.300890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.300899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:47.300904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:47.300913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:47.300922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:47.300969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:47.306262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:47.307639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:47.307656Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:47.307658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:47.307662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:47.307668Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 173 [2:7555894790481290530:3202]
2025-09-30T14:50:47.307687Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:47.307701Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:47.307705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.307708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.307710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.307726Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:47.307733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:47.307742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:47.307806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.307814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.307816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.307820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:47.307822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:47.307899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:47.307908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.307921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.307939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.307961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:47.307984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894790571014085:2454], now have 1 active actors on pipe
2025-09-30T14:50:47.307991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894790571014310:3530], now have 1 active actors on pipe
2025-09-30T14:50:47.307998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894790481290525:3202]
2025-09-30T14:50:47.308000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894790481290525:3202]
2025-09-30T14:50:47.308002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894790481290525:3202]
2025-09-30T14:50:47.308014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:47.308025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:47.308031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:47.308038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:47.308040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:47.308045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:47.308048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:47.308081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894790481290525:3202]
2025-09-30T14:50:47.308089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:47.308098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:47.308092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 173
2025-09-30T14:50:47.308098Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 173
2025-09-30T14:50:47.308149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:47.308158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:47.308181Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f96a26d-985206ed-14011e01-1d67bfc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:47.308193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.308198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.308201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:47.308210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.308223Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:47.308239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:47.308448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:47.308459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:47.308472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:47.308574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 174 partition: 0 MaxSeqNo: 42 sessionId: src_id|5f96a26d-985206ed-14011e01-1d67bfc_0
2025-09-30T14:50:47.309014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23d2f44b-b287fdde-a59687a5-870a2e5c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5f96a26d-985206ed-14011e01-1d67bfc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:47.311778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f96a26d-985206ed-14011e01-1d67bfc_0] Write session: try to update token
2025-09-30T14:50:47.311797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f96a26d-985206ed-14011e01-1d67bfc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:47.319492Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:47.319518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:47.319530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894790481290525:3202]
2025-09-30T14:50:47.319579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:47.319579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:47.319789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:47.319924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:47.320081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:47.320241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:47.320439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:47.320482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:47.326223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 174 sessionId: src_id|5f96a26d-985206ed-14011e01-1d67bfc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:47.328972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:47.330002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:47.330028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:47.330046Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:47.330049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:47.330052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:47.330054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:47.330063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894790481290525:3202]
2025-09-30T14:50:47.330067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894790481290525:3202]
2025-09-30T14:50:47.330071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894790481290525:3202]
2025-09-30T14:50:47.330117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:47.330119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:47.330127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:47.330129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.330131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:47.330132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:47.330282Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:47.381178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894790571014321:3106]
2025-09-30T14:50:47.381376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 173, pipe: [1:7555894790571014321:3106]
2025-09-30T14:50:47.435549Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:47.435808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:47.435844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894790571014321:3106], now have 1 active actors on pipe
2025-09-30T14:50:47.435937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:47.436062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894790571014321:3106]
2025-09-30T14:50:47.436091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:47.448118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:47.448136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:47.448161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 174 reason: error at write: Disconnected sessionId: src_id|5f96a26d-985206ed-14011e01-1d67bfc_0
2025-09-30T14:50:47.448334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 174 sessionId: src_id|5f96a26d-985206ed-14011e01-1d67bfc_0 is DEAD
2025-09-30T14:50:47.448445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f96a26d-985206ed-14011e01-1d67bfc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:47.448457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f96a26d-985206ed-14011e01-1d67bfc_0] Write session will restart in 0.006435s
2025-09-30T14:50:47.448493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f96a26d-985206ed-14011e01-1d67bfc_0] Write session: Do CDS request
2025-09-30T14:50:47.448499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f96a26d-985206ed-14011e01-1d67bfc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:47.455840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f96a26d-985206ed-14011e01-1d67bfc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:47.455905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:47.455921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 175
2025-09-30T14:50:47.456055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 175 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:47.456086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 175 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:47.456096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=175 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:47.456100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:47.457013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 175 sessionId:  describe result for acl check
2025-09-30T14:50:47.457047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:47.457050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:47.457052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:47.457058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894790571014417:3535] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:47.457576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894790571014417:3535] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:47.460841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894790571014417:3535] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:47.461921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:47.463384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:47.463591Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:47.463604Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:47.463615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:47.463674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:47.463684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894790571014417:3535] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:47.463711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894790571014417:3535] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:47.463715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894790571014417:3535] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:47.463717Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894790481290761:3205]
2025-09-30T14:50:47.463726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 175 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:47.464277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:47.464596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:47.464662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:47.465028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:47.465093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:47.465099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:47.465100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:47.465100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:47.465101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:47.465102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:47.465103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:47.465104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:47.465105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:47.465106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:47.465107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.465109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.465110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.465111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:47.465112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:47.465117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:47.465127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:47.465131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:47.465135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:47.465139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:47.465143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:47.465147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:47.465151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:47.465155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:47.465158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:47.465160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.465163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.465165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.465167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:47.465170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:47.465178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:47.465186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:47.465192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:47.465198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:47.465202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:47.465208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:47.465213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:47.465218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:47.465222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:47.465225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:47.465228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:47.465231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:47.465234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:47.465237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:47.465240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:47.465242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:47.465245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:47.465248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:47.465251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:47.465255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:47.465257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.465261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.465263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.465266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.465269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.465272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.465274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:47.465277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:47.465279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:47.465282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:47.465308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:47.470839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:47.471851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:47.471868Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:47.471871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:47.471875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:47.471883Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 174 [2:7555894790481290761:3205]
2025-09-30T14:50:47.471901Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:47.471915Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:47.471918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.471921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.471924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.471940Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:47.471946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:47.471955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:47.472018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.472025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.472027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.472031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:47.472033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:47.472101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:47.472109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.472121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.472137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.472159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:47.472182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894790571014550:3535], now have 1 active actors on pipe
2025-09-30T14:50:47.472192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894790571014324:2454], now have 1 active actors on pipe
2025-09-30T14:50:47.472198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894790481290756:3205]
2025-09-30T14:50:47.472201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894790481290756:3205]
2025-09-30T14:50:47.472204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894790481290756:3205]
2025-09-30T14:50:47.472217Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:47.472230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:47.472238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:47.472243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:47.472245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:47.472249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:47.472253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:47.472226Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 174
2025-09-30T14:50:47.472234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 174
2025-09-30T14:50:47.472284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894790481290756:3205]
2025-09-30T14:50:47.472292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:47.472294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:47.472323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:47.472332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:47.472367Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9d561f-7cb7938-cadaba4-7c94fc52_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:47.472378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.472382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.472390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:47.472400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.472412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:47.472432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:47.472570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:47.472578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:47.472590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:47.472657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 175 partition: 0 MaxSeqNo: 42 sessionId: src_id|a9d561f-7cb7938-cadaba4-7c94fc52_0
2025-09-30T14:50:47.473070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f96a26d-985206ed-14011e01-1d67bfc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a9d561f-7cb7938-cadaba4-7c94fc52_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:47.475900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9d561f-7cb7938-cadaba4-7c94fc52_0] Write session: try to update token
2025-09-30T14:50:47.475922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9d561f-7cb7938-cadaba4-7c94fc52_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:47.484271Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:47.484289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:47.484292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:47.484294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:47.484306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894790481290756:3205]
2025-09-30T14:50:47.484310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894790481290756:3205]
2025-09-30T14:50:47.484314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894790481290756:3205]
2025-09-30T14:50:47.484350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:47.484357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.484359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:47.484360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:47.484366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:47.484380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:47.484492Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:47.490810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 175 sessionId: src_id|a9d561f-7cb7938-cadaba4-7c94fc52_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:47.493767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:47.536325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894790571014561:3106]
2025-09-30T14:50:47.536578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 174, pipe: [1:7555894790571014561:3106]
2025-09-30T14:50:47.598679Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:47.599391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:47.599409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:47.599429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894790571014561:3106], now have 1 active actors on pipe
2025-09-30T14:50:47.599643Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:47.599697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894790571014561:3106]
2025-09-30T14:50:47.599702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:47.599705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:47.599743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:47.599782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 175 reason: error at write: Disconnected sessionId: src_id|a9d561f-7cb7938-cadaba4-7c94fc52_0
2025-09-30T14:50:47.599988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 175 sessionId: src_id|a9d561f-7cb7938-cadaba4-7c94fc52_0 is DEAD
2025-09-30T14:50:47.600155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9d561f-7cb7938-cadaba4-7c94fc52_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:47.600168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9d561f-7cb7938-cadaba4-7c94fc52_0] Write session will restart in 0.008410s
2025-09-30T14:50:47.600204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9d561f-7cb7938-cadaba4-7c94fc52_0] Write session: Do CDS request
2025-09-30T14:50:47.600213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9d561f-7cb7938-cadaba4-7c94fc52_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:47.609875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9d561f-7cb7938-cadaba4-7c94fc52_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:47.609927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:47.609942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 176
2025-09-30T14:50:47.611423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 176 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:47.611468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 176 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:47.611474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=176 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:47.611478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:47.611935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 176 sessionId:  describe result for acl check
2025-09-30T14:50:47.611973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:47.611982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:47.611984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:47.611990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894790571014615:3539] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:47.612534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894790571014615:3539] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:47.615207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894790571014615:3539] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:47.619331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894790571014615:3539] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:47.619349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894790571014615:3539] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:47.619352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894790571014615:3539] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:47.619361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 176 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:47.620235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:47.621706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:47.621909Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:47.621919Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:47.621929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:47.621977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:47.622027Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894790481290992:3207]
2025-09-30T14:50:47.622761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:47.623040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:47.623085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:47.623446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:47.623505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:47.623511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:47.623512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:47.623513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:47.623515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:47.623516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:47.623517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:47.623519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:47.623520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:47.623521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:47.623522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.623523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.623525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.623526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:47.623528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:47.623533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:47.623544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:47.623549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:47.623554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:47.623558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:47.623562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:47.623567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:47.623571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:47.623575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:47.623580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:47.623585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.623589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.623593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.623598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:47.623602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:47.623609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:47.623618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:47.623625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:47.623631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:47.623636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:47.623642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:47.623647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:47.623652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:47.623657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:47.623663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:47.623668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:47.623678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:47.623683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:47.623689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:47.623698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:47.623704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:47.623708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:47.623714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:47.623718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:47.623724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:47.623729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.623739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.623744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.623754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.623760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.623771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.623775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:47.623785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:47.623790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:47.623797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:47.623848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:47.629460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:47.630697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:47.630711Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:47.630714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:47.630718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:47.630724Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 175 [2:7555894790481290992:3207]
2025-09-30T14:50:47.630739Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:47.630753Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:47.630756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.630759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.630761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.630778Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:47.630785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:47.630791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:47.630852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.630861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.630864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.630867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:47.630870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:47.630938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:47.630947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.630960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.630973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.630988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:47.631014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894790571014784:3539], now have 1 active actors on pipe
2025-09-30T14:50:47.631018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894790571014562:2454], now have 1 active actors on pipe
2025-09-30T14:50:47.631025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894790481290987:3207]
2025-09-30T14:50:47.631029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894790481290987:3207]
2025-09-30T14:50:47.631031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894790481290987:3207]
2025-09-30T14:50:47.631046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:47.631058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:47.631065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:47.631069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:47.631071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:47.631076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:47.631079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:47.631112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894790481290987:3207]
2025-09-30T14:50:47.631123Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:47.631140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:47.631417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 175
2025-09-30T14:50:47.631420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 175
2025-09-30T14:50:47.631498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:47.631512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:47.631552Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f73547f8-e592c30f-f986176d-daf85328_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:47.631565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.631572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.631574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:47.631586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.631601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:47.631620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:47.631831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:47.631841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:47.631858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:47.631958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 176 partition: 0 MaxSeqNo: 42 sessionId: src_id|f73547f8-e592c30f-f986176d-daf85328_0
2025-09-30T14:50:47.632317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9d561f-7cb7938-cadaba4-7c94fc52_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f73547f8-e592c30f-f986176d-daf85328_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:47.635333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f73547f8-e592c30f-f986176d-daf85328_0] Write session: try to update token
2025-09-30T14:50:47.635350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f73547f8-e592c30f-f986176d-daf85328_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:47.643409Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:47.643428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:47.643431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:47.643433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:47.643442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894790481290987:3207]
2025-09-30T14:50:47.643448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894790481290987:3207]
2025-09-30T14:50:47.643452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894790481290987:3207]
2025-09-30T14:50:47.643491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:47.643491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:47.643495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:47.643498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.643498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:47.643501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:47.643645Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:47.654456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 176 sessionId: src_id|f73547f8-e592c30f-f986176d-daf85328_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:47.657345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:47.700087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894790571014800:3106]
2025-09-30T14:50:47.700414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 175, pipe: [1:7555894790571014800:3106]
2025-09-30T14:50:47.758292Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:47.758601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:47.758613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:47.758634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894790571014800:3106], now have 1 active actors on pipe
2025-09-30T14:50:47.758859Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:47.759417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:47.759431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:47.759801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73547f8-e592c30f-f986176d-daf85328_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:47.759811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73547f8-e592c30f-f986176d-daf85328_0] Write session will restart in 0.006722s
2025-09-30T14:50:47.759834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73547f8-e592c30f-f986176d-daf85328_0] Write session: Do CDS request
2025-09-30T14:50:47.759840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73547f8-e592c30f-f986176d-daf85328_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:47.759487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 176 reason: error at write: Disconnected sessionId: src_id|f73547f8-e592c30f-f986176d-daf85328_0
2025-09-30T14:50:47.759672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 176 sessionId: src_id|f73547f8-e592c30f-f986176d-daf85328_0 is DEAD
2025-09-30T14:50:47.759834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894790571014800:3106]
2025-09-30T14:50:47.759847Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:47.767757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f73547f8-e592c30f-f986176d-daf85328_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:47.767860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:47.767878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 177
2025-09-30T14:50:47.768031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 177 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:47.768062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 177 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:47.768067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=177 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:47.768071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:47.768487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 177 sessionId:  describe result for acl check
2025-09-30T14:50:47.768518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:47.768520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:47.768522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:47.768528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894790571014828:3544] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:47.769048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894790571014828:3544] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:47.771528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894790571014828:3544] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:47.775152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894790571014828:3544] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:47.775169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894790571014828:3544] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:47.775173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894790571014828:3544] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:47.775189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 177 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:47.778344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:47.779772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:47.779976Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:47.779980Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:47.779992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:47.780057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:47.780094Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894790481291235:3210]
2025-09-30T14:50:47.780735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:47.781038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:47.781089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:47.781435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:47.781512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:47.781522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:47.781523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:47.781524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:47.781525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:47.781526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:47.781528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:47.781529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:47.781530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:47.781531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:47.781533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.781534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.781535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.781536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:47.781538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:47.781544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:47.781554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:47.781559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:47.781563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:47.781567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:47.781571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:47.781575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:47.781579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:47.781584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:47.781589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:47.781593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.781597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.781601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.781606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:47.781610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:47.781619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:47.781627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:47.781634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:47.781640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:47.781644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:47.781650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:47.781655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:47.781661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:47.781673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:47.781679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:47.781688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:47.781693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:47.781703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:47.781708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:47.781717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:47.781722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:47.781733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:47.781738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:47.781747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:47.781754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:47.781762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.781768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.781777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.781782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.781787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.781797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.781802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:47.781807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:47.781816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:47.781822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:47.781867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:47.788004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:47.789066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:47.789084Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:47.789087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:47.789431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 176
2025-09-30T14:50:47.789476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 176
2025-09-30T14:50:47.789090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:47.789099Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 176 [2:7555894790481291235:3210]
2025-09-30T14:50:47.789116Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:47.789132Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:47.789135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.789138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.789141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.789157Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:47.789164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:47.789171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:47.789236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.789238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.789240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.789244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:47.789247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:47.789330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:47.789334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.789349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.789363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.789382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:47.789402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894790571014813:2454], now have 1 active actors on pipe
2025-09-30T14:50:47.789406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894790571014975:3544], now have 1 active actors on pipe
2025-09-30T14:50:47.789412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894790481291230:3210]
2025-09-30T14:50:47.789414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894790481291230:3210]
2025-09-30T14:50:47.789417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894790481291230:3210]
2025-09-30T14:50:47.789431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:47.789444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:47.789454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:47.789457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:47.789459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:47.789460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:47.789463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:47.789517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894790481291230:3210]
2025-09-30T14:50:47.789524Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:47.789534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:47.789994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:47.790009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:47.790032Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e961e54-f021f401-45a20194-7b626374_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:47.790041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.790045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.790048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:47.790058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.790068Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:47.790082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:47.790240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:47.790249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:47.790264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:47.790354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 177 partition: 0 MaxSeqNo: 42 sessionId: src_id|5e961e54-f021f401-45a20194-7b626374_0
2025-09-30T14:50:47.790804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73547f8-e592c30f-f986176d-daf85328_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5e961e54-f021f401-45a20194-7b626374_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:47.793483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e961e54-f021f401-45a20194-7b626374_0] Write session: try to update token
2025-09-30T14:50:47.793502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e961e54-f021f401-45a20194-7b626374_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:47.805424Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:47.805449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:47.805451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:47.805453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:47.805462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894790481291230:3210]
2025-09-30T14:50:47.805467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894790481291230:3210]
2025-09-30T14:50:47.805471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894790481291230:3210]
2025-09-30T14:50:47.805513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:47.805516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:47.805521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.805521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:47.805523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:47.805524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:47.805662Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:47.809419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 177 sessionId: src_id|5e961e54-f021f401-45a20194-7b626374_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:47.812217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:47.859908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894790571015052:3106]
2025-09-30T14:50:47.860211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 176, pipe: [1:7555894790571015052:3106]
2025-09-30T14:50:47.925981Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:47.926247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:47.926268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:47.926310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894790571015052:3106], now have 1 active actors on pipe
2025-09-30T14:50:47.926487Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:47.926494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894790571015052:3106]
2025-09-30T14:50:47.926516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:47.926519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:47.926544Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:47.926577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 177 reason: error at write: Disconnected sessionId: src_id|5e961e54-f021f401-45a20194-7b626374_0
2025-09-30T14:50:47.926772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 177 sessionId: src_id|5e961e54-f021f401-45a20194-7b626374_0 is DEAD
2025-09-30T14:50:47.926916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e961e54-f021f401-45a20194-7b626374_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:47.926935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e961e54-f021f401-45a20194-7b626374_0] Write session will restart in 0.006568s
2025-09-30T14:50:47.926957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e961e54-f021f401-45a20194-7b626374_0] Write session: Do CDS request
2025-09-30T14:50:47.926966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e961e54-f021f401-45a20194-7b626374_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:47.934711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e961e54-f021f401-45a20194-7b626374_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:47.934873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:47.934886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 178
2025-09-30T14:50:47.935017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 178 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:47.935048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 178 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:47.935059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=178 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:47.935062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:47.935481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 178 sessionId:  describe result for acl check
2025-09-30T14:50:47.935516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:47.935523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:47.935526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:47.935532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894790571015069:3548] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:47.936068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894790571015069:3548] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:47.938112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894790571015069:3548] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:47.940864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894790571015069:3548] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:47.940876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894790571015069:3548] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:47.940879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894790571015069:3548] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:47.940887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 178 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:47.944110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:47.945510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:47.945711Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:47.945720Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:47.945731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:47.945786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:47.945826Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894790481291467:3212]
2025-09-30T14:50:47.946418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:47.946717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:47.946758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:47.947063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:47.947122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:47.947128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:47.947130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:47.947131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:47.947132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:47.947133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:47.947133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:47.947134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:47.947135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:47.947136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:47.947137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.947138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.947139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.947140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:47.947142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:47.947146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:47.947156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:47.947160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:47.947164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:47.947168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:47.947172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:47.947175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:47.947178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:47.947181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:47.947185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:47.947188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.947192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.947195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.947199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:47.947202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:47.947209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:47.947216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:47.947221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:47.947226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:47.947230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:47.947234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:47.947239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:47.947261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:47.947266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:47.947270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:47.947274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:47.947279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:47.947283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:47.947287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:47.947291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:47.947296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:47.947300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:47.947305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:47.947308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:47.947313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:47.947318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.947322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.947326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.947333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.947338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.947342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.947351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:47.947356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:47.947360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:47.947365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:47.947402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:47.953347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:47.954234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:47.954255Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:47.954259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:47.954262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:47.954269Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 177 [2:7555894790481291467:3212]
2025-09-30T14:50:47.954288Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:47.954305Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:47.954313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.954317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.954319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.954336Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:47.954343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:47.954352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:47.954418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.954429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.954432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.954436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:47.954439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:47.954509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:47.954516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.954530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:47.954550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:47.954569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:47.954590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894790571015053:2454], now have 1 active actors on pipe
2025-09-30T14:50:47.954594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894790571015215:3548], now have 1 active actors on pipe
2025-09-30T14:50:47.954601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894790481291462:3212]
2025-09-30T14:50:47.954603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894790481291462:3212]
2025-09-30T14:50:47.954605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894790481291462:3212]
2025-09-30T14:50:47.954618Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:47.954635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:47.954658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:47.954662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:47.954664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:47.954669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:47.954672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:47.954636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 177
2025-09-30T14:50:47.954659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 177
2025-09-30T14:50:47.954707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894790481291462:3212]
2025-09-30T14:50:47.954716Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:47.954719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:47.954749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:47.954759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:47.954793Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42e267b2-f51eefdf-75591601-531e3298_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:47.954805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.954808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.954811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:47.954820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.954835Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:47.954857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:47.955023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:47.955032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:47.955047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:47.955126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 178 partition: 0 MaxSeqNo: 42 sessionId: src_id|42e267b2-f51eefdf-75591601-531e3298_0
2025-09-30T14:50:47.955443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e961e54-f021f401-45a20194-7b626374_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|42e267b2-f51eefdf-75591601-531e3298_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:47.958306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42e267b2-f51eefdf-75591601-531e3298_0] Write session: try to update token
2025-09-30T14:50:47.958328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42e267b2-f51eefdf-75591601-531e3298_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:47.967195Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:47.967213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:47.967215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:47.967217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:47.967228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894790481291462:3212]
2025-09-30T14:50:47.967233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894790481291462:3212]
2025-09-30T14:50:47.967237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894790481291462:3212]
2025-09-30T14:50:47.967300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:47.967307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:47.967311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:47.967333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:47.967347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:47.967351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:47.967444Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:47.973364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 178 sessionId: src_id|42e267b2-f51eefdf-75591601-531e3298_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:47.976052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:48.026807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894794865982602:3106]
2025-09-30T14:50:48.027140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 177, pipe: [1:7555894794865982602:3106]
2025-09-30T14:50:48.085285Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:48.085889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:48.085905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:48.085944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894794865982602:3106], now have 1 active actors on pipe
2025-09-30T14:50:48.086161Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:48.086210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894794865982602:3106]
2025-09-30T14:50:48.086213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:48.086246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:48.086316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 178 reason: status is not ok: tablet will be restarted right now sessionId: src_id|42e267b2-f51eefdf-75591601-531e3298_0
2025-09-30T14:50:48.086520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 178 sessionId: src_id|42e267b2-f51eefdf-75591601-531e3298_0 is DEAD
2025-09-30T14:50:48.086724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42e267b2-f51eefdf-75591601-531e3298_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:48.086733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42e267b2-f51eefdf-75591601-531e3298_0] Write session will restart in 0.006592s
2025-09-30T14:50:48.086759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42e267b2-f51eefdf-75591601-531e3298_0] Write session: Do CDS request
2025-09-30T14:50:48.086764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42e267b2-f51eefdf-75591601-531e3298_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:48.094755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42e267b2-f51eefdf-75591601-531e3298_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:48.094911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:48.094927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 179
2025-09-30T14:50:48.095082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 179 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:48.095114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 179 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:48.095134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=179 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:48.095139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:48.095605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 179 sessionId:  describe result for acl check
2025-09-30T14:50:48.095642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:48.095645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:48.095648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:48.095654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894794865982624:3556] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:48.096231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894794865982624:3556] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:48.099217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894794865982624:3556] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:48.102405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894794865982624:3556] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:48.102420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894794865982624:3556] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:48.102424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894794865982624:3556] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:48.102432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 179 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:48.104115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:48.105460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:48.105656Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:48.105665Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:48.105675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:48.105722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:48.105762Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894794776258998:3215]
2025-09-30T14:50:48.106421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:48.106723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:48.106767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:48.107128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:48.107189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:48.107195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:48.107196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:48.107197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:48.107198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:48.107200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:48.107201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:48.107202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:48.107204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:48.107205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:48.107206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.107207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.107208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.107210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:48.107211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:48.107215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:48.107227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:48.107231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:48.107236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:48.107257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:48.107262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:48.107266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:48.107270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:48.107275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:48.107280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:48.107284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.107288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.107292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.107297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:48.107301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:48.107309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:48.107319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:48.107325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:48.107331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:48.107341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:48.107347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:48.107352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:48.107362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:48.107368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:48.107373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:48.107379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:48.107385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:48.107390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:48.107400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:48.107405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:48.107415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:48.107420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:48.107430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:48.107435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:48.107442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:48.107451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.107456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.107465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.107471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.107481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.107487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.107492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:48.107502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:48.107506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:48.107513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:48.107567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:48.113192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:48.114089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:48.114103Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:48.114106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:48.114110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:48.114117Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 178 [2:7555894794776258998:3215]
2025-09-30T14:50:48.114133Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:48.114152Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:48.114155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.114158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.114161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.114179Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:48.114194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:48.114201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:48.114266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.114273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.114276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.114280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:48.114283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:48.114349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:48.114356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.114369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.114386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.114407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:48.114429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894794776258993:3215]
2025-09-30T14:50:48.114436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894794776258993:3215]
2025-09-30T14:50:48.114438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894794776258993:3215]
2025-09-30T14:50:48.114452Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:48.114465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:48.114468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894794865982827:3556], now have 1 active actors on pipe
2025-09-30T14:50:48.114472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894794865982603:2454], now have 1 active actors on pipe
2025-09-30T14:50:48.114475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:48.114477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:48.114480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:48.114495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:48.114498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:48.114532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894794776258993:3215]
2025-09-30T14:50:48.114545Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:48.114541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 178
2025-09-30T14:50:48.114569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:48.114541Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 178
2025-09-30T14:50:48.114630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:48.114639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:48.114677Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99e14065-d4773189-a1f9eb2-1c562c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:48.114688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.114692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.114694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:48.114704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.114714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:48.114731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:48.114865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:48.114871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:48.114882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:48.115003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 179 partition: 0 MaxSeqNo: 42 sessionId: src_id|99e14065-d4773189-a1f9eb2-1c562c0_0
2025-09-30T14:50:48.115445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42e267b2-f51eefdf-75591601-531e3298_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|99e14065-d4773189-a1f9eb2-1c562c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:48.118407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99e14065-d4773189-a1f9eb2-1c562c0_0] Write session: try to update token
2025-09-30T14:50:48.118427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99e14065-d4773189-a1f9eb2-1c562c0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:48.132591Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:48.132608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:48.132620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894794776258993:3215]
2025-09-30T14:50:48.132670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:48.132700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:48.132859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:48.133018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:48.133170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:48.133307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:48.133310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 179 sessionId: src_id|99e14065-d4773189-a1f9eb2-1c562c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:48.133505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:48.133548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:48.135984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:48.136158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:48.136176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:48.136210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:48.136297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:48.137385Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:48.137400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:48.137403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:48.137406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:48.137415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894794776258993:3215]
2025-09-30T14:50:48.137420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894794776258993:3215]
2025-09-30T14:50:48.137424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894794776258993:3215]
2025-09-30T14:50:48.137458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:48.137459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:48.137465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:48.137469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.137469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:48.137472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:48.137602Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:48.186561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894794865982844:3106]
2025-09-30T14:50:48.186905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 178, pipe: [1:7555894794865982844:3106]
2025-09-30T14:50:48.258624Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:48.267890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:48.267920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:48.268110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:48.268192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:48.268276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:48.268357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:48.268414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:48.268423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:48.268507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:48.268580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:48.268659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:48.268762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:48.268812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:48.268823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:48.268905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:48.268982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:48.269058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:48.269138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:48.269190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:48.269198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:48.269276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:48.269349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:48.269432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:48.269512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:48.269567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:48.269574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:48.269656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:48.269724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:48.269796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:48.269871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:48.269926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:48.269935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:48.270011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:48.270095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:48.270167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:48.270245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:48.270296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:48.270306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:48.270384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:48.270463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:48.270541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:48.270620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:48.270688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:48.270696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:48.270769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:48.270837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:48.270905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:48.270977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:48.271024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:48.271032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:48.271104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:48.271172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:48.271267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:48.271344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:48.271393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:48.271401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:48.271472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:48.271537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:48.271607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:48.271676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:48.271725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:48.271738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:48.271811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894794865982844:3106], now have 1 active actors on pipe
2025-09-30T14:50:48.272081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:48.272147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894794865982844:3106]
2025-09-30T14:50:48.272179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:48.272187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:48.272217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 179 reason: error at write: Disconnected sessionId: src_id|99e14065-d4773189-a1f9eb2-1c562c0_0
2025-09-30T14:50:48.272467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 179 sessionId: src_id|99e14065-d4773189-a1f9eb2-1c562c0_0 is DEAD
2025-09-30T14:50:48.272631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99e14065-d4773189-a1f9eb2-1c562c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:48.272643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99e14065-d4773189-a1f9eb2-1c562c0_0] Write session will restart in 0.008839s
2025-09-30T14:50:48.272677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99e14065-d4773189-a1f9eb2-1c562c0_0] Write session: Do CDS request
2025-09-30T14:50:48.272684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99e14065-d4773189-a1f9eb2-1c562c0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:48.273159Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:48.282795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99e14065-d4773189-a1f9eb2-1c562c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:48.282940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:48.282956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 180
2025-09-30T14:50:48.283078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 180 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:48.283122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 180 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:48.283131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=180 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:48.283136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:48.283657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 180 sessionId:  describe result for acl check
2025-09-30T14:50:48.283698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:48.283700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:48.283702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:48.283708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894794865982909:3566] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:48.284445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894794865982909:3566] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:48.287327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894794865982909:3566] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:48.290199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894794865982909:3566] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:48.290215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894794865982909:3566] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:48.290218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894794865982909:3566] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:48.290227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 180 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:48.290714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:48.292064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:48.292247Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:48.292257Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:48.292267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:48.292312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:48.292349Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894794776259245:3223]
2025-09-30T14:50:48.292998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:48.293295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:48.293335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:48.293642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:48.293703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:48.293709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:48.293710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:48.293711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:48.293712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:48.293714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:48.293715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:48.293716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:48.293717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:48.293718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:48.293719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.293720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.293721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.293722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:48.293723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:48.293728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:48.293738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:48.293742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:48.293746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:48.293749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:48.293752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:48.293755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:48.293758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:48.293761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:48.293765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:48.293768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.293771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.293774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.293778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:48.293782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:48.293788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:48.293794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:48.293799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:48.293804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:48.293807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:48.293811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:48.293815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:48.293820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:48.293825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:48.293830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:48.293834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:48.293839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:48.293844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:48.293849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:48.293853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:48.293858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:48.293863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:48.293869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:48.293874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:48.293879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:48.293883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.293888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.293893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.293898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.293902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.293907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.293911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:48.293916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:48.293920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:48.293926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:48.293970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:48.299608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:48.300507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:48.300523Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:48.300526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:48.300530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:48.300537Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 179 [2:7555894794776259245:3223]
2025-09-30T14:50:48.300552Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:48.300567Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:48.300570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.300573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.300576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.300593Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:48.300599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:48.300607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:48.300666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.300679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.300681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.300684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:48.300687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:48.300757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:48.300765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.300779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.300798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.300820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:48.300845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894794865983087:3566], now have 1 active actors on pipe
2025-09-30T14:50:48.300854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894794865982859:2454], now have 1 active actors on pipe
2025-09-30T14:50:48.300861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894794776259240:3223]
2025-09-30T14:50:48.300863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894794776259240:3223]
2025-09-30T14:50:48.300866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894794776259240:3223]
2025-09-30T14:50:48.300881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:48.300897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:48.300900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:48.300901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:48.300903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:48.300916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:48.300918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:48.300949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894794776259240:3223]
2025-09-30T14:50:48.300910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 179
2025-09-30T14:50:48.300957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:48.300960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:48.300943Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 179
2025-09-30T14:50:48.300984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:48.300995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:48.301029Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50dba3b4-ea111103-f5ba0157-d453e2dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:48.301042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.301046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.301048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:48.301056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.301066Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:48.301088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:48.301203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:48.301211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:48.301224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:48.301314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 180 partition: 0 MaxSeqNo: 42 sessionId: src_id|50dba3b4-ea111103-f5ba0157-d453e2dc_0
2025-09-30T14:50:48.301696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99e14065-d4773189-a1f9eb2-1c562c0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|50dba3b4-ea111103-f5ba0157-d453e2dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:48.305113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50dba3b4-ea111103-f5ba0157-d453e2dc_0] Write session: try to update token
2025-09-30T14:50:48.305130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50dba3b4-ea111103-f5ba0157-d453e2dc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:48.313204Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:48.313220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:48.313223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:48.313225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:48.313235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894794776259240:3223]
2025-09-30T14:50:48.313240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894794776259240:3223]
2025-09-30T14:50:48.313245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894794776259240:3223]
2025-09-30T14:50:48.313284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:48.313286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:48.313291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.313294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:48.313294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:48.313307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:48.313446Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:48.319960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 180 sessionId: src_id|50dba3b4-ea111103-f5ba0157-d453e2dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:48.322637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:48.372413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894794865983110:3106]
2025-09-30T14:50:48.372738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 179, pipe: [1:7555894794865983110:3106]
2025-09-30T14:50:48.426748Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:48.427418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:48.427435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:48.427455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894794865983110:3106], now have 1 active actors on pipe
2025-09-30T14:50:48.427651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:48.427650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894794865983110:3106]
2025-09-30T14:50:48.427665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:48.427672Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:48.427734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 180 reason: error at write: Disconnected sessionId: src_id|50dba3b4-ea111103-f5ba0157-d453e2dc_0
2025-09-30T14:50:48.427651Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:48.427912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 180 sessionId: src_id|50dba3b4-ea111103-f5ba0157-d453e2dc_0 is DEAD
2025-09-30T14:50:48.428099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50dba3b4-ea111103-f5ba0157-d453e2dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:48.428110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50dba3b4-ea111103-f5ba0157-d453e2dc_0] Write session will restart in 0.007376s
2025-09-30T14:50:48.428147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50dba3b4-ea111103-f5ba0157-d453e2dc_0] Write session: Do CDS request
2025-09-30T14:50:48.428155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50dba3b4-ea111103-f5ba0157-d453e2dc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:48.436852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50dba3b4-ea111103-f5ba0157-d453e2dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:48.436876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:48.436893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 181
2025-09-30T14:50:48.437123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 181 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:48.437157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 181 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:48.437161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=181 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:48.437165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:48.437665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 181 sessionId:  describe result for acl check
2025-09-30T14:50:48.437706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:48.437708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:48.437710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:48.437716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894794865983150:3572] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:48.438292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894794865983150:3572] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:48.441223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894794865983150:3572] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:48.444430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894794865983150:3572] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:48.444445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894794865983150:3572] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:48.444449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894794865983150:3572] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:48.444457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 181 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:48.445139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:48.446317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:48.446496Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:48.446508Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:48.446515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:48.446554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:48.446581Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894794776259505:3232]
2025-09-30T14:50:48.447136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:48.447465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:48.447500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:48.447816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:48.447869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:48.447874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:48.447876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:48.447877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:48.447878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:48.447879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:48.447880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:48.447881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:48.447883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:48.447884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:48.447885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.447886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.447887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.447888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:48.447889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:48.447894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:48.447905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:48.447910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:48.447914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:48.447918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:48.447922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:48.447930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:48.447934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:48.447938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:48.447942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:48.447946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.447950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.447954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.447962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:48.447966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:48.447977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:48.447988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:48.447998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:48.448008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:48.448016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:48.448022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:48.448026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:48.448036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:48.448042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:48.448051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:48.448056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:48.448061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:48.448070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:48.448076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:48.448085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:48.448099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:48.448110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:48.448115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:48.448119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:48.448124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:48.448128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.448134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.448138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.448143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.448148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.448153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.448157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:48.448162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:48.448166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:48.448171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:48.448211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:48.453490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:48.454364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:48.454375Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:48.454377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:48.454380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:48.454386Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 180 [2:7555894794776259505:3232]
2025-09-30T14:50:48.454397Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:48.454409Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:48.454411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.454414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.454415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.454429Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:48.454441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:48.454452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:48.454503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.454508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.454510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.454512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:48.454514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:48.454559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:48.454567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.454575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.454581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.454591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:48.454603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894794776259500:3232]
2025-09-30T14:50:48.454605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894794776259500:3232]
2025-09-30T14:50:48.454606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894794776259500:3232]
2025-09-30T14:50:48.454612Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:48.454621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:48.454636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:48.454638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:48.454651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:48.454654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:48.454657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:48.454681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894794865983341:3572], now have 1 active actors on pipe
2025-09-30T14:50:48.454685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894794865983111:2454], now have 1 active actors on pipe
2025-09-30T14:50:48.454687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894794776259500:3232]
2025-09-30T14:50:48.454696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:48.454729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:48.454743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 180
2025-09-30T14:50:48.454768Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 180
2025-09-30T14:50:48.454824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:48.454838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:48.454882Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c210f08-26636c1e-f00367b0-d1d78361_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:48.454894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.454898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.454900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:48.454910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.454925Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:48.454944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:48.455100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:48.455107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:48.455128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:48.455229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 181 partition: 0 MaxSeqNo: 42 sessionId: src_id|9c210f08-26636c1e-f00367b0-d1d78361_0
2025-09-30T14:50:48.455667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50dba3b4-ea111103-f5ba0157-d453e2dc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9c210f08-26636c1e-f00367b0-d1d78361_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:48.458328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c210f08-26636c1e-f00367b0-d1d78361_0] Write session: try to update token
2025-09-30T14:50:48.458348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c210f08-26636c1e-f00367b0-d1d78361_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:48.466876Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:48.466892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:48.466895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:48.466897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:48.466907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894794776259500:3232]
2025-09-30T14:50:48.466911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894794776259500:3232]
2025-09-30T14:50:48.466915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894794776259500:3232]
2025-09-30T14:50:48.466954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:48.466964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.466966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:48.466970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:48.466977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:48.466981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:48.467116Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:48.472461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 181 sessionId: src_id|9c210f08-26636c1e-f00367b0-d1d78361_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:48.475010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:48.528062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894794865983356:3106]
2025-09-30T14:50:48.528347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 180, pipe: [1:7555894794865983356:3106]
2025-09-30T14:50:48.577742Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:48.578273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:48.578285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:48.578316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894794865983356:3106], now have 1 active actors on pipe
2025-09-30T14:50:48.578514Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:48.578560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894794865983356:3106]
2025-09-30T14:50:48.578596Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:48.578956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:48.579028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 181 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9c210f08-26636c1e-f00367b0-d1d78361_0
2025-09-30T14:50:48.579200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 181 sessionId: src_id|9c210f08-26636c1e-f00367b0-d1d78361_0 is DEAD
2025-09-30T14:50:48.579364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c210f08-26636c1e-f00367b0-d1d78361_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:48.579373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c210f08-26636c1e-f00367b0-d1d78361_0] Write session will restart in 0.009146s
2025-09-30T14:50:48.579390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c210f08-26636c1e-f00367b0-d1d78361_0] Write session: Do CDS request
2025-09-30T14:50:48.579395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c210f08-26636c1e-f00367b0-d1d78361_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:48.589808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c210f08-26636c1e-f00367b0-d1d78361_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:48.589906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:48.589921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 182
2025-09-30T14:50:48.590048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 182 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:48.590078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 182 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:48.590085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=182 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:48.590089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:48.590551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 182 sessionId:  describe result for acl check
2025-09-30T14:50:48.590588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:48.590590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:48.590591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:48.590598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894794865983452:3576] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:48.591135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894794865983452:3576] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:48.593655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894794865983452:3576] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:48.594995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:48.595504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:48.595680Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:48.595689Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:48.595700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:48.595753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:48.595791Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894794776259740:3234]
2025-09-30T14:50:48.596442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:48.596783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:48.596827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:48.597012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894794865983452:3576] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:48.597028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894794865983452:3576] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:48.597031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894794865983452:3576] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:48.597044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 182 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:48.597160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:48.597224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:48.597230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:48.597232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:48.597233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:48.597234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:48.597235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:48.597236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:48.597237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:48.597239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:48.597240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:48.597241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.597242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.597243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.597244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:48.597245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:48.597252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:48.597262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:48.597267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:48.597272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:48.597276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:48.597280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:48.597285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:48.597289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:48.597293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:48.597297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:48.597301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.597305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.597310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.597314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:48.597318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:48.597325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:48.597334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:48.597341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:48.597347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:48.597354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:48.597364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:48.597369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:48.597375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:48.597386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:48.597391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:48.597400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:48.597405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:48.597411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:48.597416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:48.597425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:48.597431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:48.597436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:48.597442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:48.597447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:48.597453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:48.597462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.597468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.597477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.597482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.597491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.597496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.597504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:48.597510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:48.597519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:48.597525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:48.597579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:48.603186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:48.604078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:48.604099Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:48.604102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:48.604105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:48.604112Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 181 [2:7555894794776259740:3234]
2025-09-30T14:50:48.604128Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:48.604144Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:48.604152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.604156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.604159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.604175Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:48.604187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:48.604198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:48.604266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.604273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.604275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.604279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:48.604281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:48.604356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:48.604364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.604379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.604396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.604419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:48.604441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894794865983591:3576], now have 1 active actors on pipe
2025-09-30T14:50:48.604453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894794865983357:2454], now have 1 active actors on pipe
2025-09-30T14:50:48.604460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894794776259734:3234]
2025-09-30T14:50:48.604463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894794776259734:3234]
2025-09-30T14:50:48.604465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894794776259734:3234]
2025-09-30T14:50:48.604480Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:48.604493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:48.604494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:48.604504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:48.604509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:48.604512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:48.604523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:48.604527Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 181
2025-09-30T14:50:48.604536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 181
2025-09-30T14:50:48.604548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894794776259734:3234]
2025-09-30T14:50:48.604552Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:48.604559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:48.604590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:48.604595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:48.604631Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97edd116-f257d24a-8b514c52-3afb7bd6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:48.604644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.604653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.604656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:48.604665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.604674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:48.604692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:48.604907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:48.604916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:48.604931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:48.605039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 182 partition: 0 MaxSeqNo: 42 sessionId: src_id|97edd116-f257d24a-8b514c52-3afb7bd6_0
2025-09-30T14:50:48.605409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c210f08-26636c1e-f00367b0-d1d78361_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|97edd116-f257d24a-8b514c52-3afb7bd6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:48.608200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97edd116-f257d24a-8b514c52-3afb7bd6_0] Write session: try to update token
2025-09-30T14:50:48.608220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97edd116-f257d24a-8b514c52-3afb7bd6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:48.617525Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:48.617548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:48.617550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:48.617552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:48.617561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894794776259734:3234]
2025-09-30T14:50:48.617566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894794776259734:3234]
2025-09-30T14:50:48.617570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894794776259734:3234]
2025-09-30T14:50:48.617609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:48.617616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.617619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:48.617630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:48.617637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:48.617641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:48.617775Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:48.622979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 182 sessionId: src_id|97edd116-f257d24a-8b514c52-3afb7bd6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:48.625690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:48.679310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894794865983601:3106]
2025-09-30T14:50:48.679595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 181, pipe: [1:7555894794865983601:3106]
2025-09-30T14:50:48.729005Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:48.729251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:48.729264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:48.729307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894794865983601:3106], now have 1 active actors on pipe
2025-09-30T14:50:48.729490Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:48.729535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:48.729553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:48.729573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894794865983601:3106]
2025-09-30T14:50:48.729592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:48.729628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 182 reason: error at write: Disconnected sessionId: src_id|97edd116-f257d24a-8b514c52-3afb7bd6_0
2025-09-30T14:50:48.729811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 182 sessionId: src_id|97edd116-f257d24a-8b514c52-3afb7bd6_0 is DEAD
2025-09-30T14:50:48.729972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97edd116-f257d24a-8b514c52-3afb7bd6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:48.729979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97edd116-f257d24a-8b514c52-3afb7bd6_0] Write session will restart in 0.009495s
2025-09-30T14:50:48.730003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97edd116-f257d24a-8b514c52-3afb7bd6_0] Write session: Do CDS request
2025-09-30T14:50:48.730008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97edd116-f257d24a-8b514c52-3afb7bd6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:48.740752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97edd116-f257d24a-8b514c52-3afb7bd6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:48.740841Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:48.740858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 183
2025-09-30T14:50:48.740971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 183 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:48.741003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 183 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:48.741013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=183 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:48.741017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:48.741349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 183 sessionId:  describe result for acl check
2025-09-30T14:50:48.741383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:48.741389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:48.741391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:48.741398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894794865983687:3580] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:48.741711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894794865983687:3580] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:48.743356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894794865983687:3580] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:48.745753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894794865983687:3580] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:48.745768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894794865983687:3580] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:48.745772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894794865983687:3580] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:48.745779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 183 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:48.746215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:48.747397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:48.747578Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:48.747587Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:48.747597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:48.747650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:48.747688Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894794776259989:3237]
2025-09-30T14:50:48.748316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:48.748558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:48.748598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:48.748906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:48.748964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:48.748970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:48.748971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:48.748972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:48.748973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:48.748974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:48.748975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:48.748976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:48.748978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:48.748979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:48.748980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.748982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.748983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.748984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:48.748986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:48.748991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:48.749002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:48.749006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:48.749010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:48.749014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:48.749018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:48.749023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:48.749027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:48.749031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:48.749036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:48.749040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.749043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.749047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.749052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:48.749056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:48.749064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:48.749072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:48.749078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:48.749084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:48.749089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:48.749095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:48.749101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:48.749111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:48.749116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:48.749120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:48.749125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:48.749131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:48.749140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:48.749146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:48.749154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:48.749160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:48.749168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:48.749174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:48.749182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:48.749187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:48.749196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.749200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.749206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.749211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.749216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.749225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.749230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:48.749237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:48.749245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:48.749250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:48.749296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:48.754299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:48.755152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:48.755167Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:48.755170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:48.755174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:48.755180Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 182 [2:7555894794776259989:3237]
2025-09-30T14:50:48.755196Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:48.755211Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:48.755214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.755217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.755219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.755234Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:48.755264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:48.755274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:48.755325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.755331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.755333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.755337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:48.755340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:48.755404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:48.755413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.755425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.755437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.755455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:48.755473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894794865983602:2454], now have 1 active actors on pipe
2025-09-30T14:50:48.755483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894794865983846:3580], now have 1 active actors on pipe
2025-09-30T14:50:48.755490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894794776259984:3237]
2025-09-30T14:50:48.755491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894794776259984:3237]
2025-09-30T14:50:48.755494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894794776259984:3237]
2025-09-30T14:50:48.755507Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:48.755516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:48.755522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:48.755523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:48.755525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:48.755537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:48.755541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:48.755569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894794776259984:3237]
2025-09-30T14:50:48.755580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:48.755533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 182
2025-09-30T14:50:48.755550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 182
2025-09-30T14:50:48.755587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:48.755601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:48.755613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:48.755658Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95059aa6-21d9d580-e4d337ac-b249782d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:48.755669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.755675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.755678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:48.755689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.755697Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:48.755721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:48.755903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:48.755911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:48.755926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:48.756006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 183 partition: 0 MaxSeqNo: 42 sessionId: src_id|95059aa6-21d9d580-e4d337ac-b249782d_0
2025-09-30T14:50:48.756355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97edd116-f257d24a-8b514c52-3afb7bd6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|95059aa6-21d9d580-e4d337ac-b249782d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:48.759076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95059aa6-21d9d580-e4d337ac-b249782d_0] Write session: try to update token
2025-09-30T14:50:48.759092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95059aa6-21d9d580-e4d337ac-b249782d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:48.767458Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:48.767473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:48.767476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:48.767478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:48.767487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894794776259984:3237]
2025-09-30T14:50:48.767492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894794776259984:3237]
2025-09-30T14:50:48.767496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894794776259984:3237]
2025-09-30T14:50:48.767536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:48.767543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.767546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:48.767547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:48.767553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:48.767557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:48.767691Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:48.773543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 183 sessionId: src_id|95059aa6-21d9d580-e4d337ac-b249782d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:48.776116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:48.829639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894794865983859:3106]
2025-09-30T14:50:48.829953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 182, pipe: [1:7555894794865983859:3106]
2025-09-30T14:50:48.880191Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:48.880689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:48.880704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:48.880744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894794865983859:3106], now have 1 active actors on pipe
2025-09-30T14:50:48.880945Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:48.880970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:48.880994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:48.881030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894794865983859:3106]
2025-09-30T14:50:48.881073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 183 reason: status is not ok: tablet will be restarted right now sessionId: src_id|95059aa6-21d9d580-e4d337ac-b249782d_0
2025-09-30T14:50:48.881287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 183 sessionId: src_id|95059aa6-21d9d580-e4d337ac-b249782d_0 is DEAD
2025-09-30T14:50:48.881450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95059aa6-21d9d580-e4d337ac-b249782d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:48.881461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95059aa6-21d9d580-e4d337ac-b249782d_0] Write session will restart in 0.005693s
2025-09-30T14:50:48.881484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95059aa6-21d9d580-e4d337ac-b249782d_0] Write session: Do CDS request
2025-09-30T14:50:48.881490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95059aa6-21d9d580-e4d337ac-b249782d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:48.888826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95059aa6-21d9d580-e4d337ac-b249782d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:48.888890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:48.888906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 184
2025-09-30T14:50:48.889065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 184 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:48.889096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 184 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:48.889100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=184 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:48.889115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:48.889548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 184 sessionId:  describe result for acl check
2025-09-30T14:50:48.889584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:48.889593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:48.889595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:48.889601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894794865983874:3585] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:48.890132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894794865983874:3585] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:48.894884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894794865983874:3585] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:48.899467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894794865983874:3585] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:48.899490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894794865983874:3585] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:48.899494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894794865983874:3585] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:48.899501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 184 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:48.903230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:48.904670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:48.904885Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:48.904896Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:48.904907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:48.904964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:48.905005Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894794776260227:3239]
2025-09-30T14:50:48.905669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:48.905998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:48.906059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:48.906437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:48.906487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:48.906492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:48.906493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:48.906493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:48.906494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:48.906495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:48.906495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:48.906496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:48.906497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:48.906498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:48.906499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.906499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.906500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.906501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:48.906501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:48.906506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:48.906513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:48.906516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:48.906520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:48.906524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:48.906528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:48.906532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:48.906536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:48.906539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:48.906544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:48.906547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.906551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.906555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.906559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:48.906562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:48.906567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:48.906572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:48.906577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:48.906581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:48.906586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:48.906591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:48.906595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:48.906600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:48.906604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:48.906609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:48.906617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:48.906622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:48.906626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:48.906629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:48.906631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:48.906634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:48.906639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:48.906655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:48.906658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:48.906660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:48.906663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.906667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.906670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.906673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.906675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.906678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.906681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:48.906684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:48.906686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:48.906689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:48.906737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:48.912327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:48.913244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:48.913262Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:48.913266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:48.913270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:48.913277Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 183 [2:7555894794776260227:3239]
2025-09-30T14:50:48.913293Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:48.913309Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:48.913312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.913315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.913318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.913333Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:48.913340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:48.913347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:48.913416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.913428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.913431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.913435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:48.913437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:48.913508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:48.913515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.913531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:48.913546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:48.913570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:48.913592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894794865983860:2454], now have 1 active actors on pipe
2025-09-30T14:50:48.913601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894794865984015:3585], now have 1 active actors on pipe
2025-09-30T14:50:48.913607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894794776260222:3239]
2025-09-30T14:50:48.913610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894794776260222:3239]
2025-09-30T14:50:48.913612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894794776260222:3239]
2025-09-30T14:50:48.913624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:48.913636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:48.913640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:48.913642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:48.913645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:48.913659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:48.913667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:48.913678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 183
2025-09-30T14:50:48.913682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 183
2025-09-30T14:50:48.913703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894794776260222:3239]
2025-09-30T14:50:48.913715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:48.913717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:48.913741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:48.913746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:48.914104Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ebce5cf5-3499026b-dab73f06-c4648c81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:48.914119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.914124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.914126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:48.914136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.914147Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:48.914172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:48.914352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:48.914360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:48.914373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:48.914452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 184 partition: 0 MaxSeqNo: 42 sessionId: src_id|ebce5cf5-3499026b-dab73f06-c4648c81_0
2025-09-30T14:50:48.914849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95059aa6-21d9d580-e4d337ac-b249782d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ebce5cf5-3499026b-dab73f06-c4648c81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:48.917707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebce5cf5-3499026b-dab73f06-c4648c81_0] Write session: try to update token
2025-09-30T14:50:48.917726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebce5cf5-3499026b-dab73f06-c4648c81_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:48.926016Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:48.926034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:48.926036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:48.926037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:48.926046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894794776260222:3239]
2025-09-30T14:50:48.926051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894794776260222:3239]
2025-09-30T14:50:48.926055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894794776260222:3239]
2025-09-30T14:50:48.926094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:48.926098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:48.926104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:48.926105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:48.926107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:48.926116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:48.926244Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:48.934319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 184 sessionId: src_id|ebce5cf5-3499026b-dab73f06-c4648c81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:48.937037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:48.981185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894794865984113:3106]
2025-09-30T14:50:48.981421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 183, pipe: [1:7555894794865984113:3106]
2025-09-30T14:50:49.035811Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:49.036121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:49.036135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:49.036154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894794865984113:3106], now have 1 active actors on pipe
2025-09-30T14:50:49.036379Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:49.036455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:49.036470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:49.036478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:49.036512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894794865984113:3106]
2025-09-30T14:50:49.036534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 184 reason: error at write: Disconnected sessionId: src_id|ebce5cf5-3499026b-dab73f06-c4648c81_0
2025-09-30T14:50:49.036737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 184 sessionId: src_id|ebce5cf5-3499026b-dab73f06-c4648c81_0 is DEAD
2025-09-30T14:50:49.036846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebce5cf5-3499026b-dab73f06-c4648c81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:49.036855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebce5cf5-3499026b-dab73f06-c4648c81_0] Write session will restart in 0.008404s
2025-09-30T14:50:49.036871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebce5cf5-3499026b-dab73f06-c4648c81_0] Write session: Do CDS request
2025-09-30T14:50:49.036875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebce5cf5-3499026b-dab73f06-c4648c81_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:49.046820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebce5cf5-3499026b-dab73f06-c4648c81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:49.046980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:49.046995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 185
2025-09-30T14:50:49.047118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 185 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:49.047150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 185 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:49.047175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=185 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:49.047185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:49.047669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 185 sessionId:  describe result for acl check
2025-09-30T14:50:49.047703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:49.047719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:49.047722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:49.047728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894799160951477:3591] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:49.048260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894799160951477:3591] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:49.050584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894799160951477:3591] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:49.053222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894799160951477:3591] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:49.053239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894799160951477:3591] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:49.053243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894799160951477:3591] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:49.053251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 185 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:49.054094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:49.055459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:49.055655Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:49.055665Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:49.055675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:49.055722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:49.055758Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894799071227764:3242]
2025-09-30T14:50:49.056393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:49.056736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:49.056803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:49.057161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:49.057247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:49.057267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:49.057268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:49.057269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:49.057270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:49.057271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:49.057273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:49.057274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:49.057275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:49.057277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:49.057278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.057279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.057280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.057281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:49.057282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:49.057289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:49.057299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:49.057304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:49.057308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:49.057312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:49.057317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:49.057321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:49.057325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:49.057330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:49.057335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:49.057339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.057343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.057347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.057351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:49.057355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:49.057363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:49.057372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:49.057377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:49.057383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:49.057388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:49.057393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:49.057398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:49.057404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:49.057409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:49.057414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:49.057421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:49.057426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:49.057432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:49.057437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:49.057443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:49.057454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:49.057459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:49.057468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:49.057472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:49.057477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:49.057482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.057487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.057493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.057504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.057508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.057515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.057524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:49.057529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:49.057538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:49.057543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:49.057589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:49.063284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:49.064186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:49.064201Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:49.064205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:49.064209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:49.064215Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 184 [2:7555894799071227764:3242]
2025-09-30T14:50:49.064233Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:49.064250Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:49.064257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.064260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.064263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.064276Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:49.064287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:49.064295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:49.064357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.064365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.064368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.064372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:49.064374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:49.064440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:49.064448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.064462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.064479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.064497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:49.064516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894799160951645:3591], now have 1 active actors on pipe
2025-09-30T14:50:49.064520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894799160951413:2454], now have 1 active actors on pipe
2025-09-30T14:50:49.064526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894799071227759:3242]
2025-09-30T14:50:49.064529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894799071227759:3242]
2025-09-30T14:50:49.064531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894799071227759:3242]
2025-09-30T14:50:49.064545Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:49.064558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:49.064560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:49.064564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:49.064572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:49.064574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:49.064576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:49.064609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894799071227759:3242]
2025-09-30T14:50:49.064622Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:49.064612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 184
2025-09-30T14:50:49.064636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:49.064635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 184
2025-09-30T14:50:49.064656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:49.064661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:49.064692Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b89c6a5a-91fa738d-a597fcef-cf7bf55f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:49.064704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.064708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.064710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:49.064719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.064728Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:49.064743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:49.064888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:49.064897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:49.064910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:49.064981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 185 partition: 0 MaxSeqNo: 42 sessionId: src_id|b89c6a5a-91fa738d-a597fcef-cf7bf55f_0
2025-09-30T14:50:49.065329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebce5cf5-3499026b-dab73f06-c4648c81_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b89c6a5a-91fa738d-a597fcef-cf7bf55f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:49.068114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b89c6a5a-91fa738d-a597fcef-cf7bf55f_0] Write session: try to update token
2025-09-30T14:50:49.068134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b89c6a5a-91fa738d-a597fcef-cf7bf55f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:49.076900Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:49.076926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:49.076940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894799071227759:3242]
2025-09-30T14:50:49.076999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:49.077003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:49.077257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:49.077517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:49.077720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:49.077876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:49.078085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:49.078133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:49.083053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 185 sessionId: src_id|b89c6a5a-91fa738d-a597fcef-cf7bf55f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:49.085707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:49.085933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:49.085965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:49.086000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:49.086082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:49.087624Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:49.087637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:49.087640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:49.087642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:49.087652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894799071227759:3242]
2025-09-30T14:50:49.087656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894799071227759:3242]
2025-09-30T14:50:49.087659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894799071227759:3242]
2025-09-30T14:50:49.087699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:49.087705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.087708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:49.087708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:49.087714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:49.087718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:49.087863Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:49.136838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894799160951660:3106]
2025-09-30T14:50:49.137125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 184, pipe: [1:7555894799160951660:3106]
2025-09-30T14:50:49.201457Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:49.209307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:49.209333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:49.209490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:49.209553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:49.209611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:49.209675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:49.209717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:49.209725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:49.209789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:49.209847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:49.209911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:49.209973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:49.210012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:49.210021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:49.210094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:49.210165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:49.210237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:49.210327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:49.210373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:49.210381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:49.210442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:49.210499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:49.210556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:49.210622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:49.210675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:49.210680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:49.210739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:49.210795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:49.210858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:49.210919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:49.210959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:49.210969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:49.211031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:49.211081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:49.211140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:49.211196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:49.211318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:49.211324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:49.211386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:49.211452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:49.211517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:49.211572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:49.211613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:49.211618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:49.211686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:49.211743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:49.211799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:49.211857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:49.211972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:49.211979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:49.212040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:49.212095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:49.212153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:49.212211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:49.212250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:49.212256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:49.212316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:49.212372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:49.212429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:49.212498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:49.212613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:49.212618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:49.212670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894799160951660:3106], now have 1 active actors on pipe
2025-09-30T14:50:49.212954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:49.212968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:49.212975Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:49.212995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 185 reason: error at write: Disconnected sessionId: src_id|b89c6a5a-91fa738d-a597fcef-cf7bf55f_0
2025-09-30T14:50:49.213019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894799160951660:3106]
2025-09-30T14:50:49.213227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 185 sessionId: src_id|b89c6a5a-91fa738d-a597fcef-cf7bf55f_0 is DEAD
2025-09-30T14:50:49.213368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b89c6a5a-91fa738d-a597fcef-cf7bf55f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:49.213377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b89c6a5a-91fa738d-a597fcef-cf7bf55f_0] Write session will restart in 0.005706s
2025-09-30T14:50:49.213416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b89c6a5a-91fa738d-a597fcef-cf7bf55f_0] Write session: Do CDS request
2025-09-30T14:50:49.213422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b89c6a5a-91fa738d-a597fcef-cf7bf55f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:49.213534Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:49.220747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b89c6a5a-91fa738d-a597fcef-cf7bf55f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:49.220790Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:49.220802Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 186
2025-09-30T14:50:49.220953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 186 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:49.220982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 186 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:49.220992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=186 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:49.220996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:49.221445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 186 sessionId:  describe result for acl check
2025-09-30T14:50:49.221485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:49.221492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:49.221494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:49.221500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894799160951677:3595] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:49.222015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894799160951677:3595] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:49.225292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894799160951677:3595] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:49.228222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894799160951677:3595] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:49.228236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894799160951677:3595] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:49.228239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894799160951677:3595] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:49.228256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 186 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:49.230014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:49.231284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:49.231475Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:49.231484Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:49.231495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:49.231538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:49.231575Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894799071228004:3244]
2025-09-30T14:50:49.232154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:49.232407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:49.232445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:49.232754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:49.232809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:49.232814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:49.232815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:49.232817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:49.232818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:49.232819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:49.232820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:49.232821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:49.232823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:49.232824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:49.232825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.232826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.232827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.232828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:49.232830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:49.232834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:49.232845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:49.232849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:49.232853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:49.232856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:49.232860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:49.232863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:49.232867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:49.232870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:49.232876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:49.232879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.232882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.232887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.232891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:49.232895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:49.232902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:49.232909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:49.232914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:49.232919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:49.232925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:49.232937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:49.232943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:49.232949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:49.232958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:49.232963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:49.232968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:49.232977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:49.232981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:49.232987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:49.232995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:49.233001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:49.233005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:49.233010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:49.233015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:49.233020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:49.233025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.233031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.233040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.233045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.233049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.233059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.233063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:49.233073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:49.233078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:49.233083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:49.233128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:49.238635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:49.239798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:49.239823Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:49.239826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:49.239832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:49.239840Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 185 [2:7555894799071228004:3244]
2025-09-30T14:50:49.239860Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:49.239883Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:49.239892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.239895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.239898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.239915Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:49.239928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:49.239935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:49.240005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.240016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.240018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.240022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:49.240025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:49.240102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:49.240111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.240126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.240138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.240162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:49.240193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894799160951661:2454], now have 1 active actors on pipe
2025-09-30T14:50:49.240202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894799160951876:3595], now have 1 active actors on pipe
2025-09-30T14:50:49.240209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894799071227999:3244]
2025-09-30T14:50:49.240212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894799071227999:3244]
2025-09-30T14:50:49.240214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894799071227999:3244]
2025-09-30T14:50:49.240230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:49.240249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:49.240251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:49.240260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:49.240263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:49.240267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:49.240271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:49.240308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894799071227999:3244]
2025-09-30T14:50:49.240286Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 185
2025-09-30T14:50:49.240317Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:49.240287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 185
2025-09-30T14:50:49.240319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:49.240345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:49.240358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:49.240397Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6783dd99-11b9ef80-6da4e3bf-2e696978_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:49.240410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.240419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.240421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:49.240431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.240442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:49.240473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:49.240625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:49.240636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:49.240652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:49.240743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 186 partition: 0 MaxSeqNo: 42 sessionId: src_id|6783dd99-11b9ef80-6da4e3bf-2e696978_0
2025-09-30T14:50:49.241135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b89c6a5a-91fa738d-a597fcef-cf7bf55f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6783dd99-11b9ef80-6da4e3bf-2e696978_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:49.243997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6783dd99-11b9ef80-6da4e3bf-2e696978_0] Write session: try to update token
2025-09-30T14:50:49.244017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6783dd99-11b9ef80-6da4e3bf-2e696978_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:49.252471Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:49.252491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:49.252493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:49.252496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:49.252505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894799071227999:3244]
2025-09-30T14:50:49.252511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894799071227999:3244]
2025-09-30T14:50:49.252515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894799071227999:3244]
2025-09-30T14:50:49.252560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:49.252573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.252576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:49.252576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:49.252584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:49.252588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:49.252721Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:49.260523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 186 sessionId: src_id|6783dd99-11b9ef80-6da4e3bf-2e696978_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:49.263481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:49.312921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894799160951914:3106]
2025-09-30T14:50:49.313148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 185, pipe: [1:7555894799160951914:3106]
2025-09-30T14:50:49.372613Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:49.373383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:49.373399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:49.373419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894799160951914:3106], now have 1 active actors on pipe
2025-09-30T14:50:49.373643Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:49.373659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:49.373672Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:49.373681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:49.373722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894799160951914:3106]
2025-09-30T14:50:49.373754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 186 reason: error at write: Disconnected sessionId: src_id|6783dd99-11b9ef80-6da4e3bf-2e696978_0
2025-09-30T14:50:49.373952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 186 sessionId: src_id|6783dd99-11b9ef80-6da4e3bf-2e696978_0 is DEAD
2025-09-30T14:50:49.374114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6783dd99-11b9ef80-6da4e3bf-2e696978_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:49.374124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6783dd99-11b9ef80-6da4e3bf-2e696978_0] Write session will restart in 0.008856s
2025-09-30T14:50:49.374149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6783dd99-11b9ef80-6da4e3bf-2e696978_0] Write session: Do CDS request
2025-09-30T14:50:49.374161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6783dd99-11b9ef80-6da4e3bf-2e696978_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:49.383861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6783dd99-11b9ef80-6da4e3bf-2e696978_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:49.383966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:49.383985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 187
2025-09-30T14:50:49.384122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 187 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:49.384156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 187 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:49.384162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=187 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:49.384166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:49.384636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 187 sessionId:  describe result for acl check
2025-09-30T14:50:49.384678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:49.384693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:49.384699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:49.384705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894799160951987:3606] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:49.385259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894799160951987:3606] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:49.388121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894799160951987:3606] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:49.391131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894799160951987:3606] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:49.391146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894799160951987:3606] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:49.391150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894799160951987:3606] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:49.391158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 187 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:49.391229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:49.392441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:49.392664Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:49.392668Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:49.392679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:49.392738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:49.392792Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894799071228281:3258]
2025-09-30T14:50:49.393573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:49.393875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:49.393929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:49.394270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:49.394361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:49.394368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:49.394369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:49.394371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:49.394372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:49.394373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:49.394375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:49.394376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:49.394377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:49.394378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:49.394379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.394380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.394382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.394383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:49.394385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:49.394390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:49.394401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:49.394405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:49.394409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:49.394412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:49.394416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:49.394420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:49.394423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:49.394427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:49.394431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:49.394435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.394439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.394443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.394447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:49.394451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:49.394458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:49.394473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:49.394484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:49.394494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:49.394503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:49.394514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:49.394519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:49.394524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:49.394534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:49.394540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:49.394545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:49.394550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:49.394555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:49.394561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:49.394565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:49.394569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:49.394574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:49.394579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:49.394585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:49.394591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:49.394596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.394607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.394610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.394616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.394621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.394627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.394631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:49.394636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:49.394656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:49.394666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:49.394712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:49.400352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:49.402471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:49.402492Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:49.402496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:49.402500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:49.402508Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 186 [2:7555894799071228281:3258]
2025-09-30T14:50:49.402528Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:49.402542Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:49.402546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.402549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.402551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.402569Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:49.402575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:49.402589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:49.402675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.402684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.402686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.402690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:49.402693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:49.402762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:49.402769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.402784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.402802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.402825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:49.402846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894799071228275:3258]
2025-09-30T14:50:49.402853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894799071228275:3258]
2025-09-30T14:50:49.402856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894799071228275:3258]
2025-09-30T14:50:49.402865Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:49.402874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:49.402878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:49.402880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:49.402899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:49.402917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:49.402925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:49.402936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894799160952169:3606], now have 1 active actors on pipe
2025-09-30T14:50:49.402942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894799160951936:2454], now have 1 active actors on pipe
2025-09-30T14:50:49.402974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894799071228275:3258]
2025-09-30T14:50:49.402989Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:49.402988Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 186
2025-09-30T14:50:49.403022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:49.403007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 186
2025-09-30T14:50:49.403167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:49.403179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:49.403203Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|73b09221-15f69b61-980c1c67-4364c219_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:49.403215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.403224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.403226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:49.403236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.403282Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:49.403301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:49.403431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:49.403441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:49.403456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:49.403538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 187 partition: 0 MaxSeqNo: 42 sessionId: src_id|73b09221-15f69b61-980c1c67-4364c219_0
2025-09-30T14:50:49.403933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6783dd99-11b9ef80-6da4e3bf-2e696978_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|73b09221-15f69b61-980c1c67-4364c219_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:49.412285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73b09221-15f69b61-980c1c67-4364c219_0] Write session: try to update token
2025-09-30T14:50:49.412307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73b09221-15f69b61-980c1c67-4364c219_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:49.415413Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:49.415428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:49.415439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894799071228275:3258]
2025-09-30T14:50:49.415484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:49.415497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:49.415820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:49.416139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:49.416474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:49.416792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:49.417088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:49.417131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:49.426603Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:49.426628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:49.426631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:49.426633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:49.426659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894799071228275:3258]
2025-09-30T14:50:49.426663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894799071228275:3258]
2025-09-30T14:50:49.426667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894799071228275:3258]
2025-09-30T14:50:49.426698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:49.426704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:49.426705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:49.426708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:49.426712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.426714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:49.427187Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:49.433123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 187 sessionId: src_id|73b09221-15f69b61-980c1c67-4364c219_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:49.435924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:49.473741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894799160952184:3106]
2025-09-30T14:50:49.474018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 186, pipe: [1:7555894799160952184:3106]
2025-09-30T14:50:49.540570Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:49.541158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:49.541171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:49.541188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894799160952184:3106], now have 1 active actors on pipe
2025-09-30T14:50:49.541371Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:49.541456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:49.541460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:49.541471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:49.541511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894799160952184:3106]
2025-09-30T14:50:49.541533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 187 reason: error at write: Disconnected sessionId: src_id|73b09221-15f69b61-980c1c67-4364c219_0
2025-09-30T14:50:49.541699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 187 sessionId: src_id|73b09221-15f69b61-980c1c67-4364c219_0 is DEAD
2025-09-30T14:50:49.541857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73b09221-15f69b61-980c1c67-4364c219_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:49.541869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73b09221-15f69b61-980c1c67-4364c219_0] Write session will restart in 0.009804s
2025-09-30T14:50:49.541904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73b09221-15f69b61-980c1c67-4364c219_0] Write session: Do CDS request
2025-09-30T14:50:49.541910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73b09221-15f69b61-980c1c67-4364c219_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:49.552779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73b09221-15f69b61-980c1c67-4364c219_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:49.552843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:49.552860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 188
2025-09-30T14:50:49.553016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 188 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:49.553064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 188 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:49.553071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=188 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:49.553076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:49.553577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 188 sessionId:  describe result for acl check
2025-09-30T14:50:49.553612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:49.553619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:49.553621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:49.553626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894799160952284:3611] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:49.554150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894799160952284:3611] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:49.556287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894799160952284:3611] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:49.558023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:49.559279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:49.559380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894799160952284:3611] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:49.559391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894799160952284:3611] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:49.559393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894799160952284:3611] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:49.559402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 188 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:49.559462Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:49.559471Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:49.559484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:49.559540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:49.559581Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894799071228524:3261]
2025-09-30T14:50:49.560172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:49.560435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:49.560480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:49.560800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:49.560865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:49.560870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:49.560871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:49.560872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:49.560873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:49.560874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:49.560875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:49.560876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:49.560877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:49.560878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:49.560879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.560880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.560881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.560881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:49.560882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:49.560886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:49.560895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:49.560899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:49.560902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:49.560905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:49.560908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:49.560912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:49.560915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:49.560918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:49.560921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:49.560925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.560928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.560932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.560935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:49.560939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:49.560946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:49.560952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:49.560957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:49.560962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:49.560965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:49.560970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:49.560973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:49.560978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:49.560982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:49.560987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:49.560991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:49.560996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:49.561001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:49.561005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:49.561009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:49.561014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:49.561018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:49.561022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:49.561027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:49.561032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:49.561038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.561042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.561045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.561049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.561053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.561057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.561061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:49.561065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:49.561069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:49.561073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:49.561111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:49.567008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:49.568187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:49.568202Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:49.568205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:49.568209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:49.568215Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 187 [2:7555894799071228524:3261]
2025-09-30T14:50:49.568232Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:49.568247Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:49.568250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.568253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.568255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.568270Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:49.568276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:49.568289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:49.568352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.568358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.568360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.568363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:49.568366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:49.568425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:49.568432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.568444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.568458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.568477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:49.568498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894799160952186:2454], now have 1 active actors on pipe
2025-09-30T14:50:49.568509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894799071228519:3261]
2025-09-30T14:50:49.568511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894799071228519:3261]
2025-09-30T14:50:49.568514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894799071228519:3261]
2025-09-30T14:50:49.568527Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:49.568536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894799160952424:3611], now have 1 active actors on pipe
2025-09-30T14:50:49.568545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:49.568548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:49.568549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:49.568551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:49.568561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:49.568564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:49.568587Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 187
2025-09-30T14:50:49.568600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 187
2025-09-30T14:50:49.568600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894799071228519:3261]
2025-09-30T14:50:49.568611Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:49.568626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:49.568646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:49.568652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:49.568678Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35d10c3b-8b12d580-1abd5067-cff7c1fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:49.568688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.568692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.568694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:49.568702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.568715Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:49.568731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:49.568894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:49.568911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:49.568936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:49.569027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 188 partition: 0 MaxSeqNo: 42 sessionId: src_id|35d10c3b-8b12d580-1abd5067-cff7c1fb_0
2025-09-30T14:50:49.569425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73b09221-15f69b61-980c1c67-4364c219_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|35d10c3b-8b12d580-1abd5067-cff7c1fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:49.572328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35d10c3b-8b12d580-1abd5067-cff7c1fb_0] Write session: try to update token
2025-09-30T14:50:49.572350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35d10c3b-8b12d580-1abd5067-cff7c1fb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:49.580765Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:49.580787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:49.580789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:49.580792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:49.580802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894799071228519:3261]
2025-09-30T14:50:49.580807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894799071228519:3261]
2025-09-30T14:50:49.580811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894799071228519:3261]
2025-09-30T14:50:49.580852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:49.580858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.580861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:49.580872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:49.580878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:49.580882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:49.581039Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:49.589702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 188 sessionId: src_id|35d10c3b-8b12d580-1abd5067-cff7c1fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:49.592673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:49.641673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894799160952436:3106]
2025-09-30T14:50:49.641971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 187, pipe: [1:7555894799160952436:3106]
2025-09-30T14:50:49.691200Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:49.691899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:49.691916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:49.691935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894799160952436:3106], now have 1 active actors on pipe
2025-09-30T14:50:49.692147Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:49.692224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:49.692241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:49.692242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894799160952436:3106]
2025-09-30T14:50:49.692260Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:49.692301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 188 reason: error at write: Disconnected sessionId: src_id|35d10c3b-8b12d580-1abd5067-cff7c1fb_0
2025-09-30T14:50:49.692498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 188 sessionId: src_id|35d10c3b-8b12d580-1abd5067-cff7c1fb_0 is DEAD
2025-09-30T14:50:49.692649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35d10c3b-8b12d580-1abd5067-cff7c1fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:49.692662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35d10c3b-8b12d580-1abd5067-cff7c1fb_0] Write session will restart in 0.007140s
2025-09-30T14:50:49.692684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35d10c3b-8b12d580-1abd5067-cff7c1fb_0] Write session: Do CDS request
2025-09-30T14:50:49.692692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35d10c3b-8b12d580-1abd5067-cff7c1fb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:49.700823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35d10c3b-8b12d580-1abd5067-cff7c1fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:49.700895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:49.700912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 189
2025-09-30T14:50:49.701059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 189 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:49.701091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 189 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:49.701101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=189 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:49.701105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:49.701533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 189 sessionId:  describe result for acl check
2025-09-30T14:50:49.701566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:49.701574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:49.701576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:49.701582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894799160952452:3615] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:49.702100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894799160952452:3615] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:49.704881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894799160952452:3615] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:49.708268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894799160952452:3615] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:49.708285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894799160952452:3615] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:49.708288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894799160952452:3615] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:49.708296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 189 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:49.710819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:49.712100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:49.712300Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:49.712314Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:49.712324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:49.712374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:49.712415Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894799071228779:3264]
2025-09-30T14:50:49.713067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:49.713400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:49.713445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:49.713791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:49.713850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:49.713856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:49.713858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:49.713859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:49.713860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:49.713861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:49.713863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:49.713864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:49.713865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:49.713866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:49.713867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.713868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.713869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.713870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:49.713872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:49.713877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:49.713888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:49.713892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:49.713896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:49.713901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:49.713905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:49.713910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:49.713913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:49.713918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:49.713923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:49.713927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.713931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.713935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.713940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:49.713944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:49.713951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:49.713960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:49.713971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:49.713976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:49.713986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:49.713992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:49.714000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:49.714006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:49.714015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:49.714021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:49.714030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:49.714036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:49.714045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:49.714051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:49.714060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:49.714065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:49.714076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:49.714082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:49.714091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:49.714096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:49.714105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.714111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.714116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.714126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.714131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.714141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.714146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:49.714151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:49.714160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:49.714166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:49.714217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:49.719706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:49.720571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:49.720586Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:49.720589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:49.720593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:49.720600Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 188 [2:7555894799071228779:3264]
2025-09-30T14:50:49.720616Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:49.720631Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:49.720640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.720644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.720647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.720661Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:49.720672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:49.720680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:49.720746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.720754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.720757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.720761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:49.720763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:49.720825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:49.720832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.720844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.720860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.720883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:49.720905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894799160952437:2454], now have 1 active actors on pipe
2025-09-30T14:50:49.720913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894799160952634:3615], now have 1 active actors on pipe
2025-09-30T14:50:49.720919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894799071228773:3264]
2025-09-30T14:50:49.720921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894799071228773:3264]
2025-09-30T14:50:49.720924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894799071228773:3264]
2025-09-30T14:50:49.720937Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:49.720954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:49.720972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:49.720969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 188
2025-09-30T14:50:49.720976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 188
2025-09-30T14:50:49.720976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:49.720980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:49.720981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:49.720982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:49.721011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894799071228773:3264]
2025-09-30T14:50:49.721014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:49.721016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:49.721042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:49.721046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:49.721079Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|281e3707-6f718471-e6c49a7b-31ed66f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:49.721085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.721089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.721091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:49.721102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.721111Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:49.721131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:49.721286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:49.721299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:49.721324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:49.721431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 189 partition: 0 MaxSeqNo: 42 sessionId: src_id|281e3707-6f718471-e6c49a7b-31ed66f8_0
2025-09-30T14:50:49.721843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35d10c3b-8b12d580-1abd5067-cff7c1fb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|281e3707-6f718471-e6c49a7b-31ed66f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:49.724483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|281e3707-6f718471-e6c49a7b-31ed66f8_0] Write session: try to update token
2025-09-30T14:50:49.724500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|281e3707-6f718471-e6c49a7b-31ed66f8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:49.733326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:49.733341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:49.733344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:49.733346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:49.733355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894799071228773:3264]
2025-09-30T14:50:49.733360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894799071228773:3264]
2025-09-30T14:50:49.733364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894799071228773:3264]
2025-09-30T14:50:49.733406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:49.733414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.733416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:49.733425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:49.733432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:49.733436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:49.733615Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:49.739443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 189 sessionId: src_id|281e3707-6f718471-e6c49a7b-31ed66f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:49.742379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:49.792201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894799160952699:3106]
2025-09-30T14:50:49.792484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 188, pipe: [1:7555894799160952699:3106]
2025-09-30T14:50:49.849582Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:49.850166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:49.850180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:49.850215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894799160952699:3106], now have 1 active actors on pipe
2025-09-30T14:50:49.851486Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:49.852294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:49.852348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894799160952699:3106]
2025-09-30T14:50:49.852366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:49.852506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 189 reason: status is not ok: tablet will be restarted right now sessionId: src_id|281e3707-6f718471-e6c49a7b-31ed66f8_0
2025-09-30T14:50:49.852683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 189 sessionId: src_id|281e3707-6f718471-e6c49a7b-31ed66f8_0 is DEAD
2025-09-30T14:50:49.855511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|281e3707-6f718471-e6c49a7b-31ed66f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:49.855525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|281e3707-6f718471-e6c49a7b-31ed66f8_0] Write session will restart in 0.005441s
2025-09-30T14:50:49.855548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|281e3707-6f718471-e6c49a7b-31ed66f8_0] Write session: Do CDS request
2025-09-30T14:50:49.855553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|281e3707-6f718471-e6c49a7b-31ed66f8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:49.861754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|281e3707-6f718471-e6c49a7b-31ed66f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:49.863463Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:49.863481Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 190
2025-09-30T14:50:49.863628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 190 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:49.863661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 190 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:49.863667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=190 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:49.863671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:49.864049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 190 sessionId:  describe result for acl check
2025-09-30T14:50:49.864077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:49.864081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:49.864082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:49.864087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894799160952709:3620] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:49.864541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894799160952709:3620] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:49.866690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894799160952709:3620] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:49.880508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894799160952709:3620] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:49.880528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894799160952709:3620] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:49.880531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894799160952709:3620] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:49.880540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 190 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:49.886464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:49.887942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:49.888185Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:49.888200Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:49.888228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:49.888300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:49.888376Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894799071229024:3266]
2025-09-30T14:50:49.889013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:49.889410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:49.889472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:49.889835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:49.889917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:49.889925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:49.889926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:49.889927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:49.889928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:49.889930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:49.889931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:49.889932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:49.889933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:49.889934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:49.889935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.889936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.889937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.889939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:49.889939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:49.889945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:49.889957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:49.889961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:49.889965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:49.889969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:49.889973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:49.889977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:49.889981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:49.889986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:49.889990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:49.889994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.889998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.890002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.890006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:49.890010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:49.890018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:49.890026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:49.890033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:49.890038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:49.890054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:49.890060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:49.890065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:49.890070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:49.890075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:49.890081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:49.890085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:49.890091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:49.890096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:49.890101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:49.890105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:49.890110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:49.890116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:49.890121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:49.890126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:49.890131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:49.890137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.890142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.890147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.890152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.890159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.890164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.890169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:49.890174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:49.890179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:49.890184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:49.890227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:49.897600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:49.898497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:49.898521Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:49.898524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:49.898528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:49.898535Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 189 [2:7555894799071229024:3266]
2025-09-30T14:50:49.898553Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:49.898570Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:49.898578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.898582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.898584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.898600Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:49.898612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:49.898620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:49.898704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.898713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.898715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.898719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:49.898722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:49.898794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:49.898801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.898814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:49.898831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:49.898853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:49.898872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894799160952811:3620], now have 1 active actors on pipe
2025-09-30T14:50:49.898880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894799160952701:2454], now have 1 active actors on pipe
2025-09-30T14:50:49.898887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894799071229019:3266]
2025-09-30T14:50:49.898895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894799071229019:3266]
2025-09-30T14:50:49.898897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894799071229019:3266]
2025-09-30T14:50:49.898912Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:49.898932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:49.898933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:49.898936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:49.898938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:49.898947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:49.898951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:49.898986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894799071229019:3266]
2025-09-30T14:50:49.898994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:49.898996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:49.898974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 189
2025-09-30T14:50:49.898978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 189
2025-09-30T14:50:49.899025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:49.899034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:49.899072Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e3765d5-6550112e-5b214a18-5f8e66c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:49.899083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.899087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.899089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:49.899098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.899112Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:49.899136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:49.899399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:49.899420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:49.899441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:49.899534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 190 partition: 0 MaxSeqNo: 42 sessionId: src_id|4e3765d5-6550112e-5b214a18-5f8e66c8_0
2025-09-30T14:50:49.899929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|281e3707-6f718471-e6c49a7b-31ed66f8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4e3765d5-6550112e-5b214a18-5f8e66c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:49.902779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e3765d5-6550112e-5b214a18-5f8e66c8_0] Write session: try to update token
2025-09-30T14:50:49.902795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e3765d5-6550112e-5b214a18-5f8e66c8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:49.917494Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:49.917511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:49.917513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:49.917515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:49.917523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894799071229019:3266]
2025-09-30T14:50:49.917526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894799071229019:3266]
2025-09-30T14:50:49.917528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894799071229019:3266]
2025-09-30T14:50:49.917562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:49.917570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:49.917573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:49.917579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:49.917586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:49.917590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:49.917701Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:49.920660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 190 sessionId: src_id|4e3765d5-6550112e-5b214a18-5f8e66c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:49.923493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:49.952366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894799160952957:3106]
2025-09-30T14:50:49.952650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 189, pipe: [1:7555894799160952957:3106]
2025-09-30T14:50:50.030949Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:50.031566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:50.031584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:50.031618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894799160952957:3106], now have 1 active actors on pipe
2025-09-30T14:50:50.031814Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:50.031860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894799160952957:3106]
2025-09-30T14:50:50.031878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:50.031971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:50.032051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 190 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4e3765d5-6550112e-5b214a18-5f8e66c8_0
2025-09-30T14:50:50.032312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 190 sessionId: src_id|4e3765d5-6550112e-5b214a18-5f8e66c8_0 is DEAD
2025-09-30T14:50:50.032524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e3765d5-6550112e-5b214a18-5f8e66c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:50.032540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e3765d5-6550112e-5b214a18-5f8e66c8_0] Write session will restart in 0.009950s
2025-09-30T14:50:50.032570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e3765d5-6550112e-5b214a18-5f8e66c8_0] Write session: Do CDS request
2025-09-30T14:50:50.032578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e3765d5-6550112e-5b214a18-5f8e66c8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:50.043957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e3765d5-6550112e-5b214a18-5f8e66c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:50.044005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:50.044030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 191
2025-09-30T14:50:50.044238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 191 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:50.044296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 191 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:50.044314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=191 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:50.044319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:50.044890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 191 sessionId:  describe result for acl check
2025-09-30T14:50:50.044927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:50.044932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:50.044934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:50.044940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894803455920321:3626] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:50.045454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894803455920321:3626] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:50.048234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894803455920321:3626] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:50.051012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894803455920321:3626] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:50.051027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894803455920321:3626] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:50.051031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894803455920321:3626] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:50.051039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 191 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:50.051712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:50.052916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:50.053093Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:50.053106Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:50.053116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:50.053163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:50.053202Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894803366196567:3269]
2025-09-30T14:50:50.053880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:50.054209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:50.054257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:50.054581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:50.054667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:50.054673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:50.054674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:50.054675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:50.054676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:50.054678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:50.054679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:50.054680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:50.054681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:50.054683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:50.054684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.054685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.054686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.054687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:50.054689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:50.054694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:50.054705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:50.054709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:50.054713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:50.054717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:50.054722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:50.054726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:50.054731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:50.054735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:50.054740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:50.054744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.054749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.054753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.054757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:50.054762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:50.054769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:50.054777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:50.054788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:50.054794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:50.054805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:50.054811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:50.054821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:50.054826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:50.054836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:50.054842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:50.054847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:50.054852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:50.054857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:50.054862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:50.054867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:50.054873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:50.054880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:50.054885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:50.054895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:50.054901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:50.054910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.054915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.054925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.054930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.054939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.054945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.054950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:50.054961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:50.054966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:50.054976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:50.055023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:50.060675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:50.061543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:50.061561Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:50.061564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:50.061568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:50.061575Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 190 [2:7555894803366196567:3269]
2025-09-30T14:50:50.061592Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:50.061607Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:50.061610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.061613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.061615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.061630Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:50.061638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:50.061650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:50.061720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.061728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.061731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.061734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:50.061737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:50.061805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:50.061813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.061826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.061842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.061865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:50.061888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894803455920260:2454], now have 1 active actors on pipe
2025-09-30T14:50:50.061900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894803366196562:3269]
2025-09-30T14:50:50.061902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894803366196562:3269]
2025-09-30T14:50:50.061905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894803366196562:3269]
2025-09-30T14:50:50.061916Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:50.061926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894803455920501:3626], now have 1 active actors on pipe
2025-09-30T14:50:50.061931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:50.061935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:50.061938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:50.061940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:50.061953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:50.061956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:50.061990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894803366196562:3269]
2025-09-30T14:50:50.062006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:50.061995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 190
2025-09-30T14:50:50.061999Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 190
2025-09-30T14:50:50.062031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:50.062046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:50.062051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:50.062075Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f4f76-3efe4c90-1a6febf4-29ec149d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:50.062082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.062085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.062088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:50.062097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.062112Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:50.062131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:50.062265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:50.062272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:50.062284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:50.062358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 191 partition: 0 MaxSeqNo: 42 sessionId: src_id|3f4f76-3efe4c90-1a6febf4-29ec149d_0
2025-09-30T14:50:50.062797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e3765d5-6550112e-5b214a18-5f8e66c8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3f4f76-3efe4c90-1a6febf4-29ec149d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:50.066236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f4f76-3efe4c90-1a6febf4-29ec149d_0] Write session: try to update token
2025-09-30T14:50:50.066264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f4f76-3efe4c90-1a6febf4-29ec149d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:50.074103Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:50.074122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:50.074129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:50.074138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:50.074152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894803366196562:3269]
2025-09-30T14:50:50.074160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894803366196562:3269]
2025-09-30T14:50:50.074170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894803366196562:3269]
2025-09-30T14:50:50.074216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:50.074231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.074238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:50.074261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:50.074277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:50.074284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:50.074585Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:50.091179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 191 sessionId: src_id|3f4f76-3efe4c90-1a6febf4-29ec149d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:50.093967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:50.132162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894803455920513:3106]
2025-09-30T14:50:50.132450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 190, pipe: [1:7555894803455920513:3106]
2025-09-30T14:50:50.183349Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:50.183858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:50.183871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:50.183888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894803455920513:3106], now have 1 active actors on pipe
2025-09-30T14:50:50.184206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894803455920513:3106]
2025-09-30T14:50:50.184241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:50.184243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:50.184249Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:50.184250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:50.184336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 191 reason: error at write: Disconnected sessionId: src_id|3f4f76-3efe4c90-1a6febf4-29ec149d_0
2025-09-30T14:50:50.184603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 191 sessionId: src_id|3f4f76-3efe4c90-1a6febf4-29ec149d_0 is DEAD
2025-09-30T14:50:50.184749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f4f76-3efe4c90-1a6febf4-29ec149d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:50.184762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f4f76-3efe4c90-1a6febf4-29ec149d_0] Write session will restart in 0.007369s
2025-09-30T14:50:50.184791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f4f76-3efe4c90-1a6febf4-29ec149d_0] Write session: Do CDS request
2025-09-30T14:50:50.184802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f4f76-3efe4c90-1a6febf4-29ec149d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:50.193877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f4f76-3efe4c90-1a6febf4-29ec149d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:50.194009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:50.194028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 192
2025-09-30T14:50:50.194160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 192 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:50.194191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 192 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:50.194198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=192 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:50.194203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:50.194771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 192 sessionId:  describe result for acl check
2025-09-30T14:50:50.194809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:50.194817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:50.194818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:50.194825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894803455920533:3630] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:50.195443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894803455920533:3630] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:50.198464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894803455920533:3630] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:50.201243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894803455920533:3630] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:50.201258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894803455920533:3630] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:50.201261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894803455920533:3630] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:50.201269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 192 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:50.204520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:50.205919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:50.206166Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:50.206178Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:50.206188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:50.206248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:50.206297Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894803366196812:3271]
2025-09-30T14:50:50.206960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:50.207297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:50.207370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:50.207670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:50.207712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:50.207717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:50.207718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:50.207718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:50.207719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:50.207720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:50.207720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:50.207721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:50.207721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:50.207722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:50.207723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.207724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.207724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.207725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:50.207725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:50.207730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:50.207737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:50.207740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:50.207742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:50.207744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:50.207747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:50.207749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:50.207751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:50.207754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:50.207757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:50.207759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.207762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.207764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.207766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:50.207768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:50.207775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:50.207780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:50.207784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:50.207788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:50.207790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:50.207793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:50.207796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:50.207799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:50.207801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:50.207804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:50.207807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:50.207810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:50.207812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:50.207815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:50.207817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:50.207820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:50.207822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:50.207825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:50.207828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:50.207830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:50.207833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.207836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.207838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.207841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.207844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.207846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.207849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:50.207852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:50.207856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:50.207861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:50.207901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:50.214374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:50.215568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:50.215583Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:50.215586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:50.215589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:50.215595Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 191 [2:7555894803366196812:3271]
2025-09-30T14:50:50.215614Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:50.215632Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:50.215640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.215643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.215646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.215662Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:50.215674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:50.215685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:50.215749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.215756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.215758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.215762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:50.215765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:50.215833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:50.215842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.215857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.215869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.215886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:50.215909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894803455920515:2454], now have 1 active actors on pipe
2025-09-30T14:50:50.215917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894803455920694:3630], now have 1 active actors on pipe
2025-09-30T14:50:50.215925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894803366196807:3271]
2025-09-30T14:50:50.215927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894803366196807:3271]
2025-09-30T14:50:50.215930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894803366196807:3271]
2025-09-30T14:50:50.215942Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:50.215959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:50.215960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:50.215964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:50.215967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:50.215977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:50.215981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:50.216024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894803366196807:3271]
2025-09-30T14:50:50.216032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:50.216013Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 191
2025-09-30T14:50:50.216021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 191
2025-09-30T14:50:50.216048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:50.216400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:50.216411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:50.216443Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87036c5f-1d6aee1f-ac4921c6-7c7a58fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:50.216453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.216457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.216459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:50.216470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.216484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:50.216504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:50.216664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:50.216670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:50.216683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:50.216779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 192 partition: 0 MaxSeqNo: 42 sessionId: src_id|87036c5f-1d6aee1f-ac4921c6-7c7a58fe_0
2025-09-30T14:50:50.217180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f4f76-3efe4c90-1a6febf4-29ec149d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|87036c5f-1d6aee1f-ac4921c6-7c7a58fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:50.222626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87036c5f-1d6aee1f-ac4921c6-7c7a58fe_0] Write session: try to update token
2025-09-30T14:50:50.222664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87036c5f-1d6aee1f-ac4921c6-7c7a58fe_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:50.229383Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:50.229405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:50.229409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:50.229411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:50.229422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894803366196807:3271]
2025-09-30T14:50:50.229428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894803366196807:3271]
2025-09-30T14:50:50.229433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894803366196807:3271]
2025-09-30T14:50:50.229477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:50.229479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:50.229485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:50.229488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.229489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:50.229490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:50.229749Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:50.240181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 192 sessionId: src_id|87036c5f-1d6aee1f-ac4921c6-7c7a58fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:50.242828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:50.284229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894803455920768:3106]
2025-09-30T14:50:50.284511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 191, pipe: [1:7555894803455920768:3106]
2025-09-30T14:50:50.342214Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:50.342534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:50.342549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:50.342568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894803455920768:3106], now have 1 active actors on pipe
2025-09-30T14:50:50.342862Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:50.342866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:50.342871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:50.342921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894803455920768:3106]
2025-09-30T14:50:50.342931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 192 reason: error at write: Disconnected sessionId: src_id|87036c5f-1d6aee1f-ac4921c6-7c7a58fe_0
2025-09-30T14:50:50.342829Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:50.343155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 192 sessionId: src_id|87036c5f-1d6aee1f-ac4921c6-7c7a58fe_0 is DEAD
2025-09-30T14:50:50.343360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87036c5f-1d6aee1f-ac4921c6-7c7a58fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:50.343370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87036c5f-1d6aee1f-ac4921c6-7c7a58fe_0] Write session will restart in 0.008118s
2025-09-30T14:50:50.343395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87036c5f-1d6aee1f-ac4921c6-7c7a58fe_0] Write session: Do CDS request
2025-09-30T14:50:50.343401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87036c5f-1d6aee1f-ac4921c6-7c7a58fe_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:50.352816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87036c5f-1d6aee1f-ac4921c6-7c7a58fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:50.352905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:50.352922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 193
2025-09-30T14:50:50.353080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 193 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:50.353112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 193 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:50.353121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=193 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:50.353126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:50.353671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 193 sessionId:  describe result for acl check
2025-09-30T14:50:50.353716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:50.353726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:50.353729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:50.353735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894803455920812:3634] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:50.354299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894803455920812:3634] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:50.356737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894803455920812:3634] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:50.359906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894803455920812:3634] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:50.359918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894803455920812:3634] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:50.359921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894803455920812:3634] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:50.359927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 193 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:50.360916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:50.362245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:50.362502Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:50.362511Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:50.362522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:50.362573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:50.362612Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894803366197060:3273]
2025-09-30T14:50:50.363294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:50.363603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:50.363646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:50.364090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:50.364166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:50.364172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:50.364173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:50.364174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:50.364175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:50.364176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:50.364177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:50.364178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:50.364179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:50.364181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:50.364182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.364183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.364184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.364185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:50.364186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:50.364192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:50.364202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:50.364206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:50.364211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:50.364215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:50.364222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:50.364226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:50.364229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:50.364233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:50.364238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:50.364242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.364246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.364250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.364253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:50.364257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:50.364269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:50.364277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:50.364283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:50.364289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:50.364293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:50.364299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:50.364303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:50.364308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:50.364313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:50.364319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:50.364328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:50.364333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:50.364338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:50.364348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:50.364352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:50.364361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:50.364366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:50.364375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:50.364379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:50.364385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:50.364394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.364403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.364407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.364412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.364421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.364425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.364429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:50.364434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:50.364442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:50.364447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:50.364491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:50.370101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:50.371266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:50.371278Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:50.371281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:50.371284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:50.371290Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 192 [2:7555894803366197060:3273]
2025-09-30T14:50:50.371307Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:50.371321Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:50.371328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.371330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.371332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.371344Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:50.371351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:50.371357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:50.371416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.371423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.371424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.371428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:50.371430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:50.371498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:50.371504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.371516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.371527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.371544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:50.371566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894803366197054:3273]
2025-09-30T14:50:50.371569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894803366197054:3273]
2025-09-30T14:50:50.371571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894803366197054:3273]
2025-09-30T14:50:50.371578Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:50.371588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:50.371590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894803455921010:3634], now have 1 active actors on pipe
2025-09-30T14:50:50.371594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894803455920770:2454], now have 1 active actors on pipe
2025-09-30T14:50:50.371598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:50.371601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:50.371601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:50.371615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:50.371618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:50.371649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894803366197054:3273]
2025-09-30T14:50:50.371661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:50.371667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:50.371670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 192
2025-09-30T14:50:50.371712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:50.371722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:50.371723Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 192
2025-09-30T14:50:50.371742Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc88b78-2da9b7ec-b6a61a3-15cb8a44_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:50.371756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.371759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.371761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:50.371769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.371777Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:50.371793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:50.371904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:50.371911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:50.371922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:50.372001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 193 partition: 0 MaxSeqNo: 42 sessionId: src_id|dc88b78-2da9b7ec-b6a61a3-15cb8a44_0
2025-09-30T14:50:50.372345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87036c5f-1d6aee1f-ac4921c6-7c7a58fe_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dc88b78-2da9b7ec-b6a61a3-15cb8a44_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:50.375190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc88b78-2da9b7ec-b6a61a3-15cb8a44_0] Write session: try to update token
2025-09-30T14:50:50.375209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc88b78-2da9b7ec-b6a61a3-15cb8a44_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:50.383489Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:50.383508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:50.383516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894803366197054:3273]
2025-09-30T14:50:50.383564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:50.383569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:50.383829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:50.384051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:50.384268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:50.384453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:50.384716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:50.384769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:50.390062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 193 sessionId: src_id|dc88b78-2da9b7ec-b6a61a3-15cb8a44_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:50.392726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:50.392874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:50.392894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:50.392925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:50.392978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:50.394615Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:50.394628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:50.394630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:50.394631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:50.394655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894803366197054:3273]
2025-09-30T14:50:50.394659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894803366197054:3273]
2025-09-30T14:50:50.394662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894803366197054:3273]
2025-09-30T14:50:50.394696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:50.394701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.394703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:50.394707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:50.394713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:50.394718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:50.394860Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:50.442975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894803455921048:3106]
2025-09-30T14:50:50.443303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 192, pipe: [1:7555894803455921048:3106]
2025-09-30T14:50:50.506248Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:50.513388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:50.513416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:50.513590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:50.513660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:50.513724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:50.513786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:50.514136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:50.514148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:50.514218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:50.514276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:50.514350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:50.514422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:50.514464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:50.514471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:50.514570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:50.514672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:50.514740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:50.514846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:50.514975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:50.514982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:50.515061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:50.515165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:50.515289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:50.515390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:50.515525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:50.515534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:50.515617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:50.515700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:50.515813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:50.515876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:50.515986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:50.515995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:50.516093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:50.516186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:50.516290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:50.516393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:50.516544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:50.516554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:50.516663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:50.516728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:50.516813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:50.516878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:50.516927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:50.516940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:50.517008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:50.517071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:50.517135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:50.517204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:50.517341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:50.517350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:50.517419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:50.517480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:50.517541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:50.517647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:50.517698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:50.517705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:50.517770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:50.517833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:50.517939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:50.518004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:50.518052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:50.518060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:50.518134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894803455921048:3106], now have 1 active actors on pipe
2025-09-30T14:50:50.518425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:50.518440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:50.518470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 193 reason: error at write: Disconnected sessionId: src_id|dc88b78-2da9b7ec-b6a61a3-15cb8a44_0
2025-09-30T14:50:50.518596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894803455921048:3106]
2025-09-30T14:50:50.518595Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:50.518629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:50.518671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 193 sessionId: src_id|dc88b78-2da9b7ec-b6a61a3-15cb8a44_0 is DEAD
2025-09-30T14:50:50.518810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc88b78-2da9b7ec-b6a61a3-15cb8a44_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:50.518820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc88b78-2da9b7ec-b6a61a3-15cb8a44_0] Write session will restart in 0.007245s
2025-09-30T14:50:50.518841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc88b78-2da9b7ec-b6a61a3-15cb8a44_0] Write session: Do CDS request
2025-09-30T14:50:50.518845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc88b78-2da9b7ec-b6a61a3-15cb8a44_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:50.526808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc88b78-2da9b7ec-b6a61a3-15cb8a44_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:50.526906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:50.526924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 194
2025-09-30T14:50:50.527067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 194 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:50.527097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 194 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:50.527109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=194 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:50.527113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:50.527618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 194 sessionId:  describe result for acl check
2025-09-30T14:50:50.527660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:50.527667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:50.527669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:50.527674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894803455921066:3646] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:50.528622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894803455921066:3646] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:50.531450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894803455921066:3646] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:50.534765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894803455921066:3646] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:50.534780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894803455921066:3646] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:50.534783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894803455921066:3646] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:50.534792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 194 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:50.536524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:50.537765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:50.538043Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:50.538052Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:50.538062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:50.538117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:50.538152Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894803366197344:3288]
2025-09-30T14:50:50.538600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:50.538860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:50.538906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:50.539178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:50.539228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:50.539234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:50.539235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:50.539236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:50.539237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:50.539238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:50.539240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:50.539255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:50.539257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:50.539258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:50.539259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.539260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.539262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.539263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:50.539264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:50.539269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:50.539280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:50.539284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:50.539288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:50.539292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:50.539297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:50.539301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:50.539305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:50.539309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:50.539313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:50.539317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.539321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.539325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.539329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:50.539333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:50.539341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:50.539349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:50.539359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:50.539365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:50.539374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:50.539379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:50.539388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:50.539393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:50.539403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:50.539409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:50.539417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:50.539422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:50.539427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:50.539432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:50.539437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:50.539442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:50.539451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:50.539456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:50.539462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:50.539471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:50.539476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.539481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.539490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.539496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.539505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.539510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.539514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:50.539519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:50.539524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:50.539529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:50.539576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:50.544948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:50.545788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:50.545805Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:50.545808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:50.545812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:50.545819Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 193 [2:7555894803366197344:3288]
2025-09-30T14:50:50.545834Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:50.545849Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:50.545857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.545860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.545863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.545879Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:50.545891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:50.545903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:50.545978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.545985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.545988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.545991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:50.545994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:50.546175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 193
2025-09-30T14:50:50.546185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 193
2025-09-30T14:50:50.546378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:50.546387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.546400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.546417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.546441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:50.546466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894803455921050:2454], now have 1 active actors on pipe
2025-09-30T14:50:50.546474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894803455921276:3646], now have 1 active actors on pipe
2025-09-30T14:50:50.546489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:50.546497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:50.546516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894803366197339:3288]
2025-09-30T14:50:50.546525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894803366197339:3288]
2025-09-30T14:50:50.546527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894803366197339:3288]
2025-09-30T14:50:50.546538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:50.546553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:50.546552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:50.546554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:50.546556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:50.546566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:50.546568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:50.546588Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1987ef6e-1eca2950-adce9b44-54de8c99_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:50.546600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.546609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.546611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:50.546620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.546644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:50.546686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894803366197339:3288]
2025-09-30T14:50:50.546699Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:50.546703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:50.546713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:50.546846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:50.546856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:50.546871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:50.546953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 194 partition: 0 MaxSeqNo: 42 sessionId: src_id|1987ef6e-1eca2950-adce9b44-54de8c99_0
2025-09-30T14:50:50.547337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc88b78-2da9b7ec-b6a61a3-15cb8a44_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1987ef6e-1eca2950-adce9b44-54de8c99_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:50.550125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1987ef6e-1eca2950-adce9b44-54de8c99_0] Write session: try to update token
2025-09-30T14:50:50.550144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1987ef6e-1eca2950-adce9b44-54de8c99_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:50.558897Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:50.558921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:50.558925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:50.558929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:50.558944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894803366197339:3288]
2025-09-30T14:50:50.558950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894803366197339:3288]
2025-09-30T14:50:50.558995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894803366197339:3288]
2025-09-30T14:50:50.559046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:50.559054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:50.559056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.559060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:50.559060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:50.559062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:50.559201Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:50.568788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 194 sessionId: src_id|1987ef6e-1eca2950-adce9b44-54de8c99_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:50.571675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:50.618564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894803455921306:3106]
2025-09-30T14:50:50.618881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 193, pipe: [1:7555894803455921306:3106]
2025-09-30T14:50:50.671496Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:50.671969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:50.671982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:50.671997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894803455921306:3106], now have 1 active actors on pipe
2025-09-30T14:50:50.672242Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:50.672284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:50.672299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:50.672304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:50.672356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894803455921306:3106]
2025-09-30T14:50:50.672359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 194 reason: error at write: Disconnected sessionId: src_id|1987ef6e-1eca2950-adce9b44-54de8c99_0
2025-09-30T14:50:50.672567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 194 sessionId: src_id|1987ef6e-1eca2950-adce9b44-54de8c99_0 is DEAD
2025-09-30T14:50:50.672750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1987ef6e-1eca2950-adce9b44-54de8c99_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:50.672765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1987ef6e-1eca2950-adce9b44-54de8c99_0] Write session will restart in 0.005488s
2025-09-30T14:50:50.672790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1987ef6e-1eca2950-adce9b44-54de8c99_0] Write session: Do CDS request
2025-09-30T14:50:50.672796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1987ef6e-1eca2950-adce9b44-54de8c99_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:50.679762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1987ef6e-1eca2950-adce9b44-54de8c99_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:50.679870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:50.679886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 195
2025-09-30T14:50:50.680080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 195 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:50.680140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 195 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:50.680152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=195 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:50.680157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:50.680668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 195 sessionId:  describe result for acl check
2025-09-30T14:50:50.680721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:50.680728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:50.680732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:50.680738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894803455921322:3650] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:50.681401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894803455921322:3650] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:50.683503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894803455921322:3650] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:50.687583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894803455921322:3650] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:50.687611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894803455921322:3650] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:50.687615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894803455921322:3650] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:50.687624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 195 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:50.692346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:50.693835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:50.694042Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:50.694053Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:50.694063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:50.694118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:50.694160Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894803366197595:3290]
2025-09-30T14:50:50.694833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:50.695104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:50.695149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:50.695447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:50.695501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:50.695506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:50.695507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:50.695508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:50.695509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:50.695509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:50.695510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:50.695511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:50.695512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:50.695512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:50.695513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.695514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.695514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.695515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:50.695516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:50.695519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:50.695525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:50.695528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:50.695530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:50.695534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:50.695538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:50.695542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:50.695546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:50.695549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:50.695554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:50.695558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.695562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.695566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.695570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:50.695573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:50.695578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:50.695582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:50.695586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:50.695593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:50.695596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:50.695598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:50.695601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:50.695604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:50.695606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:50.695609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:50.695611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:50.695614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:50.695616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:50.695619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:50.695623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:50.695625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:50.695628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:50.695631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:50.695633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:50.695636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:50.695638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.695641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.695643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.695646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.695648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.695651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.695653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:50.695656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:50.695659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:50.695662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:50.695685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:50.702466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:50.703773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:50.703791Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:50.703793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:50.703798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:50.703803Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 194 [2:7555894803366197595:3290]
2025-09-30T14:50:50.703823Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:50.703838Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:50.703842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.703845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.703848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.703863Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:50.703877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:50.703884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:50.703944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.703951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.703954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.703957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:50.703960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:50.704026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:50.704033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.704048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.704064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.704085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:50.704109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894803455921445:3650], now have 1 active actors on pipe
2025-09-30T14:50:50.704117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894803455921308:2454], now have 1 active actors on pipe
2025-09-30T14:50:50.704123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894803366197587:3290]
2025-09-30T14:50:50.704126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894803366197587:3290]
2025-09-30T14:50:50.704128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894803366197587:3290]
2025-09-30T14:50:50.704141Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:50.704161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:50.704162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:50.704165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:50.704167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:50.704180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:50.704183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:50.704215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894803366197587:3290]
2025-09-30T14:50:50.704222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:50.704193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 194
2025-09-30T14:50:50.704219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 194
2025-09-30T14:50:50.704235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:50.704238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:50.704242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:50.704293Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|994e3476-e85fc863-3af1c961-50c99311_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:50.704305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.704309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.704311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:50.704320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.704329Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:50.704348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:50.704508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:50.704518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:50.704532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:50.704604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 195 partition: 0 MaxSeqNo: 42 sessionId: src_id|994e3476-e85fc863-3af1c961-50c99311_0
2025-09-30T14:50:50.704968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1987ef6e-1eca2950-adce9b44-54de8c99_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|994e3476-e85fc863-3af1c961-50c99311_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:50.707708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|994e3476-e85fc863-3af1c961-50c99311_0] Write session: try to update token
2025-09-30T14:50:50.707732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|994e3476-e85fc863-3af1c961-50c99311_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:50.720706Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:50.720728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:50.720731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:50.720734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:50.720743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894803366197587:3290]
2025-09-30T14:50:50.720748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894803366197587:3290]
2025-09-30T14:50:50.720752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894803366197587:3290]
2025-09-30T14:50:50.720796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:50.720802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.720806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:50.720813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:50.720820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:50.720824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:50.720952Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:50.722812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 195 sessionId: src_id|994e3476-e85fc863-3af1c961-50c99311_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:50.725527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:50.772155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894803455921576:3106]
2025-09-30T14:50:50.772392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 194, pipe: [1:7555894803455921576:3106]
2025-09-30T14:50:50.827609Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:50.827896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:50.827912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:50.827953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894803455921576:3106], now have 1 active actors on pipe
2025-09-30T14:50:50.828134Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:50.828207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894803455921576:3106]
2025-09-30T14:50:50.828221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:50.828226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:50.828249Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:50.828291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 195 reason: error at write: Disconnected sessionId: src_id|994e3476-e85fc863-3af1c961-50c99311_0
2025-09-30T14:50:50.828471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 195 sessionId: src_id|994e3476-e85fc863-3af1c961-50c99311_0 is DEAD
2025-09-30T14:50:50.828609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|994e3476-e85fc863-3af1c961-50c99311_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:50.828621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|994e3476-e85fc863-3af1c961-50c99311_0] Write session will restart in 0.007668s
2025-09-30T14:50:50.828652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|994e3476-e85fc863-3af1c961-50c99311_0] Write session: Do CDS request
2025-09-30T14:50:50.828661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|994e3476-e85fc863-3af1c961-50c99311_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:50.837829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|994e3476-e85fc863-3af1c961-50c99311_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:50.837922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:50.837939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 196
2025-09-30T14:50:50.838124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 196 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:50.838159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 196 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:50.838169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=196 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:50.838173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:50.838693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 196 sessionId:  describe result for acl check
2025-09-30T14:50:50.838729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:50.838737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:50.838739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:50.838745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894803455921631:3655] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:50.839301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894803455921631:3655] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:50.841488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894803455921631:3655] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:50.844725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894803455921631:3655] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:50.844741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894803455921631:3655] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:50.844747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894803455921631:3655] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:50.844755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 196 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:50.845737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:50.847124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:50.847365Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:50.847374Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:50.847386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:50.847440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:50.847476Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894803366197853:3293]
2025-09-30T14:50:50.848068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:50.848340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:50.848380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:50.848683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:50.848744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:50.848752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:50.848753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:50.848755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:50.848756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:50.848757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:50.848758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:50.848760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:50.848761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:50.848762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:50.848763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.848764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.848765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.848767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:50.848768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:50.848773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:50.848783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:50.848788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:50.848792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:50.848797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:50.848801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:50.848805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:50.848809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:50.848813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:50.848817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:50.848821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.848825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.848829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.848833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:50.848837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:50.848844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:50.848852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:50.848859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:50.848865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:50.848870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:50.848875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:50.848880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:50.848885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:50.848890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:50.848895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:50.848899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:50.848905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:50.848909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:50.848915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:50.848919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:50.848925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:50.848930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:50.848935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:50.848944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:50.848949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:50.848954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.848959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.848963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.848968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.848972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.848977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.848982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:50.848988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:50.848995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:50.849005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:50.849048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:50.855921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:50.856932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:50.856949Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:50.856953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:50.856957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:50.856964Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 195 [2:7555894803366197853:3293]
2025-09-30T14:50:50.856982Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:50.857000Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:50.857003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.857006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.857009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.857025Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:50.857033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:50.857047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:50.857105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.857116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.857118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.857120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:50.857122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:50.857183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:50.857185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.857193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:50.857200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:50.857209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:50.857221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894803366197848:3293]
2025-09-30T14:50:50.857228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894803366197848:3293]
2025-09-30T14:50:50.857229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894803366197848:3293]
2025-09-30T14:50:50.857236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:50.857246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:50.857249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:50.857253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:50.857255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:50.857260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:50.857262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:50.857270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894803455921578:2454], now have 1 active actors on pipe
2025-09-30T14:50:50.857273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894803455921821:3655], now have 1 active actors on pipe
2025-09-30T14:50:50.857306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894803366197848:3293]
2025-09-30T14:50:50.857319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:50.857329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:50.857349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 195
2025-09-30T14:50:50.857383Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 195
2025-09-30T14:50:50.857392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:50.857402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:50.857432Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26b03cf6-219ec22e-a4f175dc-6fe3bac7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:50.857443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.857446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.857447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:50.857456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.857471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:50.857491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:50.857618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:50.857623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:50.857633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:50.857723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 196 partition: 0 MaxSeqNo: 42 sessionId: src_id|26b03cf6-219ec22e-a4f175dc-6fe3bac7_0
2025-09-30T14:50:50.858143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|994e3476-e85fc863-3af1c961-50c99311_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|26b03cf6-219ec22e-a4f175dc-6fe3bac7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:50.860965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26b03cf6-219ec22e-a4f175dc-6fe3bac7_0] Write session: try to update token
2025-09-30T14:50:50.860984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26b03cf6-219ec22e-a4f175dc-6fe3bac7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:50.876918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 196 sessionId: src_id|26b03cf6-219ec22e-a4f175dc-6fe3bac7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:50.877430Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:50.877448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:50.877457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894803366197848:3293]
2025-09-30T14:50:50.877506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:50.877509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:50.877699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:50.877861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:50.878045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:50.878190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:50.878386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:50.878431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:50.879867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:50.880062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:50.880080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:50.880112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:50.880181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:50.884494Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:50.884510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:50.884512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:50.884514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:50.884524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894803366197848:3293]
2025-09-30T14:50:50.884528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894803366197848:3293]
2025-09-30T14:50:50.884533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894803366197848:3293]
2025-09-30T14:50:50.884571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:50.884582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:50.884589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:50.884599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:50.884615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:50.884619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:50.884724Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:50.928314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894803455921836:3106]
2025-09-30T14:50:50.928555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 195, pipe: [1:7555894803455921836:3106]
2025-09-30T14:50:51.001283Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:51.019908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:51.019938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:51.020103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:51.020164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:51.020233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:51.020299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:51.020740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:51.020756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:51.020831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:51.020896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:51.020965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:51.021039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:51.021085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:51.021093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:51.021168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:51.021232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:51.021299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:51.021408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:51.021451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:51.021459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:51.021531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:51.021602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:51.021668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:51.021740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:51.021784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:51.021791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:51.021885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:51.021947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:51.022012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:51.022083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:51.022144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:51.022154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:51.022221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:51.022286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:51.022350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:51.022416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:51.022481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:51.022493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:51.022595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:51.022706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:51.022793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:51.022871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:51.022939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:51.022947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:51.023016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:51.023077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:51.023148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:51.023216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:51.023303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:51.023314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:51.023385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:51.023449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:51.023558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:51.023624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:51.023689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:51.023698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:51.023766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:51.023830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:51.023899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:51.023971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:51.024113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:51.024121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:51.024198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894803455921836:3106], now have 1 active actors on pipe
2025-09-30T14:50:51.024443Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:51.024490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:51.024493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:51.024515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894803455921836:3106]
2025-09-30T14:50:51.024521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 196 reason: error at write: Disconnected sessionId: src_id|26b03cf6-219ec22e-a4f175dc-6fe3bac7_0
2025-09-30T14:50:51.024772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 196 sessionId: src_id|26b03cf6-219ec22e-a4f175dc-6fe3bac7_0 is DEAD
2025-09-30T14:50:51.024885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26b03cf6-219ec22e-a4f175dc-6fe3bac7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:51.024894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26b03cf6-219ec22e-a4f175dc-6fe3bac7_0] Write session will restart in 0.007625s
2025-09-30T14:50:51.024917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26b03cf6-219ec22e-a4f175dc-6fe3bac7_0] Write session: Do CDS request
2025-09-30T14:50:51.024922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26b03cf6-219ec22e-a4f175dc-6fe3bac7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:51.024849Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:51.034092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26b03cf6-219ec22e-a4f175dc-6fe3bac7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:51.034186Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:51.034211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 197
2025-09-30T14:50:51.035227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 197 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:51.035281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 197 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:51.035286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=197 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:51.035290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:51.035778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 197 sessionId:  describe result for acl check
2025-09-30T14:50:51.035811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:51.035818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:51.035819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:51.035825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894807750889187:3661] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:51.036435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894807750889187:3661] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:51.039817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894807750889187:3661] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:51.043065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894807750889187:3661] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:51.043081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894807750889187:3661] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:51.043085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894807750889187:3661] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:51.043092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 197 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:51.044635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:51.046113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:51.046343Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:51.046355Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:51.046365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:51.046423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:51.046471Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894807661165402:3296]
2025-09-30T14:50:51.047126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:51.047494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:51.047540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:51.047875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:51.047932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:51.047940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:51.047941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:51.047943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:51.047944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:51.047945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:51.047947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:51.047948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:51.047949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:51.047950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:51.047952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.047953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.047954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.047955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:51.047956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:51.047962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:51.047972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:51.047976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:51.047981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:51.047985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:51.047990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:51.047995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:51.047999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:51.048003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:51.048008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:51.048012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.048017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.048021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.048026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:51.048030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:51.048037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:51.048045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:51.048051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:51.048057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:51.048062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:51.048067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:51.048072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:51.048078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:51.048083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:51.048088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:51.048093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:51.048099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:51.048104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:51.048110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:51.048114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:51.048120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:51.048127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:51.048132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:51.048144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:51.048150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:51.048155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.048165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.048170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.048175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.048184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.048190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.048198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:51.048203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:51.048208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:51.048219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:51.048273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:51.055172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:51.056234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:51.056257Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:51.056260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:51.056264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:51.056273Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 196 [2:7555894807661165402:3296]
2025-09-30T14:50:51.056289Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:51.056305Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:51.056308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.056311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.056314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.056331Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:51.056339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:51.056347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:51.056408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.056417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.056419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.056423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:51.056425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:51.056497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:51.056505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.056518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.056530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.056546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:51.056564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894807750889148:2454], now have 1 active actors on pipe
2025-09-30T14:50:51.056568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894807750889394:3661], now have 1 active actors on pipe
2025-09-30T14:50:51.056575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894807661165397:3296]
2025-09-30T14:50:51.056577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894807661165397:3296]
2025-09-30T14:50:51.056579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894807661165397:3296]
2025-09-30T14:50:51.056592Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:51.056607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:51.056608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:51.056612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:51.056614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:51.056626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:51.056629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:51.056667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894807661165397:3296]
2025-09-30T14:50:51.056676Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:51.056678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:51.056643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 196
2025-09-30T14:50:51.056646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 196
2025-09-30T14:50:51.056707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:51.056715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:51.056749Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d9416d0-f9d2d244-1964e4d8-a6678071_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:51.056761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.056766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.056772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:51.056784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.056797Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:51.056817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:51.056967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:51.056975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:51.056988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:51.057092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 197 partition: 0 MaxSeqNo: 42 sessionId: src_id|6d9416d0-f9d2d244-1964e4d8-a6678071_0
2025-09-30T14:50:51.057537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26b03cf6-219ec22e-a4f175dc-6fe3bac7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6d9416d0-f9d2d244-1964e4d8-a6678071_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:51.068563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d9416d0-f9d2d244-1964e4d8-a6678071_0] Write session: try to update token
2025-09-30T14:50:51.068587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d9416d0-f9d2d244-1964e4d8-a6678071_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:51.073224Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:51.073244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:51.073247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:51.073249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:51.073258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894807661165397:3296]
2025-09-30T14:50:51.073263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894807661165397:3296]
2025-09-30T14:50:51.073267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894807661165397:3296]
2025-09-30T14:50:51.073307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:51.073314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.073319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:51.073321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:51.073327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:51.073330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:51.073464Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:51.083970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 197 sessionId: src_id|6d9416d0-f9d2d244-1964e4d8-a6678071_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:51.088816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:51.124925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894807750889409:3106]
2025-09-30T14:50:51.125201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 196, pipe: [1:7555894807750889409:3106]
2025-09-30T14:50:51.183949Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:51.184344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:51.184357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:51.184375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894807750889409:3106], now have 1 active actors on pipe
2025-09-30T14:50:51.184630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:51.184641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:51.184641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:51.184682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894807750889409:3106]
2025-09-30T14:50:51.184696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 197 reason: error at write: Disconnected sessionId: src_id|6d9416d0-f9d2d244-1964e4d8-a6678071_0
2025-09-30T14:50:51.184699Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:51.184905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 197 sessionId: src_id|6d9416d0-f9d2d244-1964e4d8-a6678071_0 is DEAD
2025-09-30T14:50:51.185060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d9416d0-f9d2d244-1964e4d8-a6678071_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:51.185073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d9416d0-f9d2d244-1964e4d8-a6678071_0] Write session will restart in 0.006667s
2025-09-30T14:50:51.185096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d9416d0-f9d2d244-1964e4d8-a6678071_0] Write session: Do CDS request
2025-09-30T14:50:51.185102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d9416d0-f9d2d244-1964e4d8-a6678071_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:51.192777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d9416d0-f9d2d244-1964e4d8-a6678071_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:51.192878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:51.192895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 198
2025-09-30T14:50:51.193030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 198 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:51.193063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 198 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:51.193074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=198 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:51.193078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:51.193540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 198 sessionId:  describe result for acl check
2025-09-30T14:50:51.193658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:51.193668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:51.193670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:51.193677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894807750889426:3665] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:51.194234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894807750889426:3665] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:51.197345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894807750889426:3665] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:51.200800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894807750889426:3665] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:51.200815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894807750889426:3665] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:51.200819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894807750889426:3665] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:51.200827Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 198 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:51.203142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:51.204680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:51.204850Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:51.204858Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:51.204865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:51.204902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:51.204941Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894807661165653:3298]
2025-09-30T14:50:51.205372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:51.205626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:51.205657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:51.205871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:51.205912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:51.205916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:51.205917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:51.205918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:51.205918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:51.205919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:51.205920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:51.205920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:51.205921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:51.205922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:51.205922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.205923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.205924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.205924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:51.205925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:51.205928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:51.205935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:51.205938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:51.205941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:51.205943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:51.205945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:51.205947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:51.205950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:51.205952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:51.205955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:51.205957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.205960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.205962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.205964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:51.205966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:51.205971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:51.205976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:51.205979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:51.205983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:51.205985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:51.205989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:51.205992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:51.206008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:51.206012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:51.206017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:51.206021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:51.206024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:51.206026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:51.206029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:51.206032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:51.206034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:51.206036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:51.206039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:51.206041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:51.206044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:51.206046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.206049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.206051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.206059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.206061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.206064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.206066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:51.206069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:51.206072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:51.206078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:51.206101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:51.213161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:51.214325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:51.214343Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:51.214345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:51.214349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:51.214355Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 197 [2:7555894807661165653:3298]
2025-09-30T14:50:51.214371Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:51.214386Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:51.214389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.214392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.214394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.214408Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:51.214417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:51.214424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:51.214476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.214484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.214488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.214492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:51.214494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:51.214560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:51.214567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.214579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.214596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.214617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:51.214652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894807750889625:3665], now have 1 active actors on pipe
2025-09-30T14:50:51.214660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894807750889411:2454], now have 1 active actors on pipe
2025-09-30T14:50:51.214666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894807661165648:3298]
2025-09-30T14:50:51.214669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894807661165648:3298]
2025-09-30T14:50:51.214671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894807661165648:3298]
2025-09-30T14:50:51.214682Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:51.214697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:51.214699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:51.214708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:51.214710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:51.214714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:51.214717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:51.214750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894807661165648:3298]
2025-09-30T14:50:51.214761Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:51.214767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:51.214770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 197
2025-09-30T14:50:51.214813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:51.214781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 197
2025-09-30T14:50:51.214822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:51.214849Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69927406-bd0aca1c-b35d6d67-4409e700_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:51.214862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.214866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.214868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:51.214879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.214887Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:51.214904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:51.215057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:51.215065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:51.215078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:51.215177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 198 partition: 0 MaxSeqNo: 42 sessionId: src_id|69927406-bd0aca1c-b35d6d67-4409e700_0
2025-09-30T14:50:51.215578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d9416d0-f9d2d244-1964e4d8-a6678071_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|69927406-bd0aca1c-b35d6d67-4409e700_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:51.218320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69927406-bd0aca1c-b35d6d67-4409e700_0] Write session: try to update token
2025-09-30T14:50:51.218341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69927406-bd0aca1c-b35d6d67-4409e700_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:51.229112Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:51.229130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:51.229138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894807661165648:3298]
2025-09-30T14:50:51.229174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:51.229179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:51.229327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:51.229460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:51.229585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:51.229714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:51.229891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:51.229926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:51.232939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 198 sessionId: src_id|69927406-bd0aca1c-b35d6d67-4409e700_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:51.236090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:51.236293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:51.236314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:51.236350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:51.236431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:51.244962Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:51.244979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:51.244981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:51.244984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:51.244994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894807661165648:3298]
2025-09-30T14:50:51.244999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894807661165648:3298]
2025-09-30T14:50:51.245003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894807661165648:3298]
2025-09-30T14:50:51.245042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:51.245049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.245053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:51.245064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:51.245082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:51.245086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:51.245187Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:51.284671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894807750889670:3106]
2025-09-30T14:50:51.284901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 197, pipe: [1:7555894807750889670:3106]
2025-09-30T14:50:51.350923Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:51.358438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:51.358463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:51.358630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:51.358707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:51.358778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:51.358849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:51.358899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:51.358909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:51.358977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:51.359037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:51.359099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:51.359161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:51.359202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:51.359208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:51.359303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:51.359361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:51.359422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:51.359487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:51.359534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:51.359542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:51.359611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:51.359677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:51.359742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:51.359801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:51.359840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:51.359852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:51.359926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:51.360091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:51.360154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:51.360214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:51.360259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:51.360266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:51.360335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:51.360394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:51.360459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:51.360523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:51.360568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:51.360574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:51.360641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:51.360702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:51.360813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:51.360914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:51.360963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:51.360971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:51.361080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:51.361135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:51.361202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:51.361268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:51.361313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:51.361324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:51.361391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:51.361445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:51.361514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:51.361581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:51.361715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:51.361722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:51.361784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:51.361841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:51.361913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:51.361974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:51.362015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:51.362026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:51.362081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894807750889670:3106], now have 1 active actors on pipe
2025-09-30T14:50:51.362309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:51.362320Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:51.362324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:51.362353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 198 reason: error at write: Disconnected sessionId: src_id|69927406-bd0aca1c-b35d6d67-4409e700_0
2025-09-30T14:50:51.362372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894807750889670:3106]
2025-09-30T14:50:51.362576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 198 sessionId: src_id|69927406-bd0aca1c-b35d6d67-4409e700_0 is DEAD
2025-09-30T14:50:51.362744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69927406-bd0aca1c-b35d6d67-4409e700_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:51.362755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69927406-bd0aca1c-b35d6d67-4409e700_0] Write session will restart in 0.008019s
2025-09-30T14:50:51.362834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69927406-bd0aca1c-b35d6d67-4409e700_0] Write session: Do CDS request
2025-09-30T14:50:51.362841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69927406-bd0aca1c-b35d6d67-4409e700_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:51.363109Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:51.371844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69927406-bd0aca1c-b35d6d67-4409e700_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:51.371931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:51.371946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 199
2025-09-30T14:50:51.372138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 199 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:51.372195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 199 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:51.372201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=199 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:51.372206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:51.372683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 199 sessionId:  describe result for acl check
2025-09-30T14:50:51.372717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:51.372723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:51.372725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:51.372731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894807750889700:3669] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:51.373274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894807750889700:3669] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:51.376284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894807750889700:3669] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:51.379188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894807750889700:3669] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:51.379200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894807750889700:3669] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:51.379203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894807750889700:3669] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:51.379210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 199 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:51.380986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:51.382153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:51.382302Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:51.382309Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:51.382317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:51.382352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:51.382396Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894807661165906:3300]
2025-09-30T14:50:51.382862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:51.383121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:51.383151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:51.383425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:51.383488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:51.383493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:51.383493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:51.383494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:51.383495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:51.383496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:51.383496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:51.383497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:51.383498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:51.383498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:51.383499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.383500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.383501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.383501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:51.383502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:51.383505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:51.383512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:51.383515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:51.383517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:51.383519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:51.383522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:51.383524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:51.383526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:51.383530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:51.383535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:51.383539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.383542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.383545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.383548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:51.383552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:51.383559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:51.383569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:51.383575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:51.383585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:51.383590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:51.383594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:51.383600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:51.383603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:51.383605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:51.383609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:51.383611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:51.383614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:51.383616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:51.383619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:51.383625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:51.383628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:51.383631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:51.383634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:51.383636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:51.383640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:51.383642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.383646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.383648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.383651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.383653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.383656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.383658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:51.383661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:51.383666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:51.383670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:51.383708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:51.390289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:51.391385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:51.391399Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:51.391402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:51.391405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:51.391411Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 198 [2:7555894807661165906:3300]
2025-09-30T14:50:51.391427Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:51.391445Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:51.391452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.391455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.391457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.391471Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:51.391482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:51.391493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:51.391558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.391564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.391566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.391570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:51.391573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:51.391640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:51.391648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.391660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.391676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.391698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:51.391720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894807750889672:2454], now have 1 active actors on pipe
2025-09-30T14:50:51.391728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894807750889908:3669], now have 1 active actors on pipe
2025-09-30T14:50:51.391733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894807661165901:3300]
2025-09-30T14:50:51.391736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894807661165901:3300]
2025-09-30T14:50:51.391739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894807661165901:3300]
2025-09-30T14:50:51.391752Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:51.391766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:51.391784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:51.391785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:51.391789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:51.391795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:51.391797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:51.391818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894807661165901:3300]
2025-09-30T14:50:51.391826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:51.391788Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 198
2025-09-30T14:50:51.391800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 198
2025-09-30T14:50:51.391835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:51.391856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:51.391864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:51.391895Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7e26014-e9fe2471-3d5c4d99-24eb775c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:51.391907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.391911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.391918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:51.391929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.391941Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:51.391969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:51.392095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:51.392102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:51.392114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:51.392228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 199 partition: 0 MaxSeqNo: 42 sessionId: src_id|d7e26014-e9fe2471-3d5c4d99-24eb775c_0
2025-09-30T14:50:51.392670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69927406-bd0aca1c-b35d6d67-4409e700_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d7e26014-e9fe2471-3d5c4d99-24eb775c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:51.395414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e26014-e9fe2471-3d5c4d99-24eb775c_0] Write session: try to update token
2025-09-30T14:50:51.395430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e26014-e9fe2471-3d5c4d99-24eb775c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:51.405236Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:51.405256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:51.405258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:51.405260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:51.405270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894807661165901:3300]
2025-09-30T14:50:51.405273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894807661165901:3300]
2025-09-30T14:50:51.405276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894807661165901:3300]
2025-09-30T14:50:51.405318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:51.405325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.405328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:51.405335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:51.405342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:51.405347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:51.405463Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:51.409582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 199 sessionId: src_id|d7e26014-e9fe2471-3d5c4d99-24eb775c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:51.412306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:51.462335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894807750889957:3106]
2025-09-30T14:50:51.462611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 198, pipe: [1:7555894807750889957:3106]
2025-09-30T14:50:51.515498Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:51.516000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:51.516012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:51.516050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894807750889957:3106], now have 1 active actors on pipe
2025-09-30T14:50:51.516296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894807750889957:3106]
2025-09-30T14:50:51.516304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:51.516327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:51.516329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:51.516399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 199 reason: error at write: Disconnected sessionId: src_id|d7e26014-e9fe2471-3d5c4d99-24eb775c_0
2025-09-30T14:50:51.516426Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:51.516572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 199 sessionId: src_id|d7e26014-e9fe2471-3d5c4d99-24eb775c_0 is DEAD
2025-09-30T14:50:51.516697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e26014-e9fe2471-3d5c4d99-24eb775c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:51.516707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e26014-e9fe2471-3d5c4d99-24eb775c_0] Write session will restart in 0.005434s
2025-09-30T14:50:51.516729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e26014-e9fe2471-3d5c4d99-24eb775c_0] Write session: Do CDS request
2025-09-30T14:50:51.516738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e26014-e9fe2471-3d5c4d99-24eb775c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:51.523778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e26014-e9fe2471-3d5c4d99-24eb775c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:51.523886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:51.523917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 200
2025-09-30T14:50:51.524028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 200 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:51.524059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 200 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:51.524069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=200 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:51.524073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:51.524491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 200 sessionId:  describe result for acl check
2025-09-30T14:50:51.524531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:51.524537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:51.524539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:51.524546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894807750889974:3681] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:51.525067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894807750889974:3681] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:51.528227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894807750889974:3681] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:51.531257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894807750889974:3681] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:51.531273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894807750889974:3681] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:51.531277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894807750889974:3681] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:51.531284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 200 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:51.533355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:51.534605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:51.534779Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:51.534788Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:51.534795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:51.534833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:51.534861Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894807661166198:3315]
2025-09-30T14:50:51.535344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:51.535614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:51.535666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:51.535974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:51.536037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:51.536044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:51.536046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:51.536047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:51.536048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:51.536049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:51.536050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:51.536051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:51.536053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:51.536054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:51.536055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.536056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.536057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.536058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:51.536059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:51.536065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:51.536075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:51.536078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:51.536082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:51.536086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:51.536089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:51.536093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:51.536097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:51.536101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:51.536105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:51.536109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.536113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.536116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.536123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:51.536126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:51.536135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:51.536146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:51.536153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:51.536158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:51.536165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:51.536170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:51.536176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:51.536181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:51.536186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:51.536191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:51.536200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:51.536205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:51.536210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:51.536217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:51.536221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:51.536231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:51.536235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:51.536240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:51.536245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:51.536250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:51.536254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.536264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.536269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.536274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.536284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.536289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.536297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:51.536301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:51.536307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:51.536312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:51.536369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:51.541776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:51.543060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:51.543073Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:51.543075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:51.543078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:51.543084Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 199 [2:7555894807661166198:3315]
2025-09-30T14:50:51.543096Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:51.543107Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:51.543109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.543111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.543112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.543124Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:51.543130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:51.543135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:51.543179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.543184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.543186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.543189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:51.543190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:51.543269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:51.543279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.543291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.543302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.543318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:51.543337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894807750890166:3681], now have 1 active actors on pipe
2025-09-30T14:50:51.543344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894807750889959:2454], now have 1 active actors on pipe
2025-09-30T14:50:51.543348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894807661166193:3315]
2025-09-30T14:50:51.543353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894807661166193:3315]
2025-09-30T14:50:51.543355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894807661166193:3315]
2025-09-30T14:50:51.543363Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:51.543375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:51.543379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:51.543388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:51.543390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:51.543396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:51.543398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:51.543416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894807661166193:3315]
2025-09-30T14:50:51.543426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:51.543428Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:51.543419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 199
2025-09-30T14:50:51.543462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 199
2025-09-30T14:50:51.543554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:51.543566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:51.543591Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28f07086-e4aad943-a9c63e37-82c4cc13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:51.543604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.543608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.543610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:51.543621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.543632Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:51.543650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:51.543803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:51.543816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:51.543847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:51.543970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 200 partition: 0 MaxSeqNo: 42 sessionId: src_id|28f07086-e4aad943-a9c63e37-82c4cc13_0
2025-09-30T14:50:51.544357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e26014-e9fe2471-3d5c4d99-24eb775c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|28f07086-e4aad943-a9c63e37-82c4cc13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:51.547147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28f07086-e4aad943-a9c63e37-82c4cc13_0] Write session: try to update token
2025-09-30T14:50:51.547165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28f07086-e4aad943-a9c63e37-82c4cc13_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:51.557347Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:51.557365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:51.557368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:51.557370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:51.557383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894807661166193:3315]
2025-09-30T14:50:51.557388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894807661166193:3315]
2025-09-30T14:50:51.557393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894807661166193:3315]
2025-09-30T14:50:51.557439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:51.557438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:51.557447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:51.557452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.557456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:51.557451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:51.557634Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:51.562415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 200 sessionId: src_id|28f07086-e4aad943-a9c63e37-82c4cc13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:51.565026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:51.616433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894807750890220:3106]
2025-09-30T14:50:51.616632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 199, pipe: [1:7555894807750890220:3106]
2025-09-30T14:50:51.660826Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:51.661154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:51.661167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:51.661205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894807750890220:3106], now have 1 active actors on pipe
2025-09-30T14:50:51.661431Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:51.661465Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:51.661467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:51.661471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:51.661532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894807750890220:3106]
2025-09-30T14:50:51.661532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 200 reason: error at write: Disconnected sessionId: src_id|28f07086-e4aad943-a9c63e37-82c4cc13_0
2025-09-30T14:50:51.661745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 200 sessionId: src_id|28f07086-e4aad943-a9c63e37-82c4cc13_0 is DEAD
2025-09-30T14:50:51.661900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f07086-e4aad943-a9c63e37-82c4cc13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:51.661909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f07086-e4aad943-a9c63e37-82c4cc13_0] Write session will restart in 0.005780s
2025-09-30T14:50:51.661932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f07086-e4aad943-a9c63e37-82c4cc13_0] Write session: Do CDS request
2025-09-30T14:50:51.661937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f07086-e4aad943-a9c63e37-82c4cc13_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:51.668773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28f07086-e4aad943-a9c63e37-82c4cc13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:51.668904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:51.668921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 201
2025-09-30T14:50:51.669024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 201 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:51.669056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 201 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:51.669069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=201 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:51.669072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:51.669549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 201 sessionId:  describe result for acl check
2025-09-30T14:50:51.669601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:51.669608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:51.669610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:51.669617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894807750890236:3685] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:51.670167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894807750890236:3685] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:51.672339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894807750890236:3685] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:51.675994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894807750890236:3685] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:51.676010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894807750890236:3685] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:51.676014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894807750890236:3685] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:51.676021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 201 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:51.680069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:51.681433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:51.681572Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:51.681579Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:51.681586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:51.681620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:51.681651Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894807661166453:3317]
2025-09-30T14:50:51.682102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:51.682331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:51.682367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:51.682602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:51.682655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:51.682660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:51.682661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:51.682661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:51.682662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:51.682663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:51.682663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:51.682664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:51.682665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:51.682665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:51.682666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.682667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.682667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.682668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:51.682669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:51.682672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:51.682679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:51.682681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:51.682684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:51.682686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:51.682688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:51.682690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:51.682692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:51.682695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:51.682697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:51.682700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.682702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.682704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.682706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:51.682709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:51.682714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:51.682720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:51.682725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:51.682728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:51.682730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:51.682733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:51.682735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:51.682738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:51.682741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:51.682743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:51.682746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:51.682748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:51.682751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:51.682754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:51.682767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:51.682770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:51.682773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:51.682776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:51.682779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:51.682782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:51.682784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.682787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.682790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.682793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.682796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.682799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.682803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:51.682806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:51.682809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:51.682812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:51.682859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:51.688691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:51.689769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:51.689788Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:51.689791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:51.689795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:51.689802Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 200 [2:7555894807661166453:3317]
2025-09-30T14:50:51.689820Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:51.689844Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:51.689852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.689856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.689859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.689876Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:51.689883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:51.689891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:51.689958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.689966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.689968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.689972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:51.689974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:51.690047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:51.690057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.690071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.690083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.690101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:51.690125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894807750890222:2454], now have 1 active actors on pipe
2025-09-30T14:50:51.690129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894807750890376:3685], now have 1 active actors on pipe
2025-09-30T14:50:51.690140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894807661166448:3317]
2025-09-30T14:50:51.690143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894807661166448:3317]
2025-09-30T14:50:51.690145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894807661166448:3317]
2025-09-30T14:50:51.690158Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:51.690172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:51.690177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:51.690185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:51.690187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:51.690192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:51.690195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:51.690227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894807661166448:3317]
2025-09-30T14:50:51.690234Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:51.690240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:51.690232Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 200
2025-09-30T14:50:51.690592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 200
2025-09-30T14:50:51.690687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:51.690703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:51.690750Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57037632-6ecdcd23-1da28f3e-d194232e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:51.690764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.690769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.690772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:51.690782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.690794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:51.690814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:51.690976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:51.690984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:51.690998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:51.691077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 201 partition: 0 MaxSeqNo: 42 sessionId: src_id|57037632-6ecdcd23-1da28f3e-d194232e_0
2025-09-30T14:50:51.691496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f07086-e4aad943-a9c63e37-82c4cc13_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|57037632-6ecdcd23-1da28f3e-d194232e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:51.694151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57037632-6ecdcd23-1da28f3e-d194232e_0] Write session: try to update token
2025-09-30T14:50:51.694166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57037632-6ecdcd23-1da28f3e-d194232e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:51.705565Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:51.705586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:51.705595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894807661166448:3317]
2025-09-30T14:50:51.705642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:51.705662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:51.705866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:51.706022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:51.706181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:51.706342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:51.706558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:51.706610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:51.709062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 201 sessionId: src_id|57037632-6ecdcd23-1da28f3e-d194232e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:51.711877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:51.712066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:51.712087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:51.712135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:51.712201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:51.715140Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:51.715160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:51.715163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:51.715165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:51.715175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894807661166448:3317]
2025-09-30T14:50:51.715180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894807661166448:3317]
2025-09-30T14:50:51.715183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894807661166448:3317]
2025-09-30T14:50:51.715220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:51.715225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:51.715227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.715230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:51.715240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:51.715262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:51.715389Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:51.761852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894807750890496:3106]
2025-09-30T14:50:51.762096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 200, pipe: [1:7555894807750890496:3106]
2025-09-30T14:50:51.826942Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:51.834935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:51.834963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:51.835139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:51.835204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:51.835286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:51.835356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:51.835409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:51.835419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:51.835491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:51.835553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:51.835651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:51.835721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:51.835770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:51.835778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:51.835848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:51.835909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:51.835984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:51.836054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:51.836096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:51.836104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:51.836210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:51.836274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:51.836335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:51.836404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:51.836515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:51.836524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:51.836592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:51.836658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:51.836726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:51.836793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:51.836836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:51.836843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:51.836912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:51.836972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:51.837033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:51.837099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:51.837146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:51.837155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:51.837223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:51.837286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:51.837350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:51.837417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:51.837553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:51.837561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:51.837630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:51.837693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:51.837755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:51.837825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:51.837867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:51.837874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:51.837944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:51.838047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:51.838112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:51.838180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:51.838226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:51.838235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:51.838302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:51.838374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:51.838440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:51.838502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:51.838545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:51.838554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:51.838613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894807750890496:3106], now have 1 active actors on pipe
2025-09-30T14:50:51.838883Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:51.838892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:51.838896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:51.838925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 201 reason: error at write: Disconnected sessionId: src_id|57037632-6ecdcd23-1da28f3e-d194232e_0
2025-09-30T14:50:51.838946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894807750890496:3106]
2025-09-30T14:50:51.838963Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:50:51.839044Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_1_2_10823260805113802020_v1 is DEAD
2025-09-30T14:50:51.839116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 201 sessionId: src_id|57037632-6ecdcd23-1da28f3e-d194232e_0 is DEAD
2025-09-30T14:50:51.839188Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894739031391497:3103] disconnected; active server actors: 1
2025-09-30T14:50:51.839198Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894739031391497:3103] client user disconnected session shared/user_1_2_10823260805113802020_v1
2025-09-30T14:50:51.839280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57037632-6ecdcd23-1da28f3e-d194232e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:51.839289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57037632-6ecdcd23-1da28f3e-d194232e_0] Write session will restart in 0.007707s
2025-09-30T14:50:51.839324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57037632-6ecdcd23-1da28f3e-d194232e_0] Write session: Do CDS request
2025-09-30T14:50:51.839330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57037632-6ecdcd23-1da28f3e-d194232e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:51.839410Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:50:51.839542Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:50:51.839548Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:50:51.839554Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.007590s
2025-09-30T14:50:51.839647Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:51.847666Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:50:51.847758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57037632-6ecdcd23-1da28f3e-d194232e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:51.847876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:51.847878Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:50:51.847883Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 3
2025-09-30T14:50:51.847890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 202
2025-09-30T14:50:51.848032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 202 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:51.848063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 202 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:51.848072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=202 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:51.848076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:51.848238Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:50:51.848284Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:50:51.848357Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 auth for : user
2025-09-30T14:50:51.848460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 202 sessionId:  describe result for acl check
2025-09-30T14:50:51.848471Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 Handle describe topics response
2025-09-30T14:50:51.848487Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 auth is DEAD
2025-09-30T14:50:51.848491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:51.848495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:51.848497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:51.848500Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:50:51.848502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894807750890533:3690] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:51.848739Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:50:51.848852Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_3_4518719700268330172_v1
2025-09-30T14:50:51.848852Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894807750890537:3691] connected; active server actors: 1
2025-09-30T14:50:51.848865Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555894807750890537:3691] session shared/user_1_3_4518719700268330172_v1
2025-09-30T14:50:51.848873Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:50:51.848886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:50:51.848895Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_3_4518719700268330172_v1" (Sender=[1:7555894807750890522:3691], Pipe=[1:7555894807750890537:3691], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:50:51.848899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:50:51.848909Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:50:51.848916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_3_4518719700268330172_v1" (Sender=[1:7555894807750890522:3691], Pipe=[1:7555894807750890537:3691], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:50:51.848931Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_3_4518719700268330172_v1" sender [1:7555894807750890522:3691] lock partition 0 for ReadingSession "shared/user_1_3_4518719700268330172_v1" (Sender=[1:7555894807750890522:3691], Pipe=[1:7555894807750890537:3691], Partitions=[], ActiveFamilyCount=1) generation 1 step 3
2025-09-30T14:50:51.848939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:50:51.848942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000031s
2025-09-30T14:50:51.849031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894807750890533:3690] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:51.849137Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 3 Session: "shared/user_1_3_4518719700268330172_v1" ClientId: "user" PipeClient { RawX1: 7555894807750890537 RawX2: 4503603922341483 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:50:51.849155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:50:51.850846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894807750890533:3690] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:51.854063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894807750890533:3690] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:51.854076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894807750890533:3690] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:51.854079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894807750890533:3690] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:51.854100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 202 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:51.857473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:51.858709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:51.858867Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:51.858874Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:51.858882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:51.858920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:51.858948Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894807661166722:3320]
2025-09-30T14:50:51.859529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:51.859839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:51.859903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:51.860191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:51.860250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:51.860256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:51.860257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:51.860258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:51.860259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:51.860260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:51.860260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:51.860262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:51.860262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:51.860263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:51.860264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.860264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.860265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.860266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:51.860267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:51.860270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:51.860277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:51.860280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:51.860282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:51.860284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:51.860287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:51.860289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:51.860291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:51.860293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:51.860296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:51.860298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.860300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.860302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.860305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:51.860309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:51.860316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:51.860324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:51.860330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:51.860346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:51.860350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:51.860356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:51.860360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:51.860365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:51.860374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:51.860377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:51.860383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:51.860386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:51.860389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:51.860392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:51.860398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:51.860401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:51.860404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:51.860407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:51.860409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:51.860412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:51.860415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.860419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.860421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.860425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.860427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.860430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.860434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:51.860437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:51.860440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:51.860443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:51.860467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:51.865974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:51.866850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:51.866863Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:51.866865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:51.866868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:51.866874Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 201 [2:7555894807661166722:3320]
2025-09-30T14:50:51.866890Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:51.866911Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:51.866918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.866921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.866924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.866939Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:51.866947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:51.866957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:51.867018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.867028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.867030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.867034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:51.867037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:51.867097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:51.867107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.867120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:51.867133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:51.867156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:51.867178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894807750890551:3696], now have 1 active actors on pipe
2025-09-30T14:50:51.867186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894807750890684:3690], now have 1 active actors on pipe
2025-09-30T14:50:51.867190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894807750890500:2454], now have 1 active actors on pipe
2025-09-30T14:50:51.867195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894807661166717:3320]
2025-09-30T14:50:51.867197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894807661166717:3320]
2025-09-30T14:50:51.867199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894807661166717:3320]
2025-09-30T14:50:51.867214Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:51.867233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:51.867236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:51.867239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:51.867253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:51.867270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:51.867273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:51.867271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 201
2025-09-30T14:50:51.867273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 201, pipe: [1:7555894807750890551:3696]
2025-09-30T14:50:51.867305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894807661166717:3320]
2025-09-30T14:50:51.867304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 201
2025-09-30T14:50:51.867315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:51.867318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:51.867331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:51.867336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:51.867351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:51.867353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:51.867360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_3_4518719700268330172_v1 on pipe: [1:7555894807750890551:3696]
2025-09-30T14:50:51.867400Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_3_4518719700268330172_v1:1 with generation 201
2025-09-30T14:50:51.867411Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7de25af5-c9afa5d1-f1b23fba-4a35fb14_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:51.867419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.867422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.867425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:51.867435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.867449Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:51.867464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.867472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.867474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:51.867489Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_3_4518719700268330172_v1
2025-09-30T14:50:51.867496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.867524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:51.867538Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:51.867669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:51.867676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:51.867689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:51.867801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 202 partition: 0 MaxSeqNo: 42 sessionId: src_id|7de25af5-c9afa5d1-f1b23fba-4a35fb14_0
2025-09-30T14:50:51.868172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57037632-6ecdcd23-1da28f3e-d194232e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7de25af5-c9afa5d1-f1b23fba-4a35fb14_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:51.870911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7de25af5-c9afa5d1-f1b23fba-4a35fb14_0] Write session: try to update token
2025-09-30T14:50:51.870929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7de25af5-c9afa5d1-f1b23fba-4a35fb14_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:51.871475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:51.871504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:51.871511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.871513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.871515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.871522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:50:51.871532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:50:51.871703Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759243851867 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:50:51.871736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:50:51.871773Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 sending to client partition status
2025-09-30T14:50:51.879660Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:51.879681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:51.879684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:51.879686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:51.879699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894807661166717:3320]
2025-09-30T14:50:51.879704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894807661166717:3320]
2025-09-30T14:50:51.879708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894807661166717:3320]
2025-09-30T14:50:51.879750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:51.879757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:51.879759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:51.879764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:51.879774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:51.879779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:51.879891Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:51.885301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 202 sessionId: src_id|7de25af5-c9afa5d1-f1b23fba-4a35fb14_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:51.888003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:51.988978Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:51.989690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:51.989704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:51.989865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_3_4518719700268330172_v1
2025-09-30T14:50:51.989881Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:51.989917Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_3_4518719700268330172_v1
2025-09-30T14:50:51.989956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894807750890551:3696]
2025-09-30T14:50:51.989957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:51.989962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:51.989992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:51.990040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 202 reason: error at write: Disconnected sessionId: src_id|7de25af5-c9afa5d1-f1b23fba-4a35fb14_0
2025-09-30T14:50:51.990249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 202 sessionId: src_id|7de25af5-c9afa5d1-f1b23fba-4a35fb14_0 is DEAD
2025-09-30T14:50:51.990392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7de25af5-c9afa5d1-f1b23fba-4a35fb14_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:51.990404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7de25af5-c9afa5d1-f1b23fba-4a35fb14_0] Write session will restart in 0.009997s
2025-09-30T14:50:51.990429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7de25af5-c9afa5d1-f1b23fba-4a35fb14_0] Write session: Do CDS request
2025-09-30T14:50:51.990434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7de25af5-c9afa5d1-f1b23fba-4a35fb14_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:52.001765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7de25af5-c9afa5d1-f1b23fba-4a35fb14_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:52.001852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:52.001871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 203
2025-09-30T14:50:52.002031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 203 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:52.002066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 203 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:52.002077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=203 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:52.002081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:52.002697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 203 sessionId:  describe result for acl check
2025-09-30T14:50:52.002728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:52.002729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:52.002731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:52.002735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894812045858193:3700] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:52.003179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894812045858193:3700] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:52.005685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894812045858193:3700] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:52.007211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:52.008340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:52.008501Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:52.008510Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:52.008520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:52.008567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:52.008635Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894811956134278:3323]
2025-09-30T14:50:52.008664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894812045858193:3700] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:52.008677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894812045858193:3700] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:52.008681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894812045858193:3700] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:52.008688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 203 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:52.009260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:52.009531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:52.009572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:52.009897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:52.009948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:52.009953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:52.009954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:52.009956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:52.009957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:52.009958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:52.009959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:52.009960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:52.009962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:52.009963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:52.009964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.009965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.009966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.009967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:52.009968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:52.009973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:52.009984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:52.009988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:52.009992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:52.009996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:52.010001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:52.010005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:52.010009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:52.010013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:52.010017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:52.010021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.010025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.010029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.010033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:52.010037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:52.010045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:52.010053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:52.010058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:52.010064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:52.010068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:52.010077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:52.010081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:52.010086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:52.010090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:52.010100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:52.010104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:52.010109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:52.010114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:52.010124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:52.010128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:52.010133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:52.010142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:52.010147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:52.010156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:52.010162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:52.010167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.010177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.010181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.010191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.010196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.010201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.010205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:52.010210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:52.010215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:52.010220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:52.010267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:52.015685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:52.016536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:52.016550Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:52.016553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:52.016557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:52.016564Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 202 [2:7555894811956134278:3323]
2025-09-30T14:50:52.016580Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:52.016595Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:52.016603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.016606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.016609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.016623Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:52.016629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:52.016636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:52.016697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.016704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.016706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.016710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:52.016712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:52.016774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:52.016782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.016794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.016807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.016829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:52.016851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894812045858332:3700], now have 1 active actors on pipe
2025-09-30T14:50:52.016859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894807750890783:2454], now have 1 active actors on pipe
2025-09-30T14:50:52.016865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894811956134273:3323]
2025-09-30T14:50:52.016869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894811956134273:3323]
2025-09-30T14:50:52.016871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894811956134273:3323]
2025-09-30T14:50:52.016888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:52.016905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:52.016911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:52.016916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:52.016918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:52.016920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:52.016923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:52.016953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894811956134273:3323]
2025-09-30T14:50:52.016964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:52.016972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:52.016970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 202
2025-09-30T14:50:52.017019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:52.016975Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 202
2025-09-30T14:50:52.017030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:52.017059Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10840132-fa3b16a0-961310fb-66c0d48c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:52.017070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.017073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.017075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:52.017085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.017098Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:52.017115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:52.017350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:52.017358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:52.017371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:52.017473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 203 partition: 0 MaxSeqNo: 42 sessionId: src_id|10840132-fa3b16a0-961310fb-66c0d48c_0
2025-09-30T14:50:52.017875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7de25af5-c9afa5d1-f1b23fba-4a35fb14_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|10840132-fa3b16a0-961310fb-66c0d48c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:52.020659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10840132-fa3b16a0-961310fb-66c0d48c_0] Write session: try to update token
2025-09-30T14:50:52.020676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10840132-fa3b16a0-961310fb-66c0d48c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:52.028537Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:52.028556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:52.028566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894811956134273:3323]
2025-09-30T14:50:52.028609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:52.028615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:52.028793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:52.028932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:52.029071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:52.029207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:52.029403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:52.029445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:52.035425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 203 sessionId: src_id|10840132-fa3b16a0-961310fb-66c0d48c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:52.038116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:52.038340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:52.038362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:52.038396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:52.038560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:52.041287Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:52.041302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:52.041304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:52.041307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:52.041316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894811956134273:3323]
2025-09-30T14:50:52.041320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894811956134273:3323]
2025-09-30T14:50:52.041326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894811956134273:3323]
2025-09-30T14:50:52.041363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:52.041369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.041369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:52.041372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:52.041386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:52.041390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:52.041565Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:52.090067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894812045858346:3696]
2025-09-30T14:50:52.090328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 202, pipe: [1:7555894812045858346:3696]
2025-09-30T14:50:52.154013Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:52.162863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:52.162890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:52.163055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:52.163131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:52.163210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:52.163301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:52.163810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:52.163824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:52.163899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:52.163961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:52.164028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:52.164097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:52.164139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:52.164145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:52.164212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:52.164283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:52.164358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:52.164454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:52.164510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:52.164516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:52.164582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:52.164655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:52.164722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:52.164788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:52.164933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:52.164948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:52.165025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:52.165113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:52.165211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:52.165285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:52.165330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:52.165336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:52.165409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:52.165474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:52.165548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:52.165622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:52.165668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:52.165676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:52.165753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:52.165820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:52.165898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:52.165973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:52.166022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:52.166029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:52.166102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:52.166167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:52.166236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:52.166310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:52.166355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:52.166362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:52.166433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:52.166495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:52.166562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:52.166646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:52.166691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:52.166698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:52.166765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:52.166828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:52.166899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:52.166964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:52.167030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:52.167037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:52.167101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894812045858346:3696], now have 1 active actors on pipe
2025-09-30T14:50:52.167402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:52.167414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894812045858346:3696]
2025-09-30T14:50:52.167419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:52.167439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:52.167449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 203 reason: error at write: Disconnected sessionId: src_id|10840132-fa3b16a0-961310fb-66c0d48c_0
2025-09-30T14:50:52.167668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 203 sessionId: src_id|10840132-fa3b16a0-961310fb-66c0d48c_0 is DEAD
2025-09-30T14:50:52.167732Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:52.167849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10840132-fa3b16a0-961310fb-66c0d48c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:52.167857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10840132-fa3b16a0-961310fb-66c0d48c_0] Write session will restart in 0.009374s
2025-09-30T14:50:52.167897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10840132-fa3b16a0-961310fb-66c0d48c_0] Write session: Do CDS request
2025-09-30T14:50:52.167904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10840132-fa3b16a0-961310fb-66c0d48c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:52.178904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10840132-fa3b16a0-961310fb-66c0d48c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:52.179145Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:52.179161Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 204
2025-09-30T14:50:52.179323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 204 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:52.179357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 204 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:52.179367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=204 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:52.179373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:52.179830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 204 sessionId:  describe result for acl check
2025-09-30T14:50:52.179880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:52.179885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:52.179887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:52.179894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894812045858410:3704] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:52.180435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894812045858410:3704] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:52.183560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894812045858410:3704] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:52.187869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894812045858410:3704] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:52.187886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894812045858410:3704] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:52.187891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894812045858410:3704] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:52.187899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 204 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:52.188531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:52.189994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:52.190201Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:52.190210Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:52.190221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:52.190270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:52.190307Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894811956134537:3325]
2025-09-30T14:50:52.190963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:52.191270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:52.191350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:52.191720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:52.191802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:52.191809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:52.191810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:52.191811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:52.191812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:52.191813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:52.191814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:52.191816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:52.191817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:52.191818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:52.191819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.191820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.191821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.191823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:52.191824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:52.191829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:52.191840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:52.191844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:52.191849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:52.191853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:52.191857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:52.191861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:52.191865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:52.191869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:52.191873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:52.191877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.191880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.191884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.191887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:52.191892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:52.191898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:52.191907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:52.191914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:52.191920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:52.191924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:52.191928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:52.191932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:52.191938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:52.191943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:52.191949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:52.191954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:52.191959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:52.191970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:52.191975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:52.191979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:52.191988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:52.191994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:52.192004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:52.192009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:52.192014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:52.192019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.192026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.192031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.192036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.192042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.192051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.192055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:52.192060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:52.192070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:52.192076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:52.192136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:52.197999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:52.198833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:52.198847Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:52.198849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:52.198853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:52.198859Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 203 [2:7555894811956134537:3325]
2025-09-30T14:50:52.198875Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:52.198899Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:52.198903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.198906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.198909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.198925Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:52.198932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:52.198944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:52.199008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.199015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.199018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.199021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:52.199024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:52.199099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:52.199109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.199121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.199131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.199145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:52.199162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894812045858348:2454], now have 1 active actors on pipe
2025-09-30T14:50:52.199171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894812045858601:3704], now have 1 active actors on pipe
2025-09-30T14:50:52.199178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894811956134532:3325]
2025-09-30T14:50:52.199180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894811956134532:3325]
2025-09-30T14:50:52.199182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894811956134532:3325]
2025-09-30T14:50:52.199195Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:52.199212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:52.199224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:52.199229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:52.199233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:52.199233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:52.199235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:52.199237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 203
2025-09-30T14:50:52.199267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 203
2025-09-30T14:50:52.199281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894811956134532:3325]
2025-09-30T14:50:52.199289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:52.199309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:52.199323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:52.199332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:52.199364Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88b4e11b-747b9fe2-18ba2b7c-43515fed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:52.199375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.199377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.199380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:52.199388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.199401Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:52.199423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:52.199565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:52.199575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:52.199589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:52.199664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 204 partition: 0 MaxSeqNo: 42 sessionId: src_id|88b4e11b-747b9fe2-18ba2b7c-43515fed_0
2025-09-30T14:50:52.200079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10840132-fa3b16a0-961310fb-66c0d48c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|88b4e11b-747b9fe2-18ba2b7c-43515fed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:52.202799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88b4e11b-747b9fe2-18ba2b7c-43515fed_0] Write session: try to update token
2025-09-30T14:50:52.202816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88b4e11b-747b9fe2-18ba2b7c-43515fed_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:52.211655Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:52.211674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:52.211676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:52.211678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:52.211689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894811956134532:3325]
2025-09-30T14:50:52.211693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894811956134532:3325]
2025-09-30T14:50:52.211697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894811956134532:3325]
2025-09-30T14:50:52.211735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:52.211741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.211744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:52.211744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:52.211752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:52.211756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:52.211881Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:52.218227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 204 sessionId: src_id|88b4e11b-747b9fe2-18ba2b7c-43515fed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:52.220877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:52.267721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894812045858614:3696]
2025-09-30T14:50:52.268008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 203, pipe: [1:7555894812045858614:3696]
2025-09-30T14:50:52.325699Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:52.326398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:52.326416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:52.326452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894812045858614:3696], now have 1 active actors on pipe
2025-09-30T14:50:52.326684Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:52.326689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:52.326726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894812045858614:3696]
2025-09-30T14:50:52.326735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:52.326801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 204 reason: status is not ok: tablet will be restarted right now sessionId: src_id|88b4e11b-747b9fe2-18ba2b7c-43515fed_0
2025-09-30T14:50:52.327014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 204 sessionId: src_id|88b4e11b-747b9fe2-18ba2b7c-43515fed_0 is DEAD
2025-09-30T14:50:52.327198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88b4e11b-747b9fe2-18ba2b7c-43515fed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:52.327209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88b4e11b-747b9fe2-18ba2b7c-43515fed_0] Write session will restart in 0.008706s
2025-09-30T14:50:52.327231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88b4e11b-747b9fe2-18ba2b7c-43515fed_0] Write session: Do CDS request
2025-09-30T14:50:52.327237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88b4e11b-747b9fe2-18ba2b7c-43515fed_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:52.336759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88b4e11b-747b9fe2-18ba2b7c-43515fed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:52.336912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:52.336929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 205
2025-09-30T14:50:52.337065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 205 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:52.337108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 205 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:52.337120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=205 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:52.337124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:52.337555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 205 sessionId:  describe result for acl check
2025-09-30T14:50:52.337595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:52.337601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:52.337603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:52.337609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894812045858652:3708] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:52.338172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894812045858652:3708] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:52.340873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894812045858652:3708] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:52.343884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894812045858652:3708] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:52.343897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894812045858652:3708] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:52.343900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894812045858652:3708] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:52.343908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 205 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:52.345524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:52.346869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:52.347041Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:52.347052Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:52.347062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:52.347114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:52.347149Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894811956134796:3327]
2025-09-30T14:50:52.347871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:52.348130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:52.348170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:52.348513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:52.348572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:52.348579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:52.348580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:52.348581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:52.348583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:52.348584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:52.348585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:52.348586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:52.348587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:52.348588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:52.348590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.348591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.348592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.348593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:52.348594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:52.348600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:52.348610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:52.348615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:52.348619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:52.348624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:52.348628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:52.348632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:52.348636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:52.348640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:52.348645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:52.348649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.348653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.348657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.348661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:52.348665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:52.348672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:52.348680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:52.348686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:52.348692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:52.348696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:52.348702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:52.348712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:52.348718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:52.348728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:52.348733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:52.348742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:52.348748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:52.348757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:52.348763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:52.348769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:52.348775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:52.348782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:52.348788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:52.348792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:52.348798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:52.348804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.348809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.348818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.348824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.348833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.348838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.348848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:52.348853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:52.348862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:52.348868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:52.348916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:52.354324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:52.355414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:52.355429Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:52.355432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:52.355436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:52.355443Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 204 [2:7555894811956134796:3327]
2025-09-30T14:50:52.355459Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:52.355474Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:52.355482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.355485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.355488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.355508Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:52.355520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:52.355527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:52.355585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.355593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.355596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.355599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:52.355603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:52.355818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 204
2025-09-30T14:50:52.355818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 204
2025-09-30T14:50:52.355963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:52.355972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.355987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.356005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.356031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:52.356055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894812045858848:3708], now have 1 active actors on pipe
2025-09-30T14:50:52.356065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894812045858616:2454], now have 1 active actors on pipe
2025-09-30T14:50:52.356083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:52.356091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:52.356106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894811956134790:3327]
2025-09-30T14:50:52.356114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894811956134790:3327]
2025-09-30T14:50:52.356117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894811956134790:3327]
2025-09-30T14:50:52.356130Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:52.356149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:52.356149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:52.356153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:52.356155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:52.356166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:52.356169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:52.356186Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6505289-1e5ff55f-26459aa0-7af856aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:52.356193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.356197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.356199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:52.356209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.356216Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:52.356254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894811956134790:3327]
2025-09-30T14:50:52.356269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:52.356280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:52.356282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:52.356435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:52.356444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:52.356457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:52.356551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 205 partition: 0 MaxSeqNo: 42 sessionId: src_id|b6505289-1e5ff55f-26459aa0-7af856aa_0
2025-09-30T14:50:52.356926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88b4e11b-747b9fe2-18ba2b7c-43515fed_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b6505289-1e5ff55f-26459aa0-7af856aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:52.359651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6505289-1e5ff55f-26459aa0-7af856aa_0] Write session: try to update token
2025-09-30T14:50:52.359669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6505289-1e5ff55f-26459aa0-7af856aa_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:52.367395Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:52.367415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:52.367424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894811956134790:3327]
2025-09-30T14:50:52.367467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:52.367476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:52.367666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:52.367812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:52.367948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:52.368087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:52.368415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:52.368461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:52.373531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 205 sessionId: src_id|b6505289-1e5ff55f-26459aa0-7af856aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:52.376153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:52.376356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:52.376379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:52.376413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:52.376499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:52.378085Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:52.378102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:52.378105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:52.378107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:52.378115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894811956134790:3327]
2025-09-30T14:50:52.378120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894811956134790:3327]
2025-09-30T14:50:52.378124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894811956134790:3327]
2025-09-30T14:50:52.378161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:52.378168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:52.378172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.378174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:52.378175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:52.378178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:52.378311Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:52.426951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894812045858882:3696]
2025-09-30T14:50:52.427231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 204, pipe: [1:7555894812045858882:3696]
2025-09-30T14:50:52.501446Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:52.509925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:52.509950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:52.510118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:52.510187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:52.510257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:52.510327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:52.510376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:52.510384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:52.510459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:52.510524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:52.510595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:52.510678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:52.510727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:52.510737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:52.510812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:52.510878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:52.510944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:52.511007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:52.511055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:52.511063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:52.511134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:52.511200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:52.511282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:52.511357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:52.511407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:52.511415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:52.511490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:52.511560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:52.511634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:52.511707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:52.511755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:52.511765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:52.511833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:52.511896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:52.511962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:52.512032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:52.512076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:52.512085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:52.512154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:52.512214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:52.512280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:52.512345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:52.512410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:52.512418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:52.512488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:52.512550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:52.512613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:52.512681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:52.512728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:52.512740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:52.512809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:52.512875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:52.512942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:52.513010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:52.513058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:52.513065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:52.513134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:52.513199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:52.513267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:52.513332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:52.513380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:52.513389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:52.513450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894812045858882:3696], now have 1 active actors on pipe
2025-09-30T14:50:52.513688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894812045858882:3696]
2025-09-30T14:50:52.513714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:52.513718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:52.513722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:52.513750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 205 reason: error at write: Disconnected sessionId: src_id|b6505289-1e5ff55f-26459aa0-7af856aa_0
2025-09-30T14:50:52.513982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 205 sessionId: src_id|b6505289-1e5ff55f-26459aa0-7af856aa_0 is DEAD
2025-09-30T14:50:52.514113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6505289-1e5ff55f-26459aa0-7af856aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:52.514121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6505289-1e5ff55f-26459aa0-7af856aa_0] Write session will restart in 0.006406s
2025-09-30T14:50:52.514138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6505289-1e5ff55f-26459aa0-7af856aa_0] Write session: Do CDS request
2025-09-30T14:50:52.514142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6505289-1e5ff55f-26459aa0-7af856aa_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:52.514587Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:52.521853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6505289-1e5ff55f-26459aa0-7af856aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:52.521904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:52.521920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 206
2025-09-30T14:50:52.522128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 206 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:52.522178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 206 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:52.522188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=206 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:52.522193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:52.522858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 206 sessionId:  describe result for acl check
2025-09-30T14:50:52.522896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:52.522903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:52.522904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:52.522911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894812045858940:3720] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:52.523503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894812045858940:3720] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:52.526212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894812045858940:3720] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:52.529483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894812045858940:3720] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:52.529501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894812045858940:3720] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:52.529505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894812045858940:3720] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:52.529512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 206 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:52.533582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:52.535085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:52.535270Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:52.535280Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:52.535291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:52.535345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:52.535386Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894811956135094:3342]
2025-09-30T14:50:52.535855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:52.536174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:52.536211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:52.536457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:52.536506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:52.536512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:52.536513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:52.536513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:52.536514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:52.536515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:52.536515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:52.536516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:52.536517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:52.536518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:52.536519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.536519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.536520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.536521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:52.536521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:52.536525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:52.536532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:52.536534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:52.536536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:52.536539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:52.536541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:52.536543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:52.536546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:52.536548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:52.536551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:52.536553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.536555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.536558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.536560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:52.536562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:52.536567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:52.536573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:52.536577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:52.536580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:52.536583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:52.536586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:52.536589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:52.536592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:52.536595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:52.536597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:52.536600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:52.536603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:52.536605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:52.536608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:52.536611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:52.536614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:52.536616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:52.536619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:52.536622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:52.536625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:52.536627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.536630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.536633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.536636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.536640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.536643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.536646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:52.536649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:52.536651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:52.536654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:52.536678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:52.542057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:52.542926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:52.542943Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:52.542946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:52.542950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:52.542957Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 205 [2:7555894811956135094:3342]
2025-09-30T14:50:52.542974Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:52.542990Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:52.542997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.543001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.543004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.543018Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:52.543029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:52.543036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:52.543093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.543100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.543102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.543106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:52.543109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:52.543173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:52.543182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.543193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.543210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.543233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:52.543267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894812045859070:3720], now have 1 active actors on pipe
2025-09-30T14:50:52.543275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894812045858911:2454], now have 1 active actors on pipe
2025-09-30T14:50:52.543281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894811956135089:3342]
2025-09-30T14:50:52.543288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894811956135089:3342]
2025-09-30T14:50:52.543290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894811956135089:3342]
2025-09-30T14:50:52.543302Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:52.543319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:52.543323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:52.543337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:52.543340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:52.543344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:52.543346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:52.543370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894811956135089:3342]
2025-09-30T14:50:52.543377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:52.543349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 205
2025-09-30T14:50:52.543380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:52.543355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 205
2025-09-30T14:50:52.543402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:52.543407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:52.543442Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3dc8754-6d9aa1df-2c1ea059-a42870e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:52.543454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.543462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.543465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:52.543474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.543487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:52.543508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:52.543630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:52.543646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:52.543658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:52.543742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 206 partition: 0 MaxSeqNo: 42 sessionId: src_id|f3dc8754-6d9aa1df-2c1ea059-a42870e8_0
2025-09-30T14:50:52.544112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6505289-1e5ff55f-26459aa0-7af856aa_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f3dc8754-6d9aa1df-2c1ea059-a42870e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:52.546855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3dc8754-6d9aa1df-2c1ea059-a42870e8_0] Write session: try to update token
2025-09-30T14:50:52.546872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3dc8754-6d9aa1df-2c1ea059-a42870e8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:52.555610Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:52.555629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:52.555630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:52.555632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:52.555640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894811956135089:3342]
2025-09-30T14:50:52.555644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894811956135089:3342]
2025-09-30T14:50:52.555648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894811956135089:3342]
2025-09-30T14:50:52.555688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:52.555697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.555705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:52.555706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:52.555713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:52.555717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:52.556138Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:52.561747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 206 sessionId: src_id|f3dc8754-6d9aa1df-2c1ea059-a42870e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:52.564258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:52.613819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894812045859175:3696]
2025-09-30T14:50:52.614072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 205, pipe: [1:7555894812045859175:3696]
2025-09-30T14:50:52.662065Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:52.662863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:52.662877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:52.662913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894812045859175:3696], now have 1 active actors on pipe
2025-09-30T14:50:52.663073Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:52.663202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:52.663216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:52.663216Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:52.663288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894812045859175:3696]
2025-09-30T14:50:52.663315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 206 reason: error at write: Disconnected sessionId: src_id|f3dc8754-6d9aa1df-2c1ea059-a42870e8_0
2025-09-30T14:50:52.663521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 206 sessionId: src_id|f3dc8754-6d9aa1df-2c1ea059-a42870e8_0 is DEAD
2025-09-30T14:50:52.663709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3dc8754-6d9aa1df-2c1ea059-a42870e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:52.663720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3dc8754-6d9aa1df-2c1ea059-a42870e8_0] Write session will restart in 0.006354s
2025-09-30T14:50:52.663741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3dc8754-6d9aa1df-2c1ea059-a42870e8_0] Write session: Do CDS request
2025-09-30T14:50:52.663749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3dc8754-6d9aa1df-2c1ea059-a42870e8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:52.670737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3dc8754-6d9aa1df-2c1ea059-a42870e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:52.670847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:52.670860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 207
2025-09-30T14:50:52.670982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 207 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:52.671016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 207 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:52.671025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=207 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:52.671029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:52.671508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 207 sessionId:  describe result for acl check
2025-09-30T14:50:52.671545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:52.671554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:52.671556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:52.671561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894812045859193:3724] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:52.672114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894812045859193:3724] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:52.674980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894812045859193:3724] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:52.678108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894812045859193:3724] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:52.678122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894812045859193:3724] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:52.678125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894812045859193:3724] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:52.678132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 207 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:52.681812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:52.683276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:52.683476Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:52.683487Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:52.683499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:52.683556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:52.683598Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894811956135355:3344]
2025-09-30T14:50:52.684222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:52.684516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:52.684563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:52.684876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:52.684928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:52.684934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:52.684935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:52.684936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:52.684937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:52.684939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:52.684940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:52.684941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:52.684942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:52.684943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:52.684944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.684945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.684946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.684947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:52.684948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:52.684953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:52.684963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:52.684967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:52.684972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:52.684976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:52.684979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:52.684983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:52.684987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:52.684991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:52.684995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:52.684999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.685003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.685007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.685010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:52.685014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:52.685020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:52.685028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:52.685034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:52.685044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:52.685048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:52.685058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:52.685062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:52.685071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:52.685077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:52.685087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:52.685090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:52.685099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:52.685103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:52.685109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:52.685117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:52.685122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:52.685130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:52.685135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:52.685144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:52.685148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:52.685154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.685163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.685167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.685172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.685181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.685186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.685193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:52.685198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:52.685202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:52.685211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:52.685250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:52.690483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:52.691433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:52.691450Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:52.691453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:52.691457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:52.691463Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 206 [2:7555894811956135355:3344]
2025-09-30T14:50:52.691478Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:52.691495Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:52.691498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.691501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.691503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.691519Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:52.691525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:52.691539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:52.691595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.691603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.691605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.691608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:52.691611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:52.691673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:52.691682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.691694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.691707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.691730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:52.691751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894812045859352:3724], now have 1 active actors on pipe
2025-09-30T14:50:52.691759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894812045859178:2454], now have 1 active actors on pipe
2025-09-30T14:50:52.691766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894811956135350:3344]
2025-09-30T14:50:52.691769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894811956135350:3344]
2025-09-30T14:50:52.691771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894811956135350:3344]
2025-09-30T14:50:52.691790Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:52.691812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:52.691814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:52.691818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:52.691820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:52.691828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:52.691831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:52.691832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 206
2025-09-30T14:50:52.691858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894811956135350:3344]
2025-09-30T14:50:52.691845Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 206
2025-09-30T14:50:52.691873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:52.691890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:52.691924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:52.691936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:52.691961Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a639de2-c59cd352-fce6f81b-7aa0ee42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:52.691972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.691976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.691978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:52.691989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.692003Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:52.692022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:52.692203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:52.692212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:52.692227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:52.692330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 207 partition: 0 MaxSeqNo: 42 sessionId: src_id|6a639de2-c59cd352-fce6f81b-7aa0ee42_0
2025-09-30T14:50:52.692718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3dc8754-6d9aa1df-2c1ea059-a42870e8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6a639de2-c59cd352-fce6f81b-7aa0ee42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:52.695613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a639de2-c59cd352-fce6f81b-7aa0ee42_0] Write session: try to update token
2025-09-30T14:50:52.695643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a639de2-c59cd352-fce6f81b-7aa0ee42_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:52.709069Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:52.709090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:52.709099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894811956135350:3344]
2025-09-30T14:50:52.709150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:52.709164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:52.709336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:52.709488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:52.709653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:52.709794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:52.709868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 207 sessionId: src_id|6a639de2-c59cd352-fce6f81b-7aa0ee42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:52.709982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:52.710021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:52.712277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:52.712445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:52.712463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:52.712492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:52.712566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:52.714497Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:52.714515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:52.714517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:52.714519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:52.714528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894811956135350:3344]
2025-09-30T14:50:52.714533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894811956135350:3344]
2025-09-30T14:50:52.714536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894811956135350:3344]
2025-09-30T14:50:52.714570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:52.714573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:52.714581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:52.714586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:52.714589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.714592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:52.714738Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:52.763330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894812045859458:3696]
2025-09-30T14:50:52.763583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 206, pipe: [1:7555894812045859458:3696]
2025-09-30T14:50:52.821179Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:52.828483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:52.828509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:52.828661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:52.828720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:52.828783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:52.828854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:52.828900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:52.828906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:52.828972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:52.829030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:52.829104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:52.829173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:52.829216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:52.829222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:52.829285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:52.829343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:52.829404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:52.829464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:52.829505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:52.829511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:52.829572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:52.829635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:52.829695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:52.829757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:52.829800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:52.829810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:52.829872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:52.829938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:52.830003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:52.830062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:52.830102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:52.830111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:52.830172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:52.830230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:52.830290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:52.830365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:52.830407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:52.830414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:52.830474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:52.830532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:52.830645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:52.830707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:52.830761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:52.830768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:52.830850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:52.830908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:52.830968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:52.831038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:52.831080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:52.831086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:52.831149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:52.831205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:52.831297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:52.831365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:52.831405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:52.831411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:52.831472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:52.831528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:52.831588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:52.831656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:52.831705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:52.831712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:52.831750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894812045859458:3696], now have 1 active actors on pipe
2025-09-30T14:50:52.831952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894812045859458:3696]
2025-09-30T14:50:52.831976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:52.831984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:52.831986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:52.832010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 207 reason: error at write: Disconnected sessionId: src_id|6a639de2-c59cd352-fce6f81b-7aa0ee42_0
2025-09-30T14:50:52.832269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 207 sessionId: src_id|6a639de2-c59cd352-fce6f81b-7aa0ee42_0 is DEAD
2025-09-30T14:50:52.832375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a639de2-c59cd352-fce6f81b-7aa0ee42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:52.832386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a639de2-c59cd352-fce6f81b-7aa0ee42_0] Write session will restart in 0.009362s
2025-09-30T14:50:52.832408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a639de2-c59cd352-fce6f81b-7aa0ee42_0] Write session: Do CDS request
2025-09-30T14:50:52.832414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a639de2-c59cd352-fce6f81b-7aa0ee42_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:52.832702Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:52.842831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a639de2-c59cd352-fce6f81b-7aa0ee42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:52.842989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:52.843005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 208
2025-09-30T14:50:52.843168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 208 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:52.843201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 208 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:52.843210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=208 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:52.843215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:52.843766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 208 sessionId:  describe result for acl check
2025-09-30T14:50:52.843804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:52.843811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:52.843812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:52.843819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894812045859529:3729] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:52.844360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894812045859529:3729] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:52.847002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894812045859529:3729] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:52.849809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894812045859529:3729] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:52.849823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894812045859529:3729] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:52.849826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894812045859529:3729] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:52.849837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 208 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:52.850969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:52.852276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:52.852475Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:52.852484Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:52.852494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:52.852547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:52.852599Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894811956135629:3347]
2025-09-30T14:50:52.853242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:52.853763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:52.853812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:52.854137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:52.854199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:52.854205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:52.854206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:52.854207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:52.854208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:52.854209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:52.854211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:52.854212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:52.854213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:52.854214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:52.854215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.854216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.854217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.854218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:52.854219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:52.854225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:52.854236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:52.854240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:52.854244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:52.854248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:52.854252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:52.854256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:52.854260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:52.854265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:52.854269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:52.854273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.854277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.854281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.854285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:52.854289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:52.854296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:52.854305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:52.854312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:52.854318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:52.854322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:52.854328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:52.854333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:52.854338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:52.854343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:52.854348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:52.854353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:52.854359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:52.854364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:52.854369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:52.854374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:52.854379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:52.854384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:52.854390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:52.854394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:52.854399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:52.854404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.854415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.854420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.854425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.854435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.854440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.854449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:52.854455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:52.854463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:52.854469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:52.854515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:52.859983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:52.860916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:52.860931Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:52.860935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:52.860939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:52.860945Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 207 [2:7555894811956135629:3347]
2025-09-30T14:50:52.860962Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:52.860982Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:52.860989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.860992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.860994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.861009Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:52.861016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:52.861030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:52.861089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.861095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.861097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.861099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:52.861101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:52.861167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:52.861176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.861187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:52.861203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:52.861224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:52.861249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894812045859716:3729], now have 1 active actors on pipe
2025-09-30T14:50:52.861253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894812045859460:2454], now have 1 active actors on pipe
2025-09-30T14:50:52.861259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894811956135624:3347]
2025-09-30T14:50:52.861262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894811956135624:3347]
2025-09-30T14:50:52.861264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894811956135624:3347]
2025-09-30T14:50:52.861277Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:52.861291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:52.861303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:52.861310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:52.861313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:52.861315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:52.861317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:52.861300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 207
2025-09-30T14:50:52.861308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 207
2025-09-30T14:50:52.861345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894811956135624:3347]
2025-09-30T14:50:52.861355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:52.861356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:52.861375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:52.861385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:52.861433Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bffa7f12-a61afef9-fb0cb413-6b6f1362_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:52.861445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.861450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.861452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:52.861461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.861477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:52.861499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:52.861645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:52.861655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:52.861671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:52.861737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 208 partition: 0 MaxSeqNo: 42 sessionId: src_id|bffa7f12-a61afef9-fb0cb413-6b6f1362_0
2025-09-30T14:50:52.862126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a639de2-c59cd352-fce6f81b-7aa0ee42_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bffa7f12-a61afef9-fb0cb413-6b6f1362_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:52.864898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bffa7f12-a61afef9-fb0cb413-6b6f1362_0] Write session: try to update token
2025-09-30T14:50:52.864915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bffa7f12-a61afef9-fb0cb413-6b6f1362_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:52.873441Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:52.873461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:52.873464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:52.873466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:52.873475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894811956135624:3347]
2025-09-30T14:50:52.873480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894811956135624:3347]
2025-09-30T14:50:52.873484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894811956135624:3347]
2025-09-30T14:50:52.873524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:52.873527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:52.873531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:52.873533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:52.873533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:52.873537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:52.873682Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:52.879050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 208 sessionId: src_id|bffa7f12-a61afef9-fb0cb413-6b6f1362_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:52.881832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:52.932278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894812045859730:3696]
2025-09-30T14:50:52.932628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 207, pipe: [1:7555894812045859730:3696]
2025-09-30T14:50:52.985004Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:52.985372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:52.985385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:52.985418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894812045859730:3696], now have 1 active actors on pipe
2025-09-30T14:50:52.985575Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:52.985595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894812045859730:3696]
2025-09-30T14:50:52.985605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:52.985609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:52.985638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:52.985678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 208 reason: error at write: Disconnected sessionId: src_id|bffa7f12-a61afef9-fb0cb413-6b6f1362_0
2025-09-30T14:50:52.985847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 208 sessionId: src_id|bffa7f12-a61afef9-fb0cb413-6b6f1362_0 is DEAD
2025-09-30T14:50:52.986004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bffa7f12-a61afef9-fb0cb413-6b6f1362_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:52.986015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bffa7f12-a61afef9-fb0cb413-6b6f1362_0] Write session will restart in 0.007778s
2025-09-30T14:50:52.986038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bffa7f12-a61afef9-fb0cb413-6b6f1362_0] Write session: Do CDS request
2025-09-30T14:50:52.986047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bffa7f12-a61afef9-fb0cb413-6b6f1362_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:52.994760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bffa7f12-a61afef9-fb0cb413-6b6f1362_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:52.994917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:52.994933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 209
2025-09-30T14:50:52.995052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 209 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:52.995085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 209 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:52.995092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=209 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:52.995096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:52.995545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 209 sessionId:  describe result for acl check
2025-09-30T14:50:52.995582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:52.995593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:52.995595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:52.995600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894812045859771:3735] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:52.996171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894812045859771:3735] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:52.999087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894812045859771:3735] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:53.002285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894812045859771:3735] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:53.002300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894812045859771:3735] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:53.002304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894812045859771:3735] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:53.002316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 209 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:53.004766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:53.006161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:53.006336Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:53.006346Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:53.006356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:53.006405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:53.006443Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894816251103190:3350]
2025-09-30T14:50:53.007123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:53.007443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:53.007483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:53.007810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:53.007865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:53.007873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:53.007874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:53.007875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:53.007877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:53.007877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:53.007879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:53.007880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:53.007881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:53.007883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:53.007884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.007885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.007886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.007887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:53.007888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:53.007894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:53.007905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:53.007910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:53.007915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:53.007918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:53.007922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:53.007927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:53.007932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:53.007936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:53.007941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:53.007945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.007949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.007953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.007958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:53.007962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:53.007969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:53.007977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:53.007983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:53.007989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:53.007994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:53.008001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:53.008005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:53.008010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:53.008015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:53.008022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:53.008028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:53.008033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:53.008038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:53.008043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:53.008048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:53.008059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:53.008064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:53.008069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:53.008082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:53.008088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:53.008093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.008098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.008107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.008113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.008118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.008124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.008128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:53.008133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:53.008138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:53.008144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:53.008190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:53.013808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:53.014764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:53.014780Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:53.014783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:53.014787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:53.014794Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 208 [2:7555894816251103190:3350]
2025-09-30T14:50:53.014810Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:53.014825Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:53.014833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.014837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.014840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.014856Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:53.014869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:53.014880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:53.014943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.014950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.014953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.014956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:53.014959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:53.015021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:53.015028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.015041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.015058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.015083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:53.015100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894816251103185:3350]
2025-09-30T14:50:53.015109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894816251103185:3350]
2025-09-30T14:50:53.015111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894816251103185:3350]
2025-09-30T14:50:53.015120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:53.015129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:53.015133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:53.015135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:53.015137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894816340827255:3735], now have 1 active actors on pipe
2025-09-30T14:50:53.015142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:53.015156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:53.015160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:53.015165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894812045859739:2454], now have 1 active actors on pipe
2025-09-30T14:50:53.015205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894816251103185:3350]
2025-09-30T14:50:53.015222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:53.015217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 208
2025-09-30T14:50:53.015258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:53.015215Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 208
2025-09-30T14:50:53.015309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:53.015319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:53.015343Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1360cc9-f2e27653-bf3bb29e-d0c5c86_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:53.015354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.015362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.015364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:53.015374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.015387Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:53.015408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:53.015562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:53.015570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:53.015585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:53.015666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 209 partition: 0 MaxSeqNo: 42 sessionId: src_id|a1360cc9-f2e27653-bf3bb29e-d0c5c86_0
2025-09-30T14:50:53.015907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bffa7f12-a61afef9-fb0cb413-6b6f1362_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a1360cc9-f2e27653-bf3bb29e-d0c5c86_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:53.018739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1360cc9-f2e27653-bf3bb29e-d0c5c86_0] Write session: try to update token
2025-09-30T14:50:53.018760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1360cc9-f2e27653-bf3bb29e-d0c5c86_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:53.027301Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:53.027318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:53.027328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894816251103185:3350]
2025-09-30T14:50:53.027375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:53.027374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:53.027573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:53.027716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:53.027862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:53.028011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:53.028199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:53.028239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:53.033540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 209 sessionId: src_id|a1360cc9-f2e27653-bf3bb29e-d0c5c86_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:53.035942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:53.036176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:53.036199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:53.036251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:53.036338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:53.037417Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:53.037434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:53.037437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:53.037439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:53.037449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894816251103185:3350]
2025-09-30T14:50:53.037453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894816251103185:3350]
2025-09-30T14:50:53.037457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894816251103185:3350]
2025-09-30T14:50:53.037491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:53.037498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:53.037503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:53.037503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.037506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:53.037506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:53.037638Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:53.085902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894816340827311:3696]
2025-09-30T14:50:53.086157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 208, pipe: [1:7555894816340827311:3696]
2025-09-30T14:50:53.149450Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:53.158486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:53.158520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:53.158719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:53.158791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:53.158865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:53.158941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:53.159384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:53.159403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:53.159482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:53.159553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:53.159630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:53.159708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:53.159756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:53.159765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:53.159841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:53.159911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:53.159983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:53.160056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:53.160099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:53.160106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:53.160184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:53.160474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:53.160572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:53.160653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:53.160701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:53.160710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:53.160784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:53.160887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:53.160954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:53.161029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:53.161080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:53.161091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:53.161171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:53.161241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:53.161313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:53.161387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:53.161438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:53.161446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:53.161523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:53.161591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:53.161667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:53.161738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:53.161784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:53.161792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:53.161867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:53.161932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:53.162001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:53.162074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:53.162120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:53.162127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:53.162194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:53.162259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:53.162337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:53.162410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:53.162455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:53.162466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:53.162538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:53.162606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:53.162694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:53.162768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:53.162823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:53.162832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:53.162901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894816340827311:3696], now have 1 active actors on pipe
2025-09-30T14:50:53.163177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:53.163183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894816340827311:3696]
2025-09-30T14:50:53.163193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:53.163201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:53.163221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 209 reason: error at write: Disconnected sessionId: src_id|a1360cc9-f2e27653-bf3bb29e-d0c5c86_0
2025-09-30T14:50:53.163408Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:53.163442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 209 sessionId: src_id|a1360cc9-f2e27653-bf3bb29e-d0c5c86_0 is DEAD
2025-09-30T14:50:53.163545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1360cc9-f2e27653-bf3bb29e-d0c5c86_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:53.163553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1360cc9-f2e27653-bf3bb29e-d0c5c86_0] Write session will restart in 0.009942s
2025-09-30T14:50:53.163576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1360cc9-f2e27653-bf3bb29e-d0c5c86_0] Write session: Do CDS request
2025-09-30T14:50:53.163596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1360cc9-f2e27653-bf3bb29e-d0c5c86_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:53.174794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1360cc9-f2e27653-bf3bb29e-d0c5c86_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:53.174868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:53.174883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 210
2025-09-30T14:50:53.175035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 210 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:53.175068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 210 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:53.175078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=210 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:53.175082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:53.175579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 210 sessionId:  describe result for acl check
2025-09-30T14:50:53.175618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:53.175624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:53.175626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:53.175632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894816340827394:3741] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:53.176208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894816340827394:3741] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:53.179317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894816340827394:3741] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:53.181793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894816340827394:3741] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:53.181804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894816340827394:3741] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:53.181806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894816340827394:3741] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:53.181815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 210 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:53.182251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:53.183354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:53.183511Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:53.183521Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:53.183531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:53.183570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:53.183608Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894816251103454:3352]
2025-09-30T14:50:53.184045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:53.184331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:53.184371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:53.184633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:53.184680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:53.184685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:53.184686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:53.184687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:53.184687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:53.184688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:53.184689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:53.184690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:53.184690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:53.184691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:53.184692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.184693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.184693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.184694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:53.184695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:53.184700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:53.184711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:53.184715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:53.184719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:53.184723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:53.184727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:53.184732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:53.184736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:53.184740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:53.184744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:53.184748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.184750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.184753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.184755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:53.184757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:53.184763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:53.184768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:53.184772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:53.184775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:53.184777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:53.184780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:53.184783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:53.184786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:53.184788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:53.184791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:53.184793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:53.184796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:53.184799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:53.184802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:53.184804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:53.184808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:53.184810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:53.184813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:53.184816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:53.184818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:53.184822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.184825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.184828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.184830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.184833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.184835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.184838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:53.184841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:53.184843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:53.184846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:53.184869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:53.189993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:53.191041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:53.191057Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:53.191060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:53.191063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:53.191070Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 209 [2:7555894816251103454:3352]
2025-09-30T14:50:53.191083Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:53.191095Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:53.191096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.191098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.191100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.191111Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:53.191117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:53.191122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:53.191163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.191169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.191170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.191173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:53.191174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:53.191223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:53.191228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.191236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.191266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.191283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:53.191301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894816340827313:2454], now have 1 active actors on pipe
2025-09-30T14:50:53.191308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894816340827573:3741], now have 1 active actors on pipe
2025-09-30T14:50:53.191314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894816251103449:3352]
2025-09-30T14:50:53.191316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894816251103449:3352]
2025-09-30T14:50:53.191319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894816251103449:3352]
2025-09-30T14:50:53.191332Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:53.191343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:53.191348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:53.191353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:53.191355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:53.191358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:53.191359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:53.191368Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 209
2025-09-30T14:50:53.191387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 209
2025-09-30T14:50:53.191386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894816251103449:3352]
2025-09-30T14:50:53.191397Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:53.191399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:53.191425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:53.191429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:53.191464Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a98ef53-1bb80b63-55a14094-bda83d2a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:53.191477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.191480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.191482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:53.191491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.191499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:53.191514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:53.191650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:53.191658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:53.191669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:53.191744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 210 partition: 0 MaxSeqNo: 42 sessionId: src_id|a98ef53-1bb80b63-55a14094-bda83d2a_0
2025-09-30T14:50:53.192127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1360cc9-f2e27653-bf3bb29e-d0c5c86_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a98ef53-1bb80b63-55a14094-bda83d2a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:53.194986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a98ef53-1bb80b63-55a14094-bda83d2a_0] Write session: try to update token
2025-09-30T14:50:53.195007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a98ef53-1bb80b63-55a14094-bda83d2a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:53.202928Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:53.202944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:53.202947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:53.202949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:53.202958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894816251103449:3352]
2025-09-30T14:50:53.202962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894816251103449:3352]
2025-09-30T14:50:53.202967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894816251103449:3352]
2025-09-30T14:50:53.203004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:53.203006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:53.203012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:53.203012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.203015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:53.203017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:53.203157Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:53.209515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 210 sessionId: src_id|a98ef53-1bb80b63-55a14094-bda83d2a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:53.212252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:53.263541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894816340827585:3696]
2025-09-30T14:50:53.263808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 209, pipe: [1:7555894816340827585:3696]
2025-09-30T14:50:53.316292Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:53.316526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:53.316538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:53.316570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894816340827585:3696], now have 1 active actors on pipe
2025-09-30T14:50:53.316724Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:53.316816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894816340827585:3696]
2025-09-30T14:50:53.316835Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:53.316851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:53.316910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 210 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a98ef53-1bb80b63-55a14094-bda83d2a_0
2025-09-30T14:50:53.317095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 210 sessionId: src_id|a98ef53-1bb80b63-55a14094-bda83d2a_0 is DEAD
2025-09-30T14:50:53.317243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a98ef53-1bb80b63-55a14094-bda83d2a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:53.317250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a98ef53-1bb80b63-55a14094-bda83d2a_0] Write session will restart in 0.007070s
2025-09-30T14:50:53.317272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a98ef53-1bb80b63-55a14094-bda83d2a_0] Write session: Do CDS request
2025-09-30T14:50:53.317276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a98ef53-1bb80b63-55a14094-bda83d2a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:53.325759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a98ef53-1bb80b63-55a14094-bda83d2a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:53.325847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:53.325863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 211
2025-09-30T14:50:53.326014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 211 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:53.326047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 211 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:53.326057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=211 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:53.326061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:53.326455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 211 sessionId:  describe result for acl check
2025-09-30T14:50:53.326489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:53.326496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:53.326498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:53.326503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894816340827635:3745] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:53.327051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894816340827635:3745] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:53.329824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894816340827635:3745] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:53.332428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894816340827635:3745] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:53.332437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894816340827635:3745] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:53.332439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894816340827635:3745] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:53.332446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 211 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:53.333615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:53.334723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:53.334883Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:53.334893Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:53.334903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:53.334947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:53.334983Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894816251103719:3354]
2025-09-30T14:50:53.335628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:53.335898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:53.335948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:53.336259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:53.336348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:53.336356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:53.336358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:53.336359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:53.336361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:53.336362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:53.336363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:53.336365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:53.336366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:53.336367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:53.336368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.336369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.336370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.336372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:53.336373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:53.336378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:53.336388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:53.336393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:53.336397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:53.336401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:53.336405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:53.336409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:53.336412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:53.336416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:53.336421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:53.336425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.336428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.336432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.336436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:53.336440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:53.336449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:53.336457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:53.336463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:53.336468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:53.336472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:53.336478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:53.336481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:53.336487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:53.336491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:53.336497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:53.336501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:53.336506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:53.336511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:53.336517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:53.336521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:53.336535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:53.336541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:53.336551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:53.336555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:53.336560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:53.336570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.336575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.336584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.336589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.336594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.336599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.336603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:53.336609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:53.336613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:53.336618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:53.336670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:53.341646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:53.342464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:53.342477Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:53.342479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:53.342481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:53.342486Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 210 [2:7555894816251103719:3354]
2025-09-30T14:50:53.342499Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:53.342510Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:53.342512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.342514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.342516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.342527Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:53.342532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:53.342537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:53.342577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.342582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.342584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.342586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:53.342588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:53.342653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:53.342659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.342666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.342673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.342683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:53.342699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894816251103714:3354]
2025-09-30T14:50:53.342706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894816251103714:3354]
2025-09-30T14:50:53.342709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894816251103714:3354]
2025-09-30T14:50:53.342720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:53.342730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894816340827587:2454], now have 1 active actors on pipe
2025-09-30T14:50:53.342733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:53.342736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:53.342738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:53.342739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894816340827845:3745], now have 1 active actors on pipe
2025-09-30T14:50:53.342743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:53.342752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:53.342754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:53.342772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894816251103714:3354]
2025-09-30T14:50:53.342781Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:53.342791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:53.342793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 210
2025-09-30T14:50:53.342810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 210
2025-09-30T14:50:53.342845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:53.342852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:53.342871Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|73ba35c-7d701399-648331-7b74f9cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:53.342879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.342882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.342883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:53.342890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.342897Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:53.342909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:53.343051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:53.343059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:53.343073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:53.343177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 211 partition: 0 MaxSeqNo: 42 sessionId: src_id|73ba35c-7d701399-648331-7b74f9cb_0
2025-09-30T14:50:53.343599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a98ef53-1bb80b63-55a14094-bda83d2a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|73ba35c-7d701399-648331-7b74f9cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:53.346486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73ba35c-7d701399-648331-7b74f9cb_0] Write session: try to update token
2025-09-30T14:50:53.346506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73ba35c-7d701399-648331-7b74f9cb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:53.353856Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:53.353872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:53.353880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894816251103714:3354]
2025-09-30T14:50:53.353920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:53.353933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:53.354091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:53.354267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:53.354402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:53.354566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:53.354770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:53.354805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:53.360904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 211 sessionId: src_id|73ba35c-7d701399-648331-7b74f9cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:53.363596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:53.364142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:53.364163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:53.364178Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:53.364181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:53.364183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:53.364184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:53.364190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894816251103714:3354]
2025-09-30T14:50:53.364193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894816251103714:3354]
2025-09-30T14:50:53.364196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894816251103714:3354]
2025-09-30T14:50:53.364234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:53.364234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:53.364239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:53.364243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:53.364244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.364246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:53.364416Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:53.417158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894816340827859:3696]
2025-09-30T14:50:53.417444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 210, pipe: [1:7555894816340827859:3696]
2025-09-30T14:50:53.475851Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:53.476582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:53.476617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894816340827859:3696], now have 1 active actors on pipe
2025-09-30T14:50:53.476731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:53.476748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:53.476800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894816340827859:3696]
2025-09-30T14:50:53.476833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:53.476842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:53.476908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 211 reason: error at write: Disconnected sessionId: src_id|73ba35c-7d701399-648331-7b74f9cb_0
2025-09-30T14:50:53.477083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 211 sessionId: src_id|73ba35c-7d701399-648331-7b74f9cb_0 is DEAD
2025-09-30T14:50:53.477216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73ba35c-7d701399-648331-7b74f9cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:53.477222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73ba35c-7d701399-648331-7b74f9cb_0] Write session will restart in 0.006755s
2025-09-30T14:50:53.477247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73ba35c-7d701399-648331-7b74f9cb_0] Write session: Do CDS request
2025-09-30T14:50:53.477251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73ba35c-7d701399-648331-7b74f9cb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:53.484783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73ba35c-7d701399-648331-7b74f9cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:53.484877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:53.484908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 212
2025-09-30T14:50:53.485018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 212 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:53.485047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 212 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:53.485056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=212 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:53.485060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:53.485453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 212 sessionId:  describe result for acl check
2025-09-30T14:50:53.485485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:53.485492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:53.485494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:53.485500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894816340827878:3750] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:53.486052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894816340827878:3750] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:53.489200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894816340827878:3750] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:53.492369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894816340827878:3750] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:53.492386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894816340827878:3750] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:53.492390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894816340827878:3750] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:53.492398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 212 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:53.496771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:53.498111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:53.498296Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:53.498308Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:53.498320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:53.498376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:53.498435Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894816251103991:3357]
2025-09-30T14:50:53.499105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:53.499397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:53.499453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:53.499823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:53.499884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:53.499891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:53.499892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:53.499893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:53.499894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:53.499895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:53.499898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:53.499899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:53.499901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:53.499902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:53.499903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.499904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.499905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.499907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:53.499908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:53.499913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:53.499923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:53.499927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:53.499931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:53.499935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:53.499940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:53.499943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:53.499946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:53.499950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:53.499956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:53.499960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.499969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.499973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.499977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:53.499980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:53.499987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:53.499996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:53.500002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:53.500008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:53.500013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:53.500018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:53.500022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:53.500027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:53.500032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:53.500037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:53.500041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:53.500046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:53.500050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:53.500055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:53.500059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:53.500064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:53.500068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:53.500073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:53.500077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:53.500082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:53.500091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.500096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.500102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.500106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.500115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.500120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.500128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:53.500133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:53.500138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:53.500143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:53.500190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:53.505360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:53.506273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:53.506288Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:53.506292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:53.506296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:53.506302Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 211 [2:7555894816251103991:3357]
2025-09-30T14:50:53.506317Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:53.506330Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:53.506333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.506335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.506337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.506353Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:53.506360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:53.506367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:53.506422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.506429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.506431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.506434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:53.506436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:53.506513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:53.506518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.506525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.506532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.506543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:53.506559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894816340828033:3750], now have 1 active actors on pipe
2025-09-30T14:50:53.506565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894816340827863:2454], now have 1 active actors on pipe
2025-09-30T14:50:53.506569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894816251103986:3357]
2025-09-30T14:50:53.506571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894816251103986:3357]
2025-09-30T14:50:53.506572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894816251103986:3357]
2025-09-30T14:50:53.506582Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:53.506593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:53.506600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:53.506603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:53.506605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:53.506605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:53.506608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:53.506643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894816251103986:3357]
2025-09-30T14:50:53.506651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:53.506661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:53.506664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 211
2025-09-30T14:50:53.506701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 211
2025-09-30T14:50:53.506699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:53.506708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:53.506731Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19e71566-fc2a6165-eb20fdf5-743438bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:53.506739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.506742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.506744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:53.506750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.506765Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:53.506778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:53.506939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:53.506954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:53.506976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:53.507070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 212 partition: 0 MaxSeqNo: 42 sessionId: src_id|19e71566-fc2a6165-eb20fdf5-743438bf_0
2025-09-30T14:50:53.507465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73ba35c-7d701399-648331-7b74f9cb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|19e71566-fc2a6165-eb20fdf5-743438bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:53.510101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19e71566-fc2a6165-eb20fdf5-743438bf_0] Write session: try to update token
2025-09-30T14:50:53.510118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19e71566-fc2a6165-eb20fdf5-743438bf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:53.518777Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:53.518802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:53.518804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:53.518808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:53.518817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894816251103986:3357]
2025-09-30T14:50:53.518821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894816251103986:3357]
2025-09-30T14:50:53.518824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894816251103986:3357]
2025-09-30T14:50:53.518868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:53.518870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:53.518876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:53.518879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.518880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:53.518882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:53.519055Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:53.525181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 212 sessionId: src_id|19e71566-fc2a6165-eb20fdf5-743438bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:53.527952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:53.576916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894816340828158:3696]
2025-09-30T14:50:53.577182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 211, pipe: [1:7555894816340828158:3696]
2025-09-30T14:50:53.634340Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:53.634705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:53.634721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:53.634762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894816340828158:3696], now have 1 active actors on pipe
2025-09-30T14:50:53.634979Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:53.634985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:53.635000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:53.635023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894816340828158:3696]
2025-09-30T14:50:53.635048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:53.635064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 212 reason: error at write: Disconnected sessionId: src_id|19e71566-fc2a6165-eb20fdf5-743438bf_0
2025-09-30T14:50:53.635280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 212 sessionId: src_id|19e71566-fc2a6165-eb20fdf5-743438bf_0 is DEAD
2025-09-30T14:50:53.635401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19e71566-fc2a6165-eb20fdf5-743438bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:53.635418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19e71566-fc2a6165-eb20fdf5-743438bf_0] Write session will restart in 0.009763s
2025-09-30T14:50:53.635440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19e71566-fc2a6165-eb20fdf5-743438bf_0] Write session: Do CDS request
2025-09-30T14:50:53.635446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19e71566-fc2a6165-eb20fdf5-743438bf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:53.646848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19e71566-fc2a6165-eb20fdf5-743438bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:53.646903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:53.646921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 213
2025-09-30T14:50:53.647072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 213 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:53.647122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 213 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:53.647132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=213 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:53.647136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:53.647674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 213 sessionId:  describe result for acl check
2025-09-30T14:50:53.647709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:53.647711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:53.647713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:53.647720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894816340828260:3761] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:53.648251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894816340828260:3761] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:53.651346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894816340828260:3761] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:53.653112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:53.654332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:53.654477Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:53.654485Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:53.654493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:53.654528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:53.654556Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894816251104289:3371]
2025-09-30T14:50:53.654860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894816340828260:3761] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:53.654873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894816340828260:3761] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:53.654877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894816340828260:3761] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:53.654884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 213 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:53.655008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:53.655264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:53.655312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:53.655599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:53.655647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:53.655654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:53.655654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:53.655655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:53.655656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:53.655656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:53.655657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:53.655658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:53.655659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:53.655659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:53.655660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.655660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.655661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.655662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:53.655662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:53.655666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:53.655672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:53.655674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:53.655677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:53.655679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:53.655682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:53.655684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:53.655686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:53.655688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:53.655691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:53.655693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.655695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.655697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.655699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:53.655701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:53.655707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:53.655712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:53.655715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:53.655719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:53.655722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:53.655725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:53.655727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:53.655730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:53.655733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:53.655736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:53.655738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:53.655742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:53.655744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:53.655747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:53.655750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:53.655753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:53.655762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:53.655766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:53.655769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:53.655772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:53.655775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.655778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.655781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.655783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.655786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.655789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.655791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:53.655794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:53.655796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:53.655800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:53.655822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:53.661117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:53.662001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:53.662013Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:53.662014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:53.662017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:53.662021Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 212 [2:7555894816251104289:3371]
2025-09-30T14:50:53.662033Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:53.662045Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:53.662047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.662048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.662050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.662061Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:53.662067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:53.662073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:53.662118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.662123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.662124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.662126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:53.662128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:53.662185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:53.662192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.662199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.662206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.662215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:53.662229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894816340828423:3761], now have 1 active actors on pipe
2025-09-30T14:50:53.662231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894816340828159:2454], now have 1 active actors on pipe
2025-09-30T14:50:53.662236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894816251104284:3371]
2025-09-30T14:50:53.662237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894816251104284:3371]
2025-09-30T14:50:53.662239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894816251104284:3371]
2025-09-30T14:50:53.662248Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:53.662257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:53.662263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:53.662267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:53.662269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:53.662274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:53.662276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:53.662291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894816251104284:3371]
2025-09-30T14:50:53.662293Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:53.662285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 212
2025-09-30T14:50:53.662296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 212
2025-09-30T14:50:53.662317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:53.662320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:53.662324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:53.662347Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4565d53-8b667e5-9b18565b-21883dd6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:53.662352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.662355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.662356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:53.662363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.662369Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:53.662378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:53.662786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:53.662797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:53.662814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:53.662925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 213 partition: 0 MaxSeqNo: 42 sessionId: src_id|e4565d53-8b667e5-9b18565b-21883dd6_0
2025-09-30T14:50:53.663316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19e71566-fc2a6165-eb20fdf5-743438bf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e4565d53-8b667e5-9b18565b-21883dd6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:53.665998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4565d53-8b667e5-9b18565b-21883dd6_0] Write session: try to update token
2025-09-30T14:50:53.666012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4565d53-8b667e5-9b18565b-21883dd6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:53.674099Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:53.674118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:53.674120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:53.674123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:53.674134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894816251104284:3371]
2025-09-30T14:50:53.674139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894816251104284:3371]
2025-09-30T14:50:53.674143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894816251104284:3371]
2025-09-30T14:50:53.674183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:53.674185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:53.674190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:53.674195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.674198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:53.674200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:53.674336Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:53.680424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 213 sessionId: src_id|e4565d53-8b667e5-9b18565b-21883dd6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:53.683262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:53.735106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894816340828434:3696]
2025-09-30T14:50:53.735378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 212, pipe: [1:7555894816340828434:3696]
2025-09-30T14:50:53.780386Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:53.780652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:53.780666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:53.780707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894816340828434:3696], now have 1 active actors on pipe
2025-09-30T14:50:53.780894Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:53.780976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:53.781051Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:53.781063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 213 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e4565d53-8b667e5-9b18565b-21883dd6_0
2025-09-30T14:50:53.781107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894816340828434:3696]
2025-09-30T14:50:53.781244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 213 sessionId: src_id|e4565d53-8b667e5-9b18565b-21883dd6_0 is DEAD
2025-09-30T14:50:53.781365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4565d53-8b667e5-9b18565b-21883dd6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:53.781372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4565d53-8b667e5-9b18565b-21883dd6_0] Write session will restart in 0.007353s
2025-09-30T14:50:53.781395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4565d53-8b667e5-9b18565b-21883dd6_0] Write session: Do CDS request
2025-09-30T14:50:53.781401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4565d53-8b667e5-9b18565b-21883dd6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:53.789715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4565d53-8b667e5-9b18565b-21883dd6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:53.789830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:53.789843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 214
2025-09-30T14:50:53.789967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 214 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:53.789999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 214 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:53.790016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=214 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:53.790020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:53.790408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 214 sessionId:  describe result for acl check
2025-09-30T14:50:53.790437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:53.790439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:53.790440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:53.790446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894816340828480:3766] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:53.790993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894816340828480:3766] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:53.793360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894816340828480:3766] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:53.796454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894816340828480:3766] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:53.796470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894816340828480:3766] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:53.796474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894816340828480:3766] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:53.796482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 214 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:53.799947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:53.801348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:53.801525Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:53.801534Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:53.801542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:53.801577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:53.801606Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894816251104570:3374]
2025-09-30T14:50:53.802032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:53.802277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:53.802304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:53.802516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:53.802556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:53.802561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:53.802562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:53.802562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:53.802563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:53.802564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:53.802565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:53.802565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:53.802566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:53.802566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:53.802567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.802568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.802569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.802569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:53.802570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:53.802573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:53.802580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:53.802582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:53.802585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:53.802587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:53.802589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:53.802591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:53.802594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:53.802596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:53.802598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:53.802601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.802603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.802605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.802608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:53.802610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:53.802614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:53.802620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:53.802638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:53.802642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:53.802644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:53.802647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:53.802649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:53.802652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:53.802655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:53.802658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:53.802661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:53.802663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:53.802666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:53.802669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:53.802672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:53.802677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:53.802681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:53.802686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:53.802689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:53.802694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:53.802699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.802704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.802708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.802711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.802714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.802716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.802719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:53.802722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:53.802724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:53.802727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:53.802750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:53.808057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:53.808994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:53.809010Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:53.809012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:53.809016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:53.809023Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 213 [2:7555894816251104570:3374]
2025-09-30T14:50:53.809040Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:53.809058Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:53.809067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.809070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.809072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.809086Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:53.809092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:53.809100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:53.809156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.809163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.809165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.809169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:53.809171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:53.809240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:53.809248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.809260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.809276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.809298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:53.809320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894816340828447:2454], now have 1 active actors on pipe
2025-09-30T14:50:53.809330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894816340828631:3766], now have 1 active actors on pipe
2025-09-30T14:50:53.809338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894816251104565:3374]
2025-09-30T14:50:53.809340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894816251104565:3374]
2025-09-30T14:50:53.809342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894816251104565:3374]
2025-09-30T14:50:53.809355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:53.809369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:53.809378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:53.809381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:53.809383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:53.809384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:53.809356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 213
2025-09-30T14:50:53.809388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:53.809368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 213
2025-09-30T14:50:53.809429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:53.809438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:53.809450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894816251104565:3374]
2025-09-30T14:50:53.809460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:53.809474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:53.809489Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14b5a3b4-1431060d-920c2b3-8a74f68d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:53.809496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.809504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.809506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:53.809515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.809523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:53.809550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:53.809723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:53.809731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:53.809744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:53.809831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 214 partition: 0 MaxSeqNo: 42 sessionId: src_id|14b5a3b4-1431060d-920c2b3-8a74f68d_0
2025-09-30T14:50:53.810235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4565d53-8b667e5-9b18565b-21883dd6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|14b5a3b4-1431060d-920c2b3-8a74f68d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:53.813131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14b5a3b4-1431060d-920c2b3-8a74f68d_0] Write session: try to update token
2025-09-30T14:50:53.813148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14b5a3b4-1431060d-920c2b3-8a74f68d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:53.821347Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:53.821367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:53.821370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:53.821372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:53.821382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894816251104565:3374]
2025-09-30T14:50:53.821387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894816251104565:3374]
2025-09-30T14:50:53.821391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894816251104565:3374]
2025-09-30T14:50:53.821429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:53.821439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.821438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:53.821441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:53.821444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:53.821448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:53.821604Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:53.828855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 214 sessionId: src_id|14b5a3b4-1431060d-920c2b3-8a74f68d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:53.831677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:53.881012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894816340828722:3696]
2025-09-30T14:50:53.881287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 213, pipe: [1:7555894816340828722:3696]
2025-09-30T14:50:53.930242Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:53.930526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:53.930539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:53.930557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894816340828722:3696], now have 1 active actors on pipe
2025-09-30T14:50:53.930770Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:53.930790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:53.930832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894816340828722:3696]
2025-09-30T14:50:53.930848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:53.930931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 214 reason: status is not ok: tablet will be restarted right now sessionId: src_id|14b5a3b4-1431060d-920c2b3-8a74f68d_0
2025-09-30T14:50:53.931139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 214 sessionId: src_id|14b5a3b4-1431060d-920c2b3-8a74f68d_0 is DEAD
2025-09-30T14:50:53.931346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14b5a3b4-1431060d-920c2b3-8a74f68d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:53.931354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14b5a3b4-1431060d-920c2b3-8a74f68d_0] Write session will restart in 0.005200s
2025-09-30T14:50:53.931385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14b5a3b4-1431060d-920c2b3-8a74f68d_0] Write session: Do CDS request
2025-09-30T14:50:53.931392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14b5a3b4-1431060d-920c2b3-8a74f68d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:53.937777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14b5a3b4-1431060d-920c2b3-8a74f68d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:53.937889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:53.937909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 215
2025-09-30T14:50:53.938020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 215 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:53.938051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 215 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:53.938060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=215 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:53.938071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:53.938503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 215 sessionId:  describe result for acl check
2025-09-30T14:50:53.938533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:53.938540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:53.938542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:53.938548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894816340828737:3770] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:53.939101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894816340828737:3770] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:53.941838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894816340828737:3770] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:53.945151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894816340828737:3770] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:53.945168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894816340828737:3770] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:53.945171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894816340828737:3770] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:53.945179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 215 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:53.950257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:53.951271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:53.951492Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:53.951503Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:53.951515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:53.951569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:53.951610Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894816251104837:3376]
2025-09-30T14:50:53.952225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:53.952609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:53.952644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:53.952942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:53.952991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:53.952997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:53.952998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:53.952998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:53.953000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:53.953000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:53.953001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:53.953003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:53.953004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:53.953005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:53.953006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.953007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.953008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.953009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:53.953009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:53.953014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:53.953023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:53.953027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:53.953030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:53.953034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:53.953038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:53.953041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:53.953045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:53.953048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:53.953053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:53.953056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.953060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.953063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.953066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:53.953069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:53.953076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:53.953083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:53.953089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:53.953093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:53.953097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:53.953101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:53.953105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:53.953109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:53.953114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:53.953119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:53.953123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:53.953127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:53.953131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:53.953135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:53.953139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:53.953144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:53.953148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:53.953152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:53.953156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:53.953160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:53.953164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.953169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.953172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.953177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.953181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.953186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.953190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:53.953194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:53.953198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:53.953208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:53.953246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:53.958486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:53.959392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:53.959414Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:53.959417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:53.959421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:53.959428Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 214 [2:7555894816251104837:3376]
2025-09-30T14:50:53.959444Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:53.959466Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:53.959474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.959477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.959479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.959495Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:53.959506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:53.959513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:53.959575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.959584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.959587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.959590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:53.959592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:53.959661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:53.959669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.959682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:53.959700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:53.959723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:53.959748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894816340828867:3770], now have 1 active actors on pipe
2025-09-30T14:50:53.959757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894816340828723:2454], now have 1 active actors on pipe
2025-09-30T14:50:53.959763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894816251104832:3376]
2025-09-30T14:50:53.959766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894816251104832:3376]
2025-09-30T14:50:53.959769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894816251104832:3376]
2025-09-30T14:50:53.959779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:53.959798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:53.959776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 214
2025-09-30T14:50:53.959802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:53.959806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:53.959783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 214
2025-09-30T14:50:53.959809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:53.959818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:53.959821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:53.959867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:53.959878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:53.959891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894816251104832:3376]
2025-09-30T14:50:53.959904Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:53.959926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:53.959940Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad87fe4e-c30dc12a-43cd504f-2bf4f1e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:53.959946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.959956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.959959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:53.959969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.959982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:53.960012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:53.960157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:53.960168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:53.960185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:53.960266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 215 partition: 0 MaxSeqNo: 42 sessionId: src_id|ad87fe4e-c30dc12a-43cd504f-2bf4f1e5_0
2025-09-30T14:50:53.960671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14b5a3b4-1431060d-920c2b3-8a74f68d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ad87fe4e-c30dc12a-43cd504f-2bf4f1e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:53.963451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad87fe4e-c30dc12a-43cd504f-2bf4f1e5_0] Write session: try to update token
2025-09-30T14:50:53.963469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad87fe4e-c30dc12a-43cd504f-2bf4f1e5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:53.971907Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:53.971933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:53.971936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:53.971939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:53.971953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894816251104832:3376]
2025-09-30T14:50:53.971960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894816251104832:3376]
2025-09-30T14:50:53.971967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894816251104832:3376]
2025-09-30T14:50:53.972018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:53.972018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:53.972025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:53.972029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:53.972033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:53.972037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:53.972222Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:53.977669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 215 sessionId: src_id|ad87fe4e-c30dc12a-43cd504f-2bf4f1e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:53.980442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:54.031031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894820635796306:3696]
2025-09-30T14:50:54.031269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 214, pipe: [1:7555894820635796306:3696]
2025-09-30T14:50:54.074305Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:54.074888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:54.074902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:54.074918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894820635796306:3696], now have 1 active actors on pipe
2025-09-30T14:50:54.075137Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:54.075215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894820635796306:3696]
2025-09-30T14:50:54.075230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:54.075234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:54.075271Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:54.075312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 215 reason: error at write: Disconnected sessionId: src_id|ad87fe4e-c30dc12a-43cd504f-2bf4f1e5_0
2025-09-30T14:50:54.075512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 215 sessionId: src_id|ad87fe4e-c30dc12a-43cd504f-2bf4f1e5_0 is DEAD
2025-09-30T14:50:54.075638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad87fe4e-c30dc12a-43cd504f-2bf4f1e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:54.075647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad87fe4e-c30dc12a-43cd504f-2bf4f1e5_0] Write session will restart in 0.008035s
2025-09-30T14:50:54.075665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad87fe4e-c30dc12a-43cd504f-2bf4f1e5_0] Write session: Do CDS request
2025-09-30T14:50:54.075672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad87fe4e-c30dc12a-43cd504f-2bf4f1e5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:54.084809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad87fe4e-c30dc12a-43cd504f-2bf4f1e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:54.084891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:54.084905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 216
2025-09-30T14:50:54.085063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 216 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:54.085096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 216 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:54.085102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=216 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:54.085106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:54.085743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 216 sessionId:  describe result for acl check
2025-09-30T14:50:54.085782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:54.085789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:54.085791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:54.085798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894820635796344:3776] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:54.086322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894820635796344:3776] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:54.089333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894820635796344:3776] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:54.092407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894820635796344:3776] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:54.092423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894820635796344:3776] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:54.092427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894820635796344:3776] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:54.092435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 216 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:54.094139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:54.095734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:54.095991Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:54.096006Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:54.096017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:54.096088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:54.096142Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894820546072405:3379]
2025-09-30T14:50:54.096817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:54.097125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:54.097173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:54.097515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:54.097581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:54.097587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:54.097588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:54.097590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:54.097591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:54.097592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:54.097593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:54.097595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:54.097596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:54.097597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:54.097599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.097600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.097602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.097603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:54.097604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:54.097610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:54.097621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:54.097626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:54.097631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:54.097635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:54.097640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:54.097644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:54.097648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:54.097652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:54.097657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:54.097661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.097666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.097670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.097674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:54.097679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:54.097692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:54.097700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:54.097711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:54.097717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:54.097726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:54.097737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:54.097745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:54.097755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:54.097765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:54.097775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:54.097785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:54.097797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:54.097802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:54.097808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:54.097813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:54.097818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:54.097824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:54.097834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:54.097839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:54.097845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:54.097854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.097860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.097865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.097875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.097880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.097890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.097894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:54.097904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:54.097909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:54.097915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:54.097967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:54.103586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:54.104462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:54.104483Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:54.104485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:54.104489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:54.104495Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 215 [2:7555894820546072405:3379]
2025-09-30T14:50:54.104511Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:54.104527Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:54.104535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.104537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.104540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.104556Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:54.104567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:54.104574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:54.104638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.104647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.104649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.104653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:54.104655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:54.104722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:54.104729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.104743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.104758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.104779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:54.104803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894820635796553:3776], now have 1 active actors on pipe
2025-09-30T14:50:54.104811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894820635796307:2454], now have 1 active actors on pipe
2025-09-30T14:50:54.104817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894820546072400:3379]
2025-09-30T14:50:54.104819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894820546072400:3379]
2025-09-30T14:50:54.104821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894820546072400:3379]
2025-09-30T14:50:54.104838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:54.104856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:54.104867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:54.104871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:54.104875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:54.104878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:54.104881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:54.104858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 215
2025-09-30T14:50:54.104887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 215
2025-09-30T14:50:54.104909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894820546072400:3379]
2025-09-30T14:50:54.104918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:54.104920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:54.104933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:54.104942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:54.104989Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8653e398-7cfba1d5-91d48141-b1cecff7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:54.105001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.105005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.105012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:54.105022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.105036Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:54.105059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:54.105176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:54.105185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:54.105199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:54.105294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 216 partition: 0 MaxSeqNo: 42 sessionId: src_id|8653e398-7cfba1d5-91d48141-b1cecff7_0
2025-09-30T14:50:54.105675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad87fe4e-c30dc12a-43cd504f-2bf4f1e5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8653e398-7cfba1d5-91d48141-b1cecff7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:54.108428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8653e398-7cfba1d5-91d48141-b1cecff7_0] Write session: try to update token
2025-09-30T14:50:54.108445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8653e398-7cfba1d5-91d48141-b1cecff7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:54.116843Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:54.116861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:54.116863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:54.116864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:54.116872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894820546072400:3379]
2025-09-30T14:50:54.116876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894820546072400:3379]
2025-09-30T14:50:54.116878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894820546072400:3379]
2025-09-30T14:50:54.116911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:54.116916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.116918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:54.116941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:54.116958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:54.116963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:54.117049Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:54.122927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 216 sessionId: src_id|8653e398-7cfba1d5-91d48141-b1cecff7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:54.125733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:54.175425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894820635796585:3696]
2025-09-30T14:50:54.175693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 215, pipe: [1:7555894820635796585:3696]
2025-09-30T14:50:54.230107Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:54.230956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:54.230974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:54.231006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894820635796585:3696], now have 1 active actors on pipe
2025-09-30T14:50:54.231180Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:54.231200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:54.231214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:54.231213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:54.231274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894820635796585:3696]
2025-09-30T14:50:54.231289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 216 reason: error at write: Disconnected sessionId: src_id|8653e398-7cfba1d5-91d48141-b1cecff7_0
2025-09-30T14:50:54.231460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 216 sessionId: src_id|8653e398-7cfba1d5-91d48141-b1cecff7_0 is DEAD
2025-09-30T14:50:54.231590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8653e398-7cfba1d5-91d48141-b1cecff7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:54.231601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8653e398-7cfba1d5-91d48141-b1cecff7_0] Write session will restart in 0.008000s
2025-09-30T14:50:54.231646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8653e398-7cfba1d5-91d48141-b1cecff7_0] Write session: Do CDS request
2025-09-30T14:50:54.231652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8653e398-7cfba1d5-91d48141-b1cecff7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:54.240797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8653e398-7cfba1d5-91d48141-b1cecff7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:54.240891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:54.240909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 217
2025-09-30T14:50:54.241046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 217 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:54.241087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 217 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:54.241096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=217 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:54.241100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:54.241579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 217 sessionId:  describe result for acl check
2025-09-30T14:50:54.241619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:54.241625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:54.241628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:54.241634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894820635796616:3780] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:54.242239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894820635796616:3780] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:54.245673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894820635796616:3780] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:54.249087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894820635796616:3780] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:54.249103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894820635796616:3780] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:54.249107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894820635796616:3780] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:54.249115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 217 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:54.250888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:54.252365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:54.252516Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:54.252526Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:54.252533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:54.252568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:54.252599Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894820546072676:3381]
2025-09-30T14:50:54.253026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:54.253250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:54.253276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:54.253500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:54.253555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:54.253561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:54.253561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:54.253562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:54.253563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:54.253563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:54.253564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:54.253565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:54.253565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:54.253566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:54.253567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.253567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.253568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.253569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:54.253569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:54.253573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:54.253584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:54.253588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:54.253592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:54.253596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:54.253600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:54.253604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:54.253608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:54.253612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:54.253618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:54.253622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.253626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.253629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.253631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:54.253633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:54.253639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:54.253644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:54.253648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:54.253651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:54.253654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:54.253657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:54.253659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:54.253662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:54.253664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:54.253667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:54.253670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:54.253673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:54.253675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:54.253678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:54.253680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:54.253683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:54.253687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:54.253691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:54.253693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:54.253696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:54.253698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.253701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.253703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.253706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.253708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.253711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.253714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:54.253716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:54.253718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:54.253721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:54.253745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:54.259209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:54.260366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:54.260389Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:54.260392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:54.260395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:54.260403Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 216 [2:7555894820546072676:3381]
2025-09-30T14:50:54.260419Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:54.260441Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:54.260449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.260452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.260455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.260471Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:54.260483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:54.260500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:54.260572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.260582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.260584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.260588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:54.260591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:54.260660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:54.260670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.260685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.260702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.260725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:54.260749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894820635796836:3780], now have 1 active actors on pipe
2025-09-30T14:50:54.260758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894820635796586:2454], now have 1 active actors on pipe
2025-09-30T14:50:54.260765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894820546072671:3381]
2025-09-30T14:50:54.260772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894820546072671:3381]
2025-09-30T14:50:54.260775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894820546072671:3381]
2025-09-30T14:50:54.260790Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:54.260792Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 216
2025-09-30T14:50:54.260808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:54.260799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 216
2025-09-30T14:50:54.260811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:54.260822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:54.260824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:54.260830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:54.260834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:54.260886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:54.260891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:54.260903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894820546072671:3381]
2025-09-30T14:50:54.260919Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:54.260932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:54.260954Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0e5bb9d-af5fce37-2384ff06-4e30e952_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:54.260961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.260965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.260966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:54.260974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.260986Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:54.261013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:54.261178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:54.261188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:54.261203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:54.261289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 217 partition: 0 MaxSeqNo: 42 sessionId: src_id|b0e5bb9d-af5fce37-2384ff06-4e30e952_0
2025-09-30T14:50:54.261676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8653e398-7cfba1d5-91d48141-b1cecff7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b0e5bb9d-af5fce37-2384ff06-4e30e952_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:54.264497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e5bb9d-af5fce37-2384ff06-4e30e952_0] Write session: try to update token
2025-09-30T14:50:54.264513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e5bb9d-af5fce37-2384ff06-4e30e952_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:54.273236Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:54.273261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:54.273263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:54.273265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:54.273273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894820546072671:3381]
2025-09-30T14:50:54.273277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894820546072671:3381]
2025-09-30T14:50:54.273280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894820546072671:3381]
2025-09-30T14:50:54.273318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:54.273326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.273329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:54.273338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:54.273344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:54.273349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:54.273477Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:54.279173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 217 sessionId: src_id|b0e5bb9d-af5fce37-2384ff06-4e30e952_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:54.281786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:54.331603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894820635796865:3696]
2025-09-30T14:50:54.331863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 216, pipe: [1:7555894820635796865:3696]
2025-09-30T14:50:54.381441Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:54.381683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:54.381695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:54.381727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894820635796865:3696], now have 1 active actors on pipe
2025-09-30T14:50:54.381976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894820635796865:3696]
2025-09-30T14:50:54.381977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:54.381982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:54.382007Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:54.382044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 217 reason: error at write: Disconnected sessionId: src_id|b0e5bb9d-af5fce37-2384ff06-4e30e952_0
2025-09-30T14:50:54.382033Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:54.382245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 217 sessionId: src_id|b0e5bb9d-af5fce37-2384ff06-4e30e952_0 is DEAD
2025-09-30T14:50:54.382405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e5bb9d-af5fce37-2384ff06-4e30e952_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:54.382414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e5bb9d-af5fce37-2384ff06-4e30e952_0] Write session will restart in 0.005777s
2025-09-30T14:50:54.382444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e5bb9d-af5fce37-2384ff06-4e30e952_0] Write session: Do CDS request
2025-09-30T14:50:54.382452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e5bb9d-af5fce37-2384ff06-4e30e952_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:54.389755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e5bb9d-af5fce37-2384ff06-4e30e952_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:54.389860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:54.389885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 218
2025-09-30T14:50:54.389988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 218 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:54.390026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 218 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:54.390036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=218 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:54.390040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:54.390420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 218 sessionId:  describe result for acl check
2025-09-30T14:50:54.390451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:54.390457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:54.390459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:54.390466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894820635796884:3784] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:54.390943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894820635796884:3784] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:54.393407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894820635796884:3784] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:54.396783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894820635796884:3784] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:54.396798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894820635796884:3784] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:54.396801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894820635796884:3784] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:54.396824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 218 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:54.400529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:54.402008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:54.402185Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:54.402194Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:54.402204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:54.402253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:54.402302Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894820546072948:3383]
2025-09-30T14:50:54.402963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:54.403345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:54.403391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:54.403675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:54.403723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:54.403728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:54.403729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:54.403730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:54.403731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:54.403731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:54.403732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:54.403733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:54.403734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:54.403735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:54.403735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.403736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.403737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.403738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:54.403739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:54.403745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:54.403755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:54.403758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:54.403763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:54.403767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:54.403771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:54.403775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:54.403779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:54.403783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:54.403787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:54.403791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.403794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.403796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.403799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:54.403801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:54.403807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:54.403812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:54.403816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:54.403819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:54.403821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:54.403824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:54.403826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:54.403829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:54.403832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:54.403835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:54.403837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:54.403840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:54.403842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:54.403845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:54.403848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:54.403850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:54.403853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:54.403856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:54.403858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:54.403869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:54.403872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.403875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.403879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.403882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.403885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.403888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.403890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:54.403893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:54.403896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:54.403898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:54.403922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:54.409222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:54.410135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:54.410146Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:54.410148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:54.410151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:54.410156Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 217 [2:7555894820546072948:3383]
2025-09-30T14:50:54.410169Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:54.410180Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:54.410182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.410184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.410186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.410200Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:54.410207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:54.410213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:54.410267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.410274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.410277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.410280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:54.410283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:54.410335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:54.410342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.410350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.410357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.410367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:54.410379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894820546072943:3383]
2025-09-30T14:50:54.410380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894820546072943:3383]
2025-09-30T14:50:54.410381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894820546072943:3383]
2025-09-30T14:50:54.410387Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:54.410400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894820635796866:2454], now have 1 active actors on pipe
2025-09-30T14:50:54.410399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:54.410403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:54.410404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:54.410406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894820635797054:3784], now have 1 active actors on pipe
2025-09-30T14:50:54.410411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:54.410423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:54.410426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:54.410456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894820546072943:3383]
2025-09-30T14:50:54.410468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:54.410473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:54.410487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 217
2025-09-30T14:50:54.410520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:54.410530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:54.410552Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6149ec48-cee9c5a4-d4b1353d-f74c106b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:54.410563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.410571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.410573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:54.410582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.410593Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:54.410591Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 217
2025-09-30T14:50:54.410605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:54.410740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:54.410748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:54.410761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:54.410840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 218 partition: 0 MaxSeqNo: 42 sessionId: src_id|6149ec48-cee9c5a4-d4b1353d-f74c106b_0
2025-09-30T14:50:54.411209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e5bb9d-af5fce37-2384ff06-4e30e952_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6149ec48-cee9c5a4-d4b1353d-f74c106b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:54.413944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6149ec48-cee9c5a4-d4b1353d-f74c106b_0] Write session: try to update token
2025-09-30T14:50:54.413961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6149ec48-cee9c5a4-d4b1353d-f74c106b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:54.421812Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:54.421832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:54.421842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894820546072943:3383]
2025-09-30T14:50:54.421883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:54.421887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:54.422049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:54.422194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:54.422335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:54.422474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:54.422679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:54.422723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:54.428005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 218 sessionId: src_id|6149ec48-cee9c5a4-d4b1353d-f74c106b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:54.430944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:54.431469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:54.431487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:54.431523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:54.431583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:54.433291Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:54.433316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:54.433318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:54.433320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:54.433331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894820546072943:3383]
2025-09-30T14:50:54.433336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894820546072943:3383]
2025-09-30T14:50:54.433341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894820546072943:3383]
2025-09-30T14:50:54.433385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:54.433390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:54.433393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.433396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:54.433397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:54.433401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:54.433596Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:54.482103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894820635797148:3696]
2025-09-30T14:50:54.482406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 217, pipe: [1:7555894820635797148:3696]
2025-09-30T14:50:54.545528Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:54.553319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:54.553342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:54.553520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:54.553592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:54.553662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:54.553734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:54.553784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:54.553793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:54.553871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:54.553943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:54.554011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:54.554087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:54.554132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:54.554140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:54.554216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:54.554286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:54.554355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:54.554424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:54.554472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:54.554480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:54.554549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:54.554633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:54.554711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:54.554779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:54.554896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:54.554905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:54.554975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:54.555043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:54.555107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:54.555182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:54.555229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:54.555240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:54.555333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:54.555401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:54.555469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:54.555544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:54.555593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:54.555600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:54.555669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:54.555741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:54.555811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:54.555882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:54.555933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:54.555942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:54.556013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:54.556079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:54.556146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:54.556216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:54.556260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:54.556267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:54.556342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:54.556407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:54.556474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:54.556541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:54.556588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:54.556596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:54.556665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:54.556730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:54.556800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:54.556866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:54.556995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:54.557004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:54.557071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894820635797148:3696], now have 1 active actors on pipe
2025-09-30T14:50:54.557292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894820635797148:3696]
2025-09-30T14:50:54.557338Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:54.557374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:54.557382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:54.557405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 218 reason: error at write: Disconnected sessionId: src_id|6149ec48-cee9c5a4-d4b1353d-f74c106b_0
2025-09-30T14:50:54.557612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 218 sessionId: src_id|6149ec48-cee9c5a4-d4b1353d-f74c106b_0 is DEAD
2025-09-30T14:50:54.557786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6149ec48-cee9c5a4-d4b1353d-f74c106b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:54.557792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6149ec48-cee9c5a4-d4b1353d-f74c106b_0] Write session will restart in 0.007400s
2025-09-30T14:50:54.557808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6149ec48-cee9c5a4-d4b1353d-f74c106b_0] Write session: Do CDS request
2025-09-30T14:50:54.557812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6149ec48-cee9c5a4-d4b1353d-f74c106b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:54.558238Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:54.566836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6149ec48-cee9c5a4-d4b1353d-f74c106b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:54.566935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:54.566950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 219
2025-09-30T14:50:54.567089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 219 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:54.567118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 219 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:54.567129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=219 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:54.567132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:54.567844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 219 sessionId:  describe result for acl check
2025-09-30T14:50:54.567880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:54.567886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:54.567888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:54.567892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894820635797190:3795] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:54.568363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894820635797190:3795] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:54.571228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894820635797190:3795] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:54.574639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894820635797190:3795] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:54.574658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894820635797190:3795] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:54.574662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894820635797190:3795] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:54.574670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 219 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:54.578490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:54.580030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:54.580331Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:54.580340Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:54.580352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:54.580403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:54.580439Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894820546073236:3392]
2025-09-30T14:50:54.581083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:54.581527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:54.581565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:54.581848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:54.581892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:54.581897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:54.581898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:54.581898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:54.581899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:54.581900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:54.581901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:54.581901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:54.581902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:54.581903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:54.581903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.581904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.581905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.581905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:54.581906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:54.581910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:54.581916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:54.581918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:54.581921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:54.581923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:54.581925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:54.581928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:54.581930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:54.581933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:54.581935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:54.581937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.581939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.581942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.581944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:54.581946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:54.581951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:54.581956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:54.581960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:54.581965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:54.581967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:54.581970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:54.581973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:54.581976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:54.581978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:54.581981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:54.581983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:54.581986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:54.581989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:54.581992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:54.581994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:54.581997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:54.581999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:54.582002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:54.582005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:54.582008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:54.582010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.582013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.582015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.582019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.582021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.582026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.582030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:54.582036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:54.582040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:54.582044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:54.582074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:54.587465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:54.588671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:54.588688Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:54.588690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:54.588694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:54.588700Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 218 [2:7555894820546073236:3392]
2025-09-30T14:50:54.588720Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:54.588739Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:54.588746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.588748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.588750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.588766Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:54.588776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:54.588783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:54.588835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.588843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.588845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.588848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:54.588850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:54.588913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:54.588920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.588933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.588951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.588974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:54.588995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894820635797346:3795], now have 1 active actors on pipe
2025-09-30T14:50:54.589003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894820635797162:2454], now have 1 active actors on pipe
2025-09-30T14:50:54.589010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894820546073231:3392]
2025-09-30T14:50:54.589017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894820546073231:3392]
2025-09-30T14:50:54.589019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894820546073231:3392]
2025-09-30T14:50:54.589032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:54.589050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:54.589046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:54.589058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:54.589060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:54.589069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:54.589072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:54.589072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 218
2025-09-30T14:50:54.589102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894820546073231:3392]
2025-09-30T14:50:54.589109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:54.589111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:54.589124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:54.589080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 218
2025-09-30T14:50:54.589129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:54.589178Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d46bd229-45ef76b-790631f0-782da0fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:54.589189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.589197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.589199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:54.589207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.589221Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:54.589243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:54.589416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:54.589429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:54.589460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:54.589549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 219 partition: 0 MaxSeqNo: 42 sessionId: src_id|d46bd229-45ef76b-790631f0-782da0fb_0
2025-09-30T14:50:54.589943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6149ec48-cee9c5a4-d4b1353d-f74c106b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d46bd229-45ef76b-790631f0-782da0fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:54.592792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d46bd229-45ef76b-790631f0-782da0fb_0] Write session: try to update token
2025-09-30T14:50:54.592812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d46bd229-45ef76b-790631f0-782da0fb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:54.601683Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:54.601702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:54.601705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:54.601708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:54.601717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894820546073231:3392]
2025-09-30T14:50:54.601722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894820546073231:3392]
2025-09-30T14:50:54.601725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894820546073231:3392]
2025-09-30T14:50:54.601767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:54.601772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:54.601774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.601777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:54.601778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:54.601785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:54.601969Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:54.607696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 219 sessionId: src_id|d46bd229-45ef76b-790631f0-782da0fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:54.610703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:54.657714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894820635797453:3696]
2025-09-30T14:50:54.657959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 218, pipe: [1:7555894820635797453:3696]
2025-09-30T14:50:54.706248Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:54.706679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:54.706693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:54.706710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894820635797453:3696], now have 1 active actors on pipe
2025-09-30T14:50:54.706916Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:54.706922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:54.706924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:54.706947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:54.706964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894820635797453:3696]
2025-09-30T14:50:54.707001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 219 reason: error at write: Disconnected sessionId: src_id|d46bd229-45ef76b-790631f0-782da0fb_0
2025-09-30T14:50:54.707210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 219 sessionId: src_id|d46bd229-45ef76b-790631f0-782da0fb_0 is DEAD
2025-09-30T14:50:54.707382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d46bd229-45ef76b-790631f0-782da0fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:54.707394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d46bd229-45ef76b-790631f0-782da0fb_0] Write session will restart in 0.008883s
2025-09-30T14:50:54.707415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d46bd229-45ef76b-790631f0-782da0fb_0] Write session: Do CDS request
2025-09-30T14:50:54.707424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d46bd229-45ef76b-790631f0-782da0fb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:54.717744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d46bd229-45ef76b-790631f0-782da0fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:54.717867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:54.717888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 220
2025-09-30T14:50:54.718029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 220 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:54.718062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 220 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:54.718075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=220 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:54.718079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:54.718638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 220 sessionId:  describe result for acl check
2025-09-30T14:50:54.718680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:54.718688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:54.718690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:54.718696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894820635797524:3800] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:54.719264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894820635797524:3800] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:54.721840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894820635797524:3800] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:54.725152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894820635797524:3800] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:54.725165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894820635797524:3800] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:54.725169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894820635797524:3800] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:54.725181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 220 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:54.726539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:54.728155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:54.728332Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:54.728341Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:54.728351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:54.728404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:54.728477Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894820546073545:3401]
2025-09-30T14:50:54.729128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:54.729406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:54.729442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:54.729740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:54.729788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:54.729793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:54.729794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:54.729796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:54.729797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:54.729798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:54.729798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:54.729799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:54.729800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:54.729801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:54.729802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.729803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.729804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.729805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:54.729806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:54.729810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:54.729820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:54.729823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:54.729827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:54.729831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:54.729835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:54.729838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:54.729841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:54.729844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:54.729849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:54.729852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.729856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.729859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.729863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:54.729867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:54.729873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:54.729881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:54.729886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:54.729891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:54.729898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:54.729903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:54.729907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:54.729912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:54.729916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:54.729921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:54.729925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:54.729930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:54.729934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:54.729939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:54.729943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:54.729947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:54.729952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:54.729957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:54.729961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:54.729970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:54.729975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.729980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.729985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.729994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.729998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.730004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.730011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:54.730016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:54.730020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:54.730024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:54.730063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:54.735463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:54.736361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:54.736378Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:54.736380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:54.736384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:54.736391Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 219 [2:7555894820546073545:3401]
2025-09-30T14:50:54.736408Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:54.736425Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:54.736431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.736443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.736445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.736456Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:54.736464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:54.736470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:54.736516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.736523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.736524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.736527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:54.736529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:54.736584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:54.736589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.736598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.736604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.736615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:54.736630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894820546073540:3401]
2025-09-30T14:50:54.736635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894820546073540:3401]
2025-09-30T14:50:54.736636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894820546073540:3401]
2025-09-30T14:50:54.736642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:54.736654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:54.736665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:54.736666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:54.736669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:54.736668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:54.736671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:54.736676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894820635797454:2454], now have 1 active actors on pipe
2025-09-30T14:50:54.736679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894820635797721:3800], now have 1 active actors on pipe
2025-09-30T14:50:54.736703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894820546073540:3401]
2025-09-30T14:50:54.736711Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:54.736721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:54.736748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 219
2025-09-30T14:50:54.736794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 219
2025-09-30T14:50:54.736842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:54.736850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:54.736870Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5499d988-f5d5f83a-6fa054f1-2afd8f1a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:54.736878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.736882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.736884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:54.736896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.736913Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:54.736929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:54.737106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:54.737127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:54.737144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:54.737264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 220 partition: 0 MaxSeqNo: 42 sessionId: src_id|5499d988-f5d5f83a-6fa054f1-2afd8f1a_0
2025-09-30T14:50:54.737681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d46bd229-45ef76b-790631f0-782da0fb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5499d988-f5d5f83a-6fa054f1-2afd8f1a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:54.740446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5499d988-f5d5f83a-6fa054f1-2afd8f1a_0] Write session: try to update token
2025-09-30T14:50:54.740465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5499d988-f5d5f83a-6fa054f1-2afd8f1a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:54.748811Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:54.748830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:54.748833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:54.748835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:54.748845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894820546073540:3401]
2025-09-30T14:50:54.748849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894820546073540:3401]
2025-09-30T14:50:54.748853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894820546073540:3401]
2025-09-30T14:50:54.748892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:54.748904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.748903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:54.748907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:54.748908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:54.748911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:54.749054Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:54.758218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 220 sessionId: src_id|5499d988-f5d5f83a-6fa054f1-2afd8f1a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:54.761088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:54.807167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894820635797748:3696]
2025-09-30T14:50:54.807392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 219, pipe: [1:7555894820635797748:3696]
2025-09-30T14:50:54.856591Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:54.857164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:54.857183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:54.857204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894820635797748:3696], now have 1 active actors on pipe
2025-09-30T14:50:54.857421Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:54.857453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:54.857471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:54.857476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:54.857515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894820635797748:3696]
2025-09-30T14:50:54.857534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 220 reason: error at write: Disconnected sessionId: src_id|5499d988-f5d5f83a-6fa054f1-2afd8f1a_0
2025-09-30T14:50:54.857739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 220 sessionId: src_id|5499d988-f5d5f83a-6fa054f1-2afd8f1a_0 is DEAD
2025-09-30T14:50:54.857855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5499d988-f5d5f83a-6fa054f1-2afd8f1a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:54.857866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5499d988-f5d5f83a-6fa054f1-2afd8f1a_0] Write session will restart in 0.005938s
2025-09-30T14:50:54.857904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5499d988-f5d5f83a-6fa054f1-2afd8f1a_0] Write session: Do CDS request
2025-09-30T14:50:54.857909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5499d988-f5d5f83a-6fa054f1-2afd8f1a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:54.864739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5499d988-f5d5f83a-6fa054f1-2afd8f1a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:54.865040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:54.865059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 221
2025-09-30T14:50:54.865182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 221 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:54.865215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 221 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:54.865219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=221 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:54.865222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:54.865701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 221 sessionId:  describe result for acl check
2025-09-30T14:50:54.865748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:54.865756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:54.865762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:54.865770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894820635797763:3805] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:54.866320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894820635797763:3805] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:54.869367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894820635797763:3805] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:54.872611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894820635797763:3805] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:54.872626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894820635797763:3805] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:54.872630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894820635797763:3805] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:54.872638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 221 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:54.877586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:54.879081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:54.879425Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:54.879436Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:54.879447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:54.879500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:54.879541Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894820546073820:3403]
2025-09-30T14:50:54.880198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:54.880485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:54.880523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:54.880859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:54.880914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:54.880920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:54.880922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:54.880923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:54.880924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:54.880925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:54.880927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:54.880928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:54.880929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:54.880930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:54.880931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.880933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.880934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.880935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:54.880936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:54.880941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:54.880952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:54.880956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:54.880961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:54.880965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:54.880969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:54.880973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:54.880977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:54.880981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:54.880986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:54.880990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.880994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.880998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.881002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:54.881006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:54.881013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:54.881021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:54.881027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:54.881032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:54.881037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:54.881042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:54.881047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:54.881052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:54.881057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:54.881067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:54.881071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:54.881076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:54.881086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:54.881091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:54.881095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:54.881103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:54.881108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:54.881117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:54.881121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:54.881127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:54.881134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.881139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.881147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.881153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.881158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.881163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.881172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:54.881177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:54.881187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:54.881192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:54.881236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:54.886579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:54.887668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:54.887679Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:54.887681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:54.887684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:54.887688Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 220 [2:7555894820546073820:3403]
2025-09-30T14:50:54.887699Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:54.887711Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:54.887713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.887715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.887716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.887728Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:54.887732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:54.887741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:54.887785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.887790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.887791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.887794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:54.887795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:54.887845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:54.887850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.887857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:54.887864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:54.887873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:54.887888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894820546073815:3403]
2025-09-30T14:50:54.887893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894820546073815:3403]
2025-09-30T14:50:54.887895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894820546073815:3403]
2025-09-30T14:50:54.887900Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:54.887910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:54.887911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:54.887916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:54.887918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:54.887922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:54.887924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:54.887931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894820635797902:3805], now have 1 active actors on pipe
2025-09-30T14:50:54.887934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894820635797749:2454], now have 1 active actors on pipe
2025-09-30T14:50:54.887957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894820546073815:3403]
2025-09-30T14:50:54.887964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:54.887972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:54.888051Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 220
2025-09-30T14:50:54.888084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 220
2025-09-30T14:50:54.888141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:54.888154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:54.888181Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a3c01c9-a15db9-cc51528d-d9584eed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:54.888202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.888209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.888212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:54.888223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.888239Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:54.888257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:54.888428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:54.888436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:54.888451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:54.888536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 221 partition: 0 MaxSeqNo: 42 sessionId: src_id|a3c01c9-a15db9-cc51528d-d9584eed_0
2025-09-30T14:50:54.888947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5499d988-f5d5f83a-6fa054f1-2afd8f1a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a3c01c9-a15db9-cc51528d-d9584eed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:54.891833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3c01c9-a15db9-cc51528d-d9584eed_0] Write session: try to update token
2025-09-30T14:50:54.891853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3c01c9-a15db9-cc51528d-d9584eed_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:54.899696Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:54.899714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:54.899717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:54.899719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:54.899729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894820546073815:3403]
2025-09-30T14:50:54.899734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894820546073815:3403]
2025-09-30T14:50:54.899738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894820546073815:3403]
2025-09-30T14:50:54.899779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:54.899786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:54.899787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:54.899789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:54.899792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:54.899797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:54.899930Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:54.906447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 221 sessionId: src_id|a3c01c9-a15db9-cc51528d-d9584eed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:54.909423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:54.957742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894820635798038:3696]
2025-09-30T14:50:54.957902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 220, pipe: [1:7555894820635798038:3696]
2025-09-30T14:50:55.009749Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:55.010116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:55.010129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:55.010162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894820635798038:3696], now have 1 active actors on pipe
2025-09-30T14:50:55.010373Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:55.010435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:55.010443Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:55.010449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:55.010489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894820635798038:3696]
2025-09-30T14:50:55.010513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 221 reason: error at write: Disconnected sessionId: src_id|a3c01c9-a15db9-cc51528d-d9584eed_0
2025-09-30T14:50:55.010697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 221 sessionId: src_id|a3c01c9-a15db9-cc51528d-d9584eed_0 is DEAD
2025-09-30T14:50:55.010833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3c01c9-a15db9-cc51528d-d9584eed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:55.010846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3c01c9-a15db9-cc51528d-d9584eed_0] Write session will restart in 0.005018s
2025-09-30T14:50:55.010869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3c01c9-a15db9-cc51528d-d9584eed_0] Write session: Do CDS request
2025-09-30T14:50:55.010877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3c01c9-a15db9-cc51528d-d9584eed_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:55.016746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3c01c9-a15db9-cc51528d-d9584eed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:55.016863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:55.016879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 222
2025-09-30T14:50:55.017006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 222 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:55.017037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 222 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:55.017044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=222 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:55.017052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:55.017452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 222 sessionId:  describe result for acl check
2025-09-30T14:50:55.017486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:55.017488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:55.017490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:55.017495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894824930765350:3811] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:55.018046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894824930765350:3811] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:55.019961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894824930765350:3811] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:55.023025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894824930765350:3811] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:55.023039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894824930765350:3811] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:55.023042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894824930765350:3811] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:55.023050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 222 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:55.030163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:55.031678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:55.031968Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:55.031990Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:55.032009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:55.032107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:55.032177Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894824841041395:3406]
2025-09-30T14:50:55.033045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:55.033461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:55.033542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:55.034355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:55.034447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:55.034454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:55.034455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:55.034456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:55.034457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:55.034459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:55.034460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:55.034461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:55.034463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:55.034464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:55.034466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.034467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.034468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.034469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:55.034470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:55.034477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:55.034487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:55.034491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:55.034495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:55.034499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:55.034502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:55.034506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:55.034510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:55.034515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:55.034518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:55.034522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.034526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.034530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.034534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:55.034538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:55.034547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:55.034554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:55.034560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:55.034565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:55.034570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:55.034576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:55.034580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:55.034586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:55.034593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:55.034598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:55.034604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:55.034609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:55.034614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:55.034633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:55.034643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:55.034650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:55.034654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:55.034659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:55.034668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:55.034673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:55.034677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.034685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.034690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.034695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.034700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.034709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.034713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:55.034718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:55.034723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:55.034728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:55.034776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:55.040323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:55.041154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:55.041169Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:55.041172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:55.041176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:55.041182Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 221 [2:7555894824841041395:3406]
2025-09-30T14:50:55.041200Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:55.041215Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:55.041218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.041220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.041223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.041239Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:55.041251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:55.041258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:55.041316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.041323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.041325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.041329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:55.041332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:55.041395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:55.041404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.041417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.041430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.041446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:55.041464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894824930765336:2454], now have 1 active actors on pipe
2025-09-30T14:50:55.041470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894824841041390:3406]
2025-09-30T14:50:55.041473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894824841041390:3406]
2025-09-30T14:50:55.041475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894824841041390:3406]
2025-09-30T14:50:55.041489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:55.041498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894824930765430:3811], now have 1 active actors on pipe
2025-09-30T14:50:55.041509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:55.041512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:55.041512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:55.041514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:55.041526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:55.041534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:55.041564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894824841041390:3406]
2025-09-30T14:50:55.041576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:55.041590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:55.041564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 221
2025-09-30T14:50:55.041590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 221
2025-09-30T14:50:55.041812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:55.041823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:55.041856Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|808f4d29-cb8e868c-9acdd8bf-6b608b2f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:55.041867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.041871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.041873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:55.041882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.041897Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:55.041917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:55.042123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:55.042130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:55.042143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:55.042234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 222 partition: 0 MaxSeqNo: 42 sessionId: src_id|808f4d29-cb8e868c-9acdd8bf-6b608b2f_0
2025-09-30T14:50:55.042601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3c01c9-a15db9-cc51528d-d9584eed_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|808f4d29-cb8e868c-9acdd8bf-6b608b2f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:55.045310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|808f4d29-cb8e868c-9acdd8bf-6b608b2f_0] Write session: try to update token
2025-09-30T14:50:55.045326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|808f4d29-cb8e868c-9acdd8bf-6b608b2f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:55.053579Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:55.053596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:55.053599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:55.053602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:55.053610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894824841041390:3406]
2025-09-30T14:50:55.053615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894824841041390:3406]
2025-09-30T14:50:55.053619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894824841041390:3406]
2025-09-30T14:50:55.053659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:55.053665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.053668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:55.053669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:55.053676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:55.053680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:55.053799Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:55.060705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 222 sessionId: src_id|808f4d29-cb8e868c-9acdd8bf-6b608b2f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:55.063487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:55.110831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894824930765621:3696]
2025-09-30T14:50:55.111101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 221, pipe: [1:7555894824930765621:3696]
2025-09-30T14:50:55.165685Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:55.166075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:55.166087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:55.166104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894824930765621:3696], now have 1 active actors on pipe
2025-09-30T14:50:55.166271Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:55.166372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:55.166387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894824930765621:3696]
2025-09-30T14:50:55.166411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:55.166485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 222 reason: status is not ok: tablet will be restarted right now sessionId: src_id|808f4d29-cb8e868c-9acdd8bf-6b608b2f_0
2025-09-30T14:50:55.166703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 222 sessionId: src_id|808f4d29-cb8e868c-9acdd8bf-6b608b2f_0 is DEAD
2025-09-30T14:50:55.166863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|808f4d29-cb8e868c-9acdd8bf-6b608b2f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:55.166871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|808f4d29-cb8e868c-9acdd8bf-6b608b2f_0] Write session will restart in 0.009608s
2025-09-30T14:50:55.166894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|808f4d29-cb8e868c-9acdd8bf-6b608b2f_0] Write session: Do CDS request
2025-09-30T14:50:55.166900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|808f4d29-cb8e868c-9acdd8bf-6b608b2f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:55.177804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|808f4d29-cb8e868c-9acdd8bf-6b608b2f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:55.177885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:55.177901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 223
2025-09-30T14:50:55.178057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 223 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:55.178103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 223 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:55.178112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=223 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:55.178117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:55.178508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 223 sessionId:  describe result for acl check
2025-09-30T14:50:55.178544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:55.178546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:55.178547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:55.178553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894824930765693:3815] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:55.179131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894824930765693:3815] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:55.181435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894824930765693:3815] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:55.184591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894824930765693:3815] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:55.184605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894824930765693:3815] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:55.184608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894824930765693:3815] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:55.184616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 223 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:55.186311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:55.188025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:55.188343Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:55.188356Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:55.188369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:55.188432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:55.188471Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894824841041672:3408]
2025-09-30T14:50:55.189055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:55.189368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:55.189409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:55.189676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:55.189730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:55.189735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:55.189735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:55.189736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:55.189737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:55.189738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:55.189738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:55.189739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:55.189740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:55.189741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:55.189742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.189742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.189743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.189744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:55.189744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:55.189749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:55.189755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:55.189757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:55.189760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:55.189763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:55.189765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:55.189767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:55.189770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:55.189773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:55.189775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:55.189778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.189780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.189782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.189785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:55.189787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:55.189792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:55.189797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:55.189801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:55.189805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:55.189807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:55.189811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:55.189813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:55.189817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:55.189819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:55.189822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:55.189825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:55.189828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:55.189831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:55.189834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:55.189837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:55.189841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:55.189846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:55.189852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:55.189856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:55.189861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:55.189865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.189870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.189875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.189880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.189885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.189891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.189895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:55.189900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:55.189905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:55.189910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:55.189955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:55.195483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:55.196556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:55.196570Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:55.196572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:55.196577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:55.196583Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 222 [2:7555894824841041672:3408]
2025-09-30T14:50:55.196603Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:55.196620Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:55.196627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.196630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.196633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.196648Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:55.196654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:55.196660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:55.196716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.196723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.196725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.196728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:55.196731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:55.196795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:55.196806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.196818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.196831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.196853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:55.196876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894824930765623:2454], now have 1 active actors on pipe
2025-09-30T14:50:55.196883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894824930765891:3815], now have 1 active actors on pipe
2025-09-30T14:50:55.196891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894824841041667:3408]
2025-09-30T14:50:55.196897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894824841041667:3408]
2025-09-30T14:50:55.196899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894824841041667:3408]
2025-09-30T14:50:55.196911Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:55.196928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:55.196930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:55.196934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:55.196936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:55.196946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:55.196950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:55.196980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894824841041667:3408]
2025-09-30T14:50:55.196963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 222
2025-09-30T14:50:55.196993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:55.196974Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 222
2025-09-30T14:50:55.197015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:55.197022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:55.197026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:55.197049Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87064481-f6e6a51b-6aecccf7-a7150fbc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:55.197060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.197063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.197065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:55.197074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.197086Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:55.197107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:55.197234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:55.197241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:55.197253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:55.197342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 223 partition: 0 MaxSeqNo: 42 sessionId: src_id|87064481-f6e6a51b-6aecccf7-a7150fbc_0
2025-09-30T14:50:55.197763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|808f4d29-cb8e868c-9acdd8bf-6b608b2f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|87064481-f6e6a51b-6aecccf7-a7150fbc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:55.200602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87064481-f6e6a51b-6aecccf7-a7150fbc_0] Write session: try to update token
2025-09-30T14:50:55.200623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87064481-f6e6a51b-6aecccf7-a7150fbc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:55.209311Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:55.209335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:55.209338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:55.209340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:55.209351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894824841041667:3408]
2025-09-30T14:50:55.209359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894824841041667:3408]
2025-09-30T14:50:55.209366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894824841041667:3408]
2025-09-30T14:50:55.209420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:55.209420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:55.209426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:55.209428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.209430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:55.209431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:55.209667Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:55.214979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 223 sessionId: src_id|87064481-f6e6a51b-6aecccf7-a7150fbc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:55.217785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:55.266507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894824930765907:3696]
2025-09-30T14:50:55.266815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 222, pipe: [1:7555894824930765907:3696]
2025-09-30T14:50:55.325106Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:55.325485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:55.325497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:55.325534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894824930765907:3696], now have 1 active actors on pipe
2025-09-30T14:50:55.325744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:55.325753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894824930765907:3696]
2025-09-30T14:50:55.325779Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:55.325757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:55.325770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:55.325816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 223 reason: error at write: Disconnected sessionId: src_id|87064481-f6e6a51b-6aecccf7-a7150fbc_0
2025-09-30T14:50:55.326022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 223 sessionId: src_id|87064481-f6e6a51b-6aecccf7-a7150fbc_0 is DEAD
2025-09-30T14:50:55.326158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87064481-f6e6a51b-6aecccf7-a7150fbc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:55.326168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87064481-f6e6a51b-6aecccf7-a7150fbc_0] Write session will restart in 0.006592s
2025-09-30T14:50:55.326190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87064481-f6e6a51b-6aecccf7-a7150fbc_0] Write session: Do CDS request
2025-09-30T14:50:55.326198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87064481-f6e6a51b-6aecccf7-a7150fbc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:55.333835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87064481-f6e6a51b-6aecccf7-a7150fbc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:55.333893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:55.333910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 224
2025-09-30T14:50:55.334078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 224 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:55.334110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 224 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:55.334115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=224 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:55.334119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:55.334598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 224 sessionId:  describe result for acl check
2025-09-30T14:50:55.334649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:55.334656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:55.334658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:55.334664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894824930765924:3819] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:55.335082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894824930765924:3819] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:55.337587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894824930765924:3819] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:55.341134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894824930765924:3819] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:55.341148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894824930765924:3819] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:55.341151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894824930765924:3819] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:55.341160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 224 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:55.346544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:55.348318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:55.348571Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:55.348581Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:55.348593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:55.348648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:55.348931Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894824841041950:3410]
2025-09-30T14:50:55.349499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:55.349808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:55.349886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:55.350241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:55.350314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:55.350321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:55.350322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:55.350323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:55.350325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:55.350326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:55.350327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:55.350329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:55.350330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:55.350331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:55.350332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.350334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.350335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.350336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:55.350337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:55.350344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:55.350354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:55.350358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:55.350363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:55.350367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:55.350373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:55.350376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:55.350381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:55.350385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:55.350392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:55.350395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.350399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.350416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.350420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:55.350425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:55.350433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:55.350440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:55.350447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:55.350452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:55.350458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:55.350464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:55.350468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:55.350473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:55.350478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:55.350483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:55.350488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:55.350493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:55.350501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:55.350507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:55.350512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:55.350518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:55.350523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:55.350528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:55.350533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:55.350537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:55.350542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.350548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.350553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.350559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.350563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.350568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.350573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:55.350578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:55.350582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:55.350588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:55.350646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:55.356117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:55.357017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:55.357036Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:55.357038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:55.357040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:55.357046Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 223 [2:7555894824841041950:3410]
2025-09-30T14:50:55.357058Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:55.357070Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:55.357072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.357074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.357076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.357088Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:55.357094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:55.357099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:55.357146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.357153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.357155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.357158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:55.357159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:55.357211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:55.357217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.357225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.357231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.357244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:55.357260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894824841041945:3410]
2025-09-30T14:50:55.357266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894824841041945:3410]
2025-09-30T14:50:55.357267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894824841041945:3410]
2025-09-30T14:50:55.357273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:55.357284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:55.357286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894824930765909:2454], now have 1 active actors on pipe
2025-09-30T14:50:55.357288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:55.357290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:55.357291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:55.357300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:55.357302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:55.357306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894824930766065:3819], now have 1 active actors on pipe
2025-09-30T14:50:55.357328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894824841041945:3410]
2025-09-30T14:50:55.357338Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:55.357363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:55.357371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 223
2025-09-30T14:50:55.357419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 223
2025-09-30T14:50:55.357462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:55.357470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:55.357488Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0e350e3-66f3f07c-319f6d07-6353331e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:55.357497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.357499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.357501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:55.357508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.357520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:55.357534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:55.357689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:55.357697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:55.357709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:55.357805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 224 partition: 0 MaxSeqNo: 42 sessionId: src_id|b0e350e3-66f3f07c-319f6d07-6353331e_0
2025-09-30T14:50:55.358199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87064481-f6e6a51b-6aecccf7-a7150fbc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b0e350e3-66f3f07c-319f6d07-6353331e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:55.360926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e350e3-66f3f07c-319f6d07-6353331e_0] Write session: try to update token
2025-09-30T14:50:55.360943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e350e3-66f3f07c-319f6d07-6353331e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:55.369316Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:55.369342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:55.369354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894824841041945:3410]
2025-09-30T14:50:55.369408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:55.369414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:55.369733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:55.370000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:55.370203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:55.370398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:55.370607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:55.370666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:55.375018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 224 sessionId: src_id|b0e350e3-66f3f07c-319f6d07-6353331e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:55.377848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:55.378266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:55.378284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:55.378316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:55.378416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:55.379653Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:55.379666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:55.379668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:55.379669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:55.379676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894824841041945:3410]
2025-09-30T14:50:55.379680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894824841041945:3410]
2025-09-30T14:50:55.379683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894824841041945:3410]
2025-09-30T14:50:55.379711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:55.379717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.379718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:55.379736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:55.379748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:55.379752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:55.379839Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:55.425692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894824930766194:3696]
2025-09-30T14:50:55.425945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 223, pipe: [1:7555894824930766194:3696]
2025-09-30T14:50:55.492327Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:55.499413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:55.499433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:55.499582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:55.499643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:55.499702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:55.499760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:55.499806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:55.499817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:55.499880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:55.499936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:55.499995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:55.500054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:55.500097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:55.500103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:55.500162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:55.500218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:55.500276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:55.500335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:55.500378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:55.500384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:55.500488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:55.500546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:55.500603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:55.500660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:55.500701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:55.500707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:55.500803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:55.500861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:55.500919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:55.500981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:55.501026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:55.501034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:55.501095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:55.501150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:55.501207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:55.501267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:55.501309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:55.501315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:55.501381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:55.501438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:55.501498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:55.501557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:55.501613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:55.501619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:55.501679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:55.501735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:55.501794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:55.501867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:55.501909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:55.501915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:55.501974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:55.502032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:55.502090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:55.502150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:55.502189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:55.502195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:55.502256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:55.502311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:55.502368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:55.502424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:55.502464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:55.502470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:55.502510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894824930766194:3696], now have 1 active actors on pipe
2025-09-30T14:50:55.502742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:55.502742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894824930766194:3696]
2025-09-30T14:50:55.502774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:55.502777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:55.502811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 224 reason: error at write: Disconnected sessionId: src_id|b0e350e3-66f3f07c-319f6d07-6353331e_0
2025-09-30T14:50:55.503051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 224 sessionId: src_id|b0e350e3-66f3f07c-319f6d07-6353331e_0 is DEAD
2025-09-30T14:50:55.503212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e350e3-66f3f07c-319f6d07-6353331e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:55.503223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e350e3-66f3f07c-319f6d07-6353331e_0] Write session will restart in 0.005430s
2025-09-30T14:50:55.503271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e350e3-66f3f07c-319f6d07-6353331e_0] Write session: Do CDS request
2025-09-30T14:50:55.503277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e350e3-66f3f07c-319f6d07-6353331e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:55.503335Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:55.509794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e350e3-66f3f07c-319f6d07-6353331e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:55.509788Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:55.509803Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 225
2025-09-30T14:50:55.510020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 225 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:55.510053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 225 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:55.510062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=225 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:55.510065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:55.510476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 225 sessionId:  describe result for acl check
2025-09-30T14:50:55.510505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:55.510512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:55.510514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:55.510527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894824930766214:3824] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:55.511063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894824930766214:3824] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:55.514228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894824930766214:3824] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:55.518535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894824930766214:3824] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:55.518552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894824930766214:3824] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:55.518556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894824930766214:3824] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:55.518564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 225 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:55.523727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:55.525364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:55.525695Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:55.525706Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:55.525720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:55.525786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:55.525831Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894824841042231:3413]
2025-09-30T14:50:55.526515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:55.526842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:55.526891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:55.527235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:55.527316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:55.527323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:55.527325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:55.527326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:55.527327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:55.527329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:55.527330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:55.527331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:55.527333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:55.527334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:55.527335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.527337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.527338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.527339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:55.527340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:55.527346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:55.527356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:55.527361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:55.527366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:55.527370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:55.527374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:55.527379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:55.527383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:55.527388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:55.527392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:55.527396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.527400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.527404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.527409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:55.527413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:55.527421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:55.527429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:55.527436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:55.527441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:55.527446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:55.527452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:55.527456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:55.527462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:55.527467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:55.527472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:55.527482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:55.527488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:55.527493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:55.527499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:55.527510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:55.527516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:55.527525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:55.527530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:55.527540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:55.527545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:55.527554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.527560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.527570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.527576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.527585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.527590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.527595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:55.527600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:55.527605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:55.527614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:55.527655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:55.533322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:55.534502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:55.534518Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:55.534521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:55.534525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:55.534531Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 224 [2:7555894824841042231:3413]
2025-09-30T14:50:55.534546Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:55.534561Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:55.534569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.534572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.534575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.534590Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:55.534603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:55.534615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:55.534702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.534709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.534711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.534715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:55.534718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:55.534786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:55.534794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.534807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.534825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.534847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:55.534870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894824930766198:2454], now have 1 active actors on pipe
2025-09-30T14:50:55.534878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894824930766371:3824], now have 1 active actors on pipe
2025-09-30T14:50:55.534885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894824841042226:3413]
2025-09-30T14:50:55.534892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894824841042226:3413]
2025-09-30T14:50:55.534894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894824841042226:3413]
2025-09-30T14:50:55.534909Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:55.534892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 224
2025-09-30T14:50:55.534927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:55.534929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:55.534932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:55.534934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:55.534947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:55.534950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:55.534998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:55.534980Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 224
2025-09-30T14:50:55.535008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:55.535020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894824841042226:3413]
2025-09-30T14:50:55.535032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:55.535043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:55.535071Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9fa80a63-dc60670a-a68ce93d-9efaf675_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:55.535084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.535088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.535090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:55.535099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.535108Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:55.535129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:55.535264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:55.535273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:55.535287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:55.535351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 225 partition: 0 MaxSeqNo: 42 sessionId: src_id|9fa80a63-dc60670a-a68ce93d-9efaf675_0
2025-09-30T14:50:55.535722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e350e3-66f3f07c-319f6d07-6353331e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9fa80a63-dc60670a-a68ce93d-9efaf675_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:55.538499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa80a63-dc60670a-a68ce93d-9efaf675_0] Write session: try to update token
2025-09-30T14:50:55.538516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa80a63-dc60670a-a68ce93d-9efaf675_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:55.547403Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:55.547424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:55.547427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:55.547429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:55.547439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894824841042226:3413]
2025-09-30T14:50:55.547447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894824841042226:3413]
2025-09-30T14:50:55.547451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894824841042226:3413]
2025-09-30T14:50:55.547495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:55.547496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:55.547502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.547503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:55.547505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:55.547507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:55.547655Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:55.553321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 225 sessionId: src_id|9fa80a63-dc60670a-a68ce93d-9efaf675_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:55.555997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:55.602939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894824930766498:3696]
2025-09-30T14:50:55.603257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 224, pipe: [1:7555894824930766498:3696]
2025-09-30T14:50:55.659430Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:55.659840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:55.659854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:55.659885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894824930766498:3696], now have 1 active actors on pipe
2025-09-30T14:50:55.660063Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:55.660099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:55.660115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:55.660119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:55.660154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894824930766498:3696]
2025-09-30T14:50:55.660181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 225 reason: error at write: Disconnected sessionId: src_id|9fa80a63-dc60670a-a68ce93d-9efaf675_0
2025-09-30T14:50:55.660411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 225 sessionId: src_id|9fa80a63-dc60670a-a68ce93d-9efaf675_0 is DEAD
2025-09-30T14:50:55.660590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa80a63-dc60670a-a68ce93d-9efaf675_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:55.660599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa80a63-dc60670a-a68ce93d-9efaf675_0] Write session will restart in 0.008336s
2025-09-30T14:50:55.660622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa80a63-dc60670a-a68ce93d-9efaf675_0] Write session: Do CDS request
2025-09-30T14:50:55.660628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa80a63-dc60670a-a68ce93d-9efaf675_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:55.669812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa80a63-dc60670a-a68ce93d-9efaf675_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:55.669870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:55.669883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 226
2025-09-30T14:50:55.670028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 226 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:55.670071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 226 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:55.670082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=226 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:55.670086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:55.670568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 226 sessionId:  describe result for acl check
2025-09-30T14:50:55.670603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:55.670610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:55.670612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:55.670628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894824930766556:3835] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:55.671132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894824930766556:3835] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:55.674257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894824930766556:3835] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:55.677107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894824930766556:3835] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:55.677133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894824930766556:3835] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:55.677137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894824930766556:3835] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:55.677144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 226 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:55.679357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:55.680811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:55.680992Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:55.681001Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:55.681010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:55.681055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:55.681093Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894824841042546:3427]
2025-09-30T14:50:55.681747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:55.682016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:55.682057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:55.682365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:55.682421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:55.682429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:55.682431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:55.682432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:55.682433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:55.682434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:55.682435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:55.682436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:55.682438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:55.682439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:55.682440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.682441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.682442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.682444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:55.682445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:55.682450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:55.682460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:55.682464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:55.682469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:55.682473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:55.682477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:55.682481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:55.682485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:55.682489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:55.682493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:55.682497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.682501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.682505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.682509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:55.682513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:55.682520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:55.682527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:55.682534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:55.682540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:55.682549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:55.682554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:55.682559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:55.682564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:55.682574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:55.682579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:55.682588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:55.682593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:55.682602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:55.682608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:55.682616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:55.682636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:55.682646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:55.682655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:55.682664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:55.682669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:55.682678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.682683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.682688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.682699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.682703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.682708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.682717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:55.682722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:55.682731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:55.682736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:55.682783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:55.688390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:55.689335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:55.689348Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:55.689351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:55.689354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:55.689361Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 225 [2:7555894824841042546:3427]
2025-09-30T14:50:55.689377Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:55.689392Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:55.689394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.689397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.689400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.689416Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:55.689429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:55.689436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:55.689500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.689507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.689510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.689514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:55.689516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:55.689596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:55.689605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.689618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.689632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.689651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:55.689669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894824930766509:2454], now have 1 active actors on pipe
2025-09-30T14:50:55.689678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894824930766772:3835], now have 1 active actors on pipe
2025-09-30T14:50:55.689684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894824841042541:3427]
2025-09-30T14:50:55.689687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894824841042541:3427]
2025-09-30T14:50:55.689689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894824841042541:3427]
2025-09-30T14:50:55.689702Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:55.689715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:55.689721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:55.689721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:55.689723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:55.689736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:55.689739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:55.689773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894824841042541:3427]
2025-09-30T14:50:55.689785Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:55.689790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:55.690509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 225
2025-09-30T14:50:55.690513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 225
2025-09-30T14:50:55.690591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:55.690606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:55.690648Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be0bd9c3-172411ed-50155b9-933b4928_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:55.690661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.690670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.690673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:55.690696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.690715Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:55.690731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:55.690910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:55.690923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:55.690946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:55.691026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 226 partition: 0 MaxSeqNo: 42 sessionId: src_id|be0bd9c3-172411ed-50155b9-933b4928_0
2025-09-30T14:50:55.691415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa80a63-dc60670a-a68ce93d-9efaf675_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|be0bd9c3-172411ed-50155b9-933b4928_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:55.694183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be0bd9c3-172411ed-50155b9-933b4928_0] Write session: try to update token
2025-09-30T14:50:55.694203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be0bd9c3-172411ed-50155b9-933b4928_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:55.702009Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:55.702026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:55.702036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894824841042541:3427]
2025-09-30T14:50:55.702080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:55.702079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:55.702248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:55.702435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:55.702578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:55.702735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:55.702937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:55.702976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:55.709320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 226 sessionId: src_id|be0bd9c3-172411ed-50155b9-933b4928_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:55.711974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:55.712756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:55.712779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:55.712800Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:55.712803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:55.712805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:55.712807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:55.712815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894824841042541:3427]
2025-09-30T14:50:55.712819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894824841042541:3427]
2025-09-30T14:50:55.712822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894824841042541:3427]
2025-09-30T14:50:55.712858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:55.712869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:55.712871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:55.712876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:55.712878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.712880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:55.713010Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:55.760049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894824930766796:3696]
2025-09-30T14:50:55.760323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 225, pipe: [1:7555894824930766796:3696]
2025-09-30T14:50:55.817895Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:55.818335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:55.818363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894824930766796:3696], now have 1 active actors on pipe
2025-09-30T14:50:55.818473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:55.818502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:55.818540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894824930766796:3696]
2025-09-30T14:50:55.818566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:55.818575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:55.818651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 226 reason: error at write: Disconnected sessionId: src_id|be0bd9c3-172411ed-50155b9-933b4928_0
2025-09-30T14:50:55.818803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 226 sessionId: src_id|be0bd9c3-172411ed-50155b9-933b4928_0 is DEAD
2025-09-30T14:50:55.818949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be0bd9c3-172411ed-50155b9-933b4928_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:55.818960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be0bd9c3-172411ed-50155b9-933b4928_0] Write session will restart in 0.007977s
2025-09-30T14:50:55.818981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be0bd9c3-172411ed-50155b9-933b4928_0] Write session: Do CDS request
2025-09-30T14:50:55.818987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be0bd9c3-172411ed-50155b9-933b4928_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:55.827778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be0bd9c3-172411ed-50155b9-933b4928_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:55.827890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:55.827916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 227
2025-09-30T14:50:55.828064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 227 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:55.828099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 227 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:55.828110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=227 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:55.828114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:55.828573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 227 sessionId:  describe result for acl check
2025-09-30T14:50:55.828608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:55.828618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:55.828623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:55.828629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894824930766829:3840] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:55.829121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894824930766829:3840] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:55.831728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894824930766829:3840] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:55.834731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894824930766829:3840] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:55.834743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894824930766829:3840] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:55.834745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894824930766829:3840] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:55.834752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 227 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:55.838466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:55.840151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:55.840353Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:55.840364Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:55.840375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:55.840425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:55.840470Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894824841042838:3430]
2025-09-30T14:50:55.841140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:55.841407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:55.841449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:55.841764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:55.841823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:55.841829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:55.841830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:55.841831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:55.841832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:55.841833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:55.841835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:55.841836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:55.841837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:55.841838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:55.841840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.841841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.841842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.841843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:55.841844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:55.841850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:55.841860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:55.841864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:55.841868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:55.841872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:55.841876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:55.841881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:55.841885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:55.841889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:55.841893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:55.841898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.841902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.841905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.841909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:55.841913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:55.841920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:55.841927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:55.841933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:55.841938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:55.841943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:55.841950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:55.841955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:55.841960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:55.841964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:55.841970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:55.841974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:55.841979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:55.841983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:55.841989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:55.841993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:55.841997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:55.842002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:55.842007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:55.842011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:55.842022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:55.842026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.842031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.842040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.842045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.842049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.842059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.842063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:55.842067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:55.842076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:55.842082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:55.842126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:55.847588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:55.848607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:55.848630Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:55.848634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:55.848638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:55.848645Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 226 [2:7555894824841042838:3430]
2025-09-30T14:50:55.848662Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:55.848687Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:55.848698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.848702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.848705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.848723Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:55.848730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:55.848737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:55.848812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.848823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.848828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.848831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:55.848835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:55.848909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:55.848917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.848931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.848947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.848970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:55.848994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894824930766810:2454], now have 1 active actors on pipe
2025-09-30T14:50:55.849003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894824930767001:3840], now have 1 active actors on pipe
2025-09-30T14:50:55.849009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894824841042832:3430]
2025-09-30T14:50:55.849012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894824841042832:3430]
2025-09-30T14:50:55.849014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894824841042832:3430]
2025-09-30T14:50:55.849027Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:55.849035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:55.849043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:55.849020Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 226
2025-09-30T14:50:55.849053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:55.849055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:55.849056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 226
2025-09-30T14:50:55.849058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:55.849061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:55.849108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:55.849119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:55.849131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894824841042832:3430]
2025-09-30T14:50:55.849140Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:55.849173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:55.849177Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c78a8f5d-51fe1b6a-e85233b6-fe8d711c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:55.849183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.849187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.849189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:55.849199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.849214Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:55.849241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:55.849417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:55.849425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:55.849438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:55.849528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 227 partition: 0 MaxSeqNo: 42 sessionId: src_id|c78a8f5d-51fe1b6a-e85233b6-fe8d711c_0
2025-09-30T14:50:55.849892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be0bd9c3-172411ed-50155b9-933b4928_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c78a8f5d-51fe1b6a-e85233b6-fe8d711c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:55.852561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c78a8f5d-51fe1b6a-e85233b6-fe8d711c_0] Write session: try to update token
2025-09-30T14:50:55.852574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c78a8f5d-51fe1b6a-e85233b6-fe8d711c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:55.861123Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:55.861143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:55.861145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:55.861147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:55.861157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894824841042832:3430]
2025-09-30T14:50:55.861162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894824841042832:3430]
2025-09-30T14:50:55.861165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894824841042832:3430]
2025-09-30T14:50:55.861203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:55.861211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.861214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:55.861223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:55.861230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:55.861234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:55.861360Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:55.866756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 227 sessionId: src_id|c78a8f5d-51fe1b6a-e85233b6-fe8d711c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:55.869470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:55.918763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894824930767098:3696]
2025-09-30T14:50:55.919045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 226, pipe: [1:7555894824930767098:3696]
2025-09-30T14:50:55.971196Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:55.971463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:55.971476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:55.971513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894824930767098:3696], now have 1 active actors on pipe
2025-09-30T14:50:55.971710Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:55.971763Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:55.971796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894824930767098:3696]
2025-09-30T14:50:55.971810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:55.971879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 227 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c78a8f5d-51fe1b6a-e85233b6-fe8d711c_0
2025-09-30T14:50:55.972085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 227 sessionId: src_id|c78a8f5d-51fe1b6a-e85233b6-fe8d711c_0 is DEAD
2025-09-30T14:50:55.972179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c78a8f5d-51fe1b6a-e85233b6-fe8d711c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:55.972187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c78a8f5d-51fe1b6a-e85233b6-fe8d711c_0] Write session will restart in 0.005019s
2025-09-30T14:50:55.972203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c78a8f5d-51fe1b6a-e85233b6-fe8d711c_0] Write session: Do CDS request
2025-09-30T14:50:55.972207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c78a8f5d-51fe1b6a-e85233b6-fe8d711c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:55.978734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c78a8f5d-51fe1b6a-e85233b6-fe8d711c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:55.978826Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:55.978842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 228
2025-09-30T14:50:55.979009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 228 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:55.979039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 228 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:55.979049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=228 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:55.979053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:55.979472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 228 sessionId:  describe result for acl check
2025-09-30T14:50:55.979504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:55.979506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:55.979508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:55.979513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894824930767124:3846] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:55.979978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894824930767124:3846] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:55.982670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894824930767124:3846] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:55.985905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894824930767124:3846] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:55.985921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894824930767124:3846] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:55.985924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894824930767124:3846] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:55.985932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 228 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:55.990357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:55.991806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:55.992021Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:55.992037Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:55.992329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:55.992398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:55.992440Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894824841043126:3432]
2025-09-30T14:50:55.993085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:55.993335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:55.993378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:55.993702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:55.993761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:55.993767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:55.993768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:55.993770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:55.993771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:55.993772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:55.993773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:55.993775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:55.993776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:55.993777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:55.993778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.993779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.993781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.993782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:55.993783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:55.993789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:55.993799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:55.993804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:55.993809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:55.993813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:55.993817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:55.993822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:55.993826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:55.993830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:55.993835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:55.993839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.993844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.993848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.993852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:55.993857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:55.993864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:55.993874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:55.993880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:55.993886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:55.993891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:55.993897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:55.993902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:55.993908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:55.993913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:55.993926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:55.993931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:55.993941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:55.993946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:55.993958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:55.993963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:55.993973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:55.993979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:55.993991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:55.993995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:55.994002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:55.994011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.994017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:55.994026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.994031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:55.994036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.994046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:55.994050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:55.994056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:55.994065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:55.994071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:55.994122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:55.999311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:56.000224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:56.000238Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:56.000241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:56.000245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:56.000251Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 227 [2:7555894824841043126:3432]
2025-09-30T14:50:56.000266Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:56.000282Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:56.000285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.000288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.000291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.000306Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:56.000317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:56.000324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:56.000382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.000390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.000392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.000396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:56.000398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:56.000460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:56.000468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.000479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.000490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.000513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:56.000535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894824930767109:2454], now have 1 active actors on pipe
2025-09-30T14:50:56.000543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894824930767270:3846], now have 1 active actors on pipe
2025-09-30T14:50:56.000549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894824841043116:3432]
2025-09-30T14:50:56.000551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894824841043116:3432]
2025-09-30T14:50:56.000554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894824841043116:3432]
2025-09-30T14:50:56.000569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:56.000587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:56.000592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:56.000596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:56.000598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:56.000606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:56.000609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:56.000591Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 227
2025-09-30T14:50:56.000636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894824841043116:3432]
2025-09-30T14:50:56.000647Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:56.000594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 227
2025-09-30T14:50:56.000650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:56.000662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:56.000667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:56.000716Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce124784-47473510-78086d6d-8189e845_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:56.000726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.000729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.000731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:56.000740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.000753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:56.000774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:56.000939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:56.000949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:56.000964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:56.001028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 228 partition: 0 MaxSeqNo: 42 sessionId: src_id|ce124784-47473510-78086d6d-8189e845_0
2025-09-30T14:50:56.001367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c78a8f5d-51fe1b6a-e85233b6-fe8d711c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ce124784-47473510-78086d6d-8189e845_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:56.003940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce124784-47473510-78086d6d-8189e845_0] Write session: try to update token
2025-09-30T14:50:56.003958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce124784-47473510-78086d6d-8189e845_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:56.012943Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:56.012970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:56.012974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:56.012977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:56.012986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894824841043116:3432]
2025-09-30T14:50:56.012992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894824841043116:3432]
2025-09-30T14:50:56.012996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894824841043116:3432]
2025-09-30T14:50:56.013038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:56.013042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:56.013049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:56.013050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.013052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:56.013052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:56.013255Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:56.018104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 228 sessionId: src_id|ce124784-47473510-78086d6d-8189e845_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:56.020813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:56.071882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894829225734700:3696]
2025-09-30T14:50:56.072217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 227, pipe: [1:7555894829225734700:3696]
2025-09-30T14:50:56.126397Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:56.126983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:56.126998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:56.127035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894829225734700:3696], now have 1 active actors on pipe
2025-09-30T14:50:56.127237Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:56.127266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894829225734700:3696]
2025-09-30T14:50:56.127294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:56.127298Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:56.127299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:56.127374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 228 reason: error at write: Disconnected sessionId: src_id|ce124784-47473510-78086d6d-8189e845_0
2025-09-30T14:50:56.127569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 228 sessionId: src_id|ce124784-47473510-78086d6d-8189e845_0 is DEAD
2025-09-30T14:50:56.127690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce124784-47473510-78086d6d-8189e845_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:56.127707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce124784-47473510-78086d6d-8189e845_0] Write session will restart in 0.007709s
2025-09-30T14:50:56.127724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce124784-47473510-78086d6d-8189e845_0] Write session: Do CDS request
2025-09-30T14:50:56.127731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce124784-47473510-78086d6d-8189e845_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:56.135372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:56.136750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:56.136847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce124784-47473510-78086d6d-8189e845_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:56.136916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:56.136933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 229
2025-09-30T14:50:56.136963Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:56.136973Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:56.136983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:56.137032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:56.137059Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894829136010482:3435]
2025-09-30T14:50:56.137082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 229 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:56.137116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 229 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:56.137121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=229 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:56.137125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:56.137556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 229 sessionId:  describe result for acl check
2025-09-30T14:50:56.137596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:56.137604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:56.137609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:56.137615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894829225734721:3850] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:56.137686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:56.137975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:56.138026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:56.138213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894829225734721:3850] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:56.138359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:56.138420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:56.138426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:56.138428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:56.138429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:56.138431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:56.138432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:56.138433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:56.138435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:56.138437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:56.138438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:56.138439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.138441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.138442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.138443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:56.138444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:56.138450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:56.138461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:56.138465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:56.138469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:56.138474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:56.138478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:56.138482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:56.138486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:56.138490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:56.138494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:56.138498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.138503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.138507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.138511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:56.138515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:56.138523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:56.138531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:56.138537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:56.138543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:56.138549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:56.138555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:56.138559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:56.138565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:56.138569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:56.138575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:56.138580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:56.138585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:56.138590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:56.138596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:56.138601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:56.138606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:56.138611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:56.138614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:56.138630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:56.138633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:56.138636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.138653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.138658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.138662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.138667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.138673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.138677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:56.138684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:56.138688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:56.138691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:56.138716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:56.140218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894829225734721:3850] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:56.144062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894829225734721:3850] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:56.144080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894829225734721:3850] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:56.144084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894829225734721:3850] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:56.144096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 229 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:56.144253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:56.145199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:56.145212Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:56.145215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:56.145218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:56.145224Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 228 [2:7555894829136010482:3435]
2025-09-30T14:50:56.145238Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:56.145252Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:56.145255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.145258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.145260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.145276Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:56.145283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:56.145289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:56.145347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.145354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.145356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.145360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:56.145362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:56.145422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:56.145430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.145441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.145451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.145472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:56.145491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894829225734761:3850], now have 1 active actors on pipe
2025-09-30T14:50:56.145499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894829225734702:2454], now have 1 active actors on pipe
2025-09-30T14:50:56.145504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894829136010477:3435]
2025-09-30T14:50:56.145506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894829136010477:3435]
2025-09-30T14:50:56.145507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894829136010477:3435]
2025-09-30T14:50:56.145518Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:56.145531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:56.145532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:56.145536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:56.145538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:56.145547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:56.145550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:56.145554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 228
2025-09-30T14:50:56.145575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 228
2025-09-30T14:50:56.145579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894829136010477:3435]
2025-09-30T14:50:56.145590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:56.145595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:56.145755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:56.145764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:56.145787Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfbc9ca3-54654779-493a81df-f2326133_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:56.145797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.145801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.145803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:56.145811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.145823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:56.145835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:56.146067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:56.146080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:56.146115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:56.146200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 229 partition: 0 MaxSeqNo: 42 sessionId: src_id|bfbc9ca3-54654779-493a81df-f2326133_0
2025-09-30T14:50:56.146609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce124784-47473510-78086d6d-8189e845_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bfbc9ca3-54654779-493a81df-f2326133_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:56.149481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfbc9ca3-54654779-493a81df-f2326133_0] Write session: try to update token
2025-09-30T14:50:56.149501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfbc9ca3-54654779-493a81df-f2326133_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:56.157467Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:56.157482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:56.157492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894829136010477:3435]
2025-09-30T14:50:56.157528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:56.157544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:56.157725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:56.157876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:56.158025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:56.158169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:56.158379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:56.158420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:56.164006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 229 sessionId: src_id|bfbc9ca3-54654779-493a81df-f2326133_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:56.166676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:56.166900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:56.166931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:56.166964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:56.167045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:56.168355Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:56.168368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:56.168372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:56.168374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:56.168383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894829136010477:3435]
2025-09-30T14:50:56.168387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894829136010477:3435]
2025-09-30T14:50:56.168391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894829136010477:3435]
2025-09-30T14:50:56.168427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:56.168427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:56.168432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:56.168435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.168436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:56.168438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:56.168576Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:56.227528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894829225734768:3696]
2025-09-30T14:50:56.227917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 228, pipe: [1:7555894829225734768:3696]
2025-09-30T14:50:56.277178Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:56.285104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:56.285131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:56.285288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:56.285362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:56.285428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:56.285486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:56.285531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:56.285541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:56.285618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:56.285681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:56.285759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:56.285839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:56.285888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:56.285897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:56.285965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:56.286023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:56.286081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:56.286172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:56.286224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:56.286229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:56.286291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:56.286350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:56.286412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:56.286476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:56.286516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:56.286521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:56.286583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:56.286660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:56.286730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:56.286785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:56.286838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:56.286840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:56.286909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:56.286972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:56.287037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:56.287106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:56.287152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:56.287159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:56.287228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:56.287309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:56.287373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:56.287440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:56.287488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:56.287496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:56.287565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:56.287627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:56.287691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:56.287755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:56.287800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:56.287806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:56.287878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:56.287941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:56.288012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:56.288079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:56.288124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:56.288131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:56.288200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:56.288263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:56.288329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:56.288393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:56.288436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:56.288442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:56.288502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894829225734768:3696], now have 1 active actors on pipe
2025-09-30T14:50:56.288742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:56.288758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:56.288773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894829225734768:3696]
2025-09-30T14:50:56.288786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 229 reason: error at write: Disconnected sessionId: src_id|bfbc9ca3-54654779-493a81df-f2326133_0
2025-09-30T14:50:56.288800Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:56.288999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 229 sessionId: src_id|bfbc9ca3-54654779-493a81df-f2326133_0 is DEAD
2025-09-30T14:50:56.289142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfbc9ca3-54654779-493a81df-f2326133_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:56.289148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfbc9ca3-54654779-493a81df-f2326133_0] Write session will restart in 0.005816s
2025-09-30T14:50:56.289165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfbc9ca3-54654779-493a81df-f2326133_0] Write session: Do CDS request
2025-09-30T14:50:56.289170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfbc9ca3-54654779-493a81df-f2326133_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:56.289389Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:56.294951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:56.295699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfbc9ca3-54654779-493a81df-f2326133_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:56.295774Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:56.295788Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 230
2025-09-30T14:50:56.295909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 230 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:56.295943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 230 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:56.295949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=230 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:56.295952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:56.296334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 230 sessionId:  describe result for acl check
2025-09-30T14:50:56.296366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:56.296373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:56.296375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:56.296381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894829225734788:3854] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:56.296388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:56.296540Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:56.296548Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:56.296556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:56.296604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:56.296636Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894829136010540:3437]
2025-09-30T14:50:56.296888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894829225734788:3854] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:56.297214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:56.297486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:56.297517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:56.297773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:56.297819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:56.297825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:56.297826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:56.297826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:56.297827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:56.297829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:56.297830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:56.297831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:56.297832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:56.297833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:56.297834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.297835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.297835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.297836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:56.297837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:56.297841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:56.297847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:56.297849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:56.297852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:56.297854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:56.297856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:56.297860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:56.297863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:56.297865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:56.297868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:56.297870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.297873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.297875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.297877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:56.297879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:56.297884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:56.297889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:56.297892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:56.297897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:56.297899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:56.297903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:56.297905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:56.297909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:56.297911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:56.297914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:56.297916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:56.297919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:56.297921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:56.297924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:56.297927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:56.297930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:56.297933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:56.297939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:56.297943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:56.297948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:56.297952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.297957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.297961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.297967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.297972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.297974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.297976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:56.297980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:56.297985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:56.297989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:56.298024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:56.299428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894829225734788:3854] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:56.303001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894829225734788:3854] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:56.303018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894829225734788:3854] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:56.303022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894829225734788:3854] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:56.303037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 230 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:56.303434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:56.304396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:56.304412Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:56.304414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:56.304418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:56.304426Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 229 [2:7555894829136010540:3437]
2025-09-30T14:50:56.304442Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:56.304456Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:56.304459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.304461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.304464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.304479Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:56.304490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:56.304497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:56.304556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.304565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.304567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.304570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:56.304573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:56.304702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:56.304709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.304721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.304735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.304758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:56.304780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894829225734769:2454], now have 1 active actors on pipe
2025-09-30T14:50:56.304784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894829225734827:3854], now have 1 active actors on pipe
2025-09-30T14:50:56.304790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894829136010535:3437]
2025-09-30T14:50:56.304792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894829136010535:3437]
2025-09-30T14:50:56.304793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894829136010535:3437]
2025-09-30T14:50:56.304801Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:56.304786Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 229
2025-09-30T14:50:56.304816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:56.304794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 229
2025-09-30T14:50:56.304836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:56.304844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:56.304862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:56.304871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:56.304873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:56.304875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894829136010535:3437]
2025-09-30T14:50:56.304877Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:56.304879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:56.304912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:56.304921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:56.304945Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2d8cfbb-908a8647-609ecaa7-8f21fbec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:56.304955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.304958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.304965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:56.304973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.304981Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:56.304999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:56.305299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:56.305309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:56.305324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:56.305433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 230 partition: 0 MaxSeqNo: 42 sessionId: src_id|b2d8cfbb-908a8647-609ecaa7-8f21fbec_0
2025-09-30T14:50:56.305837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfbc9ca3-54654779-493a81df-f2326133_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b2d8cfbb-908a8647-609ecaa7-8f21fbec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:56.308459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2d8cfbb-908a8647-609ecaa7-8f21fbec_0] Write session: try to update token
2025-09-30T14:50:56.308475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2d8cfbb-908a8647-609ecaa7-8f21fbec_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:56.316968Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:56.316985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:56.316989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:56.316991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:56.317000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894829136010535:3437]
2025-09-30T14:50:56.317005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894829136010535:3437]
2025-09-30T14:50:56.317010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894829136010535:3437]
2025-09-30T14:50:56.317052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:56.317057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:56.317059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.317061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:56.317063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:56.317067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:56.317193Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:56.322434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 230 sessionId: src_id|b2d8cfbb-908a8647-609ecaa7-8f21fbec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:56.325205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:56.388780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894829225734835:3696]
2025-09-30T14:50:56.389063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 229, pipe: [1:7555894829225734835:3696]
2025-09-30T14:50:56.425667Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:56.425951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:56.425964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:56.425994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894829225734835:3696], now have 1 active actors on pipe
2025-09-30T14:50:56.426177Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:56.426232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894829225734835:3696]
2025-09-30T14:50:56.426245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:56.426263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:56.426353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 230 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b2d8cfbb-908a8647-609ecaa7-8f21fbec_0
2025-09-30T14:50:56.426510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 230 sessionId: src_id|b2d8cfbb-908a8647-609ecaa7-8f21fbec_0 is DEAD
2025-09-30T14:50:56.426686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2d8cfbb-908a8647-609ecaa7-8f21fbec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:56.426695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2d8cfbb-908a8647-609ecaa7-8f21fbec_0] Write session will restart in 0.006516s
2025-09-30T14:50:56.426719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2d8cfbb-908a8647-609ecaa7-8f21fbec_0] Write session: Do CDS request
2025-09-30T14:50:56.426725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2d8cfbb-908a8647-609ecaa7-8f21fbec_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:56.432839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:56.434360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:56.434537Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:56.434546Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:56.434557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:56.434604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:56.434661Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894829136010597:3439]
2025-09-30T14:50:56.434782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2d8cfbb-908a8647-609ecaa7-8f21fbec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:56.434883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:56.434901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 231
2025-09-30T14:50:56.435040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 231 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:56.435067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 231 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:56.435071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=231 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:56.435074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:56.435329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:56.435515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 231 sessionId:  describe result for acl check
2025-09-30T14:50:56.435548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:56.435556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:56.435558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:56.435563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894829225734861:3858] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:56.435598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:56.435643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:56.435966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:56.436017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:56.436022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:56.436023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:56.436023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:56.436024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:56.436025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:56.436026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:56.436026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:56.436027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:56.436028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:56.436029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.436029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.436030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.436033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:56.436033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:56.436036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:56.436043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:56.436046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:56.436050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:56.436054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:56.436058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:56.436061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:56.436065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:56.436069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:56.436073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:56.436078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.436082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.436089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.436092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:56.436098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:56.436109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:56.436119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:56.436123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:56.436130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:56.436133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:56.436139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:56.436142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:56.436145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:56.436148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:56.436155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:56.436157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:56.436160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:56.436152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894829225734861:3858] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:56.436163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:56.436169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:56.436174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:56.436179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:56.436183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:56.436189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:56.436198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:56.436203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:56.436211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.436218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.436221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.436223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.436225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.436228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.436230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:56.436236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:56.436239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:56.436243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:56.436269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:56.438068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894829225734861:3858] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:56.441192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894829225734861:3858] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:56.441206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894829225734861:3858] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:56.441209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894829225734861:3858] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:56.441216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 231 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:56.441558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:56.442424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:56.442438Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:56.442441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:56.442444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:56.442450Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 230 [2:7555894829136010597:3439]
2025-09-30T14:50:56.442462Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:56.442474Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:56.442481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.442484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.442486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.442500Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:56.442507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:56.442520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:56.442568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.442573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.442574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.442576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:56.442578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:56.442656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:56.442663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.442675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.442685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.442706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:56.442729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894829225734898:3858], now have 1 active actors on pipe
2025-09-30T14:50:56.442732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894829225734836:2454], now have 1 active actors on pipe
2025-09-30T14:50:56.442738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894829136010592:3439]
2025-09-30T14:50:56.442745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894829136010592:3439]
2025-09-30T14:50:56.442747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894829136010592:3439]
2025-09-30T14:50:56.442757Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:56.442768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:56.442771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:56.442773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:56.442774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:56.442761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 230
2025-09-30T14:50:56.442790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:56.442785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 230
2025-09-30T14:50:56.442797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:56.442833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:56.442842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:56.442857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894829136010592:3439]
2025-09-30T14:50:56.442867Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:56.442878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:56.442894Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|704f266f-f8ddbb1e-370874c4-3e9b19dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:56.442900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.442906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.442908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:56.442916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.442924Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:56.442954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:56.443138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:56.443149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:56.443164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:56.443269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 231 partition: 0 MaxSeqNo: 42 sessionId: src_id|704f266f-f8ddbb1e-370874c4-3e9b19dc_0
2025-09-30T14:50:56.443626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2d8cfbb-908a8647-609ecaa7-8f21fbec_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|704f266f-f8ddbb1e-370874c4-3e9b19dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:56.446513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|704f266f-f8ddbb1e-370874c4-3e9b19dc_0] Write session: try to update token
2025-09-30T14:50:56.446529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|704f266f-f8ddbb1e-370874c4-3e9b19dc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:56.455036Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:56.455053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:56.455055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:56.455056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:56.455064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894829136010592:3439]
2025-09-30T14:50:56.455068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894829136010592:3439]
2025-09-30T14:50:56.455073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894829136010592:3439]
2025-09-30T14:50:56.455114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:56.455121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.455122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:56.455124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:56.455128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:56.455132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:56.455278Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:56.460991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 231 sessionId: src_id|704f266f-f8ddbb1e-370874c4-3e9b19dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:56.463716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:56.526499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894829225734907:3696]
2025-09-30T14:50:56.526747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 230, pipe: [1:7555894829225734907:3696]
2025-09-30T14:50:56.560781Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:56.561062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:56.561073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:56.561106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894829225734907:3696], now have 1 active actors on pipe
2025-09-30T14:50:56.561297Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:56.561376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:56.561389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:56.561391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894829225734907:3696]
2025-09-30T14:50:56.561411Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:56.561448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 231 reason: error at write: Disconnected sessionId: src_id|704f266f-f8ddbb1e-370874c4-3e9b19dc_0
2025-09-30T14:50:56.561634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 231 sessionId: src_id|704f266f-f8ddbb1e-370874c4-3e9b19dc_0 is DEAD
2025-09-30T14:50:56.561761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|704f266f-f8ddbb1e-370874c4-3e9b19dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:56.561771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|704f266f-f8ddbb1e-370874c4-3e9b19dc_0] Write session will restart in 0.005900s
2025-09-30T14:50:56.561805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|704f266f-f8ddbb1e-370874c4-3e9b19dc_0] Write session: Do CDS request
2025-09-30T14:50:56.561811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|704f266f-f8ddbb1e-370874c4-3e9b19dc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:56.568217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:56.568745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|704f266f-f8ddbb1e-370874c4-3e9b19dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:56.568853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:56.568867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 232
2025-09-30T14:50:56.568995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 232 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:56.569043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 232 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:56.569053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=232 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:56.569057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:56.569382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 232 sessionId:  describe result for acl check
2025-09-30T14:50:56.569406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:56.569412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:56.569413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:56.569419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894829225734933:3863] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:56.569604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:56.569752Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:56.569759Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:56.569767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:56.569806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:56.569837Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894829136010662:3442]
2025-09-30T14:50:56.569856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894829225734933:3863] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:56.570250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:56.570532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:56.570584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:56.570862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:56.570921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:56.570928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:56.570929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:56.570930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:56.570931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:56.570931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:56.570932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:56.570933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:56.570934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:56.570935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:56.570935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.570937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.570937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.570938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:56.570939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:56.570943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:56.570949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:56.570952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:56.570954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:56.570956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:56.570959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:56.570961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:56.570964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:56.570966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:56.570968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:56.570972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.570975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.570977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.570979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:56.570981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:56.570988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:56.570996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:56.571002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:56.571006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:56.571011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:56.571017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:56.571021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:56.571026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:56.571031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:56.571037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:56.571039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:56.571043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:56.571046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:56.571050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:56.571052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:56.571055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:56.571057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:56.571060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:56.571063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:56.571066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:56.571068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.571073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.571077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.571082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.571086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.571091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.571096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:56.571102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:56.571106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:56.571111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:56.571146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:56.571682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894829225734933:3863] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:56.575964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894829225734933:3863] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:56.575980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894829225734933:3863] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:56.575985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894829225734933:3863] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:56.575991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 232 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:56.576284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:56.577154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:56.577166Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:56.577169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:56.577171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:56.577176Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 231 [2:7555894829136010662:3442]
2025-09-30T14:50:56.577188Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:56.577201Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:56.577207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.577209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.577212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.577222Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:56.577230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:56.577234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:56.577279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.577284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.577286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.577288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:56.577293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:56.577345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:56.577351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.577358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.577364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.577377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:56.577390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894829136010657:3442]
2025-09-30T14:50:56.577398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894829136010657:3442]
2025-09-30T14:50:56.577399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894829136010657:3442]
2025-09-30T14:50:56.577406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:56.577416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:56.577420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894829225734911:2454], now have 1 active actors on pipe
2025-09-30T14:50:56.577420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:56.577422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:56.577423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894829225734972:3863], now have 1 active actors on pipe
2025-09-30T14:50:56.577431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:56.577445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:56.577448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:56.577473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894829136010657:3442]
2025-09-30T14:50:56.577479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:56.577493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:56.577508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 231
2025-09-30T14:50:56.577514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 231
2025-09-30T14:50:56.577586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:56.577596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:56.577614Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9712a23-af07415b-6238a857-60d7e3b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:56.577625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.577627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.577628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:56.577635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.577642Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:56.577652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:56.577785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:56.577791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:56.577801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:56.577864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 232 partition: 0 MaxSeqNo: 42 sessionId: src_id|d9712a23-af07415b-6238a857-60d7e3b1_0
2025-09-30T14:50:56.578222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|704f266f-f8ddbb1e-370874c4-3e9b19dc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d9712a23-af07415b-6238a857-60d7e3b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:56.580987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9712a23-af07415b-6238a857-60d7e3b1_0] Write session: try to update token
2025-09-30T14:50:56.581006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9712a23-af07415b-6238a857-60d7e3b1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:56.589525Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:56.589555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:56.589559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:56.589562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:56.589578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894829136010657:3442]
2025-09-30T14:50:56.589585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894829136010657:3442]
2025-09-30T14:50:56.589591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894829136010657:3442]
2025-09-30T14:50:56.589641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:56.589646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:56.589654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:56.589655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.589658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:56.589658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:56.589877Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:56.595065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 232 sessionId: src_id|d9712a23-af07415b-6238a857-60d7e3b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:56.597786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:56.661871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894829225734993:3696]
2025-09-30T14:50:56.662075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 231, pipe: [1:7555894829225734993:3696]
2025-09-30T14:50:56.693687Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:56.694013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:56.694025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:56.694059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894829225734993:3696], now have 1 active actors on pipe
2025-09-30T14:50:56.694277Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:56.694279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:56.694293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:56.694297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:56.694339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894829225734993:3696]
2025-09-30T14:50:56.694360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 232 reason: error at write: Disconnected sessionId: src_id|d9712a23-af07415b-6238a857-60d7e3b1_0
2025-09-30T14:50:56.694588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 232 sessionId: src_id|d9712a23-af07415b-6238a857-60d7e3b1_0 is DEAD
2025-09-30T14:50:56.694767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9712a23-af07415b-6238a857-60d7e3b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:56.694780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9712a23-af07415b-6238a857-60d7e3b1_0] Write session will restart in 0.009337s
2025-09-30T14:50:56.694804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9712a23-af07415b-6238a857-60d7e3b1_0] Write session: Do CDS request
2025-09-30T14:50:56.694810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9712a23-af07415b-6238a857-60d7e3b1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:56.701106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:56.702457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:56.702661Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:56.702669Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:56.702678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:56.702723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:56.702768Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894829136010758:3456]
2025-09-30T14:50:56.703343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:56.703648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:56.703688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:56.703990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:56.704053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:56.704061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:56.704062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:56.704063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:56.704064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:56.704065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:56.704069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:56.704070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:56.704071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:56.704072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:56.704074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.704075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.704076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.704077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:56.704078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:56.704083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:56.704093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:56.704097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:56.704102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:56.704106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:56.704110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:56.704113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:56.704117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:56.704122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:56.704127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:56.704130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.704134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.704138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.704142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:56.704146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:56.704154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:56.704161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:56.704167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:56.704173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:56.704178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:56.704183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:56.704187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:56.704194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:56.704199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:56.704203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:56.704206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:56.704211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:56.704216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:56.704226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:56.704230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:56.704240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:56.704245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:56.704251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:56.704255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:56.704265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:56.704269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.704274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.704283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.704287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.704291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.704296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.704299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:56.704303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:56.704307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:56.704312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:56.704356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:56.705787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9712a23-af07415b-6238a857-60d7e3b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:56.705852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:56.705868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 233
2025-09-30T14:50:56.706001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 233 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:56.706037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 233 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:56.706042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=233 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:56.706046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:56.706506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 233 sessionId:  describe result for acl check
2025-09-30T14:50:56.706541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:56.706548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:56.706550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:56.706555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894829225735030:3874] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:56.707114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894829225735030:3874] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:56.708956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894829225735030:3874] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:56.709599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:56.710689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:56.710701Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:56.710704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:56.710708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:56.710714Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 232 [2:7555894829136010758:3456]
2025-09-30T14:50:56.710727Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:56.710740Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:56.710748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.710751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.710754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.710769Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:56.710780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:56.710786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:56.710838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.710844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.710847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.710850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:56.710853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:56.710914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:56.710925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.710938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.710950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.710968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:56.710990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894829225735003:2454], now have 1 active actors on pipe
2025-09-30T14:50:56.710997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 232
2025-09-30T14:50:56.711002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894829136010753:3456]
2025-09-30T14:50:56.711008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894829136010753:3456]
2025-09-30T14:50:56.711010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894829136010753:3456]
2025-09-30T14:50:56.711018Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:56.711031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:56.711039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:56.711042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:56.711043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:56.711049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:56.711056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:56.711089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894829136010753:3456]
2025-09-30T14:50:56.711101Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:56.711113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:56.711574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894829225735030:3874] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:56.711587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894829225735030:3874] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:56.711592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894829225735030:3874] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:56.711598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 233 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:56.711817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894829225735065:3874], now have 1 active actors on pipe
2025-09-30T14:50:56.711829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 232
2025-09-30T14:50:56.711876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:56.711886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:56.711911Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a061ee1b-780d5637-8cc61cf0-3d7e6a5e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:56.711924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.711932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.711935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:56.711945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.711956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:56.711977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:56.712164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:56.712175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:56.712193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:56.712266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 233 partition: 0 MaxSeqNo: 42 sessionId: src_id|a061ee1b-780d5637-8cc61cf0-3d7e6a5e_0
2025-09-30T14:50:56.712610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9712a23-af07415b-6238a857-60d7e3b1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a061ee1b-780d5637-8cc61cf0-3d7e6a5e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:56.715499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a061ee1b-780d5637-8cc61cf0-3d7e6a5e_0] Write session: try to update token
2025-09-30T14:50:56.715516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a061ee1b-780d5637-8cc61cf0-3d7e6a5e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:56.722733Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:56.722755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:56.722763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894829136010753:3456]
2025-09-30T14:50:56.722802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:56.722824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:56.722980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:56.723129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:56.723307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:56.723459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:56.723808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:56.723858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:56.730300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 233 sessionId: src_id|a061ee1b-780d5637-8cc61cf0-3d7e6a5e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:56.732924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:56.733599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:56.733624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:56.733644Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:56.733651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:56.733653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:56.733658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:56.733666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894829136010753:3456]
2025-09-30T14:50:56.733670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894829136010753:3456]
2025-09-30T14:50:56.733673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894829136010753:3456]
2025-09-30T14:50:56.733713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:56.733720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:56.733724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:56.733726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.733727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:56.733728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:56.733865Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:56.794295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894829225735083:3696]
2025-09-30T14:50:56.794543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 232, pipe: [1:7555894829225735083:3696]
2025-09-30T14:50:56.842912Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:56.843158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:56.843194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894829225735083:3696], now have 1 active actors on pipe
2025-09-30T14:50:56.843337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:56.843386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894829225735083:3696]
2025-09-30T14:50:56.843416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:56.843435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:56.843443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:56.843507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 233 reason: error at write: Disconnected sessionId: src_id|a061ee1b-780d5637-8cc61cf0-3d7e6a5e_0
2025-09-30T14:50:56.843672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 233 sessionId: src_id|a061ee1b-780d5637-8cc61cf0-3d7e6a5e_0 is DEAD
2025-09-30T14:50:56.843799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a061ee1b-780d5637-8cc61cf0-3d7e6a5e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:56.843810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a061ee1b-780d5637-8cc61cf0-3d7e6a5e_0] Write session will restart in 0.009229s
2025-09-30T14:50:56.843833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a061ee1b-780d5637-8cc61cf0-3d7e6a5e_0] Write session: Do CDS request
2025-09-30T14:50:56.843839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a061ee1b-780d5637-8cc61cf0-3d7e6a5e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:56.849998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:56.851225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:56.851385Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:56.851394Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:56.851404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:56.851451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:56.851494Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894829136010832:3459]
2025-09-30T14:50:56.851972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:56.852238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:56.852284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:56.852584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:56.852638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:56.852645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:56.852646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:56.852649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:56.852650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:56.852651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:56.852652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:56.852653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:56.852654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:56.852656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:56.852657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.852658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.852662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.852664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:56.852665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:56.852670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:56.852681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:56.852685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:56.852690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:56.852694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:56.852699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:56.852703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:56.852706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:56.852711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:56.852715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:56.852718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.852723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.852727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.852732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:56.852737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:56.852745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:56.852753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:56.852759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:56.852769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:56.852774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:56.852785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:56.852790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:56.852799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:56.852804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:56.852813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:56.852817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:56.852823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:56.852831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:56.852837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:56.852847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:56.852854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:56.852860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:56.852869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:56.852873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:56.852881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:56.852886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.852895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.852900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.852909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.852914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.852922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.852927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:56.852936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:56.852940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:56.852946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:56.852993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:56.853781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a061ee1b-780d5637-8cc61cf0-3d7e6a5e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:56.853886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:56.853902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 234
2025-09-30T14:50:56.854011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 234 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:56.854056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 234 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:56.854067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=234 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:56.854076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:56.854493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 234 sessionId:  describe result for acl check
2025-09-30T14:50:56.854522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:56.854529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:56.854531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:56.854536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894829225735112:3879] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:56.855147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894829225735112:3879] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:56.856883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894829225735112:3879] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:56.858118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:56.859004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:56.859018Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:56.859021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:56.859026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:56.859033Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 233 [2:7555894829136010832:3459]
2025-09-30T14:50:56.859051Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:56.859065Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:56.859072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.859076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.859078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.859093Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:56.859104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:56.859113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:56.859165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.859172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.859174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.859177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:56.859179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:56.859257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:56.859265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.859277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:56.859289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:56.859305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:56.859326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894829225735085:2454], now have 1 active actors on pipe
2025-09-30T14:50:56.859337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894829136010827:3459]
2025-09-30T14:50:56.859339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894829136010827:3459]
2025-09-30T14:50:56.859341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894829136010827:3459]
2025-09-30T14:50:56.859352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:56.859370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:56.859356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 233
2025-09-30T14:50:56.859369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:56.859373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:56.859375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:56.859388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:56.859391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:56.859416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894829136010827:3459]
2025-09-30T14:50:56.859426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:56.859433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:56.859450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894829225735112:3879] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:56.859463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894829225735112:3879] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:56.859477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894829225735112:3879] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:56.859489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 234 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:56.859669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894829225735147:3879], now have 1 active actors on pipe
2025-09-30T14:50:56.859702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 233
2025-09-30T14:50:56.859772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:56.859782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:56.859805Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|858314a0-6fd48eac-d8680337-d3d298e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:56.859817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.859822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.859824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:56.859833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.859844Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:56.859860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:56.860011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:56.860018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:56.860029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:56.860108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 234 partition: 0 MaxSeqNo: 42 sessionId: src_id|858314a0-6fd48eac-d8680337-d3d298e2_0
2025-09-30T14:50:56.860498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a061ee1b-780d5637-8cc61cf0-3d7e6a5e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|858314a0-6fd48eac-d8680337-d3d298e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:56.863188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|858314a0-6fd48eac-d8680337-d3d298e2_0] Write session: try to update token
2025-09-30T14:50:56.863205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|858314a0-6fd48eac-d8680337-d3d298e2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:56.870728Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:56.870746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:56.870755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894829136010827:3459]
2025-09-30T14:50:56.870800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:56.870799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:56.870978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:56.871122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:56.871275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:56.871417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:56.871610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:56.871650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:56.877849Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 234 sessionId: src_id|858314a0-6fd48eac-d8680337-d3d298e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:56.880471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:56.881430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:56.881452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:56.881467Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:56.881469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:56.881471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:56.881472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:56.881479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894829136010827:3459]
2025-09-30T14:50:56.881482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894829136010827:3459]
2025-09-30T14:50:56.881485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894829136010827:3459]
2025-09-30T14:50:56.881522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:56.881524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:56.881529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:56.881531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:56.881535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:56.881542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:56.881660Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:56.943294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894829225735154:3696]
2025-09-30T14:50:56.943537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 233, pipe: [1:7555894829225735154:3696]
2025-09-30T14:50:56.985888Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:56.986203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:56.986237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894829225735154:3696], now have 1 active actors on pipe
2025-09-30T14:50:56.986325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:56.986429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894829225735154:3696]
2025-09-30T14:50:56.986470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:56.993803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:56.995207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:56.995410Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:56.995419Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:56.995428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:56.995473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:56.995502Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894829136010897:3462]
2025-09-30T14:50:56.995589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:56.995600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:56.995617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 234 reason: error at write: Disconnected sessionId: src_id|858314a0-6fd48eac-d8680337-d3d298e2_0
2025-09-30T14:50:56.995757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 234 sessionId: src_id|858314a0-6fd48eac-d8680337-d3d298e2_0 is DEAD
2025-09-30T14:50:56.995929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|858314a0-6fd48eac-d8680337-d3d298e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:56.995939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|858314a0-6fd48eac-d8680337-d3d298e2_0] Write session will restart in 0.007474s
2025-09-30T14:50:56.995973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|858314a0-6fd48eac-d8680337-d3d298e2_0] Write session: Do CDS request
2025-09-30T14:50:56.995979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|858314a0-6fd48eac-d8680337-d3d298e2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:56.996041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:57.000759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:57.000819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:57.001218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:57.001281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:57.001289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:57.001290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:57.001291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:57.001292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:57.001295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:57.001295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:57.001296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:57.001298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:57.001299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:57.001300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.001301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.001301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.001302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:57.001303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:57.001309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:57.001318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:57.001322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:57.001326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:57.001329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:57.001332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:57.001336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:57.001340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:57.001343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:57.001347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:57.001349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.001353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.001356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.001360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:57.001363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:57.001371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:57.001379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:57.001384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:57.001389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:57.001392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:57.001398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:57.001402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:57.001406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:57.001410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:57.001414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:57.001417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:57.001421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:57.001424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:57.001429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:57.001432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:57.001436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:57.001440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:57.001444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:57.001447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:57.001451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:57.001454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.001458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.001462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.001466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.001469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.001483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.001486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:57.001490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:57.001495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:57.001499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:57.001533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:57.004789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|858314a0-6fd48eac-d8680337-d3d298e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:57.004911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:57.004929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 235
2025-09-30T14:50:57.005041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 235 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:57.005072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 235 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:57.005082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=235 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:57.005086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:57.005514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 235 sessionId:  describe result for acl check
2025-09-30T14:50:57.005546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:57.005550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:57.005553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:57.005557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894833520702490:3885] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:57.005994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894833520702490:3885] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:57.006876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:57.007781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:57.007799Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:57.007801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:57.007804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:57.007810Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 234 [2:7555894829136010897:3462]
2025-09-30T14:50:57.007824Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:57.007841Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:57.007848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.007851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.007853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.007868Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:57.007879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:57.007885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:57.007940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.007947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.007950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.007953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:57.007955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:57.008016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:57.008023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.008035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.008047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.008068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:57.008066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 234
2025-09-30T14:50:57.008088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894829225735165:2454], now have 1 active actors on pipe
2025-09-30T14:50:57.008098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894829136010891:3462]
2025-09-30T14:50:57.008101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894829136010891:3462]
2025-09-30T14:50:57.008103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894829136010891:3462]
2025-09-30T14:50:57.008110Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:57.008119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:57.008124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:57.008129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:57.008131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:57.008139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:57.008142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:57.008179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894829136010891:3462]
2025-09-30T14:50:57.008190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:57.008201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:57.008420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894833520702490:3885] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:57.014850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894833520702490:3885] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:57.014868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894833520702490:3885] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:57.014872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894833520702490:3885] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:57.014881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 235 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:57.015173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894833520702527:3885], now have 1 active actors on pipe
2025-09-30T14:50:57.015273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 234
2025-09-30T14:50:57.015333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:57.015347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:57.015379Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d277795-227ea4dd-296d43e7-4500b83f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:57.015401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.015410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.015413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:57.015425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.015444Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:57.015465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:57.015634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:57.015644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:57.015657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:57.015728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 235 partition: 0 MaxSeqNo: 42 sessionId: src_id|5d277795-227ea4dd-296d43e7-4500b83f_0
2025-09-30T14:50:57.016135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|858314a0-6fd48eac-d8680337-d3d298e2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5d277795-227ea4dd-296d43e7-4500b83f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:57.018842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d277795-227ea4dd-296d43e7-4500b83f_0] Write session: try to update token
2025-09-30T14:50:57.018858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d277795-227ea4dd-296d43e7-4500b83f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:57.020617Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:57.020638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:57.020641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:57.020643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:57.020653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894829136010891:3462]
2025-09-30T14:50:57.020659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894829136010891:3462]
2025-09-30T14:50:57.020677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894829136010891:3462]
2025-09-30T14:50:57.020725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:57.020732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:57.020738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:57.020741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:57.020741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.020744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:57.020955Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:57.033374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 235 sessionId: src_id|5d277795-227ea4dd-296d43e7-4500b83f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:57.036098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:57.086665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894833520702534:3696]
2025-09-30T14:50:57.087093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 234, pipe: [1:7555894833520702534:3696]
2025-09-30T14:50:57.124989Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:57.125272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:57.125288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:57.125309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894833520702534:3696], now have 1 active actors on pipe
2025-09-30T14:50:57.125547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:57.125564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:57.125566Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:57.125583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894833520702534:3696]
2025-09-30T14:50:57.125605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:57.125635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 235 reason: error at write: Disconnected sessionId: src_id|5d277795-227ea4dd-296d43e7-4500b83f_0
2025-09-30T14:50:57.125850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 235 sessionId: src_id|5d277795-227ea4dd-296d43e7-4500b83f_0 is DEAD
2025-09-30T14:50:57.126011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d277795-227ea4dd-296d43e7-4500b83f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:57.126021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d277795-227ea4dd-296d43e7-4500b83f_0] Write session will restart in 0.008214s
2025-09-30T14:50:57.126045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d277795-227ea4dd-296d43e7-4500b83f_0] Write session: Do CDS request
2025-09-30T14:50:57.126050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d277795-227ea4dd-296d43e7-4500b83f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:57.133157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:57.134871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:57.135093Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:57.135103Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:57.135114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:57.135179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:57.135260Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894833430978256:3464]
2025-09-30T14:50:57.135819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d277795-227ea4dd-296d43e7-4500b83f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:57.135890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:57.135930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:57.135948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 236
2025-09-30T14:50:57.136054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 236 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:57.136084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 236 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:57.136089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=236 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:57.136094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:57.136242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:57.136299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:57.136502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 236 sessionId:  describe result for acl check
2025-09-30T14:50:57.136530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:57.136532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:57.136534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:57.136549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894833520702562:3889] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:57.136625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:57.136704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:57.136713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:57.136714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:57.136715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:57.136716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:57.136717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:57.136719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:57.136720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:57.136721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:57.136722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:57.136724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.136725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.136726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.136727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:57.136728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:57.136734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:57.136744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:57.136748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:57.136752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:57.136756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:57.136760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:57.136763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:57.136767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:57.136770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:57.136774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:57.136777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.136784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.136787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.136791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:57.136795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:57.136803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:57.136824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:57.136830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:57.136836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:57.136840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:57.136846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:57.136850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:57.136855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:57.136859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:57.136864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:57.136868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:57.136874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:57.136879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:57.136891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:57.136895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:57.136905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:57.136910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:57.136920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:57.136924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:57.136933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:57.136942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.136947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.136955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.136960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.136964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.136970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.136974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:57.136980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:57.136985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:57.136990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:57.137033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:57.137091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894833520702562:3889] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:57.139296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894833520702562:3889] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:57.142032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894833520702562:3889] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:57.142049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894833520702562:3889] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:57.142052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894833520702562:3889] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:57.142060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 236 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:57.142439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:57.143351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:57.143365Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:57.143368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:57.143371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:57.143378Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 235 [2:7555894833430978256:3464]
2025-09-30T14:50:57.143393Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:57.143408Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:57.143410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.143413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.143415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.143429Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:57.143436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:57.143442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:57.143498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.143507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.143509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.143512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:57.143515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:57.143579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:57.143588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.143599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.143626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.143653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:57.143670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894833520702535:2454], now have 1 active actors on pipe
2025-09-30T14:50:57.143674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894833520702599:3889], now have 1 active actors on pipe
2025-09-30T14:50:57.143680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894833430978251:3464]
2025-09-30T14:50:57.143682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894833430978251:3464]
2025-09-30T14:50:57.143687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894833430978251:3464]
2025-09-30T14:50:57.143699Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:57.143719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:57.143732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:57.143737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:57.143738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:57.143738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:57.143741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:57.143730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 235
2025-09-30T14:50:57.143732Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 235
2025-09-30T14:50:57.143774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894833430978251:3464]
2025-09-30T14:50:57.143782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:57.143785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:57.143801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:57.143805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:57.143855Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4dd528dd-9caafc7-b2de192-b7552611_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:57.143866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.143870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.143872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:57.143880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.143889Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:57.143912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:57.144068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:57.144078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:57.144093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:57.144158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 236 partition: 0 MaxSeqNo: 42 sessionId: src_id|4dd528dd-9caafc7-b2de192-b7552611_0
2025-09-30T14:50:57.144601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d277795-227ea4dd-296d43e7-4500b83f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4dd528dd-9caafc7-b2de192-b7552611_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:57.147339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dd528dd-9caafc7-b2de192-b7552611_0] Write session: try to update token
2025-09-30T14:50:57.147360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dd528dd-9caafc7-b2de192-b7552611_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:57.156070Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:57.156092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:57.156096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:57.156098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:57.156110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894833430978251:3464]
2025-09-30T14:50:57.156116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894833430978251:3464]
2025-09-30T14:50:57.156119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894833430978251:3464]
2025-09-30T14:50:57.156158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:57.156165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.156168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:57.156170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:57.156177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:57.156181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:57.156319Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:57.163647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 236 sessionId: src_id|4dd528dd-9caafc7-b2de192-b7552611_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:57.166587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:57.225901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894833520702607:3696]
2025-09-30T14:50:57.226177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 235, pipe: [1:7555894833520702607:3696]
2025-09-30T14:50:57.271343Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:57.271745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:57.271764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:57.271785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894833520702607:3696], now have 1 active actors on pipe
2025-09-30T14:50:57.272029Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:57.272032Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:57.272044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894833520702607:3696]
2025-09-30T14:50:57.272067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:57.272070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:57.272141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 236 reason: error at write: Disconnected sessionId: src_id|4dd528dd-9caafc7-b2de192-b7552611_0
2025-09-30T14:50:57.272370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 236 sessionId: src_id|4dd528dd-9caafc7-b2de192-b7552611_0 is DEAD
2025-09-30T14:50:57.272514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dd528dd-9caafc7-b2de192-b7552611_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:57.272523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dd528dd-9caafc7-b2de192-b7552611_0] Write session will restart in 0.007735s
2025-09-30T14:50:57.272549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dd528dd-9caafc7-b2de192-b7552611_0] Write session: Do CDS request
2025-09-30T14:50:57.272559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dd528dd-9caafc7-b2de192-b7552611_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:57.279277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:57.280575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:57.280744Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:57.280751Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:57.280759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:57.280800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:57.280827Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894833430978321:3466]
2025-09-30T14:50:57.281249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:57.281488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:57.281515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:57.281720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:57.281754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dd528dd-9caafc7-b2de192-b7552611_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:57.281758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:57.281763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:57.281764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:57.281765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:57.281766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:57.281767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:57.281768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:57.281768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:57.281769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:57.281770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:57.281770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.281771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.281773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.281774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:57.281774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:57.281778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:57.281783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:57.281786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:57.281788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:57.281790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:57.281792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:57.281795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:57.281797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:57.281800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:57.281802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:57.281805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.281807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.281809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.281811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:57.281813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:57.281818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:57.281823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:57.281827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:57.281830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:57.281834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:57.281837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:57.281839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:57.281842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:57.281845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:57.281848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:57.281850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:57.281853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:57.281856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:57.281859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:57.281862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:57.281865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:57.281867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:57.281870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:57.281873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:57.281877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:57.281879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.281882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.281885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.281887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.281890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.281894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.281897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:57.281900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:57.281902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:57.281905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:57.281928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:57.281892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:57.281907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 237
2025-09-30T14:50:57.282037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 237 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:57.282065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 237 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:57.282075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=237 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:57.282079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:57.282456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 237 sessionId:  describe result for acl check
2025-09-30T14:50:57.282488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:57.282494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:57.282496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:57.282501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894833520702638:3893] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:57.283015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894833520702638:3893] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:57.284801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894833520702638:3893] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:57.286823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:57.286932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894833520702638:3893] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:57.286943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894833520702638:3893] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:57.286945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894833520702638:3893] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:57.286951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 237 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:57.287780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:57.287793Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:57.287795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:57.287798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:57.287802Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 236 [2:7555894833430978321:3466]
2025-09-30T14:50:57.287811Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:57.287825Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:57.287827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.287829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.287832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.287843Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:57.287847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:57.287852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:57.287890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.287898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.287899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.287902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:57.287904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:57.287951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:57.287959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.287967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.287973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.287982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:57.287996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894833430978316:3466]
2025-09-30T14:50:57.288001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894833430978316:3466]
2025-09-30T14:50:57.288002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894833430978316:3466]
2025-09-30T14:50:57.288009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:57.288019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:57.288021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894833520702673:3893], now have 1 active actors on pipe
2025-09-30T14:50:57.288024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894833520702608:2454], now have 1 active actors on pipe
2025-09-30T14:50:57.288029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:57.288031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:57.288032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:57.288042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:57.288045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:57.288076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894833430978316:3466]
2025-09-30T14:50:57.288087Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:57.288100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:57.288090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 236
2025-09-30T14:50:57.288110Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 236
2025-09-30T14:50:57.288166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:57.288175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:57.288200Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7aa3e83-6e6addc3-56d304de-b18ad383_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:57.288211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.288215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.288216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:57.288226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.288238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:57.288252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:57.288427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:57.288441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:57.288477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:57.288591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 237 partition: 0 MaxSeqNo: 42 sessionId: src_id|e7aa3e83-6e6addc3-56d304de-b18ad383_0
2025-09-30T14:50:57.288981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dd528dd-9caafc7-b2de192-b7552611_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e7aa3e83-6e6addc3-56d304de-b18ad383_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:57.291857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7aa3e83-6e6addc3-56d304de-b18ad383_0] Write session: try to update token
2025-09-30T14:50:57.291872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7aa3e83-6e6addc3-56d304de-b18ad383_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:57.306262Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:57.306281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:57.306291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894833430978316:3466]
2025-09-30T14:50:57.306332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:57.306348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:57.306493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:57.306650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:57.306793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:57.306934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:57.307126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:57.307174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:57.310557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 237 sessionId: src_id|e7aa3e83-6e6addc3-56d304de-b18ad383_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:57.311581Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:57.311596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:57.311598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:57.311600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:57.311610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894833430978316:3466]
2025-09-30T14:50:57.311614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894833430978316:3466]
2025-09-30T14:50:57.311619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894833430978316:3466]
2025-09-30T14:50:57.311655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:57.311659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:57.311666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.311669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:57.311674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:57.311678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:57.311801Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:57.313182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:57.372344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894833520702681:3696]
2025-09-30T14:50:57.372609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 236, pipe: [1:7555894833520702681:3696]
2025-09-30T14:50:57.418532Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:57.418778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:57.418793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:57.418814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894833520702681:3696], now have 1 active actors on pipe
2025-09-30T14:50:57.418972Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:57.419058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:57.419065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894833520702681:3696]
2025-09-30T14:50:57.419086Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:57.419145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 237 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e7aa3e83-6e6addc3-56d304de-b18ad383_0
2025-09-30T14:50:57.419345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 237 sessionId: src_id|e7aa3e83-6e6addc3-56d304de-b18ad383_0 is DEAD
2025-09-30T14:50:57.419509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7aa3e83-6e6addc3-56d304de-b18ad383_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:57.419521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7aa3e83-6e6addc3-56d304de-b18ad383_0] Write session will restart in 0.007455s
2025-09-30T14:50:57.419555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7aa3e83-6e6addc3-56d304de-b18ad383_0] Write session: Do CDS request
2025-09-30T14:50:57.419561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7aa3e83-6e6addc3-56d304de-b18ad383_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:57.425578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:57.426987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:57.427153Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:57.427163Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:57.427172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:57.427218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:57.427274Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894833430978387:3468]
2025-09-30T14:50:57.427720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7aa3e83-6e6addc3-56d304de-b18ad383_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:57.427857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:57.428149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:57.428203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:57.428520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:57.428583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:57.428588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:57.428589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:57.428593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:57.428594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:57.428594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:57.428595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:57.428597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:57.428598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:57.428600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:57.428601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.428602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.428603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.428604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:57.428605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:57.428610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:57.428619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:57.428622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:57.428626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:57.428629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:57.428632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:57.428635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:57.428639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:57.428644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:57.428648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:57.428652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.428655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.428659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.428670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:57.428674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:57.428682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:57.428694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:57.428700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:57.428709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:57.428719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:57.428728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:57.428733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:57.428742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:57.428751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:57.428756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:57.428759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:57.428764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:57.428768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:57.428778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:57.428788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:57.428797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:57.428806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:57.428815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:57.428822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:57.428828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:57.428842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.428855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.428858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:57.428884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 238
2025-09-30T14:50:57.428867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.428881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.428887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.428893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.428898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:57.428902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:57.428908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:57.428913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:57.428965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:57.429015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 238 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:57.429048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 238 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:57.429059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=238 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:57.429063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:57.429447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 238 sessionId:  describe result for acl check
2025-09-30T14:50:57.429478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:57.429480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:57.429483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:57.429488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894833520702713:3897] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:57.430009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894833520702713:3897] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:57.431965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894833520702713:3897] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:57.434150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:57.434361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894833520702713:3897] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:57.434375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894833520702713:3897] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:57.434378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894833520702713:3897] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:57.434384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 238 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:57.435142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:57.435158Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:57.435161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:57.435165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:57.435171Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 237 [2:7555894833430978387:3468]
2025-09-30T14:50:57.435188Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:57.435203Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:57.435212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.435216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.435218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.435239Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:57.435269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:57.435276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:57.435328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.435335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.435337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.435340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:57.435343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:57.435410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:57.435417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.435429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.435447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.435470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:57.435513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 237
2025-09-30T14:50:57.435514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 237
2025-09-30T14:50:57.435492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894833520702682:2454], now have 1 active actors on pipe
2025-09-30T14:50:57.435501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894833520702748:3897], now have 1 active actors on pipe
2025-09-30T14:50:57.435507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894833430978382:3468]
2025-09-30T14:50:57.435509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894833430978382:3468]
2025-09-30T14:50:57.435511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894833430978382:3468]
2025-09-30T14:50:57.435525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:57.435529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:57.435533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:57.435535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:57.435540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:57.435556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:57.435559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:57.435588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894833430978382:3468]
2025-09-30T14:50:57.435600Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:57.435605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:57.435618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:57.435622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:57.435670Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62bdfe14-32842e9a-de141866-bce3676_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:57.435684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.435687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.435689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:57.435697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.435706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:57.435723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:57.435864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:57.435878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:57.435902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:57.436016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 238 partition: 0 MaxSeqNo: 42 sessionId: src_id|62bdfe14-32842e9a-de141866-bce3676_0
2025-09-30T14:50:57.436384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7aa3e83-6e6addc3-56d304de-b18ad383_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|62bdfe14-32842e9a-de141866-bce3676_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:57.439356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62bdfe14-32842e9a-de141866-bce3676_0] Write session: try to update token
2025-09-30T14:50:57.439374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62bdfe14-32842e9a-de141866-bce3676_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:57.447193Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:57.447211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:57.447213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:57.447215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:57.447224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894833430978382:3468]
2025-09-30T14:50:57.447231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894833430978382:3468]
2025-09-30T14:50:57.447235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894833430978382:3468]
2025-09-30T14:50:57.447289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:57.447296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:57.447298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.447302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:57.447303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:57.447306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:57.447434Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:57.454172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 238 sessionId: src_id|62bdfe14-32842e9a-de141866-bce3676_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:57.456820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:57.519325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894833520702758:3696]
2025-09-30T14:50:57.519636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 237, pipe: [1:7555894833520702758:3696]
2025-09-30T14:50:57.554044Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:57.554347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:57.554360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:57.554381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894833520702758:3696], now have 1 active actors on pipe
2025-09-30T14:50:57.554594Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:57.554599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:57.554603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:57.554662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894833520702758:3696]
2025-09-30T14:50:57.554683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 238 reason: error at write: Disconnected sessionId: src_id|62bdfe14-32842e9a-de141866-bce3676_0
2025-09-30T14:50:57.554915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 238 sessionId: src_id|62bdfe14-32842e9a-de141866-bce3676_0 is DEAD
2025-09-30T14:50:57.555083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62bdfe14-32842e9a-de141866-bce3676_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:57.555092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62bdfe14-32842e9a-de141866-bce3676_0] Write session will restart in 0.005667s
2025-09-30T14:50:57.555113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62bdfe14-32842e9a-de141866-bce3676_0] Write session: Do CDS request
2025-09-30T14:50:57.555118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62bdfe14-32842e9a-de141866-bce3676_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:57.555269Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:57.561674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:57.561842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62bdfe14-32842e9a-de141866-bce3676_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:57.561925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:57.561943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 239
2025-09-30T14:50:57.562060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 239 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:57.562092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 239 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:57.562102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=239 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:57.562106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:57.562530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 239 sessionId:  describe result for acl check
2025-09-30T14:50:57.562561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:57.562567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:57.562569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:57.562574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894833520702787:3902] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:57.563064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:57.563169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894833520702787:3902] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:57.563268Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:57.563277Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:57.563289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:57.563350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:57.563387Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894833430978455:3471]
2025-09-30T14:50:57.564008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:57.564270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:57.564312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:57.564631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:57.564688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:57.564699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:57.564700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:57.564703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:57.564704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:57.564706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:57.564707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:57.564708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:57.564709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:57.564711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:57.564712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.564713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.564714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.564715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:57.564716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:57.564722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:57.564731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:57.564736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:57.564740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:57.564744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:57.564748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:57.564752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:57.564758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:57.564762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:57.564766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:57.564770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.564773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.564777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.564780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:57.564785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:57.564791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:57.564800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:57.564805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:57.564810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:57.564817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:57.564823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:57.564828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:57.564833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:57.564837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:57.564842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:57.564847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:57.564851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:57.564856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:57.564861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:57.564864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:57.564869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:57.564873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:57.564878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:57.564882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:57.564888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:57.564893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.564898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.564902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.564908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.564912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.564917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.564921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:57.564926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:57.564931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:57.564936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:57.564952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894833520702787:3902] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:57.564981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:57.570041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894833520702787:3902] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:57.570061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894833520702787:3902] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:57.570065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894833520702787:3902] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:57.570074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 239 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:57.570348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:57.571346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:57.571360Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:57.571364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:57.571369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:57.571376Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 238 [2:7555894833430978455:3471]
2025-09-30T14:50:57.571391Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:57.571405Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:57.571409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.571413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.571415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.571431Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:57.571438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:57.571446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:57.571494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.571504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.571506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.571509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:57.571511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:57.571571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:57.571577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.571585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.571592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.571608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:57.571625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894833520702759:2454], now have 1 active actors on pipe
2025-09-30T14:50:57.571632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894833430978450:3471]
2025-09-30T14:50:57.571634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894833430978450:3471]
2025-09-30T14:50:57.571635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894833430978450:3471]
2025-09-30T14:50:57.571646Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:57.571654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894833520702826:3902], now have 1 active actors on pipe
2025-09-30T14:50:57.571657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:57.571661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:57.571664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:57.571668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:57.571677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:57.571679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:57.571707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894833430978450:3471]
2025-09-30T14:50:57.571715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:57.571718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:57.571681Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 238
2025-09-30T14:50:57.571734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:57.571700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 238
2025-09-30T14:50:57.571738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:57.571787Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18ac55d0-d6c08e-1a5c0ae7-6d526a52_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:57.571799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.571802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.571804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:57.571812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.571826Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:57.571847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:57.571996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:57.572008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:57.572024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:57.572112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 239 partition: 0 MaxSeqNo: 42 sessionId: src_id|18ac55d0-d6c08e-1a5c0ae7-6d526a52_0
2025-09-30T14:50:57.572525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62bdfe14-32842e9a-de141866-bce3676_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|18ac55d0-d6c08e-1a5c0ae7-6d526a52_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:57.575581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18ac55d0-d6c08e-1a5c0ae7-6d526a52_0] Write session: try to update token
2025-09-30T14:50:57.575600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18ac55d0-d6c08e-1a5c0ae7-6d526a52_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:57.584162Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:57.584184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:57.584186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:57.584189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:57.584199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894833430978450:3471]
2025-09-30T14:50:57.584203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894833430978450:3471]
2025-09-30T14:50:57.584208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894833430978450:3471]
2025-09-30T14:50:57.584249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:57.584256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.584259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:57.584278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:57.584285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:57.584288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:57.584404Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:57.589674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 239 sessionId: src_id|18ac55d0-d6c08e-1a5c0ae7-6d526a52_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:57.592246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:57.654987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894833520702834:3696]
2025-09-30T14:50:57.655353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 238, pipe: [1:7555894833520702834:3696]
2025-09-30T14:50:57.699413Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:57.699983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:57.700037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894833520702834:3696]
2025-09-30T14:50:57.700055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:57.700129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 239 reason: status is not ok: tablet will be restarted right now sessionId: src_id|18ac55d0-d6c08e-1a5c0ae7-6d526a52_0
2025-09-30T14:50:57.699702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:57.699722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:57.699763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894833520702834:3696], now have 1 active actors on pipe
2025-09-30T14:50:57.699972Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:57.700333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 239 sessionId: src_id|18ac55d0-d6c08e-1a5c0ae7-6d526a52_0 is DEAD
2025-09-30T14:50:57.700480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ac55d0-d6c08e-1a5c0ae7-6d526a52_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:57.700490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ac55d0-d6c08e-1a5c0ae7-6d526a52_0] Write session will restart in 0.009144s
2025-09-30T14:50:57.700514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ac55d0-d6c08e-1a5c0ae7-6d526a52_0] Write session: Do CDS request
2025-09-30T14:50:57.700519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ac55d0-d6c08e-1a5c0ae7-6d526a52_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:57.708477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:57.709899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:57.710087Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:57.710101Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:57.710113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:57.710164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:57.710201Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894833430978552:3479]
2025-09-30T14:50:57.710843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18ac55d0-d6c08e-1a5c0ae7-6d526a52_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:57.710837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:57.710924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:57.710948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 240
2025-09-30T14:50:57.711125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:57.711176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:57.711212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 240 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:57.711265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 240 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:57.711274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=240 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:57.711277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:57.711515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:57.711578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:57.711585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:57.711586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:57.711587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:57.711589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:57.711590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:57.711591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:57.711592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:57.711594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:57.711595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:57.711596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.711597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.711598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.711599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:57.711600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:57.711640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 240 sessionId:  describe result for acl check
2025-09-30T14:50:57.711606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:57.711616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:57.711620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:57.711625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:57.711629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:57.711633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:57.711637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:57.711641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:57.711674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:57.711685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:57.711686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:57.711646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:57.711650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:57.711654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.711692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894833520702890:3913] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:57.711658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.711663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.711667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:57.711670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:57.711677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:57.711685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:57.711691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:57.711697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:57.711702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:57.711707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:57.711711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:57.711716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:57.711721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:57.711726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:57.711730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:57.711735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:57.711740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:57.711746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:57.711750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:57.711756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:57.711760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:57.711765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:57.711769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:57.711774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:57.711779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.711784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.711788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.711793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.711798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.711803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.711808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:57.711813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:57.711817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:57.711822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:57.711864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:57.712196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894833520702890:3913] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:57.713873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894833520702890:3913] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:57.716677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894833520702890:3913] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:57.716689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894833520702890:3913] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:57.716692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894833520702890:3913] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:57.716699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 240 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:57.717138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:57.718239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:57.718259Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:57.718261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:57.718265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:57.718271Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 239 [2:7555894833430978552:3479]
2025-09-30T14:50:57.718287Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:57.718305Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:57.718317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.718322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.718325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.718340Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:57.718346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:57.718353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:57.718410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.718418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.718420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.718423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:57.718425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:57.718495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:57.718503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.718518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.718535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.718558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:57.718584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894833520702848:2454], now have 1 active actors on pipe
2025-09-30T14:50:57.718588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894833520702925:3913], now have 1 active actors on pipe
2025-09-30T14:50:57.718594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894833430978547:3479]
2025-09-30T14:50:57.718597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894833430978547:3479]
2025-09-30T14:50:57.718599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894833430978547:3479]
2025-09-30T14:50:57.718627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:57.718633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:57.718636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:57.718638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:57.718641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:57.718625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 239
2025-09-30T14:50:57.718656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:57.718663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 239
2025-09-30T14:50:57.718660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:57.718687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894833430978547:3479]
2025-09-30T14:50:57.718691Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:57.718705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:57.718728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:57.718739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:57.718769Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a48c8518-34e98485-7e651584-a752e713_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:57.718782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.718790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.718792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:57.718800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.718810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:57.718825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:57.718970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:57.718978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:57.718992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:57.719065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 240 partition: 0 MaxSeqNo: 42 sessionId: src_id|a48c8518-34e98485-7e651584-a752e713_0
2025-09-30T14:50:57.719425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ac55d0-d6c08e-1a5c0ae7-6d526a52_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a48c8518-34e98485-7e651584-a752e713_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:57.722201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a48c8518-34e98485-7e651584-a752e713_0] Write session: try to update token
2025-09-30T14:50:57.722218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a48c8518-34e98485-7e651584-a752e713_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:57.730858Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:57.730876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:57.730878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:57.730880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:57.730889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894833430978547:3479]
2025-09-30T14:50:57.730894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894833430978547:3479]
2025-09-30T14:50:57.730897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894833430978547:3479]
2025-09-30T14:50:57.730939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:57.730950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:57.730954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.730957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:57.730957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:57.730962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:57.731100Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:57.736585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 240 sessionId: src_id|a48c8518-34e98485-7e651584-a752e713_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:57.739315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:57.800345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894833520702944:3696]
2025-09-30T14:50:57.800631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 239, pipe: [1:7555894833520702944:3696]
2025-09-30T14:50:57.844424Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:57.844663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:57.844680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:57.844715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894833520702944:3696], now have 1 active actors on pipe
2025-09-30T14:50:57.844910Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:57.845041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:57.845073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:57.845097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894833520702944:3696]
2025-09-30T14:50:57.845164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 240 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a48c8518-34e98485-7e651584-a752e713_0
2025-09-30T14:50:57.845379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 240 sessionId: src_id|a48c8518-34e98485-7e651584-a752e713_0 is DEAD
2025-09-30T14:50:57.845535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a48c8518-34e98485-7e651584-a752e713_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:57.845549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a48c8518-34e98485-7e651584-a752e713_0] Write session will restart in 0.005507s
2025-09-30T14:50:57.845573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a48c8518-34e98485-7e651584-a752e713_0] Write session: Do CDS request
2025-09-30T14:50:57.845578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a48c8518-34e98485-7e651584-a752e713_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:57.851745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a48c8518-34e98485-7e651584-a752e713_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:57.851855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:57.851875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 241
2025-09-30T14:50:57.851984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 241 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:57.852013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 241 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:57.852018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=241 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:57.852022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:57.852218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:57.852426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 241 sessionId:  describe result for acl check
2025-09-30T14:50:57.852480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:57.852487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:57.852488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:57.852494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894833520702976:3918] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:57.853148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894833520702976:3918] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:57.853646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:57.853837Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:57.853851Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:57.853864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:57.853932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:57.853975Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894833430978641:3488]
2025-09-30T14:50:57.854581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:57.854876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:57.854927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:57.854925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894833520702976:3918] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:57.855255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:57.855341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:57.855348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:57.855349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:57.855350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:57.855352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:57.855353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:57.855354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:57.855355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:57.855356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:57.855357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:57.855359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.855360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.855361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.855362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:57.855363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:57.855369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:57.855380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:57.855384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:57.855388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:57.855394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:57.855398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:57.855404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:57.855408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:57.855412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:57.855416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:57.855420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.855425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.855428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.855432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:57.855436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:57.855445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:57.855453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:57.855459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:57.855466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:57.855471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:57.855478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:57.855487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:57.855493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:57.855497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:57.855502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:57.855506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:57.855511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:57.855520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:57.855525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:57.855530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:57.855539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:57.855544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:57.855553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:57.855557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:57.855562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:57.855570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.855575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.855581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.855586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.855590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.855595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.855600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:57.855605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:57.855610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:57.855615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:57.855664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:57.860812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894833520702976:3918] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:57.860829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894833520702976:3918] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:57.860832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894833520702976:3918] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:57.860841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 241 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:57.861158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:57.862096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:57.862117Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:57.862120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:57.862124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:57.862130Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 240 [2:7555894833430978641:3488]
2025-09-30T14:50:57.862144Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:57.862159Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:57.862168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.862171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.862173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.862190Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:57.862201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:57.862207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:57.862271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.862279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.862281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.862285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:57.862287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:57.862354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:57.862361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.862374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.862393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.862415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:57.862439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894833520703014:3918], now have 1 active actors on pipe
2025-09-30T14:50:57.862450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894833520702946:2454], now have 1 active actors on pipe
2025-09-30T14:50:57.862457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894833430978636:3488]
2025-09-30T14:50:57.862463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894833430978636:3488]
2025-09-30T14:50:57.862465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894833430978636:3488]
2025-09-30T14:50:57.862478Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:57.862493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:57.862496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:57.862503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:57.862505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:57.862510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:57.862492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 240
2025-09-30T14:50:57.862513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:57.862510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 240
2025-09-30T14:50:57.862544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894833430978636:3488]
2025-09-30T14:50:57.862547Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:57.862550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:57.862561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:57.862566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:57.862632Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7d96e69-50c61810-fb403457-567274a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:57.862648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.862652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.862654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:57.862664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.862679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:57.862702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:57.862869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:57.862880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:57.862898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:57.862980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 241 partition: 0 MaxSeqNo: 42 sessionId: src_id|a7d96e69-50c61810-fb403457-567274a5_0
2025-09-30T14:50:57.863391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a48c8518-34e98485-7e651584-a752e713_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a7d96e69-50c61810-fb403457-567274a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:57.866279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7d96e69-50c61810-fb403457-567274a5_0] Write session: try to update token
2025-09-30T14:50:57.866296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7d96e69-50c61810-fb403457-567274a5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:57.875879Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:57.875906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:57.875910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:57.875913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:57.875924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894833430978636:3488]
2025-09-30T14:50:57.875930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894833430978636:3488]
2025-09-30T14:50:57.875938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894833430978636:3488]
2025-09-30T14:50:57.875990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:57.875992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:57.875999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:57.876003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:57.876009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.876013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:57.876373Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:57.881763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 241 sessionId: src_id|a7d96e69-50c61810-fb403457-567274a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:57.884372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:57.945267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894833520703021:3696]
2025-09-30T14:50:57.945559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 240, pipe: [1:7555894833520703021:3696]
2025-09-30T14:50:57.981565Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:57.981830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:57.981843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:57.981861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894833520703021:3696], now have 1 active actors on pipe
2025-09-30T14:50:57.982049Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:57.982090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894833520703021:3696]
2025-09-30T14:50:57.982096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:57.982122Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:57.982179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 241 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a7d96e69-50c61810-fb403457-567274a5_0
2025-09-30T14:50:57.982430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 241 sessionId: src_id|a7d96e69-50c61810-fb403457-567274a5_0 is DEAD
2025-09-30T14:50:57.982605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7d96e69-50c61810-fb403457-567274a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:57.982640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7d96e69-50c61810-fb403457-567274a5_0] Write session will restart in 0.006364s
2025-09-30T14:50:57.982663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7d96e69-50c61810-fb403457-567274a5_0] Write session: Do CDS request
2025-09-30T14:50:57.982669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7d96e69-50c61810-fb403457-567274a5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:57.989572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:57.989706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7d96e69-50c61810-fb403457-567274a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:57.989804Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:57.989817Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 242
2025-09-30T14:50:57.989948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 242 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:57.989979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 242 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:57.989988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=242 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:57.989992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:57.990413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 242 sessionId:  describe result for acl check
2025-09-30T14:50:57.990455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:57.990470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:57.990472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:57.990478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894833520703065:3924] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:57.991020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894833520703065:3924] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:57.991018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:57.991236Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:57.991275Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:57.991286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:57.991342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:57.991385Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894833430978711:3491]
2025-09-30T14:50:57.992001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:57.992239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:57.992282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:57.992605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:57.992666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:57.992671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:57.992673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:57.992674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:57.992675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:57.992676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:57.992677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:57.992678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:57.992679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:57.992680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:57.992682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.992683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.992684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.992685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:57.992686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:57.992692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:57.992698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:57.992701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:57.992704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:57.992706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:57.992709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:57.992711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:57.992713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:57.992716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:57.992718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:57.992721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.992724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.992726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.992729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:57.992731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:57.992736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:57.992740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:57.992744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:57.992747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:57.992749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:57.992752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:57.992754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:57.992757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:57.992759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:57.992762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:57.992765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:57.992768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:57.992770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:57.992774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:57.992776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:57.992778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:57.992781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:57.992784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:57.992787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:57.992789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:57.992792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.992794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.992797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.992800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.992802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.992805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.992809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:57.992815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:57.992820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:57.992824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:57.992865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:57.993002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894833520703065:3924] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:57.997765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894833520703065:3924] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:57.997789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894833520703065:3924] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:57.997793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894833520703065:3924] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:57.997801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 242 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:57.998122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:57.998963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:57.998979Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:57.998981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:57.998985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:57.998992Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 241 [2:7555894833430978711:3491]
2025-09-30T14:50:57.999003Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:57.999015Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:57.999017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.999019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.999020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.999031Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:57.999035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:57.999041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:57.999082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.999087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.999089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.999091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:57.999093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:57.999142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:57.999147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:57.999155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:57.999163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:57.999174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:57.999191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894833520703034:2454], now have 1 active actors on pipe
2025-09-30T14:50:57.999199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894833520703104:3924], now have 1 active actors on pipe
2025-09-30T14:50:57.999205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894833430978706:3491]
2025-09-30T14:50:57.999208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894833430978706:3491]
2025-09-30T14:50:57.999210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894833430978706:3491]
2025-09-30T14:50:57.999224Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:57.999240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:57.999240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:57.999260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:57.999263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:57.999273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:57.999275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:57.999303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894833430978706:3491]
2025-09-30T14:50:57.999288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 241
2025-09-30T14:50:57.999312Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:57.999288Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 241
2025-09-30T14:50:57.999315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:57.999360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:57.999364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:57.999384Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88c536d9-7b695557-cc4c6927-5c4e086e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:57.999393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.999397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.999399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:57.999406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.999413Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:57.999425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:57.999559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:57.999569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:57.999588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:57.999698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 242 partition: 0 MaxSeqNo: 42 sessionId: src_id|88c536d9-7b695557-cc4c6927-5c4e086e_0
2025-09-30T14:50:58.000107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7d96e69-50c61810-fb403457-567274a5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|88c536d9-7b695557-cc4c6927-5c4e086e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:58.002827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88c536d9-7b695557-cc4c6927-5c4e086e_0] Write session: try to update token
2025-09-30T14:50:58.002845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88c536d9-7b695557-cc4c6927-5c4e086e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:58.010921Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:58.010944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:58.010955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894833430978706:3491]
2025-09-30T14:50:58.011013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:58.011028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:58.011350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:58.011595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:58.011815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:58.012048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:58.012341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:58.012392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:58.017608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 242 sessionId: src_id|88c536d9-7b695557-cc4c6927-5c4e086e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:58.020327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:58.020486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:58.020510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:58.021772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:58.021807Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:58.021815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:58.021821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:58.021823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:58.021832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894833430978706:3491]
2025-09-30T14:50:58.021842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894833430978706:3491]
2025-09-30T14:50:58.021847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894833430978706:3491]
2025-09-30T14:50:58.021858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:58.021884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:58.021885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:58.021890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:58.021896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.021898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:58.021903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:58.022032Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:58.082491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894837815670413:3696]
2025-09-30T14:50:58.082789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 241, pipe: [1:7555894837815670413:3696]
2025-09-30T14:50:58.138329Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:58.146503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:58.146536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:58.146728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:58.146801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:58.146874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:58.146946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:58.146994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:58.147009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:58.147086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:58.147154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:58.147222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:58.147313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:58.147366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:58.147374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:58.147446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:58.147518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:58.147595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:58.147668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:58.147715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:58.147723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:58.147795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:58.147871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:58.147941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:58.148023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:58.148075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:58.148083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:58.148152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:58.148217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:58.148288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:58.148357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:58.148404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:58.148411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:58.148480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:58.148546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:58.148612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:58.148678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:58.148757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:58.148764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:58.148831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:58.148898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:58.148969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:58.149041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:58.149090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:58.149099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:58.149171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:58.149234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:58.149300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:58.149376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:58.149425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:58.149432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:58.149504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:58.149566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:58.149638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:58.149711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:58.149787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:58.149795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:58.149864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:50:58.149927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:50:58.149992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:50:58.150056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:50:58.150101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:50:58.150108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:50:58.150174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894837815670413:3696], now have 1 active actors on pipe
2025-09-30T14:50:58.150369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:58.150386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:58.150389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:58.150428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 242 reason: error at write: Disconnected sessionId: src_id|88c536d9-7b695557-cc4c6927-5c4e086e_0
2025-09-30T14:50:58.150435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894837815670413:3696]
2025-09-30T14:50:58.150634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 242 sessionId: src_id|88c536d9-7b695557-cc4c6927-5c4e086e_0 is DEAD
2025-09-30T14:50:58.150723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88c536d9-7b695557-cc4c6927-5c4e086e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:58.150733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88c536d9-7b695557-cc4c6927-5c4e086e_0] Write session will restart in 0.007165s
2025-09-30T14:50:58.150755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88c536d9-7b695557-cc4c6927-5c4e086e_0] Write session: Do CDS request
2025-09-30T14:50:58.150779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88c536d9-7b695557-cc4c6927-5c4e086e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:58.151278Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:58.158830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88c536d9-7b695557-cc4c6927-5c4e086e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:58.158843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:58.158952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:58.158972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 243
2025-09-30T14:50:58.159119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 243 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:58.159155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 243 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:58.159165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=243 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:58.159169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:58.159587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 243 sessionId:  describe result for acl check
2025-09-30T14:50:58.159621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:58.159623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:58.159625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:58.159631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894837815670448:3930] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:58.160106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894837815670448:3930] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:58.160340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:58.160524Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:58.160533Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:58.160542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:58.160583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:58.160618Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894837725946078:3493]
2025-09-30T14:50:58.161083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:58.161343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:58.161390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:58.161721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:58.161778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:58.161784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:58.161785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:58.161786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:58.161788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:58.161789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:58.161790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:58.161791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:58.161792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:58.161794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:58.161795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.161796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.161797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.161798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:58.161799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:58.161804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:58.161815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:58.161819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:58.161824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:58.161829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:58.161833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:58.161837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:58.161840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:58.161844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:58.161847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:58.161850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.161855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.161858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.161862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:58.161865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:58.161871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:58.161878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:58.161884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:58.161889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:58.161894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:58.161899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:58.161903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:58.161907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:58.161911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:58.161916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:58.161920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:58.161925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:58.161930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:58.161935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:58.161940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:58.161945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:58.161950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:58.161955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:58.161960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:58.161965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:58.161970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.161975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.161985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.161991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.161999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.162005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.162009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:58.162014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:58.162023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:58.162028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:58.162073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:58.162505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894837815670448:3930] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:58.166982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894837815670448:3930] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:58.167001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894837815670448:3930] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:58.167003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894837815670448:3930] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:58.167010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 243 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:58.167376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:58.168464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:58.168482Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:58.168484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:58.168488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:58.168495Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 242 [2:7555894837725946078:3493]
2025-09-30T14:50:58.168510Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:58.168524Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:58.168528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.168532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.168535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.168551Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:58.168565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:58.168573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:58.168627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.168636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.168638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.168641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:58.168644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:58.168711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:58.168720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.168733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.168746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.168770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:58.168798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 242
2025-09-30T14:50:58.168794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894837815670487:3930], now have 1 active actors on pipe
2025-09-30T14:50:58.168801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 242
2025-09-30T14:50:58.168807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894837815670415:2454], now have 1 active actors on pipe
2025-09-30T14:50:58.168813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894837725946073:3493]
2025-09-30T14:50:58.168816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894837725946073:3493]
2025-09-30T14:50:58.168817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894837725946073:3493]
2025-09-30T14:50:58.168833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:58.168848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:58.168858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:58.168861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:58.168863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:58.168864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:58.168871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:58.168910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:58.168921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:58.168931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894837725946073:3493]
2025-09-30T14:50:58.168944Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:58.168955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:58.168979Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5f41183-b579d1f1-4b22ed1c-88415a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:58.168993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.169001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.169003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:58.169012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.169025Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:58.169053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:58.169184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:58.169207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:58.169234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:58.169339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 243 partition: 0 MaxSeqNo: 42 sessionId: src_id|e5f41183-b579d1f1-4b22ed1c-88415a4_0
2025-09-30T14:50:58.169720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88c536d9-7b695557-cc4c6927-5c4e086e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e5f41183-b579d1f1-4b22ed1c-88415a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:58.172578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5f41183-b579d1f1-4b22ed1c-88415a4_0] Write session: try to update token
2025-09-30T14:50:58.172596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5f41183-b579d1f1-4b22ed1c-88415a4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:58.180890Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:58.180909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:58.180912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:58.180914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:58.180923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894837725946073:3493]
2025-09-30T14:50:58.180930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894837725946073:3493]
2025-09-30T14:50:58.180934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894837725946073:3493]
2025-09-30T14:50:58.180978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:58.180983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:58.180985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.180987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:58.180989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:58.180994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:58.181125Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:58.187073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 243 sessionId: src_id|e5f41183-b579d1f1-4b22ed1c-88415a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:58.190267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:58.250452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894837815670494:3696]
2025-09-30T14:50:58.250734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 242, pipe: [1:7555894837815670494:3696]
2025-09-30T14:50:58.292245Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:58.292561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:58.292577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:58.292596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894837815670494:3696], now have 1 active actors on pipe
2025-09-30T14:50:58.292816Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:58.292831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:58.292847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894837815670494:3696]
2025-09-30T14:50:58.292853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:58.292865Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:58.292917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 243 reason: error at write: Disconnected sessionId: src_id|e5f41183-b579d1f1-4b22ed1c-88415a4_0
2025-09-30T14:50:58.293135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 243 sessionId: src_id|e5f41183-b579d1f1-4b22ed1c-88415a4_0 is DEAD
2025-09-30T14:50:58.293275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5f41183-b579d1f1-4b22ed1c-88415a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:58.293286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5f41183-b579d1f1-4b22ed1c-88415a4_0] Write session will restart in 0.007284s
2025-09-30T14:50:58.293309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5f41183-b579d1f1-4b22ed1c-88415a4_0] Write session: Do CDS request
2025-09-30T14:50:58.293318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5f41183-b579d1f1-4b22ed1c-88415a4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:58.299918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:58.301565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:58.301782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5f41183-b579d1f1-4b22ed1c-88415a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:58.301786Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:58.301799Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:58.301811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:58.301878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:58.301928Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894837725946150:3495]
2025-09-30T14:50:58.301906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:58.301921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 244
2025-09-30T14:50:58.302028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 244 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:58.302057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 244 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:58.302066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=244 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:58.302070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:58.302440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 244 sessionId:  describe result for acl check
2025-09-30T14:50:58.302470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:58.302475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:58.302476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:58.302481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894837815670528:3934] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:58.302561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:58.302855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:58.302902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:58.302914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894837815670528:3934] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:58.303225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:58.303311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:58.303320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:58.303321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:58.303322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:58.303323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:58.303324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:58.303325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:58.303327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:58.303328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:58.303329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:58.303331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.303332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.303333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.303334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:58.303334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:58.303340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:58.303349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:58.303352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:58.303356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:58.303359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:58.303363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:58.303366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:58.303370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:58.303374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:58.303379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:58.303385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.303389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.303393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.303396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:58.303400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:58.303407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:58.303415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:58.303421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:58.303426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:58.303431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:58.303436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:58.303441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:58.303446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:58.303450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:58.303455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:58.303460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:58.303471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:58.303479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:58.303486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:58.303494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:58.303500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:58.303505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:58.303514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:58.303518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:58.303523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:58.303531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.303536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.303545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.303549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.303554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.303562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.303568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:58.303577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:58.303582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:58.303590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:58.303628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:58.304954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894837815670528:3934] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:58.308653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894837815670528:3934] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:58.308671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894837815670528:3934] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:58.308677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894837815670528:3934] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:58.308685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 244 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:58.309054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:58.309911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:58.309927Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:58.309930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:58.309934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:58.309940Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 243 [2:7555894837725946150:3495]
2025-09-30T14:50:58.309956Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:58.309970Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:58.309973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.309976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.309979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.309996Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:58.310002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:58.310013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:58.310070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.310077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.310079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.310082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:58.310086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:58.310151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:58.310162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.310174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.310187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.310206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:58.310228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894837815670567:3934], now have 1 active actors on pipe
2025-09-30T14:50:58.310237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894837815670495:2454], now have 1 active actors on pipe
2025-09-30T14:50:58.310243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894837725946145:3495]
2025-09-30T14:50:58.310245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894837725946145:3495]
2025-09-30T14:50:58.310246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894837725946145:3495]
2025-09-30T14:50:58.310259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:58.310257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 243
2025-09-30T14:50:58.310272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:58.310260Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 243
2025-09-30T14:50:58.310290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:58.310293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:58.310295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:58.310297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:58.310300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:58.310328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894837725946145:3495]
2025-09-30T14:50:58.310338Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:58.310350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:58.310353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:58.310358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:58.310406Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c2e2447-6e7e8ea4-e0c3f2d7-646e70af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:58.310416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.310420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.310422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:58.310432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.310444Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:58.310460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:58.310637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:58.310654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:58.310678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:58.310754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 244 partition: 0 MaxSeqNo: 42 sessionId: src_id|5c2e2447-6e7e8ea4-e0c3f2d7-646e70af_0
2025-09-30T14:50:58.311135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5f41183-b579d1f1-4b22ed1c-88415a4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5c2e2447-6e7e8ea4-e0c3f2d7-646e70af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:58.313872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c2e2447-6e7e8ea4-e0c3f2d7-646e70af_0] Write session: try to update token
2025-09-30T14:50:58.313889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c2e2447-6e7e8ea4-e0c3f2d7-646e70af_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:58.322426Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:58.322448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:58.322450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:58.322452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:58.322465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894837725946145:3495]
2025-09-30T14:50:58.322469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894837725946145:3495]
2025-09-30T14:50:58.322472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894837725946145:3495]
2025-09-30T14:50:58.322510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:58.322517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.322522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:58.322525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:58.322532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:58.322537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:58.322666Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:58.328317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 244 sessionId: src_id|5c2e2447-6e7e8ea4-e0c3f2d7-646e70af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:58.331157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:58.392774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894837815670575:3696]
2025-09-30T14:50:58.393069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 243, pipe: [1:7555894837815670575:3696]
2025-09-30T14:50:58.432283Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:58.432673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:58.432687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:58.432726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894837815670575:3696], now have 1 active actors on pipe
2025-09-30T14:50:58.432942Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:58.432980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894837815670575:3696]
2025-09-30T14:50:58.432987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:58.433012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:58.433091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 244 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5c2e2447-6e7e8ea4-e0c3f2d7-646e70af_0
2025-09-30T14:50:58.433272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 244 sessionId: src_id|5c2e2447-6e7e8ea4-e0c3f2d7-646e70af_0 is DEAD
2025-09-30T14:50:58.433411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c2e2447-6e7e8ea4-e0c3f2d7-646e70af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:58.433432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c2e2447-6e7e8ea4-e0c3f2d7-646e70af_0] Write session will restart in 0.007389s
2025-09-30T14:50:58.433455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c2e2447-6e7e8ea4-e0c3f2d7-646e70af_0] Write session: Do CDS request
2025-09-30T14:50:58.433461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c2e2447-6e7e8ea4-e0c3f2d7-646e70af_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:58.440035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:58.441622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:58.441745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c2e2447-6e7e8ea4-e0c3f2d7-646e70af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:58.441784Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:58.441791Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:58.441799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:58.441835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:58.441866Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894837725946223:3497]
2025-09-30T14:50:58.441870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:58.441903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 245
2025-09-30T14:50:58.442037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 245 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:58.442079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 245 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:58.442087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=245 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:58.442091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:58.442409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:58.442558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 245 sessionId:  describe result for acl check
2025-09-30T14:50:58.442593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:58.442621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:58.442624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:58.442629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894837815670613:3939] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:58.442761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:58.442799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:58.443108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:58.443150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894837815670613:3939] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:58.443178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:58.443185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:58.443186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:58.443187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:58.443188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:58.443189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:58.443190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:58.443191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:58.443193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:58.443194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:58.443195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.443197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.443198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.443199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:58.443201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:58.443206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:58.443217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:58.443221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:58.443226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:58.443230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:58.443234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:58.443238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:58.443255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:58.443259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:58.443264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:58.443270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.443274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.443278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.443282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:58.443286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:58.443293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:58.443301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:58.443308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:58.443313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:58.443318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:58.443324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:58.443328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:58.443335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:58.443339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:58.443345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:58.443349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:58.443353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:58.443357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:58.443362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:58.443367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:58.443372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:58.443377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:58.443382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:58.443386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:58.443391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:58.443396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.443401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.443406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.443411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.443415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.443420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.443425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:58.443431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:58.443435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:58.443440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:58.443489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:58.445276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894837815670613:3939] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:58.448663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894837815670613:3939] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:58.448681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894837815670613:3939] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:58.448685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894837815670613:3939] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:58.448693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 245 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:58.449071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:58.449961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:58.449983Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:58.449985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:58.449990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:58.449999Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 244 [2:7555894837725946223:3497]
2025-09-30T14:50:58.450015Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:58.450034Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:58.450037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.450040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.450043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.450059Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:58.450071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:58.450077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:58.450139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.450147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.450149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.450152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:58.450157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:58.450223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:58.450236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.450249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.450260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.450281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:58.450303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894837815670576:2454], now have 1 active actors on pipe
2025-09-30T14:50:58.450312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894837815670651:3939], now have 1 active actors on pipe
2025-09-30T14:50:58.450318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894837725946218:3497]
2025-09-30T14:50:58.450320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894837725946218:3497]
2025-09-30T14:50:58.450324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894837725946218:3497]
2025-09-30T14:50:58.450335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:58.450347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:58.450345Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 244
2025-09-30T14:50:58.450355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:58.450360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 244
2025-09-30T14:50:58.450356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:58.450358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:58.450371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:58.450374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:58.450403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894837725946218:3497]
2025-09-30T14:50:58.450415Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:58.450421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:58.450434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:58.450438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:58.450487Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2384c819-e79657d7-f8f41d94-d059eebe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:58.450503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.450506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.450508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:58.450516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.450525Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:58.450543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:58.450693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:58.450704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:58.450721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:58.450791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 245 partition: 0 MaxSeqNo: 42 sessionId: src_id|2384c819-e79657d7-f8f41d94-d059eebe_0
2025-09-30T14:50:58.451176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c2e2447-6e7e8ea4-e0c3f2d7-646e70af_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2384c819-e79657d7-f8f41d94-d059eebe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:58.453984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2384c819-e79657d7-f8f41d94-d059eebe_0] Write session: try to update token
2025-09-30T14:50:58.454001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2384c819-e79657d7-f8f41d94-d059eebe_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:58.462625Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:58.462645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:58.462650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:58.462656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:58.462666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894837725946218:3497]
2025-09-30T14:50:58.462670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894837725946218:3497]
2025-09-30T14:50:58.462674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894837725946218:3497]
2025-09-30T14:50:58.462714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:58.462716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:58.462720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.462721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:58.462723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:58.462736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:58.462879Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:58.468211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 245 sessionId: src_id|2384c819-e79657d7-f8f41d94-d059eebe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:58.470937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:58.533063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894837815670659:3696]
2025-09-30T14:50:58.533339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 244, pipe: [1:7555894837815670659:3696]
2025-09-30T14:50:58.571745Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:58.572062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:58.572075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:58.572109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894837815670659:3696], now have 1 active actors on pipe
2025-09-30T14:50:58.572275Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:58.572379Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:58.572439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:58.572509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894837815670659:3696]
2025-09-30T14:50:58.572517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 245 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2384c819-e79657d7-f8f41d94-d059eebe_0
2025-09-30T14:50:58.572712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 245 sessionId: src_id|2384c819-e79657d7-f8f41d94-d059eebe_0 is DEAD
2025-09-30T14:50:58.572852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2384c819-e79657d7-f8f41d94-d059eebe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:50:58.572863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2384c819-e79657d7-f8f41d94-d059eebe_0] Write session will restart in 0.007370s
2025-09-30T14:50:58.572899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2384c819-e79657d7-f8f41d94-d059eebe_0] Write session: Do CDS request
2025-09-30T14:50:58.572905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2384c819-e79657d7-f8f41d94-d059eebe_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:58.580153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:58.581774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2384c819-e79657d7-f8f41d94-d059eebe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:58.581765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:58.581853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:58.581881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 246
2025-09-30T14:50:58.581969Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:58.581979Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:58.581990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:58.582041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:58.582020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 246 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:58.582056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 246 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:58.582062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=246 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:58.582066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:58.582080Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894837725946299:3500]
2025-09-30T14:50:58.582437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 246 sessionId:  describe result for acl check
2025-09-30T14:50:58.582469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:58.582476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:58.582478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:58.582483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894837815670695:3943] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:58.582698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:58.582978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:58.583016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:58.583087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894837815670695:3943] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:58.583344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:58.583411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:58.583419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:58.583420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:58.583421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:58.583422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:58.583423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:58.583424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:58.583425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:58.583426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:58.583428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:58.583429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.583430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.583431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.583432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:58.583433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:58.583438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:58.583447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:58.583451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:58.583454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:58.583457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:58.583461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:58.583464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:58.583468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:58.583471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:58.583476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:58.583479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.583482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.583485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.583488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:58.583491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:58.583498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:58.583504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:58.583510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:58.583515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:58.583519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:58.583524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:58.583528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:58.583533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:58.583538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:58.583548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:58.583553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:58.583562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:58.583571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:58.583580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:58.583590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:58.583595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:58.583600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:58.583608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:58.583612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:58.583617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:58.583622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.583626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.583630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.583635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.583639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.583644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.583649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:58.583657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:58.583662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:58.583666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:58.583713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:58.585132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894837815670695:3943] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:58.588873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894837815670695:3943] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:58.588892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894837815670695:3943] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:58.588896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894837815670695:3943] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:58.588906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 246 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:58.589300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:58.590318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:58.590333Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:58.590338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:58.590342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:58.590347Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 245 [2:7555894837725946299:3500]
2025-09-30T14:50:58.590366Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:58.590383Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:58.590390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.590392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.590394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.590410Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:58.590417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:58.590424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:58.590486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.590494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.590495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.590500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:58.590503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:58.590570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:58.590577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.590589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.590600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.590631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:58.590655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894837725946294:3500]
2025-09-30T14:50:58.590661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894837725946294:3500]
2025-09-30T14:50:58.590663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894837725946294:3500]
2025-09-30T14:50:58.590675Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:58.590694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894837815670734:3943], now have 1 active actors on pipe
2025-09-30T14:50:58.590693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:58.590697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:58.590699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:58.590703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894837815670660:2454], now have 1 active actors on pipe
2025-09-30T14:50:58.590710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:58.590724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:58.590730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:58.590725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 245
2025-09-30T14:50:58.590726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 245
2025-09-30T14:50:58.590764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894837725946294:3500]
2025-09-30T14:50:58.590771Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:58.590776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:58.590785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:58.590793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:58.590840Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7d0724e-eb08b35a-9478870c-c9c567cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:58.590851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.590855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.590861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:58.590869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.590877Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:58.590901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:58.591125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:58.591131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:58.591144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:58.591277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 246 partition: 0 MaxSeqNo: 42 sessionId: src_id|e7d0724e-eb08b35a-9478870c-c9c567cd_0
2025-09-30T14:50:58.591672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2384c819-e79657d7-f8f41d94-d059eebe_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e7d0724e-eb08b35a-9478870c-c9c567cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:58.594405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d0724e-eb08b35a-9478870c-c9c567cd_0] Write session: try to update token
2025-09-30T14:50:58.594422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d0724e-eb08b35a-9478870c-c9c567cd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:58.602661Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:58.602679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:58.602681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:58.602685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:58.602693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894837725946294:3500]
2025-09-30T14:50:58.602700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894837725946294:3500]
2025-09-30T14:50:58.602704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894837725946294:3500]
2025-09-30T14:50:58.602742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:58.602748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.602750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:58.602755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:58.602761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:58.602765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:58.602887Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:58.608178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 246 sessionId: src_id|e7d0724e-eb08b35a-9478870c-c9c567cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:58.610887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:58.672831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894837815670742:3696]
2025-09-30T14:50:58.673104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 245, pipe: [1:7555894837815670742:3696]
2025-09-30T14:50:58.713428Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:58.713764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:58.713781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:58.713815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894837815670742:3696], now have 1 active actors on pipe
2025-09-30T14:50:58.713958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:58.713977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:58.714048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 246 reason: error at write: Disconnected sessionId: src_id|e7d0724e-eb08b35a-9478870c-c9c567cd_0
2025-09-30T14:50:58.714100Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:58.714260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 246 sessionId: src_id|e7d0724e-eb08b35a-9478870c-c9c567cd_0 is DEAD
2025-09-30T14:50:58.714422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d0724e-eb08b35a-9478870c-c9c567cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:58.714432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d0724e-eb08b35a-9478870c-c9c567cd_0] Write session will restart in 0.007080s
2025-09-30T14:50:58.714428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:58.714453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d0724e-eb08b35a-9478870c-c9c567cd_0] Write session: Do CDS request
2025-09-30T14:50:58.714459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d0724e-eb08b35a-9478870c-c9c567cd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:58.714468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894837815670742:3696]
2025-09-30T14:50:58.721765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:58.722785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d0724e-eb08b35a-9478870c-c9c567cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:58.722918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:58.722939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 247
2025-09-30T14:50:58.723050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 247 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:58.723084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 247 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:58.723096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=247 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:58.723100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:58.723410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:58.723514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 247 sessionId:  describe result for acl check
2025-09-30T14:50:58.723549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:58.723556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:58.723558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:58.723564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894837815670792:3953] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:58.723616Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:58.723628Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:58.723639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:58.723688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:58.723735Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894837725946399:3509]
2025-09-30T14:50:58.724119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894837815670792:3953] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:58.724387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:58.724739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:58.724789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:58.725125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:58.725201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:58.725209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:58.725210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:58.725212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:58.725213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:58.725214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:58.725215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:58.725216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:58.725217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:58.725218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:58.725219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.725220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.725221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.725222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:58.725224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:58.725230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:58.725239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:58.725243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:58.725247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:58.725251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:58.725255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:58.725260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:58.725264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:58.725267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:58.725272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:58.725275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.725279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.725282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.725286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:58.725290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:58.725299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:58.725308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:58.725314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:58.725321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:58.725326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:58.725331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:58.725335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:58.725340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:58.725344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:58.725350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:58.725357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:58.725362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:58.725373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:58.725378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:58.725383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:58.725388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:58.725398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:58.725403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:58.725407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:58.725417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:58.725422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.725428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.725435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.725445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.725451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.725460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.725464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:58.725469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:58.725479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:58.725483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:58.725527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:58.725786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894837815670792:3953] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:58.730946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894837815670792:3953] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:58.730967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894837815670792:3953] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:58.730971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894837815670792:3953] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:58.730980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 247 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:58.731386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:58.732391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:58.732411Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:58.732414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:58.732417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:58.732424Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 246 [2:7555894837725946399:3509]
2025-09-30T14:50:58.732439Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:58.732454Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:58.732458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.732461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.732463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.732478Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:58.732489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:58.732496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:58.732554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.732563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.732565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.732568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:58.732570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:58.732630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:58.732637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.732651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.732663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.732687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:58.732705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894837815670829:3953], now have 1 active actors on pipe
2025-09-30T14:50:58.732712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894837725946394:3509]
2025-09-30T14:50:58.732714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894837725946394:3509]
2025-09-30T14:50:58.732717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894837725946394:3509]
2025-09-30T14:50:58.732728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:58.732743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894837815670747:2454], now have 1 active actors on pipe
2025-09-30T14:50:58.732745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:58.732749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:58.732750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:58.732751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:58.732764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:58.732766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:58.732799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894837725946394:3509]
2025-09-30T14:50:58.732818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:58.732855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:58.732867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:58.732898Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56d4fee-50232184-e2a30022-d78fbb65_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:58.732912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.732916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.732918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:58.732927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.732935Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:58.732949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:58.732957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:58.733155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:58.733168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:58.733190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:58.732808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 246
2025-09-30T14:50:58.732846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 246
2025-09-30T14:50:58.733282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 247 partition: 0 MaxSeqNo: 42 sessionId: src_id|56d4fee-50232184-e2a30022-d78fbb65_0
2025-09-30T14:50:58.733691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d0724e-eb08b35a-9478870c-c9c567cd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|56d4fee-50232184-e2a30022-d78fbb65_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:58.736576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56d4fee-50232184-e2a30022-d78fbb65_0] Write session: try to update token
2025-09-30T14:50:58.736595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56d4fee-50232184-e2a30022-d78fbb65_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:58.745318Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:58.745336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:58.745339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:58.745341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:58.745349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894837725946394:3509]
2025-09-30T14:50:58.745355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894837725946394:3509]
2025-09-30T14:50:58.745358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894837725946394:3509]
2025-09-30T14:50:58.745397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:58.745398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:58.745402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:58.745403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.745406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:58.745406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:58.745551Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:58.752089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 247 sessionId: src_id|56d4fee-50232184-e2a30022-d78fbb65_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:58.754878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:58.814654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894837815670859:3696]
2025-09-30T14:50:58.814972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 246, pipe: [1:7555894837815670859:3696]
2025-09-30T14:50:58.855420Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:58.855790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:58.855820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:58.855846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894837815670859:3696], now have 1 active actors on pipe
2025-09-30T14:50:58.856071Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:58.856087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:58.856098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894837815670859:3696]
2025-09-30T14:50:58.856103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:58.856121Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:58.856158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 247 reason: error at write: Disconnected sessionId: src_id|56d4fee-50232184-e2a30022-d78fbb65_0
2025-09-30T14:50:58.856378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 247 sessionId: src_id|56d4fee-50232184-e2a30022-d78fbb65_0 is DEAD
2025-09-30T14:50:58.856521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56d4fee-50232184-e2a30022-d78fbb65_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:58.856532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56d4fee-50232184-e2a30022-d78fbb65_0] Write session will restart in 0.006899s
2025-09-30T14:50:58.856556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56d4fee-50232184-e2a30022-d78fbb65_0] Write session: Do CDS request
2025-09-30T14:50:58.856561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56d4fee-50232184-e2a30022-d78fbb65_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:58.864779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56d4fee-50232184-e2a30022-d78fbb65_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:58.864889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:58.864906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 248
2025-09-30T14:50:58.865020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 248 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:58.865051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 248 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:58.865061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=248 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:58.865065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:58.865452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 248 sessionId:  describe result for acl check
2025-09-30T14:50:58.865483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:58.865489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:58.865491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:58.865497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894837815670896:3959] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:58.866010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894837815670896:3959] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:58.869561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894837815670896:3959] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:58.869248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:58.869830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:58.870030Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:58.870042Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:58.870053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:58.870116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:58.870168Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894837725946498:3517]
2025-09-30T14:50:58.870870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:58.871186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:58.871236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:58.871588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:58.871657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:58.871664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:58.871665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:58.871666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:58.871668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:58.871669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:58.871670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:58.871671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:58.871673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:58.871674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:58.871675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.871676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.871678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.871679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:58.871681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:58.871687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:58.871697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:58.871702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:58.871706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:58.871711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:58.871716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:58.871721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:58.871724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:58.871728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:58.871733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:58.871736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.871741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.871746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.871750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:58.871754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:58.871761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:58.871770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:58.871776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:58.871782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:58.871787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:58.871793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:58.871798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:58.871803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:58.871809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:58.871814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:58.871820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:58.871826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:58.871831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:58.871842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:58.871848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:58.871854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:58.871865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:58.871871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:58.871881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:58.871887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:58.871897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.871903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.871912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.871917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.871922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.871928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.871934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:58.871939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:58.871943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:58.871949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:58.871998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:58.872294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894837815670896:3959] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:58.872312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894837815670896:3959] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:58.872316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894837815670896:3959] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:58.872326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 248 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:58.877576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:58.878858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:58.878874Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:58.878877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:58.878881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:58.878888Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 247 [2:7555894837725946498:3517]
2025-09-30T14:50:58.878904Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:58.878919Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:58.878923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.878926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.878928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.878945Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:58.878957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:58.878964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:58.879032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.879040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.879042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.879045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:58.879048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:58.879113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:58.879122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.879136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:58.879149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:58.879167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:58.879190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894837815670860:2454], now have 1 active actors on pipe
2025-09-30T14:50:58.879201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894837815670936:3959], now have 1 active actors on pipe
2025-09-30T14:50:58.879208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894837725946493:3517]
2025-09-30T14:50:58.879210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894837725946493:3517]
2025-09-30T14:50:58.879213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894837725946493:3517]
2025-09-30T14:50:58.879227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:58.879259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:58.879268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:58.879272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:58.879275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:58.879277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:58.879279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:58.879312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894837725946493:3517]
2025-09-30T14:50:58.879320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:58.879324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:58.879291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 247
2025-09-30T14:50:58.879292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 247
2025-09-30T14:50:58.879359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:58.879368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:58.879396Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1fb1441b-ae107221-b42a4624-fa15609f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:58.879407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.879411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.879413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:58.879424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.879433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:58.879447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:58.879644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:58.879654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:58.879667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:58.879742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 248 partition: 0 MaxSeqNo: 42 sessionId: src_id|1fb1441b-ae107221-b42a4624-fa15609f_0
2025-09-30T14:50:58.880142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56d4fee-50232184-e2a30022-d78fbb65_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1fb1441b-ae107221-b42a4624-fa15609f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:58.882901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fb1441b-ae107221-b42a4624-fa15609f_0] Write session: try to update token
2025-09-30T14:50:58.882920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fb1441b-ae107221-b42a4624-fa15609f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:58.891399Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:58.891418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:58.891421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:58.891423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:58.891432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894837725946493:3517]
2025-09-30T14:50:58.891437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894837725946493:3517]
2025-09-30T14:50:58.891440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894837725946493:3517]
2025-09-30T14:50:58.891479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:58.891486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:58.891489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:58.891495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:58.891501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:58.891505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:58.891630Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:58.897839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 248 sessionId: src_id|1fb1441b-ae107221-b42a4624-fa15609f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:58.900522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:58.956497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894837815670948:3696]
2025-09-30T14:50:58.956750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 247, pipe: [1:7555894837815670948:3696]
2025-09-30T14:50:59.001087Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:59.001636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:59.001652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:59.001691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894837815670948:3696], now have 1 active actors on pipe
2025-09-30T14:50:59.001900Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:59.002034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:59.002050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:59.002095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894837815670948:3696]
2025-09-30T14:50:59.002110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 248 reason: error at write: Disconnected sessionId: src_id|1fb1441b-ae107221-b42a4624-fa15609f_0
2025-09-30T14:50:59.002123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:59.002302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 248 sessionId: src_id|1fb1441b-ae107221-b42a4624-fa15609f_0 is DEAD
2025-09-30T14:50:59.002450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fb1441b-ae107221-b42a4624-fa15609f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:59.002459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fb1441b-ae107221-b42a4624-fa15609f_0] Write session will restart in 0.005607s
2025-09-30T14:50:59.002475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fb1441b-ae107221-b42a4624-fa15609f_0] Write session: Do CDS request
2025-09-30T14:50:59.002481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fb1441b-ae107221-b42a4624-fa15609f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:59.008758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fb1441b-ae107221-b42a4624-fa15609f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:59.008862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:59.008881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 249
2025-09-30T14:50:59.009023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 249 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:59.009061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 249 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:59.009068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=249 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:59.009072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:59.009428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 249 sessionId:  describe result for acl check
2025-09-30T14:50:59.009464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:59.009474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:59.009477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:59.009481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894842110638283:3965] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:59.009949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894842110638283:3965] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:59.010540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:59.012070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894842110638283:3965] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:59.012067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:59.012249Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:59.012258Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:59.012269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:59.012319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:59.012357Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894842020913872:3520]
2025-09-30T14:50:59.012980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:59.013272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:59.013314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:59.013642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:59.013696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:59.013703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:59.013704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:59.013705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:59.013706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:59.013707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:59.013707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:59.013708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:59.013709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:59.013710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:59.013712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.013715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.013716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.013717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:59.013718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:59.013723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:59.013732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:59.013736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:59.013739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:59.013742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:59.013746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:59.013750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:59.013753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:59.013757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:59.013761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:59.013766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.013770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.013774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.013778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:59.013781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:59.013786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:59.013791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:59.013795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:59.013798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:59.013802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:59.013805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:59.013807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:59.013811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:59.013814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:59.013820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:59.013824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:59.013829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:59.013834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:59.013840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:59.013843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:59.013847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:59.013850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:59.013854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:59.013864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:59.013870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:59.013874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.013879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.013883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.013889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.013893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.013898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.013903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:59.013913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:59.013919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:59.013922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:59.013963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:59.014491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894842110638283:3965] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:59.014515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894842110638283:3965] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:59.014518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894842110638283:3965] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:59.014525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 249 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:59.019474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:59.020491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:59.020507Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:59.020510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:59.020514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:59.020521Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 248 [2:7555894842020913872:3520]
2025-09-30T14:50:59.020541Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:59.020563Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:59.020565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.020567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.020568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.020583Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:59.020593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:59.020598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:59.020640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.020645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.020647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.020649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:59.020651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:59.020795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:59.020803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.020817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.020831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.020853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:59.020896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 248
2025-09-30T14:50:59.020909Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 248
2025-09-30T14:50:59.020872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894842110638325:3965], now have 1 active actors on pipe
2025-09-30T14:50:59.020880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894842110638248:2454], now have 1 active actors on pipe
2025-09-30T14:50:59.020885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894842020913867:3520]
2025-09-30T14:50:59.020886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894842020913867:3520]
2025-09-30T14:50:59.020887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894842020913867:3520]
2025-09-30T14:50:59.020896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:59.020906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:59.020915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:59.020918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:59.020920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:59.020924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:59.020926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:59.020946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894842020913867:3520]
2025-09-30T14:50:59.020948Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:59.020951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:59.020963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:59.020966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:59.021002Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|243755e8-a1785604-5e6aa73-e0e6fa41_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:59.021010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.021012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.021013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:59.021020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.021028Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:59.021044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:59.021217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:59.021233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:59.021257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:59.021434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 249 partition: 0 MaxSeqNo: 42 sessionId: src_id|243755e8-a1785604-5e6aa73-e0e6fa41_0
2025-09-30T14:50:59.021750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fb1441b-ae107221-b42a4624-fa15609f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|243755e8-a1785604-5e6aa73-e0e6fa41_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:59.024791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|243755e8-a1785604-5e6aa73-e0e6fa41_0] Write session: try to update token
2025-09-30T14:50:59.024811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|243755e8-a1785604-5e6aa73-e0e6fa41_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:59.033497Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:59.033517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:59.033519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:59.033524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:59.033533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894842020913867:3520]
2025-09-30T14:50:59.033537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894842020913867:3520]
2025-09-30T14:50:59.033540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894842020913867:3520]
2025-09-30T14:50:59.033579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:59.033586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.033589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:59.033592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:59.033598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:59.033602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:59.033726Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:59.045002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 249 sessionId: src_id|243755e8-a1785604-5e6aa73-e0e6fa41_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:59.047577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:59.102446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894842110638335:3696]
2025-09-30T14:50:59.102854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 248, pipe: [1:7555894842110638335:3696]
2025-09-30T14:50:59.149856Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:59.150490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:59.150506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:59.150523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894842110638335:3696], now have 1 active actors on pipe
2025-09-30T14:50:59.150821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:59.150886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:59.150893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:59.150899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894842110638335:3696]
2025-09-30T14:50:59.150980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 249 reason: error at write: Disconnected sessionId: src_id|243755e8-a1785604-5e6aa73-e0e6fa41_0
2025-09-30T14:50:59.151215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 249 sessionId: src_id|243755e8-a1785604-5e6aa73-e0e6fa41_0 is DEAD
2025-09-30T14:50:59.151375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|243755e8-a1785604-5e6aa73-e0e6fa41_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:59.151385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|243755e8-a1785604-5e6aa73-e0e6fa41_0] Write session will restart in 0.008966s
2025-09-30T14:50:59.151404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|243755e8-a1785604-5e6aa73-e0e6fa41_0] Write session: Do CDS request
2025-09-30T14:50:59.151410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|243755e8-a1785604-5e6aa73-e0e6fa41_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:59.151778Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:59.158368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:59.160023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:59.160194Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:59.160206Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:59.160216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:59.160266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:59.160327Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894842020913949:3522]
2025-09-30T14:50:59.160920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:59.161203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:59.161249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:59.161495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:59.161546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:59.161551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:59.161551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:59.161552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:59.161553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:59.161553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:59.161554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:59.161555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:59.161555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:59.161556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:59.161557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.161557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.161558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.161559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:59.161559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:59.161564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:59.161580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:59.161584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:59.161589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:59.161593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:59.161597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:59.161601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:59.161605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:59.161607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:59.161610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:59.161613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.161615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.161618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.161620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:59.161622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:59.161628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:59.161632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:59.161636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:59.161639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:59.161642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:59.161645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:59.161648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:59.161650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:59.161653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:59.161656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:59.161658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:59.161661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:59.161663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:59.161666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:59.161668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:59.161671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:59.161674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:59.161678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:59.161680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:59.161684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:59.161688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.161694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.161699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.161704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.161708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.161715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.161719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:59.161724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:59.161728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:59.161732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:59.161754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|243755e8-a1785604-5e6aa73-e0e6fa41_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:59.161773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:59.161884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:59.161899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 250
2025-09-30T14:50:59.162029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 250 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:59.162064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 250 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:59.162068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=250 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:59.162071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:59.162480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 250 sessionId:  describe result for acl check
2025-09-30T14:50:59.162521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:59.162530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:59.162531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:59.162535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894842110638381:3969] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:59.163018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894842110638381:3969] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:59.164985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894842110638381:3969] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:59.167042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:59.167573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894842110638381:3969] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:59.167585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894842110638381:3969] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:59.167588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894842110638381:3969] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:59.167595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 250 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:59.168825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:59.168846Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:59.168849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:59.168853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:59.168858Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 249 [2:7555894842020913949:3522]
2025-09-30T14:50:59.168874Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:59.168890Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:59.168899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.168902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.168904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.168919Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:59.168929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:59.168935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:59.168991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.168998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.169000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.169004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:59.169006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:59.169078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:59.169085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.169099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.169114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.169133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:59.169154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894842020913944:3522]
2025-09-30T14:50:59.169157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894842020913944:3522]
2025-09-30T14:50:59.169159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894842020913944:3522]
2025-09-30T14:50:59.169166Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:59.169173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:59.169175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:59.169177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:59.169183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894842110638414:3969], now have 1 active actors on pipe
2025-09-30T14:50:59.169187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894842110638337:2454], now have 1 active actors on pipe
2025-09-30T14:50:59.169195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:59.169209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:59.169217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:59.169245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894842020913944:3522]
2025-09-30T14:50:59.169235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 249
2025-09-30T14:50:59.169259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:59.169237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 249
2025-09-30T14:50:59.169291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:59.169399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:59.169414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:59.169444Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ccb6ad8-5587bb59-e2c615af-b51bc308_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:59.169458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.169560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.169567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:59.169578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.169593Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:59.169607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:59.169777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:59.169790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:59.169812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:59.169902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 250 partition: 0 MaxSeqNo: 42 sessionId: src_id|8ccb6ad8-5587bb59-e2c615af-b51bc308_0
2025-09-30T14:50:59.170272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|243755e8-a1785604-5e6aa73-e0e6fa41_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8ccb6ad8-5587bb59-e2c615af-b51bc308_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:59.177684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ccb6ad8-5587bb59-e2c615af-b51bc308_0] Write session: try to update token
2025-09-30T14:50:59.177719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ccb6ad8-5587bb59-e2c615af-b51bc308_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:59.180606Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:50:59.180631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:59.180641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894842020913944:3522]
2025-09-30T14:50:59.180682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:59.180693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:50:59.181068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:50:59.181393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:59.181726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:59.182049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:50:59.182350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:50:59.182399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:50:59.191716Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:59.191735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:59.191738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:59.191740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:59.191751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894842020913944:3522]
2025-09-30T14:50:59.191756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894842020913944:3522]
2025-09-30T14:50:59.191766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894842020913944:3522]
2025-09-30T14:50:59.191806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:59.191814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:59.191817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.191820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:59.191821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:59.191825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:59.191955Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:59.199951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 250 sessionId: src_id|8ccb6ad8-5587bb59-e2c615af-b51bc308_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:59.202589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:59.250903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894842110638422:3696]
2025-09-30T14:50:59.251174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 249, pipe: [1:7555894842110638422:3696]
2025-09-30T14:50:59.302273Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:59.302526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:59.302538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:59.302555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894842110638422:3696], now have 1 active actors on pipe
2025-09-30T14:50:59.302807Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:59.302834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:59.302852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:59.302853Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:59.302901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894842110638422:3696]
2025-09-30T14:50:59.302915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 250 reason: error at write: Disconnected sessionId: src_id|8ccb6ad8-5587bb59-e2c615af-b51bc308_0
2025-09-30T14:50:59.303099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 250 sessionId: src_id|8ccb6ad8-5587bb59-e2c615af-b51bc308_0 is DEAD
2025-09-30T14:50:59.303235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ccb6ad8-5587bb59-e2c615af-b51bc308_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:59.303261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ccb6ad8-5587bb59-e2c615af-b51bc308_0] Write session will restart in 0.006395s
2025-09-30T14:50:59.303291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ccb6ad8-5587bb59-e2c615af-b51bc308_0] Write session: Do CDS request
2025-09-30T14:50:59.303299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ccb6ad8-5587bb59-e2c615af-b51bc308_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:59.310558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:59.310782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ccb6ad8-5587bb59-e2c615af-b51bc308_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:59.310877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:59.310892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 251
2025-09-30T14:50:59.311021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 251 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:59.311045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 251 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:59.311051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=251 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:59.311055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:59.311431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 251 sessionId:  describe result for acl check
2025-09-30T14:50:59.311458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:59.311462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:59.311464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:59.311468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894842110638462:3973] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:59.311917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894842110638462:3973] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:59.312200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:59.312362Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:59.312373Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:59.312383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:59.312425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:59.312470Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894842020914029:3524]
2025-09-30T14:50:59.313068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:59.313407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:59.313460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:59.313789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:59.313864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:59.313870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:59.313871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:59.313872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:59.313873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:59.313875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:59.313876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:59.313877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:59.313878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:59.313879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:59.313880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.313881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.313883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.313884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:59.313885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:59.313890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:59.313900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:59.313904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:59.313908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:59.313912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:59.313916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:59.313920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:59.313924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:59.313928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:59.313934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:59.313938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.313942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.313946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.313949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:59.313953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:59.313960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:59.313968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:59.313973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:59.313977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:59.313961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894842110638462:3973] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:59.313981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:59.313986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:59.313990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:59.313996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:59.314001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:59.314006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:59.314011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:59.314016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:59.314021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:59.314025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:59.314029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:59.314034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:59.314038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:59.314043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:59.314047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:59.314052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:59.314059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.314071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.314076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.314083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.314087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.314097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.314102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:59.314107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:59.314111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:59.314115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:59.314152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:59.319234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894842110638462:3973] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:59.319261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894842110638462:3973] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:59.319265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894842110638462:3973] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:59.319274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 251 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:59.319595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:59.320852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:59.320866Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:59.320869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:59.320873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:59.320879Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 250 [2:7555894842020914029:3524]
2025-09-30T14:50:59.320896Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:59.320915Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:59.320918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.320921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.320925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.320941Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:59.320948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:59.320959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:59.321017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.321024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.321026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.321029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:59.321033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:59.321092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:59.321102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.321114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.321126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.321144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:59.321164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894842110638502:3973], now have 1 active actors on pipe
2025-09-30T14:50:59.321172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894842110638423:2454], now have 1 active actors on pipe
2025-09-30T14:50:59.321179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894842020914023:3524]
2025-09-30T14:50:59.321193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894842020914023:3524]
2025-09-30T14:50:59.321199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894842020914023:3524]
2025-09-30T14:50:59.321210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:59.321199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 250
2025-09-30T14:50:59.321222Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 250
2025-09-30T14:50:59.321223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:59.321226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:59.321230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:59.321232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:59.321242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:59.321244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:59.321282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:59.321292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:59.321311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894842020914023:3524]
2025-09-30T14:50:59.321323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:59.321341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:59.321354Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f94c5478-d5beaaa0-a3b3a59c-450280ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:59.321359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.321363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.321365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:59.321373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.321387Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:59.321410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:59.321579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:59.321589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:59.321602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:59.321678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 251 partition: 0 MaxSeqNo: 42 sessionId: src_id|f94c5478-d5beaaa0-a3b3a59c-450280ea_0
2025-09-30T14:50:59.322067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ccb6ad8-5587bb59-e2c615af-b51bc308_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f94c5478-d5beaaa0-a3b3a59c-450280ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:59.324802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f94c5478-d5beaaa0-a3b3a59c-450280ea_0] Write session: try to update token
2025-09-30T14:50:59.324819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f94c5478-d5beaaa0-a3b3a59c-450280ea_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:59.333241Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:59.333257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:59.333259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:59.333262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:59.333271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894842020914023:3524]
2025-09-30T14:50:59.333276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894842020914023:3524]
2025-09-30T14:50:59.333280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894842020914023:3524]
2025-09-30T14:50:59.333322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:59.333329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.333332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:59.333332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:59.333339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:59.333343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:59.333464Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:59.340522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 251 sessionId: src_id|f94c5478-d5beaaa0-a3b3a59c-450280ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:59.343229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:59.402956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894842110638509:3696]
2025-09-30T14:50:59.403304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 250, pipe: [1:7555894842110638509:3696]
2025-09-30T14:50:59.445348Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:59.445740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:59.445761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:59.445786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894842110638509:3696], now have 1 active actors on pipe
2025-09-30T14:50:59.446023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:59.446042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:59.446051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894842110638509:3696]
2025-09-30T14:50:59.446080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:59.446068Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:59.446103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 251 reason: error at write: Disconnected sessionId: src_id|f94c5478-d5beaaa0-a3b3a59c-450280ea_0
2025-09-30T14:50:59.446336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 251 sessionId: src_id|f94c5478-d5beaaa0-a3b3a59c-450280ea_0 is DEAD
2025-09-30T14:50:59.446516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f94c5478-d5beaaa0-a3b3a59c-450280ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:59.446525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f94c5478-d5beaaa0-a3b3a59c-450280ea_0] Write session will restart in 0.008254s
2025-09-30T14:50:59.446549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f94c5478-d5beaaa0-a3b3a59c-450280ea_0] Write session: Do CDS request
2025-09-30T14:50:59.446554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f94c5478-d5beaaa0-a3b3a59c-450280ea_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:59.454234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:59.455668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f94c5478-d5beaaa0-a3b3a59c-450280ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:59.455816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:59.455833Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 252
2025-09-30T14:50:59.455970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 252 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:59.456005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 252 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:59.456010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=252 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:59.456014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:59.456088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:59.456280Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:59.456291Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:59.456301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:59.456352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:59.456400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 252 sessionId:  describe result for acl check
2025-09-30T14:50:59.456405Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894842020914111:3526]
2025-09-30T14:50:59.456434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:59.456440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:59.456442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:59.456447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894842110638553:3978] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:59.456967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894842110638553:3978] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:59.457063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:59.457336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:59.457381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:59.457706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:59.457771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:59.457777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:59.457779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:59.457780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:59.457781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:59.457782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:59.457783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:59.457784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:59.457786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:59.457787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:59.457788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.457789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.457790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.457792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:59.457793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:59.457799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:59.457810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:59.457815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:59.457819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:59.457824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:59.457828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:59.457833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:59.457838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:59.457842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:59.457847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:59.457850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.457855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.457859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.457863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:59.457868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:59.457876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:59.457885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:59.457897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:59.457907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:59.457912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:59.457918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:59.457922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:59.457927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:59.457941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:59.457951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:59.457956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:59.457964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:59.457969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:59.457978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:59.457983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:59.457992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:59.457997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:59.458006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:59.458010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:59.458019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:59.458024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.458033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.458039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.458048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.458053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.458063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.458068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:59.458078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:59.458083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:59.458092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:59.458141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:59.458985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894842110638553:3978] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:59.462919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894842110638553:3978] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:59.462936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894842110638553:3978] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:59.462939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894842110638553:3978] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:59.462947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 252 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:59.463339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:59.464312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:59.464333Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:59.464341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:59.464347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:59.464353Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 251 [2:7555894842020914111:3526]
2025-09-30T14:50:59.464371Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:59.464386Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:59.464389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.464392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.464394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.464410Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:59.464423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:59.464431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:59.464491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.464500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.464502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.464505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:59.464507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:59.464570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:59.464578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.464602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.464620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.464642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:59.464666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894842110638512:2454], now have 1 active actors on pipe
2025-09-30T14:50:59.464678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894842110638592:3978], now have 1 active actors on pipe
2025-09-30T14:50:59.464670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 251
2025-09-30T14:50:59.464684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894842020914105:3526]
2025-09-30T14:50:59.464680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 251
2025-09-30T14:50:59.464687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894842020914105:3526]
2025-09-30T14:50:59.464689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894842020914105:3526]
2025-09-30T14:50:59.464698Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:59.464709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:59.464721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:59.464725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:59.464725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:59.464727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:59.464728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:59.464748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:59.464752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:59.464786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894842020914105:3526]
2025-09-30T14:50:59.464797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:59.464801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:59.464816Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b30eb54-c59ee33e-ed2348d8-67105ebd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:59.464827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.464830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.464836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:59.464845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.464857Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:59.464920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:59.465073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:59.465090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:59.465114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:59.465214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 252 partition: 0 MaxSeqNo: 42 sessionId: src_id|b30eb54-c59ee33e-ed2348d8-67105ebd_0
2025-09-30T14:50:59.465603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f94c5478-d5beaaa0-a3b3a59c-450280ea_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b30eb54-c59ee33e-ed2348d8-67105ebd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:59.468335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b30eb54-c59ee33e-ed2348d8-67105ebd_0] Write session: try to update token
2025-09-30T14:50:59.468352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b30eb54-c59ee33e-ed2348d8-67105ebd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:59.477070Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:59.477097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:59.477099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:59.477101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:59.477110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894842020914105:3526]
2025-09-30T14:50:59.477114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894842020914105:3526]
2025-09-30T14:50:59.477118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894842020914105:3526]
2025-09-30T14:50:59.477157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:59.477166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.477169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:59.477174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:59.477190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:59.477194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:59.477311Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:59.484394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 252 sessionId: src_id|b30eb54-c59ee33e-ed2348d8-67105ebd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:59.487167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:59.546301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894842110638600:3696]
2025-09-30T14:50:59.546633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 251, pipe: [1:7555894842110638600:3696]
2025-09-30T14:50:59.591652Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:59.591970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:59.591984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:59.592002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894842110638600:3696], now have 1 active actors on pipe
2025-09-30T14:50:59.592260Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:59.592729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b30eb54-c59ee33e-ed2348d8-67105ebd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:59.592739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b30eb54-c59ee33e-ed2348d8-67105ebd_0] Write session will restart in 0.008582s
2025-09-30T14:50:59.592762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b30eb54-c59ee33e-ed2348d8-67105ebd_0] Write session: Do CDS request
2025-09-30T14:50:59.592767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b30eb54-c59ee33e-ed2348d8-67105ebd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:59.592243Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:59.592282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894842110638600:3696]
2025-09-30T14:50:59.592305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:59.592308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:59.592367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 252 reason: error at write: Disconnected sessionId: src_id|b30eb54-c59ee33e-ed2348d8-67105ebd_0
2025-09-30T14:50:59.592605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 252 sessionId: src_id|b30eb54-c59ee33e-ed2348d8-67105ebd_0 is DEAD
2025-09-30T14:50:59.601669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:59.602808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b30eb54-c59ee33e-ed2348d8-67105ebd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:59.602978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:59.602993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 253
2025-09-30T14:50:59.603107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 253 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:59.603152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 253 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:59.603161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=253 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:59.603165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:59.603236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:59.603438Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:59.603448Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:59.603459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:59.603516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:59.603558Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894842020914192:3529]
2025-09-30T14:50:59.603639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 253 sessionId:  describe result for acl check
2025-09-30T14:50:59.603673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:59.603678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:59.603680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:59.603685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894842110638643:3982] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:59.604181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:59.604226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894842110638643:3982] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:59.604432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:59.604473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:59.604782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:59.604841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:59.604849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:59.604850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:59.604851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:59.604852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:59.604854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:59.604855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:59.604856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:59.604857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:59.604858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:59.604859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.604861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.604862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.604863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:59.604864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:59.604869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:59.604879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:59.604884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:59.604888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:59.604892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:59.604896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:59.604900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:59.604905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:59.604909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:59.604913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:59.604918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.604922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.604926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.604931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:59.604935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:59.604942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:59.604949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:59.604955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:59.604961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:59.604965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:59.604970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:59.604975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:59.604980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:59.604984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:59.604989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:59.604992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:59.604996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:59.605000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:59.605006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:59.605010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:59.605014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:59.605019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:59.605024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:59.605030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:59.605044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:59.605048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.605054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.605057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.605062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.605066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.605070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.605075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:59.605081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:59.605086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:59.605092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:59.605135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:59.605876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894842110638643:3982] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:59.610026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894842110638643:3982] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:59.610039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894842110638643:3982] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:59.610042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894842110638643:3982] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:59.610049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 253 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:59.610416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:59.611464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:59.611477Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:59.611479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:59.611482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:59.611489Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 252 [2:7555894842020914192:3529]
2025-09-30T14:50:59.611505Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:59.611521Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:59.611529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.611532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.611534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.611549Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:59.611559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:59.611567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:59.611632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.611639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.611641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.611644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:59.611647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:59.611707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:59.611715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.611727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.611742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.611763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:59.611787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894842110638601:2454], now have 1 active actors on pipe
2025-09-30T14:50:59.611790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894842110638682:3982], now have 1 active actors on pipe
2025-09-30T14:50:59.611796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894842020914187:3529]
2025-09-30T14:50:59.611799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894842020914187:3529]
2025-09-30T14:50:59.611801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894842020914187:3529]
2025-09-30T14:50:59.611802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 252
2025-09-30T14:50:59.611815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:59.611826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 252
2025-09-30T14:50:59.611830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:59.611833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:59.611837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:59.611839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:59.611844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:59.611848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:59.611882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894842020914187:3529]
2025-09-30T14:50:59.611894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:59.611907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:59.611908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:59.611916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:59.611959Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51673155-80835025-a39b199b-fd9b52d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:59.611972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.611980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.611983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:59.611992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.612005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:59.612022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:59.612164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:59.612172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:59.612186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:59.612263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 253 partition: 0 MaxSeqNo: 42 sessionId: src_id|51673155-80835025-a39b199b-fd9b52d5_0
2025-09-30T14:50:59.612630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b30eb54-c59ee33e-ed2348d8-67105ebd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|51673155-80835025-a39b199b-fd9b52d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:59.615303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51673155-80835025-a39b199b-fd9b52d5_0] Write session: try to update token
2025-09-30T14:50:59.615320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51673155-80835025-a39b199b-fd9b52d5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:59.624395Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:59.624420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:59.624423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:59.624428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:59.624438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894842020914187:3529]
2025-09-30T14:50:59.624443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894842020914187:3529]
2025-09-30T14:50:59.624451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894842020914187:3529]
2025-09-30T14:50:59.624496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:59.624500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:59.624511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.624514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:59.624516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:59.624522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:59.624667Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:59.630369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 253 sessionId: src_id|51673155-80835025-a39b199b-fd9b52d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:59.633034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:59.692224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894842110638690:3696]
2025-09-30T14:50:59.692522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 252, pipe: [1:7555894842110638690:3696]
2025-09-30T14:50:59.738195Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:59.738443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:59.738454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:59.738485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894842110638690:3696], now have 1 active actors on pipe
2025-09-30T14:50:59.738626Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:59.738708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894842110638690:3696]
2025-09-30T14:50:59.738729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:59.738733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:59.738735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:59.738790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 253 reason: error at write: Disconnected sessionId: src_id|51673155-80835025-a39b199b-fd9b52d5_0
2025-09-30T14:50:59.739015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 253 sessionId: src_id|51673155-80835025-a39b199b-fd9b52d5_0 is DEAD
2025-09-30T14:50:59.739121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51673155-80835025-a39b199b-fd9b52d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:59.739128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51673155-80835025-a39b199b-fd9b52d5_0] Write session will restart in 0.007430s
2025-09-30T14:50:59.739166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51673155-80835025-a39b199b-fd9b52d5_0] Write session: Do CDS request
2025-09-30T14:50:59.739175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51673155-80835025-a39b199b-fd9b52d5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:59.747781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51673155-80835025-a39b199b-fd9b52d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:59.747890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:59.747907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 254
2025-09-30T14:50:59.748036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 254 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:59.748068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 254 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:59.748078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=254 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:59.748083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:59.748515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 254 sessionId:  describe result for acl check
2025-09-30T14:50:59.748546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:59.748553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:59.748555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:59.748560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894842110638731:3986] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:59.749100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894842110638731:3986] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:59.750782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894842110638731:3986] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:59.751689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:59.753392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:59.753591Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:59.753600Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:59.753610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:59.753665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:59.753670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894842110638731:3986] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:59.753700Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894842020914287:3532]
2025-09-30T14:50:59.753684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894842110638731:3986] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:59.753686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894842110638731:3986] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:59.753692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 254 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:59.754144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:59.754379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:59.754421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:59.754722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:59.754782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:59.754788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:59.754789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:59.754790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:59.754791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:59.754793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:59.754794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:59.754795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:59.754796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:59.754797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:59.754799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.754800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.754801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.754802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:59.754805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:59.754811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:59.754822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:59.754826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:59.754830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:59.754834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:59.754838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:59.754842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:59.754846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:59.754850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:59.754854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:59.754858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.754862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.754866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.754870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:59.754874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:59.754880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:59.754886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:59.754890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:59.754894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:59.754896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:59.754900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:59.754902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:59.754905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:59.754908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:59.754911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:59.754914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:59.754919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:59.754924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:59.754934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:59.754940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:59.754946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:59.754951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:59.754961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:59.754967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:59.754970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:59.754973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.754980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.754982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.754985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.754991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.754994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.754997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:59.755000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:59.755003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:59.755009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:59.755035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:59.760604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:59.761509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:59.761525Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:59.761527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:59.761531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:59.761538Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 253 [2:7555894842020914287:3532]
2025-09-30T14:50:59.761553Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:59.761567Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:59.761570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.761573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.761575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.761589Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:59.761595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:59.761602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:59.761661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.761669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.761672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.761675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:59.761678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:59.761744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:59.761750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.761762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.761783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.761801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:59.761819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894842110638769:3986], now have 1 active actors on pipe
2025-09-30T14:50:59.761827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894842110638691:2454], now have 1 active actors on pipe
2025-09-30T14:50:59.761833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894842020914282:3532]
2025-09-30T14:50:59.761835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894842020914282:3532]
2025-09-30T14:50:59.761837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894842020914282:3532]
2025-09-30T14:50:59.761849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:59.761864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:59.761868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:59.761883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:59.761885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:59.761888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:59.761890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:59.761880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 253
2025-09-30T14:50:59.761883Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 253
2025-09-30T14:50:59.761921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894842020914282:3532]
2025-09-30T14:50:59.761929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:59.761932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:59.761943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:59.761951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:59.762074Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96206408-ab9123b2-51590fe3-2cd2c2c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:59.762086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.762089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.762093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:59.762105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.762119Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:59.762147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:59.762328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:59.762342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:59.762363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:59.762482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 254 partition: 0 MaxSeqNo: 42 sessionId: src_id|96206408-ab9123b2-51590fe3-2cd2c2c1_0
2025-09-30T14:50:59.762912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51673155-80835025-a39b199b-fd9b52d5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|96206408-ab9123b2-51590fe3-2cd2c2c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:59.765659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96206408-ab9123b2-51590fe3-2cd2c2c1_0] Write session: try to update token
2025-09-30T14:50:59.765676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96206408-ab9123b2-51590fe3-2cd2c2c1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:59.774062Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:59.774080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:59.774082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:59.774084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:59.774093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894842020914282:3532]
2025-09-30T14:50:59.774098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894842020914282:3532]
2025-09-30T14:50:59.774102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894842020914282:3532]
2025-09-30T14:50:59.774141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:59.774148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.774146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:59.774153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:59.774157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:59.774157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:59.774294Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:59.780072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 254 sessionId: src_id|96206408-ab9123b2-51590fe3-2cd2c2c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:59.782543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:59.838653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894842110638815:3696]
2025-09-30T14:50:59.838919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 253, pipe: [1:7555894842110638815:3696]
2025-09-30T14:50:59.885935Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:50:59.886227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:59.886242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:59.886284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894842110638815:3696], now have 1 active actors on pipe
2025-09-30T14:50:59.886561Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:50:59.886548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:50:59.886563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:50:59.886574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:50:59.886619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894842110638815:3696]
2025-09-30T14:50:59.886664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 254 reason: error at write: Disconnected sessionId: src_id|96206408-ab9123b2-51590fe3-2cd2c2c1_0
2025-09-30T14:50:59.886878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 254 sessionId: src_id|96206408-ab9123b2-51590fe3-2cd2c2c1_0 is DEAD
2025-09-30T14:50:59.886999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96206408-ab9123b2-51590fe3-2cd2c2c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:50:59.887008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96206408-ab9123b2-51590fe3-2cd2c2c1_0] Write session will restart in 0.005457s
2025-09-30T14:50:59.887041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96206408-ab9123b2-51590fe3-2cd2c2c1_0] Write session: Do CDS request
2025-09-30T14:50:59.887047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96206408-ab9123b2-51590fe3-2cd2c2c1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:50:59.893796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96206408-ab9123b2-51590fe3-2cd2c2c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:59.893889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:59.893905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 255
2025-09-30T14:50:59.894048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 255 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:59.894079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 255 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:50:59.894089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=255 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:59.894093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:59.894501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 255 sessionId:  describe result for acl check
2025-09-30T14:50:59.894545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:59.894550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:59.894569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:59.894581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894842110638858:3998] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:59.895122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894842110638858:3998] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:59.895368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:59.896997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:59.897181Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:59.897193Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:50:59.897204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:59.897252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:59.897293Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894842020914404:3546]
2025-09-30T14:50:59.897440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894842110638858:3998] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:59.897934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:50:59.898231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:50:59.898280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:50:59.898628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:50:59.898687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:59.898694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:59.898695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:59.898696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:59.898697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:59.898698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:59.898699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:59.898700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:59.898701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:59.898702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:59.898703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.898705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.898706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.898707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:59.898708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:59.898713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:59.898724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:59.898727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:59.898731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:59.898735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:59.898741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:59.898745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:59.898749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:59.898753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:59.898758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:59.898762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.898766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.898769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.898773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:59.898777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:59.898785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:59.898792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:50:59.898798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:59.898804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:50:59.898809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:59.898814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:50:59.898819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:59.898824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:50:59.898842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:59.898853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:50:59.898857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:59.898863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:50:59.898873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:59.898879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:50:59.898888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:59.898893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:50:59.898902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:59.898908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:50:59.898912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:59.898922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:50:59.898927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.898933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.898942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.898948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.898956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.898961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.898969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:59.898974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:50:59.898979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:59.898984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:50:59.899034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:50:59.904129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894842110638858:3998] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:59.904147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894842110638858:3998] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:50:59.904150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894842110638858:3998] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:59.904159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 255 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:59.904428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:50:59.905534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:50:59.905555Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:50:59.905558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:59.905562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:59.905568Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 254 [2:7555894842020914404:3546]
2025-09-30T14:50:59.905584Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:50:59.905600Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:50:59.905604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.905608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.905611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.905625Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:50:59.905632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:59.905639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:59.905701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.905711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.905713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.905716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:50:59.905719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:50:59.905788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:50:59.905797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.905810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:50:59.905827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:50:59.905851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:50:59.905873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894842110638816:2454], now have 1 active actors on pipe
2025-09-30T14:50:59.905885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894842110638899:3998], now have 1 active actors on pipe
2025-09-30T14:50:59.905892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894842020914399:3546]
2025-09-30T14:50:59.905894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894842020914399:3546]
2025-09-30T14:50:59.905896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894842020914399:3546]
2025-09-30T14:50:59.905908Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:50:59.905922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:50:59.905922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:50:59.905925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:50:59.905916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 254
2025-09-30T14:50:59.905927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:50:59.905936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 254
2025-09-30T14:50:59.905942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:50:59.905945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:59.905988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:59.905999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:59.906016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894842020914399:3546]
2025-09-30T14:50:59.906032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:50:59.906057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:50:59.906066Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36740091-e2fd2c67-5c470494-b49b7544_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:59.906073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.906076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.906079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:59.906088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.906096Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:59.906127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:59.906289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:59.906297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:59.906312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:59.906388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 255 partition: 0 MaxSeqNo: 42 sessionId: src_id|36740091-e2fd2c67-5c470494-b49b7544_0
2025-09-30T14:50:59.906801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96206408-ab9123b2-51590fe3-2cd2c2c1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|36740091-e2fd2c67-5c470494-b49b7544_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:59.909570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36740091-e2fd2c67-5c470494-b49b7544_0] Write session: try to update token
2025-09-30T14:50:59.909588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36740091-e2fd2c67-5c470494-b49b7544_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:50:59.917965Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:50:59.917986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:50:59.917989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:50:59.917991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:50:59.918000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894842020914399:3546]
2025-09-30T14:50:59.918006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894842020914399:3546]
2025-09-30T14:50:59.918013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894842020914399:3546]
2025-09-30T14:50:59.918054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:50:59.918057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:50:59.918061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:50:59.918063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:50:59.918065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:50:59.918071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:50:59.918295Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:50:59.924732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 255 sessionId: src_id|36740091-e2fd2c67-5c470494-b49b7544_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:59.927690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:59.986625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894842110638914:3696]
2025-09-30T14:50:59.986822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 254, pipe: [1:7555894842110638914:3696]
2025-09-30T14:51:00.027991Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:00.028322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:00.028338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:00.028359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894842110638914:3696], now have 1 active actors on pipe
2025-09-30T14:51:00.028536Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:00.028587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894842110638914:3696]
2025-09-30T14:51:00.028607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:00.028618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:00.028686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 255 reason: status is not ok: tablet will be restarted right now sessionId: src_id|36740091-e2fd2c67-5c470494-b49b7544_0
2025-09-30T14:51:00.028875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 255 sessionId: src_id|36740091-e2fd2c67-5c470494-b49b7544_0 is DEAD
2025-09-30T14:51:00.029032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36740091-e2fd2c67-5c470494-b49b7544_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:00.029039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36740091-e2fd2c67-5c470494-b49b7544_0] Write session will restart in 0.008398s
2025-09-30T14:51:00.029056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36740091-e2fd2c67-5c470494-b49b7544_0] Write session: Do CDS request
2025-09-30T14:51:00.029060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36740091-e2fd2c67-5c470494-b49b7544_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:00.038851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36740091-e2fd2c67-5c470494-b49b7544_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:00.038924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:00.038942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 256
2025-09-30T14:51:00.039097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 256 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:00.039159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 256 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:00.039168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=256 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:00.039173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:00.039916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 256 sessionId:  describe result for acl check
2025-09-30T14:51:00.039972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:00.039981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:00.039983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:00.039988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894846405606257:4004] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:00.040572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894846405606257:4004] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:00.040714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:00.042204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:00.042455Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:00.042471Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:00.042482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:00.042556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:00.042621Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894846315881787:3549]
2025-09-30T14:51:00.042976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894846405606257:4004] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:00.043408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:00.043703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:00.043755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:00.044164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:00.044312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:00.044326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:00.044327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:00.044329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:00.044330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:00.044331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:00.044332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:00.044334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:00.044335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:00.044336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:00.044337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.044338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.044340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.044341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:00.044342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:00.044351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:00.044362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:00.044366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:00.044370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:00.044375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:00.044379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:00.044386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:00.044391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:00.044396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:00.044416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:00.044419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.044432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.044445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.044457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:00.044469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:00.044485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:00.044505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:00.044526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:00.044543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:00.044551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:00.044568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:00.044582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:00.044591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:00.044599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:00.044604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:00.044626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:00.044642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:00.044648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:00.044654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:00.044660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:00.044665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:00.044674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:00.044685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:00.044693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:00.044700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:00.044705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.044714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.044723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.044733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.044737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.044741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.044745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:00.044750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:00.044760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:00.044768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:00.044809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:00.045528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894846405606257:4004] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:00.045542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894846405606257:4004] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:00.045545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894846405606257:4004] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:00.045552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 256 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:00.050614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:00.052134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:00.052152Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:00.052155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:00.052159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:00.052165Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 255 [2:7555894846315881787:3549]
2025-09-30T14:51:00.052181Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:00.052197Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:00.052200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.052204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.052211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.052226Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:00.052237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:00.052243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:00.052305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.052313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.052315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.052319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:00.052321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:00.052385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:00.052394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.052405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.052416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.052436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:00.052460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894846405606211:2454], now have 1 active actors on pipe
2025-09-30T14:51:00.052470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894846405606298:4004], now have 1 active actors on pipe
2025-09-30T14:51:00.052476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894846315881782:3549]
2025-09-30T14:51:00.052482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894846315881782:3549]
2025-09-30T14:51:00.052485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894846315881782:3549]
2025-09-30T14:51:00.052498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:00.052519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:00.052523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:00.052526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:00.052528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:00.052538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:00.052541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:00.052529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 255
2025-09-30T14:51:00.052542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 255
2025-09-30T14:51:00.052616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894846315881782:3549]
2025-09-30T14:51:00.052631Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:00.052640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:00.052653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:00.052658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:00.052707Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5c664c8-404d472a-e7b981d0-fb9bcef8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:00.052725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.052737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.052744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:00.052752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.052762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:00.052789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:00.052922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:00.052931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:00.052946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:00.053024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 256 partition: 0 MaxSeqNo: 42 sessionId: src_id|a5c664c8-404d472a-e7b981d0-fb9bcef8_0
2025-09-30T14:51:00.053418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36740091-e2fd2c67-5c470494-b49b7544_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a5c664c8-404d472a-e7b981d0-fb9bcef8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:00.058695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5c664c8-404d472a-e7b981d0-fb9bcef8_0] Write session: try to update token
2025-09-30T14:51:00.058718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5c664c8-404d472a-e7b981d0-fb9bcef8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:00.065251Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:00.065274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:00.065276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:00.065278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:00.065288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894846315881782:3549]
2025-09-30T14:51:00.065293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894846315881782:3549]
2025-09-30T14:51:00.065299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894846315881782:3549]
2025-09-30T14:51:00.065340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:00.065345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:00.065355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.065358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:00.065362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:00.065363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:00.065739Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:00.077751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 256 sessionId: src_id|a5c664c8-404d472a-e7b981d0-fb9bcef8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:00.080767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:00.128960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894846405606305:3696]
2025-09-30T14:51:00.129194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 255, pipe: [1:7555894846405606305:3696]
2025-09-30T14:51:00.173743Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:00.174066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:00.174080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:00.174102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894846405606305:3696], now have 1 active actors on pipe
2025-09-30T14:51:00.174333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894846405606305:3696]
2025-09-30T14:51:00.174375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:00.174378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:00.174419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:00.174443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 256 reason: error at write: Disconnected sessionId: src_id|a5c664c8-404d472a-e7b981d0-fb9bcef8_0
2025-09-30T14:51:00.174659Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:00.174683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 256 sessionId: src_id|a5c664c8-404d472a-e7b981d0-fb9bcef8_0 is DEAD
2025-09-30T14:51:00.174877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5c664c8-404d472a-e7b981d0-fb9bcef8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:00.174889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5c664c8-404d472a-e7b981d0-fb9bcef8_0] Write session will restart in 0.008768s
2025-09-30T14:51:00.174915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5c664c8-404d472a-e7b981d0-fb9bcef8_0] Write session: Do CDS request
2025-09-30T14:51:00.174922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5c664c8-404d472a-e7b981d0-fb9bcef8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:00.183944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:00.184796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5c664c8-404d472a-e7b981d0-fb9bcef8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:00.184928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:00.184945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 257
2025-09-30T14:51:00.185074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 257 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:00.185115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 257 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:00.185126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=257 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:00.185130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:00.185582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 257 sessionId:  describe result for acl check
2025-09-30T14:51:00.185616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:00.185619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:00.185620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:00.185627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894846405606353:4008] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:00.185726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:00.185954Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:00.185964Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:00.185975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:00.186036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:00.186075Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894846315881871:3551]
2025-09-30T14:51:00.186222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894846405606353:4008] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:00.186741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:00.187043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:00.187109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:00.187502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:00.187561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:00.187567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:00.187569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:00.187570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:00.187571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:00.187572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:00.187573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:00.187574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:00.187577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:00.187578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:00.187580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.187581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.187582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.187583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:00.187584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:00.187591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:00.187601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:00.187605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:00.187609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:00.187614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:00.187618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:00.187622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:00.187626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:00.187630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:00.187635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:00.187639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.187643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.187647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.187651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:00.187655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:00.187661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:00.187670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:00.187676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:00.187681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:00.187686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:00.187691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:00.187695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:00.187701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:00.187706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:00.187712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:00.187715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:00.187721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:00.187725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:00.187731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:00.187735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:00.187740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:00.187745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:00.187750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:00.187759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:00.187765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:00.187769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.187774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.187783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.187788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.187798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.187803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.187808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:00.187813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:00.187818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:00.187823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:00.187863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:00.188060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894846405606353:4008] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:00.192955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894846405606353:4008] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:00.192978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894846405606353:4008] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:00.192982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894846405606353:4008] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:00.192994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 257 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:00.193309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:00.194217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:00.194237Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:00.194240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:00.194244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:00.194251Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 256 [2:7555894846315881871:3551]
2025-09-30T14:51:00.194267Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:00.194280Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:00.194283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.194286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.194291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.194305Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:00.194312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:00.194317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:00.194372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.194378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.194380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.194382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:00.194384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:00.194452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:00.194459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.194473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.194496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.194513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:00.194531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894846405606307:2454], now have 1 active actors on pipe
2025-09-30T14:51:00.194539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894846405606392:4008], now have 1 active actors on pipe
2025-09-30T14:51:00.194545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894846315881866:3551]
2025-09-30T14:51:00.194548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894846315881866:3551]
2025-09-30T14:51:00.194550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894846315881866:3551]
2025-09-30T14:51:00.194561Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:00.194572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:00.194632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 256
2025-09-30T14:51:00.194641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 256
2025-09-30T14:51:00.194586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:00.194588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:00.194593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:00.194593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:00.194595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:00.194653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894846315881866:3551]
2025-09-30T14:51:00.194656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:00.194660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:00.194674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:00.194679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:00.194723Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39ae5981-95d10104-989c90cf-7bc17a3c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:00.194735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.194738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.194740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:00.194750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.194759Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:00.194775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:00.194962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:00.194972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:00.194986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:00.195077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 257 partition: 0 MaxSeqNo: 42 sessionId: src_id|39ae5981-95d10104-989c90cf-7bc17a3c_0
2025-09-30T14:51:00.195521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5c664c8-404d472a-e7b981d0-fb9bcef8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|39ae5981-95d10104-989c90cf-7bc17a3c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:00.198326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39ae5981-95d10104-989c90cf-7bc17a3c_0] Write session: try to update token
2025-09-30T14:51:00.198346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39ae5981-95d10104-989c90cf-7bc17a3c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:00.207873Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:00.207896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:00.207899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:00.207901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:00.207910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894846315881866:3551]
2025-09-30T14:51:00.207914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894846315881866:3551]
2025-09-30T14:51:00.207918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894846315881866:3551]
2025-09-30T14:51:00.207962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:00.207968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:00.207972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.207975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:00.207987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:00.207991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:00.208174Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:00.215047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 257 sessionId: src_id|39ae5981-95d10104-989c90cf-7bc17a3c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:00.218027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:00.274390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894846405606399:3696]
2025-09-30T14:51:00.274704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 256, pipe: [1:7555894846405606399:3696]
2025-09-30T14:51:00.318838Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:00.319102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:00.319114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:00.319148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894846405606399:3696], now have 1 active actors on pipe
2025-09-30T14:51:00.319336Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:00.319403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894846405606399:3696]
2025-09-30T14:51:00.319422Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:00.319439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:00.319641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 257 reason: status is not ok: tablet will be restarted right now sessionId: src_id|39ae5981-95d10104-989c90cf-7bc17a3c_0
2025-09-30T14:51:00.319848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 257 sessionId: src_id|39ae5981-95d10104-989c90cf-7bc17a3c_0 is DEAD
2025-09-30T14:51:00.320029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ae5981-95d10104-989c90cf-7bc17a3c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:00.320040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ae5981-95d10104-989c90cf-7bc17a3c_0] Write session will restart in 0.008701s
2025-09-30T14:51:00.320063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ae5981-95d10104-989c90cf-7bc17a3c_0] Write session: Do CDS request
2025-09-30T14:51:00.320069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ae5981-95d10104-989c90cf-7bc17a3c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:00.328362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:00.329829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39ae5981-95d10104-989c90cf-7bc17a3c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:00.329875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:00.329943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:00.329960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 258
2025-09-30T14:51:00.330057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 258 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:00.330087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 258 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:00.330097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=258 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:00.330101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:00.330087Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:00.330098Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:00.330109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:00.330161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:00.330202Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894846315881956:3553]
2025-09-30T14:51:00.330543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 258 sessionId:  describe result for acl check
2025-09-30T14:51:00.330581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:00.330588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:00.330590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:00.330596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894846405606448:4012] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:00.330888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:00.331151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894846405606448:4012] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:00.331213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:00.331275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:00.331616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:00.331678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:00.331686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:00.331687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:00.331688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:00.331689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:00.331692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:00.331693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:00.331694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:00.331695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:00.331696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:00.331698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.331699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.331700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.331702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:00.331703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:00.331709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:00.331719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:00.331724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:00.331728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:00.331733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:00.331738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:00.331741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:00.331746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:00.331750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:00.331754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:00.331758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.331761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.331765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.331768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:00.331772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:00.331778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:00.331787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:00.331793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:00.331799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:00.331804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:00.331809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:00.331813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:00.331819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:00.331830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:00.331840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:00.331845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:00.331855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:00.331865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:00.331875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:00.331886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:00.331891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:00.331896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:00.331901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:00.331906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:00.331912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:00.331917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.331923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.331928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.331934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.331939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.331944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.331948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:00.331954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:00.331958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:00.331963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:00.332012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:00.332882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894846405606448:4012] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:00.338145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894846405606448:4012] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:00.338206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894846405606448:4012] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:00.338222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894846405606448:4012] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:00.338230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 258 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:00.338659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:00.339677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:00.339697Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:00.339700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:00.339703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:00.339710Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 257 [2:7555894846315881956:3553]
2025-09-30T14:51:00.339727Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:00.339747Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:00.339755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.339759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.339761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.339780Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:00.339792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:00.339799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:00.339861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.339871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.339872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.339876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:00.339878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:00.339951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:00.339960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.339991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.340007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.340029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:00.340053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894846405606401:2454], now have 1 active actors on pipe
2025-09-30T14:51:00.340062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894846405606486:4012], now have 1 active actors on pipe
2025-09-30T14:51:00.340069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894846315881951:3553]
2025-09-30T14:51:00.340076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894846315881951:3553]
2025-09-30T14:51:00.340079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894846315881951:3553]
2025-09-30T14:51:00.340056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 257
2025-09-30T14:51:00.340056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 257
2025-09-30T14:51:00.340087Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:00.340101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:00.340103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:00.340105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:00.340107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:00.340117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:00.340121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:00.340146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:00.340152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:00.340192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894846315881951:3553]
2025-09-30T14:51:00.340201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:00.340220Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc18fab1-dd9b96ca-623bbb2f-b4b096ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:00.340221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:00.340228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.340231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.340233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:00.340244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.340253Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:00.340292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:00.340435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:00.340439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:00.340454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:00.340529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 258 partition: 0 MaxSeqNo: 42 sessionId: src_id|fc18fab1-dd9b96ca-623bbb2f-b4b096ff_0
2025-09-30T14:51:00.340942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ae5981-95d10104-989c90cf-7bc17a3c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fc18fab1-dd9b96ca-623bbb2f-b4b096ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:00.343914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc18fab1-dd9b96ca-623bbb2f-b4b096ff_0] Write session: try to update token
2025-09-30T14:51:00.343936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc18fab1-dd9b96ca-623bbb2f-b4b096ff_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:00.359423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 258 sessionId: src_id|fc18fab1-dd9b96ca-623bbb2f-b4b096ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:00.361266Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:00.361292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:00.361325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894846315881951:3553]
2025-09-30T14:51:00.361375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:00.361385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:00.361567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:00.361754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:00.361906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:00.362054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:00.362287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:00.362330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:00.362373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:00.362475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:00.362488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:00.362520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:00.362591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:00.368456Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:00.368476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:00.368478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:00.368484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:00.368494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894846315881951:3553]
2025-09-30T14:51:00.368497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894846315881951:3553]
2025-09-30T14:51:00.368503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894846315881951:3553]
2025-09-30T14:51:00.368539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:00.368546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.368548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:00.368555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:00.368572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:00.368577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:00.368680Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:00.419765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894846405606494:3696]
2025-09-30T14:51:00.420067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 257, pipe: [1:7555894846405606494:3696]
2025-09-30T14:51:00.484020Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:00.490940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:00.490971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:00.491140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:00.491200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:00.491279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:00.491339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:00.491385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:00.491395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:00.491460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:00.491520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:00.491584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:00.491649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:00.491689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:00.491696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:00.491758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:00.491817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:00.491878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:00.491964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:00.492007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:00.492013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:00.492076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:00.492156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:00.492218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:00.492281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:00.492322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:00.492330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:00.492413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:00.492501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:00.492563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:00.492626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:00.492682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:00.492688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:00.492754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:00.492818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:00.492911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:00.493004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:00.493049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:00.493055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:00.493150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:00.493266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:00.494914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:00.494922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894846405606494:3696]
2025-09-30T14:51:00.494932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:00.494942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:00.494970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 258 reason: error at write: Disconnected sessionId: src_id|fc18fab1-dd9b96ca-623bbb2f-b4b096ff_0
2025-09-30T14:51:00.495157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 258 sessionId: src_id|fc18fab1-dd9b96ca-623bbb2f-b4b096ff_0 is DEAD
2025-09-30T14:51:00.493344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:00.493450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:00.493499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:00.493502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:00.493642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:00.493749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:00.493816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:00.493883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:00.493936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:00.493938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:00.495319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc18fab1-dd9b96ca-623bbb2f-b4b096ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:00.495347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc18fab1-dd9b96ca-623bbb2f-b4b096ff_0] Write session will restart in 0.007218s
2025-09-30T14:51:00.494001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:00.494054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:00.494109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:00.494165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:00.494281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:00.495371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc18fab1-dd9b96ca-623bbb2f-b4b096ff_0] Write session: Do CDS request
2025-09-30T14:51:00.494284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:00.495392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc18fab1-dd9b96ca-623bbb2f-b4b096ff_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:00.494345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:00.494400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:00.494456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:00.494514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:00.494647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:00.494649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:00.494707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894846405606494:3696], now have 1 active actors on pipe
2025-09-30T14:51:00.495712Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:00.503812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc18fab1-dd9b96ca-623bbb2f-b4b096ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:00.503939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:00.503959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 259
2025-09-30T14:51:00.504192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 259 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:00.504237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 259 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:00.504249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=259 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:00.504253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:00.504714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 259 sessionId:  describe result for acl check
2025-09-30T14:51:00.504750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:00.504756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:00.504762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:00.504769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894846405606546:4017] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:00.505109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:00.505261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894846405606546:4017] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:00.506829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:00.507026Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:00.507037Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:00.507047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:00.507108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:00.507149Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894846315882047:3556]
2025-09-30T14:51:00.507690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894846405606546:4017] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:00.507901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:00.508202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:00.508245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:00.508591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:00.508663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:00.508670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:00.508671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:00.508672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:00.508673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:00.508674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:00.508675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:00.508676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:00.508677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:00.508678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:00.508679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.508680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.508681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.508682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:00.508683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:00.508688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:00.508697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:00.508701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:00.508705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:00.508708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:00.508712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:00.508723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:00.508726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:00.508730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:00.508733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:00.508737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.508740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.508744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.508747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:00.508750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:00.508758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:00.508766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:00.508771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:00.508779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:00.508783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:00.508788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:00.508792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:00.508797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:00.508802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:00.508807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:00.508811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:00.508816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:00.508820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:00.508832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:00.508837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:00.508841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:00.508846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:00.508851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:00.508861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:00.508867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:00.508876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.508883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.508888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.508893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.508897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.508902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.508910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:00.508915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:00.508919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:00.508929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:00.508969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:00.515165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894846405606546:4017] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:00.515194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894846405606546:4017] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:00.515199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894846405606546:4017] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:00.515212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 259 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:00.515392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:00.516460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:00.516483Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:00.516485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:00.516490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:00.516497Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 258 [2:7555894846315882047:3556]
2025-09-30T14:51:00.516514Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:00.516533Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:00.516542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.516545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.516548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.516565Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:00.516575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:00.516582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:00.516652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.516660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.516661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.516665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:00.516667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:00.516736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:00.516744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.516759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.516769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.516788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:00.516811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894846405606586:4017], now have 1 active actors on pipe
2025-09-30T14:51:00.516819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894846405606498:2454], now have 1 active actors on pipe
2025-09-30T14:51:00.516826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894846315882041:3556]
2025-09-30T14:51:00.516827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894846315882041:3556]
2025-09-30T14:51:00.516830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894846315882041:3556]
2025-09-30T14:51:00.516842Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:00.516857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:00.516860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:00.516868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:00.516871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:00.516874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:00.516876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:00.516913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894846315882041:3556]
2025-09-30T14:51:00.516921Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:00.516929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:00.516906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 258
2025-09-30T14:51:00.516919Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 258
2025-09-30T14:51:00.516958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:00.516974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:00.517004Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|73ddf28a-75d33f0f-ba2fbc33-6cd77e5b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:00.517012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.517016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.517018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:00.517029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.517037Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:00.517057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:00.517233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:00.517242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:00.517256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:00.517344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 259 partition: 0 MaxSeqNo: 42 sessionId: src_id|73ddf28a-75d33f0f-ba2fbc33-6cd77e5b_0
2025-09-30T14:51:00.517777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc18fab1-dd9b96ca-623bbb2f-b4b096ff_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|73ddf28a-75d33f0f-ba2fbc33-6cd77e5b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:00.520880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73ddf28a-75d33f0f-ba2fbc33-6cd77e5b_0] Write session: try to update token
2025-09-30T14:51:00.520901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73ddf28a-75d33f0f-ba2fbc33-6cd77e5b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:00.531873Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:00.531898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:00.531901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:00.531903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:00.531916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894846315882041:3556]
2025-09-30T14:51:00.531920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894846315882041:3556]
2025-09-30T14:51:00.531924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894846315882041:3556]
2025-09-30T14:51:00.531970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:00.531977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.531980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:00.531986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:00.531993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:00.531998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:00.532150Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:00.536645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 259 sessionId: src_id|73ddf28a-75d33f0f-ba2fbc33-6cd77e5b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:00.539572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:00.594879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894846405606593:3696]
2025-09-30T14:51:00.595143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 258, pipe: [1:7555894846405606593:3696]
2025-09-30T14:51:00.649328Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:00.649634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:00.649651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:00.649687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894846405606593:3696], now have 1 active actors on pipe
2025-09-30T14:51:00.649868Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:00.649942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:00.650004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894846405606593:3696]
2025-09-30T14:51:00.650126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:00.650209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 259 reason: status is not ok: tablet will be restarted right now sessionId: src_id|73ddf28a-75d33f0f-ba2fbc33-6cd77e5b_0
2025-09-30T14:51:00.650392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 259 sessionId: src_id|73ddf28a-75d33f0f-ba2fbc33-6cd77e5b_0 is DEAD
2025-09-30T14:51:00.650551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73ddf28a-75d33f0f-ba2fbc33-6cd77e5b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:00.650559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73ddf28a-75d33f0f-ba2fbc33-6cd77e5b_0] Write session will restart in 0.006532s
2025-09-30T14:51:00.650584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73ddf28a-75d33f0f-ba2fbc33-6cd77e5b_0] Write session: Do CDS request
2025-09-30T14:51:00.650589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73ddf28a-75d33f0f-ba2fbc33-6cd77e5b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:00.658035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:00.658764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73ddf28a-75d33f0f-ba2fbc33-6cd77e5b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:00.658863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:00.658881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 260
2025-09-30T14:51:00.659021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 260 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:00.659064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 260 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:00.659074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=260 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:00.659078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:00.659518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 260 sessionId:  describe result for acl check
2025-09-30T14:51:00.659553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:00.659559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:00.659562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:00.659568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894846405606644:4021] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:00.659774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:00.659974Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:00.659982Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:00.659992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:00.660007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894846405606644:4021] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:00.660048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:00.660090Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894846315882133:3558]
2025-09-30T14:51:00.660757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:00.661126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:00.661190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:00.661538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:00.661618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:00.661625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:00.661627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:00.661628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:00.661630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:00.661631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:00.661632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:00.661633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:00.661634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:00.661635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:00.661637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.661639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.661640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.661641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:00.661642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:00.661648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:00.661658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:00.661664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:00.661668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:00.661672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:00.661676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:00.661681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:00.661684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:00.661688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:00.661693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:00.661697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.661701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.661705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.661709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:00.661713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:00.661719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:00.661727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:00.661733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:00.661737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:00.661743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:00.661748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:00.661751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:00.661756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:00.661760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:00.661765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:00.661768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:00.661773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:00.661777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:00.661790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:00.661794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:00.661803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:00.661809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:00.661814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:00.661819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:00.661824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:00.661834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.661838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.661842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.661847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.661852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.661857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.661862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:00.661868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:00.661873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:00.661878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:00.661934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:00.662317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894846405606644:4021] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:00.667559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894846405606644:4021] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:00.667580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894846405606644:4021] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:00.667584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894846405606644:4021] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:00.667594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 260 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:00.667870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:00.668926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:00.668944Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:00.668946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:00.668950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:00.668957Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 259 [2:7555894846315882133:3558]
2025-09-30T14:51:00.668974Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:00.668991Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:00.668998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.669001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.669005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.669022Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:00.669032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:00.669044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:00.669106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.669112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.669114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.669117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:00.669121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:00.669183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:00.669190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.669202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.669219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.669241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:00.669266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894846405606687:4021], now have 1 active actors on pipe
2025-09-30T14:51:00.669279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894846405606595:2454], now have 1 active actors on pipe
2025-09-30T14:51:00.669286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894846315882128:3558]
2025-09-30T14:51:00.669288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894846315882128:3558]
2025-09-30T14:51:00.669290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894846315882128:3558]
2025-09-30T14:51:00.669301Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:00.669315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:00.669328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:00.669331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:00.669335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:00.669339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:00.669341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:00.669364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894846315882128:3558]
2025-09-30T14:51:00.669372Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:00.669359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 259
2025-09-30T14:51:00.669388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:00.669442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 259
2025-09-30T14:51:00.669488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:00.669498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:00.669520Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b3a0b60-962185a8-b0ae25ae-8a4838d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:00.669534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.669537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.669540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:00.669551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.669563Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:00.669582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:00.669758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:00.669778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:00.669803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:00.669899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 260 partition: 0 MaxSeqNo: 42 sessionId: src_id|1b3a0b60-962185a8-b0ae25ae-8a4838d4_0
2025-09-30T14:51:00.670305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73ddf28a-75d33f0f-ba2fbc33-6cd77e5b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1b3a0b60-962185a8-b0ae25ae-8a4838d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:00.673322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b3a0b60-962185a8-b0ae25ae-8a4838d4_0] Write session: try to update token
2025-09-30T14:51:00.673343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b3a0b60-962185a8-b0ae25ae-8a4838d4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:00.681575Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:00.681594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:00.681604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894846315882128:3558]
2025-09-30T14:51:00.681645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:00.681648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:00.681834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:00.681984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:00.682138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:00.682294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:00.682509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:00.682551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:00.688821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 260 sessionId: src_id|1b3a0b60-962185a8-b0ae25ae-8a4838d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:00.691701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:00.692416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:00.692442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:00.692461Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:00.692467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:00.692469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:00.692471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:00.692482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894846315882128:3558]
2025-09-30T14:51:00.692490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894846315882128:3558]
2025-09-30T14:51:00.692495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894846315882128:3558]
2025-09-30T14:51:00.692546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:00.692547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:00.692554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:00.692556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.692558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:00.692559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:00.692782Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:00.750018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894846405606694:3696]
2025-09-30T14:51:00.750307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 259, pipe: [1:7555894846405606694:3696]
2025-09-30T14:51:00.809550Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:00.809827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:00.809863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894846405606694:3696], now have 1 active actors on pipe
2025-09-30T14:51:00.809976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:00.810079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:00.810086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:00.810089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:00.810137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894846405606694:3696]
2025-09-30T14:51:00.810184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 260 reason: error at write: Disconnected sessionId: src_id|1b3a0b60-962185a8-b0ae25ae-8a4838d4_0
2025-09-30T14:51:00.810385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 260 sessionId: src_id|1b3a0b60-962185a8-b0ae25ae-8a4838d4_0 is DEAD
2025-09-30T14:51:00.810538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b3a0b60-962185a8-b0ae25ae-8a4838d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:00.810549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b3a0b60-962185a8-b0ae25ae-8a4838d4_0] Write session will restart in 0.007110s
2025-09-30T14:51:00.810573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b3a0b60-962185a8-b0ae25ae-8a4838d4_0] Write session: Do CDS request
2025-09-30T14:51:00.810579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b3a0b60-962185a8-b0ae25ae-8a4838d4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:00.818789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:00.818891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b3a0b60-962185a8-b0ae25ae-8a4838d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:00.818996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:00.819013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 261
2025-09-30T14:51:00.819142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 261 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:00.819181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 261 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:00.819188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=261 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:00.819192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:00.819497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 261 sessionId:  describe result for acl check
2025-09-30T14:51:00.819524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:00.819529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:00.819530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:00.819535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894846405606771:4032] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:00.819933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894846405606771:4032] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:00.820520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:00.820755Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:00.820772Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:00.820784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:00.820848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:00.820902Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894846315882247:3561]
2025-09-30T14:51:00.821614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:00.821972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:00.822028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:00.822042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894846405606771:4032] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:00.822409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:00.822485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:00.822492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:00.822493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:00.822494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:00.822495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:00.822496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:00.822497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:00.822498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:00.822501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:00.822502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:00.822504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.822504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.822506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.822506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:00.822507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:00.822513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:00.822523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:00.822527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:00.822531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:00.822535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:00.822539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:00.822543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:00.822547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:00.822551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:00.822557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:00.822561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.822565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.822568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.822573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:00.822577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:00.822585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:00.822593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:00.822611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:00.822617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:00.822622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:00.822627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:00.822632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:00.822636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:00.822641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:00.822649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:00.822654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:00.822680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:00.822690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:00.822696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:00.822704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:00.822710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:00.822718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:00.822722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:00.822727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:00.822731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:00.822741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.822747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.822757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.822763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.822775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.822786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.822792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:00.822802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:00.822808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:00.822819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:00.822864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:00.828229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894846405606771:4032] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:00.828246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894846405606771:4032] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:00.828249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894846405606771:4032] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:00.828256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 261 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:00.828565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:00.829554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:00.829581Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:00.829584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:00.829588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:00.829595Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 260 [2:7555894846315882247:3561]
2025-09-30T14:51:00.829613Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:00.829630Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:00.829632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.829635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.829640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.829657Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:00.829674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:00.829682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:00.829743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.829752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.829755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.829758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:00.829760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:00.829835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:00.829844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.829858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.829871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.829894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:00.829920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894846405606810:4032], now have 1 active actors on pipe
2025-09-30T14:51:00.829929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894846405606707:2454], now have 1 active actors on pipe
2025-09-30T14:51:00.829936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894846315882242:3561]
2025-09-30T14:51:00.829938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894846315882242:3561]
2025-09-30T14:51:00.829940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894846315882242:3561]
2025-09-30T14:51:00.829952Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:00.829972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:00.829976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:00.829980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:00.829982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:00.829994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:00.829998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:00.829987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 260
2025-09-30T14:51:00.830025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 260
2025-09-30T14:51:00.830032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894846315882242:3561]
2025-09-30T14:51:00.830041Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:00.830056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:00.830059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:00.830064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:00.830189Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ab23ad7-344f9a7c-36a990d0-b2fb86a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:00.830203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.830207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.830209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:00.830218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.830228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:00.830252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:00.830373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:00.830381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:00.830395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:00.830473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 261 partition: 0 MaxSeqNo: 42 sessionId: src_id|3ab23ad7-344f9a7c-36a990d0-b2fb86a8_0
2025-09-30T14:51:00.830926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b3a0b60-962185a8-b0ae25ae-8a4838d4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3ab23ad7-344f9a7c-36a990d0-b2fb86a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:00.834159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ab23ad7-344f9a7c-36a990d0-b2fb86a8_0] Write session: try to update token
2025-09-30T14:51:00.834179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ab23ad7-344f9a7c-36a990d0-b2fb86a8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:00.842667Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:00.842685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:00.842687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:00.842689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:00.842698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894846315882242:3561]
2025-09-30T14:51:00.842702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894846315882242:3561]
2025-09-30T14:51:00.842706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894846315882242:3561]
2025-09-30T14:51:00.842747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:00.842759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.842761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:00.842771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:00.842787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:00.842791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:00.842909Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:00.852772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 261 sessionId: src_id|3ab23ad7-344f9a7c-36a990d0-b2fb86a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:00.855890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:00.910275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894846405606828:3696]
2025-09-30T14:51:00.910559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 260, pipe: [1:7555894846405606828:3696]
2025-09-30T14:51:00.952554Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:00.952878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:00.952890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:00.952908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894846405606828:3696], now have 1 active actors on pipe
2025-09-30T14:51:00.953074Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:00.953146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:00.953146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894846405606828:3696]
2025-09-30T14:51:00.953162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:00.953165Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:00.953226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 261 reason: error at write: Disconnected sessionId: src_id|3ab23ad7-344f9a7c-36a990d0-b2fb86a8_0
2025-09-30T14:51:00.953465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 261 sessionId: src_id|3ab23ad7-344f9a7c-36a990d0-b2fb86a8_0 is DEAD
2025-09-30T14:51:00.953616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ab23ad7-344f9a7c-36a990d0-b2fb86a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:00.953626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ab23ad7-344f9a7c-36a990d0-b2fb86a8_0] Write session will restart in 0.007376s
2025-09-30T14:51:00.953649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ab23ad7-344f9a7c-36a990d0-b2fb86a8_0] Write session: Do CDS request
2025-09-30T14:51:00.953659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ab23ad7-344f9a7c-36a990d0-b2fb86a8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:00.961296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:00.961893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ab23ad7-344f9a7c-36a990d0-b2fb86a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:00.961949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:00.961967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 262
2025-09-30T14:51:00.962149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 262 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:00.962181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 262 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:00.962192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=262 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:00.962197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:00.962681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 262 sessionId:  describe result for acl check
2025-09-30T14:51:00.962718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:00.962741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:00.962743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:00.962748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894846405606891:4039] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:00.962997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:00.963204Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:00.963215Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:00.963225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:00.963302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:00.963316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894846405606891:4039] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:00.963344Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894846315882360:3575]
2025-09-30T14:51:00.963984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:00.964272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:00.964320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:00.964658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:00.964722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:00.964729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:00.964730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:00.964731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:00.964732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:00.964733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:00.964735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:00.964736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:00.964738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:00.964739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:00.964740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.964741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.964743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.964744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:00.964745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:00.964751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:00.964761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:00.964765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:00.964772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:00.964776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:00.964780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:00.964785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:00.964789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:00.964793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:00.964798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:00.964802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.964807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.964811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.964816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:00.964820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:00.964828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:00.964841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:00.964851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:00.964857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:00.964868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:00.964873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:00.964883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:00.964888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:00.964894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:00.964899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:00.964904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:00.964915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:00.964925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:00.964936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:00.964945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:00.964951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:00.964961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:00.964973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:00.964978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:00.964985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:00.964989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.964995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.964999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.965005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.965015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.965021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.965030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:00.965035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:00.965044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:00.965050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:00.965109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:00.965365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894846405606891:4039] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:00.970134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894846405606891:4039] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:00.970154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894846405606891:4039] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:00.970157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894846405606891:4039] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:00.970166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 262 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:00.970799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:00.972213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:00.972239Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:00.972242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:00.972246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:00.972253Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 261 [2:7555894846315882360:3575]
2025-09-30T14:51:00.972271Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:00.972290Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:00.972294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.972297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.972299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.972318Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:00.972333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:00.972343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:00.972567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.972584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.972587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.972590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:00.972592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:00.972680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:00.972690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.972705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:00.972724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:00.972747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:00.972775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894846405606926:4039], now have 1 active actors on pipe
2025-09-30T14:51:00.972784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894846405606833:2454], now have 1 active actors on pipe
2025-09-30T14:51:00.972773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 261
2025-09-30T14:51:00.972792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894846315882355:3575]
2025-09-30T14:51:00.972775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 261
2025-09-30T14:51:00.972800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894846315882355:3575]
2025-09-30T14:51:00.972802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894846315882355:3575]
2025-09-30T14:51:00.972814Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:00.972835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:00.972838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:00.972844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:00.972846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:00.972854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:00.972857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:00.972921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:00.972932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:00.972951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894846315882355:3575]
2025-09-30T14:51:00.972968Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:00.972985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:00.973010Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c91a00de-ab22c16b-3be0c654-ca15f961_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:00.973025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.973032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.973040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:00.973054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.973072Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:00.973106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:00.973263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:00.973278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:00.973299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:00.973369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 262 partition: 0 MaxSeqNo: 42 sessionId: src_id|c91a00de-ab22c16b-3be0c654-ca15f961_0
2025-09-30T14:51:00.973787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ab23ad7-344f9a7c-36a990d0-b2fb86a8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c91a00de-ab22c16b-3be0c654-ca15f961_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:00.977038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c91a00de-ab22c16b-3be0c654-ca15f961_0] Write session: try to update token
2025-09-30T14:51:00.977071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c91a00de-ab22c16b-3be0c654-ca15f961_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:00.985112Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:00.985141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:00.985144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:00.985145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:00.985154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894846315882355:3575]
2025-09-30T14:51:00.985158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894846315882355:3575]
2025-09-30T14:51:00.985161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894846315882355:3575]
2025-09-30T14:51:00.985200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:00.985209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:00.985212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:00.985215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:00.985216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:00.985221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:00.985351Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:00.992045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 262 sessionId: src_id|c91a00de-ab22c16b-3be0c654-ca15f961_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:00.994862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.053115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894850700574237:3696]
2025-09-30T14:51:01.053409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 261, pipe: [1:7555894850700574237:3696]
2025-09-30T14:51:01.095042Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:01.095325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.095337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.095373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894850700574237:3696], now have 1 active actors on pipe
2025-09-30T14:51:01.095654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:01.095706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:01.095716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894850700574237:3696]
2025-09-30T14:51:01.095783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 262 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c91a00de-ab22c16b-3be0c654-ca15f961_0
2025-09-30T14:51:01.096008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 262 sessionId: src_id|c91a00de-ab22c16b-3be0c654-ca15f961_0 is DEAD
2025-09-30T14:51:01.096172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c91a00de-ab22c16b-3be0c654-ca15f961_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:01.096185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c91a00de-ab22c16b-3be0c654-ca15f961_0] Write session will restart in 0.005571s
2025-09-30T14:51:01.095595Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:01.096209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c91a00de-ab22c16b-3be0c654-ca15f961_0] Write session: Do CDS request
2025-09-30T14:51:01.096213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c91a00de-ab22c16b-3be0c654-ca15f961_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:01.102748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c91a00de-ab22c16b-3be0c654-ca15f961_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:01.102903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:01.102920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 263
2025-09-30T14:51:01.103028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 263 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:01.103062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 263 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:01.103086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=263 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:01.103090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:01.103577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 263 sessionId:  describe result for acl check
2025-09-30T14:51:01.103616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:01.103619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:01.103620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:01.103626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894850700574287:4043] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:01.104154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894850700574287:4043] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:01.105209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:01.106105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894850700574287:4043] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:01.106658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:01.106831Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:01.106842Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:01.106852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:01.106908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:01.106950Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894850610849748:3578]
2025-09-30T14:51:01.107499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:01.107704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:01.107753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:01.108030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:01.108087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:01.108095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:01.108096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:01.108097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:01.108098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:01.108099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:01.108100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:01.108101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:01.108103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:01.108104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:01.108105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.108106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.108107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.108108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:01.108109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:01.108114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:01.108124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:01.108129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:01.108133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:01.108137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:01.108141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:01.108145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:01.108149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:01.108153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:01.108158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:01.108167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.108171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.108179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.108183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:01.108192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:01.108199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:01.108211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:01.108221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:01.108228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:01.108230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:01.108234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:01.108239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:01.108243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:01.108245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:01.108248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:01.108251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:01.108254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:01.108258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:01.108261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:01.108263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:01.108267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:01.108269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:01.108272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:01.108275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:01.108278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:01.108285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.108289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.108291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.108294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.108297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.108300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.108302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:01.108305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:01.108307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:01.108310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:01.108355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:01.108592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894850700574287:4043] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:01.108608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894850700574287:4043] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:01.108610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894850700574287:4043] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:01.108617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 263 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:01.113934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:01.114919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:01.114934Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:01.114937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:01.114945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:01.114978Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 262 [2:7555894850610849748:3578]
2025-09-30T14:51:01.114998Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:01.115020Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:01.115027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.115030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.115032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.115047Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:01.115060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:01.115072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:01.115137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.115148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.115150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.115154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:01.115156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:01.115232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:01.115237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.115266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.115277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.115288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:01.115307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894850700574238:2454], now have 1 active actors on pipe
2025-09-30T14:51:01.115316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894850610849743:3578]
2025-09-30T14:51:01.115317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894850610849743:3578]
2025-09-30T14:51:01.115319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894850610849743:3578]
2025-09-30T14:51:01.115331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:01.115346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894850700574329:4043], now have 1 active actors on pipe
2025-09-30T14:51:01.115355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:01.115358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:01.115361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:01.115362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:01.115369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:01.115372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:01.115405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894850610849743:3578]
2025-09-30T14:51:01.115415Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:01.115438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:01.115453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 262
2025-09-30T14:51:01.115458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 262
2025-09-30T14:51:01.115558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.115573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.115598Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3ff76d3-cff19d36-d2daeb0b-69109e3f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:01.115612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.115620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.115623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:01.115634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.115653Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:01.115668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:01.115819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.115827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.115840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:01.115948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 263 partition: 0 MaxSeqNo: 42 sessionId: src_id|e3ff76d3-cff19d36-d2daeb0b-69109e3f_0
2025-09-30T14:51:01.116323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c91a00de-ab22c16b-3be0c654-ca15f961_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e3ff76d3-cff19d36-d2daeb0b-69109e3f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:01.119146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3ff76d3-cff19d36-d2daeb0b-69109e3f_0] Write session: try to update token
2025-09-30T14:51:01.119164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3ff76d3-cff19d36-d2daeb0b-69109e3f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:01.128396Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:01.128419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:01.128424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:01.128427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:01.128445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894850610849743:3578]
2025-09-30T14:51:01.128450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894850610849743:3578]
2025-09-30T14:51:01.128455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894850610849743:3578]
2025-09-30T14:51:01.128515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:01.128519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:01.128525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:01.128529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:01.128532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.128535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:01.128759Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:01.135231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 263 sessionId: src_id|e3ff76d3-cff19d36-d2daeb0b-69109e3f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.138072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.195967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894850700574337:3696]
2025-09-30T14:51:01.196251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 262, pipe: [1:7555894850700574337:3696]
2025-09-30T14:51:01.235655Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:01.236029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.236044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.236085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894850700574337:3696], now have 1 active actors on pipe
2025-09-30T14:51:01.236308Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:01.236343Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:01.236350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894850700574337:3696]
2025-09-30T14:51:01.236375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:01.236479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 263 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e3ff76d3-cff19d36-d2daeb0b-69109e3f_0
2025-09-30T14:51:01.236696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 263 sessionId: src_id|e3ff76d3-cff19d36-d2daeb0b-69109e3f_0 is DEAD
2025-09-30T14:51:01.236880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3ff76d3-cff19d36-d2daeb0b-69109e3f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:01.236892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3ff76d3-cff19d36-d2daeb0b-69109e3f_0] Write session will restart in 0.007841s
2025-09-30T14:51:01.236925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3ff76d3-cff19d36-d2daeb0b-69109e3f_0] Write session: Do CDS request
2025-09-30T14:51:01.236931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3ff76d3-cff19d36-d2daeb0b-69109e3f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:01.245453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:01.245851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3ff76d3-cff19d36-d2daeb0b-69109e3f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:01.245939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:01.245957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 264
2025-09-30T14:51:01.246089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 264 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:01.246122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 264 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:01.246132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=264 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:01.246136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:01.246611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 264 sessionId:  describe result for acl check
2025-09-30T14:51:01.246663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:01.246671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:01.246673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:01.246680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894850700574391:4047] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:01.247200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894850700574391:4047] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:01.247537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:01.247752Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:01.247763Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:01.247775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:01.247837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:01.247888Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894850610849839:3580]
2025-09-30T14:51:01.248556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:01.248896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:01.248951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:01.248935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894850700574391:4047] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:01.249199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:01.249243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:01.249247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:01.249248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:01.249249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:01.249250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:01.249251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:01.249252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:01.249253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:01.249253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:01.249254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:01.249255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.249258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.249258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.249259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:01.249260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:01.249264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:01.249270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:01.249272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:01.249275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:01.249278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:01.249282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:01.249286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:01.249289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:01.249293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:01.249297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:01.249301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.249304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.249307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.249311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:01.249315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:01.249321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:01.249326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:01.249330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:01.249334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:01.249336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:01.249339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:01.249341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:01.249345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:01.249348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:01.249351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:01.249364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:01.249368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:01.249372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:01.249375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:01.249378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:01.249381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:01.249383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:01.249386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:01.249389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:01.249392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:01.249396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.249398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.249401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.249404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.249406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.249409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.249411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:01.249414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:01.249416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:01.249419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:01.249444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:01.254983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894850700574391:4047] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:01.255003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894850700574391:4047] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:01.255008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894850700574391:4047] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:01.255026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 264 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:01.255367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:01.256243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:01.256258Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:01.256261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:01.256265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:01.256272Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 263 [2:7555894850610849839:3580]
2025-09-30T14:51:01.256290Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:01.256312Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:01.256314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.256316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.256318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.256338Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:01.256345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:01.256351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:01.256399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.256404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.256406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.256409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:01.256412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:01.256479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:01.256489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.256498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.256505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.256514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:01.256528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894850700574430:4047], now have 1 active actors on pipe
2025-09-30T14:51:01.256531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894850700574338:2454], now have 1 active actors on pipe
2025-09-30T14:51:01.256536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894850610849834:3580]
2025-09-30T14:51:01.256537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894850610849834:3580]
2025-09-30T14:51:01.256539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894850610849834:3580]
2025-09-30T14:51:01.256553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:01.256564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:01.256583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:01.256586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:01.256607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:01.256611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:01.256614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:01.256630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894850610849834:3580]
2025-09-30T14:51:01.256611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 263
2025-09-30T14:51:01.256637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:01.256653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:01.256626Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 263
2025-09-30T14:51:01.256673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.256677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.256704Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9fa3987a-83ef5d0f-c914cbed-394f42d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:01.256713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.256716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.256718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:01.256726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.256733Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:01.256744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:01.256895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.256905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.256937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:01.257032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 264 partition: 0 MaxSeqNo: 42 sessionId: src_id|9fa3987a-83ef5d0f-c914cbed-394f42d1_0
2025-09-30T14:51:01.257405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3ff76d3-cff19d36-d2daeb0b-69109e3f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9fa3987a-83ef5d0f-c914cbed-394f42d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:01.260228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa3987a-83ef5d0f-c914cbed-394f42d1_0] Write session: try to update token
2025-09-30T14:51:01.260250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa3987a-83ef5d0f-c914cbed-394f42d1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:01.268557Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:01.268576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:01.268587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894850610849834:3580]
2025-09-30T14:51:01.268638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:01.268644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:01.268813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:01.268957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:01.269092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:01.269229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:01.269449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:01.269501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:01.275955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 264 sessionId: src_id|9fa3987a-83ef5d0f-c914cbed-394f42d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.279030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.280349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.280373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.280392Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:01.280395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:01.280397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:01.280399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:01.280408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894850610849834:3580]
2025-09-30T14:51:01.280412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894850610849834:3580]
2025-09-30T14:51:01.280420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894850610849834:3580]
2025-09-30T14:51:01.280466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:01.280473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:01.280475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.280477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:01.280479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:01.280484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:01.280630Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:01.336762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894850700574438:3696]
2025-09-30T14:51:01.337016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 263, pipe: [1:7555894850700574438:3696]
2025-09-30T14:51:01.387515Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:01.387982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:01.388036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894850700574438:3696], now have 1 active actors on pipe
2025-09-30T14:51:01.388134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:01.388230Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:01.388242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:01.388245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:01.388283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894850700574438:3696]
2025-09-30T14:51:01.388320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 264 reason: error at write: Disconnected sessionId: src_id|9fa3987a-83ef5d0f-c914cbed-394f42d1_0
2025-09-30T14:51:01.388500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 264 sessionId: src_id|9fa3987a-83ef5d0f-c914cbed-394f42d1_0 is DEAD
2025-09-30T14:51:01.388646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa3987a-83ef5d0f-c914cbed-394f42d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:01.388658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa3987a-83ef5d0f-c914cbed-394f42d1_0] Write session will restart in 0.009943s
2025-09-30T14:51:01.388679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa3987a-83ef5d0f-c914cbed-394f42d1_0] Write session: Do CDS request
2025-09-30T14:51:01.388686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa3987a-83ef5d0f-c914cbed-394f42d1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:01.396947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:01.398704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:01.398922Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:01.398932Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:01.398943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:01.399003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:01.399039Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894850610849931:3582]
2025-09-30T14:51:01.399635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:01.399722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa3987a-83ef5d0f-c914cbed-394f42d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:01.399792Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:01.399809Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 265
2025-09-30T14:51:01.399915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:01.399926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 265 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:01.399952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 265 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:01.399959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=265 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:01.399964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:01.399947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:01.400236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:01.400291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:01.400292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 265 sessionId:  describe result for acl check
2025-09-30T14:51:01.400297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:01.400298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:01.400299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:01.400300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:01.400301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:01.400302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:01.400304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:01.400305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:01.400306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:01.400317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:01.400307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.400311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.400322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:01.400312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.400313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:01.400314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:01.400324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:01.400327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894850700574496:4051] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:01.400320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:01.400330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:01.400334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:01.400339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:01.400343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:01.400347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:01.400351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:01.400355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:01.400359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:01.400364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:01.400368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.400372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.400376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.400380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:01.400384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:01.400390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:01.400399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:01.400405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:01.400410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:01.400415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:01.400420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:01.400424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:01.400430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:01.400435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:01.400440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:01.400444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:01.400450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:01.400455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:01.400465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:01.400469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:01.400474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:01.400483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:01.400488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:01.400492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:01.400497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:01.400506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.400511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.400516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.400526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.400530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.400535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.400544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:01.400549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:01.400555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:01.400564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:01.400609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:01.400746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894850700574496:4051] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:01.402427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894850700574496:4051] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:01.405525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894850700574496:4051] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:01.405543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894850700574496:4051] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:01.405547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894850700574496:4051] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:01.405555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 265 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:01.406029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:01.407095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:01.407108Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:01.407111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:01.407115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:01.407122Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 264 [2:7555894850610849931:3582]
2025-09-30T14:51:01.407135Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:01.407149Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:01.407151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.407154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.407156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.407176Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:01.407190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:01.407196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:01.407270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.407277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.407279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.407282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:01.407284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:01.407353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:01.407362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.407371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.407382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.407392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:01.407410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894850700574532:4051], now have 1 active actors on pipe
2025-09-30T14:51:01.407417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894850700574439:2454], now have 1 active actors on pipe
2025-09-30T14:51:01.407422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894850610849926:3582]
2025-09-30T14:51:01.407423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894850610849926:3582]
2025-09-30T14:51:01.407424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894850610849926:3582]
2025-09-30T14:51:01.407433Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:01.407445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:01.407448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:01.407452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:01.407454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:01.407457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:01.407459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:01.407486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894850610849926:3582]
2025-09-30T14:51:01.407496Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:01.407512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:01.407490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 264
2025-09-30T14:51:01.407493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 264
2025-09-30T14:51:01.407549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.407559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.407579Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3c69f51-60ecb4ef-f6b2746b-52bba8f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:01.407587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.407591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.407593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:01.407600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.407610Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:01.407620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:01.407838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.407855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.407879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:01.407984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 265 partition: 0 MaxSeqNo: 42 sessionId: src_id|c3c69f51-60ecb4ef-f6b2746b-52bba8f5_0
2025-09-30T14:51:01.408343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa3987a-83ef5d0f-c914cbed-394f42d1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c3c69f51-60ecb4ef-f6b2746b-52bba8f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:01.411537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3c69f51-60ecb4ef-f6b2746b-52bba8f5_0] Write session: try to update token
2025-09-30T14:51:01.411561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3c69f51-60ecb4ef-f6b2746b-52bba8f5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:01.419980Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:01.420000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:01.420011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894850610849926:3582]
2025-09-30T14:51:01.420066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:01.420077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:01.420318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:01.420510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:01.420696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:01.420889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:01.421131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:01.421180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:01.427931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 265 sessionId: src_id|c3c69f51-60ecb4ef-f6b2746b-52bba8f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.430561Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:01.430574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:01.430576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:01.430578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:01.430587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894850610849926:3582]
2025-09-30T14:51:01.430591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894850610849926:3582]
2025-09-30T14:51:01.430596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894850610849926:3582]
2025-09-30T14:51:01.430652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:01.430664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.430670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:01.430674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:01.430679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:01.430684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:01.430811Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:01.430881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.488318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894850700574542:3696]
2025-09-30T14:51:01.488564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 264, pipe: [1:7555894850700574542:3696]
2025-09-30T14:51:01.536852Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:01.537171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.537183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.537200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894850700574542:3696], now have 1 active actors on pipe
2025-09-30T14:51:01.537365Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:01.537416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:01.537431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:01.537452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894850700574542:3696]
2025-09-30T14:51:01.537476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:01.537494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 265 reason: error at write: Disconnected sessionId: src_id|c3c69f51-60ecb4ef-f6b2746b-52bba8f5_0
2025-09-30T14:51:01.537698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 265 sessionId: src_id|c3c69f51-60ecb4ef-f6b2746b-52bba8f5_0 is DEAD
2025-09-30T14:51:01.537878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3c69f51-60ecb4ef-f6b2746b-52bba8f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:01.537889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3c69f51-60ecb4ef-f6b2746b-52bba8f5_0] Write session will restart in 0.008460s
2025-09-30T14:51:01.537911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3c69f51-60ecb4ef-f6b2746b-52bba8f5_0] Write session: Do CDS request
2025-09-30T14:51:01.537916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3c69f51-60ecb4ef-f6b2746b-52bba8f5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:01.545681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:01.547713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3c69f51-60ecb4ef-f6b2746b-52bba8f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:01.547881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:01.547900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 266
2025-09-30T14:51:01.548020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 266 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:01.548070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 266 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:01.548078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=266 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:01.548082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:01.548116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:01.548358Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:01.548369Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:01.548379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:01.548454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:01.548508Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894850610850026:3585]
2025-09-30T14:51:01.548534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 266 sessionId:  describe result for acl check
2025-09-30T14:51:01.548579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:01.548586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:01.548588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:01.548595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894850700574598:4056] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:01.549091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:01.549177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894850700574598:4056] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:01.549429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:01.549474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:01.549817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:01.549881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:01.549887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:01.549888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:01.549888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:01.549889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:01.549890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:01.549891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:01.549892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:01.549894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:01.549895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:01.549896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.549896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.549897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.549898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:01.549898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:01.549902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:01.549909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:01.549911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:01.549913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:01.549916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:01.549918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:01.549921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:01.549923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:01.549925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:01.549928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:01.549930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.549932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.549935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.549937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:01.549939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:01.549944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:01.549950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:01.549954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:01.549957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:01.549960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:01.549963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:01.549965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:01.549968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:01.549973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:01.549981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:01.549986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:01.549991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:01.549997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:01.550002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:01.550006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:01.550011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:01.550016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:01.550021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:01.550026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:01.550032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:01.550037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.550043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.550046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.550051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.550055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.550060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.550064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:01.550069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:01.550075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:01.550080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:01.550124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:01.551034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894850700574598:4056] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:01.555050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894850700574598:4056] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:01.555067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894850700574598:4056] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:01.555082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894850700574598:4056] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:01.555091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 266 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:01.555465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:01.556412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:01.556423Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:01.556425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:01.556428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:01.556433Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 265 [2:7555894850610850026:3585]
2025-09-30T14:51:01.556446Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:01.556458Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:01.556460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.556463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.556467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.556480Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:01.556485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:01.556490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:01.556533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.556539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.556540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.556543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:01.556545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:01.556606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:01.556613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.556620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.556627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.556644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:01.556670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894850700574543:2454], now have 1 active actors on pipe
2025-09-30T14:51:01.556678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894850700574637:4056], now have 1 active actors on pipe
2025-09-30T14:51:01.556685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894850610850021:3585]
2025-09-30T14:51:01.556686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894850610850021:3585]
2025-09-30T14:51:01.556688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894850610850021:3585]
2025-09-30T14:51:01.556702Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:01.556722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:01.556712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 265
2025-09-30T14:51:01.556726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:01.556729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:01.556732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:01.556741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:01.556742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 265
2025-09-30T14:51:01.556744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:01.556788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894850610850021:3585]
2025-09-30T14:51:01.556799Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:01.556812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:01.556815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.556819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.556863Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f52bad6-e51bbd11-5d56456-7ce17fd7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:01.556874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.556877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.556879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:01.556888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.556896Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:01.556915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:01.557105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.557117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.557138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:01.557268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 266 partition: 0 MaxSeqNo: 42 sessionId: src_id|2f52bad6-e51bbd11-5d56456-7ce17fd7_0
2025-09-30T14:51:01.557604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3c69f51-60ecb4ef-f6b2746b-52bba8f5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2f52bad6-e51bbd11-5d56456-7ce17fd7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:01.560261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f52bad6-e51bbd11-5d56456-7ce17fd7_0] Write session: try to update token
2025-09-30T14:51:01.560276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f52bad6-e51bbd11-5d56456-7ce17fd7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:01.569052Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:01.569066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:01.569069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:01.569071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:01.569081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894850610850021:3585]
2025-09-30T14:51:01.569085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894850610850021:3585]
2025-09-30T14:51:01.569089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894850610850021:3585]
2025-09-30T14:51:01.569129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:01.569137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.569140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:01.569140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:01.569147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:01.569152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:01.569298Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:01.574982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 266 sessionId: src_id|2f52bad6-e51bbd11-5d56456-7ce17fd7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.577924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.637839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894850700574644:3696]
2025-09-30T14:51:01.638171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 265, pipe: [1:7555894850700574644:3696]
2025-09-30T14:51:01.680098Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:01.680422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.680437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.680479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894850700574644:3696], now have 1 active actors on pipe
2025-09-30T14:51:01.680710Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:01.680754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:01.680759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894850700574644:3696]
2025-09-30T14:51:01.680769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:01.680782Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:01.680832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 266 reason: error at write: Disconnected sessionId: src_id|2f52bad6-e51bbd11-5d56456-7ce17fd7_0
2025-09-30T14:51:01.681043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 266 sessionId: src_id|2f52bad6-e51bbd11-5d56456-7ce17fd7_0 is DEAD
2025-09-30T14:51:01.681211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f52bad6-e51bbd11-5d56456-7ce17fd7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:01.681223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f52bad6-e51bbd11-5d56456-7ce17fd7_0] Write session will restart in 0.007662s
2025-09-30T14:51:01.681244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f52bad6-e51bbd11-5d56456-7ce17fd7_0] Write session: Do CDS request
2025-09-30T14:51:01.681253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f52bad6-e51bbd11-5d56456-7ce17fd7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:01.689821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f52bad6-e51bbd11-5d56456-7ce17fd7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:01.689950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:01.689969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 267
2025-09-30T14:51:01.690095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 267 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:01.690141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 267 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:01.690151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=267 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:01.690155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:01.690184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:01.690627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 267 sessionId:  describe result for acl check
2025-09-30T14:51:01.690672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:01.690680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:01.690682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:01.690688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894850700574702:4060] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:01.691275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894850700574702:4060] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:01.691777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:01.691965Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:01.691973Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:01.691984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:01.692035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:01.692072Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894850610850120:3587]
2025-09-30T14:51:01.692729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:01.693003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:01.693039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:01.693362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:01.693391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894850700574702:4060] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:01.693422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:01.693428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:01.693429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:01.693431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:01.693432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:01.693433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:01.693435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:01.693436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:01.693437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:01.693438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:01.693439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.693441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.693442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.693443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:01.693445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:01.693450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:01.693460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:01.693464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:01.693469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:01.693473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:01.693477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:01.693481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:01.693485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:01.693500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:01.693505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:01.693508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.693513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.693517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.693521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:01.693525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:01.693531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:01.693539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:01.693545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:01.693552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:01.693561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:01.693567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:01.693573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:01.693578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:01.693588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:01.693594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:01.693603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:01.693608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:01.693613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:01.693623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:01.693627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:01.693632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:01.693636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:01.693646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:01.693651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:01.693660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:01.693664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.693674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.693678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.693685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.693693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.693698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.693702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:01.693711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:01.693715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:01.693720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:01.693768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:01.698890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894850700574702:4060] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:01.698908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894850700574702:4060] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:01.698912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894850700574702:4060] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:01.698921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 267 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:01.699355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:01.700315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:01.700327Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:01.700329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:01.700332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:01.700337Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 266 [2:7555894850610850120:3587]
2025-09-30T14:51:01.700348Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:01.700359Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:01.700362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.700364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.700368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.700377Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:01.700382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:01.700387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:01.700427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.700433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.700434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.700436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:01.700438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:01.700509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:01.700515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.700523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.700529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.700539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:01.700557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894850610850115:3587]
2025-09-30T14:51:01.700562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894850610850115:3587]
2025-09-30T14:51:01.700564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894850610850115:3587]
2025-09-30T14:51:01.700570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:01.700581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:01.700589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:01.700593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:01.700594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:01.700596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:01.700597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:01.700623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894850700574741:4060], now have 1 active actors on pipe
2025-09-30T14:51:01.700630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894850700574646:2454], now have 1 active actors on pipe
2025-09-30T14:51:01.700631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894850610850115:3587]
2025-09-30T14:51:01.700637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:01.700656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:01.700648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 266
2025-09-30T14:51:01.700648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 266
2025-09-30T14:51:01.700763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.700772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.700794Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a60d6f7-b5921fd6-13ab5579-de1cab3b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:01.700802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.700805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.700806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:01.700812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.700819Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:01.700830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:01.700968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.700975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.700987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:01.701107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 267 partition: 0 MaxSeqNo: 42 sessionId: src_id|4a60d6f7-b5921fd6-13ab5579-de1cab3b_0
2025-09-30T14:51:01.701452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f52bad6-e51bbd11-5d56456-7ce17fd7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4a60d6f7-b5921fd6-13ab5579-de1cab3b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:01.704181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a60d6f7-b5921fd6-13ab5579-de1cab3b_0] Write session: try to update token
2025-09-30T14:51:01.704201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a60d6f7-b5921fd6-13ab5579-de1cab3b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:01.713413Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:01.713433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:01.713438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:01.713440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:01.713452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894850610850115:3587]
2025-09-30T14:51:01.713458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894850610850115:3587]
2025-09-30T14:51:01.713463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894850610850115:3587]
2025-09-30T14:51:01.713515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:01.713532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.713535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:01.713541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:01.713542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:01.713547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:01.713721Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:01.719144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 267 sessionId: src_id|4a60d6f7-b5921fd6-13ab5579-de1cab3b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.721926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.780652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894850700574761:3696]
2025-09-30T14:51:01.780911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 266, pipe: [1:7555894850700574761:3696]
2025-09-30T14:51:01.825731Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:01.826062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.826080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.826140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894850700574761:3696], now have 1 active actors on pipe
2025-09-30T14:51:01.826373Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:01.826467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:01.826487Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:01.826492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:01.826521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894850700574761:3696]
2025-09-30T14:51:01.826564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 267 reason: error at write: Disconnected sessionId: src_id|4a60d6f7-b5921fd6-13ab5579-de1cab3b_0
2025-09-30T14:51:01.826780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 267 sessionId: src_id|4a60d6f7-b5921fd6-13ab5579-de1cab3b_0 is DEAD
2025-09-30T14:51:01.826961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a60d6f7-b5921fd6-13ab5579-de1cab3b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:01.826974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a60d6f7-b5921fd6-13ab5579-de1cab3b_0] Write session will restart in 0.008284s
2025-09-30T14:51:01.826999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a60d6f7-b5921fd6-13ab5579-de1cab3b_0] Write session: Do CDS request
2025-09-30T14:51:01.827005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a60d6f7-b5921fd6-13ab5579-de1cab3b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:01.834690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:01.836572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:01.836835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a60d6f7-b5921fd6-13ab5579-de1cab3b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:01.836837Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:01.836848Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:01.836859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:01.836909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:01.836946Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894850610850227:3590]
2025-09-30T14:51:01.836948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:01.836966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 268
2025-09-30T14:51:01.837086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 268 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:01.837115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 268 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:01.837125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=268 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:01.837130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:01.837583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:01.837616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 268 sessionId:  describe result for acl check
2025-09-30T14:51:01.837665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:01.837673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:01.837675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:01.837681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894850700574822:4065] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:01.837956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:01.838033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:01.838225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894850700574822:4065] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:01.838387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:01.838467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:01.838474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:01.838475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:01.838476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:01.838478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:01.838479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:01.838481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:01.838482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:01.838483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:01.838484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:01.838485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.838486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.838488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.838489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:01.838490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:01.838496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:01.838505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:01.838508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:01.838512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:01.838515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:01.838519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:01.838522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:01.838526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:01.838529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:01.838533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:01.838537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.838540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.838543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.838546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:01.838550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:01.838558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:01.838566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:01.838574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:01.838580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:01.838584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:01.838590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:01.838594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:01.838619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:01.838625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:01.838630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:01.838635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:01.838641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:01.838646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:01.838652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:01.838655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:01.838661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:01.838668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:01.838675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:01.838679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:01.838685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:01.838695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.838701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.838710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.838716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.838720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.838729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.838733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:01.838739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:01.838746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:01.838755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:01.838801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:01.840433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894850700574822:4065] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:01.844291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894850700574822:4065] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:01.844310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894850700574822:4065] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:01.844314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894850700574822:4065] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:01.844324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 268 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:01.844668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:01.845662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:01.845680Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:01.845684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:01.845688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:01.845696Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 267 [2:7555894850610850227:3590]
2025-09-30T14:51:01.845713Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:01.845729Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:01.845732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.845735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.845737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.845755Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:01.845769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:01.845780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:01.845835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.845844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.845846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.845849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:01.845852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:01.845941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:01.845948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.845961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.845981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.846005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:01.846028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894850700574765:2454], now have 1 active actors on pipe
2025-09-30T14:51:01.846037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894850700574861:4065], now have 1 active actors on pipe
2025-09-30T14:51:01.846044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894850610850222:3590]
2025-09-30T14:51:01.846051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894850610850222:3590]
2025-09-30T14:51:01.846053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894850610850222:3590]
2025-09-30T14:51:01.846076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:01.846078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:01.846082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:01.846084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:01.846094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:01.846110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:01.846113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:01.846091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 267
2025-09-30T14:51:01.846114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 267
2025-09-30T14:51:01.846154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894850610850222:3590]
2025-09-30T14:51:01.846165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:01.846178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.846183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:01.846187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.846227Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c75755e0-458febbc-6df3c254-24297ce0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:01.846238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.846243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.846249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:01.846259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.846272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:01.846292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:01.846449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.846458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.846472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:01.846543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 268 partition: 0 MaxSeqNo: 42 sessionId: src_id|c75755e0-458febbc-6df3c254-24297ce0_0
2025-09-30T14:51:01.846948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a60d6f7-b5921fd6-13ab5579-de1cab3b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c75755e0-458febbc-6df3c254-24297ce0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:01.849797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c75755e0-458febbc-6df3c254-24297ce0_0] Write session: try to update token
2025-09-30T14:51:01.849818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c75755e0-458febbc-6df3c254-24297ce0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:01.858831Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:01.858848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:01.858853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:01.858856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:01.858865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894850610850222:3590]
2025-09-30T14:51:01.858870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894850610850222:3590]
2025-09-30T14:51:01.858874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894850610850222:3590]
2025-09-30T14:51:01.858916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:01.858923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.858926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:01.858929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:01.858936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:01.858940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:01.859127Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:01.865376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 268 sessionId: src_id|c75755e0-458febbc-6df3c254-24297ce0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.868662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.926592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894850700574890:3696]
2025-09-30T14:51:01.926917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 267, pipe: [1:7555894850700574890:3696]
2025-09-30T14:51:01.974664Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:01.974999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.975012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.975030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894850700574890:3696], now have 1 active actors on pipe
2025-09-30T14:51:01.975270Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:01.975310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894850700574890:3696]
2025-09-30T14:51:01.975325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:01.975728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:01.975799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 268 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c75755e0-458febbc-6df3c254-24297ce0_0
2025-09-30T14:51:01.975991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 268 sessionId: src_id|c75755e0-458febbc-6df3c254-24297ce0_0 is DEAD
2025-09-30T14:51:01.976132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c75755e0-458febbc-6df3c254-24297ce0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:01.976141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c75755e0-458febbc-6df3c254-24297ce0_0] Write session will restart in 0.007508s
2025-09-30T14:51:01.976158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c75755e0-458febbc-6df3c254-24297ce0_0] Write session: Do CDS request
2025-09-30T14:51:01.976162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c75755e0-458febbc-6df3c254-24297ce0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:01.984189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:01.984781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c75755e0-458febbc-6df3c254-24297ce0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:01.984874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:01.984901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 269
2025-09-30T14:51:01.985044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 269 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:01.985079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 269 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:01.985090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=269 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:01.985094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:01.985576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 269 sessionId:  describe result for acl check
2025-09-30T14:51:01.985610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:01.985617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:01.985620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:01.985626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894850700574957:4078] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:01.985928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:01.986135Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:01.986146Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:01.986165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:01.986189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894850700574957:4078] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:01.986218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:01.986257Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894850610850362:3604]
2025-09-30T14:51:01.986916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:01.987347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:01.987420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:01.987730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:01.987793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:01.987800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:01.987801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:01.987802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:01.987803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:01.987805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:01.987806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:01.987807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:01.987808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:01.987809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:01.987810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.987812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.987813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.987814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:01.987815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:01.987821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:01.987832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:01.987837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:01.987841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:01.987846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:01.987851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:01.987854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:01.987859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:01.987862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:01.987866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:01.987871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.987875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.987880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.987883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:01.987887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:01.987895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:01.987904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:01.987913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:01.987924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:01.987929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:01.987938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:01.987943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:01.987952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:01.987956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:01.987961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:01.987966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:01.987972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:01.987977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:01.987984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:01.987991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:01.987996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:01.988005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:01.988011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:01.988019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:01.988024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:01.988030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.988039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.988044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.988050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.988059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.988064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.988071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:01.988077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:01.988086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:01.988096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:01.988132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:01.988467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894850700574957:4078] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:01.993604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894850700574957:4078] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:01.993625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894850700574957:4078] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:01.993630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894850700574957:4078] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:01.993727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 269 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:01.993952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:01.995052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:01.995071Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:01.995074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:01.995078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:01.995085Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 268 [2:7555894850610850362:3604]
2025-09-30T14:51:01.995101Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:01.995117Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:01.995121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.995125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.995127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.995145Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:01.995157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:01.995175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:01.995240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.995263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.995265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.995269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:01.995271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:01.995345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:01.995354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:01.995371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:01.995388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:01.995411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:01.995434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894850700574995:4078], now have 1 active actors on pipe
2025-09-30T14:51:01.995442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894850700574899:2454], now have 1 active actors on pipe
2025-09-30T14:51:01.995447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894850610850355:3604]
2025-09-30T14:51:01.995449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894850610850355:3604]
2025-09-30T14:51:01.995451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894850610850355:3604]
2025-09-30T14:51:01.995464Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:01.995461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 268
2025-09-30T14:51:01.995483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:01.995487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:01.995462Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 268
2025-09-30T14:51:01.995492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:01.995495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:01.995503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:01.995506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:01.995556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.995565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.995582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894850610850355:3604]
2025-09-30T14:51:01.995597Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:01.995626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:01.995633Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f76b364f-1ad1fa29-626ab1c3-a399a1a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:01.995640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.995646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.995647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:01.995659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.995675Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:01.995708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:01.995890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.995902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.995920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:01.996013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 269 partition: 0 MaxSeqNo: 42 sessionId: src_id|f76b364f-1ad1fa29-626ab1c3-a399a1a4_0
2025-09-30T14:51:01.996407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c75755e0-458febbc-6df3c254-24297ce0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f76b364f-1ad1fa29-626ab1c3-a399a1a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:01.999509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f76b364f-1ad1fa29-626ab1c3-a399a1a4_0] Write session: try to update token
2025-09-30T14:51:01.999531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f76b364f-1ad1fa29-626ab1c3-a399a1a4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:02.008284Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:02.008302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:02.008304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:02.008307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:02.008317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894850610850355:3604]
2025-09-30T14:51:02.008322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894850610850355:3604]
2025-09-30T14:51:02.008327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894850610850355:3604]
2025-09-30T14:51:02.008374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:02.008378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:02.008385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:02.008386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.008389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:02.008389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:02.008579Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:02.015554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 269 sessionId: src_id|f76b364f-1ad1fa29-626ab1c3-a399a1a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:02.018818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:02.075601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894854995542302:3696]
2025-09-30T14:51:02.075926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 268, pipe: [1:7555894854995542302:3696]
2025-09-30T14:51:02.129829Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:02.130418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:02.130437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:02.130458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894854995542302:3696], now have 1 active actors on pipe
2025-09-30T14:51:02.130726Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:02.130706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894854995542302:3696]
2025-09-30T14:51:02.130723Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:02.130745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:02.130747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:02.130808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 269 reason: error at write: Disconnected sessionId: src_id|f76b364f-1ad1fa29-626ab1c3-a399a1a4_0
2025-09-30T14:51:02.131024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 269 sessionId: src_id|f76b364f-1ad1fa29-626ab1c3-a399a1a4_0 is DEAD
2025-09-30T14:51:02.131196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f76b364f-1ad1fa29-626ab1c3-a399a1a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:02.131207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f76b364f-1ad1fa29-626ab1c3-a399a1a4_0] Write session will restart in 0.008399s
2025-09-30T14:51:02.131238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f76b364f-1ad1fa29-626ab1c3-a399a1a4_0] Write session: Do CDS request
2025-09-30T14:51:02.131260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f76b364f-1ad1fa29-626ab1c3-a399a1a4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:02.138937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:02.140355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:02.140525Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:02.140536Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:02.140547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:02.140596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:02.140634Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894854905817756:3607]
2025-09-30T14:51:02.140824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f76b364f-1ad1fa29-626ab1c3-a399a1a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:02.140971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:02.140990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 270
2025-09-30T14:51:02.141111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 270 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:02.141134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 270 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:02.141153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=270 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:02.141157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:02.141253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:02.141517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:02.141561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:02.141557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 270 sessionId:  describe result for acl check
2025-09-30T14:51:02.141598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:02.141605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:02.141606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:02.141612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894854995542365:4082] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:02.141829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:02.141869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:02.141874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:02.141874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:02.141875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:02.141876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:02.141876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:02.141877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:02.141878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:02.141878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:02.141879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:02.141880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.141880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.141881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.141882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:02.141882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:02.141887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:02.141897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:02.141902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:02.141905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:02.141910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:02.141914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:02.141917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:02.141920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:02.141922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:02.141925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:02.141927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.141929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.141932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.141934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:02.141936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:02.141942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:02.141948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:02.141952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:02.141955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:02.141960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:02.141964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:02.141967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:02.141970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:02.141973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:02.141976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:02.141979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:02.141982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:02.141985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:02.141989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:02.141992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:02.141995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:02.141998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:02.142000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:02.142002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:02.142005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:02.142008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.142011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.142013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.142016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.142019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.142021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.142024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:02.142028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:02.142032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:02.142038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:02.142090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894854995542365:4082] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:02.142076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:02.144070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894854995542365:4082] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:02.147200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894854995542365:4082] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:02.147220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894854995542365:4082] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:02.147224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894854995542365:4082] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:02.147233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 270 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:02.147650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:02.148540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:02.148556Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:02.148559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:02.148562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:02.148568Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 269 [2:7555894854905817756:3607]
2025-09-30T14:51:02.148589Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:02.148605Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:02.148608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.148610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.148613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.148630Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:02.148636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:02.148645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:02.148698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.148705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.148707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.148710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:02.148712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:02.148863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:02.148871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.148883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.148899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.148897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 269
2025-09-30T14:51:02.148920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:02.148916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 269
2025-09-30T14:51:02.148942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894854995542304:2454], now have 1 active actors on pipe
2025-09-30T14:51:02.148951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894854995542402:4082], now have 1 active actors on pipe
2025-09-30T14:51:02.148957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894854905817751:3607]
2025-09-30T14:51:02.148960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894854905817751:3607]
2025-09-30T14:51:02.148961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894854905817751:3607]
2025-09-30T14:51:02.148970Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:02.148979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:02.148983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:02.148988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:02.148992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:02.149006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:02.149010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:02.149029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:02.149032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:02.149071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894854905817751:3607]
2025-09-30T14:51:02.149083Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:02.149099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:02.149101Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d0eccc5-f53eae58-d41bb55f-b56ae730_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:02.149109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.149112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.149113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:02.149123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.149132Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:02.149169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:02.149389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:02.149396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:02.149408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:02.149481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 270 partition: 0 MaxSeqNo: 42 sessionId: src_id|8d0eccc5-f53eae58-d41bb55f-b56ae730_0
2025-09-30T14:51:02.149871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f76b364f-1ad1fa29-626ab1c3-a399a1a4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8d0eccc5-f53eae58-d41bb55f-b56ae730_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:02.152829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d0eccc5-f53eae58-d41bb55f-b56ae730_0] Write session: try to update token
2025-09-30T14:51:02.152851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d0eccc5-f53eae58-d41bb55f-b56ae730_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:02.161633Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:02.161651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:02.161654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:02.161656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:02.161666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894854905817751:3607]
2025-09-30T14:51:02.161671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894854905817751:3607]
2025-09-30T14:51:02.161675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894854905817751:3607]
2025-09-30T14:51:02.161717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:02.161725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.161727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:02.161730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:02.161733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:02.161741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:02.161906Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:02.169101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 270 sessionId: src_id|8d0eccc5-f53eae58-d41bb55f-b56ae730_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:02.172077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:02.230703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894854995542409:3696]
2025-09-30T14:51:02.231017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 269, pipe: [1:7555894854995542409:3696]
2025-09-30T14:51:02.276756Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:02.277109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:02.277124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:02.277144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894854995542409:3696], now have 1 active actors on pipe
2025-09-30T14:51:02.277455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:02.277467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894854995542409:3696]
2025-09-30T14:51:02.277492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:02.277495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:02.277564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 270 reason: error at write: Disconnected sessionId: src_id|8d0eccc5-f53eae58-d41bb55f-b56ae730_0
2025-09-30T14:51:02.277977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d0eccc5-f53eae58-d41bb55f-b56ae730_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:02.278000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d0eccc5-f53eae58-d41bb55f-b56ae730_0] Write session will restart in 0.009767s
2025-09-30T14:51:02.278025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d0eccc5-f53eae58-d41bb55f-b56ae730_0] Write session: Do CDS request
2025-09-30T14:51:02.278031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d0eccc5-f53eae58-d41bb55f-b56ae730_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:02.277819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 270 sessionId: src_id|8d0eccc5-f53eae58-d41bb55f-b56ae730_0 is DEAD
2025-09-30T14:51:02.277585Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:02.288087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:02.288866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d0eccc5-f53eae58-d41bb55f-b56ae730_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:02.288931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:02.288963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 271
2025-09-30T14:51:02.289142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 271 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:02.289196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 271 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:02.289207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=271 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:02.289211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:02.290244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:02.290333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 271 sessionId:  describe result for acl check
2025-09-30T14:51:02.290384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:02.290391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:02.290394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:02.290400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894854995542471:4086] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:02.290471Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:02.290480Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:02.290491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:02.290539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:02.290576Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894854905817856:3609]
2025-09-30T14:51:02.290989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894854995542471:4086] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:02.291268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:02.291767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:02.291840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:02.292261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:02.292356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:02.292364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:02.292365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:02.292366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:02.292368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:02.292369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:02.292370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:02.292372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:02.292373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:02.292374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:02.292375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.292377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.292378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.292379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:02.292380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:02.292388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:02.292398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:02.292402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:02.292406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:02.292410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:02.292414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:02.292418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:02.292422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:02.292426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:02.292430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:02.292435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.292439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.292443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.292447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:02.292451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:02.292459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:02.292467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:02.292473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:02.292479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:02.292484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:02.292506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:02.292516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:02.292521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:02.292531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:02.292536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:02.292542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:02.292553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:02.292558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:02.292568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:02.292572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:02.292577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:02.292582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:02.292592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:02.292598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:02.292608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:02.292613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.292623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.292627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.292633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.292643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.292649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.292659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:02.292666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:02.292675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:02.292681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:02.292734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:02.293014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894854995542471:4086] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:02.297994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894854995542471:4086] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:02.298028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894854995542471:4086] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:02.298031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894854995542471:4086] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:02.298040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 271 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:02.298364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:02.299523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:02.299538Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:02.299541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:02.299545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:02.299552Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 270 [2:7555894854905817856:3609]
2025-09-30T14:51:02.299567Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:02.299582Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:02.299585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.299588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.299590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.299605Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:02.299612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:02.299619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:02.299681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.299688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.299690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.299694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:02.299696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:02.299764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:02.299773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.299786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.299799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.299815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:02.299833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894854995542410:2454], now have 1 active actors on pipe
2025-09-30T14:51:02.299841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894854995542510:4086], now have 1 active actors on pipe
2025-09-30T14:51:02.299848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894854905817850:3609]
2025-09-30T14:51:02.299851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894854905817850:3609]
2025-09-30T14:51:02.299853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894854905817850:3609]
2025-09-30T14:51:02.299866Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:02.299883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:02.299892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:02.299897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:02.299899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:02.299903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:02.299906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:02.299939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894854905817850:3609]
2025-09-30T14:51:02.299951Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:02.299935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 270
2025-09-30T14:51:02.299938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 270
2025-09-30T14:51:02.299971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:02.299998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:02.300008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:02.300031Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a93f94f-597f528a-a0f7cc53-457390c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:02.300038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.300041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.300043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:02.300053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.300063Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:02.300081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:02.300285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:02.300295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:02.300313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:02.300395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 271 partition: 0 MaxSeqNo: 42 sessionId: src_id|9a93f94f-597f528a-a0f7cc53-457390c_0
2025-09-30T14:51:02.300801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d0eccc5-f53eae58-d41bb55f-b56ae730_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9a93f94f-597f528a-a0f7cc53-457390c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:02.303887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a93f94f-597f528a-a0f7cc53-457390c_0] Write session: try to update token
2025-09-30T14:51:02.303911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a93f94f-597f528a-a0f7cc53-457390c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:02.312526Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:02.312548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:02.312559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894854905817850:3609]
2025-09-30T14:51:02.312611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:02.312612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:02.312858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:02.313033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:02.313193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:02.313351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:02.313566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:02.313614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:02.320633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 271 sessionId: src_id|9a93f94f-597f528a-a0f7cc53-457390c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:02.323631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:02.323731Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:02.323746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:02.323749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:02.323751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:02.323763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894854905817850:3609]
2025-09-30T14:51:02.323767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894854905817850:3609]
2025-09-30T14:51:02.323772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894854905817850:3609]
2025-09-30T14:51:02.323806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:02.323818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:02.323819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:02.323823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:02.323828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:02.323847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:02.323859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.323861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:02.324011Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:02.377669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894854995542517:3696]
2025-09-30T14:51:02.377978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 270, pipe: [1:7555894854995542517:3696]
2025-09-30T14:51:02.436590Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:02.436915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894854995542517:3696], now have 1 active actors on pipe
2025-09-30T14:51:02.437171Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:02.437168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894854995542517:3696]
2025-09-30T14:51:02.437176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:02.437206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:02.437209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:02.437273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 271 reason: error at write: Disconnected sessionId: src_id|9a93f94f-597f528a-a0f7cc53-457390c_0
2025-09-30T14:51:02.437503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 271 sessionId: src_id|9a93f94f-597f528a-a0f7cc53-457390c_0 is DEAD
2025-09-30T14:51:02.437645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a93f94f-597f528a-a0f7cc53-457390c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:02.437656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a93f94f-597f528a-a0f7cc53-457390c_0] Write session will restart in 0.005878s
2025-09-30T14:51:02.437679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a93f94f-597f528a-a0f7cc53-457390c_0] Write session: Do CDS request
2025-09-30T14:51:02.437685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a93f94f-597f528a-a0f7cc53-457390c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:02.444916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a93f94f-597f528a-a0f7cc53-457390c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:02.445008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:02.445030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 272
2025-09-30T14:51:02.445244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 272 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:02.445278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 272 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:02.445290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=272 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:02.445294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:02.445905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 272 sessionId:  describe result for acl check
2025-09-30T14:51:02.445948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:02.445961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:02.445963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:02.445969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894854995542578:4091] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:02.446557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894854995542578:4091] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:02.447512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:02.448869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894854995542578:4091] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:02.449353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:02.449535Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:02.449547Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:02.449557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:02.449609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:02.449697Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894854905817956:3611]
2025-09-30T14:51:02.450408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:02.450780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:02.450839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:02.451211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:02.451297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:02.451303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:02.451304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:02.451305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:02.451306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:02.451308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:02.451309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:02.451310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:02.451312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:02.451313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:02.451314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.451316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.451317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.451318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:02.451319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:02.451326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:02.451336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:02.451341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:02.451345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:02.451350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:02.451355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:02.451359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:02.451363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:02.451367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:02.451372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:02.451376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.451379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.451383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.451387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:02.451396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:02.451404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:02.451416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:02.451422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:02.451427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:02.451432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:02.451441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:02.451449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:02.451454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:02.451463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:02.451468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:02.451472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:02.451477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:02.451482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:02.451487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:02.451499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:02.451504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:02.451509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:02.451514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:02.451529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:02.451539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:02.451544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.451548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.451557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.451562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.451568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.451577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.451581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:02.451590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:02.451599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:02.451604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:02.451596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894854995542578:4091] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:02.451613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894854995542578:4091] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:02.451618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894854995542578:4091] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:02.451649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:02.451626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 272 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:02.457395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:02.458464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:02.458481Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:02.458484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:02.458489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:02.458496Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 271 [2:7555894854905817956:3611]
2025-09-30T14:51:02.458513Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:02.458530Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:02.458533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.458539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.458542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.458558Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:02.458572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:02.458580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:02.458664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.458673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.458676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.458679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:02.458682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:02.458760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:02.458768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.458784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.458795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.458818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:02.458842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894854995542618:4091], now have 1 active actors on pipe
2025-09-30T14:51:02.458846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894854995542518:2454], now have 1 active actors on pipe
2025-09-30T14:51:02.458853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894854905817950:3611]
2025-09-30T14:51:02.458861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894854905817950:3611]
2025-09-30T14:51:02.458865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894854905817950:3611]
2025-09-30T14:51:02.458878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:02.458897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:02.458905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:02.458911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:02.458914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:02.458918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:02.458920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:02.458911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 271
2025-09-30T14:51:02.458918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 271
2025-09-30T14:51:02.458954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894854905817950:3611]
2025-09-30T14:51:02.458966Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:02.458973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:02.459085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:02.459096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:02.459119Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1cf94d64-dda611ce-c33fb7a6-4cfb3fc1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:02.459133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.459136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.459138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:02.459148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.459158Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:02.459179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:02.459393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:02.459403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:02.459417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:02.459501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 272 partition: 0 MaxSeqNo: 42 sessionId: src_id|1cf94d64-dda611ce-c33fb7a6-4cfb3fc1_0
2025-09-30T14:51:02.459940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a93f94f-597f528a-a0f7cc53-457390c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1cf94d64-dda611ce-c33fb7a6-4cfb3fc1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:02.462936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cf94d64-dda611ce-c33fb7a6-4cfb3fc1_0] Write session: try to update token
2025-09-30T14:51:02.462956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cf94d64-dda611ce-c33fb7a6-4cfb3fc1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:02.471510Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:02.471529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:02.471532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:02.471534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:02.471543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894854905817950:3611]
2025-09-30T14:51:02.471548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894854905817950:3611]
2025-09-30T14:51:02.471552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894854905817950:3611]
2025-09-30T14:51:02.471591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:02.471599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.471601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:02.471606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:02.471613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:02.471621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:02.471774Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:02.478456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 272 sessionId: src_id|1cf94d64-dda611ce-c33fb7a6-4cfb3fc1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:02.481705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:02.537420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894854995542628:3696]
2025-09-30T14:51:02.537716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 271, pipe: [1:7555894854995542628:3696]
2025-09-30T14:51:02.590932Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:02.591338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:02.591356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:02.591378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894854995542628:3696], now have 1 active actors on pipe
2025-09-30T14:51:02.591595Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:02.591667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:02.591667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894854995542628:3696]
2025-09-30T14:51:02.591684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:02.591689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:02.591753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 272 reason: error at write: Disconnected sessionId: src_id|1cf94d64-dda611ce-c33fb7a6-4cfb3fc1_0
2025-09-30T14:51:02.591961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 272 sessionId: src_id|1cf94d64-dda611ce-c33fb7a6-4cfb3fc1_0 is DEAD
2025-09-30T14:51:02.592148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cf94d64-dda611ce-c33fb7a6-4cfb3fc1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:02.592160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cf94d64-dda611ce-c33fb7a6-4cfb3fc1_0] Write session will restart in 0.005152s
2025-09-30T14:51:02.592184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cf94d64-dda611ce-c33fb7a6-4cfb3fc1_0] Write session: Do CDS request
2025-09-30T14:51:02.592192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cf94d64-dda611ce-c33fb7a6-4cfb3fc1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:02.598808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cf94d64-dda611ce-c33fb7a6-4cfb3fc1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:02.598939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:02.598955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 273
2025-09-30T14:51:02.599072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 273 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:02.599103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 273 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:02.599113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=273 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:02.599117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:02.599761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 273 sessionId:  describe result for acl check
2025-09-30T14:51:02.599801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:02.599803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:02.599805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:02.599810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894854995542672:4095] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:02.600353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894854995542672:4095] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:02.601842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:02.602132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894854995542672:4095] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:02.603701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:02.603897Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:02.603907Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:02.603919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:02.603972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:02.604010Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894854905818059:3614]
2025-09-30T14:51:02.604559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894854995542672:4095] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:02.604574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894854995542672:4095] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:02.604578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894854995542672:4095] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:02.604585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 273 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:02.604679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:02.604920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:02.604971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:02.605301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:02.605370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:02.605377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:02.605378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:02.605379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:02.605381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:02.605382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:02.605384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:02.605385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:02.605386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:02.605387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:02.605389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.605390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.605391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.605392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:02.605394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:02.605399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:02.605411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:02.605415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:02.605420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:02.605424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:02.605428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:02.605438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:02.605442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:02.605451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:02.605455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:02.605464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.605468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.605472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.605481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:02.605487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:02.605493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:02.605507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:02.605517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:02.605523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:02.605530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:02.605535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:02.605539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:02.605545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:02.605555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:02.605561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:02.605569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:02.605575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:02.605585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:02.605591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:02.605599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:02.605604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:02.605609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:02.605619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:02.605624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:02.605633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:02.605639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.605648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.605653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.605663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.605668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.605677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.605682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:02.605688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:02.605693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:02.605700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:02.605750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:02.611298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:02.612230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:02.612249Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:02.612252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:02.612257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:02.612263Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 272 [2:7555894854905818059:3614]
2025-09-30T14:51:02.612281Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:02.612297Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:02.612308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.612312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.612315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.612332Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:02.612339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:02.612346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:02.612413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.612422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.612425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.612429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:02.612431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:02.612499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:02.612508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.612522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.612535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.612558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:02.612584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894854995542726:4095], now have 1 active actors on pipe
2025-09-30T14:51:02.612593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894854995542629:2454], now have 1 active actors on pipe
2025-09-30T14:51:02.612601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894854905818053:3614]
2025-09-30T14:51:02.612608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894854905818053:3614]
2025-09-30T14:51:02.612610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894854905818053:3614]
2025-09-30T14:51:02.612625Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:02.612642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:02.612643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:02.612651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:02.612653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:02.612659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:02.612663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:02.612698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894854905818053:3614]
2025-09-30T14:51:02.612675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 272
2025-09-30T14:51:02.612704Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:02.612676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 272
2025-09-30T14:51:02.612706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:02.612731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:02.612736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:02.612773Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1549155-30582a1b-3cb3aaca-e6d5edfa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:02.612786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.612790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.612792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:02.612803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.612818Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:02.612843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:02.612980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:02.612991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:02.613006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:02.613086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 273 partition: 0 MaxSeqNo: 42 sessionId: src_id|a1549155-30582a1b-3cb3aaca-e6d5edfa_0
2025-09-30T14:51:02.613511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cf94d64-dda611ce-c33fb7a6-4cfb3fc1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a1549155-30582a1b-3cb3aaca-e6d5edfa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:02.616426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1549155-30582a1b-3cb3aaca-e6d5edfa_0] Write session: try to update token
2025-09-30T14:51:02.616450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1549155-30582a1b-3cb3aaca-e6d5edfa_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:02.625019Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:02.625040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:02.625043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:02.625046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:02.625056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894854905818053:3614]
2025-09-30T14:51:02.625061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894854905818053:3614]
2025-09-30T14:51:02.625069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894854905818053:3614]
2025-09-30T14:51:02.625112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:02.625118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.625118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:02.625124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:02.625124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:02.625127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:02.625264Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:02.633285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 273 sessionId: src_id|a1549155-30582a1b-3cb3aaca-e6d5edfa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:02.636061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:02.692046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894854995542738:3696]
2025-09-30T14:51:02.692385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 272, pipe: [1:7555894854995542738:3696]
2025-09-30T14:51:02.738513Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:02.738922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:02.738943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:02.738966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894854995542738:3696], now have 1 active actors on pipe
2025-09-30T14:51:02.739277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:02.739295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:02.739310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894854995542738:3696]
2025-09-30T14:51:02.739344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:02.739360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 273 reason: error at write: Disconnected sessionId: src_id|a1549155-30582a1b-3cb3aaca-e6d5edfa_0
2025-09-30T14:51:02.739421Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:02.739611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 273 sessionId: src_id|a1549155-30582a1b-3cb3aaca-e6d5edfa_0 is DEAD
2025-09-30T14:51:02.739732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1549155-30582a1b-3cb3aaca-e6d5edfa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:02.739742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1549155-30582a1b-3cb3aaca-e6d5edfa_0] Write session will restart in 0.005951s
2025-09-30T14:51:02.739765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1549155-30582a1b-3cb3aaca-e6d5edfa_0] Write session: Do CDS request
2025-09-30T14:51:02.739770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1549155-30582a1b-3cb3aaca-e6d5edfa_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:02.746896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1549155-30582a1b-3cb3aaca-e6d5edfa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:02.746971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:02.746990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 274
2025-09-30T14:51:02.747130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 274 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:02.747174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 274 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:02.747184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=274 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:02.747189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:02.747698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 274 sessionId:  describe result for acl check
2025-09-30T14:51:02.747747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:02.747750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:02.747751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:02.747758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894854995542800:4099] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:02.748365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894854995542800:4099] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:02.748496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:02.750213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:02.750386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894854995542800:4099] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:02.750460Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:02.750472Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:02.750485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:02.750558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:02.750612Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894854905818172:3617]
2025-09-30T14:51:02.751238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:02.751617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:02.751676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:02.751977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:02.752024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:02.752029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:02.752029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:02.752030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:02.752031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:02.752032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:02.752032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:02.752033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:02.752034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:02.752034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:02.752036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.752036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.752037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.752038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:02.752039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:02.752042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:02.752049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:02.752051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:02.752054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:02.752057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:02.752059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:02.752061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:02.752064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:02.752066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:02.752070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:02.752072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.752075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.752077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.752079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:02.752081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:02.752087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:02.752094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:02.752098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:02.752102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:02.752104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:02.752108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:02.752110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:02.752113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:02.752117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:02.752123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:02.752128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:02.752132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:02.752140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:02.752145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:02.752149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:02.752154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:02.752158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:02.752163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:02.752167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:02.752172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:02.752177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.752181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.752183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.752187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.752189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.752192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.752195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:02.752197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:02.752200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:02.752203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:02.752226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:02.755101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894854995542800:4099] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:02.755123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894854995542800:4099] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:02.755127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894854995542800:4099] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:02.755136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 274 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:02.757695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:02.758576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:02.758605Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:02.758608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:02.758613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:02.758620Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 273 [2:7555894854905818172:3617]
2025-09-30T14:51:02.758636Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:02.758652Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:02.758656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.758659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.758662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.758677Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:02.758685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:02.758692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:02.758756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.758764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.758767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.758770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:02.758773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:02.758870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:02.758879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.758894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.758907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.758932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:02.758955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894854995542841:4099], now have 1 active actors on pipe
2025-09-30T14:51:02.758963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894854995542739:2454], now have 1 active actors on pipe
2025-09-30T14:51:02.758969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894854905818167:3617]
2025-09-30T14:51:02.758976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894854905818167:3617]
2025-09-30T14:51:02.758978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894854905818167:3617]
2025-09-30T14:51:02.758994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:02.759013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:02.759012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:02.759017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:02.759019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:02.759032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:02.759035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:02.759026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 273
2025-09-30T14:51:02.759069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894854905818167:3617]
2025-09-30T14:51:02.759080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:02.759028Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 273
2025-09-30T14:51:02.759087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:02.759096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:02.759106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:02.759154Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f423abd-908aaf37-15645fc-ab67c7a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:02.759165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.759168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.759171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:02.759180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.759189Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:02.759212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:02.759448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:02.759458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:02.759472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:02.759583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 274 partition: 0 MaxSeqNo: 42 sessionId: src_id|2f423abd-908aaf37-15645fc-ab67c7a0_0
2025-09-30T14:51:02.759989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1549155-30582a1b-3cb3aaca-e6d5edfa_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2f423abd-908aaf37-15645fc-ab67c7a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:02.762758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f423abd-908aaf37-15645fc-ab67c7a0_0] Write session: try to update token
2025-09-30T14:51:02.762776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f423abd-908aaf37-15645fc-ab67c7a0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:02.771639Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:02.771663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:02.771666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:02.771669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:02.771679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894854905818167:3617]
2025-09-30T14:51:02.771684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894854905818167:3617]
2025-09-30T14:51:02.771689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894854905818167:3617]
2025-09-30T14:51:02.771736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:02.771744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.771750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:02.771756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:02.771757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:02.771761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:02.771923Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:02.778475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 274 sessionId: src_id|2f423abd-908aaf37-15645fc-ab67c7a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:02.781322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:02.839507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894854995542861:3696]
2025-09-30T14:51:02.839833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 273, pipe: [1:7555894854995542861:3696]
2025-09-30T14:51:02.887991Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:02.888437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:02.888456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:02.888475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894854995542861:3696], now have 1 active actors on pipe
2025-09-30T14:51:02.888695Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:02.888764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:02.888766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894854995542861:3696]
2025-09-30T14:51:02.888783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:02.888788Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:02.888843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 274 reason: error at write: Disconnected sessionId: src_id|2f423abd-908aaf37-15645fc-ab67c7a0_0
2025-09-30T14:51:02.889062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 274 sessionId: src_id|2f423abd-908aaf37-15645fc-ab67c7a0_0 is DEAD
2025-09-30T14:51:02.889205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f423abd-908aaf37-15645fc-ab67c7a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:02.889216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f423abd-908aaf37-15645fc-ab67c7a0_0] Write session will restart in 0.005125s
2025-09-30T14:51:02.889249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f423abd-908aaf37-15645fc-ab67c7a0_0] Write session: Do CDS request
2025-09-30T14:51:02.889257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f423abd-908aaf37-15645fc-ab67c7a0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:02.895787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f423abd-908aaf37-15645fc-ab67c7a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:02.895936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:02.895955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 275
2025-09-30T14:51:02.896115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 275 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:02.896152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 275 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:02.896167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=275 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:02.896172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:02.896657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 275 sessionId:  describe result for acl check
2025-09-30T14:51:02.896697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:02.896704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:02.896706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:02.896712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894854995542923:4104] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:02.897207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894854995542923:4104] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:02.897905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:02.899173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894854995542923:4104] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:02.899726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:02.899922Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:02.899933Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:02.899944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:02.899996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:02.900035Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894854905818273:3619]
2025-09-30T14:51:02.900700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:02.900945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:02.900993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:02.901323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:02.901387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:02.901394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:02.901396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:02.901397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:02.901399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:02.901400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:02.901402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:02.901403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:02.901404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:02.901406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:02.901408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.901409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.901410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.901411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:02.901413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:02.901418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:02.901429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:02.901434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:02.901438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:02.901442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:02.901447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:02.901451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:02.901456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:02.901461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:02.901466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:02.901470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.901474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.901478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.901483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:02.901487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:02.901495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:02.901502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:02.901509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:02.901515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:02.901523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:02.901529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:02.901539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:02.901544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:02.901549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:02.901555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:02.901565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:02.901571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:02.901580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:02.901586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:02.901596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:02.901602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:02.901612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:02.901618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:02.901627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:02.901633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:02.901642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.901626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894854995542923:4104] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:02.901649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.901642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894854995542923:4104] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:02.901658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.901645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894854995542923:4104] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:02.901663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.901652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 275 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:02.901669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.901679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.901684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:02.901694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:02.901700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:02.901710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:02.901758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:02.907381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:02.908294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:02.908311Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:02.908315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:02.908319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:02.908329Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 274 [2:7555894854905818273:3619]
2025-09-30T14:51:02.908347Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:02.908364Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:02.908373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.908379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.908382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.908399Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:02.908410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:02.908417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:02.908483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.908492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.908494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.908498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:02.908500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:02.908570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:02.908579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.908592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:02.908611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:02.908635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:02.908659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894854995542963:4104], now have 1 active actors on pipe
2025-09-30T14:51:02.908668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894854995542862:2454], now have 1 active actors on pipe
2025-09-30T14:51:02.908675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894854905818268:3619]
2025-09-30T14:51:02.908682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894854905818268:3619]
2025-09-30T14:51:02.908684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894854905818268:3619]
2025-09-30T14:51:02.908699Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:02.908714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:02.908717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:02.908724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:02.908726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:02.908734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:02.908738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:02.908745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 274
2025-09-30T14:51:02.908753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 274
2025-09-30T14:51:02.908769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894854905818268:3619]
2025-09-30T14:51:02.908782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:02.908805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:02.908817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:02.908822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:02.908859Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fed4d8a7-93c5930f-abd8a917-b403e201_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:02.908875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.908879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.908881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:02.908891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.908905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:02.908924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:02.909121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:02.909131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:02.909148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:02.909250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 275 partition: 0 MaxSeqNo: 42 sessionId: src_id|fed4d8a7-93c5930f-abd8a917-b403e201_0
2025-09-30T14:51:02.909606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f423abd-908aaf37-15645fc-ab67c7a0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fed4d8a7-93c5930f-abd8a917-b403e201_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:02.912347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fed4d8a7-93c5930f-abd8a917-b403e201_0] Write session: try to update token
2025-09-30T14:51:02.912365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fed4d8a7-93c5930f-abd8a917-b403e201_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:02.921270Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:02.921287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:02.921290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:02.921292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:02.921301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894854905818268:3619]
2025-09-30T14:51:02.921305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894854905818268:3619]
2025-09-30T14:51:02.921309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894854905818268:3619]
2025-09-30T14:51:02.921342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:02.921342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:02.921349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:02.921350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:02.921352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:02.921352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:02.921508Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:02.928067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 275 sessionId: src_id|fed4d8a7-93c5930f-abd8a917-b403e201_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:02.930985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:02.989003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894854995543004:3696]
2025-09-30T14:51:02.989283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 274, pipe: [1:7555894854995543004:3696]
2025-09-30T14:51:03.037896Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:03.038458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:03.038478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:03.038499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894854995543004:3696], now have 1 active actors on pipe
2025-09-30T14:51:03.038735Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:03.039240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:03.039346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 275 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fed4d8a7-93c5930f-abd8a917-b403e201_0
2025-09-30T14:51:03.039357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:03.039399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894854995543004:3696]
2025-09-30T14:51:03.039562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 275 sessionId: src_id|fed4d8a7-93c5930f-abd8a917-b403e201_0 is DEAD
2025-09-30T14:51:03.039759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fed4d8a7-93c5930f-abd8a917-b403e201_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:03.039770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fed4d8a7-93c5930f-abd8a917-b403e201_0] Write session will restart in 0.009989s
2025-09-30T14:51:03.039794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fed4d8a7-93c5930f-abd8a917-b403e201_0] Write session: Do CDS request
2025-09-30T14:51:03.039800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fed4d8a7-93c5930f-abd8a917-b403e201_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:03.049272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:03.050854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fed4d8a7-93c5930f-abd8a917-b403e201_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:03.050938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:03.050958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 276
2025-09-30T14:51:03.051104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 276 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:03.051140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:03.051146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 276 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:03.051158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=276 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:03.051163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:03.051372Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:03.051382Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:03.051393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:03.051445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:03.051500Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894859200785712:3634]
2025-09-30T14:51:03.051626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 276 sessionId:  describe result for acl check
2025-09-30T14:51:03.051662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:03.051672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:03.051676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:03.051682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894859290510373:4119] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:03.052158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:03.052216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894859290510373:4119] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:03.052499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:03.052578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:03.052954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:03.053055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:03.053063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:03.053064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:03.053066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:03.053067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:03.053068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:03.053069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:03.053071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:03.053072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:03.053073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:03.053074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.053075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.053076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.053078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:03.053079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:03.053086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:03.053097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:03.053102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:03.053106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:03.053110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:03.053115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:03.053119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:03.053123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:03.053126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:03.053131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:03.053135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.053138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.053142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.053145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:03.053149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:03.053157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:03.053166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:03.053172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:03.053178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:03.053183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:03.053189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:03.053194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:03.053200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:03.053205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:03.053211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:03.053215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:03.053221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:03.053226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:03.053232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:03.053237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:03.053242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:03.053260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:03.053271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:03.053276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:03.053287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:03.053292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.053302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.053307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.053312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.053322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.053327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.053336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:03.053341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:03.053347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:03.053353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:03.053411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:03.054343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894859290510373:4119] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:03.059031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894859290510373:4119] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:03.059052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894859290510373:4119] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:03.059056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894859290510373:4119] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:03.059066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 276 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:03.059223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:03.060474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:03.060496Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:03.060498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:03.060502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:03.060511Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 275 [2:7555894859200785712:3634]
2025-09-30T14:51:03.060531Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:03.060548Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:03.060551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.060555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.060557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.060579Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:03.060587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:03.060596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:03.060669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.060678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.060681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.060685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:03.060688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:03.060767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:03.060775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.060790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.060808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.060828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:03.060853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894859290510307:2454], now have 1 active actors on pipe
2025-09-30T14:51:03.060861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894859290510411:4119], now have 1 active actors on pipe
2025-09-30T14:51:03.060869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894859200785706:3634]
2025-09-30T14:51:03.060877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894859200785706:3634]
2025-09-30T14:51:03.060880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894859200785706:3634]
2025-09-30T14:51:03.060895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:03.060916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:03.060921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:03.060932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:03.060933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:03.060935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:03.060936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:03.060931Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 275
2025-09-30T14:51:03.060958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 275
2025-09-30T14:51:03.060975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894859200785706:3634]
2025-09-30T14:51:03.060986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:03.060986Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:03.061009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:03.061019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:03.061070Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e24290e-1a7db306-791a1a21-38af920f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:03.061081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.061086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.061093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:03.061103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.061111Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:03.061138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:03.061360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:03.061367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:03.061381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:03.061469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 276 partition: 0 MaxSeqNo: 42 sessionId: src_id|5e24290e-1a7db306-791a1a21-38af920f_0
2025-09-30T14:51:03.061930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fed4d8a7-93c5930f-abd8a917-b403e201_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5e24290e-1a7db306-791a1a21-38af920f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:03.065092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e24290e-1a7db306-791a1a21-38af920f_0] Write session: try to update token
2025-09-30T14:51:03.065118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e24290e-1a7db306-791a1a21-38af920f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:03.074221Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:03.074253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:03.074257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:03.074259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:03.074271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894859200785706:3634]
2025-09-30T14:51:03.074276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894859200785706:3634]
2025-09-30T14:51:03.074281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894859200785706:3634]
2025-09-30T14:51:03.074325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:03.074340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.074343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:03.074349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:03.074356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:03.074360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:03.074545Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:03.082494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 276 sessionId: src_id|5e24290e-1a7db306-791a1a21-38af920f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:03.085265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:03.139527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894859290510419:3696]
2025-09-30T14:51:03.139844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 275, pipe: [1:7555894859290510419:3696]
2025-09-30T14:51:03.187703Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:03.188233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:03.188254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:03.188276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894859290510419:3696], now have 1 active actors on pipe
2025-09-30T14:51:03.188541Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:03.188557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:03.188562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:03.188607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894859290510419:3696]
2025-09-30T14:51:03.188627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 276 reason: error at write: Disconnected sessionId: src_id|5e24290e-1a7db306-791a1a21-38af920f_0
2025-09-30T14:51:03.188876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 276 sessionId: src_id|5e24290e-1a7db306-791a1a21-38af920f_0 is DEAD
2025-09-30T14:51:03.188845Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:03.189039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e24290e-1a7db306-791a1a21-38af920f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:03.189049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e24290e-1a7db306-791a1a21-38af920f_0] Write session will restart in 0.007628s
2025-09-30T14:51:03.189070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e24290e-1a7db306-791a1a21-38af920f_0] Write session: Do CDS request
2025-09-30T14:51:03.189076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e24290e-1a7db306-791a1a21-38af920f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:03.197602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:03.197873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e24290e-1a7db306-791a1a21-38af920f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:03.198022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:03.198041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 277
2025-09-30T14:51:03.198158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 277 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:03.198190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 277 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:03.198201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=277 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:03.198205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:03.198708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 277 sessionId:  describe result for acl check
2025-09-30T14:51:03.198745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:03.198751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:03.198755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:03.198762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894859290510486:4123] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:03.199318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894859290510486:4123] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:03.199713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:03.199903Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:03.199913Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:03.199924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:03.199970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:03.200032Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894859200785816:3636]
2025-09-30T14:51:03.200616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:03.201011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:03.201080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:03.201242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894859290510486:4123] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:03.201453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:03.201533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:03.201540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:03.201541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:03.201542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:03.201544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:03.201545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:03.201546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:03.201548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:03.201549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:03.201550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:03.201551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.201552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.201553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.201554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:03.201555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:03.201561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:03.201582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:03.201586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:03.201590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:03.201595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:03.201599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:03.201603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:03.201607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:03.201611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:03.201616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:03.201619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.201623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.201627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.201631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:03.201635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:03.201644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:03.201664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:03.201674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:03.201680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:03.201686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:03.201691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:03.201695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:03.201701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:03.201707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:03.201712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:03.201716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:03.201722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:03.201727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:03.201732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:03.201737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:03.201742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:03.201747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:03.201758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:03.201763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:03.201768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:03.201779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.201785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.201794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.201799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.201805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.201814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.201819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:03.201824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:03.201832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:03.201838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:03.201894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:03.207116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894859290510486:4123] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:03.207137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894859290510486:4123] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:03.207141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894859290510486:4123] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:03.207151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 277 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:03.207429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:03.208401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:03.208415Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:03.208419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:03.208423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:03.208431Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 276 [2:7555894859200785816:3636]
2025-09-30T14:51:03.208446Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:03.208468Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:03.208471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.208474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.208477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.208492Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:03.208499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:03.208505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:03.208564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.208571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.208573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.208576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:03.208579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:03.208643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:03.208650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.208662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.208674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.208691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:03.208720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894859290510525:4123], now have 1 active actors on pipe
2025-09-30T14:51:03.208727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894859290510420:2454], now have 1 active actors on pipe
2025-09-30T14:51:03.208733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894859200785811:3636]
2025-09-30T14:51:03.208736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894859200785811:3636]
2025-09-30T14:51:03.208738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894859200785811:3636]
2025-09-30T14:51:03.208752Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:03.208767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:03.208772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:03.208776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:03.208778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:03.208779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:03.208782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:03.208782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 276
2025-09-30T14:51:03.208788Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 276
2025-09-30T14:51:03.208817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894859200785811:3636]
2025-09-30T14:51:03.208825Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:03.208828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:03.208840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:03.208849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:03.208900Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85db2ed9-e0cb3fae-47467ad9-3e367e64_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:03.208912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.208916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.208918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:03.208928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.208945Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:03.208969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:03.209123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:03.209130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:03.209143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:03.209236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 277 partition: 0 MaxSeqNo: 42 sessionId: src_id|85db2ed9-e0cb3fae-47467ad9-3e367e64_0
2025-09-30T14:51:03.209649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e24290e-1a7db306-791a1a21-38af920f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|85db2ed9-e0cb3fae-47467ad9-3e367e64_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:03.212495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85db2ed9-e0cb3fae-47467ad9-3e367e64_0] Write session: try to update token
2025-09-30T14:51:03.212517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85db2ed9-e0cb3fae-47467ad9-3e367e64_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:03.221025Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:03.221044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:03.221046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:03.221048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:03.221057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894859200785811:3636]
2025-09-30T14:51:03.221062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894859200785811:3636]
2025-09-30T14:51:03.221066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894859200785811:3636]
2025-09-30T14:51:03.221105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:03.221116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.221119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:03.221139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:03.221159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:03.221163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:03.221281Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:03.227952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 277 sessionId: src_id|85db2ed9-e0cb3fae-47467ad9-3e367e64_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:03.230966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:03.289047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894859290510532:3696]
2025-09-30T14:51:03.289368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 276, pipe: [1:7555894859290510532:3696]
2025-09-30T14:51:03.333900Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:03.334246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:03.334263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:03.334282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894859290510532:3696], now have 1 active actors on pipe
2025-09-30T14:51:03.334496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:03.334512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:03.334522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894859290510532:3696]
2025-09-30T14:51:03.334551Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:03.334554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:03.334566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 277 reason: error at write: Disconnected sessionId: src_id|85db2ed9-e0cb3fae-47467ad9-3e367e64_0
2025-09-30T14:51:03.334790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 277 sessionId: src_id|85db2ed9-e0cb3fae-47467ad9-3e367e64_0 is DEAD
2025-09-30T14:51:03.334929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85db2ed9-e0cb3fae-47467ad9-3e367e64_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:03.334940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85db2ed9-e0cb3fae-47467ad9-3e367e64_0] Write session will restart in 0.006150s
2025-09-30T14:51:03.334981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85db2ed9-e0cb3fae-47467ad9-3e367e64_0] Write session: Do CDS request
2025-09-30T14:51:03.334989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85db2ed9-e0cb3fae-47467ad9-3e367e64_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:03.342806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85db2ed9-e0cb3fae-47467ad9-3e367e64_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:03.342958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:03.342977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 278
2025-09-30T14:51:03.343084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 278 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:03.343125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 278 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:03.343135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=278 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:03.343139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:03.343645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 278 sessionId:  describe result for acl check
2025-09-30T14:51:03.343681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:03.343685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:03.343688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:03.343694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894859290510600:4127] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:03.343950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:03.344215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894859290510600:4127] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:03.345956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:03.346166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894859290510600:4127] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:03.346183Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:03.346194Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:03.346205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:03.346278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:03.346334Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894859200785922:3638]
2025-09-30T14:51:03.346975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:03.347276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:03.347318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:03.347595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:03.347639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:03.347643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:03.347644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:03.347645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:03.347646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:03.347646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:03.347647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:03.347648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:03.347648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:03.347649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:03.347650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.347650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.347651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.347652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:03.347653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:03.347656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:03.347662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:03.347665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:03.347667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:03.347669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:03.347672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:03.347674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:03.347676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:03.347679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:03.347681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:03.347683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.347685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.347687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.347690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:03.347692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:03.347698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:03.347703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:03.347707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:03.347710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:03.347713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:03.347716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:03.347719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:03.347722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:03.347724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:03.347727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:03.347730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:03.347733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:03.347735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:03.347739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:03.347742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:03.347745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:03.347747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:03.347750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:03.347753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:03.347756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:03.347759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.347762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.347764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.347767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.347770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.347773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.347776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:03.347779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:03.347782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:03.347785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:03.347807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:03.348572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894859290510600:4127] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:03.348587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894859290510600:4127] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:03.348590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894859290510600:4127] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:03.348598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 278 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:03.353116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:03.354016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:03.354030Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:03.354032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:03.354035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:03.354040Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 277 [2:7555894859200785922:3638]
2025-09-30T14:51:03.354051Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:03.354065Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:03.354066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.354068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.354070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.354082Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:03.354087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:03.354093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:03.354134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.354140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.354141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.354144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:03.354145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:03.354196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:03.354202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.354210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.354217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.354226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:03.354238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894859200785917:3638]
2025-09-30T14:51:03.354244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894859200785917:3638]
2025-09-30T14:51:03.354245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894859200785917:3638]
2025-09-30T14:51:03.354250Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:03.354262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:03.354270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:03.354271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:03.354275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:03.354276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:03.354279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:03.354305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894859290510639:4127], now have 1 active actors on pipe
2025-09-30T14:51:03.354312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894859290510534:2454], now have 1 active actors on pipe
2025-09-30T14:51:03.354314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894859200785917:3638]
2025-09-30T14:51:03.354320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:03.354347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:03.354394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 277
2025-09-30T14:51:03.354409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 277
2025-09-30T14:51:03.354451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:03.354457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:03.354479Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb36da72-8582cf5f-7e256089-782fd563_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:03.354487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.354490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.354491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:03.354497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.354504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:03.354519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:03.354695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:03.354707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:03.354726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:03.354807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 278 partition: 0 MaxSeqNo: 42 sessionId: src_id|bb36da72-8582cf5f-7e256089-782fd563_0
2025-09-30T14:51:03.355195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85db2ed9-e0cb3fae-47467ad9-3e367e64_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bb36da72-8582cf5f-7e256089-782fd563_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:03.358968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb36da72-8582cf5f-7e256089-782fd563_0] Write session: try to update token
2025-09-30T14:51:03.358997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb36da72-8582cf5f-7e256089-782fd563_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:03.366868Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:03.366885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:03.366888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:03.366890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:03.366899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894859200785917:3638]
2025-09-30T14:51:03.366905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894859200785917:3638]
2025-09-30T14:51:03.366910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894859200785917:3638]
2025-09-30T14:51:03.366952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:03.366964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.366966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:03.366967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:03.366974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:03.366977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:03.367118Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:03.374060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 278 sessionId: src_id|bb36da72-8582cf5f-7e256089-782fd563_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:03.376911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:03.434434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894859290510647:3696]
2025-09-30T14:51:03.434744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 277, pipe: [1:7555894859290510647:3696]
2025-09-30T14:51:03.470829Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:03.471109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:03.471121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:03.471138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894859290510647:3696], now have 1 active actors on pipe
2025-09-30T14:51:03.471370Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:03.471433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894859290510647:3696]
2025-09-30T14:51:03.471445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:03.471462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:03.471479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:03.471610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 278 reason: error at write: Disconnected sessionId: src_id|bb36da72-8582cf5f-7e256089-782fd563_0
2025-09-30T14:51:03.471833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 278 sessionId: src_id|bb36da72-8582cf5f-7e256089-782fd563_0 is DEAD
2025-09-30T14:51:03.472035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb36da72-8582cf5f-7e256089-782fd563_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:03.472051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb36da72-8582cf5f-7e256089-782fd563_0] Write session will restart in 0.008412s
2025-09-30T14:51:03.472079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb36da72-8582cf5f-7e256089-782fd563_0] Write session: Do CDS request
2025-09-30T14:51:03.472087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb36da72-8582cf5f-7e256089-782fd563_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:03.479494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:03.481353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:03.481523Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:03.481530Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:03.481538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:03.481573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:03.481601Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894859200786031:3641]
2025-09-30T14:51:03.481799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb36da72-8582cf5f-7e256089-782fd563_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:03.481984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:03.482000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 279
2025-09-30T14:51:03.482064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:03.482138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 279 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:03.482167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 279 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:03.482176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=279 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:03.482180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:03.482371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:03.482440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:03.482525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 279 sessionId:  describe result for acl check
2025-09-30T14:51:03.482549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:03.482554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:03.482555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:03.482561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894859290510721:4132] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:03.482803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:03.482865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:03.482870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:03.482872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:03.482873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:03.482874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:03.482875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:03.482876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:03.482878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:03.482879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:03.482880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:03.482881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.482882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.482883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.482884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:03.482886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:03.482891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:03.482902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:03.482906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:03.482910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:03.482914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:03.482918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:03.482922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:03.482935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:03.482939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:03.482944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:03.482948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.482952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.482960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.482964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:03.482968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:03.482975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:03.482983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:03.482989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:03.483000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:03.483005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:03.483015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:03.483020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:03.483025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:03.482988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894859290510721:4132] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:03.483034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:03.483040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:03.483045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:03.483049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:03.483054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:03.483058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:03.483062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:03.483067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:03.483071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:03.483075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:03.483080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:03.483084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:03.483089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.483096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.483100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.483110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.483114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.483119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.483128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:03.483133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:03.483139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:03.483148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:03.483192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:03.484818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894859290510721:4132] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:03.488037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894859290510721:4132] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:03.488056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894859290510721:4132] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:03.488063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894859290510721:4132] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:03.488072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 279 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:03.488488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:03.489608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:03.489621Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:03.489623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:03.489626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:03.489630Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 278 [2:7555894859200786031:3641]
2025-09-30T14:51:03.489642Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:03.489655Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:03.489658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.489660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.489663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.489679Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:03.489686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:03.489697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:03.489751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.489759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.489761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.489764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:03.489767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:03.489827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:03.489835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.489848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.489857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.489873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:03.489894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894859290510651:2454], now have 1 active actors on pipe
2025-09-30T14:51:03.489902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894859290510758:4132], now have 1 active actors on pipe
2025-09-30T14:51:03.489909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894859200786026:3641]
2025-09-30T14:51:03.489917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894859200786026:3641]
2025-09-30T14:51:03.489920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894859200786026:3641]
2025-09-30T14:51:03.489932Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:03.489941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:03.489944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:03.489945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:03.489950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:03.489965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:03.489971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:03.489943Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 278
2025-09-30T14:51:03.489950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 278
2025-09-30T14:51:03.490011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894859200786026:3641]
2025-09-30T14:51:03.490022Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:03.490029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:03.490036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:03.490041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:03.490088Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b131a3a-80c9842f-aa3f0c1-323431a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:03.490106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.490110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.490112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:03.490121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.490132Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:03.490155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:03.490350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:03.490366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:03.490389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:03.490481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 279 partition: 0 MaxSeqNo: 42 sessionId: src_id|5b131a3a-80c9842f-aa3f0c1-323431a7_0
2025-09-30T14:51:03.490894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb36da72-8582cf5f-7e256089-782fd563_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5b131a3a-80c9842f-aa3f0c1-323431a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:03.493691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b131a3a-80c9842f-aa3f0c1-323431a7_0] Write session: try to update token
2025-09-30T14:51:03.493709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b131a3a-80c9842f-aa3f0c1-323431a7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:03.502991Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:03.503009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:03.503011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:03.503013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:03.503023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894859200786026:3641]
2025-09-30T14:51:03.503029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894859200786026:3641]
2025-09-30T14:51:03.503033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894859200786026:3641]
2025-09-30T14:51:03.503073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:03.503088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.503089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:03.503096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:03.503107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:03.503114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:03.503263Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:03.508717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 279 sessionId: src_id|5b131a3a-80c9842f-aa3f0c1-323431a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:03.511816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:03.571651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894859290510769:3696]
2025-09-30T14:51:03.571952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 278, pipe: [1:7555894859290510769:3696]
2025-09-30T14:51:03.612529Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:03.612824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:03.612837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:03.612869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894859290510769:3696], now have 1 active actors on pipe
2025-09-30T14:51:03.613108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:03.613118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894859290510769:3696]
2025-09-30T14:51:03.613125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:03.613151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:03.613209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 279 reason: error at write: Disconnected sessionId: src_id|5b131a3a-80c9842f-aa3f0c1-323431a7_0
2025-09-30T14:51:03.613223Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:03.613448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 279 sessionId: src_id|5b131a3a-80c9842f-aa3f0c1-323431a7_0 is DEAD
2025-09-30T14:51:03.613568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b131a3a-80c9842f-aa3f0c1-323431a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:03.613580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b131a3a-80c9842f-aa3f0c1-323431a7_0] Write session will restart in 0.007884s
2025-09-30T14:51:03.613604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b131a3a-80c9842f-aa3f0c1-323431a7_0] Write session: Do CDS request
2025-09-30T14:51:03.613614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b131a3a-80c9842f-aa3f0c1-323431a7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:03.621681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:03.622796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b131a3a-80c9842f-aa3f0c1-323431a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:03.622938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:03.622956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 280
2025-09-30T14:51:03.623116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 280 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:03.623172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 280 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:03.623181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=280 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:03.623185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:03.623687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 280 sessionId:  describe result for acl check
2025-09-30T14:51:03.623731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:03.623741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:03.623744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:03.623750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894859290510840:4136] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:03.623839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:03.624034Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:03.624044Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:03.624054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:03.624107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:03.624145Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894859200786139:3643]
2025-09-30T14:51:03.624330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894859290510840:4136] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:03.624767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:03.625131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:03.625190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:03.625566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:03.625632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:03.625640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:03.625641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:03.625642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:03.625644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:03.625645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:03.625646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:03.625647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:03.625648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:03.625650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:03.625651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.625652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.625653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.625655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:03.625655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:03.625661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:03.625670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:03.625675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:03.625679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:03.625684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:03.625688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:03.625692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:03.625697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:03.625700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:03.625705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:03.625709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.625713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.625718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.625723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:03.625731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:03.625739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:03.625752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:03.625763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:03.625772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:03.625781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:03.625791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:03.625800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:03.625805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:03.625814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:03.625824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:03.625833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:03.625842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:03.625846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:03.625852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:03.625855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:03.625860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:03.625869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:03.625879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:03.625884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:03.625893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:03.625903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.625908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.625913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.625918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.625923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.625932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.625940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:03.625946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:03.625955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:03.625964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:03.626010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:03.626113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894859290510840:4136] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:03.631329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894859290510840:4136] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:03.631355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894859290510840:4136] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:03.631359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894859290510840:4136] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:03.631369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 280 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:03.631724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:03.632954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:03.632977Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:03.632980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:03.632985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:03.632992Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 279 [2:7555894859200786139:3643]
2025-09-30T14:51:03.633011Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:03.633036Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:03.633042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.633045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.633048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.633066Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:03.633079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:03.633086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:03.633155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.633164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.633166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.633170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:03.633173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:03.633249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:03.633257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.633272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.633285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.633305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:03.633332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894859290510880:4136], now have 1 active actors on pipe
2025-09-30T14:51:03.633336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894859290510770:2454], now have 1 active actors on pipe
2025-09-30T14:51:03.633341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894859200786134:3643]
2025-09-30T14:51:03.633344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894859200786134:3643]
2025-09-30T14:51:03.633347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894859200786134:3643]
2025-09-30T14:51:03.633360Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:03.633378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:03.633383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:03.633386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:03.633388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:03.633397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:03.633400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:03.633391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 279
2025-09-30T14:51:03.633437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894859200786134:3643]
2025-09-30T14:51:03.633446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:03.633448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 279
2025-09-30T14:51:03.633458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:03.633462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:03.633466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:03.633516Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d541ddec-2a065ae8-f5ffad94-12a1d2d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:03.633532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.633537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.633538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:03.633549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.633560Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:03.633588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:03.633783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:03.633793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:03.633807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:03.633893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 280 partition: 0 MaxSeqNo: 42 sessionId: src_id|d541ddec-2a065ae8-f5ffad94-12a1d2d8_0
2025-09-30T14:51:03.634354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b131a3a-80c9842f-aa3f0c1-323431a7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d541ddec-2a065ae8-f5ffad94-12a1d2d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:03.637412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d541ddec-2a065ae8-f5ffad94-12a1d2d8_0] Write session: try to update token
2025-09-30T14:51:03.637432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d541ddec-2a065ae8-f5ffad94-12a1d2d8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:03.646074Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:03.646093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:03.646096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:03.646098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:03.646109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894859200786134:3643]
2025-09-30T14:51:03.646113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894859200786134:3643]
2025-09-30T14:51:03.646118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894859200786134:3643]
2025-09-30T14:51:03.646164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:03.646168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:03.646174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.646175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:03.646177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:03.646179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:03.646328Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:03.652754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 280 sessionId: src_id|d541ddec-2a065ae8-f5ffad94-12a1d2d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:03.655506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:03.713442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894859290510887:3696]
2025-09-30T14:51:03.713773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 279, pipe: [1:7555894859290510887:3696]
2025-09-30T14:51:03.759310Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:03.759724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:03.759739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:03.759759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894859290510887:3696], now have 1 active actors on pipe
2025-09-30T14:51:03.759994Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:03.759987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:03.760015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:03.760018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894859290510887:3696]
2025-09-30T14:51:03.760047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:03.760076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 280 reason: error at write: Disconnected sessionId: src_id|d541ddec-2a065ae8-f5ffad94-12a1d2d8_0
2025-09-30T14:51:03.760240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 280 sessionId: src_id|d541ddec-2a065ae8-f5ffad94-12a1d2d8_0 is DEAD
2025-09-30T14:51:03.760418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d541ddec-2a065ae8-f5ffad94-12a1d2d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:03.760428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d541ddec-2a065ae8-f5ffad94-12a1d2d8_0] Write session will restart in 0.006232s
2025-09-30T14:51:03.760453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d541ddec-2a065ae8-f5ffad94-12a1d2d8_0] Write session: Do CDS request
2025-09-30T14:51:03.760458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d541ddec-2a065ae8-f5ffad94-12a1d2d8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:03.767785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d541ddec-2a065ae8-f5ffad94-12a1d2d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:03.767902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:03.767921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 281
2025-09-30T14:51:03.768047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 281 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:03.768079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 281 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:03.768088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=281 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:03.768092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:03.768619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 281 sessionId:  describe result for acl check
2025-09-30T14:51:03.768661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:03.768667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:03.768673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:03.768680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894859290510922:4140] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:03.769331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894859290510922:4140] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:03.771000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:03.771294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894859290510922:4140] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:03.774305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:03.774509Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:03.774521Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:03.774532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:03.774600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:03.774637Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894859200786261:3646]
2025-09-30T14:51:03.774778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894859290510922:4140] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:03.774795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894859290510922:4140] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:03.774799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894859290510922:4140] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:03.774809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 281 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:03.775118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:03.775514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:03.775556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:03.775806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:03.775854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:03.775861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:03.775862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:03.775863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:03.775864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:03.775865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:03.775865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:03.775866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:03.775867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:03.775868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:03.775869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.775870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.775871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.775871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:03.775872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:03.775876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:03.775884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:03.775886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:03.775889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:03.775891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:03.775893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:03.775896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:03.775898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:03.775901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:03.775903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:03.775906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.775908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.775911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.775913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:03.775915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:03.775921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:03.775926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:03.775930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:03.775934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:03.775937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:03.775940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:03.775943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:03.775947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:03.775949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:03.775952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:03.775955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:03.775958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:03.775961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:03.775964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:03.775967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:03.775970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:03.775973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:03.775976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:03.775979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:03.775983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:03.775985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.775988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.775991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.775995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.775998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.776001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.776004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:03.776007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:03.776009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:03.776012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:03.776037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:03.783108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:03.784080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:03.784099Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:03.784101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:03.784106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:03.784113Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 280 [2:7555894859200786261:3646]
2025-09-30T14:51:03.784125Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:03.784139Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:03.784141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.784143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.784145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.784157Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:03.784164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:03.784169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:03.784213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.784219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.784221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.784223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:03.784225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:03.784284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:03.784293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.784303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.784310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.784320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:03.784337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894859200786255:3646]
2025-09-30T14:51:03.784345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894859200786255:3646]
2025-09-30T14:51:03.784347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894859200786255:3646]
2025-09-30T14:51:03.784360Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:03.784368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:03.784372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:03.784375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:03.784376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:03.784385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:03.784387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:03.784398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894859290510993:4140], now have 1 active actors on pipe
2025-09-30T14:51:03.784401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894859290510888:2454], now have 1 active actors on pipe
2025-09-30T14:51:03.784433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894859200786255:3646]
2025-09-30T14:51:03.784445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:03.784451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:03.784483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 280
2025-09-30T14:51:03.784484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 280
2025-09-30T14:51:03.784544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:03.784553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:03.784579Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d402f15a-3b99b516-c6283e97-13d1f450_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:03.784590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.784594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.784596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:03.784605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.784613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:03.784630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:03.784798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:03.784808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:03.784824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:03.784935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 281 partition: 0 MaxSeqNo: 42 sessionId: src_id|d402f15a-3b99b516-c6283e97-13d1f450_0
2025-09-30T14:51:03.785352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d541ddec-2a065ae8-f5ffad94-12a1d2d8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d402f15a-3b99b516-c6283e97-13d1f450_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:03.788435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d402f15a-3b99b516-c6283e97-13d1f450_0] Write session: try to update token
2025-09-30T14:51:03.788456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d402f15a-3b99b516-c6283e97-13d1f450_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:03.799352Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:03.799377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:03.799381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:03.799385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:03.799398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894859200786255:3646]
2025-09-30T14:51:03.799405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894859200786255:3646]
2025-09-30T14:51:03.799411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894859200786255:3646]
2025-09-30T14:51:03.799467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:03.799468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:03.799475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:03.799480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:03.799491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.799495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:03.799779Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:03.803775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 281 sessionId: src_id|d402f15a-3b99b516-c6283e97-13d1f450_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:03.806789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:03.860418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894859290511017:3696]
2025-09-30T14:51:03.860720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 280, pipe: [1:7555894859290511017:3696]
2025-09-30T14:51:03.915098Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:03.915493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:03.915506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:03.915541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894859290511017:3696], now have 1 active actors on pipe
2025-09-30T14:51:03.915755Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:03.915792Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:03.915798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:03.915803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:03.915862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894859290511017:3696]
2025-09-30T14:51:03.915865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 281 reason: error at write: Disconnected sessionId: src_id|d402f15a-3b99b516-c6283e97-13d1f450_0
2025-09-30T14:51:03.916071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 281 sessionId: src_id|d402f15a-3b99b516-c6283e97-13d1f450_0 is DEAD
2025-09-30T14:51:03.916261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d402f15a-3b99b516-c6283e97-13d1f450_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:03.916272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d402f15a-3b99b516-c6283e97-13d1f450_0] Write session will restart in 0.005417s
2025-09-30T14:51:03.916296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d402f15a-3b99b516-c6283e97-13d1f450_0] Write session: Do CDS request
2025-09-30T14:51:03.916306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d402f15a-3b99b516-c6283e97-13d1f450_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:03.922854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d402f15a-3b99b516-c6283e97-13d1f450_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:03.922906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:03.922924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 282
2025-09-30T14:51:03.923110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 282 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:03.923153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 282 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:03.923163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=282 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:03.923168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:03.923658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 282 sessionId:  describe result for acl check
2025-09-30T14:51:03.923714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:03.923725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:03.923727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:03.923735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894859290511081:4145] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:03.924329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894859290511081:4145] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:03.925197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:03.926427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894859290511081:4145] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:03.927209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:03.927430Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:03.927439Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:03.927450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:03.927502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:03.927551Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894859200786370:3648]
2025-09-30T14:51:03.928214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:03.928479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:03.928516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:03.928846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:03.928913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:03.928922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:03.928923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:03.928924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:03.928926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:03.928927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:03.928928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:03.928929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:03.928930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:03.928931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:03.928932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.928933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.928934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.928935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:03.928937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:03.928942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:03.928953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:03.928957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:03.928961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:03.928965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:03.928970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:03.928974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:03.928978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:03.928981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:03.928986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:03.928989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.928993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.928997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.929000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:03.929004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:03.929012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:03.929020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:03.929027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:03.929033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:03.929038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:03.929043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:03.929048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:03.929053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:03.929058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:03.929063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:03.929068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:03.929073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:03.929078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:03.929084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:03.929088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:03.929094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:03.929099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:03.929105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:03.929109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:03.929115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:03.929120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.929126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.929132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.929137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.929143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.929148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.929153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:03.929158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:03.929162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:03.929167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:03.929215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:03.929226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894859290511081:4145] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:03.929243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894859290511081:4145] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:03.929247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894859290511081:4145] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:03.929256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 282 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:03.935009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:03.936071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:03.936091Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:03.936095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:03.936099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:03.936106Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 281 [2:7555894859200786370:3648]
2025-09-30T14:51:03.936124Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:03.936142Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:03.936151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.936155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.936157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.936174Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:03.936186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:03.936194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:03.936269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.936277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.936279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.936283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:03.936286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:03.936364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:03.936374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.936388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:03.936399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:03.936416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:03.936433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894859200786365:3648]
2025-09-30T14:51:03.936441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894859200786365:3648]
2025-09-30T14:51:03.936444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894859200786365:3648]
2025-09-30T14:51:03.936455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:03.936465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:03.936468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:03.936471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:03.936473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:03.936488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:03.936496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:03.936508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894859290511018:2454], now have 1 active actors on pipe
2025-09-30T14:51:03.936517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894859290511126:4145], now have 1 active actors on pipe
2025-09-30T14:51:03.936551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894859200786365:3648]
2025-09-30T14:51:03.936561Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:03.936561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 281
2025-09-30T14:51:03.936591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:03.936570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 281
2025-09-30T14:51:03.936605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:03.936611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:03.936641Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a92b4347-41182810-f99c48bd-84e42d23_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:03.936656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.936665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.936667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:03.936679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.936690Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:03.936710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:03.936929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:03.936940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:03.936960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:03.937051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 282 partition: 0 MaxSeqNo: 42 sessionId: src_id|a92b4347-41182810-f99c48bd-84e42d23_0
2025-09-30T14:51:03.937428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d402f15a-3b99b516-c6283e97-13d1f450_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a92b4347-41182810-f99c48bd-84e42d23_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:03.940372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a92b4347-41182810-f99c48bd-84e42d23_0] Write session: try to update token
2025-09-30T14:51:03.940393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a92b4347-41182810-f99c48bd-84e42d23_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:03.949198Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:03.949222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:03.949224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:03.949226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:03.949236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894859200786365:3648]
2025-09-30T14:51:03.949241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894859200786365:3648]
2025-09-30T14:51:03.949245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894859200786365:3648]
2025-09-30T14:51:03.949291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:03.949301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:03.949304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:03.949313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:03.949321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:03.949325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:03.949448Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:03.956601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 282 sessionId: src_id|a92b4347-41182810-f99c48bd-84e42d23_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:03.959694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:04.016033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894863585478465:3696]
2025-09-30T14:51:04.016279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 281, pipe: [1:7555894863585478465:3696]
2025-09-30T14:51:04.065299Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:04.065786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:04.065801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:04.065840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894863585478465:3696], now have 1 active actors on pipe
2025-09-30T14:51:04.066076Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:04.066224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894863585478465:3696]
2025-09-30T14:51:04.066255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:04.066255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:04.066345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 282 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a92b4347-41182810-f99c48bd-84e42d23_0
2025-09-30T14:51:04.066572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 282 sessionId: src_id|a92b4347-41182810-f99c48bd-84e42d23_0 is DEAD
2025-09-30T14:51:04.066741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a92b4347-41182810-f99c48bd-84e42d23_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:04.066749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a92b4347-41182810-f99c48bd-84e42d23_0] Write session will restart in 0.007071s
2025-09-30T14:51:04.066772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a92b4347-41182810-f99c48bd-84e42d23_0] Write session: Do CDS request
2025-09-30T14:51:04.066778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a92b4347-41182810-f99c48bd-84e42d23_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:04.074801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a92b4347-41182810-f99c48bd-84e42d23_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:04.075267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:04.075285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 283
2025-09-30T14:51:04.075405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 283 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:04.075435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 283 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:04.075446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=283 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:04.075450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:04.075928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 283 sessionId:  describe result for acl check
2025-09-30T14:51:04.075972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:04.075979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:04.075981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:04.075987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894863585478539:4158] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:04.076521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894863585478539:4158] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:04.076719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:04.078429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:04.078636Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:04.078645Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:04.078655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:04.078702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:04.078739Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894863495753814:3663]
2025-09-30T14:51:04.079019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894863585478539:4158] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:04.079378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:04.079626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:04.079671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:04.079975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:04.080032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:04.080037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:04.080038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:04.080039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:04.080039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:04.080040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:04.080041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:04.080042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:04.080042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:04.080043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:04.080044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.080044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.080045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.080046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:04.080046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:04.080050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:04.080058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:04.080062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:04.080066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:04.080070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:04.080073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:04.080078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:04.080081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:04.080085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:04.080088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:04.080092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.080096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.080099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.080103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:04.080106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:04.080113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:04.080120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:04.080125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:04.080131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:04.080135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:04.080140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:04.080143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:04.080146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:04.080149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:04.080151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:04.080154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:04.080157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:04.080160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:04.080162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:04.080165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:04.080168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:04.080171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:04.080173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:04.080176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:04.080179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:04.080182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.080184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.080187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.080189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.080193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.080196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.080199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:04.080201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:04.080204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:04.080216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:04.080240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:04.085518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894863585478539:4158] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:04.085535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894863585478539:4158] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:04.085538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894863585478539:4158] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:04.085554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 283 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:04.085868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:04.086817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:04.086835Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:04.086839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:04.086843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:04.086850Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 282 [2:7555894863495753814:3663]
2025-09-30T14:51:04.086867Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:04.086882Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:04.086891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:04.086896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:04.086898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:04.086927Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:04.086938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:04.086946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:04.087014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.087022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.087024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.087027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:04.087031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:04.087096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:04.087104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.087116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.087132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.087153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:04.087175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894863585478580:4158], now have 1 active actors on pipe
2025-09-30T14:51:04.087184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894863585478469:2454], now have 1 active actors on pipe
2025-09-30T14:51:04.087191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894863495753808:3663]
2025-09-30T14:51:04.087198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894863495753808:3663]
2025-09-30T14:51:04.087200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894863495753808:3663]
2025-09-30T14:51:04.087212Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:04.087226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:04.087228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:04.087230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:04.087232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:04.087258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:04.087262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:04.087268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 282
2025-09-30T14:51:04.087278Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 282
2025-09-30T14:51:04.087298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894863495753808:3663]
2025-09-30T14:51:04.087310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:04.087317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:04.087330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:04.087335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:04.087392Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16c1b648-abfe1d6-cc898c68-fc61b682_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:04.087406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:04.087409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:04.087411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:04.087422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:04.087435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:04.087463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:04.087645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:04.087653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:04.087666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:04.087757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 283 partition: 0 MaxSeqNo: 42 sessionId: src_id|16c1b648-abfe1d6-cc898c68-fc61b682_0
2025-09-30T14:51:04.088177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a92b4347-41182810-f99c48bd-84e42d23_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|16c1b648-abfe1d6-cc898c68-fc61b682_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:04.091144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16c1b648-abfe1d6-cc898c68-fc61b682_0] Write session: try to update token
2025-09-30T14:51:04.091167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16c1b648-abfe1d6-cc898c68-fc61b682_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:04.102019Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:04.102036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:04.102039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:04.102041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:04.102050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894863495753808:3663]
2025-09-30T14:51:04.102055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894863495753808:3663]
2025-09-30T14:51:04.102060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894863495753808:3663]
2025-09-30T14:51:04.102111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:04.102115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:04.102119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:04.102124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:04.102124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.102127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:04.102272Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:04.107583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 283 sessionId: src_id|16c1b648-abfe1d6-cc898c68-fc61b682_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:04.110536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:04.166631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894863585478588:3696]
2025-09-30T14:51:04.167000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 282, pipe: [1:7555894863585478588:3696]
2025-09-30T14:51:04.217733Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:04.218226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:04.218241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:04.218280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894863585478588:3696], now have 1 active actors on pipe
2025-09-30T14:51:04.218507Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:04.218553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:04.218565Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:04.218573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:04.218628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894863585478588:3696]
2025-09-30T14:51:04.218650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 283 reason: error at write: Disconnected sessionId: src_id|16c1b648-abfe1d6-cc898c68-fc61b682_0
2025-09-30T14:51:04.218872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 283 sessionId: src_id|16c1b648-abfe1d6-cc898c68-fc61b682_0 is DEAD
2025-09-30T14:51:04.219014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16c1b648-abfe1d6-cc898c68-fc61b682_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:04.219025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16c1b648-abfe1d6-cc898c68-fc61b682_0] Write session will restart in 0.008506s
2025-09-30T14:51:04.219048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16c1b648-abfe1d6-cc898c68-fc61b682_0] Write session: Do CDS request
2025-09-30T14:51:04.219056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16c1b648-abfe1d6-cc898c68-fc61b682_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:04.227764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:04.228777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16c1b648-abfe1d6-cc898c68-fc61b682_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:04.229072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:04.229094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 284
2025-09-30T14:51:04.229209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 284 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:04.229241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 284 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:04.229250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=284 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:04.229254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:04.229697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 284 sessionId:  describe result for acl check
2025-09-30T14:51:04.229735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:04.229742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:04.229745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:04.229750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894863585478662:4162] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:04.229835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:04.230045Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:04.230054Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:04.230065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:04.230115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:04.230162Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894863495753925:3665]
2025-09-30T14:51:04.230259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894863585478662:4162] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:04.230820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:04.231078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:04.231118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:04.231469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:04.231545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:04.231551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:04.231552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:04.231553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:04.231554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:04.231556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:04.231557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:04.231558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:04.231560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:04.231562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:04.231563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.231564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.231565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.231566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:04.231568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:04.231573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:04.231582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:04.231587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:04.231591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:04.231595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:04.231599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:04.231603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:04.231607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:04.231611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:04.231615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:04.231619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.231623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.231627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.231631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:04.231635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:04.231642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:04.231648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:04.231655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:04.231660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:04.231666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:04.231670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:04.231675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:04.231681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:04.231686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:04.231691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:04.231696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:04.231701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:04.231707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:04.231712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:04.231717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:04.231722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:04.231726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:04.231737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:04.231744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:04.231754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:04.231758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.231763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.231767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.231777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.231782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.231787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.231793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:04.231799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:04.231808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:04.231814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:04.231860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:04.232333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894863585478662:4162] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:04.238161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894863585478662:4162] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:04.238184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894863585478662:4162] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:04.238194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894863585478662:4162] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:04.238203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 284 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:04.238494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:04.239451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:04.239469Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:04.239472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:04.239476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:04.239484Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 283 [2:7555894863495753925:3665]
2025-09-30T14:51:04.239500Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:04.239516Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:04.239519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:04.239522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:04.239524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:04.239538Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:04.239545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:04.239552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:04.239619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.239626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.239628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.239632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:04.239634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:04.239704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:04.239711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.239723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.239738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.239758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:04.239782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894863585478701:4162], now have 1 active actors on pipe
2025-09-30T14:51:04.239785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894863585478589:2454], now have 1 active actors on pipe
2025-09-30T14:51:04.239791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894863495753920:3665]
2025-09-30T14:51:04.239794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894863495753920:3665]
2025-09-30T14:51:04.239796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894863495753920:3665]
2025-09-30T14:51:04.239808Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:04.239821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:04.239827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:04.239832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:04.239835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:04.239842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:04.239845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:04.239853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 283
2025-09-30T14:51:04.239867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 283
2025-09-30T14:51:04.239880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894863495753920:3665]
2025-09-30T14:51:04.239891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:04.239901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:04.239926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:04.239930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:04.239954Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b47b1f38-8c42cdc2-9924df1c-c4945b50_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:04.239967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:04.239970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:04.239972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:04.239981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:04.239990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:04.240009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:04.240141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:04.240148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:04.240161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:04.240233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 284 partition: 0 MaxSeqNo: 42 sessionId: src_id|b47b1f38-8c42cdc2-9924df1c-c4945b50_0
2025-09-30T14:51:04.240667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16c1b648-abfe1d6-cc898c68-fc61b682_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b47b1f38-8c42cdc2-9924df1c-c4945b50_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:04.243740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b47b1f38-8c42cdc2-9924df1c-c4945b50_0] Write session: try to update token
2025-09-30T14:51:04.243766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b47b1f38-8c42cdc2-9924df1c-c4945b50_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:04.255307Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:04.255327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:04.255338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894863495753920:3665]
2025-09-30T14:51:04.255389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:04.255403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:04.255591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:04.255767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:04.255934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:04.256114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:04.256336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:04.256385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:04.259301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 284 sessionId: src_id|b47b1f38-8c42cdc2-9924df1c-c4945b50_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:04.262830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:04.263041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:04.263073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:04.263112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:04.263421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:04.269312Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:04.269334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:04.269336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:04.269339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:04.269349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894863495753920:3665]
2025-09-30T14:51:04.269353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894863495753920:3665]
2025-09-30T14:51:04.269357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894863495753920:3665]
2025-09-30T14:51:04.269395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:04.269400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.269402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:04.269408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:04.269421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:04.269425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:04.269533Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:04.318677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894863585478709:3696]
2025-09-30T14:51:04.318951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 283, pipe: [1:7555894863585478709:3696]
2025-09-30T14:51:04.380863Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:04.389625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:04.389667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:04.389867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:04.389952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:04.390034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:04.390109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:04.390165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:04.390175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:04.390257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:04.390333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:04.390407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:04.390486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:04.390535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:04.390538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:04.390623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:04.390712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:04.390783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:04.390860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:04.390912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:04.390920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:04.390998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:04.391080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:04.391160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:04.391227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:04.391301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:04.391309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:04.391398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:04.391470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:04.391542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:04.391616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:04.391668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:04.391676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:04.391753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:04.391828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:04.391902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:04.391979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:04.392035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:04.392043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:04.392114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:04.392185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:04.392257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:04.392329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:04.392375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:04.392382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:04.392452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:04.392516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:04.392584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:04.392651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:04.392718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:04.392725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:04.392796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:04.392861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:04.392936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:04.393009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:04.393066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:04.393074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:04.393152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:04.393221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:04.393294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:04.393365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:04.393434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:04.393442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:04.393512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894863585478709:3696], now have 1 active actors on pipe
2025-09-30T14:51:04.393755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894863585478709:3696]
2025-09-30T14:51:04.393756Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:04.393803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:04.393819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:04.393850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 284 reason: error at write: Disconnected sessionId: src_id|b47b1f38-8c42cdc2-9924df1c-c4945b50_0
2025-09-30T14:51:04.394125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 284 sessionId: src_id|b47b1f38-8c42cdc2-9924df1c-c4945b50_0 is DEAD
2025-09-30T14:51:04.394239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b47b1f38-8c42cdc2-9924df1c-c4945b50_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:04.394248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b47b1f38-8c42cdc2-9924df1c-c4945b50_0] Write session will restart in 0.008956s
2025-09-30T14:51:04.394265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b47b1f38-8c42cdc2-9924df1c-c4945b50_0] Write session: Do CDS request
2025-09-30T14:51:04.394269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b47b1f38-8c42cdc2-9924df1c-c4945b50_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:04.394541Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:04.404874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b47b1f38-8c42cdc2-9924df1c-c4945b50_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:04.405030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:04.405055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 285
2025-09-30T14:51:04.405189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 285 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:04.405233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 285 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:04.405246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=285 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:04.405250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:04.405780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 285 sessionId:  describe result for acl check
2025-09-30T14:51:04.405821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:04.405828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:04.405829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:04.405836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894863585478748:4166] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:04.406567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894863585478748:4166] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:04.408808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:04.409160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894863585478748:4166] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:04.410643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:04.410859Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:04.410873Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:04.410886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:04.410953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:04.410993Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894863495754039:3667]
2025-09-30T14:51:04.411622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:04.411930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:04.411973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:04.412183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894863585478748:4166] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:04.412201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894863585478748:4166] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:04.412204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894863585478748:4166] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:04.412213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 285 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:04.412241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:04.412300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:04.412309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:04.412310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:04.412311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:04.412312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:04.412314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:04.412315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:04.412316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:04.412318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:04.412319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:04.412320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.412321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.412323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.412324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:04.412325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:04.412331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:04.412342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:04.412347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:04.412351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:04.412356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:04.412360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:04.412364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:04.412368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:04.412372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:04.412379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:04.412383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.412387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.412391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.412395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:04.412399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:04.412406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:04.412415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:04.412420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:04.412426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:04.412432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:04.412438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:04.412442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:04.412448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:04.412452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:04.412458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:04.412461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:04.412464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:04.412468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:04.412471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:04.412473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:04.412476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:04.412479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:04.412482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:04.412484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:04.412487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:04.412490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.412494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.412496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.412499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.412501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.412504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.412506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:04.412509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:04.412512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:04.412515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:04.412539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:04.421041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:04.422093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:04.422112Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:04.422116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:04.422121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:04.422129Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 284 [2:7555894863495754039:3667]
2025-09-30T14:51:04.422149Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:04.422168Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:04.422176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:04.422179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:04.422182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:04.422199Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:04.422212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:04.422219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:04.422291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.422298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.422301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.422304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:04.422307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:04.422384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:04.422392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.422407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.422420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.422434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:04.422454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894863585478822:4166], now have 1 active actors on pipe
2025-09-30T14:51:04.422463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894863495754034:3667]
2025-09-30T14:51:04.422465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894863495754034:3667]
2025-09-30T14:51:04.422466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894863495754034:3667]
2025-09-30T14:51:04.422476Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:04.422484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894863585478710:2454], now have 1 active actors on pipe
2025-09-30T14:51:04.422494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:04.422494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:04.422498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:04.422503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:04.422505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:04.422508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:04.422540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894863495754034:3667]
2025-09-30T14:51:04.422549Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:04.422565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:04.422610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 284
2025-09-30T14:51:04.422610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 284
2025-09-30T14:51:04.422708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:04.422726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:04.422760Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1161ce86-66c7acb8-18eae15d-871b291b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:04.422770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:04.422778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:04.422784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:04.422800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:04.422815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:04.422837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:04.422982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:04.422990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:04.423003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:04.423101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 285 partition: 0 MaxSeqNo: 42 sessionId: src_id|1161ce86-66c7acb8-18eae15d-871b291b_0
2025-09-30T14:51:04.423503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b47b1f38-8c42cdc2-9924df1c-c4945b50_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1161ce86-66c7acb8-18eae15d-871b291b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:04.434943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1161ce86-66c7acb8-18eae15d-871b291b_0] Write session: try to update token
2025-09-30T14:51:04.434969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1161ce86-66c7acb8-18eae15d-871b291b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:04.440139Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:04.440163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:04.440166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:04.440168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:04.440180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894863495754034:3667]
2025-09-30T14:51:04.440184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894863495754034:3667]
2025-09-30T14:51:04.440187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894863495754034:3667]
2025-09-30T14:51:04.440231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:04.440238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.440243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:04.440253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:04.440270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:04.440274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:04.440388Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:04.450653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 285 sessionId: src_id|1161ce86-66c7acb8-18eae15d-871b291b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:04.459868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:04.495346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894863585478834:3696]
2025-09-30T14:51:04.495633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 284, pipe: [1:7555894863585478834:3696]
2025-09-30T14:51:04.549422Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:04.549758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:04.549770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:04.549788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894863585478834:3696], now have 1 active actors on pipe
2025-09-30T14:51:04.549986Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:04.550071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894863585478834:3696]
2025-09-30T14:51:04.550115Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:04.550118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:04.550201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 285 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1161ce86-66c7acb8-18eae15d-871b291b_0
2025-09-30T14:51:04.550464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 285 sessionId: src_id|1161ce86-66c7acb8-18eae15d-871b291b_0 is DEAD
2025-09-30T14:51:04.550626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1161ce86-66c7acb8-18eae15d-871b291b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:04.550649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1161ce86-66c7acb8-18eae15d-871b291b_0] Write session will restart in 0.008600s
2025-09-30T14:51:04.550673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1161ce86-66c7acb8-18eae15d-871b291b_0] Write session: Do CDS request
2025-09-30T14:51:04.550680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1161ce86-66c7acb8-18eae15d-871b291b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:04.559502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:04.560834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1161ce86-66c7acb8-18eae15d-871b291b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:04.560949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:04.560977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 286
2025-09-30T14:51:04.561123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 286 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:04.561154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 286 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:04.561168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=286 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:04.561177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:04.561419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:04.561567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 286 sessionId:  describe result for acl check
2025-09-30T14:51:04.561601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:04.561609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:04.561610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:04.561606Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:04.561614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894863585478910:4171] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:04.561619Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:04.561630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:04.561681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:04.561722Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894863495754154:3670]
2025-09-30T14:51:04.562094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894863585478910:4171] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:04.562367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:04.562625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:04.562664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:04.562965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:04.563030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:04.563038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:04.563039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:04.563040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:04.563041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:04.563042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:04.563044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:04.563045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:04.563046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:04.563047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:04.563048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.563050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.563051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.563052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:04.563053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:04.563059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:04.563069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:04.563073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:04.563077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:04.563081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:04.563086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:04.563090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:04.563094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:04.563098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:04.563103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:04.563107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.563110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.563114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.563118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:04.563122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:04.563128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:04.563136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:04.563142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:04.563148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:04.563152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:04.563158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:04.563163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:04.563169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:04.563174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:04.563180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:04.563185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:04.563190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:04.563195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:04.563200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:04.563206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:04.563211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:04.563216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:04.563222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:04.563231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:04.563237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:04.563259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.563268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.563273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.563278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.563283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.563288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.563293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:04.563300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:04.563304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:04.563309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:04.563349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:04.563946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894863585478910:4171] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:04.568537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894863585478910:4171] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:04.568554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894863585478910:4171] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:04.568557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894863585478910:4171] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:04.568566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 286 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:04.569444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:04.571034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:04.571056Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:04.571059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:04.571063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:04.571071Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 285 [2:7555894863495754154:3670]
2025-09-30T14:51:04.571089Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:04.571105Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:04.571108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:04.571112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:04.571118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:04.571136Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:04.571149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:04.571157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:04.571230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.571239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.571241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.571260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:04.571263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:04.571340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:04.571350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.571362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.571374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.571463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 285
2025-09-30T14:51:04.571395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:04.571469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 285
2025-09-30T14:51:04.571419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894863585478835:2454], now have 1 active actors on pipe
2025-09-30T14:51:04.571423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894863585478948:4171], now have 1 active actors on pipe
2025-09-30T14:51:04.571428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894863495754149:3670]
2025-09-30T14:51:04.571431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894863495754149:3670]
2025-09-30T14:51:04.571433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894863495754149:3670]
2025-09-30T14:51:04.571446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:04.571456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:04.571460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:04.571462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:04.571462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:04.571477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:04.571481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:04.571519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894863495754149:3670]
2025-09-30T14:51:04.571532Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:04.571553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:04.571557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:04.571562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:04.571605Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57c1221-93bea7f5-a5a572a2-8e52fae7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:04.571619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:04.571623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:04.571624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:04.571634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:04.571645Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:04.571676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:04.571862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:04.571879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:04.571907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:04.571991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 286 partition: 0 MaxSeqNo: 42 sessionId: src_id|57c1221-93bea7f5-a5a572a2-8e52fae7_0
2025-09-30T14:51:04.572396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1161ce86-66c7acb8-18eae15d-871b291b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|57c1221-93bea7f5-a5a572a2-8e52fae7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:04.575231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57c1221-93bea7f5-a5a572a2-8e52fae7_0] Write session: try to update token
2025-09-30T14:51:04.575266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57c1221-93bea7f5-a5a572a2-8e52fae7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:04.583873Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:04.583896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:04.583899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:04.583901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:04.583910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894863495754149:3670]
2025-09-30T14:51:04.583914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894863495754149:3670]
2025-09-30T14:51:04.583918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894863495754149:3670]
2025-09-30T14:51:04.583965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:04.583969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:04.583972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.583975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:04.583977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:04.583981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:04.584127Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:04.590844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 286 sessionId: src_id|57c1221-93bea7f5-a5a572a2-8e52fae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:04.593901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:04.650459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894863585478957:3696]
2025-09-30T14:51:04.650745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 285, pipe: [1:7555894863585478957:3696]
2025-09-30T14:51:04.696499Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:04.696971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:04.696985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:04.697004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894863585478957:3696], now have 1 active actors on pipe
2025-09-30T14:51:04.697215Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:04.697234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:04.697252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:04.697333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 286 reason: error at write: Disconnected sessionId: src_id|57c1221-93bea7f5-a5a572a2-8e52fae7_0
2025-09-30T14:51:04.697569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 286 sessionId: src_id|57c1221-93bea7f5-a5a572a2-8e52fae7_0 is DEAD
2025-09-30T14:51:04.697737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57c1221-93bea7f5-a5a572a2-8e52fae7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:04.697750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57c1221-93bea7f5-a5a572a2-8e52fae7_0] Write session will restart in 0.008115s
2025-09-30T14:51:04.697776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57c1221-93bea7f5-a5a572a2-8e52fae7_0] Write session: Do CDS request
2025-09-30T14:51:04.697789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57c1221-93bea7f5-a5a572a2-8e52fae7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:04.697789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894863585478957:3696]
2025-09-30T14:51:04.697815Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:04.706875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57c1221-93bea7f5-a5a572a2-8e52fae7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:04.706987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:04.707005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 287
2025-09-30T14:51:04.707096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 287 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:04.707119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 287 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:04.707127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=287 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:04.707131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:04.707559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 287 sessionId:  describe result for acl check
2025-09-30T14:51:04.707595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:04.707600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:04.707602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:04.707584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:04.707608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894863585479033:4175] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:04.708139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894863585479033:4175] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:04.709781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:04.710004Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:04.710014Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:04.710023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:04.710072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:04.710122Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894863495754270:3672]
2025-09-30T14:51:04.710188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894863585479033:4175] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:04.710793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:04.711136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:04.711175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:04.711512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:04.711576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:04.711585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:04.711586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:04.711587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:04.711589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:04.711590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:04.711591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:04.711592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:04.711593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:04.711594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:04.711595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.711597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.711598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.711599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:04.711600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:04.711605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:04.711614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:04.711618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:04.711621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:04.711626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:04.711629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:04.711636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:04.711640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:04.711643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:04.711647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:04.711650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.711654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.711657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.711660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:04.711663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:04.711670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:04.711676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:04.711682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:04.711687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:04.711691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:04.711695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:04.711700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:04.711705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:04.711711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:04.711715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:04.711720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:04.711724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:04.711729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:04.711733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:04.711738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:04.711742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:04.711747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:04.711752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:04.711755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:04.711760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:04.711764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.711769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.711773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.711777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.711781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.711786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.711790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:04.711795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:04.711799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:04.711804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:04.711844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:04.712567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894863585479033:4175] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:04.712583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894863585479033:4175] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:04.712586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894863585479033:4175] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:04.712594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 287 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:04.717623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:04.718584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:04.718622Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:04.718625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:04.718630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:04.718637Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 286 [2:7555894863495754270:3672]
2025-09-30T14:51:04.718656Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:04.718673Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:04.718677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:04.718680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:04.718683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:04.718700Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:04.718708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:04.718720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:04.718783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.718795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.718797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.718801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:04.718805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:04.719041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:04.719053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.719069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.719089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.719060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 286
2025-09-30T14:51:04.719064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 286
2025-09-30T14:51:04.719117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:04.719150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894863585479073:4175], now have 1 active actors on pipe
2025-09-30T14:51:04.719154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894863585478958:2454], now have 1 active actors on pipe
2025-09-30T14:51:04.719170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:04.719175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:04.719196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894863495754264:3672]
2025-09-30T14:51:04.719198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894863495754264:3672]
2025-09-30T14:51:04.719201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894863495754264:3672]
2025-09-30T14:51:04.719215Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:04.719231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:04.719238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:04.719257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:04.719259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:04.719288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:04.719297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:04.719314Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5531801-e09c0c6-d4966c53-be7a187c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:04.719327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:04.719337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:04.719340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:04.719351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:04.719367Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:04.719415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894863495754264:3672]
2025-09-30T14:51:04.719432Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:04.719445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:04.719451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:04.719651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:04.719661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:04.719679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:04.719776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 287 partition: 0 MaxSeqNo: 42 sessionId: src_id|5531801-e09c0c6-d4966c53-be7a187c_0
2025-09-30T14:51:04.720191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57c1221-93bea7f5-a5a572a2-8e52fae7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5531801-e09c0c6-d4966c53-be7a187c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:04.723093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5531801-e09c0c6-d4966c53-be7a187c_0] Write session: try to update token
2025-09-30T14:51:04.723117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5531801-e09c0c6-d4966c53-be7a187c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:04.731475Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:04.731490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:04.731500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894863495754264:3672]
2025-09-30T14:51:04.731541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:04.731549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:04.731718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:04.732251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:04.732786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:04.733270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:04.733483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:04.733524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:04.738190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 287 sessionId: src_id|5531801-e09c0c6-d4966c53-be7a187c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:04.741300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:04.741527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:04.741551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:04.741591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:04.741693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:04.745503Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:04.745521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:04.745523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:04.745525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:04.745537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894863495754264:3672]
2025-09-30T14:51:04.745540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894863495754264:3672]
2025-09-30T14:51:04.745542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894863495754264:3672]
2025-09-30T14:51:04.745573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:04.745578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.745580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:04.745590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:04.745600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:04.745604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:04.745719Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:04.797873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894863585479093:3696]
2025-09-30T14:51:04.798191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 286, pipe: [1:7555894863585479093:3696]
2025-09-30T14:51:04.855551Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:04.863713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:04.863741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:04.863935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:04.864004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:04.864088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:04.864167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:04.864217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:04.864227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:04.864306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:04.864375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:04.864453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:04.864534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:04.864587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:04.864595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:04.864675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:04.864788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:04.864862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:04.864931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:04.864985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:04.864988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:04.865065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:04.865133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:04.865203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:04.865276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:04.865327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:04.865335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:04.865409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:04.865485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:04.865557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:04.865623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:04.865670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:04.865677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:04.865751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:04.865816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:04.865888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:04.865952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:04.865998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:04.866005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:04.866073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:04.866141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:04.866208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:04.866268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:04.866314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:04.866320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:04.866395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:04.866471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:04.866543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:04.866620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:04.866694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:04.866702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:04.866777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:04.866842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:04.866918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:04.866991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:04.867040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:04.867046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:04.867115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:04.867184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:04.867274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:04.867343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:04.867395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:04.867403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:04.867470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894863585479093:3696], now have 1 active actors on pipe
2025-09-30T14:51:04.867772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:04.867787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:04.867819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 287 reason: error at write: Disconnected sessionId: src_id|5531801-e09c0c6-d4966c53-be7a187c_0
2025-09-30T14:51:04.867855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894863585479093:3696]
2025-09-30T14:51:04.867890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:04.868061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 287 sessionId: src_id|5531801-e09c0c6-d4966c53-be7a187c_0 is DEAD
2025-09-30T14:51:04.868258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5531801-e09c0c6-d4966c53-be7a187c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:04.868271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5531801-e09c0c6-d4966c53-be7a187c_0] Write session will restart in 0.008433s
2025-09-30T14:51:04.868294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5531801-e09c0c6-d4966c53-be7a187c_0] Write session: Do CDS request
2025-09-30T14:51:04.868300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5531801-e09c0c6-d4966c53-be7a187c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:04.868737Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:04.877869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5531801-e09c0c6-d4966c53-be7a187c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:04.877946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:04.877975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 288
2025-09-30T14:51:04.878148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 288 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:04.878182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 288 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:04.878199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=288 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:04.878209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:04.878705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 288 sessionId:  describe result for acl check
2025-09-30T14:51:04.878749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:04.878751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:04.878752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:04.878758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894863585479170:4180] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:04.879365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:04.879348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894863585479170:4180] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:04.881252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894863585479170:4180] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:04.881388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:04.881613Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:04.881622Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:04.881632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:04.881690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:04.881735Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894863495754398:3675]
2025-09-30T14:51:04.882418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:04.882754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:04.882799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:04.883132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:04.883191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:04.883200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:04.883201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:04.883202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:04.883203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:04.883205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:04.883206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:04.883207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:04.883208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:04.883209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:04.883210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.883212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.883213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.883214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:04.883215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:04.883220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:04.883231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:04.883235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:04.883240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:04.883283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:04.883287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:04.883292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:04.883296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:04.883300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:04.883305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:04.883309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.883313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.883317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.883321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:04.883325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:04.883333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:04.883342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:04.883349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:04.883355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:04.883360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:04.883364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:04.883369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:04.883375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:04.883381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:04.883386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:04.883392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:04.883397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:04.883402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:04.883415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:04.883420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:04.883426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:04.883433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:04.883438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:04.883445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:04.883451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:04.883460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.883466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.883470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.883476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.883484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.883490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.883494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:04.883499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:04.883508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:04.883513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:04.883557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:04.884153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894863585479170:4180] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:04.884168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894863585479170:4180] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:04.884172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894863585479170:4180] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:04.884192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 288 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:04.889185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:04.890175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:04.890190Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:04.890192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:04.890195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:04.890200Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 287 [2:7555894863495754398:3675]
2025-09-30T14:51:04.890213Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:04.890228Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:04.890233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:04.890236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:04.890238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:04.890254Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:04.890264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:04.890270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:04.890321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.890330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.890332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.890336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:04.890338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:04.890406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:04.890415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.890427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:04.890442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:04.890462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:04.890491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894863585479094:2454], now have 1 active actors on pipe
2025-09-30T14:51:04.890496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894863585479210:4180], now have 1 active actors on pipe
2025-09-30T14:51:04.890503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894863495754393:3675]
2025-09-30T14:51:04.890505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894863495754393:3675]
2025-09-30T14:51:04.890507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894863495754393:3675]
2025-09-30T14:51:04.890520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:04.890534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:04.890519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 287
2025-09-30T14:51:04.890550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 287
2025-09-30T14:51:04.890540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:04.890544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:04.890546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:04.890549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:04.890551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:04.890605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894863495754393:3675]
2025-09-30T14:51:04.890618Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:04.890625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:04.890634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:04.890638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:04.890686Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1987fb-f5fd047e-fea928a8-94e5dd4d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:04.890698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:04.890702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:04.890704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:04.890716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:04.890725Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:04.890747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:04.890913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:04.890920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:04.890933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:04.891028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 288 partition: 0 MaxSeqNo: 42 sessionId: src_id|b1987fb-f5fd047e-fea928a8-94e5dd4d_0
2025-09-30T14:51:04.891449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5531801-e09c0c6-d4966c53-be7a187c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b1987fb-f5fd047e-fea928a8-94e5dd4d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:04.894308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1987fb-f5fd047e-fea928a8-94e5dd4d_0] Write session: try to update token
2025-09-30T14:51:04.894328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1987fb-f5fd047e-fea928a8-94e5dd4d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:04.903096Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:04.903117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:04.903119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:04.903120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:04.903131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894863495754393:3675]
2025-09-30T14:51:04.903135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894863495754393:3675]
2025-09-30T14:51:04.903137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894863495754393:3675]
2025-09-30T14:51:04.903179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:04.903184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:04.903187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:04.903189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:04.903194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:04.903199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:04.903357Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:04.909380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 288 sessionId: src_id|b1987fb-f5fd047e-fea928a8-94e5dd4d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:04.912376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:04.967872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894863585479225:3696]
2025-09-30T14:51:04.968221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 287, pipe: [1:7555894863585479225:3696]
2025-09-30T14:51:05.016675Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:05.017013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:05.017029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:05.017068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894863585479225:3696], now have 1 active actors on pipe
2025-09-30T14:51:05.017268Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:05.017251Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:05.017308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:05.017310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:05.017386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 288 reason: error at write: Disconnected sessionId: src_id|b1987fb-f5fd047e-fea928a8-94e5dd4d_0
2025-09-30T14:51:05.017575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 288 sessionId: src_id|b1987fb-f5fd047e-fea928a8-94e5dd4d_0 is DEAD
2025-09-30T14:51:05.017706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1987fb-f5fd047e-fea928a8-94e5dd4d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:05.017719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1987fb-f5fd047e-fea928a8-94e5dd4d_0] Write session will restart in 0.007004s
2025-09-30T14:51:05.017742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1987fb-f5fd047e-fea928a8-94e5dd4d_0] Write session: Do CDS request
2025-09-30T14:51:05.017747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1987fb-f5fd047e-fea928a8-94e5dd4d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:05.017760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894863585479225:3696]
2025-09-30T14:51:05.025842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1987fb-f5fd047e-fea928a8-94e5dd4d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:05.025883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:05.025902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 289
2025-09-30T14:51:05.026104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 289 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:05.026141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 289 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:05.026149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=289 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:05.026154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:05.026563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 289 sessionId:  describe result for acl check
2025-09-30T14:51:05.026616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:05.026623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:05.026628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:05.026633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894867880446610:4192] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:05.027202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894867880446610:4192] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:05.027812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:05.029093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894867880446610:4192] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:05.029615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:05.029814Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:05.029823Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:05.029831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:05.029885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:05.029928Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894867790721826:3684]
2025-09-30T14:51:05.030613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:05.030934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:05.030974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:05.031327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:05.031398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:05.031405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:05.031406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:05.031407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:05.031408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:05.031409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:05.031411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:05.031412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:05.031413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:05.031415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:05.031416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.031417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.031418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.031419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:05.031420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:05.031426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:05.031434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:05.031438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:05.031441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:05.031445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:05.031449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:05.031454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:05.031458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:05.031462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:05.031467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:05.031471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.031475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.031479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.031483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:05.031487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:05.031494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:05.031502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:05.031508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:05.031514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:05.031518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:05.031524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:05.031528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:05.031533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:05.031538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:05.031544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:05.031548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:05.031554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:05.031559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:05.031564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:05.031569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:05.031575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:05.031580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:05.031585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:05.031589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:05.031595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:05.031600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.031606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.031610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.031616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.031621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.031627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.031631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:05.031637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:05.031644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:05.031650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:05.031688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894867880446610:4192] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:05.031704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894867880446610:4192] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:05.031707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894867880446610:4192] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:05.031715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 289 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:05.031697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:05.037549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:05.038516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:05.038530Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:05.038533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:05.038537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:05.038545Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 288 [2:7555894867790721826:3684]
2025-09-30T14:51:05.038559Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:05.038574Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:05.038582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.038594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.038597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.038613Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:05.038620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:05.038627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:05.038691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.038704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.038706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.038710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:05.038713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:05.038778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:05.038785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.038797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.038815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.038833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:05.038856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894867880446652:4192], now have 1 active actors on pipe
2025-09-30T14:51:05.038864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894867880446535:2454], now have 1 active actors on pipe
2025-09-30T14:51:05.038870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894867790721820:3684]
2025-09-30T14:51:05.038873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894867790721820:3684]
2025-09-30T14:51:05.038874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894867790721820:3684]
2025-09-30T14:51:05.038888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:05.038906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:05.038910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:05.038914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:05.038917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:05.038925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:05.038928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:05.038962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894867790721820:3684]
2025-09-30T14:51:05.038977Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:05.038951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 288
2025-09-30T14:51:05.038995Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 288
2025-09-30T14:51:05.039019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:05.039065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:05.039075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:05.039105Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc9a99d0-ebdebe70-ec7702db-7a68112f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:05.039115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.039126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.039129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:05.039138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.039151Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:05.039171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:05.039331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:05.039349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:05.039384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:05.039471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 289 partition: 0 MaxSeqNo: 42 sessionId: src_id|cc9a99d0-ebdebe70-ec7702db-7a68112f_0
2025-09-30T14:51:05.039860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1987fb-f5fd047e-fea928a8-94e5dd4d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cc9a99d0-ebdebe70-ec7702db-7a68112f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:05.042834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc9a99d0-ebdebe70-ec7702db-7a68112f_0] Write session: try to update token
2025-09-30T14:51:05.042856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc9a99d0-ebdebe70-ec7702db-7a68112f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:05.059635Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:05.059654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:05.059665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894867790721820:3684]
2025-09-30T14:51:05.059723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:05.059731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:05.060127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:05.060489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:05.060862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:05.061215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:05.062147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:05.062508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:05.064090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 289 sessionId: src_id|cc9a99d0-ebdebe70-ec7702db-7a68112f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:05.064295Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:05.064315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:05.064319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:05.064323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:05.064331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894867790721820:3684]
2025-09-30T14:51:05.064336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894867790721820:3684]
2025-09-30T14:51:05.064340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894867790721820:3684]
2025-09-30T14:51:05.064374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:05.064381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:05.064385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.064386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:05.064387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:05.064391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:05.064532Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:05.067120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:05.117921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894867880446671:3696]
2025-09-30T14:51:05.118285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 288, pipe: [1:7555894867880446671:3696]
2025-09-30T14:51:05.178229Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:05.178509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:05.178522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:05.178539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894867880446671:3696], now have 1 active actors on pipe
2025-09-30T14:51:05.178746Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:05.178832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:05.178847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894867880446671:3696]
2025-09-30T14:51:05.178853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:05.178869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:05.178922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 289 reason: error at write: Disconnected sessionId: src_id|cc9a99d0-ebdebe70-ec7702db-7a68112f_0
2025-09-30T14:51:05.179100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 289 sessionId: src_id|cc9a99d0-ebdebe70-ec7702db-7a68112f_0 is DEAD
2025-09-30T14:51:05.179312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc9a99d0-ebdebe70-ec7702db-7a68112f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:05.179338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc9a99d0-ebdebe70-ec7702db-7a68112f_0] Write session will restart in 0.008696s
2025-09-30T14:51:05.179362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc9a99d0-ebdebe70-ec7702db-7a68112f_0] Write session: Do CDS request
2025-09-30T14:51:05.179370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc9a99d0-ebdebe70-ec7702db-7a68112f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:05.188843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc9a99d0-ebdebe70-ec7702db-7a68112f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:05.188919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:05.188940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 290
2025-09-30T14:51:05.189155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 290 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:05.189192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 290 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:05.189203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=290 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:05.189207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:05.189663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 290 sessionId:  describe result for acl check
2025-09-30T14:51:05.189727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:05.189731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:05.189733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:05.189739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894867880446751:4197] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:05.189880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:05.190315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894867880446751:4197] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:05.192095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:05.192316Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:05.192330Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:05.192344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:05.192414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:05.192459Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894867790721967:3692]
2025-09-30T14:51:05.193164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:05.193547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:05.193602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:05.193981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:05.194075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:05.194085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:05.194086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:05.194088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:05.194089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:05.194090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:05.194092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:05.194093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:05.194095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:05.194096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:05.194097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.194098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.194100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.194101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:05.194102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:05.194108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:05.194119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:05.194123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:05.194127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:05.194132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:05.194136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:05.194140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:05.194144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:05.194148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:05.194154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:05.194158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.194163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.194166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.194170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:05.194174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:05.194182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:05.194190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:05.194196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:05.194203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:05.194209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:05.194215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:05.194219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:05.194225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:05.194229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:05.194235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:05.194240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:05.194245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:05.194251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:05.194255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:05.194259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:05.194264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:05.194269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:05.194274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:05.194280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:05.194285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:05.194290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.194295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.194300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.194305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.194310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.194315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.194319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:05.194305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894867880446751:4197] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:05.194325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:05.194342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:05.194347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:05.194394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:05.200313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894867880446751:4197] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:05.200333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894867880446751:4197] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:05.200336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894867880446751:4197] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:05.200350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 290 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:05.200656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:05.201631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:05.201653Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:05.201657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:05.201662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:05.201669Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 289 [2:7555894867790721967:3692]
2025-09-30T14:51:05.201689Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:05.201708Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:05.201712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.201716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.201718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.201737Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:05.201752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:05.201759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:05.201830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.201839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.201841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.201844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:05.201847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:05.201925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:05.201936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.201952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.201967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.201983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:05.202003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894867880446791:4197], now have 1 active actors on pipe
2025-09-30T14:51:05.202007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894867880446673:2454], now have 1 active actors on pipe
2025-09-30T14:51:05.202013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894867790721961:3692]
2025-09-30T14:51:05.202016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894867790721961:3692]
2025-09-30T14:51:05.202018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894867790721961:3692]
2025-09-30T14:51:05.202032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:05.202052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:05.202061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:05.202064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:05.202067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:05.202072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:05.202075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:05.202116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894867790721961:3692]
2025-09-30T14:51:05.202127Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:05.202135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:05.202223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 289
2025-09-30T14:51:05.202223Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 289
2025-09-30T14:51:05.202291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:05.202302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:05.202330Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0c6960f-567ffa79-cac812f1-58bb0168_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:05.202340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.202343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.202346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:05.202356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.202367Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:05.202386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:05.202571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:05.202596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:05.202611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:05.202722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 290 partition: 0 MaxSeqNo: 42 sessionId: src_id|f0c6960f-567ffa79-cac812f1-58bb0168_0
2025-09-30T14:51:05.203160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc9a99d0-ebdebe70-ec7702db-7a68112f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f0c6960f-567ffa79-cac812f1-58bb0168_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:05.206155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c6960f-567ffa79-cac812f1-58bb0168_0] Write session: try to update token
2025-09-30T14:51:05.206177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c6960f-567ffa79-cac812f1-58bb0168_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:05.218131Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:05.218151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:05.218163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894867790721961:3692]
2025-09-30T14:51:05.218219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:05.218223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:05.218419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:05.218615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:05.218771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:05.218952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:05.219168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:05.219217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:05.224390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 290 sessionId: src_id|f0c6960f-567ffa79-cac812f1-58bb0168_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:05.226800Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:05.226822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:05.226825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:05.226827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:05.226838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894867790721961:3692]
2025-09-30T14:51:05.226842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894867790721961:3692]
2025-09-30T14:51:05.226847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894867790721961:3692]
2025-09-30T14:51:05.226887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:05.226894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.226896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:05.226913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:05.226930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:05.226935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:05.227049Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:05.227457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:05.279185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894867880446798:3696]
2025-09-30T14:51:05.279539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 289, pipe: [1:7555894867880446798:3696]
2025-09-30T14:51:05.342685Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:05.343037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:05.343057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:05.343078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894867880446798:3696], now have 1 active actors on pipe
2025-09-30T14:51:05.343333Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:05.343471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:05.343479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894867880446798:3696]
2025-09-30T14:51:05.343511Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:05.343570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 290 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f0c6960f-567ffa79-cac812f1-58bb0168_0
2025-09-30T14:51:05.343772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 290 sessionId: src_id|f0c6960f-567ffa79-cac812f1-58bb0168_0 is DEAD
2025-09-30T14:51:05.343996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c6960f-567ffa79-cac812f1-58bb0168_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:05.344006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c6960f-567ffa79-cac812f1-58bb0168_0] Write session will restart in 0.009571s
2025-09-30T14:51:05.344029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c6960f-567ffa79-cac812f1-58bb0168_0] Write session: Do CDS request
2025-09-30T14:51:05.344036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c6960f-567ffa79-cac812f1-58bb0168_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:05.354062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:05.354796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c6960f-567ffa79-cac812f1-58bb0168_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:05.354887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:05.354908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 291
2025-09-30T14:51:05.355052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 291 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:05.355106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 291 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:05.355117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=291 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:05.355121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:05.355559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 291 sessionId:  describe result for acl check
2025-09-30T14:51:05.355589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:05.355591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:05.355592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:05.355599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894867880446881:4201] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:05.356069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894867880446881:4201] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:05.356236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:05.356451Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:05.356463Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:05.356474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:05.356533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:05.356595Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894867790722086:3694]
2025-09-30T14:51:05.357236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:05.357550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:05.357619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:05.357986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:05.358074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:05.358082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:05.358083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:05.358084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:05.358085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:05.358087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:05.358088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:05.358089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:05.358090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:05.358092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:05.358093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.358094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.358096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.358097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:05.358098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:05.358104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:05.358114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:05.358118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:05.358122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:05.358127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:05.358131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:05.358135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:05.358139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:05.358149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:05.358154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:05.358157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.358161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.358165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.358169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:05.358173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:05.358180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:05.358188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:05.358199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:05.358209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:05.358214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:05.358224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:05.358229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:05.358238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:05.358243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:05.358248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:05.358252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:05.358259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:05.358269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:05.358280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:05.358288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:05.358298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:05.358307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:05.358279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894867880446881:4201] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:05.358312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:05.358327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:05.358333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:05.358337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.358343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.358347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.358352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.358357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.358362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.358371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:05.358377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:05.358382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:05.358393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:05.358447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:05.363904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894867880446881:4201] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:05.363928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894867880446881:4201] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:05.363932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894867880446881:4201] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:05.363942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 291 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:05.364191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:05.365335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:05.365359Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:05.365362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:05.365366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:05.365372Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 290 [2:7555894867790722086:3694]
2025-09-30T14:51:05.365388Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:05.365405Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:05.365414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.365417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.365420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.365437Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:05.365444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:05.365451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:05.365514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.365523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.365526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.365529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:05.365531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:05.365617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:05.365726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 290
2025-09-30T14:51:05.365629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.365657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.365670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.365688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:05.365708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894867880446800:2454], now have 1 active actors on pipe
2025-09-30T14:51:05.365712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894867880446923:4201], now have 1 active actors on pipe
2025-09-30T14:51:05.365718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894867790722080:3694]
2025-09-30T14:51:05.365721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894867790722080:3694]
2025-09-30T14:51:05.365723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894867790722080:3694]
2025-09-30T14:51:05.365739Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:05.365754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:05.365757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:05.365760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:05.365763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:05.365767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:05.365770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:05.365814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894867790722080:3694]
2025-09-30T14:51:05.365830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:05.365856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:05.365855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 290
2025-09-30T14:51:05.365923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:05.365934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:05.365955Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64e270eb-a5ff2b1b-6820d5ec-84cdb5b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:05.365965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.365967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.365969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:05.365976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.365984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:05.365999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:05.366165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:05.366175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:05.366192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:05.366289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 291 partition: 0 MaxSeqNo: 42 sessionId: src_id|64e270eb-a5ff2b1b-6820d5ec-84cdb5b5_0
2025-09-30T14:51:05.366737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c6960f-567ffa79-cac812f1-58bb0168_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|64e270eb-a5ff2b1b-6820d5ec-84cdb5b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:05.369801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64e270eb-a5ff2b1b-6820d5ec-84cdb5b5_0] Write session: try to update token
2025-09-30T14:51:05.369826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64e270eb-a5ff2b1b-6820d5ec-84cdb5b5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:05.378535Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:05.378562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:05.378573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894867790722080:3694]
2025-09-30T14:51:05.378639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:05.378651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:05.378837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:05.379002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:05.379222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:05.379442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:05.379723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:05.379766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:05.387525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 291 sessionId: src_id|64e270eb-a5ff2b1b-6820d5ec-84cdb5b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:05.390522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:05.390709Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:05.390733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:05.390736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:05.390738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:05.390748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894867790722080:3694]
2025-09-30T14:51:05.390753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894867790722080:3694]
2025-09-30T14:51:05.390758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894867790722080:3694]
2025-09-30T14:51:05.390791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:05.390797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:05.390801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:05.390811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:05.390829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:05.390853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:05.390861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.390871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:05.391027Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:05.443534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894867880446930:3696]
2025-09-30T14:51:05.443891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 290, pipe: [1:7555894867880446930:3696]
2025-09-30T14:51:05.502644Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:05.502992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894867880446930:3696], now have 1 active actors on pipe
2025-09-30T14:51:05.503259Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:05.503275Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:05.503328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:05.503336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894867880446930:3696]
2025-09-30T14:51:05.503414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 291 reason: status is not ok: tablet will be restarted right now sessionId: src_id|64e270eb-a5ff2b1b-6820d5ec-84cdb5b5_0
2025-09-30T14:51:05.503646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 291 sessionId: src_id|64e270eb-a5ff2b1b-6820d5ec-84cdb5b5_0 is DEAD
2025-09-30T14:51:05.503823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64e270eb-a5ff2b1b-6820d5ec-84cdb5b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:05.503834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64e270eb-a5ff2b1b-6820d5ec-84cdb5b5_0] Write session will restart in 0.006011s
2025-09-30T14:51:05.503858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64e270eb-a5ff2b1b-6820d5ec-84cdb5b5_0] Write session: Do CDS request
2025-09-30T14:51:05.503865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64e270eb-a5ff2b1b-6820d5ec-84cdb5b5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:05.510893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64e270eb-a5ff2b1b-6820d5ec-84cdb5b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:05.511044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:05.511076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 292
2025-09-30T14:51:05.511225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 292 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:05.511298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 292 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:05.511326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=292 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:05.511334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:05.511854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 292 sessionId:  describe result for acl check
2025-09-30T14:51:05.511901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:05.511909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:05.511914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:05.511920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894867880446969:4206] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:05.512530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894867880446969:4206] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:05.514735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894867880446969:4206] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:05.515353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:05.517468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:05.517726Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:05.517739Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:05.517751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:05.517756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894867880446969:4206] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:05.517780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894867880446969:4206] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:05.517784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894867880446969:4206] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:05.517795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 292 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:05.517809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:05.517865Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894867790722208:3697]
2025-09-30T14:51:05.518504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:05.518942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:05.519032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:05.519492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:05.519589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:05.519598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:05.519599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:05.519601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:05.519602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:05.519604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:05.519605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:05.519607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:05.519609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:05.519610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:05.519611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.519613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.519614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.519615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:05.519617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:05.519625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:05.519637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:05.519642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:05.519647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:05.519652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:05.519657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:05.519661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:05.519666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:05.519670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:05.519674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:05.519679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.519683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.519687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.519692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:05.519696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:05.519706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:05.519716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:05.519724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:05.519731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:05.519736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:05.519742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:05.519748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:05.519761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:05.519767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:05.519773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:05.519778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:05.519784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:05.519795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:05.519802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:05.519811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:05.519817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:05.519830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:05.519835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:05.519843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:05.519848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:05.519854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.519863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.519867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.519878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.519883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.519894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.519904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:05.519910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:05.519921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:05.519932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:05.519989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:05.526277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:05.527360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:05.527379Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:05.527384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:05.527389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:05.527398Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 291 [2:7555894867790722208:3697]
2025-09-30T14:51:05.527418Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:05.527442Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:05.527451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.527455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.527457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.527477Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:05.527490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:05.527498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:05.527571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.527579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.527582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.527587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:05.527590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:05.527701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:05.527715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.527730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.527744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.527772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:05.527797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894867880447050:4206], now have 1 active actors on pipe
2025-09-30T14:51:05.527809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894867880446933:2454], now have 1 active actors on pipe
2025-09-30T14:51:05.527816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894867790722202:3697]
2025-09-30T14:51:05.527819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894867790722202:3697]
2025-09-30T14:51:05.527822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894867790722202:3697]
2025-09-30T14:51:05.527838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:05.527857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:05.527862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:05.527869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:05.527871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:05.527881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:05.527884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:05.527856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 291
2025-09-30T14:51:05.527858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 291
2025-09-30T14:51:05.527928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894867790722202:3697]
2025-09-30T14:51:05.527948Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:05.527969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:05.527969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:05.527981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:05.528035Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96582f75-2c2143cf-87dce44d-1dfbbb20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:05.528049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.528061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.528064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:05.528077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.528093Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:05.528122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:05.528443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:05.528457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:05.528490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:05.528588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 292 partition: 0 MaxSeqNo: 42 sessionId: src_id|96582f75-2c2143cf-87dce44d-1dfbbb20_0
2025-09-30T14:51:05.529039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64e270eb-a5ff2b1b-6820d5ec-84cdb5b5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|96582f75-2c2143cf-87dce44d-1dfbbb20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:05.532021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96582f75-2c2143cf-87dce44d-1dfbbb20_0] Write session: try to update token
2025-09-30T14:51:05.532044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96582f75-2c2143cf-87dce44d-1dfbbb20_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:05.540671Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:05.540693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:05.540696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:05.540699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:05.540708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894867790722202:3697]
2025-09-30T14:51:05.540713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894867790722202:3697]
2025-09-30T14:51:05.540717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894867790722202:3697]
2025-09-30T14:51:05.540760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:05.540760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:05.540765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:05.540768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.540769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:05.540772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:05.540924Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:05.547545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 292 sessionId: src_id|96582f75-2c2143cf-87dce44d-1dfbbb20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:05.550504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:05.603287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894867880447062:3696]
2025-09-30T14:51:05.603567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 291, pipe: [1:7555894867880447062:3696]
2025-09-30T14:51:05.663423Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:05.663752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:05.663770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:05.663793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894867880447062:3696], now have 1 active actors on pipe
2025-09-30T14:51:05.664066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:05.664080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894867880447062:3696]
2025-09-30T14:51:05.664082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:05.664103Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:05.664156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 292 reason: error at write: Disconnected sessionId: src_id|96582f75-2c2143cf-87dce44d-1dfbbb20_0
2025-09-30T14:51:05.664377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 292 sessionId: src_id|96582f75-2c2143cf-87dce44d-1dfbbb20_0 is DEAD
2025-09-30T14:51:05.664557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96582f75-2c2143cf-87dce44d-1dfbbb20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:05.664568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96582f75-2c2143cf-87dce44d-1dfbbb20_0] Write session will restart in 0.007088s
2025-09-30T14:51:05.664593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96582f75-2c2143cf-87dce44d-1dfbbb20_0] Write session: Do CDS request
2025-09-30T14:51:05.664599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96582f75-2c2143cf-87dce44d-1dfbbb20_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:05.664611Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:05.672921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96582f75-2c2143cf-87dce44d-1dfbbb20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:05.673013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:05.673035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 293
2025-09-30T14:51:05.673152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 293 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:05.673204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 293 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:05.673214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=293 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:05.673219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:05.673675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 293 sessionId:  describe result for acl check
2025-09-30T14:51:05.673713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:05.673722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:05.673724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:05.673730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894867880447142:4210] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:05.674335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894867880447142:4210] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:05.674623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:05.676173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894867880447142:4210] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:05.676875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:05.677094Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:05.677103Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:05.677116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:05.677170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:05.677210Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894867790722329:3699]
2025-09-30T14:51:05.677879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:05.678209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:05.678258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:05.678577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:05.678644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:05.678649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:05.678650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:05.678651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:05.678651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:05.678652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:05.678653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:05.678654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:05.678654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:05.678655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:05.678656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.678656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.678657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.678658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:05.678659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:05.678664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:05.678670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:05.678673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:05.678676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:05.678678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:05.678680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:05.678682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:05.678680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894867880447142:4210] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:05.678685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:05.678687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:05.678698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894867880447142:4210] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:05.678702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894867880447142:4210] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:05.678691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:05.678694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.678696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.678710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 293 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:05.678698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.678700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:05.678703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:05.678708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:05.678714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:05.678718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:05.678722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:05.678725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:05.678728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:05.678732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:05.678735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:05.678738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:05.678741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:05.678743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:05.678747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:05.678750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:05.678753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:05.678755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:05.678758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:05.678761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:05.678764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:05.678767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:05.678770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:05.678773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.678778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.678783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.678788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.678795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.678800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.678805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:05.678808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:05.678810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:05.678813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:05.678855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:05.684383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:05.685295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:05.685310Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:05.685313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:05.685317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:05.685322Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 292 [2:7555894867790722329:3699]
2025-09-30T14:51:05.685337Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:05.685351Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:05.685353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.685355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.685357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.685370Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:05.685375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:05.685380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:05.685444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.685451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.685453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.685457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:05.685460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:05.685518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:05.685526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.685540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.685555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.685569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:05.685594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894867880447063:2454], now have 1 active actors on pipe
2025-09-30T14:51:05.685605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894867880447182:4210], now have 1 active actors on pipe
2025-09-30T14:51:05.685612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894867790722323:3699]
2025-09-30T14:51:05.685614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894867790722323:3699]
2025-09-30T14:51:05.685617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894867790722323:3699]
2025-09-30T14:51:05.685629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:05.685642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:05.685656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:05.685657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:05.685660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:05.685660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:05.685662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:05.685665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 292
2025-09-30T14:51:05.685675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 292
2025-09-30T14:51:05.685700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894867790722323:3699]
2025-09-30T14:51:05.685713Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:05.685726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:05.685736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:05.685739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:05.685950Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40d0d2da-573d2140-5e89a9bf-216c472c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:05.685964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.685968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.685970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:05.685981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.685996Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:05.686024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:05.686208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:05.686232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:05.686254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:05.686379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 293 partition: 0 MaxSeqNo: 42 sessionId: src_id|40d0d2da-573d2140-5e89a9bf-216c472c_0
2025-09-30T14:51:05.686836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96582f75-2c2143cf-87dce44d-1dfbbb20_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|40d0d2da-573d2140-5e89a9bf-216c472c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:05.689643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40d0d2da-573d2140-5e89a9bf-216c472c_0] Write session: try to update token
2025-09-30T14:51:05.689666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40d0d2da-573d2140-5e89a9bf-216c472c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:05.698479Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:05.698497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:05.698501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:05.698503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:05.698512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894867790722323:3699]
2025-09-30T14:51:05.698520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894867790722323:3699]
2025-09-30T14:51:05.698524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894867790722323:3699]
2025-09-30T14:51:05.698568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:05.698567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:05.698574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.698576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:05.698577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:05.698580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:05.699122Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:05.705390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 293 sessionId: src_id|40d0d2da-573d2140-5e89a9bf-216c472c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:05.708210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:05.763997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894867880447192:3696]
2025-09-30T14:51:05.764269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 292, pipe: [1:7555894867880447192:3696]
2025-09-30T14:51:05.811188Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:05.811501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:05.811514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:05.811534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894867880447192:3696], now have 1 active actors on pipe
2025-09-30T14:51:05.811769Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:05.811762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:05.811779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:05.811783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:05.811843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 293 reason: error at write: Disconnected sessionId: src_id|40d0d2da-573d2140-5e89a9bf-216c472c_0
2025-09-30T14:51:05.811844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894867880447192:3696]
2025-09-30T14:51:05.812086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 293 sessionId: src_id|40d0d2da-573d2140-5e89a9bf-216c472c_0 is DEAD
2025-09-30T14:51:05.812233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40d0d2da-573d2140-5e89a9bf-216c472c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:05.812244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40d0d2da-573d2140-5e89a9bf-216c472c_0] Write session will restart in 0.006366s
2025-09-30T14:51:05.812268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40d0d2da-573d2140-5e89a9bf-216c472c_0] Write session: Do CDS request
2025-09-30T14:51:05.812273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40d0d2da-573d2140-5e89a9bf-216c472c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:05.819917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40d0d2da-573d2140-5e89a9bf-216c472c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:05.819962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:05.819981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 294
2025-09-30T14:51:05.820180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 294 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:05.820222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 294 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:05.820227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=294 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:05.820232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:05.820819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 294 sessionId:  describe result for acl check
2025-09-30T14:51:05.820864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:05.820866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:05.820870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:05.820876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894867880447285:4215] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:05.821366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894867880447285:4215] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:05.821894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:05.823354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894867880447285:4215] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:05.824110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:05.824325Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:05.824336Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:05.824347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:05.824398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:05.824438Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894867790722463:3702]
2025-09-30T14:51:05.825085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:05.825420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:05.825467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:05.825805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:05.825899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:05.825909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:05.825910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:05.825911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:05.825912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:05.825913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:05.825915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:05.825916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:05.825917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:05.825918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:05.825919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.825921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.825922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.825924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:05.825925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:05.825931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:05.825942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:05.825946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:05.825951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:05.825955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:05.825960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:05.825964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:05.825968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:05.825973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:05.825977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:05.825981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.825986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.825990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.825995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:05.825999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:05.826007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:05.826015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:05.826021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:05.826027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:05.826032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:05.826039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:05.826044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:05.826049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:05.826054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:05.826060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:05.826071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:05.826077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:05.826082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:05.826087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:05.826097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:05.826102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:05.826109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:05.826118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:05.826123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:05.826130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:05.826140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.826146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.826155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.826161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.826171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.826176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.826186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:05.826191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:05.826196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:05.826206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:05.826175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894867880447285:4215] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:05.826194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894867880447285:4215] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:05.826198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894867880447285:4215] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:05.826206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 294 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:05.826250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:05.831898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:05.832778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:05.832794Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:05.832798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:05.832801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:05.832809Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 293 [2:7555894867790722463:3702]
2025-09-30T14:51:05.832828Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:05.832844Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:05.832851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.832854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.832856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.832868Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:05.832874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:05.832880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:05.832934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.832943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.832948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.832952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:05.832961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:05.833020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:05.833028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.833042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.833054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.833078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:05.833099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894867880447205:2454], now have 1 active actors on pipe
2025-09-30T14:51:05.833110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894867790722457:3702]
2025-09-30T14:51:05.833112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894867790722457:3702]
2025-09-30T14:51:05.833114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894867790722457:3702]
2025-09-30T14:51:05.833128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:05.833143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894867880447325:4215], now have 1 active actors on pipe
2025-09-30T14:51:05.833147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:05.833151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:05.833153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:05.833155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:05.833169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:05.833177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:05.833213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894867790722457:3702]
2025-09-30T14:51:05.833226Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:05.833212Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 293
2025-09-30T14:51:05.833243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:05.833237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 293
2025-09-30T14:51:05.833284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:05.833292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:05.833316Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|497aa2fd-1ae22f0-f494cd50-aa1d6a20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:05.833328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.833332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.833338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:05.833349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.833378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:05.833395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:05.833548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:05.833555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:05.833566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:05.833665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 294 partition: 0 MaxSeqNo: 42 sessionId: src_id|497aa2fd-1ae22f0-f494cd50-aa1d6a20_0
2025-09-30T14:51:05.834097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40d0d2da-573d2140-5e89a9bf-216c472c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|497aa2fd-1ae22f0-f494cd50-aa1d6a20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:05.836996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|497aa2fd-1ae22f0-f494cd50-aa1d6a20_0] Write session: try to update token
2025-09-30T14:51:05.837014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|497aa2fd-1ae22f0-f494cd50-aa1d6a20_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:05.851270Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:05.851291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:05.851302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894867790722457:3702]
2025-09-30T14:51:05.851351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:05.851356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:05.851528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:05.851689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:05.851846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:05.851998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:05.852338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:05.852382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:05.856798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 294 sessionId: src_id|497aa2fd-1ae22f0-f494cd50-aa1d6a20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:05.858325Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:05.858344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:05.858347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:05.858349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:05.858359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894867790722457:3702]
2025-09-30T14:51:05.858364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894867790722457:3702]
2025-09-30T14:51:05.858368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894867790722457:3702]
2025-09-30T14:51:05.858411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:05.858419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:05.858425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.858426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:05.858428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:05.858431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:05.858575Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:05.859721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:05.912001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894867880447335:3696]
2025-09-30T14:51:05.912235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 293, pipe: [1:7555894867880447335:3696]
2025-09-30T14:51:05.974496Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:05.975214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:05.975233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:05.975274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894867880447335:3696], now have 1 active actors on pipe
2025-09-30T14:51:05.975467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:05.975507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:05.975511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:05.975504Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:05.975524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894867880447335:3696]
2025-09-30T14:51:05.975573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 294 reason: error at write: Disconnected sessionId: src_id|497aa2fd-1ae22f0-f494cd50-aa1d6a20_0
2025-09-30T14:51:05.975789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 294 sessionId: src_id|497aa2fd-1ae22f0-f494cd50-aa1d6a20_0 is DEAD
2025-09-30T14:51:05.975967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|497aa2fd-1ae22f0-f494cd50-aa1d6a20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:05.975979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|497aa2fd-1ae22f0-f494cd50-aa1d6a20_0] Write session will restart in 0.009164s
2025-09-30T14:51:05.976001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|497aa2fd-1ae22f0-f494cd50-aa1d6a20_0] Write session: Do CDS request
2025-09-30T14:51:05.976009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|497aa2fd-1ae22f0-f494cd50-aa1d6a20_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:05.985814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:05.986831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|497aa2fd-1ae22f0-f494cd50-aa1d6a20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:05.986961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:05.986978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 295
2025-09-30T14:51:05.987108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 295 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:05.987134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 295 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:05.987142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=295 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:05.987145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:05.987524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 295 sessionId:  describe result for acl check
2025-09-30T14:51:05.987558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:05.987565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:05.987567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:05.987573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894867880447431:4221] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:05.987605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:05.987790Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:05.987798Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:05.987806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:05.987868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:05.987906Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894867790722586:3704]
2025-09-30T14:51:05.988121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894867880447431:4221] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:05.988568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:05.988915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:05.988982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:05.989346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:05.989416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:05.989422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:05.989422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:05.989423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:05.989424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:05.989425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:05.989426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:05.989426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:05.989427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:05.989428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:05.989429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.989429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.989430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.989431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:05.989431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:05.989440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:05.989449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:05.989453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:05.989457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:05.989461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:05.989465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:05.989468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:05.989472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:05.989475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:05.989479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:05.989483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.989487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.989490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.989494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:05.989498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:05.989507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:05.989515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:05.989523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:05.989529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:05.989534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:05.989541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:05.989548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:05.989553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:05.989559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:05.989571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:05.989575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:05.989585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:05.989590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:05.989597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:05.989601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:05.989607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:05.989615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:05.989621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:05.989629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:05.989634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:05.989639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.989648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.989664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.989673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.989678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.989687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.989692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:05.989697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:05.989705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:05.989710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:05.989758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:05.989979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894867880447431:4221] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:05.995439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:05.996264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:05.996279Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:05.996281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:05.996284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:05.996291Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 294 [2:7555894867790722586:3704]
2025-09-30T14:51:05.996304Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:05.996299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894867880447431:4221] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:05.996317Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:05.996319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894867880447431:4221] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:05.996319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.996322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.996323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894867880447431:4221] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:05.996323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.996331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 295 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:05.996335Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:05.996340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:05.996345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:05.996392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.996400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.996402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.996406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:05.996408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:05.996475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:05.996483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:05.996494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:05.996505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:05.996527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:05.996549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894867880447346:2454], now have 1 active actors on pipe
2025-09-30T14:51:05.996561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894867790722580:3704]
2025-09-30T14:51:05.996563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894867790722580:3704]
2025-09-30T14:51:05.996567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894867790722580:3704]
2025-09-30T14:51:05.996579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:05.996588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894867880447466:4221], now have 1 active actors on pipe
2025-09-30T14:51:05.996582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 294
2025-09-30T14:51:05.996595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:05.996598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:05.996615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 294
2025-09-30T14:51:05.996600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:05.996601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:05.996614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:05.996617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:05.996655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894867790722580:3704]
2025-09-30T14:51:05.996667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:05.996684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:05.996685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:05.996690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:05.996729Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb028648-a5cba91c-f04e627-b67a965e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:05.996743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.996746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.996750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:05.996758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.996768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:05.996784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:05.996934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:05.996942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:05.996956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:05.997033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 295 partition: 0 MaxSeqNo: 42 sessionId: src_id|eb028648-a5cba91c-f04e627-b67a965e_0
2025-09-30T14:51:05.997394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|497aa2fd-1ae22f0-f494cd50-aa1d6a20_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|eb028648-a5cba91c-f04e627-b67a965e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:06.000247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb028648-a5cba91c-f04e627-b67a965e_0] Write session: try to update token
2025-09-30T14:51:06.000266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb028648-a5cba91c-f04e627-b67a965e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:06.008945Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:06.008966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:06.008969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:06.008971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:06.008980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894867790722580:3704]
2025-09-30T14:51:06.008985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894867790722580:3704]
2025-09-30T14:51:06.008989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894867790722580:3704]
2025-09-30T14:51:06.009033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:06.009035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:06.009041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.009041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:06.009044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:06.009059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:06.009205Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:06.020643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 295 sessionId: src_id|eb028648-a5cba91c-f04e627-b67a965e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:06.023374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:06.075828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894872175414786:3696]
2025-09-30T14:51:06.076086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 294, pipe: [1:7555894872175414786:3696]
2025-09-30T14:51:06.124321Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:06.124862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:06.124877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:06.124895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894872175414786:3696], now have 1 active actors on pipe
2025-09-30T14:51:06.125165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894872175414786:3696]
2025-09-30T14:51:06.125180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:06.125185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:06.125198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:06.125268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 295 reason: error at write: Disconnected sessionId: src_id|eb028648-a5cba91c-f04e627-b67a965e_0
2025-09-30T14:51:06.125425Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:06.125496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 295 sessionId: src_id|eb028648-a5cba91c-f04e627-b67a965e_0 is DEAD
2025-09-30T14:51:06.125647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb028648-a5cba91c-f04e627-b67a965e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:06.125658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb028648-a5cba91c-f04e627-b67a965e_0] Write session will restart in 0.007546s
2025-09-30T14:51:06.125681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb028648-a5cba91c-f04e627-b67a965e_0] Write session: Do CDS request
2025-09-30T14:51:06.125687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb028648-a5cba91c-f04e627-b67a965e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:06.134738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:06.134862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb028648-a5cba91c-f04e627-b67a965e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:06.134953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:06.134971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 296
2025-09-30T14:51:06.135106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 296 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:06.135138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 296 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:06.135157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=296 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:06.135165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:06.135628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 296 sessionId:  describe result for acl check
2025-09-30T14:51:06.135676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:06.135684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:06.135686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:06.135692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894872175414885:4232] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:06.136237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894872175414885:4232] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:06.137056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:06.137256Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:06.137265Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:06.137273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:06.137323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:06.137358Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894872085690043:3719]
2025-09-30T14:51:06.137961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:06.138279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:06.138310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:06.138447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894872175414885:4232] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:06.138612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:06.138674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:06.138680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:06.138682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:06.138683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:06.138684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:06.138689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:06.138690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:06.138692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:06.138693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:06.138694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:06.138695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.138696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.138697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.138698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:06.138699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:06.138705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:06.138716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:06.138720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:06.138724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:06.138728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:06.138732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:06.138736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:06.138740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:06.138744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:06.138748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:06.138753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.138758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.138761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.138766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:06.138770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:06.138776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:06.138784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:06.138790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:06.138796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:06.138800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:06.138805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:06.138815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:06.138821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:06.138825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:06.138831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:06.138835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:06.138846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:06.138855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:06.138860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:06.138863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:06.138872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:06.138877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:06.138888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:06.138892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:06.138900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:06.138904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.138908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.138917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.138921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.138927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.138936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.138940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:06.138950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:06.138954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:06.138960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:06.139005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:06.144322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894872175414885:4232] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:06.144339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894872175414885:4232] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:06.144342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894872175414885:4232] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:06.144348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 296 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:06.144508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:06.145423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:06.145440Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:06.145442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:06.145445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:06.145450Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 295 [2:7555894872085690043:3719]
2025-09-30T14:51:06.145463Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:06.145476Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:06.145477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:06.145480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:06.145481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:06.145494Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:06.145499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:06.145504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:06.145552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.145558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.145560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.145562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:06.145565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:06.145620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:06.145627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.145639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.145655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.145670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:06.145688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894872175414921:4232], now have 1 active actors on pipe
2025-09-30T14:51:06.145691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894872175414799:2454], now have 1 active actors on pipe
2025-09-30T14:51:06.145696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894872085690037:3719]
2025-09-30T14:51:06.145702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894872085690037:3719]
2025-09-30T14:51:06.145704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894872085690037:3719]
2025-09-30T14:51:06.145712Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:06.145723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:06.145729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:06.145733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:06.145735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:06.145743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:06.145745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:06.145779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894872085690037:3719]
2025-09-30T14:51:06.145788Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:06.145767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 295
2025-09-30T14:51:06.145781Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 295
2025-09-30T14:51:06.145800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:06.145810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:06.145813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:06.145858Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2028d2d-c442a6bb-f7aae636-581735c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:06.145868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:06.145871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:06.145873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:06.145880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:06.145887Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:06.145906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:06.146057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:06.146063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:06.146074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:06.146150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 296 partition: 0 MaxSeqNo: 42 sessionId: src_id|e2028d2d-c442a6bb-f7aae636-581735c6_0
2025-09-30T14:51:06.146524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb028648-a5cba91c-f04e627-b67a965e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e2028d2d-c442a6bb-f7aae636-581735c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:06.149682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2028d2d-c442a6bb-f7aae636-581735c6_0] Write session: try to update token
2025-09-30T14:51:06.149706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2028d2d-c442a6bb-f7aae636-581735c6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:06.158642Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:06.158663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:06.158665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:06.158667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:06.158678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894872085690037:3719]
2025-09-30T14:51:06.158684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894872085690037:3719]
2025-09-30T14:51:06.158689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894872085690037:3719]
2025-09-30T14:51:06.158735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:06.158746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.158747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:06.158749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:06.158753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:06.158758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:06.159003Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:06.166549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 296 sessionId: src_id|e2028d2d-c442a6bb-f7aae636-581735c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:06.170246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:06.225336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894872175414929:3696]
2025-09-30T14:51:06.225632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 295, pipe: [1:7555894872175414929:3696]
2025-09-30T14:51:06.268159Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:06.268431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:06.268445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:06.268463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894872175414929:3696], now have 1 active actors on pipe
2025-09-30T14:51:06.268660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894872175414929:3696]
2025-09-30T14:51:06.268696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:06.268701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:06.268707Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:06.268764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 296 reason: error at write: Disconnected sessionId: src_id|e2028d2d-c442a6bb-f7aae636-581735c6_0
2025-09-30T14:51:06.268985Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:06.269020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 296 sessionId: src_id|e2028d2d-c442a6bb-f7aae636-581735c6_0 is DEAD
2025-09-30T14:51:06.269178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2028d2d-c442a6bb-f7aae636-581735c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:06.269189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2028d2d-c442a6bb-f7aae636-581735c6_0] Write session will restart in 0.007420s
2025-09-30T14:51:06.269222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2028d2d-c442a6bb-f7aae636-581735c6_0] Write session: Do CDS request
2025-09-30T14:51:06.269231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2028d2d-c442a6bb-f7aae636-581735c6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:06.277851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2028d2d-c442a6bb-f7aae636-581735c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:06.277983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:06.278014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 297
2025-09-30T14:51:06.278172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 297 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:06.278225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 297 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:06.278238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=297 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:06.278242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:06.278659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 297 sessionId:  describe result for acl check
2025-09-30T14:51:06.278691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:06.278696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:06.278697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:06.278702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894872175415014:4236] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:06.279222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894872175415014:4236] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:06.279652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:06.281504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894872175415014:4236] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:06.281902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:06.282137Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:06.282150Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:06.282161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:06.282212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:06.282246Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894872085690167:3721]
2025-09-30T14:51:06.282825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:06.283171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:06.283232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:06.283612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:06.283678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:06.283684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:06.283686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:06.283687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:06.283688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:06.283689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:06.283691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:06.283692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:06.283693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:06.283694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:06.283695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.283697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.283698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.283699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:06.283700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:06.283706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:06.283716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:06.283721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:06.283725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:06.283729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:06.283733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:06.283737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:06.283741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:06.283745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:06.283749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:06.283753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.283757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.283761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.283765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:06.283769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:06.283777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:06.283785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:06.283791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:06.283797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:06.283803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:06.283809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:06.283814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:06.283819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:06.283824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:06.283830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:06.283835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:06.283840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:06.283845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:06.283850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:06.283856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:06.283863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:06.283868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:06.283873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:06.283882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:06.283888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:06.283892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.283897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.283906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.283912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.283921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.283927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.283935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:06.283908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894872175415014:4236] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:06.283941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:06.283947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:06.283953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:06.283924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894872175415014:4236] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:06.283927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894872175415014:4236] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:06.283934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 297 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:06.283997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:06.289743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:06.290705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:06.290724Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:06.290727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:06.290732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:06.290739Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 296 [2:7555894872085690167:3721]
2025-09-30T14:51:06.290758Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:06.290776Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:06.290779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:06.290782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:06.290790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:06.290808Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:06.290819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:06.290831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:06.291046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.291057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.291059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.291062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:06.291065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:06.291135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:06.291144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.291160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.291172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.291194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:06.291218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894872175415054:4236], now have 1 active actors on pipe
2025-09-30T14:51:06.291227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894872175414931:2454], now have 1 active actors on pipe
2025-09-30T14:51:06.291233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894872085690161:3721]
2025-09-30T14:51:06.291237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894872085690161:3721]
2025-09-30T14:51:06.291239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894872085690161:3721]
2025-09-30T14:51:06.291270Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:06.291284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:06.291295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:06.291298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:06.291300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 296
2025-09-30T14:51:06.291301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:06.291305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 296
2025-09-30T14:51:06.291312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:06.291314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:06.291336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894872085690161:3721]
2025-09-30T14:51:06.291339Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:06.291350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:06.291379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:06.291389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:06.291417Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7367f705-3804c30a-e456eef6-f3f75622_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:06.291430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:06.291434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:06.291436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:06.291446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:06.291463Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:06.291478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:06.291624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:06.291634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:06.291647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:06.291741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 297 partition: 0 MaxSeqNo: 42 sessionId: src_id|7367f705-3804c30a-e456eef6-f3f75622_0
2025-09-30T14:51:06.292184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2028d2d-c442a6bb-f7aae636-581735c6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7367f705-3804c30a-e456eef6-f3f75622_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:06.295094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7367f705-3804c30a-e456eef6-f3f75622_0] Write session: try to update token
2025-09-30T14:51:06.295112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7367f705-3804c30a-e456eef6-f3f75622_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:06.305332Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:06.305354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:06.305357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:06.305359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:06.305369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894872085690161:3721]
2025-09-30T14:51:06.305375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894872085690161:3721]
2025-09-30T14:51:06.305382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894872085690161:3721]
2025-09-30T14:51:06.305426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:06.305438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.305440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:06.305439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:06.305448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:06.305453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:06.305589Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:06.310712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 297 sessionId: src_id|7367f705-3804c30a-e456eef6-f3f75622_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:06.313548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:06.368705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894872175415064:3696]
2025-09-30T14:51:06.369033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 296, pipe: [1:7555894872175415064:3696]
2025-09-30T14:51:06.423829Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:06.424183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:06.424202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:06.424240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894872175415064:3696], now have 1 active actors on pipe
2025-09-30T14:51:06.424468Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:06.424497Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:06.424518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:06.424526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:06.424575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894872175415064:3696]
2025-09-30T14:51:06.424603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 297 reason: error at write: Disconnected sessionId: src_id|7367f705-3804c30a-e456eef6-f3f75622_0
2025-09-30T14:51:06.424822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 297 sessionId: src_id|7367f705-3804c30a-e456eef6-f3f75622_0 is DEAD
2025-09-30T14:51:06.424941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7367f705-3804c30a-e456eef6-f3f75622_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:06.424951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7367f705-3804c30a-e456eef6-f3f75622_0] Write session will restart in 0.008131s
2025-09-30T14:51:06.424972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7367f705-3804c30a-e456eef6-f3f75622_0] Write session: Do CDS request
2025-09-30T14:51:06.424980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7367f705-3804c30a-e456eef6-f3f75622_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:06.434767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7367f705-3804c30a-e456eef6-f3f75622_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:06.435001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:06.435021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 298
2025-09-30T14:51:06.435091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:06.435159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 298 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:06.435193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 298 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:06.435203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=298 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:06.435207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:06.435670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 298 sessionId:  describe result for acl check
2025-09-30T14:51:06.435711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:06.435718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:06.435720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:06.435726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894872175415152:4240] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:06.436301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894872175415152:4240] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:06.437511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:06.437737Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:06.437747Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:06.437757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:06.437821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:06.437858Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894872085690292:3723]
2025-09-30T14:51:06.438536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:06.438826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:06.438877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:06.439212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:06.439287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:06.439294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:06.439296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:06.439297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:06.439299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:06.439300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:06.439301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:06.439303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:06.439304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:06.439305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:06.439307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.439308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.439309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.439310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:06.439311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:06.439317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:06.439348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894872175415152:4240] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:06.439328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:06.439332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:06.439337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:06.439341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:06.439344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:06.439348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:06.439351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:06.439355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:06.439359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:06.439363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.439367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.439370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.439374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:06.439378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:06.439385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:06.439393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:06.439400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:06.439406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:06.439412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:06.439417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:06.439422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:06.439427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:06.439432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:06.439437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:06.439442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:06.439446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:06.439451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:06.439455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:06.439459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:06.439465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:06.439470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:06.439476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:06.439480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:06.439486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:06.439490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.439496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.439501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.439506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.439510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.439522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.439526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:06.439531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:06.439535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:06.439541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:06.439590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:06.444860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894872175415152:4240] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:06.444883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894872175415152:4240] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:06.444891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894872175415152:4240] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:06.444900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 298 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:06.445262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:06.446196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:06.446212Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:06.446214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:06.446218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:06.446223Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 297 [2:7555894872085690292:3723]
2025-09-30T14:51:06.446237Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:06.446250Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:06.446252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:06.446254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:06.446256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:06.446270Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:06.446276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:06.446281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:06.446347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.446354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.446357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.446362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:06.446365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:06.446427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:06.446433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.446442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.446449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.446468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:06.446494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894872175415193:4240], now have 1 active actors on pipe
2025-09-30T14:51:06.446500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894872085690286:3723]
2025-09-30T14:51:06.446503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894872085690286:3723]
2025-09-30T14:51:06.446505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894872085690286:3723]
2025-09-30T14:51:06.446519Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:06.446533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894872175415065:2454], now have 1 active actors on pipe
2025-09-30T14:51:06.446533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:06.446536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:06.446539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:06.446546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:06.446560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:06.446563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:06.446612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894872085690286:3723]
2025-09-30T14:51:06.446611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 297
2025-09-30T14:51:06.446625Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:06.446622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 297
2025-09-30T14:51:06.446650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:06.446809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:06.446824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:06.446848Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd199858-9e7ac5f8-70339da1-d6556f53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:06.446857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:06.446860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:06.446863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:06.446872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:06.446883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:06.446897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:06.447054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:06.447063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:06.447077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:06.447160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 298 partition: 0 MaxSeqNo: 42 sessionId: src_id|cd199858-9e7ac5f8-70339da1-d6556f53_0
2025-09-30T14:51:06.447579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7367f705-3804c30a-e456eef6-f3f75622_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cd199858-9e7ac5f8-70339da1-d6556f53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:06.450499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd199858-9e7ac5f8-70339da1-d6556f53_0] Write session: try to update token
2025-09-30T14:51:06.450518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd199858-9e7ac5f8-70339da1-d6556f53_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:06.458931Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:06.458956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:06.458967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894872085690286:3723]
2025-09-30T14:51:06.459015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:06.459015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:06.459286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:06.459452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:06.459607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:06.459766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:06.460106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:06.460163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:06.466127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 298 sessionId: src_id|cd199858-9e7ac5f8-70339da1-d6556f53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:06.469463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:06.469590Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:06.469612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:06.469615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:06.469617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:06.469628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894872085690286:3723]
2025-09-30T14:51:06.469632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894872085690286:3723]
2025-09-30T14:51:06.469636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894872085690286:3723]
2025-09-30T14:51:06.469687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:06.469688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:06.469694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:06.469698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:06.469701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:06.469720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:06.469731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.469734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:06.469877Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:06.527336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894872175415200:3696]
2025-09-30T14:51:06.527689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 297, pipe: [1:7555894872175415200:3696]
2025-09-30T14:51:06.595212Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:06.595534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894872175415200:3696], now have 1 active actors on pipe
2025-09-30T14:51:06.595733Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:06.599421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894872175415200:3696]
2025-09-30T14:51:06.599487Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:06.599532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:06.599612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 298 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cd199858-9e7ac5f8-70339da1-d6556f53_0
2025-09-30T14:51:06.599810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 298 sessionId: src_id|cd199858-9e7ac5f8-70339da1-d6556f53_0 is DEAD
2025-09-30T14:51:06.603487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd199858-9e7ac5f8-70339da1-d6556f53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:06.603501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd199858-9e7ac5f8-70339da1-d6556f53_0] Write session will restart in 0.006048s
2025-09-30T14:51:06.603534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd199858-9e7ac5f8-70339da1-d6556f53_0] Write session: Do CDS request
2025-09-30T14:51:06.603540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd199858-9e7ac5f8-70339da1-d6556f53_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:06.607513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:06.609555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:06.609731Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:06.609738Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:06.609746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:06.609794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:06.609842Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894872085690420:3726]
2025-09-30T14:51:06.610445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:06.610795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:06.610845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:06.610857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd199858-9e7ac5f8-70339da1-d6556f53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:06.611186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:06.611281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:06.611288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:06.611290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:06.611290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:06.611292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:06.611293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:06.611294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:06.611295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:06.611296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:06.611297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:06.611299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.611300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.611301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.611302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:06.611304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:06.611310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:06.611320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:06.611324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:06.611327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:06.611331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:06.611335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:06.611338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:06.611342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:06.611345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:06.611349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:06.611353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.611357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.611360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.611364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:06.611368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:06.611376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:06.611384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:06.611390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:06.611396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:06.611401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:06.611406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:06.611410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:06.611416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:06.611421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:06.611426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:06.611431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:06.611436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:06.611441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:06.611446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:06.611450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:06.611455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:06.611460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:06.611473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:06.611478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:06.611484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:06.611490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.611496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.611502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.611513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.611518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.611524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.611499Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:06.611519Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 299
2025-09-30T14:51:06.611533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:06.611539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:06.611547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:06.611552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:06.611600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:06.611758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 299 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:06.611786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 299 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:06.611791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=299 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:06.611795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:06.612160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 299 sessionId:  describe result for acl check
2025-09-30T14:51:06.612185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:06.612187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:06.612189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:06.612194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894872175415294:4245] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:06.612699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894872175415294:4245] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:06.618007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:06.619315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:06.619328Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:06.619332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:06.619338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:06.619347Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 298 [2:7555894872085690420:3726]
2025-09-30T14:51:06.619368Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:06.619387Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:06.619391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:06.619394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:06.619396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:06.619416Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:06.619423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:06.619430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:06.619502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.619506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.619508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.619511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:06.619514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:06.619595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:06.619597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.619611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.619622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.619638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:06.619660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894872175415206:2454], now have 1 active actors on pipe
2025-09-30T14:51:06.619669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894872085690415:3726]
2025-09-30T14:51:06.619672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894872085690415:3726]
2025-09-30T14:51:06.619674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894872085690415:3726]
2025-09-30T14:51:06.619689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:06.619703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:06.619704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:06.619707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:06.619709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:06.619719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:06.619723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:06.619761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894872085690415:3726]
2025-09-30T14:51:06.619769Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:06.619784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:06.619710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 298
2025-09-30T14:51:06.621361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894872175415294:4245] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:06.627524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894872175415294:4245] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:06.627546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894872175415294:4245] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:06.627553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894872175415294:4245] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:06.627562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 299 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:06.627955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894872175415332:4245], now have 1 active actors on pipe
2025-09-30T14:51:06.628117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 298
2025-09-30T14:51:06.628301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:06.628320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:06.628371Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e593f66-6529ca15-73c66979-2cb6dff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:06.628391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:06.628395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:06.628398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:06.628412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:06.628434Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:06.628455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:06.628741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:06.628756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:06.628776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:06.628915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 299 partition: 0 MaxSeqNo: 42 sessionId: src_id|5e593f66-6529ca15-73c66979-2cb6dff_0
2025-09-30T14:51:06.629314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd199858-9e7ac5f8-70339da1-d6556f53_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5e593f66-6529ca15-73c66979-2cb6dff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:06.632327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e593f66-6529ca15-73c66979-2cb6dff_0] Write session: try to update token
2025-09-30T14:51:06.632350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e593f66-6529ca15-73c66979-2cb6dff_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:06.632918Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:06.632936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:06.632945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894872085690415:3726]
2025-09-30T14:51:06.632990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:06.632990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:06.633167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:06.633381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:06.633564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:06.633717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:06.633934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:06.633988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:06.646697Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:06.646720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:06.646722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:06.646724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:06.646733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894872085690415:3726]
2025-09-30T14:51:06.646736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894872085690415:3726]
2025-09-30T14:51:06.646740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894872085690415:3726]
2025-09-30T14:51:06.646780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:06.646788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:06.646789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.646792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:06.646793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:06.646796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:06.646933Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:06.651654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 299 sessionId: src_id|5e593f66-6529ca15-73c66979-2cb6dff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:06.654836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:06.699404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894872175415336:3696]
2025-09-30T14:51:06.699723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 298, pipe: [1:7555894872175415336:3696]
2025-09-30T14:51:06.760058Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:06.760372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:06.760388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:06.760410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894872175415336:3696], now have 1 active actors on pipe
2025-09-30T14:51:06.760656Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:06.760643Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:06.760690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894872175415336:3696]
2025-09-30T14:51:06.760701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:06.760704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:06.761234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e593f66-6529ca15-73c66979-2cb6dff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:06.761254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e593f66-6529ca15-73c66979-2cb6dff_0] Write session will restart in 0.007542s
2025-09-30T14:51:06.761278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e593f66-6529ca15-73c66979-2cb6dff_0] Write session: Do CDS request
2025-09-30T14:51:06.761285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e593f66-6529ca15-73c66979-2cb6dff_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:06.760773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 299 reason: error at write: Disconnected sessionId: src_id|5e593f66-6529ca15-73c66979-2cb6dff_0
2025-09-30T14:51:06.761000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 299 sessionId: src_id|5e593f66-6529ca15-73c66979-2cb6dff_0 is DEAD
2025-09-30T14:51:06.769837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e593f66-6529ca15-73c66979-2cb6dff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:06.769921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:06.769942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 300
2025-09-30T14:51:06.770078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 300 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:06.770106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 300 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:06.770112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=300 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:06.770116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:06.770595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 300 sessionId:  describe result for acl check
2025-09-30T14:51:06.770643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:06.770652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:06.770654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:06.770661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894872175415423:4249] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:06.771222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894872175415423:4249] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:06.772106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:06.773042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894872175415423:4249] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:06.773937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:06.774154Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:06.774165Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:06.774176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:06.774236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:06.774272Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894872085690559:3729]
2025-09-30T14:51:06.774944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:06.775290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:06.775350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:06.775395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894872175415423:4249] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:06.775410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894872175415423:4249] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:06.775413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894872175415423:4249] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:06.775421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 300 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:06.775700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:06.775759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:06.775765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:06.775766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:06.775767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:06.775769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:06.775770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:06.775771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:06.775772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:06.775774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:06.775774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:06.775776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.775777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.775778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.775779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:06.775780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:06.775785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:06.775794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:06.775797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:06.775801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:06.775804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:06.775808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:06.775811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:06.775815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:06.775819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:06.775822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:06.775826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.775829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.775832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.775836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:06.775839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:06.775847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:06.775854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:06.775859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:06.775864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:06.775869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:06.775874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:06.775887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:06.775897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:06.775901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:06.775905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:06.775913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:06.775918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:06.775922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:06.775927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:06.775935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:06.775940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:06.775944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:06.775949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:06.775954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:06.775962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:06.775966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.775971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.775974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.775983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.775987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.775991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.775994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:06.775999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:06.776003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:06.776012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:06.776050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:06.781639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:06.782772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:06.782788Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:06.782790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:06.782794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:06.782800Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 299 [2:7555894872085690559:3729]
2025-09-30T14:51:06.782814Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:06.782833Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:06.782837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:06.782840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:06.782842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:06.782857Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:06.782864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:06.782870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:06.782930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.782938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.782940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.782944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:06.782946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:06.783011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:06.783019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.783031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.783042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.783057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:06.783076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894872085690553:3729]
2025-09-30T14:51:06.783079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894872085690553:3729]
2025-09-30T14:51:06.783081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894872085690553:3729]
2025-09-30T14:51:06.783089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:06.783103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:06.783107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:06.783111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:06.783113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:06.783116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:06.783118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:06.783127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894872175415337:2454], now have 1 active actors on pipe
2025-09-30T14:51:06.783131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894872175415463:4249], now have 1 active actors on pipe
2025-09-30T14:51:06.783163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894872085690553:3729]
2025-09-30T14:51:06.783175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:06.783192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:06.783217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 299
2025-09-30T14:51:06.783221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 299
2025-09-30T14:51:06.783461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:06.783480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:06.783514Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5efdfa54-e77f7ba3-edbffbe7-c4db4f4e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:06.783524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:06.783528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:06.783530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:06.783541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:06.783553Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:06.783576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:06.783774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:06.783788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:06.783820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:06.784051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 300 partition: 0 MaxSeqNo: 42 sessionId: src_id|5efdfa54-e77f7ba3-edbffbe7-c4db4f4e_0
2025-09-30T14:51:06.784481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e593f66-6529ca15-73c66979-2cb6dff_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5efdfa54-e77f7ba3-edbffbe7-c4db4f4e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:06.787181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5efdfa54-e77f7ba3-edbffbe7-c4db4f4e_0] Write session: try to update token
2025-09-30T14:51:06.787198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5efdfa54-e77f7ba3-edbffbe7-c4db4f4e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:06.795949Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:06.795973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:06.795976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:06.795978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:06.795988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894872085690553:3729]
2025-09-30T14:51:06.795992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894872085690553:3729]
2025-09-30T14:51:06.795997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894872085690553:3729]
2025-09-30T14:51:06.796040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:06.796052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:06.796058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.796063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:06.796064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:06.796067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:06.796214Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:06.803273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 300 sessionId: src_id|5efdfa54-e77f7ba3-edbffbe7-c4db4f4e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:06.806225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:06.861044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894872175415484:3696]
2025-09-30T14:51:06.861427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 299, pipe: [1:7555894872175415484:3696]
2025-09-30T14:51:06.909447Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:06.909866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:06.909883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:06.909902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894872175415484:3696], now have 1 active actors on pipe
2025-09-30T14:51:06.910118Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:06.910167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:06.910193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:06.910237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894872175415484:3696]
2025-09-30T14:51:06.910271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 300 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5efdfa54-e77f7ba3-edbffbe7-c4db4f4e_0
2025-09-30T14:51:06.910501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 300 sessionId: src_id|5efdfa54-e77f7ba3-edbffbe7-c4db4f4e_0 is DEAD
2025-09-30T14:51:06.910681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5efdfa54-e77f7ba3-edbffbe7-c4db4f4e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:06.910691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5efdfa54-e77f7ba3-edbffbe7-c4db4f4e_0] Write session will restart in 0.005737s
2025-09-30T14:51:06.910714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5efdfa54-e77f7ba3-edbffbe7-c4db4f4e_0] Write session: Do CDS request
2025-09-30T14:51:06.910720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5efdfa54-e77f7ba3-edbffbe7-c4db4f4e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:06.917833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5efdfa54-e77f7ba3-edbffbe7-c4db4f4e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:06.917953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:06.917972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 301
2025-09-30T14:51:06.918091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 301 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:06.918124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 301 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:06.918134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=301 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:06.918142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:06.918616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 301 sessionId:  describe result for acl check
2025-09-30T14:51:06.918656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:06.918663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:06.918665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:06.918670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894872175415520:4254] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:06.919229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894872175415520:4254] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:06.921423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894872175415520:4254] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:06.921822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:06.923552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:06.923754Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:06.923762Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:06.923771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:06.923813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:06.923858Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894872085690686:3731]
2025-09-30T14:51:06.923973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894872175415520:4254] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:06.923990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894872175415520:4254] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:06.923994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894872175415520:4254] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:06.924002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 301 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:06.924432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:06.924698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:06.924729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:06.924982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:06.925027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:06.925033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:06.925034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:06.925035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:06.925036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:06.925037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:06.925038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:06.925040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:06.925041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:06.925042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:06.925043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.925043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.925044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.925045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:06.925047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:06.925052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:06.925063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:06.925067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:06.925071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:06.925075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:06.925078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:06.925080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:06.925083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:06.925085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:06.925087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:06.925090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.925092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.925094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.925096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:06.925098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:06.925104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:06.925109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:06.925112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:06.925116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:06.925118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:06.925121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:06.925123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:06.925127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:06.925129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:06.925133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:06.925136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:06.925140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:06.925143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:06.925147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:06.925149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:06.925152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:06.925155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:06.925158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:06.925163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:06.925168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:06.925172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.925177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.925181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.925186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.925190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.925194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.925198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:06.925203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:06.925208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:06.925213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:06.925257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:06.930951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:06.931890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:06.931911Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:06.931915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:06.931919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:06.931927Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 300 [2:7555894872085690686:3731]
2025-09-30T14:51:06.931944Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:06.931960Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:06.931964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:06.931968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:06.931972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:06.931988Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:06.932003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:06.932011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:06.932074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.932082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.932084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.932088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:06.932091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:06.932158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:06.932167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.932181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:06.932199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:06.932223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:06.932247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894872175415486:2454], now have 1 active actors on pipe
2025-09-30T14:51:06.932257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894872175415611:4254], now have 1 active actors on pipe
2025-09-30T14:51:06.932263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894872085690680:3731]
2025-09-30T14:51:06.932265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894872085690680:3731]
2025-09-30T14:51:06.932268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894872085690680:3731]
2025-09-30T14:51:06.932279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:06.932294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:06.932294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:06.932297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:06.932302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:06.932315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:06.932319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:06.932336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 300
2025-09-30T14:51:06.932345Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 300
2025-09-30T14:51:06.932357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894872085690680:3731]
2025-09-30T14:51:06.932370Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:06.932374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:06.932400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:06.932406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:06.932439Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|86460d73-41643086-3e1079d9-b6629960_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:06.932445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:06.932449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:06.932451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:06.932460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:06.932468Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:06.932491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:06.932725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:06.932878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:06.932912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:06.932999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 301 partition: 0 MaxSeqNo: 42 sessionId: src_id|86460d73-41643086-3e1079d9-b6629960_0
2025-09-30T14:51:06.933365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5efdfa54-e77f7ba3-edbffbe7-c4db4f4e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|86460d73-41643086-3e1079d9-b6629960_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:06.936411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86460d73-41643086-3e1079d9-b6629960_0] Write session: try to update token
2025-09-30T14:51:06.936433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86460d73-41643086-3e1079d9-b6629960_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:06.944805Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:06.944831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:06.944833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:06.944835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:06.944847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894872085690680:3731]
2025-09-30T14:51:06.944853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894872085690680:3731]
2025-09-30T14:51:06.944857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894872085690680:3731]
2025-09-30T14:51:06.944896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:06.944903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:06.944902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:06.944906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:06.944918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:06.944922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:06.945096Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:06.951641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 301 sessionId: src_id|86460d73-41643086-3e1079d9-b6629960_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:06.954574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:07.010236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894876470382925:3696]
2025-09-30T14:51:07.010491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 300, pipe: [1:7555894876470382925:3696]
2025-09-30T14:51:07.059588Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:07.059836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:07.059847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:07.059880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894876470382925:3696], now have 1 active actors on pipe
2025-09-30T14:51:07.060045Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:07.060095Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:07.060102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:07.060117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:07.060154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894876470382925:3696]
2025-09-30T14:51:07.060173Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:51:07.060196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 301 reason: error at write: Disconnected sessionId: src_id|86460d73-41643086-3e1079d9-b6629960_0
2025-09-30T14:51:07.060297Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 3 consumer shared/user session shared/user_1_3_4518719700268330172_v1 is DEAD
2025-09-30T14:51:07.060310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 301 sessionId: src_id|86460d73-41643086-3e1079d9-b6629960_0 is DEAD
2025-09-30T14:51:07.060410Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894807750890537:3691] disconnected; active server actors: 1
2025-09-30T14:51:07.060419Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894807750890537:3691] client user disconnected session shared/user_1_3_4518719700268330172_v1
2025-09-30T14:51:07.060670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86460d73-41643086-3e1079d9-b6629960_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:07.060682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86460d73-41643086-3e1079d9-b6629960_0] Write session will restart in 0.005916s
2025-09-30T14:51:07.060697Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:51:07.060705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86460d73-41643086-3e1079d9-b6629960_0] Write session: Do CDS request
2025-09-30T14:51:07.060712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86460d73-41643086-3e1079d9-b6629960_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:07.060770Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:51:07.060776Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:51:07.060784Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.006645s
2025-09-30T14:51:07.067751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86460d73-41643086-3e1079d9-b6629960_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:07.067825Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:07.067841Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 302
2025-09-30T14:51:07.067975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 302 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:07.068016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 302 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:07.068025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=302 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:07.068029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:07.068468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 302 sessionId:  describe result for acl check
2025-09-30T14:51:07.068502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:07.068509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:07.068510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:07.068514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894876470382988:4260] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:07.068534Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:51:07.068657Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:51:07.068666Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 4
2025-09-30T14:51:07.068788Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 4 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:51:07.068833Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:51:07.068909Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 auth for : user
2025-09-30T14:51:07.069039Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 Handle describe topics response
2025-09-30T14:51:07.069061Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 auth is DEAD
2025-09-30T14:51:07.069064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894876470382988:4260] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:07.069076Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:51:07.069322Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:51:07.069398Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894876470383025:4262] connected; active server actors: 1
2025-09-30T14:51:07.069415Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555894876470383025:4262] session shared/user_1_4_387935675616407913_v1
2025-09-30T14:51:07.069419Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_4_387935675616407913_v1
2025-09-30T14:51:07.069427Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:51:07.069436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:51:07.069442Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_4_387935675616407913_v1" (Sender=[1:7555894876470382999:4262], Pipe=[1:7555894876470383025:4262], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:51:07.069445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:51:07.069452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:51:07.069462Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_4_387935675616407913_v1" (Sender=[1:7555894876470382999:4262], Pipe=[1:7555894876470383025:4262], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:51:07.069469Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_4_387935675616407913_v1" sender [1:7555894876470382999:4262] lock partition 0 for ReadingSession "shared/user_1_4_387935675616407913_v1" (Sender=[1:7555894876470382999:4262], Pipe=[1:7555894876470383025:4262], Partitions=[], ActiveFamilyCount=1) generation 1 step 4
2025-09-30T14:51:07.069483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:51:07.069487Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000028s
2025-09-30T14:51:07.069707Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 4 Session: "shared/user_1_4_387935675616407913_v1" ClientId: "user" PipeClient { RawX1: 7555894876470383025 RawX2: 4503603922342054 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:51:07.069729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:51:07.070675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:07.070966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894876470382988:4260] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:07.072726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:07.072894Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:07.072902Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:07.072909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:07.072947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:07.072977Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894876380658115:3734]
2025-09-30T14:51:07.073425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894876470382988:4260] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:07.073443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894876470382988:4260] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:07.073447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894876470382988:4260] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:07.073454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 302 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:07.073488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:07.073759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:07.073806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:07.074082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:07.074136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:07.074144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:07.074145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:07.074146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:07.074146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:07.074147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:07.074148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:07.074149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:07.074150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:07.074150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:07.074151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.074152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.074153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.074154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:07.074154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:07.074158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:07.074165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:07.074167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:07.074170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:07.074172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:07.074176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:07.074180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:07.074185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:07.074189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:07.074192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:07.074196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.074200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.074203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.074208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:07.074212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:07.074219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:07.074227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:07.074235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:07.074240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:07.074243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:07.074246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:07.074248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:07.074251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:07.074254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:07.074257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:07.074259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:07.074262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:07.074265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:07.074268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:07.074271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:07.074273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:07.074276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:07.074279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:07.074281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:07.074284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:07.074286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.074289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.074291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.074294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.074298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.074301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.074304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:07.074307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:07.074309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:07.074312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:07.074335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:07.079667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:07.080517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:07.080533Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:07.080536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:07.080541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:07.080548Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 301 [2:7555894876380658115:3734]
2025-09-30T14:51:07.080565Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:07.080583Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:07.080586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.080589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.080591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.080608Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:07.080620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:07.080632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:07.080690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.080698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.080701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.080704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:07.080706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:07.080772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:07.080781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.080792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.080803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.080818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:07.080837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894876470383063:4260], now have 1 active actors on pipe
2025-09-30T14:51:07.080843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894876470382930:2454], now have 1 active actors on pipe
2025-09-30T14:51:07.080846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894876470383032:4267], now have 1 active actors on pipe
2025-09-30T14:51:07.080852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894876380658109:3734]
2025-09-30T14:51:07.080855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894876380658109:3734]
2025-09-30T14:51:07.080856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894876380658109:3734]
2025-09-30T14:51:07.080869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:07.080884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:07.080887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:07.080895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:07.080897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:07.080901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:07.080904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:07.080946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 301
2025-09-30T14:51:07.080981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 301, pipe: [1:7555894876470383032:4267]
2025-09-30T14:51:07.080988Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 301
2025-09-30T14:51:07.080934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894876380658109:3734]
2025-09-30T14:51:07.080948Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:07.080997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:07.081074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:07.081086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:07.081102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:07.081109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:07.081116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_4_387935675616407913_v1 on pipe: [1:7555894876470383032:4267]
2025-09-30T14:51:07.081149Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e68dac32-ade1ec8-725d294b-d990fdc7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:07.081160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.081165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.081165Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_4_387935675616407913_v1:1 with generation 301
2025-09-30T14:51:07.081171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:07.081182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.081191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:07.081207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.081216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.081218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:07.081231Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_4_387935675616407913_v1
2025-09-30T14:51:07.081237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.081263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:07.081281Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:07.081452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:07.081461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:07.081475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:07.081598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 302 partition: 0 MaxSeqNo: 42 sessionId: src_id|e68dac32-ade1ec8-725d294b-d990fdc7_0
2025-09-30T14:51:07.082025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86460d73-41643086-3e1079d9-b6629960_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e68dac32-ade1ec8-725d294b-d990fdc7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:07.084849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e68dac32-ade1ec8-725d294b-d990fdc7_0] Write session: try to update token
2025-09-30T14:51:07.084868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e68dac32-ade1ec8-725d294b-d990fdc7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:07.085732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:07.085771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:07.085780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.085790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.085793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.085802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:51:07.085831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:51:07.086014Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759243867080 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:51:07.086045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:51:07.086089Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 sending to client partition status
2025-09-30T14:51:07.093501Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:07.093521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:07.093524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:07.093526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:07.093539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894876380658109:3734]
2025-09-30T14:51:07.093544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894876380658109:3734]
2025-09-30T14:51:07.093547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894876380658109:3734]
2025-09-30T14:51:07.093588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:07.093596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.093598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:07.093599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:07.093607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:07.093611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:07.093804Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:07.100172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 302 sessionId: src_id|e68dac32-ade1ec8-725d294b-d990fdc7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:07.103023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:07.208899Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:07.209332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:07.209347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:07.209583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_4_387935675616407913_v1
2025-09-30T14:51:07.209607Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:07.209636Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_4_387935675616407913_v1
2025-09-30T14:51:07.209636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894876470383032:4267]
2025-09-30T14:51:07.209670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:07.209696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:07.209795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 302 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e68dac32-ade1ec8-725d294b-d990fdc7_0
2025-09-30T14:51:07.210032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 302 sessionId: src_id|e68dac32-ade1ec8-725d294b-d990fdc7_0 is DEAD
2025-09-30T14:51:07.210167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68dac32-ade1ec8-725d294b-d990fdc7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:07.210178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68dac32-ade1ec8-725d294b-d990fdc7_0] Write session will restart in 0.009593s
2025-09-30T14:51:07.210201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68dac32-ade1ec8-725d294b-d990fdc7_0] Write session: Do CDS request
2025-09-30T14:51:07.210211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68dac32-ade1ec8-725d294b-d990fdc7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:07.220462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:07.220798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e68dac32-ade1ec8-725d294b-d990fdc7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:07.220887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:07.220913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 303
2025-09-30T14:51:07.221070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 303 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:07.221102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 303 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:07.221111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=303 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:07.221115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:07.221566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 303 sessionId:  describe result for acl check
2025-09-30T14:51:07.221617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:07.221624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:07.221626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:07.221632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894876470383191:4275] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:07.222153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894876470383191:4275] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:07.222886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:07.223083Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:07.223093Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:07.223103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:07.223159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:07.223202Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894876380658284:3748]
2025-09-30T14:51:07.223878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:07.224180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:07.224222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:07.224368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894876470383191:4275] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:07.224555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:07.224621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:07.224627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:07.224628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:07.224629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:07.224631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:07.224632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:07.224633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:07.224635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:07.224636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:07.224637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:07.224639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.224640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.224642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.224643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:07.224644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:07.224650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:07.224661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:07.224665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:07.224670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:07.224674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:07.224678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:07.224682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:07.224687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:07.224691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:07.224696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:07.224700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.224704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.224708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.224712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:07.224716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:07.224723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:07.224730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:07.224737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:07.224743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:07.224747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:07.224753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:07.224757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:07.224764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:07.224769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:07.224774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:07.224779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:07.224785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:07.224795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:07.224801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:07.224805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:07.224811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:07.224821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:07.224827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:07.224832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:07.224837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:07.224843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.224848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.224853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.224858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.224861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.224867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.224872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:07.224877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:07.224884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:07.224893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:07.224938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:07.230637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894876470383191:4275] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:07.230661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894876470383191:4275] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:07.230665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894876470383191:4275] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:07.230684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 303 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:07.230991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:07.232163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:07.232184Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:07.232187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:07.232191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:07.232199Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 302 [2:7555894876380658284:3748]
2025-09-30T14:51:07.232215Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:07.232229Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:07.232233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.232237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.232239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.232255Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:07.232262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:07.232269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:07.232326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.232335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.232337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.232341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:07.232344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:07.232413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:07.232421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.232435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.232452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.232474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:07.232498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894876470383098:2454], now have 1 active actors on pipe
2025-09-30T14:51:07.232506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894876470383229:4275], now have 1 active actors on pipe
2025-09-30T14:51:07.232513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894876380658278:3748]
2025-09-30T14:51:07.232515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894876380658278:3748]
2025-09-30T14:51:07.232519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894876380658278:3748]
2025-09-30T14:51:07.232552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 302
2025-09-30T14:51:07.232555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 302
2025-09-30T14:51:07.232537Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:07.232558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:07.232574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:07.232577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:07.232578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:07.232583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:07.232585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:07.232617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894876380658278:3748]
2025-09-30T14:51:07.232621Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:07.232637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:07.232759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:07.232776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:07.232814Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c31f49a1-3efb409e-58c4bb49-c2c258b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:07.232828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.232832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.232839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:07.232850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.232865Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:07.232886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:07.233064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:07.233080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:07.233105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:07.233208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 303 partition: 0 MaxSeqNo: 42 sessionId: src_id|c31f49a1-3efb409e-58c4bb49-c2c258b_0
2025-09-30T14:51:07.233644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68dac32-ade1ec8-725d294b-d990fdc7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c31f49a1-3efb409e-58c4bb49-c2c258b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:07.236679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c31f49a1-3efb409e-58c4bb49-c2c258b_0] Write session: try to update token
2025-09-30T14:51:07.236703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c31f49a1-3efb409e-58c4bb49-c2c258b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:07.245365Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:07.245386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:07.245389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:07.245391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:07.245400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894876380658278:3748]
2025-09-30T14:51:07.245405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894876380658278:3748]
2025-09-30T14:51:07.245413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894876380658278:3748]
2025-09-30T14:51:07.245457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:07.245465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.245473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:07.245475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:07.245480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:07.245484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:07.245625Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:07.253021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 303 sessionId: src_id|c31f49a1-3efb409e-58c4bb49-c2c258b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:07.255900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:07.309748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894876470383236:4267]
2025-09-30T14:51:07.310047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 302, pipe: [1:7555894876470383236:4267]
2025-09-30T14:51:07.356834Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:07.357178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:07.357192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:07.357210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894876470383236:4267], now have 1 active actors on pipe
2025-09-30T14:51:07.357445Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:07.357504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:07.357511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894876470383236:4267]
2025-09-30T14:51:07.357535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:07.357610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 303 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c31f49a1-3efb409e-58c4bb49-c2c258b_0
2025-09-30T14:51:07.357804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 303 sessionId: src_id|c31f49a1-3efb409e-58c4bb49-c2c258b_0 is DEAD
2025-09-30T14:51:07.357950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c31f49a1-3efb409e-58c4bb49-c2c258b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:07.357963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c31f49a1-3efb409e-58c4bb49-c2c258b_0] Write session will restart in 0.009187s
2025-09-30T14:51:07.357985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c31f49a1-3efb409e-58c4bb49-c2c258b_0] Write session: Do CDS request
2025-09-30T14:51:07.357991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c31f49a1-3efb409e-58c4bb49-c2c258b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:07.368810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c31f49a1-3efb409e-58c4bb49-c2c258b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:07.368893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:07.368913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 304
2025-09-30T14:51:07.369049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 304 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:07.369047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:07.369103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 304 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:07.369115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=304 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:07.369120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:07.369565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 304 sessionId:  describe result for acl check
2025-09-30T14:51:07.369606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:07.369613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:07.369615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:07.369622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894876470383332:4279] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:07.370151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894876470383332:4279] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:07.371413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:07.371597Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:07.371605Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:07.371612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:07.371651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:07.371693Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894876380658416:3750]
2025-09-30T14:51:07.372174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:07.372178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894876470383332:4279] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:07.372477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:07.372510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:07.372750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:07.372795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:07.372800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:07.372801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:07.372801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:07.372802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:07.372803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:07.372803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:07.372804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:07.372805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:07.372806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:07.372806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.372807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.372808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.372808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:07.372809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:07.372813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:07.372820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:07.372822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:07.372825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:07.372827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:07.372829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:07.372832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:07.372834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:07.372836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:07.372839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:07.372841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.372843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.372845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.372848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:07.372850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:07.372854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:07.372859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:07.372864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:07.372868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:07.372871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:07.372874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:07.372876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:07.372879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:07.372882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:07.372885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:07.372888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:07.372891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:07.372893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:07.372896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:07.372899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:07.372902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:07.372906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:07.372909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:07.372911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:07.372915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:07.372918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.372921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.372924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.372926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.372929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.372932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.372936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:07.372940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:07.372943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:07.372945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:07.372971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:07.378242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894876470383332:4279] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:07.378261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894876470383332:4279] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:07.378264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894876470383332:4279] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:07.378274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 304 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:07.378496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:07.379750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:07.379773Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:07.379776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:07.379781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:07.379787Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 303 [2:7555894876380658416:3750]
2025-09-30T14:51:07.379803Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:07.379824Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:07.379834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.379838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.379840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.379858Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:07.379865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:07.379872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:07.379943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.379952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.379954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.379957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:07.379960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:07.380039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:07.380049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.380064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.380076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.380094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:07.380114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894876470383370:4279], now have 1 active actors on pipe
2025-09-30T14:51:07.380118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894876470383237:2454], now have 1 active actors on pipe
2025-09-30T14:51:07.380124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894876380658410:3750]
2025-09-30T14:51:07.380128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894876380658410:3750]
2025-09-30T14:51:07.380130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894876380658410:3750]
2025-09-30T14:51:07.380142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:07.380150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:07.380155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:07.380155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:07.380163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 303
2025-09-30T14:51:07.380157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:07.380174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 303
2025-09-30T14:51:07.380170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:07.380174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:07.380217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894876380658410:3750]
2025-09-30T14:51:07.380221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:07.380229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:07.380237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:07.380247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:07.380293Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9409e7f2-9ae2a534-4dd79925-fdc032d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:07.380309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.380313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.380315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:07.380323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.380332Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:07.380361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:07.380521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:07.380527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:07.380538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:07.380603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 304 partition: 0 MaxSeqNo: 42 sessionId: src_id|9409e7f2-9ae2a534-4dd79925-fdc032d6_0
2025-09-30T14:51:07.380956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c31f49a1-3efb409e-58c4bb49-c2c258b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9409e7f2-9ae2a534-4dd79925-fdc032d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:07.383991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9409e7f2-9ae2a534-4dd79925-fdc032d6_0] Write session: try to update token
2025-09-30T14:51:07.384019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9409e7f2-9ae2a534-4dd79925-fdc032d6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:07.392621Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:07.392646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:07.392648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:07.392650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:07.392661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894876380658410:3750]
2025-09-30T14:51:07.392665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894876380658410:3750]
2025-09-30T14:51:07.392669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894876380658410:3750]
2025-09-30T14:51:07.392710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:07.392714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:07.392718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.392721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:07.392731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:07.392736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:07.392873Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:07.399694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 304 sessionId: src_id|9409e7f2-9ae2a534-4dd79925-fdc032d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:07.402691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:07.457728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894876470383379:4267]
2025-09-30T14:51:07.458008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 303, pipe: [1:7555894876470383379:4267]
2025-09-30T14:51:07.508957Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:07.509373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:07.509392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:07.509410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894876470383379:4267], now have 1 active actors on pipe
2025-09-30T14:51:07.509660Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:07.509655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894876470383379:4267]
2025-09-30T14:51:07.509664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:07.509668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:07.509696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:07.509743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 304 reason: error at write: Disconnected sessionId: src_id|9409e7f2-9ae2a534-4dd79925-fdc032d6_0
2025-09-30T14:51:07.509936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 304 sessionId: src_id|9409e7f2-9ae2a534-4dd79925-fdc032d6_0 is DEAD
2025-09-30T14:51:07.510075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9409e7f2-9ae2a534-4dd79925-fdc032d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:07.510083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9409e7f2-9ae2a534-4dd79925-fdc032d6_0] Write session will restart in 0.009218s
2025-09-30T14:51:07.510106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9409e7f2-9ae2a534-4dd79925-fdc032d6_0] Write session: Do CDS request
2025-09-30T14:51:07.510115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9409e7f2-9ae2a534-4dd79925-fdc032d6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:07.520879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9409e7f2-9ae2a534-4dd79925-fdc032d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:07.520996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:07.521016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 305
2025-09-30T14:51:07.521181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 305 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:07.521233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 305 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:07.521243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=305 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:07.521248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:07.521686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 305 sessionId:  describe result for acl check
2025-09-30T14:51:07.521725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:07.521733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:07.521734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:07.521740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894876470383411:4284] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:07.522290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894876470383411:4284] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:07.524314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894876470383411:4284] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:07.527230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:07.527291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894876470383411:4284] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:07.527311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894876470383411:4284] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:07.527314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894876470383411:4284] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:07.527324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 305 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:07.529809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:07.530075Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:07.530088Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:07.530100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:07.530168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:07.530214Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894876380658552:3753]
2025-09-30T14:51:07.530936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:07.531239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:07.531309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:07.531667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:07.531745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:07.531753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:07.531754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:07.531756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:07.531757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:07.531758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:07.531759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:07.531761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:07.531762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:07.531763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:07.531765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.531766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.531767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.531768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:07.531770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:07.531776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:07.531787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:07.531792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:07.531796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:07.531800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:07.531805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:07.531809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:07.531814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:07.531819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:07.531823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:07.531828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.531833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.531837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.531841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:07.531846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:07.531854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:07.531863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:07.531875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:07.531881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:07.531892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:07.531898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:07.531908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:07.531913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:07.531923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:07.531929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:07.531934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:07.531945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:07.531951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:07.531962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:07.531967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:07.531977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:07.531983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:07.531993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:07.531998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:07.532009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:07.532023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.532033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.532038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.532050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.532055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.532066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.532071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:07.532082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:07.532091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:07.532097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:07.532152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:07.538014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:07.539223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:07.539258Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:07.539262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:07.539265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:07.539272Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 304 [2:7555894876380658552:3753]
2025-09-30T14:51:07.539289Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:07.539310Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:07.539314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.539317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.539320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.539339Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:07.539352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:07.539363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:07.539430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.539439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.539441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.539446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:07.539449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:07.539522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:07.539531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.539544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.539560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.539595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:07.539619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894876470383380:2454], now have 1 active actors on pipe
2025-09-30T14:51:07.539627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894876470383508:4284], now have 1 active actors on pipe
2025-09-30T14:51:07.539636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894876380658546:3753]
2025-09-30T14:51:07.539643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894876380658546:3753]
2025-09-30T14:51:07.539646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894876380658546:3753]
2025-09-30T14:51:07.539659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:07.539673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:07.539679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:07.539685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:07.539687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:07.539694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:07.539697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:07.539691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 304
2025-09-30T14:51:07.539704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 304
2025-09-30T14:51:07.539731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894876380658546:3753]
2025-09-30T14:51:07.539743Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:07.539750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:07.539764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:07.539769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:07.539821Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63df00eb-f8f53720-43eb9383-cf8381b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:07.539832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.539836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.539838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:07.539848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.539861Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:07.539881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:07.540073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:07.540088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:07.540124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:07.540199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 305 partition: 0 MaxSeqNo: 42 sessionId: src_id|63df00eb-f8f53720-43eb9383-cf8381b_0
2025-09-30T14:51:07.540614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9409e7f2-9ae2a534-4dd79925-fdc032d6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|63df00eb-f8f53720-43eb9383-cf8381b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:07.543489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63df00eb-f8f53720-43eb9383-cf8381b_0] Write session: try to update token
2025-09-30T14:51:07.543507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63df00eb-f8f53720-43eb9383-cf8381b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:07.552441Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:07.552464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:07.552467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:07.552469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:07.552479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894876380658546:3753]
2025-09-30T14:51:07.552484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894876380658546:3753]
2025-09-30T14:51:07.552488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894876380658546:3753]
2025-09-30T14:51:07.552531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:07.552538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.552541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:07.552542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:07.552551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:07.552556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:07.552687Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:07.562048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 305 sessionId: src_id|63df00eb-f8f53720-43eb9383-cf8381b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:07.565031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:07.609796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894876470383521:4267]
2025-09-30T14:51:07.610147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 304, pipe: [1:7555894876470383521:4267]
2025-09-30T14:51:07.668290Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:07.668624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:07.668640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:07.668660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894876470383521:4267], now have 1 active actors on pipe
2025-09-30T14:51:07.668896Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:07.668907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:07.668944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894876470383521:4267]
2025-09-30T14:51:07.668958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:07.669045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 305 reason: status is not ok: tablet will be restarted right now sessionId: src_id|63df00eb-f8f53720-43eb9383-cf8381b_0
2025-09-30T14:51:07.669280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 305 sessionId: src_id|63df00eb-f8f53720-43eb9383-cf8381b_0 is DEAD
2025-09-30T14:51:07.669439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63df00eb-f8f53720-43eb9383-cf8381b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:07.669447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63df00eb-f8f53720-43eb9383-cf8381b_0] Write session will restart in 0.005402s
2025-09-30T14:51:07.669471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63df00eb-f8f53720-43eb9383-cf8381b_0] Write session: Do CDS request
2025-09-30T14:51:07.669477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63df00eb-f8f53720-43eb9383-cf8381b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:07.675825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63df00eb-f8f53720-43eb9383-cf8381b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:07.675908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:07.675936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 306
2025-09-30T14:51:07.676060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 306 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:07.676088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 306 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:07.676097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=306 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:07.676100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:07.676528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 306 sessionId:  describe result for acl check
2025-09-30T14:51:07.676562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:07.676564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:07.676566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:07.676573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894876470383542:4288] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:07.677210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894876470383542:4288] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:07.679649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894876470383542:4288] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:07.680563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:07.682741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:07.683005Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:07.683015Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:07.683028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:07.683093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:07.683133Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894876380658685:3755]
2025-09-30T14:51:07.683155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894876470383542:4288] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:07.683173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894876470383542:4288] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:07.683176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894876470383542:4288] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:07.683186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 306 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:07.683790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:07.684112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:07.684172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:07.684522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:07.684586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:07.684592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:07.684593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:07.684594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:07.684595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:07.684597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:07.684598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:07.684599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:07.684600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:07.684601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:07.684603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.684604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.684605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.684607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:07.684608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:07.684614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:07.684625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:07.684630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:07.684634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:07.684638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:07.684643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:07.684648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:07.684652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:07.684657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:07.684661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:07.684664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.684669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.684673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.684677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:07.684681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:07.684690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:07.684698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:07.684704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:07.684710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:07.684715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:07.684721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:07.684728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:07.684737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:07.684746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:07.684753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:07.684761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:07.684771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:07.684777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:07.684786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:07.684796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:07.684801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:07.684811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:07.684816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:07.684822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:07.684828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:07.684834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.684843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.684848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.684857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.684863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.684868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.684878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:07.684884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:07.684893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:07.684899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:07.684960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:07.690765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:07.691767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:07.691790Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:07.691793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:07.691798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:07.691806Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 305 [2:7555894876380658685:3755]
2025-09-30T14:51:07.691825Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:07.691842Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:07.691850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.691853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.691856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.691873Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:07.691885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:07.691892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:07.691959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.691968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.691970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.691973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:07.691976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:07.692050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:07.692057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.692069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.692081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.692098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:07.692122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894876470383522:2454], now have 1 active actors on pipe
2025-09-30T14:51:07.692132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894876380658679:3755]
2025-09-30T14:51:07.692135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894876380658679:3755]
2025-09-30T14:51:07.692138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894876380658679:3755]
2025-09-30T14:51:07.692157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:07.692166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894876470383652:4288], now have 1 active actors on pipe
2025-09-30T14:51:07.692174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:07.692191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:07.692201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:07.692240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894876380658679:3755]
2025-09-30T14:51:07.692246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:07.692249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:07.692250Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:07.692251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:07.692258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:07.692228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 305
2025-09-30T14:51:07.692256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 305
2025-09-30T14:51:07.692459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:07.692477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:07.692503Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3359d35-61fb9601-bb2485e4-c7d7fec6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:07.692511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.692515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.692517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:07.692527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.692540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:07.692571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:07.692761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:07.692776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:07.692799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:07.692940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 306 partition: 0 MaxSeqNo: 42 sessionId: src_id|b3359d35-61fb9601-bb2485e4-c7d7fec6_0
2025-09-30T14:51:07.693401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63df00eb-f8f53720-43eb9383-cf8381b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b3359d35-61fb9601-bb2485e4-c7d7fec6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:07.696451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3359d35-61fb9601-bb2485e4-c7d7fec6_0] Write session: try to update token
2025-09-30T14:51:07.696478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3359d35-61fb9601-bb2485e4-c7d7fec6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:07.704836Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:07.704854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:07.704861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:07.704863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:07.704872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894876380658679:3755]
2025-09-30T14:51:07.704877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894876380658679:3755]
2025-09-30T14:51:07.704881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894876380658679:3755]
2025-09-30T14:51:07.704920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:07.704927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.704927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:07.704930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:07.704937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:07.704950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:07.705071Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:07.712846Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 306 sessionId: src_id|b3359d35-61fb9601-bb2485e4-c7d7fec6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:07.715806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:07.769039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894876470383664:4267]
2025-09-30T14:51:07.769276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 305, pipe: [1:7555894876470383664:4267]
2025-09-30T14:51:07.821972Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:07.822323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:07.822341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:07.822362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894876470383664:4267], now have 1 active actors on pipe
2025-09-30T14:51:07.822634Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:07.822624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:07.822680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894876470383664:4267]
2025-09-30T14:51:07.822691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:07.822695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:07.822772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 306 reason: error at write: Disconnected sessionId: src_id|b3359d35-61fb9601-bb2485e4-c7d7fec6_0
2025-09-30T14:51:07.823157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 306 sessionId: src_id|b3359d35-61fb9601-bb2485e4-c7d7fec6_0 is DEAD
2025-09-30T14:51:07.823272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3359d35-61fb9601-bb2485e4-c7d7fec6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:07.823284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3359d35-61fb9601-bb2485e4-c7d7fec6_0] Write session will restart in 0.006623s
2025-09-30T14:51:07.823309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3359d35-61fb9601-bb2485e4-c7d7fec6_0] Write session: Do CDS request
2025-09-30T14:51:07.823319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3359d35-61fb9601-bb2485e4-c7d7fec6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:07.830870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3359d35-61fb9601-bb2485e4-c7d7fec6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:07.831002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:07.831041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 307
2025-09-30T14:51:07.831176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 307 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:07.831218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 307 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:07.831224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=307 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:07.831228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:07.831787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 307 sessionId:  describe result for acl check
2025-09-30T14:51:07.831837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:07.831846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:07.831848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:07.831863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894876470383752:4293] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:07.832493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894876470383752:4293] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:07.833965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:07.834507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894876470383752:4293] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:07.836041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:07.836263Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:07.836275Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:07.836286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:07.836340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:07.836384Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894876380658832:3758]
2025-09-30T14:51:07.837081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:07.837388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:07.837369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894876470383752:4293] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:07.837388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894876470383752:4293] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:07.837392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894876470383752:4293] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:07.837404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 307 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:07.837436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:07.837781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:07.837845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:07.837852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:07.837853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:07.837855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:07.837856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:07.837858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:07.837859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:07.837860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:07.837862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:07.837863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:07.837865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.837866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.837867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.837869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:07.837870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:07.837876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:07.837887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:07.837892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:07.837897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:07.837902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:07.837907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:07.837911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:07.837916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:07.837921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:07.837925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:07.837930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.837934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.837939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.837943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:07.837947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:07.837956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:07.837965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:07.837974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:07.837986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:07.837991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:07.838002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:07.838007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:07.838017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:07.838022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:07.838028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:07.838038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:07.838044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:07.838054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:07.838060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:07.838070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:07.838076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:07.838085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:07.838091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:07.838101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:07.838108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:07.838118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.838126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.838135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.838140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.838150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.838156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.838165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:07.838171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:07.838178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:07.838188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:07.838236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:07.844082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:07.845271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:07.845293Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:07.845296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:07.845300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:07.845307Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 306 [2:7555894876380658832:3758]
2025-09-30T14:51:07.845328Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:07.845345Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:07.845348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.845351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.845354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.845373Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:07.845388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:07.845395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:07.845468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.845476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.845477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.845481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:07.845484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:07.845556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:07.845564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.845579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.845594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.845617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:07.845643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894876380658826:3758]
2025-09-30T14:51:07.845645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894876380658826:3758]
2025-09-30T14:51:07.845647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894876380658826:3758]
2025-09-30T14:51:07.845655Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:07.845670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:07.845672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894876470383810:4293], now have 1 active actors on pipe
2025-09-30T14:51:07.845674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:07.845676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:07.845677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:07.845691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:07.845693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:07.845699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894876470383677:2454], now have 1 active actors on pipe
2025-09-30T14:51:07.845735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894876380658826:3758]
2025-09-30T14:51:07.845752Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:07.845783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:07.845786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 306
2025-09-30T14:51:07.845845Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 306
2025-09-30T14:51:07.845861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:07.845872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:07.845903Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9a1fe6b-a49de805-367e138-d06c3705_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:07.845919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.845923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.845926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:07.845936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.845950Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:07.845971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:07.846174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:07.846184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:07.846203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:07.846297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 307 partition: 0 MaxSeqNo: 42 sessionId: src_id|d9a1fe6b-a49de805-367e138-d06c3705_0
2025-09-30T14:51:07.846738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3359d35-61fb9601-bb2485e4-c7d7fec6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d9a1fe6b-a49de805-367e138-d06c3705_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:07.850393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9a1fe6b-a49de805-367e138-d06c3705_0] Write session: try to update token
2025-09-30T14:51:07.850420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9a1fe6b-a49de805-367e138-d06c3705_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:07.858747Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:07.858766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:07.858768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:07.858770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:07.858780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894876380658826:3758]
2025-09-30T14:51:07.858784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894876380658826:3758]
2025-09-30T14:51:07.858788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894876380658826:3758]
2025-09-30T14:51:07.858833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:07.858841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.858841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:07.858844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:07.858847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:07.858851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:07.858989Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:07.865918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 307 sessionId: src_id|d9a1fe6b-a49de805-367e138-d06c3705_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:07.868902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:07.923153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894876470383820:4267]
2025-09-30T14:51:07.923441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 306, pipe: [1:7555894876470383820:4267]
2025-09-30T14:51:07.972621Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:07.972995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:07.973011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:07.973032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894876470383820:4267], now have 1 active actors on pipe
2025-09-30T14:51:07.973252Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:07.973340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894876470383820:4267]
2025-09-30T14:51:07.973340Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:07.973374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:07.973449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 307 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d9a1fe6b-a49de805-367e138-d06c3705_0
2025-09-30T14:51:07.973678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 307 sessionId: src_id|d9a1fe6b-a49de805-367e138-d06c3705_0 is DEAD
2025-09-30T14:51:07.973811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9a1fe6b-a49de805-367e138-d06c3705_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:07.973823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9a1fe6b-a49de805-367e138-d06c3705_0] Write session will restart in 0.009507s
2025-09-30T14:51:07.973858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9a1fe6b-a49de805-367e138-d06c3705_0] Write session: Do CDS request
2025-09-30T14:51:07.973863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9a1fe6b-a49de805-367e138-d06c3705_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:07.984724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:07.984786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9a1fe6b-a49de805-367e138-d06c3705_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:07.984928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:07.984948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 308
2025-09-30T14:51:07.985064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 308 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:07.985097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 308 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:07.985102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=308 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:07.985105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:07.985510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 308 sessionId:  describe result for acl check
2025-09-30T14:51:07.985550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:07.985557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:07.985573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:07.985584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894876470383926:4299] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:07.986124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894876470383926:4299] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:07.986693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:07.986900Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:07.986908Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:07.986919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:07.986983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:07.987021Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894876380658967:3760]
2025-09-30T14:51:07.987681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:07.987778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894876470383926:4299] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:07.988023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:07.988083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:07.988422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:07.988478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:07.988484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:07.988485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:07.988486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:07.988487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:07.988488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:07.988489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:07.988491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:07.988492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:07.988493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:07.988494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.988496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.988497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.988498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:07.988499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:07.988505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:07.988515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:07.988520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:07.988524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:07.988528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:07.988532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:07.988536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:07.988540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:07.988544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:07.988548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:07.988553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.988556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.988560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.988564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:07.988568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:07.988580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:07.988591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:07.988601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:07.988606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:07.988610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:07.988620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:07.988629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:07.988635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:07.988644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:07.988654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:07.988664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:07.988673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:07.988682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:07.988691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:07.988700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:07.988709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:07.988718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:07.988727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:07.988735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:07.988741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:07.988750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.988759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.988767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.988776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.988781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.988790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.988795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:07.988804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:07.988809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:07.988814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:07.988859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:07.993862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894876470383926:4299] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:07.993884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894876470383926:4299] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:07.993887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894876470383926:4299] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:07.993902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 308 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:07.994142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:07.995166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:07.995182Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:07.995184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:07.995187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:07.995192Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 307 [2:7555894876380658967:3760]
2025-09-30T14:51:07.995205Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:07.995216Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:07.995219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.995221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.995222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.995237Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:07.995258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:07.995265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:07.995322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.995329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.995330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.995333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:07.995334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:07.995387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:07.995393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:07.995402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:07.995408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:07.995421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:07.995438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894876470383964:4299], now have 1 active actors on pipe
2025-09-30T14:51:07.995448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894876380658961:3760]
2025-09-30T14:51:07.995449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894876380658961:3760]
2025-09-30T14:51:07.995451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894876380658961:3760]
2025-09-30T14:51:07.995462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:07.995469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894876470383828:2454], now have 1 active actors on pipe
2025-09-30T14:51:07.995474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:07.995483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:07.995483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:07.995485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:07.995486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:07.995487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:07.995515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894876380658961:3760]
2025-09-30T14:51:07.995523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:07.995531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:07.995534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 307
2025-09-30T14:51:07.995537Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 307
2025-09-30T14:51:07.995630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:07.995636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:07.995656Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a52e623-412a8f13-4a2ff30e-ed9969bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:07.995664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.995666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.995667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:07.995673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.995681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:07.995697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:07.995838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:07.995843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:07.995853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:07.995938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 308 partition: 0 MaxSeqNo: 42 sessionId: src_id|2a52e623-412a8f13-4a2ff30e-ed9969bd_0
2025-09-30T14:51:07.996312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9a1fe6b-a49de805-367e138-d06c3705_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2a52e623-412a8f13-4a2ff30e-ed9969bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:07.999282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a52e623-412a8f13-4a2ff30e-ed9969bd_0] Write session: try to update token
2025-09-30T14:51:07.999301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a52e623-412a8f13-4a2ff30e-ed9969bd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:08.007089Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:08.007104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:08.007113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894876380658961:3760]
2025-09-30T14:51:08.007155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:08.007158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:08.007356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:08.007513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:08.007660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:08.007807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:08.008300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:08.008349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:08.013786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 308 sessionId: src_id|2a52e623-412a8f13-4a2ff30e-ed9969bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:08.016497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:08.017670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:08.017691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:08.017710Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:08.017715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:08.017717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:08.017719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:08.017730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894876380658961:3760]
2025-09-30T14:51:08.017734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894876380658961:3760]
2025-09-30T14:51:08.017737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894876380658961:3760]
2025-09-30T14:51:08.017775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:08.017783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:08.017789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:08.017790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.017792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:08.017792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:08.017922Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:08.073691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894880765351274:4267]
2025-09-30T14:51:08.073976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 307, pipe: [1:7555894880765351274:4267]
2025-09-30T14:51:08.133798Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:08.134172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:08.134220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894880765351274:4267], now have 1 active actors on pipe
2025-09-30T14:51:08.134335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:08.134394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894880765351274:4267]
2025-09-30T14:51:08.134415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:08.134447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:08.134450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:08.134519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 308 reason: error at write: Disconnected sessionId: src_id|2a52e623-412a8f13-4a2ff30e-ed9969bd_0
2025-09-30T14:51:08.134715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 308 sessionId: src_id|2a52e623-412a8f13-4a2ff30e-ed9969bd_0 is DEAD
2025-09-30T14:51:08.134923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a52e623-412a8f13-4a2ff30e-ed9969bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:08.134933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a52e623-412a8f13-4a2ff30e-ed9969bd_0] Write session will restart in 0.005588s
2025-09-30T14:51:08.134957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a52e623-412a8f13-4a2ff30e-ed9969bd_0] Write session: Do CDS request
2025-09-30T14:51:08.134963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a52e623-412a8f13-4a2ff30e-ed9969bd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:08.141893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a52e623-412a8f13-4a2ff30e-ed9969bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:08.141999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:08.142019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 309
2025-09-30T14:51:08.142147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 309 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:08.142180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 309 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:08.142194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=309 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:08.142199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:08.142715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 309 sessionId:  describe result for acl check
2025-09-30T14:51:08.142754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:08.142760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:08.142762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:08.142768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894880765351308:4305] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:08.143388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894880765351308:4305] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:08.145393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894880765351308:4305] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:08.146343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:08.148346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:08.148746Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:08.148757Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:08.148769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:08.148840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:08.148821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894880765351308:4305] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:08.148894Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894880675626402:3763]
2025-09-30T14:51:08.148842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894880765351308:4305] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:08.148846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894880765351308:4305] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:08.148857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 309 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:08.149556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:08.149845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:08.149902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:08.150268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:08.150329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:08.150336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:08.150337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:08.150338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:08.150339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:08.150341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:08.150342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:08.150343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:08.150344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:08.150345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:08.150347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.150348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.150349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.150350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:08.150351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:08.150357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:08.150367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:08.150371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:08.150375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:08.150378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:08.150382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:08.150386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:08.150389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:08.150392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:08.150396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:08.150400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.150404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.150407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.150411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:08.150415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:08.150423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:08.150430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:08.150436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:08.150442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:08.150446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:08.150451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:08.150455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:08.150460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:08.150464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:08.150469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:08.150473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:08.150478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:08.150485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:08.150491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:08.150495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:08.150499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:08.150504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:08.150508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:08.150512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:08.150517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:08.150521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.150527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.150538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.150543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.150547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.150552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.150556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:08.150565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:08.150569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:08.150586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:08.150625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:08.156327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:08.157292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:08.157307Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:08.157310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:08.157314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:08.157321Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 308 [2:7555894880675626402:3763]
2025-09-30T14:51:08.157338Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:08.157357Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:08.157360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.157363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.157365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.157379Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:08.157386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:08.157392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:08.157452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.157462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.157463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.157466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:08.157469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:08.157538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:08.157547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.157559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.157569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.157584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:08.157604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894880765351408:4305], now have 1 active actors on pipe
2025-09-30T14:51:08.157612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894880765351275:2454], now have 1 active actors on pipe
2025-09-30T14:51:08.157618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894880675626397:3763]
2025-09-30T14:51:08.157620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894880675626397:3763]
2025-09-30T14:51:08.157622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894880675626397:3763]
2025-09-30T14:51:08.157635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:08.157651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:08.157666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:08.157671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:08.157702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894880675626397:3763]
2025-09-30T14:51:08.157707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:08.157713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 308
2025-09-30T14:51:08.157760Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 308
2025-09-30T14:51:08.157740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:08.157749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:08.157754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:08.157760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:08.157838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:08.157848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:08.157873Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32c8629-793af847-f110f1fe-95a161c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:08.157885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.157888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.157890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:08.157901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.157915Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:08.157929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:08.158099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:08.158108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:08.158120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:08.159332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 309 partition: 0 MaxSeqNo: 42 sessionId: src_id|32c8629-793af847-f110f1fe-95a161c3_0
2025-09-30T14:51:08.159772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a52e623-412a8f13-4a2ff30e-ed9969bd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|32c8629-793af847-f110f1fe-95a161c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:08.162619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32c8629-793af847-f110f1fe-95a161c3_0] Write session: try to update token
2025-09-30T14:51:08.162639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32c8629-793af847-f110f1fe-95a161c3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:08.169637Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:08.169655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:08.169665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894880675626397:3763]
2025-09-30T14:51:08.169704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:08.169717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:08.169874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:08.170010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:08.170139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:08.170267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:08.170553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:08.170609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:08.179392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 309 sessionId: src_id|32c8629-793af847-f110f1fe-95a161c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:08.181421Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:08.181440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:08.181442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:08.181444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:08.181457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894880675626397:3763]
2025-09-30T14:51:08.181461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894880675626397:3763]
2025-09-30T14:51:08.181464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894880675626397:3763]
2025-09-30T14:51:08.181505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:08.181510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.181512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:08.181513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:08.181519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:08.181523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:08.181652Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:08.182388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:08.234431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894880765351442:4267]
2025-09-30T14:51:08.234736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 308, pipe: [1:7555894880765351442:4267]
2025-09-30T14:51:08.295835Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:08.296185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:08.296199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:08.296220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894880765351442:4267], now have 1 active actors on pipe
2025-09-30T14:51:08.296482Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:08.296488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:08.296492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:08.296548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894880765351442:4267]
2025-09-30T14:51:08.296573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 309 reason: error at write: Disconnected sessionId: src_id|32c8629-793af847-f110f1fe-95a161c3_0
2025-09-30T14:51:08.296803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 309 sessionId: src_id|32c8629-793af847-f110f1fe-95a161c3_0 is DEAD
2025-09-30T14:51:08.296530Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:08.296977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32c8629-793af847-f110f1fe-95a161c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:08.296988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32c8629-793af847-f110f1fe-95a161c3_0] Write session will restart in 0.005767s
2025-09-30T14:51:08.297012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32c8629-793af847-f110f1fe-95a161c3_0] Write session: Do CDS request
2025-09-30T14:51:08.297018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32c8629-793af847-f110f1fe-95a161c3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:08.303838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32c8629-793af847-f110f1fe-95a161c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:08.305074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:08.305097Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 310
2025-09-30T14:51:08.305218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 310 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:08.305270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 310 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:08.305281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=310 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:08.305285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:08.305737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 310 sessionId:  describe result for acl check
2025-09-30T14:51:08.305789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:08.305796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:08.305798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:08.305804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894880765351518:4316] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:08.306371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894880765351518:4316] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:08.308424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:08.309143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894880765351518:4316] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:08.310737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:08.310945Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:08.310955Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:08.311151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:08.311263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:08.311308Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894880675626576:3777]
2025-09-30T14:51:08.312010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:08.312393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:08.312463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:08.312839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:08.312932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:08.312940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:08.312941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:08.312942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:08.312943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:08.312945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:08.312946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:08.312947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:08.312948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:08.312950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:08.312951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.312953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.312954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.312955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:08.312956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:08.312963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:08.312974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:08.312978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:08.312982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:08.312986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:08.312990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:08.312994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:08.312999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:08.313003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:08.313008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:08.313012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.313015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.313020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.313024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:08.313030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:08.313039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:08.313048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:08.313054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:08.313060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:08.313068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:08.313074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:08.313078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:08.313084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:08.313088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:08.313093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:08.313098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:08.313104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:08.313109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:08.313115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:08.313120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:08.313125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:08.313131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:08.313137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:08.313142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:08.313156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:08.313166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.313172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.313182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.313187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.313197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.313202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.313211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:08.313217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:08.313226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:08.313232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:08.313278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:08.312075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894880765351518:4316] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:08.312096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894880765351518:4316] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:08.312100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894880765351518:4316] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:08.312111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 310 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:08.319363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:08.320401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:08.320417Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:08.320420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:08.320424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:08.320433Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 309 [2:7555894880675626576:3777]
2025-09-30T14:51:08.320450Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:08.320466Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:08.320474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.320478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.320480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.320495Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:08.320507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:08.320518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:08.320580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.320587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.320589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.320593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:08.320596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:08.320668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:08.320676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.320693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.320711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.320733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:08.320757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894880765351579:4316], now have 1 active actors on pipe
2025-09-30T14:51:08.320766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894880765351443:2454], now have 1 active actors on pipe
2025-09-30T14:51:08.320772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894880675626571:3777]
2025-09-30T14:51:08.320779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894880675626571:3777]
2025-09-30T14:51:08.320781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894880675626571:3777]
2025-09-30T14:51:08.320798Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:08.320815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:08.320819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:08.320822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:08.320825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:08.320829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:08.320832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:08.320872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894880675626571:3777]
2025-09-30T14:51:08.320875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:08.320890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:08.320908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:08.320914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:08.320947Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2aeb21a-83950ab9-16519a2c-e58fb9fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:08.320955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.320958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.320960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:08.320969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.320984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:08.321004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:08.321239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:08.321253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:08.321276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:08.321846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32c8629-793af847-f110f1fe-95a161c3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b2aeb21a-83950ab9-16519a2c-e58fb9fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:08.320861Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 309
2025-09-30T14:51:08.320861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 309
2025-09-30T14:51:08.321406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 310 partition: 0 MaxSeqNo: 42 sessionId: src_id|b2aeb21a-83950ab9-16519a2c-e58fb9fd_0
2025-09-30T14:51:08.324896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2aeb21a-83950ab9-16519a2c-e58fb9fd_0] Write session: try to update token
2025-09-30T14:51:08.324913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2aeb21a-83950ab9-16519a2c-e58fb9fd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:08.333858Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:08.333884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:08.333886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:08.333888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:08.333899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894880675626571:3777]
2025-09-30T14:51:08.333906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894880675626571:3777]
2025-09-30T14:51:08.333911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894880675626571:3777]
2025-09-30T14:51:08.333952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:08.333960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.333963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:08.333964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:08.333972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:08.333976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:08.334171Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:08.342061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 310 sessionId: src_id|b2aeb21a-83950ab9-16519a2c-e58fb9fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:08.345029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:08.396754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894880765351589:4267]
2025-09-30T14:51:08.397054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 309, pipe: [1:7555894880765351589:4267]
2025-09-30T14:51:08.448640Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:08.448982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:08.448997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:08.449014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894880765351589:4267], now have 1 active actors on pipe
2025-09-30T14:51:08.449272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894880765351589:4267]
2025-09-30T14:51:08.449283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:08.449288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:08.449305Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:08.449351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 310 reason: error at write: Disconnected sessionId: src_id|b2aeb21a-83950ab9-16519a2c-e58fb9fd_0
2025-09-30T14:51:08.449603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 310 sessionId: src_id|b2aeb21a-83950ab9-16519a2c-e58fb9fd_0 is DEAD
2025-09-30T14:51:08.449757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2aeb21a-83950ab9-16519a2c-e58fb9fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:08.449768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2aeb21a-83950ab9-16519a2c-e58fb9fd_0] Write session will restart in 0.009874s
2025-09-30T14:51:08.449792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2aeb21a-83950ab9-16519a2c-e58fb9fd_0] Write session: Do CDS request
2025-09-30T14:51:08.449798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2aeb21a-83950ab9-16519a2c-e58fb9fd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:08.450018Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:08.460453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:08.460801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2aeb21a-83950ab9-16519a2c-e58fb9fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:08.460855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:08.460876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 311
2025-09-30T14:51:08.461025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 311 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:08.461057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 311 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:08.461066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=311 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:08.461071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:08.461450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 311 sessionId:  describe result for acl check
2025-09-30T14:51:08.461482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:08.461491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:08.461493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:08.461499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894880765351693:4321] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:08.462022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894880765351693:4321] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:08.462678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:08.462930Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:08.462939Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:08.462948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:08.462997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:08.463037Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894880675626717:3779]
2025-09-30T14:51:08.463638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:08.463923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:08.463981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:08.464047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894880765351693:4321] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:08.464291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:08.464339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:08.464344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:08.464345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:08.464346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:08.464347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:08.464348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:08.464348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:08.464349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:08.464350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:08.464350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:08.464351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.464352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.464353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.464354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:08.464355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:08.464359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:08.464379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:08.464383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:08.464386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:08.464390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:08.464394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:08.464398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:08.464402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:08.464405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:08.464409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:08.464414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.464418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.464422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.464426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:08.464429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:08.464435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:08.464444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:08.464450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:08.464459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:08.464463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:08.464468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:08.464480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:08.464486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:08.464495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:08.464500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:08.464506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:08.464517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:08.464522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:08.464531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:08.464537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:08.464542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:08.464550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:08.464556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:08.464560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:08.464565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:08.464569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.464575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.464580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.464585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.464589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.464602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.464606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:08.464612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:08.464620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:08.464625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:08.464670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:08.469924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894880765351693:4321] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:08.469946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894880765351693:4321] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:08.469949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894880765351693:4321] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:08.469959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 311 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:08.470193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:08.471335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:08.471352Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:08.471355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:08.471359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:08.471366Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 310 [2:7555894880675626717:3779]
2025-09-30T14:51:08.471382Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:08.471399Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:08.471404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.471408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.471410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.471427Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:08.471433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:08.471441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:08.471506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.471513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.471518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.471521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:08.471524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:08.471593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:08.471601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.471614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.471632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.471656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:08.471680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894880765351731:4321], now have 1 active actors on pipe
2025-09-30T14:51:08.471692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894880765351592:2454], now have 1 active actors on pipe
2025-09-30T14:51:08.471699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894880675626711:3779]
2025-09-30T14:51:08.471701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894880675626711:3779]
2025-09-30T14:51:08.471703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894880675626711:3779]
2025-09-30T14:51:08.471718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:08.471733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:08.471741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:08.471748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:08.471751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:08.471753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:08.471755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:08.471758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 310
2025-09-30T14:51:08.471766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 310
2025-09-30T14:51:08.471787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894880675626711:3779]
2025-09-30T14:51:08.471799Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:08.471809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:08.471830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:08.471835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:08.471864Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f63a40d0-2c1db2e5-868e9748-320505e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:08.471876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.471880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.471881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:08.471890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.471903Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:08.471923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:08.472069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:08.472080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:08.472094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:08.472175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 311 partition: 0 MaxSeqNo: 42 sessionId: src_id|f63a40d0-2c1db2e5-868e9748-320505e3_0
2025-09-30T14:51:08.472572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2aeb21a-83950ab9-16519a2c-e58fb9fd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f63a40d0-2c1db2e5-868e9748-320505e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:08.475404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f63a40d0-2c1db2e5-868e9748-320505e3_0] Write session: try to update token
2025-09-30T14:51:08.475422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f63a40d0-2c1db2e5-868e9748-320505e3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:08.484204Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:08.484225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:08.484229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:08.484231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:08.484245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894880675626711:3779]
2025-09-30T14:51:08.484249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894880675626711:3779]
2025-09-30T14:51:08.484253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894880675626711:3779]
2025-09-30T14:51:08.484301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:08.484309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:08.484314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.484316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:08.484317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:08.484321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:08.484465Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:08.495296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 311 sessionId: src_id|f63a40d0-2c1db2e5-868e9748-320505e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:08.498116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:08.549323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894880765351739:4267]
2025-09-30T14:51:08.549553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 310, pipe: [1:7555894880765351739:4267]
2025-09-30T14:51:08.594357Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:08.594734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:08.594748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:08.594768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894880765351739:4267], now have 1 active actors on pipe
2025-09-30T14:51:08.594964Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:08.595020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894880765351739:4267]
2025-09-30T14:51:08.595028Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:08.595065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:08.595068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:08.595130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 311 reason: error at write: Disconnected sessionId: src_id|f63a40d0-2c1db2e5-868e9748-320505e3_0
2025-09-30T14:51:08.595386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 311 sessionId: src_id|f63a40d0-2c1db2e5-868e9748-320505e3_0 is DEAD
2025-09-30T14:51:08.595560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63a40d0-2c1db2e5-868e9748-320505e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:08.595569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63a40d0-2c1db2e5-868e9748-320505e3_0] Write session will restart in 0.005518s
2025-09-30T14:51:08.595591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63a40d0-2c1db2e5-868e9748-320505e3_0] Write session: Do CDS request
2025-09-30T14:51:08.595598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63a40d0-2c1db2e5-868e9748-320505e3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:08.603667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f63a40d0-2c1db2e5-868e9748-320505e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:08.603788Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:08.603807Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 312
2025-09-30T14:51:08.603977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 312 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:08.604020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 312 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:08.604032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=312 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:08.604036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:08.604461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 312 sessionId:  describe result for acl check
2025-09-30T14:51:08.604505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:08.604516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:08.604518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:08.604524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894880765351838:4325] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:08.605065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894880765351838:4325] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:08.605665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:08.607200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894880765351838:4325] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:08.607748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:08.608007Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:08.608017Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:08.608030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:08.608087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:08.608134Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894880675626857:3782]
2025-09-30T14:51:08.608803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:08.609065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:08.609103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:08.609419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:08.609477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:08.609485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:08.609486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:08.609487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:08.609488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:08.609489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:08.609491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:08.609492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:08.609493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:08.609494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:08.609496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.609497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.609498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.609500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:08.609502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:08.609507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:08.609516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:08.609521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:08.609525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:08.609529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:08.609533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:08.609537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:08.609541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:08.609545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:08.609549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:08.609553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.609557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.609561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.609565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:08.609569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:08.609577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:08.609585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:08.609590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:08.609596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:08.609600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:08.609604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:08.609608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:08.609612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:08.609617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:08.609621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:08.609632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:08.609637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:08.609646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:08.609651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:08.609658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:08.609662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:08.609666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:08.609671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:08.609675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:08.609679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:08.609683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.609693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.609698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.609703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.609708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.609717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.609721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:08.609731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:08.609736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:08.609741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:08.609786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:08.609821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894880765351838:4325] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:08.609836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894880765351838:4325] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:08.609840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894880765351838:4325] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:08.609849Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 312 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:08.615504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:08.616760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:08.616776Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:08.616779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:08.616783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:08.616790Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 311 [2:7555894880675626857:3782]
2025-09-30T14:51:08.616807Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:08.616825Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:08.616835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.616838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.616840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.616856Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:08.616863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:08.616870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:08.616932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.616938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.616940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.616944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:08.616947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:08.617012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:08.617020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.617032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.617049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.617065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:08.617084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894880765351878:4325], now have 1 active actors on pipe
2025-09-30T14:51:08.617087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894880765351740:2454], now have 1 active actors on pipe
2025-09-30T14:51:08.617091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894880675626851:3782]
2025-09-30T14:51:08.617093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894880675626851:3782]
2025-09-30T14:51:08.617094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894880675626851:3782]
2025-09-30T14:51:08.617105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:08.617118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:08.617133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:08.617136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:08.617142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:08.617146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:08.617148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:08.617163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894880675626851:3782]
2025-09-30T14:51:08.617166Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:08.617169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:08.617191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 311
2025-09-30T14:51:08.617200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 311
2025-09-30T14:51:08.617312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:08.617321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:08.617344Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5cb28175-3174f920-243dc758-10501153_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:08.617353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.617357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.617359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:08.617366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.617378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:08.617393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:08.617519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:08.617529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:08.617544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:08.617628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 312 partition: 0 MaxSeqNo: 42 sessionId: src_id|5cb28175-3174f920-243dc758-10501153_0
2025-09-30T14:51:08.618071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63a40d0-2c1db2e5-868e9748-320505e3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5cb28175-3174f920-243dc758-10501153_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:08.621177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cb28175-3174f920-243dc758-10501153_0] Write session: try to update token
2025-09-30T14:51:08.621196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cb28175-3174f920-243dc758-10501153_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:08.629402Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:08.629428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:08.629438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894880675626851:3782]
2025-09-30T14:51:08.629486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:08.629491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:08.629721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:08.629913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:08.630057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:08.630197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:08.630393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:08.630438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:08.636751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 312 sessionId: src_id|5cb28175-3174f920-243dc758-10501153_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:08.639925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:08.640618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:08.640646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:08.640666Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:08.640673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:08.640676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:08.640678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:08.640689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894880675626851:3782]
2025-09-30T14:51:08.640693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894880675626851:3782]
2025-09-30T14:51:08.640697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894880675626851:3782]
2025-09-30T14:51:08.640742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:08.640750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:08.640756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:08.640757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.640760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:08.640760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:08.640902Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:08.695270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894880765351887:4267]
2025-09-30T14:51:08.695574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 311, pipe: [1:7555894880765351887:4267]
2025-09-30T14:51:08.753734Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:08.754032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:08.754074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894880765351887:4267], now have 1 active actors on pipe
2025-09-30T14:51:08.754199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:08.754229Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:08.754274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894880765351887:4267]
2025-09-30T14:51:08.754308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:08.754316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:08.754404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 312 reason: error at write: Disconnected sessionId: src_id|5cb28175-3174f920-243dc758-10501153_0
2025-09-30T14:51:08.754669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 312 sessionId: src_id|5cb28175-3174f920-243dc758-10501153_0 is DEAD
2025-09-30T14:51:08.754754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cb28175-3174f920-243dc758-10501153_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:08.754764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cb28175-3174f920-243dc758-10501153_0] Write session will restart in 0.005983s
2025-09-30T14:51:08.754789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cb28175-3174f920-243dc758-10501153_0] Write session: Do CDS request
2025-09-30T14:51:08.754795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cb28175-3174f920-243dc758-10501153_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:08.761845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cb28175-3174f920-243dc758-10501153_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:08.761939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:08.761956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 313
2025-09-30T14:51:08.762138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 313 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:08.762179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 313 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:08.762188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=313 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:08.762191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:08.762707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 313 sessionId:  describe result for acl check
2025-09-30T14:51:08.762747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:08.762749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:08.762752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:08.762758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894880765351947:4329] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:08.763334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894880765351947:4329] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:08.765163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894880765351947:4329] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:08.765257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:08.767151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:08.767446Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:08.767459Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:08.767472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:08.767533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:08.767573Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894880675627009:3785]
2025-09-30T14:51:08.767754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894880765351947:4329] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:08.767770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894880765351947:4329] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:08.767774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894880765351947:4329] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:08.767782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 313 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:08.768219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:08.768470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:08.768512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:08.768842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:08.768900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:08.768906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:08.768907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:08.768908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:08.768909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:08.768911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:08.768912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:08.768913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:08.768915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:08.768916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:08.768917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.768919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.768920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.768921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:08.768922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:08.768927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:08.768937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:08.768941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:08.768946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:08.768950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:08.768954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:08.768958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:08.768961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:08.768964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:08.768968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:08.768972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.768976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.768980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.768984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:08.768988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:08.768995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:08.769008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:08.769019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:08.769026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:08.769030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:08.769036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:08.769045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:08.769051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:08.769061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:08.769071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:08.769080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:08.769089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:08.769094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:08.769103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:08.769109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:08.769122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:08.769129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:08.769134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:08.769138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:08.769143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:08.769147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.769153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.769157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.769162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.769167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.769172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.769176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:08.769181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:08.769185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:08.769190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:08.769234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:08.774784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:08.775845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:08.775863Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:08.775865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:08.775870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:08.775876Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 312 [2:7555894880675627009:3785]
2025-09-30T14:51:08.775893Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:08.775910Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:08.775913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.775916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.775919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.775937Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:08.775948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:08.775955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:08.776023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.776031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.776033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.776036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:08.776039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:08.776108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:08.776115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.776129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.776146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.776167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:08.776190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894880765352026:4329], now have 1 active actors on pipe
2025-09-30T14:51:08.776198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894880765351889:2454], now have 1 active actors on pipe
2025-09-30T14:51:08.776205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894880675627003:3785]
2025-09-30T14:51:08.776206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894880675627003:3785]
2025-09-30T14:51:08.776208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894880675627003:3785]
2025-09-30T14:51:08.776238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 312
2025-09-30T14:51:08.776238Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 312
2025-09-30T14:51:08.776223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:08.776242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:08.776241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:08.776245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:08.776247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:08.776257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:08.776260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:08.776295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894880675627003:3785]
2025-09-30T14:51:08.776301Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:08.776310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:08.776322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:08.776327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:08.776378Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce282c4f-fe5f9acf-bcefc973-f2517671_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:08.776385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.776389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.776391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:08.776401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.776409Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:08.776431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:08.777387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:08.777398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:08.777417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:08.777560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 313 partition: 0 MaxSeqNo: 42 sessionId: src_id|ce282c4f-fe5f9acf-bcefc973-f2517671_0
2025-09-30T14:51:08.777968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cb28175-3174f920-243dc758-10501153_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ce282c4f-fe5f9acf-bcefc973-f2517671_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:08.781059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce282c4f-fe5f9acf-bcefc973-f2517671_0] Write session: try to update token
2025-09-30T14:51:08.781081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce282c4f-fe5f9acf-bcefc973-f2517671_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:08.788645Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:08.788663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:08.788665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:08.788667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:08.788678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894880675627003:3785]
2025-09-30T14:51:08.788683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894880675627003:3785]
2025-09-30T14:51:08.788687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894880675627003:3785]
2025-09-30T14:51:08.788733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:08.788739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.788741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:08.788755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:08.788761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:08.788764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:08.788881Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:08.796792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 313 sessionId: src_id|ce282c4f-fe5f9acf-bcefc973-f2517671_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:08.799411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:08.854476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894880765352049:4267]
2025-09-30T14:51:08.854762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 312, pipe: [1:7555894880765352049:4267]
2025-09-30T14:51:08.901008Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:08.901489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:08.901506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:08.901527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894880765352049:4267], now have 1 active actors on pipe
2025-09-30T14:51:08.901807Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:08.901827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:08.901856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894880765352049:4267]
2025-09-30T14:51:08.901910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:08.901918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:08.901991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 313 reason: error at write: Disconnected sessionId: src_id|ce282c4f-fe5f9acf-bcefc973-f2517671_0
2025-09-30T14:51:08.902232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 313 sessionId: src_id|ce282c4f-fe5f9acf-bcefc973-f2517671_0 is DEAD
2025-09-30T14:51:08.902384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce282c4f-fe5f9acf-bcefc973-f2517671_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:08.902392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce282c4f-fe5f9acf-bcefc973-f2517671_0] Write session will restart in 0.008807s
2025-09-30T14:51:08.902407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce282c4f-fe5f9acf-bcefc973-f2517671_0] Write session: Do CDS request
2025-09-30T14:51:08.902412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce282c4f-fe5f9acf-bcefc973-f2517671_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:08.912833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce282c4f-fe5f9acf-bcefc973-f2517671_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:08.912917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:08.912936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 314
2025-09-30T14:51:08.913061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 314 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:08.913101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 314 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:08.913109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=314 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:08.913112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:08.913224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:08.913516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 314 sessionId:  describe result for acl check
2025-09-30T14:51:08.913551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:08.913557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:08.913560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:08.913566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894880765352155:4334] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:08.914124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894880765352155:4334] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:08.915173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:08.915490Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:08.915509Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:08.915522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:08.915588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:08.915630Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894880675627151:3787]
2025-09-30T14:51:08.916150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894880765352155:4334] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:08.916264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:08.916629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:08.916677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:08.917007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:08.917089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:08.917096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:08.917097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:08.917098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:08.917099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:08.917101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:08.917102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:08.917103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:08.917105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:08.917106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:08.917107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.917108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.917109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.917111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:08.917112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:08.917119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:08.917128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:08.917132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:08.917136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:08.917139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:08.917143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:08.917146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:08.917149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:08.917153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:08.917157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:08.917160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.917164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.917167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.917170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:08.917174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:08.917182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:08.917191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:08.917206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:08.917212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:08.917217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:08.917222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:08.917226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:08.917231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:08.917239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:08.917243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:08.917248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:08.917253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:08.917257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:08.917262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:08.917268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:08.917273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:08.917277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:08.917282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:08.917287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:08.917292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:08.917296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.917302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.917307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.917312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.917317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.917322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.917327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:08.917332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:08.917337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:08.917342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:08.917381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:08.920515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894880765352155:4334] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:08.920536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894880765352155:4334] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:08.920540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894880765352155:4334] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:08.920550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 314 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:08.923126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:08.924162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:08.924177Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:08.924180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:08.924184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:08.924193Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 313 [2:7555894880675627151:3787]
2025-09-30T14:51:08.924211Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:08.924228Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:08.924236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.924239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.924240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.924253Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:08.924259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:08.924266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:08.924328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.924336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.924338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.924341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:08.924343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:08.924416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:08.924423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.924436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:08.924451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:08.924471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:08.924494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894880765352193:4334], now have 1 active actors on pipe
2025-09-30T14:51:08.924502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894880765352051:2454], now have 1 active actors on pipe
2025-09-30T14:51:08.924508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894880675627145:3787]
2025-09-30T14:51:08.924510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894880675627145:3787]
2025-09-30T14:51:08.924513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894880675627145:3787]
2025-09-30T14:51:08.924530Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:08.924543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:08.924547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:08.924549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:08.924550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:08.924566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:08.924569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:08.924568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 313
2025-09-30T14:51:08.924601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894880675627145:3787]
2025-09-30T14:51:08.924572Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 313
2025-09-30T14:51:08.924609Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:08.924616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:08.924636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:08.924647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:08.924678Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|812e3242-f80ce5e1-402d4252-1a184ffd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:08.924690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.924694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.924696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:08.924705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.924714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:08.924735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:08.924889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:08.924901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:08.924927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:08.924995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 314 partition: 0 MaxSeqNo: 42 sessionId: src_id|812e3242-f80ce5e1-402d4252-1a184ffd_0
2025-09-30T14:51:08.925415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce282c4f-fe5f9acf-bcefc973-f2517671_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|812e3242-f80ce5e1-402d4252-1a184ffd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:08.928312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|812e3242-f80ce5e1-402d4252-1a184ffd_0] Write session: try to update token
2025-09-30T14:51:08.928334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|812e3242-f80ce5e1-402d4252-1a184ffd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:08.936852Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:08.936868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:08.936871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:08.936872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:08.936881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894880675627145:3787]
2025-09-30T14:51:08.936886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894880675627145:3787]
2025-09-30T14:51:08.936890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894880675627145:3787]
2025-09-30T14:51:08.936930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:08.936933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:08.936937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:08.936942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:08.936942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:08.936947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:08.937088Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:08.943881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 314 sessionId: src_id|812e3242-f80ce5e1-402d4252-1a184ffd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:08.946714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:09.001945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894885060319505:4267]
2025-09-30T14:51:09.002251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 313, pipe: [1:7555894885060319505:4267]
2025-09-30T14:51:09.052086Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:09.052522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:09.052541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:09.052564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894885060319505:4267], now have 1 active actors on pipe
2025-09-30T14:51:09.052814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894885060319505:4267]
2025-09-30T14:51:09.052822Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:09.052824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:09.052828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:09.052863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:09.052903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 314 reason: error at write: Disconnected sessionId: src_id|812e3242-f80ce5e1-402d4252-1a184ffd_0
2025-09-30T14:51:09.053132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 314 sessionId: src_id|812e3242-f80ce5e1-402d4252-1a184ffd_0 is DEAD
2025-09-30T14:51:09.053296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|812e3242-f80ce5e1-402d4252-1a184ffd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:09.053309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|812e3242-f80ce5e1-402d4252-1a184ffd_0] Write session will restart in 0.009697s
2025-09-30T14:51:09.053332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|812e3242-f80ce5e1-402d4252-1a184ffd_0] Write session: Do CDS request
2025-09-30T14:51:09.053354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|812e3242-f80ce5e1-402d4252-1a184ffd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:09.063779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:09.063853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|812e3242-f80ce5e1-402d4252-1a184ffd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:09.063972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:09.063992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 315
2025-09-30T14:51:09.064149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 315 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:09.064181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 315 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:09.064191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=315 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:09.064194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:09.064575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 315 sessionId:  describe result for acl check
2025-09-30T14:51:09.064611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:09.064619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:09.064621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:09.064626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894885060319615:4340] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:09.065038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894885060319615:4340] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:09.066075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:09.066301Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:09.066313Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:09.066324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:09.066396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:09.066438Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894884970594592:3790]
2025-09-30T14:51:09.067125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:09.067343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894885060319615:4340] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:09.067424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:09.067467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:09.067810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:09.067871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:09.067877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:09.067878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:09.067880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:09.067881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:09.067883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:09.067884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:09.067885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:09.067886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:09.067888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:09.067889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.067890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.067891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.067892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:09.067893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:09.067899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:09.067926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:09.067931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:09.067935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:09.067939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:09.067943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:09.067947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:09.067951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:09.067955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:09.067960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:09.067964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.067968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.067972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.067976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:09.067980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:09.067987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:09.067996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:09.068001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:09.068006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:09.068011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:09.068016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:09.068020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:09.068025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:09.068030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:09.068035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:09.068040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:09.068045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:09.068050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:09.068055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:09.068059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:09.068064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:09.068072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:09.068077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:09.068083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:09.068095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:09.068099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.068105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.068114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.068119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.068124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.068129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.068133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:09.068138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:09.068144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:09.068155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:09.068198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:09.073543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894885060319615:4340] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:09.073564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894885060319615:4340] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:09.073567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894885060319615:4340] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:09.073577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 315 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:09.074069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:09.075264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:09.075281Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:09.075284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:09.075289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:09.075296Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 314 [2:7555894884970594592:3790]
2025-09-30T14:51:09.075314Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:09.075332Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:09.075336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:09.075339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:09.075342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:09.075360Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:09.075372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:09.075379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:09.075443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.075450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.075456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.075460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:09.075463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:09.075531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:09.075536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.075550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.075563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.075591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:09.075607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894885060319510:2454], now have 1 active actors on pipe
2025-09-30T14:51:09.075610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894885060319653:4340], now have 1 active actors on pipe
2025-09-30T14:51:09.075614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894884970594586:3790]
2025-09-30T14:51:09.075616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894884970594586:3790]
2025-09-30T14:51:09.075618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894884970594586:3790]
2025-09-30T14:51:09.075629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:09.075640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:09.075653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:09.075659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:09.075663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:09.075663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:09.075666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:09.075695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894884970594586:3790]
2025-09-30T14:51:09.075696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 314
2025-09-30T14:51:09.075713Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:09.075715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 314
2025-09-30T14:51:09.075726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:09.075870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:09.075884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:09.075921Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ba3c3a-98aa978f-4aaaafb0-718a3eca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:09.075935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:09.075938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:09.075940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:09.075949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:09.075961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:09.075975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:09.076201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:09.076219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:09.076254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:09.076339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 315 partition: 0 MaxSeqNo: 42 sessionId: src_id|3ba3c3a-98aa978f-4aaaafb0-718a3eca_0
2025-09-30T14:51:09.076786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|812e3242-f80ce5e1-402d4252-1a184ffd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3ba3c3a-98aa978f-4aaaafb0-718a3eca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:09.079704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ba3c3a-98aa978f-4aaaafb0-718a3eca_0] Write session: try to update token
2025-09-30T14:51:09.079725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ba3c3a-98aa978f-4aaaafb0-718a3eca_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:09.088306Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:09.088325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:09.088329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:09.088332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:09.088340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894884970594586:3790]
2025-09-30T14:51:09.088346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894884970594586:3790]
2025-09-30T14:51:09.088350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894884970594586:3790]
2025-09-30T14:51:09.088393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:09.088401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.088404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:09.088554Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:09.088714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:09.088727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:09.088732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:09.096385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 315 sessionId: src_id|3ba3c3a-98aa978f-4aaaafb0-718a3eca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:09.099432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:09.152930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894885060319660:4267]
2025-09-30T14:51:09.153253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 314, pipe: [1:7555894885060319660:4267]
2025-09-30T14:51:09.205931Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:09.206375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:09.206391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:09.206441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894885060319660:4267], now have 1 active actors on pipe
2025-09-30T14:51:09.206725Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:09.207263Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:09.207274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:09.207280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:09.207329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894885060319660:4267]
2025-09-30T14:51:09.207346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 315 reason: error at write: Disconnected sessionId: src_id|3ba3c3a-98aa978f-4aaaafb0-718a3eca_0
2025-09-30T14:51:09.207581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 315 sessionId: src_id|3ba3c3a-98aa978f-4aaaafb0-718a3eca_0 is DEAD
2025-09-30T14:51:09.207990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ba3c3a-98aa978f-4aaaafb0-718a3eca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:09.208003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ba3c3a-98aa978f-4aaaafb0-718a3eca_0] Write session will restart in 0.006051s
2025-09-30T14:51:09.208028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ba3c3a-98aa978f-4aaaafb0-718a3eca_0] Write session: Do CDS request
2025-09-30T14:51:09.208036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ba3c3a-98aa978f-4aaaafb0-718a3eca_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:09.216330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ba3c3a-98aa978f-4aaaafb0-718a3eca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:09.216415Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:09.216447Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 316
2025-09-30T14:51:09.220758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 316 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:09.220818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 316 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:09.220824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=316 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:09.220829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:09.221347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 316 sessionId:  describe result for acl check
2025-09-30T14:51:09.221384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:09.221390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:09.221392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:09.221398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894885060319778:4345] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:09.221903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894885060319778:4345] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:09.222670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:09.224096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894885060319778:4345] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:09.225643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:09.225903Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:09.225908Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:09.225920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:09.225991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:09.226026Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894884970594749:3792]
2025-09-30T14:51:09.226732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:09.227108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:09.227159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:09.227558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:09.227637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:09.227643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:09.227644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:09.227646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:09.227647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:09.227649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:09.227650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:09.227651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:09.227653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:09.227654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:09.227655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.227657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.227658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.227660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:09.227661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:09.227667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:09.227677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:09.227681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:09.227684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:09.227686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:09.227689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:09.227691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:09.227694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:09.227696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:09.227699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:09.227701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.227704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.227706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.227709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:09.227711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:09.227717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:09.227724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:09.227728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:09.227731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:09.227733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:09.227736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:09.227741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:09.227747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:09.227754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:09.227759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:09.227763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:09.227768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:09.227771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:09.227776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:09.227780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:09.227785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:09.227791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:09.227796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:09.227798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:09.227802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:09.227804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.227808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.227811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.227814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.227816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.227820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.227823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:09.227827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:09.227829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:09.227833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:09.227886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:09.231424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894885060319778:4345] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:09.231446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894885060319778:4345] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:09.231449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894885060319778:4345] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:09.231458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 316 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:09.234114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:09.235174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:09.235192Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:09.235195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:09.235202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:09.235209Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 315 [2:7555894884970594749:3792]
2025-09-30T14:51:09.235226Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:09.235241Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:09.235261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:09.235264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:09.235267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:09.235283Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:09.235291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:09.235297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:09.235356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.235363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.235365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.235368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:09.235371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:09.235446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:09.235455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.235469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.235481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.235497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:09.235520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894885060319818:4345], now have 1 active actors on pipe
2025-09-30T14:51:09.235528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894885060319662:2454], now have 1 active actors on pipe
2025-09-30T14:51:09.235534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894884970594744:3792]
2025-09-30T14:51:09.235537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894884970594744:3792]
2025-09-30T14:51:09.235539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894884970594744:3792]
2025-09-30T14:51:09.235555Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:09.235569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:09.235587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:09.235586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:09.235591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:09.235594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:09.235594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:09.235628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894884970594744:3792]
2025-09-30T14:51:09.235639Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:09.235645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:09.235634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 315
2025-09-30T14:51:09.235669Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 315
2025-09-30T14:51:09.235736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:09.235746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:09.235773Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8fb0ed20-5c3e293c-e96d6aef-d48253ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:09.235785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:09.235788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:09.235795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:09.235803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:09.235813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:09.235837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:09.236005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:09.236017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:09.236039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:09.236119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 316 partition: 0 MaxSeqNo: 42 sessionId: src_id|8fb0ed20-5c3e293c-e96d6aef-d48253ea_0
2025-09-30T14:51:09.236534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ba3c3a-98aa978f-4aaaafb0-718a3eca_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8fb0ed20-5c3e293c-e96d6aef-d48253ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:09.239588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fb0ed20-5c3e293c-e96d6aef-d48253ea_0] Write session: try to update token
2025-09-30T14:51:09.239606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fb0ed20-5c3e293c-e96d6aef-d48253ea_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:09.255540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 316 sessionId: src_id|8fb0ed20-5c3e293c-e96d6aef-d48253ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:09.256636Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:09.256652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:09.256661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894884970594744:3792]
2025-09-30T14:51:09.256708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:09.256717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:09.256900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:09.257071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:09.257232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:09.257398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:09.257708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:09.257765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:09.258554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:09.258794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:09.258819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:09.258854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:09.258945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:09.261361Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:09.261382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:09.261385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:09.261388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:09.261398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894884970594744:3792]
2025-09-30T14:51:09.261402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894884970594744:3792]
2025-09-30T14:51:09.261406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894884970594744:3792]
2025-09-30T14:51:09.261449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:09.261453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:09.261458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.261459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:09.261460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:09.261462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:09.261615Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:09.307613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894885060319835:4267]
2025-09-30T14:51:09.307898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 315, pipe: [1:7555894885060319835:4267]
2025-09-30T14:51:09.375475Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:09.383872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:09.383898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:09.384063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:09.384123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:09.384189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:09.384253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:09.384484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:09.384496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:09.384567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:09.384627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:09.384691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:09.384754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:09.384801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:09.384805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:09.384885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:09.384960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:09.385033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:09.385108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:09.385156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:09.385164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:09.385241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:09.385317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:09.385393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:09.385506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:09.385558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:09.385569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:09.385649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:09.385722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:09.385799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:09.385869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:09.385915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:09.385923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:09.386000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:09.386067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:09.386138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:09.386206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:09.386273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:09.386280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:09.386347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:09.386412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:09.386483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:09.386552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:09.386622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:09.386630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:09.386701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:09.386766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:09.386833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:09.386904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:09.386950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:09.386957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:09.387026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:09.387093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:09.387161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:09.387236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:09.387302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:09.387310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:09.387383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:09.387450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:09.387522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:09.387589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:09.387638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:09.387646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:09.387718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894885060319835:4267], now have 1 active actors on pipe
2025-09-30T14:51:09.388009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894885060319835:4267]
2025-09-30T14:51:09.388020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:09.388025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:09.388051Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:09.388055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 316 reason: error at write: Disconnected sessionId: src_id|8fb0ed20-5c3e293c-e96d6aef-d48253ea_0
2025-09-30T14:51:09.388280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 316 sessionId: src_id|8fb0ed20-5c3e293c-e96d6aef-d48253ea_0 is DEAD
2025-09-30T14:51:09.388453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fb0ed20-5c3e293c-e96d6aef-d48253ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:09.388465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fb0ed20-5c3e293c-e96d6aef-d48253ea_0] Write session will restart in 0.007492s
2025-09-30T14:51:09.388487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fb0ed20-5c3e293c-e96d6aef-d48253ea_0] Write session: Do CDS request
2025-09-30T14:51:09.388494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fb0ed20-5c3e293c-e96d6aef-d48253ea_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:09.388701Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:09.396857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fb0ed20-5c3e293c-e96d6aef-d48253ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:09.397310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:09.397330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 317
2025-09-30T14:51:09.397473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 317 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:09.397515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 317 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:09.397523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=317 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:09.397532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:09.398207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 317 sessionId:  describe result for acl check
2025-09-30T14:51:09.398243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:09.398250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:09.398252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:09.398259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894885060319923:4355] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:09.398818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894885060319923:4355] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:09.400908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:09.401405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894885060319923:4355] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:09.402797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:09.403007Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:09.403017Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:09.403028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:09.403079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:09.403120Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894884970594917:3806]
2025-09-30T14:51:09.403897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:09.404203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:09.404268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:09.404331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894885060319923:4355] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:09.404349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894885060319923:4355] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:09.404354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894885060319923:4355] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:09.404363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 317 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:09.404611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:09.404684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:09.404689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:09.404691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:09.404692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:09.404693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:09.404694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:09.404695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:09.404697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:09.404698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:09.404699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:09.404700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.404701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.404702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.404703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:09.404705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:09.404710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:09.404720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:09.404723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:09.404727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:09.404730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:09.404733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:09.404737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:09.404740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:09.404744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:09.404748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:09.404751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.404754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.404758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.404762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:09.404765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:09.404773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:09.404781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:09.404786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:09.404791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:09.404795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:09.404802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:09.404805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:09.404810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:09.404814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:09.404819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:09.404823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:09.404827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:09.404832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:09.404836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:09.404840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:09.404844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:09.404849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:09.404854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:09.404857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:09.404861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:09.404868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.404873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.404876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.404882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.404891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.404896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.404900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:09.404904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:09.404908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:09.404919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:09.404969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:09.410637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:09.411800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:09.411817Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:09.411820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:09.411824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:09.411832Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 316 [2:7555894884970594917:3806]
2025-09-30T14:51:09.411848Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:09.411863Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:09.411866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:09.411869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:09.411871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:09.411888Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:09.411895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:09.411907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:09.412113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.412124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.412127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.412130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:09.412133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:09.412204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:09.412211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.412223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.412233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.412254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:09.412275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894885060319980:4355], now have 1 active actors on pipe
2025-09-30T14:51:09.412283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894885060319837:2454], now have 1 active actors on pipe
2025-09-30T14:51:09.412289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894884970594912:3806]
2025-09-30T14:51:09.412291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894884970594912:3806]
2025-09-30T14:51:09.412293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894884970594912:3806]
2025-09-30T14:51:09.412306Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:09.412320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:09.412332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:09.412336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:09.412337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:09.412338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:09.412340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:09.412372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894884970594912:3806]
2025-09-30T14:51:09.412380Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:09.412386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:09.412395Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 316
2025-09-30T14:51:09.412398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 316
2025-09-30T14:51:09.412544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:09.412562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:09.412611Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5866fd3-1e33af58-8ca1dfbe-5125deec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:09.412626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:09.412634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:09.412637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:09.412648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:09.412676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:09.412703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:09.412900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:09.412908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:09.412923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:09.413038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 317 partition: 0 MaxSeqNo: 42 sessionId: src_id|f5866fd3-1e33af58-8ca1dfbe-5125deec_0
2025-09-30T14:51:09.413430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fb0ed20-5c3e293c-e96d6aef-d48253ea_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f5866fd3-1e33af58-8ca1dfbe-5125deec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:09.416254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5866fd3-1e33af58-8ca1dfbe-5125deec_0] Write session: try to update token
2025-09-30T14:51:09.416275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5866fd3-1e33af58-8ca1dfbe-5125deec_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:09.424796Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:09.424816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:09.424819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:09.424821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:09.424832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894884970594912:3806]
2025-09-30T14:51:09.424836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894884970594912:3806]
2025-09-30T14:51:09.424841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894884970594912:3806]
2025-09-30T14:51:09.424883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:09.424887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:09.424891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.424892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:09.424894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:09.424899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:09.425046Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:09.431866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 317 sessionId: src_id|f5866fd3-1e33af58-8ca1dfbe-5125deec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:09.434809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:09.488328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894885060319992:4267]
2025-09-30T14:51:09.488621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 316, pipe: [1:7555894885060319992:4267]
2025-09-30T14:51:09.537995Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:09.538444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:09.538459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:09.538479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894885060319992:4267], now have 1 active actors on pipe
2025-09-30T14:51:09.538716Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:09.538785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:09.538792Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:09.538803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:09.538845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894885060319992:4267]
2025-09-30T14:51:09.538865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 317 reason: error at write: Disconnected sessionId: src_id|f5866fd3-1e33af58-8ca1dfbe-5125deec_0
2025-09-30T14:51:09.539107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 317 sessionId: src_id|f5866fd3-1e33af58-8ca1dfbe-5125deec_0 is DEAD
2025-09-30T14:51:09.539514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5866fd3-1e33af58-8ca1dfbe-5125deec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:09.539526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5866fd3-1e33af58-8ca1dfbe-5125deec_0] Write session will restart in 0.005384s
2025-09-30T14:51:09.539563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5866fd3-1e33af58-8ca1dfbe-5125deec_0] Write session: Do CDS request
2025-09-30T14:51:09.539568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5866fd3-1e33af58-8ca1dfbe-5125deec_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:09.545854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5866fd3-1e33af58-8ca1dfbe-5125deec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:09.545983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:09.546001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 318
2025-09-30T14:51:09.546130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 318 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:09.546164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 318 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:09.546170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=318 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:09.546174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:09.546685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 318 sessionId:  describe result for acl check
2025-09-30T14:51:09.546726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:09.546729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:09.546733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:09.546740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894885060320017:4360] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:09.547309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894885060320017:4360] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:09.549556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894885060320017:4360] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:09.552280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:09.552361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894885060320017:4360] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:09.552379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894885060320017:4360] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:09.552382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894885060320017:4360] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:09.552390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 318 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:09.554430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:09.554727Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:09.554739Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:09.554751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:09.554816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:09.554857Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894884970595066:3809]
2025-09-30T14:51:09.555464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:09.555796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:09.555864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:09.556206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:09.556268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:09.556273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:09.556275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:09.556276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:09.556277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:09.556279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:09.556280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:09.556281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:09.556283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:09.556284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:09.556286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.556287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.556288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.556289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:09.556291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:09.556297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:09.556308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:09.556312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:09.556316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:09.556321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:09.556325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:09.556329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:09.556334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:09.556338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:09.556344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:09.556348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.556351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.556355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.556359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:09.556363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:09.556370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:09.556377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:09.556383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:09.556388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:09.556393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:09.556398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:09.556403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:09.556408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:09.556412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:09.556417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:09.556423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:09.556428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:09.556433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:09.556438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:09.556442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:09.556447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:09.556451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:09.556457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:09.556466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:09.556471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:09.556475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.556480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.556489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.556494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.556499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.556508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.556513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:09.556518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:09.556526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:09.556531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:09.556594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:09.562341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:09.563336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:09.563350Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:09.563354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:09.563358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:09.563365Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 317 [2:7555894884970595066:3809]
2025-09-30T14:51:09.563381Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:09.563397Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:09.563400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:09.563403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:09.563406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:09.563423Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:09.563431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:09.563438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:09.563503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.563512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.563514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.563518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:09.563522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:09.563644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:09.563653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.563668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.563685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.563710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:09.563733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894885060319994:2454], now have 1 active actors on pipe
2025-09-30T14:51:09.563741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 317
2025-09-30T14:51:09.563742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 317
2025-09-30T14:51:09.563744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894885060320136:4360], now have 1 active actors on pipe
2025-09-30T14:51:09.563751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894884970595060:3809]
2025-09-30T14:51:09.563754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894884970595060:3809]
2025-09-30T14:51:09.563756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894884970595060:3809]
2025-09-30T14:51:09.563766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:09.563781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:09.563797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:09.563801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:09.563802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:09.563805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:09.563808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:09.563837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894884970595060:3809]
2025-09-30T14:51:09.563845Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:09.563859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:09.563868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:09.563878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:09.563927Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e1d3f46-65cdba17-a4275b0-ec7fc1b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:09.563941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:09.563945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:09.563948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:09.563957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:09.563966Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:09.563991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:09.564181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:09.564193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:09.564215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:09.564317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 318 partition: 0 MaxSeqNo: 42 sessionId: src_id|3e1d3f46-65cdba17-a4275b0-ec7fc1b4_0
2025-09-30T14:51:09.564678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5866fd3-1e33af58-8ca1dfbe-5125deec_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3e1d3f46-65cdba17-a4275b0-ec7fc1b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:09.567473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1d3f46-65cdba17-a4275b0-ec7fc1b4_0] Write session: try to update token
2025-09-30T14:51:09.567493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1d3f46-65cdba17-a4275b0-ec7fc1b4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:09.576101Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:09.576121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:09.576124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:09.576126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:09.576141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894884970595060:3809]
2025-09-30T14:51:09.576145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894884970595060:3809]
2025-09-30T14:51:09.576150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894884970595060:3809]
2025-09-30T14:51:09.576200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:09.576209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:09.576216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:09.576216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.576219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:09.576221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:09.576394Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:09.583506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 318 sessionId: src_id|3e1d3f46-65cdba17-a4275b0-ec7fc1b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:09.586320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:09.638854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894885060320147:4267]
2025-09-30T14:51:09.639233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 317, pipe: [1:7555894885060320147:4267]
2025-09-30T14:51:09.689106Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:09.689517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:09.689535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:09.689557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894885060320147:4267], now have 1 active actors on pipe
2025-09-30T14:51:09.689787Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:09.689857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894885060320147:4267]
2025-09-30T14:51:09.689893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:09.689970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 318 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3e1d3f46-65cdba17-a4275b0-ec7fc1b4_0
2025-09-30T14:51:09.690103Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:09.690177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 318 sessionId: src_id|3e1d3f46-65cdba17-a4275b0-ec7fc1b4_0 is DEAD
2025-09-30T14:51:09.690355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1d3f46-65cdba17-a4275b0-ec7fc1b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:09.690366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1d3f46-65cdba17-a4275b0-ec7fc1b4_0] Write session will restart in 0.007588s
2025-09-30T14:51:09.690391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1d3f46-65cdba17-a4275b0-ec7fc1b4_0] Write session: Do CDS request
2025-09-30T14:51:09.690396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1d3f46-65cdba17-a4275b0-ec7fc1b4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:09.698798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1d3f46-65cdba17-a4275b0-ec7fc1b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:09.698878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:09.698897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 319
2025-09-30T14:51:09.699077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 319 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:09.699135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 319 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:09.699145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=319 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:09.699150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:09.699579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 319 sessionId:  describe result for acl check
2025-09-30T14:51:09.699615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:09.699618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:09.699619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:09.699624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894885060320208:4364] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:09.700164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894885060320208:4364] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:09.702251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894885060320208:4364] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:09.703073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:09.705273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:09.705427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894885060320208:4364] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:09.705446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894885060320208:4364] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:09.705449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894885060320208:4364] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:09.705457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 319 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:09.705486Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:09.705498Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:09.705509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:09.705567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:09.705618Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894884970595212:3811]
2025-09-30T14:51:09.706263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:09.706593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:09.706645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:09.706965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:09.707027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:09.707033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:09.707034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:09.707035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:09.707036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:09.707037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:09.707039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:09.707040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:09.707041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:09.707042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:09.707043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.707044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.707046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.707047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:09.707048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:09.707053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:09.707063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:09.707067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:09.707071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:09.707075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:09.707079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:09.707082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:09.707086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:09.707089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:09.707092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:09.707097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.707100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.707104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.707121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:09.707125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:09.707134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:09.707142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:09.707147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:09.707153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:09.707163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:09.707168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:09.707172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:09.707182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:09.707187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:09.707192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:09.707201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:09.707206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:09.707210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:09.707220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:09.707225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:09.707230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:09.707234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:09.707239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:09.707273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:09.707283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:09.707287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.707293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.707302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.707306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.707310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.707315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.707324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:09.707328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:09.707336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:09.707345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:09.707385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:09.713043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:09.714113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:09.714133Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:09.714135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:09.714139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:09.714146Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 318 [2:7555894884970595212:3811]
2025-09-30T14:51:09.714161Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:09.714178Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:09.714187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:09.714190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:09.714192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:09.714209Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:09.714216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:09.714223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:09.714287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.714294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.714296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.714300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:09.714303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:09.714374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:09.714382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.714397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.714409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.714427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:09.714447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894885060320292:4364], now have 1 active actors on pipe
2025-09-30T14:51:09.714455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894885060320148:2454], now have 1 active actors on pipe
2025-09-30T14:51:09.714462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894884970595207:3811]
2025-09-30T14:51:09.714464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894884970595207:3811]
2025-09-30T14:51:09.714466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894884970595207:3811]
2025-09-30T14:51:09.714479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:09.714494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:09.714496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:09.714498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:09.714500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:09.714511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:09.714514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:09.714550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894884970595207:3811]
2025-09-30T14:51:09.714553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:09.714555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:09.714523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 318
2025-09-30T14:51:09.714548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 318
2025-09-30T14:51:09.714594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:09.714605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:09.714637Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43ef5486-af5c216-c233bfdf-9c91bab2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:09.714647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:09.714652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:09.714655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:09.714666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:09.714679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:09.714700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:09.714904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:09.714912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:09.714924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:09.715023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 319 partition: 0 MaxSeqNo: 42 sessionId: src_id|43ef5486-af5c216-c233bfdf-9c91bab2_0
2025-09-30T14:51:09.715476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1d3f46-65cdba17-a4275b0-ec7fc1b4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|43ef5486-af5c216-c233bfdf-9c91bab2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:09.718408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43ef5486-af5c216-c233bfdf-9c91bab2_0] Write session: try to update token
2025-09-30T14:51:09.718429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43ef5486-af5c216-c233bfdf-9c91bab2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:09.727161Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:09.727183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:09.727186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:09.727188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:09.727201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894884970595207:3811]
2025-09-30T14:51:09.727205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894884970595207:3811]
2025-09-30T14:51:09.727209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894884970595207:3811]
2025-09-30T14:51:09.727272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:09.727284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.727286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:09.727295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:09.727310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:09.727313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:09.727441Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:09.733412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 319 sessionId: src_id|43ef5486-af5c216-c233bfdf-9c91bab2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:09.736351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:09.789899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894885060320303:4267]
2025-09-30T14:51:09.790214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 318, pipe: [1:7555894885060320303:4267]
2025-09-30T14:51:09.836946Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:09.837348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:09.837365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:09.837384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894885060320303:4267], now have 1 active actors on pipe
2025-09-30T14:51:09.837613Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:09.837668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:09.837677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894885060320303:4267]
2025-09-30T14:51:09.837686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:09.837698Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:09.837751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 319 reason: error at write: Disconnected sessionId: src_id|43ef5486-af5c216-c233bfdf-9c91bab2_0
2025-09-30T14:51:09.837965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 319 sessionId: src_id|43ef5486-af5c216-c233bfdf-9c91bab2_0 is DEAD
2025-09-30T14:51:09.838100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43ef5486-af5c216-c233bfdf-9c91bab2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:09.838110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43ef5486-af5c216-c233bfdf-9c91bab2_0] Write session will restart in 0.007821s
2025-09-30T14:51:09.838133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43ef5486-af5c216-c233bfdf-9c91bab2_0] Write session: Do CDS request
2025-09-30T14:51:09.838139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43ef5486-af5c216-c233bfdf-9c91bab2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:09.846818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43ef5486-af5c216-c233bfdf-9c91bab2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:09.846904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:09.846921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 320
2025-09-30T14:51:09.847073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 320 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:09.847117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 320 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:09.847127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=320 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:09.847131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:09.847597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 320 sessionId:  describe result for acl check
2025-09-30T14:51:09.847636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:09.847643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:09.847645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:09.847651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894885060320423:4369] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:09.848178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894885060320423:4369] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:09.848518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:09.850000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894885060320423:4369] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:09.850480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:09.850692Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:09.850702Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:09.850713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:09.850768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:09.850808Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894884970595372:3814]
2025-09-30T14:51:09.851491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:09.851818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:09.851872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:09.852192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:09.852250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:09.852255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:09.852257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:09.852258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:09.852259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:09.852260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:09.852261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:09.852262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:09.852263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:09.852264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:09.852266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.852267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.852268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.852269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:09.852270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:09.852275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:09.852285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:09.852289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:09.852294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:09.852298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:09.852302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:09.852306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:09.852310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:09.852314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:09.852319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:09.852324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.852328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.852332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.852336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:09.852340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:09.852346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:09.852354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:09.852359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:09.852365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:09.852369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:09.852373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:09.852377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:09.852381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:09.852386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:09.852391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:09.852396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:09.852401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:09.852406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:09.852411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:09.852416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:09.852428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:09.852408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894885060320423:4369] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:09.852435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:09.852423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894885060320423:4369] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:09.852445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:09.852450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:09.852426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894885060320423:4369] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:09.852455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:09.852434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 320 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:09.852460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.852465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.852470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.852475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.852479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.852484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.852489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:09.852494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:09.852499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:09.852508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:09.852550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:09.857705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:09.858760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:09.858775Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:09.858777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:09.858781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:09.858787Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 319 [2:7555894884970595372:3814]
2025-09-30T14:51:09.858801Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:09.858815Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:09.858822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:09.858825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:09.858827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:09.858842Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:09.858853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:09.858863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:09.858920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.858927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.858929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.858933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:09.858935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:09.858996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:09.859004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.859016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:09.859029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:09.859046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:09.859062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894885060320316:2454], now have 1 active actors on pipe
2025-09-30T14:51:09.859070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894885060320462:4369], now have 1 active actors on pipe
2025-09-30T14:51:09.859077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894884970595366:3814]
2025-09-30T14:51:09.859079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894884970595366:3814]
2025-09-30T14:51:09.859082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894884970595366:3814]
2025-09-30T14:51:09.859095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:09.859089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 319
2025-09-30T14:51:09.859109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:09.859108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:09.859096Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 319
2025-09-30T14:51:09.859112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:09.859114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:09.859128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:09.859131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:09.859170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:09.859179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:09.859194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894884970595366:3814]
2025-09-30T14:51:09.859205Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:09.859216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:09.859234Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee7d55bc-6bdf2c27-da236cce-d7fab115_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:09.859261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:09.859265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:09.859267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:09.859275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:09.859283Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:09.859306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:09.859508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:09.859516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:09.859528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:09.859600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 320 partition: 0 MaxSeqNo: 42 sessionId: src_id|ee7d55bc-6bdf2c27-da236cce-d7fab115_0
2025-09-30T14:51:09.859955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43ef5486-af5c216-c233bfdf-9c91bab2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ee7d55bc-6bdf2c27-da236cce-d7fab115_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:09.862863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee7d55bc-6bdf2c27-da236cce-d7fab115_0] Write session: try to update token
2025-09-30T14:51:09.862883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee7d55bc-6bdf2c27-da236cce-d7fab115_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:09.871528Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:09.871549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:09.871552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:09.871554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:09.871568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894884970595366:3814]
2025-09-30T14:51:09.871572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894884970595366:3814]
2025-09-30T14:51:09.871576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894884970595366:3814]
2025-09-30T14:51:09.871618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:09.871630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:09.871632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:09.871635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:09.871642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:09.871646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:09.871791Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:09.877960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 320 sessionId: src_id|ee7d55bc-6bdf2c27-da236cce-d7fab115_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:09.880713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:09.937845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894885060320472:4267]
2025-09-30T14:51:09.938114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 319, pipe: [1:7555894885060320472:4267]
2025-09-30T14:51:09.986680Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:09.987046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:09.987063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:09.987104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894885060320472:4267], now have 1 active actors on pipe
2025-09-30T14:51:09.987360Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:09.987385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:09.987428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894885060320472:4267]
2025-09-30T14:51:09.987434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:09.987504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 320 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ee7d55bc-6bdf2c27-da236cce-d7fab115_0
2025-09-30T14:51:09.987729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 320 sessionId: src_id|ee7d55bc-6bdf2c27-da236cce-d7fab115_0 is DEAD
2025-09-30T14:51:09.987903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee7d55bc-6bdf2c27-da236cce-d7fab115_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:09.987916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee7d55bc-6bdf2c27-da236cce-d7fab115_0] Write session will restart in 0.005877s
2025-09-30T14:51:09.987957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee7d55bc-6bdf2c27-da236cce-d7fab115_0] Write session: Do CDS request
2025-09-30T14:51:09.987963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee7d55bc-6bdf2c27-da236cce-d7fab115_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:09.994856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee7d55bc-6bdf2c27-da236cce-d7fab115_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:09.994939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:09.994958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 321
2025-09-30T14:51:09.995090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 321 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:09.995124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 321 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:09.995134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=321 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:09.995138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:09.995523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 321 sessionId:  describe result for acl check
2025-09-30T14:51:09.995551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:09.995557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:09.995558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:09.995562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894885060320516:4375] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:09.996032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894885060320516:4375] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:09.998597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894885060320516:4375] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:09.999788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:10.001845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:10.002061Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:10.002075Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:10.002087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:10.002151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:10.002196Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894889265562817:3816]
2025-09-30T14:51:10.002256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894885060320516:4375] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:10.002273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894885060320516:4375] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:10.002277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894885060320516:4375] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:10.002285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 321 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:10.002866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:10.003160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:10.003205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:10.003545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:10.003612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:10.003619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:10.003621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:10.003622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:10.003623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:10.003624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:10.003625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:10.003626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:10.003627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:10.003628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:10.003629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.003630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.003632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.003634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:10.003635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:10.003641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:10.003651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:10.003655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:10.003659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:10.003663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:10.003668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:10.003672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:10.003676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:10.003680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:10.003683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:10.003686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.003690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.003694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.003697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:10.003701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:10.003708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:10.003715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:10.003721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:10.003727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:10.003732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:10.003737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:10.003742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:10.003747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:10.003752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:10.003757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:10.003762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:10.003767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:10.003772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:10.003777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:10.003782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:10.003787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:10.003793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:10.003798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:10.003802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:10.003808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:10.003812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.003817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.003821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.003825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.003829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.003834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.003839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:10.003844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:10.003849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:10.003854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:10.003896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:10.009399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:10.010505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:10.010525Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:10.010527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:10.010531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:10.010538Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 320 [2:7555894889265562817:3816]
2025-09-30T14:51:10.010552Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:10.010567Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:10.010585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.010589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.010592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.010607Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:10.010620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:10.010627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:10.010693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.010701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.010703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.010707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:10.010710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:10.010778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:10.010786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.010800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.010818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.010841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:10.010865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894889355287925:4375], now have 1 active actors on pipe
2025-09-30T14:51:10.010870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894885060320484:2454], now have 1 active actors on pipe
2025-09-30T14:51:10.010876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894884970595516:3816]
2025-09-30T14:51:10.010879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894884970595516:3816]
2025-09-30T14:51:10.010882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894884970595516:3816]
2025-09-30T14:51:10.010896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:10.010920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:10.010926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:10.010930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:10.010932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:10.010941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:10.010945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:10.010977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894884970595516:3816]
2025-09-30T14:51:10.010985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:10.010996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:10.011002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:10.011006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:10.010930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 320
2025-09-30T14:51:10.010969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 320
2025-09-30T14:51:10.011053Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26793b36-b39d75cf-4b9cd9f-55cefce7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:10.011065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.011069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.011072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:10.011080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.011094Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:10.011110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:10.011460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:10.011473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:10.011488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:10.011618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 321 partition: 0 MaxSeqNo: 42 sessionId: src_id|26793b36-b39d75cf-4b9cd9f-55cefce7_0
2025-09-30T14:51:10.011990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee7d55bc-6bdf2c27-da236cce-d7fab115_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|26793b36-b39d75cf-4b9cd9f-55cefce7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:10.014851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26793b36-b39d75cf-4b9cd9f-55cefce7_0] Write session: try to update token
2025-09-30T14:51:10.014870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26793b36-b39d75cf-4b9cd9f-55cefce7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:10.024363Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:10.024387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:10.024390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:10.024392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:10.024403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894884970595516:3816]
2025-09-30T14:51:10.024412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894884970595516:3816]
2025-09-30T14:51:10.024419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894884970595516:3816]
2025-09-30T14:51:10.024475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:10.024477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:10.024486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:10.024489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:10.024494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.024499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:10.024748Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:10.030381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 321 sessionId: src_id|26793b36-b39d75cf-4b9cd9f-55cefce7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:10.033105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:10.087342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894889355287940:4267]
2025-09-30T14:51:10.087712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 320, pipe: [1:7555894889355287940:4267]
2025-09-30T14:51:10.136536Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:10.136851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:10.136863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:10.136895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894889355287940:4267], now have 1 active actors on pipe
2025-09-30T14:51:10.137065Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:10.137102Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:10.137124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:10.137128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:10.137160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894889355287940:4267]
2025-09-30T14:51:10.137189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 321 reason: error at write: Disconnected sessionId: src_id|26793b36-b39d75cf-4b9cd9f-55cefce7_0
2025-09-30T14:51:10.137392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 321 sessionId: src_id|26793b36-b39d75cf-4b9cd9f-55cefce7_0 is DEAD
2025-09-30T14:51:10.137556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26793b36-b39d75cf-4b9cd9f-55cefce7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:10.137566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26793b36-b39d75cf-4b9cd9f-55cefce7_0] Write session will restart in 0.008102s
2025-09-30T14:51:10.137589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26793b36-b39d75cf-4b9cd9f-55cefce7_0] Write session: Do CDS request
2025-09-30T14:51:10.137594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26793b36-b39d75cf-4b9cd9f-55cefce7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:10.146860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26793b36-b39d75cf-4b9cd9f-55cefce7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:10.146972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:10.146990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 322
2025-09-30T14:51:10.147138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 322 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:10.147180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 322 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:10.147193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=322 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:10.147198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:10.147617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 322 sessionId:  describe result for acl check
2025-09-30T14:51:10.147649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:10.147655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:10.147657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:10.147663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894889355288049:4379] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:10.148191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894889355288049:4379] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:10.148612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:10.150202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894889355288049:4379] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:10.150548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:10.150783Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:10.150799Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:10.150812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:10.150879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:10.150923Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894889265562968:3819]
2025-09-30T14:51:10.151597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:10.151910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:10.151972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:10.152325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:10.152389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:10.152396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:10.152398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:10.152400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:10.152401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:10.152403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:10.152404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:10.152406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:10.152407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:10.152409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:10.152410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.152412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.152414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.152415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:10.152416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:10.152422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:10.152432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:10.152436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:10.152441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:10.152445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:10.152449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:10.152454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:10.152458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:10.152463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:10.152468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:10.152472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.152477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.152482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.152486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:10.152490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:10.152499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:10.152513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:10.152524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:10.152532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:10.152541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:10.152546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:10.152555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:10.152561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:10.152567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:10.152577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:10.152582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:10.152588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:10.152597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:10.152603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:10.152612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:10.152618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:10.152626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:10.152632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:10.152641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:10.152646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:10.152655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.152661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.152670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.152675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.152680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.152690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.152695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:10.152705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:10.152711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:10.152716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:10.152769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:10.153689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894889355288049:4379] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:10.153707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894889355288049:4379] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:10.153711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894889355288049:4379] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:10.153724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 322 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:10.158182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:10.159062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:10.159078Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:10.159080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:10.159084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:10.159091Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 321 [2:7555894889265562968:3819]
2025-09-30T14:51:10.159110Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:10.159126Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:10.159134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.159137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.159139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.159156Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:10.159168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:10.159178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:10.159261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.159271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.159274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.159278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:10.159281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:10.159346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:10.159354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.159366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.159380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.159404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:10.159426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894889355287941:2454], now have 1 active actors on pipe
2025-09-30T14:51:10.159434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894889355288091:4379], now have 1 active actors on pipe
2025-09-30T14:51:10.159441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894889265562962:3819]
2025-09-30T14:51:10.159448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894889265562962:3819]
2025-09-30T14:51:10.159450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894889265562962:3819]
2025-09-30T14:51:10.159465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:10.159479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:10.159481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:10.159485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:10.159488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:10.159499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:10.159502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:10.159486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 321
2025-09-30T14:51:10.159488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 321
2025-09-30T14:51:10.159533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894889265562962:3819]
2025-09-30T14:51:10.159541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:10.159544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:10.159571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:10.159582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:10.159615Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4b4de5d-8258d7aa-f5dc8ef0-95b0a59_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:10.159628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.159631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.159634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:10.159643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.159656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:10.159673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:10.159793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:10.159801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:10.159813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:10.159925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 322 partition: 0 MaxSeqNo: 42 sessionId: src_id|b4b4de5d-8258d7aa-f5dc8ef0-95b0a59_0
2025-09-30T14:51:10.160307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26793b36-b39d75cf-4b9cd9f-55cefce7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b4b4de5d-8258d7aa-f5dc8ef0-95b0a59_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:10.163023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b4de5d-8258d7aa-f5dc8ef0-95b0a59_0] Write session: try to update token
2025-09-30T14:51:10.163041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b4de5d-8258d7aa-f5dc8ef0-95b0a59_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:10.171238Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:10.171277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:10.171279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:10.171281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:10.171291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894889265562962:3819]
2025-09-30T14:51:10.171295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894889265562962:3819]
2025-09-30T14:51:10.171299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894889265562962:3819]
2025-09-30T14:51:10.171343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:10.171346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:10.171352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:10.171356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:10.171360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.171363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:10.171509Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:10.177418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 322 sessionId: src_id|b4b4de5d-8258d7aa-f5dc8ef0-95b0a59_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:10.180277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:10.237402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894889355288099:4267]
2025-09-30T14:51:10.237664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 321, pipe: [1:7555894889355288099:4267]
2025-09-30T14:51:10.287113Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:10.287394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:10.287414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:10.287452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894889355288099:4267], now have 1 active actors on pipe
2025-09-30T14:51:10.287634Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:10.287964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894889355288099:4267]
2025-09-30T14:51:10.287992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:10.288021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:10.288080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 322 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b4b4de5d-8258d7aa-f5dc8ef0-95b0a59_0
2025-09-30T14:51:10.288295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 322 sessionId: src_id|b4b4de5d-8258d7aa-f5dc8ef0-95b0a59_0 is DEAD
2025-09-30T14:51:10.288443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b4de5d-8258d7aa-f5dc8ef0-95b0a59_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:10.288453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b4de5d-8258d7aa-f5dc8ef0-95b0a59_0] Write session will restart in 0.005518s
2025-09-30T14:51:10.288474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b4de5d-8258d7aa-f5dc8ef0-95b0a59_0] Write session: Do CDS request
2025-09-30T14:51:10.288480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b4de5d-8258d7aa-f5dc8ef0-95b0a59_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:10.294794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b4de5d-8258d7aa-f5dc8ef0-95b0a59_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:10.294969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:10.295000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 323
2025-09-30T14:51:10.295112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 323 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:10.295161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 323 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:10.295171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=323 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:10.295175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:10.295606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 323 sessionId:  describe result for acl check
2025-09-30T14:51:10.295641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:10.295644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:10.295656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:10.295667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894889355288131:4389] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:10.296213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894889355288131:4389] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:10.299445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894889355288131:4389] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:10.301007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:10.303570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:10.303808Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:10.303820Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:10.303829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:10.303884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:10.303928Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894889265563132:3827]
2025-09-30T14:51:10.304048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894889355288131:4389] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:10.304069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894889355288131:4389] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:10.304071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894889355288131:4389] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:10.304079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 323 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:10.304578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:10.304924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:10.304981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:10.305368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:10.305424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:10.305429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:10.305430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:10.305430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:10.305431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:10.305432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:10.305433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:10.305433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:10.305434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:10.305434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:10.305436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.305436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.305437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.305438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:10.305438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:10.305443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:10.305449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:10.305451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:10.305453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:10.305456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:10.305458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:10.305460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:10.305463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:10.305465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:10.305468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:10.305470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.305473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.305477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.305481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:10.305485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:10.305504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:10.305512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:10.305519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:10.305524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:10.305528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:10.305531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:10.305533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:10.305537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:10.305540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:10.305542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:10.305545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:10.305548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:10.305551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:10.305554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:10.305556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:10.305559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:10.305562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:10.305565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:10.305568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:10.305571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:10.305574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.305578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.305581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.305585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.305587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.305590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.305593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:10.305596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:10.305598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:10.305601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:10.305644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:10.311377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:10.312294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:10.312309Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:10.312312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:10.312317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:10.312323Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 322 [2:7555894889265563132:3827]
2025-09-30T14:51:10.312339Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:10.312355Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:10.312358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.312361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.312364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.312380Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:10.312387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:10.312398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:10.312456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.312463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.312465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.312468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:10.312471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:10.312542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:10.312550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.312563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.312581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.312600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:10.312622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894889355288259:4389], now have 1 active actors on pipe
2025-09-30T14:51:10.312631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894889355288113:2454], now have 1 active actors on pipe
2025-09-30T14:51:10.312638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894889265563127:3827]
2025-09-30T14:51:10.312640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894889265563127:3827]
2025-09-30T14:51:10.312643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894889265563127:3827]
2025-09-30T14:51:10.312656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:10.312668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:10.312676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:10.312680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:10.312682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:10.312689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:10.312692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:10.312686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 322
2025-09-30T14:51:10.312722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894889265563127:3827]
2025-09-30T14:51:10.312730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:10.312732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:10.312734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 322
2025-09-30T14:51:10.312746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:10.312755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:10.312791Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32b7d408-1e611ba2-1c131a37-70394db3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:10.312800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.312805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.312809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:10.312818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.312825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:10.312848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:10.313012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:10.313019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:10.313032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:10.313142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 323 partition: 0 MaxSeqNo: 42 sessionId: src_id|32b7d408-1e611ba2-1c131a37-70394db3_0
2025-09-30T14:51:10.313541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b4de5d-8258d7aa-f5dc8ef0-95b0a59_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|32b7d408-1e611ba2-1c131a37-70394db3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:10.316591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32b7d408-1e611ba2-1c131a37-70394db3_0] Write session: try to update token
2025-09-30T14:51:10.316610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32b7d408-1e611ba2-1c131a37-70394db3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:10.324931Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:10.324949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:10.324952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:10.324954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:10.324964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894889265563127:3827]
2025-09-30T14:51:10.324969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894889265563127:3827]
2025-09-30T14:51:10.324972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894889265563127:3827]
2025-09-30T14:51:10.325018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:10.325025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.325028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:10.325067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:10.325093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:10.325098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:10.325170Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:10.331471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 323 sessionId: src_id|32b7d408-1e611ba2-1c131a37-70394db3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:10.334467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:10.387916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894889355288281:4267]
2025-09-30T14:51:10.388171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 322, pipe: [1:7555894889355288281:4267]
2025-09-30T14:51:10.446277Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:10.446822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:10.446837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:10.446857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894889355288281:4267], now have 1 active actors on pipe
2025-09-30T14:51:10.447083Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:10.447114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894889355288281:4267]
2025-09-30T14:51:10.447118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:10.447149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:10.447152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:10.447224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 323 reason: error at write: Disconnected sessionId: src_id|32b7d408-1e611ba2-1c131a37-70394db3_0
2025-09-30T14:51:10.447466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 323 sessionId: src_id|32b7d408-1e611ba2-1c131a37-70394db3_0 is DEAD
2025-09-30T14:51:10.447658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32b7d408-1e611ba2-1c131a37-70394db3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:10.447666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32b7d408-1e611ba2-1c131a37-70394db3_0] Write session will restart in 0.005583s
2025-09-30T14:51:10.447690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32b7d408-1e611ba2-1c131a37-70394db3_0] Write session: Do CDS request
2025-09-30T14:51:10.447696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32b7d408-1e611ba2-1c131a37-70394db3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:10.454863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32b7d408-1e611ba2-1c131a37-70394db3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:10.454961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:10.454977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 324
2025-09-30T14:51:10.455131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 324 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:10.455165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 324 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:10.455173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=324 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:10.455177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:10.455822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 324 sessionId:  describe result for acl check
2025-09-30T14:51:10.455865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:10.455871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:10.455873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:10.455878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894889355288322:4395] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:10.456383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894889355288322:4395] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:10.458806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894889355288322:4395] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:10.459833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:10.461818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:10.462031Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:10.462042Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:10.462054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:10.462110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:10.462149Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894889265563309:3835]
2025-09-30T14:51:10.462249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894889355288322:4395] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:10.462261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894889355288322:4395] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:10.462264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894889355288322:4395] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:10.462273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 324 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:10.462878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:10.463157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:10.463201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:10.463547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:10.463603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:10.463609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:10.463610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:10.463611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:10.463612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:10.463614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:10.463615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:10.463617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:10.463618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:10.463619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:10.463620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.463621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.463622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.463624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:10.463625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:10.463630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:10.463642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:10.463646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:10.463651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:10.463656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:10.463660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:10.463665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:10.463669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:10.463673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:10.463678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:10.463682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.463687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.463690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.463694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:10.463698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:10.463705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:10.463714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:10.463720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:10.463727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:10.463737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:10.463743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:10.463748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:10.463754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:10.463764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:10.463770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:10.463779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:10.463785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:10.463795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:10.463801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:10.463810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:10.463816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:10.463827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:10.463833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:10.463842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:10.463847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:10.463853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.463864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.463868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.463878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.463883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.463889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.463897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:10.463902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:10.463907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:10.463913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:10.463964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:10.469695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:10.470664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:10.470682Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:10.470685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:10.470690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:10.470697Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 323 [2:7555894889265563309:3835]
2025-09-30T14:51:10.470716Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:10.470732Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:10.470735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.470738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.470741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.470758Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:10.470766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:10.470773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:10.470843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.470856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.470858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.470862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:10.470865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:10.470938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:10.470946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.470959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.470979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.470999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:10.471023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894889355288284:2454], now have 1 active actors on pipe
2025-09-30T14:51:10.471032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894889355288431:4395], now have 1 active actors on pipe
2025-09-30T14:51:10.471039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894889265563304:3835]
2025-09-30T14:51:10.471047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894889265563304:3835]
2025-09-30T14:51:10.471050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894889265563304:3835]
2025-09-30T14:51:10.471066Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:10.471083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:10.471099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:10.471083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 323
2025-09-30T14:51:10.471111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:10.471113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:10.471115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:10.471083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 323
2025-09-30T14:51:10.471118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:10.471155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894889265563304:3835]
2025-09-30T14:51:10.471168Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:10.471175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:10.471190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:10.471199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:10.471269Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8472afd9-20d1c5a0-4bcc5e0c-b9ceb917_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:10.471282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.471285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.471288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:10.471300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.471315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:10.471338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:10.471514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:10.471523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:10.471537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:10.471655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 324 partition: 0 MaxSeqNo: 42 sessionId: src_id|8472afd9-20d1c5a0-4bcc5e0c-b9ceb917_0
2025-09-30T14:51:10.472077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32b7d408-1e611ba2-1c131a37-70394db3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8472afd9-20d1c5a0-4bcc5e0c-b9ceb917_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:10.475125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8472afd9-20d1c5a0-4bcc5e0c-b9ceb917_0] Write session: try to update token
2025-09-30T14:51:10.475146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8472afd9-20d1c5a0-4bcc5e0c-b9ceb917_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:10.484092Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:10.484120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:10.484123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:10.484125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:10.484135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894889265563304:3835]
2025-09-30T14:51:10.484140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894889265563304:3835]
2025-09-30T14:51:10.484145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894889265563304:3835]
2025-09-30T14:51:10.484190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:10.484198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:10.484203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.484205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:10.484206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:10.484209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:10.484375Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:10.490795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 324 sessionId: src_id|8472afd9-20d1c5a0-4bcc5e0c-b9ceb917_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:10.493909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:10.547134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894889355288444:4267]
2025-09-30T14:51:10.547442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 323, pipe: [1:7555894889355288444:4267]
2025-09-30T14:51:10.605899Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:10.606412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:10.606435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:10.606493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894889355288444:4267], now have 1 active actors on pipe
2025-09-30T14:51:10.606734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:10.606747Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:10.606749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:10.606770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:10.606817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894889355288444:4267]
2025-09-30T14:51:10.606820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 324 reason: error at write: Disconnected sessionId: src_id|8472afd9-20d1c5a0-4bcc5e0c-b9ceb917_0
2025-09-30T14:51:10.607018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 324 sessionId: src_id|8472afd9-20d1c5a0-4bcc5e0c-b9ceb917_0 is DEAD
2025-09-30T14:51:10.607235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8472afd9-20d1c5a0-4bcc5e0c-b9ceb917_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:10.607269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8472afd9-20d1c5a0-4bcc5e0c-b9ceb917_0] Write session will restart in 0.005463s
2025-09-30T14:51:10.607299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8472afd9-20d1c5a0-4bcc5e0c-b9ceb917_0] Write session: Do CDS request
2025-09-30T14:51:10.607308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8472afd9-20d1c5a0-4bcc5e0c-b9ceb917_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:10.613845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8472afd9-20d1c5a0-4bcc5e0c-b9ceb917_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:10.613922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:10.613936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 325
2025-09-30T14:51:10.614099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 325 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:10.614141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 325 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:10.614152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=325 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:10.614157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:10.614761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 325 sessionId:  describe result for acl check
2025-09-30T14:51:10.614799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:10.614803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:10.614805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:10.614811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894889355288497:4399] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:10.615417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894889355288497:4399] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:10.617562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894889355288497:4399] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:10.618023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:10.620111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:10.620316Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:10.620328Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:10.620339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:10.620394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:10.620434Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894889265563462:3838]
2025-09-30T14:51:10.620499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894889355288497:4399] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:10.620516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894889355288497:4399] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:10.620520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894889355288497:4399] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:10.620541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 325 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:10.621150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:10.621463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:10.621510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:10.621848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:10.621916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:10.621923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:10.621925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:10.621926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:10.621927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:10.621928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:10.621929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:10.621930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:10.621932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:10.621933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:10.621934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.621935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.621936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.621937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:10.621939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:10.621944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:10.621955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:10.621959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:10.621963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:10.621968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:10.621972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:10.621976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:10.621980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:10.621984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:10.621989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:10.621993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.621997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.622001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.622005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:10.622009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:10.622017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:10.622026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:10.622032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:10.622038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:10.622043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:10.622049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:10.622053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:10.622059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:10.622064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:10.622070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:10.622077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:10.622082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:10.622093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:10.622099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:10.622109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:10.622114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:10.622122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:10.622133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:10.622137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:10.622145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:10.622156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.622162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.622171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.622176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.622186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.622193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.622201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:10.622207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:10.622212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:10.622218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:10.622269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:10.627916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:10.628878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:10.628895Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:10.628898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:10.628901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:10.628908Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 324 [2:7555894889265563462:3838]
2025-09-30T14:51:10.628924Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:10.628940Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:10.628943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.628946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.628949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.628965Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:10.628972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:10.628985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:10.629052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.629062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.629064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.629069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:10.629072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:10.629141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:10.629149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.629163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.629181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.629205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:10.629226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894889355288445:2454], now have 1 active actors on pipe
2025-09-30T14:51:10.629235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894889355288594:4399], now have 1 active actors on pipe
2025-09-30T14:51:10.629241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894889265563456:3838]
2025-09-30T14:51:10.629244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894889265563456:3838]
2025-09-30T14:51:10.629247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894889265563456:3838]
2025-09-30T14:51:10.629262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:10.629280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:10.629281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:10.629285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:10.629287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:10.629300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:10.629303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:10.629293Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 324
2025-09-30T14:51:10.629309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 324
2025-09-30T14:51:10.629337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894889265563456:3838]
2025-09-30T14:51:10.629349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:10.629373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:10.629382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:10.629419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:10.629432Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc2248ab-5f48fb9e-1b32551d-2d3054ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:10.629444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.629452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.629454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:10.629464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.629478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:10.629505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:10.629706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:10.629717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:10.629735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:10.629855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 325 partition: 0 MaxSeqNo: 42 sessionId: src_id|bc2248ab-5f48fb9e-1b32551d-2d3054ce_0
2025-09-30T14:51:10.630262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8472afd9-20d1c5a0-4bcc5e0c-b9ceb917_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bc2248ab-5f48fb9e-1b32551d-2d3054ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:10.633079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc2248ab-5f48fb9e-1b32551d-2d3054ce_0] Write session: try to update token
2025-09-30T14:51:10.633096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc2248ab-5f48fb9e-1b32551d-2d3054ce_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:10.641352Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:10.641373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:10.641375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:10.641377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:10.641385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894889265563456:3838]
2025-09-30T14:51:10.641390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894889265563456:3838]
2025-09-30T14:51:10.641394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894889265563456:3838]
2025-09-30T14:51:10.641433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:10.641439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.641441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:10.641453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:10.641464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:10.641467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:10.641936Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:10.647902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 325 sessionId: src_id|bc2248ab-5f48fb9e-1b32551d-2d3054ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:10.650718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:10.706856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894889355288606:4267]
2025-09-30T14:51:10.707162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 324, pipe: [1:7555894889355288606:4267]
2025-09-30T14:51:10.760384Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:10.760726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:10.760744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:10.760767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894889355288606:4267], now have 1 active actors on pipe
2025-09-30T14:51:10.761048Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:10.761053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894889355288606:4267]
2025-09-30T14:51:10.761055Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:10.761085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:10.761087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:10.761150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 325 reason: error at write: Disconnected sessionId: src_id|bc2248ab-5f48fb9e-1b32551d-2d3054ce_0
2025-09-30T14:51:10.761360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 325 sessionId: src_id|bc2248ab-5f48fb9e-1b32551d-2d3054ce_0 is DEAD
2025-09-30T14:51:10.761524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc2248ab-5f48fb9e-1b32551d-2d3054ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:10.761536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc2248ab-5f48fb9e-1b32551d-2d3054ce_0] Write session will restart in 0.006223s
2025-09-30T14:51:10.761558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc2248ab-5f48fb9e-1b32551d-2d3054ce_0] Write session: Do CDS request
2025-09-30T14:51:10.761564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc2248ab-5f48fb9e-1b32551d-2d3054ce_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:10.768861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc2248ab-5f48fb9e-1b32551d-2d3054ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:10.768963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:10.768985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 326
2025-09-30T14:51:10.769112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 326 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:10.769142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 326 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:10.769159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=326 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:10.769168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:10.769663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 326 sessionId:  describe result for acl check
2025-09-30T14:51:10.769698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:10.769704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:10.769706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:10.769713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894889355288679:4403] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:10.770267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894889355288679:4403] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:10.772174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894889355288679:4403] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:10.772622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:10.774742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:10.774959Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:10.774969Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:10.774980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:10.775048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:10.775108Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894889265563627:3841]
2025-09-30T14:51:10.775181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894889355288679:4403] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:10.775197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894889355288679:4403] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:10.775201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894889355288679:4403] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:10.775209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 326 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:10.775821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:10.776085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:10.776127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:10.776467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:10.776534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:10.776540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:10.776541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:10.776543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:10.776544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:10.776545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:10.776546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:10.776548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:10.776549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:10.776550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:10.776551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.776553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.776555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.776557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:10.776558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:10.776564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:10.776574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:10.776579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:10.776583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:10.776587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:10.776591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:10.776596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:10.776600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:10.776604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:10.776609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:10.776613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.776617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.776621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.776625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:10.776629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:10.776638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:10.776646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:10.776652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:10.776658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:10.776662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:10.776668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:10.776672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:10.776678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:10.776683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:10.776689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:10.776694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:10.776699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:10.776704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:10.776709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:10.776713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:10.776718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:10.776726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:10.776732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:10.776736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:10.776742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:10.776749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.776755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.776764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.776769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.776774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.776780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.776785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:10.776791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:10.776800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:10.776809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:10.776851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:10.782782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:10.783719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:10.783736Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:10.783739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:10.783743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:10.783751Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 325 [2:7555894889265563627:3841]
2025-09-30T14:51:10.783771Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:10.783789Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:10.783792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.783796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.783803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.783820Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:10.783827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:10.783835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:10.783899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.783907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.783910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.783914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:10.783917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:10.783988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:10.783995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.784008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.784022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.784041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:10.784066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894889355288765:4403], now have 1 active actors on pipe
2025-09-30T14:51:10.784073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894889355288607:2454], now have 1 active actors on pipe
2025-09-30T14:51:10.784080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894889265563622:3841]
2025-09-30T14:51:10.784086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894889265563622:3841]
2025-09-30T14:51:10.784089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894889265563622:3841]
2025-09-30T14:51:10.784107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:10.784125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:10.784131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:10.784136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:10.784139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:10.784144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:10.784148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:10.784189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894889265563622:3841]
2025-09-30T14:51:10.784196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:10.784171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 325
2025-09-30T14:51:10.784208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:10.784230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:10.784235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:10.784177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 325
2025-09-30T14:51:10.784267Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2796d1e6-206defbf-a4eb0a14-b520c8b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:10.784281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.784286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.784288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:10.784297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.784306Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:10.784321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:10.784507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:10.784515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:10.784528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:10.784624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 326 partition: 0 MaxSeqNo: 42 sessionId: src_id|2796d1e6-206defbf-a4eb0a14-b520c8b4_0
2025-09-30T14:51:10.785069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc2248ab-5f48fb9e-1b32551d-2d3054ce_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2796d1e6-206defbf-a4eb0a14-b520c8b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:10.788083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2796d1e6-206defbf-a4eb0a14-b520c8b4_0] Write session: try to update token
2025-09-30T14:51:10.788107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2796d1e6-206defbf-a4eb0a14-b520c8b4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:10.801920Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:10.801940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:10.801950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894889265563622:3841]
2025-09-30T14:51:10.801987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:10.801997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:10.802179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:10.802332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:10.802476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:10.802642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:10.802858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:10.802900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:10.804200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 326 sessionId: src_id|2796d1e6-206defbf-a4eb0a14-b520c8b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:10.806899Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:10.806916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:10.806919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:10.806921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:10.806931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894889265563622:3841]
2025-09-30T14:51:10.806935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894889265563622:3841]
2025-09-30T14:51:10.806940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894889265563622:3841]
2025-09-30T14:51:10.806979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:10.806981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:10.806987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.806989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:10.806989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:10.807005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:10.807082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:10.807133Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:10.860987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894889355288788:4267]
2025-09-30T14:51:10.861264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 325, pipe: [1:7555894889355288788:4267]
2025-09-30T14:51:10.918933Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:10.919324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:10.919336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:10.919353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894889355288788:4267], now have 1 active actors on pipe
2025-09-30T14:51:10.919512Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:10.919613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:10.919616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:10.919626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:10.919672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894889355288788:4267]
2025-09-30T14:51:10.919683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 326 reason: error at write: Disconnected sessionId: src_id|2796d1e6-206defbf-a4eb0a14-b520c8b4_0
2025-09-30T14:51:10.919868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 326 sessionId: src_id|2796d1e6-206defbf-a4eb0a14-b520c8b4_0 is DEAD
2025-09-30T14:51:10.920028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2796d1e6-206defbf-a4eb0a14-b520c8b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:10.920039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2796d1e6-206defbf-a4eb0a14-b520c8b4_0] Write session will restart in 0.006129s
2025-09-30T14:51:10.920062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2796d1e6-206defbf-a4eb0a14-b520c8b4_0] Write session: Do CDS request
2025-09-30T14:51:10.920072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2796d1e6-206defbf-a4eb0a14-b520c8b4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:10.927769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2796d1e6-206defbf-a4eb0a14-b520c8b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:10.927858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:10.927873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 327
2025-09-30T14:51:10.928010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 327 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:10.928043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 327 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:10.928054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=327 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:10.928058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:10.928491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 327 sessionId:  describe result for acl check
2025-09-30T14:51:10.928522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:10.928525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:10.928527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:10.928532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894889355288892:4408] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:10.929069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894889355288892:4408] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:10.930263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:10.930789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894889355288892:4408] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:10.932564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:10.932759Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:10.932775Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:10.932787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:10.932844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:10.932886Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894889265563783:3843]
2025-09-30T14:51:10.933223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894889355288892:4408] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:10.933235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894889355288892:4408] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:10.933238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894889355288892:4408] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:10.933245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 327 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:10.933543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:10.933801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:10.933852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:10.934184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:10.934266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:10.934272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:10.934273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:10.934274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:10.934275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:10.934277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:10.934278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:10.934279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:10.934281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:10.934282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:10.934283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.934284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.934285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.934286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:10.934288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:10.934293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:10.934303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:10.934308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:10.934312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:10.934316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:10.934320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:10.934325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:10.934329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:10.934333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:10.934338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:10.934342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.934346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.934350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.934355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:10.934358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:10.934367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:10.934376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:10.934382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:10.934388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:10.934399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:10.934404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:10.934409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:10.934416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:10.934422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:10.934432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:10.934436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:10.934442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:10.934451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:10.934455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:10.934458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:10.934463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:10.934466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:10.934477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:10.934481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:10.934487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:10.934492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.934498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.934502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.934507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.934512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.934517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.934528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:10.934533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:10.934538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:10.934543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:10.934606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:10.939843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:10.941183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:10.941203Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:10.941205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:10.941209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:10.941216Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 326 [2:7555894889265563783:3843]
2025-09-30T14:51:10.941232Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:10.941252Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:10.941260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.941263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.941265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.941281Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:10.941293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:10.941300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:10.941360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.941370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.941372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.941376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:10.941379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:10.941443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:10.941449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.941464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:10.941482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:10.941503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:10.941528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894889355288943:4408], now have 1 active actors on pipe
2025-09-30T14:51:10.941535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894889355288791:2454], now have 1 active actors on pipe
2025-09-30T14:51:10.941541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894889265563776:3843]
2025-09-30T14:51:10.941548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894889265563776:3843]
2025-09-30T14:51:10.941550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894889265563776:3843]
2025-09-30T14:51:10.941567Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:10.941581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:10.941585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:10.941590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:10.941592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:10.941600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:10.941603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:10.941574Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 326
2025-09-30T14:51:10.941641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894889265563776:3843]
2025-09-30T14:51:10.941650Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:10.941651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:10.941641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 326
2025-09-30T14:51:10.941684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:10.941693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:10.941726Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e99dd659-4aba0c27-1281b7a-49edbf32_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:10.941738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.941742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.941749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:10.941760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.941775Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:10.941797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:10.942078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:10.942090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:10.942109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:10.942203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 327 partition: 0 MaxSeqNo: 42 sessionId: src_id|e99dd659-4aba0c27-1281b7a-49edbf32_0
2025-09-30T14:51:10.942594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2796d1e6-206defbf-a4eb0a14-b520c8b4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e99dd659-4aba0c27-1281b7a-49edbf32_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:10.945413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e99dd659-4aba0c27-1281b7a-49edbf32_0] Write session: try to update token
2025-09-30T14:51:10.945435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e99dd659-4aba0c27-1281b7a-49edbf32_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:10.953972Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:10.953995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:10.953997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:10.954000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:10.954009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894889265563776:3843]
2025-09-30T14:51:10.954015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894889265563776:3843]
2025-09-30T14:51:10.954018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894889265563776:3843]
2025-09-30T14:51:10.954060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:10.954068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:10.954067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:10.954070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:10.954083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:10.954087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:10.954206Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:10.960348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 327 sessionId: src_id|e99dd659-4aba0c27-1281b7a-49edbf32_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:10.963208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:11.019692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894893650256262:4267]
2025-09-30T14:51:11.019974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 326, pipe: [1:7555894893650256262:4267]
2025-09-30T14:51:11.074369Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:11.074730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:11.074747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:11.074766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894893650256262:4267], now have 1 active actors on pipe
2025-09-30T14:51:11.075032Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:11.075022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894893650256262:4267]
2025-09-30T14:51:11.075033Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:11.075062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:11.075065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:11.075126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 327 reason: error at write: Disconnected sessionId: src_id|e99dd659-4aba0c27-1281b7a-49edbf32_0
2025-09-30T14:51:11.075351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 327 sessionId: src_id|e99dd659-4aba0c27-1281b7a-49edbf32_0 is DEAD
2025-09-30T14:51:11.075513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e99dd659-4aba0c27-1281b7a-49edbf32_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:11.075526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e99dd659-4aba0c27-1281b7a-49edbf32_0] Write session will restart in 0.008566s
2025-09-30T14:51:11.075560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e99dd659-4aba0c27-1281b7a-49edbf32_0] Write session: Do CDS request
2025-09-30T14:51:11.075567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e99dd659-4aba0c27-1281b7a-49edbf32_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:11.085804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e99dd659-4aba0c27-1281b7a-49edbf32_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:11.086518Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:11.086533Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 328
2025-09-30T14:51:11.086687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 328 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:11.086719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 328 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:11.086724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=328 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:11.086728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:11.086900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:11.087149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 328 sessionId:  describe result for acl check
2025-09-30T14:51:11.087185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:11.087191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:11.087194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:11.087200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894893650256385:4414] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:11.087701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894893650256385:4414] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:11.089090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:11.089296Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:11.089306Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:11.089317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:11.089377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:11.089418Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894893560531237:3846]
2025-09-30T14:51:11.089675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894893650256385:4414] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:11.090068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:11.090356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:11.090407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:11.090740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:11.090814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:11.090819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:11.090821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:11.090822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:11.090823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:11.090825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:11.090826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:11.090827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:11.090828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:11.090829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:11.090831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.090832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.090833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.090834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:11.090835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:11.090841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:11.090851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:11.090855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:11.090859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:11.090863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:11.090867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:11.090871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:11.090875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:11.090879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:11.090884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:11.090888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.090893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.090897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.090901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:11.090905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:11.090912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:11.090920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:11.090925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:11.090931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:11.090935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:11.090941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:11.090945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:11.090950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:11.090956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:11.090961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:11.090966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:11.090971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:11.090975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:11.090980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:11.090989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:11.090994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:11.090999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:11.091009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:11.091015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:11.091023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:11.091025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.091028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.091030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.091033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.091035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.091038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.091040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:11.091043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:11.091048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:11.091050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:11.091075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:11.096409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894893650256385:4414] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:11.096427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894893650256385:4414] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:11.096431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894893650256385:4414] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:11.096440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 328 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:11.096715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:11.097808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:11.097829Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:11.097831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:11.097835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:11.097841Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 327 [2:7555894893560531237:3846]
2025-09-30T14:51:11.097853Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:11.097865Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:11.097867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.097869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.097871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.097882Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:11.097886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:11.097891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:11.097935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.097937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.097939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.097941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:11.097942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:11.098001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:11.098008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.098017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.098023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.098032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:11.098049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894893650256423:4414], now have 1 active actors on pipe
2025-09-30T14:51:11.098055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894893650256267:2454], now have 1 active actors on pipe
2025-09-30T14:51:11.098059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894893560531231:3846]
2025-09-30T14:51:11.098061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894893560531231:3846]
2025-09-30T14:51:11.098062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894893560531231:3846]
2025-09-30T14:51:11.098074Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:11.098092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:11.098093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:11.098096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:11.098098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:11.098110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:11.098113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:11.098141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894893560531231:3846]
2025-09-30T14:51:11.098134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 327
2025-09-30T14:51:11.098152Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:11.098137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 327
2025-09-30T14:51:11.098167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:11.098188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:11.098197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:11.098225Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71e0ec35-6d6110cf-65f9ab1-35ff92cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:11.098236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.098239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.098241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:11.098250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.098262Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:11.098277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:11.098443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:11.098451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:11.098465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:11.098542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 328 partition: 0 MaxSeqNo: 42 sessionId: src_id|71e0ec35-6d6110cf-65f9ab1-35ff92cc_0
2025-09-30T14:51:11.098935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e99dd659-4aba0c27-1281b7a-49edbf32_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|71e0ec35-6d6110cf-65f9ab1-35ff92cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:11.101621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71e0ec35-6d6110cf-65f9ab1-35ff92cc_0] Write session: try to update token
2025-09-30T14:51:11.101638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71e0ec35-6d6110cf-65f9ab1-35ff92cc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:11.110192Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:11.110213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:11.110215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:11.110217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:11.110226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894893560531231:3846]
2025-09-30T14:51:11.110230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894893560531231:3846]
2025-09-30T14:51:11.110235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894893560531231:3846]
2025-09-30T14:51:11.110274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:11.110280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.110280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:11.110286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:11.110290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:11.110291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:11.110432Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:11.115998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 328 sessionId: src_id|71e0ec35-6d6110cf-65f9ab1-35ff92cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:11.118477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:11.175347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894893650256430:4267]
2025-09-30T14:51:11.175604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 327, pipe: [1:7555894893650256430:4267]
2025-09-30T14:51:11.222837Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:11.223143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:11.223157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:11.223196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894893650256430:4267], now have 1 active actors on pipe
2025-09-30T14:51:11.223441Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:11.223461Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:11.223481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894893650256430:4267]
2025-09-30T14:51:11.223519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:11.223600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 328 reason: status is not ok: tablet will be restarted right now sessionId: src_id|71e0ec35-6d6110cf-65f9ab1-35ff92cc_0
2025-09-30T14:51:11.223822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 328 sessionId: src_id|71e0ec35-6d6110cf-65f9ab1-35ff92cc_0 is DEAD
2025-09-30T14:51:11.223968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71e0ec35-6d6110cf-65f9ab1-35ff92cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:11.223979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71e0ec35-6d6110cf-65f9ab1-35ff92cc_0] Write session will restart in 0.009855s
2025-09-30T14:51:11.224011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71e0ec35-6d6110cf-65f9ab1-35ff92cc_0] Write session: Do CDS request
2025-09-30T14:51:11.224016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71e0ec35-6d6110cf-65f9ab1-35ff92cc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:11.234761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71e0ec35-6d6110cf-65f9ab1-35ff92cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:11.234896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:11.234913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 329
2025-09-30T14:51:11.235100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 329 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:11.235135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 329 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:11.235145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=329 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:11.235150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:11.235472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:11.235619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 329 sessionId:  describe result for acl check
2025-09-30T14:51:11.235655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:11.235661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:11.235663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:11.235669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894893650256550:4418] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:11.236243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894893650256550:4418] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:11.237597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:11.237806Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:11.237828Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:11.237846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:11.237946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:11.238006Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894893560531394:3848]
2025-09-30T14:51:11.238101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894893650256550:4418] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:11.238795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:11.239152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:11.239208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:11.239591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:11.239655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:11.239663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:11.239664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:11.239665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:11.239666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:11.239668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:11.239669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:11.239670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:11.239672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:11.239673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:11.239675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.239676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.239677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.239678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:11.239679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:11.239685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:11.239695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:11.239700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:11.239704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:11.239708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:11.239713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:11.239717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:11.239721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:11.239725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:11.239730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:11.239734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.239738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.239742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.239746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:11.239750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:11.239757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:11.239764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:11.239769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:11.239773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:11.239778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:11.239783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:11.239788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:11.239794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:11.239798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:11.239805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:11.239810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:11.239815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:11.239820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:11.239825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:11.239830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:11.239835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:11.239840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:11.239845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:11.239850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:11.239856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:11.239860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.239865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.239869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.239873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.239879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.239892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.239896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:11.239902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:11.239911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:11.239916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:11.239961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:11.240735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894893650256550:4418] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:11.240751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894893650256550:4418] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:11.240754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894893650256550:4418] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:11.240762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 329 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:11.245699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:11.246968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:11.246990Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:11.246993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:11.246998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:11.247005Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 328 [2:7555894893560531394:3848]
2025-09-30T14:51:11.247021Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:11.247035Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:11.247039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.247043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.247045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.247062Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:11.247072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:11.247079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:11.247140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.247149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.247151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.247155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:11.247158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:11.247266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:11.247274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.247289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.247299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.247314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:11.247332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894893650256432:2454], now have 1 active actors on pipe
2025-09-30T14:51:11.247341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894893650256588:4418], now have 1 active actors on pipe
2025-09-30T14:51:11.247348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894893560531388:3848]
2025-09-30T14:51:11.247349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894893560531388:3848]
2025-09-30T14:51:11.247351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894893560531388:3848]
2025-09-30T14:51:11.247362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:11.247377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:11.247394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:11.247401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:11.247405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:11.247409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:11.247412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:11.247439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894893560531388:3848]
2025-09-30T14:51:11.247452Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:11.247460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:11.247461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 328
2025-09-30T14:51:11.247463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 328
2025-09-30T14:51:11.247599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:11.247613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:11.247654Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab4f6fad-991cb393-b41688ca-795aefe5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:11.247669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.247673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.247676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:11.247702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.247721Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:11.247739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:11.247938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:11.247950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:11.247967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:11.248055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 329 partition: 0 MaxSeqNo: 42 sessionId: src_id|ab4f6fad-991cb393-b41688ca-795aefe5_0
2025-09-30T14:51:11.248464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71e0ec35-6d6110cf-65f9ab1-35ff92cc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ab4f6fad-991cb393-b41688ca-795aefe5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:11.251382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4f6fad-991cb393-b41688ca-795aefe5_0] Write session: try to update token
2025-09-30T14:51:11.251403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4f6fad-991cb393-b41688ca-795aefe5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:11.259874Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:11.259898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:11.259908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894893560531388:3848]
2025-09-30T14:51:11.259956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:11.259960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:11.260215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:11.260376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:11.260526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:11.260675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:11.260923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:11.260973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:11.267105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 329 sessionId: src_id|ab4f6fad-991cb393-b41688ca-795aefe5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:11.270035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:11.270607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:11.270633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:11.270654Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:11.270656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:11.270659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:11.270661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:11.270670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894893560531388:3848]
2025-09-30T14:51:11.270674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894893560531388:3848]
2025-09-30T14:51:11.270679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894893560531388:3848]
2025-09-30T14:51:11.270713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:11.270718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:11.270721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:11.270729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:11.270736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.270740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:11.270880Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:11.323817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894893650256610:4267]
2025-09-30T14:51:11.324035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 328, pipe: [1:7555894893650256610:4267]
2025-09-30T14:51:11.376803Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:11.377045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:11.377077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894893650256610:4267], now have 1 active actors on pipe
2025-09-30T14:51:11.377313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:11.377348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:11.377391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894893650256610:4267]
2025-09-30T14:51:11.377400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:11.377402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:11.377479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 329 reason: error at write: Disconnected sessionId: src_id|ab4f6fad-991cb393-b41688ca-795aefe5_0
2025-09-30T14:51:11.377655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 329 sessionId: src_id|ab4f6fad-991cb393-b41688ca-795aefe5_0 is DEAD
2025-09-30T14:51:11.377814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4f6fad-991cb393-b41688ca-795aefe5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:11.377824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4f6fad-991cb393-b41688ca-795aefe5_0] Write session will restart in 0.007644s
2025-09-30T14:51:11.377840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4f6fad-991cb393-b41688ca-795aefe5_0] Write session: Do CDS request
2025-09-30T14:51:11.377844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4f6fad-991cb393-b41688ca-795aefe5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:11.386850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4f6fad-991cb393-b41688ca-795aefe5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:11.386971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:11.386988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 330
2025-09-30T14:51:11.387111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 330 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:11.387142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 330 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:11.387152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=330 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:11.387156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:11.387286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:11.387597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 330 sessionId:  describe result for acl check
2025-09-30T14:51:11.387628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:11.387629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:11.387631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:11.387636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894893650256743:4429] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:11.388151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894893650256743:4429] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:11.389293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:11.389553Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:11.389566Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:11.389578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:11.389637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:11.389686Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894893560531587:3862]
2025-09-30T14:51:11.390119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894893650256743:4429] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:11.390140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:11.390404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:11.390433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:11.390652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:11.390692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:11.390698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:11.390699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:11.390700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:11.390701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:11.390702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:11.390703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:11.390704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:11.390705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:11.390706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:11.390708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.390708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.390709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.390710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:11.390711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:11.390717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:11.390727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:11.390729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:11.390732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:11.390734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:11.390736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:11.390739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:11.390741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:11.390744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:11.390746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:11.390748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.390751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.390753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.390755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:11.390757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:11.390762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:11.390767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:11.390770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:11.390774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:11.390776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:11.390779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:11.390782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:11.390785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:11.390789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:11.390793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:11.390796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:11.390799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:11.390801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:11.390804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:11.390806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:11.390808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:11.390811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:11.390814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:11.390816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:11.390819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:11.390821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.390824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.390826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.390829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.390832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.390835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.390838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:11.390841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:11.390844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:11.390847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:11.390869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:11.396252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:11.396446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894893650256743:4429] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:11.396465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894893650256743:4429] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:11.396468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894893650256743:4429] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:11.396477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 330 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:11.397302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:11.397318Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:11.397320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:11.397324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:11.397331Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 329 [2:7555894893560531587:3862]
2025-09-30T14:51:11.397347Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:11.397362Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:11.397365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.397368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.397370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.397385Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:11.397391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:11.397397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:11.397459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.397466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.397468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.397472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:11.397474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:11.397537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:11.397545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.397558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.397574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.397596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:11.397619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894893650256779:4429], now have 1 active actors on pipe
2025-09-30T14:51:11.397627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894893650256624:2454], now have 1 active actors on pipe
2025-09-30T14:51:11.397634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894893560531581:3862]
2025-09-30T14:51:11.397637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894893560531581:3862]
2025-09-30T14:51:11.397639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894893560531581:3862]
2025-09-30T14:51:11.397646Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:11.397665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:11.397642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 329
2025-09-30T14:51:11.397671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:11.397664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 329
2025-09-30T14:51:11.397678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:11.397680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:11.397684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:11.397687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:11.397728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:11.397736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:11.397751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894893560531581:3862]
2025-09-30T14:51:11.397762Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:11.397780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:11.397794Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c0fe770-ce38350e-81d126f1-80ecc371_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:11.397801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.397809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.397811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:11.397820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.397832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:11.397944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:11.398114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:11.398128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:11.398152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:11.398239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 330 partition: 0 MaxSeqNo: 42 sessionId: src_id|1c0fe770-ce38350e-81d126f1-80ecc371_0
2025-09-30T14:51:11.398624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4f6fad-991cb393-b41688ca-795aefe5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1c0fe770-ce38350e-81d126f1-80ecc371_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:11.401475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c0fe770-ce38350e-81d126f1-80ecc371_0] Write session: try to update token
2025-09-30T14:51:11.401493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c0fe770-ce38350e-81d126f1-80ecc371_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:11.409863Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:11.409886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:11.409889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:11.409891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:11.409900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894893560531581:3862]
2025-09-30T14:51:11.409904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894893560531581:3862]
2025-09-30T14:51:11.409908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894893560531581:3862]
2025-09-30T14:51:11.409952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:11.409958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:11.409965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.409965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:11.409968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:11.409969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:11.410113Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:11.416709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 330 sessionId: src_id|1c0fe770-ce38350e-81d126f1-80ecc371_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:11.419568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:11.477451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894893650256788:4267]
2025-09-30T14:51:11.477734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 329, pipe: [1:7555894893650256788:4267]
2025-09-30T14:51:11.523442Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:11.523745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:11.523758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:11.523774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894893650256788:4267], now have 1 active actors on pipe
2025-09-30T14:51:11.524046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894893650256788:4267]
2025-09-30T14:51:11.524050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:11.524054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:11.524073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:11.524117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 330 reason: error at write: Disconnected sessionId: src_id|1c0fe770-ce38350e-81d126f1-80ecc371_0
2025-09-30T14:51:11.524298Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:11.524330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 330 sessionId: src_id|1c0fe770-ce38350e-81d126f1-80ecc371_0 is DEAD
2025-09-30T14:51:11.524441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c0fe770-ce38350e-81d126f1-80ecc371_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:11.524450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c0fe770-ce38350e-81d126f1-80ecc371_0] Write session will restart in 0.006460s
2025-09-30T14:51:11.524466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c0fe770-ce38350e-81d126f1-80ecc371_0] Write session: Do CDS request
2025-09-30T14:51:11.524472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c0fe770-ce38350e-81d126f1-80ecc371_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:11.531784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c0fe770-ce38350e-81d126f1-80ecc371_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:11.531863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:11.531877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 331
2025-09-30T14:51:11.532003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 331 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:11.532038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 331 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:11.532043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=331 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:11.532047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:11.532467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 331 sessionId:  describe result for acl check
2025-09-30T14:51:11.532505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:11.532507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:11.532509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:11.532515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894893650256850:4434] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:11.533033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894893650256850:4434] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:11.535200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894893650256850:4434] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:11.536137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:11.537951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:11.538150Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:11.538161Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:11.538172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:11.538226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:11.538265Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894893560531749:3865]
2025-09-30T14:51:11.538423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894893650256850:4434] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:11.538434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894893650256850:4434] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:11.538437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894893650256850:4434] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:11.538443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 331 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:11.538965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:11.539189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:11.539229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:11.539582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:11.539642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:11.539650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:11.539651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:11.539652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:11.539653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:11.539655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:11.539656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:11.539657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:11.539659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:11.539660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:11.539662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.539663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.539664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.539665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:11.539667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:11.539672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:11.539683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:11.539688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:11.539693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:11.539697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:11.539702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:11.539706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:11.539711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:11.539715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:11.539720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:11.539724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.539728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.539732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.539737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:11.539741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:11.539750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:11.539758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:11.539765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:11.539772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:11.539782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:11.539788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:11.539792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:11.539823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:11.539833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:11.539839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:11.539844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:11.539851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:11.539856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:11.539862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:11.539866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:11.539872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:11.539877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:11.539882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:11.539887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:11.539893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:11.539898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.539904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.539909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.539914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.539922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.539927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.539937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:11.539942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:11.539948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:11.539958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:11.540004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:11.545540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:11.546862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:11.546884Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:11.546886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:11.546891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:11.546898Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 330 [2:7555894893560531749:3865]
2025-09-30T14:51:11.546917Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:11.546933Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:11.546943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.546946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.546948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.546965Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:11.546977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:11.546984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:11.547052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.547059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.547062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.547066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:11.547069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:11.547140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:11.547149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.547163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.547173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.547188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:11.547206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894893650256949:4434], now have 1 active actors on pipe
2025-09-30T14:51:11.547213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894893650256790:2454], now have 1 active actors on pipe
2025-09-30T14:51:11.547219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894893560531744:3865]
2025-09-30T14:51:11.547221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894893560531744:3865]
2025-09-30T14:51:11.547223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894893560531744:3865]
2025-09-30T14:51:11.547235Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:11.547260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:11.547267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:11.547270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:11.547272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:11.547281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:11.547284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:11.547291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 330
2025-09-30T14:51:11.547293Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 330
2025-09-30T14:51:11.547324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894893560531744:3865]
2025-09-30T14:51:11.547335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:11.547337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:11.547367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:11.547373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:11.547408Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68715600-56e3ea-aca1fc37-7da01039_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:11.547421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.547424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.547427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:11.547437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.547451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:11.547479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:11.547664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:11.547676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:11.547695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:11.547802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 331 partition: 0 MaxSeqNo: 42 sessionId: src_id|68715600-56e3ea-aca1fc37-7da01039_0
2025-09-30T14:51:11.548168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c0fe770-ce38350e-81d126f1-80ecc371_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|68715600-56e3ea-aca1fc37-7da01039_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:11.551087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68715600-56e3ea-aca1fc37-7da01039_0] Write session: try to update token
2025-09-30T14:51:11.551108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68715600-56e3ea-aca1fc37-7da01039_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:11.559544Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:11.559570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:11.559573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:11.559575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:11.559584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894893560531744:3865]
2025-09-30T14:51:11.559589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894893560531744:3865]
2025-09-30T14:51:11.559593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894893560531744:3865]
2025-09-30T14:51:11.559633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:11.559641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.559644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:11.559653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:11.559660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:11.559664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:11.559784Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:11.565948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 331 sessionId: src_id|68715600-56e3ea-aca1fc37-7da01039_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:11.568592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:11.623884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894893650256962:4267]
2025-09-30T14:51:11.624160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 330, pipe: [1:7555894893650256962:4267]
2025-09-30T14:51:11.663970Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:11.664305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:11.664318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:11.664335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894893650256962:4267], now have 1 active actors on pipe
2025-09-30T14:51:11.664547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:11.664558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:11.664558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894893650256962:4267]
2025-09-30T14:51:11.664585Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:11.664619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 331 reason: error at write: Disconnected sessionId: src_id|68715600-56e3ea-aca1fc37-7da01039_0
2025-09-30T14:51:11.664830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 331 sessionId: src_id|68715600-56e3ea-aca1fc37-7da01039_0 is DEAD
2025-09-30T14:51:11.664977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68715600-56e3ea-aca1fc37-7da01039_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:11.664988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68715600-56e3ea-aca1fc37-7da01039_0] Write session will restart in 0.009402s
2025-09-30T14:51:11.665010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68715600-56e3ea-aca1fc37-7da01039_0] Write session: Do CDS request
2025-09-30T14:51:11.665016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68715600-56e3ea-aca1fc37-7da01039_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:11.665096Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:11.675861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68715600-56e3ea-aca1fc37-7da01039_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:11.675961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:11.675978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 332
2025-09-30T14:51:11.675960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:11.676105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 332 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:11.676142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 332 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:11.676155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=332 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:11.676159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:11.676563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 332 sessionId:  describe result for acl check
2025-09-30T14:51:11.676610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:11.676616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:11.676618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:11.676623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894893650257085:4438] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:11.677108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894893650257085:4438] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:11.678174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:11.678382Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:11.678391Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:11.678402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:11.678454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:11.678493Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894893560531910:3867]
2025-09-30T14:51:11.679036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894893650257085:4438] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:11.679181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:11.679462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:11.679504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:11.679793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:11.679834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:11.679839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:11.679840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:11.679840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:11.679841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:11.679842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:11.679843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:11.679843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:11.679844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:11.679845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:11.679846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.679846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.679847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.679848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:11.679848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:11.679852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:11.679858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:11.679861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:11.679863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:11.679866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:11.679868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:11.679871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:11.679875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:11.679879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:11.679883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:11.679887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.679891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.679894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.679898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:11.679902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:11.679909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:11.679916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:11.679922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:11.679927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:11.679931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:11.679936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:11.679940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:11.679946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:11.679951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:11.679955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:11.679958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:11.679961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:11.679964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:11.679967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:11.679970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:11.679973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:11.679975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:11.679978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:11.679981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:11.679984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:11.679987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.679990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.679993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.679996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.680000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.680003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.680005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:11.680008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:11.680010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:11.680013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:11.680036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:11.685017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894893650257085:4438] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:11.685034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894893650257085:4438] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:11.685037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894893650257085:4438] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:11.685047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 332 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:11.685248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:11.686227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:11.686243Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:11.686246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:11.686250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:11.686257Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 331 [2:7555894893560531910:3867]
2025-09-30T14:51:11.686274Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:11.686290Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:11.686297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.686300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.686302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.686317Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:11.686323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:11.686330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:11.686385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.686393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.686396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.686399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:11.686402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:11.686463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:11.686471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.686484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.686501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.686519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:11.686543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894893650256963:2454], now have 1 active actors on pipe
2025-09-30T14:51:11.686547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894893650257123:4438], now have 1 active actors on pipe
2025-09-30T14:51:11.686553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894893560531904:3867]
2025-09-30T14:51:11.686556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894893560531904:3867]
2025-09-30T14:51:11.686558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894893560531904:3867]
2025-09-30T14:51:11.686585Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:11.686598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:11.686603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:11.686606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:11.686609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:11.686617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:11.686621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:11.686600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 331
2025-09-30T14:51:11.686605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 331
2025-09-30T14:51:11.686649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894893560531904:3867]
2025-09-30T14:51:11.686657Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:11.686661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:11.686687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:11.686695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:11.686727Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68618af8-abe9bf2e-9d1093d2-6abe59bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:11.686738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.686746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.686749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:11.686759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.686772Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:11.686793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:11.686935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:11.686942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:11.686955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:11.687030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 332 partition: 0 MaxSeqNo: 42 sessionId: src_id|68618af8-abe9bf2e-9d1093d2-6abe59bb_0
2025-09-30T14:51:11.687506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68715600-56e3ea-aca1fc37-7da01039_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|68618af8-abe9bf2e-9d1093d2-6abe59bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:11.690220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68618af8-abe9bf2e-9d1093d2-6abe59bb_0] Write session: try to update token
2025-09-30T14:51:11.690237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68618af8-abe9bf2e-9d1093d2-6abe59bb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:11.698694Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:11.698717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:11.698720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:11.698722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:11.698730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894893560531904:3867]
2025-09-30T14:51:11.698737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894893560531904:3867]
2025-09-30T14:51:11.698740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894893560531904:3867]
2025-09-30T14:51:11.698772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:11.698781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.698783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:11.698785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:11.698800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:11.698805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:11.698919Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:11.704674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 332 sessionId: src_id|68618af8-abe9bf2e-9d1093d2-6abe59bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:11.707347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:11.764695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894893650257131:4267]
2025-09-30T14:51:11.764966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 331, pipe: [1:7555894893650257131:4267]
2025-09-30T14:51:11.803973Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:11.804229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:11.804241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:11.804278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894893650257131:4267], now have 1 active actors on pipe
2025-09-30T14:51:11.804412Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:11.804406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:11.804420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:11.804473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 332 reason: error at write: Disconnected sessionId: src_id|68618af8-abe9bf2e-9d1093d2-6abe59bb_0
2025-09-30T14:51:11.804590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894893650257131:4267]
2025-09-30T14:51:11.804615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:11.804679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 332 sessionId: src_id|68618af8-abe9bf2e-9d1093d2-6abe59bb_0 is DEAD
2025-09-30T14:51:11.804829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68618af8-abe9bf2e-9d1093d2-6abe59bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:11.804839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68618af8-abe9bf2e-9d1093d2-6abe59bb_0] Write session will restart in 0.006705s
2025-09-30T14:51:11.804855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68618af8-abe9bf2e-9d1093d2-6abe59bb_0] Write session: Do CDS request
2025-09-30T14:51:11.804860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68618af8-abe9bf2e-9d1093d2-6abe59bb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:11.812801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68618af8-abe9bf2e-9d1093d2-6abe59bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:11.812903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:11.812915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 333
2025-09-30T14:51:11.813029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 333 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:11.813059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 333 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:11.813069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=333 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:11.813073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:11.813480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 333 sessionId:  describe result for acl check
2025-09-30T14:51:11.813510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:11.813518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:11.813520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:11.813527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894893650257208:4443] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:11.814023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894893650257208:4443] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:11.816134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894893650257208:4443] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:11.816188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:11.818150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:11.818293Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:11.818300Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:11.818307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:11.818340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:11.818366Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894893560532082:3870]
2025-09-30T14:51:11.818482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894893650257208:4443] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:11.818495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894893650257208:4443] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:11.818498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894893650257208:4443] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:11.818517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 333 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:11.818835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:11.819066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:11.819100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:11.819360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:11.819405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:11.819410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:11.819411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:11.819411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:11.819412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:11.819413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:11.819413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:11.819414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:11.819415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:11.819415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:11.819416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.819417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.819417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.819418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:11.819418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:11.819421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:11.819428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:11.819430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:11.819432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:11.819434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:11.819437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:11.819439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:11.819441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:11.819443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:11.819446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:11.819448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.819450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.819453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.819455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:11.819457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:11.819462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:11.819466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:11.819471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:11.819475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:11.819477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:11.819480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:11.819483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:11.819486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:11.819488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:11.819491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:11.819494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:11.819497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:11.819499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:11.819502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:11.819505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:11.819507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:11.819510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:11.819513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:11.819515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:11.819518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:11.819521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.819523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.819526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.819529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.819531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.819534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.819537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:11.819540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:11.819543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:11.819546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:11.819569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:11.824822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:11.825924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:11.825938Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:11.825940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:11.825944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:11.825950Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 332 [2:7555894893560532082:3870]
2025-09-30T14:51:11.825965Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:11.825982Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:11.825985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.825988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.825991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.826005Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:11.826016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:11.826023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:11.826080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.826087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.826089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.826092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:11.826095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:11.826158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:11.826165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.826176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.826192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.826207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:11.826229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894893650257144:2454], now have 1 active actors on pipe
2025-09-30T14:51:11.826237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894893650257301:4443], now have 1 active actors on pipe
2025-09-30T14:51:11.826243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894893560532076:3870]
2025-09-30T14:51:11.826245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894893560532076:3870]
2025-09-30T14:51:11.826248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894893560532076:3870]
2025-09-30T14:51:11.826259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:11.826274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:11.826277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:11.826285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:11.826287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:11.826289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:11.826292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:11.826331Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 332
2025-09-30T14:51:11.826331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 332
2025-09-30T14:51:11.826319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894893560532076:3870]
2025-09-30T14:51:11.826330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:11.826336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:11.826375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:11.826381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:11.826408Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1976a5c5-71843076-b3471fb9-fed84f3a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:11.826419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.826423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.826424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:11.826433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.826443Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:11.826462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:11.826616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:11.826630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:11.826654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:11.826746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 333 partition: 0 MaxSeqNo: 42 sessionId: src_id|1976a5c5-71843076-b3471fb9-fed84f3a_0
2025-09-30T14:51:11.827082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68618af8-abe9bf2e-9d1093d2-6abe59bb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1976a5c5-71843076-b3471fb9-fed84f3a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:11.829921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1976a5c5-71843076-b3471fb9-fed84f3a_0] Write session: try to update token
2025-09-30T14:51:11.829944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1976a5c5-71843076-b3471fb9-fed84f3a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:11.838059Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:11.838081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:11.838091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894893560532076:3870]
2025-09-30T14:51:11.838150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:11.838169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:11.838349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:11.838510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:11.838683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:11.838841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:11.839050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:11.839092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:11.844552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 333 sessionId: src_id|1976a5c5-71843076-b3471fb9-fed84f3a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:11.847123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:11.847341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:11.847366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:11.847411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:11.847491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:11.848658Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:11.848679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:11.848681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:11.848684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:11.848694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894893560532076:3870]
2025-09-30T14:51:11.848698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894893560532076:3870]
2025-09-30T14:51:11.848705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894893560532076:3870]
2025-09-30T14:51:11.848743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:11.848756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.848758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:11.848766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:11.848783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:11.848787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:11.848894Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:11.904983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894893650257313:4267]
2025-09-30T14:51:11.905252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 332, pipe: [1:7555894893650257313:4267]
2025-09-30T14:51:11.963511Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:11.971710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:11.971748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:11.971906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:11.971979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:11.972047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:11.972135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:11.972442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:11.972455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:11.972527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:11.972590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:11.972665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:11.972739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:11.972785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:11.972793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:11.972872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:11.972938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:11.973008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:11.973074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:11.973122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:11.973130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:11.973199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:11.973268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:11.973333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:11.973399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:11.973536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:11.973545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:11.973611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:11.973676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:11.973743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:11.973810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:11.973853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:11.973862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:11.973937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:11.974022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:11.974098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:11.974189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:11.974234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:11.974242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:11.974315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:11.974379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:11.974446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:11.974508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:11.974558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:11.974576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:11.974653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:11.974710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:11.974773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:11.974842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:11.974891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:11.974899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:11.974966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:11.975021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:11.975082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:11.975153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:11.975195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:11.975201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:11.975284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:11.975348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:11.975412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:11.975475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:11.975521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:11.975533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:11.975594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894893650257313:4267], now have 1 active actors on pipe
2025-09-30T14:51:11.975841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:11.975854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:11.975886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 333 reason: error at write: Disconnected sessionId: src_id|1976a5c5-71843076-b3471fb9-fed84f3a_0
2025-09-30T14:51:11.975885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894893650257313:4267]
2025-09-30T14:51:11.975906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:11.976107Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:11.976140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 333 sessionId: src_id|1976a5c5-71843076-b3471fb9-fed84f3a_0 is DEAD
2025-09-30T14:51:11.976291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1976a5c5-71843076-b3471fb9-fed84f3a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:11.976303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1976a5c5-71843076-b3471fb9-fed84f3a_0] Write session will restart in 0.005591s
2025-09-30T14:51:11.976330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1976a5c5-71843076-b3471fb9-fed84f3a_0] Write session: Do CDS request
2025-09-30T14:51:11.976336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1976a5c5-71843076-b3471fb9-fed84f3a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:11.982830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1976a5c5-71843076-b3471fb9-fed84f3a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:11.982910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:11.982942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 334
2025-09-30T14:51:11.983063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 334 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:11.983094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 334 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:11.983112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=334 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:11.983120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:11.983610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 334 sessionId:  describe result for acl check
2025-09-30T14:51:11.983644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:11.983651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:11.983653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:11.983658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894893650257368:4449] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:11.984185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894893650257368:4449] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:11.987053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894893650257368:4449] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:11.987350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:11.989597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:11.989811Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:11.989819Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:11.989828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:11.989875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:11.989912Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894893560532245:3872]
2025-09-30T14:51:11.989925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894893650257368:4449] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:11.989936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894893650257368:4449] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:11.989939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894893650257368:4449] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:11.989945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 334 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:11.990374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:11.990683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:11.990720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:11.990967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:11.991019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:11.991025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:11.991026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:11.991028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:11.991029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:11.991030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:11.991031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:11.991032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:11.991033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:11.991034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:11.991036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.991037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.991039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.991040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:11.991041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:11.991045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:11.991052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:11.991054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:11.991057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:11.991059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:11.991061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:11.991064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:11.991066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:11.991068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:11.991070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:11.991073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.991075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.991078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.991080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:11.991082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:11.991089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:11.991093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:11.991098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:11.991101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:11.991103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:11.991106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:11.991109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:11.991112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:11.991115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:11.991118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:11.991120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:11.991123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:11.991127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:11.991130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:11.991132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:11.991135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:11.991138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:11.991140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:11.991142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:11.991145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:11.991148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.991151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.991153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.991156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.991158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.991162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.991164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:11.991167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:11.991169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:11.991172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:11.991194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:11.996528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:11.997509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:11.997522Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:11.997523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:11.997526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:11.997531Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 333 [2:7555894893560532245:3872]
2025-09-30T14:51:11.997544Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:11.997557Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:11.997558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.997561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.997562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.997574Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:11.997578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:11.997584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:11.997625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.997631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.997632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.997634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:11.997636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:11.997686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:11.997693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:11.997705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:11.997721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:11.997735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:11.997749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894893650257479:4449], now have 1 active actors on pipe
2025-09-30T14:51:11.997756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894893650257324:2454], now have 1 active actors on pipe
2025-09-30T14:51:11.997761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894893560532239:3872]
2025-09-30T14:51:11.997762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894893560532239:3872]
2025-09-30T14:51:11.997763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894893560532239:3872]
2025-09-30T14:51:11.997772Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:11.997781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:11.997786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:11.997791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:11.997791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:11.997793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:11.997793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:11.997815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894893560532239:3872]
2025-09-30T14:51:11.997817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:11.997827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:11.997835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 333
2025-09-30T14:51:11.997838Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 333
2025-09-30T14:51:11.998017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:11.998025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:11.998044Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1076f9d7-bcb2ee81-54ac21cf-3b858d97_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:11.998052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.998055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.998057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:11.998064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.998071Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:11.998087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:11.998219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:11.998225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:11.998235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:11.998303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 334 partition: 0 MaxSeqNo: 42 sessionId: src_id|1076f9d7-bcb2ee81-54ac21cf-3b858d97_0
2025-09-30T14:51:11.998691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1976a5c5-71843076-b3471fb9-fed84f3a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1076f9d7-bcb2ee81-54ac21cf-3b858d97_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:12.001513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1076f9d7-bcb2ee81-54ac21cf-3b858d97_0] Write session: try to update token
2025-09-30T14:51:12.001531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1076f9d7-bcb2ee81-54ac21cf-3b858d97_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:12.015050Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:12.015069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:12.015077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894893560532239:3872]
2025-09-30T14:51:12.015121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:12.015130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:12.015330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:12.015472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:12.015635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:12.015785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:12.016005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:12.016059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:12.016017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 334 sessionId: src_id|1076f9d7-bcb2ee81-54ac21cf-3b858d97_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:12.018643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:12.018826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:12.018845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:12.018879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:12.018951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:12.021208Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:12.021228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:12.021230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:12.021232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:12.021241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894893560532239:3872]
2025-09-30T14:51:12.021244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894893560532239:3872]
2025-09-30T14:51:12.021248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894893560532239:3872]
2025-09-30T14:51:12.021288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:12.021296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.021305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:12.021307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:12.021315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:12.021320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:12.021444Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:12.075973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894897945224790:4267]
2025-09-30T14:51:12.076255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 333, pipe: [1:7555894897945224790:4267]
2025-09-30T14:51:12.135991Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:12.144235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:12.144266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:12.144447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:12.144516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:12.144591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:12.144661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:12.144707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:12.144719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:12.144793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:12.144859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:12.144928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:12.145010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:12.145056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:12.145063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:12.145131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:12.145195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:12.145266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:12.145336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:12.145380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:12.145387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:12.145458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:12.145526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:12.145595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:12.145662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:12.145709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:12.145716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:12.145785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:12.145851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:12.145917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:12.145984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:12.146042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:12.146050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:12.146118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:12.146182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:12.146253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:12.146326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:12.146373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:12.146381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:12.146457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:12.146522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:12.146608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:12.146675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:12.146744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:12.146756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:12.146837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:12.146906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:12.146973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:12.147041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:12.147084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:12.147091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:12.147163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:12.147230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:12.147315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:12.147380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:12.147423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:12.147432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:12.147499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:12.147565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:12.147644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:12.147711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:12.147777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:12.147785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:12.147855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894897945224790:4267], now have 1 active actors on pipe
2025-09-30T14:51:12.148100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894897945224790:4267]
2025-09-30T14:51:12.148100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:12.148105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:12.148134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 334 reason: error at write: Disconnected sessionId: src_id|1076f9d7-bcb2ee81-54ac21cf-3b858d97_0
2025-09-30T14:51:12.148134Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:12.148354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 334 sessionId: src_id|1076f9d7-bcb2ee81-54ac21cf-3b858d97_0 is DEAD
2025-09-30T14:51:12.148518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1076f9d7-bcb2ee81-54ac21cf-3b858d97_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:12.148528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1076f9d7-bcb2ee81-54ac21cf-3b858d97_0] Write session will restart in 0.006325s
2025-09-30T14:51:12.148551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1076f9d7-bcb2ee81-54ac21cf-3b858d97_0] Write session: Do CDS request
2025-09-30T14:51:12.148556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1076f9d7-bcb2ee81-54ac21cf-3b858d97_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:12.149073Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:12.155733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1076f9d7-bcb2ee81-54ac21cf-3b858d97_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:12.155863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:12.155876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 335
2025-09-30T14:51:12.155988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 335 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:12.156012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 335 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:12.156016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=335 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:12.156019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:12.156455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 335 sessionId:  describe result for acl check
2025-09-30T14:51:12.156493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:12.156501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:12.156503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:12.156509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894897945224820:4453] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:12.157065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894897945224820:4453] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:12.160060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894897945224820:4453] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:12.161568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:12.163745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:12.163906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894897945224820:4453] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:12.163919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894897945224820:4453] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:12.163922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894897945224820:4453] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:12.163931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 335 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:12.163978Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:12.163987Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:12.164000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:12.164063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:12.164103Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894897855499707:3875]
2025-09-30T14:51:12.164718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:12.165079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:12.165133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:12.165487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:12.165563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:12.165572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:12.165573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:12.165574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:12.165576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:12.165577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:12.165578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:12.165579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:12.165581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:12.165582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:12.165583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.165584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.165585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.165586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:12.165588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:12.165593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:12.165603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:12.165608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:12.165612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:12.165616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:12.165619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:12.165623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:12.165626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:12.165630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:12.165634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:12.165638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.165642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.165645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.165649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:12.165653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:12.165660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:12.165668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:12.165674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:12.165679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:12.165684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:12.165689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:12.165693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:12.165698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:12.165702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:12.165707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:12.165712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:12.165717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:12.165722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:12.165726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:12.165730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:12.165735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:12.165739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:12.165744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:12.165749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:12.165754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:12.165759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.165766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.165771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.165777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.165782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.165797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.165802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:12.165808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:12.165817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:12.165823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:12.165878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:12.171355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:12.172241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:12.172264Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:12.172267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:12.172271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:12.172279Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 334 [2:7555894897855499707:3875]
2025-09-30T14:51:12.172295Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:12.172318Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:12.172321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:12.172324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:12.172327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:12.172342Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:12.172354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:12.172367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:12.172430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.172441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.172444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.172447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:12.172450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:12.172517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:12.172526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.172540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.172554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.172578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:12.172601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894897945224951:4453], now have 1 active actors on pipe
2025-09-30T14:51:12.172610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894897945224792:2454], now have 1 active actors on pipe
2025-09-30T14:51:12.172617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894897855499702:3875]
2025-09-30T14:51:12.172619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894897855499702:3875]
2025-09-30T14:51:12.172621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894897855499702:3875]
2025-09-30T14:51:12.172632Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:12.172646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:12.172650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:12.172655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:12.172658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:12.172666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:12.172669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:12.172667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 334
2025-09-30T14:51:12.172700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894897855499702:3875]
2025-09-30T14:51:12.172688Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 334
2025-09-30T14:51:12.172709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:12.172723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:12.172749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:12.172759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:12.172794Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d6bda0b-ee283ca0-2d29da32-553377ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:12.172806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:12.172810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:12.172812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:12.172822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:12.172830Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:12.172848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:12.173015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:12.173028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:12.173046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:12.173135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 335 partition: 0 MaxSeqNo: 42 sessionId: src_id|6d6bda0b-ee283ca0-2d29da32-553377ae_0
2025-09-30T14:51:12.173539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1076f9d7-bcb2ee81-54ac21cf-3b858d97_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6d6bda0b-ee283ca0-2d29da32-553377ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:12.176278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6bda0b-ee283ca0-2d29da32-553377ae_0] Write session: try to update token
2025-09-30T14:51:12.176295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6bda0b-ee283ca0-2d29da32-553377ae_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:12.184712Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:12.184735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:12.184737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:12.184738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:12.184747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894897855499702:3875]
2025-09-30T14:51:12.184752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894897855499702:3875]
2025-09-30T14:51:12.184759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894897855499702:3875]
2025-09-30T14:51:12.184802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:12.184804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:12.184811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:12.184815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:12.184816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.184819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:12.184957Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:12.191169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 335 sessionId: src_id|6d6bda0b-ee283ca0-2d29da32-553377ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:12.194050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:12.248535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894897945224963:4267]
2025-09-30T14:51:12.248782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 334, pipe: [1:7555894897945224963:4267]
2025-09-30T14:51:12.290208Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:12.290664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:12.290676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:12.290693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894897945224963:4267], now have 1 active actors on pipe
2025-09-30T14:51:12.290852Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:12.290920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894897945224963:4267]
2025-09-30T14:51:12.290943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:12.290954Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:12.291020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 335 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6d6bda0b-ee283ca0-2d29da32-553377ae_0
2025-09-30T14:51:12.291266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 335 sessionId: src_id|6d6bda0b-ee283ca0-2d29da32-553377ae_0 is DEAD
2025-09-30T14:51:12.291423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6bda0b-ee283ca0-2d29da32-553377ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:12.291434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6bda0b-ee283ca0-2d29da32-553377ae_0] Write session will restart in 0.009979s
2025-09-30T14:51:12.291466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6bda0b-ee283ca0-2d29da32-553377ae_0] Write session: Do CDS request
2025-09-30T14:51:12.291471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6bda0b-ee283ca0-2d29da32-553377ae_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:12.302499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:12.302872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6bda0b-ee283ca0-2d29da32-553377ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:12.302950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:12.302967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 336
2025-09-30T14:51:12.303127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 336 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:12.303167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 336 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:12.303177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=336 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:12.303181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:12.303634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 336 sessionId:  describe result for acl check
2025-09-30T14:51:12.303667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:12.303674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:12.303676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:12.303682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894897945225090:4457] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:12.304199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894897945225090:4457] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:12.304579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:12.304793Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:12.304802Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:12.304813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:12.304862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:12.304902Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894897855499870:3877]
2025-09-30T14:51:12.305527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:12.305827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:12.305875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:12.306047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894897945225090:4457] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:12.306185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:12.306255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:12.306262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:12.306263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:12.306264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:12.306266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:12.306267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:12.306268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:12.306269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:12.306270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:12.306272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:12.306273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.306274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.306275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.306276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:12.306277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:12.306283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:12.306293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:12.306298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:12.306302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:12.306306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:12.306310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:12.306314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:12.306318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:12.306322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:12.306327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:12.306331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.306335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.306339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.306344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:12.306348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:12.306355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:12.306363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:12.306371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:12.306376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:12.306387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:12.306393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:12.306397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:12.306402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:12.306412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:12.306417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:12.306422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:12.306427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:12.306436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:12.306441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:12.306446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:12.306452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:12.306460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:12.306466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:12.306470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:12.306479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:12.306484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.306490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.306499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.306504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.306510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.306518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.306523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:12.306533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:12.306539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:12.306544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:12.306598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:12.311704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894897945225090:4457] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:12.311719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894897945225090:4457] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:12.311722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894897945225090:4457] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:12.311730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 336 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:12.312026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:12.312922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:12.312939Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:12.312942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:12.312946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:12.312954Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 335 [2:7555894897855499870:3877]
2025-09-30T14:51:12.312970Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:12.312985Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:12.312988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:12.312992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:12.312995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:12.313013Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:12.313022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:12.313029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:12.313097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.313104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.313106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.313110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:12.313113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:12.313167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:12.313174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.313183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.313195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.313213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:12.313232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894897945224964:2454], now have 1 active actors on pipe
2025-09-30T14:51:12.313234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894897945225128:4457], now have 1 active actors on pipe
2025-09-30T14:51:12.313238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894897855499864:3877]
2025-09-30T14:51:12.313240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894897855499864:3877]
2025-09-30T14:51:12.313241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894897855499864:3877]
2025-09-30T14:51:12.313251Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:12.313262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:12.313268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:12.313271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:12.313272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:12.313283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 335
2025-09-30T14:51:12.313273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:12.313287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 335
2025-09-30T14:51:12.313275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:12.313308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894897855499864:3877]
2025-09-30T14:51:12.313312Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:12.313316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:12.313342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:12.313352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:12.313383Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2fbfcde-e83c2fe5-661392f0-c3abd69_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:12.313392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:12.313394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:12.313396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:12.313403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:12.313415Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:12.313426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:12.313528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:12.313534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:12.313544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:12.313608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 336 partition: 0 MaxSeqNo: 42 sessionId: src_id|e2fbfcde-e83c2fe5-661392f0-c3abd69_0
2025-09-30T14:51:12.314015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6bda0b-ee283ca0-2d29da32-553377ae_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e2fbfcde-e83c2fe5-661392f0-c3abd69_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:12.316615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2fbfcde-e83c2fe5-661392f0-c3abd69_0] Write session: try to update token
2025-09-30T14:51:12.316631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2fbfcde-e83c2fe5-661392f0-c3abd69_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:12.325349Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:12.325368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:12.325370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:12.325371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:12.325379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894897855499864:3877]
2025-09-30T14:51:12.325382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894897855499864:3877]
2025-09-30T14:51:12.325384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894897855499864:3877]
2025-09-30T14:51:12.325416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:12.325425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.325428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:12.325435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:12.325450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:12.325453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:12.325565Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:12.330095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 336 sessionId: src_id|e2fbfcde-e83c2fe5-661392f0-c3abd69_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:12.332680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:12.390824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894897945225149:4267]
2025-09-30T14:51:12.391208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 335, pipe: [1:7555894897945225149:4267]
2025-09-30T14:51:12.438302Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:12.438925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:12.438944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:12.438983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894897945225149:4267], now have 1 active actors on pipe
2025-09-30T14:51:12.439283Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:12.439343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:12.439362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:12.439369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:12.439415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894897945225149:4267]
2025-09-30T14:51:12.439440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 336 reason: error at write: Disconnected sessionId: src_id|e2fbfcde-e83c2fe5-661392f0-c3abd69_0
2025-09-30T14:51:12.439634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 336 sessionId: src_id|e2fbfcde-e83c2fe5-661392f0-c3abd69_0 is DEAD
2025-09-30T14:51:12.439807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2fbfcde-e83c2fe5-661392f0-c3abd69_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:12.439818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2fbfcde-e83c2fe5-661392f0-c3abd69_0] Write session will restart in 0.007871s
2025-09-30T14:51:12.439836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2fbfcde-e83c2fe5-661392f0-c3abd69_0] Write session: Do CDS request
2025-09-30T14:51:12.439843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2fbfcde-e83c2fe5-661392f0-c3abd69_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:12.448670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2fbfcde-e83c2fe5-661392f0-c3abd69_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:12.448790Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:12.448807Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 337
2025-09-30T14:51:12.449010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 337 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:12.449057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 337 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:12.449064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=337 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:12.449070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:12.451720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 337 sessionId:  describe result for acl check
2025-09-30T14:51:12.451773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:12.451775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:12.451777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:12.451785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894897945225234:4469] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:12.452498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894897945225234:4469] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:12.455480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:12.455606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894897945225234:4469] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:12.458483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:12.458718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894897945225234:4469] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:12.458736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894897945225234:4469] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:12.458752Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:12.458741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894897945225234:4469] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:12.458763Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:12.458751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 337 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:12.458776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:12.458849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:12.458899Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894897855500071:3891]
2025-09-30T14:51:12.459640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:12.460036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:12.460125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:12.460496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:12.460555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:12.460564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:12.460566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:12.460567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:12.460568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:12.460569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:12.460571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:12.460572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:12.460573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:12.460574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:12.460576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.460577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.460579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.460580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:12.460581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:12.460587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:12.460598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:12.460601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:12.460604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:12.460606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:12.460609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:12.460611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:12.460614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:12.460617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:12.460621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:12.460624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.460626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.460629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.460631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:12.460634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:12.460641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:12.460648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:12.460653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:12.460657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:12.460661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:12.460665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:12.460667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:12.460671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:12.460674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:12.460677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:12.460681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:12.460686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:12.460689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:12.460692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:12.460694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:12.460697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:12.460700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:12.460703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:12.460706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:12.460709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:12.460712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.460715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.460718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.460721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.460724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.460727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.460730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:12.460733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:12.460735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:12.460739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:12.460777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:12.466260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:12.467119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:12.467136Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:12.467138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:12.467141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:12.467146Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 336 [2:7555894897855500071:3891]
2025-09-30T14:51:12.467159Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:12.467172Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:12.467174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:12.467176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:12.467178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:12.467192Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:12.467196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:12.467202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:12.467267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.467284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.467286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.467290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:12.467292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:12.467580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:12.467563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 336
2025-09-30T14:51:12.467583Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 336
2025-09-30T14:51:12.467591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.467601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.467608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.467620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:12.467635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894897945225322:4469], now have 1 active actors on pipe
2025-09-30T14:51:12.467638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894897945225159:2454], now have 1 active actors on pipe
2025-09-30T14:51:12.467643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894897855500066:3891]
2025-09-30T14:51:12.467645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894897855500066:3891]
2025-09-30T14:51:12.467647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894897855500066:3891]
2025-09-30T14:51:12.467662Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:12.467673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:12.467677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:12.467679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:12.467680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:12.467683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:12.467701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:12.467711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:12.467712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:12.467751Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37b3983f-9122a49a-8fc48f80-627eb10b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:12.467763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:12.467766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:12.467768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:12.467775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:12.467781Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:12.467788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894897855500066:3891]
2025-09-30T14:51:12.467795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:12.467809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:12.467818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:12.468002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:12.468010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:12.468021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:12.468153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 337 partition: 0 MaxSeqNo: 42 sessionId: src_id|37b3983f-9122a49a-8fc48f80-627eb10b_0
2025-09-30T14:51:12.468642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2fbfcde-e83c2fe5-661392f0-c3abd69_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|37b3983f-9122a49a-8fc48f80-627eb10b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:12.472080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37b3983f-9122a49a-8fc48f80-627eb10b_0] Write session: try to update token
2025-09-30T14:51:12.472102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37b3983f-9122a49a-8fc48f80-627eb10b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:12.479436Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:12.479453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:12.479462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894897855500066:3891]
2025-09-30T14:51:12.479502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:12.479519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:12.479758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:12.479963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:12.480165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:12.480373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:12.480671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:12.480724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:12.489586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 337 sessionId: src_id|37b3983f-9122a49a-8fc48f80-627eb10b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:12.490103Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:12.490124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:12.490126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:12.490128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:12.490137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894897855500066:3891]
2025-09-30T14:51:12.490142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894897855500066:3891]
2025-09-30T14:51:12.490146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894897855500066:3891]
2025-09-30T14:51:12.490185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:12.490192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.490195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:12.490199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:12.490206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:12.490211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:12.490338Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:12.492887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:12.539330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894897945225334:4267]
2025-09-30T14:51:12.539555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 336, pipe: [1:7555894897945225334:4267]
2025-09-30T14:51:12.601813Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:12.602156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:12.602170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:12.602188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894897945225334:4267], now have 1 active actors on pipe
2025-09-30T14:51:12.602444Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:12.602533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:12.602546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:12.602674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 337 reason: error at write: Disconnected sessionId: src_id|37b3983f-9122a49a-8fc48f80-627eb10b_0
2025-09-30T14:51:12.602912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 337 sessionId: src_id|37b3983f-9122a49a-8fc48f80-627eb10b_0 is DEAD
2025-09-30T14:51:12.603045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37b3983f-9122a49a-8fc48f80-627eb10b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:12.603056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37b3983f-9122a49a-8fc48f80-627eb10b_0] Write session will restart in 0.008814s
2025-09-30T14:51:12.603109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37b3983f-9122a49a-8fc48f80-627eb10b_0] Write session: Do CDS request
2025-09-30T14:51:12.603115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37b3983f-9122a49a-8fc48f80-627eb10b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:12.603093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894897945225334:4267]
2025-09-30T14:51:12.603144Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:12.612978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37b3983f-9122a49a-8fc48f80-627eb10b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:12.613077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:12.613093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 338
2025-09-30T14:51:12.613246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 338 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:12.613279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 338 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:12.613287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=338 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:12.613291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:12.613728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 338 sessionId:  describe result for acl check
2025-09-30T14:51:12.613766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:12.613772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:12.613774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:12.613779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894897945225354:4473] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:12.614246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894897945225354:4473] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:12.617472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894897945225354:4473] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:12.619627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:12.621952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:12.622155Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:12.622167Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:12.622178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:12.622186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894897945225354:4473] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:12.622205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894897945225354:4473] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:12.622209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894897945225354:4473] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:12.622216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 338 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:12.622227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:12.622269Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894897855500239:3894]
2025-09-30T14:51:12.622996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:12.623296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:12.623340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:12.623676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:12.623733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:12.623741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:12.623742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:12.623744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:12.623745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:12.623746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:12.623748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:12.623749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:12.623750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:12.623751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:12.623753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.623754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.623755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.623757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:12.623759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:12.623764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:12.623775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:12.623780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:12.623785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:12.623789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:12.623794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:12.623798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:12.623803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:12.623807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:12.623812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:12.623816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.623821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.623825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.623830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:12.623834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:12.623841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:12.623851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:12.623858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:12.623864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:12.623869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:12.623875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:12.623880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:12.623886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:12.623891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:12.623897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:12.623901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:12.623907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:12.623913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:12.623919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:12.623924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:12.623930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:12.623936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:12.623942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:12.623947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:12.623953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:12.623959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.623965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.623969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.623975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.623980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.623986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.623991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:12.623997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:12.624002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:12.624008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:12.624056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:12.629473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:12.630436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:12.630454Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:12.630456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:12.630459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:12.630465Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 337 [2:7555894897855500239:3894]
2025-09-30T14:51:12.630478Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:12.630492Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:12.630499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:12.630502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:12.630504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:12.630517Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:12.630523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:12.630528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:12.630596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.630602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.630604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.630607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:12.630609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:12.630660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:12.630668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.630677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.630683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.630698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:12.630716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894897855500234:3894]
2025-09-30T14:51:12.630729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894897855500234:3894]
2025-09-30T14:51:12.630731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894897855500234:3894]
2025-09-30T14:51:12.630740Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:12.630750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894897945225335:2454], now have 1 active actors on pipe
2025-09-30T14:51:12.630755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894897945225497:4473], now have 1 active actors on pipe
2025-09-30T14:51:12.630755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:12.630759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:12.630760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:12.630762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:12.630769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:12.630771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:12.630795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894897855500234:3894]
2025-09-30T14:51:12.630801Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:12.630807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:12.630841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 337
2025-09-30T14:51:12.630987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 337
2025-09-30T14:51:12.631038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:12.631049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:12.631077Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|158ccb7b-fef2b6eb-52a54382-6607cb61_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:12.631089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:12.631091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:12.631093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:12.631100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:12.631109Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:12.631119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:12.635458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:12.635482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:12.635514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:12.635621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 338 partition: 0 MaxSeqNo: 42 sessionId: src_id|158ccb7b-fef2b6eb-52a54382-6607cb61_0
2025-09-30T14:51:12.636037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37b3983f-9122a49a-8fc48f80-627eb10b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|158ccb7b-fef2b6eb-52a54382-6607cb61_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:12.639313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|158ccb7b-fef2b6eb-52a54382-6607cb61_0] Write session: try to update token
2025-09-30T14:51:12.639338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|158ccb7b-fef2b6eb-52a54382-6607cb61_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:12.643195Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:12.643216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:12.643229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:12.643231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:12.643240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894897855500234:3894]
2025-09-30T14:51:12.643258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894897855500234:3894]
2025-09-30T14:51:12.643263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894897855500234:3894]
2025-09-30T14:51:12.643302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:12.643303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:12.643309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:12.643310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.643312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:12.643313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:12.643446Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:12.655138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 338 sessionId: src_id|158ccb7b-fef2b6eb-52a54382-6607cb61_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:12.658074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:12.703168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894897945225508:4267]
2025-09-30T14:51:12.703501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 337, pipe: [1:7555894897945225508:4267]
2025-09-30T14:51:12.755803Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:12.756061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:12.756075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:12.756093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894897945225508:4267], now have 1 active actors on pipe
2025-09-30T14:51:12.756354Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:12.756327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894897945225508:4267]
2025-09-30T14:51:12.756358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:12.756366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:12.756371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:12.756435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 338 reason: error at write: Disconnected sessionId: src_id|158ccb7b-fef2b6eb-52a54382-6607cb61_0
2025-09-30T14:51:12.756637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 338 sessionId: src_id|158ccb7b-fef2b6eb-52a54382-6607cb61_0 is DEAD
2025-09-30T14:51:12.756792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|158ccb7b-fef2b6eb-52a54382-6607cb61_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:12.756803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|158ccb7b-fef2b6eb-52a54382-6607cb61_0] Write session will restart in 0.006090s
2025-09-30T14:51:12.756822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|158ccb7b-fef2b6eb-52a54382-6607cb61_0] Write session: Do CDS request
2025-09-30T14:51:12.756830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|158ccb7b-fef2b6eb-52a54382-6607cb61_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:12.763858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|158ccb7b-fef2b6eb-52a54382-6607cb61_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:12.764030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:12.764045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 339
2025-09-30T14:51:12.764220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 339 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:12.764256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 339 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:12.764262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=339 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:12.764280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:12.764778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 339 sessionId:  describe result for acl check
2025-09-30T14:51:12.764824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:12.764834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:12.764836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:12.764841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894897945225568:4477] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:12.765445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894897945225568:4477] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:12.768194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894897945225568:4477] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:12.768958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:12.771060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:12.771313Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:12.771330Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:12.771342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:12.771404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894897945225568:4477] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:12.771417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894897945225568:4477] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:12.771420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894897945225568:4477] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:12.771405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:12.771446Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894897855500418:3897]
2025-09-30T14:51:12.771436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 339 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:12.772155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:12.772426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:12.772468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:12.772789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:12.772852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:12.772860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:12.772862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:12.772863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:12.772864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:12.772865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:12.772866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:12.772867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:12.772880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:12.772881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:12.772882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.772884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.772885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.772886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:12.772887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:12.772893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:12.772904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:12.772908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:12.772911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:12.772916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:12.772920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:12.772924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:12.772928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:12.772931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:12.772935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:12.772939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.772942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.772946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.772949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:12.772954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:12.772962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:12.772970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:12.772976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:12.772982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:12.772987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:12.772993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:12.772997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:12.773003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:12.773007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:12.773013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:12.773017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:12.773023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:12.773027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:12.773033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:12.773037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:12.773042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:12.773047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:12.773052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:12.773057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:12.773062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:12.773067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.773072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.773077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.773082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.773087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.773092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.773095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:12.773102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:12.773107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:12.773112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:12.773156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:12.778670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:12.779557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:12.779574Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:12.779577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:12.779581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:12.779587Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 338 [2:7555894897855500418:3897]
2025-09-30T14:51:12.779605Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:12.779620Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:12.779623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:12.779626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:12.779628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:12.779644Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:12.779651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:12.779659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:12.779722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.779731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.779733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.779737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:12.779740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:12.779803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:12.779812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.779825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.779838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.779863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:12.779885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894897945225673:4477], now have 1 active actors on pipe
2025-09-30T14:51:12.779895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894897945225510:2454], now have 1 active actors on pipe
2025-09-30T14:51:12.779901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894897855500413:3897]
2025-09-30T14:51:12.779904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894897855500413:3897]
2025-09-30T14:51:12.779907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894897855500413:3897]
2025-09-30T14:51:12.779921Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:12.779940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:12.779943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:12.779947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:12.779949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:12.779957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:12.779960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:12.779943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 338
2025-09-30T14:51:12.779948Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 338
2025-09-30T14:51:12.779999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:12.780010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:12.780022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894897855500413:3897]
2025-09-30T14:51:12.780036Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:12.780041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:12.780065Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|516e1ce7-95103d73-ef99468a-5e60788e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:12.780077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:12.780081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:12.780084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:12.780092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:12.780105Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:12.780136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:12.780322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:12.780333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:12.780345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:12.780435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 339 partition: 0 MaxSeqNo: 42 sessionId: src_id|516e1ce7-95103d73-ef99468a-5e60788e_0
2025-09-30T14:51:12.780829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|158ccb7b-fef2b6eb-52a54382-6607cb61_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|516e1ce7-95103d73-ef99468a-5e60788e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:12.783748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|516e1ce7-95103d73-ef99468a-5e60788e_0] Write session: try to update token
2025-09-30T14:51:12.783767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|516e1ce7-95103d73-ef99468a-5e60788e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:12.791653Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:12.791677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:12.791680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:12.791682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:12.791691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894897855500413:3897]
2025-09-30T14:51:12.791696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894897855500413:3897]
2025-09-30T14:51:12.791701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894897855500413:3897]
2025-09-30T14:51:12.791739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:12.791740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:12.791745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.791748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:12.791748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:12.791752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:12.791892Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:12.797986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 339 sessionId: src_id|516e1ce7-95103d73-ef99468a-5e60788e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:12.800684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:12.856765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894897945225696:4267]
2025-09-30T14:51:12.857065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 338, pipe: [1:7555894897945225696:4267]
2025-09-30T14:51:12.900793Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:12.901391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:12.901411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:12.901450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894897945225696:4267], now have 1 active actors on pipe
2025-09-30T14:51:12.901698Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:12.901725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:12.901741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:12.901740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:12.901792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894897945225696:4267]
2025-09-30T14:51:12.901802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 339 reason: error at write: Disconnected sessionId: src_id|516e1ce7-95103d73-ef99468a-5e60788e_0
2025-09-30T14:51:12.902028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 339 sessionId: src_id|516e1ce7-95103d73-ef99468a-5e60788e_0 is DEAD
2025-09-30T14:51:12.902145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|516e1ce7-95103d73-ef99468a-5e60788e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:12.902158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|516e1ce7-95103d73-ef99468a-5e60788e_0] Write session will restart in 0.007098s
2025-09-30T14:51:12.902180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|516e1ce7-95103d73-ef99468a-5e60788e_0] Write session: Do CDS request
2025-09-30T14:51:12.902184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|516e1ce7-95103d73-ef99468a-5e60788e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:12.910751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|516e1ce7-95103d73-ef99468a-5e60788e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:12.910867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:12.910882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 340
2025-09-30T14:51:12.910989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 340 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:12.911020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 340 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:12.911033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=340 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:12.911037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:12.911538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 340 sessionId:  describe result for acl check
2025-09-30T14:51:12.911572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:12.911578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:12.911580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:12.911584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894897945225824:4482] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:12.912059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894897945225824:4482] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:12.912645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:12.913780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894897945225824:4482] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:12.914762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:12.914971Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:12.914985Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:12.914997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:12.915051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:12.915083Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894897855500586:3899]
2025-09-30T14:51:12.915596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:12.915862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:12.915906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:12.916127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:12.916169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:12.916174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:12.916175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:12.916175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:12.916176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:12.916177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:12.916177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:12.916178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:12.916179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:12.916179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:12.916180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.916181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.916181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.916182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:12.916183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:12.916186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:12.916193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:12.916195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:12.916198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:12.916200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:12.916202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:12.916231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894897945225824:4482] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:12.916205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:12.916257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894897945225824:4482] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:12.916207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:12.916260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894897945225824:4482] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:12.916209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:12.916212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:12.916215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.916217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.916220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.916222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:12.916224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:12.916229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:12.916234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:12.916267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 340 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:12.916238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:12.916242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:12.916245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:12.916248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:12.916251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:12.916254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:12.916256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:12.916261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:12.916264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:12.916267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:12.916270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:12.916273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:12.916275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:12.916278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:12.916281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:12.916284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:12.916287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:12.916289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:12.916292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.916295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.916297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.916300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.916302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.916305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.916308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:12.916311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:12.916313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:12.916316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:12.916340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:12.921517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:12.922368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:12.922385Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:12.922388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:12.922392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:12.922399Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 339 [2:7555894897855500586:3899]
2025-09-30T14:51:12.922416Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:12.922435Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:12.922442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:12.922446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:12.922448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:12.922464Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:12.922472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:12.922479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:12.922543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.922550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.922553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.922556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:12.922571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:12.922628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:12.922635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.922649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:12.922662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:12.922677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:12.922694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894897945225698:2454], now have 1 active actors on pipe
2025-09-30T14:51:12.922701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894897945225864:4482], now have 1 active actors on pipe
2025-09-30T14:51:12.922705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894897855500580:3899]
2025-09-30T14:51:12.922707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894897855500580:3899]
2025-09-30T14:51:12.922708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894897855500580:3899]
2025-09-30T14:51:12.922717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:12.922729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:12.922730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:12.922738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:12.922740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:12.922744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:12.922747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:12.922777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894897855500580:3899]
2025-09-30T14:51:12.922784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:12.922787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:12.922775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 339
2025-09-30T14:51:12.922786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 339
2025-09-30T14:51:12.922814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:12.922821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:12.922842Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b539d93-44d10e77-70b32dce-62aa8775_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:12.922850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:12.922853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:12.922856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:12.922863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:12.922873Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:12.922887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:12.923050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:12.923059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:12.923069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:12.923139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 340 partition: 0 MaxSeqNo: 42 sessionId: src_id|9b539d93-44d10e77-70b32dce-62aa8775_0
2025-09-30T14:51:12.923507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|516e1ce7-95103d73-ef99468a-5e60788e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9b539d93-44d10e77-70b32dce-62aa8775_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:12.926164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b539d93-44d10e77-70b32dce-62aa8775_0] Write session: try to update token
2025-09-30T14:51:12.926177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b539d93-44d10e77-70b32dce-62aa8775_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:12.934829Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:12.934855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:12.934857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:12.934859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:12.934871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894897855500580:3899]
2025-09-30T14:51:12.934875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894897855500580:3899]
2025-09-30T14:51:12.934882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894897855500580:3899]
2025-09-30T14:51:12.934927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:12.934930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:12.934933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:12.934937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:12.934938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:12.934942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:12.935123Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:12.940303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 340 sessionId: src_id|9b539d93-44d10e77-70b32dce-62aa8775_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:12.942977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:13.002163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894902240193176:4267]
2025-09-30T14:51:13.002423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 339, pipe: [1:7555894902240193176:4267]
2025-09-30T14:51:13.045598Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:13.045839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:13.045851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:13.045882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894902240193176:4267], now have 1 active actors on pipe
2025-09-30T14:51:13.046110Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:13.046113Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:13.046135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:13.046139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:13.046157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894902240193176:4267]
2025-09-30T14:51:13.046191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 340 reason: error at write: Disconnected sessionId: src_id|9b539d93-44d10e77-70b32dce-62aa8775_0
2025-09-30T14:51:13.046340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 340 sessionId: src_id|9b539d93-44d10e77-70b32dce-62aa8775_0 is DEAD
2025-09-30T14:51:13.046477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b539d93-44d10e77-70b32dce-62aa8775_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:13.046486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b539d93-44d10e77-70b32dce-62aa8775_0] Write session will restart in 0.006468s
2025-09-30T14:51:13.046523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b539d93-44d10e77-70b32dce-62aa8775_0] Write session: Do CDS request
2025-09-30T14:51:13.046529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b539d93-44d10e77-70b32dce-62aa8775_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:13.053745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b539d93-44d10e77-70b32dce-62aa8775_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:13.053847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:13.053860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 341
2025-09-30T14:51:13.053969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 341 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:13.053999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 341 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:13.054008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=341 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:13.054012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:13.054483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 341 sessionId:  describe result for acl check
2025-09-30T14:51:13.054518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:13.054524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:13.054526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:13.054532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894902240193236:4490] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:13.055102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894902240193236:4490] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:13.057255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894902240193236:4490] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:13.057950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:13.059962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:13.060035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894902240193236:4490] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:13.060050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894902240193236:4490] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:13.060054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894902240193236:4490] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:13.060062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 341 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:13.060174Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:13.060185Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:13.060195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:13.060248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:13.060288Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894902150468052:3902]
2025-09-30T14:51:13.060949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:13.061195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:13.061235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:13.061548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:13.061625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:13.061633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:13.061635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:13.061636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:13.061637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:13.061638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:13.061639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:13.061640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:13.061641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:13.061642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:13.061644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.061645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.061646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.061648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:13.061649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:13.061654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:13.061663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:13.061667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:13.061671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:13.061676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:13.061680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:13.061684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:13.061688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:13.061692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:13.061697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:13.061701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.061705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.061709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.061713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:13.061718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:13.061725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:13.061733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:13.061739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:13.061750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:13.061755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:13.061765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:13.061774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:13.061784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:13.061793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:13.061802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:13.061811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:13.061817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:13.061822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:13.061827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:13.061836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:13.061841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:13.061846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:13.061856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:13.061861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:13.061866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:13.061876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.061882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.061890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.061894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.061899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.061904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.061909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:13.061919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:13.061923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:13.061932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:13.061974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:13.067608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:13.068743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:13.068762Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:13.068764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:13.068768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:13.068775Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 340 [2:7555894902150468052:3902]
2025-09-30T14:51:13.068791Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:13.068811Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:13.068823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:13.068826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:13.068828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:13.068843Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:13.068850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:13.068856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:13.068923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.068931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.068934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.068938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:13.068941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:13.069003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:13.069011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.069024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.069035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.069060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:13.069084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894902240193349:4490], now have 1 active actors on pipe
2025-09-30T14:51:13.069087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894902240193184:2454], now have 1 active actors on pipe
2025-09-30T14:51:13.069094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894902150468046:3902]
2025-09-30T14:51:13.069096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894902150468046:3902]
2025-09-30T14:51:13.069099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894902150468046:3902]
2025-09-30T14:51:13.069113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:13.069131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:13.069131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:13.069134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:13.069137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:13.069151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:13.069158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:13.069161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 340
2025-09-30T14:51:13.069191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894902150468046:3902]
2025-09-30T14:51:13.069198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:13.069174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 340
2025-09-30T14:51:13.069200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:13.069214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:13.069224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:13.069274Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23290825-c64482a0-6dd78418-d93d58f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:13.069287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:13.069290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:13.069293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:13.069302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:13.069311Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:13.069332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:13.069504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:13.069511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:13.069524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:13.069610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 341 partition: 0 MaxSeqNo: 42 sessionId: src_id|23290825-c64482a0-6dd78418-d93d58f1_0
2025-09-30T14:51:13.069978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b539d93-44d10e77-70b32dce-62aa8775_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|23290825-c64482a0-6dd78418-d93d58f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:13.072678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23290825-c64482a0-6dd78418-d93d58f1_0] Write session: try to update token
2025-09-30T14:51:13.072693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23290825-c64482a0-6dd78418-d93d58f1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:13.081122Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:13.081145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:13.081148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:13.081150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:13.081161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894902150468046:3902]
2025-09-30T14:51:13.081167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894902150468046:3902]
2025-09-30T14:51:13.081171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894902150468046:3902]
2025-09-30T14:51:13.081212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:13.081224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.081227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:13.081226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:13.081233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:13.081236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:13.081372Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:13.087105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 341 sessionId: src_id|23290825-c64482a0-6dd78418-d93d58f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:13.089888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:13.146589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894902240193360:4267]
2025-09-30T14:51:13.146867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 340, pipe: [1:7555894902240193360:4267]
2025-09-30T14:51:13.196248Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:13.196699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:13.196717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:13.196759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894902240193360:4267], now have 1 active actors on pipe
2025-09-30T14:51:13.197015Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:13.197038Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:13.197036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894902240193360:4267]
2025-09-30T14:51:13.197078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:13.197082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:13.197144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 341 reason: error at write: Disconnected sessionId: src_id|23290825-c64482a0-6dd78418-d93d58f1_0
2025-09-30T14:51:13.197371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 341 sessionId: src_id|23290825-c64482a0-6dd78418-d93d58f1_0 is DEAD
2025-09-30T14:51:13.197538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23290825-c64482a0-6dd78418-d93d58f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:13.197550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23290825-c64482a0-6dd78418-d93d58f1_0] Write session will restart in 0.008231s
2025-09-30T14:51:13.197572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23290825-c64482a0-6dd78418-d93d58f1_0] Write session: Do CDS request
2025-09-30T14:51:13.197581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23290825-c64482a0-6dd78418-d93d58f1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:13.206787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23290825-c64482a0-6dd78418-d93d58f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:13.206890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:13.206901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 342
2025-09-30T14:51:13.207020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 342 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:13.207063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 342 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:13.207072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=342 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:13.207077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:13.207569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 342 sessionId:  describe result for acl check
2025-09-30T14:51:13.207610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:13.207616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:13.207618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:13.207635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894902240193461:4494] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:13.208215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894902240193461:4494] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:13.209869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:13.210363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894902240193461:4494] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:13.212256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:13.212485Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:13.212496Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:13.212507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:13.212558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:13.212596Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894902150468222:3904]
2025-09-30T14:51:13.212822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894902240193461:4494] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:13.212836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894902240193461:4494] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:13.212840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894902240193461:4494] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:13.212848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 342 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:13.213270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:13.213551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:13.213594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:13.213921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:13.213983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:13.213990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:13.213992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:13.213993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:13.213994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:13.213996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:13.213997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:13.213998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:13.213999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:13.214000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:13.214002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.214004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.214005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.214006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:13.214007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:13.214013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:13.214024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:13.214028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:13.214033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:13.214037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:13.214041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:13.214045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:13.214049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:13.214053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:13.214058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:13.214062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.214066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.214070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.214074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:13.214079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:13.214086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:13.214094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:13.214099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:13.214105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:13.214111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:13.214116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:13.214121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:13.214126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:13.214131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:13.214135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:13.214145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:13.214148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:13.214151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:13.214157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:13.214159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:13.214162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:13.214165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:13.214168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:13.214170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:13.214174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:13.214183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.214192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.214200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.214205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.214213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.214217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.214221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:13.214231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:13.214238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:13.214241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:13.214265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:13.220016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:13.220941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:13.220968Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:13.220971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:13.220975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:13.220982Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 341 [2:7555894902150468222:3904]
2025-09-30T14:51:13.220999Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:13.221016Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:13.221026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:13.221030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:13.221033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:13.221050Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:13.221063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:13.221070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:13.221136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.221152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.221154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.221157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:13.221160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:13.221234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:13.221242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.221256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.221272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.221293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:13.221316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894902240193528:4494], now have 1 active actors on pipe
2025-09-30T14:51:13.221323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894902240193361:2454], now have 1 active actors on pipe
2025-09-30T14:51:13.221329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894902150468217:3904]
2025-09-30T14:51:13.221331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894902150468217:3904]
2025-09-30T14:51:13.221333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894902150468217:3904]
2025-09-30T14:51:13.221345Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:13.221359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:13.221363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:13.221367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:13.221370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:13.221377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:13.221381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:13.221415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894902150468217:3904]
2025-09-30T14:51:13.221423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:13.221411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 341
2025-09-30T14:51:13.221435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:13.221430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 341
2025-09-30T14:51:13.221458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:13.221471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:13.221503Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d149db5-1d0a9937-8c05c7e-5543c667_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:13.221515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:13.221525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:13.221527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:13.221538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:13.221551Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:13.221572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:13.221756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:13.221765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:13.221780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:13.221883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 342 partition: 0 MaxSeqNo: 42 sessionId: src_id|6d149db5-1d0a9937-8c05c7e-5543c667_0
2025-09-30T14:51:13.222309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23290825-c64482a0-6dd78418-d93d58f1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6d149db5-1d0a9937-8c05c7e-5543c667_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:13.225109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d149db5-1d0a9937-8c05c7e-5543c667_0] Write session: try to update token
2025-09-30T14:51:13.225130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d149db5-1d0a9937-8c05c7e-5543c667_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:13.233612Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:13.233634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:13.233644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894902150468217:3904]
2025-09-30T14:51:13.233696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:13.233715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:13.233894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:13.234062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:13.234210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:13.234360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:13.234579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:13.234626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:13.239814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 342 sessionId: src_id|6d149db5-1d0a9937-8c05c7e-5543c667_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:13.242554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:13.242807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:13.242847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:13.242882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:13.242970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:13.244524Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:13.244552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:13.244555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:13.244557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:13.244571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894902150468217:3904]
2025-09-30T14:51:13.244575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894902150468217:3904]
2025-09-30T14:51:13.244580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894902150468217:3904]
2025-09-30T14:51:13.244622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:13.244630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.244632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:13.244634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:13.244641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:13.244646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:13.244780Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:13.297077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894902240193539:4267]
2025-09-30T14:51:13.297315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 341, pipe: [1:7555894902240193539:4267]
2025-09-30T14:51:13.354178Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:13.361766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:13.361794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:13.361948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:13.362006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:13.362067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:13.362126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:13.362425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:13.362436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:13.362502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:13.362573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:13.362634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:13.362693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:13.362739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:13.362747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:13.362821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:13.362883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:13.362944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:13.363007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:13.363057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:13.363066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:13.363129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:13.363189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:13.363297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:13.363359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:13.363401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:13.363406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:13.363470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:13.363528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:13.363588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:13.363649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:13.363693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:13.363698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:13.363763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:13.363834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:13.363901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:13.363967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:13.364034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:13.364043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:13.364112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:13.364171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:13.364232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:13.364307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:13.364351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:13.364358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:13.364428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:13.364492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:13.364567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:13.364629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:13.364729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:13.364737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:13.364804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:13.364863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:13.364920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:13.364989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:13.365034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:13.365039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:13.365104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:13.365165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:13.365231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:13.365291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:13.365333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:13.365338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:13.365411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894902240193539:4267], now have 1 active actors on pipe
2025-09-30T14:51:13.365656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:13.365673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:13.365681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894902240193539:4267]
2025-09-30T14:51:13.365701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:13.365703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 342 reason: error at write: Disconnected sessionId: src_id|6d149db5-1d0a9937-8c05c7e-5543c667_0
2025-09-30T14:51:13.365895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 342 sessionId: src_id|6d149db5-1d0a9937-8c05c7e-5543c667_0 is DEAD
2025-09-30T14:51:13.366049Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:13.366064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d149db5-1d0a9937-8c05c7e-5543c667_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:13.366075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d149db5-1d0a9937-8c05c7e-5543c667_0] Write session will restart in 0.008890s
2025-09-30T14:51:13.366098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d149db5-1d0a9937-8c05c7e-5543c667_0] Write session: Do CDS request
2025-09-30T14:51:13.366104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d149db5-1d0a9937-8c05c7e-5543c667_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:13.375798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d149db5-1d0a9937-8c05c7e-5543c667_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:13.375884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:13.375897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 343
2025-09-30T14:51:13.376045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 343 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:13.376100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 343 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:13.376112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=343 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:13.376117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:13.376599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 343 sessionId:  describe result for acl check
2025-09-30T14:51:13.376640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:13.376647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:13.376650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:13.376656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894902240193654:4498] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:13.377212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894902240193654:4498] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:13.378792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:13.379755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894902240193654:4498] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:13.380940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:13.381157Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:13.381173Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:13.381186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:13.381270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:13.381312Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894902150468393:3906]
2025-09-30T14:51:13.381937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:13.382196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:13.382184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894902240193654:4498] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:13.382195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894902240193654:4498] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:13.382198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894902240193654:4498] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:13.382205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 343 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:13.382229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:13.382511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:13.382576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:13.382580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:13.382581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:13.382582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:13.382583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:13.382584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:13.382585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:13.382585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:13.382586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:13.382587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:13.382587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.382588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.382589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.382589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:13.382590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:13.382594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:13.382600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:13.382603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:13.382605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:13.382608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:13.382610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:13.382613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:13.382615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:13.382617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:13.382620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:13.382622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.382625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.382627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.382629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:13.382632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:13.382638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:13.382643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:13.382647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:13.382650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:13.382653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:13.382656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:13.382659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:13.382662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:13.382664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:13.382667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:13.382669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:13.382672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:13.382675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:13.382678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:13.382681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:13.382684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:13.382689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:13.382692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:13.382695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:13.382698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:13.382700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.382704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.382706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.382709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.382711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.382715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.382717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:13.382720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:13.382722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:13.382725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:13.382748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:13.387914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:13.389003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:13.389019Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:13.389022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:13.389026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:13.389032Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 342 [2:7555894902150468393:3906]
2025-09-30T14:51:13.389048Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:13.389067Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:13.389076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:13.389079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:13.389081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:13.389096Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:13.389107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:13.389113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:13.389157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.389163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.389164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.389167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:13.389169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:13.389230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:13.389241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.389254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.389266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.389284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:13.389302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894902240193540:2454], now have 1 active actors on pipe
2025-09-30T14:51:13.389310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894902240193710:4498], now have 1 active actors on pipe
2025-09-30T14:51:13.389315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894902150468388:3906]
2025-09-30T14:51:13.389320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894902150468388:3906]
2025-09-30T14:51:13.389322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894902150468388:3906]
2025-09-30T14:51:13.389334Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:13.389347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:13.389352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:13.389356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:13.389359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:13.389365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:13.389369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:13.389340Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 342
2025-09-30T14:51:13.389355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 342
2025-09-30T14:51:13.389413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:13.389422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:13.389435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894902150468388:3906]
2025-09-30T14:51:13.389446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:13.389457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:13.389483Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32f5fa73-26e72872-5ecab968-5c58e0c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:13.389494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:13.389503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:13.389505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:13.389514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:13.389524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:13.389548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:13.389711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:13.389719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:13.389733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:13.389795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 343 partition: 0 MaxSeqNo: 42 sessionId: src_id|32f5fa73-26e72872-5ecab968-5c58e0c7_0
2025-09-30T14:51:13.390187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d149db5-1d0a9937-8c05c7e-5543c667_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|32f5fa73-26e72872-5ecab968-5c58e0c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:13.392803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32f5fa73-26e72872-5ecab968-5c58e0c7_0] Write session: try to update token
2025-09-30T14:51:13.392819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32f5fa73-26e72872-5ecab968-5c58e0c7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:13.401055Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:13.401075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:13.401078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:13.401080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:13.401092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894902150468388:3906]
2025-09-30T14:51:13.401097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894902150468388:3906]
2025-09-30T14:51:13.401101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894902150468388:3906]
2025-09-30T14:51:13.401140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:13.401152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.401153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:13.401155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:13.401160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:13.401167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:13.401298Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:13.406591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 343 sessionId: src_id|32f5fa73-26e72872-5ecab968-5c58e0c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:13.409320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:13.466050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894902240193744:4267]
2025-09-30T14:51:13.466326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 342, pipe: [1:7555894902240193744:4267]
2025-09-30T14:51:13.510975Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:13.511352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:13.511366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:13.511397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894902240193744:4267], now have 1 active actors on pipe
2025-09-30T14:51:13.511651Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:13.511647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894902240193744:4267]
2025-09-30T14:51:13.511657Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:13.511675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:13.511685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:13.511742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 343 reason: error at write: Disconnected sessionId: src_id|32f5fa73-26e72872-5ecab968-5c58e0c7_0
2025-09-30T14:51:13.511907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 343 sessionId: src_id|32f5fa73-26e72872-5ecab968-5c58e0c7_0 is DEAD
2025-09-30T14:51:13.512072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32f5fa73-26e72872-5ecab968-5c58e0c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:13.512083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32f5fa73-26e72872-5ecab968-5c58e0c7_0] Write session will restart in 0.009259s
2025-09-30T14:51:13.512104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32f5fa73-26e72872-5ecab968-5c58e0c7_0] Write session: Do CDS request
2025-09-30T14:51:13.512110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32f5fa73-26e72872-5ecab968-5c58e0c7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:13.522837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32f5fa73-26e72872-5ecab968-5c58e0c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:13.522980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:13.523006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 344
2025-09-30T14:51:13.523125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 344 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:13.523169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 344 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:13.523177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=344 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:13.523181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:13.523631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 344 sessionId:  describe result for acl check
2025-09-30T14:51:13.523667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:13.523670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:13.523672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:13.523678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894902240193878:4510] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:13.523685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:13.524161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894902240193878:4510] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:13.526100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:13.526312Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:13.526322Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:13.526333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:13.526382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:13.526425Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894902150468603:3921]
2025-09-30T14:51:13.526957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894902240193878:4510] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:13.527096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:13.527403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:13.527456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:13.527784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:13.527842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:13.527848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:13.527849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:13.527850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:13.527852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:13.527853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:13.527854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:13.527856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:13.527857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:13.527858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:13.527860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.527861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.527862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.527864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:13.527865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:13.527870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:13.527880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:13.527884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:13.527888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:13.527892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:13.527897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:13.527901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:13.527905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:13.527909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:13.527913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:13.527917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.527921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.527925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.527929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:13.527934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:13.527941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:13.527948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:13.527954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:13.527960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:13.527964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:13.527969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:13.527974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:13.527979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:13.527984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:13.527990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:13.527994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:13.528000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:13.528004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:13.528010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:13.528014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:13.528019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:13.528024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:13.528029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:13.528038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:13.528043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:13.528049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.528055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.528064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.528069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.528073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.528078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.528082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:13.528087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:13.528093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:13.528103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:13.528150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:13.533561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894902240193878:4510] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:13.533579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894902240193878:4510] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:13.533582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894902240193878:4510] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:13.533591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 344 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:13.533799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:13.534893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:13.534908Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:13.534911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:13.534914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:13.534922Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 343 [2:7555894902150468603:3921]
2025-09-30T14:51:13.534940Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:13.534956Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:13.534959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:13.534962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:13.534965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:13.534984Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:13.534996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:13.535003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:13.535065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.535072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.535074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.535078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:13.535080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:13.535147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:13.535154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.535167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.535176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.535189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:13.535207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894902240193745:2454], now have 1 active actors on pipe
2025-09-30T14:51:13.535213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894902240193917:4510], now have 1 active actors on pipe
2025-09-30T14:51:13.535219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894902150468598:3921]
2025-09-30T14:51:13.535220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894902150468598:3921]
2025-09-30T14:51:13.535222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894902150468598:3921]
2025-09-30T14:51:13.535228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:13.535237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:13.535238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:13.535253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:13.535255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:13.535268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:13.535277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:13.535310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894902150468598:3921]
2025-09-30T14:51:13.535319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:13.535312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 343
2025-09-30T14:51:13.535328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 343
2025-09-30T14:51:13.535344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:13.535369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:13.535374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:13.535397Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48979031-21047dc4-31ecd8c9-15cb3185_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:13.535405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:13.535409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:13.535412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:13.535422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:13.535439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:13.535453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:13.535568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:13.535575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:13.535589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:13.535662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 344 partition: 0 MaxSeqNo: 42 sessionId: src_id|48979031-21047dc4-31ecd8c9-15cb3185_0
2025-09-30T14:51:13.536051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32f5fa73-26e72872-5ecab968-5c58e0c7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|48979031-21047dc4-31ecd8c9-15cb3185_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:13.538832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48979031-21047dc4-31ecd8c9-15cb3185_0] Write session: try to update token
2025-09-30T14:51:13.538847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48979031-21047dc4-31ecd8c9-15cb3185_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:13.552954Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:13.552974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:13.552988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894902150468598:3921]
2025-09-30T14:51:13.553031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:13.553049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:13.553207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:13.553345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:13.553479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:13.553619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:13.553800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:13.553839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:13.554509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 344 sessionId: src_id|48979031-21047dc4-31ecd8c9-15cb3185_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:13.557776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:13.558238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:13.558262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:13.558282Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:13.558290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:13.558293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:13.558295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:13.558303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894902150468598:3921]
2025-09-30T14:51:13.558308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894902150468598:3921]
2025-09-30T14:51:13.558312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894902150468598:3921]
2025-09-30T14:51:13.558353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:13.558360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:13.558364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:13.558366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.558368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:13.558369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:13.558502Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:13.611978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894902240193925:4267]
2025-09-30T14:51:13.612229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 343, pipe: [1:7555894902240193925:4267]
2025-09-30T14:51:13.669050Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:13.669455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:13.669496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894902240193925:4267], now have 1 active actors on pipe
2025-09-30T14:51:13.669634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:13.669693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894902240193925:4267]
2025-09-30T14:51:13.669718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:13.669731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:13.669734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:13.669800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 344 reason: error at write: Disconnected sessionId: src_id|48979031-21047dc4-31ecd8c9-15cb3185_0
2025-09-30T14:51:13.669973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 344 sessionId: src_id|48979031-21047dc4-31ecd8c9-15cb3185_0 is DEAD
2025-09-30T14:51:13.670129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48979031-21047dc4-31ecd8c9-15cb3185_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:13.670141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48979031-21047dc4-31ecd8c9-15cb3185_0] Write session will restart in 0.009156s
2025-09-30T14:51:13.670164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48979031-21047dc4-31ecd8c9-15cb3185_0] Write session: Do CDS request
2025-09-30T14:51:13.670170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48979031-21047dc4-31ecd8c9-15cb3185_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:13.680814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48979031-21047dc4-31ecd8c9-15cb3185_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:13.680937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:13.680954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 345
2025-09-30T14:51:13.681072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 345 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:13.681111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 345 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:13.681116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=345 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:13.681120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:13.681586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 345 sessionId:  describe result for acl check
2025-09-30T14:51:13.681623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:13.681630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:13.681632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:13.681639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894902240194058:4514] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:13.682130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:13.682175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894902240194058:4514] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:13.683801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894902240194058:4514] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:13.684553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:13.684870Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:13.684878Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:13.684888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:13.684949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:13.684998Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894902150468776:3923]
2025-09-30T14:51:13.685595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:13.685868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:13.685911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:13.686193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:13.686260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:13.686267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:13.686268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:13.686269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:13.686271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:13.686272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:13.686273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:13.686275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:13.686276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:13.686278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:13.686279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.686276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894902240194058:4514] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:13.686280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.686289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894902240194058:4514] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:13.686282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.686283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:13.686292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894902240194058:4514] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:13.686284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:13.686288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:13.686298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:13.686302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:13.686300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 345 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:13.686305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:13.686308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:13.686312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:13.686316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:13.686319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:13.686322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:13.686326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:13.686329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.686333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.686336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.686340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:13.686344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:13.686352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:13.686359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:13.686365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:13.686375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:13.686385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:13.686391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:13.686395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:13.686401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:13.686412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:13.686422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:13.686427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:13.686430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:13.686433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:13.686436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:13.686438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:13.686441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:13.686444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:13.686446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:13.686449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:13.686451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:13.686454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.686456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.686459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.686465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.686468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.686471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.686473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:13.686477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:13.686482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:13.686486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:13.686516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:13.691712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:13.692616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:13.692631Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:13.692635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:13.692639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:13.692646Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 344 [2:7555894902150468776:3923]
2025-09-30T14:51:13.692664Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:13.692686Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:13.692693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:13.692696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:13.692699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:13.692715Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:13.692727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:13.692734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:13.692800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.692808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.692811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.692814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:13.692817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:13.692887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:13.692895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.692909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.692926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.692949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:13.692972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894902240194097:4514], now have 1 active actors on pipe
2025-09-30T14:51:13.692980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894902240193926:2454], now have 1 active actors on pipe
2025-09-30T14:51:13.692986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894902150468771:3923]
2025-09-30T14:51:13.692988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894902150468771:3923]
2025-09-30T14:51:13.692991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894902150468771:3923]
2025-09-30T14:51:13.693003Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:13.693015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:13.693020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:13.693022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:13.693024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:13.693035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:13.693038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:13.693069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894902150468771:3923]
2025-09-30T14:51:13.693082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:13.693099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:13.693067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 344
2025-09-30T14:51:13.693126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 344
2025-09-30T14:51:13.693139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:13.693149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:13.693171Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7fd95ddd-325075ab-30428d50-5d1b50ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:13.693181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:13.693189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:13.693192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:13.693201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:13.693209Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:13.693226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:13.693342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:13.693350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:13.693362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:13.693553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 345 partition: 0 MaxSeqNo: 42 sessionId: src_id|7fd95ddd-325075ab-30428d50-5d1b50ce_0
2025-09-30T14:51:13.693892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48979031-21047dc4-31ecd8c9-15cb3185_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7fd95ddd-325075ab-30428d50-5d1b50ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:13.696720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fd95ddd-325075ab-30428d50-5d1b50ce_0] Write session: try to update token
2025-09-30T14:51:13.696741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fd95ddd-325075ab-30428d50-5d1b50ce_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:13.705139Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:13.705158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:13.705169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894902150468771:3923]
2025-09-30T14:51:13.705213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:13.705219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:13.705437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:13.705618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:13.705790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:13.705972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:13.706205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:13.706255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:13.711394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 345 sessionId: src_id|7fd95ddd-325075ab-30428d50-5d1b50ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:13.714127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:13.714335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:13.714353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:13.714390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:13.714469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:13.715697Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:13.715708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:13.715711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:13.715712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:13.715722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894902150468771:3923]
2025-09-30T14:51:13.715726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894902150468771:3923]
2025-09-30T14:51:13.715728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894902150468771:3923]
2025-09-30T14:51:13.715758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:13.715766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.715768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:13.715768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:13.715774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:13.715777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:13.715890Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:13.769658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894902240194107:4267]
2025-09-30T14:51:13.769956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 344, pipe: [1:7555894902240194107:4267]
2025-09-30T14:51:13.826126Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:13.834400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:13.834428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:13.834624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:13.834696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:13.834765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:13.834834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:13.835350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:13.835365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:13.835438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:13.835504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:13.835570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:13.835639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:13.835688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:13.835696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:13.835772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:13.835837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:13.835910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:13.835980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:13.836027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:13.836035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:13.836106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:13.836171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:13.836228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:13.836295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:13.836344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:13.836352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:13.836419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:13.836483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:13.836550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:13.836615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:13.836662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:13.836670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:13.836739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:13.836804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:13.836889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:13.836962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:13.837008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:13.837015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:13.837087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:13.837148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:13.837223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:13.837291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:13.837338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:13.837347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:13.837415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:13.837477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:13.837540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:13.837602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:13.837667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:13.837676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:13.837743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:13.837807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:13.837870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:13.837934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:13.838000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:13.838008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:13.838078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:13.838141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:13.838206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:13.838273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:13.838321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:13.838329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:13.838402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894902240194107:4267], now have 1 active actors on pipe
2025-09-30T14:51:13.838692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:13.838705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:13.838733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 345 reason: error at write: Disconnected sessionId: src_id|7fd95ddd-325075ab-30428d50-5d1b50ce_0
2025-09-30T14:51:13.838765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:13.838806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894902240194107:4267]
2025-09-30T14:51:13.838994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 345 sessionId: src_id|7fd95ddd-325075ab-30428d50-5d1b50ce_0 is DEAD
2025-09-30T14:51:13.839125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fd95ddd-325075ab-30428d50-5d1b50ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:13.839135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fd95ddd-325075ab-30428d50-5d1b50ce_0] Write session will restart in 0.008925s
2025-09-30T14:51:13.839157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fd95ddd-325075ab-30428d50-5d1b50ce_0] Write session: Do CDS request
2025-09-30T14:51:13.839164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fd95ddd-325075ab-30428d50-5d1b50ce_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:13.839175Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:13.849836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fd95ddd-325075ab-30428d50-5d1b50ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:13.850005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:13.850021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 346
2025-09-30T14:51:13.850164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 346 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:13.850207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 346 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:13.850216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=346 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:13.850220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:13.850675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 346 sessionId:  describe result for acl check
2025-09-30T14:51:13.850715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:13.850722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:13.850725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:13.850736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894902240194254:4519] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:13.851344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894902240194254:4519] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:13.851593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:13.853431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894902240194254:4519] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:13.854041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:13.854334Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:13.854345Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:13.854357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:13.854417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:13.854455Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894902150468962:3926]
2025-09-30T14:51:13.855111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:13.855464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:13.855524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:13.855851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894902240194254:4519] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:13.855866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894902240194254:4519] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:13.855869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894902240194254:4519] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:13.855877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 346 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:13.855892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:13.855984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:13.855991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:13.855992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:13.855993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:13.855994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:13.855995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:13.855996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:13.855997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:13.855998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:13.855999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:13.856000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.856001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.856002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.856004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:13.856005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:13.856011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:13.856022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:13.856026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:13.856030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:13.856034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:13.856039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:13.856043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:13.856047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:13.856051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:13.856055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:13.856059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.856063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.856067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.856071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:13.856075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:13.856083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:13.856091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:13.856097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:13.856103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:13.856107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:13.856113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:13.856117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:13.856122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:13.856127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:13.856132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:13.856137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:13.856142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:13.856147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:13.856152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:13.856156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:13.856162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:13.856166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:13.856171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:13.856181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:13.856184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:13.856187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.856190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.856192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.856195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.856198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.856201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.856203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:13.856206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:13.856209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:13.856212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:13.856238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:13.861771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:13.862685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:13.862702Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:13.862706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:13.862710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:13.862719Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 345 [2:7555894902150468962:3926]
2025-09-30T14:51:13.862735Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:13.862758Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:13.862768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:13.862771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:13.862773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:13.862789Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:13.862795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:13.862803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:13.862862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.862870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.862872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.862876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:13.862878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:13.862946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:13.862953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.862964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.862975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.862990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:13.863012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894902240194120:2454], now have 1 active actors on pipe
2025-09-30T14:51:13.863019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894902240194293:4519], now have 1 active actors on pipe
2025-09-30T14:51:13.863025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894902150468957:3926]
2025-09-30T14:51:13.863027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894902150468957:3926]
2025-09-30T14:51:13.863030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894902150468957:3926]
2025-09-30T14:51:13.863041Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:13.863054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:13.863059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:13.863060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:13.863061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:13.863073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:13.863076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:13.863064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 345
2025-09-30T14:51:13.863107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894902150468957:3926]
2025-09-30T14:51:13.863115Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:13.863117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:13.863099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 345
2025-09-30T14:51:13.863146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:13.863155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:13.863381Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c80e02ec-9e766ba0-6d981057-9ad25593_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:13.863394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:13.863397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:13.863399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:13.863410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:13.863425Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:13.863468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:13.863598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:13.863606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:13.863622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:13.863691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 346 partition: 0 MaxSeqNo: 42 sessionId: src_id|c80e02ec-9e766ba0-6d981057-9ad25593_0
2025-09-30T14:51:13.864098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fd95ddd-325075ab-30428d50-5d1b50ce_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c80e02ec-9e766ba0-6d981057-9ad25593_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:13.866885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c80e02ec-9e766ba0-6d981057-9ad25593_0] Write session: try to update token
2025-09-30T14:51:13.866908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c80e02ec-9e766ba0-6d981057-9ad25593_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:13.874995Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:13.875012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:13.875014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:13.875016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:13.875026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894902150468957:3926]
2025-09-30T14:51:13.875030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894902150468957:3926]
2025-09-30T14:51:13.875034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894902150468957:3926]
2025-09-30T14:51:13.875074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:13.875082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.875086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:13.875092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:13.875099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:13.875103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:13.875221Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:13.881942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 346 sessionId: src_id|c80e02ec-9e766ba0-6d981057-9ad25593_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:13.884822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:13.939130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894902240194303:4267]
2025-09-30T14:51:13.939365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 345, pipe: [1:7555894902240194303:4267]
2025-09-30T14:51:13.981388Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:13.981874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:13.981905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:13.981929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894902240194303:4267], now have 1 active actors on pipe
2025-09-30T14:51:13.982143Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:13.982168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:13.982175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:13.982179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:13.982224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894902240194303:4267]
2025-09-30T14:51:13.982239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 346 reason: error at write: Disconnected sessionId: src_id|c80e02ec-9e766ba0-6d981057-9ad25593_0
2025-09-30T14:51:13.982466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 346 sessionId: src_id|c80e02ec-9e766ba0-6d981057-9ad25593_0 is DEAD
2025-09-30T14:51:13.982624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c80e02ec-9e766ba0-6d981057-9ad25593_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:13.982634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c80e02ec-9e766ba0-6d981057-9ad25593_0] Write session will restart in 0.005302s
2025-09-30T14:51:13.982658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c80e02ec-9e766ba0-6d981057-9ad25593_0] Write session: Do CDS request
2025-09-30T14:51:13.982666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c80e02ec-9e766ba0-6d981057-9ad25593_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:13.988803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c80e02ec-9e766ba0-6d981057-9ad25593_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:13.988871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:13.988886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 347
2025-09-30T14:51:13.989088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 347 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:13.989121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 347 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:13.989126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=347 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:13.989130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:13.989556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 347 sessionId:  describe result for acl check
2025-09-30T14:51:13.989591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:13.989598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:13.989599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:13.989605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894902240194341:4525] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:13.990118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894902240194341:4525] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:13.992665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894902240194341:4525] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:13.994908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:13.995016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894902240194341:4525] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:13.995031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894902240194341:4525] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:13.995035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894902240194341:4525] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:13.995042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 347 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:13.997248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:13.997566Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:13.997577Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:13.997588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:13.997638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:13.997670Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894902150469138:3928]
2025-09-30T14:51:13.998224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:13.998504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:13.998544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:13.998849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:13.998902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:13.998908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:13.998910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:13.998911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:13.998912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:13.998913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:13.998915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:13.998916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:13.998917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:13.998918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:13.998919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.998921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.998922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.998923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:13.998924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:13.998929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:13.998939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:13.998943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:13.998948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:13.998952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:13.998956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:13.998960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:13.998964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:13.998968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:13.998973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:13.998977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.998981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.998985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.998989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:13.998993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:13.998999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:13.999012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:13.999023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:13.999033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:13.999044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:13.999054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:13.999062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:13.999071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:13.999075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:13.999081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:13.999085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:13.999090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:13.999095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:13.999100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:13.999105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:13.999110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:13.999115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:13.999120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:13.999125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:13.999130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:13.999135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.999141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:13.999149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.999154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:13.999162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.999168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:13.999176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:13.999181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:13.999186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:13.999191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:13.999260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:14.004660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:14.005740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:14.005757Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:14.005759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:14.005763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:14.005769Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 346 [2:7555894902150469138:3928]
2025-09-30T14:51:14.005786Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:14.005803Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:14.005811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.005814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.005817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.005835Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:14.005841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:14.005848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:14.005913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.005927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.005930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.005933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:14.005936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:14.006005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:14.006012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.006025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.006041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.006063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:14.006086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894902240194481:4525], now have 1 active actors on pipe
2025-09-30T14:51:14.006095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894902240194311:2454], now have 1 active actors on pipe
2025-09-30T14:51:14.006101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894902150469132:3928]
2025-09-30T14:51:14.006104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894902150469132:3928]
2025-09-30T14:51:14.006106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894902150469132:3928]
2025-09-30T14:51:14.006119Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:14.006134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:14.006133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:14.006137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:14.006140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:14.006153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:14.006156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:14.006192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894902150469132:3928]
2025-09-30T14:51:14.006202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:14.006177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 346
2025-09-30T14:51:14.006211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:14.006186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 346
2025-09-30T14:51:14.006243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:14.006252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:14.006285Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42614158-5ede28c3-b582faa7-3f5c3f33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:14.006297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.006301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.006308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:14.006319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.006332Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:14.006349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:14.006492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:14.006500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:14.006514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:14.006603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 347 partition: 0 MaxSeqNo: 42 sessionId: src_id|42614158-5ede28c3-b582faa7-3f5c3f33_0
2025-09-30T14:51:14.007064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c80e02ec-9e766ba0-6d981057-9ad25593_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|42614158-5ede28c3-b582faa7-3f5c3f33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:14.009823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42614158-5ede28c3-b582faa7-3f5c3f33_0] Write session: try to update token
2025-09-30T14:51:14.009841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42614158-5ede28c3-b582faa7-3f5c3f33_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:14.018776Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:14.018801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:14.018803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:14.018806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:14.018817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894902150469132:3928]
2025-09-30T14:51:14.018827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894902150469132:3928]
2025-09-30T14:51:14.018832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894902150469132:3928]
2025-09-30T14:51:14.018881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:14.018880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:14.018887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:14.018888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.018891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:14.018891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:14.019050Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:14.025854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 347 sessionId: src_id|42614158-5ede28c3-b582faa7-3f5c3f33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:14.028508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:14.082488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894906535161793:4267]
2025-09-30T14:51:14.082803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 346, pipe: [1:7555894906535161793:4267]
2025-09-30T14:51:14.133251Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:14.133618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:14.133632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:14.133653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894906535161793:4267], now have 1 active actors on pipe
2025-09-30T14:51:14.133864Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:14.133948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:14.133963Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:14.133964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:14.134010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894906535161793:4267]
2025-09-30T14:51:14.134028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 347 reason: error at write: Disconnected sessionId: src_id|42614158-5ede28c3-b582faa7-3f5c3f33_0
2025-09-30T14:51:14.134253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 347 sessionId: src_id|42614158-5ede28c3-b582faa7-3f5c3f33_0 is DEAD
2025-09-30T14:51:14.134441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42614158-5ede28c3-b582faa7-3f5c3f33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:14.134448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42614158-5ede28c3-b582faa7-3f5c3f33_0] Write session will restart in 0.005116s
2025-09-30T14:51:14.134471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42614158-5ede28c3-b582faa7-3f5c3f33_0] Write session: Do CDS request
2025-09-30T14:51:14.134477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42614158-5ede28c3-b582faa7-3f5c3f33_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:14.140802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42614158-5ede28c3-b582faa7-3f5c3f33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:14.140919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:14.140933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 348
2025-09-30T14:51:14.141105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 348 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:14.141159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 348 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:14.141172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=348 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:14.141178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:14.141631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 348 sessionId:  describe result for acl check
2025-09-30T14:51:14.141664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:14.141666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:14.141668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:14.141675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894906535161815:4529] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:14.142227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894906535161815:4529] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:14.144745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894906535161815:4529] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:14.147544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894906535161815:4529] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:14.147560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894906535161815:4529] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:14.147566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894906535161815:4529] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:14.147576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 348 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:14.148574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:14.151015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:14.151269Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:14.151279Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:14.151292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:14.151364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:14.151419Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894906445436611:3931]
2025-09-30T14:51:14.152060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:14.152468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:14.152544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:14.152946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:14.153011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:14.153018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:14.153019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:14.153020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:14.153022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:14.153024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:14.153025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:14.153027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:14.153028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:14.153030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:14.153031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.153033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.153034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.153035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:14.153037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:14.153044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:14.153055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:14.153060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:14.153065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:14.153070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:14.153075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:14.153080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:14.153085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:14.153090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:14.153095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:14.153100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.153105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.153110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.153115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:14.153120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:14.153129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:14.153138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:14.153146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:14.153152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:14.153160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:14.153171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:14.153176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:14.153182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:14.153193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:14.153199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:14.153209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:14.153215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:14.153226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:14.153233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:14.153238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:14.153245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:14.153255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:14.153263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:14.153272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:14.153279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:14.153285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.153291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.153296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.153302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.153312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.153318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.153328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:14.153334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:14.153344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:14.153349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:14.153400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:14.159456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:14.160627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:14.160647Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:14.160649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:14.160654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:14.160661Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 347 [2:7555894906445436611:3931]
2025-09-30T14:51:14.160681Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:14.160697Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:14.160701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.160704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.160706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.160725Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:14.160738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:14.160745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:14.160810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.160818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.160821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.160825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:14.160828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:14.160898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:14.160906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.160921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.160937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.160961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:14.160985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894906535161794:2454], now have 1 active actors on pipe
2025-09-30T14:51:14.160993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894906535161963:4529], now have 1 active actors on pipe
2025-09-30T14:51:14.161000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894906445436606:3931]
2025-09-30T14:51:14.161003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894906445436606:3931]
2025-09-30T14:51:14.161006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894906445436606:3931]
2025-09-30T14:51:14.161024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:14.161046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:14.161067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:14.161070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:14.161076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:14.161074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:14.161098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:14.161056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 347
2025-09-30T14:51:14.161057Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 347
2025-09-30T14:51:14.161115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894906445436606:3931]
2025-09-30T14:51:14.161123Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:14.161141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:14.161168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:14.161178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:14.161204Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1da11818-2a2bf2ff-dc6648f0-66001ede_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:14.161217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.161225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.161227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:14.161237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.161247Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:14.161261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:14.161474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:14.161483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:14.161497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:14.161645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 348 partition: 0 MaxSeqNo: 42 sessionId: src_id|1da11818-2a2bf2ff-dc6648f0-66001ede_0
2025-09-30T14:51:14.162061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42614158-5ede28c3-b582faa7-3f5c3f33_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1da11818-2a2bf2ff-dc6648f0-66001ede_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:14.164938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1da11818-2a2bf2ff-dc6648f0-66001ede_0] Write session: try to update token
2025-09-30T14:51:14.164959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1da11818-2a2bf2ff-dc6648f0-66001ede_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:14.173764Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:14.173787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:14.173790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:14.173792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:14.173801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894906445436606:3931]
2025-09-30T14:51:14.173806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894906445436606:3931]
2025-09-30T14:51:14.173810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894906445436606:3931]
2025-09-30T14:51:14.173855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:14.173858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:14.173863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.173865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:14.173870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:14.173870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:14.174033Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:14.180273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 348 sessionId: src_id|1da11818-2a2bf2ff-dc6648f0-66001ede_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:14.183096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:14.234074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894906535161978:4267]
2025-09-30T14:51:14.234378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 347, pipe: [1:7555894906535161978:4267]
2025-09-30T14:51:14.295444Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:14.295815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:14.295829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:14.295849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894906535161978:4267], now have 1 active actors on pipe
2025-09-30T14:51:14.296103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894906535161978:4267]
2025-09-30T14:51:14.296341Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:14.296359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:14.296419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:14.296498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 348 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1da11818-2a2bf2ff-dc6648f0-66001ede_0
2025-09-30T14:51:14.296717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 348 sessionId: src_id|1da11818-2a2bf2ff-dc6648f0-66001ede_0 is DEAD
2025-09-30T14:51:14.296863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1da11818-2a2bf2ff-dc6648f0-66001ede_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:14.296872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1da11818-2a2bf2ff-dc6648f0-66001ede_0] Write session will restart in 0.009998s
2025-09-30T14:51:14.296892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1da11818-2a2bf2ff-dc6648f0-66001ede_0] Write session: Do CDS request
2025-09-30T14:51:14.296897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1da11818-2a2bf2ff-dc6648f0-66001ede_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:14.307774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1da11818-2a2bf2ff-dc6648f0-66001ede_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:14.307936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:14.307955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 349
2025-09-30T14:51:14.308093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 349 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:14.308128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 349 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:14.308139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=349 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:14.308148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:14.308567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 349 sessionId:  describe result for acl check
2025-09-30T14:51:14.308606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:14.308612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:14.308614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:14.308621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894906535162117:4533] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:14.309070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:14.309190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894906535162117:4533] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:14.311061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:14.311307Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:14.311320Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:14.311333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:14.311349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894906535162117:4533] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:14.311410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:14.311466Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894906445436787:3933]
2025-09-30T14:51:14.312131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:14.312432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:14.312485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:14.312826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:14.312898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:14.312905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:14.312906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:14.312907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:14.312909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:14.312910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:14.312911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:14.312913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:14.312914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:14.312916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:14.312917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.312918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.312920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.312921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:14.312922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:14.312929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:14.312940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:14.312945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:14.312949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:14.312954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:14.312959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:14.312965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:14.312970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:14.312974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:14.312980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:14.312985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.312989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.312994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.312998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:14.313003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:14.313012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:14.313026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:14.313037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:14.313044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:14.313054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:14.313061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:14.313070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:14.313076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:14.313087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:14.313094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:14.313103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:14.313109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:14.313119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:14.313125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:14.313134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:14.313140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:14.313145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:14.313151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:14.313158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:14.313169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:14.313174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.313180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.313184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.313189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.313194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.313204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.313209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:14.313219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:14.313223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:14.313233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:14.313281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:14.314103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894906535162117:4533] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:14.314119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894906535162117:4533] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:14.314123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894906535162117:4533] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:14.314130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 349 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:14.318778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:14.319881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:14.319895Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:14.319897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:14.319901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:14.319907Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 348 [2:7555894906445436787:3933]
2025-09-30T14:51:14.319924Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:14.319945Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:14.319948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.319951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.319953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.319969Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:14.319980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:14.319988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:14.320057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.320064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.320066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.320070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:14.320072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:14.320137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:14.320145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.320157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.320168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.320187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:14.320209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894906535161979:2454], now have 1 active actors on pipe
2025-09-30T14:51:14.320217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894906535162156:4533], now have 1 active actors on pipe
2025-09-30T14:51:14.320223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894906445436782:3933]
2025-09-30T14:51:14.320226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894906445436782:3933]
2025-09-30T14:51:14.320229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894906445436782:3933]
2025-09-30T14:51:14.320242Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:14.320255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:14.320268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:14.320274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:14.320276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:14.320278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:14.320279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:14.320284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 348
2025-09-30T14:51:14.320310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894906445436782:3933]
2025-09-30T14:51:14.320288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 348
2025-09-30T14:51:14.320321Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:14.320323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:14.320349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:14.320358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:14.320389Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc2c1ae7-e2eb2492-ee9e9994-2d5cd03_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:14.320400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.320405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.320407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:14.320417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.320430Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:14.320455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:14.320585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:14.320592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:14.320605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:14.320716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 349 partition: 0 MaxSeqNo: 42 sessionId: src_id|fc2c1ae7-e2eb2492-ee9e9994-2d5cd03_0
2025-09-30T14:51:14.321098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1da11818-2a2bf2ff-dc6648f0-66001ede_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fc2c1ae7-e2eb2492-ee9e9994-2d5cd03_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:14.324067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc2c1ae7-e2eb2492-ee9e9994-2d5cd03_0] Write session: try to update token
2025-09-30T14:51:14.324090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc2c1ae7-e2eb2492-ee9e9994-2d5cd03_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:14.332516Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:14.332531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:14.332533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:14.332535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:14.332546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894906445436782:3933]
2025-09-30T14:51:14.332550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894906445436782:3933]
2025-09-30T14:51:14.332554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894906445436782:3933]
2025-09-30T14:51:14.332590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:14.332592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:14.332595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:14.332599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:14.332599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.332602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:14.332741Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:14.339442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 349 sessionId: src_id|fc2c1ae7-e2eb2492-ee9e9994-2d5cd03_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:14.342212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:14.396367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894906535162164:4267]
2025-09-30T14:51:14.396669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 348, pipe: [1:7555894906535162164:4267]
2025-09-30T14:51:14.441105Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:14.441506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:14.441522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:14.441544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894906535162164:4267], now have 1 active actors on pipe
2025-09-30T14:51:14.441781Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:14.441814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894906535162164:4267]
2025-09-30T14:51:14.441829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:14.441832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:14.441894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 349 reason: error at write: Disconnected sessionId: src_id|fc2c1ae7-e2eb2492-ee9e9994-2d5cd03_0
2025-09-30T14:51:14.441939Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:14.442092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 349 sessionId: src_id|fc2c1ae7-e2eb2492-ee9e9994-2d5cd03_0 is DEAD
2025-09-30T14:51:14.442245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc2c1ae7-e2eb2492-ee9e9994-2d5cd03_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:14.442255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc2c1ae7-e2eb2492-ee9e9994-2d5cd03_0] Write session will restart in 0.006286s
2025-09-30T14:51:14.442277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc2c1ae7-e2eb2492-ee9e9994-2d5cd03_0] Write session: Do CDS request
2025-09-30T14:51:14.442282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc2c1ae7-e2eb2492-ee9e9994-2d5cd03_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:14.449768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc2c1ae7-e2eb2492-ee9e9994-2d5cd03_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:14.449883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:14.449900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 350
2025-09-30T14:51:14.450014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 350 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:14.450044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 350 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:14.450052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=350 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:14.450055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:14.450484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 350 sessionId:  describe result for acl check
2025-09-30T14:51:14.450516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:14.450522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:14.450524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:14.450530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894906535162199:4538] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:14.451081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894906535162199:4538] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:14.452987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894906535162199:4538] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:14.455536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894906535162199:4538] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:14.455549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894906535162199:4538] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:14.455552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894906535162199:4538] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:14.455560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 350 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:14.455688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:14.457704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:14.457890Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:14.457899Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:14.457909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:14.457963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:14.458002Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894906445436966:3935]
2025-09-30T14:51:14.458659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:14.458949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:14.458987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:14.459329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:14.459389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:14.459395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:14.459397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:14.459398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:14.459399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:14.459400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:14.459401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:14.459403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:14.459404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:14.459405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:14.459407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.459408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.459409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.459410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:14.459411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:14.459416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:14.459426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:14.459431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:14.459435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:14.459439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:14.459444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:14.459448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:14.459452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:14.459456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:14.459461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:14.459465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.459472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.459476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.459480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:14.459488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:14.459496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:14.459508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:14.459515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:14.459525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:14.459530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:14.459539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:14.459544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:14.459549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:14.459557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:14.459563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:14.459571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:14.459576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:14.459581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:14.459588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:14.459593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:14.459600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:14.459609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:14.459615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:14.459620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:14.459626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:14.459635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.459641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.459645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.459652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.459657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.459662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.459670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:14.459676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:14.459684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:14.459689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:14.459734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:14.465166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:14.466143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:14.466159Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:14.466162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:14.466167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:14.466174Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 349 [2:7555894906445436966:3935]
2025-09-30T14:51:14.466189Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:14.466206Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:14.466214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.466217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.466220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.466235Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:14.466246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:14.466254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:14.466306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.466314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.466317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.466322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:14.466326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:14.466393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:14.466400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.466412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.466425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.466452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:14.466471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894906535162340:4538], now have 1 active actors on pipe
2025-09-30T14:51:14.466474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894906535162165:2454], now have 1 active actors on pipe
2025-09-30T14:51:14.466481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894906445436960:3935]
2025-09-30T14:51:14.466484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894906445436960:3935]
2025-09-30T14:51:14.466486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894906445436960:3935]
2025-09-30T14:51:14.466498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:14.466512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:14.466528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:14.466531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:14.466535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:14.466538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:14.466540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:14.466575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894906445436960:3935]
2025-09-30T14:51:14.466584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:14.466586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:14.466609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:14.466582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 349
2025-09-30T14:51:14.466613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:14.466620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 349
2025-09-30T14:51:14.466720Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|478c44e7-2c707c8e-5d01041e-5acec586_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:14.466734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.466737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.466739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:14.466749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.466758Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:14.466794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:14.466974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:14.466986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:14.466999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:14.467111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 350 partition: 0 MaxSeqNo: 42 sessionId: src_id|478c44e7-2c707c8e-5d01041e-5acec586_0
2025-09-30T14:51:14.467468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc2c1ae7-e2eb2492-ee9e9994-2d5cd03_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|478c44e7-2c707c8e-5d01041e-5acec586_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:14.472240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|478c44e7-2c707c8e-5d01041e-5acec586_0] Write session: try to update token
2025-09-30T14:51:14.472264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|478c44e7-2c707c8e-5d01041e-5acec586_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:14.478825Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:14.478843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:14.478848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:14.478850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:14.478861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894906445436960:3935]
2025-09-30T14:51:14.478864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894906445436960:3935]
2025-09-30T14:51:14.478868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894906445436960:3935]
2025-09-30T14:51:14.478905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:14.478911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.478912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:14.478914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:14.478919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:14.478922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:14.479053Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:14.487373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 350 sessionId: src_id|478c44e7-2c707c8e-5d01041e-5acec586_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:14.490011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:14.541684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894906535162375:4267]
2025-09-30T14:51:14.541910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 349, pipe: [1:7555894906535162375:4267]
2025-09-30T14:51:14.594081Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:14.594475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:14.594491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:14.594512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894906535162375:4267], now have 1 active actors on pipe
2025-09-30T14:51:14.594710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:14.594720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894906535162375:4267]
2025-09-30T14:51:14.594748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:14.594751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:14.594825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 350 reason: error at write: Disconnected sessionId: src_id|478c44e7-2c707c8e-5d01041e-5acec586_0
2025-09-30T14:51:14.595034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 350 sessionId: src_id|478c44e7-2c707c8e-5d01041e-5acec586_0 is DEAD
2025-09-30T14:51:14.595037Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:14.595202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|478c44e7-2c707c8e-5d01041e-5acec586_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:14.595215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|478c44e7-2c707c8e-5d01041e-5acec586_0] Write session will restart in 0.008609s
2025-09-30T14:51:14.595260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|478c44e7-2c707c8e-5d01041e-5acec586_0] Write session: Do CDS request
2025-09-30T14:51:14.595269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|478c44e7-2c707c8e-5d01041e-5acec586_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:14.604796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|478c44e7-2c707c8e-5d01041e-5acec586_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:14.604926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:14.604938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 351
2025-09-30T14:51:14.605468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 351 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:14.605506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 351 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:14.605516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=351 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:14.605520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:14.605953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 351 sessionId:  describe result for acl check
2025-09-30T14:51:14.606000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:14.606003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:14.606004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:14.606010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894906535162513:4549] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:14.606658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894906535162513:4549] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:14.607588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:14.608931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894906535162513:4549] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:14.609633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:14.609841Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:14.609850Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:14.609861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:14.609909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:14.609944Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894906445437181:3950]
2025-09-30T14:51:14.610646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:14.610903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:14.610944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:14.611280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:14.611337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:14.611343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:14.611344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:14.611345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:14.611346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:14.611348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:14.611349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:14.611350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:14.611351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:14.611352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:14.611353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.611354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.611355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.611357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:14.611358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:14.611362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:14.611371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:14.611376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:14.611380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:14.611384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:14.611389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:14.611393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:14.611397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:14.611402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:14.611406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:14.611410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.611414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.611418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.611422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:14.611427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:14.611433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:14.611442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:14.611448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:14.611453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:14.611457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:14.611462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:14.611466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:14.611471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:14.611475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:14.611482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:14.611491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:14.611496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:14.611502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:14.611512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:14.611516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:14.611521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:14.611526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:14.611536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:14.611542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:14.611548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:14.611553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.611564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.611569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.611574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.611583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.611589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.611598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:14.611604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:14.611608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:14.611616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:14.611606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894906535162513:4549] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:14.611620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894906535162513:4549] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:14.611625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894906535162513:4549] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:14.611633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 351 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:14.611660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:14.617230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:14.618394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:14.618413Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:14.618416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:14.618420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:14.618428Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 350 [2:7555894906445437181:3950]
2025-09-30T14:51:14.618445Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:14.618462Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:14.618465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.618468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.618471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.618488Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:14.618501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:14.618510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:14.618586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.618594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.618597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.618601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:14.618604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:14.618672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:14.618682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.618695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.618709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.618727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:14.618746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894906535162553:4549], now have 1 active actors on pipe
2025-09-30T14:51:14.618752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894906445437176:3950]
2025-09-30T14:51:14.618754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894906445437176:3950]
2025-09-30T14:51:14.618756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894906445437176:3950]
2025-09-30T14:51:14.618769Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:14.618783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894906535162376:2454], now have 1 active actors on pipe
2025-09-30T14:51:14.618784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:14.618788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:14.618790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:14.618797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:14.618814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:14.618823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:14.618860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894906445437176:3950]
2025-09-30T14:51:14.618872Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:14.618881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:14.618857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 350
2025-09-30T14:51:14.618861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 350
2025-09-30T14:51:14.618938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:14.618948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:14.618970Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d90cd14-6d672859-c9f47e97-ca577788_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:14.618982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.618990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.618993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:14.619003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.619012Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:14.619026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:14.619159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:14.619166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:14.619179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:14.619307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 351 partition: 0 MaxSeqNo: 42 sessionId: src_id|1d90cd14-6d672859-c9f47e97-ca577788_0
2025-09-30T14:51:14.619730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|478c44e7-2c707c8e-5d01041e-5acec586_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1d90cd14-6d672859-c9f47e97-ca577788_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:14.622616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d90cd14-6d672859-c9f47e97-ca577788_0] Write session: try to update token
2025-09-30T14:51:14.622638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d90cd14-6d672859-c9f47e97-ca577788_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:14.630850Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:14.630867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:14.630876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894906445437176:3950]
2025-09-30T14:51:14.630919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:14.630919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:14.631083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:14.631230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:14.631392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:14.631538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:14.631757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:14.631801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:14.638224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 351 sessionId: src_id|1d90cd14-6d672859-c9f47e97-ca577788_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:14.640965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:14.641783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:14.641807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:14.641825Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:14.641828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:14.641831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:14.641833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:14.641841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894906445437176:3950]
2025-09-30T14:51:14.641846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894906445437176:3950]
2025-09-30T14:51:14.641850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894906445437176:3950]
2025-09-30T14:51:14.641895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:14.641897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:14.641904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.641907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:14.641907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:14.641911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:14.642036Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:14.694855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894906535162562:4267]
2025-09-30T14:51:14.695062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 350, pipe: [1:7555894906535162562:4267]
2025-09-30T14:51:14.756270Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:14.756643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:14.756675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894906535162562:4267], now have 1 active actors on pipe
2025-09-30T14:51:14.756793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:14.756858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894906535162562:4267]
2025-09-30T14:51:14.756885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:14.756885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:14.756889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:14.756954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 351 reason: error at write: Disconnected sessionId: src_id|1d90cd14-6d672859-c9f47e97-ca577788_0
2025-09-30T14:51:14.757140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 351 sessionId: src_id|1d90cd14-6d672859-c9f47e97-ca577788_0 is DEAD
2025-09-30T14:51:14.757586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d90cd14-6d672859-c9f47e97-ca577788_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:14.757598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d90cd14-6d672859-c9f47e97-ca577788_0] Write session will restart in 0.008391s
2025-09-30T14:51:14.757622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d90cd14-6d672859-c9f47e97-ca577788_0] Write session: Do CDS request
2025-09-30T14:51:14.757628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d90cd14-6d672859-c9f47e97-ca577788_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:14.766840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d90cd14-6d672859-c9f47e97-ca577788_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:14.766948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:14.766966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 352
2025-09-30T14:51:14.767104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 352 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:14.767139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 352 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:14.767144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=352 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:14.767148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:14.767640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 352 sessionId:  describe result for acl check
2025-09-30T14:51:14.767673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:14.767676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:14.767678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:14.767684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894906535162672:4553] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:14.768196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894906535162672:4553] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:14.770062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:14.770352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894906535162672:4553] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:14.772168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:14.772352Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:14.772363Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:14.772374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:14.772429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:14.772473Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894906445437372:3953]
2025-09-30T14:51:14.772736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894906535162672:4553] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:14.772754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894906535162672:4553] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:14.772758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894906535162672:4553] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:14.772767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 352 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:14.773123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:14.773361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:14.773407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:14.773727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:14.773795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:14.773802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:14.773804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:14.773804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:14.773806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:14.773807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:14.773808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:14.773809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:14.773811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:14.773812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:14.773813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.773814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.773815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.773816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:14.773818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:14.773823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:14.773832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:14.773837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:14.773840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:14.773844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:14.773847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:14.773851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:14.773855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:14.773860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:14.773865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:14.773868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.773872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.773877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.773880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:14.773884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:14.773891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:14.773898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:14.773904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:14.773910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:14.773914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:14.773918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:14.773923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:14.773928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:14.773933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:14.773944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:14.773948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:14.773953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:14.773958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:14.773963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:14.773967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:14.773972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:14.773977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:14.773983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:14.773992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:14.773999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:14.774003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.774011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.774015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.774021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.774030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.774035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.774039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:14.774045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:14.774049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:14.774055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:14.774095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:14.779425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:14.780258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:14.780269Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:14.780271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:14.780276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:14.780283Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 351 [2:7555894906445437372:3953]
2025-09-30T14:51:14.780300Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:14.780318Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:14.780320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.780323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.780326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.780341Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:14.780354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:14.780361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:14.780426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.780435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.780437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.780440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:14.780443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:14.780657Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 351
2025-09-30T14:51:14.780661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 351
2025-09-30T14:51:14.780735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:14.780744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.780758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.780770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.780795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:14.780821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894906535162740:4553], now have 1 active actors on pipe
2025-09-30T14:51:14.780830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894906535162564:2454], now have 1 active actors on pipe
2025-09-30T14:51:14.780849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:14.780859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:14.780875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894906445437367:3953]
2025-09-30T14:51:14.780882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894906445437367:3953]
2025-09-30T14:51:14.780885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894906445437367:3953]
2025-09-30T14:51:14.780899Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:14.780919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:14.780931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:14.780940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:14.780942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:14.780942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:14.780945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:14.780963Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fabeaf6-b3e56e7f-5cd9bc09-5ec64207_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:14.780970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.780974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.780976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:14.780986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.781002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:14.781044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894906445437367:3953]
2025-09-30T14:51:14.781058Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:14.781073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:14.781085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:14.781282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:14.781291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:14.781307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:14.781427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 352 partition: 0 MaxSeqNo: 42 sessionId: src_id|fabeaf6-b3e56e7f-5cd9bc09-5ec64207_0
2025-09-30T14:51:14.781828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d90cd14-6d672859-c9f47e97-ca577788_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fabeaf6-b3e56e7f-5cd9bc09-5ec64207_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:14.784717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fabeaf6-b3e56e7f-5cd9bc09-5ec64207_0] Write session: try to update token
2025-09-30T14:51:14.784740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fabeaf6-b3e56e7f-5cd9bc09-5ec64207_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:14.792628Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:14.792647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:14.792657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894906445437367:3953]
2025-09-30T14:51:14.792701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:14.792704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:14.792871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:14.793014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:14.793145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:14.793281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:14.793470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:14.793513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:14.799199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 352 sessionId: src_id|fabeaf6-b3e56e7f-5cd9bc09-5ec64207_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:14.802046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:14.803272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:14.803293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:14.803312Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:14.803315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:14.803318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:14.803320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:14.803328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894906445437367:3953]
2025-09-30T14:51:14.803333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894906445437367:3953]
2025-09-30T14:51:14.803337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894906445437367:3953]
2025-09-30T14:51:14.803378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:14.803383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:14.803389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.803391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:14.803392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:14.803395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:14.803520Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:14.857152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894906535162763:4267]
2025-09-30T14:51:14.857431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 351, pipe: [1:7555894906535162763:4267]
2025-09-30T14:51:14.923784Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:14.924064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:14.924100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894906535162763:4267], now have 1 active actors on pipe
2025-09-30T14:51:14.924213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:14.924289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:14.924330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:14.924337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:14.924342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894906535162763:4267]
2025-09-30T14:51:14.924410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 352 reason: error at write: Disconnected sessionId: src_id|fabeaf6-b3e56e7f-5cd9bc09-5ec64207_0
2025-09-30T14:51:14.924572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 352 sessionId: src_id|fabeaf6-b3e56e7f-5cd9bc09-5ec64207_0 is DEAD
2025-09-30T14:51:14.924728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fabeaf6-b3e56e7f-5cd9bc09-5ec64207_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:14.924740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fabeaf6-b3e56e7f-5cd9bc09-5ec64207_0] Write session will restart in 0.008912s
2025-09-30T14:51:14.924764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fabeaf6-b3e56e7f-5cd9bc09-5ec64207_0] Write session: Do CDS request
2025-09-30T14:51:14.924769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fabeaf6-b3e56e7f-5cd9bc09-5ec64207_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:14.934766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fabeaf6-b3e56e7f-5cd9bc09-5ec64207_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:14.934906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:14.934920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 353
2025-09-30T14:51:14.935063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 353 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:14.935106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 353 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:14.935116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=353 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:14.935121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:14.935574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 353 sessionId:  describe result for acl check
2025-09-30T14:51:14.935605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:14.935611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:14.935613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:14.935618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894906535162905:4558] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:14.936140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894906535162905:4558] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:14.936129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:14.938310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:14.938512Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:14.938524Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:14.938536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:14.938579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894906535162905:4558] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:14.938607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:14.938644Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894906445437552:3955]
2025-09-30T14:51:14.939237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:14.939511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:14.939542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:14.939759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:14.939813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:14.939819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:14.939820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:14.939821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:14.939822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:14.939823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:14.939823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:14.939824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:14.939825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:14.939826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:14.939826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.939827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.939828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.939829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:14.939829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:14.939833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:14.939839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:14.939842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:14.939844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:14.939847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:14.939849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:14.939851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:14.939853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:14.939856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:14.939859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:14.939861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.939863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.939865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.939868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:14.939870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:14.939875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:14.939880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:14.939884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:14.939888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:14.939891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:14.939895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:14.939897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:14.939900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:14.939903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:14.939906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:14.939909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:14.939912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:14.939916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:14.939919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:14.939922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:14.939925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:14.939928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:14.939932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:14.939934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:14.939938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:14.939940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.939943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.939947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.939950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.939953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.939956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.939958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:14.939961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:14.939963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:14.939967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:14.939989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:14.945236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894906535162905:4558] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:14.945254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894906535162905:4558] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:14.945258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894906535162905:4558] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:14.945266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 353 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:14.945498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:14.946529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:14.946541Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:14.946543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:14.946545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:14.946549Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 352 [2:7555894906445437552:3955]
2025-09-30T14:51:14.946572Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:14.946583Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:14.946584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.946587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.946588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.946597Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:14.946601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:14.946606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:14.946655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.946663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.946666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.946668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:14.946671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:14.946726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:14.946734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.946741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:14.946748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:14.946757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:14.946770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894906445437546:3955]
2025-09-30T14:51:14.946772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894906445437546:3955]
2025-09-30T14:51:14.946774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894906445437546:3955]
2025-09-30T14:51:14.946780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:14.946791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:14.946794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894906535162947:4558], now have 1 active actors on pipe
2025-09-30T14:51:14.946794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:14.946796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:14.946800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894906535162765:2454], now have 1 active actors on pipe
2025-09-30T14:51:14.946805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:14.946819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:14.946827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:14.946853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894906445437546:3955]
2025-09-30T14:51:14.946862Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:14.946880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:14.946886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 352
2025-09-30T14:51:14.946884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 352
2025-09-30T14:51:14.946943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:14.946953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:14.946982Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b10635d5-76964ac0-14bb4612-2357fef7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:14.946996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.946999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.947001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:14.947009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.947017Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:14.947030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:14.947196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:14.947203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:14.947216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:14.947324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 353 partition: 0 MaxSeqNo: 42 sessionId: src_id|b10635d5-76964ac0-14bb4612-2357fef7_0
2025-09-30T14:51:14.947729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fabeaf6-b3e56e7f-5cd9bc09-5ec64207_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b10635d5-76964ac0-14bb4612-2357fef7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:14.950326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b10635d5-76964ac0-14bb4612-2357fef7_0] Write session: try to update token
2025-09-30T14:51:14.950342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b10635d5-76964ac0-14bb4612-2357fef7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:14.958787Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:14.958806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:14.958816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894906445437546:3955]
2025-09-30T14:51:14.958864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:14.958877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:14.959026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:14.959163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:14.959318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:14.959454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:14.959645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:14.959686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:14.964397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 353 sessionId: src_id|b10635d5-76964ac0-14bb4612-2357fef7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:14.967125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:14.967330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:14.967350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:14.967385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:14.967473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:14.969753Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:14.969771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:14.969775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:14.969777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:14.969787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894906445437546:3955]
2025-09-30T14:51:14.969791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894906445437546:3955]
2025-09-30T14:51:14.969796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894906445437546:3955]
2025-09-30T14:51:14.969837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:14.969842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:14.969845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:14.969848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:14.969848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:14.969851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:14.970033Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:15.024596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894910830130259:4267]
2025-09-30T14:51:15.024893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 352, pipe: [1:7555894910830130259:4267]
2025-09-30T14:51:15.079949Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:15.087390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:15.087414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:15.087574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:15.087640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:15.087707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:15.087766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:15.087977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:15.087987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:15.088050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:15.088108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:15.088168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:15.088310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:15.088353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:15.088365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:15.088435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:15.088489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:15.088547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:15.088620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:15.088668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:15.088674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:15.088739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:15.088798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:15.088856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:15.088925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:15.088969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:15.088976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:15.089040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:15.089095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:15.089160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:15.089220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:15.089259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:15.089265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:15.089324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:15.089382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:15.089442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:15.089502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:15.089543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:15.089548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:15.089611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:15.089675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:15.089733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:15.089793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:15.089834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:15.089841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:15.089920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:15.089986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:15.090046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:15.090107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:15.090215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:15.090225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:15.090283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:15.090334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:15.090394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:15.090459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:15.090501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:15.090507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:15.090580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:15.090634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:15.090700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:15.090756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:15.090795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:15.090801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:15.090857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894910830130259:4267], now have 1 active actors on pipe
2025-09-30T14:51:15.091099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:15.091115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:15.091116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:15.091147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 353 reason: error at write: Disconnected sessionId: src_id|b10635d5-76964ac0-14bb4612-2357fef7_0
2025-09-30T14:51:15.091161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894910830130259:4267]
2025-09-30T14:51:15.091203Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:15.091388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 353 sessionId: src_id|b10635d5-76964ac0-14bb4612-2357fef7_0 is DEAD
2025-09-30T14:51:15.091520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b10635d5-76964ac0-14bb4612-2357fef7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:15.091531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b10635d5-76964ac0-14bb4612-2357fef7_0] Write session will restart in 0.008623s
2025-09-30T14:51:15.091548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b10635d5-76964ac0-14bb4612-2357fef7_0] Write session: Do CDS request
2025-09-30T14:51:15.091553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b10635d5-76964ac0-14bb4612-2357fef7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:15.101795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b10635d5-76964ac0-14bb4612-2357fef7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:15.102002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:15.102017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 354
2025-09-30T14:51:15.102142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 354 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:15.102177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 354 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:15.102186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=354 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:15.102191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:15.102695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 354 sessionId:  describe result for acl check
2025-09-30T14:51:15.102733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:15.102740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:15.102742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:15.102749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894910830130397:4564] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:15.103301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894910830130397:4564] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:15.104538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:15.105440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894910830130397:4564] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:15.106976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:15.107145Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:15.107152Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:15.107160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:15.107206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:15.107237Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894910740405031:3958]
2025-09-30T14:51:15.107736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:15.107967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:15.108000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:15.108091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894910830130397:4564] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:15.108107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894910830130397:4564] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:15.108111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894910830130397:4564] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:15.108120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 354 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:15.108231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:15.108276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:15.108281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:15.108281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:15.108282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:15.108283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:15.108284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:15.108284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:15.108285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:15.108286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:15.108287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:15.108287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.108288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.108289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.108289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:15.108290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:15.108294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:15.108300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:15.108303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:15.108305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:15.108307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:15.108310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:15.108312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:15.108314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:15.108317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:15.108319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:15.108321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.108324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.108326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.108328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:15.108330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:15.108335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:15.108340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:15.108344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:15.108347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:15.108350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:15.108353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:15.108355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:15.108358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:15.108361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:15.108364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:15.108366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:15.108369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:15.108372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:15.108375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:15.108378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:15.108381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:15.108385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:15.108387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:15.108390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:15.108393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:15.108395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.108398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.108401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.108404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.108407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.108410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.108412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:15.108415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:15.108418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:15.108421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:15.108443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:15.113903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:15.115073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:15.115090Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:15.115093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:15.115097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:15.115104Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 353 [2:7555894910740405031:3958]
2025-09-30T14:51:15.115122Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:15.115138Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:15.115141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:15.115145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:15.115147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:15.115165Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:15.115177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:15.115184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:15.115266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.115273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.115276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.115279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:15.115282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:15.115345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:15.115354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.115367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.115385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.115406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:15.115427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894910830130264:2454], now have 1 active actors on pipe
2025-09-30T14:51:15.115435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894910830130444:4564], now have 1 active actors on pipe
2025-09-30T14:51:15.115440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894910740405026:3958]
2025-09-30T14:51:15.115442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894910740405026:3958]
2025-09-30T14:51:15.115445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894910740405026:3958]
2025-09-30T14:51:15.115461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:15.115480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:15.115499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:15.115505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:15.115520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:15.115531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:15.115533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:15.115543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894910740405026:3958]
2025-09-30T14:51:15.115551Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:15.115509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 353
2025-09-30T14:51:15.115509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 353
2025-09-30T14:51:15.115560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:15.115610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:15.115618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:15.115644Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7dd2de73-fd5a1460-74c53ff3-fa4b4a76_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:15.115654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:15.115659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:15.115662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:15.115672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:15.115684Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:15.115699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:15.115876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:15.115885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:15.115899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:15.115979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 354 partition: 0 MaxSeqNo: 42 sessionId: src_id|7dd2de73-fd5a1460-74c53ff3-fa4b4a76_0
2025-09-30T14:51:15.116324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b10635d5-76964ac0-14bb4612-2357fef7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7dd2de73-fd5a1460-74c53ff3-fa4b4a76_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:15.119177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dd2de73-fd5a1460-74c53ff3-fa4b4a76_0] Write session: try to update token
2025-09-30T14:51:15.119198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dd2de73-fd5a1460-74c53ff3-fa4b4a76_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:15.127543Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:15.127559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:15.127573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894910740405026:3958]
2025-09-30T14:51:15.127621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:15.127629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:15.127808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:15.127955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:15.128104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:15.128250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:15.128478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:15.128518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:15.135110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 354 sessionId: src_id|7dd2de73-fd5a1460-74c53ff3-fa4b4a76_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:15.138029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:15.138787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:15.138813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:15.138832Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:15.138834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:15.138836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:15.138837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:15.138843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894910740405026:3958]
2025-09-30T14:51:15.138846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894910740405026:3958]
2025-09-30T14:51:15.138849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894910740405026:3958]
2025-09-30T14:51:15.138887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:15.138896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:15.138900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:15.138903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.138905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:15.138906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:15.139041Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:15.191467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894910830130453:4267]
2025-09-30T14:51:15.191716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 353, pipe: [1:7555894910830130453:4267]
2025-09-30T14:51:15.246514Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:15.246804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:15.246836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894910830130453:4267], now have 1 active actors on pipe
2025-09-30T14:51:15.246893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:15.247029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:15.247103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894910830130453:4267]
2025-09-30T14:51:15.257268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:15.257280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:15.257301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 354 reason: error at write: Disconnected sessionId: src_id|7dd2de73-fd5a1460-74c53ff3-fa4b4a76_0
2025-09-30T14:51:15.257498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 354 sessionId: src_id|7dd2de73-fd5a1460-74c53ff3-fa4b4a76_0 is DEAD
2025-09-30T14:51:15.257678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dd2de73-fd5a1460-74c53ff3-fa4b4a76_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:15.257689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dd2de73-fd5a1460-74c53ff3-fa4b4a76_0] Write session will restart in 0.008173s
2025-09-30T14:51:15.257711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dd2de73-fd5a1460-74c53ff3-fa4b4a76_0] Write session: Do CDS request
2025-09-30T14:51:15.257717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dd2de73-fd5a1460-74c53ff3-fa4b4a76_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:15.265946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:15.266842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dd2de73-fd5a1460-74c53ff3-fa4b4a76_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:15.266969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:15.266984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 355
2025-09-30T14:51:15.267109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 355 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:15.267149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 355 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:15.267159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=355 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:15.267164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:15.267603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 355 sessionId:  describe result for acl check
2025-09-30T14:51:15.267663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:15.267670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:15.267671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:15.267678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894910830130600:4568] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:15.268387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:15.268628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894910830130600:4568] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:15.268762Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:15.268770Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:15.268783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:15.268847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:15.268885Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894910740405213:3960]
2025-09-30T14:51:15.269525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:15.269848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:15.269909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:15.270293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:15.270352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:15.270357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:15.270358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:15.270359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:15.270359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:15.270361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:15.270362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:15.270362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:15.270363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:15.270364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:15.270364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.270365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.270366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.270366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:15.270367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:15.270371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:15.270377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:15.270379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:15.270382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:15.270384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:15.270387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:15.270389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:15.270391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:15.270393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:15.270396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:15.270398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.270401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.270403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.270405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:15.270407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:15.270413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:15.270418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:15.270421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:15.270425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:15.270428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:15.270433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:15.270435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:15.270440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:15.270444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:15.270447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:15.270450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:15.270453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:15.270455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:15.270458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:15.270460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:15.270463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:15.270467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:15.270470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:15.270473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:15.270476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:15.270479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.270482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.270484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.270487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.270490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.270493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.270495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:15.270498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:15.270501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:15.270503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:15.270526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:15.271090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894910830130600:4568] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:15.275872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894910830130600:4568] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:15.275888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894910830130600:4568] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:15.275892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894910830130600:4568] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:15.275901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 355 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:15.276260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:15.277307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:15.277324Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:15.277327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:15.277331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:15.277337Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 354 [2:7555894910740405213:3960]
2025-09-30T14:51:15.277349Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:15.277361Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:15.277363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:15.277366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:15.277368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:15.277380Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:15.277387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:15.277392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:15.277435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.277442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.277443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.277446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:15.277447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:15.277502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:15.277509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.277520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.277527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.277536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:15.277548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894910740405208:3960]
2025-09-30T14:51:15.277549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894910740405208:3960]
2025-09-30T14:51:15.277551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894910740405208:3960]
2025-09-30T14:51:15.277558Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:15.277573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894910830130638:4568], now have 1 active actors on pipe
2025-09-30T14:51:15.277578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:15.277586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:15.277592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:15.277595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:15.277596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:15.277598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:15.277626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894910830130455:2454], now have 1 active actors on pipe
2025-09-30T14:51:15.277637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894910740405208:3960]
2025-09-30T14:51:15.277643Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:15.277629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 354
2025-09-30T14:51:15.277657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:15.277657Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 354
2025-09-30T14:51:15.277675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:15.277684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:15.277713Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb54ad9d-9e547d6-1cdb2ab2-4fa579a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:15.277724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:15.277727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:15.277729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:15.277740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:15.277753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:15.277773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:15.277959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:15.277968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:15.277982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:15.278073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 355 partition: 0 MaxSeqNo: 42 sessionId: src_id|fb54ad9d-9e547d6-1cdb2ab2-4fa579a3_0
2025-09-30T14:51:15.278456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dd2de73-fd5a1460-74c53ff3-fa4b4a76_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fb54ad9d-9e547d6-1cdb2ab2-4fa579a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:15.281152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb54ad9d-9e547d6-1cdb2ab2-4fa579a3_0] Write session: try to update token
2025-09-30T14:51:15.281174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb54ad9d-9e547d6-1cdb2ab2-4fa579a3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:15.289521Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:15.289539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:15.289549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894910740405208:3960]
2025-09-30T14:51:15.289588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:15.289590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:15.290471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:15.290642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:15.291159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:15.291325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:15.291634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:15.291680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:15.295274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 355 sessionId: src_id|fb54ad9d-9e547d6-1cdb2ab2-4fa579a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:15.297951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:15.298139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:15.298159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:15.298193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:15.298299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:15.300080Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:15.300095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:15.300097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:15.300100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:15.300108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894910740405208:3960]
2025-09-30T14:51:15.300113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894910740405208:3960]
2025-09-30T14:51:15.300116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894910740405208:3960]
2025-09-30T14:51:15.300151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:15.300161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:15.300163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.300167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:15.300173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:15.300178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:15.300299Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:15.347135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894910830130645:4267]
2025-09-30T14:51:15.347409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 354, pipe: [1:7555894910830130645:4267]
2025-09-30T14:51:15.408078Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:15.415741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:15.415768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:15.415929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:15.415987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:15.416052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:15.416123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:15.416168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:15.416175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:15.416241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:15.416314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:15.416375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:15.416436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:15.416673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:15.416679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:15.416739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:15.416800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:15.416857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:15.416916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:15.417051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:15.417059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:15.417121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:15.417179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:15.417238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:15.417297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:15.417337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:15.417343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:15.417406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:15.417465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:15.417522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:15.417583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:15.417624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:15.417630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:15.417694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:15.417752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:15.417814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:15.417873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:15.417915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:15.417920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:15.417980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:15.418035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:15.418094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:15.418155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:15.418196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:15.418202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:15.418263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:15.418318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:15.418374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:15.418435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:15.418475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:15.418481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:15.418544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:15.418617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:15.418674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:15.418737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:15.418789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:15.418797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:15.418870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:15.418938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:15.419010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:15.419080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:15.419120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:15.419125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:15.419177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894910830130645:4267], now have 1 active actors on pipe
2025-09-30T14:51:15.419407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:15.419437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894910830130645:4267]
2025-09-30T14:51:15.419454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:15.419457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:15.419486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 355 reason: error at write: Disconnected sessionId: src_id|fb54ad9d-9e547d6-1cdb2ab2-4fa579a3_0
2025-09-30T14:51:15.419690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 355 sessionId: src_id|fb54ad9d-9e547d6-1cdb2ab2-4fa579a3_0 is DEAD
2025-09-30T14:51:15.419797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb54ad9d-9e547d6-1cdb2ab2-4fa579a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:15.419806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb54ad9d-9e547d6-1cdb2ab2-4fa579a3_0] Write session will restart in 0.006743s
2025-09-30T14:51:15.419822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb54ad9d-9e547d6-1cdb2ab2-4fa579a3_0] Write session: Do CDS request
2025-09-30T14:51:15.419826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb54ad9d-9e547d6-1cdb2ab2-4fa579a3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:15.419824Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:15.427721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb54ad9d-9e547d6-1cdb2ab2-4fa579a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:15.427839Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:15.427855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 356
2025-09-30T14:51:15.427979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 356 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:15.428009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 356 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:15.428016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=356 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:15.428019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:15.428420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 356 sessionId:  describe result for acl check
2025-09-30T14:51:15.428454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:15.428458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:15.428459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:15.428465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894910830130705:4572] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:15.429013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894910830130705:4572] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:15.431445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894910830130705:4572] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:15.432150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:15.434061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:15.434228Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:15.434237Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:15.434247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:15.434292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:15.434328Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894910740405396:3962]
2025-09-30T14:51:15.434448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894910830130705:4572] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:15.434463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894910830130705:4572] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:15.434466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894910830130705:4572] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:15.434473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 356 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:15.434982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:15.435233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:15.435286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:15.435597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:15.435652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:15.435658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:15.435659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:15.435660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:15.435661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:15.435662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:15.435664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:15.435666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:15.435667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:15.435668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:15.435669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.435670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.435672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.435673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:15.435675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:15.435679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:15.435688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:15.435692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:15.435695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:15.435699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:15.435703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:15.435707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:15.435711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:15.435715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:15.435720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:15.435724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.435729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.435733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.435737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:15.435741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:15.435748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:15.435756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:15.435763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:15.435774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:15.435778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:15.435788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:15.435793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:15.435803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:15.435808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:15.435813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:15.435822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:15.435827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:15.435836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:15.435841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:15.435850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:15.435856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:15.435865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:15.435870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:15.435879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:15.435885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:15.435891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.435902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.435907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.435916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.435921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.435928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.435933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:15.435942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:15.435946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:15.435951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:15.435996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:15.441202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:15.442209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:15.442224Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:15.442227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:15.442230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:15.442235Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 355 [2:7555894910740405396:3962]
2025-09-30T14:51:15.442247Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:15.442260Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:15.442262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:15.442265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:15.442266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:15.442278Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:15.442283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:15.442288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:15.442331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.442339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.442340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.442343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:15.442344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:15.442399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:15.442405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.442413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.442419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.442429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:15.442446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894910740405391:3962]
2025-09-30T14:51:15.442452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894910740405391:3962]
2025-09-30T14:51:15.442454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894910740405391:3962]
2025-09-30T14:51:15.442463Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:15.442474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894910830130827:4572], now have 1 active actors on pipe
2025-09-30T14:51:15.442477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894910830130647:2454], now have 1 active actors on pipe
2025-09-30T14:51:15.442478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:15.442481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:15.442483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:15.442484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:15.442492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:15.442494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:15.442519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894910740405391:3962]
2025-09-30T14:51:15.442528Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:15.442536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:15.442573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 355
2025-09-30T14:51:15.442578Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 355
2025-09-30T14:51:15.442634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:15.442643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:15.442665Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|21735a84-a27719ac-6e5496a9-106a238e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:15.442674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:15.442676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:15.442678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:15.442687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:15.442694Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:15.442705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:15.442893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:15.442905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:15.442920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:15.443011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 356 partition: 0 MaxSeqNo: 42 sessionId: src_id|21735a84-a27719ac-6e5496a9-106a238e_0
2025-09-30T14:51:15.443486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb54ad9d-9e547d6-1cdb2ab2-4fa579a3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|21735a84-a27719ac-6e5496a9-106a238e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:15.447049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21735a84-a27719ac-6e5496a9-106a238e_0] Write session: try to update token
2025-09-30T14:51:15.447073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21735a84-a27719ac-6e5496a9-106a238e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:15.454072Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:15.454091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:15.454094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:15.454095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:15.454105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894910740405391:3962]
2025-09-30T14:51:15.454110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894910740405391:3962]
2025-09-30T14:51:15.454114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894910740405391:3962]
2025-09-30T14:51:15.454151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:15.454152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:15.454157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.454158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:15.454161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:15.454161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:15.454303Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:15.464043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 356 sessionId: src_id|21735a84-a27719ac-6e5496a9-106a238e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:15.466634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:15.519650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894910830130853:4267]
2025-09-30T14:51:15.519888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 355, pipe: [1:7555894910830130853:4267]
2025-09-30T14:51:15.557362Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:15.557810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:15.557827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:15.557845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894910830130853:4267], now have 1 active actors on pipe
2025-09-30T14:51:15.558022Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:15.558052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894910830130853:4267]
2025-09-30T14:51:15.558056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:15.558061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:15.558077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:15.558124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 356 reason: error at write: Disconnected sessionId: src_id|21735a84-a27719ac-6e5496a9-106a238e_0
2025-09-30T14:51:15.558330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 356 sessionId: src_id|21735a84-a27719ac-6e5496a9-106a238e_0 is DEAD
2025-09-30T14:51:15.558462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21735a84-a27719ac-6e5496a9-106a238e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:15.558472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21735a84-a27719ac-6e5496a9-106a238e_0] Write session will restart in 0.009959s
2025-09-30T14:51:15.558488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21735a84-a27719ac-6e5496a9-106a238e_0] Write session: Do CDS request
2025-09-30T14:51:15.558502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21735a84-a27719ac-6e5496a9-106a238e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:15.569837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21735a84-a27719ac-6e5496a9-106a238e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:15.569880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:15.569896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 357
2025-09-30T14:51:15.570068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 357 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:15.570103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 357 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:15.570116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=357 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:15.570120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:15.570324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:15.570498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 357 sessionId:  describe result for acl check
2025-09-30T14:51:15.570530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:15.570535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:15.570537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:15.570565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894910830131010:4584] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:15.570989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894910830131010:4584] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:15.572549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894910830131010:4584] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:15.572808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:15.572969Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:15.572978Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:15.572985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:15.573019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:15.573048Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894910740405618:3977]
2025-09-30T14:51:15.573494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:15.573746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:15.573782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:15.574088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:15.574141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:15.574146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:15.574147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:15.574148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:15.574150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:15.574151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:15.574152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:15.574153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:15.574154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:15.574155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:15.574156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.574157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.574158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.574159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:15.574160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:15.574166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:15.574176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:15.574180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:15.574184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:15.574188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:15.574193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:15.574196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:15.574200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:15.574205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:15.574209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:15.574213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.574217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.574221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.574225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:15.574229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:15.574236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:15.574244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:15.574250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:15.574256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:15.574260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:15.574266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:15.574270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:15.574276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:15.574280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:15.574286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:15.574290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:15.574295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:15.574299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:15.574305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:15.574309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:15.574314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:15.574318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:15.574323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:15.574328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:15.574338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:15.574343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.574349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.574353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.574359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.574363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.574371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.574376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:15.574380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:15.574384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:15.574394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:15.574439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:15.575092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894910830131010:4584] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:15.575113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894910830131010:4584] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:15.575115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894910830131010:4584] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:15.575157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 357 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:15.579762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:15.580651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:15.580668Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:15.580671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:15.580674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:15.580681Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 356 [2:7555894910740405618:3977]
2025-09-30T14:51:15.580700Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:15.580718Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:15.580726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:15.580730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:15.580732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:15.580747Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:15.580754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:15.580762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:15.580832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.580843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.580845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.580849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:15.580852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:15.580925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:15.580934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.580946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.580962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.580983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:15.581007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894910830130864:2454], now have 1 active actors on pipe
2025-09-30T14:51:15.581015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894910830131049:4584], now have 1 active actors on pipe
2025-09-30T14:51:15.581022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894910740405613:3977]
2025-09-30T14:51:15.581028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894910740405613:3977]
2025-09-30T14:51:15.581030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894910740405613:3977]
2025-09-30T14:51:15.581043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:15.581057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:15.581059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:15.581063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:15.581065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:15.581077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:15.581081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:15.581074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 356
2025-09-30T14:51:15.581077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 356
2025-09-30T14:51:15.581113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894910740405613:3977]
2025-09-30T14:51:15.581125Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:15.581133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:15.581146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:15.581150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:15.581203Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d843f67a-4d5c82c6-a130e29d-a6eb8c19_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:15.581215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:15.581219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:15.581221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:15.581230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:15.581245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:15.581274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:15.581437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:15.581448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:15.581466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:15.581551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 357 partition: 0 MaxSeqNo: 42 sessionId: src_id|d843f67a-4d5c82c6-a130e29d-a6eb8c19_0
2025-09-30T14:51:15.581915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21735a84-a27719ac-6e5496a9-106a238e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d843f67a-4d5c82c6-a130e29d-a6eb8c19_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:15.584781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d843f67a-4d5c82c6-a130e29d-a6eb8c19_0] Write session: try to update token
2025-09-30T14:51:15.584799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d843f67a-4d5c82c6-a130e29d-a6eb8c19_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:15.592912Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:15.592930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:15.592933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:15.592934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:15.592946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894910740405613:3977]
2025-09-30T14:51:15.592950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894910740405613:3977]
2025-09-30T14:51:15.592953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894910740405613:3977]
2025-09-30T14:51:15.592992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:15.592999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.593002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:15.593002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:15.593008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:15.593012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:15.593137Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:15.598853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 357 sessionId: src_id|d843f67a-4d5c82c6-a130e29d-a6eb8c19_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:15.601596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:15.658406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894910830131056:4267]
2025-09-30T14:51:15.658698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 356, pipe: [1:7555894910830131056:4267]
2025-09-30T14:51:15.703451Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:15.704046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:15.704058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:15.704089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894910830131056:4267], now have 1 active actors on pipe
2025-09-30T14:51:15.704263Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:15.704364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894910830131056:4267]
2025-09-30T14:51:15.704380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:15.704394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:15.704473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 357 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d843f67a-4d5c82c6-a130e29d-a6eb8c19_0
2025-09-30T14:51:15.704654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 357 sessionId: src_id|d843f67a-4d5c82c6-a130e29d-a6eb8c19_0 is DEAD
2025-09-30T14:51:15.704805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d843f67a-4d5c82c6-a130e29d-a6eb8c19_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:15.704815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d843f67a-4d5c82c6-a130e29d-a6eb8c19_0] Write session will restart in 0.009267s
2025-09-30T14:51:15.704840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d843f67a-4d5c82c6-a130e29d-a6eb8c19_0] Write session: Do CDS request
2025-09-30T14:51:15.704844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d843f67a-4d5c82c6-a130e29d-a6eb8c19_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:15.715740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d843f67a-4d5c82c6-a130e29d-a6eb8c19_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:15.715853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:15.715869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 358
2025-09-30T14:51:15.716002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 358 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:15.716047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 358 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:15.716057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=358 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:15.716061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:15.716465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 358 sessionId:  describe result for acl check
2025-09-30T14:51:15.716497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:15.716503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:15.716505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:15.716511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894910830131203:4588] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:15.716979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894910830131203:4588] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:15.717256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:15.719235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894910830131203:4588] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:15.719364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:15.719572Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:15.719584Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:15.719594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:15.719647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:15.719692Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894910740405804:3979]
2025-09-30T14:51:15.720258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:15.720538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:15.720584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:15.721063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:15.721136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:15.721143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:15.721144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:15.721144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:15.721145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:15.721146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:15.721147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:15.721147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:15.721148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:15.721149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:15.721150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.721151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.721151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.721152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:15.721153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:15.721157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:15.721163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:15.721166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:15.721168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:15.721171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:15.721173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:15.721175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:15.721178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:15.721180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:15.721183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:15.721185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.721188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.721190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.721192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:15.721195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:15.721201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:15.721206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:15.721210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:15.721213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:15.721216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:15.721220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:15.721223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:15.721226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:15.721229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:15.721233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:15.721236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:15.721239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:15.721242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:15.721245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:15.721248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:15.721251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:15.721253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:15.721256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:15.721258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:15.721261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:15.721264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.721267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.721269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.721273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.721275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.721280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.721285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:15.721289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:15.721294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:15.721299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:15.721340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:15.721439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894910830131203:4588] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:15.721452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894910830131203:4588] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:15.721455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894910830131203:4588] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:15.721463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 358 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:15.726714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:15.727741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:15.727759Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:15.727763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:15.727767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:15.727773Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 357 [2:7555894910740405804:3979]
2025-09-30T14:51:15.727791Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:15.727805Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:15.727812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:15.727814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:15.727816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:15.727828Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:15.727837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:15.727843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:15.727890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.727896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.727897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.727900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:15.727902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:15.727957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:15.727965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.727979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.727996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.728010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:15.728029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894910830131241:4588], now have 1 active actors on pipe
2025-09-30T14:51:15.728035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894910830131057:2454], now have 1 active actors on pipe
2025-09-30T14:51:15.728040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894910740405799:3979]
2025-09-30T14:51:15.728042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894910740405799:3979]
2025-09-30T14:51:15.728043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894910740405799:3979]
2025-09-30T14:51:15.728053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:15.728066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:15.728068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:15.728076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:15.728078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:15.728083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:15.728086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:15.728122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894910740405799:3979]
2025-09-30T14:51:15.728137Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:15.728157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:15.728133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 357
2025-09-30T14:51:15.728152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 357
2025-09-30T14:51:15.728192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:15.728199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:15.728223Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5063d04e-599c1f16-5525a52b-d17d6fd1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:15.728231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:15.728234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:15.728235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:15.728243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:15.728253Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:15.728267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:15.728462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:15.728473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:15.728488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:15.728597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 358 partition: 0 MaxSeqNo: 42 sessionId: src_id|5063d04e-599c1f16-5525a52b-d17d6fd1_0
2025-09-30T14:51:15.728966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d843f67a-4d5c82c6-a130e29d-a6eb8c19_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5063d04e-599c1f16-5525a52b-d17d6fd1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:15.731611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5063d04e-599c1f16-5525a52b-d17d6fd1_0] Write session: try to update token
2025-09-30T14:51:15.731627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5063d04e-599c1f16-5525a52b-d17d6fd1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:15.739477Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:15.739495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:15.739505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894910740405799:3979]
2025-09-30T14:51:15.739549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:15.739554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:15.739736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:15.739883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:15.740026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:15.740172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:15.740367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:15.740410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:15.744991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 358 sessionId: src_id|5063d04e-599c1f16-5525a52b-d17d6fd1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:15.747772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:15.747954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:15.747977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:15.748010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:15.748102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:15.749872Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:15.749888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:15.749893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:15.749895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:15.749906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894910740405799:3979]
2025-09-30T14:51:15.749909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894910740405799:3979]
2025-09-30T14:51:15.749913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894910740405799:3979]
2025-09-30T14:51:15.749949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:15.749958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:15.749959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.749962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:15.749970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:15.749974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:15.750104Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:15.804366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894910830131251:4267]
2025-09-30T14:51:15.804689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 357, pipe: [1:7555894910830131251:4267]
2025-09-30T14:51:15.852775Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:15.859548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:15.859571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:15.859728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:15.859804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:15.859874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:15.859937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:15.859980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:15.859991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:15.860063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:15.860123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:15.860187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:15.860528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:15.860578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:15.860586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:15.860653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:15.860710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:15.860782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:15.860846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:15.860888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:15.860894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:15.860953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:15.861014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:15.861071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:15.861132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:15.861181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:15.861189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:15.861252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:15.861308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:15.861366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:15.861424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:15.861472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:15.861481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:15.861548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:15.861603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:15.861662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:15.861718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:15.861760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:15.861769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:15.861838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:15.861903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:15.861962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:15.862019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:15.862070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:15.862078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:15.862144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:15.862198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:15.862254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:15.862327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:15.862370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:15.862376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:15.862438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:15.862502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:15.862575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:15.862633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:15.862683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:15.862691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:15.862756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:15.862813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:15.862870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:15.862932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:15.862978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:15.862986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:15.863029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894910830131251:4267], now have 1 active actors on pipe
2025-09-30T14:51:15.863295Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:15.863297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:15.863303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:15.863328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 358 reason: error at write: Disconnected sessionId: src_id|5063d04e-599c1f16-5525a52b-d17d6fd1_0
2025-09-30T14:51:15.863353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894910830131251:4267]
2025-09-30T14:51:15.863495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 358 sessionId: src_id|5063d04e-599c1f16-5525a52b-d17d6fd1_0 is DEAD
2025-09-30T14:51:15.863611Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:15.863632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5063d04e-599c1f16-5525a52b-d17d6fd1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:15.863644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5063d04e-599c1f16-5525a52b-d17d6fd1_0] Write session will restart in 0.009728s
2025-09-30T14:51:15.863666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5063d04e-599c1f16-5525a52b-d17d6fd1_0] Write session: Do CDS request
2025-09-30T14:51:15.863672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5063d04e-599c1f16-5525a52b-d17d6fd1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:15.874639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5063d04e-599c1f16-5525a52b-d17d6fd1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:15.874785Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:15.874800Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 359
2025-09-30T14:51:15.874891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 359 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:15.874923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 359 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:15.874929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=359 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:15.874934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:15.875398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:15.875422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 359 sessionId:  describe result for acl check
2025-09-30T14:51:15.875458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:15.875465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:15.875467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:15.875473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894910830131412:4593] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:15.875984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894910830131412:4593] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:15.877281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:15.877468Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:15.877479Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:15.877489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:15.877528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:15.877558Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894910740406003:3982]
2025-09-30T14:51:15.878090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894910830131412:4593] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:15.878117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:15.878377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:15.878422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:15.878716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:15.878777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:15.878783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:15.878785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:15.878787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:15.878788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:15.878789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:15.878790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:15.878791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:15.878792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:15.878794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:15.878795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.878796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.878798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.878799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:15.878800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:15.878806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:15.878816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:15.878819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:15.878824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:15.878828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:15.878833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:15.878837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:15.878840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:15.878844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:15.878849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:15.878853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.878857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.878866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.878870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:15.878878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:15.878886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:15.878897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:15.878907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:15.878914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:15.878918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:15.878924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:15.878929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:15.878934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:15.878939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:15.878945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:15.878953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:15.878963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:15.878972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:15.878982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:15.878991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:15.878996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:15.879005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:15.879015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:15.879023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:15.879029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:15.879034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.879039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.879043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.879051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.879056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.879064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.879075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:15.879084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:15.879092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:15.879101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:15.879150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:15.884092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894910830131412:4593] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:15.884108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894910830131412:4593] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:15.884112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894910830131412:4593] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:15.884121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 359 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:15.884390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:15.885242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:15.885262Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:15.885266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:15.885270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:15.885276Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 358 [2:7555894910740406003:3982]
2025-09-30T14:51:15.885291Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:15.885311Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:15.885314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:15.885317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:15.885319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:15.885335Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:15.885348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:15.885359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:15.885418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.885425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.885428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.885431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:15.885433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:15.885495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:15.885504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.885517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:15.885532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:15.885551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:15.885574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894910830131264:2454], now have 1 active actors on pipe
2025-09-30T14:51:15.885581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894910830131451:4593], now have 1 active actors on pipe
2025-09-30T14:51:15.885588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894910740405998:3982]
2025-09-30T14:51:15.885591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894910740405998:3982]
2025-09-30T14:51:15.885593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894910740405998:3982]
2025-09-30T14:51:15.885604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:15.885619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:15.885622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:15.885606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 358
2025-09-30T14:51:15.885610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 358
2025-09-30T14:51:15.885636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:15.885643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:15.885644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:15.885644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:15.885683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:15.885692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:15.885704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894910740405998:3982]
2025-09-30T14:51:15.885715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:15.885727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:15.885747Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69bc0313-8dca6703-a0612476-5c9bfaab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:15.885758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:15.885765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:15.885767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:15.885777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:15.885790Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:15.885815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:15.885970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:15.885981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:15.885995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:15.886067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 359 partition: 0 MaxSeqNo: 42 sessionId: src_id|69bc0313-8dca6703-a0612476-5c9bfaab_0
2025-09-30T14:51:15.886465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5063d04e-599c1f16-5525a52b-d17d6fd1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|69bc0313-8dca6703-a0612476-5c9bfaab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:15.889038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69bc0313-8dca6703-a0612476-5c9bfaab_0] Write session: try to update token
2025-09-30T14:51:15.889054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69bc0313-8dca6703-a0612476-5c9bfaab_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:15.897814Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:15.897832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:15.897834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:15.897836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:15.897844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894910740405998:3982]
2025-09-30T14:51:15.897847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894910740405998:3982]
2025-09-30T14:51:15.897850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894910740405998:3982]
2025-09-30T14:51:15.897882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:15.897888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:15.897890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:15.897899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:15.897905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:15.897910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:15.898034Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:15.902333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 359 sessionId: src_id|69bc0313-8dca6703-a0612476-5c9bfaab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:15.905108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:15.963561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894910830131462:4267]
2025-09-30T14:51:15.963821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 358, pipe: [1:7555894910830131462:4267]
2025-09-30T14:51:16.006341Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:16.006864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:16.006878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:16.006917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894910830131462:4267], now have 1 active actors on pipe
2025-09-30T14:51:16.007136Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:16.007161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:16.007163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894910830131462:4267]
2025-09-30T14:51:16.007179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:16.007185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:16.007381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 359 reason: error at write: Disconnected sessionId: src_id|69bc0313-8dca6703-a0612476-5c9bfaab_0
2025-09-30T14:51:16.007592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 359 sessionId: src_id|69bc0313-8dca6703-a0612476-5c9bfaab_0 is DEAD
2025-09-30T14:51:16.007763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69bc0313-8dca6703-a0612476-5c9bfaab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:16.007772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69bc0313-8dca6703-a0612476-5c9bfaab_0] Write session will restart in 0.006314s
2025-09-30T14:51:16.007794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69bc0313-8dca6703-a0612476-5c9bfaab_0] Write session: Do CDS request
2025-09-30T14:51:16.007800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69bc0313-8dca6703-a0612476-5c9bfaab_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:16.015841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69bc0313-8dca6703-a0612476-5c9bfaab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:16.015893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:16.015910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 360
2025-09-30T14:51:16.016091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 360 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:16.016125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 360 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:16.016136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=360 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:16.016143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:16.016671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 360 sessionId:  describe result for acl check
2025-09-30T14:51:16.016702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:16.016719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:16.016725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:16.016731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894915125098855:4599] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:16.017267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894915125098855:4599] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:16.019279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894915125098855:4599] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:16.020164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:16.022510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:16.022723Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:16.022733Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:16.022743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:16.022796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:16.022811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894915125098855:4599] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:16.022826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894915125098855:4599] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:16.022830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894915125098855:4599] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:16.022838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 360 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:16.022850Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894915035373488:3984]
2025-09-30T14:51:16.023533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:16.023826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:16.023866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:16.024204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:16.024261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:16.024268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:16.024269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:16.024271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:16.024272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:16.024273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:16.024274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:16.024275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:16.024276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:16.024277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:16.024278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.024280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.024281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.024282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:16.024283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:16.024287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:16.024299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:16.024303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:16.024307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:16.024311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:16.024316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:16.024320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:16.024324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:16.024328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:16.024335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:16.024339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.024343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.024347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.024351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:16.024355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:16.024362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:16.024370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:16.024376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:16.024381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:16.024385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:16.024391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:16.024396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:16.024401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:16.024406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:16.024411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:16.024417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:16.024422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:16.024428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:16.024433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:16.024437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:16.024442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:16.024446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:16.024452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:16.024456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:16.024461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:16.024465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.024477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.024481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.024486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.024498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.024503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.024507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:16.024513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:16.024517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:16.024522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:16.024568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:16.030280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:16.031142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:16.031160Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:16.031162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:16.031167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:16.031174Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 359 [2:7555894915035373488:3984]
2025-09-30T14:51:16.031192Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:16.031209Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:16.031213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.031216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.031219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.031235Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:16.031266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:16.031280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:16.031335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.031345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.031348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.031351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:16.031354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:16.031422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:16.031430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.031444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.031451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.031472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:16.031493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894915035373483:3984]
2025-09-30T14:51:16.031500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894915035373483:3984]
2025-09-30T14:51:16.031502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894915035373483:3984]
2025-09-30T14:51:16.031515Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:16.031531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:16.031534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894915125098767:2454], now have 1 active actors on pipe
2025-09-30T14:51:16.031537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894915125098951:4599], now have 1 active actors on pipe
2025-09-30T14:51:16.031541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:16.031544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:16.031545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:16.031559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:16.031562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:16.031595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894915035373483:3984]
2025-09-30T14:51:16.031605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:16.031612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:16.031611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 359
2025-09-30T14:51:16.031612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 359
2025-09-30T14:51:16.031764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:16.031773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:16.031799Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93c620fa-6f7d7c2-6a7465fa-c83b6a56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:16.031810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.031813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.031816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:16.031826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.031840Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:16.031858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:16.032032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:16.032048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:16.032073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:16.032169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 360 partition: 0 MaxSeqNo: 42 sessionId: src_id|93c620fa-6f7d7c2-6a7465fa-c83b6a56_0
2025-09-30T14:51:16.032564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69bc0313-8dca6703-a0612476-5c9bfaab_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|93c620fa-6f7d7c2-6a7465fa-c83b6a56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:16.035299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93c620fa-6f7d7c2-6a7465fa-c83b6a56_0] Write session: try to update token
2025-09-30T14:51:16.035317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93c620fa-6f7d7c2-6a7465fa-c83b6a56_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:16.043828Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:16.043847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:16.043849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:16.043851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:16.043861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894915035373483:3984]
2025-09-30T14:51:16.043865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894915035373483:3984]
2025-09-30T14:51:16.043869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894915035373483:3984]
2025-09-30T14:51:16.043910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:16.043916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:16.043923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:16.043924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.043926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:16.043927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:16.044063Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:16.049564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 360 sessionId: src_id|93c620fa-6f7d7c2-6a7465fa-c83b6a56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:16.052263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:16.107468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894915125098966:4267]
2025-09-30T14:51:16.107777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 359, pipe: [1:7555894915125098966:4267]
2025-09-30T14:51:16.159994Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:16.160613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:16.160635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:16.160678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894915125098966:4267], now have 1 active actors on pipe
2025-09-30T14:51:16.160896Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:16.160899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894915125098966:4267]
2025-09-30T14:51:16.160935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:16.160936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:16.160938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:16.160996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 360 reason: error at write: Disconnected sessionId: src_id|93c620fa-6f7d7c2-6a7465fa-c83b6a56_0
2025-09-30T14:51:16.161196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 360 sessionId: src_id|93c620fa-6f7d7c2-6a7465fa-c83b6a56_0 is DEAD
2025-09-30T14:51:16.161358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93c620fa-6f7d7c2-6a7465fa-c83b6a56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:16.161368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93c620fa-6f7d7c2-6a7465fa-c83b6a56_0] Write session will restart in 0.006737s
2025-09-30T14:51:16.161390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93c620fa-6f7d7c2-6a7465fa-c83b6a56_0] Write session: Do CDS request
2025-09-30T14:51:16.161399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93c620fa-6f7d7c2-6a7465fa-c83b6a56_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:16.169801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93c620fa-6f7d7c2-6a7465fa-c83b6a56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:16.169970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:16.170001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 361
2025-09-30T14:51:16.170136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 361 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:16.170176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 361 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:16.170187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=361 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:16.170191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:16.170705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 361 sessionId:  describe result for acl check
2025-09-30T14:51:16.170751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:16.170754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:16.170756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:16.170762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894915125099026:4603] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:16.171358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894915125099026:4603] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:16.173851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894915125099026:4603] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:16.175531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:16.177494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:16.177692Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:16.177702Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:16.177713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:16.177767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:16.177819Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894915035373677:3987]
2025-09-30T14:51:16.177940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894915125099026:4603] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:16.177958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894915125099026:4603] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:16.177961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894915125099026:4603] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:16.177970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 361 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:16.178471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:16.178793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:16.178837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:16.179166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:16.179220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:16.179225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:16.179226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:16.179228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:16.179229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:16.179230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:16.179231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:16.179233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:16.179234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:16.179235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:16.179236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.179237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.179238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.179254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:16.179256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:16.179261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:16.179272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:16.179276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:16.179280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:16.179284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:16.179289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:16.179293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:16.179297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:16.179301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:16.179305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:16.179309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.179314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.179318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.179322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:16.179326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:16.179334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:16.179343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:16.179349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:16.179355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:16.179360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:16.179371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:16.179376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:16.179381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:16.179390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:16.179396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:16.179400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:16.179405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:16.179410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:16.179415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:16.179424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:16.179429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:16.179440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:16.179446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:16.179454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:16.179460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:16.179464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.179469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.179473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.179483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.179488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.179493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.179501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:16.179507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:16.179511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:16.179521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:16.179565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:16.185043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:16.185886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:16.185903Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:16.185906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:16.185910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:16.185917Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 360 [2:7555894915035373677:3987]
2025-09-30T14:51:16.185933Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:16.185949Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:16.185952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.185954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.185957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.185974Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:16.185987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:16.185998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:16.186057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.186064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.186066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.186069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:16.186071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:16.186138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:16.186146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.186157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.186176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.186190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:16.186208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894915035373672:3987]
2025-09-30T14:51:16.186217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894915035373672:3987]
2025-09-30T14:51:16.186219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894915035373672:3987]
2025-09-30T14:51:16.186227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:16.186237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:16.186243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894915125099151:4603], now have 1 active actors on pipe
2025-09-30T14:51:16.186248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:16.186249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:16.186251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:16.186262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:16.186268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:16.186273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894915125098967:2454], now have 1 active actors on pipe
2025-09-30T14:51:16.186300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894915035373672:3987]
2025-09-30T14:51:16.186312Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:16.186326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:16.186368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 360
2025-09-30T14:51:16.186375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 360
2025-09-30T14:51:16.186457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:16.186467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:16.186493Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e58bb0b8-a2809b9e-72e01ec7-827daa4d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:16.186503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.186506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.186509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:16.186519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.186529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:16.186543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:16.186707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:16.186714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:16.186726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:16.186852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 361 partition: 0 MaxSeqNo: 42 sessionId: src_id|e58bb0b8-a2809b9e-72e01ec7-827daa4d_0
2025-09-30T14:51:16.187275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93c620fa-6f7d7c2-6a7465fa-c83b6a56_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e58bb0b8-a2809b9e-72e01ec7-827daa4d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:16.190062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e58bb0b8-a2809b9e-72e01ec7-827daa4d_0] Write session: try to update token
2025-09-30T14:51:16.190081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e58bb0b8-a2809b9e-72e01ec7-827daa4d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:16.204514Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:16.204541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:16.204552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894915035373672:3987]
2025-09-30T14:51:16.204608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:16.204613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:16.204800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:16.204958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:16.205049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 361 sessionId: src_id|e58bb0b8-a2809b9e-72e01ec7-827daa4d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:16.205129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:16.205293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:16.205514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:16.205565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:16.207664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:16.207875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:16.207894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:16.209086Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:16.209104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:16.209107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:16.209109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:16.209119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894915035373672:3987]
2025-09-30T14:51:16.209123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894915035373672:3987]
2025-09-30T14:51:16.209128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894915035373672:3987]
2025-09-30T14:51:16.209164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:16.209167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:16.209172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:16.209175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:16.209186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:16.209193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.209196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:16.209253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:16.209337Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:16.263315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894915125099164:4267]
2025-09-30T14:51:16.263761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 360, pipe: [1:7555894915125099164:4267]
2025-09-30T14:51:16.327664Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:16.335227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:16.335274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:16.335463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:16.335537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:16.335607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:16.335683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:16.335734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:16.335751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:16.335830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:16.335901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:16.335973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:16.336047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:16.336216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:16.336226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:16.336296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:16.336365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:16.336436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:16.336504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:16.336547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:16.336555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:16.336620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:16.336694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:16.336758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:16.336825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:16.336867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:16.336876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:16.336946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:16.337018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:16.337090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:16.337158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:16.337204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:16.337209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:16.337280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:16.337348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:16.337410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:16.337486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:16.337537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:16.337545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:16.337616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:16.337693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:16.337769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:16.337841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:16.337899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:16.337907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:16.337981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:16.338053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:16.338126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:16.338207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:16.338258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:16.338269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:16.338347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:16.338420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:16.338492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:16.338583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:16.338633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:16.338641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:16.338716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:16.338787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:16.338871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:16.338945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:16.338995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:16.339002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:16.339064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894915125099164:4267], now have 1 active actors on pipe
2025-09-30T14:51:16.339368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894915125099164:4267]
2025-09-30T14:51:16.339399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:16.339401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:16.339406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:16.339437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 361 reason: error at write: Disconnected sessionId: src_id|e58bb0b8-a2809b9e-72e01ec7-827daa4d_0
2025-09-30T14:51:16.339659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 361 sessionId: src_id|e58bb0b8-a2809b9e-72e01ec7-827daa4d_0 is DEAD
2025-09-30T14:51:16.339799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e58bb0b8-a2809b9e-72e01ec7-827daa4d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:16.339809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e58bb0b8-a2809b9e-72e01ec7-827daa4d_0] Write session will restart in 0.006643s
2025-09-30T14:51:16.339832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e58bb0b8-a2809b9e-72e01ec7-827daa4d_0] Write session: Do CDS request
2025-09-30T14:51:16.339838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e58bb0b8-a2809b9e-72e01ec7-827daa4d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:16.340151Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:16.347809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e58bb0b8-a2809b9e-72e01ec7-827daa4d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:16.347884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:16.347899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 362
2025-09-30T14:51:16.348061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 362 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:16.348094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 362 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:16.348104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=362 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:16.348108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:16.348618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 362 sessionId:  describe result for acl check
2025-09-30T14:51:16.348661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:16.348669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:16.348671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:16.348677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894915125099220:4607] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:16.349226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894915125099220:4607] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:16.352213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894915125099220:4607] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:16.353193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:16.355631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:16.355957Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:16.355969Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:16.355983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:16.356047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:16.356090Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894915035373867:3989]
2025-09-30T14:51:16.356123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894915125099220:4607] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:16.356139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894915125099220:4607] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:16.356144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894915125099220:4607] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:16.356152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 362 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:16.356768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:16.357140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:16.357211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:16.357590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:16.357661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:16.357667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:16.357668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:16.357669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:16.357670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:16.357671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:16.357672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:16.357673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:16.357674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:16.357675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:16.357677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.357677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.357679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.357680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:16.357681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:16.357686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:16.357697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:16.357702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:16.357706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:16.357710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:16.357714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:16.357724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:16.357728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:16.357732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:16.357736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:16.357740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.357744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.357749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.357753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:16.357757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:16.357763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:16.357771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:16.357778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:16.357783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:16.357788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:16.357793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:16.357797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:16.357803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:16.357808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:16.357814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:16.357818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:16.357824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:16.357833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:16.357839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:16.357843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:16.357848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:16.357858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:16.357864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:16.357868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:16.357873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:16.357878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.357883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.357887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.357892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.357901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.357906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.357915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:16.357921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:16.357929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:16.357935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:16.357995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:16.363610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:16.364689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:16.364704Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:16.364707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:16.364711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:16.364718Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 361 [2:7555894915035373867:3989]
2025-09-30T14:51:16.364735Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:16.364751Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:16.364759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.364762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.364765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.364781Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:16.364792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:16.364799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:16.364862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.364869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.364871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.364875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:16.364877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:16.364946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:16.364955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.364969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.364987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.365011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:16.365032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894915125099352:4607], now have 1 active actors on pipe
2025-09-30T14:51:16.365040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894915125099165:2454], now have 1 active actors on pipe
2025-09-30T14:51:16.365047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894915035373862:3989]
2025-09-30T14:51:16.365050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894915035373862:3989]
2025-09-30T14:51:16.365052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894915035373862:3989]
2025-09-30T14:51:16.365065Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:16.365079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:16.365084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:16.365087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:16.365089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:16.365098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:16.365101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:16.365133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894915035373862:3989]
2025-09-30T14:51:16.365140Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:16.365146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:16.365109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 361
2025-09-30T14:51:16.365116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 361
2025-09-30T14:51:16.365168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:16.365180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:16.365214Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5be21fd6-ede736fa-3e0c939f-d3e18039_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:16.365221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.365225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.365227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:16.365236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.365245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:16.365266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:16.365381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:16.365390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:16.365403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:16.365473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 362 partition: 0 MaxSeqNo: 42 sessionId: src_id|5be21fd6-ede736fa-3e0c939f-d3e18039_0
2025-09-30T14:51:16.365879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e58bb0b8-a2809b9e-72e01ec7-827daa4d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5be21fd6-ede736fa-3e0c939f-d3e18039_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:16.368584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5be21fd6-ede736fa-3e0c939f-d3e18039_0] Write session: try to update token
2025-09-30T14:51:16.368601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5be21fd6-ede736fa-3e0c939f-d3e18039_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:16.377357Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:16.377375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:16.377377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:16.377380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:16.377389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894915035373862:3989]
2025-09-30T14:51:16.377394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894915035373862:3989]
2025-09-30T14:51:16.377398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894915035373862:3989]
2025-09-30T14:51:16.377436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:16.377440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:16.377443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.377446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:16.377446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:16.377450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:16.377585Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:16.383159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 362 sessionId: src_id|5be21fd6-ede736fa-3e0c939f-d3e18039_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:16.385677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:16.439745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894915125099364:4267]
2025-09-30T14:51:16.440059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 361, pipe: [1:7555894915125099364:4267]
2025-09-30T14:51:16.490040Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:16.490319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:16.490334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:16.490371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894915125099364:4267], now have 1 active actors on pipe
2025-09-30T14:51:16.490543Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:16.490695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:16.490697Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:16.490707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:16.490742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894915125099364:4267]
2025-09-30T14:51:16.490780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 362 reason: error at write: Disconnected sessionId: src_id|5be21fd6-ede736fa-3e0c939f-d3e18039_0
2025-09-30T14:51:16.490976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 362 sessionId: src_id|5be21fd6-ede736fa-3e0c939f-d3e18039_0 is DEAD
2025-09-30T14:51:16.491117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5be21fd6-ede736fa-3e0c939f-d3e18039_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:16.491128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5be21fd6-ede736fa-3e0c939f-d3e18039_0] Write session will restart in 0.007322s
2025-09-30T14:51:16.491151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5be21fd6-ede736fa-3e0c939f-d3e18039_0] Write session: Do CDS request
2025-09-30T14:51:16.491155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5be21fd6-ede736fa-3e0c939f-d3e18039_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:16.499784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5be21fd6-ede736fa-3e0c939f-d3e18039_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:16.499881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:16.499894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 363
2025-09-30T14:51:16.500023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 363 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:16.500055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 363 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:16.500065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=363 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:16.500068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:16.500492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 363 sessionId:  describe result for acl check
2025-09-30T14:51:16.500528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:16.500535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:16.500537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:16.500543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894915125099468:4612] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:16.501063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894915125099468:4612] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:16.502823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894915125099468:4612] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:16.503256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:16.505505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:16.505648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894915125099468:4612] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:16.505661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894915125099468:4612] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:16.505664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894915125099468:4612] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:16.505672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 363 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:16.505716Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:16.505733Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:16.505746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:16.505814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:16.505861Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894915035374067:3992]
2025-09-30T14:51:16.506518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:16.506824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:16.506879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:16.507209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:16.507319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:16.507328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:16.507329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:16.507330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:16.507332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:16.507333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:16.507334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:16.507335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:16.507336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:16.507337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:16.507338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.507339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.507340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.507341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:16.507342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:16.507348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:16.507359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:16.507363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:16.507368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:16.507372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:16.507376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:16.507380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:16.507384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:16.507388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:16.507392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:16.507396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.507400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.507404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.507409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:16.507413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:16.507422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:16.507430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:16.507435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:16.507441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:16.507446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:16.507451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:16.507456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:16.507461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:16.507467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:16.507473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:16.507477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:16.507483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:16.507487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:16.507492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:16.507496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:16.507501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:16.507507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:16.507512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:16.507516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:16.507521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:16.507525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.507530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.507534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.507539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.507548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.507561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.507564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:16.507569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:16.507573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:16.507577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:16.507616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:16.513121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:16.513987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:16.514002Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:16.514004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:16.514007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:16.514013Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 362 [2:7555894915035374067:3992]
2025-09-30T14:51:16.514026Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:16.514037Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:16.514043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.514046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.514048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.514060Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:16.514065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:16.514071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:16.514116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.514123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.514125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.514128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:16.514130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:16.514180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:16.514186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.514196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.514206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.514216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:16.514233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894915035374062:3992]
2025-09-30T14:51:16.514238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894915035374062:3992]
2025-09-30T14:51:16.514240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894915035374062:3992]
2025-09-30T14:51:16.514249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:16.514260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:16.514264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:16.514266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:16.514267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:16.514281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:16.514284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:16.514291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894915125099555:4612], now have 1 active actors on pipe
2025-09-30T14:51:16.514306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894915125099367:2454], now have 1 active actors on pipe
2025-09-30T14:51:16.514339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894915035374062:3992]
2025-09-30T14:51:16.514353Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:16.514352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 362
2025-09-30T14:51:16.514353Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 362
2025-09-30T14:51:16.514384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:16.514434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:16.514439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:16.514462Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|920df5d2-e7a62faf-cb215ad-510cca22_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:16.514474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.514478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.514480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:16.514490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.514500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:16.514514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:16.514698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:16.514706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:16.514724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:16.514833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 363 partition: 0 MaxSeqNo: 42 sessionId: src_id|920df5d2-e7a62faf-cb215ad-510cca22_0
2025-09-30T14:51:16.515318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5be21fd6-ede736fa-3e0c939f-d3e18039_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|920df5d2-e7a62faf-cb215ad-510cca22_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:16.518406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|920df5d2-e7a62faf-cb215ad-510cca22_0] Write session: try to update token
2025-09-30T14:51:16.518432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|920df5d2-e7a62faf-cb215ad-510cca22_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:16.526809Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:16.526828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:16.526831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:16.526833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:16.526844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894915035374062:3992]
2025-09-30T14:51:16.526848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894915035374062:3992]
2025-09-30T14:51:16.526852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894915035374062:3992]
2025-09-30T14:51:16.526897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:16.526910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.526913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:16.527048Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:16.528952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:16.528970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:16.528975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:16.533648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 363 sessionId: src_id|920df5d2-e7a62faf-cb215ad-510cca22_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:16.536398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:16.590748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894915125099591:4267]
2025-09-30T14:51:16.590893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 362, pipe: [1:7555894915125099591:4267]
2025-09-30T14:51:16.639015Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:16.639302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:16.639317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:16.639333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894915125099591:4267], now have 1 active actors on pipe
2025-09-30T14:51:16.639523Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:16.639554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894915125099591:4267]
2025-09-30T14:51:16.639582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:16.639590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:16.639664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 363 reason: status is not ok: tablet will be restarted right now sessionId: src_id|920df5d2-e7a62faf-cb215ad-510cca22_0
2025-09-30T14:51:16.639879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 363 sessionId: src_id|920df5d2-e7a62faf-cb215ad-510cca22_0 is DEAD
2025-09-30T14:51:16.640013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|920df5d2-e7a62faf-cb215ad-510cca22_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:16.640024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|920df5d2-e7a62faf-cb215ad-510cca22_0] Write session will restart in 0.009278s
2025-09-30T14:51:16.640046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|920df5d2-e7a62faf-cb215ad-510cca22_0] Write session: Do CDS request
2025-09-30T14:51:16.640051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|920df5d2-e7a62faf-cb215ad-510cca22_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:16.650798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|920df5d2-e7a62faf-cb215ad-510cca22_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:16.650888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:16.650908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 364
2025-09-30T14:51:16.651062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 364 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:16.651090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 364 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:16.651095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=364 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:16.651099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:16.651526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 364 sessionId:  describe result for acl check
2025-09-30T14:51:16.651563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:16.651569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:16.651571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:16.651577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894915125099743:4623] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:16.652095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894915125099743:4623] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:16.653292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:16.654114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894915125099743:4623] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:16.655342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:16.655537Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:16.655546Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:16.655557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:16.655608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:16.655663Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894915035374294:4006]
2025-09-30T14:51:16.656284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:16.656427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894915125099743:4623] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:16.656441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894915125099743:4623] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:16.656444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894915125099743:4623] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:16.656452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 364 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:16.656548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:16.656589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:16.656855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:16.656904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:16.656909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:16.656909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:16.656911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:16.656911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:16.656912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:16.656913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:16.656914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:16.656914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:16.656915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:16.656916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.656916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.656917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.656918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:16.656918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:16.656922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:16.656928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:16.656930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:16.656933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:16.656935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:16.656938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:16.656940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:16.656942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:16.656944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:16.656947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:16.656949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.656951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.656954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.656956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:16.656958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:16.656964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:16.656968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:16.656972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:16.656976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:16.656978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:16.656981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:16.656984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:16.656987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:16.656989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:16.656993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:16.656995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:16.656998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:16.657001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:16.657004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:16.657006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:16.657009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:16.657012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:16.657015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:16.657018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:16.657021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:16.657023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.657027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.657030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.657032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.657035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.657038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.657040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:16.657043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:16.657045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:16.657048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:16.657080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:16.662556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:16.663429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:16.663442Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:16.663446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:16.663451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:16.663457Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 363 [2:7555894915035374294:4006]
2025-09-30T14:51:16.663473Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:16.663494Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:16.663501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.663505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.663507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.663523Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:16.663530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:16.663541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:16.663600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.663607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.663609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.663612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:16.663615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:16.663679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:16.663686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.663699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.663716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.663737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:16.663759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894915125099781:4623], now have 1 active actors on pipe
2025-09-30T14:51:16.663767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894915125099592:2454], now have 1 active actors on pipe
2025-09-30T14:51:16.663773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894915035374289:4006]
2025-09-30T14:51:16.663775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894915035374289:4006]
2025-09-30T14:51:16.663778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894915035374289:4006]
2025-09-30T14:51:16.663790Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:16.663807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:16.663809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:16.663813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:16.663815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:16.663826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:16.663829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:16.663861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894915035374289:4006]
2025-09-30T14:51:16.663860Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 363
2025-09-30T14:51:16.663860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 363
2025-09-30T14:51:16.663873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:16.663896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:16.663911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:16.663916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:16.663946Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c282b416-c9b14186-4f0affa5-1be4e53c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:16.663953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.663957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.663959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:16.663968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.663977Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:16.663991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:16.664156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:16.664172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:16.664197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:16.664315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 364 partition: 0 MaxSeqNo: 42 sessionId: src_id|c282b416-c9b14186-4f0affa5-1be4e53c_0
2025-09-30T14:51:16.664723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|920df5d2-e7a62faf-cb215ad-510cca22_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c282b416-c9b14186-4f0affa5-1be4e53c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:16.667520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c282b416-c9b14186-4f0affa5-1be4e53c_0] Write session: try to update token
2025-09-30T14:51:16.667540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c282b416-c9b14186-4f0affa5-1be4e53c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:16.676118Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:16.676138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:16.676140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:16.676142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:16.676153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894915035374289:4006]
2025-09-30T14:51:16.676158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894915035374289:4006]
2025-09-30T14:51:16.676161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894915035374289:4006]
2025-09-30T14:51:16.676199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:16.676205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.676208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:16.676214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:16.676222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:16.676227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:16.676341Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:16.681386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 364 sessionId: src_id|c282b416-c9b14186-4f0affa5-1be4e53c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:16.683971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:16.739777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894915125099792:4267]
2025-09-30T14:51:16.740063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 363, pipe: [1:7555894915125099792:4267]
2025-09-30T14:51:16.785674Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:16.786247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:16.786259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:16.786290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894915125099792:4267], now have 1 active actors on pipe
2025-09-30T14:51:16.786457Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:16.786523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894915125099792:4267]
2025-09-30T14:51:16.786539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:16.786770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:16.786822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 364 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c282b416-c9b14186-4f0affa5-1be4e53c_0
2025-09-30T14:51:16.787024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 364 sessionId: src_id|c282b416-c9b14186-4f0affa5-1be4e53c_0 is DEAD
2025-09-30T14:51:16.787147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c282b416-c9b14186-4f0affa5-1be4e53c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:16.787169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c282b416-c9b14186-4f0affa5-1be4e53c_0] Write session will restart in 0.005737s
2025-09-30T14:51:16.787191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c282b416-c9b14186-4f0affa5-1be4e53c_0] Write session: Do CDS request
2025-09-30T14:51:16.787197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c282b416-c9b14186-4f0affa5-1be4e53c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:16.793810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c282b416-c9b14186-4f0affa5-1be4e53c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:16.793909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:16.793926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 365
2025-09-30T14:51:16.794072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 365 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:16.794109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 365 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:16.794121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=365 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:16.794125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:16.794633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 365 sessionId:  describe result for acl check
2025-09-30T14:51:16.794669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:16.794676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:16.794678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:16.794684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894915125099839:4627] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:16.795218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894915125099839:4627] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:16.797422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894915125099839:4627] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:16.799719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894915125099839:4627] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:16.799732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894915125099839:4627] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:16.799736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894915125099839:4627] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:16.799743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 365 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:16.799816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:16.801816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:16.801965Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:16.801972Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:16.801980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:16.802016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:16.802044Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894915035374501:4009]
2025-09-30T14:51:16.802487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:16.802780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:16.802833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:16.803085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:16.803147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:16.803153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:16.803155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:16.803156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:16.803157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:16.803159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:16.803160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:16.803161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:16.803162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:16.803163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:16.803165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.803166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.803168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.803169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:16.803170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:16.803175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:16.803183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:16.803186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:16.803188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:16.803190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:16.803193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:16.803195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:16.803197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:16.803200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:16.803202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:16.803204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.803206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.803209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.803211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:16.803213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:16.803219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:16.803224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:16.803228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:16.803232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:16.803234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:16.803238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:16.803254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:16.803258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:16.803261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:16.803265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:16.803268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:16.803271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:16.803274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:16.803277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:16.803280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:16.803283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:16.803285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:16.803288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:16.803291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:16.803294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:16.803296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.803300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.803304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.803307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.803310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.803313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.803315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:16.803318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:16.803321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:16.803324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:16.803347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:16.808762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:16.809834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:16.809849Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:16.809851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:16.809854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:16.809859Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 364 [2:7555894915035374501:4009]
2025-09-30T14:51:16.809872Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:16.809885Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:16.809887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.809889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.809891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.809902Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:16.809907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:16.809912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:16.809957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.809965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.809966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.809969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:16.809971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:16.810023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:16.810029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.810037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.810044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.810054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:16.810068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894915125099793:2454], now have 1 active actors on pipe
2025-09-30T14:51:16.810078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894915035374495:4009]
2025-09-30T14:51:16.810086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894915035374495:4009]
2025-09-30T14:51:16.810088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894915035374495:4009]
2025-09-30T14:51:16.810096Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:16.810103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894915125099984:4627], now have 1 active actors on pipe
2025-09-30T14:51:16.810109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:16.810118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:16.810120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:16.810121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:16.810122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:16.810124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:16.810151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894915035374495:4009]
2025-09-30T14:51:16.810156Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:16.810161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:16.810163Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 364
2025-09-30T14:51:16.810164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 364
2025-09-30T14:51:16.810199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:16.810205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:16.810228Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e72f9d05-4cbf4824-769bfa0-97cf858d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:16.810234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.810241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.810242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:16.810250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.810256Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:16.810270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:16.810434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:16.810443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:16.810453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:16.810516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 365 partition: 0 MaxSeqNo: 42 sessionId: src_id|e72f9d05-4cbf4824-769bfa0-97cf858d_0
2025-09-30T14:51:16.810902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c282b416-c9b14186-4f0affa5-1be4e53c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e72f9d05-4cbf4824-769bfa0-97cf858d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:16.813466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e72f9d05-4cbf4824-769bfa0-97cf858d_0] Write session: try to update token
2025-09-30T14:51:16.813484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e72f9d05-4cbf4824-769bfa0-97cf858d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:16.814484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-09-30T14:51:16.814517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 2
2025-09-30T14:51:16.814759Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 85826639 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:51:16.814993Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 2 DataSize: 85826639 UsedReserveSize: 0
2025-09-30T14:51:16.815027Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:51:16.821694Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:16.821714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:16.821723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894915035374495:4009]
2025-09-30T14:51:16.821764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:16.821769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:16.821935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:16.822095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:16.822247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:16.822396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:16.822616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:16.822663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:16.827479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 365 sessionId: src_id|e72f9d05-4cbf4824-769bfa0-97cf858d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:16.830037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:16.830234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:16.830255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:16.830290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:16.830393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:16.832229Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:16.832244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:16.832246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:16.832249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:16.832258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894915035374495:4009]
2025-09-30T14:51:16.832263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894915035374495:4009]
2025-09-30T14:51:16.832267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894915035374495:4009]
2025-09-30T14:51:16.832301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:16.832304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:16.832308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:16.832311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:16.832312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.832315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:16.832452Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:16.886722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894915125100011:4267]
2025-09-30T14:51:16.887007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 364, pipe: [1:7555894915125100011:4267]
2025-09-30T14:51:16.949013Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:16.957203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:16.957234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:16.957402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:16.957467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:16.957535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:16.957608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:16.957658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:16.957668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:16.957738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:16.957801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:16.957864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:16.957931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:16.957977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:16.957985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:16.958051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:16.958123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:16.958187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:16.958254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:16.958299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:16.958313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:16.958386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:16.958447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:16.958510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:16.958589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:16.958633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:16.958645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:16.958711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:16.958774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:16.958839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:16.958901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:16.958951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:16.958959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:16.959027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:16.959090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:16.959156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:16.959219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:16.959282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:16.959290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:16.959358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:16.959416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:16.959488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:16.959553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:16.959606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:16.959617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:16.959685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:16.959749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:16.959814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:16.959882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:16.959927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:16.959934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:16.959999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:16.960063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:16.960127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:16.960191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:16.960236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:16.960243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:16.960310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:16.960373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:16.960437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:16.960500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:16.960547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:16.960555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:16.960616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894915125100011:4267], now have 1 active actors on pipe
2025-09-30T14:51:16.960830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:16.960841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:16.960845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:16.960873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 365 reason: error at write: Disconnected sessionId: src_id|e72f9d05-4cbf4824-769bfa0-97cf858d_0
2025-09-30T14:51:16.960898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894915125100011:4267]
2025-09-30T14:51:16.961109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 365 sessionId: src_id|e72f9d05-4cbf4824-769bfa0-97cf858d_0 is DEAD
2025-09-30T14:51:16.961262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e72f9d05-4cbf4824-769bfa0-97cf858d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:16.961272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e72f9d05-4cbf4824-769bfa0-97cf858d_0] Write session will restart in 0.009316s
2025-09-30T14:51:16.961294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e72f9d05-4cbf4824-769bfa0-97cf858d_0] Write session: Do CDS request
2025-09-30T14:51:16.961299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e72f9d05-4cbf4824-769bfa0-97cf858d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:16.961678Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:16.971729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e72f9d05-4cbf4824-769bfa0-97cf858d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:16.971797Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:16.971809Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 366
2025-09-30T14:51:16.971955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 366 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:16.971993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 366 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:16.972002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=366 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:16.972006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:16.972410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 366 sessionId:  describe result for acl check
2025-09-30T14:51:16.972441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:16.972453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:16.972455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:16.972461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894915125100133:4634] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:16.972980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894915125100133:4634] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:16.975518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:16.975775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894915125100133:4634] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:16.977742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:16.977885Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:16.977895Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:16.977905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:16.977952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:16.977989Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894915035374695:4012]
2025-09-30T14:51:16.978058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894915125100133:4634] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:16.978068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894915125100133:4634] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:16.978072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894915125100133:4634] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:16.978078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 366 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:16.978617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:16.978875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:16.978921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:16.979258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:16.979323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:16.979330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:16.979331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:16.979332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:16.979334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:16.979335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:16.979336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:16.979338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:16.979339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:16.979341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:16.979342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.979343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.979345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.979346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:16.979347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:16.979353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:16.979363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:16.979368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:16.979372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:16.979381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:16.979386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:16.979394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:16.979399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:16.979408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:16.979417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:16.979425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.979429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.979433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.979436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:16.979441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:16.979452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:16.979460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:16.979465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:16.979475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:16.979484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:16.979493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:16.979502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:16.979512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:16.979520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:16.979530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:16.979538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:16.979543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:16.979548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:16.979558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:16.979566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:16.979571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:16.979579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:16.979584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:16.979594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:16.979604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:16.979614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.979623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.979631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.979636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.979643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.979648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.979654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:16.979657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:16.979659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:16.979662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:16.979685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:16.984941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:16.985765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:16.985780Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:16.985783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:16.985787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:16.985793Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 365 [2:7555894915035374695:4012]
2025-09-30T14:51:16.985807Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:16.985829Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:16.985832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.985834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.985837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.985851Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:16.985857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:16.985864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:16.985926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.985934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.985936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.985940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:16.985943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:16.986008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:16.986015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.986027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:16.986042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:16.986069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:16.986092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894915125100213:4634], now have 1 active actors on pipe
2025-09-30T14:51:16.986096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894915125100019:2454], now have 1 active actors on pipe
2025-09-30T14:51:16.986101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894915035374690:4012]
2025-09-30T14:51:16.986108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894915035374690:4012]
2025-09-30T14:51:16.986111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894915035374690:4012]
2025-09-30T14:51:16.986123Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:16.986140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:16.986144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:16.986148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:16.986150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:16.986158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:16.986166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:16.986140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 365
2025-09-30T14:51:16.986147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 365
2025-09-30T14:51:16.986188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894915035374690:4012]
2025-09-30T14:51:16.986196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:16.986199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:16.986222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:16.986231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:16.986262Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef2b4e2a-72726564-4ce72c45-4571d258_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:16.986272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.986279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.986282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:16.986290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.986302Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:16.986317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:16.986472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:16.986480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:16.986492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:16.986586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 366 partition: 0 MaxSeqNo: 42 sessionId: src_id|ef2b4e2a-72726564-4ce72c45-4571d258_0
2025-09-30T14:51:16.986956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e72f9d05-4cbf4824-769bfa0-97cf858d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ef2b4e2a-72726564-4ce72c45-4571d258_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:16.989757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef2b4e2a-72726564-4ce72c45-4571d258_0] Write session: try to update token
2025-09-30T14:51:16.989777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef2b4e2a-72726564-4ce72c45-4571d258_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:16.997882Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:16.997907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:16.997911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:16.997913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:16.997924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894915035374690:4012]
2025-09-30T14:51:16.997930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894915035374690:4012]
2025-09-30T14:51:16.997937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894915035374690:4012]
2025-09-30T14:51:16.997963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:16.997969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:16.997972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:16.997981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:16.997991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:16.997995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:16.998215Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:17.003925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 366 sessionId: src_id|ef2b4e2a-72726564-4ce72c45-4571d258_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:17.006561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:17.061294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894919420067523:4267]
2025-09-30T14:51:17.061585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 365, pipe: [1:7555894919420067523:4267]
2025-09-30T14:51:17.112078Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:17.112506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:17.112527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:17.112576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894919420067523:4267], now have 1 active actors on pipe
2025-09-30T14:51:17.112799Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:17.112850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894919420067523:4267]
2025-09-30T14:51:17.112856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:17.112892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:17.112952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 366 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ef2b4e2a-72726564-4ce72c45-4571d258_0
2025-09-30T14:51:17.113153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 366 sessionId: src_id|ef2b4e2a-72726564-4ce72c45-4571d258_0 is DEAD
2025-09-30T14:51:17.113341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef2b4e2a-72726564-4ce72c45-4571d258_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:17.113352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef2b4e2a-72726564-4ce72c45-4571d258_0] Write session will restart in 0.006786s
2025-09-30T14:51:17.113374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef2b4e2a-72726564-4ce72c45-4571d258_0] Write session: Do CDS request
2025-09-30T14:51:17.113379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef2b4e2a-72726564-4ce72c45-4571d258_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:17.121847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef2b4e2a-72726564-4ce72c45-4571d258_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:17.121988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:17.122010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 367
2025-09-30T14:51:17.122124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 367 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:17.122157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 367 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:17.122166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=367 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:17.122170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:17.122816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 367 sessionId:  describe result for acl check
2025-09-30T14:51:17.122862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:17.122868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:17.122871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:17.122877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894919420067570:4638] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:17.123387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894919420067570:4638] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:17.126536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894919420067570:4638] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:17.128946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:17.129565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894919420067570:4638] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:17.129583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894919420067570:4638] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:17.129586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894919420067570:4638] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:17.129594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 367 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:17.131707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:17.131954Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:17.131970Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:17.131984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:17.132058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:17.132114Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894919330342189:4015]
2025-09-30T14:51:17.132898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:17.133269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:17.133344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:17.133711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:17.133805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:17.133812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:17.133814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:17.133815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:17.133816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:17.133818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:17.133819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:17.133820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:17.133822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:17.133823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:17.133825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.133826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.133827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.133828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:17.133829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:17.133835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:17.133845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:17.133849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:17.133853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:17.133857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:17.133860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:17.133864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:17.133868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:17.133872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:17.133888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:17.133892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.133896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.133900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.133904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:17.133908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:17.133915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:17.133923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:17.133928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:17.133934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:17.133939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:17.133946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:17.133955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:17.133960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:17.133965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:17.133970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:17.133974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:17.133979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:17.133984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:17.133990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:17.133995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:17.134010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:17.134015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:17.134019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:17.134026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:17.134030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:17.134035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.134041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.134045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.134049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.134054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.134061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.134065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:17.134071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:17.134077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:17.134083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:17.134132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:17.139785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:17.140678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:17.140696Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:17.140700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:17.140704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:17.140711Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 366 [2:7555894919330342189:4015]
2025-09-30T14:51:17.140730Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:17.140747Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:17.140756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:17.140759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:17.140762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:17.140778Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:17.140785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:17.140797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:17.140858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.140867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.140869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.140873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:17.140876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:17.140946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:17.140954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.140969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.140988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.141013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:17.141036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894919420067717:4638], now have 1 active actors on pipe
2025-09-30T14:51:17.141045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894919420067524:2454], now have 1 active actors on pipe
2025-09-30T14:51:17.141052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894919330342183:4015]
2025-09-30T14:51:17.141060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894919330342183:4015]
2025-09-30T14:51:17.141063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894919330342183:4015]
2025-09-30T14:51:17.141076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:17.141093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:17.141096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:17.141096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:17.141099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:17.141085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 366
2025-09-30T14:51:17.141085Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 366
2025-09-30T14:51:17.141113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:17.141119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:17.141155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894919330342183:4015]
2025-09-30T14:51:17.141167Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:17.141173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:17.141185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:17.141193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:17.141241Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17c395d3-e685f952-bb2cc4fb-31a92148_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:17.141252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:17.141256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:17.141259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:17.141269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:17.141280Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:17.141305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:17.141493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:17.141501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:17.141515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:17.141593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 367 partition: 0 MaxSeqNo: 42 sessionId: src_id|17c395d3-e685f952-bb2cc4fb-31a92148_0
2025-09-30T14:51:17.141995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef2b4e2a-72726564-4ce72c45-4571d258_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|17c395d3-e685f952-bb2cc4fb-31a92148_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:17.144648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17c395d3-e685f952-bb2cc4fb-31a92148_0] Write session: try to update token
2025-09-30T14:51:17.144665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17c395d3-e685f952-bb2cc4fb-31a92148_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:17.153417Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:17.153438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:17.153441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:17.153444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:17.153452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894919330342183:4015]
2025-09-30T14:51:17.153457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894919330342183:4015]
2025-09-30T14:51:17.153462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894919330342183:4015]
2025-09-30T14:51:17.153502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:17.153509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.153512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:17.153653Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:17.153699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:17.153713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:17.153717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:17.160575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 367 sessionId: src_id|17c395d3-e685f952-bb2cc4fb-31a92148_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:17.163334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:17.212876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894919420067728:4267]
2025-09-30T14:51:17.213163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 366, pipe: [1:7555894919420067728:4267]
2025-09-30T14:51:17.266328Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:17.266941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:17.266959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:17.266981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894919420067728:4267], now have 1 active actors on pipe
2025-09-30T14:51:17.267210Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:17.267203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:17.267204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894919420067728:4267]
2025-09-30T14:51:17.267216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:17.267224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:17.267301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 367 reason: error at write: Disconnected sessionId: src_id|17c395d3-e685f952-bb2cc4fb-31a92148_0
2025-09-30T14:51:17.267511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 367 sessionId: src_id|17c395d3-e685f952-bb2cc4fb-31a92148_0 is DEAD
2025-09-30T14:51:17.267679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c395d3-e685f952-bb2cc4fb-31a92148_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:17.267686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c395d3-e685f952-bb2cc4fb-31a92148_0] Write session will restart in 0.008756s
2025-09-30T14:51:17.267711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c395d3-e685f952-bb2cc4fb-31a92148_0] Write session: Do CDS request
2025-09-30T14:51:17.267733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c395d3-e685f952-bb2cc4fb-31a92148_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:17.277831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17c395d3-e685f952-bb2cc4fb-31a92148_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:17.277898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:17.277923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 368
2025-09-30T14:51:17.278112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 368 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:17.278157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 368 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:17.278164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=368 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:17.278173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:17.278630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 368 sessionId:  describe result for acl check
2025-09-30T14:51:17.278672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:17.278679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:17.278682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:17.278688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894919420067815:4642] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:17.279262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894919420067815:4642] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:17.281523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894919420067815:4642] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:17.282664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:17.285040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:17.285286Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:17.285297Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:17.285309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:17.285373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:17.285416Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894919330342384:4017]
2025-09-30T14:51:17.285431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894919420067815:4642] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:17.285447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894919420067815:4642] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:17.285452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894919420067815:4642] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:17.285461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 368 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:17.286032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:17.286340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:17.286389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:17.286731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:17.286821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:17.286827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:17.286829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:17.286830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:17.286831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:17.286833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:17.286834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:17.286835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:17.286836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:17.286838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:17.286839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.286840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.286841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.286842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:17.286843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:17.286849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:17.286861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:17.286866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:17.286872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:17.286876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:17.286880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:17.286885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:17.286890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:17.286895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:17.286899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:17.286903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.286907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.286910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.286913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:17.286917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:17.286927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:17.286936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:17.286942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:17.286965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:17.286976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:17.286982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:17.286986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:17.286996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:17.287002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:17.287009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:17.287017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:17.287022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:17.287027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:17.287037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:17.287041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:17.287046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:17.287057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:17.287063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:17.287072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:17.287077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:17.287086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.287091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.287100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.287105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.287109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.287118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.287123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:17.287128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:17.287134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:17.287144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:17.287195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:17.292777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:17.293982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:17.294004Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:17.294007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:17.294011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:17.294017Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 367 [2:7555894919330342384:4017]
2025-09-30T14:51:17.294032Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:17.294050Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:17.294052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:17.294056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:17.294058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:17.294073Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:17.294088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:17.294100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:17.294160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.294175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.294177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.294180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:17.294183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:17.294252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:17.294259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.294274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.294292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.294316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:17.294340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894919420067921:4642], now have 1 active actors on pipe
2025-09-30T14:51:17.294350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894919420067729:2454], now have 1 active actors on pipe
2025-09-30T14:51:17.294356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894919330342379:4017]
2025-09-30T14:51:17.294359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894919330342379:4017]
2025-09-30T14:51:17.294361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894919330342379:4017]
2025-09-30T14:51:17.294374Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:17.294392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:17.294373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 367
2025-09-30T14:51:17.294396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:17.294400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:17.294403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:17.294387Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 367
2025-09-30T14:51:17.294413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:17.294418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:17.294465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:17.294474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:17.294492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894919330342379:4017]
2025-09-30T14:51:17.294505Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:17.294517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:17.294535Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a7e35a5-416fe105-dcad8f27-9b8c0b0a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:17.294560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:17.294570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:17.294573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:17.294585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:17.294596Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:17.294628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:17.294763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:17.294774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:17.294792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:17.294872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 368 partition: 0 MaxSeqNo: 42 sessionId: src_id|3a7e35a5-416fe105-dcad8f27-9b8c0b0a_0
2025-09-30T14:51:17.295278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c395d3-e685f952-bb2cc4fb-31a92148_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3a7e35a5-416fe105-dcad8f27-9b8c0b0a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:17.298081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a7e35a5-416fe105-dcad8f27-9b8c0b0a_0] Write session: try to update token
2025-09-30T14:51:17.298099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a7e35a5-416fe105-dcad8f27-9b8c0b0a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:17.307089Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:17.307108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:17.307111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:17.307113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:17.307122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894919330342379:4017]
2025-09-30T14:51:17.307127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894919330342379:4017]
2025-09-30T14:51:17.307132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894919330342379:4017]
2025-09-30T14:51:17.307172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:17.307178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.307182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:17.307193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:17.307224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:17.307232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:17.307345Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:17.313401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 368 sessionId: src_id|3a7e35a5-416fe105-dcad8f27-9b8c0b0a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:17.317676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:17.367511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894919420067933:4267]
2025-09-30T14:51:17.367844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 367, pipe: [1:7555894919420067933:4267]
2025-09-30T14:51:17.420986Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:17.421348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:17.421361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:17.421378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894919420067933:4267], now have 1 active actors on pipe
2025-09-30T14:51:17.421544Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:17.421602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:17.421617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:17.421659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:17.421677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 368 reason: error at write: Disconnected sessionId: src_id|3a7e35a5-416fe105-dcad8f27-9b8c0b0a_0
2025-09-30T14:51:17.421709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894919420067933:4267]
2025-09-30T14:51:17.421910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 368 sessionId: src_id|3a7e35a5-416fe105-dcad8f27-9b8c0b0a_0 is DEAD
2025-09-30T14:51:17.422045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a7e35a5-416fe105-dcad8f27-9b8c0b0a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:17.422055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a7e35a5-416fe105-dcad8f27-9b8c0b0a_0] Write session will restart in 0.008370s
2025-09-30T14:51:17.422071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a7e35a5-416fe105-dcad8f27-9b8c0b0a_0] Write session: Do CDS request
2025-09-30T14:51:17.422075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a7e35a5-416fe105-dcad8f27-9b8c0b0a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:17.431752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a7e35a5-416fe105-dcad8f27-9b8c0b0a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:17.431866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:17.431890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 369
2025-09-30T14:51:17.432036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 369 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:17.432082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 369 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:17.432093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=369 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:17.432097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:17.432542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 369 sessionId:  describe result for acl check
2025-09-30T14:51:17.432594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:17.432597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:17.432599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:17.432605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894919420068051:4646] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:17.433185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894919420068051:4646] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:17.435145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:17.435411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894919420068051:4646] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:17.437547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:17.437743Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:17.437753Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:17.437764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:17.437819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:17.437859Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894919330342581:4019]
2025-09-30T14:51:17.438088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894919420068051:4646] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:17.438110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894919420068051:4646] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:17.438115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894919420068051:4646] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:17.438127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 369 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:17.438578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:17.438848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:17.438897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:17.439236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:17.439328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:17.439337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:17.439338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:17.439339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:17.439341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:17.439342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:17.439343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:17.439344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:17.439346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:17.439347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:17.439348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.439349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.439350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.439352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:17.439353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:17.439358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:17.439368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:17.439371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:17.439375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:17.439378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:17.439382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:17.439386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:17.439389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:17.439393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:17.439398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:17.439401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.439405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.439409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.439413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:17.439416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:17.439423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:17.439431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:17.439437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:17.439442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:17.439446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:17.439451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:17.439455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:17.439461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:17.439466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:17.439470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:17.439475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:17.439480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:17.439484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:17.439490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:17.439495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:17.439500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:17.439504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:17.439510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:17.439514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:17.439520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:17.439530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.439536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.439541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.439546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.439550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.439555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.439559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:17.439564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:17.439574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:17.439578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:17.439626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:17.445216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:17.446472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:17.446489Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:17.446491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:17.446496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:17.446503Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 368 [2:7555894919330342581:4019]
2025-09-30T14:51:17.446522Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:17.446538Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:17.446541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:17.446556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:17.446558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:17.446571Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:17.446581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:17.446590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:17.446644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.446652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.446654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.446656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:17.446658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:17.446711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:17.446718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.446732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.446743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.446762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:17.446784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894919330342576:4019]
2025-09-30T14:51:17.446792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894919330342576:4019]
2025-09-30T14:51:17.446793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894919330342576:4019]
2025-09-30T14:51:17.446802Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:17.446812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:17.446815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:17.446822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:17.446825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:17.446830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:17.446833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:17.446843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894919420068127:4646], now have 1 active actors on pipe
2025-09-30T14:51:17.446852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894919420067934:2454], now have 1 active actors on pipe
2025-09-30T14:51:17.446880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894919330342576:4019]
2025-09-30T14:51:17.446891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:17.446913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:17.446915Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 368
2025-09-30T14:51:17.446918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 368
2025-09-30T14:51:17.447009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:17.447020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:17.447047Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|917eb2ce-2d782c30-39950c36-d93590e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:17.447060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:17.447068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:17.447071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:17.447080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:17.447090Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:17.447109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:17.447272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:17.447279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:17.447293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:17.447380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 369 partition: 0 MaxSeqNo: 42 sessionId: src_id|917eb2ce-2d782c30-39950c36-d93590e3_0
2025-09-30T14:51:17.447782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a7e35a5-416fe105-dcad8f27-9b8c0b0a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|917eb2ce-2d782c30-39950c36-d93590e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:17.450714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|917eb2ce-2d782c30-39950c36-d93590e3_0] Write session: try to update token
2025-09-30T14:51:17.450730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|917eb2ce-2d782c30-39950c36-d93590e3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:17.458964Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:17.458987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:17.458989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:17.458992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:17.459001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894919330342576:4019]
2025-09-30T14:51:17.459005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894919330342576:4019]
2025-09-30T14:51:17.459010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894919330342576:4019]
2025-09-30T14:51:17.459048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:17.459060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.459068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:17.459069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:17.459075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:17.459078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:17.459203Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:17.465550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 369 sessionId: src_id|917eb2ce-2d782c30-39950c36-d93590e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:17.468263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:17.522093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894919420068141:4267]
2025-09-30T14:51:17.522323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 368, pipe: [1:7555894919420068141:4267]
2025-09-30T14:51:17.564025Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:17.564301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:17.564317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:17.564335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894919420068141:4267], now have 1 active actors on pipe
2025-09-30T14:51:17.564541Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:17.564572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894919420068141:4267]
2025-09-30T14:51:17.564600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:17.564602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:17.564638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:17.564654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 369 reason: error at write: Disconnected sessionId: src_id|917eb2ce-2d782c30-39950c36-d93590e3_0
2025-09-30T14:51:17.564851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 369 sessionId: src_id|917eb2ce-2d782c30-39950c36-d93590e3_0 is DEAD
2025-09-30T14:51:17.565003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|917eb2ce-2d782c30-39950c36-d93590e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:17.565016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|917eb2ce-2d782c30-39950c36-d93590e3_0] Write session will restart in 0.006433s
2025-09-30T14:51:17.565042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|917eb2ce-2d782c30-39950c36-d93590e3_0] Write session: Do CDS request
2025-09-30T14:51:17.565054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|917eb2ce-2d782c30-39950c36-d93590e3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:17.572796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|917eb2ce-2d782c30-39950c36-d93590e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:17.572898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:17.572914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 370
2025-09-30T14:51:17.573072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 370 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:17.573109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 370 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:17.573120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=370 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:17.573125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:17.573654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 370 sessionId:  describe result for acl check
2025-09-30T14:51:17.573698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:17.573704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:17.573706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:17.573712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894919420068194:4651] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:17.574246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894919420068194:4651] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:17.576245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894919420068194:4651] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:17.578099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:17.580088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:17.580247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894919420068194:4651] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:17.580260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894919420068194:4651] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:17.580264Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:17.580262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894919420068194:4651] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:17.580271Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:17.580269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 370 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:17.580279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:17.580319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:17.580347Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894919330342780:4022]
2025-09-30T14:51:17.580788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:17.580992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:17.581023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:17.581238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:17.581274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:17.581279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:17.581280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:17.581281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:17.581281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:17.581282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:17.581283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:17.581284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:17.581285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:17.581285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:17.581286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.581286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.581287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.581288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:17.581289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:17.581292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:17.581299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:17.581301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:17.581303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:17.581306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:17.581308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:17.581311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:17.581313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:17.581315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:17.581318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:17.581320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.581322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.581324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.581327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:17.581329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:17.581334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:17.581339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:17.581343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:17.581346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:17.581349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:17.581352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:17.581355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:17.581358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:17.581360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:17.581363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:17.581366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:17.581369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:17.581371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:17.581374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:17.581377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:17.581380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:17.581382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:17.581385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:17.581387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:17.581390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:17.581393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.581396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.581398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.581401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.581405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.581411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.581414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:17.581417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:17.581420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:17.581423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:17.581449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:17.586328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:17.587144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:17.587159Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:17.587160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:17.587163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:17.587168Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 369 [2:7555894919330342780:4022]
2025-09-30T14:51:17.587178Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:17.587189Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:17.587191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:17.587193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:17.587195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:17.587206Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:17.587211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:17.587216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:17.587275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.587282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.587283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.587286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:17.587287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:17.587337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:17.587343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.587350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.587360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.587373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:17.587389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894919420068336:4651], now have 1 active actors on pipe
2025-09-30T14:51:17.587397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894919330342775:4022]
2025-09-30T14:51:17.587399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894919330342775:4022]
2025-09-30T14:51:17.587400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894919330342775:4022]
2025-09-30T14:51:17.587409Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:17.587419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894919420068142:2454], now have 1 active actors on pipe
2025-09-30T14:51:17.587425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:17.587433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:17.587433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:17.587436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:17.587438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:17.587439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:17.587458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894919330342775:4022]
2025-09-30T14:51:17.587467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:17.587472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:17.587504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 369
2025-09-30T14:51:17.587507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 369
2025-09-30T14:51:17.587574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:17.587582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:17.587604Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1244f2e8-5805827d-41b0eb8c-7c5bce78_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:17.587613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:17.587616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:17.587617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:17.587624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:17.587635Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:17.587648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:17.587788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:17.587794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:17.587804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:17.587875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 370 partition: 0 MaxSeqNo: 42 sessionId: src_id|1244f2e8-5805827d-41b0eb8c-7c5bce78_0
2025-09-30T14:51:17.588262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|917eb2ce-2d782c30-39950c36-d93590e3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1244f2e8-5805827d-41b0eb8c-7c5bce78_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:17.590991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1244f2e8-5805827d-41b0eb8c-7c5bce78_0] Write session: try to update token
2025-09-30T14:51:17.591006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1244f2e8-5805827d-41b0eb8c-7c5bce78_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:17.604617Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:17.604641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:17.604650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894919330342775:4022]
2025-09-30T14:51:17.604685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:17.604693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:17.604868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:17.605016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:17.605148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:17.605279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:17.605428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 370 sessionId: src_id|1244f2e8-5805827d-41b0eb8c-7c5bce78_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:17.605473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:17.605520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:17.608244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:17.609312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:17.609339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:17.609356Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:17.609359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:17.609365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:17.609372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:17.609379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894919330342775:4022]
2025-09-30T14:51:17.609383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894919330342775:4022]
2025-09-30T14:51:17.609386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894919330342775:4022]
2025-09-30T14:51:17.609427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:17.609438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:17.609440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.609442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:17.609446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:17.609450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:17.609577Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:17.664965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894919420068370:4267]
2025-09-30T14:51:17.665206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 369, pipe: [1:7555894919420068370:4267]
2025-09-30T14:51:17.718737Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:17.719225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:17.719277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894919420068370:4267], now have 1 active actors on pipe
2025-09-30T14:51:17.719367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:17.719436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894919420068370:4267]
2025-09-30T14:51:17.719456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:17.719474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:17.719477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:17.719555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 370 reason: error at write: Disconnected sessionId: src_id|1244f2e8-5805827d-41b0eb8c-7c5bce78_0
2025-09-30T14:51:17.719729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 370 sessionId: src_id|1244f2e8-5805827d-41b0eb8c-7c5bce78_0 is DEAD
2025-09-30T14:51:17.719870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1244f2e8-5805827d-41b0eb8c-7c5bce78_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:17.719892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1244f2e8-5805827d-41b0eb8c-7c5bce78_0] Write session will restart in 0.009999s
2025-09-30T14:51:17.719915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1244f2e8-5805827d-41b0eb8c-7c5bce78_0] Write session: Do CDS request
2025-09-30T14:51:17.719921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1244f2e8-5805827d-41b0eb8c-7c5bce78_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:17.730787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1244f2e8-5805827d-41b0eb8c-7c5bce78_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:17.731166Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:17.731183Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 371
2025-09-30T14:51:17.731315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 371 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:17.731349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 371 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:17.731355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=371 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:17.731359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:17.731861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 371 sessionId:  describe result for acl check
2025-09-30T14:51:17.731902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:17.731910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:17.731912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:17.731918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894919420068529:4662] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:17.732455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894919420068529:4662] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:17.733766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:17.734377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894919420068529:4662] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:17.736012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:17.736197Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:17.736209Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:17.736219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:17.736274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:17.736331Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894919330343015:4036]
2025-09-30T14:51:17.737025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:17.737263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:17.737265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894919420068529:4662] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:17.737280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894919420068529:4662] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:17.737282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894919420068529:4662] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:17.737289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 371 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:17.737305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:17.737631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:17.737692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:17.737700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:17.737701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:17.737703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:17.737704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:17.737705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:17.737706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:17.737708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:17.737709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:17.737710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:17.737712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.737713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.737714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.737716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:17.737717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:17.737722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:17.737733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:17.737738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:17.737742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:17.737746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:17.737751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:17.737755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:17.737760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:17.737764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:17.737769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:17.737774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.737778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.737782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.737786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:17.737790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:17.737797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:17.737805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:17.737812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:17.737818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:17.737822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:17.737828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:17.737833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:17.737844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:17.737854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:17.737865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:17.737873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:17.737884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:17.737893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:17.737903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:17.737912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:17.737918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:17.737927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:17.737937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:17.737946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:17.737958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:17.737968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.737978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.737986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.737996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.738005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.738015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.738024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:17.738034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:17.738044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:17.738054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:17.738104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:17.743218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:17.744097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:17.744114Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:17.744117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:17.744121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:17.744128Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 370 [2:7555894919330343015:4036]
2025-09-30T14:51:17.744143Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:17.744163Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:17.744171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:17.744175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:17.744182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:17.744198Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:17.744209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:17.744221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:17.744282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.744290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.744292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.744296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:17.744299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:17.744368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:17.744376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.744389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.744407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.744431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:17.744454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894919420068371:2454], now have 1 active actors on pipe
2025-09-30T14:51:17.744463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894919420068568:4662], now have 1 active actors on pipe
2025-09-30T14:51:17.744470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894919330343010:4036]
2025-09-30T14:51:17.744478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894919330343010:4036]
2025-09-30T14:51:17.744481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894919330343010:4036]
2025-09-30T14:51:17.744492Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:17.744505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:17.744509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:17.744510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 370
2025-09-30T14:51:17.744511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:17.744531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 370
2025-09-30T14:51:17.744516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:17.744532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:17.744535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:17.744579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:17.744590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:17.744605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894919330343010:4036]
2025-09-30T14:51:17.744621Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:17.744642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:17.744657Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9faaffd-b7b0b34c-e7889d2e-2e5cd63a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:17.744670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:17.744674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:17.744681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:17.744691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:17.744706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:17.744980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:17.745157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:17.745167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:17.745182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:17.745257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 371 partition: 0 MaxSeqNo: 42 sessionId: src_id|f9faaffd-b7b0b34c-e7889d2e-2e5cd63a_0
2025-09-30T14:51:17.745640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1244f2e8-5805827d-41b0eb8c-7c5bce78_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f9faaffd-b7b0b34c-e7889d2e-2e5cd63a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:17.748341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9faaffd-b7b0b34c-e7889d2e-2e5cd63a_0] Write session: try to update token
2025-09-30T14:51:17.748359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9faaffd-b7b0b34c-e7889d2e-2e5cd63a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:17.756336Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:17.756361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:17.756364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:17.756366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:17.756374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894919330343010:4036]
2025-09-30T14:51:17.756379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894919330343010:4036]
2025-09-30T14:51:17.756382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894919330343010:4036]
2025-09-30T14:51:17.756422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:17.756424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:17.756431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:17.756435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:17.756437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.756440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:17.756574Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:17.762358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 371 sessionId: src_id|f9faaffd-b7b0b34c-e7889d2e-2e5cd63a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:17.764954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:17.819549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894919420068589:4267]
2025-09-30T14:51:17.819677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 370, pipe: [1:7555894919420068589:4267]
2025-09-30T14:51:17.876214Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:17.876592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:17.876603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:17.876635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894919420068589:4267], now have 1 active actors on pipe
2025-09-30T14:51:17.876807Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:17.876898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:17.876906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:17.876910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:17.876964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894919420068589:4267]
2025-09-30T14:51:17.876969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 371 reason: error at write: Disconnected sessionId: src_id|f9faaffd-b7b0b34c-e7889d2e-2e5cd63a_0
2025-09-30T14:51:17.877130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 371 sessionId: src_id|f9faaffd-b7b0b34c-e7889d2e-2e5cd63a_0 is DEAD
2025-09-30T14:51:17.877261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9faaffd-b7b0b34c-e7889d2e-2e5cd63a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:17.877270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9faaffd-b7b0b34c-e7889d2e-2e5cd63a_0] Write session will restart in 0.006786s
2025-09-30T14:51:17.877287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9faaffd-b7b0b34c-e7889d2e-2e5cd63a_0] Write session: Do CDS request
2025-09-30T14:51:17.877294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9faaffd-b7b0b34c-e7889d2e-2e5cd63a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:17.884768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9faaffd-b7b0b34c-e7889d2e-2e5cd63a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:17.884863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:17.884879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 372
2025-09-30T14:51:17.885020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 372 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:17.885053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 372 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:17.885058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=372 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:17.885062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:17.885515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 372 sessionId:  describe result for acl check
2025-09-30T14:51:17.885553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:17.885560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:17.885562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:17.885569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894919420068641:4667] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:17.886109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894919420068641:4667] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:17.888547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894919420068641:4667] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:17.890517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:17.890711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894919420068641:4667] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:17.890723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894919420068641:4667] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:17.890727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894919420068641:4667] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:17.890734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 372 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:17.892579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:17.892754Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:17.892766Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:17.892777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:17.892824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:17.892860Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894919330343228:4039]
2025-09-30T14:51:17.893496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:17.893806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:17.893845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:17.894166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:17.894220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:17.894226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:17.894227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:17.894228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:17.894230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:17.894231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:17.894232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:17.894233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:17.894234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:17.894235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:17.894236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.894237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.894238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.894239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:17.894240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:17.894245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:17.894256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:17.894260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:17.894264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:17.894268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:17.894272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:17.894276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:17.894280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:17.894283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:17.894289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:17.894293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.894297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.894301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.894305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:17.894309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:17.894317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:17.894325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:17.894330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:17.894336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:17.894341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:17.894346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:17.894350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:17.894354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:17.894358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:17.894364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:17.894368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:17.894372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:17.894376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:17.894382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:17.894386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:17.894390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:17.894401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:17.894406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:17.894415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:17.894420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:17.894426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.894435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.894439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.894449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.894454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.894463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.894467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:17.894472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:17.894481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:17.894486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:17.894530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:17.899891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:17.901137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:17.901156Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:17.901158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:17.901162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:17.901169Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 371 [2:7555894919330343228:4039]
2025-09-30T14:51:17.901184Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:17.901201Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:17.901209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:17.901212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:17.901214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:17.901230Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:17.901237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:17.901248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:17.901310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.901318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.901320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.901324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:17.901327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:17.901393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:17.901401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.901414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:17.901429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:17.901446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:17.901470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894919420068591:2454], now have 1 active actors on pipe
2025-09-30T14:51:17.901478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894919420068787:4667], now have 1 active actors on pipe
2025-09-30T14:51:17.901484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894919330343222:4039]
2025-09-30T14:51:17.901486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894919330343222:4039]
2025-09-30T14:51:17.901488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894919330343222:4039]
2025-09-30T14:51:17.901501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:17.901521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:17.901530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:17.901534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:17.901535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:17.901536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:17.901539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:17.901565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894919330343222:4039]
2025-09-30T14:51:17.901573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:17.901575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:17.901546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 371
2025-09-30T14:51:17.901547Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 371
2025-09-30T14:51:17.901595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:17.901605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:17.901641Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|222e8586-fd60961e-a569c054-e767134c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:17.901652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:17.901660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:17.901662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:17.901673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:17.901686Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:17.901707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:17.901876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:17.901884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:17.901898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:17.901981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 372 partition: 0 MaxSeqNo: 42 sessionId: src_id|222e8586-fd60961e-a569c054-e767134c_0
2025-09-30T14:51:17.902314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9faaffd-b7b0b34c-e7889d2e-2e5cd63a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|222e8586-fd60961e-a569c054-e767134c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:17.904904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|222e8586-fd60961e-a569c054-e767134c_0] Write session: try to update token
2025-09-30T14:51:17.904918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|222e8586-fd60961e-a569c054-e767134c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:17.913481Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:17.913501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:17.913504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:17.913506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:17.913516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894919330343222:4039]
2025-09-30T14:51:17.913521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894919330343222:4039]
2025-09-30T14:51:17.913526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894919330343222:4039]
2025-09-30T14:51:17.913563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:17.913574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:17.913581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:17.913585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:17.913591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:17.913596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:17.913722Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:17.919134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 372 sessionId: src_id|222e8586-fd60961e-a569c054-e767134c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:17.921738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:17.955556Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:11802 } ]
2025-09-30T14:51:17.977270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894919420068815:4267]
2025-09-30T14:51:17.977532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 371, pipe: [1:7555894919420068815:4267]
2025-09-30T14:51:18.018747Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:18.019148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:18.019164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:18.019202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894919420068815:4267], now have 1 active actors on pipe
2025-09-30T14:51:18.019422Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:18.019432Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:18.019468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:18.019472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:18.019477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894919420068815:4267]
2025-09-30T14:51:18.019532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 372 reason: error at write: Disconnected sessionId: src_id|222e8586-fd60961e-a569c054-e767134c_0
2025-09-30T14:51:18.019679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 372 sessionId: src_id|222e8586-fd60961e-a569c054-e767134c_0 is DEAD
2025-09-30T14:51:18.019827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|222e8586-fd60961e-a569c054-e767134c_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 117 BytesWritten: 94617674 MessagesWritten: 42 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 13516812 MessagesInflight: 10 }
2025-09-30T14:51:18.019850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|222e8586-fd60961e-a569c054-e767134c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:18.019853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|222e8586-fd60961e-a569c054-e767134c_0] Write session will restart in 0.005203s
2025-09-30T14:51:18.019870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|222e8586-fd60961e-a569c054-e767134c_0] Write session: Do CDS request
2025-09-30T14:51:18.019875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|222e8586-fd60961e-a569c054-e767134c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:18.025682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|222e8586-fd60961e-a569c054-e767134c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:18.025781Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:18.025795Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 373
2025-09-30T14:51:18.025910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 373 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:18.025942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 373 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:18.025952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=373 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:18.025956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:18.026371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 373 sessionId:  describe result for acl check
2025-09-30T14:51:18.026406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:18.026408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:18.026410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:18.026415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894923715036130:4681] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:18.026951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894923715036130:4681] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:18.029283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894923715036130:4681] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:18.031812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894923715036130:4681] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:18.031826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894923715036130:4681] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:18.031829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894923715036130:4681] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:18.031834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 373 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:18.032856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:18.034980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:18.035144Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:18.035153Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:18.035164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:18.035214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:18.035265Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894923625310727:4042]
2025-09-30T14:51:18.035902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:18.036224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:18.036267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:18.036588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:18.036640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:18.036646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:18.036648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:18.036648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:18.036650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:18.036651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:18.036652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:18.036653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:18.036655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:18.036656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:18.036657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.036658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.036659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.036660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:18.036661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:18.036667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:18.036677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:18.036681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:18.036685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:18.036689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:18.036693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:18.036697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:18.036701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:18.036705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:18.036709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:18.036713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.036717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.036721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.036725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:18.036733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:18.036740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:18.036752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:18.036758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:18.036763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:18.036768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:18.036773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:18.036778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:18.036788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:18.036797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:18.036802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:18.036811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:18.036816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:18.036824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:18.036830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:18.036838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:18.036843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:18.036848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:18.036858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:18.036863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:18.036867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:18.036876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.036881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.036891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.036896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.036905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.036910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.036920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:18.036925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:18.036935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:18.036941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:18.036987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:18.042167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:18.043022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:18.043039Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:18.043041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:18.043045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:18.043052Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 372 [2:7555894923625310727:4042]
2025-09-30T14:51:18.043067Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:18.043082Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:18.043086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.043089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.043091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.043105Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:18.043117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:18.043129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:18.043186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.043194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.043197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.043200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:18.043203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:18.043280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:18.043289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.043302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.043313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.043329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:18.043351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894923715036112:2454], now have 1 active actors on pipe
2025-09-30T14:51:18.043360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894923715036309:4681], now have 1 active actors on pipe
2025-09-30T14:51:18.043366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894923625310722:4042]
2025-09-30T14:51:18.043368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894923625310722:4042]
2025-09-30T14:51:18.043371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894923625310722:4042]
2025-09-30T14:51:18.043383Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:18.043393Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 372
2025-09-30T14:51:18.043400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:18.043419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:18.043423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:18.043423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:18.043425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:18.043427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:18.043454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 372
2025-09-30T14:51:18.043461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894923625310722:4042]
2025-09-30T14:51:18.043469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:18.043479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:18.043500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:18.043508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:18.043539Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f8c04a5-61add5a6-369c1db2-79bede61_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:18.043550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.043560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.043562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:18.043570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.043579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:18.043593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:18.043742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:18.043750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:18.043762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:18.043849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 373 partition: 0 MaxSeqNo: 42 sessionId: src_id|5f8c04a5-61add5a6-369c1db2-79bede61_0
2025-09-30T14:51:18.044204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|222e8586-fd60961e-a569c054-e767134c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5f8c04a5-61add5a6-369c1db2-79bede61_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:18.046937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f8c04a5-61add5a6-369c1db2-79bede61_0] Write session: try to update token
2025-09-30T14:51:18.046957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f8c04a5-61add5a6-369c1db2-79bede61_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:18.054868Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:18.054888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:18.054891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:18.054893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:18.054901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894923625310722:4042]
2025-09-30T14:51:18.054908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894923625310722:4042]
2025-09-30T14:51:18.054913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894923625310722:4042]
2025-09-30T14:51:18.054952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:18.054958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.054961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:18.054974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:18.054980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:18.054984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:18.055087Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:18.061225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 373 sessionId: src_id|5f8c04a5-61add5a6-369c1db2-79bede61_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:18.063944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:18.119599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894923715036326:4267]
2025-09-30T14:51:18.119835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 372, pipe: [1:7555894923715036326:4267]
2025-09-30T14:51:18.164928Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:18.165563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:18.165578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:18.165598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894923715036326:4267], now have 1 active actors on pipe
2025-09-30T14:51:18.165848Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:18.165859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:18.165912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894923715036326:4267]
2025-09-30T14:51:18.165914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:18.165985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 373 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5f8c04a5-61add5a6-369c1db2-79bede61_0
2025-09-30T14:51:18.166197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 373 sessionId: src_id|5f8c04a5-61add5a6-369c1db2-79bede61_0 is DEAD
2025-09-30T14:51:18.166353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f8c04a5-61add5a6-369c1db2-79bede61_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:18.166363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f8c04a5-61add5a6-369c1db2-79bede61_0] Write session will restart in 0.005014s
2025-09-30T14:51:18.166386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f8c04a5-61add5a6-369c1db2-79bede61_0] Write session: Do CDS request
2025-09-30T14:51:18.166392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f8c04a5-61add5a6-369c1db2-79bede61_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:18.172730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f8c04a5-61add5a6-369c1db2-79bede61_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:18.172819Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:18.172830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 374
2025-09-30T14:51:18.172969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 374 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:18.173000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 374 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:18.173009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=374 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:18.173013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:18.173450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 374 sessionId:  describe result for acl check
2025-09-30T14:51:18.173485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:18.173493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:18.173495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:18.173500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894923715036383:4685] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:18.173992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894923715036383:4685] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:18.176066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894923715036383:4685] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:18.177490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:18.179769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:18.179913Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:18.179923Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:18.179931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:18.179970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:18.179997Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894923625310928:4044]
2025-09-30T14:51:18.180125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894923715036383:4685] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:18.180136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894923715036383:4685] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:18.180139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894923715036383:4685] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:18.180144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 374 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:18.180783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:18.181026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:18.181058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:18.181449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:18.181506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:18.181512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:18.181513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:18.181514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:18.181515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:18.181516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:18.181517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:18.181518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:18.181520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:18.181521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:18.181522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.181523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.181524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.181526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:18.181527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:18.181532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:18.181541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:18.181545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:18.181550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:18.181554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:18.181558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:18.181562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:18.181566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:18.181570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:18.181574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:18.181578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.181582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.181591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.181598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:18.181601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:18.181606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:18.181615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:18.181623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:18.181628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:18.181637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:18.181647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:18.181652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:18.181658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:18.181662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:18.181668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:18.181672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:18.181681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:18.181690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:18.181695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:18.181703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:18.181708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:18.181717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:18.181726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:18.181734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:18.181740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:18.181749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.181758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.181762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.181768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.181772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.181777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.181781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:18.181786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:18.181792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:18.181801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:18.181830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:18.187205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:18.188052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:18.188065Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:18.188067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:18.188071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:18.188076Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 373 [2:7555894923625310928:4044]
2025-09-30T14:51:18.188088Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:18.188102Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:18.188104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.188106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.188108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.188120Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:18.188126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:18.188136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:18.188194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.188199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.188201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.188204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:18.188207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:18.188267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:18.188273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.188282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.188292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.188305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:18.188323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894923625310922:4044]
2025-09-30T14:51:18.188329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894923625310922:4044]
2025-09-30T14:51:18.188330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894923625310922:4044]
2025-09-30T14:51:18.188339Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:18.188351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:18.188359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:18.188365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:18.188365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:18.188367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:18.188367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:18.188375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894923715036526:4685], now have 1 active actors on pipe
2025-09-30T14:51:18.188379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894923715036328:2454], now have 1 active actors on pipe
2025-09-30T14:51:18.188404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894923625310922:4044]
2025-09-30T14:51:18.188409Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:18.188418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:18.188435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 373
2025-09-30T14:51:18.188435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 373
2025-09-30T14:51:18.188567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:18.188577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:18.188602Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da9e2cc2-16ad50d1-51344de0-48797747_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:18.188612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.188615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.188617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:18.188625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.188637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:18.188651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:18.188805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:18.188812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:18.188831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:18.188927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 374 partition: 0 MaxSeqNo: 42 sessionId: src_id|da9e2cc2-16ad50d1-51344de0-48797747_0
2025-09-30T14:51:18.189293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f8c04a5-61add5a6-369c1db2-79bede61_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|da9e2cc2-16ad50d1-51344de0-48797747_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:18.192173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da9e2cc2-16ad50d1-51344de0-48797747_0] Write session: try to update token
2025-09-30T14:51:18.192191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da9e2cc2-16ad50d1-51344de0-48797747_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:18.200239Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:18.200257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:18.200267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894923625310922:4044]
2025-09-30T14:51:18.200307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:18.200332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:18.200470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:18.200601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:18.200735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:18.200865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:18.201042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:18.201077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:18.206408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 374 sessionId: src_id|da9e2cc2-16ad50d1-51344de0-48797747_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:18.208975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:18.209161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:18.209178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:18.209219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:18.209332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:18.210552Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:18.210563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:18.210564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:18.210566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:18.210573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894923625310922:4044]
2025-09-30T14:51:18.210576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894923625310922:4044]
2025-09-30T14:51:18.210580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894923625310922:4044]
2025-09-30T14:51:18.210610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:18.210615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:18.210619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.210620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:18.210621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:18.210623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:18.210751Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:18.266044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894923715036537:4267]
2025-09-30T14:51:18.266282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 373, pipe: [1:7555894923715036537:4267]
2025-09-30T14:51:18.318473Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:18.325550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:18.325572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:18.325722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:18.325780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:18.325840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:18.325902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:18.325945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:18.325956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:18.326021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:18.326081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:18.326141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:18.326204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:18.326247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:18.326253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:18.326317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:18.326375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:18.326433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:18.326492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:18.326534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:18.326560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:18.326623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:18.326684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:18.326742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:18.326804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:18.326845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:18.326850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:18.326911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:18.326968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:18.327031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:18.327090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:18.327133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:18.327139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:18.327201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:18.327282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:18.327341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:18.327403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:18.327445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:18.327451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:18.327512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:18.327568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:18.327631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:18.327692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:18.327734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:18.327740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:18.327802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:18.327858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:18.327915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:18.327974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:18.328014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:18.328020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:18.328079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:18.328137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:18.328196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:18.328257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:18.328297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:18.328302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:18.328362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:18.328418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:18.328481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:18.328538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:18.328580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:18.328585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:18.328626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894923715036537:4267], now have 1 active actors on pipe
2025-09-30T14:51:18.328907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:18.328910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894923715036537:4267]
2025-09-30T14:51:18.328921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:18.328949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:18.328950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 374 reason: error at write: Disconnected sessionId: src_id|da9e2cc2-16ad50d1-51344de0-48797747_0
2025-09-30T14:51:18.329161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 374 sessionId: src_id|da9e2cc2-16ad50d1-51344de0-48797747_0 is DEAD
2025-09-30T14:51:18.329304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da9e2cc2-16ad50d1-51344de0-48797747_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:18.329314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da9e2cc2-16ad50d1-51344de0-48797747_0] Write session will restart in 0.005533s
2025-09-30T14:51:18.329336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da9e2cc2-16ad50d1-51344de0-48797747_0] Write session: Do CDS request
2025-09-30T14:51:18.329341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da9e2cc2-16ad50d1-51344de0-48797747_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:18.329629Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:18.335736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da9e2cc2-16ad50d1-51344de0-48797747_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:18.335824Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:18.335839Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 375
2025-09-30T14:51:18.336328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 375 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:18.336362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 375 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:18.336371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=375 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:18.336376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:18.336900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 375 sessionId:  describe result for acl check
2025-09-30T14:51:18.336932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:18.336937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:18.336938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:18.336942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894923715036568:4689] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:18.337381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894923715036568:4689] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:18.340383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894923715036568:4689] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:18.342965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894923715036568:4689] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:18.342979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894923715036568:4689] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:18.342983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894923715036568:4689] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:18.342996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 375 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:18.343043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:18.345190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:18.345402Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:18.345412Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:18.345422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:18.345478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:18.345515Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894923625311132:4046]
2025-09-30T14:51:18.346173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:18.346451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:18.346491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:18.346833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:18.346884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:18.346890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:18.346891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:18.346892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:18.346894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:18.346895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:18.346896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:18.346897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:18.346898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:18.346899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:18.346901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.346902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.346903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.346904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:18.346905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:18.346910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:18.346921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:18.346924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:18.346928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:18.346931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:18.346934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:18.346938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:18.346942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:18.346946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:18.346950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:18.346954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.346958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.346962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.346967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:18.346975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:18.346983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:18.346995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:18.347004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:18.347014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:18.347023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:18.347030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:18.347038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:18.347048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:18.347057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:18.347066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:18.347071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:18.347076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:18.347082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:18.347087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:18.347097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:18.347107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:18.347115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:18.347124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:18.347133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:18.347138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:18.347148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.347158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.347166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.347175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.347183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.347192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.347200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:18.347205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:18.347214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:18.347223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:18.347282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:18.352671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:18.353766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:18.353780Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:18.353783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:18.353786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:18.353793Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 374 [2:7555894923625311132:4046]
2025-09-30T14:51:18.353807Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:18.353823Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:18.353825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.353829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.353831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.353845Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:18.353852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:18.353859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:18.353923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.353930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.353932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.353935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:18.353937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:18.354003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:18.354009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.354021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.354038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.354060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:18.354081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894923715036737:4689], now have 1 active actors on pipe
2025-09-30T14:51:18.354089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894923715036539:2454], now have 1 active actors on pipe
2025-09-30T14:51:18.354095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894923625311126:4046]
2025-09-30T14:51:18.354098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894923625311126:4046]
2025-09-30T14:51:18.354100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894923625311126:4046]
2025-09-30T14:51:18.354111Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:18.354124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:18.354127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:18.354128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:18.354130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:18.354145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:18.354148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:18.354131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 374
2025-09-30T14:51:18.354176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894923625311126:4046]
2025-09-30T14:51:18.354190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:18.354196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:18.354236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 374
2025-09-30T14:51:18.354309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:18.354319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:18.354340Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d40d15f-c972d773-83e93667-247c6f9d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:18.354351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.354355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.354357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:18.354368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.354382Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:18.354399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:18.354519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:18.354530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:18.354565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:18.354640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 375 partition: 0 MaxSeqNo: 42 sessionId: src_id|7d40d15f-c972d773-83e93667-247c6f9d_0
2025-09-30T14:51:18.355030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da9e2cc2-16ad50d1-51344de0-48797747_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7d40d15f-c972d773-83e93667-247c6f9d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:18.357961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d40d15f-c972d773-83e93667-247c6f9d_0] Write session: try to update token
2025-09-30T14:51:18.357982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d40d15f-c972d773-83e93667-247c6f9d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:18.365785Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:18.365803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:18.365805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:18.365808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:18.365819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894923625311126:4046]
2025-09-30T14:51:18.365824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894923625311126:4046]
2025-09-30T14:51:18.365828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894923625311126:4046]
2025-09-30T14:51:18.365865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:18.365869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:18.365871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.365874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:18.365874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:18.365880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:18.366003Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:18.371902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 375 sessionId: src_id|7d40d15f-c972d773-83e93667-247c6f9d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:18.374587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:18.429383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894923715036749:4267]
2025-09-30T14:51:18.429613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 374, pipe: [1:7555894923715036749:4267]
2025-09-30T14:51:18.474912Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:18.475280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:18.475296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:18.475318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894923715036749:4267], now have 1 active actors on pipe
2025-09-30T14:51:18.475527Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:18.475536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894923715036749:4267]
2025-09-30T14:51:18.475566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:18.475569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:18.475628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 375 reason: error at write: Disconnected sessionId: src_id|7d40d15f-c972d773-83e93667-247c6f9d_0
2025-09-30T14:51:18.475800Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:18.475816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 375 sessionId: src_id|7d40d15f-c972d773-83e93667-247c6f9d_0 is DEAD
2025-09-30T14:51:18.475960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d40d15f-c972d773-83e93667-247c6f9d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:18.475971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d40d15f-c972d773-83e93667-247c6f9d_0] Write session will restart in 0.009007s
2025-09-30T14:51:18.475988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d40d15f-c972d773-83e93667-247c6f9d_0] Write session: Do CDS request
2025-09-30T14:51:18.475993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d40d15f-c972d773-83e93667-247c6f9d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:18.485846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d40d15f-c972d773-83e93667-247c6f9d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:18.485908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:18.485921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 376
2025-09-30T14:51:18.486070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 376 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:18.486105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 376 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:18.486123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=376 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:18.486131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:18.486598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 376 sessionId:  describe result for acl check
2025-09-30T14:51:18.486642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:18.486649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:18.486651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:18.486658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894923715036864:4694] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:18.487214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894923715036864:4694] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:18.489167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894923715036864:4694] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:18.489742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:18.492078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:18.492258Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:18.492268Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:18.492278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:18.492323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:18.492360Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894923625311336:4049]
2025-09-30T14:51:18.492441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894923715036864:4694] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:18.492455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894923715036864:4694] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:18.492459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894923715036864:4694] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:18.492467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 376 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:18.493021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:18.493294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:18.493334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:18.493645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:18.493709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:18.493715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:18.493716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:18.493718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:18.493719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:18.493720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:18.493721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:18.493723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:18.493724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:18.493725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:18.493727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.493728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.493729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.493730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:18.493732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:18.493737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:18.493747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:18.493752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:18.493756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:18.493760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:18.493764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:18.493767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:18.493772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:18.493780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:18.493785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:18.493789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.493793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.493796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.493800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:18.493804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:18.493811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:18.493819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:18.493830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:18.493840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:18.493849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:18.493856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:18.493865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:18.493870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:18.493879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:18.493888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:18.493898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:18.493904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:18.493912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:18.493918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:18.493927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:18.493933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:18.493938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:18.493944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:18.493948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:18.493953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:18.493958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.493963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.493972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.493977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.493986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.493991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.493999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:18.494005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:18.494010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:18.494016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:18.494062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:18.499445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:18.500271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:18.500286Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:18.500289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:18.500293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:18.500300Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 375 [2:7555894923625311336:4049]
2025-09-30T14:51:18.500315Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:18.500328Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:18.500332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.500335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.500337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.500351Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:18.500357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:18.500364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:18.500420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.500429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.500431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.500434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:18.500437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:18.500499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:18.500506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.500517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.500533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.500558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:18.500649Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 375
2025-09-30T14:51:18.500651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 375
2025-09-30T14:51:18.500583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894923715036953:4694], now have 1 active actors on pipe
2025-09-30T14:51:18.500592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894923715036753:2454], now have 1 active actors on pipe
2025-09-30T14:51:18.500597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894923625311331:4049]
2025-09-30T14:51:18.500600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894923625311331:4049]
2025-09-30T14:51:18.500602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894923625311331:4049]
2025-09-30T14:51:18.500615Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:18.500629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:18.500634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:18.500638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:18.500641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:18.500645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:18.500648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:18.500675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894923625311331:4049]
2025-09-30T14:51:18.500678Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:18.500681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:18.500695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:18.500699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:18.500754Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b51f083-dd506cf3-c2ca83a3-2fbd77eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:18.500762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.500766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.500768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:18.500776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.500786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:18.500804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:18.500969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:18.500982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:18.501004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:18.501111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 376 partition: 0 MaxSeqNo: 42 sessionId: src_id|b51f083-dd506cf3-c2ca83a3-2fbd77eb_0
2025-09-30T14:51:18.501501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d40d15f-c972d773-83e93667-247c6f9d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b51f083-dd506cf3-c2ca83a3-2fbd77eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:18.504539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b51f083-dd506cf3-c2ca83a3-2fbd77eb_0] Write session: try to update token
2025-09-30T14:51:18.504554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b51f083-dd506cf3-c2ca83a3-2fbd77eb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:18.512089Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:18.512110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:18.512113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:18.512115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:18.512124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894923625311331:4049]
2025-09-30T14:51:18.512129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894923625311331:4049]
2025-09-30T14:51:18.512133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894923625311331:4049]
2025-09-30T14:51:18.512175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:18.512175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:18.512184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:18.512187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.512190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:18.512186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:18.512330Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:18.518995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 376 sessionId: src_id|b51f083-dd506cf3-c2ca83a3-2fbd77eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:18.521742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:18.575802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894923715036964:4267]
2025-09-30T14:51:18.576024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 375, pipe: [1:7555894923715036964:4267]
2025-09-30T14:51:18.627099Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:18.627622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:18.627635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:18.627652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894923715036964:4267], now have 1 active actors on pipe
2025-09-30T14:51:18.627929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:18.627939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894923715036964:4267]
2025-09-30T14:51:18.627961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:18.627964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:18.628036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 376 reason: error at write: Disconnected sessionId: src_id|b51f083-dd506cf3-c2ca83a3-2fbd77eb_0
2025-09-30T14:51:18.628215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 376 sessionId: src_id|b51f083-dd506cf3-c2ca83a3-2fbd77eb_0 is DEAD
2025-09-30T14:51:18.628316Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:18.628407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b51f083-dd506cf3-c2ca83a3-2fbd77eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:18.628425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b51f083-dd506cf3-c2ca83a3-2fbd77eb_0] Write session will restart in 0.007862s
2025-09-30T14:51:18.628452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b51f083-dd506cf3-c2ca83a3-2fbd77eb_0] Write session: Do CDS request
2025-09-30T14:51:18.628486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b51f083-dd506cf3-c2ca83a3-2fbd77eb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:18.637756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b51f083-dd506cf3-c2ca83a3-2fbd77eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:18.637828Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:18.637854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 377
2025-09-30T14:51:18.637996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 377 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:18.638031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 377 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:18.638040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=377 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:18.638044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:18.638428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 377 sessionId:  describe result for acl check
2025-09-30T14:51:18.638467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:18.638475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:18.638478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:18.638484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894923715037087:4704] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:18.639098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894923715037087:4704] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:18.641348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894923715037087:4704] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:18.641888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:18.644430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:18.644640Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:18.644649Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:18.644661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:18.644713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:18.644749Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894923625311554:4053]
2025-09-30T14:51:18.644759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894923715037087:4704] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:18.644777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894923715037087:4704] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:18.644780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894923715037087:4704] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:18.644789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 377 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:18.645392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:18.645748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:18.645799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:18.646120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:18.646200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:18.646207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:18.646208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:18.646210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:18.646211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:18.646212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:18.646214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:18.646215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:18.646216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:18.646217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:18.646219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.646220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.646221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.646222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:18.646223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:18.646230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:18.646241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:18.646245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:18.646250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:18.646253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:18.646257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:18.646261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:18.646265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:18.646270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:18.646277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:18.646281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.646286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.646296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.646300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:18.646303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:18.646311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:18.646319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:18.646326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:18.646331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:18.646341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:18.646346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:18.646350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:18.646361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:18.646366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:18.646371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:18.646376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:18.646381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:18.646387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:18.646397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:18.646401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:18.646407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:18.646412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:18.646424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:18.646429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:18.646438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:18.646444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.646454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.646459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.646468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.646474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.646481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.646490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:18.646496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:18.646501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:18.646511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:18.646570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:18.652077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:18.652952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:18.652964Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:18.652966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:18.652969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:18.652974Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 376 [2:7555894923625311554:4053]
2025-09-30T14:51:18.652988Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:18.653002Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:18.653004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.653008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.653010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.653022Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:18.653031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:18.653036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:18.653092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.653101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.653103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.653107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:18.653109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:18.653171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:18.653182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.653194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.653207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.653223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:18.653237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894923715036966:2454], now have 1 active actors on pipe
2025-09-30T14:51:18.653240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894923715037179:4704], now have 1 active actors on pipe
2025-09-30T14:51:18.653245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894923625311549:4053]
2025-09-30T14:51:18.653246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894923625311549:4053]
2025-09-30T14:51:18.653248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894923625311549:4053]
2025-09-30T14:51:18.653257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:18.653267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:18.653276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:18.653278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:18.653290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:18.653300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:18.653302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:18.653304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894923625311549:4053]
2025-09-30T14:51:18.653307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:18.653309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:18.653345Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 376
2025-09-30T14:51:18.653398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 376
2025-09-30T14:51:18.653536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:18.653546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:18.653568Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a858b059-877578a0-e2c26c0a-30c98c21_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:18.653580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.653584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.653585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:18.653594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.653603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:18.653613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:18.653781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:18.653788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:18.653800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:18.653900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 377 partition: 0 MaxSeqNo: 42 sessionId: src_id|a858b059-877578a0-e2c26c0a-30c98c21_0
2025-09-30T14:51:18.654268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b51f083-dd506cf3-c2ca83a3-2fbd77eb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a858b059-877578a0-e2c26c0a-30c98c21_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:18.656918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a858b059-877578a0-e2c26c0a-30c98c21_0] Write session: try to update token
2025-09-30T14:51:18.656933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a858b059-877578a0-e2c26c0a-30c98c21_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:18.665045Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:18.665062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:18.665064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:18.665066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:18.665074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894923625311549:4053]
2025-09-30T14:51:18.665077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894923625311549:4053]
2025-09-30T14:51:18.665081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894923625311549:4053]
2025-09-30T14:51:18.665124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:18.665130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.665132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:18.665136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:18.665143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:18.665147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:18.665269Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:18.671565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 377 sessionId: src_id|a858b059-877578a0-e2c26c0a-30c98c21_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:18.674525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:18.727873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894923715037200:4267]
2025-09-30T14:51:18.728131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 376, pipe: [1:7555894923715037200:4267]
2025-09-30T14:51:18.771647Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:18.771973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:18.771984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:18.772001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894923715037200:4267], now have 1 active actors on pipe
2025-09-30T14:51:18.772169Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:18.772233Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:18.772236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:18.772240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:18.772277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894923715037200:4267]
2025-09-30T14:51:18.772292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 377 reason: error at write: Disconnected sessionId: src_id|a858b059-877578a0-e2c26c0a-30c98c21_0
2025-09-30T14:51:18.772485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 377 sessionId: src_id|a858b059-877578a0-e2c26c0a-30c98c21_0 is DEAD
2025-09-30T14:51:18.772633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a858b059-877578a0-e2c26c0a-30c98c21_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:18.772644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a858b059-877578a0-e2c26c0a-30c98c21_0] Write session will restart in 0.007334s
2025-09-30T14:51:18.772669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a858b059-877578a0-e2c26c0a-30c98c21_0] Write session: Do CDS request
2025-09-30T14:51:18.772674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a858b059-877578a0-e2c26c0a-30c98c21_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:18.780776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a858b059-877578a0-e2c26c0a-30c98c21_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:18.780875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:18.780889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 378
2025-09-30T14:51:18.781007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 378 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:18.781031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 378 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:18.781043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=378 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:18.781047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:18.781541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 378 sessionId:  describe result for acl check
2025-09-30T14:51:18.781569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:18.781575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:18.781576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:18.781581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894923715037268:4709] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:18.782287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894923715037268:4709] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:18.784667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894923715037268:4709] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:18.786267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:18.788391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:18.788528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894923715037268:4709] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:18.788543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894923715037268:4709] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:18.788547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894923715037268:4709] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:18.788554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 378 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:18.788578Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:18.788588Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:18.788599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:18.788656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:18.788693Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894923625311794:4066]
2025-09-30T14:51:18.789233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:18.789494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:18.789539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:18.789863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:18.789915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:18.789920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:18.789922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:18.789923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:18.789924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:18.789925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:18.789927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:18.789928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:18.789929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:18.789930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:18.789931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.789931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.789933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.789934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:18.789935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:18.789939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:18.789945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:18.789947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:18.789950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:18.789952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:18.789954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:18.789956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:18.789958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:18.789960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:18.789964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:18.789966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.789969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.789971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.789973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:18.789975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:18.789980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:18.789986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:18.789990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:18.789993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:18.789995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:18.789998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:18.790000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:18.790003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:18.790006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:18.790009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:18.790011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:18.790014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:18.790017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:18.790020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:18.790026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:18.790029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:18.790032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:18.790035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:18.790038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:18.790041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:18.790044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.790051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.790053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.790056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.790058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.790061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.790066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:18.790072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:18.790074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:18.790077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:18.790102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:18.795342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:18.796195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:18.796209Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:18.796212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:18.796216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:18.796222Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 377 [2:7555894923625311794:4066]
2025-09-30T14:51:18.796238Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:18.796253Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:18.796261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.796264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.796266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.796281Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:18.796289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:18.796295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:18.796351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.796358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.796360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.796363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:18.796365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:18.796430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:18.796438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.796450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.796463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.796488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:18.796510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894923715037201:2454], now have 1 active actors on pipe
2025-09-30T14:51:18.796518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894923715037403:4709], now have 1 active actors on pipe
2025-09-30T14:51:18.796524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894923625311789:4066]
2025-09-30T14:51:18.796527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894923625311789:4066]
2025-09-30T14:51:18.796529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894923625311789:4066]
2025-09-30T14:51:18.796541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:18.796554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:18.796574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:18.796582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:18.796551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 377
2025-09-30T14:51:18.796588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:18.796571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 377
2025-09-30T14:51:18.796591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:18.796593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:18.796624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:18.796633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:18.796645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894923625311789:4066]
2025-09-30T14:51:18.796660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:18.796670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:18.796688Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|212d4c5f-2551f0e-41bdf754-3801e3ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:18.796703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.796707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.796709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:18.796719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.796728Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:18.796750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:18.796922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:18.796930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:18.796944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:18.797030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 378 partition: 0 MaxSeqNo: 42 sessionId: src_id|212d4c5f-2551f0e-41bdf754-3801e3ed_0
2025-09-30T14:51:18.797421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a858b059-877578a0-e2c26c0a-30c98c21_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|212d4c5f-2551f0e-41bdf754-3801e3ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:18.800192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|212d4c5f-2551f0e-41bdf754-3801e3ed_0] Write session: try to update token
2025-09-30T14:51:18.800217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|212d4c5f-2551f0e-41bdf754-3801e3ed_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:18.808419Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:18.808441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:18.808444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:18.808446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:18.808455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894923625311789:4066]
2025-09-30T14:51:18.808459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894923625311789:4066]
2025-09-30T14:51:18.808463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894923625311789:4066]
2025-09-30T14:51:18.808502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:18.808508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.808511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:18.808519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:18.808525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:18.808529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:18.808658Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:18.814149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 378 sessionId: src_id|212d4c5f-2551f0e-41bdf754-3801e3ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:18.816902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:18.872251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894923715037427:4267]
2025-09-30T14:51:18.872553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 377, pipe: [1:7555894923715037427:4267]
2025-09-30T14:51:18.919162Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:18.919584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:18.919596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:18.919628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894923715037427:4267], now have 1 active actors on pipe
2025-09-30T14:51:18.919872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:18.919885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:18.919884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:18.919921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894923715037427:4267]
2025-09-30T14:51:18.919938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 378 reason: error at write: Disconnected sessionId: src_id|212d4c5f-2551f0e-41bdf754-3801e3ed_0
2025-09-30T14:51:18.919938Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:18.920153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 378 sessionId: src_id|212d4c5f-2551f0e-41bdf754-3801e3ed_0 is DEAD
2025-09-30T14:51:18.920267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|212d4c5f-2551f0e-41bdf754-3801e3ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:18.920275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|212d4c5f-2551f0e-41bdf754-3801e3ed_0] Write session will restart in 0.008307s
2025-09-30T14:51:18.920297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|212d4c5f-2551f0e-41bdf754-3801e3ed_0] Write session: Do CDS request
2025-09-30T14:51:18.920306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|212d4c5f-2551f0e-41bdf754-3801e3ed_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:18.929800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|212d4c5f-2551f0e-41bdf754-3801e3ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:18.929892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:18.929910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 379
2025-09-30T14:51:18.930080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 379 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:18.930123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 379 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:18.930142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=379 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:18.930151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:18.930618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 379 sessionId:  describe result for acl check
2025-09-30T14:51:18.930660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:18.930662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:18.930664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:18.930671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894923715037520:4714] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:18.931232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894923715037520:4714] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:18.933317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894923715037520:4714] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:18.934340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:18.936683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:18.936824Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:18.936832Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:18.936839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:18.936872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:18.936899Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894923625312000:4068]
2025-09-30T14:51:18.937037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894923715037520:4714] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:18.937054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894923715037520:4714] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:18.937057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894923715037520:4714] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:18.937065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 379 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:18.937327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:18.937560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:18.937591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:18.937854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:18.937919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:18.937924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:18.937925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:18.937926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:18.937927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:18.937927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:18.937928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:18.937929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:18.937929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:18.937930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:18.937931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.937931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.937932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.937933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:18.937934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:18.937937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:18.937944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:18.937946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:18.937949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:18.937951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:18.937953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:18.937956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:18.937958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:18.937960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:18.937962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:18.937965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.937967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.937969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.937971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:18.937973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:18.937980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:18.937985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:18.937989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:18.937992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:18.937994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:18.937997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:18.938000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:18.938003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:18.938005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:18.938008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:18.938011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:18.938013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:18.938016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:18.938019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:18.938021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:18.938024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:18.938027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:18.938030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:18.938032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:18.938035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:18.938038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.938041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.938044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.938046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.938048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.938051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.938053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:18.938056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:18.938058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:18.938061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:18.938083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:18.943282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:18.944160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:18.944171Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:18.944172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:18.944175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:18.944179Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 378 [2:7555894923625312000:4068]
2025-09-30T14:51:18.944189Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:18.944199Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:18.944200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.944202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.944203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.944214Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:18.944219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:18.944223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:18.944263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.944269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.944271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.944273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:18.944275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:18.944323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:18.944330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.944337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:18.944343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:18.944353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:18.944367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894923625311995:4068]
2025-09-30T14:51:18.944372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894923625311995:4068]
2025-09-30T14:51:18.944374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894923625311995:4068]
2025-09-30T14:51:18.944379Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:18.944389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894923715037428:2454], now have 1 active actors on pipe
2025-09-30T14:51:18.944389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:18.944391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:18.944393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:18.944395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894923715037631:4714], now have 1 active actors on pipe
2025-09-30T14:51:18.944401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:18.944409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:18.944411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:18.944429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894923625311995:4068]
2025-09-30T14:51:18.944434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:18.944439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:18.944449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 378
2025-09-30T14:51:18.944482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 378
2025-09-30T14:51:18.944534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:18.944542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:18.944561Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a75469c-c5663bd0-97cf3208-ea04fcf6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:18.944569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.944571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.944573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:18.944579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.944585Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:18.944594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:18.944784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:18.944795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:18.944811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:18.944916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 379 partition: 0 MaxSeqNo: 42 sessionId: src_id|9a75469c-c5663bd0-97cf3208-ea04fcf6_0
2025-09-30T14:51:18.945252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|212d4c5f-2551f0e-41bdf754-3801e3ed_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9a75469c-c5663bd0-97cf3208-ea04fcf6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:18.947872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a75469c-c5663bd0-97cf3208-ea04fcf6_0] Write session: try to update token
2025-09-30T14:51:18.947887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a75469c-c5663bd0-97cf3208-ea04fcf6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:18.955806Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:18.955825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:18.955834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894923625311995:4068]
2025-09-30T14:51:18.955884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:18.955885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:18.956109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:18.956292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:18.956454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:18.956631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:18.956866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:18.956913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:18.962607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 379 sessionId: src_id|9a75469c-c5663bd0-97cf3208-ea04fcf6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:18.965033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:18.965215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:18.965233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:18.965261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:18.965426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:18.966874Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:18.966887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:18.966890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:18.966892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:18.966900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894923625311995:4068]
2025-09-30T14:51:18.966904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894923625311995:4068]
2025-09-30T14:51:18.966908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894923625311995:4068]
2025-09-30T14:51:18.966937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:18.966941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:18.966942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:18.966944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:18.966949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:18.966952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:18.967083Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:19.020227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894928010004946:4267]
2025-09-30T14:51:19.020514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 378, pipe: [1:7555894928010004946:4267]
2025-09-30T14:51:19.026413Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] Counters: { Errors: 3 CurrentSessionLifetimeMs: 61070 BytesRead: 38297624 MessagesRead: 17 BytesReadCompressed: 38297624 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 2252802 BytesInflightTotal: 4505604 MessagesInflight: 2 }
2025-09-30T14:51:19.079575Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:19.087896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:19.087921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:19.088092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:19.088157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:19.088222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:19.088287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:19.088335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:19.088345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:19.088414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:19.088477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:19.088544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:19.088615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:19.088661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:19.088664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:19.088730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:19.088786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:19.088854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:19.088918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:19.088964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:19.088972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:19.089039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:19.089107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:19.089174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:19.089238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:19.089284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:19.089292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:19.089362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:19.089425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:19.089490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:19.089558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:19.089608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:19.089616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:19.089682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:19.089744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:19.089809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:19.089872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:19.089924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:19.089931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:19.089998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:19.090059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:19.090124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:19.090186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:19.090230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:19.090238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:19.090302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:19.090364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:19.090429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:19.090495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:19.090554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:19.090561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:19.090629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:19.090690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:19.090751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:19.090818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:19.090864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:19.090871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:19.090936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:19.090996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:19.091060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:19.091126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:19.091171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:19.091178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:19.091234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894928010004946:4267], now have 1 active actors on pipe
2025-09-30T14:51:19.091471Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:19.091511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:19.091513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:19.091517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894928010004946:4267]
2025-09-30T14:51:19.091537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 379 reason: error at write: Disconnected sessionId: src_id|9a75469c-c5663bd0-97cf3208-ea04fcf6_0
2025-09-30T14:51:19.091709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 379 sessionId: src_id|9a75469c-c5663bd0-97cf3208-ea04fcf6_0 is DEAD
2025-09-30T14:51:19.091856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a75469c-c5663bd0-97cf3208-ea04fcf6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:19.091865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a75469c-c5663bd0-97cf3208-ea04fcf6_0] Write session will restart in 0.008423s
2025-09-30T14:51:19.091884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a75469c-c5663bd0-97cf3208-ea04fcf6_0] Write session: Do CDS request
2025-09-30T14:51:19.091889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a75469c-c5663bd0-97cf3208-ea04fcf6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:19.092444Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:19.101855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a75469c-c5663bd0-97cf3208-ea04fcf6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:19.101981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:19.101996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 380
2025-09-30T14:51:19.102137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 380 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:19.102166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 380 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:19.102176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=380 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:19.102180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:19.102879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 380 sessionId:  describe result for acl check
2025-09-30T14:51:19.102917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:19.102919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:19.102924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:19.102930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894928010005068:4720] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:19.103488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894928010005068:4720] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:19.105690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894928010005068:4720] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:19.105931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:19.108017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:19.108190Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:19.108199Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:19.108209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:19.108250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:19.108289Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894927920279505:4071]
2025-09-30T14:51:19.108558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894928010005068:4720] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:19.108573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894928010005068:4720] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:19.108576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894928010005068:4720] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:19.108584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 380 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:19.108945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:19.109206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:19.109248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:19.109569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:19.109617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:19.109623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:19.109624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:19.109625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:19.109626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:19.109628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:19.109629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:19.109630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:19.109631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:19.109632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:19.109633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.109634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.109636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.109637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:19.109638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:19.109643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:19.109652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:19.109657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:19.109660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:19.109664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:19.109668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:19.109672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:19.109676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:19.109680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:19.109684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:19.109688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.109692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.109696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.109700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:19.109704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:19.109710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:19.109718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:19.109724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:19.109734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:19.109739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:19.109749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:19.109758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:19.109763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:19.109767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:19.109772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:19.109781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:19.109786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:19.109803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:19.109808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:19.109812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:19.109817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:19.109821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:19.109827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:19.109831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:19.109835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:19.109839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.109845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.109849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.109855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.109859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.109864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.109868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:19.109872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:19.109877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:19.109881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:19.109922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:19.115420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:19.116576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:19.116594Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:19.116596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:19.116600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:19.116607Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 379 [2:7555894927920279505:4071]
2025-09-30T14:51:19.116622Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:19.116637Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:19.116640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:19.116643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:19.116645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:19.116659Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:19.116665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:19.116672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:19.116730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.116738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.116740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.116744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:19.116747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:19.116810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:19.116818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.116831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.116843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.116866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:19.116888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894928010004950:2454], now have 1 active actors on pipe
2025-09-30T14:51:19.116896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894928010005154:4720], now have 1 active actors on pipe
2025-09-30T14:51:19.116902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894927920279500:4071]
2025-09-30T14:51:19.116905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894927920279500:4071]
2025-09-30T14:51:19.116907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894927920279500:4071]
2025-09-30T14:51:19.116919Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:19.116939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:19.116937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:19.116951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:19.116954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:19.116960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:19.116963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:19.116993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894927920279500:4071]
2025-09-30T14:51:19.116970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 379
2025-09-30T14:51:19.117001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:19.116972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 379
2025-09-30T14:51:19.117004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:19.117030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:19.117034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:19.117065Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2af00a2-83f6deaf-2daf92e5-5275cf42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:19.117076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:19.117079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:19.117086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:19.117097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:19.117109Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:19.117129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:19.117309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:19.117319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:19.117335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:19.117407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 380 partition: 0 MaxSeqNo: 42 sessionId: src_id|e2af00a2-83f6deaf-2daf92e5-5275cf42_0
2025-09-30T14:51:19.117758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a75469c-c5663bd0-97cf3208-ea04fcf6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e2af00a2-83f6deaf-2daf92e5-5275cf42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:19.120474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2af00a2-83f6deaf-2daf92e5-5275cf42_0] Write session: try to update token
2025-09-30T14:51:19.120496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2af00a2-83f6deaf-2daf92e5-5275cf42_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:19.129193Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:19.129214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:19.129216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:19.129218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:19.129230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894927920279500:4071]
2025-09-30T14:51:19.129235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894927920279500:4071]
2025-09-30T14:51:19.129239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894927920279500:4071]
2025-09-30T14:51:19.129285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:19.129290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:19.129292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.129295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:19.129296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:19.129301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:19.129443Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:19.135573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 380 sessionId: src_id|e2af00a2-83f6deaf-2daf92e5-5275cf42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:19.138241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:19.191759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894928010005167:4267]
2025-09-30T14:51:19.192027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 379, pipe: [1:7555894928010005167:4267]
2025-09-30T14:51:19.250266Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:19.250797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:19.250818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:19.250838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894928010005167:4267], now have 1 active actors on pipe
2025-09-30T14:51:19.251065Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:19.251116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894928010005167:4267]
2025-09-30T14:51:19.251117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:19.251171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:19.251438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 380 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e2af00a2-83f6deaf-2daf92e5-5275cf42_0
2025-09-30T14:51:19.251638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 380 sessionId: src_id|e2af00a2-83f6deaf-2daf92e5-5275cf42_0 is DEAD
2025-09-30T14:51:19.251790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2af00a2-83f6deaf-2daf92e5-5275cf42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:19.251800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2af00a2-83f6deaf-2daf92e5-5275cf42_0] Write session will restart in 0.006474s
2025-09-30T14:51:19.251823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2af00a2-83f6deaf-2daf92e5-5275cf42_0] Write session: Do CDS request
2025-09-30T14:51:19.251829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2af00a2-83f6deaf-2daf92e5-5275cf42_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:19.259802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2af00a2-83f6deaf-2daf92e5-5275cf42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:19.259856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:19.259870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 381
2025-09-30T14:51:19.260055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 381 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:19.260100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 381 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:19.260110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=381 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:19.260116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:19.260541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 381 sessionId:  describe result for acl check
2025-09-30T14:51:19.260576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:19.260578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:19.260580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:19.260589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894928010005214:4724] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:19.261120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894928010005214:4724] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:19.263530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894928010005214:4724] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:19.265955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:19.266033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894928010005214:4724] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:19.266048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894928010005214:4724] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:19.266052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894928010005214:4724] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:19.266061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 381 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:19.268796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:19.268994Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:19.269003Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:19.269013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:19.269057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:19.269098Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894927920279714:4073]
2025-09-30T14:51:19.269766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:19.270059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:19.270096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:19.270418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:19.270473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:19.270479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:19.270480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:19.270481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:19.270483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:19.270484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:19.270485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:19.270487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:19.270488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:19.270489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:19.270490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.270491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.270492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.270494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:19.270495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:19.270500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:19.270510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:19.270513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:19.270517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:19.270520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:19.270524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:19.270527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:19.270530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:19.270534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:19.270547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:19.270551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.270554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.270558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.270561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:19.270564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:19.270571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:19.270584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:19.270593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:19.270602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:19.270613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:19.270622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:19.270631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:19.270638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:19.270646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:19.270671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:19.270685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:19.270691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:19.270695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:19.270700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:19.270703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:19.270712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:19.270721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:19.270726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:19.270729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:19.270734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:19.270745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.270749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.270753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.270758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.270766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.270770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.270775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:19.270779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:19.270788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:19.270793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:19.270836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:19.276248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:19.277618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:19.277638Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:19.277641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:19.277645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:19.277652Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 380 [2:7555894927920279714:4073]
2025-09-30T14:51:19.277669Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:19.277692Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:19.277703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:19.277706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:19.277709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:19.277726Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:19.277733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:19.277742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:19.277805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.277812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.277814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.277818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:19.277821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:19.277894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:19.277901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.277915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.277929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.277950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:19.277972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894928010005372:4724], now have 1 active actors on pipe
2025-09-30T14:51:19.277981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894928010005168:2454], now have 1 active actors on pipe
2025-09-30T14:51:19.277987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894927920279708:4073]
2025-09-30T14:51:19.277989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894927920279708:4073]
2025-09-30T14:51:19.277991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894927920279708:4073]
2025-09-30T14:51:19.278005Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:19.278021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:19.278041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:19.278044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:19.278050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:19.278055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:19.278057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:19.278083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894927920279708:4073]
2025-09-30T14:51:19.278095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:19.278104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:19.278092Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 380
2025-09-30T14:51:19.278099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 380
2025-09-30T14:51:19.278161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:19.278171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:19.278199Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28f3a374-bd79389-17de1c7d-ef6b30de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:19.278211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:19.278214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:19.278217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:19.278227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:19.278242Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:19.278262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:19.278400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:19.278409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:19.278422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:19.278515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 381 partition: 0 MaxSeqNo: 42 sessionId: src_id|28f3a374-bd79389-17de1c7d-ef6b30de_0
2025-09-30T14:51:19.278956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2af00a2-83f6deaf-2daf92e5-5275cf42_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|28f3a374-bd79389-17de1c7d-ef6b30de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:19.281878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28f3a374-bd79389-17de1c7d-ef6b30de_0] Write session: try to update token
2025-09-30T14:51:19.281897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28f3a374-bd79389-17de1c7d-ef6b30de_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:19.291035Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:19.291051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:19.291053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:19.291055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:19.291064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894927920279708:4073]
2025-09-30T14:51:19.291068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894927920279708:4073]
2025-09-30T14:51:19.291072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894927920279708:4073]
2025-09-30T14:51:19.291110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:19.291117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.291120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:19.291126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:19.291132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:19.291136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:19.291307Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:19.296764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 381 sessionId: src_id|28f3a374-bd79389-17de1c7d-ef6b30de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:19.299321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:19.351493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894928010005385:4267]
2025-09-30T14:51:19.351768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 380, pipe: [1:7555894928010005385:4267]
2025-09-30T14:51:19.395855Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:19.396114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:19.396127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:19.396160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894928010005385:4267], now have 1 active actors on pipe
2025-09-30T14:51:19.396396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:19.396398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:19.396402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:19.396463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894928010005385:4267]
2025-09-30T14:51:19.396466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 381 reason: error at write: Disconnected sessionId: src_id|28f3a374-bd79389-17de1c7d-ef6b30de_0
2025-09-30T14:51:19.396581Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:19.396671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 381 sessionId: src_id|28f3a374-bd79389-17de1c7d-ef6b30de_0 is DEAD
2025-09-30T14:51:19.396823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f3a374-bd79389-17de1c7d-ef6b30de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:19.396833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f3a374-bd79389-17de1c7d-ef6b30de_0] Write session will restart in 0.007068s
2025-09-30T14:51:19.396852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f3a374-bd79389-17de1c7d-ef6b30de_0] Write session: Do CDS request
2025-09-30T14:51:19.396859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f3a374-bd79389-17de1c7d-ef6b30de_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:19.404807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28f3a374-bd79389-17de1c7d-ef6b30de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:19.404894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:19.404909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 382
2025-09-30T14:51:19.405016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 382 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:19.405050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 382 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:19.405060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=382 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:19.405064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:19.405493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 382 sessionId:  describe result for acl check
2025-09-30T14:51:19.405527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:19.405535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:19.405536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:19.405542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894928010005440:4728] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:19.406052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894928010005440:4728] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:19.408423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894928010005440:4728] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:19.410291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:19.412380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:19.412544Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:19.412553Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:19.412563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:19.412581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894928010005440:4728] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:19.412594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894928010005440:4728] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:19.412597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894928010005440:4728] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:19.412605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 382 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:19.412607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:19.412644Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894927920279921:4075]
2025-09-30T14:51:19.413270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:19.413508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:19.413555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:19.413885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:19.413945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:19.413951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:19.413953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:19.413954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:19.413956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:19.413957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:19.413958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:19.413959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:19.413960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:19.413962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:19.413963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.413964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.413965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.413966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:19.413967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:19.413973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:19.413984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:19.413989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:19.413994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:19.413998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:19.414002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:19.414007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:19.414011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:19.414016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:19.414022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:19.414027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.414031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.414035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.414040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:19.414044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:19.414052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:19.414060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:19.414066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:19.414072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:19.414077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:19.414083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:19.414087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:19.414092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:19.414097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:19.414103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:19.414108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:19.414114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:19.414124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:19.414130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:19.414134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:19.414140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:19.414146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:19.414154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:19.414159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:19.414165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:19.414172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.414177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.414182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.414188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.414195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.414201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.414210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:19.414215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:19.414221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:19.414227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:19.414273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:19.419615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:19.420469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:19.420485Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:19.420488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:19.420491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:19.420498Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 381 [2:7555894927920279921:4075]
2025-09-30T14:51:19.420513Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:19.420531Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:19.420540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:19.420543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:19.420546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:19.420560Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:19.420571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:19.420577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:19.420627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.420634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.420635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.420638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:19.420641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:19.420705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:19.420712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.420724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.420736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.420755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:19.420776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894928010005592:4728], now have 1 active actors on pipe
2025-09-30T14:51:19.420784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894928010005386:2454], now have 1 active actors on pipe
2025-09-30T14:51:19.420789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894927920279916:4075]
2025-09-30T14:51:19.420791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894927920279916:4075]
2025-09-30T14:51:19.420793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894927920279916:4075]
2025-09-30T14:51:19.420805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:19.420816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:19.420819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:19.420821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:19.420821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:19.420835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:19.420842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:19.420839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 381
2025-09-30T14:51:19.420865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894927920279916:4075]
2025-09-30T14:51:19.420872Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:19.420874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:19.420848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 381
2025-09-30T14:51:19.420896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:19.420905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:19.420940Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75e48e2f-61abd53f-e9b29472-cc301fe8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:19.420950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:19.420954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:19.420956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:19.420964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:19.420976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:19.420997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:19.421164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:19.421174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:19.421189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:19.421271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 382 partition: 0 MaxSeqNo: 42 sessionId: src_id|75e48e2f-61abd53f-e9b29472-cc301fe8_0
2025-09-30T14:51:19.421655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f3a374-bd79389-17de1c7d-ef6b30de_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|75e48e2f-61abd53f-e9b29472-cc301fe8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:19.424263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75e48e2f-61abd53f-e9b29472-cc301fe8_0] Write session: try to update token
2025-09-30T14:51:19.424276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75e48e2f-61abd53f-e9b29472-cc301fe8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:19.432806Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:19.432823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:19.432826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:19.432827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:19.432837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894927920279916:4075]
2025-09-30T14:51:19.432841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894927920279916:4075]
2025-09-30T14:51:19.432845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894927920279916:4075]
2025-09-30T14:51:19.432880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:19.432882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:19.432890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.432893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:19.432896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:19.432900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:19.433030Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:19.438199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 382 sessionId: src_id|75e48e2f-61abd53f-e9b29472-cc301fe8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:19.440897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:19.496896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894928010005606:4267]
2025-09-30T14:51:19.497171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 381, pipe: [1:7555894928010005606:4267]
2025-09-30T14:51:19.539610Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:19.540316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:19.540330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:19.540366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894928010005606:4267], now have 1 active actors on pipe
2025-09-30T14:51:19.540644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894928010005606:4267]
2025-09-30T14:51:19.540659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:19.540674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:19.540677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:19.540733Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:19.540742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 382 reason: error at write: Disconnected sessionId: src_id|75e48e2f-61abd53f-e9b29472-cc301fe8_0
2025-09-30T14:51:19.540941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 382 sessionId: src_id|75e48e2f-61abd53f-e9b29472-cc301fe8_0 is DEAD
2025-09-30T14:51:19.541090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75e48e2f-61abd53f-e9b29472-cc301fe8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:19.541101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75e48e2f-61abd53f-e9b29472-cc301fe8_0] Write session will restart in 0.007539s
2025-09-30T14:51:19.541123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75e48e2f-61abd53f-e9b29472-cc301fe8_0] Write session: Do CDS request
2025-09-30T14:51:19.541143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75e48e2f-61abd53f-e9b29472-cc301fe8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:19.549753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75e48e2f-61abd53f-e9b29472-cc301fe8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:19.549901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:19.549917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 383
2025-09-30T14:51:19.550042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 383 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:19.550075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 383 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:19.550085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=383 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:19.550090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:19.550503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 383 sessionId:  describe result for acl check
2025-09-30T14:51:19.550553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:19.550560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:19.550562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:19.550569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894928010005696:4733] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:19.551066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894928010005696:4733] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:19.553112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894928010005696:4733] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:19.554611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:19.556840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:19.557021Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:19.557031Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:19.557040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:19.557008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894928010005696:4733] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:19.557022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894928010005696:4733] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:19.557025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894928010005696:4733] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:19.557033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 383 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:19.557085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:19.557125Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894927920280133:4078]
2025-09-30T14:51:19.557761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:19.558116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:19.558178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:19.558562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:19.558633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:19.558639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:19.558640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:19.558641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:19.558642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:19.558644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:19.558645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:19.558646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:19.558647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:19.558648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:19.558650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.558651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.558652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.558653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:19.558654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:19.558660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:19.558670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:19.558673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:19.558677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:19.558680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:19.558682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:19.558684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:19.558687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:19.558689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:19.558691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:19.558694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.558696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.558698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.558701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:19.558703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:19.558709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:19.558714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:19.558718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:19.558721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:19.558723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:19.558726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:19.558728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:19.558731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:19.558734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:19.558737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:19.558739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:19.558755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:19.558760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:19.558765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:19.558769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:19.558775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:19.558782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:19.558784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:19.558787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:19.558790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:19.558792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.558795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.558798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.558801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.558803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.558806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.558808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:19.558812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:19.558814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:19.558817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:19.558838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:19.564195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:19.565039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:19.565057Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:19.565060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:19.565063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:19.565070Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 382 [2:7555894927920280133:4078]
2025-09-30T14:51:19.565085Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:19.565100Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:19.565103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:19.565106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:19.565109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:19.565123Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:19.565129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:19.565136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:19.565185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.565190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.565191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.565194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:19.565195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:19.565254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:19.565261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.565272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.565286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.565306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:19.565327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894928010005607:2454], now have 1 active actors on pipe
2025-09-30T14:51:19.565336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894928010005814:4733], now have 1 active actors on pipe
2025-09-30T14:51:19.565341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894927920280128:4078]
2025-09-30T14:51:19.565344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894927920280128:4078]
2025-09-30T14:51:19.565346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894927920280128:4078]
2025-09-30T14:51:19.565358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:19.565371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:19.565373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:19.565380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:19.565382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:19.565384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:19.565386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:19.565409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894927920280128:4078]
2025-09-30T14:51:19.565418Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:19.565424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:19.565425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 382
2025-09-30T14:51:19.565426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 382
2025-09-30T14:51:19.565539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:19.565547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:19.565566Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7ee698-53f1bbf9-505c5cc2-9cfd127_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:19.565575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:19.565578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:19.565579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:19.565587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:19.565594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:19.565606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:19.565731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:19.565737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:19.565748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:19.565852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 383 partition: 0 MaxSeqNo: 42 sessionId: src_id|b7ee698-53f1bbf9-505c5cc2-9cfd127_0
2025-09-30T14:51:19.566234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75e48e2f-61abd53f-e9b29472-cc301fe8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b7ee698-53f1bbf9-505c5cc2-9cfd127_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:19.568893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7ee698-53f1bbf9-505c5cc2-9cfd127_0] Write session: try to update token
2025-09-30T14:51:19.568909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7ee698-53f1bbf9-505c5cc2-9cfd127_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:19.577055Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:19.577072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:19.577080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894927920280128:4078]
2025-09-30T14:51:19.577119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:19.577129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:19.577302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:19.577440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:19.577580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:19.577711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:19.577895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:19.577931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:19.583574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 383 sessionId: src_id|b7ee698-53f1bbf9-505c5cc2-9cfd127_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:19.586203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:19.586478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:19.586498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:19.587673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:19.587704Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:19.587712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:19.587714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:19.587716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:19.587725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894927920280128:4078]
2025-09-30T14:51:19.587728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894927920280128:4078]
2025-09-30T14:51:19.587732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894927920280128:4078]
2025-09-30T14:51:19.587765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:19.587769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:19.587775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:19.587779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:19.587776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.587778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:19.587778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:19.587914Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:19.640765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894928010005826:4267]
2025-09-30T14:51:19.641062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 382, pipe: [1:7555894928010005826:4267]
2025-09-30T14:51:19.695758Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:19.703935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:19.703959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:19.704123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:19.704185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:19.704252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:19.704317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:19.704366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:19.704377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:19.704442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:19.704502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:19.704564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:19.704633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:19.704678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:19.704687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:19.704754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:19.704814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:19.704876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:19.704938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:19.704981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:19.704989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:19.705052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:19.705116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:19.705178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:19.705248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:19.705293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:19.705301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:19.705370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:19.705432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:19.705497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:19.705561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:19.705608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:19.705615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:19.705682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:19.705743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:19.705804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:19.705866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:19.705912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:19.705920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:19.705987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:19.706050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:19.706115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:19.706176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:19.706220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:19.706227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:19.706295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:19.706354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:19.706422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:19.706485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:19.706529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:19.706549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:19.706615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:19.706676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:19.706737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:19.706802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:19.706864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:19.706871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:19.706938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:19.706997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:19.707063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:19.707126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:19.707175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:19.707182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:19.707233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894928010005826:4267], now have 1 active actors on pipe
2025-09-30T14:51:19.707503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894928010005826:4267]
2025-09-30T14:51:19.707540Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:19.707567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:19.707573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:19.707595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 383 reason: error at write: Disconnected sessionId: src_id|b7ee698-53f1bbf9-505c5cc2-9cfd127_0
2025-09-30T14:51:19.707792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 383 sessionId: src_id|b7ee698-53f1bbf9-505c5cc2-9cfd127_0 is DEAD
2025-09-30T14:51:19.707958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7ee698-53f1bbf9-505c5cc2-9cfd127_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:19.707966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7ee698-53f1bbf9-505c5cc2-9cfd127_0] Write session will restart in 0.007084s
2025-09-30T14:51:19.707995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7ee698-53f1bbf9-505c5cc2-9cfd127_0] Write session: Do CDS request
2025-09-30T14:51:19.708000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7ee698-53f1bbf9-505c5cc2-9cfd127_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:19.708341Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:19.715740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7ee698-53f1bbf9-505c5cc2-9cfd127_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:19.715801Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:19.715815Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 384
2025-09-30T14:51:19.715984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 384 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:19.716016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 384 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:19.716025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=384 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:19.716029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:19.716476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 384 sessionId:  describe result for acl check
2025-09-30T14:51:19.716520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:19.716526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:19.716528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:19.716534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894928010005911:4744] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:19.717036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894928010005911:4744] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:19.719256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894928010005911:4744] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:19.721129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:19.723716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:19.723810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894928010005911:4744] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:19.723824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894928010005911:4744] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:19.723828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894928010005911:4744] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:19.723836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 384 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:19.724006Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:19.724026Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:19.724041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:19.724117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:19.724187Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894927920280381:4086]
2025-09-30T14:51:19.724969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:19.725372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:19.725460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:19.725923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:19.726054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:19.726067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:19.726068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:19.726069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:19.726071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:19.726073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:19.726074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:19.726076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:19.726077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:19.726079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:19.726080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.726082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.726083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.726085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:19.726086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:19.726095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:19.726106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:19.726111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:19.726115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:19.726119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:19.726123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:19.726127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:19.726131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:19.726134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:19.726139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:19.726143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.726147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.726150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.726154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:19.726158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:19.726170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:19.726184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:19.726204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:19.726220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:19.726234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:19.726249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:19.726263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:19.726280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:19.726293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:19.726300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:19.726314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:19.726328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:19.726342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:19.726356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:19.726369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:19.726384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:19.726399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:19.726414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:19.726427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:19.726444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:19.726460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.726473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.726485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.726501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.726516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.726524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.726549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:19.726561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:19.726568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:19.726581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:19.726631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:19.731874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:19.732706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:19.732719Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:19.732721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:19.732724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:19.732729Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 383 [2:7555894927920280381:4086]
2025-09-30T14:51:19.732740Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:19.732751Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:19.732753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:19.732755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:19.732757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:19.732767Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:19.732772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:19.732778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:19.732830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.732838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.732841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.732844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:19.732847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:19.732910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:19.732917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.732928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.732939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.732959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:19.732978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894927920280376:4086]
2025-09-30T14:51:19.732984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894927920280376:4086]
2025-09-30T14:51:19.732986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894927920280376:4086]
2025-09-30T14:51:19.732999Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:19.733017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:19.733020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894928010006057:4744], now have 1 active actors on pipe
2025-09-30T14:51:19.733024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894928010005840:2454], now have 1 active actors on pipe
2025-09-30T14:51:19.733028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:19.733030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:19.733031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:19.733046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:19.733049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:19.733076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894927920280376:4086]
2025-09-30T14:51:19.733089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:19.733105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:19.733082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 383
2025-09-30T14:51:19.733084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 383
2025-09-30T14:51:19.733139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:19.733148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:19.733175Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66c15903-38eeee2e-483c3122-c9dd41b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:19.733186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:19.733191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:19.733193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:19.733206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:19.733219Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:19.733235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:19.733594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:19.733609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:19.733634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:19.733731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 384 partition: 0 MaxSeqNo: 42 sessionId: src_id|66c15903-38eeee2e-483c3122-c9dd41b5_0
2025-09-30T14:51:19.734123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7ee698-53f1bbf9-505c5cc2-9cfd127_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|66c15903-38eeee2e-483c3122-c9dd41b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:19.736751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66c15903-38eeee2e-483c3122-c9dd41b5_0] Write session: try to update token
2025-09-30T14:51:19.736767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66c15903-38eeee2e-483c3122-c9dd41b5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:19.744399Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:19.744416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:19.744419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:19.744421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:19.744430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894927920280376:4086]
2025-09-30T14:51:19.744432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894927920280376:4086]
2025-09-30T14:51:19.744435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894927920280376:4086]
2025-09-30T14:51:19.744468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:19.744474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.744477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:19.744476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:19.744481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:19.744485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:19.744608Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:19.750852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 384 sessionId: src_id|66c15903-38eeee2e-483c3122-c9dd41b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:19.753346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:19.807649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894928010006069:4267]
2025-09-30T14:51:19.807903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 383, pipe: [1:7555894928010006069:4267]
2025-09-30T14:51:19.849157Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:19.849695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:19.849711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:19.849739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894928010006069:4267], now have 1 active actors on pipe
2025-09-30T14:51:19.849939Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:19.850048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:19.850065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:19.850070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894928010006069:4267]
2025-09-30T14:51:19.850092Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:19.850120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 384 reason: error at write: Disconnected sessionId: src_id|66c15903-38eeee2e-483c3122-c9dd41b5_0
2025-09-30T14:51:19.850326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 384 sessionId: src_id|66c15903-38eeee2e-483c3122-c9dd41b5_0 is DEAD
2025-09-30T14:51:19.850441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66c15903-38eeee2e-483c3122-c9dd41b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:19.850450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66c15903-38eeee2e-483c3122-c9dd41b5_0] Write session will restart in 0.005009s
2025-09-30T14:51:19.850473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66c15903-38eeee2e-483c3122-c9dd41b5_0] Write session: Do CDS request
2025-09-30T14:51:19.850479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66c15903-38eeee2e-483c3122-c9dd41b5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:19.856654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66c15903-38eeee2e-483c3122-c9dd41b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:19.856766Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:19.856778Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 385
2025-09-30T14:51:19.856889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 385 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:19.856920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 385 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:19.856925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=385 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:19.856928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:19.857344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 385 sessionId:  describe result for acl check
2025-09-30T14:51:19.857376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:19.857382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:19.857384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:19.857389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894928010006102:4749] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:19.857884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894928010006102:4749] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:19.860796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894928010006102:4749] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:19.863967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894928010006102:4749] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:19.863983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894928010006102:4749] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:19.863986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894928010006102:4749] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:19.863994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 385 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:19.865198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:19.867852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:19.868046Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:19.868055Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:19.868067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:19.868116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:19.868157Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894927920280606:4095]
2025-09-30T14:51:19.868798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:19.869114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:19.869162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:19.869493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:19.869555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:19.869561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:19.869563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:19.869564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:19.869565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:19.869567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:19.869568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:19.869569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:19.869571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:19.869572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:19.869574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.869575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.869576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.869577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:19.869579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:19.869584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:19.869595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:19.869600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:19.869604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:19.869608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:19.869612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:19.869616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:19.869620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:19.869624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:19.869629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:19.869633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.869637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.869641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.869645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:19.869649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:19.869657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:19.869665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:19.869671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:19.869677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:19.869682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:19.869688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:19.869692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:19.869699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:19.869704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:19.869709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:19.869714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:19.869719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:19.869726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:19.869731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:19.869735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:19.869741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:19.869745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:19.869750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:19.869754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:19.869759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:19.869764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.869769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.869774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.869779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.869784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.869789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.869793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:19.869799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:19.869804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:19.869809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:19.869851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:19.875198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:19.876170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:19.876186Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:19.876190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:19.876194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:19.876202Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 384 [2:7555894927920280606:4095]
2025-09-30T14:51:19.876218Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:19.876234Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:19.876237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:19.876240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:19.876243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:19.876258Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:19.876270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:19.876277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:19.876340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.876348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.876350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.876353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:19.876356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:19.876428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:19.876440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.876452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:19.876464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:19.876480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:19.876502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894928010006082:2454], now have 1 active actors on pipe
2025-09-30T14:51:19.876510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894928010006288:4749], now have 1 active actors on pipe
2025-09-30T14:51:19.876518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894927920280601:4095]
2025-09-30T14:51:19.876525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894927920280601:4095]
2025-09-30T14:51:19.876527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894927920280601:4095]
2025-09-30T14:51:19.876543Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:19.876561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:19.876576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:19.876579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:19.876580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:19.876582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:19.876583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:19.876586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 384
2025-09-30T14:51:19.876618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894927920280601:4095]
2025-09-30T14:51:19.876627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:19.876609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 384
2025-09-30T14:51:19.876646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:19.876651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:19.876656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:19.876690Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fae4763d-5521a958-d1e4b0e9-670a177c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:19.876703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:19.876710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:19.876717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:19.876728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:19.876738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:19.876763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:19.876903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:19.876911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:19.876925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:19.877018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 385 partition: 0 MaxSeqNo: 42 sessionId: src_id|fae4763d-5521a958-d1e4b0e9-670a177c_0
2025-09-30T14:51:19.877407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66c15903-38eeee2e-483c3122-c9dd41b5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fae4763d-5521a958-d1e4b0e9-670a177c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:19.880197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fae4763d-5521a958-d1e4b0e9-670a177c_0] Write session: try to update token
2025-09-30T14:51:19.880215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fae4763d-5521a958-d1e4b0e9-670a177c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:19.889123Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:19.889146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:19.889149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:19.889151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:19.889162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894927920280601:4095]
2025-09-30T14:51:19.889167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894927920280601:4095]
2025-09-30T14:51:19.889171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894927920280601:4095]
2025-09-30T14:51:19.889211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:19.889217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:19.889222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:19.889223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:19.889226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:19.889227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:19.889366Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:19.894768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 385 sessionId: src_id|fae4763d-5521a958-d1e4b0e9-670a177c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:19.897316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:19.950001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894928010006302:4267]
2025-09-30T14:51:19.950334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 384, pipe: [1:7555894928010006302:4267]
2025-09-30T14:51:20.005609Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:20.007375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:20.007395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:20.007450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894928010006302:4267], now have 1 active actors on pipe
2025-09-30T14:51:20.007739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894928010006302:4267]
2025-09-30T14:51:20.007785Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:20.007778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:20.007793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:20.007795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:20.007886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 385 reason: error at write: Disconnected sessionId: src_id|fae4763d-5521a958-d1e4b0e9-670a177c_0
2025-09-30T14:51:20.008073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 385 sessionId: src_id|fae4763d-5521a958-d1e4b0e9-670a177c_0 is DEAD
2025-09-30T14:51:20.008219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fae4763d-5521a958-d1e4b0e9-670a177c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:20.008235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fae4763d-5521a958-d1e4b0e9-670a177c_0] Write session will restart in 0.005013s
2025-09-30T14:51:20.008268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fae4763d-5521a958-d1e4b0e9-670a177c_0] Write session: Do CDS request
2025-09-30T14:51:20.008276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fae4763d-5521a958-d1e4b0e9-670a177c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:20.014758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fae4763d-5521a958-d1e4b0e9-670a177c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:20.014914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:20.014933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 386
2025-09-30T14:51:20.015060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 386 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:20.015094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 386 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:20.015099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=386 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:20.015103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:20.015590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 386 sessionId:  describe result for acl check
2025-09-30T14:51:20.015637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:20.015645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:20.015647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:20.015654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894932304973622:4755] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:20.016287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894932304973622:4755] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:20.018914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894932304973622:4755] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:20.022505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894932304973622:4755] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:20.022521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894932304973622:4755] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:20.022524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894932304973622:4755] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:20.022543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 386 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:20.024570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:20.026792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:20.026981Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:20.026991Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:20.026999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:20.027038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:20.027079Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894932215248118:4097]
2025-09-30T14:51:20.027557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:20.027853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:20.027908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:20.028148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:20.028191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:20.028196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:20.028197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:20.028197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:20.028198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:20.028199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:20.028200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:20.028201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:20.028202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:20.028203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:20.028203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.028204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.028205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.028205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:20.028206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:20.028210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:20.028217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:20.028220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:20.028222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:20.028225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:20.028227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:20.028230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:20.028232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:20.028235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:20.028239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:20.028242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.028244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.028246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.028248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:20.028250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:20.028256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:20.028262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:20.028266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:20.028270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:20.028272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:20.028275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:20.028278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:20.028281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:20.028284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:20.028288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:20.028290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:20.028293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:20.028296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:20.028299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:20.028302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:20.028306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:20.028309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:20.028312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:20.028316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:20.028319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:20.028322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.028324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.028327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.028331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.028335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.028341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.028344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:20.028350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:20.028354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:20.028359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:20.028391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:20.033680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:20.035585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:20.035598Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:20.035599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:20.035602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:20.035607Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 385 [2:7555894932215248118:4097]
2025-09-30T14:51:20.035621Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:20.035633Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:20.035635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.035638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.035640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.035652Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:20.035657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:20.035668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:20.035714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.035720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.035722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.035725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:20.035726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:20.035779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:20.035784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.035793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.035800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.035809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:20.035826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894932215248113:4097]
2025-09-30T14:51:20.035833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894932215248113:4097]
2025-09-30T14:51:20.035836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894932215248113:4097]
2025-09-30T14:51:20.035844Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:20.035856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:20.035859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:20.035861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:20.035863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894932304973607:2454], now have 1 active actors on pipe
2025-09-30T14:51:20.035872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:20.035885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:20.035891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:20.035897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894932304973806:4755], now have 1 active actors on pipe
2025-09-30T14:51:20.035921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894932215248113:4097]
2025-09-30T14:51:20.035932Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:20.035952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:20.035936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 385
2025-09-30T14:51:20.035943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 385
2025-09-30T14:51:20.036012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:20.036023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:20.036050Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4acd53b3-b03d6c0c-b557409-478351e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:20.036062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.036066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.036072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:20.036081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.036095Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:20.036113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:20.036262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:20.036273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:20.036294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:20.036398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 386 partition: 0 MaxSeqNo: 42 sessionId: src_id|4acd53b3-b03d6c0c-b557409-478351e6_0
2025-09-30T14:51:20.036817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fae4763d-5521a958-d1e4b0e9-670a177c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4acd53b3-b03d6c0c-b557409-478351e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:20.045424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4acd53b3-b03d6c0c-b557409-478351e6_0] Write session: try to update token
2025-09-30T14:51:20.045453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4acd53b3-b03d6c0c-b557409-478351e6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:20.053661Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:20.053689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:20.053701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894932215248113:4097]
2025-09-30T14:51:20.053753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:20.053757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:20.054326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:20.054688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:20.055014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:20.055157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:20.055379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:20.055420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:20.058561Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:20.058579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:20.058582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:20.058584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:20.058594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894932215248113:4097]
2025-09-30T14:51:20.058604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894932215248113:4097]
2025-09-30T14:51:20.058609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894932215248113:4097]
2025-09-30T14:51:20.058649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:20.058654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:20.058660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:20.058663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.058666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:20.058679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:20.058813Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:20.065232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 386 sessionId: src_id|4acd53b3-b03d6c0c-b557409-478351e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:20.068119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:20.107681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894932304973831:4267]
2025-09-30T14:51:20.107908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 385, pipe: [1:7555894932304973831:4267]
2025-09-30T14:51:20.179307Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:20.179643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:20.179661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:20.179682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894932304973831:4267], now have 1 active actors on pipe
2025-09-30T14:51:20.179974Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:20.179975Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:20.179974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:20.179980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:20.180025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894932304973831:4267]
2025-09-30T14:51:20.180063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 386 reason: error at write: Disconnected sessionId: src_id|4acd53b3-b03d6c0c-b557409-478351e6_0
2025-09-30T14:51:20.180290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 386 sessionId: src_id|4acd53b3-b03d6c0c-b557409-478351e6_0 is DEAD
2025-09-30T14:51:20.180447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4acd53b3-b03d6c0c-b557409-478351e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:20.180455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4acd53b3-b03d6c0c-b557409-478351e6_0] Write session will restart in 0.007395s
2025-09-30T14:51:20.180475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4acd53b3-b03d6c0c-b557409-478351e6_0] Write session: Do CDS request
2025-09-30T14:51:20.180480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4acd53b3-b03d6c0c-b557409-478351e6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:20.188708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4acd53b3-b03d6c0c-b557409-478351e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:20.188836Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:20.188853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 387
2025-09-30T14:51:20.188964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 387 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:20.188996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 387 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:20.189001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=387 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:20.189034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:20.189529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 387 sessionId:  describe result for acl check
2025-09-30T14:51:20.189570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:20.189572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:20.189573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:20.189578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894932304973887:4759] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:20.189980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894932304973887:4759] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:20.192431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894932304973887:4759] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:20.195422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:20.195487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894932304973887:4759] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:20.195504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894932304973887:4759] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:20.195508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894932304973887:4759] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:20.195516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 387 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:20.197830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:20.198013Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:20.198023Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:20.198031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:20.198081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:20.198117Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894932215248333:4100]
2025-09-30T14:51:20.198580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:20.198877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:20.198909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:20.199168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:20.199215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:20.199219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:20.199220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:20.199221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:20.199222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:20.199222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:20.199224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:20.199224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:20.199225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:20.199226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:20.199226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.199227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.199228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.199229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:20.199230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:20.199233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:20.199239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:20.199259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:20.199264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:20.199268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:20.199272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:20.199276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:20.199278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:20.199280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:20.199283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:20.199285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.199288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.199290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.199292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:20.199295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:20.199300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:20.199305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:20.199308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:20.199312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:20.199314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:20.199318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:20.199320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:20.199324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:20.199326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:20.199329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:20.199331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:20.199334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:20.199337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:20.199340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:20.199344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:20.199347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:20.199349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:20.199352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:20.199354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:20.199357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:20.199360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.199364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.199367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.199370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.199372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.199376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.199378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:20.199381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:20.199383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:20.199386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:20.199408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:20.204927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:20.205834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:20.205845Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:20.205848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:20.205852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:20.205858Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 386 [2:7555894932215248333:4100]
2025-09-30T14:51:20.205874Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:20.205888Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:20.205894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.205897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.205899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.205913Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:20.205918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:20.205928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:20.205981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.205987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.205988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.205991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:20.205993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:20.206048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:20.206055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.206063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.206069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.206079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:20.206094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894932215248327:4100]
2025-09-30T14:51:20.206096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894932215248327:4100]
2025-09-30T14:51:20.206098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894932215248327:4100]
2025-09-30T14:51:20.206104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:20.206114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:20.206124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:20.206124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:20.206128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:20.206130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:20.206130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:20.206164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894932304973833:2454], now have 1 active actors on pipe
2025-09-30T14:51:20.206177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894932304974044:4759], now have 1 active actors on pipe
2025-09-30T14:51:20.206180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894932215248327:4100]
2025-09-30T14:51:20.206190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:20.206208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:20.206247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 386
2025-09-30T14:51:20.206247Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 386
2025-09-30T14:51:20.206358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:20.206372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:20.206404Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68243def-1b511b62-c93cb285-4b6c7dcc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:20.206412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.206421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.206424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:20.206436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.206450Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:20.206466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:20.206651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:20.206664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:20.206695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:20.206810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 387 partition: 0 MaxSeqNo: 42 sessionId: src_id|68243def-1b511b62-c93cb285-4b6c7dcc_0
2025-09-30T14:51:20.207135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4acd53b3-b03d6c0c-b557409-478351e6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|68243def-1b511b62-c93cb285-4b6c7dcc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:20.209929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68243def-1b511b62-c93cb285-4b6c7dcc_0] Write session: try to update token
2025-09-30T14:51:20.209943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68243def-1b511b62-c93cb285-4b6c7dcc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:20.217939Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:20.217961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:20.217973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894932215248327:4100]
2025-09-30T14:51:20.218014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:20.218024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:20.218393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:20.218586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:20.218748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:20.218925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:20.219163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:20.219214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:20.226053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 387 sessionId: src_id|68243def-1b511b62-c93cb285-4b6c7dcc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:20.228761Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:20.228782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:20.228784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:20.228786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:20.228797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894932215248327:4100]
2025-09-30T14:51:20.228800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894932215248327:4100]
2025-09-30T14:51:20.228803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894932215248327:4100]
2025-09-30T14:51:20.228836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:20.228845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.228845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:20.228847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:20.228851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:20.228857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:20.228883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:20.228984Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:20.280250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894932304974056:4267]
2025-09-30T14:51:20.280608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 386, pipe: [1:7555894932304974056:4267]
2025-09-30T14:51:20.339360Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:20.339791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:20.339806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:20.339822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894932304974056:4267], now have 1 active actors on pipe
2025-09-30T14:51:20.340062Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:20.340086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:20.340101Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:20.340107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:20.340140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894932304974056:4267]
2025-09-30T14:51:20.340168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 387 reason: error at write: Disconnected sessionId: src_id|68243def-1b511b62-c93cb285-4b6c7dcc_0
2025-09-30T14:51:20.340360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 387 sessionId: src_id|68243def-1b511b62-c93cb285-4b6c7dcc_0 is DEAD
2025-09-30T14:51:20.340512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68243def-1b511b62-c93cb285-4b6c7dcc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:20.340520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68243def-1b511b62-c93cb285-4b6c7dcc_0] Write session will restart in 0.005121s
2025-09-30T14:51:20.340544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68243def-1b511b62-c93cb285-4b6c7dcc_0] Write session: Do CDS request
2025-09-30T14:51:20.340553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68243def-1b511b62-c93cb285-4b6c7dcc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:20.346832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68243def-1b511b62-c93cb285-4b6c7dcc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:20.346913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:20.346927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 388
2025-09-30T14:51:20.347077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 388 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:20.347120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 388 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:20.347129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=388 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:20.347134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:20.347525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 388 sessionId:  describe result for acl check
2025-09-30T14:51:20.347556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:20.347561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:20.347562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:20.347567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894932304974074:4763] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:20.348031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894932304974074:4763] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:20.350645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894932304974074:4763] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:20.353831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894932304974074:4763] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:20.353845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894932304974074:4763] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:20.353849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894932304974074:4763] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:20.353856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 388 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:20.356040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:20.358136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:20.358349Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:20.358358Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:20.358366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:20.358404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:20.358442Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894932215248549:4102]
2025-09-30T14:51:20.358893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:20.359139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:20.359183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:20.359525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:20.359584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:20.359589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:20.359591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:20.359592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:20.359593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:20.359594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:20.359595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:20.359596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:20.359598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:20.359599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:20.359601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.359602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.359603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.359604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:20.359605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:20.359610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:20.359622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:20.359626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:20.359630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:20.359634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:20.359638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:20.359642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:20.359647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:20.359651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:20.359656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:20.359660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.359664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.359670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.359674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:20.359679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:20.359686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:20.359695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:20.359702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:20.359712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:20.359718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:20.359723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:20.359728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:20.359737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:20.359743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:20.359754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:20.359758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:20.359768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:20.359772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:20.359782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:20.359787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:20.359796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:20.359802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:20.359811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:20.359816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:20.359825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:20.359830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.359839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.359844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.359854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.359861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.359868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.359877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:20.359882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:20.359889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:20.359898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:20.359949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:20.365330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:20.366321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:20.366338Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:20.366342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:20.366347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:20.366356Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 387 [2:7555894932215248549:4102]
2025-09-30T14:51:20.366379Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:20.366402Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:20.366410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.366414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.366417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.366433Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:20.366441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:20.366454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:20.366525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.366547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.366550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.366554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:20.366557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:20.366643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:20.366651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.366751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.366773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.366794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:20.366759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 387
2025-09-30T14:51:20.366790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 387
2025-09-30T14:51:20.366815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894932304974254:4763], now have 1 active actors on pipe
2025-09-30T14:51:20.366827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894932304974058:2454], now have 1 active actors on pipe
2025-09-30T14:51:20.366843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:20.366852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:20.366877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894932215248544:4102]
2025-09-30T14:51:20.366887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894932215248544:4102]
2025-09-30T14:51:20.366890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894932215248544:4102]
2025-09-30T14:51:20.366904Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:20.366917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:20.366921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:20.366926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:20.366927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:20.366937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:20.366940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:20.366956Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c6097b-88afd580-b0cf129-3b75c861_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:20.366968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.366972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.366980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:20.366990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.367005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:20.367044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894932215248544:4102]
2025-09-30T14:51:20.367057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:20.367067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:20.367074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:20.367229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:20.367238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:20.367287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:20.367486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 388 partition: 0 MaxSeqNo: 42 sessionId: src_id|8c6097b-88afd580-b0cf129-3b75c861_0
2025-09-30T14:51:20.367917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68243def-1b511b62-c93cb285-4b6c7dcc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8c6097b-88afd580-b0cf129-3b75c861_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:20.370687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c6097b-88afd580-b0cf129-3b75c861_0] Write session: try to update token
2025-09-30T14:51:20.370706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c6097b-88afd580-b0cf129-3b75c861_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:20.378697Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:20.378714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:20.378725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894932215248544:4102]
2025-09-30T14:51:20.378768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:20.378772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:20.378983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:20.379166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:20.379328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:20.379470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:20.379680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:20.379729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:20.388039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 388 sessionId: src_id|8c6097b-88afd580-b0cf129-3b75c861_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:20.390030Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:20.390050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:20.390053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:20.390055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:20.390066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894932215248544:4102]
2025-09-30T14:51:20.390070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894932215248544:4102]
2025-09-30T14:51:20.390075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894932215248544:4102]
2025-09-30T14:51:20.390115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:20.390122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.390125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:20.390132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:20.390139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:20.390142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:20.390272Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:20.390698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:20.440505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894932304974281:4267]
2025-09-30T14:51:20.440828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 387, pipe: [1:7555894932304974281:4267]
2025-09-30T14:51:20.501549Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:20.502022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:20.502040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:20.502065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894932304974281:4267], now have 1 active actors on pipe
2025-09-30T14:51:20.502252Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:20.502281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894932304974281:4267]
2025-09-30T14:51:20.502296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:20.502300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:20.502309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:20.502439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 388 reason: error at write: Disconnected sessionId: src_id|8c6097b-88afd580-b0cf129-3b75c861_0
2025-09-30T14:51:20.502641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 388 sessionId: src_id|8c6097b-88afd580-b0cf129-3b75c861_0 is DEAD
2025-09-30T14:51:20.502834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c6097b-88afd580-b0cf129-3b75c861_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:20.502846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c6097b-88afd580-b0cf129-3b75c861_0] Write session will restart in 0.007097s
2025-09-30T14:51:20.502870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c6097b-88afd580-b0cf129-3b75c861_0] Write session: Do CDS request
2025-09-30T14:51:20.502875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c6097b-88afd580-b0cf129-3b75c861_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:20.510872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c6097b-88afd580-b0cf129-3b75c861_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:20.511008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:20.511025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 389
2025-09-30T14:51:20.511165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 389 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:20.511198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 389 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:20.511205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=389 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:20.511209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:20.511720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 389 sessionId:  describe result for acl check
2025-09-30T14:51:20.511768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:20.511775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:20.511777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:20.511783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894932304974326:4768] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:20.512427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894932304974326:4768] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:20.514859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894932304974326:4768] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:20.518276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894932304974326:4768] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:20.518291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894932304974326:4768] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:20.518298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894932304974326:4768] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:20.518307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 389 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:20.518354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:20.521192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:20.521427Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:20.521437Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:20.521449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:20.521506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:20.521548Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894932215248768:4105]
2025-09-30T14:51:20.522232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:20.522572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:20.522619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:20.522948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:20.523010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:20.523017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:20.523018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:20.523019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:20.523021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:20.523022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:20.523024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:20.523025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:20.523027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:20.523028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:20.523030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.523031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.523033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.523034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:20.523035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:20.523041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:20.523052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:20.523057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:20.523061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:20.523065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:20.523070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:20.523074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:20.523078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:20.523082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:20.523087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:20.523092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.523096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.523101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.523105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:20.523109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:20.523116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:20.523130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:20.523142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:20.523152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:20.523158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:20.523164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:20.523169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:20.523179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:20.523188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:20.523198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:20.523207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:20.523214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:20.523224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:20.523230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:20.523239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:20.523269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:20.523274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:20.523279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:20.523283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:20.523289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:20.523294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.523299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.523304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.523311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.523320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.523325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.523330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:20.523338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:20.523343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:20.523347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:20.523395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:20.528907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:20.529789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:20.529806Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:20.529809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:20.529813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:20.529821Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 388 [2:7555894932215248768:4105]
2025-09-30T14:51:20.529838Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:20.529854Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:20.529857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.529860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.529863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.529878Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:20.529889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:20.529897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:20.529960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.529968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.529970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.529973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:20.529976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:20.530046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:20.530058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.530071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.530081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.530097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:20.530117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894932304974496:4768], now have 1 active actors on pipe
2025-09-30T14:51:20.530126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894932304974285:2454], now have 1 active actors on pipe
2025-09-30T14:51:20.530132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894932215248762:4105]
2025-09-30T14:51:20.530136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894932215248762:4105]
2025-09-30T14:51:20.530138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894932215248762:4105]
2025-09-30T14:51:20.530151Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:20.530171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:20.530171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:20.530174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:20.530177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:20.530191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:20.530195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:20.530196Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 388
2025-09-30T14:51:20.530235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894932215248762:4105]
2025-09-30T14:51:20.530207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 388
2025-09-30T14:51:20.530247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:20.530253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:20.530268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:20.530276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:20.530324Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f348aa-b19181e3-9176d155-4c2d8827_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:20.530336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.530340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.530342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:20.530352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.530360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:20.530383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:20.530547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:20.530557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:20.530571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:20.530647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 389 partition: 0 MaxSeqNo: 42 sessionId: src_id|3f348aa-b19181e3-9176d155-4c2d8827_0
2025-09-30T14:51:20.531034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c6097b-88afd580-b0cf129-3b75c861_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3f348aa-b19181e3-9176d155-4c2d8827_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:20.533888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f348aa-b19181e3-9176d155-4c2d8827_0] Write session: try to update token
2025-09-30T14:51:20.533905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f348aa-b19181e3-9176d155-4c2d8827_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:20.542125Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:20.542142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:20.542144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:20.542145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:20.542154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894932215248762:4105]
2025-09-30T14:51:20.542158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894932215248762:4105]
2025-09-30T14:51:20.542162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894932215248762:4105]
2025-09-30T14:51:20.542196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:20.542202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.542204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:20.542213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:20.542220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:20.542224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:20.542368Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:20.550005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 389 sessionId: src_id|3f348aa-b19181e3-9176d155-4c2d8827_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:20.552920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:20.602310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894932304974509:4267]
2025-09-30T14:51:20.602603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 388, pipe: [1:7555894932304974509:4267]
2025-09-30T14:51:20.650644Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:20.650984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:20.651001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:20.651021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894932304974509:4267], now have 1 active actors on pipe
2025-09-30T14:51:20.651262Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:20.651281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:20.651344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:20.651382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894932304974509:4267]
2025-09-30T14:51:20.651419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 389 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3f348aa-b19181e3-9176d155-4c2d8827_0
2025-09-30T14:51:20.651623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 389 sessionId: src_id|3f348aa-b19181e3-9176d155-4c2d8827_0 is DEAD
2025-09-30T14:51:20.651777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f348aa-b19181e3-9176d155-4c2d8827_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:20.651788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f348aa-b19181e3-9176d155-4c2d8827_0] Write session will restart in 0.007602s
2025-09-30T14:51:20.651806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f348aa-b19181e3-9176d155-4c2d8827_0] Write session: Do CDS request
2025-09-30T14:51:20.651811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f348aa-b19181e3-9176d155-4c2d8827_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:20.660852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f348aa-b19181e3-9176d155-4c2d8827_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:20.660921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:20.660937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 390
2025-09-30T14:51:20.661072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 390 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:20.661104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 390 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:20.661114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=390 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:20.661117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:20.661565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 390 sessionId:  describe result for acl check
2025-09-30T14:51:20.661598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:20.661604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:20.661606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:20.661612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894932304974615:4772] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:20.662141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894932304974615:4772] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:20.664010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894932304974615:4772] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:20.667197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:20.667485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894932304974615:4772] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:20.667501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894932304974615:4772] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:20.667504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894932304974615:4772] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:20.667513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 390 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:20.667679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:20.667846Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:20.667857Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:20.667878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:20.667928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:20.667968Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894932215248986:4107]
2025-09-30T14:51:20.668503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:20.668792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:20.668828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:20.669083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:20.669141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:20.669147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:20.669148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:20.669150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:20.669151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:20.669152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:20.669154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:20.669155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:20.669156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:20.669157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:20.669158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.669159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.669161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.669162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:20.669164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:20.669169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:20.669180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:20.669184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:20.669189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:20.669193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:20.669197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:20.669201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:20.669205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:20.669209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:20.669214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:20.669218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.669222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.669226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.669230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:20.669234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:20.669242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:20.669252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:20.669256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:20.669259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:20.669262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:20.669265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:20.669268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:20.669271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:20.669274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:20.669276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:20.669279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:20.669282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:20.669285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:20.669288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:20.669291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:20.669293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:20.669296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:20.669299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:20.669302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:20.669305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:20.669308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.669311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.669313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.669316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.669319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.669322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.669324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:20.669328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:20.669331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:20.669334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:20.669359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:20.674571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:20.675649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:20.675666Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:20.675669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:20.675674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:20.675680Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 389 [2:7555894932215248986:4107]
2025-09-30T14:51:20.675696Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:20.675712Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:20.675715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.675718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.675720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.675737Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:20.675748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:20.675756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:20.675820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.675828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.675830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.675834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:20.675836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:20.675902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:20.675910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.675923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.675937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.675955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:20.675979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894932304974725:4772], now have 1 active actors on pipe
2025-09-30T14:51:20.675988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894932304974511:2454], now have 1 active actors on pipe
2025-09-30T14:51:20.675994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894932215248980:4107]
2025-09-30T14:51:20.675997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894932215248980:4107]
2025-09-30T14:51:20.675999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894932215248980:4107]
2025-09-30T14:51:20.676014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:20.676027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:20.676031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:20.676038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:20.676040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:20.676045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:20.676048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:20.676045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 389
2025-09-30T14:51:20.676083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894932215248980:4107]
2025-09-30T14:51:20.676048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 389
2025-09-30T14:51:20.676091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:20.676094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:20.676113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:20.676118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:20.676167Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89700d3c-9d713eb-f45d9d29-48200f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:20.676178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.676181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.676183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:20.676195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.676208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:20.676229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:20.676424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:20.676434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:20.676449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:20.676536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 390 partition: 0 MaxSeqNo: 42 sessionId: src_id|89700d3c-9d713eb-f45d9d29-48200f0_0
2025-09-30T14:51:20.676920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f348aa-b19181e3-9176d155-4c2d8827_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|89700d3c-9d713eb-f45d9d29-48200f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:20.679686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89700d3c-9d713eb-f45d9d29-48200f0_0] Write session: try to update token
2025-09-30T14:51:20.679703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89700d3c-9d713eb-f45d9d29-48200f0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:20.687963Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:20.687985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:20.687994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894932215248980:4107]
2025-09-30T14:51:20.688042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:20.688046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:20.688255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:20.688402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:20.688532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:20.688659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:20.688844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:20.688884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:20.694298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 390 sessionId: src_id|89700d3c-9d713eb-f45d9d29-48200f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:20.696908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:20.697105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:20.697127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:20.697158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:20.697232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:20.698317Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:20.698333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:20.698336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:20.698338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:20.698347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894932215248980:4107]
2025-09-30T14:51:20.698352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894932215248980:4107]
2025-09-30T14:51:20.698356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894932215248980:4107]
2025-09-30T14:51:20.698384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:20.698390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.698389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:20.698394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:20.698397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:20.698397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:20.698526Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:20.751807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894932304974749:4267]
2025-09-30T14:51:20.752033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 389, pipe: [1:7555894932304974749:4267]
2025-09-30T14:51:20.807126Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:20.814596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:20.814627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:20.814785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:20.814845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:20.814910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:20.814982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:20.815031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:20.815040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:20.815113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:20.815176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:20.815237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:20.815327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:20.815371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:20.815378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:20.815476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:20.815534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:20.815595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:20.815665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:20.815710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:20.815715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:20.815781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:20.815843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:20.815910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:20.815995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:20.816047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:20.816054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:20.816129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:20.816195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:20.816262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:20.816353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:20.816401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:20.816408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:20.816481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:20.816549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:20.816615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:20.816682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:20.816732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:20.816738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:20.816813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:20.816878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:20.816943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:20.817004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:20.817046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:20.817051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:20.817117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:20.817183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:20.817254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:20.817325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:20.817371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:20.817377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:20.817442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:20.817501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:20.817572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:20.817642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:20.817683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:20.817688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:20.817754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:20.817819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:20.817878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:20.817937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:20.818047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:20.818052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:20.818110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894932304974749:4267], now have 1 active actors on pipe
2025-09-30T14:51:20.818347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:20.818360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:20.818372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894932304974749:4267]
2025-09-30T14:51:20.818392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 390 reason: error at write: Disconnected sessionId: src_id|89700d3c-9d713eb-f45d9d29-48200f0_0
2025-09-30T14:51:20.818418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:20.818651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 390 sessionId: src_id|89700d3c-9d713eb-f45d9d29-48200f0_0 is DEAD
2025-09-30T14:51:20.818801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89700d3c-9d713eb-f45d9d29-48200f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:20.818812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89700d3c-9d713eb-f45d9d29-48200f0_0] Write session will restart in 0.009974s
2025-09-30T14:51:20.818841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89700d3c-9d713eb-f45d9d29-48200f0_0] Write session: Do CDS request
2025-09-30T14:51:20.818847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89700d3c-9d713eb-f45d9d29-48200f0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:20.819113Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:20.829796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89700d3c-9d713eb-f45d9d29-48200f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:20.829925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:20.829941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 391
2025-09-30T14:51:20.830063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 391 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:20.830093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 391 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:20.830104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=391 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:20.830107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:20.830486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 391 sessionId:  describe result for acl check
2025-09-30T14:51:20.830516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:20.830519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:20.830520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:20.830527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894932304974867:4784] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:20.831012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894932304974867:4784] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:20.833833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894932304974867:4784] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:20.835076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:20.837575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:20.837770Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:20.837781Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:20.837791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:20.837843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:20.837884Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894932215249252:4122]
2025-09-30T14:51:20.838123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894932304974867:4784] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:20.838148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894932304974867:4784] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:20.838152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894932304974867:4784] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:20.838160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 391 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:20.838528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:20.838795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:20.838834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:20.839152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:20.839211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:20.839217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:20.839218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:20.839220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:20.839221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:20.839222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:20.839223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:20.839224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:20.839225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:20.839226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:20.839228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.839229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.839230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.839231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:20.839232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:20.839237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:20.839262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:20.839267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:20.839272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:20.839276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:20.839280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:20.839284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:20.839288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:20.839292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:20.839297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:20.839300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.839305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.839308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.839312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:20.839316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:20.839324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:20.839332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:20.839338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:20.839343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:20.839348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:20.839353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:20.839358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:20.839362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:20.839367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:20.839373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:20.839377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:20.839382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:20.839387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:20.839393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:20.839397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:20.839402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:20.839407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:20.839412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:20.839416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:20.839421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:20.839426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.839432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.839436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.839441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.839445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.839456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.839459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:20.839464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:20.839474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:20.839479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:20.839523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:20.845141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:20.846306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:20.846323Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:20.846326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:20.846330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:20.846338Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 390 [2:7555894932215249252:4122]
2025-09-30T14:51:20.846353Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:20.846369Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:20.846373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.846376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.846378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.846395Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:20.846401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:20.846408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:20.846467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.846477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.846479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.846482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:20.846484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:20.846571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:20.846581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.846595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.846612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.846634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:20.846659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894932304974988:4784], now have 1 active actors on pipe
2025-09-30T14:51:20.846663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894932304974760:2454], now have 1 active actors on pipe
2025-09-30T14:51:20.846670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894932215249247:4122]
2025-09-30T14:51:20.846672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894932215249247:4122]
2025-09-30T14:51:20.846675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894932215249247:4122]
2025-09-30T14:51:20.846689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:20.846704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:20.846703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:20.846706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:20.846708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:20.846719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:20.846723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:20.846728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 390
2025-09-30T14:51:20.846757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894932215249247:4122]
2025-09-30T14:51:20.846770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:20.846793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:20.846729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 390
2025-09-30T14:51:20.846807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:20.846812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:20.846841Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24efd1b7-980e7cf4-74e04f40-76f26bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:20.846852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.846856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.846858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:20.846867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.846877Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:20.846895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:20.847016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:20.847023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:20.847035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:20.847150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 391 partition: 0 MaxSeqNo: 42 sessionId: src_id|24efd1b7-980e7cf4-74e04f40-76f26bb_0
2025-09-30T14:51:20.847561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89700d3c-9d713eb-f45d9d29-48200f0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|24efd1b7-980e7cf4-74e04f40-76f26bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:20.850187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24efd1b7-980e7cf4-74e04f40-76f26bb_0] Write session: try to update token
2025-09-30T14:51:20.850202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24efd1b7-980e7cf4-74e04f40-76f26bb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:20.858914Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:20.858934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:20.858936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:20.858938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:20.858945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894932215249247:4122]
2025-09-30T14:51:20.858948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894932215249247:4122]
2025-09-30T14:51:20.858950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894932215249247:4122]
2025-09-30T14:51:20.858985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:20.858990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.858992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:20.859014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:20.859029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:20.859033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:20.859126Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:20.864443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 391 sessionId: src_id|24efd1b7-980e7cf4-74e04f40-76f26bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:20.867117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:20.918711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894932304975000:4267]
2025-09-30T14:51:20.918949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 390, pipe: [1:7555894932304975000:4267]
2025-09-30T14:51:20.968092Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:20.968444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:20.968461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:20.968501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894932304975000:4267], now have 1 active actors on pipe
2025-09-30T14:51:20.968683Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:20.968764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894932304975000:4267]
2025-09-30T14:51:20.968768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:20.968771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:20.968791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:20.968822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 391 reason: error at write: Disconnected sessionId: src_id|24efd1b7-980e7cf4-74e04f40-76f26bb_0
2025-09-30T14:51:20.969004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 391 sessionId: src_id|24efd1b7-980e7cf4-74e04f40-76f26bb_0 is DEAD
2025-09-30T14:51:20.969179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24efd1b7-980e7cf4-74e04f40-76f26bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:20.969191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24efd1b7-980e7cf4-74e04f40-76f26bb_0] Write session will restart in 0.009509s
2025-09-30T14:51:20.969213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24efd1b7-980e7cf4-74e04f40-76f26bb_0] Write session: Do CDS request
2025-09-30T14:51:20.969222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24efd1b7-980e7cf4-74e04f40-76f26bb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:20.979739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24efd1b7-980e7cf4-74e04f40-76f26bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:20.979814Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:20.979843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 392
2025-09-30T14:51:20.979956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 392 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:20.979998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 392 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:20.980007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=392 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:20.980011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:20.980468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 392 sessionId:  describe result for acl check
2025-09-30T14:51:20.980507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:20.980514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:20.980517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:20.980523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894932304975114:4790] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:20.981078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894932304975114:4790] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:20.983313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894932304975114:4790] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:20.984647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:20.987156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:20.987383Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:20.987396Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:20.987409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:20.987471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:20.987513Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894932215249473:4124]
2025-09-30T14:51:20.987614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894932304975114:4790] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:20.987631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894932304975114:4790] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:20.987634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894932304975114:4790] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:20.987644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 392 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:20.988139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:20.988450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:20.988499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:20.988820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:20.988885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:20.988892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:20.988893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:20.988894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:20.988895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:20.988896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:20.988897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:20.988899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:20.988900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:20.988901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:20.988902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.988903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.988904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.988905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:20.988906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:20.988911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:20.988921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:20.988925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:20.988928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:20.988932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:20.988937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:20.988940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:20.988944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:20.988947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:20.988951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:20.988954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.988957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.988960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.988964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:20.988967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:20.988974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:20.988981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:20.988987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:20.988992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:20.988996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:20.989000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:20.989004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:20.989008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:20.989012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:20.989018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:20.989023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:20.989027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:20.989032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:20.989036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:20.989040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:20.989045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:20.989049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:20.989054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:20.989058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:20.989063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:20.989068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.989072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.989076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.989081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.989086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.989091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.989095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:20.989101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:20.989106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:20.989110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:20.989153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:20.994672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:20.995564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:20.995579Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:20.995582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:20.995586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:20.995595Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 391 [2:7555894932215249473:4124]
2025-09-30T14:51:20.995611Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:20.995627Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:20.995631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.995634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.995636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.995651Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:20.995658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:20.995671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:20.995737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.995744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.995746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.995749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:20.995752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:20.995810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:20.995823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:20.995837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:20.995850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:20.995868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:20.995892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894932304975230:4790], now have 1 active actors on pipe
2025-09-30T14:51:20.995896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894932304975010:2454], now have 1 active actors on pipe
2025-09-30T14:51:20.995903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894932215249468:4124]
2025-09-30T14:51:20.995906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894932215249468:4124]
2025-09-30T14:51:20.995908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894932215249468:4124]
2025-09-30T14:51:20.995920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:20.995934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:20.995937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:20.995941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:20.995943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:20.995948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:20.995951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:20.995918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 391
2025-09-30T14:51:20.995933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 391
2025-09-30T14:51:20.995995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:20.996006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:20.996024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894932215249468:4124]
2025-09-30T14:51:20.996038Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:20.996061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:20.996072Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67a369e4-89506615-6d30d2e-c29219c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:20.996079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.996083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.996085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:20.996094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.996103Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:20.996132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:20.996303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:20.996324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:20.996352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:20.996468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 392 partition: 0 MaxSeqNo: 42 sessionId: src_id|67a369e4-89506615-6d30d2e-c29219c1_0
2025-09-30T14:51:20.996879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24efd1b7-980e7cf4-74e04f40-76f26bb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|67a369e4-89506615-6d30d2e-c29219c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:20.999598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67a369e4-89506615-6d30d2e-c29219c1_0] Write session: try to update token
2025-09-30T14:51:20.999616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67a369e4-89506615-6d30d2e-c29219c1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:21.007937Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:21.007965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:21.007968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:21.007970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:21.007979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894932215249468:4124]
2025-09-30T14:51:21.007983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894932215249468:4124]
2025-09-30T14:51:21.007987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894932215249468:4124]
2025-09-30T14:51:21.008027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:21.008031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:21.008035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.008037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:21.008038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:21.008040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:21.008176Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:21.014801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 392 sessionId: src_id|67a369e4-89506615-6d30d2e-c29219c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:21.017805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:21.068711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894936599942541:4267]
2025-09-30T14:51:21.068932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 391, pipe: [1:7555894936599942541:4267]
2025-09-30T14:51:21.114820Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:21.115370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:21.115383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:21.115400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894936599942541:4267], now have 1 active actors on pipe
2025-09-30T14:51:21.115551Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:21.115675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:21.115680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894936599942541:4267]
2025-09-30T14:51:21.115701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:21.115936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 392 reason: status is not ok: tablet will be restarted right now sessionId: src_id|67a369e4-89506615-6d30d2e-c29219c1_0
2025-09-30T14:51:21.116118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 392 sessionId: src_id|67a369e4-89506615-6d30d2e-c29219c1_0 is DEAD
2025-09-30T14:51:21.116283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67a369e4-89506615-6d30d2e-c29219c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:21.116292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67a369e4-89506615-6d30d2e-c29219c1_0] Write session will restart in 0.007683s
2025-09-30T14:51:21.116318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67a369e4-89506615-6d30d2e-c29219c1_0] Write session: Do CDS request
2025-09-30T14:51:21.116323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67a369e4-89506615-6d30d2e-c29219c1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:21.124835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67a369e4-89506615-6d30d2e-c29219c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:21.124933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:21.124948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 393
2025-09-30T14:51:21.125072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 393 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:21.125103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 393 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:21.125112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=393 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:21.125117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:21.125647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 393 sessionId:  describe result for acl check
2025-09-30T14:51:21.125680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:21.125687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:21.125689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:21.125694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894936599942591:4794] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:21.126209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894936599942591:4794] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:21.128739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894936599942591:4794] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:21.131436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894936599942591:4794] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:21.131450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894936599942591:4794] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:21.131453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894936599942591:4794] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:21.131461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 393 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:21.131887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:21.134121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:21.134328Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:21.134338Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:21.134349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:21.134401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:21.134445Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894936510216993:4127]
2025-09-30T14:51:21.135121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:21.135468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:21.135528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:21.135810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:21.135871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:21.135877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:21.135878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:21.135879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:21.135881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:21.135882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:21.135883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:21.135885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:21.135886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:21.135888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:21.135889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.135890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.135891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.135892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:21.135893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:21.135900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:21.135911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:21.135916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:21.135919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:21.135923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:21.135926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:21.135930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:21.135934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:21.135937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:21.135941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:21.135944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.135948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.135951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.135955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:21.135958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:21.135967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:21.135975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:21.135980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:21.135986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:21.135992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:21.135997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:21.136002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:21.136007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:21.136013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:21.136016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:21.136018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:21.136021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:21.136024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:21.136027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:21.136030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:21.136033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:21.136035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:21.136038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:21.136041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:21.136044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:21.136047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.136050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.136052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.136055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.136058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.136061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.136066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:21.136071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:21.136079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:21.136084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:21.136114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:21.141572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:21.142818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:21.142836Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:21.142839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:21.142843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:21.142849Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 392 [2:7555894936510216993:4127]
2025-09-30T14:51:21.142866Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:21.142881Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:21.142889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:21.142892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:21.142898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:21.142914Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:21.142926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:21.142937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:21.143007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.143017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.143019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.143023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:21.143025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:21.143092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:21.143100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.143112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.143127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.143147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:21.143169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894936599942759:4794], now have 1 active actors on pipe
2025-09-30T14:51:21.143181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894936510216988:4127]
2025-09-30T14:51:21.143183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894936510216988:4127]
2025-09-30T14:51:21.143186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894936510216988:4127]
2025-09-30T14:51:21.143198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:21.143212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894936599942542:2454], now have 1 active actors on pipe
2025-09-30T14:51:21.143217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:21.143221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:21.143223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:21.143224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:21.143237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:21.143259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:21.143291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894936510216988:4127]
2025-09-30T14:51:21.143299Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:21.143268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 392
2025-09-30T14:51:21.143308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:21.143279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 392
2025-09-30T14:51:21.143340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:21.143349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:21.143381Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44a57a24-e4dc490c-c49a0c3d-fb0028ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:21.143398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:21.143404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:21.143406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:21.143416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:21.143425Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:21.143448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:21.143625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:21.143634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:21.143649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:21.143732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 393 partition: 0 MaxSeqNo: 42 sessionId: src_id|44a57a24-e4dc490c-c49a0c3d-fb0028ac_0
2025-09-30T14:51:21.144107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67a369e4-89506615-6d30d2e-c29219c1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|44a57a24-e4dc490c-c49a0c3d-fb0028ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:21.147040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44a57a24-e4dc490c-c49a0c3d-fb0028ac_0] Write session: try to update token
2025-09-30T14:51:21.147064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44a57a24-e4dc490c-c49a0c3d-fb0028ac_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:21.155233Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:21.155278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:21.155281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:21.155283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:21.155293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894936510216988:4127]
2025-09-30T14:51:21.155298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894936510216988:4127]
2025-09-30T14:51:21.155302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894936510216988:4127]
2025-09-30T14:51:21.155340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:21.155340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:21.155347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:21.155351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:21.155352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.155354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:21.155497Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:21.161940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 393 sessionId: src_id|44a57a24-e4dc490c-c49a0c3d-fb0028ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:21.164803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:21.215669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894936599942771:4267]
2025-09-30T14:51:21.215904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 392, pipe: [1:7555894936599942771:4267]
2025-09-30T14:51:21.268542Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:21.269009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:21.269024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:21.269044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894936599942771:4267], now have 1 active actors on pipe
2025-09-30T14:51:21.269264Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:21.269272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:21.269276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:21.269279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:21.269326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894936599942771:4267]
2025-09-30T14:51:21.269329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 393 reason: error at write: Disconnected sessionId: src_id|44a57a24-e4dc490c-c49a0c3d-fb0028ac_0
2025-09-30T14:51:21.269498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 393 sessionId: src_id|44a57a24-e4dc490c-c49a0c3d-fb0028ac_0 is DEAD
2025-09-30T14:51:21.269689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44a57a24-e4dc490c-c49a0c3d-fb0028ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:21.269696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44a57a24-e4dc490c-c49a0c3d-fb0028ac_0] Write session will restart in 0.007059s
2025-09-30T14:51:21.269712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44a57a24-e4dc490c-c49a0c3d-fb0028ac_0] Write session: Do CDS request
2025-09-30T14:51:21.269719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44a57a24-e4dc490c-c49a0c3d-fb0028ac_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:21.277891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44a57a24-e4dc490c-c49a0c3d-fb0028ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:21.277994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:21.278013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 394
2025-09-30T14:51:21.278205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 394 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:21.278249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 394 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:21.278259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=394 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:21.278263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:21.278721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 394 sessionId:  describe result for acl check
2025-09-30T14:51:21.278766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:21.278775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:21.278777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:21.278783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894936599942807:4798] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:21.279442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894936599942807:4798] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:21.282155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894936599942807:4798] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:21.285031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894936599942807:4798] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:21.285046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894936599942807:4798] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:21.285050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894936599942807:4798] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:21.285059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 394 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:21.286600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:21.288736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:21.288930Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:21.288940Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:21.288947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:21.288993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:21.289034Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894936510217215:4129]
2025-09-30T14:51:21.289672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:21.289958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:21.290003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:21.290325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:21.290380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:21.290386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:21.290387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:21.290389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:21.290390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:21.290392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:21.290393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:21.290395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:21.290396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:21.290397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:21.290399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.290400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.290401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.290402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:21.290403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:21.290408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:21.290419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:21.290422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:21.290427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:21.290431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:21.290435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:21.290440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:21.290444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:21.290448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:21.290452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:21.290456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.290461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.290465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.290469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:21.290473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:21.290479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:21.290487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:21.290492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:21.290498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:21.290502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:21.290508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:21.290518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:21.290524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:21.290541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:21.290546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:21.290554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:21.290559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:21.290567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:21.290573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:21.290579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:21.290585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:21.290596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:21.290602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:21.290606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:21.290611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:21.290618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.290623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.290630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.290636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.290642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.290648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.290654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:21.290659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:21.290664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:21.290670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:21.290715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:21.296152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:21.297106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:21.297121Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:21.297124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:21.297128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:21.297134Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 393 [2:7555894936510217215:4129]
2025-09-30T14:51:21.297150Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:21.297166Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:21.297169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:21.297172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:21.297174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:21.297191Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:21.297203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:21.297210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:21.297270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.297279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.297281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.297286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:21.297288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:21.297353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:21.297360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.297373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.297387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.297410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:21.297431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894936599942987:4798], now have 1 active actors on pipe
2025-09-30T14:51:21.297439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894936599942772:2454], now have 1 active actors on pipe
2025-09-30T14:51:21.297445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894936510217210:4129]
2025-09-30T14:51:21.297452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894936510217210:4129]
2025-09-30T14:51:21.297455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894936510217210:4129]
2025-09-30T14:51:21.297472Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:21.297488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:21.297496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:21.297500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:21.297502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:21.297509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:21.297512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:21.297486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 393
2025-09-30T14:51:21.297486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 393
2025-09-30T14:51:21.297548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894936510217210:4129]
2025-09-30T14:51:21.297559Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:21.297577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:21.297586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:21.297591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:21.297631Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db7cafb4-99a59cd4-86e8de02-e69b4c04_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:21.297642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:21.297650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:21.297653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:21.297662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:21.297674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:21.297695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:21.297853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:21.297869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:21.297896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:21.297994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 394 partition: 0 MaxSeqNo: 42 sessionId: src_id|db7cafb4-99a59cd4-86e8de02-e69b4c04_0
2025-09-30T14:51:21.298376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44a57a24-e4dc490c-c49a0c3d-fb0028ac_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|db7cafb4-99a59cd4-86e8de02-e69b4c04_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:21.301076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db7cafb4-99a59cd4-86e8de02-e69b4c04_0] Write session: try to update token
2025-09-30T14:51:21.301093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db7cafb4-99a59cd4-86e8de02-e69b4c04_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:21.309728Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:21.309748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:21.309750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:21.309753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:21.309762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894936510217210:4129]
2025-09-30T14:51:21.309768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894936510217210:4129]
2025-09-30T14:51:21.309772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894936510217210:4129]
2025-09-30T14:51:21.309815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:21.309822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.309825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:21.309830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:21.309837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:21.309841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:21.309963Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:21.315632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 394 sessionId: src_id|db7cafb4-99a59cd4-86e8de02-e69b4c04_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:21.318501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:21.369279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894936599943002:4267]
2025-09-30T14:51:21.369570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 393, pipe: [1:7555894936599943002:4267]
2025-09-30T14:51:21.419224Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:21.419474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:21.419485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:21.419516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894936599943002:4267], now have 1 active actors on pipe
2025-09-30T14:51:21.419725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894936599943002:4267]
2025-09-30T14:51:21.419735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:21.419757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:21.419828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 394 reason: status is not ok: tablet will be restarted right now sessionId: src_id|db7cafb4-99a59cd4-86e8de02-e69b4c04_0
2025-09-30T14:51:21.419674Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:21.420006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 394 sessionId: src_id|db7cafb4-99a59cd4-86e8de02-e69b4c04_0 is DEAD
2025-09-30T14:51:21.420169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db7cafb4-99a59cd4-86e8de02-e69b4c04_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:21.420179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db7cafb4-99a59cd4-86e8de02-e69b4c04_0] Write session will restart in 0.009990s
2025-09-30T14:51:21.420204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db7cafb4-99a59cd4-86e8de02-e69b4c04_0] Write session: Do CDS request
2025-09-30T14:51:21.420210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db7cafb4-99a59cd4-86e8de02-e69b4c04_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:21.431754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db7cafb4-99a59cd4-86e8de02-e69b4c04_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:21.431845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:21.431861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 395
2025-09-30T14:51:21.432012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 395 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:21.432069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 395 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:21.432078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=395 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:21.432083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:21.432499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 395 sessionId:  describe result for acl check
2025-09-30T14:51:21.432529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:21.432532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:21.432533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:21.432538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894936599943167:4802] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:21.432960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894936599943167:4802] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:21.434646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:21.435012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894936599943167:4802] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:21.437059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:21.437254Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:21.437264Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:21.437274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:21.437328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:21.437368Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894936510217437:4131]
2025-09-30T14:51:21.437528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894936599943167:4802] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:21.437541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894936599943167:4802] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:21.437544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894936599943167:4802] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:21.437551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 395 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:21.437980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:21.438246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:21.438286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:21.438601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:21.438665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:21.438672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:21.438673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:21.438674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:21.438675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:21.438676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:21.438677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:21.438678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:21.438679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:21.438680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:21.438681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.438682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.438683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.438684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:21.438685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:21.438690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:21.438699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:21.438703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:21.438707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:21.438710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:21.438714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:21.438717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:21.438721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:21.438724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:21.438728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:21.438732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.438735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.438739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.438742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:21.438746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:21.438755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:21.438763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:21.438768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:21.438773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:21.438778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:21.438783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:21.438787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:21.438792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:21.438796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:21.438801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:21.438804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:21.438809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:21.438813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:21.438818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:21.438822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:21.438827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:21.438831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:21.438835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:21.438839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:21.438843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:21.438849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.438854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.438858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.438863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.438866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.438871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.438875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:21.438879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:21.438883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:21.438894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:21.438933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:21.444365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:21.445324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:21.445346Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:21.445349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:21.445353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:21.445360Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 394 [2:7555894936510217437:4131]
2025-09-30T14:51:21.445375Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:21.445389Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:21.445398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:21.445401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:21.445404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:21.445420Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:21.445427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:21.445433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:21.445489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.445497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.445498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.445501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:21.445504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:21.445680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 394
2025-09-30T14:51:21.445686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 394
2025-09-30T14:51:21.445801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:21.445810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.445824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.445843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.445868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:21.445891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894936599943222:4802], now have 1 active actors on pipe
2025-09-30T14:51:21.445900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894936599943003:2454], now have 1 active actors on pipe
2025-09-30T14:51:21.445921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:21.445930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:21.445945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894936510217432:4131]
2025-09-30T14:51:21.445952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894936510217432:4131]
2025-09-30T14:51:21.445956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894936510217432:4131]
2025-09-30T14:51:21.445969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:21.445984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:21.445987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:21.445995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:21.445997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:21.446002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:21.446005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:21.446023Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48057325-4ccd1600-402b07dd-492dc92c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:21.446034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:21.446039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:21.446041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:21.446051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:21.446064Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:21.446106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894936510217432:4131]
2025-09-30T14:51:21.446120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:21.446126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:21.446136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:21.446309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:21.446317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:21.446332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:21.446431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 395 partition: 0 MaxSeqNo: 42 sessionId: src_id|48057325-4ccd1600-402b07dd-492dc92c_0
2025-09-30T14:51:21.446846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db7cafb4-99a59cd4-86e8de02-e69b4c04_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|48057325-4ccd1600-402b07dd-492dc92c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:21.449815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48057325-4ccd1600-402b07dd-492dc92c_0] Write session: try to update token
2025-09-30T14:51:21.449836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48057325-4ccd1600-402b07dd-492dc92c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:21.463646Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:21.463671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:21.463682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894936510217432:4131]
2025-09-30T14:51:21.463730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:21.463745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:21.463911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:21.464115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:21.464264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:21.464409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:21.464625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:21.464668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:21.465229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 395 sessionId: src_id|48057325-4ccd1600-402b07dd-492dc92c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:21.467975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:21.468886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:21.468912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:21.468930Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:21.468933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:21.468936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:21.468938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:21.468946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894936510217432:4131]
2025-09-30T14:51:21.468950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894936510217432:4131]
2025-09-30T14:51:21.468953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894936510217432:4131]
2025-09-30T14:51:21.468984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:21.468994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:21.468999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.469001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:21.469002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:21.469005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:21.469130Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:21.519814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894936599943236:4267]
2025-09-30T14:51:21.520095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 394, pipe: [1:7555894936599943236:4267]
2025-09-30T14:51:21.575727Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:21.576093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:21.576124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894936599943236:4267], now have 1 active actors on pipe
2025-09-30T14:51:21.576241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:21.576293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894936599943236:4267]
2025-09-30T14:51:21.576315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:21.576342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:21.576353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:21.576422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 395 reason: error at write: Disconnected sessionId: src_id|48057325-4ccd1600-402b07dd-492dc92c_0
2025-09-30T14:51:21.576622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 395 sessionId: src_id|48057325-4ccd1600-402b07dd-492dc92c_0 is DEAD
2025-09-30T14:51:21.576760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48057325-4ccd1600-402b07dd-492dc92c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:21.576772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48057325-4ccd1600-402b07dd-492dc92c_0] Write session will restart in 0.009173s
2025-09-30T14:51:21.576794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48057325-4ccd1600-402b07dd-492dc92c_0] Write session: Do CDS request
2025-09-30T14:51:21.576800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48057325-4ccd1600-402b07dd-492dc92c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:21.586802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48057325-4ccd1600-402b07dd-492dc92c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:21.586879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:21.586892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 396
2025-09-30T14:51:21.587052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 396 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:21.587093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 396 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:21.587104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=396 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:21.587108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:21.587571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 396 sessionId:  describe result for acl check
2025-09-30T14:51:21.587602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:21.587608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:21.587610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:21.587618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894936599943330:4807] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:21.588069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894936599943330:4807] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:21.590505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894936599943330:4807] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:21.592043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:21.594383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:21.594658Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:21.594669Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:21.594679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:21.594727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:21.594768Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894936510217663:4134]
2025-09-30T14:51:21.595402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:21.595673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:21.595719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:21.595923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894936599943330:4807] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:21.595943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894936599943330:4807] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:21.595947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894936599943330:4807] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:21.595956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 396 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:21.596052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:21.596110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:21.596116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:21.596117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:21.596118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:21.596119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:21.596121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:21.596122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:21.596123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:21.596124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:21.596125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:21.596127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.596127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.596129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.596130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:21.596130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:21.596136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:21.596146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:21.596150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:21.596154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:21.596157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:21.596161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:21.596166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:21.596170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:21.596174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:21.596180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:21.596184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.596188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.596192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.596196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:21.596200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:21.596207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:21.596215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:21.596221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:21.596227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:21.596232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:21.596237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:21.596241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:21.596247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:21.596251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:21.596256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:21.596260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:21.596266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:21.596277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:21.596282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:21.596286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:21.596291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:21.596297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:21.596302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:21.596307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:21.596312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:21.596317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.596322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.596332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.596337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.596344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.596354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.596359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:21.596369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:21.596372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:21.596375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:21.596414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:21.601641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:21.602800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:21.602816Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:21.602819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:21.602823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:21.602830Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 395 [2:7555894936510217663:4134]
2025-09-30T14:51:21.602848Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:21.602863Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:21.602866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:21.602870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:21.602872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:21.602888Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:21.602900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:21.602906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:21.602972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.602981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.602983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.602987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:21.602990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:21.603052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:21.603060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.603072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.603085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.603106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:21.603126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894936510217658:4134]
2025-09-30T14:51:21.603132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894936510217658:4134]
2025-09-30T14:51:21.603135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894936510217658:4134]
2025-09-30T14:51:21.603146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:21.603161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:21.603165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894936599943237:2454], now have 1 active actors on pipe
2025-09-30T14:51:21.603169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894936599943459:4807], now have 1 active actors on pipe
2025-09-30T14:51:21.603172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:21.603175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:21.603177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:21.603193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:21.603196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:21.603228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 395
2025-09-30T14:51:21.603279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 395
2025-09-30T14:51:21.603230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894936510217658:4134]
2025-09-30T14:51:21.603256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:21.603259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:21.603298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:21.603303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:21.603335Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e06edf5a-72003150-77928e1b-5677b627_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:21.603342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:21.603345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:21.603347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:21.603357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:21.603366Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:21.603378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:21.603548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:21.603558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:21.603574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:21.603667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 396 partition: 0 MaxSeqNo: 42 sessionId: src_id|e06edf5a-72003150-77928e1b-5677b627_0
2025-09-30T14:51:21.604050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48057325-4ccd1600-402b07dd-492dc92c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e06edf5a-72003150-77928e1b-5677b627_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:21.606836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e06edf5a-72003150-77928e1b-5677b627_0] Write session: try to update token
2025-09-30T14:51:21.606860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e06edf5a-72003150-77928e1b-5677b627_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:21.615233Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:21.615271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:21.615274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:21.615277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:21.615287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894936510217658:4134]
2025-09-30T14:51:21.615292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894936510217658:4134]
2025-09-30T14:51:21.615297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894936510217658:4134]
2025-09-30T14:51:21.615341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:21.615348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.615348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:21.615351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:21.615355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:21.615363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:21.615491Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:21.622002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 396 sessionId: src_id|e06edf5a-72003150-77928e1b-5677b627_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:21.624999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:21.676478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894936599943470:4267]
2025-09-30T14:51:21.676719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 395, pipe: [1:7555894936599943470:4267]
2025-09-30T14:51:21.720660Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:21.721081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:21.721100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:21.721118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894936599943470:4267], now have 1 active actors on pipe
2025-09-30T14:51:21.721306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:21.721309Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:21.721321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:21.721343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894936599943470:4267]
2025-09-30T14:51:21.721383Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:21.721386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 396 reason: error at write: Disconnected sessionId: src_id|e06edf5a-72003150-77928e1b-5677b627_0
2025-09-30T14:51:21.721611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 396 sessionId: src_id|e06edf5a-72003150-77928e1b-5677b627_0 is DEAD
2025-09-30T14:51:21.721749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e06edf5a-72003150-77928e1b-5677b627_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:21.721760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e06edf5a-72003150-77928e1b-5677b627_0] Write session will restart in 0.005702s
2025-09-30T14:51:21.721781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e06edf5a-72003150-77928e1b-5677b627_0] Write session: Do CDS request
2025-09-30T14:51:21.721799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e06edf5a-72003150-77928e1b-5677b627_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:21.728841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e06edf5a-72003150-77928e1b-5677b627_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:21.728852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:21.728869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 397
2025-09-30T14:51:21.729126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 397 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:21.729157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 397 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:21.729161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=397 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:21.729164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:21.729573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 397 sessionId:  describe result for acl check
2025-09-30T14:51:21.729615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:21.729625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:21.729627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:21.729632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894936599943494:4811] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:21.730206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894936599943494:4811] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:21.732529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894936599943494:4811] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:21.735439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894936599943494:4811] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:21.735454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894936599943494:4811] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:21.735458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894936599943494:4811] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:21.735466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 397 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:21.737549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:21.740303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:21.740504Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:21.740516Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:21.740526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:21.740573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:21.740622Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894936510217888:4136]
2025-09-30T14:51:21.741288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:21.741601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:21.741645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:21.741984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:21.742044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:21.742051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:21.742052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:21.742053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:21.742054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:21.742056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:21.742057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:21.742058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:21.742060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:21.742061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:21.742063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.742064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.742065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.742066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:21.742067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:21.742072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:21.742083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:21.742087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:21.742092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:21.742096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:21.742100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:21.742105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:21.742109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:21.742113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:21.742117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:21.742121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.742125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.742129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.742133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:21.742137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:21.742144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:21.742152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:21.742158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:21.742164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:21.742168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:21.742174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:21.742178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:21.742184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:21.742188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:21.742194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:21.742198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:21.742204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:21.742209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:21.742214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:21.742218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:21.742223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:21.742228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:21.742234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:21.742238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:21.742243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:21.742249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.742254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.742259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.742264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.742269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.742274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.742278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:21.742289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:21.742294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:21.742304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:21.742356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:21.747944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:21.749008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:21.749027Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:21.749031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:21.749035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:21.749043Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 396 [2:7555894936510217888:4136]
2025-09-30T14:51:21.749059Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:21.749077Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:21.749085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:21.749089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:21.749091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:21.749109Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:21.749121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:21.749128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:21.749194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.749202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.749204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.749208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:21.749211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:21.749278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:21.749287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.749301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.749314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.749332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:21.749359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894936599943665:4811], now have 1 active actors on pipe
2025-09-30T14:51:21.749369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894936599943471:2454], now have 1 active actors on pipe
2025-09-30T14:51:21.749376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894936510217883:4136]
2025-09-30T14:51:21.749378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894936510217883:4136]
2025-09-30T14:51:21.749380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894936510217883:4136]
2025-09-30T14:51:21.749392Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:21.749406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:21.749410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:21.749414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:21.749416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:21.749421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:21.749424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:21.749419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 396
2025-09-30T14:51:21.749428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 396
2025-09-30T14:51:21.749458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894936510217883:4136]
2025-09-30T14:51:21.749468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:21.749470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:21.749488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:21.749492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:21.749799Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a36ddae-ebe5aafe-302118cb-d69d8c83_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:21.749812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:21.749815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:21.749817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:21.749826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:21.749835Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:21.749857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:21.750054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:21.750070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:21.750094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:21.750189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 397 partition: 0 MaxSeqNo: 42 sessionId: src_id|a36ddae-ebe5aafe-302118cb-d69d8c83_0
2025-09-30T14:51:21.750652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e06edf5a-72003150-77928e1b-5677b627_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a36ddae-ebe5aafe-302118cb-d69d8c83_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:21.753546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a36ddae-ebe5aafe-302118cb-d69d8c83_0] Write session: try to update token
2025-09-30T14:51:21.753568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a36ddae-ebe5aafe-302118cb-d69d8c83_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:21.761938Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:21.761958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:21.761961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:21.761962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:21.761970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894936510217883:4136]
2025-09-30T14:51:21.761973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894936510217883:4136]
2025-09-30T14:51:21.761977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894936510217883:4136]
2025-09-30T14:51:21.762017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:21.762028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.762033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:21.762032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:21.762038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:21.762042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:21.762189Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:21.773556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 397 sessionId: src_id|a36ddae-ebe5aafe-302118cb-d69d8c83_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:21.776402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:21.821395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894936599943728:4267]
2025-09-30T14:51:21.821668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 396, pipe: [1:7555894936599943728:4267]
2025-09-30T14:51:21.870683Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:21.871293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:21.871308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:21.871325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894936599943728:4267], now have 1 active actors on pipe
2025-09-30T14:51:21.871490Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:21.871616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894936599943728:4267]
2025-09-30T14:51:21.871622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:21.871626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:21.871648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:21.871691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 397 reason: error at write: Disconnected sessionId: src_id|a36ddae-ebe5aafe-302118cb-d69d8c83_0
2025-09-30T14:51:21.871910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 397 sessionId: src_id|a36ddae-ebe5aafe-302118cb-d69d8c83_0 is DEAD
2025-09-30T14:51:21.872057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a36ddae-ebe5aafe-302118cb-d69d8c83_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:21.872067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a36ddae-ebe5aafe-302118cb-d69d8c83_0] Write session will restart in 0.005680s
2025-09-30T14:51:21.872091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a36ddae-ebe5aafe-302118cb-d69d8c83_0] Write session: Do CDS request
2025-09-30T14:51:21.872099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a36ddae-ebe5aafe-302118cb-d69d8c83_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:21.878830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a36ddae-ebe5aafe-302118cb-d69d8c83_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:21.878877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:21.878889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 398
2025-09-30T14:51:21.879037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 398 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:21.879089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 398 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:21.879099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=398 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:21.879103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:21.879565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 398 sessionId:  describe result for acl check
2025-09-30T14:51:21.879597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:21.879604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:21.879606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:21.879612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894936599943765:4823] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:21.880078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894936599943765:4823] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:21.882634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894936599943765:4823] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:21.885768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894936599943765:4823] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:21.885783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894936599943765:4823] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:21.885786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894936599943765:4823] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:21.885795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 398 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:21.887662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:21.889960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:21.890154Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:21.890162Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:21.890170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:21.890211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:21.890252Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894936510218163:4151]
2025-09-30T14:51:21.890867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:21.891153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:21.891196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:21.891513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:21.891568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:21.891574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:21.891575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:21.891576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:21.891578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:21.891579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:21.891580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:21.891582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:21.891583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:21.891584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:21.891585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.891586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.891587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.891588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:21.891589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:21.891594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:21.891605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:21.891609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:21.891613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:21.891617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:21.891620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:21.891624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:21.891627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:21.891630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:21.891635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:21.891639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.891643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.891647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.891651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:21.891655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:21.891662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:21.891670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:21.891676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:21.891681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:21.891686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:21.891691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:21.891701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:21.891708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:21.891717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:21.891722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:21.891726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:21.891736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:21.891741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:21.891750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:21.891754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:21.891761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:21.891769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:21.891775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:21.891780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:21.891789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:21.891794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.891799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.891807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.891813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.891822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.891828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.891835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:21.891838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:21.891842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:21.891846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:21.891871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:21.897320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:21.898465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:21.898481Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:21.898483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:21.898487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:21.898493Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 397 [2:7555894936510218163:4151]
2025-09-30T14:51:21.898509Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:21.898523Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:21.898540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:21.898547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:21.898550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:21.898565Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:21.898577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:21.898583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:21.898648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.898655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.898658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.898661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:21.898664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:21.898727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:21.898736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.898748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:21.898765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:21.898788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:21.898809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894936510218158:4151]
2025-09-30T14:51:21.898816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894936510218158:4151]
2025-09-30T14:51:21.898819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894936510218158:4151]
2025-09-30T14:51:21.898830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:21.898844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894936599943960:4823], now have 1 active actors on pipe
2025-09-30T14:51:21.898844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:21.898849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:21.898852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:21.898852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894936599943741:2454], now have 1 active actors on pipe
2025-09-30T14:51:21.898859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:21.898872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:21.898880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:21.898906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894936510218158:4151]
2025-09-30T14:51:21.898914Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:21.898902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 397
2025-09-30T14:51:21.898934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:21.898947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:21.898906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 397
2025-09-30T14:51:21.898952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:21.898981Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b5cbe3c-88fabae2-b3451988-7b42205d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:21.898994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:21.898998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:21.899000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:21.899010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:21.899024Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:21.899038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:21.899254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:21.899269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:21.899290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:21.899410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 398 partition: 0 MaxSeqNo: 42 sessionId: src_id|7b5cbe3c-88fabae2-b3451988-7b42205d_0
2025-09-30T14:51:21.899831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a36ddae-ebe5aafe-302118cb-d69d8c83_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7b5cbe3c-88fabae2-b3451988-7b42205d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:21.902789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b5cbe3c-88fabae2-b3451988-7b42205d_0] Write session: try to update token
2025-09-30T14:51:21.902808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b5cbe3c-88fabae2-b3451988-7b42205d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:21.910125Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:21.910150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:21.910160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894936510218158:4151]
2025-09-30T14:51:21.910203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:21.910216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:21.910369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:21.910514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:21.910672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:21.910807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:21.911027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:21.911080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:21.917192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 398 sessionId: src_id|7b5cbe3c-88fabae2-b3451988-7b42205d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:21.919762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:21.920699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:21.920722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:21.920741Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:21.920744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:21.920746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:21.920747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:21.920754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894936510218158:4151]
2025-09-30T14:51:21.920756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894936510218158:4151]
2025-09-30T14:51:21.920759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894936510218158:4151]
2025-09-30T14:51:21.920791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:21.920797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:21.920798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:21.920800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:21.920803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:21.920805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:21.920925Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:21.971914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894936599943982:4267]
2025-09-30T14:51:21.972129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 397, pipe: [1:7555894936599943982:4267]
2025-09-30T14:51:22.028651Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:22.028988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:22.029019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894936599943982:4267], now have 1 active actors on pipe
2025-09-30T14:51:22.029131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:22.029215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:22.029220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:22.029286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 398 reason: error at write: Disconnected sessionId: src_id|7b5cbe3c-88fabae2-b3451988-7b42205d_0
2025-09-30T14:51:22.029341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894936599943982:4267]
2025-09-30T14:51:22.029371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:22.029462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 398 sessionId: src_id|7b5cbe3c-88fabae2-b3451988-7b42205d_0 is DEAD
2025-09-30T14:51:22.029632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b5cbe3c-88fabae2-b3451988-7b42205d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:22.029643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b5cbe3c-88fabae2-b3451988-7b42205d_0] Write session will restart in 0.006561s
2025-09-30T14:51:22.029665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b5cbe3c-88fabae2-b3451988-7b42205d_0] Write session: Do CDS request
2025-09-30T14:51:22.029672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b5cbe3c-88fabae2-b3451988-7b42205d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:22.037794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b5cbe3c-88fabae2-b3451988-7b42205d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:22.037899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:22.037915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 399
2025-09-30T14:51:22.038020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 399 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:22.038044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 399 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:22.038048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=399 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:22.038051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:22.038394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 399 sessionId:  describe result for acl check
2025-09-30T14:51:22.038442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:22.038447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:22.038449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:22.038455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894940894911338:4829] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:22.038913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894940894911338:4829] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:22.040930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894940894911338:4829] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:22.043753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894940894911338:4829] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:22.043769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894940894911338:4829] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:22.043772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894940894911338:4829] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:22.043780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 399 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:22.044100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:22.046101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:22.046298Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:22.046314Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:22.046325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:22.046381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:22.046422Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894940805185687:4154]
2025-09-30T14:51:22.047100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:22.047340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:22.047384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:22.047715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:22.047770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:22.047777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:22.047779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:22.047780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:22.047782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:22.047783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:22.047784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:22.047785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:22.047787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:22.047788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:22.047790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.047791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.047793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.047794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:22.047795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:22.047801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:22.047812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:22.047817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:22.047821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:22.047826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:22.047831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:22.047835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:22.047839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:22.047843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:22.047848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:22.047853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.047857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.047862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.047866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:22.047870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:22.047882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:22.047895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:22.047907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:22.047913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:22.047918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:22.047923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:22.047929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:22.047935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:22.047940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:22.047945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:22.047950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:22.047956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:22.047961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:22.047967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:22.047977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:22.047983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:22.047992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:22.048003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:22.048013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:22.048023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:22.048033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.048043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.048052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.048062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.048071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.048077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.048085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:22.048095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:22.048105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:22.048115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:22.048160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:22.053563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:22.054797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:22.054812Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:22.054814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:22.054817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:22.054822Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 398 [2:7555894940805185687:4154]
2025-09-30T14:51:22.054835Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:22.054848Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:22.054850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.054853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.054854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.054867Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:22.054875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:22.054880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:22.054926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.054931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.054933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.054936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:22.054938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:22.054985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:22.054993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.055003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.055009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.055019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:22.055032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894940805185682:4154]
2025-09-30T14:51:22.055034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894940805185682:4154]
2025-09-30T14:51:22.055036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894940805185682:4154]
2025-09-30T14:51:22.055041Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:22.055123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 398
2025-09-30T14:51:22.055053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:22.055142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 398
2025-09-30T14:51:22.055054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:22.055058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:22.055060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:22.055065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:22.055067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:22.055074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894940894911506:4829], now have 1 active actors on pipe
2025-09-30T14:51:22.055077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894940894911281:2454], now have 1 active actors on pipe
2025-09-30T14:51:22.055103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894940805185682:4154]
2025-09-30T14:51:22.055109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:22.055133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:22.055274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:22.055288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:22.055309Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da70f4f5-999af4c-f705f421-dcc05366_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:22.055318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.055321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.055322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:22.055329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.055338Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:22.055353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:22.055475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:22.055481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:22.055491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:22.055564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 399 partition: 0 MaxSeqNo: 42 sessionId: src_id|da70f4f5-999af4c-f705f421-dcc05366_0
2025-09-30T14:51:22.055961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b5cbe3c-88fabae2-b3451988-7b42205d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|da70f4f5-999af4c-f705f421-dcc05366_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:22.058926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da70f4f5-999af4c-f705f421-dcc05366_0] Write session: try to update token
2025-09-30T14:51:22.058947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da70f4f5-999af4c-f705f421-dcc05366_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:22.067504Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:22.067527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:22.067529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:22.067532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:22.067541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894940805185682:4154]
2025-09-30T14:51:22.067550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894940805185682:4154]
2025-09-30T14:51:22.067554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894940805185682:4154]
2025-09-30T14:51:22.067596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:22.067603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.067604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:22.067625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:22.067646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:22.067650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:22.067751Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:22.074756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 399 sessionId: src_id|da70f4f5-999af4c-f705f421-dcc05366_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:22.077516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:22.129601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894940894911518:4267]
2025-09-30T14:51:22.129888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 398, pipe: [1:7555894940894911518:4267]
2025-09-30T14:51:22.175524Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:22.175909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:22.175925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:22.175945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894940894911518:4267], now have 1 active actors on pipe
2025-09-30T14:51:22.176153Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:22.176171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:22.176184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:22.176197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:22.176245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 399 reason: error at write: Disconnected sessionId: src_id|da70f4f5-999af4c-f705f421-dcc05366_0
2025-09-30T14:51:22.176259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894940894911518:4267]
2025-09-30T14:51:22.176411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 399 sessionId: src_id|da70f4f5-999af4c-f705f421-dcc05366_0 is DEAD
2025-09-30T14:51:22.176546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da70f4f5-999af4c-f705f421-dcc05366_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:22.176556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da70f4f5-999af4c-f705f421-dcc05366_0] Write session will restart in 0.007549s
2025-09-30T14:51:22.176579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da70f4f5-999af4c-f705f421-dcc05366_0] Write session: Do CDS request
2025-09-30T14:51:22.176588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da70f4f5-999af4c-f705f421-dcc05366_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:22.185803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da70f4f5-999af4c-f705f421-dcc05366_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:22.185922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:22.185937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 400
2025-09-30T14:51:22.186036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 400 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:22.186059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 400 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:22.186067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=400 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:22.186071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:22.186441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 400 sessionId:  describe result for acl check
2025-09-30T14:51:22.186472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:22.186477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:22.186479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:22.186484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894940894911612:4833] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:22.186903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894940894911612:4833] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:22.188907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894940894911612:4833] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:22.190983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894940894911612:4833] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:22.190995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894940894911612:4833] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:22.190997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894940894911612:4833] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:22.191003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 400 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:22.191019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:22.193102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:22.193266Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:22.193277Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:22.193287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:22.193333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:22.193373Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894940805185915:4156]
2025-09-30T14:51:22.193823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:22.194089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:22.194129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:22.194415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:22.194609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:22.194616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:22.194617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:22.194619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:22.194620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:22.194621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:22.194622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:22.194624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:22.194625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:22.194626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:22.194627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.194628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.194629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.194631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:22.194632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:22.194637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:22.194648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:22.194652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:22.194657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:22.194661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:22.194665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:22.194669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:22.194673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:22.194677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:22.194681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:22.194685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.194689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.194693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.194702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:22.194706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:22.194718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:22.194726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:22.194736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:22.194747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:22.194756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:22.194765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:22.194774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:22.194779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:22.194787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:22.194793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:22.194802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:22.194812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:22.194821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:22.194830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:22.194839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:22.194844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:22.194849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:22.194854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:22.194864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:22.194873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:22.194882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.194891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.194900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.194905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.194910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.194919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.194928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:22.194933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:22.194944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:22.194953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:22.195001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:22.200250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:22.201294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:22.201311Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:22.201314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:22.201318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:22.201326Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 399 [2:7555894940805185915:4156]
2025-09-30T14:51:22.201342Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:22.201357Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:22.201361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.201363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.201366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.201381Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:22.201392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:22.201399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:22.201456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.201464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.201466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.201469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:22.201472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:22.201531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:22.201538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.201551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.201564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.201581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:22.201604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894940894911742:4833], now have 1 active actors on pipe
2025-09-30T14:51:22.201612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894940894911520:2454], now have 1 active actors on pipe
2025-09-30T14:51:22.201618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894940805185909:4156]
2025-09-30T14:51:22.201620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894940805185909:4156]
2025-09-30T14:51:22.201623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894940805185909:4156]
2025-09-30T14:51:22.201634Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:22.201653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:22.201654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:22.201657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:22.201660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:22.201674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:22.201677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:22.201704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894940805185909:4156]
2025-09-30T14:51:22.201682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 399
2025-09-30T14:51:22.201712Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:22.201691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 399
2025-09-30T14:51:22.201716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:22.201734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:22.201739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:22.201770Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38c0b746-876ed6d9-3b01978-ee68a545_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:22.201780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.201785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.201792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:22.201801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.201813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:22.201837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:22.201962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:22.201970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:22.201983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:22.202046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 400 partition: 0 MaxSeqNo: 42 sessionId: src_id|38c0b746-876ed6d9-3b01978-ee68a545_0
2025-09-30T14:51:22.202403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da70f4f5-999af4c-f705f421-dcc05366_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|38c0b746-876ed6d9-3b01978-ee68a545_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:22.205104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38c0b746-876ed6d9-3b01978-ee68a545_0] Write session: try to update token
2025-09-30T14:51:22.205122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38c0b746-876ed6d9-3b01978-ee68a545_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:22.213684Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:22.213703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:22.213705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:22.213707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:22.213716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894940805185909:4156]
2025-09-30T14:51:22.213721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894940805185909:4156]
2025-09-30T14:51:22.213725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894940805185909:4156]
2025-09-30T14:51:22.213765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:22.213773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.213779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:22.213782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:22.213786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:22.213790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:22.213922Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:22.219303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 400 sessionId: src_id|38c0b746-876ed6d9-3b01978-ee68a545_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:22.221970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:22.276543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894940894911755:4267]
2025-09-30T14:51:22.276761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 399, pipe: [1:7555894940894911755:4267]
2025-09-30T14:51:22.321488Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:22.321829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:22.321840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:22.321875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894940894911755:4267], now have 1 active actors on pipe
2025-09-30T14:51:22.322080Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:22.322099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:22.322115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:22.322141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894940894911755:4267]
2025-09-30T14:51:22.322162Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:22.322183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 400 reason: error at write: Disconnected sessionId: src_id|38c0b746-876ed6d9-3b01978-ee68a545_0
2025-09-30T14:51:22.322388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 400 sessionId: src_id|38c0b746-876ed6d9-3b01978-ee68a545_0 is DEAD
2025-09-30T14:51:22.322561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38c0b746-876ed6d9-3b01978-ee68a545_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:22.322573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38c0b746-876ed6d9-3b01978-ee68a545_0] Write session will restart in 0.008086s
2025-09-30T14:51:22.322602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38c0b746-876ed6d9-3b01978-ee68a545_0] Write session: Do CDS request
2025-09-30T14:51:22.322608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38c0b746-876ed6d9-3b01978-ee68a545_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:22.331781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38c0b746-876ed6d9-3b01978-ee68a545_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:22.331860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:22.331878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 401
2025-09-30T14:51:22.331988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 401 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:22.332018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 401 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:22.332028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=401 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:22.332032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:22.332389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 401 sessionId:  describe result for acl check
2025-09-30T14:51:22.332420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:22.332421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:22.332423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:22.332427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894940894911816:4837] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:22.332852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894940894911816:4837] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:22.334961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894940894911816:4837] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:22.337600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894940894911816:4837] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:22.337611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894940894911816:4837] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:22.337613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894940894911816:4837] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:22.337620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 401 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:22.338860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:22.341363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:22.341558Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:22.341567Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:22.341578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:22.341630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:22.341670Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894940805186144:4158]
2025-09-30T14:51:22.342338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:22.342670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:22.342712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:22.343029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:22.343204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:22.343211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:22.343212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:22.343213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:22.343215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:22.343216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:22.343217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:22.343218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:22.343220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:22.343221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:22.343223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.343224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.343225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.343227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:22.343228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:22.343234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:22.343257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:22.343260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:22.343264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:22.343268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:22.343271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:22.343274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:22.343278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:22.343283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:22.343287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:22.343291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.343295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.343298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.343301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:22.343304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:22.343313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:22.343321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:22.343326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:22.343333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:22.343337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:22.343343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:22.343347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:22.343352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:22.343356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:22.343363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:22.343366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:22.343371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:22.343376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:22.343381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:22.343385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:22.343391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:22.343401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:22.343405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:22.343409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:22.343417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:22.343422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.343427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.343436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.343441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.343450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.343455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.343459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:22.343468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:22.343473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:22.343482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:22.343525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:22.349109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:22.350231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:22.350243Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:22.350245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:22.350249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:22.350257Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 400 [2:7555894940805186144:4158]
2025-09-30T14:51:22.350275Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:22.350292Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:22.350302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.350305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.350307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.350323Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:22.350330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:22.350337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:22.350384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.350393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.350396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.350399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:22.350401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:22.350472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:22.350479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.350491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.350498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.350511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:22.350543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894940894911979:4837], now have 1 active actors on pipe
2025-09-30T14:51:22.350551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894940894911757:2454], now have 1 active actors on pipe
2025-09-30T14:51:22.350557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894940805186139:4158]
2025-09-30T14:51:22.350559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894940805186139:4158]
2025-09-30T14:51:22.350561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894940805186139:4158]
2025-09-30T14:51:22.350572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:22.350585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:22.350603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:22.350603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:22.350607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:22.350610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:22.350612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:22.350641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894940805186139:4158]
2025-09-30T14:51:22.350651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:22.350659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:22.350653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 400
2025-09-30T14:51:22.350660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 400
2025-09-30T14:51:22.350735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:22.350745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:22.350767Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33377114-d8d71e48-bdc49a3d-83e4b112_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:22.350779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.350782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.350784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:22.350793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.350807Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:22.350825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:22.350976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:22.350982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:22.350993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:22.351070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 401 partition: 0 MaxSeqNo: 42 sessionId: src_id|33377114-d8d71e48-bdc49a3d-83e4b112_0
2025-09-30T14:51:22.351472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38c0b746-876ed6d9-3b01978-ee68a545_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|33377114-d8d71e48-bdc49a3d-83e4b112_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:22.354411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33377114-d8d71e48-bdc49a3d-83e4b112_0] Write session: try to update token
2025-09-30T14:51:22.354429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33377114-d8d71e48-bdc49a3d-83e4b112_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:22.362299Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:22.362314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:22.362321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894940805186139:4158]
2025-09-30T14:51:22.362357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:22.362375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:22.362516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:22.362664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:22.362796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:22.362942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:22.363127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:22.363166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:22.368973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 401 sessionId: src_id|33377114-d8d71e48-bdc49a3d-83e4b112_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:22.371417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:22.371663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:22.371685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:22.371719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:22.371797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:22.372891Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:22.372906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:22.372909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:22.372914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:22.372923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894940805186139:4158]
2025-09-30T14:51:22.372928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894940805186139:4158]
2025-09-30T14:51:22.372931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894940805186139:4158]
2025-09-30T14:51:22.372967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:22.372978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.372980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:22.372985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:22.372987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:22.372991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:22.373115Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:22.422461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894940894911993:4267]
2025-09-30T14:51:22.422705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 400, pipe: [1:7555894940894911993:4267]
2025-09-30T14:51:22.493618Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:22.501929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:22.501960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:22.502141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:22.502215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:22.502288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:22.502354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:22.502830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:22.502850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:22.502929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:22.503005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:22.503071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:22.503162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:22.503207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:22.503215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:22.503306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:22.503379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:22.503449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:22.503521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:22.503566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:22.503574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:22.503645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:22.503714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:22.503782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:22.503857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:22.503904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:22.503913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:22.503984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:22.504051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:22.504119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:22.504188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:22.504324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:22.504332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:22.504406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:22.504471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:22.504541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:22.504611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:22.504658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:22.504666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:22.504755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:22.504822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:22.504891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:22.504965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:22.505014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:22.505021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:22.505087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:22.505151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:22.505215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:22.505280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:22.505328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:22.505336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:22.505406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:22.505472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:22.505544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:22.505613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:22.505660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:22.505669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:22.505735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:22.505797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:22.505865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:22.505929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:22.505976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:22.505984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:22.506048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894940894911993:4267], now have 1 active actors on pipe
2025-09-30T14:51:22.506277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:22.506283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:22.506291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:22.506708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33377114-d8d71e48-bdc49a3d-83e4b112_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:22.506719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33377114-d8d71e48-bdc49a3d-83e4b112_0] Write session will restart in 0.008507s
2025-09-30T14:51:22.506742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33377114-d8d71e48-bdc49a3d-83e4b112_0] Write session: Do CDS request
2025-09-30T14:51:22.506712Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:22.506749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33377114-d8d71e48-bdc49a3d-83e4b112_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:22.506808Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:51:22.506938Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:51:22.506944Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:51:22.506971Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.009261s
2025-09-30T14:51:22.506330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 401 reason: error at write: Disconnected sessionId: src_id|33377114-d8d71e48-bdc49a3d-83e4b112_0
2025-09-30T14:51:22.506339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894940894911993:4267]
2025-09-30T14:51:22.506351Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:51:22.506422Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 4 consumer shared/user session shared/user_1_4_387935675616407913_v1 is DEAD
2025-09-30T14:51:22.506519Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894876470383025:4262] disconnected; active server actors: 1
2025-09-30T14:51:22.506522Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894876470383025:4262] client user disconnected session shared/user_1_4_387935675616407913_v1
2025-09-30T14:51:22.506580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 401 sessionId: src_id|33377114-d8d71e48-bdc49a3d-83e4b112_0 is DEAD
2025-09-30T14:51:22.516740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33377114-d8d71e48-bdc49a3d-83e4b112_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:22.516792Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:22.516806Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 402
2025-09-30T14:51:22.516980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 402 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:22.517017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 402 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:22.517026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=402 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:22.517030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:22.517459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 402 sessionId:  describe result for acl check
2025-09-30T14:51:22.517492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:22.517498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:22.517499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:22.517505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894940894912086:4842] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:22.517575Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:51:22.517691Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:51:22.517698Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 5
2025-09-30T14:51:22.517794Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 5 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:51:22.517827Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:51:22.517891Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 auth for : user
2025-09-30T14:51:22.517939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894940894912086:4842] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:22.518017Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 Handle describe topics response
2025-09-30T14:51:22.518036Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 auth is DEAD
2025-09-30T14:51:22.518049Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:51:22.518241Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:51:22.518338Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_5_3410337129664790492_v1
2025-09-30T14:51:22.518490Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894940894912116:4844] connected; active server actors: 1
2025-09-30T14:51:22.518506Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555894940894912116:4844] session shared/user_1_5_3410337129664790492_v1
2025-09-30T14:51:22.518514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:51:22.518523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:51:22.518544Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_5_3410337129664790492_v1" (Sender=[1:7555894940894912091:4844], Pipe=[1:7555894940894912116:4844], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:51:22.518548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:51:22.518556Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:51:22.518565Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_5_3410337129664790492_v1" (Sender=[1:7555894940894912091:4844], Pipe=[1:7555894940894912116:4844], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:51:22.518573Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_5_3410337129664790492_v1" sender [1:7555894940894912091:4844] lock partition 0 for ReadingSession "shared/user_1_5_3410337129664790492_v1" (Sender=[1:7555894940894912091:4844], Pipe=[1:7555894940894912116:4844], Partitions=[], ActiveFamilyCount=1) generation 1 step 5
2025-09-30T14:51:22.518584Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:51:22.518592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000033s
2025-09-30T14:51:22.518836Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 5 Session: "shared/user_1_5_3410337129664790492_v1" ClientId: "user" PipeClient { RawX1: 7555894940894912116 RawX2: 4503603922342636 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:51:22.518863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:51:22.520721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894940894912086:4842] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:22.522573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:22.524980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:22.525195Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:22.525206Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:22.525217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:22.525274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:22.525317Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894940805186376:4161]
2025-09-30T14:51:22.525378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894940894912086:4842] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:22.525395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894940894912086:4842] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:22.525399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894940894912086:4842] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:22.525408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 402 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:22.525975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:22.526401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:22.526468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:22.526861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:22.526943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:22.526949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:22.526950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:22.526952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:22.526953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:22.526954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:22.526955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:22.526956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:22.526957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:22.526958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:22.526959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.526960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.526961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.526963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:22.526964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:22.526970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:22.526980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:22.526984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:22.526988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:22.526993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:22.526997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:22.527001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:22.527005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:22.527009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:22.527013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:22.527018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.527022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.527027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.527031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:22.527035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:22.527042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:22.527051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:22.527057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:22.527063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:22.527068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:22.527074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:22.527078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:22.527083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:22.527100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:22.527110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:22.527115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:22.527120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:22.527124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:22.527130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:22.527134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:22.527138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:22.527147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:22.527152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:22.527157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:22.527163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:22.527169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.527179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.527184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.527189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.527216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.527224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.527228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:22.527233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:22.527238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:22.527258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:22.527304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:22.533040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:22.533857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:22.533872Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:22.533875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:22.533879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:22.533884Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 401 [2:7555894940805186376:4161]
2025-09-30T14:51:22.533897Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:22.533910Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:22.533912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.533915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.533917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.533930Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:22.533935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:22.533940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:22.534147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.534154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.534156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.534159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:22.534161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:22.534210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:22.534216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.534226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.534232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.534242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:22.534255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894940805186371:4161]
2025-09-30T14:51:22.534259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894940805186371:4161]
2025-09-30T14:51:22.534261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894940805186371:4161]
2025-09-30T14:51:22.534269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:22.534280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:22.534282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894940894912139:4849], now have 1 active actors on pipe
2025-09-30T14:51:22.534287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:22.534288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:22.534289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:22.534295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:22.534297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:22.534300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894940894912230:4842], now have 1 active actors on pipe
2025-09-30T14:51:22.534302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894940894911998:2454], now have 1 active actors on pipe
2025-09-30T14:51:22.534326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894940805186371:4161]
2025-09-30T14:51:22.534335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:22.534365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 401
2025-09-30T14:51:22.534381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 401, pipe: [1:7555894940894912139:4849]
2025-09-30T14:51:22.534414Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 401
2025-09-30T14:51:22.534411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:22.534419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:22.534428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_5_3410337129664790492_v1 on pipe: [1:7555894940894912139:4849]
2025-09-30T14:51:22.534436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:22.534441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:22.534442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:22.534453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.534457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.534459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:22.534467Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_5_3410337129664790492_v1:1 with generation 401
2025-09-30T14:51:22.534470Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_5_3410337129664790492_v1
2025-09-30T14:51:22.534472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.534494Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3976a221-fe1568bb-92d52101-8b150035_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:22.534503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:22.534506Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:22.539465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:22.539495Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:22.539505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.539511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.539514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:22.539525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.539540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:22.539552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:51:22.539564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:51:22.539584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:22.539722Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759243882533 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:51:22.539745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:51:22.539784Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 sending to client partition status
2025-09-30T14:51:22.539793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:22.539805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:22.539824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:22.539915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 402 partition: 0 MaxSeqNo: 42 sessionId: src_id|3976a221-fe1568bb-92d52101-8b150035_0
2025-09-30T14:51:22.540225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33377114-d8d71e48-bdc49a3d-83e4b112_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3976a221-fe1568bb-92d52101-8b150035_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:22.542987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3976a221-fe1568bb-92d52101-8b150035_0] Write session: try to update token
2025-09-30T14:51:22.543003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3976a221-fe1568bb-92d52101-8b150035_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:22.545801Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:22.545822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:22.545830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894940805186371:4161]
2025-09-30T14:51:22.545871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:22.545862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:22.546046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:22.546186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:22.546325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:22.546471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:22.546675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:22.546717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:22.556793Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:22.556808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:22.556810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:22.556811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:22.556821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894940805186371:4161]
2025-09-30T14:51:22.556824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894940805186371:4161]
2025-09-30T14:51:22.556827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894940805186371:4161]
2025-09-30T14:51:22.556858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:22.556864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.556866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:22.556877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:22.556885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:22.556892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:22.557001Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:22.557828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 402 sessionId: src_id|3976a221-fe1568bb-92d52101-8b150035_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:22.560359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:22.661288Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:22.661700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:22.661713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:22.661890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_5_3410337129664790492_v1
2025-09-30T14:51:22.661912Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:22.661959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:22.661964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:22.661968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:22.662014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894940894912139:4849]
2025-09-30T14:51:22.662033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 402 reason: error at write: Disconnected sessionId: src_id|3976a221-fe1568bb-92d52101-8b150035_0
2025-09-30T14:51:22.662234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 402 sessionId: src_id|3976a221-fe1568bb-92d52101-8b150035_0 is DEAD
2025-09-30T14:51:22.662234Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_5_3410337129664790492_v1
2025-09-30T14:51:22.662394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3976a221-fe1568bb-92d52101-8b150035_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:22.662403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3976a221-fe1568bb-92d52101-8b150035_0] Write session will restart in 0.007173s
2025-09-30T14:51:22.662430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3976a221-fe1568bb-92d52101-8b150035_0] Write session: Do CDS request
2025-09-30T14:51:22.662435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3976a221-fe1568bb-92d52101-8b150035_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:22.670730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3976a221-fe1568bb-92d52101-8b150035_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:22.670865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:22.670881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 403
2025-09-30T14:51:22.670981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 403 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:22.671024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 403 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:22.671033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=403 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:22.671038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:22.671495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 403 sessionId:  describe result for acl check
2025-09-30T14:51:22.671528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:22.671534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:22.671536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:22.671542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894940894912308:4850] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:22.672093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894940894912308:4850] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:22.674499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894940894912308:4850] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:22.676992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894940894912308:4850] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:22.677005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894940894912308:4850] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:22.677008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894940894912308:4850] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:22.677016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 403 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:22.677262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:22.679638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:22.679822Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:22.679832Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:22.679841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:22.679893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:22.679930Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894940805186610:4163]
2025-09-30T14:51:22.680605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:22.680902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:22.680945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:22.681273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:22.681328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:22.681334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:22.681336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:22.681337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:22.681338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:22.681339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:22.681340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:22.681341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:22.681343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:22.681344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:22.681346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.681347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.681348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.681350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:22.681351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:22.681356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:22.681366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:22.681371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:22.681375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:22.681379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:22.681384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:22.681389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:22.681393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:22.681397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:22.681403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:22.681408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.681412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.681416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.681421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:22.681425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:22.681433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:22.681442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:22.681448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:22.681455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:22.681464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:22.681471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:22.681480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:22.681486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:22.681496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:22.681502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:22.681511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:22.681517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:22.681527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:22.681533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:22.681542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:22.681547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:22.681554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:22.681562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:22.681571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:22.681590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:22.681599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.681604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.681613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.681619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.681627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.681633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.681641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:22.681647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:22.681658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:22.681664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:22.681713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:22.687197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:22.688261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:22.688278Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:22.688280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:22.688284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:22.688291Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 402 [2:7555894940805186610:4163]
2025-09-30T14:51:22.688306Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:22.688320Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:22.688324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.688327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.688329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.688346Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:22.688351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:22.688359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:22.688416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.688425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.688428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.688432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:22.688435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:22.688496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:22.688503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.688516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.688534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.688558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:22.688581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894940894912470:4850], now have 1 active actors on pipe
2025-09-30T14:51:22.688589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894940894912244:2454], now have 1 active actors on pipe
2025-09-30T14:51:22.688596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894940805186605:4163]
2025-09-30T14:51:22.688598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894940805186605:4163]
2025-09-30T14:51:22.688601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894940805186605:4163]
2025-09-30T14:51:22.688612Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:22.688623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:22.688626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:22.688627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:22.688629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:22.688647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:22.688655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:22.688637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 402
2025-09-30T14:51:22.688647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 402
2025-09-30T14:51:22.688692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:22.688701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:22.688713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894940805186605:4163]
2025-09-30T14:51:22.688724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:22.688729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:22.688756Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5af39d86-278326d1-bb22af55-38ca4a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:22.688767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.688771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.688773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:22.688782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.688790Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:22.688943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:22.689081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:22.689089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:22.689103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:22.689187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 403 partition: 0 MaxSeqNo: 42 sessionId: src_id|5af39d86-278326d1-bb22af55-38ca4a_0
2025-09-30T14:51:22.689540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3976a221-fe1568bb-92d52101-8b150035_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5af39d86-278326d1-bb22af55-38ca4a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:22.692286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5af39d86-278326d1-bb22af55-38ca4a_0] Write session: try to update token
2025-09-30T14:51:22.692302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5af39d86-278326d1-bb22af55-38ca4a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:22.700504Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:22.700519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:22.700521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:22.700523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:22.700530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894940805186605:4163]
2025-09-30T14:51:22.700534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894940805186605:4163]
2025-09-30T14:51:22.700540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894940805186605:4163]
2025-09-30T14:51:22.700577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:22.700582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.700584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:22.700585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:22.700590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:22.700593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:22.700728Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:22.706414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 403 sessionId: src_id|5af39d86-278326d1-bb22af55-38ca4a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:22.709026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:22.762434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894940894912482:4849]
2025-09-30T14:51:22.762732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 402, pipe: [1:7555894940894912482:4849]
2025-09-30T14:51:22.802451Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:22.802775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:22.802787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:22.802815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894940894912482:4849], now have 1 active actors on pipe
2025-09-30T14:51:22.802994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:22.803033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894940894912482:4849]
2025-09-30T14:51:22.803036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:22.803039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:22.803089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 403 reason: error at write: Disconnected sessionId: src_id|5af39d86-278326d1-bb22af55-38ca4a_0
2025-09-30T14:51:22.803106Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:22.803315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 403 sessionId: src_id|5af39d86-278326d1-bb22af55-38ca4a_0 is DEAD
2025-09-30T14:51:22.803433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5af39d86-278326d1-bb22af55-38ca4a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:22.803439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5af39d86-278326d1-bb22af55-38ca4a_0] Write session will restart in 0.005115s
2025-09-30T14:51:22.803455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5af39d86-278326d1-bb22af55-38ca4a_0] Write session: Do CDS request
2025-09-30T14:51:22.803462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5af39d86-278326d1-bb22af55-38ca4a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:22.809761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5af39d86-278326d1-bb22af55-38ca4a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:22.809879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:22.809892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 404
2025-09-30T14:51:22.809983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 404 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:22.810012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 404 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:22.810022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=404 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:22.810025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:22.810419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 404 sessionId:  describe result for acl check
2025-09-30T14:51:22.810449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:22.810451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:22.810452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:22.810458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894940894912522:4854] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:22.810912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894940894912522:4854] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:22.813891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894940894912522:4854] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:22.816488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894940894912522:4854] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:22.816500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894940894912522:4854] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:22.816503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894940894912522:4854] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:22.816511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 404 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:22.818161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:22.820290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:22.820628Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:22.820639Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:22.820651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:22.820708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:22.820749Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894940805186867:4168]
2025-09-30T14:51:22.821264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:22.821519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:22.821554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:22.821849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:22.821905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:22.821911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:22.821912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:22.821913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:22.821914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:22.821915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:22.821916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:22.821918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:22.821919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:22.821920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:22.821922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.821923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.821924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.821925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:22.821926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:22.821932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:22.821942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:22.821946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:22.821950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:22.821954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:22.821959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:22.821962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:22.821966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:22.821970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:22.821975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:22.821979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.821982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.821986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.821989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:22.821992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:22.822002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:22.822009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:22.822014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:22.822019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:22.822023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:22.822029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:22.822034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:22.822039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:22.822044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:22.822050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:22.822055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:22.822061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:22.822065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:22.822071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:22.822076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:22.822081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:22.822087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:22.822092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:22.822102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:22.822108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:22.822113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.822119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.822127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.822133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.822138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.822146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.822151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:22.822157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:22.822166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:22.822172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:22.822209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:22.827759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:22.828773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:22.828790Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:22.828792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:22.828796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:22.828802Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 403 [2:7555894940805186867:4168]
2025-09-30T14:51:22.828816Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:22.828831Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:22.828835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.828838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.828840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.828856Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:22.828862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:22.828875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:22.828938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.828946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.828948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.828951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:22.828954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:22.829016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:22.829024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.829037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.829055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.829075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:22.829096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894940805186862:4168]
2025-09-30T14:51:22.829103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894940805186862:4168]
2025-09-30T14:51:22.829105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894940805186862:4168]
2025-09-30T14:51:22.829122Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:22.829134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:22.829140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894940894912484:2454], now have 1 active actors on pipe
2025-09-30T14:51:22.829144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:22.829146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:22.829147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894940894912721:4854], now have 1 active actors on pipe
2025-09-30T14:51:22.829153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:22.829167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:22.829173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:22.829203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894940805186862:4168]
2025-09-30T14:51:22.829220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:22.829220Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:22.829202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 403
2025-09-30T14:51:22.829251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 403
2025-09-30T14:51:22.829344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:22.829356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:22.829379Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|225d73db-750d696a-17e16b60-784c68e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:22.829392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.829400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.829401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:22.829412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.829427Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:22.829443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:22.829601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:22.829611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:22.829625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:22.829726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 404 partition: 0 MaxSeqNo: 42 sessionId: src_id|225d73db-750d696a-17e16b60-784c68e3_0
2025-09-30T14:51:22.830088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5af39d86-278326d1-bb22af55-38ca4a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|225d73db-750d696a-17e16b60-784c68e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:22.833043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|225d73db-750d696a-17e16b60-784c68e3_0] Write session: try to update token
2025-09-30T14:51:22.833059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|225d73db-750d696a-17e16b60-784c68e3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:22.840806Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:22.840828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:22.840837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894940805186862:4168]
2025-09-30T14:51:22.840880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:22.840883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:22.841111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:22.841254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:22.841398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:22.841536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:22.841728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:22.841767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:22.847957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 404 sessionId: src_id|225d73db-750d696a-17e16b60-784c68e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:22.850615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:22.851572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:22.851597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:22.851616Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:22.851620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:22.851628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:22.851630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:22.851638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894940805186862:4168]
2025-09-30T14:51:22.851641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894940805186862:4168]
2025-09-30T14:51:22.851645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894940805186862:4168]
2025-09-30T14:51:22.851676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:22.851686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:22.851689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:22.851692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:22.851698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.851705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:22.851835Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:22.903225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894940894912757:4849]
2025-09-30T14:51:22.903533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 403, pipe: [1:7555894940894912757:4849]
2025-09-30T14:51:22.959006Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:22.959270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:22.959307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894940894912757:4849], now have 1 active actors on pipe
2025-09-30T14:51:22.959451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:22.959490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:22.959535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894940894912757:4849]
2025-09-30T14:51:22.959545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:22.959548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:22.959611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 404 reason: error at write: Disconnected sessionId: src_id|225d73db-750d696a-17e16b60-784c68e3_0
2025-09-30T14:51:22.959761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 404 sessionId: src_id|225d73db-750d696a-17e16b60-784c68e3_0 is DEAD
2025-09-30T14:51:22.959896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|225d73db-750d696a-17e16b60-784c68e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:22.959905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|225d73db-750d696a-17e16b60-784c68e3_0] Write session will restart in 0.008444s
2025-09-30T14:51:22.959921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|225d73db-750d696a-17e16b60-784c68e3_0] Write session: Do CDS request
2025-09-30T14:51:22.959925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|225d73db-750d696a-17e16b60-784c68e3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:22.969710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|225d73db-750d696a-17e16b60-784c68e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:22.969799Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:22.969812Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 405
2025-09-30T14:51:22.969925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 405 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:22.969954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 405 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:22.969963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=405 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:22.969967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:22.970435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 405 sessionId:  describe result for acl check
2025-09-30T14:51:22.970466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:22.970472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:22.970474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:22.970479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894940894912878:4868] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:22.971016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894940894912878:4868] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:22.973034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894940894912878:4868] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:22.973700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:22.975933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:22.976240Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:22.976251Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:22.976262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:22.976318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:22.976351Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894940805187122:4180]
2025-09-30T14:51:22.976516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894940894912878:4868] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:22.976529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894940894912878:4868] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:22.976533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894940894912878:4868] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:22.976540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 405 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:22.976883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:22.977172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:22.977209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:22.977520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:22.977573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:22.977579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:22.977580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:22.977581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:22.977582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:22.977583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:22.977585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:22.977585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:22.977587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:22.977588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:22.977589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.977590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.977591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.977592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:22.977593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:22.977598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:22.977609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:22.977614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:22.977618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:22.977622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:22.977626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:22.977630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:22.977634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:22.977638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:22.977643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:22.977648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.977656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.977660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.977668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:22.977673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:22.977683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:22.977690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:22.977701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:22.977710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:22.977719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:22.977726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:22.977735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:22.977741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:22.977750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:22.977759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:22.977768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:22.977773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:22.977782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:22.977791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:22.977799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:22.977803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:22.977812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:22.977818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:22.977826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:22.977831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:22.977839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.977844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.977852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.977858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.977866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.977872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.977880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:22.977886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:22.977894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:22.977903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:22.977951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:22.983129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:22.984176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:22.984191Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:22.984194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:22.984197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:22.984204Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 404 [2:7555894940805187122:4180]
2025-09-30T14:51:22.984218Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:22.984232Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:22.984235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.984238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.984240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.984255Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:22.984265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:22.984276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:22.984334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.984341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.984343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.984347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:22.984349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:22.984410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:22.984418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.984430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:22.984446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:22.984468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:22.984489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894940894912995:4868], now have 1 active actors on pipe
2025-09-30T14:51:22.984496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894940894912761:2454], now have 1 active actors on pipe
2025-09-30T14:51:22.984502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894940805187117:4180]
2025-09-30T14:51:22.984513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894940805187117:4180]
2025-09-30T14:51:22.984515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894940805187117:4180]
2025-09-30T14:51:22.984527Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:22.984538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:22.984549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 404
2025-09-30T14:51:22.984552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:22.984580Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 404
2025-09-30T14:51:22.984552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:22.984555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:22.984557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:22.984563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:22.984587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894940805187117:4180]
2025-09-30T14:51:22.984590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:22.984594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:22.984606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:22.984610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:22.984656Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3fb3de7b-bf5e2ec1-addb2d0d-bae0f12c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:22.984670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.984678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.984680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:22.984689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.984701Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:22.984721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:22.984864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:22.984873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:22.984887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:22.984959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 405 partition: 0 MaxSeqNo: 42 sessionId: src_id|3fb3de7b-bf5e2ec1-addb2d0d-bae0f12c_0
2025-09-30T14:51:22.985306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|225d73db-750d696a-17e16b60-784c68e3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3fb3de7b-bf5e2ec1-addb2d0d-bae0f12c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:22.988187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fb3de7b-bf5e2ec1-addb2d0d-bae0f12c_0] Write session: try to update token
2025-09-30T14:51:22.988203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fb3de7b-bf5e2ec1-addb2d0d-bae0f12c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:22.996446Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:22.996460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:22.996462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:22.996464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:22.996472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894940805187117:4180]
2025-09-30T14:51:22.996474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894940805187117:4180]
2025-09-30T14:51:22.996478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894940805187117:4180]
2025-09-30T14:51:22.996510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:22.996515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:22.996517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:22.996526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:22.996536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:22.996541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:22.996651Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:23.002371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 405 sessionId: src_id|3fb3de7b-bf5e2ec1-addb2d0d-bae0f12c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:23.004978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:23.059895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894945189880308:4849]
2025-09-30T14:51:23.060139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 404, pipe: [1:7555894945189880308:4849]
2025-09-30T14:51:23.102441Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:23.102895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:23.102910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:23.102950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894945189880308:4849], now have 1 active actors on pipe
2025-09-30T14:51:23.103174Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:23.103173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894945189880308:4849]
2025-09-30T14:51:23.103205Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:23.103205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:23.103210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:23.103290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 405 reason: error at write: Disconnected sessionId: src_id|3fb3de7b-bf5e2ec1-addb2d0d-bae0f12c_0
2025-09-30T14:51:23.103502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 405 sessionId: src_id|3fb3de7b-bf5e2ec1-addb2d0d-bae0f12c_0 is DEAD
2025-09-30T14:51:23.103638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fb3de7b-bf5e2ec1-addb2d0d-bae0f12c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:23.103648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fb3de7b-bf5e2ec1-addb2d0d-bae0f12c_0] Write session will restart in 0.005087s
2025-09-30T14:51:23.103671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fb3de7b-bf5e2ec1-addb2d0d-bae0f12c_0] Write session: Do CDS request
2025-09-30T14:51:23.103681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fb3de7b-bf5e2ec1-addb2d0d-bae0f12c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:23.109863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fb3de7b-bf5e2ec1-addb2d0d-bae0f12c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:23.109994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:23.110009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 406
2025-09-30T14:51:23.110139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 406 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:23.110172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 406 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:23.110182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=406 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:23.110191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:23.110637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 406 sessionId:  describe result for acl check
2025-09-30T14:51:23.110668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:23.110675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:23.110677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:23.110681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894945189880339:4874] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:23.111139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894945189880339:4874] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:23.114157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894945189880339:4874] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:23.117037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894945189880339:4874] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:23.117052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894945189880339:4874] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:23.117055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894945189880339:4874] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:23.117064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 406 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:23.118796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:23.121028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:23.121374Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:23.121389Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:23.121403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:23.121471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:23.121513Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894945100154655:4183]
2025-09-30T14:51:23.122098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:23.122416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:23.122459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:23.122803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:23.122859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:23.122860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:23.122861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:23.122862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:23.122864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:23.122865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:23.122866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:23.122867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:23.122869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:23.122870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:23.122871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.122872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.122873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.122874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:23.122876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:23.122881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:23.122892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:23.122896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:23.122900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:23.122904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:23.122909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:23.122913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:23.122917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:23.122921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:23.122925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:23.122930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.122933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.122937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.122941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:23.122945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:23.122953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:23.122961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:23.122967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:23.122973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:23.122977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:23.122983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:23.122987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:23.122993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:23.122999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:23.123009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:23.123014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:23.123024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:23.123029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:23.123034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:23.123043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:23.123049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:23.123054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:23.123061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:23.123066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:23.123073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:23.123078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.123083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.123088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.123091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.123094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.123097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.123099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:23.123102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:23.123106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:23.123109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:23.123132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:23.128493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:23.129705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:23.129724Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:23.129726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:23.129730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:23.129738Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 405 [2:7555894945100154655:4183]
2025-09-30T14:51:23.129755Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:23.129771Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:23.129781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:23.129784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:23.129787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:23.129803Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:23.129817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:23.129824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:23.129900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.129907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.129909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.129913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:23.129916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:23.130006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:23.130014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.130028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.130041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.130061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:23.130085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894945189880536:4874], now have 1 active actors on pipe
2025-09-30T14:51:23.130093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894945189880309:2454], now have 1 active actors on pipe
2025-09-30T14:51:23.130100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894945100154650:4183]
2025-09-30T14:51:23.130103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894945100154650:4183]
2025-09-30T14:51:23.130105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894945100154650:4183]
2025-09-30T14:51:23.130119Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:23.130136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:23.130139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:23.130146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:23.130149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:23.130155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:23.130172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:23.130221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894945100154650:4183]
2025-09-30T14:51:23.130235Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:23.130207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 405
2025-09-30T14:51:23.130247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:23.130212Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 405
2025-09-30T14:51:23.130279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:23.130290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:23.130323Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1865bec3-9e360ec5-8d38e3ed-48f9113_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:23.130337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:23.130346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:23.130348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:23.130361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:23.130377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:23.130396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:23.130607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:23.130617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:23.130635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:23.130757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 406 partition: 0 MaxSeqNo: 42 sessionId: src_id|1865bec3-9e360ec5-8d38e3ed-48f9113_0
2025-09-30T14:51:23.131143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fb3de7b-bf5e2ec1-addb2d0d-bae0f12c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1865bec3-9e360ec5-8d38e3ed-48f9113_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:23.133932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1865bec3-9e360ec5-8d38e3ed-48f9113_0] Write session: try to update token
2025-09-30T14:51:23.133948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1865bec3-9e360ec5-8d38e3ed-48f9113_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:23.142441Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:23.142463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:23.142466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:23.142467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:23.142477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894945100154650:4183]
2025-09-30T14:51:23.142480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894945100154650:4183]
2025-09-30T14:51:23.142484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894945100154650:4183]
2025-09-30T14:51:23.142539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:23.142547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.142548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:23.142551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:23.142554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:23.142558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:23.142699Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:23.148066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 406 sessionId: src_id|1865bec3-9e360ec5-8d38e3ed-48f9113_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:23.150970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:23.203287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894945189880552:4849]
2025-09-30T14:51:23.203642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 405, pipe: [1:7555894945189880552:4849]
2025-09-30T14:51:23.248828Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:23.249233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:23.249258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:23.249297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894945189880552:4849], now have 1 active actors on pipe
2025-09-30T14:51:23.249479Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:23.249554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:23.249566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894945189880552:4849]
2025-09-30T14:51:23.249570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:23.249596Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:23.249629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 406 reason: error at write: Disconnected sessionId: src_id|1865bec3-9e360ec5-8d38e3ed-48f9113_0
2025-09-30T14:51:23.249838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 406 sessionId: src_id|1865bec3-9e360ec5-8d38e3ed-48f9113_0 is DEAD
2025-09-30T14:51:23.249989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1865bec3-9e360ec5-8d38e3ed-48f9113_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:23.250000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1865bec3-9e360ec5-8d38e3ed-48f9113_0] Write session will restart in 0.009169s
2025-09-30T14:51:23.250017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1865bec3-9e360ec5-8d38e3ed-48f9113_0] Write session: Do CDS request
2025-09-30T14:51:23.250021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1865bec3-9e360ec5-8d38e3ed-48f9113_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:23.260863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1865bec3-9e360ec5-8d38e3ed-48f9113_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:23.260902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:23.260918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 407
2025-09-30T14:51:23.261075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 407 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:23.261119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 407 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:23.261128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=407 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:23.261132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:23.261741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 407 sessionId:  describe result for acl check
2025-09-30T14:51:23.261787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:23.261793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:23.261795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:23.261801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894945189880665:4878] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:23.262304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894945189880665:4878] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:23.264783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894945189880665:4878] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:23.266166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:23.268430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:23.268775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894945189880665:4878] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:23.268790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894945189880665:4878] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:23.268793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894945189880665:4878] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:23.268802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 407 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:23.268862Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:23.268880Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:23.268894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:23.268959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:23.268999Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894945100154889:4185]
2025-09-30T14:51:23.269536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:23.269857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:23.269913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:23.270243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:23.270301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:23.270307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:23.270308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:23.270309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:23.270311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:23.270312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:23.270313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:23.270314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:23.270316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:23.270317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:23.270318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.270319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.270321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.270322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:23.270323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:23.270329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:23.270340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:23.270344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:23.270349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:23.270353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:23.270358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:23.270362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:23.270366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:23.270370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:23.270374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:23.270378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.270382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.270387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.270391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:23.270395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:23.270402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:23.270410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:23.270416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:23.270422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:23.270426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:23.270432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:23.270438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:23.270446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:23.270451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:23.270456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:23.270460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:23.270473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:23.270480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:23.270486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:23.270490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:23.270495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:23.270500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:23.270505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:23.270509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:23.270515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:23.270519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.270535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.270539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.270544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.270556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.270562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.270567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:23.270571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:23.270580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:23.270586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:23.270641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:23.276098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:23.277065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:23.277085Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:23.277088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:23.277092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:23.277099Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 406 [2:7555894945100154889:4185]
2025-09-30T14:51:23.277118Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:23.277136Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:23.277139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:23.277142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:23.277145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:23.277163Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:23.277171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:23.277181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:23.277260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.277270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.277272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.277276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:23.277279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:23.277351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:23.277359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.277372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.277384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.277406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:23.277431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894945189880784:4878], now have 1 active actors on pipe
2025-09-30T14:51:23.277440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894945189880553:2454], now have 1 active actors on pipe
2025-09-30T14:51:23.277448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894945100154884:4185]
2025-09-30T14:51:23.277455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894945100154884:4185]
2025-09-30T14:51:23.277457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894945100154884:4185]
2025-09-30T14:51:23.277469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:23.277479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:23.277481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:23.277483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:23.277494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:23.277518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:23.277529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:23.277554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 406
2025-09-30T14:51:23.277567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894945100154884:4185]
2025-09-30T14:51:23.277580Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 406
2025-09-30T14:51:23.277584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:23.277586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:23.277817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:23.277833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:23.277880Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9c4e581-71f8c9db-3ffded56-35af35e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:23.277893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:23.277898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:23.277903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:23.277913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:23.277924Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:23.277945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:23.278137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:23.278145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:23.278159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:23.278273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 407 partition: 0 MaxSeqNo: 42 sessionId: src_id|e9c4e581-71f8c9db-3ffded56-35af35e7_0
2025-09-30T14:51:23.278661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1865bec3-9e360ec5-8d38e3ed-48f9113_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e9c4e581-71f8c9db-3ffded56-35af35e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:23.281360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9c4e581-71f8c9db-3ffded56-35af35e7_0] Write session: try to update token
2025-09-30T14:51:23.281378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9c4e581-71f8c9db-3ffded56-35af35e7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:23.289870Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:23.289890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:23.289892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:23.289894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:23.289904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894945100154884:4185]
2025-09-30T14:51:23.289909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894945100154884:4185]
2025-09-30T14:51:23.289913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894945100154884:4185]
2025-09-30T14:51:23.289953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:23.289961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.289964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:23.289979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:23.289992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:23.289997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:23.290103Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:23.296478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 407 sessionId: src_id|e9c4e581-71f8c9db-3ffded56-35af35e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:23.299030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:23.349693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894945189880796:4849]
2025-09-30T14:51:23.349963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 406, pipe: [1:7555894945189880796:4849]
2025-09-30T14:51:23.397373Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:23.397738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:23.397749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:23.397767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894945189880796:4849], now have 1 active actors on pipe
2025-09-30T14:51:23.397935Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:23.398000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:23.398004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894945189880796:4849]
2025-09-30T14:51:23.398016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:23.398023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:23.398077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 407 reason: error at write: Disconnected sessionId: src_id|e9c4e581-71f8c9db-3ffded56-35af35e7_0
2025-09-30T14:51:23.398284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 407 sessionId: src_id|e9c4e581-71f8c9db-3ffded56-35af35e7_0 is DEAD
2025-09-30T14:51:23.398432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9c4e581-71f8c9db-3ffded56-35af35e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:23.398441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9c4e581-71f8c9db-3ffded56-35af35e7_0] Write session will restart in 0.008856s
2025-09-30T14:51:23.398456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9c4e581-71f8c9db-3ffded56-35af35e7_0] Write session: Do CDS request
2025-09-30T14:51:23.398464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9c4e581-71f8c9db-3ffded56-35af35e7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:23.408820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9c4e581-71f8c9db-3ffded56-35af35e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:23.408980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:23.408997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 408
2025-09-30T14:51:23.409088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 408 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:23.409119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 408 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:23.409128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=408 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:23.409132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:23.409630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 408 sessionId:  describe result for acl check
2025-09-30T14:51:23.409670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:23.409672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:23.409674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:23.409681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894945189880893:4882] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:23.410244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894945189880893:4882] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:23.412790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894945189880893:4882] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:23.414738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:23.417113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:23.417380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894945189880893:4882] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:23.417393Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:23.417404Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:23.417417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:23.417394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894945189880893:4882] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:23.417398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894945189880893:4882] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:23.417405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 408 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:23.417473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:23.417512Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894945100155124:4187]
2025-09-30T14:51:23.418139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:23.418422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:23.418473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:23.418816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:23.418897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:23.418904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:23.418905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:23.418906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:23.418907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:23.418909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:23.418910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:23.418911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:23.418913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:23.418914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:23.418915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.418916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.418917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.418918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:23.418920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:23.418926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:23.418935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:23.418939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:23.418944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:23.418948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:23.418952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:23.418955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:23.418959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:23.418963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:23.418967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:23.418971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.418976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.418979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.418983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:23.418987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:23.418997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:23.419005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:23.419014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:23.419020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:23.419024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:23.419029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:23.419033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:23.419038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:23.419049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:23.419054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:23.419058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:23.419063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:23.419068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:23.419075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:23.419080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:23.419085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:23.419095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:23.419100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:23.419105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:23.419110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:23.419117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.419122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.419126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.419132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.419137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.419142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.419147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:23.419154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:23.419158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:23.419164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:23.419210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:23.424725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:23.425708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:23.425723Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:23.425726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:23.425730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:23.425736Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 407 [2:7555894945100155124:4187]
2025-09-30T14:51:23.425750Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:23.425764Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:23.425770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:23.425773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:23.425775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:23.425791Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:23.425798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:23.425805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:23.425856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.425863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.425865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.425868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:23.425870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:23.425921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:23.425926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.425934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.425940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.425951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:23.425965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894945189880797:2454], now have 1 active actors on pipe
2025-09-30T14:51:23.425974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894945100155119:4187]
2025-09-30T14:51:23.425975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894945100155119:4187]
2025-09-30T14:51:23.425976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894945100155119:4187]
2025-09-30T14:51:23.425982Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:23.425992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:23.425992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:23.426005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:23.426007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:23.426011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:23.426013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894945189881029:4882], now have 1 active actors on pipe
2025-09-30T14:51:23.426013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:23.426041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894945100155119:4187]
2025-09-30T14:51:23.426046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:23.426054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:23.426040Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 407
2025-09-30T14:51:23.426063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 407
2025-09-30T14:51:23.426088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:23.426094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:23.426114Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd62f860-ee7d3ae3-b60764dd-dda36952_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:23.426127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:23.426130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:23.426132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:23.426141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:23.426148Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:23.426160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:23.426315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:23.426325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:23.426338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:23.426448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 408 partition: 0 MaxSeqNo: 42 sessionId: src_id|dd62f860-ee7d3ae3-b60764dd-dda36952_0
2025-09-30T14:51:23.426826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9c4e581-71f8c9db-3ffded56-35af35e7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dd62f860-ee7d3ae3-b60764dd-dda36952_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:23.429511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd62f860-ee7d3ae3-b60764dd-dda36952_0] Write session: try to update token
2025-09-30T14:51:23.429528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd62f860-ee7d3ae3-b60764dd-dda36952_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:23.443089Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:23.443108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:23.443118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894945100155119:4187]
2025-09-30T14:51:23.443167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:23.443169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:23.443206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 408 sessionId: src_id|dd62f860-ee7d3ae3-b60764dd-dda36952_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:23.443388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:23.443536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:23.443681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:23.443826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:23.444025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:23.444067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:23.445928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:23.446147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:23.446167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:23.446201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:23.446306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:23.447856Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:23.447869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:23.447872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:23.447874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:23.447882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894945100155119:4187]
2025-09-30T14:51:23.447886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894945100155119:4187]
2025-09-30T14:51:23.447894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894945100155119:4187]
2025-09-30T14:51:23.447927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:23.447936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:23.447938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.447941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:23.447943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:23.447947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:23.448078Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:23.498160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894945189881043:4849]
2025-09-30T14:51:23.498399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 407, pipe: [1:7555894945189881043:4849]
2025-09-30T14:51:23.556031Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:23.563392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:23.563414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:23.563588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:23.563648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:23.563708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:23.563767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:23.563827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:23.563834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:23.563899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:23.563958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:23.564028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:23.564090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:23.564183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:23.564189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:23.564251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:23.564307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:23.564375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:23.564484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:23.564526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:23.564531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:23.564595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:23.564655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:23.564713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:23.564773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:23.564816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:23.564822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:23.564886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:23.564948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:23.565008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:23.565076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:23.565123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:23.565129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:23.565190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:23.565252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:23.565307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:23.565366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:23.565409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:23.565423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:23.565500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:23.565562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:23.565631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:23.565705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:23.565750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:23.565757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:23.565824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:23.565890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:23.565957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:23.566026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:23.566068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:23.566075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:23.566142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:23.566207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:23.566271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:23.566334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:23.566379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:23.566387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:23.566453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:23.566518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:23.566601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:23.566668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:23.566713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:23.566721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:23.566784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894945189881043:4849], now have 1 active actors on pipe
2025-09-30T14:51:23.567236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:23.567240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894945189881043:4849]
2025-09-30T14:51:23.567262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:23.567281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:23.567290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 408 reason: error at write: Disconnected sessionId: src_id|dd62f860-ee7d3ae3-b60764dd-dda36952_0
2025-09-30T14:51:23.567497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 408 sessionId: src_id|dd62f860-ee7d3ae3-b60764dd-dda36952_0 is DEAD
2025-09-30T14:51:23.567609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd62f860-ee7d3ae3-b60764dd-dda36952_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:23.567618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd62f860-ee7d3ae3-b60764dd-dda36952_0] Write session will restart in 0.005522s
2025-09-30T14:51:23.567642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd62f860-ee7d3ae3-b60764dd-dda36952_0] Write session: Do CDS request
2025-09-30T14:51:23.567648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd62f860-ee7d3ae3-b60764dd-dda36952_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:23.567705Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:23.574767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd62f860-ee7d3ae3-b60764dd-dda36952_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:23.574919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:23.574935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 409
2025-09-30T14:51:23.575107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 409 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:23.575149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 409 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:23.575154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=409 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:23.575158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:23.575590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 409 sessionId:  describe result for acl check
2025-09-30T14:51:23.575631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:23.575637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:23.575640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:23.575645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894945189881061:4887] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:23.576244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894945189881061:4887] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:23.579363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894945189881061:4887] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:23.582460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894945189881061:4887] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:23.582474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894945189881061:4887] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:23.582477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894945189881061:4887] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:23.582484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 409 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:23.584823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:23.587050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:23.587228Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:23.587239Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:23.587264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:23.587318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:23.587359Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894945100155364:4190]
2025-09-30T14:51:23.587980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:23.588272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:23.588317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:23.588637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:23.588703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:23.588709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:23.588711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:23.588712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:23.588713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:23.588714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:23.588715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:23.588716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:23.588717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:23.588718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:23.588719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.588720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.588721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.588722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:23.588723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:23.588729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:23.588738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:23.588741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:23.588744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:23.588748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:23.588752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:23.588755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:23.588759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:23.588762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:23.588767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:23.588771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.588774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.588778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.588781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:23.588785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:23.588792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:23.588800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:23.588806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:23.588810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:23.588815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:23.588819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:23.588824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:23.588828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:23.588834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:23.588839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:23.588844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:23.588850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:23.588854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:23.588860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:23.588864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:23.588869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:23.588880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:23.588885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:23.588896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:23.588901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:23.588911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.588916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.588925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.588930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.588935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.588943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.588947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:23.588953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:23.588962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:23.588967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:23.589001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:23.594246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:23.595385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:23.595397Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:23.595400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:23.595404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:23.595409Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 408 [2:7555894945100155364:4190]
2025-09-30T14:51:23.595422Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:23.595436Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:23.595440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:23.595442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:23.595444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:23.595457Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:23.595465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:23.595471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:23.595528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.595537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.595538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.595542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:23.595544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:23.595598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:23.595604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.595612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.595619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.595633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:23.595649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894945100155359:4190]
2025-09-30T14:51:23.595654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894945100155359:4190]
2025-09-30T14:51:23.595655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894945100155359:4190]
2025-09-30T14:51:23.595665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:23.595679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894945189881044:2454], now have 1 active actors on pipe
2025-09-30T14:51:23.595681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:23.595684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:23.595686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:23.595687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894945189881256:4887], now have 1 active actors on pipe
2025-09-30T14:51:23.595694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:23.595702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:23.595704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:23.595729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894945100155359:4190]
2025-09-30T14:51:23.595732Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:23.595704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 408
2025-09-30T14:51:23.595709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 408
2025-09-30T14:51:23.595762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:23.595763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:23.595770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:23.595794Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1abbe92-3684dcbc-71e1d55-95fd0770_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:23.595802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:23.595805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:23.595807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:23.595814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:23.595824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:23.595837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:23.595959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:23.595964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:23.595974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:23.596063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 409 partition: 0 MaxSeqNo: 42 sessionId: src_id|d1abbe92-3684dcbc-71e1d55-95fd0770_0
2025-09-30T14:51:23.596426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd62f860-ee7d3ae3-b60764dd-dda36952_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d1abbe92-3684dcbc-71e1d55-95fd0770_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:23.599274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1abbe92-3684dcbc-71e1d55-95fd0770_0] Write session: try to update token
2025-09-30T14:51:23.599293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1abbe92-3684dcbc-71e1d55-95fd0770_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:23.607261Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:23.607277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:23.607279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:23.607281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:23.607291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894945100155359:4190]
2025-09-30T14:51:23.607296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894945100155359:4190]
2025-09-30T14:51:23.607300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894945100155359:4190]
2025-09-30T14:51:23.607339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:23.607346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.607348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:23.607365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:23.607377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:23.607380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:23.607492Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:23.613659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 409 sessionId: src_id|d1abbe92-3684dcbc-71e1d55-95fd0770_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:23.616580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:23.667667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894945189881289:4849]
2025-09-30T14:51:23.667949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 408, pipe: [1:7555894945189881289:4849]
2025-09-30T14:51:23.716382Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:23.716810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:23.716828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:23.716850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894945189881289:4849], now have 1 active actors on pipe
2025-09-30T14:51:23.717106Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:23.717129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894945189881289:4849]
2025-09-30T14:51:23.717151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:23.717154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:23.717224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 409 reason: error at write: Disconnected sessionId: src_id|d1abbe92-3684dcbc-71e1d55-95fd0770_0
2025-09-30T14:51:23.717423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 409 sessionId: src_id|d1abbe92-3684dcbc-71e1d55-95fd0770_0 is DEAD
2025-09-30T14:51:23.717556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1abbe92-3684dcbc-71e1d55-95fd0770_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:23.717567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1abbe92-3684dcbc-71e1d55-95fd0770_0] Write session will restart in 0.007450s
2025-09-30T14:51:23.717547Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:23.717591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1abbe92-3684dcbc-71e1d55-95fd0770_0] Write session: Do CDS request
2025-09-30T14:51:23.717612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1abbe92-3684dcbc-71e1d55-95fd0770_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:23.726833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1abbe92-3684dcbc-71e1d55-95fd0770_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:23.726934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:23.726957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 410
2025-09-30T14:51:23.727130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 410 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:23.727173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 410 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:23.727182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=410 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:23.727187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:23.727659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 410 sessionId:  describe result for acl check
2025-09-30T14:51:23.727702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:23.727710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:23.727714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:23.727720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894945189881346:4891] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:23.728297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894945189881346:4891] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:23.731218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894945189881346:4891] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:23.733785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894945189881346:4891] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:23.733800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894945189881346:4891] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:23.733803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894945189881346:4891] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:23.733811Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 410 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:23.734744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:23.737290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:23.737489Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:23.737498Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:23.737506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:23.737548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:23.737586Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894945100155602:4192]
2025-09-30T14:51:23.738096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:23.738399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:23.738453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:23.738765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:23.738846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:23.738852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:23.738853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:23.738854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:23.738855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:23.738856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:23.738858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:23.738859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:23.738860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:23.738861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:23.738863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.738864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.738865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.738866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:23.738867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:23.738873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:23.738883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:23.738888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:23.738892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:23.738896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:23.738901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:23.738917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:23.738926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:23.738930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:23.738935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:23.738939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.738943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.738947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.738950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:23.738954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:23.738962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:23.738969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:23.738975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:23.738981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:23.738996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:23.739001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:23.739005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:23.739012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:23.739020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:23.739023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:23.739026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:23.739029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:23.739032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:23.739035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:23.739037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:23.739040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:23.739046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:23.739051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:23.739055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:23.739060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:23.739065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.739070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.739079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.739084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.739088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.739097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.739102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:23.739107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:23.739116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:23.739121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:23.739174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:23.744572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:23.745522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:23.745535Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:23.745538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:23.745541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:23.745549Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 409 [2:7555894945100155602:4192]
2025-09-30T14:51:23.745564Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:23.745583Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:23.745591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:23.745595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:23.745597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:23.745616Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:23.745630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:23.745637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:23.745695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.745702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.745704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.745708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:23.745710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:23.745774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:23.745782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.745795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.745811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.745835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:23.745854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894945189881290:2454], now have 1 active actors on pipe
2025-09-30T14:51:23.745865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894945100155597:4192]
2025-09-30T14:51:23.745868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894945100155597:4192]
2025-09-30T14:51:23.745871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894945100155597:4192]
2025-09-30T14:51:23.745883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:23.745965Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 409
2025-09-30T14:51:23.745967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 409
2025-09-30T14:51:23.745897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894945189881522:4891], now have 1 active actors on pipe
2025-09-30T14:51:23.745901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:23.745905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:23.745907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:23.745909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:23.745928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:23.745931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:23.745960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894945100155597:4192]
2025-09-30T14:51:23.745968Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:23.745997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:23.746047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:23.746057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:23.746079Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2723ab3e-2c556949-8b004056-e620cc24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:23.746090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:23.746093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:23.746095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:23.746104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:23.746112Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:23.746127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:23.746270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:23.746284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:23.746307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:23.746393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 410 partition: 0 MaxSeqNo: 42 sessionId: src_id|2723ab3e-2c556949-8b004056-e620cc24_0
2025-09-30T14:51:23.746810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1abbe92-3684dcbc-71e1d55-95fd0770_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2723ab3e-2c556949-8b004056-e620cc24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:23.749706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2723ab3e-2c556949-8b004056-e620cc24_0] Write session: try to update token
2025-09-30T14:51:23.749722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2723ab3e-2c556949-8b004056-e620cc24_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:23.758143Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:23.758180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:23.758192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894945100155597:4192]
2025-09-30T14:51:23.758243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:23.758250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:23.758481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:23.758676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:23.758857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:23.759022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:23.759283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:23.759337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:23.765878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 410 sessionId: src_id|2723ab3e-2c556949-8b004056-e620cc24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:23.768477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:23.768850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:23.768872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:23.768888Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:23.768890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:23.768892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:23.768894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:23.768903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894945100155597:4192]
2025-09-30T14:51:23.768907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894945100155597:4192]
2025-09-30T14:51:23.768911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894945100155597:4192]
2025-09-30T14:51:23.768940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:23.768956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:23.768959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:23.768962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.768963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:23.768963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:23.769089Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:23.817138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894945189881536:4849]
2025-09-30T14:51:23.817387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 409, pipe: [1:7555894945189881536:4849]
2025-09-30T14:51:23.875663Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:23.875917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:23.875957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894945189881536:4849], now have 1 active actors on pipe
2025-09-30T14:51:23.876072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:23.876168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:23.876175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:23.876239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 410 reason: error at write: Disconnected sessionId: src_id|2723ab3e-2c556949-8b004056-e620cc24_0
2025-09-30T14:51:23.876422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 410 sessionId: src_id|2723ab3e-2c556949-8b004056-e620cc24_0 is DEAD
2025-09-30T14:51:23.876556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2723ab3e-2c556949-8b004056-e620cc24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:23.876565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2723ab3e-2c556949-8b004056-e620cc24_0] Write session will restart in 0.009145s
2025-09-30T14:51:23.876589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2723ab3e-2c556949-8b004056-e620cc24_0] Write session: Do CDS request
2025-09-30T14:51:23.876599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2723ab3e-2c556949-8b004056-e620cc24_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:23.876589Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:23.876628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894945189881536:4849]
2025-09-30T14:51:23.886814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2723ab3e-2c556949-8b004056-e620cc24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:23.886936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:23.886952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 411
2025-09-30T14:51:23.887059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 411 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:23.887089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 411 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:23.887098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=411 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:23.887102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:23.887507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 411 sessionId:  describe result for acl check
2025-09-30T14:51:23.887541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:23.887542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:23.887544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:23.887549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894945189881641:4902] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:23.888050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894945189881641:4902] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:23.890852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894945189881641:4902] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:23.893250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:23.893377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894945189881641:4902] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:23.893390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894945189881641:4902] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:23.893395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894945189881641:4902] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:23.893402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 411 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:23.895842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:23.896149Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:23.896157Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:23.896166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:23.896216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:23.896248Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894945100155888:4201]
2025-09-30T14:51:23.896732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:23.897066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:23.897104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:23.897370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:23.897430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:23.897438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:23.897440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:23.897441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:23.897442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:23.897443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:23.897444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:23.897445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:23.897446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:23.897448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:23.897449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.897450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.897451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.897452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:23.897453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:23.897459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:23.897469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:23.897473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:23.897477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:23.897481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:23.897485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:23.897489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:23.897492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:23.897496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:23.897500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:23.897503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.897507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.897511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.897514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:23.897518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:23.897524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:23.897531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:23.897537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:23.897543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:23.897547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:23.897553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:23.897557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:23.897562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:23.897569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:23.897574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:23.897580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:23.897591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:23.897595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:23.897601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:23.897605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:23.897611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:23.897616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:23.897621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:23.897625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:23.897629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:23.897633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.897638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.897642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.897646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.897649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.897654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.897657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:23.897662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:23.897665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:23.897670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:23.897707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:23.902855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:23.903726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:23.903742Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:23.903744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:23.903748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:23.903756Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 410 [2:7555894945100155888:4201]
2025-09-30T14:51:23.903772Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:23.903788Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:23.903791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:23.903794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:23.903796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:23.903810Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:23.903822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:23.903830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:23.903887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.903894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.903897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.903900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:23.903903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:23.903968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:23.903978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.903990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:23.904003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:23.904021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:23.904044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894945189881562:2454], now have 1 active actors on pipe
2025-09-30T14:51:23.904053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894945189881803:4902], now have 1 active actors on pipe
2025-09-30T14:51:23.904058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894945100155882:4201]
2025-09-30T14:51:23.904061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894945100155882:4201]
2025-09-30T14:51:23.904064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894945100155882:4201]
2025-09-30T14:51:23.904078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:23.904092Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 410
2025-09-30T14:51:23.904097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 410
2025-09-30T14:51:23.904094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:23.904096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:23.904103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:23.904105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:23.904110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:23.904114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:23.904144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894945100155882:4201]
2025-09-30T14:51:23.904151Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:23.904159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:23.904169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:23.904178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:23.904228Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2947cc4-dfed1289-1b103a4b-661cfe9d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:23.904240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:23.904244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:23.904246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:23.904257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:23.904272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:23.904287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:23.904467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:23.904474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:23.904487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:23.904597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 411 partition: 0 MaxSeqNo: 42 sessionId: src_id|f2947cc4-dfed1289-1b103a4b-661cfe9d_0
2025-09-30T14:51:23.904997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2723ab3e-2c556949-8b004056-e620cc24_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f2947cc4-dfed1289-1b103a4b-661cfe9d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:23.907868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2947cc4-dfed1289-1b103a4b-661cfe9d_0] Write session: try to update token
2025-09-30T14:51:23.907888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2947cc4-dfed1289-1b103a4b-661cfe9d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:23.915884Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:23.915906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:23.915909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:23.915911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:23.915920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894945100155882:4201]
2025-09-30T14:51:23.915925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894945100155882:4201]
2025-09-30T14:51:23.915929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894945100155882:4201]
2025-09-30T14:51:23.915968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:23.915971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:23.915975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:23.915978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:23.915983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:23.915987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:23.916106Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:23.921608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 411 sessionId: src_id|f2947cc4-dfed1289-1b103a4b-661cfe9d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:23.924322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:23.976889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894945189881824:4849]
2025-09-30T14:51:23.977217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 410, pipe: [1:7555894945189881824:4849]
2025-09-30T14:51:24.024397Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:24.024741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:24.024753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:24.024787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894945189881824:4849], now have 1 active actors on pipe
2025-09-30T14:51:24.024941Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:24.024969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:24.024995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:24.024999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:24.025025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894945189881824:4849]
2025-09-30T14:51:24.025054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 411 reason: error at write: Disconnected sessionId: src_id|f2947cc4-dfed1289-1b103a4b-661cfe9d_0
2025-09-30T14:51:24.025237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 411 sessionId: src_id|f2947cc4-dfed1289-1b103a4b-661cfe9d_0 is DEAD
2025-09-30T14:51:24.025419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2947cc4-dfed1289-1b103a4b-661cfe9d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:24.025429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2947cc4-dfed1289-1b103a4b-661cfe9d_0] Write session will restart in 0.008806s
2025-09-30T14:51:24.025455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2947cc4-dfed1289-1b103a4b-661cfe9d_0] Write session: Do CDS request
2025-09-30T14:51:24.025461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2947cc4-dfed1289-1b103a4b-661cfe9d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:24.035736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2947cc4-dfed1289-1b103a4b-661cfe9d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:24.035832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:24.035848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 412
2025-09-30T14:51:24.035976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 412 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:24.036008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 412 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:24.036019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=412 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:24.036027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:24.036503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 412 sessionId:  describe result for acl check
2025-09-30T14:51:24.036535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:24.036541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:24.036544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:24.036550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894949484849217:4909] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:24.037089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894949484849217:4909] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:24.039541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894949484849217:4909] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:24.041412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:24.043735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:24.043907Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:24.043916Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:24.043927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:24.043970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:24.043963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894949484849217:4909] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:24.043974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894949484849217:4909] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:24.043977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894949484849217:4909] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:24.043983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 412 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:24.044007Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894949395123424:4210]
2025-09-30T14:51:24.044644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:24.044883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:24.044923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:24.045236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:24.045294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:24.045299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:24.045301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:24.045302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:24.045303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:24.045304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:24.045305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:24.045306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:24.045308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:24.045309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:24.045310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.045312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.045313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.045314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:24.045315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:24.045320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:24.045330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:24.045334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:24.045339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:24.045343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:24.045347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:24.045351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:24.045355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:24.045359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:24.045368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:24.045372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.045376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.045384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.045388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:24.045396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:24.045403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:24.045411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:24.045422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:24.045431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:24.045440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:24.045445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:24.045454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:24.045459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:24.045468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:24.045473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:24.045478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:24.045483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:24.045487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:24.045493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:24.045497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:24.045507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:24.045516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:24.045525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:24.045534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:24.045540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:24.045549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.045558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.045567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.045571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.045575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.045580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.045584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:24.045589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:24.045594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:24.045599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:24.045641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:24.050715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:24.051571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:24.051585Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:24.051588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:24.051592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:24.051598Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 411 [2:7555894949395123424:4210]
2025-09-30T14:51:24.051613Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:24.051632Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:24.051639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.051642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.051645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.051658Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:24.051669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:24.051676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:24.051736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.051741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.051743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.051747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:24.051749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:24.051812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:24.051822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.051833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.051846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.051864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:24.051885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894949484849359:4909], now have 1 active actors on pipe
2025-09-30T14:51:24.051889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894949484849121:2454], now have 1 active actors on pipe
2025-09-30T14:51:24.051895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894949395123419:4210]
2025-09-30T14:51:24.051902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894949395123419:4210]
2025-09-30T14:51:24.051905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894949395123419:4210]
2025-09-30T14:51:24.051917Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:24.051934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:24.051935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:24.051945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:24.051947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:24.051950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:24.051953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:24.051974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894949395123419:4210]
2025-09-30T14:51:24.051982Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:24.051989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:24.051952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 411
2025-09-30T14:51:24.051952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 411
2025-09-30T14:51:24.052015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:24.052024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:24.052056Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f60d1d23-936ef06f-41e26f20-fbb0b0a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:24.052066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.052069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.052072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:24.052081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.052101Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:24.052116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:24.052288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:24.052299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:24.052315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:24.052407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 412 partition: 0 MaxSeqNo: 42 sessionId: src_id|f60d1d23-936ef06f-41e26f20-fbb0b0a9_0
2025-09-30T14:51:24.052756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2947cc4-dfed1289-1b103a4b-661cfe9d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f60d1d23-936ef06f-41e26f20-fbb0b0a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:24.055416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f60d1d23-936ef06f-41e26f20-fbb0b0a9_0] Write session: try to update token
2025-09-30T14:51:24.055432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f60d1d23-936ef06f-41e26f20-fbb0b0a9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:24.063341Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:24.063355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:24.063357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:24.063358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:24.063366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894949395123419:4210]
2025-09-30T14:51:24.063369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894949395123419:4210]
2025-09-30T14:51:24.063372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894949395123419:4210]
2025-09-30T14:51:24.063402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:24.063408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.063409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:24.063417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:24.063423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:24.063427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:24.063535Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:24.069086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 412 sessionId: src_id|f60d1d23-936ef06f-41e26f20-fbb0b0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:24.071806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:24.125352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894949484849371:4849]
2025-09-30T14:51:24.125669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 411, pipe: [1:7555894949484849371:4849]
2025-09-30T14:51:24.167730Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:24.168259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:24.168271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:24.168302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894949484849371:4849], now have 1 active actors on pipe
2025-09-30T14:51:24.168465Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:24.168536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:24.168542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894949484849371:4849]
2025-09-30T14:51:24.168564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:24.168639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 412 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f60d1d23-936ef06f-41e26f20-fbb0b0a9_0
2025-09-30T14:51:24.168811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 412 sessionId: src_id|f60d1d23-936ef06f-41e26f20-fbb0b0a9_0 is DEAD
2025-09-30T14:51:24.168964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f60d1d23-936ef06f-41e26f20-fbb0b0a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:24.168970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f60d1d23-936ef06f-41e26f20-fbb0b0a9_0] Write session will restart in 0.006178s
2025-09-30T14:51:24.168993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f60d1d23-936ef06f-41e26f20-fbb0b0a9_0] Write session: Do CDS request
2025-09-30T14:51:24.168999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f60d1d23-936ef06f-41e26f20-fbb0b0a9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:24.176724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f60d1d23-936ef06f-41e26f20-fbb0b0a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:24.176830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:24.176843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 413
2025-09-30T14:51:24.176962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 413 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:24.176987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 413 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:24.176995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=413 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:24.176998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:24.177349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 413 sessionId:  describe result for acl check
2025-09-30T14:51:24.177374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:24.177381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:24.177382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:24.177386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894949484849427:4913] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:24.177787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894949484849427:4913] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:24.180255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894949484849427:4913] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:24.182807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894949484849427:4913] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:24.182818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894949484849427:4913] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:24.182821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894949484849427:4913] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:24.182826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 413 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:24.183449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:24.185548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:24.185708Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:24.185715Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:24.185734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:24.185782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:24.185813Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894949395123665:4212]
2025-09-30T14:51:24.186237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:24.186495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:24.186565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:24.186914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:24.186973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:24.186979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:24.186980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:24.186981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:24.186983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:24.186984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:24.186985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:24.186987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:24.186988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:24.186989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:24.186991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.186992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.186993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.186995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:24.186996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:24.187001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:24.187012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:24.187016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:24.187020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:24.187024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:24.187028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:24.187040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:24.187044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:24.187048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:24.187052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:24.187056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.187060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.187064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.187068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:24.187072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:24.187079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:24.187088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:24.187099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:24.187109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:24.187118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:24.187127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:24.187135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:24.187141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:24.187150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:24.187155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:24.187159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:24.187169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:24.187173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:24.187183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:24.187191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:24.187196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:24.187201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:24.187211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:24.187216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:24.187219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:24.187222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.187225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.187228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.187230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.187233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.187235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.187238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:24.187240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:24.187262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:24.187267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:24.187296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:24.192637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:24.193641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:24.193652Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:24.193654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:24.193657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:24.193663Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 412 [2:7555894949395123665:4212]
2025-09-30T14:51:24.193675Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:24.193688Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:24.193693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.193695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.193697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.193709Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:24.193714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:24.193720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:24.193766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.193771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.193773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.193776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:24.193778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:24.193833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:24.193842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.193853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.193864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.193879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:24.193901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894949484849373:2454], now have 1 active actors on pipe
2025-09-30T14:51:24.193910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894949484849608:4913], now have 1 active actors on pipe
2025-09-30T14:51:24.193916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894949395123660:4212]
2025-09-30T14:51:24.193923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894949395123660:4212]
2025-09-30T14:51:24.193925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894949395123660:4212]
2025-09-30T14:51:24.193939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:24.193949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:24.193955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:24.193957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:24.193959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:24.193964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:24.193967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:24.193971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 412
2025-09-30T14:51:24.193978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 412
2025-09-30T14:51:24.193993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894949395123660:4212]
2025-09-30T14:51:24.194000Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:24.194021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:24.194113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:24.194122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:24.194145Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|605eb830-ea251fce-27da94e1-e90cb56e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:24.194158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.194161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.194163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:24.194172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.194181Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:24.194193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:24.194337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:24.194351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:24.194371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:24.194454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 413 partition: 0 MaxSeqNo: 42 sessionId: src_id|605eb830-ea251fce-27da94e1-e90cb56e_0
2025-09-30T14:51:24.194820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f60d1d23-936ef06f-41e26f20-fbb0b0a9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|605eb830-ea251fce-27da94e1-e90cb56e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:24.197528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|605eb830-ea251fce-27da94e1-e90cb56e_0] Write session: try to update token
2025-09-30T14:51:24.197552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|605eb830-ea251fce-27da94e1-e90cb56e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:24.205903Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:24.205921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:24.205924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:24.205926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:24.205935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894949395123660:4212]
2025-09-30T14:51:24.205939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894949395123660:4212]
2025-09-30T14:51:24.205944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894949395123660:4212]
2025-09-30T14:51:24.205981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:24.205988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.205991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:24.205995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:24.206001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:24.206005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:24.206126Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:24.212469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 413 sessionId: src_id|605eb830-ea251fce-27da94e1-e90cb56e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:24.215145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:24.268750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894949484849621:4849]
2025-09-30T14:51:24.268973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 412, pipe: [1:7555894949484849621:4849]
2025-09-30T14:51:24.311684Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:24.311930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:24.311942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:24.311959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894949484849621:4849], now have 1 active actors on pipe
2025-09-30T14:51:24.312219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:24.312233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:24.312242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894949484849621:4849]
2025-09-30T14:51:24.312266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:24.312293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 413 reason: error at write: Disconnected sessionId: src_id|605eb830-ea251fce-27da94e1-e90cb56e_0
2025-09-30T14:51:24.312289Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:24.312478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 413 sessionId: src_id|605eb830-ea251fce-27da94e1-e90cb56e_0 is DEAD
2025-09-30T14:51:24.312724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|605eb830-ea251fce-27da94e1-e90cb56e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:24.312739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|605eb830-ea251fce-27da94e1-e90cb56e_0] Write session will restart in 0.006173s
2025-09-30T14:51:24.312771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|605eb830-ea251fce-27da94e1-e90cb56e_0] Write session: Do CDS request
2025-09-30T14:51:24.312783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|605eb830-ea251fce-27da94e1-e90cb56e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:24.319841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|605eb830-ea251fce-27da94e1-e90cb56e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:24.319965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:24.319977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 414
2025-09-30T14:51:24.320115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 414 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:24.320140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 414 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:24.320146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=414 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:24.320158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:24.320610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 414 sessionId:  describe result for acl check
2025-09-30T14:51:24.320645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:24.320651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:24.320653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:24.320658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894949484849667:4917] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:24.321162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894949484849667:4917] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:24.323586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894949484849667:4917] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:24.326166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894949484849667:4917] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:24.326177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894949484849667:4917] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:24.326179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894949484849667:4917] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:24.326191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 414 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:24.326595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:24.328742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:24.328932Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:24.328942Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:24.328952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:24.328997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:24.329035Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894949395123906:4214]
2025-09-30T14:51:24.329706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:24.329935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:24.329971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:24.330297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:24.330353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:24.330359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:24.330360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:24.330361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:24.330363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:24.330364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:24.330365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:24.330366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:24.330368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:24.330369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:24.330370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.330372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.330373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.330374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:24.330375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:24.330380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:24.330390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:24.330395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:24.330399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:24.330403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:24.330407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:24.330411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:24.330415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:24.330419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:24.330424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:24.330428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.330432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.330436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.330439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:24.330443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:24.330449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:24.330457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:24.330463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:24.330468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:24.330473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:24.330478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:24.330483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:24.330488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:24.330497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:24.330503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:24.330507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:24.330527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:24.330534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:24.330544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:24.330549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:24.330558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:24.330563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:24.330573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:24.330578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:24.330583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:24.330589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.330598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.330602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.330609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.330617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.330622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.330627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:24.330636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:24.330641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:24.330646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:24.330689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:24.335880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:24.336929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:24.336940Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:24.336942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:24.336944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:24.336949Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 413 [2:7555894949395123906:4214]
2025-09-30T14:51:24.336959Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:24.336970Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:24.336972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.336974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.336975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.336984Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:24.336989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:24.336994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:24.337035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.337038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.337040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.337042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:24.337044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:24.337092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:24.337099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.337106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.337113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.337129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:24.337150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894949484849623:2454], now have 1 active actors on pipe
2025-09-30T14:51:24.337156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894949484849859:4917], now have 1 active actors on pipe
2025-09-30T14:51:24.337161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894949395123901:4214]
2025-09-30T14:51:24.337162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894949395123901:4214]
2025-09-30T14:51:24.337164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894949395123901:4214]
2025-09-30T14:51:24.337174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:24.337184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:24.337185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:24.337188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:24.337189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:24.337198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:24.337200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:24.337218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894949395123901:4214]
2025-09-30T14:51:24.337221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:24.337222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:24.337202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 413
2025-09-30T14:51:24.337239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 413
2025-09-30T14:51:24.337411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:24.337419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:24.337436Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|131a32f8-8ffd5aa8-6817537f-e537670f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:24.337445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.337451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.337453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:24.337459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.337466Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:24.337481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:24.337638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:24.337649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:24.337666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:24.337738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 414 partition: 0 MaxSeqNo: 42 sessionId: src_id|131a32f8-8ffd5aa8-6817537f-e537670f_0
2025-09-30T14:51:24.338109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|605eb830-ea251fce-27da94e1-e90cb56e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|131a32f8-8ffd5aa8-6817537f-e537670f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:24.340846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|131a32f8-8ffd5aa8-6817537f-e537670f_0] Write session: try to update token
2025-09-30T14:51:24.340866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|131a32f8-8ffd5aa8-6817537f-e537670f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:24.349367Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:24.349385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:24.349388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:24.349390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:24.349399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894949395123901:4214]
2025-09-30T14:51:24.349403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894949395123901:4214]
2025-09-30T14:51:24.349408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894949395123901:4214]
2025-09-30T14:51:24.349444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:24.349450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:24.349454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:24.349457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:24.349457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.349461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:24.349641Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:24.354855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 414 sessionId: src_id|131a32f8-8ffd5aa8-6817537f-e537670f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:24.357496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:24.412629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894949484849872:4849]
2025-09-30T14:51:24.412902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 413, pipe: [1:7555894949484849872:4849]
2025-09-30T14:51:24.460898Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:24.461255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:24.461271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:24.461307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894949484849872:4849], now have 1 active actors on pipe
2025-09-30T14:51:24.461504Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:24.461548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894949484849872:4849]
2025-09-30T14:51:24.461554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:24.461558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:24.461579Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:24.461639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 414 reason: error at write: Disconnected sessionId: src_id|131a32f8-8ffd5aa8-6817537f-e537670f_0
2025-09-30T14:51:24.461839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 414 sessionId: src_id|131a32f8-8ffd5aa8-6817537f-e537670f_0 is DEAD
2025-09-30T14:51:24.461999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|131a32f8-8ffd5aa8-6817537f-e537670f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:24.462009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|131a32f8-8ffd5aa8-6817537f-e537670f_0] Write session will restart in 0.005771s
2025-09-30T14:51:24.462042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|131a32f8-8ffd5aa8-6817537f-e537670f_0] Write session: Do CDS request
2025-09-30T14:51:24.462049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|131a32f8-8ffd5aa8-6817537f-e537670f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:24.468830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|131a32f8-8ffd5aa8-6817537f-e537670f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:24.468911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:24.468928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 415
2025-09-30T14:51:24.469080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 415 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:24.469129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 415 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:24.469139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=415 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:24.469143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:24.469592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 415 sessionId:  describe result for acl check
2025-09-30T14:51:24.469629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:24.469636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:24.469638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:24.469646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894949484849908:4922] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:24.470216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894949484849908:4922] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:24.472750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894949484849908:4922] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:24.476098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894949484849908:4922] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:24.476113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894949484849908:4922] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:24.476117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894949484849908:4922] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:24.476125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 415 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:24.478083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:24.480892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:24.481110Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:24.481122Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:24.481132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:24.481186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:24.481226Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894949395124150:4216]
2025-09-30T14:51:24.481841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:24.482192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:24.482251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:24.482712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:24.482775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:24.482781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:24.482782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:24.482783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:24.482785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:24.482786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:24.482787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:24.482788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:24.482789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:24.482791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:24.482792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.482793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.482794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.482796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:24.482797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:24.482802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:24.482812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:24.482817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:24.482820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:24.482827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:24.482832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:24.482836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:24.482840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:24.482844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:24.482848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:24.482853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.482857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.482861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.482865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:24.482869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:24.482876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:24.482881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:24.482885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:24.482888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:24.482891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:24.482894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:24.482896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:24.482899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:24.482901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:24.482904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:24.482906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:24.482910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:24.482912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:24.482915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:24.482917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:24.482920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:24.482924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:24.482928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:24.482932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:24.482937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:24.482941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.482947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.482951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.482956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.482961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.482966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.482970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:24.482976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:24.482982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:24.482993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:24.483035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:24.488767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:24.489659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:24.489676Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:24.489680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:24.489684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:24.489691Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 414 [2:7555894949395124150:4216]
2025-09-30T14:51:24.489710Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:24.489728Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:24.489736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.489740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.489742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.489758Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:24.489771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:24.489784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:24.489846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.489855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.489858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.489862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:24.489865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:24.489937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:24.489945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.489959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.489977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.490000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:24.490023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894949484849875:2454], now have 1 active actors on pipe
2025-09-30T14:51:24.490033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894949484850112:4922], now have 1 active actors on pipe
2025-09-30T14:51:24.490039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894949395124145:4216]
2025-09-30T14:51:24.490044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894949395124145:4216]
2025-09-30T14:51:24.490046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894949395124145:4216]
2025-09-30T14:51:24.490060Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:24.490074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:24.490091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:24.490099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:24.490100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:24.490102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:24.490102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:24.490135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894949395124145:4216]
2025-09-30T14:51:24.490100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 414
2025-09-30T14:51:24.490145Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:24.490100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 414
2025-09-30T14:51:24.490156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:24.490374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:24.490387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:24.490427Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f16c4857-6aae8df0-9a151c08-3092e6bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:24.490439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.490442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.490445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:24.490454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.490464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:24.490487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:24.490671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:24.490682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:24.490697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:24.490837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 415 partition: 0 MaxSeqNo: 42 sessionId: src_id|f16c4857-6aae8df0-9a151c08-3092e6bb_0
2025-09-30T14:51:24.491212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|131a32f8-8ffd5aa8-6817537f-e537670f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f16c4857-6aae8df0-9a151c08-3092e6bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:24.493938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f16c4857-6aae8df0-9a151c08-3092e6bb_0] Write session: try to update token
2025-09-30T14:51:24.493958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f16c4857-6aae8df0-9a151c08-3092e6bb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:24.502009Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:24.502032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:24.502035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:24.502037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:24.502046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894949395124145:4216]
2025-09-30T14:51:24.502051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894949395124145:4216]
2025-09-30T14:51:24.502055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894949395124145:4216]
2025-09-30T14:51:24.502094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:24.502101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.502103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:24.502103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:24.502108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:24.502116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:24.502241Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:24.508165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 415 sessionId: src_id|f16c4857-6aae8df0-9a151c08-3092e6bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:24.510933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:24.561590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894949484850126:4849]
2025-09-30T14:51:24.561858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 414, pipe: [1:7555894949484850126:4849]
2025-09-30T14:51:24.605423Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:24.605787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:24.605799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:24.605832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894949484850126:4849], now have 1 active actors on pipe
2025-09-30T14:51:24.606060Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:24.606068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:24.606094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:24.606099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:24.606129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894949484850126:4849]
2025-09-30T14:51:24.606161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 415 reason: error at write: Disconnected sessionId: src_id|f16c4857-6aae8df0-9a151c08-3092e6bb_0
2025-09-30T14:51:24.606396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 415 sessionId: src_id|f16c4857-6aae8df0-9a151c08-3092e6bb_0 is DEAD
2025-09-30T14:51:24.606562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f16c4857-6aae8df0-9a151c08-3092e6bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:24.606569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f16c4857-6aae8df0-9a151c08-3092e6bb_0] Write session will restart in 0.006086s
2025-09-30T14:51:24.606593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f16c4857-6aae8df0-9a151c08-3092e6bb_0] Write session: Do CDS request
2025-09-30T14:51:24.606598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f16c4857-6aae8df0-9a151c08-3092e6bb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:24.613799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f16c4857-6aae8df0-9a151c08-3092e6bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:24.613917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:24.613933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 416
2025-09-30T14:51:24.614060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 416 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:24.614112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 416 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:24.614121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=416 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:24.614126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:24.614585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 416 sessionId:  describe result for acl check
2025-09-30T14:51:24.614625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:24.614629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:24.614631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:24.614636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894949484850144:4926] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:24.615184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894949484850144:4926] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:24.621350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894949484850144:4926] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:24.624027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:24.626611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:24.626840Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:24.626853Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:24.626866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:24.626948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:24.626987Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894949395124392:4219]
2025-09-30T14:51:24.627678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:24.627928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894949484850144:4926] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:24.627950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894949484850144:4926] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:24.627954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894949484850144:4926] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:24.627962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 416 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:24.627977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:24.628036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:24.628378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:24.628429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:24.628434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:24.628435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:24.628436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:24.628436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:24.628437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:24.628438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:24.628438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:24.628439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:24.628440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:24.628440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.628441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.628442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.628442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:24.628443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:24.628447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:24.628454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:24.628456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:24.628459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:24.628462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:24.628464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:24.628466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:24.628468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:24.628471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:24.628474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:24.628476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.628479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.628484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.628488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:24.628492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:24.628499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:24.628507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:24.628513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:24.628516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:24.628520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:24.628522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:24.628525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:24.628544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:24.628549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:24.628555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:24.628560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:24.628563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:24.628566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:24.628570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:24.628573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:24.628575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:24.628579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:24.628582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:24.628584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:24.628587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:24.628589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.628592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.628594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.628597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.628599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.628602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.628604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:24.628606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:24.628609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:24.628611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:24.628636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:24.634228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:24.635443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:24.635459Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:24.635462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:24.635465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:24.635472Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 415 [2:7555894949395124392:4219]
2025-09-30T14:51:24.635487Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:24.635503Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:24.635506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.635509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.635512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.635528Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:24.635535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:24.635546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:24.635605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.635614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.635616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.635620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:24.635623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:24.635699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:24.635709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.635721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.635731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.635748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:24.635768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894949484850369:4926], now have 1 active actors on pipe
2025-09-30T14:51:24.635777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894949484850127:2454], now have 1 active actors on pipe
2025-09-30T14:51:24.635783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894949395124387:4219]
2025-09-30T14:51:24.635786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894949395124387:4219]
2025-09-30T14:51:24.635791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894949395124387:4219]
2025-09-30T14:51:24.635804Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:24.635819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:24.635827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:24.635836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:24.635840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:24.635815Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 415
2025-09-30T14:51:24.635842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:24.635844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:24.635832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 415
2025-09-30T14:51:24.635877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894949395124387:4219]
2025-09-30T14:51:24.635885Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:24.635887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:24.635913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:24.635922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:24.635954Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6afb0c3-aab09f61-b23810fe-99fda51a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:24.635967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.635970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.635972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:24.635981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.635991Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:24.636012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:24.636164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:24.636172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:24.636186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:24.636305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 416 partition: 0 MaxSeqNo: 42 sessionId: src_id|d6afb0c3-aab09f61-b23810fe-99fda51a_0
2025-09-30T14:51:24.636751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f16c4857-6aae8df0-9a151c08-3092e6bb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d6afb0c3-aab09f61-b23810fe-99fda51a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:24.639818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6afb0c3-aab09f61-b23810fe-99fda51a_0] Write session: try to update token
2025-09-30T14:51:24.639833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6afb0c3-aab09f61-b23810fe-99fda51a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:24.647711Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:24.647728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:24.647730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:24.647732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:24.647742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894949395124387:4219]
2025-09-30T14:51:24.647746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894949395124387:4219]
2025-09-30T14:51:24.647750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894949395124387:4219]
2025-09-30T14:51:24.647792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:24.647796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:24.647800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.647802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:24.647802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:24.647809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:24.647941Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:24.654419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 416 sessionId: src_id|d6afb0c3-aab09f61-b23810fe-99fda51a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:24.657180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:24.706510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894949484850379:4849]
2025-09-30T14:51:24.706838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 415, pipe: [1:7555894949484850379:4849]
2025-09-30T14:51:24.756369Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:24.756878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:24.756894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:24.756914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894949484850379:4849], now have 1 active actors on pipe
2025-09-30T14:51:24.757135Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:24.757141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:24.757151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:24.757158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894949484850379:4849]
2025-09-30T14:51:24.757180Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:24.757205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 416 reason: error at write: Disconnected sessionId: src_id|d6afb0c3-aab09f61-b23810fe-99fda51a_0
2025-09-30T14:51:24.757367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 416 sessionId: src_id|d6afb0c3-aab09f61-b23810fe-99fda51a_0 is DEAD
2025-09-30T14:51:24.757543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6afb0c3-aab09f61-b23810fe-99fda51a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:24.757551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6afb0c3-aab09f61-b23810fe-99fda51a_0] Write session will restart in 0.009330s
2025-09-30T14:51:24.757573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6afb0c3-aab09f61-b23810fe-99fda51a_0] Write session: Do CDS request
2025-09-30T14:51:24.757582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6afb0c3-aab09f61-b23810fe-99fda51a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:24.767770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6afb0c3-aab09f61-b23810fe-99fda51a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:24.767827Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:24.767843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 417
2025-09-30T14:51:24.768064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 417 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:24.768106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 417 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:24.768117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=417 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:24.768122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:24.768583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 417 sessionId:  describe result for acl check
2025-09-30T14:51:24.768618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:24.768626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:24.768628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:24.768634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894949484850483:4930] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:24.769171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894949484850483:4930] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:24.771897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894949484850483:4930] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:24.774103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:24.776680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:24.776908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894949484850483:4930] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:24.776925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894949484850483:4930] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:24.776929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894949484850483:4930] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:24.776937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 417 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:24.776969Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:24.776979Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:24.776989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:24.777045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:24.777084Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894949395124636:4221]
2025-09-30T14:51:24.777737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:24.777971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:24.778008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:24.778333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:24.778388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:24.778396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:24.778397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:24.778398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:24.778400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:24.778401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:24.778402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:24.778403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:24.778404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:24.778405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:24.778407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.778408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.778409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.778411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:24.778412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:24.778417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:24.778428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:24.778432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:24.778436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:24.778440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:24.778445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:24.778449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:24.778453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:24.778457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:24.778463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:24.778466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.778471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.778475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.778480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:24.778484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:24.778492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:24.778501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:24.778507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:24.778512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:24.778528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:24.778533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:24.778538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:24.778543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:24.778548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:24.778553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:24.778557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:24.778562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:24.778572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:24.778577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:24.778583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:24.778589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:24.778598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:24.778603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:24.778611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:24.778618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:24.778627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.778632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.778636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.778641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.778646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.778653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.778657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:24.778665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:24.778669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:24.778673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:24.778714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:24.784060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:24.785128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:24.785141Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:24.785143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:24.785147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:24.785153Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 416 [2:7555894949395124636:4221]
2025-09-30T14:51:24.785165Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:24.785180Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:24.785183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.785186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.785188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.785203Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:24.785215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:24.785222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:24.785280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.785288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.785290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.785293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:24.785296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:24.785356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:24.785363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.785375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.785387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.785410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:24.785433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894949484850380:2454], now have 1 active actors on pipe
2025-09-30T14:51:24.785440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894949484850621:4930], now have 1 active actors on pipe
2025-09-30T14:51:24.785446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894949395124631:4221]
2025-09-30T14:51:24.785448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894949395124631:4221]
2025-09-30T14:51:24.785450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894949395124631:4221]
2025-09-30T14:51:24.785462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:24.785476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:24.785477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:24.785486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:24.785489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:24.785491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:24.785494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:24.785521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894949395124631:4221]
2025-09-30T14:51:24.785533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:24.785523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 416
2025-09-30T14:51:24.785522Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 416
2025-09-30T14:51:24.785556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:24.785591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:24.785600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:24.785622Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c7294e37-273f9f0a-e9e92273-5c9cd55b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:24.785632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.785636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.785638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:24.785647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.785660Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:24.785680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:24.785861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:24.785878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:24.785904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:24.786037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 417 partition: 0 MaxSeqNo: 42 sessionId: src_id|c7294e37-273f9f0a-e9e92273-5c9cd55b_0
2025-09-30T14:51:24.786433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6afb0c3-aab09f61-b23810fe-99fda51a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c7294e37-273f9f0a-e9e92273-5c9cd55b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:24.789065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7294e37-273f9f0a-e9e92273-5c9cd55b_0] Write session: try to update token
2025-09-30T14:51:24.789081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7294e37-273f9f0a-e9e92273-5c9cd55b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:24.797423Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:24.797441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:24.797444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:24.797445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:24.797455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894949395124631:4221]
2025-09-30T14:51:24.797459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894949395124631:4221]
2025-09-30T14:51:24.797463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894949395124631:4221]
2025-09-30T14:51:24.797506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:24.797509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:24.797513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.797516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:24.797516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:24.797519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:24.797659Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:24.803190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 417 sessionId: src_id|c7294e37-273f9f0a-e9e92273-5c9cd55b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:24.805954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:24.857543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894949484850645:4849]
2025-09-30T14:51:24.857803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 416, pipe: [1:7555894949484850645:4849]
2025-09-30T14:51:24.901834Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:24.902014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:24.902027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:24.902062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894949484850645:4849], now have 1 active actors on pipe
2025-09-30T14:51:24.902248Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:24.902266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:24.902307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894949484850645:4849]
2025-09-30T14:51:24.902321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:24.902384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 417 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c7294e37-273f9f0a-e9e92273-5c9cd55b_0
2025-09-30T14:51:24.902565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 417 sessionId: src_id|c7294e37-273f9f0a-e9e92273-5c9cd55b_0 is DEAD
2025-09-30T14:51:24.902695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7294e37-273f9f0a-e9e92273-5c9cd55b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:24.902705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7294e37-273f9f0a-e9e92273-5c9cd55b_0] Write session will restart in 0.009753s
2025-09-30T14:51:24.902726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7294e37-273f9f0a-e9e92273-5c9cd55b_0] Write session: Do CDS request
2025-09-30T14:51:24.902731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7294e37-273f9f0a-e9e92273-5c9cd55b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:24.913787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7294e37-273f9f0a-e9e92273-5c9cd55b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:24.913847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:24.913875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 418
2025-09-30T14:51:24.913985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 418 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:24.914025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 418 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:24.914033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=418 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:24.914037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:24.914461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 418 sessionId:  describe result for acl check
2025-09-30T14:51:24.914493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:24.914499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:24.914503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:24.914508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894949484850784:4941] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:24.915042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894949484850784:4941] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:24.917370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894949484850784:4941] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:24.918852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:24.921425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:24.921635Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:24.921647Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:24.921658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:24.921714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:24.921753Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894949395124905:4230]
2025-09-30T14:51:24.921830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894949484850784:4941] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:24.921845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894949484850784:4941] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:24.921847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894949484850784:4941] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:24.921855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 418 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:24.922429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:24.922750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:24.922802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:24.923143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:24.923210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:24.923217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:24.923218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:24.923219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:24.923220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:24.923221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:24.923222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:24.923223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:24.923224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:24.923226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:24.923227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.923228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.923229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.923230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:24.923231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:24.923236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:24.923271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:24.923275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:24.923280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:24.923284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:24.923288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:24.923291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:24.923295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:24.923300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:24.923304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:24.923308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.923312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.923316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.923321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:24.923325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:24.923332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:24.923340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:24.923346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:24.923358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:24.923363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:24.923369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:24.923374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:24.923379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:24.923385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:24.923390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:24.923395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:24.923401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:24.923410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:24.923416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:24.923426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:24.923431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:24.923436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:24.923446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:24.923458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:24.923468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:24.923473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.923480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.923485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.923496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.923500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.923506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.923515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:24.923519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:24.923524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:24.923529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:24.923580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:24.929025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:24.930291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:24.930307Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:24.930309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:24.930313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:24.930320Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 417 [2:7555894949395124905:4230]
2025-09-30T14:51:24.930333Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:24.930347Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:24.930350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.930353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.930355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.930369Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:24.930375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:24.930382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:24.930438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.930445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.930447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.930449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:24.930451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:24.930499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:24.930504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.930512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:24.930534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:24.930549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:24.930560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894949395124900:4230]
2025-09-30T14:51:24.930567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894949395124900:4230]
2025-09-30T14:51:24.930568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894949395124900:4230]
2025-09-30T14:51:24.930574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:24.930584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:24.930587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:24.930590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:24.930592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:24.930600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:24.930602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:24.930611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894949484850900:4941], now have 1 active actors on pipe
2025-09-30T14:51:24.930614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894949484850659:2454], now have 1 active actors on pipe
2025-09-30T14:51:24.930646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894949395124900:4230]
2025-09-30T14:51:24.930659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:24.930678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:24.930669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 417
2025-09-30T14:51:24.930699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 417
2025-09-30T14:51:24.930718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:24.930728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:24.930750Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ff3f5e0-af0818bc-b2183231-8d9011d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:24.930758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.930766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.930768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:24.930777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.930786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:24.930808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:24.930936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:24.930944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:24.930957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:24.931046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 418 partition: 0 MaxSeqNo: 42 sessionId: src_id|3ff3f5e0-af0818bc-b2183231-8d9011d3_0
2025-09-30T14:51:24.931450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7294e37-273f9f0a-e9e92273-5c9cd55b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3ff3f5e0-af0818bc-b2183231-8d9011d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:24.934139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff3f5e0-af0818bc-b2183231-8d9011d3_0] Write session: try to update token
2025-09-30T14:51:24.934155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff3f5e0-af0818bc-b2183231-8d9011d3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:24.942264Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:24.942282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:24.942291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894949395124900:4230]
2025-09-30T14:51:24.942332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:24.942351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:24.942489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:24.942639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:24.942777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:24.942915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:24.943424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:24.943469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:24.949095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 418 sessionId: src_id|3ff3f5e0-af0818bc-b2183231-8d9011d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:24.951935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:24.953144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:24.953169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:24.953188Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:24.953192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:24.953194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:24.953196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:24.953205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894949395124900:4230]
2025-09-30T14:51:24.953208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894949395124900:4230]
2025-09-30T14:51:24.953212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894949395124900:4230]
2025-09-30T14:51:24.953243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:24.953256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:24.953256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:24.953259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:24.953261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:24.953264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:24.953383Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:25.002428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894953779818225:4849]
2025-09-30T14:51:25.002689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 417, pipe: [1:7555894953779818225:4849]
2025-09-30T14:51:25.056925Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:25.057210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:25.057245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894953779818225:4849], now have 1 active actors on pipe
2025-09-30T14:51:25.057391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:25.057476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894953779818225:4849]
2025-09-30T14:51:25.057491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:25.057494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:25.057510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:25.057566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 418 reason: error at write: Disconnected sessionId: src_id|3ff3f5e0-af0818bc-b2183231-8d9011d3_0
2025-09-30T14:51:25.057746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 418 sessionId: src_id|3ff3f5e0-af0818bc-b2183231-8d9011d3_0 is DEAD
2025-09-30T14:51:25.057915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff3f5e0-af0818bc-b2183231-8d9011d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:25.057926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff3f5e0-af0818bc-b2183231-8d9011d3_0] Write session will restart in 0.005997s
2025-09-30T14:51:25.057957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff3f5e0-af0818bc-b2183231-8d9011d3_0] Write session: Do CDS request
2025-09-30T14:51:25.057964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff3f5e0-af0818bc-b2183231-8d9011d3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:25.064759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff3f5e0-af0818bc-b2183231-8d9011d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:25.064852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:25.064868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 419
2025-09-30T14:51:25.064977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 419 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:25.065008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 419 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:25.065017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=419 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:25.065028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:25.065429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 419 sessionId:  describe result for acl check
2025-09-30T14:51:25.065461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:25.065463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:25.065465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:25.065470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894953779818252:4948] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:25.066012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894953779818252:4948] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:25.068962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894953779818252:4948] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:25.072105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894953779818252:4948] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:25.072122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894953779818252:4948] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:25.072125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894953779818252:4948] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:25.072133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 419 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:25.074630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:25.077398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:25.077652Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:25.077666Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:25.077679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:25.077771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:25.077813Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894953690092474:4239]
2025-09-30T14:51:25.078306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:25.078646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:25.078706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:25.079061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:25.079136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:25.079142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:25.079144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:25.079145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:25.079146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:25.079147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:25.079148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:25.079150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:25.079151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:25.079152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:25.079153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.079155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.079156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.079157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:25.079158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:25.079164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:25.079176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:25.079180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:25.079185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:25.079190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:25.079195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:25.079199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:25.079204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:25.079208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:25.079213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:25.079218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.079223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.079227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.079232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:25.079237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:25.079259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:25.079268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:25.079274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:25.079280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:25.079286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:25.079291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:25.079308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:25.079320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:25.079325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:25.079331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:25.079335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:25.079341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:25.079345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:25.079350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:25.079354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:25.079369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:25.079377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:25.079381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:25.079385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:25.079389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:25.079401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.079407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.079417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.079423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.079432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.079438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.079445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:25.079451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:25.079456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:25.079460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:25.079507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:25.085158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:25.086360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:25.086376Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:25.086379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:25.086383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:25.086390Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 418 [2:7555894953690092474:4239]
2025-09-30T14:51:25.086406Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:25.086421Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:25.086427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.086429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.086430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.086444Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:25.086450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:25.086455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:25.086499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.086504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.086505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.086507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:25.086509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:25.086583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:25.086590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.086612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.086622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.086632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:25.086649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894953779818229:2454], now have 1 active actors on pipe
2025-09-30T14:51:25.086655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894953779818444:4948], now have 1 active actors on pipe
2025-09-30T14:51:25.086660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894953690092469:4239]
2025-09-30T14:51:25.086662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894953690092469:4239]
2025-09-30T14:51:25.086664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894953690092469:4239]
2025-09-30T14:51:25.086673Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:25.086683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:25.086689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:25.086694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:25.086696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:25.086700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:25.086702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:25.086733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894953690092469:4239]
2025-09-30T14:51:25.086746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:25.086754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:25.086762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 418
2025-09-30T14:51:25.086768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 418
2025-09-30T14:51:25.086807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:25.086816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:25.086839Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fded09b1-1d132afa-1099ab45-e403c71f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:25.086851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.086854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.086857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:25.086865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.086873Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:25.086888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:25.087041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:25.087051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:25.087085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:25.087182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 419 partition: 0 MaxSeqNo: 42 sessionId: src_id|fded09b1-1d132afa-1099ab45-e403c71f_0
2025-09-30T14:51:25.087607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff3f5e0-af0818bc-b2183231-8d9011d3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fded09b1-1d132afa-1099ab45-e403c71f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:25.090254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fded09b1-1d132afa-1099ab45-e403c71f_0] Write session: try to update token
2025-09-30T14:51:25.090270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fded09b1-1d132afa-1099ab45-e403c71f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:25.098412Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:25.098431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:25.098441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894953690092469:4239]
2025-09-30T14:51:25.098481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:25.098514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:25.098657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:25.098796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:25.098930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:25.099073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:25.099285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:25.099326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:25.105100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 419 sessionId: src_id|fded09b1-1d132afa-1099ab45-e403c71f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:25.107753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:25.107935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:25.107954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:25.108001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:25.108106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:25.109449Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:25.109462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:25.109464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:25.109465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:25.109472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894953690092469:4239]
2025-09-30T14:51:25.109475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894953690092469:4239]
2025-09-30T14:51:25.109478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894953690092469:4239]
2025-09-30T14:51:25.109506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:25.109511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.109513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:25.109536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:25.109543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:25.109547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:25.109647Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:25.157563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894953779818484:4849]
2025-09-30T14:51:25.157861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 418, pipe: [1:7555894953779818484:4849]
2025-09-30T14:51:25.217449Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:25.224822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:25.224850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:25.225033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:25.225097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:25.225159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:25.225219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:25.225267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:25.225276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:25.225348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:25.225416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:25.225487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:25.225556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:25.225600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:25.225608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:25.225698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:25.225795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:25.225860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:25.225960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:25.226014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:25.226021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:25.226166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:25.226231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:25.226295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:25.226355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:25.226398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:25.226405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:25.226473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:25.226550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:25.226615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:25.226673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:25.226717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:25.226723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:25.226781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:25.226834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:25.226893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:25.226952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:25.227009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:25.227014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:25.227075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:25.227129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:25.227189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:25.227267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:25.227310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:25.227315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:25.227373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:25.227427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:25.227482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:25.227539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:25.227586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:25.227594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:25.227660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:25.227719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:25.227785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:25.227846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:25.227886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:25.227891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:25.227951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:25.228013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:25.228080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:25.228140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:25.228180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:25.228187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:25.228248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894953779818484:4849], now have 1 active actors on pipe
2025-09-30T14:51:25.228534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:25.228539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894953779818484:4849]
2025-09-30T14:51:25.228567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:25.228570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:25.228597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 419 reason: error at write: Disconnected sessionId: src_id|fded09b1-1d132afa-1099ab45-e403c71f_0
2025-09-30T14:51:25.228819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 419 sessionId: src_id|fded09b1-1d132afa-1099ab45-e403c71f_0 is DEAD
2025-09-30T14:51:25.228974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fded09b1-1d132afa-1099ab45-e403c71f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:25.228985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fded09b1-1d132afa-1099ab45-e403c71f_0] Write session will restart in 0.005128s
2025-09-30T14:51:25.229009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fded09b1-1d132afa-1099ab45-e403c71f_0] Write session: Do CDS request
2025-09-30T14:51:25.229015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fded09b1-1d132afa-1099ab45-e403c71f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:25.229165Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:25.235749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fded09b1-1d132afa-1099ab45-e403c71f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:25.235841Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:25.235855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 420
2025-09-30T14:51:25.235970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 420 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:25.236000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 420 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:25.236012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=420 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:25.236017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:25.236422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 420 sessionId:  describe result for acl check
2025-09-30T14:51:25.236454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:25.236460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:25.236462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:25.236468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894953779818510:4952] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:25.236977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894953779818510:4952] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:25.240755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894953779818510:4952] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:25.243895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894953779818510:4952] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:25.243912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894953779818510:4952] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:25.243916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894953779818510:4952] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:25.243925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 420 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:25.245862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:25.248553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:25.248767Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:25.248781Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:25.248793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:25.248854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:25.248898Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894953690092722:4241]
2025-09-30T14:51:25.249563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:25.249894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:25.249948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:25.250272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:25.250354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:25.250361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:25.250362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:25.250364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:25.250365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:25.250366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:25.250367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:25.250368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:25.250370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:25.250371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:25.250372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.250373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.250374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.250375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:25.250376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:25.250382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:25.250394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:25.250398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:25.250403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:25.250408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:25.250413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:25.250417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:25.250422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:25.250427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:25.250431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:25.250435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.250439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.250442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.250446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:25.250449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:25.250456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:25.250464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:25.250469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:25.250475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:25.250480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:25.250486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:25.250491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:25.250497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:25.250502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:25.250508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:25.250526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:25.250532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:25.250538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:25.250549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:25.250553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:25.250559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:25.250567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:25.250573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:25.250580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:25.250587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:25.250597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.250603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.250612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.250618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.250623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.250634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.250638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:25.250644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:25.250653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:25.250658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:25.250705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:25.256087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:25.257145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:25.257158Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:25.257160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:25.257163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:25.257167Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 419 [2:7555894953690092722:4241]
2025-09-30T14:51:25.257178Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:25.257190Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:25.257192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.257194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.257195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.257207Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:25.257212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:25.257217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:25.257264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.257270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.257272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.257274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:25.257276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:25.257323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:25.257329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.257337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.257343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.257355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:25.257370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894953690092717:4241]
2025-09-30T14:51:25.257375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894953690092717:4241]
2025-09-30T14:51:25.257377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894953690092717:4241]
2025-09-30T14:51:25.257381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:25.257391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:25.257398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:25.257400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:25.257401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:25.257402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:25.257402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:25.257408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894953779818722:4952], now have 1 active actors on pipe
2025-09-30T14:51:25.257411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894953779818485:2454], now have 1 active actors on pipe
2025-09-30T14:51:25.257436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894953690092717:4241]
2025-09-30T14:51:25.257444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:25.257461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:25.257504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 419
2025-09-30T14:51:25.257506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 419
2025-09-30T14:51:25.257566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:25.257576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:25.257599Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5d6a158-e9ec79b7-f62fab11-b84f5eeb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:25.257608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.257612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.257613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:25.257619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.257627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:25.257639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:25.257745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:25.257751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:25.257760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:25.257830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 420 partition: 0 MaxSeqNo: 42 sessionId: src_id|e5d6a158-e9ec79b7-f62fab11-b84f5eeb_0
2025-09-30T14:51:25.258205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fded09b1-1d132afa-1099ab45-e403c71f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e5d6a158-e9ec79b7-f62fab11-b84f5eeb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:25.261607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5d6a158-e9ec79b7-f62fab11-b84f5eeb_0] Write session: try to update token
2025-09-30T14:51:25.261629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5d6a158-e9ec79b7-f62fab11-b84f5eeb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:25.269360Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:25.269383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:25.269386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:25.269389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:25.269398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894953690092717:4241]
2025-09-30T14:51:25.269403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894953690092717:4241]
2025-09-30T14:51:25.269407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894953690092717:4241]
2025-09-30T14:51:25.269443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:25.269448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:25.269449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:25.269452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:25.269456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.269459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:25.269600Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:25.276690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 420 sessionId: src_id|e5d6a158-e9ec79b7-f62fab11-b84f5eeb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:25.279420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:25.328518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894953779818742:4849]
2025-09-30T14:51:25.328763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 419, pipe: [1:7555894953779818742:4849]
2025-09-30T14:51:25.377168Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:25.377562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:25.377574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:25.377591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894953779818742:4849], now have 1 active actors on pipe
2025-09-30T14:51:25.377760Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:25.377820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:25.377829Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:25.377833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:25.377870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894953779818742:4849]
2025-09-30T14:51:25.377883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 420 reason: error at write: Disconnected sessionId: src_id|e5d6a158-e9ec79b7-f62fab11-b84f5eeb_0
2025-09-30T14:51:25.378049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 420 sessionId: src_id|e5d6a158-e9ec79b7-f62fab11-b84f5eeb_0 is DEAD
2025-09-30T14:51:25.378202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5d6a158-e9ec79b7-f62fab11-b84f5eeb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:25.378210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5d6a158-e9ec79b7-f62fab11-b84f5eeb_0] Write session will restart in 0.006142s
2025-09-30T14:51:25.378234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5d6a158-e9ec79b7-f62fab11-b84f5eeb_0] Write session: Do CDS request
2025-09-30T14:51:25.378241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5d6a158-e9ec79b7-f62fab11-b84f5eeb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:25.385766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5d6a158-e9ec79b7-f62fab11-b84f5eeb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:25.385840Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:25.385852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 421
2025-09-30T14:51:25.386012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 421 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:25.386043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 421 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:25.386048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=421 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:25.386052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:25.386384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 421 sessionId:  describe result for acl check
2025-09-30T14:51:25.386407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:25.386412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:25.386414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:25.386418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894953779818786:4956] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:25.386862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894953779818786:4956] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:25.389383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894953779818786:4956] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:25.391836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894953779818786:4956] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:25.391850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894953779818786:4956] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:25.391853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894953779818786:4956] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:25.391861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 421 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:25.393900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:25.396058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:25.396234Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:25.396244Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:25.396254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:25.396302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:25.396338Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894953690092971:4243]
2025-09-30T14:51:25.396982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:25.397263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:25.397305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:25.397629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:25.397691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:25.397698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:25.397700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:25.397711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:25.397712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:25.397713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:25.397715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:25.397716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:25.397717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:25.397718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:25.397719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.397720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.397721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.397723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:25.397724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:25.397729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:25.397740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:25.397744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:25.397748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:25.397752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:25.397757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:25.397761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:25.397765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:25.397769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:25.397775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:25.397779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.397783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.397786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.397790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:25.397794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:25.397801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:25.397809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:25.397820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:25.397831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:25.397839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:25.397845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:25.397849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:25.397859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:25.397864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:25.397874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:25.397883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:25.397893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:25.397903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:25.397913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:25.397921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:25.397928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:25.397937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:25.397946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:25.397955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:25.397964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:25.397972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.397978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.397982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.397988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.397996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.398002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.398008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:25.398017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:25.398022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:25.398032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:25.398079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:25.403389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:25.404224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:25.404243Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:25.404246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:25.404250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:25.404257Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 420 [2:7555894953690092971:4243]
2025-09-30T14:51:25.404273Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:25.404286Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:25.404289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.404293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.404295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.404312Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:25.404324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:25.404331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:25.404393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.404402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.404404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.404407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:25.404410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:25.404472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:25.404480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.404492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.404503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.404520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:25.404536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894953779818967:4956], now have 1 active actors on pipe
2025-09-30T14:51:25.404540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894953779818743:2454], now have 1 active actors on pipe
2025-09-30T14:51:25.404546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894953690092966:4243]
2025-09-30T14:51:25.404548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894953690092966:4243]
2025-09-30T14:51:25.404551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894953690092966:4243]
2025-09-30T14:51:25.404566Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:25.404580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:25.404589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:25.404593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:25.404595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:25.404600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:25.404603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:25.404631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894953690092966:4243]
2025-09-30T14:51:25.404642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:25.404637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 420
2025-09-30T14:51:25.404648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 420
2025-09-30T14:51:25.404657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:25.404757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:25.404767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:25.404793Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6ac79787-662547de-c79ffde6-3214b2d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:25.404805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.404809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.404811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:25.404821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.404835Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:25.404857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:25.405131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:25.405146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:25.405168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:25.405277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 421 partition: 0 MaxSeqNo: 42 sessionId: src_id|6ac79787-662547de-c79ffde6-3214b2d6_0
2025-09-30T14:51:25.405718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5d6a158-e9ec79b7-f62fab11-b84f5eeb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6ac79787-662547de-c79ffde6-3214b2d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:25.408593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ac79787-662547de-c79ffde6-3214b2d6_0] Write session: try to update token
2025-09-30T14:51:25.408613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ac79787-662547de-c79ffde6-3214b2d6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:25.416858Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:25.416874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:25.416876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:25.416878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:25.416887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894953690092966:4243]
2025-09-30T14:51:25.416892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894953690092966:4243]
2025-09-30T14:51:25.416896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894953690092966:4243]
2025-09-30T14:51:25.416943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:25.416950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.416949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:25.416953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:25.416956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:25.416960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:25.417095Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:25.423079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 421 sessionId: src_id|6ac79787-662547de-c79ffde6-3214b2d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:25.425716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:25.478085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894953779819002:4849]
2025-09-30T14:51:25.478396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 420, pipe: [1:7555894953779819002:4849]
2025-09-30T14:51:25.527600Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:25.528198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:25.528214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:25.528244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894953779819002:4849], now have 1 active actors on pipe
2025-09-30T14:51:25.528409Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:25.528485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:25.528495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:25.528505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:25.528551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894953779819002:4849]
2025-09-30T14:51:25.528564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 421 reason: error at write: Disconnected sessionId: src_id|6ac79787-662547de-c79ffde6-3214b2d6_0
2025-09-30T14:51:25.528758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 421 sessionId: src_id|6ac79787-662547de-c79ffde6-3214b2d6_0 is DEAD
2025-09-30T14:51:25.528880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ac79787-662547de-c79ffde6-3214b2d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:25.528890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ac79787-662547de-c79ffde6-3214b2d6_0] Write session will restart in 0.006193s
2025-09-30T14:51:25.528915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ac79787-662547de-c79ffde6-3214b2d6_0] Write session: Do CDS request
2025-09-30T14:51:25.528919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ac79787-662547de-c79ffde6-3214b2d6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:25.535666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ac79787-662547de-c79ffde6-3214b2d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:25.535756Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:25.535771Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 422
2025-09-30T14:51:25.535902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 422 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:25.535932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 422 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:25.535941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=422 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:25.535944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:25.536317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 422 sessionId:  describe result for acl check
2025-09-30T14:51:25.536346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:25.536352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:25.536354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:25.536359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894953779819037:4961] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:25.536857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894953779819037:4961] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:25.539315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894953779819037:4961] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:25.541607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894953779819037:4961] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:25.541620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894953779819037:4961] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:25.541622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894953779819037:4961] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:25.541627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 422 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:25.543460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:25.545511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:25.545738Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:25.545745Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:25.545753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:25.545797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:25.545827Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894953690093223:4246]
2025-09-30T14:51:25.546268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:25.546469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:25.546496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:25.546733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:25.546775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:25.546779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:25.546780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:25.546781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:25.546781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:25.546782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:25.546783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:25.546784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:25.546784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:25.546785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:25.546786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.546787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.546788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.546788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:25.546789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:25.546792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:25.546798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:25.546801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:25.546803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:25.546805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:25.546808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:25.546810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:25.546812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:25.546815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:25.546817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:25.546819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.546821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.546824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.546826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:25.546828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:25.546833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:25.546838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:25.546842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:25.546847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:25.546849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:25.546852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:25.546855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:25.546858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:25.546860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:25.546863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:25.546865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:25.546868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:25.546871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:25.546874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:25.546876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:25.546879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:25.546881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:25.546885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:25.546887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:25.546890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:25.546894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.546896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.546899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.546901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.546904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.546907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.546909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:25.546912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:25.546914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:25.546917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:25.546943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:25.551894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:25.552714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:25.552725Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:25.552727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:25.552730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:25.552734Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 421 [2:7555894953690093223:4246]
2025-09-30T14:51:25.552743Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:25.552754Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:25.552756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.552758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.552759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.552770Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:25.552774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:25.552784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:25.552824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.552830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.552831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.552833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:25.552835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:25.552879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:25.552888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.552899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.552911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.552928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:25.552946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894953779819233:4961], now have 1 active actors on pipe
2025-09-30T14:51:25.552952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894953779819003:2454], now have 1 active actors on pipe
2025-09-30T14:51:25.552956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894953690093218:4246]
2025-09-30T14:51:25.552958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894953690093218:4246]
2025-09-30T14:51:25.552959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894953690093218:4246]
2025-09-30T14:51:25.552968Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:25.552979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:25.552981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:25.552984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:25.552987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:25.552991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:25.552993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:25.553012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894953690093218:4246]
2025-09-30T14:51:25.553014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:25.553032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:25.553015Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 421
2025-09-30T14:51:25.553039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:25.553042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:25.553017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 421
2025-09-30T14:51:25.553269Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ac2b466-f476df94-12187824-4d60bca1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:25.553281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.553284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.553287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:25.553295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.553304Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:25.553318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:25.553506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:25.553516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:25.553535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:25.553651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 422 partition: 0 MaxSeqNo: 42 sessionId: src_id|8ac2b466-f476df94-12187824-4d60bca1_0
2025-09-30T14:51:25.554007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ac79787-662547de-c79ffde6-3214b2d6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8ac2b466-f476df94-12187824-4d60bca1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:25.556553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ac2b466-f476df94-12187824-4d60bca1_0] Write session: try to update token
2025-09-30T14:51:25.556570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ac2b466-f476df94-12187824-4d60bca1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:25.564824Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:25.564841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:25.564843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:25.564845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:25.564854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894953690093218:4246]
2025-09-30T14:51:25.564859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894953690093218:4246]
2025-09-30T14:51:25.564862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894953690093218:4246]
2025-09-30T14:51:25.564899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:25.564911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.564914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:25.564917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:25.564932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:25.564936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:25.565089Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:25.570182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 422 sessionId: src_id|8ac2b466-f476df94-12187824-4d60bca1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:25.572564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:25.628562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894953779819260:4849]
2025-09-30T14:51:25.628843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 421, pipe: [1:7555894953779819260:4849]
2025-09-30T14:51:25.666442Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:25.666851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:25.666864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:25.666897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894953779819260:4849], now have 1 active actors on pipe
2025-09-30T14:51:25.667045Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:25.667136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894953779819260:4849]
2025-09-30T14:51:25.667141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:25.667164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:25.667229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 422 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8ac2b466-f476df94-12187824-4d60bca1_0
2025-09-30T14:51:25.667415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 422 sessionId: src_id|8ac2b466-f476df94-12187824-4d60bca1_0 is DEAD
2025-09-30T14:51:25.667534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ac2b466-f476df94-12187824-4d60bca1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:25.667543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ac2b466-f476df94-12187824-4d60bca1_0] Write session will restart in 0.005973s
2025-09-30T14:51:25.667565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ac2b466-f476df94-12187824-4d60bca1_0] Write session: Do CDS request
2025-09-30T14:51:25.667571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ac2b466-f476df94-12187824-4d60bca1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:25.674737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ac2b466-f476df94-12187824-4d60bca1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:25.674857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:25.674873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 423
2025-09-30T14:51:25.675010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 423 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:25.675040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 423 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:25.675050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=423 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:25.675054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:25.675527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 423 sessionId:  describe result for acl check
2025-09-30T14:51:25.675563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:25.675570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:25.675572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:25.675579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894953779819293:4965] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:25.676175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894953779819293:4965] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:25.678500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894953779819293:4965] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:25.681407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894953779819293:4965] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:25.681423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894953779819293:4965] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:25.681426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894953779819293:4965] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:25.681435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 423 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:25.684546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:25.686884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:25.687078Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:25.687088Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:25.687098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:25.687155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:25.687190Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894953690093474:4248]
2025-09-30T14:51:25.687846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:25.688097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:25.688135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:25.688459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:25.688515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:25.688521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:25.688522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:25.688524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:25.688526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:25.688527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:25.688528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:25.688529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:25.688530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:25.688531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:25.688533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.688534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.688535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.688536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:25.688537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:25.688542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:25.688552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:25.688556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:25.688560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:25.688565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:25.688569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:25.688573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:25.688577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:25.688581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:25.688585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:25.688590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.688593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.688598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.688602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:25.688606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:25.688612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:25.688624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:25.688635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:25.688644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:25.688652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:25.688658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:25.688662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:25.688672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:25.688681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:25.688690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:25.688695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:25.688704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:25.688712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:25.688719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:25.688723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:25.688729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:25.688737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:25.688742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:25.688751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:25.688756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:25.688764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.688772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.688780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.688790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.688794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.688799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.688808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:25.688814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:25.688822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:25.688827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:25.688874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:25.694194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:25.695529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:25.695541Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:25.695543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:25.695548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:25.695553Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 422 [2:7555894953690093474:4248]
2025-09-30T14:51:25.695569Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:25.695587Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:25.695594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.695598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.695600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.695616Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:25.695626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:25.695637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:25.695690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.695697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.695698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.695703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:25.695705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:25.695766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:25.695773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.695785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.695802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.695824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:25.695845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894953779819262:2454], now have 1 active actors on pipe
2025-09-30T14:51:25.695853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894953779819459:4965], now have 1 active actors on pipe
2025-09-30T14:51:25.695859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894953690093469:4248]
2025-09-30T14:51:25.695861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894953690093469:4248]
2025-09-30T14:51:25.695863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894953690093469:4248]
2025-09-30T14:51:25.695877Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:25.695893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:25.695894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:25.695897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:25.695899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:25.695906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:25.695909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:25.695936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894953690093469:4248]
2025-09-30T14:51:25.695949Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:25.695931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 422
2025-09-30T14:51:25.695933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 422
2025-09-30T14:51:25.695970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:25.695988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:25.695992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:25.696021Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|985930fd-186df0b-355ed146-b4b4fdc6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:25.696033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.696036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.696038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:25.696050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.696065Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:25.696078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:25.696216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:25.696227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:25.696239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:25.696360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 423 partition: 0 MaxSeqNo: 42 sessionId: src_id|985930fd-186df0b-355ed146-b4b4fdc6_0
2025-09-30T14:51:25.696711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ac2b466-f476df94-12187824-4d60bca1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|985930fd-186df0b-355ed146-b4b4fdc6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:25.699418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|985930fd-186df0b-355ed146-b4b4fdc6_0] Write session: try to update token
2025-09-30T14:51:25.699434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|985930fd-186df0b-355ed146-b4b4fdc6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:25.707895Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:25.707914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:25.707917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:25.707918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:25.707928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894953690093469:4248]
2025-09-30T14:51:25.707933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894953690093469:4248]
2025-09-30T14:51:25.707937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894953690093469:4248]
2025-09-30T14:51:25.707975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:25.707981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.707981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:25.707984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:25.707988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:25.707993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:25.708126Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:25.713374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 423 sessionId: src_id|985930fd-186df0b-355ed146-b4b4fdc6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:25.716133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:25.767318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894953779819527:4849]
2025-09-30T14:51:25.767532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 422, pipe: [1:7555894953779819527:4849]
2025-09-30T14:51:25.815161Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:25.815415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:25.815428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:25.815459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894953779819527:4849], now have 1 active actors on pipe
2025-09-30T14:51:25.815593Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:25.815655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894953779819527:4849]
2025-09-30T14:51:25.815656Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:25.815687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:25.815750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 423 reason: status is not ok: tablet will be restarted right now sessionId: src_id|985930fd-186df0b-355ed146-b4b4fdc6_0
2025-09-30T14:51:25.815930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 423 sessionId: src_id|985930fd-186df0b-355ed146-b4b4fdc6_0 is DEAD
2025-09-30T14:51:25.816095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|985930fd-186df0b-355ed146-b4b4fdc6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:25.816106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|985930fd-186df0b-355ed146-b4b4fdc6_0] Write session will restart in 0.006464s
2025-09-30T14:51:25.816128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|985930fd-186df0b-355ed146-b4b4fdc6_0] Write session: Do CDS request
2025-09-30T14:51:25.816134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|985930fd-186df0b-355ed146-b4b4fdc6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:25.823675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|985930fd-186df0b-355ed146-b4b4fdc6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:25.823762Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:25.823775Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 424
2025-09-30T14:51:25.823876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 424 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:25.823907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 424 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:25.823915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=424 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:25.823920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:25.824509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 424 sessionId:  describe result for acl check
2025-09-30T14:51:25.824551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:25.824556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:25.824561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:25.824566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894953779819565:4969] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:25.825072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894953779819565:4969] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:25.827304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894953779819565:4969] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:25.829935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894953779819565:4969] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:25.829947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894953779819565:4969] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:25.829949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894953779819565:4969] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:25.829954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 424 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:25.831834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:25.833894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:25.834053Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:25.834061Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:25.834067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:25.834101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:25.834129Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894953690093738:4251]
2025-09-30T14:51:25.834573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:25.834827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:25.834853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:25.835065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:25.835102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:25.835107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:25.835108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:25.835108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:25.835109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:25.835110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:25.835110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:25.835111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:25.835112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:25.835112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:25.835113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.835114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.835114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.835115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:25.835116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:25.835119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:25.835125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:25.835127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:25.835129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:25.835132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:25.835134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:25.835136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:25.835138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:25.835141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:25.835143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:25.835145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.835148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.835150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.835152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:25.835154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:25.835159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:25.835163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:25.835167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:25.835170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:25.835173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:25.835176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:25.835178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:25.835181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:25.835184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:25.835187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:25.835191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:25.835194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:25.835196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:25.835199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:25.835201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:25.835204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:25.835207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:25.835210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:25.835213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:25.835216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:25.835218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.835222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.835224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.835227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.835230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.835232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.835235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:25.835238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:25.835240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:25.835264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:25.835287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:25.840383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:25.841409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:25.841420Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:25.841421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:25.841423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:25.841427Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 423 [2:7555894953690093738:4251]
2025-09-30T14:51:25.841437Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:25.841446Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:25.841448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.841450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.841451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.841461Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:25.841470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:25.841474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:25.841510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.841515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.841517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.841519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:25.841520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:25.841568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:25.841573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.841580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.841588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.841606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:25.841627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894953779819529:2454], now have 1 active actors on pipe
2025-09-30T14:51:25.841632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894953779819754:4969], now have 1 active actors on pipe
2025-09-30T14:51:25.841638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894953690093733:4251]
2025-09-30T14:51:25.841640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894953690093733:4251]
2025-09-30T14:51:25.841642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894953690093733:4251]
2025-09-30T14:51:25.841653Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:25.841666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:25.841669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:25.841683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:25.841683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:25.841685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:25.841685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:25.841677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 423
2025-09-30T14:51:25.841705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894953690093733:4251]
2025-09-30T14:51:25.841711Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:25.841689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 423
2025-09-30T14:51:25.841714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:25.841738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:25.841745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:25.841765Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96ac4e89-d050c15-4826b679-5c360689_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:25.841773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.841775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.841781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:25.841787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.841794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:25.841807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:25.841936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:25.841941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:25.841950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:25.842024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 424 partition: 0 MaxSeqNo: 42 sessionId: src_id|96ac4e89-d050c15-4826b679-5c360689_0
2025-09-30T14:51:25.842382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|985930fd-186df0b-355ed146-b4b4fdc6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|96ac4e89-d050c15-4826b679-5c360689_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:25.845091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96ac4e89-d050c15-4826b679-5c360689_0] Write session: try to update token
2025-09-30T14:51:25.845109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96ac4e89-d050c15-4826b679-5c360689_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:25.853268Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:25.853285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:25.853286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:25.853287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:25.853297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894953690093733:4251]
2025-09-30T14:51:25.853300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894953690093733:4251]
2025-09-30T14:51:25.853302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894953690093733:4251]
2025-09-30T14:51:25.853333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:25.853338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.853340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:25.853347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:25.853353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:25.853356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:25.853469Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:25.859001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 424 sessionId: src_id|96ac4e89-d050c15-4826b679-5c360689_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:25.861644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:25.915855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894953779819800:4849]
2025-09-30T14:51:25.916132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 423, pipe: [1:7555894953779819800:4849]
2025-09-30T14:51:25.959747Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:25.959982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:25.959998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:25.960034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894953779819800:4849], now have 1 active actors on pipe
2025-09-30T14:51:25.960171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894953779819800:4849]
2025-09-30T14:51:25.960216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:25.960219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:25.960208Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:25.960278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 424 reason: error at write: Disconnected sessionId: src_id|96ac4e89-d050c15-4826b679-5c360689_0
2025-09-30T14:51:25.960485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 424 sessionId: src_id|96ac4e89-d050c15-4826b679-5c360689_0 is DEAD
2025-09-30T14:51:25.960644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96ac4e89-d050c15-4826b679-5c360689_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:25.960655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96ac4e89-d050c15-4826b679-5c360689_0] Write session will restart in 0.009026s
2025-09-30T14:51:25.960679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96ac4e89-d050c15-4826b679-5c360689_0] Write session: Do CDS request
2025-09-30T14:51:25.960668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:25.960685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96ac4e89-d050c15-4826b679-5c360689_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:25.970840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96ac4e89-d050c15-4826b679-5c360689_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:25.970891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:25.970903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 425
2025-09-30T14:51:25.971094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 425 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:25.971138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 425 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:25.971147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=425 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:25.971159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:25.971564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 425 sessionId:  describe result for acl check
2025-09-30T14:51:25.971597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:25.971603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:25.971604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:25.971610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894953779819900:4982] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:25.972107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894953779819900:4982] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:25.974211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894953779819900:4982] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:25.977005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894953779819900:4982] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:25.977017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894953779819900:4982] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:25.977020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894953779819900:4982] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:25.977027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 425 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:25.977754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:25.980363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:25.980554Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:25.980565Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:25.980575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:25.980634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:25.980667Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894953690094004:4259]
2025-09-30T14:51:25.981269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:25.981557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:25.981599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:25.981907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:25.981977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:25.981983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:25.981984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:25.981985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:25.981987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:25.981988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:25.981989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:25.981990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:25.981991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:25.981992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:25.981993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.981994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.981995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.981996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:25.981997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:25.982002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:25.982011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:25.982015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:25.982019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:25.982023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:25.982027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:25.982030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:25.982034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:25.982037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:25.982041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:25.982044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.982047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.982051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.982054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:25.982058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:25.982064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:25.982072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:25.982078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:25.982088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:25.982092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:25.982096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:25.982105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:25.982109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:25.982114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:25.982118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:25.982122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:25.982127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:25.982135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:25.982139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:25.982143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:25.982147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:25.982155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:25.982160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:25.982170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:25.982175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:25.982184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.982189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.982197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.982202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.982207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.982215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.982219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:25.982229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:25.982233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:25.982239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:25.982280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:25.987469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:25.988364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:25.988378Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:25.988380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:25.988384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:25.988389Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 424 [2:7555894953690094004:4259]
2025-09-30T14:51:25.988402Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:25.988413Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:25.988417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.988420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.988422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.988435Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:25.988440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:25.988451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:25.988500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.988507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.988509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.988512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:25.988514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:25.988570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:25.988577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:25.988588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:25.988599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:25.988614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:25.988635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894953779820067:4982], now have 1 active actors on pipe
2025-09-30T14:51:25.988643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894953779819817:2454], now have 1 active actors on pipe
2025-09-30T14:51:25.988648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894953690093999:4259]
2025-09-30T14:51:25.988650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894953690093999:4259]
2025-09-30T14:51:25.988652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894953690093999:4259]
2025-09-30T14:51:25.988665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:25.988680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:25.988682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:25.988686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:25.988688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:25.988698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:25.988701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:25.988723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894953690093999:4259]
2025-09-30T14:51:25.988734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:25.988740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:25.988787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 424
2025-09-30T14:51:25.988816Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 424
2025-09-30T14:51:25.988866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:25.988877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:25.988902Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96032cf7-b728a5cd-9a5d27f9-bca06e96_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:25.988915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.988918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.988920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:25.988929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.988942Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:25.988960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:25.989080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:25.989087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:25.989098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:25.989185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 425 partition: 0 MaxSeqNo: 42 sessionId: src_id|96032cf7-b728a5cd-9a5d27f9-bca06e96_0
2025-09-30T14:51:25.989564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96ac4e89-d050c15-4826b679-5c360689_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|96032cf7-b728a5cd-9a5d27f9-bca06e96_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:25.992288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96032cf7-b728a5cd-9a5d27f9-bca06e96_0] Write session: try to update token
2025-09-30T14:51:25.992306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96032cf7-b728a5cd-9a5d27f9-bca06e96_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:26.000457Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:26.000477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:26.000478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:26.000480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:26.000487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894953690093999:4259]
2025-09-30T14:51:26.000491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894953690093999:4259]
2025-09-30T14:51:26.000494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894953690093999:4259]
2025-09-30T14:51:26.000528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:26.000533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:26.000534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:26.000537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:26.000539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.000542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:26.001018Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:26.006294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 425 sessionId: src_id|96032cf7-b728a5cd-9a5d27f9-bca06e96_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:26.008885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:26.060245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894958074787391:4849]
2025-09-30T14:51:26.060542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 424, pipe: [1:7555894958074787391:4849]
2025-09-30T14:51:26.107940Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:26.108439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:26.108459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:26.108499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894958074787391:4849], now have 1 active actors on pipe
2025-09-30T14:51:26.108723Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:26.108727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:26.108741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:26.108769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894958074787391:4849]
2025-09-30T14:51:26.108788Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:26.108805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 425 reason: error at write: Disconnected sessionId: src_id|96032cf7-b728a5cd-9a5d27f9-bca06e96_0
2025-09-30T14:51:26.108993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 425 sessionId: src_id|96032cf7-b728a5cd-9a5d27f9-bca06e96_0 is DEAD
2025-09-30T14:51:26.109124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96032cf7-b728a5cd-9a5d27f9-bca06e96_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:26.109134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96032cf7-b728a5cd-9a5d27f9-bca06e96_0] Write session will restart in 0.005865s
2025-09-30T14:51:26.109156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96032cf7-b728a5cd-9a5d27f9-bca06e96_0] Write session: Do CDS request
2025-09-30T14:51:26.109162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96032cf7-b728a5cd-9a5d27f9-bca06e96_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:26.115690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96032cf7-b728a5cd-9a5d27f9-bca06e96_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:26.115819Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:26.115835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 426
2025-09-30T14:51:26.115974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 426 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:26.116004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 426 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:26.116014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=426 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:26.116018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:26.116581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 426 sessionId:  describe result for acl check
2025-09-30T14:51:26.116611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:26.116616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:26.116617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:26.116622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894958074787416:4987] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:26.117046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894958074787416:4987] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:26.120470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894958074787416:4987] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:26.123120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894958074787416:4987] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:26.123135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894958074787416:4987] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:26.123139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894958074787416:4987] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:26.123146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 426 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:26.125913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:26.128384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:26.128598Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:26.128609Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:26.128620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:26.128673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:26.128718Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894957985061579:4268]
2025-09-30T14:51:26.129408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:26.129714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:26.129752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:26.130063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:26.130124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:26.130130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:26.130131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:26.130132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:26.130133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:26.130135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:26.130136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:26.130138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:26.130139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:26.130141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:26.130142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.130143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.130144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.130146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:26.130147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:26.130152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:26.130163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:26.130167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:26.130172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:26.130176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:26.130180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:26.130184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:26.130188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:26.130192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:26.130197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:26.130201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.130205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.130209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.130213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:26.130217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:26.130226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:26.130234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:26.130241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:26.130246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:26.130254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:26.130264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:26.130267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:26.130272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:26.130276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:26.130281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:26.130285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:26.130290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:26.130294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:26.130300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:26.130304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:26.130310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:26.130319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:26.130323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:26.130327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:26.130332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:26.130341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.130348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.130356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.130362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.130366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.130377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.130381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:26.130391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:26.130395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:26.130404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:26.130450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:26.135817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:26.136842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:26.136866Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:26.136869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:26.136873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:26.136882Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 425 [2:7555894957985061579:4268]
2025-09-30T14:51:26.136900Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:26.136921Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:26.136928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:26.136931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:26.136933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:26.136948Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:26.136955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:26.136963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:26.137024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.137032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.137034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.137037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:26.137040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:26.137109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:26.137116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.137129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.137147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.137164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:26.137183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894958074787392:2454], now have 1 active actors on pipe
2025-09-30T14:51:26.137191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894958074787602:4987], now have 1 active actors on pipe
2025-09-30T14:51:26.137198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894957985061574:4268]
2025-09-30T14:51:26.137204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894957985061574:4268]
2025-09-30T14:51:26.137206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894957985061574:4268]
2025-09-30T14:51:26.137221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:26.137239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:26.137245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:26.137249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:26.137251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:26.137258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:26.137261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:26.137291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894957985061574:4268]
2025-09-30T14:51:26.137304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:26.137315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:26.137355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 425
2025-09-30T14:51:26.137540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 425
2025-09-30T14:51:26.137609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:26.137620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:26.137643Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7c2a132-efe62fcd-d509807a-254002a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:26.137655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:26.137664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:26.137666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:26.137676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:26.137686Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:26.137704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:26.138270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:26.138284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:26.138306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:26.138417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 426 partition: 0 MaxSeqNo: 42 sessionId: src_id|f7c2a132-efe62fcd-d509807a-254002a3_0
2025-09-30T14:51:26.138804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96032cf7-b728a5cd-9a5d27f9-bca06e96_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f7c2a132-efe62fcd-d509807a-254002a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:26.141548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7c2a132-efe62fcd-d509807a-254002a3_0] Write session: try to update token
2025-09-30T14:51:26.141567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7c2a132-efe62fcd-d509807a-254002a3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:26.149071Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:26.149093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:26.149095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:26.149098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:26.149107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894957985061574:4268]
2025-09-30T14:51:26.149111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894957985061574:4268]
2025-09-30T14:51:26.149115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894957985061574:4268]
2025-09-30T14:51:26.149159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:26.149166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.149165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:26.149169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:26.149172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:26.149177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:26.149309Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:26.156112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 426 sessionId: src_id|f7c2a132-efe62fcd-d509807a-254002a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:26.158704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:26.208705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894958074787655:4849]
2025-09-30T14:51:26.208993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 425, pipe: [1:7555894958074787655:4849]
2025-09-30T14:51:26.257604Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:26.258127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:26.258147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:26.258167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894958074787655:4849], now have 1 active actors on pipe
2025-09-30T14:51:26.258401Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:26.258420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:26.258422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894958074787655:4849]
2025-09-30T14:51:26.258445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:26.258448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:26.258508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 426 reason: error at write: Disconnected sessionId: src_id|f7c2a132-efe62fcd-d509807a-254002a3_0
2025-09-30T14:51:26.258739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 426 sessionId: src_id|f7c2a132-efe62fcd-d509807a-254002a3_0 is DEAD
2025-09-30T14:51:26.258883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7c2a132-efe62fcd-d509807a-254002a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:26.258893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7c2a132-efe62fcd-d509807a-254002a3_0] Write session will restart in 0.006083s
2025-09-30T14:51:26.258918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7c2a132-efe62fcd-d509807a-254002a3_0] Write session: Do CDS request
2025-09-30T14:51:26.258928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7c2a132-efe62fcd-d509807a-254002a3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:26.265781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7c2a132-efe62fcd-d509807a-254002a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:26.265912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:26.265929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 427
2025-09-30T14:51:26.266047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 427 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:26.266078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 427 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:26.266087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=427 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:26.266092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:26.266570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 427 sessionId:  describe result for acl check
2025-09-30T14:51:26.266605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:26.266607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:26.266611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:26.266616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894958074787676:4991] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:26.267127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894958074787676:4991] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:26.269619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894958074787676:4991] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:26.273383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894958074787676:4991] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:26.273399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894958074787676:4991] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:26.273403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894958074787676:4991] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:26.273411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 427 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:26.278661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:26.281308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:26.281525Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:26.281536Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:26.281548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:26.281605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:26.281646Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894957985061834:4270]
2025-09-30T14:51:26.282372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:26.282694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:26.282736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:26.283204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:26.283296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:26.283303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:26.283305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:26.283306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:26.283307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:26.283308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:26.283309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:26.283310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:26.283312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:26.283313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:26.283314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.283315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.283316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.283318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:26.283319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:26.283325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:26.283337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:26.283341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:26.283346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:26.283350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:26.283355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:26.283359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:26.283364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:26.283368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:26.283372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:26.283377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.283381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.283385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.283389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:26.283394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:26.283402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:26.283409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:26.283418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:26.283424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:26.283430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:26.283435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:26.283440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:26.283447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:26.283452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:26.283458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:26.283463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:26.283474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:26.283479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:26.283485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:26.283490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:26.283495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:26.283503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:26.283509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:26.283513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:26.283523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:26.283528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.283536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.283541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.283551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.283556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.283562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.283572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:26.283578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:26.283583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:26.283590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:26.283638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:26.289505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:26.291024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:26.291043Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:26.291045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:26.291049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:26.291056Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 426 [2:7555894957985061834:4270]
2025-09-30T14:51:26.291070Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:26.291085Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:26.291088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:26.291091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:26.291093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:26.291107Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:26.291114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:26.291121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:26.291183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.291191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.291193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.291197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:26.291199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:26.291280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:26.291288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.291302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.291314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.291335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:26.291356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894958074787819:4991], now have 1 active actors on pipe
2025-09-30T14:51:26.291364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894958074787656:2454], now have 1 active actors on pipe
2025-09-30T14:51:26.291370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894957985061829:4270]
2025-09-30T14:51:26.291372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894957985061829:4270]
2025-09-30T14:51:26.291375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894957985061829:4270]
2025-09-30T14:51:26.291387Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:26.291403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:26.291405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:26.291414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:26.291417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:26.291419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:26.291422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:26.291407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 426
2025-09-30T14:51:26.291460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894957985061829:4270]
2025-09-30T14:51:26.291468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:26.291466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 426
2025-09-30T14:51:26.291484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:26.291505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:26.291517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:26.291548Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c193c10a-17b3e37a-81debbf1-ab855ede_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:26.291560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:26.291565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:26.291571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:26.291582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:26.291592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:26.291608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:26.291745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:26.291753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:26.291768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:26.291874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 427 partition: 0 MaxSeqNo: 42 sessionId: src_id|c193c10a-17b3e37a-81debbf1-ab855ede_0
2025-09-30T14:51:26.292267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7c2a132-efe62fcd-d509807a-254002a3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c193c10a-17b3e37a-81debbf1-ab855ede_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:26.294957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c193c10a-17b3e37a-81debbf1-ab855ede_0] Write session: try to update token
2025-09-30T14:51:26.294973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c193c10a-17b3e37a-81debbf1-ab855ede_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:26.303424Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:26.303442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:26.303444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:26.303446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:26.303455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894957985061829:4270]
2025-09-30T14:51:26.303461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894957985061829:4270]
2025-09-30T14:51:26.303466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894957985061829:4270]
2025-09-30T14:51:26.303505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:26.303512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.303515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:26.303517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:26.303523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:26.303530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:26.303667Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:26.310220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 427 sessionId: src_id|c193c10a-17b3e37a-81debbf1-ab855ede_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:26.313021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:26.358733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894958074787920:4849]
2025-09-30T14:51:26.359006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 426, pipe: [1:7555894958074787920:4849]
2025-09-30T14:51:26.409854Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:26.410133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:26.410144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:26.410160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894958074787920:4849], now have 1 active actors on pipe
2025-09-30T14:51:26.410324Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:26.410415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:26.410420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894958074787920:4849]
2025-09-30T14:51:26.410428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:26.410439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:26.410488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 427 reason: error at write: Disconnected sessionId: src_id|c193c10a-17b3e37a-81debbf1-ab855ede_0
2025-09-30T14:51:26.410681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 427 sessionId: src_id|c193c10a-17b3e37a-81debbf1-ab855ede_0 is DEAD
2025-09-30T14:51:26.410806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c193c10a-17b3e37a-81debbf1-ab855ede_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:26.410817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c193c10a-17b3e37a-81debbf1-ab855ede_0] Write session will restart in 0.007594s
2025-09-30T14:51:26.410841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c193c10a-17b3e37a-81debbf1-ab855ede_0] Write session: Do CDS request
2025-09-30T14:51:26.410846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c193c10a-17b3e37a-81debbf1-ab855ede_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:26.419714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c193c10a-17b3e37a-81debbf1-ab855ede_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:26.419819Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:26.419833Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 428
2025-09-30T14:51:26.419998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 428 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:26.420036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 428 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:26.420041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=428 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:26.420045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:26.420581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 428 sessionId:  describe result for acl check
2025-09-30T14:51:26.420620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:26.420627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:26.420630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:26.420636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894958074787995:4995] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:26.421197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894958074787995:4995] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:26.423090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894958074787995:4995] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:26.425534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894958074787995:4995] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:26.425550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894958074787995:4995] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:26.425554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894958074787995:4995] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:26.425562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 428 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:26.426743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:26.429056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:26.429322Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:26.429333Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:26.429344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:26.429407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:26.429445Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894957985062088:4272]
2025-09-30T14:51:26.430112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:26.430418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:26.430478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:26.430839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:26.430901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:26.430908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:26.430909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:26.430910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:26.430911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:26.430913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:26.430914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:26.430915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:26.430916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:26.430917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:26.430919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.430920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.430922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.430923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:26.430924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:26.430930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:26.430942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:26.430946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:26.430950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:26.430955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:26.430959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:26.430964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:26.430968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:26.430972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:26.430989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:26.430993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.430997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.431001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.431005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:26.431009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:26.431016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:26.431025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:26.431030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:26.431039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:26.431044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:26.431055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:26.431060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:26.431065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:26.431072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:26.431078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:26.431087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:26.431093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:26.431103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:26.431109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:26.431118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:26.431124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:26.431129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:26.431134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:26.431139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:26.431144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:26.431149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.431155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.431159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.431165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.431171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.431177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.431181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:26.431187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:26.431194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:26.431199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:26.431262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:26.436501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:26.437583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:26.437600Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:26.437602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:26.437607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:26.437613Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 427 [2:7555894957985062088:4272]
2025-09-30T14:51:26.437627Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:26.437641Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:26.437651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:26.437655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:26.437657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:26.437672Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:26.437683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:26.437690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:26.437752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.437760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.437762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.437765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:26.437768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:26.437828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:26.437836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.437848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.437862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.437879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:26.437901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894958074788170:4995], now have 1 active actors on pipe
2025-09-30T14:51:26.437909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894958074787921:2454], now have 1 active actors on pipe
2025-09-30T14:51:26.437915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894957985062083:4272]
2025-09-30T14:51:26.437918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894957985062083:4272]
2025-09-30T14:51:26.437920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894957985062083:4272]
2025-09-30T14:51:26.437931Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:26.437946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:26.437949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:26.437952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:26.437954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:26.437968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:26.437972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:26.437954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 427
2025-09-30T14:51:26.437959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 427
2025-09-30T14:51:26.438000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894957985062083:4272]
2025-09-30T14:51:26.438014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:26.438020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:26.438034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:26.438042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:26.438082Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92098ff5-d9c38bd7-a4004eae-6968b8df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:26.438094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:26.438097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:26.438100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:26.438112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:26.438125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:26.438142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:26.438281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:26.438292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:26.438306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:26.438387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 428 partition: 0 MaxSeqNo: 42 sessionId: src_id|92098ff5-d9c38bd7-a4004eae-6968b8df_0
2025-09-30T14:51:26.438779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c193c10a-17b3e37a-81debbf1-ab855ede_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|92098ff5-d9c38bd7-a4004eae-6968b8df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:26.441517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92098ff5-d9c38bd7-a4004eae-6968b8df_0] Write session: try to update token
2025-09-30T14:51:26.441532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92098ff5-d9c38bd7-a4004eae-6968b8df_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:26.450137Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:26.450158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:26.450161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:26.450163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:26.450172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894957985062083:4272]
2025-09-30T14:51:26.450176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894957985062083:4272]
2025-09-30T14:51:26.450180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894957985062083:4272]
2025-09-30T14:51:26.450220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:26.450224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:26.450227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.450229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:26.450239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:26.450246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:26.450372Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:26.456082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 428 sessionId: src_id|92098ff5-d9c38bd7-a4004eae-6968b8df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:26.459065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:26.510765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894958074788188:4849]
2025-09-30T14:51:26.511021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 427, pipe: [1:7555894958074788188:4849]
2025-09-30T14:51:26.570763Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:26.571218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:26.571235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:26.571289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894958074788188:4849], now have 1 active actors on pipe
2025-09-30T14:51:26.571477Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:26.571527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:26.571544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:26.571567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894958074788188:4849]
2025-09-30T14:51:26.571587Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:26.571601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 428 reason: error at write: Disconnected sessionId: src_id|92098ff5-d9c38bd7-a4004eae-6968b8df_0
2025-09-30T14:51:26.571784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 428 sessionId: src_id|92098ff5-d9c38bd7-a4004eae-6968b8df_0 is DEAD
2025-09-30T14:51:26.571942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92098ff5-d9c38bd7-a4004eae-6968b8df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:26.571952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92098ff5-d9c38bd7-a4004eae-6968b8df_0] Write session will restart in 0.006023s
2025-09-30T14:51:26.571974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92098ff5-d9c38bd7-a4004eae-6968b8df_0] Write session: Do CDS request
2025-09-30T14:51:26.571982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92098ff5-d9c38bd7-a4004eae-6968b8df_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:26.578796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92098ff5-d9c38bd7-a4004eae-6968b8df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:26.578860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:26.578874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 429
2025-09-30T14:51:26.578999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 429 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:26.579031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 429 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:26.579040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=429 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:26.579044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:26.579497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 429 sessionId:  describe result for acl check
2025-09-30T14:51:26.579531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:26.579537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:26.579539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:26.579544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894958074788245:5000] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:26.580050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894958074788245:5000] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:26.582631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894958074788245:5000] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:26.584879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894958074788245:5000] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:26.584891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894958074788245:5000] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:26.584895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894958074788245:5000] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:26.584902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 429 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:26.585704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:26.587896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:26.588071Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:26.588080Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:26.588088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:26.588140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:26.588178Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894957985062359:4275]
2025-09-30T14:51:26.588780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:26.589051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:26.589094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:26.589414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:26.589475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:26.589481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:26.589482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:26.589483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:26.589485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:26.589486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:26.589487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:26.589488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:26.589489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:26.589490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:26.589491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.589492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.589493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.589494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:26.589495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:26.589501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:26.589511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:26.589516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:26.589520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:26.589525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:26.589529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:26.589533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:26.589538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:26.589542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:26.589546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:26.589551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.589555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.589559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.589563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:26.589568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:26.589575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:26.589583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:26.589593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:26.589599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:26.589603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:26.589612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:26.589621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:26.589626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:26.589635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:26.589645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:26.589649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:26.589653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:26.589658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:26.589664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:26.589669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:26.589675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:26.589682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:26.589687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:26.589692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:26.589701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:26.589705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.589714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.589719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.589727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.589733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.589739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.589747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:26.589752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:26.589757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:26.589763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:26.589806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:26.594946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:26.596198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:26.596214Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:26.596217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:26.596221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:26.596227Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 428 [2:7555894957985062359:4275]
2025-09-30T14:51:26.596244Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:26.596260Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:26.596266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:26.596269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:26.596271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:26.596287Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:26.596299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:26.596306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:26.596360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.596369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.596371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.596375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:26.596378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:26.596439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:26.596447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.596459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.596477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.596500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:26.596522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894958074788453:5000], now have 1 active actors on pipe
2025-09-30T14:51:26.596530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894958074788203:2454], now have 1 active actors on pipe
2025-09-30T14:51:26.596537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894957985062354:4275]
2025-09-30T14:51:26.596544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894957985062354:4275]
2025-09-30T14:51:26.596546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894957985062354:4275]
2025-09-30T14:51:26.596559Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:26.596576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:26.596576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:26.596580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:26.596582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:26.596568Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 428
2025-09-30T14:51:26.596611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:26.596619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:26.596572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 428
2025-09-30T14:51:26.596663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:26.596672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:26.596684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894957985062354:4275]
2025-09-30T14:51:26.596696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:26.596715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:26.596730Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8772338-4a343461-97266ac8-fbeb09fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:26.596741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:26.596747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:26.596754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:26.596764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:26.596777Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:26.596804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:26.596941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:26.596951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:26.596966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:26.597050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 429 partition: 0 MaxSeqNo: 42 sessionId: src_id|e8772338-4a343461-97266ac8-fbeb09fb_0
2025-09-30T14:51:26.597401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92098ff5-d9c38bd7-a4004eae-6968b8df_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e8772338-4a343461-97266ac8-fbeb09fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:26.600205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8772338-4a343461-97266ac8-fbeb09fb_0] Write session: try to update token
2025-09-30T14:51:26.600222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8772338-4a343461-97266ac8-fbeb09fb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:26.608402Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:26.608421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:26.608422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:26.608424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:26.608431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894957985062354:4275]
2025-09-30T14:51:26.608435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894957985062354:4275]
2025-09-30T14:51:26.608439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894957985062354:4275]
2025-09-30T14:51:26.608481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:26.608484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:26.608490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:26.608496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.608499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:26.608504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:26.608627Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:26.614371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 429 sessionId: src_id|e8772338-4a343461-97266ac8-fbeb09fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:26.617090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:26.671553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894958074788469:4849]
2025-09-30T14:51:26.671794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 428, pipe: [1:7555894958074788469:4849]
2025-09-30T14:51:26.714608Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:26.715043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:26.715056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:26.715087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894958074788469:4849], now have 1 active actors on pipe
2025-09-30T14:51:26.715335Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:26.715351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894958074788469:4849]
2025-09-30T14:51:26.715370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:26.715375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:26.715381Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:26.715435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 429 reason: error at write: Disconnected sessionId: src_id|e8772338-4a343461-97266ac8-fbeb09fb_0
2025-09-30T14:51:26.715632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 429 sessionId: src_id|e8772338-4a343461-97266ac8-fbeb09fb_0 is DEAD
2025-09-30T14:51:26.715757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8772338-4a343461-97266ac8-fbeb09fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:26.715767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8772338-4a343461-97266ac8-fbeb09fb_0] Write session will restart in 0.007461s
2025-09-30T14:51:26.715789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8772338-4a343461-97266ac8-fbeb09fb_0] Write session: Do CDS request
2025-09-30T14:51:26.715795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8772338-4a343461-97266ac8-fbeb09fb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:26.724941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8772338-4a343461-97266ac8-fbeb09fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:26.724984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:26.725001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 430
2025-09-30T14:51:26.725269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 430 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:26.725297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 430 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:26.725301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=430 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:26.725304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:26.725748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 430 sessionId:  describe result for acl check
2025-09-30T14:51:26.725781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:26.725787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:26.725789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:26.725795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894958074788533:5004] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:26.726337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894958074788533:5004] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:26.728353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894958074788533:5004] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:26.731288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894958074788533:5004] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:26.731302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894958074788533:5004] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:26.731306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894958074788533:5004] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:26.731314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 430 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:26.732877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:26.735519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:26.735735Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:26.735745Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:26.735755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:26.735806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:26.735857Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894957985062616:4277]
2025-09-30T14:51:26.736388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:26.736672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:26.736708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:26.737134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:26.737202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:26.737210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:26.737211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:26.737211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:26.737212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:26.737213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:26.737213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:26.737214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:26.737214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:26.737215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:26.737216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.737216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.737217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.737218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:26.737219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:26.737222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:26.737228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:26.737231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:26.737233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:26.737236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:26.737238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:26.737242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:26.737246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:26.737250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:26.737254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:26.737258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.737262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.737266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.737270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:26.737274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:26.737282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:26.737291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:26.737297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:26.737302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:26.737308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:26.737312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:26.737331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:26.737335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:26.737337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:26.737341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:26.737346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:26.737351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:26.737355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:26.737361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:26.737365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:26.737370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:26.737377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:26.737381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:26.737386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:26.737391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:26.737396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.737401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.737405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.737411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.737420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.737426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.737430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:26.737435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:26.737444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:26.737448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:26.737473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:26.742834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:26.743677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:26.743694Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:26.743697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:26.743701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:26.743707Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 429 [2:7555894957985062616:4277]
2025-09-30T14:51:26.743724Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:26.743743Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:26.743751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:26.743754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:26.743756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:26.743771Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:26.743779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:26.743785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:26.743846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.743852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.743854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.743858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:26.743861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:26.743921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:26.743928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.743938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.743952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.743976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:26.743996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894958074788470:2454], now have 1 active actors on pipe
2025-09-30T14:51:26.744005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894958074788721:5004], now have 1 active actors on pipe
2025-09-30T14:51:26.744011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894957985062611:4277]
2025-09-30T14:51:26.744013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894957985062611:4277]
2025-09-30T14:51:26.744015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894957985062611:4277]
2025-09-30T14:51:26.744029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:26.744046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:26.744046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:26.744049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:26.744051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:26.744066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:26.744070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:26.744097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894957985062611:4277]
2025-09-30T14:51:26.744084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 429
2025-09-30T14:51:26.744105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:26.744114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:26.744093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 429
2025-09-30T14:51:26.744137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:26.744146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:26.744180Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c26c37b-bf50376b-4585d427-60afcb37_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:26.744190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:26.744195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:26.744201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:26.744210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:26.744223Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:26.744242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:26.744597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:26.744606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:26.744621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:26.744698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 430 partition: 0 MaxSeqNo: 42 sessionId: src_id|c26c37b-bf50376b-4585d427-60afcb37_0
2025-09-30T14:51:26.745086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8772338-4a343461-97266ac8-fbeb09fb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c26c37b-bf50376b-4585d427-60afcb37_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:26.748371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c26c37b-bf50376b-4585d427-60afcb37_0] Write session: try to update token
2025-09-30T14:51:26.748391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c26c37b-bf50376b-4585d427-60afcb37_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:26.755335Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:26.755358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:26.755361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:26.755363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:26.755372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894957985062611:4277]
2025-09-30T14:51:26.755376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894957985062611:4277]
2025-09-30T14:51:26.755380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894957985062611:4277]
2025-09-30T14:51:26.755422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:26.755428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.755431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:26.755439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:26.755445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:26.755449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:26.755560Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:26.763871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 430 sessionId: src_id|c26c37b-bf50376b-4585d427-60afcb37_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:26.766777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:26.815423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894958074788736:4849]
2025-09-30T14:51:26.815648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 429, pipe: [1:7555894958074788736:4849]
2025-09-30T14:51:26.869171Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:26.869630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:26.869648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:26.869667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894958074788736:4849], now have 1 active actors on pipe
2025-09-30T14:51:26.869875Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:26.869920Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:26.869939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:26.869978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894958074788736:4849]
2025-09-30T14:51:26.870019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 430 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c26c37b-bf50376b-4585d427-60afcb37_0
2025-09-30T14:51:26.870231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 430 sessionId: src_id|c26c37b-bf50376b-4585d427-60afcb37_0 is DEAD
2025-09-30T14:51:26.870354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c26c37b-bf50376b-4585d427-60afcb37_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:26.870364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c26c37b-bf50376b-4585d427-60afcb37_0] Write session will restart in 0.008303s
2025-09-30T14:51:26.870385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c26c37b-bf50376b-4585d427-60afcb37_0] Write session: Do CDS request
2025-09-30T14:51:26.870391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c26c37b-bf50376b-4585d427-60afcb37_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:26.879773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c26c37b-bf50376b-4585d427-60afcb37_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:26.879879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:26.879898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 431
2025-09-30T14:51:26.880048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 431 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:26.880088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 431 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:26.880099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=431 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:26.880113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:26.880693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 431 sessionId:  describe result for acl check
2025-09-30T14:51:26.880724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:26.880731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:26.880733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:26.880739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894958074788806:5009] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:26.881245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894958074788806:5009] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:26.883998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894958074788806:5009] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:26.886897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894958074788806:5009] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:26.886911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894958074788806:5009] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:26.886913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894958074788806:5009] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:26.886919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 431 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:26.888658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:26.891085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:26.891322Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:26.891335Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:26.891348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:26.891415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:26.891462Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894957985062887:4280]
2025-09-30T14:51:26.892145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:26.892469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:26.892528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:26.892864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:26.892948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:26.892955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:26.892956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:26.892957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:26.892959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:26.892960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:26.892961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:26.892963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:26.892964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:26.892965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:26.892967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.892968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.892969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.892970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:26.892972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:26.892978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:26.892988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:26.892993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:26.892997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:26.893002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:26.893006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:26.893010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:26.893015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:26.893019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:26.893024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:26.893028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.893033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.893036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.893041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:26.893044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:26.893052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:26.893060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:26.893066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:26.893072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:26.893076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:26.893081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:26.893085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:26.893097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:26.893102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:26.893109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:26.893113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:26.893119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:26.893128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:26.893134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:26.893145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:26.893150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:26.893159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:26.893166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:26.893175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:26.893181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:26.893191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.893197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.893201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.893213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.893219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.893229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.893234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:26.893243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:26.893248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:26.893254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:26.893300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:26.898761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:26.900383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:26.900404Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:26.900406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:26.900410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:26.900418Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 430 [2:7555894957985062887:4280]
2025-09-30T14:51:26.900435Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:26.900452Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:26.900456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:26.900459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:26.900462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:26.900478Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:26.900487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:26.900494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:26.900560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.900571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.900573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.900577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:26.900580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:26.900653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:26.900661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.900678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:26.900695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:26.900717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:26.900741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894958074789001:5009], now have 1 active actors on pipe
2025-09-30T14:51:26.900749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894958074788749:2454], now have 1 active actors on pipe
2025-09-30T14:51:26.900757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894957985062882:4280]
2025-09-30T14:51:26.900765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894957985062882:4280]
2025-09-30T14:51:26.900768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894957985062882:4280]
2025-09-30T14:51:26.900780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:26.900790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:26.900794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:26.900795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:26.900799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:26.900816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:26.900825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:26.900801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 430
2025-09-30T14:51:26.900802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 430
2025-09-30T14:51:26.900877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:26.900888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:26.900901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894957985062882:4280]
2025-09-30T14:51:26.900919Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:26.900939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:26.900953Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1905445f-4ad3a0eb-aeb2fba2-6eedf55c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:26.900961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:26.900964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:26.900967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:26.900980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:26.900990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:26.901018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:26.901181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:26.901193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:26.901210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:26.901299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 431 partition: 0 MaxSeqNo: 42 sessionId: src_id|1905445f-4ad3a0eb-aeb2fba2-6eedf55c_0
2025-09-30T14:51:26.901709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c26c37b-bf50376b-4585d427-60afcb37_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1905445f-4ad3a0eb-aeb2fba2-6eedf55c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:26.904567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1905445f-4ad3a0eb-aeb2fba2-6eedf55c_0] Write session: try to update token
2025-09-30T14:51:26.904582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1905445f-4ad3a0eb-aeb2fba2-6eedf55c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:26.912734Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:26.912758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:26.912760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:26.912762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:26.912772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894957985062882:4280]
2025-09-30T14:51:26.912776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894957985062882:4280]
2025-09-30T14:51:26.912781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894957985062882:4280]
2025-09-30T14:51:26.912824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:26.912826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:26.912834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:26.912837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:26.912840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:26.912844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:26.912990Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:26.920055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 431 sessionId: src_id|1905445f-4ad3a0eb-aeb2fba2-6eedf55c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:26.922654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:26.970039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894958074789024:4849]
2025-09-30T14:51:26.970252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 430, pipe: [1:7555894958074789024:4849]
2025-09-30T14:51:27.030620Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:27.031030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:27.031043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:27.031058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894958074789024:4849], now have 1 active actors on pipe
2025-09-30T14:51:27.031189Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:27.031302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:27.031355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:27.031442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 431 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1905445f-4ad3a0eb-aeb2fba2-6eedf55c_0
2025-09-30T14:51:27.031638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 431 sessionId: src_id|1905445f-4ad3a0eb-aeb2fba2-6eedf55c_0 is DEAD
2025-09-30T14:51:27.031788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1905445f-4ad3a0eb-aeb2fba2-6eedf55c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:27.031795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1905445f-4ad3a0eb-aeb2fba2-6eedf55c_0] Write session will restart in 0.006002s
2025-09-30T14:51:27.031802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894958074789024:4849]
2025-09-30T14:51:27.031825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1905445f-4ad3a0eb-aeb2fba2-6eedf55c_0] Write session: Do CDS request
2025-09-30T14:51:27.031830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1905445f-4ad3a0eb-aeb2fba2-6eedf55c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:27.038773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1905445f-4ad3a0eb-aeb2fba2-6eedf55c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:27.038851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:27.038866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 432
2025-09-30T14:51:27.039034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 432 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:27.039094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 432 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:27.039105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=432 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:27.039109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:27.039871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 432 sessionId:  describe result for acl check
2025-09-30T14:51:27.039907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:27.039914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:27.039916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:27.039921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894962369756359:5021] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:27.040589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894962369756359:5021] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:27.044000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894962369756359:5021] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:27.046566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894962369756359:5021] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:27.046580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894962369756359:5021] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:27.046583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894962369756359:5021] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:27.046591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 432 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:27.049944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:27.052451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:27.052636Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:27.052645Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:27.052655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:27.052707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:27.052746Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894962280030482:4289]
2025-09-30T14:51:27.053386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:27.053643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:27.053679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:27.053904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:27.053947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:27.053954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:27.053955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:27.053956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:27.053957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:27.053959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:27.053960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:27.053961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:27.053962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:27.053962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:27.053963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.053964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.053966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.053967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:27.053968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:27.053973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:27.053981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:27.053983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:27.053986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:27.053988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:27.053990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:27.053993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:27.053995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:27.053998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:27.054000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:27.054002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.054005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.054007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.054010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:27.054012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:27.054017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:27.054022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:27.054026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:27.054030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:27.054032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:27.054035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:27.054040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:27.054050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:27.054058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:27.054064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:27.054073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:27.054078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:27.054084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:27.054087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:27.054090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:27.054093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:27.054099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:27.054102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:27.054104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:27.054112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:27.054116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.054123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.054125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.054128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.054130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.054133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.054136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:27.054142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:27.054144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:27.054148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:27.054170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:27.059515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:27.060624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:27.060638Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:27.060640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:27.060644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:27.060651Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 431 [2:7555894962280030482:4289]
2025-09-30T14:51:27.060664Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:27.060684Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:27.060687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:27.060690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:27.060693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:27.060707Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:27.060718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:27.060724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:27.060786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.060793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.060795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.060798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:27.060801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:27.060863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:27.060870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.060882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.060899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.060917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:27.060938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894962369756545:5021], now have 1 active actors on pipe
2025-09-30T14:51:27.060946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894962369756335:2454], now have 1 active actors on pipe
2025-09-30T14:51:27.060952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894962280030477:4289]
2025-09-30T14:51:27.060959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894962280030477:4289]
2025-09-30T14:51:27.060961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894962280030477:4289]
2025-09-30T14:51:27.060972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:27.060985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:27.060990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:27.060993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:27.060995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:27.061006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:27.061010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:27.061034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894962280030477:4289]
2025-09-30T14:51:27.061036Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:27.061053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:27.061035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 431
2025-09-30T14:51:27.061183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 431
2025-09-30T14:51:27.061230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:27.061239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:27.061259Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ea3d0f6-40848e8a-bae75b5d-325361ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:27.061264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:27.061267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:27.061268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:27.061275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:27.061282Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:27.061293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:27.061448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:27.061457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:27.061470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:27.061553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 432 partition: 0 MaxSeqNo: 42 sessionId: src_id|8ea3d0f6-40848e8a-bae75b5d-325361ea_0
2025-09-30T14:51:27.061901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1905445f-4ad3a0eb-aeb2fba2-6eedf55c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8ea3d0f6-40848e8a-bae75b5d-325361ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:27.064592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ea3d0f6-40848e8a-bae75b5d-325361ea_0] Write session: try to update token
2025-09-30T14:51:27.064609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ea3d0f6-40848e8a-bae75b5d-325361ea_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:27.078043Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:27.078064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:27.078073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894962280030477:4289]
2025-09-30T14:51:27.078115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:27.078132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:27.078283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:27.078719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:27.078798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 432 sessionId: src_id|8ea3d0f6-40848e8a-bae75b5d-325361ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:27.078862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:27.079065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:27.079351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:27.079407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:27.081495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:27.081767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:27.081783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:27.081807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:27.081886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:27.083885Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:27.083905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:27.083907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:27.083909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:27.083919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894962280030477:4289]
2025-09-30T14:51:27.083924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894962280030477:4289]
2025-09-30T14:51:27.083929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894962280030477:4289]
2025-09-30T14:51:27.083969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:27.083982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.083984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:27.083988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:27.083994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:27.083998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:27.084174Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:27.131850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894962369756612:4849]
2025-09-30T14:51:27.132148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 431, pipe: [1:7555894962369756612:4849]
2025-09-30T14:51:27.187899Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:27.194871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:27.194900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:27.195064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:27.195125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:27.195189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:27.195269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:27.195315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:27.195326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:27.195391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:27.195447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:27.195505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:27.195572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:27.195622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:27.195631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:27.195701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:27.195758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:27.195821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:27.195881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:27.195925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:27.195933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:27.195998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:27.196069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:27.196146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:27.196207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:27.196251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:27.196259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:27.196326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:27.196385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:27.196444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:27.196513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:27.196557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:27.196565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:27.196629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:27.196688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:27.196753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:27.196817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:27.196877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:27.196885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:27.196959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:27.197023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:27.197089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:27.197158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:27.197201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:27.197209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:27.197271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:27.197325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:27.197381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:27.197443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:27.197494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:27.197502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:27.197562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:27.197616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:27.197673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:27.197731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:27.197771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:27.197777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:27.197837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:27.197892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:27.197953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:27.198011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:27.198054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:27.198059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:27.198100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894962369756612:4849], now have 1 active actors on pipe
2025-09-30T14:51:27.198362Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:27.198363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:27.198366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:27.198406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 432 reason: error at write: Disconnected sessionId: src_id|8ea3d0f6-40848e8a-bae75b5d-325361ea_0
2025-09-30T14:51:27.198425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894962369756612:4849]
2025-09-30T14:51:27.198601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 432 sessionId: src_id|8ea3d0f6-40848e8a-bae75b5d-325361ea_0 is DEAD
2025-09-30T14:51:27.198730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ea3d0f6-40848e8a-bae75b5d-325361ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:27.198740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ea3d0f6-40848e8a-bae75b5d-325361ea_0] Write session will restart in 0.006568s
2025-09-30T14:51:27.198764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ea3d0f6-40848e8a-bae75b5d-325361ea_0] Write session: Do CDS request
2025-09-30T14:51:27.198769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ea3d0f6-40848e8a-bae75b5d-325361ea_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:27.199085Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:27.206744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ea3d0f6-40848e8a-bae75b5d-325361ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:27.206896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:27.206909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 433
2025-09-30T14:51:27.207048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 433 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:27.207080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 433 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:27.207090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=433 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:27.207096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:27.207493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 433 sessionId:  describe result for acl check
2025-09-30T14:51:27.207523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:27.207525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:27.207526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:27.207530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894962369756638:5025] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:27.207982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894962369756638:5025] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:27.211190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894962369756638:5025] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:27.214499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894962369756638:5025] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:27.214520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894962369756638:5025] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:27.214523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894962369756638:5025] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:27.214530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 433 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:27.216813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:27.218987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:27.219235Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:27.219268Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:27.219280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:27.219336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:27.219378Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894962280030743:4297]
2025-09-30T14:51:27.220036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:27.220303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:27.220353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:27.220648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:27.220717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:27.220721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:27.220722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:27.220724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:27.220725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:27.220726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:27.220727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:27.220728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:27.220729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:27.220730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:27.220731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.220732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.220733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.220735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:27.220736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:27.220741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:27.220751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:27.220755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:27.220760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:27.220764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:27.220768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:27.220772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:27.220776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:27.220780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:27.220784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:27.220788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.220792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.220796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.220800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:27.220804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:27.220812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:27.220820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:27.220826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:27.220832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:27.220841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:27.220847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:27.220855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:27.220861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:27.220870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:27.220889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:27.220893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:27.220898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:27.220903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:27.220909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:27.220913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:27.220918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:27.220924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:27.220929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:27.220934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:27.220941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:27.220949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.220955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.220963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.220968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.220977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.220987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.220995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:27.221000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:27.221009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:27.221019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:27.221050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:27.226248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:27.227299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:27.227310Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:27.227312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:27.227314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:27.227319Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 432 [2:7555894962280030743:4297]
2025-09-30T14:51:27.227330Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:27.227341Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:27.227343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:27.227345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:27.227346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:27.227357Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:27.227361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:27.227366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:27.227405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.227411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.227412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.227415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:27.227417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:27.227463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:27.227469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.227476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.227486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.227499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:27.227513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894962280030738:4297]
2025-09-30T14:51:27.227518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894962280030738:4297]
2025-09-30T14:51:27.227520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894962280030738:4297]
2025-09-30T14:51:27.227528Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:27.227539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894962369756843:5025], now have 1 active actors on pipe
2025-09-30T14:51:27.227539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:27.227543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:27.227545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:27.227547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:27.227555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:27.227557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:27.227561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894962369756614:2454], now have 1 active actors on pipe
2025-09-30T14:51:27.227584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894962280030738:4297]
2025-09-30T14:51:27.227595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:27.227603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:27.227627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 432
2025-09-30T14:51:27.227673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:27.227628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 432
2025-09-30T14:51:27.227679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:27.227696Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22ea9d73-94d1fd74-138a35ea-a5a252bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:27.227705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:27.227707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:27.227708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:27.227714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:27.227721Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:27.227733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:27.227873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:27.227885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:27.227910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:27.228099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 433 partition: 0 MaxSeqNo: 42 sessionId: src_id|22ea9d73-94d1fd74-138a35ea-a5a252bc_0
2025-09-30T14:51:27.228481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ea3d0f6-40848e8a-bae75b5d-325361ea_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|22ea9d73-94d1fd74-138a35ea-a5a252bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:27.231345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22ea9d73-94d1fd74-138a35ea-a5a252bc_0] Write session: try to update token
2025-09-30T14:51:27.231363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22ea9d73-94d1fd74-138a35ea-a5a252bc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:27.239202Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:27.239220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:27.239222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:27.239225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:27.239234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894962280030738:4297]
2025-09-30T14:51:27.239239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894962280030738:4297]
2025-09-30T14:51:27.239264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894962280030738:4297]
2025-09-30T14:51:27.239305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:27.239317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.239319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:27.239372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:27.239393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:27.239414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:27.239455Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:27.246237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 433 sessionId: src_id|22ea9d73-94d1fd74-138a35ea-a5a252bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:27.248759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:27.298751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894962369756883:4849]
2025-09-30T14:51:27.299019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 432, pipe: [1:7555894962369756883:4849]
2025-09-30T14:51:27.351144Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:27.351673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:27.351691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:27.351711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894962369756883:4849], now have 1 active actors on pipe
2025-09-30T14:51:27.351959Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:27.351957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:27.351974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:27.352002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894962369756883:4849]
2025-09-30T14:51:27.352024Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:27.352030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 433 reason: error at write: Disconnected sessionId: src_id|22ea9d73-94d1fd74-138a35ea-a5a252bc_0
2025-09-30T14:51:27.352239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 433 sessionId: src_id|22ea9d73-94d1fd74-138a35ea-a5a252bc_0 is DEAD
2025-09-30T14:51:27.352414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22ea9d73-94d1fd74-138a35ea-a5a252bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:27.352426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22ea9d73-94d1fd74-138a35ea-a5a252bc_0] Write session will restart in 0.008710s
2025-09-30T14:51:27.352449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22ea9d73-94d1fd74-138a35ea-a5a252bc_0] Write session: Do CDS request
2025-09-30T14:51:27.352454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22ea9d73-94d1fd74-138a35ea-a5a252bc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:27.362747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22ea9d73-94d1fd74-138a35ea-a5a252bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:27.362864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:27.362879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 434
2025-09-30T14:51:27.363017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 434 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:27.363050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 434 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:27.363060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=434 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:27.363064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:27.363588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 434 sessionId:  describe result for acl check
2025-09-30T14:51:27.363627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:27.363633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:27.363635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:27.363640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894962369756963:5029] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:27.364181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894962369756963:5029] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:27.366549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894962369756963:5029] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:27.369099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894962369756963:5029] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:27.369108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894962369756963:5029] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:27.369116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894962369756963:5029] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:27.369123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 434 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:27.370575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:27.373248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:27.373443Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:27.373454Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:27.373464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:27.373512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:27.373553Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894962280031005:4299]
2025-09-30T14:51:27.374180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:27.374467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:27.374522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:27.374837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:27.374902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:27.374909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:27.374911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:27.374912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:27.374913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:27.374914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:27.374915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:27.374916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:27.374918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:27.374919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:27.374920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.374921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.374923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.374924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:27.374925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:27.374930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:27.374940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:27.374944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:27.374948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:27.374952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:27.374956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:27.374960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:27.374964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:27.374968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:27.374973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:27.374976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.374980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.374984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.374987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:27.374991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:27.374999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:27.375006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:27.375013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:27.375024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:27.375033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:27.375039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:27.375049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:27.375059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:27.375068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:27.375077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:27.375086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:27.375096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:27.375100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:27.375105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:27.375115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:27.375125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:27.375135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:27.375145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:27.375154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:27.375160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:27.375169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.375179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.375187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.375192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.375200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.375206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.375214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:27.375220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:27.375224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:27.375229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:27.375289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:27.380576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:27.381432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:27.381447Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:27.381450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:27.381454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:27.381459Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 433 [2:7555894962280031005:4299]
2025-09-30T14:51:27.381473Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:27.381492Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:27.381494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:27.381497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:27.381499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:27.381512Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:27.381522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:27.381531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:27.381572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.381579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.381581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.381585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:27.381588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:27.381648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:27.381657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.381668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.381679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.381695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:27.381714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894962369757140:5029], now have 1 active actors on pipe
2025-09-30T14:51:27.381723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894962369756885:2454], now have 1 active actors on pipe
2025-09-30T14:51:27.381729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894962280031000:4299]
2025-09-30T14:51:27.381731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894962280031000:4299]
2025-09-30T14:51:27.381734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894962280031000:4299]
2025-09-30T14:51:27.381746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:27.381762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:27.381767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:27.381771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:27.381774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:27.381781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:27.381784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:27.381771Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 433
2025-09-30T14:51:27.381794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 433
2025-09-30T14:51:27.381807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894962280031000:4299]
2025-09-30T14:51:27.381816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:27.381826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:27.381844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:27.381851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:27.381875Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3ee5ed8-1d004eb9-81207895-c172ba66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:27.381884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:27.381890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:27.381891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:27.381898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:27.381908Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:27.381923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:27.382070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:27.382075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:27.382085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:27.382158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 434 partition: 0 MaxSeqNo: 42 sessionId: src_id|c3ee5ed8-1d004eb9-81207895-c172ba66_0
2025-09-30T14:51:27.382518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22ea9d73-94d1fd74-138a35ea-a5a252bc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c3ee5ed8-1d004eb9-81207895-c172ba66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:27.385037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3ee5ed8-1d004eb9-81207895-c172ba66_0] Write session: try to update token
2025-09-30T14:51:27.385050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3ee5ed8-1d004eb9-81207895-c172ba66_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:27.393714Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:27.393732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:27.393735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:27.393737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:27.393746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894962280031000:4299]
2025-09-30T14:51:27.393751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894962280031000:4299]
2025-09-30T14:51:27.393755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894962280031000:4299]
2025-09-30T14:51:27.393795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:27.393796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:27.393801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.393802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:27.393804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:27.393805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:27.393937Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:27.398738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 434 sessionId: src_id|c3ee5ed8-1d004eb9-81207895-c172ba66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:27.401451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:27.452322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894962369757154:4849]
2025-09-30T14:51:27.452564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 433, pipe: [1:7555894962369757154:4849]
2025-09-30T14:51:27.507405Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:27.508080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:27.508100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:27.508137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894962369757154:4849], now have 1 active actors on pipe
2025-09-30T14:51:27.508319Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:27.508419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:27.508420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:27.508457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894962369757154:4849]
2025-09-30T14:51:27.508500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 434 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c3ee5ed8-1d004eb9-81207895-c172ba66_0
2025-09-30T14:51:27.508694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 434 sessionId: src_id|c3ee5ed8-1d004eb9-81207895-c172ba66_0 is DEAD
2025-09-30T14:51:27.508960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3ee5ed8-1d004eb9-81207895-c172ba66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:27.508971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3ee5ed8-1d004eb9-81207895-c172ba66_0] Write session will restart in 0.006695s
2025-09-30T14:51:27.508993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3ee5ed8-1d004eb9-81207895-c172ba66_0] Write session: Do CDS request
2025-09-30T14:51:27.509008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3ee5ed8-1d004eb9-81207895-c172ba66_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:27.516743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3ee5ed8-1d004eb9-81207895-c172ba66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:27.516878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:27.516892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 435
2025-09-30T14:51:27.517052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 435 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:27.517093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 435 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:27.517104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=435 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:27.517108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:27.517586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 435 sessionId:  describe result for acl check
2025-09-30T14:51:27.517624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:27.517626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:27.517628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:27.517633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894962369757181:5034] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:27.518167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894962369757181:5034] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:27.521172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894962369757181:5034] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:27.524603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894962369757181:5034] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:27.524622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894962369757181:5034] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:27.524625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894962369757181:5034] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:27.524635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 435 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:27.528807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:27.531732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:27.531942Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:27.531951Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:27.531961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:27.532010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:27.532053Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894962280031270:4302]
2025-09-30T14:51:27.532714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:27.532996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:27.533027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:27.533408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:27.533469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:27.533475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:27.533477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:27.533478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:27.533479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:27.533480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:27.533481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:27.533482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:27.533483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:27.533485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:27.533486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.533487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.533488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.533489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:27.533490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:27.533495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:27.533505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:27.533509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:27.533513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:27.533518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:27.533522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:27.533526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:27.533530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:27.533534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:27.533539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:27.533543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.533547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.533551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.533555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:27.533559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:27.533567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:27.533575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:27.533580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:27.533586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:27.533596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:27.533602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:27.533608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:27.533612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:27.533615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:27.533617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:27.533620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:27.533623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:27.533626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:27.533629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:27.533631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:27.533634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:27.533637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:27.533639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:27.533642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:27.533644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:27.533647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.533650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.533652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.533655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.533658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.533662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.533665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:27.533668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:27.533670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:27.533673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:27.533715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:27.539235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:27.540142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:27.540161Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:27.540164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:27.540168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:27.540174Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 434 [2:7555894962280031270:4302]
2025-09-30T14:51:27.540192Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:27.540207Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:27.540216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:27.540219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:27.540222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:27.540239Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:27.540246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:27.540253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:27.540313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.540321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.540323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.540327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:27.540330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:27.540396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:27.540405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.540418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.540436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.540452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:27.540472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894962369757334:5034], now have 1 active actors on pipe
2025-09-30T14:51:27.540481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894962369757158:2454], now have 1 active actors on pipe
2025-09-30T14:51:27.540487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894962280031265:4302]
2025-09-30T14:51:27.540490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894962280031265:4302]
2025-09-30T14:51:27.540492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894962280031265:4302]
2025-09-30T14:51:27.540504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:27.540517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:27.540522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:27.540527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:27.540530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:27.540538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:27.540541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:27.540570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894962280031265:4302]
2025-09-30T14:51:27.540586Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:27.540568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 434
2025-09-30T14:51:27.540595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:27.540585Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 434
2025-09-30T14:51:27.540624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:27.540633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:27.540658Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d289053-c33ff14d-4b642ee1-e394c942_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:27.540669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:27.540673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:27.540678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:27.540688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:27.540696Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:27.540714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:27.540878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:27.540886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:27.540898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:27.541019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 435 partition: 0 MaxSeqNo: 42 sessionId: src_id|4d289053-c33ff14d-4b642ee1-e394c942_0
2025-09-30T14:51:27.541403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3ee5ed8-1d004eb9-81207895-c172ba66_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4d289053-c33ff14d-4b642ee1-e394c942_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:27.544235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d289053-c33ff14d-4b642ee1-e394c942_0] Write session: try to update token
2025-09-30T14:51:27.544252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d289053-c33ff14d-4b642ee1-e394c942_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:27.553287Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:27.553310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:27.553320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894962280031265:4302]
2025-09-30T14:51:27.553364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:27.553367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:27.553545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:27.553705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:27.553869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:27.554014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:27.554216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:27.554263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:27.558973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 435 sessionId: src_id|4d289053-c33ff14d-4b642ee1-e394c942_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:27.561722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:27.561929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:27.561952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:27.561998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:27.562108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:27.563192Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:27.563209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:27.563211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:27.563214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:27.563223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894962280031265:4302]
2025-09-30T14:51:27.563230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894962280031265:4302]
2025-09-30T14:51:27.563236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894962280031265:4302]
2025-09-30T14:51:27.563292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:27.563303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.563306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:27.563345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:27.563359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:27.563363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:27.563442Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:27.608514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894962369757428:4849]
2025-09-30T14:51:27.608754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 434, pipe: [1:7555894962369757428:4849]
2025-09-30T14:51:27.685387Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:27.693883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:27.693915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:27.694091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:27.694161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:27.694228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:27.694299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:27.694348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:27.694358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:27.694439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:27.694504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:27.694584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:27.694653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:27.694701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:27.694709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:27.694779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:27.694844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:27.694917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:27.694985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:27.695033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:27.695041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:27.695111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:27.695178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:27.695258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:27.695324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:27.695368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:27.695380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:27.695448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:27.695512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:27.695579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:27.695644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:27.695692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:27.695699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:27.695768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:27.695831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:27.695899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:27.695965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:27.696013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:27.696020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:27.696087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:27.696152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:27.696221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:27.696287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:27.696332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:27.696340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:27.696408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:27.696469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:27.696533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:27.696599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:27.696665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:27.696673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:27.696745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:27.696804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:27.696864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:27.696931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:27.696994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:27.697002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:27.697072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:27.697133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:27.697195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:27.697257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:27.697302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:27.697310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:27.697376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894962369757428:4849], now have 1 active actors on pipe
2025-09-30T14:51:27.697624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894962369757428:4849]
2025-09-30T14:51:27.697637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:27.697641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:27.697671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 435 reason: error at write: Disconnected sessionId: src_id|4d289053-c33ff14d-4b642ee1-e394c942_0
2025-09-30T14:51:27.697913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 435 sessionId: src_id|4d289053-c33ff14d-4b642ee1-e394c942_0 is DEAD
2025-09-30T14:51:27.698038Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:27.698036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d289053-c33ff14d-4b642ee1-e394c942_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:27.698058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d289053-c33ff14d-4b642ee1-e394c942_0] Write session will restart in 0.007544s
2025-09-30T14:51:27.698083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d289053-c33ff14d-4b642ee1-e394c942_0] Write session: Do CDS request
2025-09-30T14:51:27.698087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d289053-c33ff14d-4b642ee1-e394c942_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:27.698450Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:27.706752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d289053-c33ff14d-4b642ee1-e394c942_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:27.706805Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:27.706817Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 436
2025-09-30T14:51:27.706985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 436 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:27.707025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 436 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:27.707036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=436 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:27.707039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:27.707607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 436 sessionId:  describe result for acl check
2025-09-30T14:51:27.707639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:27.707646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:27.707648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:27.707652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894962369757494:5038] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:27.708091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894962369757494:5038] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:27.711211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894962369757494:5038] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:27.713557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894962369757494:5038] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:27.713570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894962369757494:5038] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:27.713573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894962369757494:5038] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:27.713580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 436 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:27.718261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:27.718799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:27.719001Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:27.719011Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:27.719022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:27.719084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:27.719123Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894962280031534:4304]
2025-09-30T14:51:27.719816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:27.720242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:27.720296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:27.720640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:27.720707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:27.720714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:27.720715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:27.720716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:27.720717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:27.720719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:27.720720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:27.720721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:27.720722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:27.720723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:27.720724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.720725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.720726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.720728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:27.720729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:27.720735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:27.720747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:27.720751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:27.720755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:27.720759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:27.720764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:27.720768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:27.720772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:27.720776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:27.720780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:27.720784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.720788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.720792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.720796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:27.720800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:27.720808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:27.720816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:27.720822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:27.720828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:27.720833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:27.720838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:27.720842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:27.720861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:27.720870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:27.720875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:27.720878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:27.720889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:27.720893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:27.720905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:27.720910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:27.720915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:27.720920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:27.720927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:27.720935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:27.720941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:27.720946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.720951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.720961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.720967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.720972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.720978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.720988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:27.720993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:27.720998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:27.721003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:27.721047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:27.726162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:27.727034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:27.727052Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:27.727055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:27.727059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:27.727065Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 435 [2:7555894962280031534:4304]
2025-09-30T14:51:27.727081Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:27.727098Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:27.727105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:27.727108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:27.727111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:27.727125Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:27.727137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:27.727148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:27.727208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.727215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.727217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.727221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:27.727224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:27.727304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:27.727311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.727324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.727336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.727355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:27.727377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894962369757687:5038], now have 1 active actors on pipe
2025-09-30T14:51:27.727385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894962369757431:2454], now have 1 active actors on pipe
2025-09-30T14:51:27.727391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894962280031529:4304]
2025-09-30T14:51:27.727393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894962280031529:4304]
2025-09-30T14:51:27.727395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894962280031529:4304]
2025-09-30T14:51:27.727409Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:27.727427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:27.727428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:27.727432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:27.727434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:27.727441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 435
2025-09-30T14:51:27.727441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:27.727449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 435
2025-09-30T14:51:27.727445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:27.727474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894962280031529:4304]
2025-09-30T14:51:27.727477Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:27.727479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:27.727493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:27.727497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:27.727544Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c834b102-ffcf93c2-b7770099-d5ad95ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:27.727558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:27.727562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:27.727564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:27.727573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:27.727581Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:27.727601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:27.727817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:27.727827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:27.727844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:27.727926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 436 partition: 0 MaxSeqNo: 42 sessionId: src_id|c834b102-ffcf93c2-b7770099-d5ad95ce_0
2025-09-30T14:51:27.728302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d289053-c33ff14d-4b642ee1-e394c942_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c834b102-ffcf93c2-b7770099-d5ad95ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:27.731163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c834b102-ffcf93c2-b7770099-d5ad95ce_0] Write session: try to update token
2025-09-30T14:51:27.731185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c834b102-ffcf93c2-b7770099-d5ad95ce_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:27.739595Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:27.739619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:27.739622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:27.739624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:27.739633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894962280031529:4304]
2025-09-30T14:51:27.739638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894962280031529:4304]
2025-09-30T14:51:27.739643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894962280031529:4304]
2025-09-30T14:51:27.739684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:27.739689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:27.739691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.739695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:27.739694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:27.739697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:27.739835Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:27.745660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 436 sessionId: src_id|c834b102-ffcf93c2-b7770099-d5ad95ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:27.748172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:27.797967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894962369757701:4849]
2025-09-30T14:51:27.798218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 435, pipe: [1:7555894962369757701:4849]
2025-09-30T14:51:27.855605Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:27.856176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:27.856188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:27.856221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894962369757701:4849], now have 1 active actors on pipe
2025-09-30T14:51:27.856376Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:27.856434Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:27.856472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894962369757701:4849]
2025-09-30T14:51:27.856477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:27.856536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 436 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c834b102-ffcf93c2-b7770099-d5ad95ce_0
2025-09-30T14:51:27.856713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 436 sessionId: src_id|c834b102-ffcf93c2-b7770099-d5ad95ce_0 is DEAD
2025-09-30T14:51:27.856873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c834b102-ffcf93c2-b7770099-d5ad95ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:27.856884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c834b102-ffcf93c2-b7770099-d5ad95ce_0] Write session will restart in 0.005725s
2025-09-30T14:51:27.856906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c834b102-ffcf93c2-b7770099-d5ad95ce_0] Write session: Do CDS request
2025-09-30T14:51:27.856911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c834b102-ffcf93c2-b7770099-d5ad95ce_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:27.863703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c834b102-ffcf93c2-b7770099-d5ad95ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:27.863769Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:27.863783Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 437
2025-09-30T14:51:27.863901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 437 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:27.863947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 437 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:27.863956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=437 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:27.863960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:27.864502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 437 sessionId:  describe result for acl check
2025-09-30T14:51:27.864539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:27.864546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:27.864549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:27.864554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894962369757758:5043] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:27.865109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894962369757758:5043] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:27.867975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894962369757758:5043] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:27.870455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894962369757758:5043] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:27.870469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894962369757758:5043] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:27.870472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894962369757758:5043] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:27.870479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 437 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:27.872439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:27.874936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:27.875130Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:27.875139Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:27.875150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:27.875195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:27.875234Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894962280031811:4307]
2025-09-30T14:51:27.875907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:27.876177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:27.876218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:27.876532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:27.876586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:27.876592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:27.876593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:27.876594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:27.876595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:27.876596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:27.876597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:27.876599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:27.876600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:27.876601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:27.876602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.876604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.876605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.876606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:27.876607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:27.876612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:27.876622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:27.876627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:27.876631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:27.876635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:27.876639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:27.876643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:27.876647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:27.876651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:27.876660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:27.876664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.876672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.876676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.876685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:27.876689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:27.876696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:27.876707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:27.876718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:27.876723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:27.876732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:27.876738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:27.876742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:27.876748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:27.876756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:27.876767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:27.876772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:27.876777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:27.876782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:27.876794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:27.876798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:27.876802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:27.876807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:27.876813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:27.876821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:27.876827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:27.876836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.876841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.876845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.876854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.876859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.876869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.876873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:27.876878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:27.876887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:27.876892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:27.876941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:27.882315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:27.883185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:27.883201Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:27.883204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:27.883208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:27.883214Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 436 [2:7555894962280031811:4307]
2025-09-30T14:51:27.883231Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:27.888067Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:27.888090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:27.888096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:27.888098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:27.888121Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:27.888130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:27.888140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:27.888236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.888246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.888249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.888254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:27.888261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:27.888362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:27.888372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.888393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:27.888410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:27.888436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:27.888459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894962369757958:5043], now have 1 active actors on pipe
2025-09-30T14:51:27.888470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894962369757715:2454], now have 1 active actors on pipe
2025-09-30T14:51:27.888479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894962280031806:4307]
2025-09-30T14:51:27.888481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894962280031806:4307]
2025-09-30T14:51:27.888488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894962280031806:4307]
2025-09-30T14:51:27.888506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:27.888531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:27.888536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:27.888540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:27.888543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:27.888545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:27.888513Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 436
2025-09-30T14:51:27.888566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 436
2025-09-30T14:51:27.888550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:27.888607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894962280031806:4307]
2025-09-30T14:51:27.888624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:27.888628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:27.888648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:27.888660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:27.888716Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a97ff5c-6cf35364-c14b0e6-46cd645a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:27.888733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:27.888740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:27.888742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:27.888781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:27.888798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:27.888828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:27.888980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:27.888988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:27.889004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:27.889106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 437 partition: 0 MaxSeqNo: 42 sessionId: src_id|6a97ff5c-6cf35364-c14b0e6-46cd645a_0
2025-09-30T14:51:27.889614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c834b102-ffcf93c2-b7770099-d5ad95ce_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6a97ff5c-6cf35364-c14b0e6-46cd645a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:27.894619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a97ff5c-6cf35364-c14b0e6-46cd645a_0] Write session: try to update token
2025-09-30T14:51:27.894643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a97ff5c-6cf35364-c14b0e6-46cd645a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:27.903135Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:27.903151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:27.903153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:27.903157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:27.903166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894962280031806:4307]
2025-09-30T14:51:27.903171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894962280031806:4307]
2025-09-30T14:51:27.903179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894962280031806:4307]
2025-09-30T14:51:27.903212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:27.903217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:27.903220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:27.903223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:27.903224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:27.903228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:27.903376Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:27.911962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 437 sessionId: src_id|6a97ff5c-6cf35364-c14b0e6-46cd645a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:27.914427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:27.956665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894962369757987:4849]
2025-09-30T14:51:27.956897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 436, pipe: [1:7555894962369757987:4849]
2025-09-30T14:51:28.007486Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:28.007828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:28.007840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:28.007856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894962369757987:4849], now have 1 active actors on pipe
2025-09-30T14:51:28.008069Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:28.008114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:28.008127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:28.008142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894962369757987:4849]
2025-09-30T14:51:28.008162Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:28.008197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 437 reason: error at write: Disconnected sessionId: src_id|6a97ff5c-6cf35364-c14b0e6-46cd645a_0
2025-09-30T14:51:28.008371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 437 sessionId: src_id|6a97ff5c-6cf35364-c14b0e6-46cd645a_0 is DEAD
2025-09-30T14:51:28.008535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a97ff5c-6cf35364-c14b0e6-46cd645a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:28.008547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a97ff5c-6cf35364-c14b0e6-46cd645a_0] Write session will restart in 0.005509s
2025-09-30T14:51:28.008571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a97ff5c-6cf35364-c14b0e6-46cd645a_0] Write session: Do CDS request
2025-09-30T14:51:28.008580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a97ff5c-6cf35364-c14b0e6-46cd645a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:28.014742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a97ff5c-6cf35364-c14b0e6-46cd645a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:28.014852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:28.014864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 438
2025-09-30T14:51:28.014963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 438 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:28.014987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 438 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:28.014994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=438 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:28.014997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:28.015564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 438 sessionId:  describe result for acl check
2025-09-30T14:51:28.015608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:28.015614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:28.015617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:28.015622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894966664725312:5049] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:28.016180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894966664725312:5049] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:28.019415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894966664725312:5049] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:28.022935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894966664725312:5049] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:28.022953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894966664725312:5049] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:28.022956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894966664725312:5049] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:28.022966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 438 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:28.026626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:28.028952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:28.029170Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:28.029180Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:28.029191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:28.029240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:28.029279Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894966574999373:4309]
2025-09-30T14:51:28.030024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:28.030278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:28.030319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:28.030685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:28.030742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:28.030749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:28.030750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:28.030751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:28.030753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:28.030754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:28.030755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:28.030756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:28.030757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:28.030758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:28.030759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.030760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.030761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.030762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:28.030764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:28.030769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:28.030780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:28.030784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:28.030788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:28.030793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:28.030797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:28.030801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:28.030805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:28.030809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:28.030813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:28.030817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.030822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.030826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.030829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:28.030838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:28.030845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:28.030857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:28.030867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:28.030873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:28.030882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:28.030888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:28.030892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:28.030897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:28.030902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:28.030912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:28.030920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:28.030925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:28.030935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:28.030943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:28.030948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:28.030958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:28.030962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:28.030972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:28.030976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:28.030981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:28.030990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.030995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.031000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.031009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.031014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.031023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.031031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:28.031036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:28.031044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:28.031051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:28.031100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:28.037272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:28.038766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:28.038781Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:28.038783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:28.038786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:28.038793Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 437 [2:7555894966574999373:4309]
2025-09-30T14:51:28.038805Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:28.038819Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:28.038821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.038823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.038824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.038836Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:28.038841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:28.038846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:28.038895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.038901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.038902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.038905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:28.038907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:28.038956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:28.038961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.038969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.038975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.038985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:28.039002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894966574999368:4309]
2025-09-30T14:51:28.039007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894966574999368:4309]
2025-09-30T14:51:28.039008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894966574999368:4309]
2025-09-30T14:51:28.039015Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:28.039025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:28.039026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894966664725294:2454], now have 1 active actors on pipe
2025-09-30T14:51:28.039029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894966664725481:5049], now have 1 active actors on pipe
2025-09-30T14:51:28.039036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:28.039044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:28.039044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:28.039046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:28.039047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:28.039080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894966574999368:4309]
2025-09-30T14:51:28.039085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:28.039090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:28.039116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 437
2025-09-30T14:51:28.039122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 437
2025-09-30T14:51:28.039190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:28.039201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:28.039226Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7bce483-9230b0a4-8e9996fc-bff0d71_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:28.039236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.039238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.039240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:28.039555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.039575Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:28.039591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:28.039781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:28.039789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:28.039800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:28.039885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 438 partition: 0 MaxSeqNo: 42 sessionId: src_id|d7bce483-9230b0a4-8e9996fc-bff0d71_0
2025-09-30T14:51:28.040294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a97ff5c-6cf35364-c14b0e6-46cd645a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d7bce483-9230b0a4-8e9996fc-bff0d71_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:28.043209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7bce483-9230b0a4-8e9996fc-bff0d71_0] Write session: try to update token
2025-09-30T14:51:28.043227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7bce483-9230b0a4-8e9996fc-bff0d71_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:28.051789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:28.051807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:28.051816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894966574999368:4309]
2025-09-30T14:51:28.051853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:28.051855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:28.052018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:28.052171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:28.052312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:28.052447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:28.052628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:28.052667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:28.058084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 438 sessionId: src_id|d7bce483-9230b0a4-8e9996fc-bff0d71_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:28.060605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:28.060775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:28.060795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:28.060821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:28.060899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:28.063354Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:28.063374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:28.063377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:28.063379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:28.063389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894966574999368:4309]
2025-09-30T14:51:28.063393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894966574999368:4309]
2025-09-30T14:51:28.063397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894966574999368:4309]
2025-09-30T14:51:28.063438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:28.063440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:28.063448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.063451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:28.063452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:28.063456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:28.063643Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:28.108211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894966664725595:4849]
2025-09-30T14:51:28.108451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 437, pipe: [1:7555894966664725595:4849]
2025-09-30T14:51:28.174380Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:28.181450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:28.181479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:28.181630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:28.181691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:28.181749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:28.181807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:28.181850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:28.181857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:28.181920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:28.181976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:28.182033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:28.182128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:28.182171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:28.182177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:28.182237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:28.182323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:28.182381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:28.182439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:28.182478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:28.182484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:28.182590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:28.182653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:28.182709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:28.182765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:28.182806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:28.182811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:28.182871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:28.182926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:28.182983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:28.183039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:28.183096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:28.183102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:28.183166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:28.183218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:28.183296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:28.183359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:28.183399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:28.183405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:28.183474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:28.183538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:28.183602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:28.183661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:28.183701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:28.183709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:28.183770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:28.183823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:28.183881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:28.183936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:28.183978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:28.183984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:28.184042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:28.184094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:28.184150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:28.184209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:28.184324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:28.184330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:28.184389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:28.184447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:28.184515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:28.184580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:28.184708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:28.184716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:28.184762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894966664725595:4849], now have 1 active actors on pipe
2025-09-30T14:51:28.185001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:28.185010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894966664725595:4849]
2025-09-30T14:51:28.185041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:28.185044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:28.185069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 438 reason: error at write: Disconnected sessionId: src_id|d7bce483-9230b0a4-8e9996fc-bff0d71_0
2025-09-30T14:51:28.185288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 438 sessionId: src_id|d7bce483-9230b0a4-8e9996fc-bff0d71_0 is DEAD
2025-09-30T14:51:28.185418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7bce483-9230b0a4-8e9996fc-bff0d71_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:28.185437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7bce483-9230b0a4-8e9996fc-bff0d71_0] Write session will restart in 0.006624s
2025-09-30T14:51:28.185460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7bce483-9230b0a4-8e9996fc-bff0d71_0] Write session: Do CDS request
2025-09-30T14:51:28.185465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7bce483-9230b0a4-8e9996fc-bff0d71_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:28.185614Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:28.192799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7bce483-9230b0a4-8e9996fc-bff0d71_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:28.192963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:28.192980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 439
2025-09-30T14:51:28.193153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 439 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:28.193197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 439 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:28.193207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=439 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:28.193211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:28.193670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 439 sessionId:  describe result for acl check
2025-09-30T14:51:28.193706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:28.193709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:28.193711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:28.193730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894966664725619:5062] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:28.194190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894966664725619:5062] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:28.196808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894966664725619:5062] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:28.200384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894966664725619:5062] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:28.200402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894966664725619:5062] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:28.200406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894966664725619:5062] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:28.200413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 439 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:28.204081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:28.206653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:28.206873Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:28.206892Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:28.206904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:28.206962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:28.207008Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894966574999678:4324]
2025-09-30T14:51:28.207689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:28.208005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:28.208048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:28.208381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:28.208437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:28.208443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:28.208445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:28.208446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:28.208448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:28.208449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:28.208450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:28.208451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:28.208452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:28.208454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:28.208455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.208457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.208458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.208459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:28.208460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:28.208466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:28.208476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:28.208480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:28.208484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:28.208489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:28.208493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:28.208497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:28.208501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:28.208505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:28.208509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:28.208513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.208517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.208521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.208525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:28.208530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:28.208537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:28.208545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:28.208551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:28.208557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:28.208561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:28.208567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:28.208579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:28.208584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:28.208589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:28.208595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:28.208599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:28.208605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:28.208610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:28.208615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:28.208619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:28.208630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:28.208635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:28.208640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:28.208645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:28.208649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:28.208654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.208659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.208668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.208672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.208676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.208680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.208689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:28.208694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:28.208698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:28.208708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:28.208753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:28.214730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:28.216232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:28.216248Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:28.216249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:28.216252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:28.216257Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 438 [2:7555894966574999678:4324]
2025-09-30T14:51:28.216271Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:28.216283Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:28.216285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.216288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.216289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.216301Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:28.216306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:28.216311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:28.216372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.216378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.216380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.216384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:28.216387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:28.216455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:28.216462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.216475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.216492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.216514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:28.216530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894966574999673:4324]
2025-09-30T14:51:28.216535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894966574999673:4324]
2025-09-30T14:51:28.216537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894966574999673:4324]
2025-09-30T14:51:28.216543Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:28.216554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:28.216556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:28.216559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:28.216561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:28.216563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:28.216565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:28.216573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894966664725790:5062], now have 1 active actors on pipe
2025-09-30T14:51:28.216576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894966664725598:2454], now have 1 active actors on pipe
2025-09-30T14:51:28.216599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894966574999673:4324]
2025-09-30T14:51:28.216606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:28.216625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:28.216668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 438
2025-09-30T14:51:28.216666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 438
2025-09-30T14:51:28.216761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:28.216772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:28.216795Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b52c7e14-4fb7d884-4b9dfc8d-6493b0f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:28.216807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.216811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.216813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:28.216824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.216837Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:28.216856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:28.217020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:28.217034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:28.217054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:28.217138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 439 partition: 0 MaxSeqNo: 42 sessionId: src_id|b52c7e14-4fb7d884-4b9dfc8d-6493b0f7_0
2025-09-30T14:51:28.217478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7bce483-9230b0a4-8e9996fc-bff0d71_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b52c7e14-4fb7d884-4b9dfc8d-6493b0f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:28.220321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b52c7e14-4fb7d884-4b9dfc8d-6493b0f7_0] Write session: try to update token
2025-09-30T14:51:28.220340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b52c7e14-4fb7d884-4b9dfc8d-6493b0f7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:28.228597Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:28.228619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:28.228629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894966574999673:4324]
2025-09-30T14:51:28.228661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:28.228669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:28.228845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:28.228999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:28.229147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:28.229294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:28.229490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:28.229532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:28.234600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 439 sessionId: src_id|b52c7e14-4fb7d884-4b9dfc8d-6493b0f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:28.237428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:28.237622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:28.237647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:28.237687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:28.237780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:28.240159Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:28.240182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:28.240185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:28.240187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:28.240198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894966574999673:4324]
2025-09-30T14:51:28.240204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894966574999673:4324]
2025-09-30T14:51:28.240209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894966574999673:4324]
2025-09-30T14:51:28.240250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:28.240266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.240268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:28.240270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:28.240273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:28.240276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:28.240468Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:28.285379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894966664725872:4849]
2025-09-30T14:51:28.285659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 438, pipe: [1:7555894966664725872:4849]
2025-09-30T14:51:28.345443Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:28.352628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:28.352652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:28.352801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:28.352872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:28.352943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:28.353013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:28.353301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:28.353313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:28.353382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:28.353438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:28.353497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:28.353561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:28.353606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:28.353612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:28.353687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:28.353745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:28.353805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:28.353862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:28.353902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:28.353908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:28.353970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:28.354027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:28.354085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:28.354143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:28.354190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:28.354200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:28.354302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:28.354360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:28.354416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:28.354473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:28.354541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:28.354547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:28.354609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:28.354669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:28.354729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:28.354788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:28.354830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:28.354836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:28.354912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:28.354991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:28.355058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:28.355121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:28.355163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:28.355169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:28.355231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:28.355299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:28.355355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:28.355415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:28.355466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:28.355473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:28.355548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:28.355612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:28.355671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:28.355728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:28.355770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:28.355775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:28.355834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:28.355886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:28.355942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:28.356000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:28.356056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:28.356062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:28.356121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894966664725872:4849], now have 1 active actors on pipe
2025-09-30T14:51:28.356322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894966664725872:4849]
2025-09-30T14:51:28.356351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:28.356353Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:28.356355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:28.356385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 439 reason: error at write: Disconnected sessionId: src_id|b52c7e14-4fb7d884-4b9dfc8d-6493b0f7_0
2025-09-30T14:51:28.356584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 439 sessionId: src_id|b52c7e14-4fb7d884-4b9dfc8d-6493b0f7_0 is DEAD
2025-09-30T14:51:28.356678Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:28.356757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b52c7e14-4fb7d884-4b9dfc8d-6493b0f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:28.356768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b52c7e14-4fb7d884-4b9dfc8d-6493b0f7_0] Write session will restart in 0.005082s
2025-09-30T14:51:28.356790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b52c7e14-4fb7d884-4b9dfc8d-6493b0f7_0] Write session: Do CDS request
2025-09-30T14:51:28.356795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b52c7e14-4fb7d884-4b9dfc8d-6493b0f7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:28.362755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b52c7e14-4fb7d884-4b9dfc8d-6493b0f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:28.362857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:28.362869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 440
2025-09-30T14:51:28.362990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 440 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:28.363015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 440 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:28.363019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=440 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:28.363022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:28.363500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 440 sessionId:  describe result for acl check
2025-09-30T14:51:28.363532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:28.363535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:28.363536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:28.363540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894966664725909:5066] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:28.363984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894966664725909:5066] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:28.367109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894966664725909:5066] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:28.369745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894966664725909:5066] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:28.369759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894966664725909:5066] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:28.369762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894966664725909:5066] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:28.369769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 440 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:28.372691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:28.375204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:28.375388Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:28.375396Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:28.375403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:28.375450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:28.375492Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894966574999946:4326]
2025-09-30T14:51:28.375994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:28.376257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:28.376285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:28.376583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:28.376637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:28.376642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:28.376643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:28.376644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:28.376645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:28.376645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:28.376646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:28.376647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:28.376648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:28.376648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:28.376649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.376650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.376650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.376652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:28.376653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:28.376656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:28.376663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:28.376666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:28.376668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:28.376670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:28.376673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:28.376676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:28.376680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:28.376684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:28.376688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:28.376691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.376693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.376697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.376701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:28.376705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:28.376713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:28.376721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:28.376726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:28.376729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:28.376732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:28.376735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:28.376737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:28.376741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:28.376743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:28.376746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:28.376748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:28.376751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:28.376754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:28.376757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:28.376759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:28.376762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:28.376765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:28.376768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:28.376770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:28.376773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:28.376777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.376780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.376783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.376785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.376788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.376790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.376794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:28.376796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:28.376799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:28.376802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:28.376829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:28.381990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:28.382851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:28.382868Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:28.382870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:28.382874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:28.382881Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 439 [2:7555894966574999946:4326]
2025-09-30T14:51:28.382896Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:28.382911Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:28.382914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.382917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.382920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.382935Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:28.382949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:28.382956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:28.383006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.383009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.383011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.383015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:28.383017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:28.383083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:28.383092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.383105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.383117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.383134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:28.383157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894966664726090:5066], now have 1 active actors on pipe
2025-09-30T14:51:28.383161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894966664725874:2454], now have 1 active actors on pipe
2025-09-30T14:51:28.383167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894966574999941:4326]
2025-09-30T14:51:28.383170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894966574999941:4326]
2025-09-30T14:51:28.383172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894966574999941:4326]
2025-09-30T14:51:28.383184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:28.383197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:28.383203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:28.383206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:28.383208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:28.383218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:28.383221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:28.383268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894966574999941:4326]
2025-09-30T14:51:28.383277Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:28.383295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:28.383272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 439
2025-09-30T14:51:28.383385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 439
2025-09-30T14:51:28.383439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:28.383456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:28.383494Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6244de89-b95686e1-7c7737b-8926f30b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:28.383508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.383512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.383514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:28.383525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.383537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:28.383557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:28.383711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:28.383720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:28.383733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:28.383818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 440 partition: 0 MaxSeqNo: 42 sessionId: src_id|6244de89-b95686e1-7c7737b-8926f30b_0
2025-09-30T14:51:28.384232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b52c7e14-4fb7d884-4b9dfc8d-6493b0f7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6244de89-b95686e1-7c7737b-8926f30b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:28.386932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6244de89-b95686e1-7c7737b-8926f30b_0] Write session: try to update token
2025-09-30T14:51:28.386952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6244de89-b95686e1-7c7737b-8926f30b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:28.399811Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:28.399833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:28.399843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894966574999941:4326]
2025-09-30T14:51:28.399894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:28.399896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:28.400068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:28.400209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:28.400354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:28.400492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:28.400679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:28.400718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:28.402630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 440 sessionId: src_id|6244de89-b95686e1-7c7737b-8926f30b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:28.404705Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:28.404722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:28.404725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:28.404727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:28.404736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894966574999941:4326]
2025-09-30T14:51:28.404740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894966574999941:4326]
2025-09-30T14:51:28.404743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894966574999941:4326]
2025-09-30T14:51:28.404778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:28.404788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.404789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:28.404795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:28.404795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:28.404799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:28.404933Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:28.405825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:28.456374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894966664726152:4849]
2025-09-30T14:51:28.456642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 439, pipe: [1:7555894966664726152:4849]
2025-09-30T14:51:28.511498Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:28.512240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:28.512258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:28.512276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894966664726152:4849], now have 1 active actors on pipe
2025-09-30T14:51:28.512454Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:28.512504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:28.512546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894966664726152:4849]
2025-09-30T14:51:28.512556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:28.512620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 440 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6244de89-b95686e1-7c7737b-8926f30b_0
2025-09-30T14:51:28.512784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 440 sessionId: src_id|6244de89-b95686e1-7c7737b-8926f30b_0 is DEAD
2025-09-30T14:51:28.512954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6244de89-b95686e1-7c7737b-8926f30b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:28.512965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6244de89-b95686e1-7c7737b-8926f30b_0] Write session will restart in 0.009229s
2025-09-30T14:51:28.512989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6244de89-b95686e1-7c7737b-8926f30b_0] Write session: Do CDS request
2025-09-30T14:51:28.512995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6244de89-b95686e1-7c7737b-8926f30b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:28.523811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6244de89-b95686e1-7c7737b-8926f30b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:28.523955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:28.523973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 441
2025-09-30T14:51:28.524141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 441 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:28.524187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 441 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:28.524197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=441 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:28.524201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:28.524678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 441 sessionId:  describe result for acl check
2025-09-30T14:51:28.524714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:28.524716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:28.524719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:28.524724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894966664726243:5071] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:28.525291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894966664726243:5071] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:28.527991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894966664726243:5071] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:28.530859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894966664726243:5071] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:28.530874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894966664726243:5071] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:28.530877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894966664726243:5071] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:28.530885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 441 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:28.532768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:28.535441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:28.535637Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:28.535650Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:28.535661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:28.535712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:28.535760Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894966575000217:4329]
2025-09-30T14:51:28.536427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:28.536733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:28.536775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:28.537117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:28.537179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:28.537185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:28.537186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:28.537187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:28.537189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:28.537190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:28.537191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:28.537193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:28.537194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:28.537195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:28.537197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.537198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.537199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.537200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:28.537201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:28.537207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:28.537217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:28.537221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:28.537225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:28.537229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:28.537233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:28.537237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:28.537241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:28.537246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:28.537251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:28.537255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.537259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.537263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.537267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:28.537271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:28.537279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:28.537287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:28.537293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:28.537300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:28.537306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:28.537311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:28.537316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:28.537321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:28.537326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:28.537332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:28.537336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:28.537342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:28.537346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:28.537357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:28.537362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:28.537367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:28.537372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:28.537377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:28.537382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:28.537387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:28.537392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.537398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.537407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.537413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.537423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.537427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.537433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:28.537443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:28.537447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:28.537452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:28.537502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:28.543200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:28.544174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:28.544192Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:28.544195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:28.544199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:28.544206Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 440 [2:7555894966575000217:4329]
2025-09-30T14:51:28.544222Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:28.544242Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:28.544250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.544254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.544256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.544273Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:28.544279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:28.544286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:28.544680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.544693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.544695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.544699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:28.544701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:28.544763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:28.544771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.544784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.544797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.544824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:28.544849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894966664726154:2454], now have 1 active actors on pipe
2025-09-30T14:51:28.544853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894966664726416:5071], now have 1 active actors on pipe
2025-09-30T14:51:28.544860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894966575000212:4329]
2025-09-30T14:51:28.544862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894966575000212:4329]
2025-09-30T14:51:28.544864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894966575000212:4329]
2025-09-30T14:51:28.544878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:28.544893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:28.544910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:28.544913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:28.544929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:28.544933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:28.544935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:28.544943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894966575000212:4329]
2025-09-30T14:51:28.544946Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:28.544948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:28.544920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 440
2025-09-30T14:51:28.544925Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 440
2025-09-30T14:51:28.544985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:28.545000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:28.545024Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e40986eb-40661108-2f81e13e-1831d4ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:28.545038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.545046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.545049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:28.545059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.545068Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:28.545085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:28.545221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:28.545230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:28.545242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:28.545329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 441 partition: 0 MaxSeqNo: 42 sessionId: src_id|e40986eb-40661108-2f81e13e-1831d4ba_0
2025-09-30T14:51:28.545707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6244de89-b95686e1-7c7737b-8926f30b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e40986eb-40661108-2f81e13e-1831d4ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:28.548411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e40986eb-40661108-2f81e13e-1831d4ba_0] Write session: try to update token
2025-09-30T14:51:28.548431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e40986eb-40661108-2f81e13e-1831d4ba_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:28.560538Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:28.560563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:28.560565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:28.560568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:28.560578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894966575000212:4329]
2025-09-30T14:51:28.560583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894966575000212:4329]
2025-09-30T14:51:28.560588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894966575000212:4329]
2025-09-30T14:51:28.560628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:28.560636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.560639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:28.560643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:28.560650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:28.560654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:28.560844Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:28.563438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 441 sessionId: src_id|e40986eb-40661108-2f81e13e-1831d4ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:28.566093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:28.612537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894966664726430:4849]
2025-09-30T14:51:28.612759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 440, pipe: [1:7555894966664726430:4849]
2025-09-30T14:51:28.667094Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:28.667375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:28.667388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:28.667421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894966664726430:4849], now have 1 active actors on pipe
2025-09-30T14:51:28.667577Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:28.667616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894966664726430:4849]
2025-09-30T14:51:28.667622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:28.667649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:28.667719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 441 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e40986eb-40661108-2f81e13e-1831d4ba_0
2025-09-30T14:51:28.667921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 441 sessionId: src_id|e40986eb-40661108-2f81e13e-1831d4ba_0 is DEAD
2025-09-30T14:51:28.668074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e40986eb-40661108-2f81e13e-1831d4ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:28.668095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e40986eb-40661108-2f81e13e-1831d4ba_0] Write session will restart in 0.009195s
2025-09-30T14:51:28.668119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e40986eb-40661108-2f81e13e-1831d4ba_0] Write session: Do CDS request
2025-09-30T14:51:28.668125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e40986eb-40661108-2f81e13e-1831d4ba_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:28.678842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e40986eb-40661108-2f81e13e-1831d4ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:28.678989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:28.679006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 442
2025-09-30T14:51:28.679125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 442 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:28.679156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 442 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:28.679166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=442 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:28.679169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:28.679587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 442 sessionId:  describe result for acl check
2025-09-30T14:51:28.679623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:28.679629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:28.679632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:28.679638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894966664726553:5075] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:28.680120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894966664726553:5075] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:28.682107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894966664726553:5075] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:28.684705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:28.684731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894966664726553:5075] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:28.684746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894966664726553:5075] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:28.684749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894966664726553:5075] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:28.684756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 442 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:28.687317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:28.687512Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:28.687536Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:28.687547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:28.687599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:28.687636Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894966575000487:4331]
2025-09-30T14:51:28.688279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:28.688525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:28.688564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:28.688876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:28.688932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:28.688938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:28.688939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:28.688940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:28.688941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:28.688942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:28.688944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:28.688945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:28.688946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:28.688947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:28.688948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.688949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.688950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.688951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:28.688952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:28.688957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:28.688967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:28.688972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:28.688976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:28.688980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:28.688985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:28.688993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:28.688997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:28.689005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:28.689011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:28.689020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.689024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.689032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.689036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:28.689044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:28.689050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:28.689062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:28.689072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:28.689081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:28.689089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:28.689095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:28.689103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:28.689109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:28.689118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:28.689128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:28.689136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:28.689141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:28.689150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:28.689159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:28.689164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:28.689173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:28.689178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:28.689184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:28.689192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:28.689202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:28.689210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.689219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.689229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.689237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.689245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.689254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.689258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:28.689267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:28.689276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:28.689285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:28.689328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:28.695029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:28.695928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:28.695943Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:28.695945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:28.695948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:28.695953Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 441 [2:7555894966575000487:4331]
2025-09-30T14:51:28.695963Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:28.695979Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:28.695984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.695986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.695988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.695999Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:28.696005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:28.696017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:28.696075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.696082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.696083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.696086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:28.696088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:28.696137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:28.696143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.696150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.696157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.696170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:28.696191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894966575000481:4331]
2025-09-30T14:51:28.696199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894966575000481:4331]
2025-09-30T14:51:28.696201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894966575000481:4331]
2025-09-30T14:51:28.696209Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:28.696223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:28.696227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894966664726697:5075], now have 1 active actors on pipe
2025-09-30T14:51:28.696229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894966664726432:2454], now have 1 active actors on pipe
2025-09-30T14:51:28.696233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:28.696235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:28.696237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:28.696251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:28.696255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:28.696269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 441
2025-09-30T14:51:28.696282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894966575000481:4331]
2025-09-30T14:51:28.696295Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:28.696282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 441
2025-09-30T14:51:28.696297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:28.696326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:28.696331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:28.696363Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a17c6946-2aed93ef-1f919673-2cac8583_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:28.696375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.696377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.696379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:28.696386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.696393Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:28.696406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:28.696546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:28.696556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:28.696571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:28.696685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 442 partition: 0 MaxSeqNo: 42 sessionId: src_id|a17c6946-2aed93ef-1f919673-2cac8583_0
2025-09-30T14:51:28.697100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e40986eb-40661108-2f81e13e-1831d4ba_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a17c6946-2aed93ef-1f919673-2cac8583_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:28.699798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a17c6946-2aed93ef-1f919673-2cac8583_0] Write session: try to update token
2025-09-30T14:51:28.699815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a17c6946-2aed93ef-1f919673-2cac8583_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:28.708353Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:28.708378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:28.708380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:28.708382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:28.708390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894966575000481:4331]
2025-09-30T14:51:28.708397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894966575000481:4331]
2025-09-30T14:51:28.708401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894966575000481:4331]
2025-09-30T14:51:28.708437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:28.708443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.708445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:28.708448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:28.708453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:28.708456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:28.708577Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:28.713695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 442 sessionId: src_id|a17c6946-2aed93ef-1f919673-2cac8583_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:28.716229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:28.767678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894966664726709:4849]
2025-09-30T14:51:28.767933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 441, pipe: [1:7555894966664726709:4849]
2025-09-30T14:51:28.814802Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:28.815399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:28.815413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:28.815442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894966664726709:4849], now have 1 active actors on pipe
2025-09-30T14:51:28.815549Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:28.815665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:28.815668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:28.815716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894966664726709:4849]
2025-09-30T14:51:28.815728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 442 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a17c6946-2aed93ef-1f919673-2cac8583_0
2025-09-30T14:51:28.815919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 442 sessionId: src_id|a17c6946-2aed93ef-1f919673-2cac8583_0 is DEAD
2025-09-30T14:51:28.816047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a17c6946-2aed93ef-1f919673-2cac8583_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:28.816059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a17c6946-2aed93ef-1f919673-2cac8583_0] Write session will restart in 0.006752s
2025-09-30T14:51:28.816080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a17c6946-2aed93ef-1f919673-2cac8583_0] Write session: Do CDS request
2025-09-30T14:51:28.816086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a17c6946-2aed93ef-1f919673-2cac8583_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:28.823646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a17c6946-2aed93ef-1f919673-2cac8583_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:28.823793Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:28.823805Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 443
2025-09-30T14:51:28.823931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 443 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:28.823963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 443 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:28.823975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=443 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:28.823979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:28.824372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 443 sessionId:  describe result for acl check
2025-09-30T14:51:28.824402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:28.824409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:28.824411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:28.824416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894966664726762:5079] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:28.824878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894966664726762:5079] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:28.827397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894966664726762:5079] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:28.830447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894966664726762:5079] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:28.830459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894966664726762:5079] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:28.830462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894966664726762:5079] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:28.830470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 443 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:28.832347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:28.834986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:28.835146Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:28.835153Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:28.835160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:28.835198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:28.835234Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894966575000770:4334]
2025-09-30T14:51:28.835729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:28.835983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:28.836015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:28.836242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:28.836282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:28.836286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:28.836287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:28.836288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:28.836288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:28.836289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:28.836290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:28.836290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:28.836291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:28.836292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:28.836292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.836293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.836294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.836294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:28.836295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:28.836298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:28.836305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:28.836307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:28.836309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:28.836312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:28.836314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:28.836316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:28.836319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:28.836321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:28.836323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:28.836326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.836328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.836330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.836332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:28.836335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:28.836340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:28.836344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:28.836348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:28.836352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:28.836355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:28.836358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:28.836361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:28.836367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:28.836371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:28.836376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:28.836379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:28.836383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:28.836387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:28.836392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:28.836396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:28.836401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:28.836406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:28.836411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:28.836415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:28.836420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:28.836424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.836428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.836438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.836442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.836450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.836455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.836462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:28.836466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:28.836475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:28.836481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:28.836519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:28.841603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:28.842818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:28.842836Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:28.842838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:28.842841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:28.842847Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 442 [2:7555894966575000770:4334]
2025-09-30T14:51:28.842862Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:28.842875Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:28.842883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.842886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.842888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.842902Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:28.842914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:28.842921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:28.842977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.842984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.842986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.842989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:28.842991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:28.843050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:28.843058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.843068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.843082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.843102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:28.843124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894966664726711:2454], now have 1 active actors on pipe
2025-09-30T14:51:28.843132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894966664726955:5079], now have 1 active actors on pipe
2025-09-30T14:51:28.843137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894966575000765:4334]
2025-09-30T14:51:28.843139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894966575000765:4334]
2025-09-30T14:51:28.843141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894966575000765:4334]
2025-09-30T14:51:28.843154Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:28.843169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:28.843172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:28.843173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:28.843174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:28.843186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:28.843189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:28.843183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 442
2025-09-30T14:51:28.843217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894966575000765:4334]
2025-09-30T14:51:28.843196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 442
2025-09-30T14:51:28.843228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:28.843237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:28.843274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:28.843283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:28.843332Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1683d10-6e1e7957-ec725cdc-6340dedc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:28.843348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.843352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.843354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:28.843363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.843372Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:28.843390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:28.843562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:28.843570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:28.843585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:28.843667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 443 partition: 0 MaxSeqNo: 42 sessionId: src_id|d1683d10-6e1e7957-ec725cdc-6340dedc_0
2025-09-30T14:51:28.844028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a17c6946-2aed93ef-1f919673-2cac8583_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d1683d10-6e1e7957-ec725cdc-6340dedc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:28.846740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1683d10-6e1e7957-ec725cdc-6340dedc_0] Write session: try to update token
2025-09-30T14:51:28.846757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1683d10-6e1e7957-ec725cdc-6340dedc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:28.854892Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:28.854909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:28.854910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:28.854912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:28.854918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894966575000765:4334]
2025-09-30T14:51:28.854921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894966575000765:4334]
2025-09-30T14:51:28.854924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894966575000765:4334]
2025-09-30T14:51:28.854954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:28.854959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.854961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:28.854964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:28.854969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:28.854973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:28.855098Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:28.860289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 443 sessionId: src_id|d1683d10-6e1e7957-ec725cdc-6340dedc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:28.862946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:28.915657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894966664727001:4849]
2025-09-30T14:51:28.915977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 442, pipe: [1:7555894966664727001:4849]
2025-09-30T14:51:28.957177Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:28.957578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:28.957589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:28.957623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894966664727001:4849], now have 1 active actors on pipe
2025-09-30T14:51:28.957805Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:28.957814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894966664727001:4849]
2025-09-30T14:51:28.957831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:28.957843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:28.957845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:28.957901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 443 reason: error at write: Disconnected sessionId: src_id|d1683d10-6e1e7957-ec725cdc-6340dedc_0
2025-09-30T14:51:28.958097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 443 sessionId: src_id|d1683d10-6e1e7957-ec725cdc-6340dedc_0 is DEAD
2025-09-30T14:51:28.958249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1683d10-6e1e7957-ec725cdc-6340dedc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:28.958258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1683d10-6e1e7957-ec725cdc-6340dedc_0] Write session will restart in 0.006403s
2025-09-30T14:51:28.958275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1683d10-6e1e7957-ec725cdc-6340dedc_0] Write session: Do CDS request
2025-09-30T14:51:28.958279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1683d10-6e1e7957-ec725cdc-6340dedc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:28.965765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1683d10-6e1e7957-ec725cdc-6340dedc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:28.965844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:28.965858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 444
2025-09-30T14:51:28.966014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 444 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:28.966046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 444 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:28.966053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=444 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:28.966057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:28.966437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 444 sessionId:  describe result for acl check
2025-09-30T14:51:28.966475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:28.966477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:28.966479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:28.966485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894966664727043:5084] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:28.967054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894966664727043:5084] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:28.969135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894966664727043:5084] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:28.971875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894966664727043:5084] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:28.971886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894966664727043:5084] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:28.971889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894966664727043:5084] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:28.971896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 444 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:28.974471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:28.977092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:28.977274Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:28.977288Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:28.977298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:28.977362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:28.977391Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894966575001041:4336]
2025-09-30T14:51:28.977872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:28.978131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:28.978168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:28.978433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:28.978478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:28.978483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:28.978483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:28.978484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:28.978485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:28.978486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:28.978486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:28.978487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:28.978488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:28.978488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:28.978489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.978490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.978491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.978492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:28.978493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:28.978496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:28.978516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:28.978519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:28.978521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:28.978524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:28.978526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:28.978528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:28.978530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:28.978533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:28.978535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:28.978538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.978540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.978542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.978545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:28.978547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:28.978552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:28.978557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:28.978561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:28.978564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:28.978570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:28.978573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:28.978575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:28.978578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:28.978580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:28.978583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:28.978585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:28.978588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:28.978590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:28.978593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:28.978596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:28.978599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:28.978602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:28.978605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:28.978608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:28.978612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:28.978616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.978622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.978626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.978631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.978635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.978641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.978645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:28.978648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:28.978650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:28.978654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:28.978676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:28.983711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:28.984805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:28.984819Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:28.984820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:28.984823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:28.984829Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 443 [2:7555894966575001041:4336]
2025-09-30T14:51:28.984839Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:28.984850Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:28.984852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.984854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.984855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.984867Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:28.984872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:28.984878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:28.984918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.984924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.984926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.984928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:28.984930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:28.984975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:28.984981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:28.984989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:28.984995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:28.985016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:28.985036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894966664727005:2454], now have 1 active actors on pipe
2025-09-30T14:51:28.985046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894966575001036:4336]
2025-09-30T14:51:28.985048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894966575001036:4336]
2025-09-30T14:51:28.985050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894966575001036:4336]
2025-09-30T14:51:28.985065Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:28.985077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894966664727218:5084], now have 1 active actors on pipe
2025-09-30T14:51:28.985080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:28.985083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:28.985085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:28.985089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:28.985104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:28.985106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:28.985132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894966575001036:4336]
2025-09-30T14:51:28.985143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:28.985158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:28.985135Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 443
2025-09-30T14:51:28.985145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 443
2025-09-30T14:51:28.985179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:28.985188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:28.985208Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2a62adf-dfdea187-c5e72084-35b5f3ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:28.985217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.985219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.985221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:28.985231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.985244Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:28.985257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:28.985382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:28.985390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:28.985403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:28.985489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 444 partition: 0 MaxSeqNo: 42 sessionId: src_id|a2a62adf-dfdea187-c5e72084-35b5f3ba_0
2025-09-30T14:51:28.985884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1683d10-6e1e7957-ec725cdc-6340dedc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a2a62adf-dfdea187-c5e72084-35b5f3ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:28.988478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a62adf-dfdea187-c5e72084-35b5f3ba_0] Write session: try to update token
2025-09-30T14:51:28.988497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a62adf-dfdea187-c5e72084-35b5f3ba_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:28.995966Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:28.995985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:28.995993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894966575001036:4336]
2025-09-30T14:51:28.996027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:28.996033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:28.996178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:28.996388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:28.996591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:28.996766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:28.996938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:28.996973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:29.002554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 444 sessionId: src_id|a2a62adf-dfdea187-c5e72084-35b5f3ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:29.005362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:29.005828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:29.005851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:29.005901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:29.005999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:29.007648Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:29.007668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:29.007670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:29.007671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:29.007677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894966575001036:4336]
2025-09-30T14:51:29.007680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894966575001036:4336]
2025-09-30T14:51:29.007683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894966575001036:4336]
2025-09-30T14:51:29.007714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:29.007731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:29.007732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.007735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:29.007736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:29.007740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:29.007900Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:29.057984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894970959694588:4849]
2025-09-30T14:51:29.058249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 443, pipe: [1:7555894970959694588:4849]
2025-09-30T14:51:29.113826Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:29.120535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:29.120561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:29.120724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:29.120794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:29.120861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:29.120933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:29.120984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:29.120993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:29.121067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:29.121137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:29.121201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:29.121275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:29.121322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:29.121329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:29.121445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:29.121518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:29.121627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:29.121693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:29.121954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:29.121962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:29.122034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:29.122099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:29.122189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:29.122258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:29.122303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:29.122310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:29.122380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:29.122444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:29.122523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:29.122589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:29.122638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:29.122645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:29.122750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:29.122815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:29.122879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:29.122945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:29.122991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:29.123000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:29.123070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:29.123151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:29.123220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:29.123299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:29.123344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:29.123351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:29.123421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:29.123481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:29.123547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:29.123612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:29.123658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:29.123664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:29.123733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:29.123795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:29.123859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:29.123924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:29.123968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:29.123975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:29.124042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:29.124104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:29.124169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:29.124236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:29.124282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:29.124288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:29.124336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894970959694588:4849], now have 1 active actors on pipe
2025-09-30T14:51:29.124511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:29.124526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:29.124552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 444 reason: error at write: Disconnected sessionId: src_id|a2a62adf-dfdea187-c5e72084-35b5f3ba_0
2025-09-30T14:51:29.124756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 444 sessionId: src_id|a2a62adf-dfdea187-c5e72084-35b5f3ba_0 is DEAD
2025-09-30T14:51:29.124881Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:29.124909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a62adf-dfdea187-c5e72084-35b5f3ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:29.124920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a62adf-dfdea187-c5e72084-35b5f3ba_0] Write session will restart in 0.006085s
2025-09-30T14:51:29.124945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a62adf-dfdea187-c5e72084-35b5f3ba_0] Write session: Do CDS request
2025-09-30T14:51:29.124925Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:29.124950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a62adf-dfdea187-c5e72084-35b5f3ba_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:29.124960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894970959694588:4849]
2025-09-30T14:51:29.131811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a62adf-dfdea187-c5e72084-35b5f3ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:29.131902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:29.131916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 445
2025-09-30T14:51:29.132018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 445 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:29.132041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 445 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:29.132050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=445 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:29.132054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:29.132349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 445 sessionId:  describe result for acl check
2025-09-30T14:51:29.132375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:29.132377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:29.132378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:29.132382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894970959694630:5096] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:29.132801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894970959694630:5096] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:29.135386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894970959694630:5096] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:29.138716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894970959694630:5096] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:29.138732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894970959694630:5096] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:29.138735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894970959694630:5096] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:29.138742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 445 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:29.143608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:29.146159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:29.146340Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:29.146349Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:29.146358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:29.146401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:29.146438Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894970869968648:4349]
2025-09-30T14:51:29.147040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:29.147333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:29.147407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:29.147778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:29.147841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:29.147848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:29.147849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:29.147851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:29.147852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:29.147853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:29.147854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:29.147855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:29.147856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:29.147857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:29.147859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.147860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.147861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.147862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:29.147864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:29.147869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:29.147880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:29.147884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:29.147888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:29.147892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:29.147896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:29.147901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:29.147904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:29.147909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:29.147913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:29.147917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.147921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.147925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.147930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:29.147933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:29.147942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:29.147950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:29.147956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:29.147962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:29.147966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:29.147971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:29.147976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:29.147981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:29.147986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:29.147991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:29.147995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:29.148007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:29.148011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:29.148021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:29.148026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:29.148031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:29.148040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:29.148046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:29.148054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:29.148060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:29.148065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.148071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.148076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.148081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.148085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.148091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.148099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:29.148104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:29.148109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:29.148118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:29.148161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:29.153655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:29.154652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:29.154668Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:29.154672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:29.154676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:29.154683Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 444 [2:7555894970869968648:4349]
2025-09-30T14:51:29.154699Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:29.154713Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:29.154719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:29.154722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:29.154723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:29.154735Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:29.154740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:29.154745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:29.154791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.154797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.154799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.154802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:29.154804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:29.154854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:29.154860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.154868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.154878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.154892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:29.154908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894970869968643:4349]
2025-09-30T14:51:29.154913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894970869968643:4349]
2025-09-30T14:51:29.154914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894970869968643:4349]
2025-09-30T14:51:29.154921Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:29.154932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:29.154941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894970959694779:5096], now have 1 active actors on pipe
2025-09-30T14:51:29.154941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:29.154943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:29.154944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894970959694607:2454], now have 1 active actors on pipe
2025-09-30T14:51:29.154952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:29.154965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:29.154973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:29.155007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894970869968643:4349]
2025-09-30T14:51:29.155018Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:29.155022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:29.155023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 444
2025-09-30T14:51:29.155018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 444
2025-09-30T14:51:29.155060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:29.155072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:29.155105Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30b19226-f23154de-29f54e80-368dc23f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:29.155115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:29.155118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:29.155119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:29.155126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:29.155136Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:29.155156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:29.155330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:29.155340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:29.155353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:29.155448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 445 partition: 0 MaxSeqNo: 42 sessionId: src_id|30b19226-f23154de-29f54e80-368dc23f_0
2025-09-30T14:51:29.155779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a62adf-dfdea187-c5e72084-35b5f3ba_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|30b19226-f23154de-29f54e80-368dc23f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:29.158449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30b19226-f23154de-29f54e80-368dc23f_0] Write session: try to update token
2025-09-30T14:51:29.158468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30b19226-f23154de-29f54e80-368dc23f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:29.166893Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:29.166915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:29.166918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:29.166920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:29.166934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894970869968643:4349]
2025-09-30T14:51:29.166938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894970869968643:4349]
2025-09-30T14:51:29.166942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894970869968643:4349]
2025-09-30T14:51:29.166981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:29.166987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:29.166990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:29.166990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:29.166997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.167000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:29.167134Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:29.173451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 445 sessionId: src_id|30b19226-f23154de-29f54e80-368dc23f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:29.176117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:29.224907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894970959694893:4849]
2025-09-30T14:51:29.225161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 444, pipe: [1:7555894970959694893:4849]
2025-09-30T14:51:29.273075Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:29.273566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:29.273578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:29.273614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894970959694893:4849], now have 1 active actors on pipe
2025-09-30T14:51:29.273783Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:29.273920Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:29.273945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894970959694893:4849]
2025-09-30T14:51:29.273974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:29.274045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 445 reason: status is not ok: tablet will be restarted right now sessionId: src_id|30b19226-f23154de-29f54e80-368dc23f_0
2025-09-30T14:51:29.274231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 445 sessionId: src_id|30b19226-f23154de-29f54e80-368dc23f_0 is DEAD
2025-09-30T14:51:29.274364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30b19226-f23154de-29f54e80-368dc23f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:29.274374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30b19226-f23154de-29f54e80-368dc23f_0] Write session will restart in 0.009692s
2025-09-30T14:51:29.274390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30b19226-f23154de-29f54e80-368dc23f_0] Write session: Do CDS request
2025-09-30T14:51:29.274394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30b19226-f23154de-29f54e80-368dc23f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:29.284768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30b19226-f23154de-29f54e80-368dc23f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:29.284881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:29.284900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 446
2025-09-30T14:51:29.285019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 446 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:29.285050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 446 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:29.285060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=446 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:29.285064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:29.285516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 446 sessionId:  describe result for acl check
2025-09-30T14:51:29.285552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:29.285559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:29.285561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:29.285567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894970959694972:5101] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:29.286062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894970959694972:5101] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:29.288855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894970959694972:5101] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:29.291839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894970959694972:5101] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:29.291854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894970959694972:5101] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:29.291857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894970959694972:5101] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:29.291863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 446 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:29.292676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:29.295070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:29.295296Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:29.295307Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:29.295316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:29.295369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:29.295401Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894970869968922:4353]
2025-09-30T14:51:29.295843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:29.296136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:29.296169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:29.296405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:29.296448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:29.296455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:29.296455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:29.296456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:29.296457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:29.296457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:29.296458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:29.296459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:29.296459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:29.296460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:29.296461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.296461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.296462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.296463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:29.296464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:29.296468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:29.296475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:29.296477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:29.296480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:29.296482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:29.296485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:29.296487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:29.296489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:29.296491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:29.296494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:29.296496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.296499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.296501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.296503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:29.296505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:29.296511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:29.296515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:29.296519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:29.296523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:29.296526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:29.296529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:29.296532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:29.296536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:29.296538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:29.296542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:29.296544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:29.296548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:29.296550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:29.296553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:29.296556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:29.296559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:29.296562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:29.296565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:29.296568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:29.296571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:29.296574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.296577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.296580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.296583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.296585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.296588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.296590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:29.296595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:29.296597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:29.296600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:29.296624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:29.301761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:29.302765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:29.302778Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:29.302780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:29.302783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:29.302788Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 445 [2:7555894970869968922:4353]
2025-09-30T14:51:29.302798Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:29.302811Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:29.302813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:29.302815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:29.302817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:29.302828Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:29.302833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:29.302839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:29.302888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.302894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.302895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.302898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:29.302900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:29.302965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:29.302972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.302981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.302987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.303002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:29.303014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894970869968917:4353]
2025-09-30T14:51:29.303020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894970869968917:4353]
2025-09-30T14:51:29.303021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894970869968917:4353]
2025-09-30T14:51:29.303028Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:29.303039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:29.303040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894970959694894:2454], now have 1 active actors on pipe
2025-09-30T14:51:29.303045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:29.303050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:29.303053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:29.303054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:29.303057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:29.303060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894970959695162:5101], now have 1 active actors on pipe
2025-09-30T14:51:29.303083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894970869968917:4353]
2025-09-30T14:51:29.303093Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:29.303101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:29.303141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 445
2025-09-30T14:51:29.303151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 445
2025-09-30T14:51:29.303255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:29.303272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:29.303303Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b43f0f-e9b2157c-322b0dbd-1f859eb5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:29.303317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:29.303321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:29.303324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:29.303337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:29.303352Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:29.303371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:29.303603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:29.303617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:29.303642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:29.303747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 446 partition: 0 MaxSeqNo: 42 sessionId: src_id|7b43f0f-e9b2157c-322b0dbd-1f859eb5_0
2025-09-30T14:51:29.304100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30b19226-f23154de-29f54e80-368dc23f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7b43f0f-e9b2157c-322b0dbd-1f859eb5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:29.306930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b43f0f-e9b2157c-322b0dbd-1f859eb5_0] Write session: try to update token
2025-09-30T14:51:29.306948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b43f0f-e9b2157c-322b0dbd-1f859eb5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:29.314904Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:29.314923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:29.314933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894970869968917:4353]
2025-09-30T14:51:29.314979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:29.314999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:29.315162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:29.315326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:29.315464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:29.315600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:29.315787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:29.315828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:29.321683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 446 sessionId: src_id|7b43f0f-e9b2157c-322b0dbd-1f859eb5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:29.324408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:29.324601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:29.324626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:29.324663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:29.324732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:29.325996Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:29.326011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:29.326013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:29.326015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:29.326025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894970869968917:4353]
2025-09-30T14:51:29.326029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894970869968917:4353]
2025-09-30T14:51:29.326034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894970869968917:4353]
2025-09-30T14:51:29.326071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:29.326072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:29.326078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:29.326082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:29.326083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.326086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:29.326266Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:29.373901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894970959695176:4849]
2025-09-30T14:51:29.374190Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 445, pipe: [1:7555894970959695176:4849]
2025-09-30T14:51:29.433676Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:29.441006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:29.441033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:29.441196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:29.441257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:29.441332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:29.441404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:29.441457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:29.441466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:29.441539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:29.441600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:29.441663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:29.441736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:29.441976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:29.441983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:29.442047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:29.442109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:29.442173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:29.442234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:29.442276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:29.442281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:29.442344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:29.442404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:29.442466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:29.442544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:29.442587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:29.442592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:29.442678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:29.442738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:29.442799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:29.442863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:29.442910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:29.442916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:29.442979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:29.443039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:29.443099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:29.443164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:29.443212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:29.443219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:29.443308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:29.443369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:29.443438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:29.443510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:29.443557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:29.443563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:29.443629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:29.443689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:29.443764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:29.443843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:29.443897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:29.443905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:29.443981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:29.444050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:29.444117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:29.444189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:29.444239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:29.444245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:29.444310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:29.444372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:29.444439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:29.444503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:29.444547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:29.444553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:29.444607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894970959695176:4849], now have 1 active actors on pipe
2025-09-30T14:51:29.444870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:29.444895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:29.444899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:29.444920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894970959695176:4849]
2025-09-30T14:51:29.444929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 446 reason: error at write: Disconnected sessionId: src_id|7b43f0f-e9b2157c-322b0dbd-1f859eb5_0
2025-09-30T14:51:29.445139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 446 sessionId: src_id|7b43f0f-e9b2157c-322b0dbd-1f859eb5_0 is DEAD
2025-09-30T14:51:29.445301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b43f0f-e9b2157c-322b0dbd-1f859eb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:29.445312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b43f0f-e9b2157c-322b0dbd-1f859eb5_0] Write session will restart in 0.006852s
2025-09-30T14:51:29.445336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b43f0f-e9b2157c-322b0dbd-1f859eb5_0] Write session: Do CDS request
2025-09-30T14:51:29.445341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b43f0f-e9b2157c-322b0dbd-1f859eb5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:29.445432Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:29.453836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b43f0f-e9b2157c-322b0dbd-1f859eb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:29.453923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:29.453941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 447
2025-09-30T14:51:29.454093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 447 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:29.454134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 447 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:29.454140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=447 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:29.454144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:29.454802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 447 sessionId:  describe result for acl check
2025-09-30T14:51:29.454834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:29.454841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:29.454842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:29.454849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894970959695229:5105] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:29.455372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894970959695229:5105] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:29.458752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894970959695229:5105] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:29.461658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894970959695229:5105] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:29.461673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894970959695229:5105] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:29.461676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894970959695229:5105] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:29.461729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 447 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:29.463533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:29.465994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:29.466266Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:29.466279Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:29.466290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:29.466340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:29.466378Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894970869969197:4355]
2025-09-30T14:51:29.467074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:29.467340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:29.467385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:29.467720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:29.467772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:29.467778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:29.467780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:29.467781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:29.467782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:29.467783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:29.467785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:29.467786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:29.467787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:29.467789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:29.467790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.467791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.467792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.467793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:29.467795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:29.467800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:29.467811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:29.467816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:29.467821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:29.467825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:29.467835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:29.467844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:29.467848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:29.467859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:29.467864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:29.467868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.467873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.467877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.467882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:29.467886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:29.467895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:29.467908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:29.467922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:29.467934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:29.467939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:29.467949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:29.467958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:29.467969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:29.467979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:29.467989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:29.467998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:29.468008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:29.468018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:29.468029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:29.468037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:29.468048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:29.468057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:29.468068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:29.468076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:29.468082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:29.468087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.468097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.468106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.468116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.468125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.468135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.468144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:29.468151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:29.468160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:29.468170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:29.468220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:29.473595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:29.474517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:29.474537Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:29.474540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:29.474544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:29.474551Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 446 [2:7555894970869969197:4355]
2025-09-30T14:51:29.474567Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:29.474582Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:29.474585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:29.474594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:29.474596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:29.474611Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:29.474622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:29.474629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:29.474689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.474697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.474700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.474703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:29.474706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:29.474771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:29.474780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.474793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.474810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.474833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:29.474855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894970959695177:2454], now have 1 active actors on pipe
2025-09-30T14:51:29.474864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894970959695447:5105], now have 1 active actors on pipe
2025-09-30T14:51:29.474870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894970869969192:4355]
2025-09-30T14:51:29.474878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894970869969192:4355]
2025-09-30T14:51:29.474880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894970869969192:4355]
2025-09-30T14:51:29.474893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:29.474907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:29.474910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:29.474912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:29.474914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:29.474929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:29.474932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:29.474918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 446
2025-09-30T14:51:29.474959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894970869969192:4355]
2025-09-30T14:51:29.474971Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:29.474925Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 446
2025-09-30T14:51:29.474993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:29.474999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:29.475006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:29.475051Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2578c2ce-a91656a9-2a95f046-c2373a74_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:29.475063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:29.475067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:29.475073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:29.475082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:29.475091Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:29.475113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:29.475270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:29.475281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:29.475297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:29.475380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 447 partition: 0 MaxSeqNo: 42 sessionId: src_id|2578c2ce-a91656a9-2a95f046-c2373a74_0
2025-09-30T14:51:29.475786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b43f0f-e9b2157c-322b0dbd-1f859eb5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2578c2ce-a91656a9-2a95f046-c2373a74_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:29.478244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2578c2ce-a91656a9-2a95f046-c2373a74_0] Write session: try to update token
2025-09-30T14:51:29.478259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2578c2ce-a91656a9-2a95f046-c2373a74_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:29.487087Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:29.487111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:29.487114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:29.487116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:29.487127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894970869969192:4355]
2025-09-30T14:51:29.487132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894970869969192:4355]
2025-09-30T14:51:29.487136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894970869969192:4355]
2025-09-30T14:51:29.487175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:29.487182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:29.487188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.487191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:29.487191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:29.487194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:29.487351Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:29.492707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 447 sessionId: src_id|2578c2ce-a91656a9-2a95f046-c2373a74_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:29.495523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:29.544903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894970959695463:4849]
2025-09-30T14:51:29.545189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 446, pipe: [1:7555894970959695463:4849]
2025-09-30T14:51:29.594484Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:29.595161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:29.595180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:29.595234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894970959695463:4849], now have 1 active actors on pipe
2025-09-30T14:51:29.595422Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:29.595470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:29.595477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:29.595481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:29.595525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894970959695463:4849]
2025-09-30T14:51:29.595548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 447 reason: error at write: Disconnected sessionId: src_id|2578c2ce-a91656a9-2a95f046-c2373a74_0
2025-09-30T14:51:29.595753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 447 sessionId: src_id|2578c2ce-a91656a9-2a95f046-c2373a74_0 is DEAD
2025-09-30T14:51:29.595893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2578c2ce-a91656a9-2a95f046-c2373a74_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:29.595902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2578c2ce-a91656a9-2a95f046-c2373a74_0] Write session will restart in 0.009091s
2025-09-30T14:51:29.595923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2578c2ce-a91656a9-2a95f046-c2373a74_0] Write session: Do CDS request
2025-09-30T14:51:29.595929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2578c2ce-a91656a9-2a95f046-c2373a74_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:29.605783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2578c2ce-a91656a9-2a95f046-c2373a74_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:29.605866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:29.605880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 448
2025-09-30T14:51:29.606000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 448 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:29.606044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 448 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:29.606054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=448 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:29.606058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:29.606568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 448 sessionId:  describe result for acl check
2025-09-30T14:51:29.606600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:29.606603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:29.606605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:29.606610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894970959695526:5110] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:29.607139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894970959695526:5110] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:29.609721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894970959695526:5110] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:29.612791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894970959695526:5110] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:29.612804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894970959695526:5110] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:29.612807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894970959695526:5110] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:29.612815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 448 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:29.614211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:29.616839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:29.617044Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:29.617053Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:29.617064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:29.617127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:29.617168Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894970869969475:4358]
2025-09-30T14:51:29.617844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:29.618176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:29.618243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:29.618617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:29.618679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:29.618686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:29.618687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:29.618689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:29.618690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:29.618691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:29.618692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:29.618693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:29.618695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:29.618696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:29.618697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.618698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.618700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.618701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:29.618702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:29.618708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:29.618718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:29.618722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:29.618726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:29.618729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:29.618733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:29.618736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:29.618740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:29.618744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:29.618748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:29.618751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.618763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.618767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.618771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:29.618775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:29.618785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:29.618793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:29.618800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:29.618805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:29.618810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:29.618816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:29.618821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:29.618826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:29.618834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:29.618839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:29.618843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:29.618848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:29.618854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:29.618859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:29.618864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:29.618871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:29.618876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:29.618881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:29.618886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:29.618891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:29.618901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.618906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.618911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.618916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.618920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.618926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.618935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:29.618941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:29.618945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:29.618952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:29.618992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:29.624707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:29.626139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:29.626158Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:29.626161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:29.626165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:29.626173Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 447 [2:7555894970869969475:4358]
2025-09-30T14:51:29.626190Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:29.626204Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:29.626208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:29.626211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:29.626214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:29.626229Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:29.626237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:29.626244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:29.626308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.626319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.626321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.626326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:29.626328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:29.626396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:29.626405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.626419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.626433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.626457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:29.626484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894970959695733:5110], now have 1 active actors on pipe
2025-09-30T14:51:29.626487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894970959695464:2454], now have 1 active actors on pipe
2025-09-30T14:51:29.626494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894970869969469:4358]
2025-09-30T14:51:29.626497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894970869969469:4358]
2025-09-30T14:51:29.626512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894970869969469:4358]
2025-09-30T14:51:29.626527Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:29.626540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:29.626544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:29.626552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:29.626554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:29.626559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:29.626561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:29.626566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 447
2025-09-30T14:51:29.626594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894970869969469:4358]
2025-09-30T14:51:29.626570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 447
2025-09-30T14:51:29.626602Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:29.626605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:29.626628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:29.626633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:29.626690Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d05e29ce-8d0c7eaa-218c0045-58316cf9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:29.626704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:29.626708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:29.626715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:29.626725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:29.626735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:29.626763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:29.626939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:29.626949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:29.626964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:29.627054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 448 partition: 0 MaxSeqNo: 42 sessionId: src_id|d05e29ce-8d0c7eaa-218c0045-58316cf9_0
2025-09-30T14:51:29.627449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2578c2ce-a91656a9-2a95f046-c2373a74_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d05e29ce-8d0c7eaa-218c0045-58316cf9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:29.630172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d05e29ce-8d0c7eaa-218c0045-58316cf9_0] Write session: try to update token
2025-09-30T14:51:29.630188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d05e29ce-8d0c7eaa-218c0045-58316cf9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:29.638906Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:29.638925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:29.638928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:29.638930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:29.638940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894970869969469:4358]
2025-09-30T14:51:29.638945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894970869969469:4358]
2025-09-30T14:51:29.638949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894970869969469:4358]
2025-09-30T14:51:29.638988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:29.638997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.639000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:29.639000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:29.639007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:29.639012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:29.639138Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:29.645383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 448 sessionId: src_id|d05e29ce-8d0c7eaa-218c0045-58316cf9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:29.648106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:29.695936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894970959695748:4849]
2025-09-30T14:51:29.696270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 447, pipe: [1:7555894970959695748:4849]
2025-09-30T14:51:29.745142Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:29.745395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:29.745406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:29.745440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894970959695748:4849], now have 1 active actors on pipe
2025-09-30T14:51:29.745718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894970959695748:4849]
2025-09-30T14:51:29.745718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:29.745723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:29.745747Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:29.745788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 448 reason: error at write: Disconnected sessionId: src_id|d05e29ce-8d0c7eaa-218c0045-58316cf9_0
2025-09-30T14:51:29.745995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 448 sessionId: src_id|d05e29ce-8d0c7eaa-218c0045-58316cf9_0 is DEAD
2025-09-30T14:51:29.746115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d05e29ce-8d0c7eaa-218c0045-58316cf9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:29.746125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d05e29ce-8d0c7eaa-218c0045-58316cf9_0] Write session will restart in 0.005172s
2025-09-30T14:51:29.746148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d05e29ce-8d0c7eaa-218c0045-58316cf9_0] Write session: Do CDS request
2025-09-30T14:51:29.746167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d05e29ce-8d0c7eaa-218c0045-58316cf9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:29.746541Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:29.752806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d05e29ce-8d0c7eaa-218c0045-58316cf9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:29.752934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:29.752951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 449
2025-09-30T14:51:29.753058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 449 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:29.753097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 449 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:29.753107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=449 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:29.753111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:29.753503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 449 sessionId:  describe result for acl check
2025-09-30T14:51:29.753543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:29.753545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:29.753547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:29.753552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894970959695763:5114] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:29.754056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894970959695763:5114] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:29.757006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894970959695763:5114] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:29.760642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894970959695763:5114] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:29.760667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894970959695763:5114] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:29.760670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894970959695763:5114] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:29.760679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 449 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:29.765770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:29.768901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:29.769138Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:29.769151Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:29.769163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:29.769227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:29.769271Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894970869969751:4360]
2025-09-30T14:51:29.769874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:29.770163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:29.770207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:29.770543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:29.770608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:29.770615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:29.770616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:29.770617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:29.770618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:29.770620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:29.770621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:29.770622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:29.770623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:29.770624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:29.770624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.770625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.770626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.770627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:29.770628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:29.770632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:29.770640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:29.770642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:29.770644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:29.770647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:29.770649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:29.770652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:29.770654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:29.770657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:29.770659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:29.770662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.770665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.770667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.770671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:29.770675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:29.770682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:29.770690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:29.770695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:29.770701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:29.770706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:29.770711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:29.770716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:29.770721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:29.770727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:29.770732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:29.770737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:29.770742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:29.770747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:29.770753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:29.770758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:29.770763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:29.770768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:29.770773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:29.770780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:29.770785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:29.770790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.770795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.770799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.770805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.770819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.770824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.770833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:29.770838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:29.770843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:29.770853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:29.770893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:29.776600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:29.777533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:29.777548Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:29.777551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:29.777555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:29.777561Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 448 [2:7555894970869969751:4360]
2025-09-30T14:51:29.777578Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:29.777595Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:29.777602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:29.777606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:29.777608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:29.777625Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:29.777631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:29.777638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:29.777698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.777706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.777708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.777712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:29.777715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:29.777779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:29.777786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.777799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.777817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.777839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:29.777861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894970959695916:5114], now have 1 active actors on pipe
2025-09-30T14:51:29.777870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894970959695749:2454], now have 1 active actors on pipe
2025-09-30T14:51:29.777876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894970869969746:4360]
2025-09-30T14:51:29.777878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894970869969746:4360]
2025-09-30T14:51:29.777880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894970869969746:4360]
2025-09-30T14:51:29.777893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:29.777908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:29.777910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:29.777919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:29.777922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:29.777927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:29.777929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:29.777924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 448
2025-09-30T14:51:29.777928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 448
2025-09-30T14:51:29.777964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894970869969746:4360]
2025-09-30T14:51:29.777976Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:29.777978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:29.777995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:29.777999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:29.778052Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6af52934-c16f76d5-d368e404-534fd186_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:29.778064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:29.778068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:29.778070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:29.778078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:29.778087Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:29.778106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:29.778263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:29.778272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:29.778287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:29.778365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 449 partition: 0 MaxSeqNo: 42 sessionId: src_id|6af52934-c16f76d5-d368e404-534fd186_0
2025-09-30T14:51:29.778753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d05e29ce-8d0c7eaa-218c0045-58316cf9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6af52934-c16f76d5-d368e404-534fd186_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:29.781528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6af52934-c16f76d5-d368e404-534fd186_0] Write session: try to update token
2025-09-30T14:51:29.781546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6af52934-c16f76d5-d368e404-534fd186_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:29.789540Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:29.789559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:29.789562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:29.789564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:29.789573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894970869969746:4360]
2025-09-30T14:51:29.789577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894970869969746:4360]
2025-09-30T14:51:29.789581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894970869969746:4360]
2025-09-30T14:51:29.789624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:29.789628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:29.789635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:29.789638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.789640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:29.789641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:29.789777Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:29.795541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 449 sessionId: src_id|6af52934-c16f76d5-d368e404-534fd186_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:29.798184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:29.845957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894970959696034:4849]
2025-09-30T14:51:29.846243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 448, pipe: [1:7555894970959696034:4849]
2025-09-30T14:51:29.896226Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:29.896908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:29.896926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:29.896964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894970959696034:4849], now have 1 active actors on pipe
2025-09-30T14:51:29.897191Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:29.897240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:29.897241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894970959696034:4849]
2025-09-30T14:51:29.897257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:29.897263Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:29.897318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 449 reason: error at write: Disconnected sessionId: src_id|6af52934-c16f76d5-d368e404-534fd186_0
2025-09-30T14:51:29.897495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 449 sessionId: src_id|6af52934-c16f76d5-d368e404-534fd186_0 is DEAD
2025-09-30T14:51:29.897641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6af52934-c16f76d5-d368e404-534fd186_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:29.897647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6af52934-c16f76d5-d368e404-534fd186_0] Write session will restart in 0.008069s
2025-09-30T14:51:29.897667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6af52934-c16f76d5-d368e404-534fd186_0] Write session: Do CDS request
2025-09-30T14:51:29.897671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6af52934-c16f76d5-d368e404-534fd186_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:29.906777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6af52934-c16f76d5-d368e404-534fd186_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:29.906920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:29.906938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 450
2025-09-30T14:51:29.907056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 450 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:29.907088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 450 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:29.907098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=450 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:29.907102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:29.907746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 450 sessionId:  describe result for acl check
2025-09-30T14:51:29.907808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:29.907816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:29.907818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:29.907824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894970959696100:5119] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:29.908378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894970959696100:5119] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:29.910739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894970959696100:5119] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:29.913830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894970959696100:5119] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:29.913844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894970959696100:5119] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:29.913848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894970959696100:5119] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:29.913856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 450 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:29.916209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:29.919110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:29.919335Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:29.919350Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:29.919367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:29.919442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:29.919483Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894970869970041:4363]
2025-09-30T14:51:29.920106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:29.920428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:29.920477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:29.920809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:29.920877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:29.920884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:29.920885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:29.920886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:29.920887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:29.920889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:29.920890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:29.920891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:29.920893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:29.920894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:29.920896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.920897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.920898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.920899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:29.920900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:29.920906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:29.920917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:29.920922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:29.920926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:29.920930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:29.920934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:29.920937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:29.920941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:29.920950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:29.920955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:29.920964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.920968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.920977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.920986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:29.920995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:29.921003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:29.921016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:29.921027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:29.921037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:29.921043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:29.921048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:29.921053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:29.921063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:29.921072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:29.921082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:29.921091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:29.921102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:29.921113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:29.921123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:29.921127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:29.921133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:29.921145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:29.921155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:29.921164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:29.921173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:29.921183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.921190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.921195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.921205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.921214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.921224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.921234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:29.921245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:29.921249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:29.921257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:29.921308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:29.926881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:29.928164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:29.928181Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:29.928183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:29.928186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:29.928192Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 449 [2:7555894970869970041:4363]
2025-09-30T14:51:29.928208Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:29.928222Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:29.928225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:29.928232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:29.928235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:29.928250Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:29.928261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:29.928267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:29.928324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.928330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.928333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.928336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:29.928338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:29.928403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:29.928409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.928423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:29.928441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:29.928462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:29.928486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894970959696280:5119], now have 1 active actors on pipe
2025-09-30T14:51:29.928489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894970959696047:2454], now have 1 active actors on pipe
2025-09-30T14:51:29.928496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894970869970036:4363]
2025-09-30T14:51:29.928499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894970869970036:4363]
2025-09-30T14:51:29.928500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894970869970036:4363]
2025-09-30T14:51:29.928512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:29.928524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:29.928527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:29.928531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:29.928533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:29.928537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:29.928540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:29.928571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894970869970036:4363]
2025-09-30T14:51:29.928579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:29.928594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:29.928574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 449
2025-09-30T14:51:29.928575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 449
2025-09-30T14:51:29.928623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:29.928632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:29.928659Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf8c7115-e428bfbc-69294fb7-5c72909c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:29.928676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:29.928682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:29.928685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:29.928693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:29.928702Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:29.928715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:29.928880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:29.928888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:29.928998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 450 partition: 0 MaxSeqNo: 42 sessionId: src_id|bf8c7115-e428bfbc-69294fb7-5c72909c_0
2025-09-30T14:51:29.928901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:29.929389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6af52934-c16f76d5-d368e404-534fd186_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bf8c7115-e428bfbc-69294fb7-5c72909c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:29.932141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf8c7115-e428bfbc-69294fb7-5c72909c_0] Write session: try to update token
2025-09-30T14:51:29.932157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf8c7115-e428bfbc-69294fb7-5c72909c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:29.940945Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:29.940967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:29.940976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894970869970036:4363]
2025-09-30T14:51:29.941022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:29.941036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:29.941205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:29.941356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:29.941506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:29.941654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:29.941847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:29.941895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:29.946757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 450 sessionId: src_id|bf8c7115-e428bfbc-69294fb7-5c72909c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:29.949269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:29.949425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:29.949461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:29.949495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:29.949579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:29.951923Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:29.951945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:29.951948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:29.951950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:29.951959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894970869970036:4363]
2025-09-30T14:51:29.951963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894970869970036:4363]
2025-09-30T14:51:29.951967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894970869970036:4363]
2025-09-30T14:51:29.952007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:29.952016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:29.952020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:29.952021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:29.952022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:29.952028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:29.952158Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:29.997495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894970959696340:4849]
2025-09-30T14:51:29.997689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 449, pipe: [1:7555894970959696340:4849]
2025-09-30T14:51:30.055181Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:30.063079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:30.063109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:30.063297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:30.063365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:30.063432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:30.063497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:30.063613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:30.063623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:30.063693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:30.063754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:30.063816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:30.063883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:30.063927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:30.063937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:30.064003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:30.064064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:30.064130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:30.064196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:30.064244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:30.064251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:30.064342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:30.064404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:30.064467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:30.064530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:30.064573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:30.064581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:30.064648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:30.064736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:30.064801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:30.064863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:30.064906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:30.064913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:30.064981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:30.065046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:30.065111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:30.065174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:30.065219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:30.065227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:30.065295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:30.065358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:30.065424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:30.065489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:30.065534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:30.065541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:30.065613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:30.065681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:30.065747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:30.065812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:30.065856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:30.065863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:30.065936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:30.066000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:30.066064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:30.066128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:30.066174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:30.066180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:30.066247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:30.066308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:30.066377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:30.066442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:30.066489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:30.066496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:30.066571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894970959696340:4849], now have 1 active actors on pipe
2025-09-30T14:51:30.066914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:30.066931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:30.066931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894970959696340:4849]
2025-09-30T14:51:30.066954Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:30.066959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 450 reason: error at write: Disconnected sessionId: src_id|bf8c7115-e428bfbc-69294fb7-5c72909c_0
2025-09-30T14:51:30.067140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 450 sessionId: src_id|bf8c7115-e428bfbc-69294fb7-5c72909c_0 is DEAD
2025-09-30T14:51:30.067277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf8c7115-e428bfbc-69294fb7-5c72909c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:30.067283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf8c7115-e428bfbc-69294fb7-5c72909c_0] Write session will restart in 0.008099s
2025-09-30T14:51:30.067300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf8c7115-e428bfbc-69294fb7-5c72909c_0] Write session: Do CDS request
2025-09-30T14:51:30.067304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf8c7115-e428bfbc-69294fb7-5c72909c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:30.067483Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:30.076830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf8c7115-e428bfbc-69294fb7-5c72909c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:30.076915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:30.076932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 451
2025-09-30T14:51:30.077057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 451 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:30.077087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 451 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:30.077097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=451 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:30.077101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:30.077543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 451 sessionId:  describe result for acl check
2025-09-30T14:51:30.077579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:30.077586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:30.077587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:30.077595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894975254663699:5125] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:30.078155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894975254663699:5125] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:30.081515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894975254663699:5125] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:30.084203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894975254663699:5125] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:30.084216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894975254663699:5125] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:30.084219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894975254663699:5125] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:30.084227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 451 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:30.085536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:30.088265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:30.088444Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:30.088454Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:30.088463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:30.088508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:30.088545Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894975164937618:4366]
2025-09-30T14:51:30.089201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:30.089459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:30.089502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:30.089822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:30.089876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:30.089883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:30.089884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:30.089885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:30.089887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:30.089888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:30.089890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:30.089891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:30.089892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:30.089893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:30.089894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.089896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.089897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.089898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:30.089900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:30.089905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:30.089916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:30.089920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:30.089925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:30.089929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:30.089933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:30.089937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:30.089941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:30.089945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:30.089950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:30.089954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.089958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.089962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.089966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:30.089970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:30.089977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:30.089984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:30.089990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:30.089996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:30.090000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:30.090005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:30.090009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:30.090014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:30.090018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:30.090023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:30.090027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:30.090031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:30.090036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:30.090040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:30.090044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:30.090050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:30.090055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:30.090060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:30.090065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:30.090070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:30.090075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.090081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.090085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.090090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.090095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.090106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.090110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:30.090115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:30.090124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:30.090129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:30.090177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:30.095585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:30.096453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:30.096471Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:30.096474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:30.096478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:30.096486Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 450 [2:7555894975164937618:4366]
2025-09-30T14:51:30.096501Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:30.096522Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:30.096529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:30.096532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:30.096535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:30.096551Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:30.096564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:30.096572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:30.096632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.096640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.096642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.096645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:30.096648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:30.096712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:30.096720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.096732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.096745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.096763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:30.096786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894975254663913:5125], now have 1 active actors on pipe
2025-09-30T14:51:30.096795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894975254663640:2454], now have 1 active actors on pipe
2025-09-30T14:51:30.096802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894975164937613:4366]
2025-09-30T14:51:30.096804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894975164937613:4366]
2025-09-30T14:51:30.096806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894975164937613:4366]
2025-09-30T14:51:30.096821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:30.096840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:30.096850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:30.096854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:30.096855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:30.096857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:30.096858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:30.096855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 450
2025-09-30T14:51:30.096856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 450
2025-09-30T14:51:30.096884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894975164937613:4366]
2025-09-30T14:51:30.096892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:30.096902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:30.096917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:30.096926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:30.096959Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61488f4-8c7186e-fbf59d65-71f2d968_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:30.096970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:30.096974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:30.096981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:30.096990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:30.097000Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:30.097027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:30.097163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:30.097174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:30.097188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:30.097283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 451 partition: 0 MaxSeqNo: 42 sessionId: src_id|61488f4-8c7186e-fbf59d65-71f2d968_0
2025-09-30T14:51:30.097653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf8c7115-e428bfbc-69294fb7-5c72909c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|61488f4-8c7186e-fbf59d65-71f2d968_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:30.100237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61488f4-8c7186e-fbf59d65-71f2d968_0] Write session: try to update token
2025-09-30T14:51:30.100252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61488f4-8c7186e-fbf59d65-71f2d968_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:30.108900Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:30.108923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:30.108926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:30.108928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:30.108936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894975164937613:4366]
2025-09-30T14:51:30.108941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894975164937613:4366]
2025-09-30T14:51:30.108946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894975164937613:4366]
2025-09-30T14:51:30.108984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:30.108987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:30.108989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:30.108993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:30.108994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.108997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:30.109149Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:30.115519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 451 sessionId: src_id|61488f4-8c7186e-fbf59d65-71f2d968_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:30.118181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:30.166933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894975254663941:4849]
2025-09-30T14:51:30.167087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 450, pipe: [1:7555894975254663941:4849]
2025-09-30T14:51:30.219914Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:30.220378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:30.220394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:30.220429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894975254663941:4849], now have 1 active actors on pipe
2025-09-30T14:51:30.220648Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:30.220717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:30.220807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 451 reason: status is not ok: tablet will be restarted right now sessionId: src_id|61488f4-8c7186e-fbf59d65-71f2d968_0
2025-09-30T14:51:30.221026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 451 sessionId: src_id|61488f4-8c7186e-fbf59d65-71f2d968_0 is DEAD
2025-09-30T14:51:30.221187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61488f4-8c7186e-fbf59d65-71f2d968_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:30.221198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61488f4-8c7186e-fbf59d65-71f2d968_0] Write session will restart in 0.007255s
2025-09-30T14:51:30.221207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894975254663941:4849]
2025-09-30T14:51:30.221224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61488f4-8c7186e-fbf59d65-71f2d968_0] Write session: Do CDS request
2025-09-30T14:51:30.221214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:30.221229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61488f4-8c7186e-fbf59d65-71f2d968_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:30.229915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61488f4-8c7186e-fbf59d65-71f2d968_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:30.229992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:30.230010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 452
2025-09-30T14:51:30.230151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 452 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:30.230184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 452 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:30.230195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=452 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:30.230209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:30.230749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 452 sessionId:  describe result for acl check
2025-09-30T14:51:30.230783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:30.230789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:30.230791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:30.230798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894975254663992:5136] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:30.231293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894975254663992:5136] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:30.234211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894975254663992:5136] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:30.237988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894975254663992:5136] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:30.238003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894975254663992:5136] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:30.238006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894975254663992:5136] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:30.238014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 452 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:30.242325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:30.245336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:30.245540Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:30.245550Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:30.245562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:30.245615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:30.245645Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894975164937933:4380]
2025-09-30T14:51:30.246122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:30.246448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:30.246489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:30.246743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:30.246794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:30.246795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:30.246795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:30.246796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:30.246797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:30.246798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:30.246799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:30.246799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:30.246800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:30.246801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:30.246802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.246802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.246803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.246804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:30.246805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:30.246809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:30.246821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:30.246825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:30.246829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:30.246833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:30.246838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:30.246842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:30.246845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:30.246849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:30.246856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:30.246860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.246864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.246868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.246872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:30.246877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:30.246883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:30.246889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:30.246893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:30.246896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:30.246899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:30.246902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:30.246905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:30.246908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:30.246911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:30.246914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:30.246917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:30.246920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:30.246924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:30.246927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:30.246931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:30.246934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:30.246936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:30.246940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:30.246942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:30.246945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:30.246948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.246950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.246955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.246957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.246960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.246962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.246965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:30.246968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:30.246971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:30.246974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:30.246999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:30.252708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:30.253912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:30.253926Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:30.253928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:30.253933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:30.253940Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 451 [2:7555894975164937933:4380]
2025-09-30T14:51:30.253957Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:30.253974Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:30.253978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:30.253981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:30.253984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:30.254000Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:30.254006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:30.254013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:30.254078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.254086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.254088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.254092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:30.254095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:30.254162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:30.254170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.254182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.254194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.254210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:30.254228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894975254664145:5136], now have 1 active actors on pipe
2025-09-30T14:51:30.254236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894975254663951:2454], now have 1 active actors on pipe
2025-09-30T14:51:30.254243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894975164937928:4380]
2025-09-30T14:51:30.254246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894975164937928:4380]
2025-09-30T14:51:30.254248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894975164937928:4380]
2025-09-30T14:51:30.254259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:30.254272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:30.254277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:30.254278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:30.254281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:30.254292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:30.254295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:30.254335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894975164937928:4380]
2025-09-30T14:51:30.254346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:30.254357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:30.254378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 451
2025-09-30T14:51:30.254676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 451
2025-09-30T14:51:30.254808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:30.254820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:30.254848Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f034501a-6cad1a23-acc22766-c75e4a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:30.254860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:30.254864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:30.254866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:30.254877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:30.254893Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:30.254911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:30.255094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:30.255102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:30.255118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:30.255202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 452 partition: 0 MaxSeqNo: 42 sessionId: src_id|f034501a-6cad1a23-acc22766-c75e4a8_0
2025-09-30T14:51:30.255572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61488f4-8c7186e-fbf59d65-71f2d968_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f034501a-6cad1a23-acc22766-c75e4a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:30.258322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f034501a-6cad1a23-acc22766-c75e4a8_0] Write session: try to update token
2025-09-30T14:51:30.258340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f034501a-6cad1a23-acc22766-c75e4a8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:30.272081Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:30.272099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:30.272111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894975164937928:4380]
2025-09-30T14:51:30.272163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:30.272166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:30.272363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:30.272522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:30.272685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:30.272841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:30.273036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:30.273078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:30.273345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 452 sessionId: src_id|f034501a-6cad1a23-acc22766-c75e4a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:30.276062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:30.277193Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:30.277208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:30.277211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:30.277213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:30.277223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894975164937928:4380]
2025-09-30T14:51:30.277227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894975164937928:4380]
2025-09-30T14:51:30.277232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894975164937928:4380]
2025-09-30T14:51:30.277269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:30.277275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.277278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:30.277294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:30.277307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:30.277311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:30.277419Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:30.321603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894975254664238:4849]
2025-09-30T14:51:30.321822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 451, pipe: [1:7555894975254664238:4849]
2025-09-30T14:51:30.392599Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:30.393286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:30.393301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:30.393321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894975254664238:4849], now have 1 active actors on pipe
2025-09-30T14:51:30.393525Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:30.393562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894975254664238:4849]
2025-09-30T14:51:30.393563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:30.393567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:30.393596Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:30.393636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 452 reason: error at write: Disconnected sessionId: src_id|f034501a-6cad1a23-acc22766-c75e4a8_0
2025-09-30T14:51:30.393812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 452 sessionId: src_id|f034501a-6cad1a23-acc22766-c75e4a8_0 is DEAD
2025-09-30T14:51:30.393945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f034501a-6cad1a23-acc22766-c75e4a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:30.393951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f034501a-6cad1a23-acc22766-c75e4a8_0] Write session will restart in 0.009560s
2025-09-30T14:51:30.393968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f034501a-6cad1a23-acc22766-c75e4a8_0] Write session: Do CDS request
2025-09-30T14:51:30.393974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f034501a-6cad1a23-acc22766-c75e4a8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:30.404739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f034501a-6cad1a23-acc22766-c75e4a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:30.404855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:30.404871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 453
2025-09-30T14:51:30.404997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 453 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:30.405029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 453 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:30.405038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=453 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:30.405042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:30.405410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 453 sessionId:  describe result for acl check
2025-09-30T14:51:30.405439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:30.405445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:30.405446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:30.405451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894975254664357:5140] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:30.405879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894975254664357:5140] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:30.408320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894975254664357:5140] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:30.410929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894975254664357:5140] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:30.410945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894975254664357:5140] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:30.410949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894975254664357:5140] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:30.410958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 453 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:30.411396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:30.413918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:30.414122Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:30.414132Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:30.414143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:30.414199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:30.414238Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894975164938213:4382]
2025-09-30T14:51:30.414895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:30.415254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:30.415299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:30.415631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:30.415681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:30.415686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:30.415687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:30.415688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:30.415689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:30.415689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:30.415690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:30.415691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:30.415692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:30.415692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:30.415693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.415694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.415695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.415695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:30.415696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:30.415699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:30.415706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:30.415708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:30.415711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:30.415714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:30.415718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:30.415722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:30.415726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:30.415729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:30.415734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:30.415738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.415742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.415744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.415747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:30.415749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:30.415755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:30.415759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:30.415763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:30.415766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:30.415769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:30.415774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:30.415783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:30.415788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:30.415793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:30.415799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:30.415808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:30.415811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:30.415814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:30.415817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:30.415820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:30.415823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:30.415826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:30.415829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:30.415832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:30.415834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:30.415837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.415840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.415842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.415845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.415848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.415855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.415858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:30.415862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:30.415864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:30.415867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:30.415895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:30.421250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:30.422117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:30.422135Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:30.422138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:30.422143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:30.422150Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 452 [2:7555894975164938213:4382]
2025-09-30T14:51:30.422167Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:30.422182Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:30.422189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:30.422192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:30.422195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:30.422210Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:30.422220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:30.422231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:30.422294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.422302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.422305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.422308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:30.422311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:30.422375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:30.422382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.422393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.422409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.422429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:30.422448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894975254664516:5140], now have 1 active actors on pipe
2025-09-30T14:51:30.422456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894975254664239:2454], now have 1 active actors on pipe
2025-09-30T14:51:30.422462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894975164938208:4382]
2025-09-30T14:51:30.422465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894975164938208:4382]
2025-09-30T14:51:30.422467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894975164938208:4382]
2025-09-30T14:51:30.422479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:30.422508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:30.422508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:30.422512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:30.422514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:30.422528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:30.422536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:30.422564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894975164938208:4382]
2025-09-30T14:51:30.422575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:30.422587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:30.422568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 452
2025-09-30T14:51:30.422571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 452
2025-09-30T14:51:30.422700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:30.422711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:30.422735Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c677a9bd-e6210180-11d349a9-c924a9fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:30.422747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:30.422754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:30.422757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:30.422768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:30.422782Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:30.422799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:30.422935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:30.422942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:30.422955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:30.423040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 453 partition: 0 MaxSeqNo: 42 sessionId: src_id|c677a9bd-e6210180-11d349a9-c924a9fb_0
2025-09-30T14:51:30.423477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f034501a-6cad1a23-acc22766-c75e4a8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c677a9bd-e6210180-11d349a9-c924a9fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:30.426284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c677a9bd-e6210180-11d349a9-c924a9fb_0] Write session: try to update token
2025-09-30T14:51:30.426304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c677a9bd-e6210180-11d349a9-c924a9fb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:30.433774Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:30.433792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:30.433802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894975164938208:4382]
2025-09-30T14:51:30.433842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:30.433846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:30.434010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:30.434156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:30.434303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:30.434445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:30.434651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:30.434691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:30.440108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 453 sessionId: src_id|c677a9bd-e6210180-11d349a9-c924a9fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:30.442695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:30.442891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:30.442911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:30.442946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:30.443036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:30.444089Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:30.444101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:30.444103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:30.444104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:30.444111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894975164938208:4382]
2025-09-30T14:51:30.444114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894975164938208:4382]
2025-09-30T14:51:30.444117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894975164938208:4382]
2025-09-30T14:51:30.444146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:30.444156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.444160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:30.444167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:30.444180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:30.444185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:30.444295Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:30.493642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894975254664531:4849]
2025-09-30T14:51:30.493973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 452, pipe: [1:7555894975254664531:4849]
2025-09-30T14:51:30.548812Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:30.556408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:30.556432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:30.556582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:30.556643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:30.556707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:30.556768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:30.556809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:30.556817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:30.556880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:30.556938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:30.556998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:30.557063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:30.557313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:30.557321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:30.557387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:30.557446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:30.557506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:30.557567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:30.557608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:30.557614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:30.557678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:30.557739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:30.557797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:30.557859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:30.557900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:30.557909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:30.557971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:30.558030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:30.558087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:30.558149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:30.558191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:30.558197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:30.558260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:30.558320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:30.558381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:30.558442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:30.558488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:30.558494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:30.558567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:30.558625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:30.558686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:30.558747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:30.558866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:30.558872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:30.558933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:30.558995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:30.559062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:30.559141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:30.559190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:30.559195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:30.559276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:30.559334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:30.559392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:30.559453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:30.559502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:30.559509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:30.559571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:30.559629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:30.559696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:30.559763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:30.559874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:30.559881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:30.559932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894975254664531:4849], now have 1 active actors on pipe
2025-09-30T14:51:30.560186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:30.560189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:30.560200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:30.560228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 453 reason: error at write: Disconnected sessionId: src_id|c677a9bd-e6210180-11d349a9-c924a9fb_0
2025-09-30T14:51:30.560251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894975254664531:4849]
2025-09-30T14:51:30.560853Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:30.560860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 453 sessionId: src_id|c677a9bd-e6210180-11d349a9-c924a9fb_0 is DEAD
2025-09-30T14:51:30.561015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c677a9bd-e6210180-11d349a9-c924a9fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:30.561027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c677a9bd-e6210180-11d349a9-c924a9fb_0] Write session will restart in 0.009418s
2025-09-30T14:51:30.561057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c677a9bd-e6210180-11d349a9-c924a9fb_0] Write session: Do CDS request
2025-09-30T14:51:30.561063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c677a9bd-e6210180-11d349a9-c924a9fb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:30.571805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c677a9bd-e6210180-11d349a9-c924a9fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:30.571860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:30.571878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 454
2025-09-30T14:51:30.572048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 454 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:30.572084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 454 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:30.572094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=454 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:30.572099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:30.572516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 454 sessionId:  describe result for acl check
2025-09-30T14:51:30.572556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:30.572565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:30.572567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:30.572573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894975254664606:5145] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:30.573121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894975254664606:5145] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:30.576346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894975254664606:5145] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:30.579320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894975254664606:5145] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:30.579336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894975254664606:5145] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:30.579340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894975254664606:5145] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:30.579347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 454 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:30.580188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:30.583226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:30.583434Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:30.583444Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:30.583455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:30.583511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:30.583551Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894975164938496:4385]
2025-09-30T14:51:30.584212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:30.584457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:30.584495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:30.584812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:30.584867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:30.584873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:30.584874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:30.584875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:30.584877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:30.584878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:30.584879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:30.584881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:30.584882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:30.584883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:30.584885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.584886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.584887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.584888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:30.584890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:30.584894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:30.584905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:30.584909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:30.584913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:30.584917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:30.584921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:30.584925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:30.584930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:30.584934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:30.584938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:30.584942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.584946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.584950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.584954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:30.584958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:30.584965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:30.584972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:30.584979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:30.584988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:30.584994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:30.585004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:30.585009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:30.585019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:30.585024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:30.585029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:30.585038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:30.585044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:30.585053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:30.585057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:30.585062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:30.585068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:30.585077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:30.585082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:30.585091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:30.585100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:30.585109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.585115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.585119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.585124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.585133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.585138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.585144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:30.585149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:30.585157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:30.585162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:30.585208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:30.590483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:30.591599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:30.591610Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:30.591611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:30.591614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:30.591619Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 453 [2:7555894975164938496:4385]
2025-09-30T14:51:30.591630Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:30.591642Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:30.591644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:30.591646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:30.591648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:30.591659Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:30.591664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:30.591670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:30.591725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.591734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.591735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.591738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:30.591739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:30.591790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:30.591796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.591804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.591810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.591820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:30.591832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894975164938491:4385]
2025-09-30T14:51:30.591838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894975164938491:4385]
2025-09-30T14:51:30.591839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894975164938491:4385]
2025-09-30T14:51:30.591845Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:30.591854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:30.591861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:30.591863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:30.591864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:30.591864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:30.591866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:30.591871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894975254664808:5145], now have 1 active actors on pipe
2025-09-30T14:51:30.591894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894975254664532:2454], now have 1 active actors on pipe
2025-09-30T14:51:30.591900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894975164938491:4385]
2025-09-30T14:51:30.591906Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:30.591924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:30.591970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 453
2025-09-30T14:51:30.591990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 453
2025-09-30T14:51:30.592039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:30.592047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:30.592068Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ff8773f-f4ce54dc-bc68b3e6-4a61afe6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:30.592077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:30.592079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:30.592081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:30.592088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:30.592099Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:30.592109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:30.592280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:30.592293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:30.592318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:30.592411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 454 partition: 0 MaxSeqNo: 42 sessionId: src_id|2ff8773f-f4ce54dc-bc68b3e6-4a61afe6_0
2025-09-30T14:51:30.592798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c677a9bd-e6210180-11d349a9-c924a9fb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2ff8773f-f4ce54dc-bc68b3e6-4a61afe6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:30.595677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ff8773f-f4ce54dc-bc68b3e6-4a61afe6_0] Write session: try to update token
2025-09-30T14:51:30.595696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ff8773f-f4ce54dc-bc68b3e6-4a61afe6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:30.603223Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:30.603264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:30.603273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894975164938491:4385]
2025-09-30T14:51:30.603311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:30.603318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:30.603489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:30.603637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:30.603844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:30.603984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:30.604178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:30.604225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:30.610635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 454 sessionId: src_id|2ff8773f-f4ce54dc-bc68b3e6-4a61afe6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:30.613335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:30.613980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:30.614002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:30.614022Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:30.614025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:30.614027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:30.614029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:30.614037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894975164938491:4385]
2025-09-30T14:51:30.614041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894975164938491:4385]
2025-09-30T14:51:30.614045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894975164938491:4385]
2025-09-30T14:51:30.614084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:30.614092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:30.614099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.614101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:30.614105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:30.614109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:30.614230Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:30.660544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894975254664823:4849]
2025-09-30T14:51:30.660812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 453, pipe: [1:7555894975254664823:4849]
2025-09-30T14:51:30.722557Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:30.722951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:30.722983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894975254664823:4849], now have 1 active actors on pipe
2025-09-30T14:51:30.723087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:30.723183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894975254664823:4849]
2025-09-30T14:51:30.723185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:30.723189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:30.723206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:30.723271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 454 reason: error at write: Disconnected sessionId: src_id|2ff8773f-f4ce54dc-bc68b3e6-4a61afe6_0
2025-09-30T14:51:30.723456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 454 sessionId: src_id|2ff8773f-f4ce54dc-bc68b3e6-4a61afe6_0 is DEAD
2025-09-30T14:51:30.723592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ff8773f-f4ce54dc-bc68b3e6-4a61afe6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:30.723601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ff8773f-f4ce54dc-bc68b3e6-4a61afe6_0] Write session will restart in 0.006246s
2025-09-30T14:51:30.723623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ff8773f-f4ce54dc-bc68b3e6-4a61afe6_0] Write session: Do CDS request
2025-09-30T14:51:30.723628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ff8773f-f4ce54dc-bc68b3e6-4a61afe6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:30.730791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ff8773f-f4ce54dc-bc68b3e6-4a61afe6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:30.730896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:30.730911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 455
2025-09-30T14:51:30.731015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 455 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:30.731049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 455 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:30.731054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=455 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:30.731058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:30.731669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 455 sessionId:  describe result for acl check
2025-09-30T14:51:30.731704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:30.731706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:30.731708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:30.731715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894975254664851:5149] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:30.732250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894975254664851:5149] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:30.734585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894975254664851:5149] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:30.737395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894975254664851:5149] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:30.737407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894975254664851:5149] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:30.737411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894975254664851:5149] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:30.737418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 455 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:30.741693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:30.744641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:30.744853Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:30.744869Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:30.744880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:30.744936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:30.744974Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894975164938778:4387]
2025-09-30T14:51:30.745625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:30.745912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:30.745968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:30.746298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:30.746362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:30.746368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:30.746369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:30.746370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:30.746371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:30.746373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:30.746374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:30.746375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:30.746376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:30.746377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:30.746378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.746379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.746380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.746381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:30.746382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:30.746388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:30.746397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:30.746401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:30.746405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:30.746409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:30.746413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:30.746417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:30.746421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:30.746425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:30.746429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:30.746433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.746437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.746441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.746445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:30.746448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:30.746456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:30.746464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:30.746470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:30.746476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:30.746485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:30.746508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:30.746517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:30.746525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:30.746534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:30.746541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:30.746549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:30.746555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:30.746563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:30.746569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:30.746577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:30.746581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:30.746586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:30.746590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:30.746594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:30.746599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:30.746604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.746613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.746622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.746627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.746635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.746640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.746645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:30.746654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:30.746658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:30.746668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:30.746713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:30.752098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:30.753006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:30.753023Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:30.753026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:30.753030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:30.753037Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 454 [2:7555894975164938778:4387]
2025-09-30T14:51:30.753050Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:30.753070Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:30.753077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:30.753080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:30.753082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:30.753096Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:30.753104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:30.753111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:30.753173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.753179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.753182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.753186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:30.753188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:30.753249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:30.753258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.753268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.753283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.753310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:30.753335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894975254665005:5149], now have 1 active actors on pipe
2025-09-30T14:51:30.753338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894975254664824:2454], now have 1 active actors on pipe
2025-09-30T14:51:30.753344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894975164938773:4387]
2025-09-30T14:51:30.753347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894975164938773:4387]
2025-09-30T14:51:30.753349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894975164938773:4387]
2025-09-30T14:51:30.753364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:30.753377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:30.753381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:30.753386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:30.753388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:30.753394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:30.753397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:30.753420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894975164938773:4387]
2025-09-30T14:51:30.753429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:30.753432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:30.753392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 454
2025-09-30T14:51:30.753402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 454
2025-09-30T14:51:30.753455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:30.753468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:30.753515Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d365bbb-56d4ef86-9d3a5d27-e614850a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:30.753527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:30.753532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:30.753534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:30.753544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:30.753554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:30.753571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:30.753736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:30.753751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:30.753773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:30.753877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 455 partition: 0 MaxSeqNo: 42 sessionId: src_id|3d365bbb-56d4ef86-9d3a5d27-e614850a_0
2025-09-30T14:51:30.754251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ff8773f-f4ce54dc-bc68b3e6-4a61afe6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3d365bbb-56d4ef86-9d3a5d27-e614850a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:30.756868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d365bbb-56d4ef86-9d3a5d27-e614850a_0] Write session: try to update token
2025-09-30T14:51:30.756882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d365bbb-56d4ef86-9d3a5d27-e614850a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:30.765317Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:30.765337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:30.765339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:30.765341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:30.765351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894975164938773:4387]
2025-09-30T14:51:30.765356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894975164938773:4387]
2025-09-30T14:51:30.765360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894975164938773:4387]
2025-09-30T14:51:30.765396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:30.765402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.765404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:30.765405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:30.765409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:30.765412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:30.765550Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:30.769990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 455 sessionId: src_id|3d365bbb-56d4ef86-9d3a5d27-e614850a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:30.772792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:30.823326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894975254665115:4849]
2025-09-30T14:51:30.823531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 454, pipe: [1:7555894975254665115:4849]
2025-09-30T14:51:30.881949Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:30.882250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:30.882266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:30.882304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894975254665115:4849], now have 1 active actors on pipe
2025-09-30T14:51:30.882549Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:30.882549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:30.882565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894975254665115:4849]
2025-09-30T14:51:30.882587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:30.882589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:30.882665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 455 reason: error at write: Disconnected sessionId: src_id|3d365bbb-56d4ef86-9d3a5d27-e614850a_0
2025-09-30T14:51:30.882860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 455 sessionId: src_id|3d365bbb-56d4ef86-9d3a5d27-e614850a_0 is DEAD
2025-09-30T14:51:30.883025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d365bbb-56d4ef86-9d3a5d27-e614850a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:30.883034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d365bbb-56d4ef86-9d3a5d27-e614850a_0] Write session will restart in 0.008929s
2025-09-30T14:51:30.883058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d365bbb-56d4ef86-9d3a5d27-e614850a_0] Write session: Do CDS request
2025-09-30T14:51:30.883066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d365bbb-56d4ef86-9d3a5d27-e614850a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:30.892714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d365bbb-56d4ef86-9d3a5d27-e614850a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:30.892832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:30.892846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 456
2025-09-30T14:51:30.892961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 456 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:30.892991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 456 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:30.893001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=456 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:30.893005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:30.893449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 456 sessionId:  describe result for acl check
2025-09-30T14:51:30.893480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:30.893484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:30.893486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:30.893490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894975254665204:5154] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:30.893905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894975254665204:5154] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:30.895995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894975254665204:5154] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:30.898431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894975254665204:5154] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:30.898445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894975254665204:5154] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:30.898448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894975254665204:5154] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:30.898456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 456 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:30.900653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:30.903301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:30.903470Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:30.903480Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:30.903489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:30.903524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:30.903552Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894975164939073:4390]
2025-09-30T14:51:30.904021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:30.904306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:30.904343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:30.904577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:30.904623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:30.904629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:30.904630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:30.904630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:30.904631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:30.904632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:30.904632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:30.904633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:30.904634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:30.904634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:30.904635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.904636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.904636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.904637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:30.904638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:30.904641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:30.904648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:30.904650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:30.904653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:30.904655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:30.904657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:30.904660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:30.904662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:30.904664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:30.904667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:30.904669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.904671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.904673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.904676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:30.904678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:30.904683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:30.904688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:30.904694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:30.904697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:30.904700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:30.904703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:30.904705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:30.904708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:30.904711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:30.904714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:30.904716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:30.904720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:30.904722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:30.904725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:30.904727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:30.904730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:30.904733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:30.904736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:30.904738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:30.904741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:30.904743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.904746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.904748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.904751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.904754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.904757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.904759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:30.904762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:30.904764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:30.904767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:30.904790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:30.909961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:30.910896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:30.910907Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:30.910909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:30.910911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:30.910916Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 455 [2:7555894975164939073:4390]
2025-09-30T14:51:30.910931Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:30.910951Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:30.910958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:30.910961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:30.910962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:30.910977Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:30.910988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:30.910993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:30.911048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.911054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.911055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.911058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:30.911060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:30.911110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:30.911117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.911128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:30.911138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:30.911154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:30.911171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894975254665128:2454], now have 1 active actors on pipe
2025-09-30T14:51:30.911178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894975254665381:5154], now have 1 active actors on pipe
2025-09-30T14:51:30.911183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894975164939068:4390]
2025-09-30T14:51:30.911186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894975164939068:4390]
2025-09-30T14:51:30.911188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894975164939068:4390]
2025-09-30T14:51:30.911202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:30.911219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:30.911220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:30.911223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:30.911226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:30.911236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:30.911257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:30.911280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894975164939068:4390]
2025-09-30T14:51:30.911294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:30.911280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 455
2025-09-30T14:51:30.911315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:30.911292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 455
2025-09-30T14:51:30.911331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:30.911340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:30.911362Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48cbac7c-ca719126-ad2802d2-90bf4a9e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:30.911373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:30.911376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:30.911383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:30.911391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:30.911405Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:30.911421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:30.911562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:30.911576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:30.911599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:30.911683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 456 partition: 0 MaxSeqNo: 42 sessionId: src_id|48cbac7c-ca719126-ad2802d2-90bf4a9e_0
2025-09-30T14:51:30.912060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d365bbb-56d4ef86-9d3a5d27-e614850a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|48cbac7c-ca719126-ad2802d2-90bf4a9e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:30.914721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48cbac7c-ca719126-ad2802d2-90bf4a9e_0] Write session: try to update token
2025-09-30T14:51:30.914738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48cbac7c-ca719126-ad2802d2-90bf4a9e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:30.927192Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:30.927208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:30.927217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894975164939068:4390]
2025-09-30T14:51:30.927290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:30.927384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:30.927587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:30.927749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:30.927903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:30.928058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:30.928273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:30.928321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:30.929282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 456 sessionId: src_id|48cbac7c-ca719126-ad2802d2-90bf4a9e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:30.932046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:30.932495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:30.932514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:30.932532Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:30.932534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:30.932537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:30.932539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:30.932546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894975164939068:4390]
2025-09-30T14:51:30.932549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894975164939068:4390]
2025-09-30T14:51:30.932553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894975164939068:4390]
2025-09-30T14:51:30.932590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:30.932596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:30.932601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:30.932601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:30.932603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:30.932605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:30.932749Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:30.982584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894975254665431:4849]
2025-09-30T14:51:30.982786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 455, pipe: [1:7555894975254665431:4849]
2025-09-30T14:51:31.043189Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:31.043877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:31.043907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894975254665431:4849], now have 1 active actors on pipe
2025-09-30T14:51:31.044031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:31.044071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894975254665431:4849]
2025-09-30T14:51:31.044087Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:31.044123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:31.044131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:31.044194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 456 reason: error at write: Disconnected sessionId: src_id|48cbac7c-ca719126-ad2802d2-90bf4a9e_0
2025-09-30T14:51:31.044387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 456 sessionId: src_id|48cbac7c-ca719126-ad2802d2-90bf4a9e_0 is DEAD
2025-09-30T14:51:31.044496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48cbac7c-ca719126-ad2802d2-90bf4a9e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:31.044505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48cbac7c-ca719126-ad2802d2-90bf4a9e_0] Write session will restart in 0.009710s
2025-09-30T14:51:31.044522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48cbac7c-ca719126-ad2802d2-90bf4a9e_0] Write session: Do CDS request
2025-09-30T14:51:31.044526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48cbac7c-ca719126-ad2802d2-90bf4a9e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:31.055755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48cbac7c-ca719126-ad2802d2-90bf4a9e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:31.055846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:31.055862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 457
2025-09-30T14:51:31.055987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 457 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:31.056018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 457 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:31.056028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=457 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:31.056032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:31.056410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 457 sessionId:  describe result for acl check
2025-09-30T14:51:31.056441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:31.056447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:31.056449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:31.056455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894979549632824:5160] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:31.056984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894979549632824:5160] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:31.059613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894979549632824:5160] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:31.062239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894979549632824:5160] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:31.062252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894979549632824:5160] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:31.062256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894979549632824:5160] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:31.062264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 457 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:31.063839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:31.066174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:31.066339Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:31.066348Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:31.066358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:31.066405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:31.066439Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894979459906656:4393]
2025-09-30T14:51:31.067115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:31.067434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:31.067476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:31.067726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:31.067771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:31.067775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:31.067776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:31.067777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:31.067778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:31.067778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:31.067779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:31.067780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:31.067781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:31.067782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:31.067783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.067783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.067784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.067785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:31.067785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:31.067789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:31.067797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:31.067804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:31.067809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:31.067812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:31.067816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:31.067820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:31.067824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:31.067828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:31.067843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:31.067845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.067848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.067851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.067853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:31.067856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:31.067864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:31.067872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:31.067878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:31.067884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:31.067893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:31.067899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:31.067905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:31.067908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:31.067911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:31.067914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:31.067917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:31.067921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:31.067924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:31.067926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:31.067929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:31.067931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:31.067934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:31.067936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:31.067939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:31.067942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:31.067944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.067947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.067949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.067952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.067955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.067957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.067960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:31.067962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:31.067965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:31.067967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:31.067991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:31.073397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:31.074275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:31.074289Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:31.074291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:31.074294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:31.074300Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 456 [2:7555894979459906656:4393]
2025-09-30T14:51:31.074315Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:31.074334Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:31.074337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.074340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.074342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.074358Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:31.074370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:31.074381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:31.074436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.074442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.074444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.074447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:31.074449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:31.074529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:31.074535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.074546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.074561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.074580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:31.074602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894979549633010:5160], now have 1 active actors on pipe
2025-09-30T14:51:31.074612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894979549632732:2454], now have 1 active actors on pipe
2025-09-30T14:51:31.074618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894979459906651:4393]
2025-09-30T14:51:31.074624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894979459906651:4393]
2025-09-30T14:51:31.074626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894979459906651:4393]
2025-09-30T14:51:31.074639Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:31.074654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:31.074657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:31.074660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:31.074662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:31.074670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:31.074674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:31.074678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 456
2025-09-30T14:51:31.074705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894979459906651:4393]
2025-09-30T14:51:31.074712Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:31.074679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 456
2025-09-30T14:51:31.074715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:31.074738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:31.074749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:31.074786Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ed00b9b-407a278d-21e09b98-16710ba0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:31.074798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.074805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.074808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:31.074817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.074831Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:31.074854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:31.075000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:31.075008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:31.075020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:31.075119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 457 partition: 0 MaxSeqNo: 42 sessionId: src_id|5ed00b9b-407a278d-21e09b98-16710ba0_0
2025-09-30T14:51:31.075483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48cbac7c-ca719126-ad2802d2-90bf4a9e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5ed00b9b-407a278d-21e09b98-16710ba0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:31.078104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed00b9b-407a278d-21e09b98-16710ba0_0] Write session: try to update token
2025-09-30T14:51:31.078126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed00b9b-407a278d-21e09b98-16710ba0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:31.086886Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:31.086906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:31.086909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:31.086911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:31.086922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894979459906651:4393]
2025-09-30T14:51:31.086926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894979459906651:4393]
2025-09-30T14:51:31.086931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894979459906651:4393]
2025-09-30T14:51:31.086972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:31.086983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.086986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:31.086984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:31.086991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:31.086995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:31.087132Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:31.092879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 457 sessionId: src_id|5ed00b9b-407a278d-21e09b98-16710ba0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:31.095431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:31.144388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894979549633025:4849]
2025-09-30T14:51:31.144660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 456, pipe: [1:7555894979549633025:4849]
2025-09-30T14:51:31.193619Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:31.194238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:31.194251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:31.194281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894979549633025:4849], now have 1 active actors on pipe
2025-09-30T14:51:31.194530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:31.194545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:31.194601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 457 reason: error at write: Disconnected sessionId: src_id|5ed00b9b-407a278d-21e09b98-16710ba0_0
2025-09-30T14:51:31.194817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 457 sessionId: src_id|5ed00b9b-407a278d-21e09b98-16710ba0_0 is DEAD
2025-09-30T14:51:31.194962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed00b9b-407a278d-21e09b98-16710ba0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:31.194973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed00b9b-407a278d-21e09b98-16710ba0_0] Write session will restart in 0.006983s
2025-09-30T14:51:31.194939Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:31.194995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed00b9b-407a278d-21e09b98-16710ba0_0] Write session: Do CDS request
2025-09-30T14:51:31.194988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894979549633025:4849]
2025-09-30T14:51:31.195009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:31.195001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed00b9b-407a278d-21e09b98-16710ba0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:31.202804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed00b9b-407a278d-21e09b98-16710ba0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:31.202918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:31.202934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 458
2025-09-30T14:51:31.203061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 458 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:31.203102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 458 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:31.203111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=458 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:31.203115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:31.203536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 458 sessionId:  describe result for acl check
2025-09-30T14:51:31.203566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:31.203572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:31.203574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:31.203580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894979549633066:5170] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:31.204104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894979549633066:5170] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:31.207056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894979549633066:5170] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:31.210559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894979549633066:5170] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:31.210576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894979549633066:5170] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:31.210579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894979549633066:5170] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:31.210586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 458 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:31.214980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:31.217809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:31.217998Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:31.218009Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:31.218019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:31.218066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:31.218100Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894979459906971:4401]
2025-09-30T14:51:31.218554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:31.218880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:31.218929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:31.219306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:31.219382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:31.219388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:31.219389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:31.219390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:31.219391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:31.219392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:31.219393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:31.219394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:31.219396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:31.219397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:31.219399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.219400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.219401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.219402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:31.219403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:31.219408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:31.219417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:31.219421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:31.219424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:31.219427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:31.219431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:31.219434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:31.219438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:31.219441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:31.219446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:31.219449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.219452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.219455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.219459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:31.219462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:31.219471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:31.219478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:31.219484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:31.219489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:31.219493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:31.219498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:31.219504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:31.219508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:31.219512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:31.219515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:31.219519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:31.219524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:31.219528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:31.219532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:31.219536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:31.219541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:31.219547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:31.219555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:31.219559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:31.219562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:31.219572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.219577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.219582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.219586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.219590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.219594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.219603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:31.219607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:31.219613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:31.219619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:31.219655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:31.225136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:31.226388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:31.226410Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:31.226412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:31.226415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:31.226421Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 457 [2:7555894979459906971:4401]
2025-09-30T14:51:31.226432Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:31.226444Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:31.226446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.226448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.226449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.226461Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:31.226466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:31.226471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:31.226525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.226530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.226532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.226534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:31.226536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:31.226597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:31.226604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.226616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.226628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.226644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:31.226664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894979549633040:2454], now have 1 active actors on pipe
2025-09-30T14:51:31.226674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894979459906966:4401]
2025-09-30T14:51:31.226679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894979459906966:4401]
2025-09-30T14:51:31.226681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894979459906966:4401]
2025-09-30T14:51:31.226692Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:31.226704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894979549633242:5170], now have 1 active actors on pipe
2025-09-30T14:51:31.226712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:31.226716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:31.226716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:31.226719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:31.226729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:31.226736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:31.226767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894979459906966:4401]
2025-09-30T14:51:31.226781Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:31.226779Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 457
2025-09-30T14:51:31.226811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 457
2025-09-30T14:51:31.226805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:31.226859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:31.226863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:31.226887Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9de7004c-39649c9c-e00c1ca1-dda86b64_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:31.226898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.226900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.226901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:31.226908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.226916Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:31.226930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:31.227093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:31.227100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:31.227114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:31.227179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 458 partition: 0 MaxSeqNo: 42 sessionId: src_id|9de7004c-39649c9c-e00c1ca1-dda86b64_0
2025-09-30T14:51:31.227592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed00b9b-407a278d-21e09b98-16710ba0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9de7004c-39649c9c-e00c1ca1-dda86b64_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:31.230323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9de7004c-39649c9c-e00c1ca1-dda86b64_0] Write session: try to update token
2025-09-30T14:51:31.230341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9de7004c-39649c9c-e00c1ca1-dda86b64_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:31.238830Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:31.238851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:31.238853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:31.238855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:31.238864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894979459906966:4401]
2025-09-30T14:51:31.238868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894979459906966:4401]
2025-09-30T14:51:31.238872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894979459906966:4401]
2025-09-30T14:51:31.238915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:31.238921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.238924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:31.238933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:31.238940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:31.238944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:31.239061Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:31.244404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 458 sessionId: src_id|9de7004c-39649c9c-e00c1ca1-dda86b64_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:31.247110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:31.295421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894979549633342:4849]
2025-09-30T14:51:31.295639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 457, pipe: [1:7555894979549633342:4849]
2025-09-30T14:51:31.343345Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:31.343572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:31.343584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:31.343616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894979549633342:4849], now have 1 active actors on pipe
2025-09-30T14:51:31.343895Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:31.343905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:31.343910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:31.343950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894979549633342:4849]
2025-09-30T14:51:31.343986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 458 reason: error at write: Disconnected sessionId: src_id|9de7004c-39649c9c-e00c1ca1-dda86b64_0
2025-09-30T14:51:31.344062Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:31.344209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 458 sessionId: src_id|9de7004c-39649c9c-e00c1ca1-dda86b64_0 is DEAD
2025-09-30T14:51:31.344380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9de7004c-39649c9c-e00c1ca1-dda86b64_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:31.344390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9de7004c-39649c9c-e00c1ca1-dda86b64_0] Write session will restart in 0.009928s
2025-09-30T14:51:31.344411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9de7004c-39649c9c-e00c1ca1-dda86b64_0] Write session: Do CDS request
2025-09-30T14:51:31.344417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9de7004c-39649c9c-e00c1ca1-dda86b64_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:31.355786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9de7004c-39649c9c-e00c1ca1-dda86b64_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:31.356174Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:31.356191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 459
2025-09-30T14:51:31.356296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 459 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:31.356329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 459 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:31.356339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=459 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:31.356347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:31.356744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 459 sessionId:  describe result for acl check
2025-09-30T14:51:31.356778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:31.356785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:31.356787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:31.356792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894979549633507:5175] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:31.357261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894979549633507:5175] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:31.359403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894979549633507:5175] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:31.360988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:31.363817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:31.364006Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:31.364016Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:31.364025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:31.364075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:31.364111Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894979459907263:4409]
2025-09-30T14:51:31.364180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894979549633507:5175] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:31.364197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894979549633507:5175] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:31.364200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894979549633507:5175] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:31.364208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 459 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:31.364753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:31.364998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:31.365041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:31.365356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:31.365408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:31.365414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:31.365415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:31.365416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:31.365417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:31.365418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:31.365419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:31.365421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:31.365422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:31.365423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:31.365424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.365425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.365426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.365428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:31.365429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:31.365433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:31.365443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:31.365448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:31.365453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:31.365457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:31.365461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:31.365465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:31.365469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:31.365473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:31.365478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:31.365482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.365486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.365490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.365494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:31.365498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:31.365505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:31.365513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:31.365519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:31.365524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:31.365528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:31.365533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:31.365539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:31.365544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:31.365549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:31.365554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:31.365559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:31.365565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:31.365574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:31.365579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:31.365583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:31.365594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:31.365600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:31.365608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:31.365613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:31.365622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:31.365627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.365632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.365640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.365646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.365650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.365655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.365661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:31.365668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:31.365672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:31.365681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:31.365723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:31.370775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:31.372044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:31.372060Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:31.372062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:31.372065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:31.372072Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 458 [2:7555894979459907263:4409]
2025-09-30T14:51:31.372085Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:31.372098Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:31.372101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.372104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.372106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.372121Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:31.372127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:31.372133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:31.372185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.372194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.372196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.372200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:31.372202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:31.372270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:31.372278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.372289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.372301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.372325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:31.372346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894979549633635:5175], now have 1 active actors on pipe
2025-09-30T14:51:31.372354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894979549633344:2454], now have 1 active actors on pipe
2025-09-30T14:51:31.372360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894979459907258:4409]
2025-09-30T14:51:31.372363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894979459907258:4409]
2025-09-30T14:51:31.372366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894979459907258:4409]
2025-09-30T14:51:31.372379Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:31.372391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:31.372395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:31.372399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:31.372401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:31.372410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:31.372413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:31.372437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894979459907258:4409]
2025-09-30T14:51:31.372445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:31.372447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:31.372409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 458
2025-09-30T14:51:31.372415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 458
2025-09-30T14:51:31.372468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:31.372477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:31.372516Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a6c9411-9fa3dea2-fdab3434-89fc883e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:31.372526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.372530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.372532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:31.372540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.372554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:31.372575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:31.372724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:31.372733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:31.372747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:31.372843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 459 partition: 0 MaxSeqNo: 42 sessionId: src_id|8a6c9411-9fa3dea2-fdab3434-89fc883e_0
2025-09-30T14:51:31.373190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9de7004c-39649c9c-e00c1ca1-dda86b64_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8a6c9411-9fa3dea2-fdab3434-89fc883e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:31.375674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a6c9411-9fa3dea2-fdab3434-89fc883e_0] Write session: try to update token
2025-09-30T14:51:31.375686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a6c9411-9fa3dea2-fdab3434-89fc883e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:31.384024Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:31.384044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:31.384047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:31.384050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:31.384061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894979459907258:4409]
2025-09-30T14:51:31.384066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894979459907258:4409]
2025-09-30T14:51:31.384071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894979459907258:4409]
2025-09-30T14:51:31.384109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:31.384114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:31.384114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:31.384118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:31.384122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.384125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:31.384289Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:31.389380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 459 sessionId: src_id|8a6c9411-9fa3dea2-fdab3434-89fc883e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:31.392143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:31.443908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894979549633646:4849]
2025-09-30T14:51:31.444192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 458, pipe: [1:7555894979549633646:4849]
2025-09-30T14:51:31.486908Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:31.487149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:31.487163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:31.487207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894979549633646:4849], now have 1 active actors on pipe
2025-09-30T14:51:31.487410Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:31.487520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:31.487530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894979549633646:4849]
2025-09-30T14:51:31.487550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:31.487604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 459 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8a6c9411-9fa3dea2-fdab3434-89fc883e_0
2025-09-30T14:51:31.487786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 459 sessionId: src_id|8a6c9411-9fa3dea2-fdab3434-89fc883e_0 is DEAD
2025-09-30T14:51:31.487963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a6c9411-9fa3dea2-fdab3434-89fc883e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:31.487975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a6c9411-9fa3dea2-fdab3434-89fc883e_0] Write session will restart in 0.007951s
2025-09-30T14:51:31.487997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a6c9411-9fa3dea2-fdab3434-89fc883e_0] Write session: Do CDS request
2025-09-30T14:51:31.488003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a6c9411-9fa3dea2-fdab3434-89fc883e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:31.496816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a6c9411-9fa3dea2-fdab3434-89fc883e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:31.496914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:31.496932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 460
2025-09-30T14:51:31.497064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 460 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:31.497097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 460 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:31.497106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=460 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:31.497110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:31.497715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 460 sessionId:  describe result for acl check
2025-09-30T14:51:31.497754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:31.497762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:31.497764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:31.497772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894979549633692:5180] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:31.498310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894979549633692:5180] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:31.501279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894979549633692:5180] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:31.504606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894979549633692:5180] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:31.504621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894979549633692:5180] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:31.504625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894979549633692:5180] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:31.504633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 460 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:31.507974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:31.510692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:31.510896Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:31.510907Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:31.510918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:31.510979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:31.511025Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894979459907554:4412]
2025-09-30T14:51:31.511694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:31.511988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:31.512039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:31.512385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:31.512455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:31.512463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:31.512464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:31.512465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:31.512467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:31.512468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:31.512469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:31.512470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:31.512472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:31.512473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:31.512474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.512476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.512477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.512478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:31.512480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:31.512486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:31.512496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:31.512500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:31.512505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:31.512509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:31.512514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:31.512518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:31.512522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:31.512526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:31.512531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:31.512535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.512539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.512549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.512553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:31.512561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:31.512570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:31.512583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:31.512593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:31.512600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:31.512610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:31.512616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:31.512625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:31.512635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:31.512644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:31.512654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:31.512659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:31.512665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:31.512675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:31.512686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:31.512695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:31.512706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:31.512715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:31.512726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:31.512735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:31.512745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:31.512756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.512765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.512773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.512779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.512789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.512794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.512803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:31.512813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:31.512822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:31.512829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:31.512875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:31.518361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:31.519745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:31.519761Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:31.519764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:31.519767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:31.519773Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 459 [2:7555894979459907554:4412]
2025-09-30T14:51:31.519790Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:31.519806Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:31.519809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.519812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.519814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.519832Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:31.519842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:31.519849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:31.519912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.519919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.519921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.519924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:31.519927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:31.519995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:31.520002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.520015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.520027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.520050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:31.520072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894979549633876:5180], now have 1 active actors on pipe
2025-09-30T14:51:31.520080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894979549633650:2454], now have 1 active actors on pipe
2025-09-30T14:51:31.520086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894979459907549:4412]
2025-09-30T14:51:31.520088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894979459907549:4412]
2025-09-30T14:51:31.520092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894979459907549:4412]
2025-09-30T14:51:31.520100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:31.520117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:31.520118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:31.520122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:31.520124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:31.520130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:31.520132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:31.520160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894979459907549:4412]
2025-09-30T14:51:31.520166Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:31.520169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:31.520138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 459
2025-09-30T14:51:31.520179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:31.520152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 459
2025-09-30T14:51:31.520185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:31.520225Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d33ad37-5a3cf71e-7a391d14-712d869c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:31.520235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.520238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.520239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:31.520246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.520257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:31.520271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:31.520439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:31.520450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:31.520464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:31.520565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 460 partition: 0 MaxSeqNo: 42 sessionId: src_id|6d33ad37-5a3cf71e-7a391d14-712d869c_0
2025-09-30T14:51:31.520981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a6c9411-9fa3dea2-fdab3434-89fc883e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6d33ad37-5a3cf71e-7a391d14-712d869c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:31.523782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d33ad37-5a3cf71e-7a391d14-712d869c_0] Write session: try to update token
2025-09-30T14:51:31.523803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d33ad37-5a3cf71e-7a391d14-712d869c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:31.532991Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:31.533009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:31.533012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:31.533014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:31.533024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894979459907549:4412]
2025-09-30T14:51:31.533029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894979459907549:4412]
2025-09-30T14:51:31.533033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894979459907549:4412]
2025-09-30T14:51:31.533072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:31.533080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.533083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:31.533081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:31.533087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:31.533091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:31.533231Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:31.539201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 460 sessionId: src_id|6d33ad37-5a3cf71e-7a391d14-712d869c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:31.541941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:31.587753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894979549633945:4849]
2025-09-30T14:51:31.588017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 459, pipe: [1:7555894979549633945:4849]
2025-09-30T14:51:31.638232Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:31.638490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:31.638516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:31.638554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894979549633945:4849], now have 1 active actors on pipe
2025-09-30T14:51:31.638725Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:31.638820Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:31.638840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894979549633945:4849]
2025-09-30T14:51:31.638942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:31.639025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 460 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6d33ad37-5a3cf71e-7a391d14-712d869c_0
2025-09-30T14:51:31.639218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 460 sessionId: src_id|6d33ad37-5a3cf71e-7a391d14-712d869c_0 is DEAD
2025-09-30T14:51:31.639379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d33ad37-5a3cf71e-7a391d14-712d869c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:31.639389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d33ad37-5a3cf71e-7a391d14-712d869c_0] Write session will restart in 0.005410s
2025-09-30T14:51:31.639410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d33ad37-5a3cf71e-7a391d14-712d869c_0] Write session: Do CDS request
2025-09-30T14:51:31.639416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d33ad37-5a3cf71e-7a391d14-712d869c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:31.645735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d33ad37-5a3cf71e-7a391d14-712d869c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:31.645802Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:31.645818Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 461
2025-09-30T14:51:31.645928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 461 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:31.645953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 461 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:31.645962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=461 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:31.645975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:31.646348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 461 sessionId:  describe result for acl check
2025-09-30T14:51:31.646378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:31.646383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:31.646385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:31.646389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894979549633963:5184] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:31.646793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894979549633963:5184] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:31.649356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894979549633963:5184] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:31.652854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894979549633963:5184] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:31.652868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894979549633963:5184] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:31.652870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894979549633963:5184] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:31.652876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 461 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:31.657793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:31.660724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:31.660895Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:31.660903Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:31.660910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:31.660952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:31.660988Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894979459907843:4414]
2025-09-30T14:51:31.661430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:31.661665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:31.661694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:31.661925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:31.661971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:31.661976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:31.661977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:31.661977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:31.661978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:31.661979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:31.661979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:31.661980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:31.661981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:31.661982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:31.661983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.661983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.661984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.661985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:31.661986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:31.661989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:31.661995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:31.661997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:31.662000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:31.662003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:31.662005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:31.662007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:31.662010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:31.662012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:31.662015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:31.662017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.662020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.662022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.662024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:31.662027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:31.662034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:31.662041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:31.662047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:31.662052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:31.662057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:31.662062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:31.662065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:31.662068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:31.662071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:31.662074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:31.662076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:31.662079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:31.662081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:31.662084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:31.662086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:31.662089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:31.662094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:31.662100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:31.662104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:31.662109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:31.662119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.662126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.662132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.662135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.662138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.662146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.662150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:31.662155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:31.662165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:31.662172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:31.662221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:31.667451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:31.668376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:31.668390Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:31.668396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:31.668400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:31.668407Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 460 [2:7555894979459907843:4414]
2025-09-30T14:51:31.668422Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:31.668440Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:31.668448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.668451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.668453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.668468Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:31.668475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:31.668481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:31.668909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.668918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.668920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.668924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:31.668927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:31.668994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:31.669001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.669014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.669028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.669051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:31.669069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894979549634119:5184], now have 1 active actors on pipe
2025-09-30T14:51:31.669077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894979549633946:2454], now have 1 active actors on pipe
2025-09-30T14:51:31.669084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894979459907838:4414]
2025-09-30T14:51:31.669087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894979459907838:4414]
2025-09-30T14:51:31.669089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894979459907838:4414]
2025-09-30T14:51:31.669105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:31.669123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:31.669137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:31.669125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 460
2025-09-30T14:51:31.669141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:31.669145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:31.669145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:31.669148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:31.669174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894979459907838:4414]
2025-09-30T14:51:31.669177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:31.669127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 460
2025-09-30T14:51:31.669179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:31.669194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:31.669198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:31.669249Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64e560d2-ff16d3c1-b57cee3c-433330bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:31.669262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.669268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.669270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:31.669279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.669289Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:31.669311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:31.669512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:31.669527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:31.669551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:31.669644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 461 partition: 0 MaxSeqNo: 42 sessionId: src_id|64e560d2-ff16d3c1-b57cee3c-433330bd_0
2025-09-30T14:51:31.670046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d33ad37-5a3cf71e-7a391d14-712d869c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|64e560d2-ff16d3c1-b57cee3c-433330bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:31.672726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64e560d2-ff16d3c1-b57cee3c-433330bd_0] Write session: try to update token
2025-09-30T14:51:31.672746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64e560d2-ff16d3c1-b57cee3c-433330bd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:31.681034Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:31.681051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:31.681053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:31.681055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:31.681065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894979459907838:4414]
2025-09-30T14:51:31.681069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894979459907838:4414]
2025-09-30T14:51:31.681073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894979459907838:4414]
2025-09-30T14:51:31.681110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:31.681121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.681130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:31.681138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:31.681144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:31.681149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:31.681265Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:31.686358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 461 sessionId: src_id|64e560d2-ff16d3c1-b57cee3c-433330bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:31.689111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:31.738791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894979549634243:4849]
2025-09-30T14:51:31.739102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 460, pipe: [1:7555894979549634243:4849]
2025-09-30T14:51:31.786063Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:31.786337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:31.786351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:31.786387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894979549634243:4849], now have 1 active actors on pipe
2025-09-30T14:51:31.786574Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:31.786646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:31.786659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:31.786695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894979549634243:4849]
2025-09-30T14:51:31.786718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 461 reason: error at write: Disconnected sessionId: src_id|64e560d2-ff16d3c1-b57cee3c-433330bd_0
2025-09-30T14:51:31.786725Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:31.786915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 461 sessionId: src_id|64e560d2-ff16d3c1-b57cee3c-433330bd_0 is DEAD
2025-09-30T14:51:31.787101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64e560d2-ff16d3c1-b57cee3c-433330bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:31.787110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64e560d2-ff16d3c1-b57cee3c-433330bd_0] Write session will restart in 0.007229s
2025-09-30T14:51:31.787127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64e560d2-ff16d3c1-b57cee3c-433330bd_0] Write session: Do CDS request
2025-09-30T14:51:31.787134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64e560d2-ff16d3c1-b57cee3c-433330bd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:31.795770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64e560d2-ff16d3c1-b57cee3c-433330bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:31.795879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:31.795896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 462
2025-09-30T14:51:31.796012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 462 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:31.796044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 462 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:31.796054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=462 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:31.796060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:31.796620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 462 sessionId:  describe result for acl check
2025-09-30T14:51:31.796665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:31.796672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:31.796674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:31.796681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894979549634285:5188] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:31.797293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894979549634285:5188] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:31.799841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894979549634285:5188] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:31.803023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894979549634285:5188] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:31.803038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894979549634285:5188] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:31.803041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894979549634285:5188] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:31.803049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 462 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:31.807050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:31.810108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:31.810329Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:31.810340Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:31.810353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:31.810409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:31.810449Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894979459908134:4416]
2025-09-30T14:51:31.811125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:31.811446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:31.811496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:31.811832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:31.811920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:31.811929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:31.811930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:31.811931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:31.811932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:31.811933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:31.811935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:31.811936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:31.811938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:31.811939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:31.811940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.811942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.811943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.811944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:31.811946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:31.811951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:31.811961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:31.811965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:31.811969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:31.811973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:31.811977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:31.811981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:31.811986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:31.811990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:31.811995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:31.811999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.812003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.812006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.812010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:31.812014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:31.812024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:31.812032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:31.812038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:31.812044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:31.812049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:31.812054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:31.812058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:31.812063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:31.812067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:31.812073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:31.812077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:31.812083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:31.812088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:31.812096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:31.812101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:31.812106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:31.812111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:31.812117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:31.812124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:31.812129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:31.812133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.812138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.812142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.812150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.812155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.812160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.812165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:31.812170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:31.812176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:31.812181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:31.812227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:31.817776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:31.819136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:31.819153Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:31.819156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:31.819160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:31.819169Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 461 [2:7555894979459908134:4416]
2025-09-30T14:51:31.819183Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:31.819199Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:31.819202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.819205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.819207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.819223Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:31.819235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:31.819258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:31.819318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.819326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.819328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.819332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:31.819334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:31.819403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:31.819411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.819425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.819436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.819456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:31.819481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894979549634450:5188], now have 1 active actors on pipe
2025-09-30T14:51:31.819485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894979549634244:2454], now have 1 active actors on pipe
2025-09-30T14:51:31.819491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894979459908129:4416]
2025-09-30T14:51:31.819494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894979459908129:4416]
2025-09-30T14:51:31.819496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894979459908129:4416]
2025-09-30T14:51:31.819512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:31.819525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:31.819536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:31.819541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:31.819543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:31.819544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:31.819547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:31.819543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 461
2025-09-30T14:51:31.819577Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 461
2025-09-30T14:51:31.819580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894979459908129:4416]
2025-09-30T14:51:31.819588Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:31.819591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:31.819605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:31.819611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:31.819663Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|847a8993-df87274b-fea6e9e0-e7ea8d03_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:31.819675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.819679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.819682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:31.819692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.819707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:31.819729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:31.819918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:31.819930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:31.819946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:31.820026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 462 partition: 0 MaxSeqNo: 42 sessionId: src_id|847a8993-df87274b-fea6e9e0-e7ea8d03_0
2025-09-30T14:51:31.820410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64e560d2-ff16d3c1-b57cee3c-433330bd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|847a8993-df87274b-fea6e9e0-e7ea8d03_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:31.823044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|847a8993-df87274b-fea6e9e0-e7ea8d03_0] Write session: try to update token
2025-09-30T14:51:31.823063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|847a8993-df87274b-fea6e9e0-e7ea8d03_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:31.831742Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:31.831764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:31.831766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:31.831769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:31.831778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894979459908129:4416]
2025-09-30T14:51:31.831782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894979459908129:4416]
2025-09-30T14:51:31.831786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894979459908129:4416]
2025-09-30T14:51:31.831826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:31.831833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.831836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:31.831850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:31.831856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:31.831864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:31.831982Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:31.836998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 462 sessionId: src_id|847a8993-df87274b-fea6e9e0-e7ea8d03_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:31.839603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:31.886781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894979549634556:4849]
2025-09-30T14:51:31.887053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 461, pipe: [1:7555894979549634556:4849]
2025-09-30T14:51:31.942903Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:31.943338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:31.943354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:31.943391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894979549634556:4849], now have 1 active actors on pipe
2025-09-30T14:51:31.943549Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:31.943644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:31.943646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:31.943659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:31.943694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894979549634556:4849]
2025-09-30T14:51:31.943715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 462 reason: error at write: Disconnected sessionId: src_id|847a8993-df87274b-fea6e9e0-e7ea8d03_0
2025-09-30T14:51:31.943872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 462 sessionId: src_id|847a8993-df87274b-fea6e9e0-e7ea8d03_0 is DEAD
2025-09-30T14:51:31.944007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|847a8993-df87274b-fea6e9e0-e7ea8d03_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:31.944019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|847a8993-df87274b-fea6e9e0-e7ea8d03_0] Write session will restart in 0.006375s
2025-09-30T14:51:31.944041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|847a8993-df87274b-fea6e9e0-e7ea8d03_0] Write session: Do CDS request
2025-09-30T14:51:31.944047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|847a8993-df87274b-fea6e9e0-e7ea8d03_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:31.951763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|847a8993-df87274b-fea6e9e0-e7ea8d03_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:31.951834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:31.951850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 463
2025-09-30T14:51:31.953269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 463 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:31.953320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 463 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:31.953327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=463 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:31.953338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:31.953785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 463 sessionId:  describe result for acl check
2025-09-30T14:51:31.953823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:31.953830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:31.953832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:31.953838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894979549634618:5193] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:31.954381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894979549634618:5193] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:31.956586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894979549634618:5193] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:31.959432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894979549634618:5193] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:31.959444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894979549634618:5193] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:31.959448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894979549634618:5193] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:31.959455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 463 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:31.961730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:31.964291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:31.964523Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:31.964534Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:31.964544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:31.964595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:31.964634Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894979459908437:4419]
2025-09-30T14:51:31.965304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:31.965615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:31.965668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:31.965926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:31.965973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:31.965978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:31.965979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:31.965979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:31.965980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:31.965981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:31.965982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:31.965983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:31.965983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:31.965984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:31.965985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.965986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.965986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.965987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:31.965987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:31.965991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:31.965997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:31.966000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:31.966002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:31.966005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:31.966007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:31.966010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:31.966012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:31.966014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:31.966018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:31.966020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.966023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.966025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.966027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:31.966029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:31.966035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:31.966041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:31.966045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:31.966048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:31.966051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:31.966054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:31.966057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:31.966060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:31.966063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:31.966066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:31.966069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:31.966072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:31.966091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:31.966098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:31.966100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:31.966103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:31.966106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:31.966109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:31.966111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:31.966115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:31.966117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.966121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.966123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.966127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.966129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.966132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.966135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:31.966138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:31.966142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:31.966145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:31.966169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:31.971497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:31.972359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:31.972375Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:31.972378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:31.972382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:31.972389Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 462 [2:7555894979459908437:4419]
2025-09-30T14:51:31.972404Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:31.972419Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:31.972427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.972430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.972433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.972447Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:31.972458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:31.972466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:31.972529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.972536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.972539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.972542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:31.972545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:31.972607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:31.972618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.972631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:31.972644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:31.972663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:31.972686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894979549634825:5193], now have 1 active actors on pipe
2025-09-30T14:51:31.972689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894979549634557:2454], now have 1 active actors on pipe
2025-09-30T14:51:31.972695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894979459908432:4419]
2025-09-30T14:51:31.972698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894979459908432:4419]
2025-09-30T14:51:31.972700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894979459908432:4419]
2025-09-30T14:51:31.972712Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:31.972724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:31.972726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:31.972728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:31.972730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:31.972741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:31.972744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:31.972744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 462
2025-09-30T14:51:31.972773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894979459908432:4419]
2025-09-30T14:51:31.972772Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 462
2025-09-30T14:51:31.972782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:31.972784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:31.972808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:31.972816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:31.972850Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4be2fdb-880f3e1c-d98b7d9b-24631f2f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:31.972861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.972870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.972873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:31.972887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.972899Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:31.972922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:31.973085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:31.973095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:31.973109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:31.973203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 463 partition: 0 MaxSeqNo: 42 sessionId: src_id|f4be2fdb-880f3e1c-d98b7d9b-24631f2f_0
2025-09-30T14:51:31.973613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|847a8993-df87274b-fea6e9e0-e7ea8d03_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f4be2fdb-880f3e1c-d98b7d9b-24631f2f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:31.976275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4be2fdb-880f3e1c-d98b7d9b-24631f2f_0] Write session: try to update token
2025-09-30T14:51:31.976296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4be2fdb-880f3e1c-d98b7d9b-24631f2f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:31.985153Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:31.985177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:31.985181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:31.985184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:31.985194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894979459908432:4419]
2025-09-30T14:51:31.985200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894979459908432:4419]
2025-09-30T14:51:31.985210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894979459908432:4419]
2025-09-30T14:51:31.985258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:31.985275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:31.985274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:31.985278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:31.985282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:31.985289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:31.985450Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:31.990489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 463 sessionId: src_id|f4be2fdb-880f3e1c-d98b7d9b-24631f2f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:31.992948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:32.043951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894983844602162:4849]
2025-09-30T14:51:32.044127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 462, pipe: [1:7555894983844602162:4849]
2025-09-30T14:51:32.088886Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:32.089445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:32.089461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:32.089501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894983844602162:4849], now have 1 active actors on pipe
2025-09-30T14:51:32.089716Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:32.089759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:32.089774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:32.089802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894983844602162:4849]
2025-09-30T14:51:32.089831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 463 reason: error at write: Disconnected sessionId: src_id|f4be2fdb-880f3e1c-d98b7d9b-24631f2f_0
2025-09-30T14:51:32.089836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:32.090043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 463 sessionId: src_id|f4be2fdb-880f3e1c-d98b7d9b-24631f2f_0 is DEAD
2025-09-30T14:51:32.090230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4be2fdb-880f3e1c-d98b7d9b-24631f2f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:32.090240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4be2fdb-880f3e1c-d98b7d9b-24631f2f_0] Write session will restart in 0.007174s
2025-09-30T14:51:32.090260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4be2fdb-880f3e1c-d98b7d9b-24631f2f_0] Write session: Do CDS request
2025-09-30T14:51:32.090268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4be2fdb-880f3e1c-d98b7d9b-24631f2f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:32.098771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4be2fdb-880f3e1c-d98b7d9b-24631f2f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:32.098955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:32.098971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 464
2025-09-30T14:51:32.099094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 464 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:32.099119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 464 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:32.099122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=464 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:32.099125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:32.099792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 464 sessionId:  describe result for acl check
2025-09-30T14:51:32.099830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:32.099838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:32.099840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:32.099846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894983844602215:5199] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:32.100419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894983844602215:5199] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:32.103019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894983844602215:5199] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:32.106084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894983844602215:5199] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:32.106100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894983844602215:5199] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:32.106103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894983844602215:5199] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:32.106110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 464 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:32.110054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:32.112505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:32.112668Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:32.112675Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:32.112682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:32.112720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:32.112753Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894983754876026:4422]
2025-09-30T14:51:32.113231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:32.113517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:32.113562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:32.113859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:32.113918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:32.113924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:32.113925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:32.113927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:32.113928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:32.113929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:32.113930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:32.113931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:32.113932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:32.113934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:32.113935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.113936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.113937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.113939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:32.113940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:32.113946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:32.113954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:32.113957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:32.113959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:32.113961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:32.113964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:32.113966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:32.113968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:32.113971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:32.113985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:32.113991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.113993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.113995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.113997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:32.113999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:32.114006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:32.114010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:32.114014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:32.114017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:32.114020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:32.114023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:32.114026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:32.114029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:32.114031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:32.114034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:32.114036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:32.114053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:32.114057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:32.114063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:32.114073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:32.114083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:32.114092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:32.114101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:32.114110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:32.114119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:32.114128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.114138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.114146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.114160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.114168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.114171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.114176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:32.114179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:32.114182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:32.114185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:32.114208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:32.119521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:32.120349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:32.120363Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:32.120365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:32.120368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:32.120374Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 463 [2:7555894983754876026:4422]
2025-09-30T14:51:32.120391Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:32.120408Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:32.120412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:32.120415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:32.120417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:32.120430Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:32.120435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:32.120440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:32.120486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.120492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.120493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.120496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:32.120498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:32.120689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:32.120699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.120712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.120723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.120702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 463
2025-09-30T14:51:32.120740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:32.120744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 463
2025-09-30T14:51:32.120763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894983844602163:2454], now have 1 active actors on pipe
2025-09-30T14:51:32.120771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894983844602384:5199], now have 1 active actors on pipe
2025-09-30T14:51:32.120777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894983754876021:4422]
2025-09-30T14:51:32.120783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894983754876021:4422]
2025-09-30T14:51:32.120786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894983754876021:4422]
2025-09-30T14:51:32.120798Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:32.120813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:32.120816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:32.120816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:32.120819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:32.120820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:32.120834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:32.120847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:32.120851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:32.120893Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|771edcf4-3534bf14-4b683251-34a66f46_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:32.120903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:32.120907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:32.120908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:32.120915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:32.120922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:32.120927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894983754876021:4422]
2025-09-30T14:51:32.120936Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:32.120957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:32.120959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:32.121104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:32.121111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:32.121122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:32.121210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 464 partition: 0 MaxSeqNo: 42 sessionId: src_id|771edcf4-3534bf14-4b683251-34a66f46_0
2025-09-30T14:51:32.121592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4be2fdb-880f3e1c-d98b7d9b-24631f2f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|771edcf4-3534bf14-4b683251-34a66f46_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:32.124296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|771edcf4-3534bf14-4b683251-34a66f46_0] Write session: try to update token
2025-09-30T14:51:32.124315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|771edcf4-3534bf14-4b683251-34a66f46_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:32.132963Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:32.132978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:32.132989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894983754876021:4422]
2025-09-30T14:51:32.133027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:32.133036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:32.133211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:32.133357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:32.133504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:32.133644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:32.133844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:32.133878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:32.138945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 464 sessionId: src_id|771edcf4-3534bf14-4b683251-34a66f46_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:32.141590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:32.141805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:32.141821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:32.141858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:32.141933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:32.143402Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:32.143413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:32.143414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:32.143416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:32.143423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894983754876021:4422]
2025-09-30T14:51:32.143426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894983754876021:4422]
2025-09-30T14:51:32.143429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894983754876021:4422]
2025-09-30T14:51:32.143462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:32.143469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.143470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:32.143472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:32.143475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:32.143481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:32.143611Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:32.189888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894983844602463:4849]
2025-09-30T14:51:32.190262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 463, pipe: [1:7555894983844602463:4849]
2025-09-30T14:51:32.247988Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:32.256373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:32.256402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:32.256560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:32.256625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:32.256691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:32.256757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:32.256805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:32.256815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:32.256884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:32.256943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:32.257011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:32.257078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:32.257121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:32.257129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:32.257199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:32.257264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:32.257327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:32.257392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:32.257438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:32.257445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:32.257513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:32.257577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:32.257642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:32.257704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:32.257747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:32.257754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:32.257819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:32.257885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:32.257951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:32.258017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:32.258061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:32.258069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:32.258136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:32.258196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:32.258258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:32.258322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:32.258366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:32.258373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:32.258437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:32.258511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:32.258578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:32.258642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:32.258687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:32.258695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:32.258757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:32.258817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:32.258879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:32.258945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:32.258991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:32.258999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:32.259066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:32.259129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:32.259191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:32.259284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:32.259347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:32.259355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:32.259420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:32.259479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:32.259542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:32.259611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:32.259655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:32.259663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:32.259713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894983844602463:4849], now have 1 active actors on pipe
2025-09-30T14:51:32.259868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:32.259940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894983844602463:4849]
2025-09-30T14:51:32.259967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:32.259974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:32.259999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 464 reason: error at write: Disconnected sessionId: src_id|771edcf4-3534bf14-4b683251-34a66f46_0
2025-09-30T14:51:32.260249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 464 sessionId: src_id|771edcf4-3534bf14-4b683251-34a66f46_0 is DEAD
2025-09-30T14:51:32.260389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|771edcf4-3534bf14-4b683251-34a66f46_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:32.260400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|771edcf4-3534bf14-4b683251-34a66f46_0] Write session will restart in 0.006376s
2025-09-30T14:51:32.260422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|771edcf4-3534bf14-4b683251-34a66f46_0] Write session: Do CDS request
2025-09-30T14:51:32.260428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|771edcf4-3534bf14-4b683251-34a66f46_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:32.260891Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:32.267764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|771edcf4-3534bf14-4b683251-34a66f46_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:32.267852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:32.267868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 465
2025-09-30T14:51:32.267977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 465 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:32.268018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 465 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:32.268027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=465 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:32.268031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:32.268777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 465 sessionId:  describe result for acl check
2025-09-30T14:51:32.268811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:32.268818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:32.268819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:32.268825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894983844602512:5210] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:32.269322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894983844602512:5210] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:32.271856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894983844602512:5210] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:32.276619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894983844602512:5210] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:32.276640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894983844602512:5210] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:32.276645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894983844602512:5210] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:32.276655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 465 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:32.281443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:32.284852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:32.285105Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:32.285116Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:32.285128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:32.285188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:32.285235Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894983754876355:4434]
2025-09-30T14:51:32.285927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:32.286221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:32.286279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:32.286662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:32.286721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:32.286726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:32.286728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:32.286729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:32.286730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:32.286731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:32.286733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:32.286734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:32.286735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:32.286736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:32.286738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.286739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.286740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.286741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:32.286743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:32.286749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:32.286759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:32.286764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:32.286768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:32.286772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:32.286777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:32.286781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:32.286785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:32.286789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:32.286811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:32.286815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.286819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.286823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.286827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:32.286832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:32.286839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:32.286847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:32.286858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:32.286863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:32.286868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:32.286874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:32.286878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:32.286884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:32.286897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:32.286903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:32.286908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:32.286913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:32.286918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:32.286927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:32.286932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:32.286937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:32.286942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:32.286947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:32.286952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:32.286958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:32.286962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.286972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.286977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.286982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.286991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.286996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.287005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:32.287010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:32.287020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:32.287025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:32.287078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:32.292621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:32.293474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:32.293488Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:32.293490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:32.293493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:32.293498Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 464 [2:7555894983754876355:4434]
2025-09-30T14:51:32.293510Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:32.293522Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:32.293523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:32.293526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:32.293527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:32.293540Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:32.293545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:32.293550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:32.293596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.293598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.293600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.293603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:32.293606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:32.293667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:32.293675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.293687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.293697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.293713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:32.293733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894983844602678:5210], now have 1 active actors on pipe
2025-09-30T14:51:32.293741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894983844602480:2454], now have 1 active actors on pipe
2025-09-30T14:51:32.293747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894983754876350:4434]
2025-09-30T14:51:32.293749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894983754876350:4434]
2025-09-30T14:51:32.293751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894983754876350:4434]
2025-09-30T14:51:32.293760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:32.293773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:32.293783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:32.293789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:32.293796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:32.293799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:32.293801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:32.293818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894983754876350:4434]
2025-09-30T14:51:32.293824Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:32.293827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:32.293833Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 464
2025-09-30T14:51:32.293840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 464
2025-09-30T14:51:32.293871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:32.293881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:32.293907Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af767eac-5a2e90f5-7fb42698-88240c0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:32.293919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:32.293922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:32.293924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:32.293932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:32.293942Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:32.293955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:32.294125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:32.294139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:32.294162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:32.294252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 465 partition: 0 MaxSeqNo: 42 sessionId: src_id|af767eac-5a2e90f5-7fb42698-88240c0e_0
2025-09-30T14:51:32.294677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|771edcf4-3534bf14-4b683251-34a66f46_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|af767eac-5a2e90f5-7fb42698-88240c0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:32.297361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af767eac-5a2e90f5-7fb42698-88240c0e_0] Write session: try to update token
2025-09-30T14:51:32.297376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af767eac-5a2e90f5-7fb42698-88240c0e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:32.305592Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:32.305608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:32.305611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:32.305613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:32.305621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894983754876350:4434]
2025-09-30T14:51:32.305627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894983754876350:4434]
2025-09-30T14:51:32.305631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894983754876350:4434]
2025-09-30T14:51:32.305669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:32.305675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.305674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:32.305678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:32.305681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:32.305685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:32.305811Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:32.312194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 465 sessionId: src_id|af767eac-5a2e90f5-7fb42698-88240c0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:32.314729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:32.360377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894983844602787:4849]
2025-09-30T14:51:32.360619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 464, pipe: [1:7555894983844602787:4849]
2025-09-30T14:51:32.413794Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:32.414426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:32.414438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:32.414470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894983844602787:4849], now have 1 active actors on pipe
2025-09-30T14:51:32.414653Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:32.414772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894983844602787:4849]
2025-09-30T14:51:32.414779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:32.414799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:32.414850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 465 reason: status is not ok: tablet will be restarted right now sessionId: src_id|af767eac-5a2e90f5-7fb42698-88240c0e_0
2025-09-30T14:51:32.415043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 465 sessionId: src_id|af767eac-5a2e90f5-7fb42698-88240c0e_0 is DEAD
2025-09-30T14:51:32.415193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af767eac-5a2e90f5-7fb42698-88240c0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:32.415202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af767eac-5a2e90f5-7fb42698-88240c0e_0] Write session will restart in 0.005944s
2025-09-30T14:51:32.415219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af767eac-5a2e90f5-7fb42698-88240c0e_0] Write session: Do CDS request
2025-09-30T14:51:32.415224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af767eac-5a2e90f5-7fb42698-88240c0e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:32.422781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af767eac-5a2e90f5-7fb42698-88240c0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:32.422880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:32.422896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 466
2025-09-30T14:51:32.423030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 466 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:32.423058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 466 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:32.423066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=466 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:32.423072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:32.423651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 466 sessionId:  describe result for acl check
2025-09-30T14:51:32.423688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:32.423692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:32.423694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:32.423700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894983844602838:5214] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:32.424232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894983844602838:5214] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:32.426683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894983844602838:5214] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:32.429564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894983844602838:5214] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:32.429581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894983844602838:5214] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:32.429584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894983844602838:5214] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:32.429592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 466 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:32.432993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:32.435700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:32.435852Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:32.435860Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:32.435875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:32.435910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:32.435942Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894983754876649:4438]
2025-09-30T14:51:32.436392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:32.436622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:32.436649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:32.436859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:32.436898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:32.436902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:32.436903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:32.436903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:32.436904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:32.436905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:32.436905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:32.436906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:32.436907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:32.436908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:32.436909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.436909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.436910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.436911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:32.436911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:32.436915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:32.436923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:32.436926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:32.436928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:32.436930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:32.436933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:32.436935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:32.436938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:32.436940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:32.436943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:32.436945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.436948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.436950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.436952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:32.436955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:32.436960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:32.436965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:32.436969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:32.436972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:32.436975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:32.436978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:32.436981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:32.436984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:32.436986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:32.436989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:32.436992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:32.436995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:32.436998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:32.437001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:32.437003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:32.437007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:32.437009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:32.437012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:32.437015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:32.437018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:32.437021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.437025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.437027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.437030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.437033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.437036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.437039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:32.437042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:32.437044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:32.437047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:32.437071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:32.442426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:32.443324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:32.443335Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:32.443337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:32.443340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:32.443344Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 465 [2:7555894983754876649:4438]
2025-09-30T14:51:32.443356Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:32.443367Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:32.443369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:32.443371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:32.443373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:32.443385Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:32.443390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:32.443395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:32.443436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.443443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.443445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.443447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:32.443449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:32.443498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:32.443505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.443515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.443526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.443540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:32.443562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894983754876644:4438]
2025-09-30T14:51:32.443568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894983754876644:4438]
2025-09-30T14:51:32.443570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894983754876644:4438]
2025-09-30T14:51:32.443578Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:32.443586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:32.443592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:32.443596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:32.443599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:32.443607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:32.443610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:32.443619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894983844603006:5214], now have 1 active actors on pipe
2025-09-30T14:51:32.443629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894983844602788:2454], now have 1 active actors on pipe
2025-09-30T14:51:32.443655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894983754876644:4438]
2025-09-30T14:51:32.443667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:32.443688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:32.443670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 465
2025-09-30T14:51:32.443679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 465
2025-09-30T14:51:32.443738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:32.443748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:32.443772Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff40fbbb-2525527e-3c44bee3-8cf79586_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:32.443782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:32.443785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:32.443786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:32.443795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:32.443806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:32.443816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:32.443990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:32.444003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:32.444027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:32.444116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 466 partition: 0 MaxSeqNo: 42 sessionId: src_id|ff40fbbb-2525527e-3c44bee3-8cf79586_0
2025-09-30T14:51:32.444509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af767eac-5a2e90f5-7fb42698-88240c0e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ff40fbbb-2525527e-3c44bee3-8cf79586_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:32.447232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff40fbbb-2525527e-3c44bee3-8cf79586_0] Write session: try to update token
2025-09-30T14:51:32.447267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff40fbbb-2525527e-3c44bee3-8cf79586_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:32.455298Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:32.455315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:32.455325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894983754876644:4438]
2025-09-30T14:51:32.455369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:32.455380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:32.455553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:32.455702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:32.455844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:32.455990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:32.456393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:32.456440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:32.461157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 466 sessionId: src_id|ff40fbbb-2525527e-3c44bee3-8cf79586_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:32.463739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:32.463926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:32.463947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:32.463981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:32.464078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:32.465893Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:32.465908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:32.465910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:32.465911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:32.465919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894983754876644:4438]
2025-09-30T14:51:32.465922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894983754876644:4438]
2025-09-30T14:51:32.465924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894983754876644:4438]
2025-09-30T14:51:32.465953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:32.465958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.465959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:32.465962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:32.465967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:32.465970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:32.466085Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:32.514992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894983844603092:4849]
2025-09-30T14:51:32.515259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 465, pipe: [1:7555894983844603092:4849]
2025-09-30T14:51:32.577655Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:32.584428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:32.584453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:32.584605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:32.584664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:32.584727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:32.584790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:32.584833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:32.584840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:32.584904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:32.584961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:32.585020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:32.585081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:32.585123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:32.585129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:32.585190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:32.585248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:32.585309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:32.585369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:32.585410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:32.585416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:32.585476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:32.585534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:32.585593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:32.585652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:32.585693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:32.585702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:32.585762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:32.585818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:32.585879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:32.585938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:32.585980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:32.585985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:32.586047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:32.586103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:32.586164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:32.586223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:32.586267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:32.586272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:32.586333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:32.586390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:32.586451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:32.586520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:32.586560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:32.586566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:32.586628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:32.586685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:32.586744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:32.586803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:32.586858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:32.586864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:32.586932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:32.586990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:32.587048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:32.587107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:32.587147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:32.587153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:32.587212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:32.587284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:32.587344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:32.587407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:32.587447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:32.587452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:32.587492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894983844603092:4849], now have 1 active actors on pipe
2025-09-30T14:51:32.587740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:32.587742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894983844603092:4849]
2025-09-30T14:51:32.587755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:32.587761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:32.587785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 466 reason: error at write: Disconnected sessionId: src_id|ff40fbbb-2525527e-3c44bee3-8cf79586_0
2025-09-30T14:51:32.588000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 466 sessionId: src_id|ff40fbbb-2525527e-3c44bee3-8cf79586_0 is DEAD
2025-09-30T14:51:32.588127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff40fbbb-2525527e-3c44bee3-8cf79586_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:32.588137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff40fbbb-2525527e-3c44bee3-8cf79586_0] Write session will restart in 0.006297s
2025-09-30T14:51:32.588153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff40fbbb-2525527e-3c44bee3-8cf79586_0] Write session: Do CDS request
2025-09-30T14:51:32.588157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff40fbbb-2525527e-3c44bee3-8cf79586_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:32.588348Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:32.595679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff40fbbb-2525527e-3c44bee3-8cf79586_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:32.595787Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:32.595806Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 467
2025-09-30T14:51:32.595950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 467 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:32.595991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 467 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:32.596004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=467 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:32.596009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:32.596412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 467 sessionId:  describe result for acl check
2025-09-30T14:51:32.596456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:32.596458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:32.596459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:32.596465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894983844603123:5219] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:32.597044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894983844603123:5219] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:32.600765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894983844603123:5219] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:32.604009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894983844603123:5219] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:32.604022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894983844603123:5219] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:32.604025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894983844603123:5219] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:32.604031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 467 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:32.607959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:32.611309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:32.611487Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:32.611496Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:32.611507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:32.611555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:32.611595Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894983754876946:4441]
2025-09-30T14:51:32.612254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:32.612518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:32.612554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:32.612875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:32.612927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:32.612934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:32.612935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:32.612936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:32.612937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:32.612938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:32.612940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:32.612941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:32.612942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:32.612943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:32.612944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.612945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.612947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.612958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:32.612960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:32.612964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:32.612976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:32.612980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:32.612984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:32.612988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:32.612992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:32.612996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:32.613000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:32.613004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:32.613009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:32.613013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.613017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.613021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.613024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:32.613028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:32.613035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:32.613048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:32.613057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:32.613065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:32.613075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:32.613085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:32.613093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:32.613103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:32.613108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:32.613117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:32.613125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:32.613131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:32.613136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:32.613141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:32.613146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:32.613155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:32.613164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:32.613170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:32.613178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:32.613188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:32.613197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.613206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.613214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.613223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.613229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.613238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.613249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:32.613258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:32.613266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:32.613275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:32.613323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:32.618741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:32.619528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:32.619542Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:32.619544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:32.619547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:32.619552Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 466 [2:7555894983754876946:4441]
2025-09-30T14:51:32.619565Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:32.619579Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:32.619581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:32.619583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:32.619585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:32.619596Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:32.619601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:32.619606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:32.619647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.619652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.619654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.619656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:32.619659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:32.619707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:32.619713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.619720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.619726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.619736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:32.619751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894983844603298:5219], now have 1 active actors on pipe
2025-09-30T14:51:32.619758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894983844603093:2454], now have 1 active actors on pipe
2025-09-30T14:51:32.619763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894983754876941:4441]
2025-09-30T14:51:32.619765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894983754876941:4441]
2025-09-30T14:51:32.619768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894983754876941:4441]
2025-09-30T14:51:32.619779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:32.619790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:32.619794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:32.619798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:32.619800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:32.619807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:32.619810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:32.619832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 466
2025-09-30T14:51:32.619832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 466
2025-09-30T14:51:32.619842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894983754876941:4441]
2025-09-30T14:51:32.619849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:32.619868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:32.619879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:32.619883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:32.619904Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8403b91-285eb265-55b3f9b5-f847550b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:32.619913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:32.619916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:32.619917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:32.619924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:32.619931Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:32.619942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:32.620073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:32.620078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:32.620087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:32.620145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 467 partition: 0 MaxSeqNo: 42 sessionId: src_id|c8403b91-285eb265-55b3f9b5-f847550b_0
2025-09-30T14:51:32.620535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff40fbbb-2525527e-3c44bee3-8cf79586_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c8403b91-285eb265-55b3f9b5-f847550b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:32.623498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8403b91-285eb265-55b3f9b5-f847550b_0] Write session: try to update token
2025-09-30T14:51:32.623523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8403b91-285eb265-55b3f9b5-f847550b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:32.631487Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:32.631505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:32.631508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:32.631511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:32.631521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894983754876941:4441]
2025-09-30T14:51:32.631526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894983754876941:4441]
2025-09-30T14:51:32.631530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894983754876941:4441]
2025-09-30T14:51:32.631570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:32.631569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:32.631574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:32.631576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.631577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:32.631579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:32.631718Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:32.637400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 467 sessionId: src_id|c8403b91-285eb265-55b3f9b5-f847550b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:32.640147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:32.688074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894983844603397:4849]
2025-09-30T14:51:32.688337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 466, pipe: [1:7555894983844603397:4849]
2025-09-30T14:51:32.738986Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:32.739597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:32.739618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:32.739659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894983844603397:4849], now have 1 active actors on pipe
2025-09-30T14:51:32.739871Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:32.739851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:32.739863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:32.739869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:32.739909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894983844603397:4849]
2025-09-30T14:51:32.739931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 467 reason: error at write: Disconnected sessionId: src_id|c8403b91-285eb265-55b3f9b5-f847550b_0
2025-09-30T14:51:32.740102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 467 sessionId: src_id|c8403b91-285eb265-55b3f9b5-f847550b_0 is DEAD
2025-09-30T14:51:32.740263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8403b91-285eb265-55b3f9b5-f847550b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:32.740274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8403b91-285eb265-55b3f9b5-f847550b_0] Write session will restart in 0.009778s
2025-09-30T14:51:32.740297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8403b91-285eb265-55b3f9b5-f847550b_0] Write session: Do CDS request
2025-09-30T14:51:32.740306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8403b91-285eb265-55b3f9b5-f847550b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:32.750795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8403b91-285eb265-55b3f9b5-f847550b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:32.750945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:32.750962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 468
2025-09-30T14:51:32.751082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 468 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:32.751121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 468 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:32.751127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=468 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:32.751132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:32.751609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 468 sessionId:  describe result for acl check
2025-09-30T14:51:32.751649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:32.751667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:32.751673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:32.751680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894983844603487:5223] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:32.752246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894983844603487:5223] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:32.755155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894983844603487:5223] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:32.757716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894983844603487:5223] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:32.757733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894983844603487:5223] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:32.757736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894983844603487:5223] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:32.757744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 468 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:32.758589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:32.761311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:32.761501Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:32.761511Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:32.761521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:32.761568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:32.761607Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894983754877242:4443]
2025-09-30T14:51:32.762255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:32.762531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:32.762570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:32.762885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:32.762938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:32.762943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:32.762944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:32.762945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:32.762947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:32.762948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:32.762949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:32.762950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:32.762951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:32.762952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:32.762954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.762955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.762956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.762957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:32.762959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:32.762964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:32.762974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:32.762978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:32.762982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:32.762986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:32.762991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:32.762995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:32.762999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:32.763003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:32.763008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:32.763012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.763016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.763019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.763024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:32.763028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:32.763034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:32.763042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:32.763048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:32.763054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:32.763058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:32.763063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:32.763069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:32.763079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:32.763084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:32.763091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:32.763096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:32.763104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:32.763108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:32.763113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:32.763117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:32.763123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:32.763129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:32.763136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:32.763141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:32.763146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:32.763152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.763158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.763164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.763170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.763175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.763180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.763186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:32.763191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:32.763197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:32.763207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:32.763265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:32.768727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:32.770015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:32.770037Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:32.770040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:32.770044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:32.770050Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 467 [2:7555894983754877242:4443]
2025-09-30T14:51:32.770066Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:32.770080Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:32.770084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:32.770086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:32.770089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:32.770105Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:32.770111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:32.770120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:32.770176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.770184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.770186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.770188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:32.770191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:32.770252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:32.770263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.770275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.770288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.770306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:32.770328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894983844603688:5223], now have 1 active actors on pipe
2025-09-30T14:51:32.770336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894983844603398:2454], now have 1 active actors on pipe
2025-09-30T14:51:32.770342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894983754877237:4443]
2025-09-30T14:51:32.770345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894983754877237:4443]
2025-09-30T14:51:32.770347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894983754877237:4443]
2025-09-30T14:51:32.770414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 467
2025-09-30T14:51:32.770427Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 467
2025-09-30T14:51:32.770362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:32.770380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:32.770394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:32.770395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:32.770398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:32.770399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:32.770400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:32.770424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894983754877237:4443]
2025-09-30T14:51:32.770427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:32.770438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:32.770475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:32.770479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:32.770516Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2b9a84f-e0fd9398-f7d59de7-bae85ef8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:32.770525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:32.770528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:32.770530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:32.770539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:32.770548Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:32.770559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:32.770716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:32.770727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:32.770743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:32.770869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 468 partition: 0 MaxSeqNo: 42 sessionId: src_id|a2b9a84f-e0fd9398-f7d59de7-bae85ef8_0
2025-09-30T14:51:32.771201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8403b91-285eb265-55b3f9b5-f847550b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a2b9a84f-e0fd9398-f7d59de7-bae85ef8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:32.773926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b9a84f-e0fd9398-f7d59de7-bae85ef8_0] Write session: try to update token
2025-09-30T14:51:32.773956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b9a84f-e0fd9398-f7d59de7-bae85ef8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:32.787548Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:32.787565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:32.787576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894983754877237:4443]
2025-09-30T14:51:32.787613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:32.787619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:32.787796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:32.787957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:32.788108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:32.788257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:32.788457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:32.788512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:32.788812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 468 sessionId: src_id|a2b9a84f-e0fd9398-f7d59de7-bae85ef8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:32.791613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:32.792355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:32.792380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:32.792399Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:32.792402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:32.792404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:32.792406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:32.792414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894983754877237:4443]
2025-09-30T14:51:32.792418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894983754877237:4443]
2025-09-30T14:51:32.792422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894983754877237:4443]
2025-09-30T14:51:32.792470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:32.792469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:32.792474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:32.792477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:32.792481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.792484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:32.792691Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:32.840114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894983844603702:4849]
2025-09-30T14:51:32.840377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 467, pipe: [1:7555894983844603702:4849]
2025-09-30T14:51:32.900797Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:32.901018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:32.901049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894983844603702:4849], now have 1 active actors on pipe
2025-09-30T14:51:32.901148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:32.901213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894983844603702:4849]
2025-09-30T14:51:32.901241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:32.901257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:32.901260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:32.901330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 468 reason: error at write: Disconnected sessionId: src_id|a2b9a84f-e0fd9398-f7d59de7-bae85ef8_0
2025-09-30T14:51:32.901518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 468 sessionId: src_id|a2b9a84f-e0fd9398-f7d59de7-bae85ef8_0 is DEAD
2025-09-30T14:51:32.901637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b9a84f-e0fd9398-f7d59de7-bae85ef8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:32.901657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b9a84f-e0fd9398-f7d59de7-bae85ef8_0] Write session will restart in 0.007651s
2025-09-30T14:51:32.901681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b9a84f-e0fd9398-f7d59de7-bae85ef8_0] Write session: Do CDS request
2025-09-30T14:51:32.901686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b9a84f-e0fd9398-f7d59de7-bae85ef8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:32.910768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b9a84f-e0fd9398-f7d59de7-bae85ef8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:32.910936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:32.910952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 469
2025-09-30T14:51:32.911093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 469 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:32.911126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 469 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:32.911136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=469 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:32.911140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:32.911580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 469 sessionId:  describe result for acl check
2025-09-30T14:51:32.911620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:32.911622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:32.911624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:32.911630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894983844603760:5228] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:32.912201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894983844603760:5228] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:32.914690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894983844603760:5228] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:32.917423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894983844603760:5228] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:32.917436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894983844603760:5228] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:32.917449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894983844603760:5228] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:32.917457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 469 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:32.920014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:32.922588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:32.922739Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:32.922746Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:32.922755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:32.922799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:32.922827Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894983754877551:4446]
2025-09-30T14:51:32.923278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:32.923533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:32.923564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:32.923782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:32.923819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:32.923825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:32.923826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:32.923827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:32.923828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:32.923829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:32.923831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:32.923832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:32.923833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:32.923834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:32.923835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.923836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.923837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.923838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:32.923839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:32.923844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:32.923854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:32.923859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:32.923862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:32.923864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:32.923867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:32.923869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:32.923871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:32.923874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:32.923877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:32.923879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.923881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.923884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.923886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:32.923889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:32.923894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:32.923899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:32.923903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:32.923906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:32.923909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:32.923912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:32.923917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:32.923923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:32.923927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:32.923931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:32.923936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:32.923941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:32.923945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:32.923951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:32.923956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:32.923960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:32.923963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:32.923969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:32.923975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:32.923980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:32.923985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.923992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.924001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.924006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.924012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.924021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.924025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:32.924028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:32.924030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:32.924033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:32.924059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:32.929172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:32.930394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:32.930407Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:32.930409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:32.930411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:32.930416Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 468 [2:7555894983754877551:4446]
2025-09-30T14:51:32.930428Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:32.930443Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:32.930453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:32.930456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:32.930458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:32.930471Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:32.930475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:32.930480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:32.930547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.930555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.930556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.930559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:32.930561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:32.930620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:32.930629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.930639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:32.930649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:32.930662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:32.930676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894983754877546:4446]
2025-09-30T14:51:32.930682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894983754877546:4446]
2025-09-30T14:51:32.930683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894983754877546:4446]
2025-09-30T14:51:32.930691Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:32.930702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:32.930714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:32.930720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:32.930744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894983754877546:4446]
2025-09-30T14:51:32.930749Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:32.930757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:32.930766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:32.930768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:32.930773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:32.930786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894983844603715:2454], now have 1 active actors on pipe
2025-09-30T14:51:32.930811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894983844603948:5228], now have 1 active actors on pipe
2025-09-30T14:51:32.930900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 468
2025-09-30T14:51:32.931001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 468
2025-09-30T14:51:32.931070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:32.931077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:32.931098Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4cdf5d6e-876a665c-4294b4de-27b3b826_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:32.931109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:32.931112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:32.931114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:32.931124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:32.931135Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:32.931148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:32.931376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:32.931383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:32.931395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:32.931502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 469 partition: 0 MaxSeqNo: 42 sessionId: src_id|4cdf5d6e-876a665c-4294b4de-27b3b826_0
2025-09-30T14:51:32.931906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b9a84f-e0fd9398-f7d59de7-bae85ef8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4cdf5d6e-876a665c-4294b4de-27b3b826_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:32.934696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cdf5d6e-876a665c-4294b4de-27b3b826_0] Write session: try to update token
2025-09-30T14:51:32.934711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cdf5d6e-876a665c-4294b4de-27b3b826_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:32.941808Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:32.941823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:32.941830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894983754877546:4446]
2025-09-30T14:51:32.941865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:32.941870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:32.942018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:32.942136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:32.942253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:32.942370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:32.942630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:32.942661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:32.948449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 469 sessionId: src_id|4cdf5d6e-876a665c-4294b4de-27b3b826_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:32.951117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:32.951327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:32.951356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:32.952485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:32.952513Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:32.952515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:32.952517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:32.952518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:32.952525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894983754877546:4446]
2025-09-30T14:51:32.952528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894983754877546:4446]
2025-09-30T14:51:32.952530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894983754877546:4446]
2025-09-30T14:51:32.952550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:32.952553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:32.952560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:32.952562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:32.952563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:32.952566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:32.952611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:32.952746Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:33.001420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894988139571325:4849]
2025-09-30T14:51:33.001690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 468, pipe: [1:7555894988139571325:4849]
2025-09-30T14:51:33.070402Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:33.077431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:33.077457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:33.077607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:33.077665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:33.077721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:33.077777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:33.077822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:33.077832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:33.077893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:33.077948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:33.078005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:33.078071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:33.078116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:33.078122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:33.078182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:33.078235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:33.078291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:33.078347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:33.078402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:33.078407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:33.078466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:33.078534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:33.078590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:33.078643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:33.078684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:33.078692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:33.078750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:33.078801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:33.078858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:33.078915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:33.078954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:33.078960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:33.079016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:33.079069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:33.079128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:33.079197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:33.079236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:33.079254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:33.079314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:33.079370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:33.079428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:33.079485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:33.079523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:33.079529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:33.079586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:33.079640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:33.079696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:33.079750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:33.079790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:33.079796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:33.079853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:33.079907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:33.079963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:33.080020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:33.080059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:33.080064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:33.080120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:33.080175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:33.080239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:33.080298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:33.080339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:33.080345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:33.080384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894988139571325:4849], now have 1 active actors on pipe
2025-09-30T14:51:33.080635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:33.080659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894988139571325:4849]
2025-09-30T14:51:33.080684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:33.080686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:33.080710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 469 reason: error at write: Disconnected sessionId: src_id|4cdf5d6e-876a665c-4294b4de-27b3b826_0
2025-09-30T14:51:33.080912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 469 sessionId: src_id|4cdf5d6e-876a665c-4294b4de-27b3b826_0 is DEAD
2025-09-30T14:51:33.080999Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:33.081073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cdf5d6e-876a665c-4294b4de-27b3b826_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:33.081085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cdf5d6e-876a665c-4294b4de-27b3b826_0] Write session will restart in 0.006532s
2025-09-30T14:51:33.081107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cdf5d6e-876a665c-4294b4de-27b3b826_0] Write session: Do CDS request
2025-09-30T14:51:33.081114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cdf5d6e-876a665c-4294b4de-27b3b826_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:33.088683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cdf5d6e-876a665c-4294b4de-27b3b826_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:33.088958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:33.088972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 470
2025-09-30T14:51:33.089383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 470 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:33.089418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 470 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:33.089427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=470 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:33.089431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:33.089788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 470 sessionId:  describe result for acl check
2025-09-30T14:51:33.089819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:33.089821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:33.089822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:33.089826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894988139571366:5236] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:33.090227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894988139571366:5236] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:33.093092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894988139571366:5236] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:33.095983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894988139571366:5236] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:33.095996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894988139571366:5236] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:33.096000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894988139571366:5236] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:33.096007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 470 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:33.099427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:33.102265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:33.102464Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:33.102475Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:33.102486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:33.102549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:33.102590Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894988049845147:4449]
2025-09-30T14:51:33.103321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:33.103621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:33.103667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:33.104007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:33.104063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:33.104069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:33.104071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:33.104072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:33.104074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:33.104075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:33.104077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:33.104078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:33.104079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:33.104080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:33.104081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.104083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.104084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.104085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:33.104086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:33.104093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:33.104103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:33.104107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:33.104112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:33.104117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:33.104122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:33.104126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:33.104131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:33.104135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:33.104140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:33.104145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.104150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.104155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.104159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:33.104163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:33.104171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:33.104184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:33.104194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:33.104205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:33.104216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:33.104226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:33.104235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:33.104245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:33.104254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:33.104264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:33.104273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:33.104283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:33.104292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:33.104302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:33.104311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:33.104321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:33.104332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:33.104343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:33.104348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:33.104358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:33.104367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.104377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.104386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.104396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.104406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.104416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.104425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:33.104435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:33.104444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:33.104454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:33.104505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:33.109756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:33.110563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:33.110575Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:33.110577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:33.110580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:33.110585Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 469 [2:7555894988049845147:4449]
2025-09-30T14:51:33.110599Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:33.110611Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:33.110613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.110615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.110616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.110627Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:33.110632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:33.110638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:33.110681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.110689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.110690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.110693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:33.110695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:33.110759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:33.110766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.110778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.110794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.110815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:33.110839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894988139571333:2454], now have 1 active actors on pipe
2025-09-30T14:51:33.110842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894988139571550:5236], now have 1 active actors on pipe
2025-09-30T14:51:33.110848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894988049845142:4449]
2025-09-30T14:51:33.110850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894988049845142:4449]
2025-09-30T14:51:33.110851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894988049845142:4449]
2025-09-30T14:51:33.110861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:33.110873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:33.110880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:33.110888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:33.110889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:33.110890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:33.110891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:33.110913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 469
2025-09-30T14:51:33.111006Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 469
2025-09-30T14:51:33.111344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894988049845142:4449]
2025-09-30T14:51:33.111356Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:33.111372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:33.111386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:33.111395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:33.111431Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b457ad6-20a316e7-46ea79e-36631b32_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:33.111443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.111447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.111449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:33.111458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.111471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:33.111494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:33.111707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:33.111714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:33.111726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:33.111823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 470 partition: 0 MaxSeqNo: 42 sessionId: src_id|5b457ad6-20a316e7-46ea79e-36631b32_0
2025-09-30T14:51:33.112184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cdf5d6e-876a665c-4294b4de-27b3b826_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5b457ad6-20a316e7-46ea79e-36631b32_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:33.114878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b457ad6-20a316e7-46ea79e-36631b32_0] Write session: try to update token
2025-09-30T14:51:33.114896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b457ad6-20a316e7-46ea79e-36631b32_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:33.123157Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:33.123179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:33.123182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:33.123184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:33.123193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894988049845142:4449]
2025-09-30T14:51:33.123198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894988049845142:4449]
2025-09-30T14:51:33.123201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894988049845142:4449]
2025-09-30T14:51:33.123263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:33.123263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:33.123270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:33.123271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.123274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:33.123277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:33.123421Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:33.130174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 470 sessionId: src_id|5b457ad6-20a316e7-46ea79e-36631b32_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:33.133086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:33.180596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894988139571639:4849]
2025-09-30T14:51:33.180854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 469, pipe: [1:7555894988139571639:4849]
2025-09-30T14:51:33.227763Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:33.228021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:33.228032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:33.228048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894988139571639:4849], now have 1 active actors on pipe
2025-09-30T14:51:33.228267Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:33.228283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:33.228298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:33.228313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894988139571639:4849]
2025-09-30T14:51:33.228332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:33.228349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 470 reason: error at write: Disconnected sessionId: src_id|5b457ad6-20a316e7-46ea79e-36631b32_0
2025-09-30T14:51:33.228545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 470 sessionId: src_id|5b457ad6-20a316e7-46ea79e-36631b32_0 is DEAD
2025-09-30T14:51:33.228700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b457ad6-20a316e7-46ea79e-36631b32_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:33.228710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b457ad6-20a316e7-46ea79e-36631b32_0] Write session will restart in 0.009246s
2025-09-30T14:51:33.228733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b457ad6-20a316e7-46ea79e-36631b32_0] Write session: Do CDS request
2025-09-30T14:51:33.228756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b457ad6-20a316e7-46ea79e-36631b32_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:33.238839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b457ad6-20a316e7-46ea79e-36631b32_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:33.238919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:33.238938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 471
2025-09-30T14:51:33.239121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 471 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:33.239151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 471 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:33.239160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=471 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:33.239165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:33.239686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 471 sessionId:  describe result for acl check
2025-09-30T14:51:33.239723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:33.239731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:33.239746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:33.239756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894988139571717:5240] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:33.240269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894988139571717:5240] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:33.243198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894988139571717:5240] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:33.246509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894988139571717:5240] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:33.246525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894988139571717:5240] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:33.246528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894988139571717:5240] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:33.246536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 471 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:33.248430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:33.251277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:33.251478Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:33.251490Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:33.251501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:33.251549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:33.251589Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894988049845446:4451]
2025-09-30T14:51:33.252289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:33.252581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:33.252620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:33.252957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:33.253012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:33.253018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:33.253020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:33.253021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:33.253022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:33.253024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:33.253025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:33.253027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:33.253028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:33.253029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:33.253031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.253032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.253033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.253034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:33.253036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:33.253041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:33.253052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:33.253057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:33.253061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:33.253066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:33.253071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:33.253076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:33.253081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:33.253085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:33.253090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:33.253095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.253099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.253103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.253107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:33.253112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:33.253119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:33.253126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:33.253135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:33.253147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:33.253152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:33.253163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:33.253167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:33.253178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:33.253184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:33.253194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:33.253199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:33.253209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:33.253214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:33.253227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:33.253233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:33.253239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:33.253244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:33.253250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:33.253256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:33.253262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:33.253267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.253273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.253278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.253284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.253289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.253299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.253308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:33.253314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:33.253319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:33.253325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:33.253373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:33.258755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:33.260042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:33.260058Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:33.260060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:33.260064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:33.260070Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 470 [2:7555894988049845446:4451]
2025-09-30T14:51:33.260085Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:33.260100Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:33.260102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.260104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.260106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.260119Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:33.260128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:33.260133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:33.260180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.260185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.260187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.260189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:33.260191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:33.260240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:33.260245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.260255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.260266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.260275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:33.260288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894988049845441:4451]
2025-09-30T14:51:33.260294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894988049845441:4451]
2025-09-30T14:51:33.260296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894988049845441:4451]
2025-09-30T14:51:33.260304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:33.260313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:33.260317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:33.260323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:33.260325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:33.260326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:33.260328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:33.260335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894988139571932:5240], now have 1 active actors on pipe
2025-09-30T14:51:33.260337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894988139571640:2454], now have 1 active actors on pipe
2025-09-30T14:51:33.260364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894988049845441:4451]
2025-09-30T14:51:33.260373Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:33.260402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:33.260397Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 470
2025-09-30T14:51:33.260400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 470
2025-09-30T14:51:33.260441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:33.260449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:33.260472Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ffe77df-1d7c55f7-9bb1922d-c6a56958_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:33.260477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.260481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.260483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:33.260493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.260502Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:33.260515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:33.260708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:33.260723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:33.260746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:33.260865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 471 partition: 0 MaxSeqNo: 42 sessionId: src_id|1ffe77df-1d7c55f7-9bb1922d-c6a56958_0
2025-09-30T14:51:33.261263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b457ad6-20a316e7-46ea79e-36631b32_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1ffe77df-1d7c55f7-9bb1922d-c6a56958_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:33.263990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ffe77df-1d7c55f7-9bb1922d-c6a56958_0] Write session: try to update token
2025-09-30T14:51:33.264007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ffe77df-1d7c55f7-9bb1922d-c6a56958_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:33.272164Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:33.272185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:33.272188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:33.272191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:33.272199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894988049845441:4451]
2025-09-30T14:51:33.272204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894988049845441:4451]
2025-09-30T14:51:33.272208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894988049845441:4451]
2025-09-30T14:51:33.272247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:33.272254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.272259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:33.272258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:33.272264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:33.272268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:33.272400Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:33.279199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 471 sessionId: src_id|1ffe77df-1d7c55f7-9bb1922d-c6a56958_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:33.282049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:33.328569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894988139571969:4849]
2025-09-30T14:51:33.328832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 470, pipe: [1:7555894988139571969:4849]
2025-09-30T14:51:33.380949Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:33.381338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:33.381349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:33.381366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894988139571969:4849], now have 1 active actors on pipe
2025-09-30T14:51:33.381521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:33.381524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:33.381528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:33.381571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894988139571969:4849]
2025-09-30T14:51:33.381581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 471 reason: error at write: Disconnected sessionId: src_id|1ffe77df-1d7c55f7-9bb1922d-c6a56958_0
2025-09-30T14:51:33.381751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 471 sessionId: src_id|1ffe77df-1d7c55f7-9bb1922d-c6a56958_0 is DEAD
2025-09-30T14:51:33.381915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ffe77df-1d7c55f7-9bb1922d-c6a56958_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:33.381925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ffe77df-1d7c55f7-9bb1922d-c6a56958_0] Write session will restart in 0.007112s
2025-09-30T14:51:33.381904Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:33.381942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ffe77df-1d7c55f7-9bb1922d-c6a56958_0] Write session: Do CDS request
2025-09-30T14:51:33.381947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ffe77df-1d7c55f7-9bb1922d-c6a56958_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:33.389782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ffe77df-1d7c55f7-9bb1922d-c6a56958_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:33.389876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:33.389890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 472
2025-09-30T14:51:33.389989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 472 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:33.390028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 472 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:33.390036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=472 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:33.390039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:33.390579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 472 sessionId:  describe result for acl check
2025-09-30T14:51:33.390623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:33.390631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:33.390633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:33.390638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894988139572020:5251] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:33.391184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894988139572020:5251] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:33.393732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894988139572020:5251] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:33.397388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894988139572020:5251] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:33.397405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894988139572020:5251] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:33.397408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894988139572020:5251] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:33.397416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 472 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:33.400736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:33.403399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:33.403591Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:33.403602Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:33.403614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:33.403666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:33.403707Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894988049845782:4465]
2025-09-30T14:51:33.404338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:33.404632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:33.404671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:33.404911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:33.404956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:33.404962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:33.404963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:33.404964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:33.404965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:33.404966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:33.404967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:33.404968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:33.404969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:33.404970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:33.404972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.404973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.404974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.404975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:33.404976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:33.404980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:33.404989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:33.404994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:33.404997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:33.405001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:33.405005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:33.405008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:33.405012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:33.405015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:33.405019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:33.405023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.405027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.405030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.405034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:33.405038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:33.405045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:33.405052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:33.405057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:33.405063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:33.405068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:33.405072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:33.405074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:33.405077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:33.405080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:33.405083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:33.405085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:33.405088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:33.405090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:33.405093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:33.405096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:33.405099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:33.405102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:33.405105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:33.405107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:33.405110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:33.405112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.405117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.405121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.405126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.405131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.405136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.405147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:33.405151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:33.405158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:33.405161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:33.405184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:33.410247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:33.411370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:33.411386Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:33.411388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:33.411392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:33.411398Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 471 [2:7555894988049845782:4465]
2025-09-30T14:51:33.411413Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:33.411434Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:33.411441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.411445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.411447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.411460Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:33.411472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:33.411479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:33.411542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.411550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.411552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.411555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:33.411558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:33.411624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:33.411632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.411643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.411659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.411682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:33.411701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894988139572196:5251], now have 1 active actors on pipe
2025-09-30T14:51:33.411710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894988139571970:2454], now have 1 active actors on pipe
2025-09-30T14:51:33.411715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894988049845777:4465]
2025-09-30T14:51:33.411718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894988049845777:4465]
2025-09-30T14:51:33.411720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894988049845777:4465]
2025-09-30T14:51:33.411733Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:33.411754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:33.411746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:33.411758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:33.411733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 471
2025-09-30T14:51:33.411760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:33.411767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:33.411736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 471
2025-09-30T14:51:33.411771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:33.411808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:33.411815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:33.411826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894988049845777:4465]
2025-09-30T14:51:33.411836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:33.411860Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d2af27e8-7dd986a4-bb8753a6-2f15d0a2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:33.411862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:33.411870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.411878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.411880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:33.411892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.411907Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:33.411937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:33.412112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:33.412122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:33.412136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:33.412212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 472 partition: 0 MaxSeqNo: 42 sessionId: src_id|d2af27e8-7dd986a4-bb8753a6-2f15d0a2_0
2025-09-30T14:51:33.412597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ffe77df-1d7c55f7-9bb1922d-c6a56958_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d2af27e8-7dd986a4-bb8753a6-2f15d0a2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:33.415523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2af27e8-7dd986a4-bb8753a6-2f15d0a2_0] Write session: try to update token
2025-09-30T14:51:33.415542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2af27e8-7dd986a4-bb8753a6-2f15d0a2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:33.423327Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:33.423346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:33.423348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:33.423349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:33.423357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894988049845777:4465]
2025-09-30T14:51:33.423360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894988049845777:4465]
2025-09-30T14:51:33.423363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894988049845777:4465]
2025-09-30T14:51:33.423395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:33.423401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.423403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:33.423404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:33.423428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:33.423433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:33.423585Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:33.429249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 472 sessionId: src_id|d2af27e8-7dd986a4-bb8753a6-2f15d0a2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:33.431771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:33.481637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894988139572280:4849]
2025-09-30T14:51:33.481917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 471, pipe: [1:7555894988139572280:4849]
2025-09-30T14:51:33.523878Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:33.524574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:33.524589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:33.524621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894988139572280:4849], now have 1 active actors on pipe
2025-09-30T14:51:33.524787Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:33.524819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:33.524832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:33.524842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:33.524885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894988139572280:4849]
2025-09-30T14:51:33.524893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 472 reason: error at write: Disconnected sessionId: src_id|d2af27e8-7dd986a4-bb8753a6-2f15d0a2_0
2025-09-30T14:51:33.525075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 472 sessionId: src_id|d2af27e8-7dd986a4-bb8753a6-2f15d0a2_0 is DEAD
2025-09-30T14:51:33.525266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2af27e8-7dd986a4-bb8753a6-2f15d0a2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:33.525278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2af27e8-7dd986a4-bb8753a6-2f15d0a2_0] Write session will restart in 0.007044s
2025-09-30T14:51:33.525301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2af27e8-7dd986a4-bb8753a6-2f15d0a2_0] Write session: Do CDS request
2025-09-30T14:51:33.525308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2af27e8-7dd986a4-bb8753a6-2f15d0a2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:33.533784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2af27e8-7dd986a4-bb8753a6-2f15d0a2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:33.533909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:33.533925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 473
2025-09-30T14:51:33.534034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 473 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:33.534064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 473 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:33.534071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=473 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:33.534074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:33.534528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 473 sessionId:  describe result for acl check
2025-09-30T14:51:33.534566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:33.534573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:33.534575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:33.534581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894988139572341:5256] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:33.535136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894988139572341:5256] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:33.537502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894988139572341:5256] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:33.540373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894988139572341:5256] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:33.540386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894988139572341:5256] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:33.540388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894988139572341:5256] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:33.540394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 473 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:33.543882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:33.546591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:33.546733Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:33.546740Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:33.546749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:33.546792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:33.546821Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894988049846085:4468]
2025-09-30T14:51:33.547293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:33.547512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:33.547552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:33.547836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:33.547902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:33.547909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:33.547910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:33.547911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:33.547912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:33.547913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:33.547914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:33.547915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:33.547916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:33.547917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:33.547918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.547919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.547920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.547921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:33.547923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:33.547927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:33.547936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:33.547940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:33.547944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:33.547948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:33.547952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:33.547956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:33.547960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:33.547964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:33.547968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:33.547972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.547976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.547980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.547984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:33.547987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:33.547996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:33.548003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:33.548009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:33.548014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:33.548018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:33.548023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:33.548027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:33.548032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:33.548045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:33.548050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:33.548059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:33.548065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:33.548074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:33.548079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:33.548088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:33.548093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:33.548098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:33.548105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:33.548108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:33.548111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:33.548114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.548117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.548119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.548122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.548125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.548128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.548130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:33.548133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:33.548136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:33.548139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:33.548162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:33.553630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:33.554523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:33.554536Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:33.554539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:33.554543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:33.554550Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 472 [2:7555894988049846085:4468]
2025-09-30T14:51:33.554566Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:33.554581Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:33.554590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.554593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.554595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.554609Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:33.554616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:33.554622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:33.554679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.554687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.554689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.554693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:33.554696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:33.554755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:33.554762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.554776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.554797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.554814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:33.554831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894988139572281:2454], now have 1 active actors on pipe
2025-09-30T14:51:33.554840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894988139572511:5256], now have 1 active actors on pipe
2025-09-30T14:51:33.554845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894988049846079:4468]
2025-09-30T14:51:33.554848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894988049846079:4468]
2025-09-30T14:51:33.554858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894988049846079:4468]
2025-09-30T14:51:33.554871Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:33.554888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:33.554869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 472
2025-09-30T14:51:33.554905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:33.554906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:33.554902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 472
2025-09-30T14:51:33.554909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:33.554915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:33.554918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:33.554952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:33.554962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:33.554973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894988049846079:4468]
2025-09-30T14:51:33.554981Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:33.554991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:33.555009Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2000287a-75710e47-d5c40722-6fcb50df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:33.555021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.555025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.555027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:33.555037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.555050Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:33.555077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:33.555206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:33.555216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:33.555232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:33.555362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 473 partition: 0 MaxSeqNo: 42 sessionId: src_id|2000287a-75710e47-d5c40722-6fcb50df_0
2025-09-30T14:51:33.555774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2af27e8-7dd986a4-bb8753a6-2f15d0a2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2000287a-75710e47-d5c40722-6fcb50df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:33.558597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2000287a-75710e47-d5c40722-6fcb50df_0] Write session: try to update token
2025-09-30T14:51:33.558615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2000287a-75710e47-d5c40722-6fcb50df_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:33.566908Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:33.566927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:33.566930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:33.566932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:33.566941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894988049846079:4468]
2025-09-30T14:51:33.566946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894988049846079:4468]
2025-09-30T14:51:33.566950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894988049846079:4468]
2025-09-30T14:51:33.566987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:33.566993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.566994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:33.566998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:33.567000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:33.567004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:33.567144Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:33.572627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 473 sessionId: src_id|2000287a-75710e47-d5c40722-6fcb50df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:33.575260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:33.625067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894988139572602:4849]
2025-09-30T14:51:33.625356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 472, pipe: [1:7555894988139572602:4849]
2025-09-30T14:51:33.671901Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:33.672365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:33.672381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:33.672417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894988139572602:4849], now have 1 active actors on pipe
2025-09-30T14:51:33.672626Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:33.672638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894988139572602:4849]
2025-09-30T14:51:33.672663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:33.672676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:33.672747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 473 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2000287a-75710e47-d5c40722-6fcb50df_0
2025-09-30T14:51:33.672941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 473 sessionId: src_id|2000287a-75710e47-d5c40722-6fcb50df_0 is DEAD
2025-09-30T14:51:33.673107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2000287a-75710e47-d5c40722-6fcb50df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:33.673128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2000287a-75710e47-d5c40722-6fcb50df_0] Write session will restart in 0.006517s
2025-09-30T14:51:33.673151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2000287a-75710e47-d5c40722-6fcb50df_0] Write session: Do CDS request
2025-09-30T14:51:33.673156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2000287a-75710e47-d5c40722-6fcb50df_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:33.680783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2000287a-75710e47-d5c40722-6fcb50df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:33.680857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:33.680873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 474
2025-09-30T14:51:33.681016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 474 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:33.681057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 474 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:33.681068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=474 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:33.681072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:33.681549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 474 sessionId:  describe result for acl check
2025-09-30T14:51:33.681588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:33.681590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:33.681592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:33.681597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894988139572645:5260] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:33.682230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894988139572645:5260] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:33.685215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894988139572645:5260] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:33.688613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894988139572645:5260] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:33.688628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894988139572645:5260] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:33.688631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894988139572645:5260] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:33.688640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 474 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:33.693347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:33.695994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:33.696168Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:33.696181Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:33.696191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:33.696236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:33.696265Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894988049846386:4470]
2025-09-30T14:51:33.696868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:33.697135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:33.697176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:33.697491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:33.697543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:33.697547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:33.697548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:33.697549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:33.697550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:33.697551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:33.697553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:33.697554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:33.697555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:33.697556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:33.697557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.697558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.697559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.697561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:33.697562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:33.697567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:33.697577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:33.697581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:33.697586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:33.697590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:33.697594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:33.697598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:33.697602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:33.697606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:33.697610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:33.697614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.697618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.697622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.697626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:33.697630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:33.697637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:33.697649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:33.697655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:33.697661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:33.697665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:33.697671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:33.697675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:33.697680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:33.697688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:33.697693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:33.697702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:33.697708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:33.697712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:33.697722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:33.697726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:33.697732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:33.697741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:33.697746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:33.697754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:33.697759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:33.697764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.697769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.697774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.697779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.697784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.697790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.697794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:33.697799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:33.697811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:33.697816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:33.697862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:33.702995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:33.703865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:33.703881Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:33.703884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:33.703887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:33.703893Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 473 [2:7555894988049846386:4470]
2025-09-30T14:51:33.703909Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:33.703929Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:33.703932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.703935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.703937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.703952Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:33.703959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:33.703966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:33.704024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.704031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.704033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.704037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:33.704039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:33.704118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:33.704126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.704134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.704140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.704154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:33.704177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894988139572604:2454], now have 1 active actors on pipe
2025-09-30T14:51:33.704185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894988139572796:5260], now have 1 active actors on pipe
2025-09-30T14:51:33.704191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894988049846381:4470]
2025-09-30T14:51:33.704198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894988049846381:4470]
2025-09-30T14:51:33.704200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894988049846381:4470]
2025-09-30T14:51:33.704212Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:33.704224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:33.704227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:33.704228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:33.704232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:33.704245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:33.704253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:33.704280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894988049846381:4470]
2025-09-30T14:51:33.704291Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:33.704299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:33.704288Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 473
2025-09-30T14:51:33.704281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 473
2025-09-30T14:51:33.704329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:33.704339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:33.704370Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e26657c-bd2223e6-d54f17fa-a31ff64e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:33.704380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.704384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.704386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:33.704395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.704407Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:33.704423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:33.704544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:33.704555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:33.704568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:33.704644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 474 partition: 0 MaxSeqNo: 42 sessionId: src_id|9e26657c-bd2223e6-d54f17fa-a31ff64e_0
2025-09-30T14:51:33.705053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2000287a-75710e47-d5c40722-6fcb50df_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9e26657c-bd2223e6-d54f17fa-a31ff64e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:33.707911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e26657c-bd2223e6-d54f17fa-a31ff64e_0] Write session: try to update token
2025-09-30T14:51:33.707929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e26657c-bd2223e6-d54f17fa-a31ff64e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:33.717276Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:33.717301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:33.717304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:33.717307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:33.717318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894988049846381:4470]
2025-09-30T14:51:33.717324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894988049846381:4470]
2025-09-30T14:51:33.717330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894988049846381:4470]
2025-09-30T14:51:33.717375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:33.717378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:33.717383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:33.717386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:33.717388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.717392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:33.717560Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:33.723097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 474 sessionId: src_id|9e26657c-bd2223e6-d54f17fa-a31ff64e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:33.725954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:33.772969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894988139572914:4849]
2025-09-30T14:51:33.773224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 473, pipe: [1:7555894988139572914:4849]
2025-09-30T14:51:33.821959Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:33.822703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:33.822721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:33.822739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894988139572914:4849], now have 1 active actors on pipe
2025-09-30T14:51:33.822923Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:33.823077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:33.823082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894988139572914:4849]
2025-09-30T14:51:33.823109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:33.823181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 474 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9e26657c-bd2223e6-d54f17fa-a31ff64e_0
2025-09-30T14:51:33.823416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 474 sessionId: src_id|9e26657c-bd2223e6-d54f17fa-a31ff64e_0 is DEAD
2025-09-30T14:51:33.823552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e26657c-bd2223e6-d54f17fa-a31ff64e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:33.823561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e26657c-bd2223e6-d54f17fa-a31ff64e_0] Write session will restart in 0.008568s
2025-09-30T14:51:33.823577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e26657c-bd2223e6-d54f17fa-a31ff64e_0] Write session: Do CDS request
2025-09-30T14:51:33.823581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e26657c-bd2223e6-d54f17fa-a31ff64e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:33.833719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e26657c-bd2223e6-d54f17fa-a31ff64e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:33.833761Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:33.833775Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 475
2025-09-30T14:51:33.833923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 475 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:33.833954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 475 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:33.833959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=475 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:33.833963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:33.834380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 475 sessionId:  describe result for acl check
2025-09-30T14:51:33.834412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:33.834418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:33.834420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:33.834428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894988139573011:5264] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:33.834939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894988139573011:5264] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:33.837283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894988139573011:5264] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:33.839907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894988139573011:5264] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:33.839920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894988139573011:5264] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:33.839924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894988139573011:5264] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:33.839931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 475 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:33.841593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:33.844307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:33.844497Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:33.844506Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:33.844515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:33.844564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:33.844609Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894988049846701:4472]
2025-09-30T14:51:33.845240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:33.845510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:33.845554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:33.845858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:33.845910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:33.845916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:33.845918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:33.845919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:33.845920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:33.845921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:33.845922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:33.845923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:33.845924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:33.845926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:33.845927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.845928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.845929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.845930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:33.845931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:33.845936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:33.845947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:33.845951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:33.845955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:33.845959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:33.845963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:33.845967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:33.845971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:33.845975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:33.845981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:33.845985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.845989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.845993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.845997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:33.846006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:33.846014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:33.846025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:33.846035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:33.846045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:33.846054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:33.846063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:33.846071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:33.846077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:33.846086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:33.846095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:33.846104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:33.846109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:33.846118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:33.846127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:33.846136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:33.846143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:33.846152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:33.846161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:33.846169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:33.846179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:33.846187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.846196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.846204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.846209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.846218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.846228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.846236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:33.846245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:33.846254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:33.846263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:33.846310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:33.851579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:33.852790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:33.852803Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:33.852805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:33.852809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:33.852815Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 474 [2:7555894988049846701:4472]
2025-09-30T14:51:33.852829Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:33.852843Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:33.852850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.852853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.852856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.852869Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:33.852882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:33.852893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:33.852947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.852954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.852956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.852959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:33.852961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:33.853024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:33.853033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.853042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.853053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.853069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:33.853086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894988139572916:2454], now have 1 active actors on pipe
2025-09-30T14:51:33.853093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894988139573212:5264], now have 1 active actors on pipe
2025-09-30T14:51:33.853099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894988049846696:4472]
2025-09-30T14:51:33.853106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894988049846696:4472]
2025-09-30T14:51:33.853108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894988049846696:4472]
2025-09-30T14:51:33.853120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:33.853130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:33.853132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:33.853134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:33.853137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:33.853150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:33.853153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:33.853176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894988049846696:4472]
2025-09-30T14:51:33.853190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:33.853213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:33.853202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 474
2025-09-30T14:51:33.853203Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 474
2025-09-30T14:51:33.853285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:33.853296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:33.853319Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2707e5a9-6e05ea31-a88caf20-11a7a56e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:33.853326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.853329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.853331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:33.853341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.853352Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:33.853364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:33.853518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:33.853527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:33.853541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:33.853634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 475 partition: 0 MaxSeqNo: 42 sessionId: src_id|2707e5a9-6e05ea31-a88caf20-11a7a56e_0
2025-09-30T14:51:33.854010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e26657c-bd2223e6-d54f17fa-a31ff64e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2707e5a9-6e05ea31-a88caf20-11a7a56e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:33.856594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2707e5a9-6e05ea31-a88caf20-11a7a56e_0] Write session: try to update token
2025-09-30T14:51:33.856610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2707e5a9-6e05ea31-a88caf20-11a7a56e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:33.864517Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:33.864538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:33.864540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:33.864542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:33.864550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894988049846696:4472]
2025-09-30T14:51:33.864554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894988049846696:4472]
2025-09-30T14:51:33.864557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894988049846696:4472]
2025-09-30T14:51:33.864592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:33.864598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.864605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:33.864617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:33.864641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:33.864646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:33.864733Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:33.870092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 475 sessionId: src_id|2707e5a9-6e05ea31-a88caf20-11a7a56e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:33.872827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:33.923009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894988139573238:4849]
2025-09-30T14:51:33.923302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 474, pipe: [1:7555894988139573238:4849]
2025-09-30T14:51:33.968848Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:33.969270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:33.969282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:33.969314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894988139573238:4849], now have 1 active actors on pipe
2025-09-30T14:51:33.969449Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:33.969516Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:33.969531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:33.969535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:33.969571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894988139573238:4849]
2025-09-30T14:51:33.969597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 475 reason: error at write: Disconnected sessionId: src_id|2707e5a9-6e05ea31-a88caf20-11a7a56e_0
2025-09-30T14:51:33.969812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 475 sessionId: src_id|2707e5a9-6e05ea31-a88caf20-11a7a56e_0 is DEAD
2025-09-30T14:51:33.969949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2707e5a9-6e05ea31-a88caf20-11a7a56e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:33.969966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2707e5a9-6e05ea31-a88caf20-11a7a56e_0] Write session will restart in 0.009151s
2025-09-30T14:51:33.969983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2707e5a9-6e05ea31-a88caf20-11a7a56e_0] Write session: Do CDS request
2025-09-30T14:51:33.969989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2707e5a9-6e05ea31-a88caf20-11a7a56e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:33.980840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2707e5a9-6e05ea31-a88caf20-11a7a56e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:33.980947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:33.980961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 476
2025-09-30T14:51:33.981098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 476 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:33.981130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 476 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:33.981140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=476 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:33.981143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:33.981611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 476 sessionId:  describe result for acl check
2025-09-30T14:51:33.981647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:33.981654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:33.981656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:33.981662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894988139573354:5271] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:33.982201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894988139573354:5271] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:33.984927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894988139573354:5271] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:33.987550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894988139573354:5271] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:33.987566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894988139573354:5271] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:33.987571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894988139573354:5271] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:33.987578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 476 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:33.987957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:33.990366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:33.990529Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:33.990539Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:33.990548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:33.990585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:33.990611Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894988049847005:4475]
2025-09-30T14:51:33.991175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:33.991412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:33.991448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:33.991693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:33.991747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:33.991752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:33.991753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:33.991754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:33.991755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:33.991757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:33.991758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:33.991759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:33.991760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:33.991761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:33.991763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.991764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.991765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.991766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:33.991767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:33.991772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:33.991793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:33.991797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:33.991801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:33.991805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:33.991810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:33.991813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:33.991817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:33.991821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:33.991830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:33.991834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.991842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.991846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.991854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:33.991858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:33.991868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:33.991880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:33.991889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:33.991897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:33.991899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:33.991902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:33.991906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:33.991909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:33.991915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:33.991918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:33.991921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:33.991924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:33.991927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:33.991933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:33.991936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:33.991939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:33.991944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:33.991953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:33.991962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:33.991967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:33.991975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.991985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.991993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.991998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.992003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.992012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.992020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:33.992025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:33.992034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:33.992043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:33.992091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:33.996959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:33.997768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:33.997783Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:33.997785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:33.997788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:33.997793Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 475 [2:7555894988049847005:4475]
2025-09-30T14:51:33.997803Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:33.997814Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:33.997816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.997818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.997819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.997829Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:33.997834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:33.997839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:33.997889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.997895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.997897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.997899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:33.997901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:33.997949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:33.997955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:33.997962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:33.997968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:33.997978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:33.997993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894988049847000:4475]
2025-09-30T14:51:33.997995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894988049847000:4475]
2025-09-30T14:51:33.997996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894988049847000:4475]
2025-09-30T14:51:33.998002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:33.998012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:33.998014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894988139573547:5271], now have 1 active actors on pipe
2025-09-30T14:51:33.998017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894988139573240:2454], now have 1 active actors on pipe
2025-09-30T14:51:33.998021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:33.998023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:33.998023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:33.998032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:33.998034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:33.998055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894988049847000:4475]
2025-09-30T14:51:33.998068Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:33.998076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:33.998083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 475
2025-09-30T14:51:33.998109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 475
2025-09-30T14:51:33.998158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:33.998166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:33.998183Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b577247e-f6113e7c-3bf5c781-e975e4f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:33.998188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.998191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.998192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:33.998199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.998209Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:33.998221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:33.998345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:33.998349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:33.998360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:33.998453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 476 partition: 0 MaxSeqNo: 42 sessionId: src_id|b577247e-f6113e7c-3bf5c781-e975e4f2_0
2025-09-30T14:51:33.998858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2707e5a9-6e05ea31-a88caf20-11a7a56e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b577247e-f6113e7c-3bf5c781-e975e4f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:34.002110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b577247e-f6113e7c-3bf5c781-e975e4f2_0] Write session: try to update token
2025-09-30T14:51:34.002132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b577247e-f6113e7c-3bf5c781-e975e4f2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:34.009202Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:34.009219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:34.009220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:34.009222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:34.009228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894988049847000:4475]
2025-09-30T14:51:34.009231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894988049847000:4475]
2025-09-30T14:51:34.009235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894988049847000:4475]
2025-09-30T14:51:34.009263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:34.009266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:34.009269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.009270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:34.009280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:34.009282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:34.009388Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:34.020153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 476 sessionId: src_id|b577247e-f6113e7c-3bf5c781-e975e4f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:34.022877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:34.069916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894992434540859:4849]
2025-09-30T14:51:34.070146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 475, pipe: [1:7555894992434540859:4849]
2025-09-30T14:51:34.110790Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:34.111536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:34.111549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:34.111567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894992434540859:4849], now have 1 active actors on pipe
2025-09-30T14:51:34.111723Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:34.111804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:34.111812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894992434540859:4849]
2025-09-30T14:51:34.111823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:34.111832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:34.111885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 476 reason: error at write: Disconnected sessionId: src_id|b577247e-f6113e7c-3bf5c781-e975e4f2_0
2025-09-30T14:51:34.112064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 476 sessionId: src_id|b577247e-f6113e7c-3bf5c781-e975e4f2_0 is DEAD
2025-09-30T14:51:34.112224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b577247e-f6113e7c-3bf5c781-e975e4f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:34.112240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b577247e-f6113e7c-3bf5c781-e975e4f2_0] Write session will restart in 0.009493s
2025-09-30T14:51:34.112267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b577247e-f6113e7c-3bf5c781-e975e4f2_0] Write session: Do CDS request
2025-09-30T14:51:34.112273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b577247e-f6113e7c-3bf5c781-e975e4f2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:34.122938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b577247e-f6113e7c-3bf5c781-e975e4f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:34.123033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:34.123050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 477
2025-09-30T14:51:34.123229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 477 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:34.123277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 477 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:34.123288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=477 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:34.123292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:34.123749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 477 sessionId:  describe result for acl check
2025-09-30T14:51:34.123786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:34.123794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:34.123796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:34.123804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894992434540971:5275] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:34.124337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894992434540971:5275] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:34.127176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894992434540971:5275] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:34.130062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894992434540971:5275] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:34.130087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894992434540971:5275] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:34.130090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894992434540971:5275] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:34.130100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 477 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:34.130603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:34.133674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:34.134189Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:34.134199Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:34.134209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:34.134258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:34.134290Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894992344814617:4478]
2025-09-30T14:51:34.134801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:34.135018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:34.135059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:34.135393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:34.135451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:34.135456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:34.135457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:34.135458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:34.135460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:34.135461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:34.135461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:34.135462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:34.135463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:34.135464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:34.135464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.135465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.135466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.135466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:34.135467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:34.135471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:34.135478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:34.135480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:34.135482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:34.135485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:34.135487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:34.135489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:34.135492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:34.135494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:34.135497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:34.135499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.135501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.135504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.135506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:34.135509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:34.135514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:34.135519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:34.135524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:34.135527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:34.135532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:34.135535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:34.135537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:34.135540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:34.135543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:34.135546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:34.135549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:34.135552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:34.135554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:34.135557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:34.135560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:34.135563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:34.135567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:34.135573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:34.135577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:34.135582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:34.135587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.135592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.135596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.135603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.135607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.135610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.135613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:34.135615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:34.135618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:34.135621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:34.135644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:34.141117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:34.142595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:34.142610Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:34.142612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:34.142616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:34.142622Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 476 [2:7555894992344814617:4478]
2025-09-30T14:51:34.142636Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:34.142650Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:34.142653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.142656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.142658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.142674Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:34.142680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:34.142687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:34.142744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.142752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.142755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.142758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:34.142761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:34.142828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:34.142835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.142848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.142865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.142887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:34.142909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894992434540860:2454], now have 1 active actors on pipe
2025-09-30T14:51:34.142918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894992434541161:5275], now have 1 active actors on pipe
2025-09-30T14:51:34.142924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894992344814602:4478]
2025-09-30T14:51:34.142930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894992344814602:4478]
2025-09-30T14:51:34.142932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894992344814602:4478]
2025-09-30T14:51:34.142944Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:34.142958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:34.142961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:34.142962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:34.142942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 476
2025-09-30T14:51:34.142963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:34.142961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 476
2025-09-30T14:51:34.142976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:34.142978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:34.143007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894992344814602:4478]
2025-09-30T14:51:34.143013Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:34.143019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:34.143039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:34.143047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:34.143096Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f51a6278-c768ff60-26575a90-33fc59b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:34.143107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.143110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.143112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:34.143121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.143129Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:34.143150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:34.143311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:34.143318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:34.143332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:34.143415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 477 partition: 0 MaxSeqNo: 42 sessionId: src_id|f51a6278-c768ff60-26575a90-33fc59b0_0
2025-09-30T14:51:34.143836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b577247e-f6113e7c-3bf5c781-e975e4f2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f51a6278-c768ff60-26575a90-33fc59b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:34.147129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f51a6278-c768ff60-26575a90-33fc59b0_0] Write session: try to update token
2025-09-30T14:51:34.147149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f51a6278-c768ff60-26575a90-33fc59b0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:34.155579Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:34.155600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:34.155603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:34.155605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:34.155614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894992344814602:4478]
2025-09-30T14:51:34.155618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894992344814602:4478]
2025-09-30T14:51:34.155622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894992344814602:4478]
2025-09-30T14:51:34.155660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:34.155659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:34.155664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:34.155667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:34.155668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.155670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:34.155806Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:34.162152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 477 sessionId: src_id|f51a6278-c768ff60-26575a90-33fc59b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:34.164759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:34.211765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894992434541176:4849]
2025-09-30T14:51:34.212101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 476, pipe: [1:7555894992434541176:4849]
2025-09-30T14:51:34.257010Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:34.257273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:34.257288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:34.257306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894992434541176:4849], now have 1 active actors on pipe
2025-09-30T14:51:34.257468Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:34.257526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894992434541176:4849]
2025-09-30T14:51:34.257546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:34.257558Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:34.257621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 477 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f51a6278-c768ff60-26575a90-33fc59b0_0
2025-09-30T14:51:34.257848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 477 sessionId: src_id|f51a6278-c768ff60-26575a90-33fc59b0_0 is DEAD
2025-09-30T14:51:34.258010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f51a6278-c768ff60-26575a90-33fc59b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:34.258017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f51a6278-c768ff60-26575a90-33fc59b0_0] Write session will restart in 0.008026s
2025-09-30T14:51:34.258033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f51a6278-c768ff60-26575a90-33fc59b0_0] Write session: Do CDS request
2025-09-30T14:51:34.258037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f51a6278-c768ff60-26575a90-33fc59b0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:34.264476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:34.265753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:34.265927Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:34.265936Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:34.265944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:34.265983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:34.266014Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894992344814673:4480]
2025-09-30T14:51:34.266470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:34.266697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:34.266738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:34.266917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f51a6278-c768ff60-26575a90-33fc59b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:34.266969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:34.267004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:34.266984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 478
2025-09-30T14:51:34.267049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:34.267055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:34.267056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:34.267057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:34.267057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:34.267059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:34.267059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:34.267060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:34.267061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:34.267062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:34.267063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.267064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.267064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.267065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:34.267066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:34.267070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:34.267077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:34.267080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:34.267082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:34.267085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:34.267087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:34.267090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:34.267092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:34.267095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:34.267097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:34.267100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.267102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.267104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.267107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:34.267110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:34.267117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:34.267125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:34.267131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:34.267136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:34.267142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:34.267147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:34.267151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:34.267155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:34.267160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:34.267165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:34.267169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:34.267174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:34.267179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:34.267184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:34.267187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:34.267190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:34.267193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:34.267195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:34.267198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:34.267209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 478 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:34.267201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:34.267260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 478 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:34.267204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.267207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.267265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=478 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:34.267210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.267214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.267216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.267219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.267223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:34.267226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:34.267272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:34.267228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:34.267231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:34.267299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:34.267721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 478 sessionId:  describe result for acl check
2025-09-30T14:51:34.267755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:34.267757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:34.267759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:34.267764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894992434541200:5279] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:34.268298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894992434541200:5279] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:34.270392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894992434541200:5279] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:34.272585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:34.272888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894992434541200:5279] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:34.272902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894992434541200:5279] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:34.272905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894992434541200:5279] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:34.272913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 478 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:34.273578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:34.273594Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:34.273596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:34.273599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:34.273605Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 477 [2:7555894992344814673:4480]
2025-09-30T14:51:34.273617Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:34.273630Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:34.273632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.273635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.273636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.273648Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:34.273652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:34.273658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:34.273711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.273717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.273718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.273721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:34.273722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:34.273787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:34.273795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.273804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.273811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.273820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:34.273836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894992344814668:4480]
2025-09-30T14:51:34.273844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894992344814668:4480]
2025-09-30T14:51:34.273847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894992344814668:4480]
2025-09-30T14:51:34.273858Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:34.273876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:34.273893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:34.273900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:34.273906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:34.273910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:34.273913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:34.273936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894992344814668:4480]
2025-09-30T14:51:34.273944Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:34.273950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:34.273970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894992434541235:5279], now have 1 active actors on pipe
2025-09-30T14:51:34.273978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894992434541177:2454], now have 1 active actors on pipe
2025-09-30T14:51:34.274011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 477
2025-09-30T14:51:34.274034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 477
2025-09-30T14:51:34.274094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:34.274111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:34.274138Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4884947-db442e6d-e1f8c1d5-5bc77ac1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:34.274148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.274151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.274153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:34.274161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.274189Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:34.274205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:34.274373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:34.274383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:34.274400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:34.274539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 478 partition: 0 MaxSeqNo: 42 sessionId: src_id|e4884947-db442e6d-e1f8c1d5-5bc77ac1_0
2025-09-30T14:51:34.274984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f51a6278-c768ff60-26575a90-33fc59b0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e4884947-db442e6d-e1f8c1d5-5bc77ac1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:34.278257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4884947-db442e6d-e1f8c1d5-5bc77ac1_0] Write session: try to update token
2025-09-30T14:51:34.278275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4884947-db442e6d-e1f8c1d5-5bc77ac1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:34.285639Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:34.285656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:34.285657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:34.285659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:34.285666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894992344814668:4480]
2025-09-30T14:51:34.285669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894992344814668:4480]
2025-09-30T14:51:34.285675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894992344814668:4480]
2025-09-30T14:51:34.285704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:34.285709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.285711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:34.285715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:34.285730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:34.285734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:34.285837Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:34.294748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 478 sessionId: src_id|e4884947-db442e6d-e1f8c1d5-5bc77ac1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:34.297429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:34.357681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894992434541265:4849]
2025-09-30T14:51:34.357953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 477, pipe: [1:7555894992434541265:4849]
2025-09-30T14:51:34.390134Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:34.390440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:34.390453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:34.390472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894992434541265:4849], now have 1 active actors on pipe
2025-09-30T14:51:34.390652Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:34.390689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:34.390702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:34.390703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:34.390749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894992434541265:4849]
2025-09-30T14:51:34.390759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 478 reason: error at write: Disconnected sessionId: src_id|e4884947-db442e6d-e1f8c1d5-5bc77ac1_0
2025-09-30T14:51:34.390919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 478 sessionId: src_id|e4884947-db442e6d-e1f8c1d5-5bc77ac1_0 is DEAD
2025-09-30T14:51:34.391053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4884947-db442e6d-e1f8c1d5-5bc77ac1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:34.391064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4884947-db442e6d-e1f8c1d5-5bc77ac1_0] Write session will restart in 0.005312s
2025-09-30T14:51:34.391087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4884947-db442e6d-e1f8c1d5-5bc77ac1_0] Write session: Do CDS request
2025-09-30T14:51:34.391093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4884947-db442e6d-e1f8c1d5-5bc77ac1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:34.396910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:34.397661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4884947-db442e6d-e1f8c1d5-5bc77ac1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:34.397786Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:34.397796Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 479
2025-09-30T14:51:34.397903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 479 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:34.397932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 479 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:34.397941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=479 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:34.397951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:34.398242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:34.398293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 479 sessionId:  describe result for acl check
2025-09-30T14:51:34.398320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:34.398327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:34.398329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:34.398337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894992434541285:5290] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:34.398407Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:34.398417Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:34.398427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:34.398473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:34.398520Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894992344814767:4494]
2025-09-30T14:51:34.398772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894992434541285:5290] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:34.399002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:34.399443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:34.399487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:34.399811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:34.399869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:34.399875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:34.399876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:34.399877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:34.399878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:34.399879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:34.399880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:34.399882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:34.399883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:34.399884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:34.399885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.399886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.399888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.399889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:34.399890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:34.399895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:34.399905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:34.399910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:34.399914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:34.399918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:34.399922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:34.399926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:34.399930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:34.399935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:34.399940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:34.399944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.399949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.399953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.399956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:34.399960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:34.399967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:34.399975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:34.399981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:34.399986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:34.399991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:34.399996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:34.400002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:34.400008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:34.400012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:34.400017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:34.400021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:34.400026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:34.400030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:34.400035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:34.400039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:34.400049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:34.400054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:34.400059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:34.400068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:34.400074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:34.400078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.400089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.400093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.400098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.400106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.400111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.400116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:34.400124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:34.400130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:34.400138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:34.400183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:34.401179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894992434541285:5290] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:34.404857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894992434541285:5290] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:34.404873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894992434541285:5290] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:34.404876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894992434541285:5290] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:34.404883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 479 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:34.405243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:34.406152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:34.406166Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:34.406169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:34.406172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:34.406178Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 478 [2:7555894992344814767:4494]
2025-09-30T14:51:34.406192Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:34.406205Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:34.406207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.406210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.406213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.406226Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:34.406232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:34.406238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:34.406293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.406314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.406319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.406323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:34.406326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:34.406385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:34.406395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.406406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.406422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.406446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:34.406466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894992434541324:5290], now have 1 active actors on pipe
2025-09-30T14:51:34.406473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894992434541266:2454], now have 1 active actors on pipe
2025-09-30T14:51:34.406479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894992344814762:4494]
2025-09-30T14:51:34.406495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894992344814762:4494]
2025-09-30T14:51:34.406502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894992344814762:4494]
2025-09-30T14:51:34.406514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:34.406530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:34.406531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:34.406541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:34.406509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 478
2025-09-30T14:51:34.406543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:34.406543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:34.406546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:34.406514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 478
2025-09-30T14:51:34.406571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894992344814762:4494]
2025-09-30T14:51:34.406580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:34.406584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:34.406595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:34.406602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:34.406646Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64b78eff-430a6da9-b4c378a5-5daacac8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:34.406656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.406663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.406665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:34.406673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.406685Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:34.406708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:34.406824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:34.406832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:34.406843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:34.406922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 479 partition: 0 MaxSeqNo: 42 sessionId: src_id|64b78eff-430a6da9-b4c378a5-5daacac8_0
2025-09-30T14:51:34.407280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4884947-db442e6d-e1f8c1d5-5bc77ac1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|64b78eff-430a6da9-b4c378a5-5daacac8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:34.410084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64b78eff-430a6da9-b4c378a5-5daacac8_0] Write session: try to update token
2025-09-30T14:51:34.410098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64b78eff-430a6da9-b4c378a5-5daacac8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:34.418643Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:34.418664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:34.418667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:34.418669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:34.418683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894992344814762:4494]
2025-09-30T14:51:34.418687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894992344814762:4494]
2025-09-30T14:51:34.418691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894992344814762:4494]
2025-09-30T14:51:34.418730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:34.418730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:34.418735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:34.418737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.418738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:34.418740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:34.418875Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:34.426741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 479 sessionId: src_id|64b78eff-430a6da9-b4c378a5-5daacac8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:34.429412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:34.490831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894992434541334:4849]
2025-09-30T14:51:34.491140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 478, pipe: [1:7555894992434541334:4849]
2025-09-30T14:51:34.526965Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:34.527312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:34.527325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:34.527343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894992434541334:4849], now have 1 active actors on pipe
2025-09-30T14:51:34.527549Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:34.527539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:34.527552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:34.527605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 479 reason: error at write: Disconnected sessionId: src_id|64b78eff-430a6da9-b4c378a5-5daacac8_0
2025-09-30T14:51:34.527770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 479 sessionId: src_id|64b78eff-430a6da9-b4c378a5-5daacac8_0 is DEAD
2025-09-30T14:51:34.527923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894992434541334:4849]
2025-09-30T14:51:34.527951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b78eff-430a6da9-b4c378a5-5daacac8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:34.527974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b78eff-430a6da9-b4c378a5-5daacac8_0] Write session will restart in 0.009845s
2025-09-30T14:51:34.527997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b78eff-430a6da9-b4c378a5-5daacac8_0] Write session: Do CDS request
2025-09-30T14:51:34.528003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b78eff-430a6da9-b4c378a5-5daacac8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:34.528006Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:34.535000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:34.536238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:34.536412Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:34.536419Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:34.536426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:34.536479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:34.536509Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894992344814827:4497]
2025-09-30T14:51:34.536968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:34.537224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:34.537292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:34.537687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:34.537772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:34.537779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:34.537781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:34.537782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:34.537783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:34.537784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:34.537785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:34.537789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:34.537790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:34.537791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:34.537793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.537794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.537795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.537798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:34.537799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:34.537804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:34.537814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:34.537819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:34.537823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:34.537827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:34.537831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:34.537835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:34.537839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:34.537843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:34.537847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:34.537851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.537855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.537859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.537863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:34.537867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:34.537874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:34.537882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:34.537889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:34.537894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:34.537899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:34.537904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:34.537909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:34.537914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:34.537919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:34.537924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:34.537928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:34.537934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:34.537938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:34.537944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:34.537953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:34.537958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:34.537962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:34.537971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:34.537975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:34.537980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:34.537986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.537990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.537996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.538000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.538003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.538005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.538008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:34.538010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:34.538013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:34.538016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:34.538040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:34.538692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64b78eff-430a6da9-b4c378a5-5daacac8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:34.538829Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:34.538844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 480
2025-09-30T14:51:34.538970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 480 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:34.539012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 480 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:34.539019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=480 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:34.539023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:34.539372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 480 sessionId:  describe result for acl check
2025-09-30T14:51:34.539405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:34.539412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:34.539414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:34.539418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894992434541359:5295] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:34.539863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894992434541359:5295] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:34.541483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894992434541359:5295] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:34.543087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:34.543528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894992434541359:5295] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:34.543540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894992434541359:5295] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:34.543542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894992434541359:5295] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:34.543547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 480 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:34.544036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:34.544050Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:34.544053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:34.544057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:34.544062Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 479 [2:7555894992344814827:4497]
2025-09-30T14:51:34.544078Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:34.544097Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:34.544100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.544103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.544105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.544118Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:34.544125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:34.544131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:34.544180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.544187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.544189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.544193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:34.544195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:34.544252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:34.544260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.544271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.544287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.544308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:34.544325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 479
2025-09-30T14:51:34.544334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 479
2025-09-30T14:51:34.544329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894992434541335:2454], now have 1 active actors on pipe
2025-09-30T14:51:34.544339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894992434541394:5295], now have 1 active actors on pipe
2025-09-30T14:51:34.544344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894992344814822:4497]
2025-09-30T14:51:34.544346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894992344814822:4497]
2025-09-30T14:51:34.544348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894992344814822:4497]
2025-09-30T14:51:34.544354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:34.544367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:34.544376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:34.544379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:34.544381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:34.544381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:34.544384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:34.544424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:34.544432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:34.544443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894992344814822:4497]
2025-09-30T14:51:34.544454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:34.544466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:34.544490Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b269b716-1cccd517-2228e35c-37819fbf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:34.544502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.544505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.544509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:34.544518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.544530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:34.544553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:34.544664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:34.544672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:34.544697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:34.544777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 480 partition: 0 MaxSeqNo: 42 sessionId: src_id|b269b716-1cccd517-2228e35c-37819fbf_0
2025-09-30T14:51:34.545056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b78eff-430a6da9-b4c378a5-5daacac8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b269b716-1cccd517-2228e35c-37819fbf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:34.547560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b269b716-1cccd517-2228e35c-37819fbf_0] Write session: try to update token
2025-09-30T14:51:34.547574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b269b716-1cccd517-2228e35c-37819fbf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:34.555944Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:34.555963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:34.555967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:34.555968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:34.555975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894992344814822:4497]
2025-09-30T14:51:34.555978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894992344814822:4497]
2025-09-30T14:51:34.555981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894992344814822:4497]
2025-09-30T14:51:34.556011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:34.556018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.556019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:34.556022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:34.556028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:34.556032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:34.556152Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:34.561509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 480 sessionId: src_id|b269b716-1cccd517-2228e35c-37819fbf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:34.564180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:34.628022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894992434541401:4849]
2025-09-30T14:51:34.628315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 479, pipe: [1:7555894992434541401:4849]
2025-09-30T14:51:34.658061Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:34.658303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:34.658313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:34.658345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894992434541401:4849], now have 1 active actors on pipe
2025-09-30T14:51:34.658524Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:34.658608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:34.658617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894992434541401:4849]
2025-09-30T14:51:34.658637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:34.658679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 480 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b269b716-1cccd517-2228e35c-37819fbf_0
2025-09-30T14:51:34.658874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 480 sessionId: src_id|b269b716-1cccd517-2228e35c-37819fbf_0 is DEAD
2025-09-30T14:51:34.659050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b269b716-1cccd517-2228e35c-37819fbf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:34.659060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b269b716-1cccd517-2228e35c-37819fbf_0] Write session will restart in 0.005924s
2025-09-30T14:51:34.659090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b269b716-1cccd517-2228e35c-37819fbf_0] Write session: Do CDS request
2025-09-30T14:51:34.659096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b269b716-1cccd517-2228e35c-37819fbf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:34.665746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b269b716-1cccd517-2228e35c-37819fbf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:34.665804Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:34.665816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 481
2025-09-30T14:51:34.665950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 481 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:34.665972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 481 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:34.665979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=481 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:34.665983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:34.665967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:34.666319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 481 sessionId:  describe result for acl check
2025-09-30T14:51:34.666347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:34.666353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:34.666357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:34.666363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894992434541423:5299] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:34.666812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894992434541423:5299] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:34.667564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:34.667725Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:34.667735Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:34.667745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:34.667789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:34.667820Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894992344814887:4499]
2025-09-30T14:51:34.668234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:34.668444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:34.668500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:34.668536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894992434541423:5299] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:34.668783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:34.668836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:34.668840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:34.668841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:34.668842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:34.668842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:34.668843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:34.668844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:34.668844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:34.668845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:34.668845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:34.668846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.668847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.668847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.668848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:34.668849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:34.668853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:34.668860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:34.668862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:34.668865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:34.668867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:34.668870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:34.668872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:34.668874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:34.668876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:34.668879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:34.668881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.668883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.668886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.668890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:34.668892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:34.668898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:34.668902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:34.668907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:34.668910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:34.668913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:34.668916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:34.668919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:34.668922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:34.668925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:34.668928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:34.668930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:34.668933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:34.668937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:34.668942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:34.668944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:34.668947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:34.668949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:34.668954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:34.668957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:34.668959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:34.668962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.668966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.668968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.668971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.668973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.668976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.668978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:34.668981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:34.668983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:34.668986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:34.669011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:34.673914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894992434541423:5299] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:34.673933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894992434541423:5299] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:34.673937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894992434541423:5299] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:34.673948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 481 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:34.674162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:34.674920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:34.674934Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:34.674936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:34.674939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:34.674943Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 480 [2:7555894992344814887:4499]
2025-09-30T14:51:34.674954Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:34.674965Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:34.674970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.674972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.674974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.674984Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:34.674988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:34.674993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:34.675032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.675037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.675038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.675040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:34.675042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:34.675086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:34.675092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.675098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.675109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.675119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:34.675131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894992434541463:5299], now have 1 active actors on pipe
2025-09-30T14:51:34.675142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894992344814882:4499]
2025-09-30T14:51:34.675144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894992344814882:4499]
2025-09-30T14:51:34.675145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894992344814882:4499]
2025-09-30T14:51:34.675153Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:34.675160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894992434541403:2454], now have 1 active actors on pipe
2025-09-30T14:51:34.675164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:34.675166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:34.675176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:34.675177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:34.675178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:34.675180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:34.675203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894992344814882:4499]
2025-09-30T14:51:34.675210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:34.675221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:34.675213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 480
2025-09-30T14:51:34.675230Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 480
2025-09-30T14:51:34.675239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:34.675260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:34.675284Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5728ba52-2dc01bac-3b625ed5-300f4ca0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:34.675294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.675297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.675298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:34.675304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.675311Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:34.675321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:34.675432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:34.675439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:34.675449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:34.675537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 481 partition: 0 MaxSeqNo: 42 sessionId: src_id|5728ba52-2dc01bac-3b625ed5-300f4ca0_0
2025-09-30T14:51:34.675872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b269b716-1cccd517-2228e35c-37819fbf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5728ba52-2dc01bac-3b625ed5-300f4ca0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:34.678615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5728ba52-2dc01bac-3b625ed5-300f4ca0_0] Write session: try to update token
2025-09-30T14:51:34.678630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5728ba52-2dc01bac-3b625ed5-300f4ca0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:34.686875Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:34.686892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:34.686894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:34.686896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:34.686905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894992344814882:4499]
2025-09-30T14:51:34.686911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894992344814882:4499]
2025-09-30T14:51:34.686916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894992344814882:4499]
2025-09-30T14:51:34.686945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:34.686951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.686952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:34.686955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:34.686959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:34.686962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:34.687081Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:34.692570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 481 sessionId: src_id|5728ba52-2dc01bac-3b625ed5-300f4ca0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:34.695040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:34.758594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894992434541470:4849]
2025-09-30T14:51:34.758900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 480, pipe: [1:7555894992434541470:4849]
2025-09-30T14:51:34.793117Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:34.793519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:34.793534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:34.793572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894992434541470:4849], now have 1 active actors on pipe
2025-09-30T14:51:34.793764Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:34.793829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894992434541470:4849]
2025-09-30T14:51:34.793832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:34.793870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:34.793907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 481 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5728ba52-2dc01bac-3b625ed5-300f4ca0_0
2025-09-30T14:51:34.794126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 481 sessionId: src_id|5728ba52-2dc01bac-3b625ed5-300f4ca0_0 is DEAD
2025-09-30T14:51:34.794271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5728ba52-2dc01bac-3b625ed5-300f4ca0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:34.794279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5728ba52-2dc01bac-3b625ed5-300f4ca0_0] Write session will restart in 0.007555s
2025-09-30T14:51:34.794303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5728ba52-2dc01bac-3b625ed5-300f4ca0_0] Write session: Do CDS request
2025-09-30T14:51:34.794308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5728ba52-2dc01bac-3b625ed5-300f4ca0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:34.800421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:34.801901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:34.802074Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:34.802082Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:34.802092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:34.802141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:34.802183Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894992344814948:4501]
2025-09-30T14:51:34.802776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5728ba52-2dc01bac-3b625ed5-300f4ca0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:34.802769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:34.802881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:34.802905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 482
2025-09-30T14:51:34.803068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:34.803089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 482 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:34.803116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:34.803126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 482 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:34.803137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=482 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:34.803141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:34.803448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:34.803507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:34.803512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:34.803514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:34.803515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:34.803517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:34.803518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:34.803525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 482 sessionId:  describe result for acl check
2025-09-30T14:51:34.803519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:34.803522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:34.803523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:34.803524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:34.803525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.803526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.803527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.803528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:34.803529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:34.803559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:34.803535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:34.803565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:34.803568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:34.803545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:34.803552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:34.803573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894992434541496:5303] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:34.803556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:34.803559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:34.803564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:34.803569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:34.803572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:34.803576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:34.803582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:34.803586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.803590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.803595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.803599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:34.803603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:34.803610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:34.803618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:34.803624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:34.803630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:34.803635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:34.803646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:34.803651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:34.803661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:34.803666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:34.803675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:34.803679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:34.803684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:34.803689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:34.803694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:34.803703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:34.803708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:34.803718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:34.803723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:34.803732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:34.803738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:34.803746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.803752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.803760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.803765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.803773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.803777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.803781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:34.803786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:34.803790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:34.803795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:34.803841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:34.804065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894992434541496:5303] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:34.805856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894992434541496:5303] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:34.808453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894992434541496:5303] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:34.808466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894992434541496:5303] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:34.808469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894992434541496:5303] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:34.808477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 482 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:34.808870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:34.809728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:34.809744Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:34.809748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:34.809752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:34.809758Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 481 [2:7555894992344814948:4501]
2025-09-30T14:51:34.809774Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:34.809793Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:34.809800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.809806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.809808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.809824Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:34.809834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:34.809840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:34.809893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.809900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.809902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.809904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:34.809907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:34.809973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:34.809984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.809995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.810007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.810025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:34.810045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894992434541533:5303], now have 1 active actors on pipe
2025-09-30T14:51:34.810052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894992434541471:2454], now have 1 active actors on pipe
2025-09-30T14:51:34.810058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894992344814943:4501]
2025-09-30T14:51:34.810065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894992344814943:4501]
2025-09-30T14:51:34.810067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894992344814943:4501]
2025-09-30T14:51:34.810081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:34.810059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 481
2025-09-30T14:51:34.810081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 481
2025-09-30T14:51:34.810098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:34.810098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:34.810100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:34.810102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:34.810117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:34.810120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:34.810163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:34.810172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:34.810184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894992344814943:4501]
2025-09-30T14:51:34.810196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:34.810216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:34.810228Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ee61c74-68620187-959e244c-2f18d02d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:34.810239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.810247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.810251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:34.810259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.810271Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:34.810297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:34.810416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:34.810422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:34.810434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:34.810502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 482 partition: 0 MaxSeqNo: 42 sessionId: src_id|9ee61c74-68620187-959e244c-2f18d02d_0
2025-09-30T14:51:34.810803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5728ba52-2dc01bac-3b625ed5-300f4ca0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9ee61c74-68620187-959e244c-2f18d02d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:34.813281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ee61c74-68620187-959e244c-2f18d02d_0] Write session: try to update token
2025-09-30T14:51:34.813308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ee61c74-68620187-959e244c-2f18d02d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:34.822013Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:34.822041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:34.822044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:34.822046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:34.822059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894992344814943:4501]
2025-09-30T14:51:34.822065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894992344814943:4501]
2025-09-30T14:51:34.822070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894992344814943:4501]
2025-09-30T14:51:34.822121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:34.822120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:34.822127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:34.822131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:34.822134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.822138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:34.822330Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:34.828433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 482 sessionId: src_id|9ee61c74-68620187-959e244c-2f18d02d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:34.830941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:34.893748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894992434541552:4849]
2025-09-30T14:51:34.894008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 481, pipe: [1:7555894992434541552:4849]
2025-09-30T14:51:34.923980Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:34.924328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:34.924347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:34.924365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894992434541552:4849], now have 1 active actors on pipe
2025-09-30T14:51:34.924552Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:34.924597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894992434541552:4849]
2025-09-30T14:51:34.924634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:34.924635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:34.924694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 482 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9ee61c74-68620187-959e244c-2f18d02d_0
2025-09-30T14:51:34.924875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 482 sessionId: src_id|9ee61c74-68620187-959e244c-2f18d02d_0 is DEAD
2025-09-30T14:51:34.925036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ee61c74-68620187-959e244c-2f18d02d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:34.925048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ee61c74-68620187-959e244c-2f18d02d_0] Write session will restart in 0.005787s
2025-09-30T14:51:34.925069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ee61c74-68620187-959e244c-2f18d02d_0] Write session: Do CDS request
2025-09-30T14:51:34.925076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ee61c74-68620187-959e244c-2f18d02d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:34.931417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:34.931681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ee61c74-68620187-959e244c-2f18d02d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:34.931771Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:34.931784Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 483
2025-09-30T14:51:34.931906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 483 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:34.931929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 483 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:34.931937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=483 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:34.931940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:34.932261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 483 sessionId:  describe result for acl check
2025-09-30T14:51:34.932285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:34.932290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:34.932291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:34.932295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894992434541576:5308] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:34.932702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894992434541576:5308] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:34.932884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:34.933050Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:34.933060Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:34.933069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:34.933119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:34.933153Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894992344815021:4504]
2025-09-30T14:51:34.933614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:34.933902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:34.933939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:34.934188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:34.934240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:34.934246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:34.934248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:34.934249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:34.934251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:34.934252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:34.934254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:34.934255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:34.934257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:34.934258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:34.934260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.934261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.934263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.934264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:34.934265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:34.934271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:34.934280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:34.934285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:34.934289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:34.934298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:34.934302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:34.934310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:34.934314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:34.934317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:34.934319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:34.934321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.934324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.934326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.934328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:34.934330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:34.934335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:34.934340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:34.934348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:34.934352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:34.934358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:34.934362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:34.934364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:34.934371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:34.934374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:34.934377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:34.934383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:34.934386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:34.934388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:34.934391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:34.934393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:34.934396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:34.934398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:34.934401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:34.934404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:34.934407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:34.934411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.934414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.934416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.934419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.934421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.934424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.934427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:34.934430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:34.934432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:34.934435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:34.934420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894992434541576:5308] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:34.934458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:34.939050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894992434541576:5308] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:34.939064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894992434541576:5308] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:34.939066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894992434541576:5308] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:34.939072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 483 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:34.939462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:34.940373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:34.940395Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:34.940398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:34.940401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:34.940407Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 482 [2:7555894992344815021:4504]
2025-09-30T14:51:34.940423Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:34.940440Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:34.940448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.940451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.940453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.940468Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:34.940479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:34.940490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:34.940551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.940561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.940566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.940569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:34.940572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:34.940635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:34.940644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.940656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:34.940668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:34.940684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:34.940709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894992434541615:5308], now have 1 active actors on pipe
2025-09-30T14:51:34.940717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894992434541553:2454], now have 1 active actors on pipe
2025-09-30T14:51:34.940723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894992344815016:4504]
2025-09-30T14:51:34.940725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894992344815016:4504]
2025-09-30T14:51:34.940727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894992344815016:4504]
2025-09-30T14:51:34.940740Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:34.940758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:34.940747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 482
2025-09-30T14:51:34.940756Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 482
2025-09-30T14:51:34.940778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:34.940781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:34.940786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:34.940786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:34.940788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:34.940815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894992344815016:4504]
2025-09-30T14:51:34.940823Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:34.940826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:34.940845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:34.940854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:34.940893Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|276b45d0-18a3b780-81352267-47e1d247_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:34.940905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.940913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.940915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:34.940925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.940941Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:34.940967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:34.941146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:34.941156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:34.941171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:34.941274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 483 partition: 0 MaxSeqNo: 42 sessionId: src_id|276b45d0-18a3b780-81352267-47e1d247_0
2025-09-30T14:51:34.941613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ee61c74-68620187-959e244c-2f18d02d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|276b45d0-18a3b780-81352267-47e1d247_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:34.944328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|276b45d0-18a3b780-81352267-47e1d247_0] Write session: try to update token
2025-09-30T14:51:34.944342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|276b45d0-18a3b780-81352267-47e1d247_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:34.952502Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:34.952526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:34.952528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:34.952533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:34.952542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894992344815016:4504]
2025-09-30T14:51:34.952546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894992344815016:4504]
2025-09-30T14:51:34.952549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894992344815016:4504]
2025-09-30T14:51:34.952588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:34.952600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:34.952600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:34.952603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:34.952606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:34.952610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:34.952734Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:34.958407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 483 sessionId: src_id|276b45d0-18a3b780-81352267-47e1d247_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:34.961135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:35.024839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894996729508926:4849]
2025-09-30T14:51:35.025066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 482, pipe: [1:7555894996729508926:4849]
2025-09-30T14:51:35.056530Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:35.056835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:35.056848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:35.056879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894996729508926:4849], now have 1 active actors on pipe
2025-09-30T14:51:35.057045Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:35.057155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:35.057169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894996729508926:4849]
2025-09-30T14:51:35.057185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:35.057246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 483 reason: status is not ok: tablet will be restarted right now sessionId: src_id|276b45d0-18a3b780-81352267-47e1d247_0
2025-09-30T14:51:35.057450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 483 sessionId: src_id|276b45d0-18a3b780-81352267-47e1d247_0 is DEAD
2025-09-30T14:51:35.057589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|276b45d0-18a3b780-81352267-47e1d247_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:35.057598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|276b45d0-18a3b780-81352267-47e1d247_0] Write session will restart in 0.008118s
2025-09-30T14:51:35.057623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|276b45d0-18a3b780-81352267-47e1d247_0] Write session: Do CDS request
2025-09-30T14:51:35.057628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|276b45d0-18a3b780-81352267-47e1d247_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:35.063705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:35.064895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:35.065037Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:35.065046Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:35.065055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:35.065093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:35.065119Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894996639782382:4507]
2025-09-30T14:51:35.065558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:35.065788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:35.065820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:35.066051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:35.066102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:35.066108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:35.066108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:35.066109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:35.066110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:35.066110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:35.066111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:35.066111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:35.066112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:35.066113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:35.066113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.066114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.066115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.066115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:35.066116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:35.066120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:35.066126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:35.066129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:35.066131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:35.066133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:35.066135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:35.066138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:35.066140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:35.066142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:35.066145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:35.066147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.066149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.066152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.066154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:35.066157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:35.066165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:35.066170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:35.066173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:35.066177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:35.066180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:35.066183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:35.066185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:35.066188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:35.066191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:35.066194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:35.066196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:35.066199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:35.066201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:35.066204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:35.066209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:35.066212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:35.066214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:35.066217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:35.066219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:35.066222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:35.066225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.066228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.066231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.066233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.066236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.066238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.066241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:35.066243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:35.066246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:35.066248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:35.066289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:35.066686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|276b45d0-18a3b780-81352267-47e1d247_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:35.066828Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:35.066841Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 484
2025-09-30T14:51:35.066949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 484 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:35.066977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 484 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:35.066986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=484 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:35.066990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:35.067413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 484 sessionId:  describe result for acl check
2025-09-30T14:51:35.067444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:35.067450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:35.067452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:35.067457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894996729508958:5314] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:35.067947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894996729508958:5314] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:35.069400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894996729508958:5314] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:35.071445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894996729508958:5314] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:35.071457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894996729508958:5314] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:35.071460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894996729508958:5314] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:35.071468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 484 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:35.071507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:35.072323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:35.072341Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:35.072343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:35.072348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:35.072352Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 483 [2:7555894996639782382:4507]
2025-09-30T14:51:35.072363Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:35.072373Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:35.072375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.072377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.072378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.072390Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:35.072399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:35.072403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:35.072443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.072449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.072450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.072453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:35.072454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:35.072499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:35.072505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.072512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.072518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.072533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:35.072546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894996729508993:5314], now have 1 active actors on pipe
2025-09-30T14:51:35.072549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894996729508930:2454], now have 1 active actors on pipe
2025-09-30T14:51:35.072553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894996639782377:4507]
2025-09-30T14:51:35.072554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894996639782377:4507]
2025-09-30T14:51:35.072558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894996639782377:4507]
2025-09-30T14:51:35.072567Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:35.072576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:35.072584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:35.072585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:35.072588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:35.072590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:35.072591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:35.072610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894996639782377:4507]
2025-09-30T14:51:35.072612Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:35.072621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:35.072602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 483
2025-09-30T14:51:35.072604Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 483
2025-09-30T14:51:35.072635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:35.072642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:35.072664Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43d09c06-4b751a55-8da372e4-6b76031f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:35.072669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.072675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.072676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:35.072682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.072688Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:35.072698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:35.072859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:35.072869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:35.072880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:35.072991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 484 partition: 0 MaxSeqNo: 42 sessionId: src_id|43d09c06-4b751a55-8da372e4-6b76031f_0
2025-09-30T14:51:35.073291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|276b45d0-18a3b780-81352267-47e1d247_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|43d09c06-4b751a55-8da372e4-6b76031f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:35.075806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43d09c06-4b751a55-8da372e4-6b76031f_0] Write session: try to update token
2025-09-30T14:51:35.075821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43d09c06-4b751a55-8da372e4-6b76031f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:35.084307Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:35.084328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:35.084330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:35.084332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:35.084342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894996639782377:4507]
2025-09-30T14:51:35.084346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894996639782377:4507]
2025-09-30T14:51:35.084350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894996639782377:4507]
2025-09-30T14:51:35.084390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:35.084396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.084397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:35.084417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:35.084434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:35.084438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:35.084533Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:35.089585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 484 sessionId: src_id|43d09c06-4b751a55-8da372e4-6b76031f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:35.092002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:35.157449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894996729509001:4849]
2025-09-30T14:51:35.157736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 483, pipe: [1:7555894996729509001:4849]
2025-09-30T14:51:35.189907Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:35.190187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:35.190198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:35.190228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894996729509001:4849], now have 1 active actors on pipe
2025-09-30T14:51:35.190423Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:35.190435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:35.190449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:35.190508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 484 reason: error at write: Disconnected sessionId: src_id|43d09c06-4b751a55-8da372e4-6b76031f_0
2025-09-30T14:51:35.190522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894996729509001:4849]
2025-09-30T14:51:35.190546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:35.190696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 484 sessionId: src_id|43d09c06-4b751a55-8da372e4-6b76031f_0 is DEAD
2025-09-30T14:51:35.190809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43d09c06-4b751a55-8da372e4-6b76031f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:35.190817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43d09c06-4b751a55-8da372e4-6b76031f_0] Write session will restart in 0.006288s
2025-09-30T14:51:35.190832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43d09c06-4b751a55-8da372e4-6b76031f_0] Write session: Do CDS request
2025-09-30T14:51:35.190838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43d09c06-4b751a55-8da372e4-6b76031f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:35.197753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:35.198705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43d09c06-4b751a55-8da372e4-6b76031f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:35.198814Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:35.198829Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 485
2025-09-30T14:51:35.198945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 485 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:35.198969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 485 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:35.198977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=485 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:35.198980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:35.199310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 485 sessionId:  describe result for acl check
2025-09-30T14:51:35.199341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:35.199343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:35.199344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:35.199347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894996729509027:5318] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:35.199495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:35.199665Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:35.199676Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:35.199686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:35.199739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:35.199734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894996729509027:5318] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:35.199783Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894996639782445:4509]
2025-09-30T14:51:35.200413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:35.200709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:35.200759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:35.201105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:35.201179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:35.201187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:35.201188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:35.201189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:35.201191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:35.201192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:35.201193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:35.201195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:35.201196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:35.201198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:35.201199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.201200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.201201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.201203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:35.201204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:35.201210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:35.201220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:35.201224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:35.201228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:35.201233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:35.201237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:35.201243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:35.201247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:35.201251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:35.201256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:35.201265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.201268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.201272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.201276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:35.201280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:35.201292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:35.201300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:35.201310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:35.201317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:35.201326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:35.201332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:35.201340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:35.201345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:35.201355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:35.201359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:35.201363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:35.201373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:35.201378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:35.201384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:35.201390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:35.201400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:35.201406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:35.201412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:35.201423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:35.201429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:35.201434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.201439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.201445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.201450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.201456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.201461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.201466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:35.201472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:35.201477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:35.201483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:35.201485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894996729509027:5318] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:35.201535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:35.206541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894996729509027:5318] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:35.206555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894996729509027:5318] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:35.206557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894996729509027:5318] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:35.206564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 485 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:35.206852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:35.207805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:35.207823Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:35.207826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:35.207830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:35.207836Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 484 [2:7555894996639782445:4509]
2025-09-30T14:51:35.207854Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:35.207872Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:35.207876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.207880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.207883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.207898Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:35.207910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:35.207920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:35.207976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.207983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.207985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.207988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:35.207991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:35.208052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:35.208059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.208072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.208088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.208111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:35.208137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894996729509002:2454], now have 1 active actors on pipe
2025-09-30T14:51:35.208140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894996729509066:5318], now have 1 active actors on pipe
2025-09-30T14:51:35.208147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894996639782440:4509]
2025-09-30T14:51:35.208149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894996639782440:4509]
2025-09-30T14:51:35.208151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894996639782440:4509]
2025-09-30T14:51:35.208158Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:35.208140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 484
2025-09-30T14:51:35.208171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:35.208175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:35.208178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:35.208179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:35.208192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:35.208195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:35.208184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 484
2025-09-30T14:51:35.208229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894996639782440:4509]
2025-09-30T14:51:35.208241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:35.208253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:35.208260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:35.208264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:35.208302Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c15a1398-c8ef2b72-b90462a4-bc37aa32_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:35.208314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.208318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.208320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:35.208329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.208342Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:35.208362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:35.208560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:35.208570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:35.208584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:35.208683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 485 partition: 0 MaxSeqNo: 42 sessionId: src_id|c15a1398-c8ef2b72-b90462a4-bc37aa32_0
2025-09-30T14:51:35.209074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43d09c06-4b751a55-8da372e4-6b76031f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c15a1398-c8ef2b72-b90462a4-bc37aa32_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:35.211901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c15a1398-c8ef2b72-b90462a4-bc37aa32_0] Write session: try to update token
2025-09-30T14:51:35.211920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c15a1398-c8ef2b72-b90462a4-bc37aa32_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:35.220156Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:35.220173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:35.220176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:35.220178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:35.220187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894996639782440:4509]
2025-09-30T14:51:35.220193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894996639782440:4509]
2025-09-30T14:51:35.220197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894996639782440:4509]
2025-09-30T14:51:35.220239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:35.220242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:35.220249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.220251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:35.220252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:35.220257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:35.220386Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:35.226173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 485 sessionId: src_id|c15a1398-c8ef2b72-b90462a4-bc37aa32_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:35.228616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:35.290566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894996729509073:4849]
2025-09-30T14:51:35.290830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 484, pipe: [1:7555894996729509073:4849]
2025-09-30T14:51:35.327368Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:35.327621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:35.327634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:35.327664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894996729509073:4849], now have 1 active actors on pipe
2025-09-30T14:51:35.327839Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:35.327908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:35.327929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894996729509073:4849]
2025-09-30T14:51:35.327956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:35.327959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:35.328016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 485 reason: error at write: Disconnected sessionId: src_id|c15a1398-c8ef2b72-b90462a4-bc37aa32_0
2025-09-30T14:51:35.328193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 485 sessionId: src_id|c15a1398-c8ef2b72-b90462a4-bc37aa32_0 is DEAD
2025-09-30T14:51:35.328365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c15a1398-c8ef2b72-b90462a4-bc37aa32_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:35.328375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c15a1398-c8ef2b72-b90462a4-bc37aa32_0] Write session will restart in 0.009712s
2025-09-30T14:51:35.328406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c15a1398-c8ef2b72-b90462a4-bc37aa32_0] Write session: Do CDS request
2025-09-30T14:51:35.328412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c15a1398-c8ef2b72-b90462a4-bc37aa32_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:35.334999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:35.336598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:35.336741Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:35.336748Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:35.336756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:35.336793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:35.336822Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894996639782510:4511]
2025-09-30T14:51:35.337290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:35.337530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:35.337557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:35.337783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:35.337826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:35.337832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:35.337832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:35.337833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:35.337834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:35.337835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:35.337836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:35.337837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:35.337837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:35.337839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:35.337840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.337840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.337841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.337842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:35.337842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:35.337846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:35.337852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:35.337854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:35.337857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:35.337859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:35.337861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:35.337863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:35.337866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:35.337868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:35.337870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:35.337872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.337875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.337877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.337879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:35.337882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:35.337888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:35.337893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:35.337896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:35.337900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:35.337903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:35.337906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:35.337909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:35.337912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:35.337914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:35.337918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:35.337920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:35.337924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:35.337927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:35.337932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:35.337936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:35.337942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:35.337946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:35.337951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:35.337956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:35.337962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:35.337966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.337971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.337974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.337976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.337979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.337981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.337984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:35.337989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:35.337993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:35.337998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:35.338039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:35.339734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c15a1398-c8ef2b72-b90462a4-bc37aa32_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:35.339815Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:35.339831Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 486
2025-09-30T14:51:35.339942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 486 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:35.339965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 486 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:35.339969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=486 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:35.339976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:35.340384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 486 sessionId:  describe result for acl check
2025-09-30T14:51:35.340428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:35.340435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:35.340437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:35.340446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894996729509106:5322] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:35.340906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894996729509106:5322] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:35.342175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894996729509106:5322] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:35.343431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:35.344397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:35.344410Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:35.344413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:35.344415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:35.344419Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 485 [2:7555894996639782510:4511]
2025-09-30T14:51:35.344431Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:35.344443Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:35.344444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.344446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.344448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.344460Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:35.344464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:35.344468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:35.344506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.344507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.344508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.344511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:35.344512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:35.344524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894996729509106:5322] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:35.344537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894996729509106:5322] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:35.344539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894996729509106:5322] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:35.344545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 486 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:35.344560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:35.344565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.344574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.344580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.344589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:35.344602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894996639782505:4511]
2025-09-30T14:51:35.344603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894996639782505:4511]
2025-09-30T14:51:35.344606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894996639782505:4511]
2025-09-30T14:51:35.344611Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:35.344623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:35.344623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:35.344626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:35.344628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:35.344638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:35.344640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:35.344649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894996729509075:2454], now have 1 active actors on pipe
2025-09-30T14:51:35.344679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 485
2025-09-30T14:51:35.344676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894996639782505:4511]
2025-09-30T14:51:35.344689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:35.344697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:35.344910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894996729509152:5322], now have 1 active actors on pipe
2025-09-30T14:51:35.344948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 485
2025-09-30T14:51:35.344996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:35.345005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:35.345028Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c7a7f2fd-892d3e2b-8af23a12-cc92d8bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:35.345039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.345044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.345046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:35.345056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.345070Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:35.345088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:35.345236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:35.345242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:35.345250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:35.345307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 486 partition: 0 MaxSeqNo: 42 sessionId: src_id|c7a7f2fd-892d3e2b-8af23a12-cc92d8bc_0
2025-09-30T14:51:35.345634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c15a1398-c8ef2b72-b90462a4-bc37aa32_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c7a7f2fd-892d3e2b-8af23a12-cc92d8bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:35.348304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7a7f2fd-892d3e2b-8af23a12-cc92d8bc_0] Write session: try to update token
2025-09-30T14:51:35.348321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7a7f2fd-892d3e2b-8af23a12-cc92d8bc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:35.356215Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:35.356231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:35.356232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:35.356234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:35.356240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894996639782505:4511]
2025-09-30T14:51:35.356244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894996639782505:4511]
2025-09-30T14:51:35.356248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894996639782505:4511]
2025-09-30T14:51:35.356291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:35.356297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.356302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:35.356302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:35.356309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:35.356313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:35.356445Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:35.363014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 486 sessionId: src_id|c7a7f2fd-892d3e2b-8af23a12-cc92d8bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:35.365655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:35.428278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894996729509169:4849]
2025-09-30T14:51:35.428538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 485, pipe: [1:7555894996729509169:4849]
2025-09-30T14:51:35.460852Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:35.461166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:35.461177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:35.461193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894996729509169:4849], now have 1 active actors on pipe
2025-09-30T14:51:35.461418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:35.461431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:35.461444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894996729509169:4849]
2025-09-30T14:51:35.461435Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:35.461480Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:35.461487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 486 reason: error at write: Disconnected sessionId: src_id|c7a7f2fd-892d3e2b-8af23a12-cc92d8bc_0
2025-09-30T14:51:35.461675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 486 sessionId: src_id|c7a7f2fd-892d3e2b-8af23a12-cc92d8bc_0 is DEAD
2025-09-30T14:51:35.461828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7a7f2fd-892d3e2b-8af23a12-cc92d8bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:35.461838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7a7f2fd-892d3e2b-8af23a12-cc92d8bc_0] Write session will restart in 0.007886s
2025-09-30T14:51:35.461872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7a7f2fd-892d3e2b-8af23a12-cc92d8bc_0] Write session: Do CDS request
2025-09-30T14:51:35.461878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7a7f2fd-892d3e2b-8af23a12-cc92d8bc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:35.468948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:35.470761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:35.470823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7a7f2fd-892d3e2b-8af23a12-cc92d8bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:35.470920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:35.470940Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:35.470949Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:35.470947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 487
2025-09-30T14:51:35.470959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:35.471005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:35.471038Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894996639782613:4525]
2025-09-30T14:51:35.471090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 487 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:35.471124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 487 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:35.471131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=487 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:35.471135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:35.471548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 487 sessionId:  describe result for acl check
2025-09-30T14:51:35.471582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:35.471589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:35.471590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:35.471596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894996729509200:5334] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:35.471691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:35.471976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:35.472020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:35.472146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894996729509200:5334] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:35.472350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:35.472406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:35.472413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:35.472414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:35.472415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:35.472417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:35.472418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:35.472419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:35.472421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:35.472422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:35.472423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:35.472424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.472426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.472427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.472428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:35.472430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:35.472435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:35.472445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:35.472449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:35.472454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:35.472458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:35.472462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:35.472466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:35.472470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:35.472474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:35.472479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:35.472483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.472486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.472490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.472494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:35.472498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:35.472506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:35.472513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:35.472521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:35.472529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:35.472538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:35.472545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:35.472553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:35.472560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:35.472569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:35.472575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:35.472583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:35.472593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:35.472602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:35.472607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:35.472616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:35.472626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:35.472630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:35.472640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:35.472645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:35.472651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:35.472655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.472660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.472665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.472674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.472683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.472689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.472697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:35.472703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:35.472711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:35.472717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:35.472754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:35.474009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894996729509200:5334] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:35.477767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894996729509200:5334] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:35.477793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894996729509200:5334] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:35.477797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894996729509200:5334] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:35.477806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 487 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:35.477956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:35.478990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:35.479003Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:35.479006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:35.479011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:35.479017Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 486 [2:7555894996639782613:4525]
2025-09-30T14:51:35.479031Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:35.479049Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:35.479053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.479056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.479058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.479073Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:35.479085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:35.479095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:35.479150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.479156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.479159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.479163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:35.479165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:35.479229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:35.479236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.479263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.479280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.479303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:35.479324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894996729509239:5334], now have 1 active actors on pipe
2025-09-30T14:51:35.479332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894996729509172:2454], now have 1 active actors on pipe
2025-09-30T14:51:35.479338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894996639782606:4525]
2025-09-30T14:51:35.479345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894996639782606:4525]
2025-09-30T14:51:35.479348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894996639782606:4525]
2025-09-30T14:51:35.479359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:35.479372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:35.479377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:35.479382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:35.479384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:35.479392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:35.479395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:35.479372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 486
2025-09-30T14:51:35.479387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 486
2025-09-30T14:51:35.479431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894996639782606:4525]
2025-09-30T14:51:35.479444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:35.479458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:35.479462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:35.479466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:35.479515Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a9cb4ca-ce756aba-504ec665-4c2f8291_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:35.479527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.479535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.479537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:35.479546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.479559Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:35.479581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:35.479716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:35.479728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:35.479742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:35.479801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 487 partition: 0 MaxSeqNo: 42 sessionId: src_id|8a9cb4ca-ce756aba-504ec665-4c2f8291_0
2025-09-30T14:51:35.480199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7a7f2fd-892d3e2b-8af23a12-cc92d8bc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8a9cb4ca-ce756aba-504ec665-4c2f8291_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:35.483102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a9cb4ca-ce756aba-504ec665-4c2f8291_0] Write session: try to update token
2025-09-30T14:51:35.483123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a9cb4ca-ce756aba-504ec665-4c2f8291_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:35.491927Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:35.491952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:35.491955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:35.491957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:35.491967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894996639782606:4525]
2025-09-30T14:51:35.491973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894996639782606:4525]
2025-09-30T14:51:35.491980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894996639782606:4525]
2025-09-30T14:51:35.492023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:35.492025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:35.492030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.492030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:35.492033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:35.492034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:35.492176Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:35.502954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 487 sessionId: src_id|8a9cb4ca-ce756aba-504ec665-4c2f8291_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:35.505535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:35.561401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894996729509246:4849]
2025-09-30T14:51:35.561681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 486, pipe: [1:7555894996729509246:4849]
2025-09-30T14:51:35.597661Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:35.598060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:35.598071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:35.598086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894996729509246:4849], now have 1 active actors on pipe
2025-09-30T14:51:35.598294Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:35.598317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:35.598331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:35.598378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:35.598400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 487 reason: error at write: Disconnected sessionId: src_id|8a9cb4ca-ce756aba-504ec665-4c2f8291_0
2025-09-30T14:51:35.598435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894996729509246:4849]
2025-09-30T14:51:35.598600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 487 sessionId: src_id|8a9cb4ca-ce756aba-504ec665-4c2f8291_0 is DEAD
2025-09-30T14:51:35.598751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a9cb4ca-ce756aba-504ec665-4c2f8291_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:35.598768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a9cb4ca-ce756aba-504ec665-4c2f8291_0] Write session will restart in 0.007512s
2025-09-30T14:51:35.598787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a9cb4ca-ce756aba-504ec665-4c2f8291_0] Write session: Do CDS request
2025-09-30T14:51:35.598795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a9cb4ca-ce756aba-504ec665-4c2f8291_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:35.606975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:35.607772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a9cb4ca-ce756aba-504ec665-4c2f8291_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:35.607904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:35.607917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 488
2025-09-30T14:51:35.608058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 488 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:35.608081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 488 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:35.608085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=488 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:35.608091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:35.608539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 488 sessionId:  describe result for acl check
2025-09-30T14:51:35.608581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:35.608588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:35.608590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:35.608595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894996729509275:5338] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:35.609202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894996729509275:5338] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:35.609385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:35.609551Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:35.609560Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:35.609569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:35.609613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:35.609652Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894996639782678:4528]
2025-09-30T14:51:35.610104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:35.610369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:35.610410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:35.610714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:35.610766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:35.610771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:35.610771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:35.610772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:35.610773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:35.610774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:35.610775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:35.610775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:35.610776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:35.610777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:35.610777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.610778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.610779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.610779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:35.610780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:35.610783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:35.610789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:35.610792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:35.610794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:35.610796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:35.610799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:35.610801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:35.610803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:35.610807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:35.610812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:35.610816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.610820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.610823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.610826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:35.610830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:35.610836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:35.610844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:35.610850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:35.610857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:35.610861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:35.610867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:35.610871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:35.610876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:35.610881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:35.610891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:35.610895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:35.610899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:35.610903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:35.610908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:35.610912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:35.610917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:35.610927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:35.610932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:35.610941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:35.610946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:35.610955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.610961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.610965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.610975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.610980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.610989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.610997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:35.611001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:35.611005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:35.611009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:35.611055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:35.611305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894996729509275:5338] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:35.616578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894996729509275:5338] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:35.616596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894996729509275:5338] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:35.616600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894996729509275:5338] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:35.616609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 488 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:35.616802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:35.617567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:35.617581Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:35.617583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:35.617585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:35.617590Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 487 [2:7555894996639782678:4528]
2025-09-30T14:51:35.617601Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:35.617615Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:35.617620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.617622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.617623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.617633Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:35.617638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:35.617647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:35.617690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.617698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.617700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.617702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:35.617704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:35.617749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:35.617751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.617757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.617764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.617773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:35.617788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894996639782673:4528]
2025-09-30T14:51:35.617793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894996639782673:4528]
2025-09-30T14:51:35.617794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894996639782673:4528]
2025-09-30T14:51:35.617799Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:35.617810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:35.617811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:35.617814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:35.617816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:35.617818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:35.617820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:35.617827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894996729509247:2454], now have 1 active actors on pipe
2025-09-30T14:51:35.617846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894996729509314:5338], now have 1 active actors on pipe
2025-09-30T14:51:35.617853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894996639782673:4528]
2025-09-30T14:51:35.617856Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:35.617866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:35.617897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 487
2025-09-30T14:51:35.617935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 487
2025-09-30T14:51:35.617969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:35.617976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:35.617998Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8feb4ab9-63684b09-c5436ad3-c6c2050b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:35.618009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.618013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.618015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:35.618023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.618030Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:35.618044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:35.618223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:35.618234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:35.618248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:35.618353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 488 partition: 0 MaxSeqNo: 42 sessionId: src_id|8feb4ab9-63684b09-c5436ad3-c6c2050b_0
2025-09-30T14:51:35.618798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a9cb4ca-ce756aba-504ec665-4c2f8291_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8feb4ab9-63684b09-c5436ad3-c6c2050b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:35.621552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8feb4ab9-63684b09-c5436ad3-c6c2050b_0] Write session: try to update token
2025-09-30T14:51:35.621573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8feb4ab9-63684b09-c5436ad3-c6c2050b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:35.631201Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:35.631218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:35.631229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555894996639782673:4528]
2025-09-30T14:51:35.631275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:35.631286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:35.631448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:35.631589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:35.631729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:35.631862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:35.632050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:35.632092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:35.635559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 488 sessionId: src_id|8feb4ab9-63684b09-c5436ad3-c6c2050b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:35.637840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:35.638020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:35.638036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:35.638066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:35.638137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:35.644270Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:35.644287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:35.644289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:35.644293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:35.644301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894996639782673:4528]
2025-09-30T14:51:35.644305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894996639782673:4528]
2025-09-30T14:51:35.644309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894996639782673:4528]
2025-09-30T14:51:35.644340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:35.644346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.644347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:35.644365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:35.644378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:35.644383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:35.644475Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:35.698605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894996729509322:4849]
2025-09-30T14:51:35.698837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 487, pipe: [1:7555894996729509322:4849]
2025-09-30T14:51:35.744732Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:35.751343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:35.751363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:35.751521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:35.751578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:35.751636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:35.751689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:35.751742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:35.751750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:35.751812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:35.751866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:35.751926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:35.751992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:35.752031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:35.752036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:35.752093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:35.752149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:35.752205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:35.752260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:35.752301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:35.752306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:35.752366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:35.752423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:35.752486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:35.752558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:35.752599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:35.752601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:35.752662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:35.752720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:35.752778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:35.752835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:35.752878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:35.752883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:35.752943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:35.752995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:35.753063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:35.753120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:35.753160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:35.753166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:35.753230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:35.753284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:35.753344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:35.753402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:35.753445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:35.753450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:35.753511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:35.753575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:35.753632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:35.753689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:35.753732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:35.753737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:35.753794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:35.753849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:35.753908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:35.753965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:35.754005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:35.754010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:35.754068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:35.754122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:35.754180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:35.754236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:35.754275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:35.754280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:35.754318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894996729509322:4849], now have 1 active actors on pipe
2025-09-30T14:51:35.754551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:35.754574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:35.754578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:35.754609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 488 reason: error at write: Disconnected sessionId: src_id|8feb4ab9-63684b09-c5436ad3-c6c2050b_0
2025-09-30T14:51:35.754612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894996729509322:4849]
2025-09-30T14:51:35.754826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 488 sessionId: src_id|8feb4ab9-63684b09-c5436ad3-c6c2050b_0 is DEAD
2025-09-30T14:51:35.754996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8feb4ab9-63684b09-c5436ad3-c6c2050b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:35.755008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8feb4ab9-63684b09-c5436ad3-c6c2050b_0] Write session will restart in 0.007716s
2025-09-30T14:51:35.755031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8feb4ab9-63684b09-c5436ad3-c6c2050b_0] Write session: Do CDS request
2025-09-30T14:51:35.755037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8feb4ab9-63684b09-c5436ad3-c6c2050b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:35.755144Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:35.763225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:35.763750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8feb4ab9-63684b09-c5436ad3-c6c2050b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:35.763858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:35.763878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 489
2025-09-30T14:51:35.764012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 489 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:35.764043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 489 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:35.764049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=489 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:35.764053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:35.764473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 489 sessionId:  describe result for acl check
2025-09-30T14:51:35.764508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:35.764517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:35.764518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:35.764524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894996729509352:5342] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:35.764639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:35.764801Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:35.764810Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:35.764820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:35.764870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:35.764910Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894996639782745:4530]
2025-09-30T14:51:35.765146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894996729509352:5342] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:35.765548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:35.765861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:35.765907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:35.766235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:35.766314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:35.766321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:35.766322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:35.766323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:35.766324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:35.766325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:35.766326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:35.766329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:35.766329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:35.766330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:35.766331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.766333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.766334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.766335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:35.766336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:35.766340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:35.766351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:35.766355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:35.766360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:35.766364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:35.766368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:35.766372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:35.766376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:35.766380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:35.766385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:35.766389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.766393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.766399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.766403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:35.766412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:35.766419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:35.766432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:35.766441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:35.766451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:35.766463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:35.766472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:35.766494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:35.766503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:35.766512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:35.766518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:35.766526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:35.766531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:35.766539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:35.766545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:35.766548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:35.766557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:35.766562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:35.766571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:35.766579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:35.766584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:35.766592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.766598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.766605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.766610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.766614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.766619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.766626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:35.766632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:35.766640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:35.766645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:35.766693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:35.767211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894996729509352:5342] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:35.772576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894996729509352:5342] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:35.772593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894996729509352:5342] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:35.772597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894996729509352:5342] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:35.772605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 489 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:35.774257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:35.775095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:35.775110Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:35.775114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:35.775118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:35.775125Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 488 [2:7555894996639782745:4530]
2025-09-30T14:51:35.775141Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:35.775161Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:35.775169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.775171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.775173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.775187Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:35.775194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:35.775201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:35.775271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.775277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.775280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.775283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:35.775285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:35.775345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:35.775354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.775366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.775377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.775395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:35.775417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894996729509323:2454], now have 1 active actors on pipe
2025-09-30T14:51:35.775427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894996729509399:5342], now have 1 active actors on pipe
2025-09-30T14:51:35.775435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894996639782740:4530]
2025-09-30T14:51:35.775436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894996639782740:4530]
2025-09-30T14:51:35.775438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894996639782740:4530]
2025-09-30T14:51:35.775453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:35.775466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:35.775470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:35.775473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:35.775474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:35.775481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:35.775484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:35.775471Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 488
2025-09-30T14:51:35.775514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894996639782740:4530]
2025-09-30T14:51:35.775524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:35.775525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:35.775520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 488
2025-09-30T14:51:35.775558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:35.775566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:35.775591Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70c93e90-72cb8316-da376e06-41ba63f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:35.775602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.775605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.775607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:35.775619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.775630Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:35.775649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:35.775825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:35.775834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:35.775848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:35.775959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 489 partition: 0 MaxSeqNo: 42 sessionId: src_id|70c93e90-72cb8316-da376e06-41ba63f0_0
2025-09-30T14:51:35.776346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8feb4ab9-63684b09-c5436ad3-c6c2050b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|70c93e90-72cb8316-da376e06-41ba63f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:35.786462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70c93e90-72cb8316-da376e06-41ba63f0_0] Write session: try to update token
2025-09-30T14:51:35.786496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70c93e90-72cb8316-da376e06-41ba63f0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:35.790842Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:35.790855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:35.790857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:35.790861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:35.790869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894996639782740:4530]
2025-09-30T14:51:35.790873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894996639782740:4530]
2025-09-30T14:51:35.790876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894996639782740:4530]
2025-09-30T14:51:35.790918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:35.790924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:35.790927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:35.790980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:35.790991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.790992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:35.791126Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:35.800699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 489 sessionId: src_id|70c93e90-72cb8316-da376e06-41ba63f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:35.808034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:35.854777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894996729509407:4849]
2025-09-30T14:51:35.855006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 488, pipe: [1:7555894996729509407:4849]
2025-09-30T14:51:35.893391Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:35.893696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:35.893709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:35.893728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894996729509407:4849], now have 1 active actors on pipe
2025-09-30T14:51:35.893897Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:35.893970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:35.893986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:35.893988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894996729509407:4849]
2025-09-30T14:51:35.894008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:35.894044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 489 reason: error at write: Disconnected sessionId: src_id|70c93e90-72cb8316-da376e06-41ba63f0_0
2025-09-30T14:51:35.894243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 489 sessionId: src_id|70c93e90-72cb8316-da376e06-41ba63f0_0 is DEAD
2025-09-30T14:51:35.894364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70c93e90-72cb8316-da376e06-41ba63f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:35.894375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70c93e90-72cb8316-da376e06-41ba63f0_0] Write session will restart in 0.006891s
2025-09-30T14:51:35.894399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70c93e90-72cb8316-da376e06-41ba63f0_0] Write session: Do CDS request
2025-09-30T14:51:35.894409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70c93e90-72cb8316-da376e06-41ba63f0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:35.900977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:35.902596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:35.902786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70c93e90-72cb8316-da376e06-41ba63f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:35.902806Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:35.902815Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:35.902825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:35.902857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:35.902871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 490
2025-09-30T14:51:35.902881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:35.902920Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894996639782825:4533]
2025-09-30T14:51:35.903043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 490 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:35.903064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 490 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:35.903072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=490 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:35.903075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:35.903426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:35.903489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 490 sessionId:  describe result for acl check
2025-09-30T14:51:35.903523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:35.903588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:35.903597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:35.903603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894996729509450:5347] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:35.903668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:35.903706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:35.904021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:35.904069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:35.904073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:35.904076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:35.904077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:35.904078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:35.904079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:35.904080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:35.904081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:35.904082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:35.904083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:35.904100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894996729509450:5347] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:35.904084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.904085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.904086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.904088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:35.904089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:35.904094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:35.904104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:35.904106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:35.904109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:35.904111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:35.904114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:35.904116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:35.904118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:35.904121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:35.904123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:35.904125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.904128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.904130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.904132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:35.904134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:35.904141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:35.904146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:35.904150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:35.904156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:35.904159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:35.904163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:35.904165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:35.904168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:35.904171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:35.904175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:35.904177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:35.904180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:35.904182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:35.904185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:35.904187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:35.904190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:35.904192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:35.904194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:35.904196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:35.904199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:35.904201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.904206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.904210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.904215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.904220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.904225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.904230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:35.904235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:35.904239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:35.904242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:35.904265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:35.906025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894996729509450:5347] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:35.909437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894996729509450:5347] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:35.909453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894996729509450:5347] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:35.909458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894996729509450:5347] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:35.909467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 490 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:35.909747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:35.910559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:35.910571Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:35.910572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:35.910575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:35.910580Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 489 [2:7555894996639782825:4533]
2025-09-30T14:51:35.910593Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:35.910604Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:35.910606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.910608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.910609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.910621Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:35.910626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:35.910631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:35.910673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.910679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.910680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.910683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:35.910685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:35.910732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:35.910738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.910747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:35.910753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:35.910762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:35.910777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555894996639782820:4533]
2025-09-30T14:51:35.910780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555894996639782820:4533]
2025-09-30T14:51:35.910782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555894996639782820:4533]
2025-09-30T14:51:35.910791Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:35.910797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:35.910803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:35.910806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:35.910808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:35.910815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:35.910818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:35.910826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894996729509489:5347], now have 1 active actors on pipe
2025-09-30T14:51:35.910829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894996729509420:2454], now have 1 active actors on pipe
2025-09-30T14:51:35.910857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555894996639782820:4533]
2025-09-30T14:51:35.910868Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:35.910874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:35.910905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 489
2025-09-30T14:51:35.910905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 489
2025-09-30T14:51:35.910946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:35.910955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:35.910982Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6883155-7a693841-1d2cbc99-582f0590_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:35.910992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.910995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.910997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:35.911005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.911017Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:35.911031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:35.911182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:35.911191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:35.911204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:35.911291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 490 partition: 0 MaxSeqNo: 42 sessionId: src_id|d6883155-7a693841-1d2cbc99-582f0590_0
2025-09-30T14:51:35.911680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70c93e90-72cb8316-da376e06-41ba63f0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d6883155-7a693841-1d2cbc99-582f0590_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:35.914357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6883155-7a693841-1d2cbc99-582f0590_0] Write session: try to update token
2025-09-30T14:51:35.914374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6883155-7a693841-1d2cbc99-582f0590_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:35.923762Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:35.923780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:35.923782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:35.923784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:35.923793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555894996639782820:4533]
2025-09-30T14:51:35.923797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555894996639782820:4533]
2025-09-30T14:51:35.923802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555894996639782820:4533]
2025-09-30T14:51:35.923839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:35.923838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:35.923844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:35.923846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:35.923846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:35.923852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:35.923989Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:35.928014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 490 sessionId: src_id|d6883155-7a693841-1d2cbc99-582f0590_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:35.930476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:35.994048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555894996729509504:4849]
2025-09-30T14:51:35.994300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 489, pipe: [1:7555894996729509504:4849]
2025-09-30T14:51:36.026422Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:36.026825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:36.026839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:36.026877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894996729509504:4849], now have 1 active actors on pipe
2025-09-30T14:51:36.027056Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:36.027151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:36.027179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555894996729509504:4849]
2025-09-30T14:51:36.027195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:36.027240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 490 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d6883155-7a693841-1d2cbc99-582f0590_0
2025-09-30T14:51:36.027441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 490 sessionId: src_id|d6883155-7a693841-1d2cbc99-582f0590_0 is DEAD
2025-09-30T14:51:36.027580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6883155-7a693841-1d2cbc99-582f0590_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:36.027589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6883155-7a693841-1d2cbc99-582f0590_0] Write session will restart in 0.006094s
2025-09-30T14:51:36.027617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6883155-7a693841-1d2cbc99-582f0590_0] Write session: Do CDS request
2025-09-30T14:51:36.027621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6883155-7a693841-1d2cbc99-582f0590_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:36.034791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6883155-7a693841-1d2cbc99-582f0590_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:36.034840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:36.034934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:36.034949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 491
2025-09-30T14:51:36.035073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 491 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:36.035098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 491 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:36.035103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=491 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:36.035106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:36.035532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 491 sessionId:  describe result for acl check
2025-09-30T14:51:36.035562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:36.035568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:36.035589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:36.035599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895001024476832:5353] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:36.036071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895001024476832:5353] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:36.036201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:36.036363Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:36.036372Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:36.036383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:36.036431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:36.036469Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895000934750192:4535]
2025-09-30T14:51:36.037056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:36.037311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:36.037345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:36.037598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895001024476832:5353] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:36.037619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:36.037666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:36.037673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:36.037674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:36.037675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:36.037675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:36.037676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:36.037677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:36.037678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:36.037679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:36.037680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:36.037681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.037682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.037683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.037684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:36.037685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:36.037690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:36.037699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:36.037704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:36.037709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:36.037713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:36.037717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:36.037721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:36.037725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:36.037729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:36.037733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:36.037737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.037740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.037744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.037747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:36.037751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:36.037757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:36.037765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:36.037771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:36.037777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:36.037781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:36.037786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:36.037791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:36.037796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:36.037800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:36.037805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:36.037809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:36.037820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:36.037824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:36.037829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:36.037833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:36.037839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:36.037843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:36.037852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:36.037865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:36.037874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:36.037878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.037883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.037887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.037894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.037899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.037904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.037907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:36.037916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:36.037922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:36.037927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:36.037973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:36.043341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895001024476832:5353] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:36.043355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895001024476832:5353] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:36.043358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895001024476832:5353] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:36.043366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 491 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:36.043686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:36.044505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:36.044519Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:36.044521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:36.044527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:36.044531Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 490 [2:7555895000934750192:4535]
2025-09-30T14:51:36.044542Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:36.044552Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:36.044554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.044556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.044557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.044568Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:36.044573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:36.044578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:36.044620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.044626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.044627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.044629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:36.044634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:36.044696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:36.044703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.044711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.044718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.044728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:36.044743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895000934750185:4535]
2025-09-30T14:51:36.044748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895000934750185:4535]
2025-09-30T14:51:36.044749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895000934750185:4535]
2025-09-30T14:51:36.044755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:36.044764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895001024476871:5353], now have 1 active actors on pipe
2025-09-30T14:51:36.044766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:36.044769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:36.044772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:36.044774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:36.044782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:36.044783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:36.044788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895001024476801:2454], now have 1 active actors on pipe
2025-09-30T14:51:36.044810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895000934750185:4535]
2025-09-30T14:51:36.044818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:36.044841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:36.044829Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 490
2025-09-30T14:51:36.044830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 490
2025-09-30T14:51:36.044938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:36.044945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:36.044963Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a03bdc3c-36fd58ae-c019013a-ee0aa344_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:36.044972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.044977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.044980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:36.044987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.044998Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:36.045012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:36.045179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:36.045186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:36.045196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:36.045303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 491 partition: 0 MaxSeqNo: 42 sessionId: src_id|a03bdc3c-36fd58ae-c019013a-ee0aa344_0
2025-09-30T14:51:36.045636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6883155-7a693841-1d2cbc99-582f0590_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a03bdc3c-36fd58ae-c019013a-ee0aa344_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:36.048370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a03bdc3c-36fd58ae-c019013a-ee0aa344_0] Write session: try to update token
2025-09-30T14:51:36.048386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a03bdc3c-36fd58ae-c019013a-ee0aa344_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:36.061859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 491 sessionId: src_id|a03bdc3c-36fd58ae-c019013a-ee0aa344_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:36.062796Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:36.062815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:36.062825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895000934750185:4535]
2025-09-30T14:51:36.062871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:36.062895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:36.063048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:36.063195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:36.063364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:36.063507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:36.063696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:36.063741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:36.064554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:36.064777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:36.064792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:36.064822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:36.064931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:36.072300Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:36.072317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:36.072322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:36.072323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:36.072331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895000934750185:4535]
2025-09-30T14:51:36.072334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895000934750185:4535]
2025-09-30T14:51:36.072337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895000934750185:4535]
2025-09-30T14:51:36.072377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:36.072388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.072394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:36.072402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:36.072408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:36.072413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:36.072520Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:36.127147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895001024476882:4849]
2025-09-30T14:51:36.127391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 490, pipe: [1:7555895001024476882:4849]
2025-09-30T14:51:36.174591Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:36.181314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:36.181341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:36.181495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:36.181553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:36.181613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:36.181672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:36.181718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:36.181726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:36.181789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:36.181849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:36.181905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:36.181973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:36.182014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:36.182019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:36.182087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:36.182157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:36.182213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:36.182281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:36.182324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:36.182330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:36.182393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:36.182450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:36.182519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:36.182590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:36.182634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:36.182640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:36.182700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:36.182759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:36.182821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:36.182881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:36.182920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:36.182926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:36.182987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:36.183045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:36.183102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:36.183161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:36.183203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:36.183208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:36.183282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:36.183339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:36.183400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:36.183461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:36.183507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:36.183515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:36.183574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:36.183630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:36.183687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:36.183743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:36.183783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:36.183789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:36.183847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:36.183902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:36.183961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:36.184020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:36.184061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:36.184067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:36.184128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:36.184184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:36.184244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:36.184301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:36.184341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:36.184346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:36.184386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895001024476882:4849], now have 1 active actors on pipe
2025-09-30T14:51:36.184662Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:36.184662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:36.184667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:36.184695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 491 reason: error at write: Disconnected sessionId: src_id|a03bdc3c-36fd58ae-c019013a-ee0aa344_0
2025-09-30T14:51:36.184727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895001024476882:4849]
2025-09-30T14:51:36.184915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 491 sessionId: src_id|a03bdc3c-36fd58ae-c019013a-ee0aa344_0 is DEAD
2025-09-30T14:51:36.185118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a03bdc3c-36fd58ae-c019013a-ee0aa344_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:36.185129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a03bdc3c-36fd58ae-c019013a-ee0aa344_0] Write session will restart in 0.005750s
2025-09-30T14:51:36.185160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a03bdc3c-36fd58ae-c019013a-ee0aa344_0] Write session: Do CDS request
2025-09-30T14:51:36.185166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a03bdc3c-36fd58ae-c019013a-ee0aa344_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:36.185298Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:36.191729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a03bdc3c-36fd58ae-c019013a-ee0aa344_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:36.191881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:36.191898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 492
2025-09-30T14:51:36.192017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 492 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:36.192049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 492 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:36.192054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=492 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:36.192063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:36.192500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 492 sessionId:  describe result for acl check
2025-09-30T14:51:36.192540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:36.192547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:36.192549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:36.192554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895001024476925:5357] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:36.193082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895001024476925:5357] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:36.193060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:36.194592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:36.194755Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:36.194765Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:36.194775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:36.194820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:36.194859Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895000934750262:4538]
2025-09-30T14:51:36.195277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895001024476925:5357] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:36.195516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:36.195755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:36.195793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:36.196087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:36.196150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:36.196156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:36.196158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:36.196158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:36.196160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:36.196162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:36.196164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:36.196165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:36.196166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:36.196167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:36.196168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.196170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.196171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.196172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:36.196173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:36.196179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:36.196188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:36.196193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:36.196198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:36.196202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:36.196206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:36.196210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:36.196214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:36.196218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:36.196222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:36.196226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.196230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.196234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.196238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:36.196242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:36.196249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:36.196256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:36.196263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:36.196268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:36.196272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:36.196277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:36.196283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:36.196289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:36.196293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:36.196298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:36.196306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:36.196311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:36.196315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:36.196325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:36.196328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:36.196333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:36.196337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:36.196341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:36.196349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:36.196355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:36.196364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.196369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.196373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.196382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.196387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.196392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.196400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:36.196407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:36.196415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:36.196420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:36.196468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:36.201958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895001024476925:5357] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:36.201974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895001024476925:5357] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:36.201976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895001024476925:5357] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:36.201983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 492 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:36.202264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:36.203122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:36.203136Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:36.203138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:36.203141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:36.203146Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 491 [2:7555895000934750262:4538]
2025-09-30T14:51:36.203157Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:36.203170Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:36.203172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.203175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.203176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.203188Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:36.203192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:36.203197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:36.203235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.203240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.203256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.203259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:36.203260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:36.203307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:36.203313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.203320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.203328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.203338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:36.203351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895001024476884:2454], now have 1 active actors on pipe
2025-09-30T14:51:36.203353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895001024476966:5357], now have 1 active actors on pipe
2025-09-30T14:51:36.203357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895000934750257:4538]
2025-09-30T14:51:36.203359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895000934750257:4538]
2025-09-30T14:51:36.203360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895000934750257:4538]
2025-09-30T14:51:36.203368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:36.203378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:36.203379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:36.203382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:36.203384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:36.203391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:36.203392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:36.203415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895000934750257:4538]
2025-09-30T14:51:36.203421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:36.203426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:36.203436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 491
2025-09-30T14:51:36.203438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 491
2025-09-30T14:51:36.203510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:36.203517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:36.203536Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d17754c-8e0863ff-98a36e5e-cd0c7ff7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:36.203540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.203544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.203545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:36.203551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.203558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:36.203566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:36.203721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:36.203726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:36.203734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:36.203822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 492 partition: 0 MaxSeqNo: 42 sessionId: src_id|7d17754c-8e0863ff-98a36e5e-cd0c7ff7_0
2025-09-30T14:51:36.204186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a03bdc3c-36fd58ae-c019013a-ee0aa344_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7d17754c-8e0863ff-98a36e5e-cd0c7ff7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:36.206760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d17754c-8e0863ff-98a36e5e-cd0c7ff7_0] Write session: try to update token
2025-09-30T14:51:36.206779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d17754c-8e0863ff-98a36e5e-cd0c7ff7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:36.215118Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:36.215140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:36.215143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:36.215145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:36.215153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895000934750257:4538]
2025-09-30T14:51:36.215158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895000934750257:4538]
2025-09-30T14:51:36.215162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895000934750257:4538]
2025-09-30T14:51:36.215203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:36.215207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:36.215209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.215212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:36.215212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:36.215215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:36.215448Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:36.220504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 492 sessionId: src_id|7d17754c-8e0863ff-98a36e5e-cd0c7ff7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:36.223039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:36.284873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895001024476974:4849]
2025-09-30T14:51:36.285148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 491, pipe: [1:7555895001024476974:4849]
2025-09-30T14:51:36.318604Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:36.318912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:36.318925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:36.318955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895001024476974:4849], now have 1 active actors on pipe
2025-09-30T14:51:36.319143Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:36.319176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:36.319199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895001024476974:4849]
2025-09-30T14:51:36.319219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:36.319296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 492 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7d17754c-8e0863ff-98a36e5e-cd0c7ff7_0
2025-09-30T14:51:36.319483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 492 sessionId: src_id|7d17754c-8e0863ff-98a36e5e-cd0c7ff7_0 is DEAD
2025-09-30T14:51:36.319677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d17754c-8e0863ff-98a36e5e-cd0c7ff7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:36.319684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d17754c-8e0863ff-98a36e5e-cd0c7ff7_0] Write session will restart in 0.005898s
2025-09-30T14:51:36.319701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d17754c-8e0863ff-98a36e5e-cd0c7ff7_0] Write session: Do CDS request
2025-09-30T14:51:36.319705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d17754c-8e0863ff-98a36e5e-cd0c7ff7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:36.326016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:36.326678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d17754c-8e0863ff-98a36e5e-cd0c7ff7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:36.326779Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:36.326805Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 493
2025-09-30T14:51:36.326920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 493 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:36.326951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 493 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:36.326963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=493 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:36.326983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:36.327418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 493 sessionId:  describe result for acl check
2025-09-30T14:51:36.327452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:36.327459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:36.327462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:36.327467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895001024477008:5361] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:36.327614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:36.327746Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:36.327753Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:36.327760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:36.327793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:36.327822Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895000934750333:4540]
2025-09-30T14:51:36.327990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895001024477008:5361] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:36.328299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:36.328567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:36.328609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:36.328917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:36.328980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:36.328985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:36.328986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:36.328986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:36.328987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:36.328988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:36.328989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:36.328989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:36.328990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:36.328990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:36.328991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.328992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.328992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.328993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:36.328994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:36.328998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:36.329005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:36.329009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:36.329013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:36.329017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:36.329021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:36.329025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:36.329028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:36.329033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:36.329039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:36.329043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.329047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.329051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.329055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:36.329059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:36.329066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:36.329073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:36.329078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:36.329084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:36.329089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:36.329093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:36.329097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:36.329101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:36.329107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:36.329113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:36.329117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:36.329123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:36.329127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:36.329132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:36.329137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:36.329142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:36.329147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:36.329152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:36.329157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:36.329162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:36.329166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.329172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.329177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.329182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.329191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.329196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.329200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:36.329204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:36.329209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:36.329216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:36.329255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:36.329437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895001024477008:5361] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:36.333920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895001024477008:5361] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:36.333933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895001024477008:5361] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:36.333937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895001024477008:5361] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:36.333944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 493 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:36.334154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:36.334955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:36.334968Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:36.334970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:36.334973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:36.334977Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 492 [2:7555895000934750333:4540]
2025-09-30T14:51:36.334992Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:36.335006Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:36.335009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.335012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.335014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.335028Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:36.335034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:36.335040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:36.335093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.335101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.335103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.335106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:36.335109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:36.335168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:36.335173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.335181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.335187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.335197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:36.335213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895001024476975:2454], now have 1 active actors on pipe
2025-09-30T14:51:36.335220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895001024477047:5361], now have 1 active actors on pipe
2025-09-30T14:51:36.335224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895000934750328:4540]
2025-09-30T14:51:36.335225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895000934750328:4540]
2025-09-30T14:51:36.335226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895000934750328:4540]
2025-09-30T14:51:36.335234Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:36.335261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:36.335265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:36.335269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:36.335270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:36.335279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:36.335282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:36.335306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895000934750328:4540]
2025-09-30T14:51:36.335313Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:36.335295Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 492
2025-09-30T14:51:36.335306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 492
2025-09-30T14:51:36.335321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:36.335340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:36.335344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:36.335371Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|efd37fd7-fdd8b77f-21f61d2b-b386ef51_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:36.335381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.335385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.335387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:36.335398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.335412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:36.335429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:36.335590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:36.335599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:36.335612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:36.335691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 493 partition: 0 MaxSeqNo: 42 sessionId: src_id|efd37fd7-fdd8b77f-21f61d2b-b386ef51_0
2025-09-30T14:51:36.336000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d17754c-8e0863ff-98a36e5e-cd0c7ff7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|efd37fd7-fdd8b77f-21f61d2b-b386ef51_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:36.338579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efd37fd7-fdd8b77f-21f61d2b-b386ef51_0] Write session: try to update token
2025-09-30T14:51:36.338595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efd37fd7-fdd8b77f-21f61d2b-b386ef51_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:36.346505Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:36.346523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:36.346526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:36.346528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:36.346537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895000934750328:4540]
2025-09-30T14:51:36.346541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895000934750328:4540]
2025-09-30T14:51:36.346545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895000934750328:4540]
2025-09-30T14:51:36.346580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:36.346581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:36.346586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:36.346588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.346590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:36.346591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:36.346726Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:36.352274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 493 sessionId: src_id|efd37fd7-fdd8b77f-21f61d2b-b386ef51_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:36.354841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:36.419505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895001024477067:4849]
2025-09-30T14:51:36.419794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 492, pipe: [1:7555895001024477067:4849]
2025-09-30T14:51:36.449739Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:36.449974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:36.449985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:36.450017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895001024477067:4849], now have 1 active actors on pipe
2025-09-30T14:51:36.450219Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:36.450280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:36.450298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895001024477067:4849]
2025-09-30T14:51:36.450322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:36.450390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 493 reason: status is not ok: tablet will be restarted right now sessionId: src_id|efd37fd7-fdd8b77f-21f61d2b-b386ef51_0
2025-09-30T14:51:36.450610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 493 sessionId: src_id|efd37fd7-fdd8b77f-21f61d2b-b386ef51_0 is DEAD
2025-09-30T14:51:36.450758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efd37fd7-fdd8b77f-21f61d2b-b386ef51_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:36.450766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efd37fd7-fdd8b77f-21f61d2b-b386ef51_0] Write session will restart in 0.006450s
2025-09-30T14:51:36.450789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efd37fd7-fdd8b77f-21f61d2b-b386ef51_0] Write session: Do CDS request
2025-09-30T14:51:36.450795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efd37fd7-fdd8b77f-21f61d2b-b386ef51_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:36.457417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:36.458793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efd37fd7-fdd8b77f-21f61d2b-b386ef51_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:36.458894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:36.458935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:36.458954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 494
2025-09-30T14:51:36.459059Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:36.459068Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:36.459078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:36.459090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 494 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:36.459121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 494 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:36.459124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:36.459131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=494 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:36.459135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:36.459160Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895000934750441:4554]
2025-09-30T14:51:36.459542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 494 sessionId:  describe result for acl check
2025-09-30T14:51:36.459577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:36.459584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:36.459586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:36.459591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895001024477114:5373] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:36.459813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:36.460048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:36.460088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:36.460085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895001024477114:5373] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:36.460402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:36.460459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:36.460467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:36.460468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:36.460469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:36.460470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:36.460471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:36.460472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:36.460473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:36.460474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:36.460475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:36.460476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.460477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.460478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.460479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:36.460480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:36.460485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:36.460495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:36.460499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:36.460503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:36.460507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:36.460512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:36.460517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:36.460521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:36.460525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:36.460530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:36.460534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.460539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.460543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.460546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:36.460550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:36.460557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:36.460564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:36.460571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:36.460576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:36.460580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:36.460585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:36.460588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:36.460593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:36.460598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:36.460602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:36.460606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:36.460611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:36.460616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:36.460620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:36.460624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:36.460629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:36.460634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:36.460639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:36.460648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:36.460653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:36.460657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.460667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.460672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.460677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.460686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.460691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.460695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:36.460705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:36.460710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:36.460719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:36.460764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:36.461783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895001024477114:5373] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:36.465477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895001024477114:5373] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:36.465490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895001024477114:5373] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:36.465493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895001024477114:5373] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:36.465499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 494 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:36.465832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:36.466643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:36.466655Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:36.466658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:36.466662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:36.466667Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 493 [2:7555895000934750441:4554]
2025-09-30T14:51:36.466683Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:36.466699Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:36.466702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.466706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.466708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.466720Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:36.466724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:36.466729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:36.466770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.466776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.466778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.466780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:36.466782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:36.466826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:36.466831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.466838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.466846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.466858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:36.466875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895001024477153:5373], now have 1 active actors on pipe
2025-09-30T14:51:36.466882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895001024477078:2454], now have 1 active actors on pipe
2025-09-30T14:51:36.466886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895000934750436:4554]
2025-09-30T14:51:36.466888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895000934750436:4554]
2025-09-30T14:51:36.466889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895000934750436:4554]
2025-09-30T14:51:36.466898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:36.466908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:36.466914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:36.466917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:36.466918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:36.466921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:36.466923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:36.466944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895000934750436:4554]
2025-09-30T14:51:36.466954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:36.466957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:36.466955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 493
2025-09-30T14:51:36.466961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 493
2025-09-30T14:51:36.466988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:36.466996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:36.467015Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a591457-99b16cb0-f966c0ee-1d9e56c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:36.467023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.467026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.467027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:36.467033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.467039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:36.467055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:36.467162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:36.467170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:36.467182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:36.467277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 494 partition: 0 MaxSeqNo: 42 sessionId: src_id|7a591457-99b16cb0-f966c0ee-1d9e56c4_0
2025-09-30T14:51:36.467632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efd37fd7-fdd8b77f-21f61d2b-b386ef51_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7a591457-99b16cb0-f966c0ee-1d9e56c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:36.470318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a591457-99b16cb0-f966c0ee-1d9e56c4_0] Write session: try to update token
2025-09-30T14:51:36.470334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a591457-99b16cb0-f966c0ee-1d9e56c4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:36.477728Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:36.477748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:36.477758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895000934750436:4554]
2025-09-30T14:51:36.477799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:36.477802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:36.477986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:36.478133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:36.478276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:36.478416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:36.478615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:36.478657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:36.483728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 494 sessionId: src_id|7a591457-99b16cb0-f966c0ee-1d9e56c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:36.486119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:36.486335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:36.486358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:36.486392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:36.486453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:36.488837Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:36.488854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:36.488859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:36.488861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:36.488870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895000934750436:4554]
2025-09-30T14:51:36.488874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895000934750436:4554]
2025-09-30T14:51:36.488878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895000934750436:4554]
2025-09-30T14:51:36.488913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:36.488911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:36.488920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.488923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:36.488923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:36.488926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:36.489056Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:36.550582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895001024477161:4849]
2025-09-30T14:51:36.550827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 493, pipe: [1:7555895001024477161:4849]
2025-09-30T14:51:36.593415Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:36.601889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:36.601912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:36.602083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:36.602147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:36.602212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:36.602279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:36.602680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:36.602692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:36.602762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:36.602825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:36.602891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:36.602955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:36.603007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:36.603016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:36.603080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:36.603141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:36.603203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:36.603281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:36.603323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:36.603330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:36.603397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:36.603459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:36.603522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:36.603588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:36.603635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:36.603642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:36.603707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:36.603767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:36.603828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:36.603891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:36.603932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:36.603939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:36.604002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:36.604067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:36.604131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:36.604201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:36.604312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:36.604320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:36.604384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:36.604444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:36.604509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:36.604572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:36.604620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:36.604628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:36.604695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:36.604759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:36.604829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:36.604892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:36.604936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:36.604944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:36.605010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:36.605070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:36.605129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:36.605195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:36.605239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:36.605246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:36.605312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:36.605371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:36.605433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:36.605491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:36.605533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:36.605540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:36.605604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895001024477161:4849], now have 1 active actors on pipe
2025-09-30T14:51:36.605774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:36.605779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:36.605783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:36.605806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 494 reason: error at write: Disconnected sessionId: src_id|7a591457-99b16cb0-f966c0ee-1d9e56c4_0
2025-09-30T14:51:36.605813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895001024477161:4849]
2025-09-30T14:51:36.605979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 494 sessionId: src_id|7a591457-99b16cb0-f966c0ee-1d9e56c4_0 is DEAD
2025-09-30T14:51:36.606187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a591457-99b16cb0-f966c0ee-1d9e56c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:36.606199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a591457-99b16cb0-f966c0ee-1d9e56c4_0] Write session will restart in 0.007114s
2025-09-30T14:51:36.606221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a591457-99b16cb0-f966c0ee-1d9e56c4_0] Write session: Do CDS request
2025-09-30T14:51:36.606227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a591457-99b16cb0-f966c0ee-1d9e56c4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:36.606220Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:36.613087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:36.614534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:36.614707Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:36.614717Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:36.614729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:36.614759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a591457-99b16cb0-f966c0ee-1d9e56c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:36.614790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:36.614828Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895000934750518:4557]
2025-09-30T14:51:36.614904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:36.614919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 495
2025-09-30T14:51:36.615047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 495 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:36.615076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 495 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:36.615088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=495 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:36.615097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:36.615438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:36.615519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 495 sessionId:  describe result for acl check
2025-09-30T14:51:36.615552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:36.615559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:36.615561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:36.615566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895001024477198:5377] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:36.615690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:36.615732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:36.616038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:36.616092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:36.616101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:36.616102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:36.616103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:36.616104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:36.616113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895001024477198:5377] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:36.616105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:36.616106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:36.616107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:36.616108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:36.616109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:36.616110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.616111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.616112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.616113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:36.616114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:36.616119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:36.616128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:36.616131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:36.616135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:36.616138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:36.616141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:36.616144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:36.616148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:36.616151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:36.616155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:36.616158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.616162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.616165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.616169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:36.616173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:36.616179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:36.616186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:36.616195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:36.616200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:36.616204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:36.616209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:36.616213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:36.616224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:36.616233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:36.616242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:36.616246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:36.616256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:36.616264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:36.616274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:36.616282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:36.616292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:36.616296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:36.616300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:36.616310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:36.616318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:36.616327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.616336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.616346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.616354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.616358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.616362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.616365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:36.616374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:36.616382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:36.616389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:36.616437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:36.617967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895001024477198:5377] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:36.621029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895001024477198:5377] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:36.621042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895001024477198:5377] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:36.621045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895001024477198:5377] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:36.621053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 495 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:36.621428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:36.622267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:36.622285Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:36.622289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:36.622295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:36.622301Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 494 [2:7555895000934750518:4557]
2025-09-30T14:51:36.622319Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:36.622338Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:36.622345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.622348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.622350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.622362Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:36.622368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:36.622380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:36.622441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.622449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.622451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.622455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:36.622458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:36.622533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:36.622540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.622552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.622569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.622593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:36.622615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895001024477162:2454], now have 1 active actors on pipe
2025-09-30T14:51:36.622627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895001024477237:5377], now have 1 active actors on pipe
2025-09-30T14:51:36.622634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895000934750513:4557]
2025-09-30T14:51:36.622636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895000934750513:4557]
2025-09-30T14:51:36.622618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 494
2025-09-30T14:51:36.622638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895000934750513:4557]
2025-09-30T14:51:36.622632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 494
2025-09-30T14:51:36.622647Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:36.622661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:36.622667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:36.622671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:36.622673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:36.622676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:36.622679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:36.622720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:36.622731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:36.622742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895000934750513:4557]
2025-09-30T14:51:36.622755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:36.622765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:36.622789Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a408328f-7a97d629-42c630ed-bc32a14e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:36.622800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.622804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.622807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:36.622816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.622826Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:36.622854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:36.622978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:36.622986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:36.623001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:36.623072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 495 partition: 0 MaxSeqNo: 42 sessionId: src_id|a408328f-7a97d629-42c630ed-bc32a14e_0
2025-09-30T14:51:36.623419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a591457-99b16cb0-f966c0ee-1d9e56c4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a408328f-7a97d629-42c630ed-bc32a14e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:36.626074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a408328f-7a97d629-42c630ed-bc32a14e_0] Write session: try to update token
2025-09-30T14:51:36.626089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a408328f-7a97d629-42c630ed-bc32a14e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:36.634035Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:36.634054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:36.634056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:36.634058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:36.634068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895000934750513:4557]
2025-09-30T14:51:36.634073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895000934750513:4557]
2025-09-30T14:51:36.634077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895000934750513:4557]
2025-09-30T14:51:36.634112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:36.634122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:36.634122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:36.634125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:36.634132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.634136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:36.634311Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:36.640316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 495 sessionId: src_id|a408328f-7a97d629-42c630ed-bc32a14e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:36.643371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:36.705733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895001024477244:4849]
2025-09-30T14:51:36.705993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 494, pipe: [1:7555895001024477244:4849]
2025-09-30T14:51:36.737603Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:36.737875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:36.737891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:36.737908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895001024477244:4849], now have 1 active actors on pipe
2025-09-30T14:51:36.738115Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:36.738118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895001024477244:4849]
2025-09-30T14:51:36.738147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:36.738150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:36.738207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 495 reason: error at write: Disconnected sessionId: src_id|a408328f-7a97d629-42c630ed-bc32a14e_0
2025-09-30T14:51:36.738237Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:36.738410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 495 sessionId: src_id|a408328f-7a97d629-42c630ed-bc32a14e_0 is DEAD
2025-09-30T14:51:36.738540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a408328f-7a97d629-42c630ed-bc32a14e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:36.738549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a408328f-7a97d629-42c630ed-bc32a14e_0] Write session will restart in 0.006494s
2025-09-30T14:51:36.738567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a408328f-7a97d629-42c630ed-bc32a14e_0] Write session: Do CDS request
2025-09-30T14:51:36.738571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a408328f-7a97d629-42c630ed-bc32a14e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:36.744511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:36.745671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a408328f-7a97d629-42c630ed-bc32a14e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:36.745777Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:36.745790Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 496
2025-09-30T14:51:36.745931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 496 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:36.745962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 496 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:36.745971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=496 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:36.745975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:36.745945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:36.746079Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:36.746088Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:36.746096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:36.746139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:36.746166Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895000934750592:4559]
2025-09-30T14:51:36.746366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 496 sessionId:  describe result for acl check
2025-09-30T14:51:36.746398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:36.746406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:36.746408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:36.746413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895001024477281:5381] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:36.746708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:36.746953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895001024477281:5381] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:36.746978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:36.747025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:36.747337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:36.747409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:36.747416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:36.747417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:36.747418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:36.747419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:36.747420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:36.747421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:36.747423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:36.747424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:36.747425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:36.747426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.747427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.747428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.747429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:36.747430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:36.747435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:36.747444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:36.747449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:36.747454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:36.747458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:36.747462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:36.747467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:36.747471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:36.747475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:36.747480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:36.747484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.747488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.747492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.747495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:36.747498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:36.747505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:36.747513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:36.747519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:36.747523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:36.747527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:36.747532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:36.747536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:36.747541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:36.747552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:36.747557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:36.747563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:36.747572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:36.747577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:36.747582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:36.747586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:36.747591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:36.747599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:36.747604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:36.747610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:36.747619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:36.747625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.747629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.747636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.747641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.747650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.747655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.747659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:36.747663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:36.747671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:36.747676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:36.747719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:36.748883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895001024477281:5381] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:36.752150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895001024477281:5381] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:36.752162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895001024477281:5381] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:36.752166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895001024477281:5381] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:36.752173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 496 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:36.752467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:36.753305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:36.753318Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:36.753320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:36.753323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:36.753328Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 495 [2:7555895000934750592:4559]
2025-09-30T14:51:36.753342Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:36.753352Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:36.753354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.753356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.753357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.753367Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:36.753372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:36.753376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:36.753412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.753419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.753421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.753423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:36.753425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:36.753464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:36.753466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.753474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.753484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.753494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:36.753506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895001024477320:5381], now have 1 active actors on pipe
2025-09-30T14:51:36.753512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895001024477245:2454], now have 1 active actors on pipe
2025-09-30T14:51:36.753517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895000934750587:4559]
2025-09-30T14:51:36.753518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895000934750587:4559]
2025-09-30T14:51:36.753520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895000934750587:4559]
2025-09-30T14:51:36.753529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:36.753539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:36.753541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:36.753542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:36.753543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:36.753553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:36.753555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:36.753574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895000934750587:4559]
2025-09-30T14:51:36.753584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:36.753578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 495
2025-09-30T14:51:36.753586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 495
2025-09-30T14:51:36.753608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:36.753611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:36.753616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:36.753640Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91beaf50-ff839148-a96dbf19-57034d94_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:36.753648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.753651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.753652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:36.753658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.753663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:36.753675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:36.753827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:36.753836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:36.753847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:36.753926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 496 partition: 0 MaxSeqNo: 42 sessionId: src_id|91beaf50-ff839148-a96dbf19-57034d94_0
2025-09-30T14:51:36.754241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a408328f-7a97d629-42c630ed-bc32a14e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|91beaf50-ff839148-a96dbf19-57034d94_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:36.756927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91beaf50-ff839148-a96dbf19-57034d94_0] Write session: try to update token
2025-09-30T14:51:36.756943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91beaf50-ff839148-a96dbf19-57034d94_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:36.764609Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:36.764624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:36.764627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:36.764628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:36.764635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895000934750587:4559]
2025-09-30T14:51:36.764638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895000934750587:4559]
2025-09-30T14:51:36.764641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895000934750587:4559]
2025-09-30T14:51:36.764673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:36.764678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.764682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:36.764691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:36.764697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:36.764700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:36.764802Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:36.770905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 496 sessionId: src_id|91beaf50-ff839148-a96dbf19-57034d94_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:36.773260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:36.838320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895001024477328:4849]
2025-09-30T14:51:36.838571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 495, pipe: [1:7555895001024477328:4849]
2025-09-30T14:51:36.864876Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:36.865118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:36.865131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:36.865162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895001024477328:4849], now have 1 active actors on pipe
2025-09-30T14:51:36.865340Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:36.865419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:36.865447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895001024477328:4849]
2025-09-30T14:51:36.865466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:36.865579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 496 reason: status is not ok: tablet will be restarted right now sessionId: src_id|91beaf50-ff839148-a96dbf19-57034d94_0
2025-09-30T14:51:36.865762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 496 sessionId: src_id|91beaf50-ff839148-a96dbf19-57034d94_0 is DEAD
2025-09-30T14:51:36.865920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91beaf50-ff839148-a96dbf19-57034d94_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:36.865929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91beaf50-ff839148-a96dbf19-57034d94_0] Write session will restart in 0.008759s
2025-09-30T14:51:36.865946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91beaf50-ff839148-a96dbf19-57034d94_0] Write session: Do CDS request
2025-09-30T14:51:36.865950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91beaf50-ff839148-a96dbf19-57034d94_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:36.873598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:36.875028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:36.875197Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:36.875203Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:36.875211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:36.875277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:36.875319Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895000934750680:4562]
2025-09-30T14:51:36.875761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91beaf50-ff839148-a96dbf19-57034d94_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:36.875886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:36.875899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:36.875919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 497
2025-09-30T14:51:36.876040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 497 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:36.876071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 497 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:36.876077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=497 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:36.876083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:36.876312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:36.876352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:36.876549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 497 sessionId:  describe result for acl check
2025-09-30T14:51:36.876582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:36.876588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:36.876593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:36.876598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895001024477380:5386] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:36.876607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:36.876659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:36.876664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:36.876665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:36.876666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:36.876666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:36.876667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:36.876668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:36.876669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:36.876669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:36.876670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:36.876671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.876673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.876673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.876674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:36.876675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:36.876678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:36.876685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:36.876688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:36.876690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:36.876692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:36.876694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:36.876697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:36.876699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:36.876701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:36.876704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:36.876706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.876708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.876711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.876713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:36.876716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:36.876721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:36.876725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:36.876728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:36.876732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:36.876735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:36.876738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:36.876741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:36.876744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:36.876747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:36.876751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:36.876753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:36.876756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:36.876760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:36.876763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:36.876765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:36.876768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:36.876770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:36.876773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:36.876776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:36.876779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:36.876781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.876784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.876787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.876789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.876793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.876796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.876798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:36.876801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:36.876804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:36.876806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:36.876830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:36.877139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895001024477380:5386] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:36.879128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895001024477380:5386] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:36.881843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895001024477380:5386] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:36.881860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895001024477380:5386] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:36.881865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895001024477380:5386] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:36.881873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 497 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:36.882204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:36.883042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:36.883054Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:36.883056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:36.883060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:36.883065Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 496 [2:7555895000934750680:4562]
2025-09-30T14:51:36.883076Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:36.883089Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:36.883095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.883097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.883099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.883112Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:36.883117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:36.883122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:36.883162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.883167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.883168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.883170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:36.883172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:36.883221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:36.883227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.883235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:36.883262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:36.883285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:36.883303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895001024477329:2454], now have 1 active actors on pipe
2025-09-30T14:51:36.883306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895001024477417:5386], now have 1 active actors on pipe
2025-09-30T14:51:36.883313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895000934750675:4562]
2025-09-30T14:51:36.883321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895000934750675:4562]
2025-09-30T14:51:36.883322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895000934750675:4562]
2025-09-30T14:51:36.883330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:36.883341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:36.883346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:36.883349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:36.883351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:36.883353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:36.883356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:36.883348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 496
2025-09-30T14:51:36.883364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 496
2025-09-30T14:51:36.883380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895000934750675:4562]
2025-09-30T14:51:36.883386Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:36.883389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:36.883407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:36.883413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:36.883439Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e195cf2a-3b6ef7f5-f872eb75-3240e61_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:36.883447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.883450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.883455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:36.883462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.883469Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:36.883481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:36.883616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:36.883622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:36.883630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:36.883717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 497 partition: 0 MaxSeqNo: 42 sessionId: src_id|e195cf2a-3b6ef7f5-f872eb75-3240e61_0
2025-09-30T14:51:36.884032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91beaf50-ff839148-a96dbf19-57034d94_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e195cf2a-3b6ef7f5-f872eb75-3240e61_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:36.886565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e195cf2a-3b6ef7f5-f872eb75-3240e61_0] Write session: try to update token
2025-09-30T14:51:36.886578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e195cf2a-3b6ef7f5-f872eb75-3240e61_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:36.894886Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:36.894905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:36.894907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:36.894912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:36.894921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895000934750675:4562]
2025-09-30T14:51:36.894926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895000934750675:4562]
2025-09-30T14:51:36.894930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895000934750675:4562]
2025-09-30T14:51:36.894967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:36.894980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:36.894983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:36.894986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:36.894991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:36.894994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:36.895121Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:36.900418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 497 sessionId: src_id|e195cf2a-3b6ef7f5-f872eb75-3240e61_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:36.902779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:36.965828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895001024477425:4849]
2025-09-30T14:51:36.966163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 496, pipe: [1:7555895001024477425:4849]
2025-09-30T14:51:37.003659Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:37.003970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:37.003981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:37.004018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895001024477425:4849], now have 1 active actors on pipe
2025-09-30T14:51:37.004183Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:37.004252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:37.004296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895001024477425:4849]
2025-09-30T14:51:37.004296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:37.004367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 497 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e195cf2a-3b6ef7f5-f872eb75-3240e61_0
2025-09-30T14:51:37.004571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 497 sessionId: src_id|e195cf2a-3b6ef7f5-f872eb75-3240e61_0 is DEAD
2025-09-30T14:51:37.004723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e195cf2a-3b6ef7f5-f872eb75-3240e61_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:37.004733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e195cf2a-3b6ef7f5-f872eb75-3240e61_0] Write session will restart in 0.007483s
2025-09-30T14:51:37.004756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e195cf2a-3b6ef7f5-f872eb75-3240e61_0] Write session: Do CDS request
2025-09-30T14:51:37.004762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e195cf2a-3b6ef7f5-f872eb75-3240e61_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:37.011999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:37.013612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:37.013754Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:37.013761Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:37.013768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:37.013806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e195cf2a-3b6ef7f5-f872eb75-3240e61_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:37.013805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:37.013837Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895005229718054:4564]
2025-09-30T14:51:37.013817Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:37.013829Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 498
2025-09-30T14:51:37.014053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 498 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:37.014075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 498 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:37.014082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=498 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:37.014085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:37.014275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:37.014490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 498 sessionId:  describe result for acl check
2025-09-30T14:51:37.014526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:37.014532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:37.014535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:37.014541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895005319444769:5392] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:37.014564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:37.014607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:37.014890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:37.014935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:37.014937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:37.014938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:37.014939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:37.014940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:37.014940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:37.014941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:37.014942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:37.014942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:37.014943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:37.014944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.014944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.014945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.014946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:37.014946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:37.014950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:37.014958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:37.014961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:37.014964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:37.014966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:37.014968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:37.014970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:37.014972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:37.014974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:37.014977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:37.014979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.014981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.014984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.014986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:37.014988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:37.014993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:37.014997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:37.015001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:37.015005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:37.015007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:37.015010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:37.015013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:37.015016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:37.015018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:37.015022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:37.015026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:37.015028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:37.015031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:37.015033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:37.015036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:37.015069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895005319444769:5392] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:37.015039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:37.015041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:37.015045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:37.015047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:37.015050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:37.015052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.015055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.015057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.015059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.015063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.015065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.015067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:37.015070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:37.015072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:37.015075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:37.015099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:37.016636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895005319444769:5392] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:37.019790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895005319444769:5392] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:37.019806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895005319444769:5392] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:37.019810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895005319444769:5392] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:37.019819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 498 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:37.020103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:37.020974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:37.020987Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:37.020989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:37.020993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:37.020999Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 497 [2:7555895005229718054:4564]
2025-09-30T14:51:37.021009Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:37.021025Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:37.021028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.021030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.021031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.021042Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:37.021050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:37.021056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:37.021099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.021104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.021105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.021107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:37.021109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:37.021164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:37.021169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.021176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.021184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.021197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:37.021212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895005229718049:4564]
2025-09-30T14:51:37.021219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895005229718049:4564]
2025-09-30T14:51:37.021220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895005229718049:4564]
2025-09-30T14:51:37.021226Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:37.021237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:37.021241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:37.021244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:37.021245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:37.021245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:37.021247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:37.021279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895005319444806:5392], now have 1 active actors on pipe
2025-09-30T14:51:37.021283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895005319444729:2454], now have 1 active actors on pipe
2025-09-30T14:51:37.021285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895005229718049:4564]
2025-09-30T14:51:37.021293Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:37.021308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:37.021342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 497
2025-09-30T14:51:37.021344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 497
2025-09-30T14:51:37.021387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:37.021395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:37.021418Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd75e235-37b0fd52-10867b20-275e06da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:37.021431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.021434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.021435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:37.021443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.021450Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:37.021461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:37.021621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:37.021628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:37.021637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:37.021716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 498 partition: 0 MaxSeqNo: 42 sessionId: src_id|cd75e235-37b0fd52-10867b20-275e06da_0
2025-09-30T14:51:37.022043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e195cf2a-3b6ef7f5-f872eb75-3240e61_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cd75e235-37b0fd52-10867b20-275e06da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:37.024734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd75e235-37b0fd52-10867b20-275e06da_0] Write session: try to update token
2025-09-30T14:51:37.024749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd75e235-37b0fd52-10867b20-275e06da_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:37.032825Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:37.032844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:37.032847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:37.032852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:37.032862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895005229718049:4564]
2025-09-30T14:51:37.032869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895005229718049:4564]
2025-09-30T14:51:37.032873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895005229718049:4564]
2025-09-30T14:51:37.032906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:37.032914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.032916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:37.032924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:37.032930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:37.032933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:37.033038Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:37.038214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 498 sessionId: src_id|cd75e235-37b0fd52-10867b20-275e06da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:37.040711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:37.104562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895005319444816:4849]
2025-09-30T14:51:37.104807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 497, pipe: [1:7555895005319444816:4849]
2025-09-30T14:51:37.140815Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:37.141174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:37.141188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:37.141227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895005319444816:4849], now have 1 active actors on pipe
2025-09-30T14:51:37.141424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:37.141434Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:37.141437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:37.141484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895005319444816:4849]
2025-09-30T14:51:37.141505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 498 reason: error at write: Disconnected sessionId: src_id|cd75e235-37b0fd52-10867b20-275e06da_0
2025-09-30T14:51:37.141670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 498 sessionId: src_id|cd75e235-37b0fd52-10867b20-275e06da_0 is DEAD
2025-09-30T14:51:37.141863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd75e235-37b0fd52-10867b20-275e06da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:37.141874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd75e235-37b0fd52-10867b20-275e06da_0] Write session will restart in 0.009566s
2025-09-30T14:51:37.141892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd75e235-37b0fd52-10867b20-275e06da_0] Write session: Do CDS request
2025-09-30T14:51:37.141896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd75e235-37b0fd52-10867b20-275e06da_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:37.141969Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:37.149304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:37.150821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:37.151014Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:37.151026Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:37.151037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:37.151087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:37.151131Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895005229718134:4567]
2025-09-30T14:51:37.151838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:37.152096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:37.152141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:37.152470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:37.152531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:37.152538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:37.152539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:37.152540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:37.152541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:37.152543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:37.152544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:37.152545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:37.152546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:37.152547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:37.152549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.152550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.152551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.152553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:37.152554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:37.152559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:37.152571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:37.152577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:37.152582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:37.152586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:37.152591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:37.152595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:37.152599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:37.152604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:37.152609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:37.152613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.152618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.152623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.152627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:37.152636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:37.152643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:37.152656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:37.152663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:37.152674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:37.152685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:37.152695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:37.152704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:37.152709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:37.152719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:37.152729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:37.152738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:37.152746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:37.152756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd75e235-37b0fd52-10867b20-275e06da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:37.152756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:37.152767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:37.152772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:37.152777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:37.152786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:37.152792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:37.152799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:37.152809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:37.152817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.152823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.152831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.152837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.152843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.152849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.152854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:37.152862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:37.152838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:37.152852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 499
2025-09-30T14:51:37.152866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:37.152875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:37.152926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:37.153000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 499 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:37.153032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 499 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:37.153038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=499 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:37.153043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:37.153441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 499 sessionId:  describe result for acl check
2025-09-30T14:51:37.153478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:37.153487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:37.153489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:37.153495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895005319444862:5396] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:37.154034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895005319444862:5396] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:37.156045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895005319444862:5396] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:37.158206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:37.158552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895005319444862:5396] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:37.158569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895005319444862:5396] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:37.158573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895005319444862:5396] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:37.158581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 499 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:37.159294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:37.159313Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:37.159316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:37.159321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:37.159328Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 498 [2:7555895005229718134:4567]
2025-09-30T14:51:37.159345Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:37.159364Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:37.159371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.159375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.159379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.159396Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:37.159407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:37.159414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:37.159478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.159485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.159487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.159489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:37.159492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:37.159558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:37.159568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.159584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.159597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.159620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:37.159646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895005319444896:5396], now have 1 active actors on pipe
2025-09-30T14:51:37.159650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895005319444818:2454], now have 1 active actors on pipe
2025-09-30T14:51:37.159656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895005229718129:4567]
2025-09-30T14:51:37.159659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895005229718129:4567]
2025-09-30T14:51:37.159660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895005229718129:4567]
2025-09-30T14:51:37.159676Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:37.159685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 498
2025-09-30T14:51:37.159711Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 498
2025-09-30T14:51:37.159696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:37.159695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:37.159698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:37.159700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:37.159718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:37.159721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:37.159767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:37.159776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:37.159791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895005229718129:4567]
2025-09-30T14:51:37.159806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:37.159831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:37.159839Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31a31163-77cf42aa-a807a998-947669ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:37.159846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.159851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.159853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:37.159862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.159876Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:37.159906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:37.160049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:37.160059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:37.160075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:37.160154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 499 partition: 0 MaxSeqNo: 42 sessionId: src_id|31a31163-77cf42aa-a807a998-947669ab_0
2025-09-30T14:51:37.160534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd75e235-37b0fd52-10867b20-275e06da_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|31a31163-77cf42aa-a807a998-947669ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:37.163496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31a31163-77cf42aa-a807a998-947669ab_0] Write session: try to update token
2025-09-30T14:51:37.163516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31a31163-77cf42aa-a807a998-947669ab_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:37.171538Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:37.171561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:37.171563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:37.171565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:37.171576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895005229718129:4567]
2025-09-30T14:51:37.171580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895005229718129:4567]
2025-09-30T14:51:37.171587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895005229718129:4567]
2025-09-30T14:51:37.171624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:37.171628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:37.171630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:37.171633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:37.171636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.171639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:37.171786Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:37.177919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 499 sessionId: src_id|31a31163-77cf42aa-a807a998-947669ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:37.180549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:37.241787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895005319444903:4849]
2025-09-30T14:51:37.242048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 498, pipe: [1:7555895005319444903:4849]
2025-09-30T14:51:37.278455Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:37.278758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:37.278771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:37.278787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895005319444903:4849], now have 1 active actors on pipe
2025-09-30T14:51:37.279030Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:37.279061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:37.279080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:37.279104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895005319444903:4849]
2025-09-30T14:51:37.279131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:37.279155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 499 reason: error at write: Disconnected sessionId: src_id|31a31163-77cf42aa-a807a998-947669ab_0
2025-09-30T14:51:37.279375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 499 sessionId: src_id|31a31163-77cf42aa-a807a998-947669ab_0 is DEAD
2025-09-30T14:51:37.279568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a31163-77cf42aa-a807a998-947669ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:37.279577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a31163-77cf42aa-a807a998-947669ab_0] Write session will restart in 0.009314s
2025-09-30T14:51:37.279603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a31163-77cf42aa-a807a998-947669ab_0] Write session: Do CDS request
2025-09-30T14:51:37.279608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a31163-77cf42aa-a807a998-947669ab_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:37.287153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:37.288764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:37.288925Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:37.288933Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:37.288940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:37.288978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:37.289014Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895005229718212:4569]
2025-09-30T14:51:37.289514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:37.289767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31a31163-77cf42aa-a807a998-947669ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:37.289779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:37.289811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:37.289828Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:37.289845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 500
2025-09-30T14:51:37.289976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 500 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:37.290010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 500 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:37.290019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=500 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:37.290024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:37.290047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:37.290090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:37.290096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:37.290097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:37.290098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:37.290100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:37.290101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:37.290102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:37.290103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:37.290104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:37.290105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:37.290106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.290108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.290109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.290112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:37.290113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:37.290119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:37.290127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:37.290130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:37.290132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:37.290135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:37.290137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:37.290140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:37.290142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:37.290145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:37.290147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:37.290150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.290152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.290154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.290156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:37.290159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:37.290165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:37.290173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:37.290179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:37.290185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:37.290190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:37.290196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:37.290200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:37.290205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:37.290220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:37.290225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:37.290228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:37.290233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:37.290238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:37.290243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:37.290248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:37.290253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:37.290258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:37.290263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:37.290267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:37.290272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:37.290277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.290282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.290291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.290296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.290305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.290314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.290316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:37.290319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:37.290321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:37.290324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:37.290351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:37.290510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 500 sessionId:  describe result for acl check
2025-09-30T14:51:37.290545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:37.290552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:37.290554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:37.290559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895005319444947:5400] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:37.291072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895005319444947:5400] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:37.293095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895005319444947:5400] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:37.295140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895005319444947:5400] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:37.295157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895005319444947:5400] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:37.295160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895005319444947:5400] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:37.295165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 500 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:37.295580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:37.296376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:37.296393Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:37.296396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:37.296399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:37.296405Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 499 [2:7555895005229718212:4569]
2025-09-30T14:51:37.296420Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:37.296435Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:37.296437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.296440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.296442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.296456Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:37.296469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:37.296475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:37.296523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.296529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.296530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.296532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:37.296535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:37.296590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:37.296597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.296609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.296622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.296643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:37.296659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895005319444990:5400], now have 1 active actors on pipe
2025-09-30T14:51:37.296665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895005319444905:2454], now have 1 active actors on pipe
2025-09-30T14:51:37.296669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895005229718207:4569]
2025-09-30T14:51:37.296671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895005229718207:4569]
2025-09-30T14:51:37.296673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895005229718207:4569]
2025-09-30T14:51:37.296681Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:37.296694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:37.296693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:37.296696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:37.296698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:37.296714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:37.296716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:37.296699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 499
2025-09-30T14:51:37.296711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 499
2025-09-30T14:51:37.296743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895005229718207:4569]
2025-09-30T14:51:37.296756Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:37.296773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:37.296842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:37.296850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:37.296869Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b12c1790-d577c764-6fc89789-2aa3a8fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:37.296876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.296879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.296882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:37.296888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.296900Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:37.296908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:37.297070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:37.297075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:37.297084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:37.297171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 500 partition: 0 MaxSeqNo: 42 sessionId: src_id|b12c1790-d577c764-6fc89789-2aa3a8fa_0
2025-09-30T14:51:37.297523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a31163-77cf42aa-a807a998-947669ab_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b12c1790-d577c764-6fc89789-2aa3a8fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:37.300097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b12c1790-d577c764-6fc89789-2aa3a8fa_0] Write session: try to update token
2025-09-30T14:51:37.300113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b12c1790-d577c764-6fc89789-2aa3a8fa_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:37.311060Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:37.311081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:37.311091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895005229718207:4569]
2025-09-30T14:51:37.311138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:37.311147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:37.311502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:37.311644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:37.311785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:37.311917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:37.312100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:37.312137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:37.319165Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:37.319185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:37.319188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:37.319190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:37.319201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895005229718207:4569]
2025-09-30T14:51:37.319206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895005229718207:4569]
2025-09-30T14:51:37.319211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895005229718207:4569]
2025-09-30T14:51:37.319270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:37.319273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:37.319277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.319280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:37.319283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:37.319285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:37.319423Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:37.322354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 500 sessionId: src_id|b12c1790-d577c764-6fc89789-2aa3a8fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:37.324907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:37.379512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895005319445000:4849]
2025-09-30T14:51:37.379784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 499, pipe: [1:7555895005319445000:4849]
2025-09-30T14:51:37.424631Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:37.424974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:37.424986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:37.425002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895005319445000:4849], now have 1 active actors on pipe
2025-09-30T14:51:37.425152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:37.425152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:37.425167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:37.425187Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:37.425223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 500 reason: error at write: Disconnected sessionId: src_id|b12c1790-d577c764-6fc89789-2aa3a8fa_0
2025-09-30T14:51:37.425249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895005319445000:4849]
2025-09-30T14:51:37.425403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 500 sessionId: src_id|b12c1790-d577c764-6fc89789-2aa3a8fa_0 is DEAD
2025-09-30T14:51:37.425575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b12c1790-d577c764-6fc89789-2aa3a8fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:37.425584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b12c1790-d577c764-6fc89789-2aa3a8fa_0] Write session will restart in 0.009532s
2025-09-30T14:51:37.425600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b12c1790-d577c764-6fc89789-2aa3a8fa_0] Write session: Do CDS request
2025-09-30T14:51:37.425606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b12c1790-d577c764-6fc89789-2aa3a8fa_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:37.432792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:37.434233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:37.434406Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:37.434414Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:37.434422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:37.434468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:37.434508Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895005229718305:4573]
2025-09-30T14:51:37.434930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:37.435195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:37.435232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:37.435465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:37.435501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:37.435506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:37.435507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:37.435507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:37.435508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:37.435509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:37.435509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:37.435510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:37.435510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:37.435511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:37.435512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.435512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.435513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.435513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:37.435514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:37.435518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:37.435523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:37.435526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:37.435528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:37.435530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:37.435533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:37.435535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:37.435538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:37.435540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:37.435543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:37.435545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.435547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.435550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.435552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:37.435554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:37.435560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:37.435565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:37.435569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:37.435572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:37.435575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:37.435578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:37.435580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:37.435583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:37.435585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:37.435588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:37.435590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:37.435593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:37.435595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:37.435598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:37.435601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:37.435603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:37.435606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:37.435609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:37.435611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:37.435614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:37.435617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.435619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.435623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.435625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.435628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.435631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.435633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:37.435636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:37.435639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:37.435642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:37.435664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:37.436820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b12c1790-d577c764-6fc89789-2aa3a8fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:37.436873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:37.436888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 501
2025-09-30T14:51:37.437059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 501 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:37.437093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 501 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:37.437103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=501 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:37.437107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:37.437460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 501 sessionId:  describe result for acl check
2025-09-30T14:51:37.437490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:37.437496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:37.437498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:37.437503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895005319445053:5406] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:37.437934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895005319445053:5406] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:37.439587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895005319445053:5406] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:37.440946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:37.441811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:37.441821Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:37.441823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:37.441826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:37.441830Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 500 [2:7555895005229718305:4573]
2025-09-30T14:51:37.441841Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:37.441853Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:37.441858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.441860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.441862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.441872Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:37.441876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:37.441884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:37.441925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.441930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.441931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.441934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:37.441937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:37.441994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:37.442004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.442011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.442017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.442026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:37.442039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895005319445001:2454], now have 1 active actors on pipe
2025-09-30T14:51:37.442048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895005229718300:4573]
2025-09-30T14:51:37.442049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895005229718300:4573]
2025-09-30T14:51:37.442052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895005229718300:4573]
2025-09-30T14:51:37.442060Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:37.442073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:37.442085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:37.442090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:37.442111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895005229718300:4573]
2025-09-30T14:51:37.442116Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:37.442127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:37.442140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:37.442168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895005319445053:5406] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:37.442153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:37.442184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895005319445053:5406] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:37.442187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895005319445053:5406] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:37.442158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:37.442193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 501 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:37.442404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895005319445093:5406], now have 1 active actors on pipe
2025-09-30T14:51:37.442500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 500
2025-09-30T14:51:37.442539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 500
2025-09-30T14:51:37.442554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:37.442569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:37.442596Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31103261-85c6bf95-8fed08bd-7268b8d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:37.442608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.442612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.442619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:37.442629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.442642Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:37.442689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:37.442835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:37.442843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:37.442853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:37.442916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 501 partition: 0 MaxSeqNo: 42 sessionId: src_id|31103261-85c6bf95-8fed08bd-7268b8d5_0
2025-09-30T14:51:37.443305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b12c1790-d577c764-6fc89789-2aa3a8fa_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|31103261-85c6bf95-8fed08bd-7268b8d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:37.445968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31103261-85c6bf95-8fed08bd-7268b8d5_0] Write session: try to update token
2025-09-30T14:51:37.445983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31103261-85c6bf95-8fed08bd-7268b8d5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:37.457636Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:37.457650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:37.457660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895005229718300:4573]
2025-09-30T14:51:37.457702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:37.457704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:37.457888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:37.458019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:37.458137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:37.458314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:37.458578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:37.458621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:37.463877Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:37.463897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:37.463898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:37.463900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:37.463906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895005229718300:4573]
2025-09-30T14:51:37.463908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895005229718300:4573]
2025-09-30T14:51:37.463910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895005229718300:4573]
2025-09-30T14:51:37.463937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:37.463942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.463941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:37.463944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:37.463945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:37.463948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:37.464034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 501 sessionId: src_id|31103261-85c6bf95-8fed08bd-7268b8d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:37.464060Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:37.466506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:37.525416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895005319445113:4849]
2025-09-30T14:51:37.525677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 500, pipe: [1:7555895005319445113:4849]
2025-09-30T14:51:37.566248Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:37.567010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:37.567027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:37.567043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895005319445113:4849], now have 1 active actors on pipe
2025-09-30T14:51:37.567288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895005319445113:4849]
2025-09-30T14:51:37.567297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:37.567301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:37.567317Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:51:37.567360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 501 reason: error at write: Disconnected sessionId: src_id|31103261-85c6bf95-8fed08bd-7268b8d5_0
2025-09-30T14:51:37.567432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 501 sessionId: src_id|31103261-85c6bf95-8fed08bd-7268b8d5_0 is DEAD
2025-09-30T14:51:37.567532Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 5 consumer shared/user session shared/user_1_5_3410337129664790492_v1 is DEAD
2025-09-30T14:51:37.567526Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:37.567549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:37.567664Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:51:37.567704Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:51:37.567707Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:51:37.567715Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.008328s
2025-09-30T14:51:37.567702Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894940894912116:4844] disconnected; active server actors: 1
2025-09-30T14:51:37.567714Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894940894912116:4844] client user disconnected session shared/user_1_5_3410337129664790492_v1
2025-09-30T14:51:37.567743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31103261-85c6bf95-8fed08bd-7268b8d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:37.567755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31103261-85c6bf95-8fed08bd-7268b8d5_0] Write session will restart in 0.009443s
2025-09-30T14:51:37.567779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31103261-85c6bf95-8fed08bd-7268b8d5_0] Write session: Do CDS request
2025-09-30T14:51:37.567785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31103261-85c6bf95-8fed08bd-7268b8d5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:37.574829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:37.576414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:37.576551Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:37.576560Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:37.576570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:37.576605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:37.576641Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895005229718410:4586]
2025-09-30T14:51:37.576679Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:51:37.576940Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:51:37.576953Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 6
2025-09-30T14:51:37.577137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:37.577152Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 6 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:51:37.577204Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:51:37.577298Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 auth for : user
2025-09-30T14:51:37.577390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:37.577435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:37.577438Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 Handle describe topics response
2025-09-30T14:51:37.577470Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 auth is DEAD
2025-09-30T14:51:37.577478Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:51:37.577722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:37.577721Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:51:37.577779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:37.577785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:37.577785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:37.577786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:37.577787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:37.577788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:37.577797Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_6_16524020304425833425_v1
2025-09-30T14:51:37.577789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:37.577789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:37.577790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:37.577791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:37.577792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.577792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.577800Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895005319445159:5416] connected; active server actors: 1
2025-09-30T14:51:37.577814Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555895005319445159:5416] session shared/user_1_6_16524020304425833425_v1
2025-09-30T14:51:37.577793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.577821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:51:37.577832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:51:37.577838Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_6_16524020304425833425_v1" (Sender=[1:7555895005319445154:5416], Pipe=[1:7555895005319445159:5416], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:51:37.577841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:51:37.577851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:51:37.577794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:37.577861Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_6_16524020304425833425_v1" (Sender=[1:7555895005319445154:5416], Pipe=[1:7555895005319445159:5416], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:51:37.577872Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_6_16524020304425833425_v1" sender [1:7555895005319445154:5416] lock partition 0 for ReadingSession "shared/user_1_6_16524020304425833425_v1" (Sender=[1:7555895005319445154:5416], Pipe=[1:7555895005319445159:5416], Partitions=[], ActiveFamilyCount=1) generation 1 step 6
2025-09-30T14:51:37.577794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:37.577798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:37.577883Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:51:37.577806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:37.577810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:37.577814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:37.577887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000034s
2025-09-30T14:51:37.577818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:37.577822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:37.577825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:37.577829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:37.577833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:37.577837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:37.577844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.577848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.577852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.577856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:37.577860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:37.577867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:37.577875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:37.577881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:37.577886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:37.577890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:37.577895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:37.577900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:37.577905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:37.577910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:37.577916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:37.577919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:37.577922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:37.577924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:37.577927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:37.577930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:37.577932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:37.577935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:37.577938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:37.577940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:37.577943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:37.577945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.577948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.577950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.577953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.577957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.577960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.577963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:37.577966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:37.577968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:37.577971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:37.577994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:37.578091Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 6 Session: "shared/user_1_6_16524020304425833425_v1" ClientId: "user" PipeClient { RawX1: 7555895005319445159 RawX2: 4503603922343208 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:51:37.578117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:51:37.578627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31103261-85c6bf95-8fed08bd-7268b8d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:37.578661Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:37.578669Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 502
2025-09-30T14:51:37.578835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 502 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:37.578862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 502 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:37.578873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=502 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:37.578877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:37.579260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 502 sessionId:  describe result for acl check
2025-09-30T14:51:37.579292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:37.579300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:37.579302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:37.579307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895005319445168:5420] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:37.579852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895005319445168:5420] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:37.581426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895005319445168:5420] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:37.583059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:37.584086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:37.584099Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:37.584101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:37.584105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:37.584110Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 501 [2:7555895005229718410:4586]
2025-09-30T14:51:37.584123Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:37.584137Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:37.584146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.584149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.584151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.584166Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:37.584173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:37.584184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:37.584236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.584243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.584245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.584248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:37.584251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:37.584310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:37.584317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.584328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.584344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.584367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:37.584388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895005319445162:5419], now have 1 active actors on pipe
2025-09-30T14:51:37.584396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895005319445114:2454], now have 1 active actors on pipe
2025-09-30T14:51:37.584368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895005319445168:5420] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:37.584401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895005229718405:4586]
2025-09-30T14:51:37.584408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895005229718405:4586]
2025-09-30T14:51:37.584383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895005319445168:5420] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:37.584410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895005229718405:4586]
2025-09-30T14:51:37.584387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895005319445168:5420] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:37.584394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 502 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:37.584421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:37.584432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:37.584439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:37.584440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:37.584442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:37.584453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:37.584434Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 501
2025-09-30T14:51:37.584486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 501, pipe: [1:7555895005319445162:5419]
2025-09-30T14:51:37.584456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:37.584483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895005229718405:4586]
2025-09-30T14:51:37.584486Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:37.584488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:37.584542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:37.584550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:37.584560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_6_16524020304425833425_v1 on pipe: [1:7555895005319445162:5419]
2025-09-30T14:51:37.584585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895005319445201:5420], now have 1 active actors on pipe
2025-09-30T14:51:37.584596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.584607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.584613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:37.584597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 501
2025-09-30T14:51:37.584626Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_6_16524020304425833425_v1
2025-09-30T14:51:37.584633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.584653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:37.584660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:37.584665Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:37.584682Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb671f8-9290b345-46e35926-175d57f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:37.584691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:37.584732Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_6_16524020304425833425_v1:1 with generation 501
2025-09-30T14:51:37.588882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:37.588914Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:37.588936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.588945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.588950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:37.588965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.588980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:37.588988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:51:37.588999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:51:37.589028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:37.589190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:37.589200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:37.589217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:37.589177Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759243897583 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:51:37.589197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:51:37.589229Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 sending to client partition status
2025-09-30T14:51:37.589298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 502 partition: 0 MaxSeqNo: 42 sessionId: src_id|bb671f8-9290b345-46e35926-175d57f7_0
2025-09-30T14:51:37.589721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31103261-85c6bf95-8fed08bd-7268b8d5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bb671f8-9290b345-46e35926-175d57f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:37.592519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb671f8-9290b345-46e35926-175d57f7_0] Write session: try to update token
2025-09-30T14:51:37.592537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb671f8-9290b345-46e35926-175d57f7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:37.596312Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:37.596331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:37.596333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:37.596336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:37.596348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895005229718405:4586]
2025-09-30T14:51:37.596351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895005229718405:4586]
2025-09-30T14:51:37.596355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895005229718405:4586]
2025-09-30T14:51:37.596393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:37.596403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.596408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:37.596411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:37.596417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:37.596423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:37.596549Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:37.606576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 502 sessionId: src_id|bb671f8-9290b345-46e35926-175d57f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:37.609199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:37.701693Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:37.701977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:37.701991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:37.702163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_6_16524020304425833425_v1
2025-09-30T14:51:37.702177Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:37.702199Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_6_16524020304425833425_v1
2025-09-30T14:51:37.702234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895005319445162:5419]
2025-09-30T14:51:37.702273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:37.702547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:37.702609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 502 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bb671f8-9290b345-46e35926-175d57f7_0
2025-09-30T14:51:37.702788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 502 sessionId: src_id|bb671f8-9290b345-46e35926-175d57f7_0 is DEAD
2025-09-30T14:51:37.702956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb671f8-9290b345-46e35926-175d57f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:37.702965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb671f8-9290b345-46e35926-175d57f7_0] Write session will restart in 0.009964s
2025-09-30T14:51:37.702987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb671f8-9290b345-46e35926-175d57f7_0] Write session: Do CDS request
2025-09-30T14:51:37.702996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb671f8-9290b345-46e35926-175d57f7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:37.709405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:37.710885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:37.711057Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:37.711068Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:37.711079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:37.711126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:37.711169Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895005229718495:4588]
2025-09-30T14:51:37.711694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:37.711962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:37.711997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:37.712261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:37.712318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:37.712324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:37.712325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:37.712326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:37.712328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:37.712329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:37.712330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:37.712332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:37.712333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:37.712334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:37.712335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.712336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.712337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.712338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:37.712340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:37.712344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:37.712355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:37.712360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:37.712364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:37.712368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:37.712372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:37.712376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:37.712380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:37.712384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:37.712389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:37.712393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.712402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.712406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.712410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:37.712414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:37.712424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:37.712436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:37.712445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:37.712449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:37.712455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:37.712459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:37.712461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:37.712464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:37.712470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:37.712475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:37.712477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:37.712480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:37.712483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:37.712486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:37.712489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:37.712492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:37.712494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:37.712497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:37.712499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:37.712502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:37.712505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.712508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.712510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.712513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.712515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.712522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.712524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:37.712528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:37.712534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:37.712537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:37.712562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:37.713673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb671f8-9290b345-46e35926-175d57f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:37.713794Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:37.713807Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 503
2025-09-30T14:51:37.713916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 503 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:37.713939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 503 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:37.713949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=503 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:37.713954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:37.714351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 503 sessionId:  describe result for acl check
2025-09-30T14:51:37.714384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:37.714389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:37.714390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:37.714394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895005319445259:5424] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:37.714860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895005319445259:5424] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:37.716721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895005319445259:5424] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:37.717565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:37.718442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:37.718456Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:37.718459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:37.718462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:37.718467Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 502 [2:7555895005229718495:4588]
2025-09-30T14:51:37.718493Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:37.718512Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:37.718519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.718522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.718525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.718538Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:37.718550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:37.718554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:37.718597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.718604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.718605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.718607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:37.718608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:37.718651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:37.718656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.718663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.718673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.718686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:37.718702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895005319445211:2454], now have 1 active actors on pipe
2025-09-30T14:51:37.718712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895005229718490:4588]
2025-09-30T14:51:37.718713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895005229718490:4588]
2025-09-30T14:51:37.718714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895005229718490:4588]
2025-09-30T14:51:37.718725Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:37.718735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:37.718743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:37.718749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:37.718752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:37.718753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:37.718755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:37.718775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895005229718490:4588]
2025-09-30T14:51:37.718782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:37.718760Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 502
2025-09-30T14:51:37.718790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:37.719071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895005319445259:5424] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:37.719080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895005319445259:5424] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:37.719082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895005319445259:5424] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:37.719087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 503 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:37.719240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895005319445294:5424], now have 1 active actors on pipe
2025-09-30T14:51:37.719297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 502
2025-09-30T14:51:37.720021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:37.720040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:37.720065Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fcbaa6ac-c1734838-5db9d249-d40df346_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:37.720080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.720087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.720089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:37.720099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.720115Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:37.720128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:37.720305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:37.720316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:37.720343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:37.720430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 503 partition: 0 MaxSeqNo: 42 sessionId: src_id|fcbaa6ac-c1734838-5db9d249-d40df346_0
2025-09-30T14:51:37.720735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb671f8-9290b345-46e35926-175d57f7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fcbaa6ac-c1734838-5db9d249-d40df346_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:37.723620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcbaa6ac-c1734838-5db9d249-d40df346_0] Write session: try to update token
2025-09-30T14:51:37.723639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcbaa6ac-c1734838-5db9d249-d40df346_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:37.730139Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:37.730159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:37.730167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895005229718490:4588]
2025-09-30T14:51:37.730203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:37.730217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:37.730360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:37.730501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:37.730624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:37.730745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:37.730917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:37.730949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:37.737730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 503 sessionId: src_id|fcbaa6ac-c1734838-5db9d249-d40df346_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:37.740112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:37.740666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:37.740684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:37.740699Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:37.740701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:37.740703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:37.740704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:37.740710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895005229718490:4588]
2025-09-30T14:51:37.740713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895005229718490:4588]
2025-09-30T14:51:37.740719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895005229718490:4588]
2025-09-30T14:51:37.740749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:37.740756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:37.740761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:37.740761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.740763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:37.740765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:37.740880Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:37.802397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895005319445301:5419]
2025-09-30T14:51:37.802692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 502, pipe: [1:7555895005319445301:5419]
2025-09-30T14:51:37.841043Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:37.841327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:37.841355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895005319445301:5419], now have 1 active actors on pipe
2025-09-30T14:51:37.841480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:37.841584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:37.841592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:37.841653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 503 reason: error at write: Disconnected sessionId: src_id|fcbaa6ac-c1734838-5db9d249-d40df346_0
2025-09-30T14:51:37.841707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895005319445301:5419]
2025-09-30T14:51:37.841744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:37.841822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 503 sessionId: src_id|fcbaa6ac-c1734838-5db9d249-d40df346_0 is DEAD
2025-09-30T14:51:37.841948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcbaa6ac-c1734838-5db9d249-d40df346_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:37.841959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcbaa6ac-c1734838-5db9d249-d40df346_0] Write session will restart in 0.007210s
2025-09-30T14:51:37.841992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcbaa6ac-c1734838-5db9d249-d40df346_0] Write session: Do CDS request
2025-09-30T14:51:37.841998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcbaa6ac-c1734838-5db9d249-d40df346_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:37.849140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:37.850525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:37.850665Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:37.850672Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:37.850679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:37.850710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcbaa6ac-c1734838-5db9d249-d40df346_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:37.850713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:37.850746Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895005229718591:4591]
2025-09-30T14:51:37.850793Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:37.850806Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 504
2025-09-30T14:51:37.850913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 504 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:37.850942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 504 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:37.850951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=504 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:37.850955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:37.851201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:37.851338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 504 sessionId:  describe result for acl check
2025-09-30T14:51:37.851374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:37.851377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:37.851378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:37.851384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895005319445346:5428] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:37.851512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:37.851544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:37.851824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:37.851877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:37.851883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:37.851884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:37.851885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:37.851886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:37.851887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:37.851888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:37.851889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:37.851895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895005319445346:5428] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:37.851890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:37.851891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:37.851904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.851905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.851906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.851907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:37.851907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:37.851911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:37.851917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:37.851919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:37.851922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:37.851926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:37.851929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:37.851931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:37.851933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:37.851935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:37.851938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:37.851940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.851942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.851944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.851947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:37.851949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:37.851954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:37.851959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:37.851962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:37.851966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:37.851968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:37.851971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:37.851974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:37.851977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:37.851979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:37.851982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:37.851984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:37.851987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:37.851991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:37.851994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:37.851996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:37.851998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:37.852001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:37.852004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:37.852006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:37.852009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:37.852011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.852014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.852016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.852019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.852021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.852024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.852026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:37.852029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:37.852031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:37.852033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:37.852056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:37.853599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895005319445346:5428] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:37.856869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895005319445346:5428] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:37.856888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895005319445346:5428] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:37.856890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895005319445346:5428] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:37.856896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 504 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:37.857300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:37.858236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:37.858256Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:37.858258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:37.858264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:37.858270Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 503 [2:7555895005229718591:4591]
2025-09-30T14:51:37.858288Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:37.858306Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:37.858313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.858316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.858319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.858336Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:37.858347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:37.858358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:37.858415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.858423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.858425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.858429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:37.858432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:37.858505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:37.858514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.858526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.858544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.858581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:37.858602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895005319445302:2454], now have 1 active actors on pipe
2025-09-30T14:51:37.858610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895005319445384:5428], now have 1 active actors on pipe
2025-09-30T14:51:37.858616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895005229718586:4591]
2025-09-30T14:51:37.858622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895005229718586:4591]
2025-09-30T14:51:37.858625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895005229718586:4591]
2025-09-30T14:51:37.858638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:37.858623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 503
2025-09-30T14:51:37.858633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 503
2025-09-30T14:51:37.858656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:37.858660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:37.858664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:37.858666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:37.858676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:37.858679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:37.858723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:37.858728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:37.858739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895005229718586:4591]
2025-09-30T14:51:37.858753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:37.858778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:37.858784Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ae814f6-67668adc-66167d6a-d26b26b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:37.858791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.858794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.858796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:37.858804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.858813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:37.858838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:37.858963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:37.858970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:37.858985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:37.859088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 504 partition: 0 MaxSeqNo: 42 sessionId: src_id|7ae814f6-67668adc-66167d6a-d26b26b2_0
2025-09-30T14:51:37.859423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcbaa6ac-c1734838-5db9d249-d40df346_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7ae814f6-67668adc-66167d6a-d26b26b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:37.861937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ae814f6-67668adc-66167d6a-d26b26b2_0] Write session: try to update token
2025-09-30T14:51:37.861950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ae814f6-67668adc-66167d6a-d26b26b2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:37.870348Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:37.870379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:37.870383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:37.870384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:37.870393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895005229718586:4591]
2025-09-30T14:51:37.870397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895005229718586:4591]
2025-09-30T14:51:37.870402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895005229718586:4591]
2025-09-30T14:51:37.870456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:37.870461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:37.870467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:37.870467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.870482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:37.870485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:37.870708Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:37.875415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 504 sessionId: src_id|7ae814f6-67668adc-66167d6a-d26b26b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:37.878316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:37.941690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895005319445403:5419]
2025-09-30T14:51:37.941913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 503, pipe: [1:7555895005319445403:5419]
2025-09-30T14:51:37.975367Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:37.975626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:37.975640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:37.975673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895005319445403:5419], now have 1 active actors on pipe
2025-09-30T14:51:37.975871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:37.975907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895005319445403:5419]
2025-09-30T14:51:37.975909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:37.975911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:37.975970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 504 reason: error at write: Disconnected sessionId: src_id|7ae814f6-67668adc-66167d6a-d26b26b2_0
2025-09-30T14:51:37.975991Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:37.976140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 504 sessionId: src_id|7ae814f6-67668adc-66167d6a-d26b26b2_0 is DEAD
2025-09-30T14:51:37.976310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ae814f6-67668adc-66167d6a-d26b26b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:37.976321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ae814f6-67668adc-66167d6a-d26b26b2_0] Write session will restart in 0.007142s
2025-09-30T14:51:37.976343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ae814f6-67668adc-66167d6a-d26b26b2_0] Write session: Do CDS request
2025-09-30T14:51:37.976349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ae814f6-67668adc-66167d6a-d26b26b2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:37.983462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:37.984714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ae814f6-67668adc-66167d6a-d26b26b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:37.984811Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:37.984826Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 505
2025-09-30T14:51:37.984953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 505 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:37.984978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 505 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:37.984982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=505 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:37.984985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:37.985116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:37.985269Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:37.985276Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:37.985284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:37.985323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:37.985324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 505 sessionId:  describe result for acl check
2025-09-30T14:51:37.985354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:37.985360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:37.985362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:37.985364Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895005229718674:4593]
2025-09-30T14:51:37.985365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895005319445457:5435] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:37.985751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895005319445457:5435] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:37.985792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:37.986047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:37.986080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:37.986293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:37.986331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:37.986336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:37.986338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:37.986339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:37.986340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:37.986343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:37.986345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:37.986346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:37.986347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:37.986348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:37.986349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.986350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.986351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.986352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:37.986353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:37.986358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:37.986367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:37.986371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:37.986375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:37.986378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:37.986382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:37.986385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:37.986388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:37.986392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:37.986396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:37.986399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.986403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.986406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.986410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:37.986414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:37.986421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:37.986425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:37.986429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:37.986432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:37.986435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:37.986437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:37.986441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:37.986444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:37.986447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:37.986450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:37.986452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:37.986456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:37.986458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:37.986461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:37.986464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:37.986467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:37.986483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:37.986486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:37.986488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:37.986491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:37.986495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.986497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.986500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.986502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.986505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.986508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.986510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:37.986513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:37.986515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:37.986518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:37.986542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:37.987237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895005319445457:5435] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:37.991110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895005319445457:5435] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:37.991124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895005319445457:5435] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:37.991126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895005319445457:5435] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:37.991132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 505 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:37.991462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:37.992309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:37.992322Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:37.992324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:37.992328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:37.992334Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 504 [2:7555895005229718674:4593]
2025-09-30T14:51:37.992346Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:37.992360Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:37.992366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.992368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.992369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.992380Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:37.992384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:37.992389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:37.992425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.992431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.992432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.992434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:37.992435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:37.992496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:37.992503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:37.992515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:37.992530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:37.992550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:37.992583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895005319445412:2454], now have 1 active actors on pipe
2025-09-30T14:51:37.992591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895005319445495:5435], now have 1 active actors on pipe
2025-09-30T14:51:37.992598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895005229718669:4593]
2025-09-30T14:51:37.992603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895005229718669:4593]
2025-09-30T14:51:37.992604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895005229718669:4593]
2025-09-30T14:51:37.992616Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:37.992634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:37.992636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:37.992623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 504
2025-09-30T14:51:37.992639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:37.992633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 504
2025-09-30T14:51:37.992641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:37.992652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:37.992658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:37.992693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:37.992701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:37.992709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895005229718669:4593]
2025-09-30T14:51:37.992715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:37.992726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:37.992742Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c39cd95-bdf16fe2-d36d6257-6b1894ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:37.992753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.992759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.992761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:37.992771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.992783Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:37.992804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:37.992942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:37.992949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:37.992961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:37.993042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 505 partition: 0 MaxSeqNo: 42 sessionId: src_id|3c39cd95-bdf16fe2-d36d6257-6b1894ae_0
2025-09-30T14:51:37.993366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ae814f6-67668adc-66167d6a-d26b26b2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3c39cd95-bdf16fe2-d36d6257-6b1894ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:37.996080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c39cd95-bdf16fe2-d36d6257-6b1894ae_0] Write session: try to update token
2025-09-30T14:51:37.996098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c39cd95-bdf16fe2-d36d6257-6b1894ae_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:38.004666Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:38.004687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:38.004690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:38.004694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:38.004704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895005229718669:4593]
2025-09-30T14:51:38.004708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895005229718669:4593]
2025-09-30T14:51:38.004712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895005229718669:4593]
2025-09-30T14:51:38.004753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:38.004766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.004771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:38.004773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:38.004777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:38.004784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:38.004908Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:38.011015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 505 sessionId: src_id|3c39cd95-bdf16fe2-d36d6257-6b1894ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:38.013442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:38.075842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895009614412805:5419]
2025-09-30T14:51:38.076059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 504, pipe: [1:7555895009614412805:5419]
2025-09-30T14:51:38.109151Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:38.109393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:38.109406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:38.109440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895009614412805:5419], now have 1 active actors on pipe
2025-09-30T14:51:38.109605Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:38.109706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895009614412805:5419]
2025-09-30T14:51:38.109706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:38.109712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:38.109739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:38.109772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 505 reason: error at write: Disconnected sessionId: src_id|3c39cd95-bdf16fe2-d36d6257-6b1894ae_0
2025-09-30T14:51:38.109983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 505 sessionId: src_id|3c39cd95-bdf16fe2-d36d6257-6b1894ae_0 is DEAD
2025-09-30T14:51:38.110140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c39cd95-bdf16fe2-d36d6257-6b1894ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:38.110147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c39cd95-bdf16fe2-d36d6257-6b1894ae_0] Write session will restart in 0.005446s
2025-09-30T14:51:38.110167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c39cd95-bdf16fe2-d36d6257-6b1894ae_0] Write session: Do CDS request
2025-09-30T14:51:38.110170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c39cd95-bdf16fe2-d36d6257-6b1894ae_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:38.116708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c39cd95-bdf16fe2-d36d6257-6b1894ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:38.116812Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:38.116822Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 506
2025-09-30T14:51:38.116939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 506 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:38.116963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 506 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:38.116967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=506 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:38.116970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:38.117291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 506 sessionId:  describe result for acl check
2025-09-30T14:51:38.117318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:38.117319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:38.117320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:38.117324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895009614412851:5441] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:38.117589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:38.117738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895009614412851:5441] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:38.119196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:38.119361Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:38.119369Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:38.119378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:38.119420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:38.119447Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895009524686056:4596]
2025-09-30T14:51:38.119589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895009614412851:5441] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:38.119920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:38.120139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:38.120168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:38.120395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:38.120444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:38.120451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:38.120452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:38.120455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:38.120457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:38.120458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:38.120459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:38.120460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:38.120462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:38.120463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:38.120464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.120466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.120466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.120467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:38.120468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:38.120471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:38.120478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:38.120480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:38.120482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:38.120485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:38.120487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:38.120489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:38.120491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:38.120494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:38.120496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:38.120498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.120501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.120503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.120505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:38.120507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:38.120513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:38.120518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:38.120531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:38.120538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:38.120543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:38.120549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:38.120552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:38.120555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:38.120562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:38.120565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:38.120568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:38.120571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:38.120577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:38.120580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:38.120582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:38.120586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:38.120588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:38.120591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:38.120594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:38.120597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:38.120600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.120603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.120606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.120609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.120611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.120615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.120617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:38.120620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:38.120626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:38.120629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:38.120659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:38.123422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895009614412851:5441] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:38.123436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895009614412851:5441] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:38.123439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895009614412851:5441] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:38.123447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 506 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:38.126256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:38.127128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:38.127139Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:38.127141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:38.127144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:38.127148Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 505 [2:7555895009524686056:4596]
2025-09-30T14:51:38.127163Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:38.127177Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:38.127183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.127185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.127186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.127194Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:38.127202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:38.127207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:38.127269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.127276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.127277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.127279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:38.127281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:38.127386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:38.127394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.127402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.127410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.127420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:38.127434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895009614412806:2454], now have 1 active actors on pipe
2025-09-30T14:51:38.127441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895009614412891:5441], now have 1 active actors on pipe
2025-09-30T14:51:38.127445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895009524686051:4596]
2025-09-30T14:51:38.127447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895009524686051:4596]
2025-09-30T14:51:38.127448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895009524686051:4596]
2025-09-30T14:51:38.127458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:38.127444Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 505
2025-09-30T14:51:38.127471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:38.127480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:38.127480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:38.127482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:38.127483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:38.127485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:38.127510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895009524686051:4596]
2025-09-30T14:51:38.127515Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:38.127509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 505
2025-09-30T14:51:38.127524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:38.127541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:38.127545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:38.127564Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18596295-6629aa0d-dc8b844-ea5c6178_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:38.127573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.127577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.127579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:38.127585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.127596Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:38.127605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:38.127746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:38.127758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:38.127778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:38.127869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 506 partition: 0 MaxSeqNo: 42 sessionId: src_id|18596295-6629aa0d-dc8b844-ea5c6178_0
2025-09-30T14:51:38.128210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c39cd95-bdf16fe2-d36d6257-6b1894ae_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|18596295-6629aa0d-dc8b844-ea5c6178_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:38.130856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18596295-6629aa0d-dc8b844-ea5c6178_0] Write session: try to update token
2025-09-30T14:51:38.130871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18596295-6629aa0d-dc8b844-ea5c6178_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:38.138837Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:38.138855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:38.138864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895009524686051:4596]
2025-09-30T14:51:38.138902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:38.138903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:38.139103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:38.139263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:38.139398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:38.139571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:38.139754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:38.139795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:38.145188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 506 sessionId: src_id|18596295-6629aa0d-dc8b844-ea5c6178_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:38.148125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:38.148305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:38.148327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:38.149484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:38.149521Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:38.149524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:38.149525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:38.149526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:38.149533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895009524686051:4596]
2025-09-30T14:51:38.149536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895009524686051:4596]
2025-09-30T14:51:38.149539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895009524686051:4596]
2025-09-30T14:51:38.149562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:38.149564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:38.149568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.149569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:38.149569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:38.149572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:38.149623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:38.149730Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:38.209984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895009614412899:5419]
2025-09-30T14:51:38.210229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 505, pipe: [1:7555895009614412899:5419]
2025-09-30T14:51:38.253237Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:38.259865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:38.259889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:38.260040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:38.260099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:38.260160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:38.260222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:38.260266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:38.260274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:38.260339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:38.260394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:38.260489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:38.260575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:38.260618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:38.260621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:38.260681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:38.260740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:38.260797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:38.260883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:38.260924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:38.260930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:38.260991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:38.261101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:38.261161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:38.261218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:38.261260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:38.261265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:38.261328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:38.261385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:38.261455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:38.261512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:38.261572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:38.261579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:38.261639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:38.261694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:38.261754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:38.261811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:38.261864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:38.261871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:38.261931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:38.261986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:38.262063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:38.262127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:38.262182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:38.262188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:38.262250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:38.262311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:38.262369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:38.262427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:38.262497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:38.262502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:38.262563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:38.262618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:38.262676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:38.262730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:38.262770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:38.262775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:38.262835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:38.262891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:38.262950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:38.263012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:38.263062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:38.263069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:38.263114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895009614412899:5419], now have 1 active actors on pipe
2025-09-30T14:51:38.263317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:38.263359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:38.263363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:38.263383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895009614412899:5419]
2025-09-30T14:51:38.263395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 506 reason: error at write: Disconnected sessionId: src_id|18596295-6629aa0d-dc8b844-ea5c6178_0
2025-09-30T14:51:38.263590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 506 sessionId: src_id|18596295-6629aa0d-dc8b844-ea5c6178_0 is DEAD
2025-09-30T14:51:38.263747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18596295-6629aa0d-dc8b844-ea5c6178_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:38.263756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18596295-6629aa0d-dc8b844-ea5c6178_0] Write session will restart in 0.005272s
2025-09-30T14:51:38.263781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18596295-6629aa0d-dc8b844-ea5c6178_0] Write session: Do CDS request
2025-09-30T14:51:38.263787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18596295-6629aa0d-dc8b844-ea5c6178_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:38.264011Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:38.269797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18596295-6629aa0d-dc8b844-ea5c6178_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:38.269853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:38.269868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 507
2025-09-30T14:51:38.270021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 507 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:38.270053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 507 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:38.270066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=507 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:38.270070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:38.270551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 507 sessionId:  describe result for acl check
2025-09-30T14:51:38.270597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:38.270604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:38.270606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:38.270612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895009614412919:5445] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:38.271159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895009614412919:5445] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:38.272597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:38.273727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895009614412919:5445] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:38.274495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:38.274664Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:38.274672Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:38.274679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:38.274714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:38.274743Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895009524686142:4598]
2025-09-30T14:51:38.275180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:38.275423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:38.275450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:38.275652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:38.275688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:38.275693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:38.275693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:38.275694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:38.275695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:38.275696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:38.275696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:38.275697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:38.275698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:38.275699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:38.275699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.275700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.275701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.275701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:38.275704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:38.275707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:38.275714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:38.275716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:38.275718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:38.275721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:38.275723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:38.275725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:38.275727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:38.275730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:38.275732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:38.275734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.275736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.275738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.275741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:38.275743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:38.275747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:38.275752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:38.275756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:38.275759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:38.275761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:38.275765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:38.275768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:38.275771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:38.275773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:38.275776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:38.275779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:38.275782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:38.275785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:38.275788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:38.275790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:38.275794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:38.275797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:38.275800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:38.275802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:38.275805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:38.275808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.275811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.275813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.275817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.275820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.275822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.275825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:38.275828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:38.275830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:38.275833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:38.275857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:38.276009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895009614412919:5445] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:38.276022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895009614412919:5445] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:38.276026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895009614412919:5445] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:38.276033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 507 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:38.280907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:38.281722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:38.281740Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:38.281742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:38.281745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:38.281751Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 506 [2:7555895009524686142:4598]
2025-09-30T14:51:38.281765Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:38.281779Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:38.281782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.281784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.281786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.281798Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:38.281803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:38.281809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:38.281857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.281861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.281862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.281865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:38.281867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:38.281919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:38.281925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.281933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.281939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.281949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:38.281965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895009524686137:4598]
2025-09-30T14:51:38.281971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895009524686137:4598]
2025-09-30T14:51:38.281972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895009524686137:4598]
2025-09-30T14:51:38.281979Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:38.281989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:38.281992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895009614412900:2454], now have 1 active actors on pipe
2025-09-30T14:51:38.281995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:38.281996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:38.281997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:38.282006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:38.282008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:38.282011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895009614412986:5445], now have 1 active actors on pipe
2025-09-30T14:51:38.282034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895009524686137:4598]
2025-09-30T14:51:38.282043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:38.282064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:38.282053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 506
2025-09-30T14:51:38.282060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 506
2025-09-30T14:51:38.282126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:38.282133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:38.282152Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3696d41f-5f7f3ec0-6c82f950-e5e494f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:38.282160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.282163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.282165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:38.282172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.282179Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:38.282190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:38.282343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:38.282355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:38.282380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:38.282452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 507 partition: 0 MaxSeqNo: 42 sessionId: src_id|3696d41f-5f7f3ec0-6c82f950-e5e494f8_0
2025-09-30T14:51:38.282804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18596295-6629aa0d-dc8b844-ea5c6178_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3696d41f-5f7f3ec0-6c82f950-e5e494f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:38.285340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3696d41f-5f7f3ec0-6c82f950-e5e494f8_0] Write session: try to update token
2025-09-30T14:51:38.285356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3696d41f-5f7f3ec0-6c82f950-e5e494f8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:38.293744Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:38.293765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:38.293768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:38.293770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:38.293780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895009524686137:4598]
2025-09-30T14:51:38.293786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895009524686137:4598]
2025-09-30T14:51:38.293793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895009524686137:4598]
2025-09-30T14:51:38.293831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:38.293839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.293841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:38.293849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:38.293856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:38.293860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:38.293991Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:38.299512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 507 sessionId: src_id|3696d41f-5f7f3ec0-6c82f950-e5e494f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:38.302023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:38.363580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895009614412994:5419]
2025-09-30T14:51:38.363859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 506, pipe: [1:7555895009614412994:5419]
2025-09-30T14:51:38.397079Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:38.397460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:38.397473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:38.397512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895009614412994:5419], now have 1 active actors on pipe
2025-09-30T14:51:38.397680Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:38.397715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:38.397726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895009614412994:5419]
2025-09-30T14:51:38.397730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:38.397746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:38.397794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 507 reason: error at write: Disconnected sessionId: src_id|3696d41f-5f7f3ec0-6c82f950-e5e494f8_0
2025-09-30T14:51:38.397969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 507 sessionId: src_id|3696d41f-5f7f3ec0-6c82f950-e5e494f8_0 is DEAD
2025-09-30T14:51:38.398102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3696d41f-5f7f3ec0-6c82f950-e5e494f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:38.398111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3696d41f-5f7f3ec0-6c82f950-e5e494f8_0] Write session will restart in 0.008199s
2025-09-30T14:51:38.398128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3696d41f-5f7f3ec0-6c82f950-e5e494f8_0] Write session: Do CDS request
2025-09-30T14:51:38.398132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3696d41f-5f7f3ec0-6c82f950-e5e494f8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:38.405761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:38.407576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:38.407715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3696d41f-5f7f3ec0-6c82f950-e5e494f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:38.407738Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:38.407746Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:38.407754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:38.407789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:38.407836Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895009524686228:4600]
2025-09-30T14:51:38.407834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:38.407847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 508
2025-09-30T14:51:38.407960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 508 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:38.407982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 508 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:38.407989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=508 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:38.407992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:38.408296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:38.408424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 508 sessionId:  describe result for acl check
2025-09-30T14:51:38.408460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:38.408462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:38.408464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:38.408470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895009614413044:5449] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:38.408565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:38.408599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:38.408808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:38.408845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:38.408850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:38.408850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:38.408851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:38.408852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:38.408852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:38.408853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:38.408854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:38.408856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:38.408857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:38.408857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.408858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.408858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.408859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:38.408859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:38.408863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:38.408868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:38.408871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:38.408873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:38.408875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:38.408878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:38.408880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:38.408882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:38.408885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:38.408887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:38.408889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.408891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.408893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.408895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:38.408906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:38.408911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:38.408916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:38.408919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:38.408923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:38.408925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:38.408928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:38.408930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:38.408933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:38.408936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:38.408940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:38.408942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:38.408945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:38.408947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:38.408951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:38.408953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:38.408956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:38.408958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:38.408961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:38.408965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:38.408968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:38.408971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.408974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.408977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.408981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.408983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.408986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.408989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:38.408992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:38.408994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:38.408997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:38.409029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:38.409057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895009614413044:5449] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:38.410845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895009614413044:5449] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:38.413610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895009614413044:5449] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:38.413622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895009614413044:5449] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:38.413625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895009614413044:5449] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:38.413630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 508 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:38.413973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:38.414776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:38.414789Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:38.414791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:38.414793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:38.414798Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 507 [2:7555895009524686228:4600]
2025-09-30T14:51:38.414808Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:38.414820Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:38.414821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.414823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.414825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.414837Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:38.414841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:38.414846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:38.414886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.414892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.414893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.414895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:38.414897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:38.414944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:38.414949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.414957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.414963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.414972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:38.414987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895009524686223:4600]
2025-09-30T14:51:38.414991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895009524686223:4600]
2025-09-30T14:51:38.414993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895009524686223:4600]
2025-09-30T14:51:38.414999Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:38.415009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895009614413082:5449], now have 1 active actors on pipe
2025-09-30T14:51:38.415009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:38.415013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:38.415015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:38.415017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895009614412995:2454], now have 1 active actors on pipe
2025-09-30T14:51:38.415024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:38.415037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:38.415039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:38.415064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895009524686223:4600]
2025-09-30T14:51:38.415076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:38.415089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:38.415086Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 507
2025-09-30T14:51:38.415092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 507
2025-09-30T14:51:38.415146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:38.415153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:38.415174Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b9b51b79-19202ea6-d017b0dc-dcad875c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:38.415182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.415184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.415185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:38.415193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.415203Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:38.415213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:38.415381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:38.415390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:38.415403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:38.415497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 508 partition: 0 MaxSeqNo: 42 sessionId: src_id|b9b51b79-19202ea6-d017b0dc-dcad875c_0
2025-09-30T14:51:38.415781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3696d41f-5f7f3ec0-6c82f950-e5e494f8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b9b51b79-19202ea6-d017b0dc-dcad875c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:38.418426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9b51b79-19202ea6-d017b0dc-dcad875c_0] Write session: try to update token
2025-09-30T14:51:38.418437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9b51b79-19202ea6-d017b0dc-dcad875c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:38.427088Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:38.427110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:38.427113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:38.427115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:38.427126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895009524686223:4600]
2025-09-30T14:51:38.427133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895009524686223:4600]
2025-09-30T14:51:38.427140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895009524686223:4600]
2025-09-30T14:51:38.427183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:38.427187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:38.427194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.427195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:38.427197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:38.427198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:38.427404Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:38.431847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 508 sessionId: src_id|b9b51b79-19202ea6-d017b0dc-dcad875c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:38.434559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:38.497704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895009614413105:5419]
2025-09-30T14:51:38.497913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 507, pipe: [1:7555895009614413105:5419]
2025-09-30T14:51:38.532866Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:38.533127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:38.533144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:38.533179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895009614413105:5419], now have 1 active actors on pipe
2025-09-30T14:51:38.533373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895009614413105:5419]
2025-09-30T14:51:38.533394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:38.533397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:38.533397Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:38.533444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 508 reason: error at write: Disconnected sessionId: src_id|b9b51b79-19202ea6-d017b0dc-dcad875c_0
2025-09-30T14:51:38.533518Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:38.533656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 508 sessionId: src_id|b9b51b79-19202ea6-d017b0dc-dcad875c_0 is DEAD
2025-09-30T14:51:38.533837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9b51b79-19202ea6-d017b0dc-dcad875c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:38.533846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9b51b79-19202ea6-d017b0dc-dcad875c_0] Write session will restart in 0.008641s
2025-09-30T14:51:38.533863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9b51b79-19202ea6-d017b0dc-dcad875c_0] Write session: Do CDS request
2025-09-30T14:51:38.533868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9b51b79-19202ea6-d017b0dc-dcad875c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:38.541443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:38.543131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:38.543307Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:38.543314Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:38.543322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:38.543374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:38.543413Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895009524686354:4615]
2025-09-30T14:51:38.543720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9b51b79-19202ea6-d017b0dc-dcad875c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:38.543828Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:38.543844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 509
2025-09-30T14:51:38.543974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 509 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:38.544009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 509 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:38.544017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=509 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:38.544020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:38.544044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:38.544328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:38.544341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 509 sessionId:  describe result for acl check
2025-09-30T14:51:38.544367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:38.544369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:38.544369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:38.544374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:38.544379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895009614413166:5461] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:38.544686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:38.544742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:38.544748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:38.544749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:38.544750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:38.544752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:38.544753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:38.544754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:38.544755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:38.544756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:38.544758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:38.544759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.544760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.544762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.544763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:38.544764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:38.544769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:38.544779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:38.544783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:38.544787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:38.544791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:38.544795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:38.544799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:38.544803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:38.544807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:38.544811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:38.544815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.544819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.544828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895009614413166:5461] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:38.544823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.544826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:38.544830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:38.544837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:38.544846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:38.544852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:38.544858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:38.544862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:38.544867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:38.544871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:38.544877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:38.544882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:38.544887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:38.544892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:38.544897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:38.544901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:38.544907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:38.544911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:38.544916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:38.544921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:38.544926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:38.544931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:38.544935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:38.544941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.544951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.544955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.544960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.544968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.544972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.544976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:38.544980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:38.544990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:38.544995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:38.545043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:38.546508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895009614413166:5461] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:38.550159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895009614413166:5461] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:38.550178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895009614413166:5461] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:38.550181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895009614413166:5461] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:38.550190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 509 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:38.550534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:38.551528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:38.551543Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:38.551548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:38.551552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:38.551558Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 508 [2:7555895009524686354:4615]
2025-09-30T14:51:38.551578Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:38.551597Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:38.551604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.551607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.551609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.551625Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:38.551636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:38.551647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:38.551706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.551713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.551715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.551718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:38.551721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:38.551780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:38.551788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.551802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.551819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.551841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:38.551865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895009614413203:5461], now have 1 active actors on pipe
2025-09-30T14:51:38.551874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895009614413115:2454], now have 1 active actors on pipe
2025-09-30T14:51:38.551881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895009524686349:4615]
2025-09-30T14:51:38.551888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895009524686349:4615]
2025-09-30T14:51:38.551890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895009524686349:4615]
2025-09-30T14:51:38.551902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:38.551913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:38.551901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 508
2025-09-30T14:51:38.551905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 508
2025-09-30T14:51:38.551919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:38.551922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:38.551923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:38.551936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:38.551939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:38.551988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:38.551998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:38.552009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895009524686349:4615]
2025-09-30T14:51:38.552021Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:38.552025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:38.552050Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0e41572-4090492-7108ecc5-c7991561_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:38.552061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.552069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.552072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:38.552081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.552090Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:38.552119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:38.552275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:38.552290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:38.552307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:38.552408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 509 partition: 0 MaxSeqNo: 42 sessionId: src_id|b0e41572-4090492-7108ecc5-c7991561_0
2025-09-30T14:51:38.552757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9b51b79-19202ea6-d017b0dc-dcad875c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b0e41572-4090492-7108ecc5-c7991561_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:38.555446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e41572-4090492-7108ecc5-c7991561_0] Write session: try to update token
2025-09-30T14:51:38.555463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e41572-4090492-7108ecc5-c7991561_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:38.563639Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:38.563661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:38.563664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:38.563666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:38.563675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895009524686349:4615]
2025-09-30T14:51:38.563680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895009524686349:4615]
2025-09-30T14:51:38.563684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895009524686349:4615]
2025-09-30T14:51:38.563724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:38.563740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.563743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:38.563878Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:38.563892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:38.563899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:38.563902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:38.569425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 509 sessionId: src_id|b0e41572-4090492-7108ecc5-c7991561_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:38.571878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:38.633390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895009614413211:5419]
2025-09-30T14:51:38.633655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 508, pipe: [1:7555895009614413211:5419]
2025-09-30T14:51:38.667355Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:38.667690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:38.667702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:38.667718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895009614413211:5419], now have 1 active actors on pipe
2025-09-30T14:51:38.667872Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:38.667927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:38.667943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:38.667952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895009614413211:5419]
2025-09-30T14:51:38.667973Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:38.668027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 509 reason: error at write: Disconnected sessionId: src_id|b0e41572-4090492-7108ecc5-c7991561_0
2025-09-30T14:51:38.668222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 509 sessionId: src_id|b0e41572-4090492-7108ecc5-c7991561_0 is DEAD
2025-09-30T14:51:38.668416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e41572-4090492-7108ecc5-c7991561_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:38.668427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e41572-4090492-7108ecc5-c7991561_0] Write session will restart in 0.009322s
2025-09-30T14:51:38.668450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e41572-4090492-7108ecc5-c7991561_0] Write session: Do CDS request
2025-09-30T14:51:38.668459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e41572-4090492-7108ecc5-c7991561_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:38.675457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:38.676993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:38.677163Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:38.677170Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:38.677178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:38.677214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:38.677244Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895009524686443:4617]
2025-09-30T14:51:38.677675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:38.677892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:38.677919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:38.678132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:38.678167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:38.678171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:38.678172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:38.678173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:38.678173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:38.678174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:38.678175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:38.678175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:38.678176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:38.678177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:38.678178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.678178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.678179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.678180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:38.678180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:38.678183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:38.678190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:38.678192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:38.678195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:38.678197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:38.678199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:38.678201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:38.678203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:38.678205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:38.678208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:38.678210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.678212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.678214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.678218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:38.678220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:38.678226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:38.678230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:38.678234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:38.678237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:38.678240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:38.678243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:38.678246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:38.678249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:38.678251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:38.678254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:38.678257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:38.678260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:38.678262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:38.678265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:38.678268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:38.678271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:38.678274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:38.678277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:38.678280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:38.678283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:38.678286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.678289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.678291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.678303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.678305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.678308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.678311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:38.678314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:38.678317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:38.678320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:38.678345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:38.678722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e41572-4090492-7108ecc5-c7991561_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:38.678801Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:38.678813Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 510
2025-09-30T14:51:38.678935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 510 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:38.678958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 510 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:38.678965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=510 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:38.678969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:38.679322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 510 sessionId:  describe result for acl check
2025-09-30T14:51:38.679346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:38.679351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:38.679352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:38.679356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895009614413266:5465] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:38.679776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895009614413266:5465] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:38.681729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895009614413266:5465] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:38.683436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:38.684192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895009614413266:5465] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:38.684205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895009614413266:5465] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:38.684208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895009614413266:5465] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:38.684215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 510 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:38.684231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:38.684243Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:38.684245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:38.684248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:38.684252Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 509 [2:7555895009524686443:4617]
2025-09-30T14:51:38.684262Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:38.684273Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:38.684275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.684277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.684279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.684289Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:38.684293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:38.684298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:38.684338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.684343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.684344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.684347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:38.684348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:38.684393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:38.684399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.684406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.684416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.684430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:38.684447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895009614413212:2454], now have 1 active actors on pipe
2025-09-30T14:51:38.684454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895009614413301:5465], now have 1 active actors on pipe
2025-09-30T14:51:38.684459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895009524686438:4617]
2025-09-30T14:51:38.684461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895009524686438:4617]
2025-09-30T14:51:38.684462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895009524686438:4617]
2025-09-30T14:51:38.684472Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:38.684482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:38.684480Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 509
2025-09-30T14:51:38.684491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:38.684493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:38.684490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 509
2025-09-30T14:51:38.684498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:38.684502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:38.684504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:38.684513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895009524686438:4617]
2025-09-30T14:51:38.684515Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:38.684528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:38.684540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:38.684546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:38.684565Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88a166c8-16a0f5a9-9b7e9c72-2194f58f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:38.684573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.684575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.684576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:38.684583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.684592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:38.684603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:38.684719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:38.684724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:38.684734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:38.684860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 510 partition: 0 MaxSeqNo: 42 sessionId: src_id|88a166c8-16a0f5a9-9b7e9c72-2194f58f_0
2025-09-30T14:51:38.685169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e41572-4090492-7108ecc5-c7991561_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|88a166c8-16a0f5a9-9b7e9c72-2194f58f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:38.687672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88a166c8-16a0f5a9-9b7e9c72-2194f58f_0] Write session: try to update token
2025-09-30T14:51:38.687686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88a166c8-16a0f5a9-9b7e9c72-2194f58f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:38.696294Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:38.696311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:38.696313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:38.696314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:38.696326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895009524686438:4617]
2025-09-30T14:51:38.696332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895009524686438:4617]
2025-09-30T14:51:38.696335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895009524686438:4617]
2025-09-30T14:51:38.696369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:38.696374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.696376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:38.696382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:38.696398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:38.696402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:38.696514Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:38.701558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 510 sessionId: src_id|88a166c8-16a0f5a9-9b7e9c72-2194f58f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:38.704351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:38.768024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895009614413308:5419]
2025-09-30T14:51:38.768289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 509, pipe: [1:7555895009614413308:5419]
2025-09-30T14:51:38.800371Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:38.800695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:38.800705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:38.800735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895009614413308:5419], now have 1 active actors on pipe
2025-09-30T14:51:38.800893Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:38.800982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895009614413308:5419]
2025-09-30T14:51:38.800983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:38.801018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:38.801102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 510 reason: status is not ok: tablet will be restarted right now sessionId: src_id|88a166c8-16a0f5a9-9b7e9c72-2194f58f_0
2025-09-30T14:51:38.801263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 510 sessionId: src_id|88a166c8-16a0f5a9-9b7e9c72-2194f58f_0 is DEAD
2025-09-30T14:51:38.801388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a166c8-16a0f5a9-9b7e9c72-2194f58f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:38.801398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a166c8-16a0f5a9-9b7e9c72-2194f58f_0] Write session will restart in 0.009132s
2025-09-30T14:51:38.801420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a166c8-16a0f5a9-9b7e9c72-2194f58f_0] Write session: Do CDS request
2025-09-30T14:51:38.801426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a166c8-16a0f5a9-9b7e9c72-2194f58f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:38.808602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:38.810372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:38.810540Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:38.810549Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:38.810556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:38.810590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:38.810627Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895009524686532:4619]
2025-09-30T14:51:38.811074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:38.811448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:38.811508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:38.811627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88a166c8-16a0f5a9-9b7e9c72-2194f58f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:38.811733Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:38.811747Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 511
2025-09-30T14:51:38.811842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:38.811869Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 511 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:38.811894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:38.811899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:38.811900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:38.811900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:38.811901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:38.811902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:38.811903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:38.811905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 511 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:38.811903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:38.811919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=511 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:38.811904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:38.811922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:38.811905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:38.811905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.811908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.811909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.811910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:38.811910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:38.811914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:38.811921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:38.811923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:38.811926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:38.811928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:38.811930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:38.811932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:38.811935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:38.811937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:38.811939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:38.811942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.811944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.811946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.811948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:38.811950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:38.811956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:38.811961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:38.811965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:38.811968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:38.811971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:38.811974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:38.811977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:38.811980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:38.811983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:38.811986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:38.811989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:38.811991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:38.811995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:38.811998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:38.812000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:38.812003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:38.812005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:38.812008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:38.812010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:38.812013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:38.812016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.812019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.812021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.812024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.812027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.812029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.812032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:38.812035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:38.812037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:38.812040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:38.812063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:38.812339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 511 sessionId:  describe result for acl check
2025-09-30T14:51:38.812370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:38.812371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:38.812373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:38.812376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895009614413365:5469] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:38.812791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895009614413365:5469] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:38.814218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895009614413365:5469] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:38.816841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895009614413365:5469] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:38.816856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895009614413365:5469] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:38.816859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895009614413365:5469] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:38.816867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 511 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:38.817162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:38.817997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:38.818013Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:38.818015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:38.818019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:38.818026Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 510 [2:7555895009524686532:4619]
2025-09-30T14:51:38.818040Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:38.818060Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:38.818067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.818070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.818072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.818085Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:38.818094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:38.818099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:38.818143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.818148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.818150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.818152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:38.818154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:38.818205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:38.818212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.818221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.818229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.818239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:38.818254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895009524686527:4619]
2025-09-30T14:51:38.818258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895009524686527:4619]
2025-09-30T14:51:38.818260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895009524686527:4619]
2025-09-30T14:51:38.818265Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:38.818278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895009614413400:5469], now have 1 active actors on pipe
2025-09-30T14:51:38.818281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895009614413310:2454], now have 1 active actors on pipe
2025-09-30T14:51:38.818281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:38.818284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:38.818286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:38.818289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:38.818302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:38.818309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:38.818335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895009524686527:4619]
2025-09-30T14:51:38.818344Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:38.818336Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 510
2025-09-30T14:51:38.818356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 510
2025-09-30T14:51:38.818360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:38.818390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:38.818398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:38.818416Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b20d402-cedb1ed8-9c281619-b250d6f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:38.818426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.818429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.818430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:38.818436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.818442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:38.818451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:38.818565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:38.818571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:38.818581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:38.818679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 511 partition: 0 MaxSeqNo: 42 sessionId: src_id|5b20d402-cedb1ed8-9c281619-b250d6f9_0
2025-09-30T14:51:38.819000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a166c8-16a0f5a9-9b7e9c72-2194f58f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5b20d402-cedb1ed8-9c281619-b250d6f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:38.821562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b20d402-cedb1ed8-9c281619-b250d6f9_0] Write session: try to update token
2025-09-30T14:51:38.821577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b20d402-cedb1ed8-9c281619-b250d6f9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:38.829668Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:38.829691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:38.829703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895009524686527:4619]
2025-09-30T14:51:38.829749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:38.829755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:38.829988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:38.830131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:38.830262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:38.830529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:38.830718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:38.830766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:38.835347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 511 sessionId: src_id|5b20d402-cedb1ed8-9c281619-b250d6f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:38.838203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:38.838389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:38.838414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:38.838446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:38.838540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:38.840548Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:38.840568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:38.840571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:38.840573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:38.840582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895009524686527:4619]
2025-09-30T14:51:38.840587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895009524686527:4619]
2025-09-30T14:51:38.840591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895009524686527:4619]
2025-09-30T14:51:38.840632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:38.840633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:38.840638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:38.840641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:38.840644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.840647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:38.840786Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:38.901181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895009614413419:5419]
2025-09-30T14:51:38.901462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 510, pipe: [1:7555895009614413419:5419]
2025-09-30T14:51:38.947123Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:38.954579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:38.954607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:38.954771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:38.954836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:38.954903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:38.954970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:38.955018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:38.955029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:38.955101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:38.955166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:38.955230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:38.955313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:38.955361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:38.955369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:38.955437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:38.955497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:38.955563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:38.955627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:38.955672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:38.955679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:38.955744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:38.955813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:38.955881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:38.955978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:38.956026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:38.956036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:38.956102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:38.956183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:38.956247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:38.956310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:38.956362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:38.956371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:38.956436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:38.956498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:38.956563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:38.956624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:38.956669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:38.956677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:38.956740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:38.956800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:38.956865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:38.956930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:38.956976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:38.956983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:38.957050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:38.957110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:38.957173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:38.957239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:38.957284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:38.957293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:38.957359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:38.957421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:38.957484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:38.957549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:38.957598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:38.957606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:38.957668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:38.957729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:38.957809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:38.957876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:38.957922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:38.957930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:38.957989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895009614413419:5419], now have 1 active actors on pipe
2025-09-30T14:51:38.958222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:38.958233Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:38.958235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:38.958263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 511 reason: error at write: Disconnected sessionId: src_id|5b20d402-cedb1ed8-9c281619-b250d6f9_0
2025-09-30T14:51:38.958298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895009614413419:5419]
2025-09-30T14:51:38.958493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 511 sessionId: src_id|5b20d402-cedb1ed8-9c281619-b250d6f9_0 is DEAD
2025-09-30T14:51:38.958652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b20d402-cedb1ed8-9c281619-b250d6f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:38.958661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b20d402-cedb1ed8-9c281619-b250d6f9_0] Write session will restart in 0.009614s
2025-09-30T14:51:38.958685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b20d402-cedb1ed8-9c281619-b250d6f9_0] Write session: Do CDS request
2025-09-30T14:51:38.958691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b20d402-cedb1ed8-9c281619-b250d6f9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:38.959055Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:38.966508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:38.968092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:38.968287Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:38.968296Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:38.968308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:38.968356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:38.968389Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895009524686635:4622]
2025-09-30T14:51:38.969187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:38.969440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:38.969472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:38.969739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:38.969794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:38.969799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:38.969800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:38.969801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:38.969801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:38.969802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:38.969803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:38.969804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:38.969807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:38.969808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:38.969809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.969810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.969811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.969812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:38.969813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:38.969828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:38.969839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:38.969843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:38.969847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:38.969851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:38.969856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:38.969858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:38.969861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:38.969863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:38.969865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:38.969869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.969873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.969877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.969880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:38.969884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:38.969890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:38.969900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:38.969906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:38.969911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:38.969916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:38.969921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:38.969926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:38.969931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:38.969935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:38.969939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:38.969942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:38.969944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:38.969947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:38.969950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:38.969953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:38.969956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:38.969958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:38.969961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:38.969964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:38.969967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:38.969969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.969972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.969975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.969978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.969982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.969984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.969987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:38.970014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b20d402-cedb1ed8-9c281619-b250d6f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:38.969989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:38.969991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:38.969994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:38.970020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:38.970116Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:38.970131Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 512
2025-09-30T14:51:38.970261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 512 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:38.970290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 512 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:38.970300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=512 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:38.970304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:38.970832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 512 sessionId:  describe result for acl check
2025-09-30T14:51:38.970870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:38.970872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:38.970874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:38.970880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895009614413481:5474] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:38.971414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895009614413481:5474] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:38.972947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895009614413481:5474] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:38.975015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:38.975597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895009614413481:5474] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:38.975621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895009614413481:5474] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:38.975625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895009614413481:5474] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:38.975633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 512 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:38.975906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:38.975924Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:38.975926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:38.975930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:38.975936Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 511 [2:7555895009524686635:4622]
2025-09-30T14:51:38.975951Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:38.975965Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:38.975968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.975971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.975976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.975991Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:38.976001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:38.976007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:38.976051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.976056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.976057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.976059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:38.976061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:38.976110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:38.976116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.976126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:38.976137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:38.976157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:38.976179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895009614413423:2454], now have 1 active actors on pipe
2025-09-30T14:51:38.976187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895009614413521:5474], now have 1 active actors on pipe
2025-09-30T14:51:38.976193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895009524686630:4622]
2025-09-30T14:51:38.976195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895009524686630:4622]
2025-09-30T14:51:38.976197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895009524686630:4622]
2025-09-30T14:51:38.976208Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:38.976221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:38.976234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:38.976237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:38.976240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:38.976242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:38.976243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:38.976266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 511
2025-09-30T14:51:38.976272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895009524686630:4622]
2025-09-30T14:51:38.976268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 511
2025-09-30T14:51:38.976280Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:38.976284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:38.976316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:38.976326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:38.976354Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5535363e-c1c91411-ece73631-a1f95726_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:38.976364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.976368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.976370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:38.976378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.976392Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:38.976409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:38.976559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:38.976571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:38.976593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:38.976693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 512 partition: 0 MaxSeqNo: 42 sessionId: src_id|5535363e-c1c91411-ece73631-a1f95726_0
2025-09-30T14:51:38.977071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b20d402-cedb1ed8-9c281619-b250d6f9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5535363e-c1c91411-ece73631-a1f95726_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:38.981694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5535363e-c1c91411-ece73631-a1f95726_0] Write session: try to update token
2025-09-30T14:51:38.981720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5535363e-c1c91411-ece73631-a1f95726_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:38.988163Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:38.988179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:38.988181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:38.988182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:38.988189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895009524686630:4622]
2025-09-30T14:51:38.988194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895009524686630:4622]
2025-09-30T14:51:38.988201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895009524686630:4622]
2025-09-30T14:51:38.988230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:38.988237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:38.988238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:38.988241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:38.988247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:38.988251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:38.988365Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:38.996562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 512 sessionId: src_id|5535363e-c1c91411-ece73631-a1f95726_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:38.999192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:39.058369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895013909380827:5419]
2025-09-30T14:51:39.058631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 511, pipe: [1:7555895013909380827:5419]
2025-09-30T14:51:39.093903Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:39.094160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:39.094173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:39.094189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895013909380827:5419], now have 1 active actors on pipe
2025-09-30T14:51:39.094351Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:39.094336Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:39.094356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:39.094361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:39.094398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895013909380827:5419]
2025-09-30T14:51:39.094423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 512 reason: error at write: Disconnected sessionId: src_id|5535363e-c1c91411-ece73631-a1f95726_0
2025-09-30T14:51:39.094604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 512 sessionId: src_id|5535363e-c1c91411-ece73631-a1f95726_0 is DEAD
2025-09-30T14:51:39.094729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5535363e-c1c91411-ece73631-a1f95726_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:39.094740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5535363e-c1c91411-ece73631-a1f95726_0] Write session will restart in 0.007226s
2025-09-30T14:51:39.094763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5535363e-c1c91411-ece73631-a1f95726_0] Write session: Do CDS request
2025-09-30T14:51:39.094769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5535363e-c1c91411-ece73631-a1f95726_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:39.102068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:39.102792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5535363e-c1c91411-ece73631-a1f95726_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:39.102870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:39.102885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 513
2025-09-30T14:51:39.102999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 513 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:39.103028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 513 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:39.103037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=513 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:39.103042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:39.103471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 513 sessionId:  describe result for acl check
2025-09-30T14:51:39.103506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:39.103514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:39.103494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:39.103516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:39.103521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895013909380881:5480] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:39.103636Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:39.103644Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:39.103654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:39.103708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:39.103735Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895013819654025:4625]
2025-09-30T14:51:39.104016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895013909380881:5480] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:39.104198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:39.104489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:39.104548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:39.104802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:39.104847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:39.104852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:39.104852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:39.104853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:39.104854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:39.104855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:39.104855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:39.104856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:39.104857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:39.104857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:39.104858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.104859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.104860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.104861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:39.104861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:39.104865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:39.104871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:39.104874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:39.104876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:39.104878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:39.104881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:39.104883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:39.104886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:39.104889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:39.104891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:39.104893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.104895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.104898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.104900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:39.104902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:39.104907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:39.104915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:39.104920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:39.104925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:39.104929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:39.104935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:39.104939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:39.104942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:39.104945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:39.104948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:39.104950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:39.104953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:39.104955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:39.104958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:39.104960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:39.104963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:39.104966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:39.104969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:39.104971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:39.104974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:39.104977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.104980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.104982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.104985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.104987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.104990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.104992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:39.105007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:39.105011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:39.105013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:39.105037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:39.105583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895013909380881:5480] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:39.109767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895013909380881:5480] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:39.109787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895013909380881:5480] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:39.109790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895013909380881:5480] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:39.109799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 513 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:39.110009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:39.110851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:39.110863Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:39.110865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:39.110868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:39.110873Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 512 [2:7555895013819654025:4625]
2025-09-30T14:51:39.110883Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:39.110894Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:39.110896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.110898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.110899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.110911Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:39.110916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:39.110921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:39.110962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.110969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.110971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.110973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:39.110974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:39.111021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:39.111027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.111035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.111043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.111056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:39.111080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895013909380920:5480], now have 1 active actors on pipe
2025-09-30T14:51:39.111089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 512
2025-09-30T14:51:39.111085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895013909380828:2454], now have 1 active actors on pipe
2025-09-30T14:51:39.111103Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 512
2025-09-30T14:51:39.111091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895013819654020:4625]
2025-09-30T14:51:39.111092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895013819654020:4625]
2025-09-30T14:51:39.111093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895013819654020:4625]
2025-09-30T14:51:39.111105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:39.111116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:39.111125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:39.111127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:39.111139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:39.111142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:39.111143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:39.111151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895013819654020:4625]
2025-09-30T14:51:39.111157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:39.111160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:39.111169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:39.111172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:39.111209Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1da6e17-2fa64a01-6879187f-c89b92a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:39.111218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.111220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.111222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:39.111229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.111236Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:39.111264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:39.111403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:39.111410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:39.111419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:39.111472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 513 partition: 0 MaxSeqNo: 42 sessionId: src_id|b1da6e17-2fa64a01-6879187f-c89b92a5_0
2025-09-30T14:51:39.111812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5535363e-c1c91411-ece73631-a1f95726_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b1da6e17-2fa64a01-6879187f-c89b92a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:39.114413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1da6e17-2fa64a01-6879187f-c89b92a5_0] Write session: try to update token
2025-09-30T14:51:39.114429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1da6e17-2fa64a01-6879187f-c89b92a5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:39.123092Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:39.123109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:39.123111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:39.123113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:39.123119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895013819654020:4625]
2025-09-30T14:51:39.123123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895013819654020:4625]
2025-09-30T14:51:39.123126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895013819654020:4625]
2025-09-30T14:51:39.123164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:39.123174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.123177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:39.123181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:39.123187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:39.123190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:39.123337Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:39.128179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 513 sessionId: src_id|b1da6e17-2fa64a01-6879187f-c89b92a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:39.130653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:39.194605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895013909380928:5419]
2025-09-30T14:51:39.194932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 512, pipe: [1:7555895013909380928:5419]
2025-09-30T14:51:39.230527Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:39.230941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:39.230957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:39.230992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895013909380928:5419], now have 1 active actors on pipe
2025-09-30T14:51:39.231213Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:39.231265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895013909380928:5419]
2025-09-30T14:51:39.231295Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:39.231302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:39.231378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 513 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b1da6e17-2fa64a01-6879187f-c89b92a5_0
2025-09-30T14:51:39.231551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 513 sessionId: src_id|b1da6e17-2fa64a01-6879187f-c89b92a5_0 is DEAD
2025-09-30T14:51:39.231651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1da6e17-2fa64a01-6879187f-c89b92a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:39.231658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1da6e17-2fa64a01-6879187f-c89b92a5_0] Write session will restart in 0.005366s
2025-09-30T14:51:39.231674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1da6e17-2fa64a01-6879187f-c89b92a5_0] Write session: Do CDS request
2025-09-30T14:51:39.231678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1da6e17-2fa64a01-6879187f-c89b92a5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:39.237729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1da6e17-2fa64a01-6879187f-c89b92a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:39.237824Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:39.237840Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 514
2025-09-30T14:51:39.237972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 514 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:39.238014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 514 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:39.238023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=514 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:39.238027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:39.238443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 514 sessionId:  describe result for acl check
2025-09-30T14:51:39.238491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:39.238493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:39.238495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:39.238501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895013909380951:5484] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:39.239031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895013909380951:5484] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:39.240871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:39.241077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895013909380951:5484] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:39.242668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:39.242872Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:39.242882Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:39.242894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:39.242944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:39.242979Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895013819654117:4627]
2025-09-30T14:51:39.243664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:39.243932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:39.243932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895013909380951:5484] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:39.243948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895013909380951:5484] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:39.243952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895013909380951:5484] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:39.243958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 514 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:39.243979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:39.244302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:39.244367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:39.244376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:39.244377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:39.244378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:39.244380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:39.244381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:39.244385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:39.244386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:39.244388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:39.244389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:39.244390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.244391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.244392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.244393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:39.244393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:39.244399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:39.244410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:39.244413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:39.244418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:39.244422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:39.244426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:39.244431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:39.244435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:39.244439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:39.244443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:39.244447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.244451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.244455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.244459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:39.244463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:39.244470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:39.244478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:39.244484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:39.244490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:39.244499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:39.244505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:39.244515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:39.244521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:39.244525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:39.244535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:39.244541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:39.244546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:39.244550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:39.244555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:39.244559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:39.244564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:39.244569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:39.244573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:39.244578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:39.244582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:39.244587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.244597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.244601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.244611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.244616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.244625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.244629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:39.244639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:39.244647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:39.244652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:39.244699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:39.250580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:39.251556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:39.251574Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:39.251577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:39.251581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:39.251587Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 513 [2:7555895013819654117:4627]
2025-09-30T14:51:39.251604Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:39.251622Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:39.251630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.251639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.251641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.251656Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:39.251667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:39.251676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:39.251740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.251748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.251750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.251754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:39.251756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:39.251873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:39.251886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.251900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.251913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.251935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:39.251959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895013909380929:2454], now have 1 active actors on pipe
2025-09-30T14:51:39.251963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895013909381020:5484], now have 1 active actors on pipe
2025-09-30T14:51:39.251969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895013819654112:4627]
2025-09-30T14:51:39.251971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895013819654112:4627]
2025-09-30T14:51:39.251973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895013819654112:4627]
2025-09-30T14:51:39.251985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:39.251999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:39.252002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:39.252002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:39.252004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:39.252015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:39.252019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:39.252032Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 513
2025-09-30T14:51:39.252069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895013819654112:4627]
2025-09-30T14:51:39.252081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:39.252088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:39.252141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 513
2025-09-30T14:51:39.252225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:39.252235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:39.252260Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0e7b804-c2db552-11ba3c24-84c47e5a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:39.252274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.252277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.252279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:39.252290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.252299Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:39.252322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:39.252499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:39.252508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:39.252522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:39.252643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 514 partition: 0 MaxSeqNo: 42 sessionId: src_id|e0e7b804-c2db552-11ba3c24-84c47e5a_0
2025-09-30T14:51:39.252990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1da6e17-2fa64a01-6879187f-c89b92a5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e0e7b804-c2db552-11ba3c24-84c47e5a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:39.255772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0e7b804-c2db552-11ba3c24-84c47e5a_0] Write session: try to update token
2025-09-30T14:51:39.255793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0e7b804-c2db552-11ba3c24-84c47e5a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:39.264850Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:39.264872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:39.264875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:39.264877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:39.264885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895013819654112:4627]
2025-09-30T14:51:39.264890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895013819654112:4627]
2025-09-30T14:51:39.264894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895013819654112:4627]
2025-09-30T14:51:39.264933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:39.264940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.264941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:39.264943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:39.264947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:39.264951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:39.265077Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:39.270949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 514 sessionId: src_id|e0e7b804-c2db552-11ba3c24-84c47e5a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:39.273771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:39.331278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895013909381030:5419]
2025-09-30T14:51:39.331545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 513, pipe: [1:7555895013909381030:5419]
2025-09-30T14:51:39.373428Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:39.373687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:39.373698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:39.373730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895013909381030:5419], now have 1 active actors on pipe
2025-09-30T14:51:39.373922Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:39.373979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895013909381030:5419]
2025-09-30T14:51:39.374012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:39.374038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:39.374103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 514 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e0e7b804-c2db552-11ba3c24-84c47e5a_0
2025-09-30T14:51:39.374246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 514 sessionId: src_id|e0e7b804-c2db552-11ba3c24-84c47e5a_0 is DEAD
2025-09-30T14:51:39.374397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0e7b804-c2db552-11ba3c24-84c47e5a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:39.374407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0e7b804-c2db552-11ba3c24-84c47e5a_0] Write session will restart in 0.009753s
2025-09-30T14:51:39.374431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0e7b804-c2db552-11ba3c24-84c47e5a_0] Write session: Do CDS request
2025-09-30T14:51:39.374437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0e7b804-c2db552-11ba3c24-84c47e5a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:39.382832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:39.384504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:39.384693Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:39.384705Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:39.384716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:39.384771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:39.384820Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895013819654211:4629]
2025-09-30T14:51:39.385471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:39.385745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0e7b804-c2db552-11ba3c24-84c47e5a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:39.385759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:39.385806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:39.385809Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:39.385838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 515
2025-09-30T14:51:39.385961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 515 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:39.385982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 515 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:39.385990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=515 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:39.385993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:39.386130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:39.386203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:39.386209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:39.386210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:39.386212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:39.386213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:39.386214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:39.386215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:39.386217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:39.386218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:39.386220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:39.386221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.386222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.386224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.386225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:39.386226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:39.386231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:39.386241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:39.386246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:39.386250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:39.386254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:39.386258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:39.386263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:39.386267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:39.386271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:39.386275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:39.386279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.386284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.386289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.386293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:39.386297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:39.386304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:39.386312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:39.386317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:39.386322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:39.386325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:39.386330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:39.386334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:39.386340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:39.386344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:39.386350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:39.386354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:39.386359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:39.386363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:39.386369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:39.386373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:39.386378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:39.386389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:39.386394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:39.386398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:39.386402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:39.386409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.386414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.386420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.386413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 515 sessionId:  describe result for acl check
2025-09-30T14:51:39.386425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.386435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.386439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.386444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:39.386453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:39.386445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:39.386457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:39.386452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:39.386454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:39.386462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:39.386459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895013909381089:5488] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:39.386519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:39.386976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895013909381089:5488] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:39.388764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895013909381089:5488] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:39.391724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895013909381089:5488] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:39.391741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895013909381089:5488] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:39.391744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895013909381089:5488] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:39.391752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 515 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:39.392079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:39.392955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:39.392970Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:39.392973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:39.392976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:39.392982Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 514 [2:7555895013819654211:4629]
2025-09-30T14:51:39.392997Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:39.393013Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:39.393016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.393019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.393021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.393036Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:39.393042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:39.393049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:39.393103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.393111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.393113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.393117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:39.393119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:39.393191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:39.393198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.393210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.393227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.393249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:39.393271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895013909381125:5488], now have 1 active actors on pipe
2025-09-30T14:51:39.393279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895013909381031:2454], now have 1 active actors on pipe
2025-09-30T14:51:39.393285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895013819654206:4629]
2025-09-30T14:51:39.393287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895013819654206:4629]
2025-09-30T14:51:39.393289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895013819654206:4629]
2025-09-30T14:51:39.393301Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:39.393292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 514
2025-09-30T14:51:39.393315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:39.393321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:39.393296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 514
2025-09-30T14:51:39.393324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:39.393328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:39.393334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:39.393337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:39.393381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:39.393390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:39.393401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895013819654206:4629]
2025-09-30T14:51:39.393412Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:39.393424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:39.393443Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1306e6aa-86fb60d-aecadfec-b9e0f90_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:39.393453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.393458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.393462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:39.393471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.393484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:39.393510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:39.393678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:39.393693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:39.393714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:39.393811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 515 partition: 0 MaxSeqNo: 42 sessionId: src_id|1306e6aa-86fb60d-aecadfec-b9e0f90_0
2025-09-30T14:51:39.394096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0e7b804-c2db552-11ba3c24-84c47e5a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1306e6aa-86fb60d-aecadfec-b9e0f90_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:39.396834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1306e6aa-86fb60d-aecadfec-b9e0f90_0] Write session: try to update token
2025-09-30T14:51:39.396852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1306e6aa-86fb60d-aecadfec-b9e0f90_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:39.405771Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:39.405794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:39.405797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:39.405800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:39.405810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895013819654206:4629]
2025-09-30T14:51:39.405817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895013819654206:4629]
2025-09-30T14:51:39.405822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895013819654206:4629]
2025-09-30T14:51:39.405863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:39.405866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:39.405872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:39.405876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:39.405877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.405880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:39.406037Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:39.411187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 515 sessionId: src_id|1306e6aa-86fb60d-aecadfec-b9e0f90_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:39.413951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:39.474087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895013909381135:5419]
2025-09-30T14:51:39.474391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 514, pipe: [1:7555895013909381135:5419]
2025-09-30T14:51:39.520467Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:39.520764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:39.520788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:39.520825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895013909381135:5419], now have 1 active actors on pipe
2025-09-30T14:51:39.521023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:39.521036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:39.521097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 515 reason: error at write: Disconnected sessionId: src_id|1306e6aa-86fb60d-aecadfec-b9e0f90_0
2025-09-30T14:51:39.521296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 515 sessionId: src_id|1306e6aa-86fb60d-aecadfec-b9e0f90_0 is DEAD
2025-09-30T14:51:39.521308Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:39.521443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1306e6aa-86fb60d-aecadfec-b9e0f90_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:39.521454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1306e6aa-86fb60d-aecadfec-b9e0f90_0] Write session will restart in 0.006419s
2025-09-30T14:51:39.521480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1306e6aa-86fb60d-aecadfec-b9e0f90_0] Write session: Do CDS request
2025-09-30T14:51:39.521485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1306e6aa-86fb60d-aecadfec-b9e0f90_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:39.521629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:39.521668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895013909381135:5419]
2025-09-30T14:51:39.528764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1306e6aa-86fb60d-aecadfec-b9e0f90_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:39.528919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:39.528938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 516
2025-09-30T14:51:39.529053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 516 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:39.529095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 516 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:39.529104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=516 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:39.529109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:39.529510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 516 sessionId:  describe result for acl check
2025-09-30T14:51:39.529540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:39.529542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:39.529543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:39.529549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895013909381190:5499] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:39.530087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895013909381190:5499] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:39.531137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:39.532298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895013909381190:5499] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:39.532956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:39.533134Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:39.533143Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:39.533154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:39.533220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:39.533261Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895013819654321:4638]
2025-09-30T14:51:39.533860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:39.534123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:39.534164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:39.534440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:39.534506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:39.534511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:39.534512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:39.534512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:39.534513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:39.534514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:39.534514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:39.534515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:39.534516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:39.534516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:39.534517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.534518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.534519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.534521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:39.534522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:39.534526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:39.534536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:39.534539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:39.534543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:39.534547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:39.534550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:39.534554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:39.534557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:39.534561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:39.534565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:39.534569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.534572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.534575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.534579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:39.534583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:39.534593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:39.534598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:39.534603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:39.534609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:39.534613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:39.534617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:39.534621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:39.534626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:39.534630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:39.534635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:39.534640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:39.534645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:39.534650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:39.534655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:39.534659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:39.534664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:39.534667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:39.534672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:39.534675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:39.534680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:39.534684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.534689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.534692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.534697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.534701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.534706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.534711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:39.534716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:39.534721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:39.534725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:39.534772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:39.535311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895013909381190:5499] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:39.535332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895013909381190:5499] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:39.535335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895013909381190:5499] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:39.535343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 516 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:39.540028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:39.541016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:39.541031Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:39.541038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:39.541041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:39.541047Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 515 [2:7555895013819654321:4638]
2025-09-30T14:51:39.541056Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:39.541069Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:39.541074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.541077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.541079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.541094Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:39.541106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:39.541112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:39.541162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.541167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.541168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.541171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:39.541173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:39.541228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:39.541235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.541247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.541263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.541285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:39.541305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895013819654316:4638]
2025-09-30T14:51:39.541311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895013819654316:4638]
2025-09-30T14:51:39.541313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895013819654316:4638]
2025-09-30T14:51:39.541326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:39.541344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895013909381243:5499], now have 1 active actors on pipe
2025-09-30T14:51:39.541352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895013909381149:2454], now have 1 active actors on pipe
2025-09-30T14:51:39.541350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:39.541356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:39.541359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:39.541360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:39.541375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:39.541381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:39.541405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 515
2025-09-30T14:51:39.541412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895013819654316:4638]
2025-09-30T14:51:39.541427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:39.541448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 515
2025-09-30T14:51:39.541464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:39.541505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:39.541509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:39.541530Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc237048-ff8d4ddb-a89551a6-5836d125_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:39.541539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.541542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.541543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:39.541551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.541558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:39.541572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:39.541740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:39.541747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:39.541760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:39.541826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 516 partition: 0 MaxSeqNo: 42 sessionId: src_id|dc237048-ff8d4ddb-a89551a6-5836d125_0
2025-09-30T14:51:39.542213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1306e6aa-86fb60d-aecadfec-b9e0f90_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dc237048-ff8d4ddb-a89551a6-5836d125_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:39.545042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc237048-ff8d4ddb-a89551a6-5836d125_0] Write session: try to update token
2025-09-30T14:51:39.545059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc237048-ff8d4ddb-a89551a6-5836d125_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:39.552935Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:39.552956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:39.552964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895013819654316:4638]
2025-09-30T14:51:39.553006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:39.553006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:39.553183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:39.553374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:39.553560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:39.553744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:39.553950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:39.553998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:39.559524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 516 sessionId: src_id|dc237048-ff8d4ddb-a89551a6-5836d125_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:39.562121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:39.562312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:39.562341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:39.562373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:39.562449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:39.569220Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:39.569239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:39.569241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:39.569244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:39.569255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895013819654316:4638]
2025-09-30T14:51:39.569259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895013819654316:4638]
2025-09-30T14:51:39.569264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895013819654316:4638]
2025-09-30T14:51:39.569299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:39.569303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:39.569305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:39.569309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:39.569310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.569313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:39.569459Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:39.622092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895013909381260:5419]
2025-09-30T14:51:39.622377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 515, pipe: [1:7555895013909381260:5419]
2025-09-30T14:51:39.674434Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:39.681731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:39.681758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:39.681914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:39.681989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:39.682051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:39.682112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:39.682370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:39.682383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:39.682450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:39.682527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:39.682587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:39.682655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:39.682698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:39.682704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:39.682766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:39.682821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:39.682881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:39.682944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:39.682987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:39.682992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:39.683053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:39.683116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:39.683176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:39.683265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:39.683309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:39.683315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:39.683380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:39.683439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:39.683542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:39.683606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:39.683666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:39.683673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:39.683752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:39.683823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:39.683898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:39.683978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:39.684030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:39.684038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:39.684112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:39.684181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:39.684249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:39.684341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:39.684386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:39.684393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:39.684464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:39.684530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:39.684592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:39.684659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:39.684702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:39.684707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:39.684781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:39.684850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:39.684909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:39.684981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:39.685140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:39.685147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:39.685215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:39.685282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:39.685347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:39.685415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:39.685456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:39.685462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:39.685520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895013909381260:5419], now have 1 active actors on pipe
2025-09-30T14:51:39.685778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895013909381260:5419]
2025-09-30T14:51:39.685780Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:39.685815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:39.685819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:39.685847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 516 reason: error at write: Disconnected sessionId: src_id|dc237048-ff8d4ddb-a89551a6-5836d125_0
2025-09-30T14:51:39.686025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 516 sessionId: src_id|dc237048-ff8d4ddb-a89551a6-5836d125_0 is DEAD
2025-09-30T14:51:39.686157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc237048-ff8d4ddb-a89551a6-5836d125_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:39.686166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc237048-ff8d4ddb-a89551a6-5836d125_0] Write session will restart in 0.008382s
2025-09-30T14:51:39.686190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc237048-ff8d4ddb-a89551a6-5836d125_0] Write session: Do CDS request
2025-09-30T14:51:39.686195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc237048-ff8d4ddb-a89551a6-5836d125_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:39.686329Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:39.695738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc237048-ff8d4ddb-a89551a6-5836d125_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:39.695845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:39.695864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 517
2025-09-30T14:51:39.695997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 517 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:39.696039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 517 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:39.696049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=517 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:39.696053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:39.696415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:39.696468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 517 sessionId:  describe result for acl check
2025-09-30T14:51:39.696697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:39.696709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:39.696712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:39.696717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895013909381318:5504] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:39.697286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895013909381318:5504] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:39.698371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:39.698640Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:39.698654Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:39.698666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:39.698740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:39.698778Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895013819654441:4646]
2025-09-30T14:51:39.699455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:39.700182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:39.700253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:39.700334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895013909381318:5504] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:39.700621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:39.700684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:39.700693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:39.700695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:39.700696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:39.700697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:39.700699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:39.700700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:39.700701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:39.700702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:39.700704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:39.700705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.700706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.700707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.700708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:39.700709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:39.700715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:39.700726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:39.700731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:39.700746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:39.700750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:39.700754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:39.700758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:39.700763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:39.700767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:39.700771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:39.700776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.700780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.700784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.700788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:39.700792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:39.700800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:39.700808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:39.700820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:39.700832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:39.700837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:39.700843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:39.700852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:39.700862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:39.700872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:39.700882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:39.700890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:39.700900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:39.700909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:39.700918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:39.700928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:39.700934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:39.700939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:39.700945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:39.700949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:39.700955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:39.700959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.700965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.700974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.700981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.700985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.700991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.700995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:39.701000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:39.701005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:39.701009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:39.701056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:39.706529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895013909381318:5504] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:39.706549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895013909381318:5504] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:39.706553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895013909381318:5504] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:39.706563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 517 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:39.706565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:39.707438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:39.707456Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:39.707459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:39.707463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:39.707471Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 516 [2:7555895013819654441:4646]
2025-09-30T14:51:39.707485Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:39.707500Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:39.707503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.707506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.707509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.707524Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:39.707530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:39.707536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:39.707589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.707600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.707602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.707605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:39.707608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:39.707675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:39.707683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.707695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.707712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.707735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:39.707759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895013909381359:5504], now have 1 active actors on pipe
2025-09-30T14:51:39.707762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895013909381262:2454], now have 1 active actors on pipe
2025-09-30T14:51:39.707768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895013819654435:4646]
2025-09-30T14:51:39.707784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 516
2025-09-30T14:51:39.707770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895013819654435:4646]
2025-09-30T14:51:39.707773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895013819654435:4646]
2025-09-30T14:51:39.707786Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:39.707800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:39.707802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:39.707806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:39.707833Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 516
2025-09-30T14:51:39.707808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:39.707814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:39.707817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:39.707860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:39.707864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:39.707880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895013819654435:4646]
2025-09-30T14:51:39.707887Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:39.707899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:39.707926Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4a58996-baab38cb-243e7a2e-55728550_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:39.707937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.707946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.707949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:39.707958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.707969Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:39.707995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:39.708161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:39.708170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:39.708183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:39.708253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 517 partition: 0 MaxSeqNo: 42 sessionId: src_id|d4a58996-baab38cb-243e7a2e-55728550_0
2025-09-30T14:51:39.708582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc237048-ff8d4ddb-a89551a6-5836d125_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d4a58996-baab38cb-243e7a2e-55728550_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:39.711311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4a58996-baab38cb-243e7a2e-55728550_0] Write session: try to update token
2025-09-30T14:51:39.711328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4a58996-baab38cb-243e7a2e-55728550_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:39.719968Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:39.719990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:39.719993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:39.719995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:39.720004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895013819654435:4646]
2025-09-30T14:51:39.720009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895013819654435:4646]
2025-09-30T14:51:39.720015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895013819654435:4646]
2025-09-30T14:51:39.720053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:39.720061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.720062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:39.720064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:39.720068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:39.720073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:39.720214Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:39.725740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 517 sessionId: src_id|d4a58996-baab38cb-243e7a2e-55728550_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:39.728424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:39.785922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895013909381366:5419]
2025-09-30T14:51:39.786225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 516, pipe: [1:7555895013909381366:5419]
2025-09-30T14:51:39.831484Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:39.831885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:39.831903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:39.831948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895013909381366:5419], now have 1 active actors on pipe
2025-09-30T14:51:39.832170Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:39.832234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:39.832234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:39.832239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:39.832295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895013909381366:5419]
2025-09-30T14:51:39.832300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 517 reason: error at write: Disconnected sessionId: src_id|d4a58996-baab38cb-243e7a2e-55728550_0
2025-09-30T14:51:39.832475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 517 sessionId: src_id|d4a58996-baab38cb-243e7a2e-55728550_0 is DEAD
2025-09-30T14:51:39.832639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4a58996-baab38cb-243e7a2e-55728550_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:39.832651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4a58996-baab38cb-243e7a2e-55728550_0] Write session will restart in 0.007047s
2025-09-30T14:51:39.832673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4a58996-baab38cb-243e7a2e-55728550_0] Write session: Do CDS request
2025-09-30T14:51:39.832679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4a58996-baab38cb-243e7a2e-55728550_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:39.840797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4a58996-baab38cb-243e7a2e-55728550_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:39.841044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:39.841064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 518
2025-09-30T14:51:39.841201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 518 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:39.841238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 518 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:39.841248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=518 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:39.841252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:39.841513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:39.841675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 518 sessionId:  describe result for acl check
2025-09-30T14:51:39.841712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:39.841714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:39.841716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:39.841721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895013909381426:5508] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:39.842232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895013909381426:5508] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:39.843191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:39.843395Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:39.843407Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:39.843418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:39.843473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:39.843515Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895013819654549:4648]
2025-09-30T14:51:39.844034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895013909381426:5508] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:39.844177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:39.844463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:39.844516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:39.844852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:39.844921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:39.844929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:39.844930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:39.844931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:39.844932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:39.844934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:39.844935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:39.844936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:39.844937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:39.844939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:39.844940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.844941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.844942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.844943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:39.844944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:39.844951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:39.844962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:39.844967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:39.844971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:39.844976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:39.844980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:39.844984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:39.844988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:39.844992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:39.844997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:39.845001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.845005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.845009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.845013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:39.845018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:39.845027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:39.845035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:39.845041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:39.845047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:39.845051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:39.845056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:39.845060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:39.845066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:39.845071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:39.845080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:39.845085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:39.845096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:39.845101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:39.845107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:39.845116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:39.845122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:39.845134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:39.845140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:39.845145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:39.845150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:39.845155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.845160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.845165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.845171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.845175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.845181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.845185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:39.845191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:39.845196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:39.845201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:39.845248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:39.850494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895013909381426:5508] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:39.850515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895013909381426:5508] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:39.850519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895013909381426:5508] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:39.850590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 518 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:39.850773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:39.851652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:39.851673Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:39.851676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:39.851679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:39.851686Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 517 [2:7555895013819654549:4648]
2025-09-30T14:51:39.851702Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:39.851718Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:39.851722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.851725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.851728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.851743Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:39.851756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:39.851762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:39.851820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.851828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.851830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.851833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:39.851836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:39.851931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:39.851939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.851952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.851968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.851987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:39.852007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895013909381465:5508], now have 1 active actors on pipe
2025-09-30T14:51:39.852015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895013909381368:2454], now have 1 active actors on pipe
2025-09-30T14:51:39.852021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895013819654544:4648]
2025-09-30T14:51:39.852023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895013819654544:4648]
2025-09-30T14:51:39.852024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895013819654544:4648]
2025-09-30T14:51:39.852041Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:39.852033Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 517
2025-09-30T14:51:39.852061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:39.852061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:39.852065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:39.852068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:39.852080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:39.852083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:39.852073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 517
2025-09-30T14:51:39.852125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895013819654544:4648]
2025-09-30T14:51:39.852137Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:39.852145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:39.852151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:39.852155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:39.852199Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3505a349-8af615f2-5b4ad43f-d0b26de9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:39.852211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.852214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.852216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:39.852225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.852233Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:39.852253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:39.852423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:39.852430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:39.852443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:39.852522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 518 partition: 0 MaxSeqNo: 42 sessionId: src_id|3505a349-8af615f2-5b4ad43f-d0b26de9_0
2025-09-30T14:51:39.852861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4a58996-baab38cb-243e7a2e-55728550_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3505a349-8af615f2-5b4ad43f-d0b26de9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:39.855584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3505a349-8af615f2-5b4ad43f-d0b26de9_0] Write session: try to update token
2025-09-30T14:51:39.855601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3505a349-8af615f2-5b4ad43f-d0b26de9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:39.864146Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:39.864166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:39.864169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:39.864171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:39.864180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895013819654544:4648]
2025-09-30T14:51:39.864185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895013819654544:4648]
2025-09-30T14:51:39.864189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895013819654544:4648]
2025-09-30T14:51:39.864231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:39.864238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.864243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:39.864264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:39.864280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:39.864285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:39.864391Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:39.871012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 518 sessionId: src_id|3505a349-8af615f2-5b4ad43f-d0b26de9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:39.874179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:39.932347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895013909381484:5419]
2025-09-30T14:51:39.932645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 517, pipe: [1:7555895013909381484:5419]
2025-09-30T14:51:39.971989Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:39.972321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:39.972333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:39.972349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895013909381484:5419], now have 1 active actors on pipe
2025-09-30T14:51:39.972546Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:39.972528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:39.972545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:39.972550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:39.972589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895013909381484:5419]
2025-09-30T14:51:39.972599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 518 reason: error at write: Disconnected sessionId: src_id|3505a349-8af615f2-5b4ad43f-d0b26de9_0
2025-09-30T14:51:39.972778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 518 sessionId: src_id|3505a349-8af615f2-5b4ad43f-d0b26de9_0 is DEAD
2025-09-30T14:51:39.972899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3505a349-8af615f2-5b4ad43f-d0b26de9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:39.972927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3505a349-8af615f2-5b4ad43f-d0b26de9_0] Write session will restart in 0.005041s
2025-09-30T14:51:39.972949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3505a349-8af615f2-5b4ad43f-d0b26de9_0] Write session: Do CDS request
2025-09-30T14:51:39.972957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3505a349-8af615f2-5b4ad43f-d0b26de9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:39.978770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3505a349-8af615f2-5b4ad43f-d0b26de9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:39.978881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:39.978896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 519
2025-09-30T14:51:39.979043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 519 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:39.979076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 519 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:39.979087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=519 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:39.979092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:39.979495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 519 sessionId:  describe result for acl check
2025-09-30T14:51:39.979532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:39.979540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:39.979541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:39.979546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895013909381514:5515] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:39.980091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895013909381514:5515] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:39.981770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895013909381514:5515] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:39.982069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:39.983822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:39.984021Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:39.984031Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:39.984041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:39.984092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:39.984129Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895013819654646:4651]
2025-09-30T14:51:39.984293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895013909381514:5515] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:39.984306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895013909381514:5515] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:39.984309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895013909381514:5515] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:39.984317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 519 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:39.984782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:39.985028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:39.985069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:39.985386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:39.985443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:39.985450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:39.985451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:39.985452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:39.985453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:39.985454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:39.985456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:39.985457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:39.985458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:39.985460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:39.985461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.985462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.985463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.985464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:39.985465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:39.985471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:39.985481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:39.985485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:39.985490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:39.985494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:39.985499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:39.985503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:39.985507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:39.985511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:39.985516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:39.985520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.985524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.985528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.985532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:39.985536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:39.985549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:39.985562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:39.985573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:39.985579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:39.985590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:39.985600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:39.985606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:39.985617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:39.985621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:39.985626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:39.985630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:39.985636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:39.985645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:39.985650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:39.985658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:39.985663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:39.985667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:39.985675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:39.985679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:39.985689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:39.985697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.985702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.985711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.985720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.985725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.985734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.985738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:39.985744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:39.985752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:39.985757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:39.985804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:39.991015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:39.991895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:39.991917Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:39.991920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:39.991924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:39.991931Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 518 [2:7555895013819654646:4651]
2025-09-30T14:51:39.991948Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:39.991963Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:39.991969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.991972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.991975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.991990Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:39.992002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:39.992014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:39.992073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.992081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.992083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.992087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:39.992089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:39.992153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:39.992161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:39.992174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:39.992192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:39.992215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:39.992237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895013909381486:2454], now have 1 active actors on pipe
2025-09-30T14:51:39.992245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895013909381587:5515], now have 1 active actors on pipe
2025-09-30T14:51:39.992251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895013819654641:4651]
2025-09-30T14:51:39.992253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895013819654641:4651]
2025-09-30T14:51:39.992255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895013819654641:4651]
2025-09-30T14:51:39.992268Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:39.992281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:39.992285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:39.992289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:39.992289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:39.992303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:39.992306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:39.992306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 518
2025-09-30T14:51:39.992313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 518
2025-09-30T14:51:39.992336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895013819654641:4651]
2025-09-30T14:51:39.992353Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:39.992358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:39.992374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:39.992378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:39.992421Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4fca168e-6985b39d-98446601-91ec91a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:39.992428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.992434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.992436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:39.992447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.992455Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:39.992477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:39.992663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:39.992673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:39.992689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:39.992813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 519 partition: 0 MaxSeqNo: 42 sessionId: src_id|4fca168e-6985b39d-98446601-91ec91a6_0
2025-09-30T14:51:39.993158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3505a349-8af615f2-5b4ad43f-d0b26de9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4fca168e-6985b39d-98446601-91ec91a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:39.995979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fca168e-6985b39d-98446601-91ec91a6_0] Write session: try to update token
2025-09-30T14:51:39.995996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fca168e-6985b39d-98446601-91ec91a6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:40.004669Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:40.004693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:40.004696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:40.004698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:40.004708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895013819654641:4651]
2025-09-30T14:51:40.004713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895013819654641:4651]
2025-09-30T14:51:40.004720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895013819654641:4651]
2025-09-30T14:51:40.004758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:40.004759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:40.004766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.004769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:40.004775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:40.004779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:40.004920Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:40.010066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 519 sessionId: src_id|4fca168e-6985b39d-98446601-91ec91a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:40.012979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:40.072658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895018204348899:5419]
2025-09-30T14:51:40.072950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 518, pipe: [1:7555895018204348899:5419]
2025-09-30T14:51:40.119284Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:40.119747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:40.119768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:40.119809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895018204348899:5419], now have 1 active actors on pipe
2025-09-30T14:51:40.120057Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:40.120066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:40.120092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:40.120097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:40.120129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895018204348899:5419]
2025-09-30T14:51:40.120161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 519 reason: error at write: Disconnected sessionId: src_id|4fca168e-6985b39d-98446601-91ec91a6_0
2025-09-30T14:51:40.120369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 519 sessionId: src_id|4fca168e-6985b39d-98446601-91ec91a6_0 is DEAD
2025-09-30T14:51:40.120514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fca168e-6985b39d-98446601-91ec91a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:40.120524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fca168e-6985b39d-98446601-91ec91a6_0] Write session will restart in 0.006107s
2025-09-30T14:51:40.120550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fca168e-6985b39d-98446601-91ec91a6_0] Write session: Do CDS request
2025-09-30T14:51:40.120558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fca168e-6985b39d-98446601-91ec91a6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:40.127771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fca168e-6985b39d-98446601-91ec91a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:40.127814Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:40.127831Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 520
2025-09-30T14:51:40.127987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 520 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:40.128020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 520 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:40.128030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=520 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:40.128035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:40.128499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 520 sessionId:  describe result for acl check
2025-09-30T14:51:40.128537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:40.128543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:40.128544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:40.128549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895018204348945:5519] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:40.128999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895018204348945:5519] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:40.130442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:40.130661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895018204348945:5519] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:40.132047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:40.132258Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:40.132273Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:40.132287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:40.132359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:40.132405Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895018114622044:4654]
2025-09-30T14:51:40.133047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:40.133257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895018204348945:5519] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:40.133275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895018204348945:5519] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:40.133279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895018204348945:5519] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:40.133288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 520 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:40.133370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:40.133432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:40.133769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:40.133862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:40.133871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:40.133873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:40.133874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:40.133875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:40.133876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:40.133878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:40.133879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:40.133880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:40.133881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:40.133883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.133884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.133885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.133886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:40.133887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:40.133894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:40.133904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:40.133909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:40.133913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:40.133917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:40.133922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:40.133930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:40.133935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:40.133939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:40.133943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:40.133951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.133955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.133964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.133968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:40.133976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:40.133984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:40.133998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:40.134010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:40.134016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:40.134026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:40.134035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:40.134045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:40.134055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:40.134065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:40.134075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:40.134084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:40.134091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:40.134101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:40.134111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:40.134116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:40.134124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:40.134131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:40.134142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:40.134146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:40.134152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:40.134158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.134164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.134174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.134183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.134190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.134200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.134205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:40.134210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:40.134215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:40.134220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:40.134270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:40.139731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:40.140825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:40.140852Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:40.140855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:40.140860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:40.140867Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 519 [2:7555895018114622044:4654]
2025-09-30T14:51:40.140885Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:40.140901Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:40.140904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:40.140907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:40.140910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:40.140929Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:40.140949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:40.140956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:40.141023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.141035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.141038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.141041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:40.141044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:40.141114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:40.141122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.141138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.141156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.141175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:40.141195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895018204348998:5519], now have 1 active actors on pipe
2025-09-30T14:51:40.141199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895018204348900:2454], now have 1 active actors on pipe
2025-09-30T14:51:40.141206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895018114622038:4654]
2025-09-30T14:51:40.141208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895018114622038:4654]
2025-09-30T14:51:40.141210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895018114622038:4654]
2025-09-30T14:51:40.141223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:40.141236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:40.141245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:40.141248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:40.141250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:40.141259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:40.141269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:40.141308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895018114622038:4654]
2025-09-30T14:51:40.141297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 519
2025-09-30T14:51:40.141322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:40.141299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 519
2025-09-30T14:51:40.141327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:40.141363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:40.141374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:40.141412Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17017aad-bf4be33e-da7c6f2d-44a01cd8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:40.141426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:40.141434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:40.141437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:40.141448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:40.141463Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:40.141481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:40.141658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:40.141670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:40.141689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:40.141838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 520 partition: 0 MaxSeqNo: 42 sessionId: src_id|17017aad-bf4be33e-da7c6f2d-44a01cd8_0
2025-09-30T14:51:40.142218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fca168e-6985b39d-98446601-91ec91a6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|17017aad-bf4be33e-da7c6f2d-44a01cd8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:40.145290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17017aad-bf4be33e-da7c6f2d-44a01cd8_0] Write session: try to update token
2025-09-30T14:51:40.145316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17017aad-bf4be33e-da7c6f2d-44a01cd8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:40.153470Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:40.153494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:40.153497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:40.153499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:40.153507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895018114622038:4654]
2025-09-30T14:51:40.153512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895018114622038:4654]
2025-09-30T14:51:40.153516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895018114622038:4654]
2025-09-30T14:51:40.153555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:40.153559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.153561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:40.153570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:40.153577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:40.153583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:40.153708Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:40.160338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 520 sessionId: src_id|17017aad-bf4be33e-da7c6f2d-44a01cd8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:40.163184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:40.220103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895018204349007:5419]
2025-09-30T14:51:40.220475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 519, pipe: [1:7555895018204349007:5419]
2025-09-30T14:51:40.261037Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:40.261340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:40.261351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:40.261368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895018204349007:5419], now have 1 active actors on pipe
2025-09-30T14:51:40.261654Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:40.261661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:40.261665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:40.261678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:40.261717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895018204349007:5419]
2025-09-30T14:51:40.261751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 520 reason: error at write: Disconnected sessionId: src_id|17017aad-bf4be33e-da7c6f2d-44a01cd8_0
2025-09-30T14:51:40.261925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 520 sessionId: src_id|17017aad-bf4be33e-da7c6f2d-44a01cd8_0 is DEAD
2025-09-30T14:51:40.262084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17017aad-bf4be33e-da7c6f2d-44a01cd8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:40.262095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17017aad-bf4be33e-da7c6f2d-44a01cd8_0] Write session will restart in 0.006483s
2025-09-30T14:51:40.262119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17017aad-bf4be33e-da7c6f2d-44a01cd8_0] Write session: Do CDS request
2025-09-30T14:51:40.262124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17017aad-bf4be33e-da7c6f2d-44a01cd8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:40.269796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17017aad-bf4be33e-da7c6f2d-44a01cd8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:40.269862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:40.269878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 521
2025-09-30T14:51:40.270000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 521 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:40.270025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 521 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:40.270030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=521 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:40.270034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:40.270377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 521 sessionId:  describe result for acl check
2025-09-30T14:51:40.270401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:40.270403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:40.270406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:40.270410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895018204349066:5523] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:40.270856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895018204349066:5523] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:40.271113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:40.272505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895018204349066:5523] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:40.272895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:40.273109Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:40.273117Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:40.273126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:40.273170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:40.273198Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895018114622143:4656]
2025-09-30T14:51:40.273641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:40.273965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:40.274038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:40.274388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:40.274492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:40.274503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:40.274504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:40.274505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:40.274506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:40.274507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:40.274508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:40.274510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:40.274511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:40.274511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:40.274512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.274513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.274515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.274516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:40.274517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:40.274523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:40.274534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:40.274539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:40.274543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:40.274547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:40.274551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:40.274554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:40.274558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:40.274562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:40.274567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:40.274570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.274574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.274578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.274582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:40.274586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:40.274595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:40.274603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:40.274609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:40.274615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:40.274619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:40.274626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:40.274630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:40.274636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:40.274642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:40.274648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:40.274653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:40.274658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:40.274663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:40.274668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:40.274672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:40.274677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:40.274681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:40.274686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:40.274690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:40.274695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:40.274700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.274704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.274708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.274714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.274719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.274724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.274728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:40.274733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:40.274738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:40.274742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:40.274788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:40.275082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895018204349066:5523] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:40.275098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895018204349066:5523] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:40.275102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895018204349066:5523] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:40.275109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 521 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:40.280417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:40.281418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:40.281443Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:40.281447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:40.281452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:40.281459Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 520 [2:7555895018114622143:4656]
2025-09-30T14:51:40.281477Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:40.281495Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:40.281507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:40.281510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:40.281512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:40.281531Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:40.281537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:40.281545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:40.281603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.281610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.281612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.281616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:40.281619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:40.281684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:40.281691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.281701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.281708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.281718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:40.281735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895018114622138:4656]
2025-09-30T14:51:40.281742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895018114622138:4656]
2025-09-30T14:51:40.281745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895018114622138:4656]
2025-09-30T14:51:40.281755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:40.281774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:40.281795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:40.281803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:40.281812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:40.281817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:40.281820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:40.281850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895018204349108:5523], now have 1 active actors on pipe
2025-09-30T14:51:40.281862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895018204349008:2454], now have 1 active actors on pipe
2025-09-30T14:51:40.281866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895018114622138:4656]
2025-09-30T14:51:40.281878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:40.281896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:40.281918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 520
2025-09-30T14:51:40.281933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 520
2025-09-30T14:51:40.281974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:40.281987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:40.282017Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33f395ed-894233f0-db096e0f-557fc69f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:40.282032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:40.282041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:40.282044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:40.282054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:40.282071Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:40.282095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:40.282282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:40.282292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:40.282308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:40.282418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 521 partition: 0 MaxSeqNo: 42 sessionId: src_id|33f395ed-894233f0-db096e0f-557fc69f_0
2025-09-30T14:51:40.282797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17017aad-bf4be33e-da7c6f2d-44a01cd8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|33f395ed-894233f0-db096e0f-557fc69f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:40.285813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33f395ed-894233f0-db096e0f-557fc69f_0] Write session: try to update token
2025-09-30T14:51:40.285837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33f395ed-894233f0-db096e0f-557fc69f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:40.293646Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:40.293664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:40.293673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895018114622138:4656]
2025-09-30T14:51:40.293720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:40.293736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:40.293899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:40.294033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:40.294177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:40.294316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:40.294532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:40.294575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:40.300970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 521 sessionId: src_id|33f395ed-894233f0-db096e0f-557fc69f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:40.303578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:40.304311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:40.304334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:40.304351Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:40.304353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:40.304355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:40.304356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:40.304363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895018114622138:4656]
2025-09-30T14:51:40.304368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895018114622138:4656]
2025-09-30T14:51:40.304374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895018114622138:4656]
2025-09-30T14:51:40.304411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:40.304409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:40.304415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:40.304416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.304419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:40.304419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:40.304544Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:40.361932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895018204349116:5419]
2025-09-30T14:51:40.362218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 520, pipe: [1:7555895018204349116:5419]
2025-09-30T14:51:40.408001Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:40.408304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:40.408347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895018204349116:5419], now have 1 active actors on pipe
2025-09-30T14:51:40.408458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:40.408554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895018204349116:5419]
2025-09-30T14:51:40.408581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:40.418621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:40.418979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:40.418996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:40.419016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 521 reason: error at write: Disconnected sessionId: src_id|33f395ed-894233f0-db096e0f-557fc69f_0
2025-09-30T14:51:40.419145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 521 sessionId: src_id|33f395ed-894233f0-db096e0f-557fc69f_0 is DEAD
2025-09-30T14:51:40.419279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f395ed-894233f0-db096e0f-557fc69f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:40.419291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f395ed-894233f0-db096e0f-557fc69f_0] Write session will restart in 0.005394s
2025-09-30T14:51:40.419315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f395ed-894233f0-db096e0f-557fc69f_0] Write session: Do CDS request
2025-09-30T14:51:40.419323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f395ed-894233f0-db096e0f-557fc69f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:40.425046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:40.425296Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:40.425306Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:40.425317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:40.425382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:40.425423Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895018114622244:4658]
2025-09-30T14:51:40.425775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33f395ed-894233f0-db096e0f-557fc69f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:40.425818Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:40.425831Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 522
2025-09-30T14:51:40.426015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 522 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:40.426044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 522 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:40.426053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=522 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:40.426066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:40.426077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:40.426350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:40.426394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:40.426432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 522 sessionId:  describe result for acl check
2025-09-30T14:51:40.426458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:40.426472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:40.426474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:40.426479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895018204349182:5527] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:40.426717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:40.426787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:40.426794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:40.426795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:40.426797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:40.426798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:40.426799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:40.426801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:40.426802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:40.426803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:40.426805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:40.426806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.426807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.426809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.426810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:40.426811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:40.426817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:40.426826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:40.426831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:40.426835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:40.426839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:40.426842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:40.426846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:40.426850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:40.426854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:40.426860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:40.426864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.426868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.426871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.426875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:40.426878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:40.426885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:40.426893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:40.426898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:40.426903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:40.426908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:40.426914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:40.426918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:40.426924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:40.426935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:40.426940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:40.426926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895018204349182:5527] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:40.426945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:40.426955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:40.426960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:40.426966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:40.426970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:40.426975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:40.426980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:40.426987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:40.426991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:40.426997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:40.427007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.427012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.427033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.427043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.427049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.427055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.427059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:40.427065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:40.427074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:40.427080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:40.427121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:40.429463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895018204349182:5527] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:40.432312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895018204349182:5527] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:40.432331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895018204349182:5527] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:40.432334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895018204349182:5527] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:40.432342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 522 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:40.432604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:40.433492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:40.433509Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:40.433512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:40.433516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:40.433522Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 521 [2:7555895018114622244:4658]
2025-09-30T14:51:40.433538Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:40.433553Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:40.433557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:40.433561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:40.433563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:40.433577Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:40.433583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:40.433593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:40.433650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.433657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.433659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.433662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:40.433665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:40.433723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:40.433731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.433743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.433754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.433778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:40.433799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895018204349218:5527], now have 1 active actors on pipe
2025-09-30T14:51:40.433807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895018204349117:2454], now have 1 active actors on pipe
2025-09-30T14:51:40.433812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895018114622238:4658]
2025-09-30T14:51:40.433814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895018114622238:4658]
2025-09-30T14:51:40.433817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895018114622238:4658]
2025-09-30T14:51:40.433829Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:40.433846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:40.433847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:40.433851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:40.433853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:40.433864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:40.433867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:40.433866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 521
2025-09-30T14:51:40.433872Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 521
2025-09-30T14:51:40.433896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895018114622238:4658]
2025-09-30T14:51:40.433904Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:40.433906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:40.433928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:40.433938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:40.433970Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec779fe5-f919f164-7d9b169e-80ebcb20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:40.433981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:40.433984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:40.433986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:40.433997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:40.434010Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:40.434031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:40.434142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:40.434152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:40.434164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:40.434240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 522 partition: 0 MaxSeqNo: 42 sessionId: src_id|ec779fe5-f919f164-7d9b169e-80ebcb20_0
2025-09-30T14:51:40.434591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f395ed-894233f0-db096e0f-557fc69f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ec779fe5-f919f164-7d9b169e-80ebcb20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:40.437364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec779fe5-f919f164-7d9b169e-80ebcb20_0] Write session: try to update token
2025-09-30T14:51:40.437380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec779fe5-f919f164-7d9b169e-80ebcb20_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:40.446574Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:40.446597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:40.446600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:40.446602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:40.446612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895018114622238:4658]
2025-09-30T14:51:40.446621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895018114622238:4658]
2025-09-30T14:51:40.446625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895018114622238:4658]
2025-09-30T14:51:40.446663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:40.446672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:40.446674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.446677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:40.446679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:40.446682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:40.446820Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:40.452143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 522 sessionId: src_id|ec779fe5-f919f164-7d9b169e-80ebcb20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:40.454736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:40.508859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895018204349228:5419]
2025-09-30T14:51:40.509088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 521, pipe: [1:7555895018204349228:5419]
2025-09-30T14:51:40.554855Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:40.555118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:40.555132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:40.555165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895018204349228:5419], now have 1 active actors on pipe
2025-09-30T14:51:40.555353Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:40.555388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:40.555398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895018204349228:5419]
2025-09-30T14:51:40.555403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:40.555416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:40.555474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 522 reason: error at write: Disconnected sessionId: src_id|ec779fe5-f919f164-7d9b169e-80ebcb20_0
2025-09-30T14:51:40.555654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 522 sessionId: src_id|ec779fe5-f919f164-7d9b169e-80ebcb20_0 is DEAD
2025-09-30T14:51:40.555754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec779fe5-f919f164-7d9b169e-80ebcb20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:40.555764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec779fe5-f919f164-7d9b169e-80ebcb20_0] Write session will restart in 0.005598s
2025-09-30T14:51:40.555787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec779fe5-f919f164-7d9b169e-80ebcb20_0] Write session: Do CDS request
2025-09-30T14:51:40.555791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec779fe5-f919f164-7d9b169e-80ebcb20_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:40.562849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:40.562865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 523
2025-09-30T14:51:40.562904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec779fe5-f919f164-7d9b169e-80ebcb20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:40.563199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 523 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:40.563233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 523 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:40.563236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=523 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:40.563240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:40.563645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 523 sessionId:  describe result for acl check
2025-09-30T14:51:40.563668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:40.563673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:40.563675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:40.563679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895018204349295:5538] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:40.564053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895018204349295:5538] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:40.565243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:40.565838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895018204349295:5538] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:40.567227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:40.567425Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:40.567436Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:40.567446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:40.567493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:40.567524Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895018114622361:4667]
2025-09-30T14:51:40.568081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:40.568330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:40.568349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895018204349295:5538] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:40.568363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895018204349295:5538] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:40.568367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895018204349295:5538] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:40.568374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 523 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:40.568378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:40.568689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:40.568751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:40.568757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:40.568758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:40.568759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:40.568761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:40.568762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:40.568763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:40.568764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:40.568765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:40.568767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:40.568768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.568769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.568770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.568771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:40.568772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:40.568777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:40.568787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:40.568791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:40.568796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:40.568800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:40.568804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:40.568807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:40.568810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:40.568814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:40.568818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:40.568822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.568826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.568830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.568834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:40.568838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:40.568845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:40.568853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:40.568859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:40.568864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:40.568868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:40.568873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:40.568877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:40.568882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:40.568887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:40.568892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:40.568896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:40.568902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:40.568906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:40.568911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:40.568915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:40.568919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:40.568923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:40.568928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:40.568932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:40.568937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:40.568943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.568952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.568957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.568968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.568972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.568978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.568981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:40.568986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:40.568990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:40.568995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:40.569045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:40.574390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:40.575440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:40.575461Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:40.575463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:40.575467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:40.575473Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 522 [2:7555895018114622361:4667]
2025-09-30T14:51:40.575487Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:40.575503Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:40.575507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:40.575510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:40.575512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:40.575527Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:40.575534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:40.575540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:40.575596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.575607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.575609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.575612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:40.575615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:40.575685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:40.575694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.575708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.575721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.575744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:40.575768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895018204349229:2454], now have 1 active actors on pipe
2025-09-30T14:51:40.575776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895018204349341:5538], now have 1 active actors on pipe
2025-09-30T14:51:40.575783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895018114622355:4667]
2025-09-30T14:51:40.575785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895018114622355:4667]
2025-09-30T14:51:40.575789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895018114622355:4667]
2025-09-30T14:51:40.575801Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:40.575819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:40.575837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:40.575844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:40.575846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:40.575850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:40.575852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:40.575842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 522
2025-09-30T14:51:40.575874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895018114622355:4667]
2025-09-30T14:51:40.575882Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:40.575884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:40.575891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 522
2025-09-30T14:51:40.575932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:40.575941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:40.575967Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c689cc0-f47bf301-94feb263-743aa730_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:40.575978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:40.575982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:40.575984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:40.575993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:40.576006Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:40.576022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:40.576182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:40.576192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:40.576207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:40.576298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 523 partition: 0 MaxSeqNo: 42 sessionId: src_id|7c689cc0-f47bf301-94feb263-743aa730_0
2025-09-30T14:51:40.576655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec779fe5-f919f164-7d9b169e-80ebcb20_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7c689cc0-f47bf301-94feb263-743aa730_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:40.579382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c689cc0-f47bf301-94feb263-743aa730_0] Write session: try to update token
2025-09-30T14:51:40.579402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c689cc0-f47bf301-94feb263-743aa730_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:40.587876Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:40.587895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:40.587897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:40.587898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:40.587905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895018114622355:4667]
2025-09-30T14:51:40.587907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895018114622355:4667]
2025-09-30T14:51:40.587909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895018114622355:4667]
2025-09-30T14:51:40.587942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:40.587946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.587948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:40.587951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:40.587957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:40.587961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:40.588086Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:40.593993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 523 sessionId: src_id|7c689cc0-f47bf301-94feb263-743aa730_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:40.596663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:40.655812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895018204349361:5419]
2025-09-30T14:51:40.656104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 522, pipe: [1:7555895018204349361:5419]
2025-09-30T14:51:40.694809Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:40.695176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:40.695198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:40.695255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895018204349361:5419], now have 1 active actors on pipe
2025-09-30T14:51:40.695467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:40.695491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:40.695495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:40.695527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895018204349361:5419]
2025-09-30T14:51:40.695559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 523 reason: error at write: Disconnected sessionId: src_id|7c689cc0-f47bf301-94feb263-743aa730_0
2025-09-30T14:51:40.695701Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:40.695747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 523 sessionId: src_id|7c689cc0-f47bf301-94feb263-743aa730_0 is DEAD
2025-09-30T14:51:40.695884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c689cc0-f47bf301-94feb263-743aa730_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:40.695895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c689cc0-f47bf301-94feb263-743aa730_0] Write session will restart in 0.008969s
2025-09-30T14:51:40.695923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c689cc0-f47bf301-94feb263-743aa730_0] Write session: Do CDS request
2025-09-30T14:51:40.695932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c689cc0-f47bf301-94feb263-743aa730_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:40.704947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:40.705817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c689cc0-f47bf301-94feb263-743aa730_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:40.706149Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:40.706166Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 524
2025-09-30T14:51:40.706290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 524 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:40.706320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 524 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:40.706330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=524 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:40.706335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:40.706807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 524 sessionId:  describe result for acl check
2025-09-30T14:51:40.706845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:40.706847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:40.706849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:40.706855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895018204349426:5543] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:40.706898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:40.707094Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:40.707106Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:40.707117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:40.707171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:40.707210Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895018114622486:4675]
2025-09-30T14:51:40.707404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895018204349426:5543] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:40.707884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:40.708216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:40.708269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:40.708597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:40.708667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:40.708673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:40.708674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:40.708676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:40.708677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:40.708678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:40.708679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:40.708680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:40.708682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:40.708683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:40.708684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.708685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.708686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.708687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:40.708688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:40.708694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:40.708704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:40.708708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:40.708712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:40.708716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:40.708721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:40.708725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:40.708729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:40.708733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:40.708736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:40.708740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.708744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.708747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.708751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:40.708754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:40.708761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:40.708769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:40.708775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:40.708781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:40.708786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:40.708791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:40.708795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:40.708800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:40.708804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:40.708809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:40.708813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:40.708819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:40.708824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:40.708829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:40.708834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:40.708839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:40.708844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:40.708849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:40.708853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:40.708859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:40.708863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.708869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.708874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.708879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.708884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.708891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.708901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:40.708907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:40.708911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:40.708916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:40.708968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:40.709634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895018204349426:5543] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:40.714075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895018204349426:5543] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:40.714091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895018204349426:5543] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:40.714095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895018204349426:5543] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:40.714103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 524 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:40.714314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:40.715324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:40.715339Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:40.715340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:40.715343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:40.715348Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 523 [2:7555895018114622486:4675]
2025-09-30T14:51:40.715360Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:40.715372Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:40.715375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:40.715377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:40.715378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:40.715391Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:40.715395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:40.715400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:40.715441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.715444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.715445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.715448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:40.715449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:40.715497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:40.715502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.715510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.715517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.715526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:40.715537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895018114622481:4675]
2025-09-30T14:51:40.715542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895018114622481:4675]
2025-09-30T14:51:40.715543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895018114622481:4675]
2025-09-30T14:51:40.715549Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:40.715559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:40.715564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:40.715568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:40.715570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:40.715571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:40.715572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:40.715579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895018204349465:5543], now have 1 active actors on pipe
2025-09-30T14:51:40.715582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895018204349362:2454], now have 1 active actors on pipe
2025-09-30T14:51:40.715605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895018114622481:4675]
2025-09-30T14:51:40.715617Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:40.715630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:40.715639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 523
2025-09-30T14:51:40.715665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 523
2025-09-30T14:51:40.715702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:40.715713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:40.715738Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ffee234-be838263-68f198fb-140b531_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:40.715749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:40.715753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:40.715755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:40.715765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:40.715777Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:40.715795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:40.715979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:40.715995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:40.716018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:40.716124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 524 partition: 0 MaxSeqNo: 42 sessionId: src_id|7ffee234-be838263-68f198fb-140b531_0
2025-09-30T14:51:40.716477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c689cc0-f47bf301-94feb263-743aa730_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7ffee234-be838263-68f198fb-140b531_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:40.719313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ffee234-be838263-68f198fb-140b531_0] Write session: try to update token
2025-09-30T14:51:40.719332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ffee234-be838263-68f198fb-140b531_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:40.727604Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:40.727627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:40.727630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:40.727633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:40.727642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895018114622481:4675]
2025-09-30T14:51:40.727646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895018114622481:4675]
2025-09-30T14:51:40.727650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895018114622481:4675]
2025-09-30T14:51:40.727691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:40.727696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:40.727697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.727700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:40.727703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:40.727708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:40.727834Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:40.734269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 524 sessionId: src_id|7ffee234-be838263-68f198fb-140b531_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:40.737026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:40.795593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895018204349472:5419]
2025-09-30T14:51:40.795888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 523, pipe: [1:7555895018204349472:5419]
2025-09-30T14:51:40.837553Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:40.837930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:40.837945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:40.837966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895018204349472:5419], now have 1 active actors on pipe
2025-09-30T14:51:40.838212Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:40.838234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895018204349472:5419]
2025-09-30T14:51:40.838253Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:40.838269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:40.838338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 524 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7ffee234-be838263-68f198fb-140b531_0
2025-09-30T14:51:40.838523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 524 sessionId: src_id|7ffee234-be838263-68f198fb-140b531_0 is DEAD
2025-09-30T14:51:40.838690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ffee234-be838263-68f198fb-140b531_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:40.838699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ffee234-be838263-68f198fb-140b531_0] Write session will restart in 0.009987s
2025-09-30T14:51:40.838723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ffee234-be838263-68f198fb-140b531_0] Write session: Do CDS request
2025-09-30T14:51:40.838729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ffee234-be838263-68f198fb-140b531_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:40.848221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:40.849747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ffee234-be838263-68f198fb-140b531_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:40.849822Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:40.849842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 525
2025-09-30T14:51:40.849906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:40.850000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 525 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:40.850045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 525 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:40.850055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=525 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:40.850059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:40.850124Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:40.850135Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:40.850146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:40.850194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:40.850233Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895018114622603:4678]
2025-09-30T14:51:40.850452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 525 sessionId:  describe result for acl check
2025-09-30T14:51:40.850492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:40.850499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:40.850501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:40.850508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895018204349540:5547] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:40.850878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:40.851031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895018204349540:5547] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:40.851203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:40.851278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:40.851646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:40.851712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:40.851718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:40.851719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:40.851720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:40.851721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:40.851722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:40.851723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:40.851725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:40.851726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:40.851727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:40.851728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.851729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.851730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.851731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:40.851732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:40.851738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:40.851747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:40.851751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:40.851756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:40.851760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:40.851764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:40.851769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:40.851773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:40.851777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:40.851781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:40.851785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.851789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.851793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.851797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:40.851800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:40.851806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:40.851815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:40.851821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:40.851826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:40.851831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:40.851836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:40.851840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:40.851846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:40.851850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:40.851855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:40.851859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:40.851864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:40.851869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:40.851874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:40.851878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:40.851883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:40.851888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:40.851893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:40.851897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:40.851903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:40.851907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.851912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.851916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.851927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.851933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.851943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.851947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:40.851957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:40.851963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:40.851968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:40.852026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:40.853084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895018204349540:5547] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:40.857019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895018204349540:5547] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:40.857037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895018204349540:5547] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:40.857041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895018204349540:5547] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:40.857050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 525 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:40.857418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:40.858456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:40.858485Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:40.858490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:40.858495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:40.858501Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 524 [2:7555895018114622603:4678]
2025-09-30T14:51:40.858518Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:40.858534Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:40.858542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:40.858546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:40.858548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:40.858562Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:40.858569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:40.858575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:40.858634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.858646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.858648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.858651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:40.858654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:40.858722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:40.858730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.858742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.858759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.858780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:40.858802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895018204349474:2454], now have 1 active actors on pipe
2025-09-30T14:51:40.858806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895018204349578:5547], now have 1 active actors on pipe
2025-09-30T14:51:40.858811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895018114622597:4678]
2025-09-30T14:51:40.858813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895018114622597:4678]
2025-09-30T14:51:40.858817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895018114622597:4678]
2025-09-30T14:51:40.858830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:40.858842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:40.858852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:40.858856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:40.858859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:40.858862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:40.858864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:40.858889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895018114622597:4678]
2025-09-30T14:51:40.858896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:40.858900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:40.858875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 524
2025-09-30T14:51:40.858884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 524
2025-09-30T14:51:40.858926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:40.858934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:40.858965Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5276af-97cb9213-3b8bb6ac-827a46bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:40.858976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:40.858987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:40.858990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:40.858999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:40.859008Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:40.859033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:40.859188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:40.859196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:40.859209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:40.859296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 525 partition: 0 MaxSeqNo: 42 sessionId: src_id|c5276af-97cb9213-3b8bb6ac-827a46bd_0
2025-09-30T14:51:40.859657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ffee234-be838263-68f198fb-140b531_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c5276af-97cb9213-3b8bb6ac-827a46bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:40.862613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5276af-97cb9213-3b8bb6ac-827a46bd_0] Write session: try to update token
2025-09-30T14:51:40.862637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5276af-97cb9213-3b8bb6ac-827a46bd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:40.871187Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:40.871203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:40.871206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:40.871208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:40.871217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895018114622597:4678]
2025-09-30T14:51:40.871221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895018114622597:4678]
2025-09-30T14:51:40.871225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895018114622597:4678]
2025-09-30T14:51:40.871281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:40.871286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:40.871290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.871293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:40.871300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:40.871304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:40.871423Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:40.877651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 525 sessionId: src_id|c5276af-97cb9213-3b8bb6ac-827a46bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:40.880364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:40.938434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895018204349599:5419]
2025-09-30T14:51:40.938718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 524, pipe: [1:7555895018204349599:5419]
2025-09-30T14:51:40.980833Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:40.981044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:40.981055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:40.981084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895018204349599:5419], now have 1 active actors on pipe
2025-09-30T14:51:40.981236Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:40.981248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:40.981274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895018204349599:5419]
2025-09-30T14:51:40.981290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:40.981360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 525 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c5276af-97cb9213-3b8bb6ac-827a46bd_0
2025-09-30T14:51:40.981524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 525 sessionId: src_id|c5276af-97cb9213-3b8bb6ac-827a46bd_0 is DEAD
2025-09-30T14:51:40.981677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5276af-97cb9213-3b8bb6ac-827a46bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:40.981699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5276af-97cb9213-3b8bb6ac-827a46bd_0] Write session will restart in 0.006502s
2025-09-30T14:51:40.981721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5276af-97cb9213-3b8bb6ac-827a46bd_0] Write session: Do CDS request
2025-09-30T14:51:40.981727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5276af-97cb9213-3b8bb6ac-827a46bd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:40.989741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5276af-97cb9213-3b8bb6ac-827a46bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:40.989787Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:40.989802Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 526
2025-09-30T14:51:40.989994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 526 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:40.990026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 526 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:40.990031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=526 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:40.990035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:40.990484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 526 sessionId:  describe result for acl check
2025-09-30T14:51:40.990520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:40.990526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:40.990528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:40.990533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895018204349675:5554] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:40.990577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:40.991046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895018204349675:5554] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:40.992311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:40.992522Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:40.992531Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:40.992543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:40.992593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:40.992630Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895018114622707:4680]
2025-09-30T14:51:40.993021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895018204349675:5554] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:40.993293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:40.993539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:40.993580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:40.993899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:40.993955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:40.993960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:40.993960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:40.993961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:40.993962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:40.993963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:40.993964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:40.993964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:40.993965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:40.993966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:40.993966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.993967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.993968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.993968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:40.993969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:40.993973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:40.993979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:40.993981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:40.993984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:40.993986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:40.993988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:40.993991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:40.993993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:40.993996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:40.993998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:40.994000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.994002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.994005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.994007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:40.994009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:40.994014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:40.994019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:40.994023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:40.994026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:40.994031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:40.994034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:40.994036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:40.994039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:40.994042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:40.994045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:40.994048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:40.994051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:40.994055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:40.994058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:40.994060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:40.994064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:40.994067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:40.994070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:40.994073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:40.994076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:40.994078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.994081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:40.994084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.994087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:40.994089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.994092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:40.994094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:40.994097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:40.994099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:40.994102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:40.994125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:40.999318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895018204349675:5554] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:40.999348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895018204349675:5554] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:40.999352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895018204349675:5554] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:40.999360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 526 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:40.999860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:41.000705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:41.000717Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:41.000720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:41.000724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:41.000731Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 525 [2:7555895018114622707:4680]
2025-09-30T14:51:41.000747Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:41.000762Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:41.000765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:41.000768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:41.000771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:41.000786Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:41.000793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:41.000799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:41.000857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.000869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.000871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.000875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:41.000877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:41.001037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:41.001048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.001062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.001076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.001096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:41.001097Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 525
2025-09-30T14:51:41.001120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895018204349610:2454], now have 1 active actors on pipe
2025-09-30T14:51:41.001103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 525
2025-09-30T14:51:41.001129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895018204349715:5554], now have 1 active actors on pipe
2025-09-30T14:51:41.001135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895018114622702:4680]
2025-09-30T14:51:41.001137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895018114622702:4680]
2025-09-30T14:51:41.001139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895018114622702:4680]
2025-09-30T14:51:41.001148Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:41.001158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:41.001164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:41.001164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:41.001166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:41.001179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:41.001182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:41.001203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:41.001212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:41.001261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895018114622702:4680]
2025-09-30T14:51:41.001273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:41.001288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:41.001294Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|734ead59-105e763e-87a9a9f4-a999097b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:41.001300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:41.001303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:41.001306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:41.001315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:41.001330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:41.001371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:41.001517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:41.001524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:41.001538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:41.001657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 526 partition: 0 MaxSeqNo: 42 sessionId: src_id|734ead59-105e763e-87a9a9f4-a999097b_0
2025-09-30T14:51:41.001997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5276af-97cb9213-3b8bb6ac-827a46bd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|734ead59-105e763e-87a9a9f4-a999097b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:41.004783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|734ead59-105e763e-87a9a9f4-a999097b_0] Write session: try to update token
2025-09-30T14:51:41.004806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|734ead59-105e763e-87a9a9f4-a999097b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:41.013411Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:41.013427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:41.013430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:41.013433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:41.013441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895018114622702:4680]
2025-09-30T14:51:41.013444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895018114622702:4680]
2025-09-30T14:51:41.013448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895018114622702:4680]
2025-09-30T14:51:41.013486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:41.013493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.013496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:41.013501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:41.013507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:41.013511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:41.013636Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:41.020758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 526 sessionId: src_id|734ead59-105e763e-87a9a9f4-a999097b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:41.023372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:41.081301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895022499317024:5419]
2025-09-30T14:51:41.081567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 525, pipe: [1:7555895022499317024:5419]
2025-09-30T14:51:41.126103Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:41.126505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:41.126519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:41.126537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895022499317024:5419], now have 1 active actors on pipe
2025-09-30T14:51:41.126755Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:41.126815Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:41.126820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:41.126824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:41.126873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895022499317024:5419]
2025-09-30T14:51:41.126884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 526 reason: error at write: Disconnected sessionId: src_id|734ead59-105e763e-87a9a9f4-a999097b_0
2025-09-30T14:51:41.127045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 526 sessionId: src_id|734ead59-105e763e-87a9a9f4-a999097b_0 is DEAD
2025-09-30T14:51:41.127223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|734ead59-105e763e-87a9a9f4-a999097b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:41.127234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|734ead59-105e763e-87a9a9f4-a999097b_0] Write session will restart in 0.008033s
2025-09-30T14:51:41.127270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|734ead59-105e763e-87a9a9f4-a999097b_0] Write session: Do CDS request
2025-09-30T14:51:41.127279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|734ead59-105e763e-87a9a9f4-a999097b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:41.136794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|734ead59-105e763e-87a9a9f4-a999097b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:41.136893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:41.136913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 527
2025-09-30T14:51:41.137062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 527 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:41.137112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 527 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:41.137123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=527 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:41.137128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:41.137474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:41.137590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 527 sessionId:  describe result for acl check
2025-09-30T14:51:41.137629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:41.137637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:41.137639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:41.137645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895022499317092:5558] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:41.138198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895022499317092:5558] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:41.139588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:41.139784Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:41.139798Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:41.139810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:41.139876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:41.139914Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895022409590112:4683]
2025-09-30T14:51:41.140543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895022499317092:5558] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:41.140604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:41.140880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:41.140922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:41.141242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:41.141305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:41.141312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:41.141313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:41.141314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:41.141316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:41.141317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:41.141318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:41.141320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:41.141321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:41.141322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:41.141324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.141325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.141326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.141328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:41.141329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:41.141335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:41.141346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:41.141351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:41.141355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:41.141360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:41.141365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:41.141369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:41.141374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:41.141379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:41.141384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:41.141389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.141394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.141398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.141402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:41.141407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:41.141414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:41.141422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:41.141429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:41.141441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:41.141447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:41.141453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:41.141458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:41.141464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:41.141469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:41.141475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:41.141485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:41.141491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:41.141496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:41.141502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:41.141507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:41.141513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:41.141520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:41.141526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:41.141531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:41.141538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:41.141546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.141551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.141556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.141564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.141571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.141579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.141584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:41.141590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:41.141596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:41.141603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:41.141650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:41.146962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895022499317092:5558] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:41.146999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895022499317092:5558] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:41.147009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895022499317092:5558] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:41.147026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 527 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:41.147218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:41.148085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:41.148099Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:41.148101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:41.148104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:41.148109Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 526 [2:7555895022409590112:4683]
2025-09-30T14:51:41.148121Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:41.148134Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:41.148136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:41.148138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:41.148139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:41.148152Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:41.148156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:41.148161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:41.148206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.148212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.148214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.148216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:41.148218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:41.148270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:41.148275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.148284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.148295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.148317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:41.148332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895022499317025:2454], now have 1 active actors on pipe
2025-09-30T14:51:41.148336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895022499317132:5558], now have 1 active actors on pipe
2025-09-30T14:51:41.148340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895022409590106:4683]
2025-09-30T14:51:41.148341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895022409590106:4683]
2025-09-30T14:51:41.148343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895022409590106:4683]
2025-09-30T14:51:41.148355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:41.148369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:41.148374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:41.148378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:41.148380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:41.148388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:41.148391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:41.148382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 526
2025-09-30T14:51:41.148401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 526
2025-09-30T14:51:41.148423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895022409590106:4683]
2025-09-30T14:51:41.148431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:41.148434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:41.148448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:41.148455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:41.148488Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89219081-429deed7-889b96a7-b771a7ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:41.148496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:41.148498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:41.148500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:41.148507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:41.148517Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:41.148534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:41.148723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:41.148734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:41.148748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:41.148859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 527 partition: 0 MaxSeqNo: 42 sessionId: src_id|89219081-429deed7-889b96a7-b771a7ab_0
2025-09-30T14:51:41.149222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|734ead59-105e763e-87a9a9f4-a999097b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|89219081-429deed7-889b96a7-b771a7ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:41.152231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89219081-429deed7-889b96a7-b771a7ab_0] Write session: try to update token
2025-09-30T14:51:41.152257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89219081-429deed7-889b96a7-b771a7ab_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:41.160158Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:41.160177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:41.160187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895022409590106:4683]
2025-09-30T14:51:41.160234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:41.160236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:41.160405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:41.160551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:41.160685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:41.160859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:41.161055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:41.161099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:41.167514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 527 sessionId: src_id|89219081-429deed7-889b96a7-b771a7ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:41.170310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:41.170976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:41.170998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:41.171016Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:41.171019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:41.171024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:41.171026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:41.171035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895022409590106:4683]
2025-09-30T14:51:41.171039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895022409590106:4683]
2025-09-30T14:51:41.171045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895022409590106:4683]
2025-09-30T14:51:41.171081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:41.171090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:41.171092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:41.171093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:41.171097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.171100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:41.171241Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:41.227194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895022499317139:5419]
2025-09-30T14:51:41.227449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 526, pipe: [1:7555895022499317139:5419]
2025-09-30T14:51:41.278336Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:41.278651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:41.278688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895022499317139:5419], now have 1 active actors on pipe
2025-09-30T14:51:41.278810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:41.278870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895022499317139:5419]
2025-09-30T14:51:41.278901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:41.278919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:41.278922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:41.278993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 527 reason: error at write: Disconnected sessionId: src_id|89219081-429deed7-889b96a7-b771a7ab_0
2025-09-30T14:51:41.279141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 527 sessionId: src_id|89219081-429deed7-889b96a7-b771a7ab_0 is DEAD
2025-09-30T14:51:41.279333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89219081-429deed7-889b96a7-b771a7ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:41.279346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89219081-429deed7-889b96a7-b771a7ab_0] Write session will restart in 0.008666s
2025-09-30T14:51:41.279381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89219081-429deed7-889b96a7-b771a7ab_0] Write session: Do CDS request
2025-09-30T14:51:41.279387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89219081-429deed7-889b96a7-b771a7ab_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:41.288822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89219081-429deed7-889b96a7-b771a7ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:41.288878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:41.288894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 528
2025-09-30T14:51:41.289078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 528 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:41.289127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 528 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:41.289140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=528 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:41.289144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:41.289610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 528 sessionId:  describe result for acl check
2025-09-30T14:51:41.289651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:41.289653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:41.289655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:41.289661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895022499317207:5562] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:41.289716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:41.290251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895022499317207:5562] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:41.291674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:41.291878Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:41.291895Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:41.291908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:41.291975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:41.292025Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895022409590219:4685]
2025-09-30T14:51:41.292054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895022499317207:5562] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:41.292640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:41.293028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:41.293087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:41.293463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:41.293551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:41.293559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:41.293560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:41.293561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:41.293562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:41.293563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:41.293564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:41.293566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:41.293567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:41.293568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:41.293570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.293571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.293572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.293573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:41.293574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:41.293580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:41.293589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:41.293592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:41.293596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:41.293601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:41.293605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:41.293609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:41.293613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:41.293617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:41.293621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:41.293625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.293629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.293633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.293637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:41.293641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:41.293649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:41.293656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:41.293662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:41.293668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:41.293672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:41.293679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:41.293684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:41.293689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:41.293694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:41.293699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:41.293703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:41.293716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:41.293721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:41.293726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:41.293730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:41.293735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:41.293742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:41.293747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:41.293753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:41.293763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:41.293768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.293774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.293778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.293790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.293795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.293800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.293804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:41.293810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:41.293815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:41.293820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:41.293864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:41.294505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895022499317207:5562] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:41.294518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895022499317207:5562] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:41.294521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895022499317207:5562] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:41.294540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 528 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:41.299433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:41.300276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:41.300292Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:41.300295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:41.300300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:41.300307Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 527 [2:7555895022409590219:4685]
2025-09-30T14:51:41.300324Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:41.300339Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:41.300342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:41.300346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:41.300348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:41.300365Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:41.300373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:41.300382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:41.300450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.300459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.300464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.300467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:41.300469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:41.300534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:41.300537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.300550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.300563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.300581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:41.300599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895022499317247:5562], now have 1 active actors on pipe
2025-09-30T14:51:41.300607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895022409590213:4685]
2025-09-30T14:51:41.300609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895022409590213:4685]
2025-09-30T14:51:41.300611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895022409590213:4685]
2025-09-30T14:51:41.300623Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:41.300633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895022499317140:2454], now have 1 active actors on pipe
2025-09-30T14:51:41.300637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:41.300640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:41.300643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:41.300646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:41.300655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:41.300658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:41.300689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895022409590213:4685]
2025-09-30T14:51:41.300701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:41.300756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:41.300767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 527
2025-09-30T14:51:41.300773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 527
2025-09-30T14:51:41.300860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:41.300870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:41.300894Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4518e6dd-7f476e89-a2aa677e-dbe5c415_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:41.300905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:41.300909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:41.300911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:41.300920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:41.300929Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:41.300946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:41.301167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:41.301177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:41.301189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:41.301272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 528 partition: 0 MaxSeqNo: 42 sessionId: src_id|4518e6dd-7f476e89-a2aa677e-dbe5c415_0
2025-09-30T14:51:41.301614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89219081-429deed7-889b96a7-b771a7ab_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4518e6dd-7f476e89-a2aa677e-dbe5c415_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:41.304253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4518e6dd-7f476e89-a2aa677e-dbe5c415_0] Write session: try to update token
2025-09-30T14:51:41.304269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4518e6dd-7f476e89-a2aa677e-dbe5c415_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:41.312912Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:41.312934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:41.312936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:41.312938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:41.312947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895022409590213:4685]
2025-09-30T14:51:41.312952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895022409590213:4685]
2025-09-30T14:51:41.312957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895022409590213:4685]
2025-09-30T14:51:41.312998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:41.313005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.313007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:41.313009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:41.313014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:41.313018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:41.313155Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:41.319207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 528 sessionId: src_id|4518e6dd-7f476e89-a2aa677e-dbe5c415_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:41.322104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:41.379291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895022499317255:5419]
2025-09-30T14:51:41.379513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 527, pipe: [1:7555895022499317255:5419]
2025-09-30T14:51:41.427386Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:41.427852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:41.427869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:41.427889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895022499317255:5419], now have 1 active actors on pipe
2025-09-30T14:51:41.428157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:41.428161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895022499317255:5419]
2025-09-30T14:51:41.428171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:41.428179Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:41.428230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 528 reason: error at write: Disconnected sessionId: src_id|4518e6dd-7f476e89-a2aa677e-dbe5c415_0
2025-09-30T14:51:41.428431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 528 sessionId: src_id|4518e6dd-7f476e89-a2aa677e-dbe5c415_0 is DEAD
2025-09-30T14:51:41.428595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4518e6dd-7f476e89-a2aa677e-dbe5c415_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:41.428606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4518e6dd-7f476e89-a2aa677e-dbe5c415_0] Write session will restart in 0.009234s
2025-09-30T14:51:41.428629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4518e6dd-7f476e89-a2aa677e-dbe5c415_0] Write session: Do CDS request
2025-09-30T14:51:41.428646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4518e6dd-7f476e89-a2aa677e-dbe5c415_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:41.428940Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:41.437206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:41.438697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4518e6dd-7f476e89-a2aa677e-dbe5c415_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:41.438821Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:41.438836Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 529
2025-09-30T14:51:41.438962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 529 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:41.438997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 529 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:41.439008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=529 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:41.439011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:41.439067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:41.439289Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:41.439301Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:41.439314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:41.439387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:41.439428Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895022409590329:4689]
2025-09-30T14:51:41.439450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 529 sessionId:  describe result for acl check
2025-09-30T14:51:41.439493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:41.439500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:41.439502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:41.439508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895022499317325:5566] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:41.440057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895022499317325:5566] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:41.440054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:41.440346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:41.440401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:41.440732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:41.440822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:41.440829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:41.440830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:41.440831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:41.440832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:41.440833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:41.440835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:41.440836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:41.440837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:41.440838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:41.440839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.440840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.440841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.440842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:41.440843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:41.440849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:41.440857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:41.440861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:41.440865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:41.440868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:41.440872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:41.440876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:41.440879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:41.440883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:41.440887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:41.440890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.440893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.440896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.440900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:41.440903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:41.440910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:41.440918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:41.440924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:41.440929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:41.440934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:41.440938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:41.440942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:41.440947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:41.440952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:41.440956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:41.440960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:41.440965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:41.440969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:41.440974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:41.440978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:41.440983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:41.440992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:41.440996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:41.441001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:41.441006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:41.441011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.441016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.441020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.441025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.441029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.441034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.441039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:41.441044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:41.441049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:41.441054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:41.441097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:41.441678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895022499317325:5566] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:41.446010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895022499317325:5566] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:41.446026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895022499317325:5566] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:41.446029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895022499317325:5566] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:41.446035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 529 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:41.446352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:41.447472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:41.447489Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:41.447493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:41.447496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:41.447502Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 528 [2:7555895022409590329:4689]
2025-09-30T14:51:41.447519Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:41.447534Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:41.447537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:41.447541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:41.447543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:41.447558Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:41.447564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:41.447571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:41.447628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.447636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.447638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.447642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:41.447644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:41.447710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:41.447719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.447732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.447744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.447761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:41.447784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895022499317363:5566], now have 1 active actors on pipe
2025-09-30T14:51:41.447792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895022499317256:2454], now have 1 active actors on pipe
2025-09-30T14:51:41.447799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895022409590324:4689]
2025-09-30T14:51:41.447801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895022409590324:4689]
2025-09-30T14:51:41.447805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895022409590324:4689]
2025-09-30T14:51:41.447817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:41.447830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:41.447838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:41.447839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:41.447830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 528
2025-09-30T14:51:41.447841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:41.447834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 528
2025-09-30T14:51:41.447851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:41.447854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:41.447893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895022409590324:4689]
2025-09-30T14:51:41.447906Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:41.447912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:41.447924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:41.447933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:41.447979Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|791c0831-dae3de8c-bdc2a0d2-5405075d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:41.447989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:41.447993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:41.447996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:41.448005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:41.448020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:41.448043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:41.448190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:41.448199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:41.448217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:41.448302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 529 partition: 0 MaxSeqNo: 42 sessionId: src_id|791c0831-dae3de8c-bdc2a0d2-5405075d_0
2025-09-30T14:51:41.448635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4518e6dd-7f476e89-a2aa677e-dbe5c415_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|791c0831-dae3de8c-bdc2a0d2-5405075d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:41.451398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|791c0831-dae3de8c-bdc2a0d2-5405075d_0] Write session: try to update token
2025-09-30T14:51:41.451419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|791c0831-dae3de8c-bdc2a0d2-5405075d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:41.460041Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:41.460061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:41.460063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:41.460065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:41.460074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895022409590324:4689]
2025-09-30T14:51:41.460079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895022409590324:4689]
2025-09-30T14:51:41.460086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895022409590324:4689]
2025-09-30T14:51:41.460126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:41.460132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:41.460134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.460136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:41.460138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:41.460142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:41.460284Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:41.465991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 529 sessionId: src_id|791c0831-dae3de8c-bdc2a0d2-5405075d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:41.468778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:41.528262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895022499317378:5419]
2025-09-30T14:51:41.528562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 528, pipe: [1:7555895022499317378:5419]
2025-09-30T14:51:41.573607Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:41.573854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:41.573866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:41.573899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895022499317378:5419], now have 1 active actors on pipe
2025-09-30T14:51:41.574162Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:41.574163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:41.574168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:41.574231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 529 reason: error at write: Disconnected sessionId: src_id|791c0831-dae3de8c-bdc2a0d2-5405075d_0
2025-09-30T14:51:41.574248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895022499317378:5419]
2025-09-30T14:51:41.574257Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:41.574407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 529 sessionId: src_id|791c0831-dae3de8c-bdc2a0d2-5405075d_0 is DEAD
2025-09-30T14:51:41.574574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|791c0831-dae3de8c-bdc2a0d2-5405075d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:41.574585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|791c0831-dae3de8c-bdc2a0d2-5405075d_0] Write session will restart in 0.006262s
2025-09-30T14:51:41.574619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|791c0831-dae3de8c-bdc2a0d2-5405075d_0] Write session: Do CDS request
2025-09-30T14:51:41.574624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|791c0831-dae3de8c-bdc2a0d2-5405075d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:41.581729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|791c0831-dae3de8c-bdc2a0d2-5405075d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:41.581804Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:41.581819Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 530
2025-09-30T14:51:41.581943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 530 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:41.581988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 530 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:41.581998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=530 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:41.582002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:41.582488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 530 sessionId:  describe result for acl check
2025-09-30T14:51:41.582536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:41.582544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:41.582548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:41.582554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895022499317437:5573] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:41.583096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895022499317437:5573] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:41.584251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:41.584817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895022499317437:5573] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:41.585975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:41.586130Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:41.586141Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:41.586151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:41.586194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:41.586228Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895022409590443:4692]
2025-09-30T14:51:41.586729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:41.587006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:41.587043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:41.587163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895022499317437:5573] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:41.587177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895022499317437:5573] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:41.587181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895022499317437:5573] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:41.587190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 530 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:41.587356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:41.587402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:41.587407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:41.587408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:41.587409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:41.587409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:41.587410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:41.587411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:41.587411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:41.587412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:41.587413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:41.587413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.587414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.587415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.587416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:41.587417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:41.587422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:41.587431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:41.587435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:41.587440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:41.587443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:41.587447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:41.587449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:41.587451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:41.587453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:41.587456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:41.587458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.587460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.587463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.587465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:41.587467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:41.587472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:41.587477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:41.587481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:41.587484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:41.587486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:41.587489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:41.587492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:41.587494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:41.587513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:41.587517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:41.587519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:41.587522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:41.587525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:41.587528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:41.587530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:41.587533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:41.587536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:41.587539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:41.587541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:41.587544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:41.587549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.587552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.587554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.587557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.587559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.587563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.587566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:41.587569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:41.587572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:41.587575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:41.587618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:41.592723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:41.593552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:41.593569Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:41.593572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:41.593576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:41.593582Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 529 [2:7555895022409590443:4692]
2025-09-30T14:51:41.593596Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:41.593608Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:41.593615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:41.593618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:41.593620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:41.593634Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:41.593647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:41.593653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:41.593697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.593702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.593703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.593706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:41.593707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:41.593754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:41.593760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.593767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.593777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.593787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:41.593803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895022499317383:2454], now have 1 active actors on pipe
2025-09-30T14:51:41.593808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895022409590438:4692]
2025-09-30T14:51:41.593809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895022409590438:4692]
2025-09-30T14:51:41.593811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895022409590438:4692]
2025-09-30T14:51:41.593818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:41.593826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895022499317490:5573], now have 1 active actors on pipe
2025-09-30T14:51:41.593839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:41.593838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:41.593841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:41.593843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:41.593855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:41.593857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:41.593878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895022409590438:4692]
2025-09-30T14:51:41.593861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 529
2025-09-30T14:51:41.593884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:41.593892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:41.593903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:41.593906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:41.593885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 529
2025-09-30T14:51:41.593933Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6829423d-cc6ff59b-6222651a-ce9be486_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:41.593945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:41.593947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:41.593948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:41.593955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:41.593961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:41.593975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:41.594093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:41.594099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:41.594108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:41.594175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 530 partition: 0 MaxSeqNo: 42 sessionId: src_id|6829423d-cc6ff59b-6222651a-ce9be486_0
2025-09-30T14:51:41.594515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|791c0831-dae3de8c-bdc2a0d2-5405075d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6829423d-cc6ff59b-6222651a-ce9be486_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:41.597167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6829423d-cc6ff59b-6222651a-ce9be486_0] Write session: try to update token
2025-09-30T14:51:41.597182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6829423d-cc6ff59b-6222651a-ce9be486_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:41.605647Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:41.605662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:41.605664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:41.605665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:41.605671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895022409590438:4692]
2025-09-30T14:51:41.605675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895022409590438:4692]
2025-09-30T14:51:41.605677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895022409590438:4692]
2025-09-30T14:51:41.605707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:41.605713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.605715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:41.605727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:41.605734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:41.605738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:41.605849Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:41.611143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 530 sessionId: src_id|6829423d-cc6ff59b-6222651a-ce9be486_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:41.613896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:41.674179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895022499317522:5419]
2025-09-30T14:51:41.674503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 529, pipe: [1:7555895022499317522:5419]
2025-09-30T14:51:41.714296Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:41.714730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:41.714747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:41.714781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895022499317522:5419], now have 1 active actors on pipe
2025-09-30T14:51:41.714985Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:41.715032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895022499317522:5419]
2025-09-30T14:51:41.715062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:41.715121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 530 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6829423d-cc6ff59b-6222651a-ce9be486_0
2025-09-30T14:51:41.715297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 530 sessionId: src_id|6829423d-cc6ff59b-6222651a-ce9be486_0 is DEAD
2025-09-30T14:51:41.715452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6829423d-cc6ff59b-6222651a-ce9be486_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:41.715463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6829423d-cc6ff59b-6222651a-ce9be486_0] Write session will restart in 0.009266s
2025-09-30T14:51:41.715485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6829423d-cc6ff59b-6222651a-ce9be486_0] Write session: Do CDS request
2025-09-30T14:51:41.715492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6829423d-cc6ff59b-6222651a-ce9be486_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:41.715675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:41.724680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:41.725681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6829423d-cc6ff59b-6222651a-ce9be486_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:41.725815Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:41.725832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 531
2025-09-30T14:51:41.725960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 531 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:41.725992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 531 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:41.726002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=531 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:41.726006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:41.726440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 531 sessionId:  describe result for acl check
2025-09-30T14:51:41.726486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:41.726493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:41.726495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:41.726501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895022499317594:5584] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:41.726904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895022499317594:5584] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:41.727104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:41.727300Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:41.727308Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:41.727318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:41.727373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:41.727422Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895022409590589:4706]
2025-09-30T14:51:41.728056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:41.728324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:41.728366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:41.728628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895022499317594:5584] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:41.728681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:41.728739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:41.728747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:41.728748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:41.728749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:41.728750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:41.728751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:41.728752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:41.728754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:41.728755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:41.728756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:41.728757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.728758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.728760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.728761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:41.728762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:41.728768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:41.728778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:41.728782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:41.728786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:41.728790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:41.728795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:41.728799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:41.728803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:41.728807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:41.728812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:41.728817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.728821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.728825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.728829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:41.728833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:41.728839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:41.728846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:41.728852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:41.728858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:41.728862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:41.728868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:41.728872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:41.728877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:41.728881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:41.728885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:41.728890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:41.728894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:41.728899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:41.728904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:41.728908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:41.728913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:41.728917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:41.728922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:41.728926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:41.728930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:41.728934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.728939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.728942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.728946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.728952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.728956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.728959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:41.728963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:41.728967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:41.728972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:41.729013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:41.734002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895022499317594:5584] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:41.734023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895022499317594:5584] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:41.734027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895022499317594:5584] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:41.734035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 531 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:41.734326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:41.735367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:41.735379Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:41.735382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:41.735386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:41.735392Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 530 [2:7555895022409590589:4706]
2025-09-30T14:51:41.735412Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:41.735433Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:41.735440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:41.735443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:41.735445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:41.735461Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:41.735472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:41.735480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:41.735538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.735545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.735547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.735550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:41.735552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:41.735613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:41.735620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.735633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.735650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.735669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:41.735693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895022499317523:2454], now have 1 active actors on pipe
2025-09-30T14:51:41.735702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895022499317632:5584], now have 1 active actors on pipe
2025-09-30T14:51:41.735709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895022409590584:4706]
2025-09-30T14:51:41.735711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895022409590584:4706]
2025-09-30T14:51:41.735713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895022409590584:4706]
2025-09-30T14:51:41.735725Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:41.735738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:41.735742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:41.735747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:41.735749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:41.735756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:41.735760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:41.735732Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 530
2025-09-30T14:51:41.735741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 530
2025-09-30T14:51:41.735805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:41.735813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:41.735825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895022409590584:4706]
2025-09-30T14:51:41.735836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:41.735842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:41.735865Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4963b8b4-23916eef-c4ec5420-1f43c18c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:41.735876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:41.735879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:41.735881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:41.735891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:41.735903Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:41.735928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:41.736076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:41.736091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:41.736112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:41.736219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 531 partition: 0 MaxSeqNo: 42 sessionId: src_id|4963b8b4-23916eef-c4ec5420-1f43c18c_0
2025-09-30T14:51:41.736555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6829423d-cc6ff59b-6222651a-ce9be486_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4963b8b4-23916eef-c4ec5420-1f43c18c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:41.739226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4963b8b4-23916eef-c4ec5420-1f43c18c_0] Write session: try to update token
2025-09-30T14:51:41.739268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4963b8b4-23916eef-c4ec5420-1f43c18c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:41.747934Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:41.747958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:41.747960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:41.747962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:41.747971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895022409590584:4706]
2025-09-30T14:51:41.747976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895022409590584:4706]
2025-09-30T14:51:41.747980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895022409590584:4706]
2025-09-30T14:51:41.748022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:41.748023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:41.748029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.748030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:41.748032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:41.748035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:41.748173Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:41.754581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 531 sessionId: src_id|4963b8b4-23916eef-c4ec5420-1f43c18c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:41.757278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:41.814980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895022499317642:5419]
2025-09-30T14:51:41.815261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 530, pipe: [1:7555895022499317642:5419]
2025-09-30T14:51:41.860823Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:41.861186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:41.861198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:41.861217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895022499317642:5419], now have 1 active actors on pipe
2025-09-30T14:51:41.861440Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:41.861445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:41.861505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:41.861537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895022499317642:5419]
2025-09-30T14:51:41.861575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 531 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4963b8b4-23916eef-c4ec5420-1f43c18c_0
2025-09-30T14:51:41.861755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 531 sessionId: src_id|4963b8b4-23916eef-c4ec5420-1f43c18c_0 is DEAD
2025-09-30T14:51:41.861891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4963b8b4-23916eef-c4ec5420-1f43c18c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:41.861900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4963b8b4-23916eef-c4ec5420-1f43c18c_0] Write session will restart in 0.008421s
2025-09-30T14:51:41.861924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4963b8b4-23916eef-c4ec5420-1f43c18c_0] Write session: Do CDS request
2025-09-30T14:51:41.861929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4963b8b4-23916eef-c4ec5420-1f43c18c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:41.871222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:41.871687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4963b8b4-23916eef-c4ec5420-1f43c18c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:41.871751Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:41.871766Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 532
2025-09-30T14:51:41.871870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 532 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:41.871901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 532 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:41.871913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=532 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:41.871917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:41.872252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 532 sessionId:  describe result for acl check
2025-09-30T14:51:41.872280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:41.872281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:41.872283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:41.872286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895022499317715:5588] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:41.872717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895022499317715:5588] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:41.872833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:41.873040Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:41.873050Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:41.873062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:41.873114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:41.873162Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895022409590712:4709]
2025-09-30T14:51:41.873796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:41.874067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:41.874110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:41.874350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:41.874391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:41.874396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:41.874396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:41.874397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:41.874398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:41.874399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:41.874399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:41.874400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:41.874401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:41.874401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:41.874402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.874403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.874404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.874404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:41.874405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:41.874409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:41.874415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:41.874418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:41.874420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:41.874423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:41.874425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:41.874427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:41.874430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:41.874432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:41.874435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:41.874437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.874441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.874445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.874448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:41.874452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:41.874470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:41.874476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:41.874483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:41.874488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:41.874492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:41.874494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:41.874497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:41.874500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:41.874503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:41.874505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:41.874507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:41.874510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:41.874513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:41.874516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:41.874519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:41.874522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:41.874524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:41.874527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:41.874530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:41.874533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:41.874535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.874540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.874542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.874547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.874552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.874556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.874560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:41.874564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:41.874568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:41.874573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:41.874579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895022499317715:5588] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:41.874616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:41.879698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895022499317715:5588] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:41.879715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895022499317715:5588] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:41.879718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895022499317715:5588] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:41.879727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 532 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:41.880138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:41.881010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:41.881030Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:41.881033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:41.881037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:41.881044Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 531 [2:7555895022409590712:4709]
2025-09-30T14:51:41.881060Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:41.881075Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:41.881078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:41.881081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:41.881084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:41.881099Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:41.881107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:41.881121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:41.881183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.881191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.881195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.881199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:41.881202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:41.881368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:41.881377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.881392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 531
2025-09-30T14:51:41.881425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 531
2025-09-30T14:51:41.881392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:41.881411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:41.881431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:41.881452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895022499317643:2454], now have 1 active actors on pipe
2025-09-30T14:51:41.881456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895022499317765:5588], now have 1 active actors on pipe
2025-09-30T14:51:41.881474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:41.881481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:41.881496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895022409590707:4709]
2025-09-30T14:51:41.881504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895022409590707:4709]
2025-09-30T14:51:41.881507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895022409590707:4709]
2025-09-30T14:51:41.881520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:41.881535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:41.881538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:41.881544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:41.881546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:41.881555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:41.881558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:41.881575Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f3c5dde-b83dc4c8-5c99ce32-c5e03b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:41.881590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:41.881602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:41.881604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:41.881613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:41.881624Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:41.881669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895022409590707:4709]
2025-09-30T14:51:41.881681Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:41.881689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:41.881694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:41.881911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:41.881925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:41.881950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:41.882079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 532 partition: 0 MaxSeqNo: 42 sessionId: src_id|3f3c5dde-b83dc4c8-5c99ce32-c5e03b5_0
2025-09-30T14:51:41.882443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4963b8b4-23916eef-c4ec5420-1f43c18c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3f3c5dde-b83dc4c8-5c99ce32-c5e03b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:41.885307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f3c5dde-b83dc4c8-5c99ce32-c5e03b5_0] Write session: try to update token
2025-09-30T14:51:41.885328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f3c5dde-b83dc4c8-5c99ce32-c5e03b5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:41.899200Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:41.899220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:41.899230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895022409590707:4709]
2025-09-30T14:51:41.899291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:41.899298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:41.899470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:41.899617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:41.899748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:41.899869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:41.899881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 532 sessionId: src_id|3f3c5dde-b83dc4c8-5c99ce32-c5e03b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:41.900210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:41.900246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:41.902615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:41.902895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:41.902911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:41.904077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:41.904111Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:41.904115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:41.904117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:41.904120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:41.904128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895022409590707:4709]
2025-09-30T14:51:41.904132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895022409590707:4709]
2025-09-30T14:51:41.904136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895022409590707:4709]
2025-09-30T14:51:41.904160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:41.904166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:41.904172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:41.904173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:41.904175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:41.904177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:41.904191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:41.904301Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:41.961907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895022499317773:5419]
2025-09-30T14:51:41.962195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 531, pipe: [1:7555895022499317773:5419]
2025-09-30T14:51:42.012393Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:42.019312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:42.019334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:42.019501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:42.019561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:42.019625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:42.019696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:42.019740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:42.019750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:42.019815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:42.019871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:42.019929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:42.019997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:42.020038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:42.020046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:42.020113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:42.020167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:42.020227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:42.020298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:42.020341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:42.020347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:42.020409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:42.020472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:42.020540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:42.020601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:42.020641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:42.020647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:42.020710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:42.020774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:42.020837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:42.020890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:42.020936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:42.020942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:42.021010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:42.021071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:42.021126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:42.021182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:42.021244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:42.021254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:42.021321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:42.021384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:42.021442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:42.021503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:42.021614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:42.021623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:42.021683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:42.021736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:42.021803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:42.021867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:42.021921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:42.021927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:42.021990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:42.022050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:42.022112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:42.022178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:42.022224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:42.022231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:42.022296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:42.022357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:42.022425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:42.022505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:42.022547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:42.022556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:42.022610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895022499317773:5419], now have 1 active actors on pipe
2025-09-30T14:51:42.022931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895022499317773:5419]
2025-09-30T14:51:42.022944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:42.022949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:42.022973Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:42.022980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 532 reason: error at write: Disconnected sessionId: src_id|3f3c5dde-b83dc4c8-5c99ce32-c5e03b5_0
2025-09-30T14:51:42.023189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 532 sessionId: src_id|3f3c5dde-b83dc4c8-5c99ce32-c5e03b5_0 is DEAD
2025-09-30T14:51:42.023319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f3c5dde-b83dc4c8-5c99ce32-c5e03b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:42.023330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f3c5dde-b83dc4c8-5c99ce32-c5e03b5_0] Write session will restart in 0.006917s
2025-09-30T14:51:42.023353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f3c5dde-b83dc4c8-5c99ce32-c5e03b5_0] Write session: Do CDS request
2025-09-30T14:51:42.023359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f3c5dde-b83dc4c8-5c99ce32-c5e03b5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:42.023778Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:42.031729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f3c5dde-b83dc4c8-5c99ce32-c5e03b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:42.031875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:42.031891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 533
2025-09-30T14:51:42.031992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 533 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:42.032023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 533 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:42.032034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=533 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:42.032038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:42.032464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 533 sessionId:  describe result for acl check
2025-09-30T14:51:42.032506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:42.032508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:42.032527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:42.032533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895026794285120:5595] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:42.033100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895026794285120:5595] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:42.035893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895026794285120:5595] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:42.036043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:42.038006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:42.038166Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:42.038174Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:42.038182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:42.038229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:42.038266Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895026704558121:4711]
2025-09-30T14:51:42.038371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895026794285120:5595] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:42.038387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895026794285120:5595] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:42.038391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895026794285120:5595] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:42.038399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 533 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:42.038832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:42.039105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:42.039144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:42.039479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:42.039531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:42.039537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:42.039538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:42.039539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:42.039540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:42.039542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:42.039543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:42.039544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:42.039546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:42.039547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:42.039548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.039549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.039550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.039550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:42.039551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:42.039555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:42.039561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:42.039564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:42.039566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:42.039569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:42.039571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:42.039573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:42.039576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:42.039578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:42.039581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:42.039583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.039585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.039588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.039590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:42.039592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:42.039598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:42.039603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:42.039607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:42.039610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:42.039613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:42.039616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:42.039619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:42.039622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:42.039625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:42.039628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:42.039630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:42.039633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:42.039636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:42.039639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:42.039641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:42.039645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:42.039647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:42.039650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:42.039653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:42.039656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:42.039660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.039663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.039668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.039673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.039679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.039684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.039688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:42.039694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:42.039698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:42.039702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:42.039726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:42.045200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:42.046171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:42.046188Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:42.046191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:42.046195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:42.046201Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 532 [2:7555895026704558121:4711]
2025-09-30T14:51:42.046218Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:42.046238Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:42.046245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:42.046249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:42.046251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:42.046266Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:42.046281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:42.046287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:42.046342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.046352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.046355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.046358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:42.046360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:42.046422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:42.046431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.046444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.046474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.046496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:42.046519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895026794285078:2454], now have 1 active actors on pipe
2025-09-30T14:51:42.046523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895026794285186:5595], now have 1 active actors on pipe
2025-09-30T14:51:42.046530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895026704558116:4711]
2025-09-30T14:51:42.046532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895026704558116:4711]
2025-09-30T14:51:42.046535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895026704558116:4711]
2025-09-30T14:51:42.046547Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:42.046559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:42.046564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:42.046566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:42.046578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:42.046581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:42.046585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:42.046586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 532
2025-09-30T14:51:42.046614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895026704558116:4711]
2025-09-30T14:51:42.046597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 532
2025-09-30T14:51:42.046623Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:42.046625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:42.046639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:42.046644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:42.046691Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91cdff94-7106e6e3-d9172b04-23b38099_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:42.046703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:42.046707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:42.046709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:42.046718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:42.046731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:42.046751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:42.046867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:42.046877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:42.046898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:42.046966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 533 partition: 0 MaxSeqNo: 42 sessionId: src_id|91cdff94-7106e6e3-d9172b04-23b38099_0
2025-09-30T14:51:42.047286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f3c5dde-b83dc4c8-5c99ce32-c5e03b5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|91cdff94-7106e6e3-d9172b04-23b38099_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:42.049999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91cdff94-7106e6e3-d9172b04-23b38099_0] Write session: try to update token
2025-09-30T14:51:42.050017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91cdff94-7106e6e3-d9172b04-23b38099_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:42.058620Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:42.058637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:42.058640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:42.058642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:42.058651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895026704558116:4711]
2025-09-30T14:51:42.058655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895026704558116:4711]
2025-09-30T14:51:42.058659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895026704558116:4711]
2025-09-30T14:51:42.058704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:42.058705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:42.058710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:42.058713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.058715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:42.058716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:42.058855Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:42.064525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 533 sessionId: src_id|91cdff94-7106e6e3-d9172b04-23b38099_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:42.067216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:42.123222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895026794285200:5419]
2025-09-30T14:51:42.123561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 532, pipe: [1:7555895026794285200:5419]
2025-09-30T14:51:42.165069Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:42.165364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:42.165380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:42.165413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895026794285200:5419], now have 1 active actors on pipe
2025-09-30T14:51:42.165687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895026794285200:5419]
2025-09-30T14:51:42.165696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:42.165727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:42.165730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:42.165755Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:42.165789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 533 reason: error at write: Disconnected sessionId: src_id|91cdff94-7106e6e3-d9172b04-23b38099_0
2025-09-30T14:51:42.165961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 533 sessionId: src_id|91cdff94-7106e6e3-d9172b04-23b38099_0 is DEAD
2025-09-30T14:51:42.166092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91cdff94-7106e6e3-d9172b04-23b38099_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:42.166104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91cdff94-7106e6e3-d9172b04-23b38099_0] Write session will restart in 0.009257s
2025-09-30T14:51:42.166138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91cdff94-7106e6e3-d9172b04-23b38099_0] Write session: Do CDS request
2025-09-30T14:51:42.166147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91cdff94-7106e6e3-d9172b04-23b38099_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:42.176770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91cdff94-7106e6e3-d9172b04-23b38099_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:42.176832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:42.176851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 534
2025-09-30T14:51:42.177008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 534 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:42.177003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:42.177059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 534 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:42.177072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=534 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:42.177076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:42.177491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 534 sessionId:  describe result for acl check
2025-09-30T14:51:42.177527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:42.177533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:42.177535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:42.177541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895026794285277:5599] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:42.178033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895026794285277:5599] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:42.178738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:42.178908Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:42.178917Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:42.178928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:42.178974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:42.179013Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895026704558236:4714]
2025-09-30T14:51:42.179653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:42.179677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895026794285277:5599] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:42.179975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:42.180014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:42.180347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:42.180405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:42.180414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:42.180415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:42.180416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:42.180417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:42.180418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:42.180419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:42.180421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:42.180422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:42.180422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:42.180423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.180424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.180425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.180426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:42.180427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:42.180433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:42.180443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:42.180447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:42.180451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:42.180455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:42.180460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:42.180464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:42.180468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:42.180472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:42.180476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:42.180480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.180485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.180488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.180492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:42.180497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:42.180503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:42.180512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:42.180518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:42.180523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:42.180528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:42.180533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:42.180537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:42.180543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:42.180548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:42.180553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:42.180557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:42.180562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:42.180568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:42.180573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:42.180577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:42.180583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:42.180588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:42.180593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:42.180598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:42.180603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:42.180608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.180613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.180618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.180623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.180627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.180632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.180636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:42.180642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:42.180652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:42.180658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:42.180703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:42.185410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895026794285277:5599] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:42.185426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895026794285277:5599] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:42.185430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895026794285277:5599] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:42.185437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 534 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:42.185847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:42.186655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:42.186668Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:42.186670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:42.186673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:42.186678Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 533 [2:7555895026704558236:4714]
2025-09-30T14:51:42.186690Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:42.186702Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:42.186707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:42.186710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:42.186711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:42.186723Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:42.186728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:42.186733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:42.186778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.186785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.186787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.186790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:42.186792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:42.186851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:42.186857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.186865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.186871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.186881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:42.187019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 533
2025-09-30T14:51:42.186894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895026704558230:4714]
2025-09-30T14:51:42.186895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895026704558230:4714]
2025-09-30T14:51:42.186897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895026704558230:4714]
2025-09-30T14:51:42.187020Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 533
2025-09-30T14:51:42.186902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:42.186915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895026794285315:5599], now have 1 active actors on pipe
2025-09-30T14:51:42.186915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:42.186919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:42.186920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:42.186921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:42.186929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:42.186930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:42.186934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895026794285202:2454], now have 1 active actors on pipe
2025-09-30T14:51:42.186958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895026704558230:4714]
2025-09-30T14:51:42.186964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:42.186976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:42.187096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:42.187099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:42.187121Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b4e530f-dd91fd01-9340b3cd-b0af4d35_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:42.187133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:42.187136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:42.187144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:42.187153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:42.187166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:42.187176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:42.187513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:42.187526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:42.187552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:42.187658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 534 partition: 0 MaxSeqNo: 42 sessionId: src_id|7b4e530f-dd91fd01-9340b3cd-b0af4d35_0
2025-09-30T14:51:42.188017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91cdff94-7106e6e3-d9172b04-23b38099_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7b4e530f-dd91fd01-9340b3cd-b0af4d35_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:42.190834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b4e530f-dd91fd01-9340b3cd-b0af4d35_0] Write session: try to update token
2025-09-30T14:51:42.190854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b4e530f-dd91fd01-9340b3cd-b0af4d35_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:42.198435Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:42.198451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:42.198475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895026704558230:4714]
2025-09-30T14:51:42.198520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:42.198523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:42.198690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:42.198837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:42.198989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:42.199140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:42.199362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:42.199407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:42.205592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 534 sessionId: src_id|7b4e530f-dd91fd01-9340b3cd-b0af4d35_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:42.208348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:42.209325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:42.209348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:42.209366Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:42.209369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:42.209372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:42.209375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:42.209383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895026704558230:4714]
2025-09-30T14:51:42.209388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895026704558230:4714]
2025-09-30T14:51:42.209392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895026704558230:4714]
2025-09-30T14:51:42.209441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:42.209440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:42.209446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:42.209450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:42.209452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.209455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:42.209585Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:42.266088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895026794285322:5419]
2025-09-30T14:51:42.266348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 533, pipe: [1:7555895026794285322:5419]
2025-09-30T14:51:42.314232Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:42.314647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:42.314683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895026794285322:5419], now have 1 active actors on pipe
2025-09-30T14:51:42.314817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:42.314862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895026794285322:5419]
2025-09-30T14:51:42.314884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:42.314913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:42.314917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:42.314996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 534 reason: error at write: Disconnected sessionId: src_id|7b4e530f-dd91fd01-9340b3cd-b0af4d35_0
2025-09-30T14:51:42.315121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 534 sessionId: src_id|7b4e530f-dd91fd01-9340b3cd-b0af4d35_0 is DEAD
2025-09-30T14:51:42.315272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b4e530f-dd91fd01-9340b3cd-b0af4d35_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:42.315283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b4e530f-dd91fd01-9340b3cd-b0af4d35_0] Write session will restart in 0.007800s
2025-09-30T14:51:42.315307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b4e530f-dd91fd01-9340b3cd-b0af4d35_0] Write session: Do CDS request
2025-09-30T14:51:42.315312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b4e530f-dd91fd01-9340b3cd-b0af4d35_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:42.324766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b4e530f-dd91fd01-9340b3cd-b0af4d35_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:42.324888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:42.324906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 535
2025-09-30T14:51:42.325018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 535 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:42.325047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 535 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:42.325066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=535 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:42.325075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:42.325184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:42.325496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 535 sessionId:  describe result for acl check
2025-09-30T14:51:42.325534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:42.325536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:42.325538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:42.325544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895026794285399:5603] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:42.326106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895026794285399:5603] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:42.326995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:42.327193Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:42.327203Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:42.327214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:42.327293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:42.327332Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895026704558350:4716]
2025-09-30T14:51:42.327732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895026794285399:5603] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:42.327981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:42.328322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:42.328382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:42.328722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:42.328795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:42.328803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:42.328805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:42.328806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:42.328807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:42.328809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:42.328810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:42.328811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:42.328813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:42.328814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:42.328815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.328817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.328818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.328819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:42.328820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:42.328827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:42.328838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:42.328843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:42.328847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:42.328852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:42.328856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:42.328860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:42.328864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:42.328869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:42.328874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:42.328878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.328888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.328892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.328897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:42.328905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:42.328913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:42.328927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:42.328938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:42.328949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:42.328956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:42.328965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:42.328969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:42.328974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:42.328979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:42.328986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:42.328990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:42.328997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:42.329004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:42.329009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:42.329016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:42.329022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:42.329032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:42.329043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:42.329051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:42.329056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:42.329062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.329067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.329073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.329082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.329087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.329091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.329095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:42.329104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:42.329109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:42.329115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:42.329160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:42.334030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895026794285399:5603] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:42.334049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895026794285399:5603] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:42.334053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895026794285399:5603] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:42.334062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 535 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:42.334319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:42.335408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:42.335423Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:42.335426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:42.335430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:42.335436Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 534 [2:7555895026704558350:4716]
2025-09-30T14:51:42.335455Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:42.335472Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:42.335476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:42.335479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:42.335481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:42.335496Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:42.335506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:42.335517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:42.335576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.335584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.335586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.335589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:42.335592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:42.335651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:42.335661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.335670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.335676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.335686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:42.335700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895026794285438:5603], now have 1 active actors on pipe
2025-09-30T14:51:42.335707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895026794285324:2454], now have 1 active actors on pipe
2025-09-30T14:51:42.335712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895026704558343:4716]
2025-09-30T14:51:42.335713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895026704558343:4716]
2025-09-30T14:51:42.335714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895026704558343:4716]
2025-09-30T14:51:42.335723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:42.335734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:42.335734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:42.335737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:42.335738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:42.335747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:42.335749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:42.335775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895026704558343:4716]
2025-09-30T14:51:42.335784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:42.335788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:42.335791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 534
2025-09-30T14:51:42.335822Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 534
2025-09-30T14:51:42.335827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:42.335834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:42.335853Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8b56d32-c48b0922-abff1c93-85d7da7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:42.335858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:42.335860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:42.335862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:42.335869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:42.335876Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:42.335889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:42.336062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:42.336070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:42.336082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:42.336174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 535 partition: 0 MaxSeqNo: 42 sessionId: src_id|f8b56d32-c48b0922-abff1c93-85d7da7_0
2025-09-30T14:51:42.336505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b4e530f-dd91fd01-9340b3cd-b0af4d35_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f8b56d32-c48b0922-abff1c93-85d7da7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:42.339108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8b56d32-c48b0922-abff1c93-85d7da7_0] Write session: try to update token
2025-09-30T14:51:42.339127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8b56d32-c48b0922-abff1c93-85d7da7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:42.346988Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:42.347008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:42.347016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895026704558343:4716]
2025-09-30T14:51:42.347054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:42.347059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:42.347230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:42.347378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:42.347517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:42.347662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:42.347840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:42.347877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:42.354042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 535 sessionId: src_id|f8b56d32-c48b0922-abff1c93-85d7da7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:42.356693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:42.356909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:42.356934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:42.356972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:42.357051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:42.358396Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:42.358420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:42.358423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:42.358425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:42.358433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895026704558343:4716]
2025-09-30T14:51:42.358437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895026704558343:4716]
2025-09-30T14:51:42.358443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895026704558343:4716]
2025-09-30T14:51:42.358495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:42.358507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.358507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:42.358513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:42.358518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:42.358518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:42.358645Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:42.415051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895026794285445:5419]
2025-09-30T14:51:42.415371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 534, pipe: [1:7555895026794285445:5419]
2025-09-30T14:51:42.474174Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:42.481245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:42.481269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:42.481417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:42.481479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:42.481544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:42.481602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:42.481861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:42.481873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:42.481938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:42.482001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:42.482065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:42.482130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:42.482169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:42.482180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:42.482240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:42.482305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:42.482375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:42.482435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:42.482493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:42.482502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:42.482569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:42.482637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:42.482697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:42.482769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:42.482819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:42.482828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:42.482895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:42.482947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:42.483004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:42.483060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:42.483115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:42.483122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:42.483180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:42.483235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:42.483315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:42.483374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:42.483413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:42.483418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:42.483478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:42.483535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:42.483594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:42.483657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:42.483698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:42.483703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:42.483764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:42.483821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:42.483887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:42.483944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:42.484135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:42.484142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:42.484206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:42.484259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:42.484316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:42.484384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:42.484427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:42.484433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:42.484489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:42.484542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:42.484600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:42.484658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:42.484704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:42.484713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:42.484772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895026794285445:5419], now have 1 active actors on pipe
2025-09-30T14:51:42.485020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:42.485026Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:42.485039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:42.485069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 535 reason: error at write: Disconnected sessionId: src_id|f8b56d32-c48b0922-abff1c93-85d7da7_0
2025-09-30T14:51:42.485074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895026794285445:5419]
2025-09-30T14:51:42.485139Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:42.485257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 535 sessionId: src_id|f8b56d32-c48b0922-abff1c93-85d7da7_0 is DEAD
2025-09-30T14:51:42.485391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8b56d32-c48b0922-abff1c93-85d7da7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:42.485402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8b56d32-c48b0922-abff1c93-85d7da7_0] Write session will restart in 0.006698s
2025-09-30T14:51:42.485426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8b56d32-c48b0922-abff1c93-85d7da7_0] Write session: Do CDS request
2025-09-30T14:51:42.485431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8b56d32-c48b0922-abff1c93-85d7da7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:42.493730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8b56d32-c48b0922-abff1c93-85d7da7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:42.493860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:42.493879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 536
2025-09-30T14:51:42.493996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 536 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:42.494031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 536 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:42.494042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=536 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:42.494049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:42.494505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 536 sessionId:  describe result for acl check
2025-09-30T14:51:42.494539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:42.494545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:42.494546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:42.494552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895026794285523:5608] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:42.495106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895026794285523:5608] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:42.495790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:42.497469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:42.497649Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:42.497658Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:42.497669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:42.497719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:42.497759Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895026704558465:4718]
2025-09-30T14:51:42.497757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895026794285523:5608] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:42.498403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:42.498722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:42.498766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:42.499095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:42.499149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:42.499156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:42.499157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:42.499158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:42.499159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:42.499160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:42.499162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:42.499163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:42.499164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:42.499165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:42.499166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.499167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.499169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.499170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:42.499171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:42.499177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:42.499184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:42.499186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:42.499189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:42.499191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:42.499194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:42.499196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:42.499198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:42.499201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:42.499203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:42.499205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.499208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.499210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.499212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:42.499215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:42.499220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:42.499225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:42.499229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:42.499232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:42.499238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:42.499258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:42.499263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:42.499269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:42.499273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:42.499279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:42.499283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:42.499288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:42.499293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:42.499298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:42.499302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:42.499307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:42.499311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:42.499316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:42.499320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:42.499326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:42.499330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.499335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.499339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.499344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.499349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.499354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.499359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:42.499365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:42.499369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:42.499374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:42.499417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:42.500173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895026794285523:5608] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:42.500189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895026794285523:5608] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:42.500193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895026794285523:5608] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:42.500202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 536 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:42.504936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:42.505859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:42.505880Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:42.505883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:42.505887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:42.505894Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 535 [2:7555895026704558465:4718]
2025-09-30T14:51:42.505911Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:42.505925Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:42.505935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:42.505938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:42.505941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:42.505961Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:42.505972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:42.505983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:42.506061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.506070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.506072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.506076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:42.506079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:42.506147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:42.506156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.506169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.506180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.506205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:42.506227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895026794285565:5608], now have 1 active actors on pipe
2025-09-30T14:51:42.506237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895026794285449:2454], now have 1 active actors on pipe
2025-09-30T14:51:42.506244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895026704558459:4718]
2025-09-30T14:51:42.506246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895026704558459:4718]
2025-09-30T14:51:42.506249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895026704558459:4718]
2025-09-30T14:51:42.506262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:42.506272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:42.506281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:42.506281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:42.506283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:42.506262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 535
2025-09-30T14:51:42.506297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:42.506305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:42.506265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 535
2025-09-30T14:51:42.506357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:42.506367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:42.506379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895026704558459:4718]
2025-09-30T14:51:42.506394Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:42.506418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:42.506432Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f992b7df-da26d9e0-1545fe0a-9c43b2af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:42.506444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:42.506453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:42.506469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:42.506479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:42.506494Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:42.506530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:42.506718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:42.506730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:42.506749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:42.506849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 536 partition: 0 MaxSeqNo: 42 sessionId: src_id|f992b7df-da26d9e0-1545fe0a-9c43b2af_0
2025-09-30T14:51:42.507214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8b56d32-c48b0922-abff1c93-85d7da7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f992b7df-da26d9e0-1545fe0a-9c43b2af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:42.509901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f992b7df-da26d9e0-1545fe0a-9c43b2af_0] Write session: try to update token
2025-09-30T14:51:42.509917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f992b7df-da26d9e0-1545fe0a-9c43b2af_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:42.518314Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:42.518331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:42.518333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:42.518335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:42.518342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895026704558459:4718]
2025-09-30T14:51:42.518347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895026704558459:4718]
2025-09-30T14:51:42.518350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895026704558459:4718]
2025-09-30T14:51:42.518380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:42.518385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.518387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:42.518400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:42.518406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:42.518414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:42.518537Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:42.525276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 536 sessionId: src_id|f992b7df-da26d9e0-1545fe0a-9c43b2af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:42.528037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:42.585030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895026794285572:5419]
2025-09-30T14:51:42.585316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 535, pipe: [1:7555895026794285572:5419]
2025-09-30T14:51:42.626058Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:42.626489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:42.626502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:42.626518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895026794285572:5419], now have 1 active actors on pipe
2025-09-30T14:51:42.626764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895026794285572:5419]
2025-09-30T14:51:42.626772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:42.626776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:42.626819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:42.626848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 536 reason: error at write: Disconnected sessionId: src_id|f992b7df-da26d9e0-1545fe0a-9c43b2af_0
2025-09-30T14:51:42.627021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 536 sessionId: src_id|f992b7df-da26d9e0-1545fe0a-9c43b2af_0 is DEAD
2025-09-30T14:51:42.627117Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:42.627185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f992b7df-da26d9e0-1545fe0a-9c43b2af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:42.627194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f992b7df-da26d9e0-1545fe0a-9c43b2af_0] Write session will restart in 0.005667s
2025-09-30T14:51:42.627219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f992b7df-da26d9e0-1545fe0a-9c43b2af_0] Write session: Do CDS request
2025-09-30T14:51:42.627224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f992b7df-da26d9e0-1545fe0a-9c43b2af_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:42.633737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f992b7df-da26d9e0-1545fe0a-9c43b2af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:42.633788Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:42.633806Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 537
2025-09-30T14:51:42.633982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 537 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:42.634026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 537 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:42.634037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=537 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:42.634041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:42.634529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 537 sessionId:  describe result for acl check
2025-09-30T14:51:42.634564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:42.634567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:42.634568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:42.634574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895026794285601:5612] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:42.635018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895026794285601:5612] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:42.636957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895026794285601:5612] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:42.637396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:42.639084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:42.639407Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:42.639419Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:42.639431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:42.639449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895026794285601:5612] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:42.639467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895026794285601:5612] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:42.639494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:42.639470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895026794285601:5612] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:42.639478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 537 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:42.639523Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895026704558595:4721]
2025-09-30T14:51:42.640020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:42.640366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:42.640420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:42.640691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:42.640738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:42.640745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:42.640746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:42.640747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:42.640747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:42.640750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:42.640752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:42.640752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:42.640753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:42.640753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:42.640754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.640755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.640755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.640756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:42.640757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:42.640760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:42.640767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:42.640769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:42.640771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:42.640774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:42.640776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:42.640778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:42.640781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:42.640783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:42.640786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:42.640788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.640790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.640792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.640794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:42.640797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:42.640805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:42.640813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:42.640818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:42.640824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:42.640829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:42.640835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:42.640840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:42.640843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:42.640846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:42.640848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:42.640850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:42.640853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:42.640856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:42.640859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:42.640861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:42.640863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:42.640867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:42.640869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:42.640872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:42.640875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:42.640877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.640879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.640881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.640884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.640886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.640889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.640891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:42.640893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:42.640896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:42.640898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:42.640921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:42.646398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:42.647392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:42.647406Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:42.647409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:42.647412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:42.647419Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 536 [2:7555895026704558595:4721]
2025-09-30T14:51:42.647433Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:42.647449Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:42.647455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:42.647458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:42.647459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:42.647469Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:42.647474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:42.647479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:42.647529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.647534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.647536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.647538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:42.647539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:42.647597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:42.647603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.647611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.647617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.647630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:42.647642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895026704558589:4721]
2025-09-30T14:51:42.647644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895026704558589:4721]
2025-09-30T14:51:42.647645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895026704558589:4721]
2025-09-30T14:51:42.647651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:42.647661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:42.647674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:42.647679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:42.647698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:42.647705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895026704558589:4721]
2025-09-30T14:51:42.647707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:42.647714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:42.647715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895026794285686:5612], now have 1 active actors on pipe
2025-09-30T14:51:42.647718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:42.647725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895026794285573:2454], now have 1 active actors on pipe
2025-09-30T14:51:42.647727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:42.647831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 536
2025-09-30T14:51:42.647875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 536
2025-09-30T14:51:42.647895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:42.647905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:42.647925Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b29348c-78c46630-a9b16f59-714a28b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:42.647930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:42.647933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:42.647935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:42.647941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:42.647948Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:42.647961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:42.648170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:42.648192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:42.648217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:42.648327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 537 partition: 0 MaxSeqNo: 42 sessionId: src_id|2b29348c-78c46630-a9b16f59-714a28b1_0
2025-09-30T14:51:42.648653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f992b7df-da26d9e0-1545fe0a-9c43b2af_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2b29348c-78c46630-a9b16f59-714a28b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:42.651429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b29348c-78c46630-a9b16f59-714a28b1_0] Write session: try to update token
2025-09-30T14:51:42.651447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b29348c-78c46630-a9b16f59-714a28b1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:42.660082Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:42.660106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:42.660109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:42.660111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:42.660120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895026704558589:4721]
2025-09-30T14:51:42.660123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895026704558589:4721]
2025-09-30T14:51:42.660127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895026704558589:4721]
2025-09-30T14:51:42.660169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:42.660180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.660182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:42.660196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:42.660205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:42.660208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:42.660340Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:42.666206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 537 sessionId: src_id|2b29348c-78c46630-a9b16f59-714a28b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:42.669002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:42.726825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895026794285719:5419]
2025-09-30T14:51:42.727116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 536, pipe: [1:7555895026794285719:5419]
2025-09-30T14:51:42.767997Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:42.768330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:42.768348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:42.768369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895026794285719:5419], now have 1 active actors on pipe
2025-09-30T14:51:42.768589Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:42.768613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895026794285719:5419]
2025-09-30T14:51:42.768628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:42.768633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:42.768647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:42.768696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 537 reason: error at write: Disconnected sessionId: src_id|2b29348c-78c46630-a9b16f59-714a28b1_0
2025-09-30T14:51:42.768873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 537 sessionId: src_id|2b29348c-78c46630-a9b16f59-714a28b1_0 is DEAD
2025-09-30T14:51:42.769015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b29348c-78c46630-a9b16f59-714a28b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:42.769037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b29348c-78c46630-a9b16f59-714a28b1_0] Write session will restart in 0.009167s
2025-09-30T14:51:42.769060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b29348c-78c46630-a9b16f59-714a28b1_0] Write session: Do CDS request
2025-09-30T14:51:42.769070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b29348c-78c46630-a9b16f59-714a28b1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:42.778748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:42.779740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b29348c-78c46630-a9b16f59-714a28b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:42.779820Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:42.779838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 538
2025-09-30T14:51:42.780334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 538 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:42.780371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 538 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:42.780381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=538 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:42.780385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:42.780690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:42.780897Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:42.780906Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:42.780917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:42.780919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 538 sessionId:  describe result for acl check
2025-09-30T14:51:42.780955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:42.780961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:42.780963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:42.780969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895026794285799:5623] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:42.780975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:42.781015Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895026704558734:4735]
2025-09-30T14:51:42.781445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895026794285799:5623] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:42.781647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:42.781908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:42.781949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:42.782255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:42.782317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:42.782327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:42.782329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:42.782330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:42.782331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:42.782332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:42.782334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:42.782335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:42.782336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:42.782337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:42.782338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.782340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.782341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.782342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:42.782343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:42.782349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:42.782358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:42.782362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:42.782366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:42.782371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:42.782375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:42.782379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:42.782383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:42.782387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:42.782392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:42.782396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.782400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.782404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.782408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:42.782412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:42.782418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:42.782427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:42.782433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:42.782439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:42.782449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:42.782467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:42.782477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:42.782481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:42.782486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:42.782491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:42.782496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:42.782506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:42.782514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:42.782521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:42.782530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:42.782535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:42.782544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:42.782549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:42.782557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:42.782563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:42.782568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.782578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.782587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.782596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.782603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.782613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.782621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:42.782628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:42.782636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:42.782641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:42.782690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:42.783544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895026794285799:5623] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:42.787825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895026794285799:5623] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:42.787844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895026794285799:5623] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:42.787848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895026794285799:5623] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:42.787857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 538 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:42.788094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:42.788951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:42.788964Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:42.788966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:42.788969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:42.788986Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 537 [2:7555895026704558734:4735]
2025-09-30T14:51:42.788997Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:42.789011Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:42.789017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:42.789019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:42.789021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:42.789033Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:42.789038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:42.789043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:42.789101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.789107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.789109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.789111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:42.789114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:42.789162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:42.789171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.789178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.789185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.789194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:42.789210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895026704558728:4735]
2025-09-30T14:51:42.789212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895026704558728:4735]
2025-09-30T14:51:42.789215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895026704558728:4735]
2025-09-30T14:51:42.789222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:42.789233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:42.789236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895026794285837:5623], now have 1 active actors on pipe
2025-09-30T14:51:42.789242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895026794285720:2454], now have 1 active actors on pipe
2025-09-30T14:51:42.789244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:42.789247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:42.789247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:42.789262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:42.789265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:42.789295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895026704558728:4735]
2025-09-30T14:51:42.789307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:42.789319Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 537
2025-09-30T14:51:42.789345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:42.789322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 537
2025-09-30T14:51:42.789452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:42.789463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:42.789491Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb12bd84-d707beb1-cc8ae7be-6a65ec1e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:42.789503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:42.789508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:42.789514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:42.789524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:42.789533Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:42.789552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:42.789697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:42.789707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:42.789731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:42.789830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 538 partition: 0 MaxSeqNo: 42 sessionId: src_id|eb12bd84-d707beb1-cc8ae7be-6a65ec1e_0
2025-09-30T14:51:42.790199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b29348c-78c46630-a9b16f59-714a28b1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|eb12bd84-d707beb1-cc8ae7be-6a65ec1e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:42.792996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb12bd84-d707beb1-cc8ae7be-6a65ec1e_0] Write session: try to update token
2025-09-30T14:51:42.793017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb12bd84-d707beb1-cc8ae7be-6a65ec1e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:42.801286Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:42.801304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:42.801312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895026704558728:4735]
2025-09-30T14:51:42.801351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:42.801366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:42.801520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:42.801658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:42.801799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:42.801950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:42.802130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:42.802167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:42.807584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 538 sessionId: src_id|eb12bd84-d707beb1-cc8ae7be-6a65ec1e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:42.810365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:42.810590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:42.810615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:42.810654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:42.810730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:42.813127Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:42.813147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:42.813150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:42.813153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:42.813162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895026704558728:4735]
2025-09-30T14:51:42.813167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895026704558728:4735]
2025-09-30T14:51:42.813170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895026704558728:4735]
2025-09-30T14:51:42.813213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:42.813217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:42.813224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:42.813226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.813228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:42.813228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:42.813367Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:42.870492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895026794285845:5419]
2025-09-30T14:51:42.870804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 537, pipe: [1:7555895026794285845:5419]
2025-09-30T14:51:42.926047Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:42.934249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:42.934276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:42.934447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:42.934525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:42.934588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:42.934654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:42.935314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:42.935330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:42.935434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:42.935505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:42.935570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:42.935634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:42.935681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:42.935688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:42.935758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:42.935816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:42.935874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:42.935947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:42.935993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:42.936002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:42.936068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:42.936130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:42.936196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:42.936265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:42.936307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:42.936313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:42.936384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:42.936450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:42.936514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:42.936588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:42.936633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:42.936640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:42.936711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:42.936777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:42.936844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:42.936908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:42.936956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:42.936964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:42.937033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:42.937103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:42.937169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:42.937239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:42.937288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:42.937295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:42.937370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:42.937435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:42.937494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:42.937566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:42.937611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:42.937617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:42.937679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:42.937735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:42.937804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:42.937870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:42.937918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:42.937923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:42.937993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:42.938067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:42.938144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:42.938219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:42.938287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:42.938295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:42.938363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895026794285845:5419], now have 1 active actors on pipe
2025-09-30T14:51:42.938601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895026794285845:5419]
2025-09-30T14:51:42.938615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:42.938618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:42.938638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:42.938647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 538 reason: error at write: Disconnected sessionId: src_id|eb12bd84-d707beb1-cc8ae7be-6a65ec1e_0
2025-09-30T14:51:42.938825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 538 sessionId: src_id|eb12bd84-d707beb1-cc8ae7be-6a65ec1e_0 is DEAD
2025-09-30T14:51:42.938929Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:42.939057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb12bd84-d707beb1-cc8ae7be-6a65ec1e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:42.939070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb12bd84-d707beb1-cc8ae7be-6a65ec1e_0] Write session will restart in 0.008750s
2025-09-30T14:51:42.939094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb12bd84-d707beb1-cc8ae7be-6a65ec1e_0] Write session: Do CDS request
2025-09-30T14:51:42.939099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb12bd84-d707beb1-cc8ae7be-6a65ec1e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:42.949776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb12bd84-d707beb1-cc8ae7be-6a65ec1e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:42.950178Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:42.950198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 539
2025-09-30T14:51:42.950351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 539 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:42.950402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 539 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:42.950408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=539 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:42.950412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:42.950812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:42.951282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 539 sessionId:  describe result for acl check
2025-09-30T14:51:42.951321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:42.951323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:42.951327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:42.951334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895026794285942:5628] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:42.951906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895026794285942:5628] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:42.952938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:42.953164Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:42.953175Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:42.953186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:42.953241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:42.953282Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895026704558863:4738]
2025-09-30T14:51:42.953887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:42.954022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895026794285942:5628] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:42.954164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:42.954211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:42.954536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:42.954599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:42.954605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:42.954607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:42.954608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:42.954609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:42.954610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:42.954611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:42.954612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:42.954614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:42.954615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:42.954617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.954618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.954619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.954620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:42.954621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:42.954626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:42.954636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:42.954640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:42.954644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:42.954648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:42.954651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:42.954655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:42.954659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:42.954663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:42.954667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:42.954671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.954675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.954679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.954683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:42.954687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:42.954695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:42.954704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:42.954710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:42.954716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:42.954721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:42.954726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:42.954730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:42.954736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:42.954741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:42.954747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:42.954757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:42.954763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:42.954773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:42.954778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:42.954783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:42.954792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:42.954797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:42.954802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:42.954811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:42.954817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:42.954826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.954831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.954836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.954846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.954850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.954860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.954866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:42.954870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:42.954873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:42.954875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:42.954900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:42.959966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895026794285942:5628] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:42.959984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895026794285942:5628] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:42.959991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895026794285942:5628] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:42.959999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 539 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:42.960223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:42.961083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:42.961102Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:42.961104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:42.961109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:42.961116Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 538 [2:7555895026704558863:4738]
2025-09-30T14:51:42.961133Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:42.961162Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:42.961170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:42.961174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:42.961176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:42.961193Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:42.961204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:42.961211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:42.961274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.961282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.961284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.961288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:42.961291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:42.961356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:42.961363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.961376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:42.961391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:42.961414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:42.961438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895026794285858:2454], now have 1 active actors on pipe
2025-09-30T14:51:42.961446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895026794285976:5628], now have 1 active actors on pipe
2025-09-30T14:51:42.961453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895026704558858:4738]
2025-09-30T14:51:42.961460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895026704558858:4738]
2025-09-30T14:51:42.961462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895026704558858:4738]
2025-09-30T14:51:42.961474Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:42.961489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:42.961501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:42.961504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:42.961508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:42.961511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:42.961525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:42.961537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895026704558858:4738]
2025-09-30T14:51:42.961540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:42.961507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 538
2025-09-30T14:51:42.961510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 538
2025-09-30T14:51:42.961557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:42.961573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:42.961583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:42.961617Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb1061ec-ab7b623b-69a71a4e-74b661e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:42.961628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:42.961632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:42.961634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:42.961643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:42.961652Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:42.961666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:42.961881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:42.961891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:42.961907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:42.961999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 539 partition: 0 MaxSeqNo: 42 sessionId: src_id|eb1061ec-ab7b623b-69a71a4e-74b661e6_0
2025-09-30T14:51:42.962362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb12bd84-d707beb1-cc8ae7be-6a65ec1e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|eb1061ec-ab7b623b-69a71a4e-74b661e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:42.965285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1061ec-ab7b623b-69a71a4e-74b661e6_0] Write session: try to update token
2025-09-30T14:51:42.965309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1061ec-ab7b623b-69a71a4e-74b661e6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:42.973786Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:42.973804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:42.973807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:42.973809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:42.973820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895026704558858:4738]
2025-09-30T14:51:42.973825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895026704558858:4738]
2025-09-30T14:51:42.973829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895026704558858:4738]
2025-09-30T14:51:42.973876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:42.973882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:42.973884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:42.973887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:42.973889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:42.973893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:42.974043Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:42.980885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 539 sessionId: src_id|eb1061ec-ab7b623b-69a71a4e-74b661e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:42.983602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:43.038651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895031089253291:5419]
2025-09-30T14:51:43.038924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 538, pipe: [1:7555895031089253291:5419]
2025-09-30T14:51:43.088714Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:43.089195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:43.089214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:43.089235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895031089253291:5419], now have 1 active actors on pipe
2025-09-30T14:51:43.089435Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:43.089522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:43.089538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:43.089590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 539 reason: error at write: Disconnected sessionId: src_id|eb1061ec-ab7b623b-69a71a4e-74b661e6_0
2025-09-30T14:51:43.089754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 539 sessionId: src_id|eb1061ec-ab7b623b-69a71a4e-74b661e6_0 is DEAD
2025-09-30T14:51:43.089895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1061ec-ab7b623b-69a71a4e-74b661e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:43.089906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1061ec-ab7b623b-69a71a4e-74b661e6_0] Write session will restart in 0.008315s
2025-09-30T14:51:43.089928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1061ec-ab7b623b-69a71a4e-74b661e6_0] Write session: Do CDS request
2025-09-30T14:51:43.089933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1061ec-ab7b623b-69a71a4e-74b661e6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:43.089929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895031089253291:5419]
2025-09-30T14:51:43.089957Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:43.099616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:43.099732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1061ec-ab7b623b-69a71a4e-74b661e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:43.099858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:43.099885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 540
2025-09-30T14:51:43.100041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 540 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:43.100085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 540 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:43.100096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=540 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:43.100101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:43.100556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 540 sessionId:  describe result for acl check
2025-09-30T14:51:43.100593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:43.100599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:43.100602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:43.100609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895031089253375:5636] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:43.101137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895031089253375:5636] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:43.101347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:43.101528Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:43.101540Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:43.101551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:43.101614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:43.101653Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895030999526279:4741]
2025-09-30T14:51:43.102282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:43.102563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:43.102621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:43.102944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:43.103029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:43.103036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:43.103037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:43.103038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:43.103039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:43.103041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:43.103042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:43.103043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:43.103044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:43.103046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:43.103047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.103048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.103049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.103051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:43.103052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:43.103058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:43.103067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:43.103072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:43.103076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:43.103080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:43.103084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:43.103088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:43.103092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:43.103096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:43.103066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895031089253375:5636] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:43.103100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:43.103106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.103110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.103114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.103118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:43.103122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:43.103130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:43.103143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:43.103155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:43.103161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:43.103166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:43.103171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:43.103175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:43.103182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:43.103188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:43.103195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:43.103200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:43.103209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:43.103216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:43.103222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:43.103231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:43.103238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:43.103265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:43.103276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:43.103282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:43.103291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:43.103296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.103301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.103310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.103315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.103325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.103331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.103335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:43.103340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:43.103350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:43.103359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:43.103410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:43.108494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895031089253375:5636] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:43.108512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895031089253375:5636] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:43.108516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895031089253375:5636] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:43.108525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 540 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:43.108876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:43.109795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:43.109819Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:43.109822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:43.109826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:43.109833Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 539 [2:7555895030999526279:4741]
2025-09-30T14:51:43.109850Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:43.109865Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:43.109868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:43.109871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:43.109873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:43.109888Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:43.109900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:43.109907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:43.109967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.109976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.109979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.109982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:43.109985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:43.110051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:43.110060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.110074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.110090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.110114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:43.110139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895031089253413:5636], now have 1 active actors on pipe
2025-09-30T14:51:43.110143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895031089253295:2454], now have 1 active actors on pipe
2025-09-30T14:51:43.110149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895030999526274:4741]
2025-09-30T14:51:43.110151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895030999526274:4741]
2025-09-30T14:51:43.110153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895030999526274:4741]
2025-09-30T14:51:43.110167Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:43.110181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:43.110186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:43.110190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:43.110192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:43.110202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:43.110210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:43.110191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 539
2025-09-30T14:51:43.110209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 539
2025-09-30T14:51:43.110241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895030999526274:4741]
2025-09-30T14:51:43.110251Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:43.110252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:43.110268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:43.110279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:43.110330Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|401e1f92-3746dbcb-45f7b75-a000ab7e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:43.110342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:43.110348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:43.110350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:43.110359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:43.110373Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:43.110396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:43.110562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:43.110574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:43.110592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:43.110690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 540 partition: 0 MaxSeqNo: 42 sessionId: src_id|401e1f92-3746dbcb-45f7b75-a000ab7e_0
2025-09-30T14:51:43.111054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1061ec-ab7b623b-69a71a4e-74b661e6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|401e1f92-3746dbcb-45f7b75-a000ab7e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:43.113830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|401e1f92-3746dbcb-45f7b75-a000ab7e_0] Write session: try to update token
2025-09-30T14:51:43.113850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|401e1f92-3746dbcb-45f7b75-a000ab7e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:43.122308Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:43.122326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:43.122329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:43.122331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:43.122341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895030999526274:4741]
2025-09-30T14:51:43.122346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895030999526274:4741]
2025-09-30T14:51:43.122351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895030999526274:4741]
2025-09-30T14:51:43.122390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:43.122389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:43.122394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:43.122396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.122396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:43.122398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:43.122548Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:43.129948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 540 sessionId: src_id|401e1f92-3746dbcb-45f7b75-a000ab7e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:43.132753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:43.190214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895031089253421:5419]
2025-09-30T14:51:43.190467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 539, pipe: [1:7555895031089253421:5419]
2025-09-30T14:51:43.225198Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:43.225567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:43.225579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:43.225595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895031089253421:5419], now have 1 active actors on pipe
2025-09-30T14:51:43.225756Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:43.225851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:43.225861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895031089253421:5419]
2025-09-30T14:51:43.225883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:43.225961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 540 reason: status is not ok: tablet will be restarted right now sessionId: src_id|401e1f92-3746dbcb-45f7b75-a000ab7e_0
2025-09-30T14:51:43.226103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 540 sessionId: src_id|401e1f92-3746dbcb-45f7b75-a000ab7e_0 is DEAD
2025-09-30T14:51:43.226258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|401e1f92-3746dbcb-45f7b75-a000ab7e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:43.226270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|401e1f92-3746dbcb-45f7b75-a000ab7e_0] Write session will restart in 0.009656s
2025-09-30T14:51:43.226295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|401e1f92-3746dbcb-45f7b75-a000ab7e_0] Write session: Do CDS request
2025-09-30T14:51:43.226301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|401e1f92-3746dbcb-45f7b75-a000ab7e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:43.236201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:43.236728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|401e1f92-3746dbcb-45f7b75-a000ab7e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:43.236822Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:43.236839Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 541
2025-09-30T14:51:43.236961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 541 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:43.237000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 541 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:43.237009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=541 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:43.237013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:43.237465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 541 sessionId:  describe result for acl check
2025-09-30T14:51:43.237495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:43.237497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:43.237499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:43.237507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895031089253503:5640] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:43.238035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:43.238042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895031089253503:5640] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:43.238255Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:43.238265Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:43.238276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:43.238335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:43.238374Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895030999526398:4743]
2025-09-30T14:51:43.239037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:43.239296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:43.239339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:43.239668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:43.239722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:43.239723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:43.239724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:43.239725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:43.239727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:43.239728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:43.239729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:43.239730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:43.239732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:43.239733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:43.239734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.239735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.239737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.239738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:43.239740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:43.239745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:43.239755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:43.239759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:43.239763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:43.239767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:43.239772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:43.239776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:43.239780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:43.239784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:43.239789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:43.239793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.239797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.239801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.239805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:43.239809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:43.239815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:43.239824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:43.239830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:43.239836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:43.239840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:43.239847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:43.239851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:43.239857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:43.239862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:43.239867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:43.239871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:43.239875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:43.239880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:43.239885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:43.239890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:43.239895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:43.239900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:43.239906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:43.239910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:43.239915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:43.239926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.239932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.239936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.239941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.239950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.239955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.239964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:43.239969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:43.239974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:43.239984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:43.240004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895031089253503:5640] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:43.240029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:43.244842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895031089253503:5640] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:43.244859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895031089253503:5640] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:43.244862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895031089253503:5640] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:43.244869Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 541 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:43.245143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:43.246004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:43.246019Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:43.246022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:43.246026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:43.246033Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 540 [2:7555895030999526398:4743]
2025-09-30T14:51:43.246048Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:43.246062Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:43.246066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:43.246069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:43.246071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:43.246086Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:43.246094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:43.246100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:43.246156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.246163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.246165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.246169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:43.246171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:43.246244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:43.246253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.246264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.246280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.246302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:43.246325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895031089253422:2454], now have 1 active actors on pipe
2025-09-30T14:51:43.246333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895031089253542:5640], now have 1 active actors on pipe
2025-09-30T14:51:43.246341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895030999526391:4743]
2025-09-30T14:51:43.246347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895030999526391:4743]
2025-09-30T14:51:43.246349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895030999526391:4743]
2025-09-30T14:51:43.246364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:43.246382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:43.246383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:43.246386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:43.246387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:43.246396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:43.246357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 540
2025-09-30T14:51:43.246401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:43.246371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 540
2025-09-30T14:51:43.246443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:43.246469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:43.246482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895030999526391:4743]
2025-09-30T14:51:43.246491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:43.246505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:43.246523Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|806637ad-5ccd4fdb-abc90ada-3c4d4754_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:43.246534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:43.246542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:43.246544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:43.246552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:43.246565Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:43.246591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:43.246737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:43.246747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:43.246763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:43.246824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 541 partition: 0 MaxSeqNo: 42 sessionId: src_id|806637ad-5ccd4fdb-abc90ada-3c4d4754_0
2025-09-30T14:51:43.247144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|401e1f92-3746dbcb-45f7b75-a000ab7e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|806637ad-5ccd4fdb-abc90ada-3c4d4754_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:43.250541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|806637ad-5ccd4fdb-abc90ada-3c4d4754_0] Write session: try to update token
2025-09-30T14:51:43.250568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|806637ad-5ccd4fdb-abc90ada-3c4d4754_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:43.258431Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:43.258466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:43.258469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:43.258471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:43.258483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895030999526391:4743]
2025-09-30T14:51:43.258487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895030999526391:4743]
2025-09-30T14:51:43.258491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895030999526391:4743]
2025-09-30T14:51:43.258534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:43.258544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.258552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:43.258553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:43.258560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:43.258581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:43.258700Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:43.266475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 541 sessionId: src_id|806637ad-5ccd4fdb-abc90ada-3c4d4754_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:43.269139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:43.325859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895031089253550:5419]
2025-09-30T14:51:43.326146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 540, pipe: [1:7555895031089253550:5419]
2025-09-30T14:51:43.363041Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:43.363477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:43.363490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:43.363506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895031089253550:5419], now have 1 active actors on pipe
2025-09-30T14:51:43.363690Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:43.363733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895031089253550:5419]
2025-09-30T14:51:43.363732Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:43.363766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:43.363834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 541 reason: status is not ok: tablet will be restarted right now sessionId: src_id|806637ad-5ccd4fdb-abc90ada-3c4d4754_0
2025-09-30T14:51:43.363984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 541 sessionId: src_id|806637ad-5ccd4fdb-abc90ada-3c4d4754_0 is DEAD
2025-09-30T14:51:43.364142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|806637ad-5ccd4fdb-abc90ada-3c4d4754_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:43.364153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|806637ad-5ccd4fdb-abc90ada-3c4d4754_0] Write session will restart in 0.008561s
2025-09-30T14:51:43.364175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|806637ad-5ccd4fdb-abc90ada-3c4d4754_0] Write session: Do CDS request
2025-09-30T14:51:43.364181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|806637ad-5ccd4fdb-abc90ada-3c4d4754_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:43.373623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:43.373703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|806637ad-5ccd4fdb-abc90ada-3c4d4754_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:43.373879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:43.373899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 542
2025-09-30T14:51:43.374044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 542 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:43.374082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 542 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:43.374092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=542 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:43.374096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:43.374534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 542 sessionId:  describe result for acl check
2025-09-30T14:51:43.374577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:43.374584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:43.374586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:43.374592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895031089253633:5644] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:43.375223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895031089253633:5644] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:43.375546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:43.375737Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:43.375746Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:43.375756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:43.375804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:43.375845Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895030999526517:4745]
2025-09-30T14:51:43.376474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:43.376710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:43.376749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:43.377038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:43.377107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:43.377113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:43.377114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:43.377115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:43.377116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:43.377117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:43.377118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:43.377119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:43.377120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:43.377121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:43.377122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.377123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.377124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.377125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:43.377126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:43.377131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:43.377140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:43.377144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:43.377148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:43.377151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:43.377154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:43.377158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:43.377161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:43.377165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:43.377168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:43.377171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.377175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.377178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.377182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:43.377185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:43.377192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:43.377199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:43.377204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:43.377209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:43.377214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:43.377219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:43.377223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:43.377227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:43.377232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:43.377236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:43.377241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:43.377245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:43.377250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:43.377255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:43.377258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:43.377263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:43.377267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:43.377272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:43.377283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:43.377288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:43.377293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.377298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.377302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.377308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.377313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.377317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.377321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:43.377325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:43.377335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:43.377340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:43.377314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895031089253633:5644] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:43.377380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:43.382177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895031089253633:5644] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:43.382222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895031089253633:5644] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:43.382226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895031089253633:5644] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:43.382237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 542 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:43.382450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:43.383316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:43.383328Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:43.383329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:43.383332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:43.383337Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 541 [2:7555895030999526517:4745]
2025-09-30T14:51:43.383349Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:43.383360Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:43.383362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:43.383364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:43.383366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:43.383378Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:43.383382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:43.383388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:43.383432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.383438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.383439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.383441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:43.383443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:43.383493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:43.383499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.383507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.383513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.383522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:43.383539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895030999526511:4745]
2025-09-30T14:51:43.383543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895030999526511:4745]
2025-09-30T14:51:43.383545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895030999526511:4745]
2025-09-30T14:51:43.383551Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:43.383561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:43.383568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:43.383572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:43.383573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:43.383574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:43.383575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:43.383582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895031089253672:5644], now have 1 active actors on pipe
2025-09-30T14:51:43.383585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895031089253551:2454], now have 1 active actors on pipe
2025-09-30T14:51:43.383605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895030999526511:4745]
2025-09-30T14:51:43.383621Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:43.383643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:43.383671Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 541
2025-09-30T14:51:43.383684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 541
2025-09-30T14:51:43.383735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:43.383744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:43.383766Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7eaa5814-1d04cc9a-e47c65b8-9cbf95cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:43.383775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:43.383779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:43.383784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:43.383793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:43.383807Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:43.383825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:43.384033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:43.384041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:43.384052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:43.384166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 542 partition: 0 MaxSeqNo: 42 sessionId: src_id|7eaa5814-1d04cc9a-e47c65b8-9cbf95cf_0
2025-09-30T14:51:43.384555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|806637ad-5ccd4fdb-abc90ada-3c4d4754_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7eaa5814-1d04cc9a-e47c65b8-9cbf95cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:43.387345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7eaa5814-1d04cc9a-e47c65b8-9cbf95cf_0] Write session: try to update token
2025-09-30T14:51:43.387364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7eaa5814-1d04cc9a-e47c65b8-9cbf95cf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:43.395581Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:43.395601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:43.395603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:43.395605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:43.395613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895030999526511:4745]
2025-09-30T14:51:43.395618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895030999526511:4745]
2025-09-30T14:51:43.395623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895030999526511:4745]
2025-09-30T14:51:43.395660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:43.395666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.395669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:43.395669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:43.395675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:43.395682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:43.395802Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:43.401592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 542 sessionId: src_id|7eaa5814-1d04cc9a-e47c65b8-9cbf95cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:43.404227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:43.464148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895031089253681:5419]
2025-09-30T14:51:43.464479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 541, pipe: [1:7555895031089253681:5419]
2025-09-30T14:51:43.499399Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:43.499795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:43.499808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:43.499840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895031089253681:5419], now have 1 active actors on pipe
2025-09-30T14:51:43.500025Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:43.500097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:43.500106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895031089253681:5419]
2025-09-30T14:51:43.500112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:43.500129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:43.500165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 542 reason: error at write: Disconnected sessionId: src_id|7eaa5814-1d04cc9a-e47c65b8-9cbf95cf_0
2025-09-30T14:51:43.500324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 542 sessionId: src_id|7eaa5814-1d04cc9a-e47c65b8-9cbf95cf_0 is DEAD
2025-09-30T14:51:43.500478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eaa5814-1d04cc9a-e47c65b8-9cbf95cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:43.500486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eaa5814-1d04cc9a-e47c65b8-9cbf95cf_0] Write session will restart in 0.005438s
2025-09-30T14:51:43.500502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eaa5814-1d04cc9a-e47c65b8-9cbf95cf_0] Write session: Do CDS request
2025-09-30T14:51:43.500506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eaa5814-1d04cc9a-e47c65b8-9cbf95cf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:43.506752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7eaa5814-1d04cc9a-e47c65b8-9cbf95cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:43.506824Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:43.506838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 543
2025-09-30T14:51:43.506943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 543 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:43.506966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 543 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:43.506973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=543 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:43.506977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:43.507444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 543 sessionId:  describe result for acl check
2025-09-30T14:51:43.507480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:43.507488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:43.507489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:43.507495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895031089253744:5649] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:43.508096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895031089253744:5649] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:43.509148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:43.509824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895031089253744:5649] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:43.510754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:43.510915Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:43.510924Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:43.510934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:43.510981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:43.511020Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895030999526639:4747]
2025-09-30T14:51:43.511661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:43.511773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895031089253744:5649] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:43.511789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895031089253744:5649] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:43.511792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895031089253744:5649] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:43.511806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 543 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:43.511888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:43.511932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:43.512297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:43.512357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:43.512363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:43.512364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:43.512365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:43.512367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:43.512368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:43.512369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:43.512370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:43.512371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:43.512373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:43.512374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.512375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.512376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.512377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:43.512378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:43.512384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:43.512393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:43.512398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:43.512402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:43.512405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:43.512409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:43.512413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:43.512418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:43.512422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:43.512426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:43.512430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.512435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.512439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.512448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:43.512452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:43.512460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:43.512473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:43.512484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:43.512489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:43.512498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:43.512504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:43.512513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:43.512519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:43.512528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:43.512533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:43.512539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:43.512544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:43.512553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:43.512558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:43.512566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:43.512571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:43.512576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:43.512586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:43.512590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:43.512600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:43.512604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.512614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.512624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.512629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.512638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.512643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.512652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:43.512661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:43.512671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:43.512676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:43.512724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:43.517949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:43.518978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:43.518998Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:43.519001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:43.519006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:43.519013Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 542 [2:7555895030999526639:4747]
2025-09-30T14:51:43.519029Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:43.519044Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:43.519047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:43.519050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:43.519053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:43.519067Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:43.519075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:43.519081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:43.519141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.519149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.519151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.519155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:43.519157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:43.519219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:43.519227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.519261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.519273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.519295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:43.519320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895031089253803:5649], now have 1 active actors on pipe
2025-09-30T14:51:43.519330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895031089253683:2454], now have 1 active actors on pipe
2025-09-30T14:51:43.519337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895030999526634:4747]
2025-09-30T14:51:43.519339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895030999526634:4747]
2025-09-30T14:51:43.519341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895030999526634:4747]
2025-09-30T14:51:43.519354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:43.519373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:43.519382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 542
2025-09-30T14:51:43.519379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:43.519383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:43.519385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:43.519397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:43.519400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:43.519432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895030999526634:4747]
2025-09-30T14:51:43.519441Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:43.519463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:43.519489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 542
2025-09-30T14:51:43.519518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:43.519527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:43.519553Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f060474-ff0da1bd-b7d71408-f34f7c31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:43.519563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:43.519569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:43.519571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:43.519582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:43.519591Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:43.519610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:43.519760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:43.519769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:43.519784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:43.519863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 543 partition: 0 MaxSeqNo: 42 sessionId: src_id|7f060474-ff0da1bd-b7d71408-f34f7c31_0
2025-09-30T14:51:43.520220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eaa5814-1d04cc9a-e47c65b8-9cbf95cf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7f060474-ff0da1bd-b7d71408-f34f7c31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:43.523016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f060474-ff0da1bd-b7d71408-f34f7c31_0] Write session: try to update token
2025-09-30T14:51:43.523036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f060474-ff0da1bd-b7d71408-f34f7c31_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:43.536523Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:43.536541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:43.536551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895030999526634:4747]
2025-09-30T14:51:43.536601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:43.536611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:43.536761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:43.536899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:43.537028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:43.537158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:43.537335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:43.537367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:43.537525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 543 sessionId: src_id|7f060474-ff0da1bd-b7d71408-f34f7c31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:43.540296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:43.540508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:43.540527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:43.540577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:43.540640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:43.541690Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:43.541703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:43.541705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:43.541707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:43.541717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895030999526634:4747]
2025-09-30T14:51:43.541721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895030999526634:4747]
2025-09-30T14:51:43.541724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895030999526634:4747]
2025-09-30T14:51:43.541758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:43.541761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:43.541767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:43.541769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.541771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:43.541771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:43.541905Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:43.600311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895031089253812:5419]
2025-09-30T14:51:43.600581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 542, pipe: [1:7555895031089253812:5419]
2025-09-30T14:51:43.646248Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:43.653059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:43.653087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:43.653249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:43.653311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:43.653373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:43.653430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:43.653478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:43.653487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:43.653554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:43.653615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:43.653679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:43.653749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:43.653795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:43.653804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:43.653867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:43.653926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:43.653982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:43.654040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:43.654083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:43.654090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:43.654156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:43.654215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:43.654284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:43.654346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:43.654387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:43.654393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:43.654470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:43.654526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:43.654588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:43.654646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:43.654692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:43.654698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:43.654760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:43.654821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:43.654885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:43.654946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:43.654995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:43.655002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:43.655073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:43.655139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:43.655200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:43.655275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:43.655321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:43.655328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:43.655393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:43.655456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:43.655524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:43.655583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:43.655625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:43.655631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:43.655692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:43.655750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:43.655809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:43.655868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:43.655916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:43.655927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:43.655989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:43.656047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:43.656106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:43.656165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:43.656208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:43.656216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:43.656270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895031089253812:5419], now have 1 active actors on pipe
2025-09-30T14:51:43.656566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:43.656571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895031089253812:5419]
2025-09-30T14:51:43.656583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:43.656603Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:43.656615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 543 reason: error at write: Disconnected sessionId: src_id|7f060474-ff0da1bd-b7d71408-f34f7c31_0
2025-09-30T14:51:43.656806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 543 sessionId: src_id|7f060474-ff0da1bd-b7d71408-f34f7c31_0 is DEAD
2025-09-30T14:51:43.656959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f060474-ff0da1bd-b7d71408-f34f7c31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:43.656969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f060474-ff0da1bd-b7d71408-f34f7c31_0] Write session will restart in 0.006039s
2025-09-30T14:51:43.656993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f060474-ff0da1bd-b7d71408-f34f7c31_0] Write session: Do CDS request
2025-09-30T14:51:43.656999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f060474-ff0da1bd-b7d71408-f34f7c31_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:43.657147Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:43.663695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f060474-ff0da1bd-b7d71408-f34f7c31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:43.663762Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:43.663777Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 544
2025-09-30T14:51:43.663900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 544 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:43.663929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 544 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:43.663935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=544 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:43.663943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:43.664347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 544 sessionId:  describe result for acl check
2025-09-30T14:51:43.664372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:43.664374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:43.664375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:43.664378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895031089253839:5653] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:43.664809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895031089253839:5653] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:43.667238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895031089253839:5653] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:43.667778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:43.669694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:43.669880Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:43.669889Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:43.669898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:43.669937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:43.669969Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895030999526762:4750]
2025-09-30T14:51:43.669979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895031089253839:5653] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:43.669995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895031089253839:5653] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:43.670000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895031089253839:5653] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:43.670013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 544 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:43.670440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:43.670711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:43.670761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:43.670987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:43.671033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:43.671041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:43.671042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:43.671043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:43.671044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:43.671045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:43.671046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:43.671046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:43.671047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:43.671048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:43.671049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.671049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.671050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.671051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:43.671051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:43.671055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:43.671062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:43.671064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:43.671067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:43.671069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:43.671071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:43.671074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:43.671076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:43.671079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:43.671082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:43.671085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.671087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.671089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.671092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:43.671094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:43.671101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:43.671106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:43.671110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:43.671113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:43.671116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:43.671119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:43.671123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:43.671126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:43.671129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:43.671132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:43.671135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:43.671139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:43.671141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:43.671145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:43.671147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:43.671150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:43.671152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:43.671156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:43.671158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:43.671161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:43.671164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.671167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.671170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.671173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.671177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.671180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.671183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:43.671186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:43.671189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:43.671192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:43.671215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:43.676381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:43.677178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:43.677194Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:43.677197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:43.677201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:43.677209Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 543 [2:7555895030999526762:4750]
2025-09-30T14:51:43.677227Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:43.677246Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:43.677253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:43.677256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:43.677259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:43.677272Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:43.677282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:43.677288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:43.677330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.677341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.677342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.677345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:43.677348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:43.677413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:43.677421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.677433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.677446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.677467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:43.677491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895031089253814:2454], now have 1 active actors on pipe
2025-09-30T14:51:43.677499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895031089253933:5653], now have 1 active actors on pipe
2025-09-30T14:51:43.677506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895030999526756:4750]
2025-09-30T14:51:43.677508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895030999526756:4750]
2025-09-30T14:51:43.677510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895030999526756:4750]
2025-09-30T14:51:43.677521Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:43.677535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:43.677534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:43.677538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:43.677540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:43.677550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 543
2025-09-30T14:51:43.677553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:43.677553Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 543
2025-09-30T14:51:43.677557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:43.677586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895030999526756:4750]
2025-09-30T14:51:43.677589Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:43.677592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:43.677608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:43.677613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:43.677659Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed6026ea-79c1b152-a0f3622-46c3cb67_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:43.677670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:43.677674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:43.677677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:43.677687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:43.677696Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:43.677716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:43.677889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:43.677900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:43.677916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:43.677995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 544 partition: 0 MaxSeqNo: 42 sessionId: src_id|ed6026ea-79c1b152-a0f3622-46c3cb67_0
2025-09-30T14:51:43.678298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f060474-ff0da1bd-b7d71408-f34f7c31_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ed6026ea-79c1b152-a0f3622-46c3cb67_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:43.681106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed6026ea-79c1b152-a0f3622-46c3cb67_0] Write session: try to update token
2025-09-30T14:51:43.681124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed6026ea-79c1b152-a0f3622-46c3cb67_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:43.689378Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:43.689396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:43.689399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:43.689400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:43.689409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895030999526756:4750]
2025-09-30T14:51:43.689413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895030999526756:4750]
2025-09-30T14:51:43.689419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895030999526756:4750]
2025-09-30T14:51:43.689457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:43.689458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:43.689465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.689466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:43.689468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:43.689470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:43.689603Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:43.694994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 544 sessionId: src_id|ed6026ea-79c1b152-a0f3622-46c3cb67_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:43.697701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:43.757002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895031089253966:5419]
2025-09-30T14:51:43.757264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 543, pipe: [1:7555895031089253966:5419]
2025-09-30T14:51:43.796568Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:43.796871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:43.796885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:43.796919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895031089253966:5419], now have 1 active actors on pipe
2025-09-30T14:51:43.797093Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:43.797123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:43.797146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:43.797150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:43.797214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 544 reason: error at write: Disconnected sessionId: src_id|ed6026ea-79c1b152-a0f3622-46c3cb67_0
2025-09-30T14:51:43.797226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895031089253966:5419]
2025-09-30T14:51:43.797391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 544 sessionId: src_id|ed6026ea-79c1b152-a0f3622-46c3cb67_0 is DEAD
2025-09-30T14:51:43.797573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed6026ea-79c1b152-a0f3622-46c3cb67_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:43.797584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed6026ea-79c1b152-a0f3622-46c3cb67_0] Write session will restart in 0.009707s
2025-09-30T14:51:43.797607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed6026ea-79c1b152-a0f3622-46c3cb67_0] Write session: Do CDS request
2025-09-30T14:51:43.797616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed6026ea-79c1b152-a0f3622-46c3cb67_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:43.807100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:43.808715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed6026ea-79c1b152-a0f3622-46c3cb67_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:43.808790Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:43.808800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:43.808807Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 545
2025-09-30T14:51:43.808913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 545 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:43.808942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 545 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:43.808950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=545 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:43.808954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:43.809014Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:43.809024Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:43.809034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:43.809078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:43.809114Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895030999526922:4764]
2025-09-30T14:51:43.809332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 545 sessionId:  describe result for acl check
2025-09-30T14:51:43.809361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:43.809368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:43.809370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:43.809375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895031089254054:5664] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:43.809741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:43.809882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895031089254054:5664] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:43.810043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:43.810101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:43.810397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:43.810445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:43.810461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:43.810462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:43.810462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:43.810463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:43.810464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:43.810464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:43.810465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:43.810466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:43.810466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:43.810467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.810468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.810469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.810469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:43.810470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:43.810474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:43.810481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:43.810483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:43.810486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:43.810488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:43.810491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:43.810493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:43.810495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:43.810498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:43.810500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:43.810503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.810505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.810507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.810509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:43.810512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:43.810516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:43.810521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:43.810525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:43.810528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:43.810531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:43.810534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:43.810536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:43.810539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:43.810542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:43.810545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:43.810548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:43.810550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:43.810553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:43.810556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:43.810559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:43.810561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:43.810564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:43.810567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:43.810569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:43.810572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:43.810575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.810579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.810581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.810583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.810586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.810588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.810591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:43.810594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:43.810597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:43.810599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:43.810623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:43.812483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895031089254054:5664] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:43.815562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895031089254054:5664] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:43.815579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895031089254054:5664] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:43.815583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895031089254054:5664] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:43.815592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 545 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:43.816004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:43.816924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:43.816944Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:43.816947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:43.816950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:43.816958Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 544 [2:7555895030999526922:4764]
2025-09-30T14:51:43.816973Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:43.816988Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:43.816998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:43.817002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:43.817004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:43.817021Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:43.817027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:43.817035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:43.817108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.817118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.817121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.817125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:43.817128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:43.817194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:43.817202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.817216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.817235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.817254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:43.817277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895031089253967:2454], now have 1 active actors on pipe
2025-09-30T14:51:43.817288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895031089254092:5664], now have 1 active actors on pipe
2025-09-30T14:51:43.817294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895030999526916:4764]
2025-09-30T14:51:43.817296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895030999526916:4764]
2025-09-30T14:51:43.817299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895030999526916:4764]
2025-09-30T14:51:43.817312Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:43.817326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:43.817353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 544
2025-09-30T14:51:43.817358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 544
2025-09-30T14:51:43.817332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:43.817342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:43.817342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:43.817344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:43.817346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:43.817379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895030999526916:4764]
2025-09-30T14:51:43.817382Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:43.817385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:43.817413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:43.817417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:43.817447Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca1b8c5e-f64669be-e4c068e0-bc547603_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:43.817462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:43.817471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:43.817474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:43.817483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:43.817497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:43.817520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:43.817674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:43.817689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:43.817708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:43.817812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 545 partition: 0 MaxSeqNo: 42 sessionId: src_id|ca1b8c5e-f64669be-e4c068e0-bc547603_0
2025-09-30T14:51:43.818148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed6026ea-79c1b152-a0f3622-46c3cb67_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ca1b8c5e-f64669be-e4c068e0-bc547603_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:43.820673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca1b8c5e-f64669be-e4c068e0-bc547603_0] Write session: try to update token
2025-09-30T14:51:43.820687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca1b8c5e-f64669be-e4c068e0-bc547603_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:43.829696Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:43.829716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:43.829719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:43.829721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:43.829736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895030999526916:4764]
2025-09-30T14:51:43.829740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895030999526916:4764]
2025-09-30T14:51:43.829744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895030999526916:4764]
2025-09-30T14:51:43.829789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:43.829790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:43.829796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:43.829798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.829800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:43.829801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:43.830009Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:43.835066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 545 sessionId: src_id|ca1b8c5e-f64669be-e4c068e0-bc547603_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:43.837788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:43.897297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895031089254111:5419]
2025-09-30T14:51:43.897569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 544, pipe: [1:7555895031089254111:5419]
2025-09-30T14:51:43.935682Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:43.936113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:43.936133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:43.936176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895031089254111:5419], now have 1 active actors on pipe
2025-09-30T14:51:43.936407Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:43.936427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:43.936440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:43.936445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:43.936490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895031089254111:5419]
2025-09-30T14:51:43.936509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 545 reason: error at write: Disconnected sessionId: src_id|ca1b8c5e-f64669be-e4c068e0-bc547603_0
2025-09-30T14:51:43.936689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 545 sessionId: src_id|ca1b8c5e-f64669be-e4c068e0-bc547603_0 is DEAD
2025-09-30T14:51:43.936815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca1b8c5e-f64669be-e4c068e0-bc547603_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:43.936826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca1b8c5e-f64669be-e4c068e0-bc547603_0] Write session will restart in 0.007216s
2025-09-30T14:51:43.936849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca1b8c5e-f64669be-e4c068e0-bc547603_0] Write session: Do CDS request
2025-09-30T14:51:43.936855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca1b8c5e-f64669be-e4c068e0-bc547603_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:43.944735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca1b8c5e-f64669be-e4c068e0-bc547603_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:43.944884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:43.944910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 546
2025-09-30T14:51:43.945027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 546 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:43.945069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 546 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:43.945082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=546 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:43.945086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:43.945539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 546 sessionId:  describe result for acl check
2025-09-30T14:51:43.945574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:43.945581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:43.945582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:43.945589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895031089254192:5669] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:43.946131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895031089254192:5669] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:43.947302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:43.948564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895031089254192:5669] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:43.949232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:43.949423Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:43.949434Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:43.949445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:43.949508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:43.949548Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895030999527059:4767]
2025-09-30T14:51:43.950196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:43.951070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:43.951132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:43.951520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:43.951598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:43.951604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:43.951606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:43.951607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:43.951608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:43.951610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:43.951611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:43.951612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:43.951613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:43.951614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:43.951615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.951617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.951618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.951619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:43.951620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:43.951626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:43.951635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:43.951639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:43.951642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:43.951646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:43.951650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:43.951653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:43.951656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:43.951659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:43.951663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:43.951667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.951670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.951673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.951677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:43.951680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:43.951689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:43.951697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:43.951702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:43.951707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:43.951712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:43.951717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:43.951720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:43.951725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:43.951729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:43.951734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:43.951738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:43.951742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:43.951718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895031089254192:5669] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:43.951748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:43.951735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895031089254192:5669] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:43.951738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895031089254192:5669] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:43.951747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 546 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:43.951753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:43.951756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:43.951761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:43.951765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:43.951770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:43.951775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:43.951781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:43.951786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.951793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.951798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.951803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.951808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.951814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.951818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:43.951823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:43.951830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:43.951841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:43.951897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:43.957270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:43.958074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:43.958091Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:43.958094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:43.958098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:43.958106Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 545 [2:7555895030999527059:4767]
2025-09-30T14:51:43.958119Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:43.958131Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:43.958137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:43.958140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:43.958141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:43.958154Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:43.958163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:43.958169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:43.958223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.958230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.958232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.958235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:43.958237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:43.958286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:43.958292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.958301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:43.958308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:43.958321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:43.958333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895030999527053:4767]
2025-09-30T14:51:43.958340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895030999527053:4767]
2025-09-30T14:51:43.958342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895030999527053:4767]
2025-09-30T14:51:43.958352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:43.958360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:43.958370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:43.958375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:43.958377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:43.958385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:43.958388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:43.958395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895031089254112:2454], now have 1 active actors on pipe
2025-09-30T14:51:43.958398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895031089254235:5669], now have 1 active actors on pipe
2025-09-30T14:51:43.958423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895030999527053:4767]
2025-09-30T14:51:43.958436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:43.958469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:43.958447Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 545
2025-09-30T14:51:43.958462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 545
2025-09-30T14:51:43.958752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:43.958766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:43.958794Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|489ebc7c-a92edc2b-34996575-4bea97ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:43.958806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:43.958814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:43.958817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:43.958829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:43.958844Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:43.958862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:43.959038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:43.959046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:43.959059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:43.959143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 546 partition: 0 MaxSeqNo: 42 sessionId: src_id|489ebc7c-a92edc2b-34996575-4bea97ad_0
2025-09-30T14:51:43.959549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca1b8c5e-f64669be-e4c068e0-bc547603_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|489ebc7c-a92edc2b-34996575-4bea97ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:43.962300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|489ebc7c-a92edc2b-34996575-4bea97ad_0] Write session: try to update token
2025-09-30T14:51:43.962320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|489ebc7c-a92edc2b-34996575-4bea97ad_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:43.970633Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:43.970652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:43.970654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:43.970656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:43.970666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895030999527053:4767]
2025-09-30T14:51:43.970670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895030999527053:4767]
2025-09-30T14:51:43.970674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895030999527053:4767]
2025-09-30T14:51:43.970715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:43.970714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:43.970721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:43.970723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:43.970724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:43.970727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:43.970902Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:43.976755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 546 sessionId: src_id|489ebc7c-a92edc2b-34996575-4bea97ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:43.979403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:44.036542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895035384221548:5419]
2025-09-30T14:51:44.036776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 545, pipe: [1:7555895035384221548:5419]
2025-09-30T14:51:44.078370Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:44.078670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:44.078683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:44.078721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895035384221548:5419], now have 1 active actors on pipe
2025-09-30T14:51:44.078886Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:44.079006Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:44.079065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:44.079089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895035384221548:5419]
2025-09-30T14:51:44.079139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 546 reason: status is not ok: tablet will be restarted right now sessionId: src_id|489ebc7c-a92edc2b-34996575-4bea97ad_0
2025-09-30T14:51:44.079344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 546 sessionId: src_id|489ebc7c-a92edc2b-34996575-4bea97ad_0 is DEAD
2025-09-30T14:51:44.079508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|489ebc7c-a92edc2b-34996575-4bea97ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:44.079517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|489ebc7c-a92edc2b-34996575-4bea97ad_0] Write session will restart in 0.006146s
2025-09-30T14:51:44.079548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|489ebc7c-a92edc2b-34996575-4bea97ad_0] Write session: Do CDS request
2025-09-30T14:51:44.079554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|489ebc7c-a92edc2b-34996575-4bea97ad_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:44.086735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|489ebc7c-a92edc2b-34996575-4bea97ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:44.086822Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:44.086840Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 547
2025-09-30T14:51:44.086992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 547 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:44.087024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 547 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:44.087035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=547 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:44.087038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:44.087517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 547 sessionId:  describe result for acl check
2025-09-30T14:51:44.087562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:44.087570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:44.087572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:44.087577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895035384221611:5675] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:44.088169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895035384221611:5675] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:44.089495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:44.090157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895035384221611:5675] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:44.091370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:44.091566Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:44.091576Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:44.091585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:44.091636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:44.091667Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895035294494483:4770]
2025-09-30T14:51:44.092308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:44.092448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895035384221611:5675] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:44.092463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895035384221611:5675] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:44.092466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895035384221611:5675] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:44.092474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 547 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:44.092564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:44.092606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:44.092850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:44.092904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:44.092909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:44.092910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:44.092912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:44.092913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:44.092914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:44.092915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:44.092916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:44.092917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:44.092918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:44.092920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.092921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.092922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.092924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:44.092925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:44.092930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:44.092940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:44.092945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:44.092949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:44.092954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:44.092959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:44.092963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:44.092967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:44.092971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:44.092976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:44.092981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.092985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.092989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.092993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:44.092998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:44.093004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:44.093014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:44.093020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:44.093030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:44.093035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:44.093045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:44.093052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:44.093058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:44.093066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:44.093071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:44.093076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:44.093086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:44.093092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:44.093101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:44.093107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:44.093116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:44.093125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:44.093131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:44.093139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:44.093144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:44.093149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.093157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.093165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.093171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.093179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.093186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.093193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:44.093199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:44.093207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:44.093212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:44.093250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:44.098612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:44.099634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:44.099647Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:44.099650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:44.099654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:44.099661Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 546 [2:7555895035294494483:4770]
2025-09-30T14:51:44.099678Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:44.099694Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:44.099701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:44.099704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:44.099706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:44.099722Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:44.099733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:44.099743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:44.099802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.099809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.099811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.099815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:44.099817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:44.099888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:44.099895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.099908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.099926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.099946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:44.099968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895035384221552:2454], now have 1 active actors on pipe
2025-09-30T14:51:44.099976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895035384221676:5675], now have 1 active actors on pipe
2025-09-30T14:51:44.099983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895035294494477:4770]
2025-09-30T14:51:44.099990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895035294494477:4770]
2025-09-30T14:51:44.099992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895035294494477:4770]
2025-09-30T14:51:44.100005Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:44.100026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:44.100025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:44.100030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:44.100032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:44.100044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:44.100048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:44.100082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895035294494477:4770]
2025-09-30T14:51:44.100058Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 546
2025-09-30T14:51:44.100089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:44.100065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 546
2025-09-30T14:51:44.100111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:44.100127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:44.100135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:44.100161Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98c8a3da-d5b72e66-b114a02e-e05c4f28_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:44.100175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:44.100178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:44.100180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:44.100190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:44.100199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:44.100212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:44.100370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:44.100379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:44.100395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:44.100501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 547 partition: 0 MaxSeqNo: 42 sessionId: src_id|98c8a3da-d5b72e66-b114a02e-e05c4f28_0
2025-09-30T14:51:44.100828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|489ebc7c-a92edc2b-34996575-4bea97ad_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|98c8a3da-d5b72e66-b114a02e-e05c4f28_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:44.103590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98c8a3da-d5b72e66-b114a02e-e05c4f28_0] Write session: try to update token
2025-09-30T14:51:44.103609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98c8a3da-d5b72e66-b114a02e-e05c4f28_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:44.112112Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:44.112130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:44.112141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895035294494477:4770]
2025-09-30T14:51:44.112188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:44.112192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:44.112356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:44.112510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:44.112655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:44.112800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:44.113009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:44.113050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:44.118633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 547 sessionId: src_id|98c8a3da-d5b72e66-b114a02e-e05c4f28_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:44.121398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:44.122740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:44.122768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:44.122788Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:44.122792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:44.122795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:44.122797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:44.122807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895035294494477:4770]
2025-09-30T14:51:44.122811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895035294494477:4770]
2025-09-30T14:51:44.122817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895035294494477:4770]
2025-09-30T14:51:44.122863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:44.122868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:44.122874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.122877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:44.122885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:44.122889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:44.123009Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:44.179403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895035384221686:5419]
2025-09-30T14:51:44.179668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 546, pipe: [1:7555895035384221686:5419]
2025-09-30T14:51:44.231341Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:44.231638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:44.231674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895035384221686:5419], now have 1 active actors on pipe
2025-09-30T14:51:44.231806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:44.231845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895035384221686:5419]
2025-09-30T14:51:44.231868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:44.231923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:44.231931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:44.232000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 547 reason: error at write: Disconnected sessionId: src_id|98c8a3da-d5b72e66-b114a02e-e05c4f28_0
2025-09-30T14:51:44.232141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 547 sessionId: src_id|98c8a3da-d5b72e66-b114a02e-e05c4f28_0 is DEAD
2025-09-30T14:51:44.232308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98c8a3da-d5b72e66-b114a02e-e05c4f28_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:44.232319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98c8a3da-d5b72e66-b114a02e-e05c4f28_0] Write session will restart in 0.005594s
2025-09-30T14:51:44.232336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98c8a3da-d5b72e66-b114a02e-e05c4f28_0] Write session: Do CDS request
2025-09-30T14:51:44.232341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98c8a3da-d5b72e66-b114a02e-e05c4f28_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:44.238791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98c8a3da-d5b72e66-b114a02e-e05c4f28_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:44.238882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:44.238899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 548
2025-09-30T14:51:44.238997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 548 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:44.239028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 548 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:44.239037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=548 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:44.239041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:44.239490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 548 sessionId:  describe result for acl check
2025-09-30T14:51:44.239522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:44.239529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:44.239531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:44.239537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895035384221701:5679] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:44.240059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895035384221701:5679] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:44.242689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895035384221701:5679] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:44.244192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:44.246277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:44.246503Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:44.246514Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:44.246525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:44.246577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:44.246571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895035384221701:5679] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:44.246589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895035384221701:5679] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:44.246592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895035384221701:5679] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:44.246612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 548 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:44.246619Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895035294494610:4772]
2025-09-30T14:51:44.247297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:44.247588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:44.247629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:44.247959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:44.248028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:44.248034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:44.248035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:44.248037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:44.248038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:44.248040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:44.248042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:44.248043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:44.248044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:44.248045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:44.248047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.248048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.248050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.248051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:44.248052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:44.248057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:44.248068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:44.248073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:44.248077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:44.248083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:44.248086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:44.248090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:44.248094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:44.248098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:44.248103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:44.248107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.248111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.248115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.248119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:44.248124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:44.248136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:44.248149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:44.248159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:44.248169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:44.248178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:44.248188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:44.248196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:44.248202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:44.248211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:44.248221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:44.248232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:44.248241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:44.248250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:44.248260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:44.248268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:44.248278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:44.248283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:44.248290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:44.248298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:44.248305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:44.248314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.248324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.248332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.248343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.248352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.248361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.248365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:44.248375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:44.248383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:44.248392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:44.248439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:44.254320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:44.255304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:44.255321Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:44.255324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:44.255328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:44.255337Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 547 [2:7555895035294494610:4772]
2025-09-30T14:51:44.255354Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:44.255370Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:44.255374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:44.255377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:44.255379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:44.255395Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:44.255408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:44.255415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:44.255482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.255489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.255491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.255495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:44.255498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:44.255573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:44.255582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.255595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.255614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.255632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:44.255656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895035384221687:2454], now have 1 active actors on pipe
2025-09-30T14:51:44.255660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895035384221810:5679], now have 1 active actors on pipe
2025-09-30T14:51:44.255667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895035294494605:4772]
2025-09-30T14:51:44.255670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895035294494605:4772]
2025-09-30T14:51:44.255672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895035294494605:4772]
2025-09-30T14:51:44.255684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:44.255700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:44.255702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:44.255706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:44.255708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:44.255718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:44.255722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:44.255744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 547
2025-09-30T14:51:44.255745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 547
2025-09-30T14:51:44.255755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895035294494605:4772]
2025-09-30T14:51:44.255763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:44.255777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:44.255976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:44.255986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:44.256010Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3be866cf-214978bf-9e40968e-3320410c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:44.256022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:44.256030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:44.256032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:44.256041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:44.256334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 548 partition: 0 MaxSeqNo: 42 sessionId: src_id|3be866cf-214978bf-9e40968e-3320410c_0
2025-09-30T14:51:44.256699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98c8a3da-d5b72e66-b114a02e-e05c4f28_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3be866cf-214978bf-9e40968e-3320410c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:44.256054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:44.256076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:44.256217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:44.256220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:44.256237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:44.259572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3be866cf-214978bf-9e40968e-3320410c_0] Write session: try to update token
2025-09-30T14:51:44.259596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3be866cf-214978bf-9e40968e-3320410c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:44.267956Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:44.267975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:44.267978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:44.267980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:44.267989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895035294494605:4772]
2025-09-30T14:51:44.267997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895035294494605:4772]
2025-09-30T14:51:44.268001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895035294494605:4772]
2025-09-30T14:51:44.268045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:44.268048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:44.268054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:44.268057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.268059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:44.268061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:44.268221Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:44.274911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 548 sessionId: src_id|3be866cf-214978bf-9e40968e-3320410c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:44.278576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:44.331963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895035384221822:5419]
2025-09-30T14:51:44.332235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 547, pipe: [1:7555895035384221822:5419]
2025-09-30T14:51:44.379635Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:44.379932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:44.379945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:44.379965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895035384221822:5419], now have 1 active actors on pipe
2025-09-30T14:51:44.380139Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:44.380207Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:44.380219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895035384221822:5419]
2025-09-30T14:51:44.380250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:44.380312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 548 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3be866cf-214978bf-9e40968e-3320410c_0
2025-09-30T14:51:44.380482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 548 sessionId: src_id|3be866cf-214978bf-9e40968e-3320410c_0 is DEAD
2025-09-30T14:51:44.380650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3be866cf-214978bf-9e40968e-3320410c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:44.380656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3be866cf-214978bf-9e40968e-3320410c_0] Write session will restart in 0.009866s
2025-09-30T14:51:44.380673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3be866cf-214978bf-9e40968e-3320410c_0] Write session: Do CDS request
2025-09-30T14:51:44.380677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3be866cf-214978bf-9e40968e-3320410c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:44.390274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:44.391816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3be866cf-214978bf-9e40968e-3320410c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:44.391861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:44.391874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 549
2025-09-30T14:51:44.392055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 549 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:44.392089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 549 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:44.392099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=549 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:44.392103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:44.392337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:44.392527Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:44.392537Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:44.392548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:44.392521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 549 sessionId:  describe result for acl check
2025-09-30T14:51:44.392569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:44.392571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:44.392573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:44.392579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895035384221913:5683] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:44.392604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:44.392638Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895035294494737:4774]
2025-09-30T14:51:44.393187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895035384221913:5683] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:44.393288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:44.393560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:44.393601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:44.393912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:44.393973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:44.393979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:44.393980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:44.393981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:44.393982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:44.393983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:44.393985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:44.393986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:44.393987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:44.393988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:44.393989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.393990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.393992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.393993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:44.393994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:44.393999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:44.394008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:44.394023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:44.394028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:44.394031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:44.394034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:44.394038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:44.394042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:44.394045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:44.394049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:44.394053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.394056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.394059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.394063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:44.394067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:44.394074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:44.394081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:44.394086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:44.394091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:44.394095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:44.394100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:44.394104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:44.394109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:44.394113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:44.394124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:44.394129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:44.394133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:44.394150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:44.394160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:44.394165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:44.394170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:44.394174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:44.394179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:44.394183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:44.394188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:44.394192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.394197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.394201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.394207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.394212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.394217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.394227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:44.394232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:44.394237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:44.394246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:44.394290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:44.395154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895035384221913:5683] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:44.399211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895035384221913:5683] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:44.399230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895035384221913:5683] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:44.399234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895035384221913:5683] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:44.399262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 549 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:44.399564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:44.400451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:44.400467Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:44.400469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:44.400473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:44.400479Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 548 [2:7555895035294494737:4774]
2025-09-30T14:51:44.400495Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:44.400512Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:44.400520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:44.400523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:44.400525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:44.400540Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:44.400550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:44.400562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:44.400624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.400631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.400633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.400637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:44.400640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:44.400707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:44.400716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.400727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.400739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.400758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:44.400780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895035384221951:5683], now have 1 active actors on pipe
2025-09-30T14:51:44.400785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895035384221823:2454], now have 1 active actors on pipe
2025-09-30T14:51:44.400791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895035294494731:4774]
2025-09-30T14:51:44.400794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895035294494731:4774]
2025-09-30T14:51:44.400796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895035294494731:4774]
2025-09-30T14:51:44.400807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:44.400821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:44.400831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:44.400833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:44.400837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:44.400850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:44.400830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 548
2025-09-30T14:51:44.400856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:44.400884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 548
2025-09-30T14:51:44.400896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:44.400904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:44.400917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895035294494731:4774]
2025-09-30T14:51:44.400929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:44.400936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:44.400968Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|277cdbf5-41e1a8cf-a2e4602d-c96695fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:44.400980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:44.400984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:44.400986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:44.400995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:44.401009Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:44.401037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:44.401187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:44.401200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:44.401215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:44.401321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 549 partition: 0 MaxSeqNo: 42 sessionId: src_id|277cdbf5-41e1a8cf-a2e4602d-c96695fd_0
2025-09-30T14:51:44.401645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3be866cf-214978bf-9e40968e-3320410c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|277cdbf5-41e1a8cf-a2e4602d-c96695fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:44.404421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|277cdbf5-41e1a8cf-a2e4602d-c96695fd_0] Write session: try to update token
2025-09-30T14:51:44.404443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|277cdbf5-41e1a8cf-a2e4602d-c96695fd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:44.412701Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:44.412721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:44.412723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:44.412736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:44.412746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895035294494731:4774]
2025-09-30T14:51:44.412751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895035294494731:4774]
2025-09-30T14:51:44.412755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895035294494731:4774]
2025-09-30T14:51:44.412799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:44.412798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:44.412804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:44.412808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:44.412811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.412813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:44.412940Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:44.419620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 549 sessionId: src_id|277cdbf5-41e1a8cf-a2e4602d-c96695fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:44.422256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:44.480463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895035384221961:5419]
2025-09-30T14:51:44.480713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 548, pipe: [1:7555895035384221961:5419]
2025-09-30T14:51:44.521636Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:44.522084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:44.522098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:44.522115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895035384221961:5419], now have 1 active actors on pipe
2025-09-30T14:51:44.522424Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:44.522420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895035384221961:5419]
2025-09-30T14:51:44.522456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:44.522461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:44.522466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:44.522521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 549 reason: error at write: Disconnected sessionId: src_id|277cdbf5-41e1a8cf-a2e4602d-c96695fd_0
2025-09-30T14:51:44.522710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 549 sessionId: src_id|277cdbf5-41e1a8cf-a2e4602d-c96695fd_0 is DEAD
2025-09-30T14:51:44.522797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|277cdbf5-41e1a8cf-a2e4602d-c96695fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:44.522805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|277cdbf5-41e1a8cf-a2e4602d-c96695fd_0] Write session will restart in 0.008303s
2025-09-30T14:51:44.522835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|277cdbf5-41e1a8cf-a2e4602d-c96695fd_0] Write session: Do CDS request
2025-09-30T14:51:44.522846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|277cdbf5-41e1a8cf-a2e4602d-c96695fd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:44.532789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|277cdbf5-41e1a8cf-a2e4602d-c96695fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:44.532849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:44.532869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 550
2025-09-30T14:51:44.533040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 550 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:44.533076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 550 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:44.533081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=550 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:44.533086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:44.533536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 550 sessionId:  describe result for acl check
2025-09-30T14:51:44.533571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:44.533577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:44.533579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:44.533585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895035384222051:5688] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:44.534032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:44.534120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895035384222051:5688] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:44.535948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895035384222051:5688] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:44.536170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:44.536389Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:44.536408Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:44.536419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:44.536488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:44.536525Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895035294494867:4777]
2025-09-30T14:51:44.537160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:44.537406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:44.537437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:44.537703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:44.537753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:44.537758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:44.537758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:44.537759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:44.537760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:44.537760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:44.537761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:44.537762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:44.537763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:44.537764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:44.537764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.537766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.537766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.537767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:44.537768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:44.537771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:44.537777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:44.537780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:44.537782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:44.537785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:44.537787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:44.537790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:44.537792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:44.537794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:44.537797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:44.537800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.537802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.537804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.537807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:44.537809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:44.537814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:44.537819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:44.537823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:44.537827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:44.537830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:44.537835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:44.537838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:44.537841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:44.537845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:44.537848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:44.537850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:44.537854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:44.537856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:44.537859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:44.537862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:44.537865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:44.537868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:44.537870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:44.537873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:44.537876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:44.537879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.537882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.537885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.537888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.537890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.537893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.537896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:44.537899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:44.537901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:44.537904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:44.537930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:44.538461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895035384222051:5688] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:44.538479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895035384222051:5688] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:44.538483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895035384222051:5688] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:44.538491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 550 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:44.542951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:44.543844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:44.543862Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:44.543865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:44.543869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:44.543876Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 549 [2:7555895035294494867:4777]
2025-09-30T14:51:44.543894Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:44.543909Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:44.543917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:44.543921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:44.543924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:44.543940Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:44.543952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:44.543963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:44.544021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.544028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.544033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.544036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:44.544039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:44.544105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:44.544112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.544125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.544142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.544164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:44.544186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895035384222091:5688], now have 1 active actors on pipe
2025-09-30T14:51:44.544196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895035384221962:2454], now have 1 active actors on pipe
2025-09-30T14:51:44.544203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895035294494860:4777]
2025-09-30T14:51:44.544205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895035294494860:4777]
2025-09-30T14:51:44.544207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895035294494860:4777]
2025-09-30T14:51:44.544220Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:44.544230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:44.544232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:44.544234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:44.544228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 549
2025-09-30T14:51:44.544235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:44.544247Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 549
2025-09-30T14:51:44.544251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:44.544254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:44.544295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:44.544304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:44.544319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895035294494860:4777]
2025-09-30T14:51:44.544331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:44.544334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:44.544362Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19693413-d95cd6ac-a31271cd-42fcd9ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:44.544373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:44.544381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:44.544383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:44.544393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:44.544405Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:44.544437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:44.544571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:44.544580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:44.544595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:44.544688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 550 partition: 0 MaxSeqNo: 42 sessionId: src_id|19693413-d95cd6ac-a31271cd-42fcd9ab_0
2025-09-30T14:51:44.545020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|277cdbf5-41e1a8cf-a2e4602d-c96695fd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|19693413-d95cd6ac-a31271cd-42fcd9ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:44.547843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19693413-d95cd6ac-a31271cd-42fcd9ab_0] Write session: try to update token
2025-09-30T14:51:44.547862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19693413-d95cd6ac-a31271cd-42fcd9ab_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:44.556839Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:44.556857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:44.556859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:44.556861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:44.556870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895035294494860:4777]
2025-09-30T14:51:44.556873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895035294494860:4777]
2025-09-30T14:51:44.556876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895035294494860:4777]
2025-09-30T14:51:44.556915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:44.556922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.556925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:44.556925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:44.556931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:44.556935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:44.557061Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:44.562834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 550 sessionId: src_id|19693413-d95cd6ac-a31271cd-42fcd9ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:44.565638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:44.622795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895035384222098:5419]
2025-09-30T14:51:44.623035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 549, pipe: [1:7555895035384222098:5419]
2025-09-30T14:51:44.664853Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:44.665193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:44.665204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:44.665240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895035384222098:5419], now have 1 active actors on pipe
2025-09-30T14:51:44.665430Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:44.665545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895035384222098:5419]
2025-09-30T14:51:44.665573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:44.665578Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:44.665656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 550 reason: status is not ok: tablet will be restarted right now sessionId: src_id|19693413-d95cd6ac-a31271cd-42fcd9ab_0
2025-09-30T14:51:44.665875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 550 sessionId: src_id|19693413-d95cd6ac-a31271cd-42fcd9ab_0 is DEAD
2025-09-30T14:51:44.666006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19693413-d95cd6ac-a31271cd-42fcd9ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:44.666014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19693413-d95cd6ac-a31271cd-42fcd9ab_0] Write session will restart in 0.007763s
2025-09-30T14:51:44.666049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19693413-d95cd6ac-a31271cd-42fcd9ab_0] Write session: Do CDS request
2025-09-30T14:51:44.666055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19693413-d95cd6ac-a31271cd-42fcd9ab_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:44.674730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19693413-d95cd6ac-a31271cd-42fcd9ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:44.674842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:44.674861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 551
2025-09-30T14:51:44.675012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 551 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:44.675047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 551 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:44.675053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=551 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:44.675057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:44.675492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 551 sessionId:  describe result for acl check
2025-09-30T14:51:44.675533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:44.675541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:44.675543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:44.675550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895035384222188:5692] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:44.676121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895035384222188:5692] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:44.677083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:44.677963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895035384222188:5692] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:44.679086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:44.679277Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:44.679286Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:44.679296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:44.679345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:44.679383Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895035294494997:4779]
2025-09-30T14:51:44.680074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:44.680278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895035384222188:5692] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:44.680293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895035384222188:5692] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:44.680296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895035384222188:5692] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:44.680305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 551 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:44.680310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:44.680348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:44.680658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:44.680714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:44.680722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:44.680724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:44.680725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:44.680727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:44.680728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:44.680729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:44.680731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:44.680732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:44.680733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:44.680734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.680735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.680736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.680737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:44.680738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:44.680743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:44.680753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:44.680758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:44.680762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:44.680766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:44.680770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:44.680774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:44.680778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:44.680782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:44.680787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:44.680791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.680795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.680799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.680804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:44.680808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:44.680815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:44.680824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:44.680830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:44.680835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:44.680840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:44.680846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:44.680850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:44.680854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:44.680859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:44.680865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:44.680869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:44.680875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:44.680880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:44.680885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:44.680891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:44.680896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:44.680901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:44.680906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:44.680910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:44.680915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:44.680926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.680931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.680936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.680941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.680950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.680956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.680960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:44.680971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:44.680975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:44.680984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:44.681025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:44.686357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:44.687513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:44.687535Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:44.687538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:44.687542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:44.687549Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 550 [2:7555895035294494997:4779]
2025-09-30T14:51:44.687569Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:44.687583Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:44.687587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:44.687591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:44.687593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:44.687608Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:44.687615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:44.687623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:44.687681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.687689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.687691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.687694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:44.687696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:44.687764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:44.687774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.687786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.687799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.687820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:44.687844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895035384222228:5692], now have 1 active actors on pipe
2025-09-30T14:51:44.687853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895035384222100:2454], now have 1 active actors on pipe
2025-09-30T14:51:44.687859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895035294494992:4779]
2025-09-30T14:51:44.687867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895035294494992:4779]
2025-09-30T14:51:44.687869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895035294494992:4779]
2025-09-30T14:51:44.687885Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:44.687896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:44.687898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:44.687900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:44.687904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:44.687919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:44.687927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:44.687961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895035294494992:4779]
2025-09-30T14:51:44.687971Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:44.687934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 550
2025-09-30T14:51:44.687972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:44.687948Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 550
2025-09-30T14:51:44.688003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:44.688013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:44.688051Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74d32830-fdc1df48-5260c9bf-d618cb89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:44.688065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:44.688073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:44.688077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:44.688087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:44.688100Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:44.688127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:44.688287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:44.688298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:44.688317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:44.688409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 551 partition: 0 MaxSeqNo: 42 sessionId: src_id|74d32830-fdc1df48-5260c9bf-d618cb89_0
2025-09-30T14:51:44.688764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19693413-d95cd6ac-a31271cd-42fcd9ab_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|74d32830-fdc1df48-5260c9bf-d618cb89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:44.691727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74d32830-fdc1df48-5260c9bf-d618cb89_0] Write session: try to update token
2025-09-30T14:51:44.691749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74d32830-fdc1df48-5260c9bf-d618cb89_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:44.699970Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:44.699990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:44.699992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:44.699994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:44.700004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895035294494992:4779]
2025-09-30T14:51:44.700009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895035294494992:4779]
2025-09-30T14:51:44.700013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895035294494992:4779]
2025-09-30T14:51:44.700050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:44.700054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:44.700057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.700059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:44.700059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:44.700063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:44.700194Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:44.706234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 551 sessionId: src_id|74d32830-fdc1df48-5260c9bf-d618cb89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:44.709076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:44.765622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895035384222250:5419]
2025-09-30T14:51:44.765859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 550, pipe: [1:7555895035384222250:5419]
2025-09-30T14:51:44.807421Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:44.807746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:44.807774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:44.807792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895035384222250:5419], now have 1 active actors on pipe
2025-09-30T14:51:44.807953Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:44.808043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895035384222250:5419]
2025-09-30T14:51:44.808052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:44.808056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:44.808072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:44.808127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 551 reason: error at write: Disconnected sessionId: src_id|74d32830-fdc1df48-5260c9bf-d618cb89_0
2025-09-30T14:51:44.808289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 551 sessionId: src_id|74d32830-fdc1df48-5260c9bf-d618cb89_0 is DEAD
2025-09-30T14:51:44.808461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74d32830-fdc1df48-5260c9bf-d618cb89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:44.808472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74d32830-fdc1df48-5260c9bf-d618cb89_0] Write session will restart in 0.009015s
2025-09-30T14:51:44.808495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74d32830-fdc1df48-5260c9bf-d618cb89_0] Write session: Do CDS request
2025-09-30T14:51:44.808504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74d32830-fdc1df48-5260c9bf-d618cb89_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:44.818794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74d32830-fdc1df48-5260c9bf-d618cb89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:44.818934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:44.818962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 552
2025-09-30T14:51:44.819097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 552 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:44.819136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 552 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:44.819147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=552 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:44.819155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:44.819644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 552 sessionId:  describe result for acl check
2025-09-30T14:51:44.819647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:44.819694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:44.819700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:44.819702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:44.819709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895035384222352:5703] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:44.820252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895035384222352:5703] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:44.821760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:44.821971Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:44.821981Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:44.821991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:44.822041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:44.822080Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895035294495164:4793]
2025-09-30T14:51:44.822241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895035384222352:5703] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:44.822753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:44.823029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:44.823098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:44.823396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:44.823457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:44.823464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:44.823466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:44.823467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:44.823468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:44.823469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:44.823470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:44.823471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:44.823473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:44.823474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:44.823475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.823476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.823477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.823478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:44.823479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:44.823485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:44.823495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:44.823499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:44.823503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:44.823508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:44.823512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:44.823515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:44.823519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:44.823523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:44.823527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:44.823531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.823536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.823553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.823557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:44.823561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:44.823567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:44.823575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:44.823581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:44.823587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:44.823591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:44.823597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:44.823602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:44.823612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:44.823617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:44.823626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:44.823631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:44.823637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:44.823644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:44.823647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:44.823649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:44.823652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:44.823655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:44.823657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:44.823659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:44.823662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:44.823665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.823668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.823670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.823673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.823675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.823678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.823680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:44.823683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:44.823685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:44.823688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:44.823713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:44.828839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895035384222352:5703] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:44.828856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895035384222352:5703] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:44.828860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895035384222352:5703] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:44.828868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 552 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:44.829095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:44.830131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:44.830146Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:44.830147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:44.830150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:44.830155Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 551 [2:7555895035294495164:4793]
2025-09-30T14:51:44.830168Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:44.830180Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:44.830182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:44.830184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:44.830185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:44.830197Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:44.830201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:44.830207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:44.830278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.830285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.830289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.830292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:44.830295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:44.830366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:44.830373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.830386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.830399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.830421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:44.830444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895035384222261:2454], now have 1 active actors on pipe
2025-09-30T14:51:44.830463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895035384222392:5703], now have 1 active actors on pipe
2025-09-30T14:51:44.830471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895035294495158:4793]
2025-09-30T14:51:44.830473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895035294495158:4793]
2025-09-30T14:51:44.830475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895035294495158:4793]
2025-09-30T14:51:44.830489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:44.830503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:44.830507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:44.830509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:44.830511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:44.830500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 551
2025-09-30T14:51:44.830525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:44.830534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:44.830580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:44.830591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:44.830602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895035294495158:4793]
2025-09-30T14:51:44.830597Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 551
2025-09-30T14:51:44.830612Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:44.830631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:44.830640Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|488fc640-c55f1a4c-d78e7fca-c6d54b1a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:44.830648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:44.830651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:44.830654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:44.830663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:44.830672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:44.830704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:44.830825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:44.830832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:44.830845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:44.830917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 552 partition: 0 MaxSeqNo: 42 sessionId: src_id|488fc640-c55f1a4c-d78e7fca-c6d54b1a_0
2025-09-30T14:51:44.831288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74d32830-fdc1df48-5260c9bf-d618cb89_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|488fc640-c55f1a4c-d78e7fca-c6d54b1a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:44.833986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|488fc640-c55f1a4c-d78e7fca-c6d54b1a_0] Write session: try to update token
2025-09-30T14:51:44.834006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|488fc640-c55f1a4c-d78e7fca-c6d54b1a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:44.842538Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:44.842561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:44.842563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:44.842565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:44.842575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895035294495158:4793]
2025-09-30T14:51:44.842579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895035294495158:4793]
2025-09-30T14:51:44.842584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895035294495158:4793]
2025-09-30T14:51:44.842626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:44.842637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.842644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:44.842648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:44.842653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:44.842659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:44.842797Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:44.847409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 552 sessionId: src_id|488fc640-c55f1a4c-d78e7fca-c6d54b1a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:44.850035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:44.907967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895035384222411:5419]
2025-09-30T14:51:44.908180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 551, pipe: [1:7555895035384222411:5419]
2025-09-30T14:51:44.949776Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:44.950080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:44.950092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:44.950123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895035384222411:5419], now have 1 active actors on pipe
2025-09-30T14:51:44.950327Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:44.950549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:44.950601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895035384222411:5419]
2025-09-30T14:51:44.950633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:44.950703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 552 reason: status is not ok: tablet will be restarted right now sessionId: src_id|488fc640-c55f1a4c-d78e7fca-c6d54b1a_0
2025-09-30T14:51:44.950875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 552 sessionId: src_id|488fc640-c55f1a4c-d78e7fca-c6d54b1a_0 is DEAD
2025-09-30T14:51:44.951005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|488fc640-c55f1a4c-d78e7fca-c6d54b1a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:44.951018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|488fc640-c55f1a4c-d78e7fca-c6d54b1a_0] Write session will restart in 0.005777s
2025-09-30T14:51:44.951042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|488fc640-c55f1a4c-d78e7fca-c6d54b1a_0] Write session: Do CDS request
2025-09-30T14:51:44.951047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|488fc640-c55f1a4c-d78e7fca-c6d54b1a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:44.957786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|488fc640-c55f1a4c-d78e7fca-c6d54b1a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:44.957860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:44.957876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 553
2025-09-30T14:51:44.958039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 553 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:44.958079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 553 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:44.958086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=553 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:44.958090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:44.958616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 553 sessionId:  describe result for acl check
2025-09-30T14:51:44.958655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:44.958661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:44.958663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:44.958669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895035384222444:5708] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:44.959224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895035384222444:5708] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:44.961471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895035384222444:5708] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:44.961631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:44.963832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:44.964114Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:44.964127Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:44.964139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:44.964199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:44.964238Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895035294495308:4796]
2025-09-30T14:51:44.964225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895035384222444:5708] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:44.964239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895035384222444:5708] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:44.964243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895035384222444:5708] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:44.964252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 553 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:44.964918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:44.965175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:44.965219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:44.965589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:44.965658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:44.965665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:44.965666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:44.965667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:44.965669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:44.965670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:44.965671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:44.965672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:44.965673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:44.965674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:44.965675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.965676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.965677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.965678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:44.965679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:44.965683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:44.965693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:44.965697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:44.965701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:44.965704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:44.965709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:44.965713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:44.965716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:44.965720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:44.965725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:44.965728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.965731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.965734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.965738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:44.965741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:44.965749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:44.965763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:44.965773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:44.965784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:44.965792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:44.965798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:44.965806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:44.965812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:44.965820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:44.965830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:44.965841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:44.965850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:44.965862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:44.965871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:44.965880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:44.965889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:44.965899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:44.965904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:44.965911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:44.965920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:44.965929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.965940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.965948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.965955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.965964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.965972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.965977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:44.965987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:44.965996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:44.966001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:44.966045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:44.971277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:44.972256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:44.972273Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:44.972276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:44.972279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:44.972285Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 552 [2:7555895035294495308:4796]
2025-09-30T14:51:44.972296Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:44.972309Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:44.972315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:44.972317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:44.972319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:44.972332Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:44.972341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:44.972347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:44.972395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.972402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.972404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.972407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:44.972409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:44.972464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:44.972470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.972478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:44.972485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:44.972494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:44.972511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895035294495302:4796]
2025-09-30T14:51:44.972515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895035294495302:4796]
2025-09-30T14:51:44.972516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895035294495302:4796]
2025-09-30T14:51:44.972524Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:44.972533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895035384222412:2454], now have 1 active actors on pipe
2025-09-30T14:51:44.972534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:44.972536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:44.972538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:44.972540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895035384222540:5708], now have 1 active actors on pipe
2025-09-30T14:51:44.972547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:44.972555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:44.972557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:44.972583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895035294495302:4796]
2025-09-30T14:51:44.972592Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:44.972599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:44.972648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 552
2025-09-30T14:51:44.972663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 552
2025-09-30T14:51:44.972727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:44.972739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:44.972765Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a601b0c-4966dfd-cdf9a5e-82d14b75_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:44.972773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:44.972776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:44.972777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:44.972786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:44.972793Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:44.972803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:44.972989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:44.972998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:44.973012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:44.973112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 553 partition: 0 MaxSeqNo: 42 sessionId: src_id|4a601b0c-4966dfd-cdf9a5e-82d14b75_0
2025-09-30T14:51:44.973435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|488fc640-c55f1a4c-d78e7fca-c6d54b1a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4a601b0c-4966dfd-cdf9a5e-82d14b75_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:44.976180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a601b0c-4966dfd-cdf9a5e-82d14b75_0] Write session: try to update token
2025-09-30T14:51:44.976205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a601b0c-4966dfd-cdf9a5e-82d14b75_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:44.983980Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:44.984005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:44.984017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895035294495302:4796]
2025-09-30T14:51:44.984061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:44.984162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:44.984251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:44.984402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:44.984548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:44.984699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:44.984897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:44.984941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:44.989928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 553 sessionId: src_id|4a601b0c-4966dfd-cdf9a5e-82d14b75_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:44.992708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:44.992887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:44.992911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:44.992949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:44.993029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:44.994637Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:44.994656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:44.994658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:44.994661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:44.994670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895035294495302:4796]
2025-09-30T14:51:44.994675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895035294495302:4796]
2025-09-30T14:51:44.994679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895035294495302:4796]
2025-09-30T14:51:44.994715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:44.994722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:44.994727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:44.994730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:44.994745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:44.994749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:44.994867Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:45.050800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895039679189860:5419]
2025-09-30T14:51:45.051046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 552, pipe: [1:7555895039679189860:5419]
2025-09-30T14:51:45.104724Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:45.113223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:45.113257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:45.113460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:45.113533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:45.113602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:45.113689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:45.113741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:45.113755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:45.113835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:45.113905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:45.113978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:45.114474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:45.114529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:45.114538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:45.114609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:45.114672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:45.114740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:45.114808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:45.114864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:45.114873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:45.114944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:45.115211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:45.115303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:45.115371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:45.115420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:45.115430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:45.115501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:45.115566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:45.115635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:45.115702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:45.115751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:45.115759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:45.115827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:45.115888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:45.115957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:45.116026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:45.116082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:45.116091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:45.116163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:45.116228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:45.116296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:45.116362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:45.116409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:45.116417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:45.116487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:45.116553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:45.116622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:45.116687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:45.116735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:45.116743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:45.116811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:45.116875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:45.116941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:45.117011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:45.117061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:45.117069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:45.117138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:45.117203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:45.117274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:45.117343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:45.117394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:45.117404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:45.117477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895039679189860:5419], now have 1 active actors on pipe
2025-09-30T14:51:45.117742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:45.117748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895039679189860:5419]
2025-09-30T14:51:45.117774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:45.117777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:45.117806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 553 reason: error at write: Disconnected sessionId: src_id|4a601b0c-4966dfd-cdf9a5e-82d14b75_0
2025-09-30T14:51:45.117983Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:45.118022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 553 sessionId: src_id|4a601b0c-4966dfd-cdf9a5e-82d14b75_0 is DEAD
2025-09-30T14:51:45.118165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a601b0c-4966dfd-cdf9a5e-82d14b75_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:45.118175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a601b0c-4966dfd-cdf9a5e-82d14b75_0] Write session will restart in 0.007378s
2025-09-30T14:51:45.118193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a601b0c-4966dfd-cdf9a5e-82d14b75_0] Write session: Do CDS request
2025-09-30T14:51:45.118196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a601b0c-4966dfd-cdf9a5e-82d14b75_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:45.126745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a601b0c-4966dfd-cdf9a5e-82d14b75_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:45.126853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:45.126877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 554
2025-09-30T14:51:45.127010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 554 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:45.127044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 554 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:45.127050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=554 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:45.127053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:45.127524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 554 sessionId:  describe result for acl check
2025-09-30T14:51:45.127557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:45.127566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:45.127567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:45.127573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895039679189926:5714] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:45.128129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895039679189926:5714] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:45.129625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:45.130520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895039679189926:5714] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:45.131717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:45.131906Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:45.131917Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:45.131927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:45.131976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:45.132018Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895039589462739:4799]
2025-09-30T14:51:45.132725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:45.133072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:45.133120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:45.133448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:45.133461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895039679189926:5714] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:45.133476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895039679189926:5714] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:45.133479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895039679189926:5714] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:45.133485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 554 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:45.133520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:45.133527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:45.133529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:45.133530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:45.133531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:45.133532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:45.133534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:45.133536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:45.133537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:45.133538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:45.133540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.133541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.133542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.133543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:45.133544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:45.133550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:45.133561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:45.133565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:45.133570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:45.133575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:45.133579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:45.133584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:45.133588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:45.133592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:45.133597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:45.133602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.133607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.133611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.133615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:45.133620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:45.133627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:45.133635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:45.133642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:45.133648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:45.133653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:45.133659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:45.133664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:45.133670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:45.133675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:45.133682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:45.133687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:45.133693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:45.133704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:45.133710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:45.133717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:45.133723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:45.133732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:45.133738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:45.133748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:45.133754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:45.133759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.133767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.133772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.133783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.133789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.133800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.133805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:45.133815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:45.133821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:45.133827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:45.133880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:45.139192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:45.140255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:45.140273Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:45.140275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:45.140278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:45.140284Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 553 [2:7555895039589462739:4799]
2025-09-30T14:51:45.140297Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:45.140310Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:45.140316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:45.140319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:45.140320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:45.140335Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:45.140347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:45.140354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:45.140409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.140415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.140416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.140419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:45.140421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:45.140475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:45.140483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.140497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.140510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.140523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:45.140537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895039679189861:2454], now have 1 active actors on pipe
2025-09-30T14:51:45.140544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895039679189993:5714], now have 1 active actors on pipe
2025-09-30T14:51:45.140548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895039589462733:4799]
2025-09-30T14:51:45.140549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895039589462733:4799]
2025-09-30T14:51:45.140551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895039589462733:4799]
2025-09-30T14:51:45.140560Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:45.140572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:45.140581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:45.140584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:45.140587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:45.140589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:45.140591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:45.140590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 553
2025-09-30T14:51:45.140621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895039589462733:4799]
2025-09-30T14:51:45.140628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:45.140631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:45.140620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 553
2025-09-30T14:51:45.140656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:45.140665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:45.140692Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10f31ab0-36d82a44-67b1d025-a5879945_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:45.140701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:45.140704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:45.140705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:45.140711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:45.140718Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:45.140735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:45.140881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:45.140887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:45.140897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:45.140975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 554 partition: 0 MaxSeqNo: 42 sessionId: src_id|10f31ab0-36d82a44-67b1d025-a5879945_0
2025-09-30T14:51:45.141322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a601b0c-4966dfd-cdf9a5e-82d14b75_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|10f31ab0-36d82a44-67b1d025-a5879945_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:45.144171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10f31ab0-36d82a44-67b1d025-a5879945_0] Write session: try to update token
2025-09-30T14:51:45.144192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10f31ab0-36d82a44-67b1d025-a5879945_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:45.152598Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:45.152621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:45.152623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:45.152625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:45.152635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895039589462733:4799]
2025-09-30T14:51:45.152640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895039589462733:4799]
2025-09-30T14:51:45.152644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895039589462733:4799]
2025-09-30T14:51:45.152687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:45.152697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.152701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:45.152707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:45.152708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:45.152712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:45.152859Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:45.160019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 554 sessionId: src_id|10f31ab0-36d82a44-67b1d025-a5879945_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:45.162887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:45.217735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895039679190003:5419]
2025-09-30T14:51:45.218065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 553, pipe: [1:7555895039679190003:5419]
2025-09-30T14:51:45.259703Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:45.260082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:45.260097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:45.260116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895039679190003:5419], now have 1 active actors on pipe
2025-09-30T14:51:45.260360Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:45.260389Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:45.260417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:45.260420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895039679190003:5419]
2025-09-30T14:51:45.260427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:45.260489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 554 reason: error at write: Disconnected sessionId: src_id|10f31ab0-36d82a44-67b1d025-a5879945_0
2025-09-30T14:51:45.260673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 554 sessionId: src_id|10f31ab0-36d82a44-67b1d025-a5879945_0 is DEAD
2025-09-30T14:51:45.260880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10f31ab0-36d82a44-67b1d025-a5879945_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:45.260893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10f31ab0-36d82a44-67b1d025-a5879945_0] Write session will restart in 0.005819s
2025-09-30T14:51:45.260928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10f31ab0-36d82a44-67b1d025-a5879945_0] Write session: Do CDS request
2025-09-30T14:51:45.260933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10f31ab0-36d82a44-67b1d025-a5879945_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:45.267820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10f31ab0-36d82a44-67b1d025-a5879945_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:45.267887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:45.267910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 555
2025-09-30T14:51:45.268128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 555 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:45.268185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 555 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:45.268195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=555 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:45.268200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:45.268612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 555 sessionId:  describe result for acl check
2025-09-30T14:51:45.268643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:45.268648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:45.268649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:45.268653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895039679190043:5718] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:45.269129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895039679190043:5718] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:45.271269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895039679190043:5718] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:45.271769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:45.273647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:45.273839Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:45.273850Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:45.273862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:45.273896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895039679190043:5718] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:45.273924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:45.273914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895039679190043:5718] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:45.273917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895039679190043:5718] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:45.273925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 555 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:45.273970Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895039589462873:4801]
2025-09-30T14:51:45.274652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:45.274972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:45.275017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:45.275353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:45.275443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:45.275450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:45.275452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:45.275453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:45.275454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:45.275456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:45.275457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:45.275459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:45.275460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:45.275461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:45.275462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.275464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.275465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.275466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:45.275467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:45.275474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:45.275485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:45.275488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:45.275493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:45.275497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:45.275502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:45.275506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:45.275510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:45.275514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:45.275519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:45.275523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.275527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.275531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.275536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:45.275540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:45.275549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:45.275557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:45.275563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:45.275569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:45.275574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:45.275580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:45.275590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:45.275595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:45.275601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:45.275606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:45.275614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:45.275619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:45.275624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:45.275630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:45.275637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:45.275642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:45.275652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:45.275658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:45.275663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:45.275668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:45.275679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.275684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.275689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.275694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.275699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.275704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.275714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:45.275718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:45.275723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:45.275729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:45.275778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:45.281209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:45.282058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:45.282079Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:45.282083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:45.282087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:45.282095Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 554 [2:7555895039589462873:4801]
2025-09-30T14:51:45.282112Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:45.282129Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:45.282137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:45.282140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:45.282142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:45.282160Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:45.282173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:45.282180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:45.282250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.282259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.282262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.282266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:45.282269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:45.282338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:45.282348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.282361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.282379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.282399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:45.282421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895039589462867:4801]
2025-09-30T14:51:45.282429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895039589462867:4801]
2025-09-30T14:51:45.282433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895039589462867:4801]
2025-09-30T14:51:45.282443Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:45.282479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:45.282493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:45.282500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:45.282525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:45.282531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895039589462867:4801]
2025-09-30T14:51:45.282533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:45.282537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:45.282540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:45.282540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895039679190134:5718], now have 1 active actors on pipe
2025-09-30T14:51:45.282544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895039679190004:2454], now have 1 active actors on pipe
2025-09-30T14:51:45.282547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:45.282647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 554
2025-09-30T14:51:45.282658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 554
2025-09-30T14:51:45.282737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:45.282751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:45.282781Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5106ba7-b5629ddb-d950d1ce-8b93042d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:45.282795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:45.282804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:45.282806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:45.282817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:45.282833Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:45.282855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:45.283010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:45.283021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:45.283044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:45.283154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 555 partition: 0 MaxSeqNo: 42 sessionId: src_id|a5106ba7-b5629ddb-d950d1ce-8b93042d_0
2025-09-30T14:51:45.283526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10f31ab0-36d82a44-67b1d025-a5879945_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a5106ba7-b5629ddb-d950d1ce-8b93042d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:45.286327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5106ba7-b5629ddb-d950d1ce-8b93042d_0] Write session: try to update token
2025-09-30T14:51:45.286346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5106ba7-b5629ddb-d950d1ce-8b93042d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:45.294108Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:45.294131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:45.294140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895039589462867:4801]
2025-09-30T14:51:45.294181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:45.294185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:45.294369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:45.294545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:45.294691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:45.294830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:45.295021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:45.295061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:45.300825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 555 sessionId: src_id|a5106ba7-b5629ddb-d950d1ce-8b93042d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:45.303768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:45.304709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:45.304739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:45.304760Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:45.304768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:45.304771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:45.304774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:45.304783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895039589462867:4801]
2025-09-30T14:51:45.304787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895039589462867:4801]
2025-09-30T14:51:45.304792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895039589462867:4801]
2025-09-30T14:51:45.304842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:45.304845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:45.304852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:45.304853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.304856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:45.304856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:45.304992Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:45.360554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895039679190146:5419]
2025-09-30T14:51:45.360834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 554, pipe: [1:7555895039679190146:5419]
2025-09-30T14:51:45.410014Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:45.410418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:45.410469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895039679190146:5419], now have 1 active actors on pipe
2025-09-30T14:51:45.410575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:45.410666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895039679190146:5419]
2025-09-30T14:51:45.410670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:45.410673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:45.410700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:45.410741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 555 reason: error at write: Disconnected sessionId: src_id|a5106ba7-b5629ddb-d950d1ce-8b93042d_0
2025-09-30T14:51:45.410907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 555 sessionId: src_id|a5106ba7-b5629ddb-d950d1ce-8b93042d_0 is DEAD
2025-09-30T14:51:45.411046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5106ba7-b5629ddb-d950d1ce-8b93042d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:45.411055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5106ba7-b5629ddb-d950d1ce-8b93042d_0] Write session will restart in 0.009910s
2025-09-30T14:51:45.411073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5106ba7-b5629ddb-d950d1ce-8b93042d_0] Write session: Do CDS request
2025-09-30T14:51:45.411077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5106ba7-b5629ddb-d950d1ce-8b93042d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:45.421264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:45.421709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5106ba7-b5629ddb-d950d1ce-8b93042d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:45.421806Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:45.421822Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 556
2025-09-30T14:51:45.421955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 556 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:45.421986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 556 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:45.421995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=556 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:45.421998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:45.422370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 556 sessionId:  describe result for acl check
2025-09-30T14:51:45.422402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:45.422408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:45.422409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:45.422413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895039679190243:5722] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:45.422849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895039679190243:5722] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:45.423129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:45.423326Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:45.423337Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:45.423348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:45.423410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:45.423449Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895039589463007:4803]
2025-09-30T14:51:45.424085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:45.424342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:45.424391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:45.424682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895039679190243:5722] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:45.424730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:45.424798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:45.424806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:45.424807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:45.424809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:45.424810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:45.424811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:45.424812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:45.424814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:45.424815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:45.424816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:45.424817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.424818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.424820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.424822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:45.424823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:45.424828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:45.424838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:45.424842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:45.424847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:45.424851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:45.424855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:45.424859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:45.424863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:45.424867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:45.424872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:45.424876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.424880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.424884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.424888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:45.424892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:45.424899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:45.424907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:45.424913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:45.424924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:45.424934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:45.424940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:45.424945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:45.424955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:45.424966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:45.424976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:45.424980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:45.424991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:45.424996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:45.425003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:45.425008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:45.425018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:45.425023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:45.425028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:45.425038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:45.425042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:45.425049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.425054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.425059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.425064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.425069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.425074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.425082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:45.425087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:45.425096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:45.425104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:45.425155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:45.430021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895039679190243:5722] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:45.430038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895039679190243:5722] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:45.430042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895039679190243:5722] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:45.430051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 556 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:45.430266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:45.431182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:45.431202Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:45.431204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:45.431208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:45.431215Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 555 [2:7555895039589463007:4803]
2025-09-30T14:51:45.431231Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:45.431265Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:45.431274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:45.431277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:45.431280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:45.431299Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:45.431313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:45.431319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:45.431383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.431392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.431394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.431398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:45.431401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:45.431472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:45.431480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.431493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.431511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.431534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:45.431559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895039679190282:5722], now have 1 active actors on pipe
2025-09-30T14:51:45.431567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895039679190147:2454], now have 1 active actors on pipe
2025-09-30T14:51:45.431573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895039589463001:4803]
2025-09-30T14:51:45.431576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895039589463001:4803]
2025-09-30T14:51:45.431577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895039589463001:4803]
2025-09-30T14:51:45.431591Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:45.431598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:45.431601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:45.431603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:45.431610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:45.431601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 555
2025-09-30T14:51:45.431626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:45.431614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 555
2025-09-30T14:51:45.431635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:45.431684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:45.431693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:45.431705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895039589463001:4803]
2025-09-30T14:51:45.431719Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:45.431724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:45.431750Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b3d0aaf-7975a972-4dec33c5-c52b28aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:45.431762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:45.431771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:45.431778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:45.431788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:45.431802Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:45.431828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:45.431964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:45.431976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:45.431995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:45.432088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 556 partition: 0 MaxSeqNo: 42 sessionId: src_id|5b3d0aaf-7975a972-4dec33c5-c52b28aa_0
2025-09-30T14:51:45.432421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5106ba7-b5629ddb-d950d1ce-8b93042d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5b3d0aaf-7975a972-4dec33c5-c52b28aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:45.435200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b3d0aaf-7975a972-4dec33c5-c52b28aa_0] Write session: try to update token
2025-09-30T14:51:45.435217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b3d0aaf-7975a972-4dec33c5-c52b28aa_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:45.443554Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:45.443577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:45.443580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:45.443582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:45.443593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895039589463001:4803]
2025-09-30T14:51:45.443598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895039589463001:4803]
2025-09-30T14:51:45.443602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895039589463001:4803]
2025-09-30T14:51:45.443640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:45.443639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:45.443643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:45.443645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:45.443647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.443650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:45.443797Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:45.449611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 556 sessionId: src_id|5b3d0aaf-7975a972-4dec33c5-c52b28aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:45.452297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:45.510614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895039679190292:5419]
2025-09-30T14:51:45.510852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 555, pipe: [1:7555895039679190292:5419]
2025-09-30T14:51:45.551132Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:45.551634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:45.551649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:45.551688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895039679190292:5419], now have 1 active actors on pipe
2025-09-30T14:51:45.551903Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:45.551957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:45.551973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:45.551989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895039679190292:5419]
2025-09-30T14:51:45.552011Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:45.552055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 556 reason: error at write: Disconnected sessionId: src_id|5b3d0aaf-7975a972-4dec33c5-c52b28aa_0
2025-09-30T14:51:45.552267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 556 sessionId: src_id|5b3d0aaf-7975a972-4dec33c5-c52b28aa_0 is DEAD
2025-09-30T14:51:45.552416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b3d0aaf-7975a972-4dec33c5-c52b28aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:45.552428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b3d0aaf-7975a972-4dec33c5-c52b28aa_0] Write session will restart in 0.005475s
2025-09-30T14:51:45.552453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b3d0aaf-7975a972-4dec33c5-c52b28aa_0] Write session: Do CDS request
2025-09-30T14:51:45.552459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b3d0aaf-7975a972-4dec33c5-c52b28aa_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:45.558772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b3d0aaf-7975a972-4dec33c5-c52b28aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:45.558871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:45.558888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 557
2025-09-30T14:51:45.559005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 557 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:45.559037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 557 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:45.559044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=557 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:45.559049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:45.559488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 557 sessionId:  describe result for acl check
2025-09-30T14:51:45.559525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:45.559527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:45.559529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:45.559535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895039679190313:5727] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:45.560070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895039679190313:5727] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:45.562399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895039679190313:5727] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:45.563079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:45.564967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:45.565144Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:45.565153Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:45.565163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:45.565209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:45.565252Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895039589463145:4806]
2025-09-30T14:51:45.565286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895039679190313:5727] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:45.565301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895039679190313:5727] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:45.565305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895039679190313:5727] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:45.565312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 557 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:45.565913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:45.566161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:45.566204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:45.566541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:45.566599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:45.566604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:45.566605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:45.566606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:45.566607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:45.566609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:45.566610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:45.566611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:45.566612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:45.566613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:45.566614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.566615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.566616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.566617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:45.566619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:45.566624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:45.566634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:45.566639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:45.566643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:45.566647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:45.566652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:45.566656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:45.566660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:45.566665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:45.566669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:45.566673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.566677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.566682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.566686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:45.566690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:45.566697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:45.566704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:45.566710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:45.566715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:45.566721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:45.566726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:45.566730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:45.566736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:45.566740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:45.566746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:45.566751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:45.566756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:45.566762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:45.566767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:45.566777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:45.566783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:45.566787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:45.566798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:45.566802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:45.566813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:45.566818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.566827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.566832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.566842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.566846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.566851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.566860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:45.566865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:45.566874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:45.566878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:45.566925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:45.572289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:45.573374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:45.573396Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:45.573399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:45.573403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:45.573409Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 556 [2:7555895039589463145:4806]
2025-09-30T14:51:45.573426Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:45.573445Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:45.573451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:45.573454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:45.573457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:45.573473Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:45.573481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:45.573489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:45.573555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.573565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.573567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.573570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:45.573573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:45.573640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:45.573649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.573663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.573677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.573696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:45.573721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895039679190424:5727], now have 1 active actors on pipe
2025-09-30T14:51:45.573729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895039679190293:2454], now have 1 active actors on pipe
2025-09-30T14:51:45.573736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895039589463139:4806]
2025-09-30T14:51:45.573738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895039589463139:4806]
2025-09-30T14:51:45.573741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895039589463139:4806]
2025-09-30T14:51:45.573757Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:45.573775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:45.573779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:45.573785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:45.573787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:45.573794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:45.573798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:45.573762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 556
2025-09-30T14:51:45.573766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 556
2025-09-30T14:51:45.573829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895039589463139:4806]
2025-09-30T14:51:45.573842Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:45.573857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:45.573867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:45.573873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:45.573921Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|445cb1ff-314fdef8-6d549565-e82ca1df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:45.573934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:45.573938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:45.573940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:45.573950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:45.573964Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:45.573987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:45.574207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:45.574219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:45.574236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:45.574318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 557 partition: 0 MaxSeqNo: 42 sessionId: src_id|445cb1ff-314fdef8-6d549565-e82ca1df_0
2025-09-30T14:51:45.574719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b3d0aaf-7975a972-4dec33c5-c52b28aa_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|445cb1ff-314fdef8-6d549565-e82ca1df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:45.577496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|445cb1ff-314fdef8-6d549565-e82ca1df_0] Write session: try to update token
2025-09-30T14:51:45.577515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|445cb1ff-314fdef8-6d549565-e82ca1df_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:45.586246Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:45.586266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:45.586268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:45.586270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:45.586277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895039589463139:4806]
2025-09-30T14:51:45.586280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895039589463139:4806]
2025-09-30T14:51:45.586283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895039589463139:4806]
2025-09-30T14:51:45.586316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:45.586322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.586323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:45.586334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:45.586339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:45.586342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:45.586476Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:45.593520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 557 sessionId: src_id|445cb1ff-314fdef8-6d549565-e82ca1df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:45.596369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:45.651905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895039679190437:5419]
2025-09-30T14:51:45.652177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 556, pipe: [1:7555895039679190437:5419]
2025-09-30T14:51:45.689377Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:45.689709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:45.689723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:45.689739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895039679190437:5419], now have 1 active actors on pipe
2025-09-30T14:51:45.689907Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:45.689987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895039679190437:5419]
2025-09-30T14:51:45.689988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:45.690019Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:45.690063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 557 reason: status is not ok: tablet will be restarted right now sessionId: src_id|445cb1ff-314fdef8-6d549565-e82ca1df_0
2025-09-30T14:51:45.690247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 557 sessionId: src_id|445cb1ff-314fdef8-6d549565-e82ca1df_0 is DEAD
2025-09-30T14:51:45.690404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|445cb1ff-314fdef8-6d549565-e82ca1df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:45.690414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|445cb1ff-314fdef8-6d549565-e82ca1df_0] Write session will restart in 0.005224s
2025-09-30T14:51:45.690430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|445cb1ff-314fdef8-6d549565-e82ca1df_0] Write session: Do CDS request
2025-09-30T14:51:45.690463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|445cb1ff-314fdef8-6d549565-e82ca1df_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:45.696707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|445cb1ff-314fdef8-6d549565-e82ca1df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:45.696798Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:45.696813Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 558
2025-09-30T14:51:45.696969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 558 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:45.697019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 558 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:45.697025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=558 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:45.697029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:45.697391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 558 sessionId:  describe result for acl check
2025-09-30T14:51:45.697445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:45.697452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:45.697453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:45.697459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895039679190457:5731] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:45.697920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895039679190457:5731] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:45.699809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895039679190457:5731] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:45.701406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:45.703282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:45.703456Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:45.703467Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:45.703477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:45.703521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:45.703557Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895039589463281:4808]
2025-09-30T14:51:45.703631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895039679190457:5731] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:45.703646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895039679190457:5731] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:45.703649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895039679190457:5731] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:45.703657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 558 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:45.704188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:45.704468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:45.704514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:45.704869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:45.704933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:45.704940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:45.704941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:45.704942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:45.704943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:45.704945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:45.704946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:45.704947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:45.704948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:45.704949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:45.704951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.704952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.704953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.704954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:45.704956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:45.704961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:45.704973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:45.704977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:45.704982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:45.704987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:45.704991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:45.704996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:45.705000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:45.705005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:45.705010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:45.705014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.705019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.705024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.705028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:45.705033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:45.705039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:45.705052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:45.705063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:45.705070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:45.705074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:45.705080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:45.705085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:45.705091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:45.705096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:45.705102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:45.705107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:45.705113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:45.705118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:45.705124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:45.705130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:45.705136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:45.705141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:45.705146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:45.705151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:45.705170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:45.705175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.705181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.705186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.705196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.705201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.705211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.705216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:45.705221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:45.705231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:45.705237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:45.705290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:45.710484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:45.711411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:45.711432Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:45.711435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:45.711439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:45.711445Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 557 [2:7555895039589463281:4808]
2025-09-30T14:51:45.711464Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:45.711489Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:45.711496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:45.711499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:45.711501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:45.711517Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:45.711529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:45.711541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:45.711602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.711610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.711613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.711616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:45.711619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:45.711814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 557
2025-09-30T14:51:45.711824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 557
2025-09-30T14:51:45.711844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:45.711856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.711869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.711882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.711899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:45.711919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895039679190438:2454], now have 1 active actors on pipe
2025-09-30T14:51:45.711923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895039679190571:5731], now have 1 active actors on pipe
2025-09-30T14:51:45.711939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:45.711949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:45.711969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895039589463275:4808]
2025-09-30T14:51:45.711979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895039589463275:4808]
2025-09-30T14:51:45.711981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895039589463275:4808]
2025-09-30T14:51:45.711994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:45.712004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:45.712011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:45.712013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:45.712015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:45.712024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:45.712027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:45.712042Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ee8cc88-1caa5bfa-b465e5af-fea6ab62_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:45.712054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:45.712058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:45.712059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:45.712069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:45.712084Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:45.712126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895039589463275:4808]
2025-09-30T14:51:45.712138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:45.712144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:45.712149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:45.712307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:45.712321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:45.712341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:45.712447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 558 partition: 0 MaxSeqNo: 42 sessionId: src_id|9ee8cc88-1caa5bfa-b465e5af-fea6ab62_0
2025-09-30T14:51:45.712794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|445cb1ff-314fdef8-6d549565-e82ca1df_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9ee8cc88-1caa5bfa-b465e5af-fea6ab62_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:45.715463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ee8cc88-1caa5bfa-b465e5af-fea6ab62_0] Write session: try to update token
2025-09-30T14:51:45.715480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ee8cc88-1caa5bfa-b465e5af-fea6ab62_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:45.723770Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:45.723789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:45.723792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:45.723793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:45.723805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895039589463275:4808]
2025-09-30T14:51:45.723810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895039589463275:4808]
2025-09-30T14:51:45.723813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895039589463275:4808]
2025-09-30T14:51:45.723852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:45.723856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:45.723859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.723861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:45.723861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:45.723864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:45.724002Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:45.729672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 558 sessionId: src_id|9ee8cc88-1caa5bfa-b465e5af-fea6ab62_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:45.732350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:45.790111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895039679190595:5419]
2025-09-30T14:51:45.790384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 557, pipe: [1:7555895039679190595:5419]
2025-09-30T14:51:45.834039Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:45.834313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:45.834331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:45.834367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895039679190595:5419], now have 1 active actors on pipe
2025-09-30T14:51:45.834539Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:45.834674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:45.834717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895039679190595:5419]
2025-09-30T14:51:45.834733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:45.834791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 558 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9ee8cc88-1caa5bfa-b465e5af-fea6ab62_0
2025-09-30T14:51:45.834998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 558 sessionId: src_id|9ee8cc88-1caa5bfa-b465e5af-fea6ab62_0 is DEAD
2025-09-30T14:51:45.835099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ee8cc88-1caa5bfa-b465e5af-fea6ab62_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:45.835108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ee8cc88-1caa5bfa-b465e5af-fea6ab62_0] Write session will restart in 0.006756s
2025-09-30T14:51:45.835135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ee8cc88-1caa5bfa-b465e5af-fea6ab62_0] Write session: Do CDS request
2025-09-30T14:51:45.835139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ee8cc88-1caa5bfa-b465e5af-fea6ab62_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:45.842831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ee8cc88-1caa5bfa-b465e5af-fea6ab62_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:45.842901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:45.842919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 559
2025-09-30T14:51:45.843039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 559 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:45.843081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 559 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:45.843091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=559 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:45.843095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:45.843599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 559 sessionId:  describe result for acl check
2025-09-30T14:51:45.843635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:45.843642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:45.843644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:45.843649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895039679190698:5742] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:45.844190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895039679190698:5742] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:45.845272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:45.846330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895039679190698:5742] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:45.847057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:45.847239Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:45.847260Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:45.847270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:45.847312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:45.847338Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895039589463455:4822]
2025-09-30T14:51:45.847820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:45.848138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:45.848187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:45.848533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:45.848595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:45.848601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:45.848602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:45.848603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:45.848604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:45.848606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:45.848607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:45.848608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:45.848609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:45.848609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895039679190698:5742] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:45.848610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:45.848611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.848613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.848621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895039679190698:5742] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:45.848624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895039679190698:5742] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:45.848614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.848630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 559 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:45.848615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:45.848616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:45.848621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:45.848632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:45.848636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:45.848641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:45.848645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:45.848649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:45.848653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:45.848658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:45.848662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:45.848666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:45.848670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.848674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.848678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.848682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:45.848686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:45.848694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:45.848701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:45.848707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:45.848713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:45.848718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:45.848723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:45.848728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:45.848733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:45.848738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:45.848743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:45.848747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:45.848752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:45.848758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:45.848763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:45.848767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:45.848773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:45.848777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:45.848781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:45.848785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:45.848790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:45.848794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.848799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.848803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.848808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.848814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.848819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.848829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:45.848834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:45.848839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:45.848844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:45.848889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:45.854247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:45.855222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:45.855238Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:45.855261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:45.855266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:45.855272Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 558 [2:7555895039589463455:4822]
2025-09-30T14:51:45.855290Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:45.855307Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:45.855310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:45.855312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:45.855313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:45.855326Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:45.855331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:45.855337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:45.855387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.855393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.855395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.855399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:45.855401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:45.855464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:45.855471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.855480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.855491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.855514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:45.855537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895039679190608:2454], now have 1 active actors on pipe
2025-09-30T14:51:45.855547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895039679190742:5742], now have 1 active actors on pipe
2025-09-30T14:51:45.855553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895039589463449:4822]
2025-09-30T14:51:45.855554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895039589463449:4822]
2025-09-30T14:51:45.855555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895039589463449:4822]
2025-09-30T14:51:45.855564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:45.855575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:45.855579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:45.855583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:45.855584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:45.855585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:45.855586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:45.855615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895039589463449:4822]
2025-09-30T14:51:45.855624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:45.855592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 558
2025-09-30T14:51:45.855631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:45.855622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 558
2025-09-30T14:51:45.855654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:45.855662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:45.855695Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf51c7ab-db0f01c3-eec541a2-924d99d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:45.855706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:45.855709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:45.855713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:45.855728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:45.855740Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:45.855754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:45.855890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:45.855897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:45.855910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:45.855991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 559 partition: 0 MaxSeqNo: 42 sessionId: src_id|bf51c7ab-db0f01c3-eec541a2-924d99d2_0
2025-09-30T14:51:45.856302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ee8cc88-1caa5bfa-b465e5af-fea6ab62_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bf51c7ab-db0f01c3-eec541a2-924d99d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:45.859299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf51c7ab-db0f01c3-eec541a2-924d99d2_0] Write session: try to update token
2025-09-30T14:51:45.859317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf51c7ab-db0f01c3-eec541a2-924d99d2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:45.868124Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:45.868144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:45.868147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:45.868149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:45.868158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895039589463449:4822]
2025-09-30T14:51:45.868162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895039589463449:4822]
2025-09-30T14:51:45.868166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895039589463449:4822]
2025-09-30T14:51:45.868207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:45.868216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.868219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:45.868236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:45.868254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:45.868260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:45.868359Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:45.873429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 559 sessionId: src_id|bf51c7ab-db0f01c3-eec541a2-924d99d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:45.876134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:45.935035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895039679190763:5419]
2025-09-30T14:51:45.935308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 558, pipe: [1:7555895039679190763:5419]
2025-09-30T14:51:45.980928Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:45.981311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:45.981326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:45.981367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895039679190763:5419], now have 1 active actors on pipe
2025-09-30T14:51:45.981599Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:45.981598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895039679190763:5419]
2025-09-30T14:51:45.981606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:45.981635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:45.981638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:45.981700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 559 reason: error at write: Disconnected sessionId: src_id|bf51c7ab-db0f01c3-eec541a2-924d99d2_0
2025-09-30T14:51:45.981867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 559 sessionId: src_id|bf51c7ab-db0f01c3-eec541a2-924d99d2_0 is DEAD
2025-09-30T14:51:45.982028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf51c7ab-db0f01c3-eec541a2-924d99d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:45.982035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf51c7ab-db0f01c3-eec541a2-924d99d2_0] Write session will restart in 0.009422s
2025-09-30T14:51:45.982053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf51c7ab-db0f01c3-eec541a2-924d99d2_0] Write session: Do CDS request
2025-09-30T14:51:45.982059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf51c7ab-db0f01c3-eec541a2-924d99d2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:45.992757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf51c7ab-db0f01c3-eec541a2-924d99d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:45.992894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:45.992924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 560
2025-09-30T14:51:45.993069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 560 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:45.993113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 560 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:45.993125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=560 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:45.993130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:45.993294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:45.993551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 560 sessionId:  describe result for acl check
2025-09-30T14:51:45.993592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:45.993596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:45.993598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:45.993604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895039679190873:5749] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:45.994112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895039679190873:5749] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:45.995191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:45.995407Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:45.995422Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:45.995436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:45.995506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:45.995547Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895039589463606:4825]
2025-09-30T14:51:45.996156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:45.996201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895039679190873:5749] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:45.996473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:45.996529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:45.996883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:45.996944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:45.996950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:45.996951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:45.996953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:45.996954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:45.996955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:45.996957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:45.996958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:45.996960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:45.996961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:45.996963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.996964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.996965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.996966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:45.996968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:45.996974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:45.996984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:45.996989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:45.996993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:45.996997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:45.997001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:45.997005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:45.997009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:45.997013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:45.997018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:45.997022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.997026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.997030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.997034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:45.997038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:45.997045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:45.997053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:45.997059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:45.997064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:45.997069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:45.997075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:45.997081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:45.997092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:45.997098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:45.997108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:45.997113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:45.997118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:45.997123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:45.997128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:45.997132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:45.997139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:45.997148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:45.997153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:45.997158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:45.997165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:45.997175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.997180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:45.997185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.997194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:45.997198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.997203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:45.997207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:45.997213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:45.997218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:45.997222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:45.997268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:46.002424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895039679190873:5749] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:46.002455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895039679190873:5749] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:46.002459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895039679190873:5749] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:46.002468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 560 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:46.002752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:46.003652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:46.003667Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:46.003670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:46.003674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:46.003681Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 559 [2:7555895039589463606:4825]
2025-09-30T14:51:46.003699Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:46.003715Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:46.003718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:46.003721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:46.003724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:46.003739Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:46.003744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:46.003751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:46.003942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.003952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.003954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.003958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:46.003961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:46.004024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:46.004032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.004044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.004057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.004080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:46.004102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895043974158209:5749], now have 1 active actors on pipe
2025-09-30T14:51:46.004110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895039679190772:2454], now have 1 active actors on pipe
2025-09-30T14:51:46.004117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895039589463600:4825]
2025-09-30T14:51:46.004119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895039589463600:4825]
2025-09-30T14:51:46.004122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895039589463600:4825]
2025-09-30T14:51:46.004134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:46.004153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:46.004152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:46.004156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:46.004158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:46.004172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:46.004143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 559
2025-09-30T14:51:46.004176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:46.004160Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 559
2025-09-30T14:51:46.004207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895039589463600:4825]
2025-09-30T14:51:46.004218Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:46.004234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:46.004238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:46.004243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:46.004293Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2cef96f6-fa7230b2-2ccfbe58-f53136bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:46.004306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:46.004310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:46.004312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:46.004321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:46.004330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:46.004351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:46.004485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:46.004493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:46.004505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:46.004568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 560 partition: 0 MaxSeqNo: 42 sessionId: src_id|2cef96f6-fa7230b2-2ccfbe58-f53136bd_0
2025-09-30T14:51:46.004940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf51c7ab-db0f01c3-eec541a2-924d99d2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2cef96f6-fa7230b2-2ccfbe58-f53136bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:46.007881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cef96f6-fa7230b2-2ccfbe58-f53136bd_0] Write session: try to update token
2025-09-30T14:51:46.007902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cef96f6-fa7230b2-2ccfbe58-f53136bd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:46.016798Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:46.016818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:46.016821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:46.016823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:46.016833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895039589463600:4825]
2025-09-30T14:51:46.016837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895039589463600:4825]
2025-09-30T14:51:46.016842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895039589463600:4825]
2025-09-30T14:51:46.016882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:46.016886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:46.016889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.016892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:46.016896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:46.016899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:46.017026Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:46.022998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 560 sessionId: src_id|2cef96f6-fa7230b2-2ccfbe58-f53136bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:46.025948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:46.081985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895043974158219:5419]
2025-09-30T14:51:46.082223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 559, pipe: [1:7555895043974158219:5419]
2025-09-30T14:51:46.124138Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:46.124550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:46.124582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:46.124628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895043974158219:5419], now have 1 active actors on pipe
2025-09-30T14:51:46.124851Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:46.124957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:46.124958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895043974158219:5419]
2025-09-30T14:51:46.124977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:46.124980Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:46.125036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 560 reason: error at write: Disconnected sessionId: src_id|2cef96f6-fa7230b2-2ccfbe58-f53136bd_0
2025-09-30T14:51:46.125204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 560 sessionId: src_id|2cef96f6-fa7230b2-2ccfbe58-f53136bd_0 is DEAD
2025-09-30T14:51:46.125348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cef96f6-fa7230b2-2ccfbe58-f53136bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:46.125360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cef96f6-fa7230b2-2ccfbe58-f53136bd_0] Write session will restart in 0.006979s
2025-09-30T14:51:46.125384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cef96f6-fa7230b2-2ccfbe58-f53136bd_0] Write session: Do CDS request
2025-09-30T14:51:46.125392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cef96f6-fa7230b2-2ccfbe58-f53136bd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:46.133757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cef96f6-fa7230b2-2ccfbe58-f53136bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:46.133947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:46.133974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 561
2025-09-30T14:51:46.134101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 561 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:46.134127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 561 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:46.134137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=561 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:46.134142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:46.134633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 561 sessionId:  describe result for acl check
2025-09-30T14:51:46.134667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:46.134669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:46.134671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:46.134676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895043974158309:5753] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:46.135185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895043974158309:5753] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:46.136326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:46.136948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895043974158309:5753] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:46.138324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:46.138519Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:46.138529Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:46.138539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:46.138587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:46.138633Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895043884431044:4828]
2025-09-30T14:51:46.139315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:46.139434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895043974158309:5753] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:46.139452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895043974158309:5753] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:46.139455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895043974158309:5753] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:46.139463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 561 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:46.139597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:46.139644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:46.139985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:46.140049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:46.140054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:46.140056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:46.140057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:46.140058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:46.140059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:46.140061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:46.140062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:46.140063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:46.140064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:46.140065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.140067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.140067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.140069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:46.140070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:46.140075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:46.140087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:46.140091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:46.140096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:46.140100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:46.140105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:46.140109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:46.140113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:46.140117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:46.140122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:46.140125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.140130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.140134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.140138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:46.140142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:46.140150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:46.140162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:46.140173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:46.140178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:46.140188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:46.140194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:46.140202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:46.140207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:46.140216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:46.140222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:46.140233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:46.140245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:46.140250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:46.140255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:46.140259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:46.140265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:46.140270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:46.140275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:46.140280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:46.140285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:46.140290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.140300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.140305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.140311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.140316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.140326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.140334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:46.140340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:46.140349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:46.140356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:46.140407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:46.146123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:46.147127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:46.147148Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:46.147151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:46.147156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:46.147162Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 560 [2:7555895043884431044:4828]
2025-09-30T14:51:46.147180Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:46.147199Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:46.147202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:46.147205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:46.147208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:46.147224Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:46.147235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:46.147241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:46.147332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.147338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.147340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.147342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:46.147344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:46.147396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:46.147404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.147414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.147420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.147431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:46.147443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895043884431038:4828]
2025-09-30T14:51:46.147445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895043884431038:4828]
2025-09-30T14:51:46.147447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895043884431038:4828]
2025-09-30T14:51:46.147453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:46.147469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:46.147477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:46.147481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:46.147483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:46.147485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:46.147487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:46.147497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895043974158358:5753], now have 1 active actors on pipe
2025-09-30T14:51:46.147536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895043974158220:2454], now have 1 active actors on pipe
2025-09-30T14:51:46.147547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895043884431038:4828]
2025-09-30T14:51:46.147555Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:46.147571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:46.147605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 560
2025-09-30T14:51:46.147605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 560
2025-09-30T14:51:46.147690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:46.147698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:46.147722Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa36b98d-227bd367-32027dd0-b299635b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:46.147732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:46.147735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:46.147737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:46.147744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:46.147756Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:46.147772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:46.147948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:46.147956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:46.147969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:46.148077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 561 partition: 0 MaxSeqNo: 42 sessionId: src_id|fa36b98d-227bd367-32027dd0-b299635b_0
2025-09-30T14:51:46.148480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cef96f6-fa7230b2-2ccfbe58-f53136bd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fa36b98d-227bd367-32027dd0-b299635b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:46.151584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa36b98d-227bd367-32027dd0-b299635b_0] Write session: try to update token
2025-09-30T14:51:46.151606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa36b98d-227bd367-32027dd0-b299635b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:46.167472Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:46.167488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:46.167498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895043884431038:4828]
2025-09-30T14:51:46.167551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:46.167591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 561 sessionId: src_id|fa36b98d-227bd367-32027dd0-b299635b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:46.167723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:46.167893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:46.168030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:46.168161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:46.168289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:46.168469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:46.168504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:46.170384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:46.170874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:46.170892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:46.170907Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:46.170909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:46.170911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:46.170912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:46.170918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895043884431038:4828]
2025-09-30T14:51:46.170921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895043884431038:4828]
2025-09-30T14:51:46.170923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895043884431038:4828]
2025-09-30T14:51:46.170962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:46.170972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.170974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:46.170976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:46.170980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:46.170986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:46.171091Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:46.225333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895043974158368:5419]
2025-09-30T14:51:46.225588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 560, pipe: [1:7555895043974158368:5419]
2025-09-30T14:51:46.279166Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:46.279558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:46.279602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895043974158368:5419], now have 1 active actors on pipe
2025-09-30T14:51:46.279788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:46.279828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895043974158368:5419]
2025-09-30T14:51:46.279854Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:46.279883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:46.279891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:46.279961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 561 reason: error at write: Disconnected sessionId: src_id|fa36b98d-227bd367-32027dd0-b299635b_0
2025-09-30T14:51:46.280115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 561 sessionId: src_id|fa36b98d-227bd367-32027dd0-b299635b_0 is DEAD
2025-09-30T14:51:46.280276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa36b98d-227bd367-32027dd0-b299635b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:46.280288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa36b98d-227bd367-32027dd0-b299635b_0] Write session will restart in 0.009797s
2025-09-30T14:51:46.280311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa36b98d-227bd367-32027dd0-b299635b_0] Write session: Do CDS request
2025-09-30T14:51:46.280316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa36b98d-227bd367-32027dd0-b299635b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:46.291782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa36b98d-227bd367-32027dd0-b299635b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:46.291878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:46.291895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 562
2025-09-30T14:51:46.291919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:46.292052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 562 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:46.292087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 562 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:46.292095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=562 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:46.292099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:46.292441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 562 sessionId:  describe result for acl check
2025-09-30T14:51:46.292475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:46.292480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:46.292481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:46.292485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895043974158472:5757] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:46.292910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895043974158472:5757] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:46.293928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:46.294125Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:46.294133Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:46.294143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:46.294192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:46.294229Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895043884431185:4830]
2025-09-30T14:51:46.294731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895043974158472:5757] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:46.294825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:46.295102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:46.295144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:46.295484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:46.295543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:46.295549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:46.295550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:46.295551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:46.295552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:46.295553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:46.295555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:46.295556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:46.295557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:46.295558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:46.295559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.295561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.295562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.295563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:46.295564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:46.295569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:46.295578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:46.295582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:46.295586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:46.295590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:46.295595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:46.295598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:46.295602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:46.295606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:46.295612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:46.295617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.295621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.295625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.295629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:46.295633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:46.295641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:46.295656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:46.295662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:46.295667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:46.295672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:46.295677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:46.295682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:46.295687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:46.295691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:46.295696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:46.295699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:46.295704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:46.295708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:46.295714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:46.295720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:46.295730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:46.295735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:46.295740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:46.295745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:46.295750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:46.295755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.295761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.295765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.295770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.295774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.295783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.295787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:46.295791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:46.295795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:46.295800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:46.295844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:46.300925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895043974158472:5757] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:46.300951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895043974158472:5757] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:46.300955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895043974158472:5757] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:46.300966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 562 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:46.301136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:46.301931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:46.301944Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:46.301946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:46.301950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:46.301955Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 561 [2:7555895043884431185:4830]
2025-09-30T14:51:46.301968Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:46.301981Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:46.301983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:46.301985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:46.301987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:46.301997Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:46.302002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:46.302007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:46.302051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.302059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.302061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.302063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:46.302065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:46.302115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:46.302121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.302129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.302135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.302149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:46.302166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895043974158509:5757], now have 1 active actors on pipe
2025-09-30T14:51:46.302172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895043974158369:2454], now have 1 active actors on pipe
2025-09-30T14:51:46.302177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895043884431180:4830]
2025-09-30T14:51:46.302179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895043884431180:4830]
2025-09-30T14:51:46.302181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895043884431180:4830]
2025-09-30T14:51:46.302191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:46.302205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:46.302208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:46.302212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:46.302214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:46.302224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:46.302227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:46.302256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895043884431180:4830]
2025-09-30T14:51:46.302267Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:46.302277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:46.302560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 561
2025-09-30T14:51:46.302567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 561
2025-09-30T14:51:46.302624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:46.302633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:46.302656Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d68b0fc4-7d509a4f-bf2c4a3d-32de04f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:46.302665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:46.302672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:46.302674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:46.302681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:46.302693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:46.302710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:46.302887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:46.302894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:46.302905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:46.302988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 562 partition: 0 MaxSeqNo: 42 sessionId: src_id|d68b0fc4-7d509a4f-bf2c4a3d-32de04f6_0
2025-09-30T14:51:46.303357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa36b98d-227bd367-32027dd0-b299635b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d68b0fc4-7d509a4f-bf2c4a3d-32de04f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:46.306127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d68b0fc4-7d509a4f-bf2c4a3d-32de04f6_0] Write session: try to update token
2025-09-30T14:51:46.306148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d68b0fc4-7d509a4f-bf2c4a3d-32de04f6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:46.314042Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:46.314059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:46.314070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895043884431180:4830]
2025-09-30T14:51:46.314115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:46.314129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:46.314288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:46.314431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:46.314579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:46.314719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:46.314908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:46.314951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:46.320503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 562 sessionId: src_id|d68b0fc4-7d509a4f-bf2c4a3d-32de04f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:46.323429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:46.323853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:46.323872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:46.325088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:46.325121Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:46.325125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:46.325127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:46.325129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:46.325138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895043884431180:4830]
2025-09-30T14:51:46.325142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895043884431180:4830]
2025-09-30T14:51:46.325146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895043884431180:4830]
2025-09-30T14:51:46.325174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:46.325176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:46.325186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.325187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:46.325189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:46.325191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:46.325215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:46.325324Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:46.379977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895043974158518:5419]
2025-09-30T14:51:46.380295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 561, pipe: [1:7555895043974158518:5419]
2025-09-30T14:51:46.437066Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:46.445209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:46.445235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:46.445405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:46.445466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:46.445534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:46.445604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:46.445883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:46.445896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:46.445972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:46.446034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:46.446101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:46.446328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:46.446378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:46.446381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:46.446465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:46.446532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:46.446599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:46.446664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:46.446708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:46.446715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:46.446784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:46.446842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:46.446908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:46.446996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:46.447061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:46.447069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:46.447135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:46.447189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:46.447267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:46.447332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:46.447372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:46.447380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:46.447441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:46.447508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:46.447579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:46.447646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:46.447691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:46.447699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:46.447755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:46.447807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:46.447862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:46.447920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:46.447961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:46.447967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:46.448026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:46.448080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:46.448137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:46.448205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:46.448251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:46.448257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:46.448317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:46.448376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:46.448447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:46.448519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:46.448587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:46.448592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:46.448663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:46.448726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:46.448791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:46.448857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:46.448900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:46.448908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:46.448963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895043974158518:5419], now have 1 active actors on pipe
2025-09-30T14:51:46.449243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895043974158518:5419]
2025-09-30T14:51:46.449271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:46.449275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:46.449308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 562 reason: error at write: Disconnected sessionId: src_id|d68b0fc4-7d509a4f-bf2c4a3d-32de04f6_0
2025-09-30T14:51:46.449361Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:46.449499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 562 sessionId: src_id|d68b0fc4-7d509a4f-bf2c4a3d-32de04f6_0 is DEAD
2025-09-30T14:51:46.449603Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:46.449681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68b0fc4-7d509a4f-bf2c4a3d-32de04f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:46.449692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68b0fc4-7d509a4f-bf2c4a3d-32de04f6_0] Write session will restart in 0.008196s
2025-09-30T14:51:46.449721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68b0fc4-7d509a4f-bf2c4a3d-32de04f6_0] Write session: Do CDS request
2025-09-30T14:51:46.449727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68b0fc4-7d509a4f-bf2c4a3d-32de04f6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:46.458835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d68b0fc4-7d509a4f-bf2c4a3d-32de04f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:46.458927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:46.458944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 563
2025-09-30T14:51:46.459093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 563 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:46.459126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 563 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:46.459137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=563 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:46.459143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:46.459628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 563 sessionId:  describe result for acl check
2025-09-30T14:51:46.459667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:46.459674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:46.459676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:46.459682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895043974158598:5761] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:46.460241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895043974158598:5761] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:46.461812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:46.462743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895043974158598:5761] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:46.464038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:46.464248Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:46.464259Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:46.464271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:46.464339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:46.464386Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895043884431327:4832]
2025-09-30T14:51:46.465030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:46.465144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895043974158598:5761] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:46.465159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895043974158598:5761] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:46.465162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895043974158598:5761] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:46.465170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 563 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:46.465320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:46.465363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:46.465599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:46.465641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:46.465645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:46.465646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:46.465647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:46.465647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:46.465648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:46.465649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:46.465650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:46.465650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:46.465651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:46.465652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.465653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.465654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.465654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:46.465655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:46.465660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:46.465666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:46.465669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:46.465671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:46.465674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:46.465676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:46.465679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:46.465681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:46.465683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:46.465687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:46.465691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.465695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.465698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.465701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:46.465705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:46.465715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:46.465723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:46.465729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:46.465745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:46.465752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:46.465757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:46.465762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:46.465767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:46.465771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:46.465776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:46.465781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:46.465786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:46.465790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:46.465796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:46.465800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:46.465804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:46.465808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:46.465813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:46.465817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:46.465823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:46.465826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.465831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.465835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.465840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.465844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.465849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.465853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:46.465859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:46.465863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:46.465875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:46.465920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:46.471371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:46.472255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:46.472270Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:46.472275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:46.472279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:46.472285Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 562 [2:7555895043884431327:4832]
2025-09-30T14:51:46.472302Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:46.472317Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:46.472326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:46.472329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:46.472331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:46.472348Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:46.472360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:46.472368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:46.472427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.472438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.472440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.472443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:46.472446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:46.472509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:46.472517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.472530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.472543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.472567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:46.472588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895043974158519:2454], now have 1 active actors on pipe
2025-09-30T14:51:46.472596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895043974158662:5761], now have 1 active actors on pipe
2025-09-30T14:51:46.472602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895043884431322:4832]
2025-09-30T14:51:46.472604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895043884431322:4832]
2025-09-30T14:51:46.472607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895043884431322:4832]
2025-09-30T14:51:46.472618Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:46.472632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:46.472635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:46.472635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:46.472638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:46.472649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:46.472653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:46.472646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 562
2025-09-30T14:51:46.472679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895043884431322:4832]
2025-09-30T14:51:46.472688Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:46.472690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:46.472662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 562
2025-09-30T14:51:46.472708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:46.472718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:46.472776Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a44b28a-fd643874-c8b77b33-715bb162_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:46.472787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:46.472790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:46.472793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:46.472801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:46.472810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:46.472834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:46.472966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:46.472974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:46.472986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:46.473059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 563 partition: 0 MaxSeqNo: 42 sessionId: src_id|3a44b28a-fd643874-c8b77b33-715bb162_0
2025-09-30T14:51:46.473399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68b0fc4-7d509a4f-bf2c4a3d-32de04f6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3a44b28a-fd643874-c8b77b33-715bb162_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:46.476194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a44b28a-fd643874-c8b77b33-715bb162_0] Write session: try to update token
2025-09-30T14:51:46.476213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a44b28a-fd643874-c8b77b33-715bb162_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:46.484565Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:46.484583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:46.484586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:46.484588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:46.484596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895043884431322:4832]
2025-09-30T14:51:46.484600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895043884431322:4832]
2025-09-30T14:51:46.484604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895043884431322:4832]
2025-09-30T14:51:46.484647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:46.484651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:46.484657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.484657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:46.484659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:46.484661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:46.484845Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:46.491138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 563 sessionId: src_id|3a44b28a-fd643874-c8b77b33-715bb162_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:46.494017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:46.549451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895043974158672:5419]
2025-09-30T14:51:46.549736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 562, pipe: [1:7555895043974158672:5419]
2025-09-30T14:51:46.596183Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:46.596652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:46.596666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:46.596682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895043974158672:5419], now have 1 active actors on pipe
2025-09-30T14:51:46.596884Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:46.596895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:46.596907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:46.596911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:46.596951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895043974158672:5419]
2025-09-30T14:51:46.596985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 563 reason: error at write: Disconnected sessionId: src_id|3a44b28a-fd643874-c8b77b33-715bb162_0
2025-09-30T14:51:46.597165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 563 sessionId: src_id|3a44b28a-fd643874-c8b77b33-715bb162_0 is DEAD
2025-09-30T14:51:46.597312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a44b28a-fd643874-c8b77b33-715bb162_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:46.597324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a44b28a-fd643874-c8b77b33-715bb162_0] Write session will restart in 0.009232s
2025-09-30T14:51:46.597348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a44b28a-fd643874-c8b77b33-715bb162_0] Write session: Do CDS request
2025-09-30T14:51:46.597354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a44b28a-fd643874-c8b77b33-715bb162_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:46.607786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a44b28a-fd643874-c8b77b33-715bb162_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:46.607828Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:46.607845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 564
2025-09-30T14:51:46.608042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 564 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:46.608073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 564 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:46.608085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=564 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:46.608088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:46.608528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 564 sessionId:  describe result for acl check
2025-09-30T14:51:46.608565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:46.608572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:46.608574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:46.608580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895043974158775:5766] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:46.609161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895043974158775:5766] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:46.609245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:46.611232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:46.611286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895043974158775:5766] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:46.611467Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:46.611478Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:46.611489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:46.611546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:46.611597Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895043884431473:4835]
2025-09-30T14:51:46.612200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:46.612518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:46.612576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:46.612913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:46.612997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:46.613004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:46.613006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:46.613007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:46.613012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:46.613014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:46.613015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:46.613016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:46.613017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:46.613019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:46.613020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.613033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.613034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.613036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:46.613037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:46.613047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:46.613057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:46.613061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:46.613066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:46.613070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:46.613075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:46.613079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:46.613083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:46.613087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:46.613091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:46.613095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.613099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.613103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.613107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:46.613112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:46.613119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:46.613132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:46.613143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:46.613149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:46.613158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:46.613163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:46.613168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:46.613179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:46.613185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:46.613190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:46.613195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:46.613199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:46.613204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:46.613210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:46.613215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:46.613225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:46.613230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:46.613240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:46.613244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:46.613250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:46.613260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.613266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.613271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.613277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.613282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.613288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.613298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:46.613304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:46.613314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:46.613320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:46.613374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:46.613570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895043974158775:5766] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:46.613589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895043974158775:5766] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:46.613592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895043974158775:5766] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:46.613602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 564 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:46.618922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:46.620119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:46.620134Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:46.620137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:46.620141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:46.620147Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 563 [2:7555895043884431473:4835]
2025-09-30T14:51:46.620164Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:46.620179Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:46.620182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:46.620185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:46.620187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:46.620202Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:46.620213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:46.620221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:46.620271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.620279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.620280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.620284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:46.620287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:46.620351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:46.620359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.620371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.620378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.620388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:46.620402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895043884431468:4835]
2025-09-30T14:51:46.620405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895043884431468:4835]
2025-09-30T14:51:46.620407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895043884431468:4835]
2025-09-30T14:51:46.620415Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:46.620428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:46.620434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:46.620437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:46.620439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:46.620449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:46.620451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:46.620460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895043974158673:2454], now have 1 active actors on pipe
2025-09-30T14:51:46.620497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895043974158815:5766], now have 1 active actors on pipe
2025-09-30T14:51:46.620504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895043884431468:4835]
2025-09-30T14:51:46.620514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:46.620559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:46.620608Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 563
2025-09-30T14:51:46.620661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 563
2025-09-30T14:51:46.620706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:46.620716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:46.620739Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f279c857-8d8d02b2-68bdfc38-225c34ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:46.620751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:46.620759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:46.620763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:46.620773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:46.620782Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:46.620792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:46.621056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:46.621069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:46.621092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:46.621194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 564 partition: 0 MaxSeqNo: 42 sessionId: src_id|f279c857-8d8d02b2-68bdfc38-225c34ae_0
2025-09-30T14:51:46.621545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a44b28a-fd643874-c8b77b33-715bb162_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f279c857-8d8d02b2-68bdfc38-225c34ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:46.624264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f279c857-8d8d02b2-68bdfc38-225c34ae_0] Write session: try to update token
2025-09-30T14:51:46.624286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f279c857-8d8d02b2-68bdfc38-225c34ae_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:46.632413Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:46.632435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:46.632437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:46.632440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:46.632453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895043884431468:4835]
2025-09-30T14:51:46.632461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895043884431468:4835]
2025-09-30T14:51:46.632468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895043884431468:4835]
2025-09-30T14:51:46.632519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:46.632522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:46.632527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:46.632528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.632531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:46.632531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:46.632732Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:46.638891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 564 sessionId: src_id|f279c857-8d8d02b2-68bdfc38-225c34ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:46.641654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:46.696902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895043974158824:5419]
2025-09-30T14:51:46.697199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 563, pipe: [1:7555895043974158824:5419]
2025-09-30T14:51:46.740297Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:46.740562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:46.740575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:46.740595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895043974158824:5419], now have 1 active actors on pipe
2025-09-30T14:51:46.740768Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:46.740836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:46.740850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:46.740915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895043974158824:5419]
2025-09-30T14:51:46.740941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 564 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f279c857-8d8d02b2-68bdfc38-225c34ae_0
2025-09-30T14:51:46.741137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 564 sessionId: src_id|f279c857-8d8d02b2-68bdfc38-225c34ae_0 is DEAD
2025-09-30T14:51:46.741279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f279c857-8d8d02b2-68bdfc38-225c34ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:46.741290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f279c857-8d8d02b2-68bdfc38-225c34ae_0] Write session will restart in 0.007087s
2025-09-30T14:51:46.741314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f279c857-8d8d02b2-68bdfc38-225c34ae_0] Write session: Do CDS request
2025-09-30T14:51:46.741320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f279c857-8d8d02b2-68bdfc38-225c34ae_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:46.749673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f279c857-8d8d02b2-68bdfc38-225c34ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:46.749789Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:46.749807Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 565
2025-09-30T14:51:46.750019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 565 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:46.750050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 565 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:46.750062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=565 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:46.750070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:46.750540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 565 sessionId:  describe result for acl check
2025-09-30T14:51:46.750584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:46.750588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:46.750590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:46.750596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895043974158921:5770] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:46.751107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895043974158921:5770] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:46.752113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:46.752880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895043974158921:5770] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:46.754337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:46.754529Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:46.754538Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:46.754549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:46.754591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:46.754623Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895043884431616:4837]
2025-09-30T14:51:46.755111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:46.755415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:46.755502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:46.755529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895043974158921:5770] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:46.755545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895043974158921:5770] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:46.755548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895043974158921:5770] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:46.755556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 565 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:46.755877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:46.755962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:46.755968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:46.755970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:46.755971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:46.755972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:46.755973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:46.755974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:46.755976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:46.755977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:46.755978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:46.755979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.755981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.755982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.755983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:46.755984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:46.755990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:46.756001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:46.756005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:46.756010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:46.756014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:46.756018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:46.756023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:46.756027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:46.756030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:46.756035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:46.756039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.756042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.756047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.756050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:46.756054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:46.756063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:46.756071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:46.756078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:46.756083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:46.756088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:46.756093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:46.756098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:46.756109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:46.756114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:46.756120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:46.756125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:46.756138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:46.756143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:46.756150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:46.756155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:46.756162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:46.756168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:46.756179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:46.756185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:46.756190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:46.756198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.756206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.756211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.756216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.756222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.756226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.756231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:46.756236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:46.756241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:46.756247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:46.756291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:46.761841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:46.762781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:46.762798Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:46.762802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:46.762806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:46.762813Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 564 [2:7555895043884431616:4837]
2025-09-30T14:51:46.762829Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:46.762844Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:46.762847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:46.762851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:46.762853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:46.762885Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:46.762897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:46.762905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:46.762952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.762959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.762960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.762963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:46.762965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:46.763167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:46.763173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.763181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.763188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.763199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:46.763219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895043974158967:5770], now have 1 active actors on pipe
2025-09-30T14:51:46.763227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895043974158825:2454], now have 1 active actors on pipe
2025-09-30T14:51:46.763233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895043884431610:4837]
2025-09-30T14:51:46.763235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895043884431610:4837]
2025-09-30T14:51:46.763237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895043884431610:4837]
2025-09-30T14:51:46.763197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 564
2025-09-30T14:51:46.763209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 564
2025-09-30T14:51:46.763269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:46.763290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:46.763290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:46.763294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:46.763296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:46.763306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:46.763310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:46.763347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:46.763354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:46.763367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895043884431610:4837]
2025-09-30T14:51:46.763376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:46.763388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:46.763399Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e07b9fe-8510d107-cfccb2ca-59d34682_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:46.763405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:46.763407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:46.763409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:46.763416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:46.763423Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:46.763443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:46.763589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:46.763600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:46.763621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:46.763695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 565 partition: 0 MaxSeqNo: 42 sessionId: src_id|2e07b9fe-8510d107-cfccb2ca-59d34682_0
2025-09-30T14:51:46.764052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f279c857-8d8d02b2-68bdfc38-225c34ae_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2e07b9fe-8510d107-cfccb2ca-59d34682_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:46.766800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e07b9fe-8510d107-cfccb2ca-59d34682_0] Write session: try to update token
2025-09-30T14:51:46.766822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e07b9fe-8510d107-cfccb2ca-59d34682_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:46.775487Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:46.775505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:46.775507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:46.775509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:46.775519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895043884431610:4837]
2025-09-30T14:51:46.775525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895043884431610:4837]
2025-09-30T14:51:46.775528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895043884431610:4837]
2025-09-30T14:51:46.775571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:46.775574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:46.775577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.775580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:46.775582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:46.775586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:46.775719Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:46.781745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 565 sessionId: src_id|2e07b9fe-8510d107-cfccb2ca-59d34682_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:46.784729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:46.814589Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-09-30T14:51:46.814612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 3
2025-09-30T14:51:46.841238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895043974158992:5419]
2025-09-30T14:51:46.841459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 564, pipe: [1:7555895043974158992:5419]
2025-09-30T14:51:46.888183Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:46.888683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:46.888713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:46.888775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895043974158992:5419], now have 1 active actors on pipe
2025-09-30T14:51:46.889007Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:46.888989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:46.889005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:46.889021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895043974158992:5419]
2025-09-30T14:51:46.889047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:46.889058Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 3
2025-09-30T14:51:46.889079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 565 reason: error at write: Disconnected sessionId: src_id|2e07b9fe-8510d107-cfccb2ca-59d34682_0
2025-09-30T14:51:46.889245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 565 sessionId: src_id|2e07b9fe-8510d107-cfccb2ca-59d34682_0 is DEAD
2025-09-30T14:51:46.889380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e07b9fe-8510d107-cfccb2ca-59d34682_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:46.889390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e07b9fe-8510d107-cfccb2ca-59d34682_0] Write session will restart in 0.009037s
2025-09-30T14:51:46.889425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e07b9fe-8510d107-cfccb2ca-59d34682_0] Write session: Do CDS request
2025-09-30T14:51:46.889431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e07b9fe-8510d107-cfccb2ca-59d34682_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:46.899755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e07b9fe-8510d107-cfccb2ca-59d34682_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:46.899849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:46.899878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 566
2025-09-30T14:51:46.899999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 566 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:46.900031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 566 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:46.900041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=566 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:46.900045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:46.900512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 566 sessionId:  describe result for acl check
2025-09-30T14:51:46.900556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:46.900562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:46.900564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:46.900570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895043974159108:5782] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:46.901131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895043974159108:5782] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:46.902507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:46.903024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895043974159108:5782] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:46.904662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:46.904840Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:46.904850Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:46.904860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:46.904914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:46.904956Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895043884431810:4853]
2025-09-30T14:51:46.905390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895043974159108:5782] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:46.905404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895043974159108:5782] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:46.905406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895043974159108:5782] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:46.905412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 566 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:46.905666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:46.905984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:46.906026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:46.906368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:46.906421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:46.906427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:46.906428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:46.906429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:46.906430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:46.906431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:46.906433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:46.906434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:46.906435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:46.906436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:46.906450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.906452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.906453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.906454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:46.906456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:46.906461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:46.906471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:46.906476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:46.906480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:46.906484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:46.906488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:46.906492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:46.906496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:46.906501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:46.906506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:46.906515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.906518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.906527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.906533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:46.906541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:46.906549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:46.906561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:46.906571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:46.906577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:46.906586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:46.906591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:46.906596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:46.906606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:46.906610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:46.906619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:46.906624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:46.906629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:46.906638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:46.906647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:46.906657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:46.906678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:46.906687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:46.906694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:46.906702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:46.906707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:46.906716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.906726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.906734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.906740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.906748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.906757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.906762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:46.906771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:46.906779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:46.906789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:46.906837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:46.912155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:46.913083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:46.913102Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:46.913104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:46.913108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:46.913114Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 565 [2:7555895043884431810:4853]
2025-09-30T14:51:46.913128Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:46.913141Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:46.913146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:46.913149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:46.913150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:46.913162Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:46.913166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:46.913173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:46.913219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.913225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.913226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.913228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:46.913230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:46.913280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:46.913287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.913294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:46.913301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:46.913310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:46.913323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895043884431805:4853]
2025-09-30T14:51:46.913327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895043884431805:4853]
2025-09-30T14:51:46.913328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895043884431805:4853]
2025-09-30T14:51:46.913334Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:46.913343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:46.913346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:46.913352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:46.913354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:46.913360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895043974159161:5782], now have 1 active actors on pipe
2025-09-30T14:51:46.913361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:46.913363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895043974159005:2454], now have 1 active actors on pipe
2025-09-30T14:51:46.913363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:46.913383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895043884431805:4853]
2025-09-30T14:51:46.913389Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:46.913393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:46.913428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 565
2025-09-30T14:51:46.913459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 565
2025-09-30T14:51:46.913486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:46.913511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:46.913540Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6152d000-d215986e-3a929ae5-28ae2a8a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:46.913565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:46.913571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:46.913573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:46.913584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:46.913595Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:46.913641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:46.913706Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 85826639 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:51:46.913768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:46.913777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:46.913799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:46.913879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 3 DataSize: 85826639 UsedReserveSize: 0
2025-09-30T14:51:46.913911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:51:46.913922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 566 partition: 0 MaxSeqNo: 42 sessionId: src_id|6152d000-d215986e-3a929ae5-28ae2a8a_0
2025-09-30T14:51:46.914243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e07b9fe-8510d107-cfccb2ca-59d34682_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6152d000-d215986e-3a929ae5-28ae2a8a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:46.916986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6152d000-d215986e-3a929ae5-28ae2a8a_0] Write session: try to update token
2025-09-30T14:51:46.917003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6152d000-d215986e-3a929ae5-28ae2a8a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:46.925424Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:46.925444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:46.925446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:46.925448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:46.925458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895043884431805:4853]
2025-09-30T14:51:46.925461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895043884431805:4853]
2025-09-30T14:51:46.925463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895043884431805:4853]
2025-09-30T14:51:46.925494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:46.925500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:46.925501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:46.925512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:46.925520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:46.925524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:46.925632Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:46.931283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 566 sessionId: src_id|6152d000-d215986e-3a929ae5-28ae2a8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:46.933751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:46.989240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895043974159185:5419]
2025-09-30T14:51:46.989614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 565, pipe: [1:7555895043974159185:5419]
2025-09-30T14:51:47.035788Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:47.036082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:47.036095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:47.036127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895043974159185:5419], now have 1 active actors on pipe
2025-09-30T14:51:47.036351Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:47.036347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:47.036352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895043974159185:5419]
2025-09-30T14:51:47.036364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:47.036371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:47.036433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 566 reason: error at write: Disconnected sessionId: src_id|6152d000-d215986e-3a929ae5-28ae2a8a_0
2025-09-30T14:51:47.036603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 566 sessionId: src_id|6152d000-d215986e-3a929ae5-28ae2a8a_0 is DEAD
2025-09-30T14:51:47.036792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6152d000-d215986e-3a929ae5-28ae2a8a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:47.036804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6152d000-d215986e-3a929ae5-28ae2a8a_0] Write session will restart in 0.009016s
2025-09-30T14:51:47.036837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6152d000-d215986e-3a929ae5-28ae2a8a_0] Write session: Do CDS request
2025-09-30T14:51:47.036843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6152d000-d215986e-3a929ae5-28ae2a8a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:47.046803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6152d000-d215986e-3a929ae5-28ae2a8a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:47.046860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:47.046877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 567
2025-09-30T14:51:47.047051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 567 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:47.047103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 567 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:47.047113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=567 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:47.047117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:47.047520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 567 sessionId:  describe result for acl check
2025-09-30T14:51:47.047557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:47.047559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:47.047560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:47.047567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895048269126590:5788] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:47.048079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895048269126590:5788] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:47.048308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:47.049962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895048269126590:5788] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:47.050523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:47.050715Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:47.050726Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:47.050736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:47.050797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:47.050832Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895048179399254:4856]
2025-09-30T14:51:47.051501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:47.051857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:47.051905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:47.052198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:47.052260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:47.052266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:47.052267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:47.052268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:47.052270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:47.052271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:47.052272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:47.052273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:47.052262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895048269126590:5788] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:47.052274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:47.052274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895048269126590:5788] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:47.052275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:47.052276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895048269126590:5788] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:47.052276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.052282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 567 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:47.052278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.052279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.052280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:47.052281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:47.052286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:47.052297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:47.052301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:47.052305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:47.052308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:47.052312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:47.052316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:47.052319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:47.052324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:47.052328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:47.052332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.052336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.052341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.052344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:47.052348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:47.052353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:47.052361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:47.052366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:47.052371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:47.052376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:47.052381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:47.052385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:47.052391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:47.052396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:47.052401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:47.052405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:47.052410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:47.052414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:47.052419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:47.052423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:47.052429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:47.052434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:47.052439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:47.052449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:47.052454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:47.052464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.052469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.052477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.052482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.052486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.052495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.052499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:47.052504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:47.052509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:47.052514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:47.052560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:47.057781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:47.058841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:47.058863Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:47.058866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:47.058869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:47.058876Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 566 [2:7555895048179399254:4856]
2025-09-30T14:51:47.058893Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:47.058907Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:47.058911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:47.058914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.058916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:47.058931Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:47.058937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:47.058945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:47.058997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.059005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.059007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.059010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:47.059012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:47.059069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:47.059075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.059084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.059091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.059103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:47.059117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895048269126485:2454], now have 1 active actors on pipe
2025-09-30T14:51:47.059124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895048269126633:5788], now have 1 active actors on pipe
2025-09-30T14:51:47.059130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895048179399248:4856]
2025-09-30T14:51:47.059132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895048179399248:4856]
2025-09-30T14:51:47.059136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895048179399248:4856]
2025-09-30T14:51:47.059147Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:47.059159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:47.059176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:47.059177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:47.059181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:47.059182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:47.059184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:47.059214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895048179399248:4856]
2025-09-30T14:51:47.059225Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:47.059233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:47.059211Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 566
2025-09-30T14:51:47.059232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 566
2025-09-30T14:51:47.059282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:47.059291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:47.059312Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fee31129-dbd45d00-8ff5ae3d-7ed27414_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:47.059320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:47.059324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.059325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:47.059333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:47.059345Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:47.059360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:47.059538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:47.059548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:47.059566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:47.059654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 567 partition: 0 MaxSeqNo: 42 sessionId: src_id|fee31129-dbd45d00-8ff5ae3d-7ed27414_0
2025-09-30T14:51:47.060001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6152d000-d215986e-3a929ae5-28ae2a8a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fee31129-dbd45d00-8ff5ae3d-7ed27414_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:47.062742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fee31129-dbd45d00-8ff5ae3d-7ed27414_0] Write session: try to update token
2025-09-30T14:51:47.062760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fee31129-dbd45d00-8ff5ae3d-7ed27414_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:47.071016Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:47.071045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:47.071055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895048179399248:4856]
2025-09-30T14:51:47.071096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:47.071099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:47.071300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:47.071453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:47.071601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:47.071737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:47.071944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:47.071994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:47.077736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 567 sessionId: src_id|fee31129-dbd45d00-8ff5ae3d-7ed27414_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:47.080556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:47.080733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:47.080756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:47.080791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:47.080892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:47.081970Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:47.081985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:47.081987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:47.081989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:47.081999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895048179399248:4856]
2025-09-30T14:51:47.082003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895048179399248:4856]
2025-09-30T14:51:47.082009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895048179399248:4856]
2025-09-30T14:51:47.082045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:47.082052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:47.082056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.082060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:47.082061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:47.082065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:47.082192Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:47.136699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895048269126643:5419]
2025-09-30T14:51:47.136991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 566, pipe: [1:7555895048269126643:5419]
2025-09-30T14:51:47.192897Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:47.201199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:47.201231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:47.201418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:47.201496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:47.201578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:47.201657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:47.201711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:47.201722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:47.201803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:47.201871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:47.201944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:47.202022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:47.202069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:47.202075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:47.202151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:47.202230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:47.202306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:47.202384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:47.202430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:47.202450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:47.202524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:47.202774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:47.202850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:47.202927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:47.202979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:47.202988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:47.203064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:47.203136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:47.203207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:47.203302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:47.203358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:47.203366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:47.203440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:47.203510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:47.203579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:47.203653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:47.203707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:47.203716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:47.203789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:47.203859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:47.203936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:47.204006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:47.204059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:47.204067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:47.204144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:47.204210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:47.204285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:47.204359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:47.204410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:47.204418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:47.204492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:47.204557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:47.204624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:47.204696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:47.204745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:47.204753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:47.204826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:47.204895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:47.204962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:47.205038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:47.205093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:47.205101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:47.205167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895048269126643:5419], now have 1 active actors on pipe
2025-09-30T14:51:47.205445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:47.205462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:47.205493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 567 reason: error at write: Disconnected sessionId: src_id|fee31129-dbd45d00-8ff5ae3d-7ed27414_0
2025-09-30T14:51:47.205655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895048269126643:5419]
2025-09-30T14:51:47.205822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fee31129-dbd45d00-8ff5ae3d-7ed27414_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:47.205832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fee31129-dbd45d00-8ff5ae3d-7ed27414_0] Write session will restart in 0.005929s
2025-09-30T14:51:47.205854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fee31129-dbd45d00-8ff5ae3d-7ed27414_0] Write session: Do CDS request
2025-09-30T14:51:47.205860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fee31129-dbd45d00-8ff5ae3d-7ed27414_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:47.205684Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:47.205685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 567 sessionId: src_id|fee31129-dbd45d00-8ff5ae3d-7ed27414_0 is DEAD
2025-09-30T14:51:47.206252Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:47.212775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fee31129-dbd45d00-8ff5ae3d-7ed27414_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:47.212866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:47.212886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 568
2025-09-30T14:51:47.213024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 568 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:47.213057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 568 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:47.213062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=568 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:47.213067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:47.213628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 568 sessionId:  describe result for acl check
2025-09-30T14:51:47.213665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:47.213667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:47.213669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:47.213675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895048269126658:5792] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:47.214196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895048269126658:5792] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:47.216924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895048269126658:5792] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:47.219110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:47.221148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:47.221338Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:47.221351Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:47.221363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:47.221424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:47.221479Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895048179399401:4859]
2025-09-30T14:51:47.221492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895048269126658:5792] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:47.221505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895048269126658:5792] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:47.221508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895048269126658:5792] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:47.221514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 568 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:47.222157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:47.222408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:47.222459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:47.222774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:47.222836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:47.222842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:47.222843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:47.222844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:47.222845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:47.222847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:47.222848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:47.222849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:47.222850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:47.222852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:47.222853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.222854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.222855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.222856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:47.222857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:47.222863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:47.222874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:47.222878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:47.222882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:47.222887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:47.222891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:47.222895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:47.222899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:47.222903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:47.222907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:47.222911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.222915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.222919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.222923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:47.222927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:47.222934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:47.222941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:47.222948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:47.222953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:47.222958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:47.222963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:47.222968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:47.222974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:47.222978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:47.222984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:47.222989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:47.222994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:47.222998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:47.223004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:47.223008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:47.223013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:47.223018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:47.223024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:47.223035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:47.223041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:47.223045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.223051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.223059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.223064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.223069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.223073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.223077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:47.223082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:47.223087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:47.223094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:47.223139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:47.228453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:47.229433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:47.229449Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:47.229452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:47.229457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:47.229464Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 567 [2:7555895048179399401:4859]
2025-09-30T14:51:47.229480Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:47.229494Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:47.229497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:47.229500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.229503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:47.229517Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:47.229526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:47.229533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:47.229595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.229603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.229604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.229608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:47.229611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:47.229680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:47.229687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.229700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.229717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.229740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:47.229761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895048269126787:5792], now have 1 active actors on pipe
2025-09-30T14:51:47.229769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895048269126644:2454], now have 1 active actors on pipe
2025-09-30T14:51:47.229775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895048179399396:4859]
2025-09-30T14:51:47.229777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895048179399396:4859]
2025-09-30T14:51:47.229780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895048179399396:4859]
2025-09-30T14:51:47.229792Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:47.229811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:47.229813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:47.229818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:47.229821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:47.229830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:47.229837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:47.229869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895048179399396:4859]
2025-09-30T14:51:47.229849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 567
2025-09-30T14:51:47.229884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:47.229887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:47.229851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 567
2025-09-30T14:51:47.229914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:47.229923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:47.229951Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd8c1110-621db56-5d9f0f34-40b49661_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:47.229962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:47.229966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.229968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:47.229980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:47.229989Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:47.230008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:47.230160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:47.230168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:47.230183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:47.230275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 568 partition: 0 MaxSeqNo: 42 sessionId: src_id|bd8c1110-621db56-5d9f0f34-40b49661_0
2025-09-30T14:51:47.230654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fee31129-dbd45d00-8ff5ae3d-7ed27414_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bd8c1110-621db56-5d9f0f34-40b49661_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:47.233462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd8c1110-621db56-5d9f0f34-40b49661_0] Write session: try to update token
2025-09-30T14:51:47.233480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd8c1110-621db56-5d9f0f34-40b49661_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:47.242004Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:47.242023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:47.242025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:47.242027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:47.242041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895048179399396:4859]
2025-09-30T14:51:47.242046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895048179399396:4859]
2025-09-30T14:51:47.242049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895048179399396:4859]
2025-09-30T14:51:47.242090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:47.242097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.242105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:47.242114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:47.242132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:47.242137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:47.242251Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:47.248955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 568 sessionId: src_id|bd8c1110-621db56-5d9f0f34-40b49661_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:47.251964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:47.305653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895048269126799:5419]
2025-09-30T14:51:47.305969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 567, pipe: [1:7555895048269126799:5419]
2025-09-30T14:51:47.350965Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:47.351436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:47.351453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:47.351473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895048269126799:5419], now have 1 active actors on pipe
2025-09-30T14:51:47.351687Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:47.351788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895048269126799:5419]
2025-09-30T14:51:47.351792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:47.351796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:47.351820Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:47.351870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 568 reason: error at write: Disconnected sessionId: src_id|bd8c1110-621db56-5d9f0f34-40b49661_0
2025-09-30T14:51:47.352068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 568 sessionId: src_id|bd8c1110-621db56-5d9f0f34-40b49661_0 is DEAD
2025-09-30T14:51:47.352225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd8c1110-621db56-5d9f0f34-40b49661_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:47.352234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd8c1110-621db56-5d9f0f34-40b49661_0] Write session will restart in 0.005628s
2025-09-30T14:51:47.352256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd8c1110-621db56-5d9f0f34-40b49661_0] Write session: Do CDS request
2025-09-30T14:51:47.352265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd8c1110-621db56-5d9f0f34-40b49661_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:47.358739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd8c1110-621db56-5d9f0f34-40b49661_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:47.358792Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:47.358811Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 569
2025-09-30T14:51:47.358954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 569 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:47.358994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 569 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:47.359003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=569 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:47.359007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:47.359413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 569 sessionId:  describe result for acl check
2025-09-30T14:51:47.359445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:47.359451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:47.359453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:47.359459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895048269126818:5796] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:47.359990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895048269126818:5796] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:47.362130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895048269126818:5796] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:47.364201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:47.366152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:47.366298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895048269126818:5796] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:47.366312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895048269126818:5796] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:47.366314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895048269126818:5796] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:47.366320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 569 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:47.366339Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:47.366349Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:47.366360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:47.366408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:47.366460Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895048179399549:4861]
2025-09-30T14:51:47.367115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:47.367392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:47.367433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:47.367767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:47.367824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:47.367830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:47.367831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:47.367833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:47.367834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:47.367836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:47.367837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:47.367838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:47.367839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:47.367841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:47.367842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.367843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.367845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.367846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:47.367847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:47.367852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:47.367862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:47.367866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:47.367871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:47.367875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:47.367879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:47.367883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:47.367887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:47.367890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:47.367894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:47.367897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.367902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.367906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.367911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:47.367914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:47.367921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:47.367929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:47.367935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:47.367941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:47.367948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:47.367954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:47.367958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:47.367964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:47.367968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:47.367974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:47.367978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:47.367983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:47.367991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:47.367996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:47.368005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:47.368010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:47.368015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:47.368022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:47.368032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:47.368037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:47.368047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.368053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.368061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.368066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.368077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.368083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.368091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:47.368096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:47.368099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:47.368104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:47.368148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:47.373536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:47.374634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:47.374647Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:47.374649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:47.374652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:47.374657Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 568 [2:7555895048179399549:4861]
2025-09-30T14:51:47.374672Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:47.374685Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:47.374689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:47.374691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.374694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:47.374710Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:47.374717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:47.374726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:47.374788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.374797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.374800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.374804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:47.374806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:47.374864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:47.374875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.374889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.374902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.374920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:47.374941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895048269126944:5796], now have 1 active actors on pipe
2025-09-30T14:51:47.374944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895048269126800:2454], now have 1 active actors on pipe
2025-09-30T14:51:47.374948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895048179399544:4861]
2025-09-30T14:51:47.374950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895048179399544:4861]
2025-09-30T14:51:47.374951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895048179399544:4861]
2025-09-30T14:51:47.374961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:47.374972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:47.374981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:47.374986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:47.374988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:47.374991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:47.374994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:47.375014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895048179399544:4861]
2025-09-30T14:51:47.375019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:47.375023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:47.375019Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 568
2025-09-30T14:51:47.375043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 568
2025-09-30T14:51:47.375061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:47.375068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:47.375086Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84dafba7-7daae347-e87ae0ba-2c09ca10_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:47.375090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:47.375093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.375095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:47.375102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:47.375108Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:47.375120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:47.375265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:47.375272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:47.375284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:47.375408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 569 partition: 0 MaxSeqNo: 42 sessionId: src_id|84dafba7-7daae347-e87ae0ba-2c09ca10_0
2025-09-30T14:51:47.375726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd8c1110-621db56-5d9f0f34-40b49661_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|84dafba7-7daae347-e87ae0ba-2c09ca10_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:47.378421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84dafba7-7daae347-e87ae0ba-2c09ca10_0] Write session: try to update token
2025-09-30T14:51:47.378454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84dafba7-7daae347-e87ae0ba-2c09ca10_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:47.386343Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:47.386364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:47.386373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895048179399544:4861]
2025-09-30T14:51:47.386415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:47.386429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:47.386609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:47.386760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:47.386901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:47.387046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:47.387227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:47.387286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:47.392395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 569 sessionId: src_id|84dafba7-7daae347-e87ae0ba-2c09ca10_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:47.395098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:47.395493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:47.395515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:47.395556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:47.395648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:47.397433Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:47.397447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:47.397450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:47.397452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:47.397463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895048179399544:4861]
2025-09-30T14:51:47.397468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895048179399544:4861]
2025-09-30T14:51:47.397474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895048179399544:4861]
2025-09-30T14:51:47.397518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:47.397526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:47.397530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.397532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:47.397533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:47.397536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:47.397726Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:47.452080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895048269126955:5419]
2025-09-30T14:51:47.452377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 568, pipe: [1:7555895048269126955:5419]
2025-09-30T14:51:47.505700Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:47.512518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:47.512545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:47.512689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:47.512749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:47.512810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:47.512869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:47.512916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:47.512924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:47.512989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:47.513045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:47.513102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:47.513163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:47.513208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:47.513215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:47.513273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:47.513327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:47.513385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:47.513442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:47.513483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:47.513488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:47.513547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:47.513602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:47.513657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:47.513714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:47.513753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:47.513759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:47.513816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:47.513870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:47.513929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:47.513987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:47.514027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:47.514032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:47.514093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:47.514150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:47.514206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:47.514263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:47.514303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:47.514308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:47.514369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:47.514423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:47.514500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:47.514560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:47.514601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:47.514606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:47.514663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:47.514717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:47.514778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:47.514835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:47.514874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:47.514879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:47.514937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:47.514994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:47.515053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:47.515108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:47.515148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:47.515153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:47.515211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:47.515291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:47.515347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:47.515404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:47.515443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:47.515448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:47.515486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895048269126955:5419], now have 1 active actors on pipe
2025-09-30T14:51:47.515738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:47.515759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:47.515763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:47.515800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 569 reason: error at write: Disconnected sessionId: src_id|84dafba7-7daae347-e87ae0ba-2c09ca10_0
2025-09-30T14:51:47.515813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895048269126955:5419]
2025-09-30T14:51:47.515975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 569 sessionId: src_id|84dafba7-7daae347-e87ae0ba-2c09ca10_0 is DEAD
2025-09-30T14:51:47.516117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84dafba7-7daae347-e87ae0ba-2c09ca10_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:47.516128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84dafba7-7daae347-e87ae0ba-2c09ca10_0] Write session will restart in 0.008972s
2025-09-30T14:51:47.516150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84dafba7-7daae347-e87ae0ba-2c09ca10_0] Write session: Do CDS request
2025-09-30T14:51:47.516156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84dafba7-7daae347-e87ae0ba-2c09ca10_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:47.516254Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:47.526741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84dafba7-7daae347-e87ae0ba-2c09ca10_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:47.526873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:47.526891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 570
2025-09-30T14:51:47.527017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 570 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:47.527059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 570 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:47.527070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=570 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:47.527074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:47.527489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 570 sessionId:  describe result for acl check
2025-09-30T14:51:47.527530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:47.527532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:47.527534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:47.527539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895048269127069:5801] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:47.527565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:47.527993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895048269127069:5801] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:47.529495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:47.529671Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:47.529681Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:47.529690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:47.529741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:47.529780Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895048179399700:4864]
2025-09-30T14:51:47.530105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895048269127069:5801] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:47.530395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:47.530731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:47.530786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:47.531149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:47.531207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:47.531213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:47.531215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:47.531216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:47.531217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:47.531218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:47.531220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:47.531221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:47.531222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:47.531223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:47.531224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.531225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.531227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.531228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:47.531229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:47.531235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:47.531258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:47.531263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:47.531267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:47.531271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:47.531275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:47.531279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:47.531283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:47.531288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:47.531293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:47.531296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.531301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.531305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.531309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:47.531313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:47.531321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:47.531329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:47.531335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:47.531341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:47.531345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:47.531351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:47.531355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:47.531360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:47.531365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:47.531370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:47.531375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:47.531380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:47.531386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:47.531392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:47.531396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:47.531401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:47.531408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:47.531413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:47.531418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:47.531423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:47.531433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.531438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.531442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.531448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.531452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.531461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.531466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:47.531471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:47.531480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:47.531486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:47.531530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:47.536711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895048269127069:5801] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:47.536732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895048269127069:5801] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:47.536737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895048269127069:5801] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:47.536745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 570 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:47.536931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:47.537789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:47.537804Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:47.537807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:47.537811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:47.537818Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 569 [2:7555895048179399700:4864]
2025-09-30T14:51:47.537834Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:47.537849Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:47.537852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:47.537855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.537857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:47.537873Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:47.537879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:47.537886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:47.537938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.537946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.537948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.537952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:47.537955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:47.538015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:47.538022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.538034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.538044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.538066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:47.538087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895048269126959:2454], now have 1 active actors on pipe
2025-09-30T14:51:47.538097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895048269127109:5801], now have 1 active actors on pipe
2025-09-30T14:51:47.538103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895048179399695:4864]
2025-09-30T14:51:47.538106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895048179399695:4864]
2025-09-30T14:51:47.538108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895048179399695:4864]
2025-09-30T14:51:47.538120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:47.538132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:47.538137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:47.538141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:47.538143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:47.538147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:47.538151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:47.538179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895048179399695:4864]
2025-09-30T14:51:47.538191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:47.538174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 569
2025-09-30T14:51:47.538207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:47.538175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 569
2025-09-30T14:51:47.538230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:47.538234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:47.538261Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8e09310-b0fd1b36-de7b054c-71fac6e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:47.538273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:47.538276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.538278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:47.538288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:47.538296Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:47.538309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:47.538468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:47.538481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:47.538501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:47.538588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 570 partition: 0 MaxSeqNo: 42 sessionId: src_id|c8e09310-b0fd1b36-de7b054c-71fac6e2_0
2025-09-30T14:51:47.538937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84dafba7-7daae347-e87ae0ba-2c09ca10_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c8e09310-b0fd1b36-de7b054c-71fac6e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:47.541546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e09310-b0fd1b36-de7b054c-71fac6e2_0] Write session: try to update token
2025-09-30T14:51:47.541562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e09310-b0fd1b36-de7b054c-71fac6e2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:47.549836Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:47.549853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:47.549856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:47.549858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:47.549868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895048179399695:4864]
2025-09-30T14:51:47.549873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895048179399695:4864]
2025-09-30T14:51:47.549888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895048179399695:4864]
2025-09-30T14:51:47.549919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:47.549925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.549927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:47.549933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:47.549939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:47.549942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:47.550048Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:47.555282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 570 sessionId: src_id|c8e09310-b0fd1b36-de7b054c-71fac6e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:47.557779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:47.615940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895048269127116:5419]
2025-09-30T14:51:47.616302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 569, pipe: [1:7555895048269127116:5419]
2025-09-30T14:51:47.657043Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:47.657357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:47.657373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:47.657410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895048269127116:5419], now have 1 active actors on pipe
2025-09-30T14:51:47.657622Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:47.657626Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:47.657649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895048269127116:5419]
2025-09-30T14:51:47.657669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:47.657734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 570 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c8e09310-b0fd1b36-de7b054c-71fac6e2_0
2025-09-30T14:51:47.657878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 570 sessionId: src_id|c8e09310-b0fd1b36-de7b054c-71fac6e2_0 is DEAD
2025-09-30T14:51:47.658026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e09310-b0fd1b36-de7b054c-71fac6e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:47.658036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e09310-b0fd1b36-de7b054c-71fac6e2_0] Write session will restart in 0.006654s
2025-09-30T14:51:47.658054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e09310-b0fd1b36-de7b054c-71fac6e2_0] Write session: Do CDS request
2025-09-30T14:51:47.658059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e09310-b0fd1b36-de7b054c-71fac6e2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:47.665808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e09310-b0fd1b36-de7b054c-71fac6e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:47.665855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:47.665888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 571
2025-09-30T14:51:47.666065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 571 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:47.666112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 571 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:47.666123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=571 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:47.666127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:47.666548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 571 sessionId:  describe result for acl check
2025-09-30T14:51:47.666584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:47.666590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:47.666592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:47.666599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895048269127217:5805] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:47.667183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895048269127217:5805] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:47.668200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:47.669082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895048269127217:5805] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:47.670427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:47.670620Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:47.670631Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:47.670642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:47.670691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:47.670729Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895048179399850:4866]
2025-09-30T14:51:47.671353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:47.671645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:47.671708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:47.671975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895048269127217:5805] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:47.672003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:47.671996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895048269127217:5805] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:47.671999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895048269127217:5805] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:47.672006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 571 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:47.672071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:47.672078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:47.672078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:47.672079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:47.672080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:47.672080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:47.672081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:47.672082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:47.672083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:47.672083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:47.672085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.672086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.672086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.672087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:47.672088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:47.672092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:47.672099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:47.672101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:47.672103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:47.672106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:47.672109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:47.672111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:47.672114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:47.672116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:47.672119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:47.672121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.672123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.672126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.672128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:47.672131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:47.672137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:47.672142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:47.672146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:47.672149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:47.672151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:47.672154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:47.672157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:47.672160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:47.672163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:47.672167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:47.672170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:47.672172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:47.672176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:47.672179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:47.672181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:47.672184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:47.672187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:47.672189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:47.672192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:47.672194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:47.672197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.672200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.672202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.672205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.672207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.672210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.672212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:47.672215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:47.672218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:47.672221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:47.672258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:47.677895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:47.678767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:47.678782Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:47.678784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:47.678787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:47.678793Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 570 [2:7555895048179399850:4866]
2025-09-30T14:51:47.678805Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:47.678821Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:47.678829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:47.678832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.678835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:47.678851Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:47.678862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:47.678869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:47.678925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.678931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.678933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.678936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:47.678938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:47.678997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:47.679004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.679014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.679020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.679030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:47.679042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895048179399844:4866]
2025-09-30T14:51:47.679048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895048179399844:4866]
2025-09-30T14:51:47.679049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895048179399844:4866]
2025-09-30T14:51:47.679056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:47.679066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:47.679068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:47.679076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:47.679078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:47.679082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:47.679085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:47.679095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895048269127266:5805], now have 1 active actors on pipe
2025-09-30T14:51:47.679099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895048269127118:2454], now have 1 active actors on pipe
2025-09-30T14:51:47.679129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895048179399844:4866]
2025-09-30T14:51:47.679138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:47.679148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:47.679184Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 570
2025-09-30T14:51:47.679279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 570
2025-09-30T14:51:47.679328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:47.679338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:47.679360Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7224fbf-2f1f0627-97183a67-b0f7b2f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:47.679371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:47.679375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.679377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:47.679387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:47.679398Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:47.679409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:47.679576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:47.679589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:47.679624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:47.679766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 571 partition: 0 MaxSeqNo: 42 sessionId: src_id|d7224fbf-2f1f0627-97183a67-b0f7b2f3_0
2025-09-30T14:51:47.680119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e09310-b0fd1b36-de7b054c-71fac6e2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d7224fbf-2f1f0627-97183a67-b0f7b2f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:47.682816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7224fbf-2f1f0627-97183a67-b0f7b2f3_0] Write session: try to update token
2025-09-30T14:51:47.682835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7224fbf-2f1f0627-97183a67-b0f7b2f3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:47.691128Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:47.691150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:47.691159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895048179399844:4866]
2025-09-30T14:51:47.691206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:47.691223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:47.691391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:47.691526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:47.691703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:47.691842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:47.692030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:47.692069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:47.697398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 571 sessionId: src_id|d7224fbf-2f1f0627-97183a67-b0f7b2f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:47.700254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:47.700597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:47.700619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:47.700657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:47.700752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:47.701934Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:47.701949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:47.701952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:47.701955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:47.701964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895048179399844:4866]
2025-09-30T14:51:47.701968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895048179399844:4866]
2025-09-30T14:51:47.701973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895048179399844:4866]
2025-09-30T14:51:47.702009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:47.702012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:47.702020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:47.702020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.702023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:47.702023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:47.702155Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:47.757757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895048269127275:5419]
2025-09-30T14:51:47.758022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 570, pipe: [1:7555895048269127275:5419]
2025-09-30T14:51:47.812358Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:47.819538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:47.819568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:47.819745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:47.819816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:47.819886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:47.819958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:47.820005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:47.820016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:47.820090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:47.820154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:47.820218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:47.820286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:47.820332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:47.820340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:47.820406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:47.820465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:47.820533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:47.820597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:47.820642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:47.820650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:47.820719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:47.820787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:47.820855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:47.820918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:47.820963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:47.820971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:47.821044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:47.821109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:47.821181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:47.821252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:47.821302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:47.821310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:47.821380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:47.821445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:47.821516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:47.821590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:47.821638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:47.821646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:47.821715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:47.821780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:47.821848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:47.821919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:47.821966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:47.821975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:47.822047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:47.822116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:47.822182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:47.822251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:47.822297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:47.822308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:47.822377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:47.822458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:47.822527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:47.822596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:47.822643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:47.822651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:47.822718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:47.822783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:47.822869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:47.822943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:47.822994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:47.823001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:47.823069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895048269127275:5419], now have 1 active actors on pipe
2025-09-30T14:51:47.823308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895048269127275:5419]
2025-09-30T14:51:47.823315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:47.823319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:47.823342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:47.823348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 571 reason: error at write: Disconnected sessionId: src_id|d7224fbf-2f1f0627-97183a67-b0f7b2f3_0
2025-09-30T14:51:47.823558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 571 sessionId: src_id|d7224fbf-2f1f0627-97183a67-b0f7b2f3_0 is DEAD
2025-09-30T14:51:47.823703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7224fbf-2f1f0627-97183a67-b0f7b2f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:47.823713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7224fbf-2f1f0627-97183a67-b0f7b2f3_0] Write session will restart in 0.005694s
2025-09-30T14:51:47.823748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7224fbf-2f1f0627-97183a67-b0f7b2f3_0] Write session: Do CDS request
2025-09-30T14:51:47.823754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7224fbf-2f1f0627-97183a67-b0f7b2f3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:47.824329Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:47.830782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7224fbf-2f1f0627-97183a67-b0f7b2f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:47.830810Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:47.830828Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 572
2025-09-30T14:51:47.831026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 572 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:47.831059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 572 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:47.831069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=572 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:47.831073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:47.831502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 572 sessionId:  describe result for acl check
2025-09-30T14:51:47.831533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:47.831535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:47.831537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:47.831542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895048269127291:5809] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:47.832078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895048269127291:5809] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:47.834772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895048269127291:5809] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:47.836581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:47.838791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:47.838993Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:47.839005Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:47.839015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:47.839064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:47.839104Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895048179400001:4868]
2025-09-30T14:51:47.839182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895048269127291:5809] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:47.839199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895048269127291:5809] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:47.839204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895048269127291:5809] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:47.839212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 572 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:47.839780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:47.840094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:47.840138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:47.840460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:47.840515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:47.840521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:47.840522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:47.840523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:47.840524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:47.840525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:47.840526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:47.840527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:47.840529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:47.840530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:47.840531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.840533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.840534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.840535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:47.840536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:47.840541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:47.840551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:47.840555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:47.840559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:47.840563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:47.840567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:47.840571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:47.840576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:47.840580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:47.840584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:47.840589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.840593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.840597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.840601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:47.840605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:47.840611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:47.840619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:47.840625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:47.840630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:47.840635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:47.840641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:47.840651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:47.840657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:47.840665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:47.840671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:47.840675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:47.840686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:47.840690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:47.840696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:47.840701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:47.840709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:47.840714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:47.840718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:47.840722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:47.840727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:47.840735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.840741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.840750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.840755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.840761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.840770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.840775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:47.840780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:47.840788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:47.840793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:47.840843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:47.846475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:47.847439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:47.847454Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:47.847457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:47.847461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:47.847469Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 571 [2:7555895048179400001:4868]
2025-09-30T14:51:47.847487Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:47.847503Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:47.847506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:47.847510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.847512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:47.847528Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:47.847541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:47.847548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:47.847615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.847624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.847627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.847630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:47.847633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:47.847699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:47.847710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.847722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.847733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.847749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:47.847773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895048269127424:5809], now have 1 active actors on pipe
2025-09-30T14:51:47.847784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895048269127277:2454], now have 1 active actors on pipe
2025-09-30T14:51:47.847789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895048179399996:4868]
2025-09-30T14:51:47.847792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895048179399996:4868]
2025-09-30T14:51:47.847794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895048179399996:4868]
2025-09-30T14:51:47.847806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:47.847821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:47.847821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:47.847827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:47.847835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:47.847839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:47.847840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:47.847828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 571
2025-09-30T14:51:47.847841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 571
2025-09-30T14:51:47.847872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895048179399996:4868]
2025-09-30T14:51:47.847881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:47.847883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:47.847905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:47.847912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:47.847946Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8fabc3a-f2b9eda8-a921c4bc-33fc8134_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:47.847957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:47.847961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.847963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:47.847973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:47.847982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:47.847999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:47.848164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:47.848172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:47.848186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:47.848305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 572 partition: 0 MaxSeqNo: 42 sessionId: src_id|8fabc3a-f2b9eda8-a921c4bc-33fc8134_0
2025-09-30T14:51:47.848666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7224fbf-2f1f0627-97183a67-b0f7b2f3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8fabc3a-f2b9eda8-a921c4bc-33fc8134_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:47.851344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fabc3a-f2b9eda8-a921c4bc-33fc8134_0] Write session: try to update token
2025-09-30T14:51:47.851361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fabc3a-f2b9eda8-a921c4bc-33fc8134_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:47.860303Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:47.860330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:47.860333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:47.860335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:47.860346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895048179399996:4868]
2025-09-30T14:51:47.860351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895048179399996:4868]
2025-09-30T14:51:47.860354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895048179399996:4868]
2025-09-30T14:51:47.860400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:47.860407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.860407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:47.860410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:47.860413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:47.860416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:47.860558Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:47.866019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 572 sessionId: src_id|8fabc3a-f2b9eda8-a921c4bc-33fc8134_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:47.868675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:47.923613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895048269127464:5419]
2025-09-30T14:51:47.923982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 571, pipe: [1:7555895048269127464:5419]
2025-09-30T14:51:47.967136Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:47.967516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:47.967532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:47.967575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895048269127464:5419], now have 1 active actors on pipe
2025-09-30T14:51:47.967746Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:47.967804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:47.967817Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:47.967824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:47.967871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895048269127464:5419]
2025-09-30T14:51:47.967883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 572 reason: error at write: Disconnected sessionId: src_id|8fabc3a-f2b9eda8-a921c4bc-33fc8134_0
2025-09-30T14:51:47.968036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 572 sessionId: src_id|8fabc3a-f2b9eda8-a921c4bc-33fc8134_0 is DEAD
2025-09-30T14:51:47.968173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fabc3a-f2b9eda8-a921c4bc-33fc8134_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:47.968180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fabc3a-f2b9eda8-a921c4bc-33fc8134_0] Write session will restart in 0.006076s
2025-09-30T14:51:47.968196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fabc3a-f2b9eda8-a921c4bc-33fc8134_0] Write session: Do CDS request
2025-09-30T14:51:47.968201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fabc3a-f2b9eda8-a921c4bc-33fc8134_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:47.975724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fabc3a-f2b9eda8-a921c4bc-33fc8134_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:47.975829Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:47.975846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 573
2025-09-30T14:51:47.975970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 573 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:47.976003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 573 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:47.976012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=573 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:47.976016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:47.976414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 573 sessionId:  describe result for acl check
2025-09-30T14:51:47.976448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:47.976456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:47.976457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:47.976463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895048269127517:5821] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:47.977006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895048269127517:5821] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:47.978985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895048269127517:5821] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:47.979526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:47.981840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:47.982032Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:47.982043Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:47.982053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:47.982105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:47.982143Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895048179400200:4883]
2025-09-30T14:51:47.982227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895048269127517:5821] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:47.982244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895048269127517:5821] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:47.982248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895048269127517:5821] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:47.982263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 573 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:47.982842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:47.983101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:47.983140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:47.983447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:47.983507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:47.983513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:47.983514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:47.983515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:47.983517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:47.983518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:47.983520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:47.983521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:47.983522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:47.983523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:47.983525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.983526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.983527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.983528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:47.983529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:47.983535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:47.983542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:47.983544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:47.983547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:47.983549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:47.983552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:47.983554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:47.983556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:47.983559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:47.983561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:47.983564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.983566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.983568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.983571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:47.983573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:47.983579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:47.983588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:47.983594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:47.983599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:47.983603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:47.983608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:47.983612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:47.983617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:47.983622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:47.983628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:47.983632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:47.983637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:47.983642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:47.983648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:47.983652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:47.983658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:47.983663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:47.983666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:47.983669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:47.983672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:47.983675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.983678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.983681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.983684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.983686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.983691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.983695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:47.983700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:47.983705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:47.983709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:47.983755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:47.989253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:47.990147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:47.990163Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:47.990166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:47.990170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:47.990177Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 572 [2:7555895048179400200:4883]
2025-09-30T14:51:47.990193Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:47.990206Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:47.990208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:47.990210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.990212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:47.990223Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:47.990232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:47.990239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:47.990284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.990291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.990293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.990297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:47.990299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:47.990365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:47.990373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:47.990385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:47.990398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:47.990416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:47.990446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895048269127626:5821], now have 1 active actors on pipe
2025-09-30T14:51:47.990455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895048269127471:2454], now have 1 active actors on pipe
2025-09-30T14:51:47.990461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895048179400194:4883]
2025-09-30T14:51:47.990464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895048179400194:4883]
2025-09-30T14:51:47.990466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895048179400194:4883]
2025-09-30T14:51:47.990477Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:47.990487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:47.990493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:47.990497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:47.990499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:47.990502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:47.990506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:47.990539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895048179400194:4883]
2025-09-30T14:51:47.990548Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:47.990519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 572
2025-09-30T14:51:47.990540Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 572
2025-09-30T14:51:47.990566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:47.990581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:47.990586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:47.990615Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b20fa1d1-1318bbd5-40959e47-5ae15efa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:47.990627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:47.990631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.990638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:47.990648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:47.990662Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:47.990680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:47.990827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:47.990837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:47.990849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:47.990950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 573 partition: 0 MaxSeqNo: 42 sessionId: src_id|b20fa1d1-1318bbd5-40959e47-5ae15efa_0
2025-09-30T14:51:47.991318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fabc3a-f2b9eda8-a921c4bc-33fc8134_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b20fa1d1-1318bbd5-40959e47-5ae15efa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:47.994040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b20fa1d1-1318bbd5-40959e47-5ae15efa_0] Write session: try to update token
2025-09-30T14:51:47.994058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b20fa1d1-1318bbd5-40959e47-5ae15efa_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:48.002658Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:48.002680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:48.002683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:48.002684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:48.002694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895048179400194:4883]
2025-09-30T14:51:48.002698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895048179400194:4883]
2025-09-30T14:51:48.002703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895048179400194:4883]
2025-09-30T14:51:48.002742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:48.002747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:48.002751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.002754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:48.002754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:48.002757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:48.002932Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:48.008870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 573 sessionId: src_id|b20fa1d1-1318bbd5-40959e47-5ae15efa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:48.011710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:48.068036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895052564094939:5419]
2025-09-30T14:51:48.068322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 572, pipe: [1:7555895052564094939:5419]
2025-09-30T14:51:48.110104Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:48.110679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:48.110691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:48.110727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895052564094939:5419], now have 1 active actors on pipe
2025-09-30T14:51:48.110900Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:48.110937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:48.110955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:48.110999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895052564094939:5419]
2025-09-30T14:51:48.111019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 573 reason: error at write: Disconnected sessionId: src_id|b20fa1d1-1318bbd5-40959e47-5ae15efa_0
2025-09-30T14:51:48.111028Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:48.111210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 573 sessionId: src_id|b20fa1d1-1318bbd5-40959e47-5ae15efa_0 is DEAD
2025-09-30T14:51:48.111379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b20fa1d1-1318bbd5-40959e47-5ae15efa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:48.111391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b20fa1d1-1318bbd5-40959e47-5ae15efa_0] Write session will restart in 0.006789s
2025-09-30T14:51:48.111415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b20fa1d1-1318bbd5-40959e47-5ae15efa_0] Write session: Do CDS request
2025-09-30T14:51:48.111423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b20fa1d1-1318bbd5-40959e47-5ae15efa_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:48.119801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b20fa1d1-1318bbd5-40959e47-5ae15efa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:48.119930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:48.119948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 574
2025-09-30T14:51:48.120124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 574 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:48.120160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 574 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:48.120165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=574 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:48.120169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:48.120649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 574 sessionId:  describe result for acl check
2025-09-30T14:51:48.120689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:48.120696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:48.120698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:48.120703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895052564095051:5829] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:48.122013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:48.121277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895052564095051:5829] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:48.123007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895052564095051:5829] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:48.123902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:48.124084Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:48.124096Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:48.124107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:48.124173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:48.124214Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895052474367650:4886]
2025-09-30T14:51:48.124803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:48.125084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:48.125123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:48.125375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:48.125427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:48.125432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:48.125433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:48.125434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:48.125435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:48.125435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:48.125417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895052564095051:5829] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:48.125436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:48.125429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895052564095051:5829] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:48.125437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:48.125444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895052564095051:5829] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:48.125438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:48.125439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:48.125452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 574 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:48.125439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.125440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.125441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.125441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:48.125442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:48.125446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:48.125452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:48.125454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:48.125457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:48.125459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:48.125462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:48.125464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:48.125466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:48.125468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:48.125471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:48.125473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.125475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.125478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.125480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:48.125482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:48.125487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:48.125492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:48.125496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:48.125499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:48.125504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:48.125507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:48.125510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:48.125513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:48.125519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:48.125524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:48.125528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:48.125533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:48.125538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:48.125543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:48.125548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:48.125553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:48.125557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:48.125562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:48.125566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:48.125571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:48.125576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.125581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.125585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.125590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.125594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.125599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.125603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:48.125607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:48.125611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:48.125617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:48.125651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:48.131183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:48.132096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:48.132115Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:48.132118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:48.132122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:48.132129Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 573 [2:7555895052474367650:4886]
2025-09-30T14:51:48.132146Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:48.132161Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:48.132169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.132172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.132175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:48.132193Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:48.132200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:48.132211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:48.132271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.132278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.132280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.132284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:48.132287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:48.132360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:48.132369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.132383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.132394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.132411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:48.132430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895052564094940:2454], now have 1 active actors on pipe
2025-09-30T14:51:48.132440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895052564095091:5829], now have 1 active actors on pipe
2025-09-30T14:51:48.132447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895052474367644:4886]
2025-09-30T14:51:48.132455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895052474367644:4886]
2025-09-30T14:51:48.132458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895052474367644:4886]
2025-09-30T14:51:48.132472Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:48.132487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:48.132499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 573
2025-09-30T14:51:48.132516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 573
2025-09-30T14:51:48.132967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 574 partition: 0 MaxSeqNo: 42 sessionId: src_id|5f615cf5-813266fd-7156937a-afb91980_0
2025-09-30T14:51:48.132495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:48.132502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:48.132504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:48.132506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:48.132506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:48.132541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895052474367644:4886]
2025-09-30T14:51:48.132544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:48.132557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:48.132578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:48.132582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:48.132616Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f615cf5-813266fd-7156937a-afb91980_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:48.132622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.132624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.132626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:48.132633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:48.132641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:48.132663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:48.132859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:48.132863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:48.132879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:48.133325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b20fa1d1-1318bbd5-40959e47-5ae15efa_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5f615cf5-813266fd-7156937a-afb91980_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:48.136344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f615cf5-813266fd-7156937a-afb91980_0] Write session: try to update token
2025-09-30T14:51:48.136363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f615cf5-813266fd-7156937a-afb91980_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:48.144389Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:48.144406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:48.144407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:48.144409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:48.144418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895052474367644:4886]
2025-09-30T14:51:48.144422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895052474367644:4886]
2025-09-30T14:51:48.144426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895052474367644:4886]
2025-09-30T14:51:48.144458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:48.144463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.144464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:48.144470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:48.144476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:48.144480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:48.144600Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:48.150178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 574 sessionId: src_id|5f615cf5-813266fd-7156937a-afb91980_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:48.152925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:48.211401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895052564095101:5419]
2025-09-30T14:51:48.211674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 573, pipe: [1:7555895052564095101:5419]
2025-09-30T14:51:48.251013Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:48.251354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:48.251366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:48.251398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895052564095101:5419], now have 1 active actors on pipe
2025-09-30T14:51:48.251586Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:48.251652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895052564095101:5419]
2025-09-30T14:51:48.251654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:48.251660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:48.251683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:48.251744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 574 reason: error at write: Disconnected sessionId: src_id|5f615cf5-813266fd-7156937a-afb91980_0
2025-09-30T14:51:48.251935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 574 sessionId: src_id|5f615cf5-813266fd-7156937a-afb91980_0 is DEAD
2025-09-30T14:51:48.252085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f615cf5-813266fd-7156937a-afb91980_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:48.252098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f615cf5-813266fd-7156937a-afb91980_0] Write session will restart in 0.009886s
2025-09-30T14:51:48.252122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f615cf5-813266fd-7156937a-afb91980_0] Write session: Do CDS request
2025-09-30T14:51:48.252127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f615cf5-813266fd-7156937a-afb91980_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:48.262833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f615cf5-813266fd-7156937a-afb91980_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:48.262897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:48.262915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 575
2025-09-30T14:51:48.263170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 575 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:48.263205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 575 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:48.263216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=575 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:48.263220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:48.263696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 575 sessionId:  describe result for acl check
2025-09-30T14:51:48.263745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:48.263753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:48.263755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:48.263761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895052564095215:5833] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:48.264323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895052564095215:5833] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:48.265079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:48.266631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895052564095215:5833] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:48.267832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:48.268085Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:48.268098Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:48.268111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:48.268181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:48.268220Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895052474367802:4888]
2025-09-30T14:51:48.268902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:48.269189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:48.269239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:48.269522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895052564095215:5833] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:48.269542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895052564095215:5833] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:48.269546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895052564095215:5833] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:48.269554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 575 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:48.269598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:48.269697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:48.269708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:48.269709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:48.269711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:48.269712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:48.269713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:48.269714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:48.269716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:48.269717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:48.269718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:48.269719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.269721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.269722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.269723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:48.269724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:48.269731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:48.269742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:48.269747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:48.269751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:48.269755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:48.269759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:48.269763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:48.269767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:48.269771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:48.269776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:48.269780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.269784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.269788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.269792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:48.269796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:48.269804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:48.269812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:48.269818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:48.269826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:48.269835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:48.269842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:48.269853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:48.269858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:48.269868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:48.269875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:48.269884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:48.269894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:48.269903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:48.269913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:48.269918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:48.269924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:48.269935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:48.269945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:48.269951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:48.269960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:48.269970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.269980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.269990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.269999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.270008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.270013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.270017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:48.270023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:48.270033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:48.270041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:48.270083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:48.275755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:48.276643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:48.276661Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:48.276664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:48.276668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:48.276676Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 574 [2:7555895052474367802:4888]
2025-09-30T14:51:48.276694Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:48.276713Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:48.276721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.276724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.276726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:48.276743Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:48.276751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:48.276758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:48.276824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.276831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.276834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.276838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:48.276841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:48.276910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:48.276919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.276933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.276946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.276964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:48.276982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895052564095102:2454], now have 1 active actors on pipe
2025-09-30T14:51:48.276985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895052564095254:5833], now have 1 active actors on pipe
2025-09-30T14:51:48.276991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895052474367797:4888]
2025-09-30T14:51:48.276999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895052474367797:4888]
2025-09-30T14:51:48.277001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895052474367797:4888]
2025-09-30T14:51:48.277018Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:48.277028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:48.277031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:48.277033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:48.277036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:48.277052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:48.277060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:48.277098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895052474367797:4888]
2025-09-30T14:51:48.277110Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:48.277126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:48.277106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 574
2025-09-30T14:51:48.277108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 574
2025-09-30T14:51:48.277192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:48.277202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:48.277227Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|772564e2-8eecb58-b2b6e5a9-7b0123bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:48.277236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.277244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.277246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:48.277256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:48.277265Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:48.277280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:48.277442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:48.277449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:48.277462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:48.277568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 575 partition: 0 MaxSeqNo: 42 sessionId: src_id|772564e2-8eecb58-b2b6e5a9-7b0123bb_0
2025-09-30T14:51:48.277982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f615cf5-813266fd-7156937a-afb91980_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|772564e2-8eecb58-b2b6e5a9-7b0123bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:48.280890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|772564e2-8eecb58-b2b6e5a9-7b0123bb_0] Write session: try to update token
2025-09-30T14:51:48.280911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|772564e2-8eecb58-b2b6e5a9-7b0123bb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:48.289838Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:48.289860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:48.289863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:48.289865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:48.289874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895052474367797:4888]
2025-09-30T14:51:48.289879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895052474367797:4888]
2025-09-30T14:51:48.289883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895052474367797:4888]
2025-09-30T14:51:48.289925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:48.289932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:48.289937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.289938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:48.289940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:48.289942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:48.290092Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:48.296311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 575 sessionId: src_id|772564e2-8eecb58-b2b6e5a9-7b0123bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:48.298965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:48.351700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895052564095264:5419]
2025-09-30T14:51:48.351903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 574, pipe: [1:7555895052564095264:5419]
2025-09-30T14:51:48.408195Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:48.408727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:48.408747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:48.408767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895052564095264:5419], now have 1 active actors on pipe
2025-09-30T14:51:48.408994Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:48.409001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:48.409023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895052564095264:5419]
2025-09-30T14:51:48.409058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:48.409130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 575 reason: status is not ok: tablet will be restarted right now sessionId: src_id|772564e2-8eecb58-b2b6e5a9-7b0123bb_0
2025-09-30T14:51:48.409307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 575 sessionId: src_id|772564e2-8eecb58-b2b6e5a9-7b0123bb_0 is DEAD
2025-09-30T14:51:48.409446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|772564e2-8eecb58-b2b6e5a9-7b0123bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:48.409457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|772564e2-8eecb58-b2b6e5a9-7b0123bb_0] Write session will restart in 0.009066s
2025-09-30T14:51:48.409492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|772564e2-8eecb58-b2b6e5a9-7b0123bb_0] Write session: Do CDS request
2025-09-30T14:51:48.409497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|772564e2-8eecb58-b2b6e5a9-7b0123bb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:48.419669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|772564e2-8eecb58-b2b6e5a9-7b0123bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:48.419717Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:48.419733Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 576
2025-09-30T14:51:48.419875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 576 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:48.419913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 576 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:48.419918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=576 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:48.419921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:48.420313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 576 sessionId:  describe result for acl check
2025-09-30T14:51:48.420351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:48.420353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:48.420355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:48.420359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895052564095379:5837] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:48.420930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895052564095379:5837] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:48.421045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:48.423183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895052564095379:5837] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:48.423232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:48.423439Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:48.423453Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:48.423466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:48.423534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:48.423574Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895052474367956:4890]
2025-09-30T14:51:48.424220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:48.424522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:48.424578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:48.424912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:48.425004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:48.425012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:48.425013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:48.425014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:48.425015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:48.425016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:48.425018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:48.425019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:48.425020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:48.425021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:48.425022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.425023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.425024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.425026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:48.425027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:48.425033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:48.425043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:48.425047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:48.425051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:48.425056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:48.425060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:48.425064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:48.425069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:48.425072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:48.425077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:48.425081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.425085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.425089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.425093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:48.425097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:48.425105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:48.425113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:48.425119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:48.425124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:48.425129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:48.425134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:48.425138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:48.425143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:48.425153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:48.425157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:48.425161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:48.425167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:48.425173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:48.425179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:48.425183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:48.425189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:48.425196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:48.425201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:48.425206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:48.425218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:48.425223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.425228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.425232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.425242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.425248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.425253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.425257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:48.425263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:48.425272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:48.425278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:48.425322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:48.425466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895052564095379:5837] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:48.425481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895052564095379:5837] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:48.425484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895052564095379:5837] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:48.425499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 576 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:48.431014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:48.431793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:48.431807Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:48.431809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:48.431812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:48.431817Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 575 [2:7555895052474367956:4890]
2025-09-30T14:51:48.431829Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:48.431841Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:48.431843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.431845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.431847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:48.431858Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:48.431868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:48.431874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:48.431919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.431924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.431926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.431928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:48.431931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:48.431981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:48.431989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.432000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.432006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.432016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:48.432028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895052474367950:4890]
2025-09-30T14:51:48.432030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895052474367950:4890]
2025-09-30T14:51:48.432031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895052474367950:4890]
2025-09-30T14:51:48.432038Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:48.432047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895052564095265:2454], now have 1 active actors on pipe
2025-09-30T14:51:48.432047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:48.432049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:48.432051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:48.432052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895052564095417:5837], now have 1 active actors on pipe
2025-09-30T14:51:48.432056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:48.432065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:48.432067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:48.432092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895052474367950:4890]
2025-09-30T14:51:48.432098Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:48.432119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:48.432118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 575
2025-09-30T14:51:48.432164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 575
2025-09-30T14:51:48.432222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:48.432239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:48.432264Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ef1f582-aa8760ce-ccededf0-d7abd732_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:48.432278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.432286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.432289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:48.432298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:48.432313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:48.432334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:48.432470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:48.432480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:48.432496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:48.432567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 576 partition: 0 MaxSeqNo: 42 sessionId: src_id|2ef1f582-aa8760ce-ccededf0-d7abd732_0
2025-09-30T14:51:48.432873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|772564e2-8eecb58-b2b6e5a9-7b0123bb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2ef1f582-aa8760ce-ccededf0-d7abd732_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:48.435730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ef1f582-aa8760ce-ccededf0-d7abd732_0] Write session: try to update token
2025-09-30T14:51:48.435752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ef1f582-aa8760ce-ccededf0-d7abd732_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:48.443926Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:48.443945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:48.443947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:48.443949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:48.443959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895052474367950:4890]
2025-09-30T14:51:48.443963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895052474367950:4890]
2025-09-30T14:51:48.443967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895052474367950:4890]
2025-09-30T14:51:48.444002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:48.444006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:48.444008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.444011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:48.444012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:48.444016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:48.444150Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:48.450005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 576 sessionId: src_id|2ef1f582-aa8760ce-ccededf0-d7abd732_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:48.452835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:48.509386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895052564095430:5419]
2025-09-30T14:51:48.509665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 575, pipe: [1:7555895052564095430:5419]
2025-09-30T14:51:48.554458Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:48.554763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:48.554774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:48.554807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895052564095430:5419], now have 1 active actors on pipe
2025-09-30T14:51:48.555018Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:48.555045Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:48.555070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895052564095430:5419]
2025-09-30T14:51:48.555095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:48.555165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 576 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2ef1f582-aa8760ce-ccededf0-d7abd732_0
2025-09-30T14:51:48.555333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 576 sessionId: src_id|2ef1f582-aa8760ce-ccededf0-d7abd732_0 is DEAD
2025-09-30T14:51:48.555443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ef1f582-aa8760ce-ccededf0-d7abd732_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:48.555454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ef1f582-aa8760ce-ccededf0-d7abd732_0] Write session will restart in 0.006797s
2025-09-30T14:51:48.555475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ef1f582-aa8760ce-ccededf0-d7abd732_0] Write session: Do CDS request
2025-09-30T14:51:48.555481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ef1f582-aa8760ce-ccededf0-d7abd732_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:48.563691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ef1f582-aa8760ce-ccededf0-d7abd732_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:48.563796Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:48.563825Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 577
2025-09-30T14:51:48.563965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 577 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:48.564007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 577 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:48.564017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=577 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:48.564021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:48.564429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 577 sessionId:  describe result for acl check
2025-09-30T14:51:48.564461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:48.564468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:48.564470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:48.564475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895052564095498:5842] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:48.564990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895052564095498:5842] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:48.566899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895052564095498:5842] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:48.567201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:48.569125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:48.569315Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:48.569333Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:48.569346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:48.569409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:48.569450Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895052474368113:4893]
2025-09-30T14:51:48.569473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895052564095498:5842] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:48.569489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895052564095498:5842] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:48.569492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895052564095498:5842] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:48.569500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 577 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:48.570060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:48.570347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:48.570402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:48.570734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:48.570816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:48.570823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:48.570824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:48.570826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:48.570827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:48.570828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:48.570829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:48.570830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:48.570831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:48.570832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:48.570833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.570834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.570834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.570836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:48.570837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:48.570843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:48.570853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:48.570858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:48.570862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:48.570867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:48.570871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:48.570875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:48.570879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:48.570884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:48.570888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:48.570892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.570896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.570901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.570905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:48.570909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:48.570916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:48.570927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:48.570933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:48.570939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:48.570944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:48.570948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:48.570952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:48.570957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:48.570964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:48.570969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:48.570973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:48.570978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:48.570984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:48.570990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:48.570994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:48.570999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:48.571005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:48.571010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:48.571014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:48.571019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:48.571023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.571031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.571036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.571041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.571046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.571052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.571056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:48.571061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:48.571066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:48.571076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:48.571116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:48.576488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:48.577330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:48.577348Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:48.577352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:48.577356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:48.577362Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 576 [2:7555895052474368113:4893]
2025-09-30T14:51:48.577381Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:48.577402Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:48.577410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.577412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.577415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:48.577429Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:48.577440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:48.577447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:48.577506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.577515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.577518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.577521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:48.577524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:48.577588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:48.577597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.577609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.577620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.577637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:48.577656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895052564095583:5842], now have 1 active actors on pipe
2025-09-30T14:51:48.577664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895052564095431:2454], now have 1 active actors on pipe
2025-09-30T14:51:48.577671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895052474368108:4893]
2025-09-30T14:51:48.577674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895052474368108:4893]
2025-09-30T14:51:48.577676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895052474368108:4893]
2025-09-30T14:51:48.577692Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:48.577710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:48.577714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:48.577719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:48.577722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:48.577729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:48.577732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:48.577723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 576
2025-09-30T14:51:48.577729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 576
2025-09-30T14:51:48.577761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895052474368108:4893]
2025-09-30T14:51:48.577770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:48.577773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:48.577786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:48.577796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:48.577850Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec427789-82fea1f8-1a8c9ac0-e4e5af66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:48.577861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.577865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.577871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:48.577881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:48.577895Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:48.577913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:48.578062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:48.578072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:48.578089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:48.578158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 577 partition: 0 MaxSeqNo: 42 sessionId: src_id|ec427789-82fea1f8-1a8c9ac0-e4e5af66_0
2025-09-30T14:51:48.578493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ef1f582-aa8760ce-ccededf0-d7abd732_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ec427789-82fea1f8-1a8c9ac0-e4e5af66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:48.581255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec427789-82fea1f8-1a8c9ac0-e4e5af66_0] Write session: try to update token
2025-09-30T14:51:48.581279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec427789-82fea1f8-1a8c9ac0-e4e5af66_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:48.589778Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:48.589797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:48.589800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:48.589801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:48.589813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895052474368108:4893]
2025-09-30T14:51:48.589817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895052474368108:4893]
2025-09-30T14:51:48.589821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895052474368108:4893]
2025-09-30T14:51:48.589855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:48.589857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:48.589859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:48.589862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.589862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:48.589863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:48.590002Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:48.595663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 577 sessionId: src_id|ec427789-82fea1f8-1a8c9ac0-e4e5af66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:48.598255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:48.655312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895052564095595:5419]
2025-09-30T14:51:48.655600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 576, pipe: [1:7555895052564095595:5419]
2025-09-30T14:51:48.694922Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:48.695449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:48.695466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:48.695502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895052564095595:5419], now have 1 active actors on pipe
2025-09-30T14:51:48.695724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:48.695765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895052564095595:5419]
2025-09-30T14:51:48.695779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:48.695780Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:48.695782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:48.695844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 577 reason: error at write: Disconnected sessionId: src_id|ec427789-82fea1f8-1a8c9ac0-e4e5af66_0
2025-09-30T14:51:48.696021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 577 sessionId: src_id|ec427789-82fea1f8-1a8c9ac0-e4e5af66_0 is DEAD
2025-09-30T14:51:48.696177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec427789-82fea1f8-1a8c9ac0-e4e5af66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:48.696188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec427789-82fea1f8-1a8c9ac0-e4e5af66_0] Write session will restart in 0.006545s
2025-09-30T14:51:48.696212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec427789-82fea1f8-1a8c9ac0-e4e5af66_0] Write session: Do CDS request
2025-09-30T14:51:48.696222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec427789-82fea1f8-1a8c9ac0-e4e5af66_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:48.703747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec427789-82fea1f8-1a8c9ac0-e4e5af66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:48.703789Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:48.703809Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 578
2025-09-30T14:51:48.703980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 578 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:48.704011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 578 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:48.704023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=578 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:48.704027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:48.704531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 578 sessionId:  describe result for acl check
2025-09-30T14:51:48.704566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:48.704568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:48.704570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:48.704575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895052564095641:5846] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:48.705120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895052564095641:5846] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:48.707341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895052564095641:5846] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:48.707713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:48.709710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:48.709905Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:48.709915Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:48.709926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:48.709977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:48.710014Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895052474368269:4895]
2025-09-30T14:51:48.710016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895052564095641:5846] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:48.710032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895052564095641:5846] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:48.710035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895052564095641:5846] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:48.710044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 578 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:48.710689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:48.711008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:48.711090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:48.711454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:48.711546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:48.711557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:48.711558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:48.711559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:48.711560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:48.711562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:48.711563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:48.711564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:48.711565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:48.711567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:48.711568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.711569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.711570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.711571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:48.711572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:48.711579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:48.711589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:48.711592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:48.711596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:48.711600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:48.711604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:48.711608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:48.711611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:48.711615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:48.711619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:48.711623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.711627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.711630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.711634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:48.711637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:48.711647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:48.711655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:48.711661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:48.711666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:48.711671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:48.711676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:48.711681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:48.711686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:48.711691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:48.711696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:48.711700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:48.711705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:48.711709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:48.711714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:48.711719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:48.711723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:48.711736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:48.711741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:48.711750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:48.711755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:48.711764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.711770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.711778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.711783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.711787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.711792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.711796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:48.711801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:48.711819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:48.711829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:48.711875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:48.717338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:48.718177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:48.718191Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:48.718193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:48.718197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:48.718204Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 577 [2:7555895052474368269:4895]
2025-09-30T14:51:48.718230Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:48.718249Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:48.718253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.718256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.718258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:48.718272Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:48.718284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:48.718295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:48.718348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.718355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.718357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.718360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:48.718363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:48.718426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:48.718444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.718455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.718470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.718491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:48.718511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895052564095749:5846], now have 1 active actors on pipe
2025-09-30T14:51:48.718521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895052564095596:2454], now have 1 active actors on pipe
2025-09-30T14:51:48.718527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895052474368264:4895]
2025-09-30T14:51:48.718529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895052474368264:4895]
2025-09-30T14:51:48.718532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895052474368264:4895]
2025-09-30T14:51:48.718544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:48.718557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:48.718561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:48.718564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:48.718566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:48.718572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:48.718575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:48.718601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895052474368264:4895]
2025-09-30T14:51:48.718610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:48.718619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:48.718601Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 577
2025-09-30T14:51:48.718607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 577
2025-09-30T14:51:48.718669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:48.718678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:48.718703Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5134bcc-1446c130-4bbf1518-b8673499_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:48.718713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.718720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.718723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:48.718731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:48.718744Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:48.718756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:48.718928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:48.718935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:48.718947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:48.719021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 578 partition: 0 MaxSeqNo: 42 sessionId: src_id|a5134bcc-1446c130-4bbf1518-b8673499_0
2025-09-30T14:51:48.719392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec427789-82fea1f8-1a8c9ac0-e4e5af66_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a5134bcc-1446c130-4bbf1518-b8673499_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:48.722150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5134bcc-1446c130-4bbf1518-b8673499_0] Write session: try to update token
2025-09-30T14:51:48.722168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5134bcc-1446c130-4bbf1518-b8673499_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:48.730932Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:48.730947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:48.730949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:48.730950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:48.730960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895052474368264:4895]
2025-09-30T14:51:48.730963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895052474368264:4895]
2025-09-30T14:51:48.730966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895052474368264:4895]
2025-09-30T14:51:48.730997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:48.731002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.731003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:48.731013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:48.731023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:48.731028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:48.731121Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:48.736187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 578 sessionId: src_id|a5134bcc-1446c130-4bbf1518-b8673499_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:48.738766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:48.796060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895052564095761:5419]
2025-09-30T14:51:48.796301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 577, pipe: [1:7555895052564095761:5419]
2025-09-30T14:51:48.840688Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:48.841185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:48.841202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:48.841252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895052564095761:5419], now have 1 active actors on pipe
2025-09-30T14:51:48.841458Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:48.841470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:48.841482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895052564095761:5419]
2025-09-30T14:51:48.841488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:48.841502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:48.841549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 578 reason: error at write: Disconnected sessionId: src_id|a5134bcc-1446c130-4bbf1518-b8673499_0
2025-09-30T14:51:48.841712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 578 sessionId: src_id|a5134bcc-1446c130-4bbf1518-b8673499_0 is DEAD
2025-09-30T14:51:48.841870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5134bcc-1446c130-4bbf1518-b8673499_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:48.841881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5134bcc-1446c130-4bbf1518-b8673499_0] Write session will restart in 0.008148s
2025-09-30T14:51:48.841904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5134bcc-1446c130-4bbf1518-b8673499_0] Write session: Do CDS request
2025-09-30T14:51:48.841909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5134bcc-1446c130-4bbf1518-b8673499_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:48.850709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5134bcc-1446c130-4bbf1518-b8673499_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:48.850792Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:48.850806Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 579
2025-09-30T14:51:48.850928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 579 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:48.850961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 579 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:48.850969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=579 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:48.850973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:48.851476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 579 sessionId:  describe result for acl check
2025-09-30T14:51:48.851510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:48.851525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:48.851527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:48.851532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895052564095823:5850] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:48.852075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895052564095823:5850] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:48.854134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895052564095823:5850] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:48.854278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:48.856145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:48.856320Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:48.856333Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:48.856343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:48.856389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:48.856423Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895052474368426:4897]
2025-09-30T14:51:48.856533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895052564095823:5850] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:48.856545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895052564095823:5850] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:48.856548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895052564095823:5850] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:48.856555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 579 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:48.857041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:48.857288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:48.857329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:48.857640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:48.857704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:48.857710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:48.857711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:48.857712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:48.857713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:48.857715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:48.857716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:48.857717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:48.857718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:48.857719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:48.857720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.857721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.857723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.857724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:48.857725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:48.857729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:48.857740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:48.857744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:48.857748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:48.857753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:48.857757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:48.857761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:48.857765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:48.857769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:48.857773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:48.857777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.857781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.857785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.857788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:48.857792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:48.857800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:48.857817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:48.857823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:48.857829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:48.857833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:48.857838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:48.857843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:48.857848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:48.857852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:48.857863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:48.857867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:48.857873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:48.857878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:48.857883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:48.857889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:48.857894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:48.857900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:48.857904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:48.857908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:48.857913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:48.857917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.857921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.857928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.857934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.857939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.857944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.857948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:48.857958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:48.857962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:48.857968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:48.858012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:48.863218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:48.864356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:48.864369Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:48.864371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:48.864375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:48.864381Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 578 [2:7555895052474368426:4897]
2025-09-30T14:51:48.864395Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:48.864410Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:48.864413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.864416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.864419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:48.864433Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:48.864444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:48.864451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:48.864506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.864513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.864515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.864519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:48.864521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:48.864581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:48.864589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.864601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:48.864614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:48.864631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:48.864650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895052564095916:5850], now have 1 active actors on pipe
2025-09-30T14:51:48.864657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895052564095762:2454], now have 1 active actors on pipe
2025-09-30T14:51:48.864663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895052474368421:4897]
2025-09-30T14:51:48.864665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895052474368421:4897]
2025-09-30T14:51:48.864667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895052474368421:4897]
2025-09-30T14:51:48.864678Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:48.864695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:48.864699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:48.864702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:48.864688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 578
2025-09-30T14:51:48.864704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:48.864709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:48.864699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 578
2025-09-30T14:51:48.864711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:48.864737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895052474368421:4897]
2025-09-30T14:51:48.864746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:48.864757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:48.864759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:48.864764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:48.864811Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee1d2531-61c5c89d-a3507c4e-9fe8812c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:48.864822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.864827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.864828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:48.864838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:48.864850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:48.864867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:48.865021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:48.865030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:48.865042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:48.865131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 579 partition: 0 MaxSeqNo: 42 sessionId: src_id|ee1d2531-61c5c89d-a3507c4e-9fe8812c_0
2025-09-30T14:51:48.865517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5134bcc-1446c130-4bbf1518-b8673499_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ee1d2531-61c5c89d-a3507c4e-9fe8812c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:48.868342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee1d2531-61c5c89d-a3507c4e-9fe8812c_0] Write session: try to update token
2025-09-30T14:51:48.868361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee1d2531-61c5c89d-a3507c4e-9fe8812c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:48.876379Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:48.876398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:48.876401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:48.876403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:48.876413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895052474368421:4897]
2025-09-30T14:51:48.876417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895052474368421:4897]
2025-09-30T14:51:48.876421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895052474368421:4897]
2025-09-30T14:51:48.876460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:48.876468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:48.876471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:48.876475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:48.876483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:48.876486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:48.876612Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:48.882224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 579 sessionId: src_id|ee1d2531-61c5c89d-a3507c4e-9fe8812c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:48.884947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:48.941489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895052564095952:5419]
2025-09-30T14:51:48.941814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 578, pipe: [1:7555895052564095952:5419]
2025-09-30T14:51:48.985690Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:48.985944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:48.985956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:48.985987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895052564095952:5419], now have 1 active actors on pipe
2025-09-30T14:51:48.986150Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:48.986174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:48.986184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895052564095952:5419]
2025-09-30T14:51:48.986191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:48.986200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:48.986379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 579 reason: error at write: Disconnected sessionId: src_id|ee1d2531-61c5c89d-a3507c4e-9fe8812c_0
2025-09-30T14:51:48.986584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 579 sessionId: src_id|ee1d2531-61c5c89d-a3507c4e-9fe8812c_0 is DEAD
2025-09-30T14:51:48.986747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee1d2531-61c5c89d-a3507c4e-9fe8812c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:48.986755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee1d2531-61c5c89d-a3507c4e-9fe8812c_0] Write session will restart in 0.006707s
2025-09-30T14:51:48.986776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee1d2531-61c5c89d-a3507c4e-9fe8812c_0] Write session: Do CDS request
2025-09-30T14:51:48.986782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee1d2531-61c5c89d-a3507c4e-9fe8812c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:48.994720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee1d2531-61c5c89d-a3507c4e-9fe8812c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:48.994808Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:48.994824Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 580
2025-09-30T14:51:48.994964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 580 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:48.995005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 580 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:48.995017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=580 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:48.995021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:48.995479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 580 sessionId:  describe result for acl check
2025-09-30T14:51:48.995518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:48.995525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:48.995527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:48.995532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895052564096057:5864] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:48.996058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895052564096057:5864] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:48.997522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:48.998170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895052564096057:5864] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:48.999303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:48.999491Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:48.999505Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:48.999517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:48.999588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:48.999629Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895052474368633:4912]
2025-09-30T14:51:49.000267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:49.000345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895052564096057:5864] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:49.000365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895052564096057:5864] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:49.000369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895052564096057:5864] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:49.000376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 580 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:49.000559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:49.000624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:49.000973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:49.001050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:49.001057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:49.001058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:49.001059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:49.001060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:49.001062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:49.001063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:49.001064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:49.001065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:49.001066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:49.001067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.001068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.001069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.001071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:49.001072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:49.001078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:49.001088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:49.001093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:49.001098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:49.001102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:49.001107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:49.001111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:49.001116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:49.001120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:49.001125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:49.001130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.001135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.001139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.001143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:49.001147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:49.001155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:49.001163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:49.001169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:49.001175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:49.001180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:49.001185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:49.001189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:49.001195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:49.001200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:49.001205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:49.001210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:49.001215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:49.001226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:49.001232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:49.001240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:49.001247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:49.001256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:49.001262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:49.001268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:49.001274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:49.001283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.001289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.001299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.001304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.001313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.001318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.001329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:49.001333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:49.001337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:49.001345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:49.001389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:49.006579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:49.007820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:49.007839Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:49.007841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:49.007845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:49.007851Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 579 [2:7555895052474368633:4912]
2025-09-30T14:51:49.007865Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:49.007878Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:49.007881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.007884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.007886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.007898Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:49.007905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:49.007916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:49.007973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.007981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.007983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.007986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:49.007989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:49.008052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:49.008061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.008075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.008095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.008114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:49.008130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895052564095970:2454], now have 1 active actors on pipe
2025-09-30T14:51:49.008141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895056859063423:5864], now have 1 active actors on pipe
2025-09-30T14:51:49.008146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895052474368627:4912]
2025-09-30T14:51:49.008149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895052474368627:4912]
2025-09-30T14:51:49.008151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895052474368627:4912]
2025-09-30T14:51:49.008164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:49.008182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:49.008182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:49.008188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:49.008190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:49.008200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:49.008203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:49.008161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 579
2025-09-30T14:51:49.008174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 579
2025-09-30T14:51:49.008246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:49.008269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:49.008286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895052474368627:4912]
2025-09-30T14:51:49.008295Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:49.008323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:49.008327Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8138bacc-1b8a84ac-3fe93762-63da5c93_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:49.008333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.008337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.008339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:49.008348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.008357Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:49.008377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:49.008509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:49.008518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:49.008534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:49.008645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 580 partition: 0 MaxSeqNo: 42 sessionId: src_id|8138bacc-1b8a84ac-3fe93762-63da5c93_0
2025-09-30T14:51:49.009003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee1d2531-61c5c89d-a3507c4e-9fe8812c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8138bacc-1b8a84ac-3fe93762-63da5c93_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:49.011634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8138bacc-1b8a84ac-3fe93762-63da5c93_0] Write session: try to update token
2025-09-30T14:51:49.011649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8138bacc-1b8a84ac-3fe93762-63da5c93_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:49.020093Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:49.020113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:49.020116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:49.020118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:49.020127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895052474368627:4912]
2025-09-30T14:51:49.020131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895052474368627:4912]
2025-09-30T14:51:49.020135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895052474368627:4912]
2025-09-30T14:51:49.020174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:49.020177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:49.020180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.020182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:49.020184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:49.020188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:49.020316Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:49.025357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 580 sessionId: src_id|8138bacc-1b8a84ac-3fe93762-63da5c93_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:49.028007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:49.086385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895056859063435:5419]
2025-09-30T14:51:49.086721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 579, pipe: [1:7555895056859063435:5419]
2025-09-30T14:51:49.123482Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:49.123726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:49.123740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:49.123773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895056859063435:5419], now have 1 active actors on pipe
2025-09-30T14:51:49.123949Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:49.123990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:49.124011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:49.124019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:49.124056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895056859063435:5419]
2025-09-30T14:51:49.124174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 580 reason: error at write: Disconnected sessionId: src_id|8138bacc-1b8a84ac-3fe93762-63da5c93_0
2025-09-30T14:51:49.124373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 580 sessionId: src_id|8138bacc-1b8a84ac-3fe93762-63da5c93_0 is DEAD
2025-09-30T14:51:49.124514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8138bacc-1b8a84ac-3fe93762-63da5c93_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:49.124525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8138bacc-1b8a84ac-3fe93762-63da5c93_0] Write session will restart in 0.005837s
2025-09-30T14:51:49.124548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8138bacc-1b8a84ac-3fe93762-63da5c93_0] Write session: Do CDS request
2025-09-30T14:51:49.124557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8138bacc-1b8a84ac-3fe93762-63da5c93_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:49.131776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8138bacc-1b8a84ac-3fe93762-63da5c93_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:49.131863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:49.131881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 581
2025-09-30T14:51:49.132005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 581 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:49.132035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 581 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:49.132046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=581 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:49.132050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:49.132537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 581 sessionId:  describe result for acl check
2025-09-30T14:51:49.132570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:49.132577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:49.132579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:49.132584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895056859063475:5868] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:49.133144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895056859063475:5868] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:49.135583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895056859063475:5868] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:49.137267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:49.139198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:49.139437Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:49.139447Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:49.139455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:49.139500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:49.139535Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895056769336091:4915]
2025-09-30T14:51:49.139609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895056859063475:5868] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:49.139626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895056859063475:5868] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:49.139628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895056859063475:5868] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:49.139635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 581 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:49.139987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:49.140245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:49.140278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:49.140512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:49.140559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:49.140564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:49.140565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:49.140566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:49.140567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:49.140567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:49.140568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:49.140570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:49.140570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:49.140571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:49.140572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.140573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.140573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.140574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:49.140575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:49.140578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:49.140586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:49.140588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:49.140590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:49.140592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:49.140595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:49.140597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:49.140600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:49.140602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:49.140605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:49.140607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.140609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.140611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.140613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:49.140616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:49.140623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:49.140628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:49.140633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:49.140636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:49.140639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:49.140642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:49.140645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:49.140648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:49.140660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:49.140666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:49.140670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:49.140675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:49.140680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:49.140685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:49.140691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:49.140695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:49.140700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:49.140702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:49.140706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:49.140710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:49.140713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.140716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.140718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.140721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.140723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.140726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.140728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:49.140731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:49.140734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:49.140736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:49.140760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:49.146013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:49.147011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:49.147024Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:49.147026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:49.147029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:49.147035Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 580 [2:7555895056769336091:4915]
2025-09-30T14:51:49.147046Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:49.147059Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:49.147063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.147066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.147068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.147083Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:49.147090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:49.147096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:49.147140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.147148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.147149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.147152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:49.147154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:49.147214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:49.147221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.147234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.147267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.147289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:49.147311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895056859063436:2454], now have 1 active actors on pipe
2025-09-30T14:51:49.147319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895056859063592:5868], now have 1 active actors on pipe
2025-09-30T14:51:49.147326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895056769336086:4915]
2025-09-30T14:51:49.147333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895056769336086:4915]
2025-09-30T14:51:49.147336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895056769336086:4915]
2025-09-30T14:51:49.147351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:49.147368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:49.147374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:49.147385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:49.147386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:49.147387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:49.147389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:49.147383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 580
2025-09-30T14:51:49.147387Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 580
2025-09-30T14:51:49.147424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895056769336086:4915]
2025-09-30T14:51:49.147436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:49.147436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:49.147459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:49.147467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:49.147510Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60b1b5e8-aabea388-a8121f60-228a22f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:49.147521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.147524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.147526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:49.147536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.147544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:49.147559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:49.147710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:49.147721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:49.147737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:49.147814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 581 partition: 0 MaxSeqNo: 42 sessionId: src_id|60b1b5e8-aabea388-a8121f60-228a22f3_0
2025-09-30T14:51:49.148178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8138bacc-1b8a84ac-3fe93762-63da5c93_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|60b1b5e8-aabea388-a8121f60-228a22f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:49.150946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60b1b5e8-aabea388-a8121f60-228a22f3_0] Write session: try to update token
2025-09-30T14:51:49.150962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60b1b5e8-aabea388-a8121f60-228a22f3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:49.159005Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:49.159023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:49.159025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:49.159026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:49.159034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895056769336086:4915]
2025-09-30T14:51:49.159038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895056769336086:4915]
2025-09-30T14:51:49.159041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895056769336086:4915]
2025-09-30T14:51:49.159076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:49.159082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.159083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:49.159083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:49.159088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:49.159091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:49.159216Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:49.165955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 581 sessionId: src_id|60b1b5e8-aabea388-a8121f60-228a22f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:49.168712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:49.224131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895056859063603:5419]
2025-09-30T14:51:49.224353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 580, pipe: [1:7555895056859063603:5419]
2025-09-30T14:51:49.261368Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:49.261658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:49.261670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:49.261687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895056859063603:5419], now have 1 active actors on pipe
2025-09-30T14:51:49.261861Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:49.261947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895056859063603:5419]
2025-09-30T14:51:49.261954Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:49.261981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:49.262048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 581 reason: status is not ok: tablet will be restarted right now sessionId: src_id|60b1b5e8-aabea388-a8121f60-228a22f3_0
2025-09-30T14:51:49.262241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 581 sessionId: src_id|60b1b5e8-aabea388-a8121f60-228a22f3_0 is DEAD
2025-09-30T14:51:49.262360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60b1b5e8-aabea388-a8121f60-228a22f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:49.262371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60b1b5e8-aabea388-a8121f60-228a22f3_0] Write session will restart in 0.007751s
2025-09-30T14:51:49.262393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60b1b5e8-aabea388-a8121f60-228a22f3_0] Write session: Do CDS request
2025-09-30T14:51:49.262400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60b1b5e8-aabea388-a8121f60-228a22f3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:49.271786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60b1b5e8-aabea388-a8121f60-228a22f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:49.271853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:49.271872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 582
2025-09-30T14:51:49.272029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 582 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:49.272062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 582 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:49.272073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=582 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:49.272077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:49.272463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 582 sessionId:  describe result for acl check
2025-09-30T14:51:49.272501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:49.272512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:49.272514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:49.272520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895056859063713:5872] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:49.273077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895056859063713:5872] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:49.274404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:49.275205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895056859063713:5872] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:49.276581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:49.276836Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:49.276849Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:49.276862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:49.276921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:49.276955Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895056769336250:4917]
2025-09-30T14:51:49.277458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895056859063713:5872] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:49.277474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895056859063713:5872] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:49.277477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895056859063713:5872] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:49.277485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 582 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:49.277566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:49.277797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:49.277842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:49.278311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:49.278377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:49.278384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:49.278385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:49.278387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:49.278388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:49.278389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:49.278391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:49.278392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:49.278393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:49.278395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:49.278396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.278397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.278398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.278400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:49.278401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:49.278406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:49.278417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:49.278421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:49.278425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:49.278428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:49.278442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:49.278445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:49.278447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:49.278449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:49.278452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:49.278454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.278457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.278459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.278462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:49.278464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:49.278469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:49.278475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:49.278479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:49.278483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:49.278487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:49.278490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:49.278493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:49.278496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:49.278499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:49.278502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:49.278505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:49.278508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:49.278511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:49.278514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:49.278516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:49.278519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:49.278523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:49.278526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:49.278529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:49.278532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:49.278534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.278537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.278539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.278542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.278544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.278547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.278550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:49.278552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:49.278554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:49.278557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:49.278594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:49.283785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:49.284764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:49.284783Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:49.284786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:49.284790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:49.284801Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 581 [2:7555895056769336250:4917]
2025-09-30T14:51:49.284818Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:49.284832Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:49.284836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.284840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.284843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.284858Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:49.284864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:49.284872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:49.284931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.284939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.284941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.284944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:49.284947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:49.285017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:49.285025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.285040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.285052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.285070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:49.285089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895056859063604:2454], now have 1 active actors on pipe
2025-09-30T14:51:49.285100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895056859063761:5872], now have 1 active actors on pipe
2025-09-30T14:51:49.285106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895056769336245:4917]
2025-09-30T14:51:49.285109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895056769336245:4917]
2025-09-30T14:51:49.285111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895056769336245:4917]
2025-09-30T14:51:49.285127Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:49.285140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:49.285151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:49.285153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:49.285156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:49.285162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:49.285165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:49.285190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895056769336245:4917]
2025-09-30T14:51:49.285198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:49.285200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:49.285175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 581
2025-09-30T14:51:49.285179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 581
2025-09-30T14:51:49.285224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:49.285235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:49.285268Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f35dfe80-e6f3b3b8-47cf2d76-4bd25411_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:49.285280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.285283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.285285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:49.285296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.285309Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:49.285326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:49.285451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:49.285458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:49.285472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:49.285542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 582 partition: 0 MaxSeqNo: 42 sessionId: src_id|f35dfe80-e6f3b3b8-47cf2d76-4bd25411_0
2025-09-30T14:51:49.285887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60b1b5e8-aabea388-a8121f60-228a22f3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f35dfe80-e6f3b3b8-47cf2d76-4bd25411_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:49.288662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f35dfe80-e6f3b3b8-47cf2d76-4bd25411_0] Write session: try to update token
2025-09-30T14:51:49.288682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f35dfe80-e6f3b3b8-47cf2d76-4bd25411_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:49.296732Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:49.296753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:49.296755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:49.296758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:49.296767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895056769336245:4917]
2025-09-30T14:51:49.296772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895056769336245:4917]
2025-09-30T14:51:49.296776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895056769336245:4917]
2025-09-30T14:51:49.296813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:49.296828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.296835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:49.296837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:49.296847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:49.296859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:49.296966Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:49.303735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 582 sessionId: src_id|f35dfe80-e6f3b3b8-47cf2d76-4bd25411_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:49.306461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:49.362385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895056859063773:5419]
2025-09-30T14:51:49.362674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 581, pipe: [1:7555895056859063773:5419]
2025-09-30T14:51:49.401632Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:49.401923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:49.401934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:49.401950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895056859063773:5419], now have 1 active actors on pipe
2025-09-30T14:51:49.402215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895056859063773:5419]
2025-09-30T14:51:49.402215Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:49.402250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:49.402253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:49.402315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 582 reason: error at write: Disconnected sessionId: src_id|f35dfe80-e6f3b3b8-47cf2d76-4bd25411_0
2025-09-30T14:51:49.402320Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:49.402533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 582 sessionId: src_id|f35dfe80-e6f3b3b8-47cf2d76-4bd25411_0 is DEAD
2025-09-30T14:51:49.402659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f35dfe80-e6f3b3b8-47cf2d76-4bd25411_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:49.402671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f35dfe80-e6f3b3b8-47cf2d76-4bd25411_0] Write session will restart in 0.006314s
2025-09-30T14:51:49.402692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f35dfe80-e6f3b3b8-47cf2d76-4bd25411_0] Write session: Do CDS request
2025-09-30T14:51:49.402697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f35dfe80-e6f3b3b8-47cf2d76-4bd25411_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:49.409749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f35dfe80-e6f3b3b8-47cf2d76-4bd25411_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:49.409897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:49.409913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 583
2025-09-30T14:51:49.410036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 583 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:49.410082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 583 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:49.410092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=583 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:49.410096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:49.410553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 583 sessionId:  describe result for acl check
2025-09-30T14:51:49.410585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:49.410591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:49.410592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:49.410596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895056859063809:5876] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:49.411030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895056859063809:5876] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:49.413179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895056859063809:5876] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:49.414878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:49.416959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:49.417181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895056859063809:5876] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:49.417199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895056859063809:5876] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:49.417203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895056859063809:5876] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:49.417210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 583 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:49.417235Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:49.417247Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:49.417258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:49.417317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:49.417358Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895056769336412:4919]
2025-09-30T14:51:49.417783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:49.418032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:49.418061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:49.418266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:49.418303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:49.418307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:49.418308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:49.418309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:49.418309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:49.418310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:49.418311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:49.418311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:49.418312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:49.418313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:49.418313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.418314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.418315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.418315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:49.418316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:49.418319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:49.418325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:49.418328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:49.418330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:49.418332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:49.418335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:49.418337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:49.418339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:49.418342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:49.418344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:49.418346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.418349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.418351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.418353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:49.418355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:49.418360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:49.418365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:49.418369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:49.418372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:49.418375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:49.418379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:49.418382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:49.418385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:49.418387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:49.418390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:49.418393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:49.418396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:49.418398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:49.418401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:49.418404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:49.418407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:49.418410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:49.418413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:49.418415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:49.418418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:49.418421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.418424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.418427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.418442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.418446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.418448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.418451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:49.418453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:49.418457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:49.418461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:49.418500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:49.423760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:49.424773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:49.424787Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:49.424789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:49.424792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:49.424796Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 582 [2:7555895056769336412:4919]
2025-09-30T14:51:49.424806Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:49.424818Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:49.424821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.424823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.424824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.424836Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:49.424840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:49.424846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:49.424891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.424897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.424898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.424900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:49.424902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:49.424951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:49.424961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.424972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.424985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.424996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:49.425014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895056859063932:5876], now have 1 active actors on pipe
2025-09-30T14:51:49.425021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895056859063774:2454], now have 1 active actors on pipe
2025-09-30T14:51:49.425025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895056769336407:4919]
2025-09-30T14:51:49.425027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895056769336407:4919]
2025-09-30T14:51:49.425028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895056769336407:4919]
2025-09-30T14:51:49.425037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:49.425047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:49.425060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:49.425061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:49.425064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:49.425064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:49.425066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:49.425088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895056769336407:4919]
2025-09-30T14:51:49.425096Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:49.425116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:49.425128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:49.425096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 582
2025-09-30T14:51:49.425133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:49.425157Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14d6f550-b7dfd2e3-32172701-aade54f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:49.425097Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 582
2025-09-30T14:51:49.425164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.425167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.425169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:49.425178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.425192Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:49.425204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:49.425350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:49.425364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:49.425385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:49.425478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 583 partition: 0 MaxSeqNo: 42 sessionId: src_id|14d6f550-b7dfd2e3-32172701-aade54f6_0
2025-09-30T14:51:49.425839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f35dfe80-e6f3b3b8-47cf2d76-4bd25411_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|14d6f550-b7dfd2e3-32172701-aade54f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:49.428603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14d6f550-b7dfd2e3-32172701-aade54f6_0] Write session: try to update token
2025-09-30T14:51:49.428620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14d6f550-b7dfd2e3-32172701-aade54f6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:49.437184Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:49.437206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:49.437208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:49.437210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:49.437219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895056769336407:4919]
2025-09-30T14:51:49.437225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895056769336407:4919]
2025-09-30T14:51:49.437228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895056769336407:4919]
2025-09-30T14:51:49.437268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:49.437275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.437275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:49.437278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:49.437281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:49.437285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:49.437421Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:49.442786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 583 sessionId: src_id|14d6f550-b7dfd2e3-32172701-aade54f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:49.445647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:49.502139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895056859063946:5419]
2025-09-30T14:51:49.502427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 582, pipe: [1:7555895056859063946:5419]
2025-09-30T14:51:49.546024Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:49.546392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:49.546414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:49.546473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895056859063946:5419], now have 1 active actors on pipe
2025-09-30T14:51:49.546743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:49.546750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:49.546766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:49.546804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895056859063946:5419]
2025-09-30T14:51:49.546826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 583 reason: error at write: Disconnected sessionId: src_id|14d6f550-b7dfd2e3-32172701-aade54f6_0
2025-09-30T14:51:49.546844Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:49.547029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 583 sessionId: src_id|14d6f550-b7dfd2e3-32172701-aade54f6_0 is DEAD
2025-09-30T14:51:49.547189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14d6f550-b7dfd2e3-32172701-aade54f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:49.547200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14d6f550-b7dfd2e3-32172701-aade54f6_0] Write session will restart in 0.006059s
2025-09-30T14:51:49.547223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14d6f550-b7dfd2e3-32172701-aade54f6_0] Write session: Do CDS request
2025-09-30T14:51:49.547270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14d6f550-b7dfd2e3-32172701-aade54f6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:49.554761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14d6f550-b7dfd2e3-32172701-aade54f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:49.554830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:49.554848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 584
2025-09-30T14:51:49.555000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 584 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:49.555031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 584 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:49.555040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=584 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:49.555049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:49.555503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 584 sessionId:  describe result for acl check
2025-09-30T14:51:49.555534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:49.555541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:49.555543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:49.555548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895056859064005:5881] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:49.556023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895056859064005:5881] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:49.557744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895056859064005:5881] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:49.558527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:49.560413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:49.560577Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:49.560588Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:49.560570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895056859064005:5881] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:49.560599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:49.560585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895056859064005:5881] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:49.560587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895056859064005:5881] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:49.560592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 584 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:49.560646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:49.560679Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895056769336577:4922]
2025-09-30T14:51:49.561289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:49.561599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:49.561643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:49.561949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:49.562008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:49.562013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:49.562014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:49.562015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:49.562017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:49.562018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:49.562019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:49.562020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:49.562021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:49.562022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:49.562024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.562025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.562026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.562027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:49.562028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:49.562033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:49.562043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:49.562047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:49.562050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:49.562054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:49.562058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:49.562063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:49.562066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:49.562070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:49.562081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:49.562089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.562094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.562101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.562106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:49.562114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:49.562121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:49.562129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:49.562139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:49.562148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:49.562153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:49.562158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:49.562166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:49.562172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:49.562181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:49.562186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:49.562194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:49.562203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:49.562210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:49.562219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:49.562228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:49.562236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:49.562245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:49.562254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:49.562262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:49.562268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:49.562276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.562285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.562294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.562298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.562307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.562316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.562324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:49.562329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:49.562334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:49.562339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:49.562382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:49.567433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:49.568440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:49.568457Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:49.568459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:49.568462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:49.568468Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 583 [2:7555895056769336577:4922]
2025-09-30T14:51:49.568483Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:49.568498Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:49.568506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.568509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.568511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.568525Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:49.568531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:49.568542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:49.568603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.568610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.568612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.568615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:49.568618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:49.568676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:49.568683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.568694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.568705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.568727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:49.568747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895056859063947:2454], now have 1 active actors on pipe
2025-09-30T14:51:49.568755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895056859064109:5881], now have 1 active actors on pipe
2025-09-30T14:51:49.568761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895056769336571:4922]
2025-09-30T14:51:49.568767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895056769336571:4922]
2025-09-30T14:51:49.568770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895056769336571:4922]
2025-09-30T14:51:49.568781Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:49.568797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:49.568797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:49.568801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:49.568803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:49.568815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:49.568818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:49.568794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 583
2025-09-30T14:51:49.568806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 583
2025-09-30T14:51:49.568845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895056769336571:4922]
2025-09-30T14:51:49.568856Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:49.568862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:49.568874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:49.568883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:49.568921Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ce3a6d5-11ff9d96-506fb4d0-fb67a46e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:49.568931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.568935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.568937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:49.568946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.568955Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:49.568974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:49.569128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:49.569137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:49.569153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:49.569228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 584 partition: 0 MaxSeqNo: 42 sessionId: src_id|1ce3a6d5-11ff9d96-506fb4d0-fb67a46e_0
2025-09-30T14:51:49.569553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14d6f550-b7dfd2e3-32172701-aade54f6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1ce3a6d5-11ff9d96-506fb4d0-fb67a46e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:49.572373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ce3a6d5-11ff9d96-506fb4d0-fb67a46e_0] Write session: try to update token
2025-09-30T14:51:49.572391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ce3a6d5-11ff9d96-506fb4d0-fb67a46e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:49.581196Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:49.581219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:49.581221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:49.581223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:49.581232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895056769336571:4922]
2025-09-30T14:51:49.581236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895056769336571:4922]
2025-09-30T14:51:49.581239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895056769336571:4922]
2025-09-30T14:51:49.581277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:49.581284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.581287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:49.581295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:49.581301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:49.581304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:49.581415Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:49.586736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 584 sessionId: src_id|1ce3a6d5-11ff9d96-506fb4d0-fb67a46e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:49.589424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:49.647049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895056859064121:5419]
2025-09-30T14:51:49.647342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 583, pipe: [1:7555895056859064121:5419]
2025-09-30T14:51:49.685812Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:49.686142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:49.686158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:49.686190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895056859064121:5419], now have 1 active actors on pipe
2025-09-30T14:51:49.686407Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:49.686413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895056859064121:5419]
2025-09-30T14:51:49.686438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:49.686442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:49.686472Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:49.686518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 584 reason: error at write: Disconnected sessionId: src_id|1ce3a6d5-11ff9d96-506fb4d0-fb67a46e_0
2025-09-30T14:51:49.686695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 584 sessionId: src_id|1ce3a6d5-11ff9d96-506fb4d0-fb67a46e_0 is DEAD
2025-09-30T14:51:49.686845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ce3a6d5-11ff9d96-506fb4d0-fb67a46e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:49.686854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ce3a6d5-11ff9d96-506fb4d0-fb67a46e_0] Write session will restart in 0.008452s
2025-09-30T14:51:49.686871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ce3a6d5-11ff9d96-506fb4d0-fb67a46e_0] Write session: Do CDS request
2025-09-30T14:51:49.686875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ce3a6d5-11ff9d96-506fb4d0-fb67a46e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:49.696701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ce3a6d5-11ff9d96-506fb4d0-fb67a46e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:49.696804Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:49.696819Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 585
2025-09-30T14:51:49.696953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 585 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:49.696985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 585 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:49.696993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=585 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:49.696996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:49.697364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 585 sessionId:  describe result for acl check
2025-09-30T14:51:49.697396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:49.697404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:49.697405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:49.697411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895056859064244:5885] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:49.697929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895056859064244:5885] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:49.698789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:49.699947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895056859064244:5885] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:49.700599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:49.700763Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:49.700773Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:49.700784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:49.700832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:49.700873Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895056769336741:4924]
2025-09-30T14:51:49.701287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:49.701539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:49.701577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:49.701845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:49.701912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:49.701918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:49.701919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:49.701919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:49.701921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:49.701922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:49.701923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:49.701924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:49.701925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:49.701926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:49.701927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.701928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.701929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.701930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:49.701932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:49.701936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:49.701946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:49.701950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:49.701954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:49.701958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:49.701961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:49.701965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:49.701968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:49.701971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:49.701975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:49.701979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.701984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.701988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.701992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:49.701996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:49.702005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:49.702011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:49.702015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:49.702018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:49.702021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:49.702024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:49.702026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:49.702029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:49.702032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:49.702035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:49.702037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:49.702040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:49.702043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:49.702045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:49.702048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:49.702051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:49.702055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:49.702058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:49.702063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:49.702068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:49.702073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.702078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.702082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.702086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.702090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.702094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.702098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:49.702104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:49.702109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:49.702114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:49.702152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:49.702412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895056859064244:5885] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:49.702441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895056859064244:5885] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:49.702444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895056859064244:5885] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:49.702451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 585 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:49.707231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:49.708215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:49.708228Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:49.708230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:49.708233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:49.708237Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 584 [2:7555895056769336741:4924]
2025-09-30T14:51:49.708246Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:49.708258Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:49.708260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.708262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.708263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.708273Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:49.708277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:49.708283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:49.708330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.708336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.708337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.708339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:49.708341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:49.708390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:49.708396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.708407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.708425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.708442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:49.708458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895056859064122:2454], now have 1 active actors on pipe
2025-09-30T14:51:49.708465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895056859064287:5885], now have 1 active actors on pipe
2025-09-30T14:51:49.708469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895056769336736:4924]
2025-09-30T14:51:49.708471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895056769336736:4924]
2025-09-30T14:51:49.708472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895056769336736:4924]
2025-09-30T14:51:49.708486Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:49.708499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:49.708506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:49.708510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:49.708513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:49.708520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:49.708523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:49.708548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895056769336736:4924]
2025-09-30T14:51:49.708559Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:49.708566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:49.708569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 584
2025-09-30T14:51:49.708572Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 584
2025-09-30T14:51:49.708677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:49.708685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:49.708705Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a729ea5-9a332bc4-6b882308-b40adfd5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:49.708714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.708716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.708717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:49.708724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.708733Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:49.708749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:49.708888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:49.708895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:49.708905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:49.709037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 585 partition: 0 MaxSeqNo: 42 sessionId: src_id|5a729ea5-9a332bc4-6b882308-b40adfd5_0
2025-09-30T14:51:49.709391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ce3a6d5-11ff9d96-506fb4d0-fb67a46e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5a729ea5-9a332bc4-6b882308-b40adfd5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:49.712011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a729ea5-9a332bc4-6b882308-b40adfd5_0] Write session: try to update token
2025-09-30T14:51:49.712027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a729ea5-9a332bc4-6b882308-b40adfd5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:49.725918Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:49.725940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:49.725950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895056769336736:4924]
2025-09-30T14:51:49.725994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:49.726005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:49.726041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 585 sessionId: src_id|5a729ea5-9a332bc4-6b882308-b40adfd5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:49.726182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:49.726339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:49.726509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:49.726661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:49.726865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:49.726912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:49.728609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:49.728795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:49.728816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:49.728847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:49.728905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:49.729946Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:49.729961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:49.729964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:49.729966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:49.729974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895056769336736:4924]
2025-09-30T14:51:49.729978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895056769336736:4924]
2025-09-30T14:51:49.729982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895056769336736:4924]
2025-09-30T14:51:49.730017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:49.730019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:49.730024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:49.730026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:49.730027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.730031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:49.730159Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:49.786829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895056859064295:5419]
2025-09-30T14:51:49.787086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 584, pipe: [1:7555895056859064295:5419]
2025-09-30T14:51:49.842183Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:49.849231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:49.849263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:49.849421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:49.849480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:49.849551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:49.849611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:49.849658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:49.849665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:49.849725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:49.849788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:49.849845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:49.849906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:49.849946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:49.849951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:49.850017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:49.850077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:49.850135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:49.850198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:49.850586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:49.850595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:49.850657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:49.850717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:49.850778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:49.850841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:49.850882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:49.850888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:49.850949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:49.851007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:49.851075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:49.851136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:49.851177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:49.851182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:49.851270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:49.851331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:49.851386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:49.851440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:49.851481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:49.851486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:49.851553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:49.851613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:49.851672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:49.851728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:49.851768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:49.851774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:49.851839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:49.851893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:49.851950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:49.852010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:49.852054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:49.852062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:49.852129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:49.852181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:49.852236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:49.852294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:49.852343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:49.852351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:49.852411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:49.852466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:49.852523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:49.852588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:49.852634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:49.852644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:49.852693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895056859064295:5419], now have 1 active actors on pipe
2025-09-30T14:51:49.852908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:49.852924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:49.852952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 585 reason: error at write: Disconnected sessionId: src_id|5a729ea5-9a332bc4-6b882308-b40adfd5_0
2025-09-30T14:51:49.852952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895056859064295:5419]
2025-09-30T14:51:49.852981Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:49.853074Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:49.853159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 585 sessionId: src_id|5a729ea5-9a332bc4-6b882308-b40adfd5_0 is DEAD
2025-09-30T14:51:49.853287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a729ea5-9a332bc4-6b882308-b40adfd5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:49.853298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a729ea5-9a332bc4-6b882308-b40adfd5_0] Write session will restart in 0.008118s
2025-09-30T14:51:49.853321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a729ea5-9a332bc4-6b882308-b40adfd5_0] Write session: Do CDS request
2025-09-30T14:51:49.853326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a729ea5-9a332bc4-6b882308-b40adfd5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:49.862770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a729ea5-9a332bc4-6b882308-b40adfd5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:49.862851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:49.862870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 586
2025-09-30T14:51:49.863049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 586 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:49.863093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 586 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:49.863106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=586 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:49.863111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:49.863514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 586 sessionId:  describe result for acl check
2025-09-30T14:51:49.863547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:49.863553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:49.863555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:49.863562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895056859064389:5889] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:49.864077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895056859064389:5889] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:49.865901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:49.866145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895056859064389:5889] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:49.867975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:49.868155Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:49.868166Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:49.868176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:49.868225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:49.868261Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895056769336918:4926]
2025-09-30T14:51:49.868870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:49.868889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895056859064389:5889] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:49.868912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895056859064389:5889] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:49.868915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895056859064389:5889] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:49.868923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 586 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:49.869129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:49.869170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:49.869490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:49.869543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:49.869550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:49.869551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:49.869552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:49.869553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:49.869554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:49.869555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:49.869556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:49.869558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:49.869559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:49.869561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.869562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.869563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.869564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:49.869565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:49.869570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:49.869580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:49.869585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:49.869589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:49.869593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:49.869597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:49.869601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:49.869605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:49.869609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:49.869614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:49.869618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.869622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.869626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.869630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:49.869633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:49.869642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:49.869650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:49.869661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:49.869669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:49.869677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:49.869682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:49.869687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:49.869692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:49.869701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:49.869710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:49.869714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:49.869719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:49.869724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:49.869730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:49.869739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:49.869744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:49.869752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:49.869758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:49.869762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:49.869772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:49.869779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.869788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.869793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.869798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.869803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.869808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.869812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:49.869822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:49.869827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:49.869836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:49.869877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:49.875101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:49.876140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:49.876160Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:49.876163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:49.876167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:49.876174Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 585 [2:7555895056769336918:4926]
2025-09-30T14:51:49.876192Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:49.876209Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:49.876217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.876220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.876223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.876239Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:49.876254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:49.876261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:49.876324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.876333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.876336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.876340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:49.876343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:49.876409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:49.876417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.876429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:49.876446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:49.876469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:49.876494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895056859064457:5889], now have 1 active actors on pipe
2025-09-30T14:51:49.876498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895056859064296:2454], now have 1 active actors on pipe
2025-09-30T14:51:49.876505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895056769336913:4926]
2025-09-30T14:51:49.876507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895056769336913:4926]
2025-09-30T14:51:49.876509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895056769336913:4926]
2025-09-30T14:51:49.876524Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:49.876538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:49.876521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 585
2025-09-30T14:51:49.876527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 585
2025-09-30T14:51:49.876550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:49.876556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:49.876559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:49.876559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:49.876562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:49.876610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:49.876620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:49.876632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895056769336913:4926]
2025-09-30T14:51:49.876644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:49.876657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:49.876677Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c979806-e957f9e5-471394b5-ac7f6418_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:49.876684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.876688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.876690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:49.876700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.876710Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:49.876732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:49.876860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:49.876868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:49.876881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:49.876954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 586 partition: 0 MaxSeqNo: 42 sessionId: src_id|8c979806-e957f9e5-471394b5-ac7f6418_0
2025-09-30T14:51:49.877317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a729ea5-9a332bc4-6b882308-b40adfd5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8c979806-e957f9e5-471394b5-ac7f6418_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:49.880175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c979806-e957f9e5-471394b5-ac7f6418_0] Write session: try to update token
2025-09-30T14:51:49.880197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c979806-e957f9e5-471394b5-ac7f6418_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:49.888967Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:49.888992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:49.888995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:49.888998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:49.889010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895056769336913:4926]
2025-09-30T14:51:49.889018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895056769336913:4926]
2025-09-30T14:51:49.889025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895056769336913:4926]
2025-09-30T14:51:49.889068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:49.889074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:49.889079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:49.889079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:49.889087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:49.889098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:49.889304Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:49.894961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 586 sessionId: src_id|8c979806-e957f9e5-471394b5-ac7f6418_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:49.897645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:49.953293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895056859064481:5419]
2025-09-30T14:51:49.953507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 585, pipe: [1:7555895056859064481:5419]
2025-09-30T14:51:49.996638Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:49.997146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:49.997162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:49.997197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895056859064481:5419], now have 1 active actors on pipe
2025-09-30T14:51:49.997378Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:49.997410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:49.997450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895056859064481:5419]
2025-09-30T14:51:49.997461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:49.997509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 586 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8c979806-e957f9e5-471394b5-ac7f6418_0
2025-09-30T14:51:49.997677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 586 sessionId: src_id|8c979806-e957f9e5-471394b5-ac7f6418_0 is DEAD
2025-09-30T14:51:49.997837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c979806-e957f9e5-471394b5-ac7f6418_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:49.997847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c979806-e957f9e5-471394b5-ac7f6418_0] Write session will restart in 0.006908s
2025-09-30T14:51:49.997870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c979806-e957f9e5-471394b5-ac7f6418_0] Write session: Do CDS request
2025-09-30T14:51:49.997875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c979806-e957f9e5-471394b5-ac7f6418_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:50.005732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c979806-e957f9e5-471394b5-ac7f6418_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:50.005846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:50.005863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 587
2025-09-30T14:51:50.005978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 587 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:50.006028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 587 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:50.006034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=587 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:50.006038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:50.006445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 587 sessionId:  describe result for acl check
2025-09-30T14:51:50.006484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:50.006492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:50.006494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:50.006499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895061154031864:5903] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:50.007003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895061154031864:5903] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:50.008985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895061154031864:5903] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:50.009658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:50.011928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:50.012115Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:50.012127Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:50.012135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:50.012172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:50.012206Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895061064304416:4941]
2025-09-30T14:51:50.012632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895061154031864:5903] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:50.012649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895061154031864:5903] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:50.012653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895061154031864:5903] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:50.012661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 587 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:50.012751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:50.013013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:50.013055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:50.013345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:50.013401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:50.013408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:50.013409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:50.013410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:50.013411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:50.013413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:50.013414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:50.013415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:50.013417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:50.013418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:50.013419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.013420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.013421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.013422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:50.013424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:50.013429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:50.013439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:50.013443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:50.013448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:50.013452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:50.013456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:50.013460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:50.013464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:50.013468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:50.013472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:50.013476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.013481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.013485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.013489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:50.013493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:50.013500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:50.013508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:50.013514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:50.013520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:50.013524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:50.013529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:50.013538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:50.013544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:50.013549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:50.013554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:50.013559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:50.013564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:50.013571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:50.013576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:50.013585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:50.013590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:50.013595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:50.013605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:50.013609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:50.013620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:50.013624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.013635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.013639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.013648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.013653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.013658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.013666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:50.013671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:50.013676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:50.013685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:50.013726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:50.019561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:50.020526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:50.020540Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:50.020543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:50.020547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:50.020553Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 586 [2:7555895061064304416:4941]
2025-09-30T14:51:50.020570Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:50.020586Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:50.020593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:50.020597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:50.020599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:50.020614Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:50.020625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:50.020636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:50.020696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.020703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.020705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.020709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:50.020712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:50.020776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:50.020783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.020796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.020808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.020830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:50.020852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895056859064502:2454], now have 1 active actors on pipe
2025-09-30T14:51:50.020860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895061154031969:5903], now have 1 active actors on pipe
2025-09-30T14:51:50.020866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895061064304411:4941]
2025-09-30T14:51:50.020868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895061064304411:4941]
2025-09-30T14:51:50.020870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895061064304411:4941]
2025-09-30T14:51:50.020885Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:50.020901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:50.020903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:50.020907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:50.020910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:50.020921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:50.020928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:50.020923Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 586
2025-09-30T14:51:50.020961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895061064304411:4941]
2025-09-30T14:51:50.020972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:50.020929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 586
2025-09-30T14:51:50.020980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:50.020995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:50.021000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:50.021052Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|208c4d2f-e090e878-cd3844f6-79834aa4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:50.021064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:50.021068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:50.021071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:50.021081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:50.021094Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:50.021114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:50.021260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:50.021271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:50.021286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:50.021357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 587 partition: 0 MaxSeqNo: 42 sessionId: src_id|208c4d2f-e090e878-cd3844f6-79834aa4_0
2025-09-30T14:51:50.021748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c979806-e957f9e5-471394b5-ac7f6418_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|208c4d2f-e090e878-cd3844f6-79834aa4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:50.024492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|208c4d2f-e090e878-cd3844f6-79834aa4_0] Write session: try to update token
2025-09-30T14:51:50.024514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|208c4d2f-e090e878-cd3844f6-79834aa4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:50.033211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:50.033230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:50.033233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:50.033236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:50.033247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895061064304411:4941]
2025-09-30T14:51:50.033251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895061064304411:4941]
2025-09-30T14:51:50.033256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895061064304411:4941]
2025-09-30T14:51:50.033297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:50.033301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:50.033308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:50.033309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.033312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:50.033313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:50.033459Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:50.039143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 587 sessionId: src_id|208c4d2f-e090e878-cd3844f6-79834aa4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:50.041982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:50.097581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895061154031984:5419]
2025-09-30T14:51:50.097830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 586, pipe: [1:7555895061154031984:5419]
2025-09-30T14:51:50.147410Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:50.147811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:50.147824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:50.147856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895061154031984:5419], now have 1 active actors on pipe
2025-09-30T14:51:50.148045Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:50.148098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:50.148108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:50.148114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:50.148154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895061154031984:5419]
2025-09-30T14:51:50.148187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 587 reason: error at write: Disconnected sessionId: src_id|208c4d2f-e090e878-cd3844f6-79834aa4_0
2025-09-30T14:51:50.148382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 587 sessionId: src_id|208c4d2f-e090e878-cd3844f6-79834aa4_0 is DEAD
2025-09-30T14:51:50.148552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|208c4d2f-e090e878-cd3844f6-79834aa4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:50.148561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|208c4d2f-e090e878-cd3844f6-79834aa4_0] Write session will restart in 0.008547s
2025-09-30T14:51:50.148583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|208c4d2f-e090e878-cd3844f6-79834aa4_0] Write session: Do CDS request
2025-09-30T14:51:50.148592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|208c4d2f-e090e878-cd3844f6-79834aa4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:50.158775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|208c4d2f-e090e878-cd3844f6-79834aa4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:50.158900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:50.158919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 588
2025-09-30T14:51:50.159046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 588 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:50.159079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 588 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:50.159089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=588 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:50.159092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:50.159511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 588 sessionId:  describe result for acl check
2025-09-30T14:51:50.159544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:50.159547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:50.159549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:50.159554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895061154032110:5907] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:50.160076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895061154032110:5907] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:50.161107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:50.161846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895061154032110:5907] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:50.163180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:50.163372Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:50.163384Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:50.163392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:50.163431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:50.163457Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895061064304585:4944]
2025-09-30T14:51:50.163970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:50.164210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:50.164243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:50.164472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895061154032110:5907] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:50.164486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895061154032110:5907] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:50.164489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895061154032110:5907] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:50.164497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 588 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:50.164513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:50.164566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:50.164572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:50.164573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:50.164574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:50.164575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:50.164577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:50.164578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:50.164579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:50.164580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:50.164581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:50.164582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.164584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.164585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.164586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:50.164588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:50.164593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:50.164604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:50.164607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:50.164611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:50.164615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:50.164619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:50.164623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:50.164626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:50.164630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:50.164634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:50.164638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.164642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.164645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.164649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:50.164653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:50.164659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:50.164667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:50.164673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:50.164679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:50.164683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:50.164687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:50.164689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:50.164692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:50.164695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:50.164699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:50.164701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:50.164704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:50.164706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:50.164709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:50.164712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:50.164715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:50.164717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:50.164720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:50.164723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:50.164727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:50.164730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.164733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.164735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.164738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.164740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.164743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.164745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:50.164748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:50.164750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:50.164752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:50.164777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:50.170304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:50.171324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:50.171341Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:50.171344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:50.171349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:50.171355Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 587 [2:7555895061064304585:4944]
2025-09-30T14:51:50.171372Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:50.171389Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:50.171397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:50.171400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:50.171403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:50.171421Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:50.171433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:50.171446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:50.171513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.171521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.171524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.171529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:50.171532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:50.171607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:50.171621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.171635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.171648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.171666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:50.171686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895061154032150:5907], now have 1 active actors on pipe
2025-09-30T14:51:50.171695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895061154031985:2454], now have 1 active actors on pipe
2025-09-30T14:51:50.171702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895061064304580:4944]
2025-09-30T14:51:50.171706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895061064304580:4944]
2025-09-30T14:51:50.171708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895061064304580:4944]
2025-09-30T14:51:50.171720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:50.171738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:50.171749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:50.171754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:50.171756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:50.171760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:50.171764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:50.171761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 587
2025-09-30T14:51:50.171798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895061064304580:4944]
2025-09-30T14:51:50.171809Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:50.171811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:50.171770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 587
2025-09-30T14:51:50.171837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:50.171848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:50.171883Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37dbd867-16463f69-d053ba57-97304d79_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:50.171895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:50.171898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:50.171900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:50.171912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:50.171926Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:50.171948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:50.172093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:50.172102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:50.172114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:50.172202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 588 partition: 0 MaxSeqNo: 42 sessionId: src_id|37dbd867-16463f69-d053ba57-97304d79_0
2025-09-30T14:51:50.172585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|208c4d2f-e090e878-cd3844f6-79834aa4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|37dbd867-16463f69-d053ba57-97304d79_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:50.175195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37dbd867-16463f69-d053ba57-97304d79_0] Write session: try to update token
2025-09-30T14:51:50.175215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37dbd867-16463f69-d053ba57-97304d79_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:50.184242Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:50.184264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:50.184266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:50.184269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:50.184277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895061064304580:4944]
2025-09-30T14:51:50.184281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895061064304580:4944]
2025-09-30T14:51:50.184285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895061064304580:4944]
2025-09-30T14:51:50.184322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:50.184328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.184328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:50.184331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:50.184334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:50.184337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:50.184469Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:50.189883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 588 sessionId: src_id|37dbd867-16463f69-d053ba57-97304d79_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:50.192519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:50.248150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895061154032160:5419]
2025-09-30T14:51:50.248411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 587, pipe: [1:7555895061154032160:5419]
2025-09-30T14:51:50.287869Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:50.288182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:50.288198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:50.288237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895061154032160:5419], now have 1 active actors on pipe
2025-09-30T14:51:50.288531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895061154032160:5419]
2025-09-30T14:51:50.288569Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:50.288532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:50.288536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:50.288571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:50.288611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 588 reason: error at write: Disconnected sessionId: src_id|37dbd867-16463f69-d053ba57-97304d79_0
2025-09-30T14:51:50.288822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 588 sessionId: src_id|37dbd867-16463f69-d053ba57-97304d79_0 is DEAD
2025-09-30T14:51:50.288991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37dbd867-16463f69-d053ba57-97304d79_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:50.289001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37dbd867-16463f69-d053ba57-97304d79_0] Write session will restart in 0.008474s
2025-09-30T14:51:50.289019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37dbd867-16463f69-d053ba57-97304d79_0] Write session: Do CDS request
2025-09-30T14:51:50.289023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37dbd867-16463f69-d053ba57-97304d79_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:50.298856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37dbd867-16463f69-d053ba57-97304d79_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:50.299044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:50.299063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 589
2025-09-30T14:51:50.299228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 589 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:50.299294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 589 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:50.299307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=589 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:50.299310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:50.299804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 589 sessionId:  describe result for acl check
2025-09-30T14:51:50.299842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:50.299844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:50.299847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:50.299853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895061154032272:5911] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:50.300408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895061154032272:5911] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:50.301611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:50.302190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895061154032272:5911] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:50.304094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:50.304313Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:50.304323Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:50.304333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:50.304385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:50.304425Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895061064304753:4946]
2025-09-30T14:51:50.305014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895061154032272:5911] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:50.305032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895061154032272:5911] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:50.305036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895061154032272:5911] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:50.305044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 589 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:50.305085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:50.305364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:50.305409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:50.305754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:50.305814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:50.305820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:50.305822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:50.305823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:50.305824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:50.305826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:50.305827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:50.305828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:50.305830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:50.305831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:50.305833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.305834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.305836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.305837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:50.305838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:50.305843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:50.305854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:50.305859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:50.305863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:50.305867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:50.305871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:50.305875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:50.305880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:50.305884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:50.305888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:50.305892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.305896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.305901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.305905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:50.305909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:50.305916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:50.305924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:50.305931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:50.305943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:50.305950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:50.305956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:50.305960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:50.305966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:50.305971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:50.305981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:50.305986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:50.305991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:50.305995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:50.306001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:50.306006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:50.306011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:50.306016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:50.306022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:50.306030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:50.306037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:50.306046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.306051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.306060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.306066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.306070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.306080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.306085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:50.306090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:50.306094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:50.306099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:50.306144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:50.311952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:50.312857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:50.312877Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:50.312880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:50.312884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:50.312892Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 588 [2:7555895061064304753:4946]
2025-09-30T14:51:50.312910Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:50.312926Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:50.312929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:50.312932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:50.312935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:50.312952Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:50.312959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:50.312966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:50.313034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.313045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.313047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.313052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:50.313055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:50.313121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:50.313129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.313142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.313161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.313184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:50.313204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895061064304748:4946]
2025-09-30T14:51:50.313211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895061064304748:4946]
2025-09-30T14:51:50.313213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895061064304748:4946]
2025-09-30T14:51:50.313226Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:50.313239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:50.313246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895061154032325:5911], now have 1 active actors on pipe
2025-09-30T14:51:50.313250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:50.313250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895061154032161:2454], now have 1 active actors on pipe
2025-09-30T14:51:50.313252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:50.313258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:50.313271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:50.313275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:50.313311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895061064304748:4946]
2025-09-30T14:51:50.313324Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:50.313336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:50.313338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 588
2025-09-30T14:51:50.313364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 588
2025-09-30T14:51:50.313505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:50.313517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:50.313546Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ea88d9a-8e71ba60-9daac02c-1746aa3e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:50.313563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:50.313567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:50.313569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:50.313580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:50.313591Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:50.313611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:50.313848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:50.313858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:50.313875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:50.314034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 589 partition: 0 MaxSeqNo: 42 sessionId: src_id|9ea88d9a-8e71ba60-9daac02c-1746aa3e_0
2025-09-30T14:51:50.314439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37dbd867-16463f69-d053ba57-97304d79_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9ea88d9a-8e71ba60-9daac02c-1746aa3e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:50.317216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea88d9a-8e71ba60-9daac02c-1746aa3e_0] Write session: try to update token
2025-09-30T14:51:50.317237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea88d9a-8e71ba60-9daac02c-1746aa3e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:50.325118Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:50.325139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:50.325149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895061064304748:4946]
2025-09-30T14:51:50.325193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:50.325195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:50.325366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:50.325515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:50.325664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:50.325818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:50.326005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:50.326039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:50.331777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 589 sessionId: src_id|9ea88d9a-8e71ba60-9daac02c-1746aa3e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:50.334483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:50.334627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:50.334663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:50.335865Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:50.335885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:50.335888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:50.335890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:50.335900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895061064304748:4946]
2025-09-30T14:51:50.335905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895061064304748:4946]
2025-09-30T14:51:50.335909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895061064304748:4946]
2025-09-30T14:51:50.335954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:50.335964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:50.335970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:50.335974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:50.335982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:50.335988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.335991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:50.336078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:50.336128Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:50.388935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895061154032336:5419]
2025-09-30T14:51:50.389253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 588, pipe: [1:7555895061154032336:5419]
2025-09-30T14:51:50.450469Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:50.459155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:50.459186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:50.459387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.459458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.459538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.459603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.459949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.459959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.460028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.460086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.460155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.460217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.460259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.460268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.460351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.460415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.460476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.460549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.460598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.460606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.460677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.460744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.460818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.460888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.460939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.460948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.461021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.461088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.461159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.461261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.461310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.461321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.461393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.461460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.461527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.461594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.461638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.461646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.461721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.461785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.461852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.461916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.461961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.461970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.462049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.462127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.462205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.462280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.462330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.462338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.462412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.462487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.462555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.462619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.462664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.462672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.462756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.462820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.462879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.462943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.462993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.463001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.463080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895061154032336:5419], now have 1 active actors on pipe
2025-09-30T14:51:50.463426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:50.463444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:50.463491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 589 reason: error at write: Disconnected sessionId: src_id|9ea88d9a-8e71ba60-9daac02c-1746aa3e_0
2025-09-30T14:51:50.463664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 589 sessionId: src_id|9ea88d9a-8e71ba60-9daac02c-1746aa3e_0 is DEAD
2025-09-30T14:51:50.463710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895061154032336:5419]
2025-09-30T14:51:50.463745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea88d9a-8e71ba60-9daac02c-1746aa3e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:50.463751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea88d9a-8e71ba60-9daac02c-1746aa3e_0] Write session will restart in 0.008218s
2025-09-30T14:51:50.463748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:50.463781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea88d9a-8e71ba60-9daac02c-1746aa3e_0] Write session: Do CDS request
2025-09-30T14:51:50.463787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea88d9a-8e71ba60-9daac02c-1746aa3e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:50.463836Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:50.472773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea88d9a-8e71ba60-9daac02c-1746aa3e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:50.472838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:50.472858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 590
2025-09-30T14:51:50.473000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 590 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:50.473039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 590 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:50.473051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=590 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:50.473055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:50.473571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 590 sessionId:  describe result for acl check
2025-09-30T14:51:50.473605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:50.473613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:50.473614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:50.473620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895061154032398:5916] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:50.474142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895061154032398:5916] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:50.476883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895061154032398:5916] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:50.477553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:50.479982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:50.480208Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:50.480220Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:50.480231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:50.480293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:50.480331Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895061064304922:4948]
2025-09-30T14:51:50.480362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895061154032398:5916] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:50.480380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895061154032398:5916] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:50.480384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895061154032398:5916] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:50.480393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 590 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:50.480982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:50.481289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:50.481339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:50.481662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:50.481714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:50.481720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:50.481721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:50.481722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:50.481723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:50.481724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:50.481725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:50.481726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:50.481728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:50.481729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:50.481730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.481731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.481732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.481733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:50.481734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:50.481739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:50.481748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:50.481752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:50.481756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:50.481760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:50.481763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:50.481767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:50.481770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:50.481773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:50.481778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:50.481781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.481785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.481788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.481792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:50.481796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:50.481804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:50.481811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:50.481816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:50.481822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:50.481826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:50.481831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:50.481835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:50.481840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:50.481844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:50.481849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:50.481853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:50.481857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:50.481866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:50.481871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:50.481875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:50.481884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:50.481888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:50.481892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:50.481901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:50.481905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:50.481910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.481915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.481918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.481923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.481931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.481936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.481941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:50.481945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:50.481950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:50.481955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:50.481997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:50.487834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:50.488687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:50.488703Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:50.488705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:50.488709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:50.488715Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 589 [2:7555895061064304922:4948]
2025-09-30T14:51:50.488728Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:50.488742Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:50.488747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:50.488750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:50.488752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:50.488764Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:50.488771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:50.488777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:50.488823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.488827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.488829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.488831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:50.488833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:50.488886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:50.488893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.488901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.488908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.488923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:50.488940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895061064304917:4948]
2025-09-30T14:51:50.488942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895061064304917:4948]
2025-09-30T14:51:50.488943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895061064304917:4948]
2025-09-30T14:51:50.488949Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:50.488960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:50.488961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:50.488965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:50.488968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:50.488973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:50.488976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:50.488985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895061154032504:5916], now have 1 active actors on pipe
2025-09-30T14:51:50.488989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895061154032338:2454], now have 1 active actors on pipe
2025-09-30T14:51:50.489019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895061064304917:4948]
2025-09-30T14:51:50.489031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:50.489056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:50.489085Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 589
2025-09-30T14:51:50.489086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 589
2025-09-30T14:51:50.489194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:50.489204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:50.489228Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99855ebd-8deadd74-ee3cacf-cbe5873f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:50.489240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:50.489244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:50.489248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:50.489257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:50.489271Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:50.489289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:50.489493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:50.489509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:50.489532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:50.489672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 590 partition: 0 MaxSeqNo: 42 sessionId: src_id|99855ebd-8deadd74-ee3cacf-cbe5873f_0
2025-09-30T14:51:50.490074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea88d9a-8e71ba60-9daac02c-1746aa3e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|99855ebd-8deadd74-ee3cacf-cbe5873f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:50.492884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99855ebd-8deadd74-ee3cacf-cbe5873f_0] Write session: try to update token
2025-09-30T14:51:50.492905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99855ebd-8deadd74-ee3cacf-cbe5873f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:50.501074Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:50.501095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:50.501103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895061064304917:4948]
2025-09-30T14:51:50.501140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:50.501157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:50.501308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:50.501463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:50.501625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:50.501778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:50.501987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:50.502034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:50.507726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 590 sessionId: src_id|99855ebd-8deadd74-ee3cacf-cbe5873f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:50.510739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:50.510932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:50.510955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:50.512156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:50.512191Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:50.512194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:50.512196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:50.512198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:50.512207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895061064304917:4948]
2025-09-30T14:51:50.512212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895061064304917:4948]
2025-09-30T14:51:50.512216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895061064304917:4948]
2025-09-30T14:51:50.512242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:50.512249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:50.512255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:50.512256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.512259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:50.512259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:50.512307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:50.512402Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:50.564032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895061154032517:5419]
2025-09-30T14:51:50.564362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 589, pipe: [1:7555895061154032517:5419]
2025-09-30T14:51:50.621458Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:50.628487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:50.628517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:50.628670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.628730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.628796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.628859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.628900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.628907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.628967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.629031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.629097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.629164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.629204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.629209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.629275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.629336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.629394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.629453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.629492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.629498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.629564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.629624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.629683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.629742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.629787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.629795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.629859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.629914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.629975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.630037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.630084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.630089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.630152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.630210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.630271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.630341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.630385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.630393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.630467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.630523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.630593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.630652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.630692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.630698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.630760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.630820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.630884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.630940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.630981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.630989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.631047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.631110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.631170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.631231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.631313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.631324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.631388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.631449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.631516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.631587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.631636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.631644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.631698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895061154032517:5419], now have 1 active actors on pipe
2025-09-30T14:51:50.631980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895061154032517:5419]
2025-09-30T14:51:50.631992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:50.631996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:50.632026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 590 reason: error at write: Disconnected sessionId: src_id|99855ebd-8deadd74-ee3cacf-cbe5873f_0
2025-09-30T14:51:50.632028Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:50.632230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 590 sessionId: src_id|99855ebd-8deadd74-ee3cacf-cbe5873f_0 is DEAD
2025-09-30T14:51:50.632317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99855ebd-8deadd74-ee3cacf-cbe5873f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:50.632325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99855ebd-8deadd74-ee3cacf-cbe5873f_0] Write session will restart in 0.008754s
2025-09-30T14:51:50.632341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99855ebd-8deadd74-ee3cacf-cbe5873f_0] Write session: Do CDS request
2025-09-30T14:51:50.632345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99855ebd-8deadd74-ee3cacf-cbe5873f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:50.632671Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:50.642759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99855ebd-8deadd74-ee3cacf-cbe5873f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:50.642901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:50.642918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 591
2025-09-30T14:51:50.643034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 591 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:50.643060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 591 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:50.643064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=591 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:50.643068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:50.643435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 591 sessionId:  describe result for acl check
2025-09-30T14:51:50.643480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:50.643488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:50.643492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:50.643498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895061154032648:5920] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:50.643961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895061154032648:5920] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:50.644427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:50.646308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895061154032648:5920] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:50.646776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:50.646931Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:50.646939Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:50.646946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:50.646982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:50.647012Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895061064305094:4951]
2025-09-30T14:51:50.647451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:50.647717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:50.647748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:50.647964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:50.648007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:50.648011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:50.648012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:50.648013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:50.648013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:50.648014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:50.648015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:50.648016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:50.648016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:50.648017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:50.648018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.648019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.648019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.648020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:50.648021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:50.648024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:50.648031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:50.648034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:50.648036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:50.648039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:50.648041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:50.648043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:50.648045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:50.648048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:50.648050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:50.648052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.648055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.648057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.648059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:50.648061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:50.648066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:50.648071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:50.648075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:50.648078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:50.648081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:50.648084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:50.648086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:50.648090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:50.648092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:50.648095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:50.648098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:50.648101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:50.648104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:50.648107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:50.648109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:50.648112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:50.648115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:50.648118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:50.648122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:50.648125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:50.648128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.648132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.648134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.648137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.648140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.648142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.648145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:50.648148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:50.648150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:50.648153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:50.648177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:50.648541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895061154032648:5920] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:50.648553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895061154032648:5920] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:50.648556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895061154032648:5920] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:50.648562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 591 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:50.653238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:50.654097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:50.654112Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:50.654114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:50.654117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:50.654123Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 590 [2:7555895061064305094:4951]
2025-09-30T14:51:50.654135Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:50.654152Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:50.654154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:50.654156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:50.654158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:50.654169Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:50.654174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:50.654179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:50.654224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.654230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.654232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.654234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:50.654236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:50.654282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:50.654288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.654296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.654303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.654312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:50.654325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895061064305089:4951]
2025-09-30T14:51:50.654326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895061064305089:4951]
2025-09-30T14:51:50.654328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895061064305089:4951]
2025-09-30T14:51:50.654334Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:50.654344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:50.654345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895061154032689:5920], now have 1 active actors on pipe
2025-09-30T14:51:50.654347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:50.654348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:50.654350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895061154032518:2454], now have 1 active actors on pipe
2025-09-30T14:51:50.654354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:50.654362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:50.654364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:50.654387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895061064305089:4951]
2025-09-30T14:51:50.654399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:50.654406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 590
2025-09-30T14:51:50.654437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:50.654453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 590
2025-09-30T14:51:50.654546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:50.654554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:50.654576Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c594e61-12f86882-7c6a678e-9e22a016_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:50.654581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:50.654585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:50.654587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:50.654596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:50.654604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:50.654618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:50.654767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:50.654772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:50.654781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:50.654860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 591 partition: 0 MaxSeqNo: 42 sessionId: src_id|6c594e61-12f86882-7c6a678e-9e22a016_0
2025-09-30T14:51:50.655216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99855ebd-8deadd74-ee3cacf-cbe5873f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6c594e61-12f86882-7c6a678e-9e22a016_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:50.657929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c594e61-12f86882-7c6a678e-9e22a016_0] Write session: try to update token
2025-09-30T14:51:50.657947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c594e61-12f86882-7c6a678e-9e22a016_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:50.666002Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:50.666020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:50.666031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895061064305089:4951]
2025-09-30T14:51:50.666072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:50.666075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:50.666240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:50.666386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:50.666538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:50.666681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:50.666876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:50.666916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:50.672427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 591 sessionId: src_id|6c594e61-12f86882-7c6a678e-9e22a016_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:50.674819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:50.675052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:50.675075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:50.675109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:50.675209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:50.676647Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:50.676662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:50.676664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:50.676665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:50.676673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895061064305089:4951]
2025-09-30T14:51:50.676676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895061064305089:4951]
2025-09-30T14:51:50.676679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895061064305089:4951]
2025-09-30T14:51:50.676717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:50.676725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.676728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:50.676736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:50.676751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:50.676755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:50.676851Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:50.731949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895061154032697:5419]
2025-09-30T14:51:50.732247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 590, pipe: [1:7555895061154032697:5419]
2025-09-30T14:51:50.784752Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:50.792049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:50.792078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:50.792232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.792292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.792355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.792417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.792807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.792817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.792880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.792937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.792994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.793057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.793100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.793107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.793169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.793228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.793285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.793345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.793386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.793392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.793466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.793534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.793601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.793661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.793714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.793720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.793784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.793842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.793901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.793958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.793998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.794003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.794066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.794121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.794179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.794237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.794277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.794287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.794346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.794402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.794492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.794568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.794614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.794620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.794682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.794751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.794812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.794870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.794912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.794919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.794980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.795034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.795092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.795153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.795198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.795204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.795288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.795343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.795399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.795458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.795498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.795506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.795566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895061154032697:5419], now have 1 active actors on pipe
2025-09-30T14:51:50.795862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:50.795881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:50.795910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 591 reason: error at write: Disconnected sessionId: src_id|6c594e61-12f86882-7c6a678e-9e22a016_0
2025-09-30T14:51:50.796046Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:50.796116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 591 sessionId: src_id|6c594e61-12f86882-7c6a678e-9e22a016_0 is DEAD
2025-09-30T14:51:50.796247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c594e61-12f86882-7c6a678e-9e22a016_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:50.796258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c594e61-12f86882-7c6a678e-9e22a016_0] Write session will restart in 0.005268s
2025-09-30T14:51:50.796283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c594e61-12f86882-7c6a678e-9e22a016_0] Write session: Do CDS request
2025-09-30T14:51:50.796258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895061154032697:5419]
2025-09-30T14:51:50.796288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c594e61-12f86882-7c6a678e-9e22a016_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:50.796309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:50.802775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c594e61-12f86882-7c6a678e-9e22a016_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:50.802840Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:50.802860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 592
2025-09-30T14:51:50.803011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 592 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:50.803043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 592 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:50.803061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=592 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:50.803069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:50.803537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 592 sessionId:  describe result for acl check
2025-09-30T14:51:50.803576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:50.803583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:50.803586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:50.803592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895061154032712:5924] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:50.804198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895061154032712:5924] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:50.807174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895061154032712:5924] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:50.810201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895061154032712:5924] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:50.810219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895061154032712:5924] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:50.810223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895061154032712:5924] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:50.810231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 592 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:50.811556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:50.813974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:50.814172Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:50.814186Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:50.814196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:50.814246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:50.814286Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895061064305266:4953]
2025-09-30T14:51:50.814957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:50.815339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:50.815387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:50.815723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:50.815794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:50.815801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:50.815802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:50.815804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:50.815805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:50.815807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:50.815808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:50.815809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:50.815811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:50.815812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:50.815813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.815814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.815815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.815816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:50.815818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:50.815824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:50.815834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:50.815838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:50.815842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:50.815846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:50.815850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:50.815854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:50.815858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:50.815863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:50.815867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:50.815872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.815876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.815880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.815884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:50.815888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:50.815895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:50.815903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:50.815909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:50.815914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:50.815919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:50.815923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:50.815928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:50.815933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:50.815938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:50.815943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:50.815947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:50.815952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:50.815958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:50.815962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:50.815969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:50.815982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:50.815986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:50.815996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:50.816001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:50.816005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:50.816015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.816020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.816029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.816034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.816042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.816047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.816052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:50.816065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:50.816070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:50.816075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:50.816118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:50.821777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:50.822959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:50.822976Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:50.822978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:50.822981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:50.822987Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 591 [2:7555895061064305266:4953]
2025-09-30T14:51:50.823001Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:50.823018Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:50.823021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:50.823023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:50.823026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:50.823041Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:50.823055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:50.823061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:50.823107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.823115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.823117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.823121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:50.823123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:50.823186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:50.823194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.823203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.823214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.823227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:50.823262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895061064305261:4953]
2025-09-30T14:51:50.823269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895061064305261:4953]
2025-09-30T14:51:50.823271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895061064305261:4953]
2025-09-30T14:51:50.823281Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:50.823291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:50.823296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:50.823300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:50.823302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:50.823312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:50.823315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:50.823325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895061154032862:5924], now have 1 active actors on pipe
2025-09-30T14:51:50.823334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895061154032698:2454], now have 1 active actors on pipe
2025-09-30T14:51:50.823363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895061064305261:4953]
2025-09-30T14:51:50.823377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:50.823388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 591
2025-09-30T14:51:50.823404Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 591
2025-09-30T14:51:50.823403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:50.823525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:50.823538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:50.823568Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|554958de-679d0a43-80400da9-fa92b79_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:50.823581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:50.823590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:50.823593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:50.823603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:50.823614Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:50.823632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:50.823810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:50.823817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:50.823830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:50.823935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 592 partition: 0 MaxSeqNo: 42 sessionId: src_id|554958de-679d0a43-80400da9-fa92b79_0
2025-09-30T14:51:50.824278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c594e61-12f86882-7c6a678e-9e22a016_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|554958de-679d0a43-80400da9-fa92b79_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:50.826971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|554958de-679d0a43-80400da9-fa92b79_0] Write session: try to update token
2025-09-30T14:51:50.826988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|554958de-679d0a43-80400da9-fa92b79_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:50.835388Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:50.835408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:50.835417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895061064305261:4953]
2025-09-30T14:51:50.835463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:50.835465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:50.835630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:50.835785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:50.835927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:50.836072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:50.836271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:50.836316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:50.841961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 592 sessionId: src_id|554958de-679d0a43-80400da9-fa92b79_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:50.844780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:50.845105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:50.845127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:50.845163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:50.845263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:50.846376Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:50.846391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:50.846394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:50.846396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:50.846406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895061064305261:4953]
2025-09-30T14:51:50.846410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895061064305261:4953]
2025-09-30T14:51:50.846414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895061064305261:4953]
2025-09-30T14:51:50.846463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:50.846469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.846472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:50.846475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:50.846487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:50.846491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:50.846632Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:50.896298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895061154032877:5419]
2025-09-30T14:51:50.896599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 591, pipe: [1:7555895061154032877:5419]
2025-09-30T14:51:50.957793Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:50.965715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:50.965748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:50.965920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.965992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.966064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.966133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.966185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.966194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.966264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.966330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.966398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.966487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.966533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.966546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.966624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.966692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.966761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.966831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.966877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.966885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.966954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.967025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.967093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.967168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.967212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.967220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.967307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.967373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.967442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.967509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.967563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.967571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.967639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.967704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.967774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.967839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.967884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.967892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.967964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.968029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.968097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.968161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.968206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.968210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.968279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.968346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.968406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.968466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.968509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.968514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.968579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.968643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.968705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.968765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.968811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.968818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.968887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:50.968944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:50.969005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:50.969076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:50.969123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:50.969130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:50.969203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895061154032877:5419], now have 1 active actors on pipe
2025-09-30T14:51:50.969446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:50.969462Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:50.969470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:50.969499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 592 reason: error at write: Disconnected sessionId: src_id|554958de-679d0a43-80400da9-fa92b79_0
2025-09-30T14:51:50.969502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895061154032877:5419]
2025-09-30T14:51:50.969671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 592 sessionId: src_id|554958de-679d0a43-80400da9-fa92b79_0 is DEAD
2025-09-30T14:51:50.969805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|554958de-679d0a43-80400da9-fa92b79_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:50.969816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|554958de-679d0a43-80400da9-fa92b79_0] Write session will restart in 0.005416s
2025-09-30T14:51:50.969839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|554958de-679d0a43-80400da9-fa92b79_0] Write session: Do CDS request
2025-09-30T14:51:50.969844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|554958de-679d0a43-80400da9-fa92b79_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:50.970178Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:50.976697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|554958de-679d0a43-80400da9-fa92b79_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:50.976809Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:50.976824Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 593
2025-09-30T14:51:50.976971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 593 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:50.977011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 593 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:50.977023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=593 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:50.977027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:50.977497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 593 sessionId:  describe result for acl check
2025-09-30T14:51:50.977528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:50.977536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:50.977538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:50.977544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895061154032909:5929] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:50.978034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895061154032909:5929] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:50.980528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895061154032909:5929] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:50.983612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895061154032909:5929] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:50.983633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895061154032909:5929] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:50.983636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895061154032909:5929] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:50.983644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 593 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:50.984558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:50.986633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:50.986853Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:50.986864Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:50.986873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:50.986917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:50.986946Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895061064305455:4956]
2025-09-30T14:51:50.987395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:50.987695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:50.987731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:50.988003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:50.988063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:50.988069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:50.988070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:50.988072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:50.988073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:50.988074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:50.988075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:50.988077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:50.988078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:50.988079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:50.988080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.988082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.988083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.988084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:50.988085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:50.988089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:50.988100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:50.988104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:50.988109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:50.988113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:50.988117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:50.988121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:50.988125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:50.988129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:50.988134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:50.988138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.988141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.988145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.988149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:50.988153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:50.988160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:50.988168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:50.988173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:50.988179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:50.988183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:50.988186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:50.988189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:50.988192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:50.988194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:50.988197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:50.988200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:50.988202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:50.988206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:50.988209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:50.988212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:50.988214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:50.988217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:50.988219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:50.988222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:50.988225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:50.988227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.988230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.988233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.988235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.988238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.988241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.988243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:50.988246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:50.988249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:50.988252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:50.988276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:50.994018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:50.994922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:50.994944Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:50.994947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:50.994951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:50.994957Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 592 [2:7555895061064305455:4956]
2025-09-30T14:51:50.994973Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:50.994989Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:50.994992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:50.994995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:50.994997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:50.995014Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:50.995029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:50.995041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:50.995101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.995111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.995113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.995117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:50.995120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:50.995189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:50.995198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:50.995210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:50.995228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:50.995269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:50.995294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895061154032895:2454], now have 1 active actors on pipe
2025-09-30T14:51:50.995304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895061154033068:5929], now have 1 active actors on pipe
2025-09-30T14:51:50.995311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895061064305446:4956]
2025-09-30T14:51:50.995318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895061064305446:4956]
2025-09-30T14:51:50.995321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895061064305446:4956]
2025-09-30T14:51:50.995335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:50.995354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:50.995354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:50.995357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:50.995360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:50.995374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:50.995382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:50.995362Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 592
2025-09-30T14:51:50.995371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 592
2025-09-30T14:51:50.995416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895061064305446:4956]
2025-09-30T14:51:50.995428Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:50.995435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:50.995449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:50.995453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:50.995505Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e7a16ae-c25df631-e5b36ba0-c7f7a939_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:50.995518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:50.995522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:50.995529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:50.995538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:50.995547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:50.995576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:50.995762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:50.995773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:50.995790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:50.995909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 593 partition: 0 MaxSeqNo: 42 sessionId: src_id|9e7a16ae-c25df631-e5b36ba0-c7f7a939_0
2025-09-30T14:51:50.996264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|554958de-679d0a43-80400da9-fa92b79_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9e7a16ae-c25df631-e5b36ba0-c7f7a939_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:50.998885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e7a16ae-c25df631-e5b36ba0-c7f7a939_0] Write session: try to update token
2025-09-30T14:51:50.998903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e7a16ae-c25df631-e5b36ba0-c7f7a939_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:51.007486Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:51.007509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:51.007512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:51.007514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:51.007522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895061064305446:4956]
2025-09-30T14:51:51.007526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895061064305446:4956]
2025-09-30T14:51:51.007530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895061064305446:4956]
2025-09-30T14:51:51.007568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:51.007579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.007578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:51.007582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:51.007595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:51.007599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:51.007716Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:51.013457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 593 sessionId: src_id|9e7a16ae-c25df631-e5b36ba0-c7f7a939_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:51.016245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:51.069896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895065449000405:5419]
2025-09-30T14:51:51.070186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 592, pipe: [1:7555895065449000405:5419]
2025-09-30T14:51:51.123755Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:51.124078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:51.124093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:51.124128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895065449000405:5419], now have 1 active actors on pipe
2025-09-30T14:51:51.124380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:51.124392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895065449000405:5419]
2025-09-30T14:51:51.124418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:51.124421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:51.124480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 593 reason: error at write: Disconnected sessionId: src_id|9e7a16ae-c25df631-e5b36ba0-c7f7a939_0
2025-09-30T14:51:51.124508Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:51.124671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 593 sessionId: src_id|9e7a16ae-c25df631-e5b36ba0-c7f7a939_0 is DEAD
2025-09-30T14:51:51.124837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e7a16ae-c25df631-e5b36ba0-c7f7a939_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:51.124847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e7a16ae-c25df631-e5b36ba0-c7f7a939_0] Write session will restart in 0.009529s
2025-09-30T14:51:51.124864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e7a16ae-c25df631-e5b36ba0-c7f7a939_0] Write session: Do CDS request
2025-09-30T14:51:51.124869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e7a16ae-c25df631-e5b36ba0-c7f7a939_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:51.135784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e7a16ae-c25df631-e5b36ba0-c7f7a939_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:51.135888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:51.135908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 594
2025-09-30T14:51:51.136033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 594 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:51.136065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 594 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:51.136072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=594 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:51.136089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:51.136518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 594 sessionId:  describe result for acl check
2025-09-30T14:51:51.136559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:51.136566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:51.136579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:51.136589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895065449000505:5942] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:51.137132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895065449000505:5942] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:51.139308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:51.139340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895065449000505:5942] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:51.141679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:51.141888Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:51.141903Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:51.141916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:51.141988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:51.142037Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895065359272957:4971]
2025-09-30T14:51:51.142324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895065449000505:5942] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:51.142340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895065449000505:5942] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:51.142343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895065449000505:5942] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:51.142350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 594 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:51.142716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:51.143030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:51.143088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:51.143448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:51.143537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:51.143546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:51.143547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:51.143548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:51.143550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:51.143551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:51.143552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:51.143554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:51.143555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:51.143557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:51.143558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.143559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.143560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.143561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:51.143562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:51.143568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:51.143578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:51.143582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:51.143586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:51.143589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:51.143593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:51.143597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:51.143601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:51.143604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:51.143608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:51.143611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.143615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.143619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.143622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:51.143626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:51.143634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:51.143640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:51.143647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:51.143651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:51.143656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:51.143660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:51.143664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:51.143669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:51.143674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:51.143679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:51.143683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:51.143687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:51.143692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:51.143697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:51.143701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:51.143706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:51.143710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:51.143716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:51.143721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:51.143734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:51.143738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.143749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.143753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.143762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.143767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.143773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.143777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:51.143786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:51.143791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:51.143796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:51.143840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:51.149405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:51.150604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:51.150619Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:51.150622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:51.150625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:51.150630Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 593 [2:7555895065359272957:4971]
2025-09-30T14:51:51.150641Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:51.150654Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:51.150656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:51.150658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:51.150660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:51.150672Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:51.150676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:51.150681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:51.150729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.150739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.150741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.150745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:51.150747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:51.150817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:51.150826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.150840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.150847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.150856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:51.150874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895065449000577:5942], now have 1 active actors on pipe
2025-09-30T14:51:51.150880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895065449000408:2454], now have 1 active actors on pipe
2025-09-30T14:51:51.150885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895065359272952:4971]
2025-09-30T14:51:51.150886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895065359272952:4971]
2025-09-30T14:51:51.150887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895065359272952:4971]
2025-09-30T14:51:51.150898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:51.150914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:51.150915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:51.150918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:51.150921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:51.150932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:51.150934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:51.150970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895065359272952:4971]
2025-09-30T14:51:51.150966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 593
2025-09-30T14:51:51.150978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 593
2025-09-30T14:51:51.150984Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:51.151050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:51.151106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:51.151124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:51.151161Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7cd6ee51-d712180f-cf7b0e8f-d083ccb2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:51.151178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:51.151182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:51.151184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:51.151196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:51.151213Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:51.151234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:51.151422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:51.151434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:51.151452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:51.151559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 594 partition: 0 MaxSeqNo: 42 sessionId: src_id|7cd6ee51-d712180f-cf7b0e8f-d083ccb2_0
2025-09-30T14:51:51.151886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e7a16ae-c25df631-e5b36ba0-c7f7a939_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7cd6ee51-d712180f-cf7b0e8f-d083ccb2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:51.154622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd6ee51-d712180f-cf7b0e8f-d083ccb2_0] Write session: try to update token
2025-09-30T14:51:51.154641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd6ee51-d712180f-cf7b0e8f-d083ccb2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:51.163733Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:51.163757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:51.163759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:51.163762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:51.163771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895065359272952:4971]
2025-09-30T14:51:51.163776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895065359272952:4971]
2025-09-30T14:51:51.163781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895065359272952:4971]
2025-09-30T14:51:51.163825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:51.163832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.163835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:51.163831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:51.163846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:51.163851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:51.163980Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:51.170857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 594 sessionId: src_id|7cd6ee51-d712180f-cf7b0e8f-d083ccb2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:51.173630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:51.224605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895065449000588:5419]
2025-09-30T14:51:51.224893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 593, pipe: [1:7555895065449000588:5419]
2025-09-30T14:51:51.277155Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:51.277514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:51.277534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:51.277556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895065449000588:5419], now have 1 active actors on pipe
2025-09-30T14:51:51.277929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:51.277996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895065449000588:5419]
2025-09-30T14:51:51.278018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:51.278021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:51.278095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 594 reason: error at write: Disconnected sessionId: src_id|7cd6ee51-d712180f-cf7b0e8f-d083ccb2_0
2025-09-30T14:51:51.278269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 594 sessionId: src_id|7cd6ee51-d712180f-cf7b0e8f-d083ccb2_0 is DEAD
2025-09-30T14:51:51.278403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd6ee51-d712180f-cf7b0e8f-d083ccb2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:51.278415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd6ee51-d712180f-cf7b0e8f-d083ccb2_0] Write session will restart in 0.007362s
2025-09-30T14:51:51.278449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd6ee51-d712180f-cf7b0e8f-d083ccb2_0] Write session: Do CDS request
2025-09-30T14:51:51.278466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd6ee51-d712180f-cf7b0e8f-d083ccb2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:51.278078Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:51.286882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd6ee51-d712180f-cf7b0e8f-d083ccb2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:51.286865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:51.286897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 595
2025-09-30T14:51:51.287159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 595 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:51.287208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 595 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:51.287219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=595 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:51.287224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:51.287696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 595 sessionId:  describe result for acl check
2025-09-30T14:51:51.287738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:51.287745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:51.287747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:51.287754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895065449000604:5946] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:51.288339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895065449000604:5946] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:51.290876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895065449000604:5946] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:51.294710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895065449000604:5946] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:51.294732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895065449000604:5946] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:51.294736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895065449000604:5946] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:51.294745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 595 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:51.295554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:51.298089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:51.298299Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:51.298308Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:51.298320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:51.298372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:51.298415Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895065359273132:4973]
2025-09-30T14:51:51.299136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:51.299498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:51.299575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:51.299939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:51.300038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:51.300046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:51.300048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:51.300049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:51.300050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:51.300051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:51.300053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:51.300054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:51.300055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:51.300056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:51.300057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.300059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.300060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.300061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:51.300062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:51.300068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:51.300078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:51.300083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:51.300088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:51.300092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:51.300097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:51.300101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:51.300105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:51.300109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:51.300113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:51.300116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.300121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.300124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.300128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:51.300133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:51.300142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:51.300150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:51.300157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:51.300163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:51.300168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:51.300174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:51.300179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:51.300184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:51.300189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:51.300194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:51.300199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:51.300212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:51.300220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:51.300230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:51.300235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:51.300245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:51.300250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:51.300261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:51.300266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:51.300272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:51.300281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.300290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.300295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.300308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.300316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.300321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.300325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:51.300331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:51.300335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:51.300341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:51.300383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:51.306172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:51.307376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:51.307393Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:51.307395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:51.307400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:51.307407Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 594 [2:7555895065359273132:4973]
2025-09-30T14:51:51.307423Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:51.307439Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:51.307447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:51.307450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:51.307453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:51.307471Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:51.307478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:51.307490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:51.307554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.307562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.307564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.307568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:51.307571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:51.307636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:51.307643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.307657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.307675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.307698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:51.307715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895065449000758:5946], now have 1 active actors on pipe
2025-09-30T14:51:51.307719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895065449000590:2454], now have 1 active actors on pipe
2025-09-30T14:51:51.307725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895065359273127:4973]
2025-09-30T14:51:51.307727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895065359273127:4973]
2025-09-30T14:51:51.307729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895065359273127:4973]
2025-09-30T14:51:51.307742Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:51.307757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:51.307760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:51.307763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:51.307765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:51.307771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:51.307773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:51.307808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895065359273127:4973]
2025-09-30T14:51:51.307825Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:51.307839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:51.307807Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 594
2025-09-30T14:51:51.307808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 594
2025-09-30T14:51:51.307895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:51.307905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:51.307930Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|86383a4e-e16e96a9-9460c332-e6518c92_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:51.307942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:51.307946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:51.307948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:51.307957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:51.307966Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:51.307983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:51.308121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:51.308128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:51.308140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:51.308201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 595 partition: 0 MaxSeqNo: 42 sessionId: src_id|86383a4e-e16e96a9-9460c332-e6518c92_0
2025-09-30T14:51:51.308551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd6ee51-d712180f-cf7b0e8f-d083ccb2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|86383a4e-e16e96a9-9460c332-e6518c92_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:51.311217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86383a4e-e16e96a9-9460c332-e6518c92_0] Write session: try to update token
2025-09-30T14:51:51.311234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86383a4e-e16e96a9-9460c332-e6518c92_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:51.320705Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:51.320727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:51.320739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895065359273127:4973]
2025-09-30T14:51:51.320794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:51.320801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:51.321059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:51.321224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:51.321449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:51.321651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:51.321848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:51.321896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:51.326415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 595 sessionId: src_id|86383a4e-e16e96a9-9460c332-e6518c92_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:51.329120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:51.329458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:51.329484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:51.329516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:51.329608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:51.331175Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:51.331191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:51.331193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:51.331195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:51.331205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895065359273127:4973]
2025-09-30T14:51:51.331209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895065359273127:4973]
2025-09-30T14:51:51.331213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895065359273127:4973]
2025-09-30T14:51:51.331268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:51.331279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.331282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:51.331284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:51.331290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:51.331295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:51.331417Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:51.378094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895065449000771:5419]
2025-09-30T14:51:51.378413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 594, pipe: [1:7555895065449000771:5419]
2025-09-30T14:51:51.438717Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:51.445772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:51.445800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:51.445976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:51.446044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:51.446116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:51.446176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:51.446218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:51.446225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:51.446287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:51.446344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:51.446409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:51.446509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:51.446696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:51.446712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:51.446775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:51.446834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:51.446890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:51.446949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:51.446989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:51.446997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:51.447061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:51.447139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:51.447197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:51.447273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:51.447314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:51.447319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:51.447384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:51.447440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:51.447496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:51.447554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:51.447602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:51.447612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:51.447682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:51.447742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:51.447807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:51.447870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:51.447911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:51.447918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:51.447980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:51.448036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:51.448096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:51.448158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:51.448202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:51.448208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:51.448269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:51.448332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:51.448407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:51.448463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:51.448521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:51.448528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:51.448589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:51.448646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:51.448705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:51.448763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:51.448806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:51.448812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:51.448871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:51.448926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:51.448983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:51.449042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:51.449083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:51.449089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:51.449138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895065449000771:5419], now have 1 active actors on pipe
2025-09-30T14:51:51.449314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895065449000771:5419]
2025-09-30T14:51:51.449328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:51.449333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:51.449345Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:51.449361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 595 reason: error at write: Disconnected sessionId: src_id|86383a4e-e16e96a9-9460c332-e6518c92_0
2025-09-30T14:51:51.449517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 595 sessionId: src_id|86383a4e-e16e96a9-9460c332-e6518c92_0 is DEAD
2025-09-30T14:51:51.449648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86383a4e-e16e96a9-9460c332-e6518c92_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:51.449656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86383a4e-e16e96a9-9460c332-e6518c92_0] Write session will restart in 0.006865s
2025-09-30T14:51:51.449674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86383a4e-e16e96a9-9460c332-e6518c92_0] Write session: Do CDS request
2025-09-30T14:51:51.449678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86383a4e-e16e96a9-9460c332-e6518c92_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:51.449959Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:51.457744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86383a4e-e16e96a9-9460c332-e6518c92_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:51.457817Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:51.457838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 596
2025-09-30T14:51:51.457979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 596 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:51.458015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 596 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:51.458020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=596 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:51.458024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:51.458447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 596 sessionId:  describe result for acl check
2025-09-30T14:51:51.458490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:51.458500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:51.458504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:51.458510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895065449000807:5950] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:51.459064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895065449000807:5950] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:51.462576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895065449000807:5950] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:51.463574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:51.465697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:51.465965Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:51.465976Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:51.465987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:51.466053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:51.466095Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895065359273306:4975]
2025-09-30T14:51:51.466124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895065449000807:5950] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:51.466142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895065449000807:5950] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:51.466145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895065449000807:5950] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:51.466154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 596 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:51.466737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:51.467036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:51.467083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:51.467433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:51.467486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:51.467492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:51.467493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:51.467494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:51.467496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:51.467497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:51.467498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:51.467499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:51.467501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:51.467502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:51.467503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.467505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.467506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.467507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:51.467509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:51.467514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:51.467525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:51.467529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:51.467532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:51.467536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:51.467540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:51.467544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:51.467549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:51.467553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:51.467557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:51.467561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.467565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.467569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.467574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:51.467578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:51.467586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:51.467593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:51.467600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:51.467605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:51.467610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:51.467615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:51.467619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:51.467625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:51.467630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:51.467635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:51.467639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:51.467644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:51.467649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:51.467654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:51.467659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:51.467664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:51.467674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:51.467679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:51.467684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:51.467689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:51.467698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.467703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.467708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.467713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.467718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.467723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.467727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:51.467733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:51.467743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:51.467748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:51.467791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:51.472929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:51.473983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:51.474000Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:51.474002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:51.474005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:51.474012Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 595 [2:7555895065359273306:4975]
2025-09-30T14:51:51.474027Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:51.474044Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:51.474051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:51.474054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:51.474056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:51.474071Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:51.474077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:51.474085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:51.474141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.474149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.474151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.474154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:51.474156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:51.474216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:51.474224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.474238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.474253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.474276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:51.474298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895065449000773:2454], now have 1 active actors on pipe
2025-09-30T14:51:51.474306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895065449000947:5950], now have 1 active actors on pipe
2025-09-30T14:51:51.474313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895065359273301:4975]
2025-09-30T14:51:51.474316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895065359273301:4975]
2025-09-30T14:51:51.474318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895065359273301:4975]
2025-09-30T14:51:51.474331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:51.474343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:51.474345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:51.474349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:51.474352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:51.474358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:51.474361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:51.474384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895065359273301:4975]
2025-09-30T14:51:51.474390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:51.474397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:51.474404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 595
2025-09-30T14:51:51.474410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 595
2025-09-30T14:51:51.474515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:51.474525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:51.474552Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eecf1e25-f3dbc6ae-40ff9701-5797b89c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:51.474564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:51.474568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:51.474575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:51.474585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:51.474597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:51.474613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:51.474774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:51.474781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:51.474797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:51.474886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 596 partition: 0 MaxSeqNo: 42 sessionId: src_id|eecf1e25-f3dbc6ae-40ff9701-5797b89c_0
2025-09-30T14:51:51.475228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86383a4e-e16e96a9-9460c332-e6518c92_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|eecf1e25-f3dbc6ae-40ff9701-5797b89c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:51.478204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eecf1e25-f3dbc6ae-40ff9701-5797b89c_0] Write session: try to update token
2025-09-30T14:51:51.478227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eecf1e25-f3dbc6ae-40ff9701-5797b89c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:51.486395Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:51.486415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:51.486438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895065359273301:4975]
2025-09-30T14:51:51.486482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:51.486502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:51.486678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:51.486817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:51.486961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:51.487115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:51.487353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:51.487395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:51.493138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 596 sessionId: src_id|eecf1e25-f3dbc6ae-40ff9701-5797b89c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:51.495972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:51.496198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:51.496221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:51.496254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:51.496372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:51.497406Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:51.497425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:51.497428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:51.497430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:51.497439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895065359273301:4975]
2025-09-30T14:51:51.497443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895065359273301:4975]
2025-09-30T14:51:51.497448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895065359273301:4975]
2025-09-30T14:51:51.497487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:51.497488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:51.497495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.497498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:51.497502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:51.497506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:51.497627Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:51.549631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895065449000958:5419]
2025-09-30T14:51:51.549915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 595, pipe: [1:7555895065449000958:5419]
2025-09-30T14:51:51.605313Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:51.612761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:51.612792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:51.612951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:51.613009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:51.613067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:51.613135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:51.613187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:51.613198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:51.613271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:51.613334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:51.613390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:51.613455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:51.613497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:51.613506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:51.613576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:51.613634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:51.613696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:51.613759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:51.613808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:51.613814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:51.613876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:51.613940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:51.614000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:51.614064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:51.614106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:51.614111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:51.614171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:51.614226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:51.614286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:51.614347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:51.614389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:51.614391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:51.614471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:51.614528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:51.614590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:51.614660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:51.614714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:51.614724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:51.614789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:51.614851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:51.614923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:51.614993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:51.615046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:51.615052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:51.615117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:51.615177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:51.615265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:51.615335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:51.615383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:51.615390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:51.615456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:51.615516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:51.615577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:51.615638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:51.615680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:51.615688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:51.615750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:51.615803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:51.615860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:51.615916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:51.615955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:51.615960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:51.616009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895065449000958:5419], now have 1 active actors on pipe
2025-09-30T14:51:51.616245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:51.616268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:51.616273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:51.616305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 596 reason: error at write: Disconnected sessionId: src_id|eecf1e25-f3dbc6ae-40ff9701-5797b89c_0
2025-09-30T14:51:51.616308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895065449000958:5419]
2025-09-30T14:51:51.616491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 596 sessionId: src_id|eecf1e25-f3dbc6ae-40ff9701-5797b89c_0 is DEAD
2025-09-30T14:51:51.616620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eecf1e25-f3dbc6ae-40ff9701-5797b89c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:51.616630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eecf1e25-f3dbc6ae-40ff9701-5797b89c_0] Write session will restart in 0.005186s
2025-09-30T14:51:51.616653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eecf1e25-f3dbc6ae-40ff9701-5797b89c_0] Write session: Do CDS request
2025-09-30T14:51:51.616659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eecf1e25-f3dbc6ae-40ff9701-5797b89c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:51.616855Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:51.622712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eecf1e25-f3dbc6ae-40ff9701-5797b89c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:51.622816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:51.622832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 597
2025-09-30T14:51:51.622962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 597 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:51.622987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 597 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:51.622992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=597 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:51.622995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:51.623425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 597 sessionId:  describe result for acl check
2025-09-30T14:51:51.623471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:51.623478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:51.623483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:51.623488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895065449000975:5955] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:51.624039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895065449000975:5955] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:51.627217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895065449000975:5955] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:51.630279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895065449000975:5955] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:51.630296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895065449000975:5955] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:51.630300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895065449000975:5955] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:51.630309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 597 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:51.630710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:51.632851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:51.633065Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:51.633077Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:51.633091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:51.633141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:51.633178Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895065359273485:4978]
2025-09-30T14:51:51.633880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:51.634157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:51.634197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:51.634537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:51.634595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:51.634601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:51.634603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:51.634604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:51.634606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:51.634607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:51.634608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:51.634610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:51.634611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:51.634613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:51.634615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.634616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.634617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.634618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:51.634620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:51.634626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:51.634637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:51.634642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:51.634647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:51.634652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:51.634657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:51.634662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:51.634666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:51.634671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:51.634676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:51.634681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.634685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.634690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.634695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:51.634699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:51.634707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:51.634716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:51.634727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:51.634734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:51.634743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:51.634749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:51.634758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:51.634764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:51.634774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:51.634780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:51.634793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:51.634799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:51.634805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:51.634811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:51.634820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:51.634826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:51.634837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:51.634843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:51.634852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:51.634859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:51.634869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.634875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.634884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.634890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.634895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.634901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.634906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:51.634913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:51.634923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:51.634929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:51.634983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:51.640249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:51.641367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:51.641387Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:51.641390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:51.641395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:51.641402Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 596 [2:7555895065359273485:4978]
2025-09-30T14:51:51.641418Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:51.641433Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:51.641437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:51.641439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:51.641442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:51.641459Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:51.641472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:51.641483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:51.641546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.641555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.641557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.641561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:51.641563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:51.641630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:51.641637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.641650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.641666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.641689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:51.641711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895065449000960:2454], now have 1 active actors on pipe
2025-09-30T14:51:51.641719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895065449001130:5955], now have 1 active actors on pipe
2025-09-30T14:51:51.641726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895065359273480:4978]
2025-09-30T14:51:51.641728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895065359273480:4978]
2025-09-30T14:51:51.641730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895065359273480:4978]
2025-09-30T14:51:51.641744Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:51.641756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:51.641759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:51.641762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:51.641765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:51.641776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:51.641780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:51.641756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 596
2025-09-30T14:51:51.641786Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 596
2025-09-30T14:51:51.641820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:51.641830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:51.641843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895065359273480:4978]
2025-09-30T14:51:51.641855Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:51.641867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:51.641892Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64ec3cdc-b0bba32-1e887763-fa424473_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:51.641903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:51.641908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:51.641910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:51.641920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:51.641934Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:51.641962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:51.642075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:51.642083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:51.642096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:51.642181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 597 partition: 0 MaxSeqNo: 42 sessionId: src_id|64ec3cdc-b0bba32-1e887763-fa424473_0
2025-09-30T14:51:51.642551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eecf1e25-f3dbc6ae-40ff9701-5797b89c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|64ec3cdc-b0bba32-1e887763-fa424473_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:51.645347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64ec3cdc-b0bba32-1e887763-fa424473_0] Write session: try to update token
2025-09-30T14:51:51.645367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64ec3cdc-b0bba32-1e887763-fa424473_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:51.653911Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:51.653931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:51.653933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:51.653936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:51.653944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895065359273480:4978]
2025-09-30T14:51:51.653948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895065359273480:4978]
2025-09-30T14:51:51.653952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895065359273480:4978]
2025-09-30T14:51:51.653990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:51.653996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.653999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:51.654004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:51.654020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:51.654025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:51.654135Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:51.659817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 597 sessionId: src_id|64ec3cdc-b0bba32-1e887763-fa424473_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:51.662537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:51.716556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895065449001143:5419]
2025-09-30T14:51:51.716863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 596, pipe: [1:7555895065449001143:5419]
2025-09-30T14:51:51.763607Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:51.764031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:51.764046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:51.764085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895065449001143:5419], now have 1 active actors on pipe
2025-09-30T14:51:51.764348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:51.764370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895065449001143:5419]
2025-09-30T14:51:51.764394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:51.764481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 597 reason: status is not ok: tablet will be restarted right now sessionId: src_id|64ec3cdc-b0bba32-1e887763-fa424473_0
2025-09-30T14:51:51.764306Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:51.764663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 597 sessionId: src_id|64ec3cdc-b0bba32-1e887763-fa424473_0 is DEAD
2025-09-30T14:51:51.764800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64ec3cdc-b0bba32-1e887763-fa424473_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:51.764813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64ec3cdc-b0bba32-1e887763-fa424473_0] Write session will restart in 0.008477s
2025-09-30T14:51:51.764834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64ec3cdc-b0bba32-1e887763-fa424473_0] Write session: Do CDS request
2025-09-30T14:51:51.764840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64ec3cdc-b0bba32-1e887763-fa424473_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:51.774788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64ec3cdc-b0bba32-1e887763-fa424473_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:51.774866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:51.774884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 598
2025-09-30T14:51:51.775045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 598 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:51.775077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 598 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:51.775087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=598 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:51.775091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:51.775550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 598 sessionId:  describe result for acl check
2025-09-30T14:51:51.775599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:51.775608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:51.775610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:51.775616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895065449001279:5959] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:51.776178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895065449001279:5959] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:51.777879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:51.778202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895065449001279:5959] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:51.779661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:51.779856Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:51.779871Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:51.779884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:51.779956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:51.780000Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895065359273659:4980]
2025-09-30T14:51:51.780623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:51.780722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895065449001279:5959] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:51.780739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895065449001279:5959] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:51.780742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895065449001279:5959] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:51.780750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 598 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:51.780891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:51.780952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:51.781304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:51.781396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:51.781407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:51.781409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:51.781410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:51.781411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:51.781412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:51.781414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:51.781415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:51.781416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:51.781417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:51.781419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.781420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.781421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.781422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:51.781423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:51.781430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:51.781440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:51.781444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:51.781448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:51.781452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:51.781455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:51.781459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:51.781463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:51.781467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:51.781472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:51.781476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.781480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.781484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.781488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:51.781492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:51.781500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:51.781508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:51.781514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:51.781527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:51.781532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:51.781542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:51.781546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:51.781558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:51.781562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:51.781574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:51.781583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:51.781588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:51.781593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:51.781602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:51.781607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:51.781612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:51.781621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:51.781631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:51.781640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:51.781647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:51.781656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.781665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.781673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.781678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.781687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.781695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.781704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:51.781714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:51.781723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:51.781732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:51.781779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:51.787336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:51.788273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:51.788294Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:51.788297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:51.788300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:51.788308Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 597 [2:7555895065359273659:4980]
2025-09-30T14:51:51.788324Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:51.788346Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:51.788351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:51.788354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:51.788357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:51.788373Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:51.788392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:51.788404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:51.788464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.788472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.788474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.788478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:51.788481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:51.788548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:51.788557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.788571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.788587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.788609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:51.788629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895065449001145:2454], now have 1 active actors on pipe
2025-09-30T14:51:51.788633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895065449001320:5959], now have 1 active actors on pipe
2025-09-30T14:51:51.788638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895065359273654:4980]
2025-09-30T14:51:51.788641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895065359273654:4980]
2025-09-30T14:51:51.788643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895065359273654:4980]
2025-09-30T14:51:51.788657Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:51.788673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:51.788676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:51.788676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:51.788679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:51.788690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:51.788694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:51.788710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 597
2025-09-30T14:51:51.788737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895065359273654:4980]
2025-09-30T14:51:51.788748Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:51.788754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:51.788711Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 597
2025-09-30T14:51:51.788774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:51.788780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:51.788815Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3509d4d7-87774169-44e59732-c4766aad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:51.788828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:51.788832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:51.788834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:51.788844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:51.788856Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:51.788877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:51.789066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:51.789079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:51.789099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:51.789197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 598 partition: 0 MaxSeqNo: 42 sessionId: src_id|3509d4d7-87774169-44e59732-c4766aad_0
2025-09-30T14:51:51.789554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64ec3cdc-b0bba32-1e887763-fa424473_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3509d4d7-87774169-44e59732-c4766aad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:51.792216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3509d4d7-87774169-44e59732-c4766aad_0] Write session: try to update token
2025-09-30T14:51:51.792235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3509d4d7-87774169-44e59732-c4766aad_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:51.800812Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:51.800837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:51.800840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:51.800842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:51.800854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895065359273654:4980]
2025-09-30T14:51:51.800859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895065359273654:4980]
2025-09-30T14:51:51.800863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895065359273654:4980]
2025-09-30T14:51:51.800907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:51.800910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:51.800919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.800922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:51.800935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:51.800941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:51.801124Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:51.806561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 598 sessionId: src_id|3509d4d7-87774169-44e59732-c4766aad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:51.809255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:51.864496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895065449001329:5419]
2025-09-30T14:51:51.864768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 597, pipe: [1:7555895065449001329:5419]
2025-09-30T14:51:51.907781Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:51.908285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:51.908303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:51.908339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895065449001329:5419], now have 1 active actors on pipe
2025-09-30T14:51:51.908507Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:51.908503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:51.908544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:51.908548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:51.908553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895065449001329:5419]
2025-09-30T14:51:51.908612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 598 reason: error at write: Disconnected sessionId: src_id|3509d4d7-87774169-44e59732-c4766aad_0
2025-09-30T14:51:51.908774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 598 sessionId: src_id|3509d4d7-87774169-44e59732-c4766aad_0 is DEAD
2025-09-30T14:51:51.908943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3509d4d7-87774169-44e59732-c4766aad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:51.908954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3509d4d7-87774169-44e59732-c4766aad_0] Write session will restart in 0.008007s
2025-09-30T14:51:51.908976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3509d4d7-87774169-44e59732-c4766aad_0] Write session: Do CDS request
2025-09-30T14:51:51.908984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3509d4d7-87774169-44e59732-c4766aad_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:51.917805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3509d4d7-87774169-44e59732-c4766aad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:51.917853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:51.917870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 599
2025-09-30T14:51:51.918057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 599 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:51.918111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 599 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:51.918122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=599 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:51.918127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:51.918654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 599 sessionId:  describe result for acl check
2025-09-30T14:51:51.918700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:51.918707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:51.918709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:51.918717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895065449001380:5964] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:51.919272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895065449001380:5964] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:51.921679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895065449001380:5964] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:51.923865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895065449001380:5964] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:51.923882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895065449001380:5964] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:51.923886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895065449001380:5964] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:51.923895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 599 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:51.923819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:51.926306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:51.926502Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:51.926509Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:51.926517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:51.926556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:51.926592Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895065359273850:4983]
2025-09-30T14:51:51.927059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:51.927387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:51.927450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:51.927809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:51.927874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:51.927881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:51.927882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:51.927883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:51.927884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:51.927885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:51.927886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:51.927887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:51.927888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:51.927889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:51.927890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.927892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.927893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.927894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:51.927896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:51.927904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:51.927914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:51.927919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:51.927923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:51.927927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:51.927932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:51.927935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:51.927938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:51.927941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:51.927945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:51.927949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.927953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.927957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.927960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:51.927963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:51.927972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:51.927980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:51.927988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:51.927994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:51.928000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:51.928017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:51.928031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:51.928045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:51.928058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:51.928063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:51.928072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:51.928079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:51.928090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:51.928102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:51.928131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:51.928142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:51.928149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:51.928154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:51.928158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:51.928167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:51.928174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.928185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.928190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.928202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.928213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.928219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.928230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:51.928236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:51.928247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:51.928259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:51.928314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:51.933780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:51.934617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:51.934635Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:51.934638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:51.934641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:51.934648Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 598 [2:7555895065359273850:4983]
2025-09-30T14:51:51.934666Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:51.934680Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:51.934683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:51.934686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:51.934689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:51.934705Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:51.934715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:51.934721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:51.934789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.934797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.934799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.934803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:51.934806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:51.934877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:51.934886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.934898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:51.934910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:51.934928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:51.934955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895065449001516:5964], now have 1 active actors on pipe
2025-09-30T14:51:51.934964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895065449001343:2454], now have 1 active actors on pipe
2025-09-30T14:51:51.934970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895065359273844:4983]
2025-09-30T14:51:51.934973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895065359273844:4983]
2025-09-30T14:51:51.934975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895065359273844:4983]
2025-09-30T14:51:51.934987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:51.935006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:51.935024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 598
2025-09-30T14:51:51.935017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:51.935025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:51.935029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:51.935034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 598
2025-09-30T14:51:51.935030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:51.935033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:51.935061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895065359273844:4983]
2025-09-30T14:51:51.935065Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:51.935085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:51.935093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:51.935098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:51.935130Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e73f181f-870ebc79-9e53860c-cdb7b255_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:51.935145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:51.935148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:51.935151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:51.935161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:51.935171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:51.935184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:51.935349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:51.935357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:51.935369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:51.935458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 599 partition: 0 MaxSeqNo: 42 sessionId: src_id|e73f181f-870ebc79-9e53860c-cdb7b255_0
2025-09-30T14:51:51.935790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3509d4d7-87774169-44e59732-c4766aad_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e73f181f-870ebc79-9e53860c-cdb7b255_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:51.938522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e73f181f-870ebc79-9e53860c-cdb7b255_0] Write session: try to update token
2025-09-30T14:51:51.938542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e73f181f-870ebc79-9e53860c-cdb7b255_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:51.946936Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:51.946964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:51.946977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895065359273844:4983]
2025-09-30T14:51:51.947028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:51.947034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:51.947339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:51.947490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:51.947708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:51.947924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:51.948203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:51.948258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:51.953793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 599 sessionId: src_id|e73f181f-870ebc79-9e53860c-cdb7b255_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:51.956535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:51.957003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:51.957030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:51.958157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:51.958190Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:51.958193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:51.958195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:51.958197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:51.958206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895065359273844:4983]
2025-09-30T14:51:51.958210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895065359273844:4983]
2025-09-30T14:51:51.958213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895065359273844:4983]
2025-09-30T14:51:51.958235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:51.958242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:51.958248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:51.958249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:51.958251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:51.958253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:51.958264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:51.958381Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:52.008891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895069743968833:5419]
2025-09-30T14:51:52.009165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 598, pipe: [1:7555895069743968833:5419]
2025-09-30T14:51:52.067336Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:52.075429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:52.075454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:52.075609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:52.075677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:52.075742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:52.075812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:52.075856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:52.075866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:52.075934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:52.076006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:52.076069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:52.076131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:52.076183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:52.076191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:52.076252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:52.076315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:52.076378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:52.076444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:52.076484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:52.076491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:52.076557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:52.076615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:52.076683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:52.076740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:52.076783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:52.076791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:52.076853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:52.076907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:52.076969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:52.077034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:52.077077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:52.077085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:52.077150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:52.077215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:52.077287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:52.077353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:52.077393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:52.077403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:52.077470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:52.077531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:52.077596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:52.077659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:52.077721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:52.077731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:52.077794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:52.077857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:52.077921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:52.077985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:52.078030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:52.078039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:52.078111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:52.078181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:52.078251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:52.078322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:52.078374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:52.078382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:52.078468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:52.078538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:52.078600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:52.078658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:52.078700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:52.078703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:52.078751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895069743968833:5419], now have 1 active actors on pipe
2025-09-30T14:51:52.078911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:52.078929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:52.078954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 599 reason: error at write: Disconnected sessionId: src_id|e73f181f-870ebc79-9e53860c-cdb7b255_0
2025-09-30T14:51:52.079123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 599 sessionId: src_id|e73f181f-870ebc79-9e53860c-cdb7b255_0 is DEAD
2025-09-30T14:51:52.079288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e73f181f-870ebc79-9e53860c-cdb7b255_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:52.079296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e73f181f-870ebc79-9e53860c-cdb7b255_0] Write session will restart in 0.006631s
2025-09-30T14:51:52.079319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e73f181f-870ebc79-9e53860c-cdb7b255_0] Write session: Do CDS request
2025-09-30T14:51:52.079325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e73f181f-870ebc79-9e53860c-cdb7b255_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:52.079503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895069743968833:5419]
2025-09-30T14:51:52.079521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:52.079825Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:52.086788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e73f181f-870ebc79-9e53860c-cdb7b255_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:52.086889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:52.086909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 600
2025-09-30T14:51:52.087063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 600 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:52.087100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 600 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:52.087105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=600 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:52.087109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:52.087519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 600 sessionId:  describe result for acl check
2025-09-30T14:51:52.087556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:52.087558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:52.087560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:52.087565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895069743968871:5976] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:52.088108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895069743968871:5976] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:52.091259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895069743968871:5976] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:52.094203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895069743968871:5976] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:52.094219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895069743968871:5976] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:52.094223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895069743968871:5976] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:52.094230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 600 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:52.094738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:52.097044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:52.097248Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:52.097261Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:52.097273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:52.097329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:52.097364Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895069654241365:4996]
2025-09-30T14:51:52.097996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:52.098356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:52.098434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:52.098764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:52.098838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:52.098846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:52.098848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:52.098849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:52.098850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:52.098851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:52.098852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:52.098854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:52.098855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:52.098856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:52.098858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.098859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.098860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.098861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:52.098863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:52.098868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:52.098879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:52.098884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:52.098889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:52.098893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:52.098897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:52.098901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:52.098906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:52.098910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:52.098915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:52.098919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.098924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.098928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.098932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:52.098936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:52.098944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:52.098952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:52.098958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:52.098964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:52.098969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:52.098975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:52.098980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:52.098986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:52.098990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:52.098996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:52.099001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:52.099007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:52.099018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:52.099023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:52.099028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:52.099033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:52.099044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:52.099050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:52.099057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:52.099062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:52.099067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.099073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.099078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.099084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.099090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.099095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.099105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:52.099111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:52.099116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:52.099126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:52.099171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:52.104937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:52.105966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:52.105989Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:52.105992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:52.105996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:52.106003Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 599 [2:7555895069654241365:4996]
2025-09-30T14:51:52.106019Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:52.106034Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:52.106037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:52.106040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:52.106042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:52.106058Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:52.106071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:52.106078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:52.106139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.106147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.106150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.106153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:52.106156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:52.106221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:52.106228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.106242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.106255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.106277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:52.106296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895069743968854:2454], now have 1 active actors on pipe
2025-09-30T14:51:52.106300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895069743969024:5976], now have 1 active actors on pipe
2025-09-30T14:51:52.106306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895069654241353:4996]
2025-09-30T14:51:52.106309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895069654241353:4996]
2025-09-30T14:51:52.106311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895069654241353:4996]
2025-09-30T14:51:52.106327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:52.106343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:52.106348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:52.106352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:52.106354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:52.106365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:52.106368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:52.106371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 599
2025-09-30T14:51:52.106399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895069654241353:4996]
2025-09-30T14:51:52.106409Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:52.106412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 599
2025-09-30T14:51:52.106440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:52.106464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:52.106468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:52.106494Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|700e14f6-1e2ca7e6-4c9b2cdf-3c7b507e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:52.106506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:52.106511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:52.106513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:52.106521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:52.106531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:52.106544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:52.106689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:52.106697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:52.106710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:52.106787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 600 partition: 0 MaxSeqNo: 42 sessionId: src_id|700e14f6-1e2ca7e6-4c9b2cdf-3c7b507e_0
2025-09-30T14:51:52.107118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e73f181f-870ebc79-9e53860c-cdb7b255_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|700e14f6-1e2ca7e6-4c9b2cdf-3c7b507e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:52.109949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|700e14f6-1e2ca7e6-4c9b2cdf-3c7b507e_0] Write session: try to update token
2025-09-30T14:51:52.109971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|700e14f6-1e2ca7e6-4c9b2cdf-3c7b507e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:52.118236Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:52.118262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:52.118271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895069654241353:4996]
2025-09-30T14:51:52.118307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:52.118312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:52.118488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:52.118632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:52.118772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:52.118904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:52.119091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:52.119139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:52.125027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 600 sessionId: src_id|700e14f6-1e2ca7e6-4c9b2cdf-3c7b507e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:52.127787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:52.127994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:52.128020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:52.128054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:52.128103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:52.129265Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:52.129282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:52.129284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:52.129286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:52.129294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895069654241353:4996]
2025-09-30T14:51:52.129299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895069654241353:4996]
2025-09-30T14:51:52.129302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895069654241353:4996]
2025-09-30T14:51:52.129339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:52.129352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:52.129355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.129358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:52.129358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:52.129364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:52.129494Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:52.179910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895069743969046:5419]
2025-09-30T14:51:52.180169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 599, pipe: [1:7555895069743969046:5419]
2025-09-30T14:51:52.241555Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:52.249618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:52.249651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:52.249830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:52.249897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:52.249962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:52.250033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:52.250079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:52.250088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:52.250157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:52.250221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:52.250284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:52.250351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:52.250398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:52.250406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:52.250489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:52.250551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:52.250614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:52.250672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:52.250716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:52.250725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:52.250790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:52.250860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:52.250926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:52.250995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:52.251039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:52.251045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:52.251108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:52.251165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:52.251227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:52.251309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:52.251351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:52.251360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:52.251432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:52.251506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:52.251573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:52.251641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:52.251691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:52.251697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:52.251758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:52.251813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:52.251874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:52.251939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:52.251982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:52.251991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:52.252065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:52.252121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:52.252177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:52.252238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:52.252276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:52.252285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:52.252354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:52.252410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:52.252474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:52.252535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:52.252582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:52.252589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:52.252656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:52.252726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:52.252792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:52.252861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:52.252901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:52.252906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:52.252968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895069743969046:5419], now have 1 active actors on pipe
2025-09-30T14:51:52.253277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:52.253353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895069743969046:5419]
2025-09-30T14:51:52.253356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:52.253360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:52.253387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 600 reason: error at write: Disconnected sessionId: src_id|700e14f6-1e2ca7e6-4c9b2cdf-3c7b507e_0
2025-09-30T14:51:52.253560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 600 sessionId: src_id|700e14f6-1e2ca7e6-4c9b2cdf-3c7b507e_0 is DEAD
2025-09-30T14:51:52.253683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|700e14f6-1e2ca7e6-4c9b2cdf-3c7b507e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:52.253694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|700e14f6-1e2ca7e6-4c9b2cdf-3c7b507e_0] Write session will restart in 0.008861s
2025-09-30T14:51:52.253718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|700e14f6-1e2ca7e6-4c9b2cdf-3c7b507e_0] Write session: Do CDS request
2025-09-30T14:51:52.253723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|700e14f6-1e2ca7e6-4c9b2cdf-3c7b507e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:52.254066Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:52.263706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|700e14f6-1e2ca7e6-4c9b2cdf-3c7b507e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:52.264318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:52.264338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 601
2025-09-30T14:51:52.264491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 601 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:52.264518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 601 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:52.264524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=601 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:52.264528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:52.264921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 601 sessionId:  describe result for acl check
2025-09-30T14:51:52.264960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:52.264964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:52.264966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:52.264972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895069743969114:5981] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:52.265492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895069743969114:5981] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:52.268449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895069743969114:5981] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:52.269463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:52.271766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:52.271984Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:52.271996Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:52.272006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:52.272061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:52.272114Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895069654241544:5000]
2025-09-30T14:51:52.272291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895069743969114:5981] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:52.272310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895069743969114:5981] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:52.272313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895069743969114:5981] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:52.272321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 601 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:52.272789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:52.273550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:52.273612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:52.274008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:52.274080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:52.274086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:52.274088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:52.274089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:52.274090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:52.274091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:52.274093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:52.274094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:52.274095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:52.274097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:52.274098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.274100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.274101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.274103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:52.274104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:52.274110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:52.274121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:52.274125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:52.274130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:52.274134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:52.274138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:52.274142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:52.274146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:52.274151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:52.274155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:52.274159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.274163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.274166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.274169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:52.274173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:52.274183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:52.274191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:52.274196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:52.274201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:52.274206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:52.274211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:52.274215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:52.274219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:52.274225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:52.274230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:52.274235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:52.274240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:52.274245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:52.274250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:52.274261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:52.274267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:52.274272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:52.274277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:52.274287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:52.274293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:52.274299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.274308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.274313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.274318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.274324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.274330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.274334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:52.274340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:52.274350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:52.274355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:52.274397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:52.280249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:52.281855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 600
2025-09-30T14:51:52.281860Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 600
2025-09-30T14:51:52.281416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:52.281444Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:52.281447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:52.281451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:52.281459Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 600 [2:7555895069654241544:5000]
2025-09-30T14:51:52.281477Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:52.281495Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:52.281499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:52.281503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:52.281506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:52.281522Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:52.281530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:52.281538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:52.281606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.281608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.281611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.281614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:52.281617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:52.281692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:52.281695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.281710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.281740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.281758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:52.281777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895069743969225:5981], now have 1 active actors on pipe
2025-09-30T14:51:52.281781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895069743969049:2454], now have 1 active actors on pipe
2025-09-30T14:51:52.281788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895069654241539:5000]
2025-09-30T14:51:52.281791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895069654241539:5000]
2025-09-30T14:51:52.281793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895069654241539:5000]
2025-09-30T14:51:52.281808Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:52.281823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:52.281822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:52.281825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:52.281827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:52.281838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:52.281842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:52.281880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895069654241539:5000]
2025-09-30T14:51:52.281883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:52.281894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:52.281917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:52.281922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:52.281953Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|813b39c4-430c9b47-48170ae2-6700b043_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:52.281962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:52.281967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:52.281969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:52.281980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:52.281989Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:52.282005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:52.282179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:52.282187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:52.282222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:52.282322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 601 partition: 0 MaxSeqNo: 42 sessionId: src_id|813b39c4-430c9b47-48170ae2-6700b043_0
2025-09-30T14:51:52.282710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|700e14f6-1e2ca7e6-4c9b2cdf-3c7b507e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|813b39c4-430c9b47-48170ae2-6700b043_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:52.285617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|813b39c4-430c9b47-48170ae2-6700b043_0] Write session: try to update token
2025-09-30T14:51:52.285643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|813b39c4-430c9b47-48170ae2-6700b043_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:52.294597Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:52.294616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:52.294619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:52.294620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:52.294627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895069654241539:5000]
2025-09-30T14:51:52.294631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895069654241539:5000]
2025-09-30T14:51:52.294634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895069654241539:5000]
2025-09-30T14:51:52.294672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:52.294679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.294682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:52.294682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:52.294687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:52.294691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:52.294822Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:52.301749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 601 sessionId: src_id|813b39c4-430c9b47-48170ae2-6700b043_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:52.304637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:52.353480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895069743969236:5419]
2025-09-30T14:51:52.353764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 600, pipe: [1:7555895069743969236:5419]
2025-09-30T14:51:52.405813Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:52.406256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:52.406271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:52.406290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895069743969236:5419], now have 1 active actors on pipe
2025-09-30T14:51:52.406524Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:52.406569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:52.406585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:52.406606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895069743969236:5419]
2025-09-30T14:51:52.406626Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:52.406660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 601 reason: error at write: Disconnected sessionId: src_id|813b39c4-430c9b47-48170ae2-6700b043_0
2025-09-30T14:51:52.406661Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:51:52.406741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 601 sessionId: src_id|813b39c4-430c9b47-48170ae2-6700b043_0 is DEAD
2025-09-30T14:51:52.406755Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 6 consumer shared/user session shared/user_1_6_16524020304425833425_v1 is DEAD
2025-09-30T14:51:52.406866Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895005319445159:5416] disconnected; active server actors: 1
2025-09-30T14:51:52.406876Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895005319445159:5416] client user disconnected session shared/user_1_6_16524020304425833425_v1
2025-09-30T14:51:52.407023Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:51:52.407025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|813b39c4-430c9b47-48170ae2-6700b043_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:52.407041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|813b39c4-430c9b47-48170ae2-6700b043_0] Write session will restart in 0.008568s
2025-09-30T14:51:52.407058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|813b39c4-430c9b47-48170ae2-6700b043_0] Write session: Do CDS request
2025-09-30T14:51:52.407062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|813b39c4-430c9b47-48170ae2-6700b043_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:52.407127Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:51:52.407133Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:51:52.407147Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.009944s
2025-09-30T14:51:52.416713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|813b39c4-430c9b47-48170ae2-6700b043_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:52.416801Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:52.416820Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 602
2025-09-30T14:51:52.416935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 602 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:52.416979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 602 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:52.416988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=602 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:52.416992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:52.417434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 602 sessionId:  describe result for acl check
2025-09-30T14:51:52.417473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:52.417480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:52.417484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:52.417489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895069743969313:5985] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:52.417565Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:51:52.417691Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:51:52.417701Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 7
2025-09-30T14:51:52.417821Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 7 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:51:52.417865Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:51:52.417939Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 auth for : user
2025-09-30T14:51:52.418041Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 Handle describe topics response
2025-09-30T14:51:52.418054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895069743969313:5985] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:52.418062Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 auth is DEAD
2025-09-30T14:51:52.418075Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:51:52.418321Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:51:52.418446Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_7_8935728575530857911_v1
2025-09-30T14:51:52.418500Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895069743969350:5987] connected; active server actors: 1
2025-09-30T14:51:52.418550Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555895069743969350:5987] session shared/user_1_7_8935728575530857911_v1
2025-09-30T14:51:52.418572Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:51:52.418583Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:51:52.418589Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_7_8935728575530857911_v1" (Sender=[1:7555895069743969323:5987], Pipe=[1:7555895069743969350:5987], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:51:52.418593Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:51:52.418607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:51:52.418616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_7_8935728575530857911_v1" (Sender=[1:7555895069743969323:5987], Pipe=[1:7555895069743969350:5987], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:51:52.418631Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_7_8935728575530857911_v1" sender [1:7555895069743969323:5987] lock partition 0 for ReadingSession "shared/user_1_7_8935728575530857911_v1" (Sender=[1:7555895069743969323:5987], Pipe=[1:7555895069743969350:5987], Partitions=[], ActiveFamilyCount=1) generation 1 step 7
2025-09-30T14:51:52.418644Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:51:52.418656Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000045s
2025-09-30T14:51:52.418871Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 7 Session: "shared/user_1_7_8935728575530857911_v1" ClientId: "user" PipeClient { RawX1: 7555895069743969350 RawX2: 4503603922343779 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:51:52.418899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:51:52.420388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895069743969313:5985] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:52.421034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:52.423195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:52.423419Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:52.423430Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:52.423440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:52.423493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:52.423536Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895069654241726:5002]
2025-09-30T14:51:52.423524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895069743969313:5985] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:52.423538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895069743969313:5985] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:52.423542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895069743969313:5985] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:52.423550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 602 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:52.424175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:52.424443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:52.424492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:52.424791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:52.424849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:52.424856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:52.424857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:52.424858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:52.424859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:52.424860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:52.424860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:52.424861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:52.424862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:52.424863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:52.424863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.424864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.424865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.424865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:52.424866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:52.424870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:52.424876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:52.424879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:52.424881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:52.424884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:52.424886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:52.424889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:52.424891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:52.424893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:52.424896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:52.424898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.424900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.424903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.424905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:52.424907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:52.424912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:52.424918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:52.424921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:52.424925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:52.424927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:52.424930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:52.424933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:52.424936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:52.424939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:52.424943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:52.424946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:52.424949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:52.424952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:52.424954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:52.424957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:52.424960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:52.424962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:52.424965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:52.424968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:52.424970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:52.424973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.424976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.424978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.424981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.424984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.424987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.424989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:52.424992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:52.424995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:52.424998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:52.425037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:52.430505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:52.431417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:52.431436Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:52.431439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:52.431443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:52.431450Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 601 [2:7555895069654241726:5002]
2025-09-30T14:51:52.431467Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:52.431482Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:52.431487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:52.431490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:52.431492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:52.431507Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:52.431521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:52.431533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:52.431599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.431608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.431610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.431614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:52.431617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:52.431681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:52.431688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.431702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.431719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.431752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:52.431773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895069743969375:5991], now have 1 active actors on pipe
2025-09-30T14:51:52.431781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895069743969422:5985], now have 1 active actors on pipe
2025-09-30T14:51:52.431784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895069743969238:2454], now have 1 active actors on pipe
2025-09-30T14:51:52.431790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895069654241721:5002]
2025-09-30T14:51:52.431792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895069654241721:5002]
2025-09-30T14:51:52.431794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895069654241721:5002]
2025-09-30T14:51:52.431807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:52.431825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:52.431829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:52.431833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:52.431836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:52.431845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:52.431848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:52.431880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895069654241721:5002]
2025-09-30T14:51:52.431888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:52.431860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 601, pipe: [1:7555895069743969375:5991]
2025-09-30T14:51:52.431865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 601
2025-09-30T14:51:52.431897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 601
2025-09-30T14:51:52.431905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:52.431921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:52.431925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:52.431938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_7_8935728575530857911_v1 on pipe: [1:7555895069743969375:5991]
2025-09-30T14:51:52.431962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:52.431968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:52.431975Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_7_8935728575530857911_v1:1 with generation 601
2025-09-30T14:51:52.431980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:52.431985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:52.431986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:52.431998Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_7_8935728575530857911_v1
2025-09-30T14:51:52.432000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:52.432024Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62358559-7963e006-4aa1747b-2482802e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:52.432028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:52.432032Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:52.436508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:52.436547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:52.436556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:52.436562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:52.436570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:52.436582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:52.436600Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:52.436612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:51:52.436628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:51:52.436647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:52.436821Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759243912431 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:51:52.436862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:51:52.436869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:52.436883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:52.436900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:52.436901Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 sending to client partition status
2025-09-30T14:51:52.437018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 602 partition: 0 MaxSeqNo: 42 sessionId: src_id|62358559-7963e006-4aa1747b-2482802e_0
2025-09-30T14:51:52.437377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|813b39c4-430c9b47-48170ae2-6700b043_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|62358559-7963e006-4aa1747b-2482802e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:52.440242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62358559-7963e006-4aa1747b-2482802e_0] Write session: try to update token
2025-09-30T14:51:52.440263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62358559-7963e006-4aa1747b-2482802e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:52.444486Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:52.444507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:52.444510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:52.444512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:52.444521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895069654241721:5002]
2025-09-30T14:51:52.444525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895069654241721:5002]
2025-09-30T14:51:52.444529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895069654241721:5002]
2025-09-30T14:51:52.444568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:52.444574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.444577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:52.444583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:52.444589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:52.444593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:52.444757Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:52.455215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 602 sessionId: src_id|62358559-7963e006-4aa1747b-2482802e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:52.458144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:52.556104Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:52.556673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:52.556688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:52.556941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_7_8935728575530857911_v1
2025-09-30T14:51:52.556959Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:52.556939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:52.556956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:52.556994Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_7_8935728575530857911_v1
2025-09-30T14:51:52.557021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 602 reason: error at write: Disconnected sessionId: src_id|62358559-7963e006-4aa1747b-2482802e_0
2025-09-30T14:51:52.557070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895069743969375:5991]
2025-09-30T14:51:52.557097Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:52.557212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 602 sessionId: src_id|62358559-7963e006-4aa1747b-2482802e_0 is DEAD
2025-09-30T14:51:52.557358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62358559-7963e006-4aa1747b-2482802e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:52.557369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62358559-7963e006-4aa1747b-2482802e_0] Write session will restart in 0.005459s
2025-09-30T14:51:52.557396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62358559-7963e006-4aa1747b-2482802e_0] Write session: Do CDS request
2025-09-30T14:51:52.557402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62358559-7963e006-4aa1747b-2482802e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:52.563754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62358559-7963e006-4aa1747b-2482802e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:52.563842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:52.563860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 603
2025-09-30T14:51:52.563999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 603 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:52.564036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 603 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:52.564045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=603 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:52.564052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:52.564475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 603 sessionId:  describe result for acl check
2025-09-30T14:51:52.564511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:52.564513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:52.564515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:52.564521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895069743969451:5994] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:52.565103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895069743969451:5994] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:52.567544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895069743969451:5994] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:52.570219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895069743969451:5994] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:52.570234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895069743969451:5994] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:52.570238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895069743969451:5994] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:52.570246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 603 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:52.571227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:52.573333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:52.573523Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:52.573532Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:52.573540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:52.573582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:52.573611Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895069654241913:5005]
2025-09-30T14:51:52.574093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:52.574437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:52.574504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:52.574864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:52.574923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:52.574929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:52.574930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:52.574931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:52.574933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:52.574934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:52.574935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:52.574936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:52.574937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:52.574938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:52.574939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.574940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.574942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.574943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:52.574944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:52.574950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:52.574960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:52.574964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:52.574968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:52.574973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:52.574976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:52.574980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:52.574984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:52.574990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:52.574994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:52.574998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.575002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.575006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.575010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:52.575014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:52.575021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:52.575031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:52.575039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:52.575045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:52.575049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:52.575054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:52.575061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:52.575066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:52.575072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:52.575078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:52.575083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:52.575093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:52.575097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:52.575109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:52.575115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:52.575120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:52.575127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:52.575132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:52.575140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:52.575145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:52.575151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.575156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.575162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.575167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.575172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.575182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.575186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:52.575191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:52.575197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:52.575203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:52.575278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:52.580821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:52.581646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:52.581660Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:52.581663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:52.581667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:52.581673Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 602 [2:7555895069654241913:5005]
2025-09-30T14:51:52.581689Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:52.581711Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:52.581718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:52.581721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:52.581724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:52.581739Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:52.581751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:52.581762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:52.581820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.581827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.581830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.581833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:52.581836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:52.581902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:52.581910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.581923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.581935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.581953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:52.581972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895069654241908:5005]
2025-09-30T14:51:52.581978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895069654241908:5005]
2025-09-30T14:51:52.581981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895069654241908:5005]
2025-09-30T14:51:52.582007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:52.582027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:52.582030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:52.582033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895069743969612:5994], now have 1 active actors on pipe
2025-09-30T14:51:52.582035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:52.582036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895069743969436:2454], now have 1 active actors on pipe
2025-09-30T14:51:52.582043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:52.582060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:52.582062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:52.582093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895069654241908:5005]
2025-09-30T14:51:52.582077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 602
2025-09-30T14:51:52.582107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:52.582116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:52.582090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 602
2025-09-30T14:51:52.582148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:52.582157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:52.582187Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6cf841bf-7021e6d4-12288229-30d13de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:52.582198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:52.582202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:52.582209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:52.582218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:52.582228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:52.582247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:52.582404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:52.582413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:52.582435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:52.582530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 603 partition: 0 MaxSeqNo: 42 sessionId: src_id|6cf841bf-7021e6d4-12288229-30d13de_0
2025-09-30T14:51:52.582895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62358559-7963e006-4aa1747b-2482802e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6cf841bf-7021e6d4-12288229-30d13de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:52.585611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cf841bf-7021e6d4-12288229-30d13de_0] Write session: try to update token
2025-09-30T14:51:52.585632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cf841bf-7021e6d4-12288229-30d13de_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:52.594060Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:52.594080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:52.594083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:52.594086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:52.594094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895069654241908:5005]
2025-09-30T14:51:52.594098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895069654241908:5005]
2025-09-30T14:51:52.594102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895069654241908:5005]
2025-09-30T14:51:52.594144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:52.594151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.594154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:52.594161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:52.594175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:52.594184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:52.594294Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:52.599964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 603 sessionId: src_id|6cf841bf-7021e6d4-12288229-30d13de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:52.602659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:52.657072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895069743969626:5991]
2025-09-30T14:51:52.657391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 602, pipe: [1:7555895069743969626:5991]
2025-09-30T14:51:52.708716Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:52.709245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:52.709267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:52.709321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895069743969626:5991], now have 1 active actors on pipe
2025-09-30T14:51:52.709569Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:52.709553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:52.709569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:52.709572Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:52.709620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895069743969626:5991]
2025-09-30T14:51:52.709642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 603 reason: error at write: Disconnected sessionId: src_id|6cf841bf-7021e6d4-12288229-30d13de_0
2025-09-30T14:51:52.709808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 603 sessionId: src_id|6cf841bf-7021e6d4-12288229-30d13de_0 is DEAD
2025-09-30T14:51:52.709975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cf841bf-7021e6d4-12288229-30d13de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:52.709988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cf841bf-7021e6d4-12288229-30d13de_0] Write session will restart in 0.006186s
2025-09-30T14:51:52.710012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cf841bf-7021e6d4-12288229-30d13de_0] Write session: Do CDS request
2025-09-30T14:51:52.710020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cf841bf-7021e6d4-12288229-30d13de_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:52.717781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cf841bf-7021e6d4-12288229-30d13de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:52.717844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:52.717862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 604
2025-09-30T14:51:52.718027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 604 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:52.718081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 604 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:52.718091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=604 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:52.718095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:52.718696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 604 sessionId:  describe result for acl check
2025-09-30T14:51:52.718729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:52.718736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:52.718737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:52.718743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895069743969669:5998] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:52.719272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895069743969669:5998] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:52.722162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895069743969669:5998] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:52.723855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:52.724389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:52.724553Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:52.724562Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:52.724574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:52.724620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:52.724664Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895069654242095:5007]
2025-09-30T14:51:52.725329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:52.726551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:52.726605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:52.726792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895069743969669:5998] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:52.726811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895069743969669:5998] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:52.726815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895069743969669:5998] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:52.726824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 604 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:52.726960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:52.727043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:52.727052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:52.727053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:52.727054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:52.727055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:52.727056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:52.727057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:52.727058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:52.727060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:52.727061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:52.727062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.727064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.727065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.727066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:52.727067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:52.727073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:52.727084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:52.727088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:52.727092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:52.727095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:52.727098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:52.727102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:52.727106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:52.727109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:52.727113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:52.727117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.727121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.727124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.727129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:52.727132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:52.727141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:52.727149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:52.727155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:52.727160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:52.727165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:52.727171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:52.727176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:52.727181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:52.727186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:52.727191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:52.727195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:52.727199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:52.727204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:52.727208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:52.727213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:52.727218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:52.727222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:52.727227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:52.727232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:52.727260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:52.727265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.727277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.727281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.727287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.727296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.727302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.727306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:52.727312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:52.727316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:52.727322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:52.727371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:52.732749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:52.733965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:52.733984Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:52.733987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:52.733991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:52.733997Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 603 [2:7555895069654242095:5007]
2025-09-30T14:51:52.734012Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:52.734029Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:52.734032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:52.734035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:52.734037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:52.734053Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:52.734059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:52.734065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:52.734125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.734132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.734134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.734138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:52.734141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:52.734201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:52.734208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.734222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.734234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.734253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:52.734279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895069743969808:5998], now have 1 active actors on pipe
2025-09-30T14:51:52.734287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895069743969627:2454], now have 1 active actors on pipe
2025-09-30T14:51:52.734293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895069654242090:5007]
2025-09-30T14:51:52.734295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895069654242090:5007]
2025-09-30T14:51:52.734297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895069654242090:5007]
2025-09-30T14:51:52.734310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:52.734331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:52.734338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:52.734345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:52.734347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:52.734347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:52.734349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:52.734380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895069654242090:5007]
2025-09-30T14:51:52.734389Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 603
2025-09-30T14:51:52.734411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 603
2025-09-30T14:51:52.734399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:52.734434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:52.734451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:52.734456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:52.734480Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74429f5b-918beedb-7ed3c9dc-99bf8abb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:52.734492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:52.734496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:52.734498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:52.734508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:52.734522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:52.734544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:52.734721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:52.734734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:52.734758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:52.734842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 604 partition: 0 MaxSeqNo: 42 sessionId: src_id|74429f5b-918beedb-7ed3c9dc-99bf8abb_0
2025-09-30T14:51:52.735205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cf841bf-7021e6d4-12288229-30d13de_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|74429f5b-918beedb-7ed3c9dc-99bf8abb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:52.738107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74429f5b-918beedb-7ed3c9dc-99bf8abb_0] Write session: try to update token
2025-09-30T14:51:52.738131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74429f5b-918beedb-7ed3c9dc-99bf8abb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:52.752084Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:52.752099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:52.752109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895069654242090:5007]
2025-09-30T14:51:52.752160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:52.752310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:52.752366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:52.752350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 604 sessionId: src_id|74429f5b-918beedb-7ed3c9dc-99bf8abb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:52.752518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:52.752677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:52.752820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:52.753032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:52.753075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:52.755089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:52.755273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:52.755293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:52.755324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:52.755386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:52.757256Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:52.757272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:52.757274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:52.757276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:52.757285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895069654242090:5007]
2025-09-30T14:51:52.757289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895069654242090:5007]
2025-09-30T14:51:52.757293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895069654242090:5007]
2025-09-30T14:51:52.757326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:52.757333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.757336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:52.757336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:52.757342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:52.757346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:52.757473Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:52.809668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895069743969818:5991]
2025-09-30T14:51:52.809979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 603, pipe: [1:7555895069743969818:5991]
2025-09-30T14:51:52.867661Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:52.875752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:52.875783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:52.875968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:52.876046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:52.876120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:52.876194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:52.876248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:52.876259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:52.876332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:52.876400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:52.876469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:52.876546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:52.876599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:52.876602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:52.876673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:52.876740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:52.876813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:52.876887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:52.876941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:52.876952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:52.877023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:52.877099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:52.877164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:52.877236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:52.877276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:52.877289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:52.877362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:52.877428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:52.877504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:52.877570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:52.877617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:52.877625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:52.877692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:52.877762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:52.877828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:52.877895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:52.877943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:52.877955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:52.878024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:52.878088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:52.878160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:52.878234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:52.878286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:52.878296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:52.878362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:52.878453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:52.878518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:52.878586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:52.878634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:52.878642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:52.878710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:52.878778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:52.878843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:52.878911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:52.878968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:52.878976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:52.879043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:52.879111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:52.879180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:52.879268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:52.879319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:52.879328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:52.879401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895069743969818:5991], now have 1 active actors on pipe
2025-09-30T14:51:52.879661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:52.879679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:52.879691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895069743969818:5991]
2025-09-30T14:51:52.879708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 604 reason: error at write: Disconnected sessionId: src_id|74429f5b-918beedb-7ed3c9dc-99bf8abb_0
2025-09-30T14:51:52.879735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:52.879883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 604 sessionId: src_id|74429f5b-918beedb-7ed3c9dc-99bf8abb_0 is DEAD
2025-09-30T14:51:52.880032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74429f5b-918beedb-7ed3c9dc-99bf8abb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:52.880044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74429f5b-918beedb-7ed3c9dc-99bf8abb_0] Write session will restart in 0.006674s
2025-09-30T14:51:52.880068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74429f5b-918beedb-7ed3c9dc-99bf8abb_0] Write session: Do CDS request
2025-09-30T14:51:52.880074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74429f5b-918beedb-7ed3c9dc-99bf8abb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:52.880447Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:52.887709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74429f5b-918beedb-7ed3c9dc-99bf8abb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:52.887772Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:52.887789Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 605
2025-09-30T14:51:52.887944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 605 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:52.887988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 605 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:52.888008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=605 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:52.888011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:52.888460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 605 sessionId:  describe result for acl check
2025-09-30T14:51:52.888498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:52.888500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:52.888502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:52.888509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895069743969839:6002] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:52.889050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895069743969839:6002] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:52.891859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895069743969839:6002] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:52.894895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895069743969839:6002] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:52.894918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895069743969839:6002] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:52.894922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895069743969839:6002] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:52.894930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 605 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:52.895166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:52.897582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:52.897783Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:52.897796Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:52.897807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:52.897864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:52.897902Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895069654242292:5010]
2025-09-30T14:51:52.898528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:52.898889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:52.898959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:52.899329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:52.899400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:52.899406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:52.899407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:52.899409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:52.899410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:52.899412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:52.899413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:52.899414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:52.899415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:52.899417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:52.899418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.899419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.899420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.899421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:52.899422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:52.899428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:52.899438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:52.899442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:52.899446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:52.899450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:52.899454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:52.899459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:52.899462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:52.899467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:52.899471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:52.899475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.899479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.899483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.899487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:52.899491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:52.899499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:52.899507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:52.899513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:52.899520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:52.899525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:52.899531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:52.899535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:52.899541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:52.899545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:52.899550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:52.899566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:52.899571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:52.899579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:52.899585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:52.899589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:52.899594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:52.899599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:52.899604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:52.899608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:52.899614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:52.899618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.899628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.899632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.899641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.899646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.899652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.899661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:52.899666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:52.899670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:52.899677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:52.899721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:52.905166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:52.906260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:52.906278Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:52.906280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:52.906285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:52.906292Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 604 [2:7555895069654242292:5010]
2025-09-30T14:51:52.906308Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:52.906323Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:52.906327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:52.906330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:52.906332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:52.906347Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:52.906360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:52.906366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:52.906441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.906449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.906451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.906454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:52.906457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:52.906519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:52.906527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.906540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:52.906558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:52.906580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:52.906602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895069743969999:6002], now have 1 active actors on pipe
2025-09-30T14:51:52.906612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895069743969819:2454], now have 1 active actors on pipe
2025-09-30T14:51:52.906619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895069654242286:5010]
2025-09-30T14:51:52.906622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895069654242286:5010]
2025-09-30T14:51:52.906624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895069654242286:5010]
2025-09-30T14:51:52.906637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:52.906652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:52.906659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:52.906663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:52.906665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:52.906672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:52.906676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:52.906663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 604
2025-09-30T14:51:52.906668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 604
2025-09-30T14:51:52.906708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895069654242286:5010]
2025-09-30T14:51:52.906720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:52.906726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:52.906737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:52.906742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:52.906791Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa3b65cc-38f382ed-a43adfe4-add85f4d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:52.906803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:52.906807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:52.906809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:52.906819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:52.906833Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:52.906856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:52.907050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:52.907061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:52.907075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:52.907166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 605 partition: 0 MaxSeqNo: 42 sessionId: src_id|aa3b65cc-38f382ed-a43adfe4-add85f4d_0
2025-09-30T14:51:52.907533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74429f5b-918beedb-7ed3c9dc-99bf8abb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|aa3b65cc-38f382ed-a43adfe4-add85f4d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:52.910205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa3b65cc-38f382ed-a43adfe4-add85f4d_0] Write session: try to update token
2025-09-30T14:51:52.910224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa3b65cc-38f382ed-a43adfe4-add85f4d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:52.918606Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:52.918622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:52.918625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:52.918627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:52.918637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895069654242286:5010]
2025-09-30T14:51:52.918641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895069654242286:5010]
2025-09-30T14:51:52.918646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895069654242286:5010]
2025-09-30T14:51:52.918689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:52.918697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:52.918701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:52.918704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:52.918704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:52.918708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:52.918845Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:52.924361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 605 sessionId: src_id|aa3b65cc-38f382ed-a43adfe4-add85f4d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:52.927351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:52.979651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895069743970027:5991]
2025-09-30T14:51:52.979881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 604, pipe: [1:7555895069743970027:5991]
2025-09-30T14:51:53.031370Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:53.031755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:53.031769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:53.031801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895069743970027:5991], now have 1 active actors on pipe
2025-09-30T14:51:53.031978Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:53.032013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895069743970027:5991]
2025-09-30T14:51:53.032022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:53.032026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:53.032056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:53.032083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 605 reason: error at write: Disconnected sessionId: src_id|aa3b65cc-38f382ed-a43adfe4-add85f4d_0
2025-09-30T14:51:53.032216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 605 sessionId: src_id|aa3b65cc-38f382ed-a43adfe4-add85f4d_0 is DEAD
2025-09-30T14:51:53.032330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa3b65cc-38f382ed-a43adfe4-add85f4d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:53.032341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa3b65cc-38f382ed-a43adfe4-add85f4d_0] Write session will restart in 0.005435s
2025-09-30T14:51:53.032367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa3b65cc-38f382ed-a43adfe4-add85f4d_0] Write session: Do CDS request
2025-09-30T14:51:53.032376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa3b65cc-38f382ed-a43adfe4-add85f4d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:53.038707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa3b65cc-38f382ed-a43adfe4-add85f4d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:53.038781Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:53.038801Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 606
2025-09-30T14:51:53.038942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 606 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:53.038985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 606 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:53.038996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=606 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:53.038999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:53.039487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 606 sessionId:  describe result for acl check
2025-09-30T14:51:53.039523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:53.039525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:53.039526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:53.039532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895074038937349:6011] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:53.040145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895074038937349:6011] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:53.043007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895074038937349:6011] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:53.045585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:53.045661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895074038937349:6011] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:53.045675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895074038937349:6011] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:53.045679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895074038937349:6011] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:53.045696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 606 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:53.047706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:53.047884Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:53.047894Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:53.047904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:53.047952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:53.047991Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895073949209773:5012]
2025-09-30T14:51:53.048595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:53.048924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:53.048966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:53.049291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:53.049347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:53.049353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:53.049354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:53.049355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:53.049356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:53.049357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:53.049358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:53.049360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:53.049361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:53.049362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:53.049363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.049364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.049365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.049367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:53.049368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:53.049373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:53.049383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:53.049387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:53.049392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:53.049396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:53.049401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:53.049405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:53.049409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:53.049413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:53.049417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:53.049421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.049425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.049429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.049433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:53.049437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:53.049443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:53.049452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:53.049458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:53.049464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:53.049468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:53.049474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:53.049478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:53.049484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:53.049488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:53.049494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:53.049499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:53.049504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:53.049509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:53.049514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:53.049518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:53.049524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:53.049528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:53.049533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:53.049539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:53.049544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:53.049549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.049558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.049563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.049568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.049577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.049581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.049585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:53.049589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:53.049598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:53.049604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:53.049645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:53.055191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:53.056378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:53.056395Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:53.056398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:53.056402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:53.056409Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 605 [2:7555895073949209773:5012]
2025-09-30T14:51:53.056425Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:53.056440Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:53.056443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:53.056446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:53.056448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:53.056465Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:53.056478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:53.056486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:53.056552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.056560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.056562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.056565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:53.056568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:53.056633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:53.056640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.056654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.056665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.056685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:53.056705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895073949209767:5012]
2025-09-30T14:51:53.056712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895073949209767:5012]
2025-09-30T14:51:53.056714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895073949209767:5012]
2025-09-30T14:51:53.056724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:53.056738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:53.056741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895074038937331:2454], now have 1 active actors on pipe
2025-09-30T14:51:53.056744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895074038937512:6011], now have 1 active actors on pipe
2025-09-30T14:51:53.056748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:53.056750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:53.056751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:53.056765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:53.056767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:53.056797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895073949209767:5012]
2025-09-30T14:51:53.056808Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:53.056819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:53.056814Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 605
2025-09-30T14:51:53.056825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 605
2025-09-30T14:51:53.056926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:53.056935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:53.056960Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f5f014-17fe131d-7f0fc569-56465bc5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:53.056974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:53.056982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:53.056984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:53.056993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:53.057005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:53.057023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:53.057203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:53.057210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:53.057222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:53.057345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 606 partition: 0 MaxSeqNo: 42 sessionId: src_id|2f5f014-17fe131d-7f0fc569-56465bc5_0
2025-09-30T14:51:53.057670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa3b65cc-38f382ed-a43adfe4-add85f4d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2f5f014-17fe131d-7f0fc569-56465bc5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:53.060478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5f014-17fe131d-7f0fc569-56465bc5_0] Write session: try to update token
2025-09-30T14:51:53.060498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5f014-17fe131d-7f0fc569-56465bc5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:53.068850Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:53.068865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:53.068875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895073949209767:5012]
2025-09-30T14:51:53.068918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:53.068929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:53.069091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:53.069243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:53.069379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:53.069520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:53.069720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:53.069766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:53.074657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 606 sessionId: src_id|2f5f014-17fe131d-7f0fc569-56465bc5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:53.077375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:53.077580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:53.077603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:53.077639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:53.077703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:53.079522Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:53.079536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:53.079539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:53.079541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:53.079550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895073949209767:5012]
2025-09-30T14:51:53.079554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895073949209767:5012]
2025-09-30T14:51:53.079557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895073949209767:5012]
2025-09-30T14:51:53.079595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:53.079601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.079604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:53.079602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:53.079610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:53.079615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:53.079736Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:53.132187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895074038937540:5991]
2025-09-30T14:51:53.132469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 605, pipe: [1:7555895074038937540:5991]
2025-09-30T14:51:53.190267Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:53.197172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:53.197196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:53.197360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:53.197419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:53.197481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:53.197540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:53.197583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:53.197590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:53.197652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:53.197712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:53.197774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:53.197836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:53.197882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:53.197891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:53.197963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:53.198020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:53.198079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:53.198147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:53.198196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:53.198202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:53.198265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:53.198330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:53.198398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:53.198486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:53.198530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:53.198537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:53.198598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:53.198653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:53.198714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:53.198786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:53.198966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:53.198979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:53.199047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:53.199108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:53.199177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:53.199263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:53.199310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:53.199317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:53.199390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:53.199459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:53.199524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:53.199578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:53.199618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:53.199624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:53.199685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:53.199747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:53.199812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:53.199868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:53.199909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:53.199915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:53.199977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:53.200039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:53.200093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:53.200152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:53.200192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:53.200198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:53.200264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:53.200317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:53.200370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:53.200425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:53.200466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:53.200471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:53.200523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895074038937540:5991], now have 1 active actors on pipe
2025-09-30T14:51:53.200762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:53.200796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895074038937540:5991]
2025-09-30T14:51:53.200829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:53.200838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:53.200865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 606 reason: error at write: Disconnected sessionId: src_id|2f5f014-17fe131d-7f0fc569-56465bc5_0
2025-09-30T14:51:53.201053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 606 sessionId: src_id|2f5f014-17fe131d-7f0fc569-56465bc5_0 is DEAD
2025-09-30T14:51:53.201192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5f014-17fe131d-7f0fc569-56465bc5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:53.201204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5f014-17fe131d-7f0fc569-56465bc5_0] Write session will restart in 0.007784s
2025-09-30T14:51:53.201226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5f014-17fe131d-7f0fc569-56465bc5_0] Write session: Do CDS request
2025-09-30T14:51:53.201231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5f014-17fe131d-7f0fc569-56465bc5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:53.201352Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:53.209754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5f014-17fe131d-7f0fc569-56465bc5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:53.209859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:53.209878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 607
2025-09-30T14:51:53.210022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 607 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:53.210066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 607 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:53.210077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=607 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:53.210082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:53.210550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 607 sessionId:  describe result for acl check
2025-09-30T14:51:53.210587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:53.210593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:53.210595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:53.210602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895074038937582:6022] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:53.211198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895074038937582:6022] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:53.214322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895074038937582:6022] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:53.217481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895074038937582:6022] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:53.217498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895074038937582:6022] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:53.217501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895074038937582:6022] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:53.217511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 607 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:53.218222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:53.220318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:53.220529Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:53.220539Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:53.220561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:53.220622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:53.220662Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895073949209996:5027]
2025-09-30T14:51:53.221296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:53.221592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:53.221642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:53.221959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:53.222041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:53.222048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:53.222049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:53.222050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:53.222051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:53.222052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:53.222054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:53.222055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:53.222056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:53.222057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:53.222058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.222059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.222060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.222062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:53.222063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:53.222068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:53.222079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:53.222083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:53.222088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:53.222092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:53.222096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:53.222101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:53.222105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:53.222109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:53.222113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:53.222116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.222120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.222123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.222127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:53.222130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:53.222139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:53.222147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:53.222152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:53.222157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:53.222161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:53.222165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:53.222169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:53.222174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:53.222179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:53.222184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:53.222190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:53.222195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:53.222200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:53.222205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:53.222210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:53.222214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:53.222219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:53.222224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:53.222231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:53.222241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:53.222246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.222257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.222262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.222271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.222275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.222285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.222290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:53.222295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:53.222300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:53.222305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:53.222352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:53.227864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:53.228937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:53.228951Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:53.228953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:53.228955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:53.228960Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 606 [2:7555895073949209996:5027]
2025-09-30T14:51:53.228972Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:53.228985Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:53.228990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:53.228993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:53.228995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:53.229011Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:53.229018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:53.229025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:53.229076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.229083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.229084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.229087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:53.229089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:53.229140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:53.229147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.229161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.229178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.229201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:53.229223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895074038937732:6022], now have 1 active actors on pipe
2025-09-30T14:51:53.229230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895074038937550:2454], now have 1 active actors on pipe
2025-09-30T14:51:53.229235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895073949209991:5027]
2025-09-30T14:51:53.229237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895073949209991:5027]
2025-09-30T14:51:53.229238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895073949209991:5027]
2025-09-30T14:51:53.229247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:53.229258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:53.229267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:53.229270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:53.229276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:53.229278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:53.229280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:53.229302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895073949209991:5027]
2025-09-30T14:51:53.229274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 606
2025-09-30T14:51:53.229310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:53.229322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:53.229337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:53.229346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:53.229377Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|711e4789-478bbaa-5f8bf3d2-27bf3ca8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:53.229388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:53.229392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:53.229395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:53.229403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:53.229392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 606
2025-09-30T14:51:53.229413Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:53.229437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:53.229671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:53.229681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:53.229696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:53.229806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 607 partition: 0 MaxSeqNo: 42 sessionId: src_id|711e4789-478bbaa-5f8bf3d2-27bf3ca8_0
2025-09-30T14:51:53.230155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5f014-17fe131d-7f0fc569-56465bc5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|711e4789-478bbaa-5f8bf3d2-27bf3ca8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:53.232929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|711e4789-478bbaa-5f8bf3d2-27bf3ca8_0] Write session: try to update token
2025-09-30T14:51:53.232950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|711e4789-478bbaa-5f8bf3d2-27bf3ca8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:53.241596Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:53.241612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:53.241615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:53.241617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:53.241629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895073949209991:5027]
2025-09-30T14:51:53.241633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895073949209991:5027]
2025-09-30T14:51:53.241637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895073949209991:5027]
2025-09-30T14:51:53.241675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:53.241683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.241686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:53.241699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:53.241707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:53.241711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:53.241826Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:53.247712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 607 sessionId: src_id|711e4789-478bbaa-5f8bf3d2-27bf3ca8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:53.250437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:53.301161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895074038937745:5991]
2025-09-30T14:51:53.301420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 606, pipe: [1:7555895074038937745:5991]
2025-09-30T14:51:53.356769Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:53.357248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:53.357262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:53.357301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895074038937745:5991], now have 1 active actors on pipe
2025-09-30T14:51:53.357503Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:53.357571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:53.357589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895074038937745:5991]
2025-09-30T14:51:53.357628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:53.357725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 607 reason: status is not ok: tablet will be restarted right now sessionId: src_id|711e4789-478bbaa-5f8bf3d2-27bf3ca8_0
2025-09-30T14:51:53.357886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 607 sessionId: src_id|711e4789-478bbaa-5f8bf3d2-27bf3ca8_0 is DEAD
2025-09-30T14:51:53.358029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|711e4789-478bbaa-5f8bf3d2-27bf3ca8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:53.358040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|711e4789-478bbaa-5f8bf3d2-27bf3ca8_0] Write session will restart in 0.005938s
2025-09-30T14:51:53.358063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|711e4789-478bbaa-5f8bf3d2-27bf3ca8_0] Write session: Do CDS request
2025-09-30T14:51:53.358069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|711e4789-478bbaa-5f8bf3d2-27bf3ca8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:53.364776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|711e4789-478bbaa-5f8bf3d2-27bf3ca8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:53.364886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:53.364905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 608
2025-09-30T14:51:53.365044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 608 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:53.365081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 608 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:53.365091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=608 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:53.365096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:53.365544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 608 sessionId:  describe result for acl check
2025-09-30T14:51:53.365581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:53.365587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:53.365589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:53.365594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895074038937760:6026] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:53.366149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895074038937760:6026] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:53.368407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895074038937760:6026] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:53.371109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895074038937760:6026] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:53.371127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895074038937760:6026] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:53.371132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895074038937760:6026] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:53.371140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 608 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:53.372909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:53.375289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:53.375504Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:53.375516Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:53.375528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:53.375583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:53.375629Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895073949210182:5029]
2025-09-30T14:51:53.376254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:53.376588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:53.376633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:53.376962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:53.377026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:53.377034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:53.377035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:53.377037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:53.377038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:53.377040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:53.377041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:53.377042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:53.377043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:53.377044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:53.377045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.377047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.377048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.377049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:53.377051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:53.377056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:53.377067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:53.377071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:53.377075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:53.377079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:53.377082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:53.377086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:53.377090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:53.377094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:53.377098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:53.377103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.377107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.377111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.377115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:53.377119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:53.377126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:53.377134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:53.377140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:53.377146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:53.377152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:53.377158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:53.377162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:53.377167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:53.377172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:53.377178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:53.377182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:53.377187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:53.377192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:53.377198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:53.377202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:53.377207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:53.377216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:53.377220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:53.377225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:53.377230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:53.377240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.377246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.377255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.377260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.377282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.377291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.377297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:53.377304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:53.377312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:53.377316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:53.377358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:53.383102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:53.383975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:53.383993Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:53.383996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:53.384000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:53.384007Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 607 [2:7555895073949210182:5029]
2025-09-30T14:51:53.384023Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:53.384041Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:53.384044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:53.384048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:53.384052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:53.384069Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:53.384080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:53.384088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:53.384151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.384154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.384156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.384158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:53.384161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:53.384211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:53.384217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.384226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.384235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.384247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:53.384263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895073949210177:5029]
2025-09-30T14:51:53.384269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895073949210177:5029]
2025-09-30T14:51:53.384270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895073949210177:5029]
2025-09-30T14:51:53.384276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:53.384289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:53.384290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:53.384293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:53.384296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:53.384305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:53.384307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:53.384315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895074038937926:6026], now have 1 active actors on pipe
2025-09-30T14:51:53.384319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895074038937746:2454], now have 1 active actors on pipe
2025-09-30T14:51:53.384350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895073949210177:5029]
2025-09-30T14:51:53.384362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:53.384389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:53.384411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 607
2025-09-30T14:51:53.384454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 607
2025-09-30T14:51:53.384510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:53.384520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:53.384547Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2ffc14f-7493382-fab4a421-a50b9deb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:53.384558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:53.384562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:53.384564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:53.384574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:53.384583Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:53.384600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:53.384813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:53.384822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:53.384838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:53.384939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 608 partition: 0 MaxSeqNo: 42 sessionId: src_id|c2ffc14f-7493382-fab4a421-a50b9deb_0
2025-09-30T14:51:53.385320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|711e4789-478bbaa-5f8bf3d2-27bf3ca8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c2ffc14f-7493382-fab4a421-a50b9deb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:53.388176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2ffc14f-7493382-fab4a421-a50b9deb_0] Write session: try to update token
2025-09-30T14:51:53.388199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2ffc14f-7493382-fab4a421-a50b9deb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:53.396521Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:53.396540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:53.396542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:53.396544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:53.396554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895073949210177:5029]
2025-09-30T14:51:53.396559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895073949210177:5029]
2025-09-30T14:51:53.396563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895073949210177:5029]
2025-09-30T14:51:53.396606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:53.396612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.396615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:53.396616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:53.396624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:53.396631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:53.396752Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:53.403070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 608 sessionId: src_id|c2ffc14f-7493382-fab4a421-a50b9deb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:53.406157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:53.457823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895074038937941:5991]
2025-09-30T14:51:53.458067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 607, pipe: [1:7555895074038937941:5991]
2025-09-30T14:51:53.507312Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:53.507602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:53.507617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:53.507636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895074038937941:5991], now have 1 active actors on pipe
2025-09-30T14:51:53.507849Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:53.507883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:53.507886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895074038937941:5991]
2025-09-30T14:51:53.507902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:53.507911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:53.507966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 608 reason: error at write: Disconnected sessionId: src_id|c2ffc14f-7493382-fab4a421-a50b9deb_0
2025-09-30T14:51:53.508127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 608 sessionId: src_id|c2ffc14f-7493382-fab4a421-a50b9deb_0 is DEAD
2025-09-30T14:51:53.508287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2ffc14f-7493382-fab4a421-a50b9deb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:53.508298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2ffc14f-7493382-fab4a421-a50b9deb_0] Write session will restart in 0.007384s
2025-09-30T14:51:53.508321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2ffc14f-7493382-fab4a421-a50b9deb_0] Write session: Do CDS request
2025-09-30T14:51:53.508327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2ffc14f-7493382-fab4a421-a50b9deb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:53.516779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2ffc14f-7493382-fab4a421-a50b9deb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:53.516849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:53.516867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 609
2025-09-30T14:51:53.517027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 609 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:53.517073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 609 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:53.517095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=609 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:53.517104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:53.517809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 609 sessionId:  describe result for acl check
2025-09-30T14:51:53.517855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:53.517863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:53.517866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:53.517871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895074038937979:6031] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:53.518406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895074038937979:6031] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:53.520947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895074038937979:6031] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:53.523687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895074038937979:6031] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:53.523703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895074038937979:6031] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:53.523707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895074038937979:6031] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:53.523715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 609 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:53.524201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:53.526811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:53.527061Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:53.527073Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:53.527086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:53.527182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:53.527236Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895073949210371:5032]
2025-09-30T14:51:53.527931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:53.528338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:53.528401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:53.528776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:53.528868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:53.528877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:53.528878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:53.528879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:53.528880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:53.528882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:53.528883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:53.528885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:53.528886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:53.528887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:53.528888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.528889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.528891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.528892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:53.528893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:53.528900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:53.528911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:53.528916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:53.528920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:53.528924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:53.528928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:53.528932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:53.528935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:53.528939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:53.528944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:53.528948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.528952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.528956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.528960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:53.528964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:53.528990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:53.528999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:53.529006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:53.529015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:53.529020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:53.529027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:53.529032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:53.529037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:53.529043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:53.529049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:53.529061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:53.529066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:53.529072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:53.529077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:53.529081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:53.529086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:53.529092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:53.529097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:53.529106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:53.529111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:53.529116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.529126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.529130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.529136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.529140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.529146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.529150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:53.529155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:53.529165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:53.529171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:53.529216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:53.534913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:53.535836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:53.535854Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:53.535858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:53.535863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:53.535870Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 608 [2:7555895073949210371:5032]
2025-09-30T14:51:53.535890Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:53.535907Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:53.535917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:53.535920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:53.535924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:53.535946Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:53.535961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:53.535969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:53.536031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.536040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.536043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.536047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:53.536050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:53.536120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:53.536126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.536140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.536154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.536184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:53.536208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895074038937944:2454], now have 1 active actors on pipe
2025-09-30T14:51:53.536217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895074038938127:6031], now have 1 active actors on pipe
2025-09-30T14:51:53.536223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895073949210366:5032]
2025-09-30T14:51:53.536230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895073949210366:5032]
2025-09-30T14:51:53.536233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895073949210366:5032]
2025-09-30T14:51:53.536250Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:53.536268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:53.536269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:53.536273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:53.536275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:53.536289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:53.536292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:53.536327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895073949210366:5032]
2025-09-30T14:51:53.536335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:53.536337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:53.536306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 608
2025-09-30T14:51:53.536308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 608
2025-09-30T14:51:53.536365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:53.536375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:53.536407Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ed21797-ab671acc-fa09ad18-153f74df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:53.536418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:53.536423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:53.536425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:53.536436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:53.536445Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:53.536472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:53.536657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:53.536666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:53.536681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:53.537208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2ffc14f-7493382-fab4a421-a50b9deb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8ed21797-ab671acc-fa09ad18-153f74df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:53.536821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 609 partition: 0 MaxSeqNo: 42 sessionId: src_id|8ed21797-ab671acc-fa09ad18-153f74df_0
2025-09-30T14:51:53.540007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed21797-ab671acc-fa09ad18-153f74df_0] Write session: try to update token
2025-09-30T14:51:53.540025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed21797-ab671acc-fa09ad18-153f74df_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:53.548431Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:53.548451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:53.548454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:53.548457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:53.548466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895073949210366:5032]
2025-09-30T14:51:53.548471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895073949210366:5032]
2025-09-30T14:51:53.548477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895073949210366:5032]
2025-09-30T14:51:53.548519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:53.548532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.548535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:53.548664Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:53.551303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:53.551316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:53.551319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:53.554684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 609 sessionId: src_id|8ed21797-ab671acc-fa09ad18-153f74df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:53.557265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:53.607877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895074038938140:5991]
2025-09-30T14:51:53.608155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 608, pipe: [1:7555895074038938140:5991]
2025-09-30T14:51:53.670096Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:53.670685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:53.670700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:53.670737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895074038938140:5991], now have 1 active actors on pipe
2025-09-30T14:51:53.670970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:53.670980Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:53.670988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:53.671023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895074038938140:5991]
2025-09-30T14:51:53.671049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 609 reason: error at write: Disconnected sessionId: src_id|8ed21797-ab671acc-fa09ad18-153f74df_0
2025-09-30T14:51:53.671200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 609 sessionId: src_id|8ed21797-ab671acc-fa09ad18-153f74df_0 is DEAD
2025-09-30T14:51:53.671211Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:53.671341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed21797-ab671acc-fa09ad18-153f74df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:53.671367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed21797-ab671acc-fa09ad18-153f74df_0] Write session will restart in 0.008121s
2025-09-30T14:51:53.671390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed21797-ab671acc-fa09ad18-153f74df_0] Write session: Do CDS request
2025-09-30T14:51:53.671399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed21797-ab671acc-fa09ad18-153f74df_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:53.680763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed21797-ab671acc-fa09ad18-153f74df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:53.680877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:53.680896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 610
2025-09-30T14:51:53.681065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 610 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:53.681123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 610 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:53.681133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=610 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:53.681138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:53.681657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 610 sessionId:  describe result for acl check
2025-09-30T14:51:53.681693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:53.681700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:53.681702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:53.681709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895074038938206:6035] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:53.682226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895074038938206:6035] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:53.684814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895074038938206:6035] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:53.685729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:53.688132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:53.688332Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:53.688345Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:53.688357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:53.688437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:53.688468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895074038938206:6035] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:53.688478Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895073949210558:5034]
2025-09-30T14:51:53.688482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895074038938206:6035] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:53.688485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895074038938206:6035] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:53.688494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 610 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:53.688986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:53.689252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:53.689283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:53.689539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:53.689590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:53.689595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:53.689595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:53.689596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:53.689597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:53.689598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:53.689599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:53.689600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:53.689601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:53.689601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:53.689602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.689603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.689603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.689604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:53.689605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:53.689608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:53.689615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:53.689617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:53.689620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:53.689622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:53.689625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:53.689627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:53.689629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:53.689632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:53.689634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:53.689636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.689638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.689641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.689643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:53.689646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:53.689650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:53.689655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:53.689659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:53.689662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:53.689666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:53.689670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:53.689672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:53.689675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:53.689678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:53.689681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:53.689684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:53.689687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:53.689690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:53.689693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:53.689696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:53.689699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:53.689702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:53.689705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:53.689708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:53.689714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:53.689719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.689723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.689728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.689733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.689737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.689742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.689747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:53.689752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:53.689756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:53.689761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:53.689802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:53.695179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:53.696059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:53.696078Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:53.696081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:53.696085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:53.696092Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 609 [2:7555895073949210558:5034]
2025-09-30T14:51:53.696108Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:53.696128Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:53.696131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:53.696139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:53.696141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:53.696158Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:53.696171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:53.696178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:53.696241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.696249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.696251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.696255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:53.696257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:53.696324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:53.696333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.696346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.696359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.696382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:53.696404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895074038938141:2454], now have 1 active actors on pipe
2025-09-30T14:51:53.696412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895074038938326:6035], now have 1 active actors on pipe
2025-09-30T14:51:53.696419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895073949210553:5034]
2025-09-30T14:51:53.696421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895073949210553:5034]
2025-09-30T14:51:53.696424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895073949210553:5034]
2025-09-30T14:51:53.696436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:53.696449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:53.696454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:53.696458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:53.696460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:53.696468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:53.696470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:53.696467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 609
2025-09-30T14:51:53.696500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895073949210553:5034]
2025-09-30T14:51:53.696508Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:53.696510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:53.696471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 609
2025-09-30T14:51:53.696529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:53.696538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:53.696582Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5d37d3f-ae360479-36f2aeb-d257d61e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:53.696866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 610 partition: 0 MaxSeqNo: 42 sessionId: src_id|d5d37d3f-ae360479-36f2aeb-d257d61e_0
2025-09-30T14:51:53.696588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:53.696592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:53.696594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:53.696603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:53.696612Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:53.696632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:53.696779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:53.696782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:53.696795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:53.697212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed21797-ab671acc-fa09ad18-153f74df_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d5d37d3f-ae360479-36f2aeb-d257d61e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:53.699936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5d37d3f-ae360479-36f2aeb-d257d61e_0] Write session: try to update token
2025-09-30T14:51:53.699955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5d37d3f-ae360479-36f2aeb-d257d61e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:53.708767Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:53.708781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:53.708783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:53.708785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:53.708792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895073949210553:5034]
2025-09-30T14:51:53.708798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895073949210553:5034]
2025-09-30T14:51:53.708801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895073949210553:5034]
2025-09-30T14:51:53.708840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:53.708847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.708850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:53.708853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:53.708882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:53.708886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:53.708997Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:53.714487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 610 sessionId: src_id|d5d37d3f-ae360479-36f2aeb-d257d61e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:53.717188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:53.771182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895074038938338:5991]
2025-09-30T14:51:53.771512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 609, pipe: [1:7555895074038938338:5991]
2025-09-30T14:51:53.820281Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:53.820831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:53.820846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:53.820885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895074038938338:5991], now have 1 active actors on pipe
2025-09-30T14:51:53.821122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:53.821134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895074038938338:5991]
2025-09-30T14:51:53.821137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:53.821156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:53.821214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 610 reason: error at write: Disconnected sessionId: src_id|d5d37d3f-ae360479-36f2aeb-d257d61e_0
2025-09-30T14:51:53.821316Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:53.821378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 610 sessionId: src_id|d5d37d3f-ae360479-36f2aeb-d257d61e_0 is DEAD
2025-09-30T14:51:53.821700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5d37d3f-ae360479-36f2aeb-d257d61e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:53.821712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5d37d3f-ae360479-36f2aeb-d257d61e_0] Write session will restart in 0.008022s
2025-09-30T14:51:53.821734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5d37d3f-ae360479-36f2aeb-d257d61e_0] Write session: Do CDS request
2025-09-30T14:51:53.821739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5d37d3f-ae360479-36f2aeb-d257d61e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:53.830744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5d37d3f-ae360479-36f2aeb-d257d61e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:53.830887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:53.830908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 611
2025-09-30T14:51:53.831044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 611 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:53.831077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 611 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:53.831087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=611 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:53.831091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:53.831613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 611 sessionId:  describe result for acl check
2025-09-30T14:51:53.831654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:53.831656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:53.831658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:53.831663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895074038938415:6039] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:53.832184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895074038938415:6039] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:53.834356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895074038938415:6039] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:53.835881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:53.838156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:53.838356Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:53.838365Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:53.838376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:53.838457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:53.838499Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895073949210747:5036]
2025-09-30T14:51:53.838528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895074038938415:6039] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:53.838544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895074038938415:6039] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:53.838547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895074038938415:6039] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:53.838555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 611 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:53.839082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:53.839360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:53.839403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:53.839714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:53.839801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:53.839807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:53.839808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:53.839809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:53.839811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:53.839812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:53.839813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:53.839814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:53.839815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:53.839816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:53.839817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.839818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.839819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.839820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:53.839821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:53.839827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:53.839838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:53.839842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:53.839846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:53.839850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:53.839855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:53.839859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:53.839863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:53.839867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:53.839871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:53.839875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.839879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.839884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.839888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:53.839892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:53.839898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:53.839908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:53.839914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:53.839919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:53.839922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:53.839925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:53.839927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:53.839930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:53.839933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:53.839936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:53.839938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:53.839941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:53.839944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:53.839947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:53.839950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:53.839953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:53.839955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:53.839958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:53.839961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:53.839966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:53.839970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.839977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.839981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.839987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.839992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.839997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.840001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:53.840006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:53.840011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:53.840016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:53.840063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:53.845511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:53.846338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:53.846351Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:53.846354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:53.846358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:53.846365Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 610 [2:7555895073949210747:5036]
2025-09-30T14:51:53.846381Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:53.846397Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:53.846400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:53.846403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:53.846406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:53.846433Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:53.846445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:53.846453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:53.846517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.846524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.846527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.846530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:53.846532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:53.846598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:53.846605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.846618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.846630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.846652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:53.846674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895074038938525:6039], now have 1 active actors on pipe
2025-09-30T14:51:53.846682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895074038938339:2454], now have 1 active actors on pipe
2025-09-30T14:51:53.846689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895073949210742:5036]
2025-09-30T14:51:53.846693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895073949210742:5036]
2025-09-30T14:51:53.846695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895073949210742:5036]
2025-09-30T14:51:53.846709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:53.846727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:53.846742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:53.846749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:53.846751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:53.846754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:53.846757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:53.846760Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 610
2025-09-30T14:51:53.846775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895073949210742:5036]
2025-09-30T14:51:53.846777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 610
2025-09-30T14:51:53.846784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:53.846792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:53.846902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:53.846912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:53.846943Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c6fbbef-70725762-d824f01d-8596e5c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:53.846955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:53.846960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:53.846962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:53.846971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:53.846984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:53.847005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:53.847164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:53.847172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:53.847185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:53.847294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 611 partition: 0 MaxSeqNo: 42 sessionId: src_id|6c6fbbef-70725762-d824f01d-8596e5c3_0
2025-09-30T14:51:53.847664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5d37d3f-ae360479-36f2aeb-d257d61e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6c6fbbef-70725762-d824f01d-8596e5c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:53.850289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c6fbbef-70725762-d824f01d-8596e5c3_0] Write session: try to update token
2025-09-30T14:51:53.850308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c6fbbef-70725762-d824f01d-8596e5c3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:53.858634Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:53.858651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:53.858653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:53.858654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:53.858665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895073949210742:5036]
2025-09-30T14:51:53.858669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895073949210742:5036]
2025-09-30T14:51:53.858673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895073949210742:5036]
2025-09-30T14:51:53.858716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:53.858722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.858725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:53.858724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:53.858731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:53.858736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:53.858853Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:53.864606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 611 sessionId: src_id|6c6fbbef-70725762-d824f01d-8596e5c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:53.867288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:53.921234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895074038938549:5991]
2025-09-30T14:51:53.921555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 610, pipe: [1:7555895074038938549:5991]
2025-09-30T14:51:53.969480Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:53.969726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:53.969743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:53.969777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895074038938549:5991], now have 1 active actors on pipe
2025-09-30T14:51:53.970019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895074038938549:5991]
2025-09-30T14:51:53.970054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:53.970057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:53.970086Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:53.970125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 611 reason: error at write: Disconnected sessionId: src_id|6c6fbbef-70725762-d824f01d-8596e5c3_0
2025-09-30T14:51:53.970436Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:53.970484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c6fbbef-70725762-d824f01d-8596e5c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:53.970496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c6fbbef-70725762-d824f01d-8596e5c3_0] Write session will restart in 0.009196s
2025-09-30T14:51:53.970519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c6fbbef-70725762-d824f01d-8596e5c3_0] Write session: Do CDS request
2025-09-30T14:51:53.970540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c6fbbef-70725762-d824f01d-8596e5c3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:53.970311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 611 sessionId: src_id|6c6fbbef-70725762-d824f01d-8596e5c3_0 is DEAD
2025-09-30T14:51:53.980714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c6fbbef-70725762-d824f01d-8596e5c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:53.980798Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:53.980814Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 612
2025-09-30T14:51:53.980952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 612 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:53.980983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 612 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:53.980993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=612 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:53.980998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:53.981557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 612 sessionId:  describe result for acl check
2025-09-30T14:51:53.981605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:53.981612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:53.981614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:53.981620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895074038938647:6045] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:53.982169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895074038938647:6045] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:53.984277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895074038938647:6045] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:53.985453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:53.987636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:53.987831Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:53.987842Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:53.987854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:53.987907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:53.987946Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895073949210949:5039]
2025-09-30T14:51:53.988075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895074038938647:6045] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:53.988092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895074038938647:6045] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:53.988095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895074038938647:6045] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:53.988103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 612 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:53.988554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:53.988856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:53.988898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:53.989163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:53.989208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:53.989213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:53.989213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:53.989214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:53.989215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:53.989215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:53.989216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:53.989217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:53.989218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:53.989219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:53.989220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.989220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.989221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.989222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:53.989223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:53.989227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:53.989233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:53.989235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:53.989238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:53.989240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:53.989242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:53.989245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:53.989247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:53.989250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:53.989252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:53.989254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.989257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.989259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.989261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:53.989263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:53.989268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:53.989273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:53.989278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:53.989281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:53.989284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:53.989287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:53.989290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:53.989293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:53.989296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:53.989299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:53.989302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:53.989305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:53.989308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:53.989311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:53.989314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:53.989317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:53.989319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:53.989323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:53.989325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:53.989328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:53.989331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.989334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.989337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.989340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.989342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.989346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.989348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:53.989352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:53.989355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:53.989358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:53.989389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:53.994818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:53.995696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:53.995710Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:53.995713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:53.995717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:53.995723Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 611 [2:7555895073949210949:5039]
2025-09-30T14:51:53.995738Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:53.995753Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:53.995764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:53.995767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:53.995769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:53.995785Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:53.995792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:53.995799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:53.995854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.995861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.995864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.995867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:53.995870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:53.995934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:53.995945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:53.995957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:53.995970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:53.995987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:53.996011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895074038938744:6045], now have 1 active actors on pipe
2025-09-30T14:51:53.996019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895074038938550:2454], now have 1 active actors on pipe
2025-09-30T14:51:53.996026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895073949210944:5039]
2025-09-30T14:51:53.996029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895073949210944:5039]
2025-09-30T14:51:53.996031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895073949210944:5039]
2025-09-30T14:51:53.996046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:53.996059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:53.996072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:53.996078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:53.996081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:53.996084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:53.996087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:53.996112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895073949210944:5039]
2025-09-30T14:51:53.996103Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 611
2025-09-30T14:51:53.996121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:53.996104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 611
2025-09-30T14:51:53.996136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:53.996154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:53.996159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:53.996189Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d758268-68401d1a-38ad8e7e-bda98194_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:53.996200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:53.996204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:53.996207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:53.996216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:53.996232Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:53.996251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:53.996408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:53.996415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:53.996429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:53.996507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 612 partition: 0 MaxSeqNo: 42 sessionId: src_id|7d758268-68401d1a-38ad8e7e-bda98194_0
2025-09-30T14:51:53.996879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c6fbbef-70725762-d824f01d-8596e5c3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7d758268-68401d1a-38ad8e7e-bda98194_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:53.999607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d758268-68401d1a-38ad8e7e-bda98194_0] Write session: try to update token
2025-09-30T14:51:53.999626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d758268-68401d1a-38ad8e7e-bda98194_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:54.008506Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:54.008534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:54.008537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:54.008540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:54.008554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895073949210944:5039]
2025-09-30T14:51:54.008560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895073949210944:5039]
2025-09-30T14:51:54.008567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895073949210944:5039]
2025-09-30T14:51:54.008616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:54.008619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:54.008627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.008630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:54.008631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:54.008635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:54.008833Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:54.014652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 612 sessionId: src_id|7d758268-68401d1a-38ad8e7e-bda98194_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:54.017459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:54.070198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895078333906055:5991]
2025-09-30T14:51:54.070507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 611, pipe: [1:7555895078333906055:5991]
2025-09-30T14:51:54.119103Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:54.119420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:54.119436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:54.119478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895078333906055:5991], now have 1 active actors on pipe
2025-09-30T14:51:54.119716Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:54.119712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895078333906055:5991]
2025-09-30T14:51:54.119712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:54.119717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:54.119764Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:54.119780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 612 reason: error at write: Disconnected sessionId: src_id|7d758268-68401d1a-38ad8e7e-bda98194_0
2025-09-30T14:51:54.119965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 612 sessionId: src_id|7d758268-68401d1a-38ad8e7e-bda98194_0 is DEAD
2025-09-30T14:51:54.120114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d758268-68401d1a-38ad8e7e-bda98194_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:54.120125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d758268-68401d1a-38ad8e7e-bda98194_0] Write session will restart in 0.006655s
2025-09-30T14:51:54.120146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d758268-68401d1a-38ad8e7e-bda98194_0] Write session: Do CDS request
2025-09-30T14:51:54.120164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d758268-68401d1a-38ad8e7e-bda98194_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:54.127668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d758268-68401d1a-38ad8e7e-bda98194_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:54.127820Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:54.127838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 613
2025-09-30T14:51:54.127946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 613 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:54.127976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 613 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:54.127985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=613 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:54.127990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:54.128369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 613 sessionId:  describe result for acl check
2025-09-30T14:51:54.128413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:54.128419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:54.128421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:54.128426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895078333906083:6050] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:54.128995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895078333906083:6050] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:54.131433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895078333906083:6050] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:54.134305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895078333906083:6050] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:54.134329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895078333906083:6050] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:54.134332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895078333906083:6050] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:54.134340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 613 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:54.134492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:54.136886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:54.137090Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:54.137102Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:54.137114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:54.137175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:54.137217Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895078244178452:5042]
2025-09-30T14:51:54.137864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:54.138164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:54.138216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:54.138556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:54.138626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:54.138633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:54.138634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:54.138635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:54.138636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:54.138637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:54.138639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:54.138640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:54.138641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:54.138642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:54.138644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.138645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.138646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.138647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:54.138648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:54.138654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:54.138664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:54.138668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:54.138673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:54.138678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:54.138682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:54.138685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:54.138691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:54.138695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:54.138700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:54.138704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.138708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.138712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.138716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:54.138719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:54.138727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:54.138735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:54.138741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:54.138747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:54.138751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:54.138757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:54.138761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:54.138766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:54.138771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:54.138776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:54.138781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:54.138786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:54.138791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:54.138796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:54.138800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:54.138805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:54.138809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:54.138814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:54.138817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:54.138822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:54.138826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.138831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.138835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.138841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.138845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.138850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.138854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:54.138859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:54.138866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:54.138877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:54.138926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:54.144594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:54.145463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:54.145480Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:54.145483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:54.145486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:54.145493Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 612 [2:7555895078244178452:5042]
2025-09-30T14:51:54.145508Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:54.145522Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:54.145530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:54.145533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:54.145535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:54.145550Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:54.145562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:54.145574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:54.145635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.145647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.145649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.145652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:54.145654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:54.145726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:54.145734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.145747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.145764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.145786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:54.145807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895078333906056:2454], now have 1 active actors on pipe
2025-09-30T14:51:54.145815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895078333906243:6050], now have 1 active actors on pipe
2025-09-30T14:51:54.145821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895078244178446:5042]
2025-09-30T14:51:54.145829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895078244178446:5042]
2025-09-30T14:51:54.145831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895078244178446:5042]
2025-09-30T14:51:54.145844Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:54.145861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:54.145862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:54.145865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:54.145867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:54.145878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:54.145882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:54.145875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 612
2025-09-30T14:51:54.145916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 612
2025-09-30T14:51:54.145917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895078244178446:5042]
2025-09-30T14:51:54.145930Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:54.145935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:54.145967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:54.145972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:54.145996Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a98fd63-111e6608-a0c2599e-c786b99d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:54.146003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:54.146006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:54.146009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:54.146018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:54.146028Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:54.146044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:54.146196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:54.146205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:54.146216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:54.146296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 613 partition: 0 MaxSeqNo: 42 sessionId: src_id|5a98fd63-111e6608-a0c2599e-c786b99d_0
2025-09-30T14:51:54.146611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d758268-68401d1a-38ad8e7e-bda98194_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5a98fd63-111e6608-a0c2599e-c786b99d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:54.149379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a98fd63-111e6608-a0c2599e-c786b99d_0] Write session: try to update token
2025-09-30T14:51:54.149400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a98fd63-111e6608-a0c2599e-c786b99d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:54.158082Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:54.158099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:54.158102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:54.158105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:54.158113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895078244178446:5042]
2025-09-30T14:51:54.158118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895078244178446:5042]
2025-09-30T14:51:54.158121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895078244178446:5042]
2025-09-30T14:51:54.158161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:54.158163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:54.158166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.158169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:54.158169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:54.158173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:54.158306Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:54.163814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 613 sessionId: src_id|5a98fd63-111e6608-a0c2599e-c786b99d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:54.166580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:54.219723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895078333906277:5991]
2025-09-30T14:51:54.220007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 612, pipe: [1:7555895078333906277:5991]
2025-09-30T14:51:54.264502Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:54.264790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:54.264823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:54.264875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895078333906277:5991], now have 1 active actors on pipe
2025-09-30T14:51:54.265144Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:54.265136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:54.265197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895078333906277:5991]
2025-09-30T14:51:54.265264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:54.265365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 613 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5a98fd63-111e6608-a0c2599e-c786b99d_0
2025-09-30T14:51:54.265581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 613 sessionId: src_id|5a98fd63-111e6608-a0c2599e-c786b99d_0 is DEAD
2025-09-30T14:51:54.265715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a98fd63-111e6608-a0c2599e-c786b99d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:54.265726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a98fd63-111e6608-a0c2599e-c786b99d_0] Write session will restart in 0.009261s
2025-09-30T14:51:54.265748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a98fd63-111e6608-a0c2599e-c786b99d_0] Write session: Do CDS request
2025-09-30T14:51:54.265754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a98fd63-111e6608-a0c2599e-c786b99d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:54.275742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a98fd63-111e6608-a0c2599e-c786b99d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:54.275887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:54.275908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 614
2025-09-30T14:51:54.276378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 614 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:54.276420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 614 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:54.276425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=614 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:54.276429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:54.276912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 614 sessionId:  describe result for acl check
2025-09-30T14:51:54.276953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:54.276960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:54.276962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:54.276969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895078333906403:6061] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:54.277528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895078333906403:6061] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:54.278747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:54.279379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895078333906403:6061] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:54.281402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:54.281595Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:54.281605Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:54.281615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:54.281663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:54.281699Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895078244178666:5056]
2025-09-30T14:51:54.281812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895078333906403:6061] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:54.281827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895078333906403:6061] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:54.281830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895078333906403:6061] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:54.281837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 614 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:54.282326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:54.282593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:54.282635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:54.282985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:54.283070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:54.283076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:54.283078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:54.283079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:54.283080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:54.283081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:54.283083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:54.283084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:54.283085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:54.283086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:54.283087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.283088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.283089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.283091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:54.283092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:54.283097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:54.283107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:54.283112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:54.283116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:54.283120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:54.283124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:54.283128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:54.283132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:54.283136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:54.283141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:54.283145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.283149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.283153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.283156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:54.283160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:54.283168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:54.283175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:54.283181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:54.283187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:54.283191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:54.283196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:54.283200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:54.283205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:54.283209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:54.283213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:54.283217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:54.283221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:54.283226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:54.283231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:54.283235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:54.283258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:54.283265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:54.283270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:54.283281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:54.283287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:54.283298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.283302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.283311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.283316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.283326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.283331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.283336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:54.283345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:54.283357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:54.283363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:54.283411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:54.288851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:54.290058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:54.290084Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:54.290087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:54.290091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:54.290097Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 613 [2:7555895078244178666:5056]
2025-09-30T14:51:54.290116Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:54.290135Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:54.290141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:54.290145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:54.290147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:54.290163Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:54.290173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:54.290184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:54.290248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.290255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.290257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.290261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:54.290264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:54.290338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:54.290345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.290359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.290376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.290398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:54.290430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895078333906467:6061], now have 1 active actors on pipe
2025-09-30T14:51:54.290437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895078333906279:2454], now have 1 active actors on pipe
2025-09-30T14:51:54.290443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895078244178661:5056]
2025-09-30T14:51:54.290445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895078244178661:5056]
2025-09-30T14:51:54.290447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895078244178661:5056]
2025-09-30T14:51:54.290459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:54.290477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:54.290480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:54.290485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:54.290487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:54.290495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:54.290498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:54.290533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895078244178661:5056]
2025-09-30T14:51:54.290540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:54.290501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 613
2025-09-30T14:51:54.290542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:54.290501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 613
2025-09-30T14:51:54.290555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:54.290560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:54.290616Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5123194e-3d78aa93-daa8c8e8-64cd8a76_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:54.290628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:54.290635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:54.290637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:54.290647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:54.290659Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:54.290681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:54.290851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:54.290863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:54.290887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:54.290994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 614 partition: 0 MaxSeqNo: 42 sessionId: src_id|5123194e-3d78aa93-daa8c8e8-64cd8a76_0
2025-09-30T14:51:54.291395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a98fd63-111e6608-a0c2599e-c786b99d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5123194e-3d78aa93-daa8c8e8-64cd8a76_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:54.294466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5123194e-3d78aa93-daa8c8e8-64cd8a76_0] Write session: try to update token
2025-09-30T14:51:54.294493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5123194e-3d78aa93-daa8c8e8-64cd8a76_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:54.302637Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:54.302654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:54.302657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:54.302659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:54.302668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895078244178661:5056]
2025-09-30T14:51:54.302672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895078244178661:5056]
2025-09-30T14:51:54.302679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895078244178661:5056]
2025-09-30T14:51:54.302720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:54.302727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.302729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:54.302730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:54.302736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:54.302740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:54.302866Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:54.309145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 614 sessionId: src_id|5123194e-3d78aa93-daa8c8e8-64cd8a76_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:54.311838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:54.365128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895078333906479:5991]
2025-09-30T14:51:54.365396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 613, pipe: [1:7555895078333906479:5991]
2025-09-30T14:51:54.409749Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:54.410032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:54.410046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:54.410081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895078333906479:5991], now have 1 active actors on pipe
2025-09-30T14:51:54.410287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:54.410312Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:54.410306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:54.410331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895078333906479:5991]
2025-09-30T14:51:54.410352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:54.410379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 614 reason: error at write: Disconnected sessionId: src_id|5123194e-3d78aa93-daa8c8e8-64cd8a76_0
2025-09-30T14:51:54.410571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 614 sessionId: src_id|5123194e-3d78aa93-daa8c8e8-64cd8a76_0 is DEAD
2025-09-30T14:51:54.410709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5123194e-3d78aa93-daa8c8e8-64cd8a76_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:54.410722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5123194e-3d78aa93-daa8c8e8-64cd8a76_0] Write session will restart in 0.007196s
2025-09-30T14:51:54.410745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5123194e-3d78aa93-daa8c8e8-64cd8a76_0] Write session: Do CDS request
2025-09-30T14:51:54.410769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5123194e-3d78aa93-daa8c8e8-64cd8a76_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:54.418759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5123194e-3d78aa93-daa8c8e8-64cd8a76_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:54.418861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:54.418877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 615
2025-09-30T14:51:54.418991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 615 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:54.419015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 615 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:54.419025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=615 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:54.419027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:54.419442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 615 sessionId:  describe result for acl check
2025-09-30T14:51:54.419475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:54.419482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:54.419486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:54.419492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895078333906533:6065] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:54.420048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895078333906533:6065] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:54.422186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895078333906533:6065] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:54.424017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:54.426238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:54.426394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895078333906533:6065] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:54.426408Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:54.426429Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:54.426420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895078333906533:6065] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:54.426439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:54.426424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895078333906533:6065] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:54.426432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 615 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:54.426489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:54.426524Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895078244178860:5058]
2025-09-30T14:51:54.427163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:54.427426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:54.427465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:54.427741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:54.427786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:54.427791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:54.427792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:54.427793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:54.427793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:54.427794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:54.427795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:54.427795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:54.427796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:54.427797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:54.427798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.427798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.427799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.427800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:54.427801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:54.427804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:54.427811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:54.427813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:54.427816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:54.427818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:54.427821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:54.427823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:54.427825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:54.427828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:54.427830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:54.427833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.427835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.427837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.427840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:54.427842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:54.427847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:54.427852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:54.427855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:54.427859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:54.427861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:54.427864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:54.427867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:54.427870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:54.427873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:54.427876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:54.427878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:54.427882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:54.427886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:54.427889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:54.427892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:54.427894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:54.427897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:54.427900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:54.427902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:54.427906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:54.427908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.427911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.427913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.427916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.427918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.427923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.427928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:54.427933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:54.427937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:54.427943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:54.427970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:54.433106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:54.433941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:54.433952Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:54.433956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:54.433960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:54.433967Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 614 [2:7555895078244178860:5058]
2025-09-30T14:51:54.433982Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:54.433997Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:54.434000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:54.434003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:54.434007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:54.434023Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:54.434029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:54.434036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:54.434088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.434098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.434100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.434103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:54.434106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:54.434165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:54.434173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.434185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.434198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.434221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:54.434242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895078333906671:6065], now have 1 active actors on pipe
2025-09-30T14:51:54.434253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895078244178855:5058]
2025-09-30T14:51:54.434261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895078244178855:5058]
2025-09-30T14:51:54.434263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895078244178855:5058]
2025-09-30T14:51:54.434275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:54.434289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:54.434290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895078333906481:2454], now have 1 active actors on pipe
2025-09-30T14:51:54.434298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:54.434298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:54.434300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:54.434313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:54.434316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:54.434342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895078244178855:5058]
2025-09-30T14:51:54.434354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:54.434369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:54.434354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 614
2025-09-30T14:51:54.434402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:54.434422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:54.434379Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 614
2025-09-30T14:51:54.434450Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8337c8f2-e137ff86-29276e1f-24ca14e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:54.434461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:54.434473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:54.434475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:54.434485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:54.434494Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:54.434508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:54.434651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:54.434660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:54.434675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:54.434761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 615 partition: 0 MaxSeqNo: 42 sessionId: src_id|8337c8f2-e137ff86-29276e1f-24ca14e5_0
2025-09-30T14:51:54.435140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5123194e-3d78aa93-daa8c8e8-64cd8a76_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8337c8f2-e137ff86-29276e1f-24ca14e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:54.437902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8337c8f2-e137ff86-29276e1f-24ca14e5_0] Write session: try to update token
2025-09-30T14:51:54.437919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8337c8f2-e137ff86-29276e1f-24ca14e5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:54.445735Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:54.445754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:54.445763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895078244178855:5058]
2025-09-30T14:51:54.445805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:54.445817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:54.445995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:54.446543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:54.446694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:54.447205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:54.447422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:54.447471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:54.451371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 615 sessionId: src_id|8337c8f2-e137ff86-29276e1f-24ca14e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:54.453980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:54.454181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:54.454201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:54.454236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:54.454301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:54.456049Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:54.456065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:54.456067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:54.456068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:54.456075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895078244178855:5058]
2025-09-30T14:51:54.456078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895078244178855:5058]
2025-09-30T14:51:54.456080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895078244178855:5058]
2025-09-30T14:51:54.456116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:54.456115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:54.456119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:54.456121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.456123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:54.456123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:54.456248Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:54.510514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895078333906684:5991]
2025-09-30T14:51:54.510723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 614, pipe: [1:7555895078333906684:5991]
2025-09-30T14:51:54.561974Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:54.569339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:54.569361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:54.569520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:54.569586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:54.569647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:54.569705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:54.569747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:54.569755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:54.569818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:54.569873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:54.569943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:54.570003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:54.570042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:54.570048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:54.570108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:54.570168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:54.570235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:54.570304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:54.570355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:54.570363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:54.570444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:54.570512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:54.570583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:54.570651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:54.570696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:54.570704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:54.570769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:54.570826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:54.570884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:54.570949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:54.570994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:54.571000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:54.571065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:54.571125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:54.571184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:54.571270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:54.571314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:54.571320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:54.571379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:54.571433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:54.571497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:54.571572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:54.571630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:54.571638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:54.571709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:54.571769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:54.571836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:54.571909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:54.571957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:54.571965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:54.572037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:54.572100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:54.572165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:54.572234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:54.572285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:54.572292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:54.572362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:54.572423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:54.572482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:54.572542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:54.572584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:54.572589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:54.572641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895078333906684:5991], now have 1 active actors on pipe
2025-09-30T14:51:54.572970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895078333906684:5991]
2025-09-30T14:51:54.572996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:54.573000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:54.573032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 615 reason: error at write: Disconnected sessionId: src_id|8337c8f2-e137ff86-29276e1f-24ca14e5_0
2025-09-30T14:51:54.573186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 615 sessionId: src_id|8337c8f2-e137ff86-29276e1f-24ca14e5_0 is DEAD
2025-09-30T14:51:54.573316Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:54.573344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8337c8f2-e137ff86-29276e1f-24ca14e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:54.573354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8337c8f2-e137ff86-29276e1f-24ca14e5_0] Write session will restart in 0.009199s
2025-09-30T14:51:54.573372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8337c8f2-e137ff86-29276e1f-24ca14e5_0] Write session: Do CDS request
2025-09-30T14:51:54.573376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8337c8f2-e137ff86-29276e1f-24ca14e5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:54.573681Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:54.583752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8337c8f2-e137ff86-29276e1f-24ca14e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:54.583854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:54.583874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 616
2025-09-30T14:51:54.584019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 616 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:54.584051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 616 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:54.584062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=616 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:54.584066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:54.584508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 616 sessionId:  describe result for acl check
2025-09-30T14:51:54.584546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:54.584553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:54.584555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:54.584561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895078333906760:6070] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:54.585142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895078333906760:6070] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:54.587832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895078333906760:6070] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:54.588654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:54.590763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:54.590932Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:54.590941Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:54.590951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:54.590992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:54.591030Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895078244179057:5061]
2025-09-30T14:51:54.591113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895078333906760:6070] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:54.591128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895078333906760:6070] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:54.591131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895078333906760:6070] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:54.591139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 616 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:54.591699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:54.592014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:54.592058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:54.592373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:54.592423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:54.592427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:54.592428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:54.592428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:54.592429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:54.592431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:54.592432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:54.592433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:54.592435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:54.592436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:54.592436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.592438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.592439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.592440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:54.592441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:54.592445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:54.592453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:54.592457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:54.592462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:54.592465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:54.592468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:54.592472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:54.592476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:54.592479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:54.592483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:54.592486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.592490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.592493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.592497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:54.592500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:54.592506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:54.592514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:54.592519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:54.592523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:54.592528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:54.592532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:54.592536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:54.592541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:54.592546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:54.592551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:54.592555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:54.592559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:54.592569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:54.592573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:54.592577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:54.592583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:54.592591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:54.592596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:54.592600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:54.592605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:54.592608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.592612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.592617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.592621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.592626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.592630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.592634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:54.592638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:54.592648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:54.592652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:54.592690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:54.598040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:54.598902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:54.598918Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:54.598920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:54.598925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:54.598931Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 615 [2:7555895078244179057:5061]
2025-09-30T14:51:54.598947Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:54.598961Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:54.598968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:54.598971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:54.598973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:54.598987Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:54.598993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:54.599000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:54.599056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.599063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.599065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.599068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:54.599071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:54.599133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:54.599142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.599152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.599162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.599178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:54.599196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895078333906877:6070], now have 1 active actors on pipe
2025-09-30T14:51:54.599204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895078333906686:2454], now have 1 active actors on pipe
2025-09-30T14:51:54.599210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895078244179052:5061]
2025-09-30T14:51:54.599212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895078244179052:5061]
2025-09-30T14:51:54.599214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895078244179052:5061]
2025-09-30T14:51:54.599226Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:54.599239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:54.599265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:54.599266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:54.599268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:54.599284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:54.599291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:54.599316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895078244179052:5061]
2025-09-30T14:51:54.599324Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:54.599335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:54.599304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 615
2025-09-30T14:51:54.599318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 615
2025-09-30T14:51:54.599360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:54.599374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:54.599399Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9ae0f8b-15be0adc-1ddc7cbd-a33fcc97_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:54.599425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:54.599436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:54.599439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:54.599447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:54.599455Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:54.599467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:54.599605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:54.599615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:54.599629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:54.599724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 616 partition: 0 MaxSeqNo: 42 sessionId: src_id|a9ae0f8b-15be0adc-1ddc7cbd-a33fcc97_0
2025-09-30T14:51:54.600083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8337c8f2-e137ff86-29276e1f-24ca14e5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a9ae0f8b-15be0adc-1ddc7cbd-a33fcc97_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:54.602892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9ae0f8b-15be0adc-1ddc7cbd-a33fcc97_0] Write session: try to update token
2025-09-30T14:51:54.602911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9ae0f8b-15be0adc-1ddc7cbd-a33fcc97_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:54.611449Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:54.611469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:54.611472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:54.611474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:54.611484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895078244179052:5061]
2025-09-30T14:51:54.611489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895078244179052:5061]
2025-09-30T14:51:54.611493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895078244179052:5061]
2025-09-30T14:51:54.611535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:54.611546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.611549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:54.611558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:54.611568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:54.611573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:54.611694Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:54.617513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 616 sessionId: src_id|a9ae0f8b-15be0adc-1ddc7cbd-a33fcc97_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:54.620167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:54.673350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895078333906888:5991]
2025-09-30T14:51:54.673753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 615, pipe: [1:7555895078333906888:5991]
2025-09-30T14:51:54.718251Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:54.718932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:54.718947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:54.718980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895078333906888:5991], now have 1 active actors on pipe
2025-09-30T14:51:54.719143Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:54.719214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:54.719232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:54.719268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895078333906888:5991]
2025-09-30T14:51:54.719290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:54.719310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 616 reason: error at write: Disconnected sessionId: src_id|a9ae0f8b-15be0adc-1ddc7cbd-a33fcc97_0
2025-09-30T14:51:54.719488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 616 sessionId: src_id|a9ae0f8b-15be0adc-1ddc7cbd-a33fcc97_0 is DEAD
2025-09-30T14:51:54.719667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9ae0f8b-15be0adc-1ddc7cbd-a33fcc97_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:54.719678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9ae0f8b-15be0adc-1ddc7cbd-a33fcc97_0] Write session will restart in 0.009868s
2025-09-30T14:51:54.719702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9ae0f8b-15be0adc-1ddc7cbd-a33fcc97_0] Write session: Do CDS request
2025-09-30T14:51:54.719707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9ae0f8b-15be0adc-1ddc7cbd-a33fcc97_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:54.730791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9ae0f8b-15be0adc-1ddc7cbd-a33fcc97_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:54.730904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:54.730924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 617
2025-09-30T14:51:54.731042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 617 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:54.731075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 617 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:54.731083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=617 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:54.731087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:54.731565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 617 sessionId:  describe result for acl check
2025-09-30T14:51:54.731609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:54.731619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:54.731622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:54.731627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895078333906997:6074] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:54.732098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895078333906997:6074] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:54.733897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895078333906997:6074] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:54.734447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:54.736826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:54.737039Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:54.737052Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:54.737063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:54.737128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:54.737170Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895078244179253:5063]
2025-09-30T14:51:54.737215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895078333906997:6074] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:54.737231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895078333906997:6074] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:54.737235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895078333906997:6074] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:54.737242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 617 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:54.737773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:54.738037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:54.738072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:54.738290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:54.738330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:54.738334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:54.738334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:54.738335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:54.738336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:54.738337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:54.738337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:54.738338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:54.738339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:54.738339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:54.738340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.738341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.738342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.738343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:54.738344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:54.738347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:54.738354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:54.738357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:54.738362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:54.738366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:54.738370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:54.738373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:54.738377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:54.738380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:54.738384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:54.738387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.738391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.738395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.738398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:54.738402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:54.738420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:54.738428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:54.738432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:54.738435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:54.738438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:54.738442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:54.738444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:54.738447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:54.738450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:54.738453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:54.738455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:54.738458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:54.738460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:54.738464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:54.738466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:54.738469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:54.738472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:54.738475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:54.738477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:54.738480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:54.738482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.738485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.738488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.738491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.738495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.738498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.738501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:54.738504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:54.738507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:54.738510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:54.738534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:54.743698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:54.744578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:54.744603Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:54.744607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:54.744611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:54.744618Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 616 [2:7555895078244179253:5063]
2025-09-30T14:51:54.744636Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:54.744653Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:54.744661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:54.744664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:54.744667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:54.744683Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:54.744694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:54.744705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:54.744775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.744785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.744788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.744792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:54.744794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:54.744859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:54.744867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.744881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.744899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.744920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:54.744943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895078333907082:6074], now have 1 active actors on pipe
2025-09-30T14:51:54.744952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895078333906889:2454], now have 1 active actors on pipe
2025-09-30T14:51:54.744958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895078244179248:5063]
2025-09-30T14:51:54.744960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895078244179248:5063]
2025-09-30T14:51:54.744962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895078244179248:5063]
2025-09-30T14:51:54.744975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:54.744991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:54.745013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:54.745014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:54.745016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:54.745019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:54.745021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:54.745027Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 616
2025-09-30T14:51:54.745049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895078244179248:5063]
2025-09-30T14:51:54.745047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 616
2025-09-30T14:51:54.745059Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:54.745068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:54.745097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:54.745101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:54.745134Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16f7144f-7a4efd82-a96cf0d0-83ece4b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:54.745146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:54.745149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:54.745151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:54.745163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:54.745172Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:54.745187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:54.745363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:54.745375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:54.745394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:54.745490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 617 partition: 0 MaxSeqNo: 42 sessionId: src_id|16f7144f-7a4efd82-a96cf0d0-83ece4b7_0
2025-09-30T14:51:54.745838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9ae0f8b-15be0adc-1ddc7cbd-a33fcc97_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|16f7144f-7a4efd82-a96cf0d0-83ece4b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:54.748581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16f7144f-7a4efd82-a96cf0d0-83ece4b7_0] Write session: try to update token
2025-09-30T14:51:54.748596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16f7144f-7a4efd82-a96cf0d0-83ece4b7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:54.756886Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:54.756909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:54.756911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:54.756914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:54.756924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895078244179248:5063]
2025-09-30T14:51:54.756930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895078244179248:5063]
2025-09-30T14:51:54.756937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895078244179248:5063]
2025-09-30T14:51:54.756983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:54.756982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:54.756991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:54.756995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:54.757303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.757318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:54.757468Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:54.763281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 617 sessionId: src_id|16f7144f-7a4efd82-a96cf0d0-83ece4b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:54.766063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:54.819299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895078333907093:5991]
2025-09-30T14:51:54.819578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 616, pipe: [1:7555895078333907093:5991]
2025-09-30T14:51:54.862353Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:54.862637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:54.862667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:54.862716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895078333907093:5991], now have 1 active actors on pipe
2025-09-30T14:51:54.862903Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:54.862971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:54.862987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:54.863001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895078333907093:5991]
2025-09-30T14:51:54.863029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:54.863040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 617 reason: error at write: Disconnected sessionId: src_id|16f7144f-7a4efd82-a96cf0d0-83ece4b7_0
2025-09-30T14:51:54.863209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 617 sessionId: src_id|16f7144f-7a4efd82-a96cf0d0-83ece4b7_0 is DEAD
2025-09-30T14:51:54.863356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16f7144f-7a4efd82-a96cf0d0-83ece4b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:54.863365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16f7144f-7a4efd82-a96cf0d0-83ece4b7_0] Write session will restart in 0.008162s
2025-09-30T14:51:54.863387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16f7144f-7a4efd82-a96cf0d0-83ece4b7_0] Write session: Do CDS request
2025-09-30T14:51:54.863394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16f7144f-7a4efd82-a96cf0d0-83ece4b7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:54.872806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16f7144f-7a4efd82-a96cf0d0-83ece4b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:54.872884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:54.872902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 618
2025-09-30T14:51:54.873034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 618 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:54.873077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 618 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:54.873086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=618 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:54.873091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:54.873532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 618 sessionId:  describe result for acl check
2025-09-30T14:51:54.873572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:54.873574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:54.873576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:54.873581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895078333907176:6078] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:54.874057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895078333907176:6078] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:54.876230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895078333907176:6078] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:54.877704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:54.880063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:54.880283Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:54.880296Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:54.880318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:54.880393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:54.880446Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895078244179462:5065]
2025-09-30T14:51:54.880462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895078333907176:6078] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:54.880483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895078333907176:6078] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:54.880486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895078333907176:6078] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:54.880495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 618 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:54.881020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:54.881333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:54.881387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:54.881721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:54.881791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:54.881797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:54.881799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:54.881800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:54.881801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:54.881802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:54.881803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:54.881805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:54.881806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:54.881807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:54.881808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.881809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.881810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.881811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:54.881813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:54.881819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:54.881829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:54.881833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:54.881837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:54.881841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:54.881845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:54.881849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:54.881852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:54.881856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:54.881860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:54.881863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.881868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.881872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.881876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:54.881891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:54.881900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:54.881914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:54.881920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:54.881926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:54.881932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:54.881937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:54.881942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:54.881947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:54.881953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:54.881958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:54.881963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:54.881973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:54.881978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:54.881983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:54.881993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:54.881998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:54.882007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:54.882013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:54.882017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:54.882023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:54.882031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.882037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.882045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.882050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.882058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.882068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.882073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:54.882083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:54.882087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:54.882092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:54.882141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:54.887801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:54.888697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:54.888710Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:54.888712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:54.888715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:54.888721Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 617 [2:7555895078244179462:5065]
2025-09-30T14:51:54.888734Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:54.888747Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:54.888752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:54.888755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:54.888756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:54.888769Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:54.888774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:54.888786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:54.888856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.888862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.888863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.888866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:54.888868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:54.888919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:54.888927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.888940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:54.888952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:54.888971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:54.888988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895078244179457:5065]
2025-09-30T14:51:54.888995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895078244179457:5065]
2025-09-30T14:51:54.888998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895078244179457:5065]
2025-09-30T14:51:54.889006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:54.889017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:54.889036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:54.889037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:54.889039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:54.889049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:54.889052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:54.889062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895078333907094:2454], now have 1 active actors on pipe
2025-09-30T14:51:54.889072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895078333907287:6078], now have 1 active actors on pipe
2025-09-30T14:51:54.889104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895078244179457:5065]
2025-09-30T14:51:54.889116Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:54.889135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:54.889110Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 617
2025-09-30T14:51:54.889203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 617
2025-09-30T14:51:54.889237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:54.889247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:54.889270Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9dc0d983-f7ca73b4-7472a3f4-7c641e11_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:54.889283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:54.889290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:54.889292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:54.889301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:54.889311Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:54.889325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:54.889482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:54.889496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:54.889521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:54.889608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 618 partition: 0 MaxSeqNo: 42 sessionId: src_id|9dc0d983-f7ca73b4-7472a3f4-7c641e11_0
2025-09-30T14:51:54.889920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16f7144f-7a4efd82-a96cf0d0-83ece4b7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9dc0d983-f7ca73b4-7472a3f4-7c641e11_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:54.892595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dc0d983-f7ca73b4-7472a3f4-7c641e11_0] Write session: try to update token
2025-09-30T14:51:54.892614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dc0d983-f7ca73b4-7472a3f4-7c641e11_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:54.905932Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:54.905950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:54.905960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895078244179457:5065]
2025-09-30T14:51:54.906006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:54.906024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:54.906182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:54.906181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 618 sessionId: src_id|9dc0d983-f7ca73b4-7472a3f4-7c641e11_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:54.906330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:54.906484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:54.906639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:54.906821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:54.906868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:54.908714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:54.908917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:54.908931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:54.908964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:54.909063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:54.911145Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:54.911159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:54.911161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:54.911163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:54.911169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895078244179457:5065]
2025-09-30T14:51:54.911173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895078244179457:5065]
2025-09-30T14:51:54.911176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895078244179457:5065]
2025-09-30T14:51:54.911207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:54.911214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:54.911217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:54.911228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:54.911264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:54.911267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:54.911374Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:54.963143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895078333907311:5991]
2025-09-30T14:51:54.963654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 617, pipe: [1:7555895078333907311:5991]
2025-09-30T14:51:55.018748Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:55.026102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:55.026129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:55.026295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:55.026364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:55.026446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:55.026517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:55.027093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:55.027104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:55.027176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:55.027234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:55.027306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:55.027366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:55.027411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:55.027419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:55.027483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:55.027544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:55.027603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:55.027673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:55.027716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:55.027722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:55.027786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:55.027858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:55.027926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:55.027993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:55.028039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:55.028044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:55.028110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:55.028175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:55.028236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:55.028298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:55.028339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:55.028349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:55.028414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:55.028472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:55.028543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:55.028609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:55.028651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:55.028656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:55.028728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:55.028785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:55.028848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:55.028917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:55.028959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:55.028966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:55.029027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:55.029083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:55.029151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:55.029228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:55.029275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:55.029280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:55.029341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:55.029397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:55.029467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:55.029537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:55.029592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:55.029597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:55.029668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:55.029734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:55.029800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:55.029861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:55.029904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:55.029910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:55.029974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895078333907311:5991], now have 1 active actors on pipe
2025-09-30T14:51:55.030226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895078333907311:5991]
2025-09-30T14:51:55.030238Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:55.030278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:55.030280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:55.030308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 618 reason: error at write: Disconnected sessionId: src_id|9dc0d983-f7ca73b4-7472a3f4-7c641e11_0
2025-09-30T14:51:55.030507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 618 sessionId: src_id|9dc0d983-f7ca73b4-7472a3f4-7c641e11_0 is DEAD
2025-09-30T14:51:55.030543Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:55.030677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dc0d983-f7ca73b4-7472a3f4-7c641e11_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:55.030685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dc0d983-f7ca73b4-7472a3f4-7c641e11_0] Write session will restart in 0.008672s
2025-09-30T14:51:55.030707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dc0d983-f7ca73b4-7472a3f4-7c641e11_0] Write session: Do CDS request
2025-09-30T14:51:55.030713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dc0d983-f7ca73b4-7472a3f4-7c641e11_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:55.040827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dc0d983-f7ca73b4-7472a3f4-7c641e11_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:55.040890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:55.040909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 619
2025-09-30T14:51:55.041050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 619 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:55.041082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 619 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:55.041092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=619 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:55.041096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:55.041580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 619 sessionId:  describe result for acl check
2025-09-30T14:51:55.041619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:55.041626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:55.041628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:55.041634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895082628874722:6085] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:55.042236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895082628874722:6085] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:55.044597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:55.044624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895082628874722:6085] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:55.046772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:55.046954Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:55.046965Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:55.046975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:55.047028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:55.047070Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895082539146956:5068]
2025-09-30T14:51:55.047124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895082628874722:6085] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:55.047148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895082628874722:6085] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:55.047151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895082628874722:6085] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:55.047159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 619 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:55.047746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:55.048020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:55.048067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:55.048413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:55.048482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:55.048488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:55.048490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:55.048491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:55.048492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:55.048493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:55.048494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:55.048496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:55.048497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:55.048498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:55.048499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.048500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.048502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.048503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:55.048504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:55.048510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:55.048520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:55.048525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:55.048529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:55.048533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:55.048537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:55.048541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:55.048545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:55.048548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:55.048552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:55.048555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.048557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.048560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.048562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:55.048564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:55.048569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:55.048575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:55.048579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:55.048583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:55.048586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:55.048590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:55.048593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:55.048595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:55.048598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:55.048601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:55.048603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:55.048606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:55.048609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:55.048611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:55.048614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:55.048617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:55.048620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:55.048622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:55.048625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:55.048628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:55.048630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.048634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.048637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.048640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.048642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.048645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.048647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:55.048651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:55.048654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:55.048656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:55.048682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:55.053814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:55.054652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:55.054666Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:55.054669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:55.054672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:55.054678Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 618 [2:7555895082539146956:5068]
2025-09-30T14:51:55.054693Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:55.054709Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:55.054716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:55.054719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:55.054722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:55.054737Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:55.054748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:55.054754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:55.054814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.054821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.054823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.054826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:55.054828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:55.054894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:55.054901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.054913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.054928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.054949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:55.054971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895082628874810:6085], now have 1 active actors on pipe
2025-09-30T14:51:55.054978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895082628874615:2454], now have 1 active actors on pipe
2025-09-30T14:51:55.054985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895082539146951:5068]
2025-09-30T14:51:55.054987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895082539146951:5068]
2025-09-30T14:51:55.054989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895082539146951:5068]
2025-09-30T14:51:55.055002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:55.055015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:55.055021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:55.055025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:55.055028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:55.055035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:55.055038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:55.055070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895082539146951:5068]
2025-09-30T14:51:55.055079Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:55.055044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 618
2025-09-30T14:51:55.055080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:55.055046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 618
2025-09-30T14:51:55.055109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:55.055118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:55.055151Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d634ce5-14b1d8d6-e153a9f2-b2e31a37_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:55.055162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:55.055170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:55.055172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:55.055180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:55.055194Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:55.055214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:55.055345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:55.055353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:55.055370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:55.055467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 619 partition: 0 MaxSeqNo: 42 sessionId: src_id|6d634ce5-14b1d8d6-e153a9f2-b2e31a37_0
2025-09-30T14:51:55.055854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dc0d983-f7ca73b4-7472a3f4-7c641e11_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6d634ce5-14b1d8d6-e153a9f2-b2e31a37_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:55.058520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d634ce5-14b1d8d6-e153a9f2-b2e31a37_0] Write session: try to update token
2025-09-30T14:51:55.058535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d634ce5-14b1d8d6-e153a9f2-b2e31a37_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:55.067575Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:55.067597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:55.067600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:55.067602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:55.067611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895082539146951:5068]
2025-09-30T14:51:55.067616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895082539146951:5068]
2025-09-30T14:51:55.067620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895082539146951:5068]
2025-09-30T14:51:55.067661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:55.067668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.067671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:55.067675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:55.067683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:55.067686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:55.067809Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:55.072922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 619 sessionId: src_id|6d634ce5-14b1d8d6-e153a9f2-b2e31a37_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:55.075778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:55.130532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895082628874825:5991]
2025-09-30T14:51:55.130811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 618, pipe: [1:7555895082628874825:5991]
2025-09-30T14:51:55.176481Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:55.177046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:55.177060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:55.177090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895082628874825:5991], now have 1 active actors on pipe
2025-09-30T14:51:55.177241Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:55.177256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:55.177274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:55.177330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 619 reason: error at write: Disconnected sessionId: src_id|6d634ce5-14b1d8d6-e153a9f2-b2e31a37_0
2025-09-30T14:51:55.177384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895082628874825:5991]
2025-09-30T14:51:55.177415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:55.177506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 619 sessionId: src_id|6d634ce5-14b1d8d6-e153a9f2-b2e31a37_0 is DEAD
2025-09-30T14:51:55.177648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d634ce5-14b1d8d6-e153a9f2-b2e31a37_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:55.177658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d634ce5-14b1d8d6-e153a9f2-b2e31a37_0] Write session will restart in 0.005004s
2025-09-30T14:51:55.177680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d634ce5-14b1d8d6-e153a9f2-b2e31a37_0] Write session: Do CDS request
2025-09-30T14:51:55.177701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d634ce5-14b1d8d6-e153a9f2-b2e31a37_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:55.183702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d634ce5-14b1d8d6-e153a9f2-b2e31a37_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:55.183795Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:55.183814Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 620
2025-09-30T14:51:55.183947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 620 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:55.183975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 620 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:55.183984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=620 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:55.183988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:55.184367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 620 sessionId:  describe result for acl check
2025-09-30T14:51:55.184399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:55.184408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:55.184410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:55.184415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895082628874840:6089] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:55.184902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895082628874840:6089] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:55.186901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895082628874840:6089] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:55.189614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895082628874840:6089] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:55.189625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895082628874840:6089] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:55.189628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895082628874840:6089] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:55.189634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 620 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:55.191336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:55.193637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:55.193825Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:55.193838Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:55.193849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:55.193898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:55.193939Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895082539147171:5077]
2025-09-30T14:51:55.194610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:55.194941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:55.194982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:55.195315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:55.195385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:55.195391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:55.195392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:55.195393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:55.195394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:55.195396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:55.195397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:55.195398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:55.195399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:55.195400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:55.195402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.195403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.195404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.195405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:55.195406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:55.195412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:55.195422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:55.195426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:55.195430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:55.195434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:55.195438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:55.195442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:55.195446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:55.195450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:55.195455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:55.195459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.195463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.195467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.195471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:55.195475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:55.195482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:55.195490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:55.195496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:55.195501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:55.195506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:55.195510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:55.195515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:55.195519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:55.195529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:55.195535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:55.195539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:55.195550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:55.195555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:55.195560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:55.195564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:55.195569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:55.195579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:55.195589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:55.195595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:55.195600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:55.195608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.195614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.195622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.195628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.195632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.195641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.195646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:55.195652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:55.195656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:55.195661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:55.195702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:55.201261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:55.202168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:55.202185Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:55.202188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:55.202191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:55.202197Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 619 [2:7555895082539147171:5077]
2025-09-30T14:51:55.202214Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:55.202228Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:55.202231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:55.202234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:55.202241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:55.202256Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:55.202268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:55.202276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:55.202335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.202343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.202345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.202349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:55.202351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:55.202421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:55.202429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.202441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.202456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.202477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:55.202498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895082628875016:6089], now have 1 active actors on pipe
2025-09-30T14:51:55.202510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895082628874826:2454], now have 1 active actors on pipe
2025-09-30T14:51:55.202516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895082539147166:5077]
2025-09-30T14:51:55.202518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895082539147166:5077]
2025-09-30T14:51:55.202520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895082539147166:5077]
2025-09-30T14:51:55.202534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:55.202550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:55.202560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:55.202564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:55.202565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:55.202566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:55.202568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:55.202598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895082539147166:5077]
2025-09-30T14:51:55.202609Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:55.202613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:55.202607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 619
2025-09-30T14:51:55.202638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 619
2025-09-30T14:51:55.202647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:55.202657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:55.202687Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d4acb1b-255c5039-4ef21c8b-4596bfec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:55.202698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:55.202701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:55.202703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:55.202711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:55.202722Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:55.202739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:55.202868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:55.202876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:55.202888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:55.202977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 620 partition: 0 MaxSeqNo: 42 sessionId: src_id|8d4acb1b-255c5039-4ef21c8b-4596bfec_0
2025-09-30T14:51:55.203317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d634ce5-14b1d8d6-e153a9f2-b2e31a37_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8d4acb1b-255c5039-4ef21c8b-4596bfec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:55.206075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d4acb1b-255c5039-4ef21c8b-4596bfec_0] Write session: try to update token
2025-09-30T14:51:55.206093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d4acb1b-255c5039-4ef21c8b-4596bfec_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:55.214573Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:55.214599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:55.214601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:55.214602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:55.214608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895082539147166:5077]
2025-09-30T14:51:55.214610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895082539147166:5077]
2025-09-30T14:51:55.214612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895082539147166:5077]
2025-09-30T14:51:55.214643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:55.214648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.214649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:55.214655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:55.214662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:55.214666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:55.214781Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:55.220193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 620 sessionId: src_id|8d4acb1b-255c5039-4ef21c8b-4596bfec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:55.222809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:55.277515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895082628875055:5991]
2025-09-30T14:51:55.277784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 619, pipe: [1:7555895082628875055:5991]
2025-09-30T14:51:55.323508Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:55.323842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:55.323855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:55.323888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895082628875055:5991], now have 1 active actors on pipe
2025-09-30T14:51:55.324096Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:55.324154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:55.324160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895082628875055:5991]
2025-09-30T14:51:55.324170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:55.324181Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:55.324242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 620 reason: error at write: Disconnected sessionId: src_id|8d4acb1b-255c5039-4ef21c8b-4596bfec_0
2025-09-30T14:51:55.324409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 620 sessionId: src_id|8d4acb1b-255c5039-4ef21c8b-4596bfec_0 is DEAD
2025-09-30T14:51:55.324543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d4acb1b-255c5039-4ef21c8b-4596bfec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:55.324550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d4acb1b-255c5039-4ef21c8b-4596bfec_0] Write session will restart in 0.009095s
2025-09-30T14:51:55.324576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d4acb1b-255c5039-4ef21c8b-4596bfec_0] Write session: Do CDS request
2025-09-30T14:51:55.324580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d4acb1b-255c5039-4ef21c8b-4596bfec_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:55.334772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d4acb1b-255c5039-4ef21c8b-4596bfec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:55.334814Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:55.334835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 621
2025-09-30T14:51:55.335027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 621 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:55.335080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 621 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:55.335085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=621 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:55.335088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:55.335560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 621 sessionId:  describe result for acl check
2025-09-30T14:51:55.335608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:55.335615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:55.335617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:55.335623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895082628875187:6100] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:55.336156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895082628875187:6100] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:55.337845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:55.338108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895082628875187:6100] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:55.340188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:55.340409Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:55.340419Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:55.340430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:55.340489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:55.340527Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895082539147393:5085]
2025-09-30T14:51:55.340639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895082628875187:6100] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:55.340653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895082628875187:6100] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:55.340656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895082628875187:6100] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:55.340665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 621 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:55.341081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:55.341342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:55.341377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:55.341622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:55.341667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:55.341671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:55.341672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:55.341673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:55.341673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:55.341674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:55.341675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:55.341675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:55.341676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:55.341677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:55.341678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.341678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.341679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.341680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:55.341680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:55.341684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:55.341690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:55.341692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:55.341695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:55.341697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:55.341699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:55.341701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:55.341704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:55.341706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:55.341709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:55.341711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.341713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.341715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.341717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:55.341720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:55.341725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:55.341731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:55.341734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:55.341738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:55.341742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:55.341745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:55.341748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:55.341751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:55.341754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:55.341757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:55.341760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:55.341763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:55.341766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:55.341769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:55.341771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:55.341774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:55.341777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:55.341780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:55.341783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:55.341785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:55.341788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.341791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.341793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.341796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.341798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.341801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.341803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:55.341806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:55.341808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:55.341811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:55.341833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:55.347234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:55.348397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:55.348412Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:55.348414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:55.348416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:55.348423Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 620 [2:7555895082539147393:5085]
2025-09-30T14:51:55.348435Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:55.348448Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:55.348451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:55.348453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:55.348454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:55.348466Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:55.348471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:55.348476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:55.348521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.348526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.348527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.348530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:55.348531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:55.348581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:55.348587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.348596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.348606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.348616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:55.348631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895082539147388:5085]
2025-09-30T14:51:55.348636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895082539147388:5085]
2025-09-30T14:51:55.348637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895082539147388:5085]
2025-09-30T14:51:55.348643Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:55.348651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:55.348656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895082628875251:6100], now have 1 active actors on pipe
2025-09-30T14:51:55.348660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:55.348660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:55.348661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:55.348670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:55.348672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:55.348676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895082628875056:2454], now have 1 active actors on pipe
2025-09-30T14:51:55.348702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895082539147388:5085]
2025-09-30T14:51:55.348715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:55.348749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:55.348763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 620
2025-09-30T14:51:55.348770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 620
2025-09-30T14:51:55.348863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:55.348871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:55.348888Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7265726d-3d8000b6-11e14448-ed3101ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:55.348896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:55.348899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:55.348900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:55.348907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:55.348914Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:55.348924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:55.349049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:55.349054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:55.349064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:55.349150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 621 partition: 0 MaxSeqNo: 42 sessionId: src_id|7265726d-3d8000b6-11e14448-ed3101ee_0
2025-09-30T14:51:55.349471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d4acb1b-255c5039-4ef21c8b-4596bfec_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7265726d-3d8000b6-11e14448-ed3101ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:55.352346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7265726d-3d8000b6-11e14448-ed3101ee_0] Write session: try to update token
2025-09-30T14:51:55.352363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7265726d-3d8000b6-11e14448-ed3101ee_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:55.360878Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:55.360898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:55.360901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:55.360903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:55.360912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895082539147388:5085]
2025-09-30T14:51:55.360916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895082539147388:5085]
2025-09-30T14:51:55.360920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895082539147388:5085]
2025-09-30T14:51:55.360959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:55.360961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:55.360965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:55.360968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:55.360970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.360973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:55.361104Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:55.366428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 621 sessionId: src_id|7265726d-3d8000b6-11e14448-ed3101ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:55.369004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:55.424474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895082628875264:5991]
2025-09-30T14:51:55.424718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 620, pipe: [1:7555895082628875264:5991]
2025-09-30T14:51:55.467339Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:55.467783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:55.467796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:55.467834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895082628875264:5991], now have 1 active actors on pipe
2025-09-30T14:51:55.468095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:55.468112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:55.468113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895082628875264:5991]
2025-09-30T14:51:55.468132Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:55.468107Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:55.468187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 621 reason: error at write: Disconnected sessionId: src_id|7265726d-3d8000b6-11e14448-ed3101ee_0
2025-09-30T14:51:55.468369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 621 sessionId: src_id|7265726d-3d8000b6-11e14448-ed3101ee_0 is DEAD
2025-09-30T14:51:55.468519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7265726d-3d8000b6-11e14448-ed3101ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:55.468529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7265726d-3d8000b6-11e14448-ed3101ee_0] Write session will restart in 0.009548s
2025-09-30T14:51:55.468560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7265726d-3d8000b6-11e14448-ed3101ee_0] Write session: Do CDS request
2025-09-30T14:51:55.468568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7265726d-3d8000b6-11e14448-ed3101ee_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:55.479772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7265726d-3d8000b6-11e14448-ed3101ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:55.479869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:55.479889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 622
2025-09-30T14:51:55.480099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 622 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:55.480140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 622 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:55.480150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=622 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:55.480156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:55.480609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 622 sessionId:  describe result for acl check
2025-09-30T14:51:55.480649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:55.480656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:55.480658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:55.480664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895082628875367:6105] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:55.481234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895082628875367:6105] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:55.483387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895082628875367:6105] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:55.484720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:55.487123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:55.487318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895082628875367:6105] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:55.487366Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:55.487335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895082628875367:6105] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:55.487376Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:55.487338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895082628875367:6105] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:55.487347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 622 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:55.487386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:55.487443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:55.487481Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895082539147593:5087]
2025-09-30T14:51:55.488152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:55.488450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:55.488491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:55.488795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:55.488858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:55.488865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:55.488866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:55.488867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:55.488868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:55.488870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:55.488871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:55.488872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:55.488874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:55.488875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:55.488876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.488877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.488878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.488880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:55.488881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:55.488886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:55.488896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:55.488901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:55.488905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:55.488910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:55.488914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:55.488918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:55.488922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:55.488925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:55.488930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:55.488934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.488939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.488943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.488947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:55.488951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:55.488958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:55.488966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:55.488972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:55.488978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:55.488983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:55.488989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:55.488993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:55.489006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:55.489011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:55.489015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:55.489020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:55.489027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:55.489033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:55.489038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:55.489043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:55.489050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:55.489058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:55.489063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:55.489072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:55.489077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:55.489082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.489087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.489092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.489102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.489107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.489116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.489121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:55.489128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:55.489133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:55.489138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:55.489189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:55.494773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:55.496001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:55.496021Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:55.496024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:55.496028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:55.496034Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 621 [2:7555895082539147593:5087]
2025-09-30T14:51:55.496051Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:55.496068Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:55.496072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:55.496080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:55.496083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:55.496100Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:55.496111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:55.496121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:55.496183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.496190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.496194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.496198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:55.496200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:55.496279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:55.496287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.496300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.496316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.496338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:55.496360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895082628875464:6105], now have 1 active actors on pipe
2025-09-30T14:51:55.496368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895082628875267:2454], now have 1 active actors on pipe
2025-09-30T14:51:55.496374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895082539147588:5087]
2025-09-30T14:51:55.496381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895082539147588:5087]
2025-09-30T14:51:55.496384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895082539147588:5087]
2025-09-30T14:51:55.496398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:55.496416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:55.496420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:55.496424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:55.496426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:55.496435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:55.496437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:55.496472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895082539147588:5087]
2025-09-30T14:51:55.496444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 621
2025-09-30T14:51:55.496478Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:55.496453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 621
2025-09-30T14:51:55.496481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:55.496512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:55.496520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:55.496551Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11cde2a-624746-7e6686cc-1b17ea09_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:55.496562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:55.496570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:55.496572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:55.496585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:55.496594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:55.496614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:55.496757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:55.496763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:55.496776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:55.496872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 622 partition: 0 MaxSeqNo: 42 sessionId: src_id|11cde2a-624746-7e6686cc-1b17ea09_0
2025-09-30T14:51:55.497219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7265726d-3d8000b6-11e14448-ed3101ee_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|11cde2a-624746-7e6686cc-1b17ea09_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:55.500012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11cde2a-624746-7e6686cc-1b17ea09_0] Write session: try to update token
2025-09-30T14:51:55.500034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11cde2a-624746-7e6686cc-1b17ea09_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:55.508731Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:55.508751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:55.508754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:55.508756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:55.508765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895082539147588:5087]
2025-09-30T14:51:55.508771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895082539147588:5087]
2025-09-30T14:51:55.508775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895082539147588:5087]
2025-09-30T14:51:55.508816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:55.508823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.508827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:55.508831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:55.508833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:55.508837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:55.508967Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:55.514690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 622 sessionId: src_id|11cde2a-624746-7e6686cc-1b17ea09_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:55.517433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:55.568327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895082628875475:5991]
2025-09-30T14:51:55.568572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 621, pipe: [1:7555895082628875475:5991]
2025-09-30T14:51:55.624208Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:55.624623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:55.624642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:55.624681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895082628875475:5991], now have 1 active actors on pipe
2025-09-30T14:51:55.624922Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:55.624952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895082628875475:5991]
2025-09-30T14:51:55.624956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:55.624963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:55.624985Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:55.625035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 622 reason: error at write: Disconnected sessionId: src_id|11cde2a-624746-7e6686cc-1b17ea09_0
2025-09-30T14:51:55.625241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 622 sessionId: src_id|11cde2a-624746-7e6686cc-1b17ea09_0 is DEAD
2025-09-30T14:51:55.625394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11cde2a-624746-7e6686cc-1b17ea09_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:55.625414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11cde2a-624746-7e6686cc-1b17ea09_0] Write session will restart in 0.006311s
2025-09-30T14:51:55.625436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11cde2a-624746-7e6686cc-1b17ea09_0] Write session: Do CDS request
2025-09-30T14:51:55.625442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11cde2a-624746-7e6686cc-1b17ea09_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:55.632699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11cde2a-624746-7e6686cc-1b17ea09_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:55.632839Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:55.632855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 623
2025-09-30T14:51:55.633011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 623 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:55.633051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 623 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:55.633058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=623 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:55.633061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:55.633483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 623 sessionId:  describe result for acl check
2025-09-30T14:51:55.633534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:55.633541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:55.633543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:55.633549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895082628875500:6109] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:55.634114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895082628875500:6109] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:55.636993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895082628875500:6109] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:55.639730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895082628875500:6109] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:55.639748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895082628875500:6109] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:55.639752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895082628875500:6109] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:55.639760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 623 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:55.640959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:55.643499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:55.643715Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:55.643730Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:55.643743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:55.643808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:55.643848Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895082539147798:5090]
2025-09-30T14:51:55.644478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:55.644835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:55.644899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:55.645240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:55.645348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:55.645357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:55.645358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:55.645359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:55.645360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:55.645362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:55.645363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:55.645364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:55.645366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:55.645367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:55.645369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.645370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.645371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.645373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:55.645374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:55.645381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:55.645392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:55.645397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:55.645402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:55.645406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:55.645410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:55.645414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:55.645417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:55.645421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:55.645428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:55.645432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.645436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.645439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.645444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:55.645448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:55.645457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:55.645465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:55.645472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:55.645478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:55.645483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:55.645488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:55.645492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:55.645497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:55.645502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:55.645508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:55.645512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:55.645517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:55.645521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:55.645527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:55.645533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:55.645538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:55.645543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:55.645552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:55.645556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:55.645563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:55.645571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.645576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.645580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.645584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.645591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.645596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.645601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:55.645606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:55.645613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:55.645618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:55.645664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:55.651394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:55.652333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:55.652356Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:55.652359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:55.652363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:55.652369Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 622 [2:7555895082539147798:5090]
2025-09-30T14:51:55.652387Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:55.652405Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:55.652408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:55.652412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:55.652414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:55.652431Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:55.652438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:55.652446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:55.652522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.652531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.652533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.652537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:55.652540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:55.652612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:55.652621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.652636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.652658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.652677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:55.652701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895082628875477:2454], now have 1 active actors on pipe
2025-09-30T14:51:55.652711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895082628875673:6109], now have 1 active actors on pipe
2025-09-30T14:51:55.652717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895082539147793:5090]
2025-09-30T14:51:55.652725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895082539147793:5090]
2025-09-30T14:51:55.652727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895082539147793:5090]
2025-09-30T14:51:55.652744Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:55.652766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:55.652769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:55.652773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:55.652775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:55.652782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:55.652786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:55.652767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 622
2025-09-30T14:51:55.652772Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 622
2025-09-30T14:51:55.652824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895082539147793:5090]
2025-09-30T14:51:55.652835Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:55.652836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:55.652857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:55.652861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:55.652910Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|158153e1-34c95d15-24c6776f-afb6d7a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:55.652922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:55.652931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:55.652933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:55.652943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:55.652954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:55.652977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:55.653131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:55.653146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:55.653164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:55.653263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 623 partition: 0 MaxSeqNo: 42 sessionId: src_id|158153e1-34c95d15-24c6776f-afb6d7a3_0
2025-09-30T14:51:55.653599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11cde2a-624746-7e6686cc-1b17ea09_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|158153e1-34c95d15-24c6776f-afb6d7a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:55.656222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|158153e1-34c95d15-24c6776f-afb6d7a3_0] Write session: try to update token
2025-09-30T14:51:55.656237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|158153e1-34c95d15-24c6776f-afb6d7a3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:55.665093Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:55.665118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:55.665121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:55.665125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:55.665137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895082539147793:5090]
2025-09-30T14:51:55.665141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895082539147793:5090]
2025-09-30T14:51:55.665145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895082539147793:5090]
2025-09-30T14:51:55.665194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:55.665201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:55.665207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:55.665214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:55.665219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.665223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:55.665428Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:55.670420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 623 sessionId: src_id|158153e1-34c95d15-24c6776f-afb6d7a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:55.673235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:55.724988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895082628875686:5991]
2025-09-30T14:51:55.725264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 622, pipe: [1:7555895082628875686:5991]
2025-09-30T14:51:55.770053Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:55.770576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:55.770591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:55.770624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895082628875686:5991], now have 1 active actors on pipe
2025-09-30T14:51:55.770801Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:55.770852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895082628875686:5991]
2025-09-30T14:51:55.770858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:55.770896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:55.770982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 623 reason: status is not ok: tablet will be restarted right now sessionId: src_id|158153e1-34c95d15-24c6776f-afb6d7a3_0
2025-09-30T14:51:55.771159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 623 sessionId: src_id|158153e1-34c95d15-24c6776f-afb6d7a3_0 is DEAD
2025-09-30T14:51:55.771302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|158153e1-34c95d15-24c6776f-afb6d7a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:55.771313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|158153e1-34c95d15-24c6776f-afb6d7a3_0] Write session will restart in 0.009341s
2025-09-30T14:51:55.771338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|158153e1-34c95d15-24c6776f-afb6d7a3_0] Write session: Do CDS request
2025-09-30T14:51:55.771343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|158153e1-34c95d15-24c6776f-afb6d7a3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:55.781771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|158153e1-34c95d15-24c6776f-afb6d7a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:55.781848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:55.781865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 624
2025-09-30T14:51:55.782040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 624 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:55.782082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 624 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:55.782091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=624 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:55.782096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:55.782548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 624 sessionId:  describe result for acl check
2025-09-30T14:51:55.782581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:55.782583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:55.782584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:55.782590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895082628875798:6113] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:55.783107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895082628875798:6113] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:55.785276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895082628875798:6113] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:55.785585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:55.787744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:55.787934Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:55.787942Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:55.787953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:55.788004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:55.788043Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895082539147999:5092]
2025-09-30T14:51:55.788112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895082628875798:6113] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:55.788143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895082628875798:6113] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:55.788149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895082628875798:6113] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:55.788157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 624 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:55.788672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:55.788921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:55.788956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:55.789193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:55.789237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:55.789242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:55.789243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:55.789244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:55.789244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:55.789245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:55.789246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:55.789247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:55.789247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:55.789248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:55.789249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.789249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.789250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.789251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:55.789251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:55.789255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:55.789261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:55.789263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:55.789266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:55.789268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:55.789271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:55.789273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:55.789275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:55.789278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:55.789280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:55.789282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.789285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.789287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.789290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:55.789293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:55.789300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:55.789308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:55.789314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:55.789320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:55.789325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:55.789330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:55.789334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:55.789336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:55.789345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:55.789348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:55.789351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:55.789354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:55.789357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:55.789360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:55.789363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:55.789366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:55.789373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:55.789376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:55.789379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:55.789386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:55.789389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.789392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.789398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.789401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.789403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.789406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.789409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:55.789412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:55.789416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:55.789419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:55.789459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:55.794859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:55.795728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:55.795739Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:55.795743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:55.795747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:55.795751Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 623 [2:7555895082539147999:5092]
2025-09-30T14:51:55.795764Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:55.795776Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:55.795778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:55.795780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:55.795782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:55.795794Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:55.795799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:55.795808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:55.795870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.795880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.795882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.795886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:55.795889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:55.795951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:55.795959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.795970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.795981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.795996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:55.796020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895082628875688:2454], now have 1 active actors on pipe
2025-09-30T14:51:55.796028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895082628875887:6113], now have 1 active actors on pipe
2025-09-30T14:51:55.796035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895082539147994:5092]
2025-09-30T14:51:55.796038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895082539147994:5092]
2025-09-30T14:51:55.796040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895082539147994:5092]
2025-09-30T14:51:55.796055Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:55.796071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:55.796074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:55.796090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:55.796093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:55.796096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:55.796098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:55.796129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895082539147994:5092]
2025-09-30T14:51:55.796137Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:55.796140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:55.796115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 623
2025-09-30T14:51:55.796161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:55.796118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 623
2025-09-30T14:51:55.796170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:55.796472Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|859678e1-b75f0648-4f42d4a7-fd505201_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:55.796490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:55.796493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:55.796495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:55.796505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:55.796515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:55.796538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:55.796701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:55.796710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:55.796725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:55.796800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 624 partition: 0 MaxSeqNo: 42 sessionId: src_id|859678e1-b75f0648-4f42d4a7-fd505201_0
2025-09-30T14:51:55.797111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|158153e1-34c95d15-24c6776f-afb6d7a3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|859678e1-b75f0648-4f42d4a7-fd505201_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:55.799612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|859678e1-b75f0648-4f42d4a7-fd505201_0] Write session: try to update token
2025-09-30T14:51:55.799626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|859678e1-b75f0648-4f42d4a7-fd505201_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:55.808074Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:55.808094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:55.808098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:55.808100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:55.808109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895082539147994:5092]
2025-09-30T14:51:55.808113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895082539147994:5092]
2025-09-30T14:51:55.808118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895082539147994:5092]
2025-09-30T14:51:55.808158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:55.808165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.808166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:55.808168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:55.808172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:55.808177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:55.808303Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:55.813678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 624 sessionId: src_id|859678e1-b75f0648-4f42d4a7-fd505201_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:55.816637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:55.870926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895082628875898:5991]
2025-09-30T14:51:55.871255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 623, pipe: [1:7555895082628875898:5991]
2025-09-30T14:51:55.913536Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:55.913792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:55.913803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:55.913836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895082628875898:5991], now have 1 active actors on pipe
2025-09-30T14:51:55.914020Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:55.914049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:55.914057Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:55.914068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:55.914099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895082628875898:5991]
2025-09-30T14:51:55.914150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 624 reason: error at write: Disconnected sessionId: src_id|859678e1-b75f0648-4f42d4a7-fd505201_0
2025-09-30T14:51:55.914314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 624 sessionId: src_id|859678e1-b75f0648-4f42d4a7-fd505201_0 is DEAD
2025-09-30T14:51:55.914461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|859678e1-b75f0648-4f42d4a7-fd505201_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:55.914470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|859678e1-b75f0648-4f42d4a7-fd505201_0] Write session will restart in 0.009533s
2025-09-30T14:51:55.914486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|859678e1-b75f0648-4f42d4a7-fd505201_0] Write session: Do CDS request
2025-09-30T14:51:55.914489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|859678e1-b75f0648-4f42d4a7-fd505201_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:55.924805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|859678e1-b75f0648-4f42d4a7-fd505201_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:55.924850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:55.924866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 625
2025-09-30T14:51:55.925052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 625 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:55.925087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 625 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:55.925098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=625 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:55.925101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:55.925549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 625 sessionId:  describe result for acl check
2025-09-30T14:51:55.925584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:55.925589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:55.925591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:55.925596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895082628876014:6118] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:55.926150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895082628876014:6118] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:55.928306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895082628876014:6118] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:55.929168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:55.931718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:55.931946Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:55.931958Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:55.931969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:55.932028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:55.932067Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895082539148216:5095]
2025-09-30T14:51:55.932115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895082628876014:6118] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:55.932133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895082628876014:6118] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:55.932138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895082628876014:6118] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:55.932147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 625 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:55.932747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:55.933011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:55.933052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:55.933377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:55.933433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:55.933439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:55.933441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:55.933442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:55.933443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:55.933444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:55.933446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:55.933447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:55.933448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:55.933449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:55.933451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.933452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.933453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.933454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:55.933455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:55.933461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:55.933471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:55.933475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:55.933478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:55.933481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:55.933485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:55.933489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:55.933492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:55.933496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:55.933501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:55.933504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.933508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.933511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.933516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:55.933520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:55.933527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:55.933535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:55.933541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:55.933545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:55.933551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:55.933556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:55.933561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:55.933574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:55.933580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:55.933590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:55.933595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:55.933600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:55.933605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:55.933610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:55.933614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:55.933619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:55.933624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:55.933634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:55.933642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:55.933648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:55.933658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.933667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.933676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.933682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.933691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.933696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.933704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:55.933710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:55.933719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:55.933728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:55.933790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:55.938574Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:11802 } ]
2025-09-30T14:51:55.939358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:55.940477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:55.940491Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:55.940493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:55.940497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:55.940504Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 624 [2:7555895082539148216:5095]
2025-09-30T14:51:55.940523Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:55.940536Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:55.940538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:55.940540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:55.940543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:55.940558Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:55.940565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:55.940571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:55.940622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.940629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.940630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.940633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:55.940635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:55.940684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:55.940691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.940700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:55.940706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:55.940715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:55.940727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895082539148210:5095]
2025-09-30T14:51:55.940732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895082539148210:5095]
2025-09-30T14:51:55.940734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895082539148210:5095]
2025-09-30T14:51:55.940739Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:55.940749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:55.940762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:55.940763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:55.940765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:55.940772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:55.940775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:55.940802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895082628876111:6118], now have 1 active actors on pipe
2025-09-30T14:51:55.940812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895082628875900:2454], now have 1 active actors on pipe
2025-09-30T14:51:55.940814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895082539148210:5095]
2025-09-30T14:51:55.940822Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:55.940843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:55.940835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 624
2025-09-30T14:51:55.940865Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 624
2025-09-30T14:51:55.940884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:55.940895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:55.940923Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|749ef9e4-59bb08b8-cef39058-9818dc8d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:55.940936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:55.940940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:55.940942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:55.940950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:55.940959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:55.940975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:55.941201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:55.941216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:55.941238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:55.941363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 625 partition: 0 MaxSeqNo: 42 sessionId: src_id|749ef9e4-59bb08b8-cef39058-9818dc8d_0
2025-09-30T14:51:55.941700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|859678e1-b75f0648-4f42d4a7-fd505201_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|749ef9e4-59bb08b8-cef39058-9818dc8d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:55.944344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|749ef9e4-59bb08b8-cef39058-9818dc8d_0] Write session: try to update token
2025-09-30T14:51:55.944360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|749ef9e4-59bb08b8-cef39058-9818dc8d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:55.953658Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:55.953677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:55.953678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:55.953680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:55.953687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895082539148210:5095]
2025-09-30T14:51:55.953691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895082539148210:5095]
2025-09-30T14:51:55.953694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895082539148210:5095]
2025-09-30T14:51:55.953730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:55.953735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:55.953737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:55.953744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:55.953750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:55.953755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:55.953868Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:55.959067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 625 sessionId: src_id|749ef9e4-59bb08b8-cef39058-9818dc8d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:55.961776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:56.014262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895086923843427:5991]
2025-09-30T14:51:56.014543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 624, pipe: [1:7555895086923843427:5991]
2025-09-30T14:51:56.061930Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:56.062212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:56.062224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:56.062256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895086923843427:5991], now have 1 active actors on pipe
2025-09-30T14:51:56.062441Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:56.062465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:56.062482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:56.062490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:56.062535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895086923843427:5991]
2025-09-30T14:51:56.062570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 625 reason: error at write: Disconnected sessionId: src_id|749ef9e4-59bb08b8-cef39058-9818dc8d_0
2025-09-30T14:51:56.062734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 625 sessionId: src_id|749ef9e4-59bb08b8-cef39058-9818dc8d_0 is DEAD
2025-09-30T14:51:56.062873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|749ef9e4-59bb08b8-cef39058-9818dc8d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:56.062883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|749ef9e4-59bb08b8-cef39058-9818dc8d_0] Write session will restart in 0.006736s
2025-09-30T14:51:56.062899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|749ef9e4-59bb08b8-cef39058-9818dc8d_0] Write session: Do CDS request
2025-09-30T14:51:56.062903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|749ef9e4-59bb08b8-cef39058-9818dc8d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:56.070700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|749ef9e4-59bb08b8-cef39058-9818dc8d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:56.070856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:56.070874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 626
2025-09-30T14:51:56.070995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 626 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:56.071029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 626 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:56.071039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=626 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:56.071043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:56.071520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 626 sessionId:  describe result for acl check
2025-09-30T14:51:56.071557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:56.071565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:56.071568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:56.071573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895086923843473:6124] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:56.072087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895086923843473:6124] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:56.074693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895086923843473:6124] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:56.077481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895086923843473:6124] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:56.077499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895086923843473:6124] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:56.077504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895086923843473:6124] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:56.077513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 626 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:56.077534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:56.080323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:56.080529Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:56.080540Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:56.080551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:56.080601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:56.080644Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895086834115720:5097]
2025-09-30T14:51:56.081315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:56.081611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:56.081652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:56.081978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:56.082034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:56.082039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:56.082041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:56.082042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:56.082043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:56.082044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:56.082046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:56.082047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:56.082049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:56.082050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:56.082051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.082052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.082054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.082055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:56.082056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:56.082062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:56.082073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:56.082077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:56.082082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:56.082086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:56.082090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:56.082095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:56.082099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:56.082103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:56.082107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:56.082111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.082115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.082119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.082123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:56.082128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:56.082135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:56.082144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:56.082150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:56.082155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:56.082160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:56.082166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:56.082170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:56.082176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:56.082181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:56.082186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:56.082191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:56.082196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:56.082206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:56.082211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:56.082216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:56.082221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:56.082226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:56.082236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:56.082240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:56.082247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:56.082256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.082261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.082269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.082276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.082285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.082289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.082293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:56.082298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:56.082307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:56.082311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:56.082352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:56.087658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:56.088895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:56.088914Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:56.088917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:56.088921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:56.088928Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 625 [2:7555895086834115720:5097]
2025-09-30T14:51:56.088944Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:56.088960Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:56.088969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:56.088972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:56.088974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:56.088991Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:56.089004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:56.089011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:56.089081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.089088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.089091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.089094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:56.089097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:56.089164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:56.089172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.089185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.089201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.089225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:56.089243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895086923843431:2454], now have 1 active actors on pipe
2025-09-30T14:51:56.089255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895086923843632:6124], now have 1 active actors on pipe
2025-09-30T14:51:56.089261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895086834115712:5097]
2025-09-30T14:51:56.089264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895086834115712:5097]
2025-09-30T14:51:56.089266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895086834115712:5097]
2025-09-30T14:51:56.089279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:56.089293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:56.089304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:56.089308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:56.089309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:56.089312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:56.089315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:56.089320Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 625
2025-09-30T14:51:56.089323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 625
2025-09-30T14:51:56.089352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895086834115712:5097]
2025-09-30T14:51:56.089365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:56.089368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:56.089397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:56.089407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:56.089438Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b23c83d0-22807cb7-63502e11-b5fcdfd3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:56.089451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:56.089460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:56.089462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:56.089472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:56.089483Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:56.089509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:56.089656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:56.089664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:56.089676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:56.089762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 626 partition: 0 MaxSeqNo: 42 sessionId: src_id|b23c83d0-22807cb7-63502e11-b5fcdfd3_0
2025-09-30T14:51:56.090131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|749ef9e4-59bb08b8-cef39058-9818dc8d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b23c83d0-22807cb7-63502e11-b5fcdfd3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:56.092993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b23c83d0-22807cb7-63502e11-b5fcdfd3_0] Write session: try to update token
2025-09-30T14:51:56.093010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b23c83d0-22807cb7-63502e11-b5fcdfd3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:56.102300Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:56.102322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:56.102323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:56.102325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:56.102332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895086834115712:5097]
2025-09-30T14:51:56.102336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895086834115712:5097]
2025-09-30T14:51:56.102339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895086834115712:5097]
2025-09-30T14:51:56.102374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:56.102380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.102381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:56.102403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:56.102420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:56.102425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:56.102538Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:56.107644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 626 sessionId: src_id|b23c83d0-22807cb7-63502e11-b5fcdfd3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:56.110232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:56.162763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895086923843644:5991]
2025-09-30T14:51:56.163059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 625, pipe: [1:7555895086923843644:5991]
2025-09-30T14:51:56.207901Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:56.208262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:56.208276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:56.208308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895086923843644:5991], now have 1 active actors on pipe
2025-09-30T14:51:56.208561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:56.208576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895086923843644:5991]
2025-09-30T14:51:56.208606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:56.208609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:56.208684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 626 reason: error at write: Disconnected sessionId: src_id|b23c83d0-22807cb7-63502e11-b5fcdfd3_0
2025-09-30T14:51:56.208677Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:56.208859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 626 sessionId: src_id|b23c83d0-22807cb7-63502e11-b5fcdfd3_0 is DEAD
2025-09-30T14:51:56.208994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b23c83d0-22807cb7-63502e11-b5fcdfd3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:56.209005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b23c83d0-22807cb7-63502e11-b5fcdfd3_0] Write session will restart in 0.007269s
2025-09-30T14:51:56.209028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b23c83d0-22807cb7-63502e11-b5fcdfd3_0] Write session: Do CDS request
2025-09-30T14:51:56.209037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b23c83d0-22807cb7-63502e11-b5fcdfd3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:56.217702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b23c83d0-22807cb7-63502e11-b5fcdfd3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:56.217768Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:56.217782Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 627
2025-09-30T14:51:56.217917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 627 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:56.217940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 627 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:56.217946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=627 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:56.217950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:56.218563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 627 sessionId:  describe result for acl check
2025-09-30T14:51:56.218601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:56.218603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:56.218605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:56.218610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895086923843718:6128] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:56.219041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895086923843718:6128] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:56.220923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895086923843718:6128] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:56.222899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:56.223153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895086923843718:6128] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:56.223166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895086923843718:6128] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:56.223170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895086923843718:6128] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:56.223177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 627 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:56.224984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:56.225218Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:56.225226Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:56.225234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:56.225275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:56.225304Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895086834115939:5100]
2025-09-30T14:51:56.225768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:56.226015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:56.226049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:56.226291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:56.226337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:56.226342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:56.226343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:56.226343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:56.226344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:56.226345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:56.226346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:56.226347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:56.226347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:56.226348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:56.226349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.226349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.226350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.226351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:56.226351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:56.226355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:56.226361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:56.226364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:56.226366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:56.226369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:56.226371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:56.226373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:56.226375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:56.226378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:56.226380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:56.226383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.226385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.226388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.226390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:56.226392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:56.226397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:56.226401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:56.226419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:56.226424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:56.226429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:56.226435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:56.226439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:56.226445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:56.226449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:56.226454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:56.226456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:56.226459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:56.226464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:56.226466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:56.226469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:56.226474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:56.226478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:56.226481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:56.226483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:56.226486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:56.226488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.226491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.226493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.226496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.226498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.226501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.226503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:56.226506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:56.226508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:56.226511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:56.226534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:56.231882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:56.232783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:56.232795Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:56.232797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:56.232800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:56.232804Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 626 [2:7555895086834115939:5100]
2025-09-30T14:51:56.232815Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:56.232827Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:56.232831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:56.232833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:56.232836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:56.232850Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:56.232856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:56.232863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:56.232906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.232912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.232914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.232916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:56.232918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:56.232964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:56.232969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.232977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.232984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.232994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:56.233011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895086923843847:6128], now have 1 active actors on pipe
2025-09-30T14:51:56.233019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895086834115933:5100]
2025-09-30T14:51:56.233021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895086834115933:5100]
2025-09-30T14:51:56.233022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895086834115933:5100]
2025-09-30T14:51:56.233028Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:56.233034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895086923843645:2454], now have 1 active actors on pipe
2025-09-30T14:51:56.233040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:56.233044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:56.233052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:56.233055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:56.233055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:56.233057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:56.233081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895086834115933:5100]
2025-09-30T14:51:56.233086Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:56.233091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:56.233122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 626
2025-09-30T14:51:56.233156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 626
2025-09-30T14:51:56.233201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:56.233209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:56.233228Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7276bb9c-f1ea8556-a12b1c36-90ba91bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:56.233233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:56.233237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:56.233239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:56.233245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:56.233252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:56.233263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:56.233408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:56.233414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:56.233423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:56.233508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 627 partition: 0 MaxSeqNo: 42 sessionId: src_id|7276bb9c-f1ea8556-a12b1c36-90ba91bb_0
2025-09-30T14:51:56.233813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b23c83d0-22807cb7-63502e11-b5fcdfd3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7276bb9c-f1ea8556-a12b1c36-90ba91bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:56.236449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7276bb9c-f1ea8556-a12b1c36-90ba91bb_0] Write session: try to update token
2025-09-30T14:51:56.236463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7276bb9c-f1ea8556-a12b1c36-90ba91bb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:56.244964Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:56.244989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:56.244997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895086834115933:5100]
2025-09-30T14:51:56.245040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:56.245043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:56.245226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:56.245384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:56.245546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:56.245703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:56.245916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:56.245964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:56.250149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 627 sessionId: src_id|7276bb9c-f1ea8556-a12b1c36-90ba91bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:56.252844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:56.253087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:56.253109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:56.253155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:56.253224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:56.255403Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:56.255424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:56.255426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:56.255428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:56.255437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895086834115933:5100]
2025-09-30T14:51:56.255440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895086834115933:5100]
2025-09-30T14:51:56.255443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895086834115933:5100]
2025-09-30T14:51:56.255482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:56.255482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:56.255488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.255489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:56.255489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:56.255493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:56.255629Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:56.308689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895086923843881:5991]
2025-09-30T14:51:56.309098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 626, pipe: [1:7555895086923843881:5991]
2025-09-30T14:51:56.359708Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:56.367412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:56.367436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:56.367587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:56.367648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:56.367707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:56.367767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:56.367814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:56.367822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:56.367887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:56.367944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:56.368002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:56.368063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:56.368104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:56.368112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:56.368199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:56.368256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:56.368326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:56.368388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:56.368430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:56.368436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:56.368501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:56.368901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:56.368965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:56.369025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:56.369068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:56.369074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:56.369138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:56.369195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:56.369252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:56.369309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:56.369353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:56.369358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:56.369422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:56.369481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:56.369541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:56.369600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:56.369642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:56.369647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:56.369708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:56.369772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:56.369846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:56.369906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:56.369946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:56.369952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:56.370014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:56.370072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:56.370132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:56.370191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:56.370232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:56.370237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:56.370301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:56.370359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:56.370432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:56.370494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:56.370541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:56.370547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:56.370608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:56.370664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:56.370722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:56.370780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:56.370822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:56.370827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:56.370887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895086923843881:5991], now have 1 active actors on pipe
2025-09-30T14:51:56.371186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895086923843881:5991]
2025-09-30T14:51:56.371232Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:56.371397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:56.371407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:56.371431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 627 reason: error at write: Disconnected sessionId: src_id|7276bb9c-f1ea8556-a12b1c36-90ba91bb_0
2025-09-30T14:51:56.371631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 627 sessionId: src_id|7276bb9c-f1ea8556-a12b1c36-90ba91bb_0 is DEAD
2025-09-30T14:51:56.371630Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:56.371724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7276bb9c-f1ea8556-a12b1c36-90ba91bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:56.371736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7276bb9c-f1ea8556-a12b1c36-90ba91bb_0] Write session will restart in 0.006830s
2025-09-30T14:51:56.371759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7276bb9c-f1ea8556-a12b1c36-90ba91bb_0] Write session: Do CDS request
2025-09-30T14:51:56.371764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7276bb9c-f1ea8556-a12b1c36-90ba91bb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:56.379763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7276bb9c-f1ea8556-a12b1c36-90ba91bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:56.379895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:56.379924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 628
2025-09-30T14:51:56.380429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 628 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:56.380464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 628 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:56.380474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=628 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:56.380482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:56.380935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 628 sessionId:  describe result for acl check
2025-09-30T14:51:56.380973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:56.380979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:56.380981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:56.380988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895086923843923:6139] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:56.381542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895086923843923:6139] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:56.384273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895086923843923:6139] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:56.386723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:56.387007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895086923843923:6139] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:56.387024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895086923843923:6139] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:56.387028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895086923843923:6139] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:56.387035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 628 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:56.389035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:56.389214Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:56.389223Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:56.389231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:56.389276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:56.389314Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895086834116170:5114]
2025-09-30T14:51:56.389801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:56.390106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:56.390140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:56.390460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:56.390531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:56.390538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:56.390539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:56.390540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:56.390542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:56.390543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:56.390544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:56.390545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:56.390547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:56.390548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:56.390549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.390550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.390551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.390553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:56.390554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:56.390559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:56.390567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:56.390570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:56.390573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:56.390575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:56.390577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:56.390580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:56.390582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:56.390584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:56.390587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:56.390589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.390591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.390593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.390596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:56.390598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:56.390603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:56.390608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:56.390612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:56.390615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:56.390619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:56.390626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:56.390628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:56.390632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:56.390638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:56.390641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:56.390644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:56.390647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:56.390654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:56.390657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:56.390660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:56.390666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:56.390669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:56.390672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:56.390678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:56.390682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:56.390685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.390688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.390691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.390695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.390701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.390704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.390707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:56.390710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:56.390712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:56.390718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:56.390754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:56.395905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:56.397037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:56.397050Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:56.397051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:56.397054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:56.397060Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 627 [2:7555895086834116170:5114]
2025-09-30T14:51:56.397071Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:56.397086Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:56.397088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:56.397090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:56.397092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:56.397103Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:56.397112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:56.397118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:56.397174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.397182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.397183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.397187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:56.397188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:56.397242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:56.397250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.397262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.397279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.397293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:56.397311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895086834116164:5114]
2025-09-30T14:51:56.397313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895086834116164:5114]
2025-09-30T14:51:56.397315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895086834116164:5114]
2025-09-30T14:51:56.397321Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:56.397330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:56.397333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:56.397334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895086923843883:2454], now have 1 active actors on pipe
2025-09-30T14:51:56.397334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:56.397337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895086923844085:6139], now have 1 active actors on pipe
2025-09-30T14:51:56.397343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:56.397352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:56.397354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:56.397381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895086834116164:5114]
2025-09-30T14:51:56.397387Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:56.397395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:56.397400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 627
2025-09-30T14:51:56.397443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 627
2025-09-30T14:51:56.397461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:56.397471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:56.397489Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb0fd963-2719f930-e620b706-15804c6c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:56.397494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:56.397497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:56.397499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:56.397506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:56.397513Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:56.397525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:56.397685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:56.397703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:56.397738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:56.397834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 628 partition: 0 MaxSeqNo: 42 sessionId: src_id|bb0fd963-2719f930-e620b706-15804c6c_0
2025-09-30T14:51:56.398165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7276bb9c-f1ea8556-a12b1c36-90ba91bb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bb0fd963-2719f930-e620b706-15804c6c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:56.400893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb0fd963-2719f930-e620b706-15804c6c_0] Write session: try to update token
2025-09-30T14:51:56.400913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb0fd963-2719f930-e620b706-15804c6c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:56.409894Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:56.409922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:56.409925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:56.409927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:56.409939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895086834116164:5114]
2025-09-30T14:51:56.409945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895086834116164:5114]
2025-09-30T14:51:56.409951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895086834116164:5114]
2025-09-30T14:51:56.410003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:56.410013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:56.410020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.410020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:56.410023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:56.410024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:56.410212Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:56.416109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 628 sessionId: src_id|bb0fd963-2719f930-e620b706-15804c6c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:56.418869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:56.471483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895086923844100:5991]
2025-09-30T14:51:56.471757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 627, pipe: [1:7555895086923844100:5991]
2025-09-30T14:51:56.513833Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:56.514083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:56.514094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:56.514127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895086923844100:5991], now have 1 active actors on pipe
2025-09-30T14:51:56.514361Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:56.514368Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:56.514422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:56.514425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:56.514425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895086923844100:5991]
2025-09-30T14:51:56.514484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 628 reason: error at write: Disconnected sessionId: src_id|bb0fd963-2719f930-e620b706-15804c6c_0
2025-09-30T14:51:56.514656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 628 sessionId: src_id|bb0fd963-2719f930-e620b706-15804c6c_0 is DEAD
2025-09-30T14:51:56.514808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb0fd963-2719f930-e620b706-15804c6c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:56.514819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb0fd963-2719f930-e620b706-15804c6c_0] Write session will restart in 0.006726s
2025-09-30T14:51:56.514841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb0fd963-2719f930-e620b706-15804c6c_0] Write session: Do CDS request
2025-09-30T14:51:56.514849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb0fd963-2719f930-e620b706-15804c6c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:56.522779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb0fd963-2719f930-e620b706-15804c6c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:56.522875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:56.522892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 629
2025-09-30T14:51:56.523017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 629 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:56.523050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 629 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:56.523060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=629 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:56.523064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:56.523538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 629 sessionId:  describe result for acl check
2025-09-30T14:51:56.523576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:56.523583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:56.523585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:56.523591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895086923844134:6144] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:56.524156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895086923844134:6144] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:56.526718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895086923844134:6144] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:56.529633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895086923844134:6144] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:56.529651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895086923844134:6144] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:56.529654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895086923844134:6144] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:56.529664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 629 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:56.530767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:56.533468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:56.533740Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:56.533753Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:56.533762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:56.533821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:56.533871Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895086834116381:5117]
2025-09-30T14:51:56.534571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:56.534984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:56.535043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:56.535437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:56.535507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:56.535515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:56.535516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:56.535517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:56.535519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:56.535520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:56.535522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:56.535523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:56.535525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:56.535526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:56.535528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.535529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.535530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.535532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:56.535533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:56.535539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:56.535550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:56.535554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:56.535558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:56.535563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:56.535567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:56.535571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:56.535576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:56.535580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:56.535585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:56.535589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.535593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.535597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.535601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:56.535606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:56.535614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:56.535623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:56.535640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:56.535646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:56.535651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:56.535656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:56.535661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:56.535667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:56.535672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:56.535678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:56.535683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:56.535688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:56.535697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:56.535702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:56.535707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:56.535713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:56.535722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:56.535728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:56.535735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:56.535741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:56.535748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.535753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.535758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.535768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.535774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.535784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.535789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:56.535799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:56.535804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:56.535810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:56.535856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:56.541509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:56.542425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:56.542444Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:56.542447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:56.542451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:56.542458Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 628 [2:7555895086834116381:5117]
2025-09-30T14:51:56.542476Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:56.542494Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:56.542503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:56.542506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:56.542508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:56.542525Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:56.542537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:56.542545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:56.542612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.542621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.542623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.542627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:56.542629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:56.542704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:56.542716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.542729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.542741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.542756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:56.542781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895086923844102:2454], now have 1 active actors on pipe
2025-09-30T14:51:56.542789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895086923844303:6144], now have 1 active actors on pipe
2025-09-30T14:51:56.542796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895086834116376:5117]
2025-09-30T14:51:56.542799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895086834116376:5117]
2025-09-30T14:51:56.542801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895086834116376:5117]
2025-09-30T14:51:56.542817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:56.542833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:56.542839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:56.542843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:56.542845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:56.542854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:56.542857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:56.542892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895086834116376:5117]
2025-09-30T14:51:56.542901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:56.542903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:56.542871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 628
2025-09-30T14:51:56.542903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 628
2025-09-30T14:51:56.542938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:56.542949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:56.542978Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75936974-6013439b-ff866b46-616dcda2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:56.542990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:56.542994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:56.542996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:56.543006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:56.543021Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:56.543034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:56.543206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:56.543214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:56.543227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:56.543352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 629 partition: 0 MaxSeqNo: 42 sessionId: src_id|75936974-6013439b-ff866b46-616dcda2_0
2025-09-30T14:51:56.543721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb0fd963-2719f930-e620b706-15804c6c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|75936974-6013439b-ff866b46-616dcda2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:56.546561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75936974-6013439b-ff866b46-616dcda2_0] Write session: try to update token
2025-09-30T14:51:56.546580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75936974-6013439b-ff866b46-616dcda2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:56.555411Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:56.555434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:56.555436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:56.555438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:56.555453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895086834116376:5117]
2025-09-30T14:51:56.555457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895086834116376:5117]
2025-09-30T14:51:56.555461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895086834116376:5117]
2025-09-30T14:51:56.555508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:56.555516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.555519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:56.555526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:56.555538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:56.555542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:56.555668Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:56.561350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 629 sessionId: src_id|75936974-6013439b-ff866b46-616dcda2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:56.564158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:56.614870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895086923844322:5991]
2025-09-30T14:51:56.615225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 628, pipe: [1:7555895086923844322:5991]
2025-09-30T14:51:56.661223Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:56.661849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:56.661865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:56.661896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895086923844322:5991], now have 1 active actors on pipe
2025-09-30T14:51:56.662045Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:56.662092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:56.662109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:56.662125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895086923844322:5991]
2025-09-30T14:51:56.662146Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:56.662186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 629 reason: error at write: Disconnected sessionId: src_id|75936974-6013439b-ff866b46-616dcda2_0
2025-09-30T14:51:56.662335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 629 sessionId: src_id|75936974-6013439b-ff866b46-616dcda2_0 is DEAD
2025-09-30T14:51:56.662502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75936974-6013439b-ff866b46-616dcda2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:56.662514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75936974-6013439b-ff866b46-616dcda2_0] Write session will restart in 0.009506s
2025-09-30T14:51:56.662537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75936974-6013439b-ff866b46-616dcda2_0] Write session: Do CDS request
2025-09-30T14:51:56.662543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75936974-6013439b-ff866b46-616dcda2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:56.672795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75936974-6013439b-ff866b46-616dcda2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:56.672890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:56.672910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 630
2025-09-30T14:51:56.673036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 630 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:56.673068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 630 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:56.673078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=630 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:56.673081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:56.673555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 630 sessionId:  describe result for acl check
2025-09-30T14:51:56.673597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:56.673603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:56.673604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:56.673609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895086923844405:6148] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:56.674143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895086923844405:6148] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:56.676239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895086923844405:6148] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:56.677615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:56.680517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:56.680701Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:56.680709Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:56.680717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:56.680758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:56.680790Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895086834116590:5119]
2025-09-30T14:51:56.680962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895086923844405:6148] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:56.680980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895086923844405:6148] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:56.680984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895086923844405:6148] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:56.680992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 630 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:56.681338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:56.681618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:56.681657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:56.682002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:56.682074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:56.682080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:56.682081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:56.682082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:56.682083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:56.682084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:56.682085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:56.682086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:56.682088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:56.682089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:56.682091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.682092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.682093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.682094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:56.682095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:56.682100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:56.682110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:56.682114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:56.682118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:56.682122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:56.682127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:56.682131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:56.682134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:56.682138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:56.682144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:56.682149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.682152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.682156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.682160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:56.682164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:56.682171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:56.682180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:56.682184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:56.682191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:56.682195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:56.682202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:56.682204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:56.682208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:56.682211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:56.682214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:56.682216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:56.682219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:56.682221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:56.682224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:56.682226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:56.682229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:56.682235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:56.682238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:56.682241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:56.682244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:56.682246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.682253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.682256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.682259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.682262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.682264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.682278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:56.682285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:56.682287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:56.682290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:56.682316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:56.687541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:56.688531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:56.688546Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:56.688549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:56.688553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:56.688559Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 629 [2:7555895086834116590:5119]
2025-09-30T14:51:56.688574Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:56.688589Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:56.688592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:56.688595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:56.688598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:56.688613Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:56.688624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:56.688631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:56.688690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.688697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.688699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.688702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:56.688705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:56.688770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:56.688779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.688792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.688804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.688827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:56.688849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895086923844528:6148], now have 1 active actors on pipe
2025-09-30T14:51:56.688858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895086923844323:2454], now have 1 active actors on pipe
2025-09-30T14:51:56.688864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895086834116585:5119]
2025-09-30T14:51:56.688867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895086834116585:5119]
2025-09-30T14:51:56.688869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895086834116585:5119]
2025-09-30T14:51:56.688881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:56.688895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:56.688899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:56.688903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:56.688905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:56.688909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:56.688912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:56.688945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895086834116585:5119]
2025-09-30T14:51:56.688958Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:56.688945Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 629
2025-09-30T14:51:56.688978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:56.688953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 629
2025-09-30T14:51:56.689274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:56.689287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:56.689323Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ab2d4a-8539a3dd-1025e2c-60110af0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:56.689345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:56.689354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:56.689356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:56.689366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:56.689380Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:56.689398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:56.689559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:56.689567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:56.689580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:56.689717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 630 partition: 0 MaxSeqNo: 42 sessionId: src_id|1ab2d4a-8539a3dd-1025e2c-60110af0_0
2025-09-30T14:51:56.690099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75936974-6013439b-ff866b46-616dcda2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1ab2d4a-8539a3dd-1025e2c-60110af0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:56.693107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ab2d4a-8539a3dd-1025e2c-60110af0_0] Write session: try to update token
2025-09-30T14:51:56.693128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ab2d4a-8539a3dd-1025e2c-60110af0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:56.701009Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:56.701029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:56.701032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:56.701034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:56.701042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895086834116585:5119]
2025-09-30T14:51:56.701047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895086834116585:5119]
2025-09-30T14:51:56.701052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895086834116585:5119]
2025-09-30T14:51:56.701091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:56.701103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.701103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:56.701105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:56.701109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:56.701113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:56.701259Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:56.707857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 630 sessionId: src_id|1ab2d4a-8539a3dd-1025e2c-60110af0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:56.710416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:56.762310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895086923844540:5991]
2025-09-30T14:51:56.762588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 629, pipe: [1:7555895086923844540:5991]
2025-09-30T14:51:56.803752Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:56.803991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:56.804002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:56.804035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895086923844540:5991], now have 1 active actors on pipe
2025-09-30T14:51:56.804261Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:56.804280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:56.804281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:56.804285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:56.804337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895086923844540:5991]
2025-09-30T14:51:56.804348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 630 reason: error at write: Disconnected sessionId: src_id|1ab2d4a-8539a3dd-1025e2c-60110af0_0
2025-09-30T14:51:56.804522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 630 sessionId: src_id|1ab2d4a-8539a3dd-1025e2c-60110af0_0 is DEAD
2025-09-30T14:51:56.804686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ab2d4a-8539a3dd-1025e2c-60110af0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:56.804700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ab2d4a-8539a3dd-1025e2c-60110af0_0] Write session will restart in 0.007231s
2025-09-30T14:51:56.804724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ab2d4a-8539a3dd-1025e2c-60110af0_0] Write session: Do CDS request
2025-09-30T14:51:56.804733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ab2d4a-8539a3dd-1025e2c-60110af0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:56.812803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ab2d4a-8539a3dd-1025e2c-60110af0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:56.812907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:56.812926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 631
2025-09-30T14:51:56.813084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 631 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:56.813119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 631 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:56.813129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=631 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:56.813133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:56.813673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 631 sessionId:  describe result for acl check
2025-09-30T14:51:56.813713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:56.813720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:56.813722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:56.813727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895086923844585:6152] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:56.814245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895086923844585:6152] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:56.816953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895086923844585:6152] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:56.819227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895086923844585:6152] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:56.819258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895086923844585:6152] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:56.819262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895086923844585:6152] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:56.819269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 631 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:56.819488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:56.821568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:56.821758Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:56.821768Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:56.821779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:56.821831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:56.821869Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895086834116800:5121]
2025-09-30T14:51:56.822543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:56.822819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:56.822856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:56.823201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:56.823275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:56.823281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:56.823282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:56.823283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:56.823284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:56.823286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:56.823287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:56.823288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:56.823289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:56.823290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:56.823292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.823293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.823295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.823296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:56.823297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:56.823303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:56.823314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:56.823318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:56.823323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:56.823326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:56.823331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:56.823335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:56.823339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:56.823343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:56.823348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:56.823353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.823358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.823362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.823367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:56.823371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:56.823378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:56.823390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:56.823399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:56.823406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:56.823414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:56.823421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:56.823429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:56.823435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:56.823439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:56.823444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:56.823450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:56.823456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:56.823465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:56.823475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:56.823480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:56.823490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:56.823498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:56.823507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:56.823511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:56.823520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:56.823525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.823531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.823536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.823542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.823549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.823554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.823562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:56.823568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:56.823576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:56.823582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:56.823631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:56.828948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:56.829794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:56.829809Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:56.829812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:56.829816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:56.829823Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 630 [2:7555895086834116800:5121]
2025-09-30T14:51:56.829835Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:56.829852Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:56.829854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:56.829856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:56.829858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:56.829870Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:56.829879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:56.829884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:56.829927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.829932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.829934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.829936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:56.829939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:56.829991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:56.829996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.830005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.830012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.830021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:56.830041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895086834116794:5121]
2025-09-30T14:51:56.830050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895086834116794:5121]
2025-09-30T14:51:56.830052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895086834116794:5121]
2025-09-30T14:51:56.830064Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:56.830077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:56.830082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895086923844541:2454], now have 1 active actors on pipe
2025-09-30T14:51:56.830085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895086923844746:6152], now have 1 active actors on pipe
2025-09-30T14:51:56.830087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:56.830090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:56.830092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:56.830101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:56.830103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:56.830129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895086834116794:5121]
2025-09-30T14:51:56.830135Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:56.830137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:56.830117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 630
2025-09-30T14:51:56.830153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 630
2025-09-30T14:51:56.830186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:56.830197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:56.830219Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dedd6a96-375efadf-8b048ce5-c5c56482_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:56.830232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:56.830235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:56.830237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:56.830244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:56.830251Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:56.830261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:56.830432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:56.830447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:56.830466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:56.830556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 631 partition: 0 MaxSeqNo: 42 sessionId: src_id|dedd6a96-375efadf-8b048ce5-c5c56482_0
2025-09-30T14:51:56.830887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ab2d4a-8539a3dd-1025e2c-60110af0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dedd6a96-375efadf-8b048ce5-c5c56482_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:56.833656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dedd6a96-375efadf-8b048ce5-c5c56482_0] Write session: try to update token
2025-09-30T14:51:56.833674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dedd6a96-375efadf-8b048ce5-c5c56482_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:56.842270Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:56.842287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:56.842297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895086834116794:5121]
2025-09-30T14:51:56.842341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:56.842354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:56.843188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:56.843362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:56.843876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:56.844021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:56.844210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:56.844253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:56.847490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 631 sessionId: src_id|dedd6a96-375efadf-8b048ce5-c5c56482_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:56.849958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:56.850158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:56.850180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:56.850212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:56.850301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:56.852755Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:56.852771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:56.852775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:56.852777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:56.852786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895086834116794:5121]
2025-09-30T14:51:56.852790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895086834116794:5121]
2025-09-30T14:51:56.852795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895086834116794:5121]
2025-09-30T14:51:56.852832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:56.852846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.852845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:56.852849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:56.852852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:56.852856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:56.852979Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:56.904611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895086923844759:5991]
2025-09-30T14:51:56.904839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 630, pipe: [1:7555895086923844759:5991]
2025-09-30T14:51:56.960327Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:56.967330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:56.967354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:56.967516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:56.967573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:56.967636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:56.967708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:56.967764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:56.967772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:56.967836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:56.967892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:56.967951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:56.968011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:56.968052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:56.968058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:56.968118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:56.968175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:56.968235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:56.968293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:56.968335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:56.968341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:56.968401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:56.968458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:56.968516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:56.968573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:56.968614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:56.968619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:56.968681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:56.968736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:56.968799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:56.968863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:56.968904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:56.968906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:56.968966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:56.969023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:56.969080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:56.969143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:56.969184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:56.969190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:56.969249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:56.969304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:56.969363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:56.969423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:56.969465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:56.969470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:56.969528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:56.969581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:56.969638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:56.969696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:56.969736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:56.969743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:56.969812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:56.969876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:56.969938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:56.969998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:56.970044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:56.970051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:56.970113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:56.970164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:56.970221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:56.970286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:56.970327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:56.970336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:56.970375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895086923844759:5991], now have 1 active actors on pipe
2025-09-30T14:51:56.970607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895086923844759:5991]
2025-09-30T14:51:56.970644Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:56.970666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:56.970677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:56.970703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 631 reason: error at write: Disconnected sessionId: src_id|dedd6a96-375efadf-8b048ce5-c5c56482_0
2025-09-30T14:51:56.970881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 631 sessionId: src_id|dedd6a96-375efadf-8b048ce5-c5c56482_0 is DEAD
2025-09-30T14:51:56.971016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dedd6a96-375efadf-8b048ce5-c5c56482_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:56.971027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dedd6a96-375efadf-8b048ce5-c5c56482_0] Write session will restart in 0.009448s
2025-09-30T14:51:56.971050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dedd6a96-375efadf-8b048ce5-c5c56482_0] Write session: Do CDS request
2025-09-30T14:51:56.971056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dedd6a96-375efadf-8b048ce5-c5c56482_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:56.971344Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:56.981751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dedd6a96-375efadf-8b048ce5-c5c56482_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:56.981858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:56.981874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 632
2025-09-30T14:51:56.981989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 632 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:56.982013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 632 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:56.982016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=632 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:56.982019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:56.982507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 632 sessionId:  describe result for acl check
2025-09-30T14:51:56.982547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:56.982549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:56.982550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:56.982555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895086923844916:6158] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:56.983076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895086923844916:6158] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:56.984700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:56.984824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895086923844916:6158] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:56.987192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:56.987402Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:56.987414Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:56.987424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:56.987435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895086923844916:6158] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:56.987449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895086923844916:6158] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:56.987452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895086923844916:6158] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:56.987460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 632 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:56.987481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:56.987522Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895086834117022:5124]
2025-09-30T14:51:56.988186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:56.988468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:56.988533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:56.988885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:56.988975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:56.988985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:56.988987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:56.988988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:56.988989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:56.988990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:56.988992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:56.988993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:56.988994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:56.988996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:56.988997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.988998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.988999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.989000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:56.989002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:56.989007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:56.989017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:56.989021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:56.989025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:56.989028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:56.989033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:56.989037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:56.989041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:56.989051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:56.989074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:56.989082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.989087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.989095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.989100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:56.989103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:56.989118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:56.989131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:56.989142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:56.989148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:56.989158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:56.989169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:56.989180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:56.989189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:56.989198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:56.989208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:56.989218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:56.989228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:56.989237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:56.989246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:56.989254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:56.989263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:56.989272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:56.989282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:56.989291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:56.989296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:56.989305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.989316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.989324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.989328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.989337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.989347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.989356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:56.989367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:56.989378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:56.989384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:56.989428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:56.994858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:56.996203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:56.996225Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:56.996228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:56.996232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:56.996239Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 631 [2:7555895086834117022:5124]
2025-09-30T14:51:56.996254Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:56.996270Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:56.996277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:56.996280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:56.996282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:56.996299Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:56.996313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:56.996321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:56.996379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.996387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.996389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.996392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:56.996395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:56.996462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:56.996471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:56.996484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:56.996501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:56.996522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:56.996545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895086923844775:2454], now have 1 active actors on pipe
2025-09-30T14:51:56.996554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895086923844988:6158], now have 1 active actors on pipe
2025-09-30T14:51:56.996561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895086834117017:5124]
2025-09-30T14:51:56.996564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895086834117017:5124]
2025-09-30T14:51:56.996566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895086834117017:5124]
2025-09-30T14:51:56.996579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:56.996598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:56.996600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:56.996610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:56.996614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:56.996616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:56.996619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:56.996650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895086834117017:5124]
2025-09-30T14:51:56.996660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:56.996639Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 631
2025-09-30T14:51:56.996673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:56.996648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 631
2025-09-30T14:51:56.996699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:56.996710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:56.996746Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28c57eb-c45568a5-b2fe916c-b1935c52_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:56.996757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:56.996761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:56.996763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:56.996774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:56.996789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:56.996808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:56.996966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:56.996980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:56.996998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:56.997075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 632 partition: 0 MaxSeqNo: 42 sessionId: src_id|28c57eb-c45568a5-b2fe916c-b1935c52_0
2025-09-30T14:51:56.997388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dedd6a96-375efadf-8b048ce5-c5c56482_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|28c57eb-c45568a5-b2fe916c-b1935c52_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:57.000223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28c57eb-c45568a5-b2fe916c-b1935c52_0] Write session: try to update token
2025-09-30T14:51:57.000243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28c57eb-c45568a5-b2fe916c-b1935c52_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:57.008988Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:57.009011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:57.009014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:57.009016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:57.009026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895086834117017:5124]
2025-09-30T14:51:57.009030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895086834117017:5124]
2025-09-30T14:51:57.009034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895086834117017:5124]
2025-09-30T14:51:57.009078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:57.009085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.009088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:57.009090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:57.009096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:57.009100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:57.009237Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:57.014133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 632 sessionId: src_id|28c57eb-c45568a5-b2fe916c-b1935c52_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:57.016730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:57.071011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895091218812299:5991]
2025-09-30T14:51:57.071285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 631, pipe: [1:7555895091218812299:5991]
2025-09-30T14:51:57.125459Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:57.125751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:57.125767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:57.125805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895091218812299:5991], now have 1 active actors on pipe
2025-09-30T14:51:57.126014Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:57.126033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895091218812299:5991]
2025-09-30T14:51:57.126054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:57.126057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:57.126032Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:57.126119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 632 reason: error at write: Disconnected sessionId: src_id|28c57eb-c45568a5-b2fe916c-b1935c52_0
2025-09-30T14:51:57.126277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 632 sessionId: src_id|28c57eb-c45568a5-b2fe916c-b1935c52_0 is DEAD
2025-09-30T14:51:57.126425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28c57eb-c45568a5-b2fe916c-b1935c52_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:57.126450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28c57eb-c45568a5-b2fe916c-b1935c52_0] Write session will restart in 0.006170s
2025-09-30T14:51:57.126473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28c57eb-c45568a5-b2fe916c-b1935c52_0] Write session: Do CDS request
2025-09-30T14:51:57.126483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28c57eb-c45568a5-b2fe916c-b1935c52_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:57.133806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28c57eb-c45568a5-b2fe916c-b1935c52_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:57.133869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:57.133895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 633
2025-09-30T14:51:57.134040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 633 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:57.134082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 633 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:57.134091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=633 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:57.134095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:57.134502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 633 sessionId:  describe result for acl check
2025-09-30T14:51:57.134535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:57.134542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:57.134544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:57.134549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895091218812332:6163] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:57.135078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895091218812332:6163] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:57.137987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895091218812332:6163] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:57.140908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895091218812332:6163] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:57.140934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895091218812332:6163] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:57.140937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895091218812332:6163] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:57.140945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 633 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:57.141077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:57.143525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:57.143715Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:57.143723Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:57.143731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:57.143767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:57.143795Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895091129084533:5127]
2025-09-30T14:51:57.144257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:57.144512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:57.144541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:57.144750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:57.144807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:57.144813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:57.144814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:57.144815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:57.144816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:57.144816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:57.144817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:57.144818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:57.144818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:57.144819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:57.144820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.144820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.144821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.144822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:57.144823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:57.144826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:57.144832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:57.144834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:57.144837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:57.144839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:57.144842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:57.144844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:57.144847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:57.144849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:57.144852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:57.144854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.144856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.144859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.144861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:57.144863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:57.144868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:57.144874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:57.144877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:57.144881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:57.144884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:57.144888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:57.144890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:57.144893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:57.144896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:57.144899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:57.144902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:57.144905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:57.144908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:57.144912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:57.144914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:57.144917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:57.144920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:57.144923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:57.144927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:57.144930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:57.144932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.144935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.144938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.144941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.144943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.144946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.144949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:57.144952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:57.144956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:57.144959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:57.144984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:57.150515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:57.151477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:57.151492Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:57.151495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:57.151498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:57.151505Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 632 [2:7555895091129084533:5127]
2025-09-30T14:51:57.151522Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:57.151537Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:57.151540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:57.151543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:57.151545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:57.151559Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:57.151565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:57.151572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:57.151629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.151638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.151640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.151643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:57.151646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:57.151707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:57.151716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.151727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.151740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.151762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:57.151782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895091129084527:5127]
2025-09-30T14:51:57.151789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895091129084527:5127]
2025-09-30T14:51:57.151792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895091129084527:5127]
2025-09-30T14:51:57.151805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:57.151822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895091218812301:2454], now have 1 active actors on pipe
2025-09-30T14:51:57.151831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895091218812508:6163], now have 1 active actors on pipe
2025-09-30T14:51:57.151838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:57.151849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:57.151851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:57.151853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:57.151863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:57.151865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:57.151894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895091129084527:5127]
2025-09-30T14:51:57.151906Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:57.151914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:57.151903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 632
2025-09-30T14:51:57.151915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 632
2025-09-30T14:51:57.151979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:57.151989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:57.152011Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a4642ae-8e16db5d-d9f97885-c1121f9a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:57.152023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:57.152026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:57.152028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:57.152037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:57.152051Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:57.152067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:57.152252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:57.152266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:57.152286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:57.152386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 633 partition: 0 MaxSeqNo: 42 sessionId: src_id|2a4642ae-8e16db5d-d9f97885-c1121f9a_0
2025-09-30T14:51:57.152704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28c57eb-c45568a5-b2fe916c-b1935c52_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2a4642ae-8e16db5d-d9f97885-c1121f9a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:57.155512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a4642ae-8e16db5d-d9f97885-c1121f9a_0] Write session: try to update token
2025-09-30T14:51:57.155536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a4642ae-8e16db5d-d9f97885-c1121f9a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:57.163221Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:57.163242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:57.163265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895091129084527:5127]
2025-09-30T14:51:57.163309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:57.163312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:57.163483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:57.163627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:57.164104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:57.164576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:57.165237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:57.165286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:57.169595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 633 sessionId: src_id|2a4642ae-8e16db5d-d9f97885-c1121f9a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:57.172226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:57.172772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:57.172793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:57.173874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:57.173899Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:57.173901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:57.173903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:57.173904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:57.173911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895091129084527:5127]
2025-09-30T14:51:57.173914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895091129084527:5127]
2025-09-30T14:51:57.173916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895091129084527:5127]
2025-09-30T14:51:57.173942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:57.173942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:57.173947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.173947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:57.173950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:57.173951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:57.173982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:57.174065Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:57.226179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895091218812520:5991]
2025-09-30T14:51:57.226504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 632, pipe: [1:7555895091218812520:5991]
2025-09-30T14:51:57.276812Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:57.284459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:57.284486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:57.284636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:57.284702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:57.284772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:57.284844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:57.284895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:57.284905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:57.284978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:57.285038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:57.285104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:57.285179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:57.285224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:57.285231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:57.285298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:57.285358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:57.285415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:57.285475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:57.285525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:57.285533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:57.285595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:57.285652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:57.285718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:57.285787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:57.285834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:57.285841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:57.285904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:57.285959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:57.286015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:57.286076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:57.286123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:57.286131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:57.286202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:57.286266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:57.286330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:57.286416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:57.286466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:57.286473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:57.286546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:57.286611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:57.286679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:57.286740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:57.286785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:57.286792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:57.286857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:57.286915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:57.286979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:57.287043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:57.287088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:57.287096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:57.287163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:57.287225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:57.287307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:57.287373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:57.287421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:57.287428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:57.287497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:57.287560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:57.287624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:57.287688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:57.287733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:57.287740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:57.287828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895091218812520:5991], now have 1 active actors on pipe
2025-09-30T14:51:57.288280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:57.288297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:57.288322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 633 reason: error at write: Disconnected sessionId: src_id|2a4642ae-8e16db5d-d9f97885-c1121f9a_0
2025-09-30T14:51:57.288489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 633 sessionId: src_id|2a4642ae-8e16db5d-d9f97885-c1121f9a_0 is DEAD
2025-09-30T14:51:57.288657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a4642ae-8e16db5d-d9f97885-c1121f9a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:57.288669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a4642ae-8e16db5d-d9f97885-c1121f9a_0] Write session will restart in 0.008198s
2025-09-30T14:51:57.288663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:57.288694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a4642ae-8e16db5d-d9f97885-c1121f9a_0] Write session: Do CDS request
2025-09-30T14:51:57.288700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a4642ae-8e16db5d-d9f97885-c1121f9a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:57.288708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895091218812520:5991]
2025-09-30T14:51:57.289046Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:57.297793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a4642ae-8e16db5d-d9f97885-c1121f9a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:57.297863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:57.297883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 634
2025-09-30T14:51:57.298009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 634 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:57.298042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 634 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:57.298046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=634 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:57.298051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:57.298537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 634 sessionId:  describe result for acl check
2025-09-30T14:51:57.298575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:57.298582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:57.298584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:57.298590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895091218812594:6173] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:57.299100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895091218812594:6173] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:57.301873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895091218812594:6173] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:57.304714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895091218812594:6173] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:57.304734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895091218812594:6173] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:57.304737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895091218812594:6173] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:57.304744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 634 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:57.304722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:57.307283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:57.307478Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:57.307489Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:57.307500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:57.307552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:57.307600Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895091129084775:5135]
2025-09-30T14:51:57.308146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:57.308400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:57.308440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:57.308732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:57.308788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:57.308795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:57.308796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:57.308797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:57.308798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:57.308799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:57.308800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:57.308802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:57.308803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:57.308804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:57.308805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.308806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.308808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.308808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:57.308810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:57.308814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:57.308824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:57.308829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:57.308833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:57.308837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:57.308842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:57.308846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:57.308850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:57.308854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:57.308858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:57.308862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.308866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.308871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.308875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:57.308879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:57.308886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:57.308894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:57.308900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:57.308906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:57.308912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:57.308918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:57.308923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:57.308928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:57.308933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:57.308938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:57.308943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:57.308948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:57.308953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:57.308959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:57.308963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:57.308968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:57.308973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:57.308978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:57.308989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:57.308994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:57.309001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.309005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.309007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.309010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.309013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.309016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.309019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:57.309022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:57.309025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:57.309029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:57.309072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:57.314480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:57.315369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:57.315387Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:57.315390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:57.315394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:57.315400Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 633 [2:7555895091129084775:5135]
2025-09-30T14:51:57.315417Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:57.315434Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:57.315441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:57.315445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:57.315447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:57.315462Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:57.315469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:57.315476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:57.315530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.315537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.315539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.315543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:57.315545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:57.315601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:57.315609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.315622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.315638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.315661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:57.315682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895091218812741:6173], now have 1 active actors on pipe
2025-09-30T14:51:57.315690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895091218812535:2454], now have 1 active actors on pipe
2025-09-30T14:51:57.315697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895091129084769:5135]
2025-09-30T14:51:57.315699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895091129084769:5135]
2025-09-30T14:51:57.315701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895091129084769:5135]
2025-09-30T14:51:57.315717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:57.315704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 633
2025-09-30T14:51:57.315730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:57.315746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 633
2025-09-30T14:51:57.315734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:57.315740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:57.315741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:57.315749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:57.315751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:57.315794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:57.315803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:57.315814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895091129084769:5135]
2025-09-30T14:51:57.315826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:57.315829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:57.315858Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6a3e56d-65927e96-46858093-e2be37c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:57.315868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:57.315872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:57.315874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:57.315883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:57.315896Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:57.315922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:57.316061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:57.316074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:57.316094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:57.316162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 634 partition: 0 MaxSeqNo: 42 sessionId: src_id|b6a3e56d-65927e96-46858093-e2be37c7_0
2025-09-30T14:51:57.316509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a4642ae-8e16db5d-d9f97885-c1121f9a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b6a3e56d-65927e96-46858093-e2be37c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:57.319311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6a3e56d-65927e96-46858093-e2be37c7_0] Write session: try to update token
2025-09-30T14:51:57.319331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6a3e56d-65927e96-46858093-e2be37c7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:57.327356Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:57.327373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:57.327374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:57.327376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:57.327385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895091129084769:5135]
2025-09-30T14:51:57.327388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895091129084769:5135]
2025-09-30T14:51:57.327390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895091129084769:5135]
2025-09-30T14:51:57.327421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:57.327426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.327428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:57.327429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:57.327435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:57.327438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:57.327560Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:57.333885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 634 sessionId: src_id|b6a3e56d-65927e96-46858093-e2be37c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:57.336648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:57.388998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895091218812763:5991]
2025-09-30T14:51:57.389290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 633, pipe: [1:7555895091218812763:5991]
2025-09-30T14:51:57.430293Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:57.430984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:57.431006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:57.431026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895091218812763:5991], now have 1 active actors on pipe
2025-09-30T14:51:57.431226Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:57.431262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895091218812763:5991]
2025-09-30T14:51:57.431268Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:57.431300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:57.431376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 634 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b6a3e56d-65927e96-46858093-e2be37c7_0
2025-09-30T14:51:57.431526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 634 sessionId: src_id|b6a3e56d-65927e96-46858093-e2be37c7_0 is DEAD
2025-09-30T14:51:57.431662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6a3e56d-65927e96-46858093-e2be37c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:57.431673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6a3e56d-65927e96-46858093-e2be37c7_0] Write session will restart in 0.005028s
2025-09-30T14:51:57.431691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6a3e56d-65927e96-46858093-e2be37c7_0] Write session: Do CDS request
2025-09-30T14:51:57.431695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6a3e56d-65927e96-46858093-e2be37c7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:57.437735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6a3e56d-65927e96-46858093-e2be37c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:57.437818Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:57.437834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 635
2025-09-30T14:51:57.437967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 635 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:57.437996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 635 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:57.438006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=635 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:57.438009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:57.438501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 635 sessionId:  describe result for acl check
2025-09-30T14:51:57.438541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:57.438551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:57.438553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:57.438559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895091218812784:6178] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:57.439102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895091218812784:6178] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:57.442158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895091218812784:6178] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:57.445331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895091218812784:6178] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:57.445358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895091218812784:6178] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:57.445362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895091218812784:6178] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:57.445371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 635 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:57.446474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:57.448899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:57.449115Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:57.449128Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:57.449140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:57.449199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:57.449240Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895091129084996:5143]
2025-09-30T14:51:57.449888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:57.450199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:57.450272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:57.450643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:57.450737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:57.450747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:57.450748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:57.450749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:57.450751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:57.450752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:57.450753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:57.450755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:57.450756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:57.450757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:57.450758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.450759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.450761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.450762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:57.450763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:57.450769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:57.450780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:57.450784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:57.450789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:57.450793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:57.450797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:57.450801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:57.450805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:57.450809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:57.450813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:57.450817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.450821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.450826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.450829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:57.450834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:57.450842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:57.450851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:57.450858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:57.450863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:57.450868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:57.450873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:57.450878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:57.450883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:57.450887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:57.450892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:57.450896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:57.450901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:57.450906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:57.450912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:57.450930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:57.450935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:57.450942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:57.450953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:57.450957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:57.450962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:57.450974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.450979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.450988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.450993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.450997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.451019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.451029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:57.451034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:57.451043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:57.451048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:57.451094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:57.456769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:57.457633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:57.457649Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:57.457653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:57.457657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:57.457665Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 634 [2:7555895091129084996:5143]
2025-09-30T14:51:57.457682Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:57.457700Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:57.457708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:57.457711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:57.457713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:57.457731Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:57.457740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:57.457745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:57.457798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.457807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.457809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.457813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:57.457815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:57.457874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:57.457880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.457889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.457895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.457907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:57.457922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895091129084991:5143]
2025-09-30T14:51:57.457927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895091129084991:5143]
2025-09-30T14:51:57.457930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895091129084991:5143]
2025-09-30T14:51:57.457937Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:57.457950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:57.457951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:57.457956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:57.457959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:57.457964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:57.457967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:57.457978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895091218812765:2454], now have 1 active actors on pipe
2025-09-30T14:51:57.457982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895091218812972:6178], now have 1 active actors on pipe
2025-09-30T14:51:57.458013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895091129084991:5143]
2025-09-30T14:51:57.458025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:57.458057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:57.458066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 634
2025-09-30T14:51:57.458076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 634
2025-09-30T14:51:57.458125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:57.458134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:57.458159Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|547d3259-eb35b2c6-20168483-a7c58d84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:57.458171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:57.458176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:57.458178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:57.458186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:57.458193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:57.458204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:57.458361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:57.458368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:57.458381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:57.458492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 635 partition: 0 MaxSeqNo: 42 sessionId: src_id|547d3259-eb35b2c6-20168483-a7c58d84_0
2025-09-30T14:51:57.458857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6a3e56d-65927e96-46858093-e2be37c7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|547d3259-eb35b2c6-20168483-a7c58d84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:57.461597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|547d3259-eb35b2c6-20168483-a7c58d84_0] Write session: try to update token
2025-09-30T14:51:57.461615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|547d3259-eb35b2c6-20168483-a7c58d84_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:57.470496Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:57.470512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:57.470516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:57.470518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:57.470527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895091129084991:5143]
2025-09-30T14:51:57.470531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895091129084991:5143]
2025-09-30T14:51:57.470534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895091129084991:5143]
2025-09-30T14:51:57.470581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:57.470582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:57.470589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:57.470590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.470593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:57.470594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:57.470828Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:57.475777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 635 sessionId: src_id|547d3259-eb35b2c6-20168483-a7c58d84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:57.478351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:57.531325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895091218812988:5991]
2025-09-30T14:51:57.531604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 634, pipe: [1:7555895091218812988:5991]
2025-09-30T14:51:57.577220Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:57.577907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:57.577928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:57.577965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895091218812988:5991], now have 1 active actors on pipe
2025-09-30T14:51:57.578151Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:57.578191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895091218812988:5991]
2025-09-30T14:51:57.578197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:57.578228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:57.578295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 635 reason: status is not ok: tablet will be restarted right now sessionId: src_id|547d3259-eb35b2c6-20168483-a7c58d84_0
2025-09-30T14:51:57.578462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 635 sessionId: src_id|547d3259-eb35b2c6-20168483-a7c58d84_0 is DEAD
2025-09-30T14:51:57.578614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|547d3259-eb35b2c6-20168483-a7c58d84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:57.578624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|547d3259-eb35b2c6-20168483-a7c58d84_0] Write session will restart in 0.008368s
2025-09-30T14:51:57.578646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|547d3259-eb35b2c6-20168483-a7c58d84_0] Write session: Do CDS request
2025-09-30T14:51:57.578652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|547d3259-eb35b2c6-20168483-a7c58d84_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:57.587748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|547d3259-eb35b2c6-20168483-a7c58d84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:57.587857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:57.587875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 636
2025-09-30T14:51:57.587992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 636 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:57.588022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 636 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:57.588031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=636 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:57.588035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:57.588529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 636 sessionId:  describe result for acl check
2025-09-30T14:51:57.588568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:57.588575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:57.588577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:57.588585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895091218813056:6183] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:57.589115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895091218813056:6183] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:57.591347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895091218813056:6183] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:57.593988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895091218813056:6183] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:57.594003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895091218813056:6183] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:57.594007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895091218813056:6183] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:57.594015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 636 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:57.594112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:57.596367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:57.596574Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:57.596586Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:57.596598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:57.596659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:57.596702Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895091129085213:5146]
2025-09-30T14:51:57.597350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:57.597708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:57.597767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:57.598110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:57.598205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:57.598212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:57.598214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:57.598215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:57.598216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:57.598218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:57.598219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:57.598220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:57.598222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:57.598223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:57.598224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.598226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.598227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.598228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:57.598229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:57.598236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:57.598247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:57.598252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:57.598255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:57.598259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:57.598264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:57.598268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:57.598272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:57.598276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:57.598280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:57.598284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.598287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.598292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.598296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:57.598300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:57.598309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:57.598319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:57.598328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:57.598340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:57.598346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:57.598356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:57.598362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:57.598368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:57.598374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:57.598388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:57.598393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:57.598416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:57.598421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:57.598431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:57.598435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:57.598440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:57.598449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:57.598456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:57.598465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:57.598470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:57.598476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.598486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.598491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.598501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.598507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.598512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.598517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:57.598522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:57.598527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:57.598532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:57.598578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:57.604152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:57.604994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:57.605009Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:57.605012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:57.605016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:57.605023Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 635 [2:7555895091129085213:5146]
2025-09-30T14:51:57.605040Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:57.605057Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:57.605066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:57.605070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:57.605073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:57.605088Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:57.605095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:57.605107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:57.605168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.605175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.605176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.605179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:57.605181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:57.605240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:57.605247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.605259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.605270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.605290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:57.605311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895091218812990:2454], now have 1 active actors on pipe
2025-09-30T14:51:57.605319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895091218813200:6183], now have 1 active actors on pipe
2025-09-30T14:51:57.605324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895091129085207:5146]
2025-09-30T14:51:57.605327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895091129085207:5146]
2025-09-30T14:51:57.605329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895091129085207:5146]
2025-09-30T14:51:57.605343Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:57.605358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:57.605361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:57.605368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:57.605373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:57.605377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:57.605379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:57.605413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895091129085207:5146]
2025-09-30T14:51:57.605427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:57.605412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 635
2025-09-30T14:51:57.605418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 635
2025-09-30T14:51:57.605455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:57.605679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:57.605691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:57.605720Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b9f7cc73-c503d862-e40f84e6-3cc7f4e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:57.605733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:57.605736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:57.605739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:57.605748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:57.605762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:57.605777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:57.605933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:57.605941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:57.605954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:57.606066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 636 partition: 0 MaxSeqNo: 42 sessionId: src_id|b9f7cc73-c503d862-e40f84e6-3cc7f4e5_0
2025-09-30T14:51:57.606449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|547d3259-eb35b2c6-20168483-a7c58d84_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b9f7cc73-c503d862-e40f84e6-3cc7f4e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:57.609147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9f7cc73-c503d862-e40f84e6-3cc7f4e5_0] Write session: try to update token
2025-09-30T14:51:57.609168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9f7cc73-c503d862-e40f84e6-3cc7f4e5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:57.623157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 636 sessionId: src_id|b9f7cc73-c503d862-e40f84e6-3cc7f4e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:57.623345Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:57.623366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:57.623377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895091129085207:5146]
2025-09-30T14:51:57.623428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:57.623448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:57.623612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:57.623767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:57.623917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:57.624071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:57.624284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:57.624332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:57.625918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:57.626126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:57.626142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:57.626175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:57.626253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:57.627881Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:57.627896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:57.627898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:57.627900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:57.627908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895091129085207:5146]
2025-09-30T14:51:57.627911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895091129085207:5146]
2025-09-30T14:51:57.627915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895091129085207:5146]
2025-09-30T14:51:57.627955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:57.627957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:57.627962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:57.627966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.627969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:57.627969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:57.628111Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:57.678303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895091218813212:5991]
2025-09-30T14:51:57.678645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 635, pipe: [1:7555895091218813212:5991]
2025-09-30T14:51:57.733364Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:57.740541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:57.740568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:57.740727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:57.740786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:57.740845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:57.740908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:57.740960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:57.740969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:57.741036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:57.741096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:57.741158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:57.741221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:57.741272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:57.741276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:57.741339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:57.741406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:57.741473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:57.741536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:57.741579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:57.741589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:57.741656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:57.741722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:57.741784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:57.741846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:57.741891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:57.741898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:57.741963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:57.742020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:57.742078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:57.742145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:57.742187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:57.742194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:57.742256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:57.742327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:57.742416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:57.742489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:57.742544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:57.742552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:57.742627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:57.742693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:57.742754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:57.742822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:57.742866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:57.742872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:57.742937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:57.743005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:57.743070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:57.743133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:57.743176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:57.743181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:57.743255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:57.743310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:57.743369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:57.743425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:57.743465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:57.743471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:57.743540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:57.743599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:57.743653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:57.743713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:57.743755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:57.743761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:57.743813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895091218813212:5991], now have 1 active actors on pipe
2025-09-30T14:51:57.744090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:57.744102Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:57.744106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:57.744135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 636 reason: error at write: Disconnected sessionId: src_id|b9f7cc73-c503d862-e40f84e6-3cc7f4e5_0
2025-09-30T14:51:57.744147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895091218813212:5991]
2025-09-30T14:51:57.744302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 636 sessionId: src_id|b9f7cc73-c503d862-e40f84e6-3cc7f4e5_0 is DEAD
2025-09-30T14:51:57.744444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9f7cc73-c503d862-e40f84e6-3cc7f4e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:57.744455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9f7cc73-c503d862-e40f84e6-3cc7f4e5_0] Write session will restart in 0.009111s
2025-09-30T14:51:57.744478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9f7cc73-c503d862-e40f84e6-3cc7f4e5_0] Write session: Do CDS request
2025-09-30T14:51:57.744484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9f7cc73-c503d862-e40f84e6-3cc7f4e5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:57.744630Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:57.754685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9f7cc73-c503d862-e40f84e6-3cc7f4e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:57.754809Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:57.754831Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 637
2025-09-30T14:51:57.754953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 637 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:57.754989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 637 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:57.754998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=637 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:57.755002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:57.755473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 637 sessionId:  describe result for acl check
2025-09-30T14:51:57.755524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:57.755533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:57.755536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:57.755541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895091218813274:6187] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:57.756119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895091218813274:6187] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:57.759129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895091218813274:6187] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:57.760985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:57.763683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:57.763925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895091218813274:6187] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:57.763945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895091218813274:6187] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:57.763948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895091218813274:6187] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:57.763958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 637 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:57.764001Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:57.764013Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:57.764024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:57.764086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:57.764125Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895091129085428:5148]
2025-09-30T14:51:57.764685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:57.764979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:57.765024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:57.765312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:57.765358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:57.765363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:57.765365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:57.765366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:57.765367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:57.765368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:57.765369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:57.765370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:57.765372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:57.765372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:57.765374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.765375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.765375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.765377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:57.765377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:57.765383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:57.765395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:57.765399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:57.765403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:57.765405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:57.765408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:57.765410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:57.765412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:57.765414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:57.765417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:57.765419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.765421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.765423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.765426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:57.765428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:57.765435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:57.765440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:57.765444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:57.765447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:57.765450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:57.765453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:57.765456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:57.765459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:57.765462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:57.765468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:57.765472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:57.765477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:57.765482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:57.765487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:57.765492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:57.765497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:57.765501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:57.765504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:57.765506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:57.765509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:57.765512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.765515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.765517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.765520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.765522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.765525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.765528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:57.765531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:57.765534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:57.765536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:57.765562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:57.771025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:57.771894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:57.771911Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:57.771914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:57.771918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:57.771924Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 636 [2:7555895091129085428:5148]
2025-09-30T14:51:57.771940Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:57.771956Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:57.771959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:57.771962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:57.771964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:57.771980Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:57.771988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:57.771995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:57.772051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.772059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.772061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.772064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:57.772067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:57.772127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:57.772136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.772148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.772164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.772186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:57.772207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895091218813214:2454], now have 1 active actors on pipe
2025-09-30T14:51:57.772215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895091218813426:6187], now have 1 active actors on pipe
2025-09-30T14:51:57.772222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895091129085423:5148]
2025-09-30T14:51:57.772224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895091129085423:5148]
2025-09-30T14:51:57.772226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895091129085423:5148]
2025-09-30T14:51:57.772237Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:57.772249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:57.772254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:57.772257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:57.772269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:57.772269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:57.772272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:57.772304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895091129085423:5148]
2025-09-30T14:51:57.772312Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:57.772314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:57.772283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 636
2025-09-30T14:51:57.772301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 636
2025-09-30T14:51:57.772334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:57.772342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:57.772387Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a73f2cd8-69b132f-7ccf8047-f7c8a81d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:57.772399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:57.772402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:57.772405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:57.772414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:57.772422Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:57.772444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:57.772573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:57.772581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:57.772593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:57.772658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 637 partition: 0 MaxSeqNo: 42 sessionId: src_id|a73f2cd8-69b132f-7ccf8047-f7c8a81d_0
2025-09-30T14:51:57.773004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9f7cc73-c503d862-e40f84e6-3cc7f4e5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a73f2cd8-69b132f-7ccf8047-f7c8a81d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:57.775665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a73f2cd8-69b132f-7ccf8047-f7c8a81d_0] Write session: try to update token
2025-09-30T14:51:57.775685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a73f2cd8-69b132f-7ccf8047-f7c8a81d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:57.784133Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:57.784151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:57.784154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:57.784156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:57.784165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895091129085423:5148]
2025-09-30T14:51:57.784171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895091129085423:5148]
2025-09-30T14:51:57.784175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895091129085423:5148]
2025-09-30T14:51:57.784210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:57.784216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.784219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:57.784232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:57.784238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:57.784242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:57.784356Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:57.790706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 637 sessionId: src_id|a73f2cd8-69b132f-7ccf8047-f7c8a81d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:57.793393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:57.844181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895091218813437:5991]
2025-09-30T14:51:57.844456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 636, pipe: [1:7555895091218813437:5991]
2025-09-30T14:51:57.897071Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:57.897685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:57.897699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:57.897733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895091218813437:5991], now have 1 active actors on pipe
2025-09-30T14:51:57.897922Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:57.897991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:57.898040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895091218813437:5991]
2025-09-30T14:51:57.898043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:57.898111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 637 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a73f2cd8-69b132f-7ccf8047-f7c8a81d_0
2025-09-30T14:51:57.898291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 637 sessionId: src_id|a73f2cd8-69b132f-7ccf8047-f7c8a81d_0 is DEAD
2025-09-30T14:51:57.898443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a73f2cd8-69b132f-7ccf8047-f7c8a81d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:57.898453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a73f2cd8-69b132f-7ccf8047-f7c8a81d_0] Write session will restart in 0.009555s
2025-09-30T14:51:57.898491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a73f2cd8-69b132f-7ccf8047-f7c8a81d_0] Write session: Do CDS request
2025-09-30T14:51:57.898497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a73f2cd8-69b132f-7ccf8047-f7c8a81d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:57.908754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a73f2cd8-69b132f-7ccf8047-f7c8a81d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:57.908856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:57.908876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 638
2025-09-30T14:51:57.909022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 638 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:57.909062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 638 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:57.909072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=638 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:57.909076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:57.909471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 638 sessionId:  describe result for acl check
2025-09-30T14:51:57.909507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:57.909514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:57.909516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:57.909522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895091218813521:6191] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:57.910068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895091218813521:6191] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:57.912495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895091218813521:6191] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:57.914788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:57.914881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895091218813521:6191] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:57.914897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895091218813521:6191] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:57.914901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895091218813521:6191] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:57.914909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 638 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:57.917231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:57.917423Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:57.917432Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:57.917441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:57.917484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:57.917520Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895091129085658:5151]
2025-09-30T14:51:57.918118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:57.918380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:57.918426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:57.918716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:57.918775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:57.918781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:57.918782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:57.918783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:57.918784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:57.918785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:57.918786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:57.918788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:57.918789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:57.918790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:57.918791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.918792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.918793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.918794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:57.918795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:57.918800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:57.918810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:57.918813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:57.918817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:57.918821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:57.918825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:57.918828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:57.918832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:57.918835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:57.918839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:57.918842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.918847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.918851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.918854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:57.918858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:57.918866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:57.918873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:57.918879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:57.918884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:57.918889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:57.918894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:57.918899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:57.918904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:57.918910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:57.918915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:57.918920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:57.918925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:57.918930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:57.918936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:57.918941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:57.918946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:57.918950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:57.918955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:57.918962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:57.918968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:57.918977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.918982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.918987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.918997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.919001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.919006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.919011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:57.919018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:57.919028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:57.919034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:57.919082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:57.924677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:57.925917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:57.925932Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:57.925935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:57.925938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:57.925945Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 637 [2:7555895091129085658:5151]
2025-09-30T14:51:57.925962Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:57.925975Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:57.925983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:57.925986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:57.925988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:57.926004Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:57.926014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:57.926020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:57.926076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.926083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.926084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.926088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:57.926091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:57.926151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:57.926158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.926171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:57.926187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:57.926211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:57.926229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895091218813438:2454], now have 1 active actors on pipe
2025-09-30T14:51:57.926236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895091218813650:6191], now have 1 active actors on pipe
2025-09-30T14:51:57.926241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895091129085652:5151]
2025-09-30T14:51:57.926244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895091129085652:5151]
2025-09-30T14:51:57.926246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895091129085652:5151]
2025-09-30T14:51:57.926259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:57.926273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:57.926279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:57.926282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:57.926285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:57.926287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:57.926289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:57.926287Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 637
2025-09-30T14:51:57.926321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895091129085652:5151]
2025-09-30T14:51:57.926333Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:57.926339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:57.926370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 637
2025-09-30T14:51:57.926488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:57.926498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:57.926523Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92f7c6c2-6d776744-8b47c021-56db62f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:57.926531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:57.926535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:57.926537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:57.926547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:57.926560Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:57.926573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:57.926738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:57.926744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:57.926755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:57.926864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 638 partition: 0 MaxSeqNo: 42 sessionId: src_id|92f7c6c2-6d776744-8b47c021-56db62f6_0
2025-09-30T14:51:57.927123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a73f2cd8-69b132f-7ccf8047-f7c8a81d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|92f7c6c2-6d776744-8b47c021-56db62f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:57.929845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92f7c6c2-6d776744-8b47c021-56db62f6_0] Write session: try to update token
2025-09-30T14:51:57.929862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92f7c6c2-6d776744-8b47c021-56db62f6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:57.938522Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:57.938538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:57.938541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:57.938543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:57.938552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895091129085652:5151]
2025-09-30T14:51:57.938556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895091129085652:5151]
2025-09-30T14:51:57.938559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895091129085652:5151]
2025-09-30T14:51:57.938598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:57.938601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:57.938605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:57.938608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:57.938608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:57.938612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:57.938758Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:57.943873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 638 sessionId: src_id|92f7c6c2-6d776744-8b47c021-56db62f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:57.946649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:57.998240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895091218813684:5991]
2025-09-30T14:51:57.998468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 637, pipe: [1:7555895091218813684:5991]
2025-09-30T14:51:58.048936Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:58.049223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:58.049237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:58.049273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895091218813684:5991], now have 1 active actors on pipe
2025-09-30T14:51:58.049485Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:58.049500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:58.049520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895091218813684:5991]
2025-09-30T14:51:58.049522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:58.049540Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:58.049584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 638 reason: error at write: Disconnected sessionId: src_id|92f7c6c2-6d776744-8b47c021-56db62f6_0
2025-09-30T14:51:58.049728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 638 sessionId: src_id|92f7c6c2-6d776744-8b47c021-56db62f6_0 is DEAD
2025-09-30T14:51:58.049856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92f7c6c2-6d776744-8b47c021-56db62f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:58.049864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92f7c6c2-6d776744-8b47c021-56db62f6_0] Write session will restart in 0.005297s
2025-09-30T14:51:58.049887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92f7c6c2-6d776744-8b47c021-56db62f6_0] Write session: Do CDS request
2025-09-30T14:51:58.049896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92f7c6c2-6d776744-8b47c021-56db62f6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:58.056713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92f7c6c2-6d776744-8b47c021-56db62f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:58.056789Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:58.056808Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 639
2025-09-30T14:51:58.056929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 639 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:58.056961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 639 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:58.056970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=639 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:58.056974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:58.057403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 639 sessionId:  describe result for acl check
2025-09-30T14:51:58.057437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:58.057445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:58.057446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:58.057452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895095513781006:6200] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:58.057987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895095513781006:6200] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:58.060359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895095513781006:6200] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:58.063130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895095513781006:6200] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:58.063144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895095513781006:6200] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:58.063147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895095513781006:6200] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:58.063154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 639 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:58.065025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:58.067464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:58.067647Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:58.067658Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:58.067668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:58.067718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:58.067757Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895095424053171:5153]
2025-09-30T14:51:58.068397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:58.068703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:58.068745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:58.069070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:58.069131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:58.069138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:58.069139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:58.069140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:58.069141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:58.069142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:58.069144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:58.069144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:58.069145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:58.069146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:58.069148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.069149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.069150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.069151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:58.069152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:58.069157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:58.069167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:58.069171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:58.069175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:58.069178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:58.069183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:58.069187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:58.069191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:58.069195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:58.069199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:58.069203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.069207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.069211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.069215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:58.069219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:58.069226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:58.069234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:58.069240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:58.069245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:58.069250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:58.069255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:58.069260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:58.069265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:58.069270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:58.069275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:58.069280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:58.069286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:58.069292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:58.069297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:58.069301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:58.069306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:58.069311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:58.069316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:58.069320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:58.069326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:58.069330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.069335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.069341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.069348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.069358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.069363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.069367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:58.069372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:58.069377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:58.069386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:58.069429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:58.075015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:58.076013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:58.076030Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:58.076032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:58.076035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:58.076040Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 638 [2:7555895095424053171:5153]
2025-09-30T14:51:58.076054Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:58.076069Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:58.076072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:58.076075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:58.076077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:58.076092Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:58.076099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:58.076105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:58.076162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.076171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.076173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.076175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:58.076177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:58.076238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:58.076246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.076258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.076270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.076292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:58.076314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895095513781184:6200], now have 1 active actors on pipe
2025-09-30T14:51:58.076321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895095513780984:2454], now have 1 active actors on pipe
2025-09-30T14:51:58.076327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895095424053166:5153]
2025-09-30T14:51:58.076329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895095424053166:5153]
2025-09-30T14:51:58.076331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895095424053166:5153]
2025-09-30T14:51:58.076342Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:58.076357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:58.076358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:58.076366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:58.076369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:58.076369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:58.076371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:58.076385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 638
2025-09-30T14:51:58.076395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 638
2025-09-30T14:51:58.076401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895095424053166:5153]
2025-09-30T14:51:58.076409Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:58.076411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:58.076438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:58.076448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:58.076721Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ecbb38f-d6f3de8-64ea9f3a-3a422314_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:58.076739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:58.076742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:58.076745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:58.076755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:58.076765Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:58.076789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:58.076945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:58.076952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:58.076964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:58.077040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 639 partition: 0 MaxSeqNo: 42 sessionId: src_id|ecbb38f-d6f3de8-64ea9f3a-3a422314_0
2025-09-30T14:51:58.077394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92f7c6c2-6d776744-8b47c021-56db62f6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ecbb38f-d6f3de8-64ea9f3a-3a422314_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:58.080234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecbb38f-d6f3de8-64ea9f3a-3a422314_0] Write session: try to update token
2025-09-30T14:51:58.080257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecbb38f-d6f3de8-64ea9f3a-3a422314_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:58.088770Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:58.088788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:58.088791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:58.088793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:58.088803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895095424053166:5153]
2025-09-30T14:51:58.088810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895095424053166:5153]
2025-09-30T14:51:58.088814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895095424053166:5153]
2025-09-30T14:51:58.088855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:58.088861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.088864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:58.088864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:58.088871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:58.088875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:58.089004Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:58.094786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 639 sessionId: src_id|ecbb38f-d6f3de8-64ea9f3a-3a422314_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:58.097547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:58.149839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895095513781213:5991]
2025-09-30T14:51:58.150133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 638, pipe: [1:7555895095513781213:5991]
2025-09-30T14:51:58.206005Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:58.206327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:58.206345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:58.206392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895095513781213:5991], now have 1 active actors on pipe
2025-09-30T14:51:58.206622Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:58.206636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:58.206673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:58.206677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:58.206697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895095513781213:5991]
2025-09-30T14:51:58.206740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 639 reason: error at write: Disconnected sessionId: src_id|ecbb38f-d6f3de8-64ea9f3a-3a422314_0
2025-09-30T14:51:58.206908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 639 sessionId: src_id|ecbb38f-d6f3de8-64ea9f3a-3a422314_0 is DEAD
2025-09-30T14:51:58.207058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecbb38f-d6f3de8-64ea9f3a-3a422314_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:58.207068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecbb38f-d6f3de8-64ea9f3a-3a422314_0] Write session will restart in 0.007798s
2025-09-30T14:51:58.207092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecbb38f-d6f3de8-64ea9f3a-3a422314_0] Write session: Do CDS request
2025-09-30T14:51:58.207097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecbb38f-d6f3de8-64ea9f3a-3a422314_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:58.215668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecbb38f-d6f3de8-64ea9f3a-3a422314_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:58.215785Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:58.215803Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 640
2025-09-30T14:51:58.215923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 640 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:58.215973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 640 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:58.215982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=640 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:58.215987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:58.216471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 640 sessionId:  describe result for acl check
2025-09-30T14:51:58.216506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:58.216514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:58.216516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:58.216521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895095513781252:6204] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:58.217064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895095513781252:6204] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:58.219901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895095513781252:6204] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:58.222710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895095513781252:6204] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:58.222728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895095513781252:6204] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:58.222732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895095513781252:6204] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:58.222739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 640 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:58.223663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:58.225859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:58.226039Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:58.226050Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:58.226058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:58.226106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:58.226146Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895095424053392:5156]
2025-09-30T14:51:58.226834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:58.227151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:58.227213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:58.227504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:58.227554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:58.227558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:58.227559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:58.227560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:58.227561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:58.227562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:58.227562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:58.227563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:58.227564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:58.227565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:58.227566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.227567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.227567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.227569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:58.227570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:58.227574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:58.227581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:58.227584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:58.227586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:58.227589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:58.227591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:58.227594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:58.227596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:58.227598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:58.227601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:58.227603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.227605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.227608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.227610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:58.227612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:58.227618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:58.227623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:58.227628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:58.227632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:58.227636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:58.227639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:58.227642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:58.227645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:58.227647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:58.227650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:58.227652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:58.227655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:58.227662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:58.227665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:58.227667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:58.227671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:58.227677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:58.227680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:58.227683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:58.227689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:58.227694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.227699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.227703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.227713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.227718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.227723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.227726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:58.227732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:58.227737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:58.227747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:58.227775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:58.233270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:58.234169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:58.234185Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:58.234188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:58.234192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:58.234199Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 639 [2:7555895095424053392:5156]
2025-09-30T14:51:58.234215Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:58.234235Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:58.234242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:58.234245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:58.234248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:58.234264Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:58.234275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:58.234283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:58.234338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.234344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.234345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.234348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:58.234350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:58.234429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:58.234439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.234451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.234462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.234478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:58.234496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895095513781214:2454], now have 1 active actors on pipe
2025-09-30T14:51:58.234504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895095513781427:6204], now have 1 active actors on pipe
2025-09-30T14:51:58.234510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895095424053387:5156]
2025-09-30T14:51:58.234513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895095424053387:5156]
2025-09-30T14:51:58.234515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895095424053387:5156]
2025-09-30T14:51:58.234527Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:58.234545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:58.234554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:58.234558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:58.234560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:58.234538Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 639
2025-09-30T14:51:58.234564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:58.234564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 639
2025-09-30T14:51:58.234567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:58.234613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:58.234623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:58.234634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895095424053387:5156]
2025-09-30T14:51:58.234642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:58.234648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:58.234667Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11bca538-d84b7950-16f5b907-a9c45d1d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:58.234673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:58.234677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:58.234679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:58.234691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:58.234702Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:58.234729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:58.234893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:58.234903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:58.234919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:58.235282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 640 partition: 0 MaxSeqNo: 42 sessionId: src_id|11bca538-d84b7950-16f5b907-a9c45d1d_0
2025-09-30T14:51:58.235636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecbb38f-d6f3de8-64ea9f3a-3a422314_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|11bca538-d84b7950-16f5b907-a9c45d1d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:58.238538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11bca538-d84b7950-16f5b907-a9c45d1d_0] Write session: try to update token
2025-09-30T14:51:58.238561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11bca538-d84b7950-16f5b907-a9c45d1d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:58.246584Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:58.246602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:58.246605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:58.246607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:58.246618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895095424053387:5156]
2025-09-30T14:51:58.246623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895095424053387:5156]
2025-09-30T14:51:58.246627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895095424053387:5156]
2025-09-30T14:51:58.246667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:58.246671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:58.246678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:58.246679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.246682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:58.246683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:58.246819Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:58.253990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 640 sessionId: src_id|11bca538-d84b7950-16f5b907-a9c45d1d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:58.257088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:58.307004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895095513781441:5991]
2025-09-30T14:51:58.307281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 639, pipe: [1:7555895095513781441:5991]
2025-09-30T14:51:58.359494Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:58.359675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:58.359686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:58.359703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895095513781441:5991], now have 1 active actors on pipe
2025-09-30T14:51:58.359889Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:58.359890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:58.359905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:58.359921Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:58.359957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895095513781441:5991]
2025-09-30T14:51:58.359963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 640 reason: error at write: Disconnected sessionId: src_id|11bca538-d84b7950-16f5b907-a9c45d1d_0
2025-09-30T14:51:58.360096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 640 sessionId: src_id|11bca538-d84b7950-16f5b907-a9c45d1d_0 is DEAD
2025-09-30T14:51:58.360241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11bca538-d84b7950-16f5b907-a9c45d1d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:58.360249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11bca538-d84b7950-16f5b907-a9c45d1d_0] Write session will restart in 0.009423s
2025-09-30T14:51:58.360271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11bca538-d84b7950-16f5b907-a9c45d1d_0] Write session: Do CDS request
2025-09-30T14:51:58.360280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11bca538-d84b7950-16f5b907-a9c45d1d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:58.370877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11bca538-d84b7950-16f5b907-a9c45d1d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:58.371026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:58.371060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 641
2025-09-30T14:51:58.371265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 641 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:58.371318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 641 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:58.371334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=641 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:58.371344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:58.371815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 641 sessionId:  describe result for acl check
2025-09-30T14:51:58.371856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:58.371858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:58.371860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:58.371867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895095513781481:6215] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:58.372474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895095513781481:6215] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:58.375144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895095513781481:6215] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:58.378753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895095513781481:6215] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:58.378776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895095513781481:6215] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:58.378781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895095513781481:6215] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:58.378789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 641 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:58.382779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:58.384979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:58.385287Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:58.385298Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:58.385309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:58.385360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:58.385394Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895095424053647:5170]
2025-09-30T14:51:58.385838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:58.386105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:58.386140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:58.386432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:58.386478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:58.386482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:58.386483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:58.386484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:58.386485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:58.386485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:58.386486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:58.386487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:58.386488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:58.386488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:58.386489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.386489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.386490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.386491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:58.386491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:58.386495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:58.386501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:58.386504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:58.386506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:58.386508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:58.386511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:58.386513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:58.386516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:58.386518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:58.386521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:58.386523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.386525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.386528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.386530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:58.386532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:58.386538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:58.386544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:58.386547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:58.386551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:58.386554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:58.386557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:58.386559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:58.386562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:58.386565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:58.386568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:58.386571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:58.386574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:58.386576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:58.386579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:58.386581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:58.386584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:58.386587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:58.386590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:58.386592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:58.386595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:58.386599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.386602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.386605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.386607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.386610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.386612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.386615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:58.386618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:58.386620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:58.386623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:58.386647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:58.391948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:58.393670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:58.393683Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:58.393684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:58.393687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:58.393692Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 640 [2:7555895095424053647:5170]
2025-09-30T14:51:58.393703Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:58.393715Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:58.393717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:58.393719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:58.393720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:58.393731Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:58.393736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:58.393742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:58.393786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.393796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.393797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.393800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:58.393801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:58.393852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:58.393858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.393869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.393879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.393894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:58.393913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895095424053642:5170]
2025-09-30T14:51:58.393919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895095424053642:5170]
2025-09-30T14:51:58.393921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895095424053642:5170]
2025-09-30T14:51:58.393929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:58.393940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:58.393942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895095513781467:2454], now have 1 active actors on pipe
2025-09-30T14:51:58.393944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:58.393946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:58.393947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895095513781602:6215], now have 1 active actors on pipe
2025-09-30T14:51:58.393951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:58.393960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:58.393961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:58.393987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895095424053642:5170]
2025-09-30T14:51:58.393996Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:58.394005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:58.394034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 640
2025-09-30T14:51:58.394034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 640
2025-09-30T14:51:58.394146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:58.394157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:58.394181Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2dd98595-adcea32d-220af7e5-28c6101f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:58.394190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:58.394197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:58.394200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:58.394208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:58.394222Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:58.394236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:58.394392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:58.394414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:58.394431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:58.394518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 641 partition: 0 MaxSeqNo: 42 sessionId: src_id|2dd98595-adcea32d-220af7e5-28c6101f_0
2025-09-30T14:51:58.394843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11bca538-d84b7950-16f5b907-a9c45d1d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2dd98595-adcea32d-220af7e5-28c6101f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:58.402431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dd98595-adcea32d-220af7e5-28c6101f_0] Write session: try to update token
2025-09-30T14:51:58.402457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dd98595-adcea32d-220af7e5-28c6101f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:58.405724Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:58.405740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:58.405748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895095424053642:5170]
2025-09-30T14:51:58.405785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:58.405800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:58.406018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:58.406303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:58.406457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:58.406591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:58.406766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:58.406799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:58.417011Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:58.417032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:58.417034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:58.417040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:58.417050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895095424053642:5170]
2025-09-30T14:51:58.417054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895095424053642:5170]
2025-09-30T14:51:58.417058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895095424053642:5170]
2025-09-30T14:51:58.417097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:58.417105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.417108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:58.417115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:58.417125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:58.417130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:58.417249Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:58.421760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 641 sessionId: src_id|2dd98595-adcea32d-220af7e5-28c6101f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:58.424499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:58.460106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895095513781692:5991]
2025-09-30T14:51:58.460376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 640, pipe: [1:7555895095513781692:5991]
2025-09-30T14:51:58.526686Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:58.527208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:58.527225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:58.527261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895095513781692:5991], now have 1 active actors on pipe
2025-09-30T14:51:58.527509Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:58.527514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:58.527563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895095513781692:5991]
2025-09-30T14:51:58.527574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:58.527577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:58.527648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 641 reason: error at write: Disconnected sessionId: src_id|2dd98595-adcea32d-220af7e5-28c6101f_0
2025-09-30T14:51:58.527819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 641 sessionId: src_id|2dd98595-adcea32d-220af7e5-28c6101f_0 is DEAD
2025-09-30T14:51:58.527945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dd98595-adcea32d-220af7e5-28c6101f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:58.527954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dd98595-adcea32d-220af7e5-28c6101f_0] Write session will restart in 0.008243s
2025-09-30T14:51:58.527982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dd98595-adcea32d-220af7e5-28c6101f_0] Write session: Do CDS request
2025-09-30T14:51:58.527991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dd98595-adcea32d-220af7e5-28c6101f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:58.537746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dd98595-adcea32d-220af7e5-28c6101f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:58.537812Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:58.537829Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 642
2025-09-30T14:51:58.537955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 642 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:58.537980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 642 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:58.537987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=642 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:58.537991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:58.538388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 642 sessionId:  describe result for acl check
2025-09-30T14:51:58.538432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:58.538439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:58.538441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:58.538445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895095513781744:6220] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:58.538928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895095513781744:6220] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:58.541188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895095513781744:6220] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:58.543751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895095513781744:6220] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:58.543766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895095513781744:6220] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:58.543769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895095513781744:6220] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:58.543776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 642 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:58.544236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:58.546523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:58.546695Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:58.546703Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:58.546710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:58.546745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:58.546772Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895095424053869:5173]
2025-09-30T14:51:58.547212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:58.547513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:58.547549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:58.547773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:58.547816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:58.547823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:58.547824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:58.547825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:58.547826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:58.547827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:58.547828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:58.547830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:58.547831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:58.547832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:58.547833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.547834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.547835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.547836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:58.547837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:58.547842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:58.547851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:58.547855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:58.547859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:58.547863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:58.547867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:58.547869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:58.547871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:58.547873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:58.547876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:58.547878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.547880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.547883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.547885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:58.547887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:58.547893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:58.547898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:58.547902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:58.547905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:58.547907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:58.547910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:58.547913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:58.547916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:58.547918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:58.547921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:58.547924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:58.547927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:58.547930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:58.547933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:58.547936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:58.547939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:58.547941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:58.547944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:58.547947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:58.547953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:58.547957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.547962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.547966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.547970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.547974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.547979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.547983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:58.547987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:58.547993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:58.547997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:58.548037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:58.553502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:58.554700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:58.554712Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:58.554713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:58.554716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:58.554721Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 641 [2:7555895095424053869:5173]
2025-09-30T14:51:58.554731Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:58.554742Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:58.554744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:58.554745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:58.554746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:58.554757Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:58.554762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:58.554768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:58.554828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.554837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.554839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.554842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:58.554844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:58.554907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:58.554913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.554925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.554936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.554956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:58.554977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895095513781911:6220], now have 1 active actors on pipe
2025-09-30T14:51:58.554985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895095513781696:2454], now have 1 active actors on pipe
2025-09-30T14:51:58.554990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895095424053864:5173]
2025-09-30T14:51:58.554992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895095424053864:5173]
2025-09-30T14:51:58.554994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895095424053864:5173]
2025-09-30T14:51:58.555005Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:58.555015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:58.555018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:58.555021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:58.555022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:58.555035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:58.555042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:58.555069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895095424053864:5173]
2025-09-30T14:51:58.555046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 641
2025-09-30T14:51:58.555081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:58.555053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 641
2025-09-30T14:51:58.555086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:58.555115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:58.555124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:58.555146Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1e536ba-c3a9a90-6a987858-149bab45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:58.555159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:58.555167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:58.555169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:58.555178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:58.555191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:58.555210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:58.555368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:58.555376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:58.555389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:58.555474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 642 partition: 0 MaxSeqNo: 42 sessionId: src_id|c1e536ba-c3a9a90-6a987858-149bab45_0
2025-09-30T14:51:58.555823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dd98595-adcea32d-220af7e5-28c6101f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c1e536ba-c3a9a90-6a987858-149bab45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:58.558516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1e536ba-c3a9a90-6a987858-149bab45_0] Write session: try to update token
2025-09-30T14:51:58.558535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1e536ba-c3a9a90-6a987858-149bab45_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:58.566954Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:58.566971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:58.566981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895095424053864:5173]
2025-09-30T14:51:58.567030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:58.567035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:58.567187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:58.567379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:58.567539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:58.567664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:58.567849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:58.567896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:58.572894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 642 sessionId: src_id|c1e536ba-c3a9a90-6a987858-149bab45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:58.575525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:58.575698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:58.575714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:58.575750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:58.575848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:58.577708Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:58.577725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:58.577727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:58.577729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:58.577738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895095424053864:5173]
2025-09-30T14:51:58.577743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895095424053864:5173]
2025-09-30T14:51:58.577748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895095424053864:5173]
2025-09-30T14:51:58.577784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:58.577794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:58.577796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.577799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:58.577806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:58.577810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:58.577967Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:58.627556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895095513781925:5991]
2025-09-30T14:51:58.627951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 641, pipe: [1:7555895095513781925:5991]
2025-09-30T14:51:58.686290Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:58.693568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:58.693596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:58.693762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:58.693822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:58.693883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:58.693951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:58.693996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:58.694006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:58.694076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:58.694138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:58.694211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:58.694293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:58.694344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:58.694354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:58.694446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:58.694567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:58.694669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:58.694742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:58.694791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:58.694801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:58.694873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:58.694940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:58.695005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:58.695185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:58.695326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:58.695333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:58.695439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:58.695541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:58.695602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:58.695672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:58.695786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:58.695794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:58.695860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:58.695945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:58.696028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:58.696141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:58.696186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:58.696193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:58.696307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:58.696367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:58.696441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:58.696507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:58.696551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:58.696559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:58.696683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:58.696806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:58.696918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:58.696989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:58.697086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:58.697092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:58.697153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:58.697206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:58.697273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:58.697329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:58.697406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:58.697414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:58.698026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895095513781925:5991]
2025-09-30T14:51:58.698049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:58.698053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:58.698057Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:58.698083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 642 reason: error at write: Disconnected sessionId: src_id|c1e536ba-c3a9a90-6a987858-149bab45_0
2025-09-30T14:51:58.698257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 642 sessionId: src_id|c1e536ba-c3a9a90-6a987858-149bab45_0 is DEAD
2025-09-30T14:51:58.698440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1e536ba-c3a9a90-6a987858-149bab45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:58.698452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1e536ba-c3a9a90-6a987858-149bab45_0] Write session will restart in 0.007381s
2025-09-30T14:51:58.698481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1e536ba-c3a9a90-6a987858-149bab45_0] Write session: Do CDS request
2025-09-30T14:51:58.698486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1e536ba-c3a9a90-6a987858-149bab45_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:58.697483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:58.697552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:58.697611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:58.697671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:58.697710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:58.697712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:58.697780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895095513781925:5991], now have 1 active actors on pipe
2025-09-30T14:51:58.698873Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:58.706773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1e536ba-c3a9a90-6a987858-149bab45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:58.706895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:58.706916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 643
2025-09-30T14:51:58.707064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 643 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:58.707098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 643 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:58.707108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=643 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:58.707111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:58.707663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 643 sessionId:  describe result for acl check
2025-09-30T14:51:58.707698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:58.707705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:58.707707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:58.707714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895095513781950:6224] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:58.708255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895095513781950:6224] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:58.711463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895095513781950:6224] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:58.714696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895095513781950:6224] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:58.714727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895095513781950:6224] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:58.714730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895095513781950:6224] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:58.714738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 643 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:58.716536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:58.719069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:58.719444Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:58.719456Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:58.719468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:58.719532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:58.719577Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895095424054090:5175]
2025-09-30T14:51:58.720224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:58.720566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:58.720612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:58.720938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:58.720997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:58.721005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:58.721007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:58.721008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:58.721009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:58.721010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:58.721012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:58.721013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:58.721014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:58.721015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:58.721016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.721017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.721019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.721020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:58.721021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:58.721027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:58.721038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:58.721042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:58.721046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:58.721050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:58.721055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:58.721059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:58.721063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:58.721067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:58.721072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:58.721076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.721080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.721084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.721088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:58.721092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:58.721100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:58.721109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:58.721115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:58.721121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:58.721126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:58.721131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:58.721136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:58.721142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:58.721147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:58.721152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:58.721157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:58.721162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:58.721167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:58.721172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:58.721177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:58.721190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:58.721196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:58.721201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:58.721206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:58.721211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:58.721216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.721224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.721229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.721235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.721242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.721247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.721257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:58.721263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:58.721273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:58.721278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:58.721327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:58.727017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:58.727915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:58.727927Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:58.727930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:58.727934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:58.727940Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 642 [2:7555895095424054090:5175]
2025-09-30T14:51:58.727958Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:58.727975Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:58.727978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:58.727981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:58.727983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:58.727998Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:58.728005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:58.728012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:58.728070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.728077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.728079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.728083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:58.728086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:58.728149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:58.728156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.728168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.728183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.728204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:58.728226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895095513782142:6224], now have 1 active actors on pipe
2025-09-30T14:51:58.728234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895095513781926:2454], now have 1 active actors on pipe
2025-09-30T14:51:58.728240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895095424054085:5175]
2025-09-30T14:51:58.728242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895095424054085:5175]
2025-09-30T14:51:58.728244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895095424054085:5175]
2025-09-30T14:51:58.728255Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:58.728266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:58.728268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:58.728271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:58.728273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:58.728287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:58.728294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:58.728327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895095424054085:5175]
2025-09-30T14:51:58.728334Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:58.728336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:58.728299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 642
2025-09-30T14:51:58.728313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 642
2025-09-30T14:51:58.728362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:58.728371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:58.728412Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e562d3ea-c8a1c74c-f4957be1-d057199f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:58.728425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:58.728428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:58.728430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:58.728441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:58.728451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:58.728468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:58.728653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:58.728667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:58.728691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:58.728818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 643 partition: 0 MaxSeqNo: 42 sessionId: src_id|e562d3ea-c8a1c74c-f4957be1-d057199f_0
2025-09-30T14:51:58.729154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1e536ba-c3a9a90-6a987858-149bab45_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e562d3ea-c8a1c74c-f4957be1-d057199f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:58.731944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e562d3ea-c8a1c74c-f4957be1-d057199f_0] Write session: try to update token
2025-09-30T14:51:58.731965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e562d3ea-c8a1c74c-f4957be1-d057199f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:58.740658Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:58.740675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:58.740677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:58.740678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:58.740684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895095424054085:5175]
2025-09-30T14:51:58.740687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895095424054085:5175]
2025-09-30T14:51:58.740690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895095424054085:5175]
2025-09-30T14:51:58.740723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:58.740729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.740731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:58.740744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:58.740750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:58.740754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:58.740862Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:58.747329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 643 sessionId: src_id|e562d3ea-c8a1c74c-f4957be1-d057199f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:58.750099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:58.798023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895095513782157:5991]
2025-09-30T14:51:58.798316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 642, pipe: [1:7555895095513782157:5991]
2025-09-30T14:51:58.848613Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:58.849225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:58.849240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:58.849272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895095513782157:5991], now have 1 active actors on pipe
2025-09-30T14:51:58.849437Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:58.849516Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:58.849547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895095513782157:5991]
2025-09-30T14:51:58.849559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:58.849616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 643 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e562d3ea-c8a1c74c-f4957be1-d057199f_0
2025-09-30T14:51:58.849774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 643 sessionId: src_id|e562d3ea-c8a1c74c-f4957be1-d057199f_0 is DEAD
2025-09-30T14:51:58.849927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e562d3ea-c8a1c74c-f4957be1-d057199f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:58.849938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e562d3ea-c8a1c74c-f4957be1-d057199f_0] Write session will restart in 0.007493s
2025-09-30T14:51:58.849961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e562d3ea-c8a1c74c-f4957be1-d057199f_0] Write session: Do CDS request
2025-09-30T14:51:58.849967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e562d3ea-c8a1c74c-f4957be1-d057199f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:58.858797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e562d3ea-c8a1c74c-f4957be1-d057199f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:58.858917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:58.858935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 644
2025-09-30T14:51:58.859100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 644 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:58.859148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 644 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:58.859160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=644 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:58.859165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:58.859665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 644 sessionId:  describe result for acl check
2025-09-30T14:51:58.859700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:58.859707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:58.859709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:58.859715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895095513782208:6228] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:58.860274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895095513782208:6228] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:58.862988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895095513782208:6228] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:58.865843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895095513782208:6228] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:58.865861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895095513782208:6228] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:58.865865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895095513782208:6228] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:58.865872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 644 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:58.866715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:58.869080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:58.869299Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:58.869309Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:58.869319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:58.869368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:58.869408Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895095424054312:5177]
2025-09-30T14:51:58.870073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:58.870406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:58.870445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:58.870754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:58.870814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:58.870820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:58.870822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:58.870823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:58.870825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:58.870826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:58.870827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:58.870829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:58.870830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:58.870831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:58.870833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.870834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.870835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.870836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:58.870838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:58.870843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:58.870853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:58.870858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:58.870862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:58.870866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:58.870871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:58.870875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:58.870879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:58.870883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:58.870889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:58.870899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.870903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.870911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.870915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:58.870923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:58.870930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:58.870942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:58.870952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:58.870965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:58.870969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:58.870974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:58.870979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:58.870984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:58.870991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:58.870996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:58.871001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:58.871006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:58.871010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:58.871016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:58.871020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:58.871025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:58.871030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:58.871035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:58.871040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:58.871044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:58.871049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.871054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.871058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.871062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.871067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.871073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.871077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:58.871082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:58.871087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:58.871092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:58.871137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:58.876487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:58.877275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:58.877288Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:58.877291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:58.877295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:58.877302Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 643 [2:7555895095424054312:5177]
2025-09-30T14:51:58.877318Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:58.877333Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:58.877335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:58.877337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:58.877339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:58.877351Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:58.877356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:58.877361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:58.877406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.877414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.877416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.877418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:58.877420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:58.877481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:58.877489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.877504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:58.877518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:58.877538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:58.877562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895095513782158:2454], now have 1 active actors on pipe
2025-09-30T14:51:58.877565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895095513782375:6228], now have 1 active actors on pipe
2025-09-30T14:51:58.877570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895095424054307:5177]
2025-09-30T14:51:58.877572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895095424054307:5177]
2025-09-30T14:51:58.877574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895095424054307:5177]
2025-09-30T14:51:58.877584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:58.877597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:58.877599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:58.877602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:58.877604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:58.877612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:58.877615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:58.877646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895095424054307:5177]
2025-09-30T14:51:58.877656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:58.877661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:58.877700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:58.877710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:58.877737Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e68613eb-8748ed92-a2ef261d-5d1b5ad7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:58.877749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:58.877754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:58.877664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 643
2025-09-30T14:51:58.877756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:58.877676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 643
2025-09-30T14:51:58.877766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:58.877775Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:58.877789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:58.877939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:58.877949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:58.877962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:58.878061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 644 partition: 0 MaxSeqNo: 42 sessionId: src_id|e68613eb-8748ed92-a2ef261d-5d1b5ad7_0
2025-09-30T14:51:58.878390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e562d3ea-c8a1c74c-f4957be1-d057199f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e68613eb-8748ed92-a2ef261d-5d1b5ad7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:58.881046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e68613eb-8748ed92-a2ef261d-5d1b5ad7_0] Write session: try to update token
2025-09-30T14:51:58.881064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e68613eb-8748ed92-a2ef261d-5d1b5ad7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:58.889426Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:58.889442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:58.889452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895095424054307:5177]
2025-09-30T14:51:58.889495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:58.889509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:58.889659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:58.889806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:58.889969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:58.890108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:58.890298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:58.890358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:58.895613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 644 sessionId: src_id|e68613eb-8748ed92-a2ef261d-5d1b5ad7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:58.898009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:58.898228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:58.898247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:58.898281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:58.898363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:58.900043Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:58.900059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:58.900062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:58.900064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:58.900073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895095424054307:5177]
2025-09-30T14:51:58.900078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895095424054307:5177]
2025-09-30T14:51:58.900082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895095424054307:5177]
2025-09-30T14:51:58.900121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:58.900123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:58.900130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:58.900131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:58.900132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:58.900135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:58.900311Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:58.949566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895095513782401:5991]
2025-09-30T14:51:58.949846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 643, pipe: [1:7555895095513782401:5991]
2025-09-30T14:51:59.012282Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:59.019948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:59.019974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:59.020130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:59.020201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:59.020267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:59.020326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:59.020564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:59.020575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:59.020644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:59.020703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:59.020764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:59.020829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:59.020874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:59.020883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:59.020950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:59.021008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:59.021066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:59.021125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:59.021173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:59.021180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:59.021285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:59.021352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:59.021416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:59.021481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:59.021544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:59.021554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:59.021617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:59.021678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:59.021736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:59.021796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:59.021836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:59.021841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:59.021909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:59.021971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:59.022029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:59.022087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:59.022138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:59.022145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:59.022210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:59.022271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:59.022332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:59.022415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:59.022548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:59.022555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:59.022617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:59.022677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:59.022751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:59.022811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:59.022851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:59.022856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:59.022919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:59.022978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:59.023043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:59.023102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:59.023143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:59.023148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:59.023213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:59.023296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:59.023363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:59.023420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:59.023526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:59.023532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:59.023586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895095513782401:5991], now have 1 active actors on pipe
2025-09-30T14:51:59.023839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:59.023846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895095513782401:5991]
2025-09-30T14:51:59.023872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:59.023875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:59.023899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 644 reason: error at write: Disconnected sessionId: src_id|e68613eb-8748ed92-a2ef261d-5d1b5ad7_0
2025-09-30T14:51:59.024056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 644 sessionId: src_id|e68613eb-8748ed92-a2ef261d-5d1b5ad7_0 is DEAD
2025-09-30T14:51:59.024185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68613eb-8748ed92-a2ef261d-5d1b5ad7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:59.024196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68613eb-8748ed92-a2ef261d-5d1b5ad7_0] Write session will restart in 0.008556s
2025-09-30T14:51:59.024224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68613eb-8748ed92-a2ef261d-5d1b5ad7_0] Write session: Do CDS request
2025-09-30T14:51:59.024230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68613eb-8748ed92-a2ef261d-5d1b5ad7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:59.024397Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:59.033760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e68613eb-8748ed92-a2ef261d-5d1b5ad7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:59.033837Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:59.033854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 645
2025-09-30T14:51:59.033972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 645 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:59.034002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 645 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:59.034008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=645 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:59.034012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:59.034522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 645 sessionId:  describe result for acl check
2025-09-30T14:51:59.034558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:59.034565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:59.034567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:59.034572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895099808749757:6235] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:59.035096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895099808749757:6235] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:59.037327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895099808749757:6235] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:59.039802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895099808749757:6235] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:59.039818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895099808749757:6235] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:59.039821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895099808749757:6235] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:59.039829Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 645 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:59.040899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:59.043289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:59.043481Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:59.043494Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:59.043506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:59.043574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:59.043619Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895099719021843:5180]
2025-09-30T14:51:59.044275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:59.044644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:59.044704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:59.045056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:59.045147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:59.045156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:59.045157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:59.045158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:59.045159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:59.045161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:59.045162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:59.045163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:59.045164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:59.045165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:59.045166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.045168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.045169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.045170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:59.045172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:59.045178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:59.045189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:59.045193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:59.045197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:59.045200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:59.045204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:59.045208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:59.045212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:59.045216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:59.045221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:59.045224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.045228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.045232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.045236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:59.045240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:59.045250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:59.045258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:59.045264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:59.045270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:59.045274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:59.045280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:59.045285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:59.045290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:59.045294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:59.045299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:59.045304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:59.045309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:59.045317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:59.045330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:59.045335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:59.045340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:59.045345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:59.045350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:59.045358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:59.045363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:59.045368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.045376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.045380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.045385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.045395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.045400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.045404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:59.045410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:59.045419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:59.045424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:59.045468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:59.050671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:59.051559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:59.051578Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:59.051581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:59.051584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:59.051591Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 644 [2:7555895099719021843:5180]
2025-09-30T14:51:59.051606Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:59.051624Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:59.051632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:59.051636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:59.051638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:59.051654Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:59.051669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:59.051678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:59.051741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.051751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.051754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.051757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:59.051760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:59.051826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:59.051833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.051845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.051857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.051879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:59.051903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895099808749705:2454], now have 1 active actors on pipe
2025-09-30T14:51:59.051911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895099808749923:6235], now have 1 active actors on pipe
2025-09-30T14:51:59.051917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895099719021838:5180]
2025-09-30T14:51:59.051919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895099719021838:5180]
2025-09-30T14:51:59.051922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895099719021838:5180]
2025-09-30T14:51:59.051934Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:59.051947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:59.051952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:59.051954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:59.051956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:59.051968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:59.051971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:59.051960Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 644
2025-09-30T14:51:59.051968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 644
2025-09-30T14:51:59.052007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895099719021838:5180]
2025-09-30T14:51:59.052017Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:59.052019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:59.052046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:59.052055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:59.052406Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|370aabed-1e1eee92-379a3ca1-1d18d92a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:59.052424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:59.052428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:59.052430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:59.052441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:59.052460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:59.052488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:59.052734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:59.052747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:59.052767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:59.052835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 645 partition: 0 MaxSeqNo: 42 sessionId: src_id|370aabed-1e1eee92-379a3ca1-1d18d92a_0
2025-09-30T14:51:59.053203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68613eb-8748ed92-a2ef261d-5d1b5ad7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|370aabed-1e1eee92-379a3ca1-1d18d92a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:59.055923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|370aabed-1e1eee92-379a3ca1-1d18d92a_0] Write session: try to update token
2025-09-30T14:51:59.055943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|370aabed-1e1eee92-379a3ca1-1d18d92a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:59.063527Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:59.063542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:59.063545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:59.063547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:59.063555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895099719021838:5180]
2025-09-30T14:51:59.063561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895099719021838:5180]
2025-09-30T14:51:59.063565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895099719021838:5180]
2025-09-30T14:51:59.063607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:59.063610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:59.063615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.063617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:59.063618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:59.063621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:59.063751Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:59.069602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 645 sessionId: src_id|370aabed-1e1eee92-379a3ca1-1d18d92a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:59.072248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:59.124165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895099808749941:5991]
2025-09-30T14:51:59.124427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 644, pipe: [1:7555895099808749941:5991]
2025-09-30T14:51:59.177012Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:59.177525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:59.177542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:59.177583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895099808749941:5991], now have 1 active actors on pipe
2025-09-30T14:51:59.177823Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:59.177872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:59.177882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895099808749941:5991]
2025-09-30T14:51:59.177893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:59.177905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:59.177983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 645 reason: error at write: Disconnected sessionId: src_id|370aabed-1e1eee92-379a3ca1-1d18d92a_0
2025-09-30T14:51:59.178158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 645 sessionId: src_id|370aabed-1e1eee92-379a3ca1-1d18d92a_0 is DEAD
2025-09-30T14:51:59.178277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|370aabed-1e1eee92-379a3ca1-1d18d92a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:59.178286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|370aabed-1e1eee92-379a3ca1-1d18d92a_0] Write session will restart in 0.006005s
2025-09-30T14:51:59.178310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|370aabed-1e1eee92-379a3ca1-1d18d92a_0] Write session: Do CDS request
2025-09-30T14:51:59.178319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|370aabed-1e1eee92-379a3ca1-1d18d92a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:59.185761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|370aabed-1e1eee92-379a3ca1-1d18d92a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:59.185825Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:59.185842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 646
2025-09-30T14:51:59.185970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 646 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:59.186011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 646 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:59.186021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=646 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:59.186025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:59.186452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 646 sessionId:  describe result for acl check
2025-09-30T14:51:59.186487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:59.186489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:59.186491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:59.186496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895099808749963:6239] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:59.187033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895099808749963:6239] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:59.189429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895099808749963:6239] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:59.192123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895099808749963:6239] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:59.192136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895099808749963:6239] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:59.192139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895099808749963:6239] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:59.192146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 646 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:59.194317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:59.196505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:59.196705Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:59.196719Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:59.196731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:59.196800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:59.196841Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895099719022069:5183]
2025-09-30T14:51:59.197471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:59.197795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:59.197852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:59.198182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:59.198278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:59.198287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:59.198288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:59.198289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:59.198290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:59.198291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:59.198293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:59.198294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:59.198295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:59.198296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:59.198298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.198299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.198300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.198301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:59.198303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:59.198309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:59.198320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:59.198324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:59.198329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:59.198333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:59.198337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:59.198341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:59.198345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:59.198349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:59.198359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:59.198367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.198370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.198378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.198382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:59.198390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:59.198411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:59.198420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:59.198431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:59.198437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:59.198446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:59.198451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:59.198462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:59.198473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:59.198478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:59.198488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:59.198493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:59.198499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:59.198509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:59.198520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:59.198528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:59.198534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:59.198543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:59.198553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:59.198561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:59.198567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:59.198576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.198586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.198595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.198600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.198605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.198611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.198620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:59.198630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:59.198639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:59.198648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:59.198693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:59.204200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:59.205003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:59.205019Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:59.205021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:59.205025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:59.205031Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 645 [2:7555895099719022069:5183]
2025-09-30T14:51:59.205042Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:59.205056Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:59.205058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:59.205061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:59.205063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:59.205075Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:59.205081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:59.205087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:59.205141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.205148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.205150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.205152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:59.205154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:59.205213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:59.205221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.205234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.205245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.205262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:59.205282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895099719022064:5183]
2025-09-30T14:51:59.205285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895099719022064:5183]
2025-09-30T14:51:59.205288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895099719022064:5183]
2025-09-30T14:51:59.205307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:59.205320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:59.205331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:59.205334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:59.205348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895099808749942:2454], now have 1 active actors on pipe
2025-09-30T14:51:59.205359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895099808750147:6239], now have 1 active actors on pipe
2025-09-30T14:51:59.205372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:59.205395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:59.205404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:59.205405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 645
2025-09-30T14:51:59.205413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 645
2025-09-30T14:51:59.205448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895099719022064:5183]
2025-09-30T14:51:59.205461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:59.205463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:59.205513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:59.205526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:59.205568Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd1584e4-2f436bd7-ed1f21a4-233ef00f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:59.205581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:59.205586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:59.205593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:59.205603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:59.205619Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:59.205643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:59.205775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:59.205784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:59.205803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:59.205890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 646 partition: 0 MaxSeqNo: 42 sessionId: src_id|dd1584e4-2f436bd7-ed1f21a4-233ef00f_0
2025-09-30T14:51:59.206224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|370aabed-1e1eee92-379a3ca1-1d18d92a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dd1584e4-2f436bd7-ed1f21a4-233ef00f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:59.209151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1584e4-2f436bd7-ed1f21a4-233ef00f_0] Write session: try to update token
2025-09-30T14:51:59.209171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1584e4-2f436bd7-ed1f21a4-233ef00f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:59.217875Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:59.217890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:59.217892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:59.217894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:59.217903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895099719022064:5183]
2025-09-30T14:51:59.217906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895099719022064:5183]
2025-09-30T14:51:59.217909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895099719022064:5183]
2025-09-30T14:51:59.217942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:59.217947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.217949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:59.217962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:59.217972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:59.217982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:59.218072Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:59.224091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 646 sessionId: src_id|dd1584e4-2f436bd7-ed1f21a4-233ef00f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:59.226674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:59.278287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895099808750175:5991]
2025-09-30T14:51:59.278617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 645, pipe: [1:7555895099808750175:5991]
2025-09-30T14:51:59.327349Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:59.327902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:59.327919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:59.327954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895099808750175:5991], now have 1 active actors on pipe
2025-09-30T14:51:59.328167Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:59.328199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:59.328221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895099808750175:5991]
2025-09-30T14:51:59.328257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:59.328330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 646 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dd1584e4-2f436bd7-ed1f21a4-233ef00f_0
2025-09-30T14:51:59.328509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 646 sessionId: src_id|dd1584e4-2f436bd7-ed1f21a4-233ef00f_0 is DEAD
2025-09-30T14:51:59.328667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1584e4-2f436bd7-ed1f21a4-233ef00f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:59.328692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1584e4-2f436bd7-ed1f21a4-233ef00f_0] Write session will restart in 0.006946s
2025-09-30T14:51:59.328715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1584e4-2f436bd7-ed1f21a4-233ef00f_0] Write session: Do CDS request
2025-09-30T14:51:59.328721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1584e4-2f436bd7-ed1f21a4-233ef00f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:59.336708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1584e4-2f436bd7-ed1f21a4-233ef00f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:59.336882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:59.336900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 647
2025-09-30T14:51:59.337015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 647 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:59.337046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 647 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:59.337055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=647 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:59.337059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:59.337435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 647 sessionId:  describe result for acl check
2025-09-30T14:51:59.337470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:59.337476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:59.337478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:59.337483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895099808750205:6243] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:59.337968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895099808750205:6243] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:59.340479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895099808750205:6243] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:59.343024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895099808750205:6243] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:59.343041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895099808750205:6243] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:59.343045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895099808750205:6243] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:59.343053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 647 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:59.344953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:59.347617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:59.347947Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:59.347956Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:59.347969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:59.348033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:59.348091Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895099719022307:5185]
2025-09-30T14:51:59.348733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:59.349061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:59.349107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:59.349449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:59.349509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:59.349514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:59.349516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:59.349517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:59.349518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:59.349519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:59.349521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:59.349522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:59.349523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:59.349524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:59.349526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.349527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.349528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.349530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:59.349531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:59.349537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:59.349547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:59.349552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:59.349557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:59.349562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:59.349567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:59.349570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:59.349575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:59.349580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:59.349585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:59.349589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.349593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.349598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.349602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:59.349619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:59.349628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:59.349640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:59.349646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:59.349654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:59.349660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:59.349669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:59.349674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:59.349683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:59.349688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:59.349696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:59.349703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:59.349709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:59.349719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:59.349725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:59.349733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:59.349739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:59.349745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:59.349751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:59.349756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:59.349762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:59.349767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.349773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.349781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.349787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.349791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.349797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.349805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:59.349811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:59.349816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:59.349823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:59.349867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:59.355226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:59.356277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:59.356294Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:59.356296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:59.356300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:59.356306Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 646 [2:7555895099719022307:5185]
2025-09-30T14:51:59.356320Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:59.356334Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:59.356337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:59.356340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:59.356342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:59.356358Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:59.356364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:59.356371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:59.356433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.356441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.356443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.356448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:59.356451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:59.356508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:59.356515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.356527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.356542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.356567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:59.356584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895099808750395:6243], now have 1 active actors on pipe
2025-09-30T14:51:59.356587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895099808750176:2454], now have 1 active actors on pipe
2025-09-30T14:51:59.356594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895099719022293:5185]
2025-09-30T14:51:59.356596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895099719022293:5185]
2025-09-30T14:51:59.356598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895099719022293:5185]
2025-09-30T14:51:59.356614Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:59.356628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:59.356638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:59.356642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:59.356644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:59.356646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:59.356649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:59.356678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895099719022293:5185]
2025-09-30T14:51:59.356689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:59.356662Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 646
2025-09-30T14:51:59.356663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 646
2025-09-30T14:51:59.356741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:59.356817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:59.356841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:59.356871Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb3f376e-93d0afb6-4531bd6c-b067d9f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:59.356884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:59.356897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:59.356903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:59.356914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:59.356925Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:59.356955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:59.357088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:59.357102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:59.357122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:59.357218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 647 partition: 0 MaxSeqNo: 42 sessionId: src_id|bb3f376e-93d0afb6-4531bd6c-b067d9f3_0
2025-09-30T14:51:59.357577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1584e4-2f436bd7-ed1f21a4-233ef00f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bb3f376e-93d0afb6-4531bd6c-b067d9f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:59.360230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb3f376e-93d0afb6-4531bd6c-b067d9f3_0] Write session: try to update token
2025-09-30T14:51:59.360249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb3f376e-93d0afb6-4531bd6c-b067d9f3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:59.368798Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:59.368816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:59.368819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:59.368820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:59.368828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895099719022293:5185]
2025-09-30T14:51:59.368835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895099719022293:5185]
2025-09-30T14:51:59.368838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895099719022293:5185]
2025-09-30T14:51:59.368876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:59.368882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.368887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:59.368886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:59.368893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:59.368896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:59.369038Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:59.374376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 647 sessionId: src_id|bb3f376e-93d0afb6-4531bd6c-b067d9f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:59.377128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:59.428271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895099808750432:5991]
2025-09-30T14:51:59.428543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 646, pipe: [1:7555895099808750432:5991]
2025-09-30T14:51:59.476276Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:59.476569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:59.476580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:59.476617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895099808750432:5991], now have 1 active actors on pipe
2025-09-30T14:51:59.476851Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:59.476927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895099808750432:5991]
2025-09-30T14:51:59.476954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:59.476961Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:59.477029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 647 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bb3f376e-93d0afb6-4531bd6c-b067d9f3_0
2025-09-30T14:51:59.477204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 647 sessionId: src_id|bb3f376e-93d0afb6-4531bd6c-b067d9f3_0 is DEAD
2025-09-30T14:51:59.477344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb3f376e-93d0afb6-4531bd6c-b067d9f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:59.477356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb3f376e-93d0afb6-4531bd6c-b067d9f3_0] Write session will restart in 0.005894s
2025-09-30T14:51:59.477379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb3f376e-93d0afb6-4531bd6c-b067d9f3_0] Write session: Do CDS request
2025-09-30T14:51:59.477384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb3f376e-93d0afb6-4531bd6c-b067d9f3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:59.484732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb3f376e-93d0afb6-4531bd6c-b067d9f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:59.484897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:59.484916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 648
2025-09-30T14:51:59.485080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 648 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:59.485113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 648 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:59.485123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=648 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:59.485127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:59.485614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 648 sessionId:  describe result for acl check
2025-09-30T14:51:59.485644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:59.485645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:59.485646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:59.485652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895099808750458:6255] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:59.486105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895099808750458:6255] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:59.489093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895099808750458:6255] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:59.492183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895099808750458:6255] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:59.492199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895099808750458:6255] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:59.492203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895099808750458:6255] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:59.492210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 648 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:59.493963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:59.496470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:59.496804Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:59.496816Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:59.496828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:59.496886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:59.496925Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895099719022557:5199]
2025-09-30T14:51:59.497500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:59.497811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:59.497851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:59.498126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:59.498192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:59.498193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:59.498194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:59.498195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:59.498197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:59.498198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:59.498200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:59.498201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:59.498202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:59.498203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:59.498205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.498206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.498207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.498209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:59.498210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:59.498215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:59.498226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:59.498230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:59.498235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:59.498239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:59.498242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:59.498246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:59.498250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:59.498253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:59.498257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:59.498260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.498264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.498268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.498272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:59.498279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:59.498286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:59.498294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:59.498304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:59.498310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:59.498315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:59.498321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:59.498330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:59.498337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:59.498346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:59.498353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:59.498362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:59.498367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:59.498376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:59.498386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:59.498392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:59.498408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:59.498418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:59.498425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:59.498433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:59.498439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:59.498448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.498457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.498461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.498475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.498481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.498485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.498490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:59.498495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:59.498499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:59.498504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:59.498546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:59.504182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:59.505024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:59.505043Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:59.505047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:59.505051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:59.505057Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 647 [2:7555895099719022557:5199]
2025-09-30T14:51:59.505075Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:59.505092Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:59.505095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:59.505098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:59.505101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:59.505117Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:59.505129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:59.505135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:59.505202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.505210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.505213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.505216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:59.505219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:59.505404Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 647
2025-09-30T14:51:59.505408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 647
2025-09-30T14:51:59.505678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:59.505688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.505703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.505721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.505745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:59.505770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895099808750435:2454], now have 1 active actors on pipe
2025-09-30T14:51:59.505778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895099808750655:6255], now have 1 active actors on pipe
2025-09-30T14:51:59.505793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:59.505802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:59.505820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895099719022552:5199]
2025-09-30T14:51:59.505827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895099719022552:5199]
2025-09-30T14:51:59.505829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895099719022552:5199]
2025-09-30T14:51:59.505842Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:59.505855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:59.505860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:59.505863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:59.505864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:59.505875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:59.505878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:59.505895Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1e06443-3b34b178-c07e0e2-f95b489c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:59.505906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:59.505909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:59.505911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:59.505920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:59.505934Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:59.505975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895099719022552:5199]
2025-09-30T14:51:59.505987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:59.505994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:59.505998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:59.506207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:59.506220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:59.506242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:59.506359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 648 partition: 0 MaxSeqNo: 42 sessionId: src_id|e1e06443-3b34b178-c07e0e2-f95b489c_0
2025-09-30T14:51:59.506763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb3f376e-93d0afb6-4531bd6c-b067d9f3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e1e06443-3b34b178-c07e0e2-f95b489c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:59.509344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e06443-3b34b178-c07e0e2-f95b489c_0] Write session: try to update token
2025-09-30T14:51:59.509358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e06443-3b34b178-c07e0e2-f95b489c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:59.518224Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:59.518243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:59.518252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895099719022552:5199]
2025-09-30T14:51:59.518296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:59.518300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:59.518553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:59.518743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:59.518891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:59.519041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:59.519239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:59.519305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:59.523349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 648 sessionId: src_id|e1e06443-3b34b178-c07e0e2-f95b489c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:59.525943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:59.526154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:59.526175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:59.526213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:59.526319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:59.529714Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:59.529735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:59.529738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:59.529740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:59.529750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895099719022552:5199]
2025-09-30T14:51:59.529754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895099719022552:5199]
2025-09-30T14:51:59.529758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895099719022552:5199]
2025-09-30T14:51:59.529801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:59.529809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.529812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:59.529813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:59.529820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:59.529825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:59.529950Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:59.577266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895099808750670:5991]
2025-09-30T14:51:59.577523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 647, pipe: [1:7555895099808750670:5991]
2025-09-30T14:51:59.639672Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:59.647217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:59.647264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:59.647441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:59.647512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:59.647583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:59.647660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:59.647708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:59.647717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:59.647790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:59.647860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:59.647924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:59.648003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:59.648050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:59.648058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:59.648136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:59.648212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:59.648282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:59.648350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:59.648405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:59.648414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:59.648494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:59.648568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:59.648639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:59.648709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:59.648756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:59.648763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:59.648836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:59.648906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:59.648975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:59.649048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:59.649095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:59.649107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:59.649175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:59.649241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:59.649303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:59.649366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:59.649410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:59.649418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:59.649483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:59.649541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:59.649610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:59.649680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:59.649746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:59.649754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:59.649822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:59.649893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:59.649966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:59.650082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:59.650226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:59.650237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:59.650311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:59.650371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:59.650449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:59.650522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:59.650585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:59.650593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:59.650661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:59.650732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:59.650802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:59.650874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:59.650924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:59.650932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:59.650996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895099808750670:5991], now have 1 active actors on pipe
2025-09-30T14:51:59.651189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:59.651193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895099808750670:5991]
2025-09-30T14:51:59.651207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:59.651215Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:59.651236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 648 reason: error at write: Disconnected sessionId: src_id|e1e06443-3b34b178-c07e0e2-f95b489c_0
2025-09-30T14:51:59.651434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 648 sessionId: src_id|e1e06443-3b34b178-c07e0e2-f95b489c_0 is DEAD
2025-09-30T14:51:59.651650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e06443-3b34b178-c07e0e2-f95b489c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:59.651661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e06443-3b34b178-c07e0e2-f95b489c_0] Write session will restart in 0.008069s
2025-09-30T14:51:59.651684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e06443-3b34b178-c07e0e2-f95b489c_0] Write session: Do CDS request
2025-09-30T14:51:59.651691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e06443-3b34b178-c07e0e2-f95b489c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:59.652180Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:59.660785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e06443-3b34b178-c07e0e2-f95b489c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:59.660929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:59.660945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 649
2025-09-30T14:51:59.661093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 649 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:59.661123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 649 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:59.661132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=649 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:59.661136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:59.661629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 649 sessionId:  describe result for acl check
2025-09-30T14:51:59.661663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:59.661665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:59.661667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:59.661672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895099808750713:6259] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:59.662174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895099808750713:6259] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:59.665531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895099808750713:6259] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:59.668180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895099808750713:6259] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:59.668211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895099808750713:6259] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:59.668214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895099808750713:6259] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:59.668223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 649 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:59.668777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:59.671213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:59.671425Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:59.671435Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:59.671445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:59.671499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:59.671532Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895099719022787:5202]
2025-09-30T14:51:59.672111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:59.672477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:59.672521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:59.672828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:59.672877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:59.672882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:59.672884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:59.672885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:59.672886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:59.672887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:59.672888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:59.672889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:59.672891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:59.672892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:59.672893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.672894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.672895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.672896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:59.672897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:59.672902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:59.672911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:59.672915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:59.672919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:59.672923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:59.672926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:59.672930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:59.672934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:59.672937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:59.672941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:59.672945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.672948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.672952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.672957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:59.672961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:59.672968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:59.672977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:59.672982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:59.672988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:59.672993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:59.672999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:59.673009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:59.673012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:59.673015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:59.673018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:59.673020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:59.673023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:59.673025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:59.673028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:59.673030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:59.673033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:59.673036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:59.673038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:59.673041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:59.673045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:59.673048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.673050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.673053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.673055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.673058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.673060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.673062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:59.673065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:59.673068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:59.673070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:59.673096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:59.678516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:59.679429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:59.679443Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:59.679446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:59.679451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:59.679458Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 648 [2:7555895099719022787:5202]
2025-09-30T14:51:59.679474Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:59.679490Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:59.679494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:59.679497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:59.679500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:59.679515Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:59.679522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:59.679529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:59.679590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.679598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.679601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.679605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:59.679608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:59.679674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:59.679681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.679694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.679709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.679728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:59.679750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895099808750894:6259], now have 1 active actors on pipe
2025-09-30T14:51:59.679760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895099808750671:2454], now have 1 active actors on pipe
2025-09-30T14:51:59.679767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895099719022782:5202]
2025-09-30T14:51:59.679770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895099719022782:5202]
2025-09-30T14:51:59.679772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895099719022782:5202]
2025-09-30T14:51:59.679784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:59.679798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:59.679800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:59.679805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:59.679807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:59.679817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:59.679821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:59.679824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 648
2025-09-30T14:51:59.679856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895099719022782:5202]
2025-09-30T14:51:59.679840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 648
2025-09-30T14:51:59.679866Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:59.679869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:59.679884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:59.679889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:59.679942Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8730092b-cae7b60d-8b0751e4-54d9febe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:59.679955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:59.679959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:59.679961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:59.679971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:59.679987Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:59.680014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:59.680247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:59.680264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:59.680290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:59.680376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 649 partition: 0 MaxSeqNo: 42 sessionId: src_id|8730092b-cae7b60d-8b0751e4-54d9febe_0
2025-09-30T14:51:59.680732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e06443-3b34b178-c07e0e2-f95b489c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8730092b-cae7b60d-8b0751e4-54d9febe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:59.683590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8730092b-cae7b60d-8b0751e4-54d9febe_0] Write session: try to update token
2025-09-30T14:51:59.683610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8730092b-cae7b60d-8b0751e4-54d9febe_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:59.692237Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:59.692257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:59.692260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:59.692263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:59.692273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895099719022782:5202]
2025-09-30T14:51:59.692277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895099719022782:5202]
2025-09-30T14:51:59.692282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895099719022782:5202]
2025-09-30T14:51:59.692325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:59.692332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:59.692335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.692338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:59.692339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:59.692344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:59.692485Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:59.697770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 649 sessionId: src_id|8730092b-cae7b60d-8b0751e4-54d9febe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:59.700435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:59.751338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895099808750908:5991]
2025-09-30T14:51:59.751606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 648, pipe: [1:7555895099808750908:5991]
2025-09-30T14:51:59.804528Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:59.805097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:59.805123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:59.805159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895099808750908:5991], now have 1 active actors on pipe
2025-09-30T14:51:59.805389Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:59.805407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:59.805476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:59.805481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895099808750908:5991]
2025-09-30T14:51:59.805562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 649 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8730092b-cae7b60d-8b0751e4-54d9febe_0
2025-09-30T14:51:59.805750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 649 sessionId: src_id|8730092b-cae7b60d-8b0751e4-54d9febe_0 is DEAD
2025-09-30T14:51:59.805893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8730092b-cae7b60d-8b0751e4-54d9febe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:51:59.805904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8730092b-cae7b60d-8b0751e4-54d9febe_0] Write session will restart in 0.005397s
2025-09-30T14:51:59.805928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8730092b-cae7b60d-8b0751e4-54d9febe_0] Write session: Do CDS request
2025-09-30T14:51:59.805934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8730092b-cae7b60d-8b0751e4-54d9febe_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:59.812762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8730092b-cae7b60d-8b0751e4-54d9febe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:59.812818Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:59.812835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 650
2025-09-30T14:51:59.813011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 650 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:59.813046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 650 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:59.813058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=650 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:59.813062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:59.813738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 650 sessionId:  describe result for acl check
2025-09-30T14:51:59.813789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:59.813795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:59.813797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:59.813803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895099808750933:6263] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:59.814382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895099808750933:6263] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:59.817385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895099808750933:6263] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:59.820304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895099808750933:6263] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:59.820320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895099808750933:6263] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:59.820324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895099808750933:6263] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:59.820332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 650 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:59.821979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:59.824358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:59.824548Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:59.824559Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:51:59.824570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:59.824625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:59.824682Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895099719023016:5204]
2025-09-30T14:51:59.825313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:51:59.825630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:51:59.825679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:51:59.826020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:51:59.826081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:59.826082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:59.826083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:59.826084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:59.826085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:59.826087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:59.826088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:59.826089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:59.826090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:59.826091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:59.826092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.826093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.826094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.826096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:59.826097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:59.826103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:59.826112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:59.826115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:59.826118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:59.826122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:59.826126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:59.826129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:59.826133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:59.826136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:59.826140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:59.826143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.826147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.826150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.826153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:59.826156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:59.826164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:59.826172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:51:59.826177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:59.826181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:51:59.826186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:59.826191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:51:59.826195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:59.826199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:51:59.826203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:59.826207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:51:59.826211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:59.826216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:51:59.826220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:59.826224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:51:59.826229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:59.826233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:51:59.826237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:59.826241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:51:59.826245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:59.826250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:51:59.826253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.826258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.826263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.826268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.826272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.826277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.826280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:59.826285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:51:59.826289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:59.826294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:51:59.826333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:51:59.831969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:51:59.832825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:51:59.832838Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:51:59.832840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:59.832843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:59.832848Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 649 [2:7555895099719023016:5204]
2025-09-30T14:51:59.832863Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:51:59.832876Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:51:59.832878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:59.832880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:59.832882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:59.832894Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:51:59.832899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:59.832905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:59.832949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.832955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.832956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.832959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:51:59.832961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:51:59.833020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:51:59.833026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.833034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:51:59.833041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:51:59.833051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:51:59.833067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895099719023011:5204]
2025-09-30T14:51:59.833072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895099719023011:5204]
2025-09-30T14:51:59.833074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895099719023011:5204]
2025-09-30T14:51:59.833081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:51:59.833091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:51:59.833090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:51:59.833094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:51:59.833096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:51:59.833103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:51:59.833106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:59.833113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895099808750909:2454], now have 1 active actors on pipe
2025-09-30T14:51:59.833116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895099808751130:6263], now have 1 active actors on pipe
2025-09-30T14:51:59.833142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895099719023011:5204]
2025-09-30T14:51:59.833151Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:51:59.833160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:51:59.833216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 649
2025-09-30T14:51:59.833218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 649
2025-09-30T14:51:59.833304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:59.833312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:59.833332Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b09d6204-cace7cfe-da0ac001-91eddb24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:59.833343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:59.833346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:59.833348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:59.833357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:59.833365Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:59.833379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:59.833489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:59.833497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:59.833511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:59.833642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 650 partition: 0 MaxSeqNo: 42 sessionId: src_id|b09d6204-cace7cfe-da0ac001-91eddb24_0
2025-09-30T14:51:59.833984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8730092b-cae7b60d-8b0751e4-54d9febe_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b09d6204-cace7cfe-da0ac001-91eddb24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:59.836631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b09d6204-cace7cfe-da0ac001-91eddb24_0] Write session: try to update token
2025-09-30T14:51:59.836648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b09d6204-cace7cfe-da0ac001-91eddb24_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:59.845324Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:51:59.845341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:59.845350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895099719023011:5204]
2025-09-30T14:51:59.845395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:51:59.845399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:59.845561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:51:59.845702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:59.845831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:59.845970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:51:59.846155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:51:59.846197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:51:59.850666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 650 sessionId: src_id|b09d6204-cace7cfe-da0ac001-91eddb24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:59.853465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:59.853721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:59.853741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:59.853789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:59.854017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:51:59.856062Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:51:59.856079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:51:59.856081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:51:59.856084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:51:59.856093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895099719023011:5204]
2025-09-30T14:51:59.856099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895099719023011:5204]
2025-09-30T14:51:59.856102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895099719023011:5204]
2025-09-30T14:51:59.856138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:51:59.856145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:51:59.856149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:51:59.856160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:51:59.856167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:51:59.856172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:51:59.856276Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:51:59.905443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895099808751145:5991]
2025-09-30T14:51:59.905746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 649, pipe: [1:7555895099808751145:5991]
2025-09-30T14:51:59.976459Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:51:59.984788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:59.984815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:59.984980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:59.985049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:59.985114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:59.985178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:59.985223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:59.985232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:59.985299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:59.985362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:59.985426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:59.985497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:59.985541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:59.985548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:59.985611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:59.985685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:59.985747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:59.985813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:59.985858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:59.985866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:59.985932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:59.985998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:59.986061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:59.986124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:59.986167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:59.986175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:59.986240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:59.986301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:59.986362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:59.986439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:59.986485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:59.986492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:59.986556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:59.986634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:59.986701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:59.986765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:59.986810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:59.986817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:59.986883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:59.986944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:59.987012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:59.987078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:59.987121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:59.987130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:59.987195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:59.987274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:59.987337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:59.987403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:59.987449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:59.987456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:59.987519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:59.987587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:59.987655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:59.987719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:59.987763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:59.987770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:59.987838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:51:59.987901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:51:59.987964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:51:59.988030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:51:59.988073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:51:59.988080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:51:59.988140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895099808751145:5991], now have 1 active actors on pipe
2025-09-30T14:51:59.988364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:51:59.988377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895099808751145:5991]
2025-09-30T14:51:59.988423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:51:59.988426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:51:59.988478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 650 reason: error at write: Disconnected sessionId: src_id|b09d6204-cace7cfe-da0ac001-91eddb24_0
2025-09-30T14:51:59.988659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 650 sessionId: src_id|b09d6204-cace7cfe-da0ac001-91eddb24_0 is DEAD
2025-09-30T14:51:59.988853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b09d6204-cace7cfe-da0ac001-91eddb24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:51:59.988865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b09d6204-cace7cfe-da0ac001-91eddb24_0] Write session will restart in 0.007993s
2025-09-30T14:51:59.988888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b09d6204-cace7cfe-da0ac001-91eddb24_0] Write session: Do CDS request
2025-09-30T14:51:59.988893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b09d6204-cace7cfe-da0ac001-91eddb24_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:51:59.989355Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:51:59.997779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b09d6204-cace7cfe-da0ac001-91eddb24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:59.997916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:59.997935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 651
2025-09-30T14:51:59.998083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 651 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:59.998116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 651 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:51:59.998125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=651 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:59.998129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:59.998619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 651 sessionId:  describe result for acl check
2025-09-30T14:51:59.998666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:59.998673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:59.998675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:59.998684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895099808751194:6270] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:59.999293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895099808751194:6270] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:00.002086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895099808751194:6270] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:00.004686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895099808751194:6270] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:00.004702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895099808751194:6270] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:00.004706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895099808751194:6270] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:00.004713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 651 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:00.007215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:00.009597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:00.009806Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:00.009820Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:00.009834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:00.009924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:00.009968Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895104013990554:5207]
2025-09-30T14:52:00.010616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:00.010924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:00.010984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:00.011352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:00.011447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:00.011455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:00.011456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:00.011458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:00.011459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:00.011460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:00.011462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:00.011463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:00.011464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:00.011466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:00.011467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.011468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.011470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.011471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:00.011472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:00.011479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:00.011490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:00.011494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:00.011498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:00.011502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:00.011506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:00.011510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:00.011514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:00.011518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:00.011522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:00.011526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.011530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.011534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.011537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:00.011541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:00.011553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:00.011561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:00.011568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:00.011574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:00.011579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:00.011584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:00.011588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:00.011593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:00.011599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:00.011609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:00.011614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:00.011619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:00.011623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:00.011628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:00.011632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:00.011637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:00.011642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:00.011647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:00.011658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:00.011662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:00.011667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.011672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.011681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.011686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.011691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.011697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.011701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:00.011705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:00.011710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:00.011714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:00.011756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:00.017416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:00.018361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:00.018380Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:00.018383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:00.018387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:00.018407Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 650 [2:7555895104013990554:5207]
2025-09-30T14:52:00.018424Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:00.018441Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:00.018445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:00.018448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:00.018456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:00.018473Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:00.018484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:00.018492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:00.018560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.018574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.018577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.018581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:00.018584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:00.018657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:00.018666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.018681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.018695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.018716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:00.018740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895099808751169:2454], now have 1 active actors on pipe
2025-09-30T14:52:00.018749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895104103718665:6270], now have 1 active actors on pipe
2025-09-30T14:52:00.018756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895104013990549:5207]
2025-09-30T14:52:00.018758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895104013990549:5207]
2025-09-30T14:52:00.018760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895104013990549:5207]
2025-09-30T14:52:00.018775Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:00.018790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:00.018798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:00.018802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:00.018804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:00.018812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:00.018816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:00.018819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 650
2025-09-30T14:52:00.018851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895104013990549:5207]
2025-09-30T14:52:00.018841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 650
2025-09-30T14:52:00.018861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:00.018862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:00.018880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:00.018886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:00.019219Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23d604c4-dac4b014-d4b5a71e-9b2aafe7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:00.019261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:00.019267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:00.019269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:00.019280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:00.019296Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:00.019334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:00.019484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:00.019495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:00.019515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:00.019614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 651 partition: 0 MaxSeqNo: 42 sessionId: src_id|23d604c4-dac4b014-d4b5a71e-9b2aafe7_0
2025-09-30T14:52:00.019968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b09d6204-cace7cfe-da0ac001-91eddb24_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|23d604c4-dac4b014-d4b5a71e-9b2aafe7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:00.022825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23d604c4-dac4b014-d4b5a71e-9b2aafe7_0] Write session: try to update token
2025-09-30T14:52:00.022844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23d604c4-dac4b014-d4b5a71e-9b2aafe7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:00.031589Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:00.031607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:00.031610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:00.031612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:00.031625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895104013990549:5207]
2025-09-30T14:52:00.031630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895104013990549:5207]
2025-09-30T14:52:00.031635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895104013990549:5207]
2025-09-30T14:52:00.031682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:00.031683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:00.031689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:00.031690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.031693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:00.031693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:00.032888Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:00.037908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 651 sessionId: src_id|23d604c4-dac4b014-d4b5a71e-9b2aafe7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:00.040639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:00.088791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895104103718703:5991]
2025-09-30T14:52:00.089084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 650, pipe: [1:7555895104103718703:5991]
2025-09-30T14:52:00.140811Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:00.141104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:00.141117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:00.141155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895104103718703:5991], now have 1 active actors on pipe
2025-09-30T14:52:00.141379Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:00.141407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:00.141452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:00.141453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895104103718703:5991]
2025-09-30T14:52:00.141515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 651 reason: status is not ok: tablet will be restarted right now sessionId: src_id|23d604c4-dac4b014-d4b5a71e-9b2aafe7_0
2025-09-30T14:52:00.141703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 651 sessionId: src_id|23d604c4-dac4b014-d4b5a71e-9b2aafe7_0 is DEAD
2025-09-30T14:52:00.141864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23d604c4-dac4b014-d4b5a71e-9b2aafe7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:00.141874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23d604c4-dac4b014-d4b5a71e-9b2aafe7_0] Write session will restart in 0.007464s
2025-09-30T14:52:00.141898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23d604c4-dac4b014-d4b5a71e-9b2aafe7_0] Write session: Do CDS request
2025-09-30T14:52:00.141904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23d604c4-dac4b014-d4b5a71e-9b2aafe7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:00.150830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23d604c4-dac4b014-d4b5a71e-9b2aafe7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:00.150913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:00.150933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 652
2025-09-30T14:52:00.151084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 652 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:00.151116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 652 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:00.151125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=652 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:00.151129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:00.151687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 652 sessionId:  describe result for acl check
2025-09-30T14:52:00.151727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:00.151729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:00.151731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:00.151738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895104103718745:6274] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:00.152304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895104103718745:6274] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:00.155381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895104103718745:6274] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:00.158247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895104103718745:6274] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:00.158266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895104103718745:6274] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:00.158269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895104103718745:6274] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:00.158278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 652 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:00.158939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:00.161560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:00.161742Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:00.161753Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:00.161763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:00.161820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:00.161863Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895104013990787:5210]
2025-09-30T14:52:00.162334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:00.162606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:00.162642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:00.162884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:00.162939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:00.162944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:00.162945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:00.162946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:00.162947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:00.162948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:00.162948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:00.162949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:00.162950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:00.162951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:00.162951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.162952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.162953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.162953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:00.162954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:00.162958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:00.162964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:00.162967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:00.162970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:00.162972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:00.162974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:00.162977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:00.162980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:00.162982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:00.162985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:00.162987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.162990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.162992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.162995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:00.162997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:00.163002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:00.163007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:00.163012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:00.163015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:00.163018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:00.163021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:00.163024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:00.163027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:00.163030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:00.163033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:00.163036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:00.163039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:00.163041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:00.163045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:00.163047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:00.163050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:00.163053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:00.163056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:00.163058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:00.163061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:00.163064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.163069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.163072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.163075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.163078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.163081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.163083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:00.163086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:00.163089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:00.163092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:00.163115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:00.168570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:00.169768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:00.169781Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:00.169783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:00.169786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:00.169791Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 651 [2:7555895104013990787:5210]
2025-09-30T14:52:00.169803Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:00.169815Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:00.169817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:00.169819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:00.169821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:00.169837Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:00.169844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:00.169850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:00.169919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.169927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.169929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.169932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:00.169934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:00.169998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:00.170005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.170018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.170031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.170061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:00.170086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895104103718930:6274], now have 1 active actors on pipe
2025-09-30T14:52:00.170089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895104103718705:2454], now have 1 active actors on pipe
2025-09-30T14:52:00.170095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895104013990782:5210]
2025-09-30T14:52:00.170097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895104013990782:5210]
2025-09-30T14:52:00.170099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895104013990782:5210]
2025-09-30T14:52:00.170111Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:00.170123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:00.170125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:00.170129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:00.170131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:00.170139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:00.170142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:00.170180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895104013990782:5210]
2025-09-30T14:52:00.170190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:00.170197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:00.170190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 651
2025-09-30T14:52:00.170228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 651
2025-09-30T14:52:00.170333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:00.170343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:00.170370Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|932512d1-5ad5b083-2e0bc22c-3209d0e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:00.170382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:00.170387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:00.170401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:00.170417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:00.170431Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:00.170451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:00.170606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:00.170613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:00.170626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:00.170717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 652 partition: 0 MaxSeqNo: 42 sessionId: src_id|932512d1-5ad5b083-2e0bc22c-3209d0e2_0
2025-09-30T14:52:00.171103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23d604c4-dac4b014-d4b5a71e-9b2aafe7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|932512d1-5ad5b083-2e0bc22c-3209d0e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:00.173726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|932512d1-5ad5b083-2e0bc22c-3209d0e2_0] Write session: try to update token
2025-09-30T14:52:00.173743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|932512d1-5ad5b083-2e0bc22c-3209d0e2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:00.188342Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:00.188361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:00.188372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895104013990782:5210]
2025-09-30T14:52:00.188423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:00.188435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:00.188618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:00.188774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:00.188930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:00.189086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:00.189296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:00.189341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:00.190643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 652 sessionId: src_id|932512d1-5ad5b083-2e0bc22c-3209d0e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:00.192724Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:00.192739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:00.192741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:00.192744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:00.192754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895104013990782:5210]
2025-09-30T14:52:00.192758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895104013990782:5210]
2025-09-30T14:52:00.192763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895104013990782:5210]
2025-09-30T14:52:00.192801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:00.192806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.192808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:00.192825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:00.192838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:00.192842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:00.192949Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:00.193517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:00.241855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895104103718943:5991]
2025-09-30T14:52:00.242113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 651, pipe: [1:7555895104103718943:5991]
2025-09-30T14:52:00.299621Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:00.299870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:00.299884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:00.299900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895104103718943:5991], now have 1 active actors on pipe
2025-09-30T14:52:00.300138Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:00.300163Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:00.300174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:00.300179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:00.300226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895104103718943:5991]
2025-09-30T14:52:00.300244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 652 reason: error at write: Disconnected sessionId: src_id|932512d1-5ad5b083-2e0bc22c-3209d0e2_0
2025-09-30T14:52:00.300433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 652 sessionId: src_id|932512d1-5ad5b083-2e0bc22c-3209d0e2_0 is DEAD
2025-09-30T14:52:00.300566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|932512d1-5ad5b083-2e0bc22c-3209d0e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:00.300578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|932512d1-5ad5b083-2e0bc22c-3209d0e2_0] Write session will restart in 0.009002s
2025-09-30T14:52:00.300602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|932512d1-5ad5b083-2e0bc22c-3209d0e2_0] Write session: Do CDS request
2025-09-30T14:52:00.300616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|932512d1-5ad5b083-2e0bc22c-3209d0e2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:00.310825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|932512d1-5ad5b083-2e0bc22c-3209d0e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:00.310889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:00.310905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 653
2025-09-30T14:52:00.311088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 653 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:00.311121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 653 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:00.311131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=653 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:00.311135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:00.311684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 653 sessionId:  describe result for acl check
2025-09-30T14:52:00.311725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:00.311732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:00.311734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:00.311739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895104103718997:6278] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:00.312323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895104103718997:6278] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:00.314932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895104103718997:6278] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:00.318007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895104103718997:6278] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:00.318027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895104103718997:6278] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:00.318031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895104103718997:6278] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:00.318039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 653 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:00.318406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:00.320887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:00.321112Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:00.321126Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:00.321150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:00.321221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:00.321263Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895104013991019:5212]
2025-09-30T14:52:00.321929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:00.322265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:00.322306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:00.322576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:00.322621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:00.322627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:00.322627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:00.322628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:00.322629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:00.322630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:00.322631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:00.322632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:00.322632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:00.322633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:00.322634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.322635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.322636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.322637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:00.322638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:00.322642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:00.322648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:00.322651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:00.322653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:00.322656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:00.322658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:00.322660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:00.322663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:00.322665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:00.322668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:00.322670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.322672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.322675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.322677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:00.322679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:00.322685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:00.322690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:00.322694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:00.322697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:00.322701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:00.322704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:00.322707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:00.322710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:00.322714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:00.322717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:00.322720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:00.322723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:00.322726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:00.322729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:00.322732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:00.322735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:00.322739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:00.322742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:00.322749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:00.322753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:00.322758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.322763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.322767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.322771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.322776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.322782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.322786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:00.322791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:00.322800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:00.322806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:00.322831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:00.328549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:00.329523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:00.329538Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:00.329539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:00.329543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:00.329550Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 652 [2:7555895104013991019:5212]
2025-09-30T14:52:00.329566Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:00.329583Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:00.329586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:00.329590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:00.329592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:00.329606Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:00.329611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:00.329617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:00.329665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.329672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.329673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.329676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:00.329678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:00.329732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:00.329739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.329753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.329771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.329792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:00.329816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895104103719172:6278], now have 1 active actors on pipe
2025-09-30T14:52:00.329824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895104103718945:2454], now have 1 active actors on pipe
2025-09-30T14:52:00.329830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895104013991014:5212]
2025-09-30T14:52:00.329833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895104013991014:5212]
2025-09-30T14:52:00.329835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895104013991014:5212]
2025-09-30T14:52:00.329849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:00.329862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:00.329877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:00.329884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:00.329886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:00.329887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:00.329889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:00.329921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895104013991014:5212]
2025-09-30T14:52:00.329931Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:00.329935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:00.329913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 652
2025-09-30T14:52:00.329928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 652
2025-09-30T14:52:00.329974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:00.329983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:00.330020Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13094745-729794e4-72cf1646-4cf35387_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:00.330032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:00.330037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:00.330039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:00.330049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:00.330063Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:00.330082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:00.330281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:00.330289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:00.330304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:00.330456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 653 partition: 0 MaxSeqNo: 42 sessionId: src_id|13094745-729794e4-72cf1646-4cf35387_0
2025-09-30T14:52:00.330829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|932512d1-5ad5b083-2e0bc22c-3209d0e2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|13094745-729794e4-72cf1646-4cf35387_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:00.333716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13094745-729794e4-72cf1646-4cf35387_0] Write session: try to update token
2025-09-30T14:52:00.333736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13094745-729794e4-72cf1646-4cf35387_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:00.342031Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:00.342054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:00.342056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:00.342058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:00.342067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895104013991014:5212]
2025-09-30T14:52:00.342072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895104013991014:5212]
2025-09-30T14:52:00.342076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895104013991014:5212]
2025-09-30T14:52:00.342119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:00.342126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.342126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:00.342129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:00.342132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:00.342136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:00.342278Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:00.348445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 653 sessionId: src_id|13094745-729794e4-72cf1646-4cf35387_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:00.351371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:00.400583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895104103719184:5991]
2025-09-30T14:52:00.400843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 652, pipe: [1:7555895104103719184:5991]
2025-09-30T14:52:00.455571Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:00.456023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:00.456038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:00.456078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895104103719184:5991], now have 1 active actors on pipe
2025-09-30T14:52:00.456268Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:00.456272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:00.456276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:00.456331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895104103719184:5991]
2025-09-30T14:52:00.456345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 653 reason: error at write: Disconnected sessionId: src_id|13094745-729794e4-72cf1646-4cf35387_0
2025-09-30T14:52:00.456533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 653 sessionId: src_id|13094745-729794e4-72cf1646-4cf35387_0 is DEAD
2025-09-30T14:52:00.456591Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:00.456716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13094745-729794e4-72cf1646-4cf35387_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:00.456732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13094745-729794e4-72cf1646-4cf35387_0] Write session will restart in 0.008399s
2025-09-30T14:52:00.456757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13094745-729794e4-72cf1646-4cf35387_0] Write session: Do CDS request
2025-09-30T14:52:00.456762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13094745-729794e4-72cf1646-4cf35387_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:00.467000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13094745-729794e4-72cf1646-4cf35387_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:00.467048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:00.467067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 654
2025-09-30T14:52:00.467299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 654 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:00.467342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 654 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:00.467348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=654 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:00.467352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:00.467791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 654 sessionId:  describe result for acl check
2025-09-30T14:52:00.467828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:00.467831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:00.467832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:00.467839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895104103719264:6289] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:00.468354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895104103719264:6289] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:00.471811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895104103719264:6289] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:00.474485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895104103719264:6289] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:00.474521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895104103719264:6289] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:00.474528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895104103719264:6289] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:00.474537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 654 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:00.474589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:00.477175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:00.477361Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:00.477373Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:00.477381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:00.477433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:00.477475Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895104013991288:5226]
2025-09-30T14:52:00.478172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:00.478463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:00.478502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:00.478823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:00.478886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:00.478894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:00.478895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:00.478897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:00.478898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:00.478899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:00.478901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:00.478902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:00.478903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:00.478905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:00.478906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.478907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.478908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.478909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:00.478910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:00.478916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:00.478926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:00.478930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:00.478935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:00.478939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:00.478943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:00.478947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:00.478952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:00.478956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:00.478960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:00.478964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.478968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.478972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.478976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:00.478980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:00.478988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:00.478996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:00.479002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:00.479007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:00.479012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:00.479018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:00.479022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:00.479027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:00.479033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:00.479038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:00.479042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:00.479048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:00.479053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:00.479058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:00.479063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:00.479068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:00.479073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:00.479078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:00.479083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:00.479088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:00.479095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.479099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.479104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.479109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.479113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.479119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.479123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:00.479129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:00.479134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:00.479140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:00.479185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:00.484937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:00.485950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:00.485968Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:00.485971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:00.485975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:00.485982Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 653 [2:7555895104013991288:5226]
2025-09-30T14:52:00.486000Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:00.486021Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:00.486028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:00.486032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:00.486035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:00.486050Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:00.486062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:00.486070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:00.486135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.486146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.486148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.486152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:00.486154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:00.486223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:00.486232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.486245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.486265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.486287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:00.486311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895104103719438:6289], now have 1 active actors on pipe
2025-09-30T14:52:00.486323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895104103719211:2454], now have 1 active actors on pipe
2025-09-30T14:52:00.486329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895104013991282:5226]
2025-09-30T14:52:00.486332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895104013991282:5226]
2025-09-30T14:52:00.486334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895104013991282:5226]
2025-09-30T14:52:00.486347Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:00.486362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:00.486366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:00.486369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:00.486371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:00.486378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:00.486382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:00.486431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895104013991282:5226]
2025-09-30T14:52:00.486415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 653
2025-09-30T14:52:00.486446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:00.486421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 653
2025-09-30T14:52:00.486450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:00.486493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:00.486506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:00.486541Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48d5e2df-b374b3a7-3d4dbfae-1dbad29a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:00.486551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:00.486555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:00.486557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:00.486571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:00.486585Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:00.486604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:00.486748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:00.486756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:00.486770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:00.486843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 654 partition: 0 MaxSeqNo: 42 sessionId: src_id|48d5e2df-b374b3a7-3d4dbfae-1dbad29a_0
2025-09-30T14:52:00.487223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13094745-729794e4-72cf1646-4cf35387_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|48d5e2df-b374b3a7-3d4dbfae-1dbad29a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:00.490031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48d5e2df-b374b3a7-3d4dbfae-1dbad29a_0] Write session: try to update token
2025-09-30T14:52:00.490056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48d5e2df-b374b3a7-3d4dbfae-1dbad29a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:00.498588Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:00.498607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:00.498610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:00.498612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:00.498621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895104013991282:5226]
2025-09-30T14:52:00.498625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895104013991282:5226]
2025-09-30T14:52:00.498630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895104013991282:5226]
2025-09-30T14:52:00.498670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:00.498676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.498679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:00.498691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:00.498703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:00.498707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:00.498904Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:00.506981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 654 sessionId: src_id|48d5e2df-b374b3a7-3d4dbfae-1dbad29a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:00.509681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:00.556743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895104103719450:5991]
2025-09-30T14:52:00.557091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 653, pipe: [1:7555895104103719450:5991]
2025-09-30T14:52:00.605520Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:00.606014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:00.606026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:00.606043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895104103719450:5991], now have 1 active actors on pipe
2025-09-30T14:52:00.606260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:00.606276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:00.606278Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:00.606325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895104103719450:5991]
2025-09-30T14:52:00.606346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 654 reason: error at write: Disconnected sessionId: src_id|48d5e2df-b374b3a7-3d4dbfae-1dbad29a_0
2025-09-30T14:52:00.606382Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:00.606535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 654 sessionId: src_id|48d5e2df-b374b3a7-3d4dbfae-1dbad29a_0 is DEAD
2025-09-30T14:52:00.606704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48d5e2df-b374b3a7-3d4dbfae-1dbad29a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:00.606717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48d5e2df-b374b3a7-3d4dbfae-1dbad29a_0] Write session will restart in 0.005006s
2025-09-30T14:52:00.606741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48d5e2df-b374b3a7-3d4dbfae-1dbad29a_0] Write session: Do CDS request
2025-09-30T14:52:00.606750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48d5e2df-b374b3a7-3d4dbfae-1dbad29a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:00.612740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48d5e2df-b374b3a7-3d4dbfae-1dbad29a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:00.612874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:00.612892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 655
2025-09-30T14:52:00.612997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 655 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:00.613026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 655 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:00.613035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=655 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:00.613039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:00.613486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 655 sessionId:  describe result for acl check
2025-09-30T14:52:00.613529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:00.613534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:00.613535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:00.613539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895104103719467:6294] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:00.613985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895104103719467:6294] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:00.616204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895104103719467:6294] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:00.619525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895104103719467:6294] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:00.619547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895104103719467:6294] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:00.619550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895104103719467:6294] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:00.619558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 655 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:00.621521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:00.624020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:00.624203Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:00.624213Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:00.624222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:00.624267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:00.624305Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895104013991524:5229]
2025-09-30T14:52:00.624973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:00.625300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:00.625368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:00.625618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:00.625661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:00.625665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:00.625666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:00.625667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:00.625668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:00.625669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:00.625669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:00.625670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:00.625671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:00.625671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:00.625672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.625673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.625674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.625675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:00.625675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:00.625679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:00.625686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:00.625688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:00.625691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:00.625693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:00.625696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:00.625699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:00.625701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:00.625704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:00.625707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:00.625709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.625711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.625714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.625716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:00.625719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:00.625724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:00.625730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:00.625734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:00.625737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:00.625741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:00.625744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:00.625746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:00.625749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:00.625752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:00.625754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:00.625757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:00.625760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:00.625763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:00.625765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:00.625768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:00.625772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:00.625774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:00.625778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:00.625780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:00.625783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:00.625786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.625789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.625792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.625795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.625798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.625801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.625804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:00.625809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:00.625812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:00.625815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:00.625839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:00.631129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:00.632376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:00.632388Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:00.632390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:00.632393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:00.632397Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 654 [2:7555895104013991524:5229]
2025-09-30T14:52:00.632409Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:00.632422Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:00.632425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:00.632430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:00.632431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:00.632444Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:00.632449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:00.632454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:00.632501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.632511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.632513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.632516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:00.632519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:00.632570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:00.632575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.632584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.632590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.632604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:00.632620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895104013991519:5229]
2025-09-30T14:52:00.632627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895104013991519:5229]
2025-09-30T14:52:00.632628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895104013991519:5229]
2025-09-30T14:52:00.632639Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:00.632649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895104103719667:6294], now have 1 active actors on pipe
2025-09-30T14:52:00.632652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:00.632656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:00.632658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895104103719453:2454], now have 1 active actors on pipe
2025-09-30T14:52:00.632658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:00.632665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:00.632679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:00.632682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:00.632713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895104013991519:5229]
2025-09-30T14:52:00.632723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:00.632734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:00.632740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 654
2025-09-30T14:52:00.632743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 654
2025-09-30T14:52:00.632817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:00.632826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:00.632848Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ee6f161-81f50b9d-b58c3ee2-a2c783c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:00.632859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:00.632863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:00.632869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:00.632879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:00.632887Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:00.632899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:00.633053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:00.633063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:00.633077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:00.633202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 655 partition: 0 MaxSeqNo: 42 sessionId: src_id|9ee6f161-81f50b9d-b58c3ee2-a2c783c5_0
2025-09-30T14:52:00.633545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48d5e2df-b374b3a7-3d4dbfae-1dbad29a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9ee6f161-81f50b9d-b58c3ee2-a2c783c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:00.636385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ee6f161-81f50b9d-b58c3ee2-a2c783c5_0] Write session: try to update token
2025-09-30T14:52:00.636407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ee6f161-81f50b9d-b58c3ee2-a2c783c5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:00.644283Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:00.644300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:00.644303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:00.644306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:00.644314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895104013991519:5229]
2025-09-30T14:52:00.644319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895104013991519:5229]
2025-09-30T14:52:00.644323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895104013991519:5229]
2025-09-30T14:52:00.644361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:00.644372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.644373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:00.644375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:00.644378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:00.644382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:00.644501Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:00.650291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 655 sessionId: src_id|9ee6f161-81f50b9d-b58c3ee2-a2c783c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:00.653233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:00.706740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895104103719694:5991]
2025-09-30T14:52:00.707004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 654, pipe: [1:7555895104103719694:5991]
2025-09-30T14:52:00.750772Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:00.751237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:00.751271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:00.751312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895104103719694:5991], now have 1 active actors on pipe
2025-09-30T14:52:00.751550Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:00.751561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:00.751605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:00.751622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895104103719694:5991]
2025-09-30T14:52:00.751694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 655 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9ee6f161-81f50b9d-b58c3ee2-a2c783c5_0
2025-09-30T14:52:00.751870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 655 sessionId: src_id|9ee6f161-81f50b9d-b58c3ee2-a2c783c5_0 is DEAD
2025-09-30T14:52:00.752014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ee6f161-81f50b9d-b58c3ee2-a2c783c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:00.752022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ee6f161-81f50b9d-b58c3ee2-a2c783c5_0] Write session will restart in 0.005052s
2025-09-30T14:52:00.752053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ee6f161-81f50b9d-b58c3ee2-a2c783c5_0] Write session: Do CDS request
2025-09-30T14:52:00.752058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ee6f161-81f50b9d-b58c3ee2-a2c783c5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:00.757780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ee6f161-81f50b9d-b58c3ee2-a2c783c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:00.757879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:00.757898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 656
2025-09-30T14:52:00.758039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 656 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:00.758072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 656 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:00.758083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=656 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:00.758087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:00.758469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 656 sessionId:  describe result for acl check
2025-09-30T14:52:00.758509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:00.758517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:00.758519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:00.758524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895104103719710:6298] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:00.759012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895104103719710:6298] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:00.761779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895104103719710:6298] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:00.765444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895104103719710:6298] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:00.765464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895104103719710:6298] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:00.765467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895104103719710:6298] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:00.765475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 656 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:00.767539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:00.770148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:00.770407Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:00.770416Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:00.770428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:00.770491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:00.770530Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895104013991759:5231]
2025-09-30T14:52:00.771204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:00.771473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:00.771515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:00.771854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:00.771913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:00.771919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:00.771920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:00.771921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:00.771923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:00.771924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:00.771925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:00.771926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:00.771928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:00.771929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:00.771930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.771932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.771933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.771934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:00.771935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:00.771940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:00.771951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:00.771955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:00.771959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:00.771963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:00.771968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:00.771972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:00.771976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:00.771980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:00.771985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:00.771989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.771998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.772002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.772010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:00.772014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:00.772025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:00.772033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:00.772044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:00.772054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:00.772063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:00.772072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:00.772081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:00.772086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:00.772095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:00.772100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:00.772109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:00.772115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:00.772124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:00.772130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:00.772139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:00.772144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:00.772149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:00.772155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:00.772159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:00.772165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:00.772170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.772179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.772184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.772194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.772203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.772209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.772214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:00.772220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:00.772231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:00.772240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:00.772288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:00.777636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:00.778896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:00.778910Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:00.778911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:00.778915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:00.778919Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 655 [2:7555895104013991759:5231]
2025-09-30T14:52:00.778932Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:00.778944Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:00.778946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:00.778948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:00.778950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:00.778963Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:00.778972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:00.778977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:00.779027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.779034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.779036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.779040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:00.779042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:00.779095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:00.779101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.779109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.779115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.779124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:00.779140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895104013991753:5231]
2025-09-30T14:52:00.779141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895104013991753:5231]
2025-09-30T14:52:00.779143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895104013991753:5231]
2025-09-30T14:52:00.779149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:00.779161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:00.779168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895104103719696:2454], now have 1 active actors on pipe
2025-09-30T14:52:00.779171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:00.779173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:00.779173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895104103719890:6298], now have 1 active actors on pipe
2025-09-30T14:52:00.779179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:00.779193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:00.779210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:00.779263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895104013991753:5231]
2025-09-30T14:52:00.779279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:00.779290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:00.779257Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 655
2025-09-30T14:52:00.779277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 655
2025-09-30T14:52:00.779316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:00.779325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:00.779351Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a722d36-90b82961-d5cd34f7-71fe3f71_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:00.779361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:00.779367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:00.779369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:00.779377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:00.779384Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:00.779394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:00.779539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:00.779546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:00.779558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:00.779631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 656 partition: 0 MaxSeqNo: 42 sessionId: src_id|4a722d36-90b82961-d5cd34f7-71fe3f71_0
2025-09-30T14:52:00.779974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ee6f161-81f50b9d-b58c3ee2-a2c783c5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4a722d36-90b82961-d5cd34f7-71fe3f71_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:00.782800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a722d36-90b82961-d5cd34f7-71fe3f71_0] Write session: try to update token
2025-09-30T14:52:00.782819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a722d36-90b82961-d5cd34f7-71fe3f71_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:00.791389Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:00.791404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:00.791406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:00.791408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:00.791416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895104013991753:5231]
2025-09-30T14:52:00.791419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895104013991753:5231]
2025-09-30T14:52:00.791424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895104013991753:5231]
2025-09-30T14:52:00.791457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:00.791463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.791465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:00.791468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:00.791475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:00.791479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:00.791586Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:00.797000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 656 sessionId: src_id|4a722d36-90b82961-d5cd34f7-71fe3f71_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:00.799723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:00.851727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895104103719938:5991]
2025-09-30T14:52:00.852034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 655, pipe: [1:7555895104103719938:5991]
2025-09-30T14:52:00.899219Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:00.899757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:00.899772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:00.899812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895104103719938:5991], now have 1 active actors on pipe
2025-09-30T14:52:00.900064Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:00.900109Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:00.900113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:00.900116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:00.900173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895104103719938:5991]
2025-09-30T14:52:00.900186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 656 reason: error at write: Disconnected sessionId: src_id|4a722d36-90b82961-d5cd34f7-71fe3f71_0
2025-09-30T14:52:00.900392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 656 sessionId: src_id|4a722d36-90b82961-d5cd34f7-71fe3f71_0 is DEAD
2025-09-30T14:52:00.900556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a722d36-90b82961-d5cd34f7-71fe3f71_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:00.900564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a722d36-90b82961-d5cd34f7-71fe3f71_0] Write session will restart in 0.007223s
2025-09-30T14:52:00.900587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a722d36-90b82961-d5cd34f7-71fe3f71_0] Write session: Do CDS request
2025-09-30T14:52:00.900596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a722d36-90b82961-d5cd34f7-71fe3f71_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:00.908738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a722d36-90b82961-d5cd34f7-71fe3f71_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:00.908845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:00.908870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 657
2025-09-30T14:52:00.908979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 657 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:00.909010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 657 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:00.909031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=657 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:00.909036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:00.909471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 657 sessionId:  describe result for acl check
2025-09-30T14:52:00.909506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:00.909508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:00.909511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:00.909518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895104103719970:6302] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:00.910054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895104103719970:6302] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:00.912431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895104103719970:6302] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:00.915708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895104103719970:6302] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:00.915724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895104103719970:6302] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:00.915727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895104103719970:6302] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:00.915735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 657 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:00.917577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:00.920484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:00.920709Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:00.920720Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:00.920731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:00.920785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:00.920827Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895104013992006:5234]
2025-09-30T14:52:00.921520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:00.921876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:00.921921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:00.922277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:00.922340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:00.922346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:00.922348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:00.922349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:00.922351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:00.922352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:00.922353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:00.922355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:00.922356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:00.922357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:00.922358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.922360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.922361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.922362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:00.922363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:00.922369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:00.922381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:00.922386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:00.922404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:00.922409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:00.922413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:00.922417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:00.922422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:00.922427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:00.922433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:00.922436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.922440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.922444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.922447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:00.922451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:00.922460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:00.922467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:00.922474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:00.922480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:00.922485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:00.922493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:00.922498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:00.922504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:00.922510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:00.922516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:00.922520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:00.922527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:00.922537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:00.922543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:00.922552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:00.922559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:00.922570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:00.922576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:00.922582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:00.922589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:00.922595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.922601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.922605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.922611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.922616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.922622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.922628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:00.922633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:00.922637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:00.922643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:00.922694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:00.928367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:00.929735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:00.929756Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:00.929758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:00.929762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:00.929770Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 656 [2:7555895104013992006:5234]
2025-09-30T14:52:00.929786Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:00.929802Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:00.929806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:00.929809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:00.929811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:00.929827Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:00.929834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:00.929848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:00.929912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.929926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.929928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.929932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:00.929935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:00.930006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:00.930014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.930030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:00.930048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:00.930154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 656
2025-09-30T14:52:00.930214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 656
2025-09-30T14:52:00.930073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:00.930100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895104103719939:2454], now have 1 active actors on pipe
2025-09-30T14:52:00.930104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895104103720170:6302], now have 1 active actors on pipe
2025-09-30T14:52:00.930110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895104013992001:5234]
2025-09-30T14:52:00.930112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895104013992001:5234]
2025-09-30T14:52:00.930115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895104013992001:5234]
2025-09-30T14:52:00.930129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:00.930143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:00.930153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:00.930158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:00.930159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:00.930160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:00.930163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:00.930196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895104013992001:5234]
2025-09-30T14:52:00.930199Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:00.930217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:00.930373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:00.930386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:00.930422Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f24389d-2035539d-234857eb-4af141ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:00.930437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:00.930442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:00.930445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:00.930457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:00.930473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:00.930494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:00.930716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:00.930730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:00.930753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:00.930827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 657 partition: 0 MaxSeqNo: 42 sessionId: src_id|5f24389d-2035539d-234857eb-4af141ef_0
2025-09-30T14:52:00.931201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a722d36-90b82961-d5cd34f7-71fe3f71_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5f24389d-2035539d-234857eb-4af141ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:00.934044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f24389d-2035539d-234857eb-4af141ef_0] Write session: try to update token
2025-09-30T14:52:00.934061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f24389d-2035539d-234857eb-4af141ef_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:00.942858Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:00.942886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:00.942889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:00.942891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:00.942903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895104013992001:5234]
2025-09-30T14:52:00.942910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895104013992001:5234]
2025-09-30T14:52:00.942916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895104013992001:5234]
2025-09-30T14:52:00.942967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:00.942972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:00.942978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:00.942980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:00.942981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:00.942983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:00.943212Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:00.948564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 657 sessionId: src_id|5f24389d-2035539d-234857eb-4af141ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:00.951637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:01.000135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895108398687502:5991]
2025-09-30T14:52:01.000364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 656, pipe: [1:7555895108398687502:5991]
2025-09-30T14:52:01.046825Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:01.047134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:01.047148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:01.047181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895108398687502:5991], now have 1 active actors on pipe
2025-09-30T14:52:01.047394Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:01.047408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:01.047416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:01.047420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:01.047468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895108398687502:5991]
2025-09-30T14:52:01.047489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 657 reason: error at write: Disconnected sessionId: src_id|5f24389d-2035539d-234857eb-4af141ef_0
2025-09-30T14:52:01.047658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 657 sessionId: src_id|5f24389d-2035539d-234857eb-4af141ef_0 is DEAD
2025-09-30T14:52:01.047857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f24389d-2035539d-234857eb-4af141ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:01.047869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f24389d-2035539d-234857eb-4af141ef_0] Write session will restart in 0.009213s
2025-09-30T14:52:01.047892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f24389d-2035539d-234857eb-4af141ef_0] Write session: Do CDS request
2025-09-30T14:52:01.047897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f24389d-2035539d-234857eb-4af141ef_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:01.058784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f24389d-2035539d-234857eb-4af141ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:01.058880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:01.058894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 658
2025-09-30T14:52:01.059072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 658 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:01.059106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 658 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:01.059112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=658 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:01.059115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:01.059629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 658 sessionId:  describe result for acl check
2025-09-30T14:52:01.059666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:01.059671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:01.059673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:01.059678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895108398687651:6309] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:01.060217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895108398687651:6309] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:01.062386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895108398687651:6309] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:01.062679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:01.065072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:01.065263Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:01.065274Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:01.065300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:01.065351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:01.065388Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895108308959539:5236]
2025-09-30T14:52:01.065374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895108398687651:6309] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:01.065390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895108398687651:6309] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:01.065394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895108398687651:6309] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:01.065403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 658 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:01.066052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:01.066286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:01.066323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:01.066641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:01.066697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:01.066703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:01.066705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:01.066706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:01.066707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:01.066708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:01.066709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:01.066710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:01.066712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:01.066713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:01.066715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.066716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.066717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.066718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:01.066719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:01.066724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:01.066735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:01.066739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:01.066743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:01.066747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:01.066752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:01.066756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:01.066760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:01.066764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:01.066768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:01.066772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.066776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.066781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.066785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:01.066789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:01.066802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:01.066809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:01.066819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:01.066825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:01.066835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:01.066843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:01.066852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:01.066857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:01.066866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:01.066876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:01.066884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:01.066889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:01.066896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:01.066902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:01.066910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:01.066915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:01.066924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:01.066930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:01.066937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:01.066943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:01.066951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.066957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.066965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.066971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.066975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.066981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.066985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:01.066991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:01.066995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:01.067000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:01.067045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:01.072436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:01.073751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:01.073766Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:01.073769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:01.073773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:01.073780Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 657 [2:7555895108308959539:5236]
2025-09-30T14:52:01.073796Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:01.073815Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:01.073822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:01.073826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:01.073828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:01.073843Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:01.073850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:01.073857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:01.073917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.073924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.073926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.073930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:01.073932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:01.073993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:01.074002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.074016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.074028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.074045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:01.074067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895108398687504:2454], now have 1 active actors on pipe
2025-09-30T14:52:01.074076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895108398687740:6309], now have 1 active actors on pipe
2025-09-30T14:52:01.074082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895108308959534:5236]
2025-09-30T14:52:01.074084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895108308959534:5236]
2025-09-30T14:52:01.074086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895108308959534:5236]
2025-09-30T14:52:01.074097Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:01.074107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:01.074109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:01.074111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:01.074114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:01.074128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:01.074131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:01.074167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895108308959534:5236]
2025-09-30T14:52:01.074179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:01.074166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 657
2025-09-30T14:52:01.074200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:01.074167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 657
2025-09-30T14:52:01.074242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:01.074251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:01.074276Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b91cfcc-92e1841a-4bbcb3cd-cb1ed622_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:01.074287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:01.074294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:01.074295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:01.074305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:01.074318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:01.074335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:01.074572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:01.074586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:01.074609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:01.074776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 658 partition: 0 MaxSeqNo: 42 sessionId: src_id|7b91cfcc-92e1841a-4bbcb3cd-cb1ed622_0
2025-09-30T14:52:01.075179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f24389d-2035539d-234857eb-4af141ef_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7b91cfcc-92e1841a-4bbcb3cd-cb1ed622_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:01.078005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b91cfcc-92e1841a-4bbcb3cd-cb1ed622_0] Write session: try to update token
2025-09-30T14:52:01.078025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b91cfcc-92e1841a-4bbcb3cd-cb1ed622_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:01.086160Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:01.086191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:01.086201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895108308959534:5236]
2025-09-30T14:52:01.086242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:01.086253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:01.086409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:01.086542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:01.086671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:01.086807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:01.087072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:01.087112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:01.093058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 658 sessionId: src_id|7b91cfcc-92e1841a-4bbcb3cd-cb1ed622_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:01.095719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:01.096506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:01.096526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:01.096544Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:01.096547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:01.096550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:01.096556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:01.096565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895108308959534:5236]
2025-09-30T14:52:01.096574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895108308959534:5236]
2025-09-30T14:52:01.096577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895108308959534:5236]
2025-09-30T14:52:01.096617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:01.096622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:01.096627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.096629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:01.096629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:01.096633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:01.096750Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:01.147577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895108398687761:5991]
2025-09-30T14:52:01.147891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 657, pipe: [1:7555895108398687761:5991]
2025-09-30T14:52:01.209275Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:01.209725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:01.209763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895108398687761:5991], now have 1 active actors on pipe
2025-09-30T14:52:01.209879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:01.209963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895108398687761:5991]
2025-09-30T14:52:01.210053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:01.222037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:01.222050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:01.222075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 658 reason: error at write: Disconnected sessionId: src_id|7b91cfcc-92e1841a-4bbcb3cd-cb1ed622_0
2025-09-30T14:52:01.222218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 658 sessionId: src_id|7b91cfcc-92e1841a-4bbcb3cd-cb1ed622_0 is DEAD
2025-09-30T14:52:01.222352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b91cfcc-92e1841a-4bbcb3cd-cb1ed622_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:01.222362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b91cfcc-92e1841a-4bbcb3cd-cb1ed622_0] Write session will restart in 0.008637s
2025-09-30T14:52:01.222379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b91cfcc-92e1841a-4bbcb3cd-cb1ed622_0] Write session: Do CDS request
2025-09-30T14:52:01.222384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b91cfcc-92e1841a-4bbcb3cd-cb1ed622_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:01.231525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:01.231775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b91cfcc-92e1841a-4bbcb3cd-cb1ed622_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:01.232156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:01.232172Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 659
2025-09-30T14:52:01.232293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 659 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:01.232328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 659 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:01.232340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=659 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:01.232346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:01.232798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 659 sessionId:  describe result for acl check
2025-09-30T14:52:01.232832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:01.232838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:01.232840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:01.232845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895108398687963:6313] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:01.233383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895108398687963:6313] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:01.234252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:01.234547Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:01.234559Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:01.234570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:01.234628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:01.234667Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895108308959779:5239]
2025-09-30T14:52:01.235357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:01.235623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:01.235667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:01.235798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895108398687963:6313] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:01.235997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:01.236058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:01.236065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:01.236066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:01.236067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:01.236069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:01.236070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:01.236071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:01.236072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:01.236073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:01.236075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:01.236076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.236078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.236079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.236081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:01.236082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:01.236088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:01.236100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:01.236104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:01.236109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:01.236113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:01.236118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:01.236122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:01.236126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:01.236131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:01.236135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:01.236140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.236146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.236150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.236155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:01.236159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:01.236165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:01.236173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:01.236184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:01.236190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:01.236200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:01.236206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:01.236215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:01.236221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:01.236232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:01.236237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:01.236246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:01.236251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:01.236260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:01.236266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:01.236271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:01.236276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:01.236287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:01.236293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:01.236297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:01.236303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:01.236308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.236314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.236323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.236329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.236335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.236340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.236344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:01.236353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:01.236362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:01.236372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:01.236422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:01.241541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895108398687963:6313] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:01.241556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895108398687963:6313] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:01.241560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895108398687963:6313] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:01.241569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 659 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:01.241845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:01.242768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:01.242778Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:01.242780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:01.242783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:01.242787Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 658 [2:7555895108308959779:5239]
2025-09-30T14:52:01.242799Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:01.242812Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:01.242814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:01.242816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:01.242817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:01.242831Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:01.242835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:01.242840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:01.242888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.242895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.242897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.242900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:01.242902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:01.243007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:01.243014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.243022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.243029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.243044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:01.243062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895108398687762:2454], now have 1 active actors on pipe
2025-09-30T14:52:01.243068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895108398688000:6313], now have 1 active actors on pipe
2025-09-30T14:52:01.243073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895108308959774:5239]
2025-09-30T14:52:01.243074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895108308959774:5239]
2025-09-30T14:52:01.243075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895108308959774:5239]
2025-09-30T14:52:01.243085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:01.243095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:01.243098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:01.243101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:01.243102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:01.243107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:01.243109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:01.243136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 658
2025-09-30T14:52:01.243134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895108308959774:5239]
2025-09-30T14:52:01.243138Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 658
2025-09-30T14:52:01.243142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:01.243151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:01.243172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:01.243176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:01.243194Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fbcc8180-d657c52d-1c5b3280-7f573375_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:01.243200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:01.243204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:01.243205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:01.243211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:01.243218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:01.243228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:01.243417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:01.243425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:01.243441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:01.243542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 659 partition: 0 MaxSeqNo: 42 sessionId: src_id|fbcc8180-d657c52d-1c5b3280-7f573375_0
2025-09-30T14:52:01.243909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b91cfcc-92e1841a-4bbcb3cd-cb1ed622_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fbcc8180-d657c52d-1c5b3280-7f573375_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:01.246726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbcc8180-d657c52d-1c5b3280-7f573375_0] Write session: try to update token
2025-09-30T14:52:01.246746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbcc8180-d657c52d-1c5b3280-7f573375_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:01.255322Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:01.255340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:01.255343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:01.255345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:01.255359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895108308959774:5239]
2025-09-30T14:52:01.255364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895108308959774:5239]
2025-09-30T14:52:01.255367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895108308959774:5239]
2025-09-30T14:52:01.255410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:01.255417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.255420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:01.255421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:01.255428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:01.255432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:01.255566Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:01.261729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 659 sessionId: src_id|fbcc8180-d657c52d-1c5b3280-7f573375_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:01.264477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:01.309891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895108398688009:5991]
2025-09-30T14:52:01.310156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 658, pipe: [1:7555895108398688009:5991]
2025-09-30T14:52:01.360251Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:01.360582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:01.360602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:01.360638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895108398688009:5991], now have 1 active actors on pipe
2025-09-30T14:52:01.360840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:01.360841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895108398688009:5991]
2025-09-30T14:52:01.360861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:01.360863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:01.360871Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:01.360922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 659 reason: error at write: Disconnected sessionId: src_id|fbcc8180-d657c52d-1c5b3280-7f573375_0
2025-09-30T14:52:01.361091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 659 sessionId: src_id|fbcc8180-d657c52d-1c5b3280-7f573375_0 is DEAD
2025-09-30T14:52:01.361221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbcc8180-d657c52d-1c5b3280-7f573375_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:01.361232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbcc8180-d657c52d-1c5b3280-7f573375_0] Write session will restart in 0.005551s
2025-09-30T14:52:01.361263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbcc8180-d657c52d-1c5b3280-7f573375_0] Write session: Do CDS request
2025-09-30T14:52:01.361269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbcc8180-d657c52d-1c5b3280-7f573375_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:01.367692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbcc8180-d657c52d-1c5b3280-7f573375_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:01.367812Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:01.367823Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 660
2025-09-30T14:52:01.367935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 660 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:01.367960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 660 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:01.367969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=660 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:01.367973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:01.368313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 660 sessionId:  describe result for acl check
2025-09-30T14:52:01.368338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:01.368343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:01.368347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:01.368351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895108398688033:6317] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:01.368748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895108398688033:6317] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:01.371111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895108398688033:6317] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:01.373665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895108398688033:6317] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:01.373679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895108398688033:6317] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:01.373683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895108398688033:6317] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:01.373690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 660 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:01.376263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:01.378808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:01.379099Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:01.379110Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:01.379121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:01.379179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:01.379219Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895108308960018:5241]
2025-09-30T14:52:01.379844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:01.380171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:01.380218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:01.380569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:01.380628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:01.380634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:01.380636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:01.380637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:01.380638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:01.380639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:01.380641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:01.380642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:01.380643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:01.380645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:01.380646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.380648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.380649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.380650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:01.380652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:01.380657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:01.380667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:01.380673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:01.380678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:01.380681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:01.380686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:01.380691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:01.380695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:01.380700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:01.380706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:01.380710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.380715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.380719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.380724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:01.380728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:01.380735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:01.380744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:01.380750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:01.380756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:01.380761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:01.380767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:01.380773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:01.380778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:01.380786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:01.380792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:01.380798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:01.380804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:01.380809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:01.380815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:01.380820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:01.380826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:01.380832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:01.380837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:01.380849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:01.380855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:01.380860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.380867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.380871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.380877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.380881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.380885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.380889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:01.380893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:01.380897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:01.380901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:01.380940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:01.386213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:01.387395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:01.387410Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:01.387412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:01.387415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:01.387422Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 659 [2:7555895108308960018:5241]
2025-09-30T14:52:01.387440Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:01.387455Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:01.387460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:01.387463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:01.387465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:01.387478Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:01.387489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:01.387497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:01.387556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.387563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.387565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.387568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:01.387570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:01.387634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:01.387641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.387655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.387666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.387685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:01.387707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895108398688010:2454], now have 1 active actors on pipe
2025-09-30T14:52:01.387717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895108308960013:5241]
2025-09-30T14:52:01.387719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895108308960013:5241]
2025-09-30T14:52:01.387720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895108308960013:5241]
2025-09-30T14:52:01.387730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:01.387743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895108398688203:6317], now have 1 active actors on pipe
2025-09-30T14:52:01.387746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:01.387749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:01.387751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:01.387754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:01.387767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:01.387771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:01.387800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895108308960013:5241]
2025-09-30T14:52:01.387816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:01.387810Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 659
2025-09-30T14:52:01.387855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 659
2025-09-30T14:52:01.387857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:01.387971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:01.387984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:01.388006Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|deefc36-d7950b1d-99318235-fd21baba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:01.388017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:01.388021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:01.388023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:01.388033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:01.388048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:01.388066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:01.388254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:01.388263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:01.388277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:01.388367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 660 partition: 0 MaxSeqNo: 42 sessionId: src_id|deefc36-d7950b1d-99318235-fd21baba_0
2025-09-30T14:52:01.388724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbcc8180-d657c52d-1c5b3280-7f573375_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|deefc36-d7950b1d-99318235-fd21baba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:01.391329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|deefc36-d7950b1d-99318235-fd21baba_0] Write session: try to update token
2025-09-30T14:52:01.391344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|deefc36-d7950b1d-99318235-fd21baba_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:01.399555Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:01.399571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:01.399578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895108308960013:5241]
2025-09-30T14:52:01.399613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:01.399631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:01.399783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:01.399953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:01.400082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:01.400215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:01.400466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:01.400505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:01.405216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 660 sessionId: src_id|deefc36-d7950b1d-99318235-fd21baba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:01.407714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:01.407938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:01.407957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:01.407986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:01.408095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:01.410008Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:01.410027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:01.410028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:01.410030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:01.410037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895108308960013:5241]
2025-09-30T14:52:01.410039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895108308960013:5241]
2025-09-30T14:52:01.410041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895108308960013:5241]
2025-09-30T14:52:01.410070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:01.410075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.410078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:01.410082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:01.410087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:01.410091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:01.410216Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:01.460909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895108398688270:5991]
2025-09-30T14:52:01.461169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 659, pipe: [1:7555895108398688270:5991]
2025-09-30T14:52:01.520426Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:01.528878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:01.528904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:01.529068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:01.529129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:01.529195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:01.529272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:01.529321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:01.529336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:01.529405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:01.529472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:01.529545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:01.529609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:01.529650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:01.529657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:01.529729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:01.529799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:01.529863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:01.529925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:01.529967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:01.529974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:01.530036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:01.530372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:01.530456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:01.530523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:01.530568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:01.530575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:01.530639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:01.530703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:01.530780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:01.530852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:01.530896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:01.530902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:01.530972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:01.531034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:01.531094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:01.531156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:01.531328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:01.531336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:01.531400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:01.531462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:01.531523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:01.531592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:01.531644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:01.531650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:01.531714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:01.531770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:01.531839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:01.531907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:01.531951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:01.531957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:01.532025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:01.532118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:01.532189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:01.532251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:01.532293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:01.532300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:01.532365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:01.532423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:01.532496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:01.532570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:01.532618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:01.532625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:01.532703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895108398688270:5991], now have 1 active actors on pipe
2025-09-30T14:52:01.533033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895108398688270:5991]
2025-09-30T14:52:01.533061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:01.533068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:01.533071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:01.533101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 660 reason: error at write: Disconnected sessionId: src_id|deefc36-d7950b1d-99318235-fd21baba_0
2025-09-30T14:52:01.533297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 660 sessionId: src_id|deefc36-d7950b1d-99318235-fd21baba_0 is DEAD
2025-09-30T14:52:01.533473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deefc36-d7950b1d-99318235-fd21baba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:01.533487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deefc36-d7950b1d-99318235-fd21baba_0] Write session will restart in 0.007425s
2025-09-30T14:52:01.533512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deefc36-d7950b1d-99318235-fd21baba_0] Write session: Do CDS request
2025-09-30T14:52:01.533519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deefc36-d7950b1d-99318235-fd21baba_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:01.533554Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:01.541841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|deefc36-d7950b1d-99318235-fd21baba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:01.541909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:01.541929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 661
2025-09-30T14:52:01.542257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 661 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:01.542307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 661 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:01.542318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=661 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:01.542322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:01.542731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 661 sessionId:  describe result for acl check
2025-09-30T14:52:01.542758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:01.542763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:01.542765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:01.542769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895108398688308:6329] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:01.543339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895108398688308:6329] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:01.545849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895108398688308:6329] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:01.549459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895108398688308:6329] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:01.549475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895108398688308:6329] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:01.549478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895108398688308:6329] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:01.549487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 661 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:01.553050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:01.555616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:01.555842Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:01.555852Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:01.555863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:01.555914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:01.555953Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895108308960297:5256]
2025-09-30T14:52:01.556601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:01.556893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:01.556953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:01.557312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:01.557375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:01.557384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:01.557385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:01.557386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:01.557387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:01.557389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:01.557390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:01.557391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:01.557393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:01.557394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:01.557395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.557396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.557398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.557399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:01.557400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:01.557406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:01.557415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:01.557419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:01.557422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:01.557426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:01.557430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:01.557433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:01.557438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:01.557443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:01.557447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:01.557451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.557455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.557459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.557464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:01.557468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:01.557475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:01.557483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:01.557490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:01.557501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:01.557510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:01.557520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:01.557525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:01.557531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:01.557536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:01.557546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:01.557555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:01.557562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:01.557568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:01.557581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:01.557586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:01.557591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:01.557596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:01.557601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:01.557606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:01.557612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:01.557617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.557624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.557628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.557634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.557638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.557643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.557648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:01.557654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:01.557660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:01.557666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:01.557715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:01.563438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:01.564559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:01.564572Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:01.564574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:01.564577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:01.564582Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 660 [2:7555895108308960297:5256]
2025-09-30T14:52:01.564595Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:01.564608Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:01.564610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:01.564612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:01.564614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:01.564627Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:01.564636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:01.564642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:01.564690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.564698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.564700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.564702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:01.564704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:01.564753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:01.564759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.564767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.564778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.564787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:01.564803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895108308960292:5256]
2025-09-30T14:52:01.564808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895108308960292:5256]
2025-09-30T14:52:01.564810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895108308960292:5256]
2025-09-30T14:52:01.564818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:01.564829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:01.564834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:01.564838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:01.564838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:01.564840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:01.564840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:01.564847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895108398688470:6329], now have 1 active actors on pipe
2025-09-30T14:52:01.564850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895108398688285:2454], now have 1 active actors on pipe
2025-09-30T14:52:01.564877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895108308960292:5256]
2025-09-30T14:52:01.564883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:01.564892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:01.564959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 660
2025-09-30T14:52:01.564963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 660
2025-09-30T14:52:01.565034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:01.565043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:01.565063Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b57994c0-5b5e5569-a4f59c8d-29d8e34e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:01.565072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:01.565075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:01.565078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:01.565087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:01.565102Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:01.565117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:01.565286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:01.565294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:01.565307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:01.565405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 661 partition: 0 MaxSeqNo: 42 sessionId: src_id|b57994c0-5b5e5569-a4f59c8d-29d8e34e_0
2025-09-30T14:52:01.565808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deefc36-d7950b1d-99318235-fd21baba_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b57994c0-5b5e5569-a4f59c8d-29d8e34e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:01.568644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b57994c0-5b5e5569-a4f59c8d-29d8e34e_0] Write session: try to update token
2025-09-30T14:52:01.568662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b57994c0-5b5e5569-a4f59c8d-29d8e34e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:01.577313Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:01.577337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:01.577348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895108308960292:5256]
2025-09-30T14:52:01.577394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:01.577393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:01.577578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:01.577720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:01.577869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:01.578017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:01.578233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:01.578277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:01.583374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 661 sessionId: src_id|b57994c0-5b5e5569-a4f59c8d-29d8e34e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:01.586118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:01.586310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:01.586335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:01.586368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:01.586456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:01.588205Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:01.588220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:01.588222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:01.588224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:01.588233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895108308960292:5256]
2025-09-30T14:52:01.588236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895108308960292:5256]
2025-09-30T14:52:01.588239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895108308960292:5256]
2025-09-30T14:52:01.588269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:01.588278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.588279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:01.588289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:01.588305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:01.588310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:01.588409Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:01.632970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895108398688530:5991]
2025-09-30T14:52:01.633207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 660, pipe: [1:7555895108398688530:5991]
2025-09-30T14:52:01.694231Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:01.701671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:01.701698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:01.701857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:01.701916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:01.701977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:01.702044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:01.702090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:01.702105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:01.702173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:01.702231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:01.702292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:01.702368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:01.702428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:01.702436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:01.702503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:01.702566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:01.702636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:01.702709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:01.702754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:01.702763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:01.702824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:01.702892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:01.702955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:01.703019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:01.703067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:01.703075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:01.703142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:01.703203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:01.703288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:01.703354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:01.703401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:01.703408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:01.703479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:01.703538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:01.703599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:01.703666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:01.703708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:01.703714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:01.703810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:01.703869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:01.703939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:01.704004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:01.704054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:01.704061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:01.704131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:01.704190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:01.704250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:01.704308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:01.704364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:01.704372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:01.704441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:01.704496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:01.704552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:01.704608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:01.704653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:01.704661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:01.704722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:01.704777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:01.704834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:01.704894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:01.704943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:01.704950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:01.705006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895108398688530:5991], now have 1 active actors on pipe
2025-09-30T14:52:01.705263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:01.705265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895108398688530:5991]
2025-09-30T14:52:01.705274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:01.705302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 661 reason: error at write: Disconnected sessionId: src_id|b57994c0-5b5e5569-a4f59c8d-29d8e34e_0
2025-09-30T14:52:01.705507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:01.705928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 661 sessionId: src_id|b57994c0-5b5e5569-a4f59c8d-29d8e34e_0 is DEAD
2025-09-30T14:52:01.705948Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:01.706051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b57994c0-5b5e5569-a4f59c8d-29d8e34e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:01.706060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b57994c0-5b5e5569-a4f59c8d-29d8e34e_0] Write session will restart in 0.005825s
2025-09-30T14:52:01.706082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b57994c0-5b5e5569-a4f59c8d-29d8e34e_0] Write session: Do CDS request
2025-09-30T14:52:01.706088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b57994c0-5b5e5569-a4f59c8d-29d8e34e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:01.712747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b57994c0-5b5e5569-a4f59c8d-29d8e34e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:01.712792Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:01.712806Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 662
2025-09-30T14:52:01.712961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 662 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:01.713008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 662 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:01.713018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=662 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:01.713022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:01.713475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 662 sessionId:  describe result for acl check
2025-09-30T14:52:01.713510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:01.713514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:01.713515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:01.713521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895108398688546:6333] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:01.714032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895108398688546:6333] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:01.717246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895108398688546:6333] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:01.720347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895108398688546:6333] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:01.720362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895108398688546:6333] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:01.720365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895108398688546:6333] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:01.720374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 662 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:01.722627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:01.725412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:01.725692Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:01.725703Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:01.725714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:01.725770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:01.725815Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895108308960538:5258]
2025-09-30T14:52:01.726505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:01.726825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:01.726869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:01.727212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:01.727288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:01.727294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:01.727296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:01.727297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:01.727298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:01.727299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:01.727301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:01.727302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:01.727303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:01.727304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:01.727306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.727307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.727308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.727309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:01.727310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:01.727316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:01.727328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:01.727332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:01.727337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:01.727341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:01.727345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:01.727349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:01.727354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:01.727358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:01.727362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:01.727367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.727371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.727375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.727379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:01.727383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:01.727390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:01.727398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:01.727405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:01.727411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:01.727415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:01.727421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:01.727425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:01.727430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:01.727440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:01.727450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:01.727455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:01.727464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:01.727473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:01.727478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:01.727487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:01.727493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:01.727498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:01.727508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:01.727513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:01.727518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:01.727528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.727537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.727545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.727551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.727560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.727570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.727580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:01.727586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:01.727595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:01.727600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:01.727646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:01.733117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:01.734345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:01.734358Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:01.734360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:01.734363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:01.734368Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 661 [2:7555895108308960538:5258]
2025-09-30T14:52:01.734380Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:01.734405Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:01.734409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:01.734412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:01.734414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:01.734430Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:01.734442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:01.734451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:01.734504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.734510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.734512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.734515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:01.734517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:01.734567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:01.734572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.734581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.734587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.734601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:01.734616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895108398688739:6333], now have 1 active actors on pipe
2025-09-30T14:52:01.734622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895108398688532:2454], now have 1 active actors on pipe
2025-09-30T14:52:01.734628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895108308960533:5258]
2025-09-30T14:52:01.734630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895108308960533:5258]
2025-09-30T14:52:01.734633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895108308960533:5258]
2025-09-30T14:52:01.734646Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:01.734657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:01.734663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:01.734665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:01.734666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:01.734677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:01.734680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:01.734710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895108308960533:5258]
2025-09-30T14:52:01.734722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:01.734723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:01.734702Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 661
2025-09-30T14:52:01.734827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 661
2025-09-30T14:52:01.734895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:01.734906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:01.734932Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14eafa2b-424ad501-dcdc703b-bcb6b7a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:01.734944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:01.734948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:01.734950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:01.734960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:01.734974Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:01.734992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:01.735132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:01.735142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:01.735155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:01.735224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 662 partition: 0 MaxSeqNo: 42 sessionId: src_id|14eafa2b-424ad501-dcdc703b-bcb6b7a6_0
2025-09-30T14:52:01.735600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b57994c0-5b5e5569-a4f59c8d-29d8e34e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|14eafa2b-424ad501-dcdc703b-bcb6b7a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:01.738474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14eafa2b-424ad501-dcdc703b-bcb6b7a6_0] Write session: try to update token
2025-09-30T14:52:01.738498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14eafa2b-424ad501-dcdc703b-bcb6b7a6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:01.746849Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:01.746868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:01.746878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895108308960533:5258]
2025-09-30T14:52:01.746918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:01.746922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:01.747087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:01.747280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:01.747442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:01.747600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:01.747787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:01.747830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:01.753141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 662 sessionId: src_id|14eafa2b-424ad501-dcdc703b-bcb6b7a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:01.755698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:01.755907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:01.755933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:01.755972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:01.756053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:01.757554Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:01.757576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:01.757579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:01.757581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:01.757591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895108308960533:5258]
2025-09-30T14:52:01.757595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895108308960533:5258]
2025-09-30T14:52:01.757599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895108308960533:5258]
2025-09-30T14:52:01.757639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:01.757646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.757649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:01.757649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:01.757655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:01.757658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:01.757795Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:01.805519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895108398688784:5991]
2025-09-30T14:52:01.805775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 661, pipe: [1:7555895108398688784:5991]
2025-09-30T14:52:01.867988Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:01.875130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:01.875155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:01.875331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:01.875391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:01.875450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:01.875509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:01.875553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:01.875563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:01.875636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:01.875697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:01.875758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:01.875818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:01.875971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:01.875978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:01.876041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:01.876096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:01.876154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:01.876211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:01.876251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:01.876260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:01.876323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:01.876385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:01.876447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:01.876505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:01.876545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:01.876551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:01.876612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:01.876679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:01.876747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:01.876808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:01.876849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:01.876855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:01.876930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:01.876986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:01.877044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:01.877103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:01.877146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:01.877152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:01.877213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:01.877272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:01.877334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:01.877398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:01.877440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:01.877445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:01.877507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:01.877566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:01.877626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:01.877688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:01.877733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:01.877747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:01.877820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:01.877880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:01.877939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:01.877998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:01.878102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:01.878108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:01.878172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:01.878228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:01.878289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:01.878347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:01.878403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:01.878410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:01.878469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895108398688784:5991], now have 1 active actors on pipe
2025-09-30T14:52:01.878737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:01.878751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:01.878779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 662 reason: error at write: Disconnected sessionId: src_id|14eafa2b-424ad501-dcdc703b-bcb6b7a6_0
2025-09-30T14:52:01.879016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 662 sessionId: src_id|14eafa2b-424ad501-dcdc703b-bcb6b7a6_0 is DEAD
2025-09-30T14:52:01.879182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14eafa2b-424ad501-dcdc703b-bcb6b7a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:01.879194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14eafa2b-424ad501-dcdc703b-bcb6b7a6_0] Write session will restart in 0.007306s
2025-09-30T14:52:01.879219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14eafa2b-424ad501-dcdc703b-bcb6b7a6_0] Write session: Do CDS request
2025-09-30T14:52:01.879224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14eafa2b-424ad501-dcdc703b-bcb6b7a6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:01.879214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:01.879221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895108398688784:5991]
2025-09-30T14:52:01.879530Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:01.887755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14eafa2b-424ad501-dcdc703b-bcb6b7a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:01.887908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:01.887936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 663
2025-09-30T14:52:01.888060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 663 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:01.888092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 663 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:01.888102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=663 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:01.888110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:01.888505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 663 sessionId:  describe result for acl check
2025-09-30T14:52:01.888538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:01.888544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:01.888546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:01.888552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895108398688831:6337] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:01.889333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895108398688831:6337] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:01.891493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895108398688831:6337] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:01.894318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895108398688831:6337] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:01.894331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895108398688831:6337] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:01.894335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895108398688831:6337] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:01.894343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 663 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:01.895961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:01.898151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:01.898347Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:01.898357Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:01.898367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:01.898440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:01.898480Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895108308960793:5260]
2025-09-30T14:52:01.899120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:01.899430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:01.899481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:01.899830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:01.899891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:01.899897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:01.899898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:01.899899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:01.899900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:01.899901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:01.899903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:01.899904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:01.899905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:01.899906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:01.899907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.899909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.899910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.899911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:01.899912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:01.899919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:01.899930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:01.899935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:01.899940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:01.899944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:01.899949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:01.899957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:01.899961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:01.899970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:01.899974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:01.899983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.899993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.899997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.900006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:01.900010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:01.900022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:01.900035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:01.900046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:01.900055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:01.900064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:01.900073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:01.900078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:01.900084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:01.900089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:01.900094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:01.900103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:01.900113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:01.900122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:01.900132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:01.900141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:01.900146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:01.900155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:01.900163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:01.900172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:01.900180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:01.900189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.900199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.900208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.900218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.900229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.900238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.900247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:01.900254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:01.900263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:01.900271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:01.900321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:01.905517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:01.906614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:01.906628Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:01.906631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:01.906634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:01.906641Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 662 [2:7555895108308960793:5260]
2025-09-30T14:52:01.906656Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:01.906671Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:01.906678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:01.906681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:01.906684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:01.906699Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:01.906706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:01.906713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:01.906772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.906779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.906782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.906785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:01.906788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:01.906849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:01.906856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.906869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:01.906883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:01.906906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:01.906929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895108398689022:6337], now have 1 active actors on pipe
2025-09-30T14:52:01.906937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895108398688786:2454], now have 1 active actors on pipe
2025-09-30T14:52:01.906944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895108308960788:5260]
2025-09-30T14:52:01.906950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895108308960788:5260]
2025-09-30T14:52:01.906953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895108308960788:5260]
2025-09-30T14:52:01.906966Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:01.906983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:01.906990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:01.906994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:01.906995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:01.906998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:01.907001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:01.906967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 662
2025-09-30T14:52:01.906970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 662
2025-09-30T14:52:01.907038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:01.907047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:01.907062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895108308960788:5260]
2025-09-30T14:52:01.907074Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:01.907083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:01.907103Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94fba809-de9b9c88-3ac1a24-4aa7371_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:01.907114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:01.907119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:01.907122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:01.907130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:01.907143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:01.907167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:01.907342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:01.907350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:01.907364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:01.907451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 663 partition: 0 MaxSeqNo: 42 sessionId: src_id|94fba809-de9b9c88-3ac1a24-4aa7371_0
2025-09-30T14:52:01.907807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14eafa2b-424ad501-dcdc703b-bcb6b7a6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|94fba809-de9b9c88-3ac1a24-4aa7371_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:01.910556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94fba809-de9b9c88-3ac1a24-4aa7371_0] Write session: try to update token
2025-09-30T14:52:01.910587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94fba809-de9b9c88-3ac1a24-4aa7371_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:01.919357Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:01.919378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:01.919380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:01.919382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:01.919392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895108308960788:5260]
2025-09-30T14:52:01.919398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895108308960788:5260]
2025-09-30T14:52:01.919402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895108308960788:5260]
2025-09-30T14:52:01.919448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:01.919453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:01.919461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:01.919461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:01.919464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:01.919466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:01.919615Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:01.925637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 663 sessionId: src_id|94fba809-de9b9c88-3ac1a24-4aa7371_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:01.928726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:01.979583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895108398689049:5991]
2025-09-30T14:52:01.979922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 662, pipe: [1:7555895108398689049:5991]
2025-09-30T14:52:02.031015Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:02.031600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:02.031614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:02.031631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895108398689049:5991], now have 1 active actors on pipe
2025-09-30T14:52:02.031805Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:02.031860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:02.031872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:02.031880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895108398689049:5991]
2025-09-30T14:52:02.031903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:02.031937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 663 reason: error at write: Disconnected sessionId: src_id|94fba809-de9b9c88-3ac1a24-4aa7371_0
2025-09-30T14:52:02.032121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 663 sessionId: src_id|94fba809-de9b9c88-3ac1a24-4aa7371_0 is DEAD
2025-09-30T14:52:02.032277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94fba809-de9b9c88-3ac1a24-4aa7371_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:02.032288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94fba809-de9b9c88-3ac1a24-4aa7371_0] Write session will restart in 0.009044s
2025-09-30T14:52:02.032311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94fba809-de9b9c88-3ac1a24-4aa7371_0] Write session: Do CDS request
2025-09-30T14:52:02.032319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94fba809-de9b9c88-3ac1a24-4aa7371_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:02.042834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94fba809-de9b9c88-3ac1a24-4aa7371_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:02.042947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:02.042961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 664
2025-09-30T14:52:02.043104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 664 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:02.043147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 664 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:02.043152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=664 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:02.043166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:02.043734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 664 sessionId:  describe result for acl check
2025-09-30T14:52:02.043767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:02.043770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:02.043771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:02.043777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895112693656432:6344] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:02.044312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895112693656432:6344] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:02.047058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895112693656432:6344] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:02.049974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895112693656432:6344] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:02.049992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895112693656432:6344] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:02.049996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895112693656432:6344] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:02.050006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 664 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:02.050079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:02.052829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:02.053030Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:02.053040Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:02.053048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:02.053092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:02.053123Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895112603928331:5263]
2025-09-30T14:52:02.053780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:02.054136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:02.054181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:02.054539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:02.054605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:02.054611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:02.054612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:02.054614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:02.054615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:02.054616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:02.054618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:02.054619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:02.054620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:02.054621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:02.054622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.054623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.054624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.054626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:02.054627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:02.054632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:02.054643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:02.054647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:02.054651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:02.054655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:02.054659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:02.054662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:02.054666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:02.054669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:02.054673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:02.054678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.054682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.054686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.054690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:02.054694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:02.054702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:02.054710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:02.054716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:02.054722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:02.054727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:02.054732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:02.054736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:02.054742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:02.054747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:02.054752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:02.054756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:02.054761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:02.054765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:02.054771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:02.054775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:02.054780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:02.054785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:02.054791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:02.054797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:02.054803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:02.054807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.054818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.054822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.054828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.054838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.054842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.054847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:02.054851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:02.054856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:02.054865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:02.054906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:02.062024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:02.062864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:02.062878Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:02.062880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:02.062884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:02.062890Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 663 [2:7555895112603928331:5263]
2025-09-30T14:52:02.062903Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:02.062916Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:02.062918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:02.062921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:02.062922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:02.062937Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:02.062943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:02.062950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:02.063009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.063016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.063018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.063020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:02.063023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:02.063074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:02.063080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.063089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.063095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.063104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:02.063117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895112603928325:5263]
2025-09-30T14:52:02.063123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895112603928325:5263]
2025-09-30T14:52:02.063125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895112603928325:5263]
2025-09-30T14:52:02.063134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:02.063145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:02.063144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:02.063148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:02.063150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:02.063154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:02.063156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:02.063164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895112693656591:6344], now have 1 active actors on pipe
2025-09-30T14:52:02.063167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895112693656353:2454], now have 1 active actors on pipe
2025-09-30T14:52:02.063193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895112603928325:5263]
2025-09-30T14:52:02.063204Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:02.063269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 663
2025-09-30T14:52:02.063237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:02.063273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 663
2025-09-30T14:52:02.063374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:02.063384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:02.063409Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef4a9427-fe921954-ae988fa7-83f663c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:02.063416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:02.063420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:02.063422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:02.063433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:02.063442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:02.063464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:02.063632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:02.063646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:02.063665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:02.063776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 664 partition: 0 MaxSeqNo: 42 sessionId: src_id|ef4a9427-fe921954-ae988fa7-83f663c4_0
2025-09-30T14:52:02.064166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94fba809-de9b9c88-3ac1a24-4aa7371_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ef4a9427-fe921954-ae988fa7-83f663c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:02.067087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef4a9427-fe921954-ae988fa7-83f663c4_0] Write session: try to update token
2025-09-30T14:52:02.067108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef4a9427-fe921954-ae988fa7-83f663c4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:02.075669Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:02.075697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:02.075711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895112603928325:5263]
2025-09-30T14:52:02.075758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:02.075779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:02.075947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:02.076137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:02.076296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:02.076444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:02.076731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:02.076782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:02.081490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 664 sessionId: src_id|ef4a9427-fe921954-ae988fa7-83f663c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:02.084341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:02.084540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:02.084564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:02.084598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:02.084688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:02.086321Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:02.086345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:02.086347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:02.086350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:02.086359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895112603928325:5263]
2025-09-30T14:52:02.086364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895112603928325:5263]
2025-09-30T14:52:02.086368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895112603928325:5263]
2025-09-30T14:52:02.086418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:02.086429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:02.086430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.086433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:02.086434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:02.086437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:02.086576Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:02.132163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895112693656607:5991]
2025-09-30T14:52:02.132470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 663, pipe: [1:7555895112693656607:5991]
2025-09-30T14:52:02.199660Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:02.208594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:02.208622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:02.208783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.208861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.208928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.208996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.209044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.209053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.209126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.209192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.209259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.209327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.209370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.209378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.209449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.209510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.209575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.209641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.209685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.209692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.209766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.209830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.209897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.209961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.210005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.210012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.210081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.210146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.210216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.210279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.210335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.210342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.210422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.210488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.210559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.210628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.210678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.210686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.210755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.210821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.210891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.210957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.211003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.211010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.211078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.211140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.211205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.211293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.211340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.211348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.211422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.211489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.211558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.211629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.211682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.211693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.211765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.211827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.211900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.211972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.212032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.212039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.212102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895112693656607:5991], now have 1 active actors on pipe
2025-09-30T14:52:02.212397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895112693656607:5991]
2025-09-30T14:52:02.212434Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:02.212437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:02.212442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:02.212479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 664 reason: error at write: Disconnected sessionId: src_id|ef4a9427-fe921954-ae988fa7-83f663c4_0
2025-09-30T14:52:02.212703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 664 sessionId: src_id|ef4a9427-fe921954-ae988fa7-83f663c4_0 is DEAD
2025-09-30T14:52:02.212832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef4a9427-fe921954-ae988fa7-83f663c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:02.212845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef4a9427-fe921954-ae988fa7-83f663c4_0] Write session will restart in 0.007529s
2025-09-30T14:52:02.212873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef4a9427-fe921954-ae988fa7-83f663c4_0] Write session: Do CDS request
2025-09-30T14:52:02.212879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef4a9427-fe921954-ae988fa7-83f663c4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:02.213431Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:02.221831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef4a9427-fe921954-ae988fa7-83f663c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:02.221914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:02.221929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 665
2025-09-30T14:52:02.222225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 665 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:02.222258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 665 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:02.222262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=665 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:02.222266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:02.222749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 665 sessionId:  describe result for acl check
2025-09-30T14:52:02.222789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:02.222792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:02.222794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:02.222803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895112693656652:6348] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:02.223349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895112693656652:6348] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:02.226498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895112693656652:6348] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:02.229791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895112693656652:6348] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:02.229812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895112693656652:6348] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:02.229816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895112693656652:6348] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:02.229825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 665 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:02.233474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:02.234177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:02.234407Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:02.234417Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:02.234430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:02.234496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:02.234538Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895112603928578:5266]
2025-09-30T14:52:02.235180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:02.235592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:02.235652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:02.236018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:02.236117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:02.236125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:02.236126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:02.236127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:02.236128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:02.236129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:02.236130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:02.236132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:02.236133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:02.236134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:02.236135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.236136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.236137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.236138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:02.236140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:02.236146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:02.236156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:02.236160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:02.236164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:02.236167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:02.236172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:02.236176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:02.236195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:02.236199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:02.236203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:02.236206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.236210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.236214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.236218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:02.236221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:02.236231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:02.236240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:02.236246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:02.236252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:02.236257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:02.236268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:02.236274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:02.236280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:02.236285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:02.236292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:02.236301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:02.236307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:02.236312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:02.236323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:02.236327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:02.236332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:02.236337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:02.236345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:02.236350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:02.236356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:02.236361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.236371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.236376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.236381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.236386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.236397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.236402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:02.236416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:02.236426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:02.236431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:02.236477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:02.242168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:02.243078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:02.243100Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:02.243103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:02.243107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:02.243115Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 664 [2:7555895112603928578:5266]
2025-09-30T14:52:02.243134Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:02.243150Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:02.243153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:02.243156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:02.243158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:02.243176Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:02.243184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:02.243190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:02.243275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.243283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.243285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.243288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:02.243291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:02.243359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:02.243366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.243379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.243396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.243418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:02.243440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895112693656847:6348], now have 1 active actors on pipe
2025-09-30T14:52:02.243450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895112693656608:2454], now have 1 active actors on pipe
2025-09-30T14:52:02.243457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895112603928573:5266]
2025-09-30T14:52:02.243459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895112603928573:5266]
2025-09-30T14:52:02.243461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895112603928573:5266]
2025-09-30T14:52:02.243473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:02.243489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:02.243488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:02.243492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:02.243494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:02.243502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:02.243505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:02.243532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895112603928573:5266]
2025-09-30T14:52:02.243538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:02.243547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:02.243566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:02.243526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 664
2025-09-30T14:52:02.243575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:02.243531Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 664
2025-09-30T14:52:02.243608Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77ff94a9-4f4542a2-9170ac53-1a0301c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:02.243620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:02.243624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:02.243626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:02.243636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:02.243647Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:02.243663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:02.243897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:02.243916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:02.243942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:02.244054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 665 partition: 0 MaxSeqNo: 42 sessionId: src_id|77ff94a9-4f4542a2-9170ac53-1a0301c1_0
2025-09-30T14:52:02.244414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef4a9427-fe921954-ae988fa7-83f663c4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|77ff94a9-4f4542a2-9170ac53-1a0301c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:02.247210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77ff94a9-4f4542a2-9170ac53-1a0301c1_0] Write session: try to update token
2025-09-30T14:52:02.247232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77ff94a9-4f4542a2-9170ac53-1a0301c1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:02.255975Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:02.255994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:02.256004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895112603928573:5266]
2025-09-30T14:52:02.256049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:02.256061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:02.256228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:02.256387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:02.256548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:02.256703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:02.256914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:02.256970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:02.261951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 665 sessionId: src_id|77ff94a9-4f4542a2-9170ac53-1a0301c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:02.264855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:02.265108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:02.265134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:02.265177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:02.265253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:02.266846Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:02.266862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:02.266864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:02.266865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:02.266873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895112603928573:5266]
2025-09-30T14:52:02.266877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895112603928573:5266]
2025-09-30T14:52:02.266880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895112603928573:5266]
2025-09-30T14:52:02.266913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:02.266919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.266921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:02.266937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:02.266944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:02.266949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:02.267053Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:02.312411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895112693656861:5991]
2025-09-30T14:52:02.312687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 664, pipe: [1:7555895112693656861:5991]
2025-09-30T14:52:02.378210Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:02.386685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:02.386712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:02.386900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.386977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.387046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.387116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.387165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.387176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.387276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.387342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.387407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.387476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.387527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.387535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.387608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.387675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.387745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.387812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.387858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.387866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.387936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.388008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.388074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.388144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.388194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.388198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.388267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.388334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.388407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.388476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.388525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.388536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.388613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.388679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.388747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.388819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.388868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.388877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.388948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.389010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.389084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.389151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.389203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.389211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.389281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.389345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.389411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.389478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.389545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.389553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.389623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.389686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.389750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.389822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.389869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.389876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.389944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.390007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.390078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.390145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.390295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.390305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.390377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895112693656861:5991], now have 1 active actors on pipe
2025-09-30T14:52:02.390737Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:02.390789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:02.390788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895112693656861:5991]
2025-09-30T14:52:02.390800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:02.390828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 665 reason: error at write: Disconnected sessionId: src_id|77ff94a9-4f4542a2-9170ac53-1a0301c1_0
2025-09-30T14:52:02.391025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 665 sessionId: src_id|77ff94a9-4f4542a2-9170ac53-1a0301c1_0 is DEAD
2025-09-30T14:52:02.391183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77ff94a9-4f4542a2-9170ac53-1a0301c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:02.391194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77ff94a9-4f4542a2-9170ac53-1a0301c1_0] Write session will restart in 0.008297s
2025-09-30T14:52:02.391218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77ff94a9-4f4542a2-9170ac53-1a0301c1_0] Write session: Do CDS request
2025-09-30T14:52:02.391224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77ff94a9-4f4542a2-9170ac53-1a0301c1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:02.391631Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:02.400718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77ff94a9-4f4542a2-9170ac53-1a0301c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:02.400829Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:02.400845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 666
2025-09-30T14:52:02.400973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 666 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:02.401007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 666 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:02.401019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=666 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:02.401025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:02.401523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 666 sessionId:  describe result for acl check
2025-09-30T14:52:02.401560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:02.401567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:02.401569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:02.401575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895112693656908:6352] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:02.402153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895112693656908:6352] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:02.405352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895112693656908:6352] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:02.408395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895112693656908:6352] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:02.408411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895112693656908:6352] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:02.408415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895112693656908:6352] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:02.408423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 666 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:02.409402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:02.411948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:02.412160Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:02.412170Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:02.412181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:02.412242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:02.412286Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895112603928823:5268]
2025-09-30T14:52:02.412945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:02.413314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:02.413376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:02.413709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:02.413794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:02.413802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:02.413803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:02.413804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:02.413805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:02.413807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:02.413808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:02.413809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:02.413810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:02.413811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:02.413813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.413814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.413815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.413816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:02.413817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:02.413823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:02.413832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:02.413836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:02.413840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:02.413843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:02.413847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:02.413851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:02.413854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:02.413858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:02.413862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:02.413866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.413870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.413874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.413877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:02.413881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:02.413892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:02.413901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:02.413907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:02.413912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:02.413917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:02.413922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:02.413933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:02.413941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:02.413950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:02.413955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:02.413961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:02.413966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:02.413971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:02.413975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:02.413979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:02.413984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:02.413993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:02.413998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:02.414002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:02.414007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:02.414012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.414021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.414026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.414037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.414041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.414050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.414054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:02.414064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:02.414068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:02.414077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:02.414118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:02.419994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:02.420978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:02.421003Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:02.421007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:02.421012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:02.421020Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 665 [2:7555895112603928823:5268]
2025-09-30T14:52:02.421039Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:02.421063Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:02.421076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:02.421079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:02.421081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:02.421099Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:02.421107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:02.421114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:02.421183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.421189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.421192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.421196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:02.421198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:02.421269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:02.421281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.421294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.421304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.421321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:02.421346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895112693656862:2454], now have 1 active actors on pipe
2025-09-30T14:52:02.421354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895112693657102:6352], now have 1 active actors on pipe
2025-09-30T14:52:02.421361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895112603928818:5268]
2025-09-30T14:52:02.421363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895112603928818:5268]
2025-09-30T14:52:02.421366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895112603928818:5268]
2025-09-30T14:52:02.421380Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:02.421395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:02.421395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:02.421398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:02.421400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:02.421415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:02.421418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:02.421463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895112603928818:5268]
2025-09-30T14:52:02.421473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:02.421455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 665
2025-09-30T14:52:02.421473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 665
2025-09-30T14:52:02.421519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:02.421539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:02.421544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:02.421576Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36015cbd-2d663357-237d913d-92927a1c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:02.421588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:02.421592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:02.421595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:02.421605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:02.421620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:02.421640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:02.421848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:02.421861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:02.421883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:02.422047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 666 partition: 0 MaxSeqNo: 42 sessionId: src_id|36015cbd-2d663357-237d913d-92927a1c_0
2025-09-30T14:52:02.422416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77ff94a9-4f4542a2-9170ac53-1a0301c1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|36015cbd-2d663357-237d913d-92927a1c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:02.425187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36015cbd-2d663357-237d913d-92927a1c_0] Write session: try to update token
2025-09-30T14:52:02.425205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36015cbd-2d663357-237d913d-92927a1c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:02.434338Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:02.434363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:02.434374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895112603928818:5268]
2025-09-30T14:52:02.434436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:02.434444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:02.434706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:02.434917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:02.435074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:02.435239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:02.435483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:02.435540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:02.440109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 666 sessionId: src_id|36015cbd-2d663357-237d913d-92927a1c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:02.442715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:02.442936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:02.442961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:02.443009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:02.443106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:02.445264Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:02.445286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:02.445289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:02.445291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:02.445302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895112603928818:5268]
2025-09-30T14:52:02.445306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895112603928818:5268]
2025-09-30T14:52:02.445312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895112603928818:5268]
2025-09-30T14:52:02.445351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:02.445357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:02.445361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.445363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:02.445365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:02.445368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:02.445508Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:02.491069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895112693657118:5991]
2025-09-30T14:52:02.491309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 665, pipe: [1:7555895112693657118:5991]
2025-09-30T14:52:02.561251Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:02.570286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:02.570328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:02.570547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.570629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.570709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.570786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.570842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.570854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.570940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.571019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.571098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.571185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.571237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.571268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.571363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.571439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.571515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.571592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.571645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.571654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.571733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.571814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.571892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.571971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.572027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.572035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.572116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.572193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.572274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.572370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.572420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.572428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.572507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.572584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.572659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.572732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.572784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.572792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.572872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.572941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.573014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.573090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.573138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.573149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.573230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.573309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.573388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.573462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.573511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.573518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.573593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.573666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.573748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.573830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.573882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.573890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.573968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.574040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.574119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.574200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.574253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.574261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.574337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895112693657118:5991], now have 1 active actors on pipe
2025-09-30T14:52:02.574618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:02.574650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895112693657118:5991]
2025-09-30T14:52:02.574672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:02.574675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:02.574699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 666 reason: error at write: Disconnected sessionId: src_id|36015cbd-2d663357-237d913d-92927a1c_0
2025-09-30T14:52:02.574879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 666 sessionId: src_id|36015cbd-2d663357-237d913d-92927a1c_0 is DEAD
2025-09-30T14:52:02.575013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36015cbd-2d663357-237d913d-92927a1c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:02.575025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36015cbd-2d663357-237d913d-92927a1c_0] Write session will restart in 0.008824s
2025-09-30T14:52:02.575050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36015cbd-2d663357-237d913d-92927a1c_0] Write session: Do CDS request
2025-09-30T14:52:02.575057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36015cbd-2d663357-237d913d-92927a1c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:02.575884Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:02.584823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36015cbd-2d663357-237d913d-92927a1c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:02.584968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:02.584987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 667
2025-09-30T14:52:02.585611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 667 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:02.585648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 667 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:02.585670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=667 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:02.585674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:02.586260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 667 sessionId:  describe result for acl check
2025-09-30T14:52:02.586295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:02.586302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:02.586303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:02.586311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895112693657198:6364] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:02.586885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895112693657198:6364] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:02.589729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895112693657198:6364] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:02.593634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895112693657198:6364] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:02.593650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895112693657198:6364] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:02.593654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:02.593653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895112693657198:6364] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:02.593663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 667 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:02.596949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:02.597196Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:02.597206Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:02.597218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:02.597280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:02.597322Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895112603929107:5283]
2025-09-30T14:52:02.598013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:02.598373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:02.598462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:02.598845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:02.598923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:02.598930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:02.598932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:02.598933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:02.598934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:02.598936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:02.598937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:02.598938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:02.598939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:02.598941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:02.598942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.598943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.598944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.598946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:02.598948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:02.598954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:02.598965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:02.598969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:02.598973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:02.598978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:02.598982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:02.598986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:02.598991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:02.598995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:02.598999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:02.599004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.599007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.599011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.599016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:02.599020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:02.599027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:02.599041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:02.599051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:02.599061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:02.599071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:02.599090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:02.599099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:02.599104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:02.599114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:02.599124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:02.599133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:02.599138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:02.599143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:02.599148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:02.599157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:02.599162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:02.599173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:02.599178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:02.599183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:02.599189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:02.599193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.599199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.599204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.599209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.599214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.599220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.599224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:02.599230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:02.599235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:02.599241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:02.599307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:02.605010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:02.605893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:02.605908Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:02.605911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:02.605916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:02.605924Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 666 [2:7555895112603929107:5283]
2025-09-30T14:52:02.605941Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:02.605959Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:02.605962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:02.605966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:02.605980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:02.606005Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:02.606012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:02.606028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:02.606091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.606099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.606101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.606105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:02.606108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:02.606174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:02.606182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.606195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.606207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.606230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:02.606256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895112693657381:6364], now have 1 active actors on pipe
2025-09-30T14:52:02.606265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895112693657144:2454], now have 1 active actors on pipe
2025-09-30T14:52:02.606271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895112603929101:5283]
2025-09-30T14:52:02.606274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895112603929101:5283]
2025-09-30T14:52:02.606276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895112603929101:5283]
2025-09-30T14:52:02.606289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:02.606302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:02.606303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:02.606307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:02.606318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:02.606319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:02.606326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:02.606372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895112603929101:5283]
2025-09-30T14:52:02.606395Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:02.606367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 666
2025-09-30T14:52:02.606370Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 666
2025-09-30T14:52:02.606427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:02.606463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:02.606473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:02.606497Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0e3956f-81baf7-59897274-a9515c89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:02.606504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:02.606508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:02.606510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:02.606520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:02.606529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:02.606543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:02.606688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:02.606697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:02.606710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:02.606793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 667 partition: 0 MaxSeqNo: 42 sessionId: src_id|a0e3956f-81baf7-59897274-a9515c89_0
2025-09-30T14:52:02.607195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36015cbd-2d663357-237d913d-92927a1c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a0e3956f-81baf7-59897274-a9515c89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:02.610107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e3956f-81baf7-59897274-a9515c89_0] Write session: try to update token
2025-09-30T14:52:02.610127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e3956f-81baf7-59897274-a9515c89_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:02.618810Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:02.618834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:02.618844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895112603929101:5283]
2025-09-30T14:52:02.618894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:02.618899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:02.619098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:02.619279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:02.619436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:02.619593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:02.619798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:02.619843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:02.625549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 667 sessionId: src_id|a0e3956f-81baf7-59897274-a9515c89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:02.628560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:02.628723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:02.628744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:02.629938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:02.629972Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:02.629975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:02.629977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:02.629979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:02.629988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895112603929101:5283]
2025-09-30T14:52:02.629992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895112603929101:5283]
2025-09-30T14:52:02.629996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895112603929101:5283]
2025-09-30T14:52:02.630022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:02.630029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:02.630037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.630039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:02.630047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:02.630051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:02.630070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:02.630208Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:02.674888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895112693657395:5991]
2025-09-30T14:52:02.675216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 666, pipe: [1:7555895112693657395:5991]
2025-09-30T14:52:02.736109Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:02.744344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:02.744372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:02.744542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.744615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.744688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.744761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.744808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.744820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.744899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.744967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.745035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.745108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.745158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.745168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.745240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.745300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.745363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.745429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.745473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.745480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.745546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.745617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.745685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.745752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.745799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.745805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.745871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.745939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.746012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.746080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.746130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.746138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.746218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.746280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.746339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.746418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.746464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.746472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.746535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.746591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.746656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.746725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.746772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.746778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.746840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.746903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.746966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.747029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.747078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.747086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.747160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.747225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.747308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.747372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.747418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.747426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.747496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:02.747558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:02.747622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:02.747688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:02.747737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:02.747746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:02.747800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895112693657395:5991], now have 1 active actors on pipe
2025-09-30T14:52:02.748071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:02.748139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895112693657395:5991]
2025-09-30T14:52:02.748326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:02.748336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:02.748361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 667 reason: error at write: Disconnected sessionId: src_id|a0e3956f-81baf7-59897274-a9515c89_0
2025-09-30T14:52:02.748531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 667 sessionId: src_id|a0e3956f-81baf7-59897274-a9515c89_0 is DEAD
2025-09-30T14:52:02.748701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e3956f-81baf7-59897274-a9515c89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:02.748714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e3956f-81baf7-59897274-a9515c89_0] Write session will restart in 0.008342s
2025-09-30T14:52:02.748749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e3956f-81baf7-59897274-a9515c89_0] Write session: Do CDS request
2025-09-30T14:52:02.748756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e3956f-81baf7-59897274-a9515c89_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:02.748904Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:02.758772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e3956f-81baf7-59897274-a9515c89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:02.758891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:02.758906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 668
2025-09-30T14:52:02.759126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 668 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:02.759161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 668 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:02.759168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=668 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:02.759172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:02.759617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 668 sessionId:  describe result for acl check
2025-09-30T14:52:02.759655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:02.759658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:02.759660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:02.759667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895112693657455:6368] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:02.760214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895112693657455:6368] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:02.763532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895112693657455:6368] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:02.766393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:02.766583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895112693657455:6368] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:02.766596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895112693657455:6368] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:02.766600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895112693657455:6368] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:02.766607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 668 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:02.769535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:02.769762Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:02.769770Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:02.769778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:02.769821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:02.769874Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895112603929354:5285]
2025-09-30T14:52:02.770527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:02.770837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:02.770879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:02.771187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:02.771267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:02.771277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:02.771278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:02.771279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:02.771280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:02.771281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:02.771282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:02.771283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:02.771285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:02.771286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:02.771287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.771288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.771289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.771290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:02.771291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:02.771297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:02.771308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:02.771313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:02.771318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:02.771322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:02.771326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:02.771330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:02.771334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:02.771338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:02.771342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:02.771345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.771349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.771353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.771358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:02.771362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:02.771373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:02.771380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:02.771385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:02.771391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:02.771396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:02.771402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:02.771406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:02.771412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:02.771417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:02.771422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:02.771427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:02.771432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:02.771437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:02.771442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:02.771447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:02.771452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:02.771457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:02.771462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:02.771467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:02.771473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:02.771483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.771488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.771490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.771494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.771496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.771499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.771502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:02.771505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:02.771509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:02.771514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:02.771563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:02.777229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:02.778119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:02.778139Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:02.778142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:02.778146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:02.778154Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 667 [2:7555895112603929354:5285]
2025-09-30T14:52:02.778172Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:02.778188Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:02.778191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:02.778195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:02.778197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:02.778214Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:02.778225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:02.778232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:02.778297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.778305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.778307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.778311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:02.778314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:02.778397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:02.778404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.778417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.778433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.778454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:02.778478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895112693657397:2454], now have 1 active actors on pipe
2025-09-30T14:52:02.778487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895112693657639:6368], now have 1 active actors on pipe
2025-09-30T14:52:02.778494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895112603929348:5285]
2025-09-30T14:52:02.778496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895112603929348:5285]
2025-09-30T14:52:02.778498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895112603929348:5285]
2025-09-30T14:52:02.778513Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:02.778530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:02.778535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:02.778539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:02.778541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:02.778550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:02.778554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:02.778590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895112603929348:5285]
2025-09-30T14:52:02.778600Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:02.778625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:02.778595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 667
2025-09-30T14:52:02.778665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 667
2025-09-30T14:52:02.778771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:02.778788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:02.778817Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|847e0cfb-1194f1b4-5200b2ab-fa014ee3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:02.778831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:02.778840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:02.778843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:02.778853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:02.778870Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:02.778892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:02.779141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:02.779152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:02.779174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:02.779295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 668 partition: 0 MaxSeqNo: 42 sessionId: src_id|847e0cfb-1194f1b4-5200b2ab-fa014ee3_0
2025-09-30T14:52:02.779683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e3956f-81baf7-59897274-a9515c89_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|847e0cfb-1194f1b4-5200b2ab-fa014ee3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:02.782600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|847e0cfb-1194f1b4-5200b2ab-fa014ee3_0] Write session: try to update token
2025-09-30T14:52:02.782619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|847e0cfb-1194f1b4-5200b2ab-fa014ee3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:02.790963Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:02.790982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:02.790992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895112603929348:5285]
2025-09-30T14:52:02.791038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:02.791041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:02.791211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:02.791388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:02.791553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:02.791695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:02.791904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:02.791950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:02.798159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 668 sessionId: src_id|847e0cfb-1194f1b4-5200b2ab-fa014ee3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:02.800994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:02.801894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:02.801921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:02.801941Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:02.801944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:02.801945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:02.801947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:02.801955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895112603929348:5285]
2025-09-30T14:52:02.801959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895112603929348:5285]
2025-09-30T14:52:02.801962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895112603929348:5285]
2025-09-30T14:52:02.802008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:02.802014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:02.802019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.802020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:02.802022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:02.802023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:02.802162Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:02.848462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895112693657652:5991]
2025-09-30T14:52:02.848754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 667, pipe: [1:7555895112693657652:5991]
2025-09-30T14:52:02.916222Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:02.916465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:02.916501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895112693657652:5991], now have 1 active actors on pipe
2025-09-30T14:52:02.916625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:02.916658Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:02.916720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895112693657652:5991]
2025-09-30T14:52:02.928833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:02.928846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:02.928870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 668 reason: error at write: Disconnected sessionId: src_id|847e0cfb-1194f1b4-5200b2ab-fa014ee3_0
2025-09-30T14:52:02.929007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 668 sessionId: src_id|847e0cfb-1194f1b4-5200b2ab-fa014ee3_0 is DEAD
2025-09-30T14:52:02.929121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|847e0cfb-1194f1b4-5200b2ab-fa014ee3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:02.929134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|847e0cfb-1194f1b4-5200b2ab-fa014ee3_0] Write session will restart in 0.007046s
2025-09-30T14:52:02.929157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|847e0cfb-1194f1b4-5200b2ab-fa014ee3_0] Write session: Do CDS request
2025-09-30T14:52:02.929162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|847e0cfb-1194f1b4-5200b2ab-fa014ee3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:02.937801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|847e0cfb-1194f1b4-5200b2ab-fa014ee3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:02.937894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:02.937914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 669
2025-09-30T14:52:02.938041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 669 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:02.938073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 669 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:02.938077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=669 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:02.938081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:02.938501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 669 sessionId:  describe result for acl check
2025-09-30T14:52:02.938530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:02.938532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:02.938535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:02.938539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895112693657771:6373] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:02.938940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895112693657771:6373] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:02.940913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895112693657771:6373] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:02.943277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:02.943359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895112693657771:6373] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:02.943373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895112693657771:6373] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:02.943377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895112693657771:6373] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:02.943384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 669 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:02.946201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:02.946426Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:02.946436Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:02.946447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:02.946501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:02.946548Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895112603929615:5288]
2025-09-30T14:52:02.947214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:02.947621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:02.947668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:02.948013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:02.948073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:02.948079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:02.948080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:02.948081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:02.948083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:02.948084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:02.948085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:02.948087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:02.948088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:02.948089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:02.948090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.948092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.948093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.948094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:02.948095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:02.948102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:02.948112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:02.948117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:02.948121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:02.948126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:02.948130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:02.948134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:02.948138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:02.948143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:02.948147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:02.948151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.948155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.948159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.948164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:02.948168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:02.948175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:02.948183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:02.948189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:02.948195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:02.948200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:02.948207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:02.948214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:02.948220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:02.948230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:02.948236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:02.948241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:02.948247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:02.948256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:02.948261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:02.948266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:02.948276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:02.948281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:02.948287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:02.948296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:02.948302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:02.948311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.948317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.948322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.948330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.948335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.948344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.948349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:02.948354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:02.948364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:02.948370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:02.948430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:02.954070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:02.954972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:02.954989Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:02.954992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:02.954996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:02.955004Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 668 [2:7555895112603929615:5288]
2025-09-30T14:52:02.955023Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:02.955040Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:02.955045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:02.955048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:02.955051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:02.955067Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:02.955079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:02.955092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:02.955151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.955156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.955158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.955162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:02.955164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:02.955225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:02.955231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.955259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:02.955279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:02.955297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:02.955314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895112603929609:5288]
2025-09-30T14:52:02.955322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895112603929609:5288]
2025-09-30T14:52:02.955324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895112603929609:5288]
2025-09-30T14:52:02.955333Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:02.955348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895112693657908:6373], now have 1 active actors on pipe
2025-09-30T14:52:02.955350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:02.955354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:02.955356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:02.955357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895112693657653:2454], now have 1 active actors on pipe
2025-09-30T14:52:02.955365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:02.955379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:02.955382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:02.955421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895112603929609:5288]
2025-09-30T14:52:02.955430Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:02.955413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 668
2025-09-30T14:52:02.955456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:02.955560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 668
2025-09-30T14:52:02.955612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:02.955623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:02.955649Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44aa89ce-5e512fc0-ae707837-5abf2f03_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:02.955663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:02.955672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:02.955674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:02.955685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:02.955698Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:02.955716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:02.956075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:02.956089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:02.956113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:02.956236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 669 partition: 0 MaxSeqNo: 42 sessionId: src_id|44aa89ce-5e512fc0-ae707837-5abf2f03_0
2025-09-30T14:52:02.956657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|847e0cfb-1194f1b4-5200b2ab-fa014ee3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|44aa89ce-5e512fc0-ae707837-5abf2f03_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:02.959469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44aa89ce-5e512fc0-ae707837-5abf2f03_0] Write session: try to update token
2025-09-30T14:52:02.959492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44aa89ce-5e512fc0-ae707837-5abf2f03_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:02.967342Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:02.967367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:02.967376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895112603929609:5288]
2025-09-30T14:52:02.967422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:02.967448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:02.967614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:02.967775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:02.967944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:02.968110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:02.968330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:02.968383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:02.973430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 669 sessionId: src_id|44aa89ce-5e512fc0-ae707837-5abf2f03_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:02.976136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:02.976351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:02.976379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:02.976418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:02.976500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:02.977771Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:02.977794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:02.977796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:02.977798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:02.977809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895112603929609:5288]
2025-09-30T14:52:02.977813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895112603929609:5288]
2025-09-30T14:52:02.977817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895112603929609:5288]
2025-09-30T14:52:02.977860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:02.977874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:02.977877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:02.977895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:02.977902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:02.977907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:02.978026Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:03.016897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895116988625227:5991]
2025-09-30T14:52:03.017167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 668, pipe: [1:7555895116988625227:5991]
2025-09-30T14:52:03.089867Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:03.098089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:03.098122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:03.098298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:03.098367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:03.098446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:03.098517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:03.098567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:03.098580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:03.098653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:03.098726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:03.098792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:03.098867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:03.098912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:03.098920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:03.098991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:03.099051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:03.099121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:03.099191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:03.099256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:03.099270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:03.099342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:03.099411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:03.099480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:03.099547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:03.099593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:03.099601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:03.099670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:03.099735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:03.099800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:03.099865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:03.099910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:03.099920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:03.099992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:03.100058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:03.100124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:03.100192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:03.100240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:03.100249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:03.100319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:03.100381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:03.100450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:03.100518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:03.100563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:03.100570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:03.100639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:03.100705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:03.100780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:03.100845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:03.100900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:03.100908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:03.100976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:03.101042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:03.101102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:03.101167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:03.101215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:03.101222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:03.101293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:03.101357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:03.101424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:03.101491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:03.101541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:03.101551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:03.101619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895116988625227:5991], now have 1 active actors on pipe
2025-09-30T14:52:03.101903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:03.101925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:03.101930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:03.101960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895116988625227:5991]
2025-09-30T14:52:03.101963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 669 reason: error at write: Disconnected sessionId: src_id|44aa89ce-5e512fc0-ae707837-5abf2f03_0
2025-09-30T14:52:03.102163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 669 sessionId: src_id|44aa89ce-5e512fc0-ae707837-5abf2f03_0 is DEAD
2025-09-30T14:52:03.102398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44aa89ce-5e512fc0-ae707837-5abf2f03_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:03.102410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44aa89ce-5e512fc0-ae707837-5abf2f03_0] Write session will restart in 0.005948s
2025-09-30T14:52:03.102434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44aa89ce-5e512fc0-ae707837-5abf2f03_0] Write session: Do CDS request
2025-09-30T14:52:03.102439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44aa89ce-5e512fc0-ae707837-5abf2f03_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:03.103013Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:03.109704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44aa89ce-5e512fc0-ae707837-5abf2f03_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:03.109832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:03.109846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 670
2025-09-30T14:52:03.109956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 670 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:03.109980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 670 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:03.109987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=670 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:03.109991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:03.110430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 670 sessionId:  describe result for acl check
2025-09-30T14:52:03.110469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:03.110475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:03.110477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:03.110483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895116988625249:6381] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:03.110962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895116988625249:6381] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:03.114153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895116988625249:6381] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:03.117318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895116988625249:6381] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:03.117335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895116988625249:6381] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:03.117339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895116988625249:6381] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:03.117347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 670 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:03.120655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:03.123684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:03.123871Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:03.123879Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:03.123887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:03.123938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:03.123973Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895116898897162:5291]
2025-09-30T14:52:03.124509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:03.124848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:03.124900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:03.125161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:03.125209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:03.125214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:03.125215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:03.125216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:03.125227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:03.125228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:03.125229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:03.125230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:03.125231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:03.125232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:03.125232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.125233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.125234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.125235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:03.125236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:03.125240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:03.125247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:03.125249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:03.125252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:03.125257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:03.125261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:03.125265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:03.125269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:03.125274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:03.125278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:03.125287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.125289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.125291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.125294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:03.125296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:03.125303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:03.125313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:03.125317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:03.125321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:03.125325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:03.125328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:03.125332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:03.125336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:03.125339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:03.125346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:03.125349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:03.125352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:03.125360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:03.125363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:03.125366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:03.125369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:03.125373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:03.125376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:03.125378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:03.125382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:03.125384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.125388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.125390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.125394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.125397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.125400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.125408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:03.125411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:03.125414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:03.125417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:03.125445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:03.130997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:03.131893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:03.131911Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:03.131913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:03.131916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:03.131922Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 669 [2:7555895116898897162:5291]
2025-09-30T14:52:03.131936Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:03.131955Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:03.131958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:03.131960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:03.131966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:03.131980Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:03.131986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:03.131998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:03.132059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.132064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.132066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.132069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:03.132071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:03.132128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:03.132136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.132148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.132161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.132174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:03.132186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895116898897157:5291]
2025-09-30T14:52:03.132197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895116898897157:5291]
2025-09-30T14:52:03.132199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895116898897157:5291]
2025-09-30T14:52:03.132206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:03.132217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:03.132227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:03.132230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:03.132248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:03.132260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895116898897157:5291]
2025-09-30T14:52:03.132262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:03.132262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:03.132264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:03.132269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895116988625420:6381], now have 1 active actors on pipe
2025-09-30T14:52:03.132271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:03.132281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895116988625234:2454], now have 1 active actors on pipe
2025-09-30T14:52:03.132371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 669
2025-09-30T14:52:03.132380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 669
2025-09-30T14:52:03.132434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:03.132442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:03.132464Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|713e895d-e5d6a8de-db0864bd-635e1d3d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:03.132474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:03.132477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:03.132478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:03.132486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:03.132497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:03.132513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:03.132708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:03.132714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:03.132725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:03.132842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 670 partition: 0 MaxSeqNo: 42 sessionId: src_id|713e895d-e5d6a8de-db0864bd-635e1d3d_0
2025-09-30T14:52:03.133223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44aa89ce-5e512fc0-ae707837-5abf2f03_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|713e895d-e5d6a8de-db0864bd-635e1d3d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:03.136242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|713e895d-e5d6a8de-db0864bd-635e1d3d_0] Write session: try to update token
2025-09-30T14:52:03.136267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|713e895d-e5d6a8de-db0864bd-635e1d3d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:03.144797Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:03.144818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:03.144828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895116898897157:5291]
2025-09-30T14:52:03.144874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:03.144880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:03.145063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:03.145218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:03.145373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:03.145520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:03.145789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:03.145834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:03.151319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 670 sessionId: src_id|713e895d-e5d6a8de-db0864bd-635e1d3d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:03.154116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:03.154323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:03.154347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:03.154397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:03.154481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:03.155811Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:03.155831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:03.155832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:03.155834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:03.155843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895116898897157:5291]
2025-09-30T14:52:03.155847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895116898897157:5291]
2025-09-30T14:52:03.155850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895116898897157:5291]
2025-09-30T14:52:03.155881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:03.155886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.155886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:03.155888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:03.155891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:03.155901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:03.156018Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:03.202244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895116988625492:5991]
2025-09-30T14:52:03.202586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 669, pipe: [1:7555895116988625492:5991]
2025-09-30T14:52:03.260555Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:03.268778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:03.268810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:03.268986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:03.269051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:03.269119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:03.269198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:03.269247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:03.269255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:03.269325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:03.269394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:03.269472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:03.269545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:03.269593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:03.269599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:03.269668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:03.269734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:03.269800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:03.269877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:03.269922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:03.269928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:03.270012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:03.270078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:03.270146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:03.270217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:03.270262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:03.270268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:03.270342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:03.270431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:03.270509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:03.270582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:03.270628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:03.270636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:03.270716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:03.270787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:03.270856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:03.270930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:03.270982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:03.270988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:03.271054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:03.271118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:03.271185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:03.271272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:03.271317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:03.271323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:03.271390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:03.271459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:03.271527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:03.271599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:03.271650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:03.271656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:03.271730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:03.271796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:03.271858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:03.271928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:03.272001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:03.272009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:03.272075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:03.272137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:03.272201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:03.272273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:03.272320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:03.272328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:03.272386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895116988625492:5991], now have 1 active actors on pipe
2025-09-30T14:52:03.272551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:03.272552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:03.272565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:03.272598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 670 reason: error at write: Disconnected sessionId: src_id|713e895d-e5d6a8de-db0864bd-635e1d3d_0
2025-09-30T14:52:03.272599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895116988625492:5991]
2025-09-30T14:52:03.272783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 670 sessionId: src_id|713e895d-e5d6a8de-db0864bd-635e1d3d_0 is DEAD
2025-09-30T14:52:03.272913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|713e895d-e5d6a8de-db0864bd-635e1d3d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:03.272923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|713e895d-e5d6a8de-db0864bd-635e1d3d_0] Write session will restart in 0.005592s
2025-09-30T14:52:03.272944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|713e895d-e5d6a8de-db0864bd-635e1d3d_0] Write session: Do CDS request
2025-09-30T14:52:03.272952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|713e895d-e5d6a8de-db0864bd-635e1d3d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:03.273518Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:03.279850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|713e895d-e5d6a8de-db0864bd-635e1d3d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:03.279961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:03.279976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 671
2025-09-30T14:52:03.280118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 671 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:03.280149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 671 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:03.280161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=671 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:03.280165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:03.280701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 671 sessionId:  describe result for acl check
2025-09-30T14:52:03.280753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:03.280762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:03.280765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:03.280775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895116988625508:6385] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:03.281429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895116988625508:6385] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:03.284991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895116988625508:6385] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:03.288491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895116988625508:6385] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:03.288510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895116988625508:6385] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:03.288514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895116988625508:6385] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:03.288525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 671 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:03.292401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:03.295123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:03.295355Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:03.295361Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:03.295369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:03.295421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:03.295457Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895116898897412:5293]
2025-09-30T14:52:03.296015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:03.296279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:03.296319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:03.296580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:03.296629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:03.296635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:03.296636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:03.296637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:03.296639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:03.296640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:03.296642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:03.296643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:03.296644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:03.296645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:03.296646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.296647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.296648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.296650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:03.296651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:03.296656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:03.296665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:03.296670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:03.296675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:03.296679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:03.296683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:03.296687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:03.296691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:03.296696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:03.296700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:03.296704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.296708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.296712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.296717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:03.296720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:03.296726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:03.296732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:03.296735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:03.296739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:03.296744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:03.296747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:03.296750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:03.296753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:03.296756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:03.296760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:03.296763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:03.296766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:03.296769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:03.296772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:03.296774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:03.296777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:03.296780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:03.296783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:03.296785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:03.296789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:03.296792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.296795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.296798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.296801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.296803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.296806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.296809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:03.296813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:03.296815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:03.296818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:03.296842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:03.302421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:03.303375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:03.303392Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:03.303395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:03.303399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:03.303406Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 670 [2:7555895116898897412:5293]
2025-09-30T14:52:03.303424Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:03.303442Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:03.303445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:03.303448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:03.303451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:03.303467Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:03.303479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:03.303486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:03.303537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.303544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.303546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.303549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:03.303551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:03.303610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:03.303617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.303626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.303633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.303644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:03.303660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895116898897407:5293]
2025-09-30T14:52:03.303666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895116898897407:5293]
2025-09-30T14:52:03.303668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895116898897407:5293]
2025-09-30T14:52:03.303675Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:03.303686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895116988625493:2454], now have 1 active actors on pipe
2025-09-30T14:52:03.303687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:03.303690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:03.303692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:03.303698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895116988625685:6385], now have 1 active actors on pipe
2025-09-30T14:52:03.303704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:03.303719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:03.303727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:03.303756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895116898897407:5293]
2025-09-30T14:52:03.303766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:03.303793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:03.303810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 670
2025-09-30T14:52:03.303814Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 670
2025-09-30T14:52:03.303920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:03.303933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:03.303961Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6a17fbf-abfef63a-2f212ca7-c858f620_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:03.303973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:03.303978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:03.303980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:03.303990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:03.304006Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:03.304023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:03.304184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:03.304201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:03.304226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:03.304321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 671 partition: 0 MaxSeqNo: 42 sessionId: src_id|f6a17fbf-abfef63a-2f212ca7-c858f620_0
2025-09-30T14:52:03.304688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|713e895d-e5d6a8de-db0864bd-635e1d3d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f6a17fbf-abfef63a-2f212ca7-c858f620_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:03.307655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6a17fbf-abfef63a-2f212ca7-c858f620_0] Write session: try to update token
2025-09-30T14:52:03.307675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6a17fbf-abfef63a-2f212ca7-c858f620_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:03.315953Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:03.315973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:03.315983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895116898897407:5293]
2025-09-30T14:52:03.316032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:03.316045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:03.316217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:03.316382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:03.316536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:03.316698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:03.316909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:03.316964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:03.323156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 671 sessionId: src_id|f6a17fbf-abfef63a-2f212ca7-c858f620_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:03.326404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:03.327112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:03.327138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:03.327160Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:03.327164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:03.327167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:03.327170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:03.327180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895116898897407:5293]
2025-09-30T14:52:03.327184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895116898897407:5293]
2025-09-30T14:52:03.327188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895116898897407:5293]
2025-09-30T14:52:03.327238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:03.327241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:03.327263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:03.327275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:03.327277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.327280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:03.327418Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:03.372747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895116988625752:5991]
2025-09-30T14:52:03.373042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 670, pipe: [1:7555895116988625752:5991]
2025-09-30T14:52:03.436064Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:03.436311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:03.436351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895116988625752:5991], now have 1 active actors on pipe
2025-09-30T14:52:03.436463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:03.436570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:03.436631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895116988625752:5991]
2025-09-30T14:52:03.446077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:03.446089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:03.446109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 671 reason: error at write: Disconnected sessionId: src_id|f6a17fbf-abfef63a-2f212ca7-c858f620_0
2025-09-30T14:52:03.446427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 671 sessionId: src_id|f6a17fbf-abfef63a-2f212ca7-c858f620_0 is DEAD
2025-09-30T14:52:03.446580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6a17fbf-abfef63a-2f212ca7-c858f620_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:03.446593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6a17fbf-abfef63a-2f212ca7-c858f620_0] Write session will restart in 0.007867s
2025-09-30T14:52:03.446618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6a17fbf-abfef63a-2f212ca7-c858f620_0] Write session: Do CDS request
2025-09-30T14:52:03.446624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6a17fbf-abfef63a-2f212ca7-c858f620_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:03.455827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6a17fbf-abfef63a-2f212ca7-c858f620_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:03.455988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:03.456005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 672
2025-09-30T14:52:03.456141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 672 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:03.456173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 672 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:03.456188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=672 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:03.456192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:03.456659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 672 sessionId:  describe result for acl check
2025-09-30T14:52:03.456689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:03.456694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:03.456695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:03.456700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895116988625890:6389] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:03.457145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895116988625890:6389] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:03.459835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895116988625890:6389] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:03.460927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:03.463890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:03.464122Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:03.464135Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:03.464148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:03.464219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:03.464229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895116988625890:6389] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:03.464247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895116988625890:6389] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:03.464251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895116988625890:6389] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:03.464263Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895116898897662:5295]
2025-09-30T14:52:03.464259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 672 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:03.464965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:03.465304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:03.465366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:03.465652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:03.465698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:03.465703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:03.465704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:03.465705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:03.465705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:03.465706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:03.465707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:03.465708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:03.465709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:03.465710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:03.465711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.465712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.465713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.465713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:03.465715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:03.465719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:03.465726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:03.465729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:03.465732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:03.465734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:03.465736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:03.465739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:03.465741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:03.465744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:03.465747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:03.465749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.465751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.465754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.465756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:03.465758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:03.465764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:03.465772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:03.465776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:03.465779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:03.465782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:03.465785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:03.465788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:03.465791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:03.465796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:03.465800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:03.465802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:03.465806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:03.465808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:03.465811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:03.465814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:03.465817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:03.465819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:03.465822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:03.465825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:03.465828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:03.465830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.465833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.465836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.465839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.465843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.465846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.465848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:03.465851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:03.465854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:03.465857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:03.465879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:03.471206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:03.472191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:03.472214Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:03.472217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:03.472222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:03.472229Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 671 [2:7555895116898897662:5295]
2025-09-30T14:52:03.472246Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:03.472265Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:03.472274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:03.472277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:03.472279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:03.472294Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:03.472301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:03.472308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:03.472372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.472383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.472384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.472387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:03.472390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:03.472461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:03.472469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.472483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.472499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.472516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:03.472540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895116988625753:2454], now have 1 active actors on pipe
2025-09-30T14:52:03.472548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895116988626002:6389], now have 1 active actors on pipe
2025-09-30T14:52:03.472555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895116898897657:5295]
2025-09-30T14:52:03.472557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895116898897657:5295]
2025-09-30T14:52:03.472559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895116898897657:5295]
2025-09-30T14:52:03.472573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:03.472593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:03.472599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:03.472603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:03.472605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:03.472612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:03.472615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:03.472617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 671
2025-09-30T14:52:03.472648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895116898897657:5295]
2025-09-30T14:52:03.472660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:03.472623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 671
2025-09-30T14:52:03.472670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:03.472688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:03.472698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:03.472738Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a187571-f724c37-a6d84492-f05ce8db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:03.472750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:03.472759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:03.472766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:03.472776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:03.472790Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:03.472814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:03.472974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:03.472983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:03.472997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:03.473076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 672 partition: 0 MaxSeqNo: 42 sessionId: src_id|2a187571-f724c37-a6d84492-f05ce8db_0
2025-09-30T14:52:03.473444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6a17fbf-abfef63a-2f212ca7-c858f620_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2a187571-f724c37-a6d84492-f05ce8db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:03.476284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a187571-f724c37-a6d84492-f05ce8db_0] Write session: try to update token
2025-09-30T14:52:03.476303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a187571-f724c37-a6d84492-f05ce8db_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:03.484991Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:03.485010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:03.485013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:03.485016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:03.485027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895116898897657:5295]
2025-09-30T14:52:03.485035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895116898897657:5295]
2025-09-30T14:52:03.485041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895116898897657:5295]
2025-09-30T14:52:03.485095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:03.485093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:03.485101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:03.485105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.485105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:03.485109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:03.485338Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:03.490734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 672 sessionId: src_id|2a187571-f724c37-a6d84492-f05ce8db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:03.493604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:03.536577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895116988626015:5991]
2025-09-30T14:52:03.536805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 671, pipe: [1:7555895116988626015:5991]
2025-09-30T14:52:03.597726Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:03.598019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:03.598035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:03.598073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895116988626015:5991], now have 1 active actors on pipe
2025-09-30T14:52:03.598271Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:03.598308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:03.598318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895116988626015:5991]
2025-09-30T14:52:03.598339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:03.598416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 672 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2a187571-f724c37-a6d84492-f05ce8db_0
2025-09-30T14:52:03.598606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 672 sessionId: src_id|2a187571-f724c37-a6d84492-f05ce8db_0 is DEAD
2025-09-30T14:52:03.598763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a187571-f724c37-a6d84492-f05ce8db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:03.598770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a187571-f724c37-a6d84492-f05ce8db_0] Write session will restart in 0.005752s
2025-09-30T14:52:03.598787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a187571-f724c37-a6d84492-f05ce8db_0] Write session: Do CDS request
2025-09-30T14:52:03.598791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a187571-f724c37-a6d84492-f05ce8db_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:03.605755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a187571-f724c37-a6d84492-f05ce8db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:03.605918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:03.605933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 673
2025-09-30T14:52:03.606556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 673 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:03.606581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 673 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:03.606590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=673 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:03.606593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:03.607078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 673 sessionId:  describe result for acl check
2025-09-30T14:52:03.607113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:03.607122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:03.607124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:03.607130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895116988626056:6401] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:03.607669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895116988626056:6401] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:03.610249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895116988626056:6401] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:03.613894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895116988626056:6401] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:03.613909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895116988626056:6401] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:03.613912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895116988626056:6401] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:03.613922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 673 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:03.616459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:03.619341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:03.619593Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:03.619607Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:03.619619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:03.619680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:03.619728Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895116898897952:5310]
2025-09-30T14:52:03.620214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:03.620491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:03.620543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:03.620867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:03.620924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:03.620933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:03.620934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:03.620935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:03.620937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:03.620938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:03.620940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:03.620941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:03.620942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:03.620944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:03.620945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.620947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.620948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.620949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:03.620950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:03.620955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:03.620966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:03.620970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:03.620975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:03.620980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:03.620984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:03.620988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:03.620993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:03.620998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:03.621002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:03.621006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.621010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.621014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.621018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:03.621022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:03.621032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:03.621040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:03.621047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:03.621058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:03.621064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:03.621072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:03.621075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:03.621078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:03.621081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:03.621085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:03.621088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:03.621091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:03.621097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:03.621100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:03.621103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:03.621106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:03.621112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:03.621116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:03.621118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:03.621122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:03.621125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.621129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.621132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.621135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.621140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.621149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.621154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:03.621162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:03.621166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:03.621175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:03.621215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:03.626601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:03.627516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:03.627532Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:03.627535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:03.627540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:03.627547Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 672 [2:7555895116898897952:5310]
2025-09-30T14:52:03.627565Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:03.627580Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:03.627584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:03.627587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:03.627589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:03.627606Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:03.627613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:03.627626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:03.627692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.627700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.627703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.627706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:03.627709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:03.627777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:03.627789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.627800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.627812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.627832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:03.627852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895116988626237:6401], now have 1 active actors on pipe
2025-09-30T14:52:03.627861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895116988626041:2454], now have 1 active actors on pipe
2025-09-30T14:52:03.627867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895116898897947:5310]
2025-09-30T14:52:03.627870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895116898897947:5310]
2025-09-30T14:52:03.627874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895116898897947:5310]
2025-09-30T14:52:03.627887Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:03.627906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:03.627907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:03.627910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:03.627912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:03.627917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 672
2025-09-30T14:52:03.627934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:03.627934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 672
2025-09-30T14:52:03.627937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:03.627981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:03.627991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:03.628004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895116898897947:5310]
2025-09-30T14:52:03.628016Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:03.628027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:03.628056Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c417308-3a08ccff-f69d603a-f3b02ad2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:03.628068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:03.628072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:03.628075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:03.628086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:03.628096Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:03.628126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:03.628295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:03.628306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:03.628322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:03.628434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 673 partition: 0 MaxSeqNo: 42 sessionId: src_id|2c417308-3a08ccff-f69d603a-f3b02ad2_0
2025-09-30T14:52:03.628839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a187571-f724c37-a6d84492-f05ce8db_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2c417308-3a08ccff-f69d603a-f3b02ad2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:03.631650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c417308-3a08ccff-f69d603a-f3b02ad2_0] Write session: try to update token
2025-09-30T14:52:03.631668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c417308-3a08ccff-f69d603a-f3b02ad2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:03.640521Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:03.640544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:03.640546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:03.640548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:03.640558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895116898897947:5310]
2025-09-30T14:52:03.640562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895116898897947:5310]
2025-09-30T14:52:03.640567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895116898897947:5310]
2025-09-30T14:52:03.640607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:03.640614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.640616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:03.640620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:03.640626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:03.640631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:03.640800Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:03.647716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 673 sessionId: src_id|2c417308-3a08ccff-f69d603a-f3b02ad2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:03.650578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:03.698401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895116988626298:5991]
2025-09-30T14:52:03.698746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 672, pipe: [1:7555895116988626298:5991]
2025-09-30T14:52:03.752883Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:03.753241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:03.753259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:03.753278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895116988626298:5991], now have 1 active actors on pipe
2025-09-30T14:52:03.753446Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:03.753506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:03.753507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895116988626298:5991]
2025-09-30T14:52:03.753523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:03.753531Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:03.753587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 673 reason: error at write: Disconnected sessionId: src_id|2c417308-3a08ccff-f69d603a-f3b02ad2_0
2025-09-30T14:52:03.753788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 673 sessionId: src_id|2c417308-3a08ccff-f69d603a-f3b02ad2_0 is DEAD
2025-09-30T14:52:03.753930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c417308-3a08ccff-f69d603a-f3b02ad2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:03.753938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c417308-3a08ccff-f69d603a-f3b02ad2_0] Write session will restart in 0.008083s
2025-09-30T14:52:03.753961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c417308-3a08ccff-f69d603a-f3b02ad2_0] Write session: Do CDS request
2025-09-30T14:52:03.753970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c417308-3a08ccff-f69d603a-f3b02ad2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:03.762851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c417308-3a08ccff-f69d603a-f3b02ad2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:03.762936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:03.762955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 674
2025-09-30T14:52:03.763154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 674 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:03.763215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 674 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:03.763233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=674 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:03.763238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:03.763670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 674 sessionId:  describe result for acl check
2025-09-30T14:52:03.763702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:03.763705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:03.763707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:03.763713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895116988626323:6405] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:03.764248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895116988626323:6405] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:03.767072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895116988626323:6405] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:03.770457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895116988626323:6405] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:03.770469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895116988626323:6405] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:03.770471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895116988626323:6405] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:03.770477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 674 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:03.772773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:03.775444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:03.775650Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:03.775660Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:03.775672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:03.775724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:03.775769Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895116898898204:5312]
2025-09-30T14:52:03.776463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:03.776739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:03.776772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:03.777023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:03.777074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:03.777079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:03.777079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:03.777080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:03.777081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:03.777081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:03.777083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:03.777083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:03.777084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:03.777085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:03.777086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.777087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.777088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.777088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:03.777089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:03.777093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:03.777099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:03.777102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:03.777104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:03.777107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:03.777109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:03.777111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:03.777114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:03.777116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:03.777119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:03.777121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.777124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.777126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.777128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:03.777130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:03.777136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:03.777141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:03.777145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:03.777149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:03.777155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:03.777158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:03.777160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:03.777164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:03.777167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:03.777171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:03.777174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:03.777177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:03.777180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:03.777182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:03.777185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:03.777188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:03.777201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:03.777204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:03.777207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:03.777210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:03.777212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.777215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.777218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.777221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.777223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.777226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.777228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:03.777231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:03.777233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:03.777236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:03.777260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:03.782754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:03.783649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:03.783665Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:03.783667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:03.783671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:03.783676Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 673 [2:7555895116898898204:5312]
2025-09-30T14:52:03.783691Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:03.783704Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:03.783710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:03.783713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:03.783714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:03.783728Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:03.783733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:03.783739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:03.783790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.783796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.783798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.783801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:03.783803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:03.783855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:03.783861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.783871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.783878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.783887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:03.783903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895116898898199:5312]
2025-09-30T14:52:03.783909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895116898898199:5312]
2025-09-30T14:52:03.783911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895116898898199:5312]
2025-09-30T14:52:03.783920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:03.783933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:03.783944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:03.783946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:03.783948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:03.783948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:03.783951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:03.783955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895116988626299:2454], now have 1 active actors on pipe
2025-09-30T14:52:03.783958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895116988626518:6405], now have 1 active actors on pipe
2025-09-30T14:52:03.783983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895116898898199:5312]
2025-09-30T14:52:03.783991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:03.783998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:03.784025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 673
2025-09-30T14:52:03.784042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 673
2025-09-30T14:52:03.784117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:03.784125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:03.784144Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23b2aaa8-3dba7720-2972cb98-5ef78b80_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:03.784153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:03.784156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:03.784158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:03.784165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:03.784175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:03.784188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:03.784328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:03.784340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:03.784352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:03.784444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 674 partition: 0 MaxSeqNo: 42 sessionId: src_id|23b2aaa8-3dba7720-2972cb98-5ef78b80_0
2025-09-30T14:52:03.784822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c417308-3a08ccff-f69d603a-f3b02ad2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|23b2aaa8-3dba7720-2972cb98-5ef78b80_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:03.787700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23b2aaa8-3dba7720-2972cb98-5ef78b80_0] Write session: try to update token
2025-09-30T14:52:03.787719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23b2aaa8-3dba7720-2972cb98-5ef78b80_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:03.796141Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:03.796159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:03.796162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:03.796164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:03.796173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895116898898199:5312]
2025-09-30T14:52:03.796177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895116898898199:5312]
2025-09-30T14:52:03.796181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895116898898199:5312]
2025-09-30T14:52:03.796221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:03.796228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.796230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:03.796232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:03.796236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:03.796240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:03.796369Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:03.802653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 674 sessionId: src_id|23b2aaa8-3dba7720-2972cb98-5ef78b80_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:03.805483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:03.853514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895116988626561:5991]
2025-09-30T14:52:03.853764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 673, pipe: [1:7555895116988626561:5991]
2025-09-30T14:52:03.909536Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:03.910161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:03.910179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:03.910215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895116988626561:5991], now have 1 active actors on pipe
2025-09-30T14:52:03.910399Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:03.910451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:03.910465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:03.910470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:03.910511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895116988626561:5991]
2025-09-30T14:52:03.910527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 674 reason: error at write: Disconnected sessionId: src_id|23b2aaa8-3dba7720-2972cb98-5ef78b80_0
2025-09-30T14:52:03.910692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 674 sessionId: src_id|23b2aaa8-3dba7720-2972cb98-5ef78b80_0 is DEAD
2025-09-30T14:52:03.910843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23b2aaa8-3dba7720-2972cb98-5ef78b80_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:03.910855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23b2aaa8-3dba7720-2972cb98-5ef78b80_0] Write session will restart in 0.005423s
2025-09-30T14:52:03.910879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23b2aaa8-3dba7720-2972cb98-5ef78b80_0] Write session: Do CDS request
2025-09-30T14:52:03.910885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23b2aaa8-3dba7720-2972cb98-5ef78b80_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:03.917727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23b2aaa8-3dba7720-2972cb98-5ef78b80_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:03.917864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:03.917878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 675
2025-09-30T14:52:03.918019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 675 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:03.918052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 675 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:03.918061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=675 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:03.918066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:03.918431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 675 sessionId:  describe result for acl check
2025-09-30T14:52:03.918470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:03.918475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:03.918478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:03.918482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895116988626585:6409] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:03.918875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895116988626585:6409] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:03.921499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895116988626585:6409] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:03.924357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895116988626585:6409] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:03.924369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895116988626585:6409] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:03.924372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895116988626585:6409] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:03.924377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 675 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:03.926333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:03.928912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:03.929092Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:03.929101Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:03.929109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:03.929152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:03.929184Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895116898898468:5315]
2025-09-30T14:52:03.929687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:03.929913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:03.929943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:03.930160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:03.930201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:03.930205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:03.930206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:03.930207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:03.930207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:03.930208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:03.930209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:03.930210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:03.930211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:03.930212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:03.930213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.930213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.930214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.930215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:03.930215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:03.930218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:03.930229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:03.930233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:03.930237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:03.930241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:03.930244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:03.930249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:03.930253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:03.930256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:03.930259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:03.930262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.930264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.930266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.930268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:03.930271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:03.930276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:03.930281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:03.930286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:03.930289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:03.930292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:03.930295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:03.930297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:03.930300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:03.930303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:03.930306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:03.930308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:03.930311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:03.930313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:03.930316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:03.930318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:03.930321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:03.930324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:03.930327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:03.930329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:03.930332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:03.930335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.930338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.930345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.930348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.930350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.930354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.930356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:03.930363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:03.930366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:03.930369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:03.930404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:03.935544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:03.936700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:03.936713Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:03.936715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:03.936718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:03.936725Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 674 [2:7555895116898898468:5315]
2025-09-30T14:52:03.936738Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:03.936754Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:03.936756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:03.936758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:03.936760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:03.936771Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:03.936779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:03.936785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:03.936826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.936832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.936833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.936836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:03.936838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:03.936899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:03.936905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.936912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:03.936921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:03.936931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:03.936947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895116898898463:5315]
2025-09-30T14:52:03.936952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895116898898463:5315]
2025-09-30T14:52:03.936954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895116898898463:5315]
2025-09-30T14:52:03.936962Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:03.936973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:03.936976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895116988626562:2454], now have 1 active actors on pipe
2025-09-30T14:52:03.936981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895116988626778:6409], now have 1 active actors on pipe
2025-09-30T14:52:03.936985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:03.936985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:03.936988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:03.936993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:03.936995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:03.937018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895116898898463:5315]
2025-09-30T14:52:03.937030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:03.937039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:03.937052Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 674
2025-09-30T14:52:03.937081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 674
2025-09-30T14:52:03.937132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:03.937139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:03.937158Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|277b1a09-b8a0c1ae-7f41349b-e1350fea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:03.937168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:03.937170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:03.937172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:03.937179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:03.937186Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:03.937194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:03.937320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:03.937324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:03.937334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:03.937401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 675 partition: 0 MaxSeqNo: 42 sessionId: src_id|277b1a09-b8a0c1ae-7f41349b-e1350fea_0
2025-09-30T14:52:03.937747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23b2aaa8-3dba7720-2972cb98-5ef78b80_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|277b1a09-b8a0c1ae-7f41349b-e1350fea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:03.940591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|277b1a09-b8a0c1ae-7f41349b-e1350fea_0] Write session: try to update token
2025-09-30T14:52:03.940611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|277b1a09-b8a0c1ae-7f41349b-e1350fea_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:03.954177Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:03.954196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:03.954204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895116898898463:5315]
2025-09-30T14:52:03.954250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:03.954253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:03.954452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:03.954608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:03.954757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:03.954906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:03.955161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:03.955201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:03.958742Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:03.958759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:03.958761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:03.958763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:03.958770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895116898898463:5315]
2025-09-30T14:52:03.958773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895116898898463:5315]
2025-09-30T14:52:03.958777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895116898898463:5315]
2025-09-30T14:52:03.958805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:03.958809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:03.958811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:03.958824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:03.958831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:03.958835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:03.958941Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:03.959163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 675 sessionId: src_id|277b1a09-b8a0c1ae-7f41349b-e1350fea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:03.961808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:04.010690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895121283594141:5991]
2025-09-30T14:52:04.011017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 674, pipe: [1:7555895121283594141:5991]
2025-09-30T14:52:04.067837Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:04.068136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:04.068152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:04.068170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895121283594141:5991], now have 1 active actors on pipe
2025-09-30T14:52:04.068404Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:04.068433Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:04.068447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895121283594141:5991]
2025-09-30T14:52:04.068469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:04.068471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:04.068532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 675 reason: error at write: Disconnected sessionId: src_id|277b1a09-b8a0c1ae-7f41349b-e1350fea_0
2025-09-30T14:52:04.068730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 675 sessionId: src_id|277b1a09-b8a0c1ae-7f41349b-e1350fea_0 is DEAD
2025-09-30T14:52:04.068896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|277b1a09-b8a0c1ae-7f41349b-e1350fea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:04.068910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|277b1a09-b8a0c1ae-7f41349b-e1350fea_0] Write session will restart in 0.008833s
2025-09-30T14:52:04.068927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|277b1a09-b8a0c1ae-7f41349b-e1350fea_0] Write session: Do CDS request
2025-09-30T14:52:04.068934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|277b1a09-b8a0c1ae-7f41349b-e1350fea_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:04.078734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|277b1a09-b8a0c1ae-7f41349b-e1350fea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:04.078827Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:04.078843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 676
2025-09-30T14:52:04.078989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 676 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:04.079024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 676 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:04.079034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=676 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:04.079038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:04.079577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 676 sessionId:  describe result for acl check
2025-09-30T14:52:04.079617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:04.079624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:04.079625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:04.079631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895121283594191:6416] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:04.080183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895121283594191:6416] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:04.082638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895121283594191:6416] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:04.085876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895121283594191:6416] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:04.085891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895121283594191:6416] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:04.085895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895121283594191:6416] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:04.085903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 676 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:04.088072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:04.090701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:04.090898Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:04.090908Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:04.090919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:04.090973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:04.091009Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895121193866020:5317]
2025-09-30T14:52:04.091713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:04.091986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:04.092019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:04.092309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:04.092355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:04.092360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:04.092361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:04.092362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:04.092363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:04.092364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:04.092365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:04.092365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:04.092366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:04.092367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:04.092368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.092369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.092369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.092370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:04.092371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:04.092374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:04.092381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:04.092383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:04.092386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:04.092388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:04.092391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:04.092393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:04.092395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:04.092398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:04.092400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:04.092402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.092405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.092407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.092410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:04.092412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:04.092419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:04.092423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:04.092429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:04.092435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:04.092441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:04.092447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:04.092452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:04.092462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:04.092471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:04.092477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:04.092481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:04.092487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:04.092496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:04.092503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:04.092511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:04.092516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:04.092525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:04.092530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:04.092537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:04.092540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:04.092549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.092554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.092562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.092567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.092576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.092585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.092593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:04.092599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:04.092607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:04.092612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:04.092660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:04.097899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:04.098739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:04.098754Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:04.098757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:04.098760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:04.098765Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 675 [2:7555895121193866020:5317]
2025-09-30T14:52:04.098777Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:04.098794Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:04.098800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:04.098802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:04.098804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:04.098815Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:04.098821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:04.098830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:04.098888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.098897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.098900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.098903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:04.098906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:04.098959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:04.098966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.098978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.098993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.099009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:04.099034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895121283594386:6416], now have 1 active actors on pipe
2025-09-30T14:52:04.099042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895121283594145:2454], now have 1 active actors on pipe
2025-09-30T14:52:04.099048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895121193866015:5317]
2025-09-30T14:52:04.099055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895121193866015:5317]
2025-09-30T14:52:04.099058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895121193866015:5317]
2025-09-30T14:52:04.099070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:04.099082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:04.099087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:04.099090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:04.099093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:04.099096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:04.099098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:04.099129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895121193866015:5317]
2025-09-30T14:52:04.099137Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:04.099140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:04.099106Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 675
2025-09-30T14:52:04.099107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 675
2025-09-30T14:52:04.099160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:04.099169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:04.099203Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|953818f4-d8ed5297-66e0d383-6481b98f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:04.099217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:04.099221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:04.099223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:04.099232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:04.099259Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:04.099276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:04.099407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:04.099419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:04.099432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:04.099518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 676 partition: 0 MaxSeqNo: 42 sessionId: src_id|953818f4-d8ed5297-66e0d383-6481b98f_0
2025-09-30T14:52:04.099857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|277b1a09-b8a0c1ae-7f41349b-e1350fea_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|953818f4-d8ed5297-66e0d383-6481b98f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:04.102817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|953818f4-d8ed5297-66e0d383-6481b98f_0] Write session: try to update token
2025-09-30T14:52:04.102840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|953818f4-d8ed5297-66e0d383-6481b98f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:04.111060Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:04.111088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:04.111091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:04.111093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:04.111103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895121193866015:5317]
2025-09-30T14:52:04.111110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895121193866015:5317]
2025-09-30T14:52:04.111114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895121193866015:5317]
2025-09-30T14:52:04.111159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:04.111167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.111168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:04.111171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:04.111174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:04.111179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:04.111369Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:04.118625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 676 sessionId: src_id|953818f4-d8ed5297-66e0d383-6481b98f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:04.121236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:04.168403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895121283594408:5991]
2025-09-30T14:52:04.168719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 675, pipe: [1:7555895121283594408:5991]
2025-09-30T14:52:04.220803Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:04.221133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:04.221156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:04.221179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895121283594408:5991], now have 1 active actors on pipe
2025-09-30T14:52:04.221464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:04.221472Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:04.221478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:04.221529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895121283594408:5991]
2025-09-30T14:52:04.221542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 676 reason: error at write: Disconnected sessionId: src_id|953818f4-d8ed5297-66e0d383-6481b98f_0
2025-09-30T14:52:04.221568Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:04.221826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|953818f4-d8ed5297-66e0d383-6481b98f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:04.221836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|953818f4-d8ed5297-66e0d383-6481b98f_0] Write session will restart in 0.007301s
2025-09-30T14:52:04.221860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|953818f4-d8ed5297-66e0d383-6481b98f_0] Write session: Do CDS request
2025-09-30T14:52:04.221865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|953818f4-d8ed5297-66e0d383-6481b98f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:04.221713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 676 sessionId: src_id|953818f4-d8ed5297-66e0d383-6481b98f_0 is DEAD
2025-09-30T14:52:04.230816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|953818f4-d8ed5297-66e0d383-6481b98f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:04.230920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:04.230937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 677
2025-09-30T14:52:04.231094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 677 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:04.231136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 677 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:04.231142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=677 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:04.231146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:04.231723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 677 sessionId:  describe result for acl check
2025-09-30T14:52:04.231760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:04.231763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:04.231765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:04.231771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895121283594432:6420] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:04.232281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895121283594432:6420] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:04.234846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895121283594432:6420] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:04.238238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895121283594432:6420] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:04.238253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895121283594432:6420] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:04.238257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895121283594432:6420] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:04.238264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 677 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:04.241398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:04.244422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:04.244640Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:04.244649Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:04.244661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:04.244719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:04.244761Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895121193866275:5320]
2025-09-30T14:52:04.245452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:04.245787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:04.245833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:04.246195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:04.246258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:04.246268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:04.246269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:04.246270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:04.246271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:04.246273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:04.246274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:04.246276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:04.246277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:04.246278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:04.246280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.246281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.246283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.246284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:04.246285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:04.246291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:04.246302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:04.246306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:04.246310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:04.246314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:04.246318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:04.246323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:04.246327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:04.246331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:04.246336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:04.246340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.246344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.246348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.246352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:04.246356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:04.246363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:04.246372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:04.246389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:04.246395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:04.246400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:04.246405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:04.246410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:04.246416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:04.246422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:04.246428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:04.246433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:04.246441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:04.246446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:04.246451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:04.246455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:04.246459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:04.246464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:04.246469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:04.246473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:04.246479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:04.246485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.246490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.246495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.246500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.246505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.246516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.246521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:04.246531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:04.246536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:04.246546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:04.246600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:04.252353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:04.253430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:04.253450Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:04.253452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:04.253457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:04.253464Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 676 [2:7555895121193866275:5320]
2025-09-30T14:52:04.253482Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:04.253498Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:04.253501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:04.253504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:04.253506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:04.253525Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:04.253532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:04.253539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:04.253598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.253606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.253608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.253612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:04.253614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:04.253683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:04.253691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.253703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.253719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.253741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:04.253766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895121283594409:2454], now have 1 active actors on pipe
2025-09-30T14:52:04.253776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895121283594602:6420], now have 1 active actors on pipe
2025-09-30T14:52:04.253782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895121193866270:5320]
2025-09-30T14:52:04.253784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895121193866270:5320]
2025-09-30T14:52:04.253787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895121193866270:5320]
2025-09-30T14:52:04.253797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:04.253810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:04.253818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:04.253820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:04.253823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:04.253829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:04.253832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:04.253866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895121193866270:5320]
2025-09-30T14:52:04.253874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:04.253827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 676
2025-09-30T14:52:04.253876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:04.253864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 676
2025-09-30T14:52:04.253893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:04.253896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:04.254277Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8ffcdfd-bb0d59d2-38a9d193-6949c32b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:04.254293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:04.254297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:04.254299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:04.254308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:04.254324Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:04.254355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:04.254812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:04.254840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:04.254867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:04.255005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 677 partition: 0 MaxSeqNo: 42 sessionId: src_id|b8ffcdfd-bb0d59d2-38a9d193-6949c32b_0
2025-09-30T14:52:04.255404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|953818f4-d8ed5297-66e0d383-6481b98f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b8ffcdfd-bb0d59d2-38a9d193-6949c32b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:04.258428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8ffcdfd-bb0d59d2-38a9d193-6949c32b_0] Write session: try to update token
2025-09-30T14:52:04.258454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8ffcdfd-bb0d59d2-38a9d193-6949c32b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:04.266514Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:04.266546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:04.266550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:04.266552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:04.266565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895121193866270:5320]
2025-09-30T14:52:04.266571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895121193866270:5320]
2025-09-30T14:52:04.266578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895121193866270:5320]
2025-09-30T14:52:04.266634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:04.266639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:04.266648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.266651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:04.266658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:04.266663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:04.266827Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:04.274368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 677 sessionId: src_id|b8ffcdfd-bb0d59d2-38a9d193-6949c32b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:04.277504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:04.321507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895121283594673:5991]
2025-09-30T14:52:04.321846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 676, pipe: [1:7555895121283594673:5991]
2025-09-30T14:52:04.375273Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:04.375693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:04.375706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:04.375723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895121283594673:5991], now have 1 active actors on pipe
2025-09-30T14:52:04.375970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895121283594673:5991]
2025-09-30T14:52:04.375992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:04.375995Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:04.375996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:04.376048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 677 reason: error at write: Disconnected sessionId: src_id|b8ffcdfd-bb0d59d2-38a9d193-6949c32b_0
2025-09-30T14:52:04.376039Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:04.376190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 677 sessionId: src_id|b8ffcdfd-bb0d59d2-38a9d193-6949c32b_0 is DEAD
2025-09-30T14:52:04.376347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8ffcdfd-bb0d59d2-38a9d193-6949c32b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:04.376358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8ffcdfd-bb0d59d2-38a9d193-6949c32b_0] Write session will restart in 0.008859s
2025-09-30T14:52:04.376381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8ffcdfd-bb0d59d2-38a9d193-6949c32b_0] Write session: Do CDS request
2025-09-30T14:52:04.376389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8ffcdfd-bb0d59d2-38a9d193-6949c32b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:04.386770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8ffcdfd-bb0d59d2-38a9d193-6949c32b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:04.386865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:04.386881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 678
2025-09-30T14:52:04.387005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 678 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:04.387035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 678 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:04.387045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=678 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:04.387049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:04.387491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 678 sessionId:  describe result for acl check
2025-09-30T14:52:04.387529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:04.387531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:04.387532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:04.387538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895121283594734:6424] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:04.388046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895121283594734:6424] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:04.390719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895121283594734:6424] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:04.393439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895121283594734:6424] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:04.393449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895121283594734:6424] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:04.393453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895121283594734:6424] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:04.393459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 678 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:04.394918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:04.397682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:04.397889Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:04.397899Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:04.397909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:04.397969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:04.398012Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895121193866531:5322]
2025-09-30T14:52:04.398676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:04.399053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:04.399098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:04.399413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:04.399473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:04.399479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:04.399480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:04.399481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:04.399482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:04.399483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:04.399485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:04.399485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:04.399487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:04.399488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:04.399489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.399490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.399491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.399492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:04.399493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:04.399499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:04.399508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:04.399511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:04.399515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:04.399518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:04.399523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:04.399526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:04.399529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:04.399533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:04.399537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:04.399540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.399544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.399547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.399550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:04.399553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:04.399561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:04.399569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:04.399576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:04.399581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:04.399586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:04.399591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:04.399596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:04.399602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:04.399607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:04.399612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:04.399623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:04.399629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:04.399638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:04.399644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:04.399648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:04.399652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:04.399656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:04.399663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:04.399672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:04.399677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:04.399681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.399691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.399695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.399705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.399710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.399722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.399726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:04.399732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:04.399741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:04.399747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:04.399800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:04.405170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:04.406146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:04.406164Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:04.406167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:04.406172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:04.406180Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 677 [2:7555895121193866531:5322]
2025-09-30T14:52:04.406196Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:04.406213Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:04.406216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:04.406219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:04.406220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:04.406234Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:04.406243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:04.406249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:04.406315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.406325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.406327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.406330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:04.406333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:04.406415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:04.406424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.406437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.406455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.406471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:04.406495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895121283594674:2454], now have 1 active actors on pipe
2025-09-30T14:52:04.406504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895121283594924:6424], now have 1 active actors on pipe
2025-09-30T14:52:04.406511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895121193866526:5322]
2025-09-30T14:52:04.406514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895121193866526:5322]
2025-09-30T14:52:04.406516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895121193866526:5322]
2025-09-30T14:52:04.406531Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:04.406551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:04.406572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:04.406575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:04.406579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:04.406581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:04.406581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:04.406577Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 677
2025-09-30T14:52:04.406624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895121193866526:5322]
2025-09-30T14:52:04.406633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:04.406629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 677
2025-09-30T14:52:04.406642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:04.406676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:04.406686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:04.406716Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|219845e4-712686e4-514d3596-b782c24d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:04.406728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:04.406737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:04.406739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:04.406750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:04.406764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:04.406783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:04.406947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:04.406957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:04.406972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:04.407050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 678 partition: 0 MaxSeqNo: 42 sessionId: src_id|219845e4-712686e4-514d3596-b782c24d_0
2025-09-30T14:52:04.407465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8ffcdfd-bb0d59d2-38a9d193-6949c32b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|219845e4-712686e4-514d3596-b782c24d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:04.410335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|219845e4-712686e4-514d3596-b782c24d_0] Write session: try to update token
2025-09-30T14:52:04.410353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|219845e4-712686e4-514d3596-b782c24d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:04.420362Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:04.420394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:04.420397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:04.420399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:04.420413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895121193866526:5322]
2025-09-30T14:52:04.420420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895121193866526:5322]
2025-09-30T14:52:04.420428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895121193866526:5322]
2025-09-30T14:52:04.420485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:04.420489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:04.420499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.420502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:04.420503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:04.420506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:04.420676Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:04.425758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 678 sessionId: src_id|219845e4-712686e4-514d3596-b782c24d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:04.428624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:04.476091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895121283594941:5991]
2025-09-30T14:52:04.476369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 677, pipe: [1:7555895121283594941:5991]
2025-09-30T14:52:04.529476Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:04.530137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:04.530151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:04.530190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895121283594941:5991], now have 1 active actors on pipe
2025-09-30T14:52:04.530458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:04.530492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895121283594941:5991]
2025-09-30T14:52:04.530518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:04.530521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:04.530591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 678 reason: error at write: Disconnected sessionId: src_id|219845e4-712686e4-514d3596-b782c24d_0
2025-09-30T14:52:04.530634Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:04.530777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 678 sessionId: src_id|219845e4-712686e4-514d3596-b782c24d_0 is DEAD
2025-09-30T14:52:04.530948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|219845e4-712686e4-514d3596-b782c24d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:04.530961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|219845e4-712686e4-514d3596-b782c24d_0] Write session will restart in 0.007623s
2025-09-30T14:52:04.530986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|219845e4-712686e4-514d3596-b782c24d_0] Write session: Do CDS request
2025-09-30T14:52:04.530993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|219845e4-712686e4-514d3596-b782c24d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:04.539767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|219845e4-712686e4-514d3596-b782c24d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:04.539878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:04.539897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 679
2025-09-30T14:52:04.540122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 679 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:04.540157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 679 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:04.540170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=679 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:04.540179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:04.540630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 679 sessionId:  describe result for acl check
2025-09-30T14:52:04.540673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:04.540680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:04.540682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:04.540689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895121283594966:6429] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:04.541242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895121283594966:6429] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:04.543888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895121283594966:6429] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:04.546927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895121283594966:6429] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:04.546943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895121283594966:6429] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:04.546946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895121283594966:6429] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:04.546954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 679 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:04.551115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:04.553869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:04.554067Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:04.554077Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:04.554087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:04.554143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:04.554183Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895121193866790:5325]
2025-09-30T14:52:04.554815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:04.555159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:04.555200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:04.555568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:04.555628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:04.555634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:04.555635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:04.555636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:04.555638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:04.555639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:04.555640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:04.555641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:04.555642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:04.555644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:04.555645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.555646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.555647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.555648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:04.555650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:04.555655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:04.555665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:04.555670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:04.555674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:04.555678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:04.555682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:04.555686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:04.555690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:04.555694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:04.555699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:04.555703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.555707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.555711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.555714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:04.555718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:04.555725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:04.555734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:04.555741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:04.555746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:04.555751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:04.555756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:04.555762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:04.555767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:04.555772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:04.555778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:04.555782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:04.555788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:04.555793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:04.555798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:04.555808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:04.555814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:04.555819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:04.555824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:04.555829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:04.555839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:04.555844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.555849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.555859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.555865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.555872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.555877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.555882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:04.555887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:04.555892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:04.555899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:04.555946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:04.561428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:04.562288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:04.562305Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:04.562308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:04.562313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:04.562318Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 678 [2:7555895121193866790:5325]
2025-09-30T14:52:04.562338Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:04.562359Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:04.562367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:04.562370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:04.562372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:04.562401Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:04.562413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:04.562420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:04.562478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.562486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.562488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.562492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:04.562494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:04.562560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:04.562568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.562581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.562599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.562622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:04.562646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895121283595118:6429], now have 1 active actors on pipe
2025-09-30T14:52:04.562654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895121283594942:2454], now have 1 active actors on pipe
2025-09-30T14:52:04.562661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895121193866785:5325]
2025-09-30T14:52:04.562663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895121193866785:5325]
2025-09-30T14:52:04.562665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895121193866785:5325]
2025-09-30T14:52:04.562677Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:04.562693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:04.562694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:04.562704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:04.562706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:04.562710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:04.562713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:04.562711Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 678
2025-09-30T14:52:04.562745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895121193866785:5325]
2025-09-30T14:52:04.562753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:04.562715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 678
2025-09-30T14:52:04.562756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:04.562773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:04.562783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:04.562827Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d952bb-ef9fbf3a-67b8774a-6f8808dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:04.562839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:04.562843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:04.562845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:04.562854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:04.562867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:04.562884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:04.563056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:04.563065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:04.563079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:04.563152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 679 partition: 0 MaxSeqNo: 42 sessionId: src_id|d952bb-ef9fbf3a-67b8774a-6f8808dd_0
2025-09-30T14:52:04.563554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|219845e4-712686e4-514d3596-b782c24d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d952bb-ef9fbf3a-67b8774a-6f8808dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:04.566325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d952bb-ef9fbf3a-67b8774a-6f8808dd_0] Write session: try to update token
2025-09-30T14:52:04.566345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d952bb-ef9fbf3a-67b8774a-6f8808dd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:04.574913Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:04.574936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:04.574939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:04.574941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:04.574951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895121193866785:5325]
2025-09-30T14:52:04.574956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895121193866785:5325]
2025-09-30T14:52:04.574961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895121193866785:5325]
2025-09-30T14:52:04.575005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:04.575013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.575014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:04.575021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:04.575021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:04.575026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:04.575166Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:04.580674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 679 sessionId: src_id|d952bb-ef9fbf3a-67b8774a-6f8808dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:04.583447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:04.630688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895121283595229:5991]
2025-09-30T14:52:04.630938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 678, pipe: [1:7555895121283595229:5991]
2025-09-30T14:52:04.695828Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:04.696166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:04.696181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:04.696218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895121283595229:5991], now have 1 active actors on pipe
2025-09-30T14:52:04.696438Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:04.696473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895121283595229:5991]
2025-09-30T14:52:04.696490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:04.696508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:04.696582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 679 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d952bb-ef9fbf3a-67b8774a-6f8808dd_0
2025-09-30T14:52:04.696759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 679 sessionId: src_id|d952bb-ef9fbf3a-67b8774a-6f8808dd_0 is DEAD
2025-09-30T14:52:04.696880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d952bb-ef9fbf3a-67b8774a-6f8808dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:04.696886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d952bb-ef9fbf3a-67b8774a-6f8808dd_0] Write session will restart in 0.009420s
2025-09-30T14:52:04.696903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d952bb-ef9fbf3a-67b8774a-6f8808dd_0] Write session: Do CDS request
2025-09-30T14:52:04.696908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d952bb-ef9fbf3a-67b8774a-6f8808dd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:04.707697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d952bb-ef9fbf3a-67b8774a-6f8808dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:04.707802Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:04.707816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 680
2025-09-30T14:52:04.707928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 680 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:04.707961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 680 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:04.707969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=680 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:04.707975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:04.708467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 680 sessionId:  describe result for acl check
2025-09-30T14:52:04.708509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:04.708515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:04.708517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:04.708523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895121283595312:6440] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:04.709056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895121283595312:6440] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:04.711920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895121283595312:6440] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:04.714933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:04.714934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895121283595312:6440] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:04.714949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895121283595312:6440] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:04.714953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895121283595312:6440] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:04.714961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 680 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:04.717652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:04.717867Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:04.717878Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:04.717890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:04.717946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:04.717989Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895121193867085:5339]
2025-09-30T14:52:04.718679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:04.718989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:04.719036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:04.719395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:04.719463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:04.719468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:04.719469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:04.719470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:04.719472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:04.719473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:04.719475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:04.719477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:04.719479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:04.719480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:04.719482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.719483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.719484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.719486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:04.719487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:04.719492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:04.719504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:04.719509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:04.719513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:04.719518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:04.719523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:04.719532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:04.719536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:04.719545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:04.719551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:04.719559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.719564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.719573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.719577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:04.719585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:04.719593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:04.719606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:04.719617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:04.719624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:04.719629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:04.719634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:04.719639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:04.719644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:04.719650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:04.719657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:04.719667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:04.719673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:04.719678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:04.719683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:04.719689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:04.719696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:04.719701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:04.719712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:04.719717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:04.719723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:04.719728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.719734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.719739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.719745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.719757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.719763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.719772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:04.719778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:04.719782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:04.719788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:04.719839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:04.725137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:04.726089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:04.726110Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:04.726113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:04.726117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:04.726126Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 679 [2:7555895121193867085:5339]
2025-09-30T14:52:04.726144Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:04.726160Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:04.726169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:04.726172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:04.726174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:04.726190Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:04.726197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:04.726209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:04.726264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.726271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.726273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.726276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:04.726279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:04.726348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:04.726355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.726368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.726393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.726412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:04.726439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895121283595231:2454], now have 1 active actors on pipe
2025-09-30T14:52:04.726443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895121283595486:6440], now have 1 active actors on pipe
2025-09-30T14:52:04.726450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895121193867079:5339]
2025-09-30T14:52:04.726453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895121193867079:5339]
2025-09-30T14:52:04.726455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895121193867079:5339]
2025-09-30T14:52:04.726468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:04.726485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:04.726493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:04.726501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:04.726504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:04.726505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:04.726507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:04.726535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895121193867079:5339]
2025-09-30T14:52:04.726551Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:04.726550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 679
2025-09-30T14:52:04.726557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 679
2025-09-30T14:52:04.726569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:04.726643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:04.726654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:04.726678Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ea63909-e279269b-38d357aa-c0cf223b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:04.726691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:04.726695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:04.726698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:04.726707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:04.726717Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:04.726733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:04.726909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:04.726920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:04.726936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:04.727028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 680 partition: 0 MaxSeqNo: 42 sessionId: src_id|7ea63909-e279269b-38d357aa-c0cf223b_0
2025-09-30T14:52:04.727439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d952bb-ef9fbf3a-67b8774a-6f8808dd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7ea63909-e279269b-38d357aa-c0cf223b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:04.730552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea63909-e279269b-38d357aa-c0cf223b_0] Write session: try to update token
2025-09-30T14:52:04.730570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea63909-e279269b-38d357aa-c0cf223b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:04.739792Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:04.739811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:04.739823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895121193867079:5339]
2025-09-30T14:52:04.739867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:04.739885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:04.740154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:04.740353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:04.740505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:04.740653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:04.740871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:04.740922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:04.745982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 680 sessionId: src_id|7ea63909-e279269b-38d357aa-c0cf223b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:04.748688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:04.748825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:04.748846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:04.750039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:04.750066Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:04.750072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:04.750074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:04.750075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:04.750083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895121193867079:5339]
2025-09-30T14:52:04.750086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895121193867079:5339]
2025-09-30T14:52:04.750090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895121193867079:5339]
2025-09-30T14:52:04.750113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:04.750114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:04.750119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:04.750123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:04.750130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.750132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:04.750132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:04.750252Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:04.796612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895121283595498:5991]
2025-09-30T14:52:04.796884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 679, pipe: [1:7555895121283595498:5991]
2025-09-30T14:52:04.858777Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:04.866667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:04.866694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:04.866845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:04.866905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:04.866964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:04.867037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:04.867097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:04.867108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:04.867179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:04.867235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:04.867317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:04.867376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:04.867416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:04.867422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:04.867482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:04.867540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:04.867599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:04.867659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:04.867704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:04.867710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:04.867772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:04.867829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:04.867886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:04.867944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:04.867983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:04.867990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:04.868052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:04.868108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:04.868168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:04.868244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:04.868287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:04.868296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:04.868358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:04.868413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:04.868472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:04.868531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:04.868573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:04.868579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:04.868641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:04.868699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:04.868768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:04.868828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:04.868870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:04.868876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:04.868937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:04.868991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:04.869049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:04.869108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:04.869149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:04.869155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:04.869215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:04.869277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:04.869338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:04.869395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:04.869436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:04.869441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:04.869502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:04.869556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:04.869616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:04.869676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:04.869717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:04.869722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:04.869769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895121283595498:5991], now have 1 active actors on pipe
2025-09-30T14:52:04.869988Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:04.870004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895121283595498:5991]
2025-09-30T14:52:04.870035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:04.870037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:04.870061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 680 reason: error at write: Disconnected sessionId: src_id|7ea63909-e279269b-38d357aa-c0cf223b_0
2025-09-30T14:52:04.870219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 680 sessionId: src_id|7ea63909-e279269b-38d357aa-c0cf223b_0 is DEAD
2025-09-30T14:52:04.870392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea63909-e279269b-38d357aa-c0cf223b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:04.870405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea63909-e279269b-38d357aa-c0cf223b_0] Write session will restart in 0.006160s
2025-09-30T14:52:04.870428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea63909-e279269b-38d357aa-c0cf223b_0] Write session: Do CDS request
2025-09-30T14:52:04.870433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea63909-e279269b-38d357aa-c0cf223b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:04.870687Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:04.877769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea63909-e279269b-38d357aa-c0cf223b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:04.877832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:04.877847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 681
2025-09-30T14:52:04.878252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 681 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:04.878285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 681 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:04.878295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=681 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:04.878300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:04.878795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 681 sessionId:  describe result for acl check
2025-09-30T14:52:04.878832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:04.878834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:04.878836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:04.878842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895121283595524:6444] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:04.879396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895121283595524:6444] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:04.883078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895121283595524:6444] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:04.886228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895121283595524:6444] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:04.886241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895121283595524:6444] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:04.886245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895121283595524:6444] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:04.886253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 681 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:04.889527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:04.892507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:04.892784Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:04.892793Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:04.892803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:04.892850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:04.892880Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895121193867345:5341]
2025-09-30T14:52:04.893403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:04.893681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:04.893711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:04.893952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:04.893998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:04.894002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:04.894003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:04.894004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:04.894005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:04.894005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:04.894006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:04.894007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:04.894008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:04.894009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:04.894010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.894010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.894011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.894012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:04.894012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:04.894016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:04.894022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:04.894024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:04.894027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:04.894031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:04.894035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:04.894039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:04.894043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:04.894047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:04.894052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:04.894056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.894059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.894062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.894066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:04.894071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:04.894077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:04.894085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:04.894090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:04.894095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:04.894098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:04.894101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:04.894104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:04.894107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:04.894110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:04.894113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:04.894115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:04.894118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:04.894120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:04.894123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:04.894126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:04.894128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:04.894131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:04.894134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:04.894136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:04.894139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:04.894142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.894146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.894148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.894151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.894154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.894156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.894159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:04.894161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:04.894164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:04.894167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:04.894189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:04.899603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:04.900444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:04.900464Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:04.900466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:04.900470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:04.900476Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 680 [2:7555895121193867345:5341]
2025-09-30T14:52:04.900492Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:04.900506Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:04.900509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:04.900512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:04.900515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:04.900530Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:04.900536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:04.900542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:04.900602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.900611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.900613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.900617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:04.900619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:04.900683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:04.900691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.900706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:04.900717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:04.900738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:04.900760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895121193867340:5341]
2025-09-30T14:52:04.900767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895121193867340:5341]
2025-09-30T14:52:04.900769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895121193867340:5341]
2025-09-30T14:52:04.900796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:04.900807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:04.900809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:04.900810Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:04.900823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895121283595691:6444], now have 1 active actors on pipe
2025-09-30T14:52:04.900828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895121283595500:2454], now have 1 active actors on pipe
2025-09-30T14:52:04.900836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:04.900858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:04.900866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:04.900834Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 680
2025-09-30T14:52:04.900865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 680
2025-09-30T14:52:04.900901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895121193867340:5341]
2025-09-30T14:52:04.900912Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:04.900919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:04.900927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:04.900936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:04.900979Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5d12ac4-7366ff12-dc6c6caa-213bf5f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:04.900990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:04.900999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:04.901001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:04.901014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:04.901023Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:04.901045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:04.901221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:04.901236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:04.901259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:04.901368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 681 partition: 0 MaxSeqNo: 42 sessionId: src_id|c5d12ac4-7366ff12-dc6c6caa-213bf5f8_0
2025-09-30T14:52:04.901767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea63909-e279269b-38d357aa-c0cf223b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c5d12ac4-7366ff12-dc6c6caa-213bf5f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:04.904537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d12ac4-7366ff12-dc6c6caa-213bf5f8_0] Write session: try to update token
2025-09-30T14:52:04.904555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d12ac4-7366ff12-dc6c6caa-213bf5f8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:04.913304Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:04.913329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:04.913331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:04.913333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:04.913343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895121193867340:5341]
2025-09-30T14:52:04.913347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895121193867340:5341]
2025-09-30T14:52:04.913351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895121193867340:5341]
2025-09-30T14:52:04.913391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:04.913398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:04.913401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:04.913403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:04.913410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:04.913415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:04.913549Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:04.918968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 681 sessionId: src_id|c5d12ac4-7366ff12-dc6c6caa-213bf5f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:04.921720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:04.970167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895121283595781:5991]
2025-09-30T14:52:04.970538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 680, pipe: [1:7555895121283595781:5991]
2025-09-30T14:52:05.021533Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:05.022132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:05.022155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:05.022207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895121283595781:5991], now have 1 active actors on pipe
2025-09-30T14:52:05.022547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:05.022548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895121283595781:5991]
2025-09-30T14:52:05.022558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:05.022642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 681 reason: error at write: Disconnected sessionId: src_id|c5d12ac4-7366ff12-dc6c6caa-213bf5f8_0
2025-09-30T14:52:05.022663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:05.022842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 681 sessionId: src_id|c5d12ac4-7366ff12-dc6c6caa-213bf5f8_0 is DEAD
2025-09-30T14:52:05.022994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d12ac4-7366ff12-dc6c6caa-213bf5f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:05.023006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d12ac4-7366ff12-dc6c6caa-213bf5f8_0] Write session will restart in 0.005637s
2025-09-30T14:52:05.023030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d12ac4-7366ff12-dc6c6caa-213bf5f8_0] Write session: Do CDS request
2025-09-30T14:52:05.023035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d12ac4-7366ff12-dc6c6caa-213bf5f8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:05.023132Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:05.029765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d12ac4-7366ff12-dc6c6caa-213bf5f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:05.029843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:05.029858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 682
2025-09-30T14:52:05.030020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 682 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:05.030056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 682 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:05.030069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=682 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:05.030073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:05.030541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 682 sessionId:  describe result for acl check
2025-09-30T14:52:05.030580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:05.030587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:05.030589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:05.030595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895125578563099:6451] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:05.031157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895125578563099:6451] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:05.033961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895125578563099:6451] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:05.036982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895125578563099:6451] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:05.036997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895125578563099:6451] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:05.037001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895125578563099:6451] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:05.037010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 682 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:05.041888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:05.044909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:05.045116Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:05.045126Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:05.045137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:05.045187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:05.045227Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895125488834914:5344]
2025-09-30T14:52:05.045914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:05.046231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:05.046271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:05.046621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:05.046709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:05.046716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:05.046717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:05.046718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:05.046719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:05.046720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:05.046722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:05.046723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:05.046724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:05.046725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:05.046727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.046728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.046729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.046730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:05.046732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:05.046737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:05.046747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:05.046752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:05.046756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:05.046760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:05.046764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:05.046768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:05.046772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:05.046776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:05.046781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:05.046785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.046789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.046793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.046797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:05.046801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:05.046810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:05.046818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:05.046825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:05.046830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:05.046835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:05.046841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:05.046845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:05.046850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:05.046855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:05.046860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:05.046864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:05.046868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:05.046881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:05.046886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:05.046890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:05.046895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:05.046907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:05.046911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:05.046921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:05.046926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:05.046935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.046940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.046959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.046969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.046973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.046978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.046982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:05.046988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:05.046997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:05.047003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:05.047050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:05.052723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:05.053718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:05.053737Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:05.053740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:05.053745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:05.053751Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 681 [2:7555895125488834914:5344]
2025-09-30T14:52:05.053769Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:05.053785Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:05.053793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:05.053797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:05.053799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:05.053815Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:05.053827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:05.053836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:05.053896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.053903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.053905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.053909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:05.053912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:05.053977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:05.053984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.053997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.054014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.054036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:05.054058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895125578563085:2454], now have 1 active actors on pipe
2025-09-30T14:52:05.054066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895125578563237:6451], now have 1 active actors on pipe
2025-09-30T14:52:05.054071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895125488834909:5344]
2025-09-30T14:52:05.054073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895125488834909:5344]
2025-09-30T14:52:05.054074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895125488834909:5344]
2025-09-30T14:52:05.054085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:05.054095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:05.054106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:05.054112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:05.054111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:05.054116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:05.054118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:05.054144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895125488834909:5344]
2025-09-30T14:52:05.054152Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:05.054110Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 681
2025-09-30T14:52:05.054136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 681
2025-09-30T14:52:05.054175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:05.054187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:05.054191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:05.054214Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|debcdfdf-3bfb71b7-ef0aea95-66b5c21e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:05.054226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:05.054229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:05.054232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:05.054241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:05.054254Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:05.054269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:05.054507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:05.054518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:05.054537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:05.054640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 682 partition: 0 MaxSeqNo: 42 sessionId: src_id|debcdfdf-3bfb71b7-ef0aea95-66b5c21e_0
2025-09-30T14:52:05.054982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d12ac4-7366ff12-dc6c6caa-213bf5f8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|debcdfdf-3bfb71b7-ef0aea95-66b5c21e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:05.057651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|debcdfdf-3bfb71b7-ef0aea95-66b5c21e_0] Write session: try to update token
2025-09-30T14:52:05.057670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|debcdfdf-3bfb71b7-ef0aea95-66b5c21e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:05.066599Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:05.066621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:05.066624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:05.066626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:05.066634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895125488834909:5344]
2025-09-30T14:52:05.066638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895125488834909:5344]
2025-09-30T14:52:05.066643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895125488834909:5344]
2025-09-30T14:52:05.066683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:05.066690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.066693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:05.066708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:05.066717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:05.066723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:05.066839Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:05.071933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 682 sessionId: src_id|debcdfdf-3bfb71b7-ef0aea95-66b5c21e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:05.075050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:05.122771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895125578563356:5991]
2025-09-30T14:52:05.123110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 681, pipe: [1:7555895125578563356:5991]
2025-09-30T14:52:05.177337Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:05.177990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:05.178004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:05.178039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895125578563356:5991], now have 1 active actors on pipe
2025-09-30T14:52:05.178305Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:05.178301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895125578563356:5991]
2025-09-30T14:52:05.178338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:05.178341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:05.178414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 682 reason: error at write: Disconnected sessionId: src_id|debcdfdf-3bfb71b7-ef0aea95-66b5c21e_0
2025-09-30T14:52:05.178560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:05.178578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 682 sessionId: src_id|debcdfdf-3bfb71b7-ef0aea95-66b5c21e_0 is DEAD
2025-09-30T14:52:05.178755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|debcdfdf-3bfb71b7-ef0aea95-66b5c21e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:05.178768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|debcdfdf-3bfb71b7-ef0aea95-66b5c21e_0] Write session will restart in 0.007294s
2025-09-30T14:52:05.178791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|debcdfdf-3bfb71b7-ef0aea95-66b5c21e_0] Write session: Do CDS request
2025-09-30T14:52:05.178799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|debcdfdf-3bfb71b7-ef0aea95-66b5c21e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:05.187710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|debcdfdf-3bfb71b7-ef0aea95-66b5c21e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:05.187868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:05.187885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 683
2025-09-30T14:52:05.188000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 683 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:05.188029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 683 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:05.188035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=683 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:05.188040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:05.188482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 683 sessionId:  describe result for acl check
2025-09-30T14:52:05.188525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:05.188527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:05.188528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:05.188534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895125578563381:6455] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:05.189087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895125578563381:6455] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:05.191790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895125578563381:6455] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:05.195165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895125578563381:6455] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:05.195181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895125578563381:6455] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:05.195184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895125578563381:6455] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:05.195276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 683 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:05.198302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:05.201670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:05.201882Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:05.201895Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:05.201906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:05.201966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:05.202009Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895125488835178:5347]
2025-09-30T14:52:05.202663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:05.203098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:05.203218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:05.203775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:05.203902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:05.203912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:05.203914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:05.203916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:05.203917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:05.203918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:05.203919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:05.203921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:05.203922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:05.203923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:05.203925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.203926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.203927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.203928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:05.203929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:05.203936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:05.203960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:05.203965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:05.203969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:05.203973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:05.203977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:05.203982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:05.203986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:05.203989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:05.203994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:05.203998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.204006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.204009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.204013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:05.204017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:05.204028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:05.204043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:05.204054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:05.204060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:05.204066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:05.204071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:05.204089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:05.204099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:05.204105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:05.204111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:05.204123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:05.204128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:05.204134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:05.204140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:05.204146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:05.204152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:05.204162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:05.204169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:05.204177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:05.204183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:05.204190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.204206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.204227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.204233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.204244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.204251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.204256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:05.204261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:05.204266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:05.204272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:05.204316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:05.210124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:05.211043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:05.211064Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:05.211067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:05.211072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:05.211079Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 682 [2:7555895125488835178:5347]
2025-09-30T14:52:05.211098Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:05.211116Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:05.211119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:05.211122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:05.211125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:05.211141Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:05.211149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:05.211156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:05.211219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.211228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.211230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.211234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:05.211237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:05.211329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:05.211337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.211351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.211370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.211392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:05.211414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895125578563552:6455], now have 1 active actors on pipe
2025-09-30T14:52:05.211423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895125578563358:2454], now have 1 active actors on pipe
2025-09-30T14:52:05.211430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895125488835173:5347]
2025-09-30T14:52:05.211432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895125488835173:5347]
2025-09-30T14:52:05.211434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895125488835173:5347]
2025-09-30T14:52:05.211448Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:05.211467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:05.211471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:05.211474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:05.211476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:05.211485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:05.211489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:05.211525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895125488835173:5347]
2025-09-30T14:52:05.211538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:05.211557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:05.211528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 682
2025-09-30T14:52:05.211581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:05.211590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:05.211532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 682
2025-09-30T14:52:05.211621Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c0c8d5a-cb6c6993-2b2e467a-d94b85b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:05.211633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:05.211636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:05.211639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:05.211650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:05.211664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:05.211683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:05.211888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:05.211907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:05.211933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:05.212046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 683 partition: 0 MaxSeqNo: 42 sessionId: src_id|6c0c8d5a-cb6c6993-2b2e467a-d94b85b0_0
2025-09-30T14:52:05.212410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|debcdfdf-3bfb71b7-ef0aea95-66b5c21e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6c0c8d5a-cb6c6993-2b2e467a-d94b85b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:05.215197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0c8d5a-cb6c6993-2b2e467a-d94b85b0_0] Write session: try to update token
2025-09-30T14:52:05.215219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0c8d5a-cb6c6993-2b2e467a-d94b85b0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:05.224089Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:05.224110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:05.224113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:05.224116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:05.224125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895125488835173:5347]
2025-09-30T14:52:05.224129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895125488835173:5347]
2025-09-30T14:52:05.224133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895125488835173:5347]
2025-09-30T14:52:05.224170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:05.224175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.224177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:05.224189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:05.224196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:05.224200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:05.224318Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:05.230143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 683 sessionId: src_id|6c0c8d5a-cb6c6993-2b2e467a-d94b85b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:05.233109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:05.278450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895125578563626:5991]
2025-09-30T14:52:05.278803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 682, pipe: [1:7555895125578563626:5991]
2025-09-30T14:52:05.334649Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:05.335454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:05.335475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:05.335515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895125578563626:5991], now have 1 active actors on pipe
2025-09-30T14:52:05.335742Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:05.335772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:05.335787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:05.335795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:05.335841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895125578563626:5991]
2025-09-30T14:52:05.335845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 683 reason: error at write: Disconnected sessionId: src_id|6c0c8d5a-cb6c6993-2b2e467a-d94b85b0_0
2025-09-30T14:52:05.336015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 683 sessionId: src_id|6c0c8d5a-cb6c6993-2b2e467a-d94b85b0_0 is DEAD
2025-09-30T14:52:05.336175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0c8d5a-cb6c6993-2b2e467a-d94b85b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:05.336188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0c8d5a-cb6c6993-2b2e467a-d94b85b0_0] Write session will restart in 0.009088s
2025-09-30T14:52:05.336213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0c8d5a-cb6c6993-2b2e467a-d94b85b0_0] Write session: Do CDS request
2025-09-30T14:52:05.336234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0c8d5a-cb6c6993-2b2e467a-d94b85b0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:05.346790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0c8d5a-cb6c6993-2b2e467a-d94b85b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:05.346874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:05.346890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 684
2025-09-30T14:52:05.347011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 684 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:05.347042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 684 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:05.347052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=684 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:05.347056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:05.347477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 684 sessionId:  describe result for acl check
2025-09-30T14:52:05.347520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:05.347532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:05.347534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:05.347542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895125578563693:6459] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:05.348018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895125578563693:6459] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:05.350441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895125578563693:6459] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:05.353324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895125578563693:6459] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:05.353339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895125578563693:6459] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:05.353342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895125578563693:6459] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:05.353351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 684 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:05.354338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:05.357025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:05.357376Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:05.357392Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:05.357407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:05.357496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:05.357542Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895125488835441:5349]
2025-09-30T14:52:05.358206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:05.358571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:05.358631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:05.358987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:05.359075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:05.359083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:05.359085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:05.359086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:05.359087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:05.359089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:05.359090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:05.359091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:05.359093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:05.359094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:05.359096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.359097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.359098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.359100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:05.359101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:05.359107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:05.359119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:05.359123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:05.359127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:05.359132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:05.359136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:05.359141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:05.359144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:05.359148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:05.359152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:05.359156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.359160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.359163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.359167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:05.359171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:05.359180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:05.359187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:05.359194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:05.359199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:05.359207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:05.359213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:05.359218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:05.359223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:05.359228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:05.359234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:05.359238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:05.359260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:05.359266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:05.359271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:05.359283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:05.359288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:05.359293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:05.359298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:05.359308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:05.359314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:05.359322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.359331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.359334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.359339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.359343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.359349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.359358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:05.359364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:05.359368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:05.359374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:05.359423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:05.364827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:05.365631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:05.365645Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:05.365647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:05.365650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:05.365655Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 683 [2:7555895125488835441:5349]
2025-09-30T14:52:05.365669Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:05.365681Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:05.365684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:05.365686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:05.365687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:05.365700Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:05.365709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:05.365721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:05.365785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.365795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.365798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.365802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:05.365804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:05.366041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 683
2025-09-30T14:52:05.366043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 683
2025-09-30T14:52:05.366224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:05.366232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.366240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.366253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.366272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:05.366296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895125578563884:6459], now have 1 active actors on pipe
2025-09-30T14:52:05.366304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895125578563628:2454], now have 1 active actors on pipe
2025-09-30T14:52:05.366317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:05.366325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:05.366343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895125488835436:5349]
2025-09-30T14:52:05.366350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895125488835436:5349]
2025-09-30T14:52:05.366352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895125488835436:5349]
2025-09-30T14:52:05.366364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:05.366391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:05.366401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:05.366405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:05.366406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:05.366407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:05.366409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:05.366425Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9248be4-36803353-def0b896-cb6bb388_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:05.366437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:05.366440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:05.366445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:05.366454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:05.366466Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:05.366504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895125488835436:5349]
2025-09-30T14:52:05.366517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:05.366524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:05.366527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:05.366845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:05.366860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:05.366879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:05.367012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 684 partition: 0 MaxSeqNo: 42 sessionId: src_id|9248be4-36803353-def0b896-cb6bb388_0
2025-09-30T14:52:05.367425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0c8d5a-cb6c6993-2b2e467a-d94b85b0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9248be4-36803353-def0b896-cb6bb388_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:05.370096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9248be4-36803353-def0b896-cb6bb388_0] Write session: try to update token
2025-09-30T14:52:05.370113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9248be4-36803353-def0b896-cb6bb388_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:05.379096Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:05.379136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:05.379146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895125488835436:5349]
2025-09-30T14:52:05.379194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:05.379197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:05.379481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:05.379665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:05.379844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:05.380000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:05.380203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:05.380249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:05.384803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 684 sessionId: src_id|9248be4-36803353-def0b896-cb6bb388_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:05.387662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:05.387878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:05.387901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:05.387948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:05.388031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:05.389506Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:05.389521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:05.389523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:05.389525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:05.389535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895125488835436:5349]
2025-09-30T14:52:05.389539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895125488835436:5349]
2025-09-30T14:52:05.389543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895125488835436:5349]
2025-09-30T14:52:05.389584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:05.389588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:05.389593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.389595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:05.389596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:05.389599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:05.389725Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:05.436117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895125578563898:5991]
2025-09-30T14:52:05.436389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 683, pipe: [1:7555895125578563898:5991]
2025-09-30T14:52:05.500937Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:05.509244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:05.509278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:05.509450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:05.509514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:05.509586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:05.509656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:05.509710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:05.509721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:05.509792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:05.509857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:05.509923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:05.509991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:05.510036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:05.510044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:05.510108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:05.510178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:05.510237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:05.510294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:05.510334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:05.510341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:05.510427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:05.510490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:05.510561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:05.510626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:05.510673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:05.510681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:05.510747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:05.510814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:05.510881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:05.510950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:05.510996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:05.511005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:05.511071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:05.511133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:05.511211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:05.511289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:05.511338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:05.511347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:05.511415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:05.511473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:05.511539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:05.511607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:05.511652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:05.511659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:05.511725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:05.511787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:05.511858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:05.511921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:05.511966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:05.511973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:05.512037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:05.512101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:05.512167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:05.512233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:05.512275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:05.512283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:05.512347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:05.512408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:05.512474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:05.512537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:05.512580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:05.512587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:05.512662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895125578563898:5991], now have 1 active actors on pipe
2025-09-30T14:52:05.512915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:05.512927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:05.512945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895125578563898:5991]
2025-09-30T14:52:05.512953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 684 reason: error at write: Disconnected sessionId: src_id|9248be4-36803353-def0b896-cb6bb388_0
2025-09-30T14:52:05.512972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:05.513147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 684 sessionId: src_id|9248be4-36803353-def0b896-cb6bb388_0 is DEAD
2025-09-30T14:52:05.513318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9248be4-36803353-def0b896-cb6bb388_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:05.513331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9248be4-36803353-def0b896-cb6bb388_0] Write session will restart in 0.005747s
2025-09-30T14:52:05.513374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9248be4-36803353-def0b896-cb6bb388_0] Write session: Do CDS request
2025-09-30T14:52:05.513380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9248be4-36803353-def0b896-cb6bb388_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:05.513838Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:05.520783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9248be4-36803353-def0b896-cb6bb388_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:05.520929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:05.520946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 685
2025-09-30T14:52:05.521074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 685 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:05.521110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 685 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:05.521136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=685 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:05.521144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:05.521562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 685 sessionId:  describe result for acl check
2025-09-30T14:52:05.521590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:05.521596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:05.521598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:05.521603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895125578563917:6464] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:05.522028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895125578563917:6464] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:05.524907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895125578563917:6464] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:05.528503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895125578563917:6464] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:05.528520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895125578563917:6464] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:05.528524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895125578563917:6464] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:05.528546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 685 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:05.532877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:05.536116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:05.536350Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:05.536361Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:05.536373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:05.536435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:05.536484Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895125488835707:5351]
2025-09-30T14:52:05.537198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:05.537528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:05.537577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:05.537931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:05.537996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:05.538003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:05.538004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:05.538006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:05.538008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:05.538009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:05.538010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:05.538012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:05.538014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:05.538015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:05.538016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.538018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.538019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.538020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:05.538022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:05.538027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:05.538039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:05.538044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:05.538049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:05.538053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:05.538058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:05.538063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:05.538068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:05.538072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:05.538077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:05.538081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.538086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.538090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.538095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:05.538099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:05.538107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:05.538116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:05.538122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:05.538129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:05.538135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:05.538141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:05.538153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:05.538158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:05.538164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:05.538176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:05.538181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:05.538193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:05.538198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:05.538208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:05.538213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:05.538219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:05.538230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:05.538237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:05.538247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:05.538253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:05.538261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.538271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.538276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.538289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.538296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.538307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.538312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:05.538322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:05.538329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:05.538339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:05.538403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:05.544002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:05.545471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:05.545491Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:05.545494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:05.545498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:05.545505Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 684 [2:7555895125488835707:5351]
2025-09-30T14:52:05.545523Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:05.545540Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:05.545548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:05.545551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:05.545553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:05.545570Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:05.545583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:05.545590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:05.545658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.545665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.545668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.545671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:05.545674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:05.545746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:05.545754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.545770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.545789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.545812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:05.545836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895125578563902:2454], now have 1 active actors on pipe
2025-09-30T14:52:05.545848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895125578564077:6464], now have 1 active actors on pipe
2025-09-30T14:52:05.545854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895125488835702:5351]
2025-09-30T14:52:05.545857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895125488835702:5351]
2025-09-30T14:52:05.545859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895125488835702:5351]
2025-09-30T14:52:05.545876Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:05.545890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:05.545907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:05.545910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:05.545913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:05.545918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:05.545920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:05.545946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895125488835702:5351]
2025-09-30T14:52:05.545906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 684
2025-09-30T14:52:05.545955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:05.545907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 684
2025-09-30T14:52:05.545958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:05.545976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:05.545981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:05.546033Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f7409b9-3a571913-92c3ada-95dd671d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:05.546047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:05.546055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:05.546057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:05.546067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:05.546081Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:05.546110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:05.546293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:05.546302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:05.546316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:05.546391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 685 partition: 0 MaxSeqNo: 42 sessionId: src_id|6f7409b9-3a571913-92c3ada-95dd671d_0
2025-09-30T14:52:05.546799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9248be4-36803353-def0b896-cb6bb388_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6f7409b9-3a571913-92c3ada-95dd671d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:05.549683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f7409b9-3a571913-92c3ada-95dd671d_0] Write session: try to update token
2025-09-30T14:52:05.549704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f7409b9-3a571913-92c3ada-95dd671d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:05.558551Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:05.558575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:05.558578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:05.558580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:05.558590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895125488835702:5351]
2025-09-30T14:52:05.558595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895125488835702:5351]
2025-09-30T14:52:05.558600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895125488835702:5351]
2025-09-30T14:52:05.558643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:05.558656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.558659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:05.558665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:05.558672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:05.558677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:05.558807Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:05.565432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 685 sessionId: src_id|6f7409b9-3a571913-92c3ada-95dd671d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:05.568270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:05.613259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895125578564174:5991]
2025-09-30T14:52:05.613582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 684, pipe: [1:7555895125578564174:5991]
2025-09-30T14:52:05.679231Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:05.679597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:05.679613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:05.679630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895125578564174:5991], now have 1 active actors on pipe
2025-09-30T14:52:05.679821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:05.679839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:05.679896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 685 reason: error at write: Disconnected sessionId: src_id|6f7409b9-3a571913-92c3ada-95dd671d_0
2025-09-30T14:52:05.679900Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:05.680097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 685 sessionId: src_id|6f7409b9-3a571913-92c3ada-95dd671d_0 is DEAD
2025-09-30T14:52:05.680258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:05.680273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f7409b9-3a571913-92c3ada-95dd671d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:05.680297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f7409b9-3a571913-92c3ada-95dd671d_0] Write session will restart in 0.006552s
2025-09-30T14:52:05.680296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895125578564174:5991]
2025-09-30T14:52:05.680320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f7409b9-3a571913-92c3ada-95dd671d_0] Write session: Do CDS request
2025-09-30T14:52:05.680326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f7409b9-3a571913-92c3ada-95dd671d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:05.687745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f7409b9-3a571913-92c3ada-95dd671d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:05.687816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:05.687831Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 686
2025-09-30T14:52:05.687992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 686 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:05.688024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 686 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:05.688029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=686 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:05.688037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:05.688421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 686 sessionId:  describe result for acl check
2025-09-30T14:52:05.688460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:05.688462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:05.688464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:05.688469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895125578564224:6475] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:05.688999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895125578564224:6475] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:05.691975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895125578564224:6475] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:05.695377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895125578564224:6475] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:05.695403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895125578564224:6475] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:05.695406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895125578564224:6475] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:05.695413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 686 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:05.698280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:05.700744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:05.700977Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:05.700988Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:05.700999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:05.701056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:05.701100Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895125488836008:5362]
2025-09-30T14:52:05.701805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:05.702077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:05.702121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:05.702469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:05.702533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:05.702540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:05.702541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:05.702542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:05.702544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:05.702545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:05.702547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:05.702548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:05.702549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:05.702551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:05.702552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.702553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.702555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.702556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:05.702558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:05.702563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:05.702575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:05.702580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:05.702584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:05.702590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:05.702594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:05.702599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:05.702604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:05.702608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:05.702614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:05.702623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.702627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.702632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.702636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:05.702641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:05.702648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:05.702662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:05.702669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:05.702676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:05.702686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:05.702691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:05.702699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:05.702704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:05.702710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:05.702719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:05.702723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:05.702734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:05.702739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:05.702749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:05.702754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:05.702764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:05.702771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:05.702781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:05.702786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:05.702792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:05.702797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.702802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.702807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.702813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.702818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.702828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.702833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:05.702843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:05.702852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:05.702862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:05.702913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:05.708538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:05.709936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:05.709956Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:05.709959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:05.709964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:05.709971Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 685 [2:7555895125488836008:5362]
2025-09-30T14:52:05.709988Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:05.710002Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:05.710004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:05.710007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:05.710009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:05.710025Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:05.710040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:05.710046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:05.710101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.710110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.710112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.710116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:05.710119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:05.710192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:05.710200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.710214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.710232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.710257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:05.710279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895125578564200:2454], now have 1 active actors on pipe
2025-09-30T14:52:05.710288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895125578564418:6475], now have 1 active actors on pipe
2025-09-30T14:52:05.710294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895125488836003:5362]
2025-09-30T14:52:05.710301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895125488836003:5362]
2025-09-30T14:52:05.710304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895125488836003:5362]
2025-09-30T14:52:05.710317Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:05.710331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:05.710332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:05.710336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:05.710338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:05.710352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:05.710355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:05.710312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 685
2025-09-30T14:52:05.710324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 685
2025-09-30T14:52:05.710420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:05.710430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:05.710443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895125488836003:5362]
2025-09-30T14:52:05.710455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:05.710470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:05.710487Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b43be5fb-8f282a54-12874ef5-b41a73c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:05.710498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:05.710502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:05.710509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:05.710518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:05.710532Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:05.710562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:05.710694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:05.710703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:05.710718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:05.710838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 686 partition: 0 MaxSeqNo: 42 sessionId: src_id|b43be5fb-8f282a54-12874ef5-b41a73c1_0
2025-09-30T14:52:05.711218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f7409b9-3a571913-92c3ada-95dd671d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b43be5fb-8f282a54-12874ef5-b41a73c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:05.714041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b43be5fb-8f282a54-12874ef5-b41a73c1_0] Write session: try to update token
2025-09-30T14:52:05.714067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b43be5fb-8f282a54-12874ef5-b41a73c1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:05.722335Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:05.722361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:05.722364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:05.722366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:05.722393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895125488836003:5362]
2025-09-30T14:52:05.722401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895125488836003:5362]
2025-09-30T14:52:05.722406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895125488836003:5362]
2025-09-30T14:52:05.722450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:05.722459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.722462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:05.722468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:05.722468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:05.722476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:05.722625Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:05.728748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 686 sessionId: src_id|b43be5fb-8f282a54-12874ef5-b41a73c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:05.731675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:05.780683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895125578564469:5991]
2025-09-30T14:52:05.780955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 685, pipe: [1:7555895125578564469:5991]
2025-09-30T14:52:05.831804Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:05.832339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:05.832354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:05.832371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895125578564469:5991], now have 1 active actors on pipe
2025-09-30T14:52:05.832542Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:05.832635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:05.832737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 686 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b43be5fb-8f282a54-12874ef5-b41a73c1_0
2025-09-30T14:52:05.832748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:05.832807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895125578564469:5991]
2025-09-30T14:52:05.832938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 686 sessionId: src_id|b43be5fb-8f282a54-12874ef5-b41a73c1_0 is DEAD
2025-09-30T14:52:05.833108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b43be5fb-8f282a54-12874ef5-b41a73c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:05.833120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b43be5fb-8f282a54-12874ef5-b41a73c1_0] Write session will restart in 0.005628s
2025-09-30T14:52:05.833161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b43be5fb-8f282a54-12874ef5-b41a73c1_0] Write session: Do CDS request
2025-09-30T14:52:05.833168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b43be5fb-8f282a54-12874ef5-b41a73c1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:05.839730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b43be5fb-8f282a54-12874ef5-b41a73c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:05.839812Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:05.839828Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 687
2025-09-30T14:52:05.839988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 687 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:05.840024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 687 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:05.840034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=687 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:05.840038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:05.840512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 687 sessionId:  describe result for acl check
2025-09-30T14:52:05.840545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:05.840547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:05.840549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:05.840554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895125578564493:6479] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:05.841095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895125578564493:6479] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:05.843387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895125578564493:6479] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:05.846383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895125578564493:6479] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:05.846398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895125578564493:6479] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:05.846401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895125578564493:6479] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:05.846408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 687 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:05.851304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:05.854511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:05.854759Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:05.854778Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:05.854790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:05.854851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:05.854891Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895125488836274:5368]
2025-09-30T14:52:05.855622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:05.855951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:05.855996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:05.856361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:05.856425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:05.856433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:05.856434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:05.856435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:05.856436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:05.856437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:05.856438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:05.856440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:05.856441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:05.856442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:05.856443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.856445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.856446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.856447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:05.856448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:05.856453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:05.856464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:05.856469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:05.856473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:05.856477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:05.856482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:05.856486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:05.856490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:05.856494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:05.856499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:05.856503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.856507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.856511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.856515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:05.856520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:05.856529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:05.856537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:05.856543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:05.856549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:05.856553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:05.856561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:05.856565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:05.856571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:05.856576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:05.856582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:05.856586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:05.856591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:05.856596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:05.856602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:05.856607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:05.856612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:05.856618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:05.856625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:05.856629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:05.856635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:05.856640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.856646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.856651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.856656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.856661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.856672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.856676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:05.856682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:05.856691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:05.856696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:05.856742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:05.862723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:05.863676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:05.863695Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:05.863701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:05.863707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:05.863716Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 686 [2:7555895125488836274:5368]
2025-09-30T14:52:05.863737Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:05.863754Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:05.863763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:05.863767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:05.863770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:05.863787Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:05.863800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:05.863805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:05.863858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.863867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.863871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.863873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:05.863875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:05.863943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:05.863950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.863961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:05.863972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:05.863981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:05.863999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895125578564627:6479], now have 1 active actors on pipe
2025-09-30T14:52:05.864008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895125488836269:5368]
2025-09-30T14:52:05.864010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895125488836269:5368]
2025-09-30T14:52:05.864011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895125488836269:5368]
2025-09-30T14:52:05.864021Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:05.864027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895125578564471:2454], now have 1 active actors on pipe
2025-09-30T14:52:05.864033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:05.864041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:05.864044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:05.864045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:05.864049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:05.864051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:05.864081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895125488836269:5368]
2025-09-30T14:52:05.864095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:05.864116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:05.864092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 686
2025-09-30T14:52:05.864100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 686
2025-09-30T14:52:05.864164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:05.864173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:05.864202Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84d757-cbc30b7d-f24cd678-d42765fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:05.864215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:05.864219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:05.864221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:05.864231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:05.864245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:05.864262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:05.864408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:05.864417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:05.864432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:05.864521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 687 partition: 0 MaxSeqNo: 42 sessionId: src_id|84d757-cbc30b7d-f24cd678-d42765fb_0
2025-09-30T14:52:05.864939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b43be5fb-8f282a54-12874ef5-b41a73c1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|84d757-cbc30b7d-f24cd678-d42765fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:05.867987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84d757-cbc30b7d-f24cd678-d42765fb_0] Write session: try to update token
2025-09-30T14:52:05.868008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84d757-cbc30b7d-f24cd678-d42765fb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:05.877599Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:05.877619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:05.877627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895125488836269:5368]
2025-09-30T14:52:05.877664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:05.877666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:05.877832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:05.877980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:05.878124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:05.878279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:05.878528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:05.878580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:05.883585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 687 sessionId: src_id|84d757-cbc30b7d-f24cd678-d42765fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:05.886494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:05.886832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:05.886860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:05.886898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:05.887008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:05.888502Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:05.888518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:05.888521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:05.888524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:05.888533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895125488836269:5368]
2025-09-30T14:52:05.888538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895125488836269:5368]
2025-09-30T14:52:05.888543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895125488836269:5368]
2025-09-30T14:52:05.888577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:05.888584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:05.888587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:05.888587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:05.888603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:05.888611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:05.888723Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:05.932744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895125578564743:5991]
2025-09-30T14:52:05.933227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 686, pipe: [1:7555895125578564743:5991]
2025-09-30T14:52:05.995065Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:06.002111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:06.002138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:06.002280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:06.002338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:06.002413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:06.002485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:06.002534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:06.002545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:06.002607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:06.002663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:06.002726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:06.002787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:06.002830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:06.002836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:06.002897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:06.002953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:06.003016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:06.003074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:06.003115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:06.003123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:06.003187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:06.003274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:06.003355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:06.003430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:06.003472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:06.003478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:06.003539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:06.003596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:06.003669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:06.003736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:06.003787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:06.003797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:06.003867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:06.003935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:06.003995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:06.004053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:06.004106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:06.004113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:06.004178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:06.004237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:06.004296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:06.004354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:06.004395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:06.004401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:06.004461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:06.004516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:06.004575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:06.004641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:06.004684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:06.004689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:06.004750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:06.004805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:06.004873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:06.004943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:06.004985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:06.004991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:06.005054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:06.005107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:06.005170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:06.005230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:06.005275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:06.005282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:06.005324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895125578564743:5991], now have 1 active actors on pipe
2025-09-30T14:52:06.005556Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:06.005570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:06.005574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:06.005603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 687 reason: error at write: Disconnected sessionId: src_id|84d757-cbc30b7d-f24cd678-d42765fb_0
2025-09-30T14:52:06.005625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895125578564743:5991]
2025-09-30T14:52:06.005793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 687 sessionId: src_id|84d757-cbc30b7d-f24cd678-d42765fb_0 is DEAD
2025-09-30T14:52:06.005916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84d757-cbc30b7d-f24cd678-d42765fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:06.005927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84d757-cbc30b7d-f24cd678-d42765fb_0] Write session will restart in 0.006806s
2025-09-30T14:52:06.005976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84d757-cbc30b7d-f24cd678-d42765fb_0] Write session: Do CDS request
2025-09-30T14:52:06.005982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84d757-cbc30b7d-f24cd678-d42765fb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:06.006538Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:06.013725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84d757-cbc30b7d-f24cd678-d42765fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:06.013792Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:06.013808Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 688
2025-09-30T14:52:06.013968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 688 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:06.013995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 688 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:06.013998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=688 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:06.014001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:06.014418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 688 sessionId:  describe result for acl check
2025-09-30T14:52:06.014459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:06.014465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:06.014468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:06.014474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895129873532093:6486] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:06.015002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895129873532093:6486] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:06.018883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895129873532093:6486] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:06.022158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895129873532093:6486] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:06.022169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895129873532093:6486] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:06.022172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895129873532093:6486] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:06.022178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 688 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:06.024390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:06.027136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:06.027394Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:06.027406Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:06.027420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:06.027483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:06.027531Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895129783803849:5371]
2025-09-30T14:52:06.028236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:06.028631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:06.028691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:06.029052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:06.029125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:06.029129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:06.029131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:06.029132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:06.029133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:06.029135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:06.029137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:06.029138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:06.029140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:06.029141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:06.029142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.029144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.029145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.029146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:06.029148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:06.029154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:06.029164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:06.029169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:06.029173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:06.029178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:06.029182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:06.029186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:06.029190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:06.029195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:06.029200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:06.029210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.029214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.029223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.029227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:06.029236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:06.029244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:06.029257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:06.029268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:06.029279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:06.029289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:06.029300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:06.029305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:06.029312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:06.029318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:06.029330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:06.029339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:06.029348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:06.029359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:06.029369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:06.029380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:06.029386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:06.029397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:06.029409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:06.029414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:06.029420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:06.029431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.029438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.029446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.029457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.029463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.029473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.029482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:06.029489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:06.029494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:06.029500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:06.029549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:06.035441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:06.036890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:06.036906Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:06.036908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:06.036911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:06.036916Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 687 [2:7555895129783803849:5371]
2025-09-30T14:52:06.036929Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:06.036943Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:06.036947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:06.036949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:06.036950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:06.036965Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:06.036971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:06.036979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:06.037034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.037041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.037043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.037046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:06.037047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:06.037103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:06.037109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.037119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.037130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.037140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:06.037153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895129783803844:5371]
2025-09-30T14:52:06.037159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895129783803844:5371]
2025-09-30T14:52:06.037160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895129783803844:5371]
2025-09-30T14:52:06.037166Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:06.037176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:06.037180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:06.037183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:06.037186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:06.037189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:06.037191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:06.037198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895129873532060:2454], now have 1 active actors on pipe
2025-09-30T14:52:06.037201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895129873532314:6486], now have 1 active actors on pipe
2025-09-30T14:52:06.037229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895129783803844:5371]
2025-09-30T14:52:06.037243Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:06.037263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:06.037280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 687
2025-09-30T14:52:06.037334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:06.037289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 687
2025-09-30T14:52:06.037345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:06.037374Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79e25e76-4fdc816a-38530389-743f0f3f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:06.037385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:06.037389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:06.037392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:06.037401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:06.037415Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:06.037427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:06.037599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:06.037607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:06.037622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:06.037735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 688 partition: 0 MaxSeqNo: 42 sessionId: src_id|79e25e76-4fdc816a-38530389-743f0f3f_0
2025-09-30T14:52:06.038114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84d757-cbc30b7d-f24cd678-d42765fb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|79e25e76-4fdc816a-38530389-743f0f3f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:06.040943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79e25e76-4fdc816a-38530389-743f0f3f_0] Write session: try to update token
2025-09-30T14:52:06.040965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79e25e76-4fdc816a-38530389-743f0f3f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:06.049307Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:06.049332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:06.049345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895129783803844:5371]
2025-09-30T14:52:06.049393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:06.049396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:06.049584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:06.049743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:06.049914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:06.050081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:06.050317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:06.050394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:06.056024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 688 sessionId: src_id|79e25e76-4fdc816a-38530389-743f0f3f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:06.058823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:06.060022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:06.060046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:06.060063Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:06.060065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:06.060067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:06.060069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:06.060076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895129783803844:5371]
2025-09-30T14:52:06.060079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895129783803844:5371]
2025-09-30T14:52:06.060082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895129783803844:5371]
2025-09-30T14:52:06.060121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:06.060129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:06.060132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.060136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:06.060136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:06.060140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:06.060278Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:06.105815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895129873532338:5991]
2025-09-30T14:52:06.106146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 687, pipe: [1:7555895129873532338:5991]
2025-09-30T14:52:06.171408Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:06.171911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:06.171948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895129873532338:5991], now have 1 active actors on pipe
2025-09-30T14:52:06.172088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:06.172176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895129873532338:5991]
2025-09-30T14:52:06.172251Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:06.183721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:06.183736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:06.183758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 688 reason: error at write: Disconnected sessionId: src_id|79e25e76-4fdc816a-38530389-743f0f3f_0
2025-09-30T14:52:06.183892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 688 sessionId: src_id|79e25e76-4fdc816a-38530389-743f0f3f_0 is DEAD
2025-09-30T14:52:06.184033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79e25e76-4fdc816a-38530389-743f0f3f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:06.184041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79e25e76-4fdc816a-38530389-743f0f3f_0] Write session will restart in 0.009453s
2025-09-30T14:52:06.184063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79e25e76-4fdc816a-38530389-743f0f3f_0] Write session: Do CDS request
2025-09-30T14:52:06.184070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79e25e76-4fdc816a-38530389-743f0f3f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:06.194822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79e25e76-4fdc816a-38530389-743f0f3f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:06.195438Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:06.195453Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 689
2025-09-30T14:52:06.195566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 689 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:06.195599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 689 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:06.195610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=689 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:06.195615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:06.196070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 689 sessionId:  describe result for acl check
2025-09-30T14:52:06.196105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:06.196112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:06.196125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:06.196135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895129873532568:6490] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:06.196625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895129873532568:6490] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:06.197607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:06.199052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895129873532568:6490] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:06.200619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:06.200826Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:06.200838Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:06.200849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:06.200906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:06.200950Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895129783804118:5374]
2025-09-30T14:52:06.201626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:06.201747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895129873532568:6490] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:06.201764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895129873532568:6490] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:06.201767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895129873532568:6490] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:06.201776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 689 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:06.201928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:06.201971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:06.202306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:06.202367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:06.202385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:06.202386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:06.202388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:06.202389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:06.202390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:06.202391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:06.202392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:06.202394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:06.202395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:06.202396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.202397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.202398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.202399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:06.202400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:06.202406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:06.202417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:06.202421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:06.202426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:06.202430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:06.202434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:06.202438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:06.202442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:06.202446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:06.202451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:06.202455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.202459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.202463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.202467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:06.202470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:06.202477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:06.202486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:06.202491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:06.202506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:06.202511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:06.202517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:06.202522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:06.202527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:06.202532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:06.202538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:06.202542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:06.202547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:06.202551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:06.202556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:06.202560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:06.202564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:06.202569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:06.202575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:06.202579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:06.202584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:06.202590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.202595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.202601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.202606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.202616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.202621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.202627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:06.202637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:06.202642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:06.202647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:06.202699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:06.208489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:06.209349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:06.209367Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:06.209370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:06.209375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:06.209382Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 688 [2:7555895129783804118:5374]
2025-09-30T14:52:06.209405Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:06.209426Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:06.209429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:06.209437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:06.209440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:06.209458Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:06.209470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:06.209477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:06.209551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.209558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.209560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.209564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:06.209567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:06.209634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:06.209644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.209656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.209667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.209683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:06.209701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895129873532340:2454], now have 1 active actors on pipe
2025-09-30T14:52:06.209710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895129873532607:6490], now have 1 active actors on pipe
2025-09-30T14:52:06.209716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895129783804113:5374]
2025-09-30T14:52:06.209718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895129783804113:5374]
2025-09-30T14:52:06.209720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895129783804113:5374]
2025-09-30T14:52:06.209737Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:06.209754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:06.209765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:06.209774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:06.209775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:06.209777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:06.209777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:06.209765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 688
2025-09-30T14:52:06.209771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 688
2025-09-30T14:52:06.209812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895129783804113:5374]
2025-09-30T14:52:06.209827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:06.209833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:06.209856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:06.209867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:06.209900Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e76be79a-2db16a06-42547514-63b819ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:06.209913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:06.209917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:06.209919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:06.209929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:06.209938Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:06.209962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:06.210141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:06.210163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:06.210191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:06.210286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 689 partition: 0 MaxSeqNo: 42 sessionId: src_id|e76be79a-2db16a06-42547514-63b819ce_0
2025-09-30T14:52:06.210661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79e25e76-4fdc816a-38530389-743f0f3f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e76be79a-2db16a06-42547514-63b819ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:06.213636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e76be79a-2db16a06-42547514-63b819ce_0] Write session: try to update token
2025-09-30T14:52:06.213656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e76be79a-2db16a06-42547514-63b819ce_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:06.222105Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:06.222127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:06.222130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:06.222132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:06.222142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895129783804113:5374]
2025-09-30T14:52:06.222146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895129783804113:5374]
2025-09-30T14:52:06.222151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895129783804113:5374]
2025-09-30T14:52:06.222193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:06.222199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.222202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:06.222205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:06.222212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:06.222216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:06.222349Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:06.228346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 689 sessionId: src_id|e76be79a-2db16a06-42547514-63b819ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:06.231314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:06.272213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895129873532616:5991]
2025-09-30T14:52:06.272502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 688, pipe: [1:7555895129873532616:5991]
2025-09-30T14:52:06.333111Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:06.333805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:06.333820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:06.333854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895129873532616:5991], now have 1 active actors on pipe
2025-09-30T14:52:06.334032Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:06.334112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895129873532616:5991]
2025-09-30T14:52:06.334118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:06.334149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:06.334219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 689 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e76be79a-2db16a06-42547514-63b819ce_0
2025-09-30T14:52:06.334409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 689 sessionId: src_id|e76be79a-2db16a06-42547514-63b819ce_0 is DEAD
2025-09-30T14:52:06.334610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e76be79a-2db16a06-42547514-63b819ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:06.334620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e76be79a-2db16a06-42547514-63b819ce_0] Write session will restart in 0.009756s
2025-09-30T14:52:06.334659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e76be79a-2db16a06-42547514-63b819ce_0] Write session: Do CDS request
2025-09-30T14:52:06.334665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e76be79a-2db16a06-42547514-63b819ce_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:06.345770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e76be79a-2db16a06-42547514-63b819ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:06.345889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:06.345906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 690
2025-09-30T14:52:06.346037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 690 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:06.346067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 690 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:06.346080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=690 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:06.346085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:06.346594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 690 sessionId:  describe result for acl check
2025-09-30T14:52:06.346630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:06.346633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:06.346635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:06.346641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895129873532697:6494] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:06.347207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895129873532697:6494] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:06.349962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895129873532697:6494] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:06.352789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895129873532697:6494] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:06.352803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895129873532697:6494] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:06.352806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895129873532697:6494] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:06.352816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 690 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:06.353122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:06.355767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:06.355977Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:06.355987Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:06.355998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:06.356072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:06.356112Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895129783804388:5376]
2025-09-30T14:52:06.356772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:06.357052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:06.357094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:06.357418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:06.357484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:06.357491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:06.357492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:06.357493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:06.357494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:06.357495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:06.357496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:06.357498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:06.357499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:06.357500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:06.357501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.357502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.357503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.357505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:06.357506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:06.357511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:06.357521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:06.357524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:06.357528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:06.357531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:06.357535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:06.357538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:06.357542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:06.357545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:06.357549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:06.357553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.357557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.357561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.357564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:06.357567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:06.357576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:06.357584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:06.357589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:06.357595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:06.357600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:06.357605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:06.357609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:06.357615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:06.357619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:06.357624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:06.357634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:06.357639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:06.357644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:06.357654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:06.357658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:06.357662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:06.357667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:06.357671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:06.357677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:06.357681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:06.357691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.357697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.357705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.357710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.357715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.357719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.357723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:06.357728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:06.357733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:06.357737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:06.357779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:06.363210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:06.364338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:06.364355Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:06.364357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:06.364360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:06.364365Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 689 [2:7555895129783804388:5376]
2025-09-30T14:52:06.364378Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:06.364393Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:06.364396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:06.364399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:06.364402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:06.364416Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:06.364423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:06.364430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:06.364487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.364494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.364496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.364498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:06.364500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:06.364554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:06.364562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.364571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.364577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.364599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:06.364616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895129783804383:5376]
2025-09-30T14:52:06.364618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895129783804383:5376]
2025-09-30T14:52:06.364620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895129783804383:5376]
2025-09-30T14:52:06.364627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:06.364636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:06.364642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:06.364646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:06.364647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:06.364650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:06.364652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:06.364660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895129873532883:6494], now have 1 active actors on pipe
2025-09-30T14:52:06.364663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895129873532618:2454], now have 1 active actors on pipe
2025-09-30T14:52:06.364690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895129783804383:5376]
2025-09-30T14:52:06.364703Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:06.364718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:06.364771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 689
2025-09-30T14:52:06.364791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 689
2025-09-30T14:52:06.364862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:06.364882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:06.364915Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a5db516-ddd0497d-8c11dfb-e0573982_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:06.364929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:06.364946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:06.364949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:06.364960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:06.364977Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:06.364998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:06.365210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:06.365222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:06.365255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:06.365381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 690 partition: 0 MaxSeqNo: 42 sessionId: src_id|7a5db516-ddd0497d-8c11dfb-e0573982_0
2025-09-30T14:52:06.365754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e76be79a-2db16a06-42547514-63b819ce_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7a5db516-ddd0497d-8c11dfb-e0573982_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:06.368700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5db516-ddd0497d-8c11dfb-e0573982_0] Write session: try to update token
2025-09-30T14:52:06.368716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5db516-ddd0497d-8c11dfb-e0573982_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:06.376849Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:06.376867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:06.376870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:06.376873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:06.376884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895129783804383:5376]
2025-09-30T14:52:06.376888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895129783804383:5376]
2025-09-30T14:52:06.376893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895129783804383:5376]
2025-09-30T14:52:06.376928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:06.376931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:06.376935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:06.376939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.376939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:06.376941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:06.377104Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:06.383378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 690 sessionId: src_id|7a5db516-ddd0497d-8c11dfb-e0573982_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:06.386023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:06.434521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895129873532895:5991]
2025-09-30T14:52:06.434861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 689, pipe: [1:7555895129873532895:5991]
2025-09-30T14:52:06.483296Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:06.483564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:06.483576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:06.483613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895129873532895:5991], now have 1 active actors on pipe
2025-09-30T14:52:06.483811Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:06.483857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895129873532895:5991]
2025-09-30T14:52:06.483883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:06.483887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:06.483889Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:06.483941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 690 reason: error at write: Disconnected sessionId: src_id|7a5db516-ddd0497d-8c11dfb-e0573982_0
2025-09-30T14:52:06.484115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 690 sessionId: src_id|7a5db516-ddd0497d-8c11dfb-e0573982_0 is DEAD
2025-09-30T14:52:06.484279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5db516-ddd0497d-8c11dfb-e0573982_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:06.484290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5db516-ddd0497d-8c11dfb-e0573982_0] Write session will restart in 0.009689s
2025-09-30T14:52:06.484311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5db516-ddd0497d-8c11dfb-e0573982_0] Write session: Do CDS request
2025-09-30T14:52:06.484316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5db516-ddd0497d-8c11dfb-e0573982_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:06.494797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5db516-ddd0497d-8c11dfb-e0573982_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:06.494890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:06.494905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 691
2025-09-30T14:52:06.495023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 691 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:06.495055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 691 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:06.495065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=691 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:06.495071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:06.495527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 691 sessionId:  describe result for acl check
2025-09-30T14:52:06.495565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:06.495572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:06.495574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:06.495580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895129873532974:6499] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:06.496044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895129873532974:6499] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:06.499101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895129873532974:6499] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:06.501840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895129873532974:6499] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:06.501858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895129873532974:6499] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:06.501862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895129873532974:6499] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:06.501870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 691 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:06.502820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:06.505675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:06.505887Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:06.505897Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:06.505908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:06.505955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:06.505997Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895129783804658:5378]
2025-09-30T14:52:06.506704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:06.507037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:06.507077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:06.507413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:06.507472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:06.507478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:06.507479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:06.507480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:06.507482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:06.507483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:06.507484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:06.507486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:06.507487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:06.507488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:06.507489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.507491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.507492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.507493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:06.507495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:06.507500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:06.507510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:06.507515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:06.507519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:06.507523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:06.507528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:06.507532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:06.507536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:06.507540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:06.507545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:06.507549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.507553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.507557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.507561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:06.507565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:06.507573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:06.507582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:06.507587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:06.507593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:06.507597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:06.507603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:06.507608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:06.507613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:06.507618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:06.507630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:06.507635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:06.507640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:06.507646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:06.507651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:06.507655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:06.507661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:06.507667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:06.507672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:06.507677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:06.507688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:06.507698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.507708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.507717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.507726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.507735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.507740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.507744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:06.507750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:06.507755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:06.507760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:06.507812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:06.513384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:06.514267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:06.514286Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:06.514290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:06.514294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:06.514301Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 690 [2:7555895129783804658:5378]
2025-09-30T14:52:06.514318Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:06.514334Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:06.514343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:06.514346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:06.514348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:06.514364Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:06.514386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:06.514409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:06.514464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.514469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.514471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.514474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:06.514476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:06.514543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:06.514551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.514562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.514580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.514603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:06.514625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895129873533162:6499], now have 1 active actors on pipe
2025-09-30T14:52:06.514634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895129873532899:2454], now have 1 active actors on pipe
2025-09-30T14:52:06.514640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895129783804653:5378]
2025-09-30T14:52:06.514643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895129783804653:5378]
2025-09-30T14:52:06.514645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895129783804653:5378]
2025-09-30T14:52:06.514659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:06.514673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:06.514676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:06.514686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:06.514688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:06.514692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:06.514697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:06.514733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895129783804653:5378]
2025-09-30T14:52:06.514744Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:06.514760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:06.514742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 690
2025-09-30T14:52:06.514743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 690
2025-09-30T14:52:06.514788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:06.514799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:06.514822Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71922dc8-4a81d27-153914-da444b99_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:06.514831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:06.514835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:06.514840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:06.514848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:06.514859Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:06.514871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:06.514999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:06.515006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:06.515018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:06.515090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 691 partition: 0 MaxSeqNo: 42 sessionId: src_id|71922dc8-4a81d27-153914-da444b99_0
2025-09-30T14:52:06.515505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5db516-ddd0497d-8c11dfb-e0573982_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|71922dc8-4a81d27-153914-da444b99_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:06.518281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71922dc8-4a81d27-153914-da444b99_0] Write session: try to update token
2025-09-30T14:52:06.518301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71922dc8-4a81d27-153914-da444b99_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:06.533583Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:06.533608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:06.533619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895129783804653:5378]
2025-09-30T14:52:06.533672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:06.533672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:06.533872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:06.534046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:06.534199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:06.534361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:06.534659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 691 sessionId: src_id|71922dc8-4a81d27-153914-da444b99_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:06.534689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:06.534742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:06.537776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:06.538762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:06.538792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:06.538814Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:06.538817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:06.538820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:06.538823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:06.538832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895129783804653:5378]
2025-09-30T14:52:06.538836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895129783804653:5378]
2025-09-30T14:52:06.538842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895129783804653:5378]
2025-09-30T14:52:06.538887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:06.538896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:06.538903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:06.538903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.538906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:06.538908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:06.539057Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:06.584009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895129873533176:5991]
2025-09-30T14:52:06.584247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 690, pipe: [1:7555895129873533176:5991]
2025-09-30T14:52:06.660119Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:06.660847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:06.660888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895129873533176:5991], now have 1 active actors on pipe
2025-09-30T14:52:06.661008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:06.661047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895129873533176:5991]
2025-09-30T14:52:06.661067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:06.661113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:06.661121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:06.661202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 691 reason: error at write: Disconnected sessionId: src_id|71922dc8-4a81d27-153914-da444b99_0
2025-09-30T14:52:06.661401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 691 sessionId: src_id|71922dc8-4a81d27-153914-da444b99_0 is DEAD
2025-09-30T14:52:06.661517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71922dc8-4a81d27-153914-da444b99_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:06.661528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71922dc8-4a81d27-153914-da444b99_0] Write session will restart in 0.007717s
2025-09-30T14:52:06.661551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71922dc8-4a81d27-153914-da444b99_0] Write session: Do CDS request
2025-09-30T14:52:06.661558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71922dc8-4a81d27-153914-da444b99_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:06.670784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71922dc8-4a81d27-153914-da444b99_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:06.670968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:06.670983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 692
2025-09-30T14:52:06.671108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 692 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:06.671140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 692 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:06.671149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=692 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:06.671153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:06.671636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 692 sessionId:  describe result for acl check
2025-09-30T14:52:06.671667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:06.671673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:06.671675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:06.671680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895129873533229:6503] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:06.672210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895129873533229:6503] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:06.675315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895129873533229:6503] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:06.678667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895129873533229:6503] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:06.678682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895129873533229:6503] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:06.678685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895129873533229:6503] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:06.678694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 692 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:06.680259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:06.682943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:06.683132Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:06.683144Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:06.683154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:06.683204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:06.683259Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895129783804932:5381]
2025-09-30T14:52:06.683927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:06.684208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:06.684254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:06.684586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:06.684645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:06.684651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:06.684652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:06.684654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:06.684655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:06.684656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:06.684657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:06.684658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:06.684659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:06.684660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:06.684662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.684663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.684664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.684665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:06.684666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:06.684672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:06.684683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:06.684687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:06.684692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:06.684695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:06.684700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:06.684705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:06.684709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:06.684713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:06.684717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:06.684722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.684726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.684730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.684734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:06.684738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:06.684745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:06.684754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:06.684759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:06.684765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:06.684771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:06.684776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:06.684781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:06.684786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:06.684791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:06.684797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:06.684802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:06.684808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:06.684818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:06.684824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:06.684828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:06.684834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:06.684845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:06.684850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:06.684855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:06.684860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:06.684870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.684875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.684879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.684889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.684894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.684899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.684908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:06.684912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:06.684917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:06.684921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:06.684966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:06.690472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:06.691419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:06.691439Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:06.691441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:06.691445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:06.691452Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 691 [2:7555895129783804932:5381]
2025-09-30T14:52:06.691472Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:06.691488Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:06.691491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:06.691495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:06.691497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:06.691513Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:06.691522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:06.691528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:06.691622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.691629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.691631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.691635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:06.691637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:06.691703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:06.691711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.691724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.691736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.691761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:06.691784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895129873533443:6503], now have 1 active actors on pipe
2025-09-30T14:52:06.691792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895129873533178:2454], now have 1 active actors on pipe
2025-09-30T14:52:06.691799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895129783804927:5381]
2025-09-30T14:52:06.691806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895129783804927:5381]
2025-09-30T14:52:06.691808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895129783804927:5381]
2025-09-30T14:52:06.691821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:06.691834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:06.691837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:06.691845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:06.691846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:06.691851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:06.691854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:06.691900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895129783804927:5381]
2025-09-30T14:52:06.691907Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:06.691882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 691
2025-09-30T14:52:06.691915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:06.691912Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 691
2025-09-30T14:52:06.692030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:06.692042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:06.692073Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6bf000ae-79c801b0-62888345-9170277b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:06.692096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:06.692105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:06.692107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:06.692117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:06.692131Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:06.692151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:06.692333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:06.692342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:06.692356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:06.692453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 692 partition: 0 MaxSeqNo: 42 sessionId: src_id|6bf000ae-79c801b0-62888345-9170277b_0
2025-09-30T14:52:06.692830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71922dc8-4a81d27-153914-da444b99_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6bf000ae-79c801b0-62888345-9170277b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:06.695628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bf000ae-79c801b0-62888345-9170277b_0] Write session: try to update token
2025-09-30T14:52:06.695644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bf000ae-79c801b0-62888345-9170277b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:06.704236Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:06.704261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:06.704265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:06.704267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:06.704278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895129783804927:5381]
2025-09-30T14:52:06.704284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895129783804927:5381]
2025-09-30T14:52:06.704288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895129783804927:5381]
2025-09-30T14:52:06.704338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:06.704337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:06.704342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:06.704345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:06.704354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.704375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:06.704593Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:06.709673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 692 sessionId: src_id|6bf000ae-79c801b0-62888345-9170277b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:06.712672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:06.761166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895129873533479:5991]
2025-09-30T14:52:06.761459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 691, pipe: [1:7555895129873533479:5991]
2025-09-30T14:52:06.813737Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:06.814135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:06.814151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:06.814193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895129873533479:5991], now have 1 active actors on pipe
2025-09-30T14:52:06.814412Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:06.814463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:06.814468Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:06.814485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:06.814513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895129873533479:5991]
2025-09-30T14:52:06.814562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 692 reason: error at write: Disconnected sessionId: src_id|6bf000ae-79c801b0-62888345-9170277b_0
2025-09-30T14:52:06.814766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 692 sessionId: src_id|6bf000ae-79c801b0-62888345-9170277b_0 is DEAD
2025-09-30T14:52:06.814945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bf000ae-79c801b0-62888345-9170277b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:06.814956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bf000ae-79c801b0-62888345-9170277b_0] Write session will restart in 0.008275s
2025-09-30T14:52:06.814980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bf000ae-79c801b0-62888345-9170277b_0] Write session: Do CDS request
2025-09-30T14:52:06.814987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bf000ae-79c801b0-62888345-9170277b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:06.824819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bf000ae-79c801b0-62888345-9170277b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:06.824942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:06.824960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 693
2025-09-30T14:52:06.825088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 693 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:06.825124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 693 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:06.825134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=693 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:06.825138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:06.825541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 693 sessionId:  describe result for acl check
2025-09-30T14:52:06.825577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:06.825579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:06.825583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:06.825589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895129873533534:6514] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:06.826126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895129873533534:6514] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:06.829556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895129873533534:6514] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:06.833232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895129873533534:6514] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:06.833246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895129873533534:6514] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:06.833250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895129873533534:6514] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:06.833258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 693 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:06.834863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:06.837924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:06.838143Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:06.838154Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:06.838164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:06.838212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:06.838252Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895129783805240:5395]
2025-09-30T14:52:06.838957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:06.839238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:06.839309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:06.839632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:06.839689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:06.839695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:06.839696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:06.839698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:06.839699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:06.839700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:06.839701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:06.839702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:06.839703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:06.839705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:06.839706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.839707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.839708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.839710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:06.839711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:06.839716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:06.839727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:06.839732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:06.839736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:06.839740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:06.839745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:06.839749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:06.839752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:06.839756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:06.839761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:06.839766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.839770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.839774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.839778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:06.839782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:06.839789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:06.839798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:06.839806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:06.839811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:06.839821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:06.839827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:06.839834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:06.839840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:06.839847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:06.839852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:06.839859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:06.839864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:06.839869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:06.839878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:06.839883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:06.839888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:06.839893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:06.839898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:06.839907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:06.839913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:06.839920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.839930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.839934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.839939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.839943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.839948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.839952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:06.839957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:06.839962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:06.839968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:06.840017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:06.845644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:06.846717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:06.846733Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:06.846736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:06.846740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:06.846747Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 692 [2:7555895129783805240:5395]
2025-09-30T14:52:06.846764Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:06.846780Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:06.846783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:06.846786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:06.846787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:06.846799Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:06.846809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:06.846815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:06.846875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.846884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.846886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.846890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:06.846893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:06.846959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:06.846967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.846979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:06.846990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:06.847009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:06.847034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895129873533745:6514], now have 1 active actors on pipe
2025-09-30T14:52:06.847038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895129873533481:2454], now have 1 active actors on pipe
2025-09-30T14:52:06.847044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895129783805235:5395]
2025-09-30T14:52:06.847047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895129783805235:5395]
2025-09-30T14:52:06.847049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895129783805235:5395]
2025-09-30T14:52:06.847063Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:06.847079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:06.847084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:06.847087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:06.847089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:06.847099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:06.847102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:06.847137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895129783805235:5395]
2025-09-30T14:52:06.847149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:06.847157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:06.847160Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 692
2025-09-30T14:52:06.847163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 692
2025-09-30T14:52:06.847208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:06.847218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:06.847261Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e4ec7c3-939c413f-854a7c3c-7acb4e93_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:06.847274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:06.847278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:06.847280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:06.847289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:06.847299Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:06.847318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:06.847488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:06.847511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:06.847535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:06.847641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 693 partition: 0 MaxSeqNo: 42 sessionId: src_id|2e4ec7c3-939c413f-854a7c3c-7acb4e93_0
2025-09-30T14:52:06.848024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bf000ae-79c801b0-62888345-9170277b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2e4ec7c3-939c413f-854a7c3c-7acb4e93_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:06.850909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e4ec7c3-939c413f-854a7c3c-7acb4e93_0] Write session: try to update token
2025-09-30T14:52:06.850927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e4ec7c3-939c413f-854a7c3c-7acb4e93_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:06.859298Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:06.859321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:06.859331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895129783805235:5395]
2025-09-30T14:52:06.859380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:06.859382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:06.859567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:06.859719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:06.859886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:06.860039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:06.860233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:06.860276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:06.865230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 693 sessionId: src_id|2e4ec7c3-939c413f-854a7c3c-7acb4e93_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:06.868223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:06.868445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:06.868474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:06.868513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:06.868627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:06.870310Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:06.870332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:06.870334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:06.870336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:06.870346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895129783805235:5395]
2025-09-30T14:52:06.870350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895129783805235:5395]
2025-09-30T14:52:06.870354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895129783805235:5395]
2025-09-30T14:52:06.870406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:06.870418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:06.870417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:06.870421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:06.870425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:06.870430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:06.870585Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:06.914769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895129873533760:5991]
2025-09-30T14:52:06.915081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 692, pipe: [1:7555895129873533760:5991]
2025-09-30T14:52:06.990303Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:06.999067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:06.999103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:06.999294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:06.999368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:06.999441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:06.999516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:06.999567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:06.999578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:06.999654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:06.999728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:06.999803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:06.999879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:06.999927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:06.999939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:07.000014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:07.000085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:07.000158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:07.000234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:07.000282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:07.000290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:07.000388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:07.000467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:07.000534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:07.000602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:07.000648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:07.000656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:07.000752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:07.000842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:07.000920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:07.000992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:07.001051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:07.001055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:07.001131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:07.001203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:07.001274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:07.001346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:07.001390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:07.001393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:07.001464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:07.001524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:07.001592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:07.001668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:07.001716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:07.001725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:07.001797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:07.001866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:07.001940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:07.002013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:07.002061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:07.002070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:07.002141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:07.002212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:07.002281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:07.002351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:07.002411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:07.002419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:07.002490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:07.002561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:07.002634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:07.002708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:07.002756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:07.002764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:07.002837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895129873533760:5991], now have 1 active actors on pipe
2025-09-30T14:52:07.003109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:07.003114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895129873533760:5991]
2025-09-30T14:52:07.003122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:07.003152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 693 reason: error at write: Disconnected sessionId: src_id|2e4ec7c3-939c413f-854a7c3c-7acb4e93_0
2025-09-30T14:52:07.003342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 693 sessionId: src_id|2e4ec7c3-939c413f-854a7c3c-7acb4e93_0 is DEAD
2025-09-30T14:52:07.003428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:07.003495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e4ec7c3-939c413f-854a7c3c-7acb4e93_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:07.003506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e4ec7c3-939c413f-854a7c3c-7acb4e93_0] Write session will restart in 0.009168s
2025-09-30T14:52:07.003529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e4ec7c3-939c413f-854a7c3c-7acb4e93_0] Write session: Do CDS request
2025-09-30T14:52:07.003535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e4ec7c3-939c413f-854a7c3c-7acb4e93_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:07.004241Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:07.013821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e4ec7c3-939c413f-854a7c3c-7acb4e93_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:07.013935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:07.013950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 694
2025-09-30T14:52:07.014087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 694 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:07.014119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 694 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:07.014130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=694 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:07.014135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:07.014670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 694 sessionId:  describe result for acl check
2025-09-30T14:52:07.014709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:07.014715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:07.014717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:07.014723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895134168501117:6521] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:07.015285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895134168501117:6521] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:07.017907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895134168501117:6521] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:07.021062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895134168501117:6521] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:07.021077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895134168501117:6521] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:07.021081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895134168501117:6521] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:07.021091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 694 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:07.026182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:07.029375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:07.029618Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:07.029632Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:07.029644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:07.029705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:07.029753Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895134078772821:5398]
2025-09-30T14:52:07.030452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:07.030792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:07.030848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:07.031221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:07.031323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:07.031332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:07.031333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:07.031334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:07.031336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:07.031337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:07.031338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:07.031339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:07.031340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:07.031342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:07.031343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.031344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.031346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.031347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:07.031348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:07.031356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:07.031366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:07.031371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:07.031375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:07.031380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:07.031385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:07.031389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:07.031393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:07.031397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:07.031401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:07.031406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.031410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.031414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.031418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:07.031422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:07.031430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:07.031437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:07.031443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:07.031448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:07.031454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:07.031459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:07.031463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:07.031470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:07.031475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:07.031481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:07.031486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:07.031492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:07.031498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:07.031504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:07.031509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:07.031515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:07.031521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:07.031526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:07.031531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:07.031539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:07.031548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.031560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.031565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.031571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.031582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.031588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.031592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:07.031598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:07.031603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:07.031615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:07.031663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:07.037474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:07.038950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:07.038968Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:07.038971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:07.038975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:07.038982Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 693 [2:7555895134078772821:5398]
2025-09-30T14:52:07.038998Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:07.039012Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:07.039021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:07.039023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:07.039025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:07.039041Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:07.039048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:07.039055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:07.039113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.039122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.039124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.039127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:07.039130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:07.039200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:07.039209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.039224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.039240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.039279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:07.039302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895134168501258:6521], now have 1 active actors on pipe
2025-09-30T14:52:07.039310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895134168501080:2454], now have 1 active actors on pipe
2025-09-30T14:52:07.039317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895134078772816:5398]
2025-09-30T14:52:07.039324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895134078772816:5398]
2025-09-30T14:52:07.039326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895134078772816:5398]
2025-09-30T14:52:07.039339Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:07.039352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:07.039357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:07.039361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:07.039345Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 693
2025-09-30T14:52:07.039366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:07.039353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 693
2025-09-30T14:52:07.039371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:07.039374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:07.039413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895134078772816:5398]
2025-09-30T14:52:07.039420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:07.039433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:07.039438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:07.039443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:07.039484Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59d44c33-a7231194-27bb791b-e02fc565_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:07.039498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:07.039502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:07.039504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:07.039514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:07.039522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:07.039542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:07.039677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:07.039684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:07.039696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:07.039784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 694 partition: 0 MaxSeqNo: 42 sessionId: src_id|59d44c33-a7231194-27bb791b-e02fc565_0
2025-09-30T14:52:07.040154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e4ec7c3-939c413f-854a7c3c-7acb4e93_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|59d44c33-a7231194-27bb791b-e02fc565_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:07.043166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59d44c33-a7231194-27bb791b-e02fc565_0] Write session: try to update token
2025-09-30T14:52:07.043194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59d44c33-a7231194-27bb791b-e02fc565_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:07.051837Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:07.051863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:07.051866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:07.051868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:07.051878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895134078772816:5398]
2025-09-30T14:52:07.051883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895134078772816:5398]
2025-09-30T14:52:07.051888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895134078772816:5398]
2025-09-30T14:52:07.051929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:07.051936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.051935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:07.051939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:07.051941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:07.051945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:07.052093Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:07.057913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 694 sessionId: src_id|59d44c33-a7231194-27bb791b-e02fc565_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:07.060685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:07.103176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895134168501360:5991]
2025-09-30T14:52:07.103486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 693, pipe: [1:7555895134168501360:5991]
2025-09-30T14:52:07.171531Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:07.171851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:07.171872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:07.171916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895134168501360:5991], now have 1 active actors on pipe
2025-09-30T14:52:07.172145Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:07.172176Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:07.172195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895134168501360:5991]
2025-09-30T14:52:07.172198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:07.172201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:07.172262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 694 reason: error at write: Disconnected sessionId: src_id|59d44c33-a7231194-27bb791b-e02fc565_0
2025-09-30T14:52:07.172456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 694 sessionId: src_id|59d44c33-a7231194-27bb791b-e02fc565_0 is DEAD
2025-09-30T14:52:07.172611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59d44c33-a7231194-27bb791b-e02fc565_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:07.172624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59d44c33-a7231194-27bb791b-e02fc565_0] Write session will restart in 0.009691s
2025-09-30T14:52:07.172647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59d44c33-a7231194-27bb791b-e02fc565_0] Write session: Do CDS request
2025-09-30T14:52:07.172656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59d44c33-a7231194-27bb791b-e02fc565_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:07.183797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59d44c33-a7231194-27bb791b-e02fc565_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:07.183892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:07.183909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 695
2025-09-30T14:52:07.184038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 695 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:07.184070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 695 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:07.184088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=695 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:07.184097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:07.184534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 695 sessionId:  describe result for acl check
2025-09-30T14:52:07.184565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:07.184567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:07.184569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:07.184575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895134168501421:6525] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:07.185165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895134168501421:6525] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:07.187278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895134168501421:6525] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:07.190147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895134168501421:6525] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:07.190161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895134168501421:6525] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:07.190164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895134168501421:6525] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:07.190172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 695 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:07.193041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:07.196081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:07.196376Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:07.196398Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:07.196415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:07.196543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:07.196600Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895134078773097:5401]
2025-09-30T14:52:07.197420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:07.197811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:07.197894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:07.198386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:07.198515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:07.198528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:07.198530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:07.198531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:07.198533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:07.198534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:07.198536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:07.198537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:07.198539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:07.198540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:07.198541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.198542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.198544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.198545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:07.198547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:07.198556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:07.198569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:07.198574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:07.198577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:07.198582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:07.198585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:07.198589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:07.198593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:07.198597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:07.198601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:07.198606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.198611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.198615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.198619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:07.198624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:07.198636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:07.198648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:07.198656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:07.198662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:07.198681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:07.198697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:07.198710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:07.198724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:07.198737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:07.198750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:07.198778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:07.198785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:07.198792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:07.198800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:07.198808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:07.198813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:07.198829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:07.198845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:07.198853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:07.198859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:07.198866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.198872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.198879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.198885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.198891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.198902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.198909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:07.198915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:07.198922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:07.198937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:07.198992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:07.204845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:07.205725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:07.205743Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:07.205745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:07.205748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:07.205753Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 694 [2:7555895134078773097:5401]
2025-09-30T14:52:07.205768Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:07.205782Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:07.205791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:07.205794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:07.205796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:07.205816Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:07.205831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:07.205839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:07.205904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.205910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.205913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.205915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:07.205917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:07.205972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:07.205978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.205988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.205994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.206008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:07.206020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895134078773092:5401]
2025-09-30T14:52:07.206026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895134078773092:5401]
2025-09-30T14:52:07.206027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895134078773092:5401]
2025-09-30T14:52:07.206034Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:07.206049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:07.206049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:07.206054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:07.206056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:07.206070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:07.206072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:07.206107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895134168501581:6525], now have 1 active actors on pipe
2025-09-30T14:52:07.206114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895134168501363:2454], now have 1 active actors on pipe
2025-09-30T14:52:07.206116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895134078773092:5401]
2025-09-30T14:52:07.206122Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:07.206146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:07.206206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 694
2025-09-30T14:52:07.206273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:07.206281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:07.206289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 694
2025-09-30T14:52:07.206303Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e0169b-8de759d7-7ffc21fe-439922d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:07.206312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:07.206315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:07.206321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:07.206328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:07.206335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:07.206351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:07.206513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:07.206519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:07.206530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:07.206621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 695 partition: 0 MaxSeqNo: 42 sessionId: src_id|7e0169b-8de759d7-7ffc21fe-439922d2_0
2025-09-30T14:52:07.206961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59d44c33-a7231194-27bb791b-e02fc565_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7e0169b-8de759d7-7ffc21fe-439922d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:07.210108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e0169b-8de759d7-7ffc21fe-439922d2_0] Write session: try to update token
2025-09-30T14:52:07.210132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e0169b-8de759d7-7ffc21fe-439922d2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:07.218072Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:07.218093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:07.218103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895134078773092:5401]
2025-09-30T14:52:07.218148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:07.218166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:07.218341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:07.218503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:07.218652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:07.218795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:07.218994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:07.219038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:07.224560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 695 sessionId: src_id|7e0169b-8de759d7-7ffc21fe-439922d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:07.227058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:07.227369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:07.227390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:07.228496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:07.228528Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:07.228538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:07.228541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:07.228543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:07.228552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895134078773092:5401]
2025-09-30T14:52:07.228555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895134078773092:5401]
2025-09-30T14:52:07.228559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895134078773092:5401]
2025-09-30T14:52:07.228586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:07.228594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.228594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:07.228596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:07.228600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:07.228604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:07.228611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:07.228713Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:07.272130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895134168501644:5991]
2025-09-30T14:52:07.272399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 694, pipe: [1:7555895134168501644:5991]
2025-09-30T14:52:07.339750Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:07.349009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:07.349044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:07.349229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:07.349306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:07.349385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:07.349455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:07.349508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:07.349518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:07.349593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:07.349658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:07.349727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:07.349798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:07.349908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:07.349917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:07.349990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:07.350057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:07.350126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:07.350196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:07.350244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:07.350255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:07.350328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:07.350407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:07.350476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:07.350543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:07.350587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:07.350594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:07.350665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:07.350731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:07.350800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:07.350869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:07.350916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:07.350924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:07.350996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:07.351061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:07.351128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:07.351200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:07.351267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:07.351276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:07.351346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:07.351409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:07.351475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:07.351544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:07.351593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:07.351601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:07.351670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:07.351736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:07.351803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:07.351869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:07.351916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:07.351924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:07.351993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:07.352055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:07.352120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:07.352185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:07.352232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:07.352240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:07.352311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:07.352376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:07.352443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:07.352508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:07.352558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:07.352566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:07.352634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895134168501644:5991], now have 1 active actors on pipe
2025-09-30T14:52:07.352943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895134168501644:5991]
2025-09-30T14:52:07.352978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:07.353167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:07.353182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:07.353209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 695 reason: error at write: Disconnected sessionId: src_id|7e0169b-8de759d7-7ffc21fe-439922d2_0
2025-09-30T14:52:07.353400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 695 sessionId: src_id|7e0169b-8de759d7-7ffc21fe-439922d2_0 is DEAD
2025-09-30T14:52:07.353534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e0169b-8de759d7-7ffc21fe-439922d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:07.353545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e0169b-8de759d7-7ffc21fe-439922d2_0] Write session will restart in 0.009735s
2025-09-30T14:52:07.353567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e0169b-8de759d7-7ffc21fe-439922d2_0] Write session: Do CDS request
2025-09-30T14:52:07.353571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e0169b-8de759d7-7ffc21fe-439922d2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:07.354031Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:07.364718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e0169b-8de759d7-7ffc21fe-439922d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:07.364847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:07.364862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 696
2025-09-30T14:52:07.364989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 696 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:07.365023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 696 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:07.365028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=696 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:07.365033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:07.365434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 696 sessionId:  describe result for acl check
2025-09-30T14:52:07.365470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:07.365477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:07.365478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:07.365484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895134168501723:6529] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:07.366021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895134168501723:6529] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:07.369011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895134168501723:6529] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:07.372218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895134168501723:6529] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:07.372232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895134168501723:6529] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:07.372235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895134168501723:6529] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:07.372242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 696 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:07.373390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:07.376130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:07.376333Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:07.376345Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:07.376355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:07.376407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:07.376455Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895134078773372:5403]
2025-09-30T14:52:07.377124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:07.377439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:07.377482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:07.377815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:07.377875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:07.377881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:07.377882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:07.377884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:07.377885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:07.377886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:07.377887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:07.377889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:07.377890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:07.377891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:07.377892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.377893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.377895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.377896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:07.377897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:07.377902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:07.377913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:07.377918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:07.377922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:07.377926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:07.377931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:07.377935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:07.377943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:07.377947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:07.377956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:07.377960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.377969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.377973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.377977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:07.377981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:07.377989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:07.377997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:07.378003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:07.378010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:07.378014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:07.378020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:07.378029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:07.378034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:07.378044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:07.378055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:07.378063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:07.378069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:07.378079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:07.378085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:07.378089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:07.378095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:07.378100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:07.378105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:07.378110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:07.378117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:07.378122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.378127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.378132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.378137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.378142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.378147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.378152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:07.378157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:07.378162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:07.378168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:07.378213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:07.383930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:07.384809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:07.384828Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:07.384831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:07.384834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:07.384840Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 695 [2:7555895134078773372:5403]
2025-09-30T14:52:07.384854Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:07.384868Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:07.384871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:07.384874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:07.384875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:07.384888Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:07.384893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:07.384899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:07.384947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.384956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.384958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.384961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:07.384963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:07.385030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:07.385037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.385045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.385056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.385073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:07.385097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895134168501646:2454], now have 1 active actors on pipe
2025-09-30T14:52:07.385104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895134168501915:6529], now have 1 active actors on pipe
2025-09-30T14:52:07.385109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895134078773367:5403]
2025-09-30T14:52:07.385111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895134078773367:5403]
2025-09-30T14:52:07.385113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895134078773367:5403]
2025-09-30T14:52:07.385122Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:07.385133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:07.385136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:07.385140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:07.385146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:07.385149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:07.385150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:07.385180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895134078773367:5403]
2025-09-30T14:52:07.385190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:07.385208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:07.385232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:07.385187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 695
2025-09-30T14:52:07.385208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 695
2025-09-30T14:52:07.385240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:07.385268Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b26156-a4b24b3-41f87653-f3029a7d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:07.385274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:07.385283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:07.385285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:07.385295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:07.385308Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:07.385319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:07.385475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:07.385502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:07.385527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:07.385662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 696 partition: 0 MaxSeqNo: 42 sessionId: src_id|7b26156-a4b24b3-41f87653-f3029a7d_0
2025-09-30T14:52:07.385980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e0169b-8de759d7-7ffc21fe-439922d2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7b26156-a4b24b3-41f87653-f3029a7d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:07.388871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b26156-a4b24b3-41f87653-f3029a7d_0] Write session: try to update token
2025-09-30T14:52:07.388891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b26156-a4b24b3-41f87653-f3029a7d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:07.397771Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:07.397794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:07.397804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895134078773367:5403]
2025-09-30T14:52:07.397852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:07.398029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:07.398041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:07.398193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:07.398351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:07.398524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:07.398739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:07.398780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:07.403486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 696 sessionId: src_id|7b26156-a4b24b3-41f87653-f3029a7d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:07.406462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:07.407011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:07.407033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:07.407063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:07.407156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:07.408388Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:07.408407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:07.408409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:07.408411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:07.408418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895134078773367:5403]
2025-09-30T14:52:07.408422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895134078773367:5403]
2025-09-30T14:52:07.408425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895134078773367:5403]
2025-09-30T14:52:07.408457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:07.408463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.408469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:07.408472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:07.408480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:07.408495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:07.408597Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:07.453395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895134168501929:5991]
2025-09-30T14:52:07.453629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 695, pipe: [1:7555895134168501929:5991]
2025-09-30T14:52:07.513357Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:07.521686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:07.521719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:07.521898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:07.521966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:07.522041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:07.522113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:07.522161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:07.522170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:07.522247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:07.522314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:07.522393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:07.522462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:07.522510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:07.522518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:07.522593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:07.522659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:07.522724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:07.522793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:07.522842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:07.522850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:07.522918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:07.522985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:07.523046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:07.523121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:07.523170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:07.523179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:07.523274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:07.523340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:07.523409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:07.523480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:07.523525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:07.523533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:07.523601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:07.523666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:07.523733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:07.523805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:07.523852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:07.523860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:07.523929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:07.523996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:07.524115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:07.524186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:07.524233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:07.524240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:07.524309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:07.524371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:07.524433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:07.524496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:07.524541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:07.524553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:07.524621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:07.524687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:07.524752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:07.524817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:07.524946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:07.524957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:07.525030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:07.525101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:07.525168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:07.525238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:07.525283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:07.525290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:07.525358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895134168501929:5991], now have 1 active actors on pipe
2025-09-30T14:52:07.525589Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:07.525590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895134168501929:5991]
2025-09-30T14:52:07.525623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:07.525626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:07.525658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 696 reason: error at write: Disconnected sessionId: src_id|7b26156-a4b24b3-41f87653-f3029a7d_0
2025-09-30T14:52:07.525860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 696 sessionId: src_id|7b26156-a4b24b3-41f87653-f3029a7d_0 is DEAD
2025-09-30T14:52:07.525978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b26156-a4b24b3-41f87653-f3029a7d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:07.525988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b26156-a4b24b3-41f87653-f3029a7d_0] Write session will restart in 0.005482s
2025-09-30T14:52:07.526008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b26156-a4b24b3-41f87653-f3029a7d_0] Write session: Do CDS request
2025-09-30T14:52:07.526012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b26156-a4b24b3-41f87653-f3029a7d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:07.526711Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:07.532848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b26156-a4b24b3-41f87653-f3029a7d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:07.532868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:07.532893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 697
2025-09-30T14:52:07.533111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 697 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:07.533147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 697 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:07.533154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=697 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:07.533162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:07.533646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 697 sessionId:  describe result for acl check
2025-09-30T14:52:07.533703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:07.533712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:07.533714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:07.533721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895134168501947:6534] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:07.534305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895134168501947:6534] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:07.536926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895134168501947:6534] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:07.540859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895134168501947:6534] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:07.540876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895134168501947:6534] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:07.540879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895134168501947:6534] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:07.540889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 697 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:07.548457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:07.551706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:07.552075Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:07.552090Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:07.552104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:07.552178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:07.552223Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895134078773650:5405]
2025-09-30T14:52:07.552887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:07.553228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:07.553274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:07.553649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:07.553730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:07.553737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:07.553738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:07.553740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:07.553741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:07.553742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:07.553743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:07.553744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:07.553746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:07.553747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:07.553748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.553749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.553750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.553751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:07.553752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:07.553758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:07.553769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:07.553774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:07.553778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:07.553783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:07.553787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:07.553791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:07.553795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:07.553799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:07.553804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:07.553808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.553811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.553815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.553819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:07.553823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:07.553834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:07.553841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:07.553847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:07.553853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:07.553858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:07.553863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:07.553868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:07.553874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:07.553880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:07.553885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:07.553895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:07.553901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:07.553910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:07.553916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:07.553925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:07.553930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:07.553939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:07.553945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:07.553949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:07.553954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:07.553962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.553970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.553976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.553982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.553992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.553997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.554006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:07.554011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:07.554016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:07.554021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:07.554065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:07.559595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:07.560475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:07.560492Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:07.560495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:07.560499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:07.560506Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 696 [2:7555895134078773650:5405]
2025-09-30T14:52:07.560523Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:07.560540Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:07.560543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:07.560547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:07.560549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:07.560566Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:07.560573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:07.560580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:07.560645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.560654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.560657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.560660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:07.560664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:07.560726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:07.560734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.560748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.560760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.560782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:07.560804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895134168502071:6534], now have 1 active actors on pipe
2025-09-30T14:52:07.560813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895134168501933:2454], now have 1 active actors on pipe
2025-09-30T14:52:07.560819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895134078773645:5405]
2025-09-30T14:52:07.560822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895134078773645:5405]
2025-09-30T14:52:07.560825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895134078773645:5405]
2025-09-30T14:52:07.560838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:07.560854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:07.560863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:07.560871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:07.560873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:07.560877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:07.560880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:07.560914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895134078773645:5405]
2025-09-30T14:52:07.560922Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:07.560928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:07.560900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 696
2025-09-30T14:52:07.560906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 696
2025-09-30T14:52:07.560955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:07.560964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:07.560997Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5f85283-b438f2bd-2782ec71-d9753bef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:07.561008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:07.561013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:07.561015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:07.561024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:07.561034Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:07.561057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:07.561211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:07.561220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:07.561235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:07.561349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 697 partition: 0 MaxSeqNo: 42 sessionId: src_id|e5f85283-b438f2bd-2782ec71-d9753bef_0
2025-09-30T14:52:07.561699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b26156-a4b24b3-41f87653-f3029a7d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e5f85283-b438f2bd-2782ec71-d9753bef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:07.564445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5f85283-b438f2bd-2782ec71-d9753bef_0] Write session: try to update token
2025-09-30T14:52:07.564463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5f85283-b438f2bd-2782ec71-d9753bef_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:07.573209Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:07.573227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:07.573229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:07.573230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:07.573238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895134078773645:5405]
2025-09-30T14:52:07.573245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895134078773645:5405]
2025-09-30T14:52:07.573248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895134078773645:5405]
2025-09-30T14:52:07.573281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:07.573287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.573288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:07.573292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:07.573299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:07.573303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:07.573420Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:07.578982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 697 sessionId: src_id|e5f85283-b438f2bd-2782ec71-d9753bef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:07.581757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:07.625958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895134168502217:5991]
2025-09-30T14:52:07.626247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 696, pipe: [1:7555895134168502217:5991]
2025-09-30T14:52:07.681091Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:07.681748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:07.681768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:07.681812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895134168502217:5991], now have 1 active actors on pipe
2025-09-30T14:52:07.682001Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:07.682056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:07.682069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:07.682086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895134168502217:5991]
2025-09-30T14:52:07.682111Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:07.682129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 697 reason: error at write: Disconnected sessionId: src_id|e5f85283-b438f2bd-2782ec71-d9753bef_0
2025-09-30T14:52:07.682327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 697 sessionId: src_id|e5f85283-b438f2bd-2782ec71-d9753bef_0 is DEAD
2025-09-30T14:52:07.682489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5f85283-b438f2bd-2782ec71-d9753bef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:07.682499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5f85283-b438f2bd-2782ec71-d9753bef_0] Write session will restart in 0.005196s
2025-09-30T14:52:07.682523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5f85283-b438f2bd-2782ec71-d9753bef_0] Write session: Do CDS request
2025-09-30T14:52:07.682532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5f85283-b438f2bd-2782ec71-d9753bef_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:07.688752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5f85283-b438f2bd-2782ec71-d9753bef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:07.688826Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:07.688846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 698
2025-09-30T14:52:07.689044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 698 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:07.689080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 698 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:07.689093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=698 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:07.689097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:07.689569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 698 sessionId:  describe result for acl check
2025-09-30T14:52:07.689617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:07.689624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:07.689626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:07.689633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895134168502233:6538] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:07.690254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895134168502233:6538] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:07.693019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895134168502233:6538] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:07.697089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895134168502233:6538] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:07.697102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895134168502233:6538] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:07.697105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895134168502233:6538] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:07.697115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 698 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:07.702550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:07.705851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:07.706099Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:07.706109Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:07.706120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:07.706183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:07.706213Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895134078773927:5408]
2025-09-30T14:52:07.706743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:07.707063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:07.707100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:07.707365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:07.707409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:07.707414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:07.707416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:07.707417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:07.707419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:07.707420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:07.707421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:07.707422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:07.707424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:07.707425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:07.707426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.707427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.707428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.707429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:07.707430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:07.707435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:07.707445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:07.707449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:07.707452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:07.707456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:07.707460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:07.707463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:07.707467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:07.707471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:07.707475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:07.707479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.707482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.707486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.707489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:07.707493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:07.707501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:07.707510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:07.707516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:07.707522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:07.707527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:07.707532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:07.707537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:07.707542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:07.707547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:07.707553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:07.707559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:07.707570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:07.707574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:07.707584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:07.707589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:07.707594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:07.707603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:07.707606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:07.707608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:07.707611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:07.707614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.707617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.707619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.707622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.707624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.707628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.707630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:07.707633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:07.707637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:07.707640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:07.707663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:07.713324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:07.714736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:07.714752Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:07.714755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:07.714760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:07.714766Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 697 [2:7555895134078773927:5408]
2025-09-30T14:52:07.714784Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:07.714800Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:07.714803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:07.714807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:07.714809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:07.714824Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:07.714834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:07.714839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:07.714889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.714894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.714896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.714898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:07.714900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:07.714954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:07.714959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.714968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.714975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.714989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:07.715011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895134078773922:5408]
2025-09-30T14:52:07.715019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895134078773922:5408]
2025-09-30T14:52:07.715021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895134078773922:5408]
2025-09-30T14:52:07.715028Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:07.715039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:07.715039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:07.715042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:07.715045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:07.715052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:07.715054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:07.715061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895134168502219:2454], now have 1 active actors on pipe
2025-09-30T14:52:07.715065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895134168502375:6538], now have 1 active actors on pipe
2025-09-30T14:52:07.715090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895134078773922:5408]
2025-09-30T14:52:07.715100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:07.715113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:07.715132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 697
2025-09-30T14:52:07.715138Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 697
2025-09-30T14:52:07.715190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:07.715200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:07.715227Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2cdf50db-3713df4a-1202a95e-af035133_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:07.715238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:07.715258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:07.715261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:07.715272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:07.715282Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:07.715296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:07.715484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:07.715494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:07.715509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:07.715613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 698 partition: 0 MaxSeqNo: 42 sessionId: src_id|2cdf50db-3713df4a-1202a95e-af035133_0
2025-09-30T14:52:07.715961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5f85283-b438f2bd-2782ec71-d9753bef_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2cdf50db-3713df4a-1202a95e-af035133_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:07.718746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cdf50db-3713df4a-1202a95e-af035133_0] Write session: try to update token
2025-09-30T14:52:07.718765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cdf50db-3713df4a-1202a95e-af035133_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:07.727785Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:07.727806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:07.727809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:07.727811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:07.727820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895134078773922:5408]
2025-09-30T14:52:07.727824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895134078773922:5408]
2025-09-30T14:52:07.727828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895134078773922:5408]
2025-09-30T14:52:07.727871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:07.727878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.727880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:07.727885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:07.727891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:07.727895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:07.728028Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:07.734338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 698 sessionId: src_id|2cdf50db-3713df4a-1202a95e-af035133_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:07.737532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:07.782063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895134168502524:5991]
2025-09-30T14:52:07.782235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 697, pipe: [1:7555895134168502524:5991]
2025-09-30T14:52:07.837233Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:07.837497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:07.837511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:07.837544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895134168502524:5991], now have 1 active actors on pipe
2025-09-30T14:52:07.837821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:07.837866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895134168502524:5991]
2025-09-30T14:52:07.837874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:07.837877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:07.837939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 698 reason: error at write: Disconnected sessionId: src_id|2cdf50db-3713df4a-1202a95e-af035133_0
2025-09-30T14:52:07.837991Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:07.838103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 698 sessionId: src_id|2cdf50db-3713df4a-1202a95e-af035133_0 is DEAD
2025-09-30T14:52:07.838256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cdf50db-3713df4a-1202a95e-af035133_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:07.838267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cdf50db-3713df4a-1202a95e-af035133_0] Write session will restart in 0.009291s
2025-09-30T14:52:07.838296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cdf50db-3713df4a-1202a95e-af035133_0] Write session: Do CDS request
2025-09-30T14:52:07.838300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cdf50db-3713df4a-1202a95e-af035133_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:07.848730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cdf50db-3713df4a-1202a95e-af035133_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:07.848848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:07.848865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 699
2025-09-30T14:52:07.849027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 699 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:07.849077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 699 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:07.849090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=699 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:07.849095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:07.849529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 699 sessionId:  describe result for acl check
2025-09-30T14:52:07.849565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:07.849567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:07.849568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:07.849573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895134168502592:6549] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:07.850129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895134168502592:6549] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:07.852340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895134168502592:6549] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:07.855839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895134168502592:6549] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:07.855851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895134168502592:6549] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:07.855853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895134168502592:6549] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:07.855861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 699 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:07.857903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:07.861026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:07.861225Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:07.861234Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:07.861245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:07.861299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:07.861339Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895134078774241:5422]
2025-09-30T14:52:07.862006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:07.862295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:07.862336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:07.862675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:07.862734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:07.862740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:07.862741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:07.862742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:07.862743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:07.862745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:07.862746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:07.862747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:07.862748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:07.862750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:07.862751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.862752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.862754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.862755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:07.862756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:07.862762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:07.862773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:07.862778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:07.862782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:07.862786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:07.862790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:07.862794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:07.862799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:07.862803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:07.862807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:07.862811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.862816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.862820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.862824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:07.862828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:07.862836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:07.862844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:07.862851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:07.862857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:07.862861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:07.862867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:07.862872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:07.862884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:07.862889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:07.862899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:07.862903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:07.862908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:07.862913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:07.862919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:07.862923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:07.862929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:07.862934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:07.862939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:07.862950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:07.862955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:07.862963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.862969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.862974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.862984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.862988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.862995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.863004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:07.863009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:07.863020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:07.863026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:07.863073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:07.868831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:07.869770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:07.869787Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:07.869790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:07.869795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:07.869803Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 698 [2:7555895134078774241:5422]
2025-09-30T14:52:07.869820Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:07.869837Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:07.869840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:07.869843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:07.869846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:07.869863Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:07.869872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:07.869880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:07.869948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.869957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.869959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.869963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:07.869966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:07.870044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:07.870052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.870066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:07.870084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:07.870107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:07.870133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895134168502527:2454], now have 1 active actors on pipe
2025-09-30T14:52:07.870143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895134168502792:6549], now have 1 active actors on pipe
2025-09-30T14:52:07.870150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895134078774236:5422]
2025-09-30T14:52:07.870156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895134078774236:5422]
2025-09-30T14:52:07.870159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895134078774236:5422]
2025-09-30T14:52:07.870172Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:07.870187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:07.870196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:07.870199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:07.870201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:07.870209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:07.870212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:07.870251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895134078774236:5422]
2025-09-30T14:52:07.870263Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:07.870276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:07.870276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 698
2025-09-30T14:52:07.870279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 698
2025-09-30T14:52:07.870498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:07.870509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:07.870539Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b713dce7-ee27e76-84c9dbdd-43c615e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:07.870551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:07.870561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:07.870564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:07.870574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:07.870591Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:07.870613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:07.870831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:07.870839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:07.870854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:07.871169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 699 partition: 0 MaxSeqNo: 42 sessionId: src_id|b713dce7-ee27e76-84c9dbdd-43c615e0_0
2025-09-30T14:52:07.871572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cdf50db-3713df4a-1202a95e-af035133_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b713dce7-ee27e76-84c9dbdd-43c615e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:07.874473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b713dce7-ee27e76-84c9dbdd-43c615e0_0] Write session: try to update token
2025-09-30T14:52:07.874497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b713dce7-ee27e76-84c9dbdd-43c615e0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:07.882791Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:07.882810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:07.882813Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:07.882815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:07.882825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895134078774236:5422]
2025-09-30T14:52:07.882833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895134078774236:5422]
2025-09-30T14:52:07.882837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895134078774236:5422]
2025-09-30T14:52:07.882879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:07.882883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:07.882886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:07.882889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:07.882889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:07.882896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:07.883038Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:07.889574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 699 sessionId: src_id|b713dce7-ee27e76-84c9dbdd-43c615e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:07.892301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:07.938250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895134168502812:5991]
2025-09-30T14:52:07.938593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 698, pipe: [1:7555895134168502812:5991]
2025-09-30T14:52:07.986996Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:07.987575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:07.987586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:07.987602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895134168502812:5991], now have 1 active actors on pipe
2025-09-30T14:52:07.987761Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:07.987765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:07.987799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:07.987801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:07.987831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895134168502812:5991]
2025-09-30T14:52:07.987866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 699 reason: error at write: Disconnected sessionId: src_id|b713dce7-ee27e76-84c9dbdd-43c615e0_0
2025-09-30T14:52:07.988036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 699 sessionId: src_id|b713dce7-ee27e76-84c9dbdd-43c615e0_0 is DEAD
2025-09-30T14:52:07.988188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b713dce7-ee27e76-84c9dbdd-43c615e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:07.988198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b713dce7-ee27e76-84c9dbdd-43c615e0_0] Write session will restart in 0.008842s
2025-09-30T14:52:07.988221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b713dce7-ee27e76-84c9dbdd-43c615e0_0] Write session: Do CDS request
2025-09-30T14:52:07.988231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b713dce7-ee27e76-84c9dbdd-43c615e0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:07.998772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b713dce7-ee27e76-84c9dbdd-43c615e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:07.998882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:07.998896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 700
2025-09-30T14:52:07.998987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 700 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:07.999012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 700 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:07.999016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=700 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:07.999019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:07.999424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 700 sessionId:  describe result for acl check
2025-09-30T14:52:07.999464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:07.999471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:07.999473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:07.999479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895134168502878:6556] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:07.999987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895134168502878:6556] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:08.002571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895134168502878:6556] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:08.005708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895134168502878:6556] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:08.005724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895134168502878:6556] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:08.005727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895134168502878:6556] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:08.005735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 700 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:08.008307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:08.011422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:08.011614Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:08.011623Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:08.011634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:08.011679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:08.011716Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895138373741828:5425]
2025-09-30T14:52:08.012382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:08.012658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:08.012698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:08.013020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:08.013074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:08.013079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:08.013081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:08.013082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:08.013083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:08.013085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:08.013086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:08.013087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:08.013088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:08.013090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:08.013091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.013092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.013093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.013095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:08.013096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:08.013101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:08.013111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:08.013116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:08.013120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:08.013124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:08.013128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:08.013133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:08.013137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:08.013141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:08.013145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:08.013150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.013153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.013157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.013160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:08.013165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:08.013172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:08.013181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:08.013187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:08.013193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:08.013197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:08.013203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:08.013208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:08.013213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:08.013219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:08.013224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:08.013228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:08.013234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:08.013243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:08.013248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:08.013253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:08.013259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:08.013268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:08.013274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:08.013284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:08.013290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:08.013296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.013306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.013311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.013321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.013326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.013331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.013340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:08.013345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:08.013352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:08.013362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:08.013409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:08.018860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:08.019755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:08.019770Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:08.019774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:08.019779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:08.019785Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 699 [2:7555895138373741828:5425]
2025-09-30T14:52:08.019801Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:08.019817Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:08.019820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:08.019823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:08.019825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:08.019841Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:08.019854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:08.019862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:08.019921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.019928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.019930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.019933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:08.019936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:08.020001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:08.020008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.020020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.020032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.020053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:08.020076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895134168502833:2454], now have 1 active actors on pipe
2025-09-30T14:52:08.020085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895138463470371:6556], now have 1 active actors on pipe
2025-09-30T14:52:08.020091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895138373741823:5425]
2025-09-30T14:52:08.020094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895138373741823:5425]
2025-09-30T14:52:08.020097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895138373741823:5425]
2025-09-30T14:52:08.020113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:08.020130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:08.020131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:08.020133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:08.020135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:08.020149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:08.020152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:08.020112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 699
2025-09-30T14:52:08.020116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 699
2025-09-30T14:52:08.020205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:08.020215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:08.020225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895138373741823:5425]
2025-09-30T14:52:08.020232Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:08.020238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:08.020261Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e570579-cc650a31-9bea5187-6aab6e36_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:08.020281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:08.020289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:08.020291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:08.020301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:08.020309Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:08.020337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:08.020477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:08.020487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:08.020505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:08.020598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 700 partition: 0 MaxSeqNo: 42 sessionId: src_id|e570579-cc650a31-9bea5187-6aab6e36_0
2025-09-30T14:52:08.020944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b713dce7-ee27e76-84c9dbdd-43c615e0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e570579-cc650a31-9bea5187-6aab6e36_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:08.023768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e570579-cc650a31-9bea5187-6aab6e36_0] Write session: try to update token
2025-09-30T14:52:08.023790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e570579-cc650a31-9bea5187-6aab6e36_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:08.033136Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:08.033153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:08.033156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:08.033158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:08.033170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895138373741823:5425]
2025-09-30T14:52:08.033181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895138373741823:5425]
2025-09-30T14:52:08.033188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895138373741823:5425]
2025-09-30T14:52:08.033245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:08.033247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:08.033253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:08.033254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.033256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:08.033257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:08.033410Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:08.038301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 700 sessionId: src_id|e570579-cc650a31-9bea5187-6aab6e36_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:08.041286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:08.088234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895138463470421:5991]
2025-09-30T14:52:08.088500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 699, pipe: [1:7555895138463470421:5991]
2025-09-30T14:52:08.144639Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:08.145377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:08.145397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:08.145441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895138463470421:5991], now have 1 active actors on pipe
2025-09-30T14:52:08.145673Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:08.145729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:08.145749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:08.145754Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:08.145801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895138463470421:5991]
2025-09-30T14:52:08.145817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 700 reason: error at write: Disconnected sessionId: src_id|e570579-cc650a31-9bea5187-6aab6e36_0
2025-09-30T14:52:08.146025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 700 sessionId: src_id|e570579-cc650a31-9bea5187-6aab6e36_0 is DEAD
2025-09-30T14:52:08.146181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e570579-cc650a31-9bea5187-6aab6e36_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:08.146188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e570579-cc650a31-9bea5187-6aab6e36_0] Write session will restart in 0.005257s
2025-09-30T14:52:08.146207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e570579-cc650a31-9bea5187-6aab6e36_0] Write session: Do CDS request
2025-09-30T14:52:08.146211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e570579-cc650a31-9bea5187-6aab6e36_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:08.152731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e570579-cc650a31-9bea5187-6aab6e36_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:08.152889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:08.152904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 701
2025-09-30T14:52:08.152982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 701 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:08.153014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 701 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:08.153025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=701 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:08.153029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:08.153480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 701 sessionId:  describe result for acl check
2025-09-30T14:52:08.153541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:08.153548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:08.153551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:08.153559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895138463470436:6562] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:08.154136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895138463470436:6562] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:08.156372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895138463470436:6562] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:08.160373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895138463470436:6562] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:08.160390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895138463470436:6562] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:08.160394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895138463470436:6562] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:08.160403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 701 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:08.167863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:08.171363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:08.171609Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:08.171624Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:08.171636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:08.171705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:08.171753Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895138373742110:5428]
2025-09-30T14:52:08.172441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:08.172792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:08.172847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:08.173221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:08.173301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:08.173308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:08.173310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:08.173311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:08.173313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:08.173314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:08.173316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:08.173318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:08.173319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:08.173320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:08.173322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.173323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.173325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.173326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:08.173328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:08.173334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:08.173344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:08.173349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:08.173354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:08.173358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:08.173362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:08.173366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:08.173370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:08.173375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:08.173380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:08.173384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.173388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.173392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.173396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:08.173400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:08.173429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:08.173439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:08.173445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:08.173451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:08.173457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:08.173462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:08.173469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:08.173475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:08.173479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:08.173485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:08.173490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:08.173495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:08.173500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:08.173506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:08.173511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:08.173517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:08.173529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:08.173534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:08.173540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:08.173546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:08.173551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.173558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.173567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.173573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.173578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.173589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.173594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:08.173604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:08.173610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:08.173620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:08.173689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:08.179664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:08.180597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:08.180612Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:08.180615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:08.180620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:08.180627Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 700 [2:7555895138373742110:5428]
2025-09-30T14:52:08.180647Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:08.180666Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:08.180669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:08.180673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:08.180675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:08.180693Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:08.180701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:08.180716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:08.180784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.180792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.180794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.180798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:08.180802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:08.180874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:08.180885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.180899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.180912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.180931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:08.180955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895138373742105:5428]
2025-09-30T14:52:08.180958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895138373742105:5428]
2025-09-30T14:52:08.180960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895138373742105:5428]
2025-09-30T14:52:08.180970Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:08.180983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:08.180986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:08.180993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:08.180996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:08.181002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:08.181006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:08.181017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895138463470423:2454], now have 1 active actors on pipe
2025-09-30T14:52:08.181022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895138463470549:6562], now have 1 active actors on pipe
2025-09-30T14:52:08.181057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895138373742105:5428]
2025-09-30T14:52:08.181076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:08.181103Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 700
2025-09-30T14:52:08.181116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 700
2025-09-30T14:52:08.181101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:08.181355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:08.181371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:08.181397Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eafdb61a-a4bdfe9e-796b5432-6569a77f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:08.181411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:08.181421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:08.181424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:08.181434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:08.181451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:08.181466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:08.182448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:08.182464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:08.182502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:08.182629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 701 partition: 0 MaxSeqNo: 42 sessionId: src_id|eafdb61a-a4bdfe9e-796b5432-6569a77f_0
2025-09-30T14:52:08.183051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e570579-cc650a31-9bea5187-6aab6e36_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|eafdb61a-a4bdfe9e-796b5432-6569a77f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:08.185955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eafdb61a-a4bdfe9e-796b5432-6569a77f_0] Write session: try to update token
2025-09-30T14:52:08.185978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eafdb61a-a4bdfe9e-796b5432-6569a77f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:08.193443Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:08.193461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:08.193474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895138373742105:5428]
2025-09-30T14:52:08.193519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:08.193525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:08.193718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:08.193880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:08.194037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:08.194190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:08.194391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:08.194429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:08.203170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 701 sessionId: src_id|eafdb61a-a4bdfe9e-796b5432-6569a77f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:08.204838Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:08.204855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:08.204858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:08.204860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:08.204871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895138373742105:5428]
2025-09-30T14:52:08.204877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895138373742105:5428]
2025-09-30T14:52:08.204881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895138373742105:5428]
2025-09-30T14:52:08.204926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:08.204940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.204939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:08.204943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:08.204947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:08.204951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:08.205102Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:08.205951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:08.245999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895138463470710:5991]
2025-09-30T14:52:08.246299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 700, pipe: [1:7555895138463470710:5991]
2025-09-30T14:52:08.315560Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:08.316399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:08.316415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:08.316432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895138463470710:5991], now have 1 active actors on pipe
2025-09-30T14:52:08.316646Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:08.316668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:08.316675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:08.316680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:08.316729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895138463470710:5991]
2025-09-30T14:52:08.316743Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:52:08.316757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 701 reason: error at write: Disconnected sessionId: src_id|eafdb61a-a4bdfe9e-796b5432-6569a77f_0
2025-09-30T14:52:08.316839Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 7 consumer shared/user session shared/user_1_7_8935728575530857911_v1 is DEAD
2025-09-30T14:52:08.316947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 701 sessionId: src_id|eafdb61a-a4bdfe9e-796b5432-6569a77f_0 is DEAD
2025-09-30T14:52:08.316961Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895069743969350:5987] disconnected; active server actors: 1
2025-09-30T14:52:08.316965Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895069743969350:5987] client user disconnected session shared/user_1_7_8935728575530857911_v1
2025-09-30T14:52:08.317075Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:52:08.317076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eafdb61a-a4bdfe9e-796b5432-6569a77f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:08.317097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eafdb61a-a4bdfe9e-796b5432-6569a77f_0] Write session will restart in 0.005696s
2025-09-30T14:52:08.317119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eafdb61a-a4bdfe9e-796b5432-6569a77f_0] Write session: Do CDS request
2025-09-30T14:52:08.317124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eafdb61a-a4bdfe9e-796b5432-6569a77f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:08.317166Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:52:08.317171Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:52:08.317178Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.007046s
2025-09-30T14:52:08.323756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eafdb61a-a4bdfe9e-796b5432-6569a77f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:08.323854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:08.323869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 702
2025-09-30T14:52:08.324022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 702 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:08.324053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 702 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:08.324059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=702 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:08.324062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:08.324449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 702 sessionId:  describe result for acl check
2025-09-30T14:52:08.324486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:08.324493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:08.324495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:08.324500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895138463470726:6566] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:08.325037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895138463470726:6566] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:08.325599Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:52:08.325722Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:52:08.325743Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 8
2025-09-30T14:52:08.325903Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 8 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:52:08.325952Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:52:08.326053Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 auth for : user
2025-09-30T14:52:08.326161Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 Handle describe topics response
2025-09-30T14:52:08.326194Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 auth is DEAD
2025-09-30T14:52:08.326214Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:52:08.326493Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:52:08.326608Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_8_16360897178546223690_v1
2025-09-30T14:52:08.326685Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895138463470751:6569] connected; active server actors: 1
2025-09-30T14:52:08.326706Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555895138463470751:6569] session shared/user_1_8_16360897178546223690_v1
2025-09-30T14:52:08.326714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:52:08.326740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:52:08.326751Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_8_16360897178546223690_v1" (Sender=[1:7555895138463470733:6569], Pipe=[1:7555895138463470751:6569], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:52:08.326758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:52:08.326768Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:52:08.326783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_8_16360897178546223690_v1" (Sender=[1:7555895138463470733:6569], Pipe=[1:7555895138463470751:6569], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:52:08.326797Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_8_16360897178546223690_v1" sender [1:7555895138463470733:6569] lock partition 0 for ReadingSession "shared/user_1_8_16360897178546223690_v1" (Sender=[1:7555895138463470733:6569], Pipe=[1:7555895138463470751:6569], Partitions=[], ActiveFamilyCount=1) generation 1 step 8
2025-09-30T14:52:08.326805Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:52:08.326812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000037s
2025-09-30T14:52:08.327016Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 8 Session: "shared/user_1_8_16360897178546223690_v1" ClientId: "user" PipeClient { RawX1: 7555895138463470751 RawX2: 4503603922344361 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:52:08.327037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:52:08.327377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895138463470726:6566] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:08.331158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895138463470726:6566] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:08.331173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895138463470726:6566] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:08.331179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895138463470726:6566] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:08.331186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 702 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:08.337095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:08.339680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:08.339892Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:08.339907Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:08.339918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:08.339980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:08.340026Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895138373742392:5430]
2025-09-30T14:52:08.340693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:08.340972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:08.341018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:08.341375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:08.341461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:08.341468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:08.341469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:08.341471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:08.341472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:08.341473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:08.341475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:08.341476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:08.341478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:08.341479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:08.341480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.341481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.341483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.341484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:08.341486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:08.341492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:08.341503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:08.341508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:08.341513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:08.341517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:08.341521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:08.341526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:08.341530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:08.341534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:08.341539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:08.341543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.341547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.341551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.341556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:08.341560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:08.341569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:08.341577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:08.341584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:08.341590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:08.341595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:08.341602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:08.341607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:08.341613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:08.341623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:08.341628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:08.341634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:08.341644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:08.341651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:08.341662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:08.341667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:08.341674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:08.341679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:08.341689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:08.341694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:08.341699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:08.341704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.341709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.341714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.341719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.341725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.341734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.341739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:08.341745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:08.341754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:08.341760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:08.341811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:08.347341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:08.348205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:08.348226Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:08.348229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:08.348233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:08.348240Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 701 [2:7555895138373742392:5430]
2025-09-30T14:52:08.348261Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:08.348277Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:08.348285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:08.348289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:08.348291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:08.348307Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:08.348319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:08.348326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:08.348391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.348400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.348403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.348407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:08.348410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:08.348478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:08.348485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.348500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.348517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.348541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:08.348564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895138463470858:6566], now have 1 active actors on pipe
2025-09-30T14:52:08.348572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895138463470761:6573], now have 1 active actors on pipe
2025-09-30T14:52:08.348576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895138463470712:2454], now have 1 active actors on pipe
2025-09-30T14:52:08.348583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895138373742387:5430]
2025-09-30T14:52:08.348586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895138373742387:5430]
2025-09-30T14:52:08.348588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895138373742387:5430]
2025-09-30T14:52:08.348602Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:08.348621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:08.348621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:08.348624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:08.348626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:08.348643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:08.348652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:08.348645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 701
2025-09-30T14:52:08.348651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 701, pipe: [1:7555895138463470761:6573]
2025-09-30T14:52:08.348682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 701
2025-09-30T14:52:08.348685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895138373742387:5430]
2025-09-30T14:52:08.348699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:08.348700Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:08.348716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:08.348721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:08.348739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:08.348747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:08.348753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_8_16360897178546223690_v1 on pipe: [1:7555895138463470761:6573]
2025-09-30T14:52:08.348779Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_8_16360897178546223690_v1:1 with generation 701
2025-09-30T14:52:08.348808Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e271d6f5-c55ebc9a-696b827c-4a0d0662_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:08.348820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:08.348825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:08.348829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:08.348839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:08.348853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:08.348868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:08.348877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:08.348884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:08.348898Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_8_16360897178546223690_v1
2025-09-30T14:52:08.348906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:08.348941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:08.348963Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:52:08.349073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:08.349082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:08.349096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:08.349177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 702 partition: 0 MaxSeqNo: 42 sessionId: src_id|e271d6f5-c55ebc9a-696b827c-4a0d0662_0
2025-09-30T14:52:08.349530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eafdb61a-a4bdfe9e-796b5432-6569a77f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e271d6f5-c55ebc9a-696b827c-4a0d0662_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:08.352302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e271d6f5-c55ebc9a-696b827c-4a0d0662_0] Write session: try to update token
2025-09-30T14:52:08.352323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e271d6f5-c55ebc9a-696b827c-4a0d0662_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:08.353595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:52:08.353634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:52:08.353645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:08.353648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:08.353651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:08.353661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:52:08.353676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:52:08.353851Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759243928348 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:52:08.353875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:52:08.353916Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 sending to client partition status
2025-09-30T14:52:08.360915Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:08.360936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:08.360939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:08.360941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:08.360951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895138373742387:5430]
2025-09-30T14:52:08.360956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895138373742387:5430]
2025-09-30T14:52:08.360960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895138373742387:5430]
2025-09-30T14:52:08.361001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:08.361007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.361010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:08.361010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:08.361017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:08.361021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:08.361145Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:08.367433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 702 sessionId: src_id|e271d6f5-c55ebc9a-696b827c-4a0d0662_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:08.370277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:08.471030Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:08.471522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:08.471535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:08.471738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_8_16360897178546223690_v1
2025-09-30T14:52:08.471754Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:08.471778Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_8_16360897178546223690_v1
2025-09-30T14:52:08.471802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:08.471823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:08.471835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895138463470761:6573]
2025-09-30T14:52:08.471857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:08.471893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 702 reason: error at write: Disconnected sessionId: src_id|e271d6f5-c55ebc9a-696b827c-4a0d0662_0
2025-09-30T14:52:08.472064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 702 sessionId: src_id|e271d6f5-c55ebc9a-696b827c-4a0d0662_0 is DEAD
2025-09-30T14:52:08.472212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e271d6f5-c55ebc9a-696b827c-4a0d0662_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:08.472224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e271d6f5-c55ebc9a-696b827c-4a0d0662_0] Write session will restart in 0.009248s
2025-09-30T14:52:08.472251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e271d6f5-c55ebc9a-696b827c-4a0d0662_0] Write session: Do CDS request
2025-09-30T14:52:08.472256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e271d6f5-c55ebc9a-696b827c-4a0d0662_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:08.482722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e271d6f5-c55ebc9a-696b827c-4a0d0662_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:08.482869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:08.482884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 703
2025-09-30T14:52:08.483040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 703 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:08.483080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 703 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:08.483085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=703 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:08.483089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:08.483526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 703 sessionId:  describe result for acl check
2025-09-30T14:52:08.483558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:08.483561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:08.483562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:08.483568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895138463471089:6575] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:08.484121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895138463471089:6575] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:08.486967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895138463471089:6575] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:08.490011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895138463471089:6575] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:08.490025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895138463471089:6575] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:08.490027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895138463471089:6575] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:08.490034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 703 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:08.490874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:08.493836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:08.494080Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:08.494094Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:08.494106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:08.494160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:08.494201Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895138373742676:5432]
2025-09-30T14:52:08.494878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:08.495237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:08.495298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:08.495635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:08.495700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:08.495706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:08.495707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:08.495708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:08.495709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:08.495711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:08.495712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:08.495713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:08.495714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:08.495715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:08.495716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.495717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.495718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.495719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:08.495720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:08.495726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:08.495735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:08.495740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:08.495744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:08.495748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:08.495752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:08.495756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:08.495759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:08.495763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:08.495767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:08.495770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.495775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.495779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.495783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:08.495787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:08.495795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:08.495804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:08.495810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:08.495815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:08.495820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:08.495826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:08.495831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:08.495835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:08.495840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:08.495846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:08.495851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:08.495856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:08.495861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:08.495866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:08.495871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:08.495884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:08.495889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:08.495899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:08.495906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:08.495915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:08.495922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.495931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.495936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.495945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.495950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.495960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.495965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:08.495970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:08.495978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:08.495984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:08.496034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:08.501734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:08.502582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:08.502596Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:08.502598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:08.502602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:08.502607Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 702 [2:7555895138373742676:5432]
2025-09-30T14:52:08.502621Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:08.502637Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:08.502640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:08.502644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:08.502647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:08.502663Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:08.502668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:08.502673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:08.502731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.502739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.502740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.502743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:08.502745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:08.502800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:08.502808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.502820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.502837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.502859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:08.502880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895138463471288:6575], now have 1 active actors on pipe
2025-09-30T14:52:08.502889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895138463471010:2454], now have 1 active actors on pipe
2025-09-30T14:52:08.502895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895138373742671:5432]
2025-09-30T14:52:08.502898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895138373742671:5432]
2025-09-30T14:52:08.502900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895138373742671:5432]
2025-09-30T14:52:08.502915Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:08.502932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:08.502939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:08.502943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:08.502945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:08.502949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:08.502951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:08.502980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895138373742671:5432]
2025-09-30T14:52:08.502986Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:08.502990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:08.502972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 702
2025-09-30T14:52:08.503016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:08.502982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 702
2025-09-30T14:52:08.503023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:08.503046Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a898066-931f8e74-82f4a1a5-8e976cd0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:08.503054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:08.503057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:08.503059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:08.503066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:08.503077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:08.503092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:08.503270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:08.503279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:08.503292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:08.503364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 703 partition: 0 MaxSeqNo: 42 sessionId: src_id|9a898066-931f8e74-82f4a1a5-8e976cd0_0
2025-09-30T14:52:08.503707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e271d6f5-c55ebc9a-696b827c-4a0d0662_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9a898066-931f8e74-82f4a1a5-8e976cd0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:08.506312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a898066-931f8e74-82f4a1a5-8e976cd0_0] Write session: try to update token
2025-09-30T14:52:08.506332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a898066-931f8e74-82f4a1a5-8e976cd0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:08.515090Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:08.515109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:08.515119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895138373742671:5432]
2025-09-30T14:52:08.515163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:08.515179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:08.515365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:08.515522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:08.515671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:08.515823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:08.516046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:08.516090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:08.521275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 703 sessionId: src_id|9a898066-931f8e74-82f4a1a5-8e976cd0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:08.524124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:08.524302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:08.524320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:08.524352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:08.524429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:08.526045Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:08.526058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:08.526060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:08.526061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:08.526069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895138373742671:5432]
2025-09-30T14:52:08.526071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895138373742671:5432]
2025-09-30T14:52:08.526074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895138373742671:5432]
2025-09-30T14:52:08.526105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:08.526112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.526113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:08.526118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:08.526125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:08.526132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:08.526244Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:08.572106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895138463471301:6573]
2025-09-30T14:52:08.572406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 702, pipe: [1:7555895138463471301:6573]
2025-09-30T14:52:08.634442Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:08.642442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:08.642467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:08.642640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:08.642701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:08.642764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:08.642825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:08.642869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:08.642877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:08.642952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:08.643013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:08.643088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:08.643171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:08.643479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:08.643490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:08.643562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:08.643630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:08.643700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:08.643765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:08.643808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:08.643814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:08.643878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:08.643946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:08.644009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:08.644072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:08.644119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:08.644126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:08.644194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:08.644255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:08.644314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:08.644381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:08.644428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:08.644435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:08.644502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:08.644564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:08.644630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:08.644697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:08.644744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:08.644752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:08.644818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:08.644877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:08.644943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:08.645016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:08.645062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:08.645070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:08.645140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:08.645204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:08.645267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:08.645334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:08.645381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:08.645386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:08.645450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:08.645510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:08.645573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:08.645639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:08.645688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:08.645695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:08.645762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:08.645832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:08.645898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:08.645963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:08.646008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:08.646017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:08.646082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895138463471301:6573], now have 1 active actors on pipe
2025-09-30T14:52:08.646348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:08.646356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:08.646369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:08.646401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 703 reason: error at write: Disconnected sessionId: src_id|9a898066-931f8e74-82f4a1a5-8e976cd0_0
2025-09-30T14:52:08.646423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895138463471301:6573]
2025-09-30T14:52:08.646577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 703 sessionId: src_id|9a898066-931f8e74-82f4a1a5-8e976cd0_0 is DEAD
2025-09-30T14:52:08.646701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a898066-931f8e74-82f4a1a5-8e976cd0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:08.646712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a898066-931f8e74-82f4a1a5-8e976cd0_0] Write session will restart in 0.009873s
2025-09-30T14:52:08.646734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a898066-931f8e74-82f4a1a5-8e976cd0_0] Write session: Do CDS request
2025-09-30T14:52:08.646740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a898066-931f8e74-82f4a1a5-8e976cd0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:08.647400Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:08.657830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a898066-931f8e74-82f4a1a5-8e976cd0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:08.657927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:08.657943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 704
2025-09-30T14:52:08.658093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 704 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:08.658124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 704 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:08.658134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=704 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:08.658141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:08.658776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 704 sessionId:  describe result for acl check
2025-09-30T14:52:08.658823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:08.658829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:08.658836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:08.658841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895138463471365:6579] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:08.659383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895138463471365:6579] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:08.662656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895138463471365:6579] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:08.665743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895138463471365:6579] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:08.665759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895138463471365:6579] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:08.665763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895138463471365:6579] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:08.665771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 704 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:08.667344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:08.670631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:08.670806Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:08.670813Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:08.670821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:08.670865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:08.670894Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895138373742961:5435]
2025-09-30T14:52:08.671460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:08.671743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:08.671778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:08.672014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:08.672054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:08.672059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:08.672060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:08.672061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:08.672061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:08.672062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:08.672063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:08.672064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:08.672065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:08.672065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:08.672066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.672067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.672068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.672068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:08.672069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:08.672073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:08.672079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:08.672082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:08.672084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:08.672087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:08.672089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:08.672092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:08.672094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:08.672096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:08.672099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:08.672101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.672103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.672106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.672108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:08.672110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:08.672115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:08.672121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:08.672124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:08.672127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:08.672130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:08.672133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:08.672136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:08.672139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:08.672142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:08.672146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:08.672148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:08.672151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:08.672154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:08.672157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:08.672160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:08.672163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:08.672166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:08.672169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:08.672171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:08.672174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:08.672177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.672181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.672183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.672187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.672189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.672192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.672194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:08.672197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:08.672200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:08.672202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:08.672226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:08.678466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:08.679517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:08.679532Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:08.679535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:08.679539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:08.679546Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 703 [2:7555895138373742961:5435]
2025-09-30T14:52:08.679562Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:08.679578Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:08.679585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:08.679588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:08.679590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:08.679606Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:08.679618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:08.679630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:08.679695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.679704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.679706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.679710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:08.679712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:08.679778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:08.679786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.679798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.679809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.679825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:08.679848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895138463471580:6579], now have 1 active actors on pipe
2025-09-30T14:52:08.679856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895138463471303:2454], now have 1 active actors on pipe
2025-09-30T14:52:08.679862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895138373742956:5435]
2025-09-30T14:52:08.679864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895138373742956:5435]
2025-09-30T14:52:08.679866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895138373742956:5435]
2025-09-30T14:52:08.679877Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:08.679893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:08.679895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:08.679903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:08.679905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:08.679908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:08.679911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:08.679945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895138373742956:5435]
2025-09-30T14:52:08.679947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:08.679914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 703
2025-09-30T14:52:08.679923Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 703
2025-09-30T14:52:08.679961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:08.679977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:08.679982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:08.680020Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39feb8a1-7221d4cc-129f0e6c-d61787fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:08.680031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:08.680034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:08.680036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:08.680044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:08.680054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:08.680080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:08.680276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:08.680289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:08.680304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:08.680385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 704 partition: 0 MaxSeqNo: 42 sessionId: src_id|39feb8a1-7221d4cc-129f0e6c-d61787fd_0
2025-09-30T14:52:08.680779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a898066-931f8e74-82f4a1a5-8e976cd0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|39feb8a1-7221d4cc-129f0e6c-d61787fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:08.683546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39feb8a1-7221d4cc-129f0e6c-d61787fd_0] Write session: try to update token
2025-09-30T14:52:08.683564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39feb8a1-7221d4cc-129f0e6c-d61787fd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:08.691990Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:08.692004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:08.692005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:08.692007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:08.692018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895138373742956:5435]
2025-09-30T14:52:08.692021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895138373742956:5435]
2025-09-30T14:52:08.692024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895138373742956:5435]
2025-09-30T14:52:08.692056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:08.692061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.692062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:08.692082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:08.692095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:08.692100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:08.692196Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:08.697916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 704 sessionId: src_id|39feb8a1-7221d4cc-129f0e6c-d61787fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:08.700876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:08.746679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895138463471594:6573]
2025-09-30T14:52:08.746987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 703, pipe: [1:7555895138463471594:6573]
2025-09-30T14:52:08.799786Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:08.800059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:08.800073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:08.800111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895138463471594:6573], now have 1 active actors on pipe
2025-09-30T14:52:08.800312Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:08.800388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:08.800470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 704 reason: status is not ok: tablet will be restarted right now sessionId: src_id|39feb8a1-7221d4cc-129f0e6c-d61787fd_0
2025-09-30T14:52:08.800645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 704 sessionId: src_id|39feb8a1-7221d4cc-129f0e6c-d61787fd_0 is DEAD
2025-09-30T14:52:08.800810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39feb8a1-7221d4cc-129f0e6c-d61787fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:08.800822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39feb8a1-7221d4cc-129f0e6c-d61787fd_0] Write session will restart in 0.009403s
2025-09-30T14:52:08.800852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39feb8a1-7221d4cc-129f0e6c-d61787fd_0] Write session: Do CDS request
2025-09-30T14:52:08.800858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39feb8a1-7221d4cc-129f0e6c-d61787fd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:08.800914Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:08.800960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895138463471594:6573]
2025-09-30T14:52:08.811719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39feb8a1-7221d4cc-129f0e6c-d61787fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:08.811838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:08.811851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 705
2025-09-30T14:52:08.811961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 705 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:08.811993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 705 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:08.812002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=705 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:08.812006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:08.812362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 705 sessionId:  describe result for acl check
2025-09-30T14:52:08.812397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:08.812401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:08.812402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:08.812407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895138463471661:6589] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:08.812922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895138463471661:6589] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:08.815756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895138463471661:6589] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:08.819547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895138463471661:6589] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:08.819566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895138463471661:6589] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:08.819570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895138463471661:6589] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:08.819577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 705 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:08.821940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:08.824769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:08.824968Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:08.824980Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:08.824991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:08.825046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:08.825088Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895138373743257:5443]
2025-09-30T14:52:08.825773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:08.826081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:08.826124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:08.826455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:08.826520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:08.826527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:08.826528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:08.826529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:08.826530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:08.826532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:08.826533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:08.826534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:08.826535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:08.826536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:08.826538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.826539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.826541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.826542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:08.826543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:08.826549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:08.826559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:08.826563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:08.826568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:08.826572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:08.826576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:08.826581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:08.826585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:08.826589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:08.826593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:08.826597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.826600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.826604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.826607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:08.826610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:08.826617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:08.826625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:08.826631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:08.826637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:08.826641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:08.826646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:08.826650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:08.826655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:08.826659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:08.826664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:08.826668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:08.826673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:08.826678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:08.826682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:08.826687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:08.826691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:08.826696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:08.826707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:08.826711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:08.826716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:08.826721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.826727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.826736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.826741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.826750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.826755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.826760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:08.826770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:08.826774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:08.826780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:08.826828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:08.832166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:08.833225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:08.833237Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:08.833239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:08.833242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:08.833247Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 704 [2:7555895138373743257:5443]
2025-09-30T14:52:08.833259Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:08.833269Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:08.833271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:08.833273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:08.833274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:08.833286Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:08.833291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:08.833295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:08.833336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.833347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.833348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.833353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:08.833355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:08.833413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:08.833418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.833426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:08.833432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:08.833441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:08.833459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895138463471866:6589], now have 1 active actors on pipe
2025-09-30T14:52:08.833465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895138463471608:2454], now have 1 active actors on pipe
2025-09-30T14:52:08.833469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895138373743252:5443]
2025-09-30T14:52:08.833471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895138373743252:5443]
2025-09-30T14:52:08.833472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895138373743252:5443]
2025-09-30T14:52:08.833481Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:08.833490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:08.833498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:08.833502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:08.833502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:08.833504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:08.833504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:08.833528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895138373743252:5443]
2025-09-30T14:52:08.833533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:08.833530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 704
2025-09-30T14:52:08.833540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 704
2025-09-30T14:52:08.833566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:08.833599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:08.833606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:08.833625Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a394b67f-85cefbaf-46dbed5e-a2dd4a46_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:08.833634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:08.833636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:08.833641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:08.833649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:08.833663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:08.833675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:08.833827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:08.833836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:08.833847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:08.833948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 705 partition: 0 MaxSeqNo: 42 sessionId: src_id|a394b67f-85cefbaf-46dbed5e-a2dd4a46_0
2025-09-30T14:52:08.834288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39feb8a1-7221d4cc-129f0e6c-d61787fd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a394b67f-85cefbaf-46dbed5e-a2dd4a46_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:08.837093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a394b67f-85cefbaf-46dbed5e-a2dd4a46_0] Write session: try to update token
2025-09-30T14:52:08.837111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a394b67f-85cefbaf-46dbed5e-a2dd4a46_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:08.845327Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:08.845343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:08.845351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895138373743252:5443]
2025-09-30T14:52:08.845391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:08.845400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:08.845565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:08.845698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:08.845829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:08.845972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:08.846156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:08.846192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:08.851236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 705 sessionId: src_id|a394b67f-85cefbaf-46dbed5e-a2dd4a46_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:08.853999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:08.854197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:08.854220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:08.854258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:08.854340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:08.856002Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:08.856016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:08.856018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:08.856019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:08.856030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895138373743252:5443]
2025-09-30T14:52:08.856034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895138373743252:5443]
2025-09-30T14:52:08.856038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895138373743252:5443]
2025-09-30T14:52:08.856070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:08.856079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:08.856081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:08.856093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:08.856108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:08.856112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:08.856204Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:08.901333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895138463471909:6573]
2025-09-30T14:52:08.901605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 704, pipe: [1:7555895138463471909:6573]
2025-09-30T14:52:08.965551Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:08.972707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:08.972730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:08.972885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:08.972949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:08.973009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:08.973067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:08.973109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:08.973117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:08.973187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:08.973243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:08.973308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:08.973371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:08.973518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:08.973525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:08.973586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:08.973643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:08.973707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:08.973764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:08.973812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:08.973822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:08.973903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:08.973998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:08.974080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:08.974164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:08.974212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:08.974217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:08.974308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:08.974416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:08.974508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:08.974587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:08.974638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:08.974641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:08.974732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:08.974810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:08.974890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:08.974968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:08.975021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:08.975025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:08.975113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:08.975184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:08.975267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:08.975329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:08.975378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:08.975387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:08.975455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:08.975516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:08.975569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:08.975629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:08.975670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:08.975679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:08.975738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:08.975793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:08.975849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:08.975913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:08.975960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:08.975966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:08.976023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:08.976077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:08.976142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:08.976204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:08.976247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:08.976256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:08.976306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895138463471909:6573], now have 1 active actors on pipe
2025-09-30T14:52:08.976513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895138463471909:6573]
2025-09-30T14:52:08.976654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:08.976661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:08.976684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 705 reason: error at write: Disconnected sessionId: src_id|a394b67f-85cefbaf-46dbed5e-a2dd4a46_0
2025-09-30T14:52:08.976686Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:08.976843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 705 sessionId: src_id|a394b67f-85cefbaf-46dbed5e-a2dd4a46_0 is DEAD
2025-09-30T14:52:08.976980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a394b67f-85cefbaf-46dbed5e-a2dd4a46_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:08.976987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a394b67f-85cefbaf-46dbed5e-a2dd4a46_0] Write session will restart in 0.009870s
2025-09-30T14:52:08.977007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a394b67f-85cefbaf-46dbed5e-a2dd4a46_0] Write session: Do CDS request
2025-09-30T14:52:08.977011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a394b67f-85cefbaf-46dbed5e-a2dd4a46_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:08.977082Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:08.987760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a394b67f-85cefbaf-46dbed5e-a2dd4a46_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:08.987855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:08.987883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 706
2025-09-30T14:52:08.987991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 706 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:08.988024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 706 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:08.988030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=706 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:08.988034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:08.988525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 706 sessionId:  describe result for acl check
2025-09-30T14:52:08.988560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:08.988566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:08.988568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:08.988574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895138463471999:6597] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:08.989115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895138463471999:6597] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:08.991736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895138463471999:6597] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:08.994566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895138463471999:6597] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:08.994581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895138463471999:6597] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:08.994585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895138463471999:6597] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:08.994592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 706 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:08.997001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:08.999841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:09.000053Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:09.000065Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:09.000076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:09.000129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:09.000172Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895138373743576:5452]
2025-09-30T14:52:09.000853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:09.001151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:09.001203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:09.001496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:09.001543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:09.001548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:09.001548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:09.001549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:09.001550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:09.001551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:09.001551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:09.001552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:09.001553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:09.001554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:09.001555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.001556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.001556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.001557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:09.001558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:09.001562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:09.001569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:09.001571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:09.001575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:09.001579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:09.001584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:09.001588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:09.001591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:09.001596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:09.001600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:09.001604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.001608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.001612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.001615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:09.001619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:09.001627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:09.001636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:09.001642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:09.001648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:09.001669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:09.001674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:09.001680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:09.001685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:09.001690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:09.001695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:09.001700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:09.001706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:09.001711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:09.001716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:09.001721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:09.001725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:09.001729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:09.001731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:09.001734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:09.001737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:09.001740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.001742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.001745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.001748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.001750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.001753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.001756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:09.001759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:09.001762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:09.001765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:09.001789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:09.007164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:09.008036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:09.008055Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:09.008058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:09.008062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:09.008070Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 705 [2:7555895138373743576:5452]
2025-09-30T14:52:09.008087Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:09.008102Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:09.008106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:09.008109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:09.008111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:09.008127Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:09.008139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:09.008146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:09.008206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.008217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.008219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.008222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:09.008224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:09.008292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:09.008302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.008314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.008326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.008343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:09.008361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895138463472184:6597], now have 1 active actors on pipe
2025-09-30T14:52:09.008369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895138463471926:2454], now have 1 active actors on pipe
2025-09-30T14:52:09.008375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895138373743571:5452]
2025-09-30T14:52:09.008377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895138373743571:5452]
2025-09-30T14:52:09.008380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895138373743571:5452]
2025-09-30T14:52:09.008392Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:09.008407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:09.008411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:09.008414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:09.008415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:09.008430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:09.008433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:09.008465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895138373743571:5452]
2025-09-30T14:52:09.008477Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:09.008431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 705
2025-09-30T14:52:09.008446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 705
2025-09-30T14:52:09.008492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:09.008493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:09.008498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:09.008542Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d66c5a6-52d86438-20874959-4fec2dbb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:09.008554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:09.008559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:09.008561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:09.008571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:09.008584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:09.008601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:09.008752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:09.008761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:09.008776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:09.008875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 706 partition: 0 MaxSeqNo: 42 sessionId: src_id|9d66c5a6-52d86438-20874959-4fec2dbb_0
2025-09-30T14:52:09.009235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a394b67f-85cefbaf-46dbed5e-a2dd4a46_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9d66c5a6-52d86438-20874959-4fec2dbb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:09.012160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d66c5a6-52d86438-20874959-4fec2dbb_0] Write session: try to update token
2025-09-30T14:52:09.012185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d66c5a6-52d86438-20874959-4fec2dbb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:09.020958Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:09.020979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:09.020981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:09.020984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:09.020994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895138373743571:5452]
2025-09-30T14:52:09.020998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895138373743571:5452]
2025-09-30T14:52:09.021002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895138373743571:5452]
2025-09-30T14:52:09.021045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:09.021052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.021056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:09.021058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:09.021064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:09.021068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:09.021209Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:09.026987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 706 sessionId: src_id|9d66c5a6-52d86438-20874959-4fec2dbb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:09.029705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:09.076931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895142758439523:6573]
2025-09-30T14:52:09.077226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 705, pipe: [1:7555895142758439523:6573]
2025-09-30T14:52:09.126930Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:09.127524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:09.127538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:09.127575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895142758439523:6573], now have 1 active actors on pipe
2025-09-30T14:52:09.127747Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:09.127841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:09.127869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895142758439523:6573]
2025-09-30T14:52:09.127892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:09.127962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 706 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9d66c5a6-52d86438-20874959-4fec2dbb_0
2025-09-30T14:52:09.128127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 706 sessionId: src_id|9d66c5a6-52d86438-20874959-4fec2dbb_0 is DEAD
2025-09-30T14:52:09.128270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d66c5a6-52d86438-20874959-4fec2dbb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:09.128280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d66c5a6-52d86438-20874959-4fec2dbb_0] Write session will restart in 0.006444s
2025-09-30T14:52:09.128315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d66c5a6-52d86438-20874959-4fec2dbb_0] Write session: Do CDS request
2025-09-30T14:52:09.128320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d66c5a6-52d86438-20874959-4fec2dbb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:09.135730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d66c5a6-52d86438-20874959-4fec2dbb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:09.135857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:09.135873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 707
2025-09-30T14:52:09.136016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 707 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:09.136050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 707 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:09.136067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=707 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:09.136076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:09.136524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 707 sessionId:  describe result for acl check
2025-09-30T14:52:09.136555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:09.136561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:09.136563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:09.136569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895142758439547:6601] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:09.137129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895142758439547:6601] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:09.139529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895142758439547:6601] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:09.143299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895142758439547:6601] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:09.143322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895142758439547:6601] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:09.143326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895142758439547:6601] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:09.143335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 707 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:09.149116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:09.152383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:09.152600Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:09.152611Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:09.152623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:09.152683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:09.152725Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895142668711159:5455]
2025-09-30T14:52:09.153424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:09.153710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:09.153760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:09.154103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:09.154165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:09.154171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:09.154172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:09.154173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:09.154174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:09.154176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:09.154177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:09.154178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:09.154179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:09.154181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:09.154182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.154183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.154184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.154186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:09.154187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:09.154192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:09.154203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:09.154207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:09.154212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:09.154216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:09.154220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:09.154225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:09.154229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:09.154233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:09.154237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:09.154241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.154246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.154250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.154254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:09.154258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:09.154265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:09.154273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:09.154279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:09.154285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:09.154290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:09.154295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:09.154300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:09.154305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:09.154315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:09.154320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:09.154324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:09.154332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:09.154337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:09.154342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:09.154351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:09.154356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:09.154374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:09.154379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:09.154384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:09.154390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:09.154399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.154405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.154413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.154418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.154422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.154427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.154431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:09.154436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:09.154445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:09.154450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:09.154500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:09.160095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:09.160938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:09.160954Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:09.160955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:09.160959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:09.160963Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 706 [2:7555895142668711159:5455]
2025-09-30T14:52:09.160976Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:09.160987Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:09.160989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:09.160991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:09.160993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:09.161005Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:09.161010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:09.161015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:09.161076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.161084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.161085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.161088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:09.161090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:09.161147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:09.161156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.161166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.161182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.161201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:09.161224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895142758439525:2454], now have 1 active actors on pipe
2025-09-30T14:52:09.161234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895142758439692:6601], now have 1 active actors on pipe
2025-09-30T14:52:09.161242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895142668711154:5455]
2025-09-30T14:52:09.161247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895142668711154:5455]
2025-09-30T14:52:09.161248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895142668711154:5455]
2025-09-30T14:52:09.161258Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:09.161267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:09.161273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:09.161276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:09.161279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:09.161280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:09.161282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:09.161311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895142668711154:5455]
2025-09-30T14:52:09.161319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:09.161307Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 706
2025-09-30T14:52:09.161307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 706
2025-09-30T14:52:09.161352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:09.161355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:09.161361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:09.161393Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2911015-dfaf63b3-bc399b67-b6a93dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:09.161405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:09.161408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:09.161410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:09.161417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:09.161428Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:09.161441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:09.161591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:09.161600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:09.161614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:09.161689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 707 partition: 0 MaxSeqNo: 42 sessionId: src_id|c2911015-dfaf63b3-bc399b67-b6a93dc_0
2025-09-30T14:52:09.162060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d66c5a6-52d86438-20874959-4fec2dbb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c2911015-dfaf63b3-bc399b67-b6a93dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:09.165008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2911015-dfaf63b3-bc399b67-b6a93dc_0] Write session: try to update token
2025-09-30T14:52:09.165029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2911015-dfaf63b3-bc399b67-b6a93dc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:09.173428Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:09.173449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:09.173452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:09.173455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:09.173466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895142668711154:5455]
2025-09-30T14:52:09.173470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895142668711154:5455]
2025-09-30T14:52:09.173474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895142668711154:5455]
2025-09-30T14:52:09.173515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:09.173523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.173522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:09.173526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:09.173528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:09.173533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:09.173680Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:09.179724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 707 sessionId: src_id|c2911015-dfaf63b3-bc399b67-b6a93dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:09.182235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:09.227980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895142758439819:6573]
2025-09-30T14:52:09.228270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 706, pipe: [1:7555895142758439819:6573]
2025-09-30T14:52:09.278507Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:09.279176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:09.279189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:09.279226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895142758439819:6573], now have 1 active actors on pipe
2025-09-30T14:52:09.279408Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:09.279475Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:09.279475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895142758439819:6573]
2025-09-30T14:52:09.279503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:09.279582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 707 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c2911015-dfaf63b3-bc399b67-b6a93dc_0
2025-09-30T14:52:09.279764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 707 sessionId: src_id|c2911015-dfaf63b3-bc399b67-b6a93dc_0 is DEAD
2025-09-30T14:52:09.279912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2911015-dfaf63b3-bc399b67-b6a93dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:09.279924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2911015-dfaf63b3-bc399b67-b6a93dc_0] Write session will restart in 0.005550s
2025-09-30T14:52:09.279949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2911015-dfaf63b3-bc399b67-b6a93dc_0] Write session: Do CDS request
2025-09-30T14:52:09.279955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2911015-dfaf63b3-bc399b67-b6a93dc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:09.286694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2911015-dfaf63b3-bc399b67-b6a93dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:09.286832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:09.286849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 708
2025-09-30T14:52:09.286978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 708 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:09.287013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 708 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:09.287025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=708 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:09.287029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:09.287569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 708 sessionId:  describe result for acl check
2025-09-30T14:52:09.287618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:09.287627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:09.287630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:09.287636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895142758439834:6605] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:09.288233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895142758439834:6605] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:09.290689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895142758439834:6605] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:09.294436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895142758439834:6605] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:09.294454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895142758439834:6605] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:09.294458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895142758439834:6605] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:09.294466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 708 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:09.300889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:09.304340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:09.304577Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:09.304587Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:09.304598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:09.304657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:09.304700Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895142668711444:5457]
2025-09-30T14:52:09.305237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:09.305506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:09.305557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:09.305804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:09.305858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:09.305863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:09.305864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:09.305865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:09.305866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:09.305866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:09.305867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:09.305868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:09.305869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:09.305870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:09.305870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.305871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.305872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.305873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:09.305874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:09.305878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:09.305885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:09.305887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:09.305890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:09.305892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:09.305894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:09.305897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:09.305899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:09.305901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:09.305904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:09.305906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.305909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.305911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.305914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:09.305916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:09.305921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:09.305927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:09.305931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:09.305934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:09.305937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:09.305940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:09.305943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:09.305946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:09.305949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:09.305953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:09.305955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:09.305958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:09.305961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:09.305965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:09.305967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:09.305970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:09.305973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:09.305978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:09.305980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:09.305983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:09.305986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.306006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.306009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.306012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.306016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.306019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.306022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:09.306025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:09.306028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:09.306031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:09.306070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:09.312004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:09.312926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:09.312946Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:09.312950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:09.312954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:09.312961Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 707 [2:7555895142668711444:5457]
2025-09-30T14:52:09.312978Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:09.312995Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:09.312998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:09.313001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:09.313004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:09.313021Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:09.313028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:09.313037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:09.313103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.313112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.313115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.313119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:09.313122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:09.313202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:09.313210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.313224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.313242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.313264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:09.313288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895142758439963:6605], now have 1 active actors on pipe
2025-09-30T14:52:09.313297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895142758439820:2454], now have 1 active actors on pipe
2025-09-30T14:52:09.313303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895142668711439:5457]
2025-09-30T14:52:09.313306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895142668711439:5457]
2025-09-30T14:52:09.313309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895142668711439:5457]
2025-09-30T14:52:09.313324Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:09.313343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:09.313351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:09.313356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:09.313359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:09.313369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:09.313373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:09.313349Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 707
2025-09-30T14:52:09.313350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 707
2025-09-30T14:52:09.313412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895142668711439:5457]
2025-09-30T14:52:09.313424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:09.313432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:09.313440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:09.313445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:09.313490Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f566eb5-e9012204-7330cdf2-6693c1ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:09.313502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:09.313512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:09.313514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:09.313523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:09.313537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:09.313565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:09.313871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:09.313879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:09.313893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:09.313989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 708 partition: 0 MaxSeqNo: 42 sessionId: src_id|9f566eb5-e9012204-7330cdf2-6693c1ea_0
2025-09-30T14:52:09.314438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2911015-dfaf63b3-bc399b67-b6a93dc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9f566eb5-e9012204-7330cdf2-6693c1ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:09.317231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f566eb5-e9012204-7330cdf2-6693c1ea_0] Write session: try to update token
2025-09-30T14:52:09.317248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f566eb5-e9012204-7330cdf2-6693c1ea_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:09.326035Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:09.326054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:09.326057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:09.326059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:09.326069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895142668711439:5457]
2025-09-30T14:52:09.326074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895142668711439:5457]
2025-09-30T14:52:09.326078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895142668711439:5457]
2025-09-30T14:52:09.326120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:09.326122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:09.326126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.326128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:09.326129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:09.326132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:09.326275Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:09.332598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 708 sessionId: src_id|9f566eb5-e9012204-7330cdf2-6693c1ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:09.335432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:09.379520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895142758440115:6573]
2025-09-30T14:52:09.379794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 707, pipe: [1:7555895142758440115:6573]
2025-09-30T14:52:09.434636Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:09.435235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:09.435262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:09.435294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895142758440115:6573], now have 1 active actors on pipe
2025-09-30T14:52:09.435483Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:09.435578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:09.435593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895142758440115:6573]
2025-09-30T14:52:09.435610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:09.435700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 708 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9f566eb5-e9012204-7330cdf2-6693c1ea_0
2025-09-30T14:52:09.435879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 708 sessionId: src_id|9f566eb5-e9012204-7330cdf2-6693c1ea_0 is DEAD
2025-09-30T14:52:09.436021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f566eb5-e9012204-7330cdf2-6693c1ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:09.436033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f566eb5-e9012204-7330cdf2-6693c1ea_0] Write session will restart in 0.005843s
2025-09-30T14:52:09.436057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f566eb5-e9012204-7330cdf2-6693c1ea_0] Write session: Do CDS request
2025-09-30T14:52:09.436063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f566eb5-e9012204-7330cdf2-6693c1ea_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:09.442773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f566eb5-e9012204-7330cdf2-6693c1ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:09.442852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:09.442869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 709
2025-09-30T14:52:09.443017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 709 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:09.443050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 709 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:09.443061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=709 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:09.443066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:09.443516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 709 sessionId:  describe result for acl check
2025-09-30T14:52:09.443552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:09.443554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:09.443556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:09.443565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895142758440130:6609] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:09.444127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895142758440130:6609] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:09.446352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895142758440130:6609] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:09.449841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895142758440130:6609] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:09.449854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895142758440130:6609] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:09.449858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895142758440130:6609] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:09.449867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 709 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:09.456630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:09.459778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:09.460008Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:09.460018Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:09.460028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:09.460079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:09.460133Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895142668711731:5459]
2025-09-30T14:52:09.460771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:09.461177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:09.461224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:09.461537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:09.461598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:09.461605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:09.461606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:09.461607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:09.461608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:09.461609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:09.461611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:09.461612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:09.461613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:09.461614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:09.461615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.461616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.461617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.461619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:09.461620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:09.461624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:09.461633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:09.461637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:09.461640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:09.461644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:09.461647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:09.461651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:09.461654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:09.461657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:09.461661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:09.461665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.461668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.461671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.461675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:09.461679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:09.461687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:09.461694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:09.461700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:09.461706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:09.461710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:09.461715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:09.461719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:09.461724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:09.461728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:09.461733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:09.461738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:09.461742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:09.461746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:09.461750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:09.461754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:09.461759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:09.461764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:09.461768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:09.461774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:09.461780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:09.461789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.461794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.461802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.461806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.461814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.461819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.461824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:09.461829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:09.461837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:09.461846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:09.461885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:09.467679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:09.468721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:09.468736Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:09.468739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:09.468743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:09.468751Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 708 [2:7555895142668711731:5459]
2025-09-30T14:52:09.468768Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:09.468783Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:09.468786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:09.468801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:09.468805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:09.468823Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:09.468835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:09.468842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:09.468906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.468910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.468913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.468917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:09.468919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:09.468991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:09.468998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.469012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.469029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.469052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:09.469075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895142758440247:6609], now have 1 active actors on pipe
2025-09-30T14:52:09.469088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895142758440116:2454], now have 1 active actors on pipe
2025-09-30T14:52:09.469095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895142668711726:5459]
2025-09-30T14:52:09.469098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895142668711726:5459]
2025-09-30T14:52:09.469100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895142668711726:5459]
2025-09-30T14:52:09.469113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:09.469128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:09.469134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:09.469138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:09.469142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:09.469143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:09.469146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:09.469186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895142668711726:5459]
2025-09-30T14:52:09.469201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:09.469190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 708
2025-09-30T14:52:09.469197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 708
2025-09-30T14:52:09.469217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:09.469250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:09.469255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:09.469278Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc8f2a16-d522d0c-33e8a142-1c724ed3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:09.469291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:09.469295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:09.469302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:09.469315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:09.469329Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:09.469348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:09.469509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:09.469518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:09.469532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:09.469614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 709 partition: 0 MaxSeqNo: 42 sessionId: src_id|fc8f2a16-d522d0c-33e8a142-1c724ed3_0
2025-09-30T14:52:09.469980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f566eb5-e9012204-7330cdf2-6693c1ea_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fc8f2a16-d522d0c-33e8a142-1c724ed3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:09.472859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc8f2a16-d522d0c-33e8a142-1c724ed3_0] Write session: try to update token
2025-09-30T14:52:09.472882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc8f2a16-d522d0c-33e8a142-1c724ed3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:09.486622Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:09.486640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:09.486652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895142668711726:5459]
2025-09-30T14:52:09.486701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:09.486725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:09.486884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:09.487038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:09.487218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 709 sessionId: src_id|fc8f2a16-d522d0c-33e8a142-1c724ed3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:09.487598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:09.487745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:09.487955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:09.487997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:09.489999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:09.490220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:09.490235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:09.490266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:09.490349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:09.491932Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:09.491949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:09.491950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:09.491952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:09.491959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895142668711726:5459]
2025-09-30T14:52:09.491963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895142668711726:5459]
2025-09-30T14:52:09.491965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895142668711726:5459]
2025-09-30T14:52:09.491993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:09.491999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.492000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:09.492013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:09.492020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:09.492025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:09.492125Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:09.535677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895142758440414:6573]
2025-09-30T14:52:09.535973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 708, pipe: [1:7555895142758440414:6573]
2025-09-30T14:52:09.603379Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:09.611458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:09.611490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:09.611676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:09.611747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:09.611819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:09.611882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:09.611928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:09.611936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:09.612005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:09.612067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:09.612129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:09.612193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:09.612235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:09.612241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:09.612308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:09.612368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:09.612430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:09.612495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:09.612537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:09.612544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:09.612611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:09.612684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:09.612755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:09.612819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:09.612861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:09.612866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:09.612931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:09.613002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:09.613064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:09.613126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:09.613175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:09.613181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:09.613243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:09.613313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:09.613390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:09.613462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:09.613505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:09.613510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:09.613573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:09.613628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:09.613699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:09.613775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:09.613826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:09.613834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:09.613900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:09.613956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:09.614025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:09.614090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:09.614132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:09.614139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:09.614204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:09.614272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:09.614345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:09.614427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:09.614475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:09.614481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:09.614550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:09.614622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:09.614687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:09.614755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:09.614806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:09.614813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:09.614882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895142758440414:6573], now have 1 active actors on pipe
2025-09-30T14:52:09.615123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:09.615142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895142758440414:6573]
2025-09-30T14:52:09.615170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:09.615172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:09.615201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 709 reason: error at write: Disconnected sessionId: src_id|fc8f2a16-d522d0c-33e8a142-1c724ed3_0
2025-09-30T14:52:09.615403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 709 sessionId: src_id|fc8f2a16-d522d0c-33e8a142-1c724ed3_0 is DEAD
2025-09-30T14:52:09.615515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc8f2a16-d522d0c-33e8a142-1c724ed3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:09.615527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc8f2a16-d522d0c-33e8a142-1c724ed3_0] Write session will restart in 0.009218s
2025-09-30T14:52:09.615550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc8f2a16-d522d0c-33e8a142-1c724ed3_0] Write session: Do CDS request
2025-09-30T14:52:09.615556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc8f2a16-d522d0c-33e8a142-1c724ed3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:09.616121Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:09.625793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc8f2a16-d522d0c-33e8a142-1c724ed3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:09.625856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:09.625879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 710
2025-09-30T14:52:09.625996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 710 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:09.626032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 710 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:09.626044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=710 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:09.626053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:09.626557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 710 sessionId:  describe result for acl check
2025-09-30T14:52:09.626595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:09.626604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:09.626605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:09.626611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895142758440466:6614] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:09.627153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895142758440466:6614] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:09.630185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895142758440466:6614] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:09.633619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895142758440466:6614] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:09.633633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895142758440466:6614] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:09.633637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895142758440466:6614] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:09.633647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 710 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:09.636564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:09.639337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:09.639544Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:09.639555Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:09.639567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:09.639620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:09.639664Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895142668712021:5462]
2025-09-30T14:52:09.640350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:09.640636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:09.640681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:09.641022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:09.641085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:09.641090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:09.641091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:09.641092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:09.641093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:09.641095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:09.641096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:09.641097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:09.641098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:09.641099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:09.641101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.641102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.641102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.641103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:09.641104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:09.641109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:09.641120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:09.641124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:09.641128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:09.641132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:09.641136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:09.641139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:09.641143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:09.641146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:09.641150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:09.641154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.641158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.641162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.641166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:09.641170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:09.641178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:09.641186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:09.641191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:09.641196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:09.641202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:09.641207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:09.641211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:09.641216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:09.641220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:09.641226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:09.641230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:09.641235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:09.641239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:09.641250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:09.641255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:09.641265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:09.641270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:09.641275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:09.641284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:09.641288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:09.641293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.641297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.641301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.641306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.641310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.641316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.641319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:09.641324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:09.641334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:09.641339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:09.641385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:09.646720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:09.647614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:09.647627Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:09.647631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:09.647635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:09.647641Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 709 [2:7555895142668712021:5462]
2025-09-30T14:52:09.647660Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:09.647675Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:09.647677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:09.647681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:09.647683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:09.647699Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:09.647707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:09.647714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:09.647773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.647788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.647791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.647794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:09.647797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:09.647867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:09.647876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.647889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.647907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.647931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:09.647951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895142758440660:6614], now have 1 active actors on pipe
2025-09-30T14:52:09.647960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895142758440416:2454], now have 1 active actors on pipe
2025-09-30T14:52:09.647966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895142668712016:5462]
2025-09-30T14:52:09.647968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895142668712016:5462]
2025-09-30T14:52:09.647970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895142668712016:5462]
2025-09-30T14:52:09.647983Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:09.647996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:09.648001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:09.648005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:09.648006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:09.648017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:09.648020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:09.648049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895142668712016:5462]
2025-09-30T14:52:09.648061Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:09.648067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:09.648061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 709
2025-09-30T14:52:09.648064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 709
2025-09-30T14:52:09.648115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:09.648124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:09.648151Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|677a3ced-cdad01c8-87ac9f19-bb402f2b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:09.648162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:09.648166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:09.648168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:09.648177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:09.648186Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:09.648204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:09.648375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:09.648382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:09.648396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:09.648497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 710 partition: 0 MaxSeqNo: 42 sessionId: src_id|677a3ced-cdad01c8-87ac9f19-bb402f2b_0
2025-09-30T14:52:09.648816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc8f2a16-d522d0c-33e8a142-1c724ed3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|677a3ced-cdad01c8-87ac9f19-bb402f2b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:09.651804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|677a3ced-cdad01c8-87ac9f19-bb402f2b_0] Write session: try to update token
2025-09-30T14:52:09.651822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|677a3ced-cdad01c8-87ac9f19-bb402f2b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:09.659713Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:09.659734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:09.659746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895142668712016:5462]
2025-09-30T14:52:09.659795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:09.659803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:09.660029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:09.660206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:09.660368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:09.660543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:09.660788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:09.660835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:09.666611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 710 sessionId: src_id|677a3ced-cdad01c8-87ac9f19-bb402f2b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:09.669437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:09.670448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:09.670469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:09.670487Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:09.670489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:09.670491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:09.670492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:09.670498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895142668712016:5462]
2025-09-30T14:52:09.670501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895142668712016:5462]
2025-09-30T14:52:09.670504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895142668712016:5462]
2025-09-30T14:52:09.670540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:09.670549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.670551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:09.670560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:09.670567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:09.670569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:09.670666Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:09.715405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895142758440713:6573]
2025-09-30T14:52:09.715722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 709, pipe: [1:7555895142758440713:6573]
2025-09-30T14:52:09.781573Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:09.782102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:09.782138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895142758440713:6573], now have 1 active actors on pipe
2025-09-30T14:52:09.782245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:09.782311Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:09.782373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895142758440713:6573]
2025-09-30T14:52:09.794316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:09.794342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:09.794383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 710 reason: error at write: Disconnected sessionId: src_id|677a3ced-cdad01c8-87ac9f19-bb402f2b_0
2025-09-30T14:52:09.794539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 710 sessionId: src_id|677a3ced-cdad01c8-87ac9f19-bb402f2b_0 is DEAD
2025-09-30T14:52:09.794680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|677a3ced-cdad01c8-87ac9f19-bb402f2b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:09.794693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|677a3ced-cdad01c8-87ac9f19-bb402f2b_0] Write session will restart in 0.008362s
2025-09-30T14:52:09.794730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|677a3ced-cdad01c8-87ac9f19-bb402f2b_0] Write session: Do CDS request
2025-09-30T14:52:09.794738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|677a3ced-cdad01c8-87ac9f19-bb402f2b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:09.803704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|677a3ced-cdad01c8-87ac9f19-bb402f2b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:09.803802Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:09.803817Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 711
2025-09-30T14:52:09.803941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 711 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:09.803969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 711 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:09.803979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=711 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:09.803982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:09.804421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 711 sessionId:  describe result for acl check
2025-09-30T14:52:09.804471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:09.804480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:09.804484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:09.804490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895142758440915:6618] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:09.805015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895142758440915:6618] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:09.807459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895142758440915:6618] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:09.808193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:09.811157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:09.811343Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:09.811352Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:09.811360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:09.811402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:09.811451Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895142668712310:5464]
2025-09-30T14:52:09.811524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895142758440915:6618] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:09.811538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895142758440915:6618] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:09.811541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895142758440915:6618] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:09.811549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 711 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:09.811945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:09.812189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:09.812222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:09.812502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:09.812553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:09.812558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:09.812559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:09.812559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:09.812560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:09.812561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:09.812562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:09.812563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:09.812563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:09.812564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:09.812565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.812566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.812566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.812567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:09.812567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:09.812571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:09.812578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:09.812580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:09.812582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:09.812585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:09.812587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:09.812589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:09.812591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:09.812594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:09.812597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:09.812599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.812601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.812603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.812605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:09.812608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:09.812613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:09.812618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:09.812622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:09.812625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:09.812628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:09.812632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:09.812634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:09.812638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:09.812641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:09.812645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:09.812648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:09.812651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:09.812653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:09.812656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:09.812658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:09.812661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:09.812664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:09.812667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:09.812670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:09.812673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:09.812675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.812678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.812681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.812683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.812686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.812688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.812691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:09.812693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:09.812696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:09.812699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:09.812723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:09.818079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:09.819355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:09.819368Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:09.819370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:09.819374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:09.819379Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 710 [2:7555895142668712310:5464]
2025-09-30T14:52:09.819392Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:09.819406Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:09.819408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:09.819410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:09.819411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:09.819422Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:09.819427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:09.819432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:09.819477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.819486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.819487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.819489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:09.819491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:09.819539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:09.819541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.819550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.819562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.819583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:09.819604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895142758440714:2454], now have 1 active actors on pipe
2025-09-30T14:52:09.819615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895142668712305:5464]
2025-09-30T14:52:09.819617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895142668712305:5464]
2025-09-30T14:52:09.819618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895142668712305:5464]
2025-09-30T14:52:09.819625Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:09.819631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895142758441008:6618], now have 1 active actors on pipe
2025-09-30T14:52:09.819637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:09.819636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:09.819639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:09.819641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:09.819645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:09.819646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:09.819673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895142668712305:5464]
2025-09-30T14:52:09.819682Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:09.819689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:09.819680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 710
2025-09-30T14:52:09.819680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 710
2025-09-30T14:52:09.819743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:09.819751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:09.819770Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64beeebf-9e244d28-738b58c6-4a652a89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:09.819775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:09.819778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:09.819779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:09.819787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:09.819794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:09.819804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:09.819972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:09.819980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:09.820004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:09.820120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 711 partition: 0 MaxSeqNo: 42 sessionId: src_id|64beeebf-9e244d28-738b58c6-4a652a89_0
2025-09-30T14:52:09.820489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|677a3ced-cdad01c8-87ac9f19-bb402f2b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|64beeebf-9e244d28-738b58c6-4a652a89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:09.823449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64beeebf-9e244d28-738b58c6-4a652a89_0] Write session: try to update token
2025-09-30T14:52:09.823470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64beeebf-9e244d28-738b58c6-4a652a89_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:09.837652Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:09.837672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:09.837681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895142668712305:5464]
2025-09-30T14:52:09.837726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:09.837731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:09.837927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:09.838079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:09.838223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:09.838233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 711 sessionId: src_id|64beeebf-9e244d28-738b58c6-4a652a89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:09.838387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:09.838938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:09.838985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:09.841060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:09.841249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:09.841265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:09.841299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:09.841426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:09.842755Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:09.842772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:09.842775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:09.842776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:09.842784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895142668712305:5464]
2025-09-30T14:52:09.842788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895142668712305:5464]
2025-09-30T14:52:09.842791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895142668712305:5464]
2025-09-30T14:52:09.842820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:09.842824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.842833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:09.842837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:09.842856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:09.842861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:09.842968Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:09.882280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895142758441042:6573]
2025-09-30T14:52:09.882600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 710, pipe: [1:7555895142758441042:6573]
2025-09-30T14:52:09.952048Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:09.960268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:09.960293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:09.960444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:09.960505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:09.960571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:09.960648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:09.961171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:09.961191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:09.961264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:09.961324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:09.961384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:09.961459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:09.961501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:09.961508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:09.961574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:09.961636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:09.961697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:09.961756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:09.961796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:09.961801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:09.961871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:09.961929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:09.961989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:09.962073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:09.962121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:09.962128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:09.962201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:09.962270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:09.962337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:09.962413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:09.962464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:09.962471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:09.962539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:09.962648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:09.962740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:09.962804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:09.962845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:09.962851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:09.962915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:09.962970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:09.963034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:09.963101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:09.963148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:09.963155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:09.963225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:09.963304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:09.963367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:09.963435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:09.963482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:09.963490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:09.963554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:09.963613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:09.963680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:09.963752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:09.963801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:09.963810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:09.963882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:09.963945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:09.964002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:09.964061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:09.964101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:09.964107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:09.964156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895142758441042:6573], now have 1 active actors on pipe
2025-09-30T14:52:09.964398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:09.964413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:09.964441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 711 reason: error at write: Disconnected sessionId: src_id|64beeebf-9e244d28-738b58c6-4a652a89_0
2025-09-30T14:52:09.964607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 711 sessionId: src_id|64beeebf-9e244d28-738b58c6-4a652a89_0 is DEAD
2025-09-30T14:52:09.964644Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:09.964699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895142758441042:6573]
2025-09-30T14:52:09.964739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64beeebf-9e244d28-738b58c6-4a652a89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:09.964750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64beeebf-9e244d28-738b58c6-4a652a89_0] Write session will restart in 0.006365s
2025-09-30T14:52:09.964774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64beeebf-9e244d28-738b58c6-4a652a89_0] Write session: Do CDS request
2025-09-30T14:52:09.964780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64beeebf-9e244d28-738b58c6-4a652a89_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:09.965232Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:09.972727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64beeebf-9e244d28-738b58c6-4a652a89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:09.972921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:09.972934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 712
2025-09-30T14:52:09.973078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 712 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:09.973119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 712 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:09.973131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=712 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:09.973134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:09.973575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 712 sessionId:  describe result for acl check
2025-09-30T14:52:09.973616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:09.973623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:09.973624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:09.973630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895142758441076:6630] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:09.974163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895142758441076:6630] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:09.976930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895142758441076:6630] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:09.980684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895142758441076:6630] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:09.980699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895142758441076:6630] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:09.980703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895142758441076:6630] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:09.980711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 712 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:09.986460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:09.989470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:09.989662Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:09.989678Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:09.989689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:09.989737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:09.989794Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895142668712650:5479]
2025-09-30T14:52:09.990504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:09.990818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:09.990860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:09.991216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:09.991301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:09.991307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:09.991309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:09.991310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:09.991311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:09.991313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:09.991314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:09.991315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:09.991316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:09.991318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:09.991319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.991320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.991321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.991322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:09.991324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:09.991330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:09.991341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:09.991345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:09.991349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:09.991353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:09.991357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:09.991361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:09.991365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:09.991370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:09.991374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:09.991378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.991382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.991386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.991390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:09.991394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:09.991403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:09.991412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:09.991418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:09.991424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:09.991428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:09.991434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:09.991439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:09.991445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:09.991456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:09.991461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:09.991466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:09.991474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:09.991479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:09.991485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:09.991489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:09.991494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:09.991504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:09.991510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:09.991515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:09.991520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:09.991530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.991535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.991540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.991550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.991555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.991565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.991569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:09.991575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:09.991580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:09.991586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:09.991629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:09.997284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:09.998823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:09.998841Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:09.998843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:09.998847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:09.998853Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 711 [2:7555895142668712650:5479]
2025-09-30T14:52:09.998871Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:09.998885Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:09.998893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:09.998897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:09.998899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:09.998914Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:09.998925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:09.998936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:09.998997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.999009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.999011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.999015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:09.999018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:09.999084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:09.999094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:09.999107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:09.999120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:09.999140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:09.999164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895142758441058:2454], now have 1 active actors on pipe
2025-09-30T14:52:09.999169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895142758441219:6630], now have 1 active actors on pipe
2025-09-30T14:52:09.999175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895142668712645:5479]
2025-09-30T14:52:09.999182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895142668712645:5479]
2025-09-30T14:52:09.999185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895142668712645:5479]
2025-09-30T14:52:09.999199Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:09.999214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 711
2025-09-30T14:52:09.999211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:09.999226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 711
2025-09-30T14:52:09.999216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:09.999218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:09.999220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:09.999232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:09.999235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:09.999305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895142668712645:5479]
2025-09-30T14:52:09.999317Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:09.999323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:09.999337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:09.999346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:09.999396Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4afd70b1-f4d54487-c4be152e-d94b586c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:09.999407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:09.999415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:09.999417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:09.999428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:09.999441Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:09.999468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:09.999605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:09.999614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:09.999629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:09.999703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 712 partition: 0 MaxSeqNo: 42 sessionId: src_id|4afd70b1-f4d54487-c4be152e-d94b586c_0
2025-09-30T14:52:10.000090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64beeebf-9e244d28-738b58c6-4a652a89_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4afd70b1-f4d54487-c4be152e-d94b586c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:10.002898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4afd70b1-f4d54487-c4be152e-d94b586c_0] Write session: try to update token
2025-09-30T14:52:10.002917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4afd70b1-f4d54487-c4be152e-d94b586c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:10.011702Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:10.011722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:10.011725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:10.011728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:10.011738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895142668712645:5479]
2025-09-30T14:52:10.011744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895142668712645:5479]
2025-09-30T14:52:10.011749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895142668712645:5479]
2025-09-30T14:52:10.011792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:10.011799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.011803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:10.011804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:10.011810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:10.011814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:10.011943Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:10.020766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 712 sessionId: src_id|4afd70b1-f4d54487-c4be152e-d94b586c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:10.023476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:10.065096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895147053408660:6573]
2025-09-30T14:52:10.065355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 711, pipe: [1:7555895147053408660:6573]
2025-09-30T14:52:10.121004Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:10.121253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:10.121266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:10.121285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895147053408660:6573], now have 1 active actors on pipe
2025-09-30T14:52:10.121504Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:10.121491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895147053408660:6573]
2025-09-30T14:52:10.121506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:10.121530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:10.121533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:10.121603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 712 reason: error at write: Disconnected sessionId: src_id|4afd70b1-f4d54487-c4be152e-d94b586c_0
2025-09-30T14:52:10.121768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 712 sessionId: src_id|4afd70b1-f4d54487-c4be152e-d94b586c_0 is DEAD
2025-09-30T14:52:10.121928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4afd70b1-f4d54487-c4be152e-d94b586c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:10.121940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4afd70b1-f4d54487-c4be152e-d94b586c_0] Write session will restart in 0.009035s
2025-09-30T14:52:10.121962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4afd70b1-f4d54487-c4be152e-d94b586c_0] Write session: Do CDS request
2025-09-30T14:52:10.121971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4afd70b1-f4d54487-c4be152e-d94b586c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:10.131671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4afd70b1-f4d54487-c4be152e-d94b586c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:10.131793Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:10.131807Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 713
2025-09-30T14:52:10.132035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 713 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:10.132076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 713 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:10.132082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=713 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:10.132087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:10.132622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 713 sessionId:  describe result for acl check
2025-09-30T14:52:10.132661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:10.132664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:10.132665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:10.132671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895147053408706:6636] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:10.133184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895147053408706:6636] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:10.135625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895147053408706:6636] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:10.138838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895147053408706:6636] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:10.138853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895147053408706:6636] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:10.138856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895147053408706:6636] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:10.138864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 713 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:10.142925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:10.145960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:10.146162Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:10.146174Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:10.146185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:10.146249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:10.146289Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895146963680240:5482]
2025-09-30T14:52:10.146866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:10.147156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:10.147197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:10.147555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:10.147649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:10.147654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:10.147656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:10.147657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:10.147658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:10.147659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:10.147661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:10.147662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:10.147663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:10.147664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:10.147665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.147667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.147668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.147669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:10.147670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:10.147676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:10.147686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:10.147691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:10.147695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:10.147699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:10.147704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:10.147707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:10.147711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:10.147715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:10.147718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:10.147720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.147722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.147725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.147727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:10.147729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:10.147738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:10.147747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:10.147753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:10.147758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:10.147763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:10.147769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:10.147773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:10.147779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:10.147784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:10.147789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:10.147793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:10.147798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:10.147803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:10.147809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:10.147813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:10.147818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:10.147823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:10.147833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:10.147837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:10.147844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:10.147849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.147855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.147859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.147866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.147871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.147876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.147881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:10.147886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:10.147893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:10.147904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:10.147940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:10.153248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:10.154234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:10.154252Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:10.154254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:10.154258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:10.154265Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 712 [2:7555895146963680240:5482]
2025-09-30T14:52:10.154282Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:10.154296Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:10.154299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:10.154302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:10.154305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:10.154321Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:10.154333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:10.154341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:10.154773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.154781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.154783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.154785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:10.154787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:10.154841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:10.154847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.154856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.154862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.154879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:10.154899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895147053408863:6636], now have 1 active actors on pipe
2025-09-30T14:52:10.154909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895146963680235:5482]
2025-09-30T14:52:10.154910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895146963680235:5482]
2025-09-30T14:52:10.154913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895146963680235:5482]
2025-09-30T14:52:10.154919Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:10.154926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895147053408662:2454], now have 1 active actors on pipe
2025-09-30T14:52:10.154933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:10.154933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:10.154937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:10.154940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:10.154945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:10.154947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:10.154972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895146963680235:5482]
2025-09-30T14:52:10.154976Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:10.155005Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 712
2025-09-30T14:52:10.155034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 712
2025-09-30T14:52:10.155066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:10.155077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:10.155086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:10.155105Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b821d89-39d27487-3f1dc0b-c5b8dbfe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:10.155117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:10.155120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:10.155122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:10.155134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:10.155148Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:10.155165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:10.155410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:10.155420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:10.155434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:10.155543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 713 partition: 0 MaxSeqNo: 42 sessionId: src_id|6b821d89-39d27487-3f1dc0b-c5b8dbfe_0
2025-09-30T14:52:10.155876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4afd70b1-f4d54487-c4be152e-d94b586c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6b821d89-39d27487-3f1dc0b-c5b8dbfe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:10.158509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b821d89-39d27487-3f1dc0b-c5b8dbfe_0] Write session: try to update token
2025-09-30T14:52:10.158527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b821d89-39d27487-3f1dc0b-c5b8dbfe_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:10.166464Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:10.166482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:10.166489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895146963680235:5482]
2025-09-30T14:52:10.166527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:10.166531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:10.166691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:10.167157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:10.167638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:10.168083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:10.168269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:10.168313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:10.173028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 713 sessionId: src_id|6b821d89-39d27487-3f1dc0b-c5b8dbfe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:10.175649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:10.175799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:10.175817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:10.176923Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:10.176934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:10.176935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:10.176937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:10.176943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895146963680235:5482]
2025-09-30T14:52:10.176945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895146963680235:5482]
2025-09-30T14:52:10.176948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895146963680235:5482]
2025-09-30T14:52:10.176976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:10.176979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:10.176983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:10.176987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:10.176990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:10.176996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.176998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:10.177085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:10.177137Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:10.221767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895147053408962:6573]
2025-09-30T14:52:10.222015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 712, pipe: [1:7555895147053408962:6573]
2025-09-30T14:52:10.282015Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:10.290274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:10.290310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:10.290508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:10.290582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:10.290648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:10.290716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:10.290762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:10.290772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:10.290845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:10.290923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:10.290985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:10.291056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:10.291108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:10.291116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:10.291187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:10.291274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:10.291344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:10.291407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:10.291457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:10.291465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:10.291540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:10.291612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:10.291681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:10.291751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:10.291799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:10.291809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:10.291885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:10.291956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:10.292022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:10.292092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:10.292144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:10.292153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:10.292226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:10.292293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:10.292358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:10.292424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:10.292475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:10.292481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:10.292542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:10.292602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:10.292662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:10.292725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:10.292767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:10.292773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:10.292837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:10.292892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:10.292952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:10.293016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:10.293058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:10.293063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:10.293125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:10.293180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:10.293240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:10.293303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:10.293345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:10.293350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:10.293412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:10.293467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:10.293525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:10.293584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:10.293631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:10.293637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:10.293698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895147053408962:6573], now have 1 active actors on pipe
2025-09-30T14:52:10.293972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:10.294002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895147053408962:6573]
2025-09-30T14:52:10.294030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:10.294032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:10.294066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 713 reason: error at write: Disconnected sessionId: src_id|6b821d89-39d27487-3f1dc0b-c5b8dbfe_0
2025-09-30T14:52:10.294279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 713 sessionId: src_id|6b821d89-39d27487-3f1dc0b-c5b8dbfe_0 is DEAD
2025-09-30T14:52:10.294417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b821d89-39d27487-3f1dc0b-c5b8dbfe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:10.294437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b821d89-39d27487-3f1dc0b-c5b8dbfe_0] Write session will restart in 0.006717s
2025-09-30T14:52:10.294464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b821d89-39d27487-3f1dc0b-c5b8dbfe_0] Write session: Do CDS request
2025-09-30T14:52:10.294469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b821d89-39d27487-3f1dc0b-c5b8dbfe_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:10.294735Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:10.302770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b821d89-39d27487-3f1dc0b-c5b8dbfe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:10.302903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:10.302919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 714
2025-09-30T14:52:10.303058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 714 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:10.303092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 714 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:10.303102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=714 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:10.303106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:10.303549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 714 sessionId:  describe result for acl check
2025-09-30T14:52:10.303584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:10.303586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:10.303588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:10.303593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895147053408988:6640] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:10.304124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895147053408988:6640] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:10.307038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895147053408988:6640] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:10.311166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895147053408988:6640] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:10.311182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895147053408988:6640] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:10.311186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895147053408988:6640] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:10.311194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 714 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:10.315376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:10.318302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:10.318518Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:10.318527Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:10.318535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:10.318573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:10.318607Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895146963680533:5484]
2025-09-30T14:52:10.319105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:10.319412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:10.319447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:10.319729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:10.319788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:10.319795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:10.319796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:10.319797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:10.319797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:10.319798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:10.319799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:10.319800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:10.319801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:10.319801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:10.319802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.319803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.319804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.319804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:10.319806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:10.319810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:10.319816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:10.319819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:10.319821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:10.319824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:10.319827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:10.319829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:10.319831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:10.319834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:10.319836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:10.319839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.319841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.319843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.319846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:10.319848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:10.319854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:10.319859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:10.319863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:10.319867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:10.319870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:10.319874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:10.319876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:10.319880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:10.319883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:10.319886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:10.319889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:10.319892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:10.319895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:10.319898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:10.319901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:10.319904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:10.319907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:10.319910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:10.319912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:10.319917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:10.319920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.319923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.319926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.319929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.319932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.319935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.319938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:10.319941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:10.319944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:10.319947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:10.319971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:10.325618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:10.326641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:10.326655Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:10.326657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:10.326660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:10.326666Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 713 [2:7555895146963680533:5484]
2025-09-30T14:52:10.326680Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:10.326692Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:10.326695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:10.326697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:10.326700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:10.326712Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:10.326717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:10.326722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:10.326772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.326778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.326780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.326782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:10.326784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:10.326838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:10.326845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.326854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.326861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.326871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:10.326883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895146963680528:5484]
2025-09-30T14:52:10.326884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895146963680528:5484]
2025-09-30T14:52:10.326886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895146963680528:5484]
2025-09-30T14:52:10.326891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:10.326901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:10.326905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:10.326909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:10.326910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:10.326920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:10.326923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:10.326934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895147053408963:2454], now have 1 active actors on pipe
2025-09-30T14:52:10.326944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895147053409170:6640], now have 1 active actors on pipe
2025-09-30T14:52:10.326976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895146963680528:5484]
2025-09-30T14:52:10.326988Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:10.327003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:10.327008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 713
2025-09-30T14:52:10.327028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 713
2025-09-30T14:52:10.327074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:10.327081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:10.327101Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28da624f-a7bd9874-545c52d8-d094fd6e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:10.327110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:10.327112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:10.327118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:10.327125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:10.327133Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:10.327152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:10.327310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:10.327327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:10.327358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:10.327454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 714 partition: 0 MaxSeqNo: 42 sessionId: src_id|28da624f-a7bd9874-545c52d8-d094fd6e_0
2025-09-30T14:52:10.327822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b821d89-39d27487-3f1dc0b-c5b8dbfe_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|28da624f-a7bd9874-545c52d8-d094fd6e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:10.330440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28da624f-a7bd9874-545c52d8-d094fd6e_0] Write session: try to update token
2025-09-30T14:52:10.330456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28da624f-a7bd9874-545c52d8-d094fd6e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:10.344776Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:10.344795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:10.344806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895146963680528:5484]
2025-09-30T14:52:10.344855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:10.344865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:10.345036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:10.345189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:10.345326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:10.345461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:10.345644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:10.345681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:10.350142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 714 sessionId: src_id|28da624f-a7bd9874-545c52d8-d094fd6e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:10.350168Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:10.350185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:10.350188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:10.350190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:10.350199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895146963680528:5484]
2025-09-30T14:52:10.350203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895146963680528:5484]
2025-09-30T14:52:10.350208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895146963680528:5484]
2025-09-30T14:52:10.350248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:10.350256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:10.350261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.350262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:10.350263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:10.350265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:10.350424Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:10.352832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:10.394297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895147053409265:6573]
2025-09-30T14:52:10.394592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 713, pipe: [1:7555895147053409265:6573]
2025-09-30T14:52:10.461892Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:10.462591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:10.462611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:10.462630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895147053409265:6573], now have 1 active actors on pipe
2025-09-30T14:52:10.462838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:10.462852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:10.462922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895147053409265:6573]
2025-09-30T14:52:10.462950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 714 reason: error at write: Disconnected sessionId: src_id|28da624f-a7bd9874-545c52d8-d094fd6e_0
2025-09-30T14:52:10.462952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:10.463047Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:10.463144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 714 sessionId: src_id|28da624f-a7bd9874-545c52d8-d094fd6e_0 is DEAD
2025-09-30T14:52:10.463344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28da624f-a7bd9874-545c52d8-d094fd6e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:10.463355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28da624f-a7bd9874-545c52d8-d094fd6e_0] Write session will restart in 0.005406s
2025-09-30T14:52:10.463378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28da624f-a7bd9874-545c52d8-d094fd6e_0] Write session: Do CDS request
2025-09-30T14:52:10.463387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28da624f-a7bd9874-545c52d8-d094fd6e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:10.469729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28da624f-a7bd9874-545c52d8-d094fd6e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:10.469882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:10.469897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 715
2025-09-30T14:52:10.470053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 715 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:10.470095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 715 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:10.470107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=715 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:10.470111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:10.470531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 715 sessionId:  describe result for acl check
2025-09-30T14:52:10.470563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:10.470570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:10.470572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:10.470577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895147053409280:6644] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:10.471126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895147053409280:6644] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:10.473020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895147053409280:6644] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:10.476441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895147053409280:6644] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:10.476456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895147053409280:6644] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:10.476460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895147053409280:6644] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:10.476468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 715 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:10.483871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:10.486930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:10.487116Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:10.487126Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:10.487136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:10.487177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:10.487216Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895146963680827:5486]
2025-09-30T14:52:10.487879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:10.488183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:10.488226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:10.488540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:10.488591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:10.488600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:10.488601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:10.488602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:10.488603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:10.488604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:10.488605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:10.488606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:10.488607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:10.488608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:10.488609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.488610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.488612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.488613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:10.488614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:10.488619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:10.488629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:10.488633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:10.488636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:10.488640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:10.488644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:10.488647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:10.488650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:10.488654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:10.488658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:10.488662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.488665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.488669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.488673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:10.488676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:10.488684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:10.488692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:10.488697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:10.488703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:10.488707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:10.488712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:10.488716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:10.488721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:10.488725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:10.488729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:10.488733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:10.488738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:10.488743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:10.488748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:10.488751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:10.488756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:10.488760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:10.488765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:10.488769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:10.488773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:10.488783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.488787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.488792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.488797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.488801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.488807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.488814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:10.488818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:10.488823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:10.488827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:10.488872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:10.494324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:10.495826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:10.495840Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:10.495842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:10.495845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:10.495850Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 714 [2:7555895146963680827:5486]
2025-09-30T14:52:10.495862Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:10.495874Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:10.495876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:10.495879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:10.495880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:10.495893Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:10.495901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:10.495906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:10.495956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.495961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.495963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.495965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:10.495967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:10.496015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:10.496020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.496029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.496036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.496046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:10.496064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895146963680822:5486]
2025-09-30T14:52:10.496072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895146963680822:5486]
2025-09-30T14:52:10.496076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895146963680822:5486]
2025-09-30T14:52:10.496084Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:10.496094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:10.496097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:10.496099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:10.496102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:10.496115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:10.496121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:10.496129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895147053409266:2454], now have 1 active actors on pipe
2025-09-30T14:52:10.496131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895147053409402:6644], now have 1 active actors on pipe
2025-09-30T14:52:10.496160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895146963680822:5486]
2025-09-30T14:52:10.496170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:10.496183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:10.496245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 714
2025-09-30T14:52:10.496246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 714
2025-09-30T14:52:10.496342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:10.496356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:10.496383Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6fa39c1f-f6508400-686de439-4d1b05f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:10.496398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:10.496405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:10.496408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:10.496420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:10.496435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:10.496455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:10.496660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:10.496667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:10.496681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:10.496775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 715 partition: 0 MaxSeqNo: 42 sessionId: src_id|6fa39c1f-f6508400-686de439-4d1b05f3_0
2025-09-30T14:52:10.497127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28da624f-a7bd9874-545c52d8-d094fd6e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6fa39c1f-f6508400-686de439-4d1b05f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:10.500045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fa39c1f-f6508400-686de439-4d1b05f3_0] Write session: try to update token
2025-09-30T14:52:10.500068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fa39c1f-f6508400-686de439-4d1b05f3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:10.508514Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:10.508538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:10.508548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895146963680822:5486]
2025-09-30T14:52:10.508594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:10.508593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:10.508817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:10.509028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:10.509206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:10.509383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:10.509629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:10.509683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:10.515512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 715 sessionId: src_id|6fa39c1f-f6508400-686de439-4d1b05f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:10.518191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:10.519429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:10.519454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:10.519473Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:10.519476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:10.519478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:10.519480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:10.519488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895146963680822:5486]
2025-09-30T14:52:10.519492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895146963680822:5486]
2025-09-30T14:52:10.519495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895146963680822:5486]
2025-09-30T14:52:10.519537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:10.519544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:10.519550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.519550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:10.519552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:10.519554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:10.519686Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:10.563311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895147053409570:6573]
2025-09-30T14:52:10.563605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 714, pipe: [1:7555895147053409570:6573]
2025-09-30T14:52:10.629825Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:10.630330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:10.630379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895147053409570:6573], now have 1 active actors on pipe
2025-09-30T14:52:10.630502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:10.630558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895147053409570:6573]
2025-09-30T14:52:10.630586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:10.630608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:10.630632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:10.630705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 715 reason: error at write: Disconnected sessionId: src_id|6fa39c1f-f6508400-686de439-4d1b05f3_0
2025-09-30T14:52:10.630849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 715 sessionId: src_id|6fa39c1f-f6508400-686de439-4d1b05f3_0 is DEAD
2025-09-30T14:52:10.631017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fa39c1f-f6508400-686de439-4d1b05f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:10.631027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fa39c1f-f6508400-686de439-4d1b05f3_0] Write session will restart in 0.007381s
2025-09-30T14:52:10.631051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fa39c1f-f6508400-686de439-4d1b05f3_0] Write session: Do CDS request
2025-09-30T14:52:10.631057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fa39c1f-f6508400-686de439-4d1b05f3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:10.639818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fa39c1f-f6508400-686de439-4d1b05f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:10.639958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:10.639973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 716
2025-09-30T14:52:10.640106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 716 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:10.640137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 716 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:10.640146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=716 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:10.640149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:10.640595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 716 sessionId:  describe result for acl check
2025-09-30T14:52:10.640639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:10.640646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:10.640648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:10.640655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895147053409598:6649] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:10.641198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895147053409598:6649] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:10.644213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895147053409598:6649] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:10.647694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895147053409598:6649] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:10.647708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895147053409598:6649] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:10.647711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895147053409598:6649] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:10.647719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 716 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:10.652273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:10.655177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:10.655386Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:10.655398Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:10.655408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:10.655460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:10.655503Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895146963681124:5489]
2025-09-30T14:52:10.656189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:10.656473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:10.656516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:10.656848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:10.656912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:10.656918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:10.656920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:10.656921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:10.656923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:10.656924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:10.656925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:10.656926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:10.656928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:10.656929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:10.656930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.656932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.656933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.656934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:10.656936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:10.656941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:10.656952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:10.656957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:10.656962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:10.656966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:10.656971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:10.656975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:10.656979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:10.656984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:10.656989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:10.656994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.656998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.657002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.657007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:10.657011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:10.657020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:10.657034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:10.657040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:10.657046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:10.657051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:10.657060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:10.657064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:10.657075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:10.657081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:10.657091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:10.657096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:10.657102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:10.657112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:10.657118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:10.657124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:10.657130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:10.657140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:10.657146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:10.657153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:10.657164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:10.657168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.657174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.657183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.657189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.657197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.657207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.657212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:10.657221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:10.657226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:10.657231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:10.657276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:10.662876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:10.664051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:10.664066Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:10.664069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:10.664073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:10.664078Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 715 [2:7555895146963681124:5489]
2025-09-30T14:52:10.664094Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:10.664110Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:10.664112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:10.664115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:10.664117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:10.664133Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:10.664140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:10.664146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:10.664209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.664216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.664218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.664222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:10.664224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:10.664292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:10.664299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.664310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.664325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.664345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:10.664369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895147053409571:2454], now have 1 active actors on pipe
2025-09-30T14:52:10.664372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895147053409771:6649], now have 1 active actors on pipe
2025-09-30T14:52:10.664378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895146963681119:5489]
2025-09-30T14:52:10.664380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895146963681119:5489]
2025-09-30T14:52:10.664383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895146963681119:5489]
2025-09-30T14:52:10.664396Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:10.664411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:10.664422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:10.664426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:10.664429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:10.664430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:10.664433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:10.664466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895146963681119:5489]
2025-09-30T14:52:10.664474Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:10.664477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:10.664433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 715
2025-09-30T14:52:10.664492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:10.664500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:10.664544Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3525c9b3-bfd10baa-6a0c1fd7-bf0095e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:10.664555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:10.664559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:10.664561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:10.664570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:10.664585Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:10.664606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:10.664590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 715
2025-09-30T14:52:10.664787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:10.664795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:10.664808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:10.664912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 716 partition: 0 MaxSeqNo: 42 sessionId: src_id|3525c9b3-bfd10baa-6a0c1fd7-bf0095e2_0
2025-09-30T14:52:10.665227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fa39c1f-f6508400-686de439-4d1b05f3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3525c9b3-bfd10baa-6a0c1fd7-bf0095e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:10.668068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3525c9b3-bfd10baa-6a0c1fd7-bf0095e2_0] Write session: try to update token
2025-09-30T14:52:10.668089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3525c9b3-bfd10baa-6a0c1fd7-bf0095e2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:10.676721Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:10.676741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:10.676744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:10.676746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:10.676755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895146963681119:5489]
2025-09-30T14:52:10.676760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895146963681119:5489]
2025-09-30T14:52:10.676764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895146963681119:5489]
2025-09-30T14:52:10.676806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:10.676815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.676824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:10.676821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:10.676829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:10.676834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:10.676977Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:10.682916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 716 sessionId: src_id|3525c9b3-bfd10baa-6a0c1fd7-bf0095e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:10.685490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:10.730698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895147053409875:6573]
2025-09-30T14:52:10.730979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 715, pipe: [1:7555895147053409875:6573]
2025-09-30T14:52:10.787144Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:10.787455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:10.787469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:10.787507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895147053409875:6573], now have 1 active actors on pipe
2025-09-30T14:52:10.787745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:10.787788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:10.787792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:10.787802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895147053409875:6573]
2025-09-30T14:52:10.787873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 716 reason: error at write: Disconnected sessionId: src_id|3525c9b3-bfd10baa-6a0c1fd7-bf0095e2_0
2025-09-30T14:52:10.788031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 716 sessionId: src_id|3525c9b3-bfd10baa-6a0c1fd7-bf0095e2_0 is DEAD
2025-09-30T14:52:10.788182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3525c9b3-bfd10baa-6a0c1fd7-bf0095e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:10.788194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3525c9b3-bfd10baa-6a0c1fd7-bf0095e2_0] Write session will restart in 0.008958s
2025-09-30T14:52:10.788186Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:10.788218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3525c9b3-bfd10baa-6a0c1fd7-bf0095e2_0] Write session: Do CDS request
2025-09-30T14:52:10.788226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3525c9b3-bfd10baa-6a0c1fd7-bf0095e2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:10.798746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3525c9b3-bfd10baa-6a0c1fd7-bf0095e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:10.798877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:10.798892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 717
2025-09-30T14:52:10.799024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 717 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:10.799052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 717 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:10.799059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=717 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:10.799063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:10.799469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 717 sessionId:  describe result for acl check
2025-09-30T14:52:10.799500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:10.799506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:10.799508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:10.799512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895147053409936:6653] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:10.800141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895147053409936:6653] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:10.803087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895147053409936:6653] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:10.806283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895147053409936:6653] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:10.806298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895147053409936:6653] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:10.806301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895147053409936:6653] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:10.806309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 717 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:10.809624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:10.812672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:10.812884Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:10.812897Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:10.812907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:10.812958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:10.813000Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895146963681420:5491]
2025-09-30T14:52:10.813708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:10.813994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:10.814036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:10.814373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:10.814436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:10.814441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:10.814443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:10.814444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:10.814445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:10.814446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:10.814448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:10.814449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:10.814450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:10.814451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:10.814453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.814454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.814455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.814457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:10.814458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:10.814464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:10.814475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:10.814479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:10.814484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:10.814488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:10.814492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:10.814496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:10.814501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:10.814505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:10.814509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:10.814513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.814517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.814521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.814525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:10.814529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:10.814537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:10.814546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:10.814552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:10.814557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:10.814561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:10.814567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:10.814572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:10.814578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:10.814582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:10.814587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:10.814597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:10.814601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:10.814608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:10.814619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:10.814624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:10.814629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:10.814635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:10.814640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:10.814645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:10.814650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:10.814660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.814665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.814670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.814679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.814683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.814689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.814700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:10.814705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:10.814710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:10.814715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:10.814757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:10.820154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:10.821533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:10.821556Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:10.821559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:10.821563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:10.821570Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 716 [2:7555895146963681420:5491]
2025-09-30T14:52:10.821588Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:10.821607Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:10.821615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:10.821618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:10.821620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:10.821636Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:10.821647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:10.821653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:10.821716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.821724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.821726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.821730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:10.821732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:10.821800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:10.821808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.821823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.821840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.821861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:10.821886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895147053410122:6653], now have 1 active actors on pipe
2025-09-30T14:52:10.821889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895147053409876:2454], now have 1 active actors on pipe
2025-09-30T14:52:10.821896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895146963681415:5491]
2025-09-30T14:52:10.821902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895146963681415:5491]
2025-09-30T14:52:10.821904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895146963681415:5491]
2025-09-30T14:52:10.821918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:10.821931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:10.821937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:10.821940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:10.821943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:10.821953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:10.821957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:10.821991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895146963681415:5491]
2025-09-30T14:52:10.822000Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:10.822001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:10.821960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 716
2025-09-30T14:52:10.821967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 716
2025-09-30T14:52:10.822028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:10.822039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:10.822072Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c00c436-3a1d0440-3f9c786c-2c4bb3b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:10.822084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:10.822087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:10.822094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:10.822104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:10.822117Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:10.822140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:10.822279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:10.822288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:10.822302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:10.822388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 717 partition: 0 MaxSeqNo: 42 sessionId: src_id|9c00c436-3a1d0440-3f9c786c-2c4bb3b4_0
2025-09-30T14:52:10.822741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3525c9b3-bfd10baa-6a0c1fd7-bf0095e2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9c00c436-3a1d0440-3f9c786c-2c4bb3b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:10.825514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c00c436-3a1d0440-3f9c786c-2c4bb3b4_0] Write session: try to update token
2025-09-30T14:52:10.825537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c00c436-3a1d0440-3f9c786c-2c4bb3b4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:10.834221Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:10.834244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:10.834247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:10.834249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:10.834258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895146963681415:5491]
2025-09-30T14:52:10.834262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895146963681415:5491]
2025-09-30T14:52:10.834267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895146963681415:5491]
2025-09-30T14:52:10.834311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:10.834318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.834310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:10.834321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:10.834324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:10.834327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:10.834489Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:10.839674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 717 sessionId: src_id|9c00c436-3a1d0440-3f9c786c-2c4bb3b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:10.842388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:10.887862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895147053410193:6573]
2025-09-30T14:52:10.888106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 716, pipe: [1:7555895147053410193:6573]
2025-09-30T14:52:10.946788Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:10.947034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:10.947047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:10.947079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895147053410193:6573], now have 1 active actors on pipe
2025-09-30T14:52:10.947301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:10.947313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:10.947316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:10.947376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895147053410193:6573]
2025-09-30T14:52:10.947379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 717 reason: error at write: Disconnected sessionId: src_id|9c00c436-3a1d0440-3f9c786c-2c4bb3b4_0
2025-09-30T14:52:10.947553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 717 sessionId: src_id|9c00c436-3a1d0440-3f9c786c-2c4bb3b4_0 is DEAD
2025-09-30T14:52:10.947568Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:10.947663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c00c436-3a1d0440-3f9c786c-2c4bb3b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:10.947674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c00c436-3a1d0440-3f9c786c-2c4bb3b4_0] Write session will restart in 0.008268s
2025-09-30T14:52:10.947697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c00c436-3a1d0440-3f9c786c-2c4bb3b4_0] Write session: Do CDS request
2025-09-30T14:52:10.947707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c00c436-3a1d0440-3f9c786c-2c4bb3b4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:10.956786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c00c436-3a1d0440-3f9c786c-2c4bb3b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:10.956868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:10.956886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 718
2025-09-30T14:52:10.957070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 718 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:10.957112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 718 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:10.957122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=718 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:10.957126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:10.957608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 718 sessionId:  describe result for acl check
2025-09-30T14:52:10.957644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:10.957650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:10.957652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:10.957658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895147053410239:6664] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:10.958197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895147053410239:6664] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:10.961192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895147053410239:6664] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:10.965299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895147053410239:6664] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:10.965317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895147053410239:6664] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:10.965320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895147053410239:6664] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:10.965328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 718 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:10.970406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:10.973759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:10.973984Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:10.974012Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:10.974025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:10.974095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:10.974142Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895146963681765:5506]
2025-09-30T14:52:10.974782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:10.975103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:10.975159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:10.975500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:10.975585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:10.975591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:10.975592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:10.975593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:10.975594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:10.975595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:10.975596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:10.975597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:10.975598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:10.975599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:10.975601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.975602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.975603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.975605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:10.975606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:10.975612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:10.975622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:10.975627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:10.975632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:10.975636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:10.975640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:10.975644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:10.975648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:10.975652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:10.975657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:10.975661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.975665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.975670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.975674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:10.975678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:10.975686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:10.975695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:10.975701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:10.975707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:10.975711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:10.975717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:10.975721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:10.975726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:10.975733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:10.975739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:10.975744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:10.975749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:10.975755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:10.975760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:10.975765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:10.975770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:10.975774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:10.975780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:10.975782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:10.975785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:10.975788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.975791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.975793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.975796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.975798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.975801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.975804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:10.975807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:10.975809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:10.975813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:10.975836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:10.981224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:10.982469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:10.982486Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:10.982489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:10.982493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:10.982499Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 717 [2:7555895146963681765:5506]
2025-09-30T14:52:10.982515Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:10.982531Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:10.982535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:10.982537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:10.982540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:10.982557Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:10.982565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:10.982571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:10.982631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.982639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.982641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.982645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:10.982647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:10.982711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:10.982719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.982731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:10.982749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:10.982771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:10.982794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895147053410208:2454], now have 1 active actors on pipe
2025-09-30T14:52:10.982802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895147053410409:6664], now have 1 active actors on pipe
2025-09-30T14:52:10.982808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895146963681760:5506]
2025-09-30T14:52:10.982811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895146963681760:5506]
2025-09-30T14:52:10.982813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895146963681760:5506]
2025-09-30T14:52:10.982828Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:10.982845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:10.982845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:10.982848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:10.982851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:10.982865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:10.982868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:10.982899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895146963681760:5506]
2025-09-30T14:52:10.982859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 717
2025-09-30T14:52:10.982907Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:10.982861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 717
2025-09-30T14:52:10.982910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:10.982923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:10.982928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:10.982976Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3aec77e-2cb5e930-2e585231-3d2e77e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:10.982988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:10.982999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:10.983001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:10.983011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:10.983020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:10.983051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:10.983286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:10.983296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:10.983312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:10.983404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 718 partition: 0 MaxSeqNo: 42 sessionId: src_id|e3aec77e-2cb5e930-2e585231-3d2e77e2_0
2025-09-30T14:52:10.983778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c00c436-3a1d0440-3f9c786c-2c4bb3b4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e3aec77e-2cb5e930-2e585231-3d2e77e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:10.986738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3aec77e-2cb5e930-2e585231-3d2e77e2_0] Write session: try to update token
2025-09-30T14:52:10.986753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3aec77e-2cb5e930-2e585231-3d2e77e2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:10.995509Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:10.995527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:10.995529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:10.995531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:10.995540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895146963681760:5506]
2025-09-30T14:52:10.995544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895146963681760:5506]
2025-09-30T14:52:10.995549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895146963681760:5506]
2025-09-30T14:52:10.995585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:10.995592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:10.995594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:10.995597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:10.995604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:10.995609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:10.995745Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:11.000916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 718 sessionId: src_id|e3aec77e-2cb5e930-2e585231-3d2e77e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:11.003663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:11.047603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895151348377830:6573]
2025-09-30T14:52:11.047840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 717, pipe: [1:7555895151348377830:6573]
2025-09-30T14:52:11.109080Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:11.109346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:11.109359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:11.109395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895151348377830:6573], now have 1 active actors on pipe
2025-09-30T14:52:11.109588Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:11.109702Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:11.109717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:11.109721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:11.109757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895151348377830:6573]
2025-09-30T14:52:11.109783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 718 reason: error at write: Disconnected sessionId: src_id|e3aec77e-2cb5e930-2e585231-3d2e77e2_0
2025-09-30T14:52:11.109958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 718 sessionId: src_id|e3aec77e-2cb5e930-2e585231-3d2e77e2_0 is DEAD
2025-09-30T14:52:11.110112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3aec77e-2cb5e930-2e585231-3d2e77e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:11.110124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3aec77e-2cb5e930-2e585231-3d2e77e2_0] Write session will restart in 0.008055s
2025-09-30T14:52:11.110147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3aec77e-2cb5e930-2e585231-3d2e77e2_0] Write session: Do CDS request
2025-09-30T14:52:11.110154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3aec77e-2cb5e930-2e585231-3d2e77e2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:11.119709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3aec77e-2cb5e930-2e585231-3d2e77e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:11.119837Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:11.119852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 719
2025-09-30T14:52:11.120019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 719 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:11.120064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 719 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:11.120074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=719 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:11.120078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:11.120491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 719 sessionId:  describe result for acl check
2025-09-30T14:52:11.120529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:11.120536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:11.120540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:11.120547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895151348377858:6671] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:11.121066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895151348377858:6671] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:11.123889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895151348377858:6671] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:11.127127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895151348377858:6671] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:11.127142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895151348377858:6671] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:11.127146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895151348377858:6671] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:11.127154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 719 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:11.132386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:11.135589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:11.135793Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:11.135802Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:11.135811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:11.135853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:11.135883Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895151258649361:5509]
2025-09-30T14:52:11.136360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:11.136638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:11.136672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:11.136913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:11.136963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:11.136970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:11.136971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:11.136972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:11.136973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:11.136974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:11.136975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:11.136976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:11.136977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:11.136978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:11.136980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.136981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:11.136982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:11.136983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:11.136985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:11.136991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:11.137002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:11.137007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:11.137012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:11.137016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:11.137020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:11.137024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:11.137027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:11.137030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:11.137034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:11.137038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.137042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:11.137045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:11.137049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:11.137053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:11.137066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:11.137076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:11.137093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:11.137109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:11.137123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:11.137136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:11.137149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:11.137163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:11.137175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:11.137200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:11.137215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:11.137222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:11.137235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:11.137251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:11.137265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:11.137277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:11.137291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:11.137297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:11.137305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:11.137311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:11.137325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.137341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.137355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:11.137367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:11.137381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:11.137395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:11.137407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:11.137419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:11.137433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:11.137445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:11.137498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:11.143320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:11.144684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:11.144698Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:11.144700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:11.144704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:11.144710Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 718 [2:7555895151258649361:5509]
2025-09-30T14:52:11.144731Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:11.144748Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:11.144751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:11.144753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:11.144756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:11.144772Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:11.144783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:11.144790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:11.144861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.144870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:11.144872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:11.144876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:11.144878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:11.144945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:11.144952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.144967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:11.144978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:11.144994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:11.145017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895151348378018:6671], now have 1 active actors on pipe
2025-09-30T14:52:11.145025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895151348377835:2454], now have 1 active actors on pipe
2025-09-30T14:52:11.145031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895151258649356:5509]
2025-09-30T14:52:11.145033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895151258649356:5509]
2025-09-30T14:52:11.145035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895151258649356:5509]
2025-09-30T14:52:11.145050Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:11.145068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:11.145067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:11.145070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:11.145071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:11.145086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:11.145089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:11.145087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 718
2025-09-30T14:52:11.145124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895151258649356:5509]
2025-09-30T14:52:11.145132Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:11.145133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:11.145091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 718
2025-09-30T14:52:11.145147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:11.145156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:11.145222Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b116846-e3a5fe7c-f7a39839-cff2b048_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:11.145233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:11.145236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:11.145240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:11.145252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:11.145265Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:11.145289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:11.145410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:11.145423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:11.145451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:11.145533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 719 partition: 0 MaxSeqNo: 42 sessionId: src_id|4b116846-e3a5fe7c-f7a39839-cff2b048_0
2025-09-30T14:52:11.145834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3aec77e-2cb5e930-2e585231-3d2e77e2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4b116846-e3a5fe7c-f7a39839-cff2b048_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:11.148599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b116846-e3a5fe7c-f7a39839-cff2b048_0] Write session: try to update token
2025-09-30T14:52:11.148616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b116846-e3a5fe7c-f7a39839-cff2b048_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:11.157388Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:11.157405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:11.157407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:11.157408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:11.157415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895151258649356:5509]
2025-09-30T14:52:11.157419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895151258649356:5509]
2025-09-30T14:52:11.157422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895151258649356:5509]
2025-09-30T14:52:11.157460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:11.157466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.157465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:11.157469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:11.157475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:11.157478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:11.157606Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:11.163288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 719 sessionId: src_id|4b116846-e3a5fe7c-f7a39839-cff2b048_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:11.166045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:11.209920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895151348378141:6573]
2025-09-30T14:52:11.210153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 718, pipe: [1:7555895151348378141:6573]
2025-09-30T14:52:11.263012Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:11.263565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:11.263579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:11.263613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895151348378141:6573], now have 1 active actors on pipe
2025-09-30T14:52:11.263861Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:11.263847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895151348378141:6573]
2025-09-30T14:52:11.263858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:11.263863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:11.263878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:11.263935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 719 reason: error at write: Disconnected sessionId: src_id|4b116846-e3a5fe7c-f7a39839-cff2b048_0
2025-09-30T14:52:11.264126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 719 sessionId: src_id|4b116846-e3a5fe7c-f7a39839-cff2b048_0 is DEAD
2025-09-30T14:52:11.264281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b116846-e3a5fe7c-f7a39839-cff2b048_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:11.264294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b116846-e3a5fe7c-f7a39839-cff2b048_0] Write session will restart in 0.009490s
2025-09-30T14:52:11.264317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b116846-e3a5fe7c-f7a39839-cff2b048_0] Write session: Do CDS request
2025-09-30T14:52:11.264328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b116846-e3a5fe7c-f7a39839-cff2b048_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:11.274770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b116846-e3a5fe7c-f7a39839-cff2b048_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:11.274869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:11.274887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 720
2025-09-30T14:52:11.275026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 720 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:11.275070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 720 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:11.275075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=720 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:11.275080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:11.275509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 720 sessionId:  describe result for acl check
2025-09-30T14:52:11.275549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:11.275555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:11.275558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:11.275564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895151348378197:6675] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:11.276117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895151348378197:6675] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:11.279225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895151348378197:6675] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:11.282651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895151348378197:6675] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:11.282668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895151348378197:6675] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:11.282672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895151348378197:6675] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:11.282680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 720 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:11.291693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:11.295209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:11.295486Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:11.295500Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:11.295512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:11.295574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:11.295614Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895151258649660:5511]
2025-09-30T14:52:11.296657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:11.297002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:11.297052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:11.297461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:11.297538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:11.297548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:11.297549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:11.297550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:11.297551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:11.297552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:11.297554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:11.297555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:11.297556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:11.297557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:11.297559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.297560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:11.297561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:11.297562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:11.297563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:11.297569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:11.297579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:11.297583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:11.297586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:11.297590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:11.297593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:11.297597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:11.297600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:11.297604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:11.297607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:11.297614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.297617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:11.297621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:11.297624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:11.297627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:11.297634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:11.297642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:11.297647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:11.297651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:11.297655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:11.297661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:11.297665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:11.297671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:11.297675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:11.297680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:11.297684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:11.297688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:11.297692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:11.297696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:11.297700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:11.297706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:11.297711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:11.297716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:11.297720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:11.297724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:11.297728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.297733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.297736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:11.297741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:11.297745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:11.297749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:11.297753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:11.297757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:11.297762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:11.297766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:11.297806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:11.304102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:11.306263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:11.306283Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:11.306286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:11.306292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:11.306299Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 719 [2:7555895151258649660:5511]
2025-09-30T14:52:11.306335Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:11.306373Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:11.306380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:11.306384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:11.306386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:11.306403Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:11.306410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:11.306417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:11.306475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.306482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:11.306484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:11.306488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:11.306491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:11.306556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:11.306566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.306581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:11.306600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:11.306623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:11.306645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895151348378142:2454], now have 1 active actors on pipe
2025-09-30T14:52:11.306653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895151348378381:6675], now have 1 active actors on pipe
2025-09-30T14:52:11.306660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895151258649655:5511]
2025-09-30T14:52:11.306667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895151258649655:5511]
2025-09-30T14:52:11.306669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895151258649655:5511]
2025-09-30T14:52:11.306682Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:11.306697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:11.306700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:11.306707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:11.306709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:11.306717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:11.306720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:11.306755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895151258649655:5511]
2025-09-30T14:52:11.306763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:11.306724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 719
2025-09-30T14:52:11.306729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 719
2025-09-30T14:52:11.306778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:11.306803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:11.306812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:11.306835Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1905a1e-1f5206c9-3b0eb938-ef08e543_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:11.306846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:11.306850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:11.306852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:11.306860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:11.306873Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:11.306890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:11.307056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:11.307065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:11.307078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:11.307155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 720 partition: 0 MaxSeqNo: 42 sessionId: src_id|a1905a1e-1f5206c9-3b0eb938-ef08e543_0
2025-09-30T14:52:11.307568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b116846-e3a5fe7c-f7a39839-cff2b048_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a1905a1e-1f5206c9-3b0eb938-ef08e543_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:11.313698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1905a1e-1f5206c9-3b0eb938-ef08e543_0] Write session: try to update token
2025-09-30T14:52:11.313727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1905a1e-1f5206c9-3b0eb938-ef08e543_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:11.320357Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:11.320388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:11.320398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895151258649655:5511]
2025-09-30T14:52:11.320444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:11.320458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:11.320798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:11.320944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:11.321097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:11.321239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:11.321532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:11.321577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:11.329748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 720 sessionId: src_id|a1905a1e-1f5206c9-3b0eb938-ef08e543_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:11.332291Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:11.332313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:11.332316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:11.332318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:11.332329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895151258649655:5511]
2025-09-30T14:52:11.332333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895151258649655:5511]
2025-09-30T14:52:11.332337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895151258649655:5511]
2025-09-30T14:52:11.332376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:11.332383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.332386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:11.332398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:11.332406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:11.332411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:11.332586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:11.332756Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:11.364034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895151348378449:6573]
2025-09-30T14:52:11.364360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 719, pipe: [1:7555895151348378449:6573]
2025-09-30T14:52:11.442144Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:11.442553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:11.442571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:11.442592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895151348378449:6573], now have 1 active actors on pipe
2025-09-30T14:52:11.442833Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:11.442825Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:11.442868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895151348378449:6573]
2025-09-30T14:52:11.442879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:11.442886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:11.442963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 720 reason: error at write: Disconnected sessionId: src_id|a1905a1e-1f5206c9-3b0eb938-ef08e543_0
2025-09-30T14:52:11.443135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 720 sessionId: src_id|a1905a1e-1f5206c9-3b0eb938-ef08e543_0 is DEAD
2025-09-30T14:52:11.443269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1905a1e-1f5206c9-3b0eb938-ef08e543_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:11.443280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1905a1e-1f5206c9-3b0eb938-ef08e543_0] Write session will restart in 0.008721s
2025-09-30T14:52:11.443305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1905a1e-1f5206c9-3b0eb938-ef08e543_0] Write session: Do CDS request
2025-09-30T14:52:11.443321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1905a1e-1f5206c9-3b0eb938-ef08e543_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:11.452804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1905a1e-1f5206c9-3b0eb938-ef08e543_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:11.452921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:11.452936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 721
2025-09-30T14:52:11.453083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 721 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:11.453148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 721 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:11.453162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=721 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:11.453170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:11.453710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 721 sessionId:  describe result for acl check
2025-09-30T14:52:11.453746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:11.453753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:11.453755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:11.453761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895151348378486:6681] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:11.454384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895151348378486:6681] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:11.457530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895151348378486:6681] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:11.460974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895151348378486:6681] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:11.460992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895151348378486:6681] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:11.460995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895151348378486:6681] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:11.461008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 721 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:11.466427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:11.470020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:11.470284Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:11.470298Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:11.470311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:11.470390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:11.470429Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895151258649962:5515]
2025-09-30T14:52:11.471074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:11.471407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:11.471467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:11.471845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:11.471928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:11.471936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:11.471940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:11.471942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:11.471943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:11.471945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:11.471946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:11.471947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:11.471948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:11.471949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:11.471950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.471951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:11.471952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:11.471953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:11.471954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:11.471960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:11.471970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:11.471974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:11.471978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:11.471981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:11.471985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:11.471989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:11.471993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:11.471997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:11.472001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:11.472005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.472009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:11.472012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:11.472016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:11.472019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:11.472026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:11.472033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:11.472039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:11.472043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:11.472047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:11.472053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:11.472058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:11.472064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:11.472069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:11.472074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:11.472078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:11.472084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:11.472088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:11.472093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:11.472098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:11.472102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:11.472107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:11.472112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:11.472116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:11.472121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:11.472129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.472134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.472138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:11.472143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:11.472148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:11.472153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:11.472157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:11.472162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:11.472167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:11.472173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:11.472218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:11.477774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:11.479035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:11.479053Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:11.479055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:11.479059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:11.479065Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 720 [2:7555895151258649962:5515]
2025-09-30T14:52:11.479080Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:11.479095Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:11.479097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:11.479100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:11.479102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:11.479117Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:11.479125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:11.479131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:11.479194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.479201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:11.479203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:11.479206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:11.479208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:11.479289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:11.479297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.479309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:11.479324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:11.479343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:11.479362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895151258649957:5515]
2025-09-30T14:52:11.479365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895151258649957:5515]
2025-09-30T14:52:11.479366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895151258649957:5515]
2025-09-30T14:52:11.479373Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:11.479384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:11.479388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:11.479389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895151348378452:2454], now have 1 active actors on pipe
2025-09-30T14:52:11.479391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:11.479392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895151348378659:6681], now have 1 active actors on pipe
2025-09-30T14:52:11.479397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:11.479410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:11.479412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:11.479442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895151258649957:5515]
2025-09-30T14:52:11.479456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:11.479466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 720
2025-09-30T14:52:11.479488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:11.479516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 720
2025-09-30T14:52:11.479611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:11.479623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:11.479643Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dedb5fc2-3175bc28-4352d653-20ca235c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:11.479649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:11.479653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:11.479655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:11.479664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:11.479674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:11.479691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:11.479874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:11.479887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:11.479912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:11.480028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 721 partition: 0 MaxSeqNo: 42 sessionId: src_id|dedb5fc2-3175bc28-4352d653-20ca235c_0
2025-09-30T14:52:11.480368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1905a1e-1f5206c9-3b0eb938-ef08e543_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dedb5fc2-3175bc28-4352d653-20ca235c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:11.483306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dedb5fc2-3175bc28-4352d653-20ca235c_0] Write session: try to update token
2025-09-30T14:52:11.483327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dedb5fc2-3175bc28-4352d653-20ca235c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:11.492035Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:11.492056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:11.492066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895151258649957:5515]
2025-09-30T14:52:11.492109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:11.492111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:11.492296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:11.492442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:11.492585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:11.492787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:11.492986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:11.493036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:11.499941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 721 sessionId: src_id|dedb5fc2-3175bc28-4352d653-20ca235c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:11.502793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:11.503813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:11.503857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:11.503878Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:11.503881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:11.503883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:11.503886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:11.503895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895151258649957:5515]
2025-09-30T14:52:11.503899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895151258649957:5515]
2025-09-30T14:52:11.503904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895151258649957:5515]
2025-09-30T14:52:11.503952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:11.503954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:11.503961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.503964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:11.503968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:11.503976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:11.504101Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:11.543262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895151348378767:6573]
2025-09-30T14:52:11.543562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 720, pipe: [1:7555895151348378767:6573]
2025-09-30T14:52:11.618866Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:11.619511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:11.619553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895151348378767:6573], now have 1 active actors on pipe
2025-09-30T14:52:11.619657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:11.619691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:11.619737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895151348378767:6573]
2025-09-30T14:52:11.630455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:11.630470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:11.630490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 721 reason: error at write: Disconnected sessionId: src_id|dedb5fc2-3175bc28-4352d653-20ca235c_0
2025-09-30T14:52:11.630618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 721 sessionId: src_id|dedb5fc2-3175bc28-4352d653-20ca235c_0 is DEAD
2025-09-30T14:52:11.630756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dedb5fc2-3175bc28-4352d653-20ca235c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:11.630768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dedb5fc2-3175bc28-4352d653-20ca235c_0] Write session will restart in 0.007854s
2025-09-30T14:52:11.630791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dedb5fc2-3175bc28-4352d653-20ca235c_0] Write session: Do CDS request
2025-09-30T14:52:11.630797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dedb5fc2-3175bc28-4352d653-20ca235c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:11.639759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dedb5fc2-3175bc28-4352d653-20ca235c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:11.640098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:11.640112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 722
2025-09-30T14:52:11.640254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 722 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:11.640294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 722 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:11.640303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=722 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:11.640308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:11.640733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 722 sessionId:  describe result for acl check
2025-09-30T14:52:11.640770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:11.640777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:11.640779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:11.640784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895151348378911:6686] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:11.641447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895151348378911:6686] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:11.644364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895151348378911:6686] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:11.646384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:11.649548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:11.649715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895151348378911:6686] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:11.649730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895151348378911:6686] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:11.649734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895151348378911:6686] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:11.649742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 722 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:11.649758Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:11.649769Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:11.649779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:11.649840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:11.649879Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895151258650267:5518]
2025-09-30T14:52:11.650390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:11.650681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:11.650716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:11.650979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:11.651031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:11.651036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:11.651036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:11.651037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:11.651038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:11.651039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:11.651039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:11.651040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:11.651041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:11.651041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:11.651042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.651043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:11.651044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:11.651045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:11.651045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:11.651049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:11.651056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:11.651058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:11.651061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:11.651063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:11.651065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:11.651067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:11.651070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:11.651072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:11.651075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:11.651077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.651080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:11.651083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:11.651085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:11.651087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:11.651092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:11.651098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:11.651102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:11.651105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:11.651108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:11.651111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:11.651114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:11.651117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:11.651121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:11.651124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:11.651126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:11.651129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:11.651132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:11.651135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:11.651137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:11.651141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:11.651143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:11.651147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:11.651149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:11.651152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:11.651155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.651159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.651161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:11.651164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:11.651166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:11.651169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:11.651171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:11.651174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:11.651177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:11.651180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:11.651203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:11.657567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:11.658577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:11.658591Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:11.658593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:11.658597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:11.658603Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 721 [2:7555895151258650267:5518]
2025-09-30T14:52:11.658616Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:11.658630Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:11.658633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:11.658636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:11.658639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:11.658655Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:11.658667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:11.658674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:11.658733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.658738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:11.658740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:11.658742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:11.658744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:11.658960Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 721
2025-09-30T14:52:11.658962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 721
2025-09-30T14:52:11.659188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:11.659199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.659208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:11.659214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:11.659232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:11.659269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895151348379068:6686], now have 1 active actors on pipe
2025-09-30T14:52:11.659278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895151348378769:2454], now have 1 active actors on pipe
2025-09-30T14:52:11.659298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:11.659302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:11.659316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895151258650262:5518]
2025-09-30T14:52:11.659319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895151258650262:5518]
2025-09-30T14:52:11.659320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895151258650262:5518]
2025-09-30T14:52:11.659334Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:11.659352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:11.659354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:11.659358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:11.659361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:11.659376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:11.659379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:11.659396Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ddeb6bf-42314fef-8aac37af-543b0389_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:11.659406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:11.659410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:11.659412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:11.659421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:11.659438Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:11.659477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895151258650262:5518]
2025-09-30T14:52:11.659490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:11.659497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:11.659505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:11.659687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:11.659695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:11.659724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:11.659814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 722 partition: 0 MaxSeqNo: 42 sessionId: src_id|3ddeb6bf-42314fef-8aac37af-543b0389_0
2025-09-30T14:52:11.660158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dedb5fc2-3175bc28-4352d653-20ca235c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3ddeb6bf-42314fef-8aac37af-543b0389_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:11.662853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ddeb6bf-42314fef-8aac37af-543b0389_0] Write session: try to update token
2025-09-30T14:52:11.662871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ddeb6bf-42314fef-8aac37af-543b0389_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:11.672575Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:11.672591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:11.672599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895151258650262:5518]
2025-09-30T14:52:11.672642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:11.672645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:11.672834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:11.672978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:11.673120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:11.673262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:11.673457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:11.673497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:11.677437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 722 sessionId: src_id|3ddeb6bf-42314fef-8aac37af-543b0389_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:11.680021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:11.680201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:11.680220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:11.680251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:11.680339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:11.684741Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:11.684758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:11.684761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:11.684763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:11.684772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895151258650262:5518]
2025-09-30T14:52:11.684776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895151258650262:5518]
2025-09-30T14:52:11.684780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895151258650262:5518]
2025-09-30T14:52:11.684817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:11.684824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.684826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:11.684824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:11.684832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:11.684837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:11.684960Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:11.719878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895151348379079:6573]
2025-09-30T14:52:11.720164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 721, pipe: [1:7555895151348379079:6573]
2025-09-30T14:52:11.790571Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:11.797910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:11.797937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:11.798107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:11.798172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:11.798230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:11.798294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:11.798338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:11.798361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:11.798441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:11.798512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:11.798581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:11.798643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:11.798684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:11.798690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:11.798752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:11.798808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:11.798867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:11.798926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:11.798966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:11.798975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:11.799037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:11.799097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:11.799212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:11.799297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:11.799338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:11.799344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:11.799406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:11.799461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:11.799520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:11.799580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:11.799626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:11.799631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:11.799703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:11.799764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:11.799821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:11.799886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:11.799939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:11.799951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:11.800020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:11.800087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:11.800149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:11.800209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:11.800249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:11.800255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:11.800318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:11.800374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:11.800445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:11.800503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:11.800549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:11.800556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:11.800628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:11.800703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:11.800774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:11.800843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:11.800896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:11.800906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:11.800983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:11.801040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:11.801098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:11.801156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:11.801197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:11.801203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:11.801264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895151348379079:6573], now have 1 active actors on pipe
2025-09-30T14:52:11.801557Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:11.801618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895151348379079:6573]
2025-09-30T14:52:11.801756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:11.801765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:11.801795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 722 reason: error at write: Disconnected sessionId: src_id|3ddeb6bf-42314fef-8aac37af-543b0389_0
2025-09-30T14:52:11.801955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 722 sessionId: src_id|3ddeb6bf-42314fef-8aac37af-543b0389_0 is DEAD
2025-09-30T14:52:11.802081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ddeb6bf-42314fef-8aac37af-543b0389_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:11.802089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ddeb6bf-42314fef-8aac37af-543b0389_0] Write session will restart in 0.007398s
2025-09-30T14:52:11.802107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ddeb6bf-42314fef-8aac37af-543b0389_0] Write session: Do CDS request
2025-09-30T14:52:11.802111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ddeb6bf-42314fef-8aac37af-543b0389_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:11.802230Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:11.810861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ddeb6bf-42314fef-8aac37af-543b0389_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:11.810905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:11.810921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 723
2025-09-30T14:52:11.811082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 723 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:11.811115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 723 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:11.811125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=723 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:11.811129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:11.811598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 723 sessionId:  describe result for acl check
2025-09-30T14:52:11.811641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:11.811648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:11.811650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:11.811656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895151348379114:6690] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:11.812231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895151348379114:6690] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:11.815790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895151348379114:6690] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:11.819324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895151348379114:6690] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:11.819340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895151348379114:6690] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:11.819344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895151348379114:6690] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:11.819352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 723 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:11.823041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:11.826505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:11.826725Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:11.826738Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:11.826748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:11.826812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:11.826853Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895151258650571:5520]
2025-09-30T14:52:11.827540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:11.827850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:11.827898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:11.828234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:11.828305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:11.828314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:11.828315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:11.828316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:11.828317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:11.828319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:11.828320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:11.828321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:11.828322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:11.828323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:11.828324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.828325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:11.828326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:11.828327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:11.828328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:11.828333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:11.828344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:11.828348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:11.828351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:11.828355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:11.828360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:11.828363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:11.828367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:11.828371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:11.828375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:11.828379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.828382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:11.828385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:11.828389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:11.828392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:11.828401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:11.828409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:11.828415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:11.828420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:11.828424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:11.828432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:11.828437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:11.828442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:11.828447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:11.828452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:11.828458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:11.828464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:11.828469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:11.828475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:11.828479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:11.828484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:11.828489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:11.828495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:11.828499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:11.828504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:11.828509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.828514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.828518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:11.828523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:11.828527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:11.828532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:11.828536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:11.828540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:11.828545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:11.828549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:11.828592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:11.835384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:11.836359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:11.836373Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:11.836375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:11.836379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:11.836384Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 722 [2:7555895151258650571:5520]
2025-09-30T14:52:11.836398Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:11.836411Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:11.836413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:11.836415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:11.836416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:11.836428Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:11.836434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:11.836439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:11.836486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.836492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:11.836494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:11.836496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:11.836498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:11.836697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 722
2025-09-30T14:52:11.836701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 722
2025-09-30T14:52:11.836906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:11.836914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.836923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:11.836931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:11.836946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:11.836960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895151348379311:6690], now have 1 active actors on pipe
2025-09-30T14:52:11.836967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895151348379080:2454], now have 1 active actors on pipe
2025-09-30T14:52:11.836978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:11.836986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:11.837002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895151258650565:5520]
2025-09-30T14:52:11.837007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895151258650565:5520]
2025-09-30T14:52:11.837009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895151258650565:5520]
2025-09-30T14:52:11.837019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:11.837030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:11.837033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:11.837036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:11.837037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:11.837042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:11.837045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:11.837061Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a659576-e499701c-a66fed88-9d7f3121_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:11.837069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:11.837072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:11.837078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:11.837087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:11.837094Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:11.837124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895151258650565:5520]
2025-09-30T14:52:11.837133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:11.837142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:11.837143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:11.837327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:11.837342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:11.837367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:11.837450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 723 partition: 0 MaxSeqNo: 42 sessionId: src_id|8a659576-e499701c-a66fed88-9d7f3121_0
2025-09-30T14:52:11.837811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ddeb6bf-42314fef-8aac37af-543b0389_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8a659576-e499701c-a66fed88-9d7f3121_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:11.840636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a659576-e499701c-a66fed88-9d7f3121_0] Write session: try to update token
2025-09-30T14:52:11.840655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a659576-e499701c-a66fed88-9d7f3121_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:11.850241Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:11.850265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:11.850276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895151258650565:5520]
2025-09-30T14:52:11.850322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:11.850326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:11.850512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:11.850679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:11.850841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:11.850998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:11.851204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:11.851266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:11.855516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 723 sessionId: src_id|8a659576-e499701c-a66fed88-9d7f3121_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:11.858087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:11.858280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:11.858299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:11.858328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:11.858414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:11.863351Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:11.863374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:11.863377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:11.863380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:11.863389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895151258650565:5520]
2025-09-30T14:52:11.863394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895151258650565:5520]
2025-09-30T14:52:11.863398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895151258650565:5520]
2025-09-30T14:52:11.863438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:11.863440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:11.863444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:11.863447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:11.863447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:11.863451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:11.863600Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:11.901638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895151348379392:6573]
2025-09-30T14:52:11.901875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 722, pipe: [1:7555895151348379392:6573]
2025-09-30T14:52:11.970802Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:11.978882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:11.978905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:11.979063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:11.979129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:11.979195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:11.979273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:11.979319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:11.979332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:11.979406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:11.979470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:11.979538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:11.979604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:11.979648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:11.979658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:11.979725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:11.979893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:11.979955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:11.980034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:11.980080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:11.980087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:11.980157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:11.980226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:11.980289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:11.980354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:11.980396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:11.980403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:11.980470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:11.980577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:11.980680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:11.980742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:11.980803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:11.980810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:11.980877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:11.980938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:11.981000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:11.981071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:11.981132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:11.981140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:11.981204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:11.981264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:11.981330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:11.981392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:11.981440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:11.981449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:11.981513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:11.981570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:11.981634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:11.981703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:11.981749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:11.981760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:11.981827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:11.981892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:11.981962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:11.982027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:11.982075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:11.982082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:11.982146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:11.982206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:11.982273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:11.982340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:11.982396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:11.982403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:11.982461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895151348379392:6573], now have 1 active actors on pipe
2025-09-30T14:52:11.982678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895151348379392:6573]
2025-09-30T14:52:11.982701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:11.982705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:11.982712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:11.982727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 723 reason: error at write: Disconnected sessionId: src_id|8a659576-e499701c-a66fed88-9d7f3121_0
2025-09-30T14:52:11.982879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 723 sessionId: src_id|8a659576-e499701c-a66fed88-9d7f3121_0 is DEAD
2025-09-30T14:52:11.983049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a659576-e499701c-a66fed88-9d7f3121_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:11.983062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a659576-e499701c-a66fed88-9d7f3121_0] Write session will restart in 0.006198s
2025-09-30T14:52:11.983086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a659576-e499701c-a66fed88-9d7f3121_0] Write session: Do CDS request
2025-09-30T14:52:11.983092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a659576-e499701c-a66fed88-9d7f3121_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:11.983423Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:11.990754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a659576-e499701c-a66fed88-9d7f3121_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:11.990855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:11.990872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 724
2025-09-30T14:52:11.991361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 724 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:11.991398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 724 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:11.991412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=724 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:11.991416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:11.992034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 724 sessionId:  describe result for acl check
2025-09-30T14:52:11.992069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:11.992077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:11.992079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:11.992086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895151348379461:6704] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:11.992614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895151348379461:6704] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:11.996437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895151348379461:6704] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:11.999955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895151348379461:6704] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:11.999969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895151348379461:6704] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:11.999972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895151348379461:6704] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:11.999980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 724 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:12.004936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:12.007816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:12.008107Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:12.008119Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:12.008131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:12.008199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:12.008237Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895155553618220:5535]
2025-09-30T14:52:12.008791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:12.009053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:12.009093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:12.009410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:12.009467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:12.009473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:12.009474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:12.009475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:12.009476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:12.009477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:12.009478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:12.009480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:12.009481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:12.009482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:12.009483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.009484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.009485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.009486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:12.009488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:12.009493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:12.009504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:12.009508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:12.009512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:12.009516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:12.009520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:12.009524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:12.009528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:12.009533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:12.009537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:12.009541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.009545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.009549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.009552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:12.009554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:12.009560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:12.009565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:12.009570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:12.009573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:12.009577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:12.009580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:12.009584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:12.009589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:12.009594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:12.009599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:12.009603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:12.009608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:12.009613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:12.009619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:12.009623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:12.009629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:12.009633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:12.009638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:12.009643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:12.009650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:12.009657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.009669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.009674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.009684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.009689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.009695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.009700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:12.009705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:12.009710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:12.009719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:12.009763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:12.015546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:12.016374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:12.016389Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:12.016392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:12.016396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:12.016402Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 723 [2:7555895155553618220:5535]
2025-09-30T14:52:12.016417Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:12.016431Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:12.016439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:12.016441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:12.016444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:12.016459Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:12.016467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:12.016473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:12.016529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.016537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.016539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.016542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:12.016545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:12.016610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:12.016621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.016633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.016646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.016663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:12.016685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895151348379431:2454], now have 1 active actors on pipe
2025-09-30T14:52:12.016693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895151348379620:6704], now have 1 active actors on pipe
2025-09-30T14:52:12.016700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895155553618214:5535]
2025-09-30T14:52:12.016702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895155553618214:5535]
2025-09-30T14:52:12.016706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895155553618214:5535]
2025-09-30T14:52:12.016719Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:12.016728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:12.016731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:12.016733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:12.016736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:12.016751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:12.016759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:12.016727Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 723
2025-09-30T14:52:12.016787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895155553618214:5535]
2025-09-30T14:52:12.016801Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:12.016806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:12.016851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 723
2025-09-30T14:52:12.016892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:12.016902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:12.016925Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e54d6ad-ba2228b2-74c4dd5e-a7071732_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:12.016937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:12.016945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:12.016948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:12.016957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:12.016966Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:12.016984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:12.017109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:12.017121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:12.017142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:12.017233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 724 partition: 0 MaxSeqNo: 42 sessionId: src_id|3e54d6ad-ba2228b2-74c4dd5e-a7071732_0
2025-09-30T14:52:12.017533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a659576-e499701c-a66fed88-9d7f3121_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3e54d6ad-ba2228b2-74c4dd5e-a7071732_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:12.020252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e54d6ad-ba2228b2-74c4dd5e-a7071732_0] Write session: try to update token
2025-09-30T14:52:12.020269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e54d6ad-ba2228b2-74c4dd5e-a7071732_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:12.029790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:12.029809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:12.029811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:12.029812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:12.029819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895155553618214:5535]
2025-09-30T14:52:12.029822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895155553618214:5535]
2025-09-30T14:52:12.029825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895155553618214:5535]
2025-09-30T14:52:12.029855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:12.029861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.029863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:12.029870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:12.029877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:12.029882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:12.030002Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:12.034247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 724 sessionId: src_id|3e54d6ad-ba2228b2-74c4dd5e-a7071732_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:12.036815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:12.082885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895155643347043:6573]
2025-09-30T14:52:12.083118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 723, pipe: [1:7555895155643347043:6573]
2025-09-30T14:52:12.140419Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:12.141104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:12.141121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:12.141159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895155643347043:6573], now have 1 active actors on pipe
2025-09-30T14:52:12.141378Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:12.141385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895155643347043:6573]
2025-09-30T14:52:12.141399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:12.141412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:12.141413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:12.141476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 724 reason: error at write: Disconnected sessionId: src_id|3e54d6ad-ba2228b2-74c4dd5e-a7071732_0
2025-09-30T14:52:12.141662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 724 sessionId: src_id|3e54d6ad-ba2228b2-74c4dd5e-a7071732_0 is DEAD
2025-09-30T14:52:12.141847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e54d6ad-ba2228b2-74c4dd5e-a7071732_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:12.141858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e54d6ad-ba2228b2-74c4dd5e-a7071732_0] Write session will restart in 0.006553s
2025-09-30T14:52:12.141881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e54d6ad-ba2228b2-74c4dd5e-a7071732_0] Write session: Do CDS request
2025-09-30T14:52:12.141889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e54d6ad-ba2228b2-74c4dd5e-a7071732_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:12.149787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e54d6ad-ba2228b2-74c4dd5e-a7071732_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:12.149893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:12.149907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 725
2025-09-30T14:52:12.150021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 725 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:12.150052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 725 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:12.150061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=725 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:12.150065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:12.150539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 725 sessionId:  describe result for acl check
2025-09-30T14:52:12.150582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:12.150590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:12.150592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:12.150598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895155643347074:6708] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:12.151185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895155643347074:6708] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:12.153987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895155643347074:6708] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:12.157133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895155643347074:6708] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:12.157147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895155643347074:6708] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:12.157150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895155643347074:6708] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:12.157159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 725 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:12.162723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:12.165647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:12.165856Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:12.165867Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:12.165877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:12.165926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:12.165968Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895155553618526:5538]
2025-09-30T14:52:12.166567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:12.166885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:12.166934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:12.167264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:12.167337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:12.167343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:12.167344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:12.167345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:12.167346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:12.167347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:12.167348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:12.167350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:12.167351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:12.167352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:12.167353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.167354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.167355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.167357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:12.167358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:12.167363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:12.167372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:12.167376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:12.167379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:12.167383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:12.167387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:12.167391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:12.167394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:12.167398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:12.167402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:12.167405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.167408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.167412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.167415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:12.167418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:12.167426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:12.167434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:12.167440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:12.167445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:12.167450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:12.167455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:12.167459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:12.167464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:12.167471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:12.167482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:12.167485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:12.167490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:12.167495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:12.167500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:12.167509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:12.167514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:12.167518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:12.167523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:12.167531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:12.167536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:12.167540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.167549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.167553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.167558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.167562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.167568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.167572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:12.167577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:12.167581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:12.167585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:12.167626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:12.172987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:12.174044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:12.174059Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:12.174062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:12.174068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:12.174075Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 724 [2:7555895155553618526:5538]
2025-09-30T14:52:12.174090Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:12.174106Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:12.174114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:12.174117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:12.174119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:12.174135Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:12.174146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:12.174152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:12.174217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.174224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.174227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.174230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:12.174232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:12.174300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:12.174307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.174320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.174338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.174367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:12.174391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895155643347046:2454], now have 1 active actors on pipe
2025-09-30T14:52:12.174400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895155643347229:6708], now have 1 active actors on pipe
2025-09-30T14:52:12.174408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895155553618521:5538]
2025-09-30T14:52:12.174415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895155553618521:5538]
2025-09-30T14:52:12.174417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895155553618521:5538]
2025-09-30T14:52:12.174431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:12.174447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:12.174453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:12.174458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:12.174460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:12.174467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:12.174471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:12.174457Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 724
2025-09-30T14:52:12.174465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 724
2025-09-30T14:52:12.174505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895155553618521:5538]
2025-09-30T14:52:12.174519Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:12.174521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:12.174537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:12.174547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:12.174602Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82601283-4afa3a9a-6581a34f-969ababa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:12.174618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:12.174628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:12.174634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:12.174643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:12.174658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:12.174686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:12.174883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:12.174897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:12.174934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:12.175021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 725 partition: 0 MaxSeqNo: 42 sessionId: src_id|82601283-4afa3a9a-6581a34f-969ababa_0
2025-09-30T14:52:12.175371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e54d6ad-ba2228b2-74c4dd5e-a7071732_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|82601283-4afa3a9a-6581a34f-969ababa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:12.178101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82601283-4afa3a9a-6581a34f-969ababa_0] Write session: try to update token
2025-09-30T14:52:12.178118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82601283-4afa3a9a-6581a34f-969ababa_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:12.186889Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:12.186913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:12.186916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:12.186918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:12.186930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895155553618521:5538]
2025-09-30T14:52:12.186936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895155553618521:5538]
2025-09-30T14:52:12.186941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895155553618521:5538]
2025-09-30T14:52:12.186991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:12.186995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:12.187002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:12.187006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:12.187011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.187014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:12.187197Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:12.192576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 725 sessionId: src_id|82601283-4afa3a9a-6581a34f-969ababa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:12.195448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:12.241610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895155643347357:6573]
2025-09-30T14:52:12.241922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 724, pipe: [1:7555895155643347357:6573]
2025-09-30T14:52:12.296684Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:12.296959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:12.296977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:12.297014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895155643347357:6573], now have 1 active actors on pipe
2025-09-30T14:52:12.297177Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:12.297225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895155643347357:6573]
2025-09-30T14:52:12.297247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:12.297256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:12.297329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 725 reason: status is not ok: tablet will be restarted right now sessionId: src_id|82601283-4afa3a9a-6581a34f-969ababa_0
2025-09-30T14:52:12.297496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 725 sessionId: src_id|82601283-4afa3a9a-6581a34f-969ababa_0 is DEAD
2025-09-30T14:52:12.297651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82601283-4afa3a9a-6581a34f-969ababa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:12.297660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82601283-4afa3a9a-6581a34f-969ababa_0] Write session will restart in 0.008201s
2025-09-30T14:52:12.297690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82601283-4afa3a9a-6581a34f-969ababa_0] Write session: Do CDS request
2025-09-30T14:52:12.297696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82601283-4afa3a9a-6581a34f-969ababa_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:12.306753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82601283-4afa3a9a-6581a34f-969ababa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:12.306889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:12.306908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 726
2025-09-30T14:52:12.307142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 726 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:12.307179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 726 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:12.307185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=726 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:12.307188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:12.307739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 726 sessionId:  describe result for acl check
2025-09-30T14:52:12.307776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:12.307783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:12.307784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:12.307791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895155643347418:6712] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:12.308328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895155643347418:6712] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:12.311143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895155643347418:6712] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:12.314249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895155643347418:6712] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:12.314263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895155643347418:6712] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:12.314267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895155643347418:6712] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:12.314274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 726 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:12.318020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:12.321106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:12.321313Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:12.321323Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:12.321361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:12.321427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:12.321467Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895155553618839:5540]
2025-09-30T14:52:12.322144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:12.322376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:12.322427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:12.322743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:12.322800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:12.322806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:12.322806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:12.322808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:12.322809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:12.322809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:12.322811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:12.322812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:12.322813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:12.322814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:12.322815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.322816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.322817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.322819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:12.322820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:12.322825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:12.322837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:12.322841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:12.322846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:12.322850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:12.322854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:12.322858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:12.322862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:12.322866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:12.322870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:12.322875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.322879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.322883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.322890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:12.322894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:12.322906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:12.322918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:12.322929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:12.322934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:12.322938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:12.322944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:12.322949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:12.322956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:12.322965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:12.322975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:12.322982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:12.322991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:12.323001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:12.323008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:12.323017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:12.323026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:12.323034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:12.323043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:12.323051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:12.323057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:12.323065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.323075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.323079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.323088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.323093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.323098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.323103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:12.323108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:12.323113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:12.323119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:12.323163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:12.328521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:12.329320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:12.329336Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:12.329339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:12.329343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:12.329349Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 725 [2:7555895155553618839:5540]
2025-09-30T14:52:12.329364Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:12.329387Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:12.329395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:12.329399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:12.329402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:12.329414Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:12.329418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:12.329428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:12.329474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.329480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.329482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.329485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:12.329488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:12.329554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:12.329560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.329569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.329575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.329585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:12.329602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895155643347358:2454], now have 1 active actors on pipe
2025-09-30T14:52:12.329608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895155643347592:6712], now have 1 active actors on pipe
2025-09-30T14:52:12.329613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895155553618830:5540]
2025-09-30T14:52:12.329615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895155553618830:5540]
2025-09-30T14:52:12.329616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895155553618830:5540]
2025-09-30T14:52:12.329625Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:12.329637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:12.329638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:12.329641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:12.329643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:12.329650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:12.329652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:12.329678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895155553618830:5540]
2025-09-30T14:52:12.329686Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:12.329691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:12.329710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 725
2025-09-30T14:52:12.329715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 725
2025-09-30T14:52:12.330110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:12.330118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:12.330138Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24a3841e-aca45b45-bae70f4d-a6176aa0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:12.330145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:12.330149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:12.330151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:12.330159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:12.330166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:12.330179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:12.330334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:12.330340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:12.330360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:12.330458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 726 partition: 0 MaxSeqNo: 42 sessionId: src_id|24a3841e-aca45b45-bae70f4d-a6176aa0_0
2025-09-30T14:52:12.330811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82601283-4afa3a9a-6581a34f-969ababa_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|24a3841e-aca45b45-bae70f4d-a6176aa0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:12.333478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24a3841e-aca45b45-bae70f4d-a6176aa0_0] Write session: try to update token
2025-09-30T14:52:12.333498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24a3841e-aca45b45-bae70f4d-a6176aa0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:12.341387Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:12.341407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:12.341410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:12.341412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:12.341420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895155553618830:5540]
2025-09-30T14:52:12.341424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895155553618830:5540]
2025-09-30T14:52:12.341428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895155553618830:5540]
2025-09-30T14:52:12.341466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:12.341472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.341475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:12.341484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:12.341491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:12.341494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:12.341610Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:12.347535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 726 sessionId: src_id|24a3841e-aca45b45-bae70f4d-a6176aa0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:12.350368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:12.397248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895155643347674:6573]
2025-09-30T14:52:12.397511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 725, pipe: [1:7555895155643347674:6573]
2025-09-30T14:52:12.449963Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:12.450522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:12.450534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:12.450568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895155643347674:6573], now have 1 active actors on pipe
2025-09-30T14:52:12.450734Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:12.450808Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:12.450872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:12.450890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895155643347674:6573]
2025-09-30T14:52:12.450957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 726 reason: status is not ok: tablet will be restarted right now sessionId: src_id|24a3841e-aca45b45-bae70f4d-a6176aa0_0
2025-09-30T14:52:12.451127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 726 sessionId: src_id|24a3841e-aca45b45-bae70f4d-a6176aa0_0 is DEAD
2025-09-30T14:52:12.451287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24a3841e-aca45b45-bae70f4d-a6176aa0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:12.451297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24a3841e-aca45b45-bae70f4d-a6176aa0_0] Write session will restart in 0.007481s
2025-09-30T14:52:12.451316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24a3841e-aca45b45-bae70f4d-a6176aa0_0] Write session: Do CDS request
2025-09-30T14:52:12.451337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24a3841e-aca45b45-bae70f4d-a6176aa0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:12.459687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24a3841e-aca45b45-bae70f4d-a6176aa0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:12.459817Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:12.459834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 727
2025-09-30T14:52:12.459964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 727 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:12.459989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 727 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:12.459997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=727 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:12.460000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:12.460422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 727 sessionId:  describe result for acl check
2025-09-30T14:52:12.460460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:12.460464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:12.460466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:12.460472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895155643347692:6716] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:12.461002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:12.461002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895155643347692:6716] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:12.463142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895155643347692:6716] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:12.463850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:12.464028Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:12.464037Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:12.464047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:12.464094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:12.464122Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895155553618897:5542]
2025-09-30T14:52:12.464616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:12.464909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:12.464949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:12.465209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:12.465281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:12.465288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:12.465289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:12.465290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:12.465291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:12.465293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:12.465294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:12.465295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:12.465297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:12.465298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:12.465299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.465300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.465302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.465303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:12.465304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:12.465310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:12.465320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:12.465325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:12.465329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:12.465333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:12.465336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:12.465338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:12.465341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:12.465343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:12.465346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:12.465348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.465350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.465353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.465355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:12.465357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:12.465364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:12.465373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895155643347692:6716] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:12.465369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:12.465386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895155643347692:6716] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:12.465373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:12.465376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:12.465389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895155643347692:6716] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:12.465379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:12.465396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 727 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:12.465383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:12.465385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:12.465388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:12.465392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:12.465395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:12.465398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:12.465403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:12.465406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:12.465409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:12.465411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:12.465414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:12.465417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:12.465421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:12.465426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:12.465431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:12.465435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.465441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.465446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.465451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.465457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.465462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.465466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:12.465470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:12.465473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:12.465475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:12.465500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:12.470569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:12.471465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:12.471481Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:12.471483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:12.471487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:12.471494Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 726 [2:7555895155553618897:5542]
2025-09-30T14:52:12.471510Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:12.471524Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:12.471527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:12.471530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:12.471533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:12.471548Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:12.471554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:12.471564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:12.471622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.471630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.471632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.471635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:12.471638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:12.471705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:12.471714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.471727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.471739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.471762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:12.471785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895155643347731:6716], now have 1 active actors on pipe
2025-09-30T14:52:12.471790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895155643347675:2454], now have 1 active actors on pipe
2025-09-30T14:52:12.471796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895155553618891:5542]
2025-09-30T14:52:12.471802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895155553618891:5542]
2025-09-30T14:52:12.471807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895155553618891:5542]
2025-09-30T14:52:12.471819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:12.471837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:12.471847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:12.471851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:12.471852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:12.471854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:12.471854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:12.471849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 726
2025-09-30T14:52:12.471852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 726
2025-09-30T14:52:12.471882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895155553618891:5542]
2025-09-30T14:52:12.471890Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:12.471892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:12.471915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:12.471923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:12.471954Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6593416-799e3a26-40f60f6f-88dbc474_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:12.471966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:12.471970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:12.471972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:12.471981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:12.471989Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:12.472006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:12.472116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:12.472126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:12.472139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:12.472214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 727 partition: 0 MaxSeqNo: 42 sessionId: src_id|b6593416-799e3a26-40f60f6f-88dbc474_0
2025-09-30T14:52:12.472531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24a3841e-aca45b45-bae70f4d-a6176aa0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b6593416-799e3a26-40f60f6f-88dbc474_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:12.475344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6593416-799e3a26-40f60f6f-88dbc474_0] Write session: try to update token
2025-09-30T14:52:12.475363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6593416-799e3a26-40f60f6f-88dbc474_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:12.484069Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:12.484087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:12.484090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:12.484093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:12.484101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895155553618891:5542]
2025-09-30T14:52:12.484106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895155553618891:5542]
2025-09-30T14:52:12.484112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895155553618891:5542]
2025-09-30T14:52:12.484150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:12.484158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.484160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:12.484159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:12.484166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:12.484170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:12.484310Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:12.489496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 727 sessionId: src_id|b6593416-799e3a26-40f60f6f-88dbc474_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:12.492226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:12.550861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895155643347743:6573]
2025-09-30T14:52:12.551139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 726, pipe: [1:7555895155643347743:6573]
2025-09-30T14:52:12.594442Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:12.594679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:12.594690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:12.594723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895155643347743:6573], now have 1 active actors on pipe
2025-09-30T14:52:12.594917Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:12.594976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:12.594989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:12.595010Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:12.595042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 727 reason: error at write: Disconnected sessionId: src_id|b6593416-799e3a26-40f60f6f-88dbc474_0
2025-09-30T14:52:12.595059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895155643347743:6573]
2025-09-30T14:52:12.595187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 727 sessionId: src_id|b6593416-799e3a26-40f60f6f-88dbc474_0 is DEAD
2025-09-30T14:52:12.595350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6593416-799e3a26-40f60f6f-88dbc474_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:12.595361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6593416-799e3a26-40f60f6f-88dbc474_0] Write session will restart in 0.007510s
2025-09-30T14:52:12.595384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6593416-799e3a26-40f60f6f-88dbc474_0] Write session: Do CDS request
2025-09-30T14:52:12.595392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6593416-799e3a26-40f60f6f-88dbc474_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:12.603760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6593416-799e3a26-40f60f6f-88dbc474_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:12.603832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:12.603851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 728
2025-09-30T14:52:12.603985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 728 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:12.603956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:12.604014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 728 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:12.604023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=728 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:12.604026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:12.604456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 728 sessionId:  describe result for acl check
2025-09-30T14:52:12.604495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:12.604501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:12.604503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:12.604509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895155643347763:6721] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:12.605002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895155643347763:6721] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:12.606971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895155643347763:6721] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:12.607038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:12.607226Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:12.607239Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:12.607266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:12.607321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:12.607364Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895155553618957:5545]
2025-09-30T14:52:12.607876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:12.608179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:12.608223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:12.608554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:12.608612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:12.608618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:12.608619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:12.608620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:12.608621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:12.608622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:12.608623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:12.608624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:12.608626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:12.608627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:12.608628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.608629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.608630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.608634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:12.608635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:12.608641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:12.608651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:12.608655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:12.608659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:12.608663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:12.608667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:12.608671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:12.608675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:12.608679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:12.608684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:12.608688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.608692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.608695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.608699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:12.608703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:12.608710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:12.608718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:12.608724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:12.608730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:12.608734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:12.608739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:12.608744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:12.608749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:12.608753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:12.608758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:12.608762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:12.608767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:12.608777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:12.608783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:12.608788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:12.608798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:12.608802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:12.608807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:12.608816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:12.608821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:12.608826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.608837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.608841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.608845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.608854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.608859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.608863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:12.608872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:12.608876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:12.608881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:12.608926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:12.609330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895155643347763:6721] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:12.609344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895155643347763:6721] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:12.609347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895155643347763:6721] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:12.609355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 728 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:12.614241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:12.615107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:12.615123Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:12.615125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:12.615130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:12.615136Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 727 [2:7555895155553618957:5545]
2025-09-30T14:52:12.615151Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:12.615165Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:12.615168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:12.615171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:12.615173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:12.615188Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:12.615200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:12.615210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:12.615286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.615293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.615295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.615298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:12.615301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:12.615359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:12.615366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.615377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.615395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.615417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:12.615438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895155643347744:2454], now have 1 active actors on pipe
2025-09-30T14:52:12.615448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895155643347802:6721], now have 1 active actors on pipe
2025-09-30T14:52:12.615454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895155553618951:5545]
2025-09-30T14:52:12.615456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895155553618951:5545]
2025-09-30T14:52:12.615458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895155553618951:5545]
2025-09-30T14:52:12.615470Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:12.615484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:12.615492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:12.615495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:12.615497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:12.615499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:12.615502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:12.615528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895155553618951:5545]
2025-09-30T14:52:12.615536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:12.615539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:12.615511Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 727
2025-09-30T14:52:12.615529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 727
2025-09-30T14:52:12.615571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:12.615579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:12.615606Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94756c1-ab5b5ac8-a267fea8-3e768ea8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:12.615617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:12.615622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:12.615628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:12.615637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:12.615650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:12.615666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:12.615809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:12.615820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:12.615835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:12.615913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 728 partition: 0 MaxSeqNo: 42 sessionId: src_id|94756c1-ab5b5ac8-a267fea8-3e768ea8_0
2025-09-30T14:52:12.616225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6593416-799e3a26-40f60f6f-88dbc474_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|94756c1-ab5b5ac8-a267fea8-3e768ea8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:12.618808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94756c1-ab5b5ac8-a267fea8-3e768ea8_0] Write session: try to update token
2025-09-30T14:52:12.618826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94756c1-ab5b5ac8-a267fea8-3e768ea8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:12.627723Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:12.627745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:12.627747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:12.627750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:12.627762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895155553618951:5545]
2025-09-30T14:52:12.627766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895155553618951:5545]
2025-09-30T14:52:12.627770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895155553618951:5545]
2025-09-30T14:52:12.627810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:12.627817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.627820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:12.627823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:12.627853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:12.627857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:12.627956Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:12.632355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 728 sessionId: src_id|94756c1-ab5b5ac8-a267fea8-3e768ea8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:12.634829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:12.695267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895155643347810:6573]
2025-09-30T14:52:12.695613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 727, pipe: [1:7555895155643347810:6573]
2025-09-30T14:52:12.733340Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:12.733854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:12.733866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:12.733895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895155643347810:6573], now have 1 active actors on pipe
2025-09-30T14:52:12.734082Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:12.734117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:12.734137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895155643347810:6573]
2025-09-30T14:52:12.734162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:12.734229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 728 reason: status is not ok: tablet will be restarted right now sessionId: src_id|94756c1-ab5b5ac8-a267fea8-3e768ea8_0
2025-09-30T14:52:12.734390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 728 sessionId: src_id|94756c1-ab5b5ac8-a267fea8-3e768ea8_0 is DEAD
2025-09-30T14:52:12.734525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94756c1-ab5b5ac8-a267fea8-3e768ea8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:12.734536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94756c1-ab5b5ac8-a267fea8-3e768ea8_0] Write session will restart in 0.008092s
2025-09-30T14:52:12.734570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94756c1-ab5b5ac8-a267fea8-3e768ea8_0] Write session: Do CDS request
2025-09-30T14:52:12.734575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94756c1-ab5b5ac8-a267fea8-3e768ea8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:12.743717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94756c1-ab5b5ac8-a267fea8-3e768ea8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:12.743778Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:12.743794Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 729
2025-09-30T14:52:12.743845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:12.743955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 729 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:12.743986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 729 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:12.743996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=729 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:12.744000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:12.744443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 729 sessionId:  describe result for acl check
2025-09-30T14:52:12.744477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:12.744479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:12.744481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:12.744487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895155643347831:6725] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:12.745038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895155643347831:6725] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:12.746838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:12.747058Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:12.747068Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:12.747079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:12.747129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:12.747162Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895155553619016:5547]
2025-09-30T14:52:12.747315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895155643347831:6725] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:12.747835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:12.748089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:12.748132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:12.748462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:12.748522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:12.748530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:12.748531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:12.748532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:12.748533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:12.748534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:12.748535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:12.748536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:12.748538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:12.748539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:12.748540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.748541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.748542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.748543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:12.748544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:12.748552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:12.748562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:12.748566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:12.748570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:12.748574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:12.748583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:12.748587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:12.748595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:12.748599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:12.748608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:12.748612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.748616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.748620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.748629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:12.748633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:12.748640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:12.748652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:12.748664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:12.748670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:12.748679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:12.748684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:12.748693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:12.748702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:12.748707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:12.748712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:12.748717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:12.748721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:12.748726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:12.748738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:12.748743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:12.748748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:12.748757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:12.748767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:12.748772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:12.748777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:12.748781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.748788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.748793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.748800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.748805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.748810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.748819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:12.748824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:12.748829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:12.748834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:12.748883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:12.749640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895155643347831:6725] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:12.749652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895155643347831:6725] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:12.749655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895155643347831:6725] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:12.749661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 729 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:12.754472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:12.755345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:12.755359Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:12.755362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:12.755370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:12.755377Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 728 [2:7555895155553619016:5547]
2025-09-30T14:52:12.755394Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:12.755408Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:12.755411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:12.755414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:12.755416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:12.755431Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:12.755436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:12.755440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:12.755484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.755491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.755493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.755496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:12.755499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:12.755558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:12.755565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.755573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.755580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.755593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:12.755610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895155553619010:5547]
2025-09-30T14:52:12.755615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895155553619010:5547]
2025-09-30T14:52:12.755617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895155553619010:5547]
2025-09-30T14:52:12.755625Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:12.755635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895155643347811:2454], now have 1 active actors on pipe
2025-09-30T14:52:12.755636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:12.755640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:12.755642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895155643347870:6725], now have 1 active actors on pipe
2025-09-30T14:52:12.755642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:12.755648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:12.755657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:12.755659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:12.755686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895155553619010:5547]
2025-09-30T14:52:12.755698Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:12.755693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 728
2025-09-30T14:52:12.755695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 728
2025-09-30T14:52:12.755719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:12.755774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:12.755779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:12.755802Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d1264e-45dbebf4-6730ce2f-56151038_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:12.755813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:12.755820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:12.755827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:12.755837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:12.755851Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:12.755867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:12.756025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:12.756036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:12.756048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:12.756158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 729 partition: 0 MaxSeqNo: 42 sessionId: src_id|3d1264e-45dbebf4-6730ce2f-56151038_0
2025-09-30T14:52:12.756565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94756c1-ab5b5ac8-a267fea8-3e768ea8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3d1264e-45dbebf4-6730ce2f-56151038_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:12.759310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d1264e-45dbebf4-6730ce2f-56151038_0] Write session: try to update token
2025-09-30T14:52:12.759327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d1264e-45dbebf4-6730ce2f-56151038_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:12.767652Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:12.767672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:12.767683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895155553619010:5547]
2025-09-30T14:52:12.767728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:12.767734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:12.767949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:12.768103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:12.768276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:12.768464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:12.768689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:12.768732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:12.773259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 729 sessionId: src_id|3d1264e-45dbebf4-6730ce2f-56151038_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:12.775860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:12.776426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:12.776448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:12.776485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:12.776552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:12.777825Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:12.777841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:12.777842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:12.777844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:12.777851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895155553619010:5547]
2025-09-30T14:52:12.777854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895155553619010:5547]
2025-09-30T14:52:12.777857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895155553619010:5547]
2025-09-30T14:52:12.777891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:12.777898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.777901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:12.777902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:12.777907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:12.777911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:12.778033Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:12.834485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895155643347878:6573]
2025-09-30T14:52:12.834757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 728, pipe: [1:7555895155643347878:6573]
2025-09-30T14:52:12.886046Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:12.893461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:12.893489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:12.893648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:12.893707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:12.893770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:12.893830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:12.893872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:12.893880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:12.893946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:12.894005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:12.894068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:12.894131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:12.894173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:12.894179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:12.894242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:12.894300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:12.894377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:12.894439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:12.894479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:12.894490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:12.894552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:12.894609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:12.894672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:12.894731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:12.894772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:12.894777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:12.894841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:12.894897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:12.894954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:12.895014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:12.895057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:12.895069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:12.895145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:12.895215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:12.895295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:12.895351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:12.895469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:12.895475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:12.895536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:12.895591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:12.895665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:12.895727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:12.895769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:12.895775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:12.895835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:12.895892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:12.895949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:12.896006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:12.896047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:12.896054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:12.896117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:12.896175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:12.896231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:12.896289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:12.896330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:12.896336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:12.896396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:12.896456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:12.896516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:12.896575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:12.896618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:12.896624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:12.896681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895155643347878:6573], now have 1 active actors on pipe
2025-09-30T14:52:12.896957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:12.896973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:12.896986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:12.897003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 729 reason: error at write: Disconnected sessionId: src_id|3d1264e-45dbebf4-6730ce2f-56151038_0
2025-09-30T14:52:12.897042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895155643347878:6573]
2025-09-30T14:52:12.897194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 729 sessionId: src_id|3d1264e-45dbebf4-6730ce2f-56151038_0 is DEAD
2025-09-30T14:52:12.897346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d1264e-45dbebf4-6730ce2f-56151038_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:12.897356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d1264e-45dbebf4-6730ce2f-56151038_0] Write session will restart in 0.007610s
2025-09-30T14:52:12.897381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d1264e-45dbebf4-6730ce2f-56151038_0] Write session: Do CDS request
2025-09-30T14:52:12.897387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d1264e-45dbebf4-6730ce2f-56151038_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:12.897771Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:12.905876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d1264e-45dbebf4-6730ce2f-56151038_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:12.905886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:12.905901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 730
2025-09-30T14:52:12.906087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 730 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:12.906134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 730 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:12.906145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=730 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:12.906149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:12.906606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 730 sessionId:  describe result for acl check
2025-09-30T14:52:12.906648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:12.906650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:12.906652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:12.906658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895155643347899:6729] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:12.906656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:12.907191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895155643347899:6729] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:12.909562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:12.909769Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:12.909780Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:12.909792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:12.909861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:12.909901Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895155553619076:5549]
2025-09-30T14:52:12.909920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895155643347899:6729] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:12.910556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:12.910860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:12.910902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:12.911232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:12.911310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:12.911316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:12.911318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:12.911319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:12.911320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:12.911321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:12.911322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:12.911324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:12.911325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:12.911326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:12.911327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.911328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.911329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.911330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:12.911331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:12.911337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:12.911350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:12.911354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:12.911358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:12.911362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:12.911367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:12.911371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:12.911375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:12.911379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:12.911383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:12.911388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.911391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.911396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.911400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:12.911403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:12.911410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:12.911417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:12.911424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:12.911429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:12.911433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:12.911439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:12.911444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:12.911449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:12.911454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:12.911464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:12.911468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:12.911473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:12.911478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:12.911488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:12.911497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:12.911507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:12.911516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:12.911527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:12.911536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:12.911541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:12.911550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.911559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.911568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.911573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.911577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.911586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.911590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:12.911596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:12.911606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:12.911615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:12.911662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:12.912404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895155643347899:6729] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:12.912418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895155643347899:6729] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:12.912422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895155643347899:6729] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:12.912429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 730 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:12.916920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:12.917777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:12.917793Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:12.917796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:12.917801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:12.917808Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 729 [2:7555895155553619076:5549]
2025-09-30T14:52:12.917825Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:12.917841Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:12.917846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:12.917849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:12.917852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:12.917866Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:12.917872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:12.917880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:12.917940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.917950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.917953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.917956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:12.917958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:12.918021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:12.918030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.918042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:12.918058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:12.918080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:12.918102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895155643347939:6729], now have 1 active actors on pipe
2025-09-30T14:52:12.918111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895155643347879:2454], now have 1 active actors on pipe
2025-09-30T14:52:12.918117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895155553619070:5549]
2025-09-30T14:52:12.918119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895155553619070:5549]
2025-09-30T14:52:12.918120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895155553619070:5549]
2025-09-30T14:52:12.918132Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:12.918149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:12.918147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:12.918162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:12.918164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:12.918166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:12.918169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:12.918160Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 729
2025-09-30T14:52:12.918167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 729
2025-09-30T14:52:12.918198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895155553619070:5549]
2025-09-30T14:52:12.918209Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:12.918211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:12.918234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:12.918243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:12.918274Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea3b81ae-45072622-2dd7ad9c-70def773_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:12.918285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:12.918289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:12.918291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:12.918300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:12.918313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:12.918333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:12.918490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:12.918507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:12.918529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:12.918619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 730 partition: 0 MaxSeqNo: 42 sessionId: src_id|ea3b81ae-45072622-2dd7ad9c-70def773_0
2025-09-30T14:52:12.918969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d1264e-45dbebf4-6730ce2f-56151038_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ea3b81ae-45072622-2dd7ad9c-70def773_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:12.921534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea3b81ae-45072622-2dd7ad9c-70def773_0] Write session: try to update token
2025-09-30T14:52:12.921549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea3b81ae-45072622-2dd7ad9c-70def773_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:12.930384Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:12.930403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:12.930406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:12.930408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:12.930416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895155553619070:5549]
2025-09-30T14:52:12.930421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895155553619070:5549]
2025-09-30T14:52:12.930425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895155553619070:5549]
2025-09-30T14:52:12.930463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:12.930470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:12.930474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:12.930474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:12.930480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:12.930485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:12.930622Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:12.935544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 730 sessionId: src_id|ea3b81ae-45072622-2dd7ad9c-70def773_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:12.938435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:12.997288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895155643347979:6573]
2025-09-30T14:52:12.997540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 729, pipe: [1:7555895155643347979:6573]
2025-09-30T14:52:13.043684Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:13.044096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:13.044108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:13.044141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895155643347979:6573], now have 1 active actors on pipe
2025-09-30T14:52:13.044322Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:13.044381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895155643347979:6573]
2025-09-30T14:52:13.044386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:13.044390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:13.044411Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:13.044449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 730 reason: error at write: Disconnected sessionId: src_id|ea3b81ae-45072622-2dd7ad9c-70def773_0
2025-09-30T14:52:13.044617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 730 sessionId: src_id|ea3b81ae-45072622-2dd7ad9c-70def773_0 is DEAD
2025-09-30T14:52:13.044745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea3b81ae-45072622-2dd7ad9c-70def773_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:13.044757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea3b81ae-45072622-2dd7ad9c-70def773_0] Write session will restart in 0.005165s
2025-09-30T14:52:13.044785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea3b81ae-45072622-2dd7ad9c-70def773_0] Write session: Do CDS request
2025-09-30T14:52:13.044790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea3b81ae-45072622-2dd7ad9c-70def773_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:13.050794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea3b81ae-45072622-2dd7ad9c-70def773_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:13.050879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:13.050894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 731
2025-09-30T14:52:13.051340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 731 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:13.051373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 731 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:13.051385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=731 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:13.051389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:13.051846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 731 sessionId:  describe result for acl check
2025-09-30T14:52:13.051879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:13.051885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:13.051887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:13.051893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895159938315304:6745] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:13.052372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895159938315304:6745] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:13.053818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:13.054601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895159938315304:6745] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:13.056683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:13.056889Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:13.056900Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:13.056911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:13.056960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:13.057002Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895159848586480:5564]
2025-09-30T14:52:13.057508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895159938315304:6745] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:13.057523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895159938315304:6745] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:13.057526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895159938315304:6745] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:13.057535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 731 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:13.057657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:13.057884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:13.057925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:13.058238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:13.058295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:13.058301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:13.058304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:13.058305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:13.058306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:13.058308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:13.058309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:13.058310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:13.058312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:13.058313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:13.058314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.058315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.058316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.058317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:13.058319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:13.058324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:13.058335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:13.058339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:13.058353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:13.058357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:13.058361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:13.058365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:13.058369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:13.058373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:13.058377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:13.058381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.058385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.058389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.058393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:13.058397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:13.058404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:13.058411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:13.058417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:13.058423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:13.058428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:13.058433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:13.058437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:13.058442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:13.058447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:13.058452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:13.058458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:13.058463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:13.058468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:13.058472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:13.058482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:13.058487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:13.058491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:13.058500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:13.058505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:13.058511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:13.058520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.058525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.058534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.058539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.058547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.058552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.058554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:13.058557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:13.058560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:13.058562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:13.058585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:13.064067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:13.064935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:13.064956Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:13.064959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:13.064963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:13.064974Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 730 [2:7555895159848586480:5564]
2025-09-30T14:52:13.064993Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:13.065007Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:13.065016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:13.065019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:13.065021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:13.065037Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:13.065049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:13.065060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:13.065121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.065128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.065131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.065135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:13.065138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:13.065212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:13.065220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.065233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.065249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.065268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:13.065291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895159938315345:6745], now have 1 active actors on pipe
2025-09-30T14:52:13.065298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895159938315288:2454], now have 1 active actors on pipe
2025-09-30T14:52:13.065304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895159848586474:5564]
2025-09-30T14:52:13.065311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895159848586474:5564]
2025-09-30T14:52:13.065313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895159848586474:5564]
2025-09-30T14:52:13.065326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:13.065343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:13.065346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:13.065355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:13.065358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:13.065361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:13.065363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:13.065357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 730
2025-09-30T14:52:13.065394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895159848586474:5564]
2025-09-30T14:52:13.065359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 730
2025-09-30T14:52:13.065405Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:13.065407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:13.065424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:13.065429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:13.065475Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f52e91f-800f2466-45fcb796-569aa7c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:13.065487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:13.065491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:13.065496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:13.065508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:13.065522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:13.065544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:13.065698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:13.065705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:13.065718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:13.065792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 731 partition: 0 MaxSeqNo: 42 sessionId: src_id|8f52e91f-800f2466-45fcb796-569aa7c0_0
2025-09-30T14:52:13.066151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea3b81ae-45072622-2dd7ad9c-70def773_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8f52e91f-800f2466-45fcb796-569aa7c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:13.069000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f52e91f-800f2466-45fcb796-569aa7c0_0] Write session: try to update token
2025-09-30T14:52:13.069020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f52e91f-800f2466-45fcb796-569aa7c0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:13.078535Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:13.078567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:13.078572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:13.078574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:13.078587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895159848586474:5564]
2025-09-30T14:52:13.078594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895159848586474:5564]
2025-09-30T14:52:13.078598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895159848586474:5564]
2025-09-30T14:52:13.078651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:13.078655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:13.078668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:13.078669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.078672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:13.078672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:13.078831Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:13.083761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 731 sessionId: src_id|8f52e91f-800f2466-45fcb796-569aa7c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:13.086711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:13.144771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895159938315360:6573]
2025-09-30T14:52:13.145079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 730, pipe: [1:7555895159938315360:6573]
2025-09-30T14:52:13.188450Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:13.189097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:13.189109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:13.189143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895159938315360:6573], now have 1 active actors on pipe
2025-09-30T14:52:13.189352Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:13.189429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895159938315360:6573]
2025-09-30T14:52:13.189435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:13.189464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:13.189523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 731 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8f52e91f-800f2466-45fcb796-569aa7c0_0
2025-09-30T14:52:13.189689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 731 sessionId: src_id|8f52e91f-800f2466-45fcb796-569aa7c0_0 is DEAD
2025-09-30T14:52:13.189849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f52e91f-800f2466-45fcb796-569aa7c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:13.189859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f52e91f-800f2466-45fcb796-569aa7c0_0] Write session will restart in 0.006688s
2025-09-30T14:52:13.189881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f52e91f-800f2466-45fcb796-569aa7c0_0] Write session: Do CDS request
2025-09-30T14:52:13.189886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f52e91f-800f2466-45fcb796-569aa7c0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:13.197768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f52e91f-800f2466-45fcb796-569aa7c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:13.197858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:13.197874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 732
2025-09-30T14:52:13.198021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 732 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:13.198061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 732 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:13.198070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=732 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:13.198074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:13.198510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 732 sessionId:  describe result for acl check
2025-09-30T14:52:13.198543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:13.198545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:13.198547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:13.198554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895159938315381:6749] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:13.199088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895159938315381:6749] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:13.199692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:13.201100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895159938315381:6749] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:13.202924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:13.203109Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:13.203118Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:13.203129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:13.203180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:13.203218Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895159848586543:5567]
2025-09-30T14:52:13.203292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895159938315381:6749] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:13.203309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895159938315381:6749] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:13.203312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895159938315381:6749] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:13.203321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 732 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:13.203877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:13.204147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:13.204181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:13.204415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:13.204459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:13.204464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:13.204465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:13.204466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:13.204466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:13.204467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:13.204468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:13.204469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:13.204469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:13.204472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:13.204472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.204473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.204473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.204474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:13.204475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:13.204478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:13.204484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:13.204487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:13.204489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:13.204491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:13.204494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:13.204496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:13.204499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:13.204501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:13.204503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:13.204505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.204508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.204510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.204512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:13.204515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:13.204519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:13.204525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:13.204529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:13.204532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:13.204535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:13.204538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:13.204541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:13.204544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:13.204546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:13.204549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:13.204552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:13.204555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:13.204558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:13.204561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:13.204564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:13.204567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:13.204569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:13.204573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:13.204575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:13.204578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:13.204581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.204583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.204585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.204588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.204604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.204614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.204618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:13.204625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:13.204629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:13.204636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:13.204676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:13.210455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:13.211400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:13.211420Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:13.211423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:13.211427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:13.211436Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 731 [2:7555895159848586543:5567]
2025-09-30T14:52:13.211454Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:13.211472Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:13.211475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:13.211479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:13.211481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:13.211503Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:13.211516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:13.211523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:13.211594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.211601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.211604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.211607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:13.211610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:13.211682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:13.211691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.211704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.211719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.211737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:13.211760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895159938315419:6749], now have 1 active actors on pipe
2025-09-30T14:52:13.211776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895159848586537:5567]
2025-09-30T14:52:13.211779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895159848586537:5567]
2025-09-30T14:52:13.211781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895159848586537:5567]
2025-09-30T14:52:13.211793Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:13.211802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895159938315361:2454], now have 1 active actors on pipe
2025-09-30T14:52:13.211809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:13.211811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:13.211813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:13.211816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:13.211827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:13.211831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:13.211868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895159848586537:5567]
2025-09-30T14:52:13.211882Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:13.211903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:13.211876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 731
2025-09-30T14:52:13.211881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 731
2025-09-30T14:52:13.211977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:13.211987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:13.212015Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6630219b-d8bb4942-cb8f0abb-44e3bfa1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:13.212027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:13.212031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:13.212035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:13.212046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:13.212060Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:13.212079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:13.212354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:13.212368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:13.212403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:13.212515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 732 partition: 0 MaxSeqNo: 42 sessionId: src_id|6630219b-d8bb4942-cb8f0abb-44e3bfa1_0
2025-09-30T14:52:13.213024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f52e91f-800f2466-45fcb796-569aa7c0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6630219b-d8bb4942-cb8f0abb-44e3bfa1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:13.215935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6630219b-d8bb4942-cb8f0abb-44e3bfa1_0] Write session: try to update token
2025-09-30T14:52:13.215954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6630219b-d8bb4942-cb8f0abb-44e3bfa1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:13.224448Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:13.224472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:13.224474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:13.224476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:13.224485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895159848586537:5567]
2025-09-30T14:52:13.224489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895159848586537:5567]
2025-09-30T14:52:13.224493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895159848586537:5567]
2025-09-30T14:52:13.224534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:13.224540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.224540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:13.224547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:13.224548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:13.224550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:13.224685Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:13.230967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 732 sessionId: src_id|6630219b-d8bb4942-cb8f0abb-44e3bfa1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:13.233564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:13.289678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895159938315430:6573]
2025-09-30T14:52:13.289964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 731, pipe: [1:7555895159938315430:6573]
2025-09-30T14:52:13.331855Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:13.332134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:13.332147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:13.332187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895159938315430:6573], now have 1 active actors on pipe
2025-09-30T14:52:13.332393Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:13.332457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895159938315430:6573]
2025-09-30T14:52:13.332488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:13.332549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 732 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6630219b-d8bb4942-cb8f0abb-44e3bfa1_0
2025-09-30T14:52:13.332642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:13.332690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 732 sessionId: src_id|6630219b-d8bb4942-cb8f0abb-44e3bfa1_0 is DEAD
2025-09-30T14:52:13.332846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6630219b-d8bb4942-cb8f0abb-44e3bfa1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:13.332858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6630219b-d8bb4942-cb8f0abb-44e3bfa1_0] Write session will restart in 0.009419s
2025-09-30T14:52:13.332881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6630219b-d8bb4942-cb8f0abb-44e3bfa1_0] Write session: Do CDS request
2025-09-30T14:52:13.332887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6630219b-d8bb4942-cb8f0abb-44e3bfa1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:13.341543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:13.343689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6630219b-d8bb4942-cb8f0abb-44e3bfa1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:13.343812Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:13.343830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 733
2025-09-30T14:52:13.343978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 733 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:13.344012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 733 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:13.344021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=733 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:13.344026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:13.344424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 733 sessionId:  describe result for acl check
2025-09-30T14:52:13.344460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:13.344467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:13.344469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:13.344474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895159938315456:6753] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:13.344665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:13.344828Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:13.344837Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:13.344845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:13.344892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:13.344926Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895159848586605:5569]
2025-09-30T14:52:13.344940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895159938315456:6753] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:13.345449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:13.345827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:13.345873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:13.346212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:13.346277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:13.346284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:13.346285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:13.346285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:13.346286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:13.346286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:13.346287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:13.346288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:13.346288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:13.346289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:13.346289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.346290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.346291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.346291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:13.346292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:13.346296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:13.346301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:13.346304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:13.346306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:13.346308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:13.346311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:13.346313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:13.346317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:13.346321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:13.346327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:13.346331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.346334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.346338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.346351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:13.346356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:13.346363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:13.346369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:13.346374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:13.346377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:13.346379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:13.346382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:13.346385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:13.346388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:13.346391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:13.346394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:13.346396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:13.346398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:13.346401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:13.346403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:13.346405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:13.346408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:13.346411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:13.346413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:13.346416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:13.346419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:13.346421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.346424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.346426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.346429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.346431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.346434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.346436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:13.346439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:13.346441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:13.346444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:13.346469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:13.346666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895159938315456:6753] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:13.351649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895159938315456:6753] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:13.351676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895159938315456:6753] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:13.351681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895159938315456:6753] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:13.351694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 733 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:13.351962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:13.352986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:13.353007Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:13.353010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:13.353016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:13.353022Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 732 [2:7555895159848586605:5569]
2025-09-30T14:52:13.353038Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:13.353053Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:13.353061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:13.353064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:13.353066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:13.353083Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:13.353094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:13.353101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:13.353172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.353180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.353182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.353185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:13.353188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:13.353255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:13.353266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.353278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.353288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.353303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:13.353320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895159938315494:6753], now have 1 active actors on pipe
2025-09-30T14:52:13.353329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895159938315432:2454], now have 1 active actors on pipe
2025-09-30T14:52:13.353336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895159848586600:5569]
2025-09-30T14:52:13.353340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895159848586600:5569]
2025-09-30T14:52:13.353342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895159848586600:5569]
2025-09-30T14:52:13.353358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:13.353375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:13.353382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:13.353388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:13.353391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:13.353393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:13.353396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:13.353396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 732
2025-09-30T14:52:13.353403Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 732
2025-09-30T14:52:13.353431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895159848586600:5569]
2025-09-30T14:52:13.353439Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:13.353450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:13.353465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:13.353470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:13.353505Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e19f890-5b7835fd-422cc4ae-90a17aef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:13.353517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:13.353526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:13.353529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:13.353538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:13.353552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:13.353579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:13.353751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:13.353759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:13.353773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:13.353859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 733 partition: 0 MaxSeqNo: 42 sessionId: src_id|3e19f890-5b7835fd-422cc4ae-90a17aef_0
2025-09-30T14:52:13.354212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6630219b-d8bb4942-cb8f0abb-44e3bfa1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3e19f890-5b7835fd-422cc4ae-90a17aef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:13.356988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e19f890-5b7835fd-422cc4ae-90a17aef_0] Write session: try to update token
2025-09-30T14:52:13.357006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e19f890-5b7835fd-422cc4ae-90a17aef_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:13.365453Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:13.365476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:13.365479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:13.365481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:13.365490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895159848586600:5569]
2025-09-30T14:52:13.365494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895159848586600:5569]
2025-09-30T14:52:13.365497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895159848586600:5569]
2025-09-30T14:52:13.365531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:13.365537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.365539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:13.365541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:13.365551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:13.365556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:13.365666Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:13.371016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 733 sessionId: src_id|3e19f890-5b7835fd-422cc4ae-90a17aef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:13.373612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:13.432533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895159938315501:6573]
2025-09-30T14:52:13.432847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 732, pipe: [1:7555895159938315501:6573]
2025-09-30T14:52:13.479359Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:13.479595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:13.479607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:13.479636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895159938315501:6573], now have 1 active actors on pipe
2025-09-30T14:52:13.479815Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:13.479910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:13.479925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:13.479937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895159938315501:6573]
2025-09-30T14:52:13.479952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:13.479987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 733 reason: error at write: Disconnected sessionId: src_id|3e19f890-5b7835fd-422cc4ae-90a17aef_0
2025-09-30T14:52:13.480135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 733 sessionId: src_id|3e19f890-5b7835fd-422cc4ae-90a17aef_0 is DEAD
2025-09-30T14:52:13.480235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e19f890-5b7835fd-422cc4ae-90a17aef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:13.480244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e19f890-5b7835fd-422cc4ae-90a17aef_0] Write session will restart in 0.006860s
2025-09-30T14:52:13.480261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e19f890-5b7835fd-422cc4ae-90a17aef_0] Write session: Do CDS request
2025-09-30T14:52:13.480267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e19f890-5b7835fd-422cc4ae-90a17aef_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:13.488741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e19f890-5b7835fd-422cc4ae-90a17aef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:13.488859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:13.488878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 734
2025-09-30T14:52:13.488994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 734 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:13.488978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:13.489029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 734 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:13.489039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=734 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:13.489044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:13.489481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 734 sessionId:  describe result for acl check
2025-09-30T14:52:13.489517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:13.489519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:13.489521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:13.489527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895159938315530:6758] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:13.489551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:13.489728Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:13.489739Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:13.489751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:13.489808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:13.489849Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895159848586667:5571]
2025-09-30T14:52:13.490075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895159938315530:6758] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:13.490513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:13.492125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895159938315530:6758] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:13.492425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:13.492480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:13.492815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:13.492873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:13.492879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:13.492880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:13.492881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:13.492883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:13.492884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:13.492885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:13.492887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:13.492888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:13.492889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:13.492890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.492892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.492893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.492894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:13.492895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:13.492901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:13.492911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:13.492916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:13.492920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:13.492927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:13.492931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:13.492935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:13.492940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:13.492944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:13.492949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:13.492952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.492956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.492960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.492965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:13.492970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:13.492977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:13.492985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:13.492992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:13.492998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:13.493002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:13.493008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:13.493016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:13.493021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:13.493026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:13.493039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:13.493044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:13.493049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:13.493054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:13.493063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:13.493068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:13.493073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:13.493082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:13.493088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:13.493096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:13.493102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:13.493107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.493116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.493120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.493126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.493134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.493139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.493148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:13.493153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:13.493158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:13.493167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:13.493211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:13.498401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895159938315530:6758] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:13.498420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895159938315530:6758] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:13.498424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895159938315530:6758] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:13.498434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 734 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:13.498635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:13.499888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:13.499909Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:13.499912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:13.499915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:13.499921Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 733 [2:7555895159848586667:5571]
2025-09-30T14:52:13.499937Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:13.499952Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:13.499955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:13.499958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:13.499960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:13.499978Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:13.499993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:13.500005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:13.500066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.500074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.500075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.500078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:13.500080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:13.500143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:13.500150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.500163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.500174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.500194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:13.500216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895159938315569:6758], now have 1 active actors on pipe
2025-09-30T14:52:13.500224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895159938315505:2454], now have 1 active actors on pipe
2025-09-30T14:52:13.500230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895159848586662:5571]
2025-09-30T14:52:13.500232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895159848586662:5571]
2025-09-30T14:52:13.500233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895159848586662:5571]
2025-09-30T14:52:13.500247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:13.500266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:13.500277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:13.500281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:13.500283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:13.500284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:13.500288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:13.500310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 733
2025-09-30T14:52:13.500338Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 733
2025-09-30T14:52:13.500318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895159848586662:5571]
2025-09-30T14:52:13.500329Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:13.500352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:13.500365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:13.500370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:13.500400Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3f22c8b-d3f01092-495d6dfa-3228c9ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:13.500412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:13.500416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:13.500418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:13.500427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:13.500442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:13.500457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:13.500639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:13.500651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:13.500671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:13.500805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 734 partition: 0 MaxSeqNo: 42 sessionId: src_id|d3f22c8b-d3f01092-495d6dfa-3228c9ec_0
2025-09-30T14:52:13.501150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e19f890-5b7835fd-422cc4ae-90a17aef_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d3f22c8b-d3f01092-495d6dfa-3228c9ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:13.503844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f22c8b-d3f01092-495d6dfa-3228c9ec_0] Write session: try to update token
2025-09-30T14:52:13.503859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f22c8b-d3f01092-495d6dfa-3228c9ec_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:13.512922Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:13.512947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:13.512958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895159848586662:5571]
2025-09-30T14:52:13.513003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:13.513004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:13.513195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:13.513358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:13.513525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:13.513670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:13.513872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:13.513911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:13.517782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 734 sessionId: src_id|d3f22c8b-d3f01092-495d6dfa-3228c9ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:13.520480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:13.520834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:13.520864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:13.520892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:13.521013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:13.523929Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:13.523945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:13.523947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:13.523950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:13.523959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895159848586662:5571]
2025-09-30T14:52:13.523966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895159848586662:5571]
2025-09-30T14:52:13.523970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895159848586662:5571]
2025-09-30T14:52:13.524009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:13.524021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.524024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:13.524024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:13.524031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:13.524036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:13.524161Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:13.579957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895159938315576:6573]
2025-09-30T14:52:13.580257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 733, pipe: [1:7555895159938315576:6573]
2025-09-30T14:52:13.632155Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:13.639483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:13.639509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:13.639690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:13.639758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:13.639823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:13.639896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:13.639940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:13.639948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:13.640015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:13.640080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:13.640147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:13.640235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:13.640282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:13.640289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:13.640359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:13.640419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:13.640483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:13.640547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:13.640589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:13.640595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:13.640662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:13.640731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:13.640798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:13.640861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:13.640905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:13.640911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:13.640983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:13.641045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:13.641116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:13.641182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:13.641226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:13.641237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:13.641306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:13.641368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:13.641432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:13.641497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:13.641543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:13.641551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:13.641620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:13.641685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:13.641751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:13.641817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:13.641862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:13.641872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:13.641939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:13.641999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:13.642062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:13.642129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:13.642176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:13.642184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:13.642249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:13.642311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:13.642383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:13.642453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:13.642497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:13.642506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:13.642570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:13.642637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:13.642702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:13.642769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:13.642818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:13.642821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:13.642888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895159938315576:6573], now have 1 active actors on pipe
2025-09-30T14:52:13.643138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:13.643154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:13.643181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 734 reason: error at write: Disconnected sessionId: src_id|d3f22c8b-d3f01092-495d6dfa-3228c9ec_0
2025-09-30T14:52:13.643197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:13.643295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895159938315576:6573]
2025-09-30T14:52:13.643381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 734 sessionId: src_id|d3f22c8b-d3f01092-495d6dfa-3228c9ec_0 is DEAD
2025-09-30T14:52:13.643518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f22c8b-d3f01092-495d6dfa-3228c9ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:13.643527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f22c8b-d3f01092-495d6dfa-3228c9ec_0] Write session will restart in 0.006916s
2025-09-30T14:52:13.643550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f22c8b-d3f01092-495d6dfa-3228c9ec_0] Write session: Do CDS request
2025-09-30T14:52:13.643555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f22c8b-d3f01092-495d6dfa-3228c9ec_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:13.644068Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:13.651694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f22c8b-d3f01092-495d6dfa-3228c9ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:13.651778Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:13.651793Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 735
2025-09-30T14:52:13.651938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 735 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:13.651970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 735 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:13.651979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=735 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:13.651983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:13.652416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 735 sessionId:  describe result for acl check
2025-09-30T14:52:13.652455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:13.652457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:13.652458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:13.652464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895159938315602:6762] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:13.653073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895159938315602:6762] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:13.653532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:13.655223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895159938315602:6762] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:13.656717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:13.656916Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:13.656932Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:13.656944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:13.657007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:13.657049Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895159848586734:5574]
2025-09-30T14:52:13.657672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:13.657994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:13.658047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:13.658365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:13.658428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895159938315602:6762] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:13.658440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895159938315602:6762] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:13.658443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895159938315602:6762] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:13.658451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 735 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:13.658447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:13.658458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:13.658459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:13.658460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:13.658461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:13.658462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:13.658463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:13.658464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:13.658465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:13.658467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:13.658468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.658469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.658470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.658471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:13.658472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:13.658477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:13.658487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:13.658491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:13.658495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:13.658499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:13.658502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:13.658506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:13.658509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:13.658513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:13.658517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:13.658520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.658524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.658528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.658532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:13.658535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:13.658542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:13.658549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:13.658557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:13.658563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:13.658567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:13.658572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:13.658577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:13.658582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:13.658587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:13.658592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:13.658596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:13.658601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:13.658606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:13.658612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:13.658616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:13.658621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:13.658626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:13.658631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:13.658635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:13.658640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:13.658645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.658651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.658657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.658662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.658667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.658672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.658676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:13.658681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:13.658685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:13.658690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:13.658745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:13.664098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:13.664981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:13.664996Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:13.665000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:13.665007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:13.665014Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 734 [2:7555895159848586734:5574]
2025-09-30T14:52:13.665030Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:13.665045Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:13.665053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:13.665056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:13.665058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:13.665073Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:13.665080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:13.665087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:13.665147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.665154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.665156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.665159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:13.665162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:13.665223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:13.665231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.665244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.665263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.665282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:13.665301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895159938315577:2454], now have 1 active actors on pipe
2025-09-30T14:52:13.665305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895159938315641:6762], now have 1 active actors on pipe
2025-09-30T14:52:13.665311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895159848586728:5574]
2025-09-30T14:52:13.665313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895159848586728:5574]
2025-09-30T14:52:13.665316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895159848586728:5574]
2025-09-30T14:52:13.665330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:13.665344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:13.665344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:13.665348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:13.665350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:13.665366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:13.665369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:13.665397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895159848586728:5574]
2025-09-30T14:52:13.665410Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:13.665417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:13.665416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 734
2025-09-30T14:52:13.665425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 734
2025-09-30T14:52:13.665563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:13.665573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:13.665596Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26034af6-66361dfb-a3754204-3fa5a995_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:13.665602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:13.665606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:13.665608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:13.665617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:13.665630Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:13.665646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:13.667299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:13.667317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:13.667351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:13.667473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 735 partition: 0 MaxSeqNo: 42 sessionId: src_id|26034af6-66361dfb-a3754204-3fa5a995_0
2025-09-30T14:52:13.667828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f22c8b-d3f01092-495d6dfa-3228c9ec_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|26034af6-66361dfb-a3754204-3fa5a995_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:13.670539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26034af6-66361dfb-a3754204-3fa5a995_0] Write session: try to update token
2025-09-30T14:52:13.670559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26034af6-66361dfb-a3754204-3fa5a995_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:13.677321Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:13.677343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:13.677345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:13.677348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:13.677357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895159848586728:5574]
2025-09-30T14:52:13.677361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895159848586728:5574]
2025-09-30T14:52:13.677365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895159848586728:5574]
2025-09-30T14:52:13.677403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:13.677407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:13.677413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:13.677415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.677418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:13.677418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:13.677554Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:13.684865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 735 sessionId: src_id|26034af6-66361dfb-a3754204-3fa5a995_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:13.687541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:13.743302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895159938315650:6573]
2025-09-30T14:52:13.743569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 734, pipe: [1:7555895159938315650:6573]
2025-09-30T14:52:13.785913Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:13.786485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:13.786500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:13.786515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895159938315650:6573], now have 1 active actors on pipe
2025-09-30T14:52:13.786711Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:13.786757Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:13.786772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:13.786818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895159938315650:6573]
2025-09-30T14:52:13.786837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 735 reason: status is not ok: tablet will be restarted right now sessionId: src_id|26034af6-66361dfb-a3754204-3fa5a995_0
2025-09-30T14:52:13.786999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 735 sessionId: src_id|26034af6-66361dfb-a3754204-3fa5a995_0 is DEAD
2025-09-30T14:52:13.787160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26034af6-66361dfb-a3754204-3fa5a995_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:13.787172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26034af6-66361dfb-a3754204-3fa5a995_0] Write session will restart in 0.006594s
2025-09-30T14:52:13.787195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26034af6-66361dfb-a3754204-3fa5a995_0] Write session: Do CDS request
2025-09-30T14:52:13.787201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26034af6-66361dfb-a3754204-3fa5a995_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:13.794745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26034af6-66361dfb-a3754204-3fa5a995_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:13.794835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:13.794853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 736
2025-09-30T14:52:13.794957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 736 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:13.794988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 736 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:13.794997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=736 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:13.795006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:13.795551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 736 sessionId:  describe result for acl check
2025-09-30T14:52:13.795586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:13.795595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:13.795596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:13.795602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895159938315676:6766] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:13.796129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895159938315676:6766] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:13.796553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:13.797761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895159938315676:6766] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:13.799838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:13.800036Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:13.800046Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:13.800056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:13.800111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:13.800152Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895159848586799:5576]
2025-09-30T14:52:13.800166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895159938315676:6766] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:13.800178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895159938315676:6766] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:13.800182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895159938315676:6766] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:13.800188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 736 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:13.800702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:13.801006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:13.801066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:13.801406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:13.801492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:13.801498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:13.801499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:13.801500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:13.801501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:13.801502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:13.801503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:13.801504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:13.801506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:13.801507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:13.801508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.801509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.801510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.801511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:13.801512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:13.801518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:13.801526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:13.801531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:13.801537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:13.801541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:13.801545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:13.801549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:13.801553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:13.801556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:13.801561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:13.801565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.801569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.801573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.801577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:13.801581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:13.801588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:13.801596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:13.801603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:13.801619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:13.801629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:13.801634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:13.801639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:13.801643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:13.801648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:13.801654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:13.801658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:13.801663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:13.801668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:13.801678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:13.801682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:13.801688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:13.801693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:13.801702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:13.801707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:13.801717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:13.801722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.801731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.801740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.801745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.801756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.801765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.801773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:13.801778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:13.801796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:13.801807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:13.801854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:13.807178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:13.808058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:13.808078Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:13.808081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:13.808085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:13.808092Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 735 [2:7555895159848586799:5576]
2025-09-30T14:52:13.808109Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:13.808124Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:13.808128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:13.808131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:13.808134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:13.808150Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:13.808161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:13.808169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:13.808233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.808240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.808243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.808246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:13.808249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:13.808329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:13.808338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.808349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.808359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.808381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:13.808404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895159938315651:2454], now have 1 active actors on pipe
2025-09-30T14:52:13.808414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895159938315713:6766], now have 1 active actors on pipe
2025-09-30T14:52:13.808421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895159848586793:5576]
2025-09-30T14:52:13.808423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895159848586793:5576]
2025-09-30T14:52:13.808425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895159848586793:5576]
2025-09-30T14:52:13.808437Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:13.808450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:13.808463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:13.808466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:13.808485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:13.808488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:13.808491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:13.808497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895159848586793:5576]
2025-09-30T14:52:13.808465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 735
2025-09-30T14:52:13.808500Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:13.808512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:13.808532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:13.808544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:13.808558Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 735
2025-09-30T14:52:13.808571Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18400021-ca8a8175-94f2bc44-b587c838_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:13.808582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:13.808586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:13.808589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:13.808599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:13.808609Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:13.808630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:13.808751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:13.808762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:13.808774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:13.808828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 736 partition: 0 MaxSeqNo: 42 sessionId: src_id|18400021-ca8a8175-94f2bc44-b587c838_0
2025-09-30T14:52:13.809153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26034af6-66361dfb-a3754204-3fa5a995_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|18400021-ca8a8175-94f2bc44-b587c838_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:13.811850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18400021-ca8a8175-94f2bc44-b587c838_0] Write session: try to update token
2025-09-30T14:52:13.811869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18400021-ca8a8175-94f2bc44-b587c838_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:13.820217Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:13.820240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:13.820243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:13.820245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:13.820254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895159848586793:5576]
2025-09-30T14:52:13.820258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895159848586793:5576]
2025-09-30T14:52:13.820262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895159848586793:5576]
2025-09-30T14:52:13.820303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:13.820311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:13.820314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.820317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:13.820318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:13.820323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:13.820466Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:13.826322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 736 sessionId: src_id|18400021-ca8a8175-94f2bc44-b587c838_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:13.829009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:13.887178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895159938315725:6573]
2025-09-30T14:52:13.887477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 735, pipe: [1:7555895159938315725:6573]
2025-09-30T14:52:13.928477Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:13.928727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:13.928740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:13.928772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895159938315725:6573], now have 1 active actors on pipe
2025-09-30T14:52:13.928940Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:13.928960Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:13.928987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:13.928991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:13.929017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895159938315725:6573]
2025-09-30T14:52:13.929054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 736 reason: error at write: Disconnected sessionId: src_id|18400021-ca8a8175-94f2bc44-b587c838_0
2025-09-30T14:52:13.929206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 736 sessionId: src_id|18400021-ca8a8175-94f2bc44-b587c838_0 is DEAD
2025-09-30T14:52:13.929342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18400021-ca8a8175-94f2bc44-b587c838_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:13.929354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18400021-ca8a8175-94f2bc44-b587c838_0] Write session will restart in 0.008650s
2025-09-30T14:52:13.929377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18400021-ca8a8175-94f2bc44-b587c838_0] Write session: Do CDS request
2025-09-30T14:52:13.929383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18400021-ca8a8175-94f2bc44-b587c838_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:13.937822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:13.938750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18400021-ca8a8175-94f2bc44-b587c838_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:13.938851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:13.938867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 737
2025-09-30T14:52:13.938986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 737 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:13.939016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 737 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:13.939036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=737 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:13.939040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:13.939393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 737 sessionId:  describe result for acl check
2025-09-30T14:52:13.939426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:13.939430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:13.939432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:13.939436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895159938315754:6770] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:13.939861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895159938315754:6770] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:13.940702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:13.940859Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:13.940867Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:13.940874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:13.940912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:13.940944Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895159848586876:5578]
2025-09-30T14:52:13.941416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:13.941552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895159938315754:6770] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:13.941682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:13.941742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:13.942084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:13.942152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:13.942158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:13.942159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:13.942160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:13.942162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:13.942163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:13.942164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:13.942165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:13.942166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:13.942167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:13.942168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.942169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.942171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.942172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:13.942173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:13.942178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:13.942188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:13.942193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:13.942197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:13.942201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:13.942205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:13.942209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:13.942213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:13.942217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:13.942231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:13.942236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.942240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.942244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.942248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:13.942252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:13.942258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:13.942266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:13.942272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:13.942282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:13.942287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:13.942292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:13.942298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:13.942307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:13.942316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:13.942322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:13.942330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:13.942335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:13.942353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:13.942359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:13.942365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:13.942370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:13.942380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:13.942389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:13.942394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:13.942399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:13.942403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.942413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.942419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.942426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.942436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.942442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.942451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:13.942460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:13.942469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:13.942474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:13.942518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:13.947282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895159938315754:6770] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:13.947295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895159938315754:6770] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:13.947298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895159938315754:6770] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:13.947305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 737 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:13.947603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:13.948378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:13.948394Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:13.948396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:13.948399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:13.948404Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 736 [2:7555895159848586876:5578]
2025-09-30T14:52:13.948414Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:13.948424Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:13.948426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:13.948440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:13.948447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:13.948461Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:13.948472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:13.948482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:13.948530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.948538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.948540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.948544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:13.948549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:13.948600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:13.948605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.948613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:13.948619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:13.948633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:13.948645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895159848586871:5578]
2025-09-30T14:52:13.948646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895159848586871:5578]
2025-09-30T14:52:13.948648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895159848586871:5578]
2025-09-30T14:52:13.948653Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:13.948662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895159938315726:2454], now have 1 active actors on pipe
2025-09-30T14:52:13.948664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:13.948667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:13.948668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:13.948669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:13.948677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:13.948679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:13.948683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895159938315793:6770], now have 1 active actors on pipe
2025-09-30T14:52:13.948704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895159848586871:5578]
2025-09-30T14:52:13.948710Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:13.948719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:13.948735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 736
2025-09-30T14:52:13.948742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 736
2025-09-30T14:52:13.948798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:13.948806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:13.948824Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23ef537a-b8e897c4-e715dae4-4442a402_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:13.948832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:13.948835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:13.948836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:13.948843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:13.948853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:13.948862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:13.948998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:13.949003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:13.949012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:13.949100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 737 partition: 0 MaxSeqNo: 42 sessionId: src_id|23ef537a-b8e897c4-e715dae4-4442a402_0
2025-09-30T14:52:13.949431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18400021-ca8a8175-94f2bc44-b587c838_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|23ef537a-b8e897c4-e715dae4-4442a402_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:13.952196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23ef537a-b8e897c4-e715dae4-4442a402_0] Write session: try to update token
2025-09-30T14:52:13.952217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23ef537a-b8e897c4-e715dae4-4442a402_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:13.960200Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:13.960214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:13.960221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895159848586871:5578]
2025-09-30T14:52:13.960262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:13.960275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:13.960418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:13.960555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:13.960679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:13.960812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:13.961016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:13.961070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:13.965983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 737 sessionId: src_id|23ef537a-b8e897c4-e715dae4-4442a402_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:13.968705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:13.969154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:13.969171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:13.969199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:13.969290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:13.973379Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:13.973400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:13.973403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:13.973405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:13.973416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895159848586871:5578]
2025-09-30T14:52:13.973420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895159848586871:5578]
2025-09-30T14:52:13.973426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895159848586871:5578]
2025-09-30T14:52:13.973472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:13.973481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:13.973488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:13.973489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:13.973492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:13.973500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:13.973685Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:14.028995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895164233283120:6573]
2025-09-30T14:52:14.029236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 736, pipe: [1:7555895164233283120:6573]
2025-09-30T14:52:14.078774Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:14.086119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:14.086142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:14.086290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:14.086359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:14.086420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:14.086482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:14.086527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:14.086535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:14.086598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:14.086660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:14.086727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:14.086845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:14.086898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:14.086905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:14.086968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:14.087035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:14.087099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:14.087159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:14.087201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:14.087210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:14.087298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:14.087359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:14.087419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:14.087505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:14.087546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:14.087551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:14.087611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:14.087666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:14.087730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:14.087794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:14.087840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:14.087848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:14.087911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:14.087974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:14.088043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:14.088154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:14.088207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:14.088216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:14.088295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:14.088356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:14.088427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:14.088492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:14.088539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:14.088545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:14.088610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:14.088666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:14.088728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:14.088787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:14.088829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:14.088834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:14.088898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:14.088960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:14.089020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:14.089082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:14.089123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:14.089129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:14.089188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:14.089244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:14.089303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:14.089360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:14.089403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:14.089409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:14.089464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895164233283120:6573], now have 1 active actors on pipe
2025-09-30T14:52:14.089703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895164233283120:6573]
2025-09-30T14:52:14.089720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:14.089723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:14.089748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:14.089769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 737 reason: error at write: Disconnected sessionId: src_id|23ef537a-b8e897c4-e715dae4-4442a402_0
2025-09-30T14:52:14.089945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 737 sessionId: src_id|23ef537a-b8e897c4-e715dae4-4442a402_0 is DEAD
2025-09-30T14:52:14.090117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23ef537a-b8e897c4-e715dae4-4442a402_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:14.090125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23ef537a-b8e897c4-e715dae4-4442a402_0] Write session will restart in 0.005824s
2025-09-30T14:52:14.090147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23ef537a-b8e897c4-e715dae4-4442a402_0] Write session: Do CDS request
2025-09-30T14:52:14.090151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23ef537a-b8e897c4-e715dae4-4442a402_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:14.090419Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:14.096701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23ef537a-b8e897c4-e715dae4-4442a402_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:14.096804Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:14.096819Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 738
2025-09-30T14:52:14.096928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 738 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:14.096953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 738 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:14.096960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=738 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:14.096963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:14.097399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 738 sessionId:  describe result for acl check
2025-09-30T14:52:14.097443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:14.097450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:14.097452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:14.097457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895164233283171:6784] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:14.097989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895164233283171:6784] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:14.098413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:14.100131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895164233283171:6784] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:14.101930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:14.102102Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:14.102109Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:14.102116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:14.102153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:14.102185Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895164143554279:5594]
2025-09-30T14:52:14.102746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:14.102904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895164233283171:6784] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:14.102918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895164233283171:6784] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:14.102922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895164233283171:6784] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:14.102930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 738 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:14.103090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:14.103134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:14.103421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:14.103468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:14.103472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:14.103473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:14.103474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:14.103475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:14.103475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:14.103478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:14.103478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:14.103479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:14.103479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:14.103480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.103481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.103481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.103482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:14.103483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:14.103486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:14.103493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:14.103496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:14.103498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:14.103501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:14.103503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:14.103506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:14.103508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:14.103511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:14.103516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:14.103519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.103523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.103527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.103530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:14.103534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:14.103542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:14.103547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:14.103551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:14.103554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:14.103557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:14.103560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:14.103563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:14.103567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:14.103569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:14.103572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:14.103574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:14.103577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:14.103579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:14.103582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:14.103584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:14.103587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:14.103590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:14.103592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:14.103595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:14.103597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:14.103600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.103602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.103605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.103607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.103611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.103613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.103616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:14.103618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:14.103620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:14.103623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:14.103647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:14.109023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:14.110055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:14.110069Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:14.110072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:14.110077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:14.110084Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 737 [2:7555895164143554279:5594]
2025-09-30T14:52:14.110103Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:14.110126Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:14.110132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:14.110136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:14.110139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:14.110154Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:14.110168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:14.110175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:14.110245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.110255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.110257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.110261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:14.110264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:14.110367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:14.110376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.110390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.110408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.110432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:14.110458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895164233283145:2454], now have 1 active actors on pipe
2025-09-30T14:52:14.110468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895164233283208:6784], now have 1 active actors on pipe
2025-09-30T14:52:14.110479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895164143554273:5594]
2025-09-30T14:52:14.110486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895164143554273:5594]
2025-09-30T14:52:14.110490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895164143554273:5594]
2025-09-30T14:52:14.110505Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:14.110515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:14.110518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:14.110520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:14.110529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:14.110547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:14.110550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:14.110524Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 737
2025-09-30T14:52:14.110533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 737
2025-09-30T14:52:14.110618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:14.110626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:14.110654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895164143554273:5594]
2025-09-30T14:52:14.110670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:14.110673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:14.110705Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ae2a141-b3ed5b4f-79fdef14-8fbfccec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:14.110719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:14.110723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:14.110725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:14.110735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:14.110745Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:14.110771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:14.110911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:14.110919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:14.110933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:14.111021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 738 partition: 0 MaxSeqNo: 42 sessionId: src_id|5ae2a141-b3ed5b4f-79fdef14-8fbfccec_0
2025-09-30T14:52:14.111397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23ef537a-b8e897c4-e715dae4-4442a402_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5ae2a141-b3ed5b4f-79fdef14-8fbfccec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:14.114189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae2a141-b3ed5b4f-79fdef14-8fbfccec_0] Write session: try to update token
2025-09-30T14:52:14.114213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae2a141-b3ed5b4f-79fdef14-8fbfccec_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:14.123439Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:14.123464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:14.123469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:14.123471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:14.123500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895164143554273:5594]
2025-09-30T14:52:14.123507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895164143554273:5594]
2025-09-30T14:52:14.123516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895164143554273:5594]
2025-09-30T14:52:14.123568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:14.123568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:14.123575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:14.123579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:14.123589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.123593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:14.123835Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:14.129731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 738 sessionId: src_id|5ae2a141-b3ed5b4f-79fdef14-8fbfccec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:14.132598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:14.189769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895164233283218:6573]
2025-09-30T14:52:14.190097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 737, pipe: [1:7555895164233283218:6573]
2025-09-30T14:52:14.236828Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:14.237392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:14.237410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:14.237448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895164233283218:6573], now have 1 active actors on pipe
2025-09-30T14:52:14.237639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895164233283218:6573]
2025-09-30T14:52:14.237671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:14.237674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:14.237704Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:14.237734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 738 reason: error at write: Disconnected sessionId: src_id|5ae2a141-b3ed5b4f-79fdef14-8fbfccec_0
2025-09-30T14:52:14.237735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:14.237902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 738 sessionId: src_id|5ae2a141-b3ed5b4f-79fdef14-8fbfccec_0 is DEAD
2025-09-30T14:52:14.238063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae2a141-b3ed5b4f-79fdef14-8fbfccec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:14.238087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae2a141-b3ed5b4f-79fdef14-8fbfccec_0] Write session will restart in 0.009491s
2025-09-30T14:52:14.238110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae2a141-b3ed5b4f-79fdef14-8fbfccec_0] Write session: Do CDS request
2025-09-30T14:52:14.238116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae2a141-b3ed5b4f-79fdef14-8fbfccec_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:14.247126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:14.248786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae2a141-b3ed5b4f-79fdef14-8fbfccec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:14.248852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:14.248869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 739
2025-09-30T14:52:14.249025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 739 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:14.249064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 739 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:14.249074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=739 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:14.249079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:14.249581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 739 sessionId:  describe result for acl check
2025-09-30T14:52:14.249620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:14.249627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:14.249630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:14.249637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895164233283250:6788] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:14.250218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895164233283250:6788] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:14.250563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:14.250810Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:14.250821Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:14.250833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:14.250909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:14.250953Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895164143554348:5596]
2025-09-30T14:52:14.251611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:14.251864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:14.251910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:14.252028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895164233283250:6788] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:14.252186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:14.252255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:14.252256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:14.252257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:14.252258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:14.252260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:14.252261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:14.252262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:14.252263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:14.252264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:14.252265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:14.252267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.252268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.252269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.252270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:14.252271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:14.252276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:14.252287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:14.252295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:14.252298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:14.252302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:14.252306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:14.252309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:14.252313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:14.252317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:14.252323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:14.252327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.252330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.252334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.252338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:14.252343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:14.252351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:14.252359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:14.252365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:14.252372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:14.252378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:14.252382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:14.252385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:14.252389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:14.252394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:14.252399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:14.252404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:14.252410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:14.252414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:14.252420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:14.252425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:14.252430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:14.252436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:14.252440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:14.252445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:14.252452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:14.252457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.252463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.252467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.252473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.252478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.252484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.252489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:14.252495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:14.252502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:14.252509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:14.252555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:14.258170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895164233283250:6788] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:14.258192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895164233283250:6788] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:14.258196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895164233283250:6788] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:14.258206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 739 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:14.258604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:14.259997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:14.260016Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:14.260020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:14.260024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:14.260032Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 738 [2:7555895164143554348:5596]
2025-09-30T14:52:14.260050Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:14.260066Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:14.260070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:14.260073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:14.260078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:14.260097Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:14.260104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:14.260111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:14.260179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.260187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.260189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.260193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:14.260196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:14.260269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:14.260276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.260291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.260306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.260331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:14.260360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895164233283289:6788], now have 1 active actors on pipe
2025-09-30T14:52:14.260370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895164233283220:2454], now have 1 active actors on pipe
2025-09-30T14:52:14.260377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895164143554342:5596]
2025-09-30T14:52:14.260379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895164143554342:5596]
2025-09-30T14:52:14.260382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895164143554342:5596]
2025-09-30T14:52:14.260399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:14.260411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:14.260422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:14.260426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:14.260427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:14.260429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:14.260430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:14.260468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895164143554342:5596]
2025-09-30T14:52:14.260476Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:14.260463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 738
2025-09-30T14:52:14.260465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 738
2025-09-30T14:52:14.260507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:14.260523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:14.260529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:14.260560Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ec32036-b698c286-5ea79756-cc294990_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:14.260573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:14.260577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:14.260579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:14.260592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:14.260602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:14.260619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:14.260762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:14.260769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:14.260783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:14.260861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 739 partition: 0 MaxSeqNo: 42 sessionId: src_id|3ec32036-b698c286-5ea79756-cc294990_0
2025-09-30T14:52:14.261242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae2a141-b3ed5b4f-79fdef14-8fbfccec_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3ec32036-b698c286-5ea79756-cc294990_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:14.264031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ec32036-b698c286-5ea79756-cc294990_0] Write session: try to update token
2025-09-30T14:52:14.264052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ec32036-b698c286-5ea79756-cc294990_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:14.273132Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:14.273149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:14.273157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895164143554342:5596]
2025-09-30T14:52:14.273197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:14.273217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:14.273368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:14.273517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:14.273657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:14.273811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:14.274028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:14.274074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:14.280164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 739 sessionId: src_id|3ec32036-b698c286-5ea79756-cc294990_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:14.282975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:14.284407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:14.284435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:14.284459Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:14.284462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:14.284464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:14.284466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:14.284480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895164143554342:5596]
2025-09-30T14:52:14.284485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895164143554342:5596]
2025-09-30T14:52:14.284488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895164143554342:5596]
2025-09-30T14:52:14.284537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:14.284542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:14.284547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:14.284549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.284550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:14.284552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:14.284696Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:14.337740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895164233283297:6573]
2025-09-30T14:52:14.338017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 738, pipe: [1:7555895164233283297:6573]
2025-09-30T14:52:14.393955Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:14.394179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:14.394211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895164233283297:6573], now have 1 active actors on pipe
2025-09-30T14:52:14.394352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:14.394381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895164233283297:6573]
2025-09-30T14:52:14.394408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:14.394460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:14.394467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:14.394543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 739 reason: error at write: Disconnected sessionId: src_id|3ec32036-b698c286-5ea79756-cc294990_0
2025-09-30T14:52:14.394690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 739 sessionId: src_id|3ec32036-b698c286-5ea79756-cc294990_0 is DEAD
2025-09-30T14:52:14.394854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ec32036-b698c286-5ea79756-cc294990_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:14.394865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ec32036-b698c286-5ea79756-cc294990_0] Write session will restart in 0.005468s
2025-09-30T14:52:14.394888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ec32036-b698c286-5ea79756-cc294990_0] Write session: Do CDS request
2025-09-30T14:52:14.394892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ec32036-b698c286-5ea79756-cc294990_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:14.401735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ec32036-b698c286-5ea79756-cc294990_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:14.401908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:14.401923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 740
2025-09-30T14:52:14.402040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 740 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:14.402066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 740 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:14.402074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=740 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:14.402078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:14.402461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 740 sessionId:  describe result for acl check
2025-09-30T14:52:14.402495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:14.402500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:14.402501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:14.402506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895164233283323:6792] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:14.402959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895164233283323:6792] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:14.404332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:14.405125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895164233283323:6792] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:14.407509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:14.407715Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:14.407726Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:14.407736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:14.407752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895164233283323:6792] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:14.407767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895164233283323:6792] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:14.407771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895164233283323:6792] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:14.407780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 740 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:14.407787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:14.407829Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895164143554418:5598]
2025-09-30T14:52:14.408478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:14.408795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:14.408841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:14.409185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:14.409260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:14.409270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:14.409271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:14.409272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:14.409274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:14.409275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:14.409276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:14.409277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:14.409281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:14.409282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:14.409283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.409284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.409285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.409286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:14.409287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:14.409293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:14.409304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:14.409309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:14.409313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:14.409317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:14.409321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:14.409325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:14.409329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:14.409333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:14.409338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:14.409342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.409346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.409350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.409353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:14.409357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:14.409370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:14.409384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:14.409394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:14.409405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:14.409414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:14.409424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:14.409433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:14.409439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:14.409449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:14.409459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:14.409463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:14.409472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:14.409476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:14.409481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:14.409489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:14.409493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:14.409506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:14.409511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:14.409514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:14.409519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:14.409524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.409528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.409532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.409537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.409547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.409552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.409559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:14.409563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:14.409572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:14.409577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:14.409622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:14.415403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:14.416299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:14.416316Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:14.416319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:14.416324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:14.416331Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 739 [2:7555895164143554418:5598]
2025-09-30T14:52:14.416349Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:14.416369Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:14.416380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:14.416383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:14.416390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:14.416407Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:14.416415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:14.416422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:14.416487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.416496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.416498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.416502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:14.416505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:14.416573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:14.416581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.416597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.416610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.416635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:14.416659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895164233283364:6792], now have 1 active actors on pipe
2025-09-30T14:52:14.416669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895164233283298:2454], now have 1 active actors on pipe
2025-09-30T14:52:14.416675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895164143554411:5598]
2025-09-30T14:52:14.416678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895164143554411:5598]
2025-09-30T14:52:14.416680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895164143554411:5598]
2025-09-30T14:52:14.416692Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:14.416707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:14.416710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:14.416717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:14.416719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:14.416728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:14.416731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:14.416768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895164143554411:5598]
2025-09-30T14:52:14.416780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:14.416795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:14.416765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 739
2025-09-30T14:52:14.416780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 739
2025-09-30T14:52:14.416822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:14.416831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:14.416857Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1f916b7-54cac833-a90a90ae-12906cb9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:14.416869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:14.416873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:14.416880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:14.416889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:14.416902Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:14.416918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:14.417091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:14.417099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:14.417112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:14.417194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 740 partition: 0 MaxSeqNo: 42 sessionId: src_id|d1f916b7-54cac833-a90a90ae-12906cb9_0
2025-09-30T14:52:14.417567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ec32036-b698c286-5ea79756-cc294990_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d1f916b7-54cac833-a90a90ae-12906cb9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:14.420637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1f916b7-54cac833-a90a90ae-12906cb9_0] Write session: try to update token
2025-09-30T14:52:14.420663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1f916b7-54cac833-a90a90ae-12906cb9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:14.429454Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:14.429469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:14.429480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895164143554411:5598]
2025-09-30T14:52:14.429522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:14.429533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:14.429691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:14.429834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:14.429981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:14.430131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:14.430333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:14.430389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:14.435778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 740 sessionId: src_id|d1f916b7-54cac833-a90a90ae-12906cb9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:14.438498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:14.438752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:14.438777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:14.438817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:14.438895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:14.440439Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:14.440459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:14.440462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:14.440464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:14.440479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895164143554411:5598]
2025-09-30T14:52:14.440483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895164143554411:5598]
2025-09-30T14:52:14.440486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895164143554411:5598]
2025-09-30T14:52:14.440525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:14.440536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.440535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:14.440538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:14.440542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:14.440547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:14.440678Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:14.494422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895164233283378:6573]
2025-09-30T14:52:14.494747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 739, pipe: [1:7555895164233283378:6573]
2025-09-30T14:52:14.561417Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:14.568913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:14.568937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:14.569091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:14.569163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:14.569233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:14.569310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:14.569370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:14.569378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:14.569443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:14.569499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:14.569559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:14.569628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:14.569669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:14.569675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:14.569737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:14.569793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:14.569856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:14.569920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:14.569965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:14.569971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:14.570037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:14.570096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:14.570156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:14.570216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:14.570265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:14.570271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:14.570356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:14.570416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:14.570479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:14.570540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:14.570588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:14.570595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:14.570679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:14.570735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:14.570802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:14.570865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:14.570909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:14.570915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:14.570981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:14.571039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:14.571099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:14.571169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:14.571212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:14.571218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:14.571321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:14.571391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:14.571454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:14.571525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:14.571580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:14.571589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:14.571664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:14.571731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:14.571792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:14.571855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:14.571903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:14.571910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:14.571982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:14.572048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:14.572110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:14.572177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:14.572222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:14.572229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:14.572291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895164233283378:6573], now have 1 active actors on pipe
2025-09-30T14:52:14.572489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:14.572506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:14.572518Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:14.572545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 740 reason: error at write: Disconnected sessionId: src_id|d1f916b7-54cac833-a90a90ae-12906cb9_0
2025-09-30T14:52:14.572573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895164233283378:6573]
2025-09-30T14:52:14.572720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 740 sessionId: src_id|d1f916b7-54cac833-a90a90ae-12906cb9_0 is DEAD
2025-09-30T14:52:14.572853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1f916b7-54cac833-a90a90ae-12906cb9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:14.572864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1f916b7-54cac833-a90a90ae-12906cb9_0] Write session will restart in 0.005552s
2025-09-30T14:52:14.572887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1f916b7-54cac833-a90a90ae-12906cb9_0] Write session: Do CDS request
2025-09-30T14:52:14.572892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1f916b7-54cac833-a90a90ae-12906cb9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:14.573364Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:14.579738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1f916b7-54cac833-a90a90ae-12906cb9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:14.579810Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:14.579836Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 741
2025-09-30T14:52:14.579959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 741 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:14.579987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 741 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:14.579994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=741 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:14.579997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:14.580367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 741 sessionId:  describe result for acl check
2025-09-30T14:52:14.580395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:14.580396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:14.580398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:14.580402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895164233283393:6797] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:14.580844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895164233283393:6797] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:14.583163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895164233283393:6797] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:14.583577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:14.586762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:14.586956Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:14.586964Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:14.586973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:14.587025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:14.587057Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895164143554491:5601]
2025-09-30T14:52:14.587074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895164233283393:6797] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:14.587089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895164233283393:6797] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:14.587093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895164233283393:6797] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:14.587101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 741 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:14.587644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:14.587947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:14.587991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:14.588318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:14.588382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:14.588396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:14.588397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:14.588399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:14.588400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:14.588401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:14.588404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:14.588406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:14.588407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:14.588408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:14.588410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.588411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.588412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.588413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:14.588414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:14.588420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:14.588432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:14.588436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:14.588440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:14.588444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:14.588448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:14.588452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:14.588456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:14.588460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:14.588465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:14.588469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.588473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.588477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.588481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:14.588484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:14.588491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:14.588500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:14.588505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:14.588512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:14.588516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:14.588521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:14.588526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:14.588532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:14.588537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:14.588542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:14.588547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:14.588552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:14.588557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:14.588562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:14.588566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:14.588571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:14.588575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:14.588580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:14.588585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:14.588596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:14.588600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.588610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.588614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.588619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.588628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.588633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.588642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:14.588647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:14.588655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:14.588660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:14.588702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:14.594218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:14.595430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:14.595447Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:14.595450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:14.595455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:14.595462Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 740 [2:7555895164143554491:5601]
2025-09-30T14:52:14.595481Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:14.595498Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:14.595510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:14.595513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:14.595515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:14.595531Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:14.595538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:14.595545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:14.595613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.595623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.595626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.595630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:14.595632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:14.595697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:14.595704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.595716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.595726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.595740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:14.595754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895164233283447:6797], now have 1 active actors on pipe
2025-09-30T14:52:14.595763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895164143554485:5601]
2025-09-30T14:52:14.595764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895164143554485:5601]
2025-09-30T14:52:14.595766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895164143554485:5601]
2025-09-30T14:52:14.595778Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:14.595789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895164233283380:2454], now have 1 active actors on pipe
2025-09-30T14:52:14.595799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:14.595804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:14.595809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:14.595811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:14.595818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:14.595826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:14.595864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895164143554485:5601]
2025-09-30T14:52:14.595883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:14.595871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 740
2025-09-30T14:52:14.595879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 740
2025-09-30T14:52:14.595910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:14.595959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:14.595969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:14.595993Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8d98a85-c8ec9c67-331f4f19-db7a2f25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:14.596006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:14.596015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:14.596017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:14.596028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:14.596042Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:14.596067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:14.596232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:14.596242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:14.596256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:14.596361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 741 partition: 0 MaxSeqNo: 42 sessionId: src_id|e8d98a85-c8ec9c67-331f4f19-db7a2f25_0
2025-09-30T14:52:14.596712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1f916b7-54cac833-a90a90ae-12906cb9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e8d98a85-c8ec9c67-331f4f19-db7a2f25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:14.599599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d98a85-c8ec9c67-331f4f19-db7a2f25_0] Write session: try to update token
2025-09-30T14:52:14.599616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d98a85-c8ec9c67-331f4f19-db7a2f25_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:14.608179Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:14.608198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:14.608208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895164143554485:5601]
2025-09-30T14:52:14.608252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:14.608263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:14.608422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:14.608562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:14.608760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:14.608905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:14.609099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:14.609133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:14.613580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 741 sessionId: src_id|e8d98a85-c8ec9c67-331f4f19-db7a2f25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:14.616023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:14.616250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:14.616279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:14.616316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:14.616435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:14.618855Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:14.618870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:14.618873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:14.618876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:14.618889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895164143554485:5601]
2025-09-30T14:52:14.618893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895164143554485:5601]
2025-09-30T14:52:14.618898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895164143554485:5601]
2025-09-30T14:52:14.618937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:14.618950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.618952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:14.618961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:14.618967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:14.618972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:14.619087Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:14.672574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895164233283459:6573]
2025-09-30T14:52:14.672891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 740, pipe: [1:7555895164233283459:6573]
2025-09-30T14:52:14.725690Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:14.733250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:14.733277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:14.733449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:14.733526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:14.733600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:14.733671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:14.733719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:14.733728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:14.733799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:14.733865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:14.733928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:14.733994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:14.734102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:14.734109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:14.734172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:14.734228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:14.734287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:14.734365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:14.734410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:14.734418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:14.734487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:14.734545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:14.734601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:14.734662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:14.734705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:14.734711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:14.734772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:14.734829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:14.734887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:14.734946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:14.734991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:14.734999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:14.735065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:14.735125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:14.735187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:14.735276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:14.735318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:14.735324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:14.735387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:14.735443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:14.735511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:14.735574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:14.735617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:14.735623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:14.735683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:14.735746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:14.735807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:14.735879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:14.735926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:14.735932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:14.736003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:14.736066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:14.736127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:14.736187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:14.736230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:14.736235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:14.736302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:14.736370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:14.736431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:14.736490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:14.736532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:14.736538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:14.736600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895164233283459:6573], now have 1 active actors on pipe
2025-09-30T14:52:14.736895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:14.736905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895164233283459:6573]
2025-09-30T14:52:14.736921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:14.736927Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:14.736951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 741 reason: error at write: Disconnected sessionId: src_id|e8d98a85-c8ec9c67-331f4f19-db7a2f25_0
2025-09-30T14:52:14.737130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 741 sessionId: src_id|e8d98a85-c8ec9c67-331f4f19-db7a2f25_0 is DEAD
2025-09-30T14:52:14.737268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d98a85-c8ec9c67-331f4f19-db7a2f25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:14.737279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d98a85-c8ec9c67-331f4f19-db7a2f25_0] Write session will restart in 0.009630s
2025-09-30T14:52:14.737302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d98a85-c8ec9c67-331f4f19-db7a2f25_0] Write session: Do CDS request
2025-09-30T14:52:14.737307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d98a85-c8ec9c67-331f4f19-db7a2f25_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:14.737531Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:14.747049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:14.747679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d98a85-c8ec9c67-331f4f19-db7a2f25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:14.747817Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:14.747833Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 742
2025-09-30T14:52:14.747958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 742 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:14.747992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 742 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:14.748002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=742 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:14.748005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:14.748476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 742 sessionId:  describe result for acl check
2025-09-30T14:52:14.748525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:14.748533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:14.748535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:14.748541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895164233283493:6801] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:14.749101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895164233283493:6801] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:14.750425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:14.750618Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:14.750629Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:14.750639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:14.750679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:14.750709Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895164143554563:5603]
2025-09-30T14:52:14.751200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:14.751490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:14.751536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:14.751831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:14.751887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:14.751893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:14.751894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:14.751895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:14.751896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:14.751897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:14.751898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:14.751899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:14.751901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:14.751902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:14.751903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.751904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.751905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.751906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:14.751907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:14.751913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:14.751922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:14.751927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:14.751931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:14.751935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:14.751943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895164233283493:6801] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:14.751941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:14.751945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:14.751949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:14.751953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:14.751958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:14.751961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.751965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.751970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.751973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:14.751977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:14.751984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:14.751992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:14.751998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:14.752003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:14.752007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:14.752013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:14.752020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:14.752025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:14.752030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:14.752035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:14.752040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:14.752045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:14.752049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:14.752054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:14.752059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:14.752068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:14.752073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:14.752078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:14.752087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:14.752093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:14.752103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.752108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.752116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.752121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.752126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.752131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.752140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:14.752145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:14.752155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:14.752160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:14.752197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:14.757244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895164233283493:6801] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:14.757263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895164233283493:6801] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:14.757267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895164233283493:6801] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:14.757277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 742 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:14.757559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:14.758547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:14.758558Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:14.758560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:14.758563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:14.758568Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 741 [2:7555895164143554563:5603]
2025-09-30T14:52:14.758580Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:14.758594Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:14.758597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:14.758600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:14.758603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:14.758616Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:14.758622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:14.758627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:14.758669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.758675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.758679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.758682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:14.758683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:14.758731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:14.758736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.758748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.758763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.758784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:14.758806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895164233283533:6801], now have 1 active actors on pipe
2025-09-30T14:52:14.758814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895164233283460:2454], now have 1 active actors on pipe
2025-09-30T14:52:14.758820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895164143554557:5603]
2025-09-30T14:52:14.758823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895164143554557:5603]
2025-09-30T14:52:14.758825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895164143554557:5603]
2025-09-30T14:52:14.758837Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:14.758847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:14.758849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:14.758851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:14.758851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:14.758860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:14.758862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:14.758894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895164143554557:5603]
2025-09-30T14:52:14.758902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:14.758903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:14.758876Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 741
2025-09-30T14:52:14.758886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 741
2025-09-30T14:52:14.758926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:14.758933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:14.758959Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0d435d5-8cc416d6-7eeb8c69-e46515ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:14.758964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:14.758966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:14.758970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:14.758976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:14.758983Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:14.759002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:14.759153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:14.759178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:14.759206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:14.759342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 742 partition: 0 MaxSeqNo: 42 sessionId: src_id|e0d435d5-8cc416d6-7eeb8c69-e46515ae_0
2025-09-30T14:52:14.759655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d98a85-c8ec9c67-331f4f19-db7a2f25_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e0d435d5-8cc416d6-7eeb8c69-e46515ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:14.762274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0d435d5-8cc416d6-7eeb8c69-e46515ae_0] Write session: try to update token
2025-09-30T14:52:14.762291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0d435d5-8cc416d6-7eeb8c69-e46515ae_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:14.770979Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:14.770996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:14.770999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:14.771001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:14.771011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895164143554557:5603]
2025-09-30T14:52:14.771015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895164143554557:5603]
2025-09-30T14:52:14.771018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895164143554557:5603]
2025-09-30T14:52:14.771061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:14.771067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.771070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:14.771072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:14.771079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:14.771082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:14.771205Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:14.776345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 742 sessionId: src_id|e0d435d5-8cc416d6-7eeb8c69-e46515ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:14.778909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:14.836937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895164233283541:6573]
2025-09-30T14:52:14.837258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 741, pipe: [1:7555895164233283541:6573]
2025-09-30T14:52:14.879568Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:14.880158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:14.880176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:14.880215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895164233283541:6573], now have 1 active actors on pipe
2025-09-30T14:52:14.880434Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:14.880466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:14.880466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:14.880479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:14.880514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895164233283541:6573]
2025-09-30T14:52:14.880542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 742 reason: error at write: Disconnected sessionId: src_id|e0d435d5-8cc416d6-7eeb8c69-e46515ae_0
2025-09-30T14:52:14.880733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 742 sessionId: src_id|e0d435d5-8cc416d6-7eeb8c69-e46515ae_0 is DEAD
2025-09-30T14:52:14.880889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0d435d5-8cc416d6-7eeb8c69-e46515ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:14.880901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0d435d5-8cc416d6-7eeb8c69-e46515ae_0] Write session will restart in 0.008605s
2025-09-30T14:52:14.880924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0d435d5-8cc416d6-7eeb8c69-e46515ae_0] Write session: Do CDS request
2025-09-30T14:52:14.880930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0d435d5-8cc416d6-7eeb8c69-e46515ae_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:14.890788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0d435d5-8cc416d6-7eeb8c69-e46515ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:14.890861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:14.890883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:14.890900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 743
2025-09-30T14:52:14.891036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 743 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:14.891067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 743 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:14.891078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=743 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:14.891081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:14.891512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 743 sessionId:  describe result for acl check
2025-09-30T14:52:14.891546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:14.891553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:14.891555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:14.891561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895164233283576:6805] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:14.892090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895164233283576:6805] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:14.894042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:14.894064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895164233283576:6805] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:14.894243Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:14.894254Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:14.894265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:14.894322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:14.894370Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895164143554634:5605]
2025-09-30T14:52:14.894818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:14.895057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:14.895091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:14.895348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:14.895393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:14.895398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:14.895399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:14.895400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:14.895400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:14.895401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:14.895401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:14.895402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:14.895403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:14.895403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:14.895404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.895405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.895406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.895406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:14.895407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:14.895410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:14.895416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:14.895419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:14.895421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:14.895424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:14.895428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:14.895432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:14.895436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:14.895439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:14.895442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:14.895445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.895448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.895452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.895455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:14.895459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:14.895468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:14.895475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:14.895483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:14.895489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:14.895494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:14.895499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:14.895502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:14.895505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:14.895508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:14.895511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:14.895513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:14.895516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:14.895518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:14.895521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:14.895523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:14.895526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:14.895529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:14.895532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:14.895535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:14.895538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:14.895541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.895544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.895546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.895549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.895551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.895554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.895556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:14.895558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:14.895561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:14.895564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:14.895587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:14.896386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895164233283576:6805] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:14.896399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895164233283576:6805] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:14.896404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895164233283576:6805] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:14.896411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 743 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:14.901005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:14.901949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:14.901962Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:14.901965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:14.901970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:14.901976Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 742 [2:7555895164143554634:5605]
2025-09-30T14:52:14.901993Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:14.902007Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:14.902008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:14.902011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:14.902012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:14.902026Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:14.902031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:14.902039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:14.902084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.902093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.902095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.902097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:14.902099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:14.902157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:14.902163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.902176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:14.902186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:14.902200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:14.902213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895164233283615:6805], now have 1 active actors on pipe
2025-09-30T14:52:14.902220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895164233283542:2454], now have 1 active actors on pipe
2025-09-30T14:52:14.902225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895164143554628:5605]
2025-09-30T14:52:14.902228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895164143554628:5605]
2025-09-30T14:52:14.902229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895164143554628:5605]
2025-09-30T14:52:14.902239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:14.902252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:14.902267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:14.902274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:14.902274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:14.902278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:14.902280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:14.902303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 742
2025-09-30T14:52:14.902317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 742
2025-09-30T14:52:14.902308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895164143554628:5605]
2025-09-30T14:52:14.902317Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:14.902330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:14.902359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:14.902364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:14.902393Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90483f51-625db4bd-504b8cef-77452931_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:14.902400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:14.902404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:14.902406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:14.902415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:14.902425Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:14.902439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:14.902563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:14.902573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:14.902586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:14.902664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 743 partition: 0 MaxSeqNo: 42 sessionId: src_id|90483f51-625db4bd-504b8cef-77452931_0
2025-09-30T14:52:14.903019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0d435d5-8cc416d6-7eeb8c69-e46515ae_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|90483f51-625db4bd-504b8cef-77452931_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:14.905713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90483f51-625db4bd-504b8cef-77452931_0] Write session: try to update token
2025-09-30T14:52:14.905733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90483f51-625db4bd-504b8cef-77452931_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:14.919497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 743 sessionId: src_id|90483f51-625db4bd-504b8cef-77452931_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:14.919724Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:14.919741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:14.919749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895164143554628:5605]
2025-09-30T14:52:14.919788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:14.919802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:14.919981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:14.920143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:14.920288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:14.920435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:14.920636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:14.920679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:14.922172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:14.922403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:14.922431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:14.922464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:14.922556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:14.925469Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:14.925484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:14.925487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:14.925489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:14.925499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895164143554628:5605]
2025-09-30T14:52:14.925503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895164143554628:5605]
2025-09-30T14:52:14.925507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895164143554628:5605]
2025-09-30T14:52:14.925542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:14.925548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:14.925551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:14.925561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:14.925584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:14.925595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:14.925680Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:14.980783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895164233283635:6573]
2025-09-30T14:52:14.980980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 742, pipe: [1:7555895164233283635:6573]
2025-09-30T14:52:15.036191Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:15.044017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:15.044044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:15.044220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:15.044286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:15.044361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:15.044425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:15.044476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:15.044486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:15.044559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:15.044619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:15.044682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:15.044745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:15.044789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:15.044794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:15.044860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:15.044918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:15.044979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:15.045037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:15.045079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:15.045084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:15.045151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:15.045218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:15.045286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:15.045349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:15.045399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:15.045407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:15.045481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:15.045546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:15.045608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:15.045674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:15.045721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:15.045727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:15.045796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:15.045857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:15.045922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:15.045985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:15.046033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:15.046039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:15.046107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:15.046170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:15.046239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:15.046312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:15.046376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:15.046382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:15.046452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:15.046520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:15.046587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:15.046665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:15.046716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:15.046722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:15.046795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:15.046860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:15.046933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:15.047002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:15.047052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:15.047058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:15.047133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:15.047198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:15.047291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:15.047365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:15.047433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:15.047441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:15.047513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895164233283635:6573], now have 1 active actors on pipe
2025-09-30T14:52:15.047740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:15.047757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895164233283635:6573]
2025-09-30T14:52:15.047792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:15.047794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:15.047826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 743 reason: error at write: Disconnected sessionId: src_id|90483f51-625db4bd-504b8cef-77452931_0
2025-09-30T14:52:15.048089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 743 sessionId: src_id|90483f51-625db4bd-504b8cef-77452931_0 is DEAD
2025-09-30T14:52:15.048172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90483f51-625db4bd-504b8cef-77452931_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:15.048183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90483f51-625db4bd-504b8cef-77452931_0] Write session will restart in 0.008566s
2025-09-30T14:52:15.048208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90483f51-625db4bd-504b8cef-77452931_0] Write session: Do CDS request
2025-09-30T14:52:15.048215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90483f51-625db4bd-504b8cef-77452931_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:15.048846Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:15.057766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90483f51-625db4bd-504b8cef-77452931_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:15.057905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:15.057921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 744
2025-09-30T14:52:15.058067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 744 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:15.058107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 744 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:15.058118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=744 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:15.058124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:15.058549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 744 sessionId:  describe result for acl check
2025-09-30T14:52:15.058586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:15.058593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:15.058594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:15.058600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895168528250975:6812] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:15.059111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895168528250975:6812] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:15.061071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895168528250975:6812] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:15.061114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:15.061659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:15.061821Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:15.061829Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:15.061837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:15.061876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:15.061905Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895168438522016:5608]
2025-09-30T14:52:15.062404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:15.062712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:15.062757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:15.063066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:15.063142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:15.063149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:15.063151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:15.063152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:15.063153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:15.063154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:15.063155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:15.063156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:15.063157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:15.063158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:15.063159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.063160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.063161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.063162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:15.063163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:15.063168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:15.063178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:15.063182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:15.063186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:15.063189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:15.063193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:15.063197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:15.063200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:15.063206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:15.063210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:15.063213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.063216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.063219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.063222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:15.063226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:15.063234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:15.063261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:15.063267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:15.063272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:15.063276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:15.063280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:15.063284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:15.063289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:15.063293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:15.063297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:15.063300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:15.063305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:15.063309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:15.063314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:15.063318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:15.063323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:15.063327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:15.063342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:15.063351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:15.063355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:15.063364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.063374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.063382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.063386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.063393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.063398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.063406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:15.063411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:15.063416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:15.063425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:15.063469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:15.063892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895168528250975:6812] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:15.063907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895168528250975:6812] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:15.063910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895168528250975:6812] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:15.063917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 744 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:15.068812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:15.069647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:15.069661Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:15.069664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:15.069668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:15.069673Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 743 [2:7555895168438522016:5608]
2025-09-30T14:52:15.069685Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:15.069699Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:15.069701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:15.069703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:15.069704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:15.069716Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:15.069721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:15.069727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:15.069768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.069774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.069777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.069780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:15.069781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:15.070018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 743
2025-09-30T14:52:15.070020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 743
2025-09-30T14:52:15.070061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:15.070069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.070078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.070086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.070103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:15.070127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895168528251018:6812], now have 1 active actors on pipe
2025-09-30T14:52:15.070136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895168528250941:2454], now have 1 active actors on pipe
2025-09-30T14:52:15.070150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:15.070154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:15.070177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895168438522011:5608]
2025-09-30T14:52:15.070182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895168438522011:5608]
2025-09-30T14:52:15.070184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895168438522011:5608]
2025-09-30T14:52:15.070193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:15.070209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:15.070213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:15.070216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:15.070218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:15.070222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:15.070224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:15.070236Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a257566c-af5ac9b0-9f68cb12-f360e9a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:15.070249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:15.070252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:15.070259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:15.070268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:15.070276Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:15.070311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895168438522011:5608]
2025-09-30T14:52:15.070321Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:15.070330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:15.070332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:15.070505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:15.070513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:15.070528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:15.070647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 744 partition: 0 MaxSeqNo: 42 sessionId: src_id|a257566c-af5ac9b0-9f68cb12-f360e9a3_0
2025-09-30T14:52:15.071001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90483f51-625db4bd-504b8cef-77452931_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a257566c-af5ac9b0-9f68cb12-f360e9a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:15.073960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a257566c-af5ac9b0-9f68cb12-f360e9a3_0] Write session: try to update token
2025-09-30T14:52:15.073981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a257566c-af5ac9b0-9f68cb12-f360e9a3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:15.082507Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:15.082526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:15.082536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895168438522011:5608]
2025-09-30T14:52:15.082580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:15.082583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:15.082751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:15.082903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:15.083040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:15.083179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:15.083409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:15.083460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:15.089141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 744 sessionId: src_id|a257566c-af5ac9b0-9f68cb12-f360e9a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:15.091842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:15.092056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:15.092076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:15.092108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:15.092210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:15.094450Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:15.094464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:15.094467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:15.094469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:15.094477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895168438522011:5608]
2025-09-30T14:52:15.094481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895168438522011:5608]
2025-09-30T14:52:15.094484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895168438522011:5608]
2025-09-30T14:52:15.094519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:15.094527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:15.094530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.094532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:15.094533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:15.094549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:15.094665Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:15.147702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895168528251048:6573]
2025-09-30T14:52:15.147987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 743, pipe: [1:7555895168528251048:6573]
2025-09-30T14:52:15.205965Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:15.214565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:15.214590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:15.214773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:15.214843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:15.214913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:15.214977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:15.215021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:15.215034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:15.215107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:15.215174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:15.215257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:15.215340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:15.215388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:15.215398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:15.215469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:15.215529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:15.215595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:15.215664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:15.215712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:15.215720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:15.215795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:15.215862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:15.215928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:15.215993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:15.216041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:15.216048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:15.216122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:15.216193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:15.216265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:15.216330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:15.216375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:15.216382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:15.216453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:15.216520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:15.216584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:15.216651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:15.216698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:15.216706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:15.216775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:15.216842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:15.216916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:15.216981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:15.217027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:15.217040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:15.217124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:15.217186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:15.217249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:15.217322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:15.217369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:15.217376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:15.217451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:15.217511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:15.217583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:15.217648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:15.217695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:15.217702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:15.217774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:15.217841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:15.217905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:15.217977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:15.218022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:15.218031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:15.218102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895168528251048:6573], now have 1 active actors on pipe
2025-09-30T14:52:15.218413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:15.218434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:15.218439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:15.218469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 744 reason: error at write: Disconnected sessionId: src_id|a257566c-af5ac9b0-9f68cb12-f360e9a3_0
2025-09-30T14:52:15.218479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895168528251048:6573]
2025-09-30T14:52:15.218663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 744 sessionId: src_id|a257566c-af5ac9b0-9f68cb12-f360e9a3_0 is DEAD
2025-09-30T14:52:15.218824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a257566c-af5ac9b0-9f68cb12-f360e9a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:15.218836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a257566c-af5ac9b0-9f68cb12-f360e9a3_0] Write session will restart in 0.008197s
2025-09-30T14:52:15.218861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a257566c-af5ac9b0-9f68cb12-f360e9a3_0] Write session: Do CDS request
2025-09-30T14:52:15.218867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a257566c-af5ac9b0-9f68cb12-f360e9a3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:15.219393Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:15.227765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a257566c-af5ac9b0-9f68cb12-f360e9a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:15.227829Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:15.227844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 745
2025-09-30T14:52:15.228087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 745 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:15.228134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 745 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:15.228142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=745 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:15.228145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:15.228591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 745 sessionId:  describe result for acl check
2025-09-30T14:52:15.228624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:15.228629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:15.228630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:15.228636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895168528251084:6823] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:15.229142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895168528251084:6823] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:15.229726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:15.231074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895168528251084:6823] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:15.233343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:15.233510Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:15.233521Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:15.233532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:15.233579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:15.233614Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895168438522129:5623]
2025-09-30T14:52:15.234089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:15.234150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895168528251084:6823] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:15.234166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895168528251084:6823] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:15.234170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895168528251084:6823] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:15.234179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 745 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:15.234376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:15.234418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:15.234742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:15.234824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:15.234831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:15.234832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:15.234833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:15.234834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:15.234836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:15.234837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:15.234838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:15.234839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:15.234840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:15.234841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.234842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.234842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.234845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:15.234846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:15.234849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:15.234856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:15.234858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:15.234861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:15.234864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:15.234868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:15.234872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:15.234876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:15.234880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:15.234884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:15.234887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.234891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.234895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.234898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:15.234903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:15.234910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:15.234920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:15.234926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:15.234932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:15.234936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:15.234942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:15.234946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:15.234951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:15.234956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:15.234961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:15.234965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:15.234970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:15.234975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:15.234980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:15.234985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:15.234991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:15.234996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:15.235001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:15.235005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:15.235010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:15.235015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.235020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.235024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.235029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.235033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.235038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.235042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:15.235047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:15.235051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:15.235056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:15.235102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:15.240545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:15.241406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:15.241424Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:15.241427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:15.241432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:15.241439Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 744 [2:7555895168438522129:5623]
2025-09-30T14:52:15.241457Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:15.241474Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:15.241486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:15.241489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:15.241492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:15.241508Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:15.241516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:15.241527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:15.241584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.241593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.241595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.241599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:15.241602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:15.241673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:15.241682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.241696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.241711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.241735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:15.241758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895168528251049:2454], now have 1 active actors on pipe
2025-09-30T14:52:15.241767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895168528251123:6823], now have 1 active actors on pipe
2025-09-30T14:52:15.241774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895168438522123:5623]
2025-09-30T14:52:15.241781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895168438522123:5623]
2025-09-30T14:52:15.241784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895168438522123:5623]
2025-09-30T14:52:15.241797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:15.241810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:15.241814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:15.241819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:15.241822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:15.241832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:15.241835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:15.241843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 744
2025-09-30T14:52:15.241860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 744
2025-09-30T14:52:15.241868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895168438522123:5623]
2025-09-30T14:52:15.241879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:15.241883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:15.241918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:15.241928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:15.241960Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f09e12cb-c632a250-c60f99aa-bd60d62b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:15.241973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:15.241978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:15.241981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:15.241991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:15.242004Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:15.242023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:15.242187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:15.242197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:15.242211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:15.242331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 745 partition: 0 MaxSeqNo: 42 sessionId: src_id|f09e12cb-c632a250-c60f99aa-bd60d62b_0
2025-09-30T14:52:15.242707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a257566c-af5ac9b0-9f68cb12-f360e9a3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f09e12cb-c632a250-c60f99aa-bd60d62b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:15.245516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f09e12cb-c632a250-c60f99aa-bd60d62b_0] Write session: try to update token
2025-09-30T14:52:15.245539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f09e12cb-c632a250-c60f99aa-bd60d62b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:15.254183Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:15.254202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:15.254205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:15.254207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:15.254217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895168438522123:5623]
2025-09-30T14:52:15.254222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895168438522123:5623]
2025-09-30T14:52:15.254228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895168438522123:5623]
2025-09-30T14:52:15.254273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:15.254283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.254285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:15.254284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:15.254291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:15.254296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:15.254432Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:15.260776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 745 sessionId: src_id|f09e12cb-c632a250-c60f99aa-bd60d62b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:15.263558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:15.318726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895168528251133:6573]
2025-09-30T14:52:15.319020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 744, pipe: [1:7555895168528251133:6573]
2025-09-30T14:52:15.362144Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:15.362649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:15.362667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:15.362709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895168528251133:6573], now have 1 active actors on pipe
2025-09-30T14:52:15.362919Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:15.362971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895168528251133:6573]
2025-09-30T14:52:15.363002Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:15.363045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:15.363129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 745 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f09e12cb-c632a250-c60f99aa-bd60d62b_0
2025-09-30T14:52:15.363305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 745 sessionId: src_id|f09e12cb-c632a250-c60f99aa-bd60d62b_0 is DEAD
2025-09-30T14:52:15.363454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f09e12cb-c632a250-c60f99aa-bd60d62b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:15.363466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f09e12cb-c632a250-c60f99aa-bd60d62b_0] Write session will restart in 0.009717s
2025-09-30T14:52:15.363503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f09e12cb-c632a250-c60f99aa-bd60d62b_0] Write session: Do CDS request
2025-09-30T14:52:15.363509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f09e12cb-c632a250-c60f99aa-bd60d62b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:15.372864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:15.374750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f09e12cb-c632a250-c60f99aa-bd60d62b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:15.374817Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:15.374834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 746
2025-09-30T14:52:15.374951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 746 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:15.374985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 746 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:15.374995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=746 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:15.374999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:15.376169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 746 sessionId:  describe result for acl check
2025-09-30T14:52:15.376174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:15.376208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:15.376210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:15.376212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:15.376217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895168528251172:6827] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:15.376372Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:15.376387Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:15.376401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:15.376480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:15.376521Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895168438522205:5625]
2025-09-30T14:52:15.376821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895168528251172:6827] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:15.377178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:15.377450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:15.377491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:15.377753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:15.377805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:15.377810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:15.377811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:15.377812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:15.377812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:15.377813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:15.377814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:15.377814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:15.377815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:15.377816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:15.377816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.377817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.377818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.377818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:15.377819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:15.377822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:15.377828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:15.377831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:15.377834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:15.377838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:15.377840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:15.377842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:15.377845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:15.377847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:15.377850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:15.377852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.377854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.377856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.377858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:15.377860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:15.377865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:15.377870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:15.377875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:15.377879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:15.377881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:15.377885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:15.377889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:15.377892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:15.377894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:15.377898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:15.377900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:15.377903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:15.377905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:15.377909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:15.377911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:15.377914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:15.377916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:15.377919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:15.377921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:15.377924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:15.377928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.377931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.377934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.377936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.377939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.377942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.377944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:15.377947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:15.377949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:15.377952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:15.377978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:15.379115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895168528251172:6827] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:15.383085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895168528251172:6827] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:15.383103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895168528251172:6827] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:15.383107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895168528251172:6827] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:15.383115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 746 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:15.383486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:15.384401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:15.384416Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:15.384418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:15.384422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:15.384428Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 745 [2:7555895168438522205:5625]
2025-09-30T14:52:15.384443Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:15.384458Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:15.384461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:15.384464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:15.384467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:15.384485Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:15.384491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:15.384498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:15.384574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.384581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.384583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.384587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:15.384589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:15.384655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:15.384659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.384673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.384685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.384703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:15.384722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895168528251210:6827], now have 1 active actors on pipe
2025-09-30T14:52:15.384728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895168438522199:5625]
2025-09-30T14:52:15.384730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895168438522199:5625]
2025-09-30T14:52:15.384732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895168438522199:5625]
2025-09-30T14:52:15.384745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:15.384753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895168528251134:2454], now have 1 active actors on pipe
2025-09-30T14:52:15.384759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:15.384761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:15.384763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:15.384765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:15.384775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:15.384778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:15.384791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 745
2025-09-30T14:52:15.384816Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 745
2025-09-30T14:52:15.384812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895168438522199:5625]
2025-09-30T14:52:15.384821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:15.384824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:15.384845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:15.384850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:15.384885Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c442e226-4ac64f77-2e0c3eac-cdecc406_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:15.384897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:15.384901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:15.384903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:15.384913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:15.384925Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:15.384945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:15.385092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:15.385103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:15.385117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:15.385237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 746 partition: 0 MaxSeqNo: 42 sessionId: src_id|c442e226-4ac64f77-2e0c3eac-cdecc406_0
2025-09-30T14:52:15.385583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f09e12cb-c632a250-c60f99aa-bd60d62b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c442e226-4ac64f77-2e0c3eac-cdecc406_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:15.388288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c442e226-4ac64f77-2e0c3eac-cdecc406_0] Write session: try to update token
2025-09-30T14:52:15.388306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c442e226-4ac64f77-2e0c3eac-cdecc406_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:15.397344Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:15.397363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:15.397366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:15.397368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:15.397379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895168438522199:5625]
2025-09-30T14:52:15.397384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895168438522199:5625]
2025-09-30T14:52:15.397388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895168438522199:5625]
2025-09-30T14:52:15.397425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:15.397433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.397435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:15.397444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:15.397450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:15.397454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:15.397597Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:15.402672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 746 sessionId: src_id|c442e226-4ac64f77-2e0c3eac-cdecc406_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:15.405340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:15.463123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895168528251217:6573]
2025-09-30T14:52:15.463400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 745, pipe: [1:7555895168528251217:6573]
2025-09-30T14:52:15.511298Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:15.511916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:15.511933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:15.511975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895168528251217:6573], now have 1 active actors on pipe
2025-09-30T14:52:15.512194Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:15.512232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:15.512249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:15.512261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895168528251217:6573]
2025-09-30T14:52:15.512293Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:15.512703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c442e226-4ac64f77-2e0c3eac-cdecc406_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:15.512321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 746 reason: error at write: Disconnected sessionId: src_id|c442e226-4ac64f77-2e0c3eac-cdecc406_0
2025-09-30T14:52:15.512734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c442e226-4ac64f77-2e0c3eac-cdecc406_0] Write session will restart in 0.008343s
2025-09-30T14:52:15.512506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 746 sessionId: src_id|c442e226-4ac64f77-2e0c3eac-cdecc406_0 is DEAD
2025-09-30T14:52:15.512760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c442e226-4ac64f77-2e0c3eac-cdecc406_0] Write session: Do CDS request
2025-09-30T14:52:15.512765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c442e226-4ac64f77-2e0c3eac-cdecc406_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:15.522785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c442e226-4ac64f77-2e0c3eac-cdecc406_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:15.522855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:15.522870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 747
2025-09-30T14:52:15.523077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 747 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:15.523119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 747 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:15.523128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=747 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:15.523132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:15.523422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:15.523610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 747 sessionId:  describe result for acl check
2025-09-30T14:52:15.523643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:15.523645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:15.523647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:15.523652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895168528251258:6832] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:15.524209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895168528251258:6832] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:15.526512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895168528251258:6832] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:15.527530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:15.527788Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:15.527808Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:15.527825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:15.527910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:15.527960Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895168438522282:5627]
2025-09-30T14:52:15.528725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:15.529051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:15.529100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:15.529436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:15.529431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895168528251258:6832] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:15.529448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895168528251258:6832] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:15.529451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895168528251258:6832] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:15.529459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 747 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:15.529497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:15.529503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:15.529504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:15.529505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:15.529507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:15.529508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:15.529509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:15.529511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:15.529512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:15.529513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:15.529514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.529515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.529516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.529517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:15.529518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:15.529524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:15.529535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:15.529539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:15.529543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:15.529549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:15.529554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:15.529558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:15.529562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:15.529566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:15.529570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:15.529574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.529578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.529582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.529586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:15.529590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:15.529597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:15.529605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:15.529612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:15.529617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:15.529622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:15.529626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:15.529630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:15.529635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:15.529641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:15.529652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:15.529657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:15.529662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:15.529667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:15.529672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:15.529676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:15.529681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:15.529685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:15.529690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:15.529694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:15.529699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:15.529705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.529714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.529719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.529729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.529734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.529739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.529748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:15.529753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:15.529758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:15.529769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:15.529819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:15.535769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:15.536645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:15.536672Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:15.536676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:15.536681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:15.536688Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 746 [2:7555895168438522282:5627]
2025-09-30T14:52:15.536704Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:15.536720Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:15.536729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:15.536732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:15.536735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:15.536752Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:15.536758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:15.536765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:15.536833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.536841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.536844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.536847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:15.536850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:15.536917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:15.536925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.536938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.536955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.536973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:15.536991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895168528251221:2454], now have 1 active actors on pipe
2025-09-30T14:52:15.537004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895168438522276:5627]
2025-09-30T14:52:15.537006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895168438522276:5627]
2025-09-30T14:52:15.537009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895168438522276:5627]
2025-09-30T14:52:15.537024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:15.537038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:15.537041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:15.537044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:15.537048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:15.537052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:15.537056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:15.537063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895168528251296:6832], now have 1 active actors on pipe
2025-09-30T14:52:15.537101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895168438522276:5627]
2025-09-30T14:52:15.537112Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:15.537119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:15.537108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 746
2025-09-30T14:52:15.537116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 746
2025-09-30T14:52:15.537172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:15.537182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:15.537207Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8c76d69-35d6fac5-4b93daf2-527e7bd9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:15.537218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:15.537222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:15.537224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:15.537235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:15.537250Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:15.537265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:15.537428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:15.537436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:15.537448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:15.537561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 747 partition: 0 MaxSeqNo: 42 sessionId: src_id|a8c76d69-35d6fac5-4b93daf2-527e7bd9_0
2025-09-30T14:52:15.538016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c442e226-4ac64f77-2e0c3eac-cdecc406_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a8c76d69-35d6fac5-4b93daf2-527e7bd9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:15.540956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8c76d69-35d6fac5-4b93daf2-527e7bd9_0] Write session: try to update token
2025-09-30T14:52:15.540980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8c76d69-35d6fac5-4b93daf2-527e7bd9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:15.548960Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:15.548979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:15.548988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895168438522276:5627]
2025-09-30T14:52:15.549030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:15.549029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:15.549181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:15.549315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:15.549437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:15.549568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:15.549748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:15.549786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:15.556017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 747 sessionId: src_id|a8c76d69-35d6fac5-4b93daf2-527e7bd9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:15.558610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:15.559828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:15.559852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:15.559871Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:15.559873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:15.559875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:15.559876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:15.559884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895168438522276:5627]
2025-09-30T14:52:15.559887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895168438522276:5627]
2025-09-30T14:52:15.559891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895168438522276:5627]
2025-09-30T14:52:15.559933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:15.559943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.559942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:15.559945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:15.559948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:15.559952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:15.560081Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:15.612601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895168528251305:6573]
2025-09-30T14:52:15.612825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 746, pipe: [1:7555895168528251305:6573]
2025-09-30T14:52:15.663522Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:15.663846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:15.663887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895168528251305:6573], now have 1 active actors on pipe
2025-09-30T14:52:15.664024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:15.664055Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:15.664100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895168528251305:6573]
2025-09-30T14:52:15.664117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:15.664125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:15.664192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 747 reason: error at write: Disconnected sessionId: src_id|a8c76d69-35d6fac5-4b93daf2-527e7bd9_0
2025-09-30T14:52:15.664331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 747 sessionId: src_id|a8c76d69-35d6fac5-4b93daf2-527e7bd9_0 is DEAD
2025-09-30T14:52:15.664454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8c76d69-35d6fac5-4b93daf2-527e7bd9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:15.664465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8c76d69-35d6fac5-4b93daf2-527e7bd9_0] Write session will restart in 0.008929s
2025-09-30T14:52:15.664482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8c76d69-35d6fac5-4b93daf2-527e7bd9_0] Write session: Do CDS request
2025-09-30T14:52:15.664489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8c76d69-35d6fac5-4b93daf2-527e7bd9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:15.673569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:15.674722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8c76d69-35d6fac5-4b93daf2-527e7bd9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:15.674829Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:15.674844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 748
2025-09-30T14:52:15.674959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 748 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:15.674992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 748 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:15.675004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=748 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:15.675012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:15.675433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 748 sessionId:  describe result for acl check
2025-09-30T14:52:15.675469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:15.675476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:15.675478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:15.675484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895168528251346:6836] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:15.676035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895168528251346:6836] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:15.677815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895168528251346:6836] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:15.680131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:15.680365Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:15.680376Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:15.680388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:15.680487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:15.680479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895168528251346:6836] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:15.680500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895168528251346:6836] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:15.680503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895168528251346:6836] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:15.680511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 748 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:15.680530Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895168438522362:5630]
2025-09-30T14:52:15.681082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:15.681356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:15.681388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:15.681611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:15.681656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:15.681661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:15.681661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:15.681662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:15.681662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:15.681663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:15.681664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:15.681664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:15.681665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:15.681666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:15.681666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.681667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.681667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.681668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:15.681668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:15.681672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:15.681678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:15.681680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:15.681682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:15.681685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:15.681687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:15.681689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:15.681691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:15.681693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:15.681696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:15.681698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.681700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.681702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.681704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:15.681707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:15.681711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:15.681717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:15.681722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:15.681725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:15.681728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:15.681730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:15.681734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:15.681738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:15.681742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:15.681745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:15.681748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:15.681752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:15.681755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:15.681758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:15.681760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:15.681763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:15.681765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:15.681769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:15.681771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:15.681775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:15.681777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.681781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.681783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.681786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.681789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.681792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.681794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:15.681797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:15.681799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:15.681802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:15.681825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:15.687538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:15.688398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:15.688414Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:15.688420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:15.688424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:15.688429Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 747 [2:7555895168438522362:5630]
2025-09-30T14:52:15.688445Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:15.688459Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:15.688467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:15.688469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:15.688472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:15.688486Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:15.688497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:15.688504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:15.688567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.688574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.688576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.688580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:15.688582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:15.688649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:15.688658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.688670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.688682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.688698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:15.688719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895168528251381:6836], now have 1 active actors on pipe
2025-09-30T14:52:15.688727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895168528251307:2454], now have 1 active actors on pipe
2025-09-30T14:52:15.688733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895168438522356:5630]
2025-09-30T14:52:15.688736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895168438522356:5630]
2025-09-30T14:52:15.688738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895168438522356:5630]
2025-09-30T14:52:15.688753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:15.688767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:15.688770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:15.688777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:15.688779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:15.688784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:15.688787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:15.688829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895168438522356:5630]
2025-09-30T14:52:15.688838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:15.688817Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 747
2025-09-30T14:52:15.688819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 747
2025-09-30T14:52:15.688864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:15.688872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:15.688877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:15.688904Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83fff117-b5b8e09a-a7428620-1a9ec37f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:15.688910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:15.688918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:15.688921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:15.688929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:15.688942Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:15.688957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:15.689110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:15.689118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:15.689132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:15.689217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 748 partition: 0 MaxSeqNo: 42 sessionId: src_id|83fff117-b5b8e09a-a7428620-1a9ec37f_0
2025-09-30T14:52:15.689567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8c76d69-35d6fac5-4b93daf2-527e7bd9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|83fff117-b5b8e09a-a7428620-1a9ec37f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:15.692320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83fff117-b5b8e09a-a7428620-1a9ec37f_0] Write session: try to update token
2025-09-30T14:52:15.692340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83fff117-b5b8e09a-a7428620-1a9ec37f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:15.702559Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:15.702577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:15.702579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:15.702582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:15.702590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895168438522356:5630]
2025-09-30T14:52:15.702595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895168438522356:5630]
2025-09-30T14:52:15.702599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895168438522356:5630]
2025-09-30T14:52:15.702645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:15.702659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.702659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:15.702665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:15.702666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:15.702670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:15.702801Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:15.705993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 748 sessionId: src_id|83fff117-b5b8e09a-a7428620-1a9ec37f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:15.708748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:15.764168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895168528251392:6573]
2025-09-30T14:52:15.764448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 747, pipe: [1:7555895168528251392:6573]
2025-09-30T14:52:15.807588Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:15.808206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:15.808219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:15.808249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895168528251392:6573], now have 1 active actors on pipe
2025-09-30T14:52:15.808515Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:15.808506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:15.808520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:15.808529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:15.808572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895168528251392:6573]
2025-09-30T14:52:15.808583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 748 reason: error at write: Disconnected sessionId: src_id|83fff117-b5b8e09a-a7428620-1a9ec37f_0
2025-09-30T14:52:15.808730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 748 sessionId: src_id|83fff117-b5b8e09a-a7428620-1a9ec37f_0 is DEAD
2025-09-30T14:52:15.808867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83fff117-b5b8e09a-a7428620-1a9ec37f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:15.808877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83fff117-b5b8e09a-a7428620-1a9ec37f_0] Write session will restart in 0.008082s
2025-09-30T14:52:15.808894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83fff117-b5b8e09a-a7428620-1a9ec37f_0] Write session: Do CDS request
2025-09-30T14:52:15.808898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83fff117-b5b8e09a-a7428620-1a9ec37f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:15.817756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83fff117-b5b8e09a-a7428620-1a9ec37f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:15.817869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:15.817882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 749
2025-09-30T14:52:15.818008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 749 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:15.818040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 749 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:15.818050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=749 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:15.818054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:15.818238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:15.818524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 749 sessionId:  describe result for acl check
2025-09-30T14:52:15.818561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:15.818569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:15.818572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:15.818577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895168528251434:6840] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:15.819136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895168528251434:6840] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:15.821389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895168528251434:6840] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:15.822232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:15.822526Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:15.822537Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:15.822547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:15.822603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:15.822633Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895168438522441:5632]
2025-09-30T14:52:15.823141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:15.823475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:15.823540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:15.823691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895168528251434:6840] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:15.823708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895168528251434:6840] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:15.823711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895168528251434:6840] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:15.823719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 749 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:15.823914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:15.824000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:15.824007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:15.824008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:15.824010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:15.824011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:15.824012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:15.824013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:15.824014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:15.824016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:15.824017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:15.824018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.824022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.824023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.824025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:15.824025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:15.824032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:15.824043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:15.824047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:15.824051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:15.824055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:15.824059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:15.824064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:15.824068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:15.824072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:15.824076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:15.824079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.824083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.824087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.824091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:15.824095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:15.824103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:15.824111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:15.824117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:15.824123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:15.824129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:15.824134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:15.824139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:15.824143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:15.824154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:15.824164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:15.824172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:15.824177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:15.824188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:15.824197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:15.824205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:15.824210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:15.824221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:15.824227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:15.824231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:15.824236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:15.824241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.824246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.824250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.824256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.824261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.824267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.824271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:15.824277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:15.824282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:15.824289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:15.824333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:15.830724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:15.831636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:15.831657Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:15.831660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:15.831664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:15.831671Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 748 [2:7555895168438522441:5632]
2025-09-30T14:52:15.831689Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:15.831705Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:15.831708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:15.831711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:15.831714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:15.831734Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:15.831747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:15.831754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:15.831819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.831828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.831830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.831834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:15.831837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:15.831912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:15.831920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.831934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.831946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.831968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:15.831996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895168528251471:6840], now have 1 active actors on pipe
2025-09-30T14:52:15.832000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895168528251393:2454], now have 1 active actors on pipe
2025-09-30T14:52:15.832006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895168438522435:5632]
2025-09-30T14:52:15.832008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895168438522435:5632]
2025-09-30T14:52:15.832011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895168438522435:5632]
2025-09-30T14:52:15.832027Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:15.832045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:15.832049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:15.832082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 748
2025-09-30T14:52:15.832050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:15.832083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 748
2025-09-30T14:52:15.832051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:15.832067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:15.832071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:15.832105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895168438522435:5632]
2025-09-30T14:52:15.832113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:15.832136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:15.832158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:15.832169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:15.832201Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6d59d36-6100b069-e365001f-34d033f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:15.832213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:15.832217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:15.832223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:15.832233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:15.832247Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:15.832267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:15.832412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:15.832425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:15.832447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:15.832526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 749 partition: 0 MaxSeqNo: 42 sessionId: src_id|b6d59d36-6100b069-e365001f-34d033f9_0
2025-09-30T14:52:15.832878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83fff117-b5b8e09a-a7428620-1a9ec37f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b6d59d36-6100b069-e365001f-34d033f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:15.835668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6d59d36-6100b069-e365001f-34d033f9_0] Write session: try to update token
2025-09-30T14:52:15.835686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6d59d36-6100b069-e365001f-34d033f9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:15.849471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 749 sessionId: src_id|b6d59d36-6100b069-e365001f-34d033f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:15.852040Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:15.852058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:15.852067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895168438522435:5632]
2025-09-30T14:52:15.852074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:15.852112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:15.852119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:15.852296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:15.852447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:15.852598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:15.852747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:15.852935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:15.852981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:15.852992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:15.853008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:15.853037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:15.853140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:15.858445Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:15.858462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:15.858464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:15.858467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:15.858486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895168438522435:5632]
2025-09-30T14:52:15.858494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895168438522435:5632]
2025-09-30T14:52:15.858498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895168438522435:5632]
2025-09-30T14:52:15.858534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:15.858543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:15.858545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.858548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:15.858557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:15.858562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:15.858682Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:15.908527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895168528251480:6573]
2025-09-30T14:52:15.908750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 748, pipe: [1:7555895168528251480:6573]
2025-09-30T14:52:15.964752Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:15.972166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:15.972191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:15.972350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:15.972412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:15.972471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:15.972538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:15.972585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:15.972595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:15.972669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:15.972731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:15.972797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:15.972868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:15.972911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:15.972919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:15.972981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:15.973042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:15.973112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:15.973172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:15.973215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:15.973222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:15.973289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:15.973357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:15.973423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:15.973486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:15.973534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:15.973544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:15.973613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:15.973675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:15.973739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:15.973802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:15.973846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:15.973854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:15.973921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:15.973983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:15.974048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:15.974151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:15.974200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:15.974207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:15.974271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:15.974349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:15.974415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:15.974477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:15.974521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:15.974528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:15.974596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:15.974661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:15.974724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:15.974791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:15.974844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:15.974852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:15.974919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:15.974980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:15.975043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:15.975109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:15.975279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:15.975287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:15.975360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:15.975423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:15.975488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:15.975551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:15.975604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:15.975612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:15.975673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895168528251480:6573], now have 1 active actors on pipe
2025-09-30T14:52:15.975934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:15.975960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:15.975988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 749 reason: error at write: Disconnected sessionId: src_id|b6d59d36-6100b069-e365001f-34d033f9_0
2025-09-30T14:52:15.976130Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:15.976171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 749 sessionId: src_id|b6d59d36-6100b069-e365001f-34d033f9_0 is DEAD
2025-09-30T14:52:15.976179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895168528251480:6573]
2025-09-30T14:52:15.976297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6d59d36-6100b069-e365001f-34d033f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:15.976308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6d59d36-6100b069-e365001f-34d033f9_0] Write session will restart in 0.008884s
2025-09-30T14:52:15.976333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6d59d36-6100b069-e365001f-34d033f9_0] Write session: Do CDS request
2025-09-30T14:52:15.976338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6d59d36-6100b069-e365001f-34d033f9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:15.976816Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:15.986047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:15.986738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6d59d36-6100b069-e365001f-34d033f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:15.986848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:15.986863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 750
2025-09-30T14:52:15.986960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 750 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:15.986992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 750 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:15.987001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=750 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:15.987005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:15.987427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 750 sessionId:  describe result for acl check
2025-09-30T14:52:15.987463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:15.987469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:15.987471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:15.987476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895168528251538:6845] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:15.987971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895168528251538:6845] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:15.989149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:15.989343Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:15.989353Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:15.989365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:15.989415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:15.989457Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895168438522533:5635]
2025-09-30T14:52:15.989682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895168528251538:6845] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:15.990092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:15.990385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:15.990431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:15.990761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:15.990821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:15.990827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:15.990828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:15.990830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:15.990831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:15.990833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:15.990834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:15.990836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:15.990837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:15.990838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:15.990840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.990841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.990842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.990843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:15.990844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:15.990849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:15.990859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:15.990863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:15.990866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:15.990870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:15.990874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:15.990878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:15.990882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:15.990886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:15.990891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:15.990895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.990899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.990903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.990907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:15.990911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:15.990918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:15.990926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:15.990932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:15.990937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:15.990941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:15.990947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:15.990951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:15.990956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:15.990967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:15.990972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:15.990976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:15.990981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:15.990985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:15.990990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:15.990995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:15.991000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:15.991004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:15.991009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:15.991013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:15.991021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:15.991027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.991032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.991038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.991043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.991047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.991054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.991058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:15.991065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:15.991069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:15.991076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:15.991117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:15.997081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895168528251538:6845] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:15.997098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895168528251538:6845] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:15.997102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895168528251538:6845] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:15.997111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 750 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:15.997419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:15.998512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:15.998528Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:15.998530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:15.998534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:15.998540Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 749 [2:7555895168438522533:5635]
2025-09-30T14:52:15.998555Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:15.998570Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:15.998578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:15.998584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:15.998586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:15.998601Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:15.998613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:15.998622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:15.998684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.998691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.998693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.998696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:15.998698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:15.998754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:15.998761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:15.998769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:15.998775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:15.998785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:15.998800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895168528251484:2454], now have 1 active actors on pipe
2025-09-30T14:52:15.998804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895168528251581:6845], now have 1 active actors on pipe
2025-09-30T14:52:15.998810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895168438522527:5635]
2025-09-30T14:52:15.998814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895168438522527:5635]
2025-09-30T14:52:15.998816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895168438522527:5635]
2025-09-30T14:52:15.998830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:15.998848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:15.998853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:15.998857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:15.998859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:15.998868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:15.998871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:15.998854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 749
2025-09-30T14:52:15.998857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 749
2025-09-30T14:52:15.998899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895168438522527:5635]
2025-09-30T14:52:15.998909Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:15.998925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:15.999041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:15.999053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:15.999079Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c34e4e80-89c9edcd-29825bd5-a4614e23_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:15.999088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:15.999094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:15.999097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:15.999105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:15.999115Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:15.999132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:15.999289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:15.999300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:15.999314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:15.999413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 750 partition: 0 MaxSeqNo: 42 sessionId: src_id|c34e4e80-89c9edcd-29825bd5-a4614e23_0
2025-09-30T14:52:15.999752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6d59d36-6100b069-e365001f-34d033f9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c34e4e80-89c9edcd-29825bd5-a4614e23_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:16.002367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c34e4e80-89c9edcd-29825bd5-a4614e23_0] Write session: try to update token
2025-09-30T14:52:16.002385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c34e4e80-89c9edcd-29825bd5-a4614e23_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:16.015770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 750 sessionId: src_id|c34e4e80-89c9edcd-29825bd5-a4614e23_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:16.018486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:16.019950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:16.019972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:16.019988Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:16.019991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:16.019998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895168438522527:5635]
2025-09-30T14:52:16.020039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:16.020046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:16.020211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:16.020350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:16.020477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:16.020609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:16.020805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:16.020850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:16.020870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:16.020982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:16.027985Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:16.028003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:16.028006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:16.028008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:16.028022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895168438522527:5635]
2025-09-30T14:52:16.028025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895168438522527:5635]
2025-09-30T14:52:16.028028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895168438522527:5635]
2025-09-30T14:52:16.028064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:16.028071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.028071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:16.028074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:16.028076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:16.028079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:16.028204Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:16.076463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895172823218889:6573]
2025-09-30T14:52:16.076686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 749, pipe: [1:7555895172823218889:6573]
2025-09-30T14:52:16.134789Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:16.142574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:16.142600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:16.142750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:16.142811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:16.142876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:16.142940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:16.142987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:16.142996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:16.143064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:16.143125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:16.143199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:16.143280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:16.143326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:16.143332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:16.143396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:16.143454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:16.143525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:16.143593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:16.143634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:16.143643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:16.143719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:16.143790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:16.143850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:16.143910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:16.143951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:16.143961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:16.144025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:16.144084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:16.144148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:16.144206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:16.144253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:16.144264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:16.144331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:16.144388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:16.144445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:16.144507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:16.144558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:16.144566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:16.144635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:16.144692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:16.144754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:16.144814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:16.144856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:16.144862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:16.144922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:16.144978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:16.145036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:16.145097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:16.145142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:16.145147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:16.145209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:16.145265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:16.145325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:16.145406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:16.145449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:16.145454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:16.145514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:16.145570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:16.145633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:16.145700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:16.145742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:16.145748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:16.145843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895172823218889:6573], now have 1 active actors on pipe
2025-09-30T14:52:16.146078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:16.146096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:16.146125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 750 reason: error at write: Disconnected sessionId: src_id|c34e4e80-89c9edcd-29825bd5-a4614e23_0
2025-09-30T14:52:16.146285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 750 sessionId: src_id|c34e4e80-89c9edcd-29825bd5-a4614e23_0 is DEAD
2025-09-30T14:52:16.146429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c34e4e80-89c9edcd-29825bd5-a4614e23_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:16.146438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c34e4e80-89c9edcd-29825bd5-a4614e23_0] Write session will restart in 0.006334s
2025-09-30T14:52:16.146456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c34e4e80-89c9edcd-29825bd5-a4614e23_0] Write session: Do CDS request
2025-09-30T14:52:16.146460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c34e4e80-89c9edcd-29825bd5-a4614e23_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:16.146472Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:16.146670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895172823218889:6573]
2025-09-30T14:52:16.146820Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:16.153779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c34e4e80-89c9edcd-29825bd5-a4614e23_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:16.153854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:16.153873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 751
2025-09-30T14:52:16.154006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 751 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:16.154038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 751 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:16.154044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=751 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:16.154049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:16.154412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 751 sessionId:  describe result for acl check
2025-09-30T14:52:16.154446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:16.154452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:16.154454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:16.154461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895172823218944:6857] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:16.154970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895172823218944:6857] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:16.155683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:16.157286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895172823218944:6857] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:16.159511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:16.159775Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:16.159787Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:16.159800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:16.159870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:16.159911Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895172733489926:5644]
2025-09-30T14:52:16.160176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895172823218944:6857] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:16.160194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895172823218944:6857] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:16.160197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895172823218944:6857] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:16.160204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 751 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:16.160557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:16.160838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:16.160879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:16.161117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:16.161171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:16.161177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:16.161179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:16.161180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:16.161181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:16.161183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:16.161185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:16.161187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:16.161188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:16.161189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:16.161190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.161191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.161193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.161194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:16.161195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:16.161200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:16.161210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:16.161214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:16.161218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:16.161221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:16.161224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:16.161226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:16.161229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:16.161231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:16.161234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:16.161236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.161238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.161241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.161243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:16.161245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:16.161250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:16.161254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:16.161258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:16.161261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:16.161264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:16.161267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:16.161270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:16.161274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:16.161277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:16.161280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:16.161282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:16.161285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:16.161287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:16.161290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:16.161293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:16.161295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:16.161298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:16.161301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:16.161303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:16.161306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:16.161308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.161311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.161314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.161317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.161320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.161322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.161324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:16.161327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:16.161329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:16.161332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:16.161357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:16.167404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:16.168485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:16.168500Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:16.168502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:16.168506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:16.168511Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 750 [2:7555895172733489926:5644]
2025-09-30T14:52:16.168523Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:16.168534Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:16.168535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:16.168537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:16.168539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:16.168553Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:16.168561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:16.168567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:16.168620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.168627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.168628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.168632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:16.168634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:16.168704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:16.168711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.168724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.168741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.168763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:16.168783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895172823218982:6857], now have 1 active actors on pipe
2025-09-30T14:52:16.168791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895172823218904:2454], now have 1 active actors on pipe
2025-09-30T14:52:16.168798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895172733489920:5644]
2025-09-30T14:52:16.168800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895172733489920:5644]
2025-09-30T14:52:16.168804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895172733489920:5644]
2025-09-30T14:52:16.168818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:16.168834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:16.168838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:16.168842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:16.168844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:16.168818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 750
2025-09-30T14:52:16.168853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:16.168828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 750
2025-09-30T14:52:16.168856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:16.168886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895172733489920:5644]
2025-09-30T14:52:16.168899Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:16.168914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:16.168915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:16.168918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:16.168965Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c98b1e90-8490a08a-cd44be3c-294aa9ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:16.168976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:16.168979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:16.168981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:16.168989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:16.168997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:16.169017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:16.169220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:16.169234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:16.169255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:16.169360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 751 partition: 0 MaxSeqNo: 42 sessionId: src_id|c98b1e90-8490a08a-cd44be3c-294aa9ca_0
2025-09-30T14:52:16.169714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c34e4e80-89c9edcd-29825bd5-a4614e23_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c98b1e90-8490a08a-cd44be3c-294aa9ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:16.172557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c98b1e90-8490a08a-cd44be3c-294aa9ca_0] Write session: try to update token
2025-09-30T14:52:16.172577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c98b1e90-8490a08a-cd44be3c-294aa9ca_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:16.182799Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:16.182815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:16.182817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:16.182819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:16.182830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895172733489920:5644]
2025-09-30T14:52:16.182834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895172733489920:5644]
2025-09-30T14:52:16.182837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895172733489920:5644]
2025-09-30T14:52:16.182883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:16.182890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.182893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:16.182895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:16.182901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:16.182904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:16.183036Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:16.186766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 751 sessionId: src_id|c98b1e90-8490a08a-cd44be3c-294aa9ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:16.189479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:16.246983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895172823219003:6573]
2025-09-30T14:52:16.247281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 750, pipe: [1:7555895172823219003:6573]
2025-09-30T14:52:16.290315Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:16.290870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:16.290886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:16.290925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895172823219003:6573], now have 1 active actors on pipe
2025-09-30T14:52:16.291206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:16.291217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895172823219003:6573]
2025-09-30T14:52:16.291222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:16.291239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:16.291323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 751 reason: error at write: Disconnected sessionId: src_id|c98b1e90-8490a08a-cd44be3c-294aa9ca_0
2025-09-30T14:52:16.291407Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:16.291507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 751 sessionId: src_id|c98b1e90-8490a08a-cd44be3c-294aa9ca_0 is DEAD
2025-09-30T14:52:16.291627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c98b1e90-8490a08a-cd44be3c-294aa9ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:16.291657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c98b1e90-8490a08a-cd44be3c-294aa9ca_0] Write session will restart in 0.008410s
2025-09-30T14:52:16.291681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c98b1e90-8490a08a-cd44be3c-294aa9ca_0] Write session: Do CDS request
2025-09-30T14:52:16.291686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c98b1e90-8490a08a-cd44be3c-294aa9ca_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:16.300685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c98b1e90-8490a08a-cd44be3c-294aa9ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:16.300787Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:16.300814Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 752
2025-09-30T14:52:16.300934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 752 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:16.300965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 752 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:16.300974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=752 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:16.300978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:16.301431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 752 sessionId:  describe result for acl check
2025-09-30T14:52:16.301474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:16.301481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:16.301483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:16.301489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895172823219045:6862] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:16.302073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895172823219045:6862] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:16.302291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:16.304415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895172823219045:6862] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:16.305805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:16.305998Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:16.306009Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:16.306019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:16.306069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:16.306108Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895172733490031:5652]
2025-09-30T14:52:16.306791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:16.307030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895172823219045:6862] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:16.307043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895172823219045:6862] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:16.307047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895172823219045:6862] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:16.307056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 752 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:16.307077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:16.307126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:16.307428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:16.307497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:16.307503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:16.307504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:16.307505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:16.307507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:16.307508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:16.307509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:16.307510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:16.307511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:16.307513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:16.307514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.307515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.307516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.307518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:16.307519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:16.307525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:16.307534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:16.307538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:16.307543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:16.307547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:16.307551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:16.307555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:16.307559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:16.307563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:16.307568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:16.307571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.307575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.307579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.307583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:16.307591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:16.307597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:16.307603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:16.307610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:16.307614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:16.307617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:16.307620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:16.307623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:16.307625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:16.307628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:16.307631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:16.307633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:16.307636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:16.307638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:16.307641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:16.307644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:16.307646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:16.307649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:16.307652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:16.307654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:16.307657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:16.307660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.307662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.307666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.307669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.307672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.307675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.307677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:16.307680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:16.307683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:16.307686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:16.307712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:16.313883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:16.314782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:16.314802Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:16.314809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:16.314813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:16.314820Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 751 [2:7555895172733490031:5652]
2025-09-30T14:52:16.314837Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:16.314853Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:16.314856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:16.314859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:16.314861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:16.314877Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:16.314890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:16.314897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:16.314962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.314970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.314973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.314976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:16.314977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:16.315033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:16.315038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.315048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.315059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.315069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:16.315085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895172733490025:5652]
2025-09-30T14:52:16.315090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895172733490025:5652]
2025-09-30T14:52:16.315091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895172733490025:5652]
2025-09-30T14:52:16.315099Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:16.315112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895172823219004:2454], now have 1 active actors on pipe
2025-09-30T14:52:16.315119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895172823219084:6862], now have 1 active actors on pipe
2025-09-30T14:52:16.315119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:16.315123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:16.315125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:16.315126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:16.315133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:16.315136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:16.315164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895172733490025:5652]
2025-09-30T14:52:16.315173Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:16.315180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:16.315193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 751
2025-09-30T14:52:16.315210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 751
2025-09-30T14:52:16.315286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:16.315296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:16.315318Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc3a735a-1e3700d3-e0d889d9-a57eac54_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:16.315323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:16.315329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:16.315330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:16.315338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:16.315347Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:16.315362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:16.315535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:16.315549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:16.315575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:16.315677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 752 partition: 0 MaxSeqNo: 42 sessionId: src_id|fc3a735a-1e3700d3-e0d889d9-a57eac54_0
2025-09-30T14:52:16.316006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c98b1e90-8490a08a-cd44be3c-294aa9ca_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fc3a735a-1e3700d3-e0d889d9-a57eac54_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:16.318781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc3a735a-1e3700d3-e0d889d9-a57eac54_0] Write session: try to update token
2025-09-30T14:52:16.318803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc3a735a-1e3700d3-e0d889d9-a57eac54_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:16.328863Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:16.328881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:16.328883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:16.328884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:16.328892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895172733490025:5652]
2025-09-30T14:52:16.328895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895172733490025:5652]
2025-09-30T14:52:16.328897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895172733490025:5652]
2025-09-30T14:52:16.328931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:16.328936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.328938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:16.328940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:16.328947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:16.328952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:16.329067Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:16.332803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 752 sessionId: src_id|fc3a735a-1e3700d3-e0d889d9-a57eac54_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:16.335464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:16.391325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895172823219094:6573]
2025-09-30T14:52:16.391620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 751, pipe: [1:7555895172823219094:6573]
2025-09-30T14:52:16.437744Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:16.438421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:16.438436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:16.438471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895172823219094:6573], now have 1 active actors on pipe
2025-09-30T14:52:16.438699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:16.438719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895172823219094:6573]
2025-09-30T14:52:16.438739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:16.438741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:16.438802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 752 reason: error at write: Disconnected sessionId: src_id|fc3a735a-1e3700d3-e0d889d9-a57eac54_0
2025-09-30T14:52:16.438968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 752 sessionId: src_id|fc3a735a-1e3700d3-e0d889d9-a57eac54_0 is DEAD
2025-09-30T14:52:16.439061Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:16.439102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc3a735a-1e3700d3-e0d889d9-a57eac54_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:16.439112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc3a735a-1e3700d3-e0d889d9-a57eac54_0] Write session will restart in 0.005209s
2025-09-30T14:52:16.439135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc3a735a-1e3700d3-e0d889d9-a57eac54_0] Write session: Do CDS request
2025-09-30T14:52:16.439141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc3a735a-1e3700d3-e0d889d9-a57eac54_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:16.445702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc3a735a-1e3700d3-e0d889d9-a57eac54_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:16.445816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:16.445830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 753
2025-09-30T14:52:16.445946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 753 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:16.445980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 753 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:16.445989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=753 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:16.445993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:16.446389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 753 sessionId:  describe result for acl check
2025-09-30T14:52:16.446426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:16.446436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:16.446438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:16.446444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895172823219136:6866] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:16.446912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895172823219136:6866] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:16.448258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:16.448810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895172823219136:6866] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:16.451522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:16.451720Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:16.451732Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:16.451743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:16.451790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:16.451825Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895172733490115:5654]
2025-09-30T14:52:16.451820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895172823219136:6866] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:16.451833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895172823219136:6866] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:16.451836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895172823219136:6866] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:16.451843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 753 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:16.452279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:16.452599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:16.452650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:16.452920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:16.452961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:16.452966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:16.452967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:16.452968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:16.452969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:16.452970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:16.452970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:16.452971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:16.452972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:16.452972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:16.452973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.452973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.452974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.452975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:16.452975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:16.452979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:16.452986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:16.452988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:16.452992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:16.452994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:16.453004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:16.453006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:16.453008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:16.453010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:16.453013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:16.453015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.453018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.453020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.453022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:16.453024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:16.453030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:16.453035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:16.453039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:16.453042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:16.453045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:16.453047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:16.453050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:16.453053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:16.453064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:16.453067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:16.453070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:16.453073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:16.453076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:16.453078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:16.453081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:16.453083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:16.453086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:16.453089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:16.453091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:16.453094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:16.453097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.453099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.453102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.453105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.453107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.453110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.453112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:16.453115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:16.453117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:16.453120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:16.453145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:16.458571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:16.459476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:16.459493Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:16.459496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:16.459499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:16.459505Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 752 [2:7555895172733490115:5654]
2025-09-30T14:52:16.459522Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:16.459539Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:16.459542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:16.459545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:16.459547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:16.459563Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:16.459569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:16.459576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:16.459640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.459649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.459652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.459655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:16.459657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:16.459720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:16.459731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.459744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.459755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.459769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:16.459790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895172823219174:6866], now have 1 active actors on pipe
2025-09-30T14:52:16.459799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895172823219095:2454], now have 1 active actors on pipe
2025-09-30T14:52:16.459805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895172733490109:5654]
2025-09-30T14:52:16.459807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895172733490109:5654]
2025-09-30T14:52:16.459809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895172733490109:5654]
2025-09-30T14:52:16.459821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:16.459837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:16.459843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:16.459846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:16.459848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:16.459855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:16.459858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:16.459894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895172733490109:5654]
2025-09-30T14:52:16.459910Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:16.459893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 752
2025-09-30T14:52:16.459938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:16.459912Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 752
2025-09-30T14:52:16.460240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:16.460251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:16.460285Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2381e8f7-22b21d60-af9f6774-2358f180_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:16.460297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:16.460301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:16.460303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:16.460313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:16.460326Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:16.460344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:16.460523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:16.460536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:16.460551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:16.460627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 753 partition: 0 MaxSeqNo: 42 sessionId: src_id|2381e8f7-22b21d60-af9f6774-2358f180_0
2025-09-30T14:52:16.460953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc3a735a-1e3700d3-e0d889d9-a57eac54_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2381e8f7-22b21d60-af9f6774-2358f180_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:16.463754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2381e8f7-22b21d60-af9f6774-2358f180_0] Write session: try to update token
2025-09-30T14:52:16.463773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2381e8f7-22b21d60-af9f6774-2358f180_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:16.472162Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:16.472181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:16.472183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:16.472185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:16.472196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895172733490109:5654]
2025-09-30T14:52:16.472200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895172733490109:5654]
2025-09-30T14:52:16.472203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895172733490109:5654]
2025-09-30T14:52:16.472241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:16.472247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.472250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:16.472251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:16.472257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:16.472261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:16.472377Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:16.478189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 753 sessionId: src_id|2381e8f7-22b21d60-af9f6774-2358f180_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:16.480849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:16.538785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895172823219188:6573]
2025-09-30T14:52:16.539049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 752, pipe: [1:7555895172823219188:6573]
2025-09-30T14:52:16.586593Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:16.587074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:16.587089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:16.587125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895172823219188:6573], now have 1 active actors on pipe
2025-09-30T14:52:16.587361Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:16.587392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895172823219188:6573]
2025-09-30T14:52:16.587421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:16.587425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:16.587432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:16.587494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 753 reason: error at write: Disconnected sessionId: src_id|2381e8f7-22b21d60-af9f6774-2358f180_0
2025-09-30T14:52:16.587661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 753 sessionId: src_id|2381e8f7-22b21d60-af9f6774-2358f180_0 is DEAD
2025-09-30T14:52:16.587827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2381e8f7-22b21d60-af9f6774-2358f180_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:16.587838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2381e8f7-22b21d60-af9f6774-2358f180_0] Write session will restart in 0.005654s
2025-09-30T14:52:16.587860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2381e8f7-22b21d60-af9f6774-2358f180_0] Write session: Do CDS request
2025-09-30T14:52:16.587869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2381e8f7-22b21d60-af9f6774-2358f180_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:16.594783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2381e8f7-22b21d60-af9f6774-2358f180_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:16.594849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:16.594868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 754
2025-09-30T14:52:16.594998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 754 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:16.595029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 754 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:16.595041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=754 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:16.595045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:16.595461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 754 sessionId:  describe result for acl check
2025-09-30T14:52:16.595501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:16.595508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:16.595509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:16.595515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895172823219202:6871] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:16.596011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895172823219202:6871] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:16.598058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895172823219202:6871] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:16.599178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:16.602401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:16.602605Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:16.602615Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:16.602625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:16.602668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:16.602705Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895172733490201:5657]
2025-09-30T14:52:16.602792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895172823219202:6871] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:16.602807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895172823219202:6871] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:16.602811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895172823219202:6871] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:16.602819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 754 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:16.603370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:16.603659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:16.603695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:16.604002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:16.604060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:16.604066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:16.604067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:16.604068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:16.604069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:16.604070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:16.604071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:16.604073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:16.604074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:16.604075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:16.604076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.604077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.604078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.604079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:16.604080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:16.604085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:16.604094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:16.604100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:16.604103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:16.604106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:16.604110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:16.604113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:16.604117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:16.604120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:16.604129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:16.604137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.604141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.604149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.604153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:16.604156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:16.604163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:16.604170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:16.604180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:16.604189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:16.604195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:16.604203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:16.604207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:16.604215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:16.604220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:16.604224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:16.604228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:16.604232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:16.604242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:16.604251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:16.604258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:16.604263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:16.604268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:16.604273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:16.604277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:16.604282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:16.604286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.604290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.604294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.604299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.604303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.604311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.604316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:16.604324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:16.604328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:16.604337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:16.604380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:16.609851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:16.610711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:16.610728Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:16.610731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:16.610736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:16.610743Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 753 [2:7555895172733490201:5657]
2025-09-30T14:52:16.610758Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:16.610773Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:16.610776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:16.610778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:16.610781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:16.610795Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:16.610801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:16.610807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:16.610867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.610874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.610876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.610880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:16.610882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:16.610945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:16.610952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.610963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.610973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.610994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:16.611014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895172733490195:5657]
2025-09-30T14:52:16.611021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895172733490195:5657]
2025-09-30T14:52:16.611023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895172733490195:5657]
2025-09-30T14:52:16.611030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:16.611041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:16.611045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:16.611051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:16.611053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:16.611060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:16.611062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:16.611072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895172823219189:2454], now have 1 active actors on pipe
2025-09-30T14:52:16.611077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895172823219269:6871], now have 1 active actors on pipe
2025-09-30T14:52:16.611105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895172733490195:5657]
2025-09-30T14:52:16.611119Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:16.611139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:16.611130Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 753
2025-09-30T14:52:16.611158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 753
2025-09-30T14:52:16.611239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:16.611261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:16.611282Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b5b545c-22015e60-1c4bc6c6-f891ff2d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:16.611294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:16.611297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:16.611299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:16.611308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:16.611322Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:16.611338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:16.611494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:16.611501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:16.611511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:16.611583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 754 partition: 0 MaxSeqNo: 42 sessionId: src_id|1b5b545c-22015e60-1c4bc6c6-f891ff2d_0
2025-09-30T14:52:16.611930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2381e8f7-22b21d60-af9f6774-2358f180_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1b5b545c-22015e60-1c4bc6c6-f891ff2d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:16.614649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b5b545c-22015e60-1c4bc6c6-f891ff2d_0] Write session: try to update token
2025-09-30T14:52:16.614670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b5b545c-22015e60-1c4bc6c6-f891ff2d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:16.623234Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:16.623270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:16.623272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:16.623274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:16.623283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895172733490195:5657]
2025-09-30T14:52:16.623290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895172733490195:5657]
2025-09-30T14:52:16.623294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895172733490195:5657]
2025-09-30T14:52:16.623334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:16.623340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.623343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:16.623343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:16.623349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:16.623353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:16.623488Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:16.628825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 754 sessionId: src_id|1b5b545c-22015e60-1c4bc6c6-f891ff2d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:16.631497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:16.687814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895172823219281:6573]
2025-09-30T14:52:16.688222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 753, pipe: [1:7555895172823219281:6573]
2025-09-30T14:52:16.731657Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:16.731924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:16.731936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:16.731968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895172823219281:6573], now have 1 active actors on pipe
2025-09-30T14:52:16.732133Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:16.732209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:16.732228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:16.732281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895172823219281:6573]
2025-09-30T14:52:16.732373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 754 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1b5b545c-22015e60-1c4bc6c6-f891ff2d_0
2025-09-30T14:52:16.732543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 754 sessionId: src_id|1b5b545c-22015e60-1c4bc6c6-f891ff2d_0 is DEAD
2025-09-30T14:52:16.732711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b5b545c-22015e60-1c4bc6c6-f891ff2d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:16.732721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b5b545c-22015e60-1c4bc6c6-f891ff2d_0] Write session will restart in 0.008469s
2025-09-30T14:52:16.732739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b5b545c-22015e60-1c4bc6c6-f891ff2d_0] Write session: Do CDS request
2025-09-30T14:52:16.732744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b5b545c-22015e60-1c4bc6c6-f891ff2d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:16.742247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:16.742723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b5b545c-22015e60-1c4bc6c6-f891ff2d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:16.742807Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:16.742821Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 755
2025-09-30T14:52:16.742922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 755 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:16.742953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 755 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:16.742973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=755 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:16.742982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:16.743401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 755 sessionId:  describe result for acl check
2025-09-30T14:52:16.743434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:16.743440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:16.743442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:16.743447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895172823219328:6875] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:16.743959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895172823219328:6875] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:16.745399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:16.745577Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:16.745587Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:16.745595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:16.745640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:16.745681Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895172733490286:5659]
2025-09-30T14:52:16.745717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895172823219328:6875] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:16.746302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:16.746589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:16.746637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:16.746879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:16.746925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:16.746932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:16.746933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:16.746934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:16.746935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:16.746936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:16.746937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:16.746938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:16.746939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:16.746940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:16.746941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.746942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.746943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.746944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:16.746948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:16.746952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:16.746961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:16.746965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:16.746969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:16.746973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:16.746976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:16.746980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:16.746984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:16.746987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:16.746991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:16.746995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.746998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.747001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.747005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:16.747008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:16.747015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:16.747022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:16.747028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:16.747033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:16.747038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:16.747043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:16.747047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:16.747052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:16.747055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:16.747057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:16.747059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:16.747062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:16.747065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:16.747068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:16.747070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:16.747075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:16.747077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:16.747080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:16.747082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:16.747085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:16.747089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.747091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.747094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.747096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.747099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.747103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.747105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:16.747108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:16.747110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:16.747112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:16.747136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:16.747836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895172823219328:6875] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:16.747847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895172823219328:6875] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:16.747849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895172823219328:6875] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:16.747854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 755 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:16.752472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:16.753334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:16.753351Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:16.753353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:16.753358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:16.753365Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 754 [2:7555895172733490286:5659]
2025-09-30T14:52:16.753383Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:16.753396Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:16.753406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:16.753409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:16.753410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:16.753421Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:16.753426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:16.753431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:16.753477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.753479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.753480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.753482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:16.753484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:16.753533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:16.753539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.753547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.753554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.753563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:16.753579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895172733490279:5659]
2025-09-30T14:52:16.753584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895172733490279:5659]
2025-09-30T14:52:16.753586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895172733490279:5659]
2025-09-30T14:52:16.753591Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:16.753601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:16.753603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:16.753607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:16.753609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:16.753614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:16.753616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:16.753624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895172823219367:6875], now have 1 active actors on pipe
2025-09-30T14:52:16.753628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895172823219282:2454], now have 1 active actors on pipe
2025-09-30T14:52:16.753656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895172733490279:5659]
2025-09-30T14:52:16.753667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:16.753679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:16.753692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 754
2025-09-30T14:52:16.753694Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 754
2025-09-30T14:52:16.753742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:16.753751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:16.753772Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|facbc947-acce942c-c13ba350-216cdf0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:16.753778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:16.753785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:16.753786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:16.753792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:16.753799Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:16.753812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:16.753937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:16.753943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:16.753953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:16.754029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 755 partition: 0 MaxSeqNo: 42 sessionId: src_id|facbc947-acce942c-c13ba350-216cdf0e_0
2025-09-30T14:52:16.754353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b5b545c-22015e60-1c4bc6c6-f891ff2d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|facbc947-acce942c-c13ba350-216cdf0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:16.757059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|facbc947-acce942c-c13ba350-216cdf0e_0] Write session: try to update token
2025-09-30T14:52:16.757080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|facbc947-acce942c-c13ba350-216cdf0e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:16.765966Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:16.765985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:16.765987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:16.765989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:16.765998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895172733490279:5659]
2025-09-30T14:52:16.766065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895172733490279:5659]
2025-09-30T14:52:16.766074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895172733490279:5659]
2025-09-30T14:52:16.766114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:16.766125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.766128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:16.766167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:16.766192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:16.766207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:16.766280Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:16.770324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 755 sessionId: src_id|facbc947-acce942c-c13ba350-216cdf0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:16.773066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:16.814769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-09-30T14:52:16.814796Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 4
2025-09-30T14:52:16.832199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895172823219377:6573]
2025-09-30T14:52:16.832447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 754, pipe: [1:7555895172823219377:6573]
2025-09-30T14:52:16.871233Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:16.871537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:16.871557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:16.871619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895172823219377:6573], now have 1 active actors on pipe
2025-09-30T14:52:16.871809Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:16.871827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:16.871830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:16.871842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 4
2025-09-30T14:52:16.871843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:16.871886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895172823219377:6573]
2025-09-30T14:52:16.871908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 755 reason: error at write: Disconnected sessionId: src_id|facbc947-acce942c-c13ba350-216cdf0e_0
2025-09-30T14:52:16.872056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 755 sessionId: src_id|facbc947-acce942c-c13ba350-216cdf0e_0 is DEAD
2025-09-30T14:52:16.872194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|facbc947-acce942c-c13ba350-216cdf0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:16.872201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|facbc947-acce942c-c13ba350-216cdf0e_0] Write session will restart in 0.005743s
2025-09-30T14:52:16.872221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|facbc947-acce942c-c13ba350-216cdf0e_0] Write session: Do CDS request
2025-09-30T14:52:16.872225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|facbc947-acce942c-c13ba350-216cdf0e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:16.878688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|facbc947-acce942c-c13ba350-216cdf0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:16.878768Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:16.878782Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 756
2025-09-30T14:52:16.878886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 756 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:16.878917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 756 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:16.878927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=756 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:16.878930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:16.879375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 756 sessionId:  describe result for acl check
2025-09-30T14:52:16.879409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:16.879412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:16.879414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:16.879419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895172823219401:6879] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:16.880003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895172823219401:6879] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:16.881777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:16.882022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895172823219401:6879] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:16.885058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:16.885254Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:16.885264Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:16.885272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:16.885321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:16.885356Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895172733490371:5662]
2025-09-30T14:52:16.885433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895172823219401:6879] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:16.885448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895172823219401:6879] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:16.885452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895172823219401:6879] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:16.885460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 756 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:16.885834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:16.886071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:16.886103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:16.886435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:16.886508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:16.886513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:16.886513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:16.886514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:16.886515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:16.886515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:16.886516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:16.886517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:16.886517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:16.886518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:16.886519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.886521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.886522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.886522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:16.886523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:16.886526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:16.886532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:16.886534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:16.886537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:16.886539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:16.886541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:16.886544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:16.886546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:16.886548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:16.886551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:16.886553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.886555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.886557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.886559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:16.886562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:16.886567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:16.886573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:16.886577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:16.886580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:16.886583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:16.886586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:16.886589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:16.886592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:16.886595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:16.886598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:16.886601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:16.886603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:16.886606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:16.886609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:16.886611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:16.886614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:16.886618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:16.886623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:16.886627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:16.886632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:16.886637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.886642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.886646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.886651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.886656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.886660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.886665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:16.886670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:16.886674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:16.886680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:16.886741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:16.892143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:16.893025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:16.893042Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:16.893046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:16.893050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:16.893057Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 755 [2:7555895172733490371:5662]
2025-09-30T14:52:16.893072Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:16.893088Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:16.893091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:16.893094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:16.893096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:16.893113Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:16.893122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:16.893127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:16.893177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.893182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.893184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.893186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:16.893187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:16.893242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:16.893249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.893262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:16.893275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:16.893288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:16.893304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895172733490365:5662]
2025-09-30T14:52:16.893309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895172733490365:5662]
2025-09-30T14:52:16.893310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895172733490365:5662]
2025-09-30T14:52:16.893317Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:16.893328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895172823219378:2454], now have 1 active actors on pipe
2025-09-30T14:52:16.893329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:16.893331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895172823219460:6879], now have 1 active actors on pipe
2025-09-30T14:52:16.893332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:16.893335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:16.893336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:16.893345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:16.893348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:16.893372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895172733490365:5662]
2025-09-30T14:52:16.893381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:16.893398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:16.893376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 755
2025-09-30T14:52:16.893382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 755
2025-09-30T14:52:16.893454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:16.893463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:16.893513Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 85826639 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:52:16.893551Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4c6c5a07-f6f8644b-9729525e-859cd474_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:16.893558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:16.893561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:16.893562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:16.893569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:16.893576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:16.893584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:16.893746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 4 DataSize: 85826639 UsedReserveSize: 0
2025-09-30T14:52:16.893752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:16.893758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:16.893769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:16.893775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:52:16.893831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 756 partition: 0 MaxSeqNo: 42 sessionId: src_id|4c6c5a07-f6f8644b-9729525e-859cd474_0
2025-09-30T14:52:16.894153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|facbc947-acce942c-c13ba350-216cdf0e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4c6c5a07-f6f8644b-9729525e-859cd474_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:16.896838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c6c5a07-f6f8644b-9729525e-859cd474_0] Write session: try to update token
2025-09-30T14:52:16.896855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c6c5a07-f6f8644b-9729525e-859cd474_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:16.905825Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:16.905845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:16.905847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:16.905849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:16.905857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895172733490365:5662]
2025-09-30T14:52:16.905862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895172733490365:5662]
2025-09-30T14:52:16.905866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895172733490365:5662]
2025-09-30T14:52:16.905904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:16.905906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:16.905910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:16.905911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:16.905913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:16.905916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:16.906045Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:16.910771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 756 sessionId: src_id|4c6c5a07-f6f8644b-9729525e-859cd474_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:16.913434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:16.971952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895172823219475:6573]
2025-09-30T14:52:16.972249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 755, pipe: [1:7555895172823219475:6573]
2025-09-30T14:52:17.015030Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:17.015614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:17.015626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:17.015659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895172823219475:6573], now have 1 active actors on pipe
2025-09-30T14:52:17.015833Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:17.015932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895172823219475:6573]
2025-09-30T14:52:17.015938Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:17.015971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:17.016044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 756 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4c6c5a07-f6f8644b-9729525e-859cd474_0
2025-09-30T14:52:17.016209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 756 sessionId: src_id|4c6c5a07-f6f8644b-9729525e-859cd474_0 is DEAD
2025-09-30T14:52:17.016376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c6c5a07-f6f8644b-9729525e-859cd474_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:17.016387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c6c5a07-f6f8644b-9729525e-859cd474_0] Write session will restart in 0.006328s
2025-09-30T14:52:17.016427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c6c5a07-f6f8644b-9729525e-859cd474_0] Write session: Do CDS request
2025-09-30T14:52:17.016432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c6c5a07-f6f8644b-9729525e-859cd474_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:17.023687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c6c5a07-f6f8644b-9729525e-859cd474_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:17.023757Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:17.023772Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 757
2025-09-30T14:52:17.023915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 757 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:17.023957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 757 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:17.023966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=757 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:17.023970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:17.024543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 757 sessionId:  describe result for acl check
2025-09-30T14:52:17.024578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:17.024585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:17.024588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:17.024594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895177118186839:6886] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:17.025141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895177118186839:6886] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:17.026483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:17.027095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895177118186839:6886] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:17.029470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:17.029658Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:17.029668Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:17.029680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:17.029736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:17.029757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895177118186839:6886] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:17.029777Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895177028457767:5666]
2025-09-30T14:52:17.029772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895177118186839:6886] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:17.029775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895177118186839:6886] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:17.029782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 757 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:17.030336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:17.030631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:17.030674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:17.030990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:17.031048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:17.031053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:17.031054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:17.031056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:17.031059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:17.031060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:17.031061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:17.031062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:17.031063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:17.031065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:17.031066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.031067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.031068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.031069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:17.031070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:17.031075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:17.031086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:17.031090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:17.031094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:17.031098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:17.031102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:17.031106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:17.031110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:17.031114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:17.031118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:17.031122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.031126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.031130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.031134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:17.031138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:17.031151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:17.031163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:17.031173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:17.031178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:17.031184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:17.031194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:17.031199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:17.031204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:17.031213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:17.031222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:17.031231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:17.031236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:17.031277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:17.031287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:17.031292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:17.031297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:17.031306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:17.031311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:17.031323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:17.031328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:17.031332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.031337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.031341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.031346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.031350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.031356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.031359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:17.031364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:17.031369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:17.031379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:17.031424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:17.036898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:17.038044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:17.038058Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:17.038060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:17.038064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:17.038071Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 756 [2:7555895177028457767:5666]
2025-09-30T14:52:17.038086Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:17.038103Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:17.038106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:17.038109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:17.038111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:17.038124Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:17.038130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:17.038136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:17.038189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.038198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.038200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.038204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:17.038206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:17.038273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:17.038281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.038294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.038311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.038346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:17.038369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895177118186794:2454], now have 1 active actors on pipe
2025-09-30T14:52:17.038377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895177118186877:6886], now have 1 active actors on pipe
2025-09-30T14:52:17.038383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895177028457761:5666]
2025-09-30T14:52:17.038385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895177028457761:5666]
2025-09-30T14:52:17.038387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895177028457761:5666]
2025-09-30T14:52:17.038398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:17.038410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:17.038430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:17.038438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:17.038451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:17.038455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:17.038457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:17.038467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895177028457761:5666]
2025-09-30T14:52:17.038470Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:17.038421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 756
2025-09-30T14:52:17.038422Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 756
2025-09-30T14:52:17.038483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:17.038519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:17.038528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:17.038551Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9ab8d3b-5fa2d59c-3630c1cb-6480489e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:17.038561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:17.038564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:17.038566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:17.038575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:17.038588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:17.038603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:17.038759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:17.038766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:17.038778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:17.038884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 757 partition: 0 MaxSeqNo: 42 sessionId: src_id|c9ab8d3b-5fa2d59c-3630c1cb-6480489e_0
2025-09-30T14:52:17.039195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c6c5a07-f6f8644b-9729525e-859cd474_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c9ab8d3b-5fa2d59c-3630c1cb-6480489e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:17.042046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9ab8d3b-5fa2d59c-3630c1cb-6480489e_0] Write session: try to update token
2025-09-30T14:52:17.042069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9ab8d3b-5fa2d59c-3630c1cb-6480489e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:17.050946Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:17.050967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:17.050977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895177028457761:5666]
2025-09-30T14:52:17.051012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:17.051022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:17.051201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:17.051371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:17.051534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:17.051701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:17.051882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:17.051919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:17.056326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 757 sessionId: src_id|c9ab8d3b-5fa2d59c-3630c1cb-6480489e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:17.058919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:17.059115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:17.059136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:17.059165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:17.059256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:17.062039Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:17.062056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:17.062058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:17.062063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:17.062071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895177028457761:5666]
2025-09-30T14:52:17.062075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895177028457761:5666]
2025-09-30T14:52:17.062079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895177028457761:5666]
2025-09-30T14:52:17.062113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:17.062118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.062120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:17.062144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:17.062158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:17.062162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:17.062238Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:17.116361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895177118186891:6573]
2025-09-30T14:52:17.116660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 756, pipe: [1:7555895177118186891:6573]
2025-09-30T14:52:17.170701Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:17.178627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:17.178659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:17.178831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:17.178905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:17.178976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:17.179044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:17.179090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:17.179101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:17.179171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:17.179236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:17.179329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:17.179402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:17.179450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:17.179459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:17.179532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:17.179594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:17.179662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:17.179733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:17.179777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:17.179785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:17.179854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:17.179926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:17.179993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:17.180058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:17.180101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:17.180109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:17.180178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:17.180246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:17.180316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:17.180380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:17.180431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:17.180445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:17.180511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:17.180576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:17.180642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:17.180711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:17.180753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:17.180761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:17.180833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:17.180898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:17.180963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:17.181028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:17.181073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:17.181080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:17.181149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:17.181211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:17.181274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:17.181340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:17.181384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:17.181392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:17.181460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:17.181521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:17.181584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:17.181653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:17.181699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:17.181706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:17.181773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:17.181835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:17.181904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:17.181979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:17.182024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:17.182032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:17.182108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895177118186891:6573], now have 1 active actors on pipe
2025-09-30T14:52:17.182373Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:17.182419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:17.182421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:17.182446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 757 reason: error at write: Disconnected sessionId: src_id|c9ab8d3b-5fa2d59c-3630c1cb-6480489e_0
2025-09-30T14:52:17.182601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 757 sessionId: src_id|c9ab8d3b-5fa2d59c-3630c1cb-6480489e_0 is DEAD
2025-09-30T14:52:17.182746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9ab8d3b-5fa2d59c-3630c1cb-6480489e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:17.182757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9ab8d3b-5fa2d59c-3630c1cb-6480489e_0] Write session will restart in 0.007082s
2025-09-30T14:52:17.182778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9ab8d3b-5fa2d59c-3630c1cb-6480489e_0] Write session: Do CDS request
2025-09-30T14:52:17.182784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9ab8d3b-5fa2d59c-3630c1cb-6480489e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:17.182861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895177118186891:6573]
2025-09-30T14:52:17.183291Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:17.190691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9ab8d3b-5fa2d59c-3630c1cb-6480489e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:17.190835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:17.190848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 758
2025-09-30T14:52:17.190944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 758 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:17.190968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 758 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:17.190971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=758 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:17.190974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:17.191371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 758 sessionId:  describe result for acl check
2025-09-30T14:52:17.191401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:17.191407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:17.191409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:17.191412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895177118186942:6896] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:17.191869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895177118186942:6896] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:17.193443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:17.193749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895177118186942:6896] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:17.196969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:17.197170Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:17.197184Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:17.197196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:17.197229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895177118186942:6896] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:17.197243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895177118186942:6896] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:17.197247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895177118186942:6896] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:17.197254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 758 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:17.197255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:17.197298Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895177028457870:5675]
2025-09-30T14:52:17.197915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:17.198259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:17.198309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:17.198626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:17.198711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:17.198718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:17.198719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:17.198720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:17.198721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:17.198722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:17.198723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:17.198724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:17.198725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:17.198726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:17.198727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.198728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.198729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.198730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:17.198731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:17.198736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:17.198745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:17.198749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:17.198753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:17.198757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:17.198761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:17.198765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:17.198769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:17.198772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:17.198776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:17.198780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.198784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.198787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.198791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:17.198795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:17.198804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:17.198812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:17.198817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:17.198823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:17.198829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:17.198834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:17.198837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:17.198842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:17.198846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:17.198851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:17.198854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:17.198858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:17.198862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:17.198866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:17.198870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:17.198875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:17.198879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:17.198884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:17.198888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:17.198893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:17.198897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.198901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.198905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.198910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.198921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.198926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.198930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:17.198935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:17.198945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:17.198950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:17.198992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:17.204557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:17.205762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:17.205779Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:17.205781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:17.205785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:17.205791Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 757 [2:7555895177028457870:5675]
2025-09-30T14:52:17.205806Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:17.205820Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:17.205823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:17.205825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:17.205827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:17.205842Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:17.205848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:17.205860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:17.205916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.205929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.205930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.205933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:17.205936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:17.205998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:17.206006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.206018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.206029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.206044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:17.206068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895177118186906:2454], now have 1 active actors on pipe
2025-09-30T14:52:17.206076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895177118186989:6896], now have 1 active actors on pipe
2025-09-30T14:52:17.206081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895177028457864:5675]
2025-09-30T14:52:17.206083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895177028457864:5675]
2025-09-30T14:52:17.206086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895177028457864:5675]
2025-09-30T14:52:17.206097Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:17.206111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:17.206115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:17.206122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:17.206124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:17.206128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:17.206131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:17.206161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895177028457864:5675]
2025-09-30T14:52:17.206169Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:17.206175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:17.206152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 757
2025-09-30T14:52:17.206195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:17.206204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:17.206187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 757
2025-09-30T14:52:17.206235Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd947c7-e21a39d0-b269b215-b73a735b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:17.206246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:17.206250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:17.206256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:17.206265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:17.206279Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:17.206303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:17.206463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:17.206472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:17.206487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:17.206564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 758 partition: 0 MaxSeqNo: 42 sessionId: src_id|bd947c7-e21a39d0-b269b215-b73a735b_0
2025-09-30T14:52:17.206905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9ab8d3b-5fa2d59c-3630c1cb-6480489e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bd947c7-e21a39d0-b269b215-b73a735b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:17.209584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd947c7-e21a39d0-b269b215-b73a735b_0] Write session: try to update token
2025-09-30T14:52:17.209602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd947c7-e21a39d0-b269b215-b73a735b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:17.218518Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:17.218547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:17.218551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:17.218554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:17.218565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895177028457864:5675]
2025-09-30T14:52:17.218570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895177028457864:5675]
2025-09-30T14:52:17.218577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895177028457864:5675]
2025-09-30T14:52:17.218626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:17.218629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:17.218633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:17.218637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.218637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:17.218639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:17.218880Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:17.224456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 758 sessionId: src_id|bd947c7-e21a39d0-b269b215-b73a735b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:17.227198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:17.283284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895177118187010:6573]
2025-09-30T14:52:17.283555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 757, pipe: [1:7555895177118187010:6573]
2025-09-30T14:52:17.331302Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:17.331556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:17.331575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:17.331612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895177118187010:6573], now have 1 active actors on pipe
2025-09-30T14:52:17.331797Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:17.331814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:17.331823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:17.331839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:17.331861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895177118187010:6573]
2025-09-30T14:52:17.331902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 758 reason: error at write: Disconnected sessionId: src_id|bd947c7-e21a39d0-b269b215-b73a735b_0
2025-09-30T14:52:17.332075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 758 sessionId: src_id|bd947c7-e21a39d0-b269b215-b73a735b_0 is DEAD
2025-09-30T14:52:17.332230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd947c7-e21a39d0-b269b215-b73a735b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:17.332242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd947c7-e21a39d0-b269b215-b73a735b_0] Write session will restart in 0.008997s
2025-09-30T14:52:17.332265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd947c7-e21a39d0-b269b215-b73a735b_0] Write session: Do CDS request
2025-09-30T14:52:17.332271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd947c7-e21a39d0-b269b215-b73a735b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:17.342102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:17.342769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd947c7-e21a39d0-b269b215-b73a735b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:17.342861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:17.342890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 759
2025-09-30T14:52:17.343034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 759 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:17.343070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 759 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:17.343077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=759 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:17.343096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:17.343535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 759 sessionId:  describe result for acl check
2025-09-30T14:52:17.343570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:17.343578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:17.343582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:17.343588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895177118187062:6901] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:17.344099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895177118187062:6901] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:17.345386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:17.345606Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:17.345615Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:17.345625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:17.345674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:17.345710Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895177028457982:5683]
2025-09-30T14:52:17.346054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895177118187062:6901] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:17.346372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:17.346705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:17.346757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:17.347080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:17.347139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:17.347145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:17.347146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:17.347147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:17.347148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:17.347149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:17.347151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:17.347152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:17.347153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:17.347154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:17.347155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.347157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.347158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.347159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:17.347160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:17.347165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:17.347175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:17.347179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:17.347183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:17.347187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:17.347191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:17.347195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:17.347199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:17.347203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:17.347208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:17.347212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.347216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.347220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.347224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:17.347228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:17.347235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:17.347259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:17.347265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:17.347271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:17.347276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:17.347281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:17.347286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:17.347291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:17.347296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:17.347301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:17.347305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:17.347310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:17.347315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:17.347320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:17.347325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:17.347330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:17.347340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:17.347345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:17.347353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:17.347359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:17.347368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.347374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.347382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.347388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.347397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.347402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.347412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:17.347417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:17.347428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:17.347433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:17.347477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:17.352669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895177118187062:6901] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:17.352691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895177118187062:6901] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:17.352694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895177118187062:6901] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:17.352703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 759 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:17.352851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:17.353717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:17.353734Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:17.353737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:17.353741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:17.353747Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 758 [2:7555895177028457982:5683]
2025-09-30T14:52:17.353765Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:17.353784Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:17.353787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:17.353790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:17.353793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:17.353808Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:17.353814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:17.353824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:17.353886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.353893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.353895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.353898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:17.353901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:17.353950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:17.353956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.353964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.353973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.353987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:17.354004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895177028457976:5683]
2025-09-30T14:52:17.354012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895177028457976:5683]
2025-09-30T14:52:17.354014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895177028457976:5683]
2025-09-30T14:52:17.354027Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:17.354041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895177118187012:2454], now have 1 active actors on pipe
2025-09-30T14:52:17.354041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:17.354045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:17.354048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:17.354049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895177118187101:6901], now have 1 active actors on pipe
2025-09-30T14:52:17.354053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:17.354063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:17.354070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:17.354102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895177028457976:5683]
2025-09-30T14:52:17.354111Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:17.354104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 758
2025-09-30T14:52:17.354110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 758
2025-09-30T14:52:17.354127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:17.354160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:17.354169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:17.354191Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|743c4f3c-d1980e1c-89100663-3b8bd7cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:17.354201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:17.354205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:17.354212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:17.354220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:17.354228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:17.354242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:17.354408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:17.354422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:17.354446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:17.354562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 759 partition: 0 MaxSeqNo: 42 sessionId: src_id|743c4f3c-d1980e1c-89100663-3b8bd7cc_0
2025-09-30T14:52:17.354919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd947c7-e21a39d0-b269b215-b73a735b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|743c4f3c-d1980e1c-89100663-3b8bd7cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:17.357602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|743c4f3c-d1980e1c-89100663-3b8bd7cc_0] Write session: try to update token
2025-09-30T14:52:17.357623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|743c4f3c-d1980e1c-89100663-3b8bd7cc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:17.366566Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:17.366597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:17.366601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:17.366604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:17.366614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895177028457976:5683]
2025-09-30T14:52:17.366619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895177028457976:5683]
2025-09-30T14:52:17.366630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895177028457976:5683]
2025-09-30T14:52:17.366685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:17.366688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:17.366694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:17.366698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:17.366701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.366704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:17.366907Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:17.372052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 759 sessionId: src_id|743c4f3c-d1980e1c-89100663-3b8bd7cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:17.374897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:17.432270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895177118187108:6573]
2025-09-30T14:52:17.432530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 758, pipe: [1:7555895177118187108:6573]
2025-09-30T14:52:17.473002Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:17.473574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:17.473590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:17.473624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895177118187108:6573], now have 1 active actors on pipe
2025-09-30T14:52:17.473800Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:17.473827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:17.473878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:17.473883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895177118187108:6573]
2025-09-30T14:52:17.473949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 759 reason: status is not ok: tablet will be restarted right now sessionId: src_id|743c4f3c-d1980e1c-89100663-3b8bd7cc_0
2025-09-30T14:52:17.474128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 759 sessionId: src_id|743c4f3c-d1980e1c-89100663-3b8bd7cc_0 is DEAD
2025-09-30T14:52:17.474289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|743c4f3c-d1980e1c-89100663-3b8bd7cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:17.474301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|743c4f3c-d1980e1c-89100663-3b8bd7cc_0] Write session will restart in 0.006192s
2025-09-30T14:52:17.474323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|743c4f3c-d1980e1c-89100663-3b8bd7cc_0] Write session: Do CDS request
2025-09-30T14:52:17.474341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|743c4f3c-d1980e1c-89100663-3b8bd7cc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:17.481760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|743c4f3c-d1980e1c-89100663-3b8bd7cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:17.481832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:17.481856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 760
2025-09-30T14:52:17.482032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 760 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:17.482074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 760 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:17.482083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=760 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:17.482088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:17.482502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 760 sessionId:  describe result for acl check
2025-09-30T14:52:17.482534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:17.482540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:17.482542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:17.482547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895177118187160:6906] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:17.483079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895177118187160:6906] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:17.483699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:17.485382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895177118187160:6906] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:17.486978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:17.487184Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:17.487202Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:17.487213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:17.487292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:17.487336Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895177028458072:5685]
2025-09-30T14:52:17.487725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895177118187160:6906] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:17.487738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895177118187160:6906] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:17.487741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895177118187160:6906] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:17.487750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 760 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:17.488023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:17.488296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:17.488347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:17.488668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:17.488743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:17.488751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:17.488752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:17.488753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:17.488754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:17.488756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:17.488757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:17.488758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:17.488759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:17.488761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:17.488762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.488764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.488766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.488767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:17.488768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:17.488774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:17.488784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:17.488789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:17.488794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:17.488798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:17.488803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:17.488807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:17.488811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:17.488816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:17.488820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:17.488824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.488828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.488832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.488836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:17.488840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:17.488847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:17.488856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:17.488861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:17.488867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:17.488872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:17.488877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:17.488882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:17.488887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:17.488898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:17.488904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:17.488909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:17.488919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:17.488926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:17.488931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:17.488936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:17.488941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:17.488946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:17.488956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:17.488960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:17.488970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:17.488975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.488984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.488989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.488994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.489002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.489007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.489011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:17.489016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:17.489021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:17.489026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:17.489074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:17.494500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:17.495394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:17.495414Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:17.495417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:17.495421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:17.495428Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 759 [2:7555895177028458072:5685]
2025-09-30T14:52:17.495445Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:17.495460Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:17.495469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:17.495473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:17.495475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:17.495494Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:17.495505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:17.495517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:17.495582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.495590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.495592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.495595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:17.495598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:17.495665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:17.495673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.495687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.495699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.495718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:17.495851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 759
2025-09-30T14:52:17.495861Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 759
2025-09-30T14:52:17.495736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895177118187198:6906], now have 1 active actors on pipe
2025-09-30T14:52:17.495747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895177028458066:5685]
2025-09-30T14:52:17.495751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895177028458066:5685]
2025-09-30T14:52:17.495753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895177028458066:5685]
2025-09-30T14:52:17.495765Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:17.495774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895177118187110:2454], now have 1 active actors on pipe
2025-09-30T14:52:17.495778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:17.495782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:17.495782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:17.495784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:17.495799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:17.495802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:17.495833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895177028458066:5685]
2025-09-30T14:52:17.495840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:17.495846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:17.495935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:17.495942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:17.495971Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0faf681-37127268-a41fcf76-8b6c98a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:17.495977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:17.495981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:17.495984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:17.495993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:17.496003Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:17.496018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:17.496205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:17.496219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:17.496239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:17.496326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 760 partition: 0 MaxSeqNo: 42 sessionId: src_id|e0faf681-37127268-a41fcf76-8b6c98a8_0
2025-09-30T14:52:17.496669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|743c4f3c-d1980e1c-89100663-3b8bd7cc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e0faf681-37127268-a41fcf76-8b6c98a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:17.499293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0faf681-37127268-a41fcf76-8b6c98a8_0] Write session: try to update token
2025-09-30T14:52:17.499307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0faf681-37127268-a41fcf76-8b6c98a8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:17.507947Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:17.507976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:17.507978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:17.507980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:17.507990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895177028458066:5685]
2025-09-30T14:52:17.507995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895177028458066:5685]
2025-09-30T14:52:17.507999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895177028458066:5685]
2025-09-30T14:52:17.508044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:17.508052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.508055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:17.508060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:17.508068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:17.508072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:17.508193Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:17.514317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 760 sessionId: src_id|e0faf681-37127268-a41fcf76-8b6c98a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:17.516933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:17.574097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895177118187209:6573]
2025-09-30T14:52:17.574368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 759, pipe: [1:7555895177118187209:6573]
2025-09-30T14:52:17.627471Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:17.628153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:17.628171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:17.628207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895177118187209:6573], now have 1 active actors on pipe
2025-09-30T14:52:17.628403Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:17.628420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:17.628422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895177118187209:6573]
2025-09-30T14:52:17.628446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:17.628448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:17.628515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 760 reason: error at write: Disconnected sessionId: src_id|e0faf681-37127268-a41fcf76-8b6c98a8_0
2025-09-30T14:52:17.628670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 760 sessionId: src_id|e0faf681-37127268-a41fcf76-8b6c98a8_0 is DEAD
2025-09-30T14:52:17.628787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0faf681-37127268-a41fcf76-8b6c98a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:17.628797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0faf681-37127268-a41fcf76-8b6c98a8_0] Write session will restart in 0.006027s
2025-09-30T14:52:17.628820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0faf681-37127268-a41fcf76-8b6c98a8_0] Write session: Do CDS request
2025-09-30T14:52:17.628825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0faf681-37127268-a41fcf76-8b6c98a8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:17.635656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0faf681-37127268-a41fcf76-8b6c98a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:17.635751Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:17.635778Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 761
2025-09-30T14:52:17.635918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 761 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:17.635948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 761 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:17.635958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=761 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:17.635961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:17.636416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 761 sessionId:  describe result for acl check
2025-09-30T14:52:17.636457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:17.636459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:17.636461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:17.636469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895177118187236:6910] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:17.637071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895177118187236:6910] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:17.638702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:17.638771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895177118187236:6910] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:17.641988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:17.642188Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:17.642208Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:17.642220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:17.642264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895177118187236:6910] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:17.642277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895177118187236:6910] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:17.642280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895177118187236:6910] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:17.642287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 761 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:17.642284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:17.642338Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895177028458165:5688]
2025-09-30T14:52:17.642967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:17.643300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:17.643357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:17.643695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:17.643766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:17.643772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:17.643773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:17.643774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:17.643775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:17.643776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:17.643777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:17.643779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:17.643780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:17.643781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:17.643782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.643784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.643785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.643786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:17.643787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:17.643793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:17.643804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:17.643809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:17.643813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:17.643817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:17.643822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:17.643826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:17.643830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:17.643834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:17.643839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:17.643843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.643847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.643851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.643855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:17.643860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:17.643869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:17.643877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:17.643883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:17.643888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:17.643892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:17.643897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:17.643902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:17.643907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:17.643912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:17.643917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:17.643922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:17.643927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:17.643931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:17.643937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:17.643941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:17.643946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:17.643952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:17.643958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:17.643963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:17.643968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:17.643973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.643985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.643990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.643999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.644003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.644008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.644017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:17.644022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:17.644026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:17.644035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:17.644079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:17.649405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:17.650226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:17.650242Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:17.650244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:17.650248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:17.650254Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 760 [2:7555895177028458165:5688]
2025-09-30T14:52:17.650270Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:17.650284Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:17.650291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:17.650295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:17.650297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:17.650311Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:17.650317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:17.650324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:17.650384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.650391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.650393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.650397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:17.650400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:17.650460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:17.650468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.650479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.650496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.650518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:17.650540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895177118187211:2454], now have 1 active actors on pipe
2025-09-30T14:52:17.650548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895177118187298:6910], now have 1 active actors on pipe
2025-09-30T14:52:17.650554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895177028458159:5688]
2025-09-30T14:52:17.650556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895177028458159:5688]
2025-09-30T14:52:17.650559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895177028458159:5688]
2025-09-30T14:52:17.650571Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:17.650586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:17.650589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:17.650596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:17.650599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:17.650604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:17.650607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:17.650633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895177028458159:5688]
2025-09-30T14:52:17.650641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:17.650602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 760
2025-09-30T14:52:17.650644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:17.650630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 760
2025-09-30T14:52:17.650660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:17.650664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:17.650708Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2748c611-4be912a1-652d2e2-f938dfaf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:17.650722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:17.650726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:17.650728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:17.650737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:17.650747Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:17.650765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:17.650924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:17.650935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:17.650950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:17.651024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 761 partition: 0 MaxSeqNo: 42 sessionId: src_id|2748c611-4be912a1-652d2e2-f938dfaf_0
2025-09-30T14:52:17.651376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0faf681-37127268-a41fcf76-8b6c98a8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2748c611-4be912a1-652d2e2-f938dfaf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:17.654173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2748c611-4be912a1-652d2e2-f938dfaf_0] Write session: try to update token
2025-09-30T14:52:17.654191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2748c611-4be912a1-652d2e2-f938dfaf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:17.662360Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:17.662381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:17.662382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:17.662384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:17.662391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895177028458159:5688]
2025-09-30T14:52:17.662395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895177028458159:5688]
2025-09-30T14:52:17.662401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895177028458159:5688]
2025-09-30T14:52:17.662432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:17.662437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.662439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:17.662449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:17.662457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:17.662477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:17.662555Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:17.667917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 761 sessionId: src_id|2748c611-4be912a1-652d2e2-f938dfaf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:17.670638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:17.728719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895177118187309:6573]
2025-09-30T14:52:17.728934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 760, pipe: [1:7555895177118187309:6573]
2025-09-30T14:52:17.768963Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:17.769477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:17.769492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:17.769528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895177118187309:6573], now have 1 active actors on pipe
2025-09-30T14:52:17.769732Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:17.769748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:17.769761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:17.769779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895177118187309:6573]
2025-09-30T14:52:17.769803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:17.769823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 761 reason: error at write: Disconnected sessionId: src_id|2748c611-4be912a1-652d2e2-f938dfaf_0
2025-09-30T14:52:17.769977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 761 sessionId: src_id|2748c611-4be912a1-652d2e2-f938dfaf_0 is DEAD
2025-09-30T14:52:17.770134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2748c611-4be912a1-652d2e2-f938dfaf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:17.770143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2748c611-4be912a1-652d2e2-f938dfaf_0] Write session will restart in 0.009423s
2025-09-30T14:52:17.770164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2748c611-4be912a1-652d2e2-f938dfaf_0] Write session: Do CDS request
2025-09-30T14:52:17.770173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2748c611-4be912a1-652d2e2-f938dfaf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:17.780084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:17.780738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2748c611-4be912a1-652d2e2-f938dfaf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:17.780829Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:17.780847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 762
2025-09-30T14:52:17.780976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 762 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:17.781009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 762 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:17.781014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=762 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:17.781023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:17.781478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 762 sessionId:  describe result for acl check
2025-09-30T14:52:17.781515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:17.781525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:17.781527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:17.781533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895177118187364:6914] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:17.782077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895177118187364:6914] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:17.783319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:17.783484Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:17.783492Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:17.783500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:17.783540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:17.783585Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895177028458257:5690]
2025-09-30T14:52:17.784203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:17.784211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895177118187364:6914] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:17.784533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:17.784569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:17.784838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:17.784884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:17.784888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:17.784889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:17.784889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:17.784890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:17.784891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:17.784892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:17.784892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:17.784893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:17.784895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:17.784896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.784897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.784897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.784898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:17.784898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:17.784902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:17.784908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:17.784911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:17.784913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:17.784915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:17.784918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:17.784920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:17.784922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:17.784925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:17.784927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:17.784929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.784931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.784934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.784936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:17.784938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:17.784944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:17.784951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:17.784958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:17.784963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:17.784968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:17.784974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:17.784978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:17.784983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:17.784988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:17.784993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:17.784996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:17.784999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:17.785001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:17.785004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:17.785006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:17.785009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:17.785012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:17.785014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:17.785017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:17.785020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:17.785023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.785026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.785028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.785031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.785033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.785036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.785038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:17.785041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:17.785043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:17.785046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:17.785069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:17.790070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895177118187364:6914] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:17.790090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895177118187364:6914] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:17.790093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895177118187364:6914] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:17.790102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 762 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:17.790345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:17.791179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:17.791194Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:17.791196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:17.791198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:17.791203Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 761 [2:7555895177028458257:5690]
2025-09-30T14:52:17.791215Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:17.791226Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:17.791228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:17.791230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:17.791231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:17.791257Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:17.791261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:17.791266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:17.791307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.791314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.791315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.791317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:17.791319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:17.791375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:17.791383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.791394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.791409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.791430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:17.791451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895177118187310:2454], now have 1 active actors on pipe
2025-09-30T14:52:17.791457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895177118187402:6914], now have 1 active actors on pipe
2025-09-30T14:52:17.791462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895177028458251:5690]
2025-09-30T14:52:17.791464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895177028458251:5690]
2025-09-30T14:52:17.791465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895177028458251:5690]
2025-09-30T14:52:17.791473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:17.791484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:17.791488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:17.791491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:17.791493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:17.791504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:17.791481Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 761
2025-09-30T14:52:17.791507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:17.791505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 761
2025-09-30T14:52:17.791534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895177028458251:5690]
2025-09-30T14:52:17.791548Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:17.791554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:17.791564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:17.791572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:17.791609Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa65df9c-c11be2f3-7c3d9de3-12f5d94d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:17.791620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:17.791624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:17.791630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:17.791638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:17.791651Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:17.791675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:17.791862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:17.791878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:17.791911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:17.791993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 762 partition: 0 MaxSeqNo: 42 sessionId: src_id|aa65df9c-c11be2f3-7c3d9de3-12f5d94d_0
2025-09-30T14:52:17.792349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2748c611-4be912a1-652d2e2-f938dfaf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|aa65df9c-c11be2f3-7c3d9de3-12f5d94d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:17.795106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa65df9c-c11be2f3-7c3d9de3-12f5d94d_0] Write session: try to update token
2025-09-30T14:52:17.795125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa65df9c-c11be2f3-7c3d9de3-12f5d94d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:17.803541Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:17.803559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:17.803562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:17.803564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:17.803574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895177028458251:5690]
2025-09-30T14:52:17.803578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895177028458251:5690]
2025-09-30T14:52:17.803583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895177028458251:5690]
2025-09-30T14:52:17.803625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:17.803631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.803634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:17.803638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:17.803645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:17.803649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:17.803769Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:17.809464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 762 sessionId: src_id|aa65df9c-c11be2f3-7c3d9de3-12f5d94d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:17.812230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:17.870035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895177118187410:6573]
2025-09-30T14:52:17.870298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 761, pipe: [1:7555895177118187410:6573]
2025-09-30T14:52:17.909072Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:17.909801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:17.909821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:17.909864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895177118187410:6573], now have 1 active actors on pipe
2025-09-30T14:52:17.910084Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:17.910096Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:17.910101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895177118187410:6573]
2025-09-30T14:52:17.910126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:17.910129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:17.910199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 762 reason: error at write: Disconnected sessionId: src_id|aa65df9c-c11be2f3-7c3d9de3-12f5d94d_0
2025-09-30T14:52:17.910379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 762 sessionId: src_id|aa65df9c-c11be2f3-7c3d9de3-12f5d94d_0 is DEAD
2025-09-30T14:52:17.910519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa65df9c-c11be2f3-7c3d9de3-12f5d94d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:17.910531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa65df9c-c11be2f3-7c3d9de3-12f5d94d_0] Write session will restart in 0.008301s
2025-09-30T14:52:17.910554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa65df9c-c11be2f3-7c3d9de3-12f5d94d_0] Write session: Do CDS request
2025-09-30T14:52:17.910560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa65df9c-c11be2f3-7c3d9de3-12f5d94d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:17.919751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa65df9c-c11be2f3-7c3d9de3-12f5d94d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:17.919846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:17.919864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 763
2025-09-30T14:52:17.920008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 763 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:17.920054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 763 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:17.920068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=763 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:17.920072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:17.920475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 763 sessionId:  describe result for acl check
2025-09-30T14:52:17.920506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:17.920511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:17.920513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:17.920518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895177118187463:6918] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:17.920979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895177118187463:6918] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:17.921367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:17.923195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895177118187463:6918] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:17.924688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:17.924901Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:17.924914Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:17.924928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:17.925006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:17.925044Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895177028458350:5692]
2025-09-30T14:52:17.925411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895177118187463:6918] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:17.925424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895177118187463:6918] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:17.925427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895177118187463:6918] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:17.925434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 763 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:17.925712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:17.926018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:17.926058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:17.926394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:17.926471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:17.926478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:17.926479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:17.926480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:17.926481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:17.926483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:17.926484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:17.926485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:17.926487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:17.926488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:17.926489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.926490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.926491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.926493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:17.926494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:17.926499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:17.926505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:17.926508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:17.926510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:17.926513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:17.926515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:17.926517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:17.926520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:17.926522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:17.926526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:17.926530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.926534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.926538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.926543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:17.926546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:17.926555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:17.926561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:17.926565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:17.926568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:17.926571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:17.926574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:17.926576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:17.926579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:17.926581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:17.926584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:17.926586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:17.926590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:17.926594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:17.926599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:17.926602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:17.926607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:17.926612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:17.926617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:17.926621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:17.926626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:17.926629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.926632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.926634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.926638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.926640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.926643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.926646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:17.926651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:17.926656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:17.926661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:17.926702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:17.932167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:17.933064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:17.933081Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:17.933084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:17.933088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:17.933094Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 762 [2:7555895177028458350:5692]
2025-09-30T14:52:17.933110Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:17.933125Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:17.933128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:17.933131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:17.933133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:17.933151Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:17.933157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:17.933164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:17.933224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.933226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.933228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.933232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:17.933234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:17.933433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 762
2025-09-30T14:52:17.933453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 762
2025-09-30T14:52:17.933549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:17.933562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.933576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:17.933588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:17.933608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:17.933635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895177118187500:6918], now have 1 active actors on pipe
2025-09-30T14:52:17.933644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895177118187411:2454], now have 1 active actors on pipe
2025-09-30T14:52:17.933657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:17.933662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:17.933682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895177028458344:5692]
2025-09-30T14:52:17.933689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895177028458344:5692]
2025-09-30T14:52:17.933691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895177028458344:5692]
2025-09-30T14:52:17.933703Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:17.933718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:17.933721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:17.933731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:17.933734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:17.933736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:17.933739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:17.933756Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39d4f7d4-308e7cb9-467a7021-7472896a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:17.933764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:17.933768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:17.933770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:17.933778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:17.933793Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:17.933827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895177028458344:5692]
2025-09-30T14:52:17.933840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:17.933848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:17.933854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:17.934031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:17.934047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:17.934071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:17.934144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 763 partition: 0 MaxSeqNo: 42 sessionId: src_id|39d4f7d4-308e7cb9-467a7021-7472896a_0
2025-09-30T14:52:17.934474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa65df9c-c11be2f3-7c3d9de3-12f5d94d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|39d4f7d4-308e7cb9-467a7021-7472896a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:17.937317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39d4f7d4-308e7cb9-467a7021-7472896a_0] Write session: try to update token
2025-09-30T14:52:17.937335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39d4f7d4-308e7cb9-467a7021-7472896a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:17.945604Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:17.945623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:17.945632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895177028458344:5692]
2025-09-30T14:52:17.945661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:17.945674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:17.945830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:17.945961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:17.946093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:17.946228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:17.946656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:17.946708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:17.952563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 763 sessionId: src_id|39d4f7d4-308e7cb9-467a7021-7472896a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:17.954960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:17.956055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:17.956083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:17.956104Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:17.956107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:17.956110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:17.956112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:17.956120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895177028458344:5692]
2025-09-30T14:52:17.956123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895177028458344:5692]
2025-09-30T14:52:17.956126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895177028458344:5692]
2025-09-30T14:52:17.956163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:17.956173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:17.956174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:17.956178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:17.956193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:17.956198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:17.956288Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:18.010275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895181413154836:6573]
2025-09-30T14:52:18.010661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 762, pipe: [1:7555895181413154836:6573]
2025-09-30T14:52:18.063445Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:18.064000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:18.064042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895181413154836:6573], now have 1 active actors on pipe
2025-09-30T14:52:18.064139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:18.064195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:18.064253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:18.064262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:18.064268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895181413154836:6573]
2025-09-30T14:52:18.064338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 763 reason: error at write: Disconnected sessionId: src_id|39d4f7d4-308e7cb9-467a7021-7472896a_0
2025-09-30T14:52:18.064483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 763 sessionId: src_id|39d4f7d4-308e7cb9-467a7021-7472896a_0 is DEAD
2025-09-30T14:52:18.064624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39d4f7d4-308e7cb9-467a7021-7472896a_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 130 BytesWritten: 94617674 MessagesWritten: 42 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 13516812 MessagesInflight: 10 }
2025-09-30T14:52:18.064653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39d4f7d4-308e7cb9-467a7021-7472896a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:18.064657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39d4f7d4-308e7cb9-467a7021-7472896a_0] Write session will restart in 0.009103s
2025-09-30T14:52:18.064677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39d4f7d4-308e7cb9-467a7021-7472896a_0] Write session: Do CDS request
2025-09-30T14:52:18.064683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39d4f7d4-308e7cb9-467a7021-7472896a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:18.074802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39d4f7d4-308e7cb9-467a7021-7472896a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:18.074867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:18.074894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 764
2025-09-30T14:52:18.075019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 764 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:18.075051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 764 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:18.075061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=764 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:18.075064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:18.075222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:18.075496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 764 sessionId:  describe result for acl check
2025-09-30T14:52:18.075528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:18.075534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:18.075536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:18.075542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895181413154897:6933] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:18.076072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895181413154897:6933] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:18.078348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895181413154897:6933] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:18.078662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:18.078884Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:18.078895Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:18.078905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:18.078955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:18.078993Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895181323425752:5695]
2025-09-30T14:52:18.079618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:18.079959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:18.080032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:18.080334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:18.080414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:18.080420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:18.080422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:18.080423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:18.080424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:18.080425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:18.080426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:18.080428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:18.080429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:18.080430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:18.080432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.080433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.080434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.080435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:18.080436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:18.080442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:18.080454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:18.080459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:18.080464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:18.080468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:18.080472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:18.080476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:18.080481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:18.080485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:18.080489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:18.080494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.080498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.080502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.080511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:18.080516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:18.080524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:18.080536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:18.080546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:18.080553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:18.080561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:18.080567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:18.080575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:18.080581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:18.080589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:18.080594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:18.080602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:18.080608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:18.080616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:18.080622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:18.080630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:18.080635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:18.080640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:18.080648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:18.080653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:18.080662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:18.080667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.080671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.080678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.080683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.080692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.080698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.080705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:18.080721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:18.080730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:18.080735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:18.080781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:18.081118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895181413154897:6933] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:18.081132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895181413154897:6933] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:18.081145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895181413154897:6933] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:18.081153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 764 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:18.085908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:18.087041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:18.087055Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:18.087060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:18.087062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:18.087067Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 763 [2:7555895181323425752:5695]
2025-09-30T14:52:18.087080Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:18.087093Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:18.087095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:18.087097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:18.087098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:18.087111Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:18.087120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:18.087129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:18.087175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.087180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.087181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.087183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:18.087184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:18.087234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:18.087240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.087271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.087282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.087296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:18.087313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895181323425745:5695]
2025-09-30T14:52:18.087317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895181323425745:5695]
2025-09-30T14:52:18.087319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895181323425745:5695]
2025-09-30T14:52:18.087326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:18.087335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895181413154843:2454], now have 1 active actors on pipe
2025-09-30T14:52:18.087341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895181413154936:6933], now have 1 active actors on pipe
2025-09-30T14:52:18.087347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:18.087346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:18.087350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:18.087352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:18.087356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:18.087358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:18.087385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895181323425745:5695]
2025-09-30T14:52:18.087393Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:18.087407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:18.087414Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 763
2025-09-30T14:52:18.087424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 763
2025-09-30T14:52:18.087482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:18.087489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:18.087509Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9fb341c1-3e743be4-31dc6ce5-1994e186_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:18.087514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:18.087516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:18.087517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:18.087524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:18.087531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:18.087540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:18.087674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:18.087702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:18.087729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:18.087831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 764 partition: 0 MaxSeqNo: 42 sessionId: src_id|9fb341c1-3e743be4-31dc6ce5-1994e186_0
2025-09-30T14:52:18.088143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39d4f7d4-308e7cb9-467a7021-7472896a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9fb341c1-3e743be4-31dc6ce5-1994e186_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:18.090906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fb341c1-3e743be4-31dc6ce5-1994e186_0] Write session: try to update token
2025-09-30T14:52:18.090927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fb341c1-3e743be4-31dc6ce5-1994e186_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:18.099132Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:18.099155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:18.099163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895181323425745:5695]
2025-09-30T14:52:18.099207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:18.099205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:18.099387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:18.099523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:18.099652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:18.099783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:18.099950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:18.099991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:18.104265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 764 sessionId: src_id|9fb341c1-3e743be4-31dc6ce5-1994e186_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:18.106810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:18.107026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:18.107050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:18.107088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:18.107177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:18.109409Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:18.109426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:18.109428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:18.109430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:18.109440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895181323425745:5695]
2025-09-30T14:52:18.109444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895181323425745:5695]
2025-09-30T14:52:18.109449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895181323425745:5695]
2025-09-30T14:52:18.109489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:18.109493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:18.109498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:18.109501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.109504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:18.109510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:18.109637Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:18.164395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895181413154944:6573]
2025-09-30T14:52:18.164654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 763, pipe: [1:7555895181413154944:6573]
2025-09-30T14:52:18.215578Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:18.223835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:18.223867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:18.224027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:18.224094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:18.224158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:18.224223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:18.224272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:18.224284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:18.224351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:18.224417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:18.224474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:18.224552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:18.224603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:18.224611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:18.224680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:18.224742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:18.224805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:18.224869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:18.224913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:18.224921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:18.224986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:18.225051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:18.225112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:18.225176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:18.225219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:18.225227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:18.225293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:18.225355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:18.225417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:18.225480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:18.225533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:18.225542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:18.225608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:18.225668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:18.225735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:18.225805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:18.225848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:18.225855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:18.225922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:18.225985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:18.226054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:18.226119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:18.226178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:18.226185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:18.226251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:18.226316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:18.226390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:18.226457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:18.226503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:18.226511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:18.226576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:18.226638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:18.226700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:18.226764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:18.226808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:18.226816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:18.226883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:18.226947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:18.227011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:18.227077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:18.227121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:18.227130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:18.227200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895181413154944:6573], now have 1 active actors on pipe
2025-09-30T14:52:18.227446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895181413154944:6573]
2025-09-30T14:52:18.227482Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:18.227515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:18.227519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:18.227556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 764 reason: error at write: Disconnected sessionId: src_id|9fb341c1-3e743be4-31dc6ce5-1994e186_0
2025-09-30T14:52:18.227720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 764 sessionId: src_id|9fb341c1-3e743be4-31dc6ce5-1994e186_0 is DEAD
2025-09-30T14:52:18.227866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fb341c1-3e743be4-31dc6ce5-1994e186_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:18.227878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fb341c1-3e743be4-31dc6ce5-1994e186_0] Write session will restart in 0.005782s
2025-09-30T14:52:18.227901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fb341c1-3e743be4-31dc6ce5-1994e186_0] Write session: Do CDS request
2025-09-30T14:52:18.227907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fb341c1-3e743be4-31dc6ce5-1994e186_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:18.228163Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:18.234785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fb341c1-3e743be4-31dc6ce5-1994e186_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:18.234803Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:18.234817Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 765
2025-09-30T14:52:18.234955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 765 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:18.234994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 765 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:18.235002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=765 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:18.235005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:18.235390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 765 sessionId:  describe result for acl check
2025-09-30T14:52:18.235430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:18.235436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:18.235438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:18.235444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895181413154972:6943] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:18.235978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895181413154972:6943] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:18.238710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895181413154972:6943] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:18.239320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:18.242630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:18.242832Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:18.242844Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:18.242854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:18.242908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:18.242947Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895181323425860:5704]
2025-09-30T14:52:18.243000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895181413154972:6943] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:18.243019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895181413154972:6943] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:18.243023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895181413154972:6943] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:18.243030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 765 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:18.243659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:18.243945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:18.243992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:18.244330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:18.244395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:18.244402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:18.244403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:18.244404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:18.244405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:18.244407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:18.244408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:18.244409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:18.244410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:18.244412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:18.244413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.244414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.244416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.244417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:18.244418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:18.244424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:18.244435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:18.244439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:18.244443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:18.244447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:18.244451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:18.244455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:18.244458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:18.244462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:18.244467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:18.244471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.244475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.244479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.244484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:18.244488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:18.244495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:18.244503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:18.244509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:18.244516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:18.244520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:18.244526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:18.244531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:18.244537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:18.244542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:18.244547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:18.244551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:18.244556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:18.244561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:18.244567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:18.244577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:18.244583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:18.244588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:18.244595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:18.244599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:18.244605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:18.244610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.244620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.244624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.244630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.244638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.244642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.244646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:18.244651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:18.244657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:18.244661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:18.244709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:18.250222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:18.251057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:18.251075Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:18.251078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:18.251083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:18.251090Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 764 [2:7555895181323425860:5704]
2025-09-30T14:52:18.251107Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:18.251121Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:18.251128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:18.251131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:18.251134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:18.251148Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:18.251160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:18.251167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:18.251540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.251549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.251552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.251555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:18.251558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:18.251629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:18.251636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.251650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.251668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.251694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:18.251712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895181413155048:6943], now have 1 active actors on pipe
2025-09-30T14:52:18.251721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895181413154958:2454], now have 1 active actors on pipe
2025-09-30T14:52:18.251728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895181323425854:5704]
2025-09-30T14:52:18.251731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895181323425854:5704]
2025-09-30T14:52:18.251733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895181323425854:5704]
2025-09-30T14:52:18.251745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:18.251784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 764
2025-09-30T14:52:18.251757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:18.251760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:18.251830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 764
2025-09-30T14:52:18.251766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:18.251776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:18.251779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:18.251781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:18.251810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895181323425854:5704]
2025-09-30T14:52:18.251813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:18.251824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:18.251838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:18.251842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:18.251876Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aee9d1a6-7a7466b4-db0ad174-e1064b96_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:18.251889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:18.251893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:18.251900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:18.251909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:18.251918Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:18.251941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:18.252082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:18.252090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:18.252103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:18.252169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 765 partition: 0 MaxSeqNo: 42 sessionId: src_id|aee9d1a6-7a7466b4-db0ad174-e1064b96_0
2025-09-30T14:52:18.252514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fb341c1-3e743be4-31dc6ce5-1994e186_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|aee9d1a6-7a7466b4-db0ad174-e1064b96_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:18.255374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aee9d1a6-7a7466b4-db0ad174-e1064b96_0] Write session: try to update token
2025-09-30T14:52:18.255393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aee9d1a6-7a7466b4-db0ad174-e1064b96_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:18.264767Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:18.264783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:18.264784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:18.264786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:18.264794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895181323425854:5704]
2025-09-30T14:52:18.264798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895181323425854:5704]
2025-09-30T14:52:18.264801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895181323425854:5704]
2025-09-30T14:52:18.264833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:18.264839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.264842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:18.264855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:18.264862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:18.264867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:18.264969Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:18.269182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 765 sessionId: src_id|aee9d1a6-7a7466b4-db0ad174-e1064b96_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:18.271822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:18.327742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895181413155070:6573]
2025-09-30T14:52:18.328012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 764, pipe: [1:7555895181413155070:6573]
2025-09-30T14:52:18.369926Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:18.370445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:18.370462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:18.370501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895181413155070:6573], now have 1 active actors on pipe
2025-09-30T14:52:18.370776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:18.370790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:18.370790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895181413155070:6573]
2025-09-30T14:52:18.370811Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:18.370851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 765 reason: error at write: Disconnected sessionId: src_id|aee9d1a6-7a7466b4-db0ad174-e1064b96_0
2025-09-30T14:52:18.371009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 765 sessionId: src_id|aee9d1a6-7a7466b4-db0ad174-e1064b96_0 is DEAD
2025-09-30T14:52:18.371044Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:18.371156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aee9d1a6-7a7466b4-db0ad174-e1064b96_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:18.371169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aee9d1a6-7a7466b4-db0ad174-e1064b96_0] Write session will restart in 0.006281s
2025-09-30T14:52:18.371191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aee9d1a6-7a7466b4-db0ad174-e1064b96_0] Write session: Do CDS request
2025-09-30T14:52:18.371197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aee9d1a6-7a7466b4-db0ad174-e1064b96_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:18.378765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aee9d1a6-7a7466b4-db0ad174-e1064b96_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:18.378834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:18.378850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 766
2025-09-30T14:52:18.378974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 766 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:18.379009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 766 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:18.379023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=766 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:18.379031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:18.379508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 766 sessionId:  describe result for acl check
2025-09-30T14:52:18.379545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:18.379549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:18.379551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:18.379557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895181413155120:6948] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:18.380271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895181413155120:6948] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:18.381835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:18.382420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895181413155120:6948] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:18.384701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:18.384894Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:18.384903Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:18.384914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:18.384976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:18.385030Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895181323425978:5712]
2025-09-30T14:52:18.385072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895181413155120:6948] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:18.385084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895181413155120:6948] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:18.385087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895181413155120:6948] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:18.385095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 766 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:18.385652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:18.385941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:18.385983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:18.386291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:18.386359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:18.386366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:18.386367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:18.386368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:18.386369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:18.386370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:18.386371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:18.386372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:18.386374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:18.386375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:18.386376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.386377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.386378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.386380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:18.386381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:18.386385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:18.386395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:18.386399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:18.386403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:18.386408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:18.386412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:18.386416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:18.386420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:18.386424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:18.386429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:18.386433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.386437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.386441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.386445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:18.386449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:18.386456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:18.386465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:18.386471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:18.386476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:18.386482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:18.386487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:18.386491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:18.386496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:18.386501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:18.386506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:18.386510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:18.386515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:18.386520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:18.386525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:18.386529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:18.386534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:18.386538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:18.386543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:18.386547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:18.386552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:18.386557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.386562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.386566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.386571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.386579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.386585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.386589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:18.386594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:18.386598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:18.386603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:18.386647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:18.391823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:18.392711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:18.392722Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:18.392724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:18.392727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:18.392733Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 765 [2:7555895181323425978:5712]
2025-09-30T14:52:18.392746Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:18.392759Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:18.392761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:18.392762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:18.392764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:18.392775Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:18.392785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:18.392791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:18.392834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.392840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.392841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.392843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:18.392845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:18.392894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:18.392899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.392907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.392913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.392926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:18.392938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895181323425972:5712]
2025-09-30T14:52:18.392943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895181323425972:5712]
2025-09-30T14:52:18.392944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895181323425972:5712]
2025-09-30T14:52:18.392954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:18.392964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:18.392968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:18.392980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:18.392983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:18.392983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:18.392985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:18.392991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895181413155071:2454], now have 1 active actors on pipe
2025-09-30T14:52:18.392995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895181413155163:6948], now have 1 active actors on pipe
2025-09-30T14:52:18.393019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895181323425972:5712]
2025-09-30T14:52:18.393032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:18.393036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:18.393025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 765
2025-09-30T14:52:18.393045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 765
2025-09-30T14:52:18.393358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:18.393366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:18.393386Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1fedb0e-431beae-57382254-7e629db6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:18.393395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:18.393398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:18.393399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:18.393406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:18.393415Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:18.393428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:18.393630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:18.393645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:18.393670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:18.393769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 766 partition: 0 MaxSeqNo: 42 sessionId: src_id|c1fedb0e-431beae-57382254-7e629db6_0
2025-09-30T14:52:18.394102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aee9d1a6-7a7466b4-db0ad174-e1064b96_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c1fedb0e-431beae-57382254-7e629db6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:18.396873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fedb0e-431beae-57382254-7e629db6_0] Write session: try to update token
2025-09-30T14:52:18.396892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fedb0e-431beae-57382254-7e629db6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:18.405052Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:18.405074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:18.405076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:18.405078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:18.405088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895181323425972:5712]
2025-09-30T14:52:18.405092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895181323425972:5712]
2025-09-30T14:52:18.405096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895181323425972:5712]
2025-09-30T14:52:18.405136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:18.405138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:18.405143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.405144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:18.405148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:18.405148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:18.405279Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:18.411288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 766 sessionId: src_id|c1fedb0e-431beae-57382254-7e629db6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:18.413865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:18.471108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895181413155175:6573]
2025-09-30T14:52:18.471401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 765, pipe: [1:7555895181413155175:6573]
2025-09-30T14:52:18.525536Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:18.525858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:18.525872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:18.525910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895181413155175:6573], now have 1 active actors on pipe
2025-09-30T14:52:18.526152Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:18.526187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895181413155175:6573]
2025-09-30T14:52:18.526204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:18.526223Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:18.526284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 766 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c1fedb0e-431beae-57382254-7e629db6_0
2025-09-30T14:52:18.526487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 766 sessionId: src_id|c1fedb0e-431beae-57382254-7e629db6_0 is DEAD
2025-09-30T14:52:18.526630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fedb0e-431beae-57382254-7e629db6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:18.526642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fedb0e-431beae-57382254-7e629db6_0] Write session will restart in 0.006182s
2025-09-30T14:52:18.526665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fedb0e-431beae-57382254-7e629db6_0] Write session: Do CDS request
2025-09-30T14:52:18.526671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fedb0e-431beae-57382254-7e629db6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:18.533812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fedb0e-431beae-57382254-7e629db6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:18.533877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:18.533896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 767
2025-09-30T14:52:18.534049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 767 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:18.534089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 767 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:18.534104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=767 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:18.534108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:18.534519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 767 sessionId:  describe result for acl check
2025-09-30T14:52:18.534548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:18.534550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:18.534552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:18.534558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895181413155192:6953] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:18.535112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895181413155192:6953] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:18.537212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895181413155192:6953] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:18.538270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:18.541811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:18.542040Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:18.542050Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:18.542061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:18.542115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:18.542142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895181413155192:6953] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:18.542174Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895181323426076:5714]
2025-09-30T14:52:18.542160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895181413155192:6953] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:18.542164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895181413155192:6953] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:18.542173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 767 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:18.542893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:18.543207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:18.543265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:18.543600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:18.543661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:18.543667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:18.543668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:18.543669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:18.543671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:18.543672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:18.543673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:18.543675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:18.543676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:18.543677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:18.543679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.543680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.543682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.543683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:18.543684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:18.543690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:18.543701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:18.543705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:18.543710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:18.543715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:18.543721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:18.543725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:18.543729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:18.543734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:18.543738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:18.543742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.543747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.543750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.543755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:18.543759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:18.543766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:18.543775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:18.543781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:18.543787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:18.543793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:18.543803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:18.543808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:18.543818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:18.543823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:18.543833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:18.543837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:18.543843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:18.543852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:18.543858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:18.543864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:18.543873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:18.543878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:18.543883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:18.543888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:18.543894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:18.543905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.543911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.543919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.543924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.543928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.543938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.543942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:18.543952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:18.543957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:18.543962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:18.544012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:18.549518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:18.550746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:18.550761Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:18.550763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:18.550767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:18.550774Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 766 [2:7555895181323426076:5714]
2025-09-30T14:52:18.550791Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:18.550808Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:18.550811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:18.550814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:18.550816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:18.550834Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:18.550841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:18.550847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:18.550911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.550926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.550928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.550931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:18.550934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:18.551006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:18.551014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.551024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.551034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.551045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:18.551061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895181323426068:5714]
2025-09-30T14:52:18.551066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895181323426068:5714]
2025-09-30T14:52:18.551067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895181323426068:5714]
2025-09-30T14:52:18.551074Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:18.551087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:18.551103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:18.551105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:18.551108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:18.551112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:18.551115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:18.551151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895181413155178:2454], now have 1 active actors on pipe
2025-09-30T14:52:18.551160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895181413155271:6953], now have 1 active actors on pipe
2025-09-30T14:52:18.551163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895181323426068:5714]
2025-09-30T14:52:18.551171Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:18.551188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:18.551203Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 766
2025-09-30T14:52:18.551209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 766
2025-09-30T14:52:18.551280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:18.551292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:18.551318Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9300c08d-887e1632-21aa4296-91b29f1f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:18.551326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:18.551329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:18.551331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:18.551340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:18.551350Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:18.551370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:18.551579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:18.551595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:18.551619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:18.551766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 767 partition: 0 MaxSeqNo: 42 sessionId: src_id|9300c08d-887e1632-21aa4296-91b29f1f_0
2025-09-30T14:52:18.552083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fedb0e-431beae-57382254-7e629db6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9300c08d-887e1632-21aa4296-91b29f1f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:18.555035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9300c08d-887e1632-21aa4296-91b29f1f_0] Write session: try to update token
2025-09-30T14:52:18.555054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9300c08d-887e1632-21aa4296-91b29f1f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:18.563295Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:18.563311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:18.563313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:18.563315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:18.563324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895181323426068:5714]
2025-09-30T14:52:18.563328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895181323426068:5714]
2025-09-30T14:52:18.563332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895181323426068:5714]
2025-09-30T14:52:18.563369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:18.563376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.563378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:18.563386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:18.563393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:18.563397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:18.563510Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:18.569679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 767 sessionId: src_id|9300c08d-887e1632-21aa4296-91b29f1f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:18.572477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:18.626210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895181413155282:6573]
2025-09-30T14:52:18.626566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 766, pipe: [1:7555895181413155282:6573]
2025-09-30T14:52:18.669138Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:18.669376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:18.669387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:18.669418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895181413155282:6573], now have 1 active actors on pipe
2025-09-30T14:52:18.669632Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:18.669665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:18.669683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:18.669690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895181413155282:6573]
2025-09-30T14:52:18.669712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:18.669760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 767 reason: error at write: Disconnected sessionId: src_id|9300c08d-887e1632-21aa4296-91b29f1f_0
2025-09-30T14:52:18.669951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 767 sessionId: src_id|9300c08d-887e1632-21aa4296-91b29f1f_0 is DEAD
2025-09-30T14:52:18.670082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9300c08d-887e1632-21aa4296-91b29f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:18.670095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9300c08d-887e1632-21aa4296-91b29f1f_0] Write session will restart in 0.005498s
2025-09-30T14:52:18.670113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9300c08d-887e1632-21aa4296-91b29f1f_0] Write session: Do CDS request
2025-09-30T14:52:18.670117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9300c08d-887e1632-21aa4296-91b29f1f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:18.676718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9300c08d-887e1632-21aa4296-91b29f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:18.676864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:18.676892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 768
2025-09-30T14:52:18.677007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 768 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:18.677041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 768 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:18.677051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=768 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:18.677055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:18.677536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 768 sessionId:  describe result for acl check
2025-09-30T14:52:18.677572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:18.677579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:18.677581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:18.677587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895181413155308:6957] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:18.678137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895181413155308:6957] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:18.680164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895181413155308:6957] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:18.683894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:18.684144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895181413155308:6957] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:18.684157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895181413155308:6957] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:18.684161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895181413155308:6957] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:18.684169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 768 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:18.684383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:18.684533Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:18.684541Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:18.684548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:18.684597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:18.684627Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895181323426174:5717]
2025-09-30T14:52:18.685072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:18.685384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:18.685435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:18.685757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:18.685832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:18.685838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:18.685839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:18.685841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:18.685842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:18.685843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:18.685845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:18.685846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:18.685847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:18.685848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:18.685850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.685851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.685852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.685853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:18.685855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:18.685860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:18.685871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:18.685886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:18.685891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:18.685895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:18.685903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:18.685907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:18.685916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:18.685920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:18.685925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:18.685930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.685938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.685942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.685950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:18.685954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:18.685966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:18.685974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:18.685986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:18.685991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:18.685995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:18.685999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:18.686003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:18.686007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:18.686011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:18.686015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:18.686019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:18.686024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:18.686033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:18.686038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:18.686046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:18.686056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:18.686065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:18.686074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:18.686078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:18.686087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:18.686094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.686103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.686112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.686121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.686130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.686135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.686143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:18.686149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:18.686157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:18.686162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:18.686214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:18.691432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:18.692330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:18.692357Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:18.692361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:18.692365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:18.692372Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 767 [2:7555895181323426174:5717]
2025-09-30T14:52:18.692388Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:18.692406Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:18.692414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:18.692417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:18.692419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:18.692435Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:18.692446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:18.692453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:18.692513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.692520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.692522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.692526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:18.692531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:18.692595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:18.692604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.692617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.692634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.692656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:18.692678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895181413155284:2454], now have 1 active actors on pipe
2025-09-30T14:52:18.692687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895181413155378:6957], now have 1 active actors on pipe
2025-09-30T14:52:18.692693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895181323426168:5717]
2025-09-30T14:52:18.692695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895181323426168:5717]
2025-09-30T14:52:18.692697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895181323426168:5717]
2025-09-30T14:52:18.692709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:18.692727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:18.692727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:18.692731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:18.692733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:18.692747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:18.692750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:18.692724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 767
2025-09-30T14:52:18.692740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 767
2025-09-30T14:52:18.692777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895181323426168:5717]
2025-09-30T14:52:18.692790Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:18.692796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:18.692813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:18.692820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:18.692861Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11a2dd57-db1df651-ade6a890-832b7cb2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:18.692872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:18.692879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:18.692881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:18.692889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:18.692896Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:18.692912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:18.693090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:18.693102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:18.693120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:18.693225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 768 partition: 0 MaxSeqNo: 42 sessionId: src_id|11a2dd57-db1df651-ade6a890-832b7cb2_0
2025-09-30T14:52:18.693557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9300c08d-887e1632-21aa4296-91b29f1f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|11a2dd57-db1df651-ade6a890-832b7cb2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:18.696241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11a2dd57-db1df651-ade6a890-832b7cb2_0] Write session: try to update token
2025-09-30T14:52:18.696259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11a2dd57-db1df651-ade6a890-832b7cb2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:18.704308Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:18.704328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:18.704331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:18.704333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:18.704345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895181323426168:5717]
2025-09-30T14:52:18.704351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895181323426168:5717]
2025-09-30T14:52:18.704355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895181323426168:5717]
2025-09-30T14:52:18.704395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:18.704405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.704408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:18.704406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:18.704412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:18.704415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:18.704543Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:18.709391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 768 sessionId: src_id|11a2dd57-db1df651-ade6a890-832b7cb2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:18.712250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:18.770084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895181413155389:6573]
2025-09-30T14:52:18.770353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 767, pipe: [1:7555895181413155389:6573]
2025-09-30T14:52:18.811772Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:18.812423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:18.812436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:18.812467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895181413155389:6573], now have 1 active actors on pipe
2025-09-30T14:52:18.812696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:18.812713Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:18.812756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895181413155389:6573]
2025-09-30T14:52:18.812779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:18.812785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:18.812845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 768 reason: error at write: Disconnected sessionId: src_id|11a2dd57-db1df651-ade6a890-832b7cb2_0
2025-09-30T14:52:18.812999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 768 sessionId: src_id|11a2dd57-db1df651-ade6a890-832b7cb2_0 is DEAD
2025-09-30T14:52:18.813142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11a2dd57-db1df651-ade6a890-832b7cb2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:18.813153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11a2dd57-db1df651-ade6a890-832b7cb2_0] Write session will restart in 0.006758s
2025-09-30T14:52:18.813176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11a2dd57-db1df651-ade6a890-832b7cb2_0] Write session: Do CDS request
2025-09-30T14:52:18.813185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11a2dd57-db1df651-ade6a890-832b7cb2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:18.820726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11a2dd57-db1df651-ade6a890-832b7cb2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:18.820804Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:18.820818Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 769
2025-09-30T14:52:18.820930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 769 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:18.820961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 769 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:18.820970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=769 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:18.820973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:18.821446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 769 sessionId:  describe result for acl check
2025-09-30T14:52:18.821485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:18.821491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:18.821492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:18.821497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895181413155448:6961] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:18.822028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895181413155448:6961] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:18.823437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:18.824139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895181413155448:6961] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:18.826976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:18.827194Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:18.827208Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:18.827222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:18.827275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895181413155448:6961] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:18.827290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895181413155448:6961] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:18.827294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895181413155448:6961] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:18.827303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 769 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:18.827310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:18.827355Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895181323426271:5719]
2025-09-30T14:52:18.827940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:18.828239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:18.828289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:18.828619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:18.828680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:18.828685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:18.828686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:18.828686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:18.828687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:18.828688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:18.828689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:18.828689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:18.828690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:18.828691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:18.828692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.828692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.828693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.828694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:18.828694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:18.828698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:18.828704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:18.828707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:18.828710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:18.828712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:18.828714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:18.828717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:18.828719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:18.828721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:18.828724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:18.828727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.828729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.828732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.828734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:18.828736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:18.828743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:18.828749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:18.828753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:18.828756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:18.828759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:18.828763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:18.828765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:18.828768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:18.828771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:18.828776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:18.828778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:18.828781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:18.828783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:18.828786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:18.828788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:18.828791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:18.828794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:18.828797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:18.828799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:18.828802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:18.828804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.828807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.828809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.828812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.828815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.828817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.828820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:18.828823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:18.828825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:18.828828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:18.828850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:18.834111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:18.835046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:18.835062Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:18.835065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:18.835070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:18.835076Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 768 [2:7555895181323426271:5719]
2025-09-30T14:52:18.835092Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:18.835106Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:18.835109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:18.835113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:18.835117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:18.835131Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:18.835138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:18.835145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:18.835203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.835213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.835216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.835219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:18.835222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:18.835306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:18.835314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.835326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.835340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.835362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:18.835383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895181413155486:6961], now have 1 active actors on pipe
2025-09-30T14:52:18.835391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895181413155391:2454], now have 1 active actors on pipe
2025-09-30T14:52:18.835397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895181323426265:5719]
2025-09-30T14:52:18.835399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895181323426265:5719]
2025-09-30T14:52:18.835401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895181323426265:5719]
2025-09-30T14:52:18.835413Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:18.835396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 768
2025-09-30T14:52:18.835431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:18.835416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 768
2025-09-30T14:52:18.835441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:18.835445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:18.835446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:18.835452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:18.835455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:18.835497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:18.835506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:18.835517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895181323426265:5719]
2025-09-30T14:52:18.835530Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:18.835543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:18.835566Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e2ebfbc-3abd4229-a0b146ce-67d0273a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:18.835577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:18.835581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:18.835583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:18.835592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:18.835605Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:18.835626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:18.835725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:18.835731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:18.835745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:18.835824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 769 partition: 0 MaxSeqNo: 42 sessionId: src_id|3e2ebfbc-3abd4229-a0b146ce-67d0273a_0
2025-09-30T14:52:18.836152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11a2dd57-db1df651-ade6a890-832b7cb2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3e2ebfbc-3abd4229-a0b146ce-67d0273a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:18.838898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e2ebfbc-3abd4229-a0b146ce-67d0273a_0] Write session: try to update token
2025-09-30T14:52:18.838924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e2ebfbc-3abd4229-a0b146ce-67d0273a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:18.854168Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:18.854186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:18.854189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:18.854190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:18.854198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895181323426265:5719]
2025-09-30T14:52:18.854201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895181323426265:5719]
2025-09-30T14:52:18.854204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895181323426265:5719]
2025-09-30T14:52:18.854241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:18.854246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.854248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:18.854260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:18.854266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:18.854269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:18.854403Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:18.858544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 769 sessionId: src_id|3e2ebfbc-3abd4229-a0b146ce-67d0273a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:18.868523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:18.912955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895181413155497:6573]
2025-09-30T14:52:18.913336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 768, pipe: [1:7555895181413155497:6573]
2025-09-30T14:52:18.962557Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:18.963179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:18.963195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:18.963214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895181413155497:6573], now have 1 active actors on pipe
2025-09-30T14:52:18.963358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895181413155497:6573]
2025-09-30T14:52:18.963383Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:18.963392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:18.963394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:18.963419Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:18.963463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 769 reason: error at write: Disconnected sessionId: src_id|3e2ebfbc-3abd4229-a0b146ce-67d0273a_0
2025-09-30T14:52:18.963617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 769 sessionId: src_id|3e2ebfbc-3abd4229-a0b146ce-67d0273a_0 is DEAD
2025-09-30T14:52:18.963763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e2ebfbc-3abd4229-a0b146ce-67d0273a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:18.963773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e2ebfbc-3abd4229-a0b146ce-67d0273a_0] Write session will restart in 0.008062s
2025-09-30T14:52:18.963801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e2ebfbc-3abd4229-a0b146ce-67d0273a_0] Write session: Do CDS request
2025-09-30T14:52:18.963806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e2ebfbc-3abd4229-a0b146ce-67d0273a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:18.972715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e2ebfbc-3abd4229-a0b146ce-67d0273a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:18.972831Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:18.972844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 770
2025-09-30T14:52:18.972985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 770 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:18.973015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 770 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:18.973025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=770 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:18.973029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:18.973421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 770 sessionId:  describe result for acl check
2025-09-30T14:52:18.973452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:18.973455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:18.973456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:18.973462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895181413155562:6965] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:18.973727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:18.973960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895181413155562:6965] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:18.975650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895181413155562:6965] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:18.977222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:18.977434Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:18.977445Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:18.977457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:18.977512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:18.977552Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895181323426382:5722]
2025-09-30T14:52:18.978189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:18.978183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895181413155562:6965] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:18.978201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895181413155562:6965] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:18.978205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895181413155562:6965] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:18.978214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 770 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:18.978520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:18.978564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:18.978891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:18.978972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:18.978980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:18.978981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:18.978982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:18.978983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:18.978985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:18.978986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:18.978987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:18.978988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:18.978989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:18.978991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.978992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.978993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.978994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:18.978995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:18.979000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:18.979009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:18.979014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:18.979018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:18.979022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:18.979026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:18.979031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:18.979035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:18.979039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:18.979043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:18.979047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.979051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.979056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.979059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:18.979063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:18.979070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:18.979077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:18.979084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:18.979090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:18.979094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:18.979100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:18.979104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:18.979110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:18.979115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:18.979120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:18.979125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:18.979130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:18.979134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:18.979139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:18.979144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:18.979148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:18.979153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:18.979158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:18.979162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:18.979168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:18.979173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.979177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.979181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.979187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.979191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.979197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.979201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:18.979205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:18.979214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:18.979219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:18.979280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:18.984930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:18.986074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:18.986089Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:18.986091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:18.986095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:18.986101Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 769 [2:7555895181323426382:5722]
2025-09-30T14:52:18.986119Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:18.986132Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:18.986134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:18.986137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:18.986138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:18.986151Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:18.986156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:18.986162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:18.986211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.986225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.986230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.986233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:18.986235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:18.986299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:18.986306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.986315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:18.986334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:18.986344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:18.986356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895181323426376:5722]
2025-09-30T14:52:18.986362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895181323426376:5722]
2025-09-30T14:52:18.986363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895181323426376:5722]
2025-09-30T14:52:18.986370Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:18.986379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895181413155594:6965], now have 1 active actors on pipe
2025-09-30T14:52:18.986379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:18.986382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:18.986384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:18.986388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895181413155502:2454], now have 1 active actors on pipe
2025-09-30T14:52:18.986393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:18.986401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:18.986403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:18.986431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895181323426376:5722]
2025-09-30T14:52:18.986441Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:18.986448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:18.986483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 769
2025-09-30T14:52:18.986483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 769
2025-09-30T14:52:18.986544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:18.986554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:18.986578Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94e7d17b-db10026e-6ebc8cd5-cf3c712a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:18.986588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:18.986590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:18.986592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:18.986599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:18.986606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:18.986624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:18.986792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:18.986806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:18.986830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:18.986903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 770 partition: 0 MaxSeqNo: 42 sessionId: src_id|94e7d17b-db10026e-6ebc8cd5-cf3c712a_0
2025-09-30T14:52:18.987240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e2ebfbc-3abd4229-a0b146ce-67d0273a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|94e7d17b-db10026e-6ebc8cd5-cf3c712a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:18.990003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94e7d17b-db10026e-6ebc8cd5-cf3c712a_0] Write session: try to update token
2025-09-30T14:52:18.990021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94e7d17b-db10026e-6ebc8cd5-cf3c712a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:18.998549Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:18.998565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:18.998568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:18.998571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:18.998580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895181323426376:5722]
2025-09-30T14:52:18.998585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895181323426376:5722]
2025-09-30T14:52:18.998589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895181323426376:5722]
2025-09-30T14:52:18.998631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:18.998638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:18.998641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:18.998644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:18.998654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:18.998660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:18.998776Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:19.004141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 770 sessionId: src_id|94e7d17b-db10026e-6ebc8cd5-cf3c712a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:19.006776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:19.063488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895185708122921:6573]
2025-09-30T14:52:19.063723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 769, pipe: [1:7555895185708122921:6573]
2025-09-30T14:52:19.086444Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] Counters: { Errors: 7 CurrentSessionLifetimeMs: 121130 BytesRead: 38297624 MessagesRead: 17 BytesReadCompressed: 38297624 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 2252802 BytesInflightTotal: 4505604 MessagesInflight: 2 }
2025-09-30T14:52:19.112771Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:19.113311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:19.113328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:19.113368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895185708122921:6573], now have 1 active actors on pipe
2025-09-30T14:52:19.113586Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:19.113671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895185708122921:6573]
2025-09-30T14:52:19.113675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:19.113678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:19.113704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:19.113746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 770 reason: error at write: Disconnected sessionId: src_id|94e7d17b-db10026e-6ebc8cd5-cf3c712a_0
2025-09-30T14:52:19.113896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 770 sessionId: src_id|94e7d17b-db10026e-6ebc8cd5-cf3c712a_0 is DEAD
2025-09-30T14:52:19.114051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94e7d17b-db10026e-6ebc8cd5-cf3c712a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:19.114064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94e7d17b-db10026e-6ebc8cd5-cf3c712a_0] Write session will restart in 0.005024s
2025-09-30T14:52:19.114087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94e7d17b-db10026e-6ebc8cd5-cf3c712a_0] Write session: Do CDS request
2025-09-30T14:52:19.114096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94e7d17b-db10026e-6ebc8cd5-cf3c712a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:19.120764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94e7d17b-db10026e-6ebc8cd5-cf3c712a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:19.120836Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:19.120854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 771
2025-09-30T14:52:19.121004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 771 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:19.121048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 771 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:19.121058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=771 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:19.121062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:19.121492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 771 sessionId:  describe result for acl check
2025-09-30T14:52:19.121526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:19.121543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:19.121549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:19.121555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895185708122940:6972] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:19.122087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895185708122940:6972] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:19.124115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895185708122940:6972] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:19.124822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:19.128456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:19.128663Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:19.128673Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:19.128683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:19.128738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:19.128779Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895185618393780:5725]
2025-09-30T14:52:19.128787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895185708122940:6972] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:19.128819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895185708122940:6972] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:19.128822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895185708122940:6972] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:19.128828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 771 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:19.129433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:19.129758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:19.129803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:19.130126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:19.130176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:19.130181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:19.130182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:19.130183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:19.130184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:19.130184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:19.130185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:19.130186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:19.130187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:19.130188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:19.130188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.130189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.130190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.130191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:19.130191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:19.130195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:19.130202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:19.130205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:19.130210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:19.130213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:19.130217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:19.130221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:19.130225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:19.130230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:19.130234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:19.130237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.130240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.130242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.130244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:19.130247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:19.130254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:19.130259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:19.130264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:19.130267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:19.130270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:19.130275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:19.130277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:19.130280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:19.130282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:19.130285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:19.130288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:19.130291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:19.130293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:19.130296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:19.130298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:19.130301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:19.130303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:19.130306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:19.130308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:19.130311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:19.130316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.130318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.130332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.130336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.130339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.130341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.130344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:19.130346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:19.130349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:19.130352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:19.130375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:19.135784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:19.136971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:19.136988Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:19.136992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:19.136997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:19.137008Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 770 [2:7555895185618393780:5725]
2025-09-30T14:52:19.137027Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:19.137049Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:19.137051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:19.137055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:19.137057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:19.137074Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:19.137080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:19.137092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:19.137153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.137161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.137163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.137167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:19.137170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:19.137240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:19.137248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.137263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.137280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.137302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:19.137323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895185708122925:2454], now have 1 active actors on pipe
2025-09-30T14:52:19.137329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895185708123023:6972], now have 1 active actors on pipe
2025-09-30T14:52:19.137335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895185618393774:5725]
2025-09-30T14:52:19.137337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895185618393774:5725]
2025-09-30T14:52:19.137339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895185618393774:5725]
2025-09-30T14:52:19.137348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:19.137358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:19.137364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:19.137369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:19.137371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:19.137372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:19.137375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:19.137402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895185618393774:5725]
2025-09-30T14:52:19.137412Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:19.137420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:19.137407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 770
2025-09-30T14:52:19.137441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 770
2025-09-30T14:52:19.137466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:19.137473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:19.137498Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3fa71f5c-865fe6fa-ee283a33-513ea297_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:19.137510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:19.137519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:19.137521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:19.137531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:19.137543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:19.137563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:19.137721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:19.137731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:19.137746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:19.137860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 771 partition: 0 MaxSeqNo: 42 sessionId: src_id|3fa71f5c-865fe6fa-ee283a33-513ea297_0
2025-09-30T14:52:19.138216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94e7d17b-db10026e-6ebc8cd5-cf3c712a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3fa71f5c-865fe6fa-ee283a33-513ea297_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:19.141008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa71f5c-865fe6fa-ee283a33-513ea297_0] Write session: try to update token
2025-09-30T14:52:19.141031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa71f5c-865fe6fa-ee283a33-513ea297_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:19.149622Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:19.149639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:19.149649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895185618393774:5725]
2025-09-30T14:52:19.149690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:19.149696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:19.149885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:19.150037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:19.150178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:19.150345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:19.150543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:19.150586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:19.155489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 771 sessionId: src_id|3fa71f5c-865fe6fa-ee283a33-513ea297_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:19.158054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:19.158282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:19.158304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:19.158369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:19.158476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:19.162864Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:19.162887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:19.163237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:19.163263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:19.163273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895185618393774:5725]
2025-09-30T14:52:19.163282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895185618393774:5725]
2025-09-30T14:52:19.163285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895185618393774:5725]
2025-09-30T14:52:19.163336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:19.163346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.163349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:19.163352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:19.163359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:19.163363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:19.163483Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:19.214029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895185708123035:6573]
2025-09-30T14:52:19.214306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 770, pipe: [1:7555895185708123035:6573]
2025-09-30T14:52:19.274231Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:19.282627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:19.282654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:19.282816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:19.282891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:19.282962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:19.283031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:19.283091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:19.283106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:19.283195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:19.283292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:19.283368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:19.283443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:19.283489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:19.283501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:19.283577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:19.283645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:19.283719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:19.283791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:19.283840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:19.283848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:19.283927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:19.283999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:19.284078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:19.284150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:19.284198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:19.284206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:19.284283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:19.284349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:19.284416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:19.284484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:19.284533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:19.284539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:19.284612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:19.284682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:19.284752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:19.284824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:19.284873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:19.284881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:19.284956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:19.285019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:19.285090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:19.285167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:19.285216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:19.285224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:19.285292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:19.285355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:19.285425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:19.285489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:19.285532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:19.285537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:19.285600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:19.285658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:19.285724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:19.285795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:19.285842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:19.285848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:19.285914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:19.285976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:19.286044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:19.286109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:19.286152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:19.286157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:19.286214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895185708123035:6573], now have 1 active actors on pipe
2025-09-30T14:52:19.286521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:19.286589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895185708123035:6573]
2025-09-30T14:52:19.286620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:19.286628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:19.286659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 771 reason: error at write: Disconnected sessionId: src_id|3fa71f5c-865fe6fa-ee283a33-513ea297_0
2025-09-30T14:52:19.286851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 771 sessionId: src_id|3fa71f5c-865fe6fa-ee283a33-513ea297_0 is DEAD
2025-09-30T14:52:19.286989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa71f5c-865fe6fa-ee283a33-513ea297_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:19.286999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa71f5c-865fe6fa-ee283a33-513ea297_0] Write session will restart in 0.008990s
2025-09-30T14:52:19.287022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa71f5c-865fe6fa-ee283a33-513ea297_0] Write session: Do CDS request
2025-09-30T14:52:19.287029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa71f5c-865fe6fa-ee283a33-513ea297_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:19.287438Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:19.296756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa71f5c-865fe6fa-ee283a33-513ea297_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:19.296820Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:19.296840Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 772
2025-09-30T14:52:19.296970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 772 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:19.297003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 772 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:19.297013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=772 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:19.297020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:19.297372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 772 sessionId:  describe result for acl check
2025-09-30T14:52:19.297400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:19.297402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:19.297403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:19.297408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895185708123111:6982] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:19.298028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895185708123111:6982] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:19.299006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:19.300566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895185708123111:6982] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:19.302613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:19.302879Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:19.302889Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:19.302901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:19.302955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:19.302990Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895185618393910:5733]
2025-09-30T14:52:19.303281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895185708123111:6982] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:19.303299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895185708123111:6982] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:19.303302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895185708123111:6982] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:19.303310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 772 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:19.303605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:19.303873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:19.303922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:19.304248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:19.304308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:19.304314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:19.304315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:19.304316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:19.304317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:19.304318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:19.304320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:19.304321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:19.304321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:19.304322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:19.304323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.304324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.304325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.304326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:19.304327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:19.304333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:19.304341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:19.304345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:19.304348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:19.304352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:19.304355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:19.304359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:19.304363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:19.304367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:19.304371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:19.304376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.304380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.304384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.304388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:19.304392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:19.304400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:19.304407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:19.304413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:19.304418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:19.304423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:19.304429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:19.304433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:19.304438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:19.304442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:19.304447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:19.304451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:19.304456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:19.304461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:19.304466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:19.304470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:19.304475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:19.304479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:19.304484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:19.304488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:19.304493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:19.304497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.304502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.304505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.304510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.304513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.304518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.304521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:19.304525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:19.304529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:19.304533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:19.304575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:19.310256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:19.311658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:19.311674Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:19.311676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:19.311681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:19.311688Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 771 [2:7555895185618393910:5733]
2025-09-30T14:52:19.311703Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:19.311717Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:19.311741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:19.311744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:19.311746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:19.311763Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:19.311770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:19.311783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:19.311841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.311850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.311853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.311856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:19.311859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:19.311927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:19.311936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.311950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.311964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.311988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:19.312011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895185708123049:2454], now have 1 active actors on pipe
2025-09-30T14:52:19.312020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895185708123161:6982], now have 1 active actors on pipe
2025-09-30T14:52:19.312026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895185618393889:5733]
2025-09-30T14:52:19.312033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895185618393889:5733]
2025-09-30T14:52:19.312036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895185618393889:5733]
2025-09-30T14:52:19.312051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:19.312068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:19.312070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:19.312074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:19.312075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:19.312086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:19.312089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:19.312123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895185618393889:5733]
2025-09-30T14:52:19.312136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:19.312144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:19.312120Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 771
2025-09-30T14:52:19.312178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:19.312129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 771
2025-09-30T14:52:19.312188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:19.312214Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dea17e91-b9303a50-c4917d88-16ede2e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:19.312225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:19.312231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:19.312233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:19.312242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:19.312254Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:19.312272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:19.312458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:19.312466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:19.312479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:19.312568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 772 partition: 0 MaxSeqNo: 42 sessionId: src_id|dea17e91-b9303a50-c4917d88-16ede2e6_0
2025-09-30T14:52:19.312903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa71f5c-865fe6fa-ee283a33-513ea297_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dea17e91-b9303a50-c4917d88-16ede2e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:19.315762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dea17e91-b9303a50-c4917d88-16ede2e6_0] Write session: try to update token
2025-09-30T14:52:19.315782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dea17e91-b9303a50-c4917d88-16ede2e6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:19.324280Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:19.324302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:19.324312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895185618393889:5733]
2025-09-30T14:52:19.324357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:19.324356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:19.324530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:19.324685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:19.324828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:19.324973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:19.325188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:19.325229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:19.330601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 772 sessionId: src_id|dea17e91-b9303a50-c4917d88-16ede2e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:19.333446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:19.333654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:19.333683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:19.333720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:19.333828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:19.335791Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:19.335806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:19.335809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:19.335811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:19.335820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895185618393889:5733]
2025-09-30T14:52:19.335824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895185618393889:5733]
2025-09-30T14:52:19.335827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895185618393889:5733]
2025-09-30T14:52:19.335866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:19.335873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.335876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:19.335891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:19.335904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:19.335909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:19.336039Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:19.386576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895185708123173:6573]
2025-09-30T14:52:19.386990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 771, pipe: [1:7555895185708123173:6573]
2025-09-30T14:52:19.445347Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:19.452881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:19.452907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:19.453059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:19.453116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:19.453182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:19.453249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:19.453291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:19.453298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:19.453363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:19.453417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:19.453481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:19.453544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:19.453586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:19.453592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:19.453667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:19.453730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:19.453793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:19.453851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:19.453893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:19.453900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:19.453964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:19.454023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:19.454086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:19.454143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:19.454183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:19.454188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:19.454247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:19.454303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:19.454373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:19.454436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:19.454481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:19.454487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:19.454548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:19.454601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:19.454660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:19.454729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:19.454771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:19.454776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:19.454837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:19.454893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:19.454960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:19.455027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:19.455072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:19.455077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:19.455139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:19.455202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:19.455281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:19.455347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:19.455392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:19.455398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:19.455464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:19.455523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:19.455587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:19.455647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:19.455688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:19.455697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:19.455765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:19.455820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:19.455878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:19.455935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:19.455975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:19.455980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:19.456033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895185708123173:6573], now have 1 active actors on pipe
2025-09-30T14:52:19.456277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895185708123173:6573]
2025-09-30T14:52:19.456312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:19.456316Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:19.456316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:19.456345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 772 reason: error at write: Disconnected sessionId: src_id|dea17e91-b9303a50-c4917d88-16ede2e6_0
2025-09-30T14:52:19.456514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 772 sessionId: src_id|dea17e91-b9303a50-c4917d88-16ede2e6_0 is DEAD
2025-09-30T14:52:19.456656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dea17e91-b9303a50-c4917d88-16ede2e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:19.456666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dea17e91-b9303a50-c4917d88-16ede2e6_0] Write session will restart in 0.006935s
2025-09-30T14:52:19.456685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dea17e91-b9303a50-c4917d88-16ede2e6_0] Write session: Do CDS request
2025-09-30T14:52:19.456689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dea17e91-b9303a50-c4917d88-16ede2e6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:19.456981Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:19.464693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dea17e91-b9303a50-c4917d88-16ede2e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:19.464830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:19.464848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 773
2025-09-30T14:52:19.464987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 773 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:19.465020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 773 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:19.465031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=773 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:19.465034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:19.465475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 773 sessionId:  describe result for acl check
2025-09-30T14:52:19.465512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:19.465515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:19.465516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:19.465522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895185708123202:6987] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:19.466055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895185708123202:6987] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:19.469021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:19.469262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895185708123202:6987] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:19.472318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:19.472519Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:19.472529Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:19.472539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:19.472532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895185708123202:6987] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:19.472548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895185708123202:6987] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:19.472552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895185708123202:6987] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:19.472561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 773 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:19.472593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:19.472632Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895185618394021:5741]
2025-09-30T14:52:19.473131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:19.473412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:19.473451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:19.473710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:19.473756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:19.473761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:19.473762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:19.473763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:19.473763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:19.473764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:19.473765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:19.473766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:19.473767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:19.473768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:19.473768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.473769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.473770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.473771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:19.473772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:19.473775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:19.473783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:19.473785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:19.473788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:19.473791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:19.473793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:19.473796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:19.473798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:19.473801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:19.473803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:19.473806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.473808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.473811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.473813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:19.473815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:19.473821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:19.473827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:19.473832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:19.473836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:19.473839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:19.473853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:19.473855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:19.473858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:19.473862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:19.473865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:19.473867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:19.473870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:19.473873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:19.473876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:19.473879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:19.473883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:19.473886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:19.473890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:19.473893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:19.473897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:19.473900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.473906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.473911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.473916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.473920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.473925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.473928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:19.473933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:19.473939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:19.473944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:19.473970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:19.479638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:19.480765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:19.480782Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:19.480785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:19.480790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:19.480798Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 772 [2:7555895185618394021:5741]
2025-09-30T14:52:19.480812Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:19.480830Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:19.480836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:19.480838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:19.480840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:19.480854Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:19.480859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:19.480866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:19.480921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.480927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.480929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.480931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:19.480933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:19.480991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:19.480997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.481006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.481016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.481029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:19.481045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895185618394015:5741]
2025-09-30T14:52:19.481050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895185618394015:5741]
2025-09-30T14:52:19.481051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895185618394015:5741]
2025-09-30T14:52:19.481057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:19.481069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:19.481071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:19.481072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:19.481077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:19.481084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:19.481086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:19.481098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895185708123275:6987], now have 1 active actors on pipe
2025-09-30T14:52:19.481107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895185708123174:2454], now have 1 active actors on pipe
2025-09-30T14:52:19.481134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895185618394015:5741]
2025-09-30T14:52:19.481143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:19.481154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:19.481170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 772
2025-09-30T14:52:19.481178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 772
2025-09-30T14:52:19.481252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:19.481261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:19.481285Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df8b9a8a-d24f2f6f-69e2c6ad-a775ab0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:19.481295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:19.481298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:19.481300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:19.481307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:19.481314Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:19.481328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:19.481502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:19.481507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:19.481518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:19.481615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 773 partition: 0 MaxSeqNo: 42 sessionId: src_id|df8b9a8a-d24f2f6f-69e2c6ad-a775ab0c_0
2025-09-30T14:52:19.481966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dea17e91-b9303a50-c4917d88-16ede2e6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|df8b9a8a-d24f2f6f-69e2c6ad-a775ab0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:19.484853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df8b9a8a-d24f2f6f-69e2c6ad-a775ab0c_0] Write session: try to update token
2025-09-30T14:52:19.484879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df8b9a8a-d24f2f6f-69e2c6ad-a775ab0c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:19.493342Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:19.493359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:19.493362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:19.493364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:19.493374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895185618394015:5741]
2025-09-30T14:52:19.493378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895185618394015:5741]
2025-09-30T14:52:19.493383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895185618394015:5741]
2025-09-30T14:52:19.493423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:19.493431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.493430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:19.493433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:19.493448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:19.493453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:19.493583Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:19.499433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 773 sessionId: src_id|df8b9a8a-d24f2f6f-69e2c6ad-a775ab0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:19.502176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:19.556568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895185708123289:6573]
2025-09-30T14:52:19.556883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 772, pipe: [1:7555895185708123289:6573]
2025-09-30T14:52:19.602606Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:19.603084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:19.603100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:19.603136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895185708123289:6573], now have 1 active actors on pipe
2025-09-30T14:52:19.603420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895185708123289:6573]
2025-09-30T14:52:19.603439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:19.603443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:19.603455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:19.603506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 773 reason: error at write: Disconnected sessionId: src_id|df8b9a8a-d24f2f6f-69e2c6ad-a775ab0c_0
2025-09-30T14:52:19.603592Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:19.603681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 773 sessionId: src_id|df8b9a8a-d24f2f6f-69e2c6ad-a775ab0c_0 is DEAD
2025-09-30T14:52:19.603829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df8b9a8a-d24f2f6f-69e2c6ad-a775ab0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:19.603855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df8b9a8a-d24f2f6f-69e2c6ad-a775ab0c_0] Write session will restart in 0.006423s
2025-09-30T14:52:19.603880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df8b9a8a-d24f2f6f-69e2c6ad-a775ab0c_0] Write session: Do CDS request
2025-09-30T14:52:19.603886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df8b9a8a-d24f2f6f-69e2c6ad-a775ab0c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:19.611741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df8b9a8a-d24f2f6f-69e2c6ad-a775ab0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:19.611824Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:19.611843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 774
2025-09-30T14:52:19.611974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 774 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:19.612006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 774 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:19.612016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=774 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:19.612020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:19.612697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 774 sessionId:  describe result for acl check
2025-09-30T14:52:19.612731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:19.612734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:19.612737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:19.612743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895185708123352:6992] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:19.613258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895185708123352:6992] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:19.614814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:19.615291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895185708123352:6992] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:19.618163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:19.618389Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:19.618402Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:19.618414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:19.618467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:19.618490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895185708123352:6992] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:19.618508Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895185618394126:5744]
2025-09-30T14:52:19.618507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895185708123352:6992] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:19.618510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895185708123352:6992] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:19.618518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 774 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:19.619128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:19.619453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:19.619495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:19.619812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:19.619872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:19.619878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:19.619879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:19.619880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:19.619882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:19.619883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:19.619884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:19.619886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:19.619887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:19.619888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:19.619889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.619890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.619892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.619893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:19.619894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:19.619899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:19.619909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:19.619913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:19.619917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:19.619921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:19.619924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:19.619929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:19.619932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:19.619936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:19.619940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:19.619944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.619948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.619952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.619955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:19.619959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:19.619967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:19.619975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:19.619980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:19.619985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:19.619989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:19.619995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:19.619999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:19.620005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:19.620009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:19.620015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:19.620019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:19.620023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:19.620028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:19.620033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:19.620037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:19.620042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:19.620046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:19.620051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:19.620055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:19.620060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:19.620065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.620070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.620074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.620079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.620084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.620095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.620099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:19.620103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:19.620108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:19.620118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:19.620160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:19.625767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:19.626701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:19.626720Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:19.626722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:19.626727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:19.626734Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 773 [2:7555895185618394126:5744]
2025-09-30T14:52:19.626755Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:19.626771Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:19.626775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:19.626780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:19.626783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:19.626799Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:19.626812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:19.626824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:19.626892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.626900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.626903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.626907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:19.626910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:19.626979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:19.626987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.626998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.627016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.627045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:19.627064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895185708123390:6992], now have 1 active actors on pipe
2025-09-30T14:52:19.627073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895185708123290:2454], now have 1 active actors on pipe
2025-09-30T14:52:19.627080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895185618394120:5744]
2025-09-30T14:52:19.627084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895185618394120:5744]
2025-09-30T14:52:19.627092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895185618394120:5744]
2025-09-30T14:52:19.627106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:19.627116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:19.627119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:19.627122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:19.627128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:19.627144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:19.627155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:19.627188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895185618394120:5744]
2025-09-30T14:52:19.627196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:19.627179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 773
2025-09-30T14:52:19.627180Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 773
2025-09-30T14:52:19.627218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:19.627236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:19.627260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:19.627295Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b847e8b3-b6063d32-18105844-70e6b943_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:19.627307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:19.627311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:19.627314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:19.627324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:19.627334Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:19.627353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:19.627498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:19.627509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:19.627524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:19.627596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 774 partition: 0 MaxSeqNo: 42 sessionId: src_id|b847e8b3-b6063d32-18105844-70e6b943_0
2025-09-30T14:52:19.627958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df8b9a8a-d24f2f6f-69e2c6ad-a775ab0c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b847e8b3-b6063d32-18105844-70e6b943_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:19.630820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b847e8b3-b6063d32-18105844-70e6b943_0] Write session: try to update token
2025-09-30T14:52:19.630839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b847e8b3-b6063d32-18105844-70e6b943_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:19.639562Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:19.639583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:19.639586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:19.639588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:19.639597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895185618394120:5744]
2025-09-30T14:52:19.639601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895185618394120:5744]
2025-09-30T14:52:19.639608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895185618394120:5744]
2025-09-30T14:52:19.639652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:19.639664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.639664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:19.639671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:19.639674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:19.639678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:19.639827Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:19.645086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 774 sessionId: src_id|b847e8b3-b6063d32-18105844-70e6b943_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:19.647886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:19.703497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895185708123402:6573]
2025-09-30T14:52:19.703780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 773, pipe: [1:7555895185708123402:6573]
2025-09-30T14:52:19.749146Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:19.749865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:19.749882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:19.749924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895185708123402:6573], now have 1 active actors on pipe
2025-09-30T14:52:19.750124Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:19.750173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:19.750186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:19.750199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895185708123402:6573]
2025-09-30T14:52:19.750227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:19.750254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 774 reason: error at write: Disconnected sessionId: src_id|b847e8b3-b6063d32-18105844-70e6b943_0
2025-09-30T14:52:19.750450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 774 sessionId: src_id|b847e8b3-b6063d32-18105844-70e6b943_0 is DEAD
2025-09-30T14:52:19.750583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b847e8b3-b6063d32-18105844-70e6b943_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:19.750595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b847e8b3-b6063d32-18105844-70e6b943_0] Write session will restart in 0.009537s
2025-09-30T14:52:19.750619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b847e8b3-b6063d32-18105844-70e6b943_0] Write session: Do CDS request
2025-09-30T14:52:19.750628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b847e8b3-b6063d32-18105844-70e6b943_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:19.761804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b847e8b3-b6063d32-18105844-70e6b943_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:19.761868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:19.761886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 775
2025-09-30T14:52:19.762023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:19.762051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 775 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:19.762089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 775 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:19.762101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=775 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:19.762105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:19.762511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 775 sessionId:  describe result for acl check
2025-09-30T14:52:19.762542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:19.762548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:19.762550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:19.762556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895185708123470:6996] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:19.763066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895185708123470:6996] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:19.765328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895185708123470:6996] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:19.765585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:19.765789Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:19.765802Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:19.765814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:19.765871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:19.765909Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895185618394231:5746]
2025-09-30T14:52:19.766412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:19.766754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:19.766820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:19.767168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:19.767263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:19.767269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:19.767270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:19.767272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:19.767273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:19.767274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:19.767275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:19.767277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:19.767278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:19.767279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:19.767281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.767282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.767283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.767284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:19.767285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:19.767292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:19.767303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:19.767307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:19.767312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:19.767317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:19.767321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:19.767326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:19.767330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:19.767335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:19.767339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:19.767344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.767348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.767352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.767356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:19.767360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:19.767368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:19.767376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:19.767383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:19.767389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:19.767394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:19.767399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:19.767404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:19.767409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:19.767414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:19.767420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:19.767429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:19.767435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:19.767447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:19.767452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:19.767457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:19.767467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:19.767473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:19.767478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:19.767487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:19.767493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:19.767497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.767508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.767512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.767518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.767523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.767529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.767533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:19.767543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:19.767549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:19.767554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:19.767601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:19.768218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895185708123470:6996] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:19.768233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895185708123470:6996] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:19.768236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895185708123470:6996] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:19.768243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 775 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:19.772967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:19.774264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:19.774282Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:19.774285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:19.774288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:19.774295Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 774 [2:7555895185618394231:5746]
2025-09-30T14:52:19.774310Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:19.774338Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:19.774345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:19.774347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:19.774349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:19.774362Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:19.774367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:19.774373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:19.774444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.774450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.774451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.774455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:19.774458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:19.774521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:19.774528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.774542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.774557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.774576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:19.774603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895185708123508:6996], now have 1 active actors on pipe
2025-09-30T14:52:19.774607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895185708123403:2454], now have 1 active actors on pipe
2025-09-30T14:52:19.774613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895185618394225:5746]
2025-09-30T14:52:19.774615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895185618394225:5746]
2025-09-30T14:52:19.774617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895185618394225:5746]
2025-09-30T14:52:19.774631Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:19.774641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:19.774644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:19.774646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:19.774646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:19.774660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:19.774663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:19.774698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895185618394225:5746]
2025-09-30T14:52:19.774714Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:19.774695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 774
2025-09-30T14:52:19.774706Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 774
2025-09-30T14:52:19.774742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:19.774795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:19.774803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:19.774824Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c04491-eaefbbbb-3a2591a1-4ec4be93_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:19.774833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:19.774836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:19.774838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:19.774847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:19.774858Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:19.774873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:19.775033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:19.775041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:19.775053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:19.775137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 775 partition: 0 MaxSeqNo: 42 sessionId: src_id|2c04491-eaefbbbb-3a2591a1-4ec4be93_0
2025-09-30T14:52:19.775499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b847e8b3-b6063d32-18105844-70e6b943_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2c04491-eaefbbbb-3a2591a1-4ec4be93_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:19.778165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c04491-eaefbbbb-3a2591a1-4ec4be93_0] Write session: try to update token
2025-09-30T14:52:19.778182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c04491-eaefbbbb-3a2591a1-4ec4be93_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:19.786761Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:19.786776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:19.786778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:19.786781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:19.786790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895185618394225:5746]
2025-09-30T14:52:19.786795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895185618394225:5746]
2025-09-30T14:52:19.786798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895185618394225:5746]
2025-09-30T14:52:19.786841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:19.786846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:19.786848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.786851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:19.786853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:19.786857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:19.786991Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:19.792416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 775 sessionId: src_id|2c04491-eaefbbbb-3a2591a1-4ec4be93_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:19.795454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:19.850465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895185708123516:6573]
2025-09-30T14:52:19.850799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 774, pipe: [1:7555895185708123516:6573]
2025-09-30T14:52:19.895423Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:19.895926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:19.895940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:19.895976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895185708123516:6573], now have 1 active actors on pipe
2025-09-30T14:52:19.896210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:19.896200Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:19.896223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:19.896233Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:19.896280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895185708123516:6573]
2025-09-30T14:52:19.896294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 775 reason: error at write: Disconnected sessionId: src_id|2c04491-eaefbbbb-3a2591a1-4ec4be93_0
2025-09-30T14:52:19.896461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 775 sessionId: src_id|2c04491-eaefbbbb-3a2591a1-4ec4be93_0 is DEAD
2025-09-30T14:52:19.896616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c04491-eaefbbbb-3a2591a1-4ec4be93_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:19.896627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c04491-eaefbbbb-3a2591a1-4ec4be93_0] Write session will restart in 0.009591s
2025-09-30T14:52:19.896651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c04491-eaefbbbb-3a2591a1-4ec4be93_0] Write session: Do CDS request
2025-09-30T14:52:19.896657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c04491-eaefbbbb-3a2591a1-4ec4be93_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:19.907531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:19.907802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c04491-eaefbbbb-3a2591a1-4ec4be93_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:19.907884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:19.907902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 776
2025-09-30T14:52:19.908040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 776 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:19.908086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 776 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:19.908098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=776 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:19.908102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:19.908600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 776 sessionId:  describe result for acl check
2025-09-30T14:52:19.908635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:19.908636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:19.908637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:19.908642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895185708123585:7000] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:19.909093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895185708123585:7000] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:19.911474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895185708123585:7000] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:19.911619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:19.911836Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:19.911850Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:19.911862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:19.911918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:19.911959Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895185618394336:5748]
2025-09-30T14:52:19.912599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:19.912947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:19.913006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:19.913268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:19.913329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:19.913330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:19.913331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:19.913332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:19.913333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:19.913334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:19.913335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:19.913336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:19.913337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:19.913338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:19.913339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.913340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.913341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.913341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:19.913342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:19.913347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:19.913354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:19.913356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:19.913359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:19.913361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:19.913364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:19.913366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:19.913369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:19.913371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:19.913374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:19.913376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.913379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.913381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.913383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:19.913386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:19.913391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:19.913396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:19.913403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:19.913410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:19.913416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:19.913422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:19.913426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:19.913432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:19.913438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:19.913443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:19.913447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:19.913450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:19.913453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:19.913462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:19.913465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:19.913469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:19.913475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:19.913481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:19.913491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:19.913497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:19.913503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.913512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.913522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.913530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.913538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.913544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.913550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:19.913553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:19.913556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:19.913562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:19.913587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:19.914153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895185708123585:7000] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:19.914170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895185708123585:7000] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:19.914173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895185708123585:7000] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:19.914182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 776 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:19.919171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:19.920010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:19.920023Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:19.920025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:19.920029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:19.920033Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 775 [2:7555895185618394336:5748]
2025-09-30T14:52:19.920047Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:19.920061Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:19.920064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:19.920066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:19.920067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:19.920082Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:19.920087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:19.920094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:19.920140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.920148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.920149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.920152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:19.920154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:19.920214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:19.920221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.920232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:19.920247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:19.920268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:19.920290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895185708123517:2454], now have 1 active actors on pipe
2025-09-30T14:52:19.920297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895185708123623:7000], now have 1 active actors on pipe
2025-09-30T14:52:19.920302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895185618394330:5748]
2025-09-30T14:52:19.920304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895185618394330:5748]
2025-09-30T14:52:19.920305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895185618394330:5748]
2025-09-30T14:52:19.920313Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:19.920325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:19.920328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:19.920334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:19.920335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:19.920337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:19.920339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:19.920367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895185618394330:5748]
2025-09-30T14:52:19.920372Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:19.920366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 775
2025-09-30T14:52:19.920399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:19.920383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 775
2025-09-30T14:52:19.920436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:19.920445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:19.920470Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f3812ca-1dfc31d-f7dcb335-c072f09f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:19.920480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:19.920484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:19.920485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:19.920495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:19.920508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:19.920526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:19.920671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:19.920680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:19.920693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:19.920797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 776 partition: 0 MaxSeqNo: 42 sessionId: src_id|7f3812ca-1dfc31d-f7dcb335-c072f09f_0
2025-09-30T14:52:19.921132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c04491-eaefbbbb-3a2591a1-4ec4be93_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7f3812ca-1dfc31d-f7dcb335-c072f09f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:19.923896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3812ca-1dfc31d-f7dcb335-c072f09f_0] Write session: try to update token
2025-09-30T14:52:19.923917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3812ca-1dfc31d-f7dcb335-c072f09f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:19.932555Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:19.932576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:19.932585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895185618394330:5748]
2025-09-30T14:52:19.932628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:19.932631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:19.932810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:19.932959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:19.933118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:19.933277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:19.933502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:19.933556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:19.938103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 776 sessionId: src_id|7f3812ca-1dfc31d-f7dcb335-c072f09f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:19.940844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:19.941064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:19.941083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:19.941118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:19.941213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:19.943159Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:19.943175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:19.943178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:19.943180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:19.943189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895185618394330:5748]
2025-09-30T14:52:19.943194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895185618394330:5748]
2025-09-30T14:52:19.943198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895185618394330:5748]
2025-09-30T14:52:19.943237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:19.943261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:19.943264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:19.943401Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:19.943408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:19.943415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:19.943418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:19.996341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895185708123650:6573]
2025-09-30T14:52:19.996591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 775, pipe: [1:7555895185708123650:6573]
2025-09-30T14:52:20.051343Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:20.059805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:20.059836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:20.060021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:20.060102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:20.060173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:20.060249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:20.060305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:20.060315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:20.060393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:20.060461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:20.060529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:20.060603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:20.060655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:20.060664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:20.060742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:20.060808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:20.060875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:20.060945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:20.060996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:20.061004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:20.061079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:20.061149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:20.061215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:20.061288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:20.061338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:20.061346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:20.061421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:20.061486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:20.061552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:20.061623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:20.061675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:20.061683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:20.061760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:20.061836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:20.061910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:20.061985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:20.062037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:20.062045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:20.062120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:20.062193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:20.062269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:20.062359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:20.062412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:20.062420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:20.062496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:20.062566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:20.062643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:20.062717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:20.062769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:20.062778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:20.062855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:20.062926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:20.063001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:20.063076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:20.063125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:20.063133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:20.063208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:20.063296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:20.063372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:20.063449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:20.063498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:20.063507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:20.063572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895185708123650:6573], now have 1 active actors on pipe
2025-09-30T14:52:20.063826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895185708123650:6573]
2025-09-30T14:52:20.063849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:20.063871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:20.063874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:20.063905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 776 reason: error at write: Disconnected sessionId: src_id|7f3812ca-1dfc31d-f7dcb335-c072f09f_0
2025-09-30T14:52:20.064094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 776 sessionId: src_id|7f3812ca-1dfc31d-f7dcb335-c072f09f_0 is DEAD
2025-09-30T14:52:20.064231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3812ca-1dfc31d-f7dcb335-c072f09f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:20.064257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3812ca-1dfc31d-f7dcb335-c072f09f_0] Write session will restart in 0.009589s
2025-09-30T14:52:20.064282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3812ca-1dfc31d-f7dcb335-c072f09f_0] Write session: Do CDS request
2025-09-30T14:52:20.064287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3812ca-1dfc31d-f7dcb335-c072f09f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:20.064973Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:20.074797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3812ca-1dfc31d-f7dcb335-c072f09f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:20.074881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:20.074898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 777
2025-09-30T14:52:20.075036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 777 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:20.075074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 777 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:20.075081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=777 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:20.075085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:20.075482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 777 sessionId:  describe result for acl check
2025-09-30T14:52:20.075523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:20.075530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:20.075532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:20.075538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895190003091017:7007] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:20.075854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:20.076080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895190003091017:7007] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:20.078372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895190003091017:7007] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:20.079221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:20.079448Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:20.079459Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:20.079471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:20.079534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:20.079576Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895189913361751:5751]
2025-09-30T14:52:20.080165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:20.080566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:20.080623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:20.080963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:20.081053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:20.081062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:20.081050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895190003091017:7007] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:20.081063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:20.081064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:20.081065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:20.081063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895190003091017:7007] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:20.081066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895190003091017:7007] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:20.081072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 777 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:20.081066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:20.081068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:20.081069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:20.081070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:20.081071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:20.081072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.081073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.081074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.081076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:20.081077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:20.081082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:20.081093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:20.081098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:20.081102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:20.081106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:20.081110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:20.081114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:20.081118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:20.081122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:20.081126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:20.081130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.081134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.081138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.081142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:20.081146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:20.081155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:20.081164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:20.081169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:20.081175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:20.081180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:20.081185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:20.081190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:20.081195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:20.081200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:20.081205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:20.081209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:20.081215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:20.081219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:20.081224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:20.081229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:20.081234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:20.081239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:20.081245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:20.081250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:20.081255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:20.081262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.081267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.081271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.081275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.081286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.081294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.081299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:20.081308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:20.081318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:20.081326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:20.081373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:20.086983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:20.088090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:20.088106Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:20.088110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:20.088114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:20.088121Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 776 [2:7555895189913361751:5751]
2025-09-30T14:52:20.088138Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:20.088155Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:20.088159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:20.088162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:20.088164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:20.088181Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:20.088194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:20.088201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:20.088272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.088280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.088282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.088286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:20.088289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:20.088356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:20.088369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.088383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.088397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.088415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:20.088432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895190003090947:2454], now have 1 active actors on pipe
2025-09-30T14:52:20.088441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895190003091055:7007], now have 1 active actors on pipe
2025-09-30T14:52:20.088447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895189913361745:5751]
2025-09-30T14:52:20.088450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895189913361745:5751]
2025-09-30T14:52:20.088452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895189913361745:5751]
2025-09-30T14:52:20.088468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:20.088485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:20.088494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:20.088499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:20.088501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:20.088507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:20.088514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:20.088550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895189913361745:5751]
2025-09-30T14:52:20.088523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 776
2025-09-30T14:52:20.088558Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:20.088572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 776
2025-09-30T14:52:20.088561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:20.088611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:20.088621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:20.088646Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1068d010-d5e54ae0-89d01cd6-f8fd05de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:20.088657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:20.088661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:20.088664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:20.088672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:20.088689Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:20.088707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:20.088856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:20.088868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:20.088886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:20.088977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 777 partition: 0 MaxSeqNo: 42 sessionId: src_id|1068d010-d5e54ae0-89d01cd6-f8fd05de_0
2025-09-30T14:52:20.089309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3812ca-1dfc31d-f7dcb335-c072f09f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1068d010-d5e54ae0-89d01cd6-f8fd05de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:20.092079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1068d010-d5e54ae0-89d01cd6-f8fd05de_0] Write session: try to update token
2025-09-30T14:52:20.092096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1068d010-d5e54ae0-89d01cd6-f8fd05de_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:20.100867Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:20.100882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:20.100893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895189913361745:5751]
2025-09-30T14:52:20.100937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:20.100936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:20.101119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:20.101273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:20.101422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:20.101619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:20.101934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:20.101987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:20.106599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 777 sessionId: src_id|1068d010-d5e54ae0-89d01cd6-f8fd05de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:20.109431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:20.109674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:20.109696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:20.109733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:20.109831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:20.112525Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:20.112544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:20.112547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:20.112549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:20.112560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895189913361745:5751]
2025-09-30T14:52:20.112564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895189913361745:5751]
2025-09-30T14:52:20.112568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895189913361745:5751]
2025-09-30T14:52:20.112611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:20.112623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.112631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:20.112633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:20.112644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:20.112649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:20.112782Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:20.163786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895190003091065:6573]
2025-09-30T14:52:20.164088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 776, pipe: [1:7555895190003091065:6573]
2025-09-30T14:52:20.221471Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:20.228805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:20.228830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:20.228985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:20.229047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:20.229111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:20.229172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:20.229219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:20.229227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:20.229293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:20.229353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:20.229418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:20.229481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:20.229527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:20.229535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:20.229597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:20.229655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:20.229717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:20.229777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:20.229818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:20.229823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:20.229888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:20.229950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:20.230009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:20.230072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:20.230120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:20.230126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:20.230191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:20.230258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:20.230355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:20.230430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:20.230478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:20.230487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:20.230566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:20.230640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:20.230715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:20.230788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:20.230837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:20.230845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:20.230919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:20.230989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:20.231062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:20.231122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:20.231165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:20.231172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:20.231234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:20.231306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:20.231363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:20.231425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:20.231468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:20.231474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:20.231535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:20.231593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:20.231654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:20.231720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:20.231761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:20.231769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:20.231830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:20.231894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:20.231967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:20.232036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:20.232082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:20.232087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:20.232138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895190003091065:6573], now have 1 active actors on pipe
2025-09-30T14:52:20.232369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:20.232391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:20.232394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:20.232418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 777 reason: error at write: Disconnected sessionId: src_id|1068d010-d5e54ae0-89d01cd6-f8fd05de_0
2025-09-30T14:52:20.232418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895190003091065:6573]
2025-09-30T14:52:20.232559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 777 sessionId: src_id|1068d010-d5e54ae0-89d01cd6-f8fd05de_0 is DEAD
2025-09-30T14:52:20.232689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1068d010-d5e54ae0-89d01cd6-f8fd05de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:20.232699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1068d010-d5e54ae0-89d01cd6-f8fd05de_0] Write session will restart in 0.008277s
2025-09-30T14:52:20.232716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1068d010-d5e54ae0-89d01cd6-f8fd05de_0] Write session: Do CDS request
2025-09-30T14:52:20.232720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1068d010-d5e54ae0-89d01cd6-f8fd05de_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:20.232998Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:20.241729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1068d010-d5e54ae0-89d01cd6-f8fd05de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:20.241819Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:20.241832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 778
2025-09-30T14:52:20.241939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 778 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:20.241988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 778 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:20.241993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=778 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:20.241997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:20.242360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 778 sessionId:  describe result for acl check
2025-09-30T14:52:20.242397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:20.242401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:20.242403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:20.242409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895190003091132:7011] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:20.242880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895190003091132:7011] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:20.243789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:20.245075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895190003091132:7011] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:20.247569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:20.247771Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:20.247781Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:20.247792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:20.247816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895190003091132:7011] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:20.247842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:20.247828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895190003091132:7011] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:20.247830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895190003091132:7011] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:20.247837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 778 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:20.247882Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895189913361861:5754]
2025-09-30T14:52:20.248493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:20.248786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:20.248832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:20.249102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:20.249161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:20.249168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:20.249169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:20.249170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:20.249172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:20.249173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:20.249174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:20.249176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:20.249177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:20.249178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:20.249180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.249181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.249182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.249184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:20.249185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:20.249190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:20.249201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:20.249205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:20.249209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:20.249213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:20.249218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:20.249222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:20.249230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:20.249234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:20.249243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:20.249248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.249251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.249255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.249260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:20.249269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:20.249281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:20.249294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:20.249304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:20.249310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:20.249314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:20.249318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:20.249326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:20.249331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:20.249339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:20.249349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:20.249354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:20.249363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:20.249372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:20.249381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:20.249389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:20.249395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:20.249402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:20.249407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:20.249410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:20.249415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:20.249419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.249428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.249432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.249440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.249444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.249452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.249456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:20.249466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:20.249475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:20.249480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:20.249525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:20.254833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:20.255699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:20.255716Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:20.255720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:20.255724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:20.255732Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 777 [2:7555895189913361861:5754]
2025-09-30T14:52:20.255754Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:20.255774Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:20.255781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:20.255785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:20.255787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:20.255804Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:20.255817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:20.255828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:20.255893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.255901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.255904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.255907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:20.255909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:20.255973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:20.255980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.255993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.256005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.256028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:20.256049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895190003091170:7011], now have 1 active actors on pipe
2025-09-30T14:52:20.256057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895190003091066:2454], now have 1 active actors on pipe
2025-09-30T14:52:20.256064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895189913361855:5754]
2025-09-30T14:52:20.256066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895189913361855:5754]
2025-09-30T14:52:20.256068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895189913361855:5754]
2025-09-30T14:52:20.256080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:20.256097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:20.256101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:20.256108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:20.256110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:20.256117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:20.256120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:20.256119Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 777
2025-09-30T14:52:20.256151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895189913361855:5754]
2025-09-30T14:52:20.256159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:20.256132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 777
2025-09-30T14:52:20.256163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:20.256177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:20.256182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:20.256229Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be461c02-1d1f7c0f-259df8f2-96d64255_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:20.256243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:20.256247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:20.256249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:20.256258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:20.256267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:20.256289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:20.256465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:20.256476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:20.256490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:20.256572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 778 partition: 0 MaxSeqNo: 42 sessionId: src_id|be461c02-1d1f7c0f-259df8f2-96d64255_0
2025-09-30T14:52:20.256938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1068d010-d5e54ae0-89d01cd6-f8fd05de_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|be461c02-1d1f7c0f-259df8f2-96d64255_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:20.259840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be461c02-1d1f7c0f-259df8f2-96d64255_0] Write session: try to update token
2025-09-30T14:52:20.259865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be461c02-1d1f7c0f-259df8f2-96d64255_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:20.268087Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:20.268107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:20.268111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:20.268113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:20.268122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895189913361855:5754]
2025-09-30T14:52:20.268132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895189913361855:5754]
2025-09-30T14:52:20.268136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895189913361855:5754]
2025-09-30T14:52:20.268178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:20.268184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.268187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:20.268187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:20.268194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:20.268198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:20.268341Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:20.276389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 778 sessionId: src_id|be461c02-1d1f7c0f-259df8f2-96d64255_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:20.278915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:20.332730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895190003091196:6573]
2025-09-30T14:52:20.333004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 777, pipe: [1:7555895190003091196:6573]
2025-09-30T14:52:20.379471Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:20.380427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:20.380442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:20.380459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895190003091196:6573], now have 1 active actors on pipe
2025-09-30T14:52:20.380752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895190003091196:6573]
2025-09-30T14:52:20.380786Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:20.380787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:20.380793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:20.380819Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:20.380876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 778 reason: error at write: Disconnected sessionId: src_id|be461c02-1d1f7c0f-259df8f2-96d64255_0
2025-09-30T14:52:20.381035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 778 sessionId: src_id|be461c02-1d1f7c0f-259df8f2-96d64255_0 is DEAD
2025-09-30T14:52:20.381301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be461c02-1d1f7c0f-259df8f2-96d64255_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:20.381313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be461c02-1d1f7c0f-259df8f2-96d64255_0] Write session will restart in 0.007754s
2025-09-30T14:52:20.381333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be461c02-1d1f7c0f-259df8f2-96d64255_0] Write session: Do CDS request
2025-09-30T14:52:20.381337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be461c02-1d1f7c0f-259df8f2-96d64255_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:20.389895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be461c02-1d1f7c0f-259df8f2-96d64255_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:20.389969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:20.389983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 779
2025-09-30T14:52:20.390112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 779 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:20.390137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 779 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:20.390144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=779 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:20.390147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:20.390545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 779 sessionId:  describe result for acl check
2025-09-30T14:52:20.390581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:20.390589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:20.390591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:20.390597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895190003091273:7022] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:20.391052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895190003091273:7022] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:20.392114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:20.393141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895190003091273:7022] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:20.398617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:20.398808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895190003091273:7022] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:20.398823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895190003091273:7022] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:20.398826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895190003091273:7022] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:20.398832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 779 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:20.398847Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:20.398858Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:20.398869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:20.398924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:20.398970Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895189913362006:5768]
2025-09-30T14:52:20.399649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:20.399956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:20.400008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:20.400367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:20.400439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:20.400444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:20.400446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:20.400447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:20.400448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:20.400450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:20.400451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:20.400452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:20.400454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:20.400455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:20.400456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.400458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.400459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.400460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:20.400462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:20.400467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:20.400478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:20.400483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:20.400487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:20.400492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:20.400496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:20.400500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:20.400504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:20.400508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:20.400514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:20.400518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.400522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.400527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.400531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:20.400535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:20.400545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:20.400559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:20.400570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:20.400579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:20.400589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:20.400599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:20.400609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:20.400614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:20.400619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:20.400630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:20.400639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:20.400648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:20.400657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:20.400668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:20.400672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:20.400683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:20.400688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:20.400693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:20.400698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:20.400707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:20.400716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.400726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.400734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.400741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.400749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.400757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.400765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:20.400770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:20.400779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:20.400784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:20.400833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:20.406098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:20.407431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:20.407443Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:20.407445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:20.407449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:20.407455Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 778 [2:7555895189913362006:5768]
2025-09-30T14:52:20.407469Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:20.407482Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:20.407484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:20.407487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:20.407489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:20.407501Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:20.407506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:20.407512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:20.407569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.407570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.407572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.407576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:20.407578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:20.407636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:20.407646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.407656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.407663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.407673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:20.407685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895189913362000:5768]
2025-09-30T14:52:20.407687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895189913362000:5768]
2025-09-30T14:52:20.407688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895189913362000:5768]
2025-09-30T14:52:20.407695Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:20.407704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:20.407711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:20.407713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:20.407715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:20.407724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:20.407727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:20.407742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895189913362000:5768]
2025-09-30T14:52:20.407745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:20.407748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:20.407753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895190003091311:7022], now have 1 active actors on pipe
2025-09-30T14:52:20.407757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895190003091206:2454], now have 1 active actors on pipe
2025-09-30T14:52:20.407855Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 778
2025-09-30T14:52:20.407886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 778
2025-09-30T14:52:20.407981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:20.407994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:20.408020Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11895582-6455b589-ddbfe8c9-b6fde378_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:20.408035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:20.408047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:20.408050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:20.408061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:20.408072Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:20.408090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:20.408305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:20.408315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:20.408332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:20.408434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 779 partition: 0 MaxSeqNo: 42 sessionId: src_id|11895582-6455b589-ddbfe8c9-b6fde378_0
2025-09-30T14:52:20.408822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be461c02-1d1f7c0f-259df8f2-96d64255_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|11895582-6455b589-ddbfe8c9-b6fde378_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:20.411575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11895582-6455b589-ddbfe8c9-b6fde378_0] Write session: try to update token
2025-09-30T14:52:20.411593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11895582-6455b589-ddbfe8c9-b6fde378_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:20.420536Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:20.420556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:20.420558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:20.420564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:20.420572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895189913362000:5768]
2025-09-30T14:52:20.420576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895189913362000:5768]
2025-09-30T14:52:20.420580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895189913362000:5768]
2025-09-30T14:52:20.420619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:20.420626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.420626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:20.420629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:20.420633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:20.420639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:20.420978Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:20.431560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 779 sessionId: src_id|11895582-6455b589-ddbfe8c9-b6fde378_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:20.434088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:20.480702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895190003091325:6573]
2025-09-30T14:52:20.480943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 778, pipe: [1:7555895190003091325:6573]
2025-09-30T14:52:20.535022Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:20.536038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:20.536059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:20.536079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895190003091325:6573], now have 1 active actors on pipe
2025-09-30T14:52:20.536321Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:20.536324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895190003091325:6573]
2025-09-30T14:52:20.536333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:20.536337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:20.536357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:20.536411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 779 reason: error at write: Disconnected sessionId: src_id|11895582-6455b589-ddbfe8c9-b6fde378_0
2025-09-30T14:52:20.536583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 779 sessionId: src_id|11895582-6455b589-ddbfe8c9-b6fde378_0 is DEAD
2025-09-30T14:52:20.536842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11895582-6455b589-ddbfe8c9-b6fde378_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:20.536858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11895582-6455b589-ddbfe8c9-b6fde378_0] Write session will restart in 0.008689s
2025-09-30T14:52:20.536890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11895582-6455b589-ddbfe8c9-b6fde378_0] Write session: Do CDS request
2025-09-30T14:52:20.536907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11895582-6455b589-ddbfe8c9-b6fde378_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:20.546757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11895582-6455b589-ddbfe8c9-b6fde378_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:20.546778Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:20.546793Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 780
2025-09-30T14:52:20.546962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 780 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:20.546997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 780 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:20.547005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=780 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:20.547009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:20.547455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 780 sessionId:  describe result for acl check
2025-09-30T14:52:20.547491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:20.547500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:20.547501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:20.547507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895190003091394:7027] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:20.548058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895190003091394:7027] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:20.548803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:20.550008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895190003091394:7027] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:20.552176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:20.552441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895190003091394:7027] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:20.552459Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:20.552457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895190003091394:7027] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:20.552460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895190003091394:7027] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:20.552468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 780 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:20.552469Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:20.552482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:20.552547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:20.552591Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895189913362118:5770]
2025-09-30T14:52:20.553250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:20.553563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:20.553607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:20.553941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:20.553997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:20.554003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:20.554004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:20.554005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:20.554006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:20.554008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:20.554009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:20.554010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:20.554011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:20.554012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:20.554014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.554014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.554015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.554016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:20.554018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:20.554023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:20.554034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:20.554038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:20.554042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:20.554046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:20.554050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:20.554055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:20.554058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:20.554063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:20.554068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:20.554072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.554075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.554079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.554084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:20.554088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:20.554095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:20.554104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:20.554112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:20.554122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:20.554127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:20.554135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:20.554141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:20.554147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:20.554156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:20.554161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:20.554169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:20.554174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:20.554181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:20.554186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:20.554194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:20.554199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:20.554205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:20.554210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:20.554218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:20.554223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:20.554230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.554236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.554243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.554248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.554252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.554258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.554262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:20.554268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:20.554277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:20.554285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:20.554341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:20.559562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:20.560892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:20.560903Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:20.560905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:20.560908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:20.560916Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 779 [2:7555895189913362118:5770]
2025-09-30T14:52:20.560929Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:20.560940Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:20.560942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:20.560944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:20.560945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:20.560957Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:20.560961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:20.560967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:20.561022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.561029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.561031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.561034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:20.561036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:20.561098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:20.561107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.561121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.561133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.561145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:20.561158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895190003091432:7027], now have 1 active actors on pipe
2025-09-30T14:52:20.561166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895190003091326:2454], now have 1 active actors on pipe
2025-09-30T14:52:20.561171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895189913362113:5770]
2025-09-30T14:52:20.561172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895189913362113:5770]
2025-09-30T14:52:20.561174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895189913362113:5770]
2025-09-30T14:52:20.561188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:20.561197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:20.561205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:20.561207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:20.561208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:20.561212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:20.561215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:20.561230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895189913362113:5770]
2025-09-30T14:52:20.561232Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:20.561244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:20.561219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 779
2025-09-30T14:52:20.561227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 779
2025-09-30T14:52:20.561283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:20.561290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:20.561308Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8b38c60-4a592d2f-9de48f01-3460345a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:20.561318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:20.561320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:20.561322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:20.561329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:20.561337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:20.561350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:20.561525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:20.561535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:20.561552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:20.561645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 780 partition: 0 MaxSeqNo: 42 sessionId: src_id|e8b38c60-4a592d2f-9de48f01-3460345a_0
2025-09-30T14:52:20.561960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11895582-6455b589-ddbfe8c9-b6fde378_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e8b38c60-4a592d2f-9de48f01-3460345a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:20.564778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8b38c60-4a592d2f-9de48f01-3460345a_0] Write session: try to update token
2025-09-30T14:52:20.564798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8b38c60-4a592d2f-9de48f01-3460345a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:20.576163Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:20.576178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:20.576186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895189913362113:5770]
2025-09-30T14:52:20.576226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:20.576234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:20.576427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:20.576569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:20.576715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:20.576851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:20.577035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:20.577071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:20.579538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 780 sessionId: src_id|e8b38c60-4a592d2f-9de48f01-3460345a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:20.582259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:20.582523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:20.582544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:20.583880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:20.583920Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:20.583923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:20.583926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:20.583929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:20.583936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895189913362113:5770]
2025-09-30T14:52:20.583938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895189913362113:5770]
2025-09-30T14:52:20.583941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895189913362113:5770]
2025-09-30T14:52:20.584024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:20.583970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:20.583973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:20.583979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.583980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:20.583983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:20.583988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:20.584154Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:20.636350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895190003091444:6573]
2025-09-30T14:52:20.636602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 779, pipe: [1:7555895190003091444:6573]
2025-09-30T14:52:20.689243Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:20.696923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:20.696950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:20.697120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:20.697178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:20.697238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:20.697298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:20.697342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:20.697349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:20.697417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:20.697480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:20.697540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:20.697604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:20.697729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:20.697736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:20.697799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:20.697856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:20.697916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:20.697978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:20.698020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:20.698026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:20.698086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:20.698163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:20.698220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:20.698281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:20.698411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:20.698418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:20.698483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:20.698543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:20.698603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:20.698662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:20.698706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:20.698711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:20.698773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:20.698832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:20.698892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:20.698950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:20.698996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:20.698998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:20.699060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:20.699116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:20.699173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:20.699232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:20.699300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:20.699308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:20.699383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:20.699438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:20.699497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:20.699556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:20.699603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:20.699611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:20.699674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:20.699729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:20.699786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:20.699893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:20.699943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:20.699950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:20.700022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:20.700089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:20.700156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:20.700228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:20.700278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:20.700286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:20.700347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895190003091444:6573], now have 1 active actors on pipe
2025-09-30T14:52:20.700629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895190003091444:6573]
2025-09-30T14:52:20.700674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:20.700679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:20.700715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 780 reason: error at write: Disconnected sessionId: src_id|e8b38c60-4a592d2f-9de48f01-3460345a_0
2025-09-30T14:52:20.700777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:20.700893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 780 sessionId: src_id|e8b38c60-4a592d2f-9de48f01-3460345a_0 is DEAD
2025-09-30T14:52:20.701098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8b38c60-4a592d2f-9de48f01-3460345a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:20.701108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8b38c60-4a592d2f-9de48f01-3460345a_0] Write session will restart in 0.007091s
2025-09-30T14:52:20.701143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8b38c60-4a592d2f-9de48f01-3460345a_0] Write session: Do CDS request
2025-09-30T14:52:20.701149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8b38c60-4a592d2f-9de48f01-3460345a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:20.701394Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:20.709751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8b38c60-4a592d2f-9de48f01-3460345a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:20.709829Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:20.709847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 781
2025-09-30T14:52:20.709958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 781 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:20.709989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 781 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:20.709999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=781 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:20.710003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:20.710465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 781 sessionId:  describe result for acl check
2025-09-30T14:52:20.710504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:20.710510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:20.710512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:20.710517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895190003091494:7031] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:20.711043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895190003091494:7031] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:20.713340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895190003091494:7031] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:20.713414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:20.716434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:20.716618Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:20.716630Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:20.716641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:20.716691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:20.716726Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895189913362229:5773]
2025-09-30T14:52:20.716718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895190003091494:7031] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:20.716740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895190003091494:7031] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:20.716744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895190003091494:7031] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:20.716751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 781 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:20.717324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:20.717569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:20.717611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:20.717907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:20.717965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:20.717972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:20.717973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:20.717974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:20.717976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:20.717977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:20.717978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:20.717980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:20.717981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:20.717982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:20.717983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.717984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.717986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.717987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:20.717988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:20.717992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:20.718002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:20.718006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:20.718010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:20.718013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:20.718017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:20.718021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:20.718024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:20.718028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:20.718032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:20.718035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.718039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.718043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.718047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:20.718051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:20.718057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:20.718065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:20.718071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:20.718076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:20.718081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:20.718086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:20.718090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:20.718095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:20.718099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:20.718103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:20.718108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:20.718113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:20.718117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:20.718123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:20.718132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:20.718138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:20.718142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:20.718148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:20.718156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:20.718162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:20.718171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.718176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.718180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.718190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.718196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.718205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.718210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:20.718219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:20.718224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:20.718234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:20.718274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:20.723480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:20.724670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:20.724688Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:20.724691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:20.724694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:20.724701Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 780 [2:7555895189913362229:5773]
2025-09-30T14:52:20.724716Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:20.724729Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:20.724732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:20.724739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:20.724741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:20.724755Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:20.724767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:20.724778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:20.724833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.724841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.724843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.724846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:20.724849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:20.724911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:20.724919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.724932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.724949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.724972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:20.724995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895190003091552:7031], now have 1 active actors on pipe
2025-09-30T14:52:20.725003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895190003091445:2454], now have 1 active actors on pipe
2025-09-30T14:52:20.725009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895189913362224:5773]
2025-09-30T14:52:20.725016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895189913362224:5773]
2025-09-30T14:52:20.725018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895189913362224:5773]
2025-09-30T14:52:20.725031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:20.725044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:20.725050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:20.725055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:20.725057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:20.725066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:20.725068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:20.725095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895189913362224:5773]
2025-09-30T14:52:20.725107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:20.725099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 780
2025-09-30T14:52:20.725132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:20.725148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:20.725153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:20.725110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 780
2025-09-30T14:52:20.725179Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51068ee-6a3c801f-b6fa02d-acca4a51_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:20.725191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:20.725195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:20.725197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:20.725207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:20.725216Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:20.725230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:20.725371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:20.725379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:20.725391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:20.725470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 781 partition: 0 MaxSeqNo: 42 sessionId: src_id|51068ee-6a3c801f-b6fa02d-acca4a51_0
2025-09-30T14:52:20.725845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8b38c60-4a592d2f-9de48f01-3460345a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|51068ee-6a3c801f-b6fa02d-acca4a51_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:20.728545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51068ee-6a3c801f-b6fa02d-acca4a51_0] Write session: try to update token
2025-09-30T14:52:20.728561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51068ee-6a3c801f-b6fa02d-acca4a51_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:20.736719Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:20.736738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:20.736747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895189913362224:5773]
2025-09-30T14:52:20.736790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:20.736794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:20.737135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:20.737293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:20.737440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:20.737581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:20.737782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:20.737826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:20.743936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 781 sessionId: src_id|51068ee-6a3c801f-b6fa02d-acca4a51_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:20.746551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:20.747321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:20.747342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:20.747363Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:20.747366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:20.747369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:20.747371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:20.747380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895189913362224:5773]
2025-09-30T14:52:20.747385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895189913362224:5773]
2025-09-30T14:52:20.747393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895189913362224:5773]
2025-09-30T14:52:20.747431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:20.747440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:20.747443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:20.747448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:20.747448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.747451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:20.747590Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:20.800649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895190003091564:6573]
2025-09-30T14:52:20.800871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 780, pipe: [1:7555895190003091564:6573]
2025-09-30T14:52:20.853493Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:20.853897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:20.853928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895190003091564:6573], now have 1 active actors on pipe
2025-09-30T14:52:20.854037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:20.854087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895190003091564:6573]
2025-09-30T14:52:20.854122Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:20.854131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:20.854134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:20.854195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 781 reason: error at write: Disconnected sessionId: src_id|51068ee-6a3c801f-b6fa02d-acca4a51_0
2025-09-30T14:52:20.854356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 781 sessionId: src_id|51068ee-6a3c801f-b6fa02d-acca4a51_0 is DEAD
2025-09-30T14:52:20.854489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51068ee-6a3c801f-b6fa02d-acca4a51_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:20.854499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51068ee-6a3c801f-b6fa02d-acca4a51_0] Write session will restart in 0.006050s
2025-09-30T14:52:20.854523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51068ee-6a3c801f-b6fa02d-acca4a51_0] Write session: Do CDS request
2025-09-30T14:52:20.854529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51068ee-6a3c801f-b6fa02d-acca4a51_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:20.861753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51068ee-6a3c801f-b6fa02d-acca4a51_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:20.861834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:20.861847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 782
2025-09-30T14:52:20.862212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 782 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:20.862246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 782 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:20.862255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=782 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:20.862258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:20.862750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 782 sessionId:  describe result for acl check
2025-09-30T14:52:20.862793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:20.862800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:20.862802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:20.862808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895190003091635:7035] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:20.863356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895190003091635:7035] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:20.864429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:20.865399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895190003091635:7035] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:20.867796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:20.867944Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:20.867953Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:20.867972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:20.868016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:20.868046Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895189913362341:5775]
2025-09-30T14:52:20.868035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895190003091635:7035] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:20.868047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895190003091635:7035] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:20.868049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895190003091635:7035] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:20.868055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 782 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:20.868510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:20.868745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:20.868778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:20.869037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:20.869081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:20.869085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:20.869086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:20.869087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:20.869087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:20.869088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:20.869089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:20.869089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:20.869090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:20.869091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:20.869091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.869092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.869092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.869093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:20.869094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:20.869097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:20.869103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:20.869106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:20.869109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:20.869111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:20.869113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:20.869116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:20.869118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:20.869120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:20.869123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:20.869125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.869128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.869130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.869133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:20.869135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:20.869141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:20.869146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:20.869150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:20.869153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:20.869155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:20.869158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:20.869161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:20.869164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:20.869166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:20.869169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:20.869172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:20.869175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:20.869177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:20.869180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:20.869182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:20.869185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:20.869188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:20.869191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:20.869194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:20.869197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:20.869199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.869202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.869205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.869207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.869210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.869213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.869218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:20.869223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:20.869227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:20.869233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:20.869260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:20.874346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:20.875619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:20.875638Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:20.875643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:20.875647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:20.875653Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 781 [2:7555895189913362341:5775]
2025-09-30T14:52:20.875670Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:20.875684Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:20.875692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:20.875695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:20.875697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:20.875711Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:20.875722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:20.875733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:20.875785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.875793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.875795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.875798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:20.875801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:20.875862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:20.875868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.875879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:20.875895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:20.875915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:20.875939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895190003091565:2454], now have 1 active actors on pipe
2025-09-30T14:52:20.875946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895190003091673:7035], now have 1 active actors on pipe
2025-09-30T14:52:20.875951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895189913362335:5775]
2025-09-30T14:52:20.875953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895189913362335:5775]
2025-09-30T14:52:20.875955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895189913362335:5775]
2025-09-30T14:52:20.875970Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:20.875987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:20.875996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:20.876001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:20.876003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:20.876004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:20.876006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:20.875997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 781
2025-09-30T14:52:20.876029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895189913362335:5775]
2025-09-30T14:52:20.876037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:20.876001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 781
2025-09-30T14:52:20.876048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:20.876060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:20.876064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:20.876099Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb1d257b-d54047a8-97fa15d9-ac69f206_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:20.876110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:20.876113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:20.876115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:20.876124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:20.876133Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:20.876151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:20.876278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:20.876285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:20.876297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:20.876386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 782 partition: 0 MaxSeqNo: 42 sessionId: src_id|fb1d257b-d54047a8-97fa15d9-ac69f206_0
2025-09-30T14:52:20.876713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51068ee-6a3c801f-b6fa02d-acca4a51_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fb1d257b-d54047a8-97fa15d9-ac69f206_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:20.879447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb1d257b-d54047a8-97fa15d9-ac69f206_0] Write session: try to update token
2025-09-30T14:52:20.879463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb1d257b-d54047a8-97fa15d9-ac69f206_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:20.887547Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:20.887567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:20.887570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:20.887572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:20.887581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895189913362335:5775]
2025-09-30T14:52:20.887585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895189913362335:5775]
2025-09-30T14:52:20.887589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895189913362335:5775]
2025-09-30T14:52:20.887632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:20.887640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:20.887641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:20.887646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:20.887647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:20.887654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:20.887784Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:20.893481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 782 sessionId: src_id|fb1d257b-d54047a8-97fa15d9-ac69f206_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:20.896288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:20.954257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895190003091686:6573]
2025-09-30T14:52:20.954467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 781, pipe: [1:7555895190003091686:6573]
2025-09-30T14:52:20.992182Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:20.992419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:20.992444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:20.992476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895190003091686:6573], now have 1 active actors on pipe
2025-09-30T14:52:20.992654Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:20.992714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:20.992723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895190003091686:6573]
2025-09-30T14:52:20.992742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:20.992808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 782 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fb1d257b-d54047a8-97fa15d9-ac69f206_0
2025-09-30T14:52:20.992970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 782 sessionId: src_id|fb1d257b-d54047a8-97fa15d9-ac69f206_0 is DEAD
2025-09-30T14:52:20.993117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb1d257b-d54047a8-97fa15d9-ac69f206_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:20.993128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb1d257b-d54047a8-97fa15d9-ac69f206_0] Write session will restart in 0.009479s
2025-09-30T14:52:20.993152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb1d257b-d54047a8-97fa15d9-ac69f206_0] Write session: Do CDS request
2025-09-30T14:52:20.993158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb1d257b-d54047a8-97fa15d9-ac69f206_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:21.003781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb1d257b-d54047a8-97fa15d9-ac69f206_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:21.003883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:21.003899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 783
2025-09-30T14:52:21.004013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 783 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:21.004045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 783 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:21.004055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=783 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:21.004063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:21.004253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:21.004463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 783 sessionId:  describe result for acl check
2025-09-30T14:52:21.004497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:21.004499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:21.004501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:21.004506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895194298059080:7042] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:21.004973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895194298059080:7042] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:21.007015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895194298059080:7042] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:21.007757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:21.007938Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:21.007946Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:21.007954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:21.008008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:21.008042Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895194208329763:5778]
2025-09-30T14:52:21.008529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:21.008931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:21.008986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:21.009230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895194298059080:7042] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:21.009247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895194298059080:7042] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:21.009250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895194298059080:7042] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:21.009257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 783 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:21.009318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:21.009388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:21.009393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:21.009395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:21.009396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:21.009397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:21.009398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:21.009400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:21.009401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:21.009403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:21.009404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:21.009405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.009407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.009408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.009409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:21.009411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:21.009416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:21.009426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:21.009430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:21.009435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:21.009439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:21.009444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:21.009463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:21.009468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:21.009476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:21.009482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:21.009490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.009493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.009502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.009508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:21.009516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:21.009524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:21.009536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:21.009547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:21.009552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:21.009561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:21.009566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:21.009571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:21.009577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:21.009582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:21.009591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:21.009596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:21.009606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:21.009611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:21.009617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:21.009625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:21.009631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:21.009640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:21.009650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:21.009658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:21.009663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:21.009668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.009677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.009681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.009687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.009698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.009703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.009709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:21.009715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:21.009724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:21.009731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:21.009775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:21.015124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:21.016448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:21.016466Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:21.016470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:21.016473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:21.016479Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 782 [2:7555895194208329763:5778]
2025-09-30T14:52:21.016494Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:21.016509Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:21.016512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:21.016517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:21.016519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:21.016537Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:21.016544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:21.016550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:21.016612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.016620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.016622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.016625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:21.016628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:21.016693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:21.016704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.016716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.016728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.016746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:21.016768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895194298059117:7042], now have 1 active actors on pipe
2025-09-30T14:52:21.016776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895190003091694:2454], now have 1 active actors on pipe
2025-09-30T14:52:21.016783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895194208329757:5778]
2025-09-30T14:52:21.016790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895194208329757:5778]
2025-09-30T14:52:21.016793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895194208329757:5778]
2025-09-30T14:52:21.016805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:21.016819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:21.016818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:21.016821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:21.016823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:21.016835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:21.016839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:21.016871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895194208329757:5778]
2025-09-30T14:52:21.016883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:21.016859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 782
2025-09-30T14:52:21.016878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 782
2025-09-30T14:52:21.016892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:21.016932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:21.016941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:21.016967Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6670220d-cecd55ab-61ef9982-6f2a1573_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:21.016974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:21.016982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:21.016984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:21.016993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:21.017006Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:21.017022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:21.017202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:21.017212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:21.017227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:21.017307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 783 partition: 0 MaxSeqNo: 42 sessionId: src_id|6670220d-cecd55ab-61ef9982-6f2a1573_0
2025-09-30T14:52:21.017601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb1d257b-d54047a8-97fa15d9-ac69f206_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6670220d-cecd55ab-61ef9982-6f2a1573_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:21.020345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6670220d-cecd55ab-61ef9982-6f2a1573_0] Write session: try to update token
2025-09-30T14:52:21.020359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6670220d-cecd55ab-61ef9982-6f2a1573_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:21.034807Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:21.034826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:21.034837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895194208329757:5778]
2025-09-30T14:52:21.034882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:21.034904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 783 sessionId: src_id|6670220d-cecd55ab-61ef9982-6f2a1573_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:21.034942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:21.035060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:21.035207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:21.035367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:21.035512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:21.035776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:21.035818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:21.037766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:21.037975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:21.037991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:21.038026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:21.038123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:21.039298Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:21.039312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:21.039315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:21.039317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:21.039329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895194208329757:5778]
2025-09-30T14:52:21.039332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895194208329757:5778]
2025-09-30T14:52:21.039335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895194208329757:5778]
2025-09-30T14:52:21.039373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:21.039380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.039382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:21.039414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:21.039428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:21.039433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:21.039513Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:21.093066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895194298059131:6573]
2025-09-30T14:52:21.093360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 782, pipe: [1:7555895194298059131:6573]
2025-09-30T14:52:21.144484Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:21.151384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:21.151404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:21.151551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:21.151612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:21.151672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:21.151732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:21.151774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:21.151782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:21.151843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:21.151904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:21.151962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:21.152024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:21.152065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:21.152070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:21.152131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:21.152192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:21.152267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:21.152361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:21.152401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:21.152407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:21.152467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:21.152539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:21.152599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:21.152658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:21.152699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:21.152705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:21.152785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:21.152841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:21.152897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:21.152958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:21.153000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:21.153005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:21.153067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:21.153124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:21.153184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:21.153245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:21.153287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:21.153300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:21.153378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:21.153440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:21.153501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:21.153564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:21.153680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:21.153686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:21.153746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:21.153802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:21.153859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:21.153921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:21.153962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:21.153968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:21.154028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:21.154085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:21.154145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:21.154205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:21.154246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:21.154252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:21.154334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:21.154403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:21.154465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:21.154523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:21.154639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:21.154648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:21.154701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895194298059131:6573], now have 1 active actors on pipe
2025-09-30T14:52:21.155039Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:21.155045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895194298059131:6573]
2025-09-30T14:52:21.155066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:21.155068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:21.155091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 783 reason: error at write: Disconnected sessionId: src_id|6670220d-cecd55ab-61ef9982-6f2a1573_0
2025-09-30T14:52:21.155275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 783 sessionId: src_id|6670220d-cecd55ab-61ef9982-6f2a1573_0 is DEAD
2025-09-30T14:52:21.155379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6670220d-cecd55ab-61ef9982-6f2a1573_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:21.155386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6670220d-cecd55ab-61ef9982-6f2a1573_0] Write session will restart in 0.006486s
2025-09-30T14:52:21.155403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6670220d-cecd55ab-61ef9982-6f2a1573_0] Write session: Do CDS request
2025-09-30T14:52:21.155407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6670220d-cecd55ab-61ef9982-6f2a1573_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:21.155487Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:21.162758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6670220d-cecd55ab-61ef9982-6f2a1573_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:21.162830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:21.162847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 784
2025-09-30T14:52:21.163342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 784 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:21.163376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 784 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:21.163386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=784 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:21.163390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:21.163824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 784 sessionId:  describe result for acl check
2025-09-30T14:52:21.163854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:21.163857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:21.163861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:21.163866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895194298059164:7046] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:21.164387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895194298059164:7046] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:21.167088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:21.167123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895194298059164:7046] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:21.170519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:21.170741Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:21.170755Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:21.170766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:21.170822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:21.170859Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895194208329879:5781]
2025-09-30T14:52:21.170884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895194298059164:7046] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:21.170899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895194298059164:7046] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:21.170902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895194298059164:7046] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:21.170910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 784 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:21.171507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:21.171830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:21.171878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:21.172202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:21.172264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:21.172272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:21.172273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:21.172274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:21.172276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:21.172277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:21.172278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:21.172280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:21.172281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:21.172282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:21.172283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.172285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.172286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.172287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:21.172288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:21.172293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:21.172303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:21.172307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:21.172311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:21.172315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:21.172320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:21.172324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:21.172327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:21.172331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:21.172336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:21.172340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.172344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.172347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.172351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:21.172355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:21.172361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:21.172369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:21.172375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:21.172381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:21.172386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:21.172391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:21.172395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:21.172399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:21.172404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:21.172408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:21.172413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:21.172418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:21.172423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:21.172427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:21.172432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:21.172436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:21.172441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:21.172446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:21.172451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:21.172456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:21.172461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.172466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.172470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.172476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.172481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.172486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.172490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:21.172495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:21.172500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:21.172505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:21.172552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:21.177625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:21.178765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:21.178782Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:21.178784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:21.178788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:21.178794Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 783 [2:7555895194208329879:5781]
2025-09-30T14:52:21.178808Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:21.178820Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:21.178822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:21.178824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:21.178828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:21.178839Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:21.178844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:21.178854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:21.178897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.178903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.178905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.178907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:21.178909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:21.178963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:21.178972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.178979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.178985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.178994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:21.179009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895194298059243:7046], now have 1 active actors on pipe
2025-09-30T14:52:21.179011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895194298059133:2454], now have 1 active actors on pipe
2025-09-30T14:52:21.179016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895194208329874:5781]
2025-09-30T14:52:21.179017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895194208329874:5781]
2025-09-30T14:52:21.179019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895194208329874:5781]
2025-09-30T14:52:21.179025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:21.179036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:21.179036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:21.179039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:21.179041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:21.179049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:21.179051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:21.179073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895194208329874:5781]
2025-09-30T14:52:21.179079Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:21.179060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 783
2025-09-30T14:52:21.179087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:21.179068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 783
2025-09-30T14:52:21.179108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:21.179111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:21.179133Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb12b769-6240f3d1-420b1dc2-9eab62db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:21.179142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:21.179144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:21.179146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:21.179155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:21.179162Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:21.179176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:21.179344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:21.179351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:21.179362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:21.179440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 784 partition: 0 MaxSeqNo: 42 sessionId: src_id|eb12b769-6240f3d1-420b1dc2-9eab62db_0
2025-09-30T14:52:21.179756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6670220d-cecd55ab-61ef9982-6f2a1573_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|eb12b769-6240f3d1-420b1dc2-9eab62db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:21.182389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb12b769-6240f3d1-420b1dc2-9eab62db_0] Write session: try to update token
2025-09-30T14:52:21.182406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb12b769-6240f3d1-420b1dc2-9eab62db_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:21.190809Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:21.190826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:21.190836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895194208329874:5781]
2025-09-30T14:52:21.190876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:21.190877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:21.191057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:21.191201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:21.191349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:21.191475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:21.191643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:21.191682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:21.195929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 784 sessionId: src_id|eb12b769-6240f3d1-420b1dc2-9eab62db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:21.198640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:21.198850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:21.198873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:21.198909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:21.199052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:21.201928Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:21.201941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:21.201943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:21.201945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:21.201952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895194208329874:5781]
2025-09-30T14:52:21.201959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895194208329874:5781]
2025-09-30T14:52:21.201961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895194208329874:5781]
2025-09-30T14:52:21.201990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:21.201995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.201998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:21.202003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:21.202009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:21.202023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:21.202126Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:21.255332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895194298059254:6573]
2025-09-30T14:52:21.255609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 783, pipe: [1:7555895194298059254:6573]
2025-09-30T14:52:21.309104Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:21.317357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:21.317388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:21.317570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:21.317639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:21.317710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:21.317783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:21.317829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:21.317838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:21.317906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:21.317972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:21.318040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:21.318171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:21.318216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:21.318226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:21.318298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:21.318369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:21.318440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:21.318512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:21.318556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:21.318563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:21.318637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:21.318709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:21.318780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:21.318845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:21.318891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:21.318899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:21.318973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:21.319040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:21.319105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:21.319170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:21.319233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:21.319260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:21.319332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:21.319400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:21.319466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:21.319529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:21.319573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:21.319581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:21.319648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:21.319714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:21.319781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:21.319844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:21.319912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:21.319920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:21.319995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:21.320060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:21.320125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:21.320192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:21.320344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:21.320353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:21.320419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:21.320481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:21.320547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:21.320612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:21.320658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:21.320667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:21.320737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:21.320804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:21.320869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:21.320936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:21.320997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:21.321005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:21.321072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895194298059254:6573], now have 1 active actors on pipe
2025-09-30T14:52:21.321369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895194298059254:6573]
2025-09-30T14:52:21.321392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:21.321396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:21.321402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:21.321437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 784 reason: error at write: Disconnected sessionId: src_id|eb12b769-6240f3d1-420b1dc2-9eab62db_0
2025-09-30T14:52:21.321608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 784 sessionId: src_id|eb12b769-6240f3d1-420b1dc2-9eab62db_0 is DEAD
2025-09-30T14:52:21.321768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb12b769-6240f3d1-420b1dc2-9eab62db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:21.321779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb12b769-6240f3d1-420b1dc2-9eab62db_0] Write session will restart in 0.009414s
2025-09-30T14:52:21.321802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb12b769-6240f3d1-420b1dc2-9eab62db_0] Write session: Do CDS request
2025-09-30T14:52:21.321807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb12b769-6240f3d1-420b1dc2-9eab62db_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:21.322218Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:21.332794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb12b769-6240f3d1-420b1dc2-9eab62db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:21.332868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:21.332886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 785
2025-09-30T14:52:21.333009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 785 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:21.333040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 785 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:21.333050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=785 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:21.333054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:21.333463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 785 sessionId:  describe result for acl check
2025-09-30T14:52:21.333494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:21.333500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:21.333504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:21.333510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895194298059331:7050] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:21.334040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895194298059331:7050] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:21.334858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:21.336740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895194298059331:7050] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:21.338349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:21.338536Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:21.338546Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:21.338556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:21.338604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:21.338639Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895194208329994:5783]
2025-09-30T14:52:21.338917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895194298059331:7050] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:21.338931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895194298059331:7050] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:21.338935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895194298059331:7050] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:21.338942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 785 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:21.339310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:21.339614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:21.339684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:21.340055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:21.340109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:21.340114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:21.340115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:21.340116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:21.340116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:21.340117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:21.340118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:21.340119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:21.340120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:21.340120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:21.340121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.340122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.340122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.340123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:21.340124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:21.340128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:21.340142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:21.340145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:21.340147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:21.340150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:21.340152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:21.340155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:21.340158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:21.340162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:21.340166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:21.340170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.340174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.340178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.340184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:21.340187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:21.340192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:21.340197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:21.340201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:21.340204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:21.340207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:21.340209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:21.340212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:21.340215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:21.340225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:21.340229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:21.340231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:21.340234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:21.340237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:21.340240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:21.340243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:21.340246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:21.340250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:21.340255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:21.340259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:21.340264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:21.340270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.340275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.340279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.340284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.340288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.340291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.340293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:21.340296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:21.340300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:21.340304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:21.340327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:21.345695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:21.346557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:21.346572Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:21.346574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:21.346577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:21.346582Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 784 [2:7555895194208329994:5783]
2025-09-30T14:52:21.346594Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:21.346605Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:21.346607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:21.346610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:21.346612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:21.346626Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:21.346633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:21.346639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:21.346688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.346695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.346696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.346699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:21.346701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:21.346763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:21.346771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.346782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.346797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.346819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:21.346841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895194298059368:7050], now have 1 active actors on pipe
2025-09-30T14:52:21.346847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895194298059256:2454], now have 1 active actors on pipe
2025-09-30T14:52:21.346852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895194208329989:5783]
2025-09-30T14:52:21.346854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895194208329989:5783]
2025-09-30T14:52:21.346856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895194208329989:5783]
2025-09-30T14:52:21.346866Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:21.346880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:21.346882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:21.346885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:21.346887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:21.346898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:21.346901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:21.346929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895194208329989:5783]
2025-09-30T14:52:21.346922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 784
2025-09-30T14:52:21.346939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:21.346925Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 784
2025-09-30T14:52:21.346969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:21.346971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:21.346973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:21.347001Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56e3703b-21b69ec5-c6f37a96-9b8c2b06_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:21.347008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:21.347018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:21.347020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:21.347030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:21.347044Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:21.347057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:21.347173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:21.347181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:21.347194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:21.347286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 785 partition: 0 MaxSeqNo: 42 sessionId: src_id|56e3703b-21b69ec5-c6f37a96-9b8c2b06_0
2025-09-30T14:52:21.347631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb12b769-6240f3d1-420b1dc2-9eab62db_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|56e3703b-21b69ec5-c6f37a96-9b8c2b06_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:21.350399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56e3703b-21b69ec5-c6f37a96-9b8c2b06_0] Write session: try to update token
2025-09-30T14:52:21.350417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56e3703b-21b69ec5-c6f37a96-9b8c2b06_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:21.358885Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:21.358904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:21.358914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895194208329989:5783]
2025-09-30T14:52:21.358954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:21.358958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:21.359130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:21.359293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:21.359424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:21.359559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:21.359915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:21.359955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:21.364342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 785 sessionId: src_id|56e3703b-21b69ec5-c6f37a96-9b8c2b06_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:21.367078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:21.367291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:21.367310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:21.367343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:21.367435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:21.370060Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:21.370077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:21.370079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:21.370082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:21.370090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895194208329989:5783]
2025-09-30T14:52:21.370096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895194208329989:5783]
2025-09-30T14:52:21.370099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895194208329989:5783]
2025-09-30T14:52:21.370135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:21.370142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.370142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:21.370144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:21.370150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:21.370154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:21.370271Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:21.421775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895194298059402:6573]
2025-09-30T14:52:21.422021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 784, pipe: [1:7555895194298059402:6573]
2025-09-30T14:52:21.477403Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:21.484799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:21.484832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:21.485009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:21.485078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:21.485148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:21.485213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:21.485523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:21.485540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:21.485612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:21.485668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:21.485738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:21.485814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:21.485865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:21.485873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:21.485946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:21.486018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:21.486089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:21.486161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:21.486209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:21.486216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:21.486293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:21.486373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:21.486437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:21.486503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:21.486560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:21.486567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:21.486636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:21.486695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:21.486800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:21.486905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:21.486950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:21.486958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:21.487024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:21.487094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:21.487158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:21.487222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:21.487284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:21.487295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:21.487360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:21.487417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:21.487479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:21.487544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:21.487587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:21.487599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:21.487672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:21.487726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:21.487795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:21.487859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:21.487980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:21.487990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:21.488054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:21.488110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:21.488170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:21.488236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:21.488278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:21.488285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:21.488348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:21.488411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:21.488474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:21.488536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:21.488579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:21.488585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:21.488645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895194298059402:6573], now have 1 active actors on pipe
2025-09-30T14:52:21.488880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:21.488885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895194298059402:6573]
2025-09-30T14:52:21.488896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:21.488916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:21.488936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 785 reason: error at write: Disconnected sessionId: src_id|56e3703b-21b69ec5-c6f37a96-9b8c2b06_0
2025-09-30T14:52:21.489152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 785 sessionId: src_id|56e3703b-21b69ec5-c6f37a96-9b8c2b06_0 is DEAD
2025-09-30T14:52:21.489254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56e3703b-21b69ec5-c6f37a96-9b8c2b06_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:21.489273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56e3703b-21b69ec5-c6f37a96-9b8c2b06_0] Write session will restart in 0.005480s
2025-09-30T14:52:21.489296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56e3703b-21b69ec5-c6f37a96-9b8c2b06_0] Write session: Do CDS request
2025-09-30T14:52:21.489301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56e3703b-21b69ec5-c6f37a96-9b8c2b06_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:21.489400Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:21.495692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56e3703b-21b69ec5-c6f37a96-9b8c2b06_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:21.495759Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:21.495775Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 786
2025-09-30T14:52:21.495928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 786 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:21.495963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 786 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:21.495970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=786 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:21.495974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:21.496371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 786 sessionId:  describe result for acl check
2025-09-30T14:52:21.496412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:21.496417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:21.496418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:21.496423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895194298059419:7062] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:21.496853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895194298059419:7062] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:21.498950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895194298059419:7062] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:21.501939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895194298059419:7062] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:21.501955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895194298059419:7062] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:21.501958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895194298059419:7062] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:21.501967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 786 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:21.502118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:21.505763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:21.506160Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:21.506172Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:21.506188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:21.506243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:21.506283Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895194208330147:5797]
2025-09-30T14:52:21.506968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:21.507307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:21.507352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:21.507684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:21.507741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:21.507747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:21.507748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:21.507750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:21.507751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:21.507752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:21.507753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:21.507754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:21.507756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:21.507757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:21.507759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.507760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.507761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.507762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:21.507763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:21.507768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:21.507780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:21.507784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:21.507788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:21.507792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:21.507796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:21.507800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:21.507804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:21.507808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:21.507813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:21.507817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.507821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.507825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.507829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:21.507833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:21.507841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:21.507849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:21.507855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:21.507865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:21.507870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:21.507876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:21.507884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:21.507890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:21.507895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:21.507905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:21.507909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:21.507914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:21.507924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:21.507929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:21.507938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:21.507943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:21.507948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:21.507953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:21.507958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:21.507964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:21.507971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.507976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.507984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.507990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.507995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.508000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.508004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:21.508009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:21.508015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:21.508020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:21.508064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:21.513354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:21.514667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:21.514682Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:21.514684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:21.514688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:21.514694Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 785 [2:7555895194208330147:5797]
2025-09-30T14:52:21.514709Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:21.514723Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:21.514726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:21.514729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:21.514731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:21.514746Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:21.514753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:21.514759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:21.514817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.514824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.514827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.514830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:21.514833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:21.514907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:21.514913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.514927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.514943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.514964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:21.514986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895194298059406:2454], now have 1 active actors on pipe
2025-09-30T14:52:21.514995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895194298059516:7062], now have 1 active actors on pipe
2025-09-30T14:52:21.515001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895194208330141:5797]
2025-09-30T14:52:21.515003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895194208330141:5797]
2025-09-30T14:52:21.515005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895194208330141:5797]
2025-09-30T14:52:21.515017Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:21.515029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:21.515032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:21.515036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:21.515039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:21.515047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:21.515050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:21.515083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895194208330141:5797]
2025-09-30T14:52:21.515097Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:21.515108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:21.515084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 785
2025-09-30T14:52:21.515109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 785
2025-09-30T14:52:21.515181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:21.515190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:21.515211Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea89b13-76e03717-57ffd30f-cb603ddf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:21.515218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:21.515221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:21.515223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:21.515232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:21.515241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:21.515294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:21.515496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:21.515504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:21.515517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:21.515613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 786 partition: 0 MaxSeqNo: 42 sessionId: src_id|ea89b13-76e03717-57ffd30f-cb603ddf_0
2025-09-30T14:52:21.516002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56e3703b-21b69ec5-c6f37a96-9b8c2b06_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ea89b13-76e03717-57ffd30f-cb603ddf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:21.518855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea89b13-76e03717-57ffd30f-cb603ddf_0] Write session: try to update token
2025-09-30T14:52:21.518871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea89b13-76e03717-57ffd30f-cb603ddf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:21.527026Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:21.527044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:21.527046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:21.527048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:21.527058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895194208330141:5797]
2025-09-30T14:52:21.527062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895194208330141:5797]
2025-09-30T14:52:21.527066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895194208330141:5797]
2025-09-30T14:52:21.527104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:21.527110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.527113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:21.527112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:21.527119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:21.527122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:21.527267Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:21.533125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 786 sessionId: src_id|ea89b13-76e03717-57ffd30f-cb603ddf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:21.536090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:21.589183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895194298059529:6573]
2025-09-30T14:52:21.589397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 785, pipe: [1:7555895194298059529:6573]
2025-09-30T14:52:21.635502Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:21.635933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:21.635946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:21.635982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895194298059529:6573], now have 1 active actors on pipe
2025-09-30T14:52:21.636240Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:21.636243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895194298059529:6573]
2025-09-30T14:52:21.636279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:21.636281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:21.636342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 786 reason: error at write: Disconnected sessionId: src_id|ea89b13-76e03717-57ffd30f-cb603ddf_0
2025-09-30T14:52:21.636515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 786 sessionId: src_id|ea89b13-76e03717-57ffd30f-cb603ddf_0 is DEAD
2025-09-30T14:52:21.636647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea89b13-76e03717-57ffd30f-cb603ddf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:21.636655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea89b13-76e03717-57ffd30f-cb603ddf_0] Write session will restart in 0.008328s
2025-09-30T14:52:21.636673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea89b13-76e03717-57ffd30f-cb603ddf_0] Write session: Do CDS request
2025-09-30T14:52:21.636677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea89b13-76e03717-57ffd30f-cb603ddf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:21.637256Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:21.645691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea89b13-76e03717-57ffd30f-cb603ddf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:21.645858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:21.645875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 787
2025-09-30T14:52:21.646003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 787 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:21.646040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 787 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:21.646046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=787 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:21.646050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:21.646500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 787 sessionId:  describe result for acl check
2025-09-30T14:52:21.646541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:21.646548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:21.646550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:21.646556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895194298059606:7066] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:21.647107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895194298059606:7066] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:21.647731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:21.648979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895194298059606:7066] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:21.651464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:21.651639Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:21.651648Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:21.651656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:21.651696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:21.651728Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895194208330266:5800]
2025-09-30T14:52:21.651751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895194298059606:7066] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:21.651768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895194298059606:7066] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:21.651771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895194298059606:7066] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:21.651779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 787 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:21.652228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:21.652534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:21.652593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:21.652955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:21.653002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:21.653007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:21.653008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:21.653008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:21.653010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:21.653010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:21.653011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:21.653012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:21.653012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:21.653013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:21.653014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.653015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.653015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.653016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:21.653017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:21.653021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:21.653028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:21.653031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:21.653033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:21.653048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:21.653052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:21.653056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:21.653060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:21.653063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:21.653069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:21.653073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.653077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.653079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.653082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:21.653084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:21.653089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:21.653095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:21.653099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:21.653102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:21.653107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:21.653113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:21.653117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:21.653123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:21.653128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:21.653134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:21.653139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:21.653142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:21.653145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:21.653148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:21.653150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:21.653153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:21.653156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:21.653159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:21.653161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:21.653164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:21.653168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.653171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.653173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.653177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.653180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.653182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.653185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:21.653187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:21.653190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:21.653192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:21.653224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:21.658869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:21.660192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:21.660207Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:21.660210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:21.660214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:21.660221Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 786 [2:7555895194208330266:5800]
2025-09-30T14:52:21.660236Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:21.660252Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:21.660255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:21.660258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:21.660260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:21.660277Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:21.660286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:21.660293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:21.660358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.660368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.660370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.660373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:21.660375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:21.660447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:21.660455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.660469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.660481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.660503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:21.660528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895194298059531:2454], now have 1 active actors on pipe
2025-09-30T14:52:21.660537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895194298059644:7066], now have 1 active actors on pipe
2025-09-30T14:52:21.660543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895194208330260:5800]
2025-09-30T14:52:21.660550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895194208330260:5800]
2025-09-30T14:52:21.660552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895194208330260:5800]
2025-09-30T14:52:21.660563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:21.660578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:21.660580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:21.660584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:21.660587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:21.660592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:21.660594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:21.660581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 786
2025-09-30T14:52:21.660583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 786
2025-09-30T14:52:21.660622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895194208330260:5800]
2025-09-30T14:52:21.660628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:21.660635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:21.660646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:21.660653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:21.660687Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53e54a8c-ce7a78bc-a8c82fb3-81bc9f5f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:21.660696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:21.660698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:21.660700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:21.660706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:21.660715Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:21.660727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:21.660906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:21.660915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:21.660930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:21.661007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 787 partition: 0 MaxSeqNo: 42 sessionId: src_id|53e54a8c-ce7a78bc-a8c82fb3-81bc9f5f_0
2025-09-30T14:52:21.661373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea89b13-76e03717-57ffd30f-cb603ddf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|53e54a8c-ce7a78bc-a8c82fb3-81bc9f5f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:21.664043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53e54a8c-ce7a78bc-a8c82fb3-81bc9f5f_0] Write session: try to update token
2025-09-30T14:52:21.664064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53e54a8c-ce7a78bc-a8c82fb3-81bc9f5f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:21.672634Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:21.672651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:21.672652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:21.672654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:21.672661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895194208330260:5800]
2025-09-30T14:52:21.672664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895194208330260:5800]
2025-09-30T14:52:21.672669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895194208330260:5800]
2025-09-30T14:52:21.672706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:21.672711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:21.672716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.672717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:21.672720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:21.672724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:21.672871Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:21.677590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 787 sessionId: src_id|53e54a8c-ce7a78bc-a8c82fb3-81bc9f5f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:21.680389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:21.736667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895194298059655:6573]
2025-09-30T14:52:21.736946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 786, pipe: [1:7555895194298059655:6573]
2025-09-30T14:52:21.778696Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:21.778976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:21.778989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:21.779025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895194298059655:6573], now have 1 active actors on pipe
2025-09-30T14:52:21.779298Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:21.779317Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:21.779302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:21.779306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:21.779369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895194298059655:6573]
2025-09-30T14:52:21.779370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 787 reason: error at write: Disconnected sessionId: src_id|53e54a8c-ce7a78bc-a8c82fb3-81bc9f5f_0
2025-09-30T14:52:21.779537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 787 sessionId: src_id|53e54a8c-ce7a78bc-a8c82fb3-81bc9f5f_0 is DEAD
2025-09-30T14:52:21.779698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53e54a8c-ce7a78bc-a8c82fb3-81bc9f5f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:21.779708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53e54a8c-ce7a78bc-a8c82fb3-81bc9f5f_0] Write session will restart in 0.008606s
2025-09-30T14:52:21.779731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53e54a8c-ce7a78bc-a8c82fb3-81bc9f5f_0] Write session: Do CDS request
2025-09-30T14:52:21.779741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53e54a8c-ce7a78bc-a8c82fb3-81bc9f5f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:21.789731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53e54a8c-ce7a78bc-a8c82fb3-81bc9f5f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:21.789827Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:21.789843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 788
2025-09-30T14:52:21.789958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 788 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:21.789991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 788 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:21.789995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=788 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:21.789999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:21.790111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:21.790415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 788 sessionId:  describe result for acl check
2025-09-30T14:52:21.790444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:21.790445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:21.790447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:21.790450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895194298059734:7070] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:21.791011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895194298059734:7070] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:21.792679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895194298059734:7070] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:21.793656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:21.793842Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:21.793855Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:21.793868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:21.793949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:21.793985Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895194208330383:5802]
2025-09-30T14:52:21.794420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:21.794737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:21.794791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:21.795068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895194298059734:7070] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:21.795081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895194298059734:7070] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:21.795084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895194298059734:7070] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:21.795099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 788 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:21.795093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:21.795155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:21.795159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:21.795160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:21.795161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:21.795161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:21.795162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:21.795163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:21.795164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:21.795164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:21.795165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:21.795166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.795166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.795167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.795168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:21.795168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:21.795172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:21.795178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:21.795181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:21.795183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:21.795185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:21.795188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:21.795190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:21.795192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:21.795195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:21.795197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:21.795199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.795202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.795204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.795206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:21.795208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:21.795214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:21.795219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:21.795222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:21.795226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:21.795228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:21.795231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:21.795235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:21.795238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:21.795240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:21.795262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:21.795266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:21.795271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:21.795276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:21.795282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:21.795286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:21.795291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:21.795295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:21.795300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:21.795305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:21.795311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:21.795315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.795320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.795324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.795329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.795334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.795339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.795343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:21.795348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:21.795352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:21.795359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:21.795382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:21.800355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:21.801145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:21.801157Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:21.801158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:21.801161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:21.801166Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 787 [2:7555895194208330383:5802]
2025-09-30T14:52:21.801176Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:21.801185Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:21.801187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:21.801189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:21.801190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:21.801201Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:21.801206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:21.801211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:21.801252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.801258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.801259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.801263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:21.801265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:21.801311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:21.801316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.801323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.801329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.801342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:21.801361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895194208330377:5802]
2025-09-30T14:52:21.801367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895194208330377:5802]
2025-09-30T14:52:21.801369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895194208330377:5802]
2025-09-30T14:52:21.801376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:21.801383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:21.801388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895194298059772:7070], now have 1 active actors on pipe
2025-09-30T14:52:21.801391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:21.801392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895194298059656:2454], now have 1 active actors on pipe
2025-09-30T14:52:21.801393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:21.801399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:21.801412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:21.801415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:21.801440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895194208330377:5802]
2025-09-30T14:52:21.801451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:21.801456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:21.801469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 787
2025-09-30T14:52:21.801474Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 787
2025-09-30T14:52:21.801566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:21.801576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:21.801602Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19e21738-40e52e55-cb51cd32-ab63cc59_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:21.801615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:21.801619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:21.801621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:21.801632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:21.801641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:21.801654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:21.801807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:21.801818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:21.801837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:21.801924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 788 partition: 0 MaxSeqNo: 42 sessionId: src_id|19e21738-40e52e55-cb51cd32-ab63cc59_0
2025-09-30T14:52:21.802264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53e54a8c-ce7a78bc-a8c82fb3-81bc9f5f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|19e21738-40e52e55-cb51cd32-ab63cc59_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:21.805030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19e21738-40e52e55-cb51cd32-ab63cc59_0] Write session: try to update token
2025-09-30T14:52:21.805049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19e21738-40e52e55-cb51cd32-ab63cc59_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:21.812653Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:21.812670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:21.812672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:21.812675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:21.812683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895194208330377:5802]
2025-09-30T14:52:21.812688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895194208330377:5802]
2025-09-30T14:52:21.812692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895194208330377:5802]
2025-09-30T14:52:21.812729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:21.812737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.812740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:21.812875Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:21.812925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:21.812938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:21.812942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:21.818660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 788 sessionId: src_id|19e21738-40e52e55-cb51cd32-ab63cc59_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:21.821469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:21.879458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895194298059782:6573]
2025-09-30T14:52:21.879801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 787, pipe: [1:7555895194298059782:6573]
2025-09-30T14:52:21.919154Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:21.919435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:21.919448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:21.919484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895194298059782:6573], now have 1 active actors on pipe
2025-09-30T14:52:21.919643Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:21.919691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:21.919696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:21.919709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:21.919741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895194298059782:6573]
2025-09-30T14:52:21.919771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 788 reason: error at write: Disconnected sessionId: src_id|19e21738-40e52e55-cb51cd32-ab63cc59_0
2025-09-30T14:52:21.919930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 788 sessionId: src_id|19e21738-40e52e55-cb51cd32-ab63cc59_0 is DEAD
2025-09-30T14:52:21.920070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19e21738-40e52e55-cb51cd32-ab63cc59_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:21.920081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19e21738-40e52e55-cb51cd32-ab63cc59_0] Write session will restart in 0.006476s
2025-09-30T14:52:21.920106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19e21738-40e52e55-cb51cd32-ab63cc59_0] Write session: Do CDS request
2025-09-30T14:52:21.920111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19e21738-40e52e55-cb51cd32-ab63cc59_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:21.927723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19e21738-40e52e55-cb51cd32-ab63cc59_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:21.927813Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:21.927842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 789
2025-09-30T14:52:21.927960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 789 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:21.927994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 789 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:21.928005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=789 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:21.928009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:21.928425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 789 sessionId:  describe result for acl check
2025-09-30T14:52:21.928461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:21.928469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:21.928471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:21.928476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895194298059826:7074] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:21.929033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895194298059826:7074] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:21.930870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895194298059826:7074] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:21.931049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:21.934547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:21.934712Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:21.934720Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:21.934731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:21.934727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895194298059826:7074] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:21.934740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895194298059826:7074] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:21.934744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895194298059826:7074] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:21.934753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 789 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:21.934780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:21.934816Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895194208330502:5804]
2025-09-30T14:52:21.935299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:21.935616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:21.935677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:21.936040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:21.936099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:21.936105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:21.936106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:21.936108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:21.936109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:21.936110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:21.936112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:21.936113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:21.936114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:21.936115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:21.936117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.936117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.936119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.936120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:21.936121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:21.936126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:21.936137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:21.936141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:21.936146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:21.936160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:21.936165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:21.936169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:21.936173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:21.936181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:21.936187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:21.936195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.936199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.936207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.936211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:21.936219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:21.936226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:21.936238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:21.936250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:21.936257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:21.936261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:21.936267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:21.936275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:21.936281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:21.936286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:21.936295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:21.936300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:21.936305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:21.936310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:21.936314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:21.936318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:21.936324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:21.936328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:21.936338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:21.936347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:21.936356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:21.936365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.936374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.936382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.936386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.936392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.936398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.936403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:21.936408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:21.936413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:21.936418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:21.936466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:21.941779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:21.942630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:21.942644Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:21.942646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:21.942649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:21.942654Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 788 [2:7555895194208330502:5804]
2025-09-30T14:52:21.942667Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:21.942683Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:21.942688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:21.942690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:21.942692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:21.942703Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:21.942708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:21.942713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:21.942774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.942779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.942781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.942783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:21.942785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:21.942997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 788
2025-09-30T14:52:21.943000Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 788
2025-09-30T14:52:21.943162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:21.943168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.943177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:21.943184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:21.943195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:21.943210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895194298059783:2454], now have 1 active actors on pipe
2025-09-30T14:52:21.943217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895194298059898:7074], now have 1 active actors on pipe
2025-09-30T14:52:21.943235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:21.943241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:21.943289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895194208330496:5804]
2025-09-30T14:52:21.943294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895194208330496:5804]
2025-09-30T14:52:21.943296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895194208330496:5804]
2025-09-30T14:52:21.943305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:21.943316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:21.943329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:21.943329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:21.943332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:21.943334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:21.943334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:21.943348Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b55e9baf-cf294303-db7735e7-a7ef611a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:21.943356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:21.943363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:21.943365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:21.943372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:21.943379Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:21.943416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895194208330496:5804]
2025-09-30T14:52:21.943431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:21.943445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:21.943451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:21.943592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:21.943600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:21.943612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:21.943693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 789 partition: 0 MaxSeqNo: 42 sessionId: src_id|b55e9baf-cf294303-db7735e7-a7ef611a_0
2025-09-30T14:52:21.944050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19e21738-40e52e55-cb51cd32-ab63cc59_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b55e9baf-cf294303-db7735e7-a7ef611a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:21.946950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b55e9baf-cf294303-db7735e7-a7ef611a_0] Write session: try to update token
2025-09-30T14:52:21.946977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b55e9baf-cf294303-db7735e7-a7ef611a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:21.955485Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:21.955505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:21.955514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895194208330496:5804]
2025-09-30T14:52:21.955542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:21.955552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:21.955749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:21.955899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:21.956053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:21.956217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:21.956419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:21.956461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:21.962119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 789 sessionId: src_id|b55e9baf-cf294303-db7735e7-a7ef611a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:21.964979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:21.965193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:21.965214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:21.966396Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:21.966412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:21.966415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:21.966416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:21.966425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895194208330496:5804]
2025-09-30T14:52:21.966430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895194208330496:5804]
2025-09-30T14:52:21.966438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895194208330496:5804]
2025-09-30T14:52:21.966475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:21.966488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:21.966499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:21.966506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:21.966508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:21.966515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:21.966520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:21.966607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:21.966641Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:22.019782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895198593027227:6573]
2025-09-30T14:52:22.020023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 788, pipe: [1:7555895198593027227:6573]
2025-09-30T14:52:22.071896Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:22.079183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:22.079207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:22.079387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:22.079453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:22.079513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:22.079575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:22.079618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:22.079626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:22.079690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:22.079749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:22.079813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:22.079874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:22.079918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:22.079924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:22.079983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:22.080060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:22.080120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:22.080178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:22.080220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:22.080225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:22.080325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:22.080385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:22.080448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:22.080508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:22.080550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:22.080556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:22.080622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:22.080692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:22.080753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:22.080832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:22.080875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:22.080880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:22.080942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:22.081007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:22.081071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:22.081138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:22.081181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:22.081188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:22.081253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:22.081308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:22.081369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:22.081427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:22.081484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:22.081490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:22.081550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:22.081606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:22.081663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:22.081732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:22.081777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:22.081783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:22.081845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:22.081900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:22.081972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:22.082037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:22.082079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:22.082084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:22.082145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:22.082203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:22.082270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:22.082349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:22.082405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:22.082411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:22.082463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895198593027227:6573], now have 1 active actors on pipe
2025-09-30T14:52:22.082752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:22.082785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895198593027227:6573]
2025-09-30T14:52:22.082807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:22.082809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:22.082837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 789 reason: error at write: Disconnected sessionId: src_id|b55e9baf-cf294303-db7735e7-a7ef611a_0
2025-09-30T14:52:22.083011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 789 sessionId: src_id|b55e9baf-cf294303-db7735e7-a7ef611a_0 is DEAD
2025-09-30T14:52:22.083162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b55e9baf-cf294303-db7735e7-a7ef611a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:22.083173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b55e9baf-cf294303-db7735e7-a7ef611a_0] Write session will restart in 0.005710s
2025-09-30T14:52:22.083196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b55e9baf-cf294303-db7735e7-a7ef611a_0] Write session: Do CDS request
2025-09-30T14:52:22.083201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b55e9baf-cf294303-db7735e7-a7ef611a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:22.083452Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:22.089693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b55e9baf-cf294303-db7735e7-a7ef611a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:22.089802Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:22.089819Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 790
2025-09-30T14:52:22.089959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 790 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:22.089995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 790 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:22.090007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=790 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:22.090011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:22.090454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 790 sessionId:  describe result for acl check
2025-09-30T14:52:22.090492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:22.090500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:22.090502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:22.090508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895198593027246:7081] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:22.091036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895198593027246:7081] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:22.093011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895198593027246:7081] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:22.094353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:22.097719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:22.097884Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:22.097892Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:22.097900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:22.097938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:22.097967Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895198503297932:5807]
2025-09-30T14:52:22.098099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895198593027246:7081] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:22.098114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895198593027246:7081] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:22.098118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895198593027246:7081] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:22.098126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 790 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:22.098443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:22.098722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:22.098785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:22.099132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:22.099192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:22.099197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:22.099198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:22.099200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:22.099201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:22.099203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:22.099204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:22.099206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:22.099207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:22.099208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:22.099210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.099212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.099213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.099215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:22.099216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:22.099222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:22.099233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:22.099238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:22.099254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:22.099258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:22.099263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:22.099267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:22.099272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:22.099276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:22.099281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:22.099284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.099288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.099293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.099297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:22.099301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:22.099310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:22.099323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:22.099333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:22.099340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:22.099348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:22.099353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:22.099358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:22.099364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:22.099369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:22.099388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:22.099396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:22.099401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:22.099410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:22.099415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:22.099421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:22.099427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:22.099432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:22.099441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:22.099447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:22.099454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:22.099463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.099472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.099480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.099487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.099495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.099500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.099509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:22.099514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:22.099519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:22.099528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:22.099577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:22.105090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:22.105985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:22.106004Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:22.106008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:22.106012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:22.106018Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 789 [2:7555895198503297932:5807]
2025-09-30T14:52:22.106036Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:22.106053Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:22.106057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:22.106060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:22.106062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:22.106078Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:22.106085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:22.106097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:22.106161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.106169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.106171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.106175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:22.106177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:22.106242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:22.106250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.106263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.106280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.106302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:22.106337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895198593027231:2454], now have 1 active actors on pipe
2025-09-30T14:52:22.106346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895198593027347:7081], now have 1 active actors on pipe
2025-09-30T14:52:22.106353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895198503297926:5807]
2025-09-30T14:52:22.106356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895198503297926:5807]
2025-09-30T14:52:22.106359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895198503297926:5807]
2025-09-30T14:52:22.106371Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:22.106386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:22.106389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:22.106397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:22.106399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:22.106356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 789
2025-09-30T14:52:22.106405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:22.106399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 789
2025-09-30T14:52:22.106408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:22.106456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:22.106465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:22.106477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895198503297926:5807]
2025-09-30T14:52:22.106489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:22.106519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:22.106524Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7dfc41ff-8cf9ecbb-50bca14a-1d92391_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:22.106530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:22.106534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:22.106536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:22.106549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:22.106563Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:22.106596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:22.106752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:22.106764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:22.106968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:22.107087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 790 partition: 0 MaxSeqNo: 42 sessionId: src_id|7dfc41ff-8cf9ecbb-50bca14a-1d92391_0
2025-09-30T14:52:22.107461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b55e9baf-cf294303-db7735e7-a7ef611a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7dfc41ff-8cf9ecbb-50bca14a-1d92391_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:22.110205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dfc41ff-8cf9ecbb-50bca14a-1d92391_0] Write session: try to update token
2025-09-30T14:52:22.110223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dfc41ff-8cf9ecbb-50bca14a-1d92391_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:22.119444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:22.119462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:22.119465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:22.119467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:22.119479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895198503297926:5807]
2025-09-30T14:52:22.119483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895198503297926:5807]
2025-09-30T14:52:22.119487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895198503297926:5807]
2025-09-30T14:52:22.119525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:22.119525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:22.119530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:22.119533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.119534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:22.119536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:22.119668Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:22.124940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 790 sessionId: src_id|7dfc41ff-8cf9ecbb-50bca14a-1d92391_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:22.127527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:22.183117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895198593027359:6573]
2025-09-30T14:52:22.183474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 789, pipe: [1:7555895198593027359:6573]
2025-09-30T14:52:22.230721Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:22.231229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:22.231259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:22.231297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895198593027359:6573], now have 1 active actors on pipe
2025-09-30T14:52:22.231467Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:22.231567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:22.231570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895198593027359:6573]
2025-09-30T14:52:22.231595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:22.231664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 790 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7dfc41ff-8cf9ecbb-50bca14a-1d92391_0
2025-09-30T14:52:22.231821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 790 sessionId: src_id|7dfc41ff-8cf9ecbb-50bca14a-1d92391_0 is DEAD
2025-09-30T14:52:22.231966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dfc41ff-8cf9ecbb-50bca14a-1d92391_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:22.231975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dfc41ff-8cf9ecbb-50bca14a-1d92391_0] Write session will restart in 0.009392s
2025-09-30T14:52:22.231996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dfc41ff-8cf9ecbb-50bca14a-1d92391_0] Write session: Do CDS request
2025-09-30T14:52:22.232001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dfc41ff-8cf9ecbb-50bca14a-1d92391_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:22.242728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dfc41ff-8cf9ecbb-50bca14a-1d92391_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:22.242845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:22.242861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 791
2025-09-30T14:52:22.242971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 791 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:22.243003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 791 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:22.243014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=791 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:22.243017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:22.243398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 791 sessionId:  describe result for acl check
2025-09-30T14:52:22.243430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:22.243437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:22.243439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:22.243445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895198593027441:7085] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:22.243620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:22.243971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895198593027441:7085] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:22.245793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895198593027441:7085] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:22.247165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:22.247415Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:22.247428Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:22.247441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:22.247514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:22.247558Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895198503298052:5810]
2025-09-30T14:52:22.248043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:22.248296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895198593027441:7085] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:22.248309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895198593027441:7085] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:22.248311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895198593027441:7085] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:22.248318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 791 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:22.248338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:22.248376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:22.248631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:22.248677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:22.248682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:22.248683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:22.248684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:22.248685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:22.248686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:22.248687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:22.248688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:22.248688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:22.248689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:22.248690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.248691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.248691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.248692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:22.248693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:22.248696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:22.248704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:22.248708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:22.248712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:22.248717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:22.248720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:22.248724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:22.248727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:22.248731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:22.248737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:22.248741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.248746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.248750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.248754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:22.248758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:22.248765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:22.248772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:22.248777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:22.248781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:22.248784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:22.248787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:22.248789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:22.248792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:22.248795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:22.248798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:22.248800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:22.248803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:22.248805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:22.248808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:22.248811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:22.248815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:22.248819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:22.248824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:22.248829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:22.248834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:22.248840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.248845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.248850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.248855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.248860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.248865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.248869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:22.248876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:22.248880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:22.248884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:22.248908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:22.254426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:22.255345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:22.255361Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:22.255364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:22.255368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:22.255375Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 790 [2:7555895198503298052:5810]
2025-09-30T14:52:22.255395Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:22.255409Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:22.255417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:22.255421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:22.255424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:22.255440Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:22.255448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:22.255455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:22.255511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.255519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.255521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.255525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:22.255527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:22.255608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:22.255615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.255626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.255643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.255665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:22.255687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895198593027360:2454], now have 1 active actors on pipe
2025-09-30T14:52:22.255694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895198593027478:7085], now have 1 active actors on pipe
2025-09-30T14:52:22.255700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895198503298046:5810]
2025-09-30T14:52:22.255703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895198503298046:5810]
2025-09-30T14:52:22.255705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895198503298046:5810]
2025-09-30T14:52:22.255709Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 790
2025-09-30T14:52:22.255719Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:22.255712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 790
2025-09-30T14:52:22.255738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:22.255743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:22.255749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:22.255751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:22.255752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:22.255755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:22.255786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895198503298046:5810]
2025-09-30T14:52:22.255800Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:22.255815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:22.255821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:22.255826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:22.255875Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|479fbe83-51d4907b-3a3d591c-85505663_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:22.255886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:22.255890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:22.255892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:22.255903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:22.255917Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:22.255938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:22.256099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:22.256107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:22.256119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:22.256184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 791 partition: 0 MaxSeqNo: 42 sessionId: src_id|479fbe83-51d4907b-3a3d591c-85505663_0
2025-09-30T14:52:22.256564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dfc41ff-8cf9ecbb-50bca14a-1d92391_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|479fbe83-51d4907b-3a3d591c-85505663_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:22.259617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|479fbe83-51d4907b-3a3d591c-85505663_0] Write session: try to update token
2025-09-30T14:52:22.259637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|479fbe83-51d4907b-3a3d591c-85505663_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:22.268225Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:22.268244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:22.268247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:22.268249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:22.268259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895198503298046:5810]
2025-09-30T14:52:22.268263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895198503298046:5810]
2025-09-30T14:52:22.268267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895198503298046:5810]
2025-09-30T14:52:22.268304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:22.268311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:22.268317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:22.268318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.268321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:22.268324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:22.268452Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:22.273715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 791 sessionId: src_id|479fbe83-51d4907b-3a3d591c-85505663_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:22.276428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:22.331594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895198593027489:6573]
2025-09-30T14:52:22.331886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 790, pipe: [1:7555895198593027489:6573]
2025-09-30T14:52:22.375827Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:22.376083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:22.376097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:22.376138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895198593027489:6573], now have 1 active actors on pipe
2025-09-30T14:52:22.376324Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:22.376411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895198593027489:6573]
2025-09-30T14:52:22.376429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:22.376442Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:22.376514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 791 reason: status is not ok: tablet will be restarted right now sessionId: src_id|479fbe83-51d4907b-3a3d591c-85505663_0
2025-09-30T14:52:22.376678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 791 sessionId: src_id|479fbe83-51d4907b-3a3d591c-85505663_0 is DEAD
2025-09-30T14:52:22.376826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|479fbe83-51d4907b-3a3d591c-85505663_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:22.376837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|479fbe83-51d4907b-3a3d591c-85505663_0] Write session will restart in 0.006050s
2025-09-30T14:52:22.376860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|479fbe83-51d4907b-3a3d591c-85505663_0] Write session: Do CDS request
2025-09-30T14:52:22.376865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|479fbe83-51d4907b-3a3d591c-85505663_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:22.383697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|479fbe83-51d4907b-3a3d591c-85505663_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:22.383750Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:22.383767Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 792
2025-09-30T14:52:22.383952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 792 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:22.383994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 792 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:22.384009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=792 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:22.384012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:22.384448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 792 sessionId:  describe result for acl check
2025-09-30T14:52:22.384487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:22.384494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:22.384496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:22.384503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895198593027513:7089] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:22.385027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895198593027513:7089] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:22.387019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895198593027513:7089] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:22.389598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895198593027513:7089] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:22.389612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895198593027513:7089] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:22.389615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895198593027513:7089] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:22.389623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 792 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:22.391615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:22.395686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:22.395897Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:22.395909Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:22.395921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:22.395980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:22.396020Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895198503298175:5812]
2025-09-30T14:52:22.396718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:22.397039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:22.397083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:22.397409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:22.397473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:22.397480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:22.397482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:22.397483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:22.397484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:22.397485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:22.397487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:22.397489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:22.397490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:22.397492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:22.397493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.397494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.397496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.397497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:22.397499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:22.397504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:22.397515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:22.397520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:22.397525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:22.397530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:22.397535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:22.397539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:22.397544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:22.397548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:22.397553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:22.397557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.397562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.397566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.397571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:22.397575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:22.397585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:22.397594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:22.397600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:22.397606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:22.397616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:22.397622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:22.397631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:22.397637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:22.397647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:22.397654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:22.397661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:22.397672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:22.397677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:22.397687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:22.397692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:22.397702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:22.397707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:22.397717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:22.397722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:22.397732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:22.397737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.397747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.397752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.397758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.397763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.397768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.397777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:22.397784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:22.397793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:22.397798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:22.397845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:22.403457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:22.404330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:22.404349Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:22.404352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:22.404356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:22.404362Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 791 [2:7555895198503298175:5812]
2025-09-30T14:52:22.404376Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:22.404391Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:22.404400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:22.404403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:22.404405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:22.404420Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:22.404431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:22.404442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:22.404504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.404512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.404514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.404518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:22.404521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:22.404583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:22.404591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.404605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.404624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.404646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:22.404669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895198593027607:7089], now have 1 active actors on pipe
2025-09-30T14:52:22.404677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895198593027490:2454], now have 1 active actors on pipe
2025-09-30T14:52:22.404683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895198503298170:5812]
2025-09-30T14:52:22.404689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895198503298170:5812]
2025-09-30T14:52:22.404692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895198503298170:5812]
2025-09-30T14:52:22.404705Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:22.404718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:22.404691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 791
2025-09-30T14:52:22.404722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:22.404726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 791
2025-09-30T14:52:22.404737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:22.404738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:22.404738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:22.404741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:22.404773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895198503298170:5812]
2025-09-30T14:52:22.404785Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:22.404798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:22.404803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:22.404808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:22.404848Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a502bb72-d6ee84b3-198bd25e-a6d3cf25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:22.404860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:22.404864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:22.404871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:22.404879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:22.404890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:22.404911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:22.405068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:22.405091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:22.405112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:22.405199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 792 partition: 0 MaxSeqNo: 42 sessionId: src_id|a502bb72-d6ee84b3-198bd25e-a6d3cf25_0
2025-09-30T14:52:22.405509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|479fbe83-51d4907b-3a3d591c-85505663_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a502bb72-d6ee84b3-198bd25e-a6d3cf25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:22.408270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a502bb72-d6ee84b3-198bd25e-a6d3cf25_0] Write session: try to update token
2025-09-30T14:52:22.408287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a502bb72-d6ee84b3-198bd25e-a6d3cf25_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:22.416866Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:22.416887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:22.416890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:22.416892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:22.416901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895198503298170:5812]
2025-09-30T14:52:22.416906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895198503298170:5812]
2025-09-30T14:52:22.416910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895198503298170:5812]
2025-09-30T14:52:22.416949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:22.416959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.416958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:22.416961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:22.416964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:22.416968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:22.417105Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:22.422351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 792 sessionId: src_id|a502bb72-d6ee84b3-198bd25e-a6d3cf25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:22.425176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:22.476469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895198593027642:6573]
2025-09-30T14:52:22.476732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 791, pipe: [1:7555895198593027642:6573]
2025-09-30T14:52:22.525683Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:22.525923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:22.525935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:22.525966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895198593027642:6573], now have 1 active actors on pipe
2025-09-30T14:52:22.526142Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:22.526175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895198593027642:6573]
2025-09-30T14:52:22.526190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:22.526212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:22.526283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 792 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a502bb72-d6ee84b3-198bd25e-a6d3cf25_0
2025-09-30T14:52:22.526452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 792 sessionId: src_id|a502bb72-d6ee84b3-198bd25e-a6d3cf25_0 is DEAD
2025-09-30T14:52:22.526632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a502bb72-d6ee84b3-198bd25e-a6d3cf25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:22.526645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a502bb72-d6ee84b3-198bd25e-a6d3cf25_0] Write session will restart in 0.009972s
2025-09-30T14:52:22.526669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a502bb72-d6ee84b3-198bd25e-a6d3cf25_0] Write session: Do CDS request
2025-09-30T14:52:22.526676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a502bb72-d6ee84b3-198bd25e-a6d3cf25_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:22.537033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:22.537765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a502bb72-d6ee84b3-198bd25e-a6d3cf25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:22.537868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:22.537881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 793
2025-09-30T14:52:22.538000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 793 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:22.538033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 793 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:22.538039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=793 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:22.538042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:22.538418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 793 sessionId:  describe result for acl check
2025-09-30T14:52:22.538453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:22.538455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:22.538456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:22.538460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895198593027730:7101] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:22.538871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895198593027730:7101] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:22.541180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895198593027730:7101] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:22.541187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:22.541373Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:22.541382Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:22.541390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:22.541431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:22.541461Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895198503298335:5826]
2025-09-30T14:52:22.541921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:22.542197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:22.542227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:22.542460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:22.542505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:22.542510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:22.542511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:22.542512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:22.542512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:22.542513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:22.542514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:22.542515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:22.542515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:22.542516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:22.542517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.542518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.542518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.542519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:22.542520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:22.542523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:22.542530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:22.542532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:22.542535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:22.542538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:22.542543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:22.542546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:22.542550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:22.542554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:22.542558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:22.542562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.542565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.542568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.542572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:22.542576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:22.542583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:22.542591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:22.542596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:22.542602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:22.542606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:22.542611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:22.542616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:22.542621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:22.542626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:22.542631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:22.542635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:22.542640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:22.542644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:22.542649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:22.542653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:22.542658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:22.542663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:22.542668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:22.542673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:22.542677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:22.542683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.542688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.542694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.542699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.542707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.542712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.542717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:22.542727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:22.542733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:22.542743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:22.542787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:22.545191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895198593027730:7101] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:22.545209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895198593027730:7101] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:22.545213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895198593027730:7101] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:22.545222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 793 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:22.548352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:22.549275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:22.549291Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:22.549294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:22.549298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:22.549305Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 792 [2:7555895198503298335:5826]
2025-09-30T14:52:22.549321Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:22.549335Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:22.549343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:22.549346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:22.549349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:22.549366Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:22.549376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:22.549383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:22.549441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.549449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.549451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.549454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:22.549458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:22.549522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:22.549529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.549542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.549554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.549577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:22.549601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895198593027645:2454], now have 1 active actors on pipe
2025-09-30T14:52:22.549610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895198593027768:7101], now have 1 active actors on pipe
2025-09-30T14:52:22.549616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895198503298327:5826]
2025-09-30T14:52:22.549618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895198503298327:5826]
2025-09-30T14:52:22.549620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895198503298327:5826]
2025-09-30T14:52:22.549634Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:22.549654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:22.549660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:22.549665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:22.549667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:22.549673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:22.549676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:22.549678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 792
2025-09-30T14:52:22.549687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 792
2025-09-30T14:52:22.549709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895198503298327:5826]
2025-09-30T14:52:22.549720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:22.549734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:22.549748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:22.549758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:22.550154Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|607b0107-bbee32a1-4c3eea31-7204e9d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:22.550169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:22.550173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:22.550175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:22.550184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:22.550194Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:22.550220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:22.550457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:22.550464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:22.550476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:22.550571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 793 partition: 0 MaxSeqNo: 42 sessionId: src_id|607b0107-bbee32a1-4c3eea31-7204e9d7_0
2025-09-30T14:52:22.550903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a502bb72-d6ee84b3-198bd25e-a6d3cf25_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|607b0107-bbee32a1-4c3eea31-7204e9d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:22.553649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|607b0107-bbee32a1-4c3eea31-7204e9d7_0] Write session: try to update token
2025-09-30T14:52:22.553667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|607b0107-bbee32a1-4c3eea31-7204e9d7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:22.561911Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:22.561933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:22.561935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:22.561937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:22.561948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895198503298327:5826]
2025-09-30T14:52:22.561954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895198503298327:5826]
2025-09-30T14:52:22.561958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895198503298327:5826]
2025-09-30T14:52:22.561996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:22.562003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:22.562009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.562010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:22.562011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:22.562014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:22.562140Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:22.567755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 793 sessionId: src_id|607b0107-bbee32a1-4c3eea31-7204e9d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:22.570391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:22.626508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895198593027775:6573]
2025-09-30T14:52:22.626788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 792, pipe: [1:7555895198593027775:6573]
2025-09-30T14:52:22.668568Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:22.668824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:22.668837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:22.668869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895198593027775:6573], now have 1 active actors on pipe
2025-09-30T14:52:22.669074Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:22.669132Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:22.669137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895198593027775:6573]
2025-09-30T14:52:22.669159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:22.669224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 793 reason: status is not ok: tablet will be restarted right now sessionId: src_id|607b0107-bbee32a1-4c3eea31-7204e9d7_0
2025-09-30T14:52:22.669387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 793 sessionId: src_id|607b0107-bbee32a1-4c3eea31-7204e9d7_0 is DEAD
2025-09-30T14:52:22.669512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|607b0107-bbee32a1-4c3eea31-7204e9d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:22.669523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|607b0107-bbee32a1-4c3eea31-7204e9d7_0] Write session will restart in 0.007457s
2025-09-30T14:52:22.669544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|607b0107-bbee32a1-4c3eea31-7204e9d7_0] Write session: Do CDS request
2025-09-30T14:52:22.669549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|607b0107-bbee32a1-4c3eea31-7204e9d7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:22.677776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|607b0107-bbee32a1-4c3eea31-7204e9d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:22.677861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:22.677875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 794
2025-09-30T14:52:22.677993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 794 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:22.678025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 794 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:22.678035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=794 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:22.678039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:22.678561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 794 sessionId:  describe result for acl check
2025-09-30T14:52:22.678601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:22.678603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:22.678605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:22.678610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895198593027832:7105] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:22.679106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895198593027832:7105] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:22.681070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895198593027832:7105] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:22.681225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:22.684876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:22.685094Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:22.685106Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:22.685117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:22.685198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:22.685239Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895198503298460:5829]
2025-09-30T14:52:22.685252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895198593027832:7105] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:22.685266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895198593027832:7105] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:22.685269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895198593027832:7105] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:22.685275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 794 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:22.685864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:22.686189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:22.686243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:22.686556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:22.686618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:22.686624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:22.686625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:22.686627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:22.686628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:22.686629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:22.686630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:22.686631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:22.686632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:22.686634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:22.686635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.686636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.686638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.686639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:22.686640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:22.686646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:22.686656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:22.686660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:22.686664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:22.686667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:22.686671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:22.686674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:22.686678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:22.686682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:22.686687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:22.686690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.686694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.686699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.686703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:22.686707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:22.686714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:22.686722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:22.686730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:22.686736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:22.686742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:22.686748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:22.686752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:22.686758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:22.686763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:22.686768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:22.686779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:22.686785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:22.686787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:22.686790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:22.686792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:22.686795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:22.686798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:22.686801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:22.686804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:22.686807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:22.686810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.686813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.686815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.686818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.686821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.686824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.686826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:22.686829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:22.686832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:22.686836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:22.686862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:22.692383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:22.693616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:22.693632Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:22.693635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:22.693639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:22.693645Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 793 [2:7555895198503298460:5829]
2025-09-30T14:52:22.693661Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:22.693675Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:22.693683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:22.693686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:22.693689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:22.693704Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:22.693715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:22.693729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:22.693788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.693795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.693797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.693801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:22.693803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:22.693865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:22.693872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.693881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.693887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.693897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:22.693910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895198593027777:2454], now have 1 active actors on pipe
2025-09-30T14:52:22.693913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895198593027896:7105], now have 1 active actors on pipe
2025-09-30T14:52:22.693917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895198503298454:5829]
2025-09-30T14:52:22.693919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895198503298454:5829]
2025-09-30T14:52:22.693921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895198503298454:5829]
2025-09-30T14:52:22.693933Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:22.693951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:22.693958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:22.693962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:22.693964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:22.693967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:22.693969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:22.693997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895198503298454:5829]
2025-09-30T14:52:22.694005Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:22.694021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:22.694034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 793
2025-09-30T14:52:22.694039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 793
2025-09-30T14:52:22.694121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:22.694128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:22.694150Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d57b9195-99aef91d-395644b4-8da16a2b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:22.694158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:22.694160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:22.694162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:22.694171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:22.694181Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:22.694191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:22.694352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:22.694358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:22.694368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:22.694468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 794 partition: 0 MaxSeqNo: 42 sessionId: src_id|d57b9195-99aef91d-395644b4-8da16a2b_0
2025-09-30T14:52:22.694795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|607b0107-bbee32a1-4c3eea31-7204e9d7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d57b9195-99aef91d-395644b4-8da16a2b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:22.697588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d57b9195-99aef91d-395644b4-8da16a2b_0] Write session: try to update token
2025-09-30T14:52:22.697609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d57b9195-99aef91d-395644b4-8da16a2b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:22.705691Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:22.705710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:22.705712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:22.705714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:22.705724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895198503298454:5829]
2025-09-30T14:52:22.705732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895198503298454:5829]
2025-09-30T14:52:22.705735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895198503298454:5829]
2025-09-30T14:52:22.705774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:22.705781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.705784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:22.705851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:22.705867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:22.705872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:22.705913Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:22.711705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 794 sessionId: src_id|d57b9195-99aef91d-395644b4-8da16a2b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:22.714428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:22.769357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895198593027907:6573]
2025-09-30T14:52:22.769673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 793, pipe: [1:7555895198593027907:6573]
2025-09-30T14:52:22.812680Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:22.813174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:22.813193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:22.813232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895198593027907:6573], now have 1 active actors on pipe
2025-09-30T14:52:22.813451Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:22.813452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:22.813462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895198593027907:6573]
2025-09-30T14:52:22.813469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:22.813480Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:22.813555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 794 reason: error at write: Disconnected sessionId: src_id|d57b9195-99aef91d-395644b4-8da16a2b_0
2025-09-30T14:52:22.813719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 794 sessionId: src_id|d57b9195-99aef91d-395644b4-8da16a2b_0 is DEAD
2025-09-30T14:52:22.813866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d57b9195-99aef91d-395644b4-8da16a2b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:22.813874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d57b9195-99aef91d-395644b4-8da16a2b_0] Write session will restart in 0.009677s
2025-09-30T14:52:22.813897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d57b9195-99aef91d-395644b4-8da16a2b_0] Write session: Do CDS request
2025-09-30T14:52:22.813905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d57b9195-99aef91d-395644b4-8da16a2b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:22.824791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d57b9195-99aef91d-395644b4-8da16a2b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:22.824866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:22.824883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 795
2025-09-30T14:52:22.825006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 795 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:22.825032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 795 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:22.825038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=795 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:22.825040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:22.825469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 795 sessionId:  describe result for acl check
2025-09-30T14:52:22.825505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:22.825512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:22.825514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:22.825520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895198593027993:7109] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:22.826047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895198593027993:7109] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:22.827080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:22.827984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895198593027993:7109] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:22.830741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:22.830940Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:22.830952Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:22.830964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:22.830973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895198593027993:7109] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:22.830989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895198593027993:7109] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:22.830992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895198593027993:7109] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:22.831000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 795 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:22.831031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:22.831071Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895198503298585:5831]
2025-09-30T14:52:22.831705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:22.832022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:22.832062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:22.832296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:22.832341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:22.832346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:22.832346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:22.832348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:22.832348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:22.832349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:22.832350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:22.832350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:22.832351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:22.832352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:22.832352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.832353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.832354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.832355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:22.832355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:22.832359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:22.832365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:22.832368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:22.832370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:22.832373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:22.832376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:22.832380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:22.832384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:22.832387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:22.832391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:22.832396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.832400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.832404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.832407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:22.832409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:22.832415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:22.832420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:22.832426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:22.832432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:22.832436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:22.832440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:22.832445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:22.832449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:22.832453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:22.832458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:22.832462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:22.832467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:22.832471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:22.832477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:22.832482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:22.832488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:22.832498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:22.832504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:22.832513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:22.832518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:22.832528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.832538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.832546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.832549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.832555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.832558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.832561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:22.832568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:22.832571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:22.832574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:22.832616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:22.837843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:22.838796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:22.838815Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:22.838818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:22.838823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:22.838829Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 794 [2:7555895198503298585:5831]
2025-09-30T14:52:22.838845Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:22.838860Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:22.838867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:22.838871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:22.838874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:22.838889Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:22.838898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:22.838906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:22.838969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.838978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.838980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.838983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:22.838987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:22.839055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:22.839063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.839076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.839089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.839113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:22.839138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895198593028030:7109], now have 1 active actors on pipe
2025-09-30T14:52:22.839142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895198593027909:2454], now have 1 active actors on pipe
2025-09-30T14:52:22.839149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895198503298580:5831]
2025-09-30T14:52:22.839152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895198503298580:5831]
2025-09-30T14:52:22.839154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895198503298580:5831]
2025-09-30T14:52:22.839169Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:22.839184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:22.839197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:22.839207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:22.839208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:22.839210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:22.839211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:22.839238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895198503298580:5831]
2025-09-30T14:52:22.839265Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:22.839213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 794
2025-09-30T14:52:22.839267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:22.839218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 794
2025-09-30T14:52:22.839291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:22.839301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:22.839343Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b14791d-c7cb84bf-79aca71c-f88cf9a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:22.839356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:22.839364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:22.839366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:22.839377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:22.839390Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:22.839415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:22.839557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:22.839566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:22.839581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:22.839658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 795 partition: 0 MaxSeqNo: 42 sessionId: src_id|9b14791d-c7cb84bf-79aca71c-f88cf9a0_0
2025-09-30T14:52:22.839979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d57b9195-99aef91d-395644b4-8da16a2b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9b14791d-c7cb84bf-79aca71c-f88cf9a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:22.842765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b14791d-c7cb84bf-79aca71c-f88cf9a0_0] Write session: try to update token
2025-09-30T14:52:22.842782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b14791d-c7cb84bf-79aca71c-f88cf9a0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:22.851155Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:22.851177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:22.851180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:22.851182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:22.851194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895198503298580:5831]
2025-09-30T14:52:22.851197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895198503298580:5831]
2025-09-30T14:52:22.851201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895198503298580:5831]
2025-09-30T14:52:22.851259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:22.851262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:22.851267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.851269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:22.851270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:22.851275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:22.851406Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:22.856394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 795 sessionId: src_id|9b14791d-c7cb84bf-79aca71c-f88cf9a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:22.858992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:22.913742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895198593028041:6573]
2025-09-30T14:52:22.914042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 794, pipe: [1:7555895198593028041:6573]
2025-09-30T14:52:22.956914Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:22.957433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:22.957446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:22.957482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895198593028041:6573], now have 1 active actors on pipe
2025-09-30T14:52:22.957642Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:22.957720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895198593028041:6573]
2025-09-30T14:52:22.957729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:22.957737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:22.957797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 795 reason: error at write: Disconnected sessionId: src_id|9b14791d-c7cb84bf-79aca71c-f88cf9a0_0
2025-09-30T14:52:22.957883Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:22.957971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 795 sessionId: src_id|9b14791d-c7cb84bf-79aca71c-f88cf9a0_0 is DEAD
2025-09-30T14:52:22.958125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b14791d-c7cb84bf-79aca71c-f88cf9a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:22.958135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b14791d-c7cb84bf-79aca71c-f88cf9a0_0] Write session will restart in 0.008208s
2025-09-30T14:52:22.958152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b14791d-c7cb84bf-79aca71c-f88cf9a0_0] Write session: Do CDS request
2025-09-30T14:52:22.958156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b14791d-c7cb84bf-79aca71c-f88cf9a0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:22.967619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b14791d-c7cb84bf-79aca71c-f88cf9a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:22.967783Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:22.967798Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 796
2025-09-30T14:52:22.967963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 796 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:22.967995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 796 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:22.968005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=796 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:22.968009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:22.968382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 796 sessionId:  describe result for acl check
2025-09-30T14:52:22.968419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:22.968427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:22.968429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:22.968434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895198593028126:7113] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:22.968973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895198593028126:7113] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:22.970072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:22.970717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895198593028126:7113] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:22.973404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:22.973593Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:22.973604Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:22.973615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:22.973674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:22.973669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895198593028126:7113] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:22.973683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895198593028126:7113] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:22.973703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895198593028126:7113] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:22.973711Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895198503298722:5834]
2025-09-30T14:52:22.973711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 796 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:22.974363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:22.974642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:22.974689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:22.974931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:22.974973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:22.974978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:22.974979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:22.974980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:22.974981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:22.974981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:22.974982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:22.974983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:22.974983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:22.974984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:22.974985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.974986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.974986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.974987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:22.974987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:22.974991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:22.974997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:22.975000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:22.975002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:22.975004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:22.975007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:22.975009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:22.975011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:22.975014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:22.975017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:22.975019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.975021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.975023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.975026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:22.975028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:22.975033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:22.975037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:22.975041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:22.975044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:22.975047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:22.975050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:22.975053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:22.975056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:22.975058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:22.975061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:22.975064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:22.975067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:22.975070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:22.975073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:22.975075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:22.975078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:22.975081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:22.975084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:22.975086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:22.975089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:22.975091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.975097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.975101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.975106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.975112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.975117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.975122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:22.975127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:22.975132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:22.975135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:22.975158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:22.980105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:22.981270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:22.981285Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:22.981288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:22.981292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:22.981297Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 795 [2:7555895198503298722:5834]
2025-09-30T14:52:22.981312Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:22.981325Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:22.981332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:22.981335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:22.981338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:22.981352Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:22.981364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:22.981376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:22.981434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.981441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.981443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.981446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:22.981448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:22.981506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:22.981513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:22.981524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:22.981542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:22.981566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:22.981581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895198593028165:7113], now have 1 active actors on pipe
2025-09-30T14:52:22.981589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895198593028042:2454], now have 1 active actors on pipe
2025-09-30T14:52:22.981594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895198503298717:5834]
2025-09-30T14:52:22.981597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895198503298717:5834]
2025-09-30T14:52:22.981598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895198503298717:5834]
2025-09-30T14:52:22.981610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:22.981621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:22.981629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:22.981634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:22.981637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:22.981640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:22.981642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:22.981661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895198503298717:5834]
2025-09-30T14:52:22.981670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:22.981658Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 795
2025-09-30T14:52:22.981670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 795
2025-09-30T14:52:22.981693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:22.981720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:22.981725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:22.981747Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|add7b629-6654051f-304c87eb-4a33cb56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:22.981759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:22.981768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:22.981770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:22.981782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:22.981791Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:22.981811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:22.981942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:22.981952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:22.981966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:22.982065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 796 partition: 0 MaxSeqNo: 42 sessionId: src_id|add7b629-6654051f-304c87eb-4a33cb56_0
2025-09-30T14:52:22.982402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b14791d-c7cb84bf-79aca71c-f88cf9a0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|add7b629-6654051f-304c87eb-4a33cb56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:22.984936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|add7b629-6654051f-304c87eb-4a33cb56_0] Write session: try to update token
2025-09-30T14:52:22.984952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|add7b629-6654051f-304c87eb-4a33cb56_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:22.998650Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:22.998670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:22.998680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895198503298717:5834]
2025-09-30T14:52:22.998730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:22.998766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:22.998914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:22.999069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:22.999219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:22.999386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:22.999585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:22.999637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:23.000051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 796 sessionId: src_id|add7b629-6654051f-304c87eb-4a33cb56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:23.002570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:23.003698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:23.003715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:23.003731Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:23.003733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:23.003735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:23.003736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:23.003742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895198503298717:5834]
2025-09-30T14:52:23.003745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895198503298717:5834]
2025-09-30T14:52:23.003748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895198503298717:5834]
2025-09-30T14:52:23.003782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:23.003791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.003793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:23.003793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:23.003799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:23.003803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:23.003913Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:23.058115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895202887995494:6573]
2025-09-30T14:52:23.058350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 795, pipe: [1:7555895202887995494:6573]
2025-09-30T14:52:23.112214Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:23.112572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:23.112609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895202887995494:6573], now have 1 active actors on pipe
2025-09-30T14:52:23.112715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:23.112791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895202887995494:6573]
2025-09-30T14:52:23.112819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:23.112824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:23.112874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:23.112885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 796 reason: error at write: Disconnected sessionId: src_id|add7b629-6654051f-304c87eb-4a33cb56_0
2025-09-30T14:52:23.113035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 796 sessionId: src_id|add7b629-6654051f-304c87eb-4a33cb56_0 is DEAD
2025-09-30T14:52:23.113117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|add7b629-6654051f-304c87eb-4a33cb56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:23.113126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|add7b629-6654051f-304c87eb-4a33cb56_0] Write session will restart in 0.006226s
2025-09-30T14:52:23.113148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|add7b629-6654051f-304c87eb-4a33cb56_0] Write session: Do CDS request
2025-09-30T14:52:23.113155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|add7b629-6654051f-304c87eb-4a33cb56_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:23.120696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|add7b629-6654051f-304c87eb-4a33cb56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:23.120763Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:23.120796Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 797
2025-09-30T14:52:23.120884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 797 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:23.120908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 797 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:23.120912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=797 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:23.120915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:23.121350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 797 sessionId:  describe result for acl check
2025-09-30T14:52:23.121386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:23.121393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:23.121395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:23.121400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895202887995548:7122] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:23.121921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895202887995548:7122] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:23.123917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895202887995548:7122] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:23.124125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:23.127424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:23.127608Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:23.127616Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:23.127625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:23.127674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:23.127709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895202887995548:7122] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:23.127711Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895202798266147:5837]
2025-09-30T14:52:23.127724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895202887995548:7122] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:23.127729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895202887995548:7122] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:23.127736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 797 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:23.128150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:23.128384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:23.128415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:23.128628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:23.128669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:23.128673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:23.128674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:23.128674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:23.128675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:23.128676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:23.128677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:23.128677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:23.128678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:23.128679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:23.128679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.128680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.128681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.128682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:23.128683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:23.128686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:23.128693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:23.128695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:23.128697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:23.128700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:23.128702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:23.128705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:23.128707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:23.128709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:23.128712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:23.128714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.128716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.128719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.128721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:23.128723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:23.128728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:23.128735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:23.128739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:23.128742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:23.128745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:23.128749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:23.128752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:23.128755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:23.128757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:23.128760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:23.128762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:23.128765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:23.128768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:23.128771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:23.128773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:23.128776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:23.128778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:23.128781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:23.128784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:23.128787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:23.128790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.128793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.128795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.128798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.128801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.128805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.128807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:23.128810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:23.128812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:23.128816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:23.128841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:23.134401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:23.135281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:23.135300Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:23.135303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:23.135307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:23.135315Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 796 [2:7555895202798266147:5837]
2025-09-30T14:52:23.135332Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:23.135349Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:23.135356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:23.135359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:23.135362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:23.135379Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:23.135392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:23.135399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:23.135465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.135474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.135479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.135482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:23.135484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:23.135549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:23.135558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.135571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.135583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.135601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:23.135626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895202887995498:2454], now have 1 active actors on pipe
2025-09-30T14:52:23.135634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895202887995621:7122], now have 1 active actors on pipe
2025-09-30T14:52:23.135641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895202798266141:5837]
2025-09-30T14:52:23.135642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895202798266141:5837]
2025-09-30T14:52:23.135644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895202798266141:5837]
2025-09-30T14:52:23.135657Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:23.135674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:23.135662Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 796
2025-09-30T14:52:23.135684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 796
2025-09-30T14:52:23.135690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:23.135693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:23.135696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:23.135700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:23.135702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:23.135743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:23.135747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:23.135757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895202798266141:5837]
2025-09-30T14:52:23.135763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:23.135775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:23.135787Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18ab3817-4f7f39d3-5a216857-e4fdd206_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:23.135793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:23.135795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:23.135797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:23.135804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:23.135811Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:23.135828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:23.135971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:23.135980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:23.135994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:23.136064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 797 partition: 0 MaxSeqNo: 42 sessionId: src_id|18ab3817-4f7f39d3-5a216857-e4fdd206_0
2025-09-30T14:52:23.136429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|add7b629-6654051f-304c87eb-4a33cb56_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|18ab3817-4f7f39d3-5a216857-e4fdd206_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:23.139272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18ab3817-4f7f39d3-5a216857-e4fdd206_0] Write session: try to update token
2025-09-30T14:52:23.139290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18ab3817-4f7f39d3-5a216857-e4fdd206_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:23.147937Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:23.147959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:23.147965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:23.147968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:23.147978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895202798266141:5837]
2025-09-30T14:52:23.147983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895202798266141:5837]
2025-09-30T14:52:23.147988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895202798266141:5837]
2025-09-30T14:52:23.148036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:23.148040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:23.148044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.148046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:23.148051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:23.148055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:23.148230Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:23.155757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 797 sessionId: src_id|18ab3817-4f7f39d3-5a216857-e4fdd206_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:23.158249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:23.212753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895202887995633:6573]
2025-09-30T14:52:23.213046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 796, pipe: [1:7555895202887995633:6573]
2025-09-30T14:52:23.254559Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:23.255198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:23.255218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:23.255268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895202887995633:6573], now have 1 active actors on pipe
2025-09-30T14:52:23.255570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:23.255599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895202887995633:6573]
2025-09-30T14:52:23.255622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:23.255625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:23.255687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 797 reason: error at write: Disconnected sessionId: src_id|18ab3817-4f7f39d3-5a216857-e4fdd206_0
2025-09-30T14:52:23.255833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 797 sessionId: src_id|18ab3817-4f7f39d3-5a216857-e4fdd206_0 is DEAD
2025-09-30T14:52:23.256024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ab3817-4f7f39d3-5a216857-e4fdd206_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:23.256049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ab3817-4f7f39d3-5a216857-e4fdd206_0] Write session will restart in 0.006545s
2025-09-30T14:52:23.256071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ab3817-4f7f39d3-5a216857-e4fdd206_0] Write session: Do CDS request
2025-09-30T14:52:23.256078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ab3817-4f7f39d3-5a216857-e4fdd206_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:23.256260Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:23.263716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18ab3817-4f7f39d3-5a216857-e4fdd206_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:23.263781Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:23.263797Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 798
2025-09-30T14:52:23.263949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 798 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:23.263979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 798 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:23.263989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=798 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:23.263993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:23.264407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 798 sessionId:  describe result for acl check
2025-09-30T14:52:23.264449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:23.264456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:23.264458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:23.264464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895202887995648:7126] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:23.264989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895202887995648:7126] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:23.267181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895202887995648:7126] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:23.268539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:23.271947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:23.272159Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:23.272168Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:23.272180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:23.272233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:23.272273Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895202798266274:5839]
2025-09-30T14:52:23.272386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895202887995648:7126] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:23.272403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895202887995648:7126] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:23.272409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895202887995648:7126] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:23.272417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 798 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:23.272856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:23.273084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:23.273125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:23.273369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:23.273423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:23.273429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:23.273431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:23.273432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:23.273433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:23.273434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:23.273435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:23.273437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:23.273438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:23.273440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:23.273441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.273443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.273444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.273445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:23.273446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:23.273451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:23.273462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:23.273466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:23.273470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:23.273475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:23.273480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:23.273484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:23.273488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:23.273492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:23.273497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:23.273501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.273506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.273510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.273515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:23.273520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:23.273527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:23.273535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:23.273546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:23.273552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:23.273557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:23.273562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:23.273568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:23.273574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:23.273579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:23.273588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:23.273594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:23.273600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:23.273605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:23.273615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:23.273621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:23.273630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:23.273637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:23.273646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:23.273652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:23.273659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:23.273668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.273674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.273682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.273689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.273697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.273703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.273711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:23.273717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:23.273726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:23.273731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:23.273769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:23.279109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:23.280174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:23.280191Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:23.280195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:23.280200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:23.280207Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 797 [2:7555895202798266274:5839]
2025-09-30T14:52:23.280226Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:23.280242Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:23.280245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:23.280249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:23.280252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:23.280268Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:23.280279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:23.280287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:23.280349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.280355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.280358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.280362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:23.280364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:23.280433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:23.280440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.280452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.280469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.280491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:23.280510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895202887995758:7126], now have 1 active actors on pipe
2025-09-30T14:52:23.280518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895202887995634:2454], now have 1 active actors on pipe
2025-09-30T14:52:23.280525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895202798266269:5839]
2025-09-30T14:52:23.280531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895202798266269:5839]
2025-09-30T14:52:23.280533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895202798266269:5839]
2025-09-30T14:52:23.280548Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:23.280565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:23.280565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:23.280569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:23.280571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:23.280585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:23.280588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:23.280580Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 797
2025-09-30T14:52:23.280613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 797
2025-09-30T14:52:23.280621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895202798266269:5839]
2025-09-30T14:52:23.280629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:23.280632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:23.280652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:23.280656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:23.280704Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea3924b1-de807ae3-591efa62-f963cbb8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:23.280715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:23.280722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:23.280725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:23.280735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:23.280748Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:23.280767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:23.280927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:23.280937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:23.280957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:23.281057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 798 partition: 0 MaxSeqNo: 42 sessionId: src_id|ea3924b1-de807ae3-591efa62-f963cbb8_0
2025-09-30T14:52:23.281372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ab3817-4f7f39d3-5a216857-e4fdd206_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ea3924b1-de807ae3-591efa62-f963cbb8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:23.284115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea3924b1-de807ae3-591efa62-f963cbb8_0] Write session: try to update token
2025-09-30T14:52:23.284136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea3924b1-de807ae3-591efa62-f963cbb8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:23.292573Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:23.292595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:23.292598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:23.292600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:23.292609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895202798266269:5839]
2025-09-30T14:52:23.292614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895202798266269:5839]
2025-09-30T14:52:23.292618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895202798266269:5839]
2025-09-30T14:52:23.292655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:23.292661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.292664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:23.292668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:23.292675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:23.292678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:23.292793Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:23.298996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 798 sessionId: src_id|ea3924b1-de807ae3-591efa62-f963cbb8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:23.301672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:23.355587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895202887995770:6573]
2025-09-30T14:52:23.355900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 797, pipe: [1:7555895202887995770:6573]
2025-09-30T14:52:23.395767Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:23.396338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:23.396355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:23.396387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895202887995770:6573], now have 1 active actors on pipe
2025-09-30T14:52:23.396648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:23.396648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:23.396664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:23.396701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895202887995770:6573]
2025-09-30T14:52:23.396727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 798 reason: error at write: Disconnected sessionId: src_id|ea3924b1-de807ae3-591efa62-f963cbb8_0
2025-09-30T14:52:23.396774Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:23.396886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 798 sessionId: src_id|ea3924b1-de807ae3-591efa62-f963cbb8_0 is DEAD
2025-09-30T14:52:23.397025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea3924b1-de807ae3-591efa62-f963cbb8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:23.397033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea3924b1-de807ae3-591efa62-f963cbb8_0] Write session will restart in 0.009429s
2025-09-30T14:52:23.397056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea3924b1-de807ae3-591efa62-f963cbb8_0] Write session: Do CDS request
2025-09-30T14:52:23.397065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea3924b1-de807ae3-591efa62-f963cbb8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:23.407727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea3924b1-de807ae3-591efa62-f963cbb8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:23.407861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:23.407885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 799
2025-09-30T14:52:23.407995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 799 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:23.408036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 799 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:23.408045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=799 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:23.408049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:23.408533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 799 sessionId:  describe result for acl check
2025-09-30T14:52:23.408568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:23.408575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:23.408577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:23.408583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895202887995860:7130] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:23.409105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895202887995860:7130] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:23.409207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:23.411275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895202887995860:7130] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:23.413268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:23.413474Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:23.413486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895202887995860:7130] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:23.413488Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:23.413501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:23.413499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895202887995860:7130] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:23.413502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895202887995860:7130] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:23.413510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 799 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:23.413557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:23.413595Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895202798266403:5841]
2025-09-30T14:52:23.414254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:23.414541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:23.414587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:23.414869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:23.414930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:23.414936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:23.414938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:23.414939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:23.414940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:23.414942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:23.414943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:23.414944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:23.414945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:23.414946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:23.414948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.414949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.414950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.414951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:23.414952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:23.414958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:23.414968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:23.414973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:23.414977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:23.414981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:23.414985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:23.414990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:23.414994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:23.414998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:23.415002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:23.415007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.415011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.415015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.415019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:23.415023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:23.415030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:23.415038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:23.415044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:23.415050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:23.415054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:23.415059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:23.415068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:23.415074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:23.415084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:23.415090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:23.415099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:23.415105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:23.415114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:23.415120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:23.415125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:23.415129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:23.415131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:23.415135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:23.415138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:23.415141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:23.415144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.415147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.415149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.415152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.415155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.415158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.415160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:23.415164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:23.415166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:23.415169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:23.415203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:23.420495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:23.421647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:23.421660Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:23.421662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:23.421664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:23.421669Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 798 [2:7555895202798266403:5841]
2025-09-30T14:52:23.421680Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:23.421692Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:23.421698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:23.421700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:23.421702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:23.421713Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:23.421718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:23.421723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:23.421769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.421775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.421777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.421779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:23.421781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:23.421835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:23.421842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.421850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.421856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.421865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:23.421877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895202798266398:5841]
2025-09-30T14:52:23.421884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895202798266398:5841]
2025-09-30T14:52:23.421886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895202798266398:5841]
2025-09-30T14:52:23.421894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:23.421904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:23.421908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:23.421913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:23.421914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:23.421921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:23.421923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:23.421933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895202887995771:2454], now have 1 active actors on pipe
2025-09-30T14:52:23.421943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895202887995896:7130], now have 1 active actors on pipe
2025-09-30T14:52:23.421970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895202798266398:5841]
2025-09-30T14:52:23.421990Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:23.422012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:23.422020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 798
2025-09-30T14:52:23.422028Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 798
2025-09-30T14:52:23.422140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:23.422148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:23.422170Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|188f13b0-70583572-f1056a36-c43e1c89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:23.422183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:23.422186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:23.422189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:23.422197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:23.422206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:23.422222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:23.422377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:23.422386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:23.422400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:23.422498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 799 partition: 0 MaxSeqNo: 42 sessionId: src_id|188f13b0-70583572-f1056a36-c43e1c89_0
2025-09-30T14:52:23.422825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea3924b1-de807ae3-591efa62-f963cbb8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|188f13b0-70583572-f1056a36-c43e1c89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:23.425482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|188f13b0-70583572-f1056a36-c43e1c89_0] Write session: try to update token
2025-09-30T14:52:23.425498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|188f13b0-70583572-f1056a36-c43e1c89_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:23.433671Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:23.433693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:23.433695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:23.433696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:23.433703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895202798266398:5841]
2025-09-30T14:52:23.433706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895202798266398:5841]
2025-09-30T14:52:23.433715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895202798266398:5841]
2025-09-30T14:52:23.433745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:23.433750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.433752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:23.433767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:23.433774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:23.433777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:23.433875Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:23.439505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 799 sessionId: src_id|188f13b0-70583572-f1056a36-c43e1c89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:23.442174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:23.496892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895202887995932:6573]
2025-09-30T14:52:23.497150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 798, pipe: [1:7555895202887995932:6573]
2025-09-30T14:52:23.540304Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:23.540841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:23.540858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:23.540891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895202887995932:6573], now have 1 active actors on pipe
2025-09-30T14:52:23.541102Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:23.541175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:23.541213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895202887995932:6573]
2025-09-30T14:52:23.541231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:23.541308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 799 reason: status is not ok: tablet will be restarted right now sessionId: src_id|188f13b0-70583572-f1056a36-c43e1c89_0
2025-09-30T14:52:23.541473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 799 sessionId: src_id|188f13b0-70583572-f1056a36-c43e1c89_0 is DEAD
2025-09-30T14:52:23.541617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|188f13b0-70583572-f1056a36-c43e1c89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:23.541630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|188f13b0-70583572-f1056a36-c43e1c89_0] Write session will restart in 0.009266s
2025-09-30T14:52:23.541646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|188f13b0-70583572-f1056a36-c43e1c89_0] Write session: Do CDS request
2025-09-30T14:52:23.541650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|188f13b0-70583572-f1056a36-c43e1c89_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:23.551789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|188f13b0-70583572-f1056a36-c43e1c89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:23.551838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:23.551857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 800
2025-09-30T14:52:23.552010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 800 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:23.552053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 800 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:23.552063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=800 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:23.552067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:23.552505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 800 sessionId:  describe result for acl check
2025-09-30T14:52:23.552541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:23.552548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:23.552550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:23.552555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895202887996021:7142] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:23.553068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895202887996021:7142] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:23.554256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:23.555129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895202887996021:7142] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:23.557806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:23.557990Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:23.558000Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:23.558009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:23.558056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:23.558092Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895202798266570:5856]
2025-09-30T14:52:23.558195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895202887996021:7142] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:23.558211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895202887996021:7142] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:23.558215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895202887996021:7142] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:23.558222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 800 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:23.558639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:23.558899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:23.558941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:23.559274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:23.559329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:23.559336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:23.559337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:23.559338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:23.559339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:23.559341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:23.559342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:23.559343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:23.559344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:23.559345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:23.559347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.559348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.559349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.559350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:23.559351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:23.559357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:23.559367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:23.559371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:23.559376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:23.559380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:23.559384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:23.559388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:23.559392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:23.559396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:23.559400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:23.559404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.559408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.559412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.559416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:23.559419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:23.559425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:23.559430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:23.559434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:23.559438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:23.559441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:23.559444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:23.559446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:23.559449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:23.559451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:23.559454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:23.559457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:23.559460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:23.559462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:23.559465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:23.559468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:23.559471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:23.559473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:23.559476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:23.559479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:23.559482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:23.559484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.559487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.559489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.559493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.559496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.559498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.559501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:23.559504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:23.559507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:23.559510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:23.559533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:23.564831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:23.565988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:23.566002Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:23.566003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:23.566006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:23.566011Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 799 [2:7555895202798266570:5856]
2025-09-30T14:52:23.566022Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:23.566032Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:23.566034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:23.566036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:23.566038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:23.566048Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:23.566053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:23.566059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:23.566109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.566116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.566117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.566120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:23.566121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:23.566178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:23.566190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.566201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.566212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.566230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:23.566246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895202887995933:2454], now have 1 active actors on pipe
2025-09-30T14:52:23.566254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895202887996058:7142], now have 1 active actors on pipe
2025-09-30T14:52:23.566258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895202798266565:5856]
2025-09-30T14:52:23.566259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895202798266565:5856]
2025-09-30T14:52:23.566262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895202798266565:5856]
2025-09-30T14:52:23.566276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:23.566292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:23.566292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:23.566296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:23.566298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:23.566324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:23.566326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:23.566350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895202798266565:5856]
2025-09-30T14:52:23.566358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:23.566339Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 799
2025-09-30T14:52:23.566371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:23.566351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 799
2025-09-30T14:52:23.566385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:23.566389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:23.566418Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3fc81f3a-8e386c36-13daacc9-5bc41aee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:23.566429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:23.566433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:23.566436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:23.566444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:23.566456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:23.566473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:23.566622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:23.566631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:23.566648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:23.566739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 800 partition: 0 MaxSeqNo: 42 sessionId: src_id|3fc81f3a-8e386c36-13daacc9-5bc41aee_0
2025-09-30T14:52:23.567103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|188f13b0-70583572-f1056a36-c43e1c89_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3fc81f3a-8e386c36-13daacc9-5bc41aee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:23.569875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fc81f3a-8e386c36-13daacc9-5bc41aee_0] Write session: try to update token
2025-09-30T14:52:23.569897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fc81f3a-8e386c36-13daacc9-5bc41aee_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:23.578107Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:23.578127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:23.578129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:23.578132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:23.578141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895202798266565:5856]
2025-09-30T14:52:23.578146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895202798266565:5856]
2025-09-30T14:52:23.578150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895202798266565:5856]
2025-09-30T14:52:23.578185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:23.578191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.578198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:23.578213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:23.578225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:23.578227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:23.578342Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:23.583856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 800 sessionId: src_id|3fc81f3a-8e386c36-13daacc9-5bc41aee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:23.586480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:23.641287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895202887996071:6573]
2025-09-30T14:52:23.641597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 799, pipe: [1:7555895202887996071:6573]
2025-09-30T14:52:23.684767Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:23.685036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:23.685049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:23.685086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895202887996071:6573], now have 1 active actors on pipe
2025-09-30T14:52:23.685308Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:23.685359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:23.685383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:23.685429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895202887996071:6573]
2025-09-30T14:52:23.685465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 800 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3fc81f3a-8e386c36-13daacc9-5bc41aee_0
2025-09-30T14:52:23.685633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 800 sessionId: src_id|3fc81f3a-8e386c36-13daacc9-5bc41aee_0 is DEAD
2025-09-30T14:52:23.685818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fc81f3a-8e386c36-13daacc9-5bc41aee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:23.685828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fc81f3a-8e386c36-13daacc9-5bc41aee_0] Write session will restart in 0.008856s
2025-09-30T14:52:23.685866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fc81f3a-8e386c36-13daacc9-5bc41aee_0] Write session: Do CDS request
2025-09-30T14:52:23.685872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fc81f3a-8e386c36-13daacc9-5bc41aee_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:23.695673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fc81f3a-8e386c36-13daacc9-5bc41aee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:23.695774Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:23.695791Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 801
2025-09-30T14:52:23.695886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 801 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:23.695917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 801 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:23.695928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=801 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:23.695931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:23.696350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 801 sessionId:  describe result for acl check
2025-09-30T14:52:23.696385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:23.696392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:23.696394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:23.696400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895202887996162:7146] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:23.696932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895202887996162:7146] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:23.697222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:23.698721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895202887996162:7146] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:23.700938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:23.701118Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:23.701127Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:23.701136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:23.701168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895202887996162:7146] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:23.701184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:23.701182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895202887996162:7146] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:23.701196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895202887996162:7146] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:23.701204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 801 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:23.701222Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895202798266700:5858]
2025-09-30T14:52:23.701846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:23.702126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:23.702167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:23.702488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:23.702546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:23.702553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:23.702554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:23.702555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:23.702556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:23.702557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:23.702558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:23.702559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:23.702561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:23.702562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:23.702563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.702564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.702565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.702567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:23.702568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:23.702574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:23.702584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:23.702588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:23.702592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:23.702596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:23.702600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:23.702604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:23.702608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:23.702612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:23.702621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:23.702625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.702633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.702637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.702645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:23.702650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:23.702661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:23.702673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:23.702683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:23.702693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:23.702702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:23.702711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:23.702719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:23.702725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:23.702730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:23.702740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:23.702748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:23.702754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:23.702762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:23.702771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:23.702780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:23.702787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:23.702791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:23.702797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:23.702802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:23.702811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:23.702820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.702828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.702836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.702841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.702850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.702859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.702867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:23.702872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:23.702878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:23.702887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:23.702929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:23.708452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:23.709783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:23.709803Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:23.709806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:23.709811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:23.709818Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 800 [2:7555895202798266700:5858]
2025-09-30T14:52:23.709835Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:23.709848Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:23.709856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:23.709859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:23.709862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:23.709877Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:23.709884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:23.709890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:23.709951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.709958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.709960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.709963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:23.709966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:23.710028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:23.710039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.710049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.710055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.710064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:23.710077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895202798266695:5858]
2025-09-30T14:52:23.710079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895202798266695:5858]
2025-09-30T14:52:23.710080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895202798266695:5858]
2025-09-30T14:52:23.710086Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:23.710098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895202887996199:7146], now have 1 active actors on pipe
2025-09-30T14:52:23.710097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:23.710100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895202887996072:2454], now have 1 active actors on pipe
2025-09-30T14:52:23.710101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:23.710103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:23.710106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:23.710114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:23.710116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:23.710140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895202798266695:5858]
2025-09-30T14:52:23.710148Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:23.710156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:23.710214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 800
2025-09-30T14:52:23.710220Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 800
2025-09-30T14:52:23.710287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:23.710296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:23.710333Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c454baf-c377331a-b0eeded0-48832ad0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:23.710348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:23.710357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:23.710359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:23.710366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:23.710378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:23.710393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:23.710561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:23.710569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:23.710581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:23.710659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 801 partition: 0 MaxSeqNo: 42 sessionId: src_id|9c454baf-c377331a-b0eeded0-48832ad0_0
2025-09-30T14:52:23.710968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fc81f3a-8e386c36-13daacc9-5bc41aee_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9c454baf-c377331a-b0eeded0-48832ad0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:23.713549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c454baf-c377331a-b0eeded0-48832ad0_0] Write session: try to update token
2025-09-30T14:52:23.713567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c454baf-c377331a-b0eeded0-48832ad0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:23.727340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 801 sessionId: src_id|9c454baf-c377331a-b0eeded0-48832ad0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:23.727412Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:23.727432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:23.727440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895202798266695:5858]
2025-09-30T14:52:23.727488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:23.727511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:23.727666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:23.727805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:23.727934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:23.728062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:23.728253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:23.728290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:23.730064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:23.730275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:23.730289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:23.730332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:23.730438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:23.732534Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:23.732549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:23.732554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:23.732555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:23.732561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895202798266695:5858]
2025-09-30T14:52:23.732564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895202798266695:5858]
2025-09-30T14:52:23.732566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895202798266695:5858]
2025-09-30T14:52:23.732593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:23.732598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.732600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:23.732609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:23.732615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:23.732621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:23.732724Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:23.785645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895202887996210:6573]
2025-09-30T14:52:23.785927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 800, pipe: [1:7555895202887996210:6573]
2025-09-30T14:52:23.837470Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:23.844344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:23.844370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:23.844520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:23.844576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:23.844634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:23.844691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:23.844735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:23.844743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:23.844809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:23.844866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:23.844924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:23.844984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:23.845025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:23.845034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:23.845101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:23.845156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:23.845214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:23.845272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:23.845318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:23.845324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:23.845385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:23.845451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:23.845520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:23.845578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:23.845618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:23.845624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:23.845685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:23.845741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:23.845798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:23.845855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:23.845896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:23.845902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:23.845964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:23.846020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:23.846078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:23.846137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:23.846195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:23.846201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:23.846262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:23.846329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:23.846386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:23.846443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:23.846483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:23.846489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:23.846550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:23.846607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:23.846664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:23.846719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:23.846822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:23.846831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:23.846892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:23.846945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:23.847002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:23.847061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:23.847117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:23.847127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:23.847184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:23.847236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:23.847320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:23.847384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:23.847424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:23.847430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:23.847470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895202887996210:6573], now have 1 active actors on pipe
2025-09-30T14:52:23.847755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895202887996210:6573]
2025-09-30T14:52:23.847764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:23.847769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:23.847790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:23.847799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 801 reason: error at write: Disconnected sessionId: src_id|9c454baf-c377331a-b0eeded0-48832ad0_0
2025-09-30T14:52:23.847818Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:52:23.847895Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 8 consumer shared/user session shared/user_1_8_16360897178546223690_v1 is DEAD
2025-09-30T14:52:23.847978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 801 sessionId: src_id|9c454baf-c377331a-b0eeded0-48832ad0_0 is DEAD
2025-09-30T14:52:23.848013Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895138463470751:6569] disconnected; active server actors: 1
2025-09-30T14:52:23.848022Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895138463470751:6569] client user disconnected session shared/user_1_8_16360897178546223690_v1
2025-09-30T14:52:23.848100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c454baf-c377331a-b0eeded0-48832ad0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:23.848110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c454baf-c377331a-b0eeded0-48832ad0_0] Write session will restart in 0.008644s
2025-09-30T14:52:23.848143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c454baf-c377331a-b0eeded0-48832ad0_0] Write session: Do CDS request
2025-09-30T14:52:23.848149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c454baf-c377331a-b0eeded0-48832ad0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:23.848194Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:52:23.848239Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:23.848330Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:52:23.848335Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:52:23.848341Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.006753s
2025-09-30T14:52:23.855577Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:52:23.855760Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:52:23.855773Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 9
2025-09-30T14:52:23.855946Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 9 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:52:23.855996Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:52:23.856081Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 auth for : user
2025-09-30T14:52:23.856231Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 Handle describe topics response
2025-09-30T14:52:23.856267Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 auth is DEAD
2025-09-30T14:52:23.856274Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:52:23.856505Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:52:23.856585Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895202887996232:7150] connected; active server actors: 1
2025-09-30T14:52:23.856599Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555895202887996232:7150] session shared/user_1_9_3987928195281550931_v1
2025-09-30T14:52:23.856607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:52:23.856617Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:52:23.856628Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_9_3987928195281550931_v1" (Sender=[1:7555895202887996224:7150], Pipe=[1:7555895202887996232:7150], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:52:23.856632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:52:23.856632Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_9_3987928195281550931_v1
2025-09-30T14:52:23.856641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:52:23.856653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_9_3987928195281550931_v1" (Sender=[1:7555895202887996224:7150], Pipe=[1:7555895202887996232:7150], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:52:23.856665Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_9_3987928195281550931_v1" sender [1:7555895202887996224:7150] lock partition 0 for ReadingSession "shared/user_1_9_3987928195281550931_v1" (Sender=[1:7555895202887996224:7150], Pipe=[1:7555895202887996232:7150], Partitions=[], ActiveFamilyCount=1) generation 1 step 9
2025-09-30T14:52:23.856682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:52:23.856691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000043s
2025-09-30T14:52:23.856923Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 9 Session: "shared/user_1_9_3987928195281550931_v1" ClientId: "user" PipeClient { RawX1: 7555895202887996232 RawX2: 4503603922344942 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:52:23.856951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:52:23.857578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c454baf-c377331a-b0eeded0-48832ad0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:23.857642Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:23.857652Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 802
2025-09-30T14:52:23.857756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 802 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:23.857783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 802 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:23.857792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=802 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:23.857796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:23.858177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 802 sessionId:  describe result for acl check
2025-09-30T14:52:23.858213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:23.858222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:23.858224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:23.858229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895202887996288:7154] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:23.858781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895202887996288:7154] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:23.860681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:23.861010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895202887996288:7154] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:23.864118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:23.864325Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:23.864334Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:23.864344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:23.864348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895202887996288:7154] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:23.864362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895202887996288:7154] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:23.864365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895202887996288:7154] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:23.864396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:23.864373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 802 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:23.864439Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895202798266832:5860]
2025-09-30T14:52:23.864996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:23.865329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:23.865366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:23.865632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:23.865676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:23.865680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:23.865682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:23.865682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:23.865683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:23.865684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:23.865685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:23.865686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:23.865686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:23.865687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:23.865688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.865689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.865689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.865690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:23.865691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:23.865694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:23.865701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:23.865703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:23.865706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:23.865708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:23.865710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:23.865712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:23.865715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:23.865717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:23.865719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:23.865722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.865724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.865728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.865732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:23.865736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:23.865743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:23.865751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:23.865757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:23.865761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:23.865764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:23.865767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:23.865770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:23.865773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:23.865775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:23.865778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:23.865781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:23.865784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:23.865786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:23.865789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:23.865791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:23.865794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:23.865797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:23.865800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:23.865802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:23.865806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:23.865808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.865812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.865815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.865817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.865820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.865823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.865826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:23.865829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:23.865832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:23.865838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:23.865871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:23.871222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:23.872078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:23.872095Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:23.872098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:23.872103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:23.872110Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 801 [2:7555895202798266832:5860]
2025-09-30T14:52:23.872127Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:23.872145Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:23.872152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:23.872155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:23.872158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:23.872172Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:23.872183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:23.872194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:23.872253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.872261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.872264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.872267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:23.872270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:23.872335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:23.872342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.872355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:23.872372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:23.872393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:23.872414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895202887996347:7154], now have 1 active actors on pipe
2025-09-30T14:52:23.872422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895202887996212:2454], now have 1 active actors on pipe
2025-09-30T14:52:23.872425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895202887996241:7153], now have 1 active actors on pipe
2025-09-30T14:52:23.872431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895202798266827:5860]
2025-09-30T14:52:23.872437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895202798266827:5860]
2025-09-30T14:52:23.872440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895202798266827:5860]
2025-09-30T14:52:23.872450Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:23.872466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:23.872485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:23.872493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:23.872493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:23.872498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:23.872500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:23.872522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895202798266827:5860]
2025-09-30T14:52:23.872529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:23.872500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 801
2025-09-30T14:52:23.872500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 801
2025-09-30T14:52:23.872547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:23.872558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:23.872562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:23.872531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 801, pipe: [1:7555895202887996241:7153]
2025-09-30T14:52:23.872584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:23.872590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:23.872597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_9_3987928195281550931_v1 on pipe: [1:7555895202887996241:7153]
2025-09-30T14:52:23.872627Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3114e36d-9a7bae34-57ff4e5-aa738a4f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:23.872638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:23.872645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:23.872647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:23.872650Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_9_3987928195281550931_v1:1 with generation 801
2025-09-30T14:52:23.872655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:23.872664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:23.872675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:23.872679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:23.872681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:23.872693Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_9_3987928195281550931_v1
2025-09-30T14:52:23.872695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:23.872717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:23.872735Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:52:23.872859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:23.872869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:23.872883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:23.872967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 802 partition: 0 MaxSeqNo: 42 sessionId: src_id|3114e36d-9a7bae34-57ff4e5-aa738a4f_0
2025-09-30T14:52:23.873314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c454baf-c377331a-b0eeded0-48832ad0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3114e36d-9a7bae34-57ff4e5-aa738a4f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:23.876035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3114e36d-9a7bae34-57ff4e5-aa738a4f_0] Write session: try to update token
2025-09-30T14:52:23.876056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3114e36d-9a7bae34-57ff4e5-aa738a4f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:23.877112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:52:23.877150Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:52:23.877163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:23.877165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:23.877168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:23.877176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:52:23.877194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:52:23.877347Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759243943872 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:52:23.877369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:52:23.877419Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 sending to client partition status
2025-09-30T14:52:23.885340Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:23.885364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:23.885366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:23.885368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:23.885378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895202798266827:5860]
2025-09-30T14:52:23.885382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895202798266827:5860]
2025-09-30T14:52:23.885387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895202798266827:5860]
2025-09-30T14:52:23.885427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:23.885433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:23.885436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:23.885436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:23.885442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:23.885445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:23.885570Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:23.890883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 802 sessionId: src_id|3114e36d-9a7bae34-57ff4e5-aa738a4f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:23.893571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:23.992126Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:23.992830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:23.992849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:23.993060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:23.993082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_9_3987928195281550931_v1
2025-09-30T14:52:23.993072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:23.993102Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:23.993077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:23.993109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895202887996241:7153]
2025-09-30T14:52:23.993126Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_9_3987928195281550931_v1
2025-09-30T14:52:23.993138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 802 reason: error at write: Disconnected sessionId: src_id|3114e36d-9a7bae34-57ff4e5-aa738a4f_0
2025-09-30T14:52:23.993365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 802 sessionId: src_id|3114e36d-9a7bae34-57ff4e5-aa738a4f_0 is DEAD
2025-09-30T14:52:23.993455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3114e36d-9a7bae34-57ff4e5-aa738a4f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:23.993465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3114e36d-9a7bae34-57ff4e5-aa738a4f_0] Write session will restart in 0.005168s
2025-09-30T14:52:23.993488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3114e36d-9a7bae34-57ff4e5-aa738a4f_0] Write session: Do CDS request
2025-09-30T14:52:23.993492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3114e36d-9a7bae34-57ff4e5-aa738a4f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:23.999628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3114e36d-9a7bae34-57ff4e5-aa738a4f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:23.999696Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:23.999712Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 803
2025-09-30T14:52:23.999833Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 803 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:23.999868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 803 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:23.999875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=803 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:23.999878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:24.000175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 803 sessionId:  describe result for acl check
2025-09-30T14:52:24.000200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:24.000205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:24.000206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:24.000210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895207182963676:7160] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:24.000622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895207182963676:7160] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:24.003068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895207182963676:7160] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:24.005308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895207182963676:7160] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:24.005325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895207182963676:7160] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:24.005328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895207182963676:7160] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:24.005336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 803 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:24.008776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:24.009289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:24.009432Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:24.009440Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:24.009447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:24.009490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:24.009520Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895207093234275:5863]
2025-09-30T14:52:24.009962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:24.010191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:24.010231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:24.010475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:24.010517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:24.010518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:24.010518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:24.010519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:24.010520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:24.010520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:24.010521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:24.010522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:24.010522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:24.010523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:24.010524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.010524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.010525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.010526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:24.010526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:24.010530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:24.010536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:24.010539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:24.010541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:24.010543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:24.010546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:24.010548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:24.010550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:24.010552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:24.010555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:24.010557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.010559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.010561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.010564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:24.010566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:24.010570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:24.010575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:24.010579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:24.010582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:24.010584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:24.010587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:24.010590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:24.010593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:24.010595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:24.010598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:24.010601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:24.010604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:24.010607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:24.010610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:24.010613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:24.010615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:24.010618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:24.010621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:24.010624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:24.010626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:24.010629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.010632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.010635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.010639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.010641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.010645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.010647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:24.010650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:24.010653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:24.010656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:24.010689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:24.015863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:24.016645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:24.016659Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:24.016661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:24.016664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:24.016669Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 802 [2:7555895207093234275:5863]
2025-09-30T14:52:24.016680Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:24.016690Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:24.016696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:24.016698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:24.016699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:24.016711Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:24.016716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:24.016721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:24.016763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.016769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.016770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.016773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:24.016775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:24.016823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:24.016828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.016835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.016841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.016855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:24.016872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895207182963802:7160], now have 1 active actors on pipe
2025-09-30T14:52:24.016879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895202887996362:2454], now have 1 active actors on pipe
2025-09-30T14:52:24.016886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895207093234270:5863]
2025-09-30T14:52:24.016893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895207093234270:5863]
2025-09-30T14:52:24.016895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895207093234270:5863]
2025-09-30T14:52:24.016905Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:24.016919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:24.016922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:24.016927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:24.016928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:24.016936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:24.016938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:24.016966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895207093234270:5863]
2025-09-30T14:52:24.016973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:24.016976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:24.016945Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 802
2025-09-30T14:52:24.016948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 802
2025-09-30T14:52:24.016996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:24.017004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:24.017027Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab7d2d13-16185552-999116cc-f9ee2c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:24.017035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:24.017038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:24.017039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:24.017046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:24.017052Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:24.017067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:24.017208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:24.017220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:24.017239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:24.017315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 803 partition: 0 MaxSeqNo: 42 sessionId: src_id|ab7d2d13-16185552-999116cc-f9ee2c8_0
2025-09-30T14:52:24.017646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3114e36d-9a7bae34-57ff4e5-aa738a4f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ab7d2d13-16185552-999116cc-f9ee2c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:24.020316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab7d2d13-16185552-999116cc-f9ee2c8_0] Write session: try to update token
2025-09-30T14:52:24.020332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab7d2d13-16185552-999116cc-f9ee2c8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:24.028435Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:24.028460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:24.028462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:24.028464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:24.028474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895207093234270:5863]
2025-09-30T14:52:24.028480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895207093234270:5863]
2025-09-30T14:52:24.028486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895207093234270:5863]
2025-09-30T14:52:24.028534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:24.028538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:24.028546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.028548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:24.028550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:24.028552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:24.028755Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:24.034753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 803 sessionId: src_id|ab7d2d13-16185552-999116cc-f9ee2c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:24.037503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:24.093367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895207182963818:7153]
2025-09-30T14:52:24.093656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 802, pipe: [1:7555895207182963818:7153]
2025-09-30T14:52:24.132862Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:24.133117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:24.133130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:24.133161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895207182963818:7153], now have 1 active actors on pipe
2025-09-30T14:52:24.133324Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:24.133394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:24.133413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:24.133446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895207182963818:7153]
2025-09-30T14:52:24.133482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 803 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ab7d2d13-16185552-999116cc-f9ee2c8_0
2025-09-30T14:52:24.133650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 803 sessionId: src_id|ab7d2d13-16185552-999116cc-f9ee2c8_0 is DEAD
2025-09-30T14:52:24.133790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab7d2d13-16185552-999116cc-f9ee2c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:24.133802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab7d2d13-16185552-999116cc-f9ee2c8_0] Write session will restart in 0.007944s
2025-09-30T14:52:24.133833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab7d2d13-16185552-999116cc-f9ee2c8_0] Write session: Do CDS request
2025-09-30T14:52:24.133840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab7d2d13-16185552-999116cc-f9ee2c8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:24.142757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab7d2d13-16185552-999116cc-f9ee2c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:24.142860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:24.142885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 804
2025-09-30T14:52:24.143088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 804 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:24.143120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 804 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:24.143129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=804 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:24.143133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:24.143568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 804 sessionId:  describe result for acl check
2025-09-30T14:52:24.143600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:24.143608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:24.143609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:24.143615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895207182963912:7165] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:24.144151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895207182963912:7165] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:24.144466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:24.145841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895207182963912:7165] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:24.148198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:24.148363Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:24.148371Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:24.148378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:24.148414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:24.148443Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895207093234409:5866]
2025-09-30T14:52:24.148508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895207182963912:7165] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:24.148521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895207182963912:7165] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:24.148524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895207182963912:7165] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:24.148530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 804 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:24.148880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:24.149084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:24.149111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:24.149320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:24.149360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:24.149365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:24.149366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:24.149367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:24.149368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:24.149368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:24.149369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:24.149370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:24.149371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:24.149371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:24.149372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.149373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.149374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.149374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:24.149375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:24.149379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:24.149385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:24.149388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:24.149390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:24.149392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:24.149395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:24.149397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:24.149400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:24.149402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:24.149405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:24.149407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.149409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.149412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.149414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:24.149416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:24.149421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:24.149426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:24.149430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:24.149434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:24.149437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:24.149440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:24.149443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:24.149446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:24.149450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:24.149453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:24.149456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:24.149459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:24.149462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:24.149465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:24.149468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:24.149472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:24.149474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:24.149477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:24.149480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:24.149483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:24.149486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.149489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.149491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.149494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.149497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.149500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.149502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:24.149505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:24.149510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:24.149513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:24.149537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:24.154694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:24.155590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:24.155609Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:24.155612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:24.155616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:24.155623Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 803 [2:7555895207093234409:5866]
2025-09-30T14:52:24.155638Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:24.155653Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:24.155656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:24.155659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:24.155662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:24.155678Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:24.155690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:24.155696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:24.155755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.155762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.155764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.155767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:24.155770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:24.155840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:24.155849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.155860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.155876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.155899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:24.155920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895207182963819:2454], now have 1 active actors on pipe
2025-09-30T14:52:24.155929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895207182963950:7165], now have 1 active actors on pipe
2025-09-30T14:52:24.155935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895207093234403:5866]
2025-09-30T14:52:24.155939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895207093234403:5866]
2025-09-30T14:52:24.155941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895207093234403:5866]
2025-09-30T14:52:24.155954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:24.155973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:24.155973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:24.155976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:24.155979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:24.155991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:24.155995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:24.155976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 803
2025-09-30T14:52:24.155996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 803
2025-09-30T14:52:24.156025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895207093234403:5866]
2025-09-30T14:52:24.156033Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:24.156036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:24.156052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:24.156061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:24.156107Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|771a0dfd-9b85e6d0-3d193403-d6dbec93_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:24.156118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:24.156121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:24.156123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:24.156132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:24.156145Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:24.156165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:24.156305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:24.156313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:24.156326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:24.156404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 804 partition: 0 MaxSeqNo: 42 sessionId: src_id|771a0dfd-9b85e6d0-3d193403-d6dbec93_0
2025-09-30T14:52:24.156757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab7d2d13-16185552-999116cc-f9ee2c8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|771a0dfd-9b85e6d0-3d193403-d6dbec93_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:24.159543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|771a0dfd-9b85e6d0-3d193403-d6dbec93_0] Write session: try to update token
2025-09-30T14:52:24.159566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|771a0dfd-9b85e6d0-3d193403-d6dbec93_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:24.167722Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:24.167743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:24.167745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:24.167748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:24.167757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895207093234403:5866]
2025-09-30T14:52:24.167761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895207093234403:5866]
2025-09-30T14:52:24.167766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895207093234403:5866]
2025-09-30T14:52:24.167813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:24.167814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:24.167820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:24.167825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.167825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:24.167828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:24.167976Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:24.173392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 804 sessionId: src_id|771a0dfd-9b85e6d0-3d193403-d6dbec93_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:24.175946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:24.233667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895207182963961:7153]
2025-09-30T14:52:24.233926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 803, pipe: [1:7555895207182963961:7153]
2025-09-30T14:52:24.278952Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:24.279648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:24.279664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:24.279698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895207182963961:7153], now have 1 active actors on pipe
2025-09-30T14:52:24.279900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:24.279920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895207182963961:7153]
2025-09-30T14:52:24.279941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:24.279944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:24.279997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 804 reason: error at write: Disconnected sessionId: src_id|771a0dfd-9b85e6d0-3d193403-d6dbec93_0
2025-09-30T14:52:24.280178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 804 sessionId: src_id|771a0dfd-9b85e6d0-3d193403-d6dbec93_0 is DEAD
2025-09-30T14:52:24.280302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|771a0dfd-9b85e6d0-3d193403-d6dbec93_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:24.280313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|771a0dfd-9b85e6d0-3d193403-d6dbec93_0] Write session will restart in 0.006697s
2025-09-30T14:52:24.280348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|771a0dfd-9b85e6d0-3d193403-d6dbec93_0] Write session: Do CDS request
2025-09-30T14:52:24.280355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|771a0dfd-9b85e6d0-3d193403-d6dbec93_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:24.280373Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:24.287772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|771a0dfd-9b85e6d0-3d193403-d6dbec93_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:24.287861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:24.287880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 805
2025-09-30T14:52:24.288027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 805 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:24.288057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 805 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:24.288068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=805 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:24.288072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:24.288534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 805 sessionId:  describe result for acl check
2025-09-30T14:52:24.288566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:24.288568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:24.288570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:24.288575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895207182963976:7169] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:24.289107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895207182963976:7169] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:24.291938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895207182963976:7169] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:24.293527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:24.297227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:24.297442Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:24.297454Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:24.297468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:24.297539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:24.297585Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895207093234543:5868]
2025-09-30T14:52:24.297700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895207182963976:7169] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:24.297714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895207182963976:7169] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:24.297719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895207182963976:7169] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:24.297725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 805 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:24.298130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:24.298500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:24.298553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:24.298812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:24.298887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:24.298894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:24.298896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:24.298897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:24.298899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:24.298900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:24.298901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:24.298903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:24.298904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:24.298905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:24.298906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.298908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.298909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.298910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:24.298911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:24.298918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:24.298927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:24.298932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:24.298936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:24.298941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:24.298946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:24.298949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:24.298951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:24.298954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:24.298956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:24.298959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.298961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.298964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.298966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:24.298968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:24.298978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:24.298986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:24.298992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:24.298998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:24.299003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:24.299008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:24.299013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:24.299018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:24.299022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:24.299024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:24.299027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:24.299032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:24.299035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:24.299038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:24.299040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:24.299043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:24.299046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:24.299049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:24.299051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:24.299054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:24.299057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.299060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.299063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.299066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.299069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.299072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.299074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:24.299077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:24.299080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:24.299083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:24.299109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:24.304549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:24.305734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:24.305753Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:24.305755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:24.305758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:24.305764Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 804 [2:7555895207093234543:5868]
2025-09-30T14:52:24.305776Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:24.305788Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:24.305790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:24.305792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:24.305794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:24.305805Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:24.305810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:24.305815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:24.305860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.305866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.305868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.305870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:24.305872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:24.305924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:24.305930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.305939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.305945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.305959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:24.305976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895207182964092:7169], now have 1 active actors on pipe
2025-09-30T14:52:24.305989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895207093234538:5868]
2025-09-30T14:52:24.305991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895207093234538:5868]
2025-09-30T14:52:24.305992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895207093234538:5868]
2025-09-30T14:52:24.306001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:24.306011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895207182963962:2454], now have 1 active actors on pipe
2025-09-30T14:52:24.306017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:24.306017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:24.306021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:24.306023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:24.306029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:24.306031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:24.306055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895207093234538:5868]
2025-09-30T14:52:24.306061Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:24.306066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:24.306087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:24.306056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 804
2025-09-30T14:52:24.306093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:24.306063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 804
2025-09-30T14:52:24.306116Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c47ec693-fec371c9-401e43aa-9d5fa4d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:24.306125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:24.306127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:24.306129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:24.306136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:24.306142Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:24.306155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:24.306277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:24.306283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:24.306293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:24.306390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 805 partition: 0 MaxSeqNo: 42 sessionId: src_id|c47ec693-fec371c9-401e43aa-9d5fa4d2_0
2025-09-30T14:52:24.306740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|771a0dfd-9b85e6d0-3d193403-d6dbec93_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c47ec693-fec371c9-401e43aa-9d5fa4d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:24.309262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c47ec693-fec371c9-401e43aa-9d5fa4d2_0] Write session: try to update token
2025-09-30T14:52:24.309278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c47ec693-fec371c9-401e43aa-9d5fa4d2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:24.317837Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:24.317857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:24.317867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895207093234538:5868]
2025-09-30T14:52:24.317912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:24.317916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:24.318115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:24.318263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:24.318444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:24.318607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:24.318823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:24.318864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:24.323274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 805 sessionId: src_id|c47ec693-fec371c9-401e43aa-9d5fa4d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:24.325880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:24.326194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:24.326216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:24.326253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:24.326342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:24.328287Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:24.328316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:24.328319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:24.328321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:24.328331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895207093234538:5868]
2025-09-30T14:52:24.328334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895207093234538:5868]
2025-09-30T14:52:24.328336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895207093234538:5868]
2025-09-30T14:52:24.328366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:24.328374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.328376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:24.328387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:24.328402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:24.328407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:24.328549Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:24.380112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895207182964105:7153]
2025-09-30T14:52:24.380390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 804, pipe: [1:7555895207182964105:7153]
2025-09-30T14:52:24.438043Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:24.445937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:24.445966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:24.446135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.446197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.446260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.446338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.446383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.446392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.446459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.446518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.446579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.446642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.446687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.446697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.446762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.446826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.446888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.446952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.446995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.447003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.447068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.447170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.447234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.447316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.447361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.447368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.447435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.447498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.447562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.447625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.447670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.447678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.447795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.447853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.447916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.447982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.448030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.448037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.448101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.448158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.448224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.448290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.448338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.448346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.448408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.448467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.448528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.448592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.448634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.448642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.448709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.448768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.448833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.448896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.448940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.448950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.449016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.449074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.449135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.449197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.449242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.449249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.449310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895207182964105:7153], now have 1 active actors on pipe
2025-09-30T14:52:24.449574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895207182964105:7153]
2025-09-30T14:52:24.449604Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:24.449613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:24.449617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:24.449644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 805 reason: error at write: Disconnected sessionId: src_id|c47ec693-fec371c9-401e43aa-9d5fa4d2_0
2025-09-30T14:52:24.449827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 805 sessionId: src_id|c47ec693-fec371c9-401e43aa-9d5fa4d2_0 is DEAD
2025-09-30T14:52:24.449969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c47ec693-fec371c9-401e43aa-9d5fa4d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:24.449981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c47ec693-fec371c9-401e43aa-9d5fa4d2_0] Write session will restart in 0.007900s
2025-09-30T14:52:24.450005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c47ec693-fec371c9-401e43aa-9d5fa4d2_0] Write session: Do CDS request
2025-09-30T14:52:24.450011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c47ec693-fec371c9-401e43aa-9d5fa4d2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:24.450467Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:24.458774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c47ec693-fec371c9-401e43aa-9d5fa4d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:24.458871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:24.458891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 806
2025-09-30T14:52:24.459012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 806 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:24.459046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 806 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:24.459057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=806 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:24.459060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:24.459564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 806 sessionId:  describe result for acl check
2025-09-30T14:52:24.459600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:24.459606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:24.459608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:24.459614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895207182964156:7173] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:24.460160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895207182964156:7173] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:24.462718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895207182964156:7173] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:24.462765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:24.466422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:24.466599Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:24.466609Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:24.466619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:24.466660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:24.466695Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895207093234678:5870]
2025-09-30T14:52:24.466836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895207182964156:7173] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:24.466852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895207182964156:7173] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:24.466856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895207182964156:7173] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:24.466865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 806 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:24.467396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:24.467668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:24.467724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:24.467978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:24.468029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:24.468034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:24.468034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:24.468035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:24.468036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:24.468037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:24.468037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:24.468038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:24.468039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:24.468040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:24.468041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.468041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.468042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.468043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:24.468044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:24.468048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:24.468055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:24.468057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:24.468060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:24.468062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:24.468065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:24.468067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:24.468069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:24.468072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:24.468074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:24.468076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.468079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.468081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.468083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:24.468086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:24.468091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:24.468095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:24.468100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:24.468103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:24.468107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:24.468110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:24.468113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:24.468116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:24.468118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:24.468122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:24.468124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:24.468128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:24.468130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:24.468133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:24.468136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:24.468139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:24.468141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:24.468144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:24.468147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:24.468150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:24.468153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.468157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.468159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.468162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.468164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.468167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.468170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:24.468172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:24.468175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:24.468178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:24.468201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:24.473734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:24.474558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:24.474574Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:24.474576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:24.474579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:24.474585Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 805 [2:7555895207093234678:5870]
2025-09-30T14:52:24.474597Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:24.474611Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:24.474612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:24.474615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:24.474617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:24.474632Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:24.474637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:24.474642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:24.474690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.474698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.474700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.474702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:24.474704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:24.474772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:24.474779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.474791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.474810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.474834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:24.474859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895207182964239:7173], now have 1 active actors on pipe
2025-09-30T14:52:24.474864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895207182964106:2454], now have 1 active actors on pipe
2025-09-30T14:52:24.474870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895207093234673:5870]
2025-09-30T14:52:24.474873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895207093234673:5870]
2025-09-30T14:52:24.474875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895207093234673:5870]
2025-09-30T14:52:24.474887Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:24.474904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:24.474912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:24.474915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:24.474918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:24.474924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:24.474928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:24.474959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895207093234673:5870]
2025-09-30T14:52:24.474967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:24.474940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 805
2025-09-30T14:52:24.474979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:24.474943Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 805
2025-09-30T14:52:24.474999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:24.475002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:24.475025Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3d3e3b3-ff300cc4-79cabbe7-31d7b22b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:24.475034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:24.475037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:24.475040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:24.475050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:24.475064Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:24.475081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:24.475271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:24.475284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:24.475307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:24.475396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 806 partition: 0 MaxSeqNo: 42 sessionId: src_id|b3d3e3b3-ff300cc4-79cabbe7-31d7b22b_0
2025-09-30T14:52:24.475749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c47ec693-fec371c9-401e43aa-9d5fa4d2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b3d3e3b3-ff300cc4-79cabbe7-31d7b22b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:24.478480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3d3e3b3-ff300cc4-79cabbe7-31d7b22b_0] Write session: try to update token
2025-09-30T14:52:24.478493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3d3e3b3-ff300cc4-79cabbe7-31d7b22b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:24.486767Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:24.486790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:24.486799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895207093234673:5870]
2025-09-30T14:52:24.486841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:24.486850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:24.487009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:24.487149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:24.487302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:24.487447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:24.487763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:24.487804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:24.492035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 806 sessionId: src_id|b3d3e3b3-ff300cc4-79cabbe7-31d7b22b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:24.494654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:24.494848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:24.494873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:24.494916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:24.495011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:24.497529Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:24.497543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:24.497544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:24.497547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:24.497554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895207093234673:5870]
2025-09-30T14:52:24.497557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895207093234673:5870]
2025-09-30T14:52:24.497560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895207093234673:5870]
2025-09-30T14:52:24.497605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:24.497611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.497613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:24.497626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:24.497633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:24.497638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:24.497742Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:24.549580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895207182964275:7153]
2025-09-30T14:52:24.550241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 805, pipe: [1:7555895207182964275:7153]
2025-09-30T14:52:24.604153Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:24.611077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:24.611102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:24.611275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.611335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.611393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.611461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.611833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.611845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.611909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.611972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.612034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.612095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.612135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.612141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.612203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.612264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.612325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.612386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.612425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.612431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.612494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.612559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.612615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.612733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.612871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.612877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.612938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.612997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.613061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.613118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.613157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.613164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.613226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.613297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.613370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.613437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.613481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.613486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.613557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.613611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.613671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.613728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.613769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.613777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.613844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.613899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.613955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.614012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.614064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.614072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.614133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.614192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.614252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.614330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.614376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.614381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.614446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.614510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.614576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.614641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.614684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.614690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.614752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895207182964275:7153], now have 1 active actors on pipe
2025-09-30T14:52:24.614975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:24.614992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:24.615024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 806 reason: error at write: Disconnected sessionId: src_id|b3d3e3b3-ff300cc4-79cabbe7-31d7b22b_0
2025-09-30T14:52:24.615180Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:24.615192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 806 sessionId: src_id|b3d3e3b3-ff300cc4-79cabbe7-31d7b22b_0 is DEAD
2025-09-30T14:52:24.615348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3d3e3b3-ff300cc4-79cabbe7-31d7b22b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:24.615359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3d3e3b3-ff300cc4-79cabbe7-31d7b22b_0] Write session will restart in 0.006264s
2025-09-30T14:52:24.615383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3d3e3b3-ff300cc4-79cabbe7-31d7b22b_0] Write session: Do CDS request
2025-09-30T14:52:24.615389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3d3e3b3-ff300cc4-79cabbe7-31d7b22b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:24.615391Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:24.615414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895207182964275:7153]
2025-09-30T14:52:24.622695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3d3e3b3-ff300cc4-79cabbe7-31d7b22b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:24.622823Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:24.622837Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 807
2025-09-30T14:52:24.622942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 807 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:24.622966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 807 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:24.622977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=807 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:24.622981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:24.623413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 807 sessionId:  describe result for acl check
2025-09-30T14:52:24.623443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:24.623449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:24.623450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:24.623453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895207182964290:7185] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:24.623862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895207182964290:7185] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:24.626048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895207182964290:7185] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:24.628474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895207182964290:7185] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:24.628484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895207182964290:7185] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:24.628488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895207182964290:7185] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:24.628497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 807 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:24.628501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:24.632574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:24.632750Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:24.632759Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:24.632767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:24.632810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:24.632841Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895207093234854:5885]
2025-09-30T14:52:24.633296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:24.633581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:24.633612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:24.633846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:24.633892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:24.633899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:24.633900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:24.633901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:24.633902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:24.633903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:24.633904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:24.633905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:24.633906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:24.633907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:24.633908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.633909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.633911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.633911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:24.633912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:24.633917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:24.633928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:24.633933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:24.633936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:24.633938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:24.633941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:24.633943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:24.633946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:24.633948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:24.633950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:24.633953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.633955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.633958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.633960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:24.633962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:24.633968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:24.633973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:24.633979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:24.633985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:24.633991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:24.633997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:24.634001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:24.634007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:24.634011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:24.634017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:24.634021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:24.634024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:24.634027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:24.634030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:24.634033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:24.634036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:24.634039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:24.634041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:24.634045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:24.634048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:24.634050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.634053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.634056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.634058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.634061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.634063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.634066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:24.634069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:24.634071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:24.634074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:24.634097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:24.639531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:24.640684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:24.640698Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:24.640700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:24.640703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:24.640707Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 806 [2:7555895207093234854:5885]
2025-09-30T14:52:24.640721Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:24.640732Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:24.640735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:24.640737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:24.640738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:24.640749Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:24.640754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:24.640768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:24.640814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.640821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.640822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.640824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:24.640826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:24.640874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:24.640880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.640887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.640899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.640919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:24.640936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895207093234848:5885]
2025-09-30T14:52:24.640940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895207093234848:5885]
2025-09-30T14:52:24.640941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895207093234848:5885]
2025-09-30T14:52:24.640947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:24.640956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:24.640960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:24.640961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895207182964407:7185], now have 1 active actors on pipe
2025-09-30T14:52:24.640962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:24.640963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895207182964276:2454], now have 1 active actors on pipe
2025-09-30T14:52:24.640969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:24.640978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:24.640980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:24.641001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895207093234848:5885]
2025-09-30T14:52:24.641009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:24.641017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:24.641009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 806
2025-09-30T14:52:24.641055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:24.641010Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 806
2025-09-30T14:52:24.641062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:24.641081Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45c4538c-dec43649-919dd918-33467fa4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:24.641089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:24.641092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:24.641093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:24.641098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:24.641105Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:24.641119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:24.641251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:24.641256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:24.641266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:24.641343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 807 partition: 0 MaxSeqNo: 42 sessionId: src_id|45c4538c-dec43649-919dd918-33467fa4_0
2025-09-30T14:52:24.641669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3d3e3b3-ff300cc4-79cabbe7-31d7b22b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|45c4538c-dec43649-919dd918-33467fa4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:24.644220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c4538c-dec43649-919dd918-33467fa4_0] Write session: try to update token
2025-09-30T14:52:24.644234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c4538c-dec43649-919dd918-33467fa4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:24.652687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:24.652710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:24.652720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895207093234848:5885]
2025-09-30T14:52:24.652767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:24.652783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:24.652951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:24.653106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:24.653260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:24.653404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:24.653595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:24.653632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:24.657696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 807 sessionId: src_id|45c4538c-dec43649-919dd918-33467fa4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:24.660643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:24.660864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:24.660888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:24.660922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:24.661021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:24.663368Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:24.663385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:24.663386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:24.663388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:24.663395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895207093234848:5885]
2025-09-30T14:52:24.663397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895207093234848:5885]
2025-09-30T14:52:24.663400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895207093234848:5885]
2025-09-30T14:52:24.663431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:24.663436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.663438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:24.663448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:24.663454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:24.663459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:24.663556Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:24.715457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895207182964421:7153]
2025-09-30T14:52:24.715761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 806, pipe: [1:7555895207182964421:7153]
2025-09-30T14:52:24.770778Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:24.778511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:24.778538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:24.778701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.778764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.778828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.778898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.779030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.779040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.779107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.779163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.779226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.779310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.779355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.779365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.779428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.779485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.779551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.779611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.779652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.779658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.779718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.779784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.779845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.779912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.779959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.779967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.780036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.780098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.780157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.780215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.780262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.780272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.780340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.780398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.780455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.780518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.780566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.780571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.780631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.780684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.780743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.780808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.780864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.780869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.780935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.781001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.781067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.781125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.781169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.781174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.781243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.781307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.781379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.781441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.781501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.781506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.781566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.781620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.781679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.781738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.781779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.781785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.781844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895207182964421:7153], now have 1 active actors on pipe
2025-09-30T14:52:24.782085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:24.782098Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:24.782100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:24.782126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 807 reason: error at write: Disconnected sessionId: src_id|45c4538c-dec43649-919dd918-33467fa4_0
2025-09-30T14:52:24.782144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895207182964421:7153]
2025-09-30T14:52:24.782356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 807 sessionId: src_id|45c4538c-dec43649-919dd918-33467fa4_0 is DEAD
2025-09-30T14:52:24.782465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c4538c-dec43649-919dd918-33467fa4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:24.782486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c4538c-dec43649-919dd918-33467fa4_0] Write session will restart in 0.007013s
2025-09-30T14:52:24.782509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c4538c-dec43649-919dd918-33467fa4_0] Write session: Do CDS request
2025-09-30T14:52:24.782514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c4538c-dec43649-919dd918-33467fa4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:24.782908Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:24.790746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c4538c-dec43649-919dd918-33467fa4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:24.790843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:24.790862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 808
2025-09-30T14:52:24.791004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 808 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:24.791037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 808 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:24.791049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=808 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:24.791053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:24.791439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 808 sessionId:  describe result for acl check
2025-09-30T14:52:24.791465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:24.791470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:24.791471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:24.791475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895207182964468:7189] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:24.791924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895207182964468:7189] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:24.794288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895207182964468:7189] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:24.794994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:24.798642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:24.798828Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:24.798844Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:24.798856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:24.798915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:24.798930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895207182964468:7189] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:24.798946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895207182964468:7189] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:24.798967Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895207093234991:5887]
2025-09-30T14:52:24.798950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895207182964468:7189] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:24.798958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 808 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:24.799584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:24.799890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:24.799939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:24.800232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:24.800317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:24.800322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:24.800323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:24.800323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:24.800324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:24.800325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:24.800326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:24.800327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:24.800327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:24.800328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:24.800329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.800330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.800330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.800331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:24.800332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:24.800336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:24.800343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:24.800345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:24.800348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:24.800350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:24.800353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:24.800355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:24.800357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:24.800360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:24.800362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:24.800365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.800367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.800369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.800371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:24.800374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:24.800380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:24.800385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:24.800389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:24.800393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:24.800396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:24.800399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:24.800402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:24.800405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:24.800408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:24.800411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:24.800414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:24.800417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:24.800420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:24.800423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:24.800427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:24.800430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:24.800433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:24.800438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:24.800445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:24.800448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:24.800452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.800456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.800458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.800461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.800463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.800467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.800470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:24.800473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:24.800476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:24.800479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:24.800515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:24.806032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:24.807122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:24.807138Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:24.807140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:24.807143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:24.807151Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 807 [2:7555895207093234991:5887]
2025-09-30T14:52:24.807164Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:24.807177Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:24.807179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:24.807181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:24.807183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:24.807197Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:24.807205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:24.807213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:24.807292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.807304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.807306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.807309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:24.807312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:24.807381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:24.807390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.807404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.807414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.807429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:24.807450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895207182964422:2454], now have 1 active actors on pipe
2025-09-30T14:52:24.807459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895207182964557:7189], now have 1 active actors on pipe
2025-09-30T14:52:24.807466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895207093234986:5887]
2025-09-30T14:52:24.807468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895207093234986:5887]
2025-09-30T14:52:24.807471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895207093234986:5887]
2025-09-30T14:52:24.807484Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:24.807498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:24.807504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:24.807508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:24.807510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:24.807519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:24.807522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:24.807553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895207093234986:5887]
2025-09-30T14:52:24.807565Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:24.807563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 807
2025-09-30T14:52:24.807572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 807
2025-09-30T14:52:24.807601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:24.807646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:24.807656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:24.807685Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a850b6a-5262370-1f1d2720-38e65fa5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:24.807697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:24.807705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:24.807709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:24.807721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:24.807734Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:24.807753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:24.807948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:24.807964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:24.807989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:24.808087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 808 partition: 0 MaxSeqNo: 42 sessionId: src_id|2a850b6a-5262370-1f1d2720-38e65fa5_0
2025-09-30T14:52:24.808459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c4538c-dec43649-919dd918-33467fa4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2a850b6a-5262370-1f1d2720-38e65fa5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:24.811176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a850b6a-5262370-1f1d2720-38e65fa5_0] Write session: try to update token
2025-09-30T14:52:24.811193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a850b6a-5262370-1f1d2720-38e65fa5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:24.819475Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:24.819496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:24.819509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895207093234986:5887]
2025-09-30T14:52:24.819556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:24.819560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:24.819743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:24.819908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:24.820137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:24.820291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:24.820497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:24.820543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:24.825105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 808 sessionId: src_id|2a850b6a-5262370-1f1d2720-38e65fa5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:24.827904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:24.828219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:24.828257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:24.828291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:24.828392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:24.830332Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:24.830350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:24.830353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:24.830355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:24.830364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895207093234986:5887]
2025-09-30T14:52:24.830369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895207093234986:5887]
2025-09-30T14:52:24.830373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895207093234986:5887]
2025-09-30T14:52:24.830415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:24.830420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:24.830426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:24.830427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.830429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:24.830429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:24.830582Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:24.882377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895207182964569:7153]
2025-09-30T14:52:24.882678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 807, pipe: [1:7555895207182964569:7153]
2025-09-30T14:52:24.944140Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:24.952807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:24.952838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:24.953020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.953092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.953162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.953235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.953279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.953290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.953359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.953420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.953485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.953557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.953616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.953624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.953694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.953757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.953827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.953895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.953943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.953951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.954026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.954097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.954162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.954226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.954272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.954283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.954370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.954435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.954504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.954574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.954620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.954628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.954702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.954767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.954835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.954900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.954947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.954957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.955024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.955089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.955155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.955221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.955290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.955299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.955370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.955434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.955501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.955568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.955618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.955628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.955701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.955770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.955835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.955900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.955952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.955961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.956028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:24.956093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:24.956160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:24.956227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:24.956273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:24.956285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:24.956355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895207182964569:7153], now have 1 active actors on pipe
2025-09-30T14:52:24.956610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:24.956658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:24.956659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895207182964569:7153]
2025-09-30T14:52:24.956671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:24.956700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 808 reason: error at write: Disconnected sessionId: src_id|2a850b6a-5262370-1f1d2720-38e65fa5_0
2025-09-30T14:52:24.956881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 808 sessionId: src_id|2a850b6a-5262370-1f1d2720-38e65fa5_0 is DEAD
2025-09-30T14:52:24.957019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a850b6a-5262370-1f1d2720-38e65fa5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:24.957031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a850b6a-5262370-1f1d2720-38e65fa5_0] Write session will restart in 0.009777s
2025-09-30T14:52:24.957054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a850b6a-5262370-1f1d2720-38e65fa5_0] Write session: Do CDS request
2025-09-30T14:52:24.957060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a850b6a-5262370-1f1d2720-38e65fa5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:24.957426Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:24.967776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a850b6a-5262370-1f1d2720-38e65fa5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:24.967873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:24.967892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 809
2025-09-30T14:52:24.968028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 809 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:24.968060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 809 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:24.968071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=809 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:24.968075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:24.968534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 809 sessionId:  describe result for acl check
2025-09-30T14:52:24.968574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:24.968581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:24.968598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:24.968604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895207182964672:7193] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:24.969140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895207182964672:7193] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:24.969754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:24.971558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895207182964672:7193] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:24.973285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:24.973497Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:24.973508Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:24.973518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:24.973567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:24.973608Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895207093235142:5889]
2025-09-30T14:52:24.974140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895207182964672:7193] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:24.974153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895207182964672:7193] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:24.974156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895207182964672:7193] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:24.974162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 809 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:24.974242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:24.974582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:24.974636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:24.974948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:24.975017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:24.975023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:24.975025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:24.975026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:24.975027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:24.975028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:24.975029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:24.975030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:24.975031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:24.975032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:24.975033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.975034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.975035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.975036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:24.975037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:24.975042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:24.975051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:24.975056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:24.975059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:24.975063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:24.975066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:24.975070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:24.975073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:24.975077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:24.975081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:24.975084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.975088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.975092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.975095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:24.975098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:24.975106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:24.975114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:24.975120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:24.975124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:24.975129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:24.975133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:24.975137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:24.975141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:24.975147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:24.975151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:24.975155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:24.975159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:24.975165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:24.975169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:24.975174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:24.975178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:24.975183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:24.975187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:24.975192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:24.975196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:24.975202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.975206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.975210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.975215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.975219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.975225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.975234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:24.975238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:24.975259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:24.975264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:24.975302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:24.980916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:24.981791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:24.981811Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:24.981814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:24.981818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:24.981824Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 808 [2:7555895207093235142:5889]
2025-09-30T14:52:24.981841Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:24.981857Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:24.981865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:24.981869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:24.981871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:24.981886Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:24.981898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:24.981910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:24.981970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.981977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.981979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.981982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:24.981983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:24.982035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:24.982043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:24.982052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:24.982058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:24.982067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:24.982080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895207093235137:5889]
2025-09-30T14:52:24.982081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895207093235137:5889]
2025-09-30T14:52:24.982083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895207093235137:5889]
2025-09-30T14:52:24.982088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:24.982099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:24.982099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:24.982102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:24.982104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:24.982110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:24.982112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:24.982119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895207182964573:2454], now have 1 active actors on pipe
2025-09-30T14:52:24.982121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895207182964706:7193], now have 1 active actors on pipe
2025-09-30T14:52:24.982146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895207093235137:5889]
2025-09-30T14:52:24.982158Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:24.982167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:24.982191Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 808
2025-09-30T14:52:24.982228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 808
2025-09-30T14:52:24.982321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:24.982339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:24.982368Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d1e4cc0-c7e318ce-f2b6ae85-77517d38_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:24.982375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:24.982387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:24.982393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:24.982401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:24.982412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:24.982427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:24.982633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:24.982646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:24.982669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:24.982800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 809 partition: 0 MaxSeqNo: 42 sessionId: src_id|6d1e4cc0-c7e318ce-f2b6ae85-77517d38_0
2025-09-30T14:52:24.983145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a850b6a-5262370-1f1d2720-38e65fa5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6d1e4cc0-c7e318ce-f2b6ae85-77517d38_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:24.985964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d1e4cc0-c7e318ce-f2b6ae85-77517d38_0] Write session: try to update token
2025-09-30T14:52:24.985981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d1e4cc0-c7e318ce-f2b6ae85-77517d38_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:24.993769Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:24.993785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:24.993792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895207093235137:5889]
2025-09-30T14:52:24.993831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:24.993835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:24.993995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:24.994136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:24.994265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:24.994416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:24.994612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:24.994667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:25.000110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 809 sessionId: src_id|6d1e4cc0-c7e318ce-f2b6ae85-77517d38_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:25.002839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:25.003034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:25.003056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:25.003093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:25.003173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:25.004822Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:25.004840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:25.004843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:25.004845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:25.004853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895207093235137:5889]
2025-09-30T14:52:25.004857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895207093235137:5889]
2025-09-30T14:52:25.004860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895207093235137:5889]
2025-09-30T14:52:25.004891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:25.004900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.004901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:25.004917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:25.004933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:25.004941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:25.005023Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:25.056967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895211477932032:7153]
2025-09-30T14:52:25.057240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 808, pipe: [1:7555895211477932032:7153]
2025-09-30T14:52:25.112012Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:25.120313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:25.120339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:25.120496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:25.120556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:25.120620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:25.120683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:25.120725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:25.120734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:25.120809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:25.120867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:25.120931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:25.120999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:25.121041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:25.121048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:25.121117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:25.121182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:25.121258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:25.121325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:25.121370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:25.121377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:25.121444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:25.121515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:25.121579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:25.121644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:25.121694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:25.121701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:25.121768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:25.121828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:25.121890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:25.121966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:25.122015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:25.122025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:25.122089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:25.122147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:25.122204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:25.122260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:25.122320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:25.122326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:25.122389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:25.122445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:25.122507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:25.122574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:25.122616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:25.122623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:25.122682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:25.122740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:25.122802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:25.122859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:25.122900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:25.122907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:25.122968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:25.123023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:25.123090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:25.123160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:25.123211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:25.123220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:25.123304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:25.123360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:25.123416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:25.123474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:25.123514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:25.123521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:25.123582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895211477932032:7153], now have 1 active actors on pipe
2025-09-30T14:52:25.123807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895211477932032:7153]
2025-09-30T14:52:25.123809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:25.123813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:25.123840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:25.123842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 809 reason: error at write: Disconnected sessionId: src_id|6d1e4cc0-c7e318ce-f2b6ae85-77517d38_0
2025-09-30T14:52:25.124025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 809 sessionId: src_id|6d1e4cc0-c7e318ce-f2b6ae85-77517d38_0 is DEAD
2025-09-30T14:52:25.124176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d1e4cc0-c7e318ce-f2b6ae85-77517d38_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:25.124186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d1e4cc0-c7e318ce-f2b6ae85-77517d38_0] Write session will restart in 0.009860s
2025-09-30T14:52:25.124209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d1e4cc0-c7e318ce-f2b6ae85-77517d38_0] Write session: Do CDS request
2025-09-30T14:52:25.124213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d1e4cc0-c7e318ce-f2b6ae85-77517d38_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:25.124549Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:25.134726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d1e4cc0-c7e318ce-f2b6ae85-77517d38_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:25.134859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:25.134877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 810
2025-09-30T14:52:25.134999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 810 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:25.135031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 810 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:25.135042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=810 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:25.135045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:25.135491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 810 sessionId:  describe result for acl check
2025-09-30T14:52:25.135528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:25.135536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:25.135538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:25.135544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895211477932136:7200] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:25.136083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895211477932136:7200] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:25.138132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895211477932136:7200] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:25.141088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:25.141613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:25.141791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895211477932136:7200] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:25.141812Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:25.141827Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:25.141806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895211477932136:7200] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:25.141840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:25.141808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895211477932136:7200] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:25.141815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 810 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:25.141900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:25.141941Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895211388202580:5893]
2025-09-30T14:52:25.142590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:25.142843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:25.142883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:25.143201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:25.143273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:25.143279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:25.143280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:25.143281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:25.143282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:25.143283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:25.143285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:25.143286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:25.143287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:25.143288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:25.143290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.143291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.143292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.143293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:25.143295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:25.143300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:25.143309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:25.143313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:25.143317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:25.143320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:25.143324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:25.143328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:25.143332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:25.143335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:25.143339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:25.143343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.143348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.143351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.143355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:25.143359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:25.143367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:25.143374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:25.143380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:25.143386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:25.143393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:25.143404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:25.143408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:25.143415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:25.143420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:25.143426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:25.143430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:25.143436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:25.143441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:25.143447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:25.143456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:25.143461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:25.143472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:25.143478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:25.143487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:25.143492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:25.143501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.143506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.143517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.143523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.143532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.143537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.143546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:25.143552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:25.143561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:25.143566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:25.143610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:25.149119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:25.149975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:25.149994Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:25.149996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:25.150000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:25.150005Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 809 [2:7555895211388202580:5893]
2025-09-30T14:52:25.150018Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:25.150030Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:25.150032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:25.150034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:25.150037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:25.150048Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:25.150054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:25.150064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:25.150120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.150128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.150129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.150132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:25.150134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:25.150193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:25.150199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.150208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.150218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.150234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:25.150257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895211477932174:7200], now have 1 active actors on pipe
2025-09-30T14:52:25.150265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895211477932037:2454], now have 1 active actors on pipe
2025-09-30T14:52:25.150271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895211388202575:5893]
2025-09-30T14:52:25.150274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895211388202575:5893]
2025-09-30T14:52:25.150276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895211388202575:5893]
2025-09-30T14:52:25.150290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:25.150317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:25.150325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:25.150330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:25.150333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:25.150336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:25.150339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:25.150361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895211388202575:5893]
2025-09-30T14:52:25.150371Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:25.150374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 809
2025-09-30T14:52:25.150382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 809
2025-09-30T14:52:25.150385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:25.150445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:25.150455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:25.150479Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d03d7e7-53e691e1-a84771b0-d73112d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:25.150492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:25.150500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:25.150503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:25.150513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:25.150527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:25.150545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:25.150670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:25.150678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:25.150693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:25.150777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 810 partition: 0 MaxSeqNo: 42 sessionId: src_id|1d03d7e7-53e691e1-a84771b0-d73112d7_0
2025-09-30T14:52:25.151101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d1e4cc0-c7e318ce-f2b6ae85-77517d38_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1d03d7e7-53e691e1-a84771b0-d73112d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:25.153824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d03d7e7-53e691e1-a84771b0-d73112d7_0] Write session: try to update token
2025-09-30T14:52:25.153839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d03d7e7-53e691e1-a84771b0-d73112d7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:25.168111Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:25.168129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:25.168138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895211388202575:5893]
2025-09-30T14:52:25.168183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:25.168216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:25.168345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:25.168489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:25.168622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:25.168766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:25.168978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:25.168974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 810 sessionId: src_id|1d03d7e7-53e691e1-a84771b0-d73112d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:25.169032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:25.171830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:25.172173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:25.172196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:25.172244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:25.172398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:25.173640Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:25.173657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:25.173659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:25.173661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:25.173669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895211388202575:5893]
2025-09-30T14:52:25.173673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895211388202575:5893]
2025-09-30T14:52:25.173679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895211388202575:5893]
2025-09-30T14:52:25.173717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:25.173727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.173730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:25.173733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:25.173739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:25.173743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:25.173856Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:25.223878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895211477932185:7153]
2025-09-30T14:52:25.224146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 809, pipe: [1:7555895211477932185:7153]
2025-09-30T14:52:25.279081Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:25.287200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:25.287235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:25.287417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:25.287481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:25.287563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:25.287647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:25.287697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:25.287707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:25.287799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:25.287880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:25.287955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:25.288023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:25.288069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:25.288076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:25.288140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:25.288205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:25.288276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:25.288338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:25.288381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:25.288387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:25.288453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:25.288515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:25.288576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:25.288635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:25.288680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:25.288685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:25.288749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:25.288807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:25.288873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:25.288935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:25.288975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:25.288981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:25.289057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:25.289117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:25.289175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:25.289233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:25.289277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:25.289281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:25.289351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:25.289409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:25.289475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:25.289532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:25.289574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:25.289579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:25.289641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:25.289697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:25.289758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:25.289922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:25.289965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:25.289971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:25.290111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:25.290223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:25.290287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:25.290364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:25.290418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:25.290426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:25.290496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:25.290555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:25.290617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:25.290684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:25.290732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:25.290739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:25.290810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895211477932185:7153], now have 1 active actors on pipe
2025-09-30T14:52:25.291153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895211477932185:7153]
2025-09-30T14:52:25.291162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:25.291165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:25.291186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:25.291202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 810 reason: error at write: Disconnected sessionId: src_id|1d03d7e7-53e691e1-a84771b0-d73112d7_0
2025-09-30T14:52:25.291375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 810 sessionId: src_id|1d03d7e7-53e691e1-a84771b0-d73112d7_0 is DEAD
2025-09-30T14:52:25.291517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d03d7e7-53e691e1-a84771b0-d73112d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:25.291536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d03d7e7-53e691e1-a84771b0-d73112d7_0] Write session will restart in 0.006446s
2025-09-30T14:52:25.291562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d03d7e7-53e691e1-a84771b0-d73112d7_0] Write session: Do CDS request
2025-09-30T14:52:25.291568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d03d7e7-53e691e1-a84771b0-d73112d7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:25.292041Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:25.298745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d03d7e7-53e691e1-a84771b0-d73112d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:25.298868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:25.298885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 811
2025-09-30T14:52:25.299011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 811 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:25.299037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 811 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:25.299041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=811 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:25.299044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:25.299503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 811 sessionId:  describe result for acl check
2025-09-30T14:52:25.299545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:25.299547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:25.299712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:25.299722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895211477932202:7204] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:25.300240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895211477932202:7204] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:25.303350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895211477932202:7204] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:25.308478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:25.308813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895211477932202:7204] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:25.308830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895211477932202:7204] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:25.308834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895211477932202:7204] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:25.308842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 811 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:25.308999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:25.309177Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:25.309190Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:25.309201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:25.309253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:25.309297Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895211388202722:5895]
2025-09-30T14:52:25.309953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:25.310206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:25.310245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:25.310581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:25.310644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:25.310650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:25.310651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:25.310652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:25.310655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:25.310656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:25.310657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:25.310658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:25.310660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:25.310661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:25.310662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.310663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.310665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.310666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:25.310667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:25.310673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:25.310684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:25.310688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:25.310693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:25.310697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:25.310702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:25.310706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:25.310710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:25.310715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:25.310719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:25.310723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.310728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.310732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.310735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:25.310739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:25.310748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:25.310756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:25.310762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:25.310768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:25.310773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:25.310778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:25.310783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:25.310788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:25.310793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:25.310799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:25.310808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:25.310814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:25.310824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:25.310829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:25.310833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:25.310838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:25.310848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:25.310853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:25.310858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:25.310864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:25.310869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.310875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.310885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.310892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.310902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.310907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.310916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:25.310922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:25.310931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:25.310937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:25.310989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:25.316890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:25.317844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:25.317868Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:25.317872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:25.317877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:25.317885Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 810 [2:7555895211388202722:5895]
2025-09-30T14:52:25.317905Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:25.317923Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:25.317927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:25.317931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:25.317933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:25.317949Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:25.317963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:25.317981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:25.318058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.318069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.318071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.318074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:25.318077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:25.318170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:25.318178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.318193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.318210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.318226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:25.318253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895211477932186:2454], now have 1 active actors on pipe
2025-09-30T14:52:25.318273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895211477932324:7204], now have 1 active actors on pipe
2025-09-30T14:52:25.318280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895211388202716:5895]
2025-09-30T14:52:25.318283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895211388202716:5895]
2025-09-30T14:52:25.318286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895211388202716:5895]
2025-09-30T14:52:25.318314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:25.318333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:25.318339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:25.318344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:25.318346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:25.318349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:25.318352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:25.318340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 810
2025-09-30T14:52:25.318389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895211388202716:5895]
2025-09-30T14:52:25.318344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 810
2025-09-30T14:52:25.318398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:25.318401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:25.318415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:25.318420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:25.318471Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3fcaf674-67b66cfd-ac380d6c-748e0eef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:25.318485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:25.318491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:25.318499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:25.318509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:25.318523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:25.318553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:25.318729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:25.318738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:25.318755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:25.318858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 811 partition: 0 MaxSeqNo: 42 sessionId: src_id|3fcaf674-67b66cfd-ac380d6c-748e0eef_0
2025-09-30T14:52:25.319237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d03d7e7-53e691e1-a84771b0-d73112d7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3fcaf674-67b66cfd-ac380d6c-748e0eef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:25.321984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fcaf674-67b66cfd-ac380d6c-748e0eef_0] Write session: try to update token
2025-09-30T14:52:25.322007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fcaf674-67b66cfd-ac380d6c-748e0eef_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:25.331025Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:25.331054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:25.331057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:25.331059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:25.331072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895211388202716:5895]
2025-09-30T14:52:25.331080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895211388202716:5895]
2025-09-30T14:52:25.331086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895211388202716:5895]
2025-09-30T14:52:25.331141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:25.331143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:25.331151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.331155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:25.331167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:25.331171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:25.331372Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:25.337120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 811 sessionId: src_id|3fcaf674-67b66cfd-ac380d6c-748e0eef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:25.340002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:25.391499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895211477932335:7153]
2025-09-30T14:52:25.391805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 810, pipe: [1:7555895211477932335:7153]
2025-09-30T14:52:25.444644Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:25.444972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:25.444987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:25.445006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895211477932335:7153], now have 1 active actors on pipe
2025-09-30T14:52:25.445173Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:25.445224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895211477932335:7153]
2025-09-30T14:52:25.445236Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:25.445260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:25.445336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 811 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3fcaf674-67b66cfd-ac380d6c-748e0eef_0
2025-09-30T14:52:25.445522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 811 sessionId: src_id|3fcaf674-67b66cfd-ac380d6c-748e0eef_0 is DEAD
2025-09-30T14:52:25.445636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fcaf674-67b66cfd-ac380d6c-748e0eef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:25.445647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fcaf674-67b66cfd-ac380d6c-748e0eef_0] Write session will restart in 0.009000s
2025-09-30T14:52:25.445671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fcaf674-67b66cfd-ac380d6c-748e0eef_0] Write session: Do CDS request
2025-09-30T14:52:25.445677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fcaf674-67b66cfd-ac380d6c-748e0eef_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:25.455860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fcaf674-67b66cfd-ac380d6c-748e0eef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:25.456020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:25.456037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 812
2025-09-30T14:52:25.456184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 812 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:25.456219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 812 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:25.456230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=812 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:25.456234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:25.456721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 812 sessionId:  describe result for acl check
2025-09-30T14:52:25.456773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:25.456782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:25.456784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:25.456790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895211477932436:7208] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:25.457341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895211477932436:7208] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:25.458757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:25.459188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895211477932436:7208] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:25.462830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:25.463026Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:25.463038Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:25.463050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:25.463066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895211477932436:7208] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:25.463079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895211477932436:7208] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:25.463082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895211477932436:7208] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:25.463110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:25.463088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 812 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:25.463152Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895211388202863:5897]
2025-09-30T14:52:25.463795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:25.464125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:25.464184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:25.464524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:25.464580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:25.464586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:25.464587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:25.464588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:25.464588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:25.464589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:25.464590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:25.464590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:25.464591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:25.464592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:25.464592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.464593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.464594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.464594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:25.464595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:25.464599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:25.464606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:25.464608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:25.464611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:25.464613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:25.464615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:25.464618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:25.464621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:25.464623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:25.464626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:25.464628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.464631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.464633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.464635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:25.464638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:25.464645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:25.464650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:25.464654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:25.464658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:25.464660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:25.464664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:25.464666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:25.464669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:25.464672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:25.464675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:25.464678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:25.464683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:25.464686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:25.464689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:25.464691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:25.464694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:25.464697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:25.464700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:25.464703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:25.464705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:25.464708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.464712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.464714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.464718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.464721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.464724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.464726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:25.464729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:25.464733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:25.464736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:25.464762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:25.470087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:25.470941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:25.470958Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:25.470960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:25.470964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:25.470968Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 811 [2:7555895211388202863:5897]
2025-09-30T14:52:25.470980Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:25.470992Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:25.470994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:25.470996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:25.470997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:25.471010Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:25.471019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:25.471025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:25.471070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.471076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.471078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.471080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:25.471083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:25.471135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:25.471141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.471150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.471156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.471166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:25.471182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895211388202858:5897]
2025-09-30T14:52:25.471190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895211388202858:5897]
2025-09-30T14:52:25.471192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895211388202858:5897]
2025-09-30T14:52:25.471199Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:25.471209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:25.471215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:25.471219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:25.471222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:25.471225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:25.471229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:25.471275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895211477932336:2454], now have 1 active actors on pipe
2025-09-30T14:52:25.471284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895211477932474:7208], now have 1 active actors on pipe
2025-09-30T14:52:25.471287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895211388202858:5897]
2025-09-30T14:52:25.471297Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:25.471319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:25.471326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 811
2025-09-30T14:52:25.471348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 811
2025-09-30T14:52:25.471414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:25.471425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:25.471449Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38727346-39fe5de4-bff8b77a-ed4d0549_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:25.471463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:25.471471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:25.471473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:25.471483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:25.471498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:25.471517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:25.471729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:25.471741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:25.471759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:25.471900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 812 partition: 0 MaxSeqNo: 42 sessionId: src_id|38727346-39fe5de4-bff8b77a-ed4d0549_0
2025-09-30T14:52:25.472320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fcaf674-67b66cfd-ac380d6c-748e0eef_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|38727346-39fe5de4-bff8b77a-ed4d0549_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:25.475693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38727346-39fe5de4-bff8b77a-ed4d0549_0] Write session: try to update token
2025-09-30T14:52:25.475718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38727346-39fe5de4-bff8b77a-ed4d0549_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:25.483516Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:25.483538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:25.483541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:25.483543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:25.483552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895211388202858:5897]
2025-09-30T14:52:25.483557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895211388202858:5897]
2025-09-30T14:52:25.483562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895211388202858:5897]
2025-09-30T14:52:25.483603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:25.483609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.483612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:25.483613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:25.483620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:25.483624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:25.483753Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:25.492425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 812 sessionId: src_id|38727346-39fe5de4-bff8b77a-ed4d0549_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:25.495047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:25.545405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895211477932501:7153]
2025-09-30T14:52:25.545680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 811, pipe: [1:7555895211477932501:7153]
2025-09-30T14:52:25.588255Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:25.589047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:25.589061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:25.589078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895211477932501:7153], now have 1 active actors on pipe
2025-09-30T14:52:25.589278Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:25.589369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:25.589456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 812 reason: status is not ok: tablet will be restarted right now sessionId: src_id|38727346-39fe5de4-bff8b77a-ed4d0549_0
2025-09-30T14:52:25.589540Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:25.589584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895211477932501:7153]
2025-09-30T14:52:25.589636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 812 sessionId: src_id|38727346-39fe5de4-bff8b77a-ed4d0549_0 is DEAD
2025-09-30T14:52:25.589741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38727346-39fe5de4-bff8b77a-ed4d0549_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:25.589750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38727346-39fe5de4-bff8b77a-ed4d0549_0] Write session will restart in 0.007902s
2025-09-30T14:52:25.589776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38727346-39fe5de4-bff8b77a-ed4d0549_0] Write session: Do CDS request
2025-09-30T14:52:25.589781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38727346-39fe5de4-bff8b77a-ed4d0549_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:25.598715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38727346-39fe5de4-bff8b77a-ed4d0549_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:25.598827Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:25.598841Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 813
2025-09-30T14:52:25.598963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 813 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:25.599003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 813 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:25.599012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=813 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:25.599015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:25.599458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 813 sessionId:  describe result for acl check
2025-09-30T14:52:25.599497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:25.599503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:25.599505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:25.599511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895211477932567:7220] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:25.599964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895211477932567:7220] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:25.602193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895211477932567:7220] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:25.606142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:25.606508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895211477932567:7220] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:25.606523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895211477932567:7220] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:25.606529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895211477932567:7220] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:25.606537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 813 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:25.606573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:25.606748Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:25.606759Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:25.606770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:25.606821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:25.606860Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895211388203044:5912]
2025-09-30T14:52:25.607489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:25.607830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:25.607882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:25.608206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:25.608273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:25.608281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:25.608282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:25.608283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:25.608284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:25.608286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:25.608287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:25.608288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:25.608290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:25.608291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:25.608292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.608293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.608294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.608295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:25.608296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:25.608301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:25.608311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:25.608314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:25.608318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:25.608322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:25.608326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:25.608329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:25.608333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:25.608338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:25.608342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:25.608346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.608350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.608353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.608357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:25.608361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:25.608368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:25.608375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:25.608382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:25.608387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:25.608391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:25.608395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:25.608404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:25.608409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:25.608417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:25.608422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:25.608431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:25.608440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:25.608449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:25.608458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:25.608466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:25.608472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:25.608481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:25.608492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:25.608501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:25.608506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:25.608514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.608518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.608526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.608535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.608543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.608549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.608553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:25.608557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:25.608561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:25.608569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:25.608609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:25.613848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:25.614883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:25.614904Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:25.614906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:25.614911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:25.614917Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 812 [2:7555895211388203044:5912]
2025-09-30T14:52:25.614935Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:25.614956Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:25.614965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:25.614968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:25.614975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:25.614991Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:25.615007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:25.615015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:25.615074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.615083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.615086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.615090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:25.615093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:25.615160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:25.615168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.615182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.615200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.615224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:25.615266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895211477932650:7220], now have 1 active actors on pipe
2025-09-30T14:52:25.615275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895211477932511:2454], now have 1 active actors on pipe
2025-09-30T14:52:25.615282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895211388203038:5912]
2025-09-30T14:52:25.615289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895211388203038:5912]
2025-09-30T14:52:25.615291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895211388203038:5912]
2025-09-30T14:52:25.615303Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:25.615323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:25.615325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:25.615329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:25.615331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:25.615344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:25.615348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:25.615350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 812
2025-09-30T14:52:25.615384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895211388203038:5912]
2025-09-30T14:52:25.615391Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 812
2025-09-30T14:52:25.615391Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:25.615394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:25.615405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:25.615410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:25.615458Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35892be4-d0c8a580-103f29a-6e313887_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:25.615470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:25.615477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:25.615479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:25.615488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:25.615502Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:25.615522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:25.615693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:25.615703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:25.615719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:25.615798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 813 partition: 0 MaxSeqNo: 42 sessionId: src_id|35892be4-d0c8a580-103f29a-6e313887_0
2025-09-30T14:52:25.616116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38727346-39fe5de4-bff8b77a-ed4d0549_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|35892be4-d0c8a580-103f29a-6e313887_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:25.619033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35892be4-d0c8a580-103f29a-6e313887_0] Write session: try to update token
2025-09-30T14:52:25.619054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35892be4-d0c8a580-103f29a-6e313887_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:25.627762Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:25.627782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:25.627784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:25.627785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:25.627792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895211388203038:5912]
2025-09-30T14:52:25.627796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895211388203038:5912]
2025-09-30T14:52:25.627800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895211388203038:5912]
2025-09-30T14:52:25.627842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:25.627853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.627855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:25.627877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:25.627894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:25.627902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:25.627999Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:25.632723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 813 sessionId: src_id|35892be4-d0c8a580-103f29a-6e313887_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:25.635182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:25.689784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895211477932662:7153]
2025-09-30T14:52:25.690052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 812, pipe: [1:7555895211477932662:7153]
2025-09-30T14:52:25.731636Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:25.731898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:25.731910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:25.731943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895211477932662:7153], now have 1 active actors on pipe
2025-09-30T14:52:25.732124Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:25.732219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895211477932662:7153]
2025-09-30T14:52:25.732241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:25.732248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:25.732311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 813 reason: status is not ok: tablet will be restarted right now sessionId: src_id|35892be4-d0c8a580-103f29a-6e313887_0
2025-09-30T14:52:25.732483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 813 sessionId: src_id|35892be4-d0c8a580-103f29a-6e313887_0 is DEAD
2025-09-30T14:52:25.732603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35892be4-d0c8a580-103f29a-6e313887_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:25.732608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35892be4-d0c8a580-103f29a-6e313887_0] Write session will restart in 0.007220s
2025-09-30T14:52:25.732626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35892be4-d0c8a580-103f29a-6e313887_0] Write session: Do CDS request
2025-09-30T14:52:25.732630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35892be4-d0c8a580-103f29a-6e313887_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:25.740741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35892be4-d0c8a580-103f29a-6e313887_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:25.740815Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:25.740831Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 814
2025-09-30T14:52:25.740982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 814 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:25.741011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 814 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:25.741016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=814 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:25.741024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:25.741364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 814 sessionId:  describe result for acl check
2025-09-30T14:52:25.741389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:25.741390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:25.741391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:25.741395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895211477932714:7224] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:25.741834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895211477932714:7224] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:25.743806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895211477932714:7224] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:25.744690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:25.748124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:25.748308Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:25.748314Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:25.748322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:25.748361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:25.748393Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895211388203187:5914]
2025-09-30T14:52:25.748518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895211477932714:7224] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:25.748536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895211477932714:7224] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:25.748540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895211477932714:7224] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:25.748548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 814 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:25.748860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:25.749128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:25.749174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:25.749426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:25.749472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:25.749477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:25.749478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:25.749479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:25.749479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:25.749480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:25.749481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:25.749482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:25.749483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:25.749483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:25.749484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.749485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.749486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.749487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:25.749487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:25.749491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:25.749498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:25.749500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:25.749503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:25.749505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:25.749508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:25.749510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:25.749512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:25.749514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:25.749517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:25.749519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.749521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.749523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.749526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:25.749528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:25.749533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:25.749538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:25.749542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:25.749545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:25.749548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:25.749551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:25.749553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:25.749557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:25.749559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:25.749562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:25.749565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:25.749568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:25.749572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:25.749575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:25.749577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:25.749580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:25.749583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:25.749586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:25.749589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:25.749592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:25.749595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.749598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.749600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.749603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.749606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.749610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.749612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:25.749615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:25.749618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:25.749621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:25.749644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:25.755174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:25.755954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:25.755968Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:25.755970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:25.755974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:25.755978Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 813 [2:7555895211388203187:5914]
2025-09-30T14:52:25.755990Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:25.756001Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:25.756003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:25.756005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:25.756007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:25.756018Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:25.756023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:25.756028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:25.756076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.756083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.756084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.756087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:25.756089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:25.756136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:25.756141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.756149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.756156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.756169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:25.756185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895211477932663:2454], now have 1 active actors on pipe
2025-09-30T14:52:25.756194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895211388203182:5914]
2025-09-30T14:52:25.756195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895211388203182:5914]
2025-09-30T14:52:25.756197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895211388203182:5914]
2025-09-30T14:52:25.756205Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:25.756216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:25.756218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:25.756227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:25.756227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:25.756229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:25.756229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:25.756233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895211477932803:7224], now have 1 active actors on pipe
2025-09-30T14:52:25.756258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895211388203182:5914]
2025-09-30T14:52:25.756266Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:25.756276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:25.756280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 813
2025-09-30T14:52:25.756319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:25.756325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:25.756343Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e55b0f73-b39d9697-a8723d0d-64bd4240_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:25.756307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 813
2025-09-30T14:52:25.756348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:25.756354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:25.756356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:25.756362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:25.756370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:25.756383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:25.756582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:25.756594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:25.756613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:25.756691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 814 partition: 0 MaxSeqNo: 42 sessionId: src_id|e55b0f73-b39d9697-a8723d0d-64bd4240_0
2025-09-30T14:52:25.757006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35892be4-d0c8a580-103f29a-6e313887_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e55b0f73-b39d9697-a8723d0d-64bd4240_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:25.759497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e55b0f73-b39d9697-a8723d0d-64bd4240_0] Write session: try to update token
2025-09-30T14:52:25.759514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e55b0f73-b39d9697-a8723d0d-64bd4240_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:25.773468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 814 sessionId: src_id|e55b0f73-b39d9697-a8723d0d-64bd4240_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:25.774336Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:25.774356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:25.774365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895211388203182:5914]
2025-09-30T14:52:25.774407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:25.774426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:25.774603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:25.774757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:25.774910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:25.775065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:25.775292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:25.775346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:25.776281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:25.776459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:25.776474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:25.776505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:25.776575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:25.779138Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:25.779151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:25.779153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:25.779154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:25.779162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895211388203182:5914]
2025-09-30T14:52:25.779165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895211388203182:5914]
2025-09-30T14:52:25.779169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895211388203182:5914]
2025-09-30T14:52:25.779204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:25.779210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.779212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:25.779279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:25.779293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:25.779299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:25.779370Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:25.832644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895211477932815:7153]
2025-09-30T14:52:25.832945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 813, pipe: [1:7555895211477932815:7153]
2025-09-30T14:52:25.884519Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:25.891518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:25.891548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:25.891716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:25.891774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:25.891836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:25.891893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:25.891930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:25.891939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:25.892002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:25.892062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:25.892122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:25.892184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:25.892229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:25.892235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:25.892297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:25.892355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:25.892412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:25.892466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:25.892507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:25.892513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:25.892573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:25.892632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:25.892691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:25.892753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:25.892791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:25.892799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:25.892945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:25.893004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:25.893118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:25.893176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:25.893219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:25.893225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:25.893283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:25.893345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:25.893405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:25.893463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:25.893503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:25.893510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:25.893573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:25.893634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:25.893692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:25.893753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:25.893805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:25.893813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:25.893883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:25.893945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:25.894001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:25.894057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:25.894120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:25.894126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:25.894187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:25.894244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:25.894332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:25.894394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:25.894431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:25.894437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:25.894497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:25.894551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:25.894617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:25.894677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:25.894716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:25.894722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:25.894767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895211477932815:7153], now have 1 active actors on pipe
2025-09-30T14:52:25.895030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:25.895076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:25.895078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:25.895087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895211477932815:7153]
2025-09-30T14:52:25.895113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 814 reason: error at write: Disconnected sessionId: src_id|e55b0f73-b39d9697-a8723d0d-64bd4240_0
2025-09-30T14:52:25.895398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e55b0f73-b39d9697-a8723d0d-64bd4240_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:25.895415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e55b0f73-b39d9697-a8723d0d-64bd4240_0] Write session will restart in 0.007945s
2025-09-30T14:52:25.895363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 814 sessionId: src_id|e55b0f73-b39d9697-a8723d0d-64bd4240_0 is DEAD
2025-09-30T14:52:25.895432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e55b0f73-b39d9697-a8723d0d-64bd4240_0] Write session: Do CDS request
2025-09-30T14:52:25.895436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e55b0f73-b39d9697-a8723d0d-64bd4240_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:25.895836Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:25.904713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e55b0f73-b39d9697-a8723d0d-64bd4240_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:25.904838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:25.904854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 815
2025-09-30T14:52:25.904967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 815 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:25.905000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 815 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:25.905010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=815 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:25.905013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:25.905423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 815 sessionId:  describe result for acl check
2025-09-30T14:52:25.905457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:25.905462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:25.905464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:25.905468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895211477932881:7228] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:25.905906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895211477932881:7228] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:25.907752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895211477932881:7228] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:25.911797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:25.912125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895211477932881:7228] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:25.912141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895211477932881:7228] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:25.912144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895211477932881:7228] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:25.912152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 815 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:25.912275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:25.912444Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:25.912453Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:25.912464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:25.912523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:25.912565Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895211388203333:5916]
2025-09-30T14:52:25.913031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:25.913280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:25.913309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:25.913542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:25.913586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:25.913591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:25.913591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:25.913592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:25.913593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:25.913593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:25.913594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:25.913595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:25.913595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:25.913596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:25.913597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.913597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.913598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.913599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:25.913599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:25.913603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:25.913610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:25.913612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:25.913615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:25.913617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:25.913619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:25.913622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:25.913624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:25.913626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:25.913629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:25.913631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.913633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.913635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.913638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:25.913640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:25.913645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:25.913650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:25.913654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:25.913657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:25.913660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:25.913663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:25.913665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:25.913668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:25.913671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:25.913674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:25.913676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:25.913680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:25.913682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:25.913685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:25.913688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:25.913691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:25.913693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:25.913696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:25.913699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:25.913703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:25.913706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.913709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.913711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.913714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.913717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.913720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.913722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:25.913725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:25.913727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:25.913731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:25.913753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:25.918805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:25.919924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:25.919938Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:25.919940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:25.919943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:25.919948Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 814 [2:7555895211388203333:5916]
2025-09-30T14:52:25.919960Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:25.919971Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:25.919972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:25.919974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:25.919976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:25.919987Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:25.919992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:25.919996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:25.920037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.920043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.920044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.920046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:25.920048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:25.920094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:25.920100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.920107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:25.920115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:25.920135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:25.920152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895211388203327:5916]
2025-09-30T14:52:25.920157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895211388203327:5916]
2025-09-30T14:52:25.920159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895211388203327:5916]
2025-09-30T14:52:25.920165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:25.920175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:25.920177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:25.920181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:25.920183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:25.920187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:25.920188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:25.920196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895211477932816:2454], now have 1 active actors on pipe
2025-09-30T14:52:25.920198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895211477932957:7228], now have 1 active actors on pipe
2025-09-30T14:52:25.920221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895211388203327:5916]
2025-09-30T14:52:25.920229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:25.920246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:25.920288Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 814
2025-09-30T14:52:25.920324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 814
2025-09-30T14:52:25.920380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:25.920387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:25.920412Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4774c4-b1d082c7-e07bfd55-d31a5c71_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:25.920420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:25.920423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:25.920424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:25.920431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:25.920437Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:25.920451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:25.920624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:25.920637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:25.920659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:25.920763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 815 partition: 0 MaxSeqNo: 42 sessionId: src_id|d4774c4-b1d082c7-e07bfd55-d31a5c71_0
2025-09-30T14:52:25.921132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e55b0f73-b39d9697-a8723d0d-64bd4240_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d4774c4-b1d082c7-e07bfd55-d31a5c71_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:25.923907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4774c4-b1d082c7-e07bfd55-d31a5c71_0] Write session: try to update token
2025-09-30T14:52:25.923923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4774c4-b1d082c7-e07bfd55-d31a5c71_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:25.932818Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:25.932836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:25.932839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:25.932841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:25.932849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895211388203327:5916]
2025-09-30T14:52:25.932854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895211388203327:5916]
2025-09-30T14:52:25.932857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895211388203327:5916]
2025-09-30T14:52:25.932895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:25.932900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:25.932902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:25.932904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:25.932906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:25.932909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:25.933047Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:25.938334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 815 sessionId: src_id|d4774c4-b1d082c7-e07bfd55-d31a5c71_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:25.940952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:25.995461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895211477932972:7153]
2025-09-30T14:52:25.995799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 814, pipe: [1:7555895211477932972:7153]
2025-09-30T14:52:26.038871Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:26.039365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:26.039381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:26.039417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895211477932972:7153], now have 1 active actors on pipe
2025-09-30T14:52:26.039650Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:26.039690Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:26.039709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:26.039748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895211477932972:7153]
2025-09-30T14:52:26.039772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 815 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d4774c4-b1d082c7-e07bfd55-d31a5c71_0
2025-09-30T14:52:26.039909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 815 sessionId: src_id|d4774c4-b1d082c7-e07bfd55-d31a5c71_0 is DEAD
2025-09-30T14:52:26.040038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4774c4-b1d082c7-e07bfd55-d31a5c71_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:26.040047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4774c4-b1d082c7-e07bfd55-d31a5c71_0] Write session will restart in 0.009165s
2025-09-30T14:52:26.040073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4774c4-b1d082c7-e07bfd55-d31a5c71_0] Write session: Do CDS request
2025-09-30T14:52:26.040080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4774c4-b1d082c7-e07bfd55-d31a5c71_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:26.050740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4774c4-b1d082c7-e07bfd55-d31a5c71_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:26.050806Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:26.050821Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 816
2025-09-30T14:52:26.050924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 816 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:26.050948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 816 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:26.050955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=816 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:26.050957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:26.051344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 816 sessionId:  describe result for acl check
2025-09-30T14:52:26.051380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:26.051387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:26.051389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:26.051396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895215772900386:7235] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:26.051958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895215772900386:7235] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:26.053390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:26.054069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895215772900386:7235] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:26.057109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:26.057294Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:26.057301Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:26.057308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:26.057354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:26.057380Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895215683170786:5919]
2025-09-30T14:52:26.057515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895215772900386:7235] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:26.057529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895215772900386:7235] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:26.057531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895215772900386:7235] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:26.057537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 816 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:26.057850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:26.058130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:26.058164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:26.058401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:26.058439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:26.058444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:26.058444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:26.058445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:26.058446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:26.058446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:26.058447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:26.058448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:26.058449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:26.058450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:26.058450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.058451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.058452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.058452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:26.058453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:26.058457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:26.058463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:26.058466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:26.058468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:26.058470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:26.058473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:26.058475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:26.058477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:26.058480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:26.058483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:26.058485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.058487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.058489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.058492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:26.058494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:26.058500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:26.058504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:26.058508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:26.058511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:26.058514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:26.058517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:26.058520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:26.058523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:26.058526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:26.058529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:26.058532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:26.058536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:26.058539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:26.058542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:26.058544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:26.058547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:26.058551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:26.058554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:26.058556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:26.058559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:26.058562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.058566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.058568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.058571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.058574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.058577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.058580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:26.058583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:26.058586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:26.058589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:26.058614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:26.063759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:26.064662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:26.064675Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:26.064677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:26.064680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:26.064685Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 815 [2:7555895215683170786:5919]
2025-09-30T14:52:26.064697Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:26.064709Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:26.064711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:26.064713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:26.064715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:26.064725Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:26.064734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:26.064739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:26.064783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.064788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.064790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.064793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:26.064794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:26.064842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:26.064847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.064854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.064861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.064874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:26.064890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895215683170781:5919]
2025-09-30T14:52:26.064895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895215683170781:5919]
2025-09-30T14:52:26.064897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895215683170781:5919]
2025-09-30T14:52:26.064907Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:26.064917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:26.064920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:26.064926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:26.064928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:26.064934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:26.064936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895215772900287:2454], now have 1 active actors on pipe
2025-09-30T14:52:26.064937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:26.064938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895215772900429:7235], now have 1 active actors on pipe
2025-09-30T14:52:26.064960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895215683170781:5919]
2025-09-30T14:52:26.064969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:26.064994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:26.065026Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 815
2025-09-30T14:52:26.065031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 815
2025-09-30T14:52:26.065118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:26.065131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:26.065158Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f80b5295-872e32c4-4ea8a20a-dc0105b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:26.065170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:26.065177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:26.065180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:26.065191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:26.065206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:26.065224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:26.065376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:26.065383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:26.065409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:26.065497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 816 partition: 0 MaxSeqNo: 42 sessionId: src_id|f80b5295-872e32c4-4ea8a20a-dc0105b7_0
2025-09-30T14:52:26.065871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4774c4-b1d082c7-e07bfd55-d31a5c71_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f80b5295-872e32c4-4ea8a20a-dc0105b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:26.068584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f80b5295-872e32c4-4ea8a20a-dc0105b7_0] Write session: try to update token
2025-09-30T14:52:26.068600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f80b5295-872e32c4-4ea8a20a-dc0105b7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:26.076504Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:26.076537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:26.076547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895215683170781:5919]
2025-09-30T14:52:26.076583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:26.076606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:26.076746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:26.076887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:26.077032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:26.077178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:26.077453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:26.077497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:26.082594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 816 sessionId: src_id|f80b5295-872e32c4-4ea8a20a-dc0105b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:26.085330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:26.085542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:26.085564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:26.085597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:26.085663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:26.087041Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:26.087058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:26.087060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:26.087062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:26.087071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895215683170781:5919]
2025-09-30T14:52:26.087075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895215683170781:5919]
2025-09-30T14:52:26.087080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895215683170781:5919]
2025-09-30T14:52:26.087116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:26.087126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.087130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:26.087130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:26.087137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:26.087141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:26.087281Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:26.139827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895215772900443:7153]
2025-09-30T14:52:26.140076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 815, pipe: [1:7555895215772900443:7153]
2025-09-30T14:52:26.190935Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:26.198866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:26.198893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:26.199051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:26.199117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:26.199179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:26.199270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:26.199607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:26.199620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:26.199687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:26.199745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:26.199807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:26.199870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:26.199921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:26.199928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:26.199989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:26.200048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:26.200109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:26.200180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:26.200226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:26.200231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:26.200292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:26.200352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:26.200413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:26.200474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:26.200516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:26.200521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:26.200584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:26.200651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:26.200713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:26.200772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:26.200819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:26.200825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:26.200890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:26.200948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:26.201182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:26.201255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:26.201297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:26.201303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:26.201368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:26.201429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:26.201493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:26.201551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:26.201591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:26.201598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:26.201657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:26.201714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:26.201771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:26.201830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:26.201872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:26.201878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:26.201939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:26.201996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:26.202055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:26.202119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:26.202160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:26.202165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:26.202225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:26.202277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:26.202356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:26.202424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:26.202470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:26.202476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:26.202530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895215772900443:7153], now have 1 active actors on pipe
2025-09-30T14:52:26.202826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895215772900443:7153]
2025-09-30T14:52:26.202860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:26.202863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:26.202863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:26.202896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 816 reason: error at write: Disconnected sessionId: src_id|f80b5295-872e32c4-4ea8a20a-dc0105b7_0
2025-09-30T14:52:26.202916Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:26.203039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 816 sessionId: src_id|f80b5295-872e32c4-4ea8a20a-dc0105b7_0 is DEAD
2025-09-30T14:52:26.203186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f80b5295-872e32c4-4ea8a20a-dc0105b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:26.203210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f80b5295-872e32c4-4ea8a20a-dc0105b7_0] Write session will restart in 0.005387s
2025-09-30T14:52:26.203234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f80b5295-872e32c4-4ea8a20a-dc0105b7_0] Write session: Do CDS request
2025-09-30T14:52:26.203238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f80b5295-872e32c4-4ea8a20a-dc0105b7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:26.209669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f80b5295-872e32c4-4ea8a20a-dc0105b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:26.209822Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:26.209839Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 817
2025-09-30T14:52:26.209949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 817 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:26.209981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 817 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:26.209991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=817 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:26.209995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:26.210409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 817 sessionId:  describe result for acl check
2025-09-30T14:52:26.210447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:26.210453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:26.210455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:26.210461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895215772900458:7239] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:26.210979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895215772900458:7239] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:26.213665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895215772900458:7239] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:26.216300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895215772900458:7239] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:26.216317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895215772900458:7239] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:26.216320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895215772900458:7239] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:26.216327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 817 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:26.217017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:26.220628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:26.220843Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:26.220856Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:26.220868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:26.220927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:26.220966Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895215683170936:5922]
2025-09-30T14:52:26.221622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:26.221920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:26.221966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:26.222306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:26.222364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:26.222370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:26.222371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:26.222373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:26.222374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:26.222375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:26.222376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:26.222377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:26.222378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:26.222379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:26.222381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.222382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.222384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.222384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:26.222386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:26.222391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:26.222402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:26.222407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:26.222411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:26.222415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:26.222420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:26.222424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:26.222429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:26.222433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:26.222437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:26.222441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.222446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.222450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.222454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:26.222458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:26.222467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:26.222480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:26.222490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:26.222500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:26.222509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:26.222514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:26.222523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:26.222529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:26.222538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:26.222547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:26.222552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:26.222557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:26.222562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:26.222568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:26.222577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:26.222582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:26.222592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:26.222597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:26.222606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:26.222611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:26.222620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.222630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.222641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.222650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.222659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.222669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.222677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:26.222681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:26.222692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:26.222701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:26.222741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:26.228285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:26.229112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:26.229129Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:26.229131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:26.229134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:26.229139Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 816 [2:7555895215683170936:5922]
2025-09-30T14:52:26.229152Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:26.229163Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:26.229165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:26.229167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:26.229169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:26.229181Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:26.229186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:26.229191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:26.229235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.229241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.229243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.229246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:26.229248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:26.229297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:26.229303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.229311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.229317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.229326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:26.229338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895215683170931:5922]
2025-09-30T14:52:26.229346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895215683170931:5922]
2025-09-30T14:52:26.229348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895215683170931:5922]
2025-09-30T14:52:26.229357Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:26.229371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:26.229380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:26.229384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:26.229387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:26.229386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:26.229390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:26.229397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895215772900586:7239], now have 1 active actors on pipe
2025-09-30T14:52:26.229400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895215772900445:2454], now have 1 active actors on pipe
2025-09-30T14:52:26.229424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895215683170931:5922]
2025-09-30T14:52:26.229435Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:26.229442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:26.229478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 816
2025-09-30T14:52:26.229543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 816
2025-09-30T14:52:26.229839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:26.229847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:26.229869Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28d61bb-3b06050e-b2fd2868-48dcd4b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:26.229882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:26.229889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:26.229891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:26.229901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:26.229917Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:26.229933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:26.230087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:26.230095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:26.230107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:26.230197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 817 partition: 0 MaxSeqNo: 42 sessionId: src_id|28d61bb-3b06050e-b2fd2868-48dcd4b_0
2025-09-30T14:52:26.230559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f80b5295-872e32c4-4ea8a20a-dc0105b7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|28d61bb-3b06050e-b2fd2868-48dcd4b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:26.233117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28d61bb-3b06050e-b2fd2868-48dcd4b_0] Write session: try to update token
2025-09-30T14:52:26.233134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28d61bb-3b06050e-b2fd2868-48dcd4b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:26.241299Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:26.241321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:26.241323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:26.241325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:26.241334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895215683170931:5922]
2025-09-30T14:52:26.241337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895215683170931:5922]
2025-09-30T14:52:26.241340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895215683170931:5922]
2025-09-30T14:52:26.241373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:26.241378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.241380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:26.241387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:26.241397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:26.241402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:26.241509Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:26.246951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 817 sessionId: src_id|28d61bb-3b06050e-b2fd2868-48dcd4b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:26.249730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:26.303181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895215772900600:7153]
2025-09-30T14:52:26.303468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 816, pipe: [1:7555895215772900600:7153]
2025-09-30T14:52:26.349599Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:26.349891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:26.349907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:26.349946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895215772900600:7153], now have 1 active actors on pipe
2025-09-30T14:52:26.350153Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:26.350227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:26.350230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895215772900600:7153]
2025-09-30T14:52:26.350250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:26.350253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:26.350346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 817 reason: error at write: Disconnected sessionId: src_id|28d61bb-3b06050e-b2fd2868-48dcd4b_0
2025-09-30T14:52:26.350532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 817 sessionId: src_id|28d61bb-3b06050e-b2fd2868-48dcd4b_0 is DEAD
2025-09-30T14:52:26.350684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28d61bb-3b06050e-b2fd2868-48dcd4b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:26.350696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28d61bb-3b06050e-b2fd2868-48dcd4b_0] Write session will restart in 0.007135s
2025-09-30T14:52:26.350720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28d61bb-3b06050e-b2fd2868-48dcd4b_0] Write session: Do CDS request
2025-09-30T14:52:26.350725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28d61bb-3b06050e-b2fd2868-48dcd4b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:26.358738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28d61bb-3b06050e-b2fd2868-48dcd4b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:26.358844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:26.358859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 818
2025-09-30T14:52:26.358985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 818 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:26.359030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 818 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:26.359039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=818 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:26.359043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:26.359474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 818 sessionId:  describe result for acl check
2025-09-30T14:52:26.359511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:26.359521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:26.359523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:26.359529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895215772900616:7243] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:26.360043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895215772900616:7243] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:26.362767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895215772900616:7243] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:26.365314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895215772900616:7243] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:26.365328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895215772900616:7243] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:26.365331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895215772900616:7243] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:26.365340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 818 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:26.365339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:26.369039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:26.369283Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:26.369298Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:26.369309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:26.369368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:26.369409Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895215683171085:5924]
2025-09-30T14:52:26.370054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:26.370400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:26.370445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:26.370778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:26.370840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:26.370845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:26.370847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:26.370848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:26.370849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:26.370850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:26.370851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:26.370853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:26.370854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:26.370855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:26.370857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.370858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.370859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.370861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:26.370862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:26.370867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:26.370877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:26.370882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:26.370886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:26.370890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:26.370895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:26.370899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:26.370903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:26.370907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:26.370912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:26.370916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.370920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.370924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.370928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:26.370932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:26.370940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:26.370947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:26.370955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:26.370965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:26.370970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:26.370980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:26.370985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:26.370990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:26.370999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:26.371005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:26.371014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:26.371019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:26.371024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:26.371034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:26.371039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:26.371044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:26.371053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:26.371059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:26.371063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:26.371073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:26.371078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.371087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.371092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.371097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.371106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.371112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.371122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:26.371127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:26.371136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:26.371141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:26.371188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:26.376717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:26.377915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:26.377930Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:26.377933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:26.377935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:26.377940Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 817 [2:7555895215683171085:5924]
2025-09-30T14:52:26.377952Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:26.377965Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:26.377967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:26.377969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:26.377971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:26.377983Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:26.377988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:26.377995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:26.378050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.378056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.378057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.378060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:26.378061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:26.378120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:26.378128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.378139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.378155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.378176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:26.378198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895215772900602:2454], now have 1 active actors on pipe
2025-09-30T14:52:26.378204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895215772900745:7243], now have 1 active actors on pipe
2025-09-30T14:52:26.378209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895215683171078:5924]
2025-09-30T14:52:26.378210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895215683171078:5924]
2025-09-30T14:52:26.378212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895215683171078:5924]
2025-09-30T14:52:26.378224Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:26.378237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:26.378239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:26.378242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:26.378244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:26.378255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:26.378258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:26.378312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895215683171078:5924]
2025-09-30T14:52:26.378320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:26.378279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 817
2025-09-30T14:52:26.378322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:26.378344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:26.378349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:26.378380Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6aa31da9-ea12d56-541924f1-89cbdb35_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:26.378370Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 817
2025-09-30T14:52:26.378391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:26.378394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:26.378396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:26.378406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:26.378420Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:26.378444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:26.378585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:26.378593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:26.378606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:26.378694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 818 partition: 0 MaxSeqNo: 42 sessionId: src_id|6aa31da9-ea12d56-541924f1-89cbdb35_0
2025-09-30T14:52:26.379051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28d61bb-3b06050e-b2fd2868-48dcd4b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6aa31da9-ea12d56-541924f1-89cbdb35_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:26.381838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aa31da9-ea12d56-541924f1-89cbdb35_0] Write session: try to update token
2025-09-30T14:52:26.381858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aa31da9-ea12d56-541924f1-89cbdb35_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:26.390313Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:26.390334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:26.390340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:26.390342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:26.390350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895215683171078:5924]
2025-09-30T14:52:26.390355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895215683171078:5924]
2025-09-30T14:52:26.390360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895215683171078:5924]
2025-09-30T14:52:26.390401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:26.390409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.390411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:26.390420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:26.390435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:26.390442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:26.390590Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:26.396503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 818 sessionId: src_id|6aa31da9-ea12d56-541924f1-89cbdb35_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:26.399391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:26.450605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895215772900756:7153]
2025-09-30T14:52:26.450857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 817, pipe: [1:7555895215772900756:7153]
2025-09-30T14:52:26.499903Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:26.500215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:26.500231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:26.500248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895215772900756:7153], now have 1 active actors on pipe
2025-09-30T14:52:26.500514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:26.500546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:26.500550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:26.500572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895215772900756:7153]
2025-09-30T14:52:26.500579Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:26.500623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 818 reason: error at write: Disconnected sessionId: src_id|6aa31da9-ea12d56-541924f1-89cbdb35_0
2025-09-30T14:52:26.500809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 818 sessionId: src_id|6aa31da9-ea12d56-541924f1-89cbdb35_0 is DEAD
2025-09-30T14:52:26.500946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aa31da9-ea12d56-541924f1-89cbdb35_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:26.500957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aa31da9-ea12d56-541924f1-89cbdb35_0] Write session will restart in 0.006110s
2025-09-30T14:52:26.500980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aa31da9-ea12d56-541924f1-89cbdb35_0] Write session: Do CDS request
2025-09-30T14:52:26.501000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aa31da9-ea12d56-541924f1-89cbdb35_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:26.507724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aa31da9-ea12d56-541924f1-89cbdb35_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:26.507790Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:26.507809Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 819
2025-09-30T14:52:26.507949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 819 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:26.507981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 819 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:26.507986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=819 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:26.507990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:26.508385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 819 sessionId:  describe result for acl check
2025-09-30T14:52:26.508420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:26.508425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:26.508426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:26.508430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895215772900775:7248] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:26.508886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895215772900775:7248] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:26.510918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895215772900775:7248] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:26.513317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895215772900775:7248] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:26.513332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895215772900775:7248] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:26.513338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895215772900775:7248] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:26.513346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 819 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:26.513587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:26.517304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:26.517499Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:26.517509Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:26.517519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:26.517580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:26.517618Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895215683171236:5926]
2025-09-30T14:52:26.518314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:26.518676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:26.518733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:26.519086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:26.519149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:26.519156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:26.519157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:26.519158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:26.519159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:26.519161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:26.519162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:26.519163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:26.519164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:26.519165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:26.519167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.519168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.519169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.519170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:26.519171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:26.519176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:26.519187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:26.519191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:26.519196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:26.519200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:26.519204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:26.519208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:26.519213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:26.519217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:26.519221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:26.519225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.519229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.519233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.519237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:26.519241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:26.519265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:26.519272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:26.519278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:26.519284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:26.519289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:26.519294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:26.519298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:26.519304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:26.519312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:26.519318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:26.519323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:26.519328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:26.519340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:26.519345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:26.519355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:26.519360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:26.519369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:26.519375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:26.519396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:26.519406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:26.519411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.519420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.519425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.519430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.519439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.519444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.519450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:26.519455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:26.519459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:26.519470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:26.519513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:26.524798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:26.525668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:26.525690Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:26.525693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:26.525697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:26.525704Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 818 [2:7555895215683171236:5926]
2025-09-30T14:52:26.525721Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:26.525737Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:26.525741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:26.525744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:26.525747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:26.525760Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:26.525766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:26.525771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:26.525823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.525833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.525835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.525839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:26.525842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:26.525904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:26.525913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.525924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.525940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.525954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:26.525972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895215772900905:7248], now have 1 active actors on pipe
2025-09-30T14:52:26.525978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895215772900761:2454], now have 1 active actors on pipe
2025-09-30T14:52:26.525982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895215683171231:5926]
2025-09-30T14:52:26.525984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895215683171231:5926]
2025-09-30T14:52:26.525985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895215683171231:5926]
2025-09-30T14:52:26.525994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:26.526005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:26.526008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:26.526011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:26.526016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:26.526018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:26.526021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:26.526051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895215683171231:5926]
2025-09-30T14:52:26.526063Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:26.526081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:26.526069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 818
2025-09-30T14:52:26.526097Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 818
2025-09-30T14:52:26.526520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:26.526531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:26.526566Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1a2d8a7-784183c0-f063b708-2702bfc8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:26.526575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:26.526579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:26.526581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:26.526591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:26.526601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:26.526620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:26.526814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:26.526829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:26.526869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:26.526991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 819 partition: 0 MaxSeqNo: 42 sessionId: src_id|c1a2d8a7-784183c0-f063b708-2702bfc8_0
2025-09-30T14:52:26.527358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aa31da9-ea12d56-541924f1-89cbdb35_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c1a2d8a7-784183c0-f063b708-2702bfc8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:26.530020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1a2d8a7-784183c0-f063b708-2702bfc8_0] Write session: try to update token
2025-09-30T14:52:26.530037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1a2d8a7-784183c0-f063b708-2702bfc8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:26.538222Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:26.538257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:26.538262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:26.538264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:26.538276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895215683171231:5926]
2025-09-30T14:52:26.538281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895215683171231:5926]
2025-09-30T14:52:26.538286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895215683171231:5926]
2025-09-30T14:52:26.538356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:26.538357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:26.538362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:26.538367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:26.538371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.538374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:26.538581Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:26.544018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 819 sessionId: src_id|c1a2d8a7-784183c0-f063b708-2702bfc8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:26.546765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:26.600626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895215772900938:7153]
2025-09-30T14:52:26.601156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 818, pipe: [1:7555895215772900938:7153]
2025-09-30T14:52:26.643184Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:26.643488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:26.643505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:26.643550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895215772900938:7153], now have 1 active actors on pipe
2025-09-30T14:52:26.643760Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:26.643763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895215772900938:7153]
2025-09-30T14:52:26.643786Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:26.643798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:26.643802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:26.643860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 819 reason: error at write: Disconnected sessionId: src_id|c1a2d8a7-784183c0-f063b708-2702bfc8_0
2025-09-30T14:52:26.644023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 819 sessionId: src_id|c1a2d8a7-784183c0-f063b708-2702bfc8_0 is DEAD
2025-09-30T14:52:26.644193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1a2d8a7-784183c0-f063b708-2702bfc8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:26.644205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1a2d8a7-784183c0-f063b708-2702bfc8_0] Write session will restart in 0.006349s
2025-09-30T14:52:26.644227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1a2d8a7-784183c0-f063b708-2702bfc8_0] Write session: Do CDS request
2025-09-30T14:52:26.644242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1a2d8a7-784183c0-f063b708-2702bfc8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:26.651700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1a2d8a7-784183c0-f063b708-2702bfc8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:26.651762Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:26.651778Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 820
2025-09-30T14:52:26.651952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 820 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:26.651988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 820 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:26.651997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=820 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:26.652002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:26.652417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 820 sessionId:  describe result for acl check
2025-09-30T14:52:26.652455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:26.652463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:26.652464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:26.652470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895215772900963:7259] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:26.653002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895215772900963:7259] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:26.655648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895215772900963:7259] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:26.657617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:26.661674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:26.661896Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:26.661907Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:26.661917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:26.661967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:26.661944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895215772900963:7259] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:26.661961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895215772900963:7259] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:26.661964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895215772900963:7259] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:26.661973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 820 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:26.662010Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895215683171424:5941]
2025-09-30T14:52:26.662693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:26.662978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:26.663038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:26.663339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:26.663395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:26.663401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:26.663403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:26.663404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:26.663405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:26.663406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:26.663407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:26.663408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:26.663410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:26.663411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:26.663412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.663413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.663415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.663416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:26.663417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:26.663422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:26.663433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:26.663438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:26.663441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:26.663444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:26.663446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:26.663448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:26.663450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:26.663453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:26.663455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:26.663458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.663460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.663462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.663464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:26.663466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:26.663473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:26.663478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:26.663482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:26.663486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:26.663489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:26.663492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:26.663495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:26.663498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:26.663501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:26.663504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:26.663507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:26.663510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:26.663513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:26.663516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:26.663519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:26.663522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:26.663525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:26.663528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:26.663532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:26.663535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:26.663538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.663541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.663544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.663547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.663549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.663552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.663554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:26.663557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:26.663560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:26.663563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:26.663587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:26.669032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:26.670130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:26.670145Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:26.670147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:26.670150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:26.670154Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 819 [2:7555895215683171424:5941]
2025-09-30T14:52:26.670166Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:26.670177Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:26.670179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:26.670181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:26.670183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:26.670196Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:26.670201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:26.670206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:26.670261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.670270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.670273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.670276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:26.670279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:26.670354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:26.670363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.670375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.670393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.670412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:26.670444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895215772900945:2454], now have 1 active actors on pipe
2025-09-30T14:52:26.670450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895215772901091:7259], now have 1 active actors on pipe
2025-09-30T14:52:26.670455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895215683171418:5941]
2025-09-30T14:52:26.670457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895215683171418:5941]
2025-09-30T14:52:26.670458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895215683171418:5941]
2025-09-30T14:52:26.670467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:26.670478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:26.670479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:26.670454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 819
2025-09-30T14:52:26.670482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:26.670484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:26.670490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:26.670492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:26.670463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 819
2025-09-30T14:52:26.670530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:26.670537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:26.670547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895215683171418:5941]
2025-09-30T14:52:26.670555Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:26.670569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:26.670580Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|863fbc4e-bb4bde9e-156fddd7-1d2af69e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:26.670586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:26.670588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:26.670589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:26.670596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:26.670603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:26.670618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:26.670753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:26.670764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:26.670792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:26.670877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 820 partition: 0 MaxSeqNo: 42 sessionId: src_id|863fbc4e-bb4bde9e-156fddd7-1d2af69e_0
2025-09-30T14:52:26.671209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1a2d8a7-784183c0-f063b708-2702bfc8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|863fbc4e-bb4bde9e-156fddd7-1d2af69e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:26.673818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|863fbc4e-bb4bde9e-156fddd7-1d2af69e_0] Write session: try to update token
2025-09-30T14:52:26.673831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|863fbc4e-bb4bde9e-156fddd7-1d2af69e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:26.682527Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:26.682544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:26.682546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:26.682547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:26.682554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895215683171418:5941]
2025-09-30T14:52:26.682558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895215683171418:5941]
2025-09-30T14:52:26.682561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895215683171418:5941]
2025-09-30T14:52:26.682597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:26.682603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.682605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:26.682609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:26.682612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:26.682616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:26.682731Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:26.687118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 820 sessionId: src_id|863fbc4e-bb4bde9e-156fddd7-1d2af69e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:26.689857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:26.743995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895215772901102:7153]
2025-09-30T14:52:26.744288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 819, pipe: [1:7555895215772901102:7153]
2025-09-30T14:52:26.793291Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:26.793826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:26.793840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:26.793875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895215772901102:7153], now have 1 active actors on pipe
2025-09-30T14:52:26.794092Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:26.794090Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:26.794139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:26.794142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:26.794161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895215772901102:7153]
2025-09-30T14:52:26.794201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 820 reason: error at write: Disconnected sessionId: src_id|863fbc4e-bb4bde9e-156fddd7-1d2af69e_0
2025-09-30T14:52:26.794355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 820 sessionId: src_id|863fbc4e-bb4bde9e-156fddd7-1d2af69e_0 is DEAD
2025-09-30T14:52:26.794516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|863fbc4e-bb4bde9e-156fddd7-1d2af69e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:26.794525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|863fbc4e-bb4bde9e-156fddd7-1d2af69e_0] Write session will restart in 0.005965s
2025-09-30T14:52:26.794541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|863fbc4e-bb4bde9e-156fddd7-1d2af69e_0] Write session: Do CDS request
2025-09-30T14:52:26.794547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|863fbc4e-bb4bde9e-156fddd7-1d2af69e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:26.801732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|863fbc4e-bb4bde9e-156fddd7-1d2af69e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:26.801853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:26.801871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 821
2025-09-30T14:52:26.801978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 821 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:26.802004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 821 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:26.802007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=821 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:26.802010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:26.802455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 821 sessionId:  describe result for acl check
2025-09-30T14:52:26.802493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:26.802495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:26.802497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:26.802503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895215772901117:7263] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:26.803021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895215772901117:7263] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:26.806025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895215772901117:7263] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:26.808149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895215772901117:7263] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:26.808164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895215772901117:7263] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:26.808167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895215772901117:7263] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:26.808176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 821 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:26.808906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:26.812673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:26.812875Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:26.812885Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:26.812895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:26.812944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:26.812982Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895215683171575:5943]
2025-09-30T14:52:26.813639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:26.813980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:26.814026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:26.814358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:26.814420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:26.814426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:26.814427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:26.814428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:26.814430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:26.814431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:26.814432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:26.814434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:26.814435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:26.814436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:26.814438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.814439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.814440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.814441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:26.814442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:26.814448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:26.814458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:26.814463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:26.814467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:26.814471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:26.814476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:26.814480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:26.814484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:26.814488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:26.814491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:26.814495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.814500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.814504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.814508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:26.814512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:26.814520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:26.814528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:26.814534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:26.814539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:26.814549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:26.814554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:26.814558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:26.814564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:26.814568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:26.814574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:26.814578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:26.814584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:26.814588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:26.814594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:26.814599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:26.814604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:26.814609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:26.814614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:26.814626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:26.814636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:26.814641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.814651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.814655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.814660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.814669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.814674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.814678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:26.814688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:26.814693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:26.814698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:26.814741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:26.820246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:26.821516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:26.821530Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:26.821531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:26.821534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:26.821539Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 820 [2:7555895215683171575:5943]
2025-09-30T14:52:26.821551Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:26.821565Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:26.821568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:26.821571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:26.821574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:26.821589Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:26.821601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:26.821607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:26.821666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.821671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.821673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.821676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:26.821678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:26.821728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:26.821735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.821748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.821759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.821777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:26.821800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895215772901103:2454], now have 1 active actors on pipe
2025-09-30T14:52:26.821811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895215683171570:5943]
2025-09-30T14:52:26.821818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895215683171570:5943]
2025-09-30T14:52:26.821820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895215683171570:5943]
2025-09-30T14:52:26.821833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:26.821846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895215772901248:7263], now have 1 active actors on pipe
2025-09-30T14:52:26.821851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:26.821854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:26.821855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:26.821857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:26.821869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:26.821876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:26.821904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895215683171570:5943]
2025-09-30T14:52:26.821916Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:26.821867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 820
2025-09-30T14:52:26.821947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 820
2025-09-30T14:52:26.821975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:26.822026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:26.822036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:26.822059Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b54efed9-b70c7a06-9edec4de-207044af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:26.822072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:26.822075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:26.822077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:26.822087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:26.822095Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:26.822111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:26.822248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:26.822255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:26.822266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:26.822351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 821 partition: 0 MaxSeqNo: 42 sessionId: src_id|b54efed9-b70c7a06-9edec4de-207044af_0
2025-09-30T14:52:26.822680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|863fbc4e-bb4bde9e-156fddd7-1d2af69e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b54efed9-b70c7a06-9edec4de-207044af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:26.825498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b54efed9-b70c7a06-9edec4de-207044af_0] Write session: try to update token
2025-09-30T14:52:26.825514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b54efed9-b70c7a06-9edec4de-207044af_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:26.834829Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:26.834855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:26.834865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895215683171570:5943]
2025-09-30T14:52:26.834906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:26.834907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:26.835087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:26.835232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:26.835392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:26.835539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:26.835725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:26.835762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:26.839788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 821 sessionId: src_id|b54efed9-b70c7a06-9edec4de-207044af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:26.842439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:26.842638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:26.842662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:26.842696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:26.842771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:26.845725Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:26.845742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:26.845745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:26.845747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:26.845763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895215683171570:5943]
2025-09-30T14:52:26.845766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895215683171570:5943]
2025-09-30T14:52:26.845770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895215683171570:5943]
2025-09-30T14:52:26.845806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:26.845812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.845815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:26.845824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:26.845839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:26.845842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:26.845951Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:26.894514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895215772901262:7153]
2025-09-30T14:52:26.894761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 820, pipe: [1:7555895215772901262:7153]
2025-09-30T14:52:26.950040Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:26.958171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:26.958211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:26.958402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:26.958467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:26.958535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:26.958610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:26.958658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:26.958668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:26.958742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:26.958812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:26.958881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:26.958955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:26.959001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:26.959008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:26.959086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:26.959147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:26.959209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:26.959301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:26.959347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:26.959356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:26.959422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:26.959489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:26.959561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:26.959628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:26.959672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:26.959681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:26.959744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:26.959802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:26.959870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:26.959932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:26.959975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:26.959980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:26.960043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:26.960109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:26.960188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:26.960256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:26.960308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:26.960316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:26.960381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:26.960435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:26.960500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:26.960562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:26.960605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:26.960611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:26.960677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:26.960747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:26.960815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:26.960885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:26.960930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:26.960937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:26.961001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:26.961060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:26.961126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:26.961191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:26.961241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:26.961248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:26.961322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:26.961386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:26.961447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:26.961507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:26.961548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:26.961554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:26.961611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895215772901262:7153], now have 1 active actors on pipe
2025-09-30T14:52:26.961795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:26.961841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:26.961845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:26.961850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895215772901262:7153]
2025-09-30T14:52:26.961883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 821 reason: error at write: Disconnected sessionId: src_id|b54efed9-b70c7a06-9edec4de-207044af_0
2025-09-30T14:52:26.962045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 821 sessionId: src_id|b54efed9-b70c7a06-9edec4de-207044af_0 is DEAD
2025-09-30T14:52:26.962193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b54efed9-b70c7a06-9edec4de-207044af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:26.962203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b54efed9-b70c7a06-9edec4de-207044af_0] Write session will restart in 0.006051s
2025-09-30T14:52:26.962221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b54efed9-b70c7a06-9edec4de-207044af_0] Write session: Do CDS request
2025-09-30T14:52:26.962225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b54efed9-b70c7a06-9edec4de-207044af_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:26.962825Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:26.969730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b54efed9-b70c7a06-9edec4de-207044af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:26.969875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:26.969892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 822
2025-09-30T14:52:26.970029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 822 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:26.970063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 822 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:26.970074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=822 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:26.970078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:26.970780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 822 sessionId:  describe result for acl check
2025-09-30T14:52:26.970822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:26.970830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:26.970833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:26.970839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895215772901289:7267] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:26.971452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895215772901289:7267] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:26.974094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895215772901289:7267] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:26.975684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:26.979158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:26.979367Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:26.979376Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:26.979387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:26.979437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:26.979474Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895215683171738:5945]
2025-09-30T14:52:26.979568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895215772901289:7267] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:26.979583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895215772901289:7267] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:26.979587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895215772901289:7267] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:26.979594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 822 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:26.980128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:26.980452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:26.980502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:26.980843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:26.980915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:26.980922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:26.980923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:26.980924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:26.980926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:26.980927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:26.980928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:26.980929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:26.980931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:26.980932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:26.980934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.980935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.980936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.980937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:26.980938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:26.980944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:26.980955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:26.980959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:26.980964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:26.980968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:26.980973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:26.980977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:26.980981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:26.980985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:26.980991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:26.980995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.980999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.981003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.981007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:26.981011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:26.981019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:26.981027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:26.981034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:26.981039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:26.981044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:26.981049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:26.981054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:26.981059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:26.981064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:26.981069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:26.981074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:26.981079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:26.981085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:26.981090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:26.981093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:26.981098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:26.981103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:26.981108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:26.981117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:26.981122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:26.981127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.981132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.981141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.981145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.981151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.981155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.981165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:26.981170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:26.981175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:26.981184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:26.981227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:26.986614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:26.987424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:26.987439Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:26.987442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:26.987445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:26.987450Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 821 [2:7555895215683171738:5945]
2025-09-30T14:52:26.987462Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:26.987474Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:26.987476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:26.987479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:26.987480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:26.987492Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:26.987497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:26.987504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:26.987563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.987570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.987571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.987574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:26.987576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:26.987629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:26.987637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.987649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:26.987662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:26.987678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:26.987692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895215772901266:2454], now have 1 active actors on pipe
2025-09-30T14:52:26.987698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895215772901412:7267], now have 1 active actors on pipe
2025-09-30T14:52:26.987703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895215683171733:5945]
2025-09-30T14:52:26.987705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895215683171733:5945]
2025-09-30T14:52:26.987706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895215683171733:5945]
2025-09-30T14:52:26.987716Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:26.987726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:26.987739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:26.987739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:26.987744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:26.987746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:26.987748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:26.987771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895215683171733:5945]
2025-09-30T14:52:26.987756Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 821
2025-09-30T14:52:26.987779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:26.987767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 821
2025-09-30T14:52:26.987780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:26.987808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:26.987812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:26.987847Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26674b94-914112e1-29e4c530-4f1ebfef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:26.987858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:26.987861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:26.987864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:26.987873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:26.987883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:26.987899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:26.988067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:26.988075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:26.988089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:26.988177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 822 partition: 0 MaxSeqNo: 42 sessionId: src_id|26674b94-914112e1-29e4c530-4f1ebfef_0
2025-09-30T14:52:26.988526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b54efed9-b70c7a06-9edec4de-207044af_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|26674b94-914112e1-29e4c530-4f1ebfef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:26.991322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26674b94-914112e1-29e4c530-4f1ebfef_0] Write session: try to update token
2025-09-30T14:52:26.991339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26674b94-914112e1-29e4c530-4f1ebfef_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:26.999333Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:26.999360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:26.999364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:26.999366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:26.999378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895215683171733:5945]
2025-09-30T14:52:26.999384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895215683171733:5945]
2025-09-30T14:52:26.999388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895215683171733:5945]
2025-09-30T14:52:26.999433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:26.999435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:26.999444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:26.999447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:26.999448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:26.999453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:26.999652Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:27.005665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 822 sessionId: src_id|26674b94-914112e1-29e4c530-4f1ebfef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:27.008271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:27.061957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895220067868740:7153]
2025-09-30T14:52:27.062248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 821, pipe: [1:7555895220067868740:7153]
2025-09-30T14:52:27.105171Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:27.105668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:27.105680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:27.105711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895220067868740:7153], now have 1 active actors on pipe
2025-09-30T14:52:27.105874Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:27.105958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:27.105970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:27.106012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895220067868740:7153]
2025-09-30T14:52:27.106021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 822 reason: error at write: Disconnected sessionId: src_id|26674b94-914112e1-29e4c530-4f1ebfef_0
2025-09-30T14:52:27.106029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:27.106152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 822 sessionId: src_id|26674b94-914112e1-29e4c530-4f1ebfef_0 is DEAD
2025-09-30T14:52:27.106350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26674b94-914112e1-29e4c530-4f1ebfef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:27.106361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26674b94-914112e1-29e4c530-4f1ebfef_0] Write session will restart in 0.007836s
2025-09-30T14:52:27.106386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26674b94-914112e1-29e4c530-4f1ebfef_0] Write session: Do CDS request
2025-09-30T14:52:27.106396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26674b94-914112e1-29e4c530-4f1ebfef_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:27.115708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26674b94-914112e1-29e4c530-4f1ebfef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:27.115796Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:27.115815Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 823
2025-09-30T14:52:27.115978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 823 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:27.116016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 823 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:27.116020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=823 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:27.116024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:27.116475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 823 sessionId:  describe result for acl check
2025-09-30T14:52:27.116508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:27.116510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:27.116512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:27.116516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895220067868818:7274] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:27.117083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895220067868818:7274] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:27.119098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895220067868818:7274] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:27.123366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:27.123653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895220067868818:7274] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:27.123668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895220067868818:7274] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:27.123672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895220067868818:7274] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:27.123680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 823 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:27.123836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:27.124014Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:27.124024Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:27.124034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:27.124082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:27.124118Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895219978139190:5949]
2025-09-30T14:52:27.124805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:27.125102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:27.125167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:27.125510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:27.125567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:27.125574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:27.125575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:27.125576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:27.125578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:27.125579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:27.125580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:27.125582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:27.125583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:27.125585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:27.125586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.125587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.125588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.125589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:27.125591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:27.125597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:27.125607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:27.125611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:27.125615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:27.125620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:27.125625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:27.125629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:27.125633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:27.125637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:27.125646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:27.125650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.125658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.125662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.125672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:27.125676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:27.125683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:27.125691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:27.125698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:27.125704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:27.125714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:27.125725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:27.125730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:27.125735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:27.125740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:27.125746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:27.125750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:27.125759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:27.125765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:27.125770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:27.125778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:27.125789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:27.125798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:27.125803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:27.125808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:27.125818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:27.125827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.125836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.125844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.125849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.125858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.125867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.125875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:27.125880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:27.125889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:27.125894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:27.125944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:27.131283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:27.132153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:27.132177Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:27.132180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:27.132184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:27.132190Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 822 [2:7555895219978139190:5949]
2025-09-30T14:52:27.132206Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:27.132224Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:27.132232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:27.132235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:27.132237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:27.132252Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:27.132263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:27.132271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:27.132336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.132346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.132349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.132352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:27.132354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:27.132420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:27.132429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.132444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.132455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.132478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:27.132503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895220067868894:7274], now have 1 active actors on pipe
2025-09-30T14:52:27.132513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895220067868744:2454], now have 1 active actors on pipe
2025-09-30T14:52:27.132519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895219978139184:5949]
2025-09-30T14:52:27.132522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895219978139184:5949]
2025-09-30T14:52:27.132525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895219978139184:5949]
2025-09-30T14:52:27.132541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:27.132555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:27.132565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:27.132566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 822
2025-09-30T14:52:27.132570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:27.132575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 822
2025-09-30T14:52:27.132577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:27.132580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:27.132582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:27.132616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895219978139184:5949]
2025-09-30T14:52:27.132620Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:27.132622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:27.132641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:27.132645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:27.132692Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cdb6d5ef-e76a5401-3f94df47-9fa31c6c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:27.132705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:27.132709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:27.132711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:27.132721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:27.132735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:27.132761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:27.132950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:27.132960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:27.132994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:27.133093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 823 partition: 0 MaxSeqNo: 42 sessionId: src_id|cdb6d5ef-e76a5401-3f94df47-9fa31c6c_0
2025-09-30T14:52:27.133479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26674b94-914112e1-29e4c530-4f1ebfef_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cdb6d5ef-e76a5401-3f94df47-9fa31c6c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:27.136258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdb6d5ef-e76a5401-3f94df47-9fa31c6c_0] Write session: try to update token
2025-09-30T14:52:27.136279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdb6d5ef-e76a5401-3f94df47-9fa31c6c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:27.144786Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:27.144809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:27.144811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:27.144814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:27.144823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895219978139184:5949]
2025-09-30T14:52:27.144828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895219978139184:5949]
2025-09-30T14:52:27.144833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895219978139184:5949]
2025-09-30T14:52:27.144871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:27.144878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.144877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:27.144880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:27.144884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:27.144887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:27.145011Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:27.150887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 823 sessionId: src_id|cdb6d5ef-e76a5401-3f94df47-9fa31c6c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:27.153681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:27.206342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895220067868906:7153]
2025-09-30T14:52:27.206628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 822, pipe: [1:7555895220067868906:7153]
2025-09-30T14:52:27.260803Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:27.261476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:27.261495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:27.261539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895220067868906:7153], now have 1 active actors on pipe
2025-09-30T14:52:27.261787Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:27.261810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:27.261812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:27.261828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:27.261857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895220067868906:7153]
2025-09-30T14:52:27.261892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 823 reason: error at write: Disconnected sessionId: src_id|cdb6d5ef-e76a5401-3f94df47-9fa31c6c_0
2025-09-30T14:52:27.262069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 823 sessionId: src_id|cdb6d5ef-e76a5401-3f94df47-9fa31c6c_0 is DEAD
2025-09-30T14:52:27.262237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdb6d5ef-e76a5401-3f94df47-9fa31c6c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:27.262249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdb6d5ef-e76a5401-3f94df47-9fa31c6c_0] Write session will restart in 0.007840s
2025-09-30T14:52:27.262272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdb6d5ef-e76a5401-3f94df47-9fa31c6c_0] Write session: Do CDS request
2025-09-30T14:52:27.262279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdb6d5ef-e76a5401-3f94df47-9fa31c6c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:27.271771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdb6d5ef-e76a5401-3f94df47-9fa31c6c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:27.271847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:27.271866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 824
2025-09-30T14:52:27.272005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 824 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:27.272039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 824 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:27.272049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=824 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:27.272054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:27.272493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 824 sessionId:  describe result for acl check
2025-09-30T14:52:27.272541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:27.272548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:27.272551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:27.272557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895220067869000:7278] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:27.273086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895220067869000:7278] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:27.275407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895220067869000:7278] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:27.275597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:27.280479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:27.280746Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:27.280764Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:27.280778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:27.280850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:27.280900Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895219978139343:5951]
2025-09-30T14:52:27.280962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895220067869000:7278] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:27.280982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895220067869000:7278] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:27.280986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895220067869000:7278] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:27.280995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 824 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:27.281552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:27.281925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:27.281973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:27.282324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:27.282414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:27.282421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:27.282423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:27.282424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:27.282425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:27.282426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:27.282427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:27.282429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:27.282430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:27.282431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:27.282432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.282434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.282435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.282436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:27.282438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:27.282444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:27.282454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:27.282459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:27.282463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:27.282467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:27.282471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:27.282475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:27.282480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:27.282483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:27.282489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:27.282493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.282497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.282501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.282505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:27.282509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:27.282517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:27.282525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:27.282538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:27.282547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:27.282565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:27.282570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:27.282574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:27.282580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:27.282585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:27.282590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:27.282595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:27.282601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:27.282606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:27.282611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:27.282616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:27.282622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:27.282628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:27.282638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:27.282643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:27.282649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:27.282660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.282666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.282675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.282680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.282689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.282694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.282705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:27.282710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:27.282719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:27.282725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:27.282769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:27.288388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:27.289723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:27.289744Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:27.289747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:27.289751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:27.289759Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 823 [2:7555895219978139343:5951]
2025-09-30T14:52:27.289774Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:27.289790Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:27.289798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:27.289801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:27.289803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:27.289819Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:27.289831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:27.289838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:27.289899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.289907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.289909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.289913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:27.289915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:27.289980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:27.289987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.290001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.290018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.290041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:27.290064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895220067868907:2454], now have 1 active actors on pipe
2025-09-30T14:52:27.290073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895220067869066:7278], now have 1 active actors on pipe
2025-09-30T14:52:27.290079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895219978139338:5951]
2025-09-30T14:52:27.290088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895219978139338:5951]
2025-09-30T14:52:27.290090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895219978139338:5951]
2025-09-30T14:52:27.290102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:27.290115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:27.290128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:27.290129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:27.290132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:27.290134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:27.290137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:27.290171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895219978139338:5951]
2025-09-30T14:52:27.290186Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:27.290202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:27.290143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 823
2025-09-30T14:52:27.290219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:27.290146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 823
2025-09-30T14:52:27.290226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:27.290258Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d36f815e-5480e942-6d29d0d7-c93489a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:27.290270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:27.290274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:27.290276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:27.290287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:27.290312Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:27.290333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:27.290579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:27.290591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:27.290607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:27.290700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 824 partition: 0 MaxSeqNo: 42 sessionId: src_id|d36f815e-5480e942-6d29d0d7-c93489a7_0
2025-09-30T14:52:27.291045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdb6d5ef-e76a5401-3f94df47-9fa31c6c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d36f815e-5480e942-6d29d0d7-c93489a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:27.293601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d36f815e-5480e942-6d29d0d7-c93489a7_0] Write session: try to update token
2025-09-30T14:52:27.293618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d36f815e-5480e942-6d29d0d7-c93489a7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:27.302101Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:27.302125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:27.302128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:27.302130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:27.302139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895219978139338:5951]
2025-09-30T14:52:27.302143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895219978139338:5951]
2025-09-30T14:52:27.302150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895219978139338:5951]
2025-09-30T14:52:27.302189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:27.302195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.302198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:27.302196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:27.302203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:27.302208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:27.302358Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:27.307467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 824 sessionId: src_id|d36f815e-5480e942-6d29d0d7-c93489a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:27.309926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:27.361985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895220067869078:7153]
2025-09-30T14:52:27.362241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 823, pipe: [1:7555895220067869078:7153]
2025-09-30T14:52:27.408882Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:27.409153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:27.409169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:27.409207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895220067869078:7153], now have 1 active actors on pipe
2025-09-30T14:52:27.409423Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:27.409451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:27.409471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895220067869078:7153]
2025-09-30T14:52:27.409488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:27.409556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 824 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d36f815e-5480e942-6d29d0d7-c93489a7_0
2025-09-30T14:52:27.409699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 824 sessionId: src_id|d36f815e-5480e942-6d29d0d7-c93489a7_0 is DEAD
2025-09-30T14:52:27.409843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d36f815e-5480e942-6d29d0d7-c93489a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:27.409855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d36f815e-5480e942-6d29d0d7-c93489a7_0] Write session will restart in 0.006314s
2025-09-30T14:52:27.409891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d36f815e-5480e942-6d29d0d7-c93489a7_0] Write session: Do CDS request
2025-09-30T14:52:27.409896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d36f815e-5480e942-6d29d0d7-c93489a7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:27.417727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d36f815e-5480e942-6d29d0d7-c93489a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:27.417836Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:27.417852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 825
2025-09-30T14:52:27.417958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 825 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:27.417990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 825 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:27.417995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=825 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:27.417998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:27.418432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 825 sessionId:  describe result for acl check
2025-09-30T14:52:27.418472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:27.418480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:27.418481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:27.418485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895220067869095:7282] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:27.418994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895220067869095:7282] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:27.421527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895220067869095:7282] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:27.423389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:27.426843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895220067869095:7282] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:27.426856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895220067869095:7282] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:27.426859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895220067869095:7282] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:27.426864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 825 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:27.426863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:27.427049Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:27.427059Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:27.427069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:27.427114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:27.427149Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895219978139499:5953]
2025-09-30T14:52:27.427623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:27.427875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:27.427923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:27.428218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:27.428266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:27.428270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:27.428271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:27.428272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:27.428272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:27.428273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:27.428274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:27.428274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:27.428275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:27.428276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:27.428276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.428277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.428278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.428278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:27.428279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:27.428283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:27.428292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:27.428297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:27.428300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:27.428303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:27.428308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:27.428312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:27.428316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:27.428320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:27.428325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:27.428329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.428332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.428336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.428341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:27.428345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:27.428352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:27.428360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:27.428366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:27.428371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:27.428376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:27.428381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:27.428385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:27.428391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:27.428395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:27.428400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:27.428405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:27.428410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:27.428414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:27.428420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:27.428424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:27.428430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:27.428434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:27.428440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:27.428444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:27.428449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:27.428453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.428459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.428463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.428469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.428474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.428478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.428488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:27.428493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:27.428497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:27.428502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:27.428535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:27.433739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:27.434607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:27.434624Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:27.434627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:27.434630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:27.434637Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 824 [2:7555895219978139499:5953]
2025-09-30T14:52:27.434651Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:27.434664Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:27.434668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:27.434670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:27.434673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:27.434687Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:27.434694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:27.434701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:27.434753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.434761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.434763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.434766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:27.434769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:27.434830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:27.434838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.434849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.434860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.434882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:27.434902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895220067869079:2454], now have 1 active actors on pipe
2025-09-30T14:52:27.434910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895220067869230:7282], now have 1 active actors on pipe
2025-09-30T14:52:27.434916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895219978139493:5953]
2025-09-30T14:52:27.434918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895219978139493:5953]
2025-09-30T14:52:27.434920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895219978139493:5953]
2025-09-30T14:52:27.434932Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:27.434941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:27.434944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:27.434946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:27.434949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:27.434964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:27.434972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:27.434954Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 824
2025-09-30T14:52:27.434996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 824
2025-09-30T14:52:27.434998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895219978139493:5953]
2025-09-30T14:52:27.435009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:27.435039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:27.435089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:27.435098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:27.435123Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|499f1196-b40f24-673ab5ca-b5cbe5f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:27.435134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:27.435137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:27.435140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:27.435151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:27.435163Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:27.435180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:27.435333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:27.435341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:27.435354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:27.435432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 825 partition: 0 MaxSeqNo: 42 sessionId: src_id|499f1196-b40f24-673ab5ca-b5cbe5f_0
2025-09-30T14:52:27.435741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d36f815e-5480e942-6d29d0d7-c93489a7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|499f1196-b40f24-673ab5ca-b5cbe5f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:27.438557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|499f1196-b40f24-673ab5ca-b5cbe5f_0] Write session: try to update token
2025-09-30T14:52:27.438575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|499f1196-b40f24-673ab5ca-b5cbe5f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:27.447117Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:27.447139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:27.447149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895219978139493:5953]
2025-09-30T14:52:27.447191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:27.447205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:27.447401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:27.447546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:27.447680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:27.447825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:27.448008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:27.448045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:27.452298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 825 sessionId: src_id|499f1196-b40f24-673ab5ca-b5cbe5f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:27.454802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:27.455400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:27.455424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:27.455459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:27.455534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:27.457651Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:27.457671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:27.457674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:27.457680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:27.457690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895219978139493:5953]
2025-09-30T14:52:27.457694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895219978139493:5953]
2025-09-30T14:52:27.457697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895219978139493:5953]
2025-09-30T14:52:27.457734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:27.457739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:27.457745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:27.457747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.457749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:27.457750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:27.457874Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:27.509458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895220067869244:7153]
2025-09-30T14:52:27.509724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 824, pipe: [1:7555895220067869244:7153]
2025-09-30T14:52:27.567218Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:27.575320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:27.575352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:27.575527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:27.575584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:27.575652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:27.575713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:27.576211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:27.576223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:27.576288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:27.576347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:27.576417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:27.576479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:27.576524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:27.576530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:27.576595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:27.576654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:27.576719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:27.576777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:27.576818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:27.576823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:27.576888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:27.576973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:27.577044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:27.577102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:27.577287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:27.577297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:27.577366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:27.577432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:27.577509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:27.577574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:27.577615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:27.577625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:27.577692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:27.577753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:27.577815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:27.577871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:27.577916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:27.577925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:27.577999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:27.578067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:27.578140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:27.578235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:27.578277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:27.578285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:27.578369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:27.578430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:27.578500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:27.578560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:27.578604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:27.578610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:27.578671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:27.578735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:27.578795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:27.578853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:27.578910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:27.578915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:27.578986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:27.579049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:27.579115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:27.579180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:27.579226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:27.579233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:27.579313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895220067869244:7153], now have 1 active actors on pipe
2025-09-30T14:52:27.579577Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:27.579578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895220067869244:7153]
2025-09-30T14:52:27.579620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:27.579623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:27.579652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 825 reason: error at write: Disconnected sessionId: src_id|499f1196-b40f24-673ab5ca-b5cbe5f_0
2025-09-30T14:52:27.579647Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:27.579842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 825 sessionId: src_id|499f1196-b40f24-673ab5ca-b5cbe5f_0 is DEAD
2025-09-30T14:52:27.580003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|499f1196-b40f24-673ab5ca-b5cbe5f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:27.580015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|499f1196-b40f24-673ab5ca-b5cbe5f_0] Write session will restart in 0.006728s
2025-09-30T14:52:27.580050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|499f1196-b40f24-673ab5ca-b5cbe5f_0] Write session: Do CDS request
2025-09-30T14:52:27.580055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|499f1196-b40f24-673ab5ca-b5cbe5f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:27.587720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|499f1196-b40f24-673ab5ca-b5cbe5f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:27.587815Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:27.587829Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 826
2025-09-30T14:52:27.587939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 826 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:27.587964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 826 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:27.587974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=826 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:27.587977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:27.588409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 826 sessionId:  describe result for acl check
2025-09-30T14:52:27.588448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:27.588450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:27.588452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:27.588458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895220067869261:7287] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:27.589023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895220067869261:7287] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:27.592222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895220067869261:7287] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:27.594472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:27.598361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:27.598518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895220067869261:7287] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:27.598534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895220067869261:7287] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:27.598537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895220067869261:7287] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:27.598546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 826 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:27.598534Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:27.598544Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:27.598552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:27.598591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:27.598619Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895219978139656:5956]
2025-09-30T14:52:27.599077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:27.599328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:27.599360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:27.599610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:27.599654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:27.599658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:27.599659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:27.599660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:27.599661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:27.599662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:27.599663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:27.599663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:27.599664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:27.599664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:27.599665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.599666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.599666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.599667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:27.599668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:27.599671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:27.599678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:27.599681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:27.599683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:27.599686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:27.599688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:27.599691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:27.599693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:27.599696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:27.599700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:27.599704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.599708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.599712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.599716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:27.599720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:27.599727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:27.599732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:27.599735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:27.599738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:27.599742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:27.599745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:27.599747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:27.599750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:27.599753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:27.599756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:27.599759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:27.599761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:27.599766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:27.599769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:27.599771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:27.599774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:27.599777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:27.599780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:27.599782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:27.599785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:27.599788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.599790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.599793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.599796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.599799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.599802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.599804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:27.599806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:27.599809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:27.599812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:27.599834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:27.605121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:27.605980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:27.606002Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:27.606005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:27.606009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:27.606015Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 825 [2:7555895219978139656:5956]
2025-09-30T14:52:27.606030Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:27.606044Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:27.606052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:27.606055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:27.606058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:27.606073Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:27.606085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:27.606093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:27.606151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.606159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.606160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.606163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:27.606164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:27.606224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:27.606232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.606244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.606255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.606272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:27.606307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895220067869398:7287], now have 1 active actors on pipe
2025-09-30T14:52:27.606311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895220067869245:2454], now have 1 active actors on pipe
2025-09-30T14:52:27.606317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895219978139651:5956]
2025-09-30T14:52:27.606319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895219978139651:5956]
2025-09-30T14:52:27.606322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895219978139651:5956]
2025-09-30T14:52:27.606333Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:27.606344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:27.606346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:27.606349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:27.606351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:27.606361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:27.606363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:27.606395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895219978139651:5956]
2025-09-30T14:52:27.606406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:27.606411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:27.606391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 825
2025-09-30T14:52:27.606429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 825
2025-09-30T14:52:27.606620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:27.606632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:27.606656Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bae56399-73f8569f-bab9ada3-63b7648c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:27.606668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:27.606672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:27.606674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:27.606682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:27.606690Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:27.606700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:27.606881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:27.606896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:27.606929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:27.607032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 826 partition: 0 MaxSeqNo: 42 sessionId: src_id|bae56399-73f8569f-bab9ada3-63b7648c_0
2025-09-30T14:52:27.607388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|499f1196-b40f24-673ab5ca-b5cbe5f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bae56399-73f8569f-bab9ada3-63b7648c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:27.610225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bae56399-73f8569f-bab9ada3-63b7648c_0] Write session: try to update token
2025-09-30T14:52:27.610246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bae56399-73f8569f-bab9ada3-63b7648c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:27.618336Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:27.618360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:27.618369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895219978139651:5956]
2025-09-30T14:52:27.618410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:27.618421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:27.618596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:27.618747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:27.618893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:27.619040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:27.619428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:27.619474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:27.624693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 826 sessionId: src_id|bae56399-73f8569f-bab9ada3-63b7648c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:27.627209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:27.627530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:27.627554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:27.627593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:27.627710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:27.628909Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:27.628926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:27.628929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:27.628931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:27.628942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895219978139651:5956]
2025-09-30T14:52:27.628946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895219978139651:5956]
2025-09-30T14:52:27.628949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895219978139651:5956]
2025-09-30T14:52:27.628984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:27.628996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.628996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:27.628998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:27.629002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:27.629005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:27.629131Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:27.679927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895220067869432:7153]
2025-09-30T14:52:27.680205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 825, pipe: [1:7555895220067869432:7153]
2025-09-30T14:52:27.739094Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:27.747380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:27.747410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:27.747582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:27.747644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:27.747709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:27.747774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:27.747820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:27.747831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:27.747899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:27.747972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:27.748037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:27.748103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:27.748146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:27.748154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:27.748223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:27.748286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:27.748351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:27.748419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:27.748464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:27.748471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:27.748539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:27.748606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:27.748669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:27.748732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:27.748776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:27.748784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:27.748852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:27.748915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:27.748977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:27.749040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:27.749091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:27.749101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:27.749166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:27.749228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:27.749287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:27.749364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:27.749409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:27.749417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:27.749483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:27.749544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:27.749609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:27.749672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:27.749723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:27.749732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:27.749799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:27.749857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:27.749921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:27.749983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:27.750031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:27.750040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:27.750105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:27.750165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:27.750226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:27.750302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:27.750348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:27.750352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:27.750419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:27.750483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:27.750544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:27.750609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:27.750654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:27.750664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:27.750722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895220067869432:7153], now have 1 active actors on pipe
2025-09-30T14:52:27.750956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:27.750956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:27.750961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:27.750990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 826 reason: error at write: Disconnected sessionId: src_id|bae56399-73f8569f-bab9ada3-63b7648c_0
2025-09-30T14:52:27.751021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895220067869432:7153]
2025-09-30T14:52:27.751158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 826 sessionId: src_id|bae56399-73f8569f-bab9ada3-63b7648c_0 is DEAD
2025-09-30T14:52:27.751316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae56399-73f8569f-bab9ada3-63b7648c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:27.751328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae56399-73f8569f-bab9ada3-63b7648c_0] Write session will restart in 0.009763s
2025-09-30T14:52:27.751365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae56399-73f8569f-bab9ada3-63b7648c_0] Write session: Do CDS request
2025-09-30T14:52:27.751370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae56399-73f8569f-bab9ada3-63b7648c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:27.752007Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:27.762772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bae56399-73f8569f-bab9ada3-63b7648c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:27.762841Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:27.762859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 827
2025-09-30T14:52:27.763002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 827 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:27.763037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 827 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:27.763048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=827 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:27.763052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:27.763481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 827 sessionId:  describe result for acl check
2025-09-30T14:52:27.763513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:27.763521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:27.763523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:27.763529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895220067869550:7298] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:27.764055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895220067869550:7298] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:27.765195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:27.765705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895220067869550:7298] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:27.768860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:27.769040Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:27.769051Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:27.769061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:27.769102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:27.769139Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895219978139849:5970]
2025-09-30T14:52:27.769399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895220067869550:7298] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:27.769415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895220067869550:7298] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:27.769419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895220067869550:7298] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:27.769427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 827 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:27.769811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:27.770027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:27.770063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:27.770385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:27.770436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:27.770442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:27.770443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:27.770444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:27.770445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:27.770446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:27.770447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:27.770449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:27.770450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:27.770451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:27.770452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.770454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.770455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.770456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:27.770457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:27.770462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:27.770473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:27.770478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:27.770482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:27.770487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:27.770491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:27.770496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:27.770500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:27.770505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:27.770509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:27.770514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.770518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.770523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.770527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:27.770532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:27.770538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:27.770545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:27.770551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:27.770558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:27.770563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:27.770568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:27.770573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:27.770578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:27.770587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:27.770592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:27.770601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:27.770607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:27.770616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:27.770622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:27.770631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:27.770637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:27.770642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:27.770648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:27.770653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:27.770658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:27.770663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.770674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.770679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.770691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.770695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.770701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.770710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:27.770715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:27.770726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:27.770731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:27.770784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:27.776021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:27.777246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:27.777264Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:27.777267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:27.777271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:27.777278Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 826 [2:7555895219978139849:5970]
2025-09-30T14:52:27.777294Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:27.777309Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:27.777312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:27.777315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:27.777317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:27.777332Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:27.777340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:27.777346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:27.777419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.777427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.777429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.777433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:27.777435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:27.777501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:27.777508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.777520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.777539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.777562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:27.777586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895220067869587:7298], now have 1 active actors on pipe
2025-09-30T14:52:27.777590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895220067869433:2454], now have 1 active actors on pipe
2025-09-30T14:52:27.777596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895219978139844:5970]
2025-09-30T14:52:27.777598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895219978139844:5970]
2025-09-30T14:52:27.777601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895219978139844:5970]
2025-09-30T14:52:27.777612Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:27.777626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:27.777631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:27.777634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:27.777637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:27.777646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:27.777649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:27.777641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 826
2025-09-30T14:52:27.777674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895219978139844:5970]
2025-09-30T14:52:27.777682Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:27.777650Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 826
2025-09-30T14:52:27.777684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:27.777701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:27.777710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:27.777752Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4b30f6f-1b5c8367-44dc00a4-2b0e0676_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:27.777764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:27.777768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:27.777770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:27.777780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:27.777788Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:27.777808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:27.777948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:27.777956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:27.777968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:27.778073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 827 partition: 0 MaxSeqNo: 42 sessionId: src_id|a4b30f6f-1b5c8367-44dc00a4-2b0e0676_0
2025-09-30T14:52:27.778409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae56399-73f8569f-bab9ada3-63b7648c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a4b30f6f-1b5c8367-44dc00a4-2b0e0676_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:27.781373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b30f6f-1b5c8367-44dc00a4-2b0e0676_0] Write session: try to update token
2025-09-30T14:52:27.781392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b30f6f-1b5c8367-44dc00a4-2b0e0676_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:27.789611Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:27.789639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:27.789641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:27.789643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:27.789652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895219978139844:5970]
2025-09-30T14:52:27.789656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895219978139844:5970]
2025-09-30T14:52:27.789663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895219978139844:5970]
2025-09-30T14:52:27.789704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:27.789712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.789710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:27.789714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:27.789716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:27.789720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:27.789852Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:27.795881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 827 sessionId: src_id|a4b30f6f-1b5c8367-44dc00a4-2b0e0676_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:27.798660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:27.850952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895220067869599:7153]
2025-09-30T14:52:27.851239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 826, pipe: [1:7555895220067869599:7153]
2025-09-30T14:52:27.896459Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:27.896955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:27.896968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:27.896999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895220067869599:7153], now have 1 active actors on pipe
2025-09-30T14:52:27.897171Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:27.897222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:27.897241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:27.897242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:27.897280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895220067869599:7153]
2025-09-30T14:52:27.897302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 827 reason: error at write: Disconnected sessionId: src_id|a4b30f6f-1b5c8367-44dc00a4-2b0e0676_0
2025-09-30T14:52:27.897491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 827 sessionId: src_id|a4b30f6f-1b5c8367-44dc00a4-2b0e0676_0 is DEAD
2025-09-30T14:52:27.897615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b30f6f-1b5c8367-44dc00a4-2b0e0676_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:27.897627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b30f6f-1b5c8367-44dc00a4-2b0e0676_0] Write session will restart in 0.007400s
2025-09-30T14:52:27.897650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b30f6f-1b5c8367-44dc00a4-2b0e0676_0] Write session: Do CDS request
2025-09-30T14:52:27.897658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b30f6f-1b5c8367-44dc00a4-2b0e0676_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:27.905739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b30f6f-1b5c8367-44dc00a4-2b0e0676_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:27.905849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:27.905867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 828
2025-09-30T14:52:27.906016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 828 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:27.906052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 828 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:27.906058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=828 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:27.906061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:27.906517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 828 sessionId:  describe result for acl check
2025-09-30T14:52:27.906563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:27.906569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:27.906572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:27.906578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895220067869627:7302] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:27.907104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895220067869627:7302] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:27.909855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895220067869627:7302] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:27.911454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:27.915164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:27.915392Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:27.915406Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:27.915418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:27.915425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895220067869627:7302] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:27.915440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895220067869627:7302] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:27.915443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895220067869627:7302] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:27.915449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 828 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:27.915481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:27.915522Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895219978140007:5972]
2025-09-30T14:52:27.916153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:27.916458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:27.916507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:27.916834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:27.916901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:27.916905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:27.916906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:27.916908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:27.916909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:27.916910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:27.916911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:27.916913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:27.916913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:27.916915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:27.916916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.916917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.916918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.916919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:27.916920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:27.916926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:27.916937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:27.916941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:27.916946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:27.916950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:27.916954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:27.916958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:27.916963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:27.916967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:27.916972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:27.916976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.916979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.916983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.916987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:27.916991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:27.916998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:27.917019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:27.917030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:27.917040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:27.917049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:27.917059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:27.917069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:27.917078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:27.917087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:27.917093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:27.917101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:27.917110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:27.917119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:27.917129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:27.917137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:27.917142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:27.917151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:27.917156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:27.917161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:27.917171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:27.917179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.917189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.917197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.917206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.917215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.917224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.917228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:27.917238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:27.917242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:27.917248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:27.917299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:27.922706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:27.923575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:27.923589Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:27.923592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:27.923597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:27.923603Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 827 [2:7555895219978140007:5972]
2025-09-30T14:52:27.923619Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:27.923633Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:27.923640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:27.923644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:27.923646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:27.923661Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:27.923672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:27.923680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:27.923733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.923741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.923743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.923749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:27.923752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:27.923817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:27.923827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.923840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:27.923853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:27.923872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:27.923893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895220067869600:2454], now have 1 active actors on pipe
2025-09-30T14:52:27.923901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895220067869754:7302], now have 1 active actors on pipe
2025-09-30T14:52:27.923907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895219978140002:5972]
2025-09-30T14:52:27.923914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895219978140002:5972]
2025-09-30T14:52:27.923917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895219978140002:5972]
2025-09-30T14:52:27.923931Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:27.923949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:27.923956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:27.923961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:27.923963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:27.923969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:27.923973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:27.923953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 827
2025-09-30T14:52:27.923954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 827
2025-09-30T14:52:27.923999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895219978140002:5972]
2025-09-30T14:52:27.924007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:27.924010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:27.924023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:27.924032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:27.924082Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f0125d2-38bd1792-15564a35-cdd3bee7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:27.924093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:27.924096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:27.924099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:27.924109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:27.924117Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:27.924145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:27.924302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:27.924312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:27.924327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:27.924394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 828 partition: 0 MaxSeqNo: 42 sessionId: src_id|3f0125d2-38bd1792-15564a35-cdd3bee7_0
2025-09-30T14:52:27.924777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b30f6f-1b5c8367-44dc00a4-2b0e0676_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3f0125d2-38bd1792-15564a35-cdd3bee7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:27.927617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0125d2-38bd1792-15564a35-cdd3bee7_0] Write session: try to update token
2025-09-30T14:52:27.927633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0125d2-38bd1792-15564a35-cdd3bee7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:27.936281Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:27.936304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:27.936308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:27.936311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:27.936322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895219978140002:5972]
2025-09-30T14:52:27.936328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895219978140002:5972]
2025-09-30T14:52:27.936332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895219978140002:5972]
2025-09-30T14:52:27.936375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:27.936376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:27.936382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:27.936387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:27.936393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:27.936396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:27.936608Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:27.941302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 828 sessionId: src_id|3f0125d2-38bd1792-15564a35-cdd3bee7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:27.944006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:27.997356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895220067869773:7153]
2025-09-30T14:52:27.997575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 827, pipe: [1:7555895220067869773:7153]
2025-09-30T14:52:28.042840Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:28.043106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:28.043135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:28.043173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895220067869773:7153], now have 1 active actors on pipe
2025-09-30T14:52:28.043416Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:28.043440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:28.043446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:28.043451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:28.043494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895220067869773:7153]
2025-09-30T14:52:28.043504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 828 reason: error at write: Disconnected sessionId: src_id|3f0125d2-38bd1792-15564a35-cdd3bee7_0
2025-09-30T14:52:28.043665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 828 sessionId: src_id|3f0125d2-38bd1792-15564a35-cdd3bee7_0 is DEAD
2025-09-30T14:52:28.043796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0125d2-38bd1792-15564a35-cdd3bee7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:28.043807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0125d2-38bd1792-15564a35-cdd3bee7_0] Write session will restart in 0.008930s
2025-09-30T14:52:28.043831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0125d2-38bd1792-15564a35-cdd3bee7_0] Write session: Do CDS request
2025-09-30T14:52:28.043837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0125d2-38bd1792-15564a35-cdd3bee7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:28.053784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0125d2-38bd1792-15564a35-cdd3bee7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:28.053837Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:28.053853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 829
2025-09-30T14:52:28.053992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 829 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:28.054033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 829 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:28.054043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=829 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:28.054047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:28.054531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 829 sessionId:  describe result for acl check
2025-09-30T14:52:28.054566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:28.054571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:28.054573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:28.054577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895224362837160:7311] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:28.055014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895224362837160:7311] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:28.056851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895224362837160:7311] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:28.057456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:28.061449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:28.061627Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:28.061635Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:28.061642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:28.061681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:28.061712Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895224273107473:5975]
2025-09-30T14:52:28.061714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895224362837160:7311] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:28.061729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895224362837160:7311] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:28.061733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895224362837160:7311] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:28.061741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 829 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:28.062184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:28.062470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:28.062501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:28.062752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:28.062800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:28.062805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:28.062806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:28.062806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:28.062807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:28.062808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:28.062809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:28.062810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:28.062811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:28.062812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:28.062812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.062813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.062814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.062815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:28.062816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:28.062819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:28.062826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:28.062829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:28.062831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:28.062834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:28.062836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:28.062839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:28.062841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:28.062843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:28.062846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:28.062851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.062854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.062858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.062862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:28.062866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:28.062873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:28.062881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:28.062885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:28.062888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:28.062891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:28.062894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:28.062898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:28.062901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:28.062904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:28.062907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:28.062910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:28.062913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:28.062916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:28.062919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:28.062921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:28.062924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:28.062928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:28.062930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:28.062933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:28.062936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:28.062940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.062947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.062949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.062952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.062955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.062958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.062964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:28.062967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:28.062970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:28.062973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:28.062998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:28.068259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:28.069109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:28.069121Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:28.069123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:28.069126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:28.069131Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 828 [2:7555895224273107473:5975]
2025-09-30T14:52:28.069143Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:28.069154Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:28.069160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:28.069162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:28.069164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:28.069175Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:28.069179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:28.069184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:28.069223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.069229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.069230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.069233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:28.069234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:28.069296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:28.069305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.069315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.069327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.069342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:28.069361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895224362837087:2454], now have 1 active actors on pipe
2025-09-30T14:52:28.069367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895224362837242:7311], now have 1 active actors on pipe
2025-09-30T14:52:28.069372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895224273107468:5975]
2025-09-30T14:52:28.069373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895224273107468:5975]
2025-09-30T14:52:28.069375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895224273107468:5975]
2025-09-30T14:52:28.069386Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:28.069399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:28.069411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:28.069417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:28.069426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:28.069430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:28.069433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:28.069442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895224273107468:5975]
2025-09-30T14:52:28.069445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:28.069448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:28.069428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 828
2025-09-30T14:52:28.069448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 828
2025-09-30T14:52:28.069474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:28.069481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:28.069502Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e79d1fd6-1297760c-48d2a74f-9815d6c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:28.069513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:28.069515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:28.069516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:28.069523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:28.069530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:28.069538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:28.069665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:28.069671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:28.069680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:28.069749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 829 partition: 0 MaxSeqNo: 42 sessionId: src_id|e79d1fd6-1297760c-48d2a74f-9815d6c_0
2025-09-30T14:52:28.070095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0125d2-38bd1792-15564a35-cdd3bee7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e79d1fd6-1297760c-48d2a74f-9815d6c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:28.072840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e79d1fd6-1297760c-48d2a74f-9815d6c_0] Write session: try to update token
2025-09-30T14:52:28.072856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e79d1fd6-1297760c-48d2a74f-9815d6c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:28.081233Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:28.081248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:28.081256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895224273107468:5975]
2025-09-30T14:52:28.081293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:28.081309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:28.081448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:28.081585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:28.081714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:28.081854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:28.082042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:28.082076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:28.088253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 829 sessionId: src_id|e79d1fd6-1297760c-48d2a74f-9815d6c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:28.091144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:28.092206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:28.092227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:28.092249Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:28.092252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:28.092255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:28.092257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:28.092266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895224273107468:5975]
2025-09-30T14:52:28.092270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895224273107468:5975]
2025-09-30T14:52:28.092274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895224273107468:5975]
2025-09-30T14:52:28.092319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:28.092324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:28.092330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.092333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:28.092335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:28.092339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:28.092468Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:28.143784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895224362837257:7153]
2025-09-30T14:52:28.144029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 828, pipe: [1:7555895224362837257:7153]
2025-09-30T14:52:28.199221Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:28.199767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:28.199805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895224362837257:7153], now have 1 active actors on pipe
2025-09-30T14:52:28.199915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:28.199943Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:28.199984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895224362837257:7153]
2025-09-30T14:52:28.209925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:28.209942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:28.209966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 829 reason: error at write: Disconnected sessionId: src_id|e79d1fd6-1297760c-48d2a74f-9815d6c_0
2025-09-30T14:52:28.210115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 829 sessionId: src_id|e79d1fd6-1297760c-48d2a74f-9815d6c_0 is DEAD
2025-09-30T14:52:28.210265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e79d1fd6-1297760c-48d2a74f-9815d6c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:28.210274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e79d1fd6-1297760c-48d2a74f-9815d6c_0] Write session will restart in 0.006164s
2025-09-30T14:52:28.210317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e79d1fd6-1297760c-48d2a74f-9815d6c_0] Write session: Do CDS request
2025-09-30T14:52:28.210324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e79d1fd6-1297760c-48d2a74f-9815d6c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:28.217809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e79d1fd6-1297760c-48d2a74f-9815d6c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:28.217870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:28.217889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 830
2025-09-30T14:52:28.218039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 830 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:28.218072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 830 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:28.218089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=830 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:28.218092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:28.218575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 830 sessionId:  describe result for acl check
2025-09-30T14:52:28.218622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:28.218631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:28.218633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:28.218640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895224362837377:7315] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:28.219200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895224362837377:7315] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:28.219772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:28.222124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895224362837377:7315] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:28.224430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:28.224625Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:28.224633Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:28.224641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:28.224695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:28.224739Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895224273107635:5978]
2025-09-30T14:52:28.224949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895224362837377:7315] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:28.224964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895224362837377:7315] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:28.224967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895224362837377:7315] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:28.224975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 830 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:28.225296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:28.225612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:28.225657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:28.225936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:28.225993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:28.225999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:28.226001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:28.226002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:28.226003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:28.226004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:28.226006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:28.226007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:28.226008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:28.226010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:28.226011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.226013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.226014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.226015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:28.226016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:28.226022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:28.226033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:28.226038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:28.226043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:28.226048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:28.226052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:28.226055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:28.226059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:28.226062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:28.226068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:28.226073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.226077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.226082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.226086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:28.226091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:28.226098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:28.226107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:28.226118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:28.226130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:28.226139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:28.226145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:28.226151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:28.226157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:28.226162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:28.226173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:28.226178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:28.226188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:28.226194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:28.226203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:28.226207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:28.226213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:28.226218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:28.226225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:28.226229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:28.226235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:28.226244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.226250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.226258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.226264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.226271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.226280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.226285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:28.226301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:28.226306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:28.226312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:28.226355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:28.231952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:28.233140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:28.233157Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:28.233159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:28.233163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:28.233169Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 829 [2:7555895224273107635:5978]
2025-09-30T14:52:28.233182Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:28.233195Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:28.233198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:28.233200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:28.233202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:28.233215Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:28.233221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:28.233229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:28.233287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.233294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.233297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.233299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:28.233301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:28.233375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:28.233380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.233390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.233396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.233409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:28.233428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895224273107630:5978]
2025-09-30T14:52:28.233437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895224273107630:5978]
2025-09-30T14:52:28.233439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895224273107630:5978]
2025-09-30T14:52:28.233448Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:28.233460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:28.233464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:28.233464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895224362837258:2454], now have 1 active actors on pipe
2025-09-30T14:52:28.233466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:28.233471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:28.233487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:28.233490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:28.233495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895224362837414:7315], now have 1 active actors on pipe
2025-09-30T14:52:28.233563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 829
2025-09-30T14:52:28.233585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 829
2025-09-30T14:52:28.233678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895224273107630:5978]
2025-09-30T14:52:28.233694Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:28.233718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:28.233729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:28.233734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:28.233772Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b307496-742bfa9a-2e27f7d2-ae421806_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:28.233785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:28.233795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:28.233797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:28.233807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:28.233824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:28.233845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:28.234048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:28.234056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:28.234070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:28.234151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 830 partition: 0 MaxSeqNo: 42 sessionId: src_id|1b307496-742bfa9a-2e27f7d2-ae421806_0
2025-09-30T14:52:28.234528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e79d1fd6-1297760c-48d2a74f-9815d6c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1b307496-742bfa9a-2e27f7d2-ae421806_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:28.237402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b307496-742bfa9a-2e27f7d2-ae421806_0] Write session: try to update token
2025-09-30T14:52:28.237422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b307496-742bfa9a-2e27f7d2-ae421806_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:28.245844Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:28.245864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:28.245869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:28.245871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:28.245879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895224273107630:5978]
2025-09-30T14:52:28.245883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895224273107630:5978]
2025-09-30T14:52:28.245887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895224273107630:5978]
2025-09-30T14:52:28.245926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:28.245933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.245942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:28.245951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:28.245958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:28.245962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:28.246075Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:28.251686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 830 sessionId: src_id|1b307496-742bfa9a-2e27f7d2-ae421806_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:28.254449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:28.299993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895224362837425:7153]
2025-09-30T14:52:28.300256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 829, pipe: [1:7555895224362837425:7153]
2025-09-30T14:52:28.353214Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:28.353476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:28.353489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:28.353521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895224362837425:7153], now have 1 active actors on pipe
2025-09-30T14:52:28.353685Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:28.353779Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:28.353812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:28.353817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:28.353828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895224362837425:7153]
2025-09-30T14:52:28.353876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 830 reason: error at write: Disconnected sessionId: src_id|1b307496-742bfa9a-2e27f7d2-ae421806_0
2025-09-30T14:52:28.354038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 830 sessionId: src_id|1b307496-742bfa9a-2e27f7d2-ae421806_0 is DEAD
2025-09-30T14:52:28.354192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b307496-742bfa9a-2e27f7d2-ae421806_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:28.354203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b307496-742bfa9a-2e27f7d2-ae421806_0] Write session will restart in 0.005932s
2025-09-30T14:52:28.354226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b307496-742bfa9a-2e27f7d2-ae421806_0] Write session: Do CDS request
2025-09-30T14:52:28.354231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b307496-742bfa9a-2e27f7d2-ae421806_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:28.361728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b307496-742bfa9a-2e27f7d2-ae421806_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:28.361788Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:28.361803Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 831
2025-09-30T14:52:28.361913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 831 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:28.361943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 831 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:28.361953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=831 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:28.361957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:28.362629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 831 sessionId:  describe result for acl check
2025-09-30T14:52:28.362674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:28.362682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:28.362684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:28.362689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895224362837451:7319] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:28.363260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895224362837451:7319] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:28.365713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895224362837451:7319] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:28.367360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:28.371474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895224362837451:7319] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:28.371492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895224362837451:7319] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:28.371496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895224362837451:7319] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:28.371504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 831 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:28.371470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:28.371644Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:28.371653Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:28.371661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:28.371700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:28.371730Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895224273107796:5980]
2025-09-30T14:52:28.372188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:28.372488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:28.372556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:28.372928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:28.372988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:28.372994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:28.372995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:28.372996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:28.372998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:28.372999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:28.373001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:28.373002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:28.373004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:28.373005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:28.373006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.373007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.373009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.373010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:28.373011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:28.373018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:28.373028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:28.373033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:28.373037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:28.373041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:28.373045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:28.373049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:28.373054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:28.373058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:28.373062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:28.373066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.373070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.373074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.373078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:28.373082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:28.373090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:28.373097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:28.373104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:28.373110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:28.373115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:28.373121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:28.373125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:28.373130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:28.373137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:28.373143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:28.373147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:28.373152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:28.373161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:28.373166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:28.373171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:28.373176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:28.373182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:28.373189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:28.373193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:28.373198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:28.373202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.373207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.373213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.373218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.373222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.373226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.373231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:28.373236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:28.373243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:28.373248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:28.373293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:28.378766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:28.379860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:28.379873Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:28.379875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:28.379878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:28.379883Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 830 [2:7555895224273107796:5980]
2025-09-30T14:52:28.379897Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:28.379908Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:28.379910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:28.379913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:28.379915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:28.379929Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:28.379936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:28.379942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:28.380001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.380008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.380009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.380012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:28.380013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:28.380063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:28.380069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.380077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.380083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.380092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:28.380110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895224273107791:5980]
2025-09-30T14:52:28.380111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895224273107791:5980]
2025-09-30T14:52:28.380112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895224273107791:5980]
2025-09-30T14:52:28.380118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:28.380128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895224362837583:7319], now have 1 active actors on pipe
2025-09-30T14:52:28.380130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:28.380134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:28.380136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895224362837427:2454], now have 1 active actors on pipe
2025-09-30T14:52:28.380137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:28.380140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:28.380149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:28.380151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:28.380175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895224273107791:5980]
2025-09-30T14:52:28.380183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:28.380190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:28.380217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 830
2025-09-30T14:52:28.380233Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 830
2025-09-30T14:52:28.380265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:28.380275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:28.380298Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18bc5798-5af17c6b-e0a00576-64ead84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:28.380306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:28.380309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:28.380310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:28.380317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:28.380323Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:28.380332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:28.380485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:28.380497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:28.380520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:28.380628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 831 partition: 0 MaxSeqNo: 42 sessionId: src_id|18bc5798-5af17c6b-e0a00576-64ead84_0
2025-09-30T14:52:28.380968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b307496-742bfa9a-2e27f7d2-ae421806_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|18bc5798-5af17c6b-e0a00576-64ead84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:28.383649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18bc5798-5af17c6b-e0a00576-64ead84_0] Write session: try to update token
2025-09-30T14:52:28.383666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18bc5798-5af17c6b-e0a00576-64ead84_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:28.392858Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:28.392881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:28.392885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:28.392888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:28.392898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895224273107791:5980]
2025-09-30T14:52:28.392903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895224273107791:5980]
2025-09-30T14:52:28.392907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895224273107791:5980]
2025-09-30T14:52:28.392955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:28.392959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:28.392964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.392965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:28.392966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:28.392969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:28.393128Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:28.397506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 831 sessionId: src_id|18bc5798-5af17c6b-e0a00576-64ead84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:28.400234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:28.454123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895224362837595:7153]
2025-09-30T14:52:28.454447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 830, pipe: [1:7555895224362837595:7153]
2025-09-30T14:52:28.496607Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:28.496936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:28.496948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:28.496978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895224362837595:7153], now have 1 active actors on pipe
2025-09-30T14:52:28.497150Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:28.497170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895224362837595:7153]
2025-09-30T14:52:28.497171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:28.497175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:28.497204Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:28.497235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 831 reason: error at write: Disconnected sessionId: src_id|18bc5798-5af17c6b-e0a00576-64ead84_0
2025-09-30T14:52:28.497408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 831 sessionId: src_id|18bc5798-5af17c6b-e0a00576-64ead84_0 is DEAD
2025-09-30T14:52:28.497584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18bc5798-5af17c6b-e0a00576-64ead84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:28.497604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18bc5798-5af17c6b-e0a00576-64ead84_0] Write session will restart in 0.009497s
2025-09-30T14:52:28.497628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18bc5798-5af17c6b-e0a00576-64ead84_0] Write session: Do CDS request
2025-09-30T14:52:28.497637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18bc5798-5af17c6b-e0a00576-64ead84_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:28.508753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18bc5798-5af17c6b-e0a00576-64ead84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:28.508842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:28.508860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 832
2025-09-30T14:52:28.508997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 832 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:28.509042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 832 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:28.509052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=832 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:28.509056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:28.509453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 832 sessionId:  describe result for acl check
2025-09-30T14:52:28.509489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:28.509496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:28.509498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:28.509503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895224362837720:7324] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:28.510062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895224362837720:7324] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:28.511334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:28.512101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895224362837720:7324] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:28.515409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:28.515615Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:28.515603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895224362837720:7324] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:28.515626Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:28.515637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:28.515619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895224362837720:7324] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:28.515622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895224362837720:7324] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:28.515630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 832 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:28.515689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:28.515726Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895224273107958:5982]
2025-09-30T14:52:28.516264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:28.516556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:28.516596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:28.516855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:28.516916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:28.516921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:28.516922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:28.516923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:28.516924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:28.516925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:28.516927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:28.516928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:28.516929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:28.516930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:28.516932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.516933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.516934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.516935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:28.516936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:28.516942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:28.516952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:28.516957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:28.516962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:28.516965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:28.516970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:28.516974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:28.516979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:28.516983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:28.516988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:28.516992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.516997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.517000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.517004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:28.517009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:28.517015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:28.517025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:28.517034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:28.517041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:28.517049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:28.517055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:28.517063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:28.517069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:28.517078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:28.517084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:28.517092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:28.517098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:28.517105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:28.517110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:28.517115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:28.517120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:28.517127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:28.517133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:28.517141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:28.517147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:28.517156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.517162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.517169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.517175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.517183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.517189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.517197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:28.517203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:28.517212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:28.517218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:28.517267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:28.522575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:28.523375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:28.523387Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:28.523389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:28.523392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:28.523397Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 831 [2:7555895224273107958:5982]
2025-09-30T14:52:28.523408Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:28.523420Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:28.523422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:28.523425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:28.523426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:28.523437Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:28.523446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:28.523451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:28.523495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.523501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.523502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.523505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:28.523507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:28.523554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:28.523559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.523567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.523573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.523583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:28.523594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895224273107953:5982]
2025-09-30T14:52:28.523597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895224273107953:5982]
2025-09-30T14:52:28.523599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895224273107953:5982]
2025-09-30T14:52:28.523604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:28.523614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:28.523623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:28.523627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:28.523626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:28.523630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:28.523632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:28.523661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895224362837599:2454], now have 1 active actors on pipe
2025-09-30T14:52:28.523665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895224362837757:7324], now have 1 active actors on pipe
2025-09-30T14:52:28.523667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895224273107953:5982]
2025-09-30T14:52:28.523674Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:28.523716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:28.523745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 831
2025-09-30T14:52:28.523749Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 831
2025-09-30T14:52:28.523820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:28.523827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:28.523849Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c70458a-f832a477-723ad2a5-f318ffa1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:28.523858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:28.523861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:28.523862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:28.523868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:28.523874Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:28.523886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:28.524052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:28.524059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:28.524068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:28.524158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 832 partition: 0 MaxSeqNo: 42 sessionId: src_id|6c70458a-f832a477-723ad2a5-f318ffa1_0
2025-09-30T14:52:28.524484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18bc5798-5af17c6b-e0a00576-64ead84_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6c70458a-f832a477-723ad2a5-f318ffa1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:28.527177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c70458a-f832a477-723ad2a5-f318ffa1_0] Write session: try to update token
2025-09-30T14:52:28.527197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c70458a-f832a477-723ad2a5-f318ffa1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:28.535287Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:28.535304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:28.535314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895224273107953:5982]
2025-09-30T14:52:28.535364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:28.535369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:28.535606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:28.535823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:28.536048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:28.536198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:28.536412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:28.536473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:28.542412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 832 sessionId: src_id|6c70458a-f832a477-723ad2a5-f318ffa1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:28.544962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:28.545194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:28.545220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:28.546350Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:28.546364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:28.546366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:28.546370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:28.546377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895224273107953:5982]
2025-09-30T14:52:28.546380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895224273107953:5982]
2025-09-30T14:52:28.546382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895224273107953:5982]
2025-09-30T14:52:28.546412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:28.546426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:28.546430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:28.546435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.546435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:28.546436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:28.546438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:28.546566Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:28.546548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:28.597418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895224362837768:7153]
2025-09-30T14:52:28.597702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 831, pipe: [1:7555895224362837768:7153]
2025-09-30T14:52:28.650003Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:28.657315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:28.657336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:28.657470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:28.657532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:28.657606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:28.657673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:28.657717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:28.657721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:28.657783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:28.657839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:28.657896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:28.657959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:28.658005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:28.658017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:28.658086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:28.658146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:28.658214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:28.658278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:28.658341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:28.658349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:28.658430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:28.658503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:28.658574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:28.658634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:28.658673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:28.658678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:28.658743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:28.658802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:28.658859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:28.658916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:28.658958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:28.658964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:28.659026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:28.659089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:28.659154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:28.659212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:28.659276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:28.659285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:28.659349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:28.659403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:28.659464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:28.659530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:28.659588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:28.659594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:28.659656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:28.659721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:28.659786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:28.659843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:28.659889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:28.659895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:28.659956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:28.660012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:28.660067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:28.660135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:28.660182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:28.660190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:28.660265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:28.660326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:28.660382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:28.660438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:28.660478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:28.660483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:28.660526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895224362837768:7153], now have 1 active actors on pipe
2025-09-30T14:52:28.660673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:28.660728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895224362837768:7153]
2025-09-30T14:52:28.660750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:28.660755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:28.660777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 832 reason: error at write: Disconnected sessionId: src_id|6c70458a-f832a477-723ad2a5-f318ffa1_0
2025-09-30T14:52:28.660941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 832 sessionId: src_id|6c70458a-f832a477-723ad2a5-f318ffa1_0 is DEAD
2025-09-30T14:52:28.661025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c70458a-f832a477-723ad2a5-f318ffa1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:28.661034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c70458a-f832a477-723ad2a5-f318ffa1_0] Write session will restart in 0.008483s
2025-09-30T14:52:28.661051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c70458a-f832a477-723ad2a5-f318ffa1_0] Write session: Do CDS request
2025-09-30T14:52:28.661056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c70458a-f832a477-723ad2a5-f318ffa1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:28.661391Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:28.670715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c70458a-f832a477-723ad2a5-f318ffa1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:28.670813Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:28.670830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 833
2025-09-30T14:52:28.670933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 833 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:28.670957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 833 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:28.670965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=833 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:28.670969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:28.671354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 833 sessionId:  describe result for acl check
2025-09-30T14:52:28.671382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:28.671389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:28.671391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:28.671396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895224362837902:7334] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:28.672114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895224362837902:7334] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:28.673368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:28.674458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895224362837902:7334] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:28.676790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:28.676972Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:28.676982Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:28.676989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:28.677028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:28.677053Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895224273108135:5991]
2025-09-30T14:52:28.677088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895224362837902:7334] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:28.677104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895224362837902:7334] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:28.677108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895224362837902:7334] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:28.677115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 833 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:28.677574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:28.677899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:28.677938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:28.678158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:28.678199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:28.678203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:28.678204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:28.678205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:28.678205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:28.678206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:28.678207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:28.678207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:28.678208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:28.678209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:28.678209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.678210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.678211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.678211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:28.678212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:28.678215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:28.678222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:28.678224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:28.678226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:28.678229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:28.678231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:28.678233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:28.678236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:28.678238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:28.678240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:28.678242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.678245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.678247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.678249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:28.678252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:28.678257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:28.678262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:28.678265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:28.678269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:28.678271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:28.678274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:28.678277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:28.678280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:28.678282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:28.678299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:28.678302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:28.678304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:28.678307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:28.678310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:28.678312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:28.678315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:28.678318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:28.678320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:28.678323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:28.678326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:28.678329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.678332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.678334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.678336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.678339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.678342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.678344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:28.678347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:28.678349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:28.678352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:28.678376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:28.683428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:28.684627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:28.684642Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:28.684644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:28.684648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:28.684654Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 832 [2:7555895224273108135:5991]
2025-09-30T14:52:28.684667Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:28.684680Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:28.684684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:28.684687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:28.684689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:28.684704Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:28.684710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:28.684717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:28.684776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.684783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.684784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.684787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:28.684789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:28.684846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:28.684853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.684865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.684877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.684899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:28.684920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895224362837783:2454], now have 1 active actors on pipe
2025-09-30T14:52:28.684928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895224362837941:7334], now have 1 active actors on pipe
2025-09-30T14:52:28.684934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895224273108130:5991]
2025-09-30T14:52:28.684936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895224273108130:5991]
2025-09-30T14:52:28.684938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895224273108130:5991]
2025-09-30T14:52:28.684950Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:28.684966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:28.684973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:28.684977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:28.684978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:28.684985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:28.684988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:28.685017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895224273108130:5991]
2025-09-30T14:52:28.685024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:28.685027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:28.685000Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 832
2025-09-30T14:52:28.685055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 832
2025-09-30T14:52:28.685143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:28.685158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:28.685187Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b97822b-43e995f5-de95e0b-3b5df30d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:28.685199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:28.685208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:28.685210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:28.685220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:28.685233Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:28.685257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:28.685405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:28.685416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:28.685436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:28.685517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 833 partition: 0 MaxSeqNo: 42 sessionId: src_id|5b97822b-43e995f5-de95e0b-3b5df30d_0
2025-09-30T14:52:28.685858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c70458a-f832a477-723ad2a5-f318ffa1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5b97822b-43e995f5-de95e0b-3b5df30d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:28.688721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b97822b-43e995f5-de95e0b-3b5df30d_0] Write session: try to update token
2025-09-30T14:52:28.688739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b97822b-43e995f5-de95e0b-3b5df30d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:28.696978Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:28.696999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:28.697002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:28.697003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:28.697011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895224273108130:5991]
2025-09-30T14:52:28.697016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895224273108130:5991]
2025-09-30T14:52:28.697019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895224273108130:5991]
2025-09-30T14:52:28.697058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:28.697060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:28.697066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:28.697068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.697070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:28.697071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:28.697201Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:28.703158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 833 sessionId: src_id|5b97822b-43e995f5-de95e0b-3b5df30d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:28.705737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:28.760775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895224362837962:7153]
2025-09-30T14:52:28.761080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 832, pipe: [1:7555895224362837962:7153]
2025-09-30T14:52:28.803923Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:28.804485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:28.804500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:28.804551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895224362837962:7153], now have 1 active actors on pipe
2025-09-30T14:52:28.804784Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:28.804837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895224362837962:7153]
2025-09-30T14:52:28.804847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:28.804875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:28.804929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 833 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5b97822b-43e995f5-de95e0b-3b5df30d_0
2025-09-30T14:52:28.805086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 833 sessionId: src_id|5b97822b-43e995f5-de95e0b-3b5df30d_0 is DEAD
2025-09-30T14:52:28.805230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b97822b-43e995f5-de95e0b-3b5df30d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:28.805242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b97822b-43e995f5-de95e0b-3b5df30d_0] Write session will restart in 0.005175s
2025-09-30T14:52:28.805268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b97822b-43e995f5-de95e0b-3b5df30d_0] Write session: Do CDS request
2025-09-30T14:52:28.805274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b97822b-43e995f5-de95e0b-3b5df30d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:28.811759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b97822b-43e995f5-de95e0b-3b5df30d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:28.811877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:28.811901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 834
2025-09-30T14:52:28.811993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 834 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:28.812023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 834 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:28.812034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=834 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:28.812037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:28.812524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 834 sessionId:  describe result for acl check
2025-09-30T14:52:28.812559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:28.812561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:28.812563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:28.812568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895224362837977:7339] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:28.813133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895224362837977:7339] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:28.816055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895224362837977:7339] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:28.819314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895224362837977:7339] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:28.819328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895224362837977:7339] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:28.819330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895224362837977:7339] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:28.819337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 834 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:28.820695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:28.824321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:28.824533Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:28.824543Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:28.824554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:28.824605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:28.824647Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895224273108322:5999]
2025-09-30T14:52:28.825323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:28.825661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:28.825711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:28.826011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:28.826081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:28.826088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:28.826089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:28.826091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:28.826092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:28.826093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:28.826094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:28.826096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:28.826097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:28.826098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:28.826099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.826100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.826102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.826103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:28.826104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:28.826110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:28.826120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:28.826124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:28.826128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:28.826132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:28.826136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:28.826139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:28.826144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:28.826148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:28.826152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:28.826156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.826160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.826164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.826172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:28.826176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:28.826187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:28.826197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:28.826204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:28.826208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:28.826214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:28.826218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:28.826221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:28.826224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:28.826227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:28.826230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:28.826233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:28.826236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:28.826239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:28.826242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:28.826249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:28.826255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:28.826265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:28.826274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:28.826282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:28.826297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:28.826308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.826318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.826326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.826336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.826344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.826349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.826355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:28.826359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:28.826361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:28.826364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:28.826399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:28.831897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:28.832744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:28.832756Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:28.832758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:28.832762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:28.832769Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 833 [2:7555895224273108322:5999]
2025-09-30T14:52:28.832785Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:28.832803Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:28.832806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:28.832809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:28.832812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:28.832827Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:28.832834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:28.832847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:28.832923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.832930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.832932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.832936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:28.832938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:28.833000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:28.833002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.833011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.833018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.833027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:28.833039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895224273108317:5999]
2025-09-30T14:52:28.833040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895224273108317:5999]
2025-09-30T14:52:28.833042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895224273108317:5999]
2025-09-30T14:52:28.833047Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:28.833057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:28.833066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:28.833068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:28.833073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:28.833076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:28.833079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:28.833100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895224362837963:2454], now have 1 active actors on pipe
2025-09-30T14:52:28.833108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895224362838121:7339], now have 1 active actors on pipe
2025-09-30T14:52:28.833110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895224273108317:5999]
2025-09-30T14:52:28.833115Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:28.833130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:28.833215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 833
2025-09-30T14:52:28.833262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:28.833269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:28.833288Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b1ff0df-3924238b-9f90ada1-88fe2c30_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:28.833296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:28.833299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:28.833301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:28.833307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:28.833316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:28.833332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:28.833499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:28.833509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:28.833512Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 833
2025-09-30T14:52:28.833529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:28.833615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 834 partition: 0 MaxSeqNo: 42 sessionId: src_id|6b1ff0df-3924238b-9f90ada1-88fe2c30_0
2025-09-30T14:52:28.833975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b97822b-43e995f5-de95e0b-3b5df30d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6b1ff0df-3924238b-9f90ada1-88fe2c30_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:28.836599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b1ff0df-3924238b-9f90ada1-88fe2c30_0] Write session: try to update token
2025-09-30T14:52:28.836612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b1ff0df-3924238b-9f90ada1-88fe2c30_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:28.845114Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:28.845128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:28.845135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895224273108317:5999]
2025-09-30T14:52:28.845175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:28.845199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:28.845323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:28.845452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:28.845591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:28.845715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:28.845898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:28.845929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:28.850266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 834 sessionId: src_id|6b1ff0df-3924238b-9f90ada1-88fe2c30_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:28.852951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:28.853230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:28.853252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:28.853281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:28.853390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:28.856264Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:28.856278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:28.856280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:28.856281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:28.856289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895224273108317:5999]
2025-09-30T14:52:28.856294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895224273108317:5999]
2025-09-30T14:52:28.856298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895224273108317:5999]
2025-09-30T14:52:28.856335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:28.856341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.856344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:28.856352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:28.856358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:28.856360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:28.856468Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:28.905116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895224362838135:7153]
2025-09-30T14:52:28.905346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 833, pipe: [1:7555895224362838135:7153]
2025-09-30T14:52:28.962744Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:28.970052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:28.970074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:28.970215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:28.970274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:28.970345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:28.970404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:28.970446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:28.970454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:28.970516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:28.970570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:28.970626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:28.970688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:28.970732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:28.970740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:28.970813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:28.970874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:28.970940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:28.970999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:28.971051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:28.971061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:28.971125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:28.971184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:28.971269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:28.971338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:28.971387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:28.971396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:28.971460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:28.971531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:28.971602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:28.971703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:28.971745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:28.971754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:28.971844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:28.971914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:28.971988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:28.972063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:28.972113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:28.972120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:28.972191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:28.972255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:28.972322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:28.972385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:28.972434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:28.972443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:28.972508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:28.972570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:28.972630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:28.972686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:28.972724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:28.972730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:28.972798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:28.972851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:28.972915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:28.972975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:28.973015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:28.973023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:28.973080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:28.973132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:28.973188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:28.973260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:28.973306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:28.973311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:28.973354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895224362838135:7153], now have 1 active actors on pipe
2025-09-30T14:52:28.973574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:28.973586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:28.973608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 834 reason: error at write: Disconnected sessionId: src_id|6b1ff0df-3924238b-9f90ada1-88fe2c30_0
2025-09-30T14:52:28.973741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 834 sessionId: src_id|6b1ff0df-3924238b-9f90ada1-88fe2c30_0 is DEAD
2025-09-30T14:52:28.973897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b1ff0df-3924238b-9f90ada1-88fe2c30_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:28.973905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b1ff0df-3924238b-9f90ada1-88fe2c30_0] Write session will restart in 0.006762s
2025-09-30T14:52:28.973892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895224362838135:7153]
2025-09-30T14:52:28.973923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b1ff0df-3924238b-9f90ada1-88fe2c30_0] Write session: Do CDS request
2025-09-30T14:52:28.973927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b1ff0df-3924238b-9f90ada1-88fe2c30_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:28.973898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:28.974324Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:28.981653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b1ff0df-3924238b-9f90ada1-88fe2c30_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:28.981785Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:28.981801Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 835
2025-09-30T14:52:28.981923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 835 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:28.981951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 835 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:28.981955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=835 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:28.981958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:28.982378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 835 sessionId:  describe result for acl check
2025-09-30T14:52:28.982415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:28.982417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:28.982419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:28.982436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895224362838161:7343] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:28.983016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895224362838161:7343] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:28.985762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895224362838161:7343] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:28.988027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895224362838161:7343] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:28.988039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895224362838161:7343] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:28.988042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895224362838161:7343] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:28.988049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 835 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:28.988064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:28.991760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:28.991930Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:28.991939Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:28.991947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:28.991997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:28.992033Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895224273108498:6002]
2025-09-30T14:52:28.992625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:28.992879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:28.992927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:28.993248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:28.993302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:28.993308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:28.993309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:28.993311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:28.993312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:28.993313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:28.993315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:28.993316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:28.993317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:28.993318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:28.993319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.993321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.993322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.993323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:28.993324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:28.993329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:28.993339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:28.993344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:28.993348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:28.993351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:28.993356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:28.993360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:28.993364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:28.993367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:28.993369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:28.993371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.993374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.993376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.993378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:28.993381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:28.993387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:28.993392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:28.993395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:28.993399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:28.993401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:28.993404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:28.993407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:28.993410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:28.993413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:28.993416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:28.993418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:28.993421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:28.993424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:28.993427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:28.993429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:28.993432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:28.993435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:28.993438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:28.993440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:28.993443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:28.993446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.993450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.993455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.993457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.993459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.993462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.993464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:28.993467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:28.993469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:28.993472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:28.993496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:28.998726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:28.999780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:28.999797Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:28.999799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:28.999803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:28.999809Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 834 [2:7555895224273108498:6002]
2025-09-30T14:52:28.999823Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:28.999836Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:28.999844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:28.999846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:28.999848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:28.999863Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:28.999873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:28.999883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:28.999939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:28.999948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:28.999950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:28.999953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:28.999956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:29.000016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:29.000024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.000033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.000039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.000053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:29.000067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895224362838297:7343], now have 1 active actors on pipe
2025-09-30T14:52:29.000075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895224362838139:2454], now have 1 active actors on pipe
2025-09-30T14:52:29.000080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895224273108492:6002]
2025-09-30T14:52:29.000081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895224273108492:6002]
2025-09-30T14:52:29.000083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895224273108492:6002]
2025-09-30T14:52:29.000091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:29.000104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:29.000111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:29.000116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:29.000117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:29.000118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:29.000120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:29.000108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 834
2025-09-30T14:52:29.000109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 834
2025-09-30T14:52:29.000147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895224273108492:6002]
2025-09-30T14:52:29.000159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:29.000166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:29.000180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:29.000189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:29.000233Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a3fe153-97c5c2f7-5c2ab6ff-9e486506_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:29.000244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:29.000251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:29.000253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:29.000262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:29.000275Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:29.000294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:29.000485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:29.000498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:29.000513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:29.000614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 835 partition: 0 MaxSeqNo: 42 sessionId: src_id|2a3fe153-97c5c2f7-5c2ab6ff-9e486506_0
2025-09-30T14:52:29.000949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b1ff0df-3924238b-9f90ada1-88fe2c30_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2a3fe153-97c5c2f7-5c2ab6ff-9e486506_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:29.003619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a3fe153-97c5c2f7-5c2ab6ff-9e486506_0] Write session: try to update token
2025-09-30T14:52:29.003638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a3fe153-97c5c2f7-5c2ab6ff-9e486506_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:29.011945Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:29.011962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:29.011964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:29.011965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:29.011974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895224273108492:6002]
2025-09-30T14:52:29.011977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895224273108492:6002]
2025-09-30T14:52:29.011980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895224273108492:6002]
2025-09-30T14:52:29.012009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:29.012014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.012016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:29.012021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:29.012027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:29.012031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:29.012145Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:29.016959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 835 sessionId: src_id|2a3fe153-97c5c2f7-5c2ab6ff-9e486506_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:29.020144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:29.074079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895228657805627:7153]
2025-09-30T14:52:29.074280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 834, pipe: [1:7555895228657805627:7153]
2025-09-30T14:52:29.117910Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:29.118478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:29.118491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:29.118521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895228657805627:7153], now have 1 active actors on pipe
2025-09-30T14:52:29.118675Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:29.118763Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:29.118797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895228657805627:7153]
2025-09-30T14:52:29.118811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:29.118877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 835 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2a3fe153-97c5c2f7-5c2ab6ff-9e486506_0
2025-09-30T14:52:29.119031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 835 sessionId: src_id|2a3fe153-97c5c2f7-5c2ab6ff-9e486506_0 is DEAD
2025-09-30T14:52:29.119188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a3fe153-97c5c2f7-5c2ab6ff-9e486506_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:29.119197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a3fe153-97c5c2f7-5c2ab6ff-9e486506_0] Write session will restart in 0.007563s
2025-09-30T14:52:29.119215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a3fe153-97c5c2f7-5c2ab6ff-9e486506_0] Write session: Do CDS request
2025-09-30T14:52:29.119219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a3fe153-97c5c2f7-5c2ab6ff-9e486506_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:29.127711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a3fe153-97c5c2f7-5c2ab6ff-9e486506_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:29.127792Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:29.127808Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 836
2025-09-30T14:52:29.127919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 836 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:29.127952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 836 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:29.127964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=836 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:29.127969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:29.128377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 836 sessionId:  describe result for acl check
2025-09-30T14:52:29.128411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:29.128419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:29.128421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:29.128427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895228657805669:7350] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:29.128940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895228657805669:7350] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:29.130880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895228657805669:7350] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:29.132856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:29.132994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895228657805669:7350] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:29.133007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895228657805669:7350] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:29.133010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895228657805669:7350] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:29.133017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 836 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:29.136826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:29.137041Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:29.137054Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:29.137067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:29.137135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:29.137179Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895228568075961:6005]
2025-09-30T14:52:29.137790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:29.138429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:29.138478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:29.138745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:29.138788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:29.138792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:29.138793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:29.138794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:29.138795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:29.138796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:29.138796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:29.138797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:29.138798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:29.138799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:29.138799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.138800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.138801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.138801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:29.138802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:29.138807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:29.138814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:29.138817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:29.138819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:29.138822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:29.138824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:29.138827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:29.138829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:29.138831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:29.138834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:29.138836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.138838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.138841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.138843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:29.138845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:29.138851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:29.138856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:29.138859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:29.138862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:29.138866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:29.138869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:29.138872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:29.138875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:29.138878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:29.138881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:29.138884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:29.138887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:29.138890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:29.138893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:29.138897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:29.138900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:29.138903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:29.138906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:29.138909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:29.138912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:29.138915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.138918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.138920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.138924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.138927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.138930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.138932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:29.138936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:29.138940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:29.138943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:29.138967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:29.144375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:29.145185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:29.145199Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:29.145201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:29.145205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:29.145210Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 835 [2:7555895228568075961:6005]
2025-09-30T14:52:29.145223Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:29.145236Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:29.145242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:29.145244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:29.145246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:29.145265Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:29.145274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:29.145281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:29.145326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.145332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.145334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.145337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:29.145340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:29.145389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:29.145394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.145401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.145407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.145421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:29.145441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895228568075955:6005]
2025-09-30T14:52:29.145449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895228568075955:6005]
2025-09-30T14:52:29.145451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895228568075955:6005]
2025-09-30T14:52:29.145459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:29.145472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:29.145486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:29.145489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:29.145490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:29.145491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:29.145493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:29.145529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895228657805790:7350], now have 1 active actors on pipe
2025-09-30T14:52:29.145537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895228657805629:2454], now have 1 active actors on pipe
2025-09-30T14:52:29.145539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895228568075955:6005]
2025-09-30T14:52:29.145545Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:29.145576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:29.145597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 835
2025-09-30T14:52:29.145598Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 835
2025-09-30T14:52:29.145703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:29.145716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:29.145739Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3174f730-2eea46e-443a44d0-5c94615c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:29.145752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:29.145760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:29.145763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:29.145773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:29.145789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:29.145810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:29.145965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:29.145976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:29.145993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:29.146126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 836 partition: 0 MaxSeqNo: 42 sessionId: src_id|3174f730-2eea46e-443a44d0-5c94615c_0
2025-09-30T14:52:29.146438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a3fe153-97c5c2f7-5c2ab6ff-9e486506_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3174f730-2eea46e-443a44d0-5c94615c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:29.149096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3174f730-2eea46e-443a44d0-5c94615c_0] Write session: try to update token
2025-09-30T14:52:29.149114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3174f730-2eea46e-443a44d0-5c94615c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:29.157567Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:29.157585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:29.157593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895228568075955:6005]
2025-09-30T14:52:29.157629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:29.157635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:29.157799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:29.157948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:29.158081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:29.158216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:29.158427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:29.158475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:29.163130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 836 sessionId: src_id|3174f730-2eea46e-443a44d0-5c94615c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:29.165730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:29.165931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:29.165953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:29.165987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:29.166056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:29.168074Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:29.168089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:29.168091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:29.168093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:29.168100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895228568075955:6005]
2025-09-30T14:52:29.168103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895228568075955:6005]
2025-09-30T14:52:29.168106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895228568075955:6005]
2025-09-30T14:52:29.168135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:29.168140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.168143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:29.168165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:29.168178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:29.168182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:29.168274Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:29.218992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895228657805803:7153]
2025-09-30T14:52:29.219283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 835, pipe: [1:7555895228657805803:7153]
2025-09-30T14:52:29.271111Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:29.278496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:29.278525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:29.278708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:29.278786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:29.278851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:29.278923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:29.278975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:29.278983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:29.279047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:29.279109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:29.279167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:29.279226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:29.279289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:29.279296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:29.279361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:29.279431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:29.279494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:29.279558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:29.279607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:29.279615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:29.279683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:29.279745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:29.279811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:29.279904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:29.279947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:29.279954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:29.280022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:29.280087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:29.280161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:29.280238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:29.280289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:29.280298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:29.280374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:29.280443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:29.280516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:29.280588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:29.280635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:29.280644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:29.280719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:29.280786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:29.280857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:29.280928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:29.280972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:29.280978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:29.281053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:29.281114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:29.281175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:29.281237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:29.281283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:29.281292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:29.281361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:29.281427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:29.281490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:29.281552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:29.281595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:29.281597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:29.281663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:29.281719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:29.281780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:29.281840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:29.281895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:29.281898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:29.281964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895228657805803:7153], now have 1 active actors on pipe
2025-09-30T14:52:29.282227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:29.282245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:29.282259Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:29.282273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 836 reason: error at write: Disconnected sessionId: src_id|3174f730-2eea46e-443a44d0-5c94615c_0
2025-09-30T14:52:29.282339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895228657805803:7153]
2025-09-30T14:52:29.282445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 836 sessionId: src_id|3174f730-2eea46e-443a44d0-5c94615c_0 is DEAD
2025-09-30T14:52:29.282584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3174f730-2eea46e-443a44d0-5c94615c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:29.282594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3174f730-2eea46e-443a44d0-5c94615c_0] Write session will restart in 0.007561s
2025-09-30T14:52:29.282618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3174f730-2eea46e-443a44d0-5c94615c_0] Write session: Do CDS request
2025-09-30T14:52:29.282624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3174f730-2eea46e-443a44d0-5c94615c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:29.283210Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:29.291705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3174f730-2eea46e-443a44d0-5c94615c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:29.291911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:29.291927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 837
2025-09-30T14:52:29.292045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 837 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:29.292071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 837 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:29.292077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=837 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:29.292094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:29.292506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 837 sessionId:  describe result for acl check
2025-09-30T14:52:29.292549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:29.292557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:29.292559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:29.292565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895228657805864:7354] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:29.293123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895228657805864:7354] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:29.296286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895228657805864:7354] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:29.296504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:29.301053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:29.301229Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:29.301238Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:29.301246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:29.301253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895228657805864:7354] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:29.301290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:29.301270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895228657805864:7354] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:29.301274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895228657805864:7354] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:29.301282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 837 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:29.301330Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895228568076126:6007]
2025-09-30T14:52:29.301857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:29.302099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:29.302131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:29.302388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:29.302435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:29.302441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:29.302442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:29.302443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:29.302443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:29.302444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:29.302445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:29.302445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:29.302446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:29.302447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:29.302448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.302449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.302449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.302450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:29.302451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:29.302455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:29.302465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:29.302470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:29.302474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:29.302478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:29.302483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:29.302486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:29.302488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:29.302491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:29.302493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:29.302495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.302498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.302500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.302502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:29.302504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:29.302509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:29.302514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:29.302517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:29.302521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:29.302526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:29.302529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:29.302531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:29.302534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:29.302537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:29.302540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:29.302542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:29.302545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:29.302548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:29.302551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:29.302553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:29.302556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:29.302559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:29.302562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:29.302565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:29.302567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:29.302571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.302584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.302587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.302590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.302593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.302602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.302605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:29.302608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:29.302615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:29.302618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:29.302644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:29.307942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:29.309052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:29.309064Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:29.309066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:29.309069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:29.309074Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 836 [2:7555895228568076126:6007]
2025-09-30T14:52:29.309089Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:29.309104Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:29.309107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:29.309110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:29.309111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:29.309123Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:29.309127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:29.309132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:29.309178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.309184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.309186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.309189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:29.309191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:29.309246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:29.309253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.309262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.309268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.309277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:29.309292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895228568076121:6007]
2025-09-30T14:52:29.309295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895228568076121:6007]
2025-09-30T14:52:29.309296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895228568076121:6007]
2025-09-30T14:52:29.309304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:29.309313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:29.309318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895228657805967:7354], now have 1 active actors on pipe
2025-09-30T14:52:29.309324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:29.309324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895228657805804:2454], now have 1 active actors on pipe
2025-09-30T14:52:29.309326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:29.309330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:29.309345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:29.309353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:29.309375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895228568076121:6007]
2025-09-30T14:52:29.309384Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:29.309395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:29.309389Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 836
2025-09-30T14:52:29.309416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 836
2025-09-30T14:52:29.309480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:29.309491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:29.309511Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32984b55-a5a9c80e-441566db-96250bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:29.309521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:29.309524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:29.309526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:29.309534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:29.309547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:29.309569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:29.309739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:29.309753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:29.309772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:29.309851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 837 partition: 0 MaxSeqNo: 42 sessionId: src_id|32984b55-a5a9c80e-441566db-96250bd_0
2025-09-30T14:52:29.310175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3174f730-2eea46e-443a44d0-5c94615c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|32984b55-a5a9c80e-441566db-96250bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:29.312947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32984b55-a5a9c80e-441566db-96250bd_0] Write session: try to update token
2025-09-30T14:52:29.312966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32984b55-a5a9c80e-441566db-96250bd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:29.321125Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:29.321146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:29.321153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:29.321155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:29.321164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895228568076121:6007]
2025-09-30T14:52:29.321168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895228568076121:6007]
2025-09-30T14:52:29.321172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895228568076121:6007]
2025-09-30T14:52:29.321215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:29.321219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:29.321225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:29.321228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.321229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:29.321231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:29.321371Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:29.326608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 837 sessionId: src_id|32984b55-a5a9c80e-441566db-96250bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:29.329256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:29.382328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895228657805979:7153]
2025-09-30T14:52:29.382618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 836, pipe: [1:7555895228657805979:7153]
2025-09-30T14:52:29.427047Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:29.427569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:29.427585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:29.427619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895228657805979:7153], now have 1 active actors on pipe
2025-09-30T14:52:29.427822Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:29.427818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:29.427820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895228657805979:7153]
2025-09-30T14:52:29.427836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:29.427915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 837 reason: error at write: Disconnected sessionId: src_id|32984b55-a5a9c80e-441566db-96250bd_0
2025-09-30T14:52:29.427944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:29.428064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 837 sessionId: src_id|32984b55-a5a9c80e-441566db-96250bd_0 is DEAD
2025-09-30T14:52:29.428214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32984b55-a5a9c80e-441566db-96250bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:29.428223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32984b55-a5a9c80e-441566db-96250bd_0] Write session will restart in 0.007932s
2025-09-30T14:52:29.428240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32984b55-a5a9c80e-441566db-96250bd_0] Write session: Do CDS request
2025-09-30T14:52:29.428246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32984b55-a5a9c80e-441566db-96250bd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:29.437736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32984b55-a5a9c80e-441566db-96250bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:29.438053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:29.438083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 838
2025-09-30T14:52:29.438198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 838 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:29.438231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 838 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:29.438237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=838 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:29.438240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:29.438722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 838 sessionId:  describe result for acl check
2025-09-30T14:52:29.438773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:29.438781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:29.438783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:29.438789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895228657806050:7358] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:29.439366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895228657806050:7358] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:29.441549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895228657806050:7358] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:29.442754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:29.446641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:29.446839Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:29.446852Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:29.446864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:29.446926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:29.446969Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895228568076293:6009]
2025-09-30T14:52:29.446979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895228657806050:7358] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:29.446993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895228657806050:7358] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:29.446997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895228657806050:7358] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:29.447003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 838 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:29.447628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:29.447927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:29.447983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:29.448303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:29.448359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:29.448365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:29.448367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:29.448368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:29.448370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:29.448371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:29.448373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:29.448374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:29.448376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:29.448377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:29.448378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.448379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.448380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.448381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:29.448382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:29.448387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:29.448398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:29.448402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:29.448407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:29.448410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:29.448414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:29.448418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:29.448422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:29.448426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:29.448430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:29.448434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.448438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.448443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.448447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:29.448450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:29.448459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:29.448473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:29.448479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:29.448484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:29.448489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:29.448495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:29.448499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:29.448504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:29.448509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:29.448515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:29.448520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:29.448525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:29.448530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:29.448535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:29.448544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:29.448549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:29.448555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:29.448560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:29.448565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:29.448570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:29.448575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.448580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.448585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.448590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.448595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.448604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.448608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:29.448618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:29.448622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:29.448632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:29.448673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:29.453956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:29.454786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:29.454802Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:29.454804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:29.454809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:29.454816Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 837 [2:7555895228568076293:6009]
2025-09-30T14:52:29.454833Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:29.454851Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:29.454859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:29.454862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:29.454865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:29.454881Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:29.454888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:29.454894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:29.454954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.454961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.454963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.454967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:29.454969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:29.455033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:29.455041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.455057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.455069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.455087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:29.455108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895228657805980:2454], now have 1 active actors on pipe
2025-09-30T14:52:29.455116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895228657806144:7358], now have 1 active actors on pipe
2025-09-30T14:52:29.455122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895228568076288:6009]
2025-09-30T14:52:29.455125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895228568076288:6009]
2025-09-30T14:52:29.455127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895228568076288:6009]
2025-09-30T14:52:29.455139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:29.455158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:29.455158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:29.455162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:29.455164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:29.455140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 837
2025-09-30T14:52:29.455174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:29.455178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:29.455181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 837
2025-09-30T14:52:29.455210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895228568076288:6009]
2025-09-30T14:52:29.455222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:29.455230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:29.455239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:29.455267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:29.455310Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54e2df1d-4cc4e441-2df125a0-63027b8c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:29.455321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:29.455325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:29.455327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:29.455335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:29.455345Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:29.455361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:29.455534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:29.455543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:29.455560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:29.455624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 838 partition: 0 MaxSeqNo: 42 sessionId: src_id|54e2df1d-4cc4e441-2df125a0-63027b8c_0
2025-09-30T14:52:29.455945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32984b55-a5a9c80e-441566db-96250bd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|54e2df1d-4cc4e441-2df125a0-63027b8c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:29.458675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54e2df1d-4cc4e441-2df125a0-63027b8c_0] Write session: try to update token
2025-09-30T14:52:29.458692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54e2df1d-4cc4e441-2df125a0-63027b8c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:29.467069Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:29.467088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:29.467090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:29.467092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:29.467100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895228568076288:6009]
2025-09-30T14:52:29.467104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895228568076288:6009]
2025-09-30T14:52:29.467108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895228568076288:6009]
2025-09-30T14:52:29.467150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:29.467156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:29.467159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.467162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:29.467170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:29.467174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:29.467410Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:29.472864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 838 sessionId: src_id|54e2df1d-4cc4e441-2df125a0-63027b8c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:29.475577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:29.527759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895228657806158:7153]
2025-09-30T14:52:29.528030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 837, pipe: [1:7555895228657806158:7153]
2025-09-30T14:52:29.573663Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:29.574305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:29.574318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:29.574349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895228657806158:7153], now have 1 active actors on pipe
2025-09-30T14:52:29.574531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:29.574549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:29.574551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895228657806158:7153]
2025-09-30T14:52:29.574579Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:29.574641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 838 reason: error at write: Disconnected sessionId: src_id|54e2df1d-4cc4e441-2df125a0-63027b8c_0
2025-09-30T14:52:29.574725Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:29.574806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 838 sessionId: src_id|54e2df1d-4cc4e441-2df125a0-63027b8c_0 is DEAD
2025-09-30T14:52:29.574929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54e2df1d-4cc4e441-2df125a0-63027b8c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:29.574937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54e2df1d-4cc4e441-2df125a0-63027b8c_0] Write session will restart in 0.005286s
2025-09-30T14:52:29.574954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54e2df1d-4cc4e441-2df125a0-63027b8c_0] Write session: Do CDS request
2025-09-30T14:52:29.574958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54e2df1d-4cc4e441-2df125a0-63027b8c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:29.581729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54e2df1d-4cc4e441-2df125a0-63027b8c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:29.581810Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:29.581826Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 839
2025-09-30T14:52:29.581982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 839 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:29.582014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 839 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:29.582019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=839 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:29.582022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:29.582455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 839 sessionId:  describe result for acl check
2025-09-30T14:52:29.582492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:29.582499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:29.582501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:29.582505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895228657806177:7363] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:29.583005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895228657806177:7363] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:29.585104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895228657806177:7363] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:29.587217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895228657806177:7363] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:29.587230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895228657806177:7363] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:29.587233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895228657806177:7363] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:29.587240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 839 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:29.591814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:29.592385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:29.592568Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:29.592578Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:29.592589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:29.592638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:29.592677Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895228568076464:6012]
2025-09-30T14:52:29.593153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:29.593511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:29.593565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:29.593818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:29.593860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:29.593865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:29.593866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:29.593867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:29.593867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:29.593868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:29.593869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:29.593870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:29.593871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:29.593871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:29.593872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.593873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.593873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.593875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:29.593875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:29.593879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:29.593885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:29.593888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:29.593891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:29.593893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:29.593895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:29.593898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:29.593900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:29.593903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:29.593905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:29.593907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.593910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.593912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.593914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:29.593916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:29.593931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:29.593937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:29.593941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:29.593945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:29.593948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:29.593952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:29.593954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:29.593957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:29.593960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:29.593963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:29.593966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:29.593968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:29.593971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:29.593974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:29.593979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:29.593982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:29.593985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:29.593988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:29.593990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:29.593993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:29.593996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.593999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.594001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.594004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.594008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.594011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.594013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:29.594016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:29.594018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:29.594021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:29.594046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:29.599465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:29.600628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:29.600645Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:29.600647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:29.600651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:29.600658Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 838 [2:7555895228568076464:6012]
2025-09-30T14:52:29.600672Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:29.600686Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:29.600694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:29.600697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:29.600699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:29.600713Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:29.600724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:29.600730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:29.600790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.600798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.600800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.600804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:29.600806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:29.600871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:29.600879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.600890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.600907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.600931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:29.600948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895228657806322:7363], now have 1 active actors on pipe
2025-09-30T14:52:29.600951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895228657806159:2454], now have 1 active actors on pipe
2025-09-30T14:52:29.600957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895228568076459:6012]
2025-09-30T14:52:29.600965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895228568076459:6012]
2025-09-30T14:52:29.600969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895228568076459:6012]
2025-09-30T14:52:29.600980Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:29.600996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:29.601002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:29.601011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:29.601012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:29.601014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:29.601015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:29.601041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895228568076459:6012]
2025-09-30T14:52:29.601053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:29.601070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:29.601048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 838
2025-09-30T14:52:29.601048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 838
2025-09-30T14:52:29.601099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:29.601108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:29.601130Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d2dac0c5-54b5141e-fe609df1-3b4f64f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:29.601136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:29.601140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:29.601142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:29.601150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:29.601163Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:29.601175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:29.601330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:29.601338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:29.601351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:29.601439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 839 partition: 0 MaxSeqNo: 42 sessionId: src_id|d2dac0c5-54b5141e-fe609df1-3b4f64f7_0
2025-09-30T14:52:29.601791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54e2df1d-4cc4e441-2df125a0-63027b8c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d2dac0c5-54b5141e-fe609df1-3b4f64f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:29.604548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2dac0c5-54b5141e-fe609df1-3b4f64f7_0] Write session: try to update token
2025-09-30T14:52:29.604569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2dac0c5-54b5141e-fe609df1-3b4f64f7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:29.613739Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:29.613758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:29.613768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895228568076459:6012]
2025-09-30T14:52:29.613810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:29.613816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:29.613994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:29.614133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:29.614268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:29.614420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:29.614631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:29.614671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:29.618443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 839 sessionId: src_id|d2dac0c5-54b5141e-fe609df1-3b4f64f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:29.620974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:29.621195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:29.621217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:29.621253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:29.621336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:29.624300Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:29.624316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:29.624318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:29.624320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:29.624330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895228568076459:6012]
2025-09-30T14:52:29.624334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895228568076459:6012]
2025-09-30T14:52:29.624338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895228568076459:6012]
2025-09-30T14:52:29.624375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:29.624382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.624389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:29.624390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:29.624396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:29.624401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:29.624522Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:29.674689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895228657806336:7153]
2025-09-30T14:52:29.675030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 838, pipe: [1:7555895228657806336:7153]
2025-09-30T14:52:29.729035Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:29.736460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:29.736483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:29.736639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:29.736705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:29.736767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:29.736831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:29.736877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:29.736888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:29.736953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:29.737014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:29.737080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:29.737149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:29.737191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:29.737198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:29.737265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:29.737329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:29.737391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:29.737453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:29.737495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:29.737502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:29.737568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:29.737630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:29.737699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:29.737760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:29.737804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:29.737811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:29.737878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:29.737938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:29.737999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:29.738060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:29.738102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:29.738109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:29.738177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:29.738241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:29.738315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:29.738380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:29.738422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:29.738429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:29.738493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:29.738549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:29.738618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:29.738682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:29.738723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:29.738734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:29.738801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:29.738865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:29.738922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:29.738995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:29.739040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:29.739047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:29.739114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:29.739178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:29.739258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:29.739317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:29.739364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:29.739371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:29.739436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:29.739496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:29.739561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:29.739624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:29.739665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:29.739672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:29.739718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895228657806336:7153], now have 1 active actors on pipe
2025-09-30T14:52:29.739904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895228657806336:7153]
2025-09-30T14:52:29.739907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:29.739911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:29.739934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:29.739936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 839 reason: error at write: Disconnected sessionId: src_id|d2dac0c5-54b5141e-fe609df1-3b4f64f7_0
2025-09-30T14:52:29.740089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 839 sessionId: src_id|d2dac0c5-54b5141e-fe609df1-3b4f64f7_0 is DEAD
2025-09-30T14:52:29.740218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2dac0c5-54b5141e-fe609df1-3b4f64f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:29.740229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2dac0c5-54b5141e-fe609df1-3b4f64f7_0] Write session will restart in 0.006720s
2025-09-30T14:52:29.740250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2dac0c5-54b5141e-fe609df1-3b4f64f7_0] Write session: Do CDS request
2025-09-30T14:52:29.740255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2dac0c5-54b5141e-fe609df1-3b4f64f7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:29.740763Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:29.747679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2dac0c5-54b5141e-fe609df1-3b4f64f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:29.747762Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:29.747776Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 840
2025-09-30T14:52:29.748208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 840 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:29.748237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 840 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:29.748246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=840 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:29.748249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:29.748647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 840 sessionId:  describe result for acl check
2025-09-30T14:52:29.748674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:29.748676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:29.748678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:29.748684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895228657806394:7374] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:29.749171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895228657806394:7374] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:29.751438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895228657806394:7374] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:29.754307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895228657806394:7374] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:29.754321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895228657806394:7374] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:29.754325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895228657806394:7374] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:29.754333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 840 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:29.754400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:29.758542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:29.758744Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:29.758753Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:29.758764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:29.758814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:29.758850Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895228568076670:6022]
2025-09-30T14:52:29.759626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:29.759926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:29.759964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:29.760276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:29.760328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:29.760334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:29.760336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:29.760337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:29.760339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:29.760340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:29.760341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:29.760343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:29.760344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:29.760345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:29.760347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.760348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.760349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.760351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:29.760352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:29.760357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:29.760368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:29.760373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:29.760378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:29.760382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:29.760387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:29.760391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:29.760396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:29.760400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:29.760405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:29.760410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.760414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.760419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.760423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:29.760428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:29.760435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:29.760443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:29.760449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:29.760455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:29.760460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:29.760465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:29.760476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:29.760482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:29.760492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:29.760499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:29.760508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:29.760513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:29.760522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:29.760528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:29.760537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:29.760543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:29.760552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:29.760558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:29.760567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:29.760573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:29.760577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.760583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.760587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.760593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.760598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.760604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.760609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:29.760615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:29.760625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:29.760631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:29.760684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:29.766083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:29.767314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:29.767329Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:29.767332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:29.767335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:29.767342Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 839 [2:7555895228568076670:6022]
2025-09-30T14:52:29.767357Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:29.767371Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:29.767374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:29.767377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:29.767379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:29.767393Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:29.767402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:29.767408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:29.767457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.767463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.767464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.767467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:29.767469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:29.767521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:29.767526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.767534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.767540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.767550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:29.767562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895228568076664:6022]
2025-09-30T14:52:29.767567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895228568076664:6022]
2025-09-30T14:52:29.767569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895228568076664:6022]
2025-09-30T14:52:29.767574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:29.767585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895228657806361:2454], now have 1 active actors on pipe
2025-09-30T14:52:29.767586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:29.767590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:29.767592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:29.767592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895228657806524:7374], now have 1 active actors on pipe
2025-09-30T14:52:29.767599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:29.767607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:29.767609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:29.767633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895228568076664:6022]
2025-09-30T14:52:29.767638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:29.767643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:29.767700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 839
2025-09-30T14:52:29.767708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 839
2025-09-30T14:52:29.767770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:29.767777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:29.767796Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|793e2e03-3469a6e3-416b4c57-8a5229db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:29.767804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:29.767806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:29.767808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:29.767814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:29.767820Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:29.767829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:29.767947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:29.767952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:29.767961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:29.768031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 840 partition: 0 MaxSeqNo: 42 sessionId: src_id|793e2e03-3469a6e3-416b4c57-8a5229db_0
2025-09-30T14:52:29.768356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2dac0c5-54b5141e-fe609df1-3b4f64f7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|793e2e03-3469a6e3-416b4c57-8a5229db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:29.770927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|793e2e03-3469a6e3-416b4c57-8a5229db_0] Write session: try to update token
2025-09-30T14:52:29.770942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|793e2e03-3469a6e3-416b4c57-8a5229db_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:29.779056Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:29.779073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:29.779080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895228568076664:6022]
2025-09-30T14:52:29.779115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:29.779125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:29.779292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:29.779427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:29.779554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:29.779675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:29.779845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:29.779877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:29.783786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 840 sessionId: src_id|793e2e03-3469a6e3-416b4c57-8a5229db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:29.786187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:29.786387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:29.786403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:29.786437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:29.786524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:29.789374Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:29.789386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:29.789388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:29.789389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:29.789397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895228568076664:6022]
2025-09-30T14:52:29.789401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895228568076664:6022]
2025-09-30T14:52:29.789404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895228568076664:6022]
2025-09-30T14:52:29.789432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:29.789437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.789443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:29.789460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:29.789473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:29.789477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:29.789561Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:29.840078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895228657806537:7153]
2025-09-30T14:52:29.840421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 839, pipe: [1:7555895228657806537:7153]
2025-09-30T14:52:29.897508Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:29.905505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:29.905535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:29.905713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:29.905782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:29.905849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:29.905923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:29.905972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:29.905983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:29.906053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:29.906117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:29.906184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:29.906255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:29.906311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:29.906321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:29.906389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:29.906448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:29.906519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:29.906590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:29.906636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:29.906644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:29.906716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:29.906783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:29.906850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:29.906917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:29.906962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:29.906969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:29.907034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:29.907099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:29.907162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:29.907225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:29.907292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:29.907295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:29.907363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:29.907430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:29.907497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:29.907562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:29.907606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:29.907614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:29.907678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:29.907741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:29.907811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:29.907876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:29.907922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:29.907930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:29.907999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:29.908061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:29.908127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:29.908190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:29.908238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:29.908246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:29.908313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:29.908376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:29.908448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:29.908517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:29.908563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:29.908570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:29.908639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:29.908701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:29.908770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:29.908833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:29.908879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:29.908886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:29.908948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895228657806537:7153], now have 1 active actors on pipe
2025-09-30T14:52:29.909147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:29.909174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:29.909178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:29.909208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895228657806537:7153]
2025-09-30T14:52:29.909210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 840 reason: error at write: Disconnected sessionId: src_id|793e2e03-3469a6e3-416b4c57-8a5229db_0
2025-09-30T14:52:29.909366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 840 sessionId: src_id|793e2e03-3469a6e3-416b4c57-8a5229db_0 is DEAD
2025-09-30T14:52:29.909515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|793e2e03-3469a6e3-416b4c57-8a5229db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:29.909524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|793e2e03-3469a6e3-416b4c57-8a5229db_0] Write session will restart in 0.008583s
2025-09-30T14:52:29.909548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|793e2e03-3469a6e3-416b4c57-8a5229db_0] Write session: Do CDS request
2025-09-30T14:52:29.909553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|793e2e03-3469a6e3-416b4c57-8a5229db_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:29.910241Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:29.919707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|793e2e03-3469a6e3-416b4c57-8a5229db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:29.919756Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:29.919776Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 841
2025-09-30T14:52:29.919923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 841 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:29.919954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 841 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:29.919966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=841 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:29.919969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:29.920502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 841 sessionId:  describe result for acl check
2025-09-30T14:52:29.920541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:29.920548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:29.920550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:29.920555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895228657806614:7378] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:29.921110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895228657806614:7378] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:29.923731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895228657806614:7378] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:29.924638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:29.928193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:29.928380Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:29.928390Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:29.928399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:29.928378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895228657806614:7378] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:29.928392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895228657806614:7378] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:29.928395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895228657806614:7378] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:29.928402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 841 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:29.928444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:29.928483Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895228568076840:6028]
2025-09-30T14:52:29.928974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:29.929231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:29.929263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:29.929483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:29.929522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:29.929527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:29.929528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:29.929529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:29.929530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:29.929530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:29.929531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:29.929532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:29.929532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:29.929533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:29.929534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.929534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.929535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.929536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:29.929536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:29.929540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:29.929546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:29.929548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:29.929551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:29.929553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:29.929556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:29.929558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:29.929560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:29.929562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:29.929565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:29.929567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.929569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.929572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.929574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:29.929576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:29.929581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:29.929587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:29.929591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:29.929595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:29.929598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:29.929601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:29.929604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:29.929607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:29.929609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:29.929612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:29.929615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:29.929618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:29.929620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:29.929624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:29.929626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:29.929629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:29.929632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:29.929635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:29.929637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:29.929640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:29.929643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.929646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.929649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.929652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.929655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.929658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.929660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:29.929664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:29.929667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:29.929670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:29.929693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:29.934670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:29.935542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:29.935560Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:29.935563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:29.935568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:29.935574Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 840 [2:7555895228568076840:6028]
2025-09-30T14:52:29.935589Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:29.935603Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:29.935610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:29.935613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:29.935615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:29.935631Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:29.935643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:29.935654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:29.935715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.935724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.935726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.935730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:29.935733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:29.935796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:29.935803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.935815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:29.935832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:29.935855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:29.935876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895228657806539:2454], now have 1 active actors on pipe
2025-09-30T14:52:29.935884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895228657806706:7378], now have 1 active actors on pipe
2025-09-30T14:52:29.935890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895228568076835:6028]
2025-09-30T14:52:29.935892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895228568076835:6028]
2025-09-30T14:52:29.935894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895228568076835:6028]
2025-09-30T14:52:29.935907Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:29.935920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:29.935928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:29.935931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:29.935932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:29.935939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:29.935942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:29.935921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 840
2025-09-30T14:52:29.935923Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 840
2025-09-30T14:52:29.935968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895228568076835:6028]
2025-09-30T14:52:29.935979Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:29.935983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:29.935998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:29.936007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:29.936056Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f374ebf-f56ffd1-9ab30e36-22888ace_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:29.936067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:29.936075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:29.936077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:29.936086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:29.936099Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:29.936119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:29.936266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:29.936276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:29.936290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:29.936372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 841 partition: 0 MaxSeqNo: 42 sessionId: src_id|2f374ebf-f56ffd1-9ab30e36-22888ace_0
2025-09-30T14:52:29.936714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|793e2e03-3469a6e3-416b4c57-8a5229db_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2f374ebf-f56ffd1-9ab30e36-22888ace_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:29.939152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f374ebf-f56ffd1-9ab30e36-22888ace_0] Write session: try to update token
2025-09-30T14:52:29.939171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f374ebf-f56ffd1-9ab30e36-22888ace_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:29.947203Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:29.947220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:29.947222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:29.947224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:29.947232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895228568076835:6028]
2025-09-30T14:52:29.947239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895228568076835:6028]
2025-09-30T14:52:29.947259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895228568076835:6028]
2025-09-30T14:52:29.947292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:29.947302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:29.947303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:29.947303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:29.947309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:29.947313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:29.947423Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:29.952431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 841 sessionId: src_id|2f374ebf-f56ffd1-9ab30e36-22888ace_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:29.954935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:30.009504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895232952774021:7153]
2025-09-30T14:52:30.009836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 840, pipe: [1:7555895232952774021:7153]
2025-09-30T14:52:30.051960Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:30.052627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:30.052639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:30.052671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895232952774021:7153], now have 1 active actors on pipe
2025-09-30T14:52:30.052894Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:30.053016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:30.053100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 841 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2f374ebf-f56ffd1-9ab30e36-22888ace_0
2025-09-30T14:52:30.053190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:30.053245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895232952774021:7153]
2025-09-30T14:52:30.053285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 841 sessionId: src_id|2f374ebf-f56ffd1-9ab30e36-22888ace_0 is DEAD
2025-09-30T14:52:30.053449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f374ebf-f56ffd1-9ab30e36-22888ace_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:30.053460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f374ebf-f56ffd1-9ab30e36-22888ace_0] Write session will restart in 0.005897s
2025-09-30T14:52:30.053484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f374ebf-f56ffd1-9ab30e36-22888ace_0] Write session: Do CDS request
2025-09-30T14:52:30.053490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f374ebf-f56ffd1-9ab30e36-22888ace_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:30.060742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f374ebf-f56ffd1-9ab30e36-22888ace_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:30.060857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:30.060872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 842
2025-09-30T14:52:30.061004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 842 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:30.061036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 842 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:30.061045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=842 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:30.061050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:30.061520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 842 sessionId:  describe result for acl check
2025-09-30T14:52:30.061555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:30.061556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:30.061557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:30.061561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895232952774065:7385] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:30.062110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895232952774065:7385] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:30.064262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895232952774065:7385] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:30.066343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:30.066386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895232952774065:7385] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:30.066400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895232952774065:7385] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:30.066404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895232952774065:7385] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:30.066413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 842 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:30.070251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:30.070467Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:30.070475Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:30.070484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:30.070527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:30.070559Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895232863044319:6031]
2025-09-30T14:52:30.070997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:30.071235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:30.071297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:30.071568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:30.071644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:30.071651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:30.071652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:30.071653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:30.071654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:30.071656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:30.071657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:30.071659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:30.071660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:30.071661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:30.071663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.071664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.071665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.071667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:30.071668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:30.071673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:30.071681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:30.071684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:30.071687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:30.071689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:30.071692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:30.071695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:30.071697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:30.071700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:30.071703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:30.071705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.071707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.071710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.071712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:30.071714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:30.071720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:30.071725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:30.071729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:30.071733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:30.071736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:30.071739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:30.071742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:30.071745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:30.071747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:30.071751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:30.071753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:30.071756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:30.071761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:30.071764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:30.071767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:30.071770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:30.071774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:30.071776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:30.071779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:30.071782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:30.071785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.071788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.071790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.071793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.071796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.071798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.071801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:30.071804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:30.071807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:30.071810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:30.071834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:30.076951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:30.077830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:30.077845Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:30.077847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:30.077850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:30.077856Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 841 [2:7555895232863044319:6031]
2025-09-30T14:52:30.077869Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:30.077880Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:30.077882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:30.077885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:30.077886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:30.077900Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:30.077907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:30.077914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:30.077964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.077970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.077972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.077974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:30.077976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:30.078029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:30.078035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.078044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.078052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.078061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:30.078073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895232863044313:6031]
2025-09-30T14:52:30.078074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895232863044313:6031]
2025-09-30T14:52:30.078079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895232863044313:6031]
2025-09-30T14:52:30.078088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:30.078101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:30.078111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:30.078115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:30.078117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:30.078118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:30.078120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:30.078128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895232952774034:2454], now have 1 active actors on pipe
2025-09-30T14:52:30.078132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895232952774201:7385], now have 1 active actors on pipe
2025-09-30T14:52:30.078181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895232863044313:6031]
2025-09-30T14:52:30.078196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:30.078220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:30.078227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 841
2025-09-30T14:52:30.078230Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 841
2025-09-30T14:52:30.078311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:30.078320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:30.078342Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24d34c05-dec1756e-88542aed-2ab9482c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:30.078352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:30.078355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:30.078357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:30.078365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:30.078378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:30.078392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:30.078562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:30.078580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:30.078616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:30.078711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 842 partition: 0 MaxSeqNo: 42 sessionId: src_id|24d34c05-dec1756e-88542aed-2ab9482c_0
2025-09-30T14:52:30.079055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f374ebf-f56ffd1-9ab30e36-22888ace_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|24d34c05-dec1756e-88542aed-2ab9482c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:30.081870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24d34c05-dec1756e-88542aed-2ab9482c_0] Write session: try to update token
2025-09-30T14:52:30.081893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24d34c05-dec1756e-88542aed-2ab9482c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:30.090369Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:30.090392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:30.090395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:30.090397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:30.090406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895232863044313:6031]
2025-09-30T14:52:30.090411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895232863044313:6031]
2025-09-30T14:52:30.090415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895232863044313:6031]
2025-09-30T14:52:30.090461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:30.090467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.090470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:30.090527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:30.090541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:30.090545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:30.090613Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:30.096391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 842 sessionId: src_id|24d34c05-dec1756e-88542aed-2ab9482c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:30.098882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:30.153357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895232952774217:7153]
2025-09-30T14:52:30.153590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 841, pipe: [1:7555895232952774217:7153]
2025-09-30T14:52:30.195619Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:30.195959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:30.195975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:30.196017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895232952774217:7153], now have 1 active actors on pipe
2025-09-30T14:52:30.196242Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:30.196261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:30.196275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895232952774217:7153]
2025-09-30T14:52:30.196295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:30.196380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 842 reason: status is not ok: tablet will be restarted right now sessionId: src_id|24d34c05-dec1756e-88542aed-2ab9482c_0
2025-09-30T14:52:30.196538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 842 sessionId: src_id|24d34c05-dec1756e-88542aed-2ab9482c_0 is DEAD
2025-09-30T14:52:30.196657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24d34c05-dec1756e-88542aed-2ab9482c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:30.196666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24d34c05-dec1756e-88542aed-2ab9482c_0] Write session will restart in 0.006637s
2025-09-30T14:52:30.196684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24d34c05-dec1756e-88542aed-2ab9482c_0] Write session: Do CDS request
2025-09-30T14:52:30.196689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24d34c05-dec1756e-88542aed-2ab9482c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:30.204709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24d34c05-dec1756e-88542aed-2ab9482c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:30.204831Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:30.204845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 843
2025-09-30T14:52:30.204972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 843 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:30.204997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 843 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:30.205005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=843 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:30.205010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:30.205331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 843 sessionId:  describe result for acl check
2025-09-30T14:52:30.205356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:30.205360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:30.205362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:30.205366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895232952774247:7389] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:30.205774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895232952774247:7389] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:30.208345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895232952774247:7389] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:30.210482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895232952774247:7389] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:30.210497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895232952774247:7389] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:30.210500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895232952774247:7389] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:30.210508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 843 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:30.210577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:30.214721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:30.214905Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:30.214916Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:30.214927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:30.214976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:30.215008Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895232863044494:6034]
2025-09-30T14:52:30.215492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:30.215832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:30.215872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:30.216126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:30.216173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:30.216178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:30.216179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:30.216180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:30.216181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:30.216182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:30.216183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:30.216184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:30.216185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:30.216185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:30.216186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.216187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.216187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.216188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:30.216189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:30.216193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:30.216199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:30.216202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:30.216205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:30.216208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:30.216211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:30.216213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:30.216216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:30.216218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:30.216221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:30.216224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.216226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.216228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.216230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:30.216233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:30.216239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:30.216243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:30.216247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:30.216251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:30.216254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:30.216257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:30.216259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:30.216262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:30.216265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:30.216268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:30.216270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:30.216273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:30.216276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:30.216280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:30.216284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:30.216288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:30.216291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:30.216294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:30.216297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:30.216300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:30.216303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.216306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.216308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.216311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.216314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.216317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.216319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:30.216323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:30.216326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:30.216329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:30.216354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:30.221940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:30.222896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:30.222912Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:30.222915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:30.222920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:30.222928Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 842 [2:7555895232863044494:6034]
2025-09-30T14:52:30.222945Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:30.222961Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:30.222969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:30.222972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:30.222974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:30.222991Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:30.223002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:30.223009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:30.223073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.223081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.223083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.223087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:30.223090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:30.223155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:30.223163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.223176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.223188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.223206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:30.223227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895232863044488:6034]
2025-09-30T14:52:30.223234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895232863044488:6034]
2025-09-30T14:52:30.223236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895232863044488:6034]
2025-09-30T14:52:30.223272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:30.223280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:30.223282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:30.223304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:30.223323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895232952774218:2454], now have 1 active actors on pipe
2025-09-30T14:52:30.223332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895232952774386:7389], now have 1 active actors on pipe
2025-09-30T14:52:30.223339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:30.223354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:30.223358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:30.223408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895232863044488:6034]
2025-09-30T14:52:30.223382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 842
2025-09-30T14:52:30.223423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:30.223392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 842
2025-09-30T14:52:30.223437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:30.223477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:30.223487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:30.223513Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33797349-2f6eab18-3d7d8996-5b2210f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:30.223524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:30.223528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:30.223530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:30.223540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:30.223549Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:30.223562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:30.223747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:30.223761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:30.223786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:30.223922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 843 partition: 0 MaxSeqNo: 42 sessionId: src_id|33797349-2f6eab18-3d7d8996-5b2210f5_0
2025-09-30T14:52:30.224254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24d34c05-dec1756e-88542aed-2ab9482c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|33797349-2f6eab18-3d7d8996-5b2210f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:30.226929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33797349-2f6eab18-3d7d8996-5b2210f5_0] Write session: try to update token
2025-09-30T14:52:30.226954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33797349-2f6eab18-3d7d8996-5b2210f5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:30.235314Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:30.235334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:30.235344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895232863044488:6034]
2025-09-30T14:52:30.235389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:30.235398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:30.235584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:30.235734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:30.235878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:30.236016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:30.236201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:30.236242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:30.240133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 843 sessionId: src_id|33797349-2f6eab18-3d7d8996-5b2210f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:30.242868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:30.243083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:30.243108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:30.243182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:30.243312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:30.246526Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:30.246545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:30.246549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:30.246552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:30.246564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895232863044488:6034]
2025-09-30T14:52:30.246570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895232863044488:6034]
2025-09-30T14:52:30.246576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895232863044488:6034]
2025-09-30T14:52:30.246637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:30.246653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.246653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:30.246657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:30.246664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:30.246668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:30.246818Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:30.296273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895232952774398:7153]
2025-09-30T14:52:30.296643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 842, pipe: [1:7555895232952774398:7153]
2025-09-30T14:52:30.360238Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:30.370593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:30.370623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:30.370822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:30.370898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:30.370984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:30.371060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:30.371118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:30.371127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:30.371202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:30.371286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:30.371356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:30.371426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:30.371482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:30.371489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:30.371569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:30.371638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:30.371709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:30.371781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:30.371837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:30.371844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:30.371920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:30.371993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:30.372065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:30.372138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:30.372192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:30.372199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:30.372287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:30.372369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:30.372443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:30.372515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:30.372571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:30.372585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:30.372660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:30.372729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:30.372802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:30.372874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:30.372929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:30.372940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:30.373015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:30.373084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:30.373157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:30.373228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:30.373289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:30.373296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:30.373371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:30.373437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:30.373509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:30.373580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:30.373637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:30.373644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:30.373716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:30.373782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:30.373851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:30.373918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:30.373973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:30.373980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:30.374054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:30.374124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:30.374194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:30.374266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:30.374339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:30.374347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:30.374413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895232952774398:7153], now have 1 active actors on pipe
2025-09-30T14:52:30.374630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:30.374669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:30.374672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:30.374680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895232952774398:7153]
2025-09-30T14:52:30.374701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 843 reason: error at write: Disconnected sessionId: src_id|33797349-2f6eab18-3d7d8996-5b2210f5_0
2025-09-30T14:52:30.374858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 843 sessionId: src_id|33797349-2f6eab18-3d7d8996-5b2210f5_0 is DEAD
2025-09-30T14:52:30.375013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33797349-2f6eab18-3d7d8996-5b2210f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:30.375023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33797349-2f6eab18-3d7d8996-5b2210f5_0] Write session will restart in 0.007282s
2025-09-30T14:52:30.375042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33797349-2f6eab18-3d7d8996-5b2210f5_0] Write session: Do CDS request
2025-09-30T14:52:30.375046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33797349-2f6eab18-3d7d8996-5b2210f5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:30.376114Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:30.383671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33797349-2f6eab18-3d7d8996-5b2210f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:30.383846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:30.383861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 844
2025-09-30T14:52:30.383981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 844 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:30.384007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 844 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:30.384022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=844 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:30.384028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:30.384352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 844 sessionId:  describe result for acl check
2025-09-30T14:52:30.384376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:30.384381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:30.384382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:30.384386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895232952774431:7393] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:30.384783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895232952774431:7393] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:30.387016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895232952774431:7393] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:30.389573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895232952774431:7393] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:30.389589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895232952774431:7393] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:30.389601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895232952774431:7393] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:30.389616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 844 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:30.394079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:30.394698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:30.394902Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:30.394914Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:30.394927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:30.394985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:30.395035Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895232863044668:6036]
2025-09-30T14:52:30.395826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:30.396194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:30.396250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:30.396580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:30.396631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:30.396641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:30.396642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:30.396643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:30.396644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:30.396645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:30.396646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:30.396647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:30.396648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:30.396648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:30.396649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.396650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.396651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.396652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:30.396653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:30.396657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:30.396665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:30.396668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:30.396671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:30.396674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:30.396677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:30.396679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:30.396682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:30.396684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:30.396687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:30.396690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.396692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.396694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.396697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:30.396699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:30.396706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:30.396711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:30.396716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:30.396720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:30.396723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:30.396727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:30.396730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:30.396733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:30.396737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:30.396740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:30.396743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:30.396747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:30.396750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:30.396753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:30.396757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:30.396762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:30.396765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:30.396768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:30.396771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:30.396775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:30.396778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.396781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.396784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.396789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.396791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.396797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.396804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:30.396810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:30.396816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:30.396820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:30.396847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:30.402266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:30.403822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:30.403843Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:30.403847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:30.403851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:30.403860Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 843 [2:7555895232863044668:6036]
2025-09-30T14:52:30.403877Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:30.403896Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:30.403900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:30.403903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:30.403906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:30.403926Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:30.403935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:30.403943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:30.404021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.404031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.404034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.404038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:30.404041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:30.404123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:30.404133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.404146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.404159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.404183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:30.404210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895232952774569:7393], now have 1 active actors on pipe
2025-09-30T14:52:30.404220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895232952774401:2454], now have 1 active actors on pipe
2025-09-30T14:52:30.404228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895232863044663:6036]
2025-09-30T14:52:30.404232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895232863044663:6036]
2025-09-30T14:52:30.404235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895232863044663:6036]
2025-09-30T14:52:30.404251Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:30.404272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:30.404277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:30.404281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:30.404282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:30.404293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:30.404296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:30.404291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 843
2025-09-30T14:52:30.404298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 843
2025-09-30T14:52:30.404329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895232863044663:6036]
2025-09-30T14:52:30.404343Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:30.404351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:30.404366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:30.404382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:30.404454Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58a9be48-ecdac613-9494275-56fb9be7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:30.404470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:30.404474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:30.404477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:30.404489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:30.404499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:30.404520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:30.404849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:30.404862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:30.404879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:30.404989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 844 partition: 0 MaxSeqNo: 42 sessionId: src_id|58a9be48-ecdac613-9494275-56fb9be7_0
2025-09-30T14:52:30.405336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33797349-2f6eab18-3d7d8996-5b2210f5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|58a9be48-ecdac613-9494275-56fb9be7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:30.408046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58a9be48-ecdac613-9494275-56fb9be7_0] Write session: try to update token
2025-09-30T14:52:30.408066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58a9be48-ecdac613-9494275-56fb9be7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:30.416904Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:30.416924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:30.416926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:30.416928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:30.416940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895232863044663:6036]
2025-09-30T14:52:30.416946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895232863044663:6036]
2025-09-30T14:52:30.416952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895232863044663:6036]
2025-09-30T14:52:30.416998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:30.417004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:30.417009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:30.417012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:30.417013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.417017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:30.417185Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:30.422659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 844 sessionId: src_id|58a9be48-ecdac613-9494275-56fb9be7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:30.425342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:30.474958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895232952774582:7153]
2025-09-30T14:52:30.475323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 843, pipe: [1:7555895232952774582:7153]
2025-09-30T14:52:30.529653Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:30.530220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:30.530234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:30.530266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895232952774582:7153], now have 1 active actors on pipe
2025-09-30T14:52:30.530487Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:30.530552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:30.530567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:30.530579Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:30.530629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895232952774582:7153]
2025-09-30T14:52:30.530641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 844 reason: error at write: Disconnected sessionId: src_id|58a9be48-ecdac613-9494275-56fb9be7_0
2025-09-30T14:52:30.530799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 844 sessionId: src_id|58a9be48-ecdac613-9494275-56fb9be7_0 is DEAD
2025-09-30T14:52:30.530920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58a9be48-ecdac613-9494275-56fb9be7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:30.530931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58a9be48-ecdac613-9494275-56fb9be7_0] Write session will restart in 0.006700s
2025-09-30T14:52:30.530954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58a9be48-ecdac613-9494275-56fb9be7_0] Write session: Do CDS request
2025-09-30T14:52:30.530960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58a9be48-ecdac613-9494275-56fb9be7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:30.538768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58a9be48-ecdac613-9494275-56fb9be7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:30.538870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:30.538891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 845
2025-09-30T14:52:30.539015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 845 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:30.539046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 845 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:30.539056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=845 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:30.539060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:30.539517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 845 sessionId:  describe result for acl check
2025-09-30T14:52:30.539557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:30.539564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:30.539566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:30.539572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895232952774600:7398] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:30.540134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895232952774600:7398] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:30.542741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895232952774600:7398] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:30.545377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895232952774600:7398] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:30.545394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895232952774600:7398] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:30.545398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895232952774600:7398] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:30.545406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 845 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:30.546935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:30.551335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:30.551530Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:30.551541Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:30.551550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:30.551597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:30.551653Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895232863044843:6038]
2025-09-30T14:52:30.552369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:30.552731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:30.552797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:30.553154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:30.553230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:30.553237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:30.553239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:30.553240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:30.553241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:30.553243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:30.553244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:30.553246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:30.553247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:30.553249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:30.553250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.553252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.553253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.553255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:30.553256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:30.553262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:30.553273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:30.553277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:30.553283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:30.553288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:30.553292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:30.553296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:30.553301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:30.553305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:30.553309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:30.553313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.553318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.553322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.553331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:30.553335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:30.553350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:30.553362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:30.553373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:30.553379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:30.553389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:30.553395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:30.553404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:30.553409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:30.553417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:30.553422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:30.553428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:30.553434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:30.553439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:30.553449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:30.553453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:30.553459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:30.553467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:30.553474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:30.553483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:30.553488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:30.553494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.553499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.553504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.553509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.553515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.553519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.553528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:30.553533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:30.553543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:30.553552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:30.553602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:30.559213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:30.560162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:30.560176Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:30.560178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:30.560181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:30.560187Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 844 [2:7555895232863044843:6038]
2025-09-30T14:52:30.560203Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:30.560235Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:30.560243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:30.560246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:30.560249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:30.560265Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:30.560276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:30.560283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:30.560348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.560355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.560357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.560361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:30.560363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:30.560427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:30.560434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.560443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.560454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.560464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:30.560481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895232863044838:6038]
2025-09-30T14:52:30.560486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895232863044838:6038]
2025-09-30T14:52:30.560487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895232863044838:6038]
2025-09-30T14:52:30.560495Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:30.560505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:30.560508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:30.560510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:30.560512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895232952774754:7398], now have 1 active actors on pipe
2025-09-30T14:52:30.560515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895232952774586:2454], now have 1 active actors on pipe
2025-09-30T14:52:30.560520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:30.560535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:30.560543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:30.560574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895232863044838:6038]
2025-09-30T14:52:30.560584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:30.560590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:30.560621Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 844
2025-09-30T14:52:30.560621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 844
2025-09-30T14:52:30.560747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:30.560760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:30.560791Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc626ebc-826c3d8f-b8a08b01-e653240d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:30.560804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:30.560814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:30.560817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:30.560827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:30.560837Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:30.560852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:30.561005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:30.561009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:30.561025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:30.561129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 845 partition: 0 MaxSeqNo: 42 sessionId: src_id|dc626ebc-826c3d8f-b8a08b01-e653240d_0
2025-09-30T14:52:30.561459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58a9be48-ecdac613-9494275-56fb9be7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dc626ebc-826c3d8f-b8a08b01-e653240d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:30.564051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc626ebc-826c3d8f-b8a08b01-e653240d_0] Write session: try to update token
2025-09-30T14:52:30.564069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc626ebc-826c3d8f-b8a08b01-e653240d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:30.572486Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:30.572499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:30.572507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895232863044838:6038]
2025-09-30T14:52:30.572540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:30.572548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:30.572718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:30.572848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:30.572971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:30.573110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:30.573382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:30.573430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:30.577681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 845 sessionId: src_id|dc626ebc-826c3d8f-b8a08b01-e653240d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:30.580348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:30.580526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:30.580548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:30.580593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:30.580664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:30.583387Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:30.583408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:30.583411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:30.583413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:30.583433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895232863044838:6038]
2025-09-30T14:52:30.583437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895232863044838:6038]
2025-09-30T14:52:30.583441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895232863044838:6038]
2025-09-30T14:52:30.583479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:30.583480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:30.583484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:30.583490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:30.583492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.583495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:30.583635Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:30.630587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895232952774768:7153]
2025-09-30T14:52:30.630842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 844, pipe: [1:7555895232952774768:7153]
2025-09-30T14:52:30.694795Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:30.703472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:30.703502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:30.703678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:30.703747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:30.703807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:30.703876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:30.703927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:30.703939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:30.704012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:30.704077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:30.704145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:30.704215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:30.704264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:30.704272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:30.704337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:30.704401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:30.704470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:30.704538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:30.704585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:30.704594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:30.704662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:30.704726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:30.704796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:30.704862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:30.704907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:30.704916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:30.704984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:30.705048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:30.705114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:30.705182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:30.705230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:30.705238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:30.705306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:30.705372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:30.705439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:30.705504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:30.705553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:30.705565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:30.705630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:30.705692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:30.705760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:30.705824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:30.705871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:30.705879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:30.705949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:30.706010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:30.706076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:30.706142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:30.706184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:30.706193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:30.706258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:30.706333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:30.706396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:30.706461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:30.706510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:30.706518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:30.706585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:30.706650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:30.706716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:30.706781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:30.706829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:30.706838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:30.706902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895232952774768:7153], now have 1 active actors on pipe
2025-09-30T14:52:30.707291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895232952774768:7153]
2025-09-30T14:52:30.707293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:30.707297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:30.707329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 845 reason: error at write: Disconnected sessionId: src_id|dc626ebc-826c3d8f-b8a08b01-e653240d_0
2025-09-30T14:52:30.707331Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:30.707498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 845 sessionId: src_id|dc626ebc-826c3d8f-b8a08b01-e653240d_0 is DEAD
2025-09-30T14:52:30.707623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc626ebc-826c3d8f-b8a08b01-e653240d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:30.707632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc626ebc-826c3d8f-b8a08b01-e653240d_0] Write session will restart in 0.005542s
2025-09-30T14:52:30.707649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc626ebc-826c3d8f-b8a08b01-e653240d_0] Write session: Do CDS request
2025-09-30T14:52:30.707653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc626ebc-826c3d8f-b8a08b01-e653240d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:30.708208Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:30.714705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc626ebc-826c3d8f-b8a08b01-e653240d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:30.714845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:30.714861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 846
2025-09-30T14:52:30.715029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 846 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:30.715067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 846 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:30.715077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=846 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:30.715081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:30.715539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 846 sessionId:  describe result for acl check
2025-09-30T14:52:30.715586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:30.715594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:30.715596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:30.715602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895232952774785:7402] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:30.716233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895232952774785:7402] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:30.718732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895232952774785:7402] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:30.721861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895232952774785:7402] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:30.721879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895232952774785:7402] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:30.721883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895232952774785:7402] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:30.721891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 846 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:30.723777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:30.727211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:30.727423Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:30.727433Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:30.727444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:30.727497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:30.727535Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895232863045021:6041]
2025-09-30T14:52:30.728234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:30.728500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:30.728541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:30.728877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:30.728935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:30.728943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:30.728944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:30.728945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:30.728946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:30.728947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:30.728949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:30.728950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:30.728952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:30.728953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:30.728955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.728956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.728957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.728958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:30.728959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:30.728965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:30.728976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:30.728981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:30.728985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:30.728989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:30.728994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:30.728999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:30.729003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:30.729008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:30.729012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:30.729017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.729022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.729026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.729031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:30.729035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:30.729049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:30.729062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:30.729072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:30.729082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:30.729087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:30.729097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:30.729102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:30.729108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:30.729118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:30.729129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:30.729138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:30.729144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:30.729149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:30.729155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:30.729165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:30.729175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:30.729185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:30.729191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:30.729201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:30.729207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:30.729212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.729223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.729232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.729243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.729252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.729259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.729268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:30.729274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:30.729283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:30.729292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:30.729343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:30.734244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:30.735400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:30.735416Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:30.735419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:30.735423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:30.735430Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 845 [2:7555895232863045021:6041]
2025-09-30T14:52:30.735445Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:30.735459Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:30.735462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:30.735465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:30.735468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:30.735481Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:30.735488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:30.735495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:30.735553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.735562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.735564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.735568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:30.735571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:30.735631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:30.735641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.735654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.735667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.735690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:30.735713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895232952774940:7402], now have 1 active actors on pipe
2025-09-30T14:52:30.735725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895232952774770:2454], now have 1 active actors on pipe
2025-09-30T14:52:30.735732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895232863045016:6041]
2025-09-30T14:52:30.735735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895232863045016:6041]
2025-09-30T14:52:30.735737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895232863045016:6041]
2025-09-30T14:52:30.735750Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:30.735764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:30.735764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:30.735767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:30.735769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:30.735780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:30.735782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:30.735769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 845
2025-09-30T14:52:30.735774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 845
2025-09-30T14:52:30.735807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895232863045016:6041]
2025-09-30T14:52:30.735820Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:30.735823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:30.735839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:30.735849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:30.735896Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c38a089b-4bb43564-d7aad93e-cd073d94_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:30.735906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:30.735910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:30.735912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:30.735924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:30.735937Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:30.735957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:30.736127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:30.736137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:30.736151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:30.736234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 846 partition: 0 MaxSeqNo: 42 sessionId: src_id|c38a089b-4bb43564-d7aad93e-cd073d94_0
2025-09-30T14:52:30.736575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc626ebc-826c3d8f-b8a08b01-e653240d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c38a089b-4bb43564-d7aad93e-cd073d94_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:30.739399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c38a089b-4bb43564-d7aad93e-cd073d94_0] Write session: try to update token
2025-09-30T14:52:30.739414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c38a089b-4bb43564-d7aad93e-cd073d94_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:30.747419Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:30.747434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:30.747437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:30.747439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:30.747447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895232863045016:6041]
2025-09-30T14:52:30.747452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895232863045016:6041]
2025-09-30T14:52:30.747456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895232863045016:6041]
2025-09-30T14:52:30.747496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:30.747497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:30.747501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:30.747503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.747505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:30.747505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:30.747638Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:30.753746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 846 sessionId: src_id|c38a089b-4bb43564-d7aad93e-cd073d94_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:30.756444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:30.807259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895232952774976:7153]
2025-09-30T14:52:30.807551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 845, pipe: [1:7555895232952774976:7153]
2025-09-30T14:52:30.853269Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:30.853542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:30.853553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:30.853586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895232952774976:7153], now have 1 active actors on pipe
2025-09-30T14:52:30.853843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:30.853866Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:30.853846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895232952774976:7153]
2025-09-30T14:52:30.853859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:30.853873Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:30.853931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 846 reason: error at write: Disconnected sessionId: src_id|c38a089b-4bb43564-d7aad93e-cd073d94_0
2025-09-30T14:52:30.854090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 846 sessionId: src_id|c38a089b-4bb43564-d7aad93e-cd073d94_0 is DEAD
2025-09-30T14:52:30.854221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c38a089b-4bb43564-d7aad93e-cd073d94_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:30.854232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c38a089b-4bb43564-d7aad93e-cd073d94_0] Write session will restart in 0.007309s
2025-09-30T14:52:30.854254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c38a089b-4bb43564-d7aad93e-cd073d94_0] Write session: Do CDS request
2025-09-30T14:52:30.854263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c38a089b-4bb43564-d7aad93e-cd073d94_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:30.862695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c38a089b-4bb43564-d7aad93e-cd073d94_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:30.862846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:30.862860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 847
2025-09-30T14:52:30.862963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 847 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:30.862993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 847 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:30.863001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=847 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:30.863004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:30.863414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 847 sessionId:  describe result for acl check
2025-09-30T14:52:30.863452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:30.863460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:30.863461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:30.863467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895232952775001:7413] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:30.863996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895232952775001:7413] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:30.866437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895232952775001:7413] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:30.868913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895232952775001:7413] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:30.868929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895232952775001:7413] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:30.868932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895232952775001:7413] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:30.868941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 847 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:30.872985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:30.873505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:30.873679Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:30.873690Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:30.873699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:30.873740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:30.873772Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895232863045234:6055]
2025-09-30T14:52:30.874312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:30.874640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:30.874690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:30.875011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:30.875070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:30.875076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:30.875077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:30.875078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:30.875079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:30.875081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:30.875082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:30.875083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:30.875084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:30.875086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:30.875087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.875088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.875089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.875090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:30.875092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:30.875097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:30.875108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:30.875112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:30.875117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:30.875121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:30.875125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:30.875129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:30.875133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:30.875137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:30.875141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:30.875145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.875150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.875154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.875158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:30.875162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:30.875170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:30.875178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:30.875184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:30.875190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:30.875200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:30.875206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:30.875215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:30.875220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:30.875230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:30.875236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:30.875240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:30.875263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:30.875269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:30.875274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:30.875279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:30.875287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:30.875292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:30.875301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:30.875306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:30.875316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:30.875321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.875331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.875334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.875340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.875350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.875355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.875365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:30.875370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:30.875374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:30.875385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:30.875431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:30.880848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:30.881684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:30.881696Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:30.881698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:30.881701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:30.881706Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 846 [2:7555895232863045234:6055]
2025-09-30T14:52:30.881718Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:30.881730Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:30.881732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:30.881734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:30.881735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:30.881748Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:30.881755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:30.881763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:30.881811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.881818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.881819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.881822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:30.881824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:30.881874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:30.881883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.881891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:30.881898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:30.881907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:30.881919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895232863045229:6055]
2025-09-30T14:52:30.881921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895232863045229:6055]
2025-09-30T14:52:30.881923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895232863045229:6055]
2025-09-30T14:52:30.881929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:30.881940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:30.881940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:30.881943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:30.881944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:30.881949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:30.881951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:30.881958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895232952775149:7413], now have 1 active actors on pipe
2025-09-30T14:52:30.881962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895232952774978:2454], now have 1 active actors on pipe
2025-09-30T14:52:30.881985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895232863045229:6055]
2025-09-30T14:52:30.881991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:30.881996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:30.882068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 846
2025-09-30T14:52:30.882079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 846
2025-09-30T14:52:30.882220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:30.882230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:30.882250Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d2e7c195-e8f97312-346a5726-1577ecc2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:30.882261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:30.882264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:30.882266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:30.882275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:30.882295Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:30.882306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:30.882481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:30.882490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:30.882505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:30.882578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 847 partition: 0 MaxSeqNo: 42 sessionId: src_id|d2e7c195-e8f97312-346a5726-1577ecc2_0
2025-09-30T14:52:30.882955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c38a089b-4bb43564-d7aad93e-cd073d94_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d2e7c195-e8f97312-346a5726-1577ecc2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:30.885739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2e7c195-e8f97312-346a5726-1577ecc2_0] Write session: try to update token
2025-09-30T14:52:30.885756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2e7c195-e8f97312-346a5726-1577ecc2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:30.893889Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:30.893907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:30.893916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895232863045229:6055]
2025-09-30T14:52:30.893951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:30.893976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:30.894102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:30.894241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:30.894398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:30.894534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:30.894731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:30.894783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:30.900050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 847 sessionId: src_id|d2e7c195-e8f97312-346a5726-1577ecc2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:30.902782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:30.902954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:30.902975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:30.904153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:30.904184Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:30.904187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:30.904189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:30.904190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:30.904197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895232863045229:6055]
2025-09-30T14:52:30.904199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895232863045229:6055]
2025-09-30T14:52:30.904202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895232863045229:6055]
2025-09-30T14:52:30.904223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:30.904224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:30.904229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:30.904231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:30.904233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:30.904236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:30.904263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:30.904346Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:30.954158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895232952775164:7153]
2025-09-30T14:52:30.954381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 846, pipe: [1:7555895232952775164:7153]
2025-09-30T14:52:31.013346Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:31.021196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:31.021223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:31.021370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:31.021430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:31.021494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:31.021556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:31.021855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:31.021865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:31.021933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:31.021993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:31.022054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:31.022121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:31.022168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:31.022177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:31.022250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:31.022330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:31.022409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:31.022479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:31.022521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:31.022527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:31.022603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:31.022682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:31.022741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:31.022806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:31.022848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:31.022854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:31.022919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:31.022978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:31.023045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:31.023111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:31.023152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:31.023160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:31.023228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:31.023306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:31.023368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:31.023428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:31.023471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:31.023483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:31.023557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:31.023617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:31.023683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:31.023746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:31.023789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:31.023797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:31.023863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:31.023949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:31.024024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:31.024093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:31.024135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:31.024141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:31.024205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:31.024262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:31.024322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:31.024386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:31.024641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:31.024647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:31.024708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:31.024765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:31.024826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:31.024886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:31.024929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:31.024935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:31.024992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895232952775164:7153], now have 1 active actors on pipe
2025-09-30T14:52:31.025243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:31.025246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895232952775164:7153]
2025-09-30T14:52:31.025262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:31.025265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:31.025292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 847 reason: error at write: Disconnected sessionId: src_id|d2e7c195-e8f97312-346a5726-1577ecc2_0
2025-09-30T14:52:31.025414Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:31.025455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 847 sessionId: src_id|d2e7c195-e8f97312-346a5726-1577ecc2_0 is DEAD
2025-09-30T14:52:31.025613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2e7c195-e8f97312-346a5726-1577ecc2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:31.025634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2e7c195-e8f97312-346a5726-1577ecc2_0] Write session will restart in 0.007203s
2025-09-30T14:52:31.025657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2e7c195-e8f97312-346a5726-1577ecc2_0] Write session: Do CDS request
2025-09-30T14:52:31.025663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2e7c195-e8f97312-346a5726-1577ecc2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:31.033762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2e7c195-e8f97312-346a5726-1577ecc2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:31.033866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:31.033882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 848
2025-09-30T14:52:31.034003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 848 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:31.034035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 848 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:31.034040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=848 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:31.034044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:31.034432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 848 sessionId:  describe result for acl check
2025-09-30T14:52:31.034465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:31.034468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:31.034469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:31.034473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895237247742516:7420] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:31.034927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895237247742516:7420] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:31.037491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895237247742516:7420] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:31.039710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895237247742516:7420] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:31.039728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895237247742516:7420] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:31.039731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895237247742516:7420] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:31.039740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 848 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:31.043644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:31.044196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:31.044371Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:31.044381Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:31.044391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:31.044448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:31.044484Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895237158012721:6058]
2025-09-30T14:52:31.045142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:31.045403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:31.045443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:31.045757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:31.045815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:31.045820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:31.045821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:31.045822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:31.045824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:31.045826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:31.045827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:31.045828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:31.045830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:31.045831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:31.045833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.045834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.045835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.045836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:31.045837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:31.045842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:31.045853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:31.045857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:31.045861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:31.045866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:31.045871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:31.045875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:31.045880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:31.045884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:31.045890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:31.045895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.045899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.045904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.045907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:31.045912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:31.045919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:31.045927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:31.045933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:31.045939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:31.045948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:31.045954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:31.045963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:31.045969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:31.045978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:31.045986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:31.045995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:31.046000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:31.046009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:31.046015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:31.046024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:31.046029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:31.046040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:31.046044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:31.046049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:31.046058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:31.046063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.046068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.046072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.046078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.046083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.046089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.046098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:31.046103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:31.046112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:31.046118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:31.046167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:31.051356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:31.052196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:31.052216Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:31.052218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:31.052222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:31.052229Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 847 [2:7555895237158012721:6058]
2025-09-30T14:52:31.052244Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:31.052259Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:31.052267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:31.052270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:31.052273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:31.052287Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:31.052300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:31.052307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:31.052360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.052367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.052369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.052372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:31.052375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:31.052594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 847
2025-09-30T14:52:31.052595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 847
2025-09-30T14:52:31.052826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:31.052836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.052848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.052866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.052888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:31.052911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895237247742657:7420], now have 1 active actors on pipe
2025-09-30T14:52:31.052918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895237247742483:2454], now have 1 active actors on pipe
2025-09-30T14:52:31.052936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:31.052944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:31.052960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895237158012716:6058]
2025-09-30T14:52:31.052966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895237158012716:6058]
2025-09-30T14:52:31.052968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895237158012716:6058]
2025-09-30T14:52:31.052981Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:31.052995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:31.052999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:31.052999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:31.053001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:31.053014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:31.053017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:31.053033Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b0acd5c-c3539f4c-56d5742a-efc6e32b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:31.053043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:31.053048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:31.053054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:31.053064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:31.053078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:31.053112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895237158012716:6058]
2025-09-30T14:52:31.053125Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:31.053139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:31.053156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:31.053347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:31.053358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:31.053377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:31.053474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 848 partition: 0 MaxSeqNo: 42 sessionId: src_id|5b0acd5c-c3539f4c-56d5742a-efc6e32b_0
2025-09-30T14:52:31.053786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2e7c195-e8f97312-346a5726-1577ecc2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5b0acd5c-c3539f4c-56d5742a-efc6e32b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:31.056510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b0acd5c-c3539f4c-56d5742a-efc6e32b_0] Write session: try to update token
2025-09-30T14:52:31.056530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b0acd5c-c3539f4c-56d5742a-efc6e32b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:31.065285Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:31.065303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:31.065312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895237158012716:6058]
2025-09-30T14:52:31.065351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:31.065360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:31.065508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:31.065639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:31.065774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:31.065910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:31.066075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:31.066106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:31.069920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 848 sessionId: src_id|5b0acd5c-c3539f4c-56d5742a-efc6e32b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:31.072620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:31.072923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:31.072942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:31.072970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:31.073046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:31.075619Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:31.075633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:31.075636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:31.075638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:31.075648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895237158012716:6058]
2025-09-30T14:52:31.075651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895237158012716:6058]
2025-09-30T14:52:31.075654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895237158012716:6058]
2025-09-30T14:52:31.075689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:31.075691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:31.075696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.075699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:31.075703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:31.075706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:31.075834Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:31.125199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895237247742673:7153]
2025-09-30T14:52:31.125456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 847, pipe: [1:7555895237247742673:7153]
2025-09-30T14:52:31.181848Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:31.189211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:31.189234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:31.189382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:31.189437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:31.189497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:31.189555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:31.189598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:31.189606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:31.189669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:31.189724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:31.189788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:31.189855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:31.189896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:31.189902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:31.189965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:31.190031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:31.190109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:31.190179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:31.190234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:31.190242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:31.190326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:31.190385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:31.190442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:31.190500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:31.190540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:31.190546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:31.190609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:31.190665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:31.190760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:31.190816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:31.190857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:31.190863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:31.190923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:31.190984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:31.191041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:31.191098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:31.191145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:31.191153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:31.191230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:31.191318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:31.191387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:31.191445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:31.191485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:31.191491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:31.191553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:31.191609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:31.191666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:31.191725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:31.191766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:31.191771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:31.191832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:31.191888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:31.191946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:31.192006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:31.192048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:31.192057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:31.192116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:31.192172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:31.192228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:31.192283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:31.192324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:31.192329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:31.192380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895237247742673:7153], now have 1 active actors on pipe
2025-09-30T14:52:31.192675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895237247742673:7153]
2025-09-30T14:52:31.192683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:31.192687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:31.192715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 848 reason: error at write: Disconnected sessionId: src_id|5b0acd5c-c3539f4c-56d5742a-efc6e32b_0
2025-09-30T14:52:31.192722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:31.192885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 848 sessionId: src_id|5b0acd5c-c3539f4c-56d5742a-efc6e32b_0 is DEAD
2025-09-30T14:52:31.193016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b0acd5c-c3539f4c-56d5742a-efc6e32b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:31.193026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b0acd5c-c3539f4c-56d5742a-efc6e32b_0] Write session will restart in 0.005895s
2025-09-30T14:52:31.193050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b0acd5c-c3539f4c-56d5742a-efc6e32b_0] Write session: Do CDS request
2025-09-30T14:52:31.193056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b0acd5c-c3539f4c-56d5742a-efc6e32b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:31.193243Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:31.199631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b0acd5c-c3539f4c-56d5742a-efc6e32b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:31.199767Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:31.199783Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 849
2025-09-30T14:52:31.199920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 849 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:31.199963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 849 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:31.199968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=849 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:31.199974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:31.200376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 849 sessionId:  describe result for acl check
2025-09-30T14:52:31.200412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:31.200415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:31.200417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:31.200424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895237247742689:7424] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:31.200950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895237247742689:7424] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:31.203274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895237247742689:7424] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:31.206263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895237247742689:7424] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:31.206290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895237247742689:7424] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:31.206294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895237247742689:7424] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:31.206302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 849 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:31.212166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:31.212916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:31.213119Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:31.213129Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:31.213139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:31.213194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:31.213235Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895237158012902:6061]
2025-09-30T14:52:31.213894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:31.214210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:31.214251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:31.214564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:31.214624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:31.214629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:31.214630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:31.214631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:31.214631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:31.214632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:31.214633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:31.214634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:31.214635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:31.214635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:31.214636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.214637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.214638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.214638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:31.214639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:31.214643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:31.214650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:31.214653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:31.214655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:31.214658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:31.214661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:31.214663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:31.214666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:31.214668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:31.214671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:31.214673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.214675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.214678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.214680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:31.214682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:31.214689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:31.214695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:31.214700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:31.214703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:31.214706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:31.214710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:31.214712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:31.214715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:31.214719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:31.214722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:31.214725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:31.214728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:31.214731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:31.214736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:31.214741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:31.214747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:31.214751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:31.214756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:31.214761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:31.214766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:31.214774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.214778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.214783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.214793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.214803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.214808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.214813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:31.214822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:31.214831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:31.214841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:31.214874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:31.220302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:31.221331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:31.221342Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:31.221344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:31.221348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:31.221354Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 848 [2:7555895237158012902:6061]
2025-09-30T14:52:31.221366Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:31.221379Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:31.221381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:31.221383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:31.221385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:31.221396Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:31.221401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:31.221410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:31.221456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.221461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.221462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.221465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:31.221467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:31.221527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:31.221535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.221546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.221556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.221569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:31.221585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895237158012897:6061]
2025-09-30T14:52:31.221593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895237158012897:6061]
2025-09-30T14:52:31.221594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895237158012897:6061]
2025-09-30T14:52:31.221601Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:31.221611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895237247742675:2454], now have 1 active actors on pipe
2025-09-30T14:52:31.221611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:31.221615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:31.221617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895237247742847:7424], now have 1 active actors on pipe
2025-09-30T14:52:31.221617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:31.221621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:31.221629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:31.221631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:31.221664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895237158012897:6061]
2025-09-30T14:52:31.221677Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:31.221689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:31.221717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 848
2025-09-30T14:52:31.221721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 848
2025-09-30T14:52:31.221814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:31.221834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:31.221879Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|afd9cc8-a1e50a7b-5d3ec833-f78cfcf1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:31.221888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:31.221892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:31.221895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:31.221907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:31.221934Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:31.221954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:31.222134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:31.222143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:31.222158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:31.222290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 849 partition: 0 MaxSeqNo: 42 sessionId: src_id|afd9cc8-a1e50a7b-5d3ec833-f78cfcf1_0
2025-09-30T14:52:31.222630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b0acd5c-c3539f4c-56d5742a-efc6e32b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|afd9cc8-a1e50a7b-5d3ec833-f78cfcf1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:31.225400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afd9cc8-a1e50a7b-5d3ec833-f78cfcf1_0] Write session: try to update token
2025-09-30T14:52:31.225421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afd9cc8-a1e50a7b-5d3ec833-f78cfcf1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:31.233652Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:31.233670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:31.233673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:31.233674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:31.233682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895237158012897:6061]
2025-09-30T14:52:31.233685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895237158012897:6061]
2025-09-30T14:52:31.233688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895237158012897:6061]
2025-09-30T14:52:31.233719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:31.233724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.233727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:31.233767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:31.233779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:31.233786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:31.233849Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:31.239127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 849 sessionId: src_id|afd9cc8-a1e50a7b-5d3ec833-f78cfcf1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:31.241526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:31.292611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895237247742861:7153]
2025-09-30T14:52:31.292901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 848, pipe: [1:7555895237247742861:7153]
2025-09-30T14:52:31.338956Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:31.339606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:31.339620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:31.339656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895237247742861:7153], now have 1 active actors on pipe
2025-09-30T14:52:31.339849Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:31.339870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:31.339880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895237247742861:7153]
2025-09-30T14:52:31.339905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:31.339977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 849 reason: status is not ok: tablet will be restarted right now sessionId: src_id|afd9cc8-a1e50a7b-5d3ec833-f78cfcf1_0
2025-09-30T14:52:31.340130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 849 sessionId: src_id|afd9cc8-a1e50a7b-5d3ec833-f78cfcf1_0 is DEAD
2025-09-30T14:52:31.340271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afd9cc8-a1e50a7b-5d3ec833-f78cfcf1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:31.340282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afd9cc8-a1e50a7b-5d3ec833-f78cfcf1_0] Write session will restart in 0.009659s
2025-09-30T14:52:31.340305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afd9cc8-a1e50a7b-5d3ec833-f78cfcf1_0] Write session: Do CDS request
2025-09-30T14:52:31.340311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afd9cc8-a1e50a7b-5d3ec833-f78cfcf1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:31.350787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afd9cc8-a1e50a7b-5d3ec833-f78cfcf1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:31.351054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:31.351071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 850
2025-09-30T14:52:31.351183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 850 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:31.351215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 850 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:31.351225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=850 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:31.351228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:31.351759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 850 sessionId:  describe result for acl check
2025-09-30T14:52:31.351796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:31.351799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:31.351800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:31.351807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895237247742929:7428] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:31.352330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895237247742929:7428] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:31.354677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895237247742929:7428] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:31.356065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:31.360629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:31.360863Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:31.360874Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:31.360885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:31.360904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895237247742929:7428] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:31.360943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:31.360925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895237247742929:7428] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:31.360928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895237247742929:7428] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:31.360938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 850 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:31.360979Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895237158013081:6063]
2025-09-30T14:52:31.361595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:31.361934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:31.361991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:31.362319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:31.362386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:31.362391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:31.362392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:31.362393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:31.362394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:31.362394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:31.362395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:31.362396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:31.362397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:31.362397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:31.362398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.362399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.362400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.362401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:31.362401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:31.362405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:31.362412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:31.362414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:31.362417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:31.362419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:31.362421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:31.362424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:31.362426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:31.362429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:31.362431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:31.362434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.362436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.362438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.362441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:31.362443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:31.362450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:31.362455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:31.362460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:31.362463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:31.362466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:31.362469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:31.362472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:31.362476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:31.362482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:31.362487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:31.362491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:31.362497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:31.362501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:31.362505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:31.362510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:31.362514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:31.362519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:31.362524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:31.362528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:31.362533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:31.362536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.362538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.362541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.362544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.362546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.362549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.362552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:31.362554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:31.362557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:31.362560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:31.362585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:31.367909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:31.368753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:31.368771Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:31.368774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:31.368777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:31.368784Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 849 [2:7555895237158013081:6063]
2025-09-30T14:52:31.368799Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:31.368813Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:31.368816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:31.368818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:31.368821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:31.368835Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:31.368847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:31.368854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:31.368906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.368913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.368915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.368918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:31.368921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:31.368981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:31.368991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.369004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.369015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.369031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:31.369055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895237247742863:2454], now have 1 active actors on pipe
2025-09-30T14:52:31.369058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895237247743039:7428], now have 1 active actors on pipe
2025-09-30T14:52:31.369064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895237158013076:6063]
2025-09-30T14:52:31.369066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895237158013076:6063]
2025-09-30T14:52:31.369069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895237158013076:6063]
2025-09-30T14:52:31.369081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:31.369092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:31.369108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:31.369112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:31.369115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:31.369115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:31.369117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:31.369141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895237158013076:6063]
2025-09-30T14:52:31.369113Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 849
2025-09-30T14:52:31.369148Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:31.369135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 849
2025-09-30T14:52:31.369151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:31.369174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:31.369183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:31.369212Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|960bfafd-f4b26ea1-f4ad8b58-36829ff5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:31.369223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:31.369227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:31.369229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:31.369237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:31.369246Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:31.369269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:31.369400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:31.369408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:31.369421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:31.369488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 850 partition: 0 MaxSeqNo: 42 sessionId: src_id|960bfafd-f4b26ea1-f4ad8b58-36829ff5_0
2025-09-30T14:52:31.369846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afd9cc8-a1e50a7b-5d3ec833-f78cfcf1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|960bfafd-f4b26ea1-f4ad8b58-36829ff5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:31.372700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|960bfafd-f4b26ea1-f4ad8b58-36829ff5_0] Write session: try to update token
2025-09-30T14:52:31.372717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|960bfafd-f4b26ea1-f4ad8b58-36829ff5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:31.381251Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:31.381276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:31.381279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:31.381281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:31.381290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895237158013076:6063]
2025-09-30T14:52:31.381295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895237158013076:6063]
2025-09-30T14:52:31.381299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895237158013076:6063]
2025-09-30T14:52:31.381340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:31.381352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.381355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:31.381365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:31.381379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:31.381383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:31.381496Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:31.385932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 850 sessionId: src_id|960bfafd-f4b26ea1-f4ad8b58-36829ff5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:31.388527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:31.440069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895237247743050:7153]
2025-09-30T14:52:31.440350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 849, pipe: [1:7555895237247743050:7153]
2025-09-30T14:52:31.490541Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:31.491162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:31.491175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:31.491204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895237247743050:7153], now have 1 active actors on pipe
2025-09-30T14:52:31.491383Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:31.491450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:31.491465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:31.491465Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:31.491506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895237247743050:7153]
2025-09-30T14:52:31.491536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 850 reason: error at write: Disconnected sessionId: src_id|960bfafd-f4b26ea1-f4ad8b58-36829ff5_0
2025-09-30T14:52:31.491703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 850 sessionId: src_id|960bfafd-f4b26ea1-f4ad8b58-36829ff5_0 is DEAD
2025-09-30T14:52:31.491854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|960bfafd-f4b26ea1-f4ad8b58-36829ff5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:31.491859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|960bfafd-f4b26ea1-f4ad8b58-36829ff5_0] Write session will restart in 0.008788s
2025-09-30T14:52:31.491876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|960bfafd-f4b26ea1-f4ad8b58-36829ff5_0] Write session: Do CDS request
2025-09-30T14:52:31.491883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|960bfafd-f4b26ea1-f4ad8b58-36829ff5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:31.501749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|960bfafd-f4b26ea1-f4ad8b58-36829ff5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:31.501776Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:31.501807Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 851
2025-09-30T14:52:31.501975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 851 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:31.502008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 851 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:31.502017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=851 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:31.502020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:31.502474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 851 sessionId:  describe result for acl check
2025-09-30T14:52:31.502525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:31.502533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:31.502536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:31.502542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895237247743173:7433] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:31.503070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895237247743173:7433] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:31.504765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895237247743173:7433] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:31.504775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:31.508893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:31.509113Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:31.509125Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:31.509135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:31.509186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:31.509224Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895237158013262:6065]
2025-09-30T14:52:31.509274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895237247743173:7433] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:31.509294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895237247743173:7433] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:31.509298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895237247743173:7433] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:31.509306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 851 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:31.509898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:31.510190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:31.510231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:31.510572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:31.510628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:31.510635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:31.510636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:31.510637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:31.510638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:31.510639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:31.510640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:31.510642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:31.510643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:31.510644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:31.510645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.510647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.510648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.510649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:31.510650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:31.510655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:31.510667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:31.510671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:31.510675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:31.510679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:31.510683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:31.510688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:31.510692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:31.510696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:31.510701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:31.510704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.510708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.510717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.510721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:31.510725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:31.510732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:31.510744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:31.510754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:31.510764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:31.510772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:31.510782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:31.510791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:31.510796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:31.510801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:31.510806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:31.510815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:31.510825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:31.510834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:31.510843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:31.510851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:31.510861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:31.510870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:31.510876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:31.510881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:31.510887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:31.510896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.510905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.510913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.510922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.510931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.510936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.510944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:31.510953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:31.510964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:31.510973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:31.511017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:31.516516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:31.517381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:31.517398Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:31.517400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:31.517405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:31.517411Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 850 [2:7555895237158013262:6065]
2025-09-30T14:52:31.517428Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:31.517444Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:31.517447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:31.517450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:31.517453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:31.517468Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:31.517474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:31.517481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:31.517544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.517552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.517555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.517558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:31.517560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:31.517628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:31.517635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.517649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.517664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.517683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:31.517705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895237247743054:2454], now have 1 active actors on pipe
2025-09-30T14:52:31.517714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895237247743231:7433], now have 1 active actors on pipe
2025-09-30T14:52:31.517720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895237158013257:6065]
2025-09-30T14:52:31.517723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895237158013257:6065]
2025-09-30T14:52:31.517725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895237158013257:6065]
2025-09-30T14:52:31.517737Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:31.517748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:31.517751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:31.517752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:31.517754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:31.517768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:31.517775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:31.517807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895237158013257:6065]
2025-09-30T14:52:31.517770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 850
2025-09-30T14:52:31.517780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 850
2025-09-30T14:52:31.517820Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:31.517834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:31.517843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:31.517847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:31.517892Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69856607-bd686854-50a3a762-ceefc919_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:31.517907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:31.517911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:31.517913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:31.517921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:31.517935Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:31.517957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:31.518111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:31.518120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:31.518133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:31.518210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 851 partition: 0 MaxSeqNo: 42 sessionId: src_id|69856607-bd686854-50a3a762-ceefc919_0
2025-09-30T14:52:31.518540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|960bfafd-f4b26ea1-f4ad8b58-36829ff5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|69856607-bd686854-50a3a762-ceefc919_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:31.521322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69856607-bd686854-50a3a762-ceefc919_0] Write session: try to update token
2025-09-30T14:52:31.521339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69856607-bd686854-50a3a762-ceefc919_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:31.530055Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:31.530077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:31.530080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:31.530082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:31.530092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895237158013257:6065]
2025-09-30T14:52:31.530097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895237158013257:6065]
2025-09-30T14:52:31.530101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895237158013257:6065]
2025-09-30T14:52:31.530144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:31.530148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:31.530152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.530155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:31.530155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:31.530159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:31.530381Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:31.534762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 851 sessionId: src_id|69856607-bd686854-50a3a762-ceefc919_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:31.537314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:31.591614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895237247743242:7153]
2025-09-30T14:52:31.591944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 850, pipe: [1:7555895237247743242:7153]
2025-09-30T14:52:31.637160Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:31.637850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:31.637863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:31.637893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895237247743242:7153], now have 1 active actors on pipe
2025-09-30T14:52:31.638118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:31.638124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:31.638133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:31.638170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895237247743242:7153]
2025-09-30T14:52:31.638195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 851 reason: error at write: Disconnected sessionId: src_id|69856607-bd686854-50a3a762-ceefc919_0
2025-09-30T14:52:31.638178Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:31.638366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 851 sessionId: src_id|69856607-bd686854-50a3a762-ceefc919_0 is DEAD
2025-09-30T14:52:31.638536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69856607-bd686854-50a3a762-ceefc919_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:31.638546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69856607-bd686854-50a3a762-ceefc919_0] Write session will restart in 0.006771s
2025-09-30T14:52:31.638566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69856607-bd686854-50a3a762-ceefc919_0] Write session: Do CDS request
2025-09-30T14:52:31.638571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69856607-bd686854-50a3a762-ceefc919_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:31.646732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69856607-bd686854-50a3a762-ceefc919_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:31.646854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:31.646868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 852
2025-09-30T14:52:31.647000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 852 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:31.647042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 852 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:31.647052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=852 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:31.647056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:31.647552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 852 sessionId:  describe result for acl check
2025-09-30T14:52:31.647590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:31.647598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:31.647600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:31.647606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895237247743280:7437] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:31.648111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895237247743280:7437] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:31.650515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895237247743280:7437] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:31.652624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895237247743280:7437] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:31.652638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895237247743280:7437] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:31.652641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895237247743280:7437] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:31.652648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 852 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:31.652808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:31.656869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:31.657068Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:31.657078Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:31.657089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:31.657141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:31.657183Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895237158013448:6068]
2025-09-30T14:52:31.657812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:31.658117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:31.658163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:31.658505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:31.658567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:31.658573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:31.658574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:31.658575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:31.658577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:31.658578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:31.658579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:31.658580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:31.658582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:31.658583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:31.658584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.658585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.658586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.658587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:31.658588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:31.658594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:31.658603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:31.658607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:31.658611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:31.658615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:31.658619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:31.658623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:31.658627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:31.658631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:31.658638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:31.658642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.658647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.658650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.658655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:31.658659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:31.658667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:31.658675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:31.658681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:31.658686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:31.658691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:31.658696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:31.658701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:31.658705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:31.658715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:31.658720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:31.658723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:31.658728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:31.658733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:31.658738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:31.658743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:31.658753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:31.658759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:31.658768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:31.658773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:31.658783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:31.658788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.658800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.658809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.658814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.658821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.658827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.658831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:31.658841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:31.658845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:31.658851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:31.658898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:31.664480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:31.665762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:31.665778Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:31.665781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:31.665785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:31.665792Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 851 [2:7555895237158013448:6068]
2025-09-30T14:52:31.665808Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:31.665827Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:31.665835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:31.665838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:31.665840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:31.665852Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:31.665856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:31.665861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:31.665906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.665912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.665913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.665916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:31.665918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:31.665968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:31.665976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.665987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.666005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.666023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:31.666044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895237247743422:7437], now have 1 active actors on pipe
2025-09-30T14:52:31.666053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895237247743243:2454], now have 1 active actors on pipe
2025-09-30T14:52:31.666059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895237158013442:6068]
2025-09-30T14:52:31.666061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895237158013442:6068]
2025-09-30T14:52:31.666063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895237158013442:6068]
2025-09-30T14:52:31.666075Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:31.666093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:31.666094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:31.666098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:31.666100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:31.666112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:31.666118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:31.666144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895237158013442:6068]
2025-09-30T14:52:31.666152Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:31.666158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:31.666133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 851
2025-09-30T14:52:31.666135Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 851
2025-09-30T14:52:31.666176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:31.666187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:31.666224Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|755b2c9a-aac7384-5a305d0-e3f3c17f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:31.666234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:31.666238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:31.666244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:31.666255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:31.666264Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:31.666296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:31.666442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:31.666451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:31.666463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:31.666535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 852 partition: 0 MaxSeqNo: 42 sessionId: src_id|755b2c9a-aac7384-5a305d0-e3f3c17f_0
2025-09-30T14:52:31.666896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69856607-bd686854-50a3a762-ceefc919_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|755b2c9a-aac7384-5a305d0-e3f3c17f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:31.669649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|755b2c9a-aac7384-5a305d0-e3f3c17f_0] Write session: try to update token
2025-09-30T14:52:31.669670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|755b2c9a-aac7384-5a305d0-e3f3c17f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:31.678735Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:31.678757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:31.678760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:31.678762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:31.679052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895237158013442:6068]
2025-09-30T14:52:31.679071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895237158013442:6068]
2025-09-30T14:52:31.679074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895237158013442:6068]
2025-09-30T14:52:31.679125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:31.679138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.679136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:31.679140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:31.679143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:31.679149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:31.679290Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:31.684343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 852 sessionId: src_id|755b2c9a-aac7384-5a305d0-e3f3c17f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:31.699904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:31.738568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895237247743435:7153]
2025-09-30T14:52:31.738847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 851, pipe: [1:7555895237247743435:7153]
2025-09-30T14:52:31.791707Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:31.791973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:31.791991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:31.792008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895237247743435:7153], now have 1 active actors on pipe
2025-09-30T14:52:31.792204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:31.792222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:31.792290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 852 reason: error at write: Disconnected sessionId: src_id|755b2c9a-aac7384-5a305d0-e3f3c17f_0
2025-09-30T14:52:31.792454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 852 sessionId: src_id|755b2c9a-aac7384-5a305d0-e3f3c17f_0 is DEAD
2025-09-30T14:52:31.792548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|755b2c9a-aac7384-5a305d0-e3f3c17f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:31.792555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|755b2c9a-aac7384-5a305d0-e3f3c17f_0] Write session will restart in 0.008660s
2025-09-30T14:52:31.792527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895237247743435:7153]
2025-09-30T14:52:31.792560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:31.792575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|755b2c9a-aac7384-5a305d0-e3f3c17f_0] Write session: Do CDS request
2025-09-30T14:52:31.792578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|755b2c9a-aac7384-5a305d0-e3f3c17f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:31.792819Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:31.802895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|755b2c9a-aac7384-5a305d0-e3f3c17f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:31.802952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:31.802971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 853
2025-09-30T14:52:31.803228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 853 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:31.803282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 853 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:31.803288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=853 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:31.803298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:31.803634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 853 sessionId:  describe result for acl check
2025-09-30T14:52:31.803666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:31.803672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:31.803674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:31.803679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895237247743726:7447] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:31.804206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895237247743726:7447] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:31.805306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:31.805875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895237247743726:7447] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:31.806402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:31.806558Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:31.806569Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:31.806579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:31.806622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:31.806659Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895237158013643:6072]
2025-09-30T14:52:31.807302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:31.807607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:31.807643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:31.807940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:31.807997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:31.808001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:31.808002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:31.808003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:31.808004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:31.808005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:31.808007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:31.808008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:31.808009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:31.808010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:31.808011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.808012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.808014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.808015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:31.808016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:31.808020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:31.808030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:31.808034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:31.808038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:31.808042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:31.808046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:31.808050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:31.808054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:31.808058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:31.808063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:31.808067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.808070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.808075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.808078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:31.808082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:31.808089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:31.808097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:31.808102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:31.808108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:31.808112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:31.808117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:31.808122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:31.808127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:31.808138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:31.808143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:31.808147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:31.808152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:31.808158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:31.808163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:31.808167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:31.808172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:31.808181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:31.808189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:31.808198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:31.808203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:31.808207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.808213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.808221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.808226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.808234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.808244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.808252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:31.808257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:31.808262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:31.808267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:31.808313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:31.808308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895237247743726:7447] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:31.808322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895237247743726:7447] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:31.808325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895237247743726:7447] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:31.808332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 853 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:31.813330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:31.814632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:31.814644Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:31.814646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:31.814649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:31.814654Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 852 [2:7555895237158013643:6072]
2025-09-30T14:52:31.814664Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:31.814674Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:31.814676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:31.814678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:31.814679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:31.814690Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:31.814694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:31.814699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:31.814737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.814744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.814745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.814748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:31.814749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:31.814806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:31.814814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.814822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.814828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.814841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:31.814856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895237158013638:6072]
2025-09-30T14:52:31.814861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895237158013638:6072]
2025-09-30T14:52:31.814863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895237158013638:6072]
2025-09-30T14:52:31.814869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:31.814878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895237247743765:7447], now have 1 active actors on pipe
2025-09-30T14:52:31.814880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:31.814883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:31.814884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895237247743441:2454], now have 1 active actors on pipe
2025-09-30T14:52:31.814885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:31.814888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:31.814904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:31.814906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:31.814928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895237158013638:6072]
2025-09-30T14:52:31.814940Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:31.814962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:31.815027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 852
2025-09-30T14:52:31.815067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 852
2025-09-30T14:52:31.815093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:31.815106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:31.815133Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8bf03fb9-52bcfe8b-3ee306a4-de1463df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:31.815146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:31.815150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:31.815152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:31.815161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:31.815171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:31.815185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:31.815396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:31.815406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:31.815419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:31.815521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 853 partition: 0 MaxSeqNo: 42 sessionId: src_id|8bf03fb9-52bcfe8b-3ee306a4-de1463df_0
2025-09-30T14:52:31.815866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|755b2c9a-aac7384-5a305d0-e3f3c17f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8bf03fb9-52bcfe8b-3ee306a4-de1463df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:31.818480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf03fb9-52bcfe8b-3ee306a4-de1463df_0] Write session: try to update token
2025-09-30T14:52:31.818495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf03fb9-52bcfe8b-3ee306a4-de1463df_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:31.826868Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:31.826892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:31.826900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895237158013638:6072]
2025-09-30T14:52:31.826940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:31.826939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:31.827101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:31.827260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:31.827399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:31.827535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:31.827723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:31.827767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:31.833066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 853 sessionId: src_id|8bf03fb9-52bcfe8b-3ee306a4-de1463df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:31.835608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:31.835711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:31.835730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:31.835760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:31.835825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:31.837476Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:31.837490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:31.837491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:31.837493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:31.837502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895237158013638:6072]
2025-09-30T14:52:31.837505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895237158013638:6072]
2025-09-30T14:52:31.837508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895237158013638:6072]
2025-09-30T14:52:31.837542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:31.837552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.837554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:31.837557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:31.837564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:31.837567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:31.837678Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:31.892674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895237247743784:7153]
2025-09-30T14:52:31.892943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 852, pipe: [1:7555895237247743784:7153]
2025-09-30T14:52:31.943009Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:31.950823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:31.950855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:31.951028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:31.951088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:31.951148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:31.951217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:31.951280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:31.951291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:31.951353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:31.951406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:31.951469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:31.951535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:31.951576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:31.951582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:31.951642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:31.951738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:31.951795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:31.951852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:31.951896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:31.951904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:31.951969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:31.952027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:31.952081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:31.952147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:31.952190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:31.952198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:31.952264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:31.952322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:31.952379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:31.952433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:31.952480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:31.952488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:31.952550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:31.952603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:31.952659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:31.952714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:31.952757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:31.952765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:31.952825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:31.952878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:31.952936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:31.952998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:31.953039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:31.953046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:31.953103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:31.953155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:31.953209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:31.953272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:31.953314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:31.953320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:31.953377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:31.953432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:31.953485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:31.953549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:31.953588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:31.953593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:31.953648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:31.953700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:31.953754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:31.953816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:31.953860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:31.953867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:31.953915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895237247743784:7153], now have 1 active actors on pipe
2025-09-30T14:52:31.954133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:31.954149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:31.954166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895237247743784:7153]
2025-09-30T14:52:31.954174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 853 reason: error at write: Disconnected sessionId: src_id|8bf03fb9-52bcfe8b-3ee306a4-de1463df_0
2025-09-30T14:52:31.954191Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:31.954355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 853 sessionId: src_id|8bf03fb9-52bcfe8b-3ee306a4-de1463df_0 is DEAD
2025-09-30T14:52:31.954486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf03fb9-52bcfe8b-3ee306a4-de1463df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:31.954497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf03fb9-52bcfe8b-3ee306a4-de1463df_0] Write session will restart in 0.006246s
2025-09-30T14:52:31.954520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf03fb9-52bcfe8b-3ee306a4-de1463df_0] Write session: Do CDS request
2025-09-30T14:52:31.954526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf03fb9-52bcfe8b-3ee306a4-de1463df_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:31.954950Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:31.961672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf03fb9-52bcfe8b-3ee306a4-de1463df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:31.961785Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:31.961801Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 854
2025-09-30T14:52:31.961934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 854 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:31.961967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 854 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:31.961977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=854 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:31.961980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:31.962357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 854 sessionId:  describe result for acl check
2025-09-30T14:52:31.962390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:31.962394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:31.962395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:31.962400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895237247743916:7452] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:31.962836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895237247743916:7452] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:31.965207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895237247743916:7452] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:31.966703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:31.967803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:31.967953Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:31.967961Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:31.967969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:31.967965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895237247743916:7452] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:31.967976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895237247743916:7452] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:31.967979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895237247743916:7452] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:31.967984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 854 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:31.968002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:31.968030Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895237158013850:6084]
2025-09-30T14:52:31.968445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:31.968695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:31.968728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:31.968980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:31.969021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:31.969026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:31.969026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:31.969027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:31.969027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:31.969028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:31.969029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:31.969030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:31.969031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:31.969031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:31.969032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.969032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.969033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.969034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:31.969034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:31.969037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:31.969044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:31.969046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:31.969049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:31.969051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:31.969053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:31.969055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:31.969058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:31.969060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:31.969062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:31.969065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.969067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.969069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.969071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:31.969074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:31.969079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:31.969084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:31.969088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:31.969093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:31.969098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:31.969103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:31.969107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:31.969113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:31.969117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:31.969123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:31.969127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:31.969132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:31.969136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:31.969141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:31.969146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:31.969151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:31.969155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:31.969160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:31.969164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:31.969169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:31.969174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.969180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.969184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.969189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.969193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.969198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.969202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:31.969207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:31.969212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:31.969217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:31.969260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:31.974421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:31.975267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:31.975279Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:31.975282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:31.975286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:31.975292Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 853 [2:7555895237158013850:6084]
2025-09-30T14:52:31.975306Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:31.975319Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:31.975323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:31.975326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:31.975328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:31.975344Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:31.975355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:31.975364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:31.975417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.975424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.975426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.975429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:31.975431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:31.975489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:31.975497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.975508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:31.975520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:31.975536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:31.975556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895237247744093:7452], now have 1 active actors on pipe
2025-09-30T14:52:31.975565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895237247743788:2454], now have 1 active actors on pipe
2025-09-30T14:52:31.975571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895237158013845:6084]
2025-09-30T14:52:31.975574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895237158013845:6084]
2025-09-30T14:52:31.975576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895237158013845:6084]
2025-09-30T14:52:31.975590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:31.975606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:31.975611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:31.975615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:31.975616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:31.975625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:31.975628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:31.975624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 853
2025-09-30T14:52:31.975624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 853
2025-09-30T14:52:31.975658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895237158013845:6084]
2025-09-30T14:52:31.975665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:31.975669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:31.975681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:31.975691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:31.975736Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14709618-76219db5-c7d174e8-cb06418f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:31.975746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:31.975749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:31.975751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:31.975759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:31.975770Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:31.975790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:31.975949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:31.975959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:31.975973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:31.976043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 854 partition: 0 MaxSeqNo: 42 sessionId: src_id|14709618-76219db5-c7d174e8-cb06418f_0
2025-09-30T14:52:31.976363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf03fb9-52bcfe8b-3ee306a4-de1463df_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|14709618-76219db5-c7d174e8-cb06418f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:31.978833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14709618-76219db5-c7d174e8-cb06418f_0] Write session: try to update token
2025-09-30T14:52:31.978846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14709618-76219db5-c7d174e8-cb06418f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:31.987495Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:31.987517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:31.987519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:31.987521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:31.987530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895237158013845:6084]
2025-09-30T14:52:31.987534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895237158013845:6084]
2025-09-30T14:52:31.987538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895237158013845:6084]
2025-09-30T14:52:31.987575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:31.987578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:31.987582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:31.987583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:31.987585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:31.987585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:31.987722Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:31.992553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 854 sessionId: src_id|14709618-76219db5-c7d174e8-cb06418f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:31.994932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:32.054475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895241542711420:7153]
2025-09-30T14:52:32.054713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 853, pipe: [1:7555895241542711420:7153]
2025-09-30T14:52:32.093907Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:32.094471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:32.094487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:32.094519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895241542711420:7153], now have 1 active actors on pipe
2025-09-30T14:52:32.094721Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:32.094752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895241542711420:7153]
2025-09-30T14:52:32.094776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:32.094780Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:32.094780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:32.094845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 854 reason: error at write: Disconnected sessionId: src_id|14709618-76219db5-c7d174e8-cb06418f_0
2025-09-30T14:52:32.095021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 854 sessionId: src_id|14709618-76219db5-c7d174e8-cb06418f_0 is DEAD
2025-09-30T14:52:32.095159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14709618-76219db5-c7d174e8-cb06418f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:32.095171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14709618-76219db5-c7d174e8-cb06418f_0] Write session will restart in 0.009796s
2025-09-30T14:52:32.095193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14709618-76219db5-c7d174e8-cb06418f_0] Write session: Do CDS request
2025-09-30T14:52:32.095202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14709618-76219db5-c7d174e8-cb06418f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:32.105781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14709618-76219db5-c7d174e8-cb06418f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:32.105853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:32.105871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 855
2025-09-30T14:52:32.105957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 855 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:32.105988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 855 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:32.105993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=855 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:32.105997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:32.106439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 855 sessionId:  describe result for acl check
2025-09-30T14:52:32.106484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:32.106493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:32.106495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:32.106502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895241542711647:7459] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:32.107035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895241542711647:7459] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:32.108979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895241542711647:7459] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:32.111295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:32.111466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895241542711647:7459] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:32.111484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895241542711647:7459] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:32.111487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895241542711647:7459] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:32.111495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 855 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:32.111824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:32.112019Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:32.112034Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:32.112047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:32.112107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:32.112146Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895241452981346:6088]
2025-09-30T14:52:32.112780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:32.113167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:32.113227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:32.113586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:32.113654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:32.113660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:32.113661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:32.113662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:32.113664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:32.113665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:32.113666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:32.113667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:32.113669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:32.113670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:32.113671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.113673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.113674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.113676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:32.113677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:32.113693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:32.113704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:32.113709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:32.113713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:32.113718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:32.113722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:32.113726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:32.113730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:32.113735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:32.113739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:32.113743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.113748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.113752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.113756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:32.113760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:32.113767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:32.113781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:32.113787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:32.113792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:32.113796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:32.113801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:32.113807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:32.113812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:32.113818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:32.113824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:32.113828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:32.113832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:32.113839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:32.113849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:32.113853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:32.113863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:32.113868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:32.113878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:32.113882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:32.113888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:32.113897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.113903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.113912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.113917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.113923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.113929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.113934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:32.113939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:32.113948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:32.113953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:32.113998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:32.119792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:32.120672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:32.120691Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:32.120694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:32.120699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:32.120706Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 854 [2:7555895241452981346:6088]
2025-09-30T14:52:32.120724Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:32.120739Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:32.120743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:32.120746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:32.120748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:32.120764Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:32.120771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:32.120779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:32.120841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.120852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.120855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.120861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:32.120864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:32.120931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:32.120938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.120952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.120970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.120993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:32.121014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895241542711733:7459], now have 1 active actors on pipe
2025-09-30T14:52:32.121023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895241542711424:2454], now have 1 active actors on pipe
2025-09-30T14:52:32.121030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895241452981340:6088]
2025-09-30T14:52:32.121032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895241452981340:6088]
2025-09-30T14:52:32.121036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895241452981340:6088]
2025-09-30T14:52:32.121048Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:32.121061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:32.121067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:32.121071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:32.121073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:32.121077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:32.121080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:32.121115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895241452981340:6088]
2025-09-30T14:52:32.121123Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:32.121097Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 854
2025-09-30T14:52:32.121137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:32.121106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 854
2025-09-30T14:52:32.121154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:32.121166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:32.121195Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8e4865d-7455c16a-fd1b373d-283b787a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:32.121201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:32.121205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:32.121208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:32.121216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:32.121226Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:32.121244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:32.121381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:32.121389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:32.121402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:32.121471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 855 partition: 0 MaxSeqNo: 42 sessionId: src_id|f8e4865d-7455c16a-fd1b373d-283b787a_0
2025-09-30T14:52:32.121830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14709618-76219db5-c7d174e8-cb06418f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f8e4865d-7455c16a-fd1b373d-283b787a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:32.124700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8e4865d-7455c16a-fd1b373d-283b787a_0] Write session: try to update token
2025-09-30T14:52:32.124723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8e4865d-7455c16a-fd1b373d-283b787a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:32.133121Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:32.133141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:32.133143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:32.133145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:32.133154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895241452981340:6088]
2025-09-30T14:52:32.133158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895241452981340:6088]
2025-09-30T14:52:32.133163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895241452981340:6088]
2025-09-30T14:52:32.133201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:32.133214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.133217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:32.133229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:32.133239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:32.133245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:32.133344Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:32.138604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 855 sessionId: src_id|f8e4865d-7455c16a-fd1b373d-283b787a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:32.141288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:32.194747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895241542711745:7153]
2025-09-30T14:52:32.195049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 854, pipe: [1:7555895241542711745:7153]
2025-09-30T14:52:32.238437Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:32.238673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:32.238687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:32.238718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895241542711745:7153], now have 1 active actors on pipe
2025-09-30T14:52:32.238966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:32.238999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895241542711745:7153]
2025-09-30T14:52:32.239064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:32.239072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:32.239132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 855 reason: error at write: Disconnected sessionId: src_id|f8e4865d-7455c16a-fd1b373d-283b787a_0
2025-09-30T14:52:32.239309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 855 sessionId: src_id|f8e4865d-7455c16a-fd1b373d-283b787a_0 is DEAD
2025-09-30T14:52:32.239344Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:32.239468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8e4865d-7455c16a-fd1b373d-283b787a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:32.239475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8e4865d-7455c16a-fd1b373d-283b787a_0] Write session will restart in 0.007287s
2025-09-30T14:52:32.239498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8e4865d-7455c16a-fd1b373d-283b787a_0] Write session: Do CDS request
2025-09-30T14:52:32.239504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8e4865d-7455c16a-fd1b373d-283b787a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:32.247659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8e4865d-7455c16a-fd1b373d-283b787a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:32.247811Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:32.247828Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 856
2025-09-30T14:52:32.247938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 856 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:32.247971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 856 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:32.247981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=856 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:32.247985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:32.248399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 856 sessionId:  describe result for acl check
2025-09-30T14:52:32.248433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:32.248440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:32.248442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:32.248448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895241542711949:7463] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:32.248933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895241542711949:7463] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:32.250729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895241542711949:7463] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:32.252873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:32.253051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895241542711949:7463] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:32.253066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895241542711949:7463] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:32.253069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895241542711949:7463] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:32.253088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 856 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:32.253286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:32.253425Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:32.253433Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:32.253440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:32.253480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:32.253514Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895241452981532:6090]
2025-09-30T14:52:32.254129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:32.254437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:32.254484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:32.254809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:32.254862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:32.254868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:32.254869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:32.254870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:32.254871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:32.254872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:32.254873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:32.254875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:32.254876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:32.254877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:32.254878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.254879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.254881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.254882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:32.254883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:32.254889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:32.254899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:32.254904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:32.254908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:32.254912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:32.254916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:32.254920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:32.254924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:32.254928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:32.254934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:32.254938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.254942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.254946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.254950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:32.254954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:32.254960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:32.254968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:32.254974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:32.254979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:32.254984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:32.254989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:32.254994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:32.255000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:32.255005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:32.255010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:32.255014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:32.255020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:32.255024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:32.255030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:32.255040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:32.255045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:32.255050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:32.255060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:32.255064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:32.255074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:32.255079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.255089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.255093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.255103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.255108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.255114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.255123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:32.255128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:32.255134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:32.255143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:32.255187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:32.260476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:32.261880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:32.261899Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:32.261902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:32.261906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:32.261912Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 855 [2:7555895241452981532:6090]
2025-09-30T14:52:32.261930Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:32.261944Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:32.261952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:32.261956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:32.261958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:32.261972Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:32.261979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:32.261991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:32.262057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.262066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.262068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.262072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:32.262074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:32.262142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:32.262150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.262162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.262177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.262199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:32.262221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895241542712056:7463], now have 1 active actors on pipe
2025-09-30T14:52:32.262229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895241542711746:2454], now have 1 active actors on pipe
2025-09-30T14:52:32.262236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895241452981526:6090]
2025-09-30T14:52:32.262242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895241452981526:6090]
2025-09-30T14:52:32.262245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895241452981526:6090]
2025-09-30T14:52:32.262258Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:32.262285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:32.262293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:32.262298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:32.262300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:32.262302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:32.262305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:32.262308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 855
2025-09-30T14:52:32.262336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895241452981526:6090]
2025-09-30T14:52:32.262348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:32.262316Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 855
2025-09-30T14:52:32.262351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:32.262374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:32.262379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:32.262411Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a78e76-17ead8d8-a301fb64-a24bfcfe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:32.262426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:32.262430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:32.262436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:32.262445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:32.262457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:32.262483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:32.262807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:32.262822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:32.262840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:32.262975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 856 partition: 0 MaxSeqNo: 42 sessionId: src_id|1a78e76-17ead8d8-a301fb64-a24bfcfe_0
2025-09-30T14:52:32.263381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8e4865d-7455c16a-fd1b373d-283b787a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1a78e76-17ead8d8-a301fb64-a24bfcfe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:32.265932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a78e76-17ead8d8-a301fb64-a24bfcfe_0] Write session: try to update token
2025-09-30T14:52:32.265948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a78e76-17ead8d8-a301fb64-a24bfcfe_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:32.274816Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:32.274839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:32.274841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:32.274843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:32.274853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895241452981526:6090]
2025-09-30T14:52:32.274857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895241452981526:6090]
2025-09-30T14:52:32.274861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895241452981526:6090]
2025-09-30T14:52:32.274902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:32.274910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.274912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:32.274911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:32.274917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:32.274921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:32.275052Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:32.280349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 856 sessionId: src_id|1a78e76-17ead8d8-a301fb64-a24bfcfe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:32.283107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:32.339178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895241542712072:7153]
2025-09-30T14:52:32.339479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 855, pipe: [1:7555895241542712072:7153]
2025-09-30T14:52:32.384976Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:32.385535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:32.385558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:32.385613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895241542712072:7153], now have 1 active actors on pipe
2025-09-30T14:52:32.385875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:32.385878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:32.385894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:32.385925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895241542712072:7153]
2025-09-30T14:52:32.385977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 856 reason: error at write: Disconnected sessionId: src_id|1a78e76-17ead8d8-a301fb64-a24bfcfe_0
2025-09-30T14:52:32.386091Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:32.386157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 856 sessionId: src_id|1a78e76-17ead8d8-a301fb64-a24bfcfe_0 is DEAD
2025-09-30T14:52:32.386405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a78e76-17ead8d8-a301fb64-a24bfcfe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:32.386414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a78e76-17ead8d8-a301fb64-a24bfcfe_0] Write session will restart in 0.005531s
2025-09-30T14:52:32.386431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a78e76-17ead8d8-a301fb64-a24bfcfe_0] Write session: Do CDS request
2025-09-30T14:52:32.386437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a78e76-17ead8d8-a301fb64-a24bfcfe_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:32.392749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a78e76-17ead8d8-a301fb64-a24bfcfe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:32.392822Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:32.392838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 857
2025-09-30T14:52:32.392971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 857 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:32.393011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 857 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:32.393021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=857 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:32.393025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:32.393442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 857 sessionId:  describe result for acl check
2025-09-30T14:52:32.393477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:32.393484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:32.393487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:32.393492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895241542712181:7467] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:32.393987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895241542712181:7467] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:32.395844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895241542712181:7467] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:32.397992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895241542712181:7467] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:32.398003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895241542712181:7467] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:32.398005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895241542712181:7467] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:32.398013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 857 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:32.399455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:32.400763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:32.400942Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:32.400952Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:32.400962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:32.401007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:32.401046Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895241452981717:6092]
2025-09-30T14:52:32.401699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:32.402024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:32.402068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:32.402406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:32.402466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:32.402472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:32.402474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:32.402475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:32.402476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:32.402477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:32.402479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:32.402480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:32.402482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:32.402483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:32.402484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.402485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.402486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.402488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:32.402489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:32.402494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:32.402505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:32.402509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:32.402513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:32.402518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:32.402522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:32.402527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:32.402531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:32.402535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:32.402540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:32.402544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.402548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.402552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.402556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:32.402561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:32.402568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:32.402577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:32.402582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:32.402588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:32.402593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:32.402599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:32.402603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:32.402609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:32.402614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:32.402620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:32.402626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:32.402631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:32.402637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:32.402647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:32.402652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:32.402657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:32.402662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:32.402667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:32.402672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:32.402682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:32.402687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.402697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.402702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.402712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.402717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.402727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.402732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:32.402741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:32.402747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:32.402754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:32.402806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:32.408088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:32.409020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:32.409034Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:32.409037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:32.409041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:32.409047Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 856 [2:7555895241452981717:6092]
2025-09-30T14:52:32.409063Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:32.409077Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:32.409086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:32.409089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:32.409091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:32.409107Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:32.409118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:32.409129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:32.409184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.409189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.409191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.409193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:32.409195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:32.409247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:32.409254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.409267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.409284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.409306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:32.409327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895241542712073:2454], now have 1 active actors on pipe
2025-09-30T14:52:32.409333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895241542712382:7467], now have 1 active actors on pipe
2025-09-30T14:52:32.409338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895241452981712:6092]
2025-09-30T14:52:32.409339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895241452981712:6092]
2025-09-30T14:52:32.409340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895241452981712:6092]
2025-09-30T14:52:32.409352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:32.409366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:32.409370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:32.409374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:32.409375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:32.409375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:32.409378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:32.409399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895241452981712:6092]
2025-09-30T14:52:32.409401Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:32.409404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:32.409425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 856
2025-09-30T14:52:32.409495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 856
2025-09-30T14:52:32.409538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:32.409553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:32.409581Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|662483d1-b7cd07bc-3f32ff31-c51c5ce3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:32.409593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:32.409597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:32.409599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:32.409609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:32.409620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:32.409633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:32.409785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:32.409794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:32.409807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:32.409872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 857 partition: 0 MaxSeqNo: 42 sessionId: src_id|662483d1-b7cd07bc-3f32ff31-c51c5ce3_0
2025-09-30T14:52:32.410199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a78e76-17ead8d8-a301fb64-a24bfcfe_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|662483d1-b7cd07bc-3f32ff31-c51c5ce3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:32.412957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|662483d1-b7cd07bc-3f32ff31-c51c5ce3_0] Write session: try to update token
2025-09-30T14:52:32.412976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|662483d1-b7cd07bc-3f32ff31-c51c5ce3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:32.421102Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:32.421122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:32.421130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895241452981712:6092]
2025-09-30T14:52:32.421166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:32.421170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:32.421333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:32.421477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:32.421620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:32.421768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:32.421971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:32.422019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:32.426972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 857 sessionId: src_id|662483d1-b7cd07bc-3f32ff31-c51c5ce3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:32.429676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:32.430069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:32.430091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:32.430128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:32.430236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:32.431648Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:32.431661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:32.431663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:32.431665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:32.431676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895241452981712:6092]
2025-09-30T14:52:32.431681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895241452981712:6092]
2025-09-30T14:52:32.431685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895241452981712:6092]
2025-09-30T14:52:32.431722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:32.431724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:32.431733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.431736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:32.431739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:32.431746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:32.431870Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:32.486077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895241542712399:7153]
2025-09-30T14:52:32.486301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 856, pipe: [1:7555895241542712399:7153]
2025-09-30T14:52:32.537290Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:32.544729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:32.544757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:32.544915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:32.544971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:32.545027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:32.545085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:32.545127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:32.545135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:32.545199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:32.545254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:32.545312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:32.545372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:32.545412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:32.545424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:32.545502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:32.545567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:32.545623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:32.545687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:32.545731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:32.545737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:32.545804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:32.545875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:32.545940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:32.546011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:32.546062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:32.546072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:32.546138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:32.546198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:32.546268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:32.546359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:32.546409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:32.546417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:32.546487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:32.546555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:32.546619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:32.546693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:32.546740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:32.546748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:32.546819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:32.546891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:32.546962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:32.547027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:32.547072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:32.547080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:32.547146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:32.547204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:32.547289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:32.547349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:32.547390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:32.547396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:32.547456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:32.547513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:32.547568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:32.547627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:32.547667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:32.547672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:32.547734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:32.547789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:32.547852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:32.547925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:32.547971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:32.547981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:32.548047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895241542712399:7153], now have 1 active actors on pipe
2025-09-30T14:52:32.548288Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:32.548305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:32.548309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:32.548335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 857 reason: error at write: Disconnected sessionId: src_id|662483d1-b7cd07bc-3f32ff31-c51c5ce3_0
2025-09-30T14:52:32.548353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895241542712399:7153]
2025-09-30T14:52:32.548482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 857 sessionId: src_id|662483d1-b7cd07bc-3f32ff31-c51c5ce3_0 is DEAD
2025-09-30T14:52:32.548616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|662483d1-b7cd07bc-3f32ff31-c51c5ce3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:32.548625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|662483d1-b7cd07bc-3f32ff31-c51c5ce3_0] Write session will restart in 0.005358s
2025-09-30T14:52:32.548642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|662483d1-b7cd07bc-3f32ff31-c51c5ce3_0] Write session: Do CDS request
2025-09-30T14:52:32.548645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|662483d1-b7cd07bc-3f32ff31-c51c5ce3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:32.549073Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:32.554754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|662483d1-b7cd07bc-3f32ff31-c51c5ce3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:32.554857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:32.554874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 858
2025-09-30T14:52:32.555002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 858 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:32.555033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 858 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:32.555042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=858 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:32.555048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:32.555493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 858 sessionId:  describe result for acl check
2025-09-30T14:52:32.555539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:32.555545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:32.555547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:32.555553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895241542712469:7472] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:32.556208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895241542712469:7472] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:32.558429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895241542712469:7472] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:32.560923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895241542712469:7472] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:32.560935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895241542712469:7472] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:32.560938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895241542712469:7472] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:32.560945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 858 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:32.563792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:32.564283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:32.564468Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:32.564480Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:32.564493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:32.564547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:32.564584Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895241452981905:6094]
2025-09-30T14:52:32.565250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:32.565536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:32.565601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:32.566117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:32.566209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:32.566210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:32.566212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:32.566213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:32.566214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:32.566215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:32.566217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:32.566218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:32.566219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:32.566220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:32.566222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.566223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.566224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.566225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:32.566227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:32.566233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:32.566244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:32.566248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:32.566253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:32.566257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:32.566262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:32.566266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:32.566284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:32.566288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:32.566293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:32.566297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.566302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.566306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.566309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:32.566313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:32.566322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:32.566330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:32.566337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:32.566344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:32.566349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:32.566354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:32.566360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:32.566365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:32.566369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:32.566374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:32.566378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:32.566383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:32.566387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:32.566392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:32.566397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:32.566402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:32.566406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:32.566425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:32.566429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:32.566433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:32.566438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.566444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.566448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.566453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.566458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.566462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.566466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:32.566471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:32.566476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:32.566481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:32.566521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:32.571817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:32.573100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:32.573117Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:32.573121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:32.573124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:32.573131Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 857 [2:7555895241452981905:6094]
2025-09-30T14:52:32.573147Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:32.573160Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:32.573169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:32.573172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:32.573179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:32.573194Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:32.573205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:32.573216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:32.573284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.573293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.573295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.573299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:32.573301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:32.573366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:32.573375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.573390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.573408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.573433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:32.573452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895241542712709:7472], now have 1 active actors on pipe
2025-09-30T14:52:32.573456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895241542712400:2454], now have 1 active actors on pipe
2025-09-30T14:52:32.573463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895241452981900:6094]
2025-09-30T14:52:32.573465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895241452981900:6094]
2025-09-30T14:52:32.573467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895241452981900:6094]
2025-09-30T14:52:32.573482Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:32.573496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:32.573504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:32.573508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:32.573510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:32.573518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:32.573521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:32.573481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 857
2025-09-30T14:52:32.573500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 857
2025-09-30T14:52:32.573561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:32.573570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:32.573588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895241452981900:6094]
2025-09-30T14:52:32.573597Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:32.573601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:32.573625Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c31ece5c-af0c88f2-1493e1d2-47309618_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:32.573636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:32.573641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:32.573643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:32.573655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:32.573669Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:32.573696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:32.573818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:32.573828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:32.573847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:32.573923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 858 partition: 0 MaxSeqNo: 42 sessionId: src_id|c31ece5c-af0c88f2-1493e1d2-47309618_0
2025-09-30T14:52:32.574262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|662483d1-b7cd07bc-3f32ff31-c51c5ce3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c31ece5c-af0c88f2-1493e1d2-47309618_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:32.576957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c31ece5c-af0c88f2-1493e1d2-47309618_0] Write session: try to update token
2025-09-30T14:52:32.576975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c31ece5c-af0c88f2-1493e1d2-47309618_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:32.585397Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:32.585420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:32.585422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:32.585425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:32.585434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895241452981900:6094]
2025-09-30T14:52:32.585439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895241452981900:6094]
2025-09-30T14:52:32.585444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895241452981900:6094]
2025-09-30T14:52:32.585484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:32.585498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.585497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:32.585501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:32.585503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:32.585506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:32.585633Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:32.589731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 858 sessionId: src_id|c31ece5c-af0c88f2-1493e1d2-47309618_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:32.592245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:32.648376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895241542712724:7153]
2025-09-30T14:52:32.648651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 857, pipe: [1:7555895241542712724:7153]
2025-09-30T14:52:32.692031Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:32.692570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:32.692587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:32.692637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895241542712724:7153], now have 1 active actors on pipe
2025-09-30T14:52:32.692841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895241542712724:7153]
2025-09-30T14:52:32.692843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:32.692871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:32.692873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:32.692933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 858 reason: error at write: Disconnected sessionId: src_id|c31ece5c-af0c88f2-1493e1d2-47309618_0
2025-09-30T14:52:32.693044Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:32.693063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 858 sessionId: src_id|c31ece5c-af0c88f2-1493e1d2-47309618_0 is DEAD
2025-09-30T14:52:32.693208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c31ece5c-af0c88f2-1493e1d2-47309618_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:32.693215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c31ece5c-af0c88f2-1493e1d2-47309618_0] Write session will restart in 0.008401s
2025-09-30T14:52:32.693232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c31ece5c-af0c88f2-1493e1d2-47309618_0] Write session: Do CDS request
2025-09-30T14:52:32.693239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c31ece5c-af0c88f2-1493e1d2-47309618_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:32.702650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c31ece5c-af0c88f2-1493e1d2-47309618_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:32.702765Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:32.702782Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 859
2025-09-30T14:52:32.702882Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 859 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:32.702922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 859 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:32.702929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=859 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:32.702933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:32.703353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 859 sessionId:  describe result for acl check
2025-09-30T14:52:32.703387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:32.703393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:32.703395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:32.703400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895241542712973:7476] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:32.703812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895241542712973:7476] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:32.705203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895241542712973:7476] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:32.707222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:32.707364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895241542712973:7476] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:32.707379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895241542712973:7476] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:32.707382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895241542712973:7476] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:32.707390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 859 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:32.707682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:32.707825Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:32.707835Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:32.707845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:32.707888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:32.707924Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895241452982096:6097]
2025-09-30T14:52:32.708419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:32.708662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:32.708702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:32.708969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:32.709014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:32.709019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:32.709020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:32.709021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:32.709022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:32.709022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:32.709023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:32.709024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:32.709025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:32.709025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:32.709026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.709027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.709028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.709028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:32.709029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:32.709032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:32.709039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:32.709041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:32.709043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:32.709046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:32.709051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:32.709055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:32.709059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:32.709063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:32.709067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:32.709071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.709075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.709077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.709079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:32.709081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:32.709086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:32.709091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:32.709095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:32.709099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:32.709102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:32.709105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:32.709108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:32.709111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:32.709114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:32.709117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:32.709120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:32.709123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:32.709125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:32.709128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:32.709130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:32.709133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:32.709136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:32.709138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:32.709141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:32.709144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:32.709146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.709149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.709153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.709156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.709159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.709162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.709165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:32.709168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:32.709171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:32.709174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:32.709197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:32.714575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:32.715450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:32.715464Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:32.715468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:32.715472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:32.715478Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 858 [2:7555895241452982096:6097]
2025-09-30T14:52:32.715494Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:32.715509Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:32.715511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:32.715513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:32.715514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:32.715527Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:32.715532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:32.715538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:32.715587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.715593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.715595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.715598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:32.715600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:32.715665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:32.715671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.715679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.715690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.715707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:32.715724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895241452982090:6097]
2025-09-30T14:52:32.715730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895241452982090:6097]
2025-09-30T14:52:32.715732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895241452982090:6097]
2025-09-30T14:52:32.715737Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:32.715747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:32.715748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895241542713038:7476], now have 1 active actors on pipe
2025-09-30T14:52:32.715749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:32.715750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895241542712725:2454], now have 1 active actors on pipe
2025-09-30T14:52:32.715751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:32.715756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:32.715765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:32.715767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:32.715801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895241452982090:6097]
2025-09-30T14:52:32.715814Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:32.715819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:32.715834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 858
2025-09-30T14:52:32.715840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 858
2025-09-30T14:52:32.715933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:32.715945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:32.715973Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52ee4546-1d956a7-5e59fd0f-cd525997_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:32.715985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:32.715994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:32.715996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:32.716005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:32.716020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:32.716041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:32.716179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:32.716188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:32.716202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:32.716287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 859 partition: 0 MaxSeqNo: 42 sessionId: src_id|52ee4546-1d956a7-5e59fd0f-cd525997_0
2025-09-30T14:52:32.716599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c31ece5c-af0c88f2-1493e1d2-47309618_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|52ee4546-1d956a7-5e59fd0f-cd525997_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:32.719146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52ee4546-1d956a7-5e59fd0f-cd525997_0] Write session: try to update token
2025-09-30T14:52:32.719162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52ee4546-1d956a7-5e59fd0f-cd525997_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:32.728042Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:32.728065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:32.728068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:32.728070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:32.728079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895241452982090:6097]
2025-09-30T14:52:32.728084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895241452982090:6097]
2025-09-30T14:52:32.728089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895241452982090:6097]
2025-09-30T14:52:32.728128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:32.728135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:32.728141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.728142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:32.728144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:32.728146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:32.728303Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:32.732472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 859 sessionId: src_id|52ee4546-1d956a7-5e59fd0f-cd525997_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:32.735084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:32.792756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895241542713049:7153]
2025-09-30T14:52:32.793010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 858, pipe: [1:7555895241542713049:7153]
2025-09-30T14:52:32.836494Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:32.836698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:32.836709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:32.836745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895241542713049:7153], now have 1 active actors on pipe
2025-09-30T14:52:32.836938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:32.836956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:32.837015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 859 reason: error at write: Disconnected sessionId: src_id|52ee4546-1d956a7-5e59fd0f-cd525997_0
2025-09-30T14:52:32.837049Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:32.837182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 859 sessionId: src_id|52ee4546-1d956a7-5e59fd0f-cd525997_0 is DEAD
2025-09-30T14:52:32.837341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52ee4546-1d956a7-5e59fd0f-cd525997_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:32.837352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52ee4546-1d956a7-5e59fd0f-cd525997_0] Write session will restart in 0.007965s
2025-09-30T14:52:32.837374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52ee4546-1d956a7-5e59fd0f-cd525997_0] Write session: Do CDS request
2025-09-30T14:52:32.837378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52ee4546-1d956a7-5e59fd0f-cd525997_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:32.837372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895241542713049:7153]
2025-09-30T14:52:32.837392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:32.846710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52ee4546-1d956a7-5e59fd0f-cd525997_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:32.846807Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:32.846827Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 860
2025-09-30T14:52:32.846953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 860 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:32.846984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 860 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:32.846993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=860 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:32.846998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:32.847439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 860 sessionId:  describe result for acl check
2025-09-30T14:52:32.847472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:32.847479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:32.847481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:32.847485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895241542713315:7486] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:32.847946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895241542713315:7486] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:32.849690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895241542713315:7486] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:32.849897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:32.851321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:32.851498Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:32.851507Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:32.851518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:32.851570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:32.851608Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895241452982298:6101]
2025-09-30T14:52:32.852165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:32.852247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895241542713315:7486] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:32.852262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895241542713315:7486] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:32.852265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895241542713315:7486] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:32.852273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 860 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:32.852433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:32.852475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:32.852794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:32.852852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:32.852859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:32.852860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:32.852861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:32.852862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:32.852863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:32.852864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:32.852865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:32.852866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:32.852867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:32.852869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.852870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.852871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.852872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:32.852873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:32.852879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:32.852888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:32.852892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:32.852896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:32.852900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:32.852904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:32.852909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:32.852913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:32.852916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:32.852920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:32.852924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.852928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.852932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.852937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:32.852941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:32.852948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:32.852956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:32.852961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:32.852968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:32.852974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:32.852980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:32.852984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:32.852994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:32.853000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:32.853005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:32.853010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:32.853015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:32.853020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:32.853025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:32.853029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:32.853035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:32.853039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:32.853044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:32.853048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:32.853054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:32.853061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.853066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.853070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.853076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.853082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.853087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.853091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:32.853096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:32.853100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:32.853105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:32.853149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:32.858494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:32.859805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:32.859820Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:32.859823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:32.859827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:32.859833Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 859 [2:7555895241452982298:6101]
2025-09-30T14:52:32.859849Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:32.859860Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:32.859863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:32.859866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:32.859868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:32.859881Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:32.859887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:32.859893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:32.859943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.859951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.859953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.859956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:32.859958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:32.860015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:32.860025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.860037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:32.860049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:32.860069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:32.860090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895241542713064:2454], now have 1 active actors on pipe
2025-09-30T14:52:32.860097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895241542713379:7486], now have 1 active actors on pipe
2025-09-30T14:52:32.860103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895241452982293:6101]
2025-09-30T14:52:32.860105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895241452982293:6101]
2025-09-30T14:52:32.860107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895241452982293:6101]
2025-09-30T14:52:32.860117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:32.860128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:32.860130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:32.860133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:32.860136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:32.860146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:32.860149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:32.860172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895241452982293:6101]
2025-09-30T14:52:32.860179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:32.860181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:32.860160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 859
2025-09-30T14:52:32.860198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 859
2025-09-30T14:52:32.860201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:32.860209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:32.860239Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30ee946-b9efb0ba-66410877-dfd351c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:32.860250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:32.860254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:32.860256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:32.860266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:32.860279Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:32.860299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:32.860480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:32.860491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:32.860506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:32.860598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 860 partition: 0 MaxSeqNo: 42 sessionId: src_id|30ee946-b9efb0ba-66410877-dfd351c7_0
2025-09-30T14:52:32.860923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52ee4546-1d956a7-5e59fd0f-cd525997_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|30ee946-b9efb0ba-66410877-dfd351c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:32.863575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30ee946-b9efb0ba-66410877-dfd351c7_0] Write session: try to update token
2025-09-30T14:52:32.863597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30ee946-b9efb0ba-66410877-dfd351c7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:32.872022Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:32.872045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:32.872047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:32.872049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:32.872057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895241452982293:6101]
2025-09-30T14:52:32.872061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895241452982293:6101]
2025-09-30T14:52:32.872063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895241452982293:6101]
2025-09-30T14:52:32.872102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:32.872111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:32.872113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:32.872116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:32.872127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:32.872131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:32.872262Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:32.877077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 860 sessionId: src_id|30ee946-b9efb0ba-66410877-dfd351c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:32.879561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:32.937649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895241542713398:7153]
2025-09-30T14:52:32.937886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 859, pipe: [1:7555895241542713398:7153]
2025-09-30T14:52:32.985155Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:32.985563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:32.985577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:32.985612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895241542713398:7153], now have 1 active actors on pipe
2025-09-30T14:52:32.985821Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:32.985833Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:32.985854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:32.985858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:32.985890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895241542713398:7153]
2025-09-30T14:52:32.985914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 860 reason: error at write: Disconnected sessionId: src_id|30ee946-b9efb0ba-66410877-dfd351c7_0
2025-09-30T14:52:32.986060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 860 sessionId: src_id|30ee946-b9efb0ba-66410877-dfd351c7_0 is DEAD
2025-09-30T14:52:32.986196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30ee946-b9efb0ba-66410877-dfd351c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:32.986206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30ee946-b9efb0ba-66410877-dfd351c7_0] Write session will restart in 0.008829s
2025-09-30T14:52:32.986240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30ee946-b9efb0ba-66410877-dfd351c7_0] Write session: Do CDS request
2025-09-30T14:52:32.986246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30ee946-b9efb0ba-66410877-dfd351c7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:32.995692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30ee946-b9efb0ba-66410877-dfd351c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:32.995758Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:32.995773Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 861
2025-09-30T14:52:32.995937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 861 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:32.995961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 861 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:32.995965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=861 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:32.995967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:32.996297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 861 sessionId:  describe result for acl check
2025-09-30T14:52:32.996339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:32.996346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:32.996347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:32.996352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895241542713677:7491] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:32.996770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895241542713677:7491] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:32.999107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895241542713677:7491] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:32.999387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:32.999826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:32.999998Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:33.000007Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:33.000016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:33.000061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:33.000095Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895241452982524:6114]
2025-09-30T14:52:33.000720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:33.000977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:33.001019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:33.001320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:33.001397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:33.001403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:33.001404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:33.001406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:33.001407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:33.001408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:33.001409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:33.001411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:33.001412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:33.001413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:33.001415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.001416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.001417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.001419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:33.001420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:33.001425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:33.001435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:33.001439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:33.001442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:33.001446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:33.001449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:33.001453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:33.001456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:33.001460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:33.001463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:33.001467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.001470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.001474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.001477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:33.001481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:33.001488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:33.001501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:33.001511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:33.001521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:33.001530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:33.001535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:33.001544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:33.001549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:33.001558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:33.001563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:33.001567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:33.001572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:33.001576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:33.001580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:33.001584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:33.001589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:33.001593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:33.001598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:33.001602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:33.001613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:33.001617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.001627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.001631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.001636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.001639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.001644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.001648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:33.001657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:33.001665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:33.001670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:33.001659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895241542713677:7491] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:33.001673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895241542713677:7491] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:33.001676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895241542713677:7491] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:33.001683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 861 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:33.001717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:33.006810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:33.008124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:33.008140Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:33.008143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:33.008146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:33.008152Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 860 [2:7555895241452982524:6114]
2025-09-30T14:52:33.008165Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:33.008178Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:33.008186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:33.008188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:33.008191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:33.008207Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:33.008218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:33.008229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:33.008288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.008298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.008300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.008304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:33.008306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:33.008366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:33.008374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.008387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.008399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.008421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:33.008442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895241542713400:2454], now have 1 active actors on pipe
2025-09-30T14:52:33.008450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895245837681020:7491], now have 1 active actors on pipe
2025-09-30T14:52:33.008456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895241452982519:6114]
2025-09-30T14:52:33.008463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895241452982519:6114]
2025-09-30T14:52:33.008465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895241452982519:6114]
2025-09-30T14:52:33.008479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:33.008496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:33.008500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:33.008504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:33.008506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:33.008515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:33.008517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:33.008540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895241452982519:6114]
2025-09-30T14:52:33.008547Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:33.008561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:33.008545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 860
2025-09-30T14:52:33.008579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:33.008546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 860
2025-09-30T14:52:33.008587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:33.008614Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7811d4d-c6876d1e-cdb45cb6-7a56d64a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:33.008627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:33.008630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:33.008632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:33.008642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:33.008656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:33.008673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:33.008925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:33.008937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:33.008952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:33.009054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 861 partition: 0 MaxSeqNo: 42 sessionId: src_id|a7811d4d-c6876d1e-cdb45cb6-7a56d64a_0
2025-09-30T14:52:33.009384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30ee946-b9efb0ba-66410877-dfd351c7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a7811d4d-c6876d1e-cdb45cb6-7a56d64a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:33.012184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7811d4d-c6876d1e-cdb45cb6-7a56d64a_0] Write session: try to update token
2025-09-30T14:52:33.012204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7811d4d-c6876d1e-cdb45cb6-7a56d64a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:33.020323Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:33.020351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:33.020353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:33.020356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:33.020365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895241452982519:6114]
2025-09-30T14:52:33.020370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895241452982519:6114]
2025-09-30T14:52:33.020374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895241452982519:6114]
2025-09-30T14:52:33.020415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:33.020425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:33.020430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:33.020431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.020433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:33.020434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:33.020571Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:33.026089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 861 sessionId: src_id|a7811d4d-c6876d1e-cdb45cb6-7a56d64a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:33.028601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:33.086127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895245837681049:7153]
2025-09-30T14:52:33.086340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 860, pipe: [1:7555895245837681049:7153]
2025-09-30T14:52:33.123744Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:33.124291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:33.124307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:33.124343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895245837681049:7153], now have 1 active actors on pipe
2025-09-30T14:52:33.124538Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:33.124562Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:33.124601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:33.124605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:33.124628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895245837681049:7153]
2025-09-30T14:52:33.124674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 861 reason: error at write: Disconnected sessionId: src_id|a7811d4d-c6876d1e-cdb45cb6-7a56d64a_0
2025-09-30T14:52:33.124837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 861 sessionId: src_id|a7811d4d-c6876d1e-cdb45cb6-7a56d64a_0 is DEAD
2025-09-30T14:52:33.125000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7811d4d-c6876d1e-cdb45cb6-7a56d64a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:33.125012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7811d4d-c6876d1e-cdb45cb6-7a56d64a_0] Write session will restart in 0.007879s
2025-09-30T14:52:33.125037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7811d4d-c6876d1e-cdb45cb6-7a56d64a_0] Write session: Do CDS request
2025-09-30T14:52:33.125056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7811d4d-c6876d1e-cdb45cb6-7a56d64a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:33.133747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7811d4d-c6876d1e-cdb45cb6-7a56d64a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:33.133805Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:33.133823Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 862
2025-09-30T14:52:33.133954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 862 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:33.133991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 862 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:33.134000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=862 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:33.134004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:33.134542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 862 sessionId:  describe result for acl check
2025-09-30T14:52:33.134585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:33.134588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:33.134590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:33.134596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895245837681210:7500] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:33.135147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895245837681210:7500] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:33.137139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895245837681210:7500] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:33.139662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:33.139856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895245837681210:7500] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:33.139869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895245837681210:7500] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:33.139872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895245837681210:7500] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:33.139892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 862 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:33.140911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:33.141083Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:33.141094Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:33.141104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:33.141155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:33.141190Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895245747950015:6117]
2025-09-30T14:52:33.141826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:33.142120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:33.142169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:33.142501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:33.142567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:33.142574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:33.142575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:33.142576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:33.142577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:33.142579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:33.142580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:33.142581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:33.142583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:33.142584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:33.142585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.142587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.142588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.142589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:33.142590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:33.142596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:33.142607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:33.142611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:33.142616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:33.142620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:33.142624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:33.142628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:33.142637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:33.142641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:33.142650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:33.142658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.142662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.142671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.142679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:33.142683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:33.142695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:33.142707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:33.142717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:33.142727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:33.142736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:33.142745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:33.142750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:33.142756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:33.142766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:33.142775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:33.142784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:33.142789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:33.142797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:33.142805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:33.142813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:33.142817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:33.142823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:33.142826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:33.142829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:33.142832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:33.142835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.142840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.142843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.142847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.142853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.142856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.142859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:33.142862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:33.142864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:33.142867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:33.142892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:33.148132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:33.149572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:33.149592Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:33.149595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:33.149599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:33.149607Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 861 [2:7555895245747950015:6117]
2025-09-30T14:52:33.149622Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:33.149637Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:33.149640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:33.149643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:33.149645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:33.149661Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:33.149671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:33.149683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:33.149745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.149752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.149754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.149758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:33.149761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:33.149821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:33.149829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.149843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.149859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.149874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:33.149897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895245837681367:7500], now have 1 active actors on pipe
2025-09-30T14:52:33.149908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895245837681050:2454], now have 1 active actors on pipe
2025-09-30T14:52:33.149914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895245747950009:6117]
2025-09-30T14:52:33.149916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895245747950009:6117]
2025-09-30T14:52:33.149919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895245747950009:6117]
2025-09-30T14:52:33.149932Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:33.149945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:33.149948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:33.149952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:33.149955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:33.149961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:33.149963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:33.149998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895245747950009:6117]
2025-09-30T14:52:33.150010Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:33.150011Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 861
2025-09-30T14:52:33.150016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 861
2025-09-30T14:52:33.150020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:33.150093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:33.150103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:33.150129Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99c3c5c6-6af5946b-2d7b164d-11598239_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:33.150140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:33.150145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:33.150151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:33.150160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:33.150173Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:33.150191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:33.150343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:33.150352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:33.150365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:33.150434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 862 partition: 0 MaxSeqNo: 42 sessionId: src_id|99c3c5c6-6af5946b-2d7b164d-11598239_0
2025-09-30T14:52:33.150766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7811d4d-c6876d1e-cdb45cb6-7a56d64a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|99c3c5c6-6af5946b-2d7b164d-11598239_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:33.153468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99c3c5c6-6af5946b-2d7b164d-11598239_0] Write session: try to update token
2025-09-30T14:52:33.153485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99c3c5c6-6af5946b-2d7b164d-11598239_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:33.161668Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:33.161688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:33.161697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895245747950009:6117]
2025-09-30T14:52:33.161741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:33.161740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:33.161908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:33.162059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:33.162188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:33.162345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:33.162537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:33.162582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:33.167502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 862 sessionId: src_id|99c3c5c6-6af5946b-2d7b164d-11598239_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:33.170351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:33.170549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:33.170576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:33.170614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:33.170737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:33.171826Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:33.171838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:33.171840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:33.171841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:33.171848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895245747950009:6117]
2025-09-30T14:52:33.171850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895245747950009:6117]
2025-09-30T14:52:33.171853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895245747950009:6117]
2025-09-30T14:52:33.171881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:33.171887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.171889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:33.171899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:33.171926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:33.171934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:33.172024Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:33.224895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895245837681378:7153]
2025-09-30T14:52:33.225178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 861, pipe: [1:7555895245837681378:7153]
2025-09-30T14:52:33.275396Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:33.282241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:33.282285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:33.282441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:33.282498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:33.282564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:33.282624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:33.282665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:33.282675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:33.282749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:33.282817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:33.282877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:33.282935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:33.283232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:33.283256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:33.283322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:33.283388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:33.283447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:33.283508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:33.283550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:33.283560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:33.283625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:33.283686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:33.283745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:33.283812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:33.283859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:33.283867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:33.283931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:33.283987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:33.284062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:33.284133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:33.284176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:33.284181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:33.284245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:33.284304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:33.284371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:33.284428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:33.284469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:33.284475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:33.284534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:33.284596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:33.284656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:33.284712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:33.284753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:33.284761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:33.284825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:33.284886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:33.284944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:33.285015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:33.285059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:33.285067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:33.285133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:33.285187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:33.285243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:33.285297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:33.285340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:33.285347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:33.285409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:33.285463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:33.285521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:33.285577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:33.285624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:33.285632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:33.285684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895245837681378:7153], now have 1 active actors on pipe
2025-09-30T14:52:33.285951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895245837681378:7153]
2025-09-30T14:52:33.285953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:33.285995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:33.285998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:33.286025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 862 reason: error at write: Disconnected sessionId: src_id|99c3c5c6-6af5946b-2d7b164d-11598239_0
2025-09-30T14:52:33.286193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 862 sessionId: src_id|99c3c5c6-6af5946b-2d7b164d-11598239_0 is DEAD
2025-09-30T14:52:33.286338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c3c5c6-6af5946b-2d7b164d-11598239_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:33.286346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c3c5c6-6af5946b-2d7b164d-11598239_0] Write session will restart in 0.006043s
2025-09-30T14:52:33.286363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c3c5c6-6af5946b-2d7b164d-11598239_0] Write session: Do CDS request
2025-09-30T14:52:33.286368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c3c5c6-6af5946b-2d7b164d-11598239_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:33.286589Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:33.293736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99c3c5c6-6af5946b-2d7b164d-11598239_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:33.293832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:33.293849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 863
2025-09-30T14:52:33.293970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 863 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:33.293995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 863 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:33.294012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=863 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:33.294019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:33.294426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 863 sessionId:  describe result for acl check
2025-09-30T14:52:33.294466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:33.294469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:33.294470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:33.294475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895245837681527:7504] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:33.294863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895245837681527:7504] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:33.297081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895245837681527:7504] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:33.299295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:33.300587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:33.300736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895245837681527:7504] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:33.300747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895245837681527:7504] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:33.300749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895245837681527:7504] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:33.300755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 863 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:33.300949Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:33.300962Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:33.300975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:33.301038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:33.301076Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895245747950208:6119]
2025-09-30T14:52:33.301589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:33.301818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:33.301848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:33.302069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:33.302118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:33.302123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:33.302124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:33.302125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:33.302126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:33.302127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:33.302127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:33.302128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:33.302128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:33.302129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:33.302130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.302131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.302131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.302132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:33.302133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:33.302136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:33.302143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:33.302145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:33.302148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:33.302152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:33.302156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:33.302159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:33.302164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:33.302168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:33.302172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:33.302176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.302180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.302184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.302188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:33.302192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:33.302199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:33.302206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:33.302212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:33.302217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:33.302222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:33.302227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:33.302231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:33.302236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:33.302240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:33.302245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:33.302249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:33.302254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:33.302260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:33.302265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:33.302283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:33.302293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:33.302299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:33.302304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:33.302314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:33.302323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:33.302331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.302337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.302345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.302348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.302351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.302353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.302359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:33.302362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:33.302365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:33.302368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:33.302390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:33.307757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:33.308588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:33.308605Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:33.308607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:33.308611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:33.308616Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 862 [2:7555895245747950208:6119]
2025-09-30T14:52:33.308631Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:33.308646Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:33.308649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:33.308652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:33.308659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:33.308674Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:33.308685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:33.308695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:33.308744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.308751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.308752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.308755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:33.308757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:33.308802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:33.308807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.308815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.308820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.308830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:33.308841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895245747950202:6119]
2025-09-30T14:52:33.308846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895245747950202:6119]
2025-09-30T14:52:33.308848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895245747950202:6119]
2025-09-30T14:52:33.308854Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:33.308862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:33.308863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:33.308863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:33.308865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:33.308872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:33.308874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:33.308881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895245837681379:2454], now have 1 active actors on pipe
2025-09-30T14:52:33.308884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895245837681696:7504], now have 1 active actors on pipe
2025-09-30T14:52:33.308904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895245747950202:6119]
2025-09-30T14:52:33.308912Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:33.308920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:33.308939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 862
2025-09-30T14:52:33.308955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 862
2025-09-30T14:52:33.308985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:33.308992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:33.309011Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d014cb87-11c0ef21-eb6ca686-c49623a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:33.309018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:33.309021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:33.309022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:33.309028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:33.309035Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:33.309047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:33.309244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:33.309251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:33.309264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:33.309345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 863 partition: 0 MaxSeqNo: 42 sessionId: src_id|d014cb87-11c0ef21-eb6ca686-c49623a8_0
2025-09-30T14:52:33.309676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c3c5c6-6af5946b-2d7b164d-11598239_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d014cb87-11c0ef21-eb6ca686-c49623a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:33.312298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d014cb87-11c0ef21-eb6ca686-c49623a8_0] Write session: try to update token
2025-09-30T14:52:33.312314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d014cb87-11c0ef21-eb6ca686-c49623a8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:33.320071Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:33.320089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:33.320099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895245747950202:6119]
2025-09-30T14:52:33.320138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:33.320142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:33.320301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:33.320422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:33.320549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:33.320676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:33.320857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:33.320904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:33.326361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 863 sessionId: src_id|d014cb87-11c0ef21-eb6ca686-c49623a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:33.329006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:33.329221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:33.329241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:33.329281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:33.329384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:33.331116Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:33.331133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:33.331135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:33.331137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:33.331150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895245747950202:6119]
2025-09-30T14:52:33.331153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895245747950202:6119]
2025-09-30T14:52:33.331156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895245747950202:6119]
2025-09-30T14:52:33.331192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:33.331196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:33.331198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.331201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:33.331201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:33.331204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:33.331349Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:33.386192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895245837681708:7153]
2025-09-30T14:52:33.386546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 862, pipe: [1:7555895245837681708:7153]
2025-09-30T14:52:33.436090Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:33.443504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:33.443530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:33.443682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:33.443740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:33.443809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:33.443871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:33.444245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:33.444257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:33.444323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:33.444383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:33.444445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:33.444507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:33.444552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:33.444561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:33.444635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:33.444691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:33.444749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:33.444814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:33.444861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:33.444869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:33.444928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:33.444986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:33.445046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:33.445110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:33.445151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:33.445158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:33.445218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:33.445274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:33.445340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:33.445398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:33.445440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:33.445447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:33.445512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:33.445574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:33.445638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:33.445704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:33.445753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:33.445761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:33.445837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:33.445904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:33.445983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:33.446056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:33.446105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:33.446113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:33.446177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:33.446242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:33.446313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:33.446371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:33.446413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:33.446419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:33.446481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:33.446543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:33.446606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:33.446671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:33.446712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:33.446718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:33.446775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:33.446832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:33.446894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:33.446957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:33.446997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:33.447003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:33.447056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895245837681708:7153], now have 1 active actors on pipe
2025-09-30T14:52:33.447372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:33.447426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:33.447431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:33.447455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 863 reason: error at write: Disconnected sessionId: src_id|d014cb87-11c0ef21-eb6ca686-c49623a8_0
2025-09-30T14:52:33.447491Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:33.447575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895245837681708:7153]
2025-09-30T14:52:33.447594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 863 sessionId: src_id|d014cb87-11c0ef21-eb6ca686-c49623a8_0 is DEAD
2025-09-30T14:52:33.447732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d014cb87-11c0ef21-eb6ca686-c49623a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:33.447742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d014cb87-11c0ef21-eb6ca686-c49623a8_0] Write session will restart in 0.007095s
2025-09-30T14:52:33.447759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d014cb87-11c0ef21-eb6ca686-c49623a8_0] Write session: Do CDS request
2025-09-30T14:52:33.447763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d014cb87-11c0ef21-eb6ca686-c49623a8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:33.455674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d014cb87-11c0ef21-eb6ca686-c49623a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:33.455785Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:33.455799Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 864
2025-09-30T14:52:33.455907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 864 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:33.455939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 864 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:33.455948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=864 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:33.455952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:33.456332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 864 sessionId:  describe result for acl check
2025-09-30T14:52:33.456364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:33.456365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:33.456366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:33.456370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895245837681778:7508] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:33.456762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895245837681778:7508] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:33.459389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895245837681778:7508] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:33.462891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895245837681778:7508] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:33.462924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895245837681778:7508] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:33.462928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895245837681778:7508] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:33.462939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 864 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:33.464841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:33.466762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:33.467031Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:33.467044Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:33.467057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:33.467121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:33.467165Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895245747950402:6121]
2025-09-30T14:52:33.467865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:33.468184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:33.468242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:33.468615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:33.468690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:33.468697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:33.468698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:33.468699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:33.468700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:33.468702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:33.468706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:33.468707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:33.468710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:33.468711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:33.468712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.468714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.468717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.468718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:33.468720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:33.468725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:33.468735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:33.468739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:33.468743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:33.468745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:33.468748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:33.468750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:33.468752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:33.468754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:33.468758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:33.468769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.468772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.468775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.468779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:33.468786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:33.468794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:33.468805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:33.468815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:33.468824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:33.468829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:33.468839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:33.468843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:33.468848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:33.468858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:33.468867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:33.468873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:33.468882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:33.468889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:33.468897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:33.468901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:33.468910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:33.468918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:33.468926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:33.468935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:33.468940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:33.468949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.468953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.468961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.468968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.468975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.468985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.468994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:33.468998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:33.469006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:33.469012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:33.469052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:33.474241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:33.475864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:33.475877Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:33.475879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:33.475882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:33.475886Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 863 [2:7555895245747950402:6121]
2025-09-30T14:52:33.475898Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:33.475910Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:33.475913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:33.475915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:33.475917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:33.475930Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:33.475934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:33.475939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:33.475984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.475989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.475992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.475995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:33.475997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:33.476052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:33.476058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.476066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.476072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.476081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:33.476097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895245747950397:6121]
2025-09-30T14:52:33.476102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895245747950397:6121]
2025-09-30T14:52:33.476105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895245747950397:6121]
2025-09-30T14:52:33.476114Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:33.476124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:33.476126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:33.476130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:33.476132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:33.476136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:33.476138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:33.476146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895245837681709:2454], now have 1 active actors on pipe
2025-09-30T14:52:33.476148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895245837682025:7508], now have 1 active actors on pipe
2025-09-30T14:52:33.476194Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 863
2025-09-30T14:52:33.476207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 863
2025-09-30T14:52:33.476559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895245747950397:6121]
2025-09-30T14:52:33.476569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:33.476592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:33.476599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:33.476601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:33.476626Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|221d7600-a3e4f1a-399e68a1-cec2d7b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:33.476636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:33.476639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:33.476640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:33.476647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:33.476654Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:33.476670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:33.476833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:33.476838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:33.476848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:33.476915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 864 partition: 0 MaxSeqNo: 42 sessionId: src_id|221d7600-a3e4f1a-399e68a1-cec2d7b2_0
2025-09-30T14:52:33.477245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d014cb87-11c0ef21-eb6ca686-c49623a8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|221d7600-a3e4f1a-399e68a1-cec2d7b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:33.484621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|221d7600-a3e4f1a-399e68a1-cec2d7b2_0] Write session: try to update token
2025-09-30T14:52:33.484639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|221d7600-a3e4f1a-399e68a1-cec2d7b2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:33.488007Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:33.488027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:33.488030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:33.488032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:33.488041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895245747950397:6121]
2025-09-30T14:52:33.488045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895245747950397:6121]
2025-09-30T14:52:33.488049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895245747950397:6121]
2025-09-30T14:52:33.488084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:33.488085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:33.488089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:33.488091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.488092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:33.488093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:33.488413Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:33.502050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 864 sessionId: src_id|221d7600-a3e4f1a-399e68a1-cec2d7b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:33.504664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:33.524586Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:11802 } ]
2025-09-30T14:52:33.547987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895245837682041:7153]
2025-09-30T14:52:33.548263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 863, pipe: [1:7555895245837682041:7153]
2025-09-30T14:52:33.596113Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:33.596420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:33.596437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:33.596461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895245837682041:7153], now have 1 active actors on pipe
2025-09-30T14:52:33.596701Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:33.596718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:33.596718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:33.596723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:33.596768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895245837682041:7153]
2025-09-30T14:52:33.596802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 864 reason: error at write: Disconnected sessionId: src_id|221d7600-a3e4f1a-399e68a1-cec2d7b2_0
2025-09-30T14:52:33.596979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 864 sessionId: src_id|221d7600-a3e4f1a-399e68a1-cec2d7b2_0 is DEAD
2025-09-30T14:52:33.597128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|221d7600-a3e4f1a-399e68a1-cec2d7b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:33.597137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|221d7600-a3e4f1a-399e68a1-cec2d7b2_0] Write session will restart in 0.005606s
2025-09-30T14:52:33.597165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|221d7600-a3e4f1a-399e68a1-cec2d7b2_0] Write session: Do CDS request
2025-09-30T14:52:33.597171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|221d7600-a3e4f1a-399e68a1-cec2d7b2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:33.603703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|221d7600-a3e4f1a-399e68a1-cec2d7b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:33.603785Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:33.603806Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 865
2025-09-30T14:52:33.603918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 865 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:33.603963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 865 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:33.603973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=865 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:33.603976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:33.604434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 865 sessionId:  describe result for acl check
2025-09-30T14:52:33.604462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:33.604469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:33.604474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:33.604479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895245837682124:7513] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:33.605015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895245837682124:7513] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:33.607262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895245837682124:7513] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:33.609544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895245837682124:7513] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:33.609555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895245837682124:7513] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:33.609558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895245837682124:7513] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:33.609564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 865 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:33.611796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:33.612304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:33.612509Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:33.612521Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:33.612533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:33.612595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:33.612626Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895245747950599:6124]
2025-09-30T14:52:33.613187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:33.613496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:33.613530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:33.613767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:33.613808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:33.613812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:33.613813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:33.613814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:33.613815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:33.613815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:33.613816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:33.613816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:33.613817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:33.613818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:33.613819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.613819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.613820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.613821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:33.613821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:33.613825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:33.613832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:33.613834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:33.613837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:33.613839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:33.613842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:33.613844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:33.613847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:33.613849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:33.613851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:33.613854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.613856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.613859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.613861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:33.613863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:33.613870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:33.613875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:33.613878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:33.613881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:33.613884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:33.613887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:33.613889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:33.613892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:33.613895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:33.613898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:33.613900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:33.613903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:33.613905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:33.613908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:33.613911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:33.613913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:33.613916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:33.613919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:33.613922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:33.613928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:33.613933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.613937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.613942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.613947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.613951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.613954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.613957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:33.613959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:33.613962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:33.613965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:33.613987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:33.619131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:33.620544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:33.620561Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:33.620564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:33.620568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:33.620575Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 864 [2:7555895245747950599:6124]
2025-09-30T14:52:33.620590Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:33.620604Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:33.620607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:33.620611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:33.620613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:33.620628Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:33.620634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:33.620641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:33.620696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.620704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.620706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.620709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:33.620712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:33.620775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:33.620784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.620794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.620806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.620823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:33.620842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895245837682042:2454], now have 1 active actors on pipe
2025-09-30T14:52:33.620850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895245837682359:7513], now have 1 active actors on pipe
2025-09-30T14:52:33.620856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895245747950594:6124]
2025-09-30T14:52:33.620862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895245747950594:6124]
2025-09-30T14:52:33.620864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895245747950594:6124]
2025-09-30T14:52:33.620876Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:33.620890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:33.620893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:33.620901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:33.620902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:33.620906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:33.620908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:33.620937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895245747950594:6124]
2025-09-30T14:52:33.620946Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:33.620950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:33.620927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 864
2025-09-30T14:52:33.620929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 864
2025-09-30T14:52:33.620979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:33.620986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:33.621004Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96a98ed8-dcfd7a01-515c9929-30a9a8f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:33.621015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:33.621017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:33.621019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:33.621027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:33.621036Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:33.621056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:33.621235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:33.621247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:33.621266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:33.621394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 865 partition: 0 MaxSeqNo: 42 sessionId: src_id|96a98ed8-dcfd7a01-515c9929-30a9a8f4_0
2025-09-30T14:52:33.621729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|221d7600-a3e4f1a-399e68a1-cec2d7b2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|96a98ed8-dcfd7a01-515c9929-30a9a8f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:33.624316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96a98ed8-dcfd7a01-515c9929-30a9a8f4_0] Write session: try to update token
2025-09-30T14:52:33.624330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96a98ed8-dcfd7a01-515c9929-30a9a8f4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:33.632715Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:33.632732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:33.632734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:33.632736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:33.632744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895245747950594:6124]
2025-09-30T14:52:33.632747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895245747950594:6124]
2025-09-30T14:52:33.632750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895245747950594:6124]
2025-09-30T14:52:33.632783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:33.632788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.632790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:33.632794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:33.632800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:33.632805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:33.632916Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:33.638689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 865 sessionId: src_id|96a98ed8-dcfd7a01-515c9929-30a9a8f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:33.641318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:33.696969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895245837682373:7153]
2025-09-30T14:52:33.697257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 864, pipe: [1:7555895245837682373:7153]
2025-09-30T14:52:33.736498Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:33.736753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:33.736766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:33.736798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895245837682373:7153], now have 1 active actors on pipe
2025-09-30T14:52:33.737091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:33.737096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895245837682373:7153]
2025-09-30T14:52:33.737118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:33.737167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 865 reason: status is not ok: tablet will be restarted right now sessionId: src_id|96a98ed8-dcfd7a01-515c9929-30a9a8f4_0
2025-09-30T14:52:33.736973Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:33.737317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 865 sessionId: src_id|96a98ed8-dcfd7a01-515c9929-30a9a8f4_0 is DEAD
2025-09-30T14:52:33.737436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96a98ed8-dcfd7a01-515c9929-30a9a8f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:33.737446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96a98ed8-dcfd7a01-515c9929-30a9a8f4_0] Write session will restart in 0.005600s
2025-09-30T14:52:33.737462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96a98ed8-dcfd7a01-515c9929-30a9a8f4_0] Write session: Do CDS request
2025-09-30T14:52:33.737467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96a98ed8-dcfd7a01-515c9929-30a9a8f4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:33.743600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96a98ed8-dcfd7a01-515c9929-30a9a8f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:33.743722Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:33.743738Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 866
2025-09-30T14:52:33.743853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 866 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:33.743884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 866 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:33.743895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=866 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:33.743898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:33.744283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 866 sessionId:  describe result for acl check
2025-09-30T14:52:33.744312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:33.744318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:33.744320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:33.744326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895245837682455:7517] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:33.744824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895245837682455:7517] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:33.746861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895245837682455:7517] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:33.749146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895245837682455:7517] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:33.749160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895245837682455:7517] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:33.749162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895245837682455:7517] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:33.749172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 866 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:33.750836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:33.751207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:33.751365Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:33.751375Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:33.751386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:33.751429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:33.751462Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895245747950795:6126]
2025-09-30T14:52:33.752111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:33.752370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:33.752408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:33.752719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:33.752767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:33.752772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:33.752773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:33.752775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:33.752776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:33.752777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:33.752779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:33.752780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:33.752781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:33.752782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:33.752783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.752785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.752786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.752787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:33.752788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:33.752793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:33.752804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:33.752808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:33.752813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:33.752817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:33.752822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:33.752826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:33.752830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:33.752839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:33.752844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:33.752852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.752857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.752866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.752871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:33.752879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:33.752889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:33.752902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:33.752912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:33.752922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:33.752931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:33.752941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:33.752949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:33.752959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:33.752968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:33.752978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:33.752982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:33.752992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:33.753001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:33.753011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:33.753016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:33.753022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:33.753027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:33.753033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:33.753038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:33.753044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:33.753048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.753054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.753062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.753068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.753077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.753087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.753095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:33.753104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:33.753114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:33.753124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:33.753174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:33.758331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:33.759766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:33.759778Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:33.759780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:33.759784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:33.759791Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 865 [2:7555895245747950795:6126]
2025-09-30T14:52:33.759804Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:33.759817Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:33.759821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:33.759823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:33.759826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:33.759839Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:33.759851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:33.759858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:33.759913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.759920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.759921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.759925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:33.759928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:33.759987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:33.759994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.760007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.760026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.760050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:33.760072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895245837682692:7517], now have 1 active actors on pipe
2025-09-30T14:52:33.760076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895245837682374:2454], now have 1 active actors on pipe
2025-09-30T14:52:33.760081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895245747950790:6126]
2025-09-30T14:52:33.760083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895245747950790:6126]
2025-09-30T14:52:33.760085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895245747950790:6126]
2025-09-30T14:52:33.760097Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:33.760111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:33.760117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:33.760121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:33.760123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:33.760126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:33.760129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:33.760152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895245747950790:6126]
2025-09-30T14:52:33.760155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:33.760164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:33.760140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 865
2025-09-30T14:52:33.760144Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 865
2025-09-30T14:52:33.760182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:33.760192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:33.760226Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a680472e-5ff0e821-772820fa-cdd47b69_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:33.760237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:33.760240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:33.760242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:33.760251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:33.760263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:33.760276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:33.760417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:33.760426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:33.760437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:33.760506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 866 partition: 0 MaxSeqNo: 42 sessionId: src_id|a680472e-5ff0e821-772820fa-cdd47b69_0
2025-09-30T14:52:33.760808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96a98ed8-dcfd7a01-515c9929-30a9a8f4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a680472e-5ff0e821-772820fa-cdd47b69_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:33.763472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a680472e-5ff0e821-772820fa-cdd47b69_0] Write session: try to update token
2025-09-30T14:52:33.763488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a680472e-5ff0e821-772820fa-cdd47b69_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:33.771774Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:33.771792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:33.771794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:33.771797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:33.771805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895245747950790:6126]
2025-09-30T14:52:33.771809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895245747950790:6126]
2025-09-30T14:52:33.771814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895245747950790:6126]
2025-09-30T14:52:33.771849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:33.771856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.771859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:33.771868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:33.771875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:33.771889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:33.771992Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:33.777415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 866 sessionId: src_id|a680472e-5ff0e821-772820fa-cdd47b69_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:33.780118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:33.837262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895245837682706:7153]
2025-09-30T14:52:33.837539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 865, pipe: [1:7555895245837682706:7153]
2025-09-30T14:52:33.888903Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:33.889288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:33.889302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:33.889334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895245837682706:7153], now have 1 active actors on pipe
2025-09-30T14:52:33.889530Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:33.889622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895245837682706:7153]
2025-09-30T14:52:33.889663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:33.889736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 866 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a680472e-5ff0e821-772820fa-cdd47b69_0
2025-09-30T14:52:33.889903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 866 sessionId: src_id|a680472e-5ff0e821-772820fa-cdd47b69_0 is DEAD
2025-09-30T14:52:33.890082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:33.890103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a680472e-5ff0e821-772820fa-cdd47b69_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:33.890112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a680472e-5ff0e821-772820fa-cdd47b69_0] Write session will restart in 0.005722s
2025-09-30T14:52:33.890128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a680472e-5ff0e821-772820fa-cdd47b69_0] Write session: Do CDS request
2025-09-30T14:52:33.890132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a680472e-5ff0e821-772820fa-cdd47b69_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:33.896837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a680472e-5ff0e821-772820fa-cdd47b69_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:33.896922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:33.896939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 867
2025-09-30T14:52:33.897062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 867 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:33.897087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 867 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:33.897094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=867 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:33.897096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:33.897431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 867 sessionId:  describe result for acl check
2025-09-30T14:52:33.897467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:33.897473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:33.897475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:33.897481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895245837682807:7527] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:33.897930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895245837682807:7527] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:33.899959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895245837682807:7527] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:33.902311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895245837682807:7527] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:33.902323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895245837682807:7527] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:33.902325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895245837682807:7527] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:33.902330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 867 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:33.903443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:33.905050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:33.905209Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:33.905218Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:33.905228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:33.905266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:33.905302Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895245747951003:6134]
2025-09-30T14:52:33.905952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:33.906221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:33.906254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:33.906569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:33.906620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:33.906632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:33.906633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:33.906634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:33.906635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:33.906636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:33.906638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:33.906639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:33.906640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:33.906641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:33.906642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.906644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.906645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.906646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:33.906647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:33.906651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:33.906661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:33.906666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:33.906671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:33.906675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:33.906680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:33.906684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:33.906688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:33.906692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:33.906697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:33.906702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.906706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.906710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.906715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:33.906719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:33.906726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:33.906733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:33.906739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:33.906745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:33.906750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:33.906756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:33.906765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:33.906771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:33.906780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:33.906790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:33.906798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:33.906808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:33.906817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:33.906823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:33.906832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:33.906838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:33.906843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:33.906848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:33.906856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:33.906863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:33.906871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.906877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.906885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.906891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.906899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.906904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.906914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:33.906919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:33.906924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:33.906930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:33.906983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:33.912017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:33.913511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:33.913524Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:33.913527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:33.913530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:33.913536Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 866 [2:7555895245747951003:6134]
2025-09-30T14:52:33.913549Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:33.913561Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:33.913564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:33.913567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:33.913569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:33.913581Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:33.913588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:33.913595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:33.913645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.913652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.913654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.913657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:33.913660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:33.913719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:33.913726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.913738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:33.913754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:33.913778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:33.913798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895245837682720:2454], now have 1 active actors on pipe
2025-09-30T14:52:33.913806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895245837683037:7527], now have 1 active actors on pipe
2025-09-30T14:52:33.913812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895245747950998:6134]
2025-09-30T14:52:33.913814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895245747950998:6134]
2025-09-30T14:52:33.913817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895245747950998:6134]
2025-09-30T14:52:33.913829Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:33.913847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:33.913848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:33.913851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:33.913853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:33.913867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:33.913870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:33.913897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895245747950998:6134]
2025-09-30T14:52:33.913874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 866
2025-09-30T14:52:33.913904Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:33.913916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:33.913929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 866
2025-09-30T14:52:33.913958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:33.913969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:33.913991Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aed1b89d-28497d4-aa7b2c51-5a59ff69_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:33.914001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:33.914005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:33.914007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:33.914015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:33.914023Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:33.914039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:33.914171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:33.914177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:33.914189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:33.914298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 867 partition: 0 MaxSeqNo: 42 sessionId: src_id|aed1b89d-28497d4-aa7b2c51-5a59ff69_0
2025-09-30T14:52:33.914617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a680472e-5ff0e821-772820fa-cdd47b69_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|aed1b89d-28497d4-aa7b2c51-5a59ff69_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:33.917294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aed1b89d-28497d4-aa7b2c51-5a59ff69_0] Write session: try to update token
2025-09-30T14:52:33.917311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aed1b89d-28497d4-aa7b2c51-5a59ff69_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:33.925454Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:33.925473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:33.925475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:33.925476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:33.925484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895245747950998:6134]
2025-09-30T14:52:33.925489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895245747950998:6134]
2025-09-30T14:52:33.925493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895245747950998:6134]
2025-09-30T14:52:33.925529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:33.925535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:33.925536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:33.925542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:33.925542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:33.925546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:33.925667Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:33.930297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 867 sessionId: src_id|aed1b89d-28497d4-aa7b2c51-5a59ff69_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:33.932682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:33.989813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895245837683061:7153]
2025-09-30T14:52:33.990077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 866, pipe: [1:7555895245837683061:7153]
2025-09-30T14:52:34.042842Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:34.043145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:34.043161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:34.043195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895245837683061:7153], now have 1 active actors on pipe
2025-09-30T14:52:34.043445Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:34.043456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:34.043489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895245837683061:7153]
2025-09-30T14:52:34.043513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:34.043591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 867 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aed1b89d-28497d4-aa7b2c51-5a59ff69_0
2025-09-30T14:52:34.043756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 867 sessionId: src_id|aed1b89d-28497d4-aa7b2c51-5a59ff69_0 is DEAD
2025-09-30T14:52:34.043889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aed1b89d-28497d4-aa7b2c51-5a59ff69_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:34.043900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aed1b89d-28497d4-aa7b2c51-5a59ff69_0] Write session will restart in 0.009759s
2025-09-30T14:52:34.043923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aed1b89d-28497d4-aa7b2c51-5a59ff69_0] Write session: Do CDS request
2025-09-30T14:52:34.043929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aed1b89d-28497d4-aa7b2c51-5a59ff69_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:34.054750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aed1b89d-28497d4-aa7b2c51-5a59ff69_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:34.054851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:34.054868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 868
2025-09-30T14:52:34.054972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 868 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:34.055006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 868 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:34.055011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=868 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:34.055014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:34.055467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 868 sessionId:  describe result for acl check
2025-09-30T14:52:34.055500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:34.055502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:34.055504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:34.055509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895250132650592:7535] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:34.056065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895250132650592:7535] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:34.058060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895250132650592:7535] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:34.058922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:34.060766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:34.060989Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:34.060999Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:34.061009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:34.061055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:34.061092Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895250042918530:6143]
2025-09-30T14:52:34.061124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895250132650592:7535] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:34.061136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895250132650592:7535] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:34.061139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895250132650592:7535] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:34.061144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 868 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:34.061747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:34.061987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:34.062021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:34.062348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:34.062401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:34.062407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:34.062408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:34.062409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:34.062411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:34.062412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:34.062413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:34.062414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:34.062416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:34.062417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:34.062418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.062419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.062421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.062422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:34.062423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:34.062428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:34.062439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:34.062443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:34.062448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:34.062453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:34.062457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:34.062461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:34.062466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:34.062470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:34.062476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:34.062485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.062490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.062494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.062501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:34.062509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:34.062517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:34.062529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:34.062540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:34.062545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:34.062555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:34.062564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:34.062573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:34.062583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:34.062592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:34.062602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:34.062610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:34.062616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:34.062625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:34.062631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:34.062641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:34.062646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:34.062655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:34.062664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:34.062673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:34.062682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:34.062691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.062703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.062708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.062718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.062726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.062736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.062741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:34.062750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:34.062755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:34.062761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:34.062812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:34.068048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:34.068836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:34.068848Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:34.068850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:34.068853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:34.068857Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 867 [2:7555895250042918530:6143]
2025-09-30T14:52:34.068867Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:34.068877Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:34.068879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:34.068881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:34.068882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:34.068894Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:34.068898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:34.068915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:34.068959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.068964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.068966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.068968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:34.068970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:34.069015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:34.069020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.069028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.069038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.069050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:34.069065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895250042918525:6143]
2025-09-30T14:52:34.069070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895250042918525:6143]
2025-09-30T14:52:34.069071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895250042918525:6143]
2025-09-30T14:52:34.069076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:34.069085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:34.069087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895250132650701:7535], now have 1 active actors on pipe
2025-09-30T14:52:34.069097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:34.069100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:34.069101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895250132650379:2454], now have 1 active actors on pipe
2025-09-30T14:52:34.069106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:34.069114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:34.069116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:34.069137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895250042918525:6143]
2025-09-30T14:52:34.069144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:34.069153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:34.069169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 867
2025-09-30T14:52:34.069216Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 867
2025-09-30T14:52:34.069245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:34.069251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:34.069275Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|176856dc-4fbf0dec-fd3894d5-a92ee9ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:34.069287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:34.069291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:34.069295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:34.069302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:34.069309Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:34.069321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:34.069479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:34.069484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:34.069493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:34.069573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 868 partition: 0 MaxSeqNo: 42 sessionId: src_id|176856dc-4fbf0dec-fd3894d5-a92ee9ca_0
2025-09-30T14:52:34.069871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aed1b89d-28497d4-aa7b2c51-5a59ff69_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|176856dc-4fbf0dec-fd3894d5-a92ee9ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:34.072407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|176856dc-4fbf0dec-fd3894d5-a92ee9ca_0] Write session: try to update token
2025-09-30T14:52:34.072423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|176856dc-4fbf0dec-fd3894d5-a92ee9ca_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:34.080771Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:34.080790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:34.080793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:34.080795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:34.080804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895250042918525:6143]
2025-09-30T14:52:34.080809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895250042918525:6143]
2025-09-30T14:52:34.080813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895250042918525:6143]
2025-09-30T14:52:34.080852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:34.080863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.080863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:34.080869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:34.080870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:34.080873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:34.081003Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:34.085131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 868 sessionId: src_id|176856dc-4fbf0dec-fd3894d5-a92ee9ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:34.087625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:34.143422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895250132650716:7153]
2025-09-30T14:52:34.143669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 867, pipe: [1:7555895250132650716:7153]
2025-09-30T14:52:34.198263Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:34.198981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:34.198994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:34.199030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895250132650716:7153], now have 1 active actors on pipe
2025-09-30T14:52:34.199235Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:34.199285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:34.199301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:34.199316Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:34.199357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 868 reason: error at write: Disconnected sessionId: src_id|176856dc-4fbf0dec-fd3894d5-a92ee9ca_0
2025-09-30T14:52:34.199362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895250132650716:7153]
2025-09-30T14:52:34.199497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 868 sessionId: src_id|176856dc-4fbf0dec-fd3894d5-a92ee9ca_0 is DEAD
2025-09-30T14:52:34.199622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|176856dc-4fbf0dec-fd3894d5-a92ee9ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:34.199629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|176856dc-4fbf0dec-fd3894d5-a92ee9ca_0] Write session will restart in 0.009052s
2025-09-30T14:52:34.199647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|176856dc-4fbf0dec-fd3894d5-a92ee9ca_0] Write session: Do CDS request
2025-09-30T14:52:34.199652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|176856dc-4fbf0dec-fd3894d5-a92ee9ca_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:34.209761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|176856dc-4fbf0dec-fd3894d5-a92ee9ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:34.209810Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:34.209824Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 869
2025-09-30T14:52:34.209990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 869 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:34.210012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 869 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:34.210016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=869 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:34.210020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:34.210326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 869 sessionId:  describe result for acl check
2025-09-30T14:52:34.210351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:34.210357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:34.210358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:34.210363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895250132651002:7539] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:34.210784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895250132651002:7539] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:34.212913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895250132651002:7539] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:34.213612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:34.214093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:34.214276Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:34.214285Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:34.214294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:34.214339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:34.214377Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895250042918730:6146]
2025-09-30T14:52:34.215037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:34.215356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:34.215395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:34.215481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895250132651002:7539] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:34.215497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895250132651002:7539] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:34.215500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895250132651002:7539] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:34.215511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 869 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:34.215723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:34.215778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:34.215784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:34.215785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:34.215786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:34.215788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:34.215789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:34.215790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:34.215791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:34.215792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:34.215794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:34.215795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.215796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.215797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.215798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:34.215800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:34.215805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:34.215817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:34.215821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:34.215826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:34.215830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:34.215835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:34.215839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:34.215844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:34.215848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:34.215853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:34.215858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.215862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.215867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.215871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:34.215875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:34.215882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:34.215890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:34.215901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:34.215908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:34.215917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:34.215923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:34.215928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:34.215934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:34.215943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:34.215949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:34.215958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:34.215969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:34.215979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:34.215988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:34.215997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:34.216005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:34.216013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:34.216019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:34.216028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:34.216035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:34.216044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.216053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.216062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.216067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.216076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.216082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.216090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:34.216096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:34.216106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:34.216112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:34.216164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:34.221335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:34.222708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:34.222722Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:34.222724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:34.222728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:34.222734Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 868 [2:7555895250042918730:6146]
2025-09-30T14:52:34.222749Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:34.222762Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:34.222765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:34.222767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:34.222770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:34.222784Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:34.222790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:34.222803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:34.222858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.222866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.222868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.222872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:34.222874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:34.222936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:34.222943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.222955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.222969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.222993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:34.223014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895250132651042:7539], now have 1 active actors on pipe
2025-09-30T14:52:34.223022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895250132650717:2454], now have 1 active actors on pipe
2025-09-30T14:52:34.223028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895250042918725:6146]
2025-09-30T14:52:34.223035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895250042918725:6146]
2025-09-30T14:52:34.223037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895250042918725:6146]
2025-09-30T14:52:34.223051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:34.223061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:34.223067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:34.223068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:34.223070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:34.223083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:34.223085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:34.223057Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 868
2025-09-30T14:52:34.223069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 868
2025-09-30T14:52:34.223114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895250042918725:6146]
2025-09-30T14:52:34.223125Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:34.223129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:34.223146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:34.223154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:34.223194Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c48442e3-a046c6c-9cfb7a4f-314e946d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:34.223205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:34.223208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:34.223210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:34.223219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:34.223231Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:34.223272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:34.223446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:34.223458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:34.223471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:34.223541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 869 partition: 0 MaxSeqNo: 42 sessionId: src_id|c48442e3-a046c6c-9cfb7a4f-314e946d_0
2025-09-30T14:52:34.223892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|176856dc-4fbf0dec-fd3894d5-a92ee9ca_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c48442e3-a046c6c-9cfb7a4f-314e946d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:34.226482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c48442e3-a046c6c-9cfb7a4f-314e946d_0] Write session: try to update token
2025-09-30T14:52:34.226497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c48442e3-a046c6c-9cfb7a4f-314e946d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:34.234668Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:34.234689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:34.234692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:34.234694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:34.234704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895250042918725:6146]
2025-09-30T14:52:34.234708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895250042918725:6146]
2025-09-30T14:52:34.234712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895250042918725:6146]
2025-09-30T14:52:34.234753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:34.234765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.234768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:34.234768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:34.234775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:34.234779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:34.234898Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:34.239569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 869 sessionId: src_id|c48442e3-a046c6c-9cfb7a4f-314e946d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:34.242208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:34.299549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895250132651052:7153]
2025-09-30T14:52:34.299794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 868, pipe: [1:7555895250132651052:7153]
2025-09-30T14:52:34.340625Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:34.341151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:34.341167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:34.341205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895250132651052:7153], now have 1 active actors on pipe
2025-09-30T14:52:34.341374Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:34.341446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895250132651052:7153]
2025-09-30T14:52:34.341460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:34.341472Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:34.341537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 869 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c48442e3-a046c6c-9cfb7a4f-314e946d_0
2025-09-30T14:52:34.341706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 869 sessionId: src_id|c48442e3-a046c6c-9cfb7a4f-314e946d_0 is DEAD
2025-09-30T14:52:34.341825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c48442e3-a046c6c-9cfb7a4f-314e946d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:34.341833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c48442e3-a046c6c-9cfb7a4f-314e946d_0] Write session will restart in 0.005181s
2025-09-30T14:52:34.341857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c48442e3-a046c6c-9cfb7a4f-314e946d_0] Write session: Do CDS request
2025-09-30T14:52:34.341861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c48442e3-a046c6c-9cfb7a4f-314e946d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:34.347585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c48442e3-a046c6c-9cfb7a4f-314e946d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:34.347694Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:34.347708Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 870
2025-09-30T14:52:34.347840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 870 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:34.347869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 870 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:34.347882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=870 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:34.347885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:34.348277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 870 sessionId:  describe result for acl check
2025-09-30T14:52:34.348319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:34.348326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:34.348327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:34.348333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895250132651104:7543] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:34.348783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895250132651104:7543] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:34.350597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895250132651104:7543] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:34.352936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895250132651104:7543] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:34.352949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895250132651104:7543] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:34.352953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895250132651104:7543] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:34.352960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 870 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:34.354678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:34.356465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:34.356613Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:34.356620Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:34.356627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:34.356661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:34.356688Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895250042918930:6148]
2025-09-30T14:52:34.357112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:34.357344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:34.357373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:34.357579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:34.357616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:34.357623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:34.357624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:34.357624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:34.357625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:34.357625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:34.357626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:34.357627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:34.357627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:34.357628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:34.357629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.357629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.357630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.357631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:34.357631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:34.357634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:34.357641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:34.357643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:34.357646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:34.357648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:34.357651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:34.357653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:34.357655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:34.357657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:34.357660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:34.357662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.357664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.357667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.357669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:34.357671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:34.357676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:34.357680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:34.357684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:34.357687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:34.357689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:34.357692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:34.357695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:34.357697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:34.357700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:34.357703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:34.357705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:34.357708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:34.357711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:34.357714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:34.357716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:34.357719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:34.357722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:34.357724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:34.357727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:34.357729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:34.357732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.357734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.357737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.357740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.357756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.357759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.357762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:34.357765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:34.357767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:34.357770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:34.357796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:34.362875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:34.364109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:34.364119Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:34.364121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:34.364124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:34.364129Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 869 [2:7555895250042918930:6148]
2025-09-30T14:52:34.364139Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:34.364150Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:34.364152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:34.364154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:34.364155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:34.364166Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:34.364170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:34.364175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:34.364232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.364240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.364242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.364245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:34.364247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:34.364297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:34.364303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.364311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.364318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.364327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:34.364339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895250042918925:6148]
2025-09-30T14:52:34.364340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895250042918925:6148]
2025-09-30T14:52:34.364341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895250042918925:6148]
2025-09-30T14:52:34.364347Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:34.364356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:34.364358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895250132651373:7543], now have 1 active actors on pipe
2025-09-30T14:52:34.364359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:34.364360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:34.364364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:34.364372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:34.364374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:34.364378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895250132651053:2454], now have 1 active actors on pipe
2025-09-30T14:52:34.364396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895250042918925:6148]
2025-09-30T14:52:34.364402Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:34.364421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:34.364472Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 869
2025-09-30T14:52:34.364535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 869
2025-09-30T14:52:34.364569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:34.364579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:34.364602Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|350e9281-6c378e96-3e433d8b-a18b8734_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:34.364613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:34.364616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:34.364620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:34.364630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:34.364644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:34.364660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:34.364836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:34.364851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:34.364888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:34.364976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 870 partition: 0 MaxSeqNo: 42 sessionId: src_id|350e9281-6c378e96-3e433d8b-a18b8734_0
2025-09-30T14:52:34.365300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c48442e3-a046c6c-9cfb7a4f-314e946d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|350e9281-6c378e96-3e433d8b-a18b8734_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:34.368044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|350e9281-6c378e96-3e433d8b-a18b8734_0] Write session: try to update token
2025-09-30T14:52:34.368074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|350e9281-6c378e96-3e433d8b-a18b8734_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:34.380728Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:34.380746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:34.380754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895250042918925:6148]
2025-09-30T14:52:34.380791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:34.380799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:34.380943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:34.381073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:34.381200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:34.381335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:34.381510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:34.381551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:34.381986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 870 sessionId: src_id|350e9281-6c378e96-3e433d8b-a18b8734_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:34.384460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:34.384637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:34.384659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:34.384684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:34.384776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:34.385918Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:34.385933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:34.385936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:34.385937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:34.385946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895250042918925:6148]
2025-09-30T14:52:34.385950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895250042918925:6148]
2025-09-30T14:52:34.385954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895250042918925:6148]
2025-09-30T14:52:34.385984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:34.385994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.385996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:34.385997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:34.386002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:34.386005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:34.386107Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:34.441407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895250132651388:7153]
2025-09-30T14:52:34.442137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 869, pipe: [1:7555895250132651388:7153]
2025-09-30T14:52:34.488167Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:34.494607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:34.494630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:34.494770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:34.494825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:34.494883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:34.494941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:34.494983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:34.494991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:34.495051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:34.495108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:34.495162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:34.495220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:34.495357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:34.495365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:34.495424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:34.495479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:34.495536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:34.495592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:34.495637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:34.495645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:34.495710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:34.495765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:34.495818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:34.495909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:34.495950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:34.495956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:34.496040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:34.496093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:34.496151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:34.496227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:34.496271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:34.496278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:34.496344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:34.496396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:34.496449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:34.496505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:34.496545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:34.496551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:34.496608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:34.496661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:34.496717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:34.496774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:34.496812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:34.496818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:34.496878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:34.496929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:34.496984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:34.497039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:34.497079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:34.497085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:34.497143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:34.497195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:34.497250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:34.497305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:34.497427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:34.497433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:34.497492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:34.497545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:34.497600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:34.497654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:34.497694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:34.497700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:34.497744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895250132651388:7153], now have 1 active actors on pipe
2025-09-30T14:52:34.497956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:34.497976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:34.497983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:34.498004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 870 reason: error at write: Disconnected sessionId: src_id|350e9281-6c378e96-3e433d8b-a18b8734_0
2025-09-30T14:52:34.498044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895250132651388:7153]
2025-09-30T14:52:34.498169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 870 sessionId: src_id|350e9281-6c378e96-3e433d8b-a18b8734_0 is DEAD
2025-09-30T14:52:34.498327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|350e9281-6c378e96-3e433d8b-a18b8734_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:34.498336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|350e9281-6c378e96-3e433d8b-a18b8734_0] Write session will restart in 0.006424s
2025-09-30T14:52:34.498354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|350e9281-6c378e96-3e433d8b-a18b8734_0] Write session: Do CDS request
2025-09-30T14:52:34.498358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|350e9281-6c378e96-3e433d8b-a18b8734_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:34.498862Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:34.505677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|350e9281-6c378e96-3e433d8b-a18b8734_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:34.505755Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:34.505771Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 871
2025-09-30T14:52:34.505882Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 871 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:34.505912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 871 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:34.505922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=871 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:34.505926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:34.506312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 871 sessionId:  describe result for acl check
2025-09-30T14:52:34.506338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:34.506347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:34.506348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:34.506353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895250132651458:7548] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:34.506871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895250132651458:7548] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:34.509255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895250132651458:7548] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:34.512175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895250132651458:7548] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:34.512188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895250132651458:7548] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:34.512191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895250132651458:7548] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:34.512199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 871 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:34.515378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:34.515926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:34.516076Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:34.516089Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:34.516099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:34.516147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:34.516188Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895250042919130:6150]
2025-09-30T14:52:34.516704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:34.517050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:34.517102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:34.517410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:34.517467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:34.517473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:34.517474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:34.517476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:34.517477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:34.517478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:34.517479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:34.517481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:34.517482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:34.517483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:34.517485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.517486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.517487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.517489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:34.517490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:34.517495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:34.517506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:34.517510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:34.517514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:34.517519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:34.517527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:34.517531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:34.517535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:34.517539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:34.517543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:34.517552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.517556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.517564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.517568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:34.517577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:34.517584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:34.517595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:34.517606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:34.517616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:34.517623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:34.517626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:34.517629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:34.517632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:34.517638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:34.517642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:34.517644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:34.517648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:34.517651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:34.517654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:34.517659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:34.517665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:34.517668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:34.517671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:34.517677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:34.517680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:34.517682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.517686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.517694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.517704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.517711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.517714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.517716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:34.517719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:34.517725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:34.517728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:34.517754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:34.522968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:34.523842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:34.523854Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:34.523856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:34.523860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:34.523865Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 870 [2:7555895250042919130:6150]
2025-09-30T14:52:34.523878Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:34.523891Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:34.523897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:34.523899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:34.523901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:34.523913Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:34.523924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:34.523930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:34.523975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.523981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.523983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.523986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:34.523988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:34.524035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:34.524041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.524049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.524056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.524069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:34.524081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895250042919125:6150]
2025-09-30T14:52:34.524086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895250042919125:6150]
2025-09-30T14:52:34.524088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895250042919125:6150]
2025-09-30T14:52:34.524095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:34.524105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:34.524107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:34.524112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:34.524114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:34.524115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:34.524117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:34.524125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895250132651714:7548], now have 1 active actors on pipe
2025-09-30T14:52:34.524128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895250132651392:2454], now have 1 active actors on pipe
2025-09-30T14:52:34.524151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895250042919125:6150]
2025-09-30T14:52:34.524164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:34.524190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:34.524195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 870
2025-09-30T14:52:34.524202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 870
2025-09-30T14:52:34.524262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:34.524270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:34.524289Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5199d3ed-3a9852bc-6006c986-128cfa26_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:34.524298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:34.524301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:34.524302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:34.524310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:34.524319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:34.524332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:34.524483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:34.524490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:34.524502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:34.524599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 871 partition: 0 MaxSeqNo: 42 sessionId: src_id|5199d3ed-3a9852bc-6006c986-128cfa26_0
2025-09-30T14:52:34.524950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|350e9281-6c378e96-3e433d8b-a18b8734_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5199d3ed-3a9852bc-6006c986-128cfa26_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:34.527539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5199d3ed-3a9852bc-6006c986-128cfa26_0] Write session: try to update token
2025-09-30T14:52:34.527555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5199d3ed-3a9852bc-6006c986-128cfa26_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:34.535822Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:34.535838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:34.535840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:34.535842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:34.535850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895250042919125:6150]
2025-09-30T14:52:34.535854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895250042919125:6150]
2025-09-30T14:52:34.535857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895250042919125:6150]
2025-09-30T14:52:34.535896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:34.535897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:34.535904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.535904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:34.535907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:34.535909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:34.536057Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:34.541304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 871 sessionId: src_id|5199d3ed-3a9852bc-6006c986-128cfa26_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:34.543959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:34.598067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895250132651728:7153]
2025-09-30T14:52:34.598339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 870, pipe: [1:7555895250132651728:7153]
2025-09-30T14:52:34.640294Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:34.640532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:34.640544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:34.640575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895250132651728:7153], now have 1 active actors on pipe
2025-09-30T14:52:34.640854Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:34.640854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:34.640859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:34.640913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895250132651728:7153]
2025-09-30T14:52:34.640920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 871 reason: error at write: Disconnected sessionId: src_id|5199d3ed-3a9852bc-6006c986-128cfa26_0
2025-09-30T14:52:34.640896Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:34.641067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 871 sessionId: src_id|5199d3ed-3a9852bc-6006c986-128cfa26_0 is DEAD
2025-09-30T14:52:34.641193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5199d3ed-3a9852bc-6006c986-128cfa26_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:34.641205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5199d3ed-3a9852bc-6006c986-128cfa26_0] Write session will restart in 0.005455s
2025-09-30T14:52:34.641227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5199d3ed-3a9852bc-6006c986-128cfa26_0] Write session: Do CDS request
2025-09-30T14:52:34.641236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5199d3ed-3a9852bc-6006c986-128cfa26_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:34.647638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5199d3ed-3a9852bc-6006c986-128cfa26_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:34.647707Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:34.647723Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 872
2025-09-30T14:52:34.647839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 872 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:34.647868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 872 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:34.647876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=872 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:34.647879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:34.648199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 872 sessionId:  describe result for acl check
2025-09-30T14:52:34.648236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:34.648242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:34.648244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:34.648249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895250132651795:7552] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:34.648664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895250132651795:7552] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:34.650561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895250132651795:7552] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:34.652889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895250132651795:7552] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:34.652900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895250132651795:7552] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:34.652902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895250132651795:7552] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:34.652907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 872 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:34.656832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:34.657266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:34.657400Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:34.657409Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:34.657418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:34.657454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:34.657484Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895250042919333:6153]
2025-09-30T14:52:34.657935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:34.658231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:34.658308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:34.658582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:34.658629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:34.658634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:34.658635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:34.658636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:34.658637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:34.658638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:34.658638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:34.658639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:34.658640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:34.658640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:34.658641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.658642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.658642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.658643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:34.658644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:34.658647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:34.658654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:34.658657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:34.658659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:34.658662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:34.658664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:34.658667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:34.658669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:34.658671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:34.658673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:34.658676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.658678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.658680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.658683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:34.658685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:34.658691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:34.658696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:34.658700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:34.658704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:34.658706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:34.658709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:34.658712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:34.658715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:34.658718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:34.658721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:34.658724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:34.658727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:34.658729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:34.658732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:34.658735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:34.658738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:34.658741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:34.658746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:34.658750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:34.658755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:34.658759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.658764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.658768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.658773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.658778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.658787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.658795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:34.658799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:34.658803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:34.658807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:34.658830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:34.663918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:34.664757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:34.664775Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:34.664788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:34.664792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:34.664798Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 871 [2:7555895250042919333:6153]
2025-09-30T14:52:34.664809Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:34.664821Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:34.664826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:34.664829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:34.664830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:34.664841Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:34.664846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:34.664851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:34.664894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.664901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.664902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.664905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:34.664906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:34.664954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:34.664960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.664968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.664974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.664988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:34.665004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895250042919328:6153]
2025-09-30T14:52:34.665013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895250042919328:6153]
2025-09-30T14:52:34.665015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895250042919328:6153]
2025-09-30T14:52:34.665023Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:34.665032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:34.665036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:34.665045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:34.665045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:34.665047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:34.665047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:34.665079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895250132652053:7552], now have 1 active actors on pipe
2025-09-30T14:52:34.665088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895250132651730:2454], now have 1 active actors on pipe
2025-09-30T14:52:34.665091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895250042919328:6153]
2025-09-30T14:52:34.665099Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:34.665115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:34.665172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 871
2025-09-30T14:52:34.665173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 871
2025-09-30T14:52:34.665231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:34.665238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:34.665257Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eaf6562b-c2b876a4-228752a5-3dec7fb7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:34.665262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:34.665264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:34.665266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:34.665272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:34.665279Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:34.665288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:34.665443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:34.665456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:34.665486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:34.665582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 872 partition: 0 MaxSeqNo: 42 sessionId: src_id|eaf6562b-c2b876a4-228752a5-3dec7fb7_0
2025-09-30T14:52:34.665911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5199d3ed-3a9852bc-6006c986-128cfa26_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|eaf6562b-c2b876a4-228752a5-3dec7fb7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:34.668704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf6562b-c2b876a4-228752a5-3dec7fb7_0] Write session: try to update token
2025-09-30T14:52:34.668722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf6562b-c2b876a4-228752a5-3dec7fb7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:34.676801Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:34.676820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:34.676833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895250042919328:6153]
2025-09-30T14:52:34.676890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:34.676892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:34.677155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:34.677376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:34.677562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:34.677706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:34.677941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:34.677974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:34.682120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 872 sessionId: src_id|eaf6562b-c2b876a4-228752a5-3dec7fb7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:34.684421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:34.684650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:34.684668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:34.684701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:34.684795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:34.686789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:34.686805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:34.686808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:34.686810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:34.686820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895250042919328:6153]
2025-09-30T14:52:34.686825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895250042919328:6153]
2025-09-30T14:52:34.686829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895250042919328:6153]
2025-09-30T14:52:34.686865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:34.686881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.686884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:34.686894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:34.686900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:34.686904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:34.687019Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:34.740916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895250132652067:7153]
2025-09-30T14:52:34.741235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 871, pipe: [1:7555895250132652067:7153]
2025-09-30T14:52:34.790221Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:34.798903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:34.798931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:34.799101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:34.799173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:34.799261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:34.799337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:34.799645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:34.799661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:34.799737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:34.799803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:34.799866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:34.799933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:34.799981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:34.799990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:34.800063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:34.800128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:34.800196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:34.800266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:34.800314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:34.800334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:34.800440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:34.800513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:34.800578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:34.800653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:34.800700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:34.800709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:34.800780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:34.800846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:34.800914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:34.801028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:34.801077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:34.801086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:34.801193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:34.801259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:34.801331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:34.801420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:34.801483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:34.801497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:34.801566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:34.801635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:34.801708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:34.801773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:34.801817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:34.801825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:34.801934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:34.802033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:34.802132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:34.802199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:34.802248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:34.802256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:34.802335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:34.802404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:34.802467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:34.802534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:34.802583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:34.802592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:34.802664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:34.802730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:34.802803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:34.802878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:34.803017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:34.803026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:34.803085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895250132652067:7153], now have 1 active actors on pipe
2025-09-30T14:52:34.803293Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:34.803299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:34.803304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:34.803332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 872 reason: error at write: Disconnected sessionId: src_id|eaf6562b-c2b876a4-228752a5-3dec7fb7_0
2025-09-30T14:52:34.803360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895250132652067:7153]
2025-09-30T14:52:34.803475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 872 sessionId: src_id|eaf6562b-c2b876a4-228752a5-3dec7fb7_0 is DEAD
2025-09-30T14:52:34.803625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf6562b-c2b876a4-228752a5-3dec7fb7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:34.803636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf6562b-c2b876a4-228752a5-3dec7fb7_0] Write session will restart in 0.008460s
2025-09-30T14:52:34.803660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf6562b-c2b876a4-228752a5-3dec7fb7_0] Write session: Do CDS request
2025-09-30T14:52:34.803666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf6562b-c2b876a4-228752a5-3dec7fb7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:34.803720Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:34.813696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf6562b-c2b876a4-228752a5-3dec7fb7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:34.813816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:34.813835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 873
2025-09-30T14:52:34.813935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 873 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:34.813961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 873 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:34.813966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=873 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:34.813970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:34.814352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 873 sessionId:  describe result for acl check
2025-09-30T14:52:34.814390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:34.814395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:34.814396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:34.814400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895250132652350:7556] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:34.814852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895250132652350:7556] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:34.816210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:34.817174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895250132652350:7556] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:34.818253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:34.818448Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:34.818457Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:34.818465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:34.818514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:34.818551Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895250042919534:6155]
2025-09-30T14:52:34.818994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:34.819346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:34.819406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:34.819453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895250132652350:7556] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:34.819469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895250132652350:7556] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:34.819473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895250132652350:7556] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:34.819481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 873 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:34.819739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:34.819802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:34.819808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:34.819809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:34.819810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:34.819811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:34.819812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:34.819813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:34.819814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:34.819815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:34.819816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:34.819817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.819818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.819819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.819821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:34.819822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:34.819827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:34.819837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:34.819840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:34.819845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:34.819848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:34.819852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:34.819856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:34.819860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:34.819863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:34.819867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:34.819871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.819874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.819878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.819881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:34.819884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:34.819892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:34.819900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:34.819905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:34.819910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:34.819914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:34.819919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:34.819923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:34.819928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:34.819935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:34.819944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:34.819948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:34.819952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:34.819956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:34.819961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:34.819969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:34.819973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:34.819980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:34.819985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:34.819994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:34.820003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:34.820011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.820015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.820023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.820028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.820032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.820036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.820044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:34.820049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:34.820060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:34.820068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:34.820110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:34.825314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:34.826775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:34.826792Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:34.826794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:34.826799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:34.826806Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 872 [2:7555895250042919534:6155]
2025-09-30T14:52:34.826824Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:34.826840Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:34.826849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:34.826852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:34.826855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:34.826877Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:34.826889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:34.826896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:34.826962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.826970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.826972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.826975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:34.826978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:34.827046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:34.827056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.827070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.827090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.827108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:34.827126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895250132652398:7556], now have 1 active actors on pipe
2025-09-30T14:52:34.827136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895250132652069:2454], now have 1 active actors on pipe
2025-09-30T14:52:34.827142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895250042919529:6155]
2025-09-30T14:52:34.827150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895250042919529:6155]
2025-09-30T14:52:34.827152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895250042919529:6155]
2025-09-30T14:52:34.827165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:34.827178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:34.827182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:34.827213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 872
2025-09-30T14:52:34.827220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 872
2025-09-30T14:52:34.827187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:34.827189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:34.827202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:34.827205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:34.827239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895250042919529:6155]
2025-09-30T14:52:34.827261Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:34.827281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:34.827306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:34.827310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:34.827345Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bad0dd1a-58c33ce1-7ba1f9c2-5660920a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:34.827353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:34.827356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:34.827359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:34.827369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:34.827379Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:34.827396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:34.827517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:34.827527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:34.827541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:34.827631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 873 partition: 0 MaxSeqNo: 42 sessionId: src_id|bad0dd1a-58c33ce1-7ba1f9c2-5660920a_0
2025-09-30T14:52:34.827964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf6562b-c2b876a4-228752a5-3dec7fb7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bad0dd1a-58c33ce1-7ba1f9c2-5660920a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:34.830521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bad0dd1a-58c33ce1-7ba1f9c2-5660920a_0] Write session: try to update token
2025-09-30T14:52:34.830538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bad0dd1a-58c33ce1-7ba1f9c2-5660920a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:34.838833Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:34.838860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:34.838863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:34.838865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:34.838875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895250042919529:6155]
2025-09-30T14:52:34.838879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895250042919529:6155]
2025-09-30T14:52:34.838882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895250042919529:6155]
2025-09-30T14:52:34.838927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:34.838928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:34.838934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:34.838934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.838937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:34.838937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:34.839082Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:34.844098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 873 sessionId: src_id|bad0dd1a-58c33ce1-7ba1f9c2-5660920a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:34.846756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:34.903795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895250132652407:7153]
2025-09-30T14:52:34.904070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 872, pipe: [1:7555895250132652407:7153]
2025-09-30T14:52:34.941107Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:34.941538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:34.941556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:34.941583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895250132652407:7153], now have 1 active actors on pipe
2025-09-30T14:52:34.941775Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:34.941955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895250132652407:7153]
2025-09-30T14:52:34.941992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:34.942024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:34.942093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 873 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bad0dd1a-58c33ce1-7ba1f9c2-5660920a_0
2025-09-30T14:52:34.942242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 873 sessionId: src_id|bad0dd1a-58c33ce1-7ba1f9c2-5660920a_0 is DEAD
2025-09-30T14:52:34.942378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bad0dd1a-58c33ce1-7ba1f9c2-5660920a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:34.942389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bad0dd1a-58c33ce1-7ba1f9c2-5660920a_0] Write session will restart in 0.006702s
2025-09-30T14:52:34.942409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bad0dd1a-58c33ce1-7ba1f9c2-5660920a_0] Write session: Do CDS request
2025-09-30T14:52:34.942414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bad0dd1a-58c33ce1-7ba1f9c2-5660920a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:34.949612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bad0dd1a-58c33ce1-7ba1f9c2-5660920a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:34.949709Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:34.949725Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 874
2025-09-30T14:52:34.949832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 874 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:34.949862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 874 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:34.949867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=874 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:34.949871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:34.950320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 874 sessionId:  describe result for acl check
2025-09-30T14:52:34.950356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:34.950357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:34.950369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:34.950374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895250132652538:7566] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:34.950918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895250132652538:7566] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:34.952456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895250132652538:7566] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:34.955155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895250132652538:7566] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:34.955165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895250132652538:7566] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:34.955168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895250132652538:7566] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:34.955173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 874 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:34.956658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:34.958293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:34.958458Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:34.958465Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:34.958472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:34.958509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:34.958537Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895250042919759:6163]
2025-09-30T14:52:34.958951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:34.959170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:34.959215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:34.959471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:34.959516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:34.959520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:34.959521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:34.959522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:34.959522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:34.959523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:34.959524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:34.959524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:34.959525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:34.959526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:34.959527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.959527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.959528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.959529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:34.959530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:34.959534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:34.959540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:34.959542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:34.959545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:34.959547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:34.959549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:34.959551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:34.959554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:34.959556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:34.959558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:34.959560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.959563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.959565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.959567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:34.959570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:34.959574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:34.959579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:34.959583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:34.959586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:34.959588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:34.959591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:34.959593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:34.959596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:34.959599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:34.959601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:34.959604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:34.959607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:34.959609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:34.959612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:34.959614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:34.959617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:34.959620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:34.959623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:34.959625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:34.959628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:34.959630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.959633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.959635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.959638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.959640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.959643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.959645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:34.959648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:34.959650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:34.959653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:34.959676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:34.964879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:34.965973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:34.965985Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:34.965987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:34.965990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:34.965994Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 873 [2:7555895250042919759:6163]
2025-09-30T14:52:34.966003Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:34.966013Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:34.966015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:34.966017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:34.966018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:34.966028Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:34.966032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:34.966037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:34.966074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.966079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.966080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.966083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:34.966084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:34.966128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:34.966133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.966140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:34.966147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:34.966155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:34.966166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895250042919754:6163]
2025-09-30T14:52:34.966168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895250042919754:6163]
2025-09-30T14:52:34.966169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895250042919754:6163]
2025-09-30T14:52:34.966175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:34.966184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895250132652421:2454], now have 1 active actors on pipe
2025-09-30T14:52:34.966186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895250132652750:7566], now have 1 active actors on pipe
2025-09-30T14:52:34.966186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:34.966190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:34.966192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:34.966192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:34.966200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:34.966202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:34.966222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895250042919754:6163]
2025-09-30T14:52:34.966232Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:34.966243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:34.966252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 873
2025-09-30T14:52:34.966306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 873
2025-09-30T14:52:34.966377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:34.966390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:34.966414Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56793c17-50872006-c7a8c7b8-2492b92d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:34.966426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:34.966430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:34.966432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:34.966441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:34.966456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:34.966474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:34.966626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:34.966635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:34.966649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:34.966748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 874 partition: 0 MaxSeqNo: 42 sessionId: src_id|56793c17-50872006-c7a8c7b8-2492b92d_0
2025-09-30T14:52:34.967062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bad0dd1a-58c33ce1-7ba1f9c2-5660920a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|56793c17-50872006-c7a8c7b8-2492b92d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:34.969541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56793c17-50872006-c7a8c7b8-2492b92d_0] Write session: try to update token
2025-09-30T14:52:34.969556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56793c17-50872006-c7a8c7b8-2492b92d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:34.978508Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:34.978526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:34.978529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:34.978531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:34.978540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895250042919754:6163]
2025-09-30T14:52:34.978544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895250042919754:6163]
2025-09-30T14:52:34.978547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895250042919754:6163]
2025-09-30T14:52:34.978585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:34.978592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:34.978594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:34.978608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:34.978615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:34.978618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:34.978732Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:34.982908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 874 sessionId: src_id|56793c17-50872006-c7a8c7b8-2492b92d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:34.985424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:35.041947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895254427620084:7153]
2025-09-30T14:52:35.042237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 873, pipe: [1:7555895254427620084:7153]
2025-09-30T14:52:35.083501Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:35.083983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:35.083998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:35.084037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895254427620084:7153], now have 1 active actors on pipe
2025-09-30T14:52:35.084292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895254427620084:7153]
2025-09-30T14:52:35.084326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:35.084329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:35.084393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 874 reason: error at write: Disconnected sessionId: src_id|56793c17-50872006-c7a8c7b8-2492b92d_0
2025-09-30T14:52:35.084504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:35.084570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 874 sessionId: src_id|56793c17-50872006-c7a8c7b8-2492b92d_0 is DEAD
2025-09-30T14:52:35.084651Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:35.084730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56793c17-50872006-c7a8c7b8-2492b92d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:35.084741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56793c17-50872006-c7a8c7b8-2492b92d_0] Write session will restart in 0.006241s
2025-09-30T14:52:35.084765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56793c17-50872006-c7a8c7b8-2492b92d_0] Write session: Do CDS request
2025-09-30T14:52:35.084770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56793c17-50872006-c7a8c7b8-2492b92d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:35.091692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56793c17-50872006-c7a8c7b8-2492b92d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:35.091813Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:35.091830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 875
2025-09-30T14:52:35.091971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 875 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:35.092013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 875 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:35.092022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=875 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:35.092026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:35.092441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 875 sessionId:  describe result for acl check
2025-09-30T14:52:35.092475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:35.092483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:35.092485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:35.092490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895254427620191:7574] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:35.093033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895254427620191:7574] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:35.094913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895254427620191:7574] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:35.097337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:35.097402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895254427620191:7574] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:35.097415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895254427620191:7574] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:35.097418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895254427620191:7574] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:35.097424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 875 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:35.098928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:35.099073Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:35.099081Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:35.099089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:35.099134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:35.099160Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895254337887289:6172]
2025-09-30T14:52:35.099676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:35.099979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:35.100012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:35.100222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:35.100263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:35.100267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:35.100268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:35.100269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:35.100269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:35.100270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:35.100270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:35.100271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:35.100272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:35.100272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:35.100273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.100274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.100274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.100275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:35.100276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:35.100279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:35.100285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:35.100288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:35.100290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:35.100292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:35.100295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:35.100297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:35.100299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:35.100301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:35.100304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:35.100306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.100308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.100310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.100312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:35.100315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:35.100319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:35.100324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:35.100328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:35.100331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:35.100334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:35.100337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:35.100339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:35.100342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:35.100345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:35.100348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:35.100350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:35.100353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:35.100355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:35.100358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:35.100360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:35.100364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:35.100366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:35.100369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:35.100372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:35.100375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:35.100377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.100380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.100382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.100385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.100388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.100391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.100394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:35.100397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:35.100401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:35.100404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:35.100427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:35.105593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:35.106427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:35.106441Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:35.106443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:35.106447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:35.106456Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 874 [2:7555895254337887289:6172]
2025-09-30T14:52:35.106470Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:35.106482Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:35.106485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:35.106487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:35.106489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:35.106502Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:35.106513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:35.106519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:35.106574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.106581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.106583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.106587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:35.106591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:35.106636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:35.106643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.106650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.106656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.106665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:35.106676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895254337887283:6172]
2025-09-30T14:52:35.106678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895254337887283:6172]
2025-09-30T14:52:35.106679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895254337887283:6172]
2025-09-30T14:52:35.106684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:35.106695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:35.106696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:35.106699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:35.106703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:35.106703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:35.106705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:35.106712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895254427620415:7574], now have 1 active actors on pipe
2025-09-30T14:52:35.106714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895254427620088:2454], now have 1 active actors on pipe
2025-09-30T14:52:35.106735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895254337887283:6172]
2025-09-30T14:52:35.106747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:35.106757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:35.106799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 874
2025-09-30T14:52:35.106805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 874
2025-09-30T14:52:35.106891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:35.106899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:35.106921Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71149eb6-7324fe78-27edc0f2-49247b0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:35.106930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:35.106933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:35.106934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:35.106941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:35.106948Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:35.106963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:35.107145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:35.107150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:35.107159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:35.107226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 875 partition: 0 MaxSeqNo: 42 sessionId: src_id|71149eb6-7324fe78-27edc0f2-49247b0e_0
2025-09-30T14:52:35.107560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56793c17-50872006-c7a8c7b8-2492b92d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|71149eb6-7324fe78-27edc0f2-49247b0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:35.110221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71149eb6-7324fe78-27edc0f2-49247b0e_0] Write session: try to update token
2025-09-30T14:52:35.110237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71149eb6-7324fe78-27edc0f2-49247b0e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:35.118401Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:35.118420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:35.118429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895254337887283:6172]
2025-09-30T14:52:35.118468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:35.118477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:35.118698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:35.118877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:35.119046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:35.119233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:35.119572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:35.119624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:35.124527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 875 sessionId: src_id|71149eb6-7324fe78-27edc0f2-49247b0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:35.126926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:35.127617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:35.127637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:35.128651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:35.128677Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:35.128680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:35.128681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:35.128682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:35.128690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895254337887283:6172]
2025-09-30T14:52:35.128692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895254337887283:6172]
2025-09-30T14:52:35.128696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895254337887283:6172]
2025-09-30T14:52:35.128718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:35.128719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:35.128724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:35.128727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.128728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:35.128729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:35.128731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:35.128849Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:35.184316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895254427620428:7153]
2025-09-30T14:52:35.184611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 874, pipe: [1:7555895254427620428:7153]
2025-09-30T14:52:35.230479Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:35.237553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:35.237580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:35.237724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:35.237781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:35.237839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:35.237897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:35.237939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:35.237950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:35.238014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:35.238072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:35.238127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:35.238200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:35.238241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:35.238247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:35.238323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:35.238379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:35.238445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:35.238517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:35.238557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:35.238563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:35.238624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:35.238680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:35.238736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:35.238794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:35.238834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:35.238841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:35.238901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:35.238956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:35.239013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:35.239072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:35.239115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:35.239122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:35.239180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:35.239264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:35.239367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:35.239454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:35.239506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:35.239512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:35.239580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:35.239636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:35.239695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:35.239753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:35.239794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:35.239799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:35.239858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:35.239911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:35.239966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:35.240117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:35.240166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:35.240171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:35.240231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:35.240285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:35.240341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:35.240398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:35.240438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:35.240443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:35.240504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:35.240560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:35.240617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:35.240675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:35.240716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:35.240722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:35.240764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895254427620428:7153], now have 1 active actors on pipe
2025-09-30T14:52:35.241020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:35.241033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:35.241045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895254427620428:7153]
2025-09-30T14:52:35.241055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 875 reason: error at write: Disconnected sessionId: src_id|71149eb6-7324fe78-27edc0f2-49247b0e_0
2025-09-30T14:52:35.241065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:35.241233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 875 sessionId: src_id|71149eb6-7324fe78-27edc0f2-49247b0e_0 is DEAD
2025-09-30T14:52:35.241350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71149eb6-7324fe78-27edc0f2-49247b0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:35.241361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71149eb6-7324fe78-27edc0f2-49247b0e_0] Write session will restart in 0.005902s
2025-09-30T14:52:35.241378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71149eb6-7324fe78-27edc0f2-49247b0e_0] Write session: Do CDS request
2025-09-30T14:52:35.241384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71149eb6-7324fe78-27edc0f2-49247b0e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:35.241811Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:35.248680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71149eb6-7324fe78-27edc0f2-49247b0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:35.249133Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:35.249150Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 876
2025-09-30T14:52:35.249299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 876 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:35.249333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 876 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:35.249346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=876 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:35.249356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:35.249805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 876 sessionId:  describe result for acl check
2025-09-30T14:52:35.249842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:35.249849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:35.249851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:35.249857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895254427620592:7578] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:35.250385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895254427620592:7578] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:35.252535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895254427620592:7578] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:35.254983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895254427620592:7578] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:35.254994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895254427620592:7578] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:35.254997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895254427620592:7578] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:35.255004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 876 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:35.255046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:35.256689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:35.256835Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:35.256842Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:35.256849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:35.256882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:35.256910Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895254337887495:6175]
2025-09-30T14:52:35.257343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:35.257571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:35.257601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:35.257868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:35.257922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:35.257928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:35.257929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:35.257930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:35.257931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:35.257933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:35.257934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:35.257935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:35.257936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:35.257937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:35.257938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.257939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.257940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.257941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:35.257942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:35.257947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:35.257956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:35.257960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:35.257964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:35.257967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:35.257972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:35.257976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:35.257980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:35.257984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:35.257989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:35.257993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.257997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.258000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.258002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:35.258005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:35.258011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:35.258016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:35.258021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:35.258024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:35.258026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:35.258030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:35.258032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:35.258035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:35.258037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:35.258040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:35.258043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:35.258046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:35.258048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:35.258051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:35.258054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:35.258057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:35.258059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:35.258062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:35.258065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:35.258068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:35.258071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.258074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.258076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.258079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.258082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.258084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.258087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:35.258089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:35.258092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:35.258094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:35.258119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:35.263367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:35.264401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:35.264412Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:35.264414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:35.264418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:35.264423Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 875 [2:7555895254337887495:6175]
2025-09-30T14:52:35.264436Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:35.264448Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:35.264450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:35.264452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:35.264454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:35.264465Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:35.264469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:35.264475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:35.264519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.264526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.264529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.264531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:35.264533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:35.264585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:35.264591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.264599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.264606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.264618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:35.264632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895254337887489:6175]
2025-09-30T14:52:35.264638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895254337887489:6175]
2025-09-30T14:52:35.264640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895254337887489:6175]
2025-09-30T14:52:35.264646Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:35.264655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:35.264656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:35.264657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:35.264659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:35.264665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:35.264667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:35.264674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895254427620429:2454], now have 1 active actors on pipe
2025-09-30T14:52:35.264678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895254427620758:7578], now have 1 active actors on pipe
2025-09-30T14:52:35.264702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895254337887489:6175]
2025-09-30T14:52:35.264712Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:35.264717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:35.264744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 875
2025-09-30T14:52:35.264806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 875
2025-09-30T14:52:35.264849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:35.264864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:35.264887Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b2f5850-9fd2c71-fa31b899-9432a109_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:35.264897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:35.264900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:35.264902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:35.264912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:35.264925Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:35.264940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:35.265461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:35.265486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:35.265519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:35.265675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 876 partition: 0 MaxSeqNo: 42 sessionId: src_id|1b2f5850-9fd2c71-fa31b899-9432a109_0
2025-09-30T14:52:35.266020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71149eb6-7324fe78-27edc0f2-49247b0e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1b2f5850-9fd2c71-fa31b899-9432a109_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:35.268835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b2f5850-9fd2c71-fa31b899-9432a109_0] Write session: try to update token
2025-09-30T14:52:35.268855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b2f5850-9fd2c71-fa31b899-9432a109_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:35.276275Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:35.276294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:35.276316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895254337887489:6175]
2025-09-30T14:52:35.276364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:35.276374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:35.276554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:35.276709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:35.276865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:35.277027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:35.277244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:35.277285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:35.282942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 876 sessionId: src_id|1b2f5850-9fd2c71-fa31b899-9432a109_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:35.285502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:35.286858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:35.286886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:35.286908Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:35.286910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:35.286913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:35.286915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:35.286923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895254337887489:6175]
2025-09-30T14:52:35.286927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895254337887489:6175]
2025-09-30T14:52:35.286930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895254337887489:6175]
2025-09-30T14:52:35.286984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:35.286984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:35.286993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:35.286998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:35.286999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.287002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:35.287149Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:35.340987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895254427620771:7153]
2025-09-30T14:52:35.341298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 875, pipe: [1:7555895254427620771:7153]
2025-09-30T14:52:35.391008Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:35.391661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:35.391695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895254427620771:7153], now have 1 active actors on pipe
2025-09-30T14:52:35.391784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:35.391977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:35.392030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895254427620771:7153]
2025-09-30T14:52:35.402601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:35.402618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:35.402639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 876 reason: error at write: Disconnected sessionId: src_id|1b2f5850-9fd2c71-fa31b899-9432a109_0
2025-09-30T14:52:35.402762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 876 sessionId: src_id|1b2f5850-9fd2c71-fa31b899-9432a109_0 is DEAD
2025-09-30T14:52:35.402903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b2f5850-9fd2c71-fa31b899-9432a109_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:35.402910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b2f5850-9fd2c71-fa31b899-9432a109_0] Write session will restart in 0.006461s
2025-09-30T14:52:35.402934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b2f5850-9fd2c71-fa31b899-9432a109_0] Write session: Do CDS request
2025-09-30T14:52:35.402939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b2f5850-9fd2c71-fa31b899-9432a109_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:35.410728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b2f5850-9fd2c71-fa31b899-9432a109_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:35.410762Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:35.410779Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 877
2025-09-30T14:52:35.410911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 877 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:35.410936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 877 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:35.410940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=877 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:35.410943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:35.411366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 877 sessionId:  describe result for acl check
2025-09-30T14:52:35.411409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:35.411416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:35.411418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:35.411424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895254427621068:7582] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:35.411704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:35.411953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895254427621068:7582] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:35.413591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:35.413751Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:35.413761Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:35.413770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:35.413810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:35.413861Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895254337887700:6177]
2025-09-30T14:52:35.414257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895254427621068:7582] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:35.414544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:35.414802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:35.414843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:35.415161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:35.415210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:35.415216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:35.415217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:35.415219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:35.415220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:35.415221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:35.415223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:35.415224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:35.415225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:35.415226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:35.415227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.415229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.415230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.415231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:35.415232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:35.415237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:35.415263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:35.415268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:35.415272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:35.415276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:35.415281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:35.415286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:35.415290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:35.415295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:35.415299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:35.415304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.415308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.415313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.415317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:35.415322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:35.415329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:35.415342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:35.415348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:35.415358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:35.415363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:35.415371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:35.415381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:35.415387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:35.415396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:35.415402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:35.415410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:35.415416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:35.415422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:35.415432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:35.415437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:35.415443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:35.415449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:35.415455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:35.415466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:35.415472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:35.415481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.415487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.415496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.415502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.415511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.415517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.415526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:35.415532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:35.415541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:35.415547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:35.415596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:35.420747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895254427621068:7582] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:35.420768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895254427621068:7582] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:35.420772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895254427621068:7582] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:35.420781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 877 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:35.421040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:35.422420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:35.422436Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:35.422439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:35.422442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:35.422449Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 876 [2:7555895254337887700:6177]
2025-09-30T14:52:35.422463Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:35.422476Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:35.422479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:35.422482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:35.422484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:35.422499Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:35.422510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:35.422521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:35.422583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.422590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.422592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.422596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:35.422598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:35.422662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:35.422670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.422683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.422701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.422726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:35.422743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895254427621107:7582], now have 1 active actors on pipe
2025-09-30T14:52:35.422747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895254427620772:2454], now have 1 active actors on pipe
2025-09-30T14:52:35.422753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895254337887695:6177]
2025-09-30T14:52:35.422756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895254337887695:6177]
2025-09-30T14:52:35.422758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895254337887695:6177]
2025-09-30T14:52:35.422777Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:35.422793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:35.422809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:35.422815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:35.422816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:35.422798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 876
2025-09-30T14:52:35.422820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:35.422800Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 876
2025-09-30T14:52:35.422824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:35.422843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895254337887695:6177]
2025-09-30T14:52:35.422846Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:35.422872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:35.422881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:35.422890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:35.422917Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6fea8aed-4a238523-9e5c1c47-56bc617a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:35.422929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:35.422932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:35.422934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:35.422944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:35.422952Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:35.422968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:35.423113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:35.423122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:35.423134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:35.423221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 877 partition: 0 MaxSeqNo: 42 sessionId: src_id|6fea8aed-4a238523-9e5c1c47-56bc617a_0
2025-09-30T14:52:35.423556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b2f5850-9fd2c71-fa31b899-9432a109_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6fea8aed-4a238523-9e5c1c47-56bc617a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:35.426180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fea8aed-4a238523-9e5c1c47-56bc617a_0] Write session: try to update token
2025-09-30T14:52:35.426196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fea8aed-4a238523-9e5c1c47-56bc617a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:35.434672Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:35.434689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:35.434691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:35.434692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:35.434700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895254337887695:6177]
2025-09-30T14:52:35.434704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895254337887695:6177]
2025-09-30T14:52:35.434707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895254337887695:6177]
2025-09-30T14:52:35.434739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:35.434744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.434745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:35.434756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:35.434763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:35.434768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:35.434866Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:35.440368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 877 sessionId: src_id|6fea8aed-4a238523-9e5c1c47-56bc617a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:35.442954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:35.492041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895254427621117:7153]
2025-09-30T14:52:35.492306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 876, pipe: [1:7555895254427621117:7153]
2025-09-30T14:52:35.540121Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:35.540376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:35.540388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:35.540420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895254427621117:7153], now have 1 active actors on pipe
2025-09-30T14:52:35.540574Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:35.540679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895254427621117:7153]
2025-09-30T14:52:35.540680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:35.540712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:35.540743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 877 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6fea8aed-4a238523-9e5c1c47-56bc617a_0
2025-09-30T14:52:35.540870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 877 sessionId: src_id|6fea8aed-4a238523-9e5c1c47-56bc617a_0 is DEAD
2025-09-30T14:52:35.541044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fea8aed-4a238523-9e5c1c47-56bc617a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:35.541056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fea8aed-4a238523-9e5c1c47-56bc617a_0] Write session will restart in 0.005847s
2025-09-30T14:52:35.541080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fea8aed-4a238523-9e5c1c47-56bc617a_0] Write session: Do CDS request
2025-09-30T14:52:35.541086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fea8aed-4a238523-9e5c1c47-56bc617a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:35.547687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fea8aed-4a238523-9e5c1c47-56bc617a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:35.547752Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:35.547768Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 878
2025-09-30T14:52:35.547919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 878 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:35.547953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 878 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:35.547960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=878 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:35.547969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:35.548307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 878 sessionId:  describe result for acl check
2025-09-30T14:52:35.548342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:35.548347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:35.548349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:35.548353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895254427621169:7587] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:35.548835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895254427621169:7587] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:35.550871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895254427621169:7587] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:35.553688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895254427621169:7587] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:35.553705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895254427621169:7587] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:35.553708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895254427621169:7587] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:35.553716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 878 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:35.557680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:35.558164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:35.558307Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:35.558315Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:35.558322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:35.558355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:35.558384Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895254337887909:6179]
2025-09-30T14:52:35.558812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:35.559026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:35.559057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:35.559304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:35.559350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:35.559354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:35.559355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:35.559356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:35.559357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:35.559358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:35.559358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:35.559359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:35.559360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:35.559361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:35.559361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.559362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.559363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.559363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:35.559364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:35.559367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:35.559374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:35.559376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:35.559379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:35.559381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:35.559384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:35.559386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:35.559388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:35.559391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:35.559393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:35.559396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.559398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.559400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.559402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:35.559405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:35.559410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:35.559415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:35.559419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:35.559422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:35.559426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:35.559429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:35.559431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:35.559435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:35.559438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:35.559441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:35.559444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:35.559447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:35.559450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:35.559453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:35.559455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:35.559459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:35.559461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:35.559465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:35.559467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:35.559470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:35.559473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.559476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.559478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.559481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.559484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.559487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.559490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:35.559493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:35.559496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:35.559498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:35.559522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:35.564713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:35.565834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:35.565849Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:35.565851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:35.565855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:35.565862Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 877 [2:7555895254337887909:6179]
2025-09-30T14:52:35.565876Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:35.565892Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:35.565895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:35.565898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:35.565900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:35.565916Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:35.565926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:35.565931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:35.565976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.565982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.565983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.565986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:35.565988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:35.566039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:35.566045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.566053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.566059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.566069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:35.566080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895254337887904:6179]
2025-09-30T14:52:35.566085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895254337887904:6179]
2025-09-30T14:52:35.566086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895254337887904:6179]
2025-09-30T14:52:35.566094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:35.566103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895254427621118:2454], now have 1 active actors on pipe
2025-09-30T14:52:35.566107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:35.566110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:35.566112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:35.566113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:35.566127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:35.566130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:35.566135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895254427621447:7587], now have 1 active actors on pipe
2025-09-30T14:52:35.566165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895254337887904:6179]
2025-09-30T14:52:35.566177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:35.566190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:35.566204Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 877
2025-09-30T14:52:35.566222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 877
2025-09-30T14:52:35.566250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:35.566271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:35.566297Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1dd2d04-519d0a0b-64a6217e-243c041b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:35.566309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:35.566316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:35.566318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:35.566326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:35.566339Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:35.566360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:35.566510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:35.566517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:35.566528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:35.566633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 878 partition: 0 MaxSeqNo: 42 sessionId: src_id|b1dd2d04-519d0a0b-64a6217e-243c041b_0
2025-09-30T14:52:35.566967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fea8aed-4a238523-9e5c1c47-56bc617a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b1dd2d04-519d0a0b-64a6217e-243c041b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:35.569620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1dd2d04-519d0a0b-64a6217e-243c041b_0] Write session: try to update token
2025-09-30T14:52:35.569641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1dd2d04-519d0a0b-64a6217e-243c041b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:35.578154Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:35.578174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:35.578176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:35.578180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:35.578189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895254337887904:6179]
2025-09-30T14:52:35.578192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895254337887904:6179]
2025-09-30T14:52:35.578195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895254337887904:6179]
2025-09-30T14:52:35.578232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:35.578237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.578239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:35.578247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:35.578255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:35.578270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:35.578400Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:35.583687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 878 sessionId: src_id|b1dd2d04-519d0a0b-64a6217e-243c041b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:35.586279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:35.641015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895254427621462:7153]
2025-09-30T14:52:35.641239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 877, pipe: [1:7555895254427621462:7153]
2025-09-30T14:52:35.687095Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:35.687649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:35.687665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:35.687699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895254427621462:7153], now have 1 active actors on pipe
2025-09-30T14:52:35.687913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:35.687930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:35.687952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:35.687939Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:35.687994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 878 reason: error at write: Disconnected sessionId: src_id|b1dd2d04-519d0a0b-64a6217e-243c041b_0
2025-09-30T14:52:35.688013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895254427621462:7153]
2025-09-30T14:52:35.688155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 878 sessionId: src_id|b1dd2d04-519d0a0b-64a6217e-243c041b_0 is DEAD
2025-09-30T14:52:35.688322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1dd2d04-519d0a0b-64a6217e-243c041b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:35.688330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1dd2d04-519d0a0b-64a6217e-243c041b_0] Write session will restart in 0.005703s
2025-09-30T14:52:35.688353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1dd2d04-519d0a0b-64a6217e-243c041b_0] Write session: Do CDS request
2025-09-30T14:52:35.688363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1dd2d04-519d0a0b-64a6217e-243c041b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:35.694736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1dd2d04-519d0a0b-64a6217e-243c041b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:35.694825Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:35.694840Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 879
2025-09-30T14:52:35.694985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 879 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:35.695028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 879 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:35.695038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=879 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:35.695041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:35.695559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 879 sessionId:  describe result for acl check
2025-09-30T14:52:35.695596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:35.695599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:35.695601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:35.695607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895254427621498:7591] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:35.696285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895254427621498:7591] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:35.698238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895254427621498:7591] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:35.700616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895254427621498:7591] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:35.700643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895254427621498:7591] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:35.700646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895254427621498:7591] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:35.700653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 879 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:35.702705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:35.704774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:35.705200Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:35.705217Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:35.705231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:35.705302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:35.705343Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895254337888120:6182]
2025-09-30T14:52:35.705970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:35.706293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:35.706338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:35.706607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:35.706659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:35.706664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:35.706664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:35.706665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:35.706666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:35.706667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:35.706667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:35.706668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:35.706669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:35.706670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:35.706670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.706671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.706671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.706672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:35.706673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:35.706677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:35.706685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:35.706689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:35.706693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:35.706697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:35.706700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:35.706705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:35.706709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:35.706713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:35.706718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:35.706722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.706726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.706730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.706734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:35.706738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:35.706745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:35.706757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:35.706767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:35.706772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:35.706782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:35.706792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:35.706796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:35.706801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:35.706805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:35.706815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:35.706820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:35.706825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:35.706830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:35.706836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:35.706845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:35.706851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:35.706855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:35.706860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:35.706868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:35.706872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:35.706876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.706881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.706890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.706895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.706900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.706905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.706909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:35.706914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:35.706918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:35.706923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:35.706970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:35.712421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:35.713249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:35.713268Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:35.713272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:35.713275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:35.713283Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 878 [2:7555895254337888120:6182]
2025-09-30T14:52:35.713299Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:35.713314Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:35.713317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:35.713321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:35.713324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:35.713340Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:35.713346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:35.713359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:35.713415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.713422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.713425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.713428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:35.713432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:35.713508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:35.713516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.713528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.713547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.713571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:35.713595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895254427621463:2454], now have 1 active actors on pipe
2025-09-30T14:52:35.713603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895254427621792:7591], now have 1 active actors on pipe
2025-09-30T14:52:35.713610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895254337888115:6182]
2025-09-30T14:52:35.713618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895254337888115:6182]
2025-09-30T14:52:35.713621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895254337888115:6182]
2025-09-30T14:52:35.713633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:35.713650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:35.713650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:35.713653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:35.713655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:35.713635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 878
2025-09-30T14:52:35.713671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:35.713642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 878
2025-09-30T14:52:35.713674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:35.713706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895254337888115:6182]
2025-09-30T14:52:35.713713Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:35.713718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:35.713728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:35.713733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:35.713779Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1140d975-4ba887b7-21cd9854-347be51a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:35.713791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:35.713796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:35.713798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:35.713807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:35.713819Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:35.713841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:35.714029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:35.714036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:35.714048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:35.714129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 879 partition: 0 MaxSeqNo: 42 sessionId: src_id|1140d975-4ba887b7-21cd9854-347be51a_0
2025-09-30T14:52:35.714467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1dd2d04-519d0a0b-64a6217e-243c041b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1140d975-4ba887b7-21cd9854-347be51a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:35.717324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1140d975-4ba887b7-21cd9854-347be51a_0] Write session: try to update token
2025-09-30T14:52:35.717347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1140d975-4ba887b7-21cd9854-347be51a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:35.725789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:35.725814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:35.725817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:35.725819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:35.725829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895254337888115:6182]
2025-09-30T14:52:35.725833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895254337888115:6182]
2025-09-30T14:52:35.725838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895254337888115:6182]
2025-09-30T14:52:35.725878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:35.725883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:35.725889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:35.725889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.725892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:35.725893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:35.726029Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:35.732038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 879 sessionId: src_id|1140d975-4ba887b7-21cd9854-347be51a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:35.734609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:35.787988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895254427621806:7153]
2025-09-30T14:52:35.788297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 878, pipe: [1:7555895254427621806:7153]
2025-09-30T14:52:35.831057Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:35.831462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:35.831476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:35.831513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895254427621806:7153], now have 1 active actors on pipe
2025-09-30T14:52:35.831680Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:35.831784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:35.831803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:35.831812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:35.831849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895254427621806:7153]
2025-09-30T14:52:35.831875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 879 reason: error at write: Disconnected sessionId: src_id|1140d975-4ba887b7-21cd9854-347be51a_0
2025-09-30T14:52:35.832021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 879 sessionId: src_id|1140d975-4ba887b7-21cd9854-347be51a_0 is DEAD
2025-09-30T14:52:35.832163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1140d975-4ba887b7-21cd9854-347be51a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:35.832171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1140d975-4ba887b7-21cd9854-347be51a_0] Write session will restart in 0.005875s
2025-09-30T14:52:35.832204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1140d975-4ba887b7-21cd9854-347be51a_0] Write session: Do CDS request
2025-09-30T14:52:35.832210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1140d975-4ba887b7-21cd9854-347be51a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:35.838743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1140d975-4ba887b7-21cd9854-347be51a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:35.838863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:35.838879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 880
2025-09-30T14:52:35.839009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 880 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:35.839058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 880 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:35.839067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=880 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:35.839071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:35.839508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 880 sessionId:  describe result for acl check
2025-09-30T14:52:35.839547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:35.839549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:35.839552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:35.839557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895254427621848:7595] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:35.840128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895254427621848:7595] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:35.842127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895254427621848:7595] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:35.844324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895254427621848:7595] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:35.844338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895254427621848:7595] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:35.844341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895254427621848:7595] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:35.844348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 880 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:35.847332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:35.849234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:35.849408Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:35.849416Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:35.849424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:35.849464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:35.849493Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895254337888330:6184]
2025-09-30T14:52:35.850004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:35.850237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:35.850286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:35.850611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:35.850668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:35.850674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:35.850675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:35.850676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:35.850677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:35.850678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:35.850680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:35.850681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:35.850682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:35.850683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:35.850684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.850685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.850686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.850688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:35.850689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:35.850694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:35.850705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:35.850709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:35.850713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:35.850718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:35.850722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:35.850726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:35.850730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:35.850734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:35.850738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:35.850742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.850746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.850750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.850754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:35.850758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:35.850765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:35.850772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:35.850779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:35.850787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:35.850792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:35.850802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:35.850807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:35.850814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:35.850818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:35.850824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:35.850831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:35.850836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:35.850841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:35.850847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:35.850856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:35.850862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:35.850867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:35.850872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:35.850878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:35.850883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:35.850887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.850892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.850895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.850899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.850906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.850910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.850913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:35.850918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:35.850922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:35.850927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:35.850973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:35.856019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:35.857107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:35.857122Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:35.857124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:35.857127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:35.857131Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 879 [2:7555895254337888330:6184]
2025-09-30T14:52:35.857144Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:35.857157Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:35.857160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:35.857162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:35.857164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:35.857179Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:35.857189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:35.857195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:35.857234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.857240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.857241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.857243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:35.857245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:35.857305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:35.857313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.857326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:35.857342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:35.857363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:35.857389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895254427622108:7595], now have 1 active actors on pipe
2025-09-30T14:52:35.857392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895254427621808:2454], now have 1 active actors on pipe
2025-09-30T14:52:35.857398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895254337888325:6184]
2025-09-30T14:52:35.857401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895254337888325:6184]
2025-09-30T14:52:35.857404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895254337888325:6184]
2025-09-30T14:52:35.857417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:35.857427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:35.857434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:35.857438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:35.857440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:35.857449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:35.857451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:35.857479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895254337888325:6184]
2025-09-30T14:52:35.857490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:35.857467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 879
2025-09-30T14:52:35.857495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:35.857624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 879
2025-09-30T14:52:35.857673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:35.857682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:35.857703Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4af930a-3363e42e-71e0325f-65d3462a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:35.857712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:35.857715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:35.857717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:35.857723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:35.857736Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:35.857746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:35.858061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:35.858072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:35.858085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:35.858168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 880 partition: 0 MaxSeqNo: 42 sessionId: src_id|f4af930a-3363e42e-71e0325f-65d3462a_0
2025-09-30T14:52:35.858474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1140d975-4ba887b7-21cd9854-347be51a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f4af930a-3363e42e-71e0325f-65d3462a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:35.861234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4af930a-3363e42e-71e0325f-65d3462a_0] Write session: try to update token
2025-09-30T14:52:35.861251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4af930a-3363e42e-71e0325f-65d3462a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:35.869156Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:35.869174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:35.869185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895254337888325:6184]
2025-09-30T14:52:35.869230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:35.869229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:35.869408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:35.869543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:35.869681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:35.869819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:35.870006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:35.870045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:35.874980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 880 sessionId: src_id|f4af930a-3363e42e-71e0325f-65d3462a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:35.877526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:35.877720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:35.877743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:35.877775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:35.877886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:35.879942Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:35.879964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:35.879967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:35.879972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:35.879980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895254337888325:6184]
2025-09-30T14:52:35.879984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895254337888325:6184]
2025-09-30T14:52:35.879987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895254337888325:6184]
2025-09-30T14:52:35.880022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:35.880036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:35.880039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:35.880049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:35.880055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:35.880059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:35.880168Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:35.931840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895254427622152:7153]
2025-09-30T14:52:35.932136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 879, pipe: [1:7555895254427622152:7153]
2025-09-30T14:52:35.988328Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:35.996852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:35.996879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:35.997042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:35.997106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:35.997171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:35.997239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:35.997285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:35.997295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:35.997361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:35.997426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:35.997489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:35.997557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:35.997600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:35.997609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:35.997674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:35.997738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:35.997802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:35.997867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:35.997910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:35.997917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:35.997984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:35.998051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:35.998114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:35.998180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:35.998225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:35.998233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:35.998313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:35.998376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:35.998439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:35.998506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:35.998570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:35.998578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:35.998643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:35.998707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:35.998772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:35.998839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:35.998943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:35.998951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:35.999014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:35.999077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:35.999144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:35.999211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:35.999270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:35.999278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:35.999344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:35.999406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:35.999474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:35.999540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:35.999675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:35.999683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:35.999747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:35.999812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:35.999874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:35.999940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:35.999983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:35.999991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.000056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.000117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.000183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.000244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.000291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.000302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.000443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895254427622152:7153], now have 1 active actors on pipe
2025-09-30T14:52:36.000633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:36.000646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:36.000667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 880 reason: error at write: Disconnected sessionId: src_id|f4af930a-3363e42e-71e0325f-65d3462a_0
2025-09-30T14:52:36.000863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 880 sessionId: src_id|f4af930a-3363e42e-71e0325f-65d3462a_0 is DEAD
2025-09-30T14:52:36.000968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4af930a-3363e42e-71e0325f-65d3462a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:36.000989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4af930a-3363e42e-71e0325f-65d3462a_0] Write session will restart in 0.007089s
2025-09-30T14:52:36.001010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4af930a-3363e42e-71e0325f-65d3462a_0] Write session: Do CDS request
2025-09-30T14:52:36.001016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4af930a-3363e42e-71e0325f-65d3462a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:36.001043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:36.001093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895254427622152:7153]
2025-09-30T14:52:36.001458Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:36.009725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4af930a-3363e42e-71e0325f-65d3462a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:36.009781Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:36.009798Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 881
2025-09-30T14:52:36.009929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 881 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:36.009971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 881 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:36.009980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=881 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:36.009984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:36.010390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 881 sessionId:  describe result for acl check
2025-09-30T14:52:36.010428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:36.010436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:36.010438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:36.010443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895258722589593:7608] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:36.010958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895258722589593:7608] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:36.012792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895258722589593:7608] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:36.015150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895258722589593:7608] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:36.015164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895258722589593:7608] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:36.015167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895258722589593:7608] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:36.015175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 881 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:36.019198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:36.019741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:36.019942Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:36.019956Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:36.019969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:36.020040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:36.020086Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895258632855885:6194]
2025-09-30T14:52:36.020730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:36.021035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:36.021081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:36.021423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:36.021515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:36.021521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:36.021522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:36.021524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:36.021525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:36.021526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:36.021528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:36.021529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:36.021530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:36.021532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:36.021533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.021535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.021536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.021537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:36.021538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:36.021545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:36.021555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:36.021560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:36.021564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:36.021568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:36.021572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:36.021576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:36.021581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:36.021584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:36.021589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:36.021593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.021597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.021600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.021604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:36.021609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:36.021621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:36.021633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:36.021643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:36.021651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:36.021656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:36.021661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:36.021667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:36.021672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:36.021682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:36.021687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:36.021696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:36.021702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:36.021711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:36.021720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:36.021725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:36.021735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:36.021740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:36.021746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:36.021754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:36.021760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:36.021768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.021778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.021787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.021797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.021805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.021815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.021824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:36.021833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:36.021843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:36.021853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:36.021900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:36.027299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:36.028537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:36.028553Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:36.028556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:36.028560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:36.028566Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 880 [2:7555895258632855885:6194]
2025-09-30T14:52:36.028581Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:36.028599Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:36.028607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:36.028610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:36.028612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:36.028627Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:36.028639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:36.028645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:36.028702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.028710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.028713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.028716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:36.028719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:36.028932Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 880
2025-09-30T14:52:36.028932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 880
2025-09-30T14:52:36.028784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:36.029283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 881 partition: 0 MaxSeqNo: 42 sessionId: src_id|d7dbc081-e33d6810-de2f6f79-d2556753_0
2025-09-30T14:52:36.028791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.028804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.028816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.028833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:36.028851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895258722589814:7608], now have 1 active actors on pipe
2025-09-30T14:52:36.028855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895258722589470:2454], now have 1 active actors on pipe
2025-09-30T14:52:36.028861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895258632855880:6194]
2025-09-30T14:52:36.028863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895258632855880:6194]
2025-09-30T14:52:36.028866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895258632855880:6194]
2025-09-30T14:52:36.028878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:36.028888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:36.028891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:36.028892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:36.028893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:36.028907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:36.028910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:36.028941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895258632855880:6194]
2025-09-30T14:52:36.028948Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:36.028952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:36.028980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:36.028985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:36.029021Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7dbc081-e33d6810-de2f6f79-d2556753_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:36.029028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:36.029032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:36.029034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:36.029042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:36.029051Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:36.029063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:36.029191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:36.029194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:36.029206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:36.029600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4af930a-3363e42e-71e0325f-65d3462a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d7dbc081-e33d6810-de2f6f79-d2556753_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:36.032141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7dbc081-e33d6810-de2f6f79-d2556753_0] Write session: try to update token
2025-09-30T14:52:36.032157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7dbc081-e33d6810-de2f6f79-d2556753_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:36.040974Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:36.040993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:36.040996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:36.040998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:36.041008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895258632855880:6194]
2025-09-30T14:52:36.041012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895258632855880:6194]
2025-09-30T14:52:36.041017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895258632855880:6194]
2025-09-30T14:52:36.041056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:36.041064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.041068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:36.041072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:36.041073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:36.041076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:36.041208Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:36.045829Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 881 sessionId: src_id|d7dbc081-e33d6810-de2f6f79-d2556753_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:36.048582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:36.101315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895258722589844:7153]
2025-09-30T14:52:36.101562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 880, pipe: [1:7555895258722589844:7153]
2025-09-30T14:52:36.144073Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:36.144312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:36.144331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:36.144375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895258722589844:7153], now have 1 active actors on pipe
2025-09-30T14:52:36.144552Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:36.144604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:36.144614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:36.144619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:36.144661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895258722589844:7153]
2025-09-30T14:52:36.144680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 881 reason: error at write: Disconnected sessionId: src_id|d7dbc081-e33d6810-de2f6f79-d2556753_0
2025-09-30T14:52:36.144829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 881 sessionId: src_id|d7dbc081-e33d6810-de2f6f79-d2556753_0 is DEAD
2025-09-30T14:52:36.144950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7dbc081-e33d6810-de2f6f79-d2556753_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:36.144960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7dbc081-e33d6810-de2f6f79-d2556753_0] Write session will restart in 0.008845s
2025-09-30T14:52:36.144978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7dbc081-e33d6810-de2f6f79-d2556753_0] Write session: Do CDS request
2025-09-30T14:52:36.144982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7dbc081-e33d6810-de2f6f79-d2556753_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:36.154709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7dbc081-e33d6810-de2f6f79-d2556753_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:36.154837Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:36.154857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 882
2025-09-30T14:52:36.155063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 882 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:36.155126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 882 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:36.155137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=882 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:36.155141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:36.155608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 882 sessionId:  describe result for acl check
2025-09-30T14:52:36.155645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:36.155652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:36.155656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:36.155662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895258722590116:7613] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:36.156202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895258722590116:7613] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:36.157718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895258722590116:7613] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:36.157900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:36.159693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:36.159855Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:36.159871Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:36.159878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:36.159929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:36.159963Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895258632856098:6202]
2025-09-30T14:52:36.160293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895258722590116:7613] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:36.160306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895258722590116:7613] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:36.160309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895258722590116:7613] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:36.160317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 882 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:36.160553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:36.160790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:36.160834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:36.161144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:36.161215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:36.161221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:36.161222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:36.161222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:36.161223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:36.161224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:36.161225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:36.161225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:36.161226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:36.161227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:36.161227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.161228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.161230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.161231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:36.161232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:36.161237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:36.161247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:36.161250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:36.161254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:36.161258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:36.161261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:36.161265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:36.161269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:36.161272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:36.161277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:36.161280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.161284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.161287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.161291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:36.161295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:36.161303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:36.161311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:36.161316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:36.161322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:36.161327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:36.161332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:36.161337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:36.161342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:36.161346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:36.161353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:36.161357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:36.161363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:36.161367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:36.161373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:36.161377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:36.161383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:36.161387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:36.161390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:36.161393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:36.161396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:36.161399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.161402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.161410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.161413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.161416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.161419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.161422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:36.161426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:36.161430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:36.161435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:36.161478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:36.166994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:36.167953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:36.167967Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:36.167969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:36.167971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:36.167977Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 881 [2:7555895258632856098:6202]
2025-09-30T14:52:36.167994Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:36.168011Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:36.168014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:36.168018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:36.168020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:36.168035Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:36.168042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:36.168054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:36.168098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.168105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.168106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.168109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:36.168111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:36.168161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:36.168169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.168179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.168186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.168199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:36.168211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895258632856093:6202]
2025-09-30T14:52:36.168216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895258632856093:6202]
2025-09-30T14:52:36.168217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895258632856093:6202]
2025-09-30T14:52:36.168224Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:36.168235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:36.168239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:36.168243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:36.168246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:36.168247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:36.168249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:36.168257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895258722590182:7613], now have 1 active actors on pipe
2025-09-30T14:52:36.168259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895258722589845:2454], now have 1 active actors on pipe
2025-09-30T14:52:36.168283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895258632856093:6202]
2025-09-30T14:52:36.168294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:36.168318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:36.168368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 881
2025-09-30T14:52:36.168376Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 881
2025-09-30T14:52:36.168762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:36.168770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:36.168789Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b9c75345-da2de39a-f62baaa3-42b08563_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:36.168798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:36.168801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:36.168802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:36.168809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:36.168816Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:36.168829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:36.168967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:36.168976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:36.168985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:36.169084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 882 partition: 0 MaxSeqNo: 42 sessionId: src_id|b9c75345-da2de39a-f62baaa3-42b08563_0
2025-09-30T14:52:36.169406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7dbc081-e33d6810-de2f6f79-d2556753_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b9c75345-da2de39a-f62baaa3-42b08563_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:36.171998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9c75345-da2de39a-f62baaa3-42b08563_0] Write session: try to update token
2025-09-30T14:52:36.172013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9c75345-da2de39a-f62baaa3-42b08563_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:36.179670Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:36.179690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:36.179693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:36.179695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:36.179704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895258632856093:6202]
2025-09-30T14:52:36.179708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895258632856093:6202]
2025-09-30T14:52:36.179712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895258632856093:6202]
2025-09-30T14:52:36.179749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:36.179756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.179759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:36.179770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:36.179777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:36.179780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:36.179895Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:36.185426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 882 sessionId: src_id|b9c75345-da2de39a-f62baaa3-42b08563_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:36.187915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:36.244689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895258722590194:7153]
2025-09-30T14:52:36.244958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 881, pipe: [1:7555895258722590194:7153]
2025-09-30T14:52:36.290177Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:36.290473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:36.290486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:36.290519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895258722590194:7153], now have 1 active actors on pipe
2025-09-30T14:52:36.290738Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:36.290801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895258722590194:7153]
2025-09-30T14:52:36.290834Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:36.290847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:36.290925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 882 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b9c75345-da2de39a-f62baaa3-42b08563_0
2025-09-30T14:52:36.291114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 882 sessionId: src_id|b9c75345-da2de39a-f62baaa3-42b08563_0 is DEAD
2025-09-30T14:52:36.291316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9c75345-da2de39a-f62baaa3-42b08563_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:36.291326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9c75345-da2de39a-f62baaa3-42b08563_0] Write session will restart in 0.007235s
2025-09-30T14:52:36.291349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9c75345-da2de39a-f62baaa3-42b08563_0] Write session: Do CDS request
2025-09-30T14:52:36.291355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9c75345-da2de39a-f62baaa3-42b08563_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:36.299731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9c75345-da2de39a-f62baaa3-42b08563_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:36.299810Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:36.299829Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 883
2025-09-30T14:52:36.299937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 883 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:36.299961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 883 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:36.299968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=883 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:36.299971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:36.300280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 883 sessionId:  describe result for acl check
2025-09-30T14:52:36.300304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:36.300305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:36.300307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:36.300311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895258722590302:7617] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:36.300750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895258722590302:7617] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:36.303003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895258722590302:7617] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:36.305805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895258722590302:7617] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:36.305822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895258722590302:7617] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:36.305826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895258722590302:7617] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:36.305834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 883 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:36.309853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:36.310381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:36.310539Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:36.310549Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:36.310559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:36.310598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:36.310637Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895258632856312:6204]
2025-09-30T14:52:36.311331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:36.311627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:36.311669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:36.311994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:36.312047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:36.312053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:36.312055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:36.312056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:36.312058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:36.312059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:36.312060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:36.312062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:36.312063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:36.312064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:36.312066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.312067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.312068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.312070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:36.312071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:36.312076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:36.312087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:36.312095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:36.312100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:36.312104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:36.312109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:36.312113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:36.312118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:36.312122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:36.312127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:36.312132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.312141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.312145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.312150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:36.312154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:36.312165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:36.312178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:36.312189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:36.312202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:36.312207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:36.312213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:36.312218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:36.312224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:36.312229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:36.312235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:36.312240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:36.312246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:36.312256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:36.312262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:36.312270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:36.312281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:36.312287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:36.312293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:36.312299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:36.312309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:36.312317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.312328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.312332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.312342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.312347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.312357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.312361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:36.312371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:36.312376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:36.312386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:36.312433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:36.318038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:36.319381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:36.319398Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:36.319400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:36.319404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:36.319411Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 882 [2:7555895258632856312:6204]
2025-09-30T14:52:36.319427Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:36.319441Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:36.319445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:36.319448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:36.319451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:36.319467Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:36.319475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:36.319481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:36.319545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.319554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.319556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.319560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:36.319563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:36.319628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:36.319637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.319650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.319663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.319680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:36.319703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895258722590529:7617], now have 1 active actors on pipe
2025-09-30T14:52:36.319712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895258722590195:2454], now have 1 active actors on pipe
2025-09-30T14:52:36.319718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895258632856307:6204]
2025-09-30T14:52:36.319721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895258632856307:6204]
2025-09-30T14:52:36.319723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895258632856307:6204]
2025-09-30T14:52:36.319734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:36.319749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:36.319755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:36.319761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:36.319763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:36.319769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:36.319772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:36.319808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895258632856307:6204]
2025-09-30T14:52:36.319823Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:36.319807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 882
2025-09-30T14:52:36.319810Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 882
2025-09-30T14:52:36.319858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:36.319867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:36.319871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:36.319898Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|292c5b61-13351d42-ef31f22b-e2ecce97_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:36.319910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:36.319913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:36.319915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:36.319924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:36.319939Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:36.319958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:36.320120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:36.320128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:36.320144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:36.320241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 883 partition: 0 MaxSeqNo: 42 sessionId: src_id|292c5b61-13351d42-ef31f22b-e2ecce97_0
2025-09-30T14:52:36.320600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9c75345-da2de39a-f62baaa3-42b08563_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|292c5b61-13351d42-ef31f22b-e2ecce97_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:36.323372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|292c5b61-13351d42-ef31f22b-e2ecce97_0] Write session: try to update token
2025-09-30T14:52:36.323393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|292c5b61-13351d42-ef31f22b-e2ecce97_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:36.332100Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:36.332119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:36.332127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895258632856307:6204]
2025-09-30T14:52:36.332165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:36.332185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:36.332322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:36.332459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:36.332620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:36.332763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:36.332957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:36.332998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:36.337661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 883 sessionId: src_id|292c5b61-13351d42-ef31f22b-e2ecce97_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:36.340317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:36.340516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:36.340539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:36.340571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:36.340654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:36.343224Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:36.343263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:36.343266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:36.343269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:36.343280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895258632856307:6204]
2025-09-30T14:52:36.343286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895258632856307:6204]
2025-09-30T14:52:36.343291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895258632856307:6204]
2025-09-30T14:52:36.343335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:36.343341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:36.343348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:36.343349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.343352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:36.343353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:36.343535Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:36.391117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895258722590544:7153]
2025-09-30T14:52:36.391428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 882, pipe: [1:7555895258722590544:7153]
2025-09-30T14:52:36.449602Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:36.456695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:36.456720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:36.456866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.456923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.456981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.457038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.457083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.457094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.457169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.457223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.457283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.457340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.457380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.457386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.457444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.457499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.457558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.457619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.457665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.457670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.457766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.457823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.457882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.457937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.457977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.457984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.458044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.458102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.458168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.458228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.458280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.458286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.458354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.458423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.458480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.458537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.458577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.458582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.458649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.458717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.458782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.458859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.458902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.458908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.458972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.459028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.459084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.459144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.459270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.459276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.459336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.459391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.459450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.459509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.459548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.459554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.459612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.459672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.459732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.459788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.459828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.459834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.459875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895258722590544:7153], now have 1 active actors on pipe
2025-09-30T14:52:36.460079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:36.460085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:36.460088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:36.460117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 883 reason: error at write: Disconnected sessionId: src_id|292c5b61-13351d42-ef31f22b-e2ecce97_0
2025-09-30T14:52:36.460155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895258722590544:7153]
2025-09-30T14:52:36.460298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 883 sessionId: src_id|292c5b61-13351d42-ef31f22b-e2ecce97_0 is DEAD
2025-09-30T14:52:36.460456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|292c5b61-13351d42-ef31f22b-e2ecce97_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:36.460465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|292c5b61-13351d42-ef31f22b-e2ecce97_0] Write session will restart in 0.005422s
2025-09-30T14:52:36.460482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|292c5b61-13351d42-ef31f22b-e2ecce97_0] Write session: Do CDS request
2025-09-30T14:52:36.460487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|292c5b61-13351d42-ef31f22b-e2ecce97_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:36.460766Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:36.466726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|292c5b61-13351d42-ef31f22b-e2ecce97_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:36.466833Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:36.466850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 884
2025-09-30T14:52:36.466983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 884 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:36.467016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 884 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:36.467029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=884 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:36.467033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:36.467513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 884 sessionId:  describe result for acl check
2025-09-30T14:52:36.467550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:36.467558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:36.467560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:36.467566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895258722590583:7621] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:36.468104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895258722590583:7621] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:36.470531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895258722590583:7621] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:36.473021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895258722590583:7621] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:36.473032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895258722590583:7621] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:36.473035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895258722590583:7621] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:36.473041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 884 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:36.477473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:36.478036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:36.478208Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:36.478219Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:36.478232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:36.478298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:36.478340Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895258632856526:6206]
2025-09-30T14:52:36.478997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:36.479352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:36.479411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:36.479775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:36.479831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:36.479838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:36.479839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:36.479841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:36.479842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:36.479843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:36.479845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:36.479846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:36.479847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:36.479848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:36.479849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.479851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.479852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.479853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:36.479854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:36.479860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:36.479871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:36.479875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:36.479880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:36.479885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:36.479889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:36.479894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:36.479898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:36.479903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:36.479908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:36.479912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.479917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.479921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.479925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:36.479929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:36.479937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:36.479945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:36.479951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:36.479962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:36.479967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:36.479978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:36.479983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:36.479988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:36.479998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:36.480004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:36.480013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:36.480019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:36.480025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:36.480034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:36.480040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:36.480046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:36.480055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:36.480061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:36.480071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:36.480077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:36.480085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.480091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.480099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.480105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.480115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.480120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.480129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:36.480135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:36.480139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:36.480149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:36.480196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:36.485667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:36.486849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:36.486868Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:36.486871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:36.486874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:36.486881Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 883 [2:7555895258632856526:6206]
2025-09-30T14:52:36.486896Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:36.486909Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:36.486912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:36.486915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:36.486918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:36.486932Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:36.486938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:36.486944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:36.487014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.487023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.487025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.487029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:36.487032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:36.487099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:36.487108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.487121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.487135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.487154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:36.487175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895258632856521:6206]
2025-09-30T14:52:36.487177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895258632856521:6206]
2025-09-30T14:52:36.487180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895258632856521:6206]
2025-09-30T14:52:36.487188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:36.487199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:36.487204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895258722590545:2454], now have 1 active actors on pipe
2025-09-30T14:52:36.487210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:36.487211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:36.487214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:36.487224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:36.487228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:36.487234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895258722590854:7621], now have 1 active actors on pipe
2025-09-30T14:52:36.487279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895258632856521:6206]
2025-09-30T14:52:36.487292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:36.487285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 883
2025-09-30T14:52:36.487287Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 883
2025-09-30T14:52:36.487326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:36.487401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:36.487412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:36.487438Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|976a1b3b-b692daf5-1295c1b6-9dd0713b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:36.487450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:36.487454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:36.487456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:36.487465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:36.487478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:36.487491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:36.487659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:36.487666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:36.487677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:36.487773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 884 partition: 0 MaxSeqNo: 42 sessionId: src_id|976a1b3b-b692daf5-1295c1b6-9dd0713b_0
2025-09-30T14:52:36.488144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|292c5b61-13351d42-ef31f22b-e2ecce97_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|976a1b3b-b692daf5-1295c1b6-9dd0713b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:36.490906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|976a1b3b-b692daf5-1295c1b6-9dd0713b_0] Write session: try to update token
2025-09-30T14:52:36.490926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|976a1b3b-b692daf5-1295c1b6-9dd0713b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:36.498808Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:36.498835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:36.498845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895258632856521:6206]
2025-09-30T14:52:36.498890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:36.498897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:36.499071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:36.499226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:36.499394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:36.499543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:36.499761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:36.499811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:36.504380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 884 sessionId: src_id|976a1b3b-b692daf5-1295c1b6-9dd0713b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:36.507142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:36.507384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:36.507412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:36.507449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:36.507520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:36.509004Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:36.509025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:36.509027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:36.509029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:36.509039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895258632856521:6206]
2025-09-30T14:52:36.509043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895258632856521:6206]
2025-09-30T14:52:36.509047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895258632856521:6206]
2025-09-30T14:52:36.509093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:36.509105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.509108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:36.509127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:36.509156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:36.509167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:36.509247Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:36.560583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895258722590899:7153]
2025-09-30T14:52:36.560900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 883, pipe: [1:7555895258722590899:7153]
2025-09-30T14:52:36.615972Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:36.623907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:36.623948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:36.624118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.624184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.624248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.624317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.624360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.624376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.624454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.624527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.624595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.624660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.624704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.624713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.624776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.624843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.624929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.624990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.625030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.625036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.625098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.625160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.625233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.625301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.625341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.625348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.625426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.625487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.625553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.625618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.625660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.625666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.625732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.625796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.625856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.625914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.625960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.625966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.626027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.626085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.626145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.626206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.626279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.626285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.626346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.626402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.626465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.626525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.626567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.626573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.626636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.626695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.626772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.626840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.626968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.626978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.627044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.627110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.627173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.627239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.627309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.627316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.627376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895258722590899:7153], now have 1 active actors on pipe
2025-09-30T14:52:36.627565Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:36.627583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:36.627590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:36.627611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895258722590899:7153]
2025-09-30T14:52:36.627619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 884 reason: error at write: Disconnected sessionId: src_id|976a1b3b-b692daf5-1295c1b6-9dd0713b_0
2025-09-30T14:52:36.627800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 884 sessionId: src_id|976a1b3b-b692daf5-1295c1b6-9dd0713b_0 is DEAD
2025-09-30T14:52:36.627955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|976a1b3b-b692daf5-1295c1b6-9dd0713b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:36.627967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|976a1b3b-b692daf5-1295c1b6-9dd0713b_0] Write session will restart in 0.007645s
2025-09-30T14:52:36.627990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|976a1b3b-b692daf5-1295c1b6-9dd0713b_0] Write session: Do CDS request
2025-09-30T14:52:36.627996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|976a1b3b-b692daf5-1295c1b6-9dd0713b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:36.628412Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:36.636721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|976a1b3b-b692daf5-1295c1b6-9dd0713b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:36.636748Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:36.636766Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 885
2025-09-30T14:52:36.636934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 885 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:36.636978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 885 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:36.636987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=885 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:36.636991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:36.637359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 885 sessionId:  describe result for acl check
2025-09-30T14:52:36.637390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:36.637392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:36.637393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:36.637397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895258722591062:7626] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:36.638088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895258722591062:7626] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:36.640787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895258722591062:7626] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:36.644518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895258722591062:7626] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:36.644512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:36.644533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895258722591062:7626] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:36.644537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895258722591062:7626] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:36.644545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 885 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:36.644994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:36.645169Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:36.645182Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:36.645193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:36.645260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:36.645299Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895258632856743:6209]
2025-09-30T14:52:36.645930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:36.646214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:36.646250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:36.646488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:36.646524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:36.646529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:36.646529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:36.646530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:36.646531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:36.646532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:36.646532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:36.646533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:36.646534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:36.646534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:36.646535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.646536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.646536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.646537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:36.646538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:36.646541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:36.646548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:36.646550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:36.646553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:36.646555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:36.646558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:36.646560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:36.646562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:36.646564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:36.646566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:36.646569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.646571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.646573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.646575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:36.646578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:36.646583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:36.646587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:36.646591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:36.646594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:36.646598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:36.646601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:36.646603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:36.646606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:36.646609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:36.646612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:36.646615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:36.646618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:36.646620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:36.646623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:36.646626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:36.646629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:36.646632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:36.646635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:36.646637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:36.646640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:36.646643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.646647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.646649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.646652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.646655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.646658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.646661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:36.646663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:36.646666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:36.646669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:36.646693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:36.651842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:36.652955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:36.652970Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:36.652973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:36.652976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:36.652983Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 884 [2:7555895258632856743:6209]
2025-09-30T14:52:36.652999Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:36.653017Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:36.653020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:36.653023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:36.653026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:36.653040Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:36.653052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:36.653064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:36.653119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.653126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.653129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.653133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:36.653135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:36.653198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:36.653205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.653218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.653229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.653244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:36.653267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895258722591239:7626], now have 1 active actors on pipe
2025-09-30T14:52:36.653278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895258722590900:2454], now have 1 active actors on pipe
2025-09-30T14:52:36.653284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895258632856737:6209]
2025-09-30T14:52:36.653286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895258632856737:6209]
2025-09-30T14:52:36.653289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895258632856737:6209]
2025-09-30T14:52:36.653303Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:36.653316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:36.653332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:36.653335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:36.653334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:36.653339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:36.653341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:36.653364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895258632856737:6209]
2025-09-30T14:52:36.653368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:36.653371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:36.653375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 884
2025-09-30T14:52:36.653374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 884
2025-09-30T14:52:36.653485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:36.653494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:36.653516Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88237ef4-2c59cc69-d1a45e6-be82cffd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:36.653527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:36.653530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:36.653532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:36.653541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:36.653554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:36.653571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:36.653756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:36.653770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:36.653793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:36.653886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 885 partition: 0 MaxSeqNo: 42 sessionId: src_id|88237ef4-2c59cc69-d1a45e6-be82cffd_0
2025-09-30T14:52:36.654215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|976a1b3b-b692daf5-1295c1b6-9dd0713b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|88237ef4-2c59cc69-d1a45e6-be82cffd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:36.656745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88237ef4-2c59cc69-d1a45e6-be82cffd_0] Write session: try to update token
2025-09-30T14:52:36.656764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88237ef4-2c59cc69-d1a45e6-be82cffd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:36.665188Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:36.665206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:36.665216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895258632856737:6209]
2025-09-30T14:52:36.665256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:36.665259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:36.665440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:36.665590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:36.665752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:36.665916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:36.666117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:36.666158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:36.670715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 885 sessionId: src_id|88237ef4-2c59cc69-d1a45e6-be82cffd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:36.673326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:36.673522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:36.673547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:36.673582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:36.673670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:36.675443Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:36.675457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:36.675460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:36.675462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:36.675471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895258632856737:6209]
2025-09-30T14:52:36.675476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895258632856737:6209]
2025-09-30T14:52:36.675479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895258632856737:6209]
2025-09-30T14:52:36.675510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:36.675515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:36.675522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.675522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:36.675526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:36.675529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:36.675653Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:36.728008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895258722591252:7153]
2025-09-30T14:52:36.728264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 884, pipe: [1:7555895258722591252:7153]
2025-09-30T14:52:36.780250Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:36.787796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:36.787826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:36.788008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.788075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.788138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.788197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.788245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.788254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.788325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.788407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.788471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.788530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.788590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.788599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.788662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.788717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.788776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.788840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.788882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.788890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.788952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.789006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.789106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.789164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.789204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.789212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.789280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.789347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.789411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.789480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.789526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.789533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.789596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.789661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.789719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.789775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.789817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.789822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.789890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.789945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.790015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.790082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.790132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.790139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.790202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.790269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.790327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.790394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.790437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.790444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.790503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.790562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.790622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.790692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.790741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.790748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.790809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.790868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.790935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.791002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.791051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.791058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.791112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895258722591252:7153], now have 1 active actors on pipe
2025-09-30T14:52:36.791415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:36.791417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895258722591252:7153]
2025-09-30T14:52:36.791446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:36.791449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:36.791476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 885 reason: error at write: Disconnected sessionId: src_id|88237ef4-2c59cc69-d1a45e6-be82cffd_0
2025-09-30T14:52:36.791675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 885 sessionId: src_id|88237ef4-2c59cc69-d1a45e6-be82cffd_0 is DEAD
2025-09-30T14:52:36.791870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88237ef4-2c59cc69-d1a45e6-be82cffd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:36.791878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88237ef4-2c59cc69-d1a45e6-be82cffd_0] Write session will restart in 0.008794s
2025-09-30T14:52:36.791909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88237ef4-2c59cc69-d1a45e6-be82cffd_0] Write session: Do CDS request
2025-09-30T14:52:36.791915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88237ef4-2c59cc69-d1a45e6-be82cffd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:36.792284Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:36.801840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88237ef4-2c59cc69-d1a45e6-be82cffd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:36.801915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:36.801930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 886
2025-09-30T14:52:36.802029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 886 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:36.802059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 886 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:36.802386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=886 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:36.802400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:36.802820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 886 sessionId:  describe result for acl check
2025-09-30T14:52:36.802861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:36.802868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:36.802870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:36.802876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895258722591472:7630] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:36.803437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895258722591472:7630] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:36.805792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895258722591472:7630] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:36.809112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:36.809401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895258722591472:7630] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:36.809417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895258722591472:7630] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:36.809420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895258722591472:7630] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:36.809428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 886 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:36.809467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:36.809628Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:36.809639Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:36.809650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:36.809695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:36.809737Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895258632856960:6211]
2025-09-30T14:52:36.810413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:36.810659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:36.810693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:36.811005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:36.811075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:36.811085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:36.811086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:36.811087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:36.811089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:36.811090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:36.811091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:36.811093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:36.811094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:36.811096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:36.811097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.811099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.811100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.811101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:36.811103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:36.811108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:36.811120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:36.811125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:36.811130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:36.811134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:36.811139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:36.811143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:36.811148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:36.811152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:36.811157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:36.811162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.811166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.811171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.811175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:36.811184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:36.811192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:36.811205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:36.811215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:36.811223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:36.811228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:36.811240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:36.811261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:36.811267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:36.811272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:36.811278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:36.811283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:36.811289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:36.811295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:36.811306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:36.811315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:36.811320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:36.811330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:36.811335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:36.811345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:36.811350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:36.811358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.811365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.811373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.811379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.811384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.811389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.811394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:36.811399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:36.811404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:36.811410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:36.811463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:36.816705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:36.817783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:36.817799Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:36.817802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:36.817805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:36.817811Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 885 [2:7555895258632856960:6211]
2025-09-30T14:52:36.817825Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:36.817838Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:36.817840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:36.817843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:36.817846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:36.817858Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:36.817870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:36.817882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:36.817936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.817947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.817948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.817952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:36.817955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:36.818017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:36.818024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.818036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.818049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.818069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:36.818090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895258722591253:2454], now have 1 active actors on pipe
2025-09-30T14:52:36.818098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895258722591593:7630], now have 1 active actors on pipe
2025-09-30T14:52:36.818104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895258632856954:6211]
2025-09-30T14:52:36.818107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895258632856954:6211]
2025-09-30T14:52:36.818109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895258632856954:6211]
2025-09-30T14:52:36.818121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:36.818136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:36.818137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:36.818141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:36.818144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:36.818155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:36.818158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:36.818181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895258632856954:6211]
2025-09-30T14:52:36.818188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:36.818191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:36.818161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 885
2025-09-30T14:52:36.818280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 885
2025-09-30T14:52:36.818318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:36.818327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:36.818348Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4804fecc-9d1ae318-9091d374-72444714_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:36.818359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:36.818366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:36.818368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:36.818378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:36.818390Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:36.818407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:36.818544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:36.818550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:36.818562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:36.818661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 886 partition: 0 MaxSeqNo: 42 sessionId: src_id|4804fecc-9d1ae318-9091d374-72444714_0
2025-09-30T14:52:36.818961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88237ef4-2c59cc69-d1a45e6-be82cffd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4804fecc-9d1ae318-9091d374-72444714_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:36.821817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4804fecc-9d1ae318-9091d374-72444714_0] Write session: try to update token
2025-09-30T14:52:36.821833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4804fecc-9d1ae318-9091d374-72444714_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:36.830755Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:36.830774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:36.830785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895258632856954:6211]
2025-09-30T14:52:36.830823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:36.830836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:36.830993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:36.831144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:36.831305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:36.831448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:36.831646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:36.831684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:36.836254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 886 sessionId: src_id|4804fecc-9d1ae318-9091d374-72444714_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:36.838698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:36.838929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:36.838951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:36.838988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:36.839074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:36.840817Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:36.840836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:36.840838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:36.840840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:36.840849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895258632856954:6211]
2025-09-30T14:52:36.840853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895258632856954:6211]
2025-09-30T14:52:36.840857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895258632856954:6211]
2025-09-30T14:52:36.840893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:36.840896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:36.840902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:36.840904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.840906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:36.840907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:36.841037Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:36.891331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895258722591605:7153]
2025-09-30T14:52:36.891592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 885, pipe: [1:7555895258722591605:7153]
2025-09-30T14:52:36.958952Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:36.967478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:36.967503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:36.967668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.967731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.967794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.967860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.967906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.967917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.967984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.968047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.968124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.968197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.968240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.968248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.968312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.968375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.968438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.968504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.968547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.968554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.968619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.968684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.968757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.968859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.968904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.968917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.968984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.969044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.969137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.969209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.969260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.969268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.969335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.969401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.969472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.969538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.969581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.969589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.969654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.969713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.969786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.969858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.969901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.969911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.969984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.970042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.970104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.970166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.970209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.970219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.970296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.970360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.970422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.970481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.970524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.970532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.970593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:36.970651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:36.970712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:36.970777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:36.970820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:36.970828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:36.970889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895258722591605:7153], now have 1 active actors on pipe
2025-09-30T14:52:36.971101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:36.971114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:36.971115Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:36.971141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 886 reason: error at write: Disconnected sessionId: src_id|4804fecc-9d1ae318-9091d374-72444714_0
2025-09-30T14:52:36.971164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895258722591605:7153]
2025-09-30T14:52:36.971300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 886 sessionId: src_id|4804fecc-9d1ae318-9091d374-72444714_0 is DEAD
2025-09-30T14:52:36.971424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4804fecc-9d1ae318-9091d374-72444714_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:36.971435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4804fecc-9d1ae318-9091d374-72444714_0] Write session will restart in 0.006609s
2025-09-30T14:52:36.971458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4804fecc-9d1ae318-9091d374-72444714_0] Write session: Do CDS request
2025-09-30T14:52:36.971463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4804fecc-9d1ae318-9091d374-72444714_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:36.971998Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:36.978693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4804fecc-9d1ae318-9091d374-72444714_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:36.978781Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:36.978796Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 887
2025-09-30T14:52:36.978919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 887 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:36.978961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 887 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:36.978970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=887 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:36.978974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:36.979408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 887 sessionId:  describe result for acl check
2025-09-30T14:52:36.979453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:36.979460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:36.979462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:36.979467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895258722591706:7634] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:36.979965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895258722591706:7634] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:36.982248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895258722591706:7634] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:36.984622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895258722591706:7634] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:36.984637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895258722591706:7634] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:36.984640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895258722591706:7634] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:36.984648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 887 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:36.987881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:36.988313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:36.988462Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:36.988471Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:36.988481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:36.988517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:36.988552Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895258632857177:6213]
2025-09-30T14:52:36.989209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:36.989467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:36.989501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:36.989843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:36.989909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:36.989915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:36.989916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:36.989917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:36.989918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:36.989920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:36.989921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:36.989922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:36.989923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:36.989925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:36.989926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.989927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.989929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.989930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:36.989931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:36.989936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:36.989947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:36.989951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:36.989956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:36.989961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:36.989965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:36.989970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:36.989974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:36.989978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:36.989983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:36.989988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.989992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.989996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.990001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:36.990005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:36.990012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:36.990020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:36.990027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:36.990033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:36.990038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:36.990044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:36.990049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:36.990054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:36.990059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:36.990065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:36.990071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:36.990082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:36.990087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:36.990092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:36.990101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:36.990107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:36.990117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:36.990123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:36.990127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:36.990138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:36.990143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.990151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.990159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.990165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.990170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.990180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.990185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:36.990190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:36.990199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:36.990206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:36.990267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:36.995494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:36.996313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:36.996329Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:36.996331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:36.996335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:36.996342Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 886 [2:7555895258632857177:6213]
2025-09-30T14:52:36.996358Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:36.996372Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:36.996375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:36.996378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:36.996381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:36.996395Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:36.996406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:36.996413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:36.996466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.996474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.996476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.996480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:36.996483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:36.996545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:36.996553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:36.996565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:36.996579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:36.996599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:36.996622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895258722591944:7634], now have 1 active actors on pipe
2025-09-30T14:52:36.996627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895258722591609:2454], now have 1 active actors on pipe
2025-09-30T14:52:36.996632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895258632857172:6213]
2025-09-30T14:52:36.996635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895258632857172:6213]
2025-09-30T14:52:36.996637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895258632857172:6213]
2025-09-30T14:52:36.996651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:36.996669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:36.996676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:36.996680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:36.996683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:36.996689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:36.996693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:36.996722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895258632857172:6213]
2025-09-30T14:52:36.996733Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:36.996717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 886
2025-09-30T14:52:36.996744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:36.996807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 886
2025-09-30T14:52:36.996879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:36.996892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:36.996915Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d9f66ef-a16ad20d-5dfae0f0-cddbb72d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:36.996927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:36.996931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:36.996935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:36.996945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:36.996958Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:36.996975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:36.997219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:36.997230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:36.997243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:36.997383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 887 partition: 0 MaxSeqNo: 42 sessionId: src_id|8d9f66ef-a16ad20d-5dfae0f0-cddbb72d_0
2025-09-30T14:52:36.997738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4804fecc-9d1ae318-9091d374-72444714_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8d9f66ef-a16ad20d-5dfae0f0-cddbb72d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:37.000555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d9f66ef-a16ad20d-5dfae0f0-cddbb72d_0] Write session: try to update token
2025-09-30T14:52:37.000579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d9f66ef-a16ad20d-5dfae0f0-cddbb72d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:37.008630Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:37.008647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:37.008655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895258632857172:6213]
2025-09-30T14:52:37.008688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:37.008693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:37.008864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:37.009016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:37.009169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:37.009342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:37.009534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:37.009577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:37.014826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 887 sessionId: src_id|8d9f66ef-a16ad20d-5dfae0f0-cddbb72d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:37.017600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:37.017842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:37.017877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:37.017912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:37.017975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:37.019058Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:37.019075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:37.019077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:37.019079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:37.019088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895258632857172:6213]
2025-09-30T14:52:37.019091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895258632857172:6213]
2025-09-30T14:52:37.019098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895258632857172:6213]
2025-09-30T14:52:37.019136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:37.019141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:37.019144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.019146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:37.019146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:37.019150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:37.019280Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:37.071537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895263017559296:7153]
2025-09-30T14:52:37.071837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 886, pipe: [1:7555895263017559296:7153]
2025-09-30T14:52:37.126013Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:37.134462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:37.134493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:37.134669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:37.134734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:37.134801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:37.134867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:37.134909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:37.134916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:37.134982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:37.135041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:37.135108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:37.135169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:37.135211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:37.135217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:37.135303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:37.135368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:37.135427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:37.135490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:37.135533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:37.135539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:37.135609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:37.135672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:37.135730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:37.135793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:37.135838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:37.135847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:37.135914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:37.135971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:37.136039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:37.136110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:37.136160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:37.136169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:37.136233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:37.136291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:37.136352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:37.136420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:37.136463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:37.136469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:37.136530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:37.136586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:37.136664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:37.136725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:37.136766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:37.136772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:37.136834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:37.136896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:37.136956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:37.137013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:37.137059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:37.137066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:37.137131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:37.137190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:37.137248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:37.137305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:37.137350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:37.137356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:37.137424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:37.137481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:37.137540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:37.137609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:37.137654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:37.137661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:37.137718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895263017559296:7153], now have 1 active actors on pipe
2025-09-30T14:52:37.137939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:37.137993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:37.137996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:37.138025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 887 reason: error at write: Disconnected sessionId: src_id|8d9f66ef-a16ad20d-5dfae0f0-cddbb72d_0
2025-09-30T14:52:37.138194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 887 sessionId: src_id|8d9f66ef-a16ad20d-5dfae0f0-cddbb72d_0 is DEAD
2025-09-30T14:52:37.138368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d9f66ef-a16ad20d-5dfae0f0-cddbb72d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:37.138380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d9f66ef-a16ad20d-5dfae0f0-cddbb72d_0] Write session will restart in 0.008362s
2025-09-30T14:52:37.138403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d9f66ef-a16ad20d-5dfae0f0-cddbb72d_0] Write session: Do CDS request
2025-09-30T14:52:37.138408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d9f66ef-a16ad20d-5dfae0f0-cddbb72d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:37.138510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895263017559296:7153]
2025-09-30T14:52:37.138907Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:37.147735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d9f66ef-a16ad20d-5dfae0f0-cddbb72d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:37.147834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:37.147852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 888
2025-09-30T14:52:37.148004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 888 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:37.148045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 888 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:37.148056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=888 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:37.148060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:37.148491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 888 sessionId:  describe result for acl check
2025-09-30T14:52:37.148524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:37.148530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:37.148533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:37.148538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895263017559415:7648] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:37.149056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895263017559415:7648] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:37.151684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895263017559415:7648] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:37.154174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895263017559415:7648] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:37.154191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895263017559415:7648] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:37.154195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895263017559415:7648] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:37.154203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 888 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:37.156342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:37.158117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:37.158290Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:37.158300Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:37.158307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:37.158344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:37.158372Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895262927824741:6229]
2025-09-30T14:52:37.158889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:37.159157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:37.159222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:37.159571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:37.159642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:37.159649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:37.159650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:37.159652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:37.159653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:37.159654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:37.159655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:37.159656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:37.159657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:37.159658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:37.159659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.159660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.159661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.159662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:37.159664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:37.159669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:37.159681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:37.159686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:37.159691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:37.159695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:37.159700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:37.159704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:37.159709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:37.159720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:37.159725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:37.159729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.159733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.159737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.159741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:37.159746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:37.159755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:37.159763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:37.159769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:37.159774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:37.159785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:37.159791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:37.159800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:37.159806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:37.159815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:37.159831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:37.159839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:37.159845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:37.159854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:37.159859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:37.159867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:37.159873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:37.159882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:37.159889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:37.159897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:37.159903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:37.159911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.159919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.159927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.159932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.159936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.159940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.159944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:37.159949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:37.159953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:37.159958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:37.160001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:37.165298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:37.166350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:37.166365Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:37.166367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:37.166371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:37.166377Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 887 [2:7555895262927824741:6229]
2025-09-30T14:52:37.166389Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:37.166406Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:37.166411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:37.166413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:37.166415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:37.166427Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:37.166432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:37.166437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:37.166496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.166504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.166505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.166508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:37.166510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:37.166576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:37.166585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.166597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.166607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.166632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:37.166648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895262927824736:6229]
2025-09-30T14:52:37.166656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895262927824736:6229]
2025-09-30T14:52:37.166658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895262927824736:6229]
2025-09-30T14:52:37.166664Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:37.166674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:37.166684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:37.166690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:37.166699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:37.166712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:37.166715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:37.166719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895262927824736:6229]
2025-09-30T14:52:37.166721Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:37.166731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:37.166736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895263017559301:2454], now have 1 active actors on pipe
2025-09-30T14:52:37.166746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895263017559640:7648], now have 1 active actors on pipe
2025-09-30T14:52:37.166805Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 887
2025-09-30T14:52:37.166839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 887
2025-09-30T14:52:37.166875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:37.166889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:37.166912Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72925055-f71b0b41-9a6a420e-9e01f4b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:37.166923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:37.166931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:37.166933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:37.166942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:37.166951Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:37.166962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:37.167122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:37.167129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:37.167142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:37.167255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 888 partition: 0 MaxSeqNo: 42 sessionId: src_id|72925055-f71b0b41-9a6a420e-9e01f4b2_0
2025-09-30T14:52:37.167639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d9f66ef-a16ad20d-5dfae0f0-cddbb72d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|72925055-f71b0b41-9a6a420e-9e01f4b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:37.170617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72925055-f71b0b41-9a6a420e-9e01f4b2_0] Write session: try to update token
2025-09-30T14:52:37.170638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72925055-f71b0b41-9a6a420e-9e01f4b2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:37.178043Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:37.178062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:37.178075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895262927824736:6229]
2025-09-30T14:52:37.178115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:37.178118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:37.178290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:37.178427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:37.178556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:37.178687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:37.178868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:37.178905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:37.185387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 888 sessionId: src_id|72925055-f71b0b41-9a6a420e-9e01f4b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:37.188135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:37.188480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:37.188503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:37.188519Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:37.188521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:37.188523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:37.188525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:37.188532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895262927824736:6229]
2025-09-30T14:52:37.188535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895262927824736:6229]
2025-09-30T14:52:37.188538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895262927824736:6229]
2025-09-30T14:52:37.188570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:37.188574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:37.188576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:37.188577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:37.188582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.188584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:37.188703Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:37.238477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895263017559655:7153]
2025-09-30T14:52:37.238733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 887, pipe: [1:7555895263017559655:7153]
2025-09-30T14:52:37.294335Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:37.294919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:37.294955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895263017559655:7153], now have 1 active actors on pipe
2025-09-30T14:52:37.295068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:37.295121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895263017559655:7153]
2025-09-30T14:52:37.295143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:37.295173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:37.295182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:37.295263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 888 reason: error at write: Disconnected sessionId: src_id|72925055-f71b0b41-9a6a420e-9e01f4b2_0
2025-09-30T14:52:37.295408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 888 sessionId: src_id|72925055-f71b0b41-9a6a420e-9e01f4b2_0 is DEAD
2025-09-30T14:52:37.295528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72925055-f71b0b41-9a6a420e-9e01f4b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:37.295538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72925055-f71b0b41-9a6a420e-9e01f4b2_0] Write session will restart in 0.005690s
2025-09-30T14:52:37.295556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72925055-f71b0b41-9a6a420e-9e01f4b2_0] Write session: Do CDS request
2025-09-30T14:52:37.295561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72925055-f71b0b41-9a6a420e-9e01f4b2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:37.302762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72925055-f71b0b41-9a6a420e-9e01f4b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:37.302861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:37.302878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 889
2025-09-30T14:52:37.303010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 889 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:37.303045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 889 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:37.303055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=889 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:37.303058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:37.303476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 889 sessionId:  describe result for acl check
2025-09-30T14:52:37.303511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:37.303518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:37.303520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:37.303525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895263017559718:7652] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:37.304062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895263017559718:7652] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:37.306085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895263017559718:7652] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:37.308908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895263017559718:7652] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:37.308924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895263017559718:7652] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:37.308928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895263017559718:7652] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:37.308936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 889 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:37.313749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:37.314284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:37.314463Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:37.314475Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:37.314485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:37.314540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:37.314583Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895262927824960:6231]
2025-09-30T14:52:37.315151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:37.315487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:37.315544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:37.315799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:37.315868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:37.315875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:37.315876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:37.315877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:37.315879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:37.315880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:37.315882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:37.315883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:37.315884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:37.315885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:37.315887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.315888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.315889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.315891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:37.315892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:37.315895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:37.315902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:37.315905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:37.315907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:37.315914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:37.315922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:37.315927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:37.315931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:37.315935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:37.315939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:37.315944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.315947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.315956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.315960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:37.315964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:37.315972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:37.315986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:37.315999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:37.316012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:37.316017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:37.316021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:37.316023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:37.316026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:37.316029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:37.316032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:37.316036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:37.316039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:37.316042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:37.316045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:37.316049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:37.316055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:37.316059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:37.316065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:37.316069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:37.316075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:37.316080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.316085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.316092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.316102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.316107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.316112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.316115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:37.316119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:37.316121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:37.316124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:37.316149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:37.321692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:37.322551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:37.322566Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:37.322569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:37.322574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:37.322581Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 888 [2:7555895262927824960:6231]
2025-09-30T14:52:37.322596Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:37.322611Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:37.322621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:37.322624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:37.322627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:37.322643Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:37.322651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:37.322658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:37.322721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.322729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.322732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.322736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:37.322738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:37.322802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:37.322813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.322825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.322838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.322856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:37.322873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895263017559656:2454], now have 1 active actors on pipe
2025-09-30T14:52:37.322883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895263017559981:7652], now have 1 active actors on pipe
2025-09-30T14:52:37.322889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895262927824955:6231]
2025-09-30T14:52:37.322891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895262927824955:6231]
2025-09-30T14:52:37.322893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895262927824955:6231]
2025-09-30T14:52:37.322907Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:37.322920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:37.322936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:37.322939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:37.322947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:37.322953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:37.322955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:37.322972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895262927824955:6231]
2025-09-30T14:52:37.322984Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:37.322986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:37.322987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 888
2025-09-30T14:52:37.322990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 888
2025-09-30T14:52:37.323041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:37.323051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:37.323074Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bbcd551b-e8410f6d-6a18baff-ae1a6ac7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:37.323085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:37.323089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:37.323090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:37.323101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:37.323115Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:37.323135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:37.323287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:37.323302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:37.323332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:37.323421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 889 partition: 0 MaxSeqNo: 42 sessionId: src_id|bbcd551b-e8410f6d-6a18baff-ae1a6ac7_0
2025-09-30T14:52:37.323754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72925055-f71b0b41-9a6a420e-9e01f4b2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bbcd551b-e8410f6d-6a18baff-ae1a6ac7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:37.326401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbcd551b-e8410f6d-6a18baff-ae1a6ac7_0] Write session: try to update token
2025-09-30T14:52:37.326419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbcd551b-e8410f6d-6a18baff-ae1a6ac7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:37.334980Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:37.335000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:37.335011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895262927824955:6231]
2025-09-30T14:52:37.335053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:37.335053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:37.335259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:37.335407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:37.335554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:37.335700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:37.335904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:37.335943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:37.340005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 889 sessionId: src_id|bbcd551b-e8410f6d-6a18baff-ae1a6ac7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:37.342553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:37.342810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:37.342840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:37.342869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:37.342933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:37.345345Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:37.345361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:37.345363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:37.345365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:37.345372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895262927824955:6231]
2025-09-30T14:52:37.345375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895262927824955:6231]
2025-09-30T14:52:37.345382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895262927824955:6231]
2025-09-30T14:52:37.345414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:37.345416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:37.345419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.345420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:37.345421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:37.345423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:37.345540Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:37.395140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895263017560011:7153]
2025-09-30T14:52:37.395432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 888, pipe: [1:7555895263017560011:7153]
2025-09-30T14:52:37.448543Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:37.456798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:37.456827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:37.456979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:37.457040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:37.457102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:37.457180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:37.457229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:37.457237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:37.457322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:37.457381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:37.457444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:37.457505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:37.457555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:37.457563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:37.457641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:37.457705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:37.457764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:37.457822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:37.457870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:37.457877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:37.457939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:37.458005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:37.458076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:37.458138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:37.458178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:37.458184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:37.458249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:37.458320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:37.458387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:37.458460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:37.458501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:37.458507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:37.458583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:37.458643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:37.458704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:37.458769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:37.458819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:37.458830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:37.458905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:37.458962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:37.459024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:37.459084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:37.459217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:37.459228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:37.459313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:37.459371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:37.459432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:37.459491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:37.459532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:37.459537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:37.459598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:37.459662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:37.459740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:37.459802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:37.459866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:37.459875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:37.459937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:37.459994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:37.460052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:37.460126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:37.460177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:37.460186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:37.460240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895263017560011:7153], now have 1 active actors on pipe
2025-09-30T14:52:37.460456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:37.460459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:37.460471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:37.460497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 889 reason: error at write: Disconnected sessionId: src_id|bbcd551b-e8410f6d-6a18baff-ae1a6ac7_0
2025-09-30T14:52:37.460507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895263017560011:7153]
2025-09-30T14:52:37.460675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 889 sessionId: src_id|bbcd551b-e8410f6d-6a18baff-ae1a6ac7_0 is DEAD
2025-09-30T14:52:37.460772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbcd551b-e8410f6d-6a18baff-ae1a6ac7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:37.460780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbcd551b-e8410f6d-6a18baff-ae1a6ac7_0] Write session will restart in 0.005246s
2025-09-30T14:52:37.460797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbcd551b-e8410f6d-6a18baff-ae1a6ac7_0] Write session: Do CDS request
2025-09-30T14:52:37.460801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbcd551b-e8410f6d-6a18baff-ae1a6ac7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:37.461558Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:37.466706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbcd551b-e8410f6d-6a18baff-ae1a6ac7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:37.467071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:37.467094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 890
2025-09-30T14:52:37.467272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 890 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:37.467315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 890 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:37.467322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=890 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:37.467325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:37.467735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 890 sessionId:  describe result for acl check
2025-09-30T14:52:37.467765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:37.467771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:37.467772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:37.467776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895263017560045:7656] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:37.468220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895263017560045:7656] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:37.470895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895263017560045:7656] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:37.473718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895263017560045:7656] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:37.473735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895263017560045:7656] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:37.473738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895263017560045:7656] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:37.473751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 890 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:37.476483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:37.478552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:37.478710Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:37.478719Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:37.478727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:37.478764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:37.478795Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895262927825180:6233]
2025-09-30T14:52:37.479277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:37.479534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:37.479583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:37.479822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:37.479870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:37.479875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:37.479876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:37.479876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:37.479877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:37.479878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:37.479879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:37.479879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:37.479880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:37.479881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:37.479881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.479882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.479883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.479884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:37.479884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:37.479888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:37.479896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:37.479898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:37.479901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:37.479903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:37.479905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:37.479908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:37.479910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:37.479912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:37.479915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:37.479917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.479919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.479922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.479924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:37.479926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:37.479932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:37.479937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:37.479940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:37.479944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:37.479947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:37.479950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:37.479952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:37.479955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:37.479957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:37.479960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:37.479962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:37.479966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:37.479969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:37.479971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:37.479974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:37.479977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:37.479979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:37.479982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:37.479984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:37.479987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:37.479990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.479993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.479995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.479998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.480001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.480003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.480006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:37.480010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:37.480013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:37.480015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:37.480041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:37.485689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:37.486933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:37.486949Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:37.486951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:37.486954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:37.486960Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 889 [2:7555895262927825180:6233]
2025-09-30T14:52:37.486972Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:37.486985Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:37.486988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:37.486990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:37.486992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:37.487005Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:37.487010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:37.487015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:37.487058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.487063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.487065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.487067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:37.487069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:37.487117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:37.487122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.487130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.487137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.487150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:37.487166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895263017560335:7656], now have 1 active actors on pipe
2025-09-30T14:52:37.487176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895262927825175:6233]
2025-09-30T14:52:37.487183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895262927825175:6233]
2025-09-30T14:52:37.487185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895262927825175:6233]
2025-09-30T14:52:37.487196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:37.487210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895263017560012:2454], now have 1 active actors on pipe
2025-09-30T14:52:37.487210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:37.487214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:37.487216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:37.487221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:37.487241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:37.487269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:37.487271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 889
2025-09-30T14:52:37.487306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895262927825175:6233]
2025-09-30T14:52:37.487272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 889
2025-09-30T14:52:37.487310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:37.487313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:37.487337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:37.487347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:37.487378Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa33c018-f41b7ed1-56ff4736-8ace0790_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:37.487389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:37.487393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:37.487396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:37.487404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:37.487418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:37.487439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:37.487568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:37.487575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:37.487590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:37.487679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 890 partition: 0 MaxSeqNo: 42 sessionId: src_id|fa33c018-f41b7ed1-56ff4736-8ace0790_0
2025-09-30T14:52:37.488012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbcd551b-e8410f6d-6a18baff-ae1a6ac7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fa33c018-f41b7ed1-56ff4736-8ace0790_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:37.490710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa33c018-f41b7ed1-56ff4736-8ace0790_0] Write session: try to update token
2025-09-30T14:52:37.490729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa33c018-f41b7ed1-56ff4736-8ace0790_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:37.499565Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:37.499586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:37.499587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:37.499589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:37.499596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895262927825175:6233]
2025-09-30T14:52:37.499599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895262927825175:6233]
2025-09-30T14:52:37.499606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895262927825175:6233]
2025-09-30T14:52:37.499635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:37.499641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.499644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:37.499651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:37.499657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:37.499661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:37.499769Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:37.505705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 890 sessionId: src_id|fa33c018-f41b7ed1-56ff4736-8ace0790_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:37.508530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:37.560508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895263017560370:7153]
2025-09-30T14:52:37.560783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 889, pipe: [1:7555895263017560370:7153]
2025-09-30T14:52:37.605693Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:37.606210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:37.606224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:37.606272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895263017560370:7153], now have 1 active actors on pipe
2025-09-30T14:52:37.606441Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:37.606513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:37.606538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:37.606543Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:37.606596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895263017560370:7153]
2025-09-30T14:52:37.606604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 890 reason: error at write: Disconnected sessionId: src_id|fa33c018-f41b7ed1-56ff4736-8ace0790_0
2025-09-30T14:52:37.606762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 890 sessionId: src_id|fa33c018-f41b7ed1-56ff4736-8ace0790_0 is DEAD
2025-09-30T14:52:37.606920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa33c018-f41b7ed1-56ff4736-8ace0790_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:37.606932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa33c018-f41b7ed1-56ff4736-8ace0790_0] Write session will restart in 0.005125s
2025-09-30T14:52:37.606956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa33c018-f41b7ed1-56ff4736-8ace0790_0] Write session: Do CDS request
2025-09-30T14:52:37.606965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa33c018-f41b7ed1-56ff4736-8ace0790_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:37.612666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa33c018-f41b7ed1-56ff4736-8ace0790_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:37.612787Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:37.612803Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 891
2025-09-30T14:52:37.612889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 891 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:37.612919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 891 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:37.612929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=891 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:37.612932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:37.613384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 891 sessionId:  describe result for acl check
2025-09-30T14:52:37.613420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:37.613429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:37.613432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:37.613438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895263017560386:7661] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:37.613981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895263017560386:7661] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:37.616205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895263017560386:7661] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:37.618647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895263017560386:7661] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:37.618664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895263017560386:7661] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:37.618668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895263017560386:7661] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:37.618675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 891 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:37.624772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:37.625277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:37.625448Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:37.625457Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:37.625467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:37.625514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:37.625551Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895262927825402:6236]
2025-09-30T14:52:37.626221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:37.626531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:37.626572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:37.626858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:37.626909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:37.626914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:37.626915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:37.626915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:37.626916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:37.626917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:37.626918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:37.626918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:37.626919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:37.626919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:37.626920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.626921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.626922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.626922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:37.626923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:37.626926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:37.626933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:37.626935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:37.626938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:37.626940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:37.626943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:37.626945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:37.626948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:37.626950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:37.626952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:37.626954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.626957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.626959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.626961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:37.626963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:37.626969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:37.626974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:37.626978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:37.626981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:37.626984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:37.626987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:37.626990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:37.626993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:37.626995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:37.626999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:37.627003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:37.627006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:37.627008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:37.627011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:37.627013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:37.627016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:37.627018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:37.627023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:37.627028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:37.627033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:37.627037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.627042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.627046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.627050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.627054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.627059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.627062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:37.627067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:37.627071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:37.627076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:37.627118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:37.632402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:37.633255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:37.633271Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:37.633273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:37.633277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:37.633284Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 890 [2:7555895262927825402:6236]
2025-09-30T14:52:37.633299Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:37.633317Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:37.633324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:37.633327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:37.633329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:37.633344Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:37.633355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:37.633362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:37.633417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.633424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.633426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.633429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:37.633432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:37.633493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:37.633502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.633515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.633527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.633543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:37.633564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895263017560663:7661], now have 1 active actors on pipe
2025-09-30T14:52:37.633572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895263017560371:2454], now have 1 active actors on pipe
2025-09-30T14:52:37.633578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895262927825397:6236]
2025-09-30T14:52:37.633580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895262927825397:6236]
2025-09-30T14:52:37.633583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895262927825397:6236]
2025-09-30T14:52:37.633594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:37.633612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:37.633611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:37.633615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:37.633617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:37.633631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:37.633634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:37.633632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 890
2025-09-30T14:52:37.633662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895262927825397:6236]
2025-09-30T14:52:37.633670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:37.633636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 890
2025-09-30T14:52:37.633672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:37.633698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:37.633706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:37.633736Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|785989e2-47dfeded-75753f4-dd2a59f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:37.633747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:37.633750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:37.633752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:37.633761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:37.633769Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:37.633788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:37.633901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:37.633909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:37.633924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:37.634015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 891 partition: 0 MaxSeqNo: 42 sessionId: src_id|785989e2-47dfeded-75753f4-dd2a59f2_0
2025-09-30T14:52:37.634340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa33c018-f41b7ed1-56ff4736-8ace0790_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|785989e2-47dfeded-75753f4-dd2a59f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:37.636997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|785989e2-47dfeded-75753f4-dd2a59f2_0] Write session: try to update token
2025-09-30T14:52:37.637012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|785989e2-47dfeded-75753f4-dd2a59f2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:37.645364Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:37.645385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:37.645387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:37.645389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:37.645397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895262927825397:6236]
2025-09-30T14:52:37.645401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895262927825397:6236]
2025-09-30T14:52:37.645405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895262927825397:6236]
2025-09-30T14:52:37.645445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:37.645447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:37.645453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.645453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:37.645455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:37.645457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:37.645609Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:37.650987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 891 sessionId: src_id|785989e2-47dfeded-75753f4-dd2a59f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:37.653875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:37.706941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895263017560728:7153]
2025-09-30T14:52:37.707274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 890, pipe: [1:7555895263017560728:7153]
2025-09-30T14:52:37.749461Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:37.750117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:37.750131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:37.750162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895263017560728:7153], now have 1 active actors on pipe
2025-09-30T14:52:37.750356Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:37.750406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895263017560728:7153]
2025-09-30T14:52:37.750413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:37.750442Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:37.750499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 891 reason: status is not ok: tablet will be restarted right now sessionId: src_id|785989e2-47dfeded-75753f4-dd2a59f2_0
2025-09-30T14:52:37.750667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 891 sessionId: src_id|785989e2-47dfeded-75753f4-dd2a59f2_0 is DEAD
2025-09-30T14:52:37.750799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|785989e2-47dfeded-75753f4-dd2a59f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:37.750805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|785989e2-47dfeded-75753f4-dd2a59f2_0] Write session will restart in 0.006863s
2025-09-30T14:52:37.750821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|785989e2-47dfeded-75753f4-dd2a59f2_0] Write session: Do CDS request
2025-09-30T14:52:37.750826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|785989e2-47dfeded-75753f4-dd2a59f2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:37.758755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|785989e2-47dfeded-75753f4-dd2a59f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:37.758868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:37.758890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 892
2025-09-30T14:52:37.759008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 892 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:37.759042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 892 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:37.759055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=892 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:37.759063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:37.759495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 892 sessionId:  describe result for acl check
2025-09-30T14:52:37.759528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:37.759534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:37.759537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:37.759541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895263017560832:7665] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:37.759954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895263017560832:7665] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:37.762104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895263017560832:7665] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:37.764429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895263017560832:7665] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:37.764443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895263017560832:7665] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:37.764450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895263017560832:7665] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:37.764456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 892 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:37.766355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:37.768601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:37.768792Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:37.768804Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:37.768815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:37.768867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:37.768911Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895262927825624:6238]
2025-09-30T14:52:37.769557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:37.769800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:37.769841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:37.770142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:37.770224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:37.770231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:37.770232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:37.770233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:37.770235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:37.770236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:37.770237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:37.770238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:37.770239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:37.770241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:37.770242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.770243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.770244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.770246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:37.770248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:37.770264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:37.770275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:37.770279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:37.770283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:37.770287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:37.770292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:37.770296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:37.770300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:37.770304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:37.770308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:37.770312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.770317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.770321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.770325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:37.770329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:37.770337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:37.770345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:37.770353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:37.770363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:37.770367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:37.770372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:37.770376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:37.770382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:37.770387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:37.770397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:37.770402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:37.770407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:37.770416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:37.770422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:37.770426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:37.770436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:37.770441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:37.770451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:37.770455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:37.770461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:37.770466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.770472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.770476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.770481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.770486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.770495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.770500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:37.770504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:37.770510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:37.770516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:37.770561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:37.775878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:37.777143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:37.777159Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:37.777162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:37.777166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:37.777172Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 891 [2:7555895262927825624:6238]
2025-09-30T14:52:37.777187Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:37.777204Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:37.777209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:37.777211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:37.777213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:37.777224Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:37.777229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:37.777234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:37.777283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.777289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.777290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.777292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:37.777294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:37.777342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:37.777348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.777355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.777362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.777374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:37.777387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895262927825619:6238]
2025-09-30T14:52:37.777392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895262927825619:6238]
2025-09-30T14:52:37.777394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895262927825619:6238]
2025-09-30T14:52:37.777399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:37.777409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895263017560729:2454], now have 1 active actors on pipe
2025-09-30T14:52:37.777409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:37.777412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:37.777414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:37.777417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895263017561072:7665], now have 1 active actors on pipe
2025-09-30T14:52:37.777422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:37.777431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:37.777432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:37.777453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895262927825619:6238]
2025-09-30T14:52:37.777461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:37.777469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:37.777510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 891
2025-09-30T14:52:37.777511Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 891
2025-09-30T14:52:37.777618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:37.777630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:37.777650Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11a2ff6c-d8d88ea4-f7635064-851b9b19_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:37.777659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:37.777661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:37.777662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:37.777669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:37.777677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:37.777686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:37.777821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:37.777829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:37.777840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:37.777934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 892 partition: 0 MaxSeqNo: 42 sessionId: src_id|11a2ff6c-d8d88ea4-f7635064-851b9b19_0
2025-09-30T14:52:37.778287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|785989e2-47dfeded-75753f4-dd2a59f2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|11a2ff6c-d8d88ea4-f7635064-851b9b19_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:37.780842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11a2ff6c-d8d88ea4-f7635064-851b9b19_0] Write session: try to update token
2025-09-30T14:52:37.780858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11a2ff6c-d8d88ea4-f7635064-851b9b19_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:37.789595Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:37.789613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:37.789623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895262927825619:6238]
2025-09-30T14:52:37.789657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:37.789665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:37.789826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:37.789964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:37.790092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:37.790221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:37.790424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:37.790467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:37.794478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 892 sessionId: src_id|11a2ff6c-d8d88ea4-f7635064-851b9b19_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:37.796916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:37.797101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:37.797122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:37.797151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:37.797247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:37.800703Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:37.800719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:37.800720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:37.800722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:37.800729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895262927825619:6238]
2025-09-30T14:52:37.800732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895262927825619:6238]
2025-09-30T14:52:37.800735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895262927825619:6238]
2025-09-30T14:52:37.800765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:37.800770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.800772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:37.800784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:37.800802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:37.800806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:37.800917Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:37.850829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895263017561086:7153]
2025-09-30T14:52:37.851108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 891, pipe: [1:7555895263017561086:7153]
2025-09-30T14:52:37.904453Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:37.911647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:37.911676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:37.911829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:37.911892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:37.911950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:37.912008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:37.912048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:37.912056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:37.912118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:37.912176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:37.912244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:37.912305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:37.912345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:37.912351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:37.912417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:37.912477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:37.912535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:37.912592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:37.912651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:37.912657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:37.912715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:37.912773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:37.912831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:37.912897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:37.912937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:37.912943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:37.913002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:37.913062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:37.913125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:37.913193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:37.913237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:37.913242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:37.913336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:37.913391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:37.913447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:37.913504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:37.913552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:37.913560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:37.913620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:37.913673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:37.913734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:37.913789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:37.913833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:37.913841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:37.913902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:37.913954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:37.914011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:37.914065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:37.914110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:37.914116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:37.914182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:37.914249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:37.914322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:37.914380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:37.914425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:37.914432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:37.914494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:37.914548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:37.914606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:37.914671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:37.914710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:37.914715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:37.914757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895263017561086:7153], now have 1 active actors on pipe
2025-09-30T14:52:37.915037Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:37.915056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:37.915060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:37.915089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 892 reason: error at write: Disconnected sessionId: src_id|11a2ff6c-d8d88ea4-f7635064-851b9b19_0
2025-09-30T14:52:37.915091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895263017561086:7153]
2025-09-30T14:52:37.915294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 892 sessionId: src_id|11a2ff6c-d8d88ea4-f7635064-851b9b19_0 is DEAD
2025-09-30T14:52:37.915431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11a2ff6c-d8d88ea4-f7635064-851b9b19_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:37.915443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11a2ff6c-d8d88ea4-f7635064-851b9b19_0] Write session will restart in 0.007323s
2025-09-30T14:52:37.915469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11a2ff6c-d8d88ea4-f7635064-851b9b19_0] Write session: Do CDS request
2025-09-30T14:52:37.915475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11a2ff6c-d8d88ea4-f7635064-851b9b19_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:37.915830Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:37.923683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11a2ff6c-d8d88ea4-f7635064-851b9b19_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:37.923766Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:37.923786Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 893
2025-09-30T14:52:37.923933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 893 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:37.923964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 893 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:37.923975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=893 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:37.923979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:37.924381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 893 sessionId:  describe result for acl check
2025-09-30T14:52:37.924425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:37.924431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:37.924433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:37.924439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895263017561191:7669] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:37.924998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895263017561191:7669] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:37.927559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895263017561191:7669] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:37.930290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895263017561191:7669] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:37.930304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895263017561191:7669] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:37.930307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895263017561191:7669] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:37.930315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 893 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:37.934721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:37.935260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:37.935426Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:37.935436Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:37.935448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:37.935503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:37.935543Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895262927825847:6240]
2025-09-30T14:52:37.936184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:37.936526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:37.936574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:37.936902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:37.936958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:37.936963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:37.936964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:37.936964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:37.936966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:37.936967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:37.936967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:37.936968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:37.936968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:37.936970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:37.936970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.936971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.936972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.936972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:37.936973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:37.936976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:37.936983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:37.936986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:37.936988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:37.936990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:37.936993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:37.936995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:37.936997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:37.937000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:37.937002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:37.937005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.937007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.937009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.937011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:37.937014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:37.937019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:37.937027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:37.937034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:37.937040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:37.937045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:37.937050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:37.937054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:37.937059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:37.937064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:37.937069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:37.937074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:37.937078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:37.937083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:37.937089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:37.937094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:37.937097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:37.937100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:37.937102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:37.937105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:37.937109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:37.937111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.937114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.937116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.937119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.937121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.937124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.937126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:37.937129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:37.937132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:37.937135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:37.937159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:37.942494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:37.943354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:37.943371Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:37.943375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:37.943379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:37.943386Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 892 [2:7555895262927825847:6240]
2025-09-30T14:52:37.943402Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:37.943416Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:37.943420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:37.943423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:37.943425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:37.943439Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:37.943448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:37.943454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:37.943506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.943515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.943517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.943522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:37.943524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:37.943590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:37.943597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.943605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:37.943611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:37.943625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:37.943648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895263017561432:7669], now have 1 active actors on pipe
2025-09-30T14:52:37.943657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895263017561088:2454], now have 1 active actors on pipe
2025-09-30T14:52:37.943663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895262927825842:6240]
2025-09-30T14:52:37.943669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895262927825842:6240]
2025-09-30T14:52:37.943671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895262927825842:6240]
2025-09-30T14:52:37.943683Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:37.943697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:37.943702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:37.943708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:37.943710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:37.943716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:37.943719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:37.943736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 892
2025-09-30T14:52:37.943738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 892
2025-09-30T14:52:37.943744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895262927825842:6240]
2025-09-30T14:52:37.943755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:37.943758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:37.943788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:37.943794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:37.943830Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7b8a1d3-33cb1057-d4127470-e69ce5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:37.943842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:37.943846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:37.943848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:37.943859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:37.943869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:37.943883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:37.943995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:37.944005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:37.944019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:37.944104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 893 partition: 0 MaxSeqNo: 42 sessionId: src_id|b7b8a1d3-33cb1057-d4127470-e69ce5_0
2025-09-30T14:52:37.944464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11a2ff6c-d8d88ea4-f7635064-851b9b19_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b7b8a1d3-33cb1057-d4127470-e69ce5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:37.947963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b8a1d3-33cb1057-d4127470-e69ce5_0] Write session: try to update token
2025-09-30T14:52:37.947989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b8a1d3-33cb1057-d4127470-e69ce5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:37.955143Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:37.955163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:37.955165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:37.955167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:37.955174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895262927825842:6240]
2025-09-30T14:52:37.955177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895262927825842:6240]
2025-09-30T14:52:37.955181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895262927825842:6240]
2025-09-30T14:52:37.955211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:37.955217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:37.955219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:37.955219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:37.955224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:37.955227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:37.955371Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:37.965719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 893 sessionId: src_id|b7b8a1d3-33cb1057-d4127470-e69ce5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:37.968568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:38.015155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895267312528749:7153]
2025-09-30T14:52:38.015362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 892, pipe: [1:7555895267312528749:7153]
2025-09-30T14:52:38.062191Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:38.062703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:38.062716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:38.062732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895267312528749:7153], now have 1 active actors on pipe
2025-09-30T14:52:38.062865Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:38.062929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:38.062946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:38.063005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 893 reason: error at write: Disconnected sessionId: src_id|b7b8a1d3-33cb1057-d4127470-e69ce5_0
2025-09-30T14:52:38.063163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 893 sessionId: src_id|b7b8a1d3-33cb1057-d4127470-e69ce5_0 is DEAD
2025-09-30T14:52:38.063305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b8a1d3-33cb1057-d4127470-e69ce5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:38.063317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b8a1d3-33cb1057-d4127470-e69ce5_0] Write session will restart in 0.005269s
2025-09-30T14:52:38.063352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b8a1d3-33cb1057-d4127470-e69ce5_0] Write session: Do CDS request
2025-09-30T14:52:38.063357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b8a1d3-33cb1057-d4127470-e69ce5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:38.063344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:38.063382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895267312528749:7153]
2025-09-30T14:52:38.069725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b8a1d3-33cb1057-d4127470-e69ce5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:38.069807Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:38.069823Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 894
2025-09-30T14:52:38.069990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 894 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:38.070013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 894 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:38.070020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=894 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:38.070023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:38.070413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 894 sessionId:  describe result for acl check
2025-09-30T14:52:38.070447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:38.070456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:38.070458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:38.070466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895267312528830:7684] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:38.071065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895267312528830:7684] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:38.072953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895267312528830:7684] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:38.075862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895267312528830:7684] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:38.075876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895267312528830:7684] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:38.075880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895267312528830:7684] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:38.075887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 894 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:38.077931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:38.079960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:38.080122Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:38.080129Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:38.080137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:38.080175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:38.080204Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895267222793391:6249]
2025-09-30T14:52:38.080683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:38.080928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:38.080957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:38.081199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:38.081251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:38.081256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:38.081257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:38.081257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:38.081258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:38.081259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:38.081260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:38.081260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:38.081261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:38.081261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:38.081262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.081263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.081264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.081264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:38.081265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:38.081268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:38.081275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:38.081277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:38.081280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:38.081282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:38.081284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:38.081287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:38.081289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:38.081292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:38.081296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:38.081300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.081304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.081307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.081311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:38.081314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:38.081321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:38.081329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:38.081334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:38.081338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:38.081340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:38.081343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:38.081345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:38.081348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:38.081351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:38.081354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:38.081357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:38.081360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:38.081362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:38.081365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:38.081368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:38.081370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:38.081373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:38.081376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:38.081378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:38.081381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:38.081383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.081386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.081388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.081390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.081393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.081396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.081399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:38.081402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:38.081406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:38.081409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:38.081432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:38.086669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:38.087507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:38.087523Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:38.087525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:38.087529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:38.087535Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 893 [2:7555895267222793391:6249]
2025-09-30T14:52:38.087548Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:38.087560Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:38.087568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:38.087571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:38.087573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:38.087588Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:38.087594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:38.087600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:38.087652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.087660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.087662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.087665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:38.087667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:38.087726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:38.087734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.087746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.087763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.087784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:38.087806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895267312529125:7684], now have 1 active actors on pipe
2025-09-30T14:52:38.087813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895267312528779:2454], now have 1 active actors on pipe
2025-09-30T14:52:38.087819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895267222793386:6249]
2025-09-30T14:52:38.087821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895267222793386:6249]
2025-09-30T14:52:38.087823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895267222793386:6249]
2025-09-30T14:52:38.087834Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:38.087852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:38.087863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:38.087870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:38.087873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:38.087875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:38.087877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:38.087895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895267222793386:6249]
2025-09-30T14:52:38.087903Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:38.087905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:38.087895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 893
2025-09-30T14:52:38.087930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 893
2025-09-30T14:52:38.087935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:38.087943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:38.087970Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd99c3a1-44aa9d46-491b3a0-d18b35ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:38.087981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:38.087984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:38.087986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:38.087994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:38.088006Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:38.088020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:38.088131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:38.088140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:38.088153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:38.088233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 894 partition: 0 MaxSeqNo: 42 sessionId: src_id|bd99c3a1-44aa9d46-491b3a0-d18b35ad_0
2025-09-30T14:52:38.088567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b8a1d3-33cb1057-d4127470-e69ce5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bd99c3a1-44aa9d46-491b3a0-d18b35ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:38.091655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd99c3a1-44aa9d46-491b3a0-d18b35ad_0] Write session: try to update token
2025-09-30T14:52:38.091675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd99c3a1-44aa9d46-491b3a0-d18b35ad_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:38.099355Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:38.099369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:38.099372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:38.099374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:38.099382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895267222793386:6249]
2025-09-30T14:52:38.099385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895267222793386:6249]
2025-09-30T14:52:38.099388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895267222793386:6249]
2025-09-30T14:52:38.099425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:38.099436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.099438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:38.099441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:38.099451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:38.099465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:38.099563Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:38.106327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 894 sessionId: src_id|bd99c3a1-44aa9d46-491b3a0-d18b35ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:38.109008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:38.163646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895267312529149:7153]
2025-09-30T14:52:38.163925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 893, pipe: [1:7555895267312529149:7153]
2025-09-30T14:52:38.203847Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:38.204091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:38.204102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:38.204117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895267312529149:7153], now have 1 active actors on pipe
2025-09-30T14:52:38.204355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:38.204369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:38.204404Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:38.204392Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:38.204433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 894 reason: error at write: Disconnected sessionId: src_id|bd99c3a1-44aa9d46-491b3a0-d18b35ad_0
2025-09-30T14:52:38.204460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895267312529149:7153]
2025-09-30T14:52:38.204590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 894 sessionId: src_id|bd99c3a1-44aa9d46-491b3a0-d18b35ad_0 is DEAD
2025-09-30T14:52:38.204742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd99c3a1-44aa9d46-491b3a0-d18b35ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:38.204753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd99c3a1-44aa9d46-491b3a0-d18b35ad_0] Write session will restart in 0.006655s
2025-09-30T14:52:38.204776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd99c3a1-44aa9d46-491b3a0-d18b35ad_0] Write session: Do CDS request
2025-09-30T14:52:38.204781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd99c3a1-44aa9d46-491b3a0-d18b35ad_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:38.212727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd99c3a1-44aa9d46-491b3a0-d18b35ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:38.212778Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:38.212792Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 895
2025-09-30T14:52:38.212936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 895 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:38.212971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 895 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:38.212975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=895 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:38.212978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:38.213372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 895 sessionId:  describe result for acl check
2025-09-30T14:52:38.213403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:38.213408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:38.213410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:38.213414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895267312529288:7689] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:38.213918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895267312529288:7689] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:38.215942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895267312529288:7689] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:38.218552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895267312529288:7689] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:38.218566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895267312529288:7689] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:38.218570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895267312529288:7689] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:38.218577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 895 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:38.221219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:38.221585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:38.221780Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:38.221791Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:38.221803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:38.221870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:38.221909Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895267222793641:6258]
2025-09-30T14:52:38.222557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:38.222823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:38.222876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:38.223203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:38.223308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:38.223315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:38.223317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:38.223318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:38.223319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:38.223320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:38.223321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:38.223322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:38.223323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:38.223324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:38.223325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.223326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.223328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.223329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:38.223330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:38.223336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:38.223347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:38.223352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:38.223356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:38.223360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:38.223364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:38.223368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:38.223372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:38.223375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:38.223379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:38.223383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.223387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.223390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.223393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:38.223397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:38.223405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:38.223419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:38.223429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:38.223435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:38.223439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:38.223445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:38.223454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:38.223459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:38.223466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:38.223475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:38.223479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:38.223484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:38.223488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:38.223494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:38.223498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:38.223508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:38.223514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:38.223524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:38.223528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:38.223533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:38.223541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.223547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.223555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.223560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.223566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.223575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.223579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:38.223584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:38.223593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:38.223599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:38.223649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:38.228872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:38.229742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:38.229756Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:38.229757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:38.229761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:38.229765Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 894 [2:7555895267222793641:6258]
2025-09-30T14:52:38.229776Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:38.229788Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:38.229790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:38.229792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:38.229794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:38.229806Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:38.229811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:38.229816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:38.229857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.229863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.229864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.229867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:38.229869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:38.229915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:38.229920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.229927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.229933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.229943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:38.229959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895267222793636:6258]
2025-09-30T14:52:38.229964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895267222793636:6258]
2025-09-30T14:52:38.229966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895267222793636:6258]
2025-09-30T14:52:38.229974Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:38.229985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895267312529151:2454], now have 1 active actors on pipe
2025-09-30T14:52:38.229986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:38.229989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:38.229990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:38.229991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895267312529497:7689], now have 1 active actors on pipe
2025-09-30T14:52:38.229997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:38.230006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:38.230007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:38.230028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895267222793636:6258]
2025-09-30T14:52:38.230034Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:38.230045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:38.230065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 894
2025-09-30T14:52:38.230108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 894
2025-09-30T14:52:38.230607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:38.230618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:38.230640Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b4d4943-83be7d68-919f40bd-b4c7e2bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:38.230649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:38.230652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:38.230653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:38.230662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:38.230673Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:38.230691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:38.230841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:38.230846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:38.230856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:38.230935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 895 partition: 0 MaxSeqNo: 42 sessionId: src_id|6b4d4943-83be7d68-919f40bd-b4c7e2bc_0
2025-09-30T14:52:38.231291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd99c3a1-44aa9d46-491b3a0-d18b35ad_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6b4d4943-83be7d68-919f40bd-b4c7e2bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:38.234022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b4d4943-83be7d68-919f40bd-b4c7e2bc_0] Write session: try to update token
2025-09-30T14:52:38.234040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b4d4943-83be7d68-919f40bd-b4c7e2bc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:38.241738Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:38.241754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:38.241755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:38.241756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:38.241764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895267222793636:6258]
2025-09-30T14:52:38.241767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895267222793636:6258]
2025-09-30T14:52:38.241770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895267222793636:6258]
2025-09-30T14:52:38.241802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:38.241807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.241808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:38.241814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:38.241820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:38.241824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:38.241926Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:38.248668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 895 sessionId: src_id|6b4d4943-83be7d68-919f40bd-b4c7e2bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:38.251340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:38.304446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895267312529510:7153]
2025-09-30T14:52:38.304688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 894, pipe: [1:7555895267312529510:7153]
2025-09-30T14:52:38.346684Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:38.346982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:38.347000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:38.347021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895267312529510:7153], now have 1 active actors on pipe
2025-09-30T14:52:38.347234Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:38.347297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:38.347356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895267312529510:7153]
2025-09-30T14:52:38.347437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:38.347513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 895 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6b4d4943-83be7d68-919f40bd-b4c7e2bc_0
2025-09-30T14:52:38.347667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 895 sessionId: src_id|6b4d4943-83be7d68-919f40bd-b4c7e2bc_0 is DEAD
2025-09-30T14:52:38.347800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b4d4943-83be7d68-919f40bd-b4c7e2bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:38.347813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b4d4943-83be7d68-919f40bd-b4c7e2bc_0] Write session will restart in 0.006861s
2025-09-30T14:52:38.347837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b4d4943-83be7d68-919f40bd-b4c7e2bc_0] Write session: Do CDS request
2025-09-30T14:52:38.347843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b4d4943-83be7d68-919f40bd-b4c7e2bc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:38.355684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b4d4943-83be7d68-919f40bd-b4c7e2bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:38.355756Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:38.355773Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 896
2025-09-30T14:52:38.355896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 896 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:38.355934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 896 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:38.355942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=896 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:38.355946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:38.356363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 896 sessionId:  describe result for acl check
2025-09-30T14:52:38.356397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:38.356406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:38.356408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:38.356413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895267312529581:7693] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:38.356927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895267312529581:7693] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:38.358975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895267312529581:7693] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:38.361439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895267312529581:7693] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:38.361454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895267312529581:7693] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:38.361457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895267312529581:7693] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:38.361464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 896 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:38.363429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:38.365694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:38.365840Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:38.365847Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:38.365854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:38.365890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:38.365916Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895267222793867:6260]
2025-09-30T14:52:38.366338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:38.366679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:38.366747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:38.367039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:38.367122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:38.367130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:38.367131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:38.367132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:38.367133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:38.367135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:38.367136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:38.367137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:38.367138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:38.367140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:38.367141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.367142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.367144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.367145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:38.367146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:38.367153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:38.367163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:38.367167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:38.367171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:38.367175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:38.367179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:38.367182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:38.367186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:38.367191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:38.367195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:38.367199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.367203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.367207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.367212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:38.367216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:38.367224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:38.367232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:38.367238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:38.367266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:38.367275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:38.367281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:38.367285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:38.367295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:38.367300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:38.367307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:38.367315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:38.367320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:38.367327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:38.367336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:38.367341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:38.367346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:38.367350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:38.367353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:38.367355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:38.367358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:38.367360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.367363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.367365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.367368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.367370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.367373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.367376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:38.367379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:38.367381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:38.367384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:38.367406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:38.372524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:38.373988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:38.374002Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:38.374003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:38.374006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:38.374011Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 895 [2:7555895267222793867:6260]
2025-09-30T14:52:38.374023Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:38.374037Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:38.374040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:38.374043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:38.374045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:38.374059Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:38.374071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:38.374077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:38.374142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.374150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.374152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.374157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:38.374159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:38.374214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:38.374221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.374233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.374246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.374276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:38.374299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895267312529850:7693], now have 1 active actors on pipe
2025-09-30T14:52:38.374310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895267222793862:6260]
2025-09-30T14:52:38.374312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895267222793862:6260]
2025-09-30T14:52:38.374314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895267222793862:6260]
2025-09-30T14:52:38.374328Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:38.374341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895267312529511:2454], now have 1 active actors on pipe
2025-09-30T14:52:38.374348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:38.374351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:38.374353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:38.374354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:38.374368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:38.374376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:38.374408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895267222793862:6260]
2025-09-30T14:52:38.374415Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:38.374420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:38.374382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 895
2025-09-30T14:52:38.374390Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 895
2025-09-30T14:52:38.374450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:38.374458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:38.374481Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9acd06bb-2333cacf-2c35911f-9b1ce37f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:38.374490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:38.374492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:38.374493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:38.374500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:38.374507Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:38.374519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:38.374662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:38.374668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:38.374677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:38.374755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 896 partition: 0 MaxSeqNo: 42 sessionId: src_id|9acd06bb-2333cacf-2c35911f-9b1ce37f_0
2025-09-30T14:52:38.375053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b4d4943-83be7d68-919f40bd-b4c7e2bc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9acd06bb-2333cacf-2c35911f-9b1ce37f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:38.377676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9acd06bb-2333cacf-2c35911f-9b1ce37f_0] Write session: try to update token
2025-09-30T14:52:38.377695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9acd06bb-2333cacf-2c35911f-9b1ce37f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:38.386395Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:38.386412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:38.386415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:38.386417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:38.386427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895267222793862:6260]
2025-09-30T14:52:38.386434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895267222793862:6260]
2025-09-30T14:52:38.386441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895267222793862:6260]
2025-09-30T14:52:38.386490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:38.386491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:38.386497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:38.386501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:38.386507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.386509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:38.386651Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:38.391065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 896 sessionId: src_id|9acd06bb-2333cacf-2c35911f-9b1ce37f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:38.393520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:38.447307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895267312529873:7153]
2025-09-30T14:52:38.447604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 895, pipe: [1:7555895267312529873:7153]
2025-09-30T14:52:38.487128Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:38.487404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:38.487417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:38.487448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895267312529873:7153], now have 1 active actors on pipe
2025-09-30T14:52:38.487621Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:38.487621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:38.487627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:38.487639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:38.487678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895267312529873:7153]
2025-09-30T14:52:38.487691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 896 reason: error at write: Disconnected sessionId: src_id|9acd06bb-2333cacf-2c35911f-9b1ce37f_0
2025-09-30T14:52:38.487871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 896 sessionId: src_id|9acd06bb-2333cacf-2c35911f-9b1ce37f_0 is DEAD
2025-09-30T14:52:38.487997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9acd06bb-2333cacf-2c35911f-9b1ce37f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:38.488015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9acd06bb-2333cacf-2c35911f-9b1ce37f_0] Write session will restart in 0.006039s
2025-09-30T14:52:38.488031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9acd06bb-2333cacf-2c35911f-9b1ce37f_0] Write session: Do CDS request
2025-09-30T14:52:38.488035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9acd06bb-2333cacf-2c35911f-9b1ce37f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:38.494649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9acd06bb-2333cacf-2c35911f-9b1ce37f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:38.494742Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:38.494755Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 897
2025-09-30T14:52:38.494858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 897 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:38.494891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 897 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:38.494895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=897 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:38.494904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:38.495289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 897 sessionId:  describe result for acl check
2025-09-30T14:52:38.495321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:38.495326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:38.495341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:38.495346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895267312529927:7698] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:38.495806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895267312529927:7698] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:38.497750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895267312529927:7698] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:38.500251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895267312529927:7698] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:38.500267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895267312529927:7698] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:38.500270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895267312529927:7698] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:38.500277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 897 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:38.503753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:38.505816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:38.506005Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:38.506016Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:38.506026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:38.506085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:38.506124Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895267222794094:6262]
2025-09-30T14:52:38.506699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:38.507045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:38.507102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:38.507402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:38.507468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:38.507475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:38.507477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:38.507477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:38.507478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:38.507480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:38.507481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:38.507482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:38.507483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:38.507484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:38.507485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.507486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.507487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.507488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:38.507490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:38.507495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:38.507506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:38.507510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:38.507514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:38.507518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:38.507522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:38.507526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:38.507529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:38.507533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:38.507538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:38.507542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.507546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.507550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.507554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:38.507558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:38.507565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:38.507575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:38.507581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:38.507586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:38.507591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:38.507597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:38.507601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:38.507606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:38.507611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:38.507633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:38.507642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:38.507648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:38.507653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:38.507663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:38.507667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:38.507672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:38.507681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:38.507685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:38.507689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:38.507693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:38.507697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.507703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.507711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.507715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.507719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.507724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.507728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:38.507733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:38.507742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:38.507747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:38.507788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:38.512947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:38.513715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:38.513726Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:38.513728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:38.513731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:38.513736Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 896 [2:7555895267222794094:6262]
2025-09-30T14:52:38.513749Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:38.513761Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:38.513763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:38.513765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:38.513767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:38.513778Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:38.513783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:38.513788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:38.513831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.513839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.513841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.513844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:38.513846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:38.513901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:38.513908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.513916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.513922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.513932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:38.513948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895267312529876:2454], now have 1 active actors on pipe
2025-09-30T14:52:38.513956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895267222794089:6262]
2025-09-30T14:52:38.513957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895267222794089:6262]
2025-09-30T14:52:38.513959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895267222794089:6262]
2025-09-30T14:52:38.513967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:38.513974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895267312530163:7698], now have 1 active actors on pipe
2025-09-30T14:52:38.513983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:38.513989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:38.513992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:38.513994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:38.513995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:38.513998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:38.514026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895267222794089:6262]
2025-09-30T14:52:38.514038Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:38.514047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:38.514052Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 896
2025-09-30T14:52:38.514076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 896
2025-09-30T14:52:38.514160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:38.514167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:38.514186Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a70dddb6-493afce9-6f7adbe8-412842b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:38.514197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:38.514201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:38.514207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:38.514217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:38.514228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:38.514241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:38.514392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:38.514398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:38.514407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:38.514473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 897 partition: 0 MaxSeqNo: 42 sessionId: src_id|a70dddb6-493afce9-6f7adbe8-412842b5_0
2025-09-30T14:52:38.514794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9acd06bb-2333cacf-2c35911f-9b1ce37f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a70dddb6-493afce9-6f7adbe8-412842b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:38.517364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a70dddb6-493afce9-6f7adbe8-412842b5_0] Write session: try to update token
2025-09-30T14:52:38.517379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a70dddb6-493afce9-6f7adbe8-412842b5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:38.525989Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:38.526013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:38.526016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:38.526018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:38.526030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895267222794089:6262]
2025-09-30T14:52:38.526037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895267222794089:6262]
2025-09-30T14:52:38.526043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895267222794089:6262]
2025-09-30T14:52:38.526096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:38.526104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:38.526110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:38.526112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.526115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:38.526115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:38.526295Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:38.531098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 897 sessionId: src_id|a70dddb6-493afce9-6f7adbe8-412842b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:38.533689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:38.588112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895267312530239:7153]
2025-09-30T14:52:38.588398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 896, pipe: [1:7555895267312530239:7153]
2025-09-30T14:52:38.629652Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:38.630380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:38.630396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:38.630439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895267312530239:7153], now have 1 active actors on pipe
2025-09-30T14:52:38.630655Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:38.630628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:38.630656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895267312530239:7153]
2025-09-30T14:52:38.630681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:38.630684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:38.630747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 897 reason: error at write: Disconnected sessionId: src_id|a70dddb6-493afce9-6f7adbe8-412842b5_0
2025-09-30T14:52:38.630915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 897 sessionId: src_id|a70dddb6-493afce9-6f7adbe8-412842b5_0 is DEAD
2025-09-30T14:52:38.631063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a70dddb6-493afce9-6f7adbe8-412842b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:38.631075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a70dddb6-493afce9-6f7adbe8-412842b5_0] Write session will restart in 0.006385s
2025-09-30T14:52:38.631106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a70dddb6-493afce9-6f7adbe8-412842b5_0] Write session: Do CDS request
2025-09-30T14:52:38.631115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a70dddb6-493afce9-6f7adbe8-412842b5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:38.638718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a70dddb6-493afce9-6f7adbe8-412842b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:38.638777Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:38.638791Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 898
2025-09-30T14:52:38.638895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 898 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:38.638940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 898 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:38.638950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=898 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:38.638954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:38.639433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 898 sessionId:  describe result for acl check
2025-09-30T14:52:38.639469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:38.639476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:38.639477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:38.639482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895267312530398:7702] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:38.640019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895267312530398:7702] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:38.642292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895267312530398:7702] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:38.644323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895267312530398:7702] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:38.644334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895267312530398:7702] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:38.644336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895267312530398:7702] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:38.644341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 898 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:38.646974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:38.647395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:38.647547Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:38.647556Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:38.647565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:38.647603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:38.647634Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895267222794324:6265]
2025-09-30T14:52:38.648202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:38.648438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:38.648475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:38.648781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:38.648832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:38.648836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:38.648837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:38.648838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:38.648839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:38.648839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:38.648840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:38.648840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:38.648841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:38.648842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:38.648842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.648843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.648844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.648844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:38.648845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:38.648848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:38.648855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:38.648857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:38.648860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:38.648862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:38.648865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:38.648867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:38.648869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:38.648872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:38.648874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:38.648876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.648879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.648881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.648883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:38.648886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:38.648891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:38.648898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:38.648903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:38.648909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:38.648913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:38.648918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:38.648922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:38.648927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:38.648932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:38.648937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:38.648942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:38.648947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:38.648952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:38.648955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:38.648958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:38.648961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:38.648963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:38.648966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:38.648968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:38.648971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:38.648974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.648977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.648980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.648983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.648985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.648988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.648990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:38.648992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:38.648995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:38.648998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:38.649039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:38.654012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:38.654899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:38.654911Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:38.654913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:38.654916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:38.654920Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 897 [2:7555895267222794324:6265]
2025-09-30T14:52:38.654933Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:38.654947Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:38.654954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:38.654957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:38.654960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:38.654973Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:38.654984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:38.654990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:38.655036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.655042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.655043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.655046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:38.655048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:38.655091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:38.655097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.655105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.655111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.655120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:38.655136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895267312530590:7702], now have 1 active actors on pipe
2025-09-30T14:52:38.655144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895267222794319:6265]
2025-09-30T14:52:38.655146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895267222794319:6265]
2025-09-30T14:52:38.655148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895267222794319:6265]
2025-09-30T14:52:38.655158Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:38.655169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895267312530240:2454], now have 1 active actors on pipe
2025-09-30T14:52:38.655171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:38.655173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:38.655175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:38.655177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:38.655181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:38.655183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:38.655209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895267222794319:6265]
2025-09-30T14:52:38.655223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:38.655210Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 897
2025-09-30T14:52:38.655220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 897
2025-09-30T14:52:38.655255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:38.655268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:38.655272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:38.655296Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ebd593bd-7e5c3621-7aad1a6c-6d51f925_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:38.655305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:38.655308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:38.655309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:38.655316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:38.655323Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:38.655339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:38.655469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:38.655478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:38.655488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:38.655560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 898 partition: 0 MaxSeqNo: 42 sessionId: src_id|ebd593bd-7e5c3621-7aad1a6c-6d51f925_0
2025-09-30T14:52:38.655852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a70dddb6-493afce9-6f7adbe8-412842b5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ebd593bd-7e5c3621-7aad1a6c-6d51f925_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:38.658409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebd593bd-7e5c3621-7aad1a6c-6d51f925_0] Write session: try to update token
2025-09-30T14:52:38.658422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebd593bd-7e5c3621-7aad1a6c-6d51f925_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:38.666483Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:38.666505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:38.666507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:38.666509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:38.666520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895267222794319:6265]
2025-09-30T14:52:38.666524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895267222794319:6265]
2025-09-30T14:52:38.666528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895267222794319:6265]
2025-09-30T14:52:38.666566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:38.666577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.666578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:38.666580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:38.666584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:38.666587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:38.666714Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:38.671915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 898 sessionId: src_id|ebd593bd-7e5c3621-7aad1a6c-6d51f925_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:38.674297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:38.730946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895267312530604:7153]
2025-09-30T14:52:38.731278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 897, pipe: [1:7555895267312530604:7153]
2025-09-30T14:52:38.770856Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:38.771613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:38.771627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:38.771660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895267312530604:7153], now have 1 active actors on pipe
2025-09-30T14:52:38.771862Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:38.771923Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:38.771954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895267312530604:7153]
2025-09-30T14:52:38.771972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:38.772039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 898 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ebd593bd-7e5c3621-7aad1a6c-6d51f925_0
2025-09-30T14:52:38.772181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 898 sessionId: src_id|ebd593bd-7e5c3621-7aad1a6c-6d51f925_0 is DEAD
2025-09-30T14:52:38.772330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebd593bd-7e5c3621-7aad1a6c-6d51f925_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:38.772339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebd593bd-7e5c3621-7aad1a6c-6d51f925_0] Write session will restart in 0.006608s
2025-09-30T14:52:38.772357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebd593bd-7e5c3621-7aad1a6c-6d51f925_0] Write session: Do CDS request
2025-09-30T14:52:38.772362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebd593bd-7e5c3621-7aad1a6c-6d51f925_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:38.779746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebd593bd-7e5c3621-7aad1a6c-6d51f925_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:38.779838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:38.779857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 899
2025-09-30T14:52:38.779976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 899 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:38.780010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 899 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:38.780020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=899 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:38.780024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:38.780390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 899 sessionId:  describe result for acl check
2025-09-30T14:52:38.780423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:38.780429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:38.780430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:38.780435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895267312530721:7706] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:38.780885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895267312530721:7706] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:38.782986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895267312530721:7706] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:38.785372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895267312530721:7706] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:38.785385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895267312530721:7706] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:38.785388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895267312530721:7706] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:38.785394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 899 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:38.788778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:38.789188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:38.789324Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:38.789335Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:38.789345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:38.789390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:38.789420Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895267222794552:6267]
2025-09-30T14:52:38.789891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:38.790110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:38.790145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:38.790378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:38.790429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:38.790436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:38.790437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:38.790438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:38.790439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:38.790440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:38.790441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:38.790443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:38.790443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:38.790445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:38.790446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.790447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.790448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.790449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:38.790450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:38.790455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:38.790465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:38.790469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:38.790473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:38.790476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:38.790480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:38.790483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:38.790487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:38.790491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:38.790496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:38.790499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.790503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.790507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.790511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:38.790515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:38.790524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:38.790531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:38.790537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:38.790541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:38.790544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:38.790547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:38.790550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:38.790553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:38.790556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:38.790558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:38.790561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:38.790564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:38.790567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:38.790569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:38.790572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:38.790575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:38.790577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:38.790580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:38.790582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:38.790585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:38.790588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.790591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.790594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.790596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.790599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.790602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.790604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:38.790608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:38.790611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:38.790613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:38.790637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:38.795678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:38.796528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:38.796547Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:38.796549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:38.796554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:38.796560Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 898 [2:7555895267222794552:6267]
2025-09-30T14:52:38.796574Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:38.796593Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:38.796598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:38.796601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:38.796603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:38.796617Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:38.796629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:38.796635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:38.796692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.796699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.796701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.796705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:38.796708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:38.796831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:38.796840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.796852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.796865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.796889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:38.796911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895267312530956:7706], now have 1 active actors on pipe
2025-09-30T14:52:38.796919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895267312530605:2454], now have 1 active actors on pipe
2025-09-30T14:52:38.796924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895267222794547:6267]
2025-09-30T14:52:38.796892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 898
2025-09-30T14:52:38.796926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895267222794547:6267]
2025-09-30T14:52:38.796893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 898
2025-09-30T14:52:38.796928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895267222794547:6267]
2025-09-30T14:52:38.796936Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:38.796951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:38.796950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:38.796954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:38.796955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:38.796970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:38.796974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:38.797012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:38.797021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:38.797032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895267222794547:6267]
2025-09-30T14:52:38.797042Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:38.797055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:38.797076Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|493fb993-56f821a4-5c8fda80-6850f222_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:38.797088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:38.797091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:38.797094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:38.797104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:38.797117Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:38.797141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:38.797314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:38.797323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:38.797337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:38.797438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 899 partition: 0 MaxSeqNo: 42 sessionId: src_id|493fb993-56f821a4-5c8fda80-6850f222_0
2025-09-30T14:52:38.797741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebd593bd-7e5c3621-7aad1a6c-6d51f925_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|493fb993-56f821a4-5c8fda80-6850f222_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:38.800254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|493fb993-56f821a4-5c8fda80-6850f222_0] Write session: try to update token
2025-09-30T14:52:38.800269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|493fb993-56f821a4-5c8fda80-6850f222_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:38.808594Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:38.808612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:38.808615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:38.808617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:38.808626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895267222794547:6267]
2025-09-30T14:52:38.808631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895267222794547:6267]
2025-09-30T14:52:38.808635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895267222794547:6267]
2025-09-30T14:52:38.808672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:38.808678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.808681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:38.808695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:38.808704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:38.808708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:38.808840Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:38.813408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 899 sessionId: src_id|493fb993-56f821a4-5c8fda80-6850f222_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:38.815993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:38.872266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895267312530970:7153]
2025-09-30T14:52:38.872594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 898, pipe: [1:7555895267312530970:7153]
2025-09-30T14:52:38.912606Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:38.913371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:38.913389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:38.913428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895267312530970:7153], now have 1 active actors on pipe
2025-09-30T14:52:38.913696Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:38.913708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:38.913719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895267312530970:7153]
2025-09-30T14:52:38.913759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:38.913834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 899 reason: status is not ok: tablet will be restarted right now sessionId: src_id|493fb993-56f821a4-5c8fda80-6850f222_0
2025-09-30T14:52:38.914008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 899 sessionId: src_id|493fb993-56f821a4-5c8fda80-6850f222_0 is DEAD
2025-09-30T14:52:38.914147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|493fb993-56f821a4-5c8fda80-6850f222_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:38.914153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|493fb993-56f821a4-5c8fda80-6850f222_0] Write session will restart in 0.008956s
2025-09-30T14:52:38.914169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|493fb993-56f821a4-5c8fda80-6850f222_0] Write session: Do CDS request
2025-09-30T14:52:38.914174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|493fb993-56f821a4-5c8fda80-6850f222_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:38.924654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|493fb993-56f821a4-5c8fda80-6850f222_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:38.924798Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:38.924814Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 900
2025-09-30T14:52:38.924907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 900 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:38.924930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 900 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:38.924937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=900 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:38.924941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:38.925342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 900 sessionId:  describe result for acl check
2025-09-30T14:52:38.925388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:38.925396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:38.925398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:38.925403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895267312531228:7710] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:38.925917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895267312531228:7710] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:38.927633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895267312531228:7710] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:38.931202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:38.931238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895267312531228:7710] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:38.931274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895267312531228:7710] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:38.931277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895267312531228:7710] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:38.931283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 900 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:38.931699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:38.931855Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:38.931865Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:38.931875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:38.931918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:38.931955Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895267222794782:6269]
2025-09-30T14:52:38.932573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:38.932882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:38.932935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:38.933254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:38.933329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:38.933336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:38.933337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:38.933338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:38.933340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:38.933341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:38.933342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:38.933343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:38.933344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:38.933346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:38.933347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.933348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.933349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.933350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:38.933352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:38.933357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:38.933367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:38.933371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:38.933375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:38.933379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:38.933384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:38.933388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:38.933392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:38.933396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:38.933401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:38.933405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.933409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.933413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.933416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:38.933421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:38.933429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:38.933438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:38.933444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:38.933449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:38.933453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:38.933461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:38.933466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:38.933472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:38.933476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:38.933482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:38.933492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:38.933497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:38.933501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:38.933507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:38.933515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:38.933520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:38.933525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:38.933535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:38.933540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:38.933551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:38.933556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.933565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.933569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.933575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.933579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.933589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.933593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:38.933599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:38.933603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:38.933613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:38.933648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:38.939062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:38.939919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:38.939935Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:38.939938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:38.939942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:38.939948Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 899 [2:7555895267222794782:6269]
2025-09-30T14:52:38.939963Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:38.939977Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:38.939981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:38.939984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:38.939986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:38.940002Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:38.940014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:38.940021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:38.940163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.940170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.940172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.940176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:38.940179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:38.940248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:38.940258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.940273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:38.940285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:38.940304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:38.940332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895267312531325:7710], now have 1 active actors on pipe
2025-09-30T14:52:38.940337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895267312530971:2454], now have 1 active actors on pipe
2025-09-30T14:52:38.940343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895267222794776:6269]
2025-09-30T14:52:38.940345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895267222794776:6269]
2025-09-30T14:52:38.940347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895267222794776:6269]
2025-09-30T14:52:38.940362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:38.940376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:38.940379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:38.940383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:38.940384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:38.940391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:38.940394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:38.940378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 899
2025-09-30T14:52:38.940398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 899
2025-09-30T14:52:38.940425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895267222794776:6269]
2025-09-30T14:52:38.940433Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:38.940434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:38.940449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:38.940454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:38.940503Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef9152b1-c621c39-d2030ab3-f11c57c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:38.940514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:38.940517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:38.940519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:38.940529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:38.940539Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:38.941069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:38.941244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:38.941254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:38.941269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:38.941365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 900 partition: 0 MaxSeqNo: 42 sessionId: src_id|ef9152b1-c621c39-d2030ab3-f11c57c9_0
2025-09-30T14:52:38.941748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|493fb993-56f821a4-5c8fda80-6850f222_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ef9152b1-c621c39-d2030ab3-f11c57c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:38.944515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef9152b1-c621c39-d2030ab3-f11c57c9_0] Write session: try to update token
2025-09-30T14:52:38.944534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef9152b1-c621c39-d2030ab3-f11c57c9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:38.952273Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:38.952290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:38.952293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:38.952295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:38.952303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895267222794776:6269]
2025-09-30T14:52:38.952308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895267222794776:6269]
2025-09-30T14:52:38.952312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895267222794776:6269]
2025-09-30T14:52:38.952351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:38.952357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:38.952360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:38.952362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:38.952369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:38.952377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:38.952486Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:38.959123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 900 sessionId: src_id|ef9152b1-c621c39-d2030ab3-f11c57c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:38.961856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:39.014070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895271607498641:7153]
2025-09-30T14:52:39.014313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 899, pipe: [1:7555895271607498641:7153]
2025-09-30T14:52:39.061129Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:39.061386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:39.061401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:39.061417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895271607498641:7153], now have 1 active actors on pipe
2025-09-30T14:52:39.061629Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:39.061604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895271607498641:7153]
2025-09-30T14:52:39.061614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:39.061618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:39.061633Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:39.061677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 900 reason: error at write: Disconnected sessionId: src_id|ef9152b1-c621c39-d2030ab3-f11c57c9_0
2025-09-30T14:52:39.061854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 900 sessionId: src_id|ef9152b1-c621c39-d2030ab3-f11c57c9_0 is DEAD
2025-09-30T14:52:39.061984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef9152b1-c621c39-d2030ab3-f11c57c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:39.061999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef9152b1-c621c39-d2030ab3-f11c57c9_0] Write session will restart in 0.007631s
2025-09-30T14:52:39.062024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef9152b1-c621c39-d2030ab3-f11c57c9_0] Write session: Do CDS request
2025-09-30T14:52:39.062033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef9152b1-c621c39-d2030ab3-f11c57c9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:39.070722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef9152b1-c621c39-d2030ab3-f11c57c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:39.070844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:39.070861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 901
2025-09-30T14:52:39.070970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 901 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:39.070999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 901 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:39.071009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=901 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:39.071012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:39.071409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 901 sessionId:  describe result for acl check
2025-09-30T14:52:39.071438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:39.071447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:39.071448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:39.071454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895271607498828:7717] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:39.071962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895271607498828:7717] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:39.073938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895271607498828:7717] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:39.076633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895271607498828:7717] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:39.076647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895271607498828:7717] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:39.076650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895271607498828:7717] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:39.076657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 901 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:39.079149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:39.079691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:39.079853Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:39.079864Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:39.079875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:39.079930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:39.079972Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895271517762320:6272]
2025-09-30T14:52:39.080626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:39.080908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:39.080955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:39.081292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:39.081352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:39.081358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:39.081359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:39.081361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:39.081362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:39.081364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:39.081365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:39.081366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:39.081368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:39.081369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:39.081370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.081371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.081372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.081374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:39.081375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:39.081381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:39.081392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:39.081397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:39.081401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:39.081405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:39.081410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:39.081415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:39.081424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:39.081433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:39.081437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:39.081446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.081451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.081459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.081463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:39.081472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:39.081480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:39.081493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:39.081503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:39.081514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:39.081523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:39.081533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:39.081543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:39.081553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:39.081562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:39.081568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:39.081577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:39.081587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:39.081596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:39.081606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:39.081615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:39.081626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:39.081635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:39.081645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:39.081655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:39.081661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:39.081666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.081676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.081686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.081697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.081706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.081711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.081720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:39.081726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:39.081733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:39.081739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:39.081788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:39.087140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:39.088558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:39.088574Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:39.088577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:39.088581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:39.088588Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 900 [2:7555895271517762320:6272]
2025-09-30T14:52:39.088604Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:39.088622Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:39.088632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:39.088635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:39.088637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:39.088653Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:39.088660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:39.088667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:39.088729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.088740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.088742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.088745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:39.088748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:39.088815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:39.088824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.088837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.088851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.088874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:39.088895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895271607499011:7717], now have 1 active actors on pipe
2025-09-30T14:52:39.088903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895271607498655:2454], now have 1 active actors on pipe
2025-09-30T14:52:39.088910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895271517762315:6272]
2025-09-30T14:52:39.088912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895271517762315:6272]
2025-09-30T14:52:39.088915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895271517762315:6272]
2025-09-30T14:52:39.088928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:39.088945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:39.088933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 900
2025-09-30T14:52:39.088946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:39.088952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 900
2025-09-30T14:52:39.088952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:39.088954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:39.088968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:39.088971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:39.089013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:39.089017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:39.089029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895271517762315:6272]
2025-09-30T14:52:39.089039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:39.089048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:39.089070Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b04743b2-851ce746-84f3dfee-28b4825c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:39.089083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:39.089087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:39.089089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:39.089098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:39.089108Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:39.089133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:39.089261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:39.089272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:39.089287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:39.089356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 901 partition: 0 MaxSeqNo: 42 sessionId: src_id|b04743b2-851ce746-84f3dfee-28b4825c_0
2025-09-30T14:52:39.089677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef9152b1-c621c39-d2030ab3-f11c57c9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b04743b2-851ce746-84f3dfee-28b4825c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:39.092389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b04743b2-851ce746-84f3dfee-28b4825c_0] Write session: try to update token
2025-09-30T14:52:39.092406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b04743b2-851ce746-84f3dfee-28b4825c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:39.100543Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:39.100565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:39.100568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:39.100570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:39.100578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895271517762315:6272]
2025-09-30T14:52:39.100582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895271517762315:6272]
2025-09-30T14:52:39.100586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895271517762315:6272]
2025-09-30T14:52:39.100624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:39.100630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.100633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:39.100634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:39.100640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:39.100647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:39.100770Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:39.105845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 901 sessionId: src_id|b04743b2-851ce746-84f3dfee-28b4825c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:39.108598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:39.161520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895271607499046:7153]
2025-09-30T14:52:39.161793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 900, pipe: [1:7555895271607499046:7153]
2025-09-30T14:52:39.205468Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:39.205900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:39.205912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:39.205944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895271607499046:7153], now have 1 active actors on pipe
2025-09-30T14:52:39.206114Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:39.206161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:39.206163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895271607499046:7153]
2025-09-30T14:52:39.206178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:39.206184Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:39.206211Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:52:39.206234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 901 reason: error at write: Disconnected sessionId: src_id|b04743b2-851ce746-84f3dfee-28b4825c_0
2025-09-30T14:52:39.206310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 901 sessionId: src_id|b04743b2-851ce746-84f3dfee-28b4825c_0 is DEAD
2025-09-30T14:52:39.206425Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 9 consumer shared/user session shared/user_1_9_3987928195281550931_v1 is DEAD
2025-09-30T14:52:39.206538Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:52:39.206577Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:52:39.206581Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:52:39.206559Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895202887996232:7150] disconnected; active server actors: 1
2025-09-30T14:52:39.206587Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.006847s
2025-09-30T14:52:39.206567Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895202887996232:7150] client user disconnected session shared/user_1_9_3987928195281550931_v1
2025-09-30T14:52:39.206636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b04743b2-851ce746-84f3dfee-28b4825c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:39.206646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b04743b2-851ce746-84f3dfee-28b4825c_0] Write session will restart in 0.009487s
2025-09-30T14:52:39.206669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b04743b2-851ce746-84f3dfee-28b4825c_0] Write session: Do CDS request
2025-09-30T14:52:39.206674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b04743b2-851ce746-84f3dfee-28b4825c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:39.214598Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:52:39.214767Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:52:39.214781Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 10
2025-09-30T14:52:39.214914Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 10 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:52:39.214954Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:52:39.215022Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 auth for : user
2025-09-30T14:52:39.215168Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 Handle describe topics response
2025-09-30T14:52:39.215206Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 auth is DEAD
2025-09-30T14:52:39.215212Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:52:39.215519Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:52:39.215607Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_10_2061474146563990167_v1
2025-09-30T14:52:39.215635Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895271607499170:7728] connected; active server actors: 1
2025-09-30T14:52:39.215649Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555895271607499170:7728] session shared/user_1_10_2061474146563990167_v1
2025-09-30T14:52:39.215659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:52:39.215668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:52:39.215676Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_10_2061474146563990167_v1" (Sender=[1:7555895271607499143:7728], Pipe=[1:7555895271607499170:7728], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:52:39.215678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:52:39.215686Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:52:39.215692Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_10_2061474146563990167_v1" (Sender=[1:7555895271607499143:7728], Pipe=[1:7555895271607499170:7728], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:52:39.215704Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_10_2061474146563990167_v1" sender [1:7555895271607499143:7728] lock partition 0 for ReadingSession "shared/user_1_10_2061474146563990167_v1" (Sender=[1:7555895271607499143:7728], Pipe=[1:7555895271607499170:7728], Partitions=[], ActiveFamilyCount=1) generation 1 step 10
2025-09-30T14:52:39.215715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:52:39.215720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000032s
2025-09-30T14:52:39.215922Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 10 Session: "shared/user_1_10_2061474146563990167_v1" ClientId: "user" PipeClient { RawX1: 7555895271607499170 RawX2: 4503603922345520 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:52:39.215940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:52:39.216646Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:39.216664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b04743b2-851ce746-84f3dfee-28b4825c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:39.216657Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 902
2025-09-30T14:52:39.216838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 902 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:39.216871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 902 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:39.216878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=902 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:39.216883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:39.217198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 902 sessionId:  describe result for acl check
2025-09-30T14:52:39.217227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:39.217233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:39.217234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:39.217238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895271607499258:7732] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:39.217699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895271607499258:7732] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:39.219784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895271607499258:7732] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:39.223592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:39.224008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:39.224083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895271607499258:7732] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:39.224097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895271607499258:7732] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:39.224099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895271607499258:7732] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:39.224105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 902 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:39.224162Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:39.224171Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:39.224179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:39.224217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:39.224247Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895271517762589:6287]
2025-09-30T14:52:39.224705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:39.224954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:39.224997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:39.225265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:39.225330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:39.225335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:39.225336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:39.225336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:39.225337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:39.225338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:39.225339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:39.225340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:39.225340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:39.225341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:39.225342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.225343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.225344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.225344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:39.225345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:39.225348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:39.225355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:39.225357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:39.225359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:39.225362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:39.225364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:39.225366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:39.225369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:39.225371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:39.225373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:39.225376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.225378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.225380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.225382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:39.225385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:39.225391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:39.225395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:39.225400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:39.225403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:39.225406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:39.225409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:39.225412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:39.225415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:39.225417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:39.225421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:39.225423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:39.225426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:39.225429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:39.225432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:39.225434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:39.225437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:39.225440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:39.225443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:39.225445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:39.225448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:39.225452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.225455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.225458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.225461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.225463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.225466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.225469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:39.225471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:39.225474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:39.225477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:39.225500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:39.230540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:39.231974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:39.231988Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:39.231991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:39.231995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:39.232002Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 901 [2:7555895271517762589:6287]
2025-09-30T14:52:39.232016Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:39.232031Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:39.232034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:39.232037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:39.232039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:39.232055Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:39.232062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:39.232069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:39.232124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.232132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.232134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.232137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:39.232139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:39.232203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:39.232210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.232221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.232236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.232257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:39.232280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895271607499048:2454], now have 1 active actors on pipe
2025-09-30T14:52:39.232284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895271607499191:7731], now have 1 active actors on pipe
2025-09-30T14:52:39.232287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895271607499411:7732], now have 1 active actors on pipe
2025-09-30T14:52:39.232292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895271517762584:6287]
2025-09-30T14:52:39.232294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895271517762584:6287]
2025-09-30T14:52:39.232296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895271517762584:6287]
2025-09-30T14:52:39.232308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:39.232321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:39.232324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:39.232330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:39.232333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:39.232337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:39.232339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:39.232324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 901
2025-09-30T14:52:39.232326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 901
2025-09-30T14:52:39.232364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 901, pipe: [1:7555895271607499191:7731]
2025-09-30T14:52:39.232366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895271517762584:6287]
2025-09-30T14:52:39.232374Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:39.232376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:39.232390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:39.232399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:39.232436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:39.232443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:39.232449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_10_2061474146563990167_v1 on pipe: [1:7555895271607499191:7731]
2025-09-30T14:52:39.232481Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42c0138e-35f9697b-6b27ea03-6e83c4f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:39.232487Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_10_2061474146563990167_v1:1 with generation 901
2025-09-30T14:52:39.232494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:39.232499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:39.232501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:39.232511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:39.232521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:39.232532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:39.232536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:39.232537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:39.232552Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_10_2061474146563990167_v1
2025-09-30T14:52:39.232560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:39.232594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:39.232608Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:52:39.232750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:39.232758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:39.232772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:39.232831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 902 partition: 0 MaxSeqNo: 42 sessionId: src_id|42c0138e-35f9697b-6b27ea03-6e83c4f9_0
2025-09-30T14:52:39.233152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b04743b2-851ce746-84f3dfee-28b4825c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|42c0138e-35f9697b-6b27ea03-6e83c4f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:39.235737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42c0138e-35f9697b-6b27ea03-6e83c4f9_0] Write session: try to update token
2025-09-30T14:52:39.235754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42c0138e-35f9697b-6b27ea03-6e83c4f9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:39.236232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:52:39.236263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:52:39.236271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:39.236274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:39.236276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:39.236283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:52:39.236295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:52:39.236409Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759243959232 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:52:39.236438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:52:39.236467Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 sending to client partition status
2025-09-30T14:52:39.247983Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:39.248008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:39.248015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:39.248021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:39.248030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895271517762584:6287]
2025-09-30T14:52:39.248038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895271517762584:6287]
2025-09-30T14:52:39.248046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895271517762584:6287]
2025-09-30T14:52:39.248101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:39.248106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:39.248110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.248114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:39.248117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:39.248124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:39.248255Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:39.250281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 902 sessionId: src_id|42c0138e-35f9697b-6b27ea03-6e83c4f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:39.252872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:39.351775Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:39.352700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:39.352719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:39.353043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:39.353081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895271607499191:7731]
2025-09-30T14:52:39.353092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:39.353095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:39.353083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_10_2061474146563990167_v1
2025-09-30T14:52:39.353100Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:39.353161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 902 reason: error at write: Disconnected sessionId: src_id|42c0138e-35f9697b-6b27ea03-6e83c4f9_0
2025-09-30T14:52:39.353145Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_10_2061474146563990167_v1
2025-09-30T14:52:39.353340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 902 sessionId: src_id|42c0138e-35f9697b-6b27ea03-6e83c4f9_0 is DEAD
2025-09-30T14:52:39.353521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42c0138e-35f9697b-6b27ea03-6e83c4f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:39.353529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42c0138e-35f9697b-6b27ea03-6e83c4f9_0] Write session will restart in 0.008549s
2025-09-30T14:52:39.353551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42c0138e-35f9697b-6b27ea03-6e83c4f9_0] Write session: Do CDS request
2025-09-30T14:52:39.353557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42c0138e-35f9697b-6b27ea03-6e83c4f9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:39.363741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42c0138e-35f9697b-6b27ea03-6e83c4f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:39.363807Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:39.363823Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 903
2025-09-30T14:52:39.363941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 903 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:39.363975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 903 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:39.363987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=903 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:39.363991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:39.364570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 903 sessionId:  describe result for acl check
2025-09-30T14:52:39.364617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:39.364626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:39.364630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:39.364636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895271607499613:7736] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:39.365570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895271607499613:7736] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:39.367810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895271607499613:7736] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:39.369577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:39.371996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:39.372174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895271607499613:7736] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:39.372197Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:39.372188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895271607499613:7736] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:39.372206Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:39.372216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:39.372191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895271607499613:7736] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:39.372198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 903 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:39.372268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:39.372306Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895271517762823:6289]
2025-09-30T14:52:39.373009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:39.373297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:39.373341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:39.373687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:39.373744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:39.373749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:39.373750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:39.373752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:39.373753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:39.373754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:39.373755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:39.373756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:39.373757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:39.373758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:39.373759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.373761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.373762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.373763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:39.373764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:39.373769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:39.373779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:39.373784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:39.373788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:39.373792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:39.373796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:39.373800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:39.373804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:39.373808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:39.373813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:39.373816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.373820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.373824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.373828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:39.373833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:39.373840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:39.373852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:39.373858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:39.373868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:39.373877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:39.373882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:39.373890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:39.373896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:39.373901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:39.373906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:39.373910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:39.373915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:39.373920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:39.373930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:39.373935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:39.373945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:39.373950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:39.373957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:39.373961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:39.373970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:39.373975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.373984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.373988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.373997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.374002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.374007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.374017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:39.374021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:39.374025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:39.374034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:39.374078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:39.380034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:39.381147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:39.381161Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:39.381163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:39.381166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:39.381171Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 902 [2:7555895271517762823:6289]
2025-09-30T14:52:39.381183Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:39.381195Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:39.381198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:39.381200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:39.381201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:39.381213Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:39.381218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:39.381223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:39.381279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.381288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.381290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.381294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:39.381296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:39.381348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:39.381355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.381363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.381369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.381390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:39.381411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895271517762818:6289]
2025-09-30T14:52:39.381418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895271517762818:6289]
2025-09-30T14:52:39.381420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895271517762818:6289]
2025-09-30T14:52:39.381432Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:39.381443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:39.381447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895271607499423:2454], now have 1 active actors on pipe
2025-09-30T14:52:39.381450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895271607499781:7736], now have 1 active actors on pipe
2025-09-30T14:52:39.381451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:39.381453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:39.381456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:39.381464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:39.381466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:39.381501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895271517762818:6289]
2025-09-30T14:52:39.381514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:39.381543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:39.381526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 902
2025-09-30T14:52:39.381538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 902
2025-09-30T14:52:39.382162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:39.382173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:39.382194Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|534c8770-b1e2bc11-af619e6c-2764614c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:39.382201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:39.382210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:39.382212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:39.382222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:39.382231Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:39.382260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:39.382452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:39.382461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:39.382474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:39.382569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 903 partition: 0 MaxSeqNo: 42 sessionId: src_id|534c8770-b1e2bc11-af619e6c-2764614c_0
2025-09-30T14:52:39.382901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42c0138e-35f9697b-6b27ea03-6e83c4f9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|534c8770-b1e2bc11-af619e6c-2764614c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:39.388516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|534c8770-b1e2bc11-af619e6c-2764614c_0] Write session: try to update token
2025-09-30T14:52:39.388540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|534c8770-b1e2bc11-af619e6c-2764614c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:39.394226Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:39.394259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:39.394262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:39.394264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:39.394273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895271517762818:6289]
2025-09-30T14:52:39.394278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895271517762818:6289]
2025-09-30T14:52:39.394285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895271517762818:6289]
2025-09-30T14:52:39.394324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:39.394331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.394331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:39.394335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:39.394339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:39.394341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:39.394474Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:39.403408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 903 sessionId: src_id|534c8770-b1e2bc11-af619e6c-2764614c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:39.405701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:39.453381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895271607499792:7731]
2025-09-30T14:52:39.453597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 902, pipe: [1:7555895271607499792:7731]
2025-09-30T14:52:39.504289Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:39.504541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:39.504552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:39.504568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895271607499792:7731], now have 1 active actors on pipe
2025-09-30T14:52:39.504733Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:39.504810Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:39.504839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895271607499792:7731]
2025-09-30T14:52:39.504854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:39.504928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 903 reason: status is not ok: tablet will be restarted right now sessionId: src_id|534c8770-b1e2bc11-af619e6c-2764614c_0
2025-09-30T14:52:39.505048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 903 sessionId: src_id|534c8770-b1e2bc11-af619e6c-2764614c_0 is DEAD
2025-09-30T14:52:39.505198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|534c8770-b1e2bc11-af619e6c-2764614c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:39.505208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|534c8770-b1e2bc11-af619e6c-2764614c_0] Write session will restart in 0.009091s
2025-09-30T14:52:39.505229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|534c8770-b1e2bc11-af619e6c-2764614c_0] Write session: Do CDS request
2025-09-30T14:52:39.505235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|534c8770-b1e2bc11-af619e6c-2764614c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:39.515661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|534c8770-b1e2bc11-af619e6c-2764614c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:39.515770Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:39.515790Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 904
2025-09-30T14:52:39.515933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 904 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:39.515957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 904 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:39.515964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=904 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:39.515967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:39.516385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 904 sessionId:  describe result for acl check
2025-09-30T14:52:39.516416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:39.516418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:39.516420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:39.516425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895271607500003:7741] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:39.516946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895271607500003:7741] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:39.519092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895271607500003:7741] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:39.521602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895271607500003:7741] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:39.521618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895271607500003:7741] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:39.521622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895271607500003:7741] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:39.521629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 904 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:39.523594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:39.524032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:39.524204Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:39.524216Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:39.524227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:39.524278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:39.524315Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895271517763057:6291]
2025-09-30T14:52:39.524924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:39.525253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:39.525294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:39.525623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:39.525686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:39.525691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:39.525692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:39.525693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:39.525694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:39.525696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:39.525697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:39.525698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:39.525699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:39.525700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:39.525702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.525703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.525704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.525705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:39.525707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:39.525712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:39.525721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:39.525725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:39.525729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:39.525733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:39.525737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:39.525742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:39.525745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:39.525750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:39.525761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:39.525764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.525766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.525768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.525771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:39.525776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:39.525783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:39.525790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:39.525797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:39.525803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:39.525807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:39.525812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:39.525817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:39.525822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:39.525827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:39.525832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:39.525837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:39.525842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:39.525851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:39.525854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:39.525856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:39.525859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:39.525862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:39.525869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:39.525871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:39.525874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:39.525877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.525880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.525882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.525885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.525892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.525895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.525897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:39.525900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:39.525903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:39.525906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:39.525930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:39.531527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:39.532373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:39.532386Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:39.532389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:39.532393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:39.532400Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 903 [2:7555895271517763057:6291]
2025-09-30T14:52:39.532415Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:39.532430Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:39.532434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:39.532437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:39.532439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:39.532454Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:39.532464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:39.532477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:39.532534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.532541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.532543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.532547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:39.532550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:39.532616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:39.532623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.532635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.532652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.532673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:39.532694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895271607500153:7741], now have 1 active actors on pipe
2025-09-30T14:52:39.532702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895271607499795:2454], now have 1 active actors on pipe
2025-09-30T14:52:39.532708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895271517763052:6291]
2025-09-30T14:52:39.532715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895271517763052:6291]
2025-09-30T14:52:39.532717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895271517763052:6291]
2025-09-30T14:52:39.532730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:39.532746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:39.532747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:39.532751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:39.532753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:39.532764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:39.532772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:39.532769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 903
2025-09-30T14:52:39.532808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895271517763052:6291]
2025-09-30T14:52:39.532780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 903
2025-09-30T14:52:39.532819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:39.532826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:39.532843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:39.532852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:39.532899Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72de535b-7bd0033f-54051276-c3014598_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:39.532910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:39.532917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:39.532919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:39.532928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:39.532940Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:39.532959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:39.533119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:39.533132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:39.533145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:39.533221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 904 partition: 0 MaxSeqNo: 42 sessionId: src_id|72de535b-7bd0033f-54051276-c3014598_0
2025-09-30T14:52:39.533564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|534c8770-b1e2bc11-af619e6c-2764614c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|72de535b-7bd0033f-54051276-c3014598_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:39.536337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72de535b-7bd0033f-54051276-c3014598_0] Write session: try to update token
2025-09-30T14:52:39.536355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72de535b-7bd0033f-54051276-c3014598_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:39.545516Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:39.545539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:39.545542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:39.545544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:39.545554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895271517763052:6291]
2025-09-30T14:52:39.545559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895271517763052:6291]
2025-09-30T14:52:39.545563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895271517763052:6291]
2025-09-30T14:52:39.545608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:39.545610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:39.545615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.545617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:39.545619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:39.545626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:39.545763Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:39.550604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 904 sessionId: src_id|72de535b-7bd0033f-54051276-c3014598_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:39.553146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:39.604919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895271607500165:7731]
2025-09-30T14:52:39.605171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 903, pipe: [1:7555895271607500165:7731]
2025-09-30T14:52:39.657883Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:39.658837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:39.658855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:39.658900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895271607500165:7731], now have 1 active actors on pipe
2025-09-30T14:52:39.659152Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:39.659180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895271607500165:7731]
2025-09-30T14:52:39.659181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:39.659187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:39.659210Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:39.659264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 904 reason: error at write: Disconnected sessionId: src_id|72de535b-7bd0033f-54051276-c3014598_0
2025-09-30T14:52:39.659437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 904 sessionId: src_id|72de535b-7bd0033f-54051276-c3014598_0 is DEAD
2025-09-30T14:52:39.659585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72de535b-7bd0033f-54051276-c3014598_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:39.659597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72de535b-7bd0033f-54051276-c3014598_0] Write session will restart in 0.006231s
2025-09-30T14:52:39.659621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72de535b-7bd0033f-54051276-c3014598_0] Write session: Do CDS request
2025-09-30T14:52:39.659630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72de535b-7bd0033f-54051276-c3014598_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:39.666753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72de535b-7bd0033f-54051276-c3014598_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:39.666866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:39.666888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 905
2025-09-30T14:52:39.666987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 905 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:39.667012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 905 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:39.667020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=905 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:39.667032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:39.667483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 905 sessionId:  describe result for acl check
2025-09-30T14:52:39.667516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:39.667525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:39.667527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:39.667532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895271607500219:7745] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:39.668047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895271607500219:7745] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:39.670040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895271607500219:7745] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:39.672777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895271607500219:7745] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:39.672798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895271607500219:7745] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:39.672801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895271607500219:7745] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:39.672810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 905 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:39.677347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:39.680073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:39.680281Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:39.680294Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:39.680306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:39.680365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:39.680405Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895271517763293:6294]
2025-09-30T14:52:39.681020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:39.681329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:39.681361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:39.681617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:39.681677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:39.681683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:39.681685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:39.681686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:39.681687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:39.681688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:39.681690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:39.681691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:39.681693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:39.681694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:39.681695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.681696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.681698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.681699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:39.681700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:39.681706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:39.681717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:39.681721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:39.681726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:39.681730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:39.681734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:39.681738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:39.681742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:39.681746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:39.681751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:39.681755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.681759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.681763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.681767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:39.681769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:39.681774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:39.681779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:39.681783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:39.681787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:39.681790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:39.681793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:39.681796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:39.681799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:39.681802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:39.681805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:39.681808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:39.681811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:39.681814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:39.681817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:39.681819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:39.681822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:39.681825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:39.681829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:39.681832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:39.681835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:39.681837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.681840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.681842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.681845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.681848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.681851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.681853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:39.681856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:39.681859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:39.681862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:39.681885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:39.687291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:39.688099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:39.688114Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:39.688117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:39.688121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:39.688128Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 904 [2:7555895271517763293:6294]
2025-09-30T14:52:39.688144Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:39.688164Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:39.688171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:39.688174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:39.688176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:39.688192Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:39.688204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:39.688210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:39.688266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.688273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.688275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.688279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:39.688282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:39.688345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:39.688353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.688365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.688382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.688409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:39.688429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895271607500459:7745], now have 1 active actors on pipe
2025-09-30T14:52:39.688437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895271607500166:2454], now have 1 active actors on pipe
2025-09-30T14:52:39.688443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895271517763288:6294]
2025-09-30T14:52:39.688445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895271517763288:6294]
2025-09-30T14:52:39.688448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895271517763288:6294]
2025-09-30T14:52:39.688460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:39.688473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:39.688478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:39.688482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:39.688485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:39.688495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:39.688478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 904
2025-09-30T14:52:39.688502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:39.688485Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 904
2025-09-30T14:52:39.688530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895271517763288:6294]
2025-09-30T14:52:39.688538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:39.688546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:39.688563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:39.688572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:39.688605Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0f4b2aa-5c35d99b-be9d9080-9710d1c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:39.688618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:39.688621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:39.688628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:39.688637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:39.688645Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:39.688672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:39.688832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:39.688850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:39.688880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:39.688988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 905 partition: 0 MaxSeqNo: 42 sessionId: src_id|d0f4b2aa-5c35d99b-be9d9080-9710d1c3_0
2025-09-30T14:52:39.689327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72de535b-7bd0033f-54051276-c3014598_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d0f4b2aa-5c35d99b-be9d9080-9710d1c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:39.691837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0f4b2aa-5c35d99b-be9d9080-9710d1c3_0] Write session: try to update token
2025-09-30T14:52:39.691865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0f4b2aa-5c35d99b-be9d9080-9710d1c3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:39.701154Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:39.701172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:39.701175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:39.701177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:39.701186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895271517763288:6294]
2025-09-30T14:52:39.701190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895271517763288:6294]
2025-09-30T14:52:39.701194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895271517763288:6294]
2025-09-30T14:52:39.701230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:39.701233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:39.701236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.701239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:39.701238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:39.701242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:39.701366Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:39.705744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 905 sessionId: src_id|d0f4b2aa-5c35d99b-be9d9080-9710d1c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:39.708398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:39.759542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895271607500537:7731]
2025-09-30T14:52:39.759768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 904, pipe: [1:7555895271607500537:7731]
2025-09-30T14:52:39.808230Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:39.808817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:39.808831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:39.808862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895271607500537:7731], now have 1 active actors on pipe
2025-09-30T14:52:39.809008Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:39.809068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:39.809091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895271607500537:7731]
2025-09-30T14:52:39.809113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:39.809189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 905 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d0f4b2aa-5c35d99b-be9d9080-9710d1c3_0
2025-09-30T14:52:39.809341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 905 sessionId: src_id|d0f4b2aa-5c35d99b-be9d9080-9710d1c3_0 is DEAD
2025-09-30T14:52:39.809474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0f4b2aa-5c35d99b-be9d9080-9710d1c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:39.809486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0f4b2aa-5c35d99b-be9d9080-9710d1c3_0] Write session will restart in 0.005949s
2025-09-30T14:52:39.809509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0f4b2aa-5c35d99b-be9d9080-9710d1c3_0] Write session: Do CDS request
2025-09-30T14:52:39.809514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0f4b2aa-5c35d99b-be9d9080-9710d1c3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:39.816634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0f4b2aa-5c35d99b-be9d9080-9710d1c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:39.816763Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:39.816778Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 906
2025-09-30T14:52:39.816903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 906 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:39.816936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 906 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:39.816946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=906 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:39.816952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:39.817371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 906 sessionId:  describe result for acl check
2025-09-30T14:52:39.817408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:39.817415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:39.817417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:39.817422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895271607500627:7749] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:39.817937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895271607500627:7749] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:39.819799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895271607500627:7749] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:39.822125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895271607500627:7749] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:39.822136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895271607500627:7749] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:39.822139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895271607500627:7749] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:39.822146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 906 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:39.827041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:39.827595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:39.827758Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:39.827767Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:39.827776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:39.827818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:39.827856Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895271517763528:6296]
2025-09-30T14:52:39.828504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:39.828799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:39.828844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:39.829166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:39.829232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:39.829240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:39.829242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:39.829243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:39.829244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:39.829246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:39.829247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:39.829249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:39.829250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:39.829251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:39.829252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.829253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.829254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.829255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:39.829256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:39.829262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:39.829272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:39.829275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:39.829279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:39.829283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:39.829288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:39.829293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:39.829296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:39.829301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:39.829305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:39.829309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.829314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.829318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.829322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:39.829326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:39.829334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:39.829342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:39.829348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:39.829354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:39.829358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:39.829364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:39.829368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:39.829374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:39.829379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:39.829384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:39.829393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:39.829398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:39.829408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:39.829417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:39.829425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:39.829430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:39.829440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:39.829449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:39.829458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:39.829465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:39.829475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.829480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.829484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.829488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.829501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.829505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.829510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:39.829515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:39.829519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:39.829523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:39.829568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:39.834996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:39.836231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:39.836245Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:39.836246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:39.836250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:39.836255Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 905 [2:7555895271517763528:6296]
2025-09-30T14:52:39.836268Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:39.836279Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:39.836280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:39.836282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:39.836284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:39.836294Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:39.836299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:39.836304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:39.836348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.836356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.836357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.836360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:39.836362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:39.836420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:39.836428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.836442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.836459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.836478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:39.836499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895271607500866:7749], now have 1 active actors on pipe
2025-09-30T14:52:39.836503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895271607500538:2454], now have 1 active actors on pipe
2025-09-30T14:52:39.836508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895271517763523:6296]
2025-09-30T14:52:39.836511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895271517763523:6296]
2025-09-30T14:52:39.836513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895271517763523:6296]
2025-09-30T14:52:39.836526Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:39.836538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:39.836548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:39.836551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:39.836554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:39.836560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:39.836562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:39.836585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895271517763523:6296]
2025-09-30T14:52:39.836593Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:39.836573Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 905
2025-09-30T14:52:39.836576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 905
2025-09-30T14:52:39.836609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:39.836639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:39.836643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:39.836670Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e23a630a-c5a4ca4-fd37f61c-d5bf911d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:39.836683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:39.836686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:39.836688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:39.836699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:39.836713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:39.836730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:39.836887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:39.836898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:39.836913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:39.836996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 906 partition: 0 MaxSeqNo: 42 sessionId: src_id|e23a630a-c5a4ca4-fd37f61c-d5bf911d_0
2025-09-30T14:52:39.837320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0f4b2aa-5c35d99b-be9d9080-9710d1c3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e23a630a-c5a4ca4-fd37f61c-d5bf911d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:39.840057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e23a630a-c5a4ca4-fd37f61c-d5bf911d_0] Write session: try to update token
2025-09-30T14:52:39.840077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e23a630a-c5a4ca4-fd37f61c-d5bf911d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:39.849978Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:39.850006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:39.850008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:39.850010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:39.850022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895271517763523:6296]
2025-09-30T14:52:39.850028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895271517763523:6296]
2025-09-30T14:52:39.850034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895271517763523:6296]
2025-09-30T14:52:39.850085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:39.850086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:39.850096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:39.850095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.850098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:39.850103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:39.850378Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:39.854356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 906 sessionId: src_id|e23a630a-c5a4ca4-fd37f61c-d5bf911d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:39.856733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:39.909041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895271607500910:7731]
2025-09-30T14:52:39.909301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 905, pipe: [1:7555895271607500910:7731]
2025-09-30T14:52:39.957398Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:39.958049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:39.958068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:39.958108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895271607500910:7731], now have 1 active actors on pipe
2025-09-30T14:52:39.958342Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:39.958326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:39.958360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:39.958364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:39.958371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895271607500910:7731]
2025-09-30T14:52:39.958472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 906 reason: error at write: Disconnected sessionId: src_id|e23a630a-c5a4ca4-fd37f61c-d5bf911d_0
2025-09-30T14:52:39.958624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 906 sessionId: src_id|e23a630a-c5a4ca4-fd37f61c-d5bf911d_0 is DEAD
2025-09-30T14:52:39.958740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e23a630a-c5a4ca4-fd37f61c-d5bf911d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:39.958748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e23a630a-c5a4ca4-fd37f61c-d5bf911d_0] Write session will restart in 0.008051s
2025-09-30T14:52:39.958770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e23a630a-c5a4ca4-fd37f61c-d5bf911d_0] Write session: Do CDS request
2025-09-30T14:52:39.958779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e23a630a-c5a4ca4-fd37f61c-d5bf911d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:39.967728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e23a630a-c5a4ca4-fd37f61c-d5bf911d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:39.967961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:39.967980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 907
2025-09-30T14:52:39.968110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 907 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:39.968144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 907 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:39.968147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=907 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:39.968150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:39.968477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 907 sessionId:  describe result for acl check
2025-09-30T14:52:39.968502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:39.968503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:39.968504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:39.968509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895271607501082:7753] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:39.968910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895271607501082:7753] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:39.970686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895271607501082:7753] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:39.973244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895271607501082:7753] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:39.973259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895271607501082:7753] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:39.973262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895271607501082:7753] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:39.973270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 907 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:39.976587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:39.977036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:39.977192Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:39.977201Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:39.977212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:39.977261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:39.977309Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895271517763764:6298]
2025-09-30T14:52:39.977879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:39.978154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:39.978212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:39.978523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:39.978578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:39.978582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:39.978583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:39.978584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:39.978585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:39.978585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:39.978586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:39.978587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:39.978588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:39.978589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:39.978589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.978590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.978591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.978591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:39.978592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:39.978596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:39.978603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:39.978605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:39.978608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:39.978610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:39.978613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:39.978615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:39.978617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:39.978620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:39.978623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:39.978625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.978628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.978630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.978632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:39.978634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:39.978640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:39.978645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:39.978649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:39.978652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:39.978655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:39.978658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:39.978660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:39.978663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:39.978666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:39.978668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:39.978671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:39.978674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:39.978676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:39.978680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:39.978682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:39.978685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:39.978687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:39.978690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:39.978693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:39.978696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:39.978698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.978702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.978704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.978707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.978710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.978713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.978716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:39.978719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:39.978722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:39.978725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:39.978765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:39.983952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:39.984792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:39.984808Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:39.984810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:39.984815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:39.984821Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 906 [2:7555895271517763764:6298]
2025-09-30T14:52:39.984836Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:39.984854Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:39.984861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:39.984864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:39.984866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:39.984877Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:39.984882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:39.984892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:39.984936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.984944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.984946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.984948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:39.984950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:39.984996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:39.985002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.985011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:39.985021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:39.985034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:39.985050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895271607500914:2454], now have 1 active actors on pipe
2025-09-30T14:52:39.985056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895271607501270:7753], now have 1 active actors on pipe
2025-09-30T14:52:39.985061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895271517763759:6298]
2025-09-30T14:52:39.985062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895271517763759:6298]
2025-09-30T14:52:39.985064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895271517763759:6298]
2025-09-30T14:52:39.985073Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:39.985082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:39.985083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:39.985086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:39.985087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:39.985098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:39.985101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:39.985128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895271517763759:6298]
2025-09-30T14:52:39.985138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:39.985142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:39.985165Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 906
2025-09-30T14:52:39.985168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 906
2025-09-30T14:52:39.985241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:39.985248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:39.985267Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4390034b-a865e56-7144b3a-daf37e36_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:39.985275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:39.985277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:39.985279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:39.985286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:39.985292Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:39.985305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:39.985411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:39.985416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:39.985425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:39.985497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 907 partition: 0 MaxSeqNo: 42 sessionId: src_id|4390034b-a865e56-7144b3a-daf37e36_0
2025-09-30T14:52:39.985815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e23a630a-c5a4ca4-fd37f61c-d5bf911d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4390034b-a865e56-7144b3a-daf37e36_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:39.988451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4390034b-a865e56-7144b3a-daf37e36_0] Write session: try to update token
2025-09-30T14:52:39.988466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4390034b-a865e56-7144b3a-daf37e36_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:39.996894Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:39.996913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:39.996915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:39.996917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:39.996928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895271517763759:6298]
2025-09-30T14:52:39.996932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895271517763759:6298]
2025-09-30T14:52:39.996936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895271517763759:6298]
2025-09-30T14:52:39.996977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:39.996982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:39.996984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:39.996987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:39.996988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:39.996991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:39.997131Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:40.001774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 907 sessionId: src_id|4390034b-a865e56-7144b3a-daf37e36_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:40.004302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:40.058531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895275902468601:7731]
2025-09-30T14:52:40.058718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 906, pipe: [1:7555895275902468601:7731]
2025-09-30T14:52:40.100823Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:40.101509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:40.101524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:40.101555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895275902468601:7731], now have 1 active actors on pipe
2025-09-30T14:52:40.101705Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:40.101779Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:40.101812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895275902468601:7731]
2025-09-30T14:52:40.101827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:40.101898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 907 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4390034b-a865e56-7144b3a-daf37e36_0
2025-09-30T14:52:40.102050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 907 sessionId: src_id|4390034b-a865e56-7144b3a-daf37e36_0 is DEAD
2025-09-30T14:52:40.102218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4390034b-a865e56-7144b3a-daf37e36_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:40.102233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4390034b-a865e56-7144b3a-daf37e36_0] Write session will restart in 0.009183s
2025-09-30T14:52:40.102261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4390034b-a865e56-7144b3a-daf37e36_0] Write session: Do CDS request
2025-09-30T14:52:40.102266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4390034b-a865e56-7144b3a-daf37e36_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:40.112635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4390034b-a865e56-7144b3a-daf37e36_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:40.112751Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:40.112767Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 908
2025-09-30T14:52:40.112899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 908 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:40.112930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 908 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:40.112939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=908 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:40.112943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:40.113360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 908 sessionId:  describe result for acl check
2025-09-30T14:52:40.113389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:40.113396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:40.113398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:40.113403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895275902468884:7760] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:40.113900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895275902468884:7760] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:40.115450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895275902468884:7760] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:40.118272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:40.118416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895275902468884:7760] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:40.118428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895275902468884:7760] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:40.118431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895275902468884:7760] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:40.118437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 908 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:40.118691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:40.118821Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:40.118828Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:40.118835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:40.118867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:40.118892Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895275812731311:6302]
2025-09-30T14:52:40.119321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:40.119590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:40.119647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:40.119907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:40.119955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:40.119960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:40.119961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:40.119961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:40.119962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:40.119963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:40.119963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:40.119964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:40.119964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:40.119965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:40.119966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.119967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.119967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.119968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:40.119969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:40.119973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:40.119979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:40.119982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:40.119984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:40.119987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:40.119989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:40.119991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:40.119994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:40.119996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:40.119998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:40.120001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.120003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.120005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.120007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:40.120010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:40.120014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:40.120019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:40.120024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:40.120027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:40.120030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:40.120033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:40.120036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:40.120039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:40.120042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:40.120044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:40.120047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:40.120050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:40.120052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:40.120055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:40.120058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:40.120061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:40.120063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:40.120066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:40.120069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:40.120072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:40.120074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.120077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.120080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.120083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.120085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.120088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.120091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:40.120094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:40.120097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:40.120099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:40.120122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:40.125232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:40.126201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:40.126214Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:40.126216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:40.126218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:40.126223Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 907 [2:7555895275812731311:6302]
2025-09-30T14:52:40.126232Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:40.126252Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:40.126255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:40.126257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:40.126259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:40.126270Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:40.126274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:40.126279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:40.126315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.126323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.126325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.126327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:40.126328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:40.126373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:40.126379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.126387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.126393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.126402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:40.126417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895275812731305:6302]
2025-09-30T14:52:40.126422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895275812731305:6302]
2025-09-30T14:52:40.126424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895275812731305:6302]
2025-09-30T14:52:40.126434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:40.126449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:40.126453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895275902468967:7760], now have 1 active actors on pipe
2025-09-30T14:52:40.126456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895275902468605:2454], now have 1 active actors on pipe
2025-09-30T14:52:40.126458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:40.126460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:40.126463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:40.126476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:40.126479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:40.126507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895275812731305:6302]
2025-09-30T14:52:40.126522Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:40.126531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:40.126510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 907
2025-09-30T14:52:40.126529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 907
2025-09-30T14:52:40.126563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:40.126572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:40.126596Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1832eb6-95455932-4ada0827-2313e4e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:40.126607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:40.126610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:40.126612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:40.126621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:40.126634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:40.126651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:40.126782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:40.126794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:40.126810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:40.126896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 908 partition: 0 MaxSeqNo: 42 sessionId: src_id|f1832eb6-95455932-4ada0827-2313e4e9_0
2025-09-30T14:52:40.127185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4390034b-a865e56-7144b3a-daf37e36_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f1832eb6-95455932-4ada0827-2313e4e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:40.129748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1832eb6-95455932-4ada0827-2313e4e9_0] Write session: try to update token
2025-09-30T14:52:40.129767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1832eb6-95455932-4ada0827-2313e4e9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:40.138966Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:40.138986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:40.138988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:40.138990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:40.138998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895275812731305:6302]
2025-09-30T14:52:40.139002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895275812731305:6302]
2025-09-30T14:52:40.139005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895275812731305:6302]
2025-09-30T14:52:40.139047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:40.139051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:40.139057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.139058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:40.139059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:40.139062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:40.139197Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:40.143561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 908 sessionId: src_id|f1832eb6-95455932-4ada0827-2313e4e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:40.146357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:40.201923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895275902469001:7731]
2025-09-30T14:52:40.202251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 907, pipe: [1:7555895275902469001:7731]
2025-09-30T14:52:40.246256Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:40.246483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:40.246494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:40.246526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895275902469001:7731], now have 1 active actors on pipe
2025-09-30T14:52:40.246679Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:40.246725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895275902469001:7731]
2025-09-30T14:52:40.246741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:40.246759Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:40.246815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 908 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f1832eb6-95455932-4ada0827-2313e4e9_0
2025-09-30T14:52:40.246968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 908 sessionId: src_id|f1832eb6-95455932-4ada0827-2313e4e9_0 is DEAD
2025-09-30T14:52:40.247128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1832eb6-95455932-4ada0827-2313e4e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:40.247139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1832eb6-95455932-4ada0827-2313e4e9_0] Write session will restart in 0.009519s
2025-09-30T14:52:40.247162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1832eb6-95455932-4ada0827-2313e4e9_0] Write session: Do CDS request
2025-09-30T14:52:40.247168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1832eb6-95455932-4ada0827-2313e4e9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:40.257794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1832eb6-95455932-4ada0827-2313e4e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:40.257862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:40.257879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 909
2025-09-30T14:52:40.258004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 909 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:40.258038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 909 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:40.258044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=909 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:40.258052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:40.258484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 909 sessionId:  describe result for acl check
2025-09-30T14:52:40.258531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:40.258536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:40.258538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:40.258544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895275902469268:7771] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:40.259069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895275902469268:7771] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:40.261501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895275902469268:7771] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:40.262475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:40.265281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:40.265340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895275902469268:7771] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:40.265357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895275902469268:7771] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:40.265360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895275902469268:7771] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:40.265369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 909 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:40.265472Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:40.265483Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:40.265495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:40.265562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:40.265603Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895275812731585:6316]
2025-09-30T14:52:40.266090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:40.266394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:40.266441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:40.266693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:40.266751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:40.266759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:40.266761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:40.266762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:40.266763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:40.266764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:40.266765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:40.266766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:40.266767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:40.266768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:40.266769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.266771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.266772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.266773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:40.266774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:40.266780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:40.266790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:40.266794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:40.266798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:40.266802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:40.266806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:40.266810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:40.266814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:40.266818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:40.266822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:40.266825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.266830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.266834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.266838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:40.266857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:40.266864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:40.266870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:40.266874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:40.266878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:40.266881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:40.266884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:40.266886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:40.266890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:40.266893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:40.266896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:40.266900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:40.266904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:40.266907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:40.266910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:40.266912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:40.266915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:40.266918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:40.266921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:40.266924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:40.266927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:40.266930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.266933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.266935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.266939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.266942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.266945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.266948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:40.266951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:40.266954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:40.266957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:40.266980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:40.272447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:40.273321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:40.273340Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:40.273342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:40.273346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:40.273353Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 908 [2:7555895275812731585:6316]
2025-09-30T14:52:40.273369Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:40.273389Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:40.273393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:40.273395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:40.273398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:40.273413Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:40.273419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:40.273427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:40.273488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.273497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.273499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.273502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:40.273505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:40.273718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 908
2025-09-30T14:52:40.273721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 908
2025-09-30T14:52:40.273938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:40.273950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.273965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.273977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.273996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:40.274015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895275902469365:7771], now have 1 active actors on pipe
2025-09-30T14:52:40.274023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895275902469002:2454], now have 1 active actors on pipe
2025-09-30T14:52:40.274038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:40.274047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:40.274066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895275812731580:6316]
2025-09-30T14:52:40.274072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895275812731580:6316]
2025-09-30T14:52:40.274075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895275812731580:6316]
2025-09-30T14:52:40.274088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:40.274104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:40.274103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:40.274106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:40.274109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:40.274124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:40.274128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:40.274144Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2cd674e-fb7f7993-9b1df911-faa24114_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:40.274152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:40.274155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:40.274157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:40.274167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:40.274177Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:40.274216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895275812731580:6316]
2025-09-30T14:52:40.274232Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:40.274238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:40.274259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:40.274454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:40.274465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:40.274479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:40.274561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 909 partition: 0 MaxSeqNo: 42 sessionId: src_id|2cd674e-fb7f7993-9b1df911-faa24114_0
2025-09-30T14:52:40.274898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1832eb6-95455932-4ada0827-2313e4e9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2cd674e-fb7f7993-9b1df911-faa24114_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:40.277531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cd674e-fb7f7993-9b1df911-faa24114_0] Write session: try to update token
2025-09-30T14:52:40.277549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cd674e-fb7f7993-9b1df911-faa24114_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:40.290878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 909 sessionId: src_id|2cd674e-fb7f7993-9b1df911-faa24114_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:40.293201Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:40.293225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:40.293238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895275812731580:6316]
2025-09-30T14:52:40.293291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:40.293293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:40.293519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:40.293537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:40.293672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:40.293827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:40.293976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:40.294298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:40.294358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:40.294372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:40.294390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:40.294433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:40.294517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:40.298672Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:40.298692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:40.298695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:40.298697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:40.298707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895275812731580:6316]
2025-09-30T14:52:40.298711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895275812731580:6316]
2025-09-30T14:52:40.298718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895275812731580:6316]
2025-09-30T14:52:40.298754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:40.298756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:40.298762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:40.298766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:40.298766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.298770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:40.298901Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:40.346857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895275902469376:7731]
2025-09-30T14:52:40.347139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 908, pipe: [1:7555895275902469376:7731]
2025-09-30T14:52:40.403194Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:40.410418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:40.410446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:40.410603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.410663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.410730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.410804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.410846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.410853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.410918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.410975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.411036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.411096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.411143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.411152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.411226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.411304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.411363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.411426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.411467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.411473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.411537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.411598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.411666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.411742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.411787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.411793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.411856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.411912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.411971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.412067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.412167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.412176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.412237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.412297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.412355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.412447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.412487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.412495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.412557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.412614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.412673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.412743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.412792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.412799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.412869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.412926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.412983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.413044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.413085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.413091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.413152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.413207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.413266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.413325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.413368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.413374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.413441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.413514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.413589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.413653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.413715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.413725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.413790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895275902469376:7731], now have 1 active actors on pipe
2025-09-30T14:52:40.414029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:40.414042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:40.414045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895275902469376:7731]
2025-09-30T14:52:40.414066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 909 reason: error at write: Disconnected sessionId: src_id|2cd674e-fb7f7993-9b1df911-faa24114_0
2025-09-30T14:52:40.414067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:40.414198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 909 sessionId: src_id|2cd674e-fb7f7993-9b1df911-faa24114_0 is DEAD
2025-09-30T14:52:40.414345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cd674e-fb7f7993-9b1df911-faa24114_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:40.414354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cd674e-fb7f7993-9b1df911-faa24114_0] Write session will restart in 0.009293s
2025-09-30T14:52:40.414371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cd674e-fb7f7993-9b1df911-faa24114_0] Write session: Do CDS request
2025-09-30T14:52:40.414375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cd674e-fb7f7993-9b1df911-faa24114_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:40.414786Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:40.424731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cd674e-fb7f7993-9b1df911-faa24114_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:40.424793Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:40.424811Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 910
2025-09-30T14:52:40.424924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 910 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:40.424956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 910 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:40.424965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=910 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:40.424969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:40.425356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 910 sessionId:  describe result for acl check
2025-09-30T14:52:40.425392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:40.425394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:40.425395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:40.425401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895275902469589:7775] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:40.425959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895275902469589:7775] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:40.428626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895275902469589:7775] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:40.430407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:40.430959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895275902469589:7775] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:40.430972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895275902469589:7775] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:40.430974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895275902469589:7775] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:40.430982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 910 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:40.432957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:40.433167Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:40.433180Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:40.433194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:40.433269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:40.433314Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895275812731826:6318]
2025-09-30T14:52:40.433928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:40.434253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:40.434306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:40.434582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:40.434645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:40.434654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:40.434656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:40.434657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:40.434658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:40.434659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:40.434661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:40.434662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:40.434663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:40.434664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:40.434665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.434666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.434667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.434669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:40.434670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:40.434675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:40.434685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:40.434688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:40.434692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:40.434696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:40.434700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:40.434705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:40.434709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:40.434713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:40.434718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:40.434721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.434725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.434728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.434731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:40.434735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:40.434743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:40.434750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:40.434757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:40.434762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:40.434766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:40.434771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:40.434775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:40.434780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:40.434785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:40.434789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:40.434793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:40.434797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:40.434801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:40.434806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:40.434810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:40.434815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:40.434819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:40.434823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:40.434827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:40.434833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:40.434847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.434852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.434856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.434865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.434869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.434873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.434882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:40.434886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:40.434895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:40.434899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:40.434944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:40.440332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:40.441550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:40.441563Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:40.441564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:40.441568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:40.441575Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 909 [2:7555895275812731826:6318]
2025-09-30T14:52:40.441591Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:40.441606Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:40.441609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:40.441612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:40.441614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:40.441631Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:40.441642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:40.441649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:40.441709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.441715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.441716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.441719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:40.441720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:40.441768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:40.441774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.441781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.441787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.441806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:40.441829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895275902469378:2454], now have 1 active actors on pipe
2025-09-30T14:52:40.441840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895275812731820:6318]
2025-09-30T14:52:40.441843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895275812731820:6318]
2025-09-30T14:52:40.441845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895275812731820:6318]
2025-09-30T14:52:40.441861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:40.441875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895275902469742:7775], now have 1 active actors on pipe
2025-09-30T14:52:40.441881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:40.441884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:40.441889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:40.441891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:40.441897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:40.441900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:40.441929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895275812731820:6318]
2025-09-30T14:52:40.441943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:40.441932Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 909
2025-09-30T14:52:40.441971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:40.442047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 909
2025-09-30T14:52:40.442089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:40.442100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:40.442121Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0cd0149-b98a4f6-204fb3fd-e37b0e82_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:40.442132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:40.442141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:40.442143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:40.442152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:40.442165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:40.442182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:40.442336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:40.442344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:40.442356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:40.442446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 910 partition: 0 MaxSeqNo: 42 sessionId: src_id|c0cd0149-b98a4f6-204fb3fd-e37b0e82_0
2025-09-30T14:52:40.442802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cd674e-fb7f7993-9b1df911-faa24114_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c0cd0149-b98a4f6-204fb3fd-e37b0e82_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:40.445488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0cd0149-b98a4f6-204fb3fd-e37b0e82_0] Write session: try to update token
2025-09-30T14:52:40.445506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0cd0149-b98a4f6-204fb3fd-e37b0e82_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:40.454072Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:40.454094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:40.454105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895275812731820:6318]
2025-09-30T14:52:40.454151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:40.454150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:40.454357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:40.454496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:40.454639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:40.454786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:40.454982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:40.455027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:40.459067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 910 sessionId: src_id|c0cd0149-b98a4f6-204fb3fd-e37b0e82_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:40.461765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:40.461972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:40.461994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:40.462030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:40.462129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:40.464643Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:40.464658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:40.464660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:40.464661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:40.464669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895275812731820:6318]
2025-09-30T14:52:40.464672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895275812731820:6318]
2025-09-30T14:52:40.464675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895275812731820:6318]
2025-09-30T14:52:40.464708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:40.464713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.464714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:40.464719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:40.464724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:40.464727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:40.464831Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:40.514261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895275902469755:7731]
2025-09-30T14:52:40.514508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 909, pipe: [1:7555895275902469755:7731]
2025-09-30T14:52:40.568648Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:40.576171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:40.576200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:40.576379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.576448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.576507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.576565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.577062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.577074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.577140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.577195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.577251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.577312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.577359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.577370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.577444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.577507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.577613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.577703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.577743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.577749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.577809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.577875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.577939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.578001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.578039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.578045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.578103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.578158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.578219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.578306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.578357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.578365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.578445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.578498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.578552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.578615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.578658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.578664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.578728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.578780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.578842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.578909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.579050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.579056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.579122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.579181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.579235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.579311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.579352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.579359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.579425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.579482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.579543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.579604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.579648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.579656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.579719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.579785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.579851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.579914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.579956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.579964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.580028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895275902469755:7731], now have 1 active actors on pipe
2025-09-30T14:52:40.580267Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:40.580333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:40.580342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:40.580369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 910 reason: error at write: Disconnected sessionId: src_id|c0cd0149-b98a4f6-204fb3fd-e37b0e82_0
2025-09-30T14:52:40.580372Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:40.580522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 910 sessionId: src_id|c0cd0149-b98a4f6-204fb3fd-e37b0e82_0 is DEAD
2025-09-30T14:52:40.580666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0cd0149-b98a4f6-204fb3fd-e37b0e82_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:40.580674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0cd0149-b98a4f6-204fb3fd-e37b0e82_0] Write session will restart in 0.005546s
2025-09-30T14:52:40.580698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0cd0149-b98a4f6-204fb3fd-e37b0e82_0] Write session: Do CDS request
2025-09-30T14:52:40.580680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895275902469755:7731]
2025-09-30T14:52:40.580712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0cd0149-b98a4f6-204fb3fd-e37b0e82_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:40.587781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0cd0149-b98a4f6-204fb3fd-e37b0e82_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:40.587812Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:40.587828Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 911
2025-09-30T14:52:40.587968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 911 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:40.587992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 911 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:40.587996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=911 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:40.588001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:40.588360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 911 sessionId:  describe result for acl check
2025-09-30T14:52:40.588391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:40.588394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:40.588396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:40.588402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895275902469823:7780] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:40.588932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895275902469823:7780] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:40.591407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895275902469823:7780] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:40.594217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895275902469823:7780] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:40.594232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895275902469823:7780] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:40.594235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895275902469823:7780] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:40.594251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 911 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:40.598895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:40.601412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:40.601587Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:40.601597Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:40.601606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:40.601654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:40.601692Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895275812732069:6321]
2025-09-30T14:52:40.602346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:40.602614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:40.602653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:40.602960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:40.603016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:40.603022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:40.603023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:40.603024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:40.603025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:40.603026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:40.603027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:40.603029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:40.603030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:40.603031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:40.603032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.603034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.603035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.603036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:40.603037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:40.603042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:40.603052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:40.603057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:40.603061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:40.603065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:40.603069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:40.603073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:40.603077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:40.603081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:40.603086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:40.603091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.603095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.603099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.603103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:40.603107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:40.603116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:40.603129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:40.603138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:40.603148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:40.603157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:40.603166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:40.603176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:40.603185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:40.603194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:40.603203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:40.603211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:40.603217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:40.603224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:40.603233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:40.603237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:40.603260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:40.603269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:40.603274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:40.603283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:40.603288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:40.603294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.603303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.603307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.603316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.603320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.603329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.603334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:40.603343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:40.603348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:40.603357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:40.603395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:40.608425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:40.609653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:40.609668Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:40.609670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:40.609673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:40.609677Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 910 [2:7555895275812732069:6321]
2025-09-30T14:52:40.609689Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:40.609699Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:40.609701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:40.609703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:40.609704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:40.609716Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:40.609721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:40.609726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:40.609773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.609776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.609778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.609782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:40.609783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:40.609842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:40.609849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.609859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.609870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.609892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:40.609914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895275902470018:7780], now have 1 active actors on pipe
2025-09-30T14:52:40.609922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895275902469757:2454], now have 1 active actors on pipe
2025-09-30T14:52:40.609928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895275812732064:6321]
2025-09-30T14:52:40.609929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895275812732064:6321]
2025-09-30T14:52:40.609930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895275812732064:6321]
2025-09-30T14:52:40.609940Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:40.609950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:40.609962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:40.609962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:40.609966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:40.609968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:40.609969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:40.609995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895275812732064:6321]
2025-09-30T14:52:40.610007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:40.610022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:40.610001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 910
2025-09-30T14:52:40.610169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 910
2025-09-30T14:52:40.610239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:40.610257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:40.610279Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca9f84d3-b2040e96-899d88de-9b26f142_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:40.610292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:40.610295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:40.610298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:40.610306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:40.610315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:40.610327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:40.610502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:40.610510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:40.610521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:40.610605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 911 partition: 0 MaxSeqNo: 42 sessionId: src_id|ca9f84d3-b2040e96-899d88de-9b26f142_0
2025-09-30T14:52:40.610908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0cd0149-b98a4f6-204fb3fd-e37b0e82_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ca9f84d3-b2040e96-899d88de-9b26f142_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:40.613447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca9f84d3-b2040e96-899d88de-9b26f142_0] Write session: try to update token
2025-09-30T14:52:40.613460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca9f84d3-b2040e96-899d88de-9b26f142_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:40.621465Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:40.621483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:40.621491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895275812732064:6321]
2025-09-30T14:52:40.621526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:40.621539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:40.621675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:40.621798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:40.621914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:40.622037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:40.622311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:40.622346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:40.626077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 911 sessionId: src_id|ca9f84d3-b2040e96-899d88de-9b26f142_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:40.628613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:40.628801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:40.628820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:40.628847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:40.628927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:40.631893Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:40.631905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:40.631906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:40.631907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:40.631914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895275812732064:6321]
2025-09-30T14:52:40.631917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895275812732064:6321]
2025-09-30T14:52:40.631918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895275812732064:6321]
2025-09-30T14:52:40.631947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:40.631955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.631957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:40.631958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:40.631963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:40.631970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:40.632082Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:40.680631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895275902470133:7731]
2025-09-30T14:52:40.680911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 910, pipe: [1:7555895275902470133:7731]
2025-09-30T14:52:40.733639Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:40.740497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:40.740522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:40.740667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.740725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.740780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.740836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.740876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.740887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.740945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.740999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.741059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.741115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.741159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.741167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.741224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.741281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.741339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.741396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.741435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.741441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.741506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.741599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.741655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.741710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.741748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.741753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.741813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.741870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.741925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.741979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.742025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.742033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.742106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.742163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.742222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.742290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.742331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.742336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.742399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.742453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.742513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.742570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.742613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.742619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.742677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.742730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.742783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.742837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.742877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.742883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.742937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.742993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.743050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.743108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.743148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.743154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.743223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.743304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.743359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.743415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.743452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.743458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.743498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895275902470133:7731], now have 1 active actors on pipe
2025-09-30T14:52:40.743759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:40.743766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895275902470133:7731]
2025-09-30T14:52:40.743773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:40.743785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:40.743797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 911 reason: error at write: Disconnected sessionId: src_id|ca9f84d3-b2040e96-899d88de-9b26f142_0
2025-09-30T14:52:40.743931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 911 sessionId: src_id|ca9f84d3-b2040e96-899d88de-9b26f142_0 is DEAD
2025-09-30T14:52:40.744117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca9f84d3-b2040e96-899d88de-9b26f142_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:40.744131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca9f84d3-b2040e96-899d88de-9b26f142_0] Write session will restart in 0.007016s
2025-09-30T14:52:40.744155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca9f84d3-b2040e96-899d88de-9b26f142_0] Write session: Do CDS request
2025-09-30T14:52:40.744162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca9f84d3-b2040e96-899d88de-9b26f142_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:40.744322Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:40.752761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca9f84d3-b2040e96-899d88de-9b26f142_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:40.752862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:40.752879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 912
2025-09-30T14:52:40.753067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 912 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:40.753093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 912 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:40.753100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=912 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:40.753103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:40.753457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 912 sessionId:  describe result for acl check
2025-09-30T14:52:40.753487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:40.753488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:40.753489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:40.753494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895275902470304:7784] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:40.753894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895275902470304:7784] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:40.756451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895275902470304:7784] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:40.759166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895275902470304:7784] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:40.759181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895275902470304:7784] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:40.759185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895275902470304:7784] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:40.759193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 912 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:40.759313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:40.759983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:40.760174Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:40.760186Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:40.760197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:40.760264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:40.760304Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895275812732311:6323]
2025-09-30T14:52:40.760940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:40.762215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:40.762299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:40.762650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:40.762710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:40.762717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:40.762718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:40.762719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:40.762721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:40.762722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:40.762723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:40.762724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:40.762725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:40.762726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:40.762727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.762728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.762730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.762731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:40.762732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:40.762737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:40.762748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:40.762752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:40.762772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:40.762784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:40.762792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:40.762797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:40.762811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:40.762815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:40.762819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:40.762823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.762826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.762830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.762836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:40.762840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:40.762847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:40.762861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:40.762866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:40.762872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:40.762878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:40.762888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:40.762892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:40.762897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:40.762902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:40.762907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:40.762913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:40.762923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:40.762928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:40.762937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:40.762946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:40.762951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:40.762955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:40.762960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:40.762966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:40.762971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:40.762981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.762987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.762996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.763001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.763005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.763015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.763018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:40.763027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:40.763032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:40.763038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:40.763085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:40.768449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:40.769201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:40.769216Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:40.769218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:40.769221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:40.769227Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 911 [2:7555895275812732311:6323]
2025-09-30T14:52:40.769239Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:40.769252Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:40.769254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:40.769257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:40.769258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:40.769271Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:40.769276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:40.769282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:40.769326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.769335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.769337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.769340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:40.769343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:40.769554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 911
2025-09-30T14:52:40.769567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 911
2025-09-30T14:52:40.769770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:40.769780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.769788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.769795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.769806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:40.769821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895275902470499:7784], now have 1 active actors on pipe
2025-09-30T14:52:40.769824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895275902470135:2454], now have 1 active actors on pipe
2025-09-30T14:52:40.769834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:40.769842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:40.769857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895275812732305:6323]
2025-09-30T14:52:40.769862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895275812732305:6323]
2025-09-30T14:52:40.769864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895275812732305:6323]
2025-09-30T14:52:40.769875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:40.769885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:40.769892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:40.769896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:40.769898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:40.769899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:40.769901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:40.769913Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfe7cd71-297281cc-6a6af807-80eb9da4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:40.769918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:40.769921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:40.769922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:40.769928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:40.769940Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:40.769970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895275812732305:6323]
2025-09-30T14:52:40.769979Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:40.769987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:40.769989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:40.770123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:40.770132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:40.770145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:40.770226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 912 partition: 0 MaxSeqNo: 42 sessionId: src_id|cfe7cd71-297281cc-6a6af807-80eb9da4_0
2025-09-30T14:52:40.770584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca9f84d3-b2040e96-899d88de-9b26f142_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cfe7cd71-297281cc-6a6af807-80eb9da4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:40.773290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe7cd71-297281cc-6a6af807-80eb9da4_0] Write session: try to update token
2025-09-30T14:52:40.773310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe7cd71-297281cc-6a6af807-80eb9da4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:40.781647Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:40.781665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:40.781674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895275812732305:6323]
2025-09-30T14:52:40.781718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:40.781719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:40.781886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:40.782030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:40.782179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:40.782341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:40.782547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:40.782594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:40.787345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 912 sessionId: src_id|cfe7cd71-297281cc-6a6af807-80eb9da4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:40.789986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:40.790169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:40.790186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:40.790215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:40.790302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:40.791839Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:40.791854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:40.791855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:40.791857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:40.791864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895275812732305:6323]
2025-09-30T14:52:40.791866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895275812732305:6323]
2025-09-30T14:52:40.791869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895275812732305:6323]
2025-09-30T14:52:40.791897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:40.791905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.791907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:40.791908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:40.791914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:40.791926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:40.792036Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:40.843966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895275902470512:7731]
2025-09-30T14:52:40.844220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 911, pipe: [1:7555895275902470512:7731]
2025-09-30T14:52:40.893646Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:40.900628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:40.900649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:40.900801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.900860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.900915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.900979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.901021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.901029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.901090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.901147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.901203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.901259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.901298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.901305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.901363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.901414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.901472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.901533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.901573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.901578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.901637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.901692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.901748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.901815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.901854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.901861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.901920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.901973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.902037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.902096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.902134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.902140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.902196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.902262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.902318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.902372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.902411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.902417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.902476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.902530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.902587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.902643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.902687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.902693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.902761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.902823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.902883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.902940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.902980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.902987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.903043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.903096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.903159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.903213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.903263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.903268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.903327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:40.903381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:40.903438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:40.903493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:40.903531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:40.903537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:40.903576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895275902470512:7731], now have 1 active actors on pipe
2025-09-30T14:52:40.903837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895275902470512:7731]
2025-09-30T14:52:40.903865Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:40.903886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:40.903890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:40.903915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 912 reason: error at write: Disconnected sessionId: src_id|cfe7cd71-297281cc-6a6af807-80eb9da4_0
2025-09-30T14:52:40.904083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 912 sessionId: src_id|cfe7cd71-297281cc-6a6af807-80eb9da4_0 is DEAD
2025-09-30T14:52:40.904238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe7cd71-297281cc-6a6af807-80eb9da4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:40.904250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe7cd71-297281cc-6a6af807-80eb9da4_0] Write session will restart in 0.006201s
2025-09-30T14:52:40.904272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe7cd71-297281cc-6a6af807-80eb9da4_0] Write session: Do CDS request
2025-09-30T14:52:40.904278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe7cd71-297281cc-6a6af807-80eb9da4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:40.904396Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:40.911741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe7cd71-297281cc-6a6af807-80eb9da4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:40.911823Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:40.911839Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 913
2025-09-30T14:52:40.912178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 913 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:40.912223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 913 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:40.912234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=913 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:40.912238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:40.912652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 913 sessionId:  describe result for acl check
2025-09-30T14:52:40.912690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:40.912698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:40.912700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:40.912706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895275902470571:7788] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:40.913238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895275902470571:7788] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:40.916000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895275902470571:7788] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:40.919010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895275902470571:7788] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:40.919027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895275902470571:7788] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:40.919030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895275902470571:7788] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:40.919038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 913 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:40.923919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:40.924362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:40.924517Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:40.924526Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:40.924536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:40.924584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:40.924624Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895275812732553:6325]
2025-09-30T14:52:40.925092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:40.925319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:40.925356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:40.925592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:40.925647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:40.925652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:40.925653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:40.925655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:40.925656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:40.925657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:40.925658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:40.925659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:40.925660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:40.925661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:40.925663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.925664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.925665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.925666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:40.925667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:40.925673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:40.925683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:40.925686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:40.925689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:40.925694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:40.925698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:40.925703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:40.925707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:40.925712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:40.925717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:40.925721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.925724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.925729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.925733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:40.925737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:40.925744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:40.925752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:40.925763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:40.925770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:40.925778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:40.925784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:40.925792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:40.925798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:40.925807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:40.925813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:40.925821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:40.925827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:40.925835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:40.925841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:40.925849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:40.925855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:40.925863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:40.925870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:40.925878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:40.925883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:40.925888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.925898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.925903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.925912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.925918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.925927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.925932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:40.925941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:40.925950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:40.925956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:40.926004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:40.930888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:40.932076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:40.932089Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:40.932092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:40.932095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:40.932102Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 912 [2:7555895275812732553:6325]
2025-09-30T14:52:40.932116Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:40.932131Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:40.932134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:40.932137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:40.932140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:40.932155Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:40.932166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:40.932174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:40.932233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.932240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.932243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.932246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:40.932249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:40.932324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:40.932332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.932344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:40.932357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:40.932380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:40.932397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895275902470514:2454], now have 1 active actors on pipe
2025-09-30T14:52:40.932401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895275902470874:7788], now have 1 active actors on pipe
2025-09-30T14:52:40.932406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895275812732548:6325]
2025-09-30T14:52:40.932409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895275812732548:6325]
2025-09-30T14:52:40.932411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895275812732548:6325]
2025-09-30T14:52:40.932423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:40.932435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:40.932437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:40.932443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:40.932445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:40.932454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:40.932457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:40.932460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 912
2025-09-30T14:52:40.932466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 912
2025-09-30T14:52:40.932483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895275812732548:6325]
2025-09-30T14:52:40.932492Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:40.932493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:40.932524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:40.932533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:40.932563Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f7a644a-5999fed-5b8f9427-5613d28a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:40.932574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:40.932582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:40.932585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:40.932594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:40.932606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:40.932629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:40.932761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:40.932769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:40.932782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:40.932886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 913 partition: 0 MaxSeqNo: 42 sessionId: src_id|1f7a644a-5999fed-5b8f9427-5613d28a_0
2025-09-30T14:52:40.933197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe7cd71-297281cc-6a6af807-80eb9da4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1f7a644a-5999fed-5b8f9427-5613d28a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:40.935800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f7a644a-5999fed-5b8f9427-5613d28a_0] Write session: try to update token
2025-09-30T14:52:40.935819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f7a644a-5999fed-5b8f9427-5613d28a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:40.943893Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:40.943910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:40.943912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:40.943913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:40.943921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895275812732548:6325]
2025-09-30T14:52:40.943924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895275812732548:6325]
2025-09-30T14:52:40.943927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895275812732548:6325]
2025-09-30T14:52:40.943958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:40.943963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:40.943965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:40.943967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:40.943970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:40.943974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:40.944094Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:40.949490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 913 sessionId: src_id|1f7a644a-5999fed-5b8f9427-5613d28a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:40.952260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:41.004199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895280197438199:7731]
2025-09-30T14:52:41.004452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 912, pipe: [1:7555895280197438199:7731]
2025-09-30T14:52:41.054098Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:41.054671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:41.054687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:41.054722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895280197438199:7731], now have 1 active actors on pipe
2025-09-30T14:52:41.054905Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:41.054972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895280197438199:7731]
2025-09-30T14:52:41.055007Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:41.055058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:41.055131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 913 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1f7a644a-5999fed-5b8f9427-5613d28a_0
2025-09-30T14:52:41.055312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 913 sessionId: src_id|1f7a644a-5999fed-5b8f9427-5613d28a_0 is DEAD
2025-09-30T14:52:41.055453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f7a644a-5999fed-5b8f9427-5613d28a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:41.055462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f7a644a-5999fed-5b8f9427-5613d28a_0] Write session will restart in 0.008328s
2025-09-30T14:52:41.055479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f7a644a-5999fed-5b8f9427-5613d28a_0] Write session: Do CDS request
2025-09-30T14:52:41.055484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f7a644a-5999fed-5b8f9427-5613d28a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:41.064695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f7a644a-5999fed-5b8f9427-5613d28a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:41.064788Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:41.064804Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 914
2025-09-30T14:52:41.064937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 914 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:41.064980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 914 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:41.064987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=914 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:41.064990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:41.065409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 914 sessionId:  describe result for acl check
2025-09-30T14:52:41.065441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:41.065449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:41.065451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:41.065457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895280197438387:7795] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:41.065959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895280197438387:7795] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:41.068217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895280197438387:7795] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:41.071021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895280197438387:7795] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:41.071037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895280197438387:7795] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:41.071040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895280197438387:7795] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:41.071048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 914 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:41.072989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:41.075712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:41.075880Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:41.075894Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:41.075902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:41.075938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:41.075976Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895280107700106:6328]
2025-09-30T14:52:41.076421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:41.076661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:41.076689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:41.076912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:41.076957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:41.076961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:41.076962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:41.076962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:41.076963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:41.076964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:41.076965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:41.076965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:41.076966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:41.076967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:41.076968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.076969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.076969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.076970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:41.076971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:41.076974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:41.076981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:41.076984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:41.076986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:41.076988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:41.076991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:41.076993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:41.076996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:41.076998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:41.077001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:41.077003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.077005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.077007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.077010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:41.077013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:41.077020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:41.077028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:41.077033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:41.077038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:41.077043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:41.077048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:41.077051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:41.077056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:41.077060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:41.077066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:41.077070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:41.077075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:41.077080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:41.077084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:41.077088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:41.077093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:41.077097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:41.077102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:41.077106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:41.077112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:41.077117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.077122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.077127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.077131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.077135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.077145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.077147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:41.077150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:41.077153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:41.077156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:41.077181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:41.082317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:41.083128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:41.083146Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:41.083149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:41.083154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:41.083160Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 913 [2:7555895280107700106:6328]
2025-09-30T14:52:41.083178Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:41.083195Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:41.083204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:41.083207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:41.083209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:41.083226Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:41.083238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:41.083275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:41.083344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.083352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.083354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.083357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:41.083360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:41.083424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:41.083432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.083445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.083463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.083485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:41.083510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895280197438204:2454], now have 1 active actors on pipe
2025-09-30T14:52:41.083518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895280197438581:7795], now have 1 active actors on pipe
2025-09-30T14:52:41.083525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895280107700101:6328]
2025-09-30T14:52:41.083532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895280107700101:6328]
2025-09-30T14:52:41.083534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895280107700101:6328]
2025-09-30T14:52:41.083544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:41.083554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:41.083514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 913
2025-09-30T14:52:41.083558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:41.083560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:41.083565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:41.083522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 913
2025-09-30T14:52:41.083580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:41.083584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:41.083605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:41.083616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:41.083652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895280107700101:6328]
2025-09-30T14:52:41.083666Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:41.083673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:41.083684Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bdbde56c-e6558ea8-7713932e-ec619e87_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:41.083696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:41.083700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:41.083702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:41.083712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:41.083726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:41.083770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:41.083908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:41.083915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:41.083928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:41.084021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 914 partition: 0 MaxSeqNo: 42 sessionId: src_id|bdbde56c-e6558ea8-7713932e-ec619e87_0
2025-09-30T14:52:41.084384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f7a644a-5999fed-5b8f9427-5613d28a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bdbde56c-e6558ea8-7713932e-ec619e87_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:41.087130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdbde56c-e6558ea8-7713932e-ec619e87_0] Write session: try to update token
2025-09-30T14:52:41.087154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdbde56c-e6558ea8-7713932e-ec619e87_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:41.095192Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:41.095211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:41.095213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:41.095216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:41.095226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895280107700101:6328]
2025-09-30T14:52:41.095229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895280107700101:6328]
2025-09-30T14:52:41.095234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895280107700101:6328]
2025-09-30T14:52:41.095286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:41.095288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:41.095294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.095297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:41.095300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:41.095304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:41.095429Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:41.101006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 914 sessionId: src_id|bdbde56c-e6558ea8-7713932e-ec619e87_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:41.103760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:41.155259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895280197438598:7731]
2025-09-30T14:52:41.155527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 913, pipe: [1:7555895280197438598:7731]
2025-09-30T14:52:41.204764Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:41.205450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:41.205463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:41.205493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895280197438598:7731], now have 1 active actors on pipe
2025-09-30T14:52:41.205720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:41.205763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895280197438598:7731]
2025-09-30T14:52:41.205776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:41.205782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:41.205831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 914 reason: error at write: Disconnected sessionId: src_id|bdbde56c-e6558ea8-7713932e-ec619e87_0
2025-09-30T14:52:41.205837Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:41.205974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 914 sessionId: src_id|bdbde56c-e6558ea8-7713932e-ec619e87_0 is DEAD
2025-09-30T14:52:41.206125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdbde56c-e6558ea8-7713932e-ec619e87_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:41.206136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdbde56c-e6558ea8-7713932e-ec619e87_0] Write session will restart in 0.005238s
2025-09-30T14:52:41.206156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdbde56c-e6558ea8-7713932e-ec619e87_0] Write session: Do CDS request
2025-09-30T14:52:41.206162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdbde56c-e6558ea8-7713932e-ec619e87_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:41.212820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdbde56c-e6558ea8-7713932e-ec619e87_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:41.212889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:41.212904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 915
2025-09-30T14:52:41.213032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 915 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:41.213073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 915 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:41.213085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=915 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:41.213089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:41.213495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 915 sessionId:  describe result for acl check
2025-09-30T14:52:41.213533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:41.213538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:41.213540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:41.213544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895280197438666:7805] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:41.214021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895280197438666:7805] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:41.216193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895280197438666:7805] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:41.219240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895280197438666:7805] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:41.219272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895280197438666:7805] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:41.219275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895280197438666:7805] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:41.219282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 915 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:41.223581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:41.226318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:41.226490Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:41.226502Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:41.226513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:41.226586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:41.226627Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895280107700382:6337]
2025-09-30T14:52:41.227224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:41.227574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:41.227608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:41.227834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:41.227875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:41.227879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:41.227880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:41.227881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:41.227882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:41.227882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:41.227883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:41.227884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:41.227885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:41.227885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:41.227886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.227887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.227887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.227888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:41.227888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:41.227892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:41.227898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:41.227900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:41.227903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:41.227905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:41.227907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:41.227910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:41.227912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:41.227914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:41.227917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:41.227919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.227921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.227924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.227926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:41.227928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:41.227933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:41.227938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:41.227941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:41.227945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:41.227948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:41.227951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:41.227954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:41.227958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:41.227961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:41.227964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:41.227966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:41.227969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:41.227972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:41.227975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:41.227977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:41.227980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:41.227982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:41.227985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:41.227987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:41.227990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:41.227993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.227996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.228001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.228007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.228011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.228015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.228019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:41.228023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:41.228036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:41.228046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:41.228086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:41.233207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:41.234213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:41.234229Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:41.234231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:41.234235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:41.234252Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 914 [2:7555895280107700382:6337]
2025-09-30T14:52:41.234266Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:41.234281Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:41.234289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:41.234292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:41.234294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:41.234309Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:41.234321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:41.234331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:41.234387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.234396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.234402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.234405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:41.234408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:41.234468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:41.234477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.234489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.234501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.234523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:41.234545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895280197438613:2454], now have 1 active actors on pipe
2025-09-30T14:52:41.234553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895280197438915:7805], now have 1 active actors on pipe
2025-09-30T14:52:41.234559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895280107700367:6337]
2025-09-30T14:52:41.234566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895280107700367:6337]
2025-09-30T14:52:41.234567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895280107700367:6337]
2025-09-30T14:52:41.234580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:41.234592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:41.234597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:41.234601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:41.234603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:41.234608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:41.234612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:41.234598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 914
2025-09-30T14:52:41.234637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895280107700367:6337]
2025-09-30T14:52:41.234602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 914
2025-09-30T14:52:41.234645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:41.234647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:41.234664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:41.234673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:41.234720Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e92a68a2-744f1b68-d30d7c7a-ab98b2ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:41.234735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:41.234738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:41.234740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:41.234749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:41.234758Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:41.234778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:41.234930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:41.234938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:41.234951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:41.235035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 915 partition: 0 MaxSeqNo: 42 sessionId: src_id|e92a68a2-744f1b68-d30d7c7a-ab98b2ba_0
2025-09-30T14:52:41.235382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdbde56c-e6558ea8-7713932e-ec619e87_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e92a68a2-744f1b68-d30d7c7a-ab98b2ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:41.237965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e92a68a2-744f1b68-d30d7c7a-ab98b2ba_0] Write session: try to update token
2025-09-30T14:52:41.237984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e92a68a2-744f1b68-d30d7c7a-ab98b2ba_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:41.247062Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:41.247089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:41.247096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:41.247100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:41.247111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895280107700367:6337]
2025-09-30T14:52:41.247119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895280107700367:6337]
2025-09-30T14:52:41.247124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895280107700367:6337]
2025-09-30T14:52:41.247176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:41.247179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:41.247185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:41.247189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:41.247195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.247198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:41.247424Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:41.252710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 915 sessionId: src_id|e92a68a2-744f1b68-d30d7c7a-ab98b2ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:41.255433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:41.305806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895280197439002:7731]
2025-09-30T14:52:41.306232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 914, pipe: [1:7555895280197439002:7731]
2025-09-30T14:52:41.350498Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:41.351075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:41.351093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:41.351134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895280197439002:7731], now have 1 active actors on pipe
2025-09-30T14:52:41.351369Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:41.351441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:41.351442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895280197439002:7731]
2025-09-30T14:52:41.351455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:41.351463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:41.351507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 915 reason: error at write: Disconnected sessionId: src_id|e92a68a2-744f1b68-d30d7c7a-ab98b2ba_0
2025-09-30T14:52:41.351643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 915 sessionId: src_id|e92a68a2-744f1b68-d30d7c7a-ab98b2ba_0 is DEAD
2025-09-30T14:52:41.351779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e92a68a2-744f1b68-d30d7c7a-ab98b2ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:41.351789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e92a68a2-744f1b68-d30d7c7a-ab98b2ba_0] Write session will restart in 0.007283s
2025-09-30T14:52:41.351805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e92a68a2-744f1b68-d30d7c7a-ab98b2ba_0] Write session: Do CDS request
2025-09-30T14:52:41.351809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e92a68a2-744f1b68-d30d7c7a-ab98b2ba_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:41.359752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e92a68a2-744f1b68-d30d7c7a-ab98b2ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:41.359781Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:41.359796Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 916
2025-09-30T14:52:41.359942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 916 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:41.359985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 916 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:41.359996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=916 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:41.359999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:41.360310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 916 sessionId:  describe result for acl check
2025-09-30T14:52:41.360350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:41.360356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:41.360358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:41.360362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895280197439092:7810] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:41.360788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895280197439092:7810] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:41.363119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895280197439092:7810] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:41.366259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895280197439092:7810] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:41.366274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895280197439092:7810] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:41.366277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895280197439092:7810] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:41.366284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 916 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:41.371141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:41.371675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:41.371841Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:41.371852Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:41.371861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:41.371914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:41.371952Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895280107700635:6345]
2025-09-30T14:52:41.372588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:41.372836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:41.372881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:41.373201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:41.373257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:41.373263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:41.373264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:41.373266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:41.373267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:41.373268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:41.373269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:41.373271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:41.373272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:41.373274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:41.373275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.373276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.373277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.373278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:41.373279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:41.373284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:41.373295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:41.373299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:41.373303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:41.373308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:41.373312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:41.373316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:41.373325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:41.373329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:41.373338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:41.373342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.373350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.373354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.373362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:41.373366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:41.373377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:41.373385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:41.373395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:41.373404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:41.373413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:41.373422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:41.373428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:41.373438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:41.373448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:41.373453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:41.373458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:41.373463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:41.373468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:41.373478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:41.373486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:41.373496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:41.373504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:41.373510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:41.373514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:41.373520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:41.373529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.373535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.373544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.373554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.373563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.373568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.373572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:41.373581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:41.373585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:41.373590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:41.373632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:41.378915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:41.379765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:41.379782Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:41.379785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:41.379788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:41.379794Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 915 [2:7555895280107700635:6345]
2025-09-30T14:52:41.379810Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:41.379824Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:41.379827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:41.379830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:41.379832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:41.379847Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:41.379864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:41.379871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:41.379930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.379940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.379942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.379945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:41.379949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:41.380019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:41.380029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.380042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.380058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.380081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:41.380103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895280197439372:7810], now have 1 active actors on pipe
2025-09-30T14:52:41.380111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895280197439003:2454], now have 1 active actors on pipe
2025-09-30T14:52:41.380118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895280107700630:6345]
2025-09-30T14:52:41.380125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895280107700630:6345]
2025-09-30T14:52:41.380128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895280107700630:6345]
2025-09-30T14:52:41.380141Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:41.380158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:41.380160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:41.380168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:41.380170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:41.380176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:41.380179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:41.380148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 915
2025-09-30T14:52:41.380174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 915
2025-09-30T14:52:41.380209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895280107700630:6345]
2025-09-30T14:52:41.380222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:41.380228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:41.380243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:41.380255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:41.380301Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f2afed6-a3135ab8-f787e617-b32d9e2a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:41.380313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:41.380317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:41.380319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:41.380329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:41.380338Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:41.380361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:41.380536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:41.380548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:41.380565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:41.380650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 916 partition: 0 MaxSeqNo: 42 sessionId: src_id|9f2afed6-a3135ab8-f787e617-b32d9e2a_0
2025-09-30T14:52:41.380960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e92a68a2-744f1b68-d30d7c7a-ab98b2ba_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9f2afed6-a3135ab8-f787e617-b32d9e2a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:41.383708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f2afed6-a3135ab8-f787e617-b32d9e2a_0] Write session: try to update token
2025-09-30T14:52:41.383726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f2afed6-a3135ab8-f787e617-b32d9e2a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:41.392253Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:41.392271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:41.392274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:41.392276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:41.392286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895280107700630:6345]
2025-09-30T14:52:41.392290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895280107700630:6345]
2025-09-30T14:52:41.392294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895280107700630:6345]
2025-09-30T14:52:41.392335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:41.392343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.392346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:41.392358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:41.392372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:41.392380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:41.392481Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:41.397465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 916 sessionId: src_id|9f2afed6-a3135ab8-f787e617-b32d9e2a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:41.400046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:41.451721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895280197439386:7731]
2025-09-30T14:52:41.452010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 915, pipe: [1:7555895280197439386:7731]
2025-09-30T14:52:41.500024Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:41.501008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:41.501024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:41.501056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895280197439386:7731], now have 1 active actors on pipe
2025-09-30T14:52:41.501202Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:41.501231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:41.501233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895280197439386:7731]
2025-09-30T14:52:41.501249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:41.501255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:41.501317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 916 reason: error at write: Disconnected sessionId: src_id|9f2afed6-a3135ab8-f787e617-b32d9e2a_0
2025-09-30T14:52:41.501478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 916 sessionId: src_id|9f2afed6-a3135ab8-f787e617-b32d9e2a_0 is DEAD
2025-09-30T14:52:41.501612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f2afed6-a3135ab8-f787e617-b32d9e2a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:41.501622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f2afed6-a3135ab8-f787e617-b32d9e2a_0] Write session will restart in 0.007648s
2025-09-30T14:52:41.501638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f2afed6-a3135ab8-f787e617-b32d9e2a_0] Write session: Do CDS request
2025-09-30T14:52:41.501644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f2afed6-a3135ab8-f787e617-b32d9e2a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:41.510729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f2afed6-a3135ab8-f787e617-b32d9e2a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:41.510781Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:41.510799Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 917
2025-09-30T14:52:41.510955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 917 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:41.510996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 917 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:41.511000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=917 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:41.511003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:41.511442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 917 sessionId:  describe result for acl check
2025-09-30T14:52:41.511482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:41.511489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:41.511491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:41.511498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895280197439548:7815] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:41.512022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895280197439548:7815] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:41.514188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895280197439548:7815] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:41.516426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895280197439548:7815] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:41.516442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895280197439548:7815] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:41.516446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895280197439548:7815] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:41.516454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 917 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:41.517995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:41.520850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:41.521065Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:41.521075Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:41.521086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:41.521142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:41.521185Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895280107700883:6347]
2025-09-30T14:52:41.521783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:41.522084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:41.522144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:41.522408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:41.522471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:41.522478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:41.522479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:41.522480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:41.522481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:41.522483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:41.522484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:41.522485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:41.522486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:41.522487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:41.522489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.522490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.522491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.522492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:41.522493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:41.522500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:41.522510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:41.522515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:41.522519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:41.522523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:41.522527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:41.522532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:41.522536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:41.522540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:41.522546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:41.522551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.522556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.522560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.522564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:41.522569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:41.522577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:41.522586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:41.522592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:41.522599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:41.522607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:41.522613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:41.522622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:41.522628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:41.522634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:41.522641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:41.522650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:41.522660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:41.522666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:41.522675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:41.522681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:41.522690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:41.522711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:41.522719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:41.522727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:41.522733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:41.522742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.522751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.522756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.522765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.522770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.522779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.522784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:41.522792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:41.522797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:41.522803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:41.522845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:41.528179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:41.529366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:41.529380Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:41.529382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:41.529385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:41.529390Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 916 [2:7555895280107700883:6347]
2025-09-30T14:52:41.529401Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:41.529422Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:41.529425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:41.529427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:41.529429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:41.529443Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:41.529449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:41.529457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:41.529501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.529508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.529510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.529512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:41.529514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:41.529565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:41.529571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.529579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.529585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.529594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:41.529613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895280107700878:6347]
2025-09-30T14:52:41.529620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895280107700878:6347]
2025-09-30T14:52:41.529622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895280107700878:6347]
2025-09-30T14:52:41.529635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:41.529643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:41.529646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:41.529650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:41.529652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895280197439390:2454], now have 1 active actors on pipe
2025-09-30T14:52:41.529656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895280197439757:7815], now have 1 active actors on pipe
2025-09-30T14:52:41.529663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:41.529682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:41.529689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:41.529720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895280107700878:6347]
2025-09-30T14:52:41.529727Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:41.529729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:41.529704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 916
2025-09-30T14:52:41.529718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 916
2025-09-30T14:52:41.529752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:41.529762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:41.529797Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9acd9d7e-ded043a8-9f1da9e2-10c1b439_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:41.529809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:41.529813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:41.529816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:41.529824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:41.529836Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:41.529857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:41.529987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:41.529996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:41.530009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:41.530095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 917 partition: 0 MaxSeqNo: 42 sessionId: src_id|9acd9d7e-ded043a8-9f1da9e2-10c1b439_0
2025-09-30T14:52:41.530369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f2afed6-a3135ab8-f787e617-b32d9e2a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9acd9d7e-ded043a8-9f1da9e2-10c1b439_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:41.532953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9acd9d7e-ded043a8-9f1da9e2-10c1b439_0] Write session: try to update token
2025-09-30T14:52:41.532968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9acd9d7e-ded043a8-9f1da9e2-10c1b439_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:41.541772Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:41.541793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:41.541797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:41.541799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:41.541808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895280107700878:6347]
2025-09-30T14:52:41.541813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895280107700878:6347]
2025-09-30T14:52:41.541817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895280107700878:6347]
2025-09-30T14:52:41.541853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:41.541855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:41.541860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:41.541863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.541863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:41.541865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:41.541999Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:41.547078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 917 sessionId: src_id|9acd9d7e-ded043a8-9f1da9e2-10c1b439_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:41.549655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:41.601202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895280197439776:7731]
2025-09-30T14:52:41.601504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 916, pipe: [1:7555895280197439776:7731]
2025-09-30T14:52:41.644349Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:41.644621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:41.644636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:41.644672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895280197439776:7731], now have 1 active actors on pipe
2025-09-30T14:52:41.644931Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:41.644952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:41.644889Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:41.644992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895280197439776:7731]
2025-09-30T14:52:41.645031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 917 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9acd9d7e-ded043a8-9f1da9e2-10c1b439_0
2025-09-30T14:52:41.645196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 917 sessionId: src_id|9acd9d7e-ded043a8-9f1da9e2-10c1b439_0 is DEAD
2025-09-30T14:52:41.645356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9acd9d7e-ded043a8-9f1da9e2-10c1b439_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:41.645367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9acd9d7e-ded043a8-9f1da9e2-10c1b439_0] Write session will restart in 0.006067s
2025-09-30T14:52:41.645390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9acd9d7e-ded043a8-9f1da9e2-10c1b439_0] Write session: Do CDS request
2025-09-30T14:52:41.645395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9acd9d7e-ded043a8-9f1da9e2-10c1b439_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:41.652736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9acd9d7e-ded043a8-9f1da9e2-10c1b439_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:41.652827Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:41.652848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 918
2025-09-30T14:52:41.652995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 918 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:41.653054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 918 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:41.653068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=918 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:41.653071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:41.653492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 918 sessionId:  describe result for acl check
2025-09-30T14:52:41.653528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:41.653535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:41.653537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:41.653543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895280197439810:7819] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:41.654093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895280197439810:7819] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:41.656416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895280197439810:7819] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:41.659295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895280197439810:7819] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:41.659312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895280197439810:7819] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:41.659316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895280197439810:7819] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:41.659324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 918 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:41.663975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:41.667118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:41.667315Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:41.667326Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:41.667336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:41.667391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:41.667491Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895280107701134:6350]
2025-09-30T14:52:41.668083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:41.668376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:41.668417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:41.668680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:41.668736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:41.668742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:41.668743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:41.668744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:41.668745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:41.668747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:41.668748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:41.668763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:41.668764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:41.668765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:41.668767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.668769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.668770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.668771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:41.668772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:41.668778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:41.668790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:41.668793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:41.668798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:41.668803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:41.668808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:41.668812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:41.668816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:41.668821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:41.668829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:41.668833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.668841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.668846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.668854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:41.668859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:41.668871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:41.668883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:41.668893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:41.668901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:41.668910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:41.668917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:41.668925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:41.668931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:41.668939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:41.668946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:41.668954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:41.668960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:41.668970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:41.668981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:41.668986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:41.668991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:41.668996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:41.669002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:41.669007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:41.669013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:41.669021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.669031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.669035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.669043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.669054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.669063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.669068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:41.669077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:41.669082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:41.669090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:41.669126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:41.674351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:41.675616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:41.675632Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:41.675634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:41.675638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:41.675644Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 917 [2:7555895280107701134:6350]
2025-09-30T14:52:41.675659Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:41.675674Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:41.675683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:41.675686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:41.675688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:41.675704Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:41.675710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:41.675717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:41.675770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.675778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.675780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.675783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:41.675786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:41.675851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:41.675862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.675873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.675884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.675899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:41.675915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895280107701129:6350]
2025-09-30T14:52:41.675918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895280107701129:6350]
2025-09-30T14:52:41.675920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895280107701129:6350]
2025-09-30T14:52:41.675929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:41.675938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:41.675942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895280197439777:2454], now have 1 active actors on pipe
2025-09-30T14:52:41.675948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895280197440032:7819], now have 1 active actors on pipe
2025-09-30T14:52:41.675949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:41.675951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:41.675953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:41.675967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:41.675970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:41.675996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895280107701129:6350]
2025-09-30T14:52:41.676009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:41.676021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:41.676013Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 917
2025-09-30T14:52:41.676028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 917
2025-09-30T14:52:41.676129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:41.676139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:41.676164Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3f69346-e82a73f-9d19cf7-83008e90_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:41.676175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:41.676182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:41.676184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:41.676196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:41.676209Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:41.676227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:41.676374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:41.676383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:41.676398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:41.676466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 918 partition: 0 MaxSeqNo: 42 sessionId: src_id|e3f69346-e82a73f-9d19cf7-83008e90_0
2025-09-30T14:52:41.676792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9acd9d7e-ded043a8-9f1da9e2-10c1b439_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e3f69346-e82a73f-9d19cf7-83008e90_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:41.679488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3f69346-e82a73f-9d19cf7-83008e90_0] Write session: try to update token
2025-09-30T14:52:41.679510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3f69346-e82a73f-9d19cf7-83008e90_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:41.688228Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:41.688250Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:41.688252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:41.688254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:41.688264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895280107701129:6350]
2025-09-30T14:52:41.688269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895280107701129:6350]
2025-09-30T14:52:41.688273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895280107701129:6350]
2025-09-30T14:52:41.688311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:41.688319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.688321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:41.688326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:41.688336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:41.688340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:41.688449Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:41.692968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 918 sessionId: src_id|e3f69346-e82a73f-9d19cf7-83008e90_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:41.695477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:41.745096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895280197440161:7731]
2025-09-30T14:52:41.745348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 917, pipe: [1:7555895280197440161:7731]
2025-09-30T14:52:41.791172Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:41.791691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:41.791721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:41.791768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895280197440161:7731], now have 1 active actors on pipe
2025-09-30T14:52:41.792031Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:41.792005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895280197440161:7731]
2025-09-30T14:52:41.792035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:41.792039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:41.792041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:41.792097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 918 reason: error at write: Disconnected sessionId: src_id|e3f69346-e82a73f-9d19cf7-83008e90_0
2025-09-30T14:52:41.792262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 918 sessionId: src_id|e3f69346-e82a73f-9d19cf7-83008e90_0 is DEAD
2025-09-30T14:52:41.792416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3f69346-e82a73f-9d19cf7-83008e90_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:41.792429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3f69346-e82a73f-9d19cf7-83008e90_0] Write session will restart in 0.009257s
2025-09-30T14:52:41.792452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3f69346-e82a73f-9d19cf7-83008e90_0] Write session: Do CDS request
2025-09-30T14:52:41.792461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3f69346-e82a73f-9d19cf7-83008e90_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:41.802707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3f69346-e82a73f-9d19cf7-83008e90_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:41.802772Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:41.802788Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 919
2025-09-30T14:52:41.802928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 919 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:41.802987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 919 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:41.802997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=919 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:41.803001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:41.803462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 919 sessionId:  describe result for acl check
2025-09-30T14:52:41.803494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:41.803500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:41.803502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:41.803507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895280197440416:7823] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:41.803966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895280197440416:7823] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:41.805790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895280197440416:7823] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:41.807423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:41.810332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:41.810406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895280197440416:7823] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:41.810425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895280197440416:7823] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:41.810429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895280197440416:7823] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:41.810439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 919 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:41.810858Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:41.810870Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:41.810882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:41.810943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:41.810976Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895280107701381:6352]
2025-09-30T14:52:41.811446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:41.811703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:41.811746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:41.811969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:41.812009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:41.812013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:41.812014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:41.812015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:41.812015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:41.812016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:41.812017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:41.812018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:41.812018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:41.812019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:41.812020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.812020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.812022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.812022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:41.812023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:41.812027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:41.812034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:41.812036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:41.812040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:41.812044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:41.812048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:41.812052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:41.812056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:41.812060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:41.812064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:41.812068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.812072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.812075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.812078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:41.812080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:41.812087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:41.812091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:41.812095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:41.812098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:41.812101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:41.812104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:41.812108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:41.812110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:41.812113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:41.812116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:41.812119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:41.812122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:41.812125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:41.812128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:41.812132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:41.812135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:41.812140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:41.812145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:41.812149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:41.812154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:41.812160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.812171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.812179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.812183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.812192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.812197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.812206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:41.812211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:41.812220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:41.812227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:41.812269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:41.817809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:41.818740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:41.818758Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:41.818761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:41.818765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:41.818772Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 918 [2:7555895280107701381:6352]
2025-09-30T14:52:41.818788Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:41.818808Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:41.818816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:41.818819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:41.818822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:41.818838Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:41.818845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:41.818852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:41.818920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.818928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.818931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.818934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:41.818936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:41.819001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:41.819009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.819022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.819036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.819055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:41.819080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895280197440162:2454], now have 1 active actors on pipe
2025-09-30T14:52:41.819087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895280197440535:7823], now have 1 active actors on pipe
2025-09-30T14:52:41.819094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895280107701376:6352]
2025-09-30T14:52:41.819100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895280107701376:6352]
2025-09-30T14:52:41.819103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895280107701376:6352]
2025-09-30T14:52:41.819117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:41.819135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:41.819137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:41.819150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:41.819153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:41.819156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:41.819158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:41.819149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 918
2025-09-30T14:52:41.819158Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 918
2025-09-30T14:52:41.819187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895280107701376:6352]
2025-09-30T14:52:41.819194Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:41.819196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:41.819210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:41.819219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:41.819295Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36c24ef3-909652aa-8086ad02-2188310f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:41.819308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:41.819313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:41.819316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:41.819325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:41.819339Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:41.819361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:41.819536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:41.819545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:41.819560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:41.819630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 919 partition: 0 MaxSeqNo: 42 sessionId: src_id|36c24ef3-909652aa-8086ad02-2188310f_0
2025-09-30T14:52:41.819970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3f69346-e82a73f-9d19cf7-83008e90_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|36c24ef3-909652aa-8086ad02-2188310f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:41.822619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36c24ef3-909652aa-8086ad02-2188310f_0] Write session: try to update token
2025-09-30T14:52:41.822637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36c24ef3-909652aa-8086ad02-2188310f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:41.831466Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:41.831489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:41.831491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:41.831493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:41.831502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895280107701376:6352]
2025-09-30T14:52:41.831507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895280107701376:6352]
2025-09-30T14:52:41.831512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895280107701376:6352]
2025-09-30T14:52:41.831550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:41.831558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.831558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:41.831561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:41.831565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:41.831569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:41.831708Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:41.836436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 919 sessionId: src_id|36c24ef3-909652aa-8086ad02-2188310f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:41.839093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:41.892034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895280197440547:7731]
2025-09-30T14:52:41.892267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 918, pipe: [1:7555895280197440547:7731]
2025-09-30T14:52:41.941255Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:41.941756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:41.941767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:41.941797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895280197440547:7731], now have 1 active actors on pipe
2025-09-30T14:52:41.942032Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:41.942059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895280197440547:7731]
2025-09-30T14:52:41.942076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:41.942078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:41.942137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 919 reason: error at write: Disconnected sessionId: src_id|36c24ef3-909652aa-8086ad02-2188310f_0
2025-09-30T14:52:41.942300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 919 sessionId: src_id|36c24ef3-909652aa-8086ad02-2188310f_0 is DEAD
2025-09-30T14:52:41.942322Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:41.942432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36c24ef3-909652aa-8086ad02-2188310f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:41.942441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36c24ef3-909652aa-8086ad02-2188310f_0] Write session will restart in 0.008322s
2025-09-30T14:52:41.942457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36c24ef3-909652aa-8086ad02-2188310f_0] Write session: Do CDS request
2025-09-30T14:52:41.942461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36c24ef3-909652aa-8086ad02-2188310f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:41.951709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36c24ef3-909652aa-8086ad02-2188310f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:41.951735Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:41.951753Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 920
2025-09-30T14:52:41.951937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 920 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:41.951975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 920 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:41.951983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=920 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:41.951986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:41.952310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 920 sessionId:  describe result for acl check
2025-09-30T14:52:41.952342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:41.952348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:41.952349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:41.952354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895280197440712:7827] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:41.952809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895280197440712:7827] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:41.954626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895280197440712:7827] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:41.957187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895280197440712:7827] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:41.957201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895280197440712:7827] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:41.957205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895280197440712:7827] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:41.957222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 920 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:41.961169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:41.961694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:41.961976Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:41.961986Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:41.961995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:41.962038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:41.962070Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895280107701633:6354]
2025-09-30T14:52:41.962525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:41.962827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:41.962884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:41.963213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:41.963304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:41.963311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:41.963312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:41.963314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:41.963315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:41.963316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:41.963317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:41.963318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:41.963320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:41.963321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:41.963322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.963323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.963325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.963326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:41.963327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:41.963333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:41.963343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:41.963348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:41.963352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:41.963356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:41.963360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:41.963364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:41.963368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:41.963372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:41.963377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:41.963381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.963385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.963389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.963393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:41.963397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:41.963404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:41.963417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:41.963424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:41.963434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:41.963443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:41.963448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:41.963453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:41.963458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:41.963463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:41.963468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:41.963471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:41.963474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:41.963476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:41.963479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:41.963482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:41.963485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:41.963487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:41.963490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:41.963492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:41.963496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:41.963499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.963501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.963504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.963506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.963509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.963512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.963514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:41.963519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:41.963524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:41.963534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:41.963568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:41.968742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:41.970011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:41.970024Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:41.970026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:41.970028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:41.970033Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 919 [2:7555895280107701633:6354]
2025-09-30T14:52:41.970043Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:41.970053Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:41.970055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:41.970057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:41.970059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:41.970073Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:41.970084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:41.970091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:41.970138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.970144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.970145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.970148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:41.970150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:41.970211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:41.970221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.970233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:41.970256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:41.970271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:41.970354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 919
2025-09-30T14:52:41.970361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 919
2025-09-30T14:52:41.970293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895280197440919:7827], now have 1 active actors on pipe
2025-09-30T14:52:41.970302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895280197440548:2454], now have 1 active actors on pipe
2025-09-30T14:52:41.970308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895280107701628:6354]
2025-09-30T14:52:41.970310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895280107701628:6354]
2025-09-30T14:52:41.970312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895280107701628:6354]
2025-09-30T14:52:41.970324Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:41.970338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:41.970342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:41.970346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:41.970347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:41.970351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:41.970353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:41.970387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895280107701628:6354]
2025-09-30T14:52:41.970389Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:41.970391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:41.970403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:41.970408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:41.970454Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90ec97fa-35e248a5-efa353e4-1ae48f8d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:41.970460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:41.970464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:41.970465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:41.970475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:41.970483Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:41.970504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:41.970664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:41.970672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:41.970683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:41.970759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 920 partition: 0 MaxSeqNo: 42 sessionId: src_id|90ec97fa-35e248a5-efa353e4-1ae48f8d_0
2025-09-30T14:52:41.971105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36c24ef3-909652aa-8086ad02-2188310f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|90ec97fa-35e248a5-efa353e4-1ae48f8d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:41.973734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90ec97fa-35e248a5-efa353e4-1ae48f8d_0] Write session: try to update token
2025-09-30T14:52:41.973749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90ec97fa-35e248a5-efa353e4-1ae48f8d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:41.981892Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:41.981912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:41.981914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:41.981916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:41.981925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895280107701628:6354]
2025-09-30T14:52:41.981929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895280107701628:6354]
2025-09-30T14:52:41.981934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895280107701628:6354]
2025-09-30T14:52:41.981972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:41.981982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:41.981985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:41.981986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:41.981996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:41.982000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:41.982121Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:41.986817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 920 sessionId: src_id|90ec97fa-35e248a5-efa353e4-1ae48f8d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:41.989246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:42.042042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895284492408237:7731]
2025-09-30T14:52:42.042304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 919, pipe: [1:7555895284492408237:7731]
2025-09-30T14:52:42.088014Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:42.088240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:42.088252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:42.088282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895284492408237:7731], now have 1 active actors on pipe
2025-09-30T14:52:42.088475Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:42.088516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895284492408237:7731]
2025-09-30T14:52:42.088526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:42.088531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:42.088549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:42.088592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 920 reason: error at write: Disconnected sessionId: src_id|90ec97fa-35e248a5-efa353e4-1ae48f8d_0
2025-09-30T14:52:42.088758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 920 sessionId: src_id|90ec97fa-35e248a5-efa353e4-1ae48f8d_0 is DEAD
2025-09-30T14:52:42.088896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90ec97fa-35e248a5-efa353e4-1ae48f8d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:42.088907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90ec97fa-35e248a5-efa353e4-1ae48f8d_0] Write session will restart in 0.008564s
2025-09-30T14:52:42.088931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90ec97fa-35e248a5-efa353e4-1ae48f8d_0] Write session: Do CDS request
2025-09-30T14:52:42.088939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90ec97fa-35e248a5-efa353e4-1ae48f8d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:42.098742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90ec97fa-35e248a5-efa353e4-1ae48f8d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:42.098859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:42.098876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 921
2025-09-30T14:52:42.099020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 921 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:42.099058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 921 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:42.099071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=921 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:42.099075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:42.099479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 921 sessionId:  describe result for acl check
2025-09-30T14:52:42.099521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:42.099525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:42.099527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:42.099532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895284492408414:7834] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:42.099995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895284492408414:7834] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:42.102046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895284492408414:7834] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:42.104859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895284492408414:7834] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:42.104871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895284492408414:7834] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:42.104873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895284492408414:7834] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:42.104878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 921 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:42.109586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:42.110133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:42.110314Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:42.110326Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:42.110337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:42.110386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:42.110425Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895284402669194:6357]
2025-09-30T14:52:42.110893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:42.111170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:42.111220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:42.111557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:42.111635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:42.111640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:42.111640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:42.111641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:42.111642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:42.111643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:42.111644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:42.111645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:42.111646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:42.111646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:42.111647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.111648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.111649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.111649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:42.111650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:42.111654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:42.111661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:42.111664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:42.111666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:42.111669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:42.111671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:42.111673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:42.111675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:42.111678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:42.111680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:42.111683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.111685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.111687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.111689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:42.111692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:42.111698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:42.111703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:42.111706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:42.111710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:42.111713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:42.111716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:42.111719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:42.111721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:42.111724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:42.111727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:42.111730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:42.111733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:42.111736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:42.111739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:42.111742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:42.111746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:42.111748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:42.111751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:42.111753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:42.111756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:42.111761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.111764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.111767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.111769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.111772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.111774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.111776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:42.111779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:42.111782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:42.111784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:42.111811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:42.117246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:42.118694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:42.118710Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:42.118714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:42.118718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:42.118723Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 920 [2:7555895284402669194:6357]
2025-09-30T14:52:42.118741Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:42.118755Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:42.118761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:42.118763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:42.118764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:42.118777Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:42.118789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:42.118796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:42.118852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.118859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.118861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.118864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:42.118867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:42.118930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:42.118939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.118950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.118968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.118988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:42.119010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895284492408253:2454], now have 1 active actors on pipe
2025-09-30T14:52:42.119019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895284492408625:7834], now have 1 active actors on pipe
2025-09-30T14:52:42.119026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895284402669189:6357]
2025-09-30T14:52:42.119028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895284402669189:6357]
2025-09-30T14:52:42.119029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895284402669189:6357]
2025-09-30T14:52:42.119044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:42.119057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:42.119070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:42.119070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:42.119073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:42.119073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:42.119076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:42.119050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 920
2025-09-30T14:52:42.119092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 920
2025-09-30T14:52:42.119110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895284402669189:6357]
2025-09-30T14:52:42.119119Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:42.119140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:42.119156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:42.119166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:42.119198Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ae6dce8-bbc4f226-71898c42-1bf5c76_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:42.119209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:42.119212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:42.119214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:42.119223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:42.119235Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:42.119274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:42.119432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:42.119441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:42.119453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:42.119551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 921 partition: 0 MaxSeqNo: 42 sessionId: src_id|3ae6dce8-bbc4f226-71898c42-1bf5c76_0
2025-09-30T14:52:42.119887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90ec97fa-35e248a5-efa353e4-1ae48f8d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3ae6dce8-bbc4f226-71898c42-1bf5c76_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:42.122774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ae6dce8-bbc4f226-71898c42-1bf5c76_0] Write session: try to update token
2025-09-30T14:52:42.122792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ae6dce8-bbc4f226-71898c42-1bf5c76_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:42.130858Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:42.130878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:42.130881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:42.130883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:42.130892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895284402669189:6357]
2025-09-30T14:52:42.130896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895284402669189:6357]
2025-09-30T14:52:42.130900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895284402669189:6357]
2025-09-30T14:52:42.130935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:42.130941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.130943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:42.130944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:42.130948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:42.130952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:42.131072Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:42.136774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 921 sessionId: src_id|3ae6dce8-bbc4f226-71898c42-1bf5c76_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:42.139384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:42.188463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895284492408639:7731]
2025-09-30T14:52:42.188754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 920, pipe: [1:7555895284492408639:7731]
2025-09-30T14:52:42.236370Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:42.236636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:42.236653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:42.236689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895284492408639:7731], now have 1 active actors on pipe
2025-09-30T14:52:42.236915Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:42.236982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895284492408639:7731]
2025-09-30T14:52:42.236998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:42.237007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:42.237060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 921 reason: error at write: Disconnected sessionId: src_id|3ae6dce8-bbc4f226-71898c42-1bf5c76_0
2025-09-30T14:52:42.237235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 921 sessionId: src_id|3ae6dce8-bbc4f226-71898c42-1bf5c76_0 is DEAD
2025-09-30T14:52:42.237410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ae6dce8-bbc4f226-71898c42-1bf5c76_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:42.237422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ae6dce8-bbc4f226-71898c42-1bf5c76_0] Write session will restart in 0.005568s
2025-09-30T14:52:42.237399Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:42.237446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ae6dce8-bbc4f226-71898c42-1bf5c76_0] Write session: Do CDS request
2025-09-30T14:52:42.237455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ae6dce8-bbc4f226-71898c42-1bf5c76_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:42.243724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ae6dce8-bbc4f226-71898c42-1bf5c76_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:42.243792Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:42.243807Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 922
2025-09-30T14:52:42.243944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 922 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:42.243980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 922 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:42.243984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=922 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:42.243988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:42.244344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 922 sessionId:  describe result for acl check
2025-09-30T14:52:42.244375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:42.244377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:42.244379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:42.244384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895284492408701:7844] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:42.244864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895284492408701:7844] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:42.247023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895284492408701:7844] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:42.250306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895284492408701:7844] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:42.250324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895284492408701:7844] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:42.250329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895284492408701:7844] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:42.250336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 922 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:42.254647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:42.257866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:42.258128Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:42.258143Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:42.258156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:42.258218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:42.258262Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895284402669459:6366]
2025-09-30T14:52:42.258770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:42.259146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:42.259224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:42.259584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:42.259685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:42.259694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:42.259695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:42.259696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:42.259697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:42.259698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:42.259700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:42.259701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:42.259703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:42.259704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:42.259705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.259706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.259707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.259708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:42.259709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:42.259716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:42.259726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:42.259731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:42.259735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:42.259739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:42.259743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:42.259747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:42.259751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:42.259756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:42.259762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:42.259766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.259770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.259774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.259778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:42.259782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:42.259791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:42.259800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:42.259805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:42.259808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:42.259811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:42.259814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:42.259817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:42.259820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:42.259824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:42.259827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:42.259830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:42.259833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:42.259835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:42.259849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:42.259851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:42.259855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:42.259858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:42.259861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:42.259863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:42.259867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:42.259870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.259873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.259876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.259879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.259882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.259885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.259887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:42.259891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:42.259894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:42.259897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:42.259941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:42.266106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:42.266957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:42.266975Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:42.266977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:42.266981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:42.266988Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 921 [2:7555895284402669459:6366]
2025-09-30T14:52:42.267003Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:42.267019Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:42.267022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:42.267025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:42.267028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:42.267044Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:42.267052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:42.267065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:42.267127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.267133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.267136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.267139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:42.267141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:42.267193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:42.267199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.267207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.267214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.267227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:42.267263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895284492408959:7844], now have 1 active actors on pipe
2025-09-30T14:52:42.267276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895284492408654:2454], now have 1 active actors on pipe
2025-09-30T14:52:42.267282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895284402669454:6366]
2025-09-30T14:52:42.267284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895284402669454:6366]
2025-09-30T14:52:42.267286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895284402669454:6366]
2025-09-30T14:52:42.267300Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:42.267313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:42.267316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:42.267319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:42.267321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:42.267333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:42.267336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:42.267370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895284402669454:6366]
2025-09-30T14:52:42.267373Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:42.267359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 921
2025-09-30T14:52:42.267385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:42.267403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:42.267410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:42.267431Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5fbbc7fe-cacc7540-b208c307-2b70e821_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:42.267440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:42.267443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:42.267444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:42.267470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 921
2025-09-30T14:52:42.267451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:42.267462Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:42.267472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:42.268035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:42.268048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:42.268068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:42.268166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 922 partition: 0 MaxSeqNo: 42 sessionId: src_id|5fbbc7fe-cacc7540-b208c307-2b70e821_0
2025-09-30T14:52:42.268512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ae6dce8-bbc4f226-71898c42-1bf5c76_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5fbbc7fe-cacc7540-b208c307-2b70e821_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:42.271395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fbbc7fe-cacc7540-b208c307-2b70e821_0] Write session: try to update token
2025-09-30T14:52:42.271416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fbbc7fe-cacc7540-b208c307-2b70e821_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:42.279354Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:42.279376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:42.279379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:42.279381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:42.279391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895284402669454:6366]
2025-09-30T14:52:42.279396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895284402669454:6366]
2025-09-30T14:52:42.279400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895284402669454:6366]
2025-09-30T14:52:42.279442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:42.279448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.279452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:42.279468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:42.279485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:42.279490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:42.279588Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:42.286190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 922 sessionId: src_id|5fbbc7fe-cacc7540-b208c307-2b70e821_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:42.288989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:42.336961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895284492409050:7731]
2025-09-30T14:52:42.337253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 921, pipe: [1:7555895284492409050:7731]
2025-09-30T14:52:42.383673Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:42.384149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:42.384162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:42.384178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895284492409050:7731], now have 1 active actors on pipe
2025-09-30T14:52:42.384342Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:42.384433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:42.384449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895284492409050:7731]
2025-09-30T14:52:42.384457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:42.384466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:42.384533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 922 reason: error at write: Disconnected sessionId: src_id|5fbbc7fe-cacc7540-b208c307-2b70e821_0
2025-09-30T14:52:42.384714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 922 sessionId: src_id|5fbbc7fe-cacc7540-b208c307-2b70e821_0 is DEAD
2025-09-30T14:52:42.384835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fbbc7fe-cacc7540-b208c307-2b70e821_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:42.384841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fbbc7fe-cacc7540-b208c307-2b70e821_0] Write session will restart in 0.008120s
2025-09-30T14:52:42.384858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fbbc7fe-cacc7540-b208c307-2b70e821_0] Write session: Do CDS request
2025-09-30T14:52:42.384862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fbbc7fe-cacc7540-b208c307-2b70e821_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:42.393739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fbbc7fe-cacc7540-b208c307-2b70e821_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:42.393822Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:42.393837Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 923
2025-09-30T14:52:42.393946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 923 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:42.393970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 923 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:42.393984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=923 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:42.393988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:42.394444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 923 sessionId:  describe result for acl check
2025-09-30T14:52:42.394478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:42.394485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:42.394487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:42.394493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895284492409219:7849] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:42.395030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895284492409219:7849] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:42.397399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895284492409219:7849] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:42.400095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895284492409219:7849] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:42.400111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895284492409219:7849] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:42.400114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895284492409219:7849] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:42.400121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 923 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:42.401040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:42.403891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:42.404324Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:42.404334Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:42.404344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:42.404396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:42.404425Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895284402669734:6374]
2025-09-30T14:52:42.404869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:42.405149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:42.405198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:42.405453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:42.405501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:42.405508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:42.405509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:42.405510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:42.405512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:42.405512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:42.405513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:42.405514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:42.405516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:42.405517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:42.405518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.405519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.405520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.405520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:42.405521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:42.405527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:42.405537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:42.405541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:42.405544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:42.405547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:42.405549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:42.405551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:42.405554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:42.405556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:42.405558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:42.405561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.405563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.405565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.405567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:42.405570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:42.405577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:42.405582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:42.405586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:42.405589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:42.405592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:42.405595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:42.405597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:42.405600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:42.405603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:42.405606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:42.405609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:42.405612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:42.405614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:42.405617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:42.405620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:42.405623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:42.405627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:42.405629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:42.405632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:42.405635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:42.405638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.405641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.405644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.405646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.405649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.405651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.405654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:42.405657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:42.405659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:42.405662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:42.405685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:42.410770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:42.411606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:42.411620Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:42.411623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:42.411626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:42.411632Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 922 [2:7555895284402669734:6374]
2025-09-30T14:52:42.411645Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:42.411660Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:42.411666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:42.411668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:42.411670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:42.411691Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:42.411696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:42.411701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:42.411743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.411749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.411751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.411753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:42.411755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:42.411808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:42.411813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.411822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.411828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.411838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:42.411855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895284402669729:6374]
2025-09-30T14:52:42.411863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895284402669729:6374]
2025-09-30T14:52:42.411865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895284402669729:6374]
2025-09-30T14:52:42.411874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:42.411884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:42.411888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:42.411889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895284492409052:2454], now have 1 active actors on pipe
2025-09-30T14:52:42.411890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:42.411892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895284492409427:7849], now have 1 active actors on pipe
2025-09-30T14:52:42.411896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:42.411906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:42.411908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:42.411934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895284402669729:6374]
2025-09-30T14:52:42.411945Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:42.411977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:42.411983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 922
2025-09-30T14:52:42.411983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 922
2025-09-30T14:52:42.412056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:42.412068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:42.412091Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1469d854-e9635af3-9fc28aba-d237dd0b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:42.412101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:42.412104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:42.412106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:42.412114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:42.412143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:42.412164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:42.412336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:42.412350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:42.412381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:42.412451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 923 partition: 0 MaxSeqNo: 42 sessionId: src_id|1469d854-e9635af3-9fc28aba-d237dd0b_0
2025-09-30T14:52:42.412774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fbbc7fe-cacc7540-b208c307-2b70e821_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1469d854-e9635af3-9fc28aba-d237dd0b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:42.415538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1469d854-e9635af3-9fc28aba-d237dd0b_0] Write session: try to update token
2025-09-30T14:52:42.415555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1469d854-e9635af3-9fc28aba-d237dd0b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:42.424044Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:42.424066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:42.424068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:42.424070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:42.424079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895284402669729:6374]
2025-09-30T14:52:42.424087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895284402669729:6374]
2025-09-30T14:52:42.424091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895284402669729:6374]
2025-09-30T14:52:42.424131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:42.424137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.424140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:42.424139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:42.424145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:42.424149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:42.424295Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:42.429605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 923 sessionId: src_id|1469d854-e9635af3-9fc28aba-d237dd0b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:42.432166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:42.484418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895284492409440:7731]
2025-09-30T14:52:42.484688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 922, pipe: [1:7555895284492409440:7731]
2025-09-30T14:52:42.528673Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:42.529224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:42.529237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:42.529268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895284492409440:7731], now have 1 active actors on pipe
2025-09-30T14:52:42.529446Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:42.529506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:42.529554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:42.529616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 923 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1469d854-e9635af3-9fc28aba-d237dd0b_0
2025-09-30T14:52:42.529734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895284492409440:7731]
2025-09-30T14:52:42.529761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 923 sessionId: src_id|1469d854-e9635af3-9fc28aba-d237dd0b_0 is DEAD
2025-09-30T14:52:42.529884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1469d854-e9635af3-9fc28aba-d237dd0b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:42.529892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1469d854-e9635af3-9fc28aba-d237dd0b_0] Write session will restart in 0.006720s
2025-09-30T14:52:42.529914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1469d854-e9635af3-9fc28aba-d237dd0b_0] Write session: Do CDS request
2025-09-30T14:52:42.529920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1469d854-e9635af3-9fc28aba-d237dd0b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:42.537784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1469d854-e9635af3-9fc28aba-d237dd0b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:42.537852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:42.537870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 924
2025-09-30T14:52:42.538020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 924 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:42.538051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 924 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:42.538060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=924 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:42.538065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:42.538583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 924 sessionId:  describe result for acl check
2025-09-30T14:52:42.538622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:42.538628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:42.538635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:42.538640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895284492409495:7854] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:42.539191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895284492409495:7854] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:42.541014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895284492409495:7854] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:42.543507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895284492409495:7854] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:42.543525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895284492409495:7854] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:42.543528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895284492409495:7854] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:42.543537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 924 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:42.549076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:42.551853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:42.552241Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:42.552254Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:42.552264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:42.552329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:42.552363Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895284402669988:6376]
2025-09-30T14:52:42.552976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:42.553310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:42.553363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:42.553701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:42.553773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:42.553780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:42.553781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:42.553782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:42.553784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:42.553785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:42.553786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:42.553787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:42.553788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:42.553789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:42.553790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.553792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.553793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.553794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:42.553795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:42.553801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:42.553811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:42.553815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:42.553819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:42.553823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:42.553827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:42.553830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:42.553834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:42.553838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:42.553842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:42.553846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.553850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.553853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.553857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:42.553861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:42.553869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:42.553876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:42.553883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:42.553889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:42.553895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:42.553901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:42.553906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:42.553912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:42.553918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:42.553924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:42.553929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:42.553934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:42.553939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:42.553946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:42.553951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:42.553963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:42.553970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:42.553976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:42.553981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:42.553986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:42.553991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.553997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.554002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.554007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.554012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.554019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.554030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:42.554036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:42.554045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:42.554051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:42.554094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:42.559774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:42.560642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:42.560661Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:42.560664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:42.560668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:42.560675Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 923 [2:7555895284402669988:6376]
2025-09-30T14:52:42.560693Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:42.560707Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:42.560710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:42.560713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:42.560715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:42.560730Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:42.560737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:42.560744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:42.560802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.560810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.560812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.560816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:42.560819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:42.560883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:42.560890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.560902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.560915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.560936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:42.560958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895284492409444:2454], now have 1 active actors on pipe
2025-09-30T14:52:42.560970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895284492409717:7854], now have 1 active actors on pipe
2025-09-30T14:52:42.560976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895284402669983:6376]
2025-09-30T14:52:42.560979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895284402669983:6376]
2025-09-30T14:52:42.560982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895284402669983:6376]
2025-09-30T14:52:42.560993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:42.561004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:42.561006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:42.561016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:42.561022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:42.561022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:42.561025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:42.561001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 923
2025-09-30T14:52:42.561043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 923
2025-09-30T14:52:42.561063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895284402669983:6376]
2025-09-30T14:52:42.561072Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:42.561073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:42.561095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:42.561105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:42.561141Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f1c5a66-a452c8e2-9244b1e8-ffab7cf4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:42.561153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:42.561157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:42.561159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:42.561169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:42.561182Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:42.561202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:42.561339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:42.561347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:42.561361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:42.561489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 924 partition: 0 MaxSeqNo: 42 sessionId: src_id|2f1c5a66-a452c8e2-9244b1e8-ffab7cf4_0
2025-09-30T14:52:42.561842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1469d854-e9635af3-9fc28aba-d237dd0b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2f1c5a66-a452c8e2-9244b1e8-ffab7cf4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:42.564610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1c5a66-a452c8e2-9244b1e8-ffab7cf4_0] Write session: try to update token
2025-09-30T14:52:42.564628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1c5a66-a452c8e2-9244b1e8-ffab7cf4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:42.573069Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:42.573088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:42.573090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:42.573092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:42.573101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895284402669983:6376]
2025-09-30T14:52:42.573105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895284402669983:6376]
2025-09-30T14:52:42.573110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895284402669983:6376]
2025-09-30T14:52:42.573147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:42.573158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.573161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:42.573161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:42.573167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:42.573172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:42.573301Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:42.577572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 924 sessionId: src_id|2f1c5a66-a452c8e2-9244b1e8-ffab7cf4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:42.580025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:42.629806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895284492409833:7731]
2025-09-30T14:52:42.630122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 923, pipe: [1:7555895284492409833:7731]
2025-09-30T14:52:42.681716Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:42.682347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:42.682362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:42.682409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895284492409833:7731], now have 1 active actors on pipe
2025-09-30T14:52:42.682592Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:42.682641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:42.682673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895284492409833:7731]
2025-09-30T14:52:42.682706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:42.682789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 924 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2f1c5a66-a452c8e2-9244b1e8-ffab7cf4_0
2025-09-30T14:52:42.682944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 924 sessionId: src_id|2f1c5a66-a452c8e2-9244b1e8-ffab7cf4_0 is DEAD
2025-09-30T14:52:42.683099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1c5a66-a452c8e2-9244b1e8-ffab7cf4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:42.683108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1c5a66-a452c8e2-9244b1e8-ffab7cf4_0] Write session will restart in 0.007185s
2025-09-30T14:52:42.683125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1c5a66-a452c8e2-9244b1e8-ffab7cf4_0] Write session: Do CDS request
2025-09-30T14:52:42.683129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1c5a66-a452c8e2-9244b1e8-ffab7cf4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:42.691719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1c5a66-a452c8e2-9244b1e8-ffab7cf4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:42.691756Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:42.691770Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 925
2025-09-30T14:52:42.691949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 925 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:42.691997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 925 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:42.692008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=925 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:42.692012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:42.692441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 925 sessionId:  describe result for acl check
2025-09-30T14:52:42.692478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:42.692485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:42.692487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:42.692492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895284492409944:7858] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:42.693015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895284492409944:7858] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:42.695471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895284492409944:7858] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:42.698267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895284492409944:7858] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:42.698283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895284492409944:7858] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:42.698287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895284492409944:7858] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:42.698294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 925 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:42.700890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:42.703566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:42.703751Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:42.703763Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:42.703773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:42.703819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:42.703866Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895284402670245:6379]
2025-09-30T14:52:42.704516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:42.704797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:42.704844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:42.705159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:42.705237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:42.705244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:42.705246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:42.705247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:42.705248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:42.705249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:42.705251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:42.705252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:42.705253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:42.705254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:42.705255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.705256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.705258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.705259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:42.705260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:42.705266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:42.705276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:42.705280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:42.705284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:42.705288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:42.705291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:42.705295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:42.705299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:42.705303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:42.705308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:42.705311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.705315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.705320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.705324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:42.705328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:42.705338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:42.705346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:42.705352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:42.705358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:42.705363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:42.705368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:42.705379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:42.705384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:42.705388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:42.705394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:42.705399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:42.705404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:42.705409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:42.705414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:42.705419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:42.705426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:42.705431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:42.705442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:42.705447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:42.705452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:42.705463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.705468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.705477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.705482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.705490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.705496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.705500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:42.705516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:42.705521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:42.705526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:42.705565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:42.710982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:42.712434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:42.712449Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:42.712451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:42.712454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:42.712459Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 924 [2:7555895284402670245:6379]
2025-09-30T14:52:42.712473Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:42.712488Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:42.712492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:42.712495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:42.712496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:42.712507Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:42.712511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:42.712521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:42.712576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.712583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.712585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.712588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:42.712590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:42.712652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:42.712660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.712672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.712688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.712710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:42.712738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895284492410197:7858], now have 1 active actors on pipe
2025-09-30T14:52:42.712741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895284492409834:2454], now have 1 active actors on pipe
2025-09-30T14:52:42.712748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895284402670240:6379]
2025-09-30T14:52:42.712750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895284402670240:6379]
2025-09-30T14:52:42.712752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895284402670240:6379]
2025-09-30T14:52:42.712767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:42.712779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:42.712788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:42.712794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:42.712796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:42.712798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:42.712801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:42.712818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895284402670240:6379]
2025-09-30T14:52:42.712824Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:42.712827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:42.712819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 924
2025-09-30T14:52:42.712822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 924
2025-09-30T14:52:42.712868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:42.712876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:42.712898Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a26cd82-1a3255f2-132e73e6-ff9ea3d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:42.712907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:42.712909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:42.712911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:42.712919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:42.712928Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:42.712945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:42.713094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:42.713102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:42.713112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:42.713187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 925 partition: 0 MaxSeqNo: 42 sessionId: src_id|1a26cd82-1a3255f2-132e73e6-ff9ea3d6_0
2025-09-30T14:52:42.713536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1c5a66-a452c8e2-9244b1e8-ffab7cf4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1a26cd82-1a3255f2-132e73e6-ff9ea3d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:42.716201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a26cd82-1a3255f2-132e73e6-ff9ea3d6_0] Write session: try to update token
2025-09-30T14:52:42.716220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a26cd82-1a3255f2-132e73e6-ff9ea3d6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:42.729996Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:42.730017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:42.730025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895284402670240:6379]
2025-09-30T14:52:42.730066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:42.730080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:42.730078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 925 sessionId: src_id|1a26cd82-1a3255f2-132e73e6-ff9ea3d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:42.730282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:42.730429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:42.730576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:42.730722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:42.730927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:42.730971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:42.732823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:42.733020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:42.733045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:42.733081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:42.733173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:42.735276Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:42.735289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:42.735292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:42.735294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:42.735302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895284402670240:6379]
2025-09-30T14:52:42.735307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895284402670240:6379]
2025-09-30T14:52:42.735310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895284402670240:6379]
2025-09-30T14:52:42.735346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:42.735346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:42.735354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:42.735357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:42.735358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.735361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:42.735484Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:42.782922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895284492410225:7731]
2025-09-30T14:52:42.783204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 924, pipe: [1:7555895284492410225:7731]
2025-09-30T14:52:42.841387Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:42.849981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:42.850009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:42.850165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:42.850231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:42.850313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:42.850381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:42.850668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:42.850685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:42.850756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:42.850814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:42.850871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:42.850933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:42.850974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:42.850980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:42.851040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:42.851101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:42.851166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:42.851232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:42.851295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:42.851303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:42.851373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:42.851444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:42.851511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:42.851580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:42.851627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:42.851636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:42.851703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:42.851772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:42.851838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:42.851905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:42.851949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:42.851956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:42.852025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:42.852087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:42.852149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:42.852214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:42.852258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:42.852267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:42.852334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:42.852401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:42.852470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:42.852535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:42.852581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:42.852592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:42.852662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:42.852727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:42.852791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:42.852851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:42.852892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:42.852894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:42.852955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:42.853014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:42.853067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:42.853130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:42.853177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:42.853184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:42.853253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:42.853310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:42.853383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:42.853456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:42.853503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:42.853512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:42.853584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895284492410225:7731], now have 1 active actors on pipe
2025-09-30T14:52:42.853863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:42.853876Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:42.853880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:42.853911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 925 reason: error at write: Disconnected sessionId: src_id|1a26cd82-1a3255f2-132e73e6-ff9ea3d6_0
2025-09-30T14:52:42.853928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895284492410225:7731]
2025-09-30T14:52:42.854069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 925 sessionId: src_id|1a26cd82-1a3255f2-132e73e6-ff9ea3d6_0 is DEAD
2025-09-30T14:52:42.854121Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:42.854206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a26cd82-1a3255f2-132e73e6-ff9ea3d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:42.854212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a26cd82-1a3255f2-132e73e6-ff9ea3d6_0] Write session will restart in 0.007527s
2025-09-30T14:52:42.854228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a26cd82-1a3255f2-132e73e6-ff9ea3d6_0] Write session: Do CDS request
2025-09-30T14:52:42.854242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a26cd82-1a3255f2-132e73e6-ff9ea3d6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:42.862781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a26cd82-1a3255f2-132e73e6-ff9ea3d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:42.862867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:42.862888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 926
2025-09-30T14:52:42.863017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 926 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:42.863051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 926 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:42.863061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=926 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:42.863068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:42.863540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 926 sessionId:  describe result for acl check
2025-09-30T14:52:42.863577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:42.863583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:42.863586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:42.863592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895284492410279:7862] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:42.864136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895284492410279:7862] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:42.866895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895284492410279:7862] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:42.870282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895284492410279:7862] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:42.870300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895284492410279:7862] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:42.870303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895284492410279:7862] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:42.870311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 926 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:42.874170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:42.877476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:42.877672Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:42.877682Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:42.877690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:42.877733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:42.877764Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895284402670501:6381]
2025-09-30T14:52:42.878270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:42.878558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:42.878591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:42.878878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:42.878944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:42.878953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:42.878954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:42.878955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:42.878957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:42.878958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:42.878960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:42.878961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:42.878962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:42.878963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:42.878965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.878966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.878967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.878968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:42.878969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:42.878974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:42.878985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:42.878990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:42.878994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:42.878998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:42.879002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:42.879006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:42.879009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:42.879012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:42.879014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:42.879017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.879019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.879021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.879024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:42.879026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:42.879032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:42.879037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:42.879041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:42.879044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:42.879047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:42.879051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:42.879054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:42.879057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:42.879060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:42.879063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:42.879066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:42.879069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:42.879072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:42.879075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:42.879077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:42.879080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:42.879083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:42.879086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:42.879088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:42.879093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:42.879095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.879098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.879101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.879103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.879106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.879108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.879111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:42.879114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:42.879120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:42.879122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:42.879145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:42.884731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:42.885894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:42.885927Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:42.885930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:42.885935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:42.885942Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 925 [2:7555895284402670501:6381]
2025-09-30T14:52:42.885958Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:42.885978Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:42.885981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:42.885985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:42.885988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:42.886006Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:42.886021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:42.886034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:42.886109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.886118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.886121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.886125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:42.886127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:42.886208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:42.886219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.886250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:42.886262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:42.886289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:42.886329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895284492410226:2454], now have 1 active actors on pipe
2025-09-30T14:52:42.886343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895284492410547:7862], now have 1 active actors on pipe
2025-09-30T14:52:42.886350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895284402670496:6381]
2025-09-30T14:52:42.886353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895284402670496:6381]
2025-09-30T14:52:42.886356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895284402670496:6381]
2025-09-30T14:52:42.886371Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:42.886388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:42.886404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:42.886405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:42.886409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:42.886410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:42.886414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:42.886456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895284402670496:6381]
2025-09-30T14:52:42.886440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 925
2025-09-30T14:52:42.886474Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:42.886474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:42.886586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 925
2025-09-30T14:52:42.886655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:42.886675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:42.886706Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4946dbd8-d1d41979-91a33fa9-753e40a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:42.886722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:42.886726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:42.886729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:42.886741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:42.886753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:42.886769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:42.886998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:42.887015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:42.887038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:42.887169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 926 partition: 0 MaxSeqNo: 42 sessionId: src_id|4946dbd8-d1d41979-91a33fa9-753e40a_0
2025-09-30T14:52:42.887526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a26cd82-1a3255f2-132e73e6-ff9ea3d6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4946dbd8-d1d41979-91a33fa9-753e40a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:42.890431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4946dbd8-d1d41979-91a33fa9-753e40a_0] Write session: try to update token
2025-09-30T14:52:42.890453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4946dbd8-d1d41979-91a33fa9-753e40a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:42.898918Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:42.898943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:42.898955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895284402670496:6381]
2025-09-30T14:52:42.899004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:42.899006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:42.899238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:42.899441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:42.899621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:42.899802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:42.900040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:42.900091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:42.905107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 926 sessionId: src_id|4946dbd8-d1d41979-91a33fa9-753e40a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:42.907616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:42.907804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:42.907829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:42.908957Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:42.908975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:42.908978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:42.908980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:42.908989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895284402670496:6381]
2025-09-30T14:52:42.908994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895284402670496:6381]
2025-09-30T14:52:42.908998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895284402670496:6381]
2025-09-30T14:52:42.909034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:42.909035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:42.909041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:42.909045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:42.909055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:42.909066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:42.909073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:42.909135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:42.909203Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:42.953918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895284492410619:7731]
2025-09-30T14:52:42.954143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 925, pipe: [1:7555895284492410619:7731]
2025-09-30T14:52:43.017104Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:43.024080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:43.024107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:43.024256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:43.024313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:43.024371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:43.024428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:43.024624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:43.024631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:43.024694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:43.024748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:43.024806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:43.024868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:43.024910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:43.024916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:43.024976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:43.025033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:43.025089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:43.025145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:43.025186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:43.025191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:43.025252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:43.025308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:43.025366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:43.025423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:43.025465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:43.025470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:43.025531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:43.025586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:43.025643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:43.025700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:43.025740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:43.025745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:43.025805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:43.025862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:43.025920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:43.025977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:43.026017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:43.026025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:43.026084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:43.026138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:43.026198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:43.026269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:43.026310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:43.026320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:43.026378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:43.026431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:43.026490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:43.026545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:43.026591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:43.026597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:43.026655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:43.026709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:43.026780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:43.026837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:43.026880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:43.026890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:43.026962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:43.027023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:43.027091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:43.027157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:43.027200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:43.027207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:43.027273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895284492410619:7731], now have 1 active actors on pipe
2025-09-30T14:52:43.027490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:43.027499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895284492410619:7731]
2025-09-30T14:52:43.027525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:43.027528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:43.027552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 926 reason: error at write: Disconnected sessionId: src_id|4946dbd8-d1d41979-91a33fa9-753e40a_0
2025-09-30T14:52:43.027716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 926 sessionId: src_id|4946dbd8-d1d41979-91a33fa9-753e40a_0 is DEAD
2025-09-30T14:52:43.027869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4946dbd8-d1d41979-91a33fa9-753e40a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:43.027876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4946dbd8-d1d41979-91a33fa9-753e40a_0] Write session will restart in 0.009284s
2025-09-30T14:52:43.027898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4946dbd8-d1d41979-91a33fa9-753e40a_0] Write session: Do CDS request
2025-09-30T14:52:43.027904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4946dbd8-d1d41979-91a33fa9-753e40a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:43.028118Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:43.038609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4946dbd8-d1d41979-91a33fa9-753e40a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:43.038739Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:43.038756Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 927
2025-09-30T14:52:43.038894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 927 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:43.038935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 927 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:43.038946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=927 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:43.038953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:43.039465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 927 sessionId:  describe result for acl check
2025-09-30T14:52:43.039506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:43.039508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:43.039510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:43.039516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895288787378084:7870] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:43.039961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895288787378084:7870] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:43.042605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895288787378084:7870] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:43.045138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895288787378084:7870] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:43.045154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895288787378084:7870] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:43.045157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895288787378084:7870] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:43.045165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 927 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:43.046038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:43.048627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:43.048806Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:43.048815Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:43.048823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:43.048865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:43.048894Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895288697638066:6384]
2025-09-30T14:52:43.049352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:43.049600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:43.049635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:43.049851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:43.049905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:43.049912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:43.049913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:43.049914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:43.049914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:43.049915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:43.049916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:43.049917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:43.049917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:43.049918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:43.049919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.049920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.049920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.049921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:43.049922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:43.049925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:43.049934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:43.049938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:43.049942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:43.049946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:43.049950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:43.049954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:43.049958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:43.049963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:43.049966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:43.049968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.049971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.049973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.049975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:43.049978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:43.049983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:43.049988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:43.049992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:43.049996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:43.049999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:43.050002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:43.050005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:43.050008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:43.050013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:43.050016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:43.050019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:43.050022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:43.050025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:43.050028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:43.050030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:43.050033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:43.050036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:43.050038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:43.050044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:43.050048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:43.050051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.050054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.050057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.050060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.050062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.050066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.050073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:43.050076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:43.050079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:43.050083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:43.050125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:43.055348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:43.056658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:43.056675Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:43.056678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:43.056682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:43.056689Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 926 [2:7555895288697638066:6384]
2025-09-30T14:52:43.056704Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:43.056719Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:43.056726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:43.056729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:43.056731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:43.056746Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:43.056758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:43.056765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:43.056823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.056830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.056833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.056836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:43.056838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:43.056897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:43.056904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.056917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.056933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.056956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:43.056976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895288787377924:2454], now have 1 active actors on pipe
2025-09-30T14:52:43.056983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895288787378307:7870], now have 1 active actors on pipe
2025-09-30T14:52:43.056990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895288697638061:6384]
2025-09-30T14:52:43.056996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895288697638061:6384]
2025-09-30T14:52:43.056998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895288697638061:6384]
2025-09-30T14:52:43.057013Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:43.057031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:43.057050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:43.057036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:43.057053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:43.057055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:43.057058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:43.057082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895288697638061:6384]
2025-09-30T14:52:43.057048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 926
2025-09-30T14:52:43.057089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:43.057092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:43.057103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:43.057107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:43.057131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 926
2025-09-30T14:52:43.057154Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7629343d-5e4e8e7c-2d6f4925-57f7f221_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:43.057165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:43.057170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:43.057172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:43.057180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:43.057188Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:43.057207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:43.057391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:43.057398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:43.057409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:43.057496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 927 partition: 0 MaxSeqNo: 42 sessionId: src_id|7629343d-5e4e8e7c-2d6f4925-57f7f221_0
2025-09-30T14:52:43.057796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4946dbd8-d1d41979-91a33fa9-753e40a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7629343d-5e4e8e7c-2d6f4925-57f7f221_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:43.060420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7629343d-5e4e8e7c-2d6f4925-57f7f221_0] Write session: try to update token
2025-09-30T14:52:43.060437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7629343d-5e4e8e7c-2d6f4925-57f7f221_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:43.068462Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:43.068481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:43.068483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:43.068484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:43.068491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895288697638061:6384]
2025-09-30T14:52:43.068495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895288697638061:6384]
2025-09-30T14:52:43.068497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895288697638061:6384]
2025-09-30T14:52:43.068535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:43.068540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:43.068543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.068546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:43.068556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:43.068561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:43.068682Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:43.074444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 927 sessionId: src_id|7629343d-5e4e8e7c-2d6f4925-57f7f221_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:43.077100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:43.127496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895288787378335:7731]
2025-09-30T14:52:43.127774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 926, pipe: [1:7555895288787378335:7731]
2025-09-30T14:52:43.173486Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:43.174038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:43.174055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:43.174088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895288787378335:7731], now have 1 active actors on pipe
2025-09-30T14:52:43.174288Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:43.174359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:43.174390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895288787378335:7731]
2025-09-30T14:52:43.174410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:43.174467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 927 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7629343d-5e4e8e7c-2d6f4925-57f7f221_0
2025-09-30T14:52:43.174609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 927 sessionId: src_id|7629343d-5e4e8e7c-2d6f4925-57f7f221_0 is DEAD
2025-09-30T14:52:43.174763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7629343d-5e4e8e7c-2d6f4925-57f7f221_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:43.174773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7629343d-5e4e8e7c-2d6f4925-57f7f221_0] Write session will restart in 0.009296s
2025-09-30T14:52:43.174794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7629343d-5e4e8e7c-2d6f4925-57f7f221_0] Write session: Do CDS request
2025-09-30T14:52:43.174799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7629343d-5e4e8e7c-2d6f4925-57f7f221_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:43.184749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7629343d-5e4e8e7c-2d6f4925-57f7f221_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:43.184824Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:43.184840Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 928
2025-09-30T14:52:43.184994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 928 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:43.185029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 928 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:43.185038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=928 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:43.185042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:43.185452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 928 sessionId:  describe result for acl check
2025-09-30T14:52:43.185489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:43.185497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:43.185499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:43.185504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895288787378526:7875] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:43.186019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895288787378526:7875] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:43.188299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895288787378526:7875] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:43.190500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895288787378526:7875] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:43.190511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895288787378526:7875] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:43.190513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895288787378526:7875] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:43.190519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 928 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:43.194383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:43.194955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:43.195123Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:43.195132Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:43.195142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:43.195193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:43.195575Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895288697638326:6387]
2025-09-30T14:52:43.196213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:43.196533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:43.196580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:43.196822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:43.196874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:43.196880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:43.196882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:43.196883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:43.196884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:43.196885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:43.196887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:43.196888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:43.196889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:43.196890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:43.196891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.196892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.196893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.196895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:43.196896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:43.196901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:43.196912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:43.196917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:43.196921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:43.196925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:43.196929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:43.196931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:43.196934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:43.196938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:43.196943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:43.196946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.196950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.196954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.196964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:43.196968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:43.196980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:43.196988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:43.196998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:43.197008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:43.197017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:43.197027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:43.197035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:43.197041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:43.197047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:43.197051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:43.197057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:43.197061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:43.197063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:43.197066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:43.197073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:43.197076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:43.197079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:43.197082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:43.197087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:43.197090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:43.197095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.197102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.197104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.197107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.197110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.197113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.197115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:43.197118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:43.197121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:43.197123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:43.197150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:43.202668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:43.203573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:43.203594Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:43.203597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:43.203601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:43.203608Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 927 [2:7555895288697638326:6387]
2025-09-30T14:52:43.203625Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:43.203645Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:43.203654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:43.203657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:43.203664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:43.203679Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:43.203691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:43.203703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:43.203766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.203775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.203777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.203781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:43.203783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:43.203855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:43.203864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.203876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.203893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.203914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:43.203938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895288787378715:7875], now have 1 active actors on pipe
2025-09-30T14:52:43.203946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895288787378336:2454], now have 1 active actors on pipe
2025-09-30T14:52:43.203952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895288697638321:6387]
2025-09-30T14:52:43.203959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895288697638321:6387]
2025-09-30T14:52:43.203964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895288697638321:6387]
2025-09-30T14:52:43.203984Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:43.203995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 927
2025-09-30T14:52:43.204000Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 927
2025-09-30T14:52:43.204003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:43.204007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:43.204011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:43.204013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:43.204024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:43.204027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:43.204065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:43.204068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:43.204078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895288697638321:6387]
2025-09-30T14:52:43.204085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:43.204092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:43.204107Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37a29010-962b8bd8-19a21c62-36d3764b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:43.204113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:43.204116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:43.204118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:43.204124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:43.204132Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:43.204150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:43.204286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:43.204298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:43.204314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:43.204408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 928 partition: 0 MaxSeqNo: 42 sessionId: src_id|37a29010-962b8bd8-19a21c62-36d3764b_0
2025-09-30T14:52:43.204749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7629343d-5e4e8e7c-2d6f4925-57f7f221_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|37a29010-962b8bd8-19a21c62-36d3764b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:43.207502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37a29010-962b8bd8-19a21c62-36d3764b_0] Write session: try to update token
2025-09-30T14:52:43.207522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37a29010-962b8bd8-19a21c62-36d3764b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:43.216065Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:43.216090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:43.216092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:43.216094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:43.216105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895288697638321:6387]
2025-09-30T14:52:43.216110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895288697638321:6387]
2025-09-30T14:52:43.216114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895288697638321:6387]
2025-09-30T14:52:43.216157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:43.216164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.216168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:43.216208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:43.216226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:43.216230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:43.216305Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:43.222000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 928 sessionId: src_id|37a29010-962b8bd8-19a21c62-36d3764b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:43.224756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:43.274409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895288787378736:7731]
2025-09-30T14:52:43.274645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 927, pipe: [1:7555895288787378736:7731]
2025-09-30T14:52:43.323666Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:43.324431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:43.324447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:43.324484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895288787378736:7731], now have 1 active actors on pipe
2025-09-30T14:52:43.324680Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:43.324696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:43.324699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:43.324709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:43.324746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895288787378736:7731]
2025-09-30T14:52:43.324764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 928 reason: error at write: Disconnected sessionId: src_id|37a29010-962b8bd8-19a21c62-36d3764b_0
2025-09-30T14:52:43.324931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 928 sessionId: src_id|37a29010-962b8bd8-19a21c62-36d3764b_0 is DEAD
2025-09-30T14:52:43.325092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37a29010-962b8bd8-19a21c62-36d3764b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:43.325104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37a29010-962b8bd8-19a21c62-36d3764b_0] Write session will restart in 0.007647s
2025-09-30T14:52:43.325127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37a29010-962b8bd8-19a21c62-36d3764b_0] Write session: Do CDS request
2025-09-30T14:52:43.325135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37a29010-962b8bd8-19a21c62-36d3764b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:43.333733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37a29010-962b8bd8-19a21c62-36d3764b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:43.333791Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:43.333808Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 929
2025-09-30T14:52:43.334348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 929 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:43.334380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 929 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:43.334388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=929 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:43.334392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:43.334853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 929 sessionId:  describe result for acl check
2025-09-30T14:52:43.334888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:43.334890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:43.334892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:43.334897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895288787378887:7886] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:43.335354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895288787378887:7886] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:43.337057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895288787378887:7886] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:43.339355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895288787378887:7886] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:43.339370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895288787378887:7886] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:43.339373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895288787378887:7886] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:43.339381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 929 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:43.344962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:43.345426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:43.345569Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:43.345577Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:43.345584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:43.345626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:43.345655Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895288697638621:6401]
2025-09-30T14:52:43.346120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:43.346408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:43.346451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:43.346744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:43.346806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:43.346812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:43.346814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:43.346815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:43.346816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:43.346817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:43.346819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:43.346820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:43.346821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:43.346822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:43.346824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.346825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.346826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.346827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:43.346828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:43.346833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:43.346843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:43.346847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:43.346852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:43.346856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:43.346860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:43.346864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:43.346867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:43.346871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:43.346877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:43.346893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.346896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.346899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.346902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:43.346906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:43.346915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:43.346923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:43.346934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:43.346944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:43.346953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:43.346959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:43.346963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:43.346969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:43.346973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:43.346978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:43.346983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:43.346988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:43.346991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:43.346996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:43.347004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:43.347009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:43.347019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:43.347028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:43.347033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:43.347038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:43.347043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.347053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.347057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.347066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.347071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.347076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.347085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:43.347090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:43.347098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:43.347103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:43.347152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:43.352738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:43.353961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:43.353977Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:43.353979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:43.353982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:43.353986Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 928 [2:7555895288697638621:6401]
2025-09-30T14:52:43.353997Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:43.354009Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:43.354011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:43.354014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:43.354016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:43.354028Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:43.354032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:43.354037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:43.354094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.354102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.354105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.354108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:43.354110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:43.354162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:43.354168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.354180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.354191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.354213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:43.354229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895288697638616:6401]
2025-09-30T14:52:43.354251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895288697638616:6401]
2025-09-30T14:52:43.354253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895288697638616:6401]
2025-09-30T14:52:43.354259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:43.354270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:43.354271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:43.354275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:43.354277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:43.354280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:43.354282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:43.354290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895288787379095:7886], now have 1 active actors on pipe
2025-09-30T14:52:43.354293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895288787378756:2454], now have 1 active actors on pipe
2025-09-30T14:52:43.354313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895288697638616:6401]
2025-09-30T14:52:43.354316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:43.354323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:43.354344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 928
2025-09-30T14:52:43.354349Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 928
2025-09-30T14:52:43.354406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:43.354417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:43.354444Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2f18085-1e4e5f67-4437a7f0-2578b17a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:43.354456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:43.354460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:43.354467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:43.354477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:43.354491Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:43.354509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:43.354709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:43.354716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:43.354726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:43.354815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 929 partition: 0 MaxSeqNo: 42 sessionId: src_id|f2f18085-1e4e5f67-4437a7f0-2578b17a_0
2025-09-30T14:52:43.355150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37a29010-962b8bd8-19a21c62-36d3764b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f2f18085-1e4e5f67-4437a7f0-2578b17a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:43.357773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2f18085-1e4e5f67-4437a7f0-2578b17a_0] Write session: try to update token
2025-09-30T14:52:43.357790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2f18085-1e4e5f67-4437a7f0-2578b17a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:43.366524Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:43.366548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:43.366552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:43.366554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:43.366563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895288697638616:6401]
2025-09-30T14:52:43.366568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895288697638616:6401]
2025-09-30T14:52:43.366573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895288697638616:6401]
2025-09-30T14:52:43.366611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:43.366618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.366620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:43.366623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:43.366629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:43.366633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:43.366761Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:43.371099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 929 sessionId: src_id|f2f18085-1e4e5f67-4437a7f0-2578b17a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:43.373672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:43.424961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895288787379148:7731]
2025-09-30T14:52:43.425227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 928, pipe: [1:7555895288787379148:7731]
2025-09-30T14:52:43.473776Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:43.474162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:43.474175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:43.474208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895288787379148:7731], now have 1 active actors on pipe
2025-09-30T14:52:43.474380Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:43.474446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:43.474466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:43.474531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 929 reason: error at write: Disconnected sessionId: src_id|f2f18085-1e4e5f67-4437a7f0-2578b17a_0
2025-09-30T14:52:43.474613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895288787379148:7731]
2025-09-30T14:52:43.474650Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:43.474669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 929 sessionId: src_id|f2f18085-1e4e5f67-4437a7f0-2578b17a_0 is DEAD
2025-09-30T14:52:43.474802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2f18085-1e4e5f67-4437a7f0-2578b17a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:43.474811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2f18085-1e4e5f67-4437a7f0-2578b17a_0] Write session will restart in 0.007360s
2025-09-30T14:52:43.474830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2f18085-1e4e5f67-4437a7f0-2578b17a_0] Write session: Do CDS request
2025-09-30T14:52:43.474834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2f18085-1e4e5f67-4437a7f0-2578b17a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:43.483724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2f18085-1e4e5f67-4437a7f0-2578b17a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:43.483827Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:43.483851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 930
2025-09-30T14:52:43.483980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 930 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:43.484023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 930 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:43.484032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=930 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:43.484036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:43.484396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 930 sessionId:  describe result for acl check
2025-09-30T14:52:43.484431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:43.484434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:43.484435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:43.484441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895288787379243:7890] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:43.484854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895288787379243:7890] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:43.487713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895288787379243:7890] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:43.490355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895288787379243:7890] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:43.490381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895288787379243:7890] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:43.490385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895288787379243:7890] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:43.490394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 930 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:43.495795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:43.496179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:43.496316Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:43.496324Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:43.496331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:43.496363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:43.496401Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895288697638881:6403]
2025-09-30T14:52:43.496847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:43.497059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:43.497092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:43.497322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:43.497372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:43.497379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:43.497381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:43.497382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:43.497383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:43.497384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:43.497385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:43.497386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:43.497388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:43.497389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:43.497390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.497391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.497393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.497394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:43.497395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:43.497398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:43.497405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:43.497407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:43.497410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:43.497412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:43.497415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:43.497417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:43.497419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:43.497422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:43.497424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:43.497427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.497429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.497433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.497437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:43.497441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:43.497447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:43.497454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:43.497461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:43.497466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:43.497470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:43.497476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:43.497480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:43.497485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:43.497487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:43.497490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:43.497492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:43.497496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:43.497498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:43.497502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:43.497504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:43.497507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:43.497510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:43.497513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:43.497515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:43.497518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:43.497521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.497524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.497526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.497529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.497531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.497535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.497539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:43.497541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:43.497544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:43.497547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:43.497571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:43.502531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:43.503851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:43.503867Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:43.503868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:43.503871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:43.503876Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 929 [2:7555895288697638881:6403]
2025-09-30T14:52:43.503887Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:43.503898Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:43.503900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:43.503901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:43.503903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:43.503915Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:43.503920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:43.503926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:43.503974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.503981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.503982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.503985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:43.503987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:43.504045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:43.504052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.504059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.504065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.504074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:43.504086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895288697638876:6403]
2025-09-30T14:52:43.504092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895288697638876:6403]
2025-09-30T14:52:43.504093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895288697638876:6403]
2025-09-30T14:52:43.504099Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:43.504110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895288787379505:7890], now have 1 active actors on pipe
2025-09-30T14:52:43.504110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:43.504114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:43.504116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:43.504116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895288787379149:2454], now have 1 active actors on pipe
2025-09-30T14:52:43.504123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:43.504137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:43.504140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:43.504167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895288697638876:6403]
2025-09-30T14:52:43.504177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:43.504185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:43.504204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 929
2025-09-30T14:52:43.504250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:43.504206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 929
2025-09-30T14:52:43.504259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:43.504284Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7caa411-994ea329-20a6b8e2-5ac2f584_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:43.504291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:43.504299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:43.504302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:43.504310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:43.504323Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:43.504341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:43.504481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:43.504489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:43.504504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:43.504601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 930 partition: 0 MaxSeqNo: 42 sessionId: src_id|f7caa411-994ea329-20a6b8e2-5ac2f584_0
2025-09-30T14:52:43.504931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2f18085-1e4e5f67-4437a7f0-2578b17a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f7caa411-994ea329-20a6b8e2-5ac2f584_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:43.507661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7caa411-994ea329-20a6b8e2-5ac2f584_0] Write session: try to update token
2025-09-30T14:52:43.507684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7caa411-994ea329-20a6b8e2-5ac2f584_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:43.515907Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:43.515928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:43.515930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:43.515932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:43.515941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895288697638876:6403]
2025-09-30T14:52:43.515945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895288697638876:6403]
2025-09-30T14:52:43.515949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895288697638876:6403]
2025-09-30T14:52:43.515986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:43.515992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.515995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:43.515995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:43.516002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:43.516006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:43.516122Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:43.521906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 930 sessionId: src_id|f7caa411-994ea329-20a6b8e2-5ac2f584_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:43.524455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:43.574986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895288787379548:7731]
2025-09-30T14:52:43.575187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 929, pipe: [1:7555895288787379548:7731]
2025-09-30T14:52:43.620840Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:43.621437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:43.621453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:43.621491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895288787379548:7731], now have 1 active actors on pipe
2025-09-30T14:52:43.621655Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:43.621732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:43.621736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895288787379548:7731]
2025-09-30T14:52:43.621749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:43.621756Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:43.621809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 930 reason: error at write: Disconnected sessionId: src_id|f7caa411-994ea329-20a6b8e2-5ac2f584_0
2025-09-30T14:52:43.621972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 930 sessionId: src_id|f7caa411-994ea329-20a6b8e2-5ac2f584_0 is DEAD
2025-09-30T14:52:43.622136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7caa411-994ea329-20a6b8e2-5ac2f584_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:43.622147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7caa411-994ea329-20a6b8e2-5ac2f584_0] Write session will restart in 0.008225s
2025-09-30T14:52:43.622166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7caa411-994ea329-20a6b8e2-5ac2f584_0] Write session: Do CDS request
2025-09-30T14:52:43.622172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7caa411-994ea329-20a6b8e2-5ac2f584_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:43.631684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7caa411-994ea329-20a6b8e2-5ac2f584_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:43.631767Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:43.631784Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 931
2025-09-30T14:52:43.631902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 931 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:43.631934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 931 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:43.631944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=931 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:43.631947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:43.632355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 931 sessionId:  describe result for acl check
2025-09-30T14:52:43.632410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:43.632419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:43.632422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:43.632427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895288787379746:7895] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:43.632907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895288787379746:7895] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:43.634721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895288787379746:7895] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:43.636912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895288787379746:7895] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:43.636925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895288787379746:7895] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:43.636929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895288787379746:7895] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:43.636936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 931 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:43.639134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:43.641839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:43.642171Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:43.642188Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:43.642211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:43.642349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:43.642395Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895288697639143:6406]
2025-09-30T14:52:43.642929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:43.643214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:43.643272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:43.643614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:43.643673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:43.643680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:43.643681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:43.643682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:43.643684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:43.643685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:43.643686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:43.643688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:43.643689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:43.643690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:43.643692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.643693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.643694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.643696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:43.643697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:43.643703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:43.643713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:43.643716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:43.643719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:43.643721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:43.643723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:43.643726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:43.643728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:43.643730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:43.643733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:43.643736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.643738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.643740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.643743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:43.643745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:43.643751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:43.643756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:43.643760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:43.643763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:43.643767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:43.643771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:43.643773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:43.643776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:43.643779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:43.643782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:43.643785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:43.643790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:43.643795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:43.643800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:43.643805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:43.643811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:43.643814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:43.643817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:43.643820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:43.643823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:43.643826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.643829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.643831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.643834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.643837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.643840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.643842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:43.643845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:43.643847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:43.643851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:43.643880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:43.648959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:43.650260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:43.650272Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:43.650274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:43.650277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:43.650283Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 930 [2:7555895288697639143:6406]
2025-09-30T14:52:43.650296Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:43.650307Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:43.650315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:43.650317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:43.650319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:43.650333Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:43.650339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:43.650344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:43.650391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.650400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.650402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.650405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:43.650407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:43.650468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:43.650478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.650485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.650491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.650500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:43.650512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895288697639138:6406]
2025-09-30T14:52:43.650517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895288697639138:6406]
2025-09-30T14:52:43.650519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895288697639138:6406]
2025-09-30T14:52:43.650526Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:43.650537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:43.650538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895288787379549:2454], now have 1 active actors on pipe
2025-09-30T14:52:43.650540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:43.650542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895288787379931:7895], now have 1 active actors on pipe
2025-09-30T14:52:43.650542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:43.650549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:43.650563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:43.650569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:43.650593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895288697639138:6406]
2025-09-30T14:52:43.650602Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:43.650616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:43.650626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 930
2025-09-30T14:52:43.650629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 930
2025-09-30T14:52:43.650703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:43.650712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:43.650738Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab94ca25-b556bda7-ec6bce3-8916afe2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:43.650748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:43.650752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:43.650758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:43.650767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:43.650773Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:43.650783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:43.650894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:43.650900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:43.650909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:43.650976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 931 partition: 0 MaxSeqNo: 42 sessionId: src_id|ab94ca25-b556bda7-ec6bce3-8916afe2_0
2025-09-30T14:52:43.651286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7caa411-994ea329-20a6b8e2-5ac2f584_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ab94ca25-b556bda7-ec6bce3-8916afe2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:43.654086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab94ca25-b556bda7-ec6bce3-8916afe2_0] Write session: try to update token
2025-09-30T14:52:43.654102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab94ca25-b556bda7-ec6bce3-8916afe2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:43.666945Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:43.666965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:43.666972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895288697639138:6406]
2025-09-30T14:52:43.667010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:43.667033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:43.667162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:43.667300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:43.667444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:43.667590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:43.667681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 931 sessionId: src_id|ab94ca25-b556bda7-ec6bce3-8916afe2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:43.667758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:43.667794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:43.670196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:43.670399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:43.670417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:43.670448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:43.670544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:43.672248Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:43.672264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:43.672267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:43.672269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:43.672276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895288697639138:6406]
2025-09-30T14:52:43.672281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895288697639138:6406]
2025-09-30T14:52:43.672285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895288697639138:6406]
2025-09-30T14:52:43.672328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:43.672339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.672342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:43.672343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:43.672349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:43.672353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:43.672464Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:43.721929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895288787379946:7731]
2025-09-30T14:52:43.722200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 930, pipe: [1:7555895288787379946:7731]
2025-09-30T14:52:43.778199Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:43.785002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:43.785028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:43.785170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:43.785229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:43.785285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:43.785342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:43.785384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:43.785392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:43.785451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:43.785504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:43.785563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:43.785646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:43.785688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:43.785694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:43.785752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:43.785809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:43.785867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:43.785924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:43.785962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:43.785968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:43.786026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:43.786082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:43.786137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:43.786195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:43.786251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:43.786258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:43.786314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:43.786370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:43.786427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:43.786484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:43.786524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:43.786530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:43.786591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:43.786644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:43.786703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:43.786760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:43.786800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:43.786806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:43.786889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:43.786945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:43.787004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:43.787060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:43.787105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:43.787111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:43.787171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:43.787225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:43.787298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:43.787356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:43.787409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:43.787414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:43.787470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:43.787526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:43.787595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:43.787657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:43.787696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:43.787702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:43.787759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:43.787811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:43.787863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:43.787921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:43.787964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:43.787970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:43.788009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895288787379946:7731], now have 1 active actors on pipe
2025-09-30T14:52:43.788233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895288787379946:7731]
2025-09-30T14:52:43.788235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:43.788238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:43.788265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:43.788267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 931 reason: error at write: Disconnected sessionId: src_id|ab94ca25-b556bda7-ec6bce3-8916afe2_0
2025-09-30T14:52:43.788402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 931 sessionId: src_id|ab94ca25-b556bda7-ec6bce3-8916afe2_0 is DEAD
2025-09-30T14:52:43.788532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab94ca25-b556bda7-ec6bce3-8916afe2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:43.788542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab94ca25-b556bda7-ec6bce3-8916afe2_0] Write session will restart in 0.008132s
2025-09-30T14:52:43.788559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab94ca25-b556bda7-ec6bce3-8916afe2_0] Write session: Do CDS request
2025-09-30T14:52:43.788563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab94ca25-b556bda7-ec6bce3-8916afe2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:43.789093Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:43.797760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab94ca25-b556bda7-ec6bce3-8916afe2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:43.797837Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:43.797854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 932
2025-09-30T14:52:43.797982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 932 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:43.798015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 932 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:43.798036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=932 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:43.798040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:43.798448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 932 sessionId:  describe result for acl check
2025-09-30T14:52:43.798483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:43.798491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:43.798494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:43.798507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895288787380128:7899] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:43.799013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895288787380128:7899] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:43.801941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895288787380128:7899] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:43.804254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895288787380128:7899] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:43.804268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895288787380128:7899] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:43.804271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895288787380128:7899] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:43.804278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 932 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:43.806979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:43.807358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:43.807485Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:43.807492Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:43.807500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:43.807530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:43.807557Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895288697639405:6408]
2025-09-30T14:52:43.808020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:43.808248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:43.808284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:43.808503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:43.808542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:43.808547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:43.808547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:43.808548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:43.808549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:43.808549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:43.808550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:43.808551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:43.808551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:43.808552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:43.808553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.808553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.808554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.808554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:43.808555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:43.808558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:43.808565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:43.808567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:43.808570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:43.808572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:43.808574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:43.808577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:43.808579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:43.808582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:43.808588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:43.808591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.808595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.808599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.808602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:43.808605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:43.808611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:43.808620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:43.808626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:43.808630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:43.808632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:43.808636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:43.808638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:43.808646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:43.808650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:43.808660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:43.808664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:43.808674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:43.808683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:43.808690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:43.808693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:43.808696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:43.808699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:43.808702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:43.808707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:43.808710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:43.808713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.808716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.808722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.808725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.808727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.808730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.808733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:43.808736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:43.808738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:43.808741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:43.808765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:43.813784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:43.814538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:43.814551Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:43.814553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:43.814556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:43.814562Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 931 [2:7555895288697639405:6408]
2025-09-30T14:52:43.814571Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:43.814582Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:43.814584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:43.814586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:43.814587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:43.814599Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:43.814608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:43.814613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:43.814651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.814656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.814658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.814660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:43.814662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:43.814707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:43.814712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.814719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.814725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.814735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:43.814748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895288697639400:6408]
2025-09-30T14:52:43.814753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895288697639400:6408]
2025-09-30T14:52:43.814755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895288697639400:6408]
2025-09-30T14:52:43.814760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:43.814769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:43.814771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:43.814775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:43.814777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:43.814782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:43.814784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:43.814791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895288787380331:7899], now have 1 active actors on pipe
2025-09-30T14:52:43.814794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895288787379947:2454], now have 1 active actors on pipe
2025-09-30T14:52:43.814818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895288697639400:6408]
2025-09-30T14:52:43.814830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:43.814851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:43.814877Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 931
2025-09-30T14:52:43.814935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 931
2025-09-30T14:52:43.814948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:43.814956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:43.814973Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8db1acea-91c4f24e-67b013aa-2bff507b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:43.814977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:43.814985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:43.814986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:43.814993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:43.814999Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:43.815012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:43.815147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:43.815153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:43.815162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:43.815232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 932 partition: 0 MaxSeqNo: 42 sessionId: src_id|8db1acea-91c4f24e-67b013aa-2bff507b_0
2025-09-30T14:52:43.815611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab94ca25-b556bda7-ec6bce3-8916afe2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8db1acea-91c4f24e-67b013aa-2bff507b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:43.818083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8db1acea-91c4f24e-67b013aa-2bff507b_0] Write session: try to update token
2025-09-30T14:52:43.818097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8db1acea-91c4f24e-67b013aa-2bff507b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:43.826273Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:43.826299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:43.826302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:43.826305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:43.826315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895288697639400:6408]
2025-09-30T14:52:43.826320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895288697639400:6408]
2025-09-30T14:52:43.826325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895288697639400:6408]
2025-09-30T14:52:43.826371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:43.826370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:43.826375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:43.826379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.826381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:43.826382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:43.826560Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:43.832592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 932 sessionId: src_id|8db1acea-91c4f24e-67b013aa-2bff507b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:43.835105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:43.888274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895288787380345:7731]
2025-09-30T14:52:43.888536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 931, pipe: [1:7555895288787380345:7731]
2025-09-30T14:52:43.927702Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:43.928491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:43.928505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:43.928522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895288787380345:7731], now have 1 active actors on pipe
2025-09-30T14:52:43.928728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:43.928731Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:43.928742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:43.928767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895288787380345:7731]
2025-09-30T14:52:43.928796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 932 reason: error at write: Disconnected sessionId: src_id|8db1acea-91c4f24e-67b013aa-2bff507b_0
2025-09-30T14:52:43.928698Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:43.928976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 932 sessionId: src_id|8db1acea-91c4f24e-67b013aa-2bff507b_0 is DEAD
2025-09-30T14:52:43.929112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8db1acea-91c4f24e-67b013aa-2bff507b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:43.929122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8db1acea-91c4f24e-67b013aa-2bff507b_0] Write session will restart in 0.009411s
2025-09-30T14:52:43.929139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8db1acea-91c4f24e-67b013aa-2bff507b_0] Write session: Do CDS request
2025-09-30T14:52:43.929156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8db1acea-91c4f24e-67b013aa-2bff507b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:43.939785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8db1acea-91c4f24e-67b013aa-2bff507b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:43.939882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:43.939900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 933
2025-09-30T14:52:43.940041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 933 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:43.940074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 933 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:43.940084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=933 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:43.940089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:43.940538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 933 sessionId:  describe result for acl check
2025-09-30T14:52:43.940572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:43.940578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:43.940580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:43.940586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895288787380621:7903] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:43.941117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895288787380621:7903] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:43.942945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895288787380621:7903] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:43.946573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:43.946770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895288787380621:7903] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:43.946783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895288787380621:7903] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:43.946785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895288787380621:7903] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:43.946791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 933 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:43.946897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:43.947068Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:43.947078Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:43.947088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:43.947131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:43.947166Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895288697639668:6410]
2025-09-30T14:52:43.947816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:43.948064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:43.948133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:43.948488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:43.948560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:43.948566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:43.948567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:43.948568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:43.948569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:43.948570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:43.948572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:43.948572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:43.948574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:43.948575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:43.948576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.948577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.948578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.948579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:43.948580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:43.948586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:43.948597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:43.948601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:43.948605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:43.948609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:43.948613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:43.948617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:43.948621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:43.948625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:43.948630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:43.948634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.948638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.948642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.948646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:43.948650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:43.948657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:43.948665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:43.948671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:43.948676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:43.948684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:43.948689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:43.948698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:43.948704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:43.948709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:43.948714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:43.948718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:43.948724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:43.948731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:43.948736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:43.948741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:43.948747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:43.948752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:43.948757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:43.948766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:43.948771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:43.948776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.948781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.948785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.948793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.948796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.948799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.948801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:43.948804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:43.948806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:43.948809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:43.948832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:43.953918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:43.954827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:43.954847Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:43.954849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:43.954852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:43.954857Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 932 [2:7555895288697639668:6410]
2025-09-30T14:52:43.954869Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:43.954881Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:43.954883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:43.954885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:43.954887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:43.954899Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:43.954906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:43.954914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:43.954966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.954974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.954976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.954978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:43.954980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:43.955032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:43.955039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.955052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:43.955065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:43.955076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:43.955089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895288787380733:7903], now have 1 active actors on pipe
2025-09-30T14:52:43.955096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895288787380346:2454], now have 1 active actors on pipe
2025-09-30T14:52:43.955101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895288697639662:6410]
2025-09-30T14:52:43.955105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895288697639662:6410]
2025-09-30T14:52:43.955106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895288697639662:6410]
2025-09-30T14:52:43.955115Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:43.955129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:43.955131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:43.955135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:43.955137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:43.955143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:43.955145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:43.955172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895288697639662:6410]
2025-09-30T14:52:43.955185Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:43.955215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:43.955263Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 932
2025-09-30T14:52:43.955356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 932
2025-09-30T14:52:43.955423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:43.955439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:43.955464Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|282ccef8-63581582-5e5dcfd4-744ddff1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:43.955479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:43.955483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:43.955485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:43.955496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:43.955512Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:43.955531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:43.955743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:43.955755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:43.955772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:43.955856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 933 partition: 0 MaxSeqNo: 42 sessionId: src_id|282ccef8-63581582-5e5dcfd4-744ddff1_0
2025-09-30T14:52:43.956186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8db1acea-91c4f24e-67b013aa-2bff507b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|282ccef8-63581582-5e5dcfd4-744ddff1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:43.958858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|282ccef8-63581582-5e5dcfd4-744ddff1_0] Write session: try to update token
2025-09-30T14:52:43.958875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|282ccef8-63581582-5e5dcfd4-744ddff1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:43.966553Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:43.966573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:43.966581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895288697639662:6410]
2025-09-30T14:52:43.966617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:43.966619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:43.966772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:43.966912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:43.967043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:43.967182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:43.967389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:43.967426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:43.975301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 933 sessionId: src_id|282ccef8-63581582-5e5dcfd4-744ddff1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:43.977273Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:43.977293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:43.977294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:43.977295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:43.977304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895288697639662:6410]
2025-09-30T14:52:43.977307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895288697639662:6410]
2025-09-30T14:52:43.977310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895288697639662:6410]
2025-09-30T14:52:43.977344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:43.977346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:43.977355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:43.977359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:43.977423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:43.977430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:43.977482Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:43.977811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:44.029107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895293082348048:7731]
2025-09-30T14:52:44.029370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 932, pipe: [1:7555895293082348048:7731]
2025-09-30T14:52:44.079011Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:44.079550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:44.079567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:44.079585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895293082348048:7731], now have 1 active actors on pipe
2025-09-30T14:52:44.079799Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:44.079805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:44.079820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:44.079823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895293082348048:7731]
2025-09-30T14:52:44.079838Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:44.079880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 933 reason: error at write: Disconnected sessionId: src_id|282ccef8-63581582-5e5dcfd4-744ddff1_0
2025-09-30T14:52:44.080073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 933 sessionId: src_id|282ccef8-63581582-5e5dcfd4-744ddff1_0 is DEAD
2025-09-30T14:52:44.080212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|282ccef8-63581582-5e5dcfd4-744ddff1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:44.080222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|282ccef8-63581582-5e5dcfd4-744ddff1_0] Write session will restart in 0.007362s
2025-09-30T14:52:44.080239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|282ccef8-63581582-5e5dcfd4-744ddff1_0] Write session: Do CDS request
2025-09-30T14:52:44.080243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|282ccef8-63581582-5e5dcfd4-744ddff1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:44.088741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|282ccef8-63581582-5e5dcfd4-744ddff1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:44.088897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:44.088914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 934
2025-09-30T14:52:44.089031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 934 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:44.089067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 934 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:44.089078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=934 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:44.089082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:44.089481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 934 sessionId:  describe result for acl check
2025-09-30T14:52:44.089515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:44.089523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:44.089527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:44.089533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895293082348208:7910] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:44.090109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895293082348208:7910] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:44.092497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895293082348208:7910] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:44.095286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895293082348208:7910] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:44.095300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895293082348208:7910] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:44.095303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895293082348208:7910] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:44.095309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 934 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:44.096522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:44.099472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:44.099610Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:44.099617Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:44.099624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:44.099661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:44.099688Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895292992607242:6413]
2025-09-30T14:52:44.100118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:44.100403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:44.100433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:44.100641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:44.100680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:44.100684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:44.100685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:44.100686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:44.100686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:44.100687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:44.100688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:44.100688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:44.100689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:44.100690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:44.100691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.100692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.100692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.100693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:44.100693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:44.100696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:44.100703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:44.100706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:44.100708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:44.100710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:44.100713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:44.100715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:44.100717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:44.100720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:44.100722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:44.100724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.100726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.100729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.100731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:44.100733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:44.100738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:44.100743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:44.100746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:44.100750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:44.100753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:44.100759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:44.100764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:44.100769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:44.100773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:44.100778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:44.100782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:44.100787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:44.100791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:44.100796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:44.100801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:44.100806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:44.100811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:44.100821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:44.100823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:44.100826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:44.100829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.100832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.100834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.100837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.100839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.100842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.100844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:44.100848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:44.100854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:44.100858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:44.100882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:44.106098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:44.107362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:44.107377Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:44.107379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:44.107383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:44.107389Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 933 [2:7555895292992607242:6413]
2025-09-30T14:52:44.107401Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:44.107416Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:44.107421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:44.107423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:44.107425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:44.107436Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:44.107444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:44.107449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:44.107491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.107499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.107500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.107505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:44.107507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:44.107565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:44.107571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.107579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.107588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.107597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:44.107613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895293082348064:2454], now have 1 active actors on pipe
2025-09-30T14:52:44.107619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895293082348449:7910], now have 1 active actors on pipe
2025-09-30T14:52:44.107625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895292992607235:6413]
2025-09-30T14:52:44.107627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895292992607235:6413]
2025-09-30T14:52:44.107629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895292992607235:6413]
2025-09-30T14:52:44.107641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:44.107649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:44.107654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:44.107655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:44.107658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:44.107671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:44.107678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:44.107703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895292992607235:6413]
2025-09-30T14:52:44.107710Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:44.107711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:44.107682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 933
2025-09-30T14:52:44.107689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 933
2025-09-30T14:52:44.107744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:44.107753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:44.107778Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49763d52-bedf6bcc-d0d3a579-79e97e45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:44.107788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:44.107796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:44.107798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:44.107807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:44.107819Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:44.107833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:44.107963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:44.107972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:44.107984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:44.108113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 934 partition: 0 MaxSeqNo: 42 sessionId: src_id|49763d52-bedf6bcc-d0d3a579-79e97e45_0
2025-09-30T14:52:44.108467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|282ccef8-63581582-5e5dcfd4-744ddff1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|49763d52-bedf6bcc-d0d3a579-79e97e45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:44.111532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49763d52-bedf6bcc-d0d3a579-79e97e45_0] Write session: try to update token
2025-09-30T14:52:44.111553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49763d52-bedf6bcc-d0d3a579-79e97e45_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:44.119910Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:44.119942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:44.119946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:44.119949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:44.119961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895292992607235:6413]
2025-09-30T14:52:44.119967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895292992607235:6413]
2025-09-30T14:52:44.119974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895292992607235:6413]
2025-09-30T14:52:44.120019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:44.120023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:44.120031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.120033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:44.120035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:44.120041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:44.120269Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:44.125716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 934 sessionId: src_id|49763d52-bedf6bcc-d0d3a579-79e97e45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:44.128334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:44.180182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895293082348463:7731]
2025-09-30T14:52:44.180440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 933, pipe: [1:7555895293082348463:7731]
2025-09-30T14:52:44.229357Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:44.229943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:44.229962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:44.229999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895293082348463:7731], now have 1 active actors on pipe
2025-09-30T14:52:44.230209Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:44.230242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:44.230248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:44.230260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:44.230301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895293082348463:7731]
2025-09-30T14:52:44.230320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 934 reason: error at write: Disconnected sessionId: src_id|49763d52-bedf6bcc-d0d3a579-79e97e45_0
2025-09-30T14:52:44.230529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 934 sessionId: src_id|49763d52-bedf6bcc-d0d3a579-79e97e45_0 is DEAD
2025-09-30T14:52:44.230690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49763d52-bedf6bcc-d0d3a579-79e97e45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:44.230699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49763d52-bedf6bcc-d0d3a579-79e97e45_0] Write session will restart in 0.006747s
2025-09-30T14:52:44.230716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49763d52-bedf6bcc-d0d3a579-79e97e45_0] Write session: Do CDS request
2025-09-30T14:52:44.230721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49763d52-bedf6bcc-d0d3a579-79e97e45_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:44.238701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49763d52-bedf6bcc-d0d3a579-79e97e45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:44.238870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:44.238886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 935
2025-09-30T14:52:44.239027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 935 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:44.239060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 935 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:44.239065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=935 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:44.239069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:44.239539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 935 sessionId:  describe result for acl check
2025-09-30T14:52:44.239572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:44.239579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:44.239581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:44.239586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895293082348606:7914] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:44.240061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895293082348606:7914] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:44.241834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895293082348606:7914] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:44.244642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895293082348606:7914] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:44.244653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895293082348606:7914] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:44.244657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895293082348606:7914] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:44.244704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 935 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:44.249343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:44.249767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:44.249919Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:44.249929Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:44.249938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:44.249980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:44.250017Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895292992607507:6416]
2025-09-30T14:52:44.250632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:44.250874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:44.250918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:44.251223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:44.251298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:44.251305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:44.251306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:44.251307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:44.251308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:44.251309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:44.251310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:44.251311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:44.251313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:44.251314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:44.251315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.251316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.251316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.251318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:44.251319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:44.251324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:44.251333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:44.251337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:44.251341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:44.251345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:44.251349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:44.251352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:44.251356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:44.251359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:44.251364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:44.251367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.251371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.251375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.251379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:44.251382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:44.251389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:44.251403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:44.251412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:44.251422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:44.251427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:44.251432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:44.251441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:44.251447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:44.251457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:44.251466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:44.251476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:44.251480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:44.251489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:44.251494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:44.251504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:44.251513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:44.251519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:44.251524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:44.251531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:44.251536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:44.251545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.251552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.251560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.251565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.251573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.251578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.251586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:44.251592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:44.251600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:44.251605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:44.251647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:44.256920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:44.257783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:44.257803Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:44.257806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:44.257809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:44.257816Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 934 [2:7555895292992607507:6416]
2025-09-30T14:52:44.257833Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:44.257853Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:44.257860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:44.257863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:44.257866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:44.257881Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:44.257892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:44.257903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:44.258564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.258577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.258579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.258583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:44.258585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:44.258649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:44.258658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.258669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.258684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.258705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:44.258725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895293082348851:7914], now have 1 active actors on pipe
2025-09-30T14:52:44.258733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895293082348465:2454], now have 1 active actors on pipe
2025-09-30T14:52:44.258739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895292992607502:6416]
2025-09-30T14:52:44.258745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895292992607502:6416]
2025-09-30T14:52:44.258747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895292992607502:6416]
2025-09-30T14:52:44.258758Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:44.258774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:44.258778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:44.258786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:44.258788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:44.258791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:44.258793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:44.258776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 934
2025-09-30T14:52:44.258826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895292992607502:6416]
2025-09-30T14:52:44.258834Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:44.258842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:44.258791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 934
2025-09-30T14:52:44.258849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:44.258857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:44.258902Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b815c39f-23c232d2-fa75a072-26530f8d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:44.258913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:44.258921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:44.258923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:44.258934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:44.258946Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:44.258968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:44.259125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:44.259135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:44.259150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:44.259227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 935 partition: 0 MaxSeqNo: 42 sessionId: src_id|b815c39f-23c232d2-fa75a072-26530f8d_0
2025-09-30T14:52:44.259629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49763d52-bedf6bcc-d0d3a579-79e97e45_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b815c39f-23c232d2-fa75a072-26530f8d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:44.262318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b815c39f-23c232d2-fa75a072-26530f8d_0] Write session: try to update token
2025-09-30T14:52:44.262335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b815c39f-23c232d2-fa75a072-26530f8d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:44.270336Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:44.270362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:44.270364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:44.270365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:44.270373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895292992607502:6416]
2025-09-30T14:52:44.270378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895292992607502:6416]
2025-09-30T14:52:44.270381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895292992607502:6416]
2025-09-30T14:52:44.270417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:44.270429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.270429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:44.270433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:44.270435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:44.270436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:44.270559Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:44.276436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 935 sessionId: src_id|b815c39f-23c232d2-fa75a072-26530f8d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:44.279169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:44.330685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895293082348878:7731]
2025-09-30T14:52:44.330962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 934, pipe: [1:7555895293082348878:7731]
2025-09-30T14:52:44.374160Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:44.374410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:44.374427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:44.374462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895293082348878:7731], now have 1 active actors on pipe
2025-09-30T14:52:44.374626Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:44.374678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:44.374684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895293082348878:7731]
2025-09-30T14:52:44.374701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:44.374769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 935 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b815c39f-23c232d2-fa75a072-26530f8d_0
2025-09-30T14:52:44.374952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 935 sessionId: src_id|b815c39f-23c232d2-fa75a072-26530f8d_0 is DEAD
2025-09-30T14:52:44.375091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b815c39f-23c232d2-fa75a072-26530f8d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:44.375098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b815c39f-23c232d2-fa75a072-26530f8d_0] Write session will restart in 0.005570s
2025-09-30T14:52:44.375121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b815c39f-23c232d2-fa75a072-26530f8d_0] Write session: Do CDS request
2025-09-30T14:52:44.375127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b815c39f-23c232d2-fa75a072-26530f8d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:44.381848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b815c39f-23c232d2-fa75a072-26530f8d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:44.381938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:44.381955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 936
2025-09-30T14:52:44.382055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 936 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:44.382086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 936 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:44.382095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=936 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:44.382099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:44.382512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 936 sessionId:  describe result for acl check
2025-09-30T14:52:44.382551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:44.382553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:44.382555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:44.382559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895293082348933:7925] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:44.383076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895293082348933:7925] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:44.385400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895293082348933:7925] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:44.388577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895293082348933:7925] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:44.388591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895293082348933:7925] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:44.388595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895293082348933:7925] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:44.388602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 936 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:44.391781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:44.394413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:44.394614Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:44.394619Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:44.394630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:44.394692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:44.395117Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895292992607807:6430]
2025-09-30T14:52:44.395750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:44.396023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:44.396067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:44.396389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:44.396453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:44.396460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:44.396461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:44.396462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:44.396464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:44.396465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:44.396466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:44.396467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:44.396468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:44.396470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:44.396471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.396472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.396473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.396474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:44.396475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:44.396480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:44.396491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:44.396495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:44.396499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:44.396504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:44.396508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:44.396512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:44.396516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:44.396521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:44.396525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:44.396530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.396534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.396537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.396541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:44.396546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:44.396553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:44.396561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:44.396567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:44.396572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:44.396576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:44.396581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:44.396585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:44.396591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:44.396595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:44.396601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:44.396605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:44.396610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:44.396615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:44.396623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:44.396627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:44.396637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:44.396642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:44.396647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:44.396651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:44.396660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:44.396665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.396670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.396678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.396684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.396689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.396694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.396698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:44.396703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:44.396708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:44.396712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:44.396762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:44.402122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:44.402950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:44.402968Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:44.402971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:44.402975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:44.402981Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 935 [2:7555895292992607807:6430]
2025-09-30T14:52:44.402997Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:44.403009Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:44.403017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:44.403021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:44.403023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:44.403038Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:44.403049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:44.403059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:44.403113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.403121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.403124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.403128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:44.403130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:44.403191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:44.403199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.403212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.403231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.403272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:44.403294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895293082349214:7925], now have 1 active actors on pipe
2025-09-30T14:52:44.403302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895293082348889:2454], now have 1 active actors on pipe
2025-09-30T14:52:44.403308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895292992607802:6430]
2025-09-30T14:52:44.403315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895292992607802:6430]
2025-09-30T14:52:44.403317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895292992607802:6430]
2025-09-30T14:52:44.403331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:44.403350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:44.403360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:44.403364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:44.403365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:44.403371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:44.403374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:44.403349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 935
2025-09-30T14:52:44.403355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 935
2025-09-30T14:52:44.403399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895292992607802:6430]
2025-09-30T14:52:44.403415Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:44.403431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:44.403434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:44.403439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:44.403477Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3103b78-6edbda06-e81966bb-cbabfb8b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:44.403490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:44.403498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:44.403501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:44.403511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:44.403524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:44.403543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:44.403701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:44.403712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:44.403726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:44.403797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 936 partition: 0 MaxSeqNo: 42 sessionId: src_id|c3103b78-6edbda06-e81966bb-cbabfb8b_0
2025-09-30T14:52:44.404166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b815c39f-23c232d2-fa75a072-26530f8d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c3103b78-6edbda06-e81966bb-cbabfb8b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:44.406784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3103b78-6edbda06-e81966bb-cbabfb8b_0] Write session: try to update token
2025-09-30T14:52:44.406799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3103b78-6edbda06-e81966bb-cbabfb8b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:44.414738Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:44.414764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:44.414767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:44.414769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:44.414777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895292992607802:6430]
2025-09-30T14:52:44.414782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895292992607802:6430]
2025-09-30T14:52:44.414786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895292992607802:6430]
2025-09-30T14:52:44.414826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:44.414827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:44.414832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:44.414838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:44.414838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.414841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:44.414971Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:44.420401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 936 sessionId: src_id|c3103b78-6edbda06-e81966bb-cbabfb8b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:44.423064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:44.475015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895293082349290:7731]
2025-09-30T14:52:44.475332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 935, pipe: [1:7555895293082349290:7731]
2025-09-30T14:52:44.515515Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:44.516029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:44.516048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:44.516091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895293082349290:7731], now have 1 active actors on pipe
2025-09-30T14:52:44.516289Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:44.516305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895293082349290:7731]
2025-09-30T14:52:44.516330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:44.516334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:44.516338Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:44.516404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 936 reason: error at write: Disconnected sessionId: src_id|c3103b78-6edbda06-e81966bb-cbabfb8b_0
2025-09-30T14:52:44.516610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 936 sessionId: src_id|c3103b78-6edbda06-e81966bb-cbabfb8b_0 is DEAD
2025-09-30T14:52:44.516751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3103b78-6edbda06-e81966bb-cbabfb8b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:44.516761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3103b78-6edbda06-e81966bb-cbabfb8b_0] Write session will restart in 0.009803s
2025-09-30T14:52:44.516783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3103b78-6edbda06-e81966bb-cbabfb8b_0] Write session: Do CDS request
2025-09-30T14:52:44.516787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3103b78-6edbda06-e81966bb-cbabfb8b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:44.527760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3103b78-6edbda06-e81966bb-cbabfb8b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:44.527819Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:44.527837Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 937
2025-09-30T14:52:44.527994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 937 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:44.528034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 937 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:44.528045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=937 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:44.528050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:44.528452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 937 sessionId:  describe result for acl check
2025-09-30T14:52:44.528493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:44.528500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:44.528505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:44.528527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895293082349538:7930] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:44.529066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895293082349538:7930] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:44.531140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895293082349538:7930] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:44.536133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895293082349538:7930] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:44.536148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895293082349538:7930] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:44.536151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895293082349538:7930] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:44.536141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:44.536158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 937 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:44.536557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:44.536715Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:44.536726Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:44.536737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:44.536781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:44.536817Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895292992608073:6432]
2025-09-30T14:52:44.537464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:44.537721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:44.537766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:44.538086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:44.538146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:44.538153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:44.538154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:44.538155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:44.538156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:44.538157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:44.538158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:44.538159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:44.538160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:44.538161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:44.538163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.538164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.538165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.538166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:44.538167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:44.538173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:44.538183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:44.538187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:44.538192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:44.538197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:44.538202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:44.538206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:44.538210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:44.538214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:44.538219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:44.538224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.538240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.538244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.538248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:44.538252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:44.538259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:44.538267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:44.538274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:44.538279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:44.538286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:44.538292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:44.538297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:44.538303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:44.538308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:44.538317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:44.538322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:44.538333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:44.538339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:44.538347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:44.538351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:44.538362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:44.538367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:44.538378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:44.538382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:44.538387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:44.538398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.538404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.538414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.538419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.538424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.538434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.538439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:44.538444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:44.538454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:44.538459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:44.538508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:44.543758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:44.545292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:44.545309Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:44.545311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:44.545314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:44.545319Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 936 [2:7555895292992608073:6432]
2025-09-30T14:52:44.545332Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:44.545343Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:44.545345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:44.545347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:44.545349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:44.545360Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:44.545379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:44.545384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:44.545428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.545435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.545436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.545438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:44.545440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:44.545489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:44.545495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.545503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.545509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.545522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:44.545535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895292992608067:6432]
2025-09-30T14:52:44.545541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895292992608067:6432]
2025-09-30T14:52:44.545542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895292992608067:6432]
2025-09-30T14:52:44.545547Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:44.545557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895293082349684:7930], now have 1 active actors on pipe
2025-09-30T14:52:44.545557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:44.545560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:44.545561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:44.545564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895293082349293:2454], now have 1 active actors on pipe
2025-09-30T14:52:44.545570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:44.545578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:44.545580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:44.545607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895292992608067:6432]
2025-09-30T14:52:44.545616Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:44.545625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:44.545637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 936
2025-09-30T14:52:44.545643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 936
2025-09-30T14:52:44.545699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:44.545709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:44.545734Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5411160-1c5d4cdb-149d6153-6f1ec021_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:44.545745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:44.545749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:44.545751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:44.545761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:44.545771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:44.545781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:44.545951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:44.545959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:44.545969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:44.546038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 937 partition: 0 MaxSeqNo: 42 sessionId: src_id|c5411160-1c5d4cdb-149d6153-6f1ec021_0
2025-09-30T14:52:44.546414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3103b78-6edbda06-e81966bb-cbabfb8b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c5411160-1c5d4cdb-149d6153-6f1ec021_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:44.549039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5411160-1c5d4cdb-149d6153-6f1ec021_0] Write session: try to update token
2025-09-30T14:52:44.549056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5411160-1c5d4cdb-149d6153-6f1ec021_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:44.557468Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:44.557503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:44.557510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895292992608067:6432]
2025-09-30T14:52:44.557547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:44.557550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:44.557732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:44.557867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:44.558013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:44.558148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:44.558341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:44.558374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:44.561800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 937 sessionId: src_id|c5411160-1c5d4cdb-149d6153-6f1ec021_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:44.564366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:44.564531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:44.564549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:44.564574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:44.564668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:44.567517Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:44.567534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:44.567536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:44.567537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:44.567544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895292992608067:6432]
2025-09-30T14:52:44.567547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895292992608067:6432]
2025-09-30T14:52:44.567550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895292992608067:6432]
2025-09-30T14:52:44.567579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:44.567584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.567586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:44.567585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:44.567590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:44.567593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:44.567709Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:44.616417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895293082349696:7731]
2025-09-30T14:52:44.616915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 936, pipe: [1:7555895293082349696:7731]
2025-09-30T14:52:44.670207Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:44.677570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:44.677599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:44.677748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:44.677808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:44.677877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:44.677935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:44.678276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:44.678286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:44.678353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:44.678407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:44.678467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:44.678533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:44.678574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:44.678581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:44.678652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:44.678712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:44.678768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:44.678835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:44.678883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:44.678889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:44.678953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:44.679019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:44.679078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:44.679140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:44.679185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:44.679190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:44.679269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:44.679334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:44.679402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:44.679463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:44.679514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:44.679523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:44.679593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:44.679655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:44.679719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:44.679780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:44.679827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:44.679835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:44.679902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:44.679961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:44.680029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:44.680090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:44.680136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:44.680143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:44.680213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:44.680274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:44.680335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:44.680404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:44.680448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:44.680454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:44.680525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:44.680587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:44.680648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:44.680711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:44.680752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:44.680757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:44.680817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:44.680870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:44.680935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:44.680993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:44.681034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:44.681041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:44.681102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895293082349696:7731], now have 1 active actors on pipe
2025-09-30T14:52:44.681362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:44.681377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:44.681400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 937 reason: error at write: Disconnected sessionId: src_id|c5411160-1c5d4cdb-149d6153-6f1ec021_0
2025-09-30T14:52:44.681581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 937 sessionId: src_id|c5411160-1c5d4cdb-149d6153-6f1ec021_0 is DEAD
2025-09-30T14:52:44.681656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895293082349696:7731]
2025-09-30T14:52:44.681681Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:44.681687Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:44.681725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5411160-1c5d4cdb-149d6153-6f1ec021_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:44.681734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5411160-1c5d4cdb-149d6153-6f1ec021_0] Write session will restart in 0.008333s
2025-09-30T14:52:44.681751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5411160-1c5d4cdb-149d6153-6f1ec021_0] Write session: Do CDS request
2025-09-30T14:52:44.681755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5411160-1c5d4cdb-149d6153-6f1ec021_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:44.690743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5411160-1c5d4cdb-149d6153-6f1ec021_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:44.690828Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:44.690843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 938
2025-09-30T14:52:44.690989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 938 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:44.691024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 938 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:44.691033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=938 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:44.691046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:44.691447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 938 sessionId:  describe result for acl check
2025-09-30T14:52:44.691479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:44.691485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:44.691487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:44.691492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895293082349806:7934] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:44.692226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895293082349806:7934] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:44.694366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895293082349806:7934] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:44.696839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895293082349806:7934] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:44.696853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895293082349806:7934] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:44.696856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895293082349806:7934] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:44.696863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 938 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:44.700918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:44.703864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:44.704037Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:44.704046Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:44.704055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:44.704106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:44.704139Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895292992608342:6435]
2025-09-30T14:52:44.704770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:44.705023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:44.705060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:44.705366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:44.705420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:44.705426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:44.705427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:44.705429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:44.705430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:44.705431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:44.705432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:44.705433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:44.705434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:44.705435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:44.705437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.705438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.705439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.705440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:44.705441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:44.705445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:44.705456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:44.705460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:44.705464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:44.705468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:44.705473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:44.705477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:44.705480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:44.705485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:44.705490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:44.705494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.705498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.705502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.705506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:44.705510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:44.705516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:44.705524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:44.705530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:44.705536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:44.705546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:44.705551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:44.705556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:44.705561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:44.705570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:44.705575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:44.705583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:44.705589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:44.705593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:44.705597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:44.705603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:44.705608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:44.705613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:44.705618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:44.705622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:44.705627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:44.705631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.705637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.705641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.705651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.705655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.705665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.705673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:44.705683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:44.705692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:44.705701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:44.705750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:44.710653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:44.711688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:44.711702Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:44.711703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:44.711706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:44.711711Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 937 [2:7555895292992608342:6435]
2025-09-30T14:52:44.711722Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:44.711737Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:44.711743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:44.711745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:44.711746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:44.711756Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:44.711761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:44.711766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:44.711803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.711809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.711810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.711813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:44.711815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:44.711861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:44.711867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.711875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.711885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.711897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:44.711914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895293082350025:7934], now have 1 active actors on pipe
2025-09-30T14:52:44.711920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895293082349697:2454], now have 1 active actors on pipe
2025-09-30T14:52:44.711925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895292992608337:6435]
2025-09-30T14:52:44.711926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895292992608337:6435]
2025-09-30T14:52:44.711929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895292992608337:6435]
2025-09-30T14:52:44.711940Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:44.711952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:44.711963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:44.711968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:44.711988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895292992608337:6435]
2025-09-30T14:52:44.711994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:44.712017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 937
2025-09-30T14:52:44.712020Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 937
2025-09-30T14:52:44.712053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:44.712065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:44.712068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:44.712074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:44.712239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:44.712247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:44.712267Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d6e678-b87f61db-1b52ce0-ec370e89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:44.712276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:44.712278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:44.712279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:44.712286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:44.712292Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:44.712306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:44.712471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:44.712478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:44.712489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:44.712633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 938 partition: 0 MaxSeqNo: 42 sessionId: src_id|1d6e678-b87f61db-1b52ce0-ec370e89_0
2025-09-30T14:52:44.712979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5411160-1c5d4cdb-149d6153-6f1ec021_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1d6e678-b87f61db-1b52ce0-ec370e89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:44.715582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d6e678-b87f61db-1b52ce0-ec370e89_0] Write session: try to update token
2025-09-30T14:52:44.715597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d6e678-b87f61db-1b52ce0-ec370e89_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:44.723569Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:44.723593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:44.723595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:44.723597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:44.723607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895292992608337:6435]
2025-09-30T14:52:44.723612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895292992608337:6435]
2025-09-30T14:52:44.723616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895292992608337:6435]
2025-09-30T14:52:44.723649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:44.723653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:44.723655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:44.723658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:44.723659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.723662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:44.723813Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:44.729370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 938 sessionId: src_id|1d6e678-b87f61db-1b52ce0-ec370e89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:44.732092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:44.781786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895293082350101:7731]
2025-09-30T14:52:44.782114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 937, pipe: [1:7555895293082350101:7731]
2025-09-30T14:52:44.829299Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:44.829945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:44.829959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:44.829990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895293082350101:7731], now have 1 active actors on pipe
2025-09-30T14:52:44.830171Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:44.830246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895293082350101:7731]
2025-09-30T14:52:44.830250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:44.830254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:44.830290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:44.830313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 938 reason: error at write: Disconnected sessionId: src_id|1d6e678-b87f61db-1b52ce0-ec370e89_0
2025-09-30T14:52:44.830489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 938 sessionId: src_id|1d6e678-b87f61db-1b52ce0-ec370e89_0 is DEAD
2025-09-30T14:52:44.830686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d6e678-b87f61db-1b52ce0-ec370e89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:44.830697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d6e678-b87f61db-1b52ce0-ec370e89_0] Write session will restart in 0.006883s
2025-09-30T14:52:44.830719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d6e678-b87f61db-1b52ce0-ec370e89_0] Write session: Do CDS request
2025-09-30T14:52:44.830724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d6e678-b87f61db-1b52ce0-ec370e89_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:44.838746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d6e678-b87f61db-1b52ce0-ec370e89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:44.838868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:44.838885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 939
2025-09-30T14:52:44.839013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 939 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:44.839046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 939 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:44.839056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=939 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:44.839060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:44.839491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 939 sessionId:  describe result for acl check
2025-09-30T14:52:44.839525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:44.839531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:44.839533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:44.839539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895293082350211:7938] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:44.840059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895293082350211:7938] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:44.842191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895293082350211:7938] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:44.844924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895293082350211:7938] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:44.844937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895293082350211:7938] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:44.844940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895293082350211:7938] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:44.844962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 939 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:44.850589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:44.851212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:44.851394Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:44.851404Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:44.851413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:44.851454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:44.851490Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895292992608610:6437]
2025-09-30T14:52:44.852109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:44.852418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:44.852457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:44.852778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:44.852832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:44.852838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:44.852839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:44.852840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:44.852841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:44.852843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:44.852844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:44.852845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:44.852846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:44.852847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:44.852848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.852849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.852850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.852851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:44.852852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:44.852857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:44.852866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:44.852869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:44.852873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:44.852876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:44.852880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:44.852883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:44.852887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:44.852890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:44.852894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:44.852897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.852901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.852904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.852907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:44.852911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:44.852918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:44.852925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:44.852936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:44.852946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:44.852955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:44.852962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:44.852969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:44.852974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:44.852983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:44.852991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:44.853000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:44.853007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:44.853016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:44.853021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:44.853029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:44.853033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:44.853042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:44.853051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:44.853059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:44.853064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:44.853072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.853078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.853086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.853091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.853099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.853104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.853111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:44.853116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:44.853124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:44.853133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:44.853174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:44.859026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:44.860616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:44.860634Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:44.860637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:44.860641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:44.860647Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 938 [2:7555895292992608610:6437]
2025-09-30T14:52:44.860665Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:44.860682Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:44.860686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:44.860689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:44.860691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:44.860706Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:44.860715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:44.860725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:44.860787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.860795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.860798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.860802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:44.860804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:44.860871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:44.860881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.860893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:44.860908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:44.860931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:44.860954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895293082350465:7938], now have 1 active actors on pipe
2025-09-30T14:52:44.860963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895293082350102:2454], now have 1 active actors on pipe
2025-09-30T14:52:44.860969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895292992608605:6437]
2025-09-30T14:52:44.860972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895292992608605:6437]
2025-09-30T14:52:44.860975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895292992608605:6437]
2025-09-30T14:52:44.860986Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:44.861002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:44.861006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:44.861007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:44.861008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:44.861023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:44.861035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:44.861069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895292992608605:6437]
2025-09-30T14:52:44.861082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:44.861094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:44.861117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 938
2025-09-30T14:52:44.861126Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 938
2025-09-30T14:52:44.861201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:44.861213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:44.861241Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b81691-7071bf01-825d2a88-ffab3cf2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:44.861254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:44.861258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:44.861265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:44.861275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:44.861286Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:44.861301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:44.861534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:44.861551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:44.861573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:44.861728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 939 partition: 0 MaxSeqNo: 42 sessionId: src_id|2b81691-7071bf01-825d2a88-ffab3cf2_0
2025-09-30T14:52:44.862060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d6e678-b87f61db-1b52ce0-ec370e89_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2b81691-7071bf01-825d2a88-ffab3cf2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:44.864947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b81691-7071bf01-825d2a88-ffab3cf2_0] Write session: try to update token
2025-09-30T14:52:44.864969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b81691-7071bf01-825d2a88-ffab3cf2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:44.873268Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:44.873290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:44.873293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:44.873295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:44.873305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895292992608605:6437]
2025-09-30T14:52:44.873309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895292992608605:6437]
2025-09-30T14:52:44.873312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895292992608605:6437]
2025-09-30T14:52:44.873345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:44.873352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:44.873355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:44.873359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:44.873366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:44.873371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:44.873534Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:44.879177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 939 sessionId: src_id|2b81691-7071bf01-825d2a88-ffab3cf2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:44.881828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:44.930247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895293082350507:7731]
2025-09-30T14:52:44.930552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 938, pipe: [1:7555895293082350507:7731]
2025-09-30T14:52:44.980691Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:44.981501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:44.981519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:44.981554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895293082350507:7731], now have 1 active actors on pipe
2025-09-30T14:52:44.981770Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:44.981787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:44.981806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:44.981828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895293082350507:7731]
2025-09-30T14:52:44.981850Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:44.981870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 939 reason: error at write: Disconnected sessionId: src_id|2b81691-7071bf01-825d2a88-ffab3cf2_0
2025-09-30T14:52:44.982039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 939 sessionId: src_id|2b81691-7071bf01-825d2a88-ffab3cf2_0 is DEAD
2025-09-30T14:52:44.982176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b81691-7071bf01-825d2a88-ffab3cf2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:44.982187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b81691-7071bf01-825d2a88-ffab3cf2_0] Write session will restart in 0.009830s
2025-09-30T14:52:44.982218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b81691-7071bf01-825d2a88-ffab3cf2_0] Write session: Do CDS request
2025-09-30T14:52:44.982240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b81691-7071bf01-825d2a88-ffab3cf2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:44.992737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b81691-7071bf01-825d2a88-ffab3cf2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:44.992820Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:44.992848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 940
2025-09-30T14:52:44.992990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 940 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:44.993023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 940 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:44.993028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=940 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:44.993032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:44.993478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 940 sessionId:  describe result for acl check
2025-09-30T14:52:44.993513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:44.993520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:44.993522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:44.993529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895293082350649:7942] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:44.994084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895293082350649:7942] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:44.996218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895293082350649:7942] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:44.998776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895293082350649:7942] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:44.998791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895293082350649:7942] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:44.998797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895293082350649:7942] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:44.998805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 940 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:45.005238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:45.005784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:45.005951Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:45.005962Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:45.005971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:45.006017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:45.006058Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895297287576175:6439]
2025-09-30T14:52:45.006670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:45.007001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:45.007054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:45.007403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:45.007479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:45.007487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:45.007488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:45.007489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:45.007490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:45.007491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:45.007493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:45.007494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:45.007496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:45.007497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:45.007498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.007499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.007500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.007501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:45.007502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:45.007508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:45.007517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:45.007522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:45.007526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:45.007531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:45.007535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:45.007539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:45.007543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:45.007548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:45.007552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:45.007556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.007562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.007567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.007571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:45.007579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:45.007586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:45.007598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:45.007607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:45.007617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:45.007624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:45.007629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:45.007633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:45.007639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:45.007647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:45.007652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:45.007662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:45.007667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:45.007674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:45.007679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:45.007684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:45.007689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:45.007695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:45.007700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:45.007704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:45.007711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:45.007722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.007731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.007738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.007745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.007754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.007758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.007767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:45.007771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:45.007776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:45.007785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:45.007830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:45.013175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:45.014624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:45.014642Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:45.014645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:45.014649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:45.014655Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 939 [2:7555895297287576175:6439]
2025-09-30T14:52:45.014668Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:45.014682Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:45.014685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:45.014687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:45.014690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:45.014704Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:45.014715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:45.014721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:45.014771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.014778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.014779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.014783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:45.014786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:45.014848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:45.014856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.014864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.014869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.014880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:45.014895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895297287576170:6439]
2025-09-30T14:52:45.014897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895297287576170:6439]
2025-09-30T14:52:45.014899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895297287576170:6439]
2025-09-30T14:52:45.014906Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:45.014917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:45.014918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895293082350861:7942], now have 1 active actors on pipe
2025-09-30T14:52:45.014920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:45.014921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895293082350508:2454], now have 1 active actors on pipe
2025-09-30T14:52:45.014922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:45.014927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:45.014936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:45.014937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:45.014957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895297287576170:6439]
2025-09-30T14:52:45.014963Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:45.014978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:45.015004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 939
2025-09-30T14:52:45.015008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 939
2025-09-30T14:52:45.015064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:45.015074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:45.015098Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e145f514-e9467bc6-a5b77bd8-832ab83c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:45.015110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:45.015114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:45.015115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:45.015124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:45.015138Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:45.015156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:45.015376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:45.015390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:45.015413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:45.015505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 940 partition: 0 MaxSeqNo: 42 sessionId: src_id|e145f514-e9467bc6-a5b77bd8-832ab83c_0
2025-09-30T14:52:45.015867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b81691-7071bf01-825d2a88-ffab3cf2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e145f514-e9467bc6-a5b77bd8-832ab83c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:45.018533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e145f514-e9467bc6-a5b77bd8-832ab83c_0] Write session: try to update token
2025-09-30T14:52:45.018550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e145f514-e9467bc6-a5b77bd8-832ab83c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:45.027088Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:45.027109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:45.027111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:45.027113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:45.027121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895297287576170:6439]
2025-09-30T14:52:45.027126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895297287576170:6439]
2025-09-30T14:52:45.027129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895297287576170:6439]
2025-09-30T14:52:45.027171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:45.027170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:45.027176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:45.027177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.027178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:45.027180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:45.027333Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:45.032152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 940 sessionId: src_id|e145f514-e9467bc6-a5b77bd8-832ab83c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:45.034778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:45.081803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895297377318234:7731]
2025-09-30T14:52:45.082074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 939, pipe: [1:7555895297377318234:7731]
2025-09-30T14:52:45.131065Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:45.131587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:45.131600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:45.131632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895297377318234:7731], now have 1 active actors on pipe
2025-09-30T14:52:45.131846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:45.131863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:45.131867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895297377318234:7731]
2025-09-30T14:52:45.131889Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:45.131948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 940 reason: error at write: Disconnected sessionId: src_id|e145f514-e9467bc6-a5b77bd8-832ab83c_0
2025-09-30T14:52:45.131979Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:45.132121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 940 sessionId: src_id|e145f514-e9467bc6-a5b77bd8-832ab83c_0 is DEAD
2025-09-30T14:52:45.132265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e145f514-e9467bc6-a5b77bd8-832ab83c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:45.132276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e145f514-e9467bc6-a5b77bd8-832ab83c_0] Write session will restart in 0.007505s
2025-09-30T14:52:45.132299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e145f514-e9467bc6-a5b77bd8-832ab83c_0] Write session: Do CDS request
2025-09-30T14:52:45.132305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e145f514-e9467bc6-a5b77bd8-832ab83c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:45.140811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e145f514-e9467bc6-a5b77bd8-832ab83c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:45.140883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:45.140902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 941
2025-09-30T14:52:45.141062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 941 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:45.141100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 941 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:45.141114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=941 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:45.141126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:45.141572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 941 sessionId:  describe result for acl check
2025-09-30T14:52:45.141621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:45.141631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:45.141633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:45.141639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895297377318322:7949] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:45.142180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895297377318322:7949] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:45.144665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895297377318322:7949] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:45.147885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895297377318322:7949] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:45.147915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895297377318322:7949] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:45.147919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895297377318322:7949] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:45.147927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 941 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:45.151028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:45.153837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:45.154011Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:45.154018Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:45.154027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:45.154063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:45.154093Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895297287576459:6443]
2025-09-30T14:52:45.154568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:45.154849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:45.154886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:45.155108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:45.155145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:45.155150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:45.155151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:45.155152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:45.155153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:45.155153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:45.155154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:45.155155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:45.155155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:45.155156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:45.155157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.155158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.155159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.155159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:45.155160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:45.155164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:45.155171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:45.155173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:45.155176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:45.155178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:45.155180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:45.155183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:45.155185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:45.155188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:45.155190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:45.155192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.155195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.155199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.155203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:45.155207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:45.155214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:45.155222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:45.155230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:45.155234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:45.155240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:45.155264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:45.155268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:45.155277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:45.155281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:45.155291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:45.155299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:45.155304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:45.155313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:45.155318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:45.155327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:45.155332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:45.155336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:45.155340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:45.155344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:45.155349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:45.155357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.155362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.155370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.155374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.155383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.155388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.155397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:45.155406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:45.155415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:45.155424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:45.155449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:45.160580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:45.162031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:45.162046Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:45.162048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:45.162052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:45.162057Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 940 [2:7555895297287576459:6443]
2025-09-30T14:52:45.162071Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:45.162081Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:45.162083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:45.162085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:45.162086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:45.162099Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:45.162105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:45.162112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:45.162172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.162180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.162182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.162185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:45.162188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:45.162257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:45.162265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.162276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.162290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.162308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:45.162330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895297377318235:2454], now have 1 active actors on pipe
2025-09-30T14:52:45.162338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895297377318586:7949], now have 1 active actors on pipe
2025-09-30T14:52:45.162344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895297287576454:6443]
2025-09-30T14:52:45.162346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895297287576454:6443]
2025-09-30T14:52:45.162348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895297287576454:6443]
2025-09-30T14:52:45.162359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:45.162373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:45.162390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:45.162391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:45.162395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:45.162399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:45.162405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:45.162422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895297287576454:6443]
2025-09-30T14:52:45.162425Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:45.162398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 940
2025-09-30T14:52:45.162398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 940
2025-09-30T14:52:45.162436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:45.162448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:45.162451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:45.162476Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5e66a9e-a6723189-98c8fbd5-ecb1f058_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:45.162487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:45.162490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:45.162491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:45.162498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:45.162505Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:45.162522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:45.162712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:45.162719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:45.162732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:45.162819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 941 partition: 0 MaxSeqNo: 42 sessionId: src_id|c5e66a9e-a6723189-98c8fbd5-ecb1f058_0
2025-09-30T14:52:45.163181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e145f514-e9467bc6-a5b77bd8-832ab83c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c5e66a9e-a6723189-98c8fbd5-ecb1f058_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:45.165869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5e66a9e-a6723189-98c8fbd5-ecb1f058_0] Write session: try to update token
2025-09-30T14:52:45.165891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5e66a9e-a6723189-98c8fbd5-ecb1f058_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:45.174509Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:45.174525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:45.174528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:45.174529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:45.174539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895297287576454:6443]
2025-09-30T14:52:45.174543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895297287576454:6443]
2025-09-30T14:52:45.174548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895297287576454:6443]
2025-09-30T14:52:45.174589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:45.174591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:45.174597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:45.174598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.174600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:45.174600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:45.174729Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:45.179770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 941 sessionId: src_id|c5e66a9e-a6723189-98c8fbd5-ecb1f058_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:45.182459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:45.231806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895297377318642:7731]
2025-09-30T14:52:45.232061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 940, pipe: [1:7555895297377318642:7731]
2025-09-30T14:52:45.282270Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:45.282544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:45.282560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:45.282600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895297377318642:7731], now have 1 active actors on pipe
2025-09-30T14:52:45.282808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:45.282827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:45.282834Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:45.282876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895297377318642:7731]
2025-09-30T14:52:45.282815Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:45.282902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 941 reason: error at write: Disconnected sessionId: src_id|c5e66a9e-a6723189-98c8fbd5-ecb1f058_0
2025-09-30T14:52:45.283060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 941 sessionId: src_id|c5e66a9e-a6723189-98c8fbd5-ecb1f058_0 is DEAD
2025-09-30T14:52:45.283210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5e66a9e-a6723189-98c8fbd5-ecb1f058_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:45.283222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5e66a9e-a6723189-98c8fbd5-ecb1f058_0] Write session will restart in 0.008483s
2025-09-30T14:52:45.283258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5e66a9e-a6723189-98c8fbd5-ecb1f058_0] Write session: Do CDS request
2025-09-30T14:52:45.283269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5e66a9e-a6723189-98c8fbd5-ecb1f058_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:45.292739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5e66a9e-a6723189-98c8fbd5-ecb1f058_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:45.292828Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:45.292847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 942
2025-09-30T14:52:45.292961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 942 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:45.292991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 942 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:45.292996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=942 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:45.293000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:45.293501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 942 sessionId:  describe result for acl check
2025-09-30T14:52:45.293538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:45.293540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:45.293542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:45.293548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895297377318739:7953] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:45.294087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895297377318739:7953] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:45.296288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895297377318739:7953] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:45.299115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895297377318739:7953] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:45.299128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895297377318739:7953] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:45.299131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895297377318739:7953] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:45.299139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 942 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:45.304637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:45.308012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:45.308223Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:45.308237Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:45.308249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:45.308310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:45.308353Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895297287576730:6445]
2025-09-30T14:52:45.308982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:45.309373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:45.309426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:45.309755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:45.309870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:45.309881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:45.309882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:45.309884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:45.309885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:45.309886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:45.309888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:45.309889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:45.309890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:45.309892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:45.309893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.309894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.309895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.309897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:45.309898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:45.309905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:45.309915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:45.309919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:45.309923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:45.309927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:45.309931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:45.309935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:45.309939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:45.309943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:45.309948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:45.309952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.309956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.309960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.309964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:45.309969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:45.309977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:45.309984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:45.309997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:45.310007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:45.310016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:45.310022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:45.310032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:45.310038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:45.310046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:45.310052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:45.310060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:45.310065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:45.310070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:45.310079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:45.310084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:45.310089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:45.310099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:45.310110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:45.310119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:45.310126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:45.310131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.310141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.310151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.310162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.310171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.310179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.310185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:45.310193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:45.310199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:45.310204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:45.310267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:45.315437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:45.316356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:45.316372Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:45.316375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:45.316378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:45.316384Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 941 [2:7555895297287576730:6445]
2025-09-30T14:52:45.316400Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:45.316421Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:45.316428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:45.316431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:45.316433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:45.316449Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:45.316461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:45.316468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:45.316523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.316532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.316534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.316538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:45.316540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:45.316605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:45.316615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.316627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.316639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.316656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:45.316679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895297377318643:2454], now have 1 active actors on pipe
2025-09-30T14:52:45.316688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895297377318958:7953], now have 1 active actors on pipe
2025-09-30T14:52:45.316694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895297287576725:6445]
2025-09-30T14:52:45.316697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895297287576725:6445]
2025-09-30T14:52:45.316700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895297287576725:6445]
2025-09-30T14:52:45.316714Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:45.316733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:45.316734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:45.316737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:45.316739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:45.316751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:45.316754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:45.316738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 941
2025-09-30T14:52:45.316785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895297287576725:6445]
2025-09-30T14:52:45.316764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 941
2025-09-30T14:52:45.316798Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:45.316802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:45.316823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:45.316833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:45.316885Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56740ea3-758edd55-d3408909-4b440622_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:45.316897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:45.316900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:45.316903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:45.316912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:45.316926Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:45.316950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:45.317099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:45.317110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:45.317127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:45.317193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 942 partition: 0 MaxSeqNo: 42 sessionId: src_id|56740ea3-758edd55-d3408909-4b440622_0
2025-09-30T14:52:45.317538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5e66a9e-a6723189-98c8fbd5-ecb1f058_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|56740ea3-758edd55-d3408909-4b440622_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:45.320321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56740ea3-758edd55-d3408909-4b440622_0] Write session: try to update token
2025-09-30T14:52:45.320343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56740ea3-758edd55-d3408909-4b440622_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:45.328422Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:45.328439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:45.328442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:45.328444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:45.328453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895297287576725:6445]
2025-09-30T14:52:45.328462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895297287576725:6445]
2025-09-30T14:52:45.328466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895297287576725:6445]
2025-09-30T14:52:45.328506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:45.328512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.328514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:45.328517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:45.328525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:45.328529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:45.328639Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:45.334389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 942 sessionId: src_id|56740ea3-758edd55-d3408909-4b440622_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:45.336821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:45.382843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895297377319073:7731]
2025-09-30T14:52:45.383096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 941, pipe: [1:7555895297377319073:7731]
2025-09-30T14:52:45.437097Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:45.437376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:45.437391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:45.437427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895297377319073:7731], now have 1 active actors on pipe
2025-09-30T14:52:45.437627Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:45.437658Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:45.437707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:45.437781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 942 reason: status is not ok: tablet will be restarted right now sessionId: src_id|56740ea3-758edd55-d3408909-4b440622_0
2025-09-30T14:52:45.437935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 942 sessionId: src_id|56740ea3-758edd55-d3408909-4b440622_0 is DEAD
2025-09-30T14:52:45.438002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895297377319073:7731]
2025-09-30T14:52:45.438077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56740ea3-758edd55-d3408909-4b440622_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:45.438087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56740ea3-758edd55-d3408909-4b440622_0] Write session will restart in 0.006288s
2025-09-30T14:52:45.438111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56740ea3-758edd55-d3408909-4b440622_0] Write session: Do CDS request
2025-09-30T14:52:45.438116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56740ea3-758edd55-d3408909-4b440622_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:45.445762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56740ea3-758edd55-d3408909-4b440622_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:45.445813Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:45.445830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 943
2025-09-30T14:52:45.445998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 943 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:45.446030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 943 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:45.446040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=943 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:45.446044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:45.446488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 943 sessionId:  describe result for acl check
2025-09-30T14:52:45.446523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:45.446532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:45.446534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:45.446539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895297377319114:7964] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:45.447039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895297377319114:7964] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:45.449616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895297377319114:7964] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:45.452328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895297377319114:7964] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:45.452341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895297377319114:7964] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:45.452344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895297377319114:7964] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:45.452352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 943 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:45.458445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:45.461999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:45.462615Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:45.462627Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:45.462642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:45.462715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:45.462760Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895297287577039:6459]
2025-09-30T14:52:45.463456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:45.463819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:45.463884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:45.464213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:45.464315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:45.464321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:45.464323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:45.464324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:45.464325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:45.464326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:45.464327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:45.464329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:45.464329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:45.464331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:45.464332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.464333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.464334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.464335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:45.464337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:45.464343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:45.464354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:45.464359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:45.464363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:45.464367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:45.464370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:45.464372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:45.464374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:45.464377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:45.464380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:45.464382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.464384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.464387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.464389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:45.464391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:45.464398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:45.464403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:45.464407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:45.464411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:45.464413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:45.464417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:45.464419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:45.464422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:45.464427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:45.464430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:45.464434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:45.464437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:45.464441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:45.464443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:45.464446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:45.464449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:45.464451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:45.464454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:45.464456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:45.464459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:45.464462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.464465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.464467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.464478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.464481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.464484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.464486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:45.464489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:45.464492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:45.464495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:45.464518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:45.470034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:45.471405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:45.471418Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:45.471420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:45.471424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:45.471430Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 942 [2:7555895297287577039:6459]
2025-09-30T14:52:45.471448Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:45.471463Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:45.471467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:45.471470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:45.471472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:45.471488Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:45.471495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:45.471502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:45.471565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.471574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.471576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.471580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:45.471582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:45.471650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:45.471659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.471675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.471687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.471706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:45.471732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895297377319348:7964], now have 1 active actors on pipe
2025-09-30T14:52:45.471744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895297377319074:2454], now have 1 active actors on pipe
2025-09-30T14:52:45.471751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895297287577034:6459]
2025-09-30T14:52:45.471753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895297287577034:6459]
2025-09-30T14:52:45.471755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895297287577034:6459]
2025-09-30T14:52:45.471768Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:45.471784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:45.471787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:45.471791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:45.471793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:45.471815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:45.471822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:45.471852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895297287577034:6459]
2025-09-30T14:52:45.471865Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:45.471847Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 942
2025-09-30T14:52:45.471877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:45.471862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 942
2025-09-30T14:52:45.471902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:45.471913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:45.471945Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d6f1653-37617416-ec0180d6-5a2f57ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:45.471956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:45.471960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:45.471967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:45.471976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:45.471989Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:45.472009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:45.472171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:45.472178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:45.472192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:45.472290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 943 partition: 0 MaxSeqNo: 42 sessionId: src_id|6d6f1653-37617416-ec0180d6-5a2f57ee_0
2025-09-30T14:52:45.472638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56740ea3-758edd55-d3408909-4b440622_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6d6f1653-37617416-ec0180d6-5a2f57ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:45.475320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6f1653-37617416-ec0180d6-5a2f57ee_0] Write session: try to update token
2025-09-30T14:52:45.475336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6f1653-37617416-ec0180d6-5a2f57ee_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:45.483707Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:45.483726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:45.483729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:45.483731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:45.483740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895297287577034:6459]
2025-09-30T14:52:45.483744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895297287577034:6459]
2025-09-30T14:52:45.483748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895297287577034:6459]
2025-09-30T14:52:45.483789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:45.483796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.483797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:45.483799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:45.483803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:45.483807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:45.483942Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:45.488831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 943 sessionId: src_id|6d6f1653-37617416-ec0180d6-5a2f57ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:45.491644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:45.538003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895297377319485:7731]
2025-09-30T14:52:45.538340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 942, pipe: [1:7555895297377319485:7731]
2025-09-30T14:52:45.588349Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:45.588793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:45.588810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:45.588847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895297377319485:7731], now have 1 active actors on pipe
2025-09-30T14:52:45.589017Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:45.589087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:45.589105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:45.589115Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:45.589161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895297377319485:7731]
2025-09-30T14:52:45.589171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 943 reason: error at write: Disconnected sessionId: src_id|6d6f1653-37617416-ec0180d6-5a2f57ee_0
2025-09-30T14:52:45.589351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 943 sessionId: src_id|6d6f1653-37617416-ec0180d6-5a2f57ee_0 is DEAD
2025-09-30T14:52:45.589491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6f1653-37617416-ec0180d6-5a2f57ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:45.589502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6f1653-37617416-ec0180d6-5a2f57ee_0] Write session will restart in 0.008049s
2025-09-30T14:52:45.589533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6f1653-37617416-ec0180d6-5a2f57ee_0] Write session: Do CDS request
2025-09-30T14:52:45.589542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6f1653-37617416-ec0180d6-5a2f57ee_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:45.598754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6f1653-37617416-ec0180d6-5a2f57ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:45.598837Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:45.598854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 944
2025-09-30T14:52:45.598997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 944 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:45.599032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 944 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:45.599042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=944 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:45.599046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:45.599444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 944 sessionId:  describe result for acl check
2025-09-30T14:52:45.599475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:45.599476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:45.599478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:45.599483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895297377319616:7969] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:45.600063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895297377319616:7969] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:45.602263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895297377319616:7969] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:45.604721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895297377319616:7969] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:45.604736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895297377319616:7969] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:45.604740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895297377319616:7969] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:45.604748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 944 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:45.610799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:45.611429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:45.611609Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:45.611619Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:45.611631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:45.611691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:45.611729Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895297287577315:6462]
2025-09-30T14:52:45.612366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:45.612695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:45.612741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:45.613028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:45.613087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:45.613092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:45.613093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:45.613094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:45.613095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:45.613095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:45.613096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:45.613097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:45.613098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:45.613099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:45.613099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.613100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.613101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.613102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:45.613102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:45.613106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:45.613113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:45.613116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:45.613118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:45.613120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:45.613123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:45.613125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:45.613128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:45.613130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:45.613133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:45.613135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.613138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.613140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.613142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:45.613144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:45.613150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:45.613155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:45.613159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:45.613163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:45.613165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:45.613169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:45.613171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:45.613175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:45.613178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:45.613181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:45.613183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:45.613187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:45.613189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:45.613192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:45.613195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:45.613198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:45.613201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:45.613204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:45.613206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:45.613209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:45.613211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.613215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.613221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.613226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.613230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.613235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.613240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:45.613245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:45.613250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:45.613255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:45.613279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:45.618380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:45.619771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:45.619782Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:45.619784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:45.619787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:45.619792Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 943 [2:7555895297287577315:6462]
2025-09-30T14:52:45.619802Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:45.619816Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:45.619818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:45.619820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:45.619822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:45.619833Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:45.619838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:45.619844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:45.619889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.619897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.619899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.619903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:45.619906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:45.619958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:45.619964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.619973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.619980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.619998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:45.620017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895297287577310:6462]
2025-09-30T14:52:45.620026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895297287577310:6462]
2025-09-30T14:52:45.620028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895297287577310:6462]
2025-09-30T14:52:45.620034Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:45.620044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:45.620049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895297377319838:7969], now have 1 active actors on pipe
2025-09-30T14:52:45.620052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895297377319486:2454], now have 1 active actors on pipe
2025-09-30T14:52:45.620055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:45.620058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:45.620060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:45.620073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:45.620076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:45.620105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895297287577310:6462]
2025-09-30T14:52:45.620118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:45.620136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:45.620108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 943
2025-09-30T14:52:45.620111Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 943
2025-09-30T14:52:45.620186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:45.620198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:45.620222Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f31326f7-735ac281-81db0965-3aa50aea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:45.620233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:45.620236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:45.620238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:45.620247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:45.620261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:45.620274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:45.620438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:45.620458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:45.620478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:45.620612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 944 partition: 0 MaxSeqNo: 42 sessionId: src_id|f31326f7-735ac281-81db0965-3aa50aea_0
2025-09-30T14:52:45.621011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6f1653-37617416-ec0180d6-5a2f57ee_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f31326f7-735ac281-81db0965-3aa50aea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:45.623935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f31326f7-735ac281-81db0965-3aa50aea_0] Write session: try to update token
2025-09-30T14:52:45.623953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f31326f7-735ac281-81db0965-3aa50aea_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:45.631725Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:45.631740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:45.631749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895297287577310:6462]
2025-09-30T14:52:45.631794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:45.631797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:45.632041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:45.632267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:45.632480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:45.632684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:45.632976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:45.633019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:45.638156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 944 sessionId: src_id|f31326f7-735ac281-81db0965-3aa50aea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:45.640886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:45.642104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:45.642126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:45.642144Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:45.642147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:45.642150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:45.642152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:45.642161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895297287577310:6462]
2025-09-30T14:52:45.642165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895297287577310:6462]
2025-09-30T14:52:45.642169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895297287577310:6462]
2025-09-30T14:52:45.642213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:45.642218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:45.642235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.642235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:45.642237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:45.642239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:45.642364Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:45.689541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895297377319895:7731]
2025-09-30T14:52:45.689816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 943, pipe: [1:7555895297377319895:7731]
2025-09-30T14:52:45.748086Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:45.748324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:45.748360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895297377319895:7731], now have 1 active actors on pipe
2025-09-30T14:52:45.748496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:45.748534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:45.748581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895297377319895:7731]
2025-09-30T14:52:45.748586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:45.748588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:45.748647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 944 reason: error at write: Disconnected sessionId: src_id|f31326f7-735ac281-81db0965-3aa50aea_0
2025-09-30T14:52:45.748781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 944 sessionId: src_id|f31326f7-735ac281-81db0965-3aa50aea_0 is DEAD
2025-09-30T14:52:45.748945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31326f7-735ac281-81db0965-3aa50aea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:45.748955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31326f7-735ac281-81db0965-3aa50aea_0] Write session will restart in 0.006163s
2025-09-30T14:52:45.748973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31326f7-735ac281-81db0965-3aa50aea_0] Write session: Do CDS request
2025-09-30T14:52:45.748978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31326f7-735ac281-81db0965-3aa50aea_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:45.756719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f31326f7-735ac281-81db0965-3aa50aea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:45.756874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:45.756890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 945
2025-09-30T14:52:45.756999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 945 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:45.757032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 945 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:45.757045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=945 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:45.757049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:45.757459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 945 sessionId:  describe result for acl check
2025-09-30T14:52:45.757495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:45.757500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:45.757502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:45.757508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895297377319988:7973] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:45.758029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895297377319988:7973] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:45.760301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895297377319988:7973] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:45.763055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895297377319988:7973] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:45.763070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895297377319988:7973] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:45.763073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895297377319988:7973] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:45.763080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 945 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:45.767831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:45.771114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:45.771312Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:45.771323Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:45.771334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:45.771390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:45.771421Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895297287577590:6464]
2025-09-30T14:52:45.772017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:45.772350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:45.772385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:45.772615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:45.772667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:45.772673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:45.772674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:45.772675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:45.772676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:45.772677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:45.772678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:45.772678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:45.772679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:45.772680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:45.772681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.772681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.772682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.772683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:45.772683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:45.772687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:45.772694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:45.772696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:45.772699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:45.772701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:45.772703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:45.772705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:45.772708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:45.772710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:45.772713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:45.772715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.772717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.772719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.772722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:45.772724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:45.772729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:45.772734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:45.772737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:45.772741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:45.772744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:45.772747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:45.772750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:45.772753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:45.772755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:45.772758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:45.772761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:45.772764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:45.772766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:45.772769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:45.772772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:45.772775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:45.772777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:45.772780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:45.772783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:45.772786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:45.772790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.772793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.772795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.772797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.772800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.772803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.772805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:45.772808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:45.772811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:45.772814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:45.772837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:45.778003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:45.779401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:45.779415Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:45.779418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:45.779422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:45.779428Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 944 [2:7555895297287577590:6464]
2025-09-30T14:52:45.779443Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:45.779460Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:45.779464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:45.779467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:45.779469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:45.779484Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:45.779494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:45.779500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:45.779556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.779562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.779564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.779567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:45.779570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:45.779635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:45.779641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.779652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.779666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.779685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:45.779704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895297377320216:7973], now have 1 active actors on pipe
2025-09-30T14:52:45.779707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895297377319897:2454], now have 1 active actors on pipe
2025-09-30T14:52:45.779714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895297287577585:6464]
2025-09-30T14:52:45.779716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895297287577585:6464]
2025-09-30T14:52:45.779718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895297287577585:6464]
2025-09-30T14:52:45.779734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:45.779747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:45.779748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:45.779751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:45.779753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:45.779763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:45.779766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:45.779795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895297287577585:6464]
2025-09-30T14:52:45.779802Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:45.779805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:45.779778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 944
2025-09-30T14:52:45.779821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:45.779830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:45.779779Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 944
2025-09-30T14:52:45.779874Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5bd195e1-cd780d8b-3b1efbd2-7fe70693_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:45.779886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:45.779893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:45.779895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:45.779904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:45.779917Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:45.779937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:45.780092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:45.780101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:45.780116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:45.780215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 945 partition: 0 MaxSeqNo: 42 sessionId: src_id|5bd195e1-cd780d8b-3b1efbd2-7fe70693_0
2025-09-30T14:52:45.780574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31326f7-735ac281-81db0965-3aa50aea_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5bd195e1-cd780d8b-3b1efbd2-7fe70693_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:45.783320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bd195e1-cd780d8b-3b1efbd2-7fe70693_0] Write session: try to update token
2025-09-30T14:52:45.783339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bd195e1-cd780d8b-3b1efbd2-7fe70693_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:45.791545Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:45.791564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:45.791566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:45.791569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:45.791580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895297287577585:6464]
2025-09-30T14:52:45.791584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895297287577585:6464]
2025-09-30T14:52:45.791588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895297287577585:6464]
2025-09-30T14:52:45.791626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:45.791632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.791634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:45.791651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:45.791658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:45.791663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:45.791770Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:45.799449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 945 sessionId: src_id|5bd195e1-cd780d8b-3b1efbd2-7fe70693_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:45.802202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:45.848778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895297377320316:7731]
2025-09-30T14:52:45.849112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 944, pipe: [1:7555895297377320316:7731]
2025-09-30T14:52:45.896181Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:45.896782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:45.896795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:45.896810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895297377320316:7731], now have 1 active actors on pipe
2025-09-30T14:52:45.896980Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:45.897105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:45.897111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895297377320316:7731]
2025-09-30T14:52:45.897133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:45.897134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:45.897224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 945 reason: error at write: Disconnected sessionId: src_id|5bd195e1-cd780d8b-3b1efbd2-7fe70693_0
2025-09-30T14:52:45.897433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 945 sessionId: src_id|5bd195e1-cd780d8b-3b1efbd2-7fe70693_0 is DEAD
2025-09-30T14:52:45.897581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bd195e1-cd780d8b-3b1efbd2-7fe70693_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:45.897593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bd195e1-cd780d8b-3b1efbd2-7fe70693_0] Write session will restart in 0.009569s
2025-09-30T14:52:45.897614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bd195e1-cd780d8b-3b1efbd2-7fe70693_0] Write session: Do CDS request
2025-09-30T14:52:45.897621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bd195e1-cd780d8b-3b1efbd2-7fe70693_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:45.908684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bd195e1-cd780d8b-3b1efbd2-7fe70693_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:45.908799Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:45.908821Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 946
2025-09-30T14:52:45.909009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 946 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:45.909048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 946 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:45.909052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=946 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:45.909057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:45.909512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 946 sessionId:  describe result for acl check
2025-09-30T14:52:45.909557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:45.909562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:45.909565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:45.909570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895297377320530:7977] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:45.910074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895297377320530:7977] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:45.912378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895297377320530:7977] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:45.915027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895297377320530:7977] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:45.915044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895297377320530:7977] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:45.915048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895297377320530:7977] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:45.915057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 946 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:45.918786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:45.919287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:45.919437Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:45.919447Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:45.919457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:45.919510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:45.919544Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895297287577866:6466]
2025-09-30T14:52:45.920042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:45.920380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:45.920432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:45.920729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:45.920792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:45.920798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:45.920799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:45.920800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:45.920802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:45.920803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:45.920805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:45.920806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:45.920807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:45.920809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:45.920810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.920811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.920812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.920814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:45.920815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:45.920820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:45.920829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:45.920834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:45.920838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:45.920842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:45.920847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:45.920851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:45.920857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:45.920865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:45.920869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:45.920878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.920882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.920886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.920888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:45.920891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:45.920899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:45.920911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:45.920917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:45.920923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:45.920932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:45.920942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:45.920951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:45.920956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:45.920965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:45.920971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:45.920979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:45.920985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:45.920994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:45.920999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:45.921004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:45.921012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:45.921015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:45.921018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:45.921020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:45.921023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:45.921029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.921032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.921035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.921038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.921044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.921049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.921058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:45.921064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:45.921073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:45.921082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:45.921141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:45.926414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:45.927740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:45.927750Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:45.927752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:45.927755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:45.927760Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 945 [2:7555895297287577866:6466]
2025-09-30T14:52:45.927772Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:45.927783Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:45.927785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:45.927791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:45.927793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:45.927804Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:45.927809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:45.927814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:45.927858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.927864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.927865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.927867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:45.927869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:45.927916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:45.927922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.927930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:45.927936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:45.927945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:45.927956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895297287577861:6466]
2025-09-30T14:52:45.927958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895297287577861:6466]
2025-09-30T14:52:45.927960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895297287577861:6466]
2025-09-30T14:52:45.927965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:45.927975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:45.927980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:45.927984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:45.927986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:45.927986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:45.927991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:45.927993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895297377320716:7977], now have 1 active actors on pipe
2025-09-30T14:52:45.927996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895297377320318:2454], now have 1 active actors on pipe
2025-09-30T14:52:45.928018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895297287577861:6466]
2025-09-30T14:52:45.928024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:45.928041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:45.928131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 945
2025-09-30T14:52:45.928188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:45.928195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:45.928141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 945
2025-09-30T14:52:45.928215Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|73aa5ec1-4afc0ebd-6a2508d3-56adfbfd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:45.928224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:45.928226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:45.928228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:45.928237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:45.928244Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:45.928258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:45.928460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:45.928470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:45.928490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:45.928586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 946 partition: 0 MaxSeqNo: 42 sessionId: src_id|73aa5ec1-4afc0ebd-6a2508d3-56adfbfd_0
2025-09-30T14:52:45.928945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bd195e1-cd780d8b-3b1efbd2-7fe70693_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|73aa5ec1-4afc0ebd-6a2508d3-56adfbfd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:45.931561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73aa5ec1-4afc0ebd-6a2508d3-56adfbfd_0] Write session: try to update token
2025-09-30T14:52:45.931576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73aa5ec1-4afc0ebd-6a2508d3-56adfbfd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:45.944646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 946 sessionId: src_id|73aa5ec1-4afc0ebd-6a2508d3-56adfbfd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:45.945309Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:45.945326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:45.945335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895297287577861:6466]
2025-09-30T14:52:45.945384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:45.945385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:45.945561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:45.945729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:45.945878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:45.946024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:45.946250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:45.946288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:45.947462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:45.947663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:45.947680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:45.947709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:45.947775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:45.950364Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:45.950379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:45.950381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:45.950383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:45.950393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895297287577861:6466]
2025-09-30T14:52:45.950396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895297287577861:6466]
2025-09-30T14:52:45.950400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895297287577861:6466]
2025-09-30T14:52:45.950440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:45.950447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:45.950449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:45.950467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:45.950475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:45.950479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:45.950589Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:45.997279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895297377320729:7731]
2025-09-30T14:52:45.997640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 945, pipe: [1:7555895297377320729:7731]
2025-09-30T14:52:46.062365Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:46.069858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:46.069879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:46.070030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:46.070093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:46.070163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:46.070240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:46.070518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:46.070527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:46.070592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:46.070649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:46.070725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:46.070796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:46.070855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:46.070863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:46.070934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:46.071000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:46.071063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:46.071131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:46.071181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:46.071189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:46.071274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:46.071343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:46.071421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:46.071486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:46.071529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:46.071536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:46.071597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:46.071654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:46.071722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:46.071785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:46.071833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:46.071843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:46.071910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:46.071974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:46.072043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:46.072112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:46.072161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:46.072168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:46.072235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:46.072298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:46.072365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:46.072428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:46.072473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:46.072479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:46.072538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:46.072594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:46.072654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:46.072723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:46.072774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:46.072782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:46.072856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:46.072940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:46.073002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:46.073066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:46.073110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:46.073117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:46.073182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:46.073250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:46.073313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:46.073382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:46.073428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:46.073437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:46.073499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895297377320729:7731], now have 1 active actors on pipe
2025-09-30T14:52:46.073726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895297377320729:7731]
2025-09-30T14:52:46.073752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:46.073765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:46.073768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:46.073795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 946 reason: error at write: Disconnected sessionId: src_id|73aa5ec1-4afc0ebd-6a2508d3-56adfbfd_0
2025-09-30T14:52:46.074143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 946 sessionId: src_id|73aa5ec1-4afc0ebd-6a2508d3-56adfbfd_0 is DEAD
2025-09-30T14:52:46.074183Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:46.074312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73aa5ec1-4afc0ebd-6a2508d3-56adfbfd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:46.074333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73aa5ec1-4afc0ebd-6a2508d3-56adfbfd_0] Write session will restart in 0.008124s
2025-09-30T14:52:46.074351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73aa5ec1-4afc0ebd-6a2508d3-56adfbfd_0] Write session: Do CDS request
2025-09-30T14:52:46.074354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73aa5ec1-4afc0ebd-6a2508d3-56adfbfd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:46.083727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73aa5ec1-4afc0ebd-6a2508d3-56adfbfd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:46.083817Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:46.083836Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 947
2025-09-30T14:52:46.084020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 947 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:46.084056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 947 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:46.084067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=947 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:46.084072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:46.084553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 947 sessionId:  describe result for acl check
2025-09-30T14:52:46.084603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:46.084611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:46.084613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:46.084618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895301672288169:7984] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:46.085195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895301672288169:7984] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:46.087258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895301672288169:7984] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:46.090336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895301672288169:7984] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:46.090355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895301672288169:7984] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:46.090358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895301672288169:7984] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:46.090366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 947 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:46.096669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:46.100463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:46.100712Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:46.100727Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:46.100741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:46.100812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:46.100857Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895301582545453:6469]
2025-09-30T14:52:46.101510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:46.101883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:46.101941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:46.102306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:46.102402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:46.102414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:46.102415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:46.102416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:46.102418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:46.102419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:46.102420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:46.102421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:46.102422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:46.102423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:46.102425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.102426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.102427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.102428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:46.102429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:46.102436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:46.102447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:46.102451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:46.102454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:46.102458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:46.102462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:46.102466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:46.102469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:46.102473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:46.102478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:46.102482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.102485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.102489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.102493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:46.102496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:46.102507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:46.102515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:46.102522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:46.102528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:46.102533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:46.102539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:46.102543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:46.102549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:46.102554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:46.102560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:46.102564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:46.102577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:46.102583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:46.102594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:46.102599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:46.102604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:46.102614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:46.102619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:46.102627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:46.102633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:46.102638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.102643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.102648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.102653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.102657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.102662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.102666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:46.102671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:46.102676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:46.102681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:46.102727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:46.108364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:46.109825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:46.109836Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:46.109839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:46.109843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:46.109849Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 946 [2:7555895301582545453:6469]
2025-09-30T14:52:46.109865Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:46.109880Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:46.109883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:46.109886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:46.109888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:46.109904Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:46.109919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:46.109930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:46.109990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.109998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.110000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.110004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:46.110007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:46.110076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:46.110083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.110096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.110113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.110134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:46.110158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895301672288048:2454], now have 1 active actors on pipe
2025-09-30T14:52:46.110166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895301672288310:7984], now have 1 active actors on pipe
2025-09-30T14:52:46.110173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895301582545446:6469]
2025-09-30T14:52:46.110175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895301582545446:6469]
2025-09-30T14:52:46.110177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895301582545446:6469]
2025-09-30T14:52:46.110192Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:46.110210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:46.110235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:46.110205Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 946
2025-09-30T14:52:46.110238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:46.110241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:46.110248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:46.110251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:46.110291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895301582545446:6469]
2025-09-30T14:52:46.110253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 946
2025-09-30T14:52:46.110299Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:46.110313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:46.110316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:46.110321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:46.110362Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d73b6e8d-6afb95af-68924377-f5bb534c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:46.110376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:46.110379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:46.110383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:46.110392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:46.110407Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:46.110430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:46.110602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:46.110616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:46.110641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:46.110733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 947 partition: 0 MaxSeqNo: 42 sessionId: src_id|d73b6e8d-6afb95af-68924377-f5bb534c_0
2025-09-30T14:52:46.111081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73aa5ec1-4afc0ebd-6a2508d3-56adfbfd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d73b6e8d-6afb95af-68924377-f5bb534c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:46.113894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d73b6e8d-6afb95af-68924377-f5bb534c_0] Write session: try to update token
2025-09-30T14:52:46.113913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d73b6e8d-6afb95af-68924377-f5bb534c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:46.122621Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:46.122637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:46.122640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:46.122641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:46.122651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895301582545446:6469]
2025-09-30T14:52:46.122659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895301582545446:6469]
2025-09-30T14:52:46.122663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895301582545446:6469]
2025-09-30T14:52:46.122703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:46.122709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.122712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:46.122716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:46.122722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:46.122727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:46.122866Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:46.128322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 947 sessionId: src_id|d73b6e8d-6afb95af-68924377-f5bb534c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:46.130688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:46.173929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895301672288464:7731]
2025-09-30T14:52:46.174203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 946, pipe: [1:7555895301672288464:7731]
2025-09-30T14:52:46.227464Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:46.227975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:46.227990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:46.228026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895301672288464:7731], now have 1 active actors on pipe
2025-09-30T14:52:46.228226Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:46.228244Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:46.228272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895301672288464:7731]
2025-09-30T14:52:46.228293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:46.228366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 947 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d73b6e8d-6afb95af-68924377-f5bb534c_0
2025-09-30T14:52:46.228530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 947 sessionId: src_id|d73b6e8d-6afb95af-68924377-f5bb534c_0 is DEAD
2025-09-30T14:52:46.228669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d73b6e8d-6afb95af-68924377-f5bb534c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:46.228678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d73b6e8d-6afb95af-68924377-f5bb534c_0] Write session will restart in 0.008781s
2025-09-30T14:52:46.228695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d73b6e8d-6afb95af-68924377-f5bb534c_0] Write session: Do CDS request
2025-09-30T14:52:46.228699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d73b6e8d-6afb95af-68924377-f5bb534c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:46.238747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d73b6e8d-6afb95af-68924377-f5bb534c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:46.238885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:46.238904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 948
2025-09-30T14:52:46.239029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 948 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:46.239061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 948 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:46.239072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=948 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:46.239077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:46.239502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 948 sessionId:  describe result for acl check
2025-09-30T14:52:46.239536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:46.239542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:46.239544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:46.239550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895301672288625:7988] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:46.240157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895301672288625:7988] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:46.242587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895301672288625:7988] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:46.245398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895301672288625:7988] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:46.245414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895301672288625:7988] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:46.245417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895301672288625:7988] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:46.245426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 948 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:46.248139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:46.251432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:46.251723Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:46.251738Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:46.251751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:46.251816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:46.251849Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895301582545731:6472]
2025-09-30T14:52:46.252384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:46.252727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:46.252780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:46.253107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:46.253188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:46.253195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:46.253196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:46.253197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:46.253198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:46.253200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:46.253201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:46.253202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:46.253203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:46.253205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:46.253206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.253207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.253208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.253209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:46.253211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:46.253217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:46.253227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:46.253232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:46.253236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:46.253241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:46.253246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:46.253250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:46.253254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:46.253258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:46.253262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:46.253266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.253270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.253274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.253279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:46.253283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:46.253291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:46.253299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:46.253305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:46.253310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:46.253316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:46.253322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:46.253326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:46.253331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:46.253337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:46.253342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:46.253347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:46.253352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:46.253357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:46.253363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:46.253373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:46.253379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:46.253384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:46.253390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:46.253400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:46.253405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:46.253410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.253415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.253419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.253424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.253434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.253440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.253445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:46.253450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:46.253456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:46.253466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:46.253511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:46.259264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:46.260780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:46.260798Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:46.260800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:46.260804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:46.260811Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 947 [2:7555895301582545731:6472]
2025-09-30T14:52:46.260829Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:46.260845Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:46.260849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:46.260852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:46.260855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:46.260870Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:46.260877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:46.260885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:46.260951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.260961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.260963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.260966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:46.260970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:46.261038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:46.261051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.261066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.261079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.261097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:46.261119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895301672288853:7988], now have 1 active actors on pipe
2025-09-30T14:52:46.261128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895301672288466:2454], now have 1 active actors on pipe
2025-09-30T14:52:46.261135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895301582545726:6472]
2025-09-30T14:52:46.261137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895301582545726:6472]
2025-09-30T14:52:46.261139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895301582545726:6472]
2025-09-30T14:52:46.261152Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:46.261167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:46.261174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:46.261176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:46.261179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:46.261191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:46.261194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:46.261186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 947
2025-09-30T14:52:46.261230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895301582545726:6472]
2025-09-30T14:52:46.261239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:46.261202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 947
2025-09-30T14:52:46.261242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:46.261255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:46.261265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:46.261315Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2923a0d8-7b84639e-972ad315-ae111f33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:46.261326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:46.261330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:46.261333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:46.261345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:46.261358Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:46.261382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:46.261554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:46.261571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:46.261597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:46.261704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 948 partition: 0 MaxSeqNo: 42 sessionId: src_id|2923a0d8-7b84639e-972ad315-ae111f33_0
2025-09-30T14:52:46.262060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d73b6e8d-6afb95af-68924377-f5bb534c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2923a0d8-7b84639e-972ad315-ae111f33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:46.264908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2923a0d8-7b84639e-972ad315-ae111f33_0] Write session: try to update token
2025-09-30T14:52:46.264932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2923a0d8-7b84639e-972ad315-ae111f33_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:46.274115Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:46.274135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:46.274138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:46.274140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:46.274150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895301582545726:6472]
2025-09-30T14:52:46.274155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895301582545726:6472]
2025-09-30T14:52:46.274158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895301582545726:6472]
2025-09-30T14:52:46.274193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:46.274199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.274201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:46.274210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:46.274216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:46.274238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:46.274362Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:46.279811Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 948 sessionId: src_id|2923a0d8-7b84639e-972ad315-ae111f33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:46.282588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:46.328555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895301672288879:7731]
2025-09-30T14:52:46.328887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 947, pipe: [1:7555895301672288879:7731]
2025-09-30T14:52:46.379554Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:46.380012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:46.380026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:46.380055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895301672288879:7731], now have 1 active actors on pipe
2025-09-30T14:52:46.380230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895301672288879:7731]
2025-09-30T14:52:46.380271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:46.380274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:46.380330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 948 reason: error at write: Disconnected sessionId: src_id|2923a0d8-7b84639e-972ad315-ae111f33_0
2025-09-30T14:52:46.380486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 948 sessionId: src_id|2923a0d8-7b84639e-972ad315-ae111f33_0 is DEAD
2025-09-30T14:52:46.380622Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:46.380649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2923a0d8-7b84639e-972ad315-ae111f33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:46.380646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:46.380687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2923a0d8-7b84639e-972ad315-ae111f33_0] Write session will restart in 0.006202s
2025-09-30T14:52:46.380721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2923a0d8-7b84639e-972ad315-ae111f33_0] Write session: Do CDS request
2025-09-30T14:52:46.380730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2923a0d8-7b84639e-972ad315-ae111f33_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:46.387704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2923a0d8-7b84639e-972ad315-ae111f33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:46.387751Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:46.387769Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 949
2025-09-30T14:52:46.387920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 949 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:46.387950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 949 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:46.387960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=949 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:46.387963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:46.388408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 949 sessionId:  describe result for acl check
2025-09-30T14:52:46.388444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:46.388451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:46.388453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:46.388458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895301672288945:7998] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:46.388955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895301672288945:7998] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:46.391181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895301672288945:7998] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:46.393825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895301672288945:7998] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:46.393847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895301672288945:7998] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:46.393850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895301672288945:7998] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:46.393857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 949 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:46.403598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:46.404183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:46.404332Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:46.404342Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:46.404351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:46.404401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:46.404440Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895301582546022:6476]
2025-09-30T14:52:46.404943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:46.405257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:46.405315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:46.405564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:46.405617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:46.405621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:46.405622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:46.405623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:46.405624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:46.405624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:46.405625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:46.405626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:46.405627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:46.405627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:46.405628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.405628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.405629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.405630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:46.405630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:46.405634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:46.405640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:46.405642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:46.405645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:46.405647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:46.405649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:46.405652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:46.405654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:46.405657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:46.405659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:46.405661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.405663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.405666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.405668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:46.405670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:46.405675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:46.405680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:46.405684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:46.405687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:46.405690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:46.405693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:46.405695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:46.405699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:46.405703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:46.405709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:46.405713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:46.405717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:46.405723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:46.405728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:46.405732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:46.405737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:46.405742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:46.405745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:46.405747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:46.405750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:46.405753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.405756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.405758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.405761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.405764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.405767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.405771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:46.405774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:46.405777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:46.405779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:46.405812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:46.411290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:46.412472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:46.412488Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:46.412490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:46.412492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:46.412497Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 948 [2:7555895301582546022:6476]
2025-09-30T14:52:46.412508Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:46.412519Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:46.412521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:46.412523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:46.412524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:46.412536Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:46.412541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:46.412546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:46.412590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.412596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.412597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.412600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:46.412601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:46.412661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:46.412672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.412684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.412694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.412710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:46.412733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895301672289173:7998], now have 1 active actors on pipe
2025-09-30T14:52:46.412742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895301672288885:2454], now have 1 active actors on pipe
2025-09-30T14:52:46.412748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895301582546017:6476]
2025-09-30T14:52:46.412758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895301582546017:6476]
2025-09-30T14:52:46.412760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895301582546017:6476]
2025-09-30T14:52:46.412773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:46.412787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:46.412789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:46.412792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:46.412793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:46.412803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:46.412809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:46.412839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895301582546017:6476]
2025-09-30T14:52:46.412851Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:46.412854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:46.412848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 948
2025-09-30T14:52:46.412892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 948
2025-09-30T14:52:46.412895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:46.412903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:46.412926Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98199020-f9c105c-d02166ff-7c0bb019_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:46.412933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:46.413248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 949 partition: 0 MaxSeqNo: 42 sessionId: src_id|98199020-f9c105c-d02166ff-7c0bb019_0
2025-09-30T14:52:46.412936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:46.412937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:46.412944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:46.412951Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:46.412964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:46.413128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:46.413135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:46.413157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:46.413594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2923a0d8-7b84639e-972ad315-ae111f33_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|98199020-f9c105c-d02166ff-7c0bb019_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:46.416288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98199020-f9c105c-d02166ff-7c0bb019_0] Write session: try to update token
2025-09-30T14:52:46.416306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98199020-f9c105c-d02166ff-7c0bb019_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:46.424936Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:46.424954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:46.424956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:46.424958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:46.424966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895301582546017:6476]
2025-09-30T14:52:46.424971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895301582546017:6476]
2025-09-30T14:52:46.424975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895301582546017:6476]
2025-09-30T14:52:46.425012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:46.425018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.425018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:46.425021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:46.425025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:46.425029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:46.425157Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:46.429911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 949 sessionId: src_id|98199020-f9c105c-d02166ff-7c0bb019_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:46.432452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:46.480578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895301672289317:7731]
2025-09-30T14:52:46.480886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 948, pipe: [1:7555895301672289317:7731]
2025-09-30T14:52:46.528168Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:46.528415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:46.528428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:46.528459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895301672289317:7731], now have 1 active actors on pipe
2025-09-30T14:52:46.528739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:46.528765Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:46.528762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895301672289317:7731]
2025-09-30T14:52:46.528787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:46.528789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:46.528851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 949 reason: error at write: Disconnected sessionId: src_id|98199020-f9c105c-d02166ff-7c0bb019_0
2025-09-30T14:52:46.529018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 949 sessionId: src_id|98199020-f9c105c-d02166ff-7c0bb019_0 is DEAD
2025-09-30T14:52:46.529156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98199020-f9c105c-d02166ff-7c0bb019_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:46.529168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98199020-f9c105c-d02166ff-7c0bb019_0] Write session will restart in 0.007172s
2025-09-30T14:52:46.529200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98199020-f9c105c-d02166ff-7c0bb019_0] Write session: Do CDS request
2025-09-30T14:52:46.529206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98199020-f9c105c-d02166ff-7c0bb019_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:46.537888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98199020-f9c105c-d02166ff-7c0bb019_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:46.537928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:46.537947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 950
2025-09-30T14:52:46.538117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 950 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:46.538153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 950 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:46.538163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=950 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:46.538167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:46.538594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 950 sessionId:  describe result for acl check
2025-09-30T14:52:46.538635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:46.538638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:46.538640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:46.538646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895301672289365:8004] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:46.539221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895301672289365:8004] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:46.542142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895301672289365:8004] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:46.545209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895301672289365:8004] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:46.545229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895301672289365:8004] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:46.545232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895301672289365:8004] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:46.545241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 950 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:46.550619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:46.554161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:46.554387Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:46.554400Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:46.554410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:46.554465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:46.554507Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895301582546325:6488]
2025-09-30T14:52:46.555153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:46.555493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:46.555532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:46.555802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:46.555871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:46.555877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:46.555878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:46.555879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:46.555881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:46.555882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:46.555883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:46.555885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:46.555886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:46.555887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:46.555888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.555890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.555891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.555892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:46.555893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:46.555898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:46.555909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:46.555913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:46.555918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:46.555922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:46.555926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:46.555930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:46.555934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:46.555939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:46.555943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:46.555947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.555951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.555956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.555960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:46.555964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:46.555973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:46.555981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:46.555987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:46.555993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:46.555997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:46.556000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:46.556002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:46.556005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:46.556008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:46.556011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:46.556014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:46.556017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:46.556019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:46.556022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:46.556024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:46.556028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:46.556031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:46.556034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:46.556036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:46.556039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:46.556042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.556044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.556046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.556049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.556053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.556057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.556062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:46.556066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:46.556071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:46.556076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:46.556117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:46.561457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:46.562348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:46.562368Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:46.562370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:46.562374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:46.562380Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 949 [2:7555895301582546325:6488]
2025-09-30T14:52:46.562398Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:46.562413Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:46.562416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:46.562419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:46.562421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:46.562438Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:46.562445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:46.562451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:46.562507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.562518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.562521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.562525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:46.562528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:46.562595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:46.562603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.562616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.562633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.562655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:46.562678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895301672289617:8004], now have 1 active actors on pipe
2025-09-30T14:52:46.562687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895301672289320:2454], now have 1 active actors on pipe
2025-09-30T14:52:46.562692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895301582546320:6488]
2025-09-30T14:52:46.562695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895301582546320:6488]
2025-09-30T14:52:46.562698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895301582546320:6488]
2025-09-30T14:52:46.562710Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:46.562732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:46.562733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:46.562736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:46.562738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:46.562746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:46.562750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:46.562753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 949
2025-09-30T14:52:46.562782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895301582546320:6488]
2025-09-30T14:52:46.562764Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 949
2025-09-30T14:52:46.562790Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:46.562793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:46.562817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:46.562827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:46.562861Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1d3d00d-c7e19861-f26848e3-ae1650be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:46.562872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:46.562875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:46.562877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:46.562885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:46.562899Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:46.562925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:46.563066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:46.563075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:46.563088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:46.563164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 950 partition: 0 MaxSeqNo: 42 sessionId: src_id|d1d3d00d-c7e19861-f26848e3-ae1650be_0
2025-09-30T14:52:46.563544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98199020-f9c105c-d02166ff-7c0bb019_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d1d3d00d-c7e19861-f26848e3-ae1650be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:46.566384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1d3d00d-c7e19861-f26848e3-ae1650be_0] Write session: try to update token
2025-09-30T14:52:46.566401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1d3d00d-c7e19861-f26848e3-ae1650be_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:46.574665Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:46.574683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:46.574686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:46.574687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:46.574696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895301582546320:6488]
2025-09-30T14:52:46.574701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895301582546320:6488]
2025-09-30T14:52:46.574706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895301582546320:6488]
2025-09-30T14:52:46.574746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:46.574747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:46.574751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:46.574754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.574755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:46.574756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:46.574891Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:46.580855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 950 sessionId: src_id|d1d3d00d-c7e19861-f26848e3-ae1650be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:46.583545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:46.629055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895301672289736:7731]
2025-09-30T14:52:46.629298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 949, pipe: [1:7555895301672289736:7731]
2025-09-30T14:52:46.681413Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:46.682191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:46.682205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:46.682248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895301672289736:7731], now have 1 active actors on pipe
2025-09-30T14:52:46.682493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:46.682498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895301672289736:7731]
2025-09-30T14:52:46.682516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:46.682523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:46.682565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 950 reason: error at write: Disconnected sessionId: src_id|d1d3d00d-c7e19861-f26848e3-ae1650be_0
2025-09-30T14:52:46.682741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 950 sessionId: src_id|d1d3d00d-c7e19861-f26848e3-ae1650be_0 is DEAD
2025-09-30T14:52:46.682749Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:46.682866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1d3d00d-c7e19861-f26848e3-ae1650be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:46.682877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1d3d00d-c7e19861-f26848e3-ae1650be_0] Write session will restart in 0.009831s
2025-09-30T14:52:46.682898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1d3d00d-c7e19861-f26848e3-ae1650be_0] Write session: Do CDS request
2025-09-30T14:52:46.682906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1d3d00d-c7e19861-f26848e3-ae1650be_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:46.693729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1d3d00d-c7e19861-f26848e3-ae1650be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:46.693822Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:46.693853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 951
2025-09-30T14:52:46.693976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 951 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:46.694022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 951 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:46.694032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=951 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:46.694036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:46.694382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 951 sessionId:  describe result for acl check
2025-09-30T14:52:46.694412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:46.694416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:46.694418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:46.694422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895301672289972:8008] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:46.694844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895301672289972:8008] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:46.697010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895301672289972:8008] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:46.699154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895301672289972:8008] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:46.699166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895301672289972:8008] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:46.699168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895301672289972:8008] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:46.699174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 951 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:46.703149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:46.703579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:46.703698Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:46.703706Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:46.703712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:46.703743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:46.703790Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895301582546607:6491]
2025-09-30T14:52:46.704212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:46.704613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:46.704640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:46.704845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:46.704885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:46.704889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:46.704890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:46.704891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:46.704891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:46.704892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:46.704893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:46.704894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:46.704894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:46.704895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:46.704896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.704896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.704897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.704898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:46.704898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:46.704902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:46.704908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:46.704910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:46.704913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:46.704915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:46.704917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:46.704920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:46.704922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:46.704925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:46.704928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:46.704931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.704933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.704935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.704938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:46.704940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:46.704945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:46.704950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:46.704955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:46.704960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:46.704963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:46.704966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:46.704968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:46.704971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:46.704974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:46.704977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:46.704979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:46.704982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:46.704985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:46.704988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:46.704990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:46.704993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:46.704996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:46.704999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:46.705001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:46.705004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:46.705006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.705012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.705015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.705017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.705020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.705027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.705029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:46.705032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:46.705034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:46.705037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:46.705064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:46.710191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:46.711048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:46.711058Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:46.711060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:46.711063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:46.711067Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 950 [2:7555895301582546607:6491]
2025-09-30T14:52:46.711079Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:46.711089Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:46.711091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:46.711094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:46.711095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:46.711107Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:46.711116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:46.711121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:46.711158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.711163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.711164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.711167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:46.711169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:46.711218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:46.711224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.711230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.711240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.711282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:46.711297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895301672290141:8008], now have 1 active actors on pipe
2025-09-30T14:52:46.711303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895301672289737:2454], now have 1 active actors on pipe
2025-09-30T14:52:46.711307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895301582546602:6491]
2025-09-30T14:52:46.711308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895301582546602:6491]
2025-09-30T14:52:46.711310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895301582546602:6491]
2025-09-30T14:52:46.711319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:46.711327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:46.711334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:46.711337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:46.711339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:46.711339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:46.711341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:46.711361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895301582546602:6491]
2025-09-30T14:52:46.711367Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:46.711373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:46.711392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:46.711399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:46.711360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 950
2025-09-30T14:52:46.711366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 950
2025-09-30T14:52:46.711419Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6c2f6ef-16151b72-1530252c-1387ab84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:46.711427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:46.711430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:46.711431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:46.711437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:46.711447Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:46.711461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:46.711774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:46.711788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:46.711805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:46.711885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 951 partition: 0 MaxSeqNo: 42 sessionId: src_id|b6c2f6ef-16151b72-1530252c-1387ab84_0
2025-09-30T14:52:46.712201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1d3d00d-c7e19861-f26848e3-ae1650be_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b6c2f6ef-16151b72-1530252c-1387ab84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:46.714698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6c2f6ef-16151b72-1530252c-1387ab84_0] Write session: try to update token
2025-09-30T14:52:46.714710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6c2f6ef-16151b72-1530252c-1387ab84_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:46.723187Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:46.723203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:46.723210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895301582546602:6491]
2025-09-30T14:52:46.723269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:46.723447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:46.723615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:46.723748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:46.723877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:46.724003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:46.724181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:46.724212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:46.727914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 951 sessionId: src_id|b6c2f6ef-16151b72-1530252c-1387ab84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:46.730366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:46.730852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:46.730870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:46.730898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:46.730989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:46.733592Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:46.733605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:46.733606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:46.733607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:46.733615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895301582546602:6491]
2025-09-30T14:52:46.733617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895301582546602:6491]
2025-09-30T14:52:46.733620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895301582546602:6491]
2025-09-30T14:52:46.733649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:46.733651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:46.733653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:46.733656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:46.733657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.733660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:46.733777Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:46.782685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895301672290155:7731]
2025-09-30T14:52:46.782990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 950, pipe: [1:7555895301672290155:7731]
2025-09-30T14:52:46.814921Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-09-30T14:52:46.814953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 5
2025-09-30T14:52:46.834753Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:46.841646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:46.841669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:46.841818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:46.841878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:46.841938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:46.841999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:46.842041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:46.842050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:46.842119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:46.842179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:46.842251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:46.842311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:46.842353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:46.842360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:46.842417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:46.842471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:46.842528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:46.842588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:46.842629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:46.842637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:46.842698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:46.842769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:46.842828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:46.842887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:46.842927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:46.842934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:46.842995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:46.843051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:46.843108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:46.843172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:46.843228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:46.843234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:46.843315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:46.843369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:46.843426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:46.843486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:46.843525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:46.843533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:46.843592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:46.843648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:46.843711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:46.843768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:46.843812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:46.843821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:46.843879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:46.843934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:46.843988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:46.844041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:46.844084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:46.844090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:46.844152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:46.844208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:46.844275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:46.844336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:46.844378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:46.844384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:46.844443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:46.844496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:46.844553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:46.844610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:46.844652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:46.844661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:46.844703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895301672290155:7731], now have 1 active actors on pipe
2025-09-30T14:52:46.844899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:46.844913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:46.844948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 951 reason: error at write: Disconnected sessionId: src_id|b6c2f6ef-16151b72-1530252c-1387ab84_0
2025-09-30T14:52:46.845177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 951 sessionId: src_id|b6c2f6ef-16151b72-1530252c-1387ab84_0 is DEAD
2025-09-30T14:52:46.845302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6c2f6ef-16151b72-1530252c-1387ab84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:46.845313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6c2f6ef-16151b72-1530252c-1387ab84_0] Write session will restart in 0.007431s
2025-09-30T14:52:46.845306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895301672290155:7731]
2025-09-30T14:52:46.845339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6c2f6ef-16151b72-1530252c-1387ab84_0] Write session: Do CDS request
2025-09-30T14:52:46.845331Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:46.845345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6c2f6ef-16151b72-1530252c-1387ab84_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:46.845346Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 5
2025-09-30T14:52:46.845660Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:46.853743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6c2f6ef-16151b72-1530252c-1387ab84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:46.853884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:46.853905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 952
2025-09-30T14:52:46.854021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 952 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:46.854046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 952 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:46.854053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=952 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:46.854056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:46.854455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 952 sessionId:  describe result for acl check
2025-09-30T14:52:46.854486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:46.854490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:46.854491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:46.854497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895301672290207:8012] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:46.855003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895301672290207:8012] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:46.857748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895301672290207:8012] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:46.860910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895301672290207:8012] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:46.860924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895301672290207:8012] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:46.860926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895301672290207:8012] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:46.860933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 952 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:46.866929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:46.871280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:46.871506Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:46.871515Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:46.871527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:46.871576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:46.871613Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895301582546890:6494]
2025-09-30T14:52:46.872200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:46.872502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:46.872539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:46.872840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:46.872904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:46.872911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:46.872912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:46.872913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:46.872915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:46.872916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:46.872918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:46.872919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:46.872921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:46.872922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:46.872923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.872924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.872926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.872927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:46.872928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:46.872934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:46.872946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:46.872950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:46.872954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:46.872958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:46.872964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:46.872968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:46.872972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:46.872976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:46.872980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:46.872984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.872989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.872993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.872997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:46.873001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:46.873010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:46.873018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:46.873025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:46.873030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:46.873034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:46.873040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:46.873045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:46.873051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:46.873056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:46.873062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:46.873071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:46.873077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:46.873083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:46.873089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:46.873093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:46.873099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:46.873106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:46.873112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:46.873122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:46.873127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:46.873130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.873134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.873137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.873140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.873142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.873145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.873148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:46.873151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:46.873153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:46.873156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:46.873185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:46.878773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:46.880360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:46.880378Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:46.880382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:46.880387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:46.880396Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 951 [2:7555895301582546890:6494]
2025-09-30T14:52:46.880416Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:46.880436Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:46.880441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:46.880445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:46.880448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:46.880468Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:46.880476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:46.880489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:46.880567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.880574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.880577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.880581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:46.880584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:46.880661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:46.880672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.880684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:46.880695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:46.880712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:46.880736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895301672290159:2454], now have 1 active actors on pipe
2025-09-30T14:52:46.880746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895301672290455:8012], now have 1 active actors on pipe
2025-09-30T14:52:46.880754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895301582546885:6494]
2025-09-30T14:52:46.880759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895301582546885:6494]
2025-09-30T14:52:46.880761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895301582546885:6494]
2025-09-30T14:52:46.880773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:46.880789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:46.880799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:46.880801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:46.880803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:46.880806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:46.880808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:46.880848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895301582546885:6494]
2025-09-30T14:52:46.880861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:46.880878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:46.880838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 951
2025-09-30T14:52:46.880848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 951
2025-09-30T14:52:46.880904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:46.880914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:46.880962Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d55a4d5a-bfa79a50-97bbd251-ae18b931_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:46.880972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:46.880979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:46.880981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:46.880992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:46.881004Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:46.881071Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 85826639 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:52:46.881104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:46.881310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:46.881321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:46.881310Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 5 DataSize: 85826639 UsedReserveSize: 0
2025-09-30T14:52:46.881340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:46.881342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:52:46.881460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 952 partition: 0 MaxSeqNo: 42 sessionId: src_id|d55a4d5a-bfa79a50-97bbd251-ae18b931_0
2025-09-30T14:52:46.881882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6c2f6ef-16151b72-1530252c-1387ab84_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d55a4d5a-bfa79a50-97bbd251-ae18b931_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:46.884480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d55a4d5a-bfa79a50-97bbd251-ae18b931_0] Write session: try to update token
2025-09-30T14:52:46.884496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d55a4d5a-bfa79a50-97bbd251-ae18b931_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:46.893126Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:46.893146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:46.893159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895301582546885:6494]
2025-09-30T14:52:46.893213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:46.893213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:46.893430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:46.893598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:46.893747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:46.893895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:46.894124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:46.894162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:46.898527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 952 sessionId: src_id|d55a4d5a-bfa79a50-97bbd251-ae18b931_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:46.901198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:46.901444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:46.901462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:46.901497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:46.901587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:46.903605Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:46.903621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:46.903623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:46.903625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:46.903632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895301582546885:6494]
2025-09-30T14:52:46.903636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895301582546885:6494]
2025-09-30T14:52:46.903639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895301582546885:6494]
2025-09-30T14:52:46.903671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:46.903677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:46.903678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:46.903683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:46.903689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:46.903692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:46.903828Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:46.945476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895301672290579:7731]
2025-09-30T14:52:46.945801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 951, pipe: [1:7555895301672290579:7731]
2025-09-30T14:52:47.008112Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:47.015356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:47.015379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:47.015550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.015616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.015678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.015740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.015784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.015793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.015855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.015921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.015980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.016043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.016085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.016091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.016152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.016209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.016268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.016330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.016372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.016378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.016441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.016504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.016563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.016626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.016667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.016673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.016733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.016793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.016850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.016915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.016956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.016962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.017027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.017086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.017147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.017208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.017306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.017312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.017372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.017431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.017509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.017578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.017621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.017627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.017690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.017747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.017807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.017866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.017909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.017914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.017974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.018033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.018095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.018158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.018199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.018205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.018277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.018334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.018394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.018454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.018496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.018502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.018542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895301672290579:7731], now have 1 active actors on pipe
2025-09-30T14:52:47.018755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:47.018781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:47.018787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:47.018828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 952 reason: error at write: Disconnected sessionId: src_id|d55a4d5a-bfa79a50-97bbd251-ae18b931_0
2025-09-30T14:52:47.018848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895301672290579:7731]
2025-09-30T14:52:47.019070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 952 sessionId: src_id|d55a4d5a-bfa79a50-97bbd251-ae18b931_0 is DEAD
2025-09-30T14:52:47.019223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d55a4d5a-bfa79a50-97bbd251-ae18b931_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:47.019236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d55a4d5a-bfa79a50-97bbd251-ae18b931_0] Write session will restart in 0.006884s
2025-09-30T14:52:47.019284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d55a4d5a-bfa79a50-97bbd251-ae18b931_0] Write session: Do CDS request
2025-09-30T14:52:47.019292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d55a4d5a-bfa79a50-97bbd251-ae18b931_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:47.019632Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:47.027698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d55a4d5a-bfa79a50-97bbd251-ae18b931_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:47.027787Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:47.027806Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 953
2025-09-30T14:52:47.027950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 953 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:47.027984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 953 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:47.027996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=953 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:47.028001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:47.028429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 953 sessionId:  describe result for acl check
2025-09-30T14:52:47.028466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:47.028470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:47.028472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:47.028477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895305967257993:8018] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:47.028986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895305967257993:8018] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:47.031794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895305967257993:8018] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:47.034745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895305967257993:8018] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:47.034767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895305967257993:8018] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:47.034770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895305967257993:8018] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:47.034778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 953 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:47.039123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:47.042150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:47.042342Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:47.042353Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:47.042363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:47.042409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:47.042449Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895305877514483:6497]
2025-09-30T14:52:47.043106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:47.043448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:47.043490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:47.043809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:47.043867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:47.043874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:47.043875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:47.043877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:47.043878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:47.043879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:47.043881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:47.043882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:47.043883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:47.043885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:47.043886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.043887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.043889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.043890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:47.043891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:47.043896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:47.043907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:47.043911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:47.043915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:47.043919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:47.043924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:47.043928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:47.043932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:47.043937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:47.043941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:47.043945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.043949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.043953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.043963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:47.043967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:47.043978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:47.043989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:47.044000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:47.044011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:47.044020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:47.044029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:47.044034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:47.044044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:47.044048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:47.044057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:47.044062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:47.044067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:47.044076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:47.044085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:47.044094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:47.044099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:47.044106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:47.044114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:47.044124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:47.044130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:47.044142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.044151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.044160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.044169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.044177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.044186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.044194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:47.044204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:47.044212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:47.044221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:47.044262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:47.049662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:47.050841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:47.050855Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:47.050857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:47.050861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:47.050868Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 952 [2:7555895305877514483:6497]
2025-09-30T14:52:47.050884Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:47.050905Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:47.050912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:47.050915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:47.050917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:47.050932Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:47.050943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:47.050949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:47.051006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.051013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.051015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.051019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:47.051021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:47.051086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:47.051094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.051106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.051124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.051147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:47.051172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895305967258233:8018], now have 1 active actors on pipe
2025-09-30T14:52:47.051177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895305967257887:2454], now have 1 active actors on pipe
2025-09-30T14:52:47.051183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895305877514478:6497]
2025-09-30T14:52:47.051185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895305877514478:6497]
2025-09-30T14:52:47.051188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895305877514478:6497]
2025-09-30T14:52:47.051201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:47.051213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:47.051228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:47.051231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:47.051234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:47.051258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:47.051260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:47.051198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 952
2025-09-30T14:52:47.051206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 952
2025-09-30T14:52:47.051290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:47.051300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:47.051316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895305877514478:6497]
2025-09-30T14:52:47.051329Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:47.051346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:47.051363Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1fef4e1f-7fd6c664-7504850b-3b1e9f1f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:47.051374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:47.051382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:47.051385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:47.051395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:47.051407Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:47.051433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:47.051554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:47.051562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:47.051576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:47.051655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 953 partition: 0 MaxSeqNo: 42 sessionId: src_id|1fef4e1f-7fd6c664-7504850b-3b1e9f1f_0
2025-09-30T14:52:47.052047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d55a4d5a-bfa79a50-97bbd251-ae18b931_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1fef4e1f-7fd6c664-7504850b-3b1e9f1f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:47.054705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fef4e1f-7fd6c664-7504850b-3b1e9f1f_0] Write session: try to update token
2025-09-30T14:52:47.054723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fef4e1f-7fd6c664-7504850b-3b1e9f1f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:47.063180Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:47.063194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:47.063196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:47.063198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:47.063207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895305877514478:6497]
2025-09-30T14:52:47.063212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895305877514478:6497]
2025-09-30T14:52:47.063216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895305877514478:6497]
2025-09-30T14:52:47.063273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:47.063277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:47.063284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:47.063284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.063287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:47.063290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:47.063430Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:47.068583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 953 sessionId: src_id|1fef4e1f-7fd6c664-7504850b-3b1e9f1f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:47.071439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:47.119051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895305967258321:7731]
2025-09-30T14:52:47.119373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 952, pipe: [1:7555895305967258321:7731]
2025-09-30T14:52:47.167173Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:47.167893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:47.167907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:47.167938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895305967258321:7731], now have 1 active actors on pipe
2025-09-30T14:52:47.168102Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:47.168195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:47.168204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895305967258321:7731]
2025-09-30T14:52:47.168215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:47.168229Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:47.168314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 953 reason: error at write: Disconnected sessionId: src_id|1fef4e1f-7fd6c664-7504850b-3b1e9f1f_0
2025-09-30T14:52:47.168527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 953 sessionId: src_id|1fef4e1f-7fd6c664-7504850b-3b1e9f1f_0 is DEAD
2025-09-30T14:52:47.168736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fef4e1f-7fd6c664-7504850b-3b1e9f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:47.168748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fef4e1f-7fd6c664-7504850b-3b1e9f1f_0] Write session will restart in 0.005997s
2025-09-30T14:52:47.168771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fef4e1f-7fd6c664-7504850b-3b1e9f1f_0] Write session: Do CDS request
2025-09-30T14:52:47.168776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fef4e1f-7fd6c664-7504850b-3b1e9f1f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:47.175844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fef4e1f-7fd6c664-7504850b-3b1e9f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:47.175912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:47.175934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 954
2025-09-30T14:52:47.176151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 954 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:47.176181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 954 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:47.176199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=954 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:47.176209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:47.176696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 954 sessionId:  describe result for acl check
2025-09-30T14:52:47.176746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:47.176755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:47.176757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:47.176763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895305967258356:8023] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:47.177316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895305967258356:8023] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:47.179982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895305967258356:8023] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:47.182760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895305967258356:8023] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:47.182777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895305967258356:8023] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:47.182780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895305967258356:8023] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:47.182788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 954 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:47.192451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:47.192906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:47.193060Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:47.193067Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:47.193075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:47.193114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:47.193144Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895305877514769:6501]
2025-09-30T14:52:47.193626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:47.193875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:47.193906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:47.194139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:47.194181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:47.194186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:47.194186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:47.194187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:47.194188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:47.194188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:47.194189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:47.194190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:47.194190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:47.194191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:47.194192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.194192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.194193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.194194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:47.194195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:47.194198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:47.194204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:47.194207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:47.194209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:47.194211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:47.194214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:47.194228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:47.194232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:47.194235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:47.194240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:47.194244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.194247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.194251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.194255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:47.194259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:47.194267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:47.194275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:47.194282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:47.194287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:47.194292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:47.194297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:47.194301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:47.194306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:47.194311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:47.194315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:47.194319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:47.194324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:47.194329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:47.194333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:47.194338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:47.194343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:47.194348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:47.194354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:47.194358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:47.194363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:47.194366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.194369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.194372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.194378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.194383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.194388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.194392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:47.194404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:47.194409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:47.194415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:47.194444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:47.199612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:47.200445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:47.200456Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:47.200458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:47.200461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:47.200466Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 953 [2:7555895305877514769:6501]
2025-09-30T14:52:47.200477Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:47.200490Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:47.200492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:47.200494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:47.200496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:47.200508Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:47.200518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:47.200524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:47.200582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.200590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.200592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.200596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:47.200598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:47.200650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:47.200655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.200663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.200673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.200686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:47.200703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895305967258579:8023], now have 1 active actors on pipe
2025-09-30T14:52:47.200712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895305877514764:6501]
2025-09-30T14:52:47.200714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895305877514764:6501]
2025-09-30T14:52:47.200715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895305877514764:6501]
2025-09-30T14:52:47.200725Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:47.200737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895305967258323:2454], now have 1 active actors on pipe
2025-09-30T14:52:47.200737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:47.200739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:47.200741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:47.200744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:47.200758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:47.200766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:47.200792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895305877514764:6501]
2025-09-30T14:52:47.200803Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:47.200803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 953
2025-09-30T14:52:47.200817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:47.200844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:47.200847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:47.200866Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|330d2f82-10248cfb-b2a0126-23a95e78_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:47.200877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:47.200883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:47.200863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 953
2025-09-30T14:52:47.200885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:47.200895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:47.200905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:47.200920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:47.201075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:47.201087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:47.201121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:47.201191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 954 partition: 0 MaxSeqNo: 42 sessionId: src_id|330d2f82-10248cfb-b2a0126-23a95e78_0
2025-09-30T14:52:47.201521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fef4e1f-7fd6c664-7504850b-3b1e9f1f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|330d2f82-10248cfb-b2a0126-23a95e78_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:47.204333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|330d2f82-10248cfb-b2a0126-23a95e78_0] Write session: try to update token
2025-09-30T14:52:47.204352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|330d2f82-10248cfb-b2a0126-23a95e78_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:47.218260Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:47.218276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:47.218285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895305877514764:6501]
2025-09-30T14:52:47.218336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:47.218335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:47.218528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:47.218532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 954 sessionId: src_id|330d2f82-10248cfb-b2a0126-23a95e78_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:47.218681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:47.218824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:47.218962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:47.219184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:47.219226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:47.221652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:47.221803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:47.221819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:47.221849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:47.221943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:47.223489Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:47.223498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:47.223500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:47.223501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:47.223507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895305877514764:6501]
2025-09-30T14:52:47.223510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895305877514764:6501]
2025-09-30T14:52:47.223513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895305877514764:6501]
2025-09-30T14:52:47.223541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:47.223546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.223549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:47.223558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:47.223568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:47.223571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:47.223664Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:47.268560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895305967258742:7731]
2025-09-30T14:52:47.268807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 953, pipe: [1:7555895305967258742:7731]
2025-09-30T14:52:47.324574Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:47.331738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:47.331763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:47.331915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.331972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.332033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.332095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.332141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.332146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.332207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.332263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.332319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.332377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.332417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.332423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.332484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.332538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.332596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.332654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.332694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.332700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.332761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.332816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.332873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.332928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.332966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.332971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.333030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.333083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.333139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.333196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.333242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.333250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.333319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.333380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.333437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.333493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.333536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.333543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.333603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.333659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.333718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.333783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.333827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.333834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.333895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.333949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.334012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.334080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.334127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.334133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.334193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.334259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.334316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.334372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.334412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.334417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.334474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.334531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.334589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.334649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.334689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.334695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.334736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895305967258742:7731], now have 1 active actors on pipe
2025-09-30T14:52:47.334977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:47.334977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895305967258742:7731]
2025-09-30T14:52:47.335002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:47.335005Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:47.335036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 954 reason: error at write: Disconnected sessionId: src_id|330d2f82-10248cfb-b2a0126-23a95e78_0
2025-09-30T14:52:47.335259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 954 sessionId: src_id|330d2f82-10248cfb-b2a0126-23a95e78_0 is DEAD
2025-09-30T14:52:47.335445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|330d2f82-10248cfb-b2a0126-23a95e78_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:47.335454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|330d2f82-10248cfb-b2a0126-23a95e78_0] Write session will restart in 0.009427s
2025-09-30T14:52:47.335479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|330d2f82-10248cfb-b2a0126-23a95e78_0] Write session: Do CDS request
2025-09-30T14:52:47.335485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|330d2f82-10248cfb-b2a0126-23a95e78_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:47.336033Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:47.345685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|330d2f82-10248cfb-b2a0126-23a95e78_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:47.345850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:47.345876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 955
2025-09-30T14:52:47.346056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 955 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:47.346090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 955 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:47.346100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=955 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:47.346104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:47.346587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 955 sessionId:  describe result for acl check
2025-09-30T14:52:47.346626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:47.346627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:47.346629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:47.346635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895305967258925:8027] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:47.347151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895305967258925:8027] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:47.350591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895305967258925:8027] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:47.353224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895305967258925:8027] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:47.353240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895305967258925:8027] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:47.353243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895305967258925:8027] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:47.353250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 955 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:47.353721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:47.356882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:47.357067Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:47.357075Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:47.357083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:47.357121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:47.357153Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895305877515054:6503]
2025-09-30T14:52:47.357608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:47.357846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:47.357878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:47.358094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:47.358139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:47.358144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:47.358145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:47.358146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:47.358147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:47.358148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:47.358148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:47.358149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:47.358149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:47.358150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:47.358151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.358152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.358152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.358153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:47.358154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:47.358157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:47.358166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:47.358170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:47.358174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:47.358177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:47.358181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:47.358184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:47.358187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:47.358190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:47.358194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:47.358197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.358202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.358206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.358210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:47.358214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:47.358231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:47.358236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:47.358240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:47.358243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:47.358247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:47.358250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:47.358253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:47.358256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:47.358258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:47.358261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:47.358263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:47.358266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:47.358269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:47.358272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:47.358274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:47.358277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:47.358280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:47.358282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:47.358285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:47.358288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:47.358291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.358295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.358298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.358300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.358303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.358306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.358308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:47.358311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:47.358314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:47.358316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:47.358338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:47.363718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:47.365004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:47.365018Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:47.365020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:47.365024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:47.365030Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 954 [2:7555895305877515054:6503]
2025-09-30T14:52:47.365043Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:47.365059Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:47.365067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:47.365070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:47.365072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:47.365086Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:47.365096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:47.365107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:47.365160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.365167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.365169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.365172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:47.365175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:47.365231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:47.365237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.365245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.365255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.365265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:47.365282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895305967259152:8027], now have 1 active actors on pipe
2025-09-30T14:52:47.365291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895305877515049:6503]
2025-09-30T14:52:47.365292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895305877515049:6503]
2025-09-30T14:52:47.365295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895305877515049:6503]
2025-09-30T14:52:47.365307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:47.365320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895305967258744:2454], now have 1 active actors on pipe
2025-09-30T14:52:47.365322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:47.365326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:47.365330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:47.365331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:47.365344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:47.365352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:47.365386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895305877515049:6503]
2025-09-30T14:52:47.365393Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:47.365403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:47.365434Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 954
2025-09-30T14:52:47.365434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 954
2025-09-30T14:52:47.365521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:47.365532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:47.365558Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a85e6258-22f67fbd-f2af3f8-e9381840_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:47.365569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:47.365578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:47.365580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:47.365590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:47.365603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:47.365621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:47.365795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:47.365801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:47.365814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:47.365958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 955 partition: 0 MaxSeqNo: 42 sessionId: src_id|a85e6258-22f67fbd-f2af3f8-e9381840_0
2025-09-30T14:52:47.366408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|330d2f82-10248cfb-b2a0126-23a95e78_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a85e6258-22f67fbd-f2af3f8-e9381840_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:47.369090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a85e6258-22f67fbd-f2af3f8-e9381840_0] Write session: try to update token
2025-09-30T14:52:47.369119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a85e6258-22f67fbd-f2af3f8-e9381840_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:47.376908Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:47.376925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:47.376937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895305877515049:6503]
2025-09-30T14:52:47.376993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:47.376994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:47.377172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:47.377316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:47.377455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:47.377594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:47.377794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:47.377842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:47.382423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 955 sessionId: src_id|a85e6258-22f67fbd-f2af3f8-e9381840_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:47.385528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:47.385748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:47.385770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:47.385805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:47.385921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:47.387181Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:47.387194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:47.387197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:47.387199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:47.387208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895305877515049:6503]
2025-09-30T14:52:47.387213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895305877515049:6503]
2025-09-30T14:52:47.387217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895305877515049:6503]
2025-09-30T14:52:47.387271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:47.387277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:47.387282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:47.387282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.387284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:47.387285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:47.387414Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:47.434911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895305967259178:7731]
2025-09-30T14:52:47.435287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 954, pipe: [1:7555895305967259178:7731]
2025-09-30T14:52:47.492190Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:47.499576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:47.499608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:47.499782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.499845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.499906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.499969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.500012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.500019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.500082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.500143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.500202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.500262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.500306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.500316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.500413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.500535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.500648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.500778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.500862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.500875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.500991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.501088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.501165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.501250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.501306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.501316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.501398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.501501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.501601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.501684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.501738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.501748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.501828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.501908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.502004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.502120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.502174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.502183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.502278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.502355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.502435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.502526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.502603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.502618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.502695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.502766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.502845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.502923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.502977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.502986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.503061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.503133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.503208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.503308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.503362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.503373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.503452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.503522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.503598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.503668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.503719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.503727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.503785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895305967259178:7731], now have 1 active actors on pipe
2025-09-30T14:52:47.503999Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:47.504036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895305967259178:7731]
2025-09-30T14:52:47.504060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:47.504063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:47.504090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 955 reason: error at write: Disconnected sessionId: src_id|a85e6258-22f67fbd-f2af3f8-e9381840_0
2025-09-30T14:52:47.504290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 955 sessionId: src_id|a85e6258-22f67fbd-f2af3f8-e9381840_0 is DEAD
2025-09-30T14:52:47.504399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a85e6258-22f67fbd-f2af3f8-e9381840_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:47.504409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a85e6258-22f67fbd-f2af3f8-e9381840_0] Write session will restart in 0.006285s
2025-09-30T14:52:47.504449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a85e6258-22f67fbd-f2af3f8-e9381840_0] Write session: Do CDS request
2025-09-30T14:52:47.504454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a85e6258-22f67fbd-f2af3f8-e9381840_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:47.504833Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:47.511742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a85e6258-22f67fbd-f2af3f8-e9381840_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:47.511834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:47.511856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 956
2025-09-30T14:52:47.512003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 956 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:47.512040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 956 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:47.512045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=956 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:47.512050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:47.512510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 956 sessionId:  describe result for acl check
2025-09-30T14:52:47.512552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:47.512558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:47.512561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:47.512567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895305967259218:8039] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:47.513154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895305967259218:8039] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:47.515566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895305967259218:8039] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:47.518419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895305967259218:8039] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:47.518435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895305967259218:8039] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:47.518439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895305967259218:8039] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:47.518447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 956 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:47.528402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:47.531703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:47.531912Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:47.531920Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:47.531929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:47.531980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:47.532013Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895305877515376:6517]
2025-09-30T14:52:47.532594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:47.532943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:47.532986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:47.533268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:47.533320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:47.533321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:47.533322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:47.533323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:47.533325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:47.533326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:47.533328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:47.533329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:47.533330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:47.533332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:47.533333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.533334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.533336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.533337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:47.533338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:47.533344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:47.533354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:47.533359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:47.533363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:47.533367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:47.533371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:47.533375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:47.533380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:47.533384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:47.533387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:47.533389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.533392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.533394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.533397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:47.533399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:47.533405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:47.533410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:47.533415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:47.533418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:47.533422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:47.533425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:47.533428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:47.533431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:47.533434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:47.533438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:47.533441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:47.533444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:47.533447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:47.533451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:47.533454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:47.533457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:47.533460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:47.533464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:47.533466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:47.533471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:47.533474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.533477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.533479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.533483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.533486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.533489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.533492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:47.533495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:47.533497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:47.533501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:47.533534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:47.539229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:47.540528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:47.540546Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:47.540549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:47.540554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:47.540561Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 955 [2:7555895305877515376:6517]
2025-09-30T14:52:47.540578Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:47.540591Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:47.540593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:47.540596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:47.540598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:47.540611Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:47.540620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:47.540626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:47.540686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.540694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.540696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.540699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:47.540702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:47.540770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:47.540778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.540791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.540809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.540831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:47.540852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895305877515371:6517]
2025-09-30T14:52:47.540858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895305877515371:6517]
2025-09-30T14:52:47.540861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895305877515371:6517]
2025-09-30T14:52:47.540869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:47.540879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:47.540884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895305967259191:2454], now have 1 active actors on pipe
2025-09-30T14:52:47.540889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:47.540889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895305967259389:8039], now have 1 active actors on pipe
2025-09-30T14:52:47.540891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:47.540894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:47.540909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:47.540912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:47.540949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895305877515371:6517]
2025-09-30T14:52:47.540962Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:47.540971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 955
2025-09-30T14:52:47.540983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 955
2025-09-30T14:52:47.541009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:47.541066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:47.541086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:47.541113Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69c8db57-1e0397f4-e363407b-b6201575_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:47.541125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:47.541132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:47.541148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:47.541155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:47.541162Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:47.541176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:47.541327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:47.541340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:47.541378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:47.541473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 956 partition: 0 MaxSeqNo: 42 sessionId: src_id|69c8db57-1e0397f4-e363407b-b6201575_0
2025-09-30T14:52:47.541804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a85e6258-22f67fbd-f2af3f8-e9381840_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|69c8db57-1e0397f4-e363407b-b6201575_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:47.544615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69c8db57-1e0397f4-e363407b-b6201575_0] Write session: try to update token
2025-09-30T14:52:47.544639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69c8db57-1e0397f4-e363407b-b6201575_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:47.553274Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:47.553290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:47.553300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895305877515371:6517]
2025-09-30T14:52:47.553341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:47.553345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:47.553507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:47.553653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:47.553791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:47.553931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:47.554113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:47.554152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:47.558962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 956 sessionId: src_id|69c8db57-1e0397f4-e363407b-b6201575_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:47.561509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:47.561707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:47.561727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:47.561757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:47.561821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:47.563902Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:47.563917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:47.563919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:47.563922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:47.563931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895305877515371:6517]
2025-09-30T14:52:47.563935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895305877515371:6517]
2025-09-30T14:52:47.563938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895305877515371:6517]
2025-09-30T14:52:47.563977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:47.563984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.563986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:47.563991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:47.564007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:47.564011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:47.564152Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:47.604411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895305967259612:7731]
2025-09-30T14:52:47.604706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 955, pipe: [1:7555895305967259612:7731]
2025-09-30T14:52:47.674107Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:47.681853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:47.681880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:47.682032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.682091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.682153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.682210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.682273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.682285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.682347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.682410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.682473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.682538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.682584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.682590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.682654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.682725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.682792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.682859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.682907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.682914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.682982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.683045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.683108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.683167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.683214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.683217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.683306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.683371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.683433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.683496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.683550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.683558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.683623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.683683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.683752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.683817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.683860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.683866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.683933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.683995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.684061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.684125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.684172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.684179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.684244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.684311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.684379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.684439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.684488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.684495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.684567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.684634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.684696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.684759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.684803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.684811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.684876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:47.684944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:47.685009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:47.685078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:47.685123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:47.685130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:47.685190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895305967259612:7731], now have 1 active actors on pipe
2025-09-30T14:52:47.685469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:47.685487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:47.685491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:47.685521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 956 reason: error at write: Disconnected sessionId: src_id|69c8db57-1e0397f4-e363407b-b6201575_0
2025-09-30T14:52:47.685701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 956 sessionId: src_id|69c8db57-1e0397f4-e363407b-b6201575_0 is DEAD
2025-09-30T14:52:47.685841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c8db57-1e0397f4-e363407b-b6201575_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:47.685851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c8db57-1e0397f4-e363407b-b6201575_0] Write session will restart in 0.008483s
2025-09-30T14:52:47.685874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c8db57-1e0397f4-e363407b-b6201575_0] Write session: Do CDS request
2025-09-30T14:52:47.685879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c8db57-1e0397f4-e363407b-b6201575_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:47.686000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895305967259612:7731]
2025-09-30T14:52:47.686531Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:47.695733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69c8db57-1e0397f4-e363407b-b6201575_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:47.695833Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:47.695856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 957
2025-09-30T14:52:47.696038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 957 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:47.696079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 957 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:47.696090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=957 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:47.696095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:47.696640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 957 sessionId:  describe result for acl check
2025-09-30T14:52:47.696679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:47.696686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:47.696689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:47.696695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895305967259722:8043] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:47.697226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895305967259722:8043] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:47.700341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895305967259722:8043] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:47.703095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895305967259722:8043] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:47.703113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895305967259722:8043] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:47.703116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895305967259722:8043] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:47.703125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 957 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:47.708002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:47.711125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:47.711338Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:47.711347Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:47.711359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:47.711424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:47.711450Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895305877515665:6520]
2025-09-30T14:52:47.711914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:47.712296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:47.712353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:47.712694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:47.712771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:47.712779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:47.712781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:47.712782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:47.712784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:47.712785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:47.712786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:47.712787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:47.712788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:47.712790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:47.712791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.712792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.712793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.712794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:47.712795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:47.712800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:47.712810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:47.712814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:47.712817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:47.712821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:47.712824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:47.712828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:47.712831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:47.712835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:47.712839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:47.712842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.712846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.712850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.712853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:47.712857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:47.712866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:47.712873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:47.712879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:47.712885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:47.712889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:47.712894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:47.712898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:47.712903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:47.712908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:47.712912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:47.712916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:47.712921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:47.712926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:47.712932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:47.712936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:47.712942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:47.712947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:47.712952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:47.712956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:47.712961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:47.712966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.712970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.712975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.712980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.712985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.712997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.713001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:47.713007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:47.713015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:47.713020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:47.713068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:47.718660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:47.720022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:47.720033Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:47.720036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:47.720040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:47.720045Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 956 [2:7555895305877515665:6520]
2025-09-30T14:52:47.720061Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:47.720074Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:47.720077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:47.720080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:47.720081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:47.720093Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:47.720098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:47.720103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:47.720162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.720173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.720175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.720179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:47.720181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:47.720237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:47.720243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.720251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.720257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.720270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:47.720285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895305877515660:6520]
2025-09-30T14:52:47.720290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895305877515660:6520]
2025-09-30T14:52:47.720291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895305877515660:6520]
2025-09-30T14:52:47.720298Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:47.720308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:47.720312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:47.720315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:47.720317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:47.720318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:47.720319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:47.720327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895305967259948:8043], now have 1 active actors on pipe
2025-09-30T14:52:47.720330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895305967259615:2454], now have 1 active actors on pipe
2025-09-30T14:52:47.720359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895305877515660:6520]
2025-09-30T14:52:47.720374Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:47.720399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:47.720395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 956
2025-09-30T14:52:47.720418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 956
2025-09-30T14:52:47.720492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:47.720503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:47.720533Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|576f03fe-30842696-ab129fcb-572f3c75_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:47.720545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:47.720549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:47.720551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:47.720562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:47.720576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:47.720605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:47.720804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:47.720812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:47.720824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:47.720912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 957 partition: 0 MaxSeqNo: 42 sessionId: src_id|576f03fe-30842696-ab129fcb-572f3c75_0
2025-09-30T14:52:47.721229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c8db57-1e0397f4-e363407b-b6201575_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|576f03fe-30842696-ab129fcb-572f3c75_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:47.723899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|576f03fe-30842696-ab129fcb-572f3c75_0] Write session: try to update token
2025-09-30T14:52:47.723920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|576f03fe-30842696-ab129fcb-572f3c75_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:47.732569Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:47.732587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:47.732589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:47.732591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:47.732602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895305877515660:6520]
2025-09-30T14:52:47.732608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895305877515660:6520]
2025-09-30T14:52:47.732612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895305877515660:6520]
2025-09-30T14:52:47.732659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:47.732660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:47.732665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:47.732667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.732668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:47.732670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:47.732840Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:47.738804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 957 sessionId: src_id|576f03fe-30842696-ab129fcb-572f3c75_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:47.741378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:47.786184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895305967260037:7731]
2025-09-30T14:52:47.786554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 956, pipe: [1:7555895305967260037:7731]
2025-09-30T14:52:47.840430Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:47.840738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:47.840760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:47.840804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895305967260037:7731], now have 1 active actors on pipe
2025-09-30T14:52:47.841027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895305967260037:7731]
2025-09-30T14:52:47.841042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:47.841045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:47.841059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:47.841035Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:47.841099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 957 reason: error at write: Disconnected sessionId: src_id|576f03fe-30842696-ab129fcb-572f3c75_0
2025-09-30T14:52:47.841274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 957 sessionId: src_id|576f03fe-30842696-ab129fcb-572f3c75_0 is DEAD
2025-09-30T14:52:47.841435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|576f03fe-30842696-ab129fcb-572f3c75_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:47.841447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|576f03fe-30842696-ab129fcb-572f3c75_0] Write session will restart in 0.009682s
2025-09-30T14:52:47.841471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|576f03fe-30842696-ab129fcb-572f3c75_0] Write session: Do CDS request
2025-09-30T14:52:47.841481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|576f03fe-30842696-ab129fcb-572f3c75_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:47.852753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|576f03fe-30842696-ab129fcb-572f3c75_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:47.852806Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:47.852835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 958
2025-09-30T14:52:47.853011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 958 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:47.853048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 958 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:47.853058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=958 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:47.853062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:47.853492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 958 sessionId:  describe result for acl check
2025-09-30T14:52:47.853524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:47.853526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:47.853529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:47.853534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895305967260198:8047] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:47.854067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895305967260198:8047] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:47.856409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895305967260198:8047] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:47.859195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895305967260198:8047] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:47.859209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895305967260198:8047] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:47.859212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895305967260198:8047] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:47.859219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 958 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:47.865668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:47.866335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:47.866501Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:47.866510Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:47.866518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:47.866566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:47.866611Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895305877515953:6522]
2025-09-30T14:52:47.867136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:47.867449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:47.867501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:47.867842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:47.867921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:47.867927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:47.867928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:47.867928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:47.867929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:47.867930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:47.867931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:47.867931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:47.867932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:47.867933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:47.867933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.867934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.867935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.867935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:47.867936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:47.867940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:47.867948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:47.867952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:47.867957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:47.867960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:47.867964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:47.867968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:47.867972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:47.867975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:47.867979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:47.867983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.867988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.867992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.867996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:47.868000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:47.868009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:47.868017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:47.868024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:47.868030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:47.868034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:47.868039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:47.868044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:47.868049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:47.868054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:47.868060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:47.868064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:47.868069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:47.868076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:47.868081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:47.868085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:47.868091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:47.868095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:47.868100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:47.868104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:47.868109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:47.868114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.868119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.868123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.868134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.868139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.868144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.868148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:47.868153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:47.868162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:47.868167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:47.868210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:47.873618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:47.874485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:47.874501Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:47.874504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:47.874508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:47.874514Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 957 [2:7555895305877515953:6522]
2025-09-30T14:52:47.874529Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:47.874544Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:47.874547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:47.874550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:47.874552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:47.874567Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:47.874578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:47.874586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:47.874645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.874653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.874655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.874659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:47.874661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:47.874723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:47.874730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.874743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:47.874754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:47.874775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:47.874796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895305967260421:8047], now have 1 active actors on pipe
2025-09-30T14:52:47.874804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895305967260039:2454], now have 1 active actors on pipe
2025-09-30T14:52:47.874812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895305877515948:6522]
2025-09-30T14:52:47.874814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895305877515948:6522]
2025-09-30T14:52:47.874816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895305877515948:6522]
2025-09-30T14:52:47.874832Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:47.874850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:47.874852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:47.874860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:47.874861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:47.874869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:47.874873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:47.874880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 957
2025-09-30T14:52:47.874886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 957
2025-09-30T14:52:47.874903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895305877515948:6522]
2025-09-30T14:52:47.874912Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:47.874924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:47.874958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:47.874964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:47.874985Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b74611ce-c89b94f-63577fc9-dfbbdb70_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:47.874997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:47.875002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:47.875004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:47.875014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:47.875023Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:47.875037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:47.875223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:47.875233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:47.875268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:47.875508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 958 partition: 0 MaxSeqNo: 42 sessionId: src_id|b74611ce-c89b94f-63577fc9-dfbbdb70_0
2025-09-30T14:52:47.875874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|576f03fe-30842696-ab129fcb-572f3c75_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b74611ce-c89b94f-63577fc9-dfbbdb70_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:47.878650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b74611ce-c89b94f-63577fc9-dfbbdb70_0] Write session: try to update token
2025-09-30T14:52:47.878670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b74611ce-c89b94f-63577fc9-dfbbdb70_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:47.886813Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:47.886832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:47.886841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895305877515948:6522]
2025-09-30T14:52:47.886885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:47.886898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:47.887062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:47.887216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:47.887380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:47.887531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:47.887735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:47.887785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:47.892845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 958 sessionId: src_id|b74611ce-c89b94f-63577fc9-dfbbdb70_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:47.895580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:47.895856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:47.895880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:47.895918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:47.896018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:47.897859Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:47.897876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:47.897878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:47.897881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:47.897890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895305877515948:6522]
2025-09-30T14:52:47.897894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895305877515948:6522]
2025-09-30T14:52:47.897898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895305877515948:6522]
2025-09-30T14:52:47.897935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:47.897942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:47.897945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:47.897961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:47.897978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:47.897983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:47.898084Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:47.941325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895305967260462:7731]
2025-09-30T14:52:47.941714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 957, pipe: [1:7555895305967260462:7731]
2025-09-30T14:52:48.006145Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:48.013754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:48.013784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:48.013942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:48.014000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:48.014056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:48.014110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:48.014159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:48.014170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:48.014262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:48.014336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:48.014407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:48.014476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:48.014521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:48.014530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:48.014598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:48.014666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:48.014726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:48.014785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:48.014829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:48.014835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:48.014903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:48.014968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:48.015031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:48.015094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:48.015138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:48.015144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:48.015204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:48.015284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:48.015343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:48.015408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:48.015462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:48.015470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:48.015539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:48.015594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:48.015655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:48.015718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:48.015766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:48.015773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:48.015850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:48.015917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:48.016005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:48.016091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:48.016143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:48.016150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:48.016211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:48.016267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:48.016324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:48.016399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:48.016441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:48.016446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:48.016534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:48.016602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:48.016661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:48.016718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:48.016759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:48.016764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:48.016855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:48.016930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:48.016989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:48.017058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:48.017103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:48.017111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:48.017169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895305967260462:7731], now have 1 active actors on pipe
2025-09-30T14:52:48.017402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:48.017397Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:48.017416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:48.017439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 958 reason: error at write: Disconnected sessionId: src_id|b74611ce-c89b94f-63577fc9-dfbbdb70_0
2025-09-30T14:52:48.017525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895305967260462:7731]
2025-09-30T14:52:48.017579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 958 sessionId: src_id|b74611ce-c89b94f-63577fc9-dfbbdb70_0 is DEAD
2025-09-30T14:52:48.017731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b74611ce-c89b94f-63577fc9-dfbbdb70_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:48.017740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b74611ce-c89b94f-63577fc9-dfbbdb70_0] Write session will restart in 0.009570s
2025-09-30T14:52:48.017767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b74611ce-c89b94f-63577fc9-dfbbdb70_0] Write session: Do CDS request
2025-09-30T14:52:48.017772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b74611ce-c89b94f-63577fc9-dfbbdb70_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:48.018442Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:48.028740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b74611ce-c89b94f-63577fc9-dfbbdb70_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:48.028839Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:48.028855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 959
2025-09-30T14:52:48.028968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 959 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:48.028998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 959 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:48.029003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=959 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:48.029006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:48.029370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 959 sessionId:  describe result for acl check
2025-09-30T14:52:48.029404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:48.029406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:48.029408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:48.029413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895310262227851:8053] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:48.029923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895310262227851:8053] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:48.032317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895310262227851:8053] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:48.035813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895310262227851:8053] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:48.035829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895310262227851:8053] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:48.035833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895310262227851:8053] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:48.035841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 959 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:48.042511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:48.046048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:48.046257Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:48.046268Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:48.046279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:48.046341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:48.046374Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895310172483550:6524]
2025-09-30T14:52:48.046999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:48.047379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:48.047436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:48.047785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:48.047864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:48.047871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:48.047872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:48.047873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:48.047874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:48.047876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:48.047877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:48.047878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:48.047880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:48.047881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:48.047882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.047883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.047885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.047886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:48.047887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:48.047894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:48.047903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:48.047907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:48.047911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:48.047915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:48.047919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:48.047922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:48.047926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:48.047930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:48.047934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:48.047938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.047942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.047945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.047949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:48.047953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:48.047962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:48.047970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:48.047976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:48.047982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:48.047987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:48.047993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:48.047998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:48.048015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:48.048025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:48.048031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:48.048036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:48.048044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:48.048051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:48.048060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:48.048064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:48.048069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:48.048076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:48.048082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:48.048091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:48.048097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:48.048106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.048112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.048117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.048127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.048132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.048137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.048145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:48.048150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:48.048155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:48.048160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:48.048202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:48.053813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:48.055229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:48.055266Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:48.055269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:48.055273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:48.055280Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 958 [2:7555895310172483550:6524]
2025-09-30T14:52:48.055296Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:48.055318Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:48.055321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:48.055324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:48.055327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:48.055343Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:48.055353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:48.055360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:48.055421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.055427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.055431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.055434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:48.055437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:48.055500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:48.055507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.055520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.055532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.055555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:48.055577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895310262228055:8053], now have 1 active actors on pipe
2025-09-30T14:52:48.055589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895310172483545:6524]
2025-09-30T14:52:48.055591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895310172483545:6524]
2025-09-30T14:52:48.055593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895310172483545:6524]
2025-09-30T14:52:48.055606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:48.055619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895310262227767:2454], now have 1 active actors on pipe
2025-09-30T14:52:48.055624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:48.055627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:48.055629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:48.055632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:48.055641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:48.055644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:48.055674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895310172483545:6524]
2025-09-30T14:52:48.055687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:48.055693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:48.055692Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 958
2025-09-30T14:52:48.055724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 958
2025-09-30T14:52:48.055773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:48.055782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:48.055806Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0f42784-addc4a88-a0e89c98-5a0b2ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:48.055816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:48.055819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:48.055821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:48.055830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:48.055843Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:48.055860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:48.056006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:48.056013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:48.056026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:48.056162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 959 partition: 0 MaxSeqNo: 42 sessionId: src_id|f0f42784-addc4a88-a0e89c98-5a0b2ca_0
2025-09-30T14:52:48.056527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b74611ce-c89b94f-63577fc9-dfbbdb70_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f0f42784-addc4a88-a0e89c98-5a0b2ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:48.059336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0f42784-addc4a88-a0e89c98-5a0b2ca_0] Write session: try to update token
2025-09-30T14:52:48.059356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0f42784-addc4a88-a0e89c98-5a0b2ca_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:48.067872Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:48.067893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:48.067896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:48.067898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:48.067907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895310172483545:6524]
2025-09-30T14:52:48.067913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895310172483545:6524]
2025-09-30T14:52:48.067917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895310172483545:6524]
2025-09-30T14:52:48.067961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:48.067969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.067971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:48.067972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:48.067979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:48.067983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:48.068111Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:48.073790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 959 sessionId: src_id|f0f42784-addc4a88-a0e89c98-5a0b2ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:48.076761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:48.117967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895310262228210:7731]
2025-09-30T14:52:48.118382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 958, pipe: [1:7555895310262228210:7731]
2025-09-30T14:52:48.183863Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:48.184152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:48.184165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:48.184197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895310262228210:7731], now have 1 active actors on pipe
2025-09-30T14:52:48.184372Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:48.184402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:48.184422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895310262228210:7731]
2025-09-30T14:52:48.184445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:48.184527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 959 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f0f42784-addc4a88-a0e89c98-5a0b2ca_0
2025-09-30T14:52:48.184692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 959 sessionId: src_id|f0f42784-addc4a88-a0e89c98-5a0b2ca_0 is DEAD
2025-09-30T14:52:48.184826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0f42784-addc4a88-a0e89c98-5a0b2ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:48.184835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0f42784-addc4a88-a0e89c98-5a0b2ca_0] Write session will restart in 0.008188s
2025-09-30T14:52:48.184852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0f42784-addc4a88-a0e89c98-5a0b2ca_0] Write session: Do CDS request
2025-09-30T14:52:48.184856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0f42784-addc4a88-a0e89c98-5a0b2ca_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:48.193711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0f42784-addc4a88-a0e89c98-5a0b2ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:48.193867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:48.193885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 960
2025-09-30T14:52:48.194038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 960 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:48.194086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 960 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:48.194099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=960 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:48.194103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:48.194560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 960 sessionId:  describe result for acl check
2025-09-30T14:52:48.194593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:48.194595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:48.194598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:48.194603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895310262228287:8060] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:48.195118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895310262228287:8060] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:48.197380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895310262228287:8060] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:48.200360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895310262228287:8060] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:48.200377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895310262228287:8060] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:48.200380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895310262228287:8060] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:48.200388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 960 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:48.209991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:48.210624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:48.210801Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:48.210813Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:48.210824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:48.210879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:48.210920Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895310172483842:6528]
2025-09-30T14:52:48.211615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:48.211917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:48.211958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:48.212278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:48.212348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:48.212354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:48.212356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:48.212357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:48.212358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:48.212360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:48.212361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:48.212363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:48.212364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:48.212365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:48.212366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.212367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.212369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.212370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:48.212371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:48.212376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:48.212388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:48.212393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:48.212397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:48.212401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:48.212405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:48.212409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:48.212413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:48.212417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:48.212421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:48.212425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.212429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.212432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.212437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:48.212441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:48.212449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:48.212457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:48.212463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:48.212469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:48.212474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:48.212480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:48.212485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:48.212490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:48.212495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:48.212500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:48.212505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:48.212510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:48.212515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:48.212520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:48.212524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:48.212530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:48.212535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:48.212540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:48.212551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:48.212556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:48.212568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.212573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.212578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.212585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.212589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.212594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.212603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:48.212608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:48.212615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:48.212624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:48.212669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:48.218395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:48.219263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:48.219278Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:48.219282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:48.219285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:48.219292Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 959 [2:7555895310172483842:6528]
2025-09-30T14:52:48.219309Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:48.219322Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:48.219324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:48.219327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:48.219329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:48.219344Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:48.219351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:48.219359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:48.219420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.219430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.219432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.219435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:48.219438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:48.219507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:48.219516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.219528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.219540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.219557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:48.219579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895310262228506:8060], now have 1 active actors on pipe
2025-09-30T14:52:48.219587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895310262228212:2454], now have 1 active actors on pipe
2025-09-30T14:52:48.219593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895310172483837:6528]
2025-09-30T14:52:48.219594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895310172483837:6528]
2025-09-30T14:52:48.219595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895310172483837:6528]
2025-09-30T14:52:48.219607Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:48.219618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:48.219626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:48.219628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:48.219630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:48.219635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:48.219638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:48.219658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895310172483837:6528]
2025-09-30T14:52:48.219661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:48.219675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:48.219753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 959
2025-09-30T14:52:48.219763Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 959
2025-09-30T14:52:48.219830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:48.219840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:48.219861Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61789045-2f8e4495-4504c50a-a8d26cc0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:48.219874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:48.219878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:48.219881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:48.219891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:48.219905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:48.219923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:48.220079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:48.220087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:48.220101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:48.220236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 960 partition: 0 MaxSeqNo: 42 sessionId: src_id|61789045-2f8e4495-4504c50a-a8d26cc0_0
2025-09-30T14:52:48.220585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0f42784-addc4a88-a0e89c98-5a0b2ca_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|61789045-2f8e4495-4504c50a-a8d26cc0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:48.223378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61789045-2f8e4495-4504c50a-a8d26cc0_0] Write session: try to update token
2025-09-30T14:52:48.223399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61789045-2f8e4495-4504c50a-a8d26cc0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:48.231833Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:48.231849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:48.231858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895310172483837:6528]
2025-09-30T14:52:48.231900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:48.231905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:48.232073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:48.232211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:48.232336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:48.232479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:48.232684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:48.232733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:48.237723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 960 sessionId: src_id|61789045-2f8e4495-4504c50a-a8d26cc0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:48.240368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:48.240562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:48.240580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:48.240608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:48.240689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:48.244088Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:48.244110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:48.244113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:48.244115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:48.244125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895310172483837:6528]
2025-09-30T14:52:48.244130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895310172483837:6528]
2025-09-30T14:52:48.244135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895310172483837:6528]
2025-09-30T14:52:48.244177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:48.244182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:48.244188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:48.244192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:48.244193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.244196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:48.244401Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:48.284900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895310262228637:7731]
2025-09-30T14:52:48.285307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 959, pipe: [1:7555895310262228637:7731]
2025-09-30T14:52:48.353764Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:48.361336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:48.361364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:48.361518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:48.361581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:48.361648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:48.361725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:48.362278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:48.362291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:48.362358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:48.362417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:48.362477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:48.362554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:48.362604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:48.362606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:48.362670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:48.362726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:48.362792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:48.362868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:48.362908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:48.362914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:48.362975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:48.363036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:48.363096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:48.363155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:48.363196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:48.363204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:48.363284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:48.363346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:48.363407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:48.363502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:48.363565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:48.363573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:48.363650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:48.363716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:48.363784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:48.363862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:48.363912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:48.363915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:48.363989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:48.364065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:48.364141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:48.364219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:48.364268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:48.364276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:48.364346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:48.364411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:48.364476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:48.364547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:48.364601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:48.364609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:48.364683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:48.364755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:48.364841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:48.364910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:48.364957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:48.364967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:48.365041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:48.365113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:48.365181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:48.365256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:48.365306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:48.365317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:48.365396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895310262228637:7731], now have 1 active actors on pipe
2025-09-30T14:52:48.365687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:48.365704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:48.365739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 960 reason: error at write: Disconnected sessionId: src_id|61789045-2f8e4495-4504c50a-a8d26cc0_0
2025-09-30T14:52:48.365823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895310262228637:7731]
2025-09-30T14:52:48.365869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:48.365897Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:48.365927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 960 sessionId: src_id|61789045-2f8e4495-4504c50a-a8d26cc0_0 is DEAD
2025-09-30T14:52:48.366069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61789045-2f8e4495-4504c50a-a8d26cc0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:48.366080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61789045-2f8e4495-4504c50a-a8d26cc0_0] Write session will restart in 0.008185s
2025-09-30T14:52:48.366104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61789045-2f8e4495-4504c50a-a8d26cc0_0] Write session: Do CDS request
2025-09-30T14:52:48.366110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61789045-2f8e4495-4504c50a-a8d26cc0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:48.375759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61789045-2f8e4495-4504c50a-a8d26cc0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:48.375852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:48.375877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 961
2025-09-30T14:52:48.376109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 961 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:48.376163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 961 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:48.376175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=961 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:48.376180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:48.376721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 961 sessionId:  describe result for acl check
2025-09-30T14:52:48.376767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:48.376775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:48.376777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:48.376784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895310262228702:8064] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:48.377490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895310262228702:8064] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:48.380345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895310262228702:8064] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:48.383646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895310262228702:8064] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:48.383663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895310262228702:8064] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:48.383667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895310262228702:8064] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:48.383675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 961 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:48.391087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:48.396879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:48.397129Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:48.397141Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:48.397155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:48.397232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:48.397284Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895310172484134:6530]
2025-09-30T14:52:48.397894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:48.398327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:48.398374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:48.398686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:48.398752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:48.398757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:48.398758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:48.398759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:48.398759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:48.398760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:48.398761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:48.398762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:48.398762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:48.398763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:48.398764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.398765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.398766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.398767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:48.398767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:48.398771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:48.398779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:48.398782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:48.398785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:48.398787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:48.398790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:48.398793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:48.398795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:48.398798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:48.398801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:48.398803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.398805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.398808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.398810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:48.398813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:48.398820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:48.398825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:48.398829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:48.398834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:48.398836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:48.398840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:48.398843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:48.398846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:48.398849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:48.398853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:48.398855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:48.398859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:48.398862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:48.398865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:48.398868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:48.398871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:48.398876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:48.398879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:48.398881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:48.398884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:48.398887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.398890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.398892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.398896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.398899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.398902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.398905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:48.398908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:48.398910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:48.398913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:48.398942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:48.405181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:48.406232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:48.406249Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:48.406250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:48.406253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:48.406258Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 960 [2:7555895310172484134:6530]
2025-09-30T14:52:48.406271Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:48.406287Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:48.406290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:48.406304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:48.406307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:48.406324Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:48.406331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:48.406339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:48.406406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.406414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.406415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.406418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:48.406420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:48.406479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:48.406485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.406495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.406501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.406511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:48.406527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895310172484129:6530]
2025-09-30T14:52:48.406532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895310172484129:6530]
2025-09-30T14:52:48.406534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895310172484129:6530]
2025-09-30T14:52:48.406541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:48.406551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:48.406562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:48.406567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:48.406572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:48.406577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:48.406581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:48.406602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895310172484129:6530]
2025-09-30T14:52:48.406618Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:48.406630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895310262228927:8064], now have 1 active actors on pipe
2025-09-30T14:52:48.406636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895310262228640:2454], now have 1 active actors on pipe
2025-09-30T14:52:48.406670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:48.406746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 960
2025-09-30T14:52:48.406746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 960
2025-09-30T14:52:48.407313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:48.407327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:48.407354Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb014867-1fbe3c15-c31dd49e-9da7b96_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:48.407367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:48.407375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:48.407378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:48.407389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:48.407400Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:48.407413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:48.407638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:48.407644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:48.407655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:48.407775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 961 partition: 0 MaxSeqNo: 42 sessionId: src_id|cb014867-1fbe3c15-c31dd49e-9da7b96_0
2025-09-30T14:52:48.408180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61789045-2f8e4495-4504c50a-a8d26cc0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cb014867-1fbe3c15-c31dd49e-9da7b96_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:48.410945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb014867-1fbe3c15-c31dd49e-9da7b96_0] Write session: try to update token
2025-09-30T14:52:48.410964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb014867-1fbe3c15-c31dd49e-9da7b96_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:48.419353Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:48.419370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:48.419372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:48.419374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:48.419384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895310172484129:6530]
2025-09-30T14:52:48.419388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895310172484129:6530]
2025-09-30T14:52:48.419393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895310172484129:6530]
2025-09-30T14:52:48.419432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:48.419439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.419439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:48.419442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:48.419446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:48.419450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:48.419585Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:48.425306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 961 sessionId: src_id|cb014867-1fbe3c15-c31dd49e-9da7b96_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:48.428191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:48.466072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895310262229080:7731]
2025-09-30T14:52:48.466477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 960, pipe: [1:7555895310262229080:7731]
2025-09-30T14:52:48.528931Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:48.529169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:48.529181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:48.529213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895310262229080:7731], now have 1 active actors on pipe
2025-09-30T14:52:48.529396Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:48.529462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895310262229080:7731]
2025-09-30T14:52:48.529485Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:48.529501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:48.529585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 961 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cb014867-1fbe3c15-c31dd49e-9da7b96_0
2025-09-30T14:52:48.529765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 961 sessionId: src_id|cb014867-1fbe3c15-c31dd49e-9da7b96_0 is DEAD
2025-09-30T14:52:48.529893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb014867-1fbe3c15-c31dd49e-9da7b96_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:48.529904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb014867-1fbe3c15-c31dd49e-9da7b96_0] Write session will restart in 0.008455s
2025-09-30T14:52:48.529927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb014867-1fbe3c15-c31dd49e-9da7b96_0] Write session: Do CDS request
2025-09-30T14:52:48.529932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb014867-1fbe3c15-c31dd49e-9da7b96_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:48.539723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb014867-1fbe3c15-c31dd49e-9da7b96_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:48.539808Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:48.539830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 962
2025-09-30T14:52:48.539994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 962 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:48.540037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 962 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:48.540048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=962 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:48.540052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:48.540523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 962 sessionId:  describe result for acl check
2025-09-30T14:52:48.540569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:48.540575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:48.540579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:48.540586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895310262229170:8076] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:48.541132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895310262229170:8076] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:48.544162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895310262229170:8076] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:48.547397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895310262229170:8076] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:48.547426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895310262229170:8076] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:48.547430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895310262229170:8076] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:48.547440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 962 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:48.553509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:48.557055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:48.557267Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:48.557279Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:48.557287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:48.557335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:48.557376Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895310172484462:6544]
2025-09-30T14:52:48.558060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:48.558424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:48.558484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:48.558832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:48.558908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:48.558914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:48.558916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:48.558917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:48.558919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:48.558920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:48.558921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:48.558922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:48.558923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:48.558924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:48.558926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.558928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.558929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.558930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:48.558932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:48.558938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:48.558948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:48.558953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:48.558957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:48.558961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:48.558965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:48.558970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:48.558974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:48.558978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:48.558983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:48.558988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.558992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.559007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.559011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:48.559014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:48.559024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:48.559031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:48.559044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:48.559050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:48.559058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:48.559064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:48.559074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:48.559079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:48.559089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:48.559094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:48.559099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:48.559105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:48.559110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:48.559115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:48.559124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:48.559129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:48.559138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:48.559144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:48.559148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:48.559158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:48.559164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.559173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.559177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.559183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.559191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.559196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.559205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:48.559210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:48.559215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:48.559220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:48.559288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:48.564965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:48.565750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:48.565761Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:48.565764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:48.565767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:48.565772Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 961 [2:7555895310172484462:6544]
2025-09-30T14:52:48.565786Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:48.565801Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:48.565804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:48.565808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:48.565810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:48.565825Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:48.565837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:48.565843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:48.565888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.565895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.565896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.565899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:48.565901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:48.565964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:48.565972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.565983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.566000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.566019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:48.566040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895310262229399:8076], now have 1 active actors on pipe
2025-09-30T14:52:48.566050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895310262229095:2454], now have 1 active actors on pipe
2025-09-30T14:52:48.566056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895310172484457:6544]
2025-09-30T14:52:48.566057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895310172484457:6544]
2025-09-30T14:52:48.566059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895310172484457:6544]
2025-09-30T14:52:48.566071Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:48.566085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:48.566087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:48.566093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:48.566096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:48.566098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:48.566102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:48.566134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895310172484457:6544]
2025-09-30T14:52:48.566143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:48.566108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 961
2025-09-30T14:52:48.566144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:48.566157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:48.566123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 961
2025-09-30T14:52:48.566161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:48.566209Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0b85d44-141b5037-8890040b-bb7e0490_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:48.566232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:48.566236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:48.566239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:48.566247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:48.566256Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:48.566279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:48.566433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:48.566443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:48.566456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:48.566526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 962 partition: 0 MaxSeqNo: 42 sessionId: src_id|d0b85d44-141b5037-8890040b-bb7e0490_0
2025-09-30T14:52:48.566893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb014867-1fbe3c15-c31dd49e-9da7b96_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d0b85d44-141b5037-8890040b-bb7e0490_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:48.569628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0b85d44-141b5037-8890040b-bb7e0490_0] Write session: try to update token
2025-09-30T14:52:48.569649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0b85d44-141b5037-8890040b-bb7e0490_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:48.578089Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:48.578108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:48.578110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:48.578112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:48.578122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895310172484457:6544]
2025-09-30T14:52:48.578126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895310172484457:6544]
2025-09-30T14:52:48.578131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895310172484457:6544]
2025-09-30T14:52:48.578168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:48.578175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.578178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:48.578194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:48.578220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:48.578225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:48.578332Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:48.584355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 962 sessionId: src_id|d0b85d44-141b5037-8890040b-bb7e0490_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:48.586974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:48.629487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895310262229519:7731]
2025-09-30T14:52:48.629866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 961, pipe: [1:7555895310262229519:7731]
2025-09-30T14:52:48.688569Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:48.689327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:48.689346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:48.689387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895310262229519:7731], now have 1 active actors on pipe
2025-09-30T14:52:48.689606Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:48.689616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:48.689647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:48.689651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:48.689664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895310262229519:7731]
2025-09-30T14:52:48.689724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 962 reason: error at write: Disconnected sessionId: src_id|d0b85d44-141b5037-8890040b-bb7e0490_0
2025-09-30T14:52:48.689899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 962 sessionId: src_id|d0b85d44-141b5037-8890040b-bb7e0490_0 is DEAD
2025-09-30T14:52:48.690047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0b85d44-141b5037-8890040b-bb7e0490_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:48.690057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0b85d44-141b5037-8890040b-bb7e0490_0] Write session will restart in 0.009759s
2025-09-30T14:52:48.690080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0b85d44-141b5037-8890040b-bb7e0490_0] Write session: Do CDS request
2025-09-30T14:52:48.690086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0b85d44-141b5037-8890040b-bb7e0490_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:48.700736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0b85d44-141b5037-8890040b-bb7e0490_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:48.700878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:48.700896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 963
2025-09-30T14:52:48.701056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 963 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:48.701091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 963 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:48.701096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=963 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:48.701100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:48.701569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 963 sessionId:  describe result for acl check
2025-09-30T14:52:48.701611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:48.701622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:48.701624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:48.701630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895310262229648:8080] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:48.702223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895310262229648:8080] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:48.704933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895310262229648:8080] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:48.707740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895310262229648:8080] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:48.707757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895310262229648:8080] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:48.707760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895310262229648:8080] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:48.707768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 963 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:48.713561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:48.717318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:48.717499Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:48.717507Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:48.717515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:48.717558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:48.717587Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895310172484757:6547]
2025-09-30T14:52:48.718100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:48.718403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:48.718438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:48.718684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:48.718733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:48.718738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:48.718739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:48.718740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:48.718740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:48.718741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:48.718742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:48.718743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:48.718744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:48.718744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:48.718745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.718746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.718746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.718747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:48.718747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:48.718751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:48.718758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:48.718760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:48.718762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:48.718765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:48.718767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:48.718769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:48.718771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:48.718773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:48.718776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:48.718778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.718780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.718783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.718785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:48.718787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:48.718793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:48.718799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:48.718803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:48.718808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:48.718812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:48.718817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:48.718821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:48.718826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:48.718830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:48.718835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:48.718838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:48.718843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:48.718848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:48.718853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:48.718857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:48.718862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:48.718867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:48.718872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:48.718876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:48.718881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:48.718886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.718891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.718895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.718902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.718906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.718912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.718916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:48.718921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:48.718926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:48.718931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:48.718970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:48.724180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:48.724938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:48.724952Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:48.724953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:48.724957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:48.724962Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 962 [2:7555895310172484757:6547]
2025-09-30T14:52:48.724973Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:48.724984Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:48.724990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:48.724992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:48.724993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:48.725004Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:48.725008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:48.725017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:48.725058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.725064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.725066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.725068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:48.725070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:48.725119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:48.725126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.725138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.725150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.725161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:48.725179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895310172484751:6547]
2025-09-30T14:52:48.725186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895310172484751:6547]
2025-09-30T14:52:48.725188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895310172484751:6547]
2025-09-30T14:52:48.725196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:48.725205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:48.725208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:48.725214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:48.725216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:48.725218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:48.725219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:48.725226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895310262229838:8080], now have 1 active actors on pipe
2025-09-30T14:52:48.725229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895310262229522:2454], now have 1 active actors on pipe
2025-09-30T14:52:48.725249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895310172484751:6547]
2025-09-30T14:52:48.725261Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:48.725284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:48.725298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 962
2025-09-30T14:52:48.725302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 962
2025-09-30T14:52:48.725387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:48.725396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:48.725418Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b5310c5-f05a2c61-a23b3d28-653a2158_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:48.725427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:48.725430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:48.725431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:48.725438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:48.725448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:48.725457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:48.725631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:48.725648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:48.725672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:48.725765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 963 partition: 0 MaxSeqNo: 42 sessionId: src_id|3b5310c5-f05a2c61-a23b3d28-653a2158_0
2025-09-30T14:52:48.726126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0b85d44-141b5037-8890040b-bb7e0490_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3b5310c5-f05a2c61-a23b3d28-653a2158_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:48.728844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b5310c5-f05a2c61-a23b3d28-653a2158_0] Write session: try to update token
2025-09-30T14:52:48.728862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b5310c5-f05a2c61-a23b3d28-653a2158_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:48.737167Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:48.737184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:48.737193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895310172484751:6547]
2025-09-30T14:52:48.737235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:48.737246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:48.737397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:48.737540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:48.737675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:48.737818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:48.737995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:48.738038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:48.743431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 963 sessionId: src_id|3b5310c5-f05a2c61-a23b3d28-653a2158_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:48.746184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:48.747073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:48.747092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:48.748160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:48.748189Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:48.748192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:48.748194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:48.748196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:48.748204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895310172484751:6547]
2025-09-30T14:52:48.748208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895310172484751:6547]
2025-09-30T14:52:48.748213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895310172484751:6547]
2025-09-30T14:52:48.748236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:48.748244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.748246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:48.748245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:48.748251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:48.748255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:48.748262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:48.748371Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:48.789684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895310262229950:7731]
2025-09-30T14:52:48.790001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 962, pipe: [1:7555895310262229950:7731]
2025-09-30T14:52:48.860620Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:48.868121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:48.868144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:48.868297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:48.868357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:48.868414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:48.868479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:48.868525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:48.868530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:48.868599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:48.868667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:48.868736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:48.868801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:48.868841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:48.868847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:48.868919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:48.868981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:48.869050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:48.869125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:48.869171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:48.869174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:48.869247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:48.869317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:48.869386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:48.869451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:48.869497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:48.869506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:48.869575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:48.869640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:48.869713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:48.869782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:48.869830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:48.869838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:48.869907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:48.869973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:48.870046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:48.870116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:48.870164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:48.870172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:48.870255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:48.870318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:48.870385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:48.870462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:48.870511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:48.870523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:48.870591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:48.870650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:48.870722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:48.870788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:48.870834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:48.870842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:48.870909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:48.870973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:48.871038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:48.871103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:48.871152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:48.871160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:48.871232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:48.871309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:48.871374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:48.871440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:48.871481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:48.871489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:48.871550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895310262229950:7731], now have 1 active actors on pipe
2025-09-30T14:52:48.871815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895310262229950:7731]
2025-09-30T14:52:48.871836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:48.871840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:48.871847Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:48.871868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 963 reason: error at write: Disconnected sessionId: src_id|3b5310c5-f05a2c61-a23b3d28-653a2158_0
2025-09-30T14:52:48.872054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 963 sessionId: src_id|3b5310c5-f05a2c61-a23b3d28-653a2158_0 is DEAD
2025-09-30T14:52:48.872175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b5310c5-f05a2c61-a23b3d28-653a2158_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:48.872185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b5310c5-f05a2c61-a23b3d28-653a2158_0] Write session will restart in 0.009813s
2025-09-30T14:52:48.872206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b5310c5-f05a2c61-a23b3d28-653a2158_0] Write session: Do CDS request
2025-09-30T14:52:48.872212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b5310c5-f05a2c61-a23b3d28-653a2158_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:48.872846Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:48.882769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b5310c5-f05a2c61-a23b3d28-653a2158_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:48.882871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:48.882889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 964
2025-09-30T14:52:48.883156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 964 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:48.883191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 964 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:48.883196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=964 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:48.883200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:48.883633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 964 sessionId:  describe result for acl check
2025-09-30T14:52:48.883679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:48.883688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:48.883690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:48.883696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895310262230056:8084] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:48.884247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895310262230056:8084] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:48.886907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895310262230056:8084] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:48.889953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895310262230056:8084] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:48.889970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895310262230056:8084] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:48.889973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895310262230056:8084] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:48.889981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 964 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:48.901147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:48.901790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:48.901981Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:48.901993Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:48.902003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:48.902055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:48.902105Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895310172485051:6549]
2025-09-30T14:52:48.902758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:48.903172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:48.903235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:48.903610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:48.904030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:48.904039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:48.904040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:48.904042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:48.904043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:48.904044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:48.904045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:48.904046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:48.904048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:48.904049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:48.904050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.904052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.904053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.904054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:48.904056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:48.904063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:48.904074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:48.904078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:48.904082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:48.904086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:48.904090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:48.904094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:48.904098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:48.904102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:48.904106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:48.904110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.904114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.904118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.904122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:48.904126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:48.904135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:48.904144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:48.904150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:48.904156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:48.904161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:48.904165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:48.904170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:48.904175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:48.904180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:48.904185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:48.904189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:48.904194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:48.904201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:48.904206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:48.904211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:48.904217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:48.904221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:48.904226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:48.904230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:48.904235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:48.904239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.904245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.904249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.904254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.904259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.904264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.904267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:48.904273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:48.904277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:48.904282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:48.904324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:48.909980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:48.910858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:48.910871Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:48.910873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:48.910876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:48.910882Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 963 [2:7555895310172485051:6549]
2025-09-30T14:52:48.910896Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:48.910914Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:48.910917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:48.910920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:48.910922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:48.910938Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:48.910951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:48.910957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:48.911010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.911018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.911020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.911024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:48.911026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:48.911093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:48.911100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.911112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:48.911128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:48.911145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:48.911168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895310262229953:2454], now have 1 active actors on pipe
2025-09-30T14:52:48.911173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895310262230261:8084], now have 1 active actors on pipe
2025-09-30T14:52:48.911181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895310172485046:6549]
2025-09-30T14:52:48.911183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895310172485046:6549]
2025-09-30T14:52:48.911184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895310172485046:6549]
2025-09-30T14:52:48.911194Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:48.911207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:48.911213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:48.911217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:48.911219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:48.911223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:48.911226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:48.911280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895310172485046:6549]
2025-09-30T14:52:48.911288Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:48.911291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:48.911265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 963
2025-09-30T14:52:48.911282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 963
2025-09-30T14:52:48.911322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:48.911331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:48.911358Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fbdd6d7e-cc4772-4a129bb3-ca1d5f6d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:48.911371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:48.911375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:48.911377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:48.911385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:48.911395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:48.911409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:48.911543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:48.911553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:48.911569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:48.911682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 964 partition: 0 MaxSeqNo: 42 sessionId: src_id|fbdd6d7e-cc4772-4a129bb3-ca1d5f6d_0
2025-09-30T14:52:48.911988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b5310c5-f05a2c61-a23b3d28-653a2158_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fbdd6d7e-cc4772-4a129bb3-ca1d5f6d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:48.914580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbdd6d7e-cc4772-4a129bb3-ca1d5f6d_0] Write session: try to update token
2025-09-30T14:52:48.914597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbdd6d7e-cc4772-4a129bb3-ca1d5f6d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:48.924628Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:48.924649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:48.924652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:48.924654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:48.924664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895310172485046:6549]
2025-09-30T14:52:48.924668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895310172485046:6549]
2025-09-30T14:52:48.924677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895310172485046:6549]
2025-09-30T14:52:48.924720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:48.924733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:48.924737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:48.924735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:48.924743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:48.924747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:48.924878Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:48.928470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 964 sessionId: src_id|fbdd6d7e-cc4772-4a129bb3-ca1d5f6d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:48.931098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:48.971967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895310262230383:7731]
2025-09-30T14:52:48.972261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 963, pipe: [1:7555895310262230383:7731]
2025-09-30T14:52:49.037489Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:49.037973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:49.037989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:49.038027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895310262230383:7731], now have 1 active actors on pipe
2025-09-30T14:52:49.038255Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:49.038254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895310262230383:7731]
2025-09-30T14:52:49.038255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:49.038292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:49.038295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:49.038356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 964 reason: error at write: Disconnected sessionId: src_id|fbdd6d7e-cc4772-4a129bb3-ca1d5f6d_0
2025-09-30T14:52:49.038518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 964 sessionId: src_id|fbdd6d7e-cc4772-4a129bb3-ca1d5f6d_0 is DEAD
2025-09-30T14:52:49.038668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbdd6d7e-cc4772-4a129bb3-ca1d5f6d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:49.038678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbdd6d7e-cc4772-4a129bb3-ca1d5f6d_0] Write session will restart in 0.008326s
2025-09-30T14:52:49.038700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbdd6d7e-cc4772-4a129bb3-ca1d5f6d_0] Write session: Do CDS request
2025-09-30T14:52:49.038709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbdd6d7e-cc4772-4a129bb3-ca1d5f6d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:49.047766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbdd6d7e-cc4772-4a129bb3-ca1d5f6d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:49.047858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:49.047879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 965
2025-09-30T14:52:49.047987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 965 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:49.048019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 965 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:49.048029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=965 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:49.048032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:49.048537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 965 sessionId:  describe result for acl check
2025-09-30T14:52:49.048573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:49.048575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:49.048577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:49.048582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895314557197740:8090] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:49.049116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895314557197740:8090] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:49.051359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895314557197740:8090] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:49.054176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895314557197740:8090] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:49.054193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895314557197740:8090] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:49.054196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895314557197740:8090] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:49.054203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 965 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:49.063901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:49.064381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:49.064535Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:49.064545Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:49.064572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:49.064619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:49.064658Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895314467452654:6552]
2025-09-30T14:52:49.065286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:49.065566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:49.065605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:49.065906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:49.065961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:49.065967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:49.065968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:49.065969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:49.065970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:49.065971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:49.065972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:49.065973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:49.065974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:49.065975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:49.065976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.065978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.065979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.065980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:49.065981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:49.065986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:49.065996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:49.066000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:49.066005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:49.066008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:49.066012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:49.066015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:49.066019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:49.066022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:49.066027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:49.066031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.066034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.066037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.066041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:49.066044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:49.066051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:49.066059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:49.066065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:49.066070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:49.066075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:49.066081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:49.066086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:49.066095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:49.066099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:49.066105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:49.066112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:49.066117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:49.066121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:49.066130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:49.066134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:49.066139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:49.066148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:49.066152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:49.066156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:49.066161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:49.066165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.066174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.066178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.066183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.066192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.066197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.066201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:49.066206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:49.066224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:49.066229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:49.066272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:49.071590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:49.072659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:49.072676Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:49.072679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:49.072683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:49.072690Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 964 [2:7555895314467452654:6552]
2025-09-30T14:52:49.072706Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:49.072721Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:49.072724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:49.072727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:49.072729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:49.072744Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:49.072757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:49.072764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:49.072831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.072840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.072842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.072846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:49.072849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:49.072914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:49.072925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.072939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.072952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.072971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:49.072988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895314557197687:2454], now have 1 active actors on pipe
2025-09-30T14:52:49.072999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895314557197976:8090], now have 1 active actors on pipe
2025-09-30T14:52:49.073005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895314467452649:6552]
2025-09-30T14:52:49.073008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895314467452649:6552]
2025-09-30T14:52:49.073010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895314467452649:6552]
2025-09-30T14:52:49.073022Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:49.073035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:49.073044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:49.073047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:49.073049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:49.073055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:49.073058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:49.073086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895314467452649:6552]
2025-09-30T14:52:49.073095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:49.073067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 964
2025-09-30T14:52:49.073097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:49.073113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:49.073119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:49.073121Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 964
2025-09-30T14:52:49.073166Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0f024a5-2c8bd9a0-2710e7f5-706e69f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:49.073179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:49.073188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:49.073190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:49.073200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:49.073214Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:49.073240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:49.073383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:49.073395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:49.073411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:49.073482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 965 partition: 0 MaxSeqNo: 42 sessionId: src_id|c0f024a5-2c8bd9a0-2710e7f5-706e69f9_0
2025-09-30T14:52:49.073802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbdd6d7e-cc4772-4a129bb3-ca1d5f6d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c0f024a5-2c8bd9a0-2710e7f5-706e69f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:49.076453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0f024a5-2c8bd9a0-2710e7f5-706e69f9_0] Write session: try to update token
2025-09-30T14:52:49.076473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0f024a5-2c8bd9a0-2710e7f5-706e69f9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:49.085239Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:49.085265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:49.085268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:49.085270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:49.085279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895314467452649:6552]
2025-09-30T14:52:49.085283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895314467452649:6552]
2025-09-30T14:52:49.085286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895314467452649:6552]
2025-09-30T14:52:49.085328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:49.085330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:49.085335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:49.085338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.085339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:49.085340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:49.085487Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:49.091909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 965 sessionId: src_id|c0f024a5-2c8bd9a0-2710e7f5-706e69f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:49.094643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:49.138380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895314557198133:7731]
2025-09-30T14:52:49.138661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 964, pipe: [1:7555895314557198133:7731]
2025-09-30T14:52:49.205612Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:49.205910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:49.205926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:49.205966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895314557198133:7731], now have 1 active actors on pipe
2025-09-30T14:52:49.206183Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:49.206233Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:49.206252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:49.206257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:49.206300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895314557198133:7731]
2025-09-30T14:52:49.206322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 965 reason: error at write: Disconnected sessionId: src_id|c0f024a5-2c8bd9a0-2710e7f5-706e69f9_0
2025-09-30T14:52:49.206492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 965 sessionId: src_id|c0f024a5-2c8bd9a0-2710e7f5-706e69f9_0 is DEAD
2025-09-30T14:52:49.206660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0f024a5-2c8bd9a0-2710e7f5-706e69f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:49.206671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0f024a5-2c8bd9a0-2710e7f5-706e69f9_0] Write session will restart in 0.009682s
2025-09-30T14:52:49.206695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0f024a5-2c8bd9a0-2710e7f5-706e69f9_0] Write session: Do CDS request
2025-09-30T14:52:49.206701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0f024a5-2c8bd9a0-2710e7f5-706e69f9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:49.217779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0f024a5-2c8bd9a0-2710e7f5-706e69f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:49.217857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:49.217877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 966
2025-09-30T14:52:49.217998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 966 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:49.218032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 966 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:49.218044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=966 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:49.218048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:49.218497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 966 sessionId:  describe result for acl check
2025-09-30T14:52:49.218530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:49.218537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:49.218541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:49.218547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895314557198258:8095] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:49.219086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895314557198258:8095] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:49.221302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895314557198258:8095] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:49.224430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895314557198258:8095] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:49.224447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895314557198258:8095] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:49.224453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895314557198258:8095] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:49.224470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 966 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:49.233884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:49.234425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:49.234573Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:49.234582Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:49.234590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:49.234625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:49.234662Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895314467452952:6555]
2025-09-30T14:52:49.235207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:49.235494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:49.235529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:49.235765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:49.235809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:49.235814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:49.235815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:49.235816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:49.235816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:49.235818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:49.235819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:49.235819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:49.235820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:49.235820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:49.235821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.235822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.235823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.235823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:49.235824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:49.235827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:49.235834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:49.235836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:49.235839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:49.235841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:49.235844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:49.235846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:49.235848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:49.235851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:49.235853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:49.235855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.235858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.235860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.235862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:49.235864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:49.235870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:49.235874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:49.235879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:49.235882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:49.235885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:49.235888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:49.235890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:49.235893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:49.235896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:49.235900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:49.235902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:49.235906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:49.235908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:49.235911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:49.235913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:49.235916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:49.235919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:49.235922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:49.235926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:49.235929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:49.235932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.235935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.235938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.235940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.235943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.235946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.235948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:49.235951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:49.235954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:49.235956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:49.235980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:49.241326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:49.242780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:49.242798Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:49.242801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:49.242805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:49.242812Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 965 [2:7555895314467452952:6555]
2025-09-30T14:52:49.242828Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:49.242844Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:49.242852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:49.242855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:49.242858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:49.242872Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:49.242883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:49.242891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:49.242951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.242960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.242962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.242965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:49.242967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:49.243032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:49.243040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.243052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.243063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.243079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:49.243099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895314557198134:2454], now have 1 active actors on pipe
2025-09-30T14:52:49.243107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895314557198446:8095], now have 1 active actors on pipe
2025-09-30T14:52:49.243113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895314467452947:6555]
2025-09-30T14:52:49.243116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895314467452947:6555]
2025-09-30T14:52:49.243118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895314467452947:6555]
2025-09-30T14:52:49.243132Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:49.243148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:49.243151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:49.243152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:49.243154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:49.243169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:49.243172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:49.243218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895314467452947:6555]
2025-09-30T14:52:49.243228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:49.243257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:49.243193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 965
2025-09-30T14:52:49.243196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 965
2025-09-30T14:52:49.243277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:49.243289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:49.243323Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13101ecb-bd7db8b3-b0fbdd56-3929057d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:49.243339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:49.243342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:49.243344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:49.243354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:49.243365Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:49.243382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:49.243529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:49.243539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:49.243554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:49.243649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 966 partition: 0 MaxSeqNo: 42 sessionId: src_id|13101ecb-bd7db8b3-b0fbdd56-3929057d_0
2025-09-30T14:52:49.243977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0f024a5-2c8bd9a0-2710e7f5-706e69f9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|13101ecb-bd7db8b3-b0fbdd56-3929057d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:49.246642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13101ecb-bd7db8b3-b0fbdd56-3929057d_0] Write session: try to update token
2025-09-30T14:52:49.246659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13101ecb-bd7db8b3-b0fbdd56-3929057d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:49.255546Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:49.255568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:49.255570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:49.255573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:49.255582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895314467452947:6555]
2025-09-30T14:52:49.255587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895314467452947:6555]
2025-09-30T14:52:49.255592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895314467452947:6555]
2025-09-30T14:52:49.255632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:49.255640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.255640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:49.255642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:49.255647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:49.255651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:49.255772Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:49.261011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 966 sessionId: src_id|13101ecb-bd7db8b3-b0fbdd56-3929057d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:49.264009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:49.306298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895314557198566:7731]
2025-09-30T14:52:49.306616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 965, pipe: [1:7555895314557198566:7731]
2025-09-30T14:52:49.373195Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:49.373821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:49.373840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:49.373882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895314557198566:7731], now have 1 active actors on pipe
2025-09-30T14:52:49.374097Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:49.374145Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:49.374159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:49.374162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:49.374201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895314557198566:7731]
2025-09-30T14:52:49.374235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 966 reason: error at write: Disconnected sessionId: src_id|13101ecb-bd7db8b3-b0fbdd56-3929057d_0
2025-09-30T14:52:49.374407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 966 sessionId: src_id|13101ecb-bd7db8b3-b0fbdd56-3929057d_0 is DEAD
2025-09-30T14:52:49.374568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13101ecb-bd7db8b3-b0fbdd56-3929057d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:49.374580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13101ecb-bd7db8b3-b0fbdd56-3929057d_0] Write session will restart in 0.008709s
2025-09-30T14:52:49.374602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13101ecb-bd7db8b3-b0fbdd56-3929057d_0] Write session: Do CDS request
2025-09-30T14:52:49.374610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13101ecb-bd7db8b3-b0fbdd56-3929057d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:49.384769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13101ecb-bd7db8b3-b0fbdd56-3929057d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:49.384879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:49.384898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 967
2025-09-30T14:52:49.385067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 967 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:49.385111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 967 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:49.385120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=967 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:49.385125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:49.385702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 967 sessionId:  describe result for acl check
2025-09-30T14:52:49.385740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:49.385746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:49.385748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:49.385755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895314557198675:8099] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:49.386328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895314557198675:8099] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:49.388838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895314557198675:8099] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:49.391491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895314557198675:8099] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:49.391508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895314557198675:8099] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:49.391512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895314557198675:8099] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:49.391521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 967 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:49.397834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:49.401618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:49.401837Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:49.401849Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:49.401860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:49.401936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:49.401979Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895314467453249:6557]
2025-09-30T14:52:49.402653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:49.402989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:49.403049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:49.403387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:49.403453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:49.403459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:49.403460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:49.403462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:49.403463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:49.403464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:49.403465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:49.403467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:49.403468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:49.403469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:49.403470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.403472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.403473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.403474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:49.403475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:49.403481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:49.403491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:49.403494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:49.403499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:49.403503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:49.403507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:49.403510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:49.403514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:49.403518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:49.403522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:49.403526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.403530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.403533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.403537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:49.403542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:49.403550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:49.403558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:49.403564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:49.403570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:49.403575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:49.403581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:49.403585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:49.403590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:49.403595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:49.403600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:49.403605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:49.403610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:49.403615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:49.403620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:49.403625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:49.403630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:49.403636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:49.403641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:49.403651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:49.403656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:49.403660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.403671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.403675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.403680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.403685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.403694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.403699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:49.403705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:49.403713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:49.403718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:49.403758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:49.409235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:49.410793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:49.410813Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:49.410817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:49.410821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:49.410828Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 966 [2:7555895314467453249:6557]
2025-09-30T14:52:49.410843Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:49.410859Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:49.410868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:49.410870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:49.410873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:49.410889Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:49.410901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:49.410908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:49.410976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.410989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.410991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.410994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:49.410997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:49.411066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:49.411074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.411086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.411097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.411114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:49.411138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895314557198867:8099], now have 1 active actors on pipe
2025-09-30T14:52:49.411150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895314557198567:2454], now have 1 active actors on pipe
2025-09-30T14:52:49.411156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895314467453244:6557]
2025-09-30T14:52:49.411161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895314467453244:6557]
2025-09-30T14:52:49.411163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895314467453244:6557]
2025-09-30T14:52:49.411177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:49.411197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:49.411198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:49.411202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:49.411205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:49.411219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:49.411222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:49.411218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 966
2025-09-30T14:52:49.411222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 966
2025-09-30T14:52:49.411275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895314467453244:6557]
2025-09-30T14:52:49.411285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:49.411288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:49.411308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:49.411318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:49.411368Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2ebc88d-d462dffe-b598ed7f-69ddf231_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:49.411381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:49.411384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:49.411387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:49.411398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:49.411413Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:49.411436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:49.411683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:49.411697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:49.411716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:49.411820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 967 partition: 0 MaxSeqNo: 42 sessionId: src_id|a2ebc88d-d462dffe-b598ed7f-69ddf231_0
2025-09-30T14:52:49.412145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13101ecb-bd7db8b3-b0fbdd56-3929057d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a2ebc88d-d462dffe-b598ed7f-69ddf231_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:49.414836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2ebc88d-d462dffe-b598ed7f-69ddf231_0] Write session: try to update token
2025-09-30T14:52:49.414853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2ebc88d-d462dffe-b598ed7f-69ddf231_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:49.423267Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:49.423287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:49.423289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:49.423291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:49.423300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895314467453244:6557]
2025-09-30T14:52:49.423304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895314467453244:6557]
2025-09-30T14:52:49.423309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895314467453244:6557]
2025-09-30T14:52:49.423347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:49.423354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.423357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:49.423363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:49.423375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:49.423380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:49.423493Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:49.428796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 967 sessionId: src_id|a2ebc88d-d462dffe-b598ed7f-69ddf231_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:49.431716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:49.474267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895314557199001:7731]
2025-09-30T14:52:49.474571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 966, pipe: [1:7555895314557199001:7731]
2025-09-30T14:52:49.531916Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:49.532214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:49.532232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:49.532272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895314557199001:7731], now have 1 active actors on pipe
2025-09-30T14:52:49.532471Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:49.532535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:49.532554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:49.532620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 967 reason: error at write: Disconnected sessionId: src_id|a2ebc88d-d462dffe-b598ed7f-69ddf231_0
2025-09-30T14:52:49.532777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 967 sessionId: src_id|a2ebc88d-d462dffe-b598ed7f-69ddf231_0 is DEAD
2025-09-30T14:52:49.532914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2ebc88d-d462dffe-b598ed7f-69ddf231_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:49.532926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2ebc88d-d462dffe-b598ed7f-69ddf231_0] Write session will restart in 0.008055s
2025-09-30T14:52:49.532918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:49.532953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2ebc88d-d462dffe-b598ed7f-69ddf231_0] Write session: Do CDS request
2025-09-30T14:52:49.532960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2ebc88d-d462dffe-b598ed7f-69ddf231_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:49.532957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895314557199001:7731]
2025-09-30T14:52:49.541789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2ebc88d-d462dffe-b598ed7f-69ddf231_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:49.541899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:49.541917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 968
2025-09-30T14:52:49.542048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 968 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:49.542083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 968 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:49.542087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=968 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:49.542091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:49.542580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 968 sessionId:  describe result for acl check
2025-09-30T14:52:49.542635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:49.542644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:49.542646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:49.542652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895314557199050:8110] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:49.543367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895314557199050:8110] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:49.545450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895314557199050:8110] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:49.548513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895314557199050:8110] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:49.548531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895314557199050:8110] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:49.548534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895314557199050:8110] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:49.548542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 968 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:49.558885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:49.562641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:49.562874Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:49.562886Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:49.562897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:49.562958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:49.563012Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895314467453583:6565]
2025-09-30T14:52:49.563695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:49.564014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:49.564071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:49.564364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:49.564407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:49.564410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:49.564411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:49.564412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:49.564413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:49.564413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:49.564414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:49.564415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:49.564415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:49.564416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:49.564417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.564418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.564418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.564419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:49.564420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:49.564423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:49.564433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:49.564437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:49.564441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:49.564445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:49.564449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:49.564453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:49.564456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:49.564460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:49.564465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:49.564469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.564472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.564474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.564477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:49.564479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:49.564485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:49.564490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:49.564494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:49.564498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:49.564500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:49.564504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:49.564506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:49.564510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:49.564512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:49.564515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:49.564518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:49.564521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:49.564523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:49.564527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:49.564529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:49.564533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:49.564536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:49.564542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:49.564546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:49.564552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:49.564557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.564563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.564567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.564572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.564577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.564582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.564586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:49.564591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:49.564601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:49.564605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:49.564648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:49.570159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:49.570998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:49.571014Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:49.571017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:49.571021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:49.571028Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 967 [2:7555895314467453583:6565]
2025-09-30T14:52:49.571043Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:49.571059Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:49.571061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:49.571066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:49.571068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:49.571084Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:49.571096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:49.571103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:49.571169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.571177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.571178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.571182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:49.571185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:49.571264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:49.571273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.571287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.571299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.571322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:49.571345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895314557199209:8110], now have 1 active actors on pipe
2025-09-30T14:52:49.571353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895314557199017:2454], now have 1 active actors on pipe
2025-09-30T14:52:49.571360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895314467453578:6565]
2025-09-30T14:52:49.571362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895314467453578:6565]
2025-09-30T14:52:49.571365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895314467453578:6565]
2025-09-30T14:52:49.571378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:49.571395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:49.571397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:49.571406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:49.571411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:49.571413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:49.571416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:49.571448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895314467453578:6565]
2025-09-30T14:52:49.571462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:49.571475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:49.571446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 967
2025-09-30T14:52:49.571488Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 967
2025-09-30T14:52:49.572090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:49.572106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:49.572141Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fbaecd4b-f6cdc2da-469ebf94-e481cf7f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:49.572154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:49.572158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:49.572160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:49.572172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:49.572184Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:49.572198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:49.572392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:49.572404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:49.572440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:49.572541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 968 partition: 0 MaxSeqNo: 42 sessionId: src_id|fbaecd4b-f6cdc2da-469ebf94-e481cf7f_0
2025-09-30T14:52:49.572942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2ebc88d-d462dffe-b598ed7f-69ddf231_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fbaecd4b-f6cdc2da-469ebf94-e481cf7f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:49.575821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbaecd4b-f6cdc2da-469ebf94-e481cf7f_0] Write session: try to update token
2025-09-30T14:52:49.575840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbaecd4b-f6cdc2da-469ebf94-e481cf7f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:49.583583Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:49.583601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:49.583611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895314467453578:6565]
2025-09-30T14:52:49.583655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:49.583664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:49.583828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:49.583981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:49.584125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:49.584276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:49.584475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:49.584521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:49.590451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 968 sessionId: src_id|fbaecd4b-f6cdc2da-469ebf94-e481cf7f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:49.593039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:49.593186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:49.593208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:49.593245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:49.593367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:49.594431Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:49.594447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:49.594450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:49.594452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:49.594462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895314467453578:6565]
2025-09-30T14:52:49.594466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895314467453578:6565]
2025-09-30T14:52:49.594469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895314467453578:6565]
2025-09-30T14:52:49.594506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:49.594513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.594512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:49.594516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:49.594520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:49.594524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:49.594646Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:49.632923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895314557199460:7731]
2025-09-30T14:52:49.633183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 967, pipe: [1:7555895314557199460:7731]
2025-09-30T14:52:49.705190Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:49.713081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:49.713104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:49.713273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:49.713348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:49.713420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:49.713496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:49.713547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:49.713557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:49.713627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:49.713691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:49.713756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:49.713825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:49.713877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:49.713885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:49.713952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:49.714011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:49.714078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:49.714143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:49.714190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:49.714198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:49.714287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:49.714352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:49.714414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:49.714474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:49.714520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:49.714528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:49.714601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:49.714664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:49.714727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:49.714797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:49.714845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:49.714852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:49.714921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:49.714989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:49.715059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:49.715128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:49.715176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:49.715183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:49.715275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:49.715343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:49.715415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:49.715479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:49.715523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:49.715533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:49.715607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:49.715673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:49.715733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:49.715799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:49.715850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:49.715860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:49.715929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:49.715995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:49.716057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:49.716120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:49.716162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:49.716170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:49.716240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:49.716305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:49.716372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:49.716433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:49.716476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:49.716484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:49.716546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895314557199460:7731], now have 1 active actors on pipe
2025-09-30T14:52:49.716762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895314557199460:7731]
2025-09-30T14:52:49.716789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:49.716793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:49.716797Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:49.716821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 968 reason: error at write: Disconnected sessionId: src_id|fbaecd4b-f6cdc2da-469ebf94-e481cf7f_0
2025-09-30T14:52:49.717007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 968 sessionId: src_id|fbaecd4b-f6cdc2da-469ebf94-e481cf7f_0 is DEAD
2025-09-30T14:52:49.717137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbaecd4b-f6cdc2da-469ebf94-e481cf7f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:49.717148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbaecd4b-f6cdc2da-469ebf94-e481cf7f_0] Write session will restart in 0.009498s
2025-09-30T14:52:49.717173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbaecd4b-f6cdc2da-469ebf94-e481cf7f_0] Write session: Do CDS request
2025-09-30T14:52:49.717178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbaecd4b-f6cdc2da-469ebf94-e481cf7f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:49.717536Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:49.727754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbaecd4b-f6cdc2da-469ebf94-e481cf7f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:49.727833Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:49.727850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 969
2025-09-30T14:52:49.728409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 969 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:49.728446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 969 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:49.728454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=969 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:49.728458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:49.728933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 969 sessionId:  describe result for acl check
2025-09-30T14:52:49.728983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:49.728989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:49.728991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:49.728997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895314557199604:8115] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:49.729509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895314557199604:8115] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:49.732505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895314557199604:8115] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:49.735207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895314557199604:8115] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:49.735222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895314557199604:8115] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:49.735225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895314557199604:8115] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:49.735233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 969 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:49.743501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:49.744014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:49.744182Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:49.744196Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:49.744207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:49.744266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:49.744606Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895314467453884:6574]
2025-09-30T14:52:49.745260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:49.745576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:49.745629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:49.745941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:49.746013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:49.746020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:49.746021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:49.746022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:49.746024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:49.746025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:49.746026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:49.746027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:49.746029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:49.746030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:49.746031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.746032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.746033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.746034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:49.746035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:49.746041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:49.746052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:49.746056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:49.746060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:49.746064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:49.746067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:49.746070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:49.746074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:49.746077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:49.746080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:49.746083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.746087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.746090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.746094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:49.746097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:49.746105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:49.746113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:49.746119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:49.746124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:49.746135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:49.746139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:49.746149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:49.746159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:49.746168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:49.746180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:49.746185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:49.746189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:49.746193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:49.746197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:49.746201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:49.746219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:49.746223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:49.746229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:49.746233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:49.746238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:49.746244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.746249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.746253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.746262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.746266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.746277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.746282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:49.746287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:49.746295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:49.746300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:49.746340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:49.751903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:49.752786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:49.752807Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:49.752810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:49.752814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:49.752821Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 968 [2:7555895314467453884:6574]
2025-09-30T14:52:49.752838Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:49.752853Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:49.752859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:49.752863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:49.752865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:49.752880Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:49.752887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:49.752899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:49.752958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.752969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.752972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.752975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:49.752978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:49.753042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:49.753049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.753062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.753079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.753101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:49.753123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895314557199822:8115], now have 1 active actors on pipe
2025-09-30T14:52:49.753127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895314557199462:2454], now have 1 active actors on pipe
2025-09-30T14:52:49.753134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895314467453879:6574]
2025-09-30T14:52:49.753137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895314467453879:6574]
2025-09-30T14:52:49.753140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895314467453879:6574]
2025-09-30T14:52:49.753151Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:49.753169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:49.753189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:49.753197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:49.753216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:49.753194Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 968
2025-09-30T14:52:49.753225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895314467453879:6574]
2025-09-30T14:52:49.753200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 968
2025-09-30T14:52:49.753226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:49.753228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:49.753229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:49.753235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:49.753283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:49.753294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:49.753320Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7bd551f4-79383b5f-a7df20ec-3ffc1b56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:49.753332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:49.753336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:49.753338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:49.753347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:49.753360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:49.753374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:49.753546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:49.753556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:49.753571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:49.753645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 969 partition: 0 MaxSeqNo: 42 sessionId: src_id|7bd551f4-79383b5f-a7df20ec-3ffc1b56_0
2025-09-30T14:52:49.753988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbaecd4b-f6cdc2da-469ebf94-e481cf7f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7bd551f4-79383b5f-a7df20ec-3ffc1b56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:49.756704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bd551f4-79383b5f-a7df20ec-3ffc1b56_0] Write session: try to update token
2025-09-30T14:52:49.756722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bd551f4-79383b5f-a7df20ec-3ffc1b56_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:49.764772Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:49.764795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:49.764804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895314467453879:6574]
2025-09-30T14:52:49.764846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:49.764848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:49.765032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:49.765182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:49.765332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:49.765483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:49.765682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:49.765730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:49.771436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 969 sessionId: src_id|7bd551f4-79383b5f-a7df20ec-3ffc1b56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:49.773939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:49.774147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:49.774170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:49.774218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:49.774299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:49.775406Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:49.775421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:49.775424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:49.775426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:49.775435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895314467453879:6574]
2025-09-30T14:52:49.775439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895314467453879:6574]
2025-09-30T14:52:49.775443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895314467453879:6574]
2025-09-30T14:52:49.775479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:49.775483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:49.775491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.775494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:49.775502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:49.775506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:49.775627Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:49.816765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895314557199897:7731]
2025-09-30T14:52:49.817080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 968, pipe: [1:7555895314557199897:7731]
2025-09-30T14:52:49.884716Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:49.893491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:49.893524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:49.893692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:49.893756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:49.893827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:49.893888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:49.893935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:49.893943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:49.894010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:49.894083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:49.894146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:49.894224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:49.894272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:49.894281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:49.894346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:49.894404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:49.894472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:49.894540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:49.894583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:49.894589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:49.894656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:49.894731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:49.894802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:49.894867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:49.894915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:49.894923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:49.894996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:49.895058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:49.895120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:49.895184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:49.895233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:49.895256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:49.895332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:49.895401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:49.895469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:49.895537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:49.895589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:49.895600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:49.895667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:49.895724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:49.895786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:49.895857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:49.895925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:49.895932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:49.896006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:49.896076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:49.896143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:49.896211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:49.896258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:49.896272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:49.896345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:49.896411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:49.896468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:49.896538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:49.896588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:49.896595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:49.896666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:49.896731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:49.896794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:49.896853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:49.896902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:49.896909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:49.896967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895314557199897:7731], now have 1 active actors on pipe
2025-09-30T14:52:49.897194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895314557199897:7731]
2025-09-30T14:52:49.897208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:49.897211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:49.897239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:49.897241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 969 reason: error at write: Disconnected sessionId: src_id|7bd551f4-79383b5f-a7df20ec-3ffc1b56_0
2025-09-30T14:52:49.897414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 969 sessionId: src_id|7bd551f4-79383b5f-a7df20ec-3ffc1b56_0 is DEAD
2025-09-30T14:52:49.897567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bd551f4-79383b5f-a7df20ec-3ffc1b56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:49.897578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bd551f4-79383b5f-a7df20ec-3ffc1b56_0] Write session will restart in 0.009650s
2025-09-30T14:52:49.897603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bd551f4-79383b5f-a7df20ec-3ffc1b56_0] Write session: Do CDS request
2025-09-30T14:52:49.897609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bd551f4-79383b5f-a7df20ec-3ffc1b56_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:49.897999Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:49.908748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bd551f4-79383b5f-a7df20ec-3ffc1b56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:49.908996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:49.909030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 970
2025-09-30T14:52:49.909194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 970 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:49.909249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 970 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:49.909260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=970 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:49.909265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:49.909727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 970 sessionId:  describe result for acl check
2025-09-30T14:52:49.909765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:49.909772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:49.909773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:49.909780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895314557200051:8119] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:49.910324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895314557200051:8119] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:49.913426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895314557200051:8119] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:49.916732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895314557200051:8119] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:49.916749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895314557200051:8119] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:49.916753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895314557200051:8119] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:49.916761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 970 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:49.924576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:49.925138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:49.925336Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:49.925347Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:49.925357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:49.925410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:49.925728Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895314467454185:6576]
2025-09-30T14:52:49.926392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:49.926714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:49.926759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:49.927069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:49.927126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:49.927132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:49.927133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:49.927134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:49.927135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:49.927136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:49.927138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:49.927139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:49.927141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:49.927142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:49.927143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.927144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.927146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.927147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:49.927148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:49.927154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:49.927165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:49.927169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:49.927173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:49.927177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:49.927182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:49.927186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:49.927189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:49.927193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:49.927198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:49.927202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.927205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.927209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.927213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:49.927216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:49.927223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:49.927230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:49.927236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:49.927260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:49.927266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:49.927271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:49.927277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:49.927282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:49.927287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:49.927291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:49.927295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:49.927306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:49.927311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:49.927320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:49.927324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:49.927330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:49.927339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:49.927344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:49.927349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:49.927359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:49.927364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.927371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.927376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.927385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.927390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.927395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.927399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:49.927405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:49.927409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:49.927414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:49.927458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:49.932799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:49.933633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:49.933645Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:49.933647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:49.933650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:49.933655Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 969 [2:7555895314467454185:6576]
2025-09-30T14:52:49.933666Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:49.933677Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:49.933679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:49.933681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:49.933683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:49.933694Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:49.933699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:49.933704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:49.933756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.933765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.933768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.933771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:49.933773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:49.933827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:49.933835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.933843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:49.933849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:49.933858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:49.933870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895314467454180:6576]
2025-09-30T14:52:49.933872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895314467454180:6576]
2025-09-30T14:52:49.933874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895314467454180:6576]
2025-09-30T14:52:49.933879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:49.933890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:49.933893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:49.933893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895314557200258:8119], now have 1 active actors on pipe
2025-09-30T14:52:49.933895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:49.933899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:49.933911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:49.933915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:49.933921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895314557199898:2454], now have 1 active actors on pipe
2025-09-30T14:52:49.933946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895314467454180:6576]
2025-09-30T14:52:49.933964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:49.933990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:49.933962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 969
2025-09-30T14:52:49.934075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 969
2025-09-30T14:52:49.934100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:49.934110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:49.934132Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60ed616e-ca790030-2ceb94d4-2dea8d06_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:49.934144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:49.934148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:49.934150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:49.934159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:49.934175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:49.934192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:49.934356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:49.934365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:49.934375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:49.934454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 970 partition: 0 MaxSeqNo: 42 sessionId: src_id|60ed616e-ca790030-2ceb94d4-2dea8d06_0
2025-09-30T14:52:49.934770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bd551f4-79383b5f-a7df20ec-3ffc1b56_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|60ed616e-ca790030-2ceb94d4-2dea8d06_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:49.937430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60ed616e-ca790030-2ceb94d4-2dea8d06_0] Write session: try to update token
2025-09-30T14:52:49.937442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60ed616e-ca790030-2ceb94d4-2dea8d06_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:49.945764Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:49.945784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:49.945794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895314467454180:6576]
2025-09-30T14:52:49.945841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:49.945844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:49.946015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:49.946165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:49.946324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:49.946474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:49.946672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:49.946715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:49.951520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 970 sessionId: src_id|60ed616e-ca790030-2ceb94d4-2dea8d06_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:49.954439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:49.954625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:49.954647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:49.954693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:49.954767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:49.956210Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:49.956224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:49.956226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:49.956228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:49.956237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895314467454180:6576]
2025-09-30T14:52:49.956242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895314467454180:6576]
2025-09-30T14:52:49.956245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895314467454180:6576]
2025-09-30T14:52:49.956278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:49.956283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:49.956285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:49.956288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:49.956290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:49.956295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:49.956420Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:49.997525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895314557200335:7731]
2025-09-30T14:52:49.997810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 969, pipe: [1:7555895314557200335:7731]
2025-09-30T14:52:50.067542Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:50.075655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:50.075686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:50.075834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:50.075892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:50.075965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:50.076029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:50.076073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:50.076080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:50.076143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:50.076214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:50.076282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:50.076351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:50.076398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:50.076406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:50.076471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:50.076529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:50.076598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:50.076664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:50.076713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:50.076721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:50.076793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:50.076857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:50.076919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:50.076986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:50.077034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:50.077041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:50.077106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:50.077168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:50.077240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:50.077308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:50.077354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:50.077363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:50.077434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:50.077499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:50.077564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:50.077626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:50.077670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:50.077678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:50.077744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:50.077804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:50.077874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:50.077931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:50.077973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:50.077983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:50.078047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:50.078101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:50.078156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:50.078228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:50.078269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:50.078280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:50.078346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:50.078405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:50.078463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:50.078520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:50.078567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:50.078575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:50.078642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:50.078700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:50.078770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:50.078837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:50.078882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:50.078891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:50.078946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895314557200335:7731], now have 1 active actors on pipe
2025-09-30T14:52:50.079189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:50.079285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:50.079293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:50.079321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 970 reason: error at write: Disconnected sessionId: src_id|60ed616e-ca790030-2ceb94d4-2dea8d06_0
2025-09-30T14:52:50.079507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895314557200335:7731]
2025-09-30T14:52:50.079544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 970 sessionId: src_id|60ed616e-ca790030-2ceb94d4-2dea8d06_0 is DEAD
2025-09-30T14:52:50.079646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60ed616e-ca790030-2ceb94d4-2dea8d06_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:50.079654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60ed616e-ca790030-2ceb94d4-2dea8d06_0] Write session will restart in 0.009201s
2025-09-30T14:52:50.079671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60ed616e-ca790030-2ceb94d4-2dea8d06_0] Write session: Do CDS request
2025-09-30T14:52:50.079675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60ed616e-ca790030-2ceb94d4-2dea8d06_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:50.080248Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:50.089759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60ed616e-ca790030-2ceb94d4-2dea8d06_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:50.089906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:50.089927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 971
2025-09-30T14:52:50.090077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 971 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:50.090112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 971 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:50.090122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=971 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:50.090126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:50.090568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 971 sessionId:  describe result for acl check
2025-09-30T14:52:50.090618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:50.090627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:50.090629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:50.090635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895318852167778:8126] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:50.091200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895318852167778:8126] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:50.093496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895318852167778:8126] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:50.096023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895318852167778:8126] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:50.096039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895318852167778:8126] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:50.096042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895318852167778:8126] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:50.096049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 971 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:50.102473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:50.105796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:50.106003Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:50.106017Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:50.106028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:50.106087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:50.106127Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895318762421796:6579]
2025-09-30T14:52:50.106786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:50.107139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:50.107200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:50.107559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:50.107637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:50.107644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:50.107645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:50.107647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:50.107648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:50.107649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:50.107651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:50.107652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:50.107653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:50.107654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:50.107655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.107657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.107658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.107659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:50.107660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:50.107666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:50.107688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:50.107692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:50.107697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:50.107701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:50.107704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:50.107708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:50.107711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:50.107715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:50.107719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:50.107722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.107726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.107730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.107734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:50.107738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:50.107748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:50.107757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:50.107765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:50.107771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:50.107776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:50.107781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:50.107786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:50.107792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:50.107803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:50.107808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:50.107813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:50.107818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:50.107824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:50.107831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:50.107836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:50.107843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:50.107848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:50.107858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:50.107867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:50.107882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:50.107891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.107896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.107905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.107910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.107919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.107925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.107933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:50.107940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:50.107949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:50.107954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:50.108006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:50.113525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:50.114344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:50.114361Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:50.114364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:50.114369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:50.114375Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 970 [2:7555895318762421796:6579]
2025-09-30T14:52:50.114390Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:50.114407Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:50.114413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:50.114416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:50.114417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:50.114429Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:50.114438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:50.114443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:50.114496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.114504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.114506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.114510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:50.114512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:50.114578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:50.114586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.114598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.114615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.114630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:50.114651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895318852167976:8126], now have 1 active actors on pipe
2025-09-30T14:52:50.114662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895318852167640:2454], now have 1 active actors on pipe
2025-09-30T14:52:50.114668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895318762421791:6579]
2025-09-30T14:52:50.114670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895318762421791:6579]
2025-09-30T14:52:50.114672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895318762421791:6579]
2025-09-30T14:52:50.114687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:50.114699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:50.114708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:50.114712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:50.114714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:50.114714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:50.114717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:50.114752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895318762421791:6579]
2025-09-30T14:52:50.114765Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:50.114755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 970
2025-09-30T14:52:50.114764Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 970
2025-09-30T14:52:50.114790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:50.114802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:50.114807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:50.114833Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba348ac5-7353b679-592395a5-76ec9b9f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:50.114839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:50.114842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:50.114845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:50.114853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:50.114869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:50.114887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:50.115035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:50.115040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:50.115050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:50.115221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 971 partition: 0 MaxSeqNo: 42 sessionId: src_id|ba348ac5-7353b679-592395a5-76ec9b9f_0
2025-09-30T14:52:50.115595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60ed616e-ca790030-2ceb94d4-2dea8d06_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ba348ac5-7353b679-592395a5-76ec9b9f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:50.118465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba348ac5-7353b679-592395a5-76ec9b9f_0] Write session: try to update token
2025-09-30T14:52:50.118483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba348ac5-7353b679-592395a5-76ec9b9f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:50.126948Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:50.126971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:50.126981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895318762421791:6579]
2025-09-30T14:52:50.127030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:50.127028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:50.127200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:50.127356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:50.127491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:50.127627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:50.127812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:50.127851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:50.133149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 971 sessionId: src_id|ba348ac5-7353b679-592395a5-76ec9b9f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:50.135736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:50.135959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:50.135981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:50.136015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:50.136107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:50.137706Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:50.137723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:50.137726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:50.137728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:50.137737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895318762421791:6579]
2025-09-30T14:52:50.137741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895318762421791:6579]
2025-09-30T14:52:50.137745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895318762421791:6579]
2025-09-30T14:52:50.137781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:50.137784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:50.137790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:50.137792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.137793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:50.137795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:50.137924Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:50.179793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895318852168091:7731]
2025-09-30T14:52:50.180496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 970, pipe: [1:7555895318852168091:7731]
2025-09-30T14:52:50.255970Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:50.264740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:50.264769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:50.264942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:50.265012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:50.265075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:50.265142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:50.265188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:50.265201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:50.265272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:50.265335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:50.265399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:50.265469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:50.265517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:50.265525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:50.265593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:50.265659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:50.265722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:50.265790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:50.265840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:50.265848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:50.265916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:50.265979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:50.266043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:50.266110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:50.266154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:50.266161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:50.266242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:50.266306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:50.266370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:50.266434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:50.266552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:50.266562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:50.266628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:50.266689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:50.266757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:50.266824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:50.266871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:50.266881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:50.266949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:50.267012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:50.267082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:50.267149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:50.267199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:50.267206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:50.267290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:50.267352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:50.267417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:50.267482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:50.267524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:50.267532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:50.267602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:50.267664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:50.267729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:50.267801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:50.267846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:50.267854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:50.267919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:50.267976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:50.268039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:50.268101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:50.268146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:50.268154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:50.268212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895318852168091:7731], now have 1 active actors on pipe
2025-09-30T14:52:50.268493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:50.268509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:50.268508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895318852168091:7731]
2025-09-30T14:52:50.268535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:50.268539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 971 reason: error at write: Disconnected sessionId: src_id|ba348ac5-7353b679-592395a5-76ec9b9f_0
2025-09-30T14:52:50.268722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 971 sessionId: src_id|ba348ac5-7353b679-592395a5-76ec9b9f_0 is DEAD
2025-09-30T14:52:50.268886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba348ac5-7353b679-592395a5-76ec9b9f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:50.268897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba348ac5-7353b679-592395a5-76ec9b9f_0] Write session will restart in 0.006716s
2025-09-30T14:52:50.268921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba348ac5-7353b679-592395a5-76ec9b9f_0] Write session: Do CDS request
2025-09-30T14:52:50.268927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba348ac5-7353b679-592395a5-76ec9b9f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:50.269470Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:50.276754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba348ac5-7353b679-592395a5-76ec9b9f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:50.276827Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:50.276844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 972
2025-09-30T14:52:50.276997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 972 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:50.277040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 972 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:50.277049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=972 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:50.277054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:50.277488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 972 sessionId:  describe result for acl check
2025-09-30T14:52:50.277525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:50.277533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:50.277535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:50.277541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895318852168128:8130] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:50.278066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895318852168128:8130] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:50.281333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895318852168128:8130] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:50.283924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895318852168128:8130] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:50.283940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895318852168128:8130] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:50.283943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895318852168128:8130] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:50.283952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 972 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:50.293209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:50.297195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:50.297432Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:50.297442Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:50.297453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:50.297501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:50.297543Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895318762422098:6582]
2025-09-30T14:52:50.298248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:50.298575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:50.298611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:50.298941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:50.298996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:50.299003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:50.299004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:50.299005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:50.299006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:50.299008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:50.299009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:50.299010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:50.299012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:50.299013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:50.299014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.299016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.299017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.299018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:50.299019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:50.299025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:50.299036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:50.299041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:50.299046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:50.299050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:50.299055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:50.299059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:50.299064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:50.299069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:50.299074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:50.299078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.299083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.299087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.299092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:50.299096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:50.299104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:50.299117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:50.299123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:50.299134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:50.299140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:50.299150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:50.299156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:50.299162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:50.299167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:50.299173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:50.299178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:50.299184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:50.299194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:50.299201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:50.299206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:50.299212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:50.299218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:50.299224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:50.299234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:50.299240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:50.299259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.299266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.299275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.299281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.299290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.299296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.299305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:50.299310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:50.299316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:50.299323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:50.299373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:50.305103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:50.306408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:50.306425Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:50.306427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:50.306431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:50.306438Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 971 [2:7555895318762422098:6582]
2025-09-30T14:52:50.306453Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:50.306470Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:50.306473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:50.306476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:50.306479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:50.306495Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:50.306507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:50.306515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:50.306572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.306584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.306586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.306591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:50.306593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:50.306656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:50.306664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.306678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.306697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.306723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:50.306746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895318852168093:2454], now have 1 active actors on pipe
2025-09-30T14:52:50.306750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895318852168342:8130], now have 1 active actors on pipe
2025-09-30T14:52:50.306756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895318762422093:6582]
2025-09-30T14:52:50.306759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895318762422093:6582]
2025-09-30T14:52:50.306761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895318762422093:6582]
2025-09-30T14:52:50.306777Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:50.306790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:50.306808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:50.306813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:50.306815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:50.306816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:50.306819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:50.306853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895318762422093:6582]
2025-09-30T14:52:50.306862Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:50.306864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:50.306823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 971
2025-09-30T14:52:50.306892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:50.306831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 971
2025-09-30T14:52:50.306902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:50.306933Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf6e8fdc-eb76cf53-6a4a706a-64524ff4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:50.306943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:50.306947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:50.306949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:50.306959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:50.306972Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:50.306998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:50.307147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:50.307155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:50.307169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:50.307263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 972 partition: 0 MaxSeqNo: 42 sessionId: src_id|bf6e8fdc-eb76cf53-6a4a706a-64524ff4_0
2025-09-30T14:52:50.307608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba348ac5-7353b679-592395a5-76ec9b9f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bf6e8fdc-eb76cf53-6a4a706a-64524ff4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:50.310359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf6e8fdc-eb76cf53-6a4a706a-64524ff4_0] Write session: try to update token
2025-09-30T14:52:50.310377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf6e8fdc-eb76cf53-6a4a706a-64524ff4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:50.318937Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:50.318960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:50.318963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:50.318965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:50.318977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895318762422093:6582]
2025-09-30T14:52:50.318981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895318762422093:6582]
2025-09-30T14:52:50.318984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895318762422093:6582]
2025-09-30T14:52:50.319024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:50.319032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.319034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:50.319034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:50.319040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:50.319044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:50.319183Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:50.324427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 972 sessionId: src_id|bf6e8fdc-eb76cf53-6a4a706a-64524ff4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:50.327018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:50.368703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895318852168531:7731]
2025-09-30T14:52:50.368955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 971, pipe: [1:7555895318852168531:7731]
2025-09-30T14:52:50.434686Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:50.435359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:50.435373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:50.435405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895318852168531:7731], now have 1 active actors on pipe
2025-09-30T14:52:50.435613Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:50.435641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:50.435649Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:50.435662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:50.435692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895318852168531:7731]
2025-09-30T14:52:50.435715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 972 reason: error at write: Disconnected sessionId: src_id|bf6e8fdc-eb76cf53-6a4a706a-64524ff4_0
2025-09-30T14:52:50.435873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 972 sessionId: src_id|bf6e8fdc-eb76cf53-6a4a706a-64524ff4_0 is DEAD
2025-09-30T14:52:50.436023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf6e8fdc-eb76cf53-6a4a706a-64524ff4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:50.436035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf6e8fdc-eb76cf53-6a4a706a-64524ff4_0] Write session will restart in 0.009914s
2025-09-30T14:52:50.436059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf6e8fdc-eb76cf53-6a4a706a-64524ff4_0] Write session: Do CDS request
2025-09-30T14:52:50.436065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf6e8fdc-eb76cf53-6a4a706a-64524ff4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:50.446760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf6e8fdc-eb76cf53-6a4a706a-64524ff4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:50.446854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:50.446882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 973
2025-09-30T14:52:50.447044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 973 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:50.447091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 973 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:50.447101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=973 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:50.447108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:50.447570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 973 sessionId:  describe result for acl check
2025-09-30T14:52:50.447608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:50.447615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:50.447617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:50.447623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895318852168671:8134] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:50.448142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895318852168671:8134] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:50.450160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895318852168671:8134] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:50.453695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895318852168671:8134] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:50.453711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895318852168671:8134] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:50.453714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895318852168671:8134] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:50.453721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 973 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:50.458478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:50.461879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:50.462107Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:50.462120Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:50.462133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:50.462233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:50.462289Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895318762422401:6584]
2025-09-30T14:52:50.462913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:50.463259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:50.463294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:50.463564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:50.463642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:50.463649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:50.463650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:50.463651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:50.463652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:50.463653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:50.463654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:50.463656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:50.463657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:50.463658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:50.463659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.463661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.463662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.463663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:50.463664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:50.463671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:50.463682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:50.463686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:50.463690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:50.463694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:50.463698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:50.463702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:50.463706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:50.463710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:50.463714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:50.463718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.463721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.463726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.463730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:50.463735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:50.463743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:50.463749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:50.463753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:50.463757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:50.463760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:50.463763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:50.463766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:50.463769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:50.463772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:50.463775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:50.463778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:50.463781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:50.463783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:50.463786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:50.463789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:50.463792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:50.463795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:50.463798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:50.463801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:50.463804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:50.463806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.463809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.463812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.463815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.463818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.463821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.463824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:50.463828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:50.463831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:50.463836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:50.463879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:50.469479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:50.470424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:50.470440Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:50.470442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:50.470446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:50.470451Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 972 [2:7555895318762422401:6584]
2025-09-30T14:52:50.470464Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:50.470476Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:50.470478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:50.470481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:50.470482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:50.470497Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:50.470504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:50.470512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:50.470566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.470573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.470575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.470578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:50.470580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:50.470754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:50.470764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.470777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.470784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.470795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:50.470809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895318852168881:8134], now have 1 active actors on pipe
2025-09-30T14:52:50.470811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895318852168532:2454], now have 1 active actors on pipe
2025-09-30T14:52:50.470816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895318762422396:6584]
2025-09-30T14:52:50.470818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895318762422396:6584]
2025-09-30T14:52:50.470819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895318762422396:6584]
2025-09-30T14:52:50.470830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:50.470841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:50.470852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:50.470855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:50.470855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:50.470857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:50.470858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:50.470836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 972
2025-09-30T14:52:50.470841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 972
2025-09-30T14:52:50.470894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895318762422396:6584]
2025-09-30T14:52:50.470902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:50.470904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:50.470931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:50.470941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:50.470972Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6842120-794a5629-686273a3-af0bb119_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:50.470984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:50.470987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:50.470990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:50.470999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:50.471014Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:50.471038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:50.471221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:50.471235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:50.471278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:50.471384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 973 partition: 0 MaxSeqNo: 42 sessionId: src_id|d6842120-794a5629-686273a3-af0bb119_0
2025-09-30T14:52:50.471768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf6e8fdc-eb76cf53-6a4a706a-64524ff4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d6842120-794a5629-686273a3-af0bb119_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:50.474505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6842120-794a5629-686273a3-af0bb119_0] Write session: try to update token
2025-09-30T14:52:50.474527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6842120-794a5629-686273a3-af0bb119_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:50.483209Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:50.483237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:50.483240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:50.483260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:50.483269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895318762422396:6584]
2025-09-30T14:52:50.483273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895318762422396:6584]
2025-09-30T14:52:50.483277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895318762422396:6584]
2025-09-30T14:52:50.483320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:50.483327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.483328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:50.483330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:50.483335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:50.483339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:50.483497Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:50.489151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 973 sessionId: src_id|d6842120-794a5629-686273a3-af0bb119_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:50.491855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:50.536145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895318852168985:7731]
2025-09-30T14:52:50.536497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 972, pipe: [1:7555895318852168985:7731]
2025-09-30T14:52:50.596388Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:50.596810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:50.596827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:50.596860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895318852168985:7731], now have 1 active actors on pipe
2025-09-30T14:52:50.596997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895318852168985:7731]
2025-09-30T14:52:50.597021Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:50.597030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:50.597033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:50.597081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 973 reason: error at write: Disconnected sessionId: src_id|d6842120-794a5629-686273a3-af0bb119_0
2025-09-30T14:52:50.597092Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:50.597269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 973 sessionId: src_id|d6842120-794a5629-686273a3-af0bb119_0 is DEAD
2025-09-30T14:52:50.597401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6842120-794a5629-686273a3-af0bb119_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:50.597412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6842120-794a5629-686273a3-af0bb119_0] Write session will restart in 0.007981s
2025-09-30T14:52:50.597434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6842120-794a5629-686273a3-af0bb119_0] Write session: Do CDS request
2025-09-30T14:52:50.597443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6842120-794a5629-686273a3-af0bb119_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:50.606750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6842120-794a5629-686273a3-af0bb119_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:50.606864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:50.606884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 974
2025-09-30T14:52:50.606994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 974 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:50.607024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 974 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:50.607038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=974 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:50.607046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:50.607550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 974 sessionId:  describe result for acl check
2025-09-30T14:52:50.607590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:50.607594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:50.607595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:50.607601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895318852169071:8146] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:50.608140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895318852169071:8146] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:50.610366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895318852169071:8146] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:50.613784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895318852169071:8146] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:50.613798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895318852169071:8146] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:50.613801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895318852169071:8146] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:50.613809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 974 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:50.625459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:50.626159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:50.626380Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:50.626393Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:50.626403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:50.626453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:50.626497Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895318762422742:6599]
2025-09-30T14:52:50.627024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:50.627371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:50.627426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:50.627669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:50.627731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:50.627737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:50.627738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:50.627738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:50.627739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:50.627740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:50.627741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:50.627741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:50.627742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:50.627743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:50.627744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.627745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.627745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.627746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:50.627747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:50.627751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:50.627758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:50.627760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:50.627763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:50.627765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:50.627768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:50.627770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:50.627773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:50.627775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:50.627778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:50.627780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.627782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.627785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.627787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:50.627789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:50.627795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:50.627801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:50.627805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:50.627808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:50.627812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:50.627815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:50.627817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:50.627821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:50.627824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:50.627828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:50.627830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:50.627833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:50.627836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:50.627839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:50.627842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:50.627845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:50.627848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:50.627851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:50.627854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:50.627857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:50.627860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.627863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.627866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.627870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.627872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.627875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.627878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:50.627882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:50.627885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:50.627888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:50.627924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:50.633406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:50.634817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:50.634839Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:50.634842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:50.634847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:50.634853Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 973 [2:7555895318762422742:6599]
2025-09-30T14:52:50.634869Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:50.634885Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:50.634888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:50.634891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:50.634893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:50.634908Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:50.634914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:50.634921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:50.634981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.634992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.634994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.634997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:50.635000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:50.635068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:50.635078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.635092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.635106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.635122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:50.635143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895318852169298:8146], now have 1 active actors on pipe
2025-09-30T14:52:50.635152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895318852169012:2454], now have 1 active actors on pipe
2025-09-30T14:52:50.635160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895318762422737:6599]
2025-09-30T14:52:50.635162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895318762422737:6599]
2025-09-30T14:52:50.635164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895318762422737:6599]
2025-09-30T14:52:50.635176Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:50.635189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:50.635190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:50.635192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:50.635195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:50.635206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:50.635209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:50.635223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 973
2025-09-30T14:52:50.635228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 973
2025-09-30T14:52:50.635264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895318762422737:6599]
2025-09-30T14:52:50.635275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:50.635284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:50.635311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:50.635316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:50.635349Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51e18c98-34882e2d-5ef9b0eb-d2bdfd56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:50.635361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:50.635365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:50.635367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:50.635377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:50.635393Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:50.635406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:50.635540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:50.635549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:50.635562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:50.635667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 974 partition: 0 MaxSeqNo: 42 sessionId: src_id|51e18c98-34882e2d-5ef9b0eb-d2bdfd56_0
2025-09-30T14:52:50.636058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6842120-794a5629-686273a3-af0bb119_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|51e18c98-34882e2d-5ef9b0eb-d2bdfd56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:50.638720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51e18c98-34882e2d-5ef9b0eb-d2bdfd56_0] Write session: try to update token
2025-09-30T14:52:50.638737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51e18c98-34882e2d-5ef9b0eb-d2bdfd56_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:50.647475Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:50.647501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:50.647503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:50.647505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:50.647515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895318762422737:6599]
2025-09-30T14:52:50.647519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895318762422737:6599]
2025-09-30T14:52:50.647523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895318762422737:6599]
2025-09-30T14:52:50.647564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:50.647571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.647574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:50.647574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:50.647581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:50.647584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:50.647735Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:50.653638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 974 sessionId: src_id|51e18c98-34882e2d-5ef9b0eb-d2bdfd56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:50.656325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:50.697456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895318852169449:7731]
2025-09-30T14:52:50.697826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 973, pipe: [1:7555895318852169449:7731]
2025-09-30T14:52:50.759941Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:50.760662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:50.760681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:50.760718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895318852169449:7731], now have 1 active actors on pipe
2025-09-30T14:52:50.760908Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:50.761002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895318852169449:7731]
2025-09-30T14:52:50.761042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:50.761114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 974 reason: status is not ok: tablet will be restarted right now sessionId: src_id|51e18c98-34882e2d-5ef9b0eb-d2bdfd56_0
2025-09-30T14:52:50.761286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 974 sessionId: src_id|51e18c98-34882e2d-5ef9b0eb-d2bdfd56_0 is DEAD
2025-09-30T14:52:50.761295Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:50.761407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51e18c98-34882e2d-5ef9b0eb-d2bdfd56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:50.761419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51e18c98-34882e2d-5ef9b0eb-d2bdfd56_0] Write session will restart in 0.009971s
2025-09-30T14:52:50.761454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51e18c98-34882e2d-5ef9b0eb-d2bdfd56_0] Write session: Do CDS request
2025-09-30T14:52:50.761460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51e18c98-34882e2d-5ef9b0eb-d2bdfd56_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:50.772720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51e18c98-34882e2d-5ef9b0eb-d2bdfd56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:50.772859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:50.772888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 975
2025-09-30T14:52:50.773072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 975 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:50.773117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 975 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:50.773129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=975 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:50.773134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:50.773581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 975 sessionId:  describe result for acl check
2025-09-30T14:52:50.773630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:50.773637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:50.773639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:50.773645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895318852169576:8150] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:50.774214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895318852169576:8150] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:50.776278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895318852169576:8150] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:50.779219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895318852169576:8150] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:50.779236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895318852169576:8150] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:50.779239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895318852169576:8150] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:50.779407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 975 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:50.786462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:50.790007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:50.790674Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:50.790691Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:50.790702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:50.790764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:50.790807Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895318762423055:6601]
2025-09-30T14:52:50.791509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:50.791859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:50.791923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:50.792285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:50.792352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:50.792361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:50.792363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:50.792364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:50.792365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:50.792366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:50.792368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:50.792369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:50.792371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:50.792372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:50.792374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.792375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.792376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.792377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:50.792378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:50.792385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:50.792398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:50.792403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:50.792408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:50.792413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:50.792418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:50.792422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:50.792427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:50.792432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:50.792438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:50.792443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.792447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.792452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.792457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:50.792461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:50.792468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:50.792477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:50.792489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:50.792496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:50.792506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:50.792512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:50.792522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:50.792528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:50.792539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:50.792545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:50.792557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:50.792563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:50.792573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:50.792579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:50.792589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:50.792595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:50.792600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:50.792611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:50.792616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:50.792623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:50.792632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.792639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.792648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.792654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.792660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.792666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.792675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:50.792682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:50.792689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:50.792695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:50.792766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:50.798384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:50.799234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:50.799272Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:50.799275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:50.799280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:50.799287Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 974 [2:7555895318762423055:6601]
2025-09-30T14:52:50.799306Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:50.799321Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:50.799324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:50.799327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:50.799330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:50.799345Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:50.799358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:50.799368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:50.799428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.799435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.799437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.799441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:50.799443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:50.799514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:50.799522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.799536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.799553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.799576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:50.799596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895318852169751:8150], now have 1 active actors on pipe
2025-09-30T14:52:50.799606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895318852169450:2454], now have 1 active actors on pipe
2025-09-30T14:52:50.799612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895318762423046:6601]
2025-09-30T14:52:50.799614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895318762423046:6601]
2025-09-30T14:52:50.799616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895318762423046:6601]
2025-09-30T14:52:50.799627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:50.799641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:50.799643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:50.799646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:50.799648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:50.799664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:50.799667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:50.799705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895318762423046:6601]
2025-09-30T14:52:50.799687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 974
2025-09-30T14:52:50.799708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:50.799722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:50.799713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 974
2025-09-30T14:52:50.799727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:50.799728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:50.800425Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb849304-c5a79750-6cefea04-9804a6ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:50.800443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:50.800447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:50.800450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:50.800461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:50.800471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:50.800493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:50.800658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:50.800668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:50.800680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:50.800751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 975 partition: 0 MaxSeqNo: 42 sessionId: src_id|fb849304-c5a79750-6cefea04-9804a6ed_0
2025-09-30T14:52:50.801092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51e18c98-34882e2d-5ef9b0eb-d2bdfd56_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fb849304-c5a79750-6cefea04-9804a6ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:50.803772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb849304-c5a79750-6cefea04-9804a6ed_0] Write session: try to update token
2025-09-30T14:52:50.803788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb849304-c5a79750-6cefea04-9804a6ed_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:50.812154Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:50.812174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:50.812176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:50.812178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:50.812187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895318762423046:6601]
2025-09-30T14:52:50.812192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895318762423046:6601]
2025-09-30T14:52:50.812196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895318762423046:6601]
2025-09-30T14:52:50.812235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:50.812242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.812245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:50.812256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:50.812262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:50.812266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:50.812384Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:50.818348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 975 sessionId: src_id|fb849304-c5a79750-6cefea04-9804a6ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:50.821266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:50.861229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895318852169894:7731]
2025-09-30T14:52:50.861503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 974, pipe: [1:7555895318852169894:7731]
2025-09-30T14:52:50.925677Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:50.925980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:50.925998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:50.926037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895318852169894:7731], now have 1 active actors on pipe
2025-09-30T14:52:50.926304Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:50.926324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895318852169894:7731]
2025-09-30T14:52:50.926341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:50.926345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:50.926372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:50.926423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 975 reason: error at write: Disconnected sessionId: src_id|fb849304-c5a79750-6cefea04-9804a6ed_0
2025-09-30T14:52:50.926607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 975 sessionId: src_id|fb849304-c5a79750-6cefea04-9804a6ed_0 is DEAD
2025-09-30T14:52:50.926788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb849304-c5a79750-6cefea04-9804a6ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:50.926797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb849304-c5a79750-6cefea04-9804a6ed_0] Write session will restart in 0.007512s
2025-09-30T14:52:50.926829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb849304-c5a79750-6cefea04-9804a6ed_0] Write session: Do CDS request
2025-09-30T14:52:50.926838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb849304-c5a79750-6cefea04-9804a6ed_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:50.934174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:50.935733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb849304-c5a79750-6cefea04-9804a6ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:50.935774Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:50.935794Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 976
2025-09-30T14:52:50.935865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:50.935960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 976 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:50.935999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 976 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:50.936009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=976 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:50.936013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:50.936092Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:50.936105Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:50.936118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:50.936179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:50.936219Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895318762423112:6603]
2025-09-30T14:52:50.936444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 976 sessionId:  describe result for acl check
2025-09-30T14:52:50.936479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:50.936486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:50.936488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:50.936493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895318852169916:8154] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:50.936914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:50.937010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895318852169916:8154] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:50.937230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:50.937290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:50.937637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:50.937714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:50.937722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:50.937723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:50.937725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:50.937726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:50.937728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:50.937729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:50.937731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:50.937732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:50.937733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:50.937733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.937734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.937735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.937737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:50.937738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:50.937742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:50.937748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:50.937750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:50.937753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:50.937756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:50.937760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:50.937764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:50.937767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:50.937771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:50.937775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:50.937779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.937782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.937785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.937789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:50.937792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:50.937800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:50.937808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:50.937814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:50.937819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:50.937825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:50.937829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:50.937831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:50.937834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:50.937838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:50.937841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:50.937843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:50.937846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:50.937848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:50.937851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:50.937855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:50.937860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:50.937867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:50.937871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:50.937876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:50.937881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:50.937887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.937892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.937897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.937902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.937906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.937912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.937916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:50.937921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:50.937925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:50.937931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:50.937973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:50.938870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895318852169916:8154] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:50.943023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895318852169916:8154] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:50.943042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895318852169916:8154] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:50.943046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895318852169916:8154] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:50.943054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 976 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:50.943484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:50.944454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:50.944474Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:50.944477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:50.944481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:50.944488Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 975 [2:7555895318762423112:6603]
2025-09-30T14:52:50.944505Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:50.944520Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:50.944523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:50.944526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:50.944528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:50.944545Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:50.944557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:50.944570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:50.944641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.944651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.944653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.944656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:50.944659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:50.944719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:50.944727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.944739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:50.944753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:50.944773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:50.944796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895318852169896:2454], now have 1 active actors on pipe
2025-09-30T14:52:50.944804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895318852169956:8154], now have 1 active actors on pipe
2025-09-30T14:52:50.944811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895318762423106:6603]
2025-09-30T14:52:50.944818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895318762423106:6603]
2025-09-30T14:52:50.944820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895318762423106:6603]
2025-09-30T14:52:50.944833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:50.944847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:50.944841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 975
2025-09-30T14:52:50.944850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:50.944857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:50.944849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 975
2025-09-30T14:52:50.944859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:50.944865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:50.944868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:50.944899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895318762423106:6603]
2025-09-30T14:52:50.944907Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:50.944911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:50.944922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:50.944931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:50.944980Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5da97c5-6f9d13ee-934350bc-f005a2f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:50.944991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:50.944998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:50.945000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:50.945009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:50.945018Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:50.945038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:50.945200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:50.945210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:50.945222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:50.945316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 976 partition: 0 MaxSeqNo: 42 sessionId: src_id|5da97c5-6f9d13ee-934350bc-f005a2f4_0
2025-09-30T14:52:50.945687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb849304-c5a79750-6cefea04-9804a6ed_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5da97c5-6f9d13ee-934350bc-f005a2f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:50.948529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5da97c5-6f9d13ee-934350bc-f005a2f4_0] Write session: try to update token
2025-09-30T14:52:50.948551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5da97c5-6f9d13ee-934350bc-f005a2f4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:50.957106Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:50.957128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:50.957131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:50.957133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:50.957142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895318762423106:6603]
2025-09-30T14:52:50.957149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895318762423106:6603]
2025-09-30T14:52:50.957153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895318762423106:6603]
2025-09-30T14:52:50.957197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:50.957202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:50.957204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:50.957206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:50.957209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:50.957215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:50.957353Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:50.963414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 976 sessionId: src_id|5da97c5-6f9d13ee-934350bc-f005a2f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:50.966041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:51.026649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895323147137271:7731]
2025-09-30T14:52:51.026980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 975, pipe: [1:7555895323147137271:7731]
2025-09-30T14:52:51.080573Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:51.081149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:51.081166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:51.081205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895323147137271:7731], now have 1 active actors on pipe
2025-09-30T14:52:51.081452Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:51.081468Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:51.081511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895323147137271:7731]
2025-09-30T14:52:51.081540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:51.081634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 976 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5da97c5-6f9d13ee-934350bc-f005a2f4_0
2025-09-30T14:52:51.081833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 976 sessionId: src_id|5da97c5-6f9d13ee-934350bc-f005a2f4_0 is DEAD
2025-09-30T14:52:51.081988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5da97c5-6f9d13ee-934350bc-f005a2f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:51.082009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5da97c5-6f9d13ee-934350bc-f005a2f4_0] Write session will restart in 0.008128s
2025-09-30T14:52:51.082034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5da97c5-6f9d13ee-934350bc-f005a2f4_0] Write session: Do CDS request
2025-09-30T14:52:51.082039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5da97c5-6f9d13ee-934350bc-f005a2f4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:51.089142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:51.090787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:51.090981Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:51.090991Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:51.091001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:51.091066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:51.091111Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895323057390476:6606]
2025-09-30T14:52:51.091770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5da97c5-6f9d13ee-934350bc-f005a2f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:51.091779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:51.091824Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:51.091844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 977
2025-09-30T14:52:51.092020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 977 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:51.092061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 977 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:51.092067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=977 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:51.092071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:51.092140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:51.092214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:51.092538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:51.092548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 977 sessionId:  describe result for acl check
2025-09-30T14:52:51.092582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:51.092589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:51.092592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:51.092599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895323147137310:8161] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:51.092626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:51.092634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:51.092637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:51.092638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:51.092639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:51.092641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:51.092642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:51.092644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:51.092645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:51.092647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:51.092648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.092649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.092651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.092652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:51.092653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:51.092659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:51.092669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:51.092672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:51.092677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:51.092681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:51.092684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:51.092688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:51.092692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:51.092695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:51.092700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:51.092704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.092707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.092711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.092715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:51.092718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:51.092729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:51.092736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:51.092742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:51.092749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:51.092753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:51.092759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:51.092763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:51.092769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:51.092774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:51.092780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:51.092791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:51.092796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:51.092801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:51.092811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:51.092814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:51.092820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:51.092825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:51.092830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:51.092834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:51.092840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:51.092844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.092850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.092859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.092864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.092868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.092873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.092882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:51.092887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:51.092892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:51.092901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:51.092945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:51.093143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895323147137310:8161] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:51.095017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895323147137310:8161] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:51.098334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895323147137310:8161] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:51.098356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895323147137310:8161] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:51.098363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895323147137310:8161] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:51.098372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 977 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:51.098752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:51.099636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:51.099653Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:51.099656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:51.099660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:51.099667Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 976 [2:7555895323057390476:6606]
2025-09-30T14:52:51.099683Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:51.099705Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:51.099713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:51.099716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:51.099718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:51.099732Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:51.099739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:51.099747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:51.099802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.099809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.099811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.099814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:51.099817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:51.099878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:51.099886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.099898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.099914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.099930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:51.099948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895323147137276:2454], now have 1 active actors on pipe
2025-09-30T14:52:51.099952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895323147137347:8161], now have 1 active actors on pipe
2025-09-30T14:52:51.099958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895323057390471:6606]
2025-09-30T14:52:51.099960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895323057390471:6606]
2025-09-30T14:52:51.099962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895323057390471:6606]
2025-09-30T14:52:51.099975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:51.099990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:51.100008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:51.100015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:51.100017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:51.100021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:51.100024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:51.100046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895323057390471:6606]
2025-09-30T14:52:51.100053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:51.100059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:51.100030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 976
2025-09-30T14:52:51.100032Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 976
2025-09-30T14:52:51.100086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:51.100094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:51.100120Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5bf6821-95dc2a3-6125fb03-906a83f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:51.100130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:51.100133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:51.100135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:51.100144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:51.100157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:51.100168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:51.100295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:51.100302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:51.100313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:51.100404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 977 partition: 0 MaxSeqNo: 42 sessionId: src_id|f5bf6821-95dc2a3-6125fb03-906a83f4_0
2025-09-30T14:52:51.100782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5da97c5-6f9d13ee-934350bc-f005a2f4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f5bf6821-95dc2a3-6125fb03-906a83f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:51.103544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5bf6821-95dc2a3-6125fb03-906a83f4_0] Write session: try to update token
2025-09-30T14:52:51.103564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5bf6821-95dc2a3-6125fb03-906a83f4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:51.112127Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:51.112150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:51.112153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:51.112155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:51.112172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895323057390471:6606]
2025-09-30T14:52:51.112177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895323057390471:6606]
2025-09-30T14:52:51.112181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895323057390471:6606]
2025-09-30T14:52:51.112219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:51.112227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.112232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:51.112234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:51.112238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:51.112243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:51.112367Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:51.118831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 977 sessionId: src_id|f5bf6821-95dc2a3-6125fb03-906a83f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:51.122070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:51.181775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895323147137356:7731]
2025-09-30T14:52:51.182072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 976, pipe: [1:7555895323147137356:7731]
2025-09-30T14:52:51.226390Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:51.226708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:51.226724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:51.226745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895323147137356:7731], now have 1 active actors on pipe
2025-09-30T14:52:51.226968Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:51.226988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:51.227007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:51.227009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:51.227061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895323147137356:7731]
2025-09-30T14:52:51.227070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 977 reason: error at write: Disconnected sessionId: src_id|f5bf6821-95dc2a3-6125fb03-906a83f4_0
2025-09-30T14:52:51.227240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 977 sessionId: src_id|f5bf6821-95dc2a3-6125fb03-906a83f4_0 is DEAD
2025-09-30T14:52:51.227380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5bf6821-95dc2a3-6125fb03-906a83f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:51.227389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5bf6821-95dc2a3-6125fb03-906a83f4_0] Write session will restart in 0.006030s
2025-09-30T14:52:51.227410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5bf6821-95dc2a3-6125fb03-906a83f4_0] Write session: Do CDS request
2025-09-30T14:52:51.227416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5bf6821-95dc2a3-6125fb03-906a83f4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:51.234317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:51.234786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5bf6821-95dc2a3-6125fb03-906a83f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:51.234837Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:51.234854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 978
2025-09-30T14:52:51.235021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 978 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:51.235055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 978 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:51.235066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=978 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:51.235069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:51.235504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 978 sessionId:  describe result for acl check
2025-09-30T14:52:51.235542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:51.235548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:51.235550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:51.235556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895323147137378:8165] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:51.235795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:51.235960Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:51.235969Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:51.235978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:51.236017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:51.236044Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895323057390536:6609]
2025-09-30T14:52:51.236079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895323147137378:8165] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:51.236591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:51.237032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:51.237097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:51.237423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:51.237497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:51.237506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:51.237507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:51.237508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:51.237510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:51.237511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:51.237512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:51.237513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:51.237514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:51.237516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:51.237517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.237518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.237519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.237523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:51.237524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:51.237531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:51.237541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:51.237545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:51.237549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:51.237553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:51.237557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:51.237560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:51.237563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:51.237567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:51.237570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:51.237575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.237578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.237582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.237585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:51.237588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:51.237595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:51.237603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:51.237609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:51.237615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:51.237619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:51.237626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:51.237631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:51.237636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:51.237641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:51.237646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:51.237650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:51.237654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:51.237660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:51.237665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:51.237671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:51.237676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:51.237680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:51.237685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:51.237690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:51.237695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:51.237700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.237705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.237709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.237714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.237718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.237723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.237729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:51.237734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:51.237740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:51.237750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:51.237794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:51.237821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895323147137378:8165] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:51.243684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895323147137378:8165] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:51.243705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895323147137378:8165] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:51.243708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895323147137378:8165] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:51.243717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 978 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:51.243962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:51.244833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:51.244851Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:51.244854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:51.244859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:51.244866Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 977 [2:7555895323057390536:6609]
2025-09-30T14:52:51.244883Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:51.244898Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:51.244906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:51.244909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:51.244912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:51.244927Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:51.244934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:51.244947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:51.245007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.245015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.245018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.245021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:51.245024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:51.245085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:51.245094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.245109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.245126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.245146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:51.245168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895323147137417:8165], now have 1 active actors on pipe
2025-09-30T14:52:51.245176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895323147137357:2454], now have 1 active actors on pipe
2025-09-30T14:52:51.245182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895323057390531:6609]
2025-09-30T14:52:51.245184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895323057390531:6609]
2025-09-30T14:52:51.245186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895323057390531:6609]
2025-09-30T14:52:51.245199Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:51.245216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:51.245226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:51.245230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:51.245232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:51.245233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:51.245236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:51.245223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 977
2025-09-30T14:52:51.245228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 977
2025-09-30T14:52:51.245272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895323057390531:6609]
2025-09-30T14:52:51.245286Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:51.245294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:51.245406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:51.245420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:51.245444Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a35b299-a7b37381-8efa43c4-8b2b1067_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:51.245457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:51.245462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:51.245464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:51.245473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:51.245481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:51.245494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:51.245771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:51.245781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:51.245793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:51.245897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 978 partition: 0 MaxSeqNo: 42 sessionId: src_id|3a35b299-a7b37381-8efa43c4-8b2b1067_0
2025-09-30T14:52:51.246246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5bf6821-95dc2a3-6125fb03-906a83f4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3a35b299-a7b37381-8efa43c4-8b2b1067_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:51.248959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a35b299-a7b37381-8efa43c4-8b2b1067_0] Write session: try to update token
2025-09-30T14:52:51.248980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a35b299-a7b37381-8efa43c4-8b2b1067_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:51.257487Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:51.257506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:51.257508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:51.257511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:51.257520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895323057390531:6609]
2025-09-30T14:52:51.257525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895323057390531:6609]
2025-09-30T14:52:51.257529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895323057390531:6609]
2025-09-30T14:52:51.257572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:51.257578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.257581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:51.257600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:51.257609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:51.257613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:51.257719Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:51.263540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 978 sessionId: src_id|3a35b299-a7b37381-8efa43c4-8b2b1067_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:51.266318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:51.327170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895323147137425:7731]
2025-09-30T14:52:51.327487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 977, pipe: [1:7555895323147137425:7731]
2025-09-30T14:52:51.375375Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:51.375777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:51.375790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:51.375827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895323147137425:7731], now have 1 active actors on pipe
2025-09-30T14:52:51.376027Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:51.376105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895323147137425:7731]
2025-09-30T14:52:51.376118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:51.376122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:51.376153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:51.376195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 978 reason: error at write: Disconnected sessionId: src_id|3a35b299-a7b37381-8efa43c4-8b2b1067_0
2025-09-30T14:52:51.376356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 978 sessionId: src_id|3a35b299-a7b37381-8efa43c4-8b2b1067_0 is DEAD
2025-09-30T14:52:51.376499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a35b299-a7b37381-8efa43c4-8b2b1067_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:51.376510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a35b299-a7b37381-8efa43c4-8b2b1067_0] Write session will restart in 0.007594s
2025-09-30T14:52:51.376534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a35b299-a7b37381-8efa43c4-8b2b1067_0] Write session: Do CDS request
2025-09-30T14:52:51.376540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a35b299-a7b37381-8efa43c4-8b2b1067_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:51.383228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:51.384779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:51.384973Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:51.384986Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:51.384999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:51.385059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:51.385102Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895323057390595:6611]
2025-09-30T14:52:51.385712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:51.385749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a35b299-a7b37381-8efa43c4-8b2b1067_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:51.385861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:51.385881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 979
2025-09-30T14:52:51.385987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 979 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:51.386015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 979 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:51.386007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:51.386023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=979 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:51.386027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:51.386051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:51.386383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:51.386454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:51.386460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:51.386461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:51.386462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:51.386463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:51.386464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:51.386465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:51.386454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 979 sessionId:  describe result for acl check
2025-09-30T14:52:51.386466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:51.386467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:51.386468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:51.386470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.386471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.386472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.386474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:51.386476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:51.386481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:51.386490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:51.386494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:51.386499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:51.386503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:51.386508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:51.386512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:51.386517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:51.386521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:51.386526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:51.386530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.386534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.386539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.386543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:51.386547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:51.386555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:51.386563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:51.386497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:51.386573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:51.386508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:51.386579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:51.386510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:51.386583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:51.386516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895323147137450:8169] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:51.386589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:51.386593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:51.386600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:51.386604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:51.386610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:51.386614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:51.386620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:51.386625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:51.386630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:51.386639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:51.386644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:51.386650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:51.386661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:51.386665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:51.386672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:51.386677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.386686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.386690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.386695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.386703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.386709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.386716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:51.386721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:51.386725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:51.386730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:51.386775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:51.387064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895323147137450:8169] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:51.388839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895323147137450:8169] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:51.391830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895323147137450:8169] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:51.391844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895323147137450:8169] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:51.391846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895323147137450:8169] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:51.391853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 979 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:51.392207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:51.393046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:51.393061Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:51.393067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:51.393071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:51.393076Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 978 [2:7555895323057390595:6611]
2025-09-30T14:52:51.393087Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:51.393104Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:51.393107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:51.393110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:51.393112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:51.393127Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:51.393137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:51.393144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:51.393198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.393207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.393208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.393211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:51.393214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:51.393270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:51.393279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.393290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.393303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.393320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:51.393342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895323147137487:8169], now have 1 active actors on pipe
2025-09-30T14:52:51.393350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895323147137426:2454], now have 1 active actors on pipe
2025-09-30T14:52:51.393355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895323057390590:6611]
2025-09-30T14:52:51.393357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895323057390590:6611]
2025-09-30T14:52:51.393359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895323057390590:6611]
2025-09-30T14:52:51.393373Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:51.393385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:51.393388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:51.393390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:51.393392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:51.393406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:51.393413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:51.393407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 978
2025-09-30T14:52:51.393409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 978
2025-09-30T14:52:51.393444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895323057390590:6611]
2025-09-30T14:52:51.393453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:51.393455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:51.393468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:51.393474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:51.393519Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9931ee8b-b3ac596d-6956e498-6ae55b81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:51.393531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:51.393535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:51.393538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:51.393548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:51.393561Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:51.393582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:51.393768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:51.393776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:51.393790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:51.393867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 979 partition: 0 MaxSeqNo: 42 sessionId: src_id|9931ee8b-b3ac596d-6956e498-6ae55b81_0
2025-09-30T14:52:51.394157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a35b299-a7b37381-8efa43c4-8b2b1067_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9931ee8b-b3ac596d-6956e498-6ae55b81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:51.396848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9931ee8b-b3ac596d-6956e498-6ae55b81_0] Write session: try to update token
2025-09-30T14:52:51.396867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9931ee8b-b3ac596d-6956e498-6ae55b81_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:51.405663Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:51.405681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:51.405683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:51.405685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:51.405694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895323057390590:6611]
2025-09-30T14:52:51.405698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895323057390590:6611]
2025-09-30T14:52:51.405708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895323057390590:6611]
2025-09-30T14:52:51.405748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:51.405755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.405755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:51.405757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:51.405762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:51.405766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:51.405885Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:51.411235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 979 sessionId: src_id|9931ee8b-b3ac596d-6956e498-6ae55b81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:51.413941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:51.476146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895323147137495:7731]
2025-09-30T14:52:51.476425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 978, pipe: [1:7555895323147137495:7731]
2025-09-30T14:52:51.518095Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:51.518398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:51.518414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:51.518454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895323147137495:7731], now have 1 active actors on pipe
2025-09-30T14:52:51.518685Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:51.518687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:51.518720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895323147137495:7731]
2025-09-30T14:52:51.518741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:51.518746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:51.518804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 979 reason: error at write: Disconnected sessionId: src_id|9931ee8b-b3ac596d-6956e498-6ae55b81_0
2025-09-30T14:52:51.518992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 979 sessionId: src_id|9931ee8b-b3ac596d-6956e498-6ae55b81_0 is DEAD
2025-09-30T14:52:51.519154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9931ee8b-b3ac596d-6956e498-6ae55b81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:51.519165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9931ee8b-b3ac596d-6956e498-6ae55b81_0] Write session will restart in 0.005724s
2025-09-30T14:52:51.519192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9931ee8b-b3ac596d-6956e498-6ae55b81_0] Write session: Do CDS request
2025-09-30T14:52:51.519201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9931ee8b-b3ac596d-6956e498-6ae55b81_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:51.525761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9931ee8b-b3ac596d-6956e498-6ae55b81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:51.525854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:51.525874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 980
2025-09-30T14:52:51.526080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 980 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:51.526110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 980 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:51.526120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=980 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:51.526124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:51.526352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:51.526579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 980 sessionId:  describe result for acl check
2025-09-30T14:52:51.526638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:51.526659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:51.526661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:51.526669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895323147137520:8174] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:51.527441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895323147137520:8174] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:51.528172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:51.528339Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:51.528348Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:51.528358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:51.528409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:51.528481Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895323057390655:6613]
2025-09-30T14:52:51.529172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:51.529472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:51.529513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:51.529821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895323147137520:8174] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:51.529843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:51.529900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:51.529908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:51.529910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:51.529911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:51.529912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:51.529914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:51.529915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:51.529916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:51.529918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:51.529919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:51.529922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.529923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.529924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.529925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:51.529926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:51.529931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:51.529942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:51.529947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:51.529952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:51.529956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:51.529961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:51.529965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:51.529970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:51.529975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:51.529980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:51.529984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.529988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.529993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.529997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:51.530002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:51.530010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:51.530019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:51.530025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:51.530031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:51.530036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:51.530042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:51.530046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:51.530052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:51.530062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:51.530068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:51.530078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:51.530084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:51.530092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:51.530098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:51.530106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:51.530112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:51.530118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:51.530124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:51.530128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:51.530135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:51.530140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.530150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.530156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.530165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.530170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.530176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.530185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:51.530190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:51.530198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:51.530218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:51.530267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:51.535613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895323147137520:8174] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:51.535633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895323147137520:8174] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:51.535637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895323147137520:8174] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:51.535647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 980 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:51.535898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:51.536765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:51.536778Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:51.536781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:51.536785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:51.536792Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 979 [2:7555895323057390655:6613]
2025-09-30T14:52:51.536809Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:51.536826Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:51.536829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:51.536832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:51.536834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:51.536853Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:51.536865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:51.536872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:51.536930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.536937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.536939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.536942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:51.536945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:51.537012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:51.537020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.537033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.537049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.537075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:51.537099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895323147137560:8174], now have 1 active actors on pipe
2025-09-30T14:52:51.537107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895323147137498:2454], now have 1 active actors on pipe
2025-09-30T14:52:51.537114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895323057390650:6613]
2025-09-30T14:52:51.537121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895323057390650:6613]
2025-09-30T14:52:51.537123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895323057390650:6613]
2025-09-30T14:52:51.537136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:51.537150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:51.537154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:51.537155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:51.537157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 979
2025-09-30T14:52:51.537147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 979
2025-09-30T14:52:51.537167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:51.537172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:51.537175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:51.537210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895323057390650:6613]
2025-09-30T14:52:51.537216Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:51.537224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:51.537237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:51.537246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:51.537295Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5daf5e8d-d481f8ae-31f06fc0-2e0c3ef1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:51.537304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:51.537308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:51.537309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:51.537317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:51.537326Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:51.537348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:51.537584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:51.537602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:51.537629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:51.537736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 980 partition: 0 MaxSeqNo: 42 sessionId: src_id|5daf5e8d-d481f8ae-31f06fc0-2e0c3ef1_0
2025-09-30T14:52:51.538103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9931ee8b-b3ac596d-6956e498-6ae55b81_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5daf5e8d-d481f8ae-31f06fc0-2e0c3ef1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:51.540917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5daf5e8d-d481f8ae-31f06fc0-2e0c3ef1_0] Write session: try to update token
2025-09-30T14:52:51.540938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5daf5e8d-d481f8ae-31f06fc0-2e0c3ef1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:51.549654Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:51.549679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:51.549681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:51.549683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:51.549693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895323057390650:6613]
2025-09-30T14:52:51.549697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895323057390650:6613]
2025-09-30T14:52:51.549701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895323057390650:6613]
2025-09-30T14:52:51.549745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:51.549752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.549755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:51.549839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:51.549853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:51.549856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:51.549896Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:51.556154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 980 sessionId: src_id|5daf5e8d-d481f8ae-31f06fc0-2e0c3ef1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:51.558852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:51.619009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895323147137580:7731]
2025-09-30T14:52:51.619270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 979, pipe: [1:7555895323147137580:7731]
2025-09-30T14:52:51.665679Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:51.665986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:51.666005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:51.666044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895323147137580:7731], now have 1 active actors on pipe
2025-09-30T14:52:51.666266Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:51.666395Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:51.666420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:51.666424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:51.666454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895323147137580:7731]
2025-09-30T14:52:51.666491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 980 reason: error at write: Disconnected sessionId: src_id|5daf5e8d-d481f8ae-31f06fc0-2e0c3ef1_0
2025-09-30T14:52:51.666658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 980 sessionId: src_id|5daf5e8d-d481f8ae-31f06fc0-2e0c3ef1_0 is DEAD
2025-09-30T14:52:51.666815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5daf5e8d-d481f8ae-31f06fc0-2e0c3ef1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:51.666837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5daf5e8d-d481f8ae-31f06fc0-2e0c3ef1_0] Write session will restart in 0.008309s
2025-09-30T14:52:51.666863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5daf5e8d-d481f8ae-31f06fc0-2e0c3ef1_0] Write session: Do CDS request
2025-09-30T14:52:51.666868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5daf5e8d-d481f8ae-31f06fc0-2e0c3ef1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:51.674100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:51.675711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:51.675918Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:51.675931Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:51.675942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:51.675992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:51.676032Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895323057390755:6628]
2025-09-30T14:52:51.676708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:51.676757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5daf5e8d-d481f8ae-31f06fc0-2e0c3ef1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:51.676863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:51.676881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 981
2025-09-30T14:52:51.677007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 981 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:51.677040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 981 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:51.677045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=981 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:51.677050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:51.677037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:51.677095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:51.677438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:51.677480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 981 sessionId:  describe result for acl check
2025-09-30T14:52:51.677519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:51.677525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:51.677517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:51.677528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:51.677535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895323147137617:8185] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:51.677524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:51.677526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:51.677527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:51.677528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:51.677529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:51.677530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:51.677531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:51.677532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:51.677533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:51.677535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.677538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.677540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.677541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:51.677542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:51.677547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:51.677557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:51.677562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:51.677567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:51.677571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:51.677575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:51.677578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:51.677582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:51.677586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:51.677590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:51.677594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.677598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.677602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.677606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:51.677609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:51.677617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:51.677625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:51.677632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:51.677637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:51.677642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:51.677647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:51.677652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:51.677657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:51.677661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:51.677665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:51.677669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:51.677675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:51.677681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:51.677691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:51.677695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:51.677702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:51.677711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:51.677716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:51.677724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:51.677730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:51.677735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.677744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.677749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.677755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.677765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.677769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.677772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:51.677777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:51.677782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:51.677790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:51.677831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:51.678319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895323147137617:8185] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:51.680282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895323147137617:8185] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:51.683079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895323147137617:8185] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:51.683096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895323147137617:8185] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:51.683101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895323147137617:8185] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:51.683110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 981 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:51.683419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:51.684272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:51.684286Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:51.684289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:51.684293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:51.684299Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 980 [2:7555895323057390755:6628]
2025-09-30T14:52:51.684316Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:51.684331Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:51.684334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:51.684338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:51.684340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:51.684359Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:51.684366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:51.684372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:51.684425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.684436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.684438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.684441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:51.684443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:51.684506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:51.684514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.684526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.684545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.684569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:51.684592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895323147137653:8185], now have 1 active actors on pipe
2025-09-30T14:52:51.684600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895323147137591:2454], now have 1 active actors on pipe
2025-09-30T14:52:51.684606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895323057390750:6628]
2025-09-30T14:52:51.684609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895323057390750:6628]
2025-09-30T14:52:51.684611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895323057390750:6628]
2025-09-30T14:52:51.684625Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:51.684639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:51.684656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:51.684663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:51.684679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 980
2025-09-30T14:52:51.684695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895323057390750:6628]
2025-09-30T14:52:51.684690Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 980
2025-09-30T14:52:51.684703Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:51.684706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:51.684711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:51.684713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:51.684721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:51.684804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:51.684820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:51.684851Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|949b07bd-3366e595-cf823e55-d853e3da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:51.684863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:51.684868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:51.684870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:51.684880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:51.684890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:51.684903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:51.685058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:51.685067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:51.685086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:51.685209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 981 partition: 0 MaxSeqNo: 42 sessionId: src_id|949b07bd-3366e595-cf823e55-d853e3da_0
2025-09-30T14:52:51.685552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5daf5e8d-d481f8ae-31f06fc0-2e0c3ef1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|949b07bd-3366e595-cf823e55-d853e3da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:51.688402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|949b07bd-3366e595-cf823e55-d853e3da_0] Write session: try to update token
2025-09-30T14:52:51.688423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|949b07bd-3366e595-cf823e55-d853e3da_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:51.697227Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:51.697253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:51.697264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895323057390750:6628]
2025-09-30T14:52:51.697313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:51.697491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:51.697647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:51.697798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:51.697953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:51.698160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:51.698231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:51.698303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:51.703109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 981 sessionId: src_id|949b07bd-3366e595-cf823e55-d853e3da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:51.705950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:51.706151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:51.706173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:51.706222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:51.706336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:51.708073Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:51.708089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:51.708091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:51.708093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:51.708102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895323057390750:6628]
2025-09-30T14:52:51.708110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895323057390750:6628]
2025-09-30T14:52:51.708118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895323057390750:6628]
2025-09-30T14:52:51.708151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:51.708158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.708157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:51.708160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:51.708164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:51.708169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:51.708295Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:51.766518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895323147137661:7731]
2025-09-30T14:52:51.766827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 980, pipe: [1:7555895323147137661:7731]
2025-09-30T14:52:51.819479Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:51.826697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:51.826725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:51.826884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:51.826956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:51.827022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:51.827095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:51.827146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:51.827160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:51.827230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:51.827308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:51.827370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:51.827438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:51.827488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:51.827500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:51.827577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:51.827634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:51.827692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:51.827758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:51.827802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:51.827807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:51.827882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:51.827947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:51.828009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:51.828068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:51.828109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:51.828115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:51.828177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:51.828243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:51.828307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:51.828369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:51.828412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:51.828419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:51.828482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:51.828549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:51.828616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:51.828677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:51.828719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:51.828724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:51.828787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:51.828854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:51.828930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:51.829000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:51.829046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:51.829055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:51.829128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:51.829203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:51.829281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:51.829352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:51.829398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:51.829408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:51.829482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:51.829543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:51.829606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:51.829677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:51.829722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:51.829729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:51.829799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:51.829861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:51.829925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:51.829994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:51.830045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:51.830052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:51.830116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895323147137661:7731], now have 1 active actors on pipe
2025-09-30T14:52:51.830450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895323147137661:7731]
2025-09-30T14:52:51.830500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:51.830504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:51.830532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 981 reason: error at write: Disconnected sessionId: src_id|949b07bd-3366e595-cf823e55-d853e3da_0
2025-09-30T14:52:51.830574Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:51.830710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 981 sessionId: src_id|949b07bd-3366e595-cf823e55-d853e3da_0 is DEAD
2025-09-30T14:52:51.830879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|949b07bd-3366e595-cf823e55-d853e3da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:51.830892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|949b07bd-3366e595-cf823e55-d853e3da_0] Write session will restart in 0.005042s
2025-09-30T14:52:51.830918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|949b07bd-3366e595-cf823e55-d853e3da_0] Write session: Do CDS request
2025-09-30T14:52:51.830934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|949b07bd-3366e595-cf823e55-d853e3da_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:51.831227Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:51.836713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|949b07bd-3366e595-cf823e55-d853e3da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:51.836843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:51.836863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 982
2025-09-30T14:52:51.837041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 982 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:51.837083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 982 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:51.837104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=982 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:51.837109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:51.837527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 982 sessionId:  describe result for acl check
2025-09-30T14:52:51.837559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:51.837568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:51.837570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:51.837576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895323147137685:8189] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:51.838103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895323147137685:8189] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:51.839310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:51.840514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895323147137685:8189] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:51.840635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:51.840825Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:51.840834Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:51.840845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:51.840893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:51.840931Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895323057390818:6630]
2025-09-30T14:52:51.841583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:51.841973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:51.842019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:51.842343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:51.842409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:51.842414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:51.842416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:51.842417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:51.842421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:51.842423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:51.842424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:51.842425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:51.842426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:51.842427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:51.842428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.842429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.842430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.842431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:51.842433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:51.842438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:51.842448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:51.842452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:51.842456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:51.842460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:51.842464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:51.842468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:51.842472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:51.842475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:51.842479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:51.842483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.842486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.842490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.842493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:51.842497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:51.842505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:51.842512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:51.842518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:51.842523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:51.842527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:51.842533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:51.842537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:51.842542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:51.842547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:51.842551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:51.842555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:51.842561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:51.842565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:51.842569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:51.842573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:51.842577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:51.842581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:51.842586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:51.842589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:51.842594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:51.842602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.842607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.842612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.842616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.842622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.842626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.842630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:51.842635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:51.842639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:51.842649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:51.842693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:51.843504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895323147137685:8189] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:51.843521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895323147137685:8189] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:51.843524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895323147137685:8189] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:51.843533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 982 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:51.848089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:51.848964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:51.848979Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:51.848982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:51.848988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:51.848994Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 981 [2:7555895323057390818:6630]
2025-09-30T14:52:51.849010Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:51.849028Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:51.849036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:51.849039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:51.849041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:51.849056Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:51.849062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:51.849069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:51.849123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.849133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.849135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.849139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:51.849142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:51.849236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:51.849243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.849256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.849269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.849288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:51.849310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895323147137663:2454], now have 1 active actors on pipe
2025-09-30T14:52:51.849318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895323147137727:8189], now have 1 active actors on pipe
2025-09-30T14:52:51.849324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895323057390813:6630]
2025-09-30T14:52:51.849326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895323057390813:6630]
2025-09-30T14:52:51.849328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895323057390813:6630]
2025-09-30T14:52:51.849341Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:51.849360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:51.849362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:51.849367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:51.849369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:51.849379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:51.849383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:51.849382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 981
2025-09-30T14:52:51.849396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 981
2025-09-30T14:52:51.849413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895323057390813:6630]
2025-09-30T14:52:51.849421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:51.849424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:51.849443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:51.849451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:51.849496Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|366f123e-d20d1ddd-2f632267-8af124c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:51.849508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:51.849511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:51.849513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:51.849521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:51.849531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:51.849553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:51.849717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:51.849730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:51.849754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:51.849851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 982 partition: 0 MaxSeqNo: 42 sessionId: src_id|366f123e-d20d1ddd-2f632267-8af124c9_0
2025-09-30T14:52:51.850183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|949b07bd-3366e595-cf823e55-d853e3da_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|366f123e-d20d1ddd-2f632267-8af124c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:51.852961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|366f123e-d20d1ddd-2f632267-8af124c9_0] Write session: try to update token
2025-09-30T14:52:51.852983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|366f123e-d20d1ddd-2f632267-8af124c9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:51.861555Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:51.861574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:51.861578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:51.861580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:51.861588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895323057390813:6630]
2025-09-30T14:52:51.861594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895323057390813:6630]
2025-09-30T14:52:51.861596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895323057390813:6630]
2025-09-30T14:52:51.861638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:51.861648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.861648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:51.861650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:51.861655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:51.861659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:51.861793Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:51.867812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 982 sessionId: src_id|366f123e-d20d1ddd-2f632267-8af124c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:51.870465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:51.930782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895323147137734:7731]
2025-09-30T14:52:51.931035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 981, pipe: [1:7555895323147137734:7731]
2025-09-30T14:52:51.973733Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:51.974039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:51.974051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:51.974084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895323147137734:7731], now have 1 active actors on pipe
2025-09-30T14:52:51.974282Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:51.974348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:51.974358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:51.974408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895323147137734:7731]
2025-09-30T14:52:51.974434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 982 reason: status is not ok: tablet will be restarted right now sessionId: src_id|366f123e-d20d1ddd-2f632267-8af124c9_0
2025-09-30T14:52:51.974598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 982 sessionId: src_id|366f123e-d20d1ddd-2f632267-8af124c9_0 is DEAD
2025-09-30T14:52:51.974750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|366f123e-d20d1ddd-2f632267-8af124c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:51.974760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|366f123e-d20d1ddd-2f632267-8af124c9_0] Write session will restart in 0.009541s
2025-09-30T14:52:51.974782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|366f123e-d20d1ddd-2f632267-8af124c9_0] Write session: Do CDS request
2025-09-30T14:52:51.974788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|366f123e-d20d1ddd-2f632267-8af124c9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:51.982459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:51.983946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:51.984131Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:51.984142Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:51.984152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:51.984202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:51.984240Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895323057390883:6632]
2025-09-30T14:52:51.984889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:51.985191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:51.985232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:51.985744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|366f123e-d20d1ddd-2f632267-8af124c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:51.985555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:51.985619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:51.985621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:51.985623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:51.985624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:51.985625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:51.985626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:51.985627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:51.985629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:51.985630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:51.985631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:51.985632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.985633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.985634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.985635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:51.985636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:51.985641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:51.985651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:51.985654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:51.985658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:51.985661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:51.985665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:51.985669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:51.985673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:51.985679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:51.985683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:51.985687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.985691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.985695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.985699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:51.985703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:51.985710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:51.985718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:51.985724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:51.985731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:51.985736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:51.985741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:51.985746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:51.985753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:51.985757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:51.985762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:51.985768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:51.985773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:51.985777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:51.985782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:51.985787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:51.985792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:51.985796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:51.985801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:51.985806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:51.985811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:51.985815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.985820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.985825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.985830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.985836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.985841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.985846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:51.985851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:51.985855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:51.985860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:51.985904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:51.986344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:51.986363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 983
2025-09-30T14:52:51.986493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 983 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:51.986535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 983 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:51.986546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=983 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:51.986550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:51.986943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 983 sessionId:  describe result for acl check
2025-09-30T14:52:51.986984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:51.986992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:51.986995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:51.987000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895323147137767:5187] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:51.987608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895323147137767:5187] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:51.989408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895323147137767:5187] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:51.991428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:51.992011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895323147137767:5187] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:51.992027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895323147137767:5187] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:51.992031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895323147137767:5187] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:51.992039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 983 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:51.992337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:51.992351Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:51.992356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:51.992360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:51.992366Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 982 [2:7555895323057390883:6632]
2025-09-30T14:52:51.992382Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:51.992396Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:51.992400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:51.992403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:51.992405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:51.992420Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:51.992427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:51.992434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:51.992485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.992495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.992498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.992500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:51.992502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:51.992546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:51.992553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:51.992561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:51.992572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:51.992592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:51.992613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895323057390878:6632]
2025-09-30T14:52:51.992619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895323057390878:6632]
2025-09-30T14:52:51.992621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895323057390878:6632]
2025-09-30T14:52:51.992632Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:51.992647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:51.992652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:51.992657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:51.992659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:51.992666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:51.992668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:51.992701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895323057390878:6632]
2025-09-30T14:52:51.992714Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:51.992723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:51.992918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895323147137801:5187], now have 1 active actors on pipe
2025-09-30T14:52:51.992928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895323147137736:2454], now have 1 active actors on pipe
2025-09-30T14:52:51.992978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 982
2025-09-30T14:52:51.992983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 982
2025-09-30T14:52:51.993096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:51.993106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:51.993131Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c41f867-2bfcee4a-7c40c3ca-100b88ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:51.993142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:51.993146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:51.993148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:51.993157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:51.993172Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:51.993191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:51.993401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:51.993409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:51.993421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:51.993539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 983 partition: 0 MaxSeqNo: 42 sessionId: src_id|3c41f867-2bfcee4a-7c40c3ca-100b88ac_0
2025-09-30T14:52:51.993867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|366f123e-d20d1ddd-2f632267-8af124c9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3c41f867-2bfcee4a-7c40c3ca-100b88ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:51.996933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c41f867-2bfcee4a-7c40c3ca-100b88ac_0] Write session: try to update token
2025-09-30T14:52:51.996953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c41f867-2bfcee4a-7c40c3ca-100b88ac_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:52.005024Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:52.005045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:52.005049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:52.005051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:52.005061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895323057390878:6632]
2025-09-30T14:52:52.005067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895323057390878:6632]
2025-09-30T14:52:52.005070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895323057390878:6632]
2025-09-30T14:52:52.005109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:52.005115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.005118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:52.005124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:52.005130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:52.005134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:52.005259Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:52.011910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 983 sessionId: src_id|3c41f867-2bfcee4a-7c40c3ca-100b88ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:52.014649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:52.074722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895327442105113:7731]
2025-09-30T14:52:52.075032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 982, pipe: [1:7555895327442105113:7731]
2025-09-30T14:52:52.116756Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:52.117100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:52.117115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:52.117132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895327442105113:7731], now have 1 active actors on pipe
2025-09-30T14:52:52.117323Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:52.117363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:52.117381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:52.117402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:52.117444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 983 reason: error at write: Disconnected sessionId: src_id|3c41f867-2bfcee4a-7c40c3ca-100b88ac_0
2025-09-30T14:52:52.117448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895327442105113:7731]
2025-09-30T14:52:52.117611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 983 sessionId: src_id|3c41f867-2bfcee4a-7c40c3ca-100b88ac_0 is DEAD
2025-09-30T14:52:52.117770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c41f867-2bfcee4a-7c40c3ca-100b88ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:52.117782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c41f867-2bfcee4a-7c40c3ca-100b88ac_0] Write session will restart in 0.005728s
2025-09-30T14:52:52.117804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c41f867-2bfcee4a-7c40c3ca-100b88ac_0] Write session: Do CDS request
2025-09-30T14:52:52.117812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c41f867-2bfcee4a-7c40c3ca-100b88ac_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:52.124663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c41f867-2bfcee4a-7c40c3ca-100b88ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:52.124740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:52.124769Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:52.124788Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 984
2025-09-30T14:52:52.124905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 984 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:52.124945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 984 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:52.124954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=984 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:52.124957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:52.125416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 984 sessionId:  describe result for acl check
2025-09-30T14:52:52.125460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:52.125468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:52.125470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:52.125476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895327442105156:5177] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:52.125993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895327442105156:5177] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:52.126170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:52.126334Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:52.126342Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:52.126349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:52.126387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:52.126425Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895327352358257:6636]
2025-09-30T14:52:52.127050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:52.127340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:52.127401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:52.127559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895327442105156:5177] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:52.127744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:52.127802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:52.127807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:52.127808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:52.127810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:52.127811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:52.127812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:52.127814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:52.127815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:52.127816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:52.127818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:52.127819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.127820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.127822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.127823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:52.127824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:52.127830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:52.127841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:52.127845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:52.127849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:52.127865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:52.127872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:52.127875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:52.127880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:52.127884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:52.127888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:52.127891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.127895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.127899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.127903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:52.127908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:52.127915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:52.127923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:52.127932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:52.127937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:52.127941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:52.127947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:52.127955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:52.127960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:52.127965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:52.127974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:52.127979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:52.127988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:52.127993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:52.127998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:52.128005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:52.128010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:52.128019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:52.128024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:52.128028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:52.128033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:52.128045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.128050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.128054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.128059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.128065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.128083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.128087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:52.128092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:52.128101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:52.128106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:52.128152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:52.133009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895327442105156:5177] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:52.133025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895327442105156:5177] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:52.133029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895327442105156:5177] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:52.133037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 984 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:52.133231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:52.134073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:52.134088Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:52.134091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:52.134094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:52.134099Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 983 [2:7555895327352358257:6636]
2025-09-30T14:52:52.134115Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:52.134129Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:52.134132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:52.134135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:52.134137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:52.134154Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:52.134165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:52.134171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:52.134225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.134231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.134234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.134237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:52.134241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:52.134302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:52.134308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.134320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.134333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.134355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:52.134376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895327442105202:5177], now have 1 active actors on pipe
2025-09-30T14:52:52.134383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895327442105129:2454], now have 1 active actors on pipe
2025-09-30T14:52:52.134389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895327352358252:6636]
2025-09-30T14:52:52.134391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895327352358252:6636]
2025-09-30T14:52:52.134395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895327352358252:6636]
2025-09-30T14:52:52.134409Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:52.134400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 983
2025-09-30T14:52:52.134427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:52.134437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:52.134416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 983
2025-09-30T14:52:52.134441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:52.134441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:52.134443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:52.134444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:52.134467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895327352358252:6636]
2025-09-30T14:52:52.134474Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:52.134477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:52.134488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:52.134493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:52.134536Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d7a2077-9ce169e4-4d2e95ce-3d0f68d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:52.134546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:52.134549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:52.134551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:52.134559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:52.134567Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:52.134588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:52.134806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:52.134814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:52.134828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:52.134926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 984 partition: 0 MaxSeqNo: 42 sessionId: src_id|2d7a2077-9ce169e4-4d2e95ce-3d0f68d2_0
2025-09-30T14:52:52.135289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c41f867-2bfcee4a-7c40c3ca-100b88ac_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2d7a2077-9ce169e4-4d2e95ce-3d0f68d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:52.137942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d7a2077-9ce169e4-4d2e95ce-3d0f68d2_0] Write session: try to update token
2025-09-30T14:52:52.137961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d7a2077-9ce169e4-4d2e95ce-3d0f68d2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:52.146365Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:52.146392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:52.146395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:52.146397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:52.146406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895327352358252:6636]
2025-09-30T14:52:52.146410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895327352358252:6636]
2025-09-30T14:52:52.146418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895327352358252:6636]
2025-09-30T14:52:52.146456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:52.146463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.146466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:52.146465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:52.146471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:52.146479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:52.146610Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:52.153015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 984 sessionId: src_id|2d7a2077-9ce169e4-4d2e95ce-3d0f68d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:52.155819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:52.217523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895327442105211:7731]
2025-09-30T14:52:52.217836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 983, pipe: [1:7555895327442105211:7731]
2025-09-30T14:52:52.261667Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:52.261970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:52.261988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:52.262008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895327442105211:7731], now have 1 active actors on pipe
2025-09-30T14:52:52.262250Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:52.262284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895327442105211:7731]
2025-09-30T14:52:52.262285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:52.262322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:52.262324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:52.262390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 984 reason: error at write: Disconnected sessionId: src_id|2d7a2077-9ce169e4-4d2e95ce-3d0f68d2_0
2025-09-30T14:52:52.262560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 984 sessionId: src_id|2d7a2077-9ce169e4-4d2e95ce-3d0f68d2_0 is DEAD
2025-09-30T14:52:52.262739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d7a2077-9ce169e4-4d2e95ce-3d0f68d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:52.262746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d7a2077-9ce169e4-4d2e95ce-3d0f68d2_0] Write session will restart in 0.009470s
2025-09-30T14:52:52.262769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d7a2077-9ce169e4-4d2e95ce-3d0f68d2_0] Write session: Do CDS request
2025-09-30T14:52:52.262775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d7a2077-9ce169e4-4d2e95ce-3d0f68d2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:52.269596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:52.271276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:52.271485Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:52.271495Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:52.271505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:52.271557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:52.271596Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895327352358323:6638]
2025-09-30T14:52:52.272210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:52.272544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:52.272612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:52.272954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:52.273017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:52.273025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:52.273026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:52.273028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:52.273029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:52.273030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:52.273032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:52.273033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:52.273034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:52.273035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:52.273036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.273037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.273038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.273038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:52.273039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:52.273043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:52.273050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:52.273053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:52.273055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:52.273058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:52.273060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:52.273062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:52.273066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:52.273069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:52.273071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:52.273074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.273076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.273078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.273080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:52.273083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:52.273090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:52.273096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:52.273100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:52.273104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:52.273109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:52.273114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:52.273118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:52.273122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:52.273127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:52.273131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:52.273135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:52.273140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:52.273147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:52.273152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:52.273154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:52.273157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:52.273160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:52.273163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:52.273166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:52.273169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:52.273172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.273175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.273177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.273180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.273183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.273186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.273188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:52.273191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:52.273193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:52.273196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:52.273221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:52.273734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d7a2077-9ce169e4-4d2e95ce-3d0f68d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:52.273819Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:52.273837Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 985
2025-09-30T14:52:52.273969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 985 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:52.274015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 985 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:52.274024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=985 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:52.274028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:52.274437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 985 sessionId:  describe result for acl check
2025-09-30T14:52:52.274473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:52.274474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:52.274476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:52.274482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895327442105245:5169] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:52.275014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895327442105245:5169] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:52.277334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895327442105245:5169] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:52.278760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:52.279636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:52.279650Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:52.279652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:52.279656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:52.279661Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 984 [2:7555895327352358323:6638]
2025-09-30T14:52:52.279675Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:52.279688Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:52.279690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:52.279692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:52.279694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:52.279707Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:52.279711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:52.279716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:52.279779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.279785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.279786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.279788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:52.279791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:52.279845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:52.279852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.279864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.279878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.279897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:52.279921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895327442105212:2454], now have 1 active actors on pipe
2025-09-30T14:52:52.279932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895327352358318:6638]
2025-09-30T14:52:52.279934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895327352358318:6638]
2025-09-30T14:52:52.279939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895327352358318:6638]
2025-09-30T14:52:52.279955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:52.279973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:52.279977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:52.279981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:52.279970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 984
2025-09-30T14:52:52.279983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:52.279993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:52.279996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:52.280033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895327352358318:6638]
2025-09-30T14:52:52.280039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:52.280043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:52.280306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895327442105245:5169] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:52.280321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895327442105245:5169] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:52.280325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895327442105245:5169] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:52.280332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 985 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:52.280556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895327442105281:5169], now have 1 active actors on pipe
2025-09-30T14:52:52.280606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 984
2025-09-30T14:52:52.280658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:52.280671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:52.280696Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dedffdd2-9ce409aa-cf560974-af459ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:52.280708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:52.280710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:52.280712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:52.280721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:52.280736Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:52.280756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:52.280941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:52.280949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:52.280963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:52.281069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 985 partition: 0 MaxSeqNo: 42 sessionId: src_id|dedffdd2-9ce409aa-cf560974-af459ca_0
2025-09-30T14:52:52.281398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d7a2077-9ce169e4-4d2e95ce-3d0f68d2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dedffdd2-9ce409aa-cf560974-af459ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:52.284167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dedffdd2-9ce409aa-cf560974-af459ca_0] Write session: try to update token
2025-09-30T14:52:52.284188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dedffdd2-9ce409aa-cf560974-af459ca_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:52.298876Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:52.298901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:52.298912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895327352358318:6638]
2025-09-30T14:52:52.298965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:52.299006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:52.299168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:52.299362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:52.299530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:52.299696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:52.300039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:52.300099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:52.300164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 985 sessionId: src_id|dedffdd2-9ce409aa-cf560974-af459ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:52.302920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:52.303422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:52.303445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:52.303464Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:52.303471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:52.303473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:52.303475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:52.303483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895327352358318:6638]
2025-09-30T14:52:52.303488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895327352358318:6638]
2025-09-30T14:52:52.303491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895327352358318:6638]
2025-09-30T14:52:52.303542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:52.303548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:52.303549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.303552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:52.303562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:52.303579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:52.303678Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:52.362435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895327442105287:7731]
2025-09-30T14:52:52.362740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 984, pipe: [1:7555895327442105287:7731]
2025-09-30T14:52:52.414480Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:52.414886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:52.414926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895327442105287:7731], now have 1 active actors on pipe
2025-09-30T14:52:52.415031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:52.415118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895327442105287:7731]
2025-09-30T14:52:52.415143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:52.415146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:52.415153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:52.415215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 985 reason: error at write: Disconnected sessionId: src_id|dedffdd2-9ce409aa-cf560974-af459ca_0
2025-09-30T14:52:52.415376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 985 sessionId: src_id|dedffdd2-9ce409aa-cf560974-af459ca_0 is DEAD
2025-09-30T14:52:52.415543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dedffdd2-9ce409aa-cf560974-af459ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:52.415554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dedffdd2-9ce409aa-cf560974-af459ca_0] Write session will restart in 0.008571s
2025-09-30T14:52:52.415590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dedffdd2-9ce409aa-cf560974-af459ca_0] Write session: Do CDS request
2025-09-30T14:52:52.415596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dedffdd2-9ce409aa-cf560974-af459ca_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:52.423005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:52.424497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:52.424691Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:52.424699Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:52.424717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:52.424771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:52.424818Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895327352358389:6640]
2025-09-30T14:52:52.425321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:52.425689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:52.425727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dedffdd2-9ce409aa-cf560974-af459ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:52.425743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:52.425830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:52.425849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 986
2025-09-30T14:52:52.425983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 986 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:52.426018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 986 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:52.426023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=986 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:52.426027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:52.426097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:52.426167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:52.426173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:52.426174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:52.426176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:52.426177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:52.426178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:52.426179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:52.426180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:52.426181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:52.426181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:52.426182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.426183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.426183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.426184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:52.426185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:52.426189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:52.426205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:52.426209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:52.426214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:52.426217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:52.426219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:52.426222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:52.426224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:52.426226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:52.426229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:52.426232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.426234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.426238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.426240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:52.426246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:52.426252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:52.426257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:52.426261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:52.426264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:52.426267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:52.426270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:52.426273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:52.426276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:52.426278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:52.426281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:52.426283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:52.426287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:52.426290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:52.426292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:52.426295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:52.426298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:52.426300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:52.426303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:52.426306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:52.426308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:52.426324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.426328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.426333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.426337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.426343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.426348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.426352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:52.426356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:52.426359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:52.426362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:52.426408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:52.426437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 986 sessionId:  describe result for acl check
2025-09-30T14:52:52.426469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:52.426475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:52.426477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:52.426482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895327442105319:5161] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:52.426997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895327442105319:5161] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:52.428725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895327442105319:5161] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:52.431497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895327442105319:5161] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:52.431515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895327442105319:5161] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:52.431518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895327442105319:5161] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:52.431526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 986 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:52.431838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:52.432684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:52.432705Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:52.432708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:52.432712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:52.432718Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 985 [2:7555895327352358389:6640]
2025-09-30T14:52:52.432732Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:52.432743Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:52.432745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:52.432747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:52.432749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:52.432765Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:52.432777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:52.432784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:52.432843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.432851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.432853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.432857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:52.432862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:52.432923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:52.432931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.432943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.432958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.432983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:52.433012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895327442105288:2454], now have 1 active actors on pipe
2025-09-30T14:52:52.433017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895327442105356:5161], now have 1 active actors on pipe
2025-09-30T14:52:52.433024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895327352358384:6640]
2025-09-30T14:52:52.433026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895327352358384:6640]
2025-09-30T14:52:52.433027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895327352358384:6640]
2025-09-30T14:52:52.433042Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:52.433060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:52.433068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:52.433072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:52.433075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:52.433076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:52.433079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:52.433110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895327352358384:6640]
2025-09-30T14:52:52.433117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:52.433065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 985
2025-09-30T14:52:52.433121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:52.433070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 985
2025-09-30T14:52:52.433142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:52.433151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:52.433251Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|479032f3-ae481e4e-2cbddfe3-21607f18_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:52.433265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:52.433269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:52.433271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:52.433279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:52.433293Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:52.433322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:52.433539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:52.433553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:52.433575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:52.433694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 986 partition: 0 MaxSeqNo: 42 sessionId: src_id|479032f3-ae481e4e-2cbddfe3-21607f18_0
2025-09-30T14:52:52.434053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dedffdd2-9ce409aa-cf560974-af459ca_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|479032f3-ae481e4e-2cbddfe3-21607f18_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:52.436886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|479032f3-ae481e4e-2cbddfe3-21607f18_0] Write session: try to update token
2025-09-30T14:52:52.436905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|479032f3-ae481e4e-2cbddfe3-21607f18_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:52.445404Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:52.445425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:52.445428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:52.445430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:52.445439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895327352358384:6640]
2025-09-30T14:52:52.445446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895327352358384:6640]
2025-09-30T14:52:52.445450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895327352358384:6640]
2025-09-30T14:52:52.445490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:52.445501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.445504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:52.445504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:52.445511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:52.445515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:52.445646Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:52.461156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 986 sessionId: src_id|479032f3-ae481e4e-2cbddfe3-21607f18_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:52.464024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:52.515516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895327442105366:7731]
2025-09-30T14:52:52.515773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 985, pipe: [1:7555895327442105366:7731]
2025-09-30T14:52:52.563930Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:52.564255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:52.564273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:52.564293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895327442105366:7731], now have 1 active actors on pipe
2025-09-30T14:52:52.564591Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:52.564664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895327442105366:7731]
2025-09-30T14:52:52.564688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:52.564690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:52.564772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 986 reason: error at write: Disconnected sessionId: src_id|479032f3-ae481e4e-2cbddfe3-21607f18_0
2025-09-30T14:52:52.564753Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:52.564944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 986 sessionId: src_id|479032f3-ae481e4e-2cbddfe3-21607f18_0 is DEAD
2025-09-30T14:52:52.565179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|479032f3-ae481e4e-2cbddfe3-21607f18_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:52.565190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|479032f3-ae481e4e-2cbddfe3-21607f18_0] Write session will restart in 0.008396s
2025-09-30T14:52:52.565212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|479032f3-ae481e4e-2cbddfe3-21607f18_0] Write session: Do CDS request
2025-09-30T14:52:52.565220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|479032f3-ae481e4e-2cbddfe3-21607f18_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:52.572759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:52.574365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:52.574558Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:52.574570Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:52.574582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:52.574636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:52.574677Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895327352358457:6642]
2025-09-30T14:52:52.574779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|479032f3-ae481e4e-2cbddfe3-21607f18_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:52.574856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:52.574875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 987
2025-09-30T14:52:52.574995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 987 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:52.575030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 987 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:52.575051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=987 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:52.575060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:52.575364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:52.575523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 987 sessionId:  describe result for acl check
2025-09-30T14:52:52.575568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:52.575575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:52.575577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:52.575582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895327442105398:5157] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:52.575693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:52.575742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:52.576098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:52.576119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895327442105398:5157] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:52.576173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:52.576178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:52.576180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:52.576180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:52.576182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:52.576183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:52.576184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:52.576185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:52.576187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:52.576189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:52.576190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.576191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.576195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.576196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:52.576198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:52.576204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:52.576214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:52.576220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:52.576225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:52.576230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:52.576234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:52.576239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:52.576244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:52.576248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:52.576253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:52.576257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.576260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.576263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.576268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:52.576271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:52.576280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:52.576288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:52.576295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:52.576301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:52.576307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:52.576313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:52.576319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:52.576325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:52.576330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:52.576335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:52.576339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:52.576344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:52.576355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:52.576362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:52.576366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:52.576371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:52.576376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:52.576382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:52.576387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:52.576392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:52.576399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.576407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.576417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.576422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.576431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.576437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.576446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:52.576452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:52.576460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:52.576466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:52.576516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:52.578259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895327442105398:5157] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:52.581616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895327442105398:5157] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:52.581632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895327442105398:5157] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:52.581636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895327442105398:5157] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:52.581644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 987 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:52.582074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:52.582934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:52.582953Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:52.582957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:52.582960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:52.582967Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 986 [2:7555895327352358457:6642]
2025-09-30T14:52:52.582983Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:52.582998Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:52.583001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:52.583004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:52.583006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:52.583022Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:52.583036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:52.583048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:52.583107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.583111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.583113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.583117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:52.583119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:52.583178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:52.583187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.583199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.583213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.583232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:52.583268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895327442105367:2454], now have 1 active actors on pipe
2025-09-30T14:52:52.583271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895327442105436:5157], now have 1 active actors on pipe
2025-09-30T14:52:52.583277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895327352358452:6642]
2025-09-30T14:52:52.583280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895327352358452:6642]
2025-09-30T14:52:52.583281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895327352358452:6642]
2025-09-30T14:52:52.583293Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:52.583306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:52.583315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:52.583319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:52.583321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:52.583327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:52.583329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:52.583353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895327352358452:6642]
2025-09-30T14:52:52.583356Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:52.583339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 986
2025-09-30T14:52:52.583341Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 986
2025-09-30T14:52:52.583373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:52.583404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:52.583414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:52.583435Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a49a644d-3caa370f-5c900f33-13d4fae1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:52.583447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:52.583451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:52.583453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:52.583461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:52.583473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:52.583498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:52.583678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:52.583688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:52.583702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:52.583802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 987 partition: 0 MaxSeqNo: 42 sessionId: src_id|a49a644d-3caa370f-5c900f33-13d4fae1_0
2025-09-30T14:52:52.584193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|479032f3-ae481e4e-2cbddfe3-21607f18_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a49a644d-3caa370f-5c900f33-13d4fae1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:52.586986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a49a644d-3caa370f-5c900f33-13d4fae1_0] Write session: try to update token
2025-09-30T14:52:52.587003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a49a644d-3caa370f-5c900f33-13d4fae1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:52.595292Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:52.595310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:52.595322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895327352358452:6642]
2025-09-30T14:52:52.595380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:52.595500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:52.595554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:52.595700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:52.595837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:52.595978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:52.596348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:52.596396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:52.601570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 987 sessionId: src_id|a49a644d-3caa370f-5c900f33-13d4fae1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:52.604205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:52.604435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:52.604458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:52.604494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:52.604596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:52.606080Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:52.606092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:52.606095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:52.606098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:52.606107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895327352358452:6642]
2025-09-30T14:52:52.606124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895327352358452:6642]
2025-09-30T14:52:52.606131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895327352358452:6642]
2025-09-30T14:52:52.606168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:52.606178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:52.606180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.606183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:52.606184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:52.606188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:52.606348Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:52.665020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895327442105457:7731]
2025-09-30T14:52:52.665333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 986, pipe: [1:7555895327442105457:7731]
2025-09-30T14:52:52.719892Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:52.727722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:52.727751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:52.727913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:52.727974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:52.728041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:52.728102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:52.728153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:52.728159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:52.728239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:52.728308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:52.728373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:52.728442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:52.728514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:52.728524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:52.728596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:52.728662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:52.728728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:52.728796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:52.728843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:52.728850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:52.728914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:52.728983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:52.729048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:52.729116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:52.729162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:52.729172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:52.729238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:52.729304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:52.729369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:52.729437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:52.729483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:52.729491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:52.729557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:52.729621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:52.729686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:52.729750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:52.729796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:52.729805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:52.729872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:52.729937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:52.730009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:52.730075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:52.730125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:52.730134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:52.730215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:52.730278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:52.730341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:52.730403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:52.730450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:52.730458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:52.730525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:52.730586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:52.730650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:52.730717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:52.730760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:52.730767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:52.730832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:52.730898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:52.730964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:52.731027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:52.731074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:52.731082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:52.731163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895327442105457:7731], now have 1 active actors on pipe
2025-09-30T14:52:52.731558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895327442105457:7731]
2025-09-30T14:52:52.731605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:52.731616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:52.731645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 987 reason: error at write: Disconnected sessionId: src_id|a49a644d-3caa370f-5c900f33-13d4fae1_0
2025-09-30T14:52:52.731833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 987 sessionId: src_id|a49a644d-3caa370f-5c900f33-13d4fae1_0 is DEAD
2025-09-30T14:52:52.731958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a49a644d-3caa370f-5c900f33-13d4fae1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:52.731974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a49a644d-3caa370f-5c900f33-13d4fae1_0] Write session will restart in 0.008355s
2025-09-30T14:52:52.731990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a49a644d-3caa370f-5c900f33-13d4fae1_0] Write session: Do CDS request
2025-09-30T14:52:52.732010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a49a644d-3caa370f-5c900f33-13d4fae1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:52.732062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:52.732141Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:52.740231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:52.741677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:52.741844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a49a644d-3caa370f-5c900f33-13d4fae1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:52.741879Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:52.741890Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:52.741901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:52.741890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:52.741909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 988
2025-09-30T14:52:52.741962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:52.742013Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895327352358565:6657]
2025-09-30T14:52:52.742063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 988 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:52.742094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 988 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:52.742117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=988 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:52.742122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:52.742574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 988 sessionId:  describe result for acl check
2025-09-30T14:52:52.742604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:52.742613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:52.742615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:52.742620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895327442105501:5141] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:52.742676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:52.743006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:52.743058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:52.743161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895327442105501:5141] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:52.743412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:52.743481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:52.743489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:52.743490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:52.743491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:52.743492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:52.743493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:52.743494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:52.743495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:52.743496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:52.743498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:52.743499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.743500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.743501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.743502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:52.743503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:52.743510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:52.743519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:52.743523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:52.743527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:52.743531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:52.743535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:52.743538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:52.743542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:52.743545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:52.743550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:52.743553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.743557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.743560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.743563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:52.743568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:52.743576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:52.743584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:52.743589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:52.743594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:52.743599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:52.743604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:52.743608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:52.743613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:52.743616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:52.743621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:52.743625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:52.743630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:52.743634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:52.743640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:52.743644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:52.743648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:52.743653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:52.743658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:52.743662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:52.743667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:52.743671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.743676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.743680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.743686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.743690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.743695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.743698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:52.743703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:52.743707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:52.743712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:52.743755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:52.745215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895327442105501:5141] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:52.749345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:52.749355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895327442105501:5141] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:52.749372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895327442105501:5141] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:52.749376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895327442105501:5141] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:52.749385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 988 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:52.750401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:52.750415Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:52.750418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:52.750422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:52.750429Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 987 [2:7555895327352358565:6657]
2025-09-30T14:52:52.750445Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:52.750461Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:52.750464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:52.750468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:52.750470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:52.750485Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:52.750491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:52.750497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:52.750556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.750564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.750566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.750569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:52.750572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:52.750629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:52.750636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.750647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.750663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.750680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:52.750700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895327442105470:2454], now have 1 active actors on pipe
2025-09-30T14:52:52.750709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895327442105536:5141], now have 1 active actors on pipe
2025-09-30T14:52:52.750715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895327352358560:6657]
2025-09-30T14:52:52.750717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895327352358560:6657]
2025-09-30T14:52:52.750719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895327352358560:6657]
2025-09-30T14:52:52.750731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:52.750748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:52.750749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:52.750752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:52.750755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:52.750767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:52.750770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:52.750800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895327352358560:6657]
2025-09-30T14:52:52.750811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:52.750799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 987
2025-09-30T14:52:52.750808Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 987
2025-09-30T14:52:52.750823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:52.750902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:52.750918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:52.750945Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f3e8dfc-afa20eb8-b4f652ad-4588dea3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:52.750957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:52.750962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:52.750971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:52.750981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:52.750996Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:52.751015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:52.751166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:52.751181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:52.751214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:52.751386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 988 partition: 0 MaxSeqNo: 42 sessionId: src_id|7f3e8dfc-afa20eb8-b4f652ad-4588dea3_0
2025-09-30T14:52:52.751773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a49a644d-3caa370f-5c900f33-13d4fae1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7f3e8dfc-afa20eb8-b4f652ad-4588dea3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:52.754644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3e8dfc-afa20eb8-b4f652ad-4588dea3_0] Write session: try to update token
2025-09-30T14:52:52.754665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3e8dfc-afa20eb8-b4f652ad-4588dea3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:52.763003Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:52.763024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:52.763027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:52.763032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:52.763041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895327352358560:6657]
2025-09-30T14:52:52.763045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895327352358560:6657]
2025-09-30T14:52:52.763049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895327352358560:6657]
2025-09-30T14:52:52.763085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:52.763089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:52.763092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:52.763096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:52.763097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.763100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:52.763238Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:52.773989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 988 sessionId: src_id|7f3e8dfc-afa20eb8-b4f652ad-4588dea3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:52.776863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:52.831944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895327442105544:7731]
2025-09-30T14:52:52.832236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 987, pipe: [1:7555895327442105544:7731]
2025-09-30T14:52:52.878888Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:52.879256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:52.879277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:52.879309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895327442105544:7731], now have 1 active actors on pipe
2025-09-30T14:52:52.879527Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:52.879547Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:52.879588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:52.879600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:52.879607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895327442105544:7731]
2025-09-30T14:52:52.879661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 988 reason: error at write: Disconnected sessionId: src_id|7f3e8dfc-afa20eb8-b4f652ad-4588dea3_0
2025-09-30T14:52:52.879836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 988 sessionId: src_id|7f3e8dfc-afa20eb8-b4f652ad-4588dea3_0 is DEAD
2025-09-30T14:52:52.879975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3e8dfc-afa20eb8-b4f652ad-4588dea3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:52.879987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3e8dfc-afa20eb8-b4f652ad-4588dea3_0] Write session will restart in 0.008398s
2025-09-30T14:52:52.880020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3e8dfc-afa20eb8-b4f652ad-4588dea3_0] Write session: Do CDS request
2025-09-30T14:52:52.880026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3e8dfc-afa20eb8-b4f652ad-4588dea3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:52.887481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:52.888946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:52.889147Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:52.889160Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:52.889171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:52.889228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:52.889266Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895327352358634:6659]
2025-09-30T14:52:52.889789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3e8dfc-afa20eb8-b4f652ad-4588dea3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:52.889860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:52.889887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 989
2025-09-30T14:52:52.889937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:52.890010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 989 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:52.890053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 989 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:52.890064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=989 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:52.890068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:52.890245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:52.890289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:52.890472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 989 sessionId:  describe result for acl check
2025-09-30T14:52:52.890507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:52.890513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:52.890515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:52.890521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895327442105580:5129] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:52.890625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:52.890689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:52.890695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:52.890697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:52.890698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:52.890699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:52.890701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:52.890702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:52.890703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:52.890704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:52.890706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:52.890707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.890708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.890709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.890711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:52.890712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:52.890717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:52.890728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:52.890732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:52.890737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:52.890742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:52.890747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:52.890752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:52.890756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:52.890761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:52.890766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:52.890770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.890775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.890780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.890784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:52.890789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:52.890797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:52.890805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:52.890811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:52.890818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:52.890822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:52.890830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:52.890837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:52.890843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:52.890849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:52.890854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:52.890861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:52.890866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:52.890870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:52.890875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:52.890880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:52.890885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:52.890890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:52.890898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:52.890903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:52.890908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:52.890919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.890925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.890929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.890933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.890937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.890940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.890945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:52.890956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:52.890961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:52.890966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:52.891016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:52.891063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895327442105580:5129] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:52.893136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895327442105580:5129] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:52.896286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895327442105580:5129] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:52.896306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895327442105580:5129] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:52.896310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895327442105580:5129] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:52.896318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 989 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:52.896457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:52.897297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:52.897313Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:52.897316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:52.897322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:52.897329Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 988 [2:7555895327352358634:6659]
2025-09-30T14:52:52.897347Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:52.897361Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:52.897363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:52.897366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:52.897368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:52.897383Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:52.897389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:52.897395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:52.897448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.897457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.897459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.897462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:52.897464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:52.897528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:52.897536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.897549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:52.897561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:52.897581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:52.897603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895327442105617:5129], now have 1 active actors on pipe
2025-09-30T14:52:52.897612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895327442105546:2454], now have 1 active actors on pipe
2025-09-30T14:52:52.897618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895327352358629:6659]
2025-09-30T14:52:52.897620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895327352358629:6659]
2025-09-30T14:52:52.897621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895327352358629:6659]
2025-09-30T14:52:52.897637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:52.897650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:52.897661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:52.897666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:52.897669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:52.897673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:52.897677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:52.897677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 988
2025-09-30T14:52:52.897708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895327352358629:6659]
2025-09-30T14:52:52.897716Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:52.897687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 988
2025-09-30T14:52:52.897733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:52.897741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:52.897745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:52.897777Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc148fd7-a6cd06fe-434fe64-9b8df8ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:52.897790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:52.897795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:52.897797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:52.897805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:52.897814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:52.897828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:52.897962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:52.897969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:52.897980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:52.898084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 989 partition: 0 MaxSeqNo: 42 sessionId: src_id|dc148fd7-a6cd06fe-434fe64-9b8df8ef_0
2025-09-30T14:52:52.898412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3e8dfc-afa20eb8-b4f652ad-4588dea3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dc148fd7-a6cd06fe-434fe64-9b8df8ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:52.901095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc148fd7-a6cd06fe-434fe64-9b8df8ef_0] Write session: try to update token
2025-09-30T14:52:52.901111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc148fd7-a6cd06fe-434fe64-9b8df8ef_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:52.909923Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:52.909941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:52.909944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:52.909949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:52.909961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895327352358629:6659]
2025-09-30T14:52:52.909965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895327352358629:6659]
2025-09-30T14:52:52.909969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895327352358629:6659]
2025-09-30T14:52:52.910017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:52.910025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:52.910027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:52.910031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:52.910039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:52.910055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:52.910180Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:52.915728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 989 sessionId: src_id|dc148fd7-a6cd06fe-434fe64-9b8df8ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:52.918411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:52.979911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895327442105625:7731]
2025-09-30T14:52:52.980203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 988, pipe: [1:7555895327442105625:7731]
2025-09-30T14:52:53.021855Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:53.022411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:53.022427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:53.022479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895327442105625:7731], now have 1 active actors on pipe
2025-09-30T14:52:53.022704Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:53.022745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:53.022796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:53.022881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 989 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dc148fd7-a6cd06fe-434fe64-9b8df8ef_0
2025-09-30T14:52:53.022982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895327442105625:7731]
2025-09-30T14:52:53.023059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 989 sessionId: src_id|dc148fd7-a6cd06fe-434fe64-9b8df8ef_0 is DEAD
2025-09-30T14:52:53.023194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc148fd7-a6cd06fe-434fe64-9b8df8ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:53.023203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc148fd7-a6cd06fe-434fe64-9b8df8ef_0] Write session will restart in 0.005912s
2025-09-30T14:52:53.023237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc148fd7-a6cd06fe-434fe64-9b8df8ef_0] Write session: Do CDS request
2025-09-30T14:52:53.023256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc148fd7-a6cd06fe-434fe64-9b8df8ef_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:53.030737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc148fd7-a6cd06fe-434fe64-9b8df8ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:53.030837Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:53.030857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 990
2025-09-30T14:52:53.030977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 990 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:53.031009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 990 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:53.031015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=990 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:53.031018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:53.031475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 990 sessionId:  describe result for acl check
2025-09-30T14:52:53.031511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:53.031518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:53.031520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:53.031526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895331737072959:5128] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:53.032083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895331737072959:5128] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:53.031734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:53.033294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:53.033487Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:53.033497Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:53.033507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:53.033562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:53.033601Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895331647326001:6661]
2025-09-30T14:52:53.034087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895331737072959:5128] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:53.034223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:53.034543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:53.034614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:53.034990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:53.035064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:53.035070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:53.035071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:53.035073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:53.035074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:53.035075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:53.035077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:53.035089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:53.035091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:53.035092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:53.035093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.035094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.035095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.035097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:53.035098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:53.035105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:53.035115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:53.035120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:53.035124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:53.035129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:53.035133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:53.035137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:53.035142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:53.035146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:53.035151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:53.035155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.035159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.035162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.035166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:53.035172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:53.035179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:53.035187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:53.035192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:53.035197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:53.035202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:53.035206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:53.035211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:53.035217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:53.035222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:53.035228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:53.035237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:53.035262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:53.035266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:53.035270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:53.035277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:53.035282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:53.035287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:53.035292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:53.035296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:53.035301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:53.035306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.035311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.035315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.035319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.035324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.035329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.035333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:53.035338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:53.035342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:53.035347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:53.035391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:53.041366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895331737072959:5128] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:53.041400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895331737072959:5128] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:53.041404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895331737072959:5128] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:53.041413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 990 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:53.041704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:53.042817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:53.042838Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:53.042841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:53.042844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:53.042852Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 989 [2:7555895331647326001:6661]
2025-09-30T14:52:53.042869Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:53.042883Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:53.042886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:53.042889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:53.042892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:53.042907Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:53.042917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:53.042924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:53.042982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.042990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.042992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.042995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:53.042998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:53.043064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:53.043071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.043083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.043099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.043121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:53.043140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895331737073002:5128], now have 1 active actors on pipe
2025-09-30T14:52:53.043143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895331737072927:2454], now have 1 active actors on pipe
2025-09-30T14:52:53.043150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895331647325996:6661]
2025-09-30T14:52:53.043152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895331647325996:6661]
2025-09-30T14:52:53.043154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895331647325996:6661]
2025-09-30T14:52:53.043168Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:53.043181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:53.043182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:53.043185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:53.043188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:53.043201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:53.043204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:53.043225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 989
2025-09-30T14:52:53.043237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 989
2025-09-30T14:52:53.043239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895331647325996:6661]
2025-09-30T14:52:53.043268Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:53.043284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:53.043295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:53.043300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:53.043335Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9fd56e03-ad34830a-2d78453b-f8641ea2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:53.043347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:53.043351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:53.043353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:53.043362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:53.043371Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:53.043395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:53.043582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:53.043596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:53.043631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:53.043743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 990 partition: 0 MaxSeqNo: 42 sessionId: src_id|9fd56e03-ad34830a-2d78453b-f8641ea2_0
2025-09-30T14:52:53.044065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc148fd7-a6cd06fe-434fe64-9b8df8ef_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9fd56e03-ad34830a-2d78453b-f8641ea2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:53.046873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd56e03-ad34830a-2d78453b-f8641ea2_0] Write session: try to update token
2025-09-30T14:52:53.046893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd56e03-ad34830a-2d78453b-f8641ea2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:53.055577Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:53.055595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:53.055597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:53.055600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:53.055610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895331647325996:6661]
2025-09-30T14:52:53.055613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895331647325996:6661]
2025-09-30T14:52:53.055618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895331647325996:6661]
2025-09-30T14:52:53.055654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:53.055661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.055664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:53.055669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:53.055676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:53.055680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:53.055795Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:53.061469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 990 sessionId: src_id|9fd56e03-ad34830a-2d78453b-f8641ea2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:53.064312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:53.123329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895331737073024:7731]
2025-09-30T14:52:53.123736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 989, pipe: [1:7555895331737073024:7731]
2025-09-30T14:52:53.169449Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:53.169886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:53.169902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:53.169937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895331737073024:7731], now have 1 active actors on pipe
2025-09-30T14:52:53.170159Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:53.170631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd56e03-ad34830a-2d78453b-f8641ea2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:53.170656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd56e03-ad34830a-2d78453b-f8641ea2_0] Write session will restart in 0.006316s
2025-09-30T14:52:53.170679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd56e03-ad34830a-2d78453b-f8641ea2_0] Write session: Do CDS request
2025-09-30T14:52:53.170685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd56e03-ad34830a-2d78453b-f8641ea2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:53.170181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:53.170206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:53.170213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:53.170264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895331737073024:7731]
2025-09-30T14:52:53.170287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 990 reason: error at write: Disconnected sessionId: src_id|9fd56e03-ad34830a-2d78453b-f8641ea2_0
2025-09-30T14:52:53.170441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 990 sessionId: src_id|9fd56e03-ad34830a-2d78453b-f8641ea2_0 is DEAD
2025-09-30T14:52:53.177768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd56e03-ad34830a-2d78453b-f8641ea2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:53.177900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:53.177921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 991
2025-09-30T14:52:53.178049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 991 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:53.178082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 991 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:53.178087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=991 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:53.178090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:53.178580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 991 sessionId:  describe result for acl check
2025-09-30T14:52:53.178626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:53.178634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:53.178636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:53.178642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895331737073069:5120] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:53.178994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:53.179177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895331737073069:5120] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:53.181708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895331737073069:5120] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:53.182331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:53.182538Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:53.182551Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:53.182563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:53.182629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:53.182674Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895331647326088:6665]
2025-09-30T14:52:53.183379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:53.183840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:53.183920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:53.184271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:53.184354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:53.184360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:53.184361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:53.184363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:53.184364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:53.184366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:53.184367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:53.184368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:53.184370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:53.184371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:53.184372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.184373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.184374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.184375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:53.184377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:53.184383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:53.184394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:53.184398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:53.184403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:53.184407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:53.184411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:53.184423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895331737073069:5120] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:53.184417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:53.184439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895331737073069:5120] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:53.184443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895331737073069:5120] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:53.184422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:53.184451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 991 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:53.184425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:53.184430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:53.184434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.184438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.184443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.184461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:53.184465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:53.184474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:53.184482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:53.184488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:53.184493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:53.184498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:53.184504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:53.184508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:53.184513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:53.184519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:53.184524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:53.184529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:53.184535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:53.184540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:53.184545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:53.184550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:53.184555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:53.184560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:53.184566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:53.184570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:53.184576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:53.184582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.184588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.184603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.184614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.184619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.184625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.184629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:53.184635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:53.184640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:53.184646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:53.184690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:53.190321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:53.191288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:53.191303Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:53.191306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:53.191310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:53.191318Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 990 [2:7555895331647326088:6665]
2025-09-30T14:52:53.191335Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:53.191353Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:53.191361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:53.191364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:53.191367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:53.191383Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:53.191390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:53.191399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:53.191462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.191474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.191476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.191479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:53.191483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:53.191549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:53.191558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.191571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.191587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.191610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:53.191634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895331737073026:2454], now have 1 active actors on pipe
2025-09-30T14:52:53.191639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895331737073107:5120], now have 1 active actors on pipe
2025-09-30T14:52:53.191646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895331647326082:6665]
2025-09-30T14:52:53.191649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895331647326082:6665]
2025-09-30T14:52:53.191651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895331647326082:6665]
2025-09-30T14:52:53.191665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:53.191688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:53.191690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:53.191694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:53.191699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:53.191704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:53.191707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:53.191741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895331647326082:6665]
2025-09-30T14:52:53.191749Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:53.191761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:53.191729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 990
2025-09-30T14:52:53.191809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 990
2025-09-30T14:52:53.191942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:53.191956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:53.191983Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|724306ac-29ed8335-1429ed7e-df7e24ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:53.191996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:53.192015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:53.192018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:53.192028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:53.192039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:53.192059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:53.192238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:53.192252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:53.192274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:53.192385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 991 partition: 0 MaxSeqNo: 42 sessionId: src_id|724306ac-29ed8335-1429ed7e-df7e24ed_0
2025-09-30T14:52:53.192767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd56e03-ad34830a-2d78453b-f8641ea2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|724306ac-29ed8335-1429ed7e-df7e24ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:53.195771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|724306ac-29ed8335-1429ed7e-df7e24ed_0] Write session: try to update token
2025-09-30T14:52:53.195791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|724306ac-29ed8335-1429ed7e-df7e24ed_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:53.206751Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:53.206771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:53.206774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:53.206776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:53.206785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895331647326082:6665]
2025-09-30T14:52:53.206790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895331647326082:6665]
2025-09-30T14:52:53.206794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895331647326082:6665]
2025-09-30T14:52:53.206837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:53.206843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.206846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:53.206976Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:53.210472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 991 sessionId: src_id|724306ac-29ed8335-1429ed7e-df7e24ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:53.211306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:53.211330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:53.211335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:53.213282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:53.270231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895331737073117:7731]
2025-09-30T14:52:53.270539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 990, pipe: [1:7555895331737073117:7731]
2025-09-30T14:52:53.321115Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:53.321486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:53.321503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:53.321541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895331737073117:7731], now have 1 active actors on pipe
2025-09-30T14:52:53.321743Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:53.323499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:53.323522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:53.323526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:53.323562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895331737073117:7731]
2025-09-30T14:52:53.323595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 991 reason: error at write: Disconnected sessionId: src_id|724306ac-29ed8335-1429ed7e-df7e24ed_0
2025-09-30T14:52:53.323760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 991 sessionId: src_id|724306ac-29ed8335-1429ed7e-df7e24ed_0 is DEAD
2025-09-30T14:52:53.324144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|724306ac-29ed8335-1429ed7e-df7e24ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:53.324153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|724306ac-29ed8335-1429ed7e-df7e24ed_0] Write session will restart in 0.007278s
2025-09-30T14:52:53.324176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|724306ac-29ed8335-1429ed7e-df7e24ed_0] Write session: Do CDS request
2025-09-30T14:52:53.324192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|724306ac-29ed8335-1429ed7e-df7e24ed_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:53.332781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|724306ac-29ed8335-1429ed7e-df7e24ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:53.332881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:53.332900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 992
2025-09-30T14:52:53.333026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 992 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:53.333060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 992 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:53.333065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=992 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:53.333068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:53.333535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 992 sessionId:  describe result for acl check
2025-09-30T14:52:53.333572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:53.333583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:53.333585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:53.333591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895331737073153:5112] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:53.333954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:53.334119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895331737073153:5112] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:53.335830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:53.336019Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:53.336030Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:53.336035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895331737073153:5112] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:53.336041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:53.336097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:53.336138Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895331647326161:6667]
2025-09-30T14:52:53.336759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:53.337109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:53.337163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:53.337499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:53.337576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:53.337586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:53.337587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:53.337588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:53.337589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:53.337591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:53.337592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:53.337593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:53.337594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:53.337595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:53.337597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.337598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.337599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.337600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:53.337601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:53.337606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:53.337616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:53.337620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:53.337624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:53.337628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:53.337632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:53.337636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:53.337640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:53.337644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:53.337648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:53.337652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.337656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.337660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.337665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:53.337669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:53.337678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:53.337685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:53.337693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:53.337698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:53.337704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:53.337709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:53.337714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:53.337719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:53.337723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:53.337728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:53.337733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:53.337738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:53.337742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:53.337747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:53.337751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:53.337756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:53.337761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:53.337766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:53.337770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:53.337775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:53.337779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.337784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.337789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.337795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.337802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.337807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.337811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:53.337821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:53.337826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:53.337832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:53.337877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:53.338533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895331737073153:5112] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:53.338550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895331737073153:5112] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:53.338553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895331737073153:5112] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:53.338561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 992 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:53.343340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:53.344253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:53.344271Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:53.344276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:53.344280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:53.344287Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 991 [2:7555895331647326161:6667]
2025-09-30T14:52:53.344304Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:53.344320Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:53.344324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:53.344327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:53.344329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:53.344345Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:53.344351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:53.344361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:53.344424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.344426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.344429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.344432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:53.344435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:53.344503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:53.344505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.344519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.344531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.344549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:53.344566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895331737073193:5112], now have 1 active actors on pipe
2025-09-30T14:52:53.344572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895331647326155:6667]
2025-09-30T14:52:53.344576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895331647326155:6667]
2025-09-30T14:52:53.344578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895331647326155:6667]
2025-09-30T14:52:53.344684Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 991
2025-09-30T14:52:53.344737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 991
2025-09-30T14:52:53.344592Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:53.344604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895331737073119:2454], now have 1 active actors on pipe
2025-09-30T14:52:53.344603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:53.344607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:53.344609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:53.344612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:53.344624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:53.344627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:53.344658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895331647326155:6667]
2025-09-30T14:52:53.344665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:53.344672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:53.344853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:53.344857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:53.344879Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5eb82e2-8e1fcebb-d2ce92ec-fd20ec34_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:53.344886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:53.344890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:53.344892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:53.344902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:53.344912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:53.344924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:53.345299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:53.345311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:53.345331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:53.345519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 992 partition: 0 MaxSeqNo: 42 sessionId: src_id|5eb82e2-8e1fcebb-d2ce92ec-fd20ec34_0
2025-09-30T14:52:53.345895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|724306ac-29ed8335-1429ed7e-df7e24ed_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5eb82e2-8e1fcebb-d2ce92ec-fd20ec34_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:53.348990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5eb82e2-8e1fcebb-d2ce92ec-fd20ec34_0] Write session: try to update token
2025-09-30T14:52:53.349013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5eb82e2-8e1fcebb-d2ce92ec-fd20ec34_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:53.356875Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:53.356897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:53.356906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895331647326155:6667]
2025-09-30T14:52:53.356948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:53.356948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:53.357119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:53.357261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:53.357407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:53.357552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:53.357743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:53.357782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:53.364425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 992 sessionId: src_id|5eb82e2-8e1fcebb-d2ce92ec-fd20ec34_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:53.367032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:53.367882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:53.367912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:53.367933Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:53.367936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:53.367938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:53.367940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:53.367950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895331647326155:6667]
2025-09-30T14:52:53.367954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895331647326155:6667]
2025-09-30T14:52:53.367958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895331647326155:6667]
2025-09-30T14:52:53.368005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:53.368010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:53.368018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:53.368021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.368021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:53.368026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:53.368167Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:53.423853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895331737073200:7731]
2025-09-30T14:52:53.424145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 991, pipe: [1:7555895331737073200:7731]
2025-09-30T14:52:53.484342Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:53.484636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:53.484671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895331737073200:7731], now have 1 active actors on pipe
2025-09-30T14:52:53.484743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:53.484817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895331737073200:7731]
2025-09-30T14:52:53.484846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:53.484849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:53.484855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:53.484930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 992 reason: error at write: Disconnected sessionId: src_id|5eb82e2-8e1fcebb-d2ce92ec-fd20ec34_0
2025-09-30T14:52:53.485057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 992 sessionId: src_id|5eb82e2-8e1fcebb-d2ce92ec-fd20ec34_0 is DEAD
2025-09-30T14:52:53.485202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5eb82e2-8e1fcebb-d2ce92ec-fd20ec34_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:53.485213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5eb82e2-8e1fcebb-d2ce92ec-fd20ec34_0] Write session will restart in 0.007468s
2025-09-30T14:52:53.485234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5eb82e2-8e1fcebb-d2ce92ec-fd20ec34_0] Write session: Do CDS request
2025-09-30T14:52:53.485239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5eb82e2-8e1fcebb-d2ce92ec-fd20ec34_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:53.493253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:53.493761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5eb82e2-8e1fcebb-d2ce92ec-fd20ec34_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:53.493841Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:53.493861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 993
2025-09-30T14:52:53.494029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 993 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:53.494066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 993 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:53.494076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=993 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:53.494081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:53.494549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 993 sessionId:  describe result for acl check
2025-09-30T14:52:53.494587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:53.494591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:53.494592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:53.494599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895331737073240:5103] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:53.495074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:53.495111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895331737073240:5103] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:53.495277Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:53.495288Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:53.495298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:53.495354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:53.495391Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895331647326234:6669]
2025-09-30T14:52:53.496016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:53.496308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:53.496362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:53.496615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895331737073240:5103] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:53.496694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:53.496775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:53.496782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:53.496783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:53.496784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:53.496786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:53.496787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:53.496788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:53.496789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:53.496791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:53.496792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:53.496793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.496794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.496796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.496797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:53.496798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:53.496804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:53.496814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:53.496819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:53.496823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:53.496828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:53.496832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:53.496836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:53.496840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:53.496845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:53.496850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:53.496854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.496858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.496863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.496867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:53.496871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:53.496878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:53.496886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:53.496892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:53.496898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:53.496903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:53.496908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:53.496913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:53.496918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:53.496928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:53.496933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:53.496942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:53.496947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:53.496956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:53.496961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:53.496966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:53.496972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:53.496978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:53.496990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:53.496995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:53.497000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:53.497005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.497010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.497014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.497021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.497026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.497036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.497041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:53.497046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:53.497051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:53.497056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:53.497104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:53.502209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895331737073240:5103] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:53.502231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895331737073240:5103] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:53.502239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895331737073240:5103] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:53.502248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 993 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:53.502504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:53.503362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:53.503377Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:53.503380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:53.503384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:53.503391Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 992 [2:7555895331647326234:6669]
2025-09-30T14:52:53.503409Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:53.503428Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:53.503431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:53.503434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:53.503436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:53.503452Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:53.503458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:53.503466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:53.503526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.503533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.503536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.503539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:53.503542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:53.503625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:53.503631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.503645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.503658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.503675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:53.503699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895331737073279:5103], now have 1 active actors on pipe
2025-09-30T14:52:53.503707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895331737073202:2454], now have 1 active actors on pipe
2025-09-30T14:52:53.503713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895331647326229:6669]
2025-09-30T14:52:53.503715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895331647326229:6669]
2025-09-30T14:52:53.503717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895331647326229:6669]
2025-09-30T14:52:53.503730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:53.503749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:53.503756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:53.503762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:53.503764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:53.503773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:53.503776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:53.503812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895331647326229:6669]
2025-09-30T14:52:53.503822Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:53.503856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:53.503982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:53.503993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:53.503909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 992
2025-09-30T14:52:53.503953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 992
2025-09-30T14:52:53.504020Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f21a9c57-84090ca1-44012047-4f192b61_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:53.504031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:53.504034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:53.504036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:53.504046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:53.504060Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:53.504078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:53.504298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:53.504306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:53.504321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:53.504392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 993 partition: 0 MaxSeqNo: 42 sessionId: src_id|f21a9c57-84090ca1-44012047-4f192b61_0
2025-09-30T14:52:53.504727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5eb82e2-8e1fcebb-d2ce92ec-fd20ec34_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f21a9c57-84090ca1-44012047-4f192b61_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:53.507503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f21a9c57-84090ca1-44012047-4f192b61_0] Write session: try to update token
2025-09-30T14:52:53.507526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f21a9c57-84090ca1-44012047-4f192b61_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:53.516193Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:53.516216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:53.516219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:53.516221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:53.516231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895331647326229:6669]
2025-09-30T14:52:53.516236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895331647326229:6669]
2025-09-30T14:52:53.516241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895331647326229:6669]
2025-09-30T14:52:53.516281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:53.516286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:53.516288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.516291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:53.516294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:53.516298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:53.516433Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:53.522744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 993 sessionId: src_id|f21a9c57-84090ca1-44012047-4f192b61_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:53.525515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:53.585104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895331737073286:7731]
2025-09-30T14:52:53.585396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 992, pipe: [1:7555895331737073286:7731]
2025-09-30T14:52:53.629948Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:53.630304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:53.630320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:53.630358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895331737073286:7731], now have 1 active actors on pipe
2025-09-30T14:52:53.630607Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:53.630662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895331737073286:7731]
2025-09-30T14:52:53.630663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:53.630668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:53.630700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:53.630728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 993 reason: error at write: Disconnected sessionId: src_id|f21a9c57-84090ca1-44012047-4f192b61_0
2025-09-30T14:52:53.630917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 993 sessionId: src_id|f21a9c57-84090ca1-44012047-4f192b61_0 is DEAD
2025-09-30T14:52:53.631046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f21a9c57-84090ca1-44012047-4f192b61_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:53.631056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f21a9c57-84090ca1-44012047-4f192b61_0] Write session will restart in 0.007899s
2025-09-30T14:52:53.631079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f21a9c57-84090ca1-44012047-4f192b61_0] Write session: Do CDS request
2025-09-30T14:52:53.631084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f21a9c57-84090ca1-44012047-4f192b61_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:53.639709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f21a9c57-84090ca1-44012047-4f192b61_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:53.639769Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:53.639788Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 994
2025-09-30T14:52:53.639873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:53.639953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 994 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:53.639999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 994 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:53.640009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=994 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:53.640013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:53.640387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 994 sessionId:  describe result for acl check
2025-09-30T14:52:53.640426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:53.640432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:53.640434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:53.640440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895331737073325:5099] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:53.640953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895331737073325:5099] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:53.641394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:53.641584Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:53.641595Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:53.641615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:53.641676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:53.641718Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895331647326310:6672]
2025-09-30T14:52:53.642345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:53.642751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895331737073325:5099] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:53.642742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:53.642807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:53.643147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:53.643215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:53.643217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:53.643218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:53.643219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:53.643220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:53.643222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:53.643223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:53.643224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:53.643226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:53.643227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:53.643228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.643229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.643230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.643231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:53.643233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:53.643240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:53.643270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:53.643274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:53.643279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:53.643283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:53.643287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:53.643291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:53.643295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:53.643299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:53.643304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:53.643307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.643315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.643319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.643323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:53.643327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:53.643333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:53.643342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:53.643348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:53.643354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:53.643358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:53.643364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:53.643369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:53.643374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:53.643379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:53.643385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:53.643389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:53.643393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:53.643399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:53.643404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:53.643408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:53.643413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:53.643417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:53.643424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:53.643428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:53.643434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:53.643439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.643443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.643447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.643452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.643456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.643461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.643465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:53.643472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:53.643477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:53.643481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:53.643526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:53.648680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895331737073325:5099] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:53.648698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895331737073325:5099] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:53.648702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895331737073325:5099] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:53.648710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 994 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:53.649008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:53.649922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:53.649940Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:53.649942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:53.649946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:53.649953Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 993 [2:7555895331647326310:6672]
2025-09-30T14:52:53.649970Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:53.649988Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:53.649992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:53.649995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:53.649997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:53.650012Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:53.650026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:53.650033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:53.650093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.650102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.650104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.650108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:53.650110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:53.650278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:53.650287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.650300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.650316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.650337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:53.650359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895331737073287:2454], now have 1 active actors on pipe
2025-09-30T14:52:53.650367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895331737073364:5099], now have 1 active actors on pipe
2025-09-30T14:52:53.650344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 993
2025-09-30T14:52:53.650375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895331647326305:6672]
2025-09-30T14:52:53.650345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 993
2025-09-30T14:52:53.650381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895331647326305:6672]
2025-09-30T14:52:53.650383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895331647326305:6672]
2025-09-30T14:52:53.650397Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:53.650415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:53.650434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:53.650437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:53.650443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:53.650457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:53.650459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:53.650467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895331647326305:6672]
2025-09-30T14:52:53.650470Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:53.650478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:53.650493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:53.650499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:53.650530Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c589ef91-a9fe5863-fb18c62f-2271ce1c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:53.650547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:53.650550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:53.650552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:53.650561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:53.650570Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:53.650600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:53.650792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:53.650800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:53.650814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:53.650914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 994 partition: 0 MaxSeqNo: 42 sessionId: src_id|c589ef91-a9fe5863-fb18c62f-2271ce1c_0
2025-09-30T14:52:53.651280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f21a9c57-84090ca1-44012047-4f192b61_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c589ef91-a9fe5863-fb18c62f-2271ce1c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:53.654149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c589ef91-a9fe5863-fb18c62f-2271ce1c_0] Write session: try to update token
2025-09-30T14:52:53.654170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c589ef91-a9fe5863-fb18c62f-2271ce1c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:53.662800Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:53.662823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:53.662825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:53.662827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:53.662840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895331647326305:6672]
2025-09-30T14:52:53.662845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895331647326305:6672]
2025-09-30T14:52:53.662849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895331647326305:6672]
2025-09-30T14:52:53.662890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:53.662899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.662899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:53.662906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:53.662906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:53.662911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:53.663043Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:53.673901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 994 sessionId: src_id|c589ef91-a9fe5863-fb18c62f-2271ce1c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:53.676712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:53.731000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895331737073384:7731]
2025-09-30T14:52:53.731356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 993, pipe: [1:7555895331737073384:7731]
2025-09-30T14:52:53.779966Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:53.780300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:53.780316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:53.780335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895331737073384:7731], now have 1 active actors on pipe
2025-09-30T14:52:53.780599Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:53.780612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:53.780616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:53.780653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895331737073384:7731]
2025-09-30T14:52:53.780699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 994 reason: error at write: Disconnected sessionId: src_id|c589ef91-a9fe5863-fb18c62f-2271ce1c_0
2025-09-30T14:52:53.780776Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:53.780886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 994 sessionId: src_id|c589ef91-a9fe5863-fb18c62f-2271ce1c_0 is DEAD
2025-09-30T14:52:53.781033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c589ef91-a9fe5863-fb18c62f-2271ce1c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:53.781059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c589ef91-a9fe5863-fb18c62f-2271ce1c_0] Write session will restart in 0.006436s
2025-09-30T14:52:53.781083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c589ef91-a9fe5863-fb18c62f-2271ce1c_0] Write session: Do CDS request
2025-09-30T14:52:53.781093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c589ef91-a9fe5863-fb18c62f-2271ce1c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:53.788725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c589ef91-a9fe5863-fb18c62f-2271ce1c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:53.788835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:53.788854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 995
2025-09-30T14:52:53.789008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 995 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:53.789059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 995 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:53.789064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=995 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:53.789068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:53.789470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 995 sessionId:  describe result for acl check
2025-09-30T14:52:53.789504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:53.789507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:53.789509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:53.789514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895331737073431:5082] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:53.789489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:53.790052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895331737073431:5082] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:53.791443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:53.791659Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:53.791670Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:53.791683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:53.792216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895331737073431:5082] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:53.791749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:53.791790Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895331647326422:6686]
2025-09-30T14:52:53.792391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:53.792789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:53.792866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:53.793234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:53.793308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:53.793313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:53.793314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:53.793317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:53.793318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:53.793319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:53.793320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:53.793321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:53.793322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:53.793323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:53.793324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.793325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.793326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.793328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:53.793329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:53.793347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:53.793358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:53.793363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:53.793367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:53.793371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:53.793375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:53.793378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:53.793382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:53.793385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:53.793391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:53.793395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.793399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.793403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.793407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:53.793411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:53.793419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:53.793427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:53.793433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:53.793439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:53.793456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:53.793461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:53.793465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:53.793471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:53.793475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:53.793480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:53.793484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:53.793489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:53.793493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:53.793497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:53.793501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:53.793506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:53.793510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:53.793515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:53.793521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:53.793525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:53.793529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.793533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.793537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.793543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.793547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.793552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.793556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:53.793561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:53.793567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:53.793578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:53.793621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:53.798295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895331737073431:5082] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:53.798314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895331737073431:5082] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:53.798318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895331737073431:5082] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:53.798326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 995 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:53.799160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:53.800102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:53.800121Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:53.800123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:53.800127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:53.800134Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 994 [2:7555895331647326422:6686]
2025-09-30T14:52:53.800152Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:53.800171Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:53.800174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:53.800178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:53.800179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:53.800194Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:53.800201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:53.800208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:53.800268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.800269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.800271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.800274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:53.800277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:53.800350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:53.800353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.800365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.800377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.800395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:53.800413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895331737073394:2454], now have 1 active actors on pipe
2025-09-30T14:52:53.800420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895331647326417:6686]
2025-09-30T14:52:53.800422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895331647326417:6686]
2025-09-30T14:52:53.800424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895331647326417:6686]
2025-09-30T14:52:53.800436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:53.800453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895331737073471:5082], now have 1 active actors on pipe
2025-09-30T14:52:53.800452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:53.800456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:53.800458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:53.800465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:53.800480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:53.800488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:53.800518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895331647326417:6686]
2025-09-30T14:52:53.800529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:53.800538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:53.800561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 994
2025-09-30T14:52:53.800596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 994
2025-09-30T14:52:53.800649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:53.800661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:53.800685Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7849081-74ca43-b730d9f2-dc193c9e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:53.800697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:53.800701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:53.800703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:53.800712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:53.800725Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:53.800743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:53.800964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:53.800986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:53.801008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:53.801107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 995 partition: 0 MaxSeqNo: 42 sessionId: src_id|7849081-74ca43-b730d9f2-dc193c9e_0
2025-09-30T14:52:53.801475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c589ef91-a9fe5863-fb18c62f-2271ce1c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7849081-74ca43-b730d9f2-dc193c9e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:53.804258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7849081-74ca43-b730d9f2-dc193c9e_0] Write session: try to update token
2025-09-30T14:52:53.804277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7849081-74ca43-b730d9f2-dc193c9e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:53.812862Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:53.812880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:53.812883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:53.812888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:53.812898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895331647326417:6686]
2025-09-30T14:52:53.812902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895331647326417:6686]
2025-09-30T14:52:53.812909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895331647326417:6686]
2025-09-30T14:52:53.812951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:53.812957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.812963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:53.812964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:53.812972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:53.812976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:53.813099Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:53.819417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 995 sessionId: src_id|7849081-74ca43-b730d9f2-dc193c9e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:53.822156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:53.880998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895331737073479:7731]
2025-09-30T14:52:53.881333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 994, pipe: [1:7555895331737073479:7731]
2025-09-30T14:52:53.928720Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:53.929115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:53.929130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:53.929168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895331737073479:7731], now have 1 active actors on pipe
2025-09-30T14:52:53.929407Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:53.929445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895331737073479:7731]
2025-09-30T14:52:53.929480Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:53.929512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:53.929598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 995 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7849081-74ca43-b730d9f2-dc193c9e_0
2025-09-30T14:52:53.929765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 995 sessionId: src_id|7849081-74ca43-b730d9f2-dc193c9e_0 is DEAD
2025-09-30T14:52:53.929920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7849081-74ca43-b730d9f2-dc193c9e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:53.929928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7849081-74ca43-b730d9f2-dc193c9e_0] Write session will restart in 0.009208s
2025-09-30T14:52:53.929944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7849081-74ca43-b730d9f2-dc193c9e_0] Write session: Do CDS request
2025-09-30T14:52:53.929948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7849081-74ca43-b730d9f2-dc193c9e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:53.937502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:53.939142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:53.939365Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:53.939376Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:53.939387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:53.939442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:53.939484Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895331647326500:6688]
2025-09-30T14:52:53.940115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:53.940557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:53.940630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:53.940752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7849081-74ca43-b730d9f2-dc193c9e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:53.940838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:53.940856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 996
2025-09-30T14:52:53.940968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 996 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:53.940957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:53.940996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 996 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:53.941013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=996 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:53.941022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:53.941033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:53.941039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:53.941040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:53.941041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:53.941042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:53.941043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:53.941044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:53.941045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:53.941046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:53.941047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:53.941048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.941049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.941050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.941050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:53.941051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:53.941055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:53.941061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:53.941063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:53.941066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:53.941069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:53.941071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:53.941073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:53.941076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:53.941078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:53.941081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:53.941083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.941086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.941089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.941091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:53.941093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:53.941100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:53.941104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:53.941108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:53.941111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:53.941114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:53.941117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:53.941121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:53.941123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:53.941126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:53.941130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:53.941132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:53.941135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:53.941138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:53.941140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:53.941142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:53.941145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:53.941148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:53.941150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:53.941153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:53.941156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:53.941158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.941162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.941164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.941167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.941170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.941173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.941175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:53.941180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:53.941182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:53.941185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:53.941209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:53.941388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 996 sessionId:  describe result for acl check
2025-09-30T14:52:53.941420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:53.941423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:53.941424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:53.941429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895331737073521:5071] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:53.941934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895331737073521:5071] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:53.943827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895331737073521:5071] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:53.946619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:53.946654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895331737073521:5071] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:53.946668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895331737073521:5071] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:53.946672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895331737073521:5071] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:53.946680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 996 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:53.947531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:53.947551Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:53.947554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:53.947558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:53.947564Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 995 [2:7555895331647326500:6688]
2025-09-30T14:52:53.947579Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:53.947598Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:53.947607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:53.947610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:53.947612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:53.947628Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:53.947638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:53.947645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:53.947701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.947709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.947711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.947714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:53.947717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:53.947780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:53.947787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.947800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:53.947816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:53.947837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:53.947859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895331737073480:2454], now have 1 active actors on pipe
2025-09-30T14:52:53.947867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895331737073557:5071], now have 1 active actors on pipe
2025-09-30T14:52:53.947874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895331647326495:6688]
2025-09-30T14:52:53.947876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895331647326495:6688]
2025-09-30T14:52:53.947878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895331647326495:6688]
2025-09-30T14:52:53.947897Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:53.947916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:53.947929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:53.947932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:53.947936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:53.947941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:53.947945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:53.947942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 995
2025-09-30T14:52:53.947943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 995
2025-09-30T14:52:53.947967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895331647326495:6688]
2025-09-30T14:52:53.947977Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:53.947979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:53.948003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:53.948013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:53.948048Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34843d7a-11f550af-3c2c8da3-f7f729a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:53.948061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:53.948064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:53.948066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:53.948076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:53.948089Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:53.948114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:53.948279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:53.948288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:53.948303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:53.948407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 996 partition: 0 MaxSeqNo: 42 sessionId: src_id|34843d7a-11f550af-3c2c8da3-f7f729a_0
2025-09-30T14:52:53.948757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7849081-74ca43-b730d9f2-dc193c9e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|34843d7a-11f550af-3c2c8da3-f7f729a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:53.951612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34843d7a-11f550af-3c2c8da3-f7f729a_0] Write session: try to update token
2025-09-30T14:52:53.951631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34843d7a-11f550af-3c2c8da3-f7f729a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:53.960043Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:53.960060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:53.960062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:53.960066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:53.960133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895331647326495:6688]
2025-09-30T14:52:53.960143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895331647326495:6688]
2025-09-30T14:52:53.960146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895331647326495:6688]
2025-09-30T14:52:53.960189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:53.960200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:53.960203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:53.960211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:53.960219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:53.960225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:53.960335Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:53.966598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 996 sessionId: src_id|34843d7a-11f550af-3c2c8da3-f7f729a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:53.969339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:54.029520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895336032040866:7731]
2025-09-30T14:52:54.029850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 995, pipe: [1:7555895336032040866:7731]
2025-09-30T14:52:54.073703Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:54.074053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:54.074073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:54.074115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895336032040866:7731], now have 1 active actors on pipe
2025-09-30T14:52:54.074365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:54.074385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:54.074389Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:54.074442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895336032040866:7731]
2025-09-30T14:52:54.074449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 996 reason: error at write: Disconnected sessionId: src_id|34843d7a-11f550af-3c2c8da3-f7f729a_0
2025-09-30T14:52:54.074605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 996 sessionId: src_id|34843d7a-11f550af-3c2c8da3-f7f729a_0 is DEAD
2025-09-30T14:52:54.074451Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:54.074988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34843d7a-11f550af-3c2c8da3-f7f729a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:54.074999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34843d7a-11f550af-3c2c8da3-f7f729a_0] Write session will restart in 0.008171s
2025-09-30T14:52:54.075036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34843d7a-11f550af-3c2c8da3-f7f729a_0] Write session: Do CDS request
2025-09-30T14:52:54.075046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34843d7a-11f550af-3c2c8da3-f7f729a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:54.083542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:54.084779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34843d7a-11f550af-3c2c8da3-f7f729a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:54.084862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:54.084877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 997
2025-09-30T14:52:54.084983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 997 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:54.085008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 997 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:54.085012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=997 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:54.085015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:54.085255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:54.085446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 997 sessionId:  describe result for acl check
2025-09-30T14:52:54.085449Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:54.085460Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:54.085473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:54.085482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:54.085489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:54.085491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:54.085497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895336032040910:5068] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:54.085530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:54.085571Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895335942293884:6691]
2025-09-30T14:52:54.086124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895336032040910:5068] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:54.086274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:54.086810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:54.086881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:54.087209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:54.087311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:54.087318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:54.087319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:54.087320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:54.087321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:54.087322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:54.087324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:54.087325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:54.087326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:54.087327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:54.087329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.087330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.087331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.087332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:54.087333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:54.087339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:54.087349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:54.087354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:54.087360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:54.087363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:54.087367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:54.087370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:54.087375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:54.087379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:54.087384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:54.087389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.087393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.087397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.087401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:54.087405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:54.087412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:54.087420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:54.087425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:54.087431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:54.087435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:54.087440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:54.087444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:54.087449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:54.087459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:54.087464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:54.087469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:54.087473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:54.087478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:54.087483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:54.087492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:54.087497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:54.087501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:54.087506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:54.087515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:54.087524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:54.087533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.087539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.087547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.087552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.087557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.087565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.087569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:54.087574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:54.087581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:54.087590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:54.087633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:54.088268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895336032040910:5068] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:54.092845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895336032040910:5068] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:54.092868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895336032040910:5068] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:54.092871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895336032040910:5068] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:54.092880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 997 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:54.093085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:54.094131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:54.094146Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:54.094149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:54.094153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:54.094159Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 996 [2:7555895335942293884:6691]
2025-09-30T14:52:54.094174Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:54.094187Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:54.094202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:54.094205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:54.094208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:54.094224Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:54.094232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:54.094237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:54.094293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.094300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.094303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.094306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:54.094308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:54.094372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:54.094379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.094392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.094409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.094432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:54.094452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895336032040867:2454], now have 1 active actors on pipe
2025-09-30T14:52:54.094460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895336032040959:5068], now have 1 active actors on pipe
2025-09-30T14:52:54.094466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895335942293879:6691]
2025-09-30T14:52:54.094468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895335942293879:6691]
2025-09-30T14:52:54.094470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895335942293879:6691]
2025-09-30T14:52:54.094483Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:54.094496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:54.094500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:54.094507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:54.094510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:54.094515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:54.094518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:54.094552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895335942293879:6691]
2025-09-30T14:52:54.094560Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:54.094566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:54.094539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 996
2025-09-30T14:52:54.094549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 996
2025-09-30T14:52:54.094586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:54.094596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:54.094632Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4c9ddfad-409d0f3d-c049b027-87351814_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:54.094644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:54.094648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:54.094649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:54.094658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:54.094667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:54.094689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:54.094872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:54.094888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:54.094913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:54.095033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 997 partition: 0 MaxSeqNo: 42 sessionId: src_id|4c9ddfad-409d0f3d-c049b027-87351814_0
2025-09-30T14:52:54.095412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34843d7a-11f550af-3c2c8da3-f7f729a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4c9ddfad-409d0f3d-c049b027-87351814_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:54.098176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c9ddfad-409d0f3d-c049b027-87351814_0] Write session: try to update token
2025-09-30T14:52:54.098212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c9ddfad-409d0f3d-c049b027-87351814_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:54.106849Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:54.106868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:54.106874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:54.106876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:54.106885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895335942293879:6691]
2025-09-30T14:52:54.106889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895335942293879:6691]
2025-09-30T14:52:54.106896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895335942293879:6691]
2025-09-30T14:52:54.106934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:54.106938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:54.106942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.106944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:54.106945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:54.106949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:54.107086Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:54.114971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 997 sessionId: src_id|4c9ddfad-409d0f3d-c049b027-87351814_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:54.117677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:54.174424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895336032040969:7731]
2025-09-30T14:52:54.174708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 996, pipe: [1:7555895336032040969:7731]
2025-09-30T14:52:54.220635Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:54.221080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:54.221095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:54.221115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895336032040969:7731], now have 1 active actors on pipe
2025-09-30T14:52:54.221327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:54.221346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:54.221349Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:54.221356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:54.221406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 997 reason: error at write: Disconnected sessionId: src_id|4c9ddfad-409d0f3d-c049b027-87351814_0
2025-09-30T14:52:54.221409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895336032040969:7731]
2025-09-30T14:52:54.221570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 997 sessionId: src_id|4c9ddfad-409d0f3d-c049b027-87351814_0 is DEAD
2025-09-30T14:52:54.221716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c9ddfad-409d0f3d-c049b027-87351814_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:54.221737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c9ddfad-409d0f3d-c049b027-87351814_0] Write session will restart in 0.009803s
2025-09-30T14:52:54.221761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c9ddfad-409d0f3d-c049b027-87351814_0] Write session: Do CDS request
2025-09-30T14:52:54.221767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c9ddfad-409d0f3d-c049b027-87351814_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:54.229814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:54.231547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:54.231756Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:54.231765Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:54.231776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:54.231831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:54.231874Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895335942293966:6694]
2025-09-30T14:52:54.232540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:54.232810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c9ddfad-409d0f3d-c049b027-87351814_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:54.232896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:54.232916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 998
2025-09-30T14:52:54.232999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:54.233062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 998 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:54.233066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:54.233107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 998 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:54.233126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=998 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:54.233136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:54.233397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:54.233462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:54.233471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:54.233472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:54.233473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:54.233475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:54.233476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:54.233477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:54.233479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:54.233480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:54.233483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:54.233485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.233486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.233487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.233488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:54.233489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:54.233496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:54.233517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:54.233543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 998 sessionId:  describe result for acl check
2025-09-30T14:52:54.233521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:54.233525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:54.233530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:54.233533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:54.233538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:54.233542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:54.233582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:54.233546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:54.233550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:54.233554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.233558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.233562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.233566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:54.233570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:54.233590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:54.233577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:54.233585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:54.233592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:54.233592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:54.233598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895336032041013:5049] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:54.233598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:54.233602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:54.233607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:54.233612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:54.233617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:54.233622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:54.233627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:54.233633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:54.233639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:54.233643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:54.233648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:54.233653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:54.233659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:54.233665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:54.233670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:54.233675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:54.233680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:54.233685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.233689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.233693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.233699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.233703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.233708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.233712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:54.233716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:54.233722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:54.233727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:54.233766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:54.234142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895336032041013:5049] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:54.236272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895336032041013:5049] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:54.239064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895336032041013:5049] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:54.239079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895336032041013:5049] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:54.239086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895336032041013:5049] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:54.239095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 998 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:54.239217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:54.240216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:54.240234Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:54.240236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:54.240242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:54.240248Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 997 [2:7555895335942293966:6694]
2025-09-30T14:52:54.240263Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:54.240281Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:54.240291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:54.240294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:54.240296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:54.240310Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:54.240316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:54.240322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:54.240377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.240386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.240387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.240390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:54.240393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:54.240451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:54.240459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.240471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.240487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.240507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:54.240528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895336032041049:5049], now have 1 active actors on pipe
2025-09-30T14:52:54.240537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895336032040970:2454], now have 1 active actors on pipe
2025-09-30T14:52:54.240543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895335942293961:6694]
2025-09-30T14:52:54.240545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895335942293961:6694]
2025-09-30T14:52:54.240547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895335942293961:6694]
2025-09-30T14:52:54.240560Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:54.240573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:54.240586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:54.240589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:54.240590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:54.240592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:54.240608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:54.240600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 997
2025-09-30T14:52:54.240644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895335942293961:6694]
2025-09-30T14:52:54.240650Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:54.240601Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 997
2025-09-30T14:52:54.240654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:54.240669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:54.240678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:54.240720Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b127d9f-65c4b362-efc83803-e12c8047_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:54.240733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:54.240739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:54.240741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:54.240749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:54.240759Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:54.240779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:54.240963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:54.240974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:54.240991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:54.241086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 998 partition: 0 MaxSeqNo: 42 sessionId: src_id|7b127d9f-65c4b362-efc83803-e12c8047_0
2025-09-30T14:52:54.241425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c9ddfad-409d0f3d-c049b027-87351814_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7b127d9f-65c4b362-efc83803-e12c8047_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:54.244115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b127d9f-65c4b362-efc83803-e12c8047_0] Write session: try to update token
2025-09-30T14:52:54.244132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b127d9f-65c4b362-efc83803-e12c8047_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:54.252930Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:54.252951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:54.252954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:54.252956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:54.252965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895335942293961:6694]
2025-09-30T14:52:54.252970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895335942293961:6694]
2025-09-30T14:52:54.252974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895335942293961:6694]
2025-09-30T14:52:54.253016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:54.253022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.253022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:54.253025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:54.253030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:54.253033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:54.253175Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:54.258447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 998 sessionId: src_id|7b127d9f-65c4b362-efc83803-e12c8047_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:54.261158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:54.321333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895336032041057:7731]
2025-09-30T14:52:54.321603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 997, pipe: [1:7555895336032041057:7731]
2025-09-30T14:52:54.370036Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:54.370387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:54.370406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:54.370444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895336032041057:7731], now have 1 active actors on pipe
2025-09-30T14:52:54.370680Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:54.370719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895336032041057:7731]
2025-09-30T14:52:54.370725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:54.370729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:54.370754Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:54.370789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 998 reason: error at write: Disconnected sessionId: src_id|7b127d9f-65c4b362-efc83803-e12c8047_0
2025-09-30T14:52:54.370970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 998 sessionId: src_id|7b127d9f-65c4b362-efc83803-e12c8047_0 is DEAD
2025-09-30T14:52:54.371095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b127d9f-65c4b362-efc83803-e12c8047_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:54.371106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b127d9f-65c4b362-efc83803-e12c8047_0] Write session will restart in 0.007164s
2025-09-30T14:52:54.371128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b127d9f-65c4b362-efc83803-e12c8047_0] Write session: Do CDS request
2025-09-30T14:52:54.371137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b127d9f-65c4b362-efc83803-e12c8047_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:54.379241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:54.379709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b127d9f-65c4b362-efc83803-e12c8047_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:54.379800Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:54.379821Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 999
2025-09-30T14:52:54.379968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 999 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:54.380003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 999 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:54.380013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=999 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:54.380017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:54.380453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 999 sessionId:  describe result for acl check
2025-09-30T14:52:54.380503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:54.380512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:54.380514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:54.380520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895336032041100:5051] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:54.381102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:54.381125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895336032041100:5051] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:54.381287Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:54.381296Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:54.381306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:54.381357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:54.381392Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895335942294046:6696]
2025-09-30T14:52:54.382011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:54.382270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:54.382317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:54.382645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:54.382713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:54.382722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:54.382723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:54.382725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:54.382725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:54.382727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:54.382728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:54.382731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:54.382732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:54.382733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:54.382734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.382735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.382749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.382750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:54.382751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:54.382757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:54.382765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:54.382769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:54.382772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:54.382776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:54.382779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:54.382783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:54.382787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:54.382791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:54.382795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:54.382799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.382802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.382806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.382809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:54.382813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:54.382820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:54.382827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:54.382832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:54.382837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:54.382842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:54.382848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:54.382852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:54.382864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:54.382870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:54.382875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:54.382880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:54.382886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:54.382890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:54.382894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:54.382898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:54.382903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:54.382907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:54.382916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:54.382920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:54.382924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:54.382928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.382938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.382943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.382952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.382956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.382965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.382970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:54.382975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:54.382984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:54.382990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:54.383038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:54.383125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895336032041100:5051] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:54.388379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895336032041100:5051] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:54.388399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895336032041100:5051] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:54.388403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895336032041100:5051] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:54.388412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 999 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:54.388660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:54.389517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:54.389531Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:54.389533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:54.389538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:54.389543Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 998 [2:7555895335942294046:6696]
2025-09-30T14:52:54.389554Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:54.389565Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:54.389567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:54.389571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:54.389572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:54.389585Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:54.389589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:54.389594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:54.389633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.389640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.389641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.389643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:54.389645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:54.389697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:54.389704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.389718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.389733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.389754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:54.389775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895336032041139:5051], now have 1 active actors on pipe
2025-09-30T14:52:54.389779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895336032041058:2454], now have 1 active actors on pipe
2025-09-30T14:52:54.389785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895335942294041:6696]
2025-09-30T14:52:54.389792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895335942294041:6696]
2025-09-30T14:52:54.389794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895335942294041:6696]
2025-09-30T14:52:54.389806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:54.389820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:54.389824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:54.389832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:54.389834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:54.389839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:54.389844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:54.389874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895335942294041:6696]
2025-09-30T14:52:54.389884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:54.389868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 998
2025-09-30T14:52:54.389904Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 998
2025-09-30T14:52:54.389903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:54.389938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:54.389948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:54.389972Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|245dff0f-578298a4-be4b983e-afb105c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:54.389985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:54.389988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:54.389990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:54.390000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:54.390009Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:54.390023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:54.390158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:54.390168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:54.390182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:54.390258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 999 partition: 0 MaxSeqNo: 42 sessionId: src_id|245dff0f-578298a4-be4b983e-afb105c9_0
2025-09-30T14:52:54.390605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b127d9f-65c4b362-efc83803-e12c8047_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|245dff0f-578298a4-be4b983e-afb105c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:54.393237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|245dff0f-578298a4-be4b983e-afb105c9_0] Write session: try to update token
2025-09-30T14:52:54.393254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|245dff0f-578298a4-be4b983e-afb105c9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:54.404052Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:54.404076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:54.404078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:54.404081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:54.404091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895335942294041:6696]
2025-09-30T14:52:54.404096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895335942294041:6696]
2025-09-30T14:52:54.404099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895335942294041:6696]
2025-09-30T14:52:54.404140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:54.404152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.404155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:54.404162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:54.404178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:54.404182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:54.404302Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:54.407898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 999 sessionId: src_id|245dff0f-578298a4-be4b983e-afb105c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:54.410612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:54.470838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895336032041147:7731]
2025-09-30T14:52:54.471115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 998, pipe: [1:7555895336032041147:7731]
2025-09-30T14:52:54.523292Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:54.523634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:54.523650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:54.523689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895336032041147:7731], now have 1 active actors on pipe
2025-09-30T14:52:54.523933Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:54.523960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895336032041147:7731]
2025-09-30T14:52:54.523979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:54.523983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:54.523994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:54.524048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 999 reason: error at write: Disconnected sessionId: src_id|245dff0f-578298a4-be4b983e-afb105c9_0
2025-09-30T14:52:54.524220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 999 sessionId: src_id|245dff0f-578298a4-be4b983e-afb105c9_0 is DEAD
2025-09-30T14:52:54.524390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|245dff0f-578298a4-be4b983e-afb105c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:54.524402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|245dff0f-578298a4-be4b983e-afb105c9_0] Write session will restart in 0.009278s
2025-09-30T14:52:54.524426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|245dff0f-578298a4-be4b983e-afb105c9_0] Write session: Do CDS request
2025-09-30T14:52:54.524434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|245dff0f-578298a4-be4b983e-afb105c9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:54.534129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:54.534784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|245dff0f-578298a4-be4b983e-afb105c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:54.534871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:54.534902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1000
2025-09-30T14:52:54.535038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1000 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:54.535070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1000 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:54.535081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1000 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:54.535085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:54.535539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1000 sessionId:  describe result for acl check
2025-09-30T14:52:54.535577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:54.535579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:54.535580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:54.535586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895336032041200:5047] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:54.535919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:54.536119Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:54.536132Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:54.536142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:54.536177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895336032041200:5047] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:54.536194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:54.536247Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895335942294127:6698]
2025-09-30T14:52:54.536987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:54.537451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:54.537527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:54.537895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:54.537995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:54.538001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:54.538002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:54.538004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:54.538005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:54.538006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:54.538007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:54.538009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:54.538013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:54.538014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:54.538015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.538017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.538018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.538019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:54.538020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:54.538027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:54.538036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:54.538040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:54.538044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:54.538047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:54.538051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:54.538055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:54.538059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:54.538063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:54.538067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:54.538070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.538074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.538079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.538083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:54.538087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:54.538096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:54.538105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:54.538111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:54.538116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:54.538121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:54.538126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:54.538131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:54.538136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:54.538141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:54.538148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:54.538152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:54.538157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:54.538162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:54.538167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:54.538172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:54.538177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:54.538182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:54.538187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:54.538226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:54.538232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:54.538236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.538242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.538245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.538251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.538256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.538267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.538271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:54.538277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:54.538286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:54.538292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:54.538341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:54.540898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895336032041200:5047] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:54.543605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895336032041200:5047] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:54.543626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895336032041200:5047] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:54.543630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895336032041200:5047] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:54.543640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1000 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:54.546428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 999
2025-09-30T14:52:54.546431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 999
2025-09-30T14:52:54.545154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:54.546067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:54.546073Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:54.546077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:54.546081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:54.546089Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 999 [2:7555895335942294127:6698]
2025-09-30T14:52:54.546106Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:54.546120Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:54.546123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:54.546127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:54.546132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:54.546147Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:54.546154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:54.546160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:54.546230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.546232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.546234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.546238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:54.546242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:54.546309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:54.546312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.546327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.546340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.546360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:54.546379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895336032041242:5047], now have 1 active actors on pipe
2025-09-30T14:52:54.546384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895336032041150:2454], now have 1 active actors on pipe
2025-09-30T14:52:54.546391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895335942294122:6698]
2025-09-30T14:52:54.546393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895335942294122:6698]
2025-09-30T14:52:54.546395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895335942294122:6698]
2025-09-30T14:52:54.546413Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:54.546427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:54.546427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:54.546431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:54.546433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:54.546443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:54.546446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:54.546482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895335942294122:6698]
2025-09-30T14:52:54.546485Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:54.546488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:54.546507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:54.546511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:54.546635Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ccb31c10-33ecc63a-9e65624e-481bb20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:54.546642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:54.546648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:54.546650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:54.546658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:54.546668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:54.546694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:54.546932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:54.546937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:54.546954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:54.547040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1000 partition: 0 MaxSeqNo: 42 sessionId: src_id|ccb31c10-33ecc63a-9e65624e-481bb20_0
2025-09-30T14:52:54.547408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|245dff0f-578298a4-be4b983e-afb105c9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ccb31c10-33ecc63a-9e65624e-481bb20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:54.550264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccb31c10-33ecc63a-9e65624e-481bb20_0] Write session: try to update token
2025-09-30T14:52:54.550286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccb31c10-33ecc63a-9e65624e-481bb20_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:54.558752Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:54.558773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:54.558776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:54.558778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:54.558787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895335942294122:6698]
2025-09-30T14:52:54.558792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895335942294122:6698]
2025-09-30T14:52:54.558795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895335942294122:6698]
2025-09-30T14:52:54.558834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:54.558843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.558842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:54.558846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:54.558849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:54.558854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:54.558980Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:54.570776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1000 sessionId: src_id|ccb31c10-33ecc63a-9e65624e-481bb20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:54.573459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:54.623911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895336032041255:7731]
2025-09-30T14:52:54.624289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 999, pipe: [1:7555895336032041255:7731]
2025-09-30T14:52:54.675150Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:54.675582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:54.675605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:54.675628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895336032041255:7731], now have 1 active actors on pipe
2025-09-30T14:52:54.675881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:54.675910Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:54.675942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895336032041255:7731]
2025-09-30T14:52:54.675947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:54.675951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:54.676007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1000 reason: error at write: Disconnected sessionId: src_id|ccb31c10-33ecc63a-9e65624e-481bb20_0
2025-09-30T14:52:54.676187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1000 sessionId: src_id|ccb31c10-33ecc63a-9e65624e-481bb20_0 is DEAD
2025-09-30T14:52:54.676332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccb31c10-33ecc63a-9e65624e-481bb20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:54.676340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccb31c10-33ecc63a-9e65624e-481bb20_0] Write session will restart in 0.005559s
2025-09-30T14:52:54.676364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccb31c10-33ecc63a-9e65624e-481bb20_0] Write session: Do CDS request
2025-09-30T14:52:54.676372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccb31c10-33ecc63a-9e65624e-481bb20_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:54.682749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccb31c10-33ecc63a-9e65624e-481bb20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:54.682823Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:54.682850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1001
2025-09-30T14:52:54.682990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1001 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:54.683025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1001 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:54.683034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1001 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:54.683038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:54.683521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1001 sessionId:  describe result for acl check
2025-09-30T14:52:54.683553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:54.683557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:54.683559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:54.683564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895336032041297:5038] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:54.684112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895336032041297:5038] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:54.684450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:54.686101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:54.686300Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:54.686313Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:54.686326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:54.686321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895336032041297:5038] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:54.686389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:54.686428Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895335942294211:6701]
2025-09-30T14:52:54.687076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:54.687385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:54.687430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:54.687732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:54.687788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:54.687795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:54.687796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:54.687797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:54.687799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:54.687800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:54.687803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:54.687804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:54.687805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:54.687805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:54.687807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.687808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.687808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.687809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:54.687810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:54.687815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:54.687824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:54.687828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:54.687831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:54.687834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:54.687838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:54.687841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:54.687845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:54.687849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:54.687852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:54.687855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.687859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.687862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.687866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:54.687869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:54.687875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:54.687882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:54.687887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:54.687893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:54.687897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:54.687902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:54.687907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:54.687913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:54.687917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:54.687921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:54.687924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:54.687930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:54.687934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:54.687939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:54.687943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:54.687947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:54.687951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:54.687955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:54.687959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:54.687963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:54.687967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.687971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.687975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.687979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.687983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.687988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.687991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:54.687996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:54.688000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:54.688006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:54.688045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:54.693306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895336032041297:5038] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:54.693330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895336032041297:5038] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:54.693333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895336032041297:5038] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:54.693342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1001 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:54.693478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:54.694306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:54.694324Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:54.694327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:54.694332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:54.694338Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1000 [2:7555895335942294211:6701]
2025-09-30T14:52:54.694354Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:54.694368Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:54.694373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:54.694376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:54.694378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:54.694394Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:54.694406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:54.694412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:54.694471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.694479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.694481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.694484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:54.694486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:54.694551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:54.694559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.694572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.694588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.694613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:54.694636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895336032041339:5038], now have 1 active actors on pipe
2025-09-30T14:52:54.694639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895336032041256:2454], now have 1 active actors on pipe
2025-09-30T14:52:54.694646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895335942294206:6701]
2025-09-30T14:52:54.694648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895335942294206:6701]
2025-09-30T14:52:54.694650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895335942294206:6701]
2025-09-30T14:52:54.694661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:54.694681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:54.694682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:54.694686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:54.694689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:54.694701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:54.694705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:54.694687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1000
2025-09-30T14:52:54.694690Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1000
2025-09-30T14:52:54.694732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895335942294206:6701]
2025-09-30T14:52:54.694741Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:54.694745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:54.694770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:54.694779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:54.694809Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ce2e3b2-d9887d21-c12bcd61-eddffb60_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:54.694819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:54.694822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:54.694828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:54.694837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:54.694850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:54.694867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:54.695063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:54.695079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:54.695105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:54.695219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1001 partition: 0 MaxSeqNo: 42 sessionId: src_id|9ce2e3b2-d9887d21-c12bcd61-eddffb60_0
2025-09-30T14:52:54.695592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccb31c10-33ecc63a-9e65624e-481bb20_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9ce2e3b2-d9887d21-c12bcd61-eddffb60_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:54.698398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ce2e3b2-d9887d21-c12bcd61-eddffb60_0] Write session: try to update token
2025-09-30T14:52:54.698417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ce2e3b2-d9887d21-c12bcd61-eddffb60_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:54.707594Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:54.707616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:54.707619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:54.707622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:54.707631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895335942294206:6701]
2025-09-30T14:52:54.707641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895335942294206:6701]
2025-09-30T14:52:54.707644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895335942294206:6701]
2025-09-30T14:52:54.707686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:54.707689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:54.707697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:54.707710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.707716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:54.707716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:54.707867Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:54.712663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1001 sessionId: src_id|9ce2e3b2-d9887d21-c12bcd61-eddffb60_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:54.715538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:54.776020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895336032041360:7731]
2025-09-30T14:52:54.776330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1000, pipe: [1:7555895336032041360:7731]
2025-09-30T14:52:54.822585Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:54.822909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:54.822927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:54.822967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895336032041360:7731], now have 1 active actors on pipe
2025-09-30T14:52:54.823172Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:54.823177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:54.823196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:54.823206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:54.823269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895336032041360:7731]
2025-09-30T14:52:54.823279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1001 reason: error at write: Disconnected sessionId: src_id|9ce2e3b2-d9887d21-c12bcd61-eddffb60_0
2025-09-30T14:52:54.823290Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:52:54.823369Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 10 consumer shared/user session shared/user_1_10_2061474146563990167_v1 is DEAD
2025-09-30T14:52:54.823443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1001 sessionId: src_id|9ce2e3b2-d9887d21-c12bcd61-eddffb60_0 is DEAD
2025-09-30T14:52:54.823529Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895271607499170:7728] disconnected; active server actors: 1
2025-09-30T14:52:54.823536Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895271607499170:7728] client user disconnected session shared/user_1_10_2061474146563990167_v1
2025-09-30T14:52:54.824308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ce2e3b2-d9887d21-c12bcd61-eddffb60_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:54.824320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ce2e3b2-d9887d21-c12bcd61-eddffb60_0] Write session will restart in 0.007765s
2025-09-30T14:52:54.824308Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:52:54.824343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ce2e3b2-d9887d21-c12bcd61-eddffb60_0] Write session: Do CDS request
2025-09-30T14:52:54.824349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ce2e3b2-d9887d21-c12bcd61-eddffb60_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:54.824390Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:52:54.824396Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:52:54.824412Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.005562s
2025-09-30T14:52:54.830616Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:52:54.830828Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:52:54.830844Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 11
2025-09-30T14:52:54.831075Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 11 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:52:54.831129Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:52:54.831209Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 auth for : user
2025-09-30T14:52:54.831419Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 Handle describe topics response
2025-09-30T14:52:54.831453Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 auth is DEAD
2025-09-30T14:52:54.831474Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:52:54.831754Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:52:54.831854Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895336032041415:5025] connected; active server actors: 1
2025-09-30T14:52:54.831868Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555895336032041415:5025] session shared/user_1_11_12961624380292939000_v1
2025-09-30T14:52:54.831877Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:52:54.831888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:52:54.831876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:54.831894Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_11_12961624380292939000_v1" (Sender=[1:7555895336032041410:5025], Pipe=[1:7555895336032041415:5025], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:52:54.831906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:52:54.831917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:52:54.831925Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_11_12961624380292939000_v1" (Sender=[1:7555895336032041410:5025], Pipe=[1:7555895336032041415:5025], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:52:54.831935Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_11_12961624380292939000_v1" sender [1:7555895336032041410:5025] lock partition 0 for ReadingSession "shared/user_1_11_12961624380292939000_v1" (Sender=[1:7555895336032041410:5025], Pipe=[1:7555895336032041415:5025], Partitions=[], ActiveFamilyCount=1) generation 1 step 11
2025-09-30T14:52:54.831949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:52:54.831953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000033s
2025-09-30T14:52:54.831993Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_11_12961624380292939000_v1
2025-09-30T14:52:54.832181Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 11 Session: "shared/user_1_11_12961624380292939000_v1" ClientId: "user" PipeClient { RawX1: 7555895336032041415 RawX2: 4503603922342817 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:52:54.832208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:52:54.832617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ce2e3b2-d9887d21-c12bcd61-eddffb60_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:54.832712Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:54.832725Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1002
2025-09-30T14:52:54.832828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1002 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:54.832856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1002 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:54.832865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1002 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:54.832869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:54.833229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1002 sessionId:  describe result for acl check
2025-09-30T14:52:54.833264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:54.833272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:54.833273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:54.833278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895336032041423:5021] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:54.833706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:54.833857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895336032041423:5021] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:54.833911Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:54.833923Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:54.833935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:54.833998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:54.834039Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895335942294331:6715]
2025-09-30T14:52:54.834644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:54.834911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:54.834957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:54.835299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:54.835363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:54.835369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:54.835370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:54.835372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:54.835372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:54.835374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:54.835377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:54.835378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:54.835379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:54.835380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:54.835381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.835382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.835383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.835384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:54.835385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:54.835390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:54.835399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:54.835403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:54.835407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:54.835411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:54.835415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:54.835419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:54.835423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:54.835427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:54.835432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:54.835436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.835440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.835444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.835448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:54.835452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:54.835458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:54.835465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:54.835471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:54.835476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:54.835482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:54.835487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:54.835491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:54.835498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:54.835502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:54.835509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:54.835513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:54.835522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:54.835526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:54.835531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:54.835544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:54.835549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:54.835553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:54.835555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895336032041423:5021] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:54.835558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:54.835563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:54.835569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:54.835573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.835578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.835583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.835588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.835592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.835596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.835600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:54.835606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:54.835610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:54.835615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:54.835656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:54.841144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:54.841287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895336032041423:5021] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:54.841305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895336032041423:5021] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:54.841309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895336032041423:5021] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:54.841316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1002 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:54.842115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:54.842128Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:54.842130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:54.842134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:54.842141Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1001 [2:7555895335942294331:6715]
2025-09-30T14:52:54.842154Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:54.842165Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:54.842166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:54.842168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:54.842169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:54.842180Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:54.842184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:54.842201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:54.842257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.842272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.842273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.842276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:54.842279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:54.842345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:54.842348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.842359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.842365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.842375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:54.842388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895336032041460:5021], now have 1 active actors on pipe
2025-09-30T14:52:54.842397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895336032041370:2454], now have 1 active actors on pipe
2025-09-30T14:52:54.842403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895335942294325:6715]
2025-09-30T14:52:54.842405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895335942294325:6715]
2025-09-30T14:52:54.842407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895335942294325:6715]
2025-09-30T14:52:54.842421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:54.842435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895336032041418:5026], now have 1 active actors on pipe
2025-09-30T14:52:54.842442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:54.842443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:54.842447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:54.842450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:54.842460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:54.842463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:54.842473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1001
2025-09-30T14:52:54.842473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1001
2025-09-30T14:52:54.842495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895335942294325:6715]
2025-09-30T14:52:54.842505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1001, pipe: [1:7555895336032041418:5026]
2025-09-30T14:52:54.842505Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:54.842510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:54.842534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:54.842538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:54.842568Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20ab389b-ea4ea1a5-1dec5f90-629bf28e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:54.842583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:54.842590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:54.842592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:54.842600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:54.842614Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:54.842639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:54.842645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:54.842650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_11_12961624380292939000_v1 on pipe: [1:7555895336032041418:5026]
2025-09-30T14:52:54.842669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:54.842681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:54.842691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:54.842693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:54.842695Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_11_12961624380292939000_v1:1 with generation 1001
2025-09-30T14:52:54.842706Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_11_12961624380292939000_v1
2025-09-30T14:52:54.842712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:54.842731Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:52:54.842859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:54.842867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:54.842884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:54.842975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1002 partition: 0 MaxSeqNo: 42 sessionId: src_id|20ab389b-ea4ea1a5-1dec5f90-629bf28e_0
2025-09-30T14:52:54.843342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ce2e3b2-d9887d21-c12bcd61-eddffb60_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|20ab389b-ea4ea1a5-1dec5f90-629bf28e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:54.845966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20ab389b-ea4ea1a5-1dec5f90-629bf28e_0] Write session: try to update token
2025-09-30T14:52:54.845983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20ab389b-ea4ea1a5-1dec5f90-629bf28e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:54.847334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:52:54.847375Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:52:54.847385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:54.847393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:54.847395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:54.847404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:52:54.847417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:52:54.847550Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759243974842 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:52:54.847576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:52:54.847609Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 sending to client partition status
2025-09-30T14:52:54.855158Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:54.855184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:54.855188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:54.855192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:54.855205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895335942294325:6715]
2025-09-30T14:52:54.855215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895335942294325:6715]
2025-09-30T14:52:54.855220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895335942294325:6715]
2025-09-30T14:52:54.855282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:54.855297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:54.855301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:54.855301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:54.855310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.855314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:54.855526Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:54.860443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1002 sessionId: src_id|20ab389b-ea4ea1a5-1dec5f90-629bf28e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:54.863064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:54.973648Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:54.973995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:54.974012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:54.974364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895336032041418:5026]
2025-09-30T14:52:54.974377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:54.974382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:54.974412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:54.974448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1002 reason: error at write: Disconnected sessionId: src_id|20ab389b-ea4ea1a5-1dec5f90-629bf28e_0
2025-09-30T14:52:54.974624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1002 sessionId: src_id|20ab389b-ea4ea1a5-1dec5f90-629bf28e_0 is DEAD
2025-09-30T14:52:54.974542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_11_12961624380292939000_v1
2025-09-30T14:52:54.974566Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:54.974577Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_11_12961624380292939000_v1
2025-09-30T14:52:54.974841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20ab389b-ea4ea1a5-1dec5f90-629bf28e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:54.974851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20ab389b-ea4ea1a5-1dec5f90-629bf28e_0] Write session will restart in 0.009899s
2025-09-30T14:52:54.974877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20ab389b-ea4ea1a5-1dec5f90-629bf28e_0] Write session: Do CDS request
2025-09-30T14:52:54.974882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20ab389b-ea4ea1a5-1dec5f90-629bf28e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:54.985723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20ab389b-ea4ea1a5-1dec5f90-629bf28e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:54.985835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:54.985868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1003
2025-09-30T14:52:54.986001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1003 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:54.986035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1003 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:54.986040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1003 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:54.986043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:54.986480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1003 sessionId:  describe result for acl check
2025-09-30T14:52:54.986518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:54.986522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:54.986524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:54.986529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895336032041515:5022] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:54.987140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895336032041515:5022] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:54.987160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:54.989101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:54.989304Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:54.989314Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:54.989326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:54.989384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:54.989417Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895335942294418:6717]
2025-09-30T14:52:54.990034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:54.990351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:54.990402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:54.990551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895336032041515:5022] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:54.990763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:54.990834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:54.990843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:54.990844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:54.990845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:54.990846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:54.990847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:54.990848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:54.990850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:54.990851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:54.990854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:54.990856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.990857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.990858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.990859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:54.990860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:54.990865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:54.990875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:54.990879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:54.990883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:54.990887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:54.990890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:54.990894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:54.990898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:54.990901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:54.990905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:54.990908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.990912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.990916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.990920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:54.990923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:54.990931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:54.990938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:54.990945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:54.990950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:54.990955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:54.990961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:54.990965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:54.990970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:54.990974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:54.990980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:54.990986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:54.990992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:54.990998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:54.991002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:54.991006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:54.991014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:54.991018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:54.991024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:54.991028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:54.991034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:54.991040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.991044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.991048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.991053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.991059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.991063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.991067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:54.991072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:54.991076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:54.991081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:54.991125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:54.996580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895336032041515:5022] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:54.996609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895336032041515:5022] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:54.996613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895336032041515:5022] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:54.996623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1003 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:54.996934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:54.997829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:54.997848Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:54.997851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:54.997855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:54.997862Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1002 [2:7555895335942294418:6717]
2025-09-30T14:52:54.997878Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:54.997891Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:54.997894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:54.997897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:54.997900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:54.997917Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:54.997924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:54.997930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:54.997986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.997995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.997997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.997999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:54.998004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:54.998069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:54.998078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:54.998093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:54.998107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:54.998132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:54.998154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895336032041555:5022], now have 1 active actors on pipe
2025-09-30T14:52:54.998163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895336032041470:2454], now have 1 active actors on pipe
2025-09-30T14:52:54.998169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895335942294413:6717]
2025-09-30T14:52:54.998171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895335942294413:6717]
2025-09-30T14:52:54.998173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895335942294413:6717]
2025-09-30T14:52:54.998202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:54.998214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:54.998218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:54.998221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:54.998223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:54.998238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:54.998241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:54.998274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895335942294413:6717]
2025-09-30T14:52:54.998277Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:54.998243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1002
2025-09-30T14:52:54.998292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1002
2025-09-30T14:52:54.998296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:54.998308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:54.998319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:54.998345Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd126376-269a6f1c-dcf15a5f-c65084a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:54.998365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:54.998369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:54.998371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:54.998381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:54.998394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:54.998418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:54.998603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:54.998612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:54.998625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:54.998714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1003 partition: 0 MaxSeqNo: 42 sessionId: src_id|bd126376-269a6f1c-dcf15a5f-c65084a0_0
2025-09-30T14:52:54.999075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20ab389b-ea4ea1a5-1dec5f90-629bf28e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bd126376-269a6f1c-dcf15a5f-c65084a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:55.001924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd126376-269a6f1c-dcf15a5f-c65084a0_0] Write session: try to update token
2025-09-30T14:52:55.001944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd126376-269a6f1c-dcf15a5f-c65084a0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:55.010663Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:55.010683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:55.010685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:55.010687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:55.010696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895335942294413:6717]
2025-09-30T14:52:55.010702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895335942294413:6717]
2025-09-30T14:52:55.010706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895335942294413:6717]
2025-09-30T14:52:55.010746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:55.010747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:55.010754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:55.010758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:55.010768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.010773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:55.010913Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:55.017631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1003 sessionId: src_id|bd126376-269a6f1c-dcf15a5f-c65084a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:55.020300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:55.074497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895340327008864:5026]
2025-09-30T14:52:55.074804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1002, pipe: [1:7555895340327008864:5026]
2025-09-30T14:52:55.126063Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:55.126526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:55.126541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:55.126580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895340327008864:5026], now have 1 active actors on pipe
2025-09-30T14:52:55.126806Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:55.127128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:55.127274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1003 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bd126376-269a6f1c-dcf15a5f-c65084a0_0
2025-09-30T14:52:55.127298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895340327008864:5026]
2025-09-30T14:52:55.127325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:55.127455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1003 sessionId: src_id|bd126376-269a6f1c-dcf15a5f-c65084a0_0 is DEAD
2025-09-30T14:52:55.127803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd126376-269a6f1c-dcf15a5f-c65084a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:55.127814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd126376-269a6f1c-dcf15a5f-c65084a0_0] Write session will restart in 0.005594s
2025-09-30T14:52:55.127838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd126376-269a6f1c-dcf15a5f-c65084a0_0] Write session: Do CDS request
2025-09-30T14:52:55.127844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd126376-269a6f1c-dcf15a5f-c65084a0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:55.135745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd126376-269a6f1c-dcf15a5f-c65084a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:55.135847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:55.135880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1004
2025-09-30T14:52:55.136042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1004 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:55.136079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1004 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:55.136092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1004 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:55.136105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:55.136579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1004 sessionId:  describe result for acl check
2025-09-30T14:52:55.136621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:55.136626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:55.136628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:55.136635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895340327008926:5011] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:55.136286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:55.137230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895340327008926:5011] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:55.138277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:55.138485Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:55.138495Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:55.138505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:55.138558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:55.138614Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895340237261811:6721]
2025-09-30T14:52:55.139348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:55.139615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:55.139660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:55.139880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895340327008926:5011] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:55.139990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:55.140059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:55.140066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:55.140067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:55.140069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:55.140070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:55.140072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:55.140073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:55.140076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:55.140077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:55.140078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:55.140079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.140080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.140082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.140083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:55.140084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:55.140090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:55.140102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:55.140106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:55.140111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:55.140115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:55.140120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:55.140125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:55.140129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:55.140133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:55.140138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:55.140143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.140147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.140151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.140155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:55.140160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:55.140168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:55.140176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:55.140182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:55.140189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:55.140194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:55.140200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:55.140205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:55.140211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:55.140219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:55.140224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:55.140230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:55.140236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:55.140241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:55.140247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:55.140252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:55.140258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:55.140264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:55.140269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:55.140273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:55.140277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:55.140283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.140288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.140298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.140304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.140311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.140317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.140327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:55.140332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:55.140337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:55.140347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:55.140396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:55.145835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895340327008926:5011] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:55.145864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895340327008926:5011] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:55.145868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895340327008926:5011] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:55.145878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1004 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:55.147574Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1003
2025-09-30T14:52:55.147576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1003
2025-09-30T14:52:55.146141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:55.147096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:55.147103Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:55.147106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:55.147111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:55.147118Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1003 [2:7555895340237261811:6721]
2025-09-30T14:52:55.147135Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:55.147151Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:55.147154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:55.147161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:55.147163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:55.147181Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:55.147188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:55.147198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:55.147284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.147286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.147288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.147291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:55.147294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:55.147368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:55.147371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.147386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.147399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.147419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:55.147437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895340237261806:6721]
2025-09-30T14:52:55.147439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895340237261806:6721]
2025-09-30T14:52:55.147441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895340237261806:6721]
2025-09-30T14:52:55.147451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:55.147465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:55.147466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:55.147470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:55.147472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:55.147483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:55.147489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:55.147498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895340327008880:2454], now have 1 active actors on pipe
2025-09-30T14:52:55.147502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895340327008966:5011], now have 1 active actors on pipe
2025-09-30T14:52:55.147538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895340237261806:6721]
2025-09-30T14:52:55.147553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:55.147577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:55.147680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:55.147685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:55.147710Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|982d039a-7ade4d0-141fa235-5770b259_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:55.147718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:55.147725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:55.147727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:55.147736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:55.147745Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:55.147759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:55.147958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:55.147967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:55.147993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:55.151345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1004 partition: 0 MaxSeqNo: 42 sessionId: src_id|982d039a-7ade4d0-141fa235-5770b259_0
2025-09-30T14:52:55.151744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd126376-269a6f1c-dcf15a5f-c65084a0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|982d039a-7ade4d0-141fa235-5770b259_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:55.154718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|982d039a-7ade4d0-141fa235-5770b259_0] Write session: try to update token
2025-09-30T14:52:55.154743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|982d039a-7ade4d0-141fa235-5770b259_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:55.160201Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:55.160227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:55.160229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:55.160232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:55.160241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895340237261806:6721]
2025-09-30T14:52:55.160246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895340237261806:6721]
2025-09-30T14:52:55.160251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895340237261806:6721]
2025-09-30T14:52:55.160295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:55.160303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.160306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:55.160303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:55.160311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:55.160316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:55.160457Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:55.173726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1004 sessionId: src_id|982d039a-7ade4d0-141fa235-5770b259_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:55.176508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:55.230903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895340327008974:5026]
2025-09-30T14:52:55.231259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1003, pipe: [1:7555895340327008974:5026]
2025-09-30T14:52:55.275938Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:55.276324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:55.276346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:55.276367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895340327008974:5026], now have 1 active actors on pipe
2025-09-30T14:52:55.276603Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:55.276938Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:55.276991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:55.277064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1004 reason: status is not ok: tablet will be restarted right now sessionId: src_id|982d039a-7ade4d0-141fa235-5770b259_0
2025-09-30T14:52:55.277258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1004 sessionId: src_id|982d039a-7ade4d0-141fa235-5770b259_0 is DEAD
2025-09-30T14:52:55.277410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|982d039a-7ade4d0-141fa235-5770b259_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:55.277423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|982d039a-7ade4d0-141fa235-5770b259_0] Write session will restart in 0.007082s
2025-09-30T14:52:55.277446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|982d039a-7ade4d0-141fa235-5770b259_0] Write session: Do CDS request
2025-09-30T14:52:55.277452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|982d039a-7ade4d0-141fa235-5770b259_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:55.277484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895340327008974:5026]
2025-09-30T14:52:55.285808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|982d039a-7ade4d0-141fa235-5770b259_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:55.285894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:55.285916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1005
2025-09-30T14:52:55.286073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1005 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:55.286108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1005 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:55.286113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1005 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:55.286117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:55.286817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1005 sessionId:  describe result for acl check
2025-09-30T14:52:55.286858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:55.286861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:55.286863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:55.286870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895340327008999:5002] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:55.287499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895340327008999:5002] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:55.289703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:55.289955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895340327008999:5002] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:55.291460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:55.291669Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:55.291681Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:55.291692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:55.291746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:55.291786Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895340237261897:6723]
2025-09-30T14:52:55.292487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:55.292809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:55.292784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895340327008999:5002] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:55.292803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895340327008999:5002] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:55.292806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895340327008999:5002] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:55.292815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1005 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:55.292880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:55.293282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:55.293371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:55.293378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:55.293379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:55.293380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:55.293381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:55.293382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:55.293383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:55.293385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:55.293386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:55.293387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:55.293388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.293389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.293390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.293394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:55.293394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:55.293401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:55.293411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:55.293415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:55.293420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:55.293425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:55.293429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:55.293434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:55.293437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:55.293441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:55.293446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:55.293450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.293454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.293457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.293460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:55.293464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:55.293473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:55.293481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:55.293487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:55.293493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:55.293497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:55.293501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:55.293505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:55.293510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:55.293515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:55.293521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:55.293526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:55.293532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:55.293543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:55.293549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:55.293554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:55.293565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:55.293571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:55.293581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:55.293586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:55.293591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:55.293600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.293605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.293612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.293617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.293627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.293632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.293639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:55.293644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:55.293652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:55.293657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:55.293703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:55.299495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:55.300388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:55.300406Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:55.300410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:55.300415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:55.300423Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1004 [2:7555895340237261897:6723]
2025-09-30T14:52:55.300446Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:55.300466Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:55.300469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:55.300472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:55.300474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:55.300491Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:55.300503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:55.300513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:55.300569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.300575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.300578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.300580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:55.300582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:55.300651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:55.300659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.300670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.300685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.300702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:55.300724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895340327009060:5002], now have 1 active actors on pipe
2025-09-30T14:52:55.300731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895340327008975:2454], now have 1 active actors on pipe
2025-09-30T14:52:55.300739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895340237261892:6723]
2025-09-30T14:52:55.300741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895340237261892:6723]
2025-09-30T14:52:55.300742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895340237261892:6723]
2025-09-30T14:52:55.300755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:55.300772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:55.300786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:55.300789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:55.300826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895340237261892:6723]
2025-09-30T14:52:55.300836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:55.300830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1004
2025-09-30T14:52:55.300835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1004
2025-09-30T14:52:55.300887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:55.300912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:55.300920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:55.300926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:55.301169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:55.301184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:55.301212Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9bb9926-2e5231f1-6760b532-10b39f5d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:55.301227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:55.301245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:55.301255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:55.301266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:55.301276Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:55.301294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:55.301529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:55.301545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:55.301568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:55.301675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1005 partition: 0 MaxSeqNo: 42 sessionId: src_id|a9bb9926-2e5231f1-6760b532-10b39f5d_0
2025-09-30T14:52:55.302028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|982d039a-7ade4d0-141fa235-5770b259_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a9bb9926-2e5231f1-6760b532-10b39f5d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:55.304831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9bb9926-2e5231f1-6760b532-10b39f5d_0] Write session: try to update token
2025-09-30T14:52:55.304848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9bb9926-2e5231f1-6760b532-10b39f5d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:55.313175Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:55.313198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:55.313209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895340237261892:6723]
2025-09-30T14:52:55.313258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:55.313281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:55.313438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:55.313597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:55.313754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:55.313918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:55.314124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:55.314169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:55.324624Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:55.324648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:55.324651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:55.324652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:55.324662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895340237261892:6723]
2025-09-30T14:52:55.324667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895340237261892:6723]
2025-09-30T14:52:55.324671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895340237261892:6723]
2025-09-30T14:52:55.324712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:55.324720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.324725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:55.324706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1005 sessionId: src_id|a9bb9926-2e5231f1-6760b532-10b39f5d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:55.324880Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:55.324890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:55.324901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:55.324905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:55.327621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:55.377614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895340327009069:5026]
2025-09-30T14:52:55.377883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1004, pipe: [1:7555895340327009069:5026]
2025-09-30T14:52:55.439172Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:55.439619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:55.439637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:55.439658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895340327009069:5026], now have 1 active actors on pipe
2025-09-30T14:52:55.439879Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:55.439915Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:55.439922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:55.439927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:55.439973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895340327009069:5026]
2025-09-30T14:52:55.440002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1005 reason: error at write: Disconnected sessionId: src_id|a9bb9926-2e5231f1-6760b532-10b39f5d_0
2025-09-30T14:52:55.440186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1005 sessionId: src_id|a9bb9926-2e5231f1-6760b532-10b39f5d_0 is DEAD
2025-09-30T14:52:55.440394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9bb9926-2e5231f1-6760b532-10b39f5d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:55.440407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9bb9926-2e5231f1-6760b532-10b39f5d_0] Write session will restart in 0.009637s
2025-09-30T14:52:55.440440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9bb9926-2e5231f1-6760b532-10b39f5d_0] Write session: Do CDS request
2025-09-30T14:52:55.440448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9bb9926-2e5231f1-6760b532-10b39f5d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:55.449430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:55.450992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:55.451220Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:55.451230Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:55.451257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:55.451319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:55.451355Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895340237261983:6725]
2025-09-30T14:52:55.452032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9bb9926-2e5231f1-6760b532-10b39f5d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:55.452043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:55.452211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:55.452228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1006
2025-09-30T14:52:55.452373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1006 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:55.452415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1006 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:55.452425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1006 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:55.452430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:55.452426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:55.452476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:55.452801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:55.452879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:55.452886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:55.452888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:55.452889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:55.452890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:55.452892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:55.452893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:55.452895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:55.452896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:55.452902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1006 sessionId:  describe result for acl check
2025-09-30T14:52:55.452898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:55.452899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.452950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:55.452956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:55.452900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.452901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.452902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:55.452958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:55.452964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895340327009123:4999] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:55.452904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:55.452909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:55.452922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:55.452926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:55.452930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:55.452934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:55.452938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:55.452941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:55.452945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:55.452949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:55.452953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:55.452956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.452960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.452965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.452969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:55.452973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:55.452980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:55.452988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:55.452994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:55.452999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:55.453004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:55.453010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:55.453014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:55.453019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:55.453023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:55.453029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:55.453034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:55.453039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:55.453045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:55.453050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:55.453054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:55.453059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:55.453064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:55.453070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:55.453074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:55.453080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:55.453084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.453089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.453094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.453099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.453106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.453111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.453116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:55.453120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:55.453124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:55.453128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:55.453171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:55.453554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895340327009123:4999] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:55.455689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895340327009123:4999] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:55.458255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895340327009123:4999] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:55.458272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895340327009123:4999] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:55.458276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895340327009123:4999] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:55.458285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1006 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:55.458717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:55.459656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:55.459673Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:55.459676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:55.459681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:55.459688Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1005 [2:7555895340237261983:6725]
2025-09-30T14:52:55.459704Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:55.459720Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:55.459729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:55.459732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:55.459735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:55.459749Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:55.459760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:55.459767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:55.459835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.459845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.459847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.459850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:55.459853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:55.459918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:55.459927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.459941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.459954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.459978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:55.459995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895340237261978:6725]
2025-09-30T14:52:55.460007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895340237261978:6725]
2025-09-30T14:52:55.460009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895340237261978:6725]
2025-09-30T14:52:55.460016Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:55.460026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:55.460029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:55.460030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:55.460032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:55.460042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:55.460045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:55.460054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895340327009071:2454], now have 1 active actors on pipe
2025-09-30T14:52:55.460057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895340327009159:4999], now have 1 active actors on pipe
2025-09-30T14:52:55.460091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895340237261978:6725]
2025-09-30T14:52:55.460099Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:55.460116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:55.460080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1005
2025-09-30T14:52:55.460125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1005
2025-09-30T14:52:55.460254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:55.460277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:55.460304Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9f5113f-e485fd4-dae368b4-6a0a20ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:55.460316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:55.460320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:55.460322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:55.460335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:55.460344Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:55.460356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:55.460555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:55.460566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:55.460581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:55.460689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1006 partition: 0 MaxSeqNo: 42 sessionId: src_id|f9f5113f-e485fd4-dae368b4-6a0a20ad_0
2025-09-30T14:52:55.461087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9bb9926-2e5231f1-6760b532-10b39f5d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f9f5113f-e485fd4-dae368b4-6a0a20ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:55.464492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f5113f-e485fd4-dae368b4-6a0a20ad_0] Write session: try to update token
2025-09-30T14:52:55.464520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f5113f-e485fd4-dae368b4-6a0a20ad_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:55.472382Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:55.472402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:55.472405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:55.472407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:55.472416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895340237261978:6725]
2025-09-30T14:52:55.472424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895340237261978:6725]
2025-09-30T14:52:55.472429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895340237261978:6725]
2025-09-30T14:52:55.472472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:55.472480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.472479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:55.472483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:55.472487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:55.472492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:55.472620Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:55.482810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1006 sessionId: src_id|f9f5113f-e485fd4-dae368b4-6a0a20ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:55.485788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:55.539916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895340327009168:5026]
2025-09-30T14:52:55.540208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1005, pipe: [1:7555895340327009168:5026]
2025-09-30T14:52:55.593026Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:55.593394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:55.593412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:55.593433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895340327009168:5026], now have 1 active actors on pipe
2025-09-30T14:52:55.593641Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:55.593674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:55.593745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895340327009168:5026]
2025-09-30T14:52:55.593766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:55.593856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1006 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f9f5113f-e485fd4-dae368b4-6a0a20ad_0
2025-09-30T14:52:55.594023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1006 sessionId: src_id|f9f5113f-e485fd4-dae368b4-6a0a20ad_0 is DEAD
2025-09-30T14:52:55.594200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f5113f-e485fd4-dae368b4-6a0a20ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:55.594212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f5113f-e485fd4-dae368b4-6a0a20ad_0] Write session will restart in 0.005159s
2025-09-30T14:52:55.594234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f5113f-e485fd4-dae368b4-6a0a20ad_0] Write session: Do CDS request
2025-09-30T14:52:55.594241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f5113f-e485fd4-dae368b4-6a0a20ad_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:55.600750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f5113f-e485fd4-dae368b4-6a0a20ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:55.600848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:55.600866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1007
2025-09-30T14:52:55.601647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1007 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:55.601695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1007 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:55.601705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1007 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:55.601709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:55.602280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1007 sessionId:  describe result for acl check
2025-09-30T14:52:55.602323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:55.602331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:55.602333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:55.602338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895340327009217:4992] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:55.602862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895340327009217:4992] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:55.604350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:55.604687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895340327009217:4992] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:55.605932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:55.606087Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:55.606094Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:55.606102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:55.606161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:55.606205Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895340237262074:6727]
2025-09-30T14:52:55.606739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:55.607036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:55.607075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:55.607119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895340327009217:4992] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:55.607134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895340327009217:4992] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:55.607137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895340327009217:4992] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:55.607145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1007 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:55.607406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:55.607452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:55.607457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:55.607457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:55.607458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:55.607459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:55.607459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:55.607460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:55.607461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:55.607461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:55.607462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:55.607464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.607464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.607465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.607466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:55.607466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:55.607470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:55.607476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:55.607478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:55.607480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:55.607483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:55.607485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:55.607490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:55.607493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:55.607497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:55.607501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:55.607504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.607508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.607512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.607516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:55.607520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:55.607526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:55.607533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:55.607539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:55.607544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:55.607549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:55.607554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:55.607559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:55.607564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:55.607568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:55.607574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:55.607579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:55.607584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:55.607589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:55.607594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:55.607599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:55.607604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:55.607608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:55.607614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:55.607618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:55.607623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:55.607628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.607633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.607637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.607642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.607647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.607652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.607661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:55.607666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:55.607671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:55.607677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:55.607701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:55.612874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:55.613731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:55.613747Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:55.613749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:55.613753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:55.613758Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1006 [2:7555895340237262074:6727]
2025-09-30T14:52:55.613772Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:55.613787Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:55.613791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:55.613793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:55.613796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:55.613811Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:55.613818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:55.613824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:55.613873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.613881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.613883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.613886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:55.613889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:55.613950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:55.613957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.613969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.613982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.614002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:55.614022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895340327009257:4992], now have 1 active actors on pipe
2025-09-30T14:52:55.614030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895340327009170:2454], now have 1 active actors on pipe
2025-09-30T14:52:55.614036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895340237262068:6727]
2025-09-30T14:52:55.614038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895340237262068:6727]
2025-09-30T14:52:55.614042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895340237262068:6727]
2025-09-30T14:52:55.614053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:55.614069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:55.614070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:55.614074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:55.614077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:55.614089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:55.614092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:55.614117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895340237262068:6727]
2025-09-30T14:52:55.614129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:55.614133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1006
2025-09-30T14:52:55.614151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:55.614135Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1006
2025-09-30T14:52:55.614232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:55.614241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:55.614267Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c4fab06-3fa84522-776d0529-c4f64d06_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:55.614280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:55.614283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:55.614285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:55.614293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:55.614301Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:55.614313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:55.614534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:55.614541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:55.614553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:55.614660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1007 partition: 0 MaxSeqNo: 42 sessionId: src_id|8c4fab06-3fa84522-776d0529-c4f64d06_0
2025-09-30T14:52:55.615007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f5113f-e485fd4-dae368b4-6a0a20ad_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8c4fab06-3fa84522-776d0529-c4f64d06_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:55.618167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c4fab06-3fa84522-776d0529-c4f64d06_0] Write session: try to update token
2025-09-30T14:52:55.618202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c4fab06-3fa84522-776d0529-c4f64d06_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:55.625960Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:55.625977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:55.625987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895340237262068:6727]
2025-09-30T14:52:55.626032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:55.626043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:55.626245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:55.626391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:55.626539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:55.626692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:55.626897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:55.626939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:55.632533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1007 sessionId: src_id|8c4fab06-3fa84522-776d0529-c4f64d06_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:55.635183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:55.635435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:55.635458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:55.635496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:55.635611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:55.636981Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:55.636997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:55.637001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:55.637003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:55.637012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895340237262068:6727]
2025-09-30T14:52:55.637020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895340237262068:6727]
2025-09-30T14:52:55.637024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895340237262068:6727]
2025-09-30T14:52:55.637063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:55.637069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:55.637075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.637076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:55.637078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:55.637081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:55.637211Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:55.693989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895340327009266:5026]
2025-09-30T14:52:55.694320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1006, pipe: [1:7555895340327009266:5026]
2025-09-30T14:52:55.752070Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:55.760408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:55.760438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:55.760617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:55.760691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:55.760757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:55.760831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:55.760886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:55.760897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:55.760972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:55.761047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:55.761113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:55.761186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:55.761241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:55.761249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:55.761320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:55.761393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:55.761459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:55.761532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:55.761580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:55.761587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:55.761657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:55.761723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:55.761788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:55.761857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:55.761903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:55.761912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:55.761983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:55.762053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:55.762118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:55.762195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:55.762242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:55.762250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:55.762321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:55.762385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:55.762460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:55.762524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:55.762570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:55.762580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:55.762646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:55.762705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:55.762767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:55.762828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:55.762870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:55.762876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:55.762941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:55.763015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:55.763084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:55.763150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:55.763193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:55.763203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:55.763288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:55.763346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:55.763403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:55.763472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:55.763526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:55.763532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:55.763596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:55.763654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:55.763716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:55.763784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:55.763825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:55.763830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:55.763899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895340327009266:5026], now have 1 active actors on pipe
2025-09-30T14:52:55.764137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:55.764139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895340327009266:5026]
2025-09-30T14:52:55.764156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:55.764163Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:55.764187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1007 reason: error at write: Disconnected sessionId: src_id|8c4fab06-3fa84522-776d0529-c4f64d06_0
2025-09-30T14:52:55.764377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1007 sessionId: src_id|8c4fab06-3fa84522-776d0529-c4f64d06_0 is DEAD
2025-09-30T14:52:55.764516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c4fab06-3fa84522-776d0529-c4f64d06_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:55.764529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c4fab06-3fa84522-776d0529-c4f64d06_0] Write session will restart in 0.008993s
2025-09-30T14:52:55.764553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c4fab06-3fa84522-776d0529-c4f64d06_0] Write session: Do CDS request
2025-09-30T14:52:55.764559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c4fab06-3fa84522-776d0529-c4f64d06_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:55.765124Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:55.773815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:55.774730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c4fab06-3fa84522-776d0529-c4f64d06_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:55.774839Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:55.774860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1008
2025-09-30T14:52:55.775007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1008 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:55.775043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1008 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:55.775048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1008 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:55.775062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:55.775810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:55.775840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1008 sessionId:  describe result for acl check
2025-09-30T14:52:55.775876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:55.775883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:55.775885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:55.775891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895340327009320:4982] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:55.775984Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:55.775997Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:55.776008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:55.776063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:55.776109Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895340237262162:6730]
2025-09-30T14:52:55.776466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895340327009320:4982] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:55.776778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:55.777157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:55.777205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:55.777545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:55.777622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:55.777630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:55.777631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:55.777632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:55.777633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:55.777634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:55.777635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:55.777637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:55.777638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:55.777639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:55.777643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.777644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.777645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.777646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:55.777647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:55.777653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:55.777662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:55.777666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:55.777669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:55.777673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:55.777676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:55.777680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:55.777683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:55.777687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:55.777691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:55.777695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.777699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.777703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.777707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:55.777712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:55.777719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:55.777728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:55.777734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:55.777739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:55.777746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:55.777751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:55.777755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:55.777761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:55.777765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:55.777770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:55.777775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:55.777781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:55.777785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:55.777791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:55.777794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:55.777800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:55.777806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:55.777811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:55.777815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:55.777820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:55.777824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.777829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.777832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.777836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.777840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.777845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.777848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:55.777853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:55.777857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:55.777863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:55.777905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:55.779475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895340327009320:4982] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:55.785927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895340327009320:4982] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:55.785948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895340327009320:4982] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:55.785952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895340327009320:4982] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:55.785961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1008 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:55.786075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:55.786960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:55.786978Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:55.786981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:55.786998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:55.787005Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1007 [2:7555895340237262162:6730]
2025-09-30T14:52:55.787019Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:55.787044Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:55.787047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:55.787051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:55.787053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:55.787072Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:55.787079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:55.787089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:55.787161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.787169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.787171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.787173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:55.787176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:55.787357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:55.787366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.787380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.787391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.787406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:55.787431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895340327009268:2454], now have 1 active actors on pipe
2025-09-30T14:52:55.787402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1007
2025-09-30T14:52:55.787435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895340327009358:4982], now have 1 active actors on pipe
2025-09-30T14:52:55.787435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1007
2025-09-30T14:52:55.787442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895340237262157:6730]
2025-09-30T14:52:55.787445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895340237262157:6730]
2025-09-30T14:52:55.787447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895340237262157:6730]
2025-09-30T14:52:55.787456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:55.787469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:55.787475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:55.787484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:55.787486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:55.787487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:55.787489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:55.787543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:55.787555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:55.787568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895340237262157:6730]
2025-09-30T14:52:55.787582Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:55.787608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:55.787621Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|342f210-8f022607-a7be4f68-aaeb6a6a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:55.787629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:55.787638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:55.787640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:55.787651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:55.787661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:55.787684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:55.787826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:55.787836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:55.787851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:55.787927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1008 partition: 0 MaxSeqNo: 42 sessionId: src_id|342f210-8f022607-a7be4f68-aaeb6a6a_0
2025-09-30T14:52:55.788271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c4fab06-3fa84522-776d0529-c4f64d06_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|342f210-8f022607-a7be4f68-aaeb6a6a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:55.790998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|342f210-8f022607-a7be4f68-aaeb6a6a_0] Write session: try to update token
2025-09-30T14:52:55.791017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|342f210-8f022607-a7be4f68-aaeb6a6a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:55.799737Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:55.799769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:55.799771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:55.799773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:55.799782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895340237262157:6730]
2025-09-30T14:52:55.799787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895340237262157:6730]
2025-09-30T14:52:55.799791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895340237262157:6730]
2025-09-30T14:52:55.799829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:55.799837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.799836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:55.799839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:55.799842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:55.799846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:55.799981Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:55.805447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1008 sessionId: src_id|342f210-8f022607-a7be4f68-aaeb6a6a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:55.808430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:55.865345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895340327009388:5026]
2025-09-30T14:52:55.865707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1007, pipe: [1:7555895340327009388:5026]
2025-09-30T14:52:55.915175Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:55.915568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:55.915586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:55.915626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895340327009388:5026], now have 1 active actors on pipe
2025-09-30T14:52:55.915916Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:55.915915Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:55.915934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895340327009388:5026]
2025-09-30T14:52:55.915960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:55.915963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:55.916027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1008 reason: error at write: Disconnected sessionId: src_id|342f210-8f022607-a7be4f68-aaeb6a6a_0
2025-09-30T14:52:55.916224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1008 sessionId: src_id|342f210-8f022607-a7be4f68-aaeb6a6a_0 is DEAD
2025-09-30T14:52:55.916411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|342f210-8f022607-a7be4f68-aaeb6a6a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:55.916422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|342f210-8f022607-a7be4f68-aaeb6a6a_0] Write session will restart in 0.005014s
2025-09-30T14:52:55.916457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|342f210-8f022607-a7be4f68-aaeb6a6a_0] Write session: Do CDS request
2025-09-30T14:52:55.916466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|342f210-8f022607-a7be4f68-aaeb6a6a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:55.922703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|342f210-8f022607-a7be4f68-aaeb6a6a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:55.922772Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:55.922800Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1009
2025-09-30T14:52:55.922932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1009 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:55.922976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1009 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:55.922989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1009 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:55.922994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:55.924361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1009 sessionId:  describe result for acl check
2025-09-30T14:52:55.924404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:55.924415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:55.924417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:55.924423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895340327009439:4972] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:55.924899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895340327009439:4972] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:55.926606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:55.926920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895340327009439:4972] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:55.928451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:55.928649Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:55.928663Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:55.928675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:55.928741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:55.928780Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895340237262288:6744]
2025-09-30T14:52:55.929426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:55.929727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:55.929773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895340327009439:4972] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:55.929774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:55.929790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895340327009439:4972] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:55.929793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895340327009439:4972] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:55.929801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1009 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:55.930088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:55.930145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:55.930151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:55.930152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:55.930153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:55.930154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:55.930155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:55.930157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:55.930158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:55.930159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:55.930160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:55.930161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.930162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.930163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.930164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:55.930165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:55.930171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:55.930181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:55.930195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:55.930199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:55.930203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:55.930207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:55.930212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:55.930217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:55.930221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:55.930225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:55.930229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.930232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.930235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.930239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:55.930243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:55.930252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:55.930259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:55.930265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:55.930270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:55.930275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:55.930280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:55.930284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:55.930290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:55.930294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:55.930300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:55.930304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:55.930309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:55.930319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:55.930325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:55.930329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:55.930335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:55.930339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:55.930349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:55.930354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:55.930360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:55.930369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.930375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.930379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.930384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.930388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.930392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.930396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:55.930401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:55.930405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:55.930411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:55.930456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:55.936163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:55.937061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:55.937087Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:55.937090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:55.937094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:55.937101Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1008 [2:7555895340237262288:6744]
2025-09-30T14:52:55.937120Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:55.937142Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:55.937151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:55.937154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:55.937156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:55.937173Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:55.937180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:55.937186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:55.937254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.937272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.937277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.937280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:55.937282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:55.937354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:55.937365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.937379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:55.937398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:55.937415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:55.937436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895340327009479:4972], now have 1 active actors on pipe
2025-09-30T14:52:55.937439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895340327009390:2454], now have 1 active actors on pipe
2025-09-30T14:52:55.937445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895340237262282:6744]
2025-09-30T14:52:55.937450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895340237262282:6744]
2025-09-30T14:52:55.937452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895340237262282:6744]
2025-09-30T14:52:55.937466Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:55.937482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:55.937491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:55.937497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:55.937500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:55.937502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:55.937504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:55.937537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895340237262282:6744]
2025-09-30T14:52:55.937540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:55.937544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:55.937470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1008
2025-09-30T14:52:55.937472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1008
2025-09-30T14:52:55.937558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:55.937574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:55.937628Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf8bf2d3-8085e169-958d42bd-12ebe901_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:55.937643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:55.937647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:55.937649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:55.937658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:55.937669Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:55.937696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:55.937889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:55.937899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:55.937918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:55.938035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1009 partition: 0 MaxSeqNo: 42 sessionId: src_id|cf8bf2d3-8085e169-958d42bd-12ebe901_0
2025-09-30T14:52:55.938389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|342f210-8f022607-a7be4f68-aaeb6a6a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cf8bf2d3-8085e169-958d42bd-12ebe901_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:55.941175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf8bf2d3-8085e169-958d42bd-12ebe901_0] Write session: try to update token
2025-09-30T14:52:55.941196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf8bf2d3-8085e169-958d42bd-12ebe901_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:55.950278Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:55.950302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:55.950305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:55.950311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:55.950321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895340237262282:6744]
2025-09-30T14:52:55.950326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895340237262282:6744]
2025-09-30T14:52:55.950331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895340237262282:6744]
2025-09-30T14:52:55.950373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:55.950381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:55.950384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:55.950396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:55.950405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:55.950409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:55.950530Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:55.957034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1009 sessionId: src_id|cf8bf2d3-8085e169-958d42bd-12ebe901_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:55.960194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:56.016067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895344621976789:5026]
2025-09-30T14:52:56.016359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1008, pipe: [1:7555895344621976789:5026]
2025-09-30T14:52:56.065726Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:56.066167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:56.066196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:56.066233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895344621976789:5026], now have 1 active actors on pipe
2025-09-30T14:52:56.066409Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:56.066416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:56.066577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895344621976789:5026]
2025-09-30T14:52:56.066603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:56.066607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:56.066662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1009 reason: error at write: Disconnected sessionId: src_id|cf8bf2d3-8085e169-958d42bd-12ebe901_0
2025-09-30T14:52:56.066986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf8bf2d3-8085e169-958d42bd-12ebe901_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:56.066995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf8bf2d3-8085e169-958d42bd-12ebe901_0] Write session will restart in 0.009062s
2025-09-30T14:52:56.067018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf8bf2d3-8085e169-958d42bd-12ebe901_0] Write session: Do CDS request
2025-09-30T14:52:56.066835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1009 sessionId: src_id|cf8bf2d3-8085e169-958d42bd-12ebe901_0 is DEAD
2025-09-30T14:52:56.067023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf8bf2d3-8085e169-958d42bd-12ebe901_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:56.076018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:56.077654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:56.077749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf8bf2d3-8085e169-958d42bd-12ebe901_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:56.077871Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:56.077883Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:56.077894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:56.077971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:56.078012Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895344532229685:6747]
2025-09-30T14:52:56.077835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:56.077855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1010
2025-09-30T14:52:56.077982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1010 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:56.078008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1010 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:56.078013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1010 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:56.078017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:56.078464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1010 sessionId:  describe result for acl check
2025-09-30T14:52:56.078499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:56.078506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:56.078508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:56.078513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895344621976847:4963] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:56.078671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:56.078960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:56.079038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:56.079079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895344621976847:4963] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:56.079422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:56.079507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:56.079516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:56.079518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:56.079519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:56.079520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:56.079521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:56.079522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:56.079524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:56.079525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:56.079526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:56.079527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.079528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.079529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.079530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:56.079531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:56.079538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:56.079548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:56.079553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:56.079557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:56.079562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:56.079567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:56.079571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:56.079575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:56.079580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:56.079584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:56.079589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.079593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.079597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.079602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:56.079606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:56.079614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:56.079624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:56.079631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:56.079637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:56.079642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:56.079647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:56.079651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:56.079656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:56.079661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:56.079667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:56.079671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:56.079677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:56.079683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:56.079698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:56.079703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:56.079710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:56.079715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:56.079720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:56.079726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:56.079732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:56.079738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.079744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.079750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.079763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.079768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.079778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.079783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:56.079792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:56.079798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:56.079804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:56.079857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:56.081101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895344621976847:4963] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:56.085169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895344621976847:4963] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:56.085187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895344621976847:4963] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:56.085191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895344621976847:4963] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:56.085200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1010 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:56.085526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:56.086508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:56.086527Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:56.086532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:56.086536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:56.086543Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1009 [2:7555895344532229685:6747]
2025-09-30T14:52:56.086559Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:56.086573Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:56.086581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:56.086584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:56.086587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:56.086601Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:56.086608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:56.086618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:56.086676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.086684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.086687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.086691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:56.086693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:56.086771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:56.086779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.086793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.086810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.086829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:56.086849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895344621976793:2454], now have 1 active actors on pipe
2025-09-30T14:52:56.086858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895344621976888:4963], now have 1 active actors on pipe
2025-09-30T14:52:56.086864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895344532229680:6747]
2025-09-30T14:52:56.086866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895344532229680:6747]
2025-09-30T14:52:56.086869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895344532229680:6747]
2025-09-30T14:52:56.086883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:56.086896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:56.086901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:56.086905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:56.086907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:56.086916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:56.086919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:56.086951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895344532229680:6747]
2025-09-30T14:52:56.086965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:56.086971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:56.086991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1009
2025-09-30T14:52:56.086994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1009
2025-09-30T14:52:56.087124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:56.087134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:56.087160Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|feb6ed04-ce4020d7-2ad7e084-f2b6f8c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:56.087172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:56.087175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:56.087179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:56.087191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:56.087208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:56.087221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:56.087445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:56.087457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:56.087474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:56.087596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1010 partition: 0 MaxSeqNo: 42 sessionId: src_id|feb6ed04-ce4020d7-2ad7e084-f2b6f8c_0
2025-09-30T14:52:56.091504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf8bf2d3-8085e169-958d42bd-12ebe901_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|feb6ed04-ce4020d7-2ad7e084-f2b6f8c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:56.094249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|feb6ed04-ce4020d7-2ad7e084-f2b6f8c_0] Write session: try to update token
2025-09-30T14:52:56.094270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|feb6ed04-ce4020d7-2ad7e084-f2b6f8c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:56.099732Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:56.099756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:56.099759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:56.099762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:56.099771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895344532229680:6747]
2025-09-30T14:52:56.099775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895344532229680:6747]
2025-09-30T14:52:56.099779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895344532229680:6747]
2025-09-30T14:52:56.099823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:56.099829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.099832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:56.099916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:56.099930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:56.099934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:56.099983Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:56.109968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1010 sessionId: src_id|feb6ed04-ce4020d7-2ad7e084-f2b6f8c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:56.112849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:56.166610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895344621976907:5026]
2025-09-30T14:52:56.167299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1009, pipe: [1:7555895344621976907:5026]
2025-09-30T14:52:56.218535Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:56.218913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:56.218932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:56.218951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895344621976907:5026], now have 1 active actors on pipe
2025-09-30T14:52:56.219298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895344621976907:5026]
2025-09-30T14:52:56.219330Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:56.219338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:56.219343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:56.219407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1010 reason: error at write: Disconnected sessionId: src_id|feb6ed04-ce4020d7-2ad7e084-f2b6f8c_0
2025-09-30T14:52:56.219596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1010 sessionId: src_id|feb6ed04-ce4020d7-2ad7e084-f2b6f8c_0 is DEAD
2025-09-30T14:52:56.219292Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:56.220046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feb6ed04-ce4020d7-2ad7e084-f2b6f8c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:56.220069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feb6ed04-ce4020d7-2ad7e084-f2b6f8c_0] Write session will restart in 0.007183s
2025-09-30T14:52:56.220094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feb6ed04-ce4020d7-2ad7e084-f2b6f8c_0] Write session: Do CDS request
2025-09-30T14:52:56.220103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feb6ed04-ce4020d7-2ad7e084-f2b6f8c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:56.228780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|feb6ed04-ce4020d7-2ad7e084-f2b6f8c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:56.228841Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:56.228863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1011
2025-09-30T14:52:56.229062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1011 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:56.229109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1011 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:56.229119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1011 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:56.229123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:56.229545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1011 sessionId:  describe result for acl check
2025-09-30T14:52:56.229580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:56.229587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:56.229591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:56.229597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895344621976960:4958] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:56.230122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895344621976960:4958] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:56.230673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:56.232390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895344621976960:4958] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:56.233028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:56.233259Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:56.233270Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:56.233281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:56.233334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:56.233378Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895344532229779:6750]
2025-09-30T14:52:56.233886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:56.234192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:56.234236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:56.234554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:56.234631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:56.234639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:56.234640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:56.234641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:56.234643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:56.234644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:56.234645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:56.234647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:56.234648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:56.234649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:56.234651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.234653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.234654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.234655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:56.234656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:56.234662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:56.234674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:56.234679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:56.234683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:56.234688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:56.234692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:56.234695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:56.234700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:56.234703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:56.234708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:56.234711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.234715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.234720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.234724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:56.234727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:56.234736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:56.234744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:56.234750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:56.234756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:56.234761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:56.234766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:56.234770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:56.234775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:56.234780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:56.234785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:56.234789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:56.234794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:56.234801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:56.234806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:56.234810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:56.234814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:56.234819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:56.234825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:56.234830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:56.234837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:56.234843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.234849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.234853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.234858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.234863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.234868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.234873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:56.234879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:56.234885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:56.234892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:56.234936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:56.235048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895344621976960:4958] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:56.235071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895344621976960:4958] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:56.235075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895344621976960:4958] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:56.235085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1011 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:56.240879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:56.241767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:56.241781Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:56.241784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:56.241787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:56.241792Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1010 [2:7555895344532229779:6750]
2025-09-30T14:52:56.241805Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:56.241820Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:56.241822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:56.241824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:56.241826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:56.241841Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:56.241848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:56.241859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:56.241917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.241926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.241928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.241931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:56.241934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:56.242006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:56.242016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.242029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.242042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.242065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:56.242087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895344621977000:4958], now have 1 active actors on pipe
2025-09-30T14:52:56.242096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895344621976909:2454], now have 1 active actors on pipe
2025-09-30T14:52:56.242103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895344532229773:6750]
2025-09-30T14:52:56.242106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895344532229773:6750]
2025-09-30T14:52:56.242108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895344532229773:6750]
2025-09-30T14:52:56.242123Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:56.242134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:56.242137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:56.242141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:56.242143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:56.242154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:56.242158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:56.242127Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1010
2025-09-30T14:52:56.242142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1010
2025-09-30T14:52:56.242225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:56.242234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:56.242247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895344532229773:6750]
2025-09-30T14:52:56.242261Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:56.242266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:56.242295Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b58cbbdc-aeaefe74-5fa2644f-13db321b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:56.242307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:56.242310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:56.242317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:56.242326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:56.242336Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:56.242365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:56.242602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:56.242616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:56.242638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:56.242749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1011 partition: 0 MaxSeqNo: 42 sessionId: src_id|b58cbbdc-aeaefe74-5fa2644f-13db321b_0
2025-09-30T14:52:56.243201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feb6ed04-ce4020d7-2ad7e084-f2b6f8c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b58cbbdc-aeaefe74-5fa2644f-13db321b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:56.246382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b58cbbdc-aeaefe74-5fa2644f-13db321b_0] Write session: try to update token
2025-09-30T14:52:56.246400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b58cbbdc-aeaefe74-5fa2644f-13db321b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:56.255803Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:56.255824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:56.255827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:56.255829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:56.255839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895344532229773:6750]
2025-09-30T14:52:56.255848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895344532229773:6750]
2025-09-30T14:52:56.255852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895344532229773:6750]
2025-09-30T14:52:56.255898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:56.255906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:56.255911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.255915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:56.255917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:56.255920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:56.256073Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:56.263849Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1011 sessionId: src_id|b58cbbdc-aeaefe74-5fa2644f-13db321b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:56.266764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:56.319674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895344621977010:5026]
2025-09-30T14:52:56.320098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1010, pipe: [1:7555895344621977010:5026]
2025-09-30T14:52:56.372821Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:56.373269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:56.373287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:56.373309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895344621977010:5026], now have 1 active actors on pipe
2025-09-30T14:52:56.373565Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:56.373896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:56.373990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:56.374012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1011 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b58cbbdc-aeaefe74-5fa2644f-13db321b_0
2025-09-30T14:52:56.374090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895344621977010:5026]
2025-09-30T14:52:56.374195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1011 sessionId: src_id|b58cbbdc-aeaefe74-5fa2644f-13db321b_0 is DEAD
2025-09-30T14:52:56.374376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b58cbbdc-aeaefe74-5fa2644f-13db321b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:56.374388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b58cbbdc-aeaefe74-5fa2644f-13db321b_0] Write session will restart in 0.005642s
2025-09-30T14:52:56.374412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b58cbbdc-aeaefe74-5fa2644f-13db321b_0] Write session: Do CDS request
2025-09-30T14:52:56.374418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b58cbbdc-aeaefe74-5fa2644f-13db321b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:56.380781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b58cbbdc-aeaefe74-5fa2644f-13db321b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:56.380883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:56.380908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1012
2025-09-30T14:52:56.381127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1012 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:56.381183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1012 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:56.381203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1012 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:56.381209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:56.381794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1012 sessionId:  describe result for acl check
2025-09-30T14:52:56.381845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:56.381853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:56.381855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:56.381862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895344621977038:4954] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:56.382546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895344621977038:4954] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:56.384554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895344621977038:4954] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:56.385314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:56.387906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:56.388174Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:56.388193Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:56.388218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:56.388406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895344621977038:4954] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:56.388427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895344621977038:4954] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:56.388431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895344621977038:4954] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:56.388440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1012 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:56.388295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:56.388357Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895344532229871:6752]
2025-09-30T14:52:56.389138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:56.390520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:56.390593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:56.390996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:56.391094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:56.391103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:56.391104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:56.391106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:56.391107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:56.391108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:56.391109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:56.391111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:56.391112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:56.391113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:56.391114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.391116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.391118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.391119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:56.391120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:56.391127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:56.391139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:56.391144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:56.391149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:56.391153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:56.391158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:56.391162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:56.391167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:56.391171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:56.391175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:56.391180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.391184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.391188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.391192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:56.391197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:56.391210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:56.391219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:56.391232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:56.391238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:56.391263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:56.391269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:56.391274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:56.391280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:56.391285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:56.391293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:56.391302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:56.391307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:56.391313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:56.391322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:56.391327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:56.391332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:56.391338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:56.391358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:56.391369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:56.391375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:56.391381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.391387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.391392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.391404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.391409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.391416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.391421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:56.391432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:56.391437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:56.391442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:56.391489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:56.398995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:56.400067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:56.400085Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:56.400089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:56.400094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:56.400103Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1011 [2:7555895344532229871:6752]
2025-09-30T14:52:56.400125Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:56.400141Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:56.400144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:56.400147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:56.400148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:56.400165Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:56.400171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:56.400178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:56.400257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.400266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.400268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.400272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:56.400275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:56.400360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:56.400369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.400385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.400402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.400425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:56.400458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895344621977011:2454], now have 1 active actors on pipe
2025-09-30T14:52:56.400469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895344621977102:4954], now have 1 active actors on pipe
2025-09-30T14:52:56.400478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895344532229865:6752]
2025-09-30T14:52:56.400481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895344532229865:6752]
2025-09-30T14:52:56.400486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895344532229865:6752]
2025-09-30T14:52:56.400497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:56.400515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:56.400509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:56.400521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:56.400524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:56.400538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:56.400542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:56.400583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895344532229865:6752]
2025-09-30T14:52:56.400596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:56.400602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:56.400579Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1011
2025-09-30T14:52:56.400596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1011
2025-09-30T14:52:56.400762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:56.400772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:56.400804Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5244d8d-4fb5047-a0539ae-e7c18a00_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:56.400820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:56.400824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:56.400826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:56.400849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:56.400865Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:56.400877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:56.401100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:56.401126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:56.401158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:56.401285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1012 partition: 0 MaxSeqNo: 42 sessionId: src_id|5244d8d-4fb5047-a0539ae-e7c18a00_0
2025-09-30T14:52:56.401618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b58cbbdc-aeaefe74-5fa2644f-13db321b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5244d8d-4fb5047-a0539ae-e7c18a00_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:56.404677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5244d8d-4fb5047-a0539ae-e7c18a00_0] Write session: try to update token
2025-09-30T14:52:56.404698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5244d8d-4fb5047-a0539ae-e7c18a00_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:56.425028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1012 sessionId: src_id|5244d8d-4fb5047-a0539ae-e7c18a00_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:56.425551Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:56.425571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:56.425580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895344532229865:6752]
2025-09-30T14:52:56.425645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:56.426954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:56.427187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:56.427384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:56.427550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:56.427707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:56.427989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:56.428099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:56.428156Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:56.428164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:56.428167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:56.428169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:56.428178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895344532229865:6752]
2025-09-30T14:52:56.428182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895344532229865:6752]
2025-09-30T14:52:56.428186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895344532229865:6752]
2025-09-30T14:52:56.428231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:56.428270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:56.428282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:56.428287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:56.428346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:56.428358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.428361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:56.428499Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:56.474285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895344621977113:5026]
2025-09-30T14:52:56.474662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1011, pipe: [1:7555895344621977113:5026]
2025-09-30T14:52:56.552351Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:56.552728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:56.552746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:56.552766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895344621977113:5026], now have 1 active actors on pipe
2025-09-30T14:52:56.553045Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:56.553367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895344621977113:5026]
2025-09-30T14:52:56.553402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:56.553470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1012 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5244d8d-4fb5047-a0539ae-e7c18a00_0
2025-09-30T14:52:56.553640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1012 sessionId: src_id|5244d8d-4fb5047-a0539ae-e7c18a00_0 is DEAD
2025-09-30T14:52:56.553796Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:56.555542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5244d8d-4fb5047-a0539ae-e7c18a00_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:56.555556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5244d8d-4fb5047-a0539ae-e7c18a00_0] Write session will restart in 0.006993s
2025-09-30T14:52:56.555582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5244d8d-4fb5047-a0539ae-e7c18a00_0] Write session: Do CDS request
2025-09-30T14:52:56.555588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5244d8d-4fb5047-a0539ae-e7c18a00_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:56.563800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5244d8d-4fb5047-a0539ae-e7c18a00_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:56.563911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:56.563947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1013
2025-09-30T14:52:56.564170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1013 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:56.564227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1013 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:56.564239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1013 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:56.564243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:56.564666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1013 sessionId:  describe result for acl check
2025-09-30T14:52:56.564700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:56.564710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:56.564715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:56.564721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895344621977130:4951] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:56.565319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895344621977130:4951] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:56.567390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895344621977130:4951] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:56.570526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895344621977130:4951] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:56.570544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895344621977130:4951] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:56.570548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895344621977130:4951] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:56.570557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1013 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:56.571757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:56.573522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:56.573725Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:56.573747Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:56.573759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:56.573849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:56.573892Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895344532229969:6754]
2025-09-30T14:52:56.574608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:56.574962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:56.575013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:56.575365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:56.575433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:56.575434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:56.575435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:56.575436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:56.575438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:56.575439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:56.575440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:56.575442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:56.575443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:56.575445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:56.575446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.575447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.575448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.575450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:56.575451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:56.575457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:56.575468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:56.575472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:56.575476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:56.575481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:56.575485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:56.575494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:56.575498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:56.575502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:56.575506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:56.575510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.575514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.575518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.575522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:56.575526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:56.575534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:56.575542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:56.575548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:56.575553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:56.575558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:56.575564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:56.575568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:56.575573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:56.575578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:56.575583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:56.575587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:56.575592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:56.575597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:56.575602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:56.575607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:56.575612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:56.575618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:56.575623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:56.575628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:56.575634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:56.575639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.575644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.575650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.575655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.575660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.575667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.575672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:56.575677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:56.575683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:56.575689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:56.575735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:56.582818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1012
2025-09-30T14:52:56.582879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1012
2025-09-30T14:52:56.581459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:56.582403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:56.582411Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:56.582414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:56.582419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:56.582427Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1012 [2:7555895344532229969:6754]
2025-09-30T14:52:56.582447Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:56.582462Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:56.582466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:56.582469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:56.582472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:56.582490Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:56.582496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:56.582503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:56.582565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.582567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.582569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.582572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:56.582575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:56.582643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:56.582645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.582659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.582668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.582685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:56.582704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895344621977122:2454], now have 1 active actors on pipe
2025-09-30T14:52:56.582707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895344621977211:4951], now have 1 active actors on pipe
2025-09-30T14:52:56.582714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895344532229964:6754]
2025-09-30T14:52:56.582717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895344532229964:6754]
2025-09-30T14:52:56.582718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895344532229964:6754]
2025-09-30T14:52:56.582732Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:56.582748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:56.582758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:56.582763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:56.582764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:56.582766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:56.582766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:56.582801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895344532229964:6754]
2025-09-30T14:52:56.582807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:56.582814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:56.582965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:56.582970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:56.582994Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b448c7dc-ff6cf30d-ca59fa2f-b7559097_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:56.583001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:56.583004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:56.583006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:56.583016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:56.583025Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:56.583041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:56.583213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:56.583217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:56.583233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:56.583373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1013 partition: 0 MaxSeqNo: 42 sessionId: src_id|b448c7dc-ff6cf30d-ca59fa2f-b7559097_0
2025-09-30T14:52:56.583737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5244d8d-4fb5047-a0539ae-e7c18a00_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b448c7dc-ff6cf30d-ca59fa2f-b7559097_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:56.586545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b448c7dc-ff6cf30d-ca59fa2f-b7559097_0] Write session: try to update token
2025-09-30T14:52:56.586567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b448c7dc-ff6cf30d-ca59fa2f-b7559097_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:56.596340Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:56.596359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:56.596362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:56.596365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:56.596374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895344532229964:6754]
2025-09-30T14:52:56.596378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895344532229964:6754]
2025-09-30T14:52:56.596385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895344532229964:6754]
2025-09-30T14:52:56.596419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:56.596425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:56.596425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:56.596430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:56.596433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.596435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:56.596588Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:56.605160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1013 sessionId: src_id|b448c7dc-ff6cf30d-ca59fa2f-b7559097_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:56.607955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:56.653524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895344621977225:5026]
2025-09-30T14:52:56.654041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1012, pipe: [1:7555895344621977225:5026]
2025-09-30T14:52:56.715543Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:56.715869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:56.715885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:56.715925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895344621977225:5026], now have 1 active actors on pipe
2025-09-30T14:52:56.716186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:56.716219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895344621977225:5026]
2025-09-30T14:52:56.716242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:56.716245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:56.716246Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:56.716307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1013 reason: error at write: Disconnected sessionId: src_id|b448c7dc-ff6cf30d-ca59fa2f-b7559097_0
2025-09-30T14:52:56.716475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1013 sessionId: src_id|b448c7dc-ff6cf30d-ca59fa2f-b7559097_0 is DEAD
2025-09-30T14:52:56.716649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b448c7dc-ff6cf30d-ca59fa2f-b7559097_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:56.716660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b448c7dc-ff6cf30d-ca59fa2f-b7559097_0] Write session will restart in 0.005761s
2025-09-30T14:52:56.716684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b448c7dc-ff6cf30d-ca59fa2f-b7559097_0] Write session: Do CDS request
2025-09-30T14:52:56.716689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b448c7dc-ff6cf30d-ca59fa2f-b7559097_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:56.723714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b448c7dc-ff6cf30d-ca59fa2f-b7559097_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:56.723852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:56.723872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1014
2025-09-30T14:52:56.723999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1014 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:56.724026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1014 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:56.724032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1014 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:56.724037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:56.724442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1014 sessionId:  describe result for acl check
2025-09-30T14:52:56.724470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:56.724472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:56.724474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:56.724479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895344621977268:4946] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:56.725053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895344621977268:4946] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:56.726698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:56.727651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895344621977268:4946] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:56.728715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:56.728935Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:56.728945Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:56.728956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:56.729021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:56.729067Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895344532230065:6757]
2025-09-30T14:52:56.729718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:56.730029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:56.730078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:56.730453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:56.730519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895344621977268:4946] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:56.730539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:56.730535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895344621977268:4946] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:56.730546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:56.730537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895344621977268:4946] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:56.730547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:56.730548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:56.730545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1014 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:56.730549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:56.730551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:56.730552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:56.730553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:56.730554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:56.730555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:56.730556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.730557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.730559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.730560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:56.730561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:56.730566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:56.730577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:56.730582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:56.730586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:56.730589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:56.730594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:56.730598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:56.730602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:56.730607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:56.730611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:56.730615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.730619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.730623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.730627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:56.730631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:56.730639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:56.730647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:56.730653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:56.730659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:56.730663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:56.730669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:56.730678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:56.730684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:56.730694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:56.730700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:56.730709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:56.730715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:56.730719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:56.730728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:56.730733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:56.730738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:56.730742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:56.730748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:56.730752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:56.730758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:56.730763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.730768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.730773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.730778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.730789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.730795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.730799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:56.730809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:56.730814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:56.730825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:56.730869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:56.736757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:56.737848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:56.737868Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:56.737871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:56.737876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:56.737884Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1013 [2:7555895344532230065:6757]
2025-09-30T14:52:56.737905Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:56.737920Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:56.737928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:56.737932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:56.737935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:56.737954Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:56.737960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:56.737967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:56.738030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.738037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.738040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.738044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:56.738047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:56.738110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:56.738118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.738130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.738153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.738171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:56.738200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895344621977226:2454], now have 1 active actors on pipe
2025-09-30T14:52:56.738209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895344621977321:4946], now have 1 active actors on pipe
2025-09-30T14:52:56.738215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895344532230059:6757]
2025-09-30T14:52:56.738219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895344532230059:6757]
2025-09-30T14:52:56.738222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895344532230059:6757]
2025-09-30T14:52:56.738235Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:56.738252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:56.738256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:56.738257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:56.738260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:56.738270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:56.738273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:56.738274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1013
2025-09-30T14:52:56.738288Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1013
2025-09-30T14:52:56.738310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895344532230059:6757]
2025-09-30T14:52:56.738324Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:56.738334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:56.738363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:56.738368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:56.738391Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e1c8f96-686bd890-dc7647ba-f3d3ad90_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:56.738397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:56.738403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:56.738405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:56.738416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:56.738425Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:56.738438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:56.738743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:56.738761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:56.738788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:56.738905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1014 partition: 0 MaxSeqNo: 42 sessionId: src_id|3e1c8f96-686bd890-dc7647ba-f3d3ad90_0
2025-09-30T14:52:56.739287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b448c7dc-ff6cf30d-ca59fa2f-b7559097_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3e1c8f96-686bd890-dc7647ba-f3d3ad90_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:56.742209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1c8f96-686bd890-dc7647ba-f3d3ad90_0] Write session: try to update token
2025-09-30T14:52:56.742237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1c8f96-686bd890-dc7647ba-f3d3ad90_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:56.755117Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:56.755141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:56.755145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:56.755147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:56.755159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895344532230059:6757]
2025-09-30T14:52:56.755166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895344532230059:6757]
2025-09-30T14:52:56.755172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895344532230059:6757]
2025-09-30T14:52:56.755222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:56.755230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.755235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:56.755259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:56.755268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:56.755272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:56.755401Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:56.758317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1014 sessionId: src_id|3e1c8f96-686bd890-dc7647ba-f3d3ad90_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:56.761271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:56.816840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895344621977330:5026]
2025-09-30T14:52:56.817175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1013, pipe: [1:7555895344621977330:5026]
2025-09-30T14:52:56.865542Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:56.865820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:56.865834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:56.865869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895344621977330:5026], now have 1 active actors on pipe
2025-09-30T14:52:56.866058Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:56.866130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:56.866147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:56.866211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1014 reason: error at write: Disconnected sessionId: src_id|3e1c8f96-686bd890-dc7647ba-f3d3ad90_0
2025-09-30T14:52:56.866444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1014 sessionId: src_id|3e1c8f96-686bd890-dc7647ba-f3d3ad90_0 is DEAD
2025-09-30T14:52:56.866601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1c8f96-686bd890-dc7647ba-f3d3ad90_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:56.866611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1c8f96-686bd890-dc7647ba-f3d3ad90_0] Write session will restart in 0.005562s
2025-09-30T14:52:56.866636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1c8f96-686bd890-dc7647ba-f3d3ad90_0] Write session: Do CDS request
2025-09-30T14:52:56.866623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895344621977330:5026]
2025-09-30T14:52:56.866642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1c8f96-686bd890-dc7647ba-f3d3ad90_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:56.866664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:56.873834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1c8f96-686bd890-dc7647ba-f3d3ad90_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:56.874144Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:56.874164Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1015
2025-09-30T14:52:56.874287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1015 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:56.874318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1015 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:56.874326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1015 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:56.874330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:56.874746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1015 sessionId:  describe result for acl check
2025-09-30T14:52:56.874781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:56.874788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:56.874790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:56.874795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895344621977401:4925] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:56.874926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:56.875419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895344621977401:4925] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:56.876818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:56.877028Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:56.877041Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:56.877052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:56.877114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:56.877226Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895344532230173:6765]
2025-09-30T14:52:56.877599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895344621977401:4925] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:56.877837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:56.878158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:56.878228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:56.878543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:56.878626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:56.878634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:56.878635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:56.878636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:56.878637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:56.878638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:56.878639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:56.878640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:56.878641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:56.878644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:56.878645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.878646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.878647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.878648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:56.878649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:56.878655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:56.878664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:56.878668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:56.878671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:56.878675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:56.878678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:56.878682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:56.878685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:56.878689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:56.878693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:56.878697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.878700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.878704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.878707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:56.878711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:56.878717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:56.878725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:56.878730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:56.878736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:56.878740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:56.878746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:56.878751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:56.878756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:56.878761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:56.878766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:56.878773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:56.878778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:56.878783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:56.878788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:56.878792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:56.878798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:56.878803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:56.878808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:56.878818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:56.878823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:56.878827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.878833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.878837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.878842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.878846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.878850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.878856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:56.878861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:56.878867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:56.878877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:56.878923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:56.884819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895344621977401:4925] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:56.884837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895344621977401:4925] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:56.884841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895344621977401:4925] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:56.884850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1015 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:56.885047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:56.885996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:56.886011Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:56.886013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:56.886016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:56.886020Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1014 [2:7555895344532230173:6765]
2025-09-30T14:52:56.886031Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:56.886045Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:56.886047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:56.886049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:56.886050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:56.886062Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:56.886067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:56.886072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:56.886124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.886132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.886135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.886138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:56.886140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:56.886213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:56.886220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.886228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:56.886234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:56.886243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:56.886257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895344532230168:6765]
2025-09-30T14:52:56.886259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895344532230168:6765]
2025-09-30T14:52:56.886260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895344532230168:6765]
2025-09-30T14:52:56.886265Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:56.886277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895344621977344:2454], now have 1 active actors on pipe
2025-09-30T14:52:56.886285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:56.886287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:56.886291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:56.886293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:56.886295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:56.886296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:56.886300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895344621977440:4925], now have 1 active actors on pipe
2025-09-30T14:52:56.886325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895344532230168:6765]
2025-09-30T14:52:56.886333Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:56.886343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:56.886409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1014
2025-09-30T14:52:56.886447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1014
2025-09-30T14:52:56.886480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:56.886489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:56.886507Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0fca582-df7f9672-2ce71853-8716a385_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:56.886515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:56.886518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:56.886519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:56.886526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:56.886533Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:56.886545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:56.886701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:56.886713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:56.886729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:56.886813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1015 partition: 0 MaxSeqNo: 42 sessionId: src_id|b0fca582-df7f9672-2ce71853-8716a385_0
2025-09-30T14:52:56.887233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1c8f96-686bd890-dc7647ba-f3d3ad90_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b0fca582-df7f9672-2ce71853-8716a385_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:56.890124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fca582-df7f9672-2ce71853-8716a385_0] Write session: try to update token
2025-09-30T14:52:56.890143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fca582-df7f9672-2ce71853-8716a385_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:56.900771Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:56.900790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:56.900799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895344532230168:6765]
2025-09-30T14:52:56.900842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:56.900844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:56.901073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:56.901232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:56.901386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:56.901539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:56.901799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:56.901847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:56.905754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1015 sessionId: src_id|b0fca582-df7f9672-2ce71853-8716a385_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:56.908522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:56.908730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:56.908759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:56.908797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:56.908899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:56.914070Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:56.914088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:56.914090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:56.914093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:56.914107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895344532230168:6765]
2025-09-30T14:52:56.914111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895344532230168:6765]
2025-09-30T14:52:56.914115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895344532230168:6765]
2025-09-30T14:52:56.914150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:56.914157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:56.914160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:56.914162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:56.914168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:56.914172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:56.914309Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:56.966830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895344621977458:5026]
2025-09-30T14:52:56.967170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1014, pipe: [1:7555895344621977458:5026]
2025-09-30T14:52:57.023738Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:57.030830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:57.030858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:57.031006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:57.031063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:57.031118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:57.031177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:57.031401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:57.031414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:57.031480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:57.031533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:57.031592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:57.031832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:57.031877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:57.031883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:57.031942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:57.032000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:57.032058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:57.032149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:57.032193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:57.032200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:57.032260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:57.032319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:57.032386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:57.032454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:57.032500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:57.032508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:57.032572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:57.032628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:57.032683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:57.032737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:57.032780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:57.032785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:57.032846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:57.032906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:57.032966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:57.033025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:57.033066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:57.033073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:57.033137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:57.033194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:57.033254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:57.033315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:57.033366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:57.033377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:57.033447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:57.033504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:57.033562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:57.033625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:57.033674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:57.033681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:57.033745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:57.033801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:57.033862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:57.033928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:57.033970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:57.033976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:57.034035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:57.034089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:57.034149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:57.034222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:57.034263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:57.034268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:57.034321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895344621977458:5026], now have 1 active actors on pipe
2025-09-30T14:52:57.034633Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:57.034689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:57.034697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:57.034725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1015 reason: error at write: Disconnected sessionId: src_id|b0fca582-df7f9672-2ce71853-8716a385_0
2025-09-30T14:52:57.034790Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:57.034945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1015 sessionId: src_id|b0fca582-df7f9672-2ce71853-8716a385_0 is DEAD
2025-09-30T14:52:57.034989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895344621977458:5026]
2025-09-30T14:52:57.035112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fca582-df7f9672-2ce71853-8716a385_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:57.035122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fca582-df7f9672-2ce71853-8716a385_0] Write session will restart in 0.007038s
2025-09-30T14:52:57.035145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fca582-df7f9672-2ce71853-8716a385_0] Write session: Do CDS request
2025-09-30T14:52:57.035152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fca582-df7f9672-2ce71853-8716a385_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:57.042673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:57.043793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fca582-df7f9672-2ce71853-8716a385_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:57.043862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:57.043882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1016
2025-09-30T14:52:57.044003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1016 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:57.044035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1016 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:57.044044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1016 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:57.044048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:57.044243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:57.044390Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:57.044403Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:57.044413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:57.044463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:57.044464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1016 sessionId:  describe result for acl check
2025-09-30T14:52:57.044495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:57.044497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:57.044500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:57.044505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895348916944822:4915] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:57.044506Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895348827197590:6773]
2025-09-30T14:52:57.045112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:57.045377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895348916944822:4915] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:57.045431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:57.045475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:57.045774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:57.045837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:57.045843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:57.045845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:57.045845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:57.045846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:57.045848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:57.045849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:57.045850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:57.045851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:57.045852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:57.045853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.045854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.045855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.045856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:57.045857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:57.045861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:57.045870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:57.045874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:57.045877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:57.045881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:57.045885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:57.045888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:57.045891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:57.045895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:57.045899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:57.045902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.045905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.045909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.045913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:57.045916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:57.045924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:57.045932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:57.045938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:57.045944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:57.045948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:57.045952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:57.045957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:57.045961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:57.045966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:57.045971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:57.045975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:57.045980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:57.045991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:57.045998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:57.046004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:57.046011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:57.046020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:57.046024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:57.046032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:57.046037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:57.046045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.046053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.046061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.046066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.046074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.046079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.046087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:57.046092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:57.046100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:57.046104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:57.046144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:57.047841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895348916944822:4915] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:57.052371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895348916944822:4915] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:57.052385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895348916944822:4915] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:57.052390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895348916944822:4915] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:57.052398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1016 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:57.052683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:57.053648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:57.053662Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:57.053664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:57.053667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:57.053672Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1015 [2:7555895348827197590:6773]
2025-09-30T14:52:57.053683Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:57.053695Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:57.053701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:57.053703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:57.053704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:57.053717Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:57.053725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:57.053730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:57.053773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.053777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.053779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.053781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:57.053783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:57.053838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:57.053849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.053860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.053871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.053887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:57.053909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895348916944861:4915], now have 1 active actors on pipe
2025-09-30T14:52:57.053920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895348916944762:2454], now have 1 active actors on pipe
2025-09-30T14:52:57.053924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895348827197585:6773]
2025-09-30T14:52:57.053926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895348827197585:6773]
2025-09-30T14:52:57.053927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895348827197585:6773]
2025-09-30T14:52:57.053938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:57.053950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:57.053958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:57.053962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:57.053964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:57.053969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:57.053943Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1015
2025-09-30T14:52:57.053977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:57.053947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1015
2025-09-30T14:52:57.054018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:57.054026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:57.054037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895348827197585:6773]
2025-09-30T14:52:57.054048Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:57.054061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:57.054072Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|105c0386-af1f5c1c-c70f6f58-cc2e89d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:57.054078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:57.054083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:57.054089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:57.054099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:57.054111Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:57.054135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:57.054282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:57.054290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:57.054302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:57.054411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1016 partition: 0 MaxSeqNo: 42 sessionId: src_id|105c0386-af1f5c1c-c70f6f58-cc2e89d4_0
2025-09-30T14:52:57.054770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fca582-df7f9672-2ce71853-8716a385_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|105c0386-af1f5c1c-c70f6f58-cc2e89d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:57.057567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|105c0386-af1f5c1c-c70f6f58-cc2e89d4_0] Write session: try to update token
2025-09-30T14:52:57.057584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|105c0386-af1f5c1c-c70f6f58-cc2e89d4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:57.068711Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:57.068732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:57.068735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:57.068736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:57.068745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895348827197585:6773]
2025-09-30T14:52:57.068750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895348827197585:6773]
2025-09-30T14:52:57.068753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895348827197585:6773]
2025-09-30T14:52:57.068791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:57.068795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:57.068798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.068800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:57.068803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:57.068807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:57.068939Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:57.072544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1016 sessionId: src_id|105c0386-af1f5c1c-c70f6f58-cc2e89d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:57.075323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:57.135311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895348916944883:5026]
2025-09-30T14:52:57.135588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1015, pipe: [1:7555895348916944883:5026]
2025-09-30T14:52:57.187504Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:57.187874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:57.187889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:57.187928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895348916944883:5026], now have 1 active actors on pipe
2025-09-30T14:52:57.188165Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:57.188170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:57.188173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:57.188223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895348916944883:5026]
2025-09-30T14:52:57.188252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1016 reason: error at write: Disconnected sessionId: src_id|105c0386-af1f5c1c-c70f6f58-cc2e89d4_0
2025-09-30T14:52:57.188484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1016 sessionId: src_id|105c0386-af1f5c1c-c70f6f58-cc2e89d4_0 is DEAD
2025-09-30T14:52:57.188695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|105c0386-af1f5c1c-c70f6f58-cc2e89d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:57.188706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|105c0386-af1f5c1c-c70f6f58-cc2e89d4_0] Write session will restart in 0.006602s
2025-09-30T14:52:57.188731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|105c0386-af1f5c1c-c70f6f58-cc2e89d4_0] Write session: Do CDS request
2025-09-30T14:52:57.188737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|105c0386-af1f5c1c-c70f6f58-cc2e89d4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:57.188183Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:57.196784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|105c0386-af1f5c1c-c70f6f58-cc2e89d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:57.196849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:57.196861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1017
2025-09-30T14:52:57.197010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1017 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:57.197048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1017 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:57.197057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1017 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:57.197062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:57.197499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1017 sessionId:  describe result for acl check
2025-09-30T14:52:57.197550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:57.197557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:57.197559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:57.197565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895348916944943:4910] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:57.197627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:57.198129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895348916944943:4910] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:57.199352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:57.199566Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:57.199577Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:57.199587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:57.199633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:57.199685Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895348827197701:6777]
2025-09-30T14:52:57.200067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895348916944943:4910] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:57.200222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:57.200477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:57.200547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:57.200911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:57.200970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:57.200976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:57.200977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:57.200978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:57.200979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:57.200981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:57.200982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:57.200983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:57.200984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:57.200985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:57.200987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.200988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.200989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.200990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:57.200992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:57.200997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:57.201007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:57.201011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:57.201015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:57.201019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:57.201023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:57.201027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:57.201032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:57.201036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:57.201040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:57.201044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.201048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.201052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.201055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:57.201059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:57.201067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:57.201075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:57.201081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:57.201087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:57.201091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:57.201097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:57.201101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:57.201107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:57.201112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:57.201118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:57.201123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:57.201128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:57.201133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:57.201139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:57.201144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:57.201150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:57.201155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:57.201161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:57.201165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:57.201170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:57.201176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.201181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.201191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.201196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.201201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.201207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.201216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:57.201221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:57.201228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:57.201237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:57.201281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:57.207378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895348916944943:4910] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:57.207398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895348916944943:4910] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:57.207402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895348916944943:4910] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:57.207411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1017 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:57.207739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:57.208617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:57.208631Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:57.208633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:57.208636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:57.208641Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1016 [2:7555895348827197701:6777]
2025-09-30T14:52:57.208654Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:57.208665Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:57.208667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:57.208670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:57.208672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:57.208684Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:57.208689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:57.208695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:57.208750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.208759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.208760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.208762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:57.208765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:57.208830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:57.208838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.208852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.208863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.208880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:57.208898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895348916944884:2454], now have 1 active actors on pipe
2025-09-30T14:52:57.208907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895348916944983:4910], now have 1 active actors on pipe
2025-09-30T14:52:57.208912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895348827197696:6777]
2025-09-30T14:52:57.208913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895348827197696:6777]
2025-09-30T14:52:57.208914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895348827197696:6777]
2025-09-30T14:52:57.208924Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:57.208937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:57.208946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1016
2025-09-30T14:52:57.208939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:57.208942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:57.208956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1016
2025-09-30T14:52:57.208945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:57.208956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:57.208959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:57.208991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895348827197696:6777]
2025-09-30T14:52:57.208994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:57.208995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:57.209041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:57.209051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:57.209095Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce16ce4d-2e026585-5ce0b6cc-dfe25873_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:57.209107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:57.209116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:57.209118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:57.209127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:57.209136Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:57.209156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:57.209341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:57.209359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:57.209382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:57.209474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1017 partition: 0 MaxSeqNo: 42 sessionId: src_id|ce16ce4d-2e026585-5ce0b6cc-dfe25873_0
2025-09-30T14:52:57.209842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|105c0386-af1f5c1c-c70f6f58-cc2e89d4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ce16ce4d-2e026585-5ce0b6cc-dfe25873_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:57.212760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce16ce4d-2e026585-5ce0b6cc-dfe25873_0] Write session: try to update token
2025-09-30T14:52:57.212780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce16ce4d-2e026585-5ce0b6cc-dfe25873_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:57.223543Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:57.223565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:57.223568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:57.223574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:57.223584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895348827197696:6777]
2025-09-30T14:52:57.223590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895348827197696:6777]
2025-09-30T14:52:57.223594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895348827197696:6777]
2025-09-30T14:52:57.223638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:57.223650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.223653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:57.223654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:57.223661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:57.223665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:57.223796Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:57.228375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1017 sessionId: src_id|ce16ce4d-2e026585-5ce0b6cc-dfe25873_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:57.231215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:57.288393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895348916944991:5026]
2025-09-30T14:52:57.288608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1016, pipe: [1:7555895348916944991:5026]
2025-09-30T14:52:57.340241Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:57.340588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:57.340606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:57.340648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895348916944991:5026], now have 1 active actors on pipe
2025-09-30T14:52:57.340867Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:57.340951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895348916944991:5026]
2025-09-30T14:52:57.340987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:57.341009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:57.341100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1017 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ce16ce4d-2e026585-5ce0b6cc-dfe25873_0
2025-09-30T14:52:57.341307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1017 sessionId: src_id|ce16ce4d-2e026585-5ce0b6cc-dfe25873_0 is DEAD
2025-09-30T14:52:57.341483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce16ce4d-2e026585-5ce0b6cc-dfe25873_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:57.341493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce16ce4d-2e026585-5ce0b6cc-dfe25873_0] Write session will restart in 0.005078s
2025-09-30T14:52:57.341517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce16ce4d-2e026585-5ce0b6cc-dfe25873_0] Write session: Do CDS request
2025-09-30T14:52:57.341534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce16ce4d-2e026585-5ce0b6cc-dfe25873_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:57.347764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce16ce4d-2e026585-5ce0b6cc-dfe25873_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:57.347983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:57.347997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1018
2025-09-30T14:52:57.348175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1018 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:57.348217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1018 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:57.348227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1018 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:57.348232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:57.348741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1018 sessionId:  describe result for acl check
2025-09-30T14:52:57.348776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:57.348783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:57.348785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:57.348791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895348916945016:4906] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:57.349356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895348916945016:4906] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:57.351083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895348916945016:4906] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:57.351783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:57.353328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:57.353529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895348916945016:4906] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:57.353532Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:57.353543Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:57.353541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895348916945016:4906] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:57.353553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:57.353546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895348916945016:4906] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:57.353553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1018 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:57.353604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:57.353644Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895348827197801:6779]
2025-09-30T14:52:57.354331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:57.354654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:57.354699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:57.355039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:57.355106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:57.355112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:57.355113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:57.355114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:57.355116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:57.355117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:57.355118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:57.355119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:57.355121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:57.355122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:57.355123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.355124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.355125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.355126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:57.355128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:57.355133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:57.355143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:57.355148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:57.355152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:57.355157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:57.355161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:57.355165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:57.355170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:57.355174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:57.355178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:57.355182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.355187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.355191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.355195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:57.355199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:57.355207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:57.355215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:57.355221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:57.355227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:57.355232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:57.355237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:57.355259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:57.355265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:57.355269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:57.355276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:57.355281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:57.355288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:57.355303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:57.355309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:57.355313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:57.355318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:57.355323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:57.355328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:57.355333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:57.355339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:57.355344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.355350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.355354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.355360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.355365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.355371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.355375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:57.355380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:57.355391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:57.355396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:57.355438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:57.361772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:57.362765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:57.362785Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:57.362788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:57.362792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:57.362803Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1017 [2:7555895348827197801:6779]
2025-09-30T14:52:57.362821Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:57.362837Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:57.362844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:57.362848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:57.362851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:57.362867Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:57.362874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:57.362882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:57.362940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.362947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.362950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.362953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:57.362956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:57.363012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:57.363018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.363028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.363039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.363051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:57.363068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895348827197795:6779]
2025-09-30T14:52:57.363070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895348827197795:6779]
2025-09-30T14:52:57.363073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895348827197795:6779]
2025-09-30T14:52:57.363081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:57.363092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:57.363096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895348916945088:4906], now have 1 active actors on pipe
2025-09-30T14:52:57.363104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:57.363105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:57.363107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:57.363117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:57.363119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:57.363123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895348916944992:2454], now have 1 active actors on pipe
2025-09-30T14:52:57.363151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895348827197795:6779]
2025-09-30T14:52:57.363161Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:57.363169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:57.363179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1017
2025-09-30T14:52:57.363190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1017
2025-09-30T14:52:57.363314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:57.363456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:57.363488Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b439cb1-854005f0-f61116b3-92e73bca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:57.363499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:57.363501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:57.363503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:57.363511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:57.363523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:57.363535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:57.363774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:57.363785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:57.363803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:57.363902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1018 partition: 0 MaxSeqNo: 42 sessionId: src_id|8b439cb1-854005f0-f61116b3-92e73bca_0
2025-09-30T14:52:57.364313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce16ce4d-2e026585-5ce0b6cc-dfe25873_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8b439cb1-854005f0-f61116b3-92e73bca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:57.367172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b439cb1-854005f0-f61116b3-92e73bca_0] Write session: try to update token
2025-09-30T14:52:57.367190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b439cb1-854005f0-f61116b3-92e73bca_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:57.378603Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:57.378627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:57.378629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:57.378632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:57.378644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895348827197795:6779]
2025-09-30T14:52:57.378649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895348827197795:6779]
2025-09-30T14:52:57.378653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895348827197795:6779]
2025-09-30T14:52:57.378696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:57.378707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.378707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:57.378710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:57.378714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:57.378719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:57.378857Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:57.382822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1018 sessionId: src_id|8b439cb1-854005f0-f61116b3-92e73bca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:57.385570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:57.440960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895348916945100:5026]
2025-09-30T14:52:57.441241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1017, pipe: [1:7555895348916945100:5026]
2025-09-30T14:52:57.487681Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:57.487940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:57.487952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:57.487991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895348916945100:5026], now have 1 active actors on pipe
2025-09-30T14:52:57.488186Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:57.488257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:57.488275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:57.488281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895348916945100:5026]
2025-09-30T14:52:57.488303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:57.488339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1018 reason: error at write: Disconnected sessionId: src_id|8b439cb1-854005f0-f61116b3-92e73bca_0
2025-09-30T14:52:57.488504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1018 sessionId: src_id|8b439cb1-854005f0-f61116b3-92e73bca_0 is DEAD
2025-09-30T14:52:57.488625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b439cb1-854005f0-f61116b3-92e73bca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:57.488633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b439cb1-854005f0-f61116b3-92e73bca_0] Write session will restart in 0.007151s
2025-09-30T14:52:57.488650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b439cb1-854005f0-f61116b3-92e73bca_0] Write session: Do CDS request
2025-09-30T14:52:57.488656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b439cb1-854005f0-f61116b3-92e73bca_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:57.496948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b439cb1-854005f0-f61116b3-92e73bca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:57.496999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:57.497013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1019
2025-09-30T14:52:57.497230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1019 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:57.497308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1019 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:57.497318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1019 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:57.497324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:57.497708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:57.497924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1019 sessionId:  describe result for acl check
2025-09-30T14:52:57.497974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:57.497981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:57.497984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:57.497991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895348916945164:4894] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:57.498699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895348916945164:4894] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:57.499807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:57.500000Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:57.500010Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:57.500022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:57.500072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:57.500108Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895348827197901:6781]
2025-09-30T14:52:57.500672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:57.500937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:57.500979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:57.501145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895348916945164:4894] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:57.501241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:57.501295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:57.501301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:57.501302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:57.501303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:57.501305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:57.501306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:57.501308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:57.501309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:57.501310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:57.501311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:57.501313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.501314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.501315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.501317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:57.501318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:57.501323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:57.501333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:57.501337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:57.501341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:57.501345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:57.501350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:57.501353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:57.501357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:57.501361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:57.501366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:57.501370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.501374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.501378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.501382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:57.501389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:57.501396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:57.501404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:57.501410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:57.501416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:57.501420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:57.501425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:57.501429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:57.501442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:57.501447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:57.501456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:57.501460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:57.501465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:57.501472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:57.501478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:57.501480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:57.501483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:57.501486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:57.501489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:57.501491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:57.501494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:57.501496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.501499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.501501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.501504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.501507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.501509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.501512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:57.501514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:57.501517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:57.501519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:57.501555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:57.508206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895348916945164:4894] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:57.508225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895348916945164:4894] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:57.508229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895348916945164:4894] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:57.508239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1019 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:57.508380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:57.509294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:57.509317Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:57.509321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:57.509326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:57.509333Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1018 [2:7555895348827197901:6781]
2025-09-30T14:52:57.509351Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:57.509376Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:57.509380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:57.509383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:57.509386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:57.509403Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:57.509410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:57.509416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:57.509480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.509490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.509492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.509496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:57.509499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:57.509570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:57.509599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.509618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.509636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.509661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:57.509686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895348916945203:4894], now have 1 active actors on pipe
2025-09-30T14:52:57.509695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895348916945101:2454], now have 1 active actors on pipe
2025-09-30T14:52:57.509701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895348827197896:6781]
2025-09-30T14:52:57.509704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895348827197896:6781]
2025-09-30T14:52:57.509706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895348827197896:6781]
2025-09-30T14:52:57.509720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:57.509741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:57.509751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:57.509756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:57.509759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:57.509738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1018
2025-09-30T14:52:57.509762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:57.509766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:57.509744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1018
2025-09-30T14:52:57.509803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895348827197896:6781]
2025-09-30T14:52:57.509815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:57.509823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:57.509837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:57.509847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:57.509906Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd7844d-fcf83f8-16d088ce-4e402fba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:57.509918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:57.509926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:57.509928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:57.509938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:57.509952Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:57.509979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:57.510165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:57.510174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:57.510201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:57.510305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1019 partition: 0 MaxSeqNo: 42 sessionId: src_id|fd7844d-fcf83f8-16d088ce-4e402fba_0
2025-09-30T14:52:57.510791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b439cb1-854005f0-f61116b3-92e73bca_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fd7844d-fcf83f8-16d088ce-4e402fba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:57.514343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd7844d-fcf83f8-16d088ce-4e402fba_0] Write session: try to update token
2025-09-30T14:52:57.514364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd7844d-fcf83f8-16d088ce-4e402fba_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:57.522802Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:57.522824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:57.522826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:57.522828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:57.522840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895348827197896:6781]
2025-09-30T14:52:57.522845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895348827197896:6781]
2025-09-30T14:52:57.522850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895348827197896:6781]
2025-09-30T14:52:57.522888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:57.522900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.522902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:57.522970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:57.522986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:57.522991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:57.523049Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:57.533501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1019 sessionId: src_id|fd7844d-fcf83f8-16d088ce-4e402fba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:57.537011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:57.588399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895348916945211:5026]
2025-09-30T14:52:57.588733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1018, pipe: [1:7555895348916945211:5026]
2025-09-30T14:52:57.630828Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:57.631199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:57.631212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:57.631232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895348916945211:5026], now have 1 active actors on pipe
2025-09-30T14:52:57.631486Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:57.631532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:57.631546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:57.631604Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:57.631650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1019 reason: error at write: Disconnected sessionId: src_id|fd7844d-fcf83f8-16d088ce-4e402fba_0
2025-09-30T14:52:57.631684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895348916945211:5026]
2025-09-30T14:52:57.631887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1019 sessionId: src_id|fd7844d-fcf83f8-16d088ce-4e402fba_0 is DEAD
2025-09-30T14:52:57.632073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd7844d-fcf83f8-16d088ce-4e402fba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:57.632088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd7844d-fcf83f8-16d088ce-4e402fba_0] Write session will restart in 0.007352s
2025-09-30T14:52:57.632119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd7844d-fcf83f8-16d088ce-4e402fba_0] Write session: Do CDS request
2025-09-30T14:52:57.632127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd7844d-fcf83f8-16d088ce-4e402fba_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:57.640945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd7844d-fcf83f8-16d088ce-4e402fba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:57.641034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:57.641050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1020
2025-09-30T14:52:57.641072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:57.641260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1020 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:57.641292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1020 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:57.641305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1020 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:57.641309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:57.641892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1020 sessionId:  describe result for acl check
2025-09-30T14:52:57.641949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:57.641958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:57.641961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:57.641973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895348916945275:4888] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:57.642684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895348916945275:4888] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:57.642961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:57.643182Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:57.643192Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:57.643202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:57.643274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:57.643315Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895348827198002:6784]
2025-09-30T14:52:57.644018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:57.644400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:57.644443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:57.644797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:57.644864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:57.644872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:57.644873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:57.644874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:57.644876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:57.644877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:57.644879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:57.644881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:57.644882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:57.644883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:57.644884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.644886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.644887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.644888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:57.644889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:57.644895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:57.644905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:57.644910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:57.644915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:57.644919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:57.644923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:57.644927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:57.644931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:57.644935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:57.644940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:57.644944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.644948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.644952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.644957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:57.644961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:57.644968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:57.644977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:57.644983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:57.644986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:57.644989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:57.644992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:57.644995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:57.644999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:57.645001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:57.645005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:57.645008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:57.645014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:57.645019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:57.645025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:57.645029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:57.645035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:57.645041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:57.645044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:57.645048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:57.645051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:57.645054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.645058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.645061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.645064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.645067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.645070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.645073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:57.645076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:57.645079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:57.645083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:57.645112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:57.649756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895348916945275:4888] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:57.651185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:57.652158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:57.652176Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:57.652179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:57.652183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:57.652193Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1019 [2:7555895348827198002:6784]
2025-09-30T14:52:57.652210Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:57.652228Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:57.652232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:57.652234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:57.652237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:57.652254Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:57.652266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:57.652273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:57.652346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.652357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.652359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.652363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:57.652366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:57.652436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:57.652444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.652457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.652472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.652496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:57.652518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895348827197997:6784]
2025-09-30T14:52:57.652520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895348827197997:6784]
2025-09-30T14:52:57.652522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895348827197997:6784]
2025-09-30T14:52:57.652534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:57.652549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895348916945212:2454], now have 1 active actors on pipe
2025-09-30T14:52:57.652553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:57.652556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:57.652558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:57.652559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:57.652571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:57.652574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:57.652609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895348827197997:6784]
2025-09-30T14:52:57.652621Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:57.652630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:57.652645Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1019
2025-09-30T14:52:57.653514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895348916945275:4888] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:57.653527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895348916945275:4888] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:57.653529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895348916945275:4888] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:57.653537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1020 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:57.653827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895348916945318:4888], now have 1 active actors on pipe
2025-09-30T14:52:57.653862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1019
2025-09-30T14:52:57.653969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:57.653983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:57.654013Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f332882b-8ac39ea8-1ae1789e-340ba3fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:57.654022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:57.654032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:57.654035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:57.654047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:57.654061Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:57.654082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:57.654298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:57.654306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:57.654320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:57.654411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1020 partition: 0 MaxSeqNo: 42 sessionId: src_id|f332882b-8ac39ea8-1ae1789e-340ba3fe_0
2025-09-30T14:52:57.654841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd7844d-fcf83f8-16d088ce-4e402fba_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f332882b-8ac39ea8-1ae1789e-340ba3fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:57.658444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f332882b-8ac39ea8-1ae1789e-340ba3fe_0] Write session: try to update token
2025-09-30T14:52:57.658467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f332882b-8ac39ea8-1ae1789e-340ba3fe_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:57.666359Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:57.666386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:57.666396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895348827197997:6784]
2025-09-30T14:52:57.666446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:57.666452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:57.666641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:57.666865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:57.667045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:57.667213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:57.667452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:57.667503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:57.679099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1020 sessionId: src_id|f332882b-8ac39ea8-1ae1789e-340ba3fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:57.680161Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:57.680189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:57.680192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:57.680196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:57.680206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895348827197997:6784]
2025-09-30T14:52:57.680211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895348827197997:6784]
2025-09-30T14:52:57.680216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895348827197997:6784]
2025-09-30T14:52:57.680271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:57.680275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:57.680280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.680283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:57.680284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:57.680289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:57.680462Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:57.682488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:57.731774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895348916945322:5026]
2025-09-30T14:52:57.732153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1019, pipe: [1:7555895348916945322:5026]
2025-09-30T14:52:57.797785Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:57.798104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:57.798118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:57.798137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895348916945322:5026], now have 1 active actors on pipe
2025-09-30T14:52:57.798456Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:57.798442Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:57.798502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895348916945322:5026]
2025-09-30T14:52:57.798527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:57.798532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:57.798612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1020 reason: error at write: Disconnected sessionId: src_id|f332882b-8ac39ea8-1ae1789e-340ba3fe_0
2025-09-30T14:52:57.798839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1020 sessionId: src_id|f332882b-8ac39ea8-1ae1789e-340ba3fe_0 is DEAD
2025-09-30T14:52:57.798976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f332882b-8ac39ea8-1ae1789e-340ba3fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:57.798986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f332882b-8ac39ea8-1ae1789e-340ba3fe_0] Write session will restart in 0.008134s
2025-09-30T14:52:57.799020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f332882b-8ac39ea8-1ae1789e-340ba3fe_0] Write session: Do CDS request
2025-09-30T14:52:57.799029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f332882b-8ac39ea8-1ae1789e-340ba3fe_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:57.808866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f332882b-8ac39ea8-1ae1789e-340ba3fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:57.809042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:57.809059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1021
2025-09-30T14:52:57.809239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1021 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:57.809274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1021 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:57.809279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1021 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:57.809283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:57.809809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1021 sessionId:  describe result for acl check
2025-09-30T14:52:57.809841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:57.809843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:57.809845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:57.809851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895348916945347:4878] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:57.810450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895348916945347:4878] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:57.813571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895348916945347:4878] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:57.816391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:57.816514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895348916945347:4878] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:57.816528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895348916945347:4878] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:57.816532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895348916945347:4878] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:57.816541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1021 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:57.818883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:57.819180Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:57.819195Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:57.819209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:57.819293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:57.819347Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895348827198106:6786]
2025-09-30T14:52:57.820089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:57.820528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:57.820591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:57.821091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:57.821178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:57.821185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:57.821187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:57.821189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:57.821191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:57.821193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:57.821194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:57.821196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:57.821198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:57.821199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:57.821201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.821203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.821204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.821206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:57.821207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:57.821214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:57.821228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:57.821233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:57.821238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:57.821256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:57.821261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:57.821266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:57.821271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:57.821281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:57.821287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:57.821292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.821297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.821302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.821315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:57.821320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:57.821331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:57.821342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:57.821355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:57.821363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:57.821376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:57.821385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:57.821405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:57.821417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:57.821429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:57.821436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:57.821441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:57.821446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:57.821452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:57.821459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:57.821465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:57.821471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:57.821478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:57.821489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:57.821495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:57.821507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:57.821513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.821520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.821526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.821532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.821539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.821545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.821550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:57.821561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:57.821567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:57.821573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:57.821635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:57.827905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:57.829148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:57.829170Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:57.829175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:57.829180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:57.829190Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1020 [2:7555895348827198106:6786]
2025-09-30T14:52:57.829218Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:57.829243Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:57.829247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:57.829256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:57.829260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:57.829283Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:57.829296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:57.829306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:57.829395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.829407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.829409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.829414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:57.829417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:57.829703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1020
2025-09-30T14:52:57.829711Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1020
2025-09-30T14:52:57.829505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:57.829513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.829530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.829546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.829580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:57.829604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895348916945421:4878], now have 1 active actors on pipe
2025-09-30T14:52:57.829609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895348916945323:2454], now have 1 active actors on pipe
2025-09-30T14:52:57.829618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895348827198099:6786]
2025-09-30T14:52:57.829620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895348827198099:6786]
2025-09-30T14:52:57.829622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895348827198099:6786]
2025-09-30T14:52:57.829640Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:57.829656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:57.829675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:57.829675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:57.829680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:57.829680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:57.829683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:57.829727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895348827198099:6786]
2025-09-30T14:52:57.829735Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:57.829745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:57.829811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:57.829817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:57.829848Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|efcd27a-cdf6985f-295c674a-99283d04_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:57.829856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:57.829861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:57.829863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:57.829878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:57.829889Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:57.829906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:57.830090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:57.830104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:57.830120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:57.830223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1021 partition: 0 MaxSeqNo: 42 sessionId: src_id|efcd27a-cdf6985f-295c674a-99283d04_0
2025-09-30T14:52:57.830656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f332882b-8ac39ea8-1ae1789e-340ba3fe_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|efcd27a-cdf6985f-295c674a-99283d04_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:57.833956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efcd27a-cdf6985f-295c674a-99283d04_0] Write session: try to update token
2025-09-30T14:52:57.833977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efcd27a-cdf6985f-295c674a-99283d04_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:57.844087Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:57.844119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:57.844122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:57.844125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:57.844137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895348827198099:6786]
2025-09-30T14:52:57.844142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895348827198099:6786]
2025-09-30T14:52:57.844148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895348827198099:6786]
2025-09-30T14:52:57.844202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:57.844205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:57.844213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:57.844217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:57.844218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.844222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:57.844400Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:57.853862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1021 sessionId: src_id|efcd27a-cdf6985f-295c674a-99283d04_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:57.856747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:57.898691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895348916945438:5026]
2025-09-30T14:52:57.898954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1020, pipe: [1:7555895348916945438:5026]
2025-09-30T14:52:57.960736Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:57.961054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:57.961071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:57.961104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895348916945438:5026], now have 1 active actors on pipe
2025-09-30T14:52:57.961295Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:57.961343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:57.961357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:57.961359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:57.961416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895348916945438:5026]
2025-09-30T14:52:57.961430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1021 reason: error at write: Disconnected sessionId: src_id|efcd27a-cdf6985f-295c674a-99283d04_0
2025-09-30T14:52:57.961637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1021 sessionId: src_id|efcd27a-cdf6985f-295c674a-99283d04_0 is DEAD
2025-09-30T14:52:57.961816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efcd27a-cdf6985f-295c674a-99283d04_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:57.961827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efcd27a-cdf6985f-295c674a-99283d04_0] Write session will restart in 0.005413s
2025-09-30T14:52:57.961852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efcd27a-cdf6985f-295c674a-99283d04_0] Write session: Do CDS request
2025-09-30T14:52:57.961861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efcd27a-cdf6985f-295c674a-99283d04_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:57.968804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efcd27a-cdf6985f-295c674a-99283d04_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:57.969028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:57.969051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1022
2025-09-30T14:52:57.969184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1022 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:57.969214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1022 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:57.969224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1022 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:57.969229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:57.969783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1022 sessionId:  describe result for acl check
2025-09-30T14:52:57.969822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:57.969824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:57.969826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:57.969832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895348916945479:4867] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:57.970408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895348916945479:4867] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:57.973909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:57.974012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895348916945479:4867] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:57.976499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:57.976731Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:57.976741Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:57.976767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:57.976832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:57.976876Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895348827198244:6800]
2025-09-30T14:52:57.977564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:57.977953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:57.978036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:57.978412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:57.978485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:57.978491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:57.978492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:57.978493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:57.978494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:57.978495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:57.978496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:57.978497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:57.978498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:57.978499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:57.978500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.978501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.978502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.978503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:57.978504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:57.978509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:57.978518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:57.978522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:57.978526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:57.978529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:57.978532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:57.978536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:57.978539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:57.978542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:57.978546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:57.978550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.978553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.978556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.978560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:57.978563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:57.978570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:57.978577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:57.978583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:57.978588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:57.978592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:57.978597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:57.978601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:57.978606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:57.978610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:57.978615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:57.978619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:57.978623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:57.978627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:57.978632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:57.978636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:57.978640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:57.978644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:57.978649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:57.978653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:57.978657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:57.978661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.978665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.978669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.978673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.978680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.978685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.978689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:57.978693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:57.978698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:57.978702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:57.978739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:57.984722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895348916945479:4867] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:57.984743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895348916945479:4867] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:57.984747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895348916945479:4867] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:57.984757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1022 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:57.985434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:57.986345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:57.986361Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:57.986364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:57.986368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:57.986374Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1021 [2:7555895348827198244:6800]
2025-09-30T14:52:57.986392Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:57.986407Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:57.986415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:57.986418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:57.986421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:57.986437Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:57.986447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:57.986455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:57.986512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.986519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.986521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.986525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:57.986528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:57.986605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:57.986614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:57.986626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:57.986637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:57.986653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:57.986669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895348827198239:6800]
2025-09-30T14:52:57.986671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895348827198239:6800]
2025-09-30T14:52:57.986674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895348827198239:6800]
2025-09-30T14:52:57.986689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:57.986701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:57.986705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:57.986707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:57.986708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895348916945460:2454], now have 1 active actors on pipe
2025-09-30T14:52:57.986712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895348916945560:4867], now have 1 active actors on pipe
2025-09-30T14:52:57.986719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:57.986734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:57.986742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:57.986775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895348827198239:6800]
2025-09-30T14:52:57.986790Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:57.986803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:57.986781Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1021
2025-09-30T14:52:57.986787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1021
2025-09-30T14:52:57.986835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:57.986843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:57.987020Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29090b6d-1b9d4663-2cd26e2a-80ed8f61_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:57.987030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:57.987033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:57.987034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:57.987041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:57.987049Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:57.987065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:57.987293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:57.987308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:57.987328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:57.987483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1022 partition: 0 MaxSeqNo: 42 sessionId: src_id|29090b6d-1b9d4663-2cd26e2a-80ed8f61_0
2025-09-30T14:52:57.987858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efcd27a-cdf6985f-295c674a-99283d04_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|29090b6d-1b9d4663-2cd26e2a-80ed8f61_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:57.990752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29090b6d-1b9d4663-2cd26e2a-80ed8f61_0] Write session: try to update token
2025-09-30T14:52:57.990767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29090b6d-1b9d4663-2cd26e2a-80ed8f61_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:58.000426Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:58.000461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:58.000465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:58.000468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:58.000481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895348827198239:6800]
2025-09-30T14:52:58.000487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895348827198239:6800]
2025-09-30T14:52:58.000498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895348827198239:6800]
2025-09-30T14:52:58.000553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:58.000557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:58.000562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.000564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:58.000565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:58.000574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:58.000740Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:58.006951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1022 sessionId: src_id|29090b6d-1b9d4663-2cd26e2a-80ed8f61_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:58.009745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:58.061541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895353211912875:5026]
2025-09-30T14:52:58.061911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1021, pipe: [1:7555895353211912875:5026]
2025-09-30T14:52:58.119098Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:58.119430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:58.119441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:58.119476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895353211912875:5026], now have 1 active actors on pipe
2025-09-30T14:52:58.119693Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:58.119924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:58.119955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895353211912875:5026]
2025-09-30T14:52:58.119986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:58.120115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1022 reason: status is not ok: tablet will be restarted right now sessionId: src_id|29090b6d-1b9d4663-2cd26e2a-80ed8f61_0
2025-09-30T14:52:58.120379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1022 sessionId: src_id|29090b6d-1b9d4663-2cd26e2a-80ed8f61_0 is DEAD
2025-09-30T14:52:58.120884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29090b6d-1b9d4663-2cd26e2a-80ed8f61_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:58.120896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29090b6d-1b9d4663-2cd26e2a-80ed8f61_0] Write session will restart in 0.009011s
2025-09-30T14:52:58.120917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29090b6d-1b9d4663-2cd26e2a-80ed8f61_0] Write session: Do CDS request
2025-09-30T14:52:58.120922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29090b6d-1b9d4663-2cd26e2a-80ed8f61_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:58.130834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29090b6d-1b9d4663-2cd26e2a-80ed8f61_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:58.130967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:58.130984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1023
2025-09-30T14:52:58.131135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1023 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:58.131171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1023 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:58.131182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1023 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:58.131186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:58.131708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1023 sessionId:  describe result for acl check
2025-09-30T14:52:58.131747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:58.131755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:58.131757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:58.131763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895353211912945:4856] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:58.132222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895353211912945:4856] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:58.134626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:58.135531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895353211912945:4856] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:58.138018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:58.138303Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:58.138320Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:58.138334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:58.138408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:58.138464Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895353122165658:6804]
2025-09-30T14:52:58.138664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895353211912945:4856] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:58.138684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895353211912945:4856] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:58.138688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895353211912945:4856] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:58.138698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1023 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:58.139237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:58.139755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:58.139815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:58.140216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:58.140299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:58.140307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:58.140309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:58.140310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:58.140312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:58.140313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:58.140315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:58.140317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:58.140318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:58.140320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:58.140323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.140324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:58.140325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:58.140327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:58.140329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:58.140335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:58.140347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:58.140351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:58.140356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:58.140361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:58.140367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:58.140372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:58.140376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:58.140381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:58.140386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:58.140391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.140395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:58.140400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:58.140404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:58.140409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:58.140428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:58.140438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:58.140445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:58.140451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:58.140457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:58.140464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:58.140470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:58.140476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:58.140482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:58.140488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:58.140494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:58.140499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:58.140506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:58.140513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:58.140518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:58.140524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:58.140530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:58.140536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:58.140541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:58.140547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:58.140551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.140558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.140563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:58.140569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:58.140574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:58.140580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:58.140585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:58.140590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:58.140597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:58.140602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:58.140653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:58.147159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:58.148294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:58.148315Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:58.148320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:58.148325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:58.148335Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1022 [2:7555895353122165658:6804]
2025-09-30T14:52:58.148358Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:58.148379Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:58.148391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:58.148395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:58.148398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:58.148422Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:58.148437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:58.148448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:58.148531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.148541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:58.148543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:58.148548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:58.148552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:58.148647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:58.148656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.148672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:58.148694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:58.148722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:58.148754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895353211912892:2454], now have 1 active actors on pipe
2025-09-30T14:52:58.148765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895353211912992:4856], now have 1 active actors on pipe
2025-09-30T14:52:58.148774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895353122165652:6804]
2025-09-30T14:52:58.148783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895353122165652:6804]
2025-09-30T14:52:58.148786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895353122165652:6804]
2025-09-30T14:52:58.148802Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:58.148824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:58.148830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:58.148836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:58.148839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:58.148851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:58.148855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:58.148913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895353122165652:6804]
2025-09-30T14:52:58.148927Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:58.148937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:58.151443Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1022
2025-09-30T14:52:58.151459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1022
2025-09-30T14:52:58.151655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:58.151675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:58.151723Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|299d5e94-d906807b-22ec0baa-a1e492d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:58.151736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:58.151747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:58.151751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:58.151770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:58.151795Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:58.151817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:58.152072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:58.152081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:58.152097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:58.152213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1023 partition: 0 MaxSeqNo: 42 sessionId: src_id|299d5e94-d906807b-22ec0baa-a1e492d2_0
2025-09-30T14:52:58.152701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29090b6d-1b9d4663-2cd26e2a-80ed8f61_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|299d5e94-d906807b-22ec0baa-a1e492d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:58.155796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|299d5e94-d906807b-22ec0baa-a1e492d2_0] Write session: try to update token
2025-09-30T14:52:58.155825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|299d5e94-d906807b-22ec0baa-a1e492d2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:58.164480Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:58.164506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:58.164516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895353122165652:6804]
2025-09-30T14:52:58.164567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:58.164585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:58.164766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:58.164928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:58.165086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:58.165242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:58.165453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:58.165500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:58.171273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1023 sessionId: src_id|299d5e94-d906807b-22ec0baa-a1e492d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:58.174632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:58.174934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:58.174976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:58.175016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:58.175130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:58.178327Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:58.178353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:58.178357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:58.178360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:58.178373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895353122165652:6804]
2025-09-30T14:52:58.178380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895353122165652:6804]
2025-09-30T14:52:58.178386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895353122165652:6804]
2025-09-30T14:52:58.178441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:58.178443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:58.178450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:58.178450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.178454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:58.178456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:58.178626Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:58.220230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895353211913004:5026]
2025-09-30T14:52:58.220544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1022, pipe: [1:7555895353211913004:5026]
2025-09-30T14:52:58.303699Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:58.313875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:58.313909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:58.314113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:58.314206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:58.314285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:58.314363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:58.314425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:58.314433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:58.314514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:58.314586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:58.314657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:58.314739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:58.314798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:58.314804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:58.314882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:58.314950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:58.315020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:58.315091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:58.315149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:58.315160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:58.315258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:58.315328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:58.315405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:58.315474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:58.315529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:58.315536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:58.315618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:58.315683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:58.315754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:58.315834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:58.315893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:58.315900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:58.315991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:58.316065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:58.316137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:58.316212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:58.316269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:58.316277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:58.316361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:58.316435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:58.316514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:58.316591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:58.316650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:58.316658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:58.316745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:58.316818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:58.316894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:58.316986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:58.317049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:58.317060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:58.317142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:58.317217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:58.317293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:58.317373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:58.317441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:58.317454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:58.317538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:58.317610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:58.317697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:58.317780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:58.317844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:58.317855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:58.317937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895353211913004:5026], now have 1 active actors on pipe
2025-09-30T14:52:58.318278Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:58.318338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:58.318337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895353211913004:5026]
2025-09-30T14:52:58.318352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:58.318385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1023 reason: error at write: Disconnected sessionId: src_id|299d5e94-d906807b-22ec0baa-a1e492d2_0
2025-09-30T14:52:58.318592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1023 sessionId: src_id|299d5e94-d906807b-22ec0baa-a1e492d2_0 is DEAD
2025-09-30T14:52:58.318795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|299d5e94-d906807b-22ec0baa-a1e492d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:58.318809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|299d5e94-d906807b-22ec0baa-a1e492d2_0] Write session will restart in 0.009704s
2025-09-30T14:52:58.318833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|299d5e94-d906807b-22ec0baa-a1e492d2_0] Write session: Do CDS request
2025-09-30T14:52:58.318839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|299d5e94-d906807b-22ec0baa-a1e492d2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:58.319654Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:58.329921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|299d5e94-d906807b-22ec0baa-a1e492d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:58.330038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:58.330060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1024
2025-09-30T14:52:58.330200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1024 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:58.330233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1024 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:58.330238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1024 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:58.330243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:58.330680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1024 sessionId:  describe result for acl check
2025-09-30T14:52:58.330711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:58.330714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:58.330716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:58.330722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895353211913072:4851] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:58.331361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895353211913072:4851] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:58.334143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895353211913072:4851] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:58.334709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:58.335301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:58.335523Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:58.335538Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:58.335563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:58.335640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:58.335693Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895353122165764:6806]
2025-09-30T14:52:58.336395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:58.336802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:58.336860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:58.337272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:58.337348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895353211913072:4851] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:58.337367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895353211913072:4851] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:58.337380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:58.337388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:58.337390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:58.337391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:58.337393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:58.337394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:58.337372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895353211913072:4851] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:58.337395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:58.337396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:58.337383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1024 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:58.337398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:58.337399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:58.337400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.337401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:58.337403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:58.337404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:58.337406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:58.337412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:58.337424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:58.337428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:58.337433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:58.337437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:58.337443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:58.337446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:58.337450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:58.337454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:58.337458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:58.337462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.337466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:58.337470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:58.337474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:58.337478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:58.337489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:58.337498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:58.337505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:58.337511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:58.337522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:58.337527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:58.337532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:58.337539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:58.337548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:58.337554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:58.337564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:58.337570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:58.337581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:58.337587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:58.337591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:58.337596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:58.337601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:58.337605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:58.337610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:58.337615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:58.337620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.337626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.337630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:58.337644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:58.337648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:58.337659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:58.337664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:58.337674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:58.337680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:58.337691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:58.337739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:58.344750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:58.345828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:58.345848Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:58.345850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:58.345854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:58.345861Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1023 [2:7555895353122165764:6806]
2025-09-30T14:52:58.345875Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:58.345895Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:58.345898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:58.345900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:58.345903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:58.345919Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:58.345924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:58.345931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:58.346000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.346007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:58.346009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:58.346012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:58.346014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:58.346092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:58.346102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.346115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:58.346124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:58.346134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:58.346151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895353122165759:6806]
2025-09-30T14:52:58.346157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895353122165759:6806]
2025-09-30T14:52:58.346159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895353122165759:6806]
2025-09-30T14:52:58.346167Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:58.346196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:58.346201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:58.346205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:58.346208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:58.346214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:58.346219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:58.346232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895353211913007:2454], now have 1 active actors on pipe
2025-09-30T14:52:58.346244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895353211913111:4851], now have 1 active actors on pipe
2025-09-30T14:52:58.346287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895353122165759:6806]
2025-09-30T14:52:58.346298Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:58.346354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:58.346350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1023
2025-09-30T14:52:58.346357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1023
2025-09-30T14:52:58.346516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:58.346533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:58.346566Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67ea0712-7cf0a51-6aeec6d8-ed18a828_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:58.346583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:58.346588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:58.346590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:58.346606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:58.346621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:58.346643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:58.346860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:58.346872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:58.346891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:58.347005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1024 partition: 0 MaxSeqNo: 42 sessionId: src_id|67ea0712-7cf0a51-6aeec6d8-ed18a828_0
2025-09-30T14:52:58.347506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|299d5e94-d906807b-22ec0baa-a1e492d2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|67ea0712-7cf0a51-6aeec6d8-ed18a828_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:58.350435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67ea0712-7cf0a51-6aeec6d8-ed18a828_0] Write session: try to update token
2025-09-30T14:52:58.350454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67ea0712-7cf0a51-6aeec6d8-ed18a828_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:58.359815Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:58.359838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:58.359841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:58.359843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:58.359858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895353122165759:6806]
2025-09-30T14:52:58.359864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895353122165759:6806]
2025-09-30T14:52:58.359869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895353122165759:6806]
2025-09-30T14:52:58.359921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:58.359935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.359938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:58.359943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:58.359953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:58.359963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:58.360117Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:58.365916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1024 sessionId: src_id|67ea0712-7cf0a51-6aeec6d8-ed18a828_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:58.369427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:58.419335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895353211913121:5026]
2025-09-30T14:52:58.419739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1023, pipe: [1:7555895353211913121:5026]
2025-09-30T14:52:58.486597Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:58.487140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:58.487159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:58.487209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895353211913121:5026], now have 1 active actors on pipe
2025-09-30T14:52:58.487508Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:58.487536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:58.487559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:58.487564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:58.487608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895353211913121:5026]
2025-09-30T14:52:58.487667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1024 reason: error at write: Disconnected sessionId: src_id|67ea0712-7cf0a51-6aeec6d8-ed18a828_0
2025-09-30T14:52:58.487925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1024 sessionId: src_id|67ea0712-7cf0a51-6aeec6d8-ed18a828_0 is DEAD
2025-09-30T14:52:58.488127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ea0712-7cf0a51-6aeec6d8-ed18a828_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:58.488142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ea0712-7cf0a51-6aeec6d8-ed18a828_0] Write session will restart in 0.008574s
2025-09-30T14:52:58.488186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ea0712-7cf0a51-6aeec6d8-ed18a828_0] Write session: Do CDS request
2025-09-30T14:52:58.488196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ea0712-7cf0a51-6aeec6d8-ed18a828_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:58.497820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67ea0712-7cf0a51-6aeec6d8-ed18a828_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:58.497916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:58.497933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1025
2025-09-30T14:52:58.498124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1025 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:58.498163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1025 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:58.498170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1025 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:58.498184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:58.499073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:58.498691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1025 sessionId:  describe result for acl check
2025-09-30T14:52:58.498741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:58.498744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:58.498746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:58.498752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895353211913190:4847] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:58.499332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895353211913190:4847] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:58.501464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895353211913190:4847] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:58.501732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:58.502003Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:58.502018Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:58.502032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:58.502094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:58.502154Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895353122165870:6808]
2025-09-30T14:52:58.502828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:58.503109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:58.503149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:58.503510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:58.503578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:58.503585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:58.503586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:58.503587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:58.503588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:58.503589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:58.503590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:58.503591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:58.503592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:58.503593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:58.503594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.503594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:58.503595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:58.503596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:58.503597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:58.503601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:58.503610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:58.503613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:58.503616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:58.503618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:58.503621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:58.503623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:58.503626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:58.503630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:58.503634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:58.503639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.503643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:58.503647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:58.503651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:58.503654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:58.503663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:58.503672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:58.503680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:58.503686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:58.503690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:58.503693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:58.503696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:58.503700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:58.503703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:58.503707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:58.503710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:58.503714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:58.503717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:58.503720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:58.503723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:58.503727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:58.503730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:58.503733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:58.503737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:58.503740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:58.503744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.503747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.503751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:58.503754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:58.503757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:58.503761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:58.503764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:58.503767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:58.503772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:58.503775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:58.503816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:58.504991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895353211913190:4847] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:58.505009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895353211913190:4847] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:58.505013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895353211913190:4847] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:58.505023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1025 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:58.510255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:58.511402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:58.511421Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:58.511424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:58.511429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:58.511437Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1024 [2:7555895353122165870:6808]
2025-09-30T14:52:58.511457Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:58.511477Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:58.511481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:58.511485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:58.511489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:58.511511Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:58.511524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:58.511534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:58.511615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.511624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:58.511627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:58.511632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:58.511635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:58.511924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1024
2025-09-30T14:52:58.511926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1024
2025-09-30T14:52:58.511725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:58.511732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.511748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:58.511759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:58.511777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:58.511801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895353211913122:2454], now have 1 active actors on pipe
2025-09-30T14:52:58.511806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895353211913232:4847], now have 1 active actors on pipe
2025-09-30T14:52:58.511813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895353122165864:6808]
2025-09-30T14:52:58.511816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895353122165864:6808]
2025-09-30T14:52:58.511819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895353122165864:6808]
2025-09-30T14:52:58.511835Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:58.511850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:58.511852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:58.511854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:58.511857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:58.511869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:58.511873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:58.511923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895353122165864:6808]
2025-09-30T14:52:58.511930Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:58.511957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:58.512001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:58.512006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:58.512037Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ddb52517-5ae38b65-9840c6fb-d731919f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:58.512046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:58.512050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:58.512053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:58.512066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:58.512077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:58.512097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:58.512307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:58.512317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:58.512335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:58.512430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1025 partition: 0 MaxSeqNo: 42 sessionId: src_id|ddb52517-5ae38b65-9840c6fb-d731919f_0
2025-09-30T14:52:58.512926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ea0712-7cf0a51-6aeec6d8-ed18a828_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ddb52517-5ae38b65-9840c6fb-d731919f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:58.515803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddb52517-5ae38b65-9840c6fb-d731919f_0] Write session: try to update token
2025-09-30T14:52:58.515828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddb52517-5ae38b65-9840c6fb-d731919f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:58.525659Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:58.525689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:58.525700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895353122165864:6808]
2025-09-30T14:52:58.525756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:58.525758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:58.525982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:58.526185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:58.526383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:58.526554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:58.526817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:58.526879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:58.531119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1025 sessionId: src_id|ddb52517-5ae38b65-9840c6fb-d731919f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:58.534482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:58.534791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:58.534819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:58.534868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:58.534974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:58.537911Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:58.537932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:58.537935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:58.537938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:58.537950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895353122165864:6808]
2025-09-30T14:52:58.537955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895353122165864:6808]
2025-09-30T14:52:58.537962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895353122165864:6808]
2025-09-30T14:52:58.538011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:58.538019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.538022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:58.538027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:58.538037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:58.538047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:58.538223Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:58.587977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895353211913240:5026]
2025-09-30T14:52:58.588400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1024, pipe: [1:7555895353211913240:5026]
2025-09-30T14:52:58.660065Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:58.671163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:58.671203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:58.671450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:58.671529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:58.671614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:58.671693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:58.671753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:58.671763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:58.671856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:58.671934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:58.672010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:58.672089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:58.672151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:58.672159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:58.672240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:58.672316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:58.672399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:58.672481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:58.672539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:58.672546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:58.672629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:58.672701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:58.672777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:58.672854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:58.672913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:58.672920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:58.673004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:58.673080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:58.673168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:58.673252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:58.673315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:58.673324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:58.673410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:58.673489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:58.673574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:58.673648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:58.673705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:58.673712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:58.673801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:58.673873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:58.673963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:58.674042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:58.674102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:58.674109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:58.674205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:58.674287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:58.674369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:58.674455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:58.674538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:58.674545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:58.674628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:58.674701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:58.674778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:58.674857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:58.674915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:58.674923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:58.675004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:58.675079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:58.675157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:58.675256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:58.675319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:58.675327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:58.675412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895353211913240:5026], now have 1 active actors on pipe
2025-09-30T14:52:58.677413Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:58.677369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:58.677399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895353211913240:5026]
2025-09-30T14:52:58.677437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:58.677440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:58.677479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1025 reason: error at write: Disconnected sessionId: src_id|ddb52517-5ae38b65-9840c6fb-d731919f_0
2025-09-30T14:52:58.677717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1025 sessionId: src_id|ddb52517-5ae38b65-9840c6fb-d731919f_0 is DEAD
2025-09-30T14:52:58.677913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddb52517-5ae38b65-9840c6fb-d731919f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:58.677926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddb52517-5ae38b65-9840c6fb-d731919f_0] Write session will restart in 0.009975s
2025-09-30T14:52:58.677951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddb52517-5ae38b65-9840c6fb-d731919f_0] Write session: Do CDS request
2025-09-30T14:52:58.677957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddb52517-5ae38b65-9840c6fb-d731919f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:58.688811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddb52517-5ae38b65-9840c6fb-d731919f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:58.688929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:58.688948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1026
2025-09-30T14:52:58.689177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1026 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:58.689228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1026 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:58.689242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1026 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:58.689246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:58.689690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1026 sessionId:  describe result for acl check
2025-09-30T14:52:58.689731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:58.689739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:58.689741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:58.689747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895353211913309:4840] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:58.690283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895353211913309:4840] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:58.691003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:58.693387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895353211913309:4840] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:58.694008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:58.694299Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:58.694312Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:58.694325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:58.694390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:58.694438Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895353122165979:6811]
2025-09-30T14:52:58.695230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:58.695613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:58.695681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:58.696079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:58.696180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:58.696189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:58.696190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:58.696192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:58.696193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:58.696194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:58.696195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:58.696197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:58.696198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:58.696199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:58.696201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.696202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:58.696203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:58.696204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:58.696206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:58.696213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:58.696225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:58.696230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:58.696234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:58.696238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:58.696242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:58.696246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:58.696251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:58.696254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:58.696258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:58.696263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.696266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:58.696271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:58.696275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:58.696279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:58.696289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:58.696297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:58.696303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:58.696307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:58.696312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:58.696316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:58.696320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:58.696326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:58.696331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:58.696337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:58.696347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:58.696353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:58.696365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:58.696371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:58.696377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:58.696383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:58.696389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:58.696394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:58.696399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:58.696414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:58.696420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.696426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.696431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:58.696437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:58.696443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:58.696448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:58.696453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:58.696460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:58.696465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:58.696470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:58.696518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:58.697347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895353211913309:4840] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:58.697363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895353211913309:4840] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:58.697367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895353211913309:4840] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:58.697392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1026 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:58.702640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:58.703850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:58.703877Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:58.703880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:58.703885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:58.703894Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1025 [2:7555895353122165979:6811]
2025-09-30T14:52:58.703915Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:58.703935Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:58.703939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:58.703943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:58.703946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:58.703969Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:58.703978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:58.703995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:58.704078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.704087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:58.704090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:58.704095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:58.704098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:58.704192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:58.704200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.704216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:58.704231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:58.704254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:58.704297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895353211913349:4840], now have 1 active actors on pipe
2025-09-30T14:52:58.704306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895353211913242:2454], now have 1 active actors on pipe
2025-09-30T14:52:58.704314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895353122165974:6811]
2025-09-30T14:52:58.704316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895353122165974:6811]
2025-09-30T14:52:58.704318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895353122165974:6811]
2025-09-30T14:52:58.704336Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:58.704353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:58.704355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:58.704367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:58.704370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:58.704373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:58.704377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:58.704372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1025
2025-09-30T14:52:58.704377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1025
2025-09-30T14:52:58.704423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895353122165974:6811]
2025-09-30T14:52:58.704435Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:58.704442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:58.704454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:58.704460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:58.704524Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1cb9d91-80df9fd3-6150afb4-1cc76be0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:58.704538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:58.704547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:58.704550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:58.704562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:58.704579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:58.704607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:58.704804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:58.704818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:58.704836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:58.704941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1026 partition: 0 MaxSeqNo: 42 sessionId: src_id|c1cb9d91-80df9fd3-6150afb4-1cc76be0_0
2025-09-30T14:52:58.705432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddb52517-5ae38b65-9840c6fb-d731919f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c1cb9d91-80df9fd3-6150afb4-1cc76be0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:58.708248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1cb9d91-80df9fd3-6150afb4-1cc76be0_0] Write session: try to update token
2025-09-30T14:52:58.708270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1cb9d91-80df9fd3-6150afb4-1cc76be0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:58.718275Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:58.718301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:58.718305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:58.718308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:58.718323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895353122165974:6811]
2025-09-30T14:52:58.718328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895353122165974:6811]
2025-09-30T14:52:58.718335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895353122165974:6811]
2025-09-30T14:52:58.718383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:58.718393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:58.718395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.718399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:58.718401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:58.718407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:58.718580Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:58.724466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1026 sessionId: src_id|c1cb9d91-80df9fd3-6150afb4-1cc76be0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:58.727132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:58.777796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895353211913358:5026]
2025-09-30T14:52:58.778154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1025, pipe: [1:7555895353211913358:5026]
2025-09-30T14:52:58.846097Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:58.846702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:58.846726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:58.846776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895353211913358:5026], now have 1 active actors on pipe
2025-09-30T14:52:58.847062Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:58.847049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895353211913358:5026]
2025-09-30T14:52:58.847056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:58.847062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:58.847094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:58.847148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1026 reason: error at write: Disconnected sessionId: src_id|c1cb9d91-80df9fd3-6150afb4-1cc76be0_0
2025-09-30T14:52:58.847419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1026 sessionId: src_id|c1cb9d91-80df9fd3-6150afb4-1cc76be0_0 is DEAD
2025-09-30T14:52:58.847640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1cb9d91-80df9fd3-6150afb4-1cc76be0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:58.847653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1cb9d91-80df9fd3-6150afb4-1cc76be0_0] Write session will restart in 0.008560s
2025-09-30T14:52:58.847683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1cb9d91-80df9fd3-6150afb4-1cc76be0_0] Write session: Do CDS request
2025-09-30T14:52:58.847695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1cb9d91-80df9fd3-6150afb4-1cc76be0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:58.857895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1cb9d91-80df9fd3-6150afb4-1cc76be0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:58.858001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:58.858019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1027
2025-09-30T14:52:58.858224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1027 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:58.858256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1027 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:58.858267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1027 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:58.858272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:58.858694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1027 sessionId:  describe result for acl check
2025-09-30T14:52:58.858739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:58.858745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:58.858746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:58.858752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895353211913430:4836] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:58.858960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:58.859332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895353211913430:4836] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:58.860905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895353211913430:4836] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:58.861052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:58.861337Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:58.861351Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:58.861378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:58.861455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:58.861504Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895353122166087:6813]
2025-09-30T14:52:58.862284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:58.862732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:58.862786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:58.863180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:58.863278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:58.863280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:58.863281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:58.863283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:58.863284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:58.863286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:58.863287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:58.863288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:58.863290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:58.863291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:58.863293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.863294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:58.863296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:58.863297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:58.863299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:58.863306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:58.863319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:58.863323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:58.863328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:58.863332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:58.863337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:58.863341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:58.863346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:58.863350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:58.863365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:58.863370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.863374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:58.863378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:58.863383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:58.863387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:58.863396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:58.863404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:58.863412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:58.863419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:58.863425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:58.863431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:58.863437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:58.863443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:58.863449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:58.863458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:58.863463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:58.863469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:58.863475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:58.863481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:58.863487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:58.863492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:58.863498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:58.863505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:58.863510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:58.863517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:58.863522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.863529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.863536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:58.863541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:58.863548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:58.863563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:58.863585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:58.863592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:58.863603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:58.863608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:58.863662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:58.863793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895353211913430:4836] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:58.863810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895353211913430:4836] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:58.863814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895353211913430:4836] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:58.863830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1027 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:58.869816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:58.870895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:58.870919Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:58.870922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:58.870928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:58.870936Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1026 [2:7555895353122166087:6813]
2025-09-30T14:52:58.870959Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:58.870991Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:58.870999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:58.871004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:58.871007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:58.871029Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:58.871043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:58.871052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:58.871157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.871168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:58.871171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:58.871175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:58.871180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:58.871302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:58.871314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.871333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:58.871347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:58.871376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:58.871409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895353211913467:4836], now have 1 active actors on pipe
2025-09-30T14:52:58.871420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895353211913359:2454], now have 1 active actors on pipe
2025-09-30T14:52:58.871429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895353122166082:6813]
2025-09-30T14:52:58.871432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895353122166082:6813]
2025-09-30T14:52:58.871434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895353122166082:6813]
2025-09-30T14:52:58.871453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:58.871474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:58.871478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:58.871491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:58.871495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:58.871496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:58.871500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:58.871484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1026
2025-09-30T14:52:58.871474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1026
2025-09-30T14:52:58.871553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895353122166082:6813]
2025-09-30T14:52:58.871574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:58.871590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:58.871600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:58.871607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:58.871677Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ea5ce8b-b05e13af-637560f2-4a1c5b15_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:58.871694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:58.871699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:58.871704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:58.871720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:58.871739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:58.871770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:58.871953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:58.871968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:58.871989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:58.872081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1027 partition: 0 MaxSeqNo: 42 sessionId: src_id|9ea5ce8b-b05e13af-637560f2-4a1c5b15_0
2025-09-30T14:52:58.872487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1cb9d91-80df9fd3-6150afb4-1cc76be0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9ea5ce8b-b05e13af-637560f2-4a1c5b15_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:58.875427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea5ce8b-b05e13af-637560f2-4a1c5b15_0] Write session: try to update token
2025-09-30T14:52:58.875446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea5ce8b-b05e13af-637560f2-4a1c5b15_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:58.883820Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:58.883844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:58.883847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:58.883849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:58.883859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895353122166082:6813]
2025-09-30T14:52:58.883865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895353122166082:6813]
2025-09-30T14:52:58.883869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895353122166082:6813]
2025-09-30T14:52:58.883909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:58.883916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:58.883916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:58.883919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:58.883923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:58.883927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:58.884050Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:58.890907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1027 sessionId: src_id|9ea5ce8b-b05e13af-637560f2-4a1c5b15_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:58.893840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:58.947267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895353211913481:5026]
2025-09-30T14:52:58.947650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1026, pipe: [1:7555895353211913481:5026]
2025-09-30T14:52:59.008200Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:59.008708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:59.008727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:59.008778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895353211913481:5026], now have 1 active actors on pipe
2025-09-30T14:52:59.009103Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:59.009160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:59.009173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:59.009183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895353211913481:5026]
2025-09-30T14:52:59.009204Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:59.009270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1027 reason: error at write: Disconnected sessionId: src_id|9ea5ce8b-b05e13af-637560f2-4a1c5b15_0
2025-09-30T14:52:59.009462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1027 sessionId: src_id|9ea5ce8b-b05e13af-637560f2-4a1c5b15_0 is DEAD
2025-09-30T14:52:59.009646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea5ce8b-b05e13af-637560f2-4a1c5b15_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:59.009657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea5ce8b-b05e13af-637560f2-4a1c5b15_0] Write session will restart in 0.008504s
2025-09-30T14:52:59.009680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea5ce8b-b05e13af-637560f2-4a1c5b15_0] Write session: Do CDS request
2025-09-30T14:52:59.009690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea5ce8b-b05e13af-637560f2-4a1c5b15_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:59.019770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea5ce8b-b05e13af-637560f2-4a1c5b15_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:59.019800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:59.020477Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:59.020494Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1028
2025-09-30T14:52:59.020641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1028 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:59.020675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1028 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:59.020681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1028 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:59.020685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:59.021132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1028 sessionId:  describe result for acl check
2025-09-30T14:52:59.021170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:59.021172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:59.021174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:59.021180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895357506880876:4816] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:59.021736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895357506880876:4816] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:59.021728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:59.021912Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:59.021927Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:59.021938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:59.021992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:59.022030Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895357417133528:6827]
2025-09-30T14:52:59.022669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:59.022967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:59.023036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:59.023422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:59.023493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:59.023501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:59.023503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:59.023504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:59.023505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:59.023506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:59.023508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:59.023510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:59.023511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:59.023512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:59.023514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.023515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.023516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.023518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:59.023519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:59.023525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:59.023536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:59.023541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:59.023546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:59.023551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:59.023556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:59.023560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:59.023565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:59.023570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:59.023575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:59.023580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.023584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.023588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.023593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:59.023597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:59.023605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:59.023615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:59.023622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:59.023628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:59.023634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:59.023640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:59.023645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:59.023651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:59.023657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:59.023663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:59.023669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:59.023675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:59.023680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:59.023687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:59.023692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:59.023698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:59.023706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:59.023712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:59.023717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:59.023724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:59.023729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.023735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.023741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.023747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.023752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.023758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.023763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:59.023769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:59.023775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:59.023781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:59.023830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:59.023857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895357506880876:4816] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:59.029159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895357506880876:4816] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:59.029174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895357506880876:4816] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:59.029177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895357506880876:4816] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:59.029186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1028 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:59.029445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:59.030343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:59.030365Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:59.030368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:59.030372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:59.030379Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1027 [2:7555895357417133528:6827]
2025-09-30T14:52:59.030396Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:59.030410Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:59.030413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:59.030417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:59.030420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:59.030439Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:59.030446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:59.030453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:59.030510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.030520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.030522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.030525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:59.030528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:59.030595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:59.030605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.030617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.030628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.030649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:59.030675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895357506880799:2454], now have 1 active actors on pipe
2025-09-30T14:52:59.030685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895357506880911:4816], now have 1 active actors on pipe
2025-09-30T14:52:59.030692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895357417133522:6827]
2025-09-30T14:52:59.030695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895357417133522:6827]
2025-09-30T14:52:59.030697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895357417133522:6827]
2025-09-30T14:52:59.030713Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:59.030731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:59.030736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:59.030740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:59.030743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:59.030730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1027
2025-09-30T14:52:59.030753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1027
2025-09-30T14:52:59.030755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:59.030759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:59.030791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895357417133522:6827]
2025-09-30T14:52:59.030799Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:59.030815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:59.030820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:59.030826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:59.030872Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|abcefbc4-2035a79a-3ff9bbce-707f23fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:59.030886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:59.030890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:59.030893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:59.030904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:59.030914Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:59.030936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:59.031080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:59.031091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:59.031106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:59.034880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1028 partition: 0 MaxSeqNo: 42 sessionId: src_id|abcefbc4-2035a79a-3ff9bbce-707f23fe_0
2025-09-30T14:52:59.035332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea5ce8b-b05e13af-637560f2-4a1c5b15_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|abcefbc4-2035a79a-3ff9bbce-707f23fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:59.038224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abcefbc4-2035a79a-3ff9bbce-707f23fe_0] Write session: try to update token
2025-09-30T14:52:59.038249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abcefbc4-2035a79a-3ff9bbce-707f23fe_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:59.044119Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:59.044145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:59.044148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:59.044150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:59.044160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895357417133522:6827]
2025-09-30T14:52:59.044165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895357417133522:6827]
2025-09-30T14:52:59.044170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895357417133522:6827]
2025-09-30T14:52:59.044216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:59.044219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:59.044224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.044227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:59.044231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:59.044244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:59.044373Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:59.053838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1028 sessionId: src_id|abcefbc4-2035a79a-3ff9bbce-707f23fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:59.056786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:59.109527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895357506880934:5026]
2025-09-30T14:52:59.109767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1027, pipe: [1:7555895357506880934:5026]
2025-09-30T14:52:59.158069Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:59.158607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:59.158626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:59.158650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895357506880934:5026], now have 1 active actors on pipe
2025-09-30T14:52:59.158891Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:59.159531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abcefbc4-2035a79a-3ff9bbce-707f23fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:59.159543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abcefbc4-2035a79a-3ff9bbce-707f23fe_0] Write session will restart in 0.007551s
2025-09-30T14:52:59.159567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abcefbc4-2035a79a-3ff9bbce-707f23fe_0] Write session: Do CDS request
2025-09-30T14:52:59.159574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abcefbc4-2035a79a-3ff9bbce-707f23fe_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:59.158994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895357506880934:5026]
2025-09-30T14:52:59.158999Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:59.159025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:59.159113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1028 reason: status is not ok: tablet will be restarted right now sessionId: src_id|abcefbc4-2035a79a-3ff9bbce-707f23fe_0
2025-09-30T14:52:59.159373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1028 sessionId: src_id|abcefbc4-2035a79a-3ff9bbce-707f23fe_0 is DEAD
2025-09-30T14:52:59.168923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abcefbc4-2035a79a-3ff9bbce-707f23fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:59.169027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:59.169056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1029
2025-09-30T14:52:59.169229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1029 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:59.169280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1029 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:59.169289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1029 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:59.169294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:59.169867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1029 sessionId:  describe result for acl check
2025-09-30T14:52:59.169917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:59.169927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:59.169929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:59.169936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895357506880971:4812] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:59.170519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895357506880971:4812] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:59.173648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895357506880971:4812] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:59.174998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:59.177416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:59.177699Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:59.177713Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:59.177737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:59.177800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:59.177852Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895357417133652:6831]
2025-09-30T14:52:59.177919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895357506880971:4812] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:59.177934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895357506880971:4812] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:59.177938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895357506880971:4812] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:59.177946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1029 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:59.178690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:59.179020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:59.179074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:59.179489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:59.179571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:59.179578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:59.179579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:59.179580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:59.179581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:59.179583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:59.179584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:59.179586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:59.179588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:59.179589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:59.179591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.179592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.179594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.179595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:59.179597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:59.179604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:59.179617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:59.179622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:59.179628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:59.179633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:59.179638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:59.179643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:59.179647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:59.179652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:59.179658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:59.179663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.179668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.179673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.179678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:59.179683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:59.179693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:59.179703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:59.179711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:59.179724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:59.179732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:59.179744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:59.179750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:59.179756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:59.179767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:59.179774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:59.179785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:59.179791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:59.179802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:59.179809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:59.179815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:59.179833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:59.179845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:59.179852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:59.179862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:59.179872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:59.179878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.179886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.179896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.179902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.179913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.179919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.179925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:59.179932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:59.179943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:59.179950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:59.180010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:59.189568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:59.190663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:59.190684Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:59.190687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:59.190691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:59.190710Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1028 [2:7555895357417133652:6831]
2025-09-30T14:52:59.190730Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:59.190748Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:59.190751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:59.190754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:59.190756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:59.190773Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:59.190783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:59.190796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:59.190861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.190868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.190870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.190873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:59.190876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:59.190950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:59.190957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.190971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.190988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.191011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:59.191035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895357506880936:2454], now have 1 active actors on pipe
2025-09-30T14:52:59.191044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895357506881043:4812], now have 1 active actors on pipe
2025-09-30T14:52:59.191051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895357417133647:6831]
2025-09-30T14:52:59.191055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895357417133647:6831]
2025-09-30T14:52:59.191057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895357417133647:6831]
2025-09-30T14:52:59.191070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:59.191084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:59.191090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:59.191096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:59.191098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:59.191105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:59.191110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:59.191145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895357417133647:6831]
2025-09-30T14:52:59.191153Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:59.191158Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1028
2025-09-30T14:52:59.191171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:59.191223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1028
2025-09-30T14:52:59.191380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:59.191411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:59.191449Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ebda727e-3660c51-d67d182e-7ce60003_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:59.191464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:59.191471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:59.191475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:59.191494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:59.191516Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:59.191548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:59.192082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:59.192103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:59.192131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:59.192249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1029 partition: 0 MaxSeqNo: 42 sessionId: src_id|ebda727e-3660c51-d67d182e-7ce60003_0
2025-09-30T14:52:59.192626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abcefbc4-2035a79a-3ff9bbce-707f23fe_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ebda727e-3660c51-d67d182e-7ce60003_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:59.195367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebda727e-3660c51-d67d182e-7ce60003_0] Write session: try to update token
2025-09-30T14:52:59.195383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebda727e-3660c51-d67d182e-7ce60003_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:59.205195Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:52:59.205220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:59.205235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895357417133647:6831]
2025-09-30T14:52:59.205286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:52:59.205303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:52:59.205474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:52:59.205624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:59.205768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:59.205918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:52:59.206118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:52:59.206163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:52:59.213042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1029 sessionId: src_id|ebda727e-3660c51-d67d182e-7ce60003_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:59.215899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:59.216152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:59.216180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:59.216220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:59.216449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:59.217939Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:59.217959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:59.217962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:59.217964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:59.217975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895357417133647:6831]
2025-09-30T14:52:59.217980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895357417133647:6831]
2025-09-30T14:52:59.217985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895357417133647:6831]
2025-09-30T14:52:59.218026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:59.218033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.218036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:59.218050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:59.218067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:59.218072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:59.218168Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:59.259106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895357506881055:5026]
2025-09-30T14:52:59.259519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1028, pipe: [1:7555895357506881055:5026]
2025-09-30T14:52:59.330333Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:59.339082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:59.339114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:59.339312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:59.339381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:59.339450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:59.339523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:59.340037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:59.340051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:59.340126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:59.340188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:59.340254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:59.340326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:59.340375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:59.340388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:59.340457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:59.340512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:59.340579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:59.340651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:59.340699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:59.340708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:59.340774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:59.340840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:59.340915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:59.340983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:59.341026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:59.341034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:59.341101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:59.341164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:59.341228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:59.341302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:59.341350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:59.341357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:59.341426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:59.341490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:59.341556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:59.341627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:59.341673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:59.341681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:59.341749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:59.341810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:59.341878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:59.341945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:59.341992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:59.342000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:59.342068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:59.342136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:59.342214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:59.342300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:59.342345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:59.342353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:59.342423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:59.342484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:59.342548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:59.342613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:59.342661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:59.342669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:59.342733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:52:59.342802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:52:59.342874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:52:59.342940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:52:59.342993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:52:59.342997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:52:59.343067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895357506881055:5026], now have 1 active actors on pipe
2025-09-30T14:52:59.343501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:59.343598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:59.343621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:59.343665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1029 reason: error at write: Disconnected sessionId: src_id|ebda727e-3660c51-d67d182e-7ce60003_0
2025-09-30T14:52:59.344104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebda727e-3660c51-d67d182e-7ce60003_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:59.344115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebda727e-3660c51-d67d182e-7ce60003_0] Write session will restart in 0.009322s
2025-09-30T14:52:59.344139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebda727e-3660c51-d67d182e-7ce60003_0] Write session: Do CDS request
2025-09-30T14:52:59.344145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebda727e-3660c51-d67d182e-7ce60003_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:59.343856Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:59.344288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1029 sessionId: src_id|ebda727e-3660c51-d67d182e-7ce60003_0 is DEAD
2025-09-30T14:52:59.344561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895357506881055:5026]
2025-09-30T14:52:59.354868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebda727e-3660c51-d67d182e-7ce60003_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:59.355041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:59.355062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1030
2025-09-30T14:52:59.355275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1030 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:59.355315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1030 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:59.355336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1030 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:59.355346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:59.355445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:59.355887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1030 sessionId:  describe result for acl check
2025-09-30T14:52:59.355931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:59.355933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:59.355935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:59.355941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895357506881131:4808] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:59.356195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:59.356512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895357506881131:4808] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:59.356361Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:59.356373Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:59.356383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:59.356447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:59.356485Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895357417133763:6833]
2025-09-30T14:52:59.357136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:59.357829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:59.357895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:59.358282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:59.358345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:59.358352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:59.358353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:59.358354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:59.358356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:59.358357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:59.358358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:59.358360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:59.358361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:59.358362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:59.358364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.358365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.358366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.358367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:59.358368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:59.358375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:59.358385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:59.358389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:59.358394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:59.358399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:59.358403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:59.358407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:59.358412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:59.358417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:59.358421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:59.358425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.358429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.358434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.358438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:59.358443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:59.358450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:59.358458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:59.358466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:59.358484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:59.358489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:59.358494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:59.358499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:59.358505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:59.358511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:59.358517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:59.358522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:59.358528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:59.358532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:59.358538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:59.358563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:59.358576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:59.358581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:59.358587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:59.358592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:59.358597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:59.358604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.358611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.358616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.358622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.358626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.358632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.358637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:59.358643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:59.358647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:59.358653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:59.358701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:59.359345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895357506881131:4808] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:59.364457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895357506881131:4808] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:59.364477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895357506881131:4808] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:59.364482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895357506881131:4808] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:59.364493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1030 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:59.364817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:59.365832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:59.365861Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:59.365864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:59.365868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:59.365877Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1029 [2:7555895357417133763:6833]
2025-09-30T14:52:59.365896Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:59.365915Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:59.365919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:59.365923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:59.365926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:59.365950Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:59.365966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:59.365974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:59.366057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.366067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.366069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.366074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:59.366077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:59.366196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:59.366206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.366222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.366242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.366271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:59.366302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895357506881169:4808], now have 1 active actors on pipe
2025-09-30T14:52:59.366317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895357506881057:2454], now have 1 active actors on pipe
2025-09-30T14:52:59.366325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895357417133758:6833]
2025-09-30T14:52:59.366328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895357417133758:6833]
2025-09-30T14:52:59.366331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895357417133758:6833]
2025-09-30T14:52:59.366347Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:59.366363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:59.366366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:59.366371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:59.366374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:59.366380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:59.366384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:59.366372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1029
2025-09-30T14:52:59.366372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1029
2025-09-30T14:52:59.366423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895357417133758:6833]
2025-09-30T14:52:59.366440Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:59.366451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:59.366642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:59.366656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:59.366687Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b44b1f9b-fa8e2518-537ac15d-fa9f3d93_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:59.366700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:59.366705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:59.366707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:59.366719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:59.366731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:59.366750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:59.366951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:59.366962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:59.366979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:59.367113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1030 partition: 0 MaxSeqNo: 42 sessionId: src_id|b44b1f9b-fa8e2518-537ac15d-fa9f3d93_0
2025-09-30T14:52:59.367589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebda727e-3660c51-d67d182e-7ce60003_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b44b1f9b-fa8e2518-537ac15d-fa9f3d93_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:59.370877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b44b1f9b-fa8e2518-537ac15d-fa9f3d93_0] Write session: try to update token
2025-09-30T14:52:59.370899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b44b1f9b-fa8e2518-537ac15d-fa9f3d93_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:59.379948Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:59.379978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:59.379981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:59.379984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:59.379994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895357417133758:6833]
2025-09-30T14:52:59.380000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895357417133758:6833]
2025-09-30T14:52:59.380006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895357417133758:6833]
2025-09-30T14:52:59.380074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:59.380089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.380088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:59.380096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:59.380098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:59.380100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:59.380257Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:59.389261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1030 sessionId: src_id|b44b1f9b-fa8e2518-537ac15d-fa9f3d93_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:59.392499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:59.445114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895357506881177:5026]
2025-09-30T14:52:59.445457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1029, pipe: [1:7555895357506881177:5026]
2025-09-30T14:52:59.503748Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:59.504344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:59.504363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:59.504388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895357506881177:5026], now have 1 active actors on pipe
2025-09-30T14:52:59.504628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895357506881177:5026]
2025-09-30T14:52:59.504652Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:59.504662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:59.504665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:59.504703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:59.504755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1030 reason: error at write: Disconnected sessionId: src_id|b44b1f9b-fa8e2518-537ac15d-fa9f3d93_0
2025-09-30T14:52:59.504985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1030 sessionId: src_id|b44b1f9b-fa8e2518-537ac15d-fa9f3d93_0 is DEAD
2025-09-30T14:52:59.505208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b44b1f9b-fa8e2518-537ac15d-fa9f3d93_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:59.505217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b44b1f9b-fa8e2518-537ac15d-fa9f3d93_0] Write session will restart in 0.006712s
2025-09-30T14:52:59.505245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b44b1f9b-fa8e2518-537ac15d-fa9f3d93_0] Write session: Do CDS request
2025-09-30T14:52:59.505256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b44b1f9b-fa8e2518-537ac15d-fa9f3d93_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:59.512927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b44b1f9b-fa8e2518-537ac15d-fa9f3d93_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:59.513009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:59.513025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1031
2025-09-30T14:52:59.513350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1031 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:59.513409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1031 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:59.513423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1031 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:59.513429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:59.514012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1031 sessionId:  describe result for acl check
2025-09-30T14:52:59.514066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:59.514068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:59.514071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:59.514078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895357506881215:4798] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:59.514756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895357506881215:4798] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:59.517328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895357506881215:4798] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:59.517883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:59.520377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:59.520470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895357506881215:4798] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:59.520483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895357506881215:4798] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:59.520486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895357506881215:4798] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:59.520492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1031 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:59.520653Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:59.520667Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:59.520680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:59.520741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:59.520794Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895357417133876:6835]
2025-09-30T14:52:59.521547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:59.521945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:59.522010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:59.522417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:59.522502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:59.522509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:59.522510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:59.522511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:59.522512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:59.522514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:59.522515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:59.522516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:59.522518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:59.522519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:59.522521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.522522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.522524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.522525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:59.522527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:59.522534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:59.522545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:59.522549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:59.522553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:59.522557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:59.522560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:59.522564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:59.522568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:59.522572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:59.522577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:59.522582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.522586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.522590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.522594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:59.522599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:59.522608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:59.522617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:59.522625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:59.522637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:59.522643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:59.522652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:59.522658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:59.522669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:59.522674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:59.522680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:59.522686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:59.522692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:59.522697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:59.522703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:59.522710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:59.522717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:59.522727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:59.522733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:59.522740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:59.522751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:59.522756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.522764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.522770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.522782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.522787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.522792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.522797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:59.522803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:59.522809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:59.522818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:59.522863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:59.529433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:59.530771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:59.530793Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:59.530797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:59.530801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:59.530809Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1030 [2:7555895357417133876:6835]
2025-09-30T14:52:59.530830Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:59.530850Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:59.530858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:59.530862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:59.530866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:59.530893Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:59.530903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:59.530910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:59.530991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.531002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.531004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.531008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:59.531011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:59.531098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:59.531103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.531119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.531130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.531147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:59.531176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895357506881180:2454], now have 1 active actors on pipe
2025-09-30T14:52:59.531192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895357417133871:6835]
2025-09-30T14:52:59.531194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895357417133871:6835]
2025-09-30T14:52:59.531197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895357417133871:6835]
2025-09-30T14:52:59.531210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:59.531225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895357506881287:4798], now have 1 active actors on pipe
2025-09-30T14:52:59.531229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:59.531233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:59.531235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:59.531236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:59.531267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:59.531276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:59.531324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895357417133871:6835]
2025-09-30T14:52:59.531340Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:59.531324Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1030
2025-09-30T14:52:59.531351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1030
2025-09-30T14:52:59.531390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:59.531400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:59.531418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:59.531439Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bbf7500d-7b62eba4-546c1d45-83209df9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:59.531455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:59.531463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:59.531466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:59.531478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:59.531493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:59.531518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:59.531709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:59.531718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:59.531735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:59.531849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1031 partition: 0 MaxSeqNo: 42 sessionId: src_id|bbf7500d-7b62eba4-546c1d45-83209df9_0
2025-09-30T14:52:59.532340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b44b1f9b-fa8e2518-537ac15d-fa9f3d93_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bbf7500d-7b62eba4-546c1d45-83209df9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:59.536226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbf7500d-7b62eba4-546c1d45-83209df9_0] Write session: try to update token
2025-09-30T14:52:59.536252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbf7500d-7b62eba4-546c1d45-83209df9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:59.545820Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:59.545845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:59.545848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:59.545855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:59.545866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895357417133871:6835]
2025-09-30T14:52:59.545871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895357417133871:6835]
2025-09-30T14:52:59.545875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895357417133871:6835]
2025-09-30T14:52:59.545919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:59.545926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.545929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:59.545937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:59.545946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:59.545952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:59.546076Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:59.555999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1031 sessionId: src_id|bbf7500d-7b62eba4-546c1d45-83209df9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:59.558876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:59.604693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895357506881300:5026]
2025-09-30T14:52:59.605041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1030, pipe: [1:7555895357506881300:5026]
2025-09-30T14:52:59.658885Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:59.659268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:59.659289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:59.659311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895357506881300:5026], now have 1 active actors on pipe
2025-09-30T14:52:59.659543Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:59.659631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:59.659638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895357506881300:5026]
2025-09-30T14:52:59.659662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:59.659744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1031 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bbf7500d-7b62eba4-546c1d45-83209df9_0
2025-09-30T14:52:59.659921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1031 sessionId: src_id|bbf7500d-7b62eba4-546c1d45-83209df9_0 is DEAD
2025-09-30T14:52:59.660118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbf7500d-7b62eba4-546c1d45-83209df9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:59.660135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbf7500d-7b62eba4-546c1d45-83209df9_0] Write session will restart in 0.009245s
2025-09-30T14:52:59.660165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbf7500d-7b62eba4-546c1d45-83209df9_0] Write session: Do CDS request
2025-09-30T14:52:59.660173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbf7500d-7b62eba4-546c1d45-83209df9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:59.670941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbf7500d-7b62eba4-546c1d45-83209df9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:59.671106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:59.671141Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:59.671160Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1032
2025-09-30T14:52:59.671297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1032 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:59.671344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1032 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:59.671355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1032 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:59.671367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:59.671854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1032 sessionId:  describe result for acl check
2025-09-30T14:52:59.671892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:59.671899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:59.671901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:59.671908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895357506881377:4794] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:59.672575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895357506881377:4794] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:59.673618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:59.673819Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:59.673831Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:59.673843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:59.673895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:59.673948Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895357417133991:6838]
2025-09-30T14:52:59.674645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:59.675027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895357506881377:4794] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:59.675044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:59.675129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:59.675594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:59.675676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:59.675686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:59.675687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:59.675689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:59.675690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:59.675692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:59.675694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:59.675695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:59.675697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:59.675698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:59.675700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.675702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.675704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.675705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:59.675707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:59.675715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:59.675728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:59.675733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:59.675737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:59.675741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:59.675746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:59.675751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:59.675756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:59.675761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:59.675767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:59.675772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.675777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.675782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.675787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:59.675791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:59.675801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:59.675812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:59.675820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:59.675828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:59.675834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:59.675846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:59.675853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:59.675865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:59.675871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:59.675883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:59.675889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:59.675901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:59.675914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:59.675925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:59.675936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:59.675943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:59.675954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:59.675960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:59.675971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:59.675977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:59.675984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.675990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.675998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.676010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.676020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.676027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.676037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:59.676043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:59.676054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:59.676060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:59.676115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:59.681846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895357506881377:4794] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:59.681866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895357506881377:4794] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:59.681869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895357506881377:4794] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:59.681880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1032 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:59.682153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:59.683210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:59.683230Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:59.683234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:59.683239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:59.683266Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1031 [2:7555895357417133991:6838]
2025-09-30T14:52:59.683286Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:59.683312Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:59.683324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:59.683328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:59.683331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:59.683355Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:59.683363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:59.683371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:59.683446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.683454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.683457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.683461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:59.683465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:59.683550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:59.683562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.683577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.683591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.683610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:59.683641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895357506881301:2454], now have 1 active actors on pipe
2025-09-30T14:52:59.683651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895357506881414:4794], now have 1 active actors on pipe
2025-09-30T14:52:59.683660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895357417133985:6838]
2025-09-30T14:52:59.683668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895357417133985:6838]
2025-09-30T14:52:59.683671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895357417133985:6838]
2025-09-30T14:52:59.683687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:59.683741Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1031
2025-09-30T14:52:59.683762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1031
2025-09-30T14:52:59.683707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:59.683712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:59.683717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:59.683720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:59.683734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:59.683738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:59.683779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895357417133985:6838]
2025-09-30T14:52:59.683783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:59.683791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:59.683834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:59.683843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:59.683876Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9174f8a-7eeca24e-c7e30c50-4ed525e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:59.683884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:59.683889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:59.683893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:59.683905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:59.683917Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:59.683932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:59.684148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:59.684159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:59.684175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:59.684298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1032 partition: 0 MaxSeqNo: 42 sessionId: src_id|a9174f8a-7eeca24e-c7e30c50-4ed525e9_0
2025-09-30T14:52:59.684784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbf7500d-7b62eba4-546c1d45-83209df9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a9174f8a-7eeca24e-c7e30c50-4ed525e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:59.688245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9174f8a-7eeca24e-c7e30c50-4ed525e9_0] Write session: try to update token
2025-09-30T14:52:59.688266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9174f8a-7eeca24e-c7e30c50-4ed525e9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:59.697626Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:59.697654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:59.697656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:59.697659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:59.697671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895357417133985:6838]
2025-09-30T14:52:59.697682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895357417133985:6838]
2025-09-30T14:52:59.697688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895357417133985:6838]
2025-09-30T14:52:59.697734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:59.697738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:59.697745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:59.697748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.697750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:59.697751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:59.697935Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:59.707563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1032 sessionId: src_id|a9174f8a-7eeca24e-c7e30c50-4ed525e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:59.710920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:59.759815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895357506881423:5026]
2025-09-30T14:52:59.760199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1031, pipe: [1:7555895357506881423:5026]
2025-09-30T14:52:59.822572Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:59.823312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:59.823336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:59.823363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895357506881423:5026], now have 1 active actors on pipe
2025-09-30T14:52:59.823864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895357506881423:5026]
2025-09-30T14:52:59.823660Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:59.824552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9174f8a-7eeca24e-c7e30c50-4ed525e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:52:59.824564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9174f8a-7eeca24e-c7e30c50-4ed525e9_0] Write session will restart in 0.007285s
2025-09-30T14:52:59.824592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9174f8a-7eeca24e-c7e30c50-4ed525e9_0] Write session: Do CDS request
2025-09-30T14:52:59.824600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9174f8a-7eeca24e-c7e30c50-4ed525e9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:59.824060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:52:59.824134Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:59.824154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1032 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a9174f8a-7eeca24e-c7e30c50-4ed525e9_0
2025-09-30T14:52:59.824371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1032 sessionId: src_id|a9174f8a-7eeca24e-c7e30c50-4ed525e9_0 is DEAD
2025-09-30T14:52:59.833385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9174f8a-7eeca24e-c7e30c50-4ed525e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:59.833547Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:59.833565Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1033
2025-09-30T14:52:59.833754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1033 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:59.833800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1033 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:59.833811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1033 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:59.833818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:59.834385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1033 sessionId:  describe result for acl check
2025-09-30T14:52:59.834437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:59.834440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:59.834442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:59.834450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895357506881439:4792] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:59.835098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895357506881439:4792] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:59.837890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895357506881439:4792] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:59.839063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:59.840915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:59.841103Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:59.841115Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:59.841126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:59.841187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:59.841228Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895357417134105:6840]
2025-09-30T14:52:59.841284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895357506881439:4792] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:59.841302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895357506881439:4792] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:59.841306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895357506881439:4792] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:59.841315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1033 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:59.841891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:59.842228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:59.842292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:59.842654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:59.842720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:59.842727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:59.842728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:59.842730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:59.842731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:59.842733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:59.842735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:59.842736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:59.842737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:59.842738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:59.842739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.842741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.842742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.842744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:59.842745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:59.842751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:59.842762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:59.842767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:59.842772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:59.842777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:59.842782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:59.842787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:59.842791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:59.842796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:59.842802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:59.842806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.842811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.842816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.842820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:59.842824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:59.842832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:59.842840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:59.842847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:59.842852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:59.842859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:59.842865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:59.842870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:59.842875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:59.842881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:59.842887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:59.842891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:59.842898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:59.842903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:59.842909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:59.842914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:59.842920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:59.842926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:59.842931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:59.842936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:59.842942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:59.842947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.842952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.842957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.842963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.842967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.842972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.842977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:59.842982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:59.842986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:59.842991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:59.843037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:59.848889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:52:59.849956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:52:59.849974Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:52:59.849977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:52:59.849981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:52:59.849987Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1032 [2:7555895357417134105:6840]
2025-09-30T14:52:59.850002Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:52:59.850019Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:52:59.850027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:59.850030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:59.850033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:59.850047Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:52:59.850052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:52:59.850057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:52:59.850113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.850123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.850125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.850127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:52:59.850129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:52:59.850194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:52:59.850204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.850217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.850235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.850251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:52:59.850270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895357506881535:4792], now have 1 active actors on pipe
2025-09-30T14:52:59.850281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895357506881424:2454], now have 1 active actors on pipe
2025-09-30T14:52:59.850286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895357417134100:6840]
2025-09-30T14:52:59.850289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895357417134100:6840]
2025-09-30T14:52:59.850290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895357417134100:6840]
2025-09-30T14:52:59.850302Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:52:59.850316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:52:59.850316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:52:59.850330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:52:59.850334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:52:59.850335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:52:59.850337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:52:59.850369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895357417134100:6840]
2025-09-30T14:52:59.850381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:52:59.850383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:52:59.850405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:59.850411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:59.850357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1032
2025-09-30T14:52:59.850403Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1032
2025-09-30T14:52:59.850444Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90c8e3c-d9de53ab-8a7d3b4e-ab90620e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:59.850460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:59.850463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:59.850465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:59.850474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:59.850484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:59.850505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:59.850809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:59.850823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:59.850844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:59.850958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1033 partition: 0 MaxSeqNo: 42 sessionId: src_id|90c8e3c-d9de53ab-8a7d3b4e-ab90620e_0
2025-09-30T14:52:59.851385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9174f8a-7eeca24e-c7e30c50-4ed525e9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|90c8e3c-d9de53ab-8a7d3b4e-ab90620e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:52:59.854451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90c8e3c-d9de53ab-8a7d3b4e-ab90620e_0] Write session: try to update token
2025-09-30T14:52:59.854473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90c8e3c-d9de53ab-8a7d3b4e-ab90620e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:52:59.862748Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:52:59.862769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:52:59.862772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:52:59.862774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:52:59.862784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895357417134100:6840]
2025-09-30T14:52:59.862789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895357417134100:6840]
2025-09-30T14:52:59.862794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895357417134100:6840]
2025-09-30T14:52:59.862833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:52:59.862845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.862849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:52:59.862870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:52:59.862888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:52:59.862892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:52:59.863000Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:52:59.873179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1033 sessionId: src_id|90c8e3c-d9de53ab-8a7d3b4e-ab90620e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:59.875955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:59.924180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895357506881547:5026]
2025-09-30T14:52:59.924508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1032, pipe: [1:7555895357506881547:5026]
2025-09-30T14:52:59.977105Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:52:59.977437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:59.977452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:59.977472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895357506881547:5026], now have 1 active actors on pipe
2025-09-30T14:52:59.977689Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:52:59.977747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:52:59.977761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:52:59.977803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895357506881547:5026]
2025-09-30T14:52:59.977821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:52:59.977835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1033 reason: error at write: Disconnected sessionId: src_id|90c8e3c-d9de53ab-8a7d3b4e-ab90620e_0
2025-09-30T14:52:59.978033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1033 sessionId: src_id|90c8e3c-d9de53ab-8a7d3b4e-ab90620e_0 is DEAD
2025-09-30T14:52:59.978309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90c8e3c-d9de53ab-8a7d3b4e-ab90620e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:52:59.978325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90c8e3c-d9de53ab-8a7d3b4e-ab90620e_0] Write session will restart in 0.006271s
2025-09-30T14:52:59.978357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90c8e3c-d9de53ab-8a7d3b4e-ab90620e_0] Write session: Do CDS request
2025-09-30T14:52:59.978364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90c8e3c-d9de53ab-8a7d3b4e-ab90620e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:52:59.985916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90c8e3c-d9de53ab-8a7d3b4e-ab90620e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:59.985983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:59.985998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1034
2025-09-30T14:52:59.986211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1034 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:59.986249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1034 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:52:59.986274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1034 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:52:59.986279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:59.986699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1034 sessionId:  describe result for acl check
2025-09-30T14:52:59.986732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:59.986752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:59.986754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:59.986760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895357506881620:4788] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:59.987385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895357506881620:4788] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:59.988774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:52:59.990565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:52:59.990760Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:52:59.990773Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:52:59.990785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:52:59.990847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:52:59.990886Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895357417134219:6842]
2025-09-30T14:52:59.991272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895357506881620:4788] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:59.991614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:52:59.991934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:52:59.992004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:52:59.992457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:52:59.992542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:59.992549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:59.992550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:59.992552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:59.992553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:59.992554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:59.992556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:59.992558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:59.992560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:59.992561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:59.992562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.992563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.992565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.992566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:59.992567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:59.992573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:59.992582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:59.992587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:59.992590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:59.992594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:59.992599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:59.992602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:59.992606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:59.992610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:59.992615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:59.992619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.992622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.992626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.992630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:59.992633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:59.992641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:59.992649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:52:59.992655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:59.992660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:52:59.992665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:59.992671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:52:59.992675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:59.992679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:52:59.992685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:59.992690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:52:59.992694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:59.992699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:52:59.992705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:59.992710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:52:59.992714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:59.992719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:52:59.992729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:59.992734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:52:59.992741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:59.992752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:52:59.992756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.992772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:52:59.992785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.992790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:52:59.992794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.992799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:52:59.992803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:59.992808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:52:59.992812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:59.992817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:52:59.992858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:52:59.995907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895357506881620:4788] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:59.995923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895357506881620:4788] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:59.995926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895357506881620:4788] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:59.995934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1034 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:00.000539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:00.001582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:00.001604Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:00.001607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:00.001611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:00.001618Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1033 [2:7555895357417134219:6842]
2025-09-30T14:53:00.001635Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:00.001650Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:00.001658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:00.001661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:00.001664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:00.001680Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:00.001687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:00.001694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:00.001752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.001761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.001763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.001767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:00.001769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:00.001831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:00.001839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.001852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.001871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.001892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:00.001915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895357506881676:4788], now have 1 active actors on pipe
2025-09-30T14:53:00.001919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895357506881548:2454], now have 1 active actors on pipe
2025-09-30T14:53:00.001926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895357417134213:6842]
2025-09-30T14:53:00.001928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895357417134213:6842]
2025-09-30T14:53:00.001930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895357417134213:6842]
2025-09-30T14:53:00.001943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:00.001956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:00.001957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:00.001960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:00.001962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:00.001974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:00.001978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:00.002013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895357417134213:6842]
2025-09-30T14:53:00.002025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:00.002040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:00.002302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1033
2025-09-30T14:53:00.002332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1033
2025-09-30T14:53:00.002455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:00.002469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:00.002500Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce8937b9-7e680d2f-2e36939a-dd56fda1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:00.002515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:00.002523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:00.002526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:00.002536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:00.002551Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:00.002576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:00.002741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:00.002750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:00.002772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:00.002882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1034 partition: 0 MaxSeqNo: 42 sessionId: src_id|ce8937b9-7e680d2f-2e36939a-dd56fda1_0
2025-09-30T14:53:00.003343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90c8e3c-d9de53ab-8a7d3b4e-ab90620e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ce8937b9-7e680d2f-2e36939a-dd56fda1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:00.006607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce8937b9-7e680d2f-2e36939a-dd56fda1_0] Write session: try to update token
2025-09-30T14:53:00.006628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce8937b9-7e680d2f-2e36939a-dd56fda1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:00.014442Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:00.014461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:00.014471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895357417134213:6842]
2025-09-30T14:53:00.014520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:00.014533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:00.014712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:00.014859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:00.015003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:00.015145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:00.015372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:00.015408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:00.024449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1034 sessionId: src_id|ce8937b9-7e680d2f-2e36939a-dd56fda1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:00.025705Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:00.025723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:00.025726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:00.025728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:00.025737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895357417134213:6842]
2025-09-30T14:53:00.025741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895357417134213:6842]
2025-09-30T14:53:00.025745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895357417134213:6842]
2025-09-30T14:53:00.025788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:00.025799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.025802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:00.025801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:00.025808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:00.025812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:00.025949Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:00.027934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:00.077779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895361801848995:5026]
2025-09-30T14:53:00.078192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1033, pipe: [1:7555895361801848995:5026]
2025-09-30T14:53:00.140943Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:00.141468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:00.141486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:00.141509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895361801848995:5026], now have 1 active actors on pipe
2025-09-30T14:53:00.141750Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:00.141804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:00.141808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895361801848995:5026]
2025-09-30T14:53:00.141833Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:00.141889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1034 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ce8937b9-7e680d2f-2e36939a-dd56fda1_0
2025-09-30T14:53:00.142129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1034 sessionId: src_id|ce8937b9-7e680d2f-2e36939a-dd56fda1_0 is DEAD
2025-09-30T14:53:00.142450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce8937b9-7e680d2f-2e36939a-dd56fda1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:00.142468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce8937b9-7e680d2f-2e36939a-dd56fda1_0] Write session will restart in 0.008739s
2025-09-30T14:53:00.142500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce8937b9-7e680d2f-2e36939a-dd56fda1_0] Write session: Do CDS request
2025-09-30T14:53:00.142515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce8937b9-7e680d2f-2e36939a-dd56fda1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:00.152951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce8937b9-7e680d2f-2e36939a-dd56fda1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:00.153045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:00.153061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1035
2025-09-30T14:53:00.153289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1035 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:00.153322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1035 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:00.153332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1035 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:00.153345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:00.153576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:00.153800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1035 sessionId:  describe result for acl check
2025-09-30T14:53:00.153833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:00.153835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:00.153837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:00.153843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895361801849090:4769] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:00.154444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895361801849090:4769] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:00.155368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:00.155552Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:00.155565Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:00.155576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:00.155655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:00.155696Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895361712101681:6858]
2025-09-30T14:53:00.156365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:00.156368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895361801849090:4769] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:00.156745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:00.156829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:00.157205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:00.157276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:00.157282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:00.157283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:00.157285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:00.157286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:00.157287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:00.157289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:00.157290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:00.157291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:00.157293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:00.157294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.157295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.157297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.157298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:00.157299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:00.157305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:00.157315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:00.157319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:00.157324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:00.157328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:00.157333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:00.157338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:00.157343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:00.157349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:00.157354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:00.157359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.157364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.157369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.157374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:00.157379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:00.157388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:00.157397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:00.157404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:00.157411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:00.157417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:00.157424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:00.157429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:00.157436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:00.157442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:00.157449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:00.157454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:00.157461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:00.157468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:00.157478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:00.157489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:00.157496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:00.157501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:00.157512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:00.157517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:00.157528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:00.157533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.157542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.157552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.157558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.157565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.157577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.157587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:00.157593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:00.157605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:00.157611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:00.157672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:00.163346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:00.163582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895361801849090:4769] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:00.163599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895361801849090:4769] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:00.163603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895361801849090:4769] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:00.163612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1035 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:00.164425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:00.164444Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:00.164447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:00.164452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:00.164458Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1034 [2:7555895361712101681:6858]
2025-09-30T14:53:00.164476Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:00.164491Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:00.164494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:00.164497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:00.164500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:00.164517Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:00.164523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:00.164529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:00.164588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.164596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.164598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.164603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:00.164606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:00.164671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:00.164680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.164694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.164713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.164738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:00.164761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895361712101675:6858]
2025-09-30T14:53:00.164764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895361712101675:6858]
2025-09-30T14:53:00.164766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895361712101675:6858]
2025-09-30T14:53:00.164783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:00.164797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:00.164818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:00.164825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:00.164827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:00.164828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:00.164830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:00.164863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895361712101675:6858]
2025-09-30T14:53:00.164872Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:00.164898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:00.164934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895361801849127:4769], now have 1 active actors on pipe
2025-09-30T14:53:00.164943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895361801849011:2454], now have 1 active actors on pipe
2025-09-30T14:53:00.165021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1034
2025-09-30T14:53:00.165023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1034
2025-09-30T14:53:00.165243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:00.165260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:00.165291Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33f8650-d24c018e-32709d50-1a15c96c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:00.165305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:00.165311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:00.165314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:00.165327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:00.165344Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:00.165359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:00.165533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:00.165545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:00.165586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:00.165663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1035 partition: 0 MaxSeqNo: 42 sessionId: src_id|33f8650-d24c018e-32709d50-1a15c96c_0
2025-09-30T14:53:00.166211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce8937b9-7e680d2f-2e36939a-dd56fda1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|33f8650-d24c018e-32709d50-1a15c96c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:00.169748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33f8650-d24c018e-32709d50-1a15c96c_0] Write session: try to update token
2025-09-30T14:53:00.169776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33f8650-d24c018e-32709d50-1a15c96c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:00.177372Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:00.177388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:00.177397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895361712101675:6858]
2025-09-30T14:53:00.177441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:00.177443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:00.177631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:00.177781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:00.177924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:00.178069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:00.178296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:00.178350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:00.188335Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:00.188352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:00.188355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:00.188357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:00.188368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895361712101675:6858]
2025-09-30T14:53:00.188373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895361712101675:6858]
2025-09-30T14:53:00.188383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895361712101675:6858]
2025-09-30T14:53:00.188423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:00.188428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.188430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:00.188447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:00.188455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:00.188464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:00.188567Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:00.188669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1035 sessionId: src_id|33f8650-d24c018e-32709d50-1a15c96c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:00.191898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:00.242135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895361801849136:5026]
2025-09-30T14:53:00.242465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1034, pipe: [1:7555895361801849136:5026]
2025-09-30T14:53:00.298028Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:00.298332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:00.298343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:00.298365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895361801849136:5026], now have 1 active actors on pipe
2025-09-30T14:53:00.298583Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:00.298695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:00.298700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895361801849136:5026]
2025-09-30T14:53:00.298714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:00.298722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:00.298789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1035 reason: error at write: Disconnected sessionId: src_id|33f8650-d24c018e-32709d50-1a15c96c_0
2025-09-30T14:53:00.299006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1035 sessionId: src_id|33f8650-d24c018e-32709d50-1a15c96c_0 is DEAD
2025-09-30T14:53:00.299152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f8650-d24c018e-32709d50-1a15c96c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:00.299162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f8650-d24c018e-32709d50-1a15c96c_0] Write session will restart in 0.006986s
2025-09-30T14:53:00.299179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f8650-d24c018e-32709d50-1a15c96c_0] Write session: Do CDS request
2025-09-30T14:53:00.299183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f8650-d24c018e-32709d50-1a15c96c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:00.307810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:00.307965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33f8650-d24c018e-32709d50-1a15c96c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:00.308083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:00.308098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1036
2025-09-30T14:53:00.308249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1036 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:00.308284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1036 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:00.308295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1036 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:00.308300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:00.308733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1036 sessionId:  describe result for acl check
2025-09-30T14:53:00.308776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:00.308784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:00.308786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:00.308792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895361801849216:4759] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:00.309354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895361801849216:4759] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:00.309740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:00.309898Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:00.309904Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:00.309913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:00.309968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:00.310000Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895361712101796:6860]
2025-09-30T14:53:00.310469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:00.310663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:00.310694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:00.310978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:00.311046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:00.311052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:00.311053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:00.311054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:00.311055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:00.311057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:00.311058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:00.311059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:00.311061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:00.311062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:00.311063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.311064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.311065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.311066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:00.311068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:00.311073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:00.311083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:00.311088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:00.311092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:00.311097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:00.311101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:00.311105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:00.311109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:00.311113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:00.311118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:00.311122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.311126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.311130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.311134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:00.311138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:00.311146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:00.311154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:00.311160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:00.311166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:00.311171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:00.311177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:00.311181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:00.311187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:00.311192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:00.311202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:00.311206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:00.311212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:00.311217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:00.311222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:00.311225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:00.311228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:00.311231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:00.311234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:00.311236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:00.311239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:00.311264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.311270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.311273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.311276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.311279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.311282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.311284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:00.311288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:00.311290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:00.311293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:00.311326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:00.311652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895361801849216:4759] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:00.316184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895361801849216:4759] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:00.316200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895361801849216:4759] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:00.316204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895361801849216:4759] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:00.316214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1036 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:00.316472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:00.317468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:00.317484Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:00.317488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:00.317492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:00.317498Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1035 [2:7555895361712101796:6860]
2025-09-30T14:53:00.317515Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:00.317529Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:00.317537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:00.317541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:00.317543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:00.317559Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:00.317570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:00.317577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:00.317635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.317643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.317645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.317649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:00.317651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:00.317716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:00.317723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.317736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.317754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.317779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:00.317802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895361801849137:2454], now have 1 active actors on pipe
2025-09-30T14:53:00.317811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895361801849255:4759], now have 1 active actors on pipe
2025-09-30T14:53:00.317817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895361712101791:6860]
2025-09-30T14:53:00.317824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895361712101791:6860]
2025-09-30T14:53:00.317826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895361712101791:6860]
2025-09-30T14:53:00.317840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:00.317826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1035
2025-09-30T14:53:00.317839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1035
2025-09-30T14:53:00.317857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:00.317856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:00.317859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:00.317860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:00.317879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:00.317883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:00.317923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:00.317932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:00.317948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895361712101791:6860]
2025-09-30T14:53:00.317960Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:00.317973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:00.317994Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1e32d8a-da513869-fe8068e1-e0564fe0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:00.318005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:00.318010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:00.318017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:00.318028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:00.318037Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:00.318065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:00.318227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:00.318236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:00.318249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:00.318328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1036 partition: 0 MaxSeqNo: 42 sessionId: src_id|f1e32d8a-da513869-fe8068e1-e0564fe0_0
2025-09-30T14:53:00.318683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f8650-d24c018e-32709d50-1a15c96c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f1e32d8a-da513869-fe8068e1-e0564fe0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:00.321529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1e32d8a-da513869-fe8068e1-e0564fe0_0] Write session: try to update token
2025-09-30T14:53:00.321548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1e32d8a-da513869-fe8068e1-e0564fe0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:00.330214Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:00.330232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:00.330235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:00.330237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:00.330248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895361712101791:6860]
2025-09-30T14:53:00.330253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895361712101791:6860]
2025-09-30T14:53:00.330261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895361712101791:6860]
2025-09-30T14:53:00.330305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:00.330318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.330317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:00.330321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:00.330325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:00.330329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:00.330458Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:00.335994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1036 sessionId: src_id|f1e32d8a-da513869-fe8068e1-e0564fe0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:00.338776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:00.398801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895361801849263:5026]
2025-09-30T14:53:00.399107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1035, pipe: [1:7555895361801849263:5026]
2025-09-30T14:53:00.444150Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:00.444450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:00.444467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:00.444504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895361801849263:5026], now have 1 active actors on pipe
2025-09-30T14:53:00.444757Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:00.444833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895361801849263:5026]
2025-09-30T14:53:00.444858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:00.444865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:00.444927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1036 reason: error at write: Disconnected sessionId: src_id|f1e32d8a-da513869-fe8068e1-e0564fe0_0
2025-09-30T14:53:00.444956Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:00.445133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1036 sessionId: src_id|f1e32d8a-da513869-fe8068e1-e0564fe0_0 is DEAD
2025-09-30T14:53:00.445258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1e32d8a-da513869-fe8068e1-e0564fe0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:00.445268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1e32d8a-da513869-fe8068e1-e0564fe0_0] Write session will restart in 0.009928s
2025-09-30T14:53:00.445304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1e32d8a-da513869-fe8068e1-e0564fe0_0] Write session: Do CDS request
2025-09-30T14:53:00.445313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1e32d8a-da513869-fe8068e1-e0564fe0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:00.455269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:00.456813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1e32d8a-da513869-fe8068e1-e0564fe0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:00.456898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:00.456914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1037
2025-09-30T14:53:00.457085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1037 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:00.457121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1037 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:00.457131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1037 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:00.457135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:00.457319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:00.457511Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:00.457520Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:00.457529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:00.457525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1037 sessionId:  describe result for acl check
2025-09-30T14:53:00.457559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:00.457568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:00.457571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:00.457578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895361801849345:4757] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:00.457578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:00.457614Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895361712101914:6862]
2025-09-30T14:53:00.458129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895361801849345:4757] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:00.458230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:00.458555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:00.458618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:00.458963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:00.459036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:00.459043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:00.459044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:00.459045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:00.459046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:00.459047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:00.459048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:00.459049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:00.459051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:00.459052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:00.459053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.459054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.459055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.459056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:00.459057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:00.459062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:00.459071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:00.459074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:00.459078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:00.459082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:00.459086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:00.459089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:00.459093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:00.459097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:00.459101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:00.459104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.459108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.459112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.459116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:00.459120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:00.459127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:00.459135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:00.459141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:00.459146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:00.459150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:00.459155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:00.459159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:00.459163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:00.459168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:00.459173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:00.459178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:00.459183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:00.459187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:00.459193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:00.459197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:00.459202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:00.459206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:00.459211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:00.459217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:00.459222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:00.459227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.459232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.459236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.459276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.459283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.459288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.459292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:00.459296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:00.459300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:00.459305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:00.459346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:00.460029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895361801849345:4757] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:00.464323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895361801849345:4757] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:00.464338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895361801849345:4757] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:00.464341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895361801849345:4757] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:00.464349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1037 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:00.464697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:00.465535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:00.465549Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:00.465551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:00.465554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:00.465559Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1036 [2:7555895361712101914:6862]
2025-09-30T14:53:00.465570Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:00.465581Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:00.465584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:00.465587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:00.465588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:00.465600Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:00.465608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:00.465613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:00.465662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.465667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.465669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.465671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:00.465672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:00.465738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:00.465744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.465756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.465770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.465790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:00.465812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895361801849383:4757], now have 1 active actors on pipe
2025-09-30T14:53:00.465822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895361801849264:2454], now have 1 active actors on pipe
2025-09-30T14:53:00.465828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895361712101908:6862]
2025-09-30T14:53:00.465831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895361712101908:6862]
2025-09-30T14:53:00.465834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895361712101908:6862]
2025-09-30T14:53:00.465847Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:00.465862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:00.465862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:00.465865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:00.465865Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1036
2025-09-30T14:53:00.465867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:00.465894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1036
2025-09-30T14:53:00.465877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:00.465880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:00.465914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895361712101908:6862]
2025-09-30T14:53:00.465917Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:00.465919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:00.465937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:00.465942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:00.465991Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65c2f681-87d50130-4e060533-49506f4a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:00.466002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:00.466007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:00.466010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:00.466018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:00.466033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:00.466050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:00.466222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:00.466231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:00.466245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:00.466343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1037 partition: 0 MaxSeqNo: 42 sessionId: src_id|65c2f681-87d50130-4e060533-49506f4a_0
2025-09-30T14:53:00.466774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1e32d8a-da513869-fe8068e1-e0564fe0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|65c2f681-87d50130-4e060533-49506f4a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:00.469516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65c2f681-87d50130-4e060533-49506f4a_0] Write session: try to update token
2025-09-30T14:53:00.469535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65c2f681-87d50130-4e060533-49506f4a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:00.478431Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:00.478449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:00.478452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:00.478454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:00.478464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895361712101908:6862]
2025-09-30T14:53:00.478469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895361712101908:6862]
2025-09-30T14:53:00.478473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895361712101908:6862]
2025-09-30T14:53:00.478514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:00.478521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.478524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:00.478525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:00.478532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:00.478536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:00.478661Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:00.484512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1037 sessionId: src_id|65c2f681-87d50130-4e060533-49506f4a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:00.487431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:00.545217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895361801849392:5026]
2025-09-30T14:53:00.545508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1036, pipe: [1:7555895361801849392:5026]
2025-09-30T14:53:00.591135Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:00.591633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:00.591649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:00.591688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895361801849392:5026], now have 1 active actors on pipe
2025-09-30T14:53:00.591991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895361801849392:5026]
2025-09-30T14:53:00.591999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:00.592007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:00.592023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:00.592069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1037 reason: error at write: Disconnected sessionId: src_id|65c2f681-87d50130-4e060533-49506f4a_0
2025-09-30T14:53:00.591970Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:00.592275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1037 sessionId: src_id|65c2f681-87d50130-4e060533-49506f4a_0 is DEAD
2025-09-30T14:53:00.592458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65c2f681-87d50130-4e060533-49506f4a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:00.592465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65c2f681-87d50130-4e060533-49506f4a_0] Write session will restart in 0.005145s
2025-09-30T14:53:00.592489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65c2f681-87d50130-4e060533-49506f4a_0] Write session: Do CDS request
2025-09-30T14:53:00.592494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65c2f681-87d50130-4e060533-49506f4a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:00.598833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65c2f681-87d50130-4e060533-49506f4a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:00.598934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:00.598959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1038
2025-09-30T14:53:00.599084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1038 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:00.599119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1038 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:00.599124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1038 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:00.599129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:00.599785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1038 sessionId:  describe result for acl check
2025-09-30T14:53:00.599840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:00.599843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:00.599845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:00.599851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895361801849421:4753] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:00.600417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895361801849421:4753] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:00.603190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895361801849421:4753] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:00.603792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:00.605804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:00.606015Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:00.606024Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:00.606035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:00.606088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:00.606125Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895361712102033:6864]
2025-09-30T14:53:00.606101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895361801849421:4753] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:00.606117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895361801849421:4753] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:00.606121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895361801849421:4753] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:00.606129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1038 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:00.606763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:00.607057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:00.607112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:00.607464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:00.607535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:00.607544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:00.607545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:00.607547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:00.607548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:00.607549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:00.607551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:00.607552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:00.607553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:00.607555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:00.607556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.607557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.607558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.607559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:00.607561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:00.607567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:00.607578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:00.607582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:00.607587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:00.607591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:00.607596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:00.607600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:00.607604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:00.607608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:00.607612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:00.607617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.607619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.607621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.607624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:00.607626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:00.607632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:00.607636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:00.607641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:00.607644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:00.607647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:00.607650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:00.607653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:00.607656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:00.607658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:00.607661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:00.607664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:00.607667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:00.607670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:00.607673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:00.607676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:00.607679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:00.607681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:00.607684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:00.607689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:00.607692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:00.607695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.607698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.607700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.607703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.607705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.607708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.607711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:00.607714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:00.607718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:00.607721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:00.607744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:00.614885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:00.615884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:00.615899Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:00.615903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:00.615907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:00.615914Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1037 [2:7555895361712102033:6864]
2025-09-30T14:53:00.615932Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:00.615951Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:00.615958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:00.615962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:00.615965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:00.615983Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:00.615995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:00.616002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:00.616070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.616078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.616080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.616084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:00.616086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:00.616156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:00.616163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.616178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.616193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.616219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:00.616240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895361712102027:6864]
2025-09-30T14:53:00.616246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895361712102027:6864]
2025-09-30T14:53:00.616249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895361712102027:6864]
2025-09-30T14:53:00.616264Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:00.616283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:00.616304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:00.616310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:00.616329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:00.616340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:00.616344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:00.616350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895361712102027:6864]
2025-09-30T14:53:00.616357Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:00.616439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:00.616641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895361801849510:4753], now have 1 active actors on pipe
2025-09-30T14:53:00.616649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895361801849394:2454], now have 1 active actors on pipe
2025-09-30T14:53:00.616673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1037
2025-09-30T14:53:00.616717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1037
2025-09-30T14:53:00.616805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:00.616814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:00.616841Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70071ebf-98d1b1e3-ff55d5f7-1bb74a76_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:00.616849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:00.616852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:00.616855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:00.616874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:00.616884Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:00.616898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:00.617581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:00.617594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:00.617614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:00.617761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1038 partition: 0 MaxSeqNo: 42 sessionId: src_id|70071ebf-98d1b1e3-ff55d5f7-1bb74a76_0
2025-09-30T14:53:00.618203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65c2f681-87d50130-4e060533-49506f4a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|70071ebf-98d1b1e3-ff55d5f7-1bb74a76_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:00.621052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70071ebf-98d1b1e3-ff55d5f7-1bb74a76_0] Write session: try to update token
2025-09-30T14:53:00.621073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70071ebf-98d1b1e3-ff55d5f7-1bb74a76_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:00.630135Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:00.630157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:00.630160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:00.630162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:00.630187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895361712102027:6864]
2025-09-30T14:53:00.630192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895361712102027:6864]
2025-09-30T14:53:00.630196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895361712102027:6864]
2025-09-30T14:53:00.630241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:00.630250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.630252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:00.630397Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:00.631917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:00.631935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:00.631940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:00.642416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1038 sessionId: src_id|70071ebf-98d1b1e3-ff55d5f7-1bb74a76_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:00.645357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:00.692173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895361801849521:5026]
2025-09-30T14:53:00.692505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1037, pipe: [1:7555895361801849521:5026]
2025-09-30T14:53:00.751511Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:00.751940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:00.751958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:00.751979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895361801849521:5026], now have 1 active actors on pipe
2025-09-30T14:53:00.752323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:00.752370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:00.752375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:00.752445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1038 reason: error at write: Disconnected sessionId: src_id|70071ebf-98d1b1e3-ff55d5f7-1bb74a76_0
2025-09-30T14:53:00.752628Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:00.752667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1038 sessionId: src_id|70071ebf-98d1b1e3-ff55d5f7-1bb74a76_0 is DEAD
2025-09-30T14:53:00.752754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895361801849521:5026]
2025-09-30T14:53:00.755549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70071ebf-98d1b1e3-ff55d5f7-1bb74a76_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:00.755560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70071ebf-98d1b1e3-ff55d5f7-1bb74a76_0] Write session will restart in 0.009842s
2025-09-30T14:53:00.755584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70071ebf-98d1b1e3-ff55d5f7-1bb74a76_0] Write session: Do CDS request
2025-09-30T14:53:00.755592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70071ebf-98d1b1e3-ff55d5f7-1bb74a76_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:00.764321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:00.766440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:00.766670Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:00.766681Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:00.766693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:00.766756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:00.766799Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895361712102152:6867]
2025-09-30T14:53:00.766852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70071ebf-98d1b1e3-ff55d5f7-1bb74a76_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:00.767004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:00.767019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1039
2025-09-30T14:53:00.767423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1039 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:00.767464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1039 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:00.767538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:00.767469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1039 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:00.767474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:00.767964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1039 sessionId:  describe result for acl check
2025-09-30T14:53:00.767996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:00.767998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:00.768000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:00.768006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895361801849606:4746] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:00.768266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:00.768323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:00.768572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895361801849606:4746] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:00.768731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:00.768810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:00.768819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:00.768821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:00.768822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:00.768823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:00.768825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:00.768826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:00.768827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:00.768828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:00.768829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:00.768831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.768832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.768834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.768835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:00.768836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:00.768841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:00.768851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:00.768855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:00.768860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:00.768863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:00.768867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:00.768871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:00.768875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:00.768879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:00.768884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:00.768887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.768891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.768895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.768899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:00.768903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:00.768910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:00.768918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:00.768925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:00.768931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:00.768936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:00.768942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:00.768948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:00.768954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:00.768960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:00.768966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:00.768971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:00.768976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:00.768982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:00.768987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:00.768992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:00.768999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:00.769005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:00.769011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:00.769016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:00.769022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:00.769029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.769036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.769041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.769046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.769052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.769057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.769065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:00.769071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:00.769082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:00.769087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:00.769143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:00.770785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895361801849606:4746] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:00.774570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895361801849606:4746] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:00.774584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895361801849606:4746] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:00.774592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895361801849606:4746] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:00.774601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1039 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:00.775005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:00.776135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:00.776151Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:00.776154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:00.776158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:00.776166Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1038 [2:7555895361712102152:6867]
2025-09-30T14:53:00.776181Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:00.776198Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:00.776202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:00.776205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:00.776207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:00.776224Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:00.776231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:00.776239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:00.776300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.776309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.776311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.776314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:00.776317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:00.776383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:00.776391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.776406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.776425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.776450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:00.776473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895361801849645:4746], now have 1 active actors on pipe
2025-09-30T14:53:00.776481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895361801849523:2454], now have 1 active actors on pipe
2025-09-30T14:53:00.776488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895361712102147:6867]
2025-09-30T14:53:00.776490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895361712102147:6867]
2025-09-30T14:53:00.776492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895361712102147:6867]
2025-09-30T14:53:00.776520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:00.776535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:00.776513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1038
2025-09-30T14:53:00.776521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1038
2025-09-30T14:53:00.776554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:00.776558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:00.776561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:00.776573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:00.776575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:00.776606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:00.776616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:00.776632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895361712102147:6867]
2025-09-30T14:53:00.776644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:00.776656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:00.776676Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|213c7698-7216d995-bb1cc3c-a8ebcf3d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:00.776688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:00.776695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:00.776702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:00.776714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:00.776728Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:00.776752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:00.777029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:00.777040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:00.777058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:00.777340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1039 partition: 0 MaxSeqNo: 42 sessionId: src_id|213c7698-7216d995-bb1cc3c-a8ebcf3d_0
2025-09-30T14:53:00.777747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70071ebf-98d1b1e3-ff55d5f7-1bb74a76_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|213c7698-7216d995-bb1cc3c-a8ebcf3d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:00.780751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|213c7698-7216d995-bb1cc3c-a8ebcf3d_0] Write session: try to update token
2025-09-30T14:53:00.780778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|213c7698-7216d995-bb1cc3c-a8ebcf3d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:00.789355Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:00.789375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:00.789379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:00.789382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:00.789392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895361712102147:6867]
2025-09-30T14:53:00.789397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895361712102147:6867]
2025-09-30T14:53:00.789402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895361712102147:6867]
2025-09-30T14:53:00.789447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:00.789450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:00.789455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.789458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:00.789475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:00.789479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:00.789592Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:00.798181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1039 sessionId: src_id|213c7698-7216d995-bb1cc3c-a8ebcf3d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:00.800767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:00.852441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895361801849652:5026]
2025-09-30T14:53:00.852756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1038, pipe: [1:7555895361801849652:5026]
2025-09-30T14:53:00.911540Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:00.911880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:00.911900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:00.911920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895361801849652:5026], now have 1 active actors on pipe
2025-09-30T14:53:00.912158Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:00.913169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|213c7698-7216d995-bb1cc3c-a8ebcf3d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:00.913180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|213c7698-7216d995-bb1cc3c-a8ebcf3d_0] Write session will restart in 0.006994s
2025-09-30T14:53:00.913203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|213c7698-7216d995-bb1cc3c-a8ebcf3d_0] Write session: Do CDS request
2025-09-30T14:53:00.913209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|213c7698-7216d995-bb1cc3c-a8ebcf3d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:00.912700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895361801849652:5026]
2025-09-30T14:53:00.912729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:00.912795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1039 reason: status is not ok: tablet will be restarted right now sessionId: src_id|213c7698-7216d995-bb1cc3c-a8ebcf3d_0
2025-09-30T14:53:00.913012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1039 sessionId: src_id|213c7698-7216d995-bb1cc3c-a8ebcf3d_0 is DEAD
2025-09-30T14:53:00.913161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:00.921761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|213c7698-7216d995-bb1cc3c-a8ebcf3d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:00.921872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:00.921889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1040
2025-09-30T14:53:00.922075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1040 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:00.922123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1040 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:00.922135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1040 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:00.922140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:00.922738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1040 sessionId:  describe result for acl check
2025-09-30T14:53:00.922776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:00.922783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:00.922785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:00.922792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895361801849679:4739] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:00.923390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895361801849679:4739] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:00.926774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895361801849679:4739] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:00.927564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:00.929425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:00.929642Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:00.929656Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:00.929674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:00.929732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:00.929776Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895361712102272:6869]
2025-09-30T14:53:00.929839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895361801849679:4739] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:00.929853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895361801849679:4739] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:00.929857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895361801849679:4739] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:00.929865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1040 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:00.930452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:00.930729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:00.930774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:00.931116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:00.931213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:00.931221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:00.931223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:00.931224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:00.931226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:00.931227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:00.931229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:00.931230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:00.931231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:00.931233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:00.931234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.931235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.931237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.931238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:00.931239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:00.931261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:00.931273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:00.931277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:00.931282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:00.931287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:00.931291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:00.931295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:00.931300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:00.931305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:00.931309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:00.931314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.931318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.931323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.931328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:00.931332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:00.931340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:00.931349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:00.931361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:00.931372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:00.931377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:00.931382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:00.931387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:00.931394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:00.931405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:00.931411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:00.931420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:00.931427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:00.931432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:00.931438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:00.931443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:00.931449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:00.931456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:00.931462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:00.931467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:00.931475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:00.931480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.931491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.931496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.931506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.931512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.931522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.931527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:00.931538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:00.931543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:00.931554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:00.931603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:00.937269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:00.938383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:00.938398Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:00.938401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:00.938406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:00.938413Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1039 [2:7555895361712102272:6869]
2025-09-30T14:53:00.938428Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:00.938443Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:00.938447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:00.938450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:00.938452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:00.938467Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:00.938479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:00.938488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:00.938557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.938567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.938569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.938572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:00.938575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:00.938642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:00.938650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.938664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:00.938682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:00.938703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:00.938727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895361801849655:2454], now have 1 active actors on pipe
2025-09-30T14:53:00.938735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895361801849773:4739], now have 1 active actors on pipe
2025-09-30T14:53:00.938740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895361712102267:6869]
2025-09-30T14:53:00.938744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895361712102267:6869]
2025-09-30T14:53:00.938746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895361712102267:6869]
2025-09-30T14:53:00.938759Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:00.938776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:00.938792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:00.938795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:00.938796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:00.938798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:00.938798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:00.938801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1039
2025-09-30T14:53:00.938832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895361712102267:6869]
2025-09-30T14:53:00.938840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:00.938842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:00.938870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:00.938874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:00.938804Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1039
2025-09-30T14:53:00.938904Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|602f0c46-dc1d6673-8f35361f-fb44d155_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:00.938917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:00.938926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:00.938928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:00.938937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:00.938950Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:00.938975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:00.939137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:00.939150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:00.939184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:00.939296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1040 partition: 0 MaxSeqNo: 42 sessionId: src_id|602f0c46-dc1d6673-8f35361f-fb44d155_0
2025-09-30T14:53:00.939668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|213c7698-7216d995-bb1cc3c-a8ebcf3d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|602f0c46-dc1d6673-8f35361f-fb44d155_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:00.942851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|602f0c46-dc1d6673-8f35361f-fb44d155_0] Write session: try to update token
2025-09-30T14:53:00.942871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|602f0c46-dc1d6673-8f35361f-fb44d155_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:00.951388Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:00.951410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:00.951412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:00.951415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:00.951424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895361712102267:6869]
2025-09-30T14:53:00.951429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895361712102267:6869]
2025-09-30T14:53:00.951433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895361712102267:6869]
2025-09-30T14:53:00.951471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:00.951479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:00.951481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:00.951627Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:00.951892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:00.951907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:00.951911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:00.960484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1040 sessionId: src_id|602f0c46-dc1d6673-8f35361f-fb44d155_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:00.963320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:01.012642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895366096817088:5026]
2025-09-30T14:53:01.012925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1039, pipe: [1:7555895366096817088:5026]
2025-09-30T14:53:01.065161Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:01.066246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:01.066269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:01.066309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895366096817088:5026], now have 1 active actors on pipe
2025-09-30T14:53:01.066545Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:01.066563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895366096817088:5026]
2025-09-30T14:53:01.066610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:01.066655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:01.066666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:01.066724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1040 reason: error at write: Disconnected sessionId: src_id|602f0c46-dc1d6673-8f35361f-fb44d155_0
2025-09-30T14:53:01.066939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1040 sessionId: src_id|602f0c46-dc1d6673-8f35361f-fb44d155_0 is DEAD
2025-09-30T14:53:01.067129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|602f0c46-dc1d6673-8f35361f-fb44d155_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:01.067140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|602f0c46-dc1d6673-8f35361f-fb44d155_0] Write session will restart in 0.007934s
2025-09-30T14:53:01.067163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|602f0c46-dc1d6673-8f35361f-fb44d155_0] Write session: Do CDS request
2025-09-30T14:53:01.067171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|602f0c46-dc1d6673-8f35361f-fb44d155_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:01.076810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|602f0c46-dc1d6673-8f35361f-fb44d155_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:01.076912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:01.076928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1041
2025-09-30T14:53:01.077072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1041 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:01.077115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1041 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:01.077120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1041 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:01.077125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:01.077454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:01.077511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1041 sessionId:  describe result for acl check
2025-09-30T14:53:01.077544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:01.077546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:01.077547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:01.077553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895366096817187:4723] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:01.078067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895366096817187:4723] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:01.079572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:01.079819Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:01.079830Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:01.079844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:01.079909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:01.079954Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895366007069715:6878]
2025-09-30T14:53:01.080285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895366096817187:4723] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:01.080562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:01.080884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:01.080935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:01.081252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:01.081339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:01.081345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:01.081347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:01.081347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:01.081349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:01.081350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:01.081351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:01.081352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:01.081353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:01.081354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:01.081355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.081356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.081357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.081358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:01.081359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:01.081366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:01.081376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:01.081381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:01.081385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:01.081389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:01.081393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:01.081398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:01.081402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:01.081406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:01.081410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:01.081415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.081419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.081423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.081427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:01.081431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:01.081438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:01.081447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:01.081453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:01.081459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:01.081464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:01.081469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:01.081473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:01.081479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:01.081484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:01.081490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:01.081494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:01.081499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:01.081504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:01.081509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:01.081514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:01.081519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:01.081524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:01.081529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:01.081534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:01.081540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:01.081544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.081555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.081559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.081565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.081570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.081575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.081580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:01.081584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:01.081586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:01.081590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:01.081619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:01.087007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895366096817187:4723] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:01.087027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895366096817187:4723] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:01.087030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895366096817187:4723] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:01.087041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1041 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:01.087277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:01.088276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:01.088292Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:01.088295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:01.088298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:01.088305Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1040 [2:7555895366007069715:6878]
2025-09-30T14:53:01.088319Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:01.088333Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:01.088336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:01.088338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:01.088340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:01.088356Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:01.088361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:01.088370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:01.088423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.088431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.088432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.088436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:01.088438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:01.088499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:01.088509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.088520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.088542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.088556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:01.088576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895366096817229:4723], now have 1 active actors on pipe
2025-09-30T14:53:01.088585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895366096817104:2454], now have 1 active actors on pipe
2025-09-30T14:53:01.088592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895366007069709:6878]
2025-09-30T14:53:01.088600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895366007069709:6878]
2025-09-30T14:53:01.088602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895366007069709:6878]
2025-09-30T14:53:01.088610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:01.088620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:01.088624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:01.088624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:01.088626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:01.088637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:01.088641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:01.088675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895366007069709:6878]
2025-09-30T14:53:01.088686Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:01.088694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:01.088831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1040
2025-09-30T14:53:01.088858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1040
2025-09-30T14:53:01.089242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:01.089253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:01.089279Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f46e5e6b-531c32d-a4a702d6-8f69c9bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:01.089291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:01.089295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:01.089297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:01.089306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:01.089316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:01.089336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:01.089592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:01.089601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:01.089616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:01.089685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1041 partition: 0 MaxSeqNo: 42 sessionId: src_id|f46e5e6b-531c32d-a4a702d6-8f69c9bb_0
2025-09-30T14:53:01.090119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|602f0c46-dc1d6673-8f35361f-fb44d155_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f46e5e6b-531c32d-a4a702d6-8f69c9bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:01.092938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f46e5e6b-531c32d-a4a702d6-8f69c9bb_0] Write session: try to update token
2025-09-30T14:53:01.092959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f46e5e6b-531c32d-a4a702d6-8f69c9bb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:01.100963Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:01.100980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:01.100991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895366007069709:6878]
2025-09-30T14:53:01.101037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:01.101049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:01.101212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:01.101365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:01.101509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:01.101657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:01.101930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:01.101976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:01.108339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1041 sessionId: src_id|f46e5e6b-531c32d-a4a702d6-8f69c9bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:01.111264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:01.111871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:01.111897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:01.111917Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:01.111920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:01.111922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:01.111927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:01.111934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895366007069709:6878]
2025-09-30T14:53:01.111938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895366007069709:6878]
2025-09-30T14:53:01.111944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895366007069709:6878]
2025-09-30T14:53:01.111982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:01.111992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:01.111994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:01.111998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:01.111998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.112001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:01.112136Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:01.166748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895366096817259:5026]
2025-09-30T14:53:01.167072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1040, pipe: [1:7555895366096817259:5026]
2025-09-30T14:53:01.230679Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:01.231005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:01.231043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895366096817259:5026], now have 1 active actors on pipe
2025-09-30T14:53:01.231177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:01.231301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:01.231310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:01.231344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895366096817259:5026]
2025-09-30T14:53:01.231370Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:01.231401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1041 reason: error at write: Disconnected sessionId: src_id|f46e5e6b-531c32d-a4a702d6-8f69c9bb_0
2025-09-30T14:53:01.231628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1041 sessionId: src_id|f46e5e6b-531c32d-a4a702d6-8f69c9bb_0 is DEAD
2025-09-30T14:53:01.231689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f46e5e6b-531c32d-a4a702d6-8f69c9bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:01.231700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f46e5e6b-531c32d-a4a702d6-8f69c9bb_0] Write session will restart in 0.006573s
2025-09-30T14:53:01.231722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f46e5e6b-531c32d-a4a702d6-8f69c9bb_0] Write session: Do CDS request
2025-09-30T14:53:01.231727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f46e5e6b-531c32d-a4a702d6-8f69c9bb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:01.240226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f46e5e6b-531c32d-a4a702d6-8f69c9bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:01.240618Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:01.240634Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1042
2025-09-30T14:53:01.240748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1042 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:01.240791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1042 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:01.240802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1042 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:01.240807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:01.241206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1042 sessionId:  describe result for acl check
2025-09-30T14:53:01.241240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:01.241242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:01.241244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:01.241250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895366096817276:4715] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:01.241812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895366096817276:4715] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:01.244605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895366096817276:4715] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:01.247433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895366096817276:4715] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:01.247446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895366096817276:4715] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:01.247450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895366096817276:4715] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:01.247458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1042 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:01.247381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:01.249516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:01.249743Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:01.249753Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:01.249764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:01.249824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:01.249870Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895366007069864:6887]
2025-09-30T14:53:01.250545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:01.250904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:01.250960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:01.251325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:01.251404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:01.251412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:01.251413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:01.251415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:01.251416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:01.251417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:01.251419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:01.251420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:01.251422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:01.251424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:01.251425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.251426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.251428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.251429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:01.251430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:01.251438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:01.251448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:01.251452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:01.251456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:01.251459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:01.251463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:01.251466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:01.251470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:01.251475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:01.251481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:01.251486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.251490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.251495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.251499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:01.251504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:01.251512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:01.251520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:01.251532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:01.251539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:01.251551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:01.251562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:01.251567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:01.251580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:01.251589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:01.251595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:01.251604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:01.251609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:01.251613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:01.251618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:01.251627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:01.251632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:01.251641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:01.251645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:01.251650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:01.251654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:01.251658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.251669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.251673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.251682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.251686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.251691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.251695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:01.251704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:01.251708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:01.251712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:01.251761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:01.258994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:01.259920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:01.259938Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:01.259941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:01.259945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:01.259953Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1041 [2:7555895366007069864:6887]
2025-09-30T14:53:01.259972Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:01.259988Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:01.259992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:01.259996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:01.259999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:01.260015Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:01.260028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:01.260035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:01.260107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.260115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.260117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.260121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:01.260123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:01.260195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:01.260205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.260219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.260236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.260256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:01.260273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895366007069858:6887]
2025-09-30T14:53:01.260280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895366007069858:6887]
2025-09-30T14:53:01.260283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895366007069858:6887]
2025-09-30T14:53:01.260292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:01.260307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:01.260327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:01.260327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:01.260331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:01.260334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:01.260335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:01.260377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895366007069858:6887]
2025-09-30T14:53:01.260390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:01.260400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895366096817261:2454], now have 1 active actors on pipe
2025-09-30T14:53:01.260409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895366096817380:4715], now have 1 active actors on pipe
2025-09-30T14:53:01.260633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:01.260573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1041
2025-09-30T14:53:01.260768Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1041
2025-09-30T14:53:01.260820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:01.260835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:01.260868Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b418060-d36de1fc-d0aacf22-6a3eb6c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:01.260882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:01.260886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:01.260889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:01.260910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:01.260929Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:01.260950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:01.261120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:01.261132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:01.261167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:01.262016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f46e5e6b-531c32d-a4a702d6-8f69c9bb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5b418060-d36de1fc-d0aacf22-6a3eb6c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:01.265082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b418060-d36de1fc-d0aacf22-6a3eb6c0_0] Write session: try to update token
2025-09-30T14:53:01.265105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b418060-d36de1fc-d0aacf22-6a3eb6c0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:01.261593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1042 partition: 0 MaxSeqNo: 42 sessionId: src_id|5b418060-d36de1fc-d0aacf22-6a3eb6c0_0
2025-09-30T14:53:01.276451Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:01.276471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:01.276481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895366007069858:6887]
2025-09-30T14:53:01.276527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:01.276532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:01.276726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:01.276889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:01.277044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:01.277193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:01.277386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:01.277427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:01.287115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1042 sessionId: src_id|5b418060-d36de1fc-d0aacf22-6a3eb6c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:01.290514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:01.290537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:01.290588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:01.290056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:01.290705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:01.293302Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:01.293320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:01.293322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:01.293324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:01.293335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895366007069858:6887]
2025-09-30T14:53:01.293339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895366007069858:6887]
2025-09-30T14:53:01.293343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895366007069858:6887]
2025-09-30T14:53:01.293383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:01.293384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:01.293389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.293390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:01.293392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:01.293395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:01.293535Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:01.331675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895366096817392:5026]
2025-09-30T14:53:01.332002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1041, pipe: [1:7555895366096817392:5026]
2025-09-30T14:53:01.403119Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:01.410650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:01.410675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:01.410838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:01.410903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:01.410971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:01.411033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:01.411568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:01.411585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:01.411650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:01.411711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:01.411769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:01.411840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:01.411882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:01.411888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:01.411952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:01.412008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:01.412072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:01.412133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:01.412174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:01.412179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:01.412243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:01.412305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:01.412379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:01.412440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:01.412480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:01.412485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:01.412547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:01.412613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:01.412681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:01.412740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:01.412785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:01.412798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:01.412870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:01.412925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:01.412982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:01.413048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:01.413095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:01.413103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:01.413178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:01.413252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:01.413323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:01.413391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:01.413443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:01.413452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:01.413527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:01.413599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:01.413666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:01.413732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:01.413777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:01.413785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:01.413844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:01.413898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:01.413954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:01.414012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:01.414054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:01.414059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:01.414124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:01.414195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:01.414254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:01.414310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:01.414352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:01.414358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:01.414407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895366096817392:5026], now have 1 active actors on pipe
2025-09-30T14:53:01.414723Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:01.414730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895366096817392:5026]
2025-09-30T14:53:01.414766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:01.414769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:01.414807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1042 reason: error at write: Disconnected sessionId: src_id|5b418060-d36de1fc-d0aacf22-6a3eb6c0_0
2025-09-30T14:53:01.414834Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:01.415057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1042 sessionId: src_id|5b418060-d36de1fc-d0aacf22-6a3eb6c0_0 is DEAD
2025-09-30T14:53:01.415216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b418060-d36de1fc-d0aacf22-6a3eb6c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:01.415226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b418060-d36de1fc-d0aacf22-6a3eb6c0_0] Write session will restart in 0.009420s
2025-09-30T14:53:01.415267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b418060-d36de1fc-d0aacf22-6a3eb6c0_0] Write session: Do CDS request
2025-09-30T14:53:01.415275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b418060-d36de1fc-d0aacf22-6a3eb6c0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:01.424624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:01.425718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b418060-d36de1fc-d0aacf22-6a3eb6c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:01.426291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:01.426268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:01.426286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1043
2025-09-30T14:53:01.426411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1043 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:01.426441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1043 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:01.426446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1043 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:01.426450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:01.426483Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:01.426495Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:01.426506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:01.426559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:01.426597Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895366007069987:6889]
2025-09-30T14:53:01.426830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1043 sessionId:  describe result for acl check
2025-09-30T14:53:01.426863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:01.426872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:01.426874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:01.426881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895366096817482:4699] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:01.427211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:01.427357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895366096817482:4699] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:01.427495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:01.427535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:01.427842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:01.427902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:01.427908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:01.427909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:01.427910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:01.427912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:01.427913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:01.427914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:01.427916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:01.427917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:01.427918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:01.427919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.427920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.427922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.427923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:01.427924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:01.427929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:01.427939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:01.427943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:01.427946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:01.427950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:01.427954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:01.427958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:01.427962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:01.427966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:01.427970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:01.427974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.427978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.427982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.427985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:01.427988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:01.427994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:01.428002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:01.428009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:01.428014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:01.428019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:01.428025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:01.428029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:01.428034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:01.428039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:01.428044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:01.428048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:01.428052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:01.428059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:01.428064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:01.428068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:01.428073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:01.428078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:01.428083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:01.428087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:01.428092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:01.428102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.428110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.428114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.428119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.428125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.428131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.428138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:01.428143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:01.428148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:01.428154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:01.428199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:01.429700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895366096817482:4699] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:01.433277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895366096817482:4699] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:01.433292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895366096817482:4699] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:01.433295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895366096817482:4699] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:01.433305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1043 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:01.433695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:01.434702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:01.434718Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:01.434721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:01.434725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:01.434732Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1042 [2:7555895366007069987:6889]
2025-09-30T14:53:01.434749Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:01.434765Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:01.434773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:01.434777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:01.434779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:01.434795Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:01.434807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:01.434814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:01.434879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.434888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.434890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.434896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:01.434899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:01.434966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:01.434972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.434985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.434997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.435015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:01.435042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895366096817520:4699], now have 1 active actors on pipe
2025-09-30T14:53:01.435051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895366096817395:2454], now have 1 active actors on pipe
2025-09-30T14:53:01.435057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895366007069982:6889]
2025-09-30T14:53:01.435060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895366007069982:6889]
2025-09-30T14:53:01.435062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895366007069982:6889]
2025-09-30T14:53:01.435074Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:01.435087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:01.435099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:01.435103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:01.435105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:01.435107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:01.435110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:01.435145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895366007069982:6889]
2025-09-30T14:53:01.435160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:01.435170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:01.435238Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1042
2025-09-30T14:53:01.435240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1042
2025-09-30T14:53:01.435333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:01.435344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:01.435368Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35c6db2b-513af82b-ce408f3c-60c69cb2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:01.435381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:01.435384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:01.435387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:01.435400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:01.435410Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:01.435425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:01.435559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:01.435567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:01.435578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:01.435690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1043 partition: 0 MaxSeqNo: 42 sessionId: src_id|35c6db2b-513af82b-ce408f3c-60c69cb2_0
2025-09-30T14:53:01.436129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b418060-d36de1fc-d0aacf22-6a3eb6c0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|35c6db2b-513af82b-ce408f3c-60c69cb2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:01.438906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35c6db2b-513af82b-ce408f3c-60c69cb2_0] Write session: try to update token
2025-09-30T14:53:01.438924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35c6db2b-513af82b-ce408f3c-60c69cb2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:01.447518Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:01.447537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:01.447540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:01.447546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:01.447557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895366007069982:6889]
2025-09-30T14:53:01.447561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895366007069982:6889]
2025-09-30T14:53:01.447565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895366007069982:6889]
2025-09-30T14:53:01.447607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:01.447619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.447622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:01.447626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:01.447634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:01.447638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:01.447772Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:01.453600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1043 sessionId: src_id|35c6db2b-513af82b-ce408f3c-60c69cb2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:01.456349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:01.514964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895366096817529:5026]
2025-09-30T14:53:01.515296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1042, pipe: [1:7555895366096817529:5026]
2025-09-30T14:53:01.564959Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:01.565428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:01.565445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:01.565483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895366096817529:5026], now have 1 active actors on pipe
2025-09-30T14:53:01.565716Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:01.565712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895366096817529:5026]
2025-09-30T14:53:01.565721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:01.565726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:01.565745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:01.565792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1043 reason: error at write: Disconnected sessionId: src_id|35c6db2b-513af82b-ce408f3c-60c69cb2_0
2025-09-30T14:53:01.566013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1043 sessionId: src_id|35c6db2b-513af82b-ce408f3c-60c69cb2_0 is DEAD
2025-09-30T14:53:01.566135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35c6db2b-513af82b-ce408f3c-60c69cb2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:01.566146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35c6db2b-513af82b-ce408f3c-60c69cb2_0] Write session will restart in 0.009874s
2025-09-30T14:53:01.566192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35c6db2b-513af82b-ce408f3c-60c69cb2_0] Write session: Do CDS request
2025-09-30T14:53:01.566210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35c6db2b-513af82b-ce408f3c-60c69cb2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:01.576055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:01.577856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35c6db2b-513af82b-ce408f3c-60c69cb2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:01.577913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:01.577930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1044
2025-09-30T14:53:01.577991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:01.578086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1044 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:01.578121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1044 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:01.578126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1044 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:01.578135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:01.578224Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:01.578234Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:01.578247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:01.578307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:01.578349Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895366007070112:6891]
2025-09-30T14:53:01.578595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1044 sessionId:  describe result for acl check
2025-09-30T14:53:01.578624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:01.578630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:01.578635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:01.578641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895366096817619:4697] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:01.578984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:01.579188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895366096817619:4697] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:01.579309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:01.579344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:01.579676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:01.579739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:01.579743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:01.579744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:01.579745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:01.579746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:01.579747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:01.579748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:01.579750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:01.579751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:01.579752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:01.579753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.579755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.579756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.579757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:01.579758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:01.579764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:01.579774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:01.579779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:01.579783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:01.579787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:01.579791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:01.579795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:01.579799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:01.579803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:01.579808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:01.579812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.579816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.579820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.579824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:01.579828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:01.579837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:01.579842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:01.579846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:01.579849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:01.579852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:01.579855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:01.579857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:01.579860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:01.579863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:01.579866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:01.579868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:01.579871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:01.579874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:01.579877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:01.579879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:01.579882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:01.579884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:01.579887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:01.579890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:01.579893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:01.579895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.579898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.579901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.579903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.579905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.579908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.579911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:01.579914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:01.579917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:01.579919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:01.579944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:01.581263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895366096817619:4697] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:01.585077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895366096817619:4697] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:01.585091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895366096817619:4697] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:01.585095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895366096817619:4697] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:01.585103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1044 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:01.585435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:01.586342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:01.586359Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:01.586362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:01.586366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:01.586373Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1043 [2:7555895366007070112:6891]
2025-09-30T14:53:01.586393Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:01.586408Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:01.586416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:01.586419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:01.586422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:01.586439Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:01.586451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:01.586457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:01.586519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.586527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.586529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.586533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:01.586536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:01.586612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:01.586620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.586633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.586652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.586677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:01.586700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895366096817531:2454], now have 1 active actors on pipe
2025-09-30T14:53:01.586708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895366096817657:4697], now have 1 active actors on pipe
2025-09-30T14:53:01.586715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895366007070106:6891]
2025-09-30T14:53:01.586723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895366007070106:6891]
2025-09-30T14:53:01.586725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895366007070106:6891]
2025-09-30T14:53:01.586739Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:01.586757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:01.586759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:01.586763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:01.586766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:01.586777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:01.586781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:01.586759Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1043
2025-09-30T14:53:01.586764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1043
2025-09-30T14:53:01.586818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895366007070106:6891]
2025-09-30T14:53:01.586831Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:01.586839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:01.586845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:01.586849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:01.586893Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cff4b229-f3ca26e1-8c3bf214-d2124e63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:01.586904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:01.586909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:01.586911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:01.586921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:01.586930Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:01.586956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:01.587168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:01.587179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:01.587196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:01.587285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1044 partition: 0 MaxSeqNo: 42 sessionId: src_id|cff4b229-f3ca26e1-8c3bf214-d2124e63_0
2025-09-30T14:53:01.587717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35c6db2b-513af82b-ce408f3c-60c69cb2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cff4b229-f3ca26e1-8c3bf214-d2124e63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:01.590740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cff4b229-f3ca26e1-8c3bf214-d2124e63_0] Write session: try to update token
2025-09-30T14:53:01.590761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cff4b229-f3ca26e1-8c3bf214-d2124e63_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:01.599561Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:01.599583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:01.599585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:01.599587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:01.599597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895366007070106:6891]
2025-09-30T14:53:01.599601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895366007070106:6891]
2025-09-30T14:53:01.599606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895366007070106:6891]
2025-09-30T14:53:01.599673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:01.599682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.599685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:01.599688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:01.599694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:01.599702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:01.599889Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:01.606344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1044 sessionId: src_id|cff4b229-f3ca26e1-8c3bf214-d2124e63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:01.609234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:01.666001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895366096817664:5026]
2025-09-30T14:53:01.666312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1043, pipe: [1:7555895366096817664:5026]
2025-09-30T14:53:01.711303Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:01.711684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:01.711697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:01.711714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895366096817664:5026], now have 1 active actors on pipe
2025-09-30T14:53:01.711932Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:01.711978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:01.711997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:01.711999Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:01.712044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895366096817664:5026]
2025-09-30T14:53:01.712072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1044 reason: error at write: Disconnected sessionId: src_id|cff4b229-f3ca26e1-8c3bf214-d2124e63_0
2025-09-30T14:53:01.712277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1044 sessionId: src_id|cff4b229-f3ca26e1-8c3bf214-d2124e63_0 is DEAD
2025-09-30T14:53:01.712443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cff4b229-f3ca26e1-8c3bf214-d2124e63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:01.712454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cff4b229-f3ca26e1-8c3bf214-d2124e63_0] Write session will restart in 0.007314s
2025-09-30T14:53:01.712478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cff4b229-f3ca26e1-8c3bf214-d2124e63_0] Write session: Do CDS request
2025-09-30T14:53:01.712483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cff4b229-f3ca26e1-8c3bf214-d2124e63_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:01.720819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cff4b229-f3ca26e1-8c3bf214-d2124e63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:01.720887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:01.720919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1045
2025-09-30T14:53:01.721056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1045 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:01.721094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1045 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:01.721108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1045 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:01.721116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:01.721558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1045 sessionId:  describe result for acl check
2025-09-30T14:53:01.721595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:01.721602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:01.721605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:01.721611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895366096817750:4691] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:01.722190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895366096817750:4691] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:01.722561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:01.724155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895366096817750:4691] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:01.724390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:01.724591Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:01.724600Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:01.724611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:01.724661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:01.724698Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895366007070240:6894]
2025-09-30T14:53:01.725364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:01.725664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:01.725715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:01.726017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:01.726074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:01.726081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:01.726083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:01.726084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:01.726085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:01.726086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:01.726087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:01.726088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:01.726089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:01.726090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:01.726091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.726092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.726093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.726094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:01.726095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:01.726115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:01.726124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:01.726129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:01.726133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:01.726137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:01.726142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:01.726146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:01.726149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:01.726153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:01.726159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:01.726175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.726179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.726183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.726186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:01.726190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:01.726198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:01.726206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:01.726212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:01.726218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:01.726222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:01.726228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:01.726233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:01.726238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:01.726244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:01.726249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:01.726253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:01.726259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:01.726264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:01.726269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:01.726273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:01.726279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:01.726283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:01.726288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:01.726293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:01.726298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:01.726303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.726309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.726314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.726319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.726324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.726328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.726332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:01.726336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:01.726341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:01.726346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:01.726388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:01.726548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895366096817750:4691] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:01.726565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895366096817750:4691] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:01.726568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895366096817750:4691] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:01.726576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1045 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:01.731984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:01.733091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:01.733108Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:01.733111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:01.733116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:01.733123Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1044 [2:7555895366007070240:6894]
2025-09-30T14:53:01.733140Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:01.733156Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:01.733164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:01.733168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:01.733170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:01.733186Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:01.733194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:01.733205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:01.733264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.733274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.733276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.733279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:01.733282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:01.733344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:01.733351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.733362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.733373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.733393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:01.733417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895366096817793:4691], now have 1 active actors on pipe
2025-09-30T14:53:01.733425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895366096817665:2454], now have 1 active actors on pipe
2025-09-30T14:53:01.733432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895366007070234:6894]
2025-09-30T14:53:01.733434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895366007070234:6894]
2025-09-30T14:53:01.733438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895366007070234:6894]
2025-09-30T14:53:01.733452Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:01.733465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:01.733484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:01.733486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:01.733491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:01.733493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:01.733493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:01.733527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895366007070234:6894]
2025-09-30T14:53:01.733533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:01.733548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:01.733520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1044
2025-09-30T14:53:01.733527Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1044
2025-09-30T14:53:01.733577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:01.733584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:01.733610Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de5cfdf4-5502e051-a7b382eb-9dfb752f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:01.733618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:01.733622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:01.733624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:01.733634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:01.733643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:01.733664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:01.733793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:01.733802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:01.733816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:01.733878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1045 partition: 0 MaxSeqNo: 42 sessionId: src_id|de5cfdf4-5502e051-a7b382eb-9dfb752f_0
2025-09-30T14:53:01.734247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cff4b229-f3ca26e1-8c3bf214-d2124e63_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|de5cfdf4-5502e051-a7b382eb-9dfb752f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:01.737159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de5cfdf4-5502e051-a7b382eb-9dfb752f_0] Write session: try to update token
2025-09-30T14:53:01.737177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de5cfdf4-5502e051-a7b382eb-9dfb752f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:01.745821Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:01.745844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:01.745853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895366007070234:6894]
2025-09-30T14:53:01.745899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:01.745908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:01.746089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:01.746263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:01.746418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:01.746572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:01.746777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:01.746828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:01.751708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1045 sessionId: src_id|de5cfdf4-5502e051-a7b382eb-9dfb752f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:01.754317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:01.754576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:01.754603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:01.754637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:01.754782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:01.756616Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:01.756631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:01.756634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:01.756636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:01.756646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895366007070234:6894]
2025-09-30T14:53:01.756650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895366007070234:6894]
2025-09-30T14:53:01.756654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895366007070234:6894]
2025-09-30T14:53:01.756690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:01.756695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:01.756701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:01.756705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.756705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:01.756708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:01.756841Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:01.812426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895366096817804:5026]
2025-09-30T14:53:01.812716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1044, pipe: [1:7555895366096817804:5026]
2025-09-30T14:53:01.869631Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:01.877883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:01.877909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:01.878076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:01.878135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:01.878215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:01.878278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:01.878324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:01.878331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:01.878394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:01.878466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:01.878539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:01.878619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:01.878665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:01.878672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:01.878748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:01.878814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:01.878880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:01.878962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:01.879005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:01.879015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:01.879083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:01.879143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:01.879208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:01.879289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:01.879332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:01.879339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:01.879415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:01.879483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:01.879546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:01.879606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:01.879649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:01.879657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:01.879726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:01.879780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:01.879845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:01.879921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:01.879969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:01.879978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:01.880052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:01.880130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:01.880210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:01.880281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:01.880333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:01.880344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:01.880421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:01.880489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:01.880558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:01.880630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:01.880679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:01.880686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:01.880755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:01.880819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:01.880888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:01.880957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:01.881006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:01.881013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:01.881077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:01.881135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:01.881195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:01.881254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:01.881300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:01.881308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:01.881358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895366096817804:5026], now have 1 active actors on pipe
2025-09-30T14:53:01.881640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895366096817804:5026]
2025-09-30T14:53:01.881657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:01.881661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:01.881683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:01.881691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1045 reason: error at write: Disconnected sessionId: src_id|de5cfdf4-5502e051-a7b382eb-9dfb752f_0
2025-09-30T14:53:01.881935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1045 sessionId: src_id|de5cfdf4-5502e051-a7b382eb-9dfb752f_0 is DEAD
2025-09-30T14:53:01.882071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de5cfdf4-5502e051-a7b382eb-9dfb752f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:01.882081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de5cfdf4-5502e051-a7b382eb-9dfb752f_0] Write session will restart in 0.007271s
2025-09-30T14:53:01.882104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de5cfdf4-5502e051-a7b382eb-9dfb752f_0] Write session: Do CDS request
2025-09-30T14:53:01.882110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de5cfdf4-5502e051-a7b382eb-9dfb752f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:01.882461Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:01.890814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de5cfdf4-5502e051-a7b382eb-9dfb752f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:01.890919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:01.890934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1046
2025-09-30T14:53:01.891024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1046 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:01.891054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1046 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:01.891065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1046 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:01.891069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:01.891559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1046 sessionId:  describe result for acl check
2025-09-30T14:53:01.891610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:01.891616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:01.891618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:01.891624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895366096817865:4686] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:01.892575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895366096817865:4686] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:01.894406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:01.894848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895366096817865:4686] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:01.896451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:01.896669Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:01.896681Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:01.896691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:01.896749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:01.896789Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895366007070368:6896]
2025-09-30T14:53:01.897539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:01.897904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:01.897965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:01.898337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:01.898408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:01.898414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:01.898416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:01.898416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:01.898418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:01.898420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:01.898422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:01.898423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:01.898424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:01.898425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:01.898426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.898427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.898428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.898429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:01.898430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:01.898437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:01.898446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:01.898450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:01.898454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:01.898458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:01.898461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:01.898465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:01.898469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:01.898474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:01.898479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:01.898483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.898487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.898491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.898495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:01.898499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:01.898508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:01.898516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:01.898522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:01.898529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:01.898534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:01.898540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:01.898544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:01.898549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:01.898554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:01.898559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:01.898563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:01.898569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:01.898574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:01.898580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:01.898584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:01.898590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:01.898594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:01.898600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:01.898610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:01.898616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:01.898621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.898626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.898635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.898641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.898646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.898650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.898655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:01.898660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:01.898665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:01.898671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:01.898716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:01.899236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895366096817865:4686] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:01.899271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895366096817865:4686] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:01.899275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895366096817865:4686] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:01.899284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1046 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:01.904513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:01.905438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:01.905453Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:01.905456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:01.905461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:01.905468Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1045 [2:7555895366007070368:6896]
2025-09-30T14:53:01.905488Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:01.905509Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:01.905517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:01.905521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:01.905524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:01.905541Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:01.905548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:01.905559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:01.905626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.905640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.905642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.905646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:01.905649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:01.905719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:01.905727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.905742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:01.905761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:01.905786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:01.905810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895366096817934:4686], now have 1 active actors on pipe
2025-09-30T14:53:01.905819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895366096817805:2454], now have 1 active actors on pipe
2025-09-30T14:53:01.905825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895366007070363:6896]
2025-09-30T14:53:01.905829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895366007070363:6896]
2025-09-30T14:53:01.905832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895366007070363:6896]
2025-09-30T14:53:01.905845Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:01.905860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:01.905863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:01.905869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:01.905871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:01.905880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:01.905884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:01.905919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895366007070363:6896]
2025-09-30T14:53:01.905934Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:01.905910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1045
2025-09-30T14:53:01.905947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:01.905912Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1045
2025-09-30T14:53:01.905980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:01.905990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:01.906016Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41d2db66-7838315-ef3eebee-85dddb09_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:01.906027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:01.906032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:01.906034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:01.906044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:01.906057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:01.906072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:01.906236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:01.906245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:01.906261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:01.906439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1046 partition: 0 MaxSeqNo: 42 sessionId: src_id|41d2db66-7838315-ef3eebee-85dddb09_0
2025-09-30T14:53:01.906884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de5cfdf4-5502e051-a7b382eb-9dfb752f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|41d2db66-7838315-ef3eebee-85dddb09_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:01.909790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41d2db66-7838315-ef3eebee-85dddb09_0] Write session: try to update token
2025-09-30T14:53:01.909811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41d2db66-7838315-ef3eebee-85dddb09_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:01.918251Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:01.918272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:01.918284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895366007070363:6896]
2025-09-30T14:53:01.918329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:01.918335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:01.918528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:01.918720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:01.918883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:01.919033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:01.919272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:01.919316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:01.928220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1046 sessionId: src_id|41d2db66-7838315-ef3eebee-85dddb09_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:01.929647Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:01.929666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:01.929673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:01.929675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:01.929686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895366007070363:6896]
2025-09-30T14:53:01.929690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895366007070363:6896]
2025-09-30T14:53:01.929697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895366007070363:6896]
2025-09-30T14:53:01.929739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:01.929753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:01.929755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:01.929756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:01.929765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:01.929769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:01.929901Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:01.931597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:01.981903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895366096817942:5026]
2025-09-30T14:53:01.982228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1045, pipe: [1:7555895366096817942:5026]
2025-09-30T14:53:02.039867Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:02.040197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:02.040212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:02.040232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895366096817942:5026], now have 1 active actors on pipe
2025-09-30T14:53:02.040463Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:02.040494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:02.040521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:02.040521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:02.040580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895366096817942:5026]
2025-09-30T14:53:02.040584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1046 reason: error at write: Disconnected sessionId: src_id|41d2db66-7838315-ef3eebee-85dddb09_0
2025-09-30T14:53:02.040787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1046 sessionId: src_id|41d2db66-7838315-ef3eebee-85dddb09_0 is DEAD
2025-09-30T14:53:02.040933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41d2db66-7838315-ef3eebee-85dddb09_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:02.040941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41d2db66-7838315-ef3eebee-85dddb09_0] Write session will restart in 0.007474s
2025-09-30T14:53:02.040965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41d2db66-7838315-ef3eebee-85dddb09_0] Write session: Do CDS request
2025-09-30T14:53:02.040970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41d2db66-7838315-ef3eebee-85dddb09_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:02.049804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41d2db66-7838315-ef3eebee-85dddb09_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:02.049973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:02.049979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:02.049997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1047
2025-09-30T14:53:02.050132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1047 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:02.050197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1047 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:02.050209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1047 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:02.050213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:02.050611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1047 sessionId:  describe result for acl check
2025-09-30T14:53:02.050643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:02.050647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:02.050649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:02.050656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895370391785334:4678] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:02.051082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895370391785334:4678] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:02.051743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:02.051926Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:02.051935Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:02.051945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:02.051991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:02.052029Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895370302037791:6898]
2025-09-30T14:53:02.052639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:02.052755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895370391785334:4678] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:02.052936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:02.052980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:02.053301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:02.053357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:02.053362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:02.053364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:02.053365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:02.053366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:02.053367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:02.053368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:02.053369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:02.053370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:02.053372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:02.053373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.053374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.053375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.053376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:02.053377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:02.053383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:02.053392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:02.053397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:02.053401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:02.053405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:02.053410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:02.053414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:02.053418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:02.053422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:02.053426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:02.053430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.053435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.053438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.053443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:02.053447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:02.053454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:02.053462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:02.053467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:02.053472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:02.053478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:02.053484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:02.053492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:02.053497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:02.053506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:02.053511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:02.053516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:02.053521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:02.053526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:02.053532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:02.053536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:02.053541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:02.053548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:02.053558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:02.053562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:02.053568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:02.053574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.053580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.053588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.053593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.053597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.053603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.053607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:02.053616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:02.053621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:02.053626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:02.053674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:02.058625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895370391785334:4678] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:02.058645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895370391785334:4678] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:02.058649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895370391785334:4678] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:02.058660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1047 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:02.058848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:02.059689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:02.059701Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:02.059704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:02.059708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:02.059716Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1046 [2:7555895370302037791:6898]
2025-09-30T14:53:02.059728Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:02.059739Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:02.059740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:02.059742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:02.059744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:02.059757Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:02.059764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:02.059772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:02.059841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.059851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.059853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.059857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:02.059859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:02.059908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:02.059913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.059920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.059927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.059947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:02.059972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895370391785373:4678], now have 1 active actors on pipe
2025-09-30T14:53:02.059975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895370391785244:2454], now have 1 active actors on pipe
2025-09-30T14:53:02.059981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895370302037786:6898]
2025-09-30T14:53:02.059984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895370302037786:6898]
2025-09-30T14:53:02.059986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895370302037786:6898]
2025-09-30T14:53:02.059994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:02.060006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:02.060005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:02.060010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:02.060012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:02.060020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:02.060023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:02.060049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895370302037786:6898]
2025-09-30T14:53:02.060030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1046
2025-09-30T14:53:02.060052Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:02.060049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1046
2025-09-30T14:53:02.060071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:02.060086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:02.060091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:02.060114Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|772e8797-14210b63-eb17a679-86d0ffdf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:02.060127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:02.060131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:02.060134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:02.060143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:02.060153Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:02.060176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:02.060350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:02.060359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:02.060373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:02.060492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1047 partition: 0 MaxSeqNo: 42 sessionId: src_id|772e8797-14210b63-eb17a679-86d0ffdf_0
2025-09-30T14:53:02.060901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41d2db66-7838315-ef3eebee-85dddb09_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|772e8797-14210b63-eb17a679-86d0ffdf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:02.063761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|772e8797-14210b63-eb17a679-86d0ffdf_0] Write session: try to update token
2025-09-30T14:53:02.063780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|772e8797-14210b63-eb17a679-86d0ffdf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:02.071852Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:02.071871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:02.071873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:02.071874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:02.071882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895370302037786:6898]
2025-09-30T14:53:02.071886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895370302037786:6898]
2025-09-30T14:53:02.071890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895370302037786:6898]
2025-09-30T14:53:02.071930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:02.071936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.071939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:02.071941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:02.071947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:02.071950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:02.072071Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:02.078506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1047 sessionId: src_id|772e8797-14210b63-eb17a679-86d0ffdf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:02.081391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:02.140612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895370391785409:5026]
2025-09-30T14:53:02.140947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1046, pipe: [1:7555895370391785409:5026]
2025-09-30T14:53:02.186713Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:02.187179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:02.187200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:02.187274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895370391785409:5026], now have 1 active actors on pipe
2025-09-30T14:53:02.187545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:02.187561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:02.187585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895370391785409:5026]
2025-09-30T14:53:02.187612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:02.187645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1047 reason: error at write: Disconnected sessionId: src_id|772e8797-14210b63-eb17a679-86d0ffdf_0
2025-09-30T14:53:02.187867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1047 sessionId: src_id|772e8797-14210b63-eb17a679-86d0ffdf_0 is DEAD
2025-09-30T14:53:02.188065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|772e8797-14210b63-eb17a679-86d0ffdf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:02.188077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|772e8797-14210b63-eb17a679-86d0ffdf_0] Write session will restart in 0.007691s
2025-09-30T14:53:02.188099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|772e8797-14210b63-eb17a679-86d0ffdf_0] Write session: Do CDS request
2025-09-30T14:53:02.188105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|772e8797-14210b63-eb17a679-86d0ffdf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:02.187534Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:02.196810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|772e8797-14210b63-eb17a679-86d0ffdf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:02.196882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:02.196907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1048
2025-09-30T14:53:02.197080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1048 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:02.197115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1048 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:02.197120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1048 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:02.197124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:02.197514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1048 sessionId:  describe result for acl check
2025-09-30T14:53:02.197546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:02.197553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:02.197555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:02.197561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895370391785455:4656] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:02.198112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895370391785455:4656] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:02.200446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895370391785455:4656] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:02.201164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:02.202930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:02.203137Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:02.203147Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:02.203158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:02.203210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:02.203265Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895370302037972:6914]
2025-09-30T14:53:02.203999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895370391785455:4656] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:02.204018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:02.204015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895370391785455:4656] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:02.204019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895370391785455:4656] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:02.204028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1048 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:02.204433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:02.204490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:02.204867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:02.204930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:02.204939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:02.204940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:02.204941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:02.204943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:02.204944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:02.204945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:02.204947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:02.204961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:02.204962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:02.204964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.204965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.204967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.204969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:02.204970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:02.204976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:02.204989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:02.204994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:02.204999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:02.205004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:02.205009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:02.205012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:02.205017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:02.205021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:02.205026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:02.205031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.205036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.205040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.205045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:02.205050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:02.205060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:02.205070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:02.205081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:02.205088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:02.205098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:02.205104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:02.205109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:02.205120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:02.205125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:02.205133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:02.205151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:02.205157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:02.205163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:02.205172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:02.205177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:02.205188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:02.205195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:02.205206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:02.205212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:02.205218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:02.205223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.205231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.205241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.205247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.205257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.205262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.205268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:02.205278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:02.205283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:02.205291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:02.205347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:02.211153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:02.212051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:02.212072Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:02.212076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:02.212081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:02.212089Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1047 [2:7555895370302037972:6914]
2025-09-30T14:53:02.212107Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:02.212124Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:02.212128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:02.212132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:02.212135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:02.212153Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:02.212161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:02.212175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:02.212244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.212254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.212257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.212261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:02.212265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:02.212333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:02.212344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.212358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.212373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.212395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:02.212420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895370391785545:4656], now have 1 active actors on pipe
2025-09-30T14:53:02.212430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895370391785419:2454], now have 1 active actors on pipe
2025-09-30T14:53:02.212437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895370302037967:6914]
2025-09-30T14:53:02.212440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895370302037967:6914]
2025-09-30T14:53:02.212443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895370302037967:6914]
2025-09-30T14:53:02.212458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:02.212473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:02.212496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:02.212503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:02.212505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:02.212509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:02.212512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:02.212499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1047
2025-09-30T14:53:02.212543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895370302037967:6914]
2025-09-30T14:53:02.212508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1047
2025-09-30T14:53:02.212552Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:02.212562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:02.212617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:02.212631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:02.212672Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d9ad109-f4cb1f6b-5c1408ed-f64dfbe7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:02.212689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:02.212694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:02.212697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:02.212707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:02.212718Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:02.212737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:02.212946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:02.212959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:02.213001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:02.213129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1048 partition: 0 MaxSeqNo: 42 sessionId: src_id|4d9ad109-f4cb1f6b-5c1408ed-f64dfbe7_0
2025-09-30T14:53:02.213571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|772e8797-14210b63-eb17a679-86d0ffdf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4d9ad109-f4cb1f6b-5c1408ed-f64dfbe7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:02.216663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d9ad109-f4cb1f6b-5c1408ed-f64dfbe7_0] Write session: try to update token
2025-09-30T14:53:02.216683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d9ad109-f4cb1f6b-5c1408ed-f64dfbe7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:02.225312Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:02.225332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:02.225334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:02.225337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:02.225349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895370302037967:6914]
2025-09-30T14:53:02.225354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895370302037967:6914]
2025-09-30T14:53:02.225359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895370302037967:6914]
2025-09-30T14:53:02.225401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:02.225409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.225414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:02.225418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:02.225420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:02.225424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:02.225565Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:02.237720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1048 sessionId: src_id|4d9ad109-f4cb1f6b-5c1408ed-f64dfbe7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:02.241264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:02.287549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895370391785556:5026]
2025-09-30T14:53:02.287851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1047, pipe: [1:7555895370391785556:5026]
2025-09-30T14:53:02.344537Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:02.345017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:02.345030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:02.345046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895370391785556:5026], now have 1 active actors on pipe
2025-09-30T14:53:02.345253Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:02.345309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:02.345326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:02.345335Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:02.345399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895370391785556:5026]
2025-09-30T14:53:02.345403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1048 reason: error at write: Disconnected sessionId: src_id|4d9ad109-f4cb1f6b-5c1408ed-f64dfbe7_0
2025-09-30T14:53:02.345639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1048 sessionId: src_id|4d9ad109-f4cb1f6b-5c1408ed-f64dfbe7_0 is DEAD
2025-09-30T14:53:02.345751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d9ad109-f4cb1f6b-5c1408ed-f64dfbe7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:02.345760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d9ad109-f4cb1f6b-5c1408ed-f64dfbe7_0] Write session will restart in 0.006703s
2025-09-30T14:53:02.345778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d9ad109-f4cb1f6b-5c1408ed-f64dfbe7_0] Write session: Do CDS request
2025-09-30T14:53:02.345782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d9ad109-f4cb1f6b-5c1408ed-f64dfbe7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:02.353806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d9ad109-f4cb1f6b-5c1408ed-f64dfbe7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:02.353954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:02.353971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1049
2025-09-30T14:53:02.354145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1049 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:02.354209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1049 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:02.354221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1049 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:02.354226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:02.355177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1049 sessionId:  describe result for acl check
2025-09-30T14:53:02.355218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:02.355220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:02.355222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:02.355229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895370391785647:4654] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:02.355776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895370391785647:4654] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:02.356485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:02.357369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895370391785647:4654] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:02.358590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:02.358802Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:02.358814Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:02.358825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:02.358882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:02.358921Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895370302038102:6916]
2025-09-30T14:53:02.359653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:02.360017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:02.360040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895370391785647:4654] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:02.360053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895370391785647:4654] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:02.360057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895370391785647:4654] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:02.360065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1049 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:02.360069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:02.360391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:02.360495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:02.360501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:02.360502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:02.360504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:02.360505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:02.360506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:02.360508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:02.360509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:02.360510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:02.360511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:02.360513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.360514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.360515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.360516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:02.360517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:02.360524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:02.360535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:02.360539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:02.360543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:02.360547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:02.360551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:02.360556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:02.360560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:02.360564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:02.360569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:02.360572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.360576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.360581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.360585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:02.360589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:02.360600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:02.360609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:02.360616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:02.360623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:02.360628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:02.360634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:02.360641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:02.360647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:02.360652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:02.360659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:02.360664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:02.360675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:02.360681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:02.360691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:02.360696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:02.360702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:02.360713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:02.360719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:02.360725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:02.360731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:02.360741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.360747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.360757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.360763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.360773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.360779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.360783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:02.360791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:02.360796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:02.360802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:02.360853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:02.366562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:02.367520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:02.367535Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:02.367539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:02.367543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:02.367551Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1048 [2:7555895370302038102:6916]
2025-09-30T14:53:02.367568Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:02.367585Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:02.367588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:02.367591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:02.367594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:02.367611Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:02.367623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:02.367631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:02.367692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.367700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.367702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.367706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:02.367709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:02.367778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:02.367785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.367799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.367816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.367838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:02.367861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895370391785687:4654], now have 1 active actors on pipe
2025-09-30T14:53:02.367868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895370391785558:2454], now have 1 active actors on pipe
2025-09-30T14:53:02.367874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895370302038096:6916]
2025-09-30T14:53:02.367879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895370302038096:6916]
2025-09-30T14:53:02.367882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895370302038096:6916]
2025-09-30T14:53:02.367898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:02.367915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:02.367915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:02.367919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:02.367921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:02.367936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:02.367939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:02.367978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895370302038096:6916]
2025-09-30T14:53:02.367978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1048
2025-09-30T14:53:02.367981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1048
2025-09-30T14:53:02.367987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:02.368008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:02.368028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:02.368033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:02.368060Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|426c1048-d2876403-67d3991f-ba431a3f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:02.368067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:02.368070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:02.368072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:02.368084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:02.368093Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:02.368110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:02.368309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:02.368318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:02.368331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:02.368430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1049 partition: 0 MaxSeqNo: 42 sessionId: src_id|426c1048-d2876403-67d3991f-ba431a3f_0
2025-09-30T14:53:02.368803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d9ad109-f4cb1f6b-5c1408ed-f64dfbe7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|426c1048-d2876403-67d3991f-ba431a3f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:02.371849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|426c1048-d2876403-67d3991f-ba431a3f_0] Write session: try to update token
2025-09-30T14:53:02.371872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|426c1048-d2876403-67d3991f-ba431a3f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:02.380517Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:02.380535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:02.380545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895370302038096:6916]
2025-09-30T14:53:02.380585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:02.380589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:02.380773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:02.380936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:02.381087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:02.381240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:02.381458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:02.381500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:02.387788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1049 sessionId: src_id|426c1048-d2876403-67d3991f-ba431a3f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:02.390643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:02.391342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:02.391363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:02.391384Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:02.391387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:02.391391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:02.391393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:02.391402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895370302038096:6916]
2025-09-30T14:53:02.391406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895370302038096:6916]
2025-09-30T14:53:02.391409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895370302038096:6916]
2025-09-30T14:53:02.391461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:02.391470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:02.391472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.391476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:02.391476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:02.391480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:02.391614Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:02.445749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895370391785696:5026]
2025-09-30T14:53:02.445929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1048, pipe: [1:7555895370391785696:5026]
2025-09-30T14:53:02.504240Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:02.504600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:02.504655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895370391785696:5026], now have 1 active actors on pipe
2025-09-30T14:53:02.504763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:02.504869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:02.504880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:02.504943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1049 reason: error at write: Disconnected sessionId: src_id|426c1048-d2876403-67d3991f-ba431a3f_0
2025-09-30T14:53:02.505112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1049 sessionId: src_id|426c1048-d2876403-67d3991f-ba431a3f_0 is DEAD
2025-09-30T14:53:02.505279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|426c1048-d2876403-67d3991f-ba431a3f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:02.505288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|426c1048-d2876403-67d3991f-ba431a3f_0] Write session will restart in 0.008557s
2025-09-30T14:53:02.505319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|426c1048-d2876403-67d3991f-ba431a3f_0] Write session: Do CDS request
2025-09-30T14:53:02.505325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|426c1048-d2876403-67d3991f-ba431a3f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:02.505303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:02.505534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895370391785696:5026]
2025-09-30T14:53:02.514780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|426c1048-d2876403-67d3991f-ba431a3f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:02.514925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:02.514947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1050
2025-09-30T14:53:02.515147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1050 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:02.515194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1050 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:02.515205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1050 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:02.515210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:02.515747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1050 sessionId:  describe result for acl check
2025-09-30T14:53:02.515782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:02.515790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:02.515792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:02.515799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895370391785790:4642] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:02.516379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895370391785790:4642] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:02.517934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:02.518374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895370391785790:4642] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:02.520279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:02.520528Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:02.520539Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:02.520550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:02.520601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:02.520643Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895370302038233:6918]
2025-09-30T14:53:02.521239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895370391785790:4642] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:02.521252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895370391785790:4642] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:02.521256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895370391785790:4642] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:02.521257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:02.521264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1050 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:02.521597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:02.521666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:02.522042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:02.522118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:02.522125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:02.522126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:02.522127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:02.522129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:02.522130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:02.522131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:02.522133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:02.522134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:02.522135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:02.522137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.522138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.522139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.522140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:02.522141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:02.522146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:02.522157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:02.522174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:02.522178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:02.522182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:02.522185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:02.522189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:02.522193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:02.522196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:02.522200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:02.522204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.522208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.522212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.522216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:02.522220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:02.522228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:02.522236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:02.522242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:02.522251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:02.522256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:02.522262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:02.522266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:02.522272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:02.522278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:02.522283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:02.522287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:02.522292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:02.522299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:02.522311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:02.522316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:02.522320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:02.522325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:02.522330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:02.522334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:02.522340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:02.522345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.522350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.522354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.522359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.522365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.522370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.522374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:02.522379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:02.522383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:02.522388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:02.522430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:02.528167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:02.529160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:02.529179Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:02.529183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:02.529187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:02.529194Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1049 [2:7555895370302038233:6918]
2025-09-30T14:53:02.529212Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:02.529229Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:02.529236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:02.529240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:02.529244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:02.529263Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:02.529276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:02.529282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:02.529348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.529355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.529357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.529360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:02.529364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:02.529432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:02.529439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.529454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.529467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.529489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:02.529512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895370391785828:4642], now have 1 active actors on pipe
2025-09-30T14:53:02.529519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895370391785700:2454], now have 1 active actors on pipe
2025-09-30T14:53:02.529525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895370302038228:6918]
2025-09-30T14:53:02.529531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895370302038228:6918]
2025-09-30T14:53:02.529533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895370302038228:6918]
2025-09-30T14:53:02.529546Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:02.529564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:02.529568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:02.529579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:02.529583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:02.529584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:02.529588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:02.529592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1049
2025-09-30T14:53:02.529600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1049
2025-09-30T14:53:02.529624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895370302038228:6918]
2025-09-30T14:53:02.529637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:02.529652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:02.529696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:02.529706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:02.529730Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8fafe4c3-9c4eb605-4950fb9e-bcc5c10b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:02.529741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:02.529745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:02.529747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:02.529759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:02.529774Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:02.529791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:02.529931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:02.529940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:02.529952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:02.530053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1050 partition: 0 MaxSeqNo: 42 sessionId: src_id|8fafe4c3-9c4eb605-4950fb9e-bcc5c10b_0
2025-09-30T14:53:02.530512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|426c1048-d2876403-67d3991f-ba431a3f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8fafe4c3-9c4eb605-4950fb9e-bcc5c10b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:02.533513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fafe4c3-9c4eb605-4950fb9e-bcc5c10b_0] Write session: try to update token
2025-09-30T14:53:02.533533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fafe4c3-9c4eb605-4950fb9e-bcc5c10b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:02.542364Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:02.542387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:02.542398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895370302038228:6918]
2025-09-30T14:53:02.542447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:02.542468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:02.542639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:02.542795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:02.542948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:02.543125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:02.543364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:02.543412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:02.550866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1050 sessionId: src_id|8fafe4c3-9c4eb605-4950fb9e-bcc5c10b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:02.553574Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:02.553595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:02.553599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:02.553602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:02.553613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895370302038228:6918]
2025-09-30T14:53:02.553617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895370302038228:6918]
2025-09-30T14:53:02.553625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895370302038228:6918]
2025-09-30T14:53:02.553667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:02.553669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:02.553674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.553676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:02.553677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:02.553691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:02.553762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:02.553820Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:02.605513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895370391785839:5026]
2025-09-30T14:53:02.605877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1049, pipe: [1:7555895370391785839:5026]
2025-09-30T14:53:02.672665Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:02.673256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:02.673272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:02.673293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895370391785839:5026], now have 1 active actors on pipe
2025-09-30T14:53:02.673532Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:02.673614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:02.673629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:02.673707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1050 reason: error at write: Disconnected sessionId: src_id|8fafe4c3-9c4eb605-4950fb9e-bcc5c10b_0
2025-09-30T14:53:02.673815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895370391785839:5026]
2025-09-30T14:53:02.673847Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:02.673913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1050 sessionId: src_id|8fafe4c3-9c4eb605-4950fb9e-bcc5c10b_0 is DEAD
2025-09-30T14:53:02.674095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fafe4c3-9c4eb605-4950fb9e-bcc5c10b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:02.674106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fafe4c3-9c4eb605-4950fb9e-bcc5c10b_0] Write session will restart in 0.007687s
2025-09-30T14:53:02.674131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fafe4c3-9c4eb605-4950fb9e-bcc5c10b_0] Write session: Do CDS request
2025-09-30T14:53:02.674139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fafe4c3-9c4eb605-4950fb9e-bcc5c10b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:02.682847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fafe4c3-9c4eb605-4950fb9e-bcc5c10b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:02.682956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:02.682983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1051
2025-09-30T14:53:02.683122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1051 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:02.683158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1051 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:02.683170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1051 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:02.683173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:02.683652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1051 sessionId:  describe result for acl check
2025-09-30T14:53:02.683697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:02.683704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:02.683705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:02.683712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895370391785932:4641] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:02.684289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895370391785932:4641] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:02.684502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:02.686057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895370391785932:4641] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:02.686465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:02.686676Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:02.686688Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:02.686700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:02.686762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:02.686801Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895370302038367:6921]
2025-09-30T14:53:02.687486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:02.687794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:02.687842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:02.688180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:02.688251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:02.688258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:02.688259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:02.688260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:02.688262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:02.688263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:02.688264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:02.688265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:02.688267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:02.688268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:02.688269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.688270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.688271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.688273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:02.688275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:02.688280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:02.688290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:02.688295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:02.688299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:02.688303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:02.688306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:02.688310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:02.688314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:02.688318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:02.688323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:02.688327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.688330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.688334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.688338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:02.688342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:02.688350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:02.688358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:02.688365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:02.688370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:02.688375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:02.688380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:02.688384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:02.688389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:02.688399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:02.688404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:02.688408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:02.688418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:02.688423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:02.688427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:02.688433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:02.688438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:02.688443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:02.688448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:02.688457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:02.688467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:02.688471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.688481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.688485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.688490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.688494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.688499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.688508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:02.688513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:02.688517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:02.688526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:02.688572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:02.688591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895370391785932:4641] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:02.688604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895370391785932:4641] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:02.688608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895370391785932:4641] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:02.688616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1051 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:02.694218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:02.695167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:02.695187Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:02.695191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:02.695196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:02.695204Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1050 [2:7555895370302038367:6921]
2025-09-30T14:53:02.695222Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:02.695238Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:02.695267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:02.695270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:02.695274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:02.695290Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:02.695297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:02.695305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:02.695371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.695378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.695381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.695385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:02.695387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:02.695452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:02.695461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.695475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.695494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.695516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:02.695541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895370391785973:4641], now have 1 active actors on pipe
2025-09-30T14:53:02.695551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895370391785841:2454], now have 1 active actors on pipe
2025-09-30T14:53:02.695557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895370302038361:6921]
2025-09-30T14:53:02.695560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895370302038361:6921]
2025-09-30T14:53:02.695564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895370302038361:6921]
2025-09-30T14:53:02.695577Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:02.695596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:02.695590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:02.695614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:02.695616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:02.695617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:02.695619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:02.695654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895370302038361:6921]
2025-09-30T14:53:02.695595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1050
2025-09-30T14:53:02.695664Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:02.695666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:02.695680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:02.695686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:02.695625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1050
2025-09-30T14:53:02.695736Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3f78021-f6fe9acc-fc829a33-6a8b7af1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:02.695748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:02.695753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:02.695756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:02.695765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:02.695774Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:02.695798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:02.695978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:02.695988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:02.696003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:02.696111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1051 partition: 0 MaxSeqNo: 42 sessionId: src_id|f3f78021-f6fe9acc-fc829a33-6a8b7af1_0
2025-09-30T14:53:02.696529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fafe4c3-9c4eb605-4950fb9e-bcc5c10b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f3f78021-f6fe9acc-fc829a33-6a8b7af1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:02.699353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f78021-f6fe9acc-fc829a33-6a8b7af1_0] Write session: try to update token
2025-09-30T14:53:02.699370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f78021-f6fe9acc-fc829a33-6a8b7af1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:02.708154Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:02.708175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:02.708177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:02.708180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:02.708191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895370302038361:6921]
2025-09-30T14:53:02.708196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895370302038361:6921]
2025-09-30T14:53:02.708200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895370302038361:6921]
2025-09-30T14:53:02.708247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:02.708251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:02.708254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.708257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:02.708266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:02.708270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:02.708407Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:02.714885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1051 sessionId: src_id|f3f78021-f6fe9acc-fc829a33-6a8b7af1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:02.717794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:02.773940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895370391785982:5026]
2025-09-30T14:53:02.774311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1050, pipe: [1:7555895370391785982:5026]
2025-09-30T14:53:02.824636Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:02.825130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:02.825145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:02.825187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895370391785982:5026], now have 1 active actors on pipe
2025-09-30T14:53:02.825415Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:02.825504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895370391785982:5026]
2025-09-30T14:53:02.825508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:02.825513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:02.825537Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:02.826020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f78021-f6fe9acc-fc829a33-6a8b7af1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:02.826032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f78021-f6fe9acc-fc829a33-6a8b7af1_0] Write session will restart in 0.006076s
2025-09-30T14:53:02.826056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f78021-f6fe9acc-fc829a33-6a8b7af1_0] Write session: Do CDS request
2025-09-30T14:53:02.826063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f78021-f6fe9acc-fc829a33-6a8b7af1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:02.825580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1051 reason: error at write: Disconnected sessionId: src_id|f3f78021-f6fe9acc-fc829a33-6a8b7af1_0
2025-09-30T14:53:02.825811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1051 sessionId: src_id|f3f78021-f6fe9acc-fc829a33-6a8b7af1_0 is DEAD
2025-09-30T14:53:02.833869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f78021-f6fe9acc-fc829a33-6a8b7af1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:02.833952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:02.833968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1052
2025-09-30T14:53:02.834143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1052 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:02.834209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1052 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:02.834219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1052 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:02.834224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:02.834683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1052 sessionId:  describe result for acl check
2025-09-30T14:53:02.834715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:02.834722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:02.834724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:02.834729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895370391786017:4635] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:02.835322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895370391786017:4635] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:02.837696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895370391786017:4635] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:02.839213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:02.840808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:02.841022Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:02.841032Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:02.841042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:02.841092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:02.841127Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895370302038500:6923]
2025-09-30T14:53:02.841065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895370391786017:4635] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:02.841082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895370391786017:4635] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:02.841087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895370391786017:4635] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:02.841096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1052 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:02.841854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:02.842139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:02.842205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:02.842559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:02.842618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:02.842626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:02.842627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:02.842629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:02.842630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:02.842631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:02.842633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:02.842634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:02.842636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:02.842637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:02.842638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.842640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.842641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.842642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:02.842643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:02.842649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:02.842661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:02.842666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:02.842671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:02.842676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:02.842681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:02.842685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:02.842689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:02.842694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:02.842699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:02.842704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.842709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.842713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.842718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:02.842722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:02.842731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:02.842740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:02.842746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:02.842753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:02.842758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:02.842765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:02.842770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:02.842776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:02.842782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:02.842788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:02.842793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:02.842799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:02.842805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:02.842811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:02.842816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:02.842821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:02.842825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:02.842830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:02.842834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:02.842839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:02.842848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.842853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.842857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.842862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.842868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.842879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.842884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:02.842889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:02.842895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:02.842902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:02.842950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:02.848702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:02.849606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:02.849620Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:02.849623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:02.849628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:02.849635Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1051 [2:7555895370302038500:6923]
2025-09-30T14:53:02.849652Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:02.849670Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:02.849673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:02.849677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:02.849679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:02.849696Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:02.849713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:02.849726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:02.849796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.849804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.849806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.849811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:02.849814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:02.849886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:02.849894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.849907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:02.849922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:02.849946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:02.849970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895370391786114:4635], now have 1 active actors on pipe
2025-09-30T14:53:02.849980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895370391785984:2454], now have 1 active actors on pipe
2025-09-30T14:53:02.849986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895370302038495:6923]
2025-09-30T14:53:02.849989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895370302038495:6923]
2025-09-30T14:53:02.849991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895370302038495:6923]
2025-09-30T14:53:02.850006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:02.850021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:02.850026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:02.850031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:02.850033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:02.850039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:02.850042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:02.850078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895370302038495:6923]
2025-09-30T14:53:02.850090Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:02.850110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:02.850147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:02.850168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:02.850194Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc1c25ad-c7ab2314-16335db1-c78a7968_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:02.850208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:02.850212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:02.850215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:02.850226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:02.850237Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:02.850256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:02.850075Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1051
2025-09-30T14:53:02.850075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1051
2025-09-30T14:53:02.850441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:02.850450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:02.850466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:02.850557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1052 partition: 0 MaxSeqNo: 42 sessionId: src_id|bc1c25ad-c7ab2314-16335db1-c78a7968_0
2025-09-30T14:53:02.850979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f78021-f6fe9acc-fc829a33-6a8b7af1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bc1c25ad-c7ab2314-16335db1-c78a7968_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:02.854035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc1c25ad-c7ab2314-16335db1-c78a7968_0] Write session: try to update token
2025-09-30T14:53:02.854053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc1c25ad-c7ab2314-16335db1-c78a7968_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:02.870120Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:02.870137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:02.870145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895370302038495:6923]
2025-09-30T14:53:02.870206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:02.870212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:02.870381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:02.870539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:02.870682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:02.870811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:02.871003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:02.871038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:02.875099Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:02.875124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:02.875127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:02.875130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:02.875141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895370302038495:6923]
2025-09-30T14:53:02.875145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895370302038495:6923]
2025-09-30T14:53:02.875149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895370302038495:6923]
2025-09-30T14:53:02.875188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:02.875198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:02.875205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:02.875205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:02.875208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:02.875213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:02.875372Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:02.876125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1052 sessionId: src_id|bc1c25ad-c7ab2314-16335db1-c78a7968_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:02.878954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:02.925510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895370391786125:5026]
2025-09-30T14:53:02.925714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1051, pipe: [1:7555895370391786125:5026]
2025-09-30T14:53:02.988306Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:02.988749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:02.988762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:02.988782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895370391786125:5026], now have 1 active actors on pipe
2025-09-30T14:53:02.988983Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:02.989044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895370391786125:5026]
2025-09-30T14:53:02.989067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:02.989073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:02.989155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1052 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bc1c25ad-c7ab2314-16335db1-c78a7968_0
2025-09-30T14:53:02.989373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1052 sessionId: src_id|bc1c25ad-c7ab2314-16335db1-c78a7968_0 is DEAD
2025-09-30T14:53:02.989549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc1c25ad-c7ab2314-16335db1-c78a7968_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:02.989561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc1c25ad-c7ab2314-16335db1-c78a7968_0] Write session will restart in 0.008776s
2025-09-30T14:53:02.989585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc1c25ad-c7ab2314-16335db1-c78a7968_0] Write session: Do CDS request
2025-09-30T14:53:02.989590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc1c25ad-c7ab2314-16335db1-c78a7968_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:02.999045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:02.999829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc1c25ad-c7ab2314-16335db1-c78a7968_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:02.999960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:02.999975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1053
2025-09-30T14:53:03.000111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1053 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:03.000144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1053 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:03.000155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1053 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:03.000160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:03.000613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1053 sessionId:  describe result for acl check
2025-09-30T14:53:03.000654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:03.000661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:03.000663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:03.000670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895374686753519:4630] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:03.000795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:03.000961Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:03.000970Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:03.000979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:03.001029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:03.001070Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895374597005930:6925]
2025-09-30T14:53:03.001272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895374686753519:4630] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:03.001698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:03.001990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:03.002031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:03.002367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:03.002430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:03.002442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:03.002443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:03.002444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:03.002446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:03.002447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:03.002448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:03.002449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:03.002451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:03.002452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:03.002453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.002454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.002456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.002457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:03.002458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:03.002464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:03.002473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:03.002477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:03.002482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:03.002486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:03.002490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:03.002494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:03.002498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:03.002502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:03.002507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:03.002511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.002514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.002519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.002523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:03.002527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:03.002534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:03.002541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:03.002548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:03.002558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:03.002563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:03.002567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:03.002572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:03.002583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:03.002587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:03.002592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:03.002600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:03.002606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:03.002615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:03.002620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:03.002628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:03.002634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:03.002639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:03.002648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:03.002652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:03.002657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:03.002667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.002675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.002680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.002690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.002694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.002700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.002708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:03.002713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:03.002722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:03.002728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:03.002773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:03.002888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895374686753519:4630] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:03.007852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895374686753519:4630] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:03.007869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895374686753519:4630] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:03.007873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895374686753519:4630] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:03.007883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1053 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:03.008152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:03.009242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:03.009263Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:03.009266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:03.009270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:03.009276Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1052 [2:7555895374597005930:6925]
2025-09-30T14:53:03.009294Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:03.009310Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:03.009314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:03.009316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:03.009319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:03.009334Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:03.009346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:03.009357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:03.009421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.009430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.009432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.009436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:03.009438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:03.009502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:03.009512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.009524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.009537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.009556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:03.009580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895374686753558:4630], now have 1 active actors on pipe
2025-09-30T14:53:03.009588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895370391786127:2454], now have 1 active actors on pipe
2025-09-30T14:53:03.009594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895370302038628:6925]
2025-09-30T14:53:03.009597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895370302038628:6925]
2025-09-30T14:53:03.009599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895370302038628:6925]
2025-09-30T14:53:03.009611Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:03.009629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:03.009631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:03.009635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:03.009637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:03.009647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:03.009651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:03.009636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1052
2025-09-30T14:53:03.009646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1052
2025-09-30T14:53:03.009680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895370302038628:6925]
2025-09-30T14:53:03.009691Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:03.009693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:03.009714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:03.009724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:03.009759Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7844924-84df8b33-2635284c-2a04af32_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:03.009770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:03.009774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:03.009776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:03.009783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:03.009795Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:03.009817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:03.009967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:03.009974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:03.009986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:03.010074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1053 partition: 0 MaxSeqNo: 42 sessionId: src_id|7844924-84df8b33-2635284c-2a04af32_0
2025-09-30T14:53:03.010477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc1c25ad-c7ab2314-16335db1-c78a7968_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7844924-84df8b33-2635284c-2a04af32_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:03.013230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7844924-84df8b33-2635284c-2a04af32_0] Write session: try to update token
2025-09-30T14:53:03.013250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7844924-84df8b33-2635284c-2a04af32_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:03.021931Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:03.021952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:03.021955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:03.021957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:03.021967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895370302038628:6925]
2025-09-30T14:53:03.021972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895370302038628:6925]
2025-09-30T14:53:03.021977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895370302038628:6925]
2025-09-30T14:53:03.022020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:03.022028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.022032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:03.022036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:03.022051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:03.022056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:03.022197Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:03.028713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1053 sessionId: src_id|7844924-84df8b33-2635284c-2a04af32_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:03.031496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:03.089349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895374686753578:5026]
2025-09-30T14:53:03.089682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1052, pipe: [1:7555895374686753578:5026]
2025-09-30T14:53:03.141053Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:03.141398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:03.141412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:03.141433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895374686753578:5026], now have 1 active actors on pipe
2025-09-30T14:53:03.141661Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:03.141701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:03.141761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895374686753578:5026]
2025-09-30T14:53:03.141837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:03.141920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1053 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7844924-84df8b33-2635284c-2a04af32_0
2025-09-30T14:53:03.142130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1053 sessionId: src_id|7844924-84df8b33-2635284c-2a04af32_0 is DEAD
2025-09-30T14:53:03.142252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7844924-84df8b33-2635284c-2a04af32_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:03.142263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7844924-84df8b33-2635284c-2a04af32_0] Write session will restart in 0.007441s
2025-09-30T14:53:03.142285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7844924-84df8b33-2635284c-2a04af32_0] Write session: Do CDS request
2025-09-30T14:53:03.142291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7844924-84df8b33-2635284c-2a04af32_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:03.150950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7844924-84df8b33-2635284c-2a04af32_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:03.151102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:03.151136Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1054
2025-09-30T14:53:03.151317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1054 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:03.151375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1054 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:03.151381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1054 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:03.151386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:03.151852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1054 sessionId:  describe result for acl check
2025-09-30T14:53:03.151890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:03.151899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:03.151901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:03.151907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895374686753686:4618] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:03.152472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895374686753686:4618] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:03.152971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:03.154511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895374686753686:4618] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:03.155020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:03.155213Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:03.155223Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:03.155233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:03.155306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:03.155348Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895374597006079:6929]
2025-09-30T14:53:03.156038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:03.156345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:03.156386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:03.156720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:03.156784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:03.156791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:03.156792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:03.156793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:03.156795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:03.156796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:03.156798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:03.156799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:03.156800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:03.156802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:03.156803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.156805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.156806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.156807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:03.156809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:03.156814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:03.156828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:03.156833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:03.156837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:03.156842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:03.156846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:03.156851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:03.156856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:03.156860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:03.156865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:03.156870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.156874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.156879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.156884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:03.156889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:03.156897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:03.156906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:03.156912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:03.156919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:03.156924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:03.156930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:03.156935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:03.156941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:03.156963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:03.156969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:03.156974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:03.156980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:03.156986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:03.156992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:03.156996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:03.157003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:03.157008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:03.157013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:03.157018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:03.157024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:03.157030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.157036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.157041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.157047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.157053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.157060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.157064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:03.157070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:03.157075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:03.157081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:03.157084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895374686753686:4618] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:03.157111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895374686753686:4618] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:03.157114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895374686753686:4618] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:03.157123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1054 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:03.157132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:03.162748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:03.163765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:03.163786Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:03.163789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:03.163794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:03.163801Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1053 [2:7555895374597006079:6929]
2025-09-30T14:53:03.163817Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:03.163831Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:03.163835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:03.163838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:03.163841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:03.163856Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:03.163862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:03.163869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:03.163934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.163942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.163944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.163948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:03.163951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:03.164031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:03.164039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.164053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.164065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.164090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:03.164112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895374686753592:2454], now have 1 active actors on pipe
2025-09-30T14:53:03.164120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895374686753726:4618], now have 1 active actors on pipe
2025-09-30T14:53:03.164126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895374597006073:6929]
2025-09-30T14:53:03.164128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895374597006073:6929]
2025-09-30T14:53:03.164130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895374597006073:6929]
2025-09-30T14:53:03.164142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:03.164160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:03.164152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1053
2025-09-30T14:53:03.164172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:03.164176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:03.164179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:03.164180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:03.164206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1053
2025-09-30T14:53:03.164184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:03.164219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895374597006073:6929]
2025-09-30T14:53:03.164223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:03.164226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:03.164276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:03.164288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:03.164310Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9814900-88093988-54af6132-39eb6e54_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:03.164322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:03.164326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:03.164328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:03.164337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:03.164351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:03.164369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:03.164550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:03.164554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:03.164567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:03.164674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1054 partition: 0 MaxSeqNo: 42 sessionId: src_id|d9814900-88093988-54af6132-39eb6e54_0
2025-09-30T14:53:03.165061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7844924-84df8b33-2635284c-2a04af32_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d9814900-88093988-54af6132-39eb6e54_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:03.168022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9814900-88093988-54af6132-39eb6e54_0] Write session: try to update token
2025-09-30T14:53:03.168041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9814900-88093988-54af6132-39eb6e54_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:03.176666Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:03.176686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:03.176695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895374597006073:6929]
2025-09-30T14:53:03.176744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:03.176745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:03.176916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:03.177062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:03.177202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:03.177349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:03.177550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:03.177585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:03.183501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1054 sessionId: src_id|d9814900-88093988-54af6132-39eb6e54_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:03.186499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:03.186728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:03.186754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:03.186854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:03.186983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:03.188438Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:03.188459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:03.188462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:03.188464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:03.188475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895374597006073:6929]
2025-09-30T14:53:03.188479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895374597006073:6929]
2025-09-30T14:53:03.188483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895374597006073:6929]
2025-09-30T14:53:03.188527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:03.188529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:03.188536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:03.188540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:03.188542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.188544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:03.188694Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:03.241928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895374686753757:5026]
2025-09-30T14:53:03.242220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1053, pipe: [1:7555895374686753757:5026]
2025-09-30T14:53:03.302795Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:03.311074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:03.311106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:03.311310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:03.311382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:03.311450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:03.311523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:03.312171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:03.312185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:03.312260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:03.312325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:03.312392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:03.312463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:03.312508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:03.312519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:03.312589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:03.312653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:03.312721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:03.312788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:03.312832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:03.312841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:03.312908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:03.312976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:03.313046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:03.313110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:03.313155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:03.313162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:03.313230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:03.313292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:03.313359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:03.313429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:03.313480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:03.313491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:03.313559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:03.313625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:03.313690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:03.313758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:03.313802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:03.313810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:03.313879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:03.313940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:03.314010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:03.314078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:03.314125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:03.314132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:03.314214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:03.314280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:03.314348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:03.314412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:03.314457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:03.314465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:03.314532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:03.314595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:03.314661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:03.314730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:03.314778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:03.314786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:03.314853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:03.314915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:03.314985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:03.315047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:03.315091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:03.315099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:03.315163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895374686753757:5026], now have 1 active actors on pipe
2025-09-30T14:53:03.315434Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:03.315465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895374686753757:5026]
2025-09-30T14:53:03.315488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:03.315492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:03.315523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1054 reason: error at write: Disconnected sessionId: src_id|d9814900-88093988-54af6132-39eb6e54_0
2025-09-30T14:53:03.315729Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:03.315755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1054 sessionId: src_id|d9814900-88093988-54af6132-39eb6e54_0 is DEAD
2025-09-30T14:53:03.315908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9814900-88093988-54af6132-39eb6e54_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:03.315919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9814900-88093988-54af6132-39eb6e54_0] Write session will restart in 0.006676s
2025-09-30T14:53:03.315944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9814900-88093988-54af6132-39eb6e54_0] Write session: Do CDS request
2025-09-30T14:53:03.315949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9814900-88093988-54af6132-39eb6e54_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:03.323869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9814900-88093988-54af6132-39eb6e54_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:03.323958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:03.323975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1055
2025-09-30T14:53:03.324139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1055 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:03.324186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1055 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:03.324197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1055 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:03.324202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:03.324691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1055 sessionId:  describe result for acl check
2025-09-30T14:53:03.324726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:03.324729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:03.324731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:03.324737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895374686753787:4601] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:03.325454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895374686753787:4601] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:03.328511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895374686753787:4601] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:03.329659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:03.331702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:03.332013Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:03.332024Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:03.332036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:03.332093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:03.332130Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895374597006251:6943]
2025-09-30T14:53:03.332117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895374686753787:4601] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:03.332133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895374686753787:4601] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:03.332137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895374686753787:4601] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:03.332145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1055 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:03.332775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:03.333075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:03.333134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:03.333467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:03.333529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:03.333535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:03.333536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:03.333538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:03.333539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:03.333540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:03.333542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:03.333544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:03.333545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:03.333546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:03.333547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.333549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.333550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.333551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:03.333552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:03.333558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:03.333569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:03.333573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:03.333578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:03.333582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:03.333586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:03.333590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:03.333594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:03.333598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:03.333602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:03.333606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.333609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.333614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.333618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:03.333622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:03.333630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:03.333638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:03.333643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:03.333649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:03.333654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:03.333659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:03.333663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:03.333670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:03.333680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:03.333685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:03.333689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:03.333694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:03.333698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:03.333708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:03.333712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:03.333718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:03.333727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:03.333733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:03.333741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:03.333747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:03.333753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.333765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.333773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.333779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.333783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.333795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.333799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:03.333804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:03.333809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:03.333814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:03.333856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:03.339706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:03.340912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:03.340929Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:03.340932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:03.340937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:03.340944Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1054 [2:7555895374597006251:6943]
2025-09-30T14:53:03.340960Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:03.340974Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:03.340978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:03.340981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:03.340983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:03.340999Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:03.341007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:03.341014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:03.341078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.341087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.341090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.341094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:03.341096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:03.341166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:03.341173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.341185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.341201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.341218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:03.341241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895374686753759:2454], now have 1 active actors on pipe
2025-09-30T14:53:03.341250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895374686753893:4601], now have 1 active actors on pipe
2025-09-30T14:53:03.341256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895374597006246:6943]
2025-09-30T14:53:03.341258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895374597006246:6943]
2025-09-30T14:53:03.341260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895374597006246:6943]
2025-09-30T14:53:03.341278Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:03.341290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:03.341304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:03.341307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:03.341306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:03.341311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:03.341314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:03.341341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895374597006246:6943]
2025-09-30T14:53:03.341353Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:03.341361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:03.341350Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1054
2025-09-30T14:53:03.341399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1054
2025-09-30T14:53:03.341504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:03.341517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:03.341553Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7fb50792-6bd349e3-ce2d81d5-95de51e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:03.341567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:03.341587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:03.341589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:03.341601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:03.341613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:03.341634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:03.341859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:03.341872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:03.341895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:03.342018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1055 partition: 0 MaxSeqNo: 42 sessionId: src_id|7fb50792-6bd349e3-ce2d81d5-95de51e9_0
2025-09-30T14:53:03.342419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9814900-88093988-54af6132-39eb6e54_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7fb50792-6bd349e3-ce2d81d5-95de51e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:03.345240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fb50792-6bd349e3-ce2d81d5-95de51e9_0] Write session: try to update token
2025-09-30T14:53:03.345259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fb50792-6bd349e3-ce2d81d5-95de51e9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:03.353653Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:03.353673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:03.353686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895374597006246:6943]
2025-09-30T14:53:03.353735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:03.353745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:03.353929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:03.354091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:03.354272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:03.354430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:03.354633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:03.354685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:03.360077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1055 sessionId: src_id|7fb50792-6bd349e3-ce2d81d5-95de51e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:03.362841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:03.363064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:03.363097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:03.363132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:03.363262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:03.364361Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:03.364374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:03.364377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:03.364379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:03.364391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895374597006246:6943]
2025-09-30T14:53:03.364395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895374597006246:6943]
2025-09-30T14:53:03.364399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895374597006246:6943]
2025-09-30T14:53:03.364435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:03.364441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.364452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:03.364461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:03.364468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:03.364473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:03.364592Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:03.415482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895374686753904:5026]
2025-09-30T14:53:03.415803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1054, pipe: [1:7555895374686753904:5026]
2025-09-30T14:53:03.473173Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:03.480824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:03.480850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:03.481015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:03.481081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:03.481149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:03.481216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:03.481264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:03.481272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:03.481339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:03.481394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:03.481455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:03.481521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:03.481566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:03.481574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:03.481642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:03.481704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:03.481765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:03.481833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:03.481876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:03.481882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:03.481941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:03.482011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:03.482073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:03.482135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:03.482193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:03.482200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:03.482268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:03.482332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:03.482397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:03.482458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:03.482500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:03.482506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:03.482566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:03.482627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:03.482686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:03.482750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:03.482793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:03.482801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:03.482863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:03.482926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:03.482992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:03.483058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:03.483098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:03.483108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:03.483173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:03.483236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:03.483313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:03.483373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:03.483413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:03.483421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:03.483486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:03.483543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:03.483600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:03.483663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:03.483704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:03.483712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:03.483774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:03.483832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:03.483888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:03.483945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:03.483991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:03.483997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:03.484059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895374686753904:5026], now have 1 active actors on pipe
2025-09-30T14:53:03.484261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:03.484274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895374686753904:5026]
2025-09-30T14:53:03.484310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:03.484313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:03.484339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1055 reason: error at write: Disconnected sessionId: src_id|7fb50792-6bd349e3-ce2d81d5-95de51e9_0
2025-09-30T14:53:03.484565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1055 sessionId: src_id|7fb50792-6bd349e3-ce2d81d5-95de51e9_0 is DEAD
2025-09-30T14:53:03.484711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fb50792-6bd349e3-ce2d81d5-95de51e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:03.484721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fb50792-6bd349e3-ce2d81d5-95de51e9_0] Write session will restart in 0.005846s
2025-09-30T14:53:03.484745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fb50792-6bd349e3-ce2d81d5-95de51e9_0] Write session: Do CDS request
2025-09-30T14:53:03.484751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fb50792-6bd349e3-ce2d81d5-95de51e9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:03.485111Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:03.491798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fb50792-6bd349e3-ce2d81d5-95de51e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:03.491843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:03.491859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1056
2025-09-30T14:53:03.492033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1056 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:03.492064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1056 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:03.492069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1056 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:03.492073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:03.492796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1056 sessionId:  describe result for acl check
2025-09-30T14:53:03.492828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:03.492840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:03.492842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:03.492848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895374686753966:4597] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:03.493280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895374686753966:4597] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:03.495315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895374686753966:4597] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:03.495398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:03.497330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:03.497550Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:03.497560Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:03.497570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:03.497629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:03.497667Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895374597006388:6945]
2025-09-30T14:53:03.497780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895374686753966:4597] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:03.497795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895374686753966:4597] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:03.497798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895374686753966:4597] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:03.497806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1056 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:03.498318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:03.498617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:03.498660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:03.498977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:03.499034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:03.499039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:03.499040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:03.499041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:03.499042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:03.499044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:03.499045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:03.499046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:03.499047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:03.499048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:03.499049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.499050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.499051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.499052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:03.499053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:03.499059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:03.499069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:03.499073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:03.499077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:03.499082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:03.499086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:03.499090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:03.499094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:03.499099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:03.499103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:03.499107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.499111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.499115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.499124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:03.499127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:03.499134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:03.499146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:03.499154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:03.499159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:03.499164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:03.499169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:03.499173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:03.499179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:03.499184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:03.499188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:03.499197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:03.499203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:03.499210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:03.499215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:03.499220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:03.499229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:03.499234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:03.499260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:03.499269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:03.499279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:03.499290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.499299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.499308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.499317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.499326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.499332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.499341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:03.499347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:03.499353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:03.499358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:03.499402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:03.504607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:03.505449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:03.505465Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:03.505468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:03.505472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:03.505478Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1055 [2:7555895374597006388:6945]
2025-09-30T14:53:03.505495Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:03.505509Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:03.505513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:03.505516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:03.505518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:03.505532Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:03.505539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:03.505545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:03.505601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.505608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.505611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.505614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:03.505617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:03.505687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:03.505694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.505706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.505723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.505744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:03.505765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895374686754042:4597], now have 1 active actors on pipe
2025-09-30T14:53:03.505774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895374686753906:2454], now have 1 active actors on pipe
2025-09-30T14:53:03.505780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895374597006382:6945]
2025-09-30T14:53:03.505782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895374597006382:6945]
2025-09-30T14:53:03.505785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895374597006382:6945]
2025-09-30T14:53:03.505796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:03.505810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:03.505812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:03.505818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:03.505820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:03.505829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:03.505831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:03.505860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895374597006382:6945]
2025-09-30T14:53:03.505868Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:03.505871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:03.505837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1055
2025-09-30T14:53:03.505837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1055
2025-09-30T14:53:03.505894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:03.505905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:03.505941Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39572d88-5346e4ad-7b9868c3-7ac577d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:03.505947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:03.505955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:03.505958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:03.505967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:03.505980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:03.506005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:03.506201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:03.506217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:03.506242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:03.506347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1056 partition: 0 MaxSeqNo: 42 sessionId: src_id|39572d88-5346e4ad-7b9868c3-7ac577d6_0
2025-09-30T14:53:03.506684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fb50792-6bd349e3-ce2d81d5-95de51e9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|39572d88-5346e4ad-7b9868c3-7ac577d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:03.509508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39572d88-5346e4ad-7b9868c3-7ac577d6_0] Write session: try to update token
2025-09-30T14:53:03.509530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39572d88-5346e4ad-7b9868c3-7ac577d6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:03.518711Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:03.518733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:03.518736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:03.518739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:03.518748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895374597006382:6945]
2025-09-30T14:53:03.518752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895374597006382:6945]
2025-09-30T14:53:03.518756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895374597006382:6945]
2025-09-30T14:53:03.518799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:03.518813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:03.518821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.518823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:03.518828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:03.518832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:03.518971Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:03.524786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1056 sessionId: src_id|39572d88-5346e4ad-7b9868c3-7ac577d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:03.527579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:03.584456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895374686754054:5026]
2025-09-30T14:53:03.584696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1055, pipe: [1:7555895374686754054:5026]
2025-09-30T14:53:03.624765Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:03.625012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:03.625024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:03.625057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895374686754054:5026], now have 1 active actors on pipe
2025-09-30T14:53:03.625270Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:03.625314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:03.625323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895374686754054:5026]
2025-09-30T14:53:03.625327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:03.625348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:03.625390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1056 reason: error at write: Disconnected sessionId: src_id|39572d88-5346e4ad-7b9868c3-7ac577d6_0
2025-09-30T14:53:03.625596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1056 sessionId: src_id|39572d88-5346e4ad-7b9868c3-7ac577d6_0 is DEAD
2025-09-30T14:53:03.625717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39572d88-5346e4ad-7b9868c3-7ac577d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:03.625723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39572d88-5346e4ad-7b9868c3-7ac577d6_0] Write session will restart in 0.007320s
2025-09-30T14:53:03.625742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39572d88-5346e4ad-7b9868c3-7ac577d6_0] Write session: Do CDS request
2025-09-30T14:53:03.625748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39572d88-5346e4ad-7b9868c3-7ac577d6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:03.633855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39572d88-5346e4ad-7b9868c3-7ac577d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:03.633907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:03.633932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1057
2025-09-30T14:53:03.634093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1057 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:03.634135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1057 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:03.634146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1057 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:03.634152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:03.634596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1057 sessionId:  describe result for acl check
2025-09-30T14:53:03.634637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:03.634643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:03.634645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:03.634651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895374686754153:4589] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:03.635176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895374686754153:4589] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:03.636321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:03.637072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895374686754153:4589] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:03.638022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:03.638223Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:03.638234Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:03.638255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:03.638308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:03.638345Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895374597006529:6948]
2025-09-30T14:53:03.639019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:03.639293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:03.639339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:03.639332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895374686754153:4589] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:03.639346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895374686754153:4589] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:03.639349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895374686754153:4589] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:03.639367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1057 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:03.639670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:03.639735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:03.639742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:03.639743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:03.639744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:03.639745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:03.639746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:03.639748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:03.639749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:03.639750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:03.639751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:03.639753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.639754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.639755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.639756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:03.639757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:03.639763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:03.639773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:03.639777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:03.639781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:03.639784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:03.639788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:03.639792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:03.639795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:03.639798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:03.639802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:03.639805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.639809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.639812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.639816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:03.639820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:03.639826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:03.639833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:03.639838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:03.639844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:03.639848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:03.639853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:03.639857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:03.639862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:03.639866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:03.639870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:03.639874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:03.639880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:03.639885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:03.639890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:03.639895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:03.639900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:03.639905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:03.639910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:03.639914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:03.639919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:03.639925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.639931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.639936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.639941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.639945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.639957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.639963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:03.639968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:03.639973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:03.639979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:03.640023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:03.645252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:03.646141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:03.646167Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:03.646170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:03.646174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:03.646181Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1056 [2:7555895374597006529:6948]
2025-09-30T14:53:03.646198Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:03.646215Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:03.646226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:03.646229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:03.646231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:03.646245Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:03.646253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:03.646260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:03.646322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.646330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.646332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.646335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:03.646338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:03.646404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:03.646412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.646424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.646437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.646460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:03.646481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895374686754192:4589], now have 1 active actors on pipe
2025-09-30T14:53:03.646488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895374686754055:2454], now have 1 active actors on pipe
2025-09-30T14:53:03.646495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895374597006522:6948]
2025-09-30T14:53:03.646497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895374597006522:6948]
2025-09-30T14:53:03.646500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895374597006522:6948]
2025-09-30T14:53:03.646513Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:03.646528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:03.646529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:03.646533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:03.646535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:03.646547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:03.646550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:03.646580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895374597006522:6948]
2025-09-30T14:53:03.646588Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:03.646591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:03.646554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1056
2025-09-30T14:53:03.646604Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1056
2025-09-30T14:53:03.646611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:03.646620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:03.646654Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2c58fd9-b78b6ea0-dac3aaf0-105dd1cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:03.646666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:03.646670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:03.646673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:03.646682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:03.646695Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:03.646714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:03.646986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:03.647001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:03.647036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:03.647146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1057 partition: 0 MaxSeqNo: 42 sessionId: src_id|e2c58fd9-b78b6ea0-dac3aaf0-105dd1cd_0
2025-09-30T14:53:03.647530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39572d88-5346e4ad-7b9868c3-7ac577d6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e2c58fd9-b78b6ea0-dac3aaf0-105dd1cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:03.650263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2c58fd9-b78b6ea0-dac3aaf0-105dd1cd_0] Write session: try to update token
2025-09-30T14:53:03.650278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2c58fd9-b78b6ea0-dac3aaf0-105dd1cd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:03.658732Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:03.658755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:03.658758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:03.658761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:03.658770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895374597006522:6948]
2025-09-30T14:53:03.658775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895374597006522:6948]
2025-09-30T14:53:03.658779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895374597006522:6948]
2025-09-30T14:53:03.658819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:03.658826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.658828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:03.658830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:03.658836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:03.658840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:03.658967Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:03.664706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1057 sessionId: src_id|e2c58fd9-b78b6ea0-dac3aaf0-105dd1cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:03.667477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:03.725249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895374686754201:5026]
2025-09-30T14:53:03.725540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1056, pipe: [1:7555895374686754201:5026]
2025-09-30T14:53:03.771735Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:03.772228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:03.772244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:03.772281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895374686754201:5026], now have 1 active actors on pipe
2025-09-30T14:53:03.772490Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:03.772521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:03.772535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:03.772554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895374686754201:5026]
2025-09-30T14:53:03.772586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:03.772595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1057 reason: error at write: Disconnected sessionId: src_id|e2c58fd9-b78b6ea0-dac3aaf0-105dd1cd_0
2025-09-30T14:53:03.772786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1057 sessionId: src_id|e2c58fd9-b78b6ea0-dac3aaf0-105dd1cd_0 is DEAD
2025-09-30T14:53:03.772950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2c58fd9-b78b6ea0-dac3aaf0-105dd1cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:03.772961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2c58fd9-b78b6ea0-dac3aaf0-105dd1cd_0] Write session will restart in 0.006008s
2025-09-30T14:53:03.772984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2c58fd9-b78b6ea0-dac3aaf0-105dd1cd_0] Write session: Do CDS request
2025-09-30T14:53:03.772989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2c58fd9-b78b6ea0-dac3aaf0-105dd1cd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:03.779897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2c58fd9-b78b6ea0-dac3aaf0-105dd1cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:03.779870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:03.779904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1058
2025-09-30T14:53:03.780128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1058 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:03.780160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1058 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:03.780165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1058 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:03.780169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:03.780657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1058 sessionId:  describe result for acl check
2025-09-30T14:53:03.780695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:03.780703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:03.780705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:03.780710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895374686754250:4585] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:03.781284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895374686754250:4585] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:03.783347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895374686754250:4585] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:03.783579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:03.785424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:03.785621Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:03.785631Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:03.785642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:03.785689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:03.785725Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895374597006668:6950]
2025-09-30T14:53:03.785731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895374686754250:4585] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:03.785747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895374686754250:4585] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:03.785750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895374686754250:4585] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:03.785758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1058 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:03.786416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:03.786743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:03.786786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:03.787103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:03.787170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:03.787177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:03.787178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:03.787179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:03.787181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:03.787182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:03.787183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:03.787184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:03.787185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:03.787187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:03.787188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.787189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.787191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.787192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:03.787193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:03.787199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:03.787210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:03.787215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:03.787220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:03.787225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:03.787229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:03.787234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:03.787238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:03.787260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:03.787265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:03.787269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.787273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.787278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.787282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:03.787287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:03.787294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:03.787307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:03.787318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:03.787324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:03.787328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:03.787334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:03.787339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:03.787345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:03.787351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:03.787356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:03.787365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:03.787371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:03.787381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:03.787386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:03.787394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:03.787400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:03.787405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:03.787411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:03.787416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:03.787423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:03.787428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.787434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.787443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.787449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.787458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.787464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.787473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:03.787478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:03.787484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:03.787494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:03.787540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:03.792982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:03.793855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:03.793869Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:03.793872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:03.793877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:03.793885Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1057 [2:7555895374597006668:6950]
2025-09-30T14:53:03.793902Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:03.793923Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:03.793931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:03.793934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:03.793937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:03.793952Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:03.793959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:03.793966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:03.794029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.794038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.794041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.794045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:03.794048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:03.794112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:03.794119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.794133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.794166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.794185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:03.794204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895374686754338:4585], now have 1 active actors on pipe
2025-09-30T14:53:03.794213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895374686754202:2454], now have 1 active actors on pipe
2025-09-30T14:53:03.794221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895374597006662:6950]
2025-09-30T14:53:03.794224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895374597006662:6950]
2025-09-30T14:53:03.794226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895374597006662:6950]
2025-09-30T14:53:03.794239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:03.794252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:03.794256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:03.794260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:03.794262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:03.794266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:03.794269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:03.794297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895374597006662:6950]
2025-09-30T14:53:03.794270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1057
2025-09-30T14:53:03.794305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:03.794308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:03.794324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:03.794329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:03.794270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1057
2025-09-30T14:53:03.794379Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|923c5672-cbdfb79e-161307c5-c1269c58_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:03.794392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:03.794398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:03.794406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:03.794417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:03.794426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:03.794443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:03.794634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:03.794655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:03.794681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:03.794788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1058 partition: 0 MaxSeqNo: 42 sessionId: src_id|923c5672-cbdfb79e-161307c5-c1269c58_0
2025-09-30T14:53:03.795290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2c58fd9-b78b6ea0-dac3aaf0-105dd1cd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|923c5672-cbdfb79e-161307c5-c1269c58_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:03.798331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|923c5672-cbdfb79e-161307c5-c1269c58_0] Write session: try to update token
2025-09-30T14:53:03.798347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|923c5672-cbdfb79e-161307c5-c1269c58_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:03.806586Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:03.806613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:03.806616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:03.806619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:03.806628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895374597006662:6950]
2025-09-30T14:53:03.806634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895374597006662:6950]
2025-09-30T14:53:03.806639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895374597006662:6950]
2025-09-30T14:53:03.806680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:03.806692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.806695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:03.806697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:03.806705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:03.806709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:03.806836Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:03.814878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1058 sessionId: src_id|923c5672-cbdfb79e-161307c5-c1269c58_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:03.817683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:03.872701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895374686754350:5026]
2025-09-30T14:53:03.872988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1057, pipe: [1:7555895374686754350:5026]
2025-09-30T14:53:03.924192Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:03.924533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:03.924549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:03.924568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895374686754350:5026], now have 1 active actors on pipe
2025-09-30T14:53:03.924862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:03.924876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:03.924881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895374686754350:5026]
2025-09-30T14:53:03.924901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:03.924940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1058 reason: error at write: Disconnected sessionId: src_id|923c5672-cbdfb79e-161307c5-c1269c58_0
2025-09-30T14:53:03.925161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1058 sessionId: src_id|923c5672-cbdfb79e-161307c5-c1269c58_0 is DEAD
2025-09-30T14:53:03.925294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|923c5672-cbdfb79e-161307c5-c1269c58_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:03.925307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|923c5672-cbdfb79e-161307c5-c1269c58_0] Write session will restart in 0.008941s
2025-09-30T14:53:03.925330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|923c5672-cbdfb79e-161307c5-c1269c58_0] Write session: Do CDS request
2025-09-30T14:53:03.925336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|923c5672-cbdfb79e-161307c5-c1269c58_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:03.925342Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:03.935760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|923c5672-cbdfb79e-161307c5-c1269c58_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:03.935859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:03.935875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1059
2025-09-30T14:53:03.936024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1059 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:03.936055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1059 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:03.936065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1059 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:03.936069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:03.936072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:03.936501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1059 sessionId:  describe result for acl check
2025-09-30T14:53:03.936540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:03.936542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:03.936546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:03.936552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895374686754452:4580] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:03.937088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895374686754452:4580] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:03.938290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:03.938469Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:03.938478Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:03.938486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:03.938526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:03.938557Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895374597006808:6952]
2025-09-30T14:53:03.938925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895374686754452:4580] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:03.939159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:03.939450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:03.939482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:03.939715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:03.939759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:03.939764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:03.939764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:03.939765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:03.939766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:03.939767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:03.939768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:03.939768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:03.939769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:03.939770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:03.939771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.939771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.939772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.939772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:03.939773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:03.939777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:03.939783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:03.939785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:03.939788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:03.939790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:03.939793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:03.939795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:03.939797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:03.939800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:03.939804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:03.939806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.939808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.939811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.939813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:03.939815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:03.939820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:03.939826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:03.939829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:03.939832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:03.939835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:03.939838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:03.939840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:03.939844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:03.939848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:03.939854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:03.939858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:03.939864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:03.939869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:03.939874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:03.939876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:03.939879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:03.939882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:03.939884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:03.939887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:03.939890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:03.939895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.939897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.939900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.939903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.939906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.939909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.939911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:03.939914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:03.939917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:03.939920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:03.939943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:03.945245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895374686754452:4580] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:03.945262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895374686754452:4580] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:03.945266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895374686754452:4580] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:03.945275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1059 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:03.945418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:03.946509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:03.946524Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:03.946526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:03.946530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:03.946536Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1058 [2:7555895374597006808:6952]
2025-09-30T14:53:03.946553Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:03.946566Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:03.946571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:03.946575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:03.946577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:03.946593Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:03.946604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:03.946611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:03.946672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.946683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.946685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.946688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:03.946691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:03.946754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:03.946761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.946773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:03.946785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:03.946808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:03.946831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895374686754490:4580], now have 1 active actors on pipe
2025-09-30T14:53:03.946839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895374686754351:2454], now have 1 active actors on pipe
2025-09-30T14:53:03.946845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895374597006801:6952]
2025-09-30T14:53:03.946848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895374597006801:6952]
2025-09-30T14:53:03.946850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895374597006801:6952]
2025-09-30T14:53:03.946861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:03.946875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:03.946878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:03.946881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:03.946884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:03.946889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:03.946892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:03.946876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1058
2025-09-30T14:53:03.946887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1058
2025-09-30T14:53:03.946922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895374597006801:6952]
2025-09-30T14:53:03.946930Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:03.946932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:03.946944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:03.946953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:03.946999Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7dedbef4-94abd018-7bcfa70-de8fe4c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:03.947009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:03.947013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:03.947015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:03.947023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:03.947038Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:03.947054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:03.947196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:03.947203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:03.947215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:03.947309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1059 partition: 0 MaxSeqNo: 42 sessionId: src_id|7dedbef4-94abd018-7bcfa70-de8fe4c4_0
2025-09-30T14:53:03.947719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|923c5672-cbdfb79e-161307c5-c1269c58_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7dedbef4-94abd018-7bcfa70-de8fe4c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:03.950697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dedbef4-94abd018-7bcfa70-de8fe4c4_0] Write session: try to update token
2025-09-30T14:53:03.950719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dedbef4-94abd018-7bcfa70-de8fe4c4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:03.959115Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:03.959132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:03.959135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:03.959137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:03.959147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895374597006801:6952]
2025-09-30T14:53:03.959151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895374597006801:6952]
2025-09-30T14:53:03.959156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895374597006801:6952]
2025-09-30T14:53:03.959199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:03.959206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:03.959209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:03.959210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:03.959217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:03.959221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:03.959365Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:03.965593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1059 sessionId: src_id|7dedbef4-94abd018-7bcfa70-de8fe4c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:03.968455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:04.025263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895378981721800:5026]
2025-09-30T14:53:04.025448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1058, pipe: [1:7555895378981721800:5026]
2025-09-30T14:53:04.068981Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:04.069266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:04.069281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:04.069299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895378981721800:5026], now have 1 active actors on pipe
2025-09-30T14:53:04.069512Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:04.069529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895378981721800:5026]
2025-09-30T14:53:04.069551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:04.069557Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:04.069555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:04.069630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1059 reason: error at write: Disconnected sessionId: src_id|7dedbef4-94abd018-7bcfa70-de8fe4c4_0
2025-09-30T14:53:04.069844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1059 sessionId: src_id|7dedbef4-94abd018-7bcfa70-de8fe4c4_0 is DEAD
2025-09-30T14:53:04.070015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dedbef4-94abd018-7bcfa70-de8fe4c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:04.070025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dedbef4-94abd018-7bcfa70-de8fe4c4_0] Write session will restart in 0.005748s
2025-09-30T14:53:04.070049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dedbef4-94abd018-7bcfa70-de8fe4c4_0] Write session: Do CDS request
2025-09-30T14:53:04.070055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dedbef4-94abd018-7bcfa70-de8fe4c4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:04.076802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dedbef4-94abd018-7bcfa70-de8fe4c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:04.076864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:04.076876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1060
2025-09-30T14:53:04.077039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1060 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:04.077079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1060 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:04.077089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1060 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:04.077093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:04.077509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1060 sessionId:  describe result for acl check
2025-09-30T14:53:04.077543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:04.077549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:04.077552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:04.077557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895378981721883:4568] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:04.078083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895378981721883:4568] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:04.079633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:04.079811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895378981721883:4568] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:04.081280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:04.081479Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:04.081490Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:04.081501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:04.081548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:04.081576Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895378891974256:6954]
2025-09-30T14:53:04.082031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:04.082277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:04.082279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895378981721883:4568] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:04.082295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895378981721883:4568] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:04.082298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895378981721883:4568] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:04.082318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:04.082306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1060 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:04.082566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:04.082620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:04.082624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:04.082625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:04.082626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:04.082627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:04.082627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:04.082628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:04.082629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:04.082630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:04.082631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:04.082631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.082632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.082633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.082633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:04.082634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:04.082639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:04.082648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:04.082652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:04.082655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:04.082659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:04.082662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:04.082665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:04.082670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:04.082673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:04.082677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:04.082680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.082684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.082688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.082691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:04.082696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:04.082703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:04.082709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:04.082713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:04.082716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:04.082719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:04.082722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:04.082725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:04.082727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:04.082730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:04.082733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:04.082736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:04.082738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:04.082741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:04.082745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:04.082747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:04.082750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:04.082753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:04.082756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:04.082759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:04.082762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:04.082764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.082767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.082770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.082773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.082775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.082778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.082781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:04.082784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:04.082787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:04.082789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:04.082813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:04.088759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:04.090004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:04.090024Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:04.090027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:04.090031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:04.090038Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1059 [2:7555895378891974256:6954]
2025-09-30T14:53:04.090054Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:04.090070Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:04.090074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:04.090082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:04.090085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:04.090102Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:04.090116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:04.090124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:04.090203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.090210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.090213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.090217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:04.090220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:04.090286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:04.090293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.090307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.090320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.090343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:04.090367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895378981721943:4568], now have 1 active actors on pipe
2025-09-30T14:53:04.090383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895378891974250:6954]
2025-09-30T14:53:04.090386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895378891974250:6954]
2025-09-30T14:53:04.090389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895378891974250:6954]
2025-09-30T14:53:04.090401Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:04.090413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895378981721803:2454], now have 1 active actors on pipe
2025-09-30T14:53:04.090417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:04.090421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:04.090421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:04.090422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:04.090436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:04.090441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:04.090488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895378891974250:6954]
2025-09-30T14:53:04.090462Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1059
2025-09-30T14:53:04.090497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:04.090502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:04.090472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1059
2025-09-30T14:53:04.090527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:04.090538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:04.090573Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd93caa8-e0bf32fc-836904db-c913ce5b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:04.090586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:04.090589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:04.090592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:04.090618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:04.090631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:04.090652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:04.090814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:04.090825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:04.090845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:04.090926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1060 partition: 0 MaxSeqNo: 42 sessionId: src_id|dd93caa8-e0bf32fc-836904db-c913ce5b_0
2025-09-30T14:53:04.091322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dedbef4-94abd018-7bcfa70-de8fe4c4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dd93caa8-e0bf32fc-836904db-c913ce5b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:04.094185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd93caa8-e0bf32fc-836904db-c913ce5b_0] Write session: try to update token
2025-09-30T14:53:04.094205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd93caa8-e0bf32fc-836904db-c913ce5b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:04.102615Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:04.102635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:04.102637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:04.102640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:04.102649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895378891974250:6954]
2025-09-30T14:53:04.102657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895378891974250:6954]
2025-09-30T14:53:04.102661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895378891974250:6954]
2025-09-30T14:53:04.102703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:04.102710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.102713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:04.102712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:04.102719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:04.102723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:04.102880Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:04.108976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1060 sessionId: src_id|dd93caa8-e0bf32fc-836904db-c913ce5b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:04.111804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:04.169672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895378981721968:5026]
2025-09-30T14:53:04.169988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1059, pipe: [1:7555895378981721968:5026]
2025-09-30T14:53:04.217433Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:04.217740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:04.217755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:04.217794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895378981721968:5026], now have 1 active actors on pipe
2025-09-30T14:53:04.218024Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:04.218024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:04.218040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:04.218104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1060 reason: error at write: Disconnected sessionId: src_id|dd93caa8-e0bf32fc-836904db-c913ce5b_0
2025-09-30T14:53:04.218357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1060 sessionId: src_id|dd93caa8-e0bf32fc-836904db-c913ce5b_0 is DEAD
2025-09-30T14:53:04.218525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd93caa8-e0bf32fc-836904db-c913ce5b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:04.218537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd93caa8-e0bf32fc-836904db-c913ce5b_0] Write session will restart in 0.006235s
2025-09-30T14:53:04.218560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd93caa8-e0bf32fc-836904db-c913ce5b_0] Write session: Do CDS request
2025-09-30T14:53:04.218565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd93caa8-e0bf32fc-836904db-c913ce5b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:04.218534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895378981721968:5026]
2025-09-30T14:53:04.218567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:04.225834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd93caa8-e0bf32fc-836904db-c913ce5b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:04.225946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:04.225964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1061
2025-09-30T14:53:04.226231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1061 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:04.226267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1061 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:04.226272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1061 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:04.226284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:04.226866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1061 sessionId:  describe result for acl check
2025-09-30T14:53:04.226905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:04.226907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:04.226910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:04.226922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895378981722032:4561] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:04.227503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895378981722032:4561] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:04.230077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895378981722032:4561] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:04.231055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:04.233219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:04.233462Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:04.233472Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:04.233483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:04.233549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:04.233592Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895378891974413:6960]
2025-09-30T14:53:04.233568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895378981722032:4561] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:04.233586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895378981722032:4561] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:04.233589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895378981722032:4561] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:04.233599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1061 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:04.234305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:04.234710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:04.234775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:04.235134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:04.235234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:04.235277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:04.235285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:04.235286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:04.235287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:04.235288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:04.235289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:04.235291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:04.235292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:04.235293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:04.235295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.235296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.235297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.235298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:04.235299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:04.235306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:04.235316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:04.235320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:04.235325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:04.235329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:04.235333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:04.235337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:04.235341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:04.235345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:04.235349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:04.235353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.235356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.235360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.235363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:04.235367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:04.235377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:04.235385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:04.235391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:04.235397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:04.235400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:04.235405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:04.235409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:04.235414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:04.235418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:04.235424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:04.235428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:04.235433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:04.235439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:04.235445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:04.235449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:04.235455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:04.235460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:04.235465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:04.235469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:04.235474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:04.235479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.235484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.235489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.235503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.235507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.235512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.235516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:04.235521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:04.235526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:04.235531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:04.235573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:04.241560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:04.242668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:04.242687Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:04.242690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:04.242694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:04.242701Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1060 [2:7555895378891974413:6960]
2025-09-30T14:53:04.242718Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:04.242733Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:04.242736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:04.242739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:04.242741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:04.242758Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:04.242771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:04.242779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:04.242844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.242852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.242855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.242858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:04.242860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:04.242933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:04.242941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.242956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.242977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.242997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:04.243016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895378981722120:4561], now have 1 active actors on pipe
2025-09-30T14:53:04.243025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895378981721973:2454], now have 1 active actors on pipe
2025-09-30T14:53:04.243033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895378891974408:6960]
2025-09-30T14:53:04.243041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895378891974408:6960]
2025-09-30T14:53:04.243044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895378891974408:6960]
2025-09-30T14:53:04.243057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:04.243072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:04.243075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:04.243082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:04.243065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1060
2025-09-30T14:53:04.243085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:04.243092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:04.243095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:04.243118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1060
2025-09-30T14:53:04.243129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895378891974408:6960]
2025-09-30T14:53:04.243143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:04.243144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:04.243188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:04.243197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:04.243225Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b953866-39a20132-80079392-759ff238_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:04.243240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:04.243269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:04.243272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:04.243282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:04.243297Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:04.243316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:04.243434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:04.243442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:04.243456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:04.243533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1061 partition: 0 MaxSeqNo: 42 sessionId: src_id|4b953866-39a20132-80079392-759ff238_0
2025-09-30T14:53:04.243971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd93caa8-e0bf32fc-836904db-c913ce5b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4b953866-39a20132-80079392-759ff238_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:04.246844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b953866-39a20132-80079392-759ff238_0] Write session: try to update token
2025-09-30T14:53:04.246868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b953866-39a20132-80079392-759ff238_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:04.255918Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:04.255945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:04.255948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:04.255950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:04.255961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895378891974408:6960]
2025-09-30T14:53:04.255966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895378891974408:6960]
2025-09-30T14:53:04.255971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895378891974408:6960]
2025-09-30T14:53:04.256016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:04.256021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:04.256027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:04.256032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:04.256031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.256035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:04.256228Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:04.263496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1061 sessionId: src_id|4b953866-39a20132-80079392-759ff238_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:04.266445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:04.319416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895378981722142:5026]
2025-09-30T14:53:04.319713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1060, pipe: [1:7555895378981722142:5026]
2025-09-30T14:53:04.373893Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:04.374379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:04.374396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:04.374417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895378981722142:5026], now have 1 active actors on pipe
2025-09-30T14:53:04.374691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:04.374707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:04.374721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895378981722142:5026]
2025-09-30T14:53:04.374778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1061 reason: error at write: Disconnected sessionId: src_id|4b953866-39a20132-80079392-759ff238_0
2025-09-30T14:53:04.374805Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:04.374835Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:04.374992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1061 sessionId: src_id|4b953866-39a20132-80079392-759ff238_0 is DEAD
2025-09-30T14:53:04.375333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b953866-39a20132-80079392-759ff238_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:04.375344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b953866-39a20132-80079392-759ff238_0] Write session will restart in 0.006513s
2025-09-30T14:53:04.375367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b953866-39a20132-80079392-759ff238_0] Write session: Do CDS request
2025-09-30T14:53:04.375372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b953866-39a20132-80079392-759ff238_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:04.382848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b953866-39a20132-80079392-759ff238_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:04.382912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:04.382937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1062
2025-09-30T14:53:04.383099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1062 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:04.383153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1062 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:04.383162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1062 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:04.383166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:04.383614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1062 sessionId:  describe result for acl check
2025-09-30T14:53:04.383649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:04.383656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:04.383658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:04.383665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895378981722174:4554] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:04.384202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895378981722174:4554] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:04.386653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895378981722174:4554] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:04.388259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:04.390688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:04.391029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895378981722174:4554] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:04.391047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895378981722174:4554] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:04.391051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895378981722174:4554] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:04.391061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1062 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:04.390928Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:04.390939Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:04.390950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:04.391006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:04.391041Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895378891974578:6972]
2025-09-30T14:53:04.391687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:04.391973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:04.392021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:04.392348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:04.392412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:04.392418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:04.392419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:04.392420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:04.392422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:04.392423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:04.392424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:04.392425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:04.392426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:04.392428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:04.392429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.392430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.392431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.392432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:04.392434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:04.392439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:04.392450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:04.392455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:04.392459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:04.392463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:04.392468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:04.392472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:04.392476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:04.392481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:04.392485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:04.392489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.392493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.392497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.392502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:04.392506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:04.392513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:04.392521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:04.392527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:04.392533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:04.392538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:04.392543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:04.392547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:04.392553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:04.392558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:04.392563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:04.392568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:04.392573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:04.392578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:04.392583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:04.392587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:04.392592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:04.392604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:04.392609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:04.392614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:04.392624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:04.392629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.392634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.392642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.392648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.392658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.392663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.392669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:04.392674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:04.392679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:04.392685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:04.392727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:04.398935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:04.400015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:04.400036Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:04.400039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:04.400043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:04.400050Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1061 [2:7555895378891974578:6972]
2025-09-30T14:53:04.400067Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:04.400099Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:04.400107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:04.400111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:04.400114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:04.400130Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:04.400137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:04.400144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:04.400210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.400218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.400220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.400224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:04.400227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:04.400297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:04.400305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.400318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.400331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.400354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:04.400378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895378891974573:6972]
2025-09-30T14:53:04.400385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895378891974573:6972]
2025-09-30T14:53:04.400388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895378891974573:6972]
2025-09-30T14:53:04.400397Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:04.400407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:04.400416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895378981722143:2454], now have 1 active actors on pipe
2025-09-30T14:53:04.400417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:04.400421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:04.400424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:04.400442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:04.400449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:04.400455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895378981722282:4554], now have 1 active actors on pipe
2025-09-30T14:53:04.400490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895378891974573:6972]
2025-09-30T14:53:04.400501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:04.400529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:04.400499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1061
2025-09-30T14:53:04.400504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1061
2025-09-30T14:53:04.400591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:04.400604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:04.400631Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2632cee-624c4ec5-775d4e16-fa2777d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:04.400644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:04.400648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:04.400651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:04.400661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:04.400675Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:04.400698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:04.400891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:04.400902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:04.400918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:04.401032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1062 partition: 0 MaxSeqNo: 42 sessionId: src_id|2632cee-624c4ec5-775d4e16-fa2777d8_0
2025-09-30T14:53:04.401496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b953866-39a20132-80079392-759ff238_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2632cee-624c4ec5-775d4e16-fa2777d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:04.404416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2632cee-624c4ec5-775d4e16-fa2777d8_0] Write session: try to update token
2025-09-30T14:53:04.404439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2632cee-624c4ec5-775d4e16-fa2777d8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:04.413056Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:04.413073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:04.413083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895378891974573:6972]
2025-09-30T14:53:04.413130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:04.413132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:04.413315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:04.413472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:04.413641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:04.413801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:04.414028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:04.414083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:04.420617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1062 sessionId: src_id|2632cee-624c4ec5-775d4e16-fa2777d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:04.423467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:04.424429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:04.424461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:04.424482Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:04.424485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:04.424488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:04.424490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:04.424500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895378891974573:6972]
2025-09-30T14:53:04.424505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895378891974573:6972]
2025-09-30T14:53:04.424509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895378891974573:6972]
2025-09-30T14:53:04.424561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:04.424565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:04.424571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:04.424573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.424575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:04.424576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:04.424716Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:04.474835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895378981722295:5026]
2025-09-30T14:53:04.475143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1061, pipe: [1:7555895378981722295:5026]
2025-09-30T14:53:04.553883Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:04.554451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:04.554492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895378981722295:5026], now have 1 active actors on pipe
2025-09-30T14:53:04.554603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:04.554656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895378981722295:5026]
2025-09-30T14:53:04.554680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:04.554705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:04.554708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:04.554773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1062 reason: error at write: Disconnected sessionId: src_id|2632cee-624c4ec5-775d4e16-fa2777d8_0
2025-09-30T14:53:04.554993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1062 sessionId: src_id|2632cee-624c4ec5-775d4e16-fa2777d8_0 is DEAD
2025-09-30T14:53:04.555163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2632cee-624c4ec5-775d4e16-fa2777d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:04.555174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2632cee-624c4ec5-775d4e16-fa2777d8_0] Write session will restart in 0.006661s
2025-09-30T14:53:04.555193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2632cee-624c4ec5-775d4e16-fa2777d8_0] Write session: Do CDS request
2025-09-30T14:53:04.555198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2632cee-624c4ec5-775d4e16-fa2777d8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:04.562852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2632cee-624c4ec5-775d4e16-fa2777d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:04.563010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:04.563027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1063
2025-09-30T14:53:04.563192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1063 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:04.563259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1063 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:04.563270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1063 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:04.563274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:04.563768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1063 sessionId:  describe result for acl check
2025-09-30T14:53:04.563808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:04.563816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:04.563818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:04.563824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895378981722358:4547] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:04.564388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895378981722358:4547] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:04.566119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895378981722358:4547] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:04.567276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:04.569040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:04.569201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895378981722358:4547] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:04.569218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895378981722358:4547] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:04.569222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895378981722358:4547] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:04.569230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1063 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:04.569254Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:04.569267Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:04.569279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:04.569354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:04.569394Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895378891974721:6974]
2025-09-30T14:53:04.570095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:04.570441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:04.570504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:04.570874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:04.570951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:04.570958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:04.570959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:04.570961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:04.570962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:04.570963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:04.570965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:04.570966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:04.570968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:04.570969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:04.570971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.570972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.570973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.570974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:04.570975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:04.570982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:04.570994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:04.570998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:04.571003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:04.571008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:04.571012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:04.571017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:04.571021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:04.571025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:04.571030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:04.571035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.571040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.571044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.571065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:04.571073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:04.571082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:04.571094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:04.571104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:04.571111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:04.571118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:04.571124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:04.571135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:04.571140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:04.571146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:04.571152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:04.571159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:04.571166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:04.571172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:04.571180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:04.571185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:04.571191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:04.571202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:04.571208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:04.571217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:04.571225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:04.571231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.571261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.571271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.571277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.571282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.571293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.571298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:04.571305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:04.571313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:04.571319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:04.571375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:04.577180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:04.578242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:04.578255Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:04.578258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:04.578261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:04.578267Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1062 [2:7555895378891974721:6974]
2025-09-30T14:53:04.578281Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:04.578295Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:04.578297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:04.578299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:04.578301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:04.578315Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:04.578320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:04.578326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:04.578391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.578403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.578406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.578410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:04.578413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:04.578484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:04.578492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.578505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.578521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.578543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:04.578561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895378981722440:4547], now have 1 active actors on pipe
2025-09-30T14:53:04.578570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895378981722299:2454], now have 1 active actors on pipe
2025-09-30T14:53:04.578578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895378891974716:6974]
2025-09-30T14:53:04.578584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895378891974716:6974]
2025-09-30T14:53:04.578586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895378891974716:6974]
2025-09-30T14:53:04.578603Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:04.578621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:04.578630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:04.578634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:04.578637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:04.578640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:04.578644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:04.578655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1062
2025-09-30T14:53:04.578682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895378891974716:6974]
2025-09-30T14:53:04.578658Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1062
2025-09-30T14:53:04.578694Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:04.578717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:04.578738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:04.578747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:04.578780Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b04a419-965a9f2b-5067b7fe-f877d663_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:04.578792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:04.578803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:04.578809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:04.578819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:04.578832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:04.578850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:04.578988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:04.578995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:04.579008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:04.579084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1063 partition: 0 MaxSeqNo: 42 sessionId: src_id|1b04a419-965a9f2b-5067b7fe-f877d663_0
2025-09-30T14:53:04.579492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2632cee-624c4ec5-775d4e16-fa2777d8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1b04a419-965a9f2b-5067b7fe-f877d663_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:04.582354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b04a419-965a9f2b-5067b7fe-f877d663_0] Write session: try to update token
2025-09-30T14:53:04.582370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b04a419-965a9f2b-5067b7fe-f877d663_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:04.591051Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:04.591071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:04.591073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:04.591075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:04.591085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895378891974716:6974]
2025-09-30T14:53:04.591094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895378891974716:6974]
2025-09-30T14:53:04.591100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895378891974716:6974]
2025-09-30T14:53:04.591145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:04.591149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:04.591156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:04.591158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.591160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:04.591163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:04.591351Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:04.597373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1063 sessionId: src_id|1b04a419-965a9f2b-5067b7fe-f877d663_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:04.600312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:04.655042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895378981722452:5026]
2025-09-30T14:53:04.655359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1062, pipe: [1:7555895378981722452:5026]
2025-09-30T14:53:04.701495Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:04.701869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:04.701884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:04.701923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895378981722452:5026], now have 1 active actors on pipe
2025-09-30T14:53:04.702106Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:04.702198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:04.702207Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:04.702214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:04.702266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895378981722452:5026]
2025-09-30T14:53:04.702276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1063 reason: error at write: Disconnected sessionId: src_id|1b04a419-965a9f2b-5067b7fe-f877d663_0
2025-09-30T14:53:04.702491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1063 sessionId: src_id|1b04a419-965a9f2b-5067b7fe-f877d663_0 is DEAD
2025-09-30T14:53:04.702637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b04a419-965a9f2b-5067b7fe-f877d663_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:04.702648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b04a419-965a9f2b-5067b7fe-f877d663_0] Write session will restart in 0.005198s
2025-09-30T14:53:04.702670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b04a419-965a9f2b-5067b7fe-f877d663_0] Write session: Do CDS request
2025-09-30T14:53:04.702676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b04a419-965a9f2b-5067b7fe-f877d663_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:04.708785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b04a419-965a9f2b-5067b7fe-f877d663_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:04.708878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:04.708896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1064
2025-09-30T14:53:04.709031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1064 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:04.709061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1064 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:04.709071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1064 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:04.709075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:04.709463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1064 sessionId:  describe result for acl check
2025-09-30T14:53:04.709497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:04.709499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:04.709500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:04.709506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895378981722473:4537] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:04.710052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895378981722473:4537] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:04.712377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895378981722473:4537] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:04.714224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:04.714482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895378981722473:4537] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:04.714507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895378981722473:4537] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:04.714511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895378981722473:4537] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:04.714519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1064 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:04.716153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:04.716359Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:04.716370Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:04.716381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:04.716440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:04.716482Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895378891974868:6977]
2025-09-30T14:53:04.717050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:04.717316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:04.717348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:04.717624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:04.717672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:04.717677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:04.717678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:04.717679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:04.717681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:04.717682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:04.717683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:04.717684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:04.717686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:04.717687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:04.717688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.717690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.717691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.717692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:04.717693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:04.717698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:04.717708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:04.717712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:04.717717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:04.717721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:04.717725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:04.717729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:04.717733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:04.717737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:04.717741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:04.717746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.717750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.717754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.717758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:04.717762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:04.717770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:04.717780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:04.717787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:04.717791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:04.717798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:04.717801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:04.717804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:04.717807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:04.717812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:04.717815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:04.717826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:04.717833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:04.717835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:04.717839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:04.717845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:04.717848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:04.717851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:04.717854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:04.717859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:04.717863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:04.717867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.717873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.717876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.717879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.717882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.717889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.717891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:04.717894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:04.717896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:04.717900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:04.717926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:04.723406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:04.724314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:04.724331Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:04.724335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:04.724339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:04.724345Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1063 [2:7555895378891974868:6977]
2025-09-30T14:53:04.724362Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:04.724385Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:04.724392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:04.724395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:04.724398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:04.724416Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:04.724428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:04.724440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:04.724716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.724724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.724727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.724731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:04.724734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:04.724805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:04.724814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.724827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.724840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.724858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:04.724883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895378981722595:4537], now have 1 active actors on pipe
2025-09-30T14:53:04.724889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895378981722453:2454], now have 1 active actors on pipe
2025-09-30T14:53:04.724897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895378891974862:6977]
2025-09-30T14:53:04.724903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895378891974862:6977]
2025-09-30T14:53:04.724906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895378891974862:6977]
2025-09-30T14:53:04.724918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:04.724939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:04.724948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:04.724951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:04.724953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:04.724957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:04.724960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:04.724995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895378891974862:6977]
2025-09-30T14:53:04.724958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1063
2025-09-30T14:53:04.725006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:04.725009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:04.724972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1063
2025-09-30T14:53:04.725039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:04.725044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:04.725076Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a39607e-38734e5f-1c721419-e4fea0fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:04.725090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:04.725094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:04.725101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:04.725111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:04.725124Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:04.725145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:04.725261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:04.725268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:04.725280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:04.725361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1064 partition: 0 MaxSeqNo: 42 sessionId: src_id|5a39607e-38734e5f-1c721419-e4fea0fc_0
2025-09-30T14:53:04.725780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b04a419-965a9f2b-5067b7fe-f877d663_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5a39607e-38734e5f-1c721419-e4fea0fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:04.728545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a39607e-38734e5f-1c721419-e4fea0fc_0] Write session: try to update token
2025-09-30T14:53:04.728563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a39607e-38734e5f-1c721419-e4fea0fc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:04.737108Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:04.737125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:04.737127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:04.737130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:04.737139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895378891974862:6977]
2025-09-30T14:53:04.737144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895378891974862:6977]
2025-09-30T14:53:04.737148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895378891974862:6977]
2025-09-30T14:53:04.737186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:04.737189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:04.737197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.737200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:04.737202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:04.737205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:04.737355Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:04.743592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1064 sessionId: src_id|5a39607e-38734e5f-1c721419-e4fea0fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:04.746505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:04.802515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895378981722607:5026]
2025-09-30T14:53:04.802754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1063, pipe: [1:7555895378981722607:5026]
2025-09-30T14:53:04.847554Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:04.847863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:04.847875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:04.847908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895378981722607:5026], now have 1 active actors on pipe
2025-09-30T14:53:04.848126Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:04.848135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895378981722607:5026]
2025-09-30T14:53:04.848138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:04.848141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:04.848174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:04.848219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1064 reason: error at write: Disconnected sessionId: src_id|5a39607e-38734e5f-1c721419-e4fea0fc_0
2025-09-30T14:53:04.848431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1064 sessionId: src_id|5a39607e-38734e5f-1c721419-e4fea0fc_0 is DEAD
2025-09-30T14:53:04.848579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a39607e-38734e5f-1c721419-e4fea0fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:04.848588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a39607e-38734e5f-1c721419-e4fea0fc_0] Write session will restart in 0.007603s
2025-09-30T14:53:04.848612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a39607e-38734e5f-1c721419-e4fea0fc_0] Write session: Do CDS request
2025-09-30T14:53:04.848619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a39607e-38734e5f-1c721419-e4fea0fc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:04.857813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a39607e-38734e5f-1c721419-e4fea0fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:04.857869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:04.857887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1065
2025-09-30T14:53:04.858040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1065 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:04.858083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1065 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:04.858093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1065 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:04.858098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:04.858561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1065 sessionId:  describe result for acl check
2025-09-30T14:53:04.858590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:04.858596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:04.858598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:04.858604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895378981722714:4531] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:04.859117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895378981722714:4531] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:04.859300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:04.861099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895378981722714:4531] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:04.861441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:04.861644Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:04.861654Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:04.861665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:04.861717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:04.861754Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895378891975012:6979]
2025-09-30T14:53:04.862401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:04.862698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:04.862732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:04.863031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:04.863101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:04.863107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:04.863108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:04.863109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:04.863110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:04.863111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:04.863112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:04.863113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:04.863115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:04.863116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:04.863117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.863118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.863119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.863120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:04.863121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:04.863127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:04.863137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:04.863142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:04.863146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:04.863150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:04.863155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:04.863159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:04.863163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:04.863166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:04.863170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:04.863174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.863178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.863181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.863186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:04.863190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:04.863199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:04.863207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:04.863213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:04.863219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:04.863224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:04.863229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:04.863234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:04.863256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:04.863261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:04.863267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:04.863271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:04.863277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:04.863287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:04.863292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:04.863297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:04.863307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:04.863312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:04.863317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:04.863326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:04.863333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:04.863341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.863344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.863347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.863352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.863357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.863366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.863370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:04.863375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:04.863385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:04.863391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:04.863430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:04.863606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895378981722714:4531] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:04.863619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895378981722714:4531] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:04.863623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895378981722714:4531] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:04.863632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1065 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:04.868695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:04.869580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:04.869597Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:04.869601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:04.869605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:04.869612Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1064 [2:7555895378891975012:6979]
2025-09-30T14:53:04.869629Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:04.869653Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:04.869656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:04.869659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:04.869662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:04.869677Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:04.869684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:04.869691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:04.869749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.869757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.869759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.869763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:04.869766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:04.869835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:04.869843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.869856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:04.869874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:04.869897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:04.869919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895378981722608:2454], now have 1 active actors on pipe
2025-09-30T14:53:04.869927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895378981722755:4531], now have 1 active actors on pipe
2025-09-30T14:53:04.869933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895378891975006:6979]
2025-09-30T14:53:04.869940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895378891975006:6979]
2025-09-30T14:53:04.869943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895378891975006:6979]
2025-09-30T14:53:04.869956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:04.869974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:04.869984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1064
2025-09-30T14:53:04.869997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:04.870027Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1064
2025-09-30T14:53:04.870008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:04.870040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895378891975006:6979]
2025-09-30T14:53:04.870043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:04.870046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:04.870050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:04.870052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:04.870058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:04.870059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:04.870064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:04.870115Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36be1b69-1aae30ce-8e48b4a5-261e7609_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:04.870127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:04.870136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:04.870138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:04.870162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:04.870176Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:04.870206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:04.870354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:04.870366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:04.870381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:04.870454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1065 partition: 0 MaxSeqNo: 42 sessionId: src_id|36be1b69-1aae30ce-8e48b4a5-261e7609_0
2025-09-30T14:53:04.870877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a39607e-38734e5f-1c721419-e4fea0fc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|36be1b69-1aae30ce-8e48b4a5-261e7609_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:04.873806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36be1b69-1aae30ce-8e48b4a5-261e7609_0] Write session: try to update token
2025-09-30T14:53:04.873827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36be1b69-1aae30ce-8e48b4a5-261e7609_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:04.882359Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:04.882384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:04.882387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:04.882389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:04.882399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895378891975006:6979]
2025-09-30T14:53:04.882404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895378891975006:6979]
2025-09-30T14:53:04.882412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895378891975006:6979]
2025-09-30T14:53:04.882453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:04.882468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:04.882471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:04.882478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:04.882484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:04.882489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:04.882613Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:04.888549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1065 sessionId: src_id|36be1b69-1aae30ce-8e48b4a5-261e7609_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:04.891401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:04.948407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895378981722762:5026]
2025-09-30T14:53:04.948651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1064, pipe: [1:7555895378981722762:5026]
2025-09-30T14:53:04.997260Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:04.997730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:04.997745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:04.997784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895378981722762:5026], now have 1 active actors on pipe
2025-09-30T14:53:04.997990Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:04.997987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:04.997991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:04.997996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:04.998041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895378981722762:5026]
2025-09-30T14:53:04.998060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1065 reason: error at write: Disconnected sessionId: src_id|36be1b69-1aae30ce-8e48b4a5-261e7609_0
2025-09-30T14:53:04.998290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1065 sessionId: src_id|36be1b69-1aae30ce-8e48b4a5-261e7609_0 is DEAD
2025-09-30T14:53:04.998447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36be1b69-1aae30ce-8e48b4a5-261e7609_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:04.998457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36be1b69-1aae30ce-8e48b4a5-261e7609_0] Write session will restart in 0.005949s
2025-09-30T14:53:04.998479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36be1b69-1aae30ce-8e48b4a5-261e7609_0] Write session: Do CDS request
2025-09-30T14:53:04.998486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36be1b69-1aae30ce-8e48b4a5-261e7609_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:05.005811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36be1b69-1aae30ce-8e48b4a5-261e7609_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:05.005921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:05.005939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1066
2025-09-30T14:53:05.006071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1066 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:05.006115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1066 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:05.006125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1066 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:05.006129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:05.006602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1066 sessionId:  describe result for acl check
2025-09-30T14:53:05.006636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:05.006642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:05.006644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:05.006649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895383276690128:4527] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:05.007158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895383276690128:4527] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:05.009074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:05.009139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895383276690128:4527] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:05.011022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:05.011259Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:05.011270Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:05.011282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:05.011340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:05.011388Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895383186942454:6981]
2025-09-30T14:53:05.011571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895383276690128:4527] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:05.011584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895383276690128:4527] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:05.011587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895383276690128:4527] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:05.011607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1066 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:05.011999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:05.012269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:05.012303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:05.012524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:05.012572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:05.012585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:05.012586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:05.012587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:05.012589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:05.012590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:05.012591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:05.012592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:05.012594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:05.012595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:05.012596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.012597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.012598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.012599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:05.012600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:05.012606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:05.012616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:05.012620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:05.012624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:05.012628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:05.012632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:05.012636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:05.012639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:05.012644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:05.012649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:05.012653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.012656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.012660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.012663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:05.012667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:05.012674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:05.012683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:05.012689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:05.012693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:05.012696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:05.012699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:05.012702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:05.012705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:05.012708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:05.012711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:05.012713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:05.012717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:05.012720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:05.012724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:05.012726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:05.012729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:05.012732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:05.012735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:05.012737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:05.012740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:05.012743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.012747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.012749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.012753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.012755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.012758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.012760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:05.012763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:05.012767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:05.012770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:05.012794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:05.017962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:05.018883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:05.018900Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:05.018901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:05.018905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:05.018911Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1065 [2:7555895383186942454:6981]
2025-09-30T14:53:05.018923Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:05.018936Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:05.018938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:05.018941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:05.018943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:05.018955Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:05.018960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:05.018966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:05.019011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.019017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.019019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.019021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:05.019024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:05.019079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:05.019086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.019098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.019110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.019133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:05.019151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895383276690204:4527], now have 1 active actors on pipe
2025-09-30T14:53:05.019157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895378981722764:2454], now have 1 active actors on pipe
2025-09-30T14:53:05.019163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895383186942448:6981]
2025-09-30T14:53:05.019165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895383186942448:6981]
2025-09-30T14:53:05.019167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895383186942448:6981]
2025-09-30T14:53:05.019179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:05.019193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:05.019198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:05.019211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:05.019213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:05.019214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:05.019216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:05.019270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895383186942448:6981]
2025-09-30T14:53:05.019287Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:05.019287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1065
2025-09-30T14:53:05.019319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:05.019288Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1065
2025-09-30T14:53:05.019412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:05.019421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:05.019442Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|957216f6-83ceea2-1a562ae9-98b56be3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:05.019452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:05.019455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:05.019456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:05.019463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:05.019471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:05.019482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:05.019626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:05.019635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:05.019647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:05.019725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1066 partition: 0 MaxSeqNo: 42 sessionId: src_id|957216f6-83ceea2-1a562ae9-98b56be3_0
2025-09-30T14:53:05.020139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36be1b69-1aae30ce-8e48b4a5-261e7609_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|957216f6-83ceea2-1a562ae9-98b56be3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:05.022839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|957216f6-83ceea2-1a562ae9-98b56be3_0] Write session: try to update token
2025-09-30T14:53:05.022857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|957216f6-83ceea2-1a562ae9-98b56be3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:05.031349Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:05.031373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:05.031376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:05.031378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:05.031393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895383186942448:6981]
2025-09-30T14:53:05.031397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895383186942448:6981]
2025-09-30T14:53:05.031401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895383186942448:6981]
2025-09-30T14:53:05.031440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:05.031447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.031450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:05.031452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:05.031459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:05.031467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:05.031594Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:05.036885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1066 sessionId: src_id|957216f6-83ceea2-1a562ae9-98b56be3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:05.039711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:05.098434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895383276690223:5026]
2025-09-30T14:53:05.098738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1065, pipe: [1:7555895383276690223:5026]
2025-09-30T14:53:05.139690Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:05.139949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:05.139960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:05.139994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895383276690223:5026], now have 1 active actors on pipe
2025-09-30T14:53:05.140196Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:05.140269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895383276690223:5026]
2025-09-30T14:53:05.140283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:05.140300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:05.140363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1066 reason: status is not ok: tablet will be restarted right now sessionId: src_id|957216f6-83ceea2-1a562ae9-98b56be3_0
2025-09-30T14:53:05.140599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1066 sessionId: src_id|957216f6-83ceea2-1a562ae9-98b56be3_0 is DEAD
2025-09-30T14:53:05.140795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|957216f6-83ceea2-1a562ae9-98b56be3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:05.140807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|957216f6-83ceea2-1a562ae9-98b56be3_0] Write session will restart in 0.009579s
2025-09-30T14:53:05.140831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|957216f6-83ceea2-1a562ae9-98b56be3_0] Write session: Do CDS request
2025-09-30T14:53:05.140839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|957216f6-83ceea2-1a562ae9-98b56be3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:05.151786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|957216f6-83ceea2-1a562ae9-98b56be3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:05.151887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:05.151903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1067
2025-09-30T14:53:05.152027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1067 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:05.152060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1067 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:05.152069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1067 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:05.152073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:05.152534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1067 sessionId:  describe result for acl check
2025-09-30T14:53:05.152569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:05.152576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:05.152577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:05.152585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895383276690347:4522] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:05.152836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:05.153107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895383276690347:4522] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:05.154675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:05.154882Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:05.154894Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:05.154905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:05.154961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:05.155002Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895383186942615:6985]
2025-09-30T14:53:05.155125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895383276690347:4522] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:05.155668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:05.155980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:05.156030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:05.156360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:05.156437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:05.156444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:05.156445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:05.156446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:05.156448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:05.156450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:05.156451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:05.156452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:05.156454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:05.156455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:05.156456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.156457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.156459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.156460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:05.156461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:05.156467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:05.156477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:05.156481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:05.156486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:05.156490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:05.156494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:05.156498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:05.156503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:05.156507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:05.156512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:05.156516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.156526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.156530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.156534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:05.156538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:05.156547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:05.156560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:05.156572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:05.156578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:05.156583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:05.156589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:05.156594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:05.156600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:05.156610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:05.156621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:05.156631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:05.156642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:05.156652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:05.156657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:05.156667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:05.156674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:05.156679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:05.156688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:05.156694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:05.156702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:05.156712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.156719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.156729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.156737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.156747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.156753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.156763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:05.156769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:05.156778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:05.156788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:05.156841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:05.157469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895383276690347:4522] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:05.157481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895383276690347:4522] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:05.157485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895383276690347:4522] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:05.157493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1067 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:05.162562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:05.163508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:05.163527Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:05.163530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:05.163534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:05.163541Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1066 [2:7555895383186942615:6985]
2025-09-30T14:53:05.163558Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:05.163573Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:05.163577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:05.163580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:05.163582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:05.163599Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:05.163612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:05.163620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:05.163702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.163716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.163718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.163722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:05.163725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:05.163797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:05.163805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.163819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.163834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.163858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:05.163882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895383276690386:4522], now have 1 active actors on pipe
2025-09-30T14:53:05.163890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895383276690237:2454], now have 1 active actors on pipe
2025-09-30T14:53:05.163897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895383186942610:6985]
2025-09-30T14:53:05.163899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895383186942610:6985]
2025-09-30T14:53:05.163902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895383186942610:6985]
2025-09-30T14:53:05.163918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:05.163937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:05.163948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:05.163955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:05.163958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:05.163958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:05.163960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:05.163992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895383186942610:6985]
2025-09-30T14:53:05.164000Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:05.164007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:05.163984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1066
2025-09-30T14:53:05.163983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1066
2025-09-30T14:53:05.164039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:05.164048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:05.164080Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7544ab2-1d08b186-b604201b-a3c885bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:05.164091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:05.164100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:05.164102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:05.164114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:05.164128Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:05.164142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:05.164293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:05.164302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:05.164315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:05.164400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1067 partition: 0 MaxSeqNo: 42 sessionId: src_id|a7544ab2-1d08b186-b604201b-a3c885bf_0
2025-09-30T14:53:05.164808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|957216f6-83ceea2-1a562ae9-98b56be3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a7544ab2-1d08b186-b604201b-a3c885bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:05.167679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7544ab2-1d08b186-b604201b-a3c885bf_0] Write session: try to update token
2025-09-30T14:53:05.167696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7544ab2-1d08b186-b604201b-a3c885bf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:05.175971Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:05.175993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:05.175995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:05.175998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:05.176007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895383186942610:6985]
2025-09-30T14:53:05.176012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895383186942610:6985]
2025-09-30T14:53:05.176019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895383186942610:6985]
2025-09-30T14:53:05.176077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:05.176080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:05.176088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:05.176089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.176092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:05.176093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:05.176239Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:05.182968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1067 sessionId: src_id|a7544ab2-1d08b186-b604201b-a3c885bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:05.185946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:05.240272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895383276690393:5026]
2025-09-30T14:53:05.240598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1066, pipe: [1:7555895383276690393:5026]
2025-09-30T14:53:05.290125Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:05.290434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:05.290453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:05.290472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895383276690393:5026], now have 1 active actors on pipe
2025-09-30T14:53:05.290640Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:05.290792Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:05.290858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895383276690393:5026]
2025-09-30T14:53:05.290878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:05.290953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1067 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a7544ab2-1d08b186-b604201b-a3c885bf_0
2025-09-30T14:53:05.291170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1067 sessionId: src_id|a7544ab2-1d08b186-b604201b-a3c885bf_0 is DEAD
2025-09-30T14:53:05.291342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7544ab2-1d08b186-b604201b-a3c885bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:05.291351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7544ab2-1d08b186-b604201b-a3c885bf_0] Write session will restart in 0.006603s
2025-09-30T14:53:05.291375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7544ab2-1d08b186-b604201b-a3c885bf_0] Write session: Do CDS request
2025-09-30T14:53:05.291381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7544ab2-1d08b186-b604201b-a3c885bf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:05.298865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7544ab2-1d08b186-b604201b-a3c885bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:05.298956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:05.298971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1068
2025-09-30T14:53:05.299124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1068 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:05.299167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1068 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:05.299171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1068 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:05.299176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:05.299580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1068 sessionId:  describe result for acl check
2025-09-30T14:53:05.299614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:05.299616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:05.299618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:05.299623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895383276690420:4503] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:05.300151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895383276690420:4503] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:05.302665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895383276690420:4503] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:05.305593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895383276690420:4503] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:05.305611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895383276690420:4503] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:05.305614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895383276690420:4503] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:05.305622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1068 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:05.306437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:05.308701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:05.308919Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:05.308931Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:05.308943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:05.309006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:05.309051Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895383186942777:6993]
2025-09-30T14:53:05.309752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:05.310105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:05.310173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:05.310520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:05.310601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:05.310609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:05.310610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:05.310612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:05.310613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:05.310614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:05.310616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:05.310617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:05.310619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:05.310621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:05.310622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.310623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.310624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.310625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:05.310626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:05.310632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:05.310643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:05.310647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:05.310651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:05.310655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:05.310659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:05.310663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:05.310668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:05.310672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:05.310677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:05.310681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.310685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.310689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.310693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:05.310698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:05.310706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:05.310714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:05.310721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:05.310728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:05.310733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:05.310740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:05.310745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:05.310751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:05.310756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:05.310762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:05.310767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:05.310773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:05.310786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:05.310792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:05.310797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:05.310803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:05.310809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:05.310814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:05.310818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:05.310824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:05.310830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.310837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.310842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.310854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.310863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.310869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.310874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:05.310885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:05.310891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:05.310897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:05.310953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:05.317046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:05.317968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:05.317987Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:05.317989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:05.317994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:05.318001Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1067 [2:7555895383186942777:6993]
2025-09-30T14:53:05.318017Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:05.318032Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:05.318040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:05.318044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:05.318046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:05.318066Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:05.318078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:05.318085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:05.318375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.318385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.318388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.318391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:05.318393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:05.318466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:05.318473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.318488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.318501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.318524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:05.318548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895383186942772:6993]
2025-09-30T14:53:05.318555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895383186942772:6993]
2025-09-30T14:53:05.318557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895383186942772:6993]
2025-09-30T14:53:05.318570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:05.318585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895383276690407:2454], now have 1 active actors on pipe
2025-09-30T14:53:05.318592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:05.318593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895383276690551:4503], now have 1 active actors on pipe
2025-09-30T14:53:05.318595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:05.318598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:05.318602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:05.318617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:05.318620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:05.318661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895383186942772:6993]
2025-09-30T14:53:05.318675Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:05.318644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1067
2025-09-30T14:53:05.318695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1067
2025-09-30T14:53:05.318690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:05.318711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:05.318716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:05.318742Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51f107f9-21ad88be-4c252c03-21c6930d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:05.318751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:05.318755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:05.318757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:05.318770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:05.318781Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:05.318796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:05.318932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:05.318946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:05.318965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:05.319097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1068 partition: 0 MaxSeqNo: 42 sessionId: src_id|51f107f9-21ad88be-4c252c03-21c6930d_0
2025-09-30T14:53:05.319558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7544ab2-1d08b186-b604201b-a3c885bf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|51f107f9-21ad88be-4c252c03-21c6930d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:05.322684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51f107f9-21ad88be-4c252c03-21c6930d_0] Write session: try to update token
2025-09-30T14:53:05.322709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51f107f9-21ad88be-4c252c03-21c6930d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:05.331595Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:05.331619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:05.331631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895383186942772:6993]
2025-09-30T14:53:05.331679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:05.331732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:05.331864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:05.332018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:05.332172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:05.332324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:05.332694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:05.332738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:05.339577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1068 sessionId: src_id|51f107f9-21ad88be-4c252c03-21c6930d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:05.342523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:05.342777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:05.342805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:05.342826Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:05.342829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:05.342831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:05.342833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:05.342841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895383186942772:6993]
2025-09-30T14:53:05.342855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895383186942772:6993]
2025-09-30T14:53:05.342859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895383186942772:6993]
2025-09-30T14:53:05.342902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:05.342911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:05.342917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.342918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:05.342920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:05.342922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:05.343066Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:05.390796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895383276690574:5026]
2025-09-30T14:53:05.391069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1067, pipe: [1:7555895383276690574:5026]
2025-09-30T14:53:05.454588Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:05.454916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:05.454956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895383276690574:5026], now have 1 active actors on pipe
2025-09-30T14:53:05.455079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:05.455177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:05.455189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:05.455285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1068 reason: error at write: Disconnected sessionId: src_id|51f107f9-21ad88be-4c252c03-21c6930d_0
2025-09-30T14:53:05.455455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1068 sessionId: src_id|51f107f9-21ad88be-4c252c03-21c6930d_0 is DEAD
2025-09-30T14:53:05.455532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895383276690574:5026]
2025-09-30T14:53:05.455568Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:05.455637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51f107f9-21ad88be-4c252c03-21c6930d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:05.455648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51f107f9-21ad88be-4c252c03-21c6930d_0] Write session will restart in 0.009523s
2025-09-30T14:53:05.455676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51f107f9-21ad88be-4c252c03-21c6930d_0] Write session: Do CDS request
2025-09-30T14:53:05.455683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51f107f9-21ad88be-4c252c03-21c6930d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:05.466864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51f107f9-21ad88be-4c252c03-21c6930d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:05.466946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:05.466960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1069
2025-09-30T14:53:05.467118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1069 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:05.467176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1069 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:05.467189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1069 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:05.467193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:05.467649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1069 sessionId:  describe result for acl check
2025-09-30T14:53:05.467687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:05.467694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:05.467696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:05.467702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895383276690685:4499] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:05.468309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895383276690685:4499] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:05.470782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895383276690685:4499] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:05.476062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:05.477906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:05.477959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895383276690685:4499] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:05.477974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895383276690685:4499] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:05.477978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895383276690685:4499] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:05.477986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1069 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:05.478200Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:05.478213Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:05.478227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:05.478325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:05.478374Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895383186942949:7001]
2025-09-30T14:53:05.479020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:05.479423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:05.479486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:05.480104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:05.480204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:05.480212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:05.480213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:05.480215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:05.480217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:05.480218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:05.480220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:05.480221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:05.480222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:05.480224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:05.480225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.480226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.480227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.480229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:05.480230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:05.480237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:05.480249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:05.480254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:05.480258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:05.480262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:05.480266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:05.480270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:05.480275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:05.480279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:05.480283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:05.480288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.480293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.480297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.480301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:05.480306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:05.480314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:05.480323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:05.480331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:05.480337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:05.480342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:05.480349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:05.480353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:05.480359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:05.480365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:05.480371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:05.480376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:05.480382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:05.480387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:05.480393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:05.480397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:05.480403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:05.480414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:05.480420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:05.480430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:05.480436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:05.480447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.480452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.480457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.480463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.480468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.480474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.480483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:05.480488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:05.480497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:05.480506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:05.480551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:05.486327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:05.487482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:05.487506Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:05.487509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:05.487513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:05.487520Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1068 [2:7555895383186942949:7001]
2025-09-30T14:53:05.487537Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:05.487552Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:05.487555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:05.487558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:05.487561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:05.487579Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:05.487586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:05.487600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:05.487668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.487677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.487679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.487682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:05.487684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:05.487750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:05.487761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.487774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.487785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.487802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:05.487826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895383276690723:4499], now have 1 active actors on pipe
2025-09-30T14:53:05.487835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895383276690575:2454], now have 1 active actors on pipe
2025-09-30T14:53:05.487841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895383186942944:7001]
2025-09-30T14:53:05.487843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895383186942944:7001]
2025-09-30T14:53:05.487846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895383186942944:7001]
2025-09-30T14:53:05.487858Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:05.487872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:05.487871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:05.487874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:05.487876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:05.487891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:05.487895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:05.487865Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1068
2025-09-30T14:53:05.487873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1068
2025-09-30T14:53:05.487941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:05.487950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:05.487963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895383186942944:7001]
2025-09-30T14:53:05.487975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:05.487981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:05.488013Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8b401ac-4e7e40f6-c050e98b-2a5e71ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:05.488026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:05.488037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:05.488039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:05.488049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:05.488063Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:05.488160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:05.488323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:05.488333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:05.488350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:05.488437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1069 partition: 0 MaxSeqNo: 42 sessionId: src_id|e8b401ac-4e7e40f6-c050e98b-2a5e71ab_0
2025-09-30T14:53:05.488851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51f107f9-21ad88be-4c252c03-21c6930d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e8b401ac-4e7e40f6-c050e98b-2a5e71ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:05.491679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8b401ac-4e7e40f6-c050e98b-2a5e71ab_0] Write session: try to update token
2025-09-30T14:53:05.491698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8b401ac-4e7e40f6-c050e98b-2a5e71ab_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:05.500360Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:05.500389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:05.500391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:05.500394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:05.500403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895383186942944:7001]
2025-09-30T14:53:05.500411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895383186942944:7001]
2025-09-30T14:53:05.500415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895383186942944:7001]
2025-09-30T14:53:05.500455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:05.500463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.500472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:05.500490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:05.500507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:05.500512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:05.500618Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:05.509555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1069 sessionId: src_id|e8b401ac-4e7e40f6-c050e98b-2a5e71ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:05.513247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:05.555640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895383276690737:5026]
2025-09-30T14:53:05.555988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1068, pipe: [1:7555895383276690737:5026]
2025-09-30T14:53:05.614992Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:05.615347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:05.615369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:05.615395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895383276690737:5026], now have 1 active actors on pipe
2025-09-30T14:53:05.615641Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:05.615726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:05.615740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:05.615808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1069 reason: error at write: Disconnected sessionId: src_id|e8b401ac-4e7e40f6-c050e98b-2a5e71ab_0
2025-09-30T14:53:05.615846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:05.615886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895383276690737:5026]
2025-09-30T14:53:05.616080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1069 sessionId: src_id|e8b401ac-4e7e40f6-c050e98b-2a5e71ab_0 is DEAD
2025-09-30T14:53:05.616385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8b401ac-4e7e40f6-c050e98b-2a5e71ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:05.616402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8b401ac-4e7e40f6-c050e98b-2a5e71ab_0] Write session will restart in 0.009509s
2025-09-30T14:53:05.616444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8b401ac-4e7e40f6-c050e98b-2a5e71ab_0] Write session: Do CDS request
2025-09-30T14:53:05.616453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8b401ac-4e7e40f6-c050e98b-2a5e71ab_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:05.627009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8b401ac-4e7e40f6-c050e98b-2a5e71ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:05.627229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:05.627262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1070
2025-09-30T14:53:05.627403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1070 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:05.627448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1070 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:05.627458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1070 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:05.627463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:05.627872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1070 sessionId:  describe result for acl check
2025-09-30T14:53:05.627904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:05.627906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:05.627908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:05.627914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895383276690851:4492] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:05.628008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:05.628472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895383276690851:4492] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:05.629977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:05.630197Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:05.630209Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:05.630219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:05.630275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:05.630317Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895383186943102:7004]
2025-09-30T14:53:05.630787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895383276690851:4492] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:05.630978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:05.631301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:05.631347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:05.631696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:05.631769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:05.631775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:05.631776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:05.631777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:05.631779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:05.631780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:05.631781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:05.631782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:05.631783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:05.631784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:05.631786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.631787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.631788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.631789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:05.631790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:05.631796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:05.631805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:05.631809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:05.631813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:05.631816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:05.631820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:05.631823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:05.631827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:05.631830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:05.631834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:05.631837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.631840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.631843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.631847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:05.631851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:05.631858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:05.631866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:05.631872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:05.631878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:05.631882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:05.631887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:05.631892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:05.631898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:05.631903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:05.631909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:05.631914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:05.631919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:05.631926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:05.631930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:05.631935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:05.631941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:05.631946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:05.631953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:05.631959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:05.631979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:05.631994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.632000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.632005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.632010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.632016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.632021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.632026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:05.632032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:05.632037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:05.632043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:05.632091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:05.637399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895383276690851:4492] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:05.637418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895383276690851:4492] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:05.637421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895383276690851:4492] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:05.637431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1070 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:05.637788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:05.638663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:05.638677Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:05.638680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:05.638685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:05.638692Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1069 [2:7555895383186943102:7004]
2025-09-30T14:53:05.638708Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:05.638723Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:05.638731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:05.638734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:05.638737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:05.638751Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:05.638758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:05.638764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:05.638824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.638831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.638834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.638837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:05.638840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:05.638903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:05.638910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.638921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.638933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.638953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:05.638975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895383276690738:2454], now have 1 active actors on pipe
2025-09-30T14:53:05.638986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895383276690891:4492], now have 1 active actors on pipe
2025-09-30T14:53:05.638992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895383186943096:7004]
2025-09-30T14:53:05.638994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895383186943096:7004]
2025-09-30T14:53:05.638997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895383186943096:7004]
2025-09-30T14:53:05.639008Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:05.639017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:05.639020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:05.639021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:05.639022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:05.639035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:05.639039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:05.639071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895383186943096:7004]
2025-09-30T14:53:05.639054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1069
2025-09-30T14:53:05.639080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:05.639055Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1069
2025-09-30T14:53:05.639102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:05.639113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:05.639118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:05.639146Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eaede9e1-f27244f1-b630a237-d1949cc0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:05.639160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:05.639164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:05.639166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:05.639177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:05.639187Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:05.639202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:05.639442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:05.639453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:05.639471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:05.639575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1070 partition: 0 MaxSeqNo: 42 sessionId: src_id|eaede9e1-f27244f1-b630a237-d1949cc0_0
2025-09-30T14:53:05.640012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8b401ac-4e7e40f6-c050e98b-2a5e71ab_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|eaede9e1-f27244f1-b630a237-d1949cc0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:05.642877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaede9e1-f27244f1-b630a237-d1949cc0_0] Write session: try to update token
2025-09-30T14:53:05.642896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaede9e1-f27244f1-b630a237-d1949cc0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:05.656750Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:05.656772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:05.656782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895383186943096:7004]
2025-09-30T14:53:05.656833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:05.656834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:05.657033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:05.657194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:05.657341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:05.657499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:05.657703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:05.657754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:05.657878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1070 sessionId: src_id|eaede9e1-f27244f1-b630a237-d1949cc0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:05.660648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:05.660778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:05.660798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:05.662007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:05.662046Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:05.662054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:05.662057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:05.662059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:05.662068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895383186943096:7004]
2025-09-30T14:53:05.662073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895383186943096:7004]
2025-09-30T14:53:05.662078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895383186943096:7004]
2025-09-30T14:53:05.662100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:05.662108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:05.662115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.662118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:05.662123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:05.662127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:05.662170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:05.662268Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:05.715925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895383276690898:5026]
2025-09-30T14:53:05.716245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1069, pipe: [1:7555895383276690898:5026]
2025-09-30T14:53:05.775598Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:05.783903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:05.783940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:05.784110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:05.784170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:05.784228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:05.784289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:05.784339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:05.784352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:05.784421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:05.784485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:05.784544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:05.784629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:05.784674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:05.784680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:05.784745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:05.784807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:05.784874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:05.784936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:05.784984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:05.784993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:05.785059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:05.785125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:05.785187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:05.785247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:05.785289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:05.785295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:05.785367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:05.785430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:05.785497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:05.785566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:05.785614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:05.785622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:05.785688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:05.785752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:05.785812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:05.785879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:05.785931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:05.785938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:05.786010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:05.786073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:05.786138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:05.786217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:05.786262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:05.786271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:05.786341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:05.786407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:05.786474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:05.786540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:05.786586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:05.786593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:05.786667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:05.786735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:05.786801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:05.786868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:05.786912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:05.786921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:05.786987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:05.787046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:05.787113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:05.787178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:05.787227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:05.787234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:05.787314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895383276690898:5026], now have 1 active actors on pipe
2025-09-30T14:53:05.787553Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:05.787598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895383276690898:5026]
2025-09-30T14:53:05.787612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:05.787614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:05.787644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1070 reason: error at write: Disconnected sessionId: src_id|eaede9e1-f27244f1-b630a237-d1949cc0_0
2025-09-30T14:53:05.787904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1070 sessionId: src_id|eaede9e1-f27244f1-b630a237-d1949cc0_0 is DEAD
2025-09-30T14:53:05.788053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaede9e1-f27244f1-b630a237-d1949cc0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:05.788064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaede9e1-f27244f1-b630a237-d1949cc0_0] Write session will restart in 0.007153s
2025-09-30T14:53:05.788089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaede9e1-f27244f1-b630a237-d1949cc0_0] Write session: Do CDS request
2025-09-30T14:53:05.788094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaede9e1-f27244f1-b630a237-d1949cc0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:05.788493Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:05.796813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaede9e1-f27244f1-b630a237-d1949cc0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:05.796984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:05.796998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1071
2025-09-30T14:53:05.797140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1071 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:05.797183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1071 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:05.797196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1071 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:05.797200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:05.797739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1071 sessionId:  describe result for acl check
2025-09-30T14:53:05.797785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:05.797792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:05.797794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:05.797799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895383276690962:4487] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:05.798352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895383276690962:4487] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:05.800982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895383276690962:4487] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:05.801441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:05.803707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:05.803927Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:05.803937Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:05.803948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:05.804016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:05.804057Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895383186943254:7006]
2025-09-30T14:53:05.804094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895383276690962:4487] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:05.804108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895383276690962:4487] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:05.804112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895383276690962:4487] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:05.804121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1071 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:05.804720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:05.805021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:05.805066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:05.805402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:05.805456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:05.805463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:05.805464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:05.805465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:05.805466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:05.805468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:05.805469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:05.805470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:05.805472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:05.805473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:05.805474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.805476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.805477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.805479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:05.805480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:05.805486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:05.805498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:05.805502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:05.805506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:05.805510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:05.805513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:05.805518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:05.805522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:05.805526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:05.805531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:05.805535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.805539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.805543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.805547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:05.805551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:05.805560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:05.805570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:05.805576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:05.805582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:05.805587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:05.805593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:05.805597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:05.805603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:05.805608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:05.805614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:05.805618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:05.805631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:05.805636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:05.805642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:05.805647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:05.805657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:05.805662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:05.805668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:05.805677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:05.805682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:05.805687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.805694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.805702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.805707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.805712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.805722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.805727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:05.805737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:05.805742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:05.805747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:05.805798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:05.811689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:05.812581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:05.812597Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:05.812599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:05.812604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:05.812609Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1070 [2:7555895383186943254:7006]
2025-09-30T14:53:05.812624Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:05.812638Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:05.812640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:05.812643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:05.812645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:05.812659Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:05.812664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:05.812670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:05.812722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.812729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.812731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.812734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:05.812737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:05.812804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:05.812817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.812829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.812841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.812858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:05.812876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895383276690899:2454], now have 1 active actors on pipe
2025-09-30T14:53:05.812892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895383186943249:7006]
2025-09-30T14:53:05.812895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895383186943249:7006]
2025-09-30T14:53:05.812897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895383186943249:7006]
2025-09-30T14:53:05.812909Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:05.812920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895383276691049:4487], now have 1 active actors on pipe
2025-09-30T14:53:05.812929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:05.812931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:05.812935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:05.812938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:05.812944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:05.812947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:05.812980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895383186943249:7006]
2025-09-30T14:53:05.812987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:05.812993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:05.812971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1070
2025-09-30T14:53:05.813024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1070
2025-09-30T14:53:05.813077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:05.813085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:05.813105Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df04eb46-7c8a8c6f-3086f1c3-ae9cb810_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:05.813111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:05.813113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:05.813115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:05.813123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:05.813131Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:05.813146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:05.813297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:05.813306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:05.813320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:05.813414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1071 partition: 0 MaxSeqNo: 42 sessionId: src_id|df04eb46-7c8a8c6f-3086f1c3-ae9cb810_0
2025-09-30T14:53:05.813835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaede9e1-f27244f1-b630a237-d1949cc0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|df04eb46-7c8a8c6f-3086f1c3-ae9cb810_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:05.816890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df04eb46-7c8a8c6f-3086f1c3-ae9cb810_0] Write session: try to update token
2025-09-30T14:53:05.816914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df04eb46-7c8a8c6f-3086f1c3-ae9cb810_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:05.825766Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:05.825788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:05.825790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:05.825793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:05.825806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895383186943249:7006]
2025-09-30T14:53:05.825811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895383186943249:7006]
2025-09-30T14:53:05.825815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895383186943249:7006]
2025-09-30T14:53:05.825858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:05.825866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.825876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:05.825868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:05.825904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:05.825909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:05.826023Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:05.832969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1071 sessionId: src_id|df04eb46-7c8a8c6f-3086f1c3-ae9cb810_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:05.836089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:05.887967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895383276691061:5026]
2025-09-30T14:53:05.888285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1070, pipe: [1:7555895383276691061:5026]
2025-09-30T14:53:05.941118Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:05.941559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:05.941571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:05.941587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895383276691061:5026], now have 1 active actors on pipe
2025-09-30T14:53:05.941845Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:05.941879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895383276691061:5026]
2025-09-30T14:53:05.941908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:05.941915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:05.941994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1071 reason: error at write: Disconnected sessionId: src_id|df04eb46-7c8a8c6f-3086f1c3-ae9cb810_0
2025-09-30T14:53:05.942211Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:05.942239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1071 sessionId: src_id|df04eb46-7c8a8c6f-3086f1c3-ae9cb810_0 is DEAD
2025-09-30T14:53:05.942387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df04eb46-7c8a8c6f-3086f1c3-ae9cb810_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:05.942400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df04eb46-7c8a8c6f-3086f1c3-ae9cb810_0] Write session will restart in 0.005838s
2025-09-30T14:53:05.942423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df04eb46-7c8a8c6f-3086f1c3-ae9cb810_0] Write session: Do CDS request
2025-09-30T14:53:05.942429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df04eb46-7c8a8c6f-3086f1c3-ae9cb810_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:05.949747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df04eb46-7c8a8c6f-3086f1c3-ae9cb810_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:05.949898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:05.949915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1072
2025-09-30T14:53:05.950051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1072 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:05.950088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1072 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:05.950102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1072 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:05.950106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:05.950746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1072 sessionId:  describe result for acl check
2025-09-30T14:53:05.950786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:05.950792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:05.950795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:05.950800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895383276691130:4477] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:05.951387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895383276691130:4477] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:05.954951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:05.957047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895383276691130:4477] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:05.957262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:05.957468Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:05.957479Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:05.957490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:05.957555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:05.957602Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895383186943406:7008]
2025-09-30T14:53:05.958293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:05.958546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:05.958587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:05.958895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:05.958963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:05.958969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:05.958971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:05.958972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:05.958973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:05.958974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:05.958976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:05.958977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:05.958978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:05.958980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:05.958981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.958983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.958984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.958985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:05.958986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:05.958992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:05.959003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:05.959007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:05.959011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:05.959016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:05.959019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:05.959024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:05.959027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:05.959031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:05.959035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:05.959040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.959044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.959048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.959053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:05.959057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:05.959065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:05.959073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:05.959080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:05.959086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:05.959092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:05.959097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:05.959102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:05.959107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:05.959112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:05.959118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:05.959122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:05.959128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:05.959134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:05.959140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:05.959145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:05.959151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:05.959158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:05.959164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:05.959169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:05.959181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:05.959186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.959192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.959198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.959204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.959214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.959220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.959224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:05.959230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:05.959240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:05.959261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:05.959313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:05.959805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895383276691130:4477] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:05.959817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895383276691130:4477] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:05.959820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895383276691130:4477] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:05.959840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1072 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:05.964842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:05.966038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:05.966056Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:05.966059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:05.966064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:05.966071Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1071 [2:7555895383186943406:7008]
2025-09-30T14:53:05.966088Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:05.966103Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:05.966107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:05.966111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:05.966113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:05.966131Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:05.966142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:05.966160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:05.966226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.966235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.966237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.966241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:05.966243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:05.966298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:05.966304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.966313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:05.966320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:05.966334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:05.966347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895383186943400:7008]
2025-09-30T14:53:05.966354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895383186943400:7008]
2025-09-30T14:53:05.966356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895383186943400:7008]
2025-09-30T14:53:05.966363Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:05.966375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:05.966374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:05.966378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:05.966380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:05.966384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:05.966386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:05.966393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895383276691062:2454], now have 1 active actors on pipe
2025-09-30T14:53:05.966396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895383276691216:4477], now have 1 active actors on pipe
2025-09-30T14:53:05.966433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895383186943400:7008]
2025-09-30T14:53:05.966445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:05.966454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1071
2025-09-30T14:53:05.966457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:05.966507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:05.966511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:05.966464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1071
2025-09-30T14:53:05.966534Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d44c52e1-5687249a-a7bf896c-1d568e3e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:05.966540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:05.966545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:05.966546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:05.966554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:05.966563Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:05.966576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:05.966764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:05.966776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:05.966793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:05.966897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1072 partition: 0 MaxSeqNo: 42 sessionId: src_id|d44c52e1-5687249a-a7bf896c-1d568e3e_0
2025-09-30T14:53:05.967345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df04eb46-7c8a8c6f-3086f1c3-ae9cb810_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d44c52e1-5687249a-a7bf896c-1d568e3e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:05.970297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d44c52e1-5687249a-a7bf896c-1d568e3e_0] Write session: try to update token
2025-09-30T14:53:05.970317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d44c52e1-5687249a-a7bf896c-1d568e3e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:05.978843Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:05.978874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:05.978884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895383186943400:7008]
2025-09-30T14:53:05.978934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:05.978936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:05.979144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:05.979397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:05.979592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:05.979783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:05.980023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:05.980067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:05.985992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1072 sessionId: src_id|d44c52e1-5687249a-a7bf896c-1d568e3e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:05.989290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:05.990120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:05.990162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:05.990184Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:05.990191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:05.990194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:05.990196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:05.990206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895383186943400:7008]
2025-09-30T14:53:05.990210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895383186943400:7008]
2025-09-30T14:53:05.990214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895383186943400:7008]
2025-09-30T14:53:05.990259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:05.990267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:05.990271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:05.990273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:05.990274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:05.990278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:05.990413Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:06.042057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895387571658525:5026]
2025-09-30T14:53:06.042423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1071, pipe: [1:7555895387571658525:5026]
2025-09-30T14:53:06.104510Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:06.104864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:06.104901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895387571658525:5026], now have 1 active actors on pipe
2025-09-30T14:53:06.105042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:06.105078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:06.105126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895387571658525:5026]
2025-09-30T14:53:06.105137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:06.105144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:06.105218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1072 reason: error at write: Disconnected sessionId: src_id|d44c52e1-5687249a-a7bf896c-1d568e3e_0
2025-09-30T14:53:06.105411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1072 sessionId: src_id|d44c52e1-5687249a-a7bf896c-1d568e3e_0 is DEAD
2025-09-30T14:53:06.105569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d44c52e1-5687249a-a7bf896c-1d568e3e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:06.105581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d44c52e1-5687249a-a7bf896c-1d568e3e_0] Write session will restart in 0.009951s
2025-09-30T14:53:06.105603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d44c52e1-5687249a-a7bf896c-1d568e3e_0] Write session: Do CDS request
2025-09-30T14:53:06.105609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d44c52e1-5687249a-a7bf896c-1d568e3e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:06.116857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d44c52e1-5687249a-a7bf896c-1d568e3e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:06.116867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:06.116917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:06.116932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1073
2025-09-30T14:53:06.117095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1073 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:06.117127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1073 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:06.117132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1073 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:06.117136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:06.117592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1073 sessionId:  describe result for acl check
2025-09-30T14:53:06.117623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:06.117624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:06.117625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:06.117629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895387571658647:4476] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:06.118101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895387571658647:4476] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:06.119398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:06.119619Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:06.119632Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:06.119644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:06.119713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:06.119755Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895387481910870:7011]
2025-09-30T14:53:06.120246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895387571658647:4476] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:06.120434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:06.120714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:06.120764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:06.121102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:06.121175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:06.121183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:06.121185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:06.121186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:06.121187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:06.121189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:06.121190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:06.121192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:06.121194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:06.121195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:06.121196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.121198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.121199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.121201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:06.121202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:06.121208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:06.121219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:06.121224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:06.121229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:06.121234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:06.121239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:06.121242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:06.121247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:06.121251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:06.121256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:06.121260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.121263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.121267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.121271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:06.121275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:06.121283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:06.121291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:06.121298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:06.121303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:06.121308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:06.121313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:06.121318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:06.121324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:06.121329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:06.121335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:06.121341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:06.121354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:06.121359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:06.121371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:06.121375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:06.121381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:06.121385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:06.121391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:06.121401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:06.121407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:06.121413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.121423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.121429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.121440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.121445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.121454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.121463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:06.121470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:06.121475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:06.121486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:06.121537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:06.127205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895387571658647:4476] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:06.127225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895387571658647:4476] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:06.127230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895387571658647:4476] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:06.127268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1073 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:06.127297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:06.128373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:06.128389Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:06.128391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:06.128394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:06.128400Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1072 [2:7555895387481910870:7011]
2025-09-30T14:53:06.128412Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:06.128425Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:06.128427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:06.128430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:06.128431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:06.128445Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:06.128450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:06.128455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:06.128502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.128508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.128510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.128513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:06.128517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:06.128578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:06.128589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.128602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.128612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.128627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:06.128653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895387571658687:4476], now have 1 active actors on pipe
2025-09-30T14:53:06.128662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895387571658529:2454], now have 1 active actors on pipe
2025-09-30T14:53:06.128668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895387481910864:7011]
2025-09-30T14:53:06.128669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895387481910864:7011]
2025-09-30T14:53:06.128671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895387481910864:7011]
2025-09-30T14:53:06.128684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:06.128703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:06.128706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:06.128710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:06.128712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:06.128686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1072
2025-09-30T14:53:06.128722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:06.128725Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1072
2025-09-30T14:53:06.128725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:06.128759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895387481910864:7011]
2025-09-30T14:53:06.128765Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:06.128776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:06.128777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:06.128781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:06.128815Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2a89c24-44ff45f8-25c77a02-a7a209b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:06.128827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:06.128831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:06.128832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:06.128839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:06.128847Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:06.128864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:06.129045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:06.129062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:06.129087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:06.129217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1073 partition: 0 MaxSeqNo: 42 sessionId: src_id|f2a89c24-44ff45f8-25c77a02-a7a209b0_0
2025-09-30T14:53:06.129619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d44c52e1-5687249a-a7bf896c-1d568e3e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f2a89c24-44ff45f8-25c77a02-a7a209b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:06.132675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2a89c24-44ff45f8-25c77a02-a7a209b0_0] Write session: try to update token
2025-09-30T14:53:06.132699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2a89c24-44ff45f8-25c77a02-a7a209b0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:06.141342Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:06.141366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:06.141369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:06.141372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:06.141381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895387481910864:7011]
2025-09-30T14:53:06.141386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895387481910864:7011]
2025-09-30T14:53:06.141390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895387481910864:7011]
2025-09-30T14:53:06.141434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:06.141441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.141444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:06.141444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:06.141452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:06.141459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:06.141604Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:06.149683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1073 sessionId: src_id|f2a89c24-44ff45f8-25c77a02-a7a209b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:06.152825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:06.205396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895387571658705:5026]
2025-09-30T14:53:06.205732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1072, pipe: [1:7555895387571658705:5026]
2025-09-30T14:53:06.258600Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:06.259059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:06.259080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:06.259100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895387571658705:5026], now have 1 active actors on pipe
2025-09-30T14:53:06.259344Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:06.259369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:06.259379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895387571658705:5026]
2025-09-30T14:53:06.259403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:06.259473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1073 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f2a89c24-44ff45f8-25c77a02-a7a209b0_0
2025-09-30T14:53:06.259682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1073 sessionId: src_id|f2a89c24-44ff45f8-25c77a02-a7a209b0_0 is DEAD
2025-09-30T14:53:06.259853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2a89c24-44ff45f8-25c77a02-a7a209b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:06.259866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2a89c24-44ff45f8-25c77a02-a7a209b0_0] Write session will restart in 0.006125s
2025-09-30T14:53:06.259894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2a89c24-44ff45f8-25c77a02-a7a209b0_0] Write session: Do CDS request
2025-09-30T14:53:06.259901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2a89c24-44ff45f8-25c77a02-a7a209b0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:06.266776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2a89c24-44ff45f8-25c77a02-a7a209b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:06.266912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:06.266931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1074
2025-09-30T14:53:06.267071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1074 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:06.267107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1074 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:06.267120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1074 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:06.267125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:06.267625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1074 sessionId:  describe result for acl check
2025-09-30T14:53:06.267663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:06.267666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:06.267668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:06.267673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895387571658745:4468] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:06.268234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895387571658745:4468] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:06.270536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895387571658745:4468] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:06.271964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:06.273999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:06.274220Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:06.274233Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:06.274245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:06.274304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:06.274348Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895387481911025:7014]
2025-09-30T14:53:06.274405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895387571658745:4468] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:06.274422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895387571658745:4468] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:06.274426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895387571658745:4468] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:06.274435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1074 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:06.275015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:06.275380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:06.275442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:06.275784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:06.275853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:06.275860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:06.275861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:06.275862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:06.275864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:06.275865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:06.275866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:06.275867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:06.275869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:06.275870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:06.275871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.275873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.275874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.275875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:06.275877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:06.275883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:06.275894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:06.275898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:06.275902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:06.275906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:06.275911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:06.275915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:06.275919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:06.275923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:06.275929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:06.275933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.275937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.275941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.275945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:06.275949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:06.275958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:06.275966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:06.275973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:06.275978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:06.275983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:06.275988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:06.275994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:06.276000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:06.276005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:06.276010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:06.276015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:06.276020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:06.276025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:06.276033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:06.276035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:06.276039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:06.276042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:06.276045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:06.276047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:06.276050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:06.276053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.276056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.276058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.276061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.276064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.276068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.276070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:06.276073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:06.276076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:06.276079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:06.276115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:06.281853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:06.283072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:06.283091Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:06.283095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:06.283099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:06.283107Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1073 [2:7555895387481911025:7014]
2025-09-30T14:53:06.283123Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:06.283139Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:06.283143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:06.283147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:06.283149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:06.283166Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:06.283173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:06.283180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:06.283267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.283275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.283277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.283281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:06.283283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:06.283350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:06.283359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.283373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.283390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.283410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:06.283432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895387571658858:4468], now have 1 active actors on pipe
2025-09-30T14:53:06.283440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895387571658706:2454], now have 1 active actors on pipe
2025-09-30T14:53:06.283448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895387481911020:7014]
2025-09-30T14:53:06.283452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895387481911020:7014]
2025-09-30T14:53:06.283454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895387481911020:7014]
2025-09-30T14:53:06.283467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:06.283484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:06.283489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:06.283492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:06.283495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:06.283498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:06.283501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:06.283491Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1073
2025-09-30T14:53:06.283502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1073
2025-09-30T14:53:06.283534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895387481911020:7014]
2025-09-30T14:53:06.283543Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:06.283545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:06.283558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:06.283563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:06.283616Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d84cfef-fbe981f1-a6ec5388-ba8849ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:06.283628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:06.283631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:06.283634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:06.283643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:06.283656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:06.283682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:06.283840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:06.283848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:06.283862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:06.283952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1074 partition: 0 MaxSeqNo: 42 sessionId: src_id|8d84cfef-fbe981f1-a6ec5388-ba8849ee_0
2025-09-30T14:53:06.284318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2a89c24-44ff45f8-25c77a02-a7a209b0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8d84cfef-fbe981f1-a6ec5388-ba8849ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:06.286999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d84cfef-fbe981f1-a6ec5388-ba8849ee_0] Write session: try to update token
2025-09-30T14:53:06.287013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d84cfef-fbe981f1-a6ec5388-ba8849ee_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:06.295911Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:06.295938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:06.295941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:06.295944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:06.295955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895387481911020:7014]
2025-09-30T14:53:06.295961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895387481911020:7014]
2025-09-30T14:53:06.295965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895387481911020:7014]
2025-09-30T14:53:06.296008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:06.296015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.296020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:06.296027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:06.296051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:06.296056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:06.296162Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:06.302454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1074 sessionId: src_id|8d84cfef-fbe981f1-a6ec5388-ba8849ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:06.305464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:06.359502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895387571658883:5026]
2025-09-30T14:53:06.359756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1073, pipe: [1:7555895387571658883:5026]
2025-09-30T14:53:06.404410Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:06.404828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:06.404843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:06.404864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895387571658883:5026], now have 1 active actors on pipe
2025-09-30T14:53:06.405078Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:06.405143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:06.405151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:06.405156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:06.405196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895387571658883:5026]
2025-09-30T14:53:06.405209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1074 reason: error at write: Disconnected sessionId: src_id|8d84cfef-fbe981f1-a6ec5388-ba8849ee_0
2025-09-30T14:53:06.405374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1074 sessionId: src_id|8d84cfef-fbe981f1-a6ec5388-ba8849ee_0 is DEAD
2025-09-30T14:53:06.405513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d84cfef-fbe981f1-a6ec5388-ba8849ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:06.405524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d84cfef-fbe981f1-a6ec5388-ba8849ee_0] Write session will restart in 0.005085s
2025-09-30T14:53:06.405546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d84cfef-fbe981f1-a6ec5388-ba8849ee_0] Write session: Do CDS request
2025-09-30T14:53:06.405554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d84cfef-fbe981f1-a6ec5388-ba8849ee_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:06.411780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d84cfef-fbe981f1-a6ec5388-ba8849ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:06.411789Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:06.411816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1075
2025-09-30T14:53:06.412022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1075 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:06.412054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1075 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:06.412077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1075 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:06.412085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:06.412530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1075 sessionId:  describe result for acl check
2025-09-30T14:53:06.412578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:06.412580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:06.412582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:06.412588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895387571658929:4451] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:06.413141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895387571658929:4451] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:06.415832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895387571658929:4451] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:06.416919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:06.419160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:06.419414Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:06.419431Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:06.419443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:06.419511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:06.419553Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895387481911217:7028]
2025-09-30T14:53:06.419552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895387571658929:4451] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:06.419567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895387571658929:4451] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:06.419571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895387571658929:4451] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:06.419579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1075 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:06.420173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:06.420685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:06.420756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:06.421119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:06.421206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:06.421213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:06.421214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:06.421215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:06.421216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:06.421217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:06.421218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:06.421219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:06.421220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:06.421221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:06.421223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.421223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.421225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.421225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:06.421226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:06.421233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:06.421243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:06.421247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:06.421250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:06.421254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:06.421258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:06.421262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:06.421266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:06.421269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:06.421275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:06.421279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.421282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.421285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.421289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:06.421293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:06.421300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:06.421308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:06.421319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:06.421331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:06.421340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:06.421345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:06.421353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:06.421358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:06.421368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:06.421373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:06.421378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:06.421388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:06.421393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:06.421403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:06.421407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:06.421412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:06.421419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:06.421428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:06.421437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:06.421443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:06.421453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.421463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.421472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.421479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.421487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.421492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.421496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:06.421506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:06.421510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:06.421516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:06.421567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:06.427164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:06.428393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:06.428411Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:06.428414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:06.428418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:06.428425Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1074 [2:7555895387481911217:7028]
2025-09-30T14:53:06.428443Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:06.428460Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:06.428465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:06.428476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:06.428478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:06.428495Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:06.428507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:06.428514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:06.428582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.428593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.428595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.428599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:06.428601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:06.428673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:06.428681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.428694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.428711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.428734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:06.428752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895387571659046:4451], now have 1 active actors on pipe
2025-09-30T14:53:06.428761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895387571658896:2454], now have 1 active actors on pipe
2025-09-30T14:53:06.428767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895387481911211:7028]
2025-09-30T14:53:06.428770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895387481911211:7028]
2025-09-30T14:53:06.428772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895387481911211:7028]
2025-09-30T14:53:06.428787Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:06.428804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:06.428826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:06.428825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:06.428830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:06.428831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:06.428834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:06.428867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895387481911211:7028]
2025-09-30T14:53:06.428854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1074
2025-09-30T14:53:06.428879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:06.428900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:06.428866Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1074
2025-09-30T14:53:06.428914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:06.428924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:06.428957Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bbae94a1-bbda1de7-7592a05-1ba8f80c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:06.428970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:06.428974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:06.428976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:06.428986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:06.429000Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:06.429021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:06.429232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:06.429243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:06.429260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:06.429491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1075 partition: 0 MaxSeqNo: 42 sessionId: src_id|bbae94a1-bbda1de7-7592a05-1ba8f80c_0
2025-09-30T14:53:06.429913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d84cfef-fbe981f1-a6ec5388-ba8849ee_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bbae94a1-bbda1de7-7592a05-1ba8f80c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:06.432879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbae94a1-bbda1de7-7592a05-1ba8f80c_0] Write session: try to update token
2025-09-30T14:53:06.432903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbae94a1-bbda1de7-7592a05-1ba8f80c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:06.441554Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:06.441574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:06.441577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:06.441579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:06.441589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895387481911211:7028]
2025-09-30T14:53:06.441593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895387481911211:7028]
2025-09-30T14:53:06.441600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895387481911211:7028]
2025-09-30T14:53:06.441641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:06.441647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.441649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:06.441670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:06.441690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:06.441696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:06.441786Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:06.448753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1075 sessionId: src_id|bbae94a1-bbda1de7-7592a05-1ba8f80c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:06.451720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:06.505434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895387571659060:5026]
2025-09-30T14:53:06.505721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1074, pipe: [1:7555895387571659060:5026]
2025-09-30T14:53:06.554746Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:06.555070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:06.555082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:06.555116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895387571659060:5026], now have 1 active actors on pipe
2025-09-30T14:53:06.555310Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:06.555380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:06.555395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:06.555397Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:06.555448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895387571659060:5026]
2025-09-30T14:53:06.555468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1075 reason: error at write: Disconnected sessionId: src_id|bbae94a1-bbda1de7-7592a05-1ba8f80c_0
2025-09-30T14:53:06.555692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1075 sessionId: src_id|bbae94a1-bbda1de7-7592a05-1ba8f80c_0 is DEAD
2025-09-30T14:53:06.555856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbae94a1-bbda1de7-7592a05-1ba8f80c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:06.555867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbae94a1-bbda1de7-7592a05-1ba8f80c_0] Write session will restart in 0.006112s
2025-09-30T14:53:06.555890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbae94a1-bbda1de7-7592a05-1ba8f80c_0] Write session: Do CDS request
2025-09-30T14:53:06.555896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbae94a1-bbda1de7-7592a05-1ba8f80c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:06.562811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbae94a1-bbda1de7-7592a05-1ba8f80c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:06.562969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:06.562988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1076
2025-09-30T14:53:06.563098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1076 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:06.563133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1076 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:06.563138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1076 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:06.563143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:06.563602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1076 sessionId:  describe result for acl check
2025-09-30T14:53:06.563640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:06.563646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:06.563648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:06.563654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895387571659095:4447] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:06.564233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895387571659095:4447] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:06.567599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895387571659095:4447] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:06.567812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:06.569732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:06.569934Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:06.569943Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:06.569954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:06.570007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:06.570054Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895387481911374:7030]
2025-09-30T14:53:06.570067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895387571659095:4447] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:06.570082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895387571659095:4447] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:06.570086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895387571659095:4447] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:06.570102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1076 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:06.570749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:06.571040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:06.571081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:06.571380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:06.571442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:06.571448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:06.571449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:06.571449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:06.571450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:06.571451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:06.571452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:06.571452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:06.571453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:06.571454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:06.571455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.571455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.571456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.571457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:06.571458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:06.571462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:06.571469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:06.571472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:06.571474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:06.571477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:06.571479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:06.571482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:06.571486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:06.571490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:06.571494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:06.571498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.571502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.571506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.571510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:06.571514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:06.571521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:06.571529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:06.571535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:06.571541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:06.571546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:06.571552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:06.571557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:06.571562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:06.571567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:06.571573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:06.571583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:06.571588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:06.571591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:06.571594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:06.571596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:06.571599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:06.571601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:06.571604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:06.571607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:06.571610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:06.571613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.571616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.571618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.571621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.571624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.571627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.571629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:06.571632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:06.571635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:06.571638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:06.571663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:06.577571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:06.578699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:06.578726Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:06.578729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:06.578734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:06.578745Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1075 [2:7555895387481911374:7030]
2025-09-30T14:53:06.578772Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:06.578795Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:06.578803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:06.578806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:06.578808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:06.578827Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:06.578843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:06.578854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:06.578952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.578960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.578962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.578965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:06.578968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:06.579064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:06.579079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.579096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.579104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.579116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:06.579136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895387571659216:4447], now have 1 active actors on pipe
2025-09-30T14:53:06.579140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895387571659061:2454], now have 1 active actors on pipe
2025-09-30T14:53:06.579147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895387481911369:7030]
2025-09-30T14:53:06.579150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895387481911369:7030]
2025-09-30T14:53:06.579153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895387481911369:7030]
2025-09-30T14:53:06.579171Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:06.579190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:06.579198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:06.579202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:06.579204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:06.579208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:06.579211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:06.579210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1075
2025-09-30T14:53:06.579284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1075
2025-09-30T14:53:06.579287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895387481911369:7030]
2025-09-30T14:53:06.579301Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:06.579322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:06.579660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:06.579679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:06.579763Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50bef196-6ed5aa5a-8b8902e5-f70fa9b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:06.579781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:06.579795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:06.579798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:06.579812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:06.579832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:06.579865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:06.580071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:06.580086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:06.580107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:06.580216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1076 partition: 0 MaxSeqNo: 42 sessionId: src_id|50bef196-6ed5aa5a-8b8902e5-f70fa9b3_0
2025-09-30T14:53:06.580634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbae94a1-bbda1de7-7592a05-1ba8f80c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|50bef196-6ed5aa5a-8b8902e5-f70fa9b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:06.583529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50bef196-6ed5aa5a-8b8902e5-f70fa9b3_0] Write session: try to update token
2025-09-30T14:53:06.583550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50bef196-6ed5aa5a-8b8902e5-f70fa9b3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:06.592490Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:06.592527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:06.592531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:06.592534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:06.592545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895387481911369:7030]
2025-09-30T14:53:06.592551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895387481911369:7030]
2025-09-30T14:53:06.592556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895387481911369:7030]
2025-09-30T14:53:06.592607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:06.592611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:06.592613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:06.592617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:06.592621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.592625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:06.592861Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:06.599085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1076 sessionId: src_id|50bef196-6ed5aa5a-8b8902e5-f70fa9b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:06.602219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:06.655427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895387571659228:5026]
2025-09-30T14:53:06.655739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1075, pipe: [1:7555895387571659228:5026]
2025-09-30T14:53:06.708682Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:06.709090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:06.709107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:06.709129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895387571659228:5026], now have 1 active actors on pipe
2025-09-30T14:53:06.709388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:06.709403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:06.709426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895387571659228:5026]
2025-09-30T14:53:06.709446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:06.709369Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:06.709479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1076 reason: error at write: Disconnected sessionId: src_id|50bef196-6ed5aa5a-8b8902e5-f70fa9b3_0
2025-09-30T14:53:06.709704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1076 sessionId: src_id|50bef196-6ed5aa5a-8b8902e5-f70fa9b3_0 is DEAD
2025-09-30T14:53:06.709878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50bef196-6ed5aa5a-8b8902e5-f70fa9b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:06.709887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50bef196-6ed5aa5a-8b8902e5-f70fa9b3_0] Write session will restart in 0.007243s
2025-09-30T14:53:06.709921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50bef196-6ed5aa5a-8b8902e5-f70fa9b3_0] Write session: Do CDS request
2025-09-30T14:53:06.709930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50bef196-6ed5aa5a-8b8902e5-f70fa9b3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:06.718829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50bef196-6ed5aa5a-8b8902e5-f70fa9b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:06.718954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:06.718971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1077
2025-09-30T14:53:06.719162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1077 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:06.719212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1077 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:06.719218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1077 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:06.719226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:06.719699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1077 sessionId:  describe result for acl check
2025-09-30T14:53:06.719738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:06.719745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:06.719747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:06.719752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895387571659346:4438] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:06.720350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895387571659346:4438] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:06.721060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:06.722396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895387571659346:4438] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:06.723176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:06.723431Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:06.723442Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:06.723465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:06.723530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:06.723699Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895387481911534:7033]
2025-09-30T14:53:06.724322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:06.724746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:06.724828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:06.725181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:06.725247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:06.725254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:06.725255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:06.725257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:06.725258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:06.725259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:06.725248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895387571659346:4438] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:06.725260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:06.725273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895387571659346:4438] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:06.725262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:06.725277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895387571659346:4438] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:06.725263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:06.725286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1077 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:06.725264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:06.725266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.725267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.725268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.725269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:06.725270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:06.725277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:06.725286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:06.725290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:06.725294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:06.725297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:06.725301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:06.725305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:06.725309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:06.725313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:06.725319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:06.725322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.725327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.725331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.725334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:06.725337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:06.725348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:06.725357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:06.725363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:06.725369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:06.725376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:06.725382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:06.725386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:06.725407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:06.725411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:06.725417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:06.725422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:06.725427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:06.725433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:06.725439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:06.725443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:06.725454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:06.725459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:06.725464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:06.725474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:06.725479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:06.725484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.725494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.725499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.725505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.725515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.725520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.725529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:06.725535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:06.725540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:06.725549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:06.725593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:06.731293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:06.732530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:06.732548Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:06.732551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:06.732555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:06.732562Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1076 [2:7555895387481911534:7033]
2025-09-30T14:53:06.732578Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:06.732595Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:06.732599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:06.732602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:06.732605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:06.732622Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:06.732635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:06.732642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:06.732707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.732716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.732718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.732722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:06.732724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:06.732793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:06.732802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.732815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.732825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.732842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:06.732861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895387571659386:4438], now have 1 active actors on pipe
2025-09-30T14:53:06.732871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895387571659229:2454], now have 1 active actors on pipe
2025-09-30T14:53:06.732877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895387481911528:7033]
2025-09-30T14:53:06.732886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895387481911528:7033]
2025-09-30T14:53:06.732888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895387481911528:7033]
2025-09-30T14:53:06.732901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:06.732920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:06.732940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:06.732948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:06.732959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:06.732964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:06.732966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:06.732986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895387481911528:7033]
2025-09-30T14:53:06.732995Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:06.732973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1076
2025-09-30T14:53:06.732979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1076
2025-09-30T14:53:06.733006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:06.733031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:06.733036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:06.733067Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69033ffc-e18579a4-f281dbf5-13ca7fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:06.733079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:06.733086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:06.733088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:06.733098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:06.733112Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:06.733130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:06.733325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:06.733339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:06.733362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:06.733470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1077 partition: 0 MaxSeqNo: 42 sessionId: src_id|69033ffc-e18579a4-f281dbf5-13ca7fc_0
2025-09-30T14:53:06.733856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50bef196-6ed5aa5a-8b8902e5-f70fa9b3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|69033ffc-e18579a4-f281dbf5-13ca7fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:06.736980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69033ffc-e18579a4-f281dbf5-13ca7fc_0] Write session: try to update token
2025-09-30T14:53:06.736999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69033ffc-e18579a4-f281dbf5-13ca7fc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:06.745673Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:06.745697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:06.745708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895387481911528:7033]
2025-09-30T14:53:06.745754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:06.745765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:06.745937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:06.746097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:06.746260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:06.746412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:06.746647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:06.746689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:06.752290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1077 sessionId: src_id|69033ffc-e18579a4-f281dbf5-13ca7fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:06.755108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:06.755298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:06.755324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:06.755398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:06.755489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:06.756582Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:06.756601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:06.756603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:06.756605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:06.756619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895387481911528:7033]
2025-09-30T14:53:06.756623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895387481911528:7033]
2025-09-30T14:53:06.756627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895387481911528:7033]
2025-09-30T14:53:06.756664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:06.756675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.756683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:06.756685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:06.756695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:06.756700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:06.756823Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:06.809541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895387571659396:5026]
2025-09-30T14:53:06.809861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1076, pipe: [1:7555895387571659396:5026]
2025-09-30T14:53:06.870619Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:06.878314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:06.878341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:06.878496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:06.878560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:06.878632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:06.878705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:06.879124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:06.879135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:06.879201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:06.879270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:06.879332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:06.879403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:06.879456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:06.879469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:06.879545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:06.879605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:06.879665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:06.879726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:06.879766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:06.879774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:06.879849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:06.879914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:06.879974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:06.880034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:06.880077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:06.880082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:06.880145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:06.880212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:06.880272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:06.880330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:06.880371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:06.880377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:06.880441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:06.880497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:06.880560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:06.880621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:06.880665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:06.880672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:06.880738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:06.880796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:06.880861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:06.880921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:06.880966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:06.880972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:06.881033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:06.881088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:06.881147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:06.881219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:06.881268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:06.881275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:06.881344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:06.881413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:06.881476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:06.881547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:06.881594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:06.881601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:06.881666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:06.881734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:06.881799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:06.881869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:06.881920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:06.881927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:06.881996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895387571659396:5026], now have 1 active actors on pipe
2025-09-30T14:53:06.882247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:06.882249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895387571659396:5026]
2025-09-30T14:53:06.882270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:06.882278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:06.882309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1077 reason: error at write: Disconnected sessionId: src_id|69033ffc-e18579a4-f281dbf5-13ca7fc_0
2025-09-30T14:53:06.882572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1077 sessionId: src_id|69033ffc-e18579a4-f281dbf5-13ca7fc_0 is DEAD
2025-09-30T14:53:06.882653Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:06.882815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69033ffc-e18579a4-f281dbf5-13ca7fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:06.882829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69033ffc-e18579a4-f281dbf5-13ca7fc_0] Write session will restart in 0.007591s
2025-09-30T14:53:06.882854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69033ffc-e18579a4-f281dbf5-13ca7fc_0] Write session: Do CDS request
2025-09-30T14:53:06.882859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69033ffc-e18579a4-f281dbf5-13ca7fc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:06.891740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69033ffc-e18579a4-f281dbf5-13ca7fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:06.891857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:06.891870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1078
2025-09-30T14:53:06.891989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1078 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:06.892022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1078 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:06.892029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1078 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:06.892044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:06.892493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1078 sessionId:  describe result for acl check
2025-09-30T14:53:06.892537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:06.892543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:06.892545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:06.892552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895387571659487:4436] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:06.893076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895387571659487:4436] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:06.894796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:06.895267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895387571659487:4436] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:06.896880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:06.897070Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:06.897082Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:06.897093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:06.897139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:06.897180Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895387481911694:7035]
2025-09-30T14:53:06.897624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895387571659487:4436] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:06.897639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895387571659487:4436] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:06.897643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895387571659487:4436] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:06.897651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1078 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:06.897664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:06.897904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:06.897947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:06.898270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:06.898350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:06.898357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:06.898358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:06.898359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:06.898361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:06.898362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:06.898363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:06.898364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:06.898365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:06.898367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:06.898368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.898369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.898370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.898371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:06.898372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:06.898378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:06.898389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:06.898393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:06.898397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:06.898401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:06.898405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:06.898409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:06.898412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:06.898416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:06.898420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:06.898424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.898428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.898431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.898435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:06.898439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:06.898446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:06.898454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:06.898461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:06.898467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:06.898471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:06.898476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:06.898480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:06.898485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:06.898490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:06.898496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:06.898500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:06.898505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:06.898510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:06.898515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:06.898519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:06.898524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:06.898529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:06.898534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:06.898538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:06.898542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:06.898547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.898552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.898556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.898567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.898572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.898578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.898584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:06.898591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:06.898596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:06.898602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:06.898652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:06.904180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:06.905433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:06.905451Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:06.905454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:06.905458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:06.905465Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1077 [2:7555895387481911694:7035]
2025-09-30T14:53:06.905485Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:06.905508Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:06.905511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:06.905514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:06.905517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:06.905533Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:06.905539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:06.905546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:06.905607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.905614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.905617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.905620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:06.905623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:06.905690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:06.905698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.905712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:06.905725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:06.905746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:06.905770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895387571659568:4436], now have 1 active actors on pipe
2025-09-30T14:53:06.905780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895387571659397:2454], now have 1 active actors on pipe
2025-09-30T14:53:06.905786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895387481911689:7035]
2025-09-30T14:53:06.905795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895387481911689:7035]
2025-09-30T14:53:06.905798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895387481911689:7035]
2025-09-30T14:53:06.905812Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:06.905831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:06.905833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:06.905837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:06.905840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:06.905848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:06.905851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:06.905842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1077
2025-09-30T14:53:06.905883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895387481911689:7035]
2025-09-30T14:53:06.905859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1077
2025-09-30T14:53:06.905894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:06.905900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:06.906034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:06.906045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:06.906074Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3475972-b2a9303d-1b396744-f1511262_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:06.906088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:06.906096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:06.906099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:06.906109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:06.906123Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:06.906153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:06.906330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:06.906338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:06.906352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:06.906483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1078 partition: 0 MaxSeqNo: 42 sessionId: src_id|e3475972-b2a9303d-1b396744-f1511262_0
2025-09-30T14:53:06.906905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69033ffc-e18579a4-f281dbf5-13ca7fc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e3475972-b2a9303d-1b396744-f1511262_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:06.909669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3475972-b2a9303d-1b396744-f1511262_0] Write session: try to update token
2025-09-30T14:53:06.909696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3475972-b2a9303d-1b396744-f1511262_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:06.918128Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:06.918161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:06.918165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:06.918167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:06.918175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895387481911689:7035]
2025-09-30T14:53:06.918180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895387481911689:7035]
2025-09-30T14:53:06.918185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895387481911689:7035]
2025-09-30T14:53:06.918227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:06.918236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:06.918242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:06.918247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:06.918257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:06.918261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:06.918382Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:06.925067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1078 sessionId: src_id|e3475972-b2a9303d-1b396744-f1511262_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:06.928105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:06.982592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895387571659587:5026]
2025-09-30T14:53:06.983028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1077, pipe: [1:7555895387571659587:5026]
2025-09-30T14:53:07.032570Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:07.032919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:07.032937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:07.032956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895387571659587:5026], now have 1 active actors on pipe
2025-09-30T14:53:07.033227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895387571659587:5026]
2025-09-30T14:53:07.033256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:07.033261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:07.033262Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:07.033254Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:07.033333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1078 reason: error at write: Disconnected sessionId: src_id|e3475972-b2a9303d-1b396744-f1511262_0
2025-09-30T14:53:07.033550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1078 sessionId: src_id|e3475972-b2a9303d-1b396744-f1511262_0 is DEAD
2025-09-30T14:53:07.033717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3475972-b2a9303d-1b396744-f1511262_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:07.033736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3475972-b2a9303d-1b396744-f1511262_0] Write session will restart in 0.008801s
2025-09-30T14:53:07.033759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3475972-b2a9303d-1b396744-f1511262_0] Write session: Do CDS request
2025-09-30T14:53:07.033765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3475972-b2a9303d-1b396744-f1511262_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:07.043872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3475972-b2a9303d-1b396744-f1511262_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:07.043954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:07.043973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1079
2025-09-30T14:53:07.044133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1079 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:07.044174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1079 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:07.044185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1079 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:07.044190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:07.044694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1079 sessionId:  describe result for acl check
2025-09-30T14:53:07.044761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:07.044769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:07.044771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:07.044777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895391866626999:4432] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:07.045430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895391866626999:4432] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:07.046758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:07.047823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895391866626999:4432] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:07.049151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:07.049376Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:07.049387Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:07.049399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:07.049459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:07.049497Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895391776879150:7037]
2025-09-30T14:53:07.050205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:07.050409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895391866626999:4432] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:07.050426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895391866626999:4432] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:07.050430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895391866626999:4432] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:07.050438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1079 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:07.050520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:07.050617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:07.051075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:07.051170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:07.051178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:07.051179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:07.051181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:07.051182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:07.051183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:07.051185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:07.051186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:07.051188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:07.051189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:07.051191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.051192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.051193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.051195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:07.051196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:07.051203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:07.051214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:07.051219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:07.051224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:07.051228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:07.051233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:07.051237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:07.051262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:07.051266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:07.051271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:07.051275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.051279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.051283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.051287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:07.051292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:07.051301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:07.051310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:07.051317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:07.051323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:07.051335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:07.051341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:07.051347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:07.051353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:07.051358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:07.051364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:07.051369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:07.051375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:07.051383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:07.051394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:07.051399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:07.051405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:07.051416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:07.051422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:07.051432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:07.051438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:07.051468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.051478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.051483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.051493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.051498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.051503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.051509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:07.051519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:07.051524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:07.051530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:07.051583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:07.057293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:07.058540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:07.058558Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:07.058561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:07.058566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:07.058574Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1078 [2:7555895391776879150:7037]
2025-09-30T14:53:07.058593Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:07.058610Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:07.058615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:07.058618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:07.058621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:07.058638Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:07.058655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:07.058665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:07.058739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.058748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.058750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.058754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:07.058756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:07.058828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:07.058836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.058850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.058863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.058880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:07.058901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895391866627048:4432], now have 1 active actors on pipe
2025-09-30T14:53:07.058913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895391866626889:2454], now have 1 active actors on pipe
2025-09-30T14:53:07.058921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895391776879145:7037]
2025-09-30T14:53:07.058923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895391776879145:7037]
2025-09-30T14:53:07.058926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895391776879145:7037]
2025-09-30T14:53:07.058947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:07.058973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:07.058973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:07.058978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:07.058981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:07.058990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:07.058994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:07.058967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1078
2025-09-30T14:53:07.058969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1078
2025-09-30T14:53:07.059033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895391776879145:7037]
2025-09-30T14:53:07.059041Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:07.059044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:07.059063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:07.059068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:07.059118Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af8e0783-f7072415-c584fb7c-8f466c81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:07.059130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:07.059134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:07.059141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:07.059150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:07.059165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:07.059192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:07.059384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:07.059400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:07.059417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:07.059548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1079 partition: 0 MaxSeqNo: 42 sessionId: src_id|af8e0783-f7072415-c584fb7c-8f466c81_0
2025-09-30T14:53:07.059967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3475972-b2a9303d-1b396744-f1511262_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|af8e0783-f7072415-c584fb7c-8f466c81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:07.062921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af8e0783-f7072415-c584fb7c-8f466c81_0] Write session: try to update token
2025-09-30T14:53:07.062941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af8e0783-f7072415-c584fb7c-8f466c81_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:07.071754Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:07.071779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:07.071782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:07.071785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:07.071795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895391776879145:7037]
2025-09-30T14:53:07.071804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895391776879145:7037]
2025-09-30T14:53:07.071809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895391776879145:7037]
2025-09-30T14:53:07.071851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:07.071865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.071868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:07.071870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:07.071877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:07.071885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:07.072016Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:07.078744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1079 sessionId: src_id|af8e0783-f7072415-c584fb7c-8f466c81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:07.081792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:07.139274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895391866627073:5026]
2025-09-30T14:53:07.139705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1078, pipe: [1:7555895391866627073:5026]
2025-09-30T14:53:07.193052Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:07.193503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:07.193521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:07.193543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895391866627073:5026], now have 1 active actors on pipe
2025-09-30T14:53:07.193785Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:07.193811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:07.193805Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:07.193826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:07.193864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895391866627073:5026]
2025-09-30T14:53:07.193905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1079 reason: error at write: Disconnected sessionId: src_id|af8e0783-f7072415-c584fb7c-8f466c81_0
2025-09-30T14:53:07.194155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1079 sessionId: src_id|af8e0783-f7072415-c584fb7c-8f466c81_0 is DEAD
2025-09-30T14:53:07.194537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af8e0783-f7072415-c584fb7c-8f466c81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:07.194547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af8e0783-f7072415-c584fb7c-8f466c81_0] Write session will restart in 0.009763s
2025-09-30T14:53:07.194570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af8e0783-f7072415-c584fb7c-8f466c81_0] Write session: Do CDS request
2025-09-30T14:53:07.194580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af8e0783-f7072415-c584fb7c-8f466c81_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:07.205812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af8e0783-f7072415-c584fb7c-8f466c81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:07.205944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:07.205960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1080
2025-09-30T14:53:07.206083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1080 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:07.206116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1080 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:07.206122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1080 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:07.206131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:07.206564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1080 sessionId:  describe result for acl check
2025-09-30T14:53:07.206602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:07.206609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:07.206611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:07.206617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895391866627197:4425] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:07.206646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:07.207166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895391866627197:4425] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:07.208842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:07.209079Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:07.209097Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:07.209118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:07.209189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:07.209234Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895391776879325:7041]
2025-09-30T14:53:07.209375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895391866627197:4425] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:07.209884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:07.210227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:07.210277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:07.210630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:07.210716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:07.210723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:07.210725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:07.210726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:07.210728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:07.210729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:07.210730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:07.210731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:07.210733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:07.210734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:07.210735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.210737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.210738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.210739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:07.210741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:07.210747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:07.210757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:07.210761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:07.210765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:07.210768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:07.210772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:07.210776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:07.210779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:07.210783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:07.210788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:07.210792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.210795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.210799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.210803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:07.210806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:07.210815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:07.210823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:07.210829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:07.210835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:07.210839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:07.210845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:07.210849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:07.210854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:07.210858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:07.210863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:07.210868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:07.210873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:07.210883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:07.210889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:07.210893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:07.210898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:07.210902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:07.210907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:07.210912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:07.210922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:07.210927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.210932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.210940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.210944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.210948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.210953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.210966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:07.210971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:07.210976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:07.210981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:07.211037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:07.216652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895391866627197:4425] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:07.216689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895391866627197:4425] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:07.216694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895391866627197:4425] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:07.216714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1080 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:07.216866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:07.218086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:07.218108Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:07.218111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:07.218115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:07.218121Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1079 [2:7555895391776879325:7041]
2025-09-30T14:53:07.218138Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:07.218168Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:07.218179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:07.218182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:07.218185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:07.218202Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:07.218209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:07.218220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:07.218288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.218298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.218301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.218304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:07.218307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:07.218381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:07.218392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.218407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.218422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.218441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:07.218461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895391866627236:4425], now have 1 active actors on pipe
2025-09-30T14:53:07.218465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895391866627074:2454], now have 1 active actors on pipe
2025-09-30T14:53:07.218472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895391776879320:7041]
2025-09-30T14:53:07.218475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895391776879320:7041]
2025-09-30T14:53:07.218477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895391776879320:7041]
2025-09-30T14:53:07.218492Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:07.218507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:07.218508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:07.218512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:07.218514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:07.218524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:07.218527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:07.218564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895391776879320:7041]
2025-09-30T14:53:07.218573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:07.218561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1079
2025-09-30T14:53:07.218563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1079
2025-09-30T14:53:07.218588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:07.218608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:07.218613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:07.218646Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e5b6fe3-7e7d6457-e882b38-56c1e0d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:07.218660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:07.218664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:07.218666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:07.218677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:07.218693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:07.218720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:07.218934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:07.218945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:07.218960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:07.219073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1080 partition: 0 MaxSeqNo: 42 sessionId: src_id|1e5b6fe3-7e7d6457-e882b38-56c1e0d9_0
2025-09-30T14:53:07.219538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af8e0783-f7072415-c584fb7c-8f466c81_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1e5b6fe3-7e7d6457-e882b38-56c1e0d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:07.222535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5b6fe3-7e7d6457-e882b38-56c1e0d9_0] Write session: try to update token
2025-09-30T14:53:07.222555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5b6fe3-7e7d6457-e882b38-56c1e0d9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:07.231443Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:07.231471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:07.231475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:07.231478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:07.231488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895391776879320:7041]
2025-09-30T14:53:07.231495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895391776879320:7041]
2025-09-30T14:53:07.231500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895391776879320:7041]
2025-09-30T14:53:07.231543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:07.231551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.231554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:07.231569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:07.231577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:07.231582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:07.231706Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:07.238932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1080 sessionId: src_id|1e5b6fe3-7e7d6457-e882b38-56c1e0d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:07.241819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:07.293916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895391866627244:5026]
2025-09-30T14:53:07.294268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1079, pipe: [1:7555895391866627244:5026]
2025-09-30T14:53:07.348599Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:07.348985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:07.349010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:07.349032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895391866627244:5026], now have 1 active actors on pipe
2025-09-30T14:53:07.349206Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:07.349306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:07.349321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:07.349326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895391866627244:5026]
2025-09-30T14:53:07.349357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:07.349387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1080 reason: error at write: Disconnected sessionId: src_id|1e5b6fe3-7e7d6457-e882b38-56c1e0d9_0
2025-09-30T14:53:07.349593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1080 sessionId: src_id|1e5b6fe3-7e7d6457-e882b38-56c1e0d9_0 is DEAD
2025-09-30T14:53:07.349797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5b6fe3-7e7d6457-e882b38-56c1e0d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:07.349808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5b6fe3-7e7d6457-e882b38-56c1e0d9_0] Write session will restart in 0.008901s
2025-09-30T14:53:07.349831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5b6fe3-7e7d6457-e882b38-56c1e0d9_0] Write session: Do CDS request
2025-09-30T14:53:07.349837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5b6fe3-7e7d6457-e882b38-56c1e0d9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:07.359780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5b6fe3-7e7d6457-e882b38-56c1e0d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:07.359901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:07.359917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1081
2025-09-30T14:53:07.360037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1081 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:07.360069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1081 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:07.360079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1081 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:07.360084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:07.360503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1081 sessionId:  describe result for acl check
2025-09-30T14:53:07.360552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:07.360563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:07.360566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:07.360572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895391866627353:4417] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:07.361145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895391866627353:4417] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:07.362927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:07.363514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895391866627353:4417] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:07.364979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:07.365175Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:07.365186Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:07.365197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:07.365247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:07.365287Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895391776879487:7043]
2025-09-30T14:53:07.366009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:07.366267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:07.366283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895391866627353:4417] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:07.366297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895391866627353:4417] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:07.366310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:07.366300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895391866627353:4417] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:07.366308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1081 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:07.366631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:07.366701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:07.366707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:07.366709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:07.366710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:07.366711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:07.366712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:07.366714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:07.366715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:07.366717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:07.366718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:07.366719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.366720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.366722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.366723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:07.366724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:07.366730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:07.366740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:07.366745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:07.366749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:07.366754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:07.366759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:07.366763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:07.366768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:07.366772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:07.366776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:07.366781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.366785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.366790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.366794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:07.366798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:07.366806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:07.366814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:07.366820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:07.366827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:07.366832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:07.366838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:07.366843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:07.366849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:07.366854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:07.366860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:07.366865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:07.366870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:07.366875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:07.366880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:07.366885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:07.366890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:07.366896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:07.366901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:07.366906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:07.366919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:07.366924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.366930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.366935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.366941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.366949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.366955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.366959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:07.366964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:07.366974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:07.366980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:07.367030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:07.372751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:07.373675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:07.373692Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:07.373696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:07.373701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:07.373709Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1080 [2:7555895391776879487:7043]
2025-09-30T14:53:07.373737Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:07.373755Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:07.373763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:07.373766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:07.373769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:07.373786Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:07.373798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:07.373807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:07.373880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.373888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.373890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.373894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:07.373897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:07.373971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:07.373979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.373992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.374005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.374028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:07.374052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895391866627245:2454], now have 1 active actors on pipe
2025-09-30T14:53:07.374061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895391866627406:4417], now have 1 active actors on pipe
2025-09-30T14:53:07.374067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895391776879482:7043]
2025-09-30T14:53:07.374070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895391776879482:7043]
2025-09-30T14:53:07.374072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895391776879482:7043]
2025-09-30T14:53:07.374085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:07.374096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:07.374099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:07.374101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:07.374104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:07.374120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:07.374128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:07.374115Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1080
2025-09-30T14:53:07.374115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1080
2025-09-30T14:53:07.374175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895391776879482:7043]
2025-09-30T14:53:07.374191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:07.374213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:07.374220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:07.374225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:07.374278Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e7bf0ae-8d7f9cb9-97a9f25d-64d669ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:07.374290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:07.374294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:07.374296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:07.374306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:07.374319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:07.374345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:07.374485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:07.374495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:07.374508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:07.374600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1081 partition: 0 MaxSeqNo: 42 sessionId: src_id|6e7bf0ae-8d7f9cb9-97a9f25d-64d669ff_0
2025-09-30T14:53:07.375027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5b6fe3-7e7d6457-e882b38-56c1e0d9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6e7bf0ae-8d7f9cb9-97a9f25d-64d669ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:07.378006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e7bf0ae-8d7f9cb9-97a9f25d-64d669ff_0] Write session: try to update token
2025-09-30T14:53:07.378027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e7bf0ae-8d7f9cb9-97a9f25d-64d669ff_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:07.386878Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:07.386903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:07.386906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:07.386908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:07.386917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895391776879482:7043]
2025-09-30T14:53:07.386923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895391776879482:7043]
2025-09-30T14:53:07.386927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895391776879482:7043]
2025-09-30T14:53:07.386971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:07.386983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:07.386989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.386991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:07.386993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:07.386996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:07.387141Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:07.393722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1081 sessionId: src_id|6e7bf0ae-8d7f9cb9-97a9f25d-64d669ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:07.396612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:07.449529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895391866627438:5026]
2025-09-30T14:53:07.449784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1080, pipe: [1:7555895391866627438:5026]
2025-09-30T14:53:07.502117Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:07.502469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:07.502488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:07.502528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895391866627438:5026], now have 1 active actors on pipe
2025-09-30T14:53:07.502766Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:07.502754Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:07.502781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:07.502786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:07.502826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895391866627438:5026]
2025-09-30T14:53:07.502861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1081 reason: error at write: Disconnected sessionId: src_id|6e7bf0ae-8d7f9cb9-97a9f25d-64d669ff_0
2025-09-30T14:53:07.503090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1081 sessionId: src_id|6e7bf0ae-8d7f9cb9-97a9f25d-64d669ff_0 is DEAD
2025-09-30T14:53:07.503349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e7bf0ae-8d7f9cb9-97a9f25d-64d669ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:07.503376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e7bf0ae-8d7f9cb9-97a9f25d-64d669ff_0] Write session will restart in 0.008354s
2025-09-30T14:53:07.503401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e7bf0ae-8d7f9cb9-97a9f25d-64d669ff_0] Write session: Do CDS request
2025-09-30T14:53:07.503410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e7bf0ae-8d7f9cb9-97a9f25d-64d669ff_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:07.512817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e7bf0ae-8d7f9cb9-97a9f25d-64d669ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:07.512957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:07.512974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1082
2025-09-30T14:53:07.513142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1082 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:07.513204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1082 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:07.513214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1082 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:07.513219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:07.513678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1082 sessionId:  describe result for acl check
2025-09-30T14:53:07.513717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:07.513727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:07.513729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:07.513734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895391866627528:4402] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:07.514269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895391866627528:4402] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:07.516305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:07.516915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895391866627528:4402] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:07.518629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:07.518872Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:07.518889Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:07.518901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:07.518966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:07.519010Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895391776879686:7057]
2025-09-30T14:53:07.519327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895391866627528:4402] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:07.519341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895391866627528:4402] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:07.519345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895391866627528:4402] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:07.519354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1082 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:07.519674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:07.520036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:07.520106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:07.520468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:07.520532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:07.520538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:07.520539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:07.520540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:07.520542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:07.520543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:07.520544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:07.520545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:07.520547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:07.520548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:07.520550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.520551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.520552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.520553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:07.520554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:07.520561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:07.520571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:07.520575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:07.520579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:07.520583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:07.520587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:07.520591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:07.520595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:07.520598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:07.520602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:07.520606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.520609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.520613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.520617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:07.520621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:07.520629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:07.520638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:07.520645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:07.520651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:07.520656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:07.520662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:07.520667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:07.520673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:07.520677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:07.520683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:07.520687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:07.520693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:07.520698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:07.520703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:07.520708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:07.520713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:07.520718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:07.520723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:07.520728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:07.520733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:07.520738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.520744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.520747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.520759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.520763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.520768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.520779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:07.520784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:07.520788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:07.520793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:07.520840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:07.526437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:07.527584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:07.527598Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:07.527600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:07.527604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:07.527611Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1081 [2:7555895391776879686:7057]
2025-09-30T14:53:07.527627Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:07.527642Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:07.527646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:07.527649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:07.527652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:07.527667Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:07.527674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:07.527681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:07.527746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.527754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.527757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.527760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:07.527763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:07.527826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:07.527835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.527848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.527861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.527878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:07.527901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895391776879681:7057]
2025-09-30T14:53:07.527908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895391776879681:7057]
2025-09-30T14:53:07.527911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895391776879681:7057]
2025-09-30T14:53:07.527919Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:07.527931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:07.527933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895391866627601:4402], now have 1 active actors on pipe
2025-09-30T14:53:07.527939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895391866627441:2454], now have 1 active actors on pipe
2025-09-30T14:53:07.527944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:07.527944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:07.527947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:07.527958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:07.527961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:07.528002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895391776879681:7057]
2025-09-30T14:53:07.528014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:07.528024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:07.528056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1081
2025-09-30T14:53:07.528058Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1081
2025-09-30T14:53:07.528159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:07.528170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:07.528200Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4007172-564e3d55-fc529269-a3d6b328_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:07.528215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:07.528224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:07.528227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:07.528237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:07.528251Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:07.528270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:07.528421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:07.528432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:07.528451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:07.528578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1082 partition: 0 MaxSeqNo: 42 sessionId: src_id|b4007172-564e3d55-fc529269-a3d6b328_0
2025-09-30T14:53:07.528958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e7bf0ae-8d7f9cb9-97a9f25d-64d669ff_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b4007172-564e3d55-fc529269-a3d6b328_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:07.532019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4007172-564e3d55-fc529269-a3d6b328_0] Write session: try to update token
2025-09-30T14:53:07.532037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4007172-564e3d55-fc529269-a3d6b328_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:07.549122Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:07.549149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:07.549161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895391776879681:7057]
2025-09-30T14:53:07.549210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:07.549228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:07.549330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1082 sessionId: src_id|b4007172-564e3d55-fc529269-a3d6b328_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:07.549404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:07.549569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:07.549725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:07.549883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:07.550115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:07.550191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:07.551997Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:07.552013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:07.552015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:07.552017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:07.552026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895391776879681:7057]
2025-09-30T14:53:07.552031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895391776879681:7057]
2025-09-30T14:53:07.552036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895391776879681:7057]
2025-09-30T14:53:07.552079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:07.552087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.552092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:07.552093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:07.552101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:07.552113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:07.552242Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:07.552447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:07.603133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895391866627613:5026]
2025-09-30T14:53:07.603439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1081, pipe: [1:7555895391866627613:5026]
2025-09-30T14:53:07.666406Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:07.666925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:07.666944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:07.666966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895391866627613:5026], now have 1 active actors on pipe
2025-09-30T14:53:07.667196Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:07.667201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895391866627613:5026]
2025-09-30T14:53:07.667232Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:07.667233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:07.667237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:07.667332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1082 reason: error at write: Disconnected sessionId: src_id|b4007172-564e3d55-fc529269-a3d6b328_0
2025-09-30T14:53:07.667528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1082 sessionId: src_id|b4007172-564e3d55-fc529269-a3d6b328_0 is DEAD
2025-09-30T14:53:07.667706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4007172-564e3d55-fc529269-a3d6b328_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:07.667730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4007172-564e3d55-fc529269-a3d6b328_0] Write session will restart in 0.008761s
2025-09-30T14:53:07.667755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4007172-564e3d55-fc529269-a3d6b328_0] Write session: Do CDS request
2025-09-30T14:53:07.667761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4007172-564e3d55-fc529269-a3d6b328_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:07.677830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4007172-564e3d55-fc529269-a3d6b328_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:07.677891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:07.677908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1083
2025-09-30T14:53:07.678027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1083 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:07.678059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1083 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:07.678078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1083 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:07.678082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:07.678677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1083 sessionId:  describe result for acl check
2025-09-30T14:53:07.678715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:07.678717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:07.678719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:07.678725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895391866627704:4396] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:07.679308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895391866627704:4396] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:07.681336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895391866627704:4396] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:07.681365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:07.683591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:07.683801Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:07.683811Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:07.683822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:07.683872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:07.683908Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895391776879852:7060]
2025-09-30T14:53:07.683924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895391866627704:4396] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:07.683940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895391866627704:4396] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:07.683944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895391866627704:4396] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:07.683952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1083 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:07.684589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:07.684901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:07.684949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:07.685283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:07.685361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:07.685368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:07.685369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:07.685370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:07.685371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:07.685373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:07.685374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:07.685375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:07.685376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:07.685378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:07.685379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.685381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.685382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.685383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:07.685384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:07.685389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:07.685400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:07.685405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:07.685410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:07.685413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:07.685418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:07.685422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:07.685426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:07.685430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:07.685437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:07.685441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.685445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.685449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.685453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:07.685457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:07.685465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:07.685473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:07.685480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:07.685486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:07.685491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:07.685497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:07.685503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:07.685508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:07.685513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:07.685519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:07.685523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:07.685528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:07.685534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:07.685539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:07.685543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:07.685549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:07.685554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:07.685559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:07.685562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:07.685568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:07.685573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.685579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.685583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.685588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.685593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.685598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.685602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:07.685608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:07.685612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:07.685617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:07.685686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:07.691341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:07.692499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:07.692522Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:07.692525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:07.692529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:07.692536Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1082 [2:7555895391776879852:7060]
2025-09-30T14:53:07.692553Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:07.692569Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:07.692572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:07.692576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:07.692578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:07.692595Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:07.692601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:07.692609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:07.692678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.692687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.692690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.692693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:07.692696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:07.692760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:07.692768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.692782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.692799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.692822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:07.692846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895391866627614:2454], now have 1 active actors on pipe
2025-09-30T14:53:07.692858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895391866627775:4396], now have 1 active actors on pipe
2025-09-30T14:53:07.692865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895391776879847:7060]
2025-09-30T14:53:07.692868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895391776879847:7060]
2025-09-30T14:53:07.692870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895391776879847:7060]
2025-09-30T14:53:07.692883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:07.692898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:07.692900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:07.692910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:07.692913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:07.692918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:07.692922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:07.692958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895391776879847:7060]
2025-09-30T14:53:07.692975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:07.692946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1082
2025-09-30T14:53:07.692947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1082
2025-09-30T14:53:07.693009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:07.693063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:07.693072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:07.693098Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6fdcbf70-188a5c99-1546576-68527f04_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:07.693110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:07.693113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:07.693116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:07.693127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:07.693143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:07.693161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:07.693322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:07.693331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:07.693346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:07.693440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1083 partition: 0 MaxSeqNo: 42 sessionId: src_id|6fdcbf70-188a5c99-1546576-68527f04_0
2025-09-30T14:53:07.693830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4007172-564e3d55-fc529269-a3d6b328_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6fdcbf70-188a5c99-1546576-68527f04_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:07.696785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fdcbf70-188a5c99-1546576-68527f04_0] Write session: try to update token
2025-09-30T14:53:07.696807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fdcbf70-188a5c99-1546576-68527f04_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:07.705214Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:07.705240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:07.705243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:07.705245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:07.705255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895391776879847:7060]
2025-09-30T14:53:07.705259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895391776879847:7060]
2025-09-30T14:53:07.705263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895391776879847:7060]
2025-09-30T14:53:07.705308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:07.705317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.705319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:07.705338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:07.705357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:07.705365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:07.705472Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:07.714588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1083 sessionId: src_id|6fdcbf70-188a5c99-1546576-68527f04_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:07.717342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:07.767519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895391866627787:5026]
2025-09-30T14:53:07.767839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1082, pipe: [1:7555895391866627787:5026]
2025-09-30T14:53:07.817021Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:07.817386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:07.817402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:07.817421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895391866627787:5026], now have 1 active actors on pipe
2025-09-30T14:53:07.817643Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:07.817678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:07.817687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895391866627787:5026]
2025-09-30T14:53:07.817716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:07.817790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1083 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6fdcbf70-188a5c99-1546576-68527f04_0
2025-09-30T14:53:07.818018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1083 sessionId: src_id|6fdcbf70-188a5c99-1546576-68527f04_0 is DEAD
2025-09-30T14:53:07.818180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fdcbf70-188a5c99-1546576-68527f04_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:07.818202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fdcbf70-188a5c99-1546576-68527f04_0] Write session will restart in 0.005457s
2025-09-30T14:53:07.818227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fdcbf70-188a5c99-1546576-68527f04_0] Write session: Do CDS request
2025-09-30T14:53:07.818232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fdcbf70-188a5c99-1546576-68527f04_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:07.824831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fdcbf70-188a5c99-1546576-68527f04_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:07.824922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:07.824939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1084
2025-09-30T14:53:07.825082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1084 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:07.825114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1084 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:07.825124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1084 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:07.825129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:07.825619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1084 sessionId:  describe result for acl check
2025-09-30T14:53:07.825663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:07.825666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:07.825668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:07.825674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895391866627812:4388] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:07.826275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895391866627812:4388] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:07.828676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895391866627812:4388] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:07.830677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:07.832903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:07.833087Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:07.833098Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:07.833108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:07.833155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:07.833136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895391866627812:4388] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:07.833151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895391866627812:4388] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:07.833155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895391866627812:4388] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:07.833164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1084 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:07.833195Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895391776880017:7062]
2025-09-30T14:53:07.833852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:07.834128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:07.834185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:07.834508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:07.834579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:07.834586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:07.834588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:07.834589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:07.834590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:07.834592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:07.834593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:07.834595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:07.834596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:07.834597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:07.834598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.834599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.834600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.834602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:07.834603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:07.834608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:07.834619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:07.834624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:07.834628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:07.834633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:07.834637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:07.834641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:07.834644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:07.834647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:07.834652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:07.834656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.834660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.834665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.834669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:07.834673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:07.834680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:07.834688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:07.834694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:07.834700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:07.834705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:07.834711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:07.834716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:07.834721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:07.834727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:07.834732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:07.834736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:07.834742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:07.834746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:07.834751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:07.834755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:07.834760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:07.834765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:07.834770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:07.834776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:07.834781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:07.834786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.834791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.834795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.834799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.834804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.834809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.834815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:07.834819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:07.834824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:07.834829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:07.834880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:07.840688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:07.841852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:07.841876Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:07.841879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:07.841884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:07.841890Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1083 [2:7555895391776880017:7062]
2025-09-30T14:53:07.841910Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:07.841925Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:07.841928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:07.841931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:07.841933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:07.841953Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:07.841965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:07.841972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:07.842031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.842040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.842042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.842045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:07.842048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:07.842114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:07.842123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.842150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:07.842168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:07.842184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:07.842208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895391866627788:2454], now have 1 active actors on pipe
2025-09-30T14:53:07.842216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895391866627950:4388], now have 1 active actors on pipe
2025-09-30T14:53:07.842222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895391776880012:7062]
2025-09-30T14:53:07.842225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895391776880012:7062]
2025-09-30T14:53:07.842227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895391776880012:7062]
2025-09-30T14:53:07.842238Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:07.842249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:07.842250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:07.842252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:07.842254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:07.842268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:07.842271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:07.842304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895391776880012:7062]
2025-09-30T14:53:07.842318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:07.842323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:07.842307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1083
2025-09-30T14:53:07.842312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1083
2025-09-30T14:53:07.842371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:07.842381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:07.842405Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|701c6c27-7ede6813-a11b4338-3ca45b08_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:07.842412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:07.842420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:07.842423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:07.842432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:07.842441Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:07.842454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:07.842596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:07.842604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:07.842617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:07.842706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1084 partition: 0 MaxSeqNo: 42 sessionId: src_id|701c6c27-7ede6813-a11b4338-3ca45b08_0
2025-09-30T14:53:07.843093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fdcbf70-188a5c99-1546576-68527f04_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|701c6c27-7ede6813-a11b4338-3ca45b08_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:07.845984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|701c6c27-7ede6813-a11b4338-3ca45b08_0] Write session: try to update token
2025-09-30T14:53:07.846004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|701c6c27-7ede6813-a11b4338-3ca45b08_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:07.854927Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:07.854948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:07.854958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895391776880012:7062]
2025-09-30T14:53:07.855005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:07.855026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:07.855211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:07.855402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:07.855592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:07.855773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:07.856028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:07.856081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:07.861238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1084 sessionId: src_id|701c6c27-7ede6813-a11b4338-3ca45b08_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:07.864194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:07.864437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:07.864465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:07.864505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:07.864638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:07.866125Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:07.866158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:07.866161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:07.866163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:07.866173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895391776880012:7062]
2025-09-30T14:53:07.866178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895391776880012:7062]
2025-09-30T14:53:07.866183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895391776880012:7062]
2025-09-30T14:53:07.866223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:07.866229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:07.866235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:07.866230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:07.866254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:07.866268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:07.866375Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:07.918016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895391866627962:5026]
2025-09-30T14:53:07.918388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1083, pipe: [1:7555895391866627962:5026]
2025-09-30T14:53:07.983089Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:07.991713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:07.991742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:07.991928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:07.992005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:07.992078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:07.992152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:07.992205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:07.992220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:07.992303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:07.992371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:07.992439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:07.992520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:07.992566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:07.992576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:07.992646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:07.992723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:07.992793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:07.992878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:07.992923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:07.992930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:07.993003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:07.993073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:07.993144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:07.993213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:07.993258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:07.993266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:07.993343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:07.993412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:07.993496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:07.993575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:07.993622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:07.993632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:07.993713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:07.993798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:07.993872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:07.993953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:07.994003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:07.994011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:07.994083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:07.994178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:07.994255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:07.994327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:07.994376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:07.994390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:07.994464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:07.994527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:07.994589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:07.994654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:07.994703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:07.994706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:07.994779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:07.994838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:07.994893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:07.994951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:07.995049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:07.995052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:07.995116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:07.995171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:07.995229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:07.995394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:07.995444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:07.995452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:07.995513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895391866627962:5026], now have 1 active actors on pipe
2025-09-30T14:53:07.995802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:07.995855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:07.995858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:07.995902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1084 reason: error at write: Disconnected sessionId: src_id|701c6c27-7ede6813-a11b4338-3ca45b08_0
2025-09-30T14:53:07.996105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1084 sessionId: src_id|701c6c27-7ede6813-a11b4338-3ca45b08_0 is DEAD
2025-09-30T14:53:07.996130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895391866627962:5026]
2025-09-30T14:53:07.996349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|701c6c27-7ede6813-a11b4338-3ca45b08_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:07.996359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|701c6c27-7ede6813-a11b4338-3ca45b08_0] Write session will restart in 0.009085s
2025-09-30T14:53:07.996382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|701c6c27-7ede6813-a11b4338-3ca45b08_0] Write session: Do CDS request
2025-09-30T14:53:07.996388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|701c6c27-7ede6813-a11b4338-3ca45b08_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:07.996584Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:08.006855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|701c6c27-7ede6813-a11b4338-3ca45b08_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:08.006951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:08.006967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1085
2025-09-30T14:53:08.007138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1085 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:08.007175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1085 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:08.007184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1085 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:08.007188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:08.007670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1085 sessionId:  describe result for acl check
2025-09-30T14:53:08.007709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:08.007716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:08.007721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:08.007727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895396161595365:4377] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:08.008301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895396161595365:4377] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:08.010771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:08.011015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895396161595365:4377] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:08.013104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:08.013383Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:08.013393Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:08.013403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:08.013461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:08.013503Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895396071847479:7064]
2025-09-30T14:53:08.013863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895396161595365:4377] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:08.013877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895396161595365:4377] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:08.013881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895396161595365:4377] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:08.013890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1085 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:08.014114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:08.014465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:08.014512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:08.014849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:08.014906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:08.014912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:08.014913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:08.014914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:08.014916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:08.014917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:08.014918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:08.014919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:08.014921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:08.014922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:08.014923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.014924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.014925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.014927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:08.014928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:08.014934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:08.014941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:08.014944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:08.014946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:08.014950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:08.014954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:08.014958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:08.014961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:08.014965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:08.014969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:08.014974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.014977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.014980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.014982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:08.014984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:08.014990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:08.014995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:08.014999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:08.015003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:08.015005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:08.015009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:08.015012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:08.015015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:08.015018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:08.015021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:08.015024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:08.015027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:08.015030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:08.015033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:08.015036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:08.015039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:08.015042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:08.015045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:08.015048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:08.015051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:08.015054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.015057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.015060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.015063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.015065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.015068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.015072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:08.015075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:08.015078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:08.015081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:08.015104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:08.020656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:08.021558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:08.021573Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:08.021577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:08.021580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:08.021585Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1084 [2:7555895396071847479:7064]
2025-09-30T14:53:08.021597Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:08.021611Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:08.021613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:08.021615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:08.021618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:08.021630Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:08.021636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:08.021642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:08.021688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.021694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.021696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.021699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:08.021701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:08.021766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:08.021774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.021788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.021801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.021824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:08.021852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895396161595422:4377], now have 1 active actors on pipe
2025-09-30T14:53:08.021856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895391866627966:2454], now have 1 active actors on pipe
2025-09-30T14:53:08.021863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895396071847474:7064]
2025-09-30T14:53:08.021865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895396071847474:7064]
2025-09-30T14:53:08.021867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895396071847474:7064]
2025-09-30T14:53:08.021881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:08.021894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:08.021907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:08.021914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:08.021918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:08.021893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1084
2025-09-30T14:53:08.021920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:08.021922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:08.021898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1084
2025-09-30T14:53:08.021949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895396071847474:7064]
2025-09-30T14:53:08.021952Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:08.021960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:08.021976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:08.021981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:08.022012Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43519c42-d48c85f9-a158de45-c52b9198_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:08.022026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:08.022031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:08.022034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:08.022043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:08.022057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:08.022082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:08.022477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:08.022490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:08.022506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:08.022619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1085 partition: 0 MaxSeqNo: 42 sessionId: src_id|43519c42-d48c85f9-a158de45-c52b9198_0
2025-09-30T14:53:08.023018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|701c6c27-7ede6813-a11b4338-3ca45b08_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|43519c42-d48c85f9-a158de45-c52b9198_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:08.026020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43519c42-d48c85f9-a158de45-c52b9198_0] Write session: try to update token
2025-09-30T14:53:08.026040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43519c42-d48c85f9-a158de45-c52b9198_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:08.034498Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:08.034526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:08.034529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:08.034531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:08.034542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895396071847474:7064]
2025-09-30T14:53:08.034547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895396071847474:7064]
2025-09-30T14:53:08.034551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895396071847474:7064]
2025-09-30T14:53:08.034595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:08.034602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:08.034603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.034606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:08.034618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:08.034625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:08.034752Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:08.041340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1085 sessionId: src_id|43519c42-d48c85f9-a158de45-c52b9198_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:08.044236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:08.096191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895396161595445:5026]
2025-09-30T14:53:08.096546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1084, pipe: [1:7555895396161595445:5026]
2025-09-30T14:53:08.147179Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:08.147665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:08.147684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:08.147726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895396161595445:5026], now have 1 active actors on pipe
2025-09-30T14:53:08.147939Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:08.147999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895396161595445:5026]
2025-09-30T14:53:08.148001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:08.148036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:08.148116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1085 reason: status is not ok: tablet will be restarted right now sessionId: src_id|43519c42-d48c85f9-a158de45-c52b9198_0
2025-09-30T14:53:08.148267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1085 sessionId: src_id|43519c42-d48c85f9-a158de45-c52b9198_0 is DEAD
2025-09-30T14:53:08.148442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43519c42-d48c85f9-a158de45-c52b9198_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:08.148453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43519c42-d48c85f9-a158de45-c52b9198_0] Write session will restart in 0.007197s
2025-09-30T14:53:08.148476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43519c42-d48c85f9-a158de45-c52b9198_0] Write session: Do CDS request
2025-09-30T14:53:08.148483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43519c42-d48c85f9-a158de45-c52b9198_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:08.156843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43519c42-d48c85f9-a158de45-c52b9198_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:08.156946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:08.156962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1086
2025-09-30T14:53:08.157072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1086 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:08.157106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1086 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:08.157112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1086 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:08.157123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:08.157626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1086 sessionId:  describe result for acl check
2025-09-30T14:53:08.157659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:08.157666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:08.157668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:08.157675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895396161595520:4364] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:08.158231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895396161595520:4364] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:08.160732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895396161595520:4364] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:08.161440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:08.163573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:08.163791Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:08.163802Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:08.163812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:08.163863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:08.163874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895396161595520:4364] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:08.163888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895396161595520:4364] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:08.163892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895396161595520:4364] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:08.163900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1086 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:08.163914Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895396071847660:7068]
2025-09-30T14:53:08.164568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:08.164898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:08.164943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:08.165271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:08.165339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:08.165346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:08.165347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:08.165348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:08.165350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:08.165351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:08.165353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:08.165354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:08.165356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:08.165357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:08.165358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.165360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.165361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.165362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:08.165364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:08.165369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:08.165379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:08.165384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:08.165388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:08.165392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:08.165395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:08.165398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:08.165402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:08.165406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:08.165411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:08.165415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.165418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.165422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.165425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:08.165428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:08.165437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:08.165445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:08.165452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:08.165458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:08.165462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:08.165469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:08.165475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:08.165481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:08.165485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:08.165492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:08.165496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:08.165500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:08.165505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:08.165510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:08.165514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:08.165518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:08.165523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:08.165528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:08.165531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:08.165537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:08.165541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.165545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.165549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.165554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.165559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.165563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.165575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:08.165580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:08.165585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:08.165590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:08.165636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:08.171204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:08.172094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:08.172113Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:08.172115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:08.172118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:08.172124Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1085 [2:7555895396071847660:7068]
2025-09-30T14:53:08.172140Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:08.172157Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:08.172167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:08.172170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:08.172183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:08.172201Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:08.172214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:08.172226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:08.172298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.172305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.172308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.172312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:08.172315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:08.172383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:08.172389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.172400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.172411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.172428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:08.172447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895396161595459:2454], now have 1 active actors on pipe
2025-09-30T14:53:08.172455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895396161595622:4364], now have 1 active actors on pipe
2025-09-30T14:53:08.172461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895396071847655:7068]
2025-09-30T14:53:08.172464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895396071847655:7068]
2025-09-30T14:53:08.172466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895396071847655:7068]
2025-09-30T14:53:08.172480Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:08.172499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:08.172513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:08.172518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:08.172518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:08.172520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:08.172522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:08.172554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895396071847655:7068]
2025-09-30T14:53:08.172567Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:08.172558Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1085
2025-09-30T14:53:08.172594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1085
2025-09-30T14:53:08.172592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:08.172688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:08.172700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:08.172723Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe353059-6a81491d-9774dae2-cf136fac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:08.172734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:08.172742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:08.172744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:08.172754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:08.172767Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:08.172785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:08.172931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:08.172942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:08.172956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:08.173034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1086 partition: 0 MaxSeqNo: 42 sessionId: src_id|fe353059-6a81491d-9774dae2-cf136fac_0
2025-09-30T14:53:08.173461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43519c42-d48c85f9-a158de45-c52b9198_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fe353059-6a81491d-9774dae2-cf136fac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:08.176541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe353059-6a81491d-9774dae2-cf136fac_0] Write session: try to update token
2025-09-30T14:53:08.176560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe353059-6a81491d-9774dae2-cf136fac_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:08.184916Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:08.184938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:08.184950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895396071847655:7068]
2025-09-30T14:53:08.185000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:08.185005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:08.185184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:08.185336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:08.185486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:08.185636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:08.185850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:08.185893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:08.192122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1086 sessionId: src_id|fe353059-6a81491d-9774dae2-cf136fac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:08.194939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:08.195861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:08.195891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:08.195911Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:08.195915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:08.195917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:08.195920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:08.195929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895396071847655:7068]
2025-09-30T14:53:08.195933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895396071847655:7068]
2025-09-30T14:53:08.195937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895396071847655:7068]
2025-09-30T14:53:08.195985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:08.195997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.195998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:08.196000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:08.196005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:08.196009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:08.196133Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:08.248283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895396161595635:5026]
2025-09-30T14:53:08.248559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1085, pipe: [1:7555895396161595635:5026]
2025-09-30T14:53:08.313780Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:08.314358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:08.314414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895396161595635:5026], now have 1 active actors on pipe
2025-09-30T14:53:08.314528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:08.314606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:08.314658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895396161595635:5026]
2025-09-30T14:53:08.326166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:08.326182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:08.326207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1086 reason: error at write: Disconnected sessionId: src_id|fe353059-6a81491d-9774dae2-cf136fac_0
2025-09-30T14:53:08.326455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1086 sessionId: src_id|fe353059-6a81491d-9774dae2-cf136fac_0 is DEAD
2025-09-30T14:53:08.326565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe353059-6a81491d-9774dae2-cf136fac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:08.326572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe353059-6a81491d-9774dae2-cf136fac_0] Write session will restart in 0.007591s
2025-09-30T14:53:08.326594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe353059-6a81491d-9774dae2-cf136fac_0] Write session: Do CDS request
2025-09-30T14:53:08.326600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe353059-6a81491d-9774dae2-cf136fac_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:08.335775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe353059-6a81491d-9774dae2-cf136fac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:08.335912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:08.335928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1087
2025-09-30T14:53:08.335989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:08.336048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1087 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:08.336084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1087 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:08.336094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1087 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:08.336099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:08.336493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1087 sessionId:  describe result for acl check
2025-09-30T14:53:08.336533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:08.336539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:08.336541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:08.336546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895396161595768:4360] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:08.337016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895396161595768:4360] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:08.338353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:08.338700Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:08.338712Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:08.338726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:08.338798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:08.338841Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895396071847828:7070]
2025-09-30T14:53:08.339537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:08.339789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895396161595768:4360] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:08.339890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:08.339958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:08.340343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:08.340418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:08.340424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:08.340426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:08.340427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:08.340428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:08.340430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:08.340431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:08.340433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:08.340434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:08.340435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:08.340436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.340437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.340438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.340440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:08.340441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:08.340447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:08.340457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:08.340461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:08.340465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:08.340469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:08.340473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:08.340477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:08.340481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:08.340486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:08.340490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:08.340494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.340498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.340502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.340506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:08.340510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:08.340519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:08.340536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:08.340543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:08.340549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:08.340554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:08.340559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:08.340564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:08.340569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:08.340575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:08.340587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:08.340591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:08.340597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:08.340603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:08.340608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:08.340618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:08.340623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:08.340628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:08.340633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:08.340640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:08.340646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:08.340655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.340660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.340665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.340675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.340680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.340690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.340695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:08.340704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:08.340713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:08.340719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:08.340767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:08.345980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895396161595768:4360] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:08.346002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895396161595768:4360] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:08.346006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895396161595768:4360] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:08.346015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1087 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:08.346316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:08.347454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:08.347471Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:08.347472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:08.347476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:08.347482Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1086 [2:7555895396071847828:7070]
2025-09-30T14:53:08.347495Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:08.347509Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:08.347511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:08.347513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:08.347514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:08.347526Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:08.347533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:08.347541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:08.347595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.347601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.347603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.347605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:08.347607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:08.347659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:08.347664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.347672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.347679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.347692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:08.347706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895396071847823:7070]
2025-09-30T14:53:08.347712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895396071847823:7070]
2025-09-30T14:53:08.347714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895396071847823:7070]
2025-09-30T14:53:08.347723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:08.347732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:08.347739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:08.347745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:08.347748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:08.347753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:08.347756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:08.347769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895396161595636:2454], now have 1 active actors on pipe
2025-09-30T14:53:08.347773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895396161595806:4360], now have 1 active actors on pipe
2025-09-30T14:53:08.347806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895396071847823:7070]
2025-09-30T14:53:08.347822Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:08.347841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:08.347831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1086
2025-09-30T14:53:08.347844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1086
2025-09-30T14:53:08.347880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:08.347891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:08.347916Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39ad6f6a-f6a5bd00-4344e03c-3b8a5152_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:08.347922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:08.347927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:08.347929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:08.347939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:08.347949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:08.347970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:08.348128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:08.348135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:08.348148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:08.348265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1087 partition: 0 MaxSeqNo: 42 sessionId: src_id|39ad6f6a-f6a5bd00-4344e03c-3b8a5152_0
2025-09-30T14:53:08.348714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe353059-6a81491d-9774dae2-cf136fac_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|39ad6f6a-f6a5bd00-4344e03c-3b8a5152_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:08.351591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39ad6f6a-f6a5bd00-4344e03c-3b8a5152_0] Write session: try to update token
2025-09-30T14:53:08.351607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39ad6f6a-f6a5bd00-4344e03c-3b8a5152_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:08.360109Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:08.360135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:08.360145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895396071847823:7070]
2025-09-30T14:53:08.360187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:08.360202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:08.360370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:08.360516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:08.360664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:08.360814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:08.361016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:08.361063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:08.366558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1087 sessionId: src_id|39ad6f6a-f6a5bd00-4344e03c-3b8a5152_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:08.369311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:08.369527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:08.369552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:08.369589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:08.369677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:08.370872Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:08.370889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:08.370899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:08.370900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:08.370909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895396071847823:7070]
2025-09-30T14:53:08.370913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895396071847823:7070]
2025-09-30T14:53:08.370916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895396071847823:7070]
2025-09-30T14:53:08.370953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:08.370958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:08.370964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.370965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:08.370967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:08.370970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:08.371107Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:08.414690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895396161595814:5026]
2025-09-30T14:53:08.415019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1086, pipe: [1:7555895396161595814:5026]
2025-09-30T14:53:08.484257Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:08.492143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:08.492171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:08.492332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:08.492391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:08.492470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:08.492539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:08.492721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:08.492730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:08.492794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:08.492862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:08.492925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:08.492993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:08.493038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:08.493046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:08.493119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:08.493182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:08.493251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:08.493315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:08.493357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:08.493363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:08.493428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:08.493812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:08.493878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:08.493937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:08.493978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:08.493984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:08.494049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:08.494123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:08.494204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:08.494290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:08.494437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:08.494447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:08.494516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:08.494579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:08.494645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:08.494711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:08.494755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:08.494764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:08.494833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:08.494903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:08.494972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:08.495041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:08.495086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:08.495096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:08.495165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:08.495226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:08.495308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:08.495375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:08.495423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:08.495431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:08.495503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:08.495563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:08.495628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:08.495698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:08.495742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:08.495750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:08.495819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:08.495881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:08.495946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:08.496013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:08.496060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:08.496068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:08.496127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895396161595814:5026], now have 1 active actors on pipe
2025-09-30T14:53:08.496273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895396161595814:5026]
2025-09-30T14:53:08.496309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:08.496311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:08.496313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:08.496339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1087 reason: error at write: Disconnected sessionId: src_id|39ad6f6a-f6a5bd00-4344e03c-3b8a5152_0
2025-09-30T14:53:08.496555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1087 sessionId: src_id|39ad6f6a-f6a5bd00-4344e03c-3b8a5152_0 is DEAD
2025-09-30T14:53:08.496698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ad6f6a-f6a5bd00-4344e03c-3b8a5152_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:08.496709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ad6f6a-f6a5bd00-4344e03c-3b8a5152_0] Write session will restart in 0.008811s
2025-09-30T14:53:08.496734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ad6f6a-f6a5bd00-4344e03c-3b8a5152_0] Write session: Do CDS request
2025-09-30T14:53:08.496739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ad6f6a-f6a5bd00-4344e03c-3b8a5152_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:08.496743Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:08.506756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39ad6f6a-f6a5bd00-4344e03c-3b8a5152_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:08.506854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:08.506891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1088
2025-09-30T14:53:08.507025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1088 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:08.507058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1088 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:08.507063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1088 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:08.507068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:08.507573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1088 sessionId:  describe result for acl check
2025-09-30T14:53:08.507612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:08.507614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:08.507616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:08.507622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895396161595954:4350] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:08.508196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895396161595954:4350] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:08.510049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:08.510485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895396161595954:4350] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:08.512459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:08.512682Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:08.512694Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:08.512704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:08.512755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:08.512798Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895396071848032:7084]
2025-09-30T14:53:08.513176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895396161595954:4350] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:08.513192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895396161595954:4350] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:08.513195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895396161595954:4350] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:08.513203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1088 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:08.513480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:08.513813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:08.513892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:08.514418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:08.514499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:08.514506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:08.514507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:08.514508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:08.514509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:08.514510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:08.514511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:08.514513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:08.514514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:08.514515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:08.514516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.514518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.514519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.514520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:08.514522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:08.514528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:08.514539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:08.514544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:08.514548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:08.514552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:08.514556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:08.514560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:08.514565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:08.514569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:08.514573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:08.514577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.514581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.514585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.514589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:08.514593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:08.514600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:08.514608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:08.514614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:08.514619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:08.514623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:08.514628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:08.514632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:08.514637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:08.514644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:08.514648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:08.514653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:08.514657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:08.514661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:08.514666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:08.514670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:08.514675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:08.514679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:08.514684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:08.514688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:08.514692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:08.514707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.514717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.514721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.514725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.514729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.514733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.514737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:08.514741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:08.514750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:08.514755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:08.514797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:08.520664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:08.521769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:08.521781Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:08.521784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:08.521788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:08.521796Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1087 [2:7555895396071848032:7084]
2025-09-30T14:53:08.521813Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:08.521829Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:08.521832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:08.521835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:08.521838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:08.521853Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:08.521860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:08.521867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:08.521924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.521932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.521934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.521938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:08.521942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:08.522011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:08.522019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.522033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.522045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.522064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:08.522080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895396161596005:4350], now have 1 active actors on pipe
2025-09-30T14:53:08.522083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895396161595840:2454], now have 1 active actors on pipe
2025-09-30T14:53:08.522090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895396071848027:7084]
2025-09-30T14:53:08.522094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895396071848027:7084]
2025-09-30T14:53:08.522096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895396071848027:7084]
2025-09-30T14:53:08.522108Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:08.522119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:08.522125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:08.522128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:08.522130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:08.522155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:08.522166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:08.522199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895396071848027:7084]
2025-09-30T14:53:08.522212Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:08.522195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1087
2025-09-30T14:53:08.522209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1087
2025-09-30T14:53:08.522244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:08.522287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:08.522298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:08.522335Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24e34774-e0f80813-e4ddf906-a6110480_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:08.522347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:08.522351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:08.522355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:08.522364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:08.522379Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:08.522405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:08.522563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:08.522577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:08.522602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:08.522736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1088 partition: 0 MaxSeqNo: 42 sessionId: src_id|24e34774-e0f80813-e4ddf906-a6110480_0
2025-09-30T14:53:08.523093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ad6f6a-f6a5bd00-4344e03c-3b8a5152_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|24e34774-e0f80813-e4ddf906-a6110480_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:08.525920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24e34774-e0f80813-e4ddf906-a6110480_0] Write session: try to update token
2025-09-30T14:53:08.525941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24e34774-e0f80813-e4ddf906-a6110480_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:08.534225Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:08.534240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:08.534251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895396071848027:7084]
2025-09-30T14:53:08.534290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:08.534307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:08.534478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:08.534631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:08.534768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:08.534907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:08.535293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:08.535336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:08.540778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1088 sessionId: src_id|24e34774-e0f80813-e4ddf906-a6110480_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:08.544075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:08.545099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:08.545125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:08.545147Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:08.545150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:08.545152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:08.545155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:08.545164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895396071848027:7084]
2025-09-30T14:53:08.545168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895396071848027:7084]
2025-09-30T14:53:08.545175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895396071848027:7084]
2025-09-30T14:53:08.545220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:08.545228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:08.545233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:08.545235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.545237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:08.545238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:08.545401Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:08.596439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895396161596017:5026]
2025-09-30T14:53:08.596762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1087, pipe: [1:7555895396161596017:5026]
2025-09-30T14:53:08.657510Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:08.657778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:08.657813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895396161596017:5026], now have 1 active actors on pipe
2025-09-30T14:53:08.657922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:08.657974Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:08.658017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895396161596017:5026]
2025-09-30T14:53:08.658039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:08.658043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:08.658113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1088 reason: error at write: Disconnected sessionId: src_id|24e34774-e0f80813-e4ddf906-a6110480_0
2025-09-30T14:53:08.658267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1088 sessionId: src_id|24e34774-e0f80813-e4ddf906-a6110480_0 is DEAD
2025-09-30T14:53:08.659334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24e34774-e0f80813-e4ddf906-a6110480_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:08.659347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24e34774-e0f80813-e4ddf906-a6110480_0] Write session will restart in 0.007137s
2025-09-30T14:53:08.659371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24e34774-e0f80813-e4ddf906-a6110480_0] Write session: Do CDS request
2025-09-30T14:53:08.659377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24e34774-e0f80813-e4ddf906-a6110480_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:08.667798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24e34774-e0f80813-e4ddf906-a6110480_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:08.667855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:08.667870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1089
2025-09-30T14:53:08.668067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1089 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:08.668094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1089 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:08.668099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1089 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:08.668104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:08.668576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1089 sessionId:  describe result for acl check
2025-09-30T14:53:08.668610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:08.668612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:08.668613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:08.668619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895396161596100:4349] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:08.669186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895396161596100:4349] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:08.671158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895396161596100:4349] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:08.671881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:08.673773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:08.673971Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:08.673985Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:08.673996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:08.674022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895396161596100:4349] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:08.674038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895396161596100:4349] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:08.674041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895396161596100:4349] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:08.674050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1089 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:08.674050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:08.674114Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895396071848203:7087]
2025-09-30T14:53:08.674805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:08.675121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:08.675199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:08.675554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:08.675651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:08.675660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:08.675662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:08.675663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:08.675664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:08.675665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:08.675666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:08.675667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:08.675668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:08.675670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:08.675671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.675672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.675673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.675674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:08.675675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:08.675682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:08.675692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:08.675696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:08.675700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:08.675704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:08.675708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:08.675712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:08.675716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:08.675719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:08.675724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:08.675728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.675731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.675735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.675739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:08.675743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:08.675752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:08.675760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:08.675766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:08.675772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:08.675777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:08.675782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:08.675787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:08.675792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:08.675797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:08.675802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:08.675807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:08.675812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:08.675817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:08.675822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:08.675826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:08.675831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:08.675835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:08.675840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:08.675844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:08.675848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:08.675853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.675857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.675860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.675864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.675868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.675872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.675876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:08.675880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:08.675887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:08.675891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:08.675930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:08.681657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:08.682878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:08.682893Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:08.682896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:08.682900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:08.682907Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1088 [2:7555895396071848203:7087]
2025-09-30T14:53:08.682925Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:08.682947Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:08.682955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:08.682958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:08.682960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:08.682977Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:08.682988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:08.682995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:08.683058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.683066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.683068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.683073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:08.683075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:08.683154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:08.683163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.683176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.683186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.683202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:08.683220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895396071848198:7087]
2025-09-30T14:53:08.683227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895396071848198:7087]
2025-09-30T14:53:08.683229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895396071848198:7087]
2025-09-30T14:53:08.683239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:08.683264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:08.683272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895396161596186:4349], now have 1 active actors on pipe
2025-09-30T14:53:08.683275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:08.683277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:08.683278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:08.683291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:08.683295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:08.683300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895396161596018:2454], now have 1 active actors on pipe
2025-09-30T14:53:08.683339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895396071848198:7087]
2025-09-30T14:53:08.683350Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:08.683350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:08.683356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1088
2025-09-30T14:53:08.683366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1088
2025-09-30T14:53:08.683547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:08.683559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:08.683585Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0c0671c-2a4af0da-3192a8c8-742bd2a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:08.683597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:08.683601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:08.683604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:08.683615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:08.683629Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:08.683648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:08.683883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:08.683893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:08.683909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:08.684015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1089 partition: 0 MaxSeqNo: 42 sessionId: src_id|a0c0671c-2a4af0da-3192a8c8-742bd2a5_0
2025-09-30T14:53:08.684455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24e34774-e0f80813-e4ddf906-a6110480_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a0c0671c-2a4af0da-3192a8c8-742bd2a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:08.687399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0c0671c-2a4af0da-3192a8c8-742bd2a5_0] Write session: try to update token
2025-09-30T14:53:08.687419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0c0671c-2a4af0da-3192a8c8-742bd2a5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:08.695833Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:08.695853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:08.695863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895396071848198:7087]
2025-09-30T14:53:08.695911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:08.695913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:08.696087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:08.696241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:08.696383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:08.696520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:08.696713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:08.696754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:08.704116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1089 sessionId: src_id|a0c0671c-2a4af0da-3192a8c8-742bd2a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:08.706988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:08.707055Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:08.707072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:08.707074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:08.707076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:08.707088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895396071848198:7087]
2025-09-30T14:53:08.707092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895396071848198:7087]
2025-09-30T14:53:08.707096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895396071848198:7087]
2025-09-30T14:53:08.707134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:08.707149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.707152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:08.707161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:08.707167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:08.707172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:08.707311Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:08.758217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895396161596198:5026]
2025-09-30T14:53:08.758514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1088, pipe: [1:7555895396161596198:5026]
2025-09-30T14:53:08.821266Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:08.821536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:08.821551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:08.821573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895396161596198:5026], now have 1 active actors on pipe
2025-09-30T14:53:08.821745Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:08.821785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:08.821815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895396161596198:5026]
2025-09-30T14:53:08.821838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:08.821914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1089 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a0c0671c-2a4af0da-3192a8c8-742bd2a5_0
2025-09-30T14:53:08.822110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1089 sessionId: src_id|a0c0671c-2a4af0da-3192a8c8-742bd2a5_0 is DEAD
2025-09-30T14:53:08.822290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0c0671c-2a4af0da-3192a8c8-742bd2a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:08.822299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0c0671c-2a4af0da-3192a8c8-742bd2a5_0] Write session will restart in 0.007099s
2025-09-30T14:53:08.822321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0c0671c-2a4af0da-3192a8c8-742bd2a5_0] Write session: Do CDS request
2025-09-30T14:53:08.822328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0c0671c-2a4af0da-3192a8c8-742bd2a5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:08.830836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0c0671c-2a4af0da-3192a8c8-742bd2a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:08.830943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:08.830960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1090
2025-09-30T14:53:08.831142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1090 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:08.831201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1090 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:08.831209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1090 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:08.831214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:08.831870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1090 sessionId:  describe result for acl check
2025-09-30T14:53:08.831909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:08.831912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:08.831914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:08.831920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895396161596261:4339] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:08.832501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895396161596261:4339] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:08.834789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895396161596261:4339] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:08.837272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895396161596261:4339] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:08.837289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895396161596261:4339] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:08.837292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895396161596261:4339] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:08.837301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1090 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:08.837456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:08.839785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:08.840015Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:08.840027Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:08.840037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:08.840094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:08.840135Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895396071848374:7089]
2025-09-30T14:53:08.840843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:08.841213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:08.841290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:08.841649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:08.841734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:08.841741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:08.841742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:08.841743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:08.841745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:08.841747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:08.841748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:08.841749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:08.841751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:08.841752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:08.841753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.841755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.841756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.841758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:08.841759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:08.841766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:08.841777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:08.841782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:08.841787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:08.841791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:08.841797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:08.841802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:08.841806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:08.841811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:08.841816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:08.841820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.841825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.841830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.841845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:08.841850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:08.841858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:08.841866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:08.841873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:08.841879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:08.841884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:08.841890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:08.841902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:08.841907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:08.841918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:08.841924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:08.841934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:08.841939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:08.841946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:08.841956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:08.841961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:08.841971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:08.841976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:08.841982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:08.841992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:08.841998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:08.842004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.842009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.842014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.842020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.842025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.842036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.842041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:08.842051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:08.842056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:08.842067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:08.842119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:08.847726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:08.848981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:08.848999Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:08.849003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:08.849008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:08.849015Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1089 [2:7555895396071848374:7089]
2025-09-30T14:53:08.849031Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:08.849045Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:08.849049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:08.849053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:08.849056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:08.849072Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:08.849086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:08.849094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:08.849168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.849175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.849177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.849181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:08.849184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:08.849259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:08.849270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.849284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:08.849294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:08.849311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:08.849330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895396071848368:7089]
2025-09-30T14:53:08.849332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895396071848368:7089]
2025-09-30T14:53:08.849334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895396071848368:7089]
2025-09-30T14:53:08.849349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:08.849364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895396161596366:4339], now have 1 active actors on pipe
2025-09-30T14:53:08.849368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895396161596199:2454], now have 1 active actors on pipe
2025-09-30T14:53:08.849377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:08.849391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:08.849400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:08.849402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:08.849406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:08.849409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:08.849438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895396071848368:7089]
2025-09-30T14:53:08.849448Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:08.849450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:08.849498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1089
2025-09-30T14:53:08.849521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1089
2025-09-30T14:53:08.849621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:08.849632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:08.849661Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b314b8-3432c75c-226fd7ce-31662b08_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:08.849674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:08.849680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:08.849684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:08.849694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:08.849705Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:08.849725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:08.849936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:08.849955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:08.849983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:08.850075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1090 partition: 0 MaxSeqNo: 42 sessionId: src_id|8b314b8-3432c75c-226fd7ce-31662b08_0
2025-09-30T14:53:08.850565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0c0671c-2a4af0da-3192a8c8-742bd2a5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8b314b8-3432c75c-226fd7ce-31662b08_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:08.853450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b314b8-3432c75c-226fd7ce-31662b08_0] Write session: try to update token
2025-09-30T14:53:08.853469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b314b8-3432c75c-226fd7ce-31662b08_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:08.861816Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:08.861832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:08.861843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895396071848368:7089]
2025-09-30T14:53:08.861887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:08.861890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:08.862074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:08.862244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:08.862395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:08.862554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:08.862782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:08.862830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:08.869681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1090 sessionId: src_id|8b314b8-3432c75c-226fd7ce-31662b08_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:08.872584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:08.873213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:08.873242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:08.873265Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:08.873268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:08.873271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:08.873274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:08.873283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895396071848368:7089]
2025-09-30T14:53:08.873288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895396071848368:7089]
2025-09-30T14:53:08.873292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895396071848368:7089]
2025-09-30T14:53:08.873344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:08.873346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:08.873353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:08.873356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:08.873360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:08.873363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:08.873506Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:08.922051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895396161596379:5026]
2025-09-30T14:53:08.922340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1089, pipe: [1:7555895396161596379:5026]
2025-09-30T14:53:08.992179Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:08.992527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:08.992567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895396161596379:5026], now have 1 active actors on pipe
2025-09-30T14:53:08.993188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b314b8-3432c75c-226fd7ce-31662b08_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:08.993202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b314b8-3432c75c-226fd7ce-31662b08_0] Write session will restart in 0.008674s
2025-09-30T14:53:08.993238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b314b8-3432c75c-226fd7ce-31662b08_0] Write session: Do CDS request
2025-09-30T14:53:08.993245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b314b8-3432c75c-226fd7ce-31662b08_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:08.992666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:08.992708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895396161596379:5026]
2025-09-30T14:53:08.992727Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:08.992771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:08.992774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:08.992859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1090 reason: error at write: Disconnected sessionId: src_id|8b314b8-3432c75c-226fd7ce-31662b08_0
2025-09-30T14:53:08.993034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1090 sessionId: src_id|8b314b8-3432c75c-226fd7ce-31662b08_0 is DEAD
2025-09-30T14:53:09.002779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b314b8-3432c75c-226fd7ce-31662b08_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:09.002884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:09.002900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1091
2025-09-30T14:53:09.003024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1091 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:09.003055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1091 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:09.003073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1091 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:09.003080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:09.003567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1091 sessionId:  describe result for acl check
2025-09-30T14:53:09.003608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:09.003610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:09.003612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:09.003618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895400456563800:4329] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:09.004122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895400456563800:4329] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:09.005602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:09.006365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895400456563800:4329] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:09.007709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:09.007921Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:09.007931Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:09.007942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:09.007994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:09.008032Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895400366815840:7091]
2025-09-30T14:53:09.008683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895400456563800:4329] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:09.008700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895400456563800:4329] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:09.008704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895400456563800:4329] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:09.008712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1091 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:09.008723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:09.009013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:09.009085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:09.009457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:09.009522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:09.009528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:09.009529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:09.009530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:09.009532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:09.009533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:09.009535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:09.009537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:09.009538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:09.009539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:09.009541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.009542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.009543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.009545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:09.009546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:09.009552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:09.009565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:09.009569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:09.009573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:09.009578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:09.009583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:09.009588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:09.009592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:09.009597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:09.009602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:09.009607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.009611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.009614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.009619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:09.009623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:09.009631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:09.009644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:09.009655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:09.009661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:09.009670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:09.009676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:09.009685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:09.009691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:09.009701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:09.009707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:09.009716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:09.009721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:09.009731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:09.009737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:09.009746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:09.009752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:09.009763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:09.009774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:09.009778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:09.009784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:09.009793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.009799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.009808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.009814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.009823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.009828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.009839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:09.009845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:09.009854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:09.009860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:09.009913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:09.015677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:09.016647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:09.016663Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:09.016666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:09.016670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:09.016677Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1090 [2:7555895400366815840:7091]
2025-09-30T14:53:09.016694Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:09.016711Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:09.016715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:09.016718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:09.016721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:09.016735Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:09.016750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:09.016758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:09.016821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.016829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.016831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.016835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:09.016837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:09.016905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:09.016913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.016928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.016943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.016965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:09.016988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895400456563846:4329], now have 1 active actors on pipe
2025-09-30T14:53:09.016997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895396161596380:2454], now have 1 active actors on pipe
2025-09-30T14:53:09.017004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895400366815835:7091]
2025-09-30T14:53:09.017007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895400366815835:7091]
2025-09-30T14:53:09.017010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895400366815835:7091]
2025-09-30T14:53:09.017023Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:09.017036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:09.017038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:09.017038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:09.017040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:09.017056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:09.017063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:09.017080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1090
2025-09-30T14:53:09.017118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1090
2025-09-30T14:53:09.017100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895400366815835:7091]
2025-09-30T14:53:09.017117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:09.017136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:09.017153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:09.017163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:09.017198Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f28c4d8e-25578113-261ea2a4-aa381793_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:09.017211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:09.017215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:09.017217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:09.017226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:09.017234Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:09.017253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:09.017458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:09.017471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:09.017491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:09.017592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1091 partition: 0 MaxSeqNo: 42 sessionId: src_id|f28c4d8e-25578113-261ea2a4-aa381793_0
2025-09-30T14:53:09.017989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b314b8-3432c75c-226fd7ce-31662b08_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f28c4d8e-25578113-261ea2a4-aa381793_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:09.020761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f28c4d8e-25578113-261ea2a4-aa381793_0] Write session: try to update token
2025-09-30T14:53:09.020780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f28c4d8e-25578113-261ea2a4-aa381793_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:09.034863Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:09.034883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:09.034886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:09.034889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:09.034898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895400366815835:7091]
2025-09-30T14:53:09.034902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895400366815835:7091]
2025-09-30T14:53:09.034907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895400366815835:7091]
2025-09-30T14:53:09.034956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:09.034967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.034971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:09.034982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:09.035006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:09.035025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:09.035119Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:09.035945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1091 sessionId: src_id|f28c4d8e-25578113-261ea2a4-aa381793_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:09.038807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:09.092555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895400456563868:5026]
2025-09-30T14:53:09.092900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1090, pipe: [1:7555895400456563868:5026]
2025-09-30T14:53:09.155707Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:09.156203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:09.156223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:09.156261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895400456563868:5026], now have 1 active actors on pipe
2025-09-30T14:53:09.156505Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:09.156473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:09.156478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895400456563868:5026]
2025-09-30T14:53:09.156502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:09.156504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:09.156577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1091 reason: error at write: Disconnected sessionId: src_id|f28c4d8e-25578113-261ea2a4-aa381793_0
2025-09-30T14:53:09.156776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1091 sessionId: src_id|f28c4d8e-25578113-261ea2a4-aa381793_0 is DEAD
2025-09-30T14:53:09.156915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f28c4d8e-25578113-261ea2a4-aa381793_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:09.156925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f28c4d8e-25578113-261ea2a4-aa381793_0] Write session will restart in 0.007071s
2025-09-30T14:53:09.156947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f28c4d8e-25578113-261ea2a4-aa381793_0] Write session: Do CDS request
2025-09-30T14:53:09.156955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f28c4d8e-25578113-261ea2a4-aa381793_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:09.164772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f28c4d8e-25578113-261ea2a4-aa381793_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:09.164916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:09.164931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1092
2025-09-30T14:53:09.165078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1092 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:09.165113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1092 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:09.165123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1092 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:09.165127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:09.165919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1092 sessionId:  describe result for acl check
2025-09-30T14:53:09.165961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:09.165969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:09.165971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:09.165978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895400456563921:4328] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:09.166579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895400456563921:4328] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:09.169043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895400456563921:4328] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:09.170726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:09.172963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:09.173105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895400456563921:4328] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:09.173125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895400456563921:4328] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:09.173129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895400456563921:4328] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:09.173146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1092 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:09.173175Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:09.173186Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:09.173206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:09.173265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:09.173312Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895400366816026:7095]
2025-09-30T14:53:09.173987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:09.174350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:09.174412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:09.174804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:09.174875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:09.174882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:09.174883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:09.174885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:09.174886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:09.174887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:09.174888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:09.174890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:09.174892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:09.174893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:09.174894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.174895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.174896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.174898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:09.174899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:09.174904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:09.174915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:09.174920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:09.174925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:09.174929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:09.174933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:09.174938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:09.174942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:09.174946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:09.174951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:09.174955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.174959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.174963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.174967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:09.174971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:09.174978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:09.174986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:09.174993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:09.174999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:09.175004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:09.175010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:09.175014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:09.175020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:09.175024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:09.175030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:09.175035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:09.175040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:09.175045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:09.175050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:09.175054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:09.175059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:09.175063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:09.175068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:09.175073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:09.175078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:09.175084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.175088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.175093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.175098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.175103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.175108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.175111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:09.175116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:09.175122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:09.175128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:09.175172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:09.180950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:09.181823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:09.181837Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:09.181839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:09.181842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:09.181848Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1091 [2:7555895400366816026:7095]
2025-09-30T14:53:09.181861Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:09.181875Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:09.181877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:09.181880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:09.181881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:09.181894Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:09.181899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:09.181905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:09.181948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.181954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.181955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.181958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:09.181960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:09.182024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:09.182032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.182044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.182057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.182077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:09.182097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895400366816021:7095]
2025-09-30T14:53:09.182103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895400366816021:7095]
2025-09-30T14:53:09.182105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895400366816021:7095]
2025-09-30T14:53:09.182115Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:09.182129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:09.182129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895400456563881:2454], now have 1 active actors on pipe
2025-09-30T14:53:09.182147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895400456564050:4328], now have 1 active actors on pipe
2025-09-30T14:53:09.182150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:09.182152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:09.182156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:09.182169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:09.182172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:09.182195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1091
2025-09-30T14:53:09.182199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1091
2025-09-30T14:53:09.182204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895400366816021:7095]
2025-09-30T14:53:09.182216Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:09.182234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:09.182279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:09.182289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:09.182314Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|555e940e-3a5b0265-da5b09ef-ed22c611_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:09.182326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:09.182330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:09.182332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:09.182344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:09.182354Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:09.182372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:09.182529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:09.182537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:09.182550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:09.182694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1092 partition: 0 MaxSeqNo: 42 sessionId: src_id|555e940e-3a5b0265-da5b09ef-ed22c611_0
2025-09-30T14:53:09.183157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f28c4d8e-25578113-261ea2a4-aa381793_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|555e940e-3a5b0265-da5b09ef-ed22c611_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:09.186019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|555e940e-3a5b0265-da5b09ef-ed22c611_0] Write session: try to update token
2025-09-30T14:53:09.186039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|555e940e-3a5b0265-da5b09ef-ed22c611_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:09.194606Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:09.194624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:09.194633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895400366816021:7095]
2025-09-30T14:53:09.194689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:09.194701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:09.194851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:09.195003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:09.195142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:09.195300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:09.195485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:09.195524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:09.200552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1092 sessionId: src_id|555e940e-3a5b0265-da5b09ef-ed22c611_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:09.203301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:09.203672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:09.203691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:09.203731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:09.203818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:09.205233Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:09.205245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:09.205247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:09.205248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:09.205256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895400366816021:7095]
2025-09-30T14:53:09.205259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895400366816021:7095]
2025-09-30T14:53:09.205262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895400366816021:7095]
2025-09-30T14:53:09.205290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:09.205298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:09.205300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.205302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:09.205302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:09.205305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:09.205436Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:09.256377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895400456564063:5026]
2025-09-30T14:53:09.256720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1091, pipe: [1:7555895400456564063:5026]
2025-09-30T14:53:09.321571Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:09.330232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:09.330259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:09.330434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:09.330496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:09.330559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:09.330637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:09.330943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:09.330959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:09.331043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:09.331103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:09.331167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:09.331259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:09.331305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:09.331312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:09.331387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:09.331454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:09.331523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:09.331593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:09.331642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:09.331650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:09.331725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:09.331801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:09.331871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:09.331946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:09.331992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:09.331999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:09.332069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:09.332131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:09.332197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:09.332257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:09.332299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:09.332305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:09.332371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:09.332428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:09.332498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:09.332559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:09.332601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:09.332606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:09.332671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:09.332731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:09.332799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:09.332860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:09.332905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:09.332916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:09.332986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:09.333059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:09.333138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:09.333217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:09.333273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:09.333282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:09.333359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:09.333429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:09.333503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:09.333572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:09.333620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:09.333629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:09.333694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:09.333761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:09.333836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:09.333907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:09.334198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:09.334206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:09.334267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895400456564063:5026], now have 1 active actors on pipe
2025-09-30T14:53:09.334816Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:09.334828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895400456564063:5026]
2025-09-30T14:53:09.334856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:09.334859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:09.334853Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:09.334886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1092 reason: error at write: Disconnected sessionId: src_id|555e940e-3a5b0265-da5b09ef-ed22c611_0
2025-09-30T14:53:09.335133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1092 sessionId: src_id|555e940e-3a5b0265-da5b09ef-ed22c611_0 is DEAD
2025-09-30T14:53:09.335305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|555e940e-3a5b0265-da5b09ef-ed22c611_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:09.335316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|555e940e-3a5b0265-da5b09ef-ed22c611_0] Write session will restart in 0.008017s
2025-09-30T14:53:09.335339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|555e940e-3a5b0265-da5b09ef-ed22c611_0] Write session: Do CDS request
2025-09-30T14:53:09.335356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|555e940e-3a5b0265-da5b09ef-ed22c611_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:09.344833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|555e940e-3a5b0265-da5b09ef-ed22c611_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:09.344882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:09.344898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1093
2025-09-30T14:53:09.345078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1093 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:09.345109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1093 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:09.345115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1093 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:09.345119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:09.345628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1093 sessionId:  describe result for acl check
2025-09-30T14:53:09.345661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:09.345665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:09.345666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:09.345672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895400456564163:4324] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:09.346623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895400456564163:4324] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:09.348692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:09.349062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895400456564163:4324] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:09.350794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:09.350996Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:09.351005Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:09.351015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:09.351082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:09.351129Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895400366816199:7097]
2025-09-30T14:53:09.351799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895400456564163:4324] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:09.351810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895400456564163:4324] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:09.351814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895400456564163:4324] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:09.351833Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1093 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:09.351863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:09.352236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:09.352287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:09.352637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:09.352693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:09.352699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:09.352700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:09.352702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:09.352703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:09.352704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:09.352706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:09.352708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:09.352709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:09.352710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:09.352711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.352713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.352714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.352715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:09.352716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:09.352722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:09.352733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:09.352738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:09.352743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:09.352748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:09.352753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:09.352757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:09.352762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:09.352766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:09.352771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:09.352776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.352779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.352784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.352789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:09.352793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:09.352800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:09.352813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:09.352824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:09.352830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:09.352839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:09.352845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:09.352850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:09.352856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:09.352862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:09.352868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:09.352877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:09.352883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:09.352893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:09.352899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:09.352908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:09.352914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:09.352923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:09.352931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:09.352943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:09.352949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:09.352954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.352960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.352965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.352970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.352976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.352980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.352985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:09.352991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:09.352997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:09.353003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:09.353052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:09.358667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:09.359935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:09.359953Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:09.359957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:09.359961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:09.359968Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1092 [2:7555895400366816199:7097]
2025-09-30T14:53:09.359987Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:09.360002Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:09.360005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:09.360009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:09.360012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:09.360028Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:09.360039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:09.360046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:09.360115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.360123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.360125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.360129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:09.360132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:09.360200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:09.360207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.360223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.360242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.360266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:09.360287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895400366816194:7097]
2025-09-30T14:53:09.360294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895400366816194:7097]
2025-09-30T14:53:09.360296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895400366816194:7097]
2025-09-30T14:53:09.360310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:09.360328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895400456564066:2454], now have 1 active actors on pipe
2025-09-30T14:53:09.360333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:09.360337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895400456564237:4324], now have 1 active actors on pipe
2025-09-30T14:53:09.360337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:09.360339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:09.360345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:09.360361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:09.360369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:09.360404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895400366816194:7097]
2025-09-30T14:53:09.360412Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:09.360380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1092
2025-09-30T14:53:09.360421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1092
2025-09-30T14:53:09.360431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:09.360551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:09.360561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:09.360585Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb493b18-1e8293fd-4bf43b40-81fb998a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:09.360598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:09.360606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:09.360609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:09.360620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:09.360634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:09.360651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:09.360836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:09.360851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:09.360878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:09.361086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1093 partition: 0 MaxSeqNo: 42 sessionId: src_id|fb493b18-1e8293fd-4bf43b40-81fb998a_0
2025-09-30T14:53:09.361482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|555e940e-3a5b0265-da5b09ef-ed22c611_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fb493b18-1e8293fd-4bf43b40-81fb998a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:09.364452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb493b18-1e8293fd-4bf43b40-81fb998a_0] Write session: try to update token
2025-09-30T14:53:09.364478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb493b18-1e8293fd-4bf43b40-81fb998a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:09.373164Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:09.373180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:09.373191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895400366816194:7097]
2025-09-30T14:53:09.373235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:09.373235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:09.373420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:09.373560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:09.373694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:09.373831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:09.374040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:09.374086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:09.380943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1093 sessionId: src_id|fb493b18-1e8293fd-4bf43b40-81fb998a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:09.383853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:09.384434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:09.384460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:09.384480Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:09.384483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:09.384486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:09.384489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:09.384497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895400366816194:7097]
2025-09-30T14:53:09.384501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895400366816194:7097]
2025-09-30T14:53:09.384505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895400366816194:7097]
2025-09-30T14:53:09.384552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:09.384555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:09.384561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.384564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:09.384567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:09.384572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:09.384700Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:09.435095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895400456564249:5026]
2025-09-30T14:53:09.435395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1092, pipe: [1:7555895400456564249:5026]
2025-09-30T14:53:09.500376Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:09.500633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:09.500666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895400456564249:5026], now have 1 active actors on pipe
2025-09-30T14:53:09.500732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:09.513025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb493b18-1e8293fd-4bf43b40-81fb998a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:09.513039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb493b18-1e8293fd-4bf43b40-81fb998a_0] Write session will restart in 0.007285s
2025-09-30T14:53:09.513063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb493b18-1e8293fd-4bf43b40-81fb998a_0] Write session: Do CDS request
2025-09-30T14:53:09.513069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb493b18-1e8293fd-4bf43b40-81fb998a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:09.512546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:09.512608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895400456564249:5026]
2025-09-30T14:53:09.512679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:09.512681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:09.512702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1093 reason: error at write: Disconnected sessionId: src_id|fb493b18-1e8293fd-4bf43b40-81fb998a_0
2025-09-30T14:53:09.512868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1093 sessionId: src_id|fb493b18-1e8293fd-4bf43b40-81fb998a_0 is DEAD
2025-09-30T14:53:09.521812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb493b18-1e8293fd-4bf43b40-81fb998a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:09.522194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:09.522210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1094
2025-09-30T14:53:09.523162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:09.522343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1094 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:09.522376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1094 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:09.522380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1094 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:09.522384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:09.522791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1094 sessionId:  describe result for acl check
2025-09-30T14:53:09.522819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:09.522823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:09.522826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:09.522832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895400456564401:4308] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:09.523374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895400456564401:4308] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:09.525942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:09.526193Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:09.526202Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:09.526215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:09.526269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:09.526309Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895400366816386:7105]
2025-09-30T14:53:09.526371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895400456564401:4308] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:09.527117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:09.527429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:09.527485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:09.527837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:09.527914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:09.527922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:09.527923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:09.527924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:09.527926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:09.527927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:09.527928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:09.527929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:09.527930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:09.527931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:09.527932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.527933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.527934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.527935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:09.527936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:09.527942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:09.527952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:09.527957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:09.527961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:09.527966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:09.527970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:09.527974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:09.527979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:09.527983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:09.527987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:09.527992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.527996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.528000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.528004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:09.528009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:09.528017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:09.528025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:09.528032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:09.528037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:09.528042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:09.528048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:09.528053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:09.528059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:09.528066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:09.528072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:09.528077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:09.528083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:09.528087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:09.528093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:09.528098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:09.528104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:09.528110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:09.528116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:09.528121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:09.528126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:09.528131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.528144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.528149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.528160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.528165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.528171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.528179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:09.528185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:09.528190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:09.528200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:09.528258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:09.529129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895400456564401:4308] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:09.529154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895400456564401:4308] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:09.529158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895400456564401:4308] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:09.529165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1094 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:09.535401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:09.536612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:09.536628Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:09.536631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:09.536635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:09.536642Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1093 [2:7555895400366816386:7105]
2025-09-30T14:53:09.536658Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:09.536672Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:09.536675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:09.536678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:09.536680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:09.536696Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:09.536702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:09.536708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:09.536767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.536779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.536781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.536784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:09.536787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:09.536857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:09.536865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.536880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.536894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.536916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:09.536934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895400366816381:7105]
2025-09-30T14:53:09.536940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895400366816381:7105]
2025-09-30T14:53:09.536942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895400366816381:7105]
2025-09-30T14:53:09.536950Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:09.536959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:09.536963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:09.536963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:09.536966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:09.536977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:09.536980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:09.536990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895400456564340:2454], now have 1 active actors on pipe
2025-09-30T14:53:09.536999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895400456564439:4308], now have 1 active actors on pipe
2025-09-30T14:53:09.537033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895400366816381:7105]
2025-09-30T14:53:09.537046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:09.537076Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1093
2025-09-30T14:53:09.537118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:09.537140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1093
2025-09-30T14:53:09.537174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:09.537189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:09.537217Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c0ec91c-bda12c3-5b3d8355-83222063_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:09.537233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:09.537240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:09.537243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:09.537254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:09.537271Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:09.537294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:09.537494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:09.537504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:09.537528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:09.537628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1094 partition: 0 MaxSeqNo: 42 sessionId: src_id|6c0ec91c-bda12c3-5b3d8355-83222063_0
2025-09-30T14:53:09.538085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb493b18-1e8293fd-4bf43b40-81fb998a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6c0ec91c-bda12c3-5b3d8355-83222063_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:09.542642Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:11802 } ]
2025-09-30T14:53:09.547098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0ec91c-bda12c3-5b3d8355-83222063_0] Write session: try to update token
2025-09-30T14:53:09.547120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0ec91c-bda12c3-5b3d8355-83222063_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:09.550266Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:09.550288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:09.550298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895400366816381:7105]
2025-09-30T14:53:09.550347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:09.550363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:09.550528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:09.550695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:09.550851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:09.551030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:09.551408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:09.551462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:09.563143Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:09.563161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:09.563164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:09.563166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:09.563177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895400366816381:7105]
2025-09-30T14:53:09.563184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895400366816381:7105]
2025-09-30T14:53:09.563188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895400366816381:7105]
2025-09-30T14:53:09.563230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:09.563239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.563262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:09.563263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:09.563270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:09.563285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:09.563414Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:09.565083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1094 sessionId: src_id|6c0ec91c-bda12c3-5b3d8355-83222063_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:09.573837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:09.612800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895400456564457:5026]
2025-09-30T14:53:09.613057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1093, pipe: [1:7555895400456564457:5026]
2025-09-30T14:53:09.679984Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:09.680316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:09.680330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:09.680351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895400456564457:5026], now have 1 active actors on pipe
2025-09-30T14:53:09.680619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:09.680641Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:09.680634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:09.680697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1094 reason: error at write: Disconnected sessionId: src_id|6c0ec91c-bda12c3-5b3d8355-83222063_0
2025-09-30T14:53:09.680935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1094 sessionId: src_id|6c0ec91c-bda12c3-5b3d8355-83222063_0 is DEAD
2025-09-30T14:53:09.681081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:09.681119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895400456564457:5026]
2025-09-30T14:53:09.683476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0ec91c-bda12c3-5b3d8355-83222063_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:09.683487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0ec91c-bda12c3-5b3d8355-83222063_0] Write session will restart in 0.005854s
2025-09-30T14:53:09.683511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0ec91c-bda12c3-5b3d8355-83222063_0] Write session: Do CDS request
2025-09-30T14:53:09.683520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0ec91c-bda12c3-5b3d8355-83222063_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:09.690825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0ec91c-bda12c3-5b3d8355-83222063_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:09.690962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:09.690979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1095
2025-09-30T14:53:09.691085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1095 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:09.691127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1095 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:09.691137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1095 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:09.691142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:09.691633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1095 sessionId:  describe result for acl check
2025-09-30T14:53:09.691671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:09.691677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:09.691679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:09.691684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895400456564470:4302] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:09.692224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895400456564470:4302] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:09.694203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895400456564470:4302] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:09.697402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895400456564470:4302] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:09.697418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895400456564470:4302] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:09.697421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895400456564470:4302] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:09.697429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1095 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:09.700301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:09.702410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:09.702590Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:09.702599Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:09.702609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:09.702657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:09.702695Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895400366816588:7114]
2025-09-30T14:53:09.703376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:09.703680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:09.703721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:09.704051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:09.704108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:09.704113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:09.704114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:09.704115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:09.704116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:09.704117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:09.704118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:09.704119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:09.704121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:09.704122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:09.704123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.704124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.704125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.704127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:09.704128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:09.704134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:09.704144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:09.704148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:09.704153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:09.704156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:09.704161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:09.704166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:09.704170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:09.704175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:09.704180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:09.704184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.704188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.704193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.704198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:09.704205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:09.704213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:09.704226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:09.704232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:09.704237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:09.704242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:09.704248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:09.704252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:09.704258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:09.704264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:09.704269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:09.704273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:09.704278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:09.704284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:09.704289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:09.704293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:09.704297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:09.704301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:09.704306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:09.704310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:09.704314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:09.704320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.704330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.704334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.704339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.704345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.704351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.704356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:09.704363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:09.704367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:09.704371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:09.704411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:09.709992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:09.711017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:09.711036Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:09.711039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:09.711043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:09.711050Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1094 [2:7555895400366816588:7114]
2025-09-30T14:53:09.711066Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:09.711081Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:09.711084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:09.711088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:09.711090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:09.711106Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:09.711112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:09.711119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:09.711185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.711194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.711197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.711201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:09.711204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:09.711414Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1094
2025-09-30T14:53:09.711415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1094
2025-09-30T14:53:09.711507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:09.711518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.711530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.711543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.711567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:09.711592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895400456564580:4302], now have 1 active actors on pipe
2025-09-30T14:53:09.711600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895400456564458:2454], now have 1 active actors on pipe
2025-09-30T14:53:09.711617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:09.711626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:09.711640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895400366816583:7114]
2025-09-30T14:53:09.711646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895400366816583:7114]
2025-09-30T14:53:09.711648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895400366816583:7114]
2025-09-30T14:53:09.711661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:09.711680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:09.711679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:09.711683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:09.711686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:09.711701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:09.711704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:09.711720Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f6c0ea9-c82f00eb-21a9fbe2-99d2c242_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:09.711727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:09.711731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:09.711733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:09.711742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:09.711753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:09.711794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895400366816583:7114]
2025-09-30T14:53:09.711805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:09.711813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:09.711827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:09.711984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:09.711993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:09.712009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:09.712156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1095 partition: 0 MaxSeqNo: 42 sessionId: src_id|1f6c0ea9-c82f00eb-21a9fbe2-99d2c242_0
2025-09-30T14:53:09.712568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0ec91c-bda12c3-5b3d8355-83222063_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1f6c0ea9-c82f00eb-21a9fbe2-99d2c242_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:09.715221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f6c0ea9-c82f00eb-21a9fbe2-99d2c242_0] Write session: try to update token
2025-09-30T14:53:09.715238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f6c0ea9-c82f00eb-21a9fbe2-99d2c242_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:09.724178Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:09.724199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:09.724208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895400366816583:7114]
2025-09-30T14:53:09.724254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:09.724253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:09.724435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:09.724579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:09.724723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:09.724875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:09.725091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:09.725130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:09.731126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1095 sessionId: src_id|1f6c0ea9-c82f00eb-21a9fbe2-99d2c242_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:09.733857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:09.736541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:09.736569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:09.736588Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:09.736592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:09.736594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:09.736597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:09.736606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895400366816583:7114]
2025-09-30T14:53:09.736610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895400366816583:7114]
2025-09-30T14:53:09.736615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895400366816583:7114]
2025-09-30T14:53:09.736664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:09.736664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:09.736671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:09.736675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.736676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:09.736678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:09.736830Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:09.781196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895400456564644:5026]
2025-09-30T14:53:09.781505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1094, pipe: [1:7555895400456564644:5026]
2025-09-30T14:53:09.852061Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:09.852392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:09.852426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895400456564644:5026], now have 1 active actors on pipe
2025-09-30T14:53:09.852557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:09.852620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895400456564644:5026]
2025-09-30T14:53:09.852664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:09.852672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:09.852738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:09.852740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1095 reason: error at write: Disconnected sessionId: src_id|1f6c0ea9-c82f00eb-21a9fbe2-99d2c242_0
2025-09-30T14:53:09.852904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1095 sessionId: src_id|1f6c0ea9-c82f00eb-21a9fbe2-99d2c242_0 is DEAD
2025-09-30T14:53:09.853091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f6c0ea9-c82f00eb-21a9fbe2-99d2c242_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:09.853100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f6c0ea9-c82f00eb-21a9fbe2-99d2c242_0] Write session will restart in 0.007000s
2025-09-30T14:53:09.853123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f6c0ea9-c82f00eb-21a9fbe2-99d2c242_0] Write session: Do CDS request
2025-09-30T14:53:09.853129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f6c0ea9-c82f00eb-21a9fbe2-99d2c242_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:09.861752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f6c0ea9-c82f00eb-21a9fbe2-99d2c242_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:09.861874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:09.861893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1096
2025-09-30T14:53:09.862013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1096 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:09.862056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1096 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:09.862066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1096 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:09.862070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:09.862538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1096 sessionId:  describe result for acl check
2025-09-30T14:53:09.862572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:09.862582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:09.862585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:09.862591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895400456564675:4297] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:09.863132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895400456564675:4297] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:09.865635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895400456564675:4297] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:09.868409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895400456564675:4297] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:09.868424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895400456564675:4297] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:09.868429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895400456564675:4297] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:09.868437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1096 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:09.868899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:09.870862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:09.871065Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:09.871077Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:09.871088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:09.871143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:09.871274Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895400366816765:7116]
2025-09-30T14:53:09.871942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:09.872398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:09.872463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:09.872821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:09.872896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:09.872903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:09.872904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:09.872905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:09.872906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:09.872908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:09.872909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:09.872911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:09.872913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:09.872914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:09.872916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.872917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.872918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.872920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:09.872922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:09.872928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:09.872940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:09.872944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:09.872949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:09.872954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:09.872959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:09.872963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:09.872968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:09.872972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:09.872978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:09.872983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.872988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.872992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.872997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:09.873002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:09.873010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:09.873019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:09.873025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:09.873042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:09.873048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:09.873055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:09.873060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:09.873066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:09.873071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:09.873077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:09.873095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:09.873107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:09.873113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:09.873118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:09.873123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:09.873129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:09.873134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:09.873141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:09.873151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:09.873157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:09.873162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.873168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.873173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.873184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.873189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.873199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.873205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:09.873210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:09.873220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:09.873226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:09.873279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:09.878866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:09.879980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:09.879999Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:09.880001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:09.880005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:09.880012Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1095 [2:7555895400366816765:7116]
2025-09-30T14:53:09.880029Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:09.880045Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:09.880054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:09.880057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:09.880060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:09.880077Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:09.880084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:09.880092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:09.880151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.880162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.880164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.880167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:09.880170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:09.880236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:09.880249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.880262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:09.880276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:09.880296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:09.880319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895400456564819:4297], now have 1 active actors on pipe
2025-09-30T14:53:09.880328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895400456564645:2454], now have 1 active actors on pipe
2025-09-30T14:53:09.880335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895400366816760:7116]
2025-09-30T14:53:09.880337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895400366816760:7116]
2025-09-30T14:53:09.880339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895400366816760:7116]
2025-09-30T14:53:09.880350Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:09.880364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:09.880368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:09.880375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:09.880377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:09.880381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:09.880384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:09.880384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1095
2025-09-30T14:53:09.880390Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1095
2025-09-30T14:53:09.880415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895400366816760:7116]
2025-09-30T14:53:09.880424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:09.880427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:09.880441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:09.880451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:09.880503Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4d621ee-88d1f650-7ade9b25-8ff6f76a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:09.880515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:09.880520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:09.880522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:09.880531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:09.880540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:09.880557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:09.880806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:09.880816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:09.880831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:09.880961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1096 partition: 0 MaxSeqNo: 42 sessionId: src_id|d4d621ee-88d1f650-7ade9b25-8ff6f76a_0
2025-09-30T14:53:09.881362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f6c0ea9-c82f00eb-21a9fbe2-99d2c242_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d4d621ee-88d1f650-7ade9b25-8ff6f76a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:09.884380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d621ee-88d1f650-7ade9b25-8ff6f76a_0] Write session: try to update token
2025-09-30T14:53:09.884401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d621ee-88d1f650-7ade9b25-8ff6f76a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:09.896155Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:09.896176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:09.896179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:09.896181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:09.896190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895400366816760:7116]
2025-09-30T14:53:09.896195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895400366816760:7116]
2025-09-30T14:53:09.896200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895400366816760:7116]
2025-09-30T14:53:09.896242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:09.896245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:09.896251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:09.896256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:09.896260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:09.896265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:09.896407Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:09.899571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1096 sessionId: src_id|d4d621ee-88d1f650-7ade9b25-8ff6f76a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:09.902554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:09.952709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895400456564832:5026]
2025-09-30T14:53:09.952960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1095, pipe: [1:7555895400456564832:5026]
2025-09-30T14:53:10.010340Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:10.010750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:10.010765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:10.010808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895400456564832:5026], now have 1 active actors on pipe
2025-09-30T14:53:10.011109Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:10.011110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895400456564832:5026]
2025-09-30T14:53:10.011135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:10.011205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1096 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d4d621ee-88d1f650-7ade9b25-8ff6f76a_0
2025-09-30T14:53:10.011050Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:10.011446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1096 sessionId: src_id|d4d621ee-88d1f650-7ade9b25-8ff6f76a_0 is DEAD
2025-09-30T14:53:10.011600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d621ee-88d1f650-7ade9b25-8ff6f76a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:10.011611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d621ee-88d1f650-7ade9b25-8ff6f76a_0] Write session will restart in 0.009248s
2025-09-30T14:53:10.011635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d621ee-88d1f650-7ade9b25-8ff6f76a_0] Write session: Do CDS request
2025-09-30T14:53:10.011641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d621ee-88d1f650-7ade9b25-8ff6f76a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:10.021797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d621ee-88d1f650-7ade9b25-8ff6f76a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:10.021924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:10.021939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1097
2025-09-30T14:53:10.023958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1097 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:10.024005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1097 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:10.024011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1097 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:10.024014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:10.024421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1097 sessionId:  describe result for acl check
2025-09-30T14:53:10.024454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:10.024456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:10.024458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:10.024463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895404751532273:4290] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:10.024979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895404751532273:4290] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:10.025044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:10.026843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895404751532273:4290] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:10.027313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:10.027507Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:10.027526Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:10.027539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:10.027605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:10.027651Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895404661784238:7118]
2025-09-30T14:53:10.028325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:10.028600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:10.028659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:10.029015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:10.029149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:10.029156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:10.029157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:10.029158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:10.029159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:10.029160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:10.029161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:10.029163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:10.029164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:10.029165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:10.029166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.029167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.029168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.029169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:10.029170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:10.029175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:10.029181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:10.029184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:10.029186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:10.029188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:10.029191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:10.029193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:10.029195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:10.029198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:10.029200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:10.029202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.029205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.029207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.029211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:10.029215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:10.029222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:10.029230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:10.029236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:10.029242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:10.029246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:10.029252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:10.029256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:10.029261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:10.029266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:10.029271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:10.029273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:10.029276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:10.029279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:10.029282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:10.029285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:10.029297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:10.029302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:10.029307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:10.029311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:10.029315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:10.029341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.029346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.029350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.029354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.029358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.029363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.029367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:10.029371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:10.029377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:10.029383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:10.029427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:10.029643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895404751532273:4290] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:10.029657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895404751532273:4290] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:10.029661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895404751532273:4290] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:10.029668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1097 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:10.034731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:10.035882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:10.035896Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:10.035899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:10.035903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:10.035910Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1096 [2:7555895404661784238:7118]
2025-09-30T14:53:10.035924Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:10.035939Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:10.035943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:10.035946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:10.035948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:10.035964Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:10.035976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:10.035983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:10.036041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.036048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.036050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.036053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:10.036056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:10.036120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:10.036127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.036139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.036156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.036178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:10.036200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895404751532129:2454], now have 1 active actors on pipe
2025-09-30T14:53:10.036208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895404751532314:4290], now have 1 active actors on pipe
2025-09-30T14:53:10.036213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895404661784233:7118]
2025-09-30T14:53:10.036216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895404661784233:7118]
2025-09-30T14:53:10.036218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895404661784233:7118]
2025-09-30T14:53:10.036237Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:10.036254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:10.036260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:10.036264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:10.036267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:10.036273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:10.036276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:10.036262Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1096
2025-09-30T14:53:10.036287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1096
2025-09-30T14:53:10.036304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895404661784233:7118]
2025-09-30T14:53:10.036313Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:10.036316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:10.036343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:10.036352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:10.036382Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93a10964-ba01818d-38efa901-cd03f2fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:10.036393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:10.036396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:10.036398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:10.036407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:10.036420Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:10.036444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:10.036627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:10.036636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:10.036649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:10.036730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1097 partition: 0 MaxSeqNo: 42 sessionId: src_id|93a10964-ba01818d-38efa901-cd03f2fd_0
2025-09-30T14:53:10.037115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d621ee-88d1f650-7ade9b25-8ff6f76a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|93a10964-ba01818d-38efa901-cd03f2fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:10.039954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93a10964-ba01818d-38efa901-cd03f2fd_0] Write session: try to update token
2025-09-30T14:53:10.039974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93a10964-ba01818d-38efa901-cd03f2fd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:10.048593Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:10.048618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:10.048621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:10.048623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:10.048633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895404661784233:7118]
2025-09-30T14:53:10.048637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895404661784233:7118]
2025-09-30T14:53:10.048642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895404661784233:7118]
2025-09-30T14:53:10.048686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:10.048693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.048696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:10.048700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:10.048717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:10.048722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:10.048835Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:10.054837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1097 sessionId: src_id|93a10964-ba01818d-38efa901-cd03f2fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:10.057471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:10.111434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895404751532326:5026]
2025-09-30T14:53:10.111698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1096, pipe: [1:7555895404751532326:5026]
2025-09-30T14:53:10.164304Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:10.164646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:10.164659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:10.164692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895404751532326:5026], now have 1 active actors on pipe
2025-09-30T14:53:10.164913Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:10.164938Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:10.164980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895404751532326:5026]
2025-09-30T14:53:10.164991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:10.165063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1097 reason: status is not ok: tablet will be restarted right now sessionId: src_id|93a10964-ba01818d-38efa901-cd03f2fd_0
2025-09-30T14:53:10.165262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1097 sessionId: src_id|93a10964-ba01818d-38efa901-cd03f2fd_0 is DEAD
2025-09-30T14:53:10.165389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93a10964-ba01818d-38efa901-cd03f2fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:10.165397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93a10964-ba01818d-38efa901-cd03f2fd_0] Write session will restart in 0.007755s
2025-09-30T14:53:10.165421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93a10964-ba01818d-38efa901-cd03f2fd_0] Write session: Do CDS request
2025-09-30T14:53:10.165427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93a10964-ba01818d-38efa901-cd03f2fd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:10.174816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93a10964-ba01818d-38efa901-cd03f2fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:10.174921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:10.174937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1098
2025-09-30T14:53:10.175071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1098 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:10.175099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1098 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:10.175105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1098 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:10.175108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:10.175634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1098 sessionId:  describe result for acl check
2025-09-30T14:53:10.175669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:10.175675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:10.175677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:10.175683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895404751532427:4287] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:10.176241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895404751532427:4287] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:10.178542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895404751532427:4287] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:10.179766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:10.182277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:10.182499Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:10.182509Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:10.182519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:10.182586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:10.182625Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895404661784431:7122]
2025-09-30T14:53:10.182578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895404751532427:4287] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:10.182596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895404751532427:4287] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:10.182599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895404751532427:4287] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:10.182608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1098 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:10.183323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:10.183642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:10.183694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:10.184056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:10.184119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:10.184125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:10.184126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:10.184128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:10.184129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:10.184130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:10.184132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:10.184133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:10.184134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:10.184136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:10.184137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.184138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.184139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.184141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:10.184142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:10.184149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:10.184159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:10.184164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:10.184168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:10.184173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:10.184177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:10.184182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:10.184187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:10.184191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:10.184197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:10.184201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.184206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.184210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.184215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:10.184220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:10.184228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:10.184238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:10.184245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:10.184251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:10.184256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:10.184262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:10.184268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:10.184274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:10.184279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:10.184287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:10.184294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:10.184301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:10.184306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:10.184314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:10.184319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:10.184325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:10.184330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:10.184336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:10.184341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:10.184351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:10.184355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.184360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.184369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.184374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.184379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.184389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.184393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:10.184398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:10.184407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:10.184413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:10.184460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:10.190211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:10.191097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:10.191113Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:10.191117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:10.191121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:10.191129Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1097 [2:7555895404661784431:7122]
2025-09-30T14:53:10.191146Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:10.191173Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:10.191176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:10.191180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:10.191183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:10.191199Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:10.191206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:10.191214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:10.191298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.191306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.191308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.191312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:10.191316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:10.191409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:10.191418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.191433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.191445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.191464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:10.191489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895404751532339:2454], now have 1 active actors on pipe
2025-09-30T14:53:10.191497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895404751532515:4287], now have 1 active actors on pipe
2025-09-30T14:53:10.191503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895404661784426:7122]
2025-09-30T14:53:10.191505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895404661784426:7122]
2025-09-30T14:53:10.191507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895404661784426:7122]
2025-09-30T14:53:10.191522Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:10.191539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:10.191540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:10.191543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:10.191546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:10.191558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:10.191562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:10.191561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1097
2025-09-30T14:53:10.191574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1097
2025-09-30T14:53:10.191593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895404661784426:7122]
2025-09-30T14:53:10.191605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:10.191618Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:10.191661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:10.191670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:10.191706Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae69f98-25f47a22-6b98728d-eb74e868_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:10.191717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:10.191721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:10.191723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:10.191732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:10.191742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:10.191763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:10.192024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:10.192036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:10.192052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:10.192141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1098 partition: 0 MaxSeqNo: 42 sessionId: src_id|ae69f98-25f47a22-6b98728d-eb74e868_0
2025-09-30T14:53:10.192521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93a10964-ba01818d-38efa901-cd03f2fd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ae69f98-25f47a22-6b98728d-eb74e868_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:10.195423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae69f98-25f47a22-6b98728d-eb74e868_0] Write session: try to update token
2025-09-30T14:53:10.195442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae69f98-25f47a22-6b98728d-eb74e868_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:10.204276Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:10.204293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:10.204296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:10.204298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:10.204310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895404661784426:7122]
2025-09-30T14:53:10.204315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895404661784426:7122]
2025-09-30T14:53:10.204320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895404661784426:7122]
2025-09-30T14:53:10.204368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:10.204375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.204378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:10.204379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:10.204387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:10.204392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:10.204540Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:10.211681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1098 sessionId: src_id|ae69f98-25f47a22-6b98728d-eb74e868_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:10.214550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:10.265041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895404751532527:5026]
2025-09-30T14:53:10.265347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1097, pipe: [1:7555895404751532527:5026]
2025-09-30T14:53:10.321394Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:10.321969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:10.321986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:10.322007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895404751532527:5026], now have 1 active actors on pipe
2025-09-30T14:53:10.322207Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:10.322228Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:10.322221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895404751532527:5026]
2025-09-30T14:53:10.322254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:10.322257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:10.322317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1098 reason: error at write: Disconnected sessionId: src_id|ae69f98-25f47a22-6b98728d-eb74e868_0
2025-09-30T14:53:10.322533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1098 sessionId: src_id|ae69f98-25f47a22-6b98728d-eb74e868_0 is DEAD
2025-09-30T14:53:10.322708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae69f98-25f47a22-6b98728d-eb74e868_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:10.322729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae69f98-25f47a22-6b98728d-eb74e868_0] Write session will restart in 0.005281s
2025-09-30T14:53:10.322754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae69f98-25f47a22-6b98728d-eb74e868_0] Write session: Do CDS request
2025-09-30T14:53:10.322760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae69f98-25f47a22-6b98728d-eb74e868_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:10.331886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae69f98-25f47a22-6b98728d-eb74e868_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:10.331982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:10.331999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1099
2025-09-30T14:53:10.332133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1099 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:10.332163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1099 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:10.332168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1099 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:10.332172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:10.332661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1099 sessionId:  describe result for acl check
2025-09-30T14:53:10.332716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:10.332724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:10.332726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:10.332732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895404751532572:4275] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:10.333335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895404751532572:4275] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:10.336458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895404751532572:4275] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:10.338458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:10.340964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:10.341167Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:10.341178Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:10.341189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:10.341254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:10.341293Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895404661784612:7124]
2025-09-30T14:53:10.342017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:10.342397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:10.342461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:10.342827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:10.342899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:10.342905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:10.342907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:10.342908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:10.342910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:10.342911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:10.342912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:10.342914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:10.342915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:10.342916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:10.342918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.342920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.342921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.342922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:10.342924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:10.342930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:10.342941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:10.342946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:10.342951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:10.342955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:10.342961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:10.342965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:10.342970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:10.342974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:10.342981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:10.342986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.342990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.342995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.342999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:10.343004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:10.343012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:10.343021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:10.343027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:10.343033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:10.343039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:10.343045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:10.343052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:10.343058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:10.343064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:10.343070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:10.343075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:10.343087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:10.343092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:10.343098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:10.343107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:10.343113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:10.343121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:10.343127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:10.343137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:10.343143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:10.343149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.343155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.343161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.343172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.343177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.343183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.343187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:10.343193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:10.343199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:10.343205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:10.338464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895404751532572:4275] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:10.343279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:10.338481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895404751532572:4275] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:10.338485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895404751532572:4275] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:10.338494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1099 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:10.348975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:10.349908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:10.349928Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:10.349931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:10.349936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:10.349944Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1098 [2:7555895404661784612:7124]
2025-09-30T14:53:10.349961Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:10.349978Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:10.349989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:10.349993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:10.349997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:10.350016Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:10.350029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:10.350036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:10.350099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.350107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.350110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.350114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:10.350116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:10.350202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:10.350210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.350224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.350237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.350258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:10.350283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895404751532703:4275], now have 1 active actors on pipe
2025-09-30T14:53:10.350290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895404661784606:7124]
2025-09-30T14:53:10.350292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895404661784606:7124]
2025-09-30T14:53:10.350295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895404661784606:7124]
2025-09-30T14:53:10.350310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:10.350322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895404751532528:2454], now have 1 active actors on pipe
2025-09-30T14:53:10.350331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:10.350333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:10.350337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:10.350340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:10.350352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:10.350355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:10.350368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1098
2025-09-30T14:53:10.350407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1098
2025-09-30T14:53:10.350389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895404661784606:7124]
2025-09-30T14:53:10.350399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:10.350401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:10.350426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:10.350432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:10.350467Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a02cb33-62529600-7db3e77e-5b105e8e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:10.350480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:10.350484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:10.350487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:10.350497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:10.350511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:10.350537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:10.350699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:10.350709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:10.350723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:10.350835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1099 partition: 0 MaxSeqNo: 42 sessionId: src_id|3a02cb33-62529600-7db3e77e-5b105e8e_0
2025-09-30T14:53:10.351237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae69f98-25f47a22-6b98728d-eb74e868_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3a02cb33-62529600-7db3e77e-5b105e8e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:10.354020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a02cb33-62529600-7db3e77e-5b105e8e_0] Write session: try to update token
2025-09-30T14:53:10.354040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a02cb33-62529600-7db3e77e-5b105e8e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:10.363099Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:10.363115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:10.363119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:10.363121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:10.363130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895404661784606:7124]
2025-09-30T14:53:10.363139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895404661784606:7124]
2025-09-30T14:53:10.363144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895404661784606:7124]
2025-09-30T14:53:10.363194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:10.363200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:10.363207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:10.363208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.363211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:10.363212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:10.363375Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:10.370691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1099 sessionId: src_id|3a02cb33-62529600-7db3e77e-5b105e8e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:10.373588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:10.422374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895404751532717:5026]
2025-09-30T14:53:10.422677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1098, pipe: [1:7555895404751532717:5026]
2025-09-30T14:53:10.481396Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:10.481902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:10.481920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:10.481939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895404751532717:5026], now have 1 active actors on pipe
2025-09-30T14:53:10.482183Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:10.482190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:10.482207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:10.482271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1099 reason: error at write: Disconnected sessionId: src_id|3a02cb33-62529600-7db3e77e-5b105e8e_0
2025-09-30T14:53:10.482278Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:10.482328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895404751532717:5026]
2025-09-30T14:53:10.482487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1099 sessionId: src_id|3a02cb33-62529600-7db3e77e-5b105e8e_0 is DEAD
2025-09-30T14:53:10.482751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a02cb33-62529600-7db3e77e-5b105e8e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:10.482767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a02cb33-62529600-7db3e77e-5b105e8e_0] Write session will restart in 0.007611s
2025-09-30T14:53:10.482806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a02cb33-62529600-7db3e77e-5b105e8e_0] Write session: Do CDS request
2025-09-30T14:53:10.482816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a02cb33-62529600-7db3e77e-5b105e8e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:10.491927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a02cb33-62529600-7db3e77e-5b105e8e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:10.492996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:10.493009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1100
2025-09-30T14:53:10.493155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1100 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:10.493198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1100 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:10.493208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1100 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:10.493212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:10.493730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1100 sessionId:  describe result for acl check
2025-09-30T14:53:10.493772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:10.493780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:10.493781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:10.493787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895404751532808:4269] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:10.494364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895404751532808:4269] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:10.497245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:10.497603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895404751532808:4269] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:10.499684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:10.499880Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:10.499891Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:10.499901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:10.499956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:10.499997Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895404661784792:7126]
2025-09-30T14:53:10.500220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895404751532808:4269] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:10.500234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895404751532808:4269] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:10.500237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895404751532808:4269] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:10.500245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1100 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:10.500635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:10.500979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:10.501045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:10.501428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:10.501515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:10.501523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:10.501524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:10.501525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:10.501526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:10.501528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:10.501528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:10.501529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:10.501530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:10.501531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:10.501533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.501534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.501535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.501536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:10.501537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:10.501544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:10.501556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:10.501572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:10.501576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:10.501581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:10.501585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:10.501590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:10.501594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:10.501598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:10.501602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:10.501606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.501610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.501614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.501618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:10.501623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:10.501632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:10.501642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:10.501648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:10.501654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:10.501660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:10.501665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:10.501670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:10.501676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:10.501681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:10.501686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:10.501691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:10.501697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:10.501702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:10.501708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:10.501719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:10.501725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:10.501730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:10.501735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:10.501740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:10.501746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:10.501752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.501763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.501768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.501773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.501783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.501788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.501797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:10.501802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:10.501807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:10.501814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:10.501867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:10.507505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:10.508708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:10.508725Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:10.508728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:10.508731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:10.508738Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1099 [2:7555895404661784792:7126]
2025-09-30T14:53:10.508755Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:10.508770Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:10.508774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:10.508777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:10.508779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:10.508796Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:10.508803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:10.508809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:10.508869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.508876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.508879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.508883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:10.508885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:10.508948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:10.508956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.508970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.508987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.509010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:10.509028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895404751532896:4269], now have 1 active actors on pipe
2025-09-30T14:53:10.509032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895404751532718:2454], now have 1 active actors on pipe
2025-09-30T14:53:10.509038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895404661784787:7126]
2025-09-30T14:53:10.509041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895404661784787:7126]
2025-09-30T14:53:10.509043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895404661784787:7126]
2025-09-30T14:53:10.509056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:10.509088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1099
2025-09-30T14:53:10.509095Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1099
2025-09-30T14:53:10.509076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:10.509079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:10.509084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:10.509087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:10.509094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:10.509097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:10.509132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895404661784787:7126]
2025-09-30T14:53:10.509135Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:10.509138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:10.509165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:10.509170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:10.509209Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7893ea6-d1dda224-ea2c42b5-adbdcf8e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:10.509216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:10.509219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:10.509221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:10.509230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:10.509238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:10.509255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:10.509396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:10.509406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:10.509422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:10.509527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1100 partition: 0 MaxSeqNo: 42 sessionId: src_id|f7893ea6-d1dda224-ea2c42b5-adbdcf8e_0
2025-09-30T14:53:10.509910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a02cb33-62529600-7db3e77e-5b105e8e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f7893ea6-d1dda224-ea2c42b5-adbdcf8e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:10.513131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7893ea6-d1dda224-ea2c42b5-adbdcf8e_0] Write session: try to update token
2025-09-30T14:53:10.513153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7893ea6-d1dda224-ea2c42b5-adbdcf8e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:10.521336Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:10.521356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:10.521359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:10.521361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:10.521371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895404661784787:7126]
2025-09-30T14:53:10.521376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895404661784787:7126]
2025-09-30T14:53:10.521381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895404661784787:7126]
2025-09-30T14:53:10.521422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:10.521429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.521429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:10.521432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:10.521436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:10.521440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:10.521568Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:10.529516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1100 sessionId: src_id|f7893ea6-d1dda224-ea2c42b5-adbdcf8e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:10.532434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:10.582455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895404751532924:5026]
2025-09-30T14:53:10.582862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1099, pipe: [1:7555895404751532924:5026]
2025-09-30T14:53:10.635347Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:10.635743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:10.635762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:10.635800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895404751532924:5026], now have 1 active actors on pipe
2025-09-30T14:53:10.636040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:10.636064Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:10.636056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:10.636068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895404751532924:5026]
2025-09-30T14:53:10.636089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:10.636115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1100 reason: error at write: Disconnected sessionId: src_id|f7893ea6-d1dda224-ea2c42b5-adbdcf8e_0
2025-09-30T14:53:10.636309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1100 sessionId: src_id|f7893ea6-d1dda224-ea2c42b5-adbdcf8e_0 is DEAD
2025-09-30T14:53:10.636463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7893ea6-d1dda224-ea2c42b5-adbdcf8e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:10.636474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7893ea6-d1dda224-ea2c42b5-adbdcf8e_0] Write session will restart in 0.006339s
2025-09-30T14:53:10.636498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7893ea6-d1dda224-ea2c42b5-adbdcf8e_0] Write session: Do CDS request
2025-09-30T14:53:10.636504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7893ea6-d1dda224-ea2c42b5-adbdcf8e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:10.643820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7893ea6-d1dda224-ea2c42b5-adbdcf8e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:10.643925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:10.643942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1101
2025-09-30T14:53:10.644121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1101 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:10.644160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1101 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:10.644170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1101 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:10.644174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:10.644865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1101 sessionId:  describe result for acl check
2025-09-30T14:53:10.644901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:10.644909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:10.644911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:10.644917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895404751532973:4251] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:10.645446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895404751532973:4251] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:10.648351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895404751532973:4251] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:10.651173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:10.651621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895404751532973:4251] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:10.651635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895404751532973:4251] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:10.651639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895404751532973:4251] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:10.651647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1101 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:10.653479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:10.653701Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:10.653710Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:10.653721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:10.653778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:10.653831Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895404661785012:7141]
2025-09-30T14:53:10.654504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:10.654888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:10.654948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:10.655325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:10.655391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:10.655397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:10.655399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:10.655400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:10.655401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:10.655403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:10.655404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:10.655405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:10.655407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:10.655408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:10.655410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.655411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.655412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.655414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:10.655415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:10.655421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:10.655432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:10.655437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:10.655441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:10.655445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:10.655450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:10.655454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:10.655458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:10.655462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:10.655466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:10.655469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.655472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.655476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.655479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:10.655498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:10.655506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:10.655514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:10.655520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:10.655525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:10.655530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:10.655536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:10.655541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:10.655546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:10.655550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:10.655555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:10.655559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:10.655563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:10.655567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:10.655572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:10.655576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:10.655581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:10.655586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:10.655591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:10.655594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:10.655599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:10.655603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.655608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.655612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.655617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.655621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.655626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.655630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:10.655634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:10.655639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:10.655643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:10.655688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:10.661356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:10.662478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:10.662500Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:10.662503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:10.662507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:10.662514Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1100 [2:7555895404661785012:7141]
2025-09-30T14:53:10.662531Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:10.662547Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:10.662550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:10.662553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:10.662556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:10.662572Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:10.662583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:10.662590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:10.662655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.662664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.662667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.662670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:10.662673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:10.662740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:10.662748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.662762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.662782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.662807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:10.662830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895404751533113:4251], now have 1 active actors on pipe
2025-09-30T14:53:10.662834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895404751532934:2454], now have 1 active actors on pipe
2025-09-30T14:53:10.662842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895404661785006:7141]
2025-09-30T14:53:10.662849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895404661785006:7141]
2025-09-30T14:53:10.662852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895404661785006:7141]
2025-09-30T14:53:10.662866Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:10.662882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:10.662886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:10.662894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:10.662897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:10.662903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:10.662906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:10.662912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1100
2025-09-30T14:53:10.662947Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1100
2025-09-30T14:53:10.662941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895404661785006:7141]
2025-09-30T14:53:10.662949Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:10.662952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:10.662975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:10.662980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:10.663017Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9acf05f-e974c187-e2b0b9e4-7682f64_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:10.663029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:10.663033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:10.663041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:10.663050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:10.663061Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:10.663086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:10.663302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:10.663314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:10.663341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:10.663444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1101 partition: 0 MaxSeqNo: 42 sessionId: src_id|e9acf05f-e974c187-e2b0b9e4-7682f64_0
2025-09-30T14:53:10.667537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7893ea6-d1dda224-ea2c42b5-adbdcf8e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e9acf05f-e974c187-e2b0b9e4-7682f64_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:10.670302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9acf05f-e974c187-e2b0b9e4-7682f64_0] Write session: try to update token
2025-09-30T14:53:10.670321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9acf05f-e974c187-e2b0b9e4-7682f64_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:10.675510Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:10.675531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:10.675534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:10.675536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:10.675546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895404661785006:7141]
2025-09-30T14:53:10.675551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895404661785006:7141]
2025-09-30T14:53:10.675556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895404661785006:7141]
2025-09-30T14:53:10.675596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:10.675607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.675606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:10.675613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:10.675614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:10.675618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:10.675753Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:10.687261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1101 sessionId: src_id|e9acf05f-e974c187-e2b0b9e4-7682f64_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:10.690492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:10.739332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895404751533124:5026]
2025-09-30T14:53:10.743520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1100, pipe: [1:7555895404751533124:5026]
2025-09-30T14:53:10.797212Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:10.797672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:10.797699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:10.797732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895404751533124:5026], now have 1 active actors on pipe
2025-09-30T14:53:10.797982Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:10.798049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:10.798056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:10.798058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895404751533124:5026]
2025-09-30T14:53:10.798066Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:10.798081Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:53:10.798140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1101 reason: error at write: Disconnected sessionId: src_id|e9acf05f-e974c187-e2b0b9e4-7682f64_0
2025-09-30T14:53:10.798222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1101 sessionId: src_id|e9acf05f-e974c187-e2b0b9e4-7682f64_0 is DEAD
2025-09-30T14:53:10.798336Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 11 consumer shared/user session shared/user_1_11_12961624380292939000_v1 is DEAD
2025-09-30T14:53:10.798448Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:53:10.798521Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895336032041415:5025] disconnected; active server actors: 1
2025-09-30T14:53:10.798531Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895336032041415:5025] client user disconnected session shared/user_1_11_12961624380292939000_v1
2025-09-30T14:53:10.798599Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:53:10.798605Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:53:10.798612Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.008130s
2025-09-30T14:53:10.799496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9acf05f-e974c187-e2b0b9e4-7682f64_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:10.799504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9acf05f-e974c187-e2b0b9e4-7682f64_0] Write session will restart in 0.008405s
2025-09-30T14:53:10.799530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9acf05f-e974c187-e2b0b9e4-7682f64_0] Write session: Do CDS request
2025-09-30T14:53:10.799537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9acf05f-e974c187-e2b0b9e4-7682f64_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:10.807642Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:53:10.807893Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:53:10.807905Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 12
2025-09-30T14:53:10.808051Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 12 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:53:10.808113Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:53:10.808203Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 auth for : user
2025-09-30T14:53:10.808427Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 Handle describe topics response
2025-09-30T14:53:10.808461Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 auth is DEAD
2025-09-30T14:53:10.808470Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:53:10.808672Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:10.808682Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1102
2025-09-30T14:53:10.808727Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:53:10.808751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9acf05f-e974c187-e2b0b9e4-7682f64_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:10.808813Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895404751533176:4246] connected; active server actors: 1
2025-09-30T14:53:10.808825Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_12_6661911660038712371_v1
2025-09-30T14:53:10.808830Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555895404751533176:4246] session shared/user_1_12_6661911660038712371_v1
2025-09-30T14:53:10.808843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:53:10.808852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:53:10.808859Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_12_6661911660038712371_v1" (Sender=[1:7555895404751533156:4246], Pipe=[1:7555895404751533176:4246], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:53:10.808863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:53:10.808875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:53:10.808889Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_12_6661911660038712371_v1" (Sender=[1:7555895404751533156:4246], Pipe=[1:7555895404751533176:4246], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:53:10.808903Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_12_6661911660038712371_v1" sender [1:7555895404751533156:4246] lock partition 0 for ReadingSession "shared/user_1_12_6661911660038712371_v1" (Sender=[1:7555895404751533156:4246], Pipe=[1:7555895404751533176:4246], Partitions=[], ActiveFamilyCount=1) generation 1 step 12
2025-09-30T14:53:10.808921Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:53:10.808930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000047s
2025-09-30T14:53:10.808950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1102 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:10.808979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1102 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:10.808988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1102 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:10.808992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:10.809182Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 12 Session: "shared/user_1_12_6661911660038712371_v1" ClientId: "user" PipeClient { RawX1: 7555895404751533176 RawX2: 4503603922342038 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:53:10.809216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:53:10.809332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1102 sessionId:  describe result for acl check
2025-09-30T14:53:10.809368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:10.809370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:10.809372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:10.809378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895404751533197:4243] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:10.809925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895404751533197:4243] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:10.813238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895404751533197:4243] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:10.815577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:10.819665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:10.819859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895404751533197:4243] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:10.819876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895404751533197:4243] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:10.819881Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:10.819879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895404751533197:4243] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:10.819893Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:10.819887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1102 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:10.819903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:10.819953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:10.819998Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895404661785195:7143]
2025-09-30T14:53:10.820646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:10.820931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:10.820980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:10.821298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:10.821377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:10.821383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:10.821384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:10.821385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:10.821387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:10.821388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:10.821389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:10.821391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:10.821392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:10.821393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:10.821395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.821396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.821397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.821398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:10.821400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:10.821406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:10.821416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:10.821421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:10.821426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:10.821430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:10.821434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:10.821438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:10.821443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:10.821447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:10.821452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:10.821456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.821460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.821464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.821468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:10.821473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:10.821481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:10.821488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:10.821494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:10.821500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:10.821505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:10.821511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:10.821515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:10.821521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:10.821526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:10.821531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:10.821536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:10.821541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:10.821546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:10.821551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:10.821556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:10.821561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:10.821566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:10.821573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:10.821577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:10.821588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:10.821593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.821603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.821607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.821613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.821618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.821623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.821632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:10.821637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:10.821642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:10.821651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:10.821696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:10.827143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:10.828477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:10.828494Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:10.828497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:10.828501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:10.828507Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1101 [2:7555895404661785195:7143]
2025-09-30T14:53:10.828534Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:10.828549Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:10.828552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:10.828556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:10.828558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:10.828573Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:10.828580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:10.828591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:10.828663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.828671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.828673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.828677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:10.828680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:10.828751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:10.828759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.828772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.828785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.828804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:10.828828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895404751533126:2454], now have 1 active actors on pipe
2025-09-30T14:53:10.828836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895404751533313:4243], now have 1 active actors on pipe
2025-09-30T14:53:10.828839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895404751533193:4239], now have 1 active actors on pipe
2025-09-30T14:53:10.828846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895404661785190:7143]
2025-09-30T14:53:10.828848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895404661785190:7143]
2025-09-30T14:53:10.828850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895404661785190:7143]
2025-09-30T14:53:10.828869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:10.828888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:10.828898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:10.828903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:10.828906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:10.828908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:10.828911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:10.828941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895404661785190:7143]
2025-09-30T14:53:10.828946Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:10.828951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:10.828924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1101
2025-09-30T14:53:10.828938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1101
2025-09-30T14:53:10.828971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1101, pipe: [1:7555895404751533193:4239]
2025-09-30T14:53:10.828983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:10.828991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:10.829016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:10.829023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:10.829029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_12_6661911660038712371_v1 on pipe: [1:7555895404751533193:4239]
2025-09-30T14:53:10.829058Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|134938e6-5f6a19b3-442cd4ae-6eb974fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:10.829068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:10.829069Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_12_6661911660038712371_v1:1 with generation 1101
2025-09-30T14:53:10.829072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:10.829073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:10.829084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:10.829094Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:10.829110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:10.829115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:10.829117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:10.829132Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_12_6661911660038712371_v1
2025-09-30T14:53:10.829140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:10.829164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:10.829184Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:53:10.829309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:10.829321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:10.829336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:10.829432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1102 partition: 0 MaxSeqNo: 42 sessionId: src_id|134938e6-5f6a19b3-442cd4ae-6eb974fc_0
2025-09-30T14:53:10.829842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9acf05f-e974c187-e2b0b9e4-7682f64_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|134938e6-5f6a19b3-442cd4ae-6eb974fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:10.832746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|134938e6-5f6a19b3-442cd4ae-6eb974fc_0] Write session: try to update token
2025-09-30T14:53:10.832765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|134938e6-5f6a19b3-442cd4ae-6eb974fc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:10.833090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:53:10.833125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:53:10.833134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:10.833136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:10.833139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:10.833146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:53:10.833157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:53:10.833302Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759243990828 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:53:10.833322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:53:10.833369Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 sending to client partition status
2025-09-30T14:53:10.841257Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:10.841275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:10.841278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:10.841279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:10.841288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895404661785190:7143]
2025-09-30T14:53:10.841293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895404661785190:7143]
2025-09-30T14:53:10.841297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895404661785190:7143]
2025-09-30T14:53:10.841335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:10.841335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:10.841342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:10.841343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.841345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:10.841347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:10.841479Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:10.858446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1102 sessionId: src_id|134938e6-5f6a19b3-442cd4ae-6eb974fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:10.861105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:10.956052Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:10.956569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:10.956589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:10.956800Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:10.956845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:10.956848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:10.956852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895404751533193:4239]
2025-09-30T14:53:10.956859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_12_6661911660038712371_v1
2025-09-30T14:53:10.956880Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:10.956900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1102 reason: error at write: Disconnected sessionId: src_id|134938e6-5f6a19b3-442cd4ae-6eb974fc_0
2025-09-30T14:53:10.956910Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_12_6661911660038712371_v1
2025-09-30T14:53:10.957065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1102 sessionId: src_id|134938e6-5f6a19b3-442cd4ae-6eb974fc_0 is DEAD
2025-09-30T14:53:10.957212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|134938e6-5f6a19b3-442cd4ae-6eb974fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:10.957224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|134938e6-5f6a19b3-442cd4ae-6eb974fc_0] Write session will restart in 0.008896s
2025-09-30T14:53:10.957250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|134938e6-5f6a19b3-442cd4ae-6eb974fc_0] Write session: Do CDS request
2025-09-30T14:53:10.957256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|134938e6-5f6a19b3-442cd4ae-6eb974fc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:10.967769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|134938e6-5f6a19b3-442cd4ae-6eb974fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:10.967888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:10.967904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1103
2025-09-30T14:53:10.968044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1103 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:10.968072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1103 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:10.968076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1103 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:10.968081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:10.968627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1103 sessionId:  describe result for acl check
2025-09-30T14:53:10.968664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:10.968671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:10.968673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:10.968678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895404751533437:4235] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:10.969230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895404751533437:4235] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:10.971410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895404751533437:4235] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:10.974024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:10.974097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895404751533437:4235] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:10.974111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895404751533437:4235] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:10.974115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895404751533437:4235] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:10.974123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1103 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:10.976622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:10.976895Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:10.976908Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:10.976919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:10.976979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:10.977023Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895404661785383:7145]
2025-09-30T14:53:10.977684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:10.978019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:10.978064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:10.978325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:10.978374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:10.978380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:10.978381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:10.978381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:10.978382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:10.978383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:10.978384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:10.978385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:10.978386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:10.978386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:10.978387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.978388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.978389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.978389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:10.978390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:10.978394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:10.978401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:10.978403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:10.978406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:10.978408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:10.978411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:10.978413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:10.978415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:10.978418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:10.978422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:10.978424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.978427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.978429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.978431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:10.978434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:10.978439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:10.978446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:10.978451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:10.978457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:10.978462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:10.978468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:10.978473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:10.978477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:10.978479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:10.978482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:10.978485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:10.978488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:10.978493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:10.978496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:10.978498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:10.978501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:10.978504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:10.978507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:10.978509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:10.978512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:10.978515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.978518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.978521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.978523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.978525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.978528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.978531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:10.978534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:10.978537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:10.978540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:10.978563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:10.984085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:10.985165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:10.985182Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:10.985184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:10.985189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:10.985196Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1102 [2:7555895404661785383:7145]
2025-09-30T14:53:10.985211Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:10.985227Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:10.985231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:10.985234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:10.985236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:10.985252Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:10.985259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:10.985266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:10.985328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.985337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.985339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.985343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:10.985345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:10.985408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:10.985416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.985427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:10.985440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:10.985464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:10.985487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895404751533508:4235], now have 1 active actors on pipe
2025-09-30T14:53:10.985497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895404751533331:2454], now have 1 active actors on pipe
2025-09-30T14:53:10.985503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895404661785377:7145]
2025-09-30T14:53:10.985507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895404661785377:7145]
2025-09-30T14:53:10.985509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895404661785377:7145]
2025-09-30T14:53:10.985522Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:10.985535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:10.985537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:10.985540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:10.985543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:10.985553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:10.985555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:10.985586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895404661785377:7145]
2025-09-30T14:53:10.985564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1102
2025-09-30T14:53:10.985595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:10.985597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:10.985579Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1102
2025-09-30T14:53:10.985624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:10.985628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:10.985662Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|687eac3a-53b60318-30966b19-3adae0b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:10.985675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:10.985679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:10.985681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:10.985691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:10.985699Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:10.985716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:10.985856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:10.985865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:10.985879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:10.985949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1103 partition: 0 MaxSeqNo: 42 sessionId: src_id|687eac3a-53b60318-30966b19-3adae0b5_0
2025-09-30T14:53:10.986370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|134938e6-5f6a19b3-442cd4ae-6eb974fc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|687eac3a-53b60318-30966b19-3adae0b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:10.989114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|687eac3a-53b60318-30966b19-3adae0b5_0] Write session: try to update token
2025-09-30T14:53:10.989137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|687eac3a-53b60318-30966b19-3adae0b5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:10.997916Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:10.997932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:10.997936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:10.997938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:10.997948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895404661785377:7145]
2025-09-30T14:53:10.997953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895404661785377:7145]
2025-09-30T14:53:10.997960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895404661785377:7145]
2025-09-30T14:53:10.998000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:10.998008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:10.998010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:10.998009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:10.998014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:10.998020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:10.998237Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:11.004541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1103 sessionId: src_id|687eac3a-53b60318-30966b19-3adae0b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:11.007194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:11.057089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895409046500826:4239]
2025-09-30T14:53:11.057356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1102, pipe: [1:7555895409046500826:4239]
2025-09-30T14:53:11.109804Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:11.110183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:11.110198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:11.110230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895409046500826:4239], now have 1 active actors on pipe
2025-09-30T14:53:11.110461Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:11.110505Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:11.110507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:11.110562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895409046500826:4239]
2025-09-30T14:53:11.110578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1103 reason: status is not ok: tablet will be restarted right now sessionId: src_id|687eac3a-53b60318-30966b19-3adae0b5_0
2025-09-30T14:53:11.110757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1103 sessionId: src_id|687eac3a-53b60318-30966b19-3adae0b5_0 is DEAD
2025-09-30T14:53:11.110886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|687eac3a-53b60318-30966b19-3adae0b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:11.110896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|687eac3a-53b60318-30966b19-3adae0b5_0] Write session will restart in 0.009124s
2025-09-30T14:53:11.110940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|687eac3a-53b60318-30966b19-3adae0b5_0] Write session: Do CDS request
2025-09-30T14:53:11.110946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|687eac3a-53b60318-30966b19-3adae0b5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:11.120830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|687eac3a-53b60318-30966b19-3adae0b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:11.121258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:11.121275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1104
2025-09-30T14:53:11.121427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1104 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:11.121461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1104 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:11.121470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1104 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:11.121474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:11.121896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1104 sessionId:  describe result for acl check
2025-09-30T14:53:11.121924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:11.121926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:11.121927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:11.121932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895409046500957:4223] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:11.122474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895409046500957:4223] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:11.124302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:11.124584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895409046500957:4223] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:11.126884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:11.127110Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:11.127119Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:11.127128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:11.127194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:11.127237Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895408956752878:7149]
2025-09-30T14:53:11.127361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895409046500957:4223] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:11.127375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895409046500957:4223] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:11.127379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895409046500957:4223] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:11.127387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1104 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:11.127890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:11.128220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:11.128297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:11.128652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:11.128726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:11.128733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:11.128734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:11.128736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:11.128737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:11.128738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:11.128739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:11.128741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:11.128742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:11.128744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:11.128745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.128746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.128748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.128749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:11.128750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:11.128756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:11.128768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:11.128773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:11.128777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:11.128782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:11.128787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:11.128792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:11.128796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:11.128801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:11.128806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:11.128811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.128816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.128821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.128825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:11.128830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:11.128837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:11.128846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:11.128857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:11.128864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:11.128873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:11.128879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:11.128896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:11.128906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:11.128911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:11.128921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:11.128928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:11.128938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:11.128947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:11.128957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:11.128966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:11.128977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:11.128987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:11.128993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:11.129002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:11.129008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:11.129018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.129025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.129033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.129039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.129045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.129051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.129056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:11.129066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:11.129075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:11.129081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:11.129149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:11.134657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:11.135831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:11.135846Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:11.135849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:11.135853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:11.135859Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1103 [2:7555895408956752878:7149]
2025-09-30T14:53:11.135875Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:11.135890Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:11.135893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:11.135895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:11.135898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:11.135913Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:11.135919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:11.135931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:11.135990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.135997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.136000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.136003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:11.136006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:11.136065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:11.136072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.136084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.136099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.136119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:11.136142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895409046500831:2454], now have 1 active actors on pipe
2025-09-30T14:53:11.136150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895409046501014:4223], now have 1 active actors on pipe
2025-09-30T14:53:11.136157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895408956752872:7149]
2025-09-30T14:53:11.136160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895408956752872:7149]
2025-09-30T14:53:11.136162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895408956752872:7149]
2025-09-30T14:53:11.136174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:11.136188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:11.136192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:11.136200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:11.136202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:11.136205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:11.136208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:11.136211Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1103
2025-09-30T14:53:11.136237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895408956752872:7149]
2025-09-30T14:53:11.136223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1103
2025-09-30T14:53:11.136245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:11.136247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:11.136260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:11.136269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:11.136314Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd892080-2986d78c-c821009-d8ab43b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:11.136325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:11.136328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:11.136330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:11.136339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:11.136352Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:11.136374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:11.136644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:11.136665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:11.136692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:11.136795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1104 partition: 0 MaxSeqNo: 42 sessionId: src_id|cd892080-2986d78c-c821009-d8ab43b3_0
2025-09-30T14:53:11.137190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|687eac3a-53b60318-30966b19-3adae0b5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cd892080-2986d78c-c821009-d8ab43b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:11.139934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd892080-2986d78c-c821009-d8ab43b3_0] Write session: try to update token
2025-09-30T14:53:11.139949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd892080-2986d78c-c821009-d8ab43b3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:11.148415Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:11.148439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:11.148442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:11.148444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:11.148455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895408956752872:7149]
2025-09-30T14:53:11.148460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895408956752872:7149]
2025-09-30T14:53:11.148465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895408956752872:7149]
2025-09-30T14:53:11.148505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:11.148508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:11.148512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.148516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:11.148516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:11.148520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:11.148697Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:11.154484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1104 sessionId: src_id|cd892080-2986d78c-c821009-d8ab43b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:11.157364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:11.210687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895409046501037:4239]
2025-09-30T14:53:11.210942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1103, pipe: [1:7555895409046501037:4239]
2025-09-30T14:53:11.264962Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:11.265362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:11.265378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:11.265419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895409046501037:4239], now have 1 active actors on pipe
2025-09-30T14:53:11.265627Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:11.266246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd892080-2986d78c-c821009-d8ab43b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:11.266259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd892080-2986d78c-c821009-d8ab43b3_0] Write session will restart in 0.008188s
2025-09-30T14:53:11.266287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd892080-2986d78c-c821009-d8ab43b3_0] Write session: Do CDS request
2025-09-30T14:53:11.266292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd892080-2986d78c-c821009-d8ab43b3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:11.265742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:11.265848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1104 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cd892080-2986d78c-c821009-d8ab43b3_0
2025-09-30T14:53:11.266065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1104 sessionId: src_id|cd892080-2986d78c-c821009-d8ab43b3_0 is DEAD
2025-09-30T14:53:11.266281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895409046501037:4239]
2025-09-30T14:53:11.266296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:11.275765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd892080-2986d78c-c821009-d8ab43b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:11.275899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:11.275927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1105
2025-09-30T14:53:11.276098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1105 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:11.276133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1105 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:11.276139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1105 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:11.276154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:11.276769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1105 sessionId:  describe result for acl check
2025-09-30T14:53:11.276811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:11.276816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:11.276819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:11.276826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895409046501089:4217] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:11.277538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895409046501089:4217] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:11.280836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895409046501089:4217] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:11.283755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895409046501089:4217] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:11.283772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895409046501089:4217] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:11.283776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895409046501089:4217] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:11.283784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1105 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:11.284249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:11.286300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:11.286493Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:11.286503Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:11.286526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:11.286584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:11.286622Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895408956753065:7151]
2025-09-30T14:53:11.287317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:11.287639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:11.287683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:11.287999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:11.288063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:11.288067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:11.288069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:11.288070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:11.288071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:11.288073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:11.288074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:11.288075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:11.288076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:11.288078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:11.288079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.288080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.288081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.288082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:11.288083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:11.288088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:11.288099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:11.288103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:11.288108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:11.288112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:11.288116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:11.288120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:11.288124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:11.288128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:11.288133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:11.288137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.288141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.288145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.288149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:11.288153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:11.288160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:11.288167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:11.288184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:11.288189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:11.288193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:11.288197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:11.288202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:11.288207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:11.288212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:11.288218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:11.288222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:11.288228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:11.288233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:11.288238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:11.288243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:11.288248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:11.288253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:11.288260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:11.288273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:11.288277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:11.288282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.288288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.288293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.288299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.288307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.288313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.288319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:11.288324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:11.288328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:11.288334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:11.288379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:11.293965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:11.295176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:11.295195Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:11.295197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:11.295201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:11.295208Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1104 [2:7555895408956753065:7151]
2025-09-30T14:53:11.295226Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:11.295298Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:11.295306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:11.295310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:11.295312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:11.295327Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:11.295335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:11.295342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:11.295405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.295414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.295417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.295420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:11.295423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:11.295491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:11.295499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.295512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.295523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.295539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:11.295563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895409046501220:4217], now have 1 active actors on pipe
2025-09-30T14:53:11.295571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895409046501039:2454], now have 1 active actors on pipe
2025-09-30T14:53:11.295577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895408956753060:7151]
2025-09-30T14:53:11.295580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895408956753060:7151]
2025-09-30T14:53:11.295583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895408956753060:7151]
2025-09-30T14:53:11.295597Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:11.295617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:11.295628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:11.295632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:11.295633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:11.295634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:11.295638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:11.295672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895408956753060:7151]
2025-09-30T14:53:11.295681Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:11.295651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1104
2025-09-30T14:53:11.295685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:11.295707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:11.295666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1104
2025-09-30T14:53:11.295712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:11.295750Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a50f89a-5177566f-7fadf4fc-acbfd1b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:11.295761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:11.295765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:11.295767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:11.295779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:11.295789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:11.295814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:11.295961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:11.295971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:11.295986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:11.296074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1105 partition: 0 MaxSeqNo: 42 sessionId: src_id|5a50f89a-5177566f-7fadf4fc-acbfd1b1_0
2025-09-30T14:53:11.296464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd892080-2986d78c-c821009-d8ab43b3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5a50f89a-5177566f-7fadf4fc-acbfd1b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:11.299236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a50f89a-5177566f-7fadf4fc-acbfd1b1_0] Write session: try to update token
2025-09-30T14:53:11.299282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a50f89a-5177566f-7fadf4fc-acbfd1b1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:11.310648Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:11.310672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:11.310674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:11.310676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:11.310687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895408956753060:7151]
2025-09-30T14:53:11.310692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895408956753060:7151]
2025-09-30T14:53:11.310696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895408956753060:7151]
2025-09-30T14:53:11.310737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:11.310745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.310745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:11.310749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:11.310751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:11.310758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:11.310897Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:11.316074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1105 sessionId: src_id|5a50f89a-5177566f-7fadf4fc-acbfd1b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:11.318735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:11.366358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895409046501233:4239]
2025-09-30T14:53:11.366718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1104, pipe: [1:7555895409046501233:4239]
2025-09-30T14:53:11.428359Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:11.428673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:11.428687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:11.428724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895409046501233:4239], now have 1 active actors on pipe
2025-09-30T14:53:11.428977Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:11.429433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a50f89a-5177566f-7fadf4fc-acbfd1b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:11.429444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a50f89a-5177566f-7fadf4fc-acbfd1b1_0] Write session will restart in 0.009686s
2025-09-30T14:53:11.429467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a50f89a-5177566f-7fadf4fc-acbfd1b1_0] Write session: Do CDS request
2025-09-30T14:53:11.429473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a50f89a-5177566f-7fadf4fc-acbfd1b1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:11.428986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:11.429003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:11.429013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895409046501233:4239]
2025-09-30T14:53:11.429041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:11.429068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1105 reason: error at write: Disconnected sessionId: src_id|5a50f89a-5177566f-7fadf4fc-acbfd1b1_0
2025-09-30T14:53:11.429285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1105 sessionId: src_id|5a50f89a-5177566f-7fadf4fc-acbfd1b1_0 is DEAD
2025-09-30T14:53:11.440723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a50f89a-5177566f-7fadf4fc-acbfd1b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:11.440824Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:11.440841Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1106
2025-09-30T14:53:11.440977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1106 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:11.441009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1106 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:11.441019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1106 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:11.441023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:11.441490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1106 sessionId:  describe result for acl check
2025-09-30T14:53:11.441526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:11.441529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:11.441531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:11.441537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895409046501383:4212] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:11.442088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895409046501383:4212] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:11.442107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:11.444087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895409046501383:4212] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:11.444694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:11.444925Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:11.444935Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:11.444945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:11.445000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:11.445042Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895408956753254:7155]
2025-09-30T14:53:11.445742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:11.446042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:11.446082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:11.446432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:11.446491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:11.446498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:11.446500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:11.446501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:11.446502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:11.446504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:11.446505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:11.446506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:11.446507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:11.446509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:11.446510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.446511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.446512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.446513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:11.446515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:11.446520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:11.446531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:11.446536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:11.446541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:11.446546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:11.446550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:11.446555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:11.446560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:11.446564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:11.446569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:11.446574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.446578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.446583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.446587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:11.446592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:11.446599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:11.446608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:11.446615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:11.446621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:11.446627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:11.446633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:11.446638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:11.446645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:11.446650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:11.446656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:11.446661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:11.446666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:11.446671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:11.446677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:11.446682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:11.446688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:11.446693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:11.446704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:11.446709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:11.446715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:11.446720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.446728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.446733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.446744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.446753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.446759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.446768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:11.446774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:11.446781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:11.446790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:11.446832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:11.446852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895409046501383:4212] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:11.446866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895409046501383:4212] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:11.446870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895409046501383:4212] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:11.446877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1106 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:11.452332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:11.453447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:11.453461Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:11.453462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:11.453465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:11.453471Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1105 [2:7555895408956753254:7155]
2025-09-30T14:53:11.453483Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:11.453496Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:11.453498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:11.453500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:11.453501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:11.453513Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:11.453517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:11.453523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:11.453569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.453576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.453577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.453579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:11.453581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:11.453659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:11.453666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.453680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.453692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.453715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:11.453738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895409046501421:4212], now have 1 active actors on pipe
2025-09-30T14:53:11.453746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895409046501235:2454], now have 1 active actors on pipe
2025-09-30T14:53:11.453753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895408956753249:7155]
2025-09-30T14:53:11.453755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895408956753249:7155]
2025-09-30T14:53:11.453758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895408956753249:7155]
2025-09-30T14:53:11.453770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:11.453787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:11.453792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:11.453795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:11.453797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:11.453807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:11.453810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:11.453759Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1105
2025-09-30T14:53:11.453759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1105
2025-09-30T14:53:11.453852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:11.453860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:11.453875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895408956753249:7155]
2025-09-30T14:53:11.453883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:11.453898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:11.453915Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|759c6d5b-2b55cbc8-13562848-cc87fbb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:11.453926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:11.453931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:11.453937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:11.453946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:11.453957Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:11.453985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:11.454172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:11.454179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:11.454194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:11.454296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1106 partition: 0 MaxSeqNo: 42 sessionId: src_id|759c6d5b-2b55cbc8-13562848-cc87fbb_0
2025-09-30T14:53:11.454669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a50f89a-5177566f-7fadf4fc-acbfd1b1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|759c6d5b-2b55cbc8-13562848-cc87fbb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:11.457444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|759c6d5b-2b55cbc8-13562848-cc87fbb_0] Write session: try to update token
2025-09-30T14:53:11.457463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|759c6d5b-2b55cbc8-13562848-cc87fbb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:11.466139Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:11.466164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:11.466167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:11.466169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:11.466180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895408956753249:7155]
2025-09-30T14:53:11.466184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895408956753249:7155]
2025-09-30T14:53:11.466191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895408956753249:7155]
2025-09-30T14:53:11.466238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:11.466251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.466254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:11.466427Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:11.471319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:11.471340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:11.471345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:11.474483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1106 sessionId: src_id|759c6d5b-2b55cbc8-13562848-cc87fbb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:11.477439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:11.529143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895409046501436:4239]
2025-09-30T14:53:11.529416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1105, pipe: [1:7555895409046501436:4239]
2025-09-30T14:53:11.579670Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:11.579990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:11.580006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:11.580026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895409046501436:4239], now have 1 active actors on pipe
2025-09-30T14:53:11.580248Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:11.580279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:11.580295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:11.580316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895409046501436:4239]
2025-09-30T14:53:11.580337Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:11.580360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1106 reason: error at write: Disconnected sessionId: src_id|759c6d5b-2b55cbc8-13562848-cc87fbb_0
2025-09-30T14:53:11.580556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1106 sessionId: src_id|759c6d5b-2b55cbc8-13562848-cc87fbb_0 is DEAD
2025-09-30T14:53:11.580717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|759c6d5b-2b55cbc8-13562848-cc87fbb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:11.580727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|759c6d5b-2b55cbc8-13562848-cc87fbb_0] Write session will restart in 0.008826s
2025-09-30T14:53:11.580751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|759c6d5b-2b55cbc8-13562848-cc87fbb_0] Write session: Do CDS request
2025-09-30T14:53:11.580757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|759c6d5b-2b55cbc8-13562848-cc87fbb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:11.590775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|759c6d5b-2b55cbc8-13562848-cc87fbb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:11.590903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:11.590922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1107
2025-09-30T14:53:11.591035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1107 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:11.591067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1107 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:11.591072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1107 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:11.591076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:11.591536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1107 sessionId:  describe result for acl check
2025-09-30T14:53:11.591581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:11.591584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:11.591586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:11.591592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895409046501519:4205] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:11.592160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895409046501519:4205] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:11.595985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:11.596463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:11.596662Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:11.596671Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:11.596682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:11.596734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:11.596773Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895408956753445:7157]
2025-09-30T14:53:11.596773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895409046501519:4205] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:11.597421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:11.598585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:11.598641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:11.598982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:11.599049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:11.599053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:11.599054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:11.599056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:11.599057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:11.599058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:11.599059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:11.599060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:11.599061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:11.599062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:11.599063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.599064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.599065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.599066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:11.599067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:11.599072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:11.599082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:11.599086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:11.599089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:11.599093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:11.599096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:11.599100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:11.599103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:11.599107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:11.599112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:11.599116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.599120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.599123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.599127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:11.599131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:11.599138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:11.599145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:11.599151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:11.599156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:11.599161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:11.599166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:11.599170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:11.599175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:11.599179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:11.599185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:11.599189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:11.599194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:11.599199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:11.599204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:11.599209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:11.599215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:11.599219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:11.599224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:11.599228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:11.599234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:11.599239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.599261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.599271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.599277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.599282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.599287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.599291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:11.599295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:11.599301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:11.599306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:11.599344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:11.599751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895409046501519:4205] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:11.599768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895409046501519:4205] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:11.599771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895409046501519:4205] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:11.599780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1107 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:11.604869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:11.605986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:11.606005Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:11.606008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:11.606012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:11.606018Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1106 [2:7555895408956753445:7157]
2025-09-30T14:53:11.606033Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:11.606049Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:11.606053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:11.606055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:11.606058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:11.606074Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:11.606087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:11.606093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:11.606164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.606169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.606171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.606173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:11.606175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:11.606239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:11.606249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.606264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.606276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.606295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:11.606317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895409046501442:2454], now have 1 active actors on pipe
2025-09-30T14:53:11.606325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895409046501631:4205], now have 1 active actors on pipe
2025-09-30T14:53:11.606331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895408956753440:7157]
2025-09-30T14:53:11.606334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895408956753440:7157]
2025-09-30T14:53:11.606336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895408956753440:7157]
2025-09-30T14:53:11.606352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:11.606370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:11.606374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:11.606378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:11.606380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:11.606389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:11.606392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:11.606391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1106
2025-09-30T14:53:11.606392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1106
2025-09-30T14:53:11.606422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895408956753440:7157]
2025-09-30T14:53:11.606430Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:11.606435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:11.606453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:11.606458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:11.606493Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3bd4c74-12d14826-7a5e57d8-1f4897dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:11.606505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:11.606509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:11.606511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:11.606521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:11.606528Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:11.606548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:11.606724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:11.606734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:11.606747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:11.606837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1107 partition: 0 MaxSeqNo: 42 sessionId: src_id|f3bd4c74-12d14826-7a5e57d8-1f4897dd_0
2025-09-30T14:53:11.607229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|759c6d5b-2b55cbc8-13562848-cc87fbb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f3bd4c74-12d14826-7a5e57d8-1f4897dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:11.610089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3bd4c74-12d14826-7a5e57d8-1f4897dd_0] Write session: try to update token
2025-09-30T14:53:11.610108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3bd4c74-12d14826-7a5e57d8-1f4897dd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:11.618502Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:11.618525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:11.618528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:11.618530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:11.618537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895408956753440:7157]
2025-09-30T14:53:11.618542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895408956753440:7157]
2025-09-30T14:53:11.618545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895408956753440:7157]
2025-09-30T14:53:11.618585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:11.618600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.618603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:11.618744Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:11.619146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:11.619161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:11.619168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:11.626542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1107 sessionId: src_id|f3bd4c74-12d14826-7a5e57d8-1f4897dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:11.629406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:11.680689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895409046501660:4239]
2025-09-30T14:53:11.681029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1106, pipe: [1:7555895409046501660:4239]
2025-09-30T14:53:11.738073Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:11.738535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:11.738552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:11.738572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895409046501660:4239], now have 1 active actors on pipe
2025-09-30T14:53:11.738780Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:11.738777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895409046501660:4239]
2025-09-30T14:53:11.738811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:11.738814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:11.738891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1107 reason: error at write: Disconnected sessionId: src_id|f3bd4c74-12d14826-7a5e57d8-1f4897dd_0
2025-09-30T14:53:11.738933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:11.739112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1107 sessionId: src_id|f3bd4c74-12d14826-7a5e57d8-1f4897dd_0 is DEAD
2025-09-30T14:53:11.739302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3bd4c74-12d14826-7a5e57d8-1f4897dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:11.739319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3bd4c74-12d14826-7a5e57d8-1f4897dd_0] Write session will restart in 0.006130s
2025-09-30T14:53:11.739357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3bd4c74-12d14826-7a5e57d8-1f4897dd_0] Write session: Do CDS request
2025-09-30T14:53:11.739366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3bd4c74-12d14826-7a5e57d8-1f4897dd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:11.746759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3bd4c74-12d14826-7a5e57d8-1f4897dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:11.746772Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:11.746787Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1108
2025-09-30T14:53:11.746984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1108 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:11.747017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1108 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:11.747022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1108 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:11.747026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:11.747400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1108 sessionId:  describe result for acl check
2025-09-30T14:53:11.747434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:11.747455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:11.747461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:11.747467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895409046501677:4193] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:11.747956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895409046501677:4193] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:11.750022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895409046501677:4193] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:11.753351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895409046501677:4193] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:11.753367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895409046501677:4193] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:11.753370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895409046501677:4193] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:11.753379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1108 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:11.760159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:11.762762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:11.763013Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:11.763026Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:11.763038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:11.763099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:11.763136Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895408956753673:7172]
2025-09-30T14:53:11.763820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:11.764120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:11.764169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:11.764509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:11.764584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:11.764591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:11.764593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:11.764594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:11.764595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:11.764596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:11.764598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:11.764599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:11.764600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:11.764601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:11.764602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.764603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.764604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.764605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:11.764607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:11.764612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:11.764622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:11.764626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:11.764630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:11.764634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:11.764639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:11.764644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:11.764648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:11.764652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:11.764657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:11.764661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.764666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.764670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.764674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:11.764678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:11.764686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:11.764694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:11.764700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:11.764706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:11.764713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:11.764718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:11.764723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:11.764728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:11.764738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:11.764743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:11.764749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:11.764759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:11.764764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:11.764768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:11.764772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:11.764777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:11.764781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:11.764787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:11.764797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:11.764802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:11.764806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.764816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.764821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.764826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.764831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.764836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.764841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:11.764847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:11.764851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:11.764856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:11.764901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:11.770515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:11.771588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:11.771605Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:11.771608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:11.771612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:11.771618Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1107 [2:7555895408956753673:7172]
2025-09-30T14:53:11.771634Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:11.771649Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:11.771653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:11.771656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:11.771658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:11.771674Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:11.771681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:11.771692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:11.771751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.771759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.771761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.771765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:11.771768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:11.771835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:11.771843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.771857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.771871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.771896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:11.771919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895409046501661:2454], now have 1 active actors on pipe
2025-09-30T14:53:11.771933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895409046501711:4193], now have 1 active actors on pipe
2025-09-30T14:53:11.771939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895408956753668:7172]
2025-09-30T14:53:11.771942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895408956753668:7172]
2025-09-30T14:53:11.771944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895408956753668:7172]
2025-09-30T14:53:11.771956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:11.771968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:11.771971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:11.771975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:11.771979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:11.771986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:11.771989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:11.772012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1107
2025-09-30T14:53:11.772019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895408956753668:7172]
2025-09-30T14:53:11.772038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1107
2025-09-30T14:53:11.772033Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:11.772043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:11.772068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:11.772072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:11.772099Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92438bd1-73403c15-3e4016f4-36bd4e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:11.772111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:11.772115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:11.772118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:11.772127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:11.772139Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:11.772152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:11.772293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:11.772309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:11.772333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:11.772442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1108 partition: 0 MaxSeqNo: 42 sessionId: src_id|92438bd1-73403c15-3e4016f4-36bd4e4_0
2025-09-30T14:53:11.772874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3bd4c74-12d14826-7a5e57d8-1f4897dd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|92438bd1-73403c15-3e4016f4-36bd4e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:11.775644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92438bd1-73403c15-3e4016f4-36bd4e4_0] Write session: try to update token
2025-09-30T14:53:11.775663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92438bd1-73403c15-3e4016f4-36bd4e4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:11.790034Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:11.790057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:11.790068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895408956753668:7172]
2025-09-30T14:53:11.790118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:11.790145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:11.790312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:11.790475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:11.790635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:11.790818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:11.790950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1108 sessionId: src_id|92438bd1-73403c15-3e4016f4-36bd4e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:11.791064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:11.791110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:11.793691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:11.793986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:11.794004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:11.795932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:11.795964Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:11.795967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:11.795970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:11.795971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:11.795979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895408956753668:7172]
2025-09-30T14:53:11.795983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895408956753668:7172]
2025-09-30T14:53:11.795987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895408956753668:7172]
2025-09-30T14:53:11.796010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:11.796014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:11.796015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:11.796019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:11.796020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.796023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:11.796025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:11.796157Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:11.838921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895409046501860:4239]
2025-09-30T14:53:11.839226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1107, pipe: [1:7555895409046501860:4239]
2025-09-30T14:53:11.910329Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:11.918564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:11.918592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:11.918763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:11.918827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:11.918892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:11.918961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:11.919008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:11.919019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:11.919087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:11.919151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:11.919220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:11.919310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:11.919355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:11.919365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:11.919441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:11.919509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:11.919626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:11.919692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:11.919735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:11.919746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:11.919816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:11.919882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:11.919988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:11.920060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:11.920104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:11.920113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:11.920219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:11.920287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:11.920352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:11.920422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:11.920471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:11.920483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:11.920555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:11.920618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:11.920683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:11.920777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:11.920838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:11.920847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:11.920914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:11.920982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:11.921042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:11.921111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:11.921156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:11.921164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:11.921230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:11.921292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:11.921357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:11.921424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:11.921487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:11.921499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:11.921569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:11.921637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:11.921704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:11.921767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:11.921896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:11.921905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:11.921971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:11.922033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:11.922097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:11.922184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:11.922322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:11.922333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:11.922400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895409046501860:4239], now have 1 active actors on pipe
2025-09-30T14:53:11.922666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:11.922682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:11.922713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1108 reason: error at write: Disconnected sessionId: src_id|92438bd1-73403c15-3e4016f4-36bd4e4_0
2025-09-30T14:53:11.922909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1108 sessionId: src_id|92438bd1-73403c15-3e4016f4-36bd4e4_0 is DEAD
2025-09-30T14:53:11.923075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92438bd1-73403c15-3e4016f4-36bd4e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:11.923085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92438bd1-73403c15-3e4016f4-36bd4e4_0] Write session will restart in 0.007015s
2025-09-30T14:53:11.923110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92438bd1-73403c15-3e4016f4-36bd4e4_0] Write session: Do CDS request
2025-09-30T14:53:11.923115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92438bd1-73403c15-3e4016f4-36bd4e4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:11.923440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895409046501860:4239]
2025-09-30T14:53:11.923473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:11.923631Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:11.931761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92438bd1-73403c15-3e4016f4-36bd4e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:11.931911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:11.931926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1109
2025-09-30T14:53:11.932078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1109 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:11.932134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1109 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:11.932144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1109 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:11.932149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:11.932564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1109 sessionId:  describe result for acl check
2025-09-30T14:53:11.932595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:11.932603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:11.932605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:11.932610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895409046501876:4189] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:11.933113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895409046501876:4189] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:11.935425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895409046501876:4189] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:11.939266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895409046501876:4189] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:11.939283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895409046501876:4189] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:11.939287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895409046501876:4189] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:11.939295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1109 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:11.943593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:11.945779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:11.946059Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:11.946074Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:11.946086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:11.946167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:11.946210Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895408956753863:7174]
2025-09-30T14:53:11.946878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:11.947204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:11.947286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:11.947676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:11.947747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:11.947754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:11.947756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:11.947757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:11.947759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:11.947760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:11.947761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:11.947762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:11.947764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:11.947765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:11.947767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.947768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.947769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.947771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:11.947772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:11.947778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:11.947788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:11.947793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:11.947798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:11.947802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:11.947807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:11.947811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:11.947816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:11.947821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:11.947826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:11.947830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.947835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.947839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.947843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:11.947846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:11.947855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:11.947864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:11.947870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:11.947877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:11.947883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:11.947888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:11.947893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:11.947899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:11.947905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:11.947910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:11.947915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:11.947920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:11.947925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:11.947931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:11.947935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:11.947941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:11.947946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:11.947952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:11.947959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:11.947965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:11.947976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.947982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.947991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.947997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.948003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.948013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.948018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:11.948026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:11.948031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:11.948040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:11.948089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:11.955851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:11.956994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:11.957011Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:11.957014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:11.957018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:11.957025Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1108 [2:7555895408956753863:7174]
2025-09-30T14:53:11.957042Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:11.957059Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:11.957063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:11.957066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:11.957068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:11.957085Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:11.957097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:11.957105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:11.957169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.957177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.957179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.957183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:11.957186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:11.957251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:11.957258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.957271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:11.957288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:11.957311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:11.957333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895409046501989:4189], now have 1 active actors on pipe
2025-09-30T14:53:11.957342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895409046501865:2454], now have 1 active actors on pipe
2025-09-30T14:53:11.957348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895408956753858:7174]
2025-09-30T14:53:11.957351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895408956753858:7174]
2025-09-30T14:53:11.957353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895408956753858:7174]
2025-09-30T14:53:11.957368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:11.957386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:11.957404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:11.957407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:11.957409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:11.957414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:11.957417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:11.957409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1108
2025-09-30T14:53:11.957445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895408956753858:7174]
2025-09-30T14:53:11.957456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:11.957459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:11.957497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1108
2025-09-30T14:53:11.957571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:11.957599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:11.957632Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2449602-9f2a4765-fe6d4036-92b4bdf7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:11.957647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:11.957652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:11.957654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:11.957673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:11.957689Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:11.957711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:11.957877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:11.957886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:11.957901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:11.958013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1109 partition: 0 MaxSeqNo: 42 sessionId: src_id|2449602-9f2a4765-fe6d4036-92b4bdf7_0
2025-09-30T14:53:11.958468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92438bd1-73403c15-3e4016f4-36bd4e4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2449602-9f2a4765-fe6d4036-92b4bdf7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:11.961365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2449602-9f2a4765-fe6d4036-92b4bdf7_0] Write session: try to update token
2025-09-30T14:53:11.961385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2449602-9f2a4765-fe6d4036-92b4bdf7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:11.974532Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:11.974553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:11.974556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:11.974558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:11.974569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895408956753858:7174]
2025-09-30T14:53:11.974574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895408956753858:7174]
2025-09-30T14:53:11.974578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895408956753858:7174]
2025-09-30T14:53:11.974616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:11.974623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:11.974625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:11.974625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:11.974631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:11.974636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:11.974757Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:11.982937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1109 sessionId: src_id|2449602-9f2a4765-fe6d4036-92b4bdf7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:11.985739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:12.023768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895413341469363:4239]
2025-09-30T14:53:12.024038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1108, pipe: [1:7555895413341469363:4239]
2025-09-30T14:53:12.088015Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:12.088436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:12.088454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:12.088475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895413341469363:4239], now have 1 active actors on pipe
2025-09-30T14:53:12.088684Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:12.088785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:12.088848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:12.088938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1109 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2449602-9f2a4765-fe6d4036-92b4bdf7_0
2025-09-30T14:53:12.089115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895413341469363:4239]
2025-09-30T14:53:12.089152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1109 sessionId: src_id|2449602-9f2a4765-fe6d4036-92b4bdf7_0 is DEAD
2025-09-30T14:53:12.089349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2449602-9f2a4765-fe6d4036-92b4bdf7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:12.089356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2449602-9f2a4765-fe6d4036-92b4bdf7_0] Write session will restart in 0.008349s
2025-09-30T14:53:12.089379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2449602-9f2a4765-fe6d4036-92b4bdf7_0] Write session: Do CDS request
2025-09-30T14:53:12.089385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2449602-9f2a4765-fe6d4036-92b4bdf7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:12.098806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2449602-9f2a4765-fe6d4036-92b4bdf7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:12.098907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:12.098923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1110
2025-09-30T14:53:12.099080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1110 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:12.099114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1110 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:12.099121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1110 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:12.099130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:12.099651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1110 sessionId:  describe result for acl check
2025-09-30T14:53:12.099686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:12.099693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:12.099695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:12.099701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895413341469453:4183] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:12.100241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895413341469453:4183] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:12.102497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895413341469453:4183] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:12.103886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:12.105998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:12.106227Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:12.106238Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:12.106248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:12.106304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:12.106291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895413341469453:4183] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:12.106305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895413341469453:4183] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:12.106309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895413341469453:4183] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:12.106317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1110 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:12.106343Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895413251721361:7176]
2025-09-30T14:53:12.107002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:12.107346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:12.107392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:12.107720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:12.107792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:12.107799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:12.107801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:12.107802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:12.107803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:12.107804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:12.107805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:12.107806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:12.107807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:12.107808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:12.107809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.107811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.107812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.107813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:12.107814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:12.107820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:12.107831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:12.107836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:12.107840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:12.107844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:12.107848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:12.107851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:12.107855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:12.107859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:12.107862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:12.107866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.107870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.107874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.107877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:12.107881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:12.107888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:12.107896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:12.107902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:12.107907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:12.107912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:12.107916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:12.107921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:12.107926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:12.107932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:12.107938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:12.107942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:12.107948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:12.107959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:12.107965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:12.107975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:12.107981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:12.107986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:12.107992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:12.108001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:12.108008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:12.108013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.108018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.108024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.108030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.108035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.108046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.108051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:12.108056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:12.108066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:12.108072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:12.108125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:12.113656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:12.114627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:12.114646Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:12.114649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:12.114653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:12.114659Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1109 [2:7555895413251721361:7176]
2025-09-30T14:53:12.114674Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:12.114690Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:12.114697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:12.114700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:12.114702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:12.114717Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:12.114723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:12.114730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:12.114791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.114798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.114800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.114804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:12.114807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:12.114885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:12.114894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.114906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.114922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.114945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:12.114968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895413341469557:4183], now have 1 active actors on pipe
2025-09-30T14:53:12.114974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895413341469365:2454], now have 1 active actors on pipe
2025-09-30T14:53:12.114981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895413251721356:7176]
2025-09-30T14:53:12.114988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895413251721356:7176]
2025-09-30T14:53:12.114991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895413251721356:7176]
2025-09-30T14:53:12.115005Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:12.115017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:12.115022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:12.115028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:12.115030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:12.115039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:12.115043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:12.115026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1109
2025-09-30T14:53:12.115049Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1109
2025-09-30T14:53:12.115075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895413251721356:7176]
2025-09-30T14:53:12.115084Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:12.115086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:12.115113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:12.115124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:12.115158Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9005b4d5-c5d44ce6-1cb82e87-7aa6ac13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:12.115169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:12.115173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:12.115174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:12.115184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:12.115195Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:12.115216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:12.115389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:12.115405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:12.115430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:12.115530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1110 partition: 0 MaxSeqNo: 42 sessionId: src_id|9005b4d5-c5d44ce6-1cb82e87-7aa6ac13_0
2025-09-30T14:53:12.115915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2449602-9f2a4765-fe6d4036-92b4bdf7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9005b4d5-c5d44ce6-1cb82e87-7aa6ac13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:12.118799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9005b4d5-c5d44ce6-1cb82e87-7aa6ac13_0] Write session: try to update token
2025-09-30T14:53:12.118821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9005b4d5-c5d44ce6-1cb82e87-7aa6ac13_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:12.127987Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:12.128007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:12.128010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:12.128012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:12.128022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895413251721356:7176]
2025-09-30T14:53:12.128027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895413251721356:7176]
2025-09-30T14:53:12.128031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895413251721356:7176]
2025-09-30T14:53:12.128070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:12.128072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:12.128075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:12.128079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.128079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:12.128082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:12.128260Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:12.134886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1110 sessionId: src_id|9005b4d5-c5d44ce6-1cb82e87-7aa6ac13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:12.137695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:12.189154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895413341469580:4239]
2025-09-30T14:53:12.189437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1109, pipe: [1:7555895413341469580:4239]
2025-09-30T14:53:12.244022Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:12.244505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:12.244522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:12.244542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895413341469580:4239], now have 1 active actors on pipe
2025-09-30T14:53:12.244781Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:12.244847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895413341469580:4239]
2025-09-30T14:53:12.244890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:12.244893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:12.244898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:12.244960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1110 reason: error at write: Disconnected sessionId: src_id|9005b4d5-c5d44ce6-1cb82e87-7aa6ac13_0
2025-09-30T14:53:12.245211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1110 sessionId: src_id|9005b4d5-c5d44ce6-1cb82e87-7aa6ac13_0 is DEAD
2025-09-30T14:53:12.245372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9005b4d5-c5d44ce6-1cb82e87-7aa6ac13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:12.245380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9005b4d5-c5d44ce6-1cb82e87-7aa6ac13_0] Write session will restart in 0.009738s
2025-09-30T14:53:12.245411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9005b4d5-c5d44ce6-1cb82e87-7aa6ac13_0] Write session: Do CDS request
2025-09-30T14:53:12.245419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9005b4d5-c5d44ce6-1cb82e87-7aa6ac13_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:12.256810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9005b4d5-c5d44ce6-1cb82e87-7aa6ac13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:12.256896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:12.256913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1111
2025-09-30T14:53:12.257088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1111 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:12.257129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1111 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:12.257141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1111 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:12.257146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:12.257639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1111 sessionId:  describe result for acl check
2025-09-30T14:53:12.257685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:12.257689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:12.257691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:12.257699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895413341469706:4174] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:12.258410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895413341469706:4174] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:12.260410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:12.261707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895413341469706:4174] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:12.263535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:12.263740Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:12.263751Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:12.263760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:12.263810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:12.263843Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895413251721555:7180]
2025-09-30T14:53:12.264529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:12.264911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:12.264971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:12.265412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:12.265513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:12.265527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:12.265528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:12.265529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:12.265530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:12.265532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:12.265533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:12.265535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:12.265536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:12.265537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:12.265538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.265539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.265540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.265541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:12.265542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:12.265549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:12.265559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:12.265563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:12.265568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:12.265573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:12.265577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:12.265581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:12.265585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:12.265590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:12.265595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:12.265600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.265605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.265610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.265615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:12.265619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:12.265629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:12.265638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:12.265645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:12.265651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:12.265657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:12.265662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:12.265668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:12.265674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:12.265680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:12.265685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:12.265705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:12.265723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:12.265728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:12.265734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:12.265739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:12.265744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:12.265749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:12.265764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:12.265770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:12.265781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:12.265787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.265792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.265799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.265804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.265811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.265817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.265824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:12.265794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895413341469706:4174] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:12.265811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895413341469706:4174] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:12.265830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:12.265841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:12.265815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895413341469706:4174] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:12.265824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1111 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:12.265847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:12.265907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:12.271703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:12.272693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:12.272712Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:12.272715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:12.272719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:12.272726Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1110 [2:7555895413251721555:7180]
2025-09-30T14:53:12.272744Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:12.272762Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:12.272770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:12.272774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:12.272776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:12.272794Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:12.272806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:12.272818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:12.272887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.272894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.272896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.272900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:12.272903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:12.272974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:12.272981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.272996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.273013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.273034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:12.273053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895413341469581:2454], now have 1 active actors on pipe
2025-09-30T14:53:12.273067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895413251721549:7180]
2025-09-30T14:53:12.273073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895413251721549:7180]
2025-09-30T14:53:12.273075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895413251721549:7180]
2025-09-30T14:53:12.273091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:12.273106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895413341469773:4174], now have 1 active actors on pipe
2025-09-30T14:53:12.273113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:12.273127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:12.273131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:12.273135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:12.273140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:12.273142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:12.273167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895413251721549:7180]
2025-09-30T14:53:12.273175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:12.273179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:12.273161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1110
2025-09-30T14:53:12.273165Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1110
2025-09-30T14:53:12.273493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:12.273507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:12.273534Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63f04647-166c87ab-536b1e9b-6c33b964_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:12.273543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:12.273548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:12.273551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:12.273561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:12.273572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:12.273586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:12.273833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:12.273850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:12.273875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:12.274013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1111 partition: 0 MaxSeqNo: 42 sessionId: src_id|63f04647-166c87ab-536b1e9b-6c33b964_0
2025-09-30T14:53:12.274459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9005b4d5-c5d44ce6-1cb82e87-7aa6ac13_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|63f04647-166c87ab-536b1e9b-6c33b964_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:12.277280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63f04647-166c87ab-536b1e9b-6c33b964_0] Write session: try to update token
2025-09-30T14:53:12.277302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63f04647-166c87ab-536b1e9b-6c33b964_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:12.286774Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:12.286806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:12.286809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:12.286811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:12.286822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895413251721549:7180]
2025-09-30T14:53:12.286827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895413251721549:7180]
2025-09-30T14:53:12.286832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895413251721549:7180]
2025-09-30T14:53:12.286877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:12.286885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.286888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:12.287062Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:12.287375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:12.287382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:12.287387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:12.292989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1111 sessionId: src_id|63f04647-166c87ab-536b1e9b-6c33b964_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:12.295904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:12.345284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895413341469782:4239]
2025-09-30T14:53:12.345566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1110, pipe: [1:7555895413341469782:4239]
2025-09-30T14:53:12.399049Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:12.399356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:12.399374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:12.399413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895413341469782:4239], now have 1 active actors on pipe
2025-09-30T14:53:12.399640Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:12.399667Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:12.399702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895413341469782:4239]
2025-09-30T14:53:12.399720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:12.399791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1111 reason: status is not ok: tablet will be restarted right now sessionId: src_id|63f04647-166c87ab-536b1e9b-6c33b964_0
2025-09-30T14:53:12.400012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1111 sessionId: src_id|63f04647-166c87ab-536b1e9b-6c33b964_0 is DEAD
2025-09-30T14:53:12.400164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63f04647-166c87ab-536b1e9b-6c33b964_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:12.400175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63f04647-166c87ab-536b1e9b-6c33b964_0] Write session will restart in 0.006832s
2025-09-30T14:53:12.400199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63f04647-166c87ab-536b1e9b-6c33b964_0] Write session: Do CDS request
2025-09-30T14:53:12.400205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63f04647-166c87ab-536b1e9b-6c33b964_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:12.407794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63f04647-166c87ab-536b1e9b-6c33b964_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:12.407844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:12.407860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1112
2025-09-30T14:53:12.408033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1112 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:12.408068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1112 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:12.408079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1112 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:12.408084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:12.408601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1112 sessionId:  describe result for acl check
2025-09-30T14:53:12.408633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:12.408640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:12.408641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:12.408647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895413341469830:4169] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:12.409197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895413341469830:4169] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:12.411605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895413341469830:4169] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:12.414002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895413341469830:4169] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:12.414016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895413341469830:4169] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:12.414019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895413341469830:4169] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:12.414042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1112 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:12.414005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:12.416387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:12.416588Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:12.416596Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:12.416607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:12.416655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:12.416697Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895413251721749:7182]
2025-09-30T14:53:12.417370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:12.417674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:12.417718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:12.418056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:12.418156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:12.418162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:12.418164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:12.418165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:12.418166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:12.418167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:12.418168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:12.418169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:12.418171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:12.418172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:12.418173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.418174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.418175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.418176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:12.418178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:12.418183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:12.418193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:12.418196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:12.418200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:12.418205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:12.418210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:12.418214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:12.418218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:12.418222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:12.418229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:12.418233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.418236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.418240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.418244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:12.418248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:12.418257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:12.418264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:12.418272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:12.418278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:12.418283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:12.418288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:12.418293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:12.418298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:12.418303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:12.418309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:12.418313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:12.418319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:12.418323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:12.418328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:12.418332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:12.418338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:12.418343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:12.418348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:12.418358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:12.418363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:12.418370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.418376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.418385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.418390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.418395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.418399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.418404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:12.418409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:12.418414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:12.418423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:12.418463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:12.424267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:12.425491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:12.425507Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:12.425510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:12.425514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:12.425519Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1111 [2:7555895413251721749:7182]
2025-09-30T14:53:12.425536Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:12.425551Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:12.425554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:12.425557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:12.425559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:12.425575Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:12.425581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:12.425588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:12.425649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.425657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.425660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.425663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:12.425666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:12.425727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:12.425736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.425750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.425763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.425785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:12.425808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895413341469973:4169], now have 1 active actors on pipe
2025-09-30T14:53:12.425816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895413341469783:2454], now have 1 active actors on pipe
2025-09-30T14:53:12.425822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895413251721743:7182]
2025-09-30T14:53:12.425824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895413251721743:7182]
2025-09-30T14:53:12.425826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895413251721743:7182]
2025-09-30T14:53:12.425837Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:12.425853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:12.425863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:12.425866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:12.425868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:12.425871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:12.425874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:12.425902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895413251721743:7182]
2025-09-30T14:53:12.425914Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:12.425923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:12.425915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1111
2025-09-30T14:53:12.425953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1111
2025-09-30T14:53:12.425962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:12.425971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:12.425993Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|195f605d-18f1904b-1e6f25e1-e680480f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:12.425999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:12.426005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:12.426007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:12.426017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:12.426026Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:12.426046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:12.426222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:12.426245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:12.426271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:12.426393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1112 partition: 0 MaxSeqNo: 42 sessionId: src_id|195f605d-18f1904b-1e6f25e1-e680480f_0
2025-09-30T14:53:12.426808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63f04647-166c87ab-536b1e9b-6c33b964_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|195f605d-18f1904b-1e6f25e1-e680480f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:12.429485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|195f605d-18f1904b-1e6f25e1-e680480f_0] Write session: try to update token
2025-09-30T14:53:12.429506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|195f605d-18f1904b-1e6f25e1-e680480f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:12.444017Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:12.444039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:12.444048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895413251721743:7182]
2025-09-30T14:53:12.444095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:12.444113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:12.444144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1112 sessionId: src_id|195f605d-18f1904b-1e6f25e1-e680480f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:12.444275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:12.444451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:12.444593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:12.444740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:12.444944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:12.444983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:12.446849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:12.447058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:12.447075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:12.447121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:12.447208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:12.449320Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:12.449338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:12.449340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:12.449342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:12.449351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895413251721743:7182]
2025-09-30T14:53:12.449355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895413251721743:7182]
2025-09-30T14:53:12.449375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895413251721743:7182]
2025-09-30T14:53:12.449406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:12.449416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.449419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:12.449422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:12.449428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:12.449433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:12.449548Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:12.499914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895413341469985:4239]
2025-09-30T14:53:12.500159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1111, pipe: [1:7555895413341469985:4239]
2025-09-30T14:53:12.565097Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:12.572383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:12.572414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:12.572604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:12.572684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:12.572750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:12.572811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:12.572855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:12.572864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:12.572930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:12.572995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:12.573065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:12.573137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:12.573183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:12.573193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:12.573309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:12.573371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:12.573441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:12.573514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:12.573561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:12.573569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:12.573644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:12.573715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:12.573780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:12.573850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:12.574143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:12.574154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:12.574227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:12.574293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:12.574399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:12.574499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:12.574546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:12.574553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:12.574652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:12.574755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:12.574822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:12.574889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:12.574935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:12.574944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:12.575014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:12.575076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:12.575142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:12.575213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:12.575292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:12.575300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:12.575461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:12.575537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:12.575609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:12.575685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:12.575737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:12.575748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:12.575819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:12.575888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:12.575959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:12.576025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:12.576069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:12.576076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:12.576151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:12.576221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:12.576319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:12.576392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:12.576438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:12.576446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:12.576514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895413341469985:4239], now have 1 active actors on pipe
2025-09-30T14:53:12.576782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895413341469985:4239]
2025-09-30T14:53:12.576788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:12.576792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:12.576819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:12.576821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1112 reason: error at write: Disconnected sessionId: src_id|195f605d-18f1904b-1e6f25e1-e680480f_0
2025-09-30T14:53:12.577044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1112 sessionId: src_id|195f605d-18f1904b-1e6f25e1-e680480f_0 is DEAD
2025-09-30T14:53:12.577203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|195f605d-18f1904b-1e6f25e1-e680480f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:12.577225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|195f605d-18f1904b-1e6f25e1-e680480f_0] Write session will restart in 0.005956s
2025-09-30T14:53:12.577248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|195f605d-18f1904b-1e6f25e1-e680480f_0] Write session: Do CDS request
2025-09-30T14:53:12.577253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|195f605d-18f1904b-1e6f25e1-e680480f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:12.577336Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:12.584752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|195f605d-18f1904b-1e6f25e1-e680480f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:12.584831Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:12.584849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1113
2025-09-30T14:53:12.584999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1113 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:12.585031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1113 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:12.585041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1113 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:12.585046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:12.585492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1113 sessionId:  describe result for acl check
2025-09-30T14:53:12.585526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:12.585533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:12.585535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:12.585540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895413341470019:4158] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:12.586064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895413341470019:4158] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:12.589740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895413341470019:4158] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:12.593045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895413341470019:4158] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:12.593060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895413341470019:4158] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:12.593064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895413341470019:4158] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:12.593071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1113 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:12.593314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:12.595869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:12.596094Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:12.596104Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:12.596116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:12.596172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:12.596217Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895413251721943:7184]
2025-09-30T14:53:12.596939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:12.597295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:12.597359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:12.597765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:12.597834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:12.597842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:12.597844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:12.597845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:12.597846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:12.597848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:12.597849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:12.597850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:12.597852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:12.597853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:12.597854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.597855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.597857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.597858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:12.597859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:12.597866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:12.597878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:12.597883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:12.597887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:12.597892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:12.597896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:12.597901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:12.597904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:12.597909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:12.597914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:12.597918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.597923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.597927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.597931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:12.597936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:12.597946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:12.597955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:12.597962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:12.597969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:12.597974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:12.597981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:12.597986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:12.597992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:12.597997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:12.598003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:12.598008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:12.598014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:12.598019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:12.598025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:12.598030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:12.598036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:12.598041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:12.598046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:12.598051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:12.598058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:12.598063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.598071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.598079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.598085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.598096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.598102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.598107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:12.598118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:12.598135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:12.598141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:12.598190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:12.607930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:12.609030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:12.609044Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:12.609046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:12.609049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:12.609055Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1112 [2:7555895413251721943:7184]
2025-09-30T14:53:12.609067Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:12.609080Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:12.609082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:12.609085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:12.609086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:12.609098Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:12.609104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:12.609110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:12.609161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.609171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.609172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.609175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:12.609177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:12.609228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:12.609234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.609243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.609249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.609258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:12.609272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895413251721937:7184]
2025-09-30T14:53:12.609278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895413251721937:7184]
2025-09-30T14:53:12.609280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895413251721937:7184]
2025-09-30T14:53:12.609288Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:12.609299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:12.609312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:12.609318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:12.609323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:12.609326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:12.609329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:12.609348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895413251721937:7184]
2025-09-30T14:53:12.609357Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:12.609360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:12.609367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895413341469988:2454], now have 1 active actors on pipe
2025-09-30T14:53:12.609371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895413341470179:4158], now have 1 active actors on pipe
2025-09-30T14:53:12.609460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1112
2025-09-30T14:53:12.609470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1112
2025-09-30T14:53:12.609636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:12.609655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:12.609694Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88453a7-4fcf242a-4e76de45-2587d15e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:12.609707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:12.609716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:12.609719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:12.609730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:12.609747Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:12.609763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:12.610016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:12.610028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:12.610050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:12.610173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1113 partition: 0 MaxSeqNo: 42 sessionId: src_id|88453a7-4fcf242a-4e76de45-2587d15e_0
2025-09-30T14:53:12.610579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|195f605d-18f1904b-1e6f25e1-e680480f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|88453a7-4fcf242a-4e76de45-2587d15e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:12.613272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88453a7-4fcf242a-4e76de45-2587d15e_0] Write session: try to update token
2025-09-30T14:53:12.613290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88453a7-4fcf242a-4e76de45-2587d15e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:12.622207Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:12.622238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:12.622241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:12.622244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:12.622259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895413251721937:7184]
2025-09-30T14:53:12.622269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895413251721937:7184]
2025-09-30T14:53:12.622275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895413251721937:7184]
2025-09-30T14:53:12.622312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:12.622317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:12.622320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:12.622323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.622324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:12.622326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:12.622559Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:12.630530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1113 sessionId: src_id|88453a7-4fcf242a-4e76de45-2587d15e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:12.633204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:12.677037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895413341470205:4239]
2025-09-30T14:53:12.677261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1112, pipe: [1:7555895413341470205:4239]
2025-09-30T14:53:12.736032Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:12.736484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:12.736502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:12.736519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895413341470205:4239], now have 1 active actors on pipe
2025-09-30T14:53:12.736780Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:12.736856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895413341470205:4239]
2025-09-30T14:53:12.736887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:12.736903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:12.736963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1113 reason: status is not ok: tablet will be restarted right now sessionId: src_id|88453a7-4fcf242a-4e76de45-2587d15e_0
2025-09-30T14:53:12.737192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1113 sessionId: src_id|88453a7-4fcf242a-4e76de45-2587d15e_0 is DEAD
2025-09-30T14:53:12.737408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88453a7-4fcf242a-4e76de45-2587d15e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:12.737417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88453a7-4fcf242a-4e76de45-2587d15e_0] Write session will restart in 0.008745s
2025-09-30T14:53:12.737440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88453a7-4fcf242a-4e76de45-2587d15e_0] Write session: Do CDS request
2025-09-30T14:53:12.737446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88453a7-4fcf242a-4e76de45-2587d15e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:12.747789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88453a7-4fcf242a-4e76de45-2587d15e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:12.747838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:12.747853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1114
2025-09-30T14:53:12.748026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1114 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:12.748061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1114 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:12.748071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1114 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:12.748075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:12.748461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1114 sessionId:  describe result for acl check
2025-09-30T14:53:12.748503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:12.748505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:12.748507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:12.748514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895413341470367:4143] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:12.748983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895413341470367:4143] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:12.750163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:12.751159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895413341470367:4143] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:12.752331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:12.752526Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:12.752538Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:12.752549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:12.752599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:12.752635Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895413251722175:7199]
2025-09-30T14:53:12.753163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:12.753465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:12.753514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:12.753860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:12.753926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:12.753932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:12.753933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:12.753934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:12.753935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:12.753936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:12.753937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:12.753938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:12.753939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:12.753940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:12.753941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.753942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.753943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.753944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:12.753945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:12.753951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:12.753960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:12.753964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:12.753967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:12.753971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:12.753975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:12.753979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:12.753983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:12.753987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:12.753991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:12.753994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.753998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.754002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.754005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:12.754008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:12.754028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:12.754036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:12.754042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:12.754046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:12.754051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:12.754029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895413341470367:4143] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:12.754062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:12.754067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:12.754043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895413341470367:4143] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:12.754047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895413341470367:4143] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:12.754072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:12.754055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1114 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:12.754082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:12.754088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:12.754092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:12.754102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:12.754107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:12.754112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:12.754117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:12.754133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:12.754137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:12.754142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:12.754145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:12.754156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:12.754162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.754171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.754187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.754197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.754202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.754212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.754217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:12.754226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:12.754233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:12.754242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:12.754287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:12.760004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:12.760868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:12.760885Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:12.760889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:12.760893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:12.760900Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1113 [2:7555895413251722175:7199]
2025-09-30T14:53:12.760916Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:12.760937Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:12.760940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:12.760943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:12.760946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:12.760963Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:12.760975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:12.760985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:12.761043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.761050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.761052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.761055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:12.761058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:12.761119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:12.761126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.761139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.761154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.761177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:12.761198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895413341470410:4143], now have 1 active actors on pipe
2025-09-30T14:53:12.761207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895413341470218:2454], now have 1 active actors on pipe
2025-09-30T14:53:12.761213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895413251722170:7199]
2025-09-30T14:53:12.761216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895413251722170:7199]
2025-09-30T14:53:12.761218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895413251722170:7199]
2025-09-30T14:53:12.761232Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:12.761250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:12.761254Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1113
2025-09-30T14:53:12.761267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:12.761268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1113
2025-09-30T14:53:12.761271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:12.761274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:12.761279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:12.761282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:12.761310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895413251722170:7199]
2025-09-30T14:53:12.761313Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:12.761315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:12.761336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:12.761346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:12.761394Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a463e04e-d4e2aea1-2d698e66-1af9c133_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:12.761406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:12.761410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:12.761413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:12.761423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:12.761431Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:12.761448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:12.761618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:12.761629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:12.761645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:12.761742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1114 partition: 0 MaxSeqNo: 42 sessionId: src_id|a463e04e-d4e2aea1-2d698e66-1af9c133_0
2025-09-30T14:53:12.762163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88453a7-4fcf242a-4e76de45-2587d15e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a463e04e-d4e2aea1-2d698e66-1af9c133_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:12.764961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a463e04e-d4e2aea1-2d698e66-1af9c133_0] Write session: try to update token
2025-09-30T14:53:12.764983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a463e04e-d4e2aea1-2d698e66-1af9c133_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:12.773386Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:12.773410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:12.773413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:12.773415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:12.773424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895413251722170:7199]
2025-09-30T14:53:12.773429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895413251722170:7199]
2025-09-30T14:53:12.773434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895413251722170:7199]
2025-09-30T14:53:12.773472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:12.773478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:12.773479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.773482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:12.773500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:12.773503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:12.773609Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:12.779393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1114 sessionId: src_id|a463e04e-d4e2aea1-2d698e66-1af9c133_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:12.782243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:12.836802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895413341470419:4239]
2025-09-30T14:53:12.837131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1113, pipe: [1:7555895413341470419:4239]
2025-09-30T14:53:12.888849Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:12.889515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:12.889538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:12.889595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895413341470419:4239], now have 1 active actors on pipe
2025-09-30T14:53:12.889879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:12.889899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:12.889958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1114 reason: error at write: Disconnected sessionId: src_id|a463e04e-d4e2aea1-2d698e66-1af9c133_0
2025-09-30T14:53:12.890043Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:12.890392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a463e04e-d4e2aea1-2d698e66-1af9c133_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:12.890402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a463e04e-d4e2aea1-2d698e66-1af9c133_0] Write session will restart in 0.005512s
2025-09-30T14:53:12.890427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a463e04e-d4e2aea1-2d698e66-1af9c133_0] Write session: Do CDS request
2025-09-30T14:53:12.890435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a463e04e-d4e2aea1-2d698e66-1af9c133_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:12.890024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895413341470419:4239]
2025-09-30T14:53:12.890058Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:12.890197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1114 sessionId: src_id|a463e04e-d4e2aea1-2d698e66-1af9c133_0 is DEAD
2025-09-30T14:53:12.896807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a463e04e-d4e2aea1-2d698e66-1af9c133_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:12.896938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:12.896955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1115
2025-09-30T14:53:12.897093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1115 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:12.897137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1115 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:12.897143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1115 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:12.897147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:12.897599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1115 sessionId:  describe result for acl check
2025-09-30T14:53:12.897640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:12.897646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:12.897649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:12.897655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895413341470436:4132] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:12.898184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895413341470436:4132] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:12.901403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895413341470436:4132] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:12.904593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895413341470436:4132] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:12.904610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895413341470436:4132] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:12.904614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895413341470436:4132] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:12.904622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1115 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:12.906705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:12.908900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:12.909195Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:12.909205Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:12.909216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:12.909261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:12.909301Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895413251722372:7201]
2025-09-30T14:53:12.909864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:12.910152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:12.910193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:12.910526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:12.910585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:12.910591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:12.910592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:12.910593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:12.910594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:12.910595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:12.910596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:12.910597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:12.910598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:12.910600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:12.910600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.910601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.910602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.910603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:12.910605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:12.910611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:12.910621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:12.910625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:12.910629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:12.910634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:12.910638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:12.910642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:12.910646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:12.910650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:12.910654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:12.910658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.910662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.910667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.910671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:12.910675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:12.910683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:12.910690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:12.910696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:12.910702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:12.910706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:12.910712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:12.910718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:12.910723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:12.910728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:12.910733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:12.910738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:12.910743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:12.910751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:12.910756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:12.910766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:12.910772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:12.910781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:12.910786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:12.910791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:12.910800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:12.910807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.910816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.910821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.910831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.910836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.910841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.910849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:12.910855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:12.910859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:12.910864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:12.910908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:12.916438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:12.917533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:12.917547Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:12.917550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:12.917553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:12.917560Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1114 [2:7555895413251722372:7201]
2025-09-30T14:53:12.917575Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:12.917591Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:12.917594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:12.917596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:12.917599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:12.917614Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:12.917625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:12.917631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:12.917694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.917701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.917704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.917707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:12.917710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:12.917773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:12.917781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.917793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:12.917806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:12.917829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:12.917852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895413341470605:4132], now have 1 active actors on pipe
2025-09-30T14:53:12.917861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895413341470421:2454], now have 1 active actors on pipe
2025-09-30T14:53:12.917867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895413251722367:7201]
2025-09-30T14:53:12.917870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895413251722367:7201]
2025-09-30T14:53:12.917872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895413251722367:7201]
2025-09-30T14:53:12.917884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:12.917899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:12.917900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:12.917906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:12.917909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:12.917917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:12.917920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:12.917949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895413251722367:7201]
2025-09-30T14:53:12.917962Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:12.917968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:12.917971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1114
2025-09-30T14:53:12.917972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1114
2025-09-30T14:53:12.918033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:12.918044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:12.918069Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5bc95b8c-9b7013ce-e038bb89-cfe347cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:12.918080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:12.918083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:12.918085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:12.918094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:12.918103Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:12.918134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:12.918278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:12.918286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:12.918298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:12.918363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1115 partition: 0 MaxSeqNo: 42 sessionId: src_id|5bc95b8c-9b7013ce-e038bb89-cfe347cf_0
2025-09-30T14:53:12.918733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a463e04e-d4e2aea1-2d698e66-1af9c133_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5bc95b8c-9b7013ce-e038bb89-cfe347cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:12.921574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bc95b8c-9b7013ce-e038bb89-cfe347cf_0] Write session: try to update token
2025-09-30T14:53:12.921591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bc95b8c-9b7013ce-e038bb89-cfe347cf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:12.930102Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:12.930135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:12.930144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895413251722367:7201]
2025-09-30T14:53:12.930191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:12.930199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:12.930380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:12.930547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:12.930693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:12.930830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:12.931022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:12.931067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:12.936388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1115 sessionId: src_id|5bc95b8c-9b7013ce-e038bb89-cfe347cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:12.939117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:12.939341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:12.939374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:12.939408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:12.939551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:12.940783Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:12.940798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:12.940800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:12.940801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:12.940810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895413251722367:7201]
2025-09-30T14:53:12.940815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895413251722367:7201]
2025-09-30T14:53:12.940818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895413251722367:7201]
2025-09-30T14:53:12.940846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:12.940852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:12.940853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:12.940855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:12.940861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:12.940864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:12.940981Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:12.990404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895413341470626:4239]
2025-09-30T14:53:12.990738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1114, pipe: [1:7555895413341470626:4239]
2025-09-30T14:53:13.049688Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:13.056842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:13.056872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:13.057024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:13.057086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:13.057152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:13.057213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:13.057263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:13.057277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:13.057345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:13.057407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:13.057478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:13.057550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:13.057600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:13.057608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:13.057670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:13.057733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:13.057802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:13.057866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:13.057908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:13.057914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:13.057982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:13.058047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:13.058113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:13.058266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:13.058315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:13.058322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:13.058390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:13.058452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:13.058518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:13.058581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:13.058623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:13.058628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:13.058692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:13.058755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:13.058815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:13.058874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:13.058926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:13.058933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:13.059002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:13.059056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:13.059127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:13.059202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:13.059271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:13.059279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:13.059351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:13.059418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:13.059486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:13.059549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:13.059603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:13.059611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:13.059679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:13.059745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:13.059803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:13.059860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:13.059900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:13.059908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:13.059969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:13.060026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:13.060092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:13.060189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:13.060322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:13.060329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:13.060380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895413341470626:4239], now have 1 active actors on pipe
2025-09-30T14:53:13.060663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:13.060677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:13.060703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1115 reason: error at write: Disconnected sessionId: src_id|5bc95b8c-9b7013ce-e038bb89-cfe347cf_0
2025-09-30T14:53:13.060859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895413341470626:4239]
2025-09-30T14:53:13.060893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:13.060930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1115 sessionId: src_id|5bc95b8c-9b7013ce-e038bb89-cfe347cf_0 is DEAD
2025-09-30T14:53:13.061051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bc95b8c-9b7013ce-e038bb89-cfe347cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:13.061063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bc95b8c-9b7013ce-e038bb89-cfe347cf_0] Write session will restart in 0.008130s
2025-09-30T14:53:13.061087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bc95b8c-9b7013ce-e038bb89-cfe347cf_0] Write session: Do CDS request
2025-09-30T14:53:13.061093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bc95b8c-9b7013ce-e038bb89-cfe347cf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:13.061422Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:13.070849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bc95b8c-9b7013ce-e038bb89-cfe347cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:13.071053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:13.071072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1116
2025-09-30T14:53:13.071191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1116 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:13.071225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1116 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:13.071235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1116 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:13.071239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:13.071815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1116 sessionId:  describe result for acl check
2025-09-30T14:53:13.071860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:13.071868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:13.071870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:13.071876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895417636438011:4123] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:13.072429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895417636438011:4123] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:13.075104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895417636438011:4123] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:13.076146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:13.078257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:13.078458Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:13.078470Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:13.078482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:13.078543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:13.078587Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895417546689864:7203]
2025-09-30T14:53:13.078693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895417636438011:4123] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:13.078710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895417636438011:4123] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:13.078713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895417636438011:4123] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:13.078722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1116 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:13.079311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:13.079645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:13.079696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:13.080049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:13.080139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:13.080147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:13.080149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:13.080150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:13.080151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:13.080153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:13.080154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:13.080156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:13.080157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:13.080158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:13.080160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.080161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.080162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.080164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:13.080165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:13.080171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:13.080181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:13.080185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:13.080190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:13.080194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:13.080198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:13.080203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:13.080207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:13.080212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:13.080217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:13.080222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.080227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.080231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.080236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:13.080241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:13.080249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:13.080260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:13.080268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:13.080275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:13.080280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:13.080292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:13.080297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:13.080305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:13.080314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:13.080321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:13.080328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:13.080334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:13.080344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:13.080350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:13.080360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:13.080366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:13.080376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:13.080382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:13.080391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:13.080397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:13.080404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.080414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.080419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.080429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.080434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.080440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.080445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:13.080452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:13.080462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:13.080467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:13.080517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:13.086224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:13.087142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:13.087165Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:13.087167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:13.087171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:13.087178Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1115 [2:7555895417546689864:7203]
2025-09-30T14:53:13.087206Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:13.087224Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:13.087237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:13.087241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:13.087262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:13.087278Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:13.087285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:13.087292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:13.087358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.087368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.087370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.087374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:13.087377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:13.087451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:13.087459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.087474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.087491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.087515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:13.087534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895417636438125:4123], now have 1 active actors on pipe
2025-09-30T14:53:13.087540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895417636437931:2454], now have 1 active actors on pipe
2025-09-30T14:53:13.087548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895417546689859:7203]
2025-09-30T14:53:13.087551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895417546689859:7203]
2025-09-30T14:53:13.087553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895417546689859:7203]
2025-09-30T14:53:13.087568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:13.087596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:13.087595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:13.087599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:13.087602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:13.087617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:13.087621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:13.087628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1115
2025-09-30T14:53:13.087653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895417546689859:7203]
2025-09-30T14:53:13.087668Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:13.087630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1115
2025-09-30T14:53:13.087690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:13.087764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:13.087780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:13.087808Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5f36c53-3df4ac0e-ade1a60c-323dbb81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:13.087822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:13.087830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:13.087833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:13.087845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:13.087858Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:13.087894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:13.088372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:13.088389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:13.088410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:13.088501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1116 partition: 0 MaxSeqNo: 42 sessionId: src_id|f5f36c53-3df4ac0e-ade1a60c-323dbb81_0
2025-09-30T14:53:13.088885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bc95b8c-9b7013ce-e038bb89-cfe347cf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f5f36c53-3df4ac0e-ade1a60c-323dbb81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:13.091823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f36c53-3df4ac0e-ade1a60c-323dbb81_0] Write session: try to update token
2025-09-30T14:53:13.091843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f36c53-3df4ac0e-ade1a60c-323dbb81_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:13.100598Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:13.100624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:13.100626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:13.100628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:13.100637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895417546689859:7203]
2025-09-30T14:53:13.100642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895417546689859:7203]
2025-09-30T14:53:13.100646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895417546689859:7203]
2025-09-30T14:53:13.100689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:13.100696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:13.100701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.100704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:13.100704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:13.100708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:13.100856Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:13.107914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1116 sessionId: src_id|f5f36c53-3df4ac0e-ade1a60c-323dbb81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:13.110676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:13.160895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895417636438152:4239]
2025-09-30T14:53:13.161195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1115, pipe: [1:7555895417636438152:4239]
2025-09-30T14:53:13.218958Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:13.218969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:13.218973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:13.219025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895417636438152:4239]
2025-09-30T14:53:13.219045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1116 reason: error at write: Disconnected sessionId: src_id|f5f36c53-3df4ac0e-ade1a60c-323dbb81_0
2025-09-30T14:53:13.219282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1116 sessionId: src_id|f5f36c53-3df4ac0e-ade1a60c-323dbb81_0 is DEAD
2025-09-30T14:53:13.219497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f36c53-3df4ac0e-ade1a60c-323dbb81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:13.219509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f36c53-3df4ac0e-ade1a60c-323dbb81_0] Write session will restart in 0.007761s
2025-09-30T14:53:13.219534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f36c53-3df4ac0e-ade1a60c-323dbb81_0] Write session: Do CDS request
2025-09-30T14:53:13.219540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f36c53-3df4ac0e-ade1a60c-323dbb81_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:13.217623Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:13.218481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:13.218494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:13.218520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895417636438152:4239], now have 1 active actors on pipe
2025-09-30T14:53:13.218917Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:13.228820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f36c53-3df4ac0e-ade1a60c-323dbb81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:13.229082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:13.229100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1117
2025-09-30T14:53:13.229245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1117 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:13.229295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1117 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:13.229306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1117 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:13.229311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:13.229744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1117 sessionId:  describe result for acl check
2025-09-30T14:53:13.229780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:13.229787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:13.229789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:13.229796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895417636438168:4122] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:13.230381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895417636438168:4122] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:13.232387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895417636438168:4122] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:13.235296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895417636438168:4122] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:13.235313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895417636438168:4122] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:13.235317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895417636438168:4122] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:13.235333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1117 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:13.242354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:13.245174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:13.245400Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:13.245412Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:13.245423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:13.245480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:13.245527Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895417546690077:7207]
2025-09-30T14:53:13.246274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:13.246683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:13.246732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:13.247085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:13.247146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:13.247153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:13.247155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:13.247156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:13.247158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:13.247159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:13.247161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:13.247162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:13.247163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:13.247165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:13.247166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.247168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.247169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.247171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:13.247172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:13.247178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:13.247189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:13.247194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:13.247199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:13.247204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:13.247209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:13.247213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:13.247217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:13.247222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:13.247227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:13.247231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.247236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.247241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.247270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:13.247275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:13.247284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:13.247297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:13.247304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:13.247316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:13.247322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:13.247328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:13.247334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:13.247345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:13.247350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:13.247356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:13.247361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:13.247367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:13.247373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:13.247379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:13.247389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:13.247395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:13.247401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:13.247412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:13.247417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:13.247424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:13.247435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.247446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.247451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.247462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.247467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.247479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.247484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:13.247490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:13.247501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:13.247507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:13.247562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:13.253816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:13.254804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:13.254825Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:13.254829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:13.254833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:13.254843Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1116 [2:7555895417546690077:7207]
2025-09-30T14:53:13.254861Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:13.254879Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:13.254888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:13.254892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:13.254895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:13.254912Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:13.254923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:13.254930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:13.254996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.255003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.255005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.255009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:13.255012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:13.255081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:13.255090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.255103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.255115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.255131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:13.255157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895417636438153:2454], now have 1 active actors on pipe
2025-09-30T14:53:13.255166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895417636438235:4122], now have 1 active actors on pipe
2025-09-30T14:53:13.255173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895417546690072:7207]
2025-09-30T14:53:13.255175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895417546690072:7207]
2025-09-30T14:53:13.255177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895417546690072:7207]
2025-09-30T14:53:13.255191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:13.255210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:13.255222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:13.255229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:13.255234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:13.255234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:13.255237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:13.255286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895417546690072:7207]
2025-09-30T14:53:13.255294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:13.255310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:13.255282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1116
2025-09-30T14:53:13.255291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1116
2025-09-30T14:53:13.255346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:13.255356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:13.255381Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89e9cc15-78ba525e-b42a9ceb-dc4ca36b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:13.255395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:13.255405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:13.255408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:13.255419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:13.255428Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:13.255442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:13.255678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:13.255695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:13.255719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:13.255844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1117 partition: 0 MaxSeqNo: 42 sessionId: src_id|89e9cc15-78ba525e-b42a9ceb-dc4ca36b_0
2025-09-30T14:53:13.256242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f36c53-3df4ac0e-ade1a60c-323dbb81_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|89e9cc15-78ba525e-b42a9ceb-dc4ca36b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:13.259110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89e9cc15-78ba525e-b42a9ceb-dc4ca36b_0] Write session: try to update token
2025-09-30T14:53:13.259134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89e9cc15-78ba525e-b42a9ceb-dc4ca36b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:13.269601Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:13.269629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:13.269640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895417546690072:7207]
2025-09-30T14:53:13.269685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:13.269687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:13.269871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:13.270057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:13.270227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:13.270421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:13.270636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:13.270685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:13.277140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1117 sessionId: src_id|89e9cc15-78ba525e-b42a9ceb-dc4ca36b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:13.279874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:13.280651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:13.280677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:13.280696Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:13.280698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:13.280701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:13.280703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:13.280713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895417546690072:7207]
2025-09-30T14:53:13.280717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895417546690072:7207]
2025-09-30T14:53:13.280721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895417546690072:7207]
2025-09-30T14:53:13.280759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:13.280770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:13.280772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:13.280776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:13.280778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.280781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:13.280907Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:13.319096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895417636438360:4239]
2025-09-30T14:53:13.319506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1116, pipe: [1:7555895417636438360:4239]
2025-09-30T14:53:13.397490Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:13.398106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:13.398155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895417636438360:4239], now have 1 active actors on pipe
2025-09-30T14:53:13.398234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:13.398297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:13.398355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895417636438360:4239]
2025-09-30T14:53:13.410058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:13.410074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:13.410099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1117 reason: error at write: Disconnected sessionId: src_id|89e9cc15-78ba525e-b42a9ceb-dc4ca36b_0
2025-09-30T14:53:13.410287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1117 sessionId: src_id|89e9cc15-78ba525e-b42a9ceb-dc4ca36b_0 is DEAD
2025-09-30T14:53:13.410437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e9cc15-78ba525e-b42a9ceb-dc4ca36b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:13.410456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e9cc15-78ba525e-b42a9ceb-dc4ca36b_0] Write session will restart in 0.005381s
2025-09-30T14:53:13.410480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e9cc15-78ba525e-b42a9ceb-dc4ca36b_0] Write session: Do CDS request
2025-09-30T14:53:13.410486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e9cc15-78ba525e-b42a9ceb-dc4ca36b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:13.416868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89e9cc15-78ba525e-b42a9ceb-dc4ca36b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:13.417113Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:13.417129Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1118
2025-09-30T14:53:13.417249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1118 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:13.417281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1118 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:13.417286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1118 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:13.417291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:13.417745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1118 sessionId:  describe result for acl check
2025-09-30T14:53:13.417785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:13.417794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:13.417796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:13.417802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895417636438481:4109] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:13.418398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895417636438481:4109] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:13.420422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895417636438481:4109] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:13.420994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:13.423429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:13.423603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895417636438481:4109] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:13.423615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895417636438481:4109] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:13.423618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895417636438481:4109] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:13.423624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1118 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:13.423634Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:13.423645Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:13.423652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:13.423708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:13.423820Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895417546690275:7209]
2025-09-30T14:53:13.424380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:13.424850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:13.424907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:13.425262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:13.425337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:13.425345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:13.425346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:13.425348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:13.425349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:13.425351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:13.425352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:13.425354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:13.425355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:13.425357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:13.425359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.425360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.425361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.425362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:13.425363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:13.425370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:13.425381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:13.425386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:13.425391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:13.425395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:13.425401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:13.425406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:13.425410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:13.425415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:13.425419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:13.425423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.425427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.425432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.425436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:13.425440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:13.425447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:13.425455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:13.425462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:13.425468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:13.425474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:13.425479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:13.425495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:13.425501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:13.425506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:13.425512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:13.425517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:13.425523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:13.425527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:13.425534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:13.425539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:13.425544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:13.425549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:13.425556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:13.425567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:13.425573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:13.425578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.425590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.425594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.425599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.425606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.425611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.425616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:13.425622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:13.425627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:13.425632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:13.425683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:13.431266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:13.432277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:13.432297Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:13.432300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:13.432304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:13.432310Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1117 [2:7555895417546690275:7209]
2025-09-30T14:53:13.432326Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:13.432341Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:13.432349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:13.432353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:13.432356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:13.432371Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:13.432384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:13.432391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:13.432452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.432461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.432463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.432466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:13.432469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:13.432538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:13.432546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.432559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.432578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.432598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:13.432621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895417636438559:4109], now have 1 active actors on pipe
2025-09-30T14:53:13.432630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895417636438362:2454], now have 1 active actors on pipe
2025-09-30T14:53:13.432636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895417546690270:7209]
2025-09-30T14:53:13.432639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895417546690270:7209]
2025-09-30T14:53:13.432641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895417546690270:7209]
2025-09-30T14:53:13.432652Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:13.432670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:13.432668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:13.432692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:13.432695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:13.432695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:13.432697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:13.432682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1117
2025-09-30T14:53:13.432688Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1117
2025-09-30T14:53:13.432726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895417546690270:7209]
2025-09-30T14:53:13.432738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:13.432743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:13.432755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:13.432767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:13.432815Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2b82600-7256ead8-d4309823-6b57912d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:13.432830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:13.432837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:13.432839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:13.432848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:13.432862Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:13.432887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:13.433077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:13.433086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:13.433101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:13.433184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1118 partition: 0 MaxSeqNo: 42 sessionId: src_id|a2b82600-7256ead8-d4309823-6b57912d_0
2025-09-30T14:53:13.433576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e9cc15-78ba525e-b42a9ceb-dc4ca36b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a2b82600-7256ead8-d4309823-6b57912d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:13.436424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b82600-7256ead8-d4309823-6b57912d_0] Write session: try to update token
2025-09-30T14:53:13.436443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b82600-7256ead8-d4309823-6b57912d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:13.445080Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:13.445104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:13.445106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:13.445108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:13.445118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895417546690270:7209]
2025-09-30T14:53:13.445123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895417546690270:7209]
2025-09-30T14:53:13.445127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895417546690270:7209]
2025-09-30T14:53:13.445171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:13.445178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.445181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:13.445182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:13.445189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:13.445193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:13.445331Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:13.452542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1118 sessionId: src_id|a2b82600-7256ead8-d4309823-6b57912d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:13.455208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:13.498314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895417636438570:4239]
2025-09-30T14:53:13.498638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1117, pipe: [1:7555895417636438570:4239]
2025-09-30T14:53:13.562348Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:13.562785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:13.562804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:13.562823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895417636438570:4239], now have 1 active actors on pipe
2025-09-30T14:53:13.563028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:13.563042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:13.563052Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:13.563048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895417636438570:4239]
2025-09-30T14:53:13.563068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:13.563113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1118 reason: error at write: Disconnected sessionId: src_id|a2b82600-7256ead8-d4309823-6b57912d_0
2025-09-30T14:53:13.563286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1118 sessionId: src_id|a2b82600-7256ead8-d4309823-6b57912d_0 is DEAD
2025-09-30T14:53:13.563451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b82600-7256ead8-d4309823-6b57912d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:13.563459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b82600-7256ead8-d4309823-6b57912d_0] Write session will restart in 0.005474s
2025-09-30T14:53:13.563487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b82600-7256ead8-d4309823-6b57912d_0] Write session: Do CDS request
2025-09-30T14:53:13.563495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b82600-7256ead8-d4309823-6b57912d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:13.569744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b82600-7256ead8-d4309823-6b57912d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:13.569800Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:13.569816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1119
2025-09-30T14:53:13.569985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1119 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:13.570021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1119 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:13.570031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1119 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:13.570035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:13.570478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1119 sessionId:  describe result for acl check
2025-09-30T14:53:13.570520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:13.570530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:13.570534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:13.570541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895417636438597:4105] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:13.571115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895417636438597:4105] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:13.573788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895417636438597:4105] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:13.576761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895417636438597:4105] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:13.576784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895417636438597:4105] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:13.576787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895417636438597:4105] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:13.576794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1119 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:13.577756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:13.579967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:13.580148Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:13.580158Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:13.580168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:13.580231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:13.580270Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895417546690476:7211]
2025-09-30T14:53:13.581056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:13.581354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:13.581394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:13.581710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:13.581769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:13.581776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:13.581777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:13.581778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:13.581779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:13.581781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:13.581782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:13.581783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:13.581785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:13.581786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:13.581787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.581788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.581790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.581791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:13.581792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:13.581797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:13.581807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:13.581812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:13.581816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:13.581821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:13.581825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:13.581828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:13.581832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:13.581836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:13.581840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:13.581844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.581849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.581853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.581857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:13.581861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:13.581868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:13.581876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:13.581882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:13.581888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:13.581895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:13.581900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:13.581905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:13.581911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:13.581915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:13.581919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:13.581924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:13.581929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:13.581933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:13.581939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:13.581944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:13.581949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:13.581953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:13.581959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:13.581963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:13.581969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:13.581974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.581979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.581983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.581989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.581993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.582004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.582009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:13.582014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:13.582021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:13.582026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:13.582074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:13.587302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:13.588136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:13.588152Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:13.588155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:13.588159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:13.588165Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1118 [2:7555895417546690476:7211]
2025-09-30T14:53:13.588180Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:13.588196Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:13.588205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:13.588208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:13.588210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:13.588225Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:13.588231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:13.588237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:13.588283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.588290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.588291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.588294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:13.588295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:13.588343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:13.588349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.588358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.588364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.588380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:13.588398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895417546690471:7211]
2025-09-30T14:53:13.588403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895417546690471:7211]
2025-09-30T14:53:13.588405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895417546690471:7211]
2025-09-30T14:53:13.588410Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:13.588420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895417636438573:2454], now have 1 active actors on pipe
2025-09-30T14:53:13.588421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:13.588425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895417636438766:4105], now have 1 active actors on pipe
2025-09-30T14:53:13.588425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:13.588427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:13.588428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:13.588437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:13.588439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:13.588462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895417546690471:7211]
2025-09-30T14:53:13.588468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:13.588477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:13.588531Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1118
2025-09-30T14:53:13.588551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1118
2025-09-30T14:53:13.588609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:13.588618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:13.588637Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7131ba9-6b360caf-b4848268-14622aa7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:13.588648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:13.588652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:13.588654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:13.588664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:13.588674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:13.588691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:13.588879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:13.588888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:13.588899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:13.589009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1119 partition: 0 MaxSeqNo: 42 sessionId: src_id|7131ba9-6b360caf-b4848268-14622aa7_0
2025-09-30T14:53:13.589362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b82600-7256ead8-d4309823-6b57912d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7131ba9-6b360caf-b4848268-14622aa7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:13.592343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7131ba9-6b360caf-b4848268-14622aa7_0] Write session: try to update token
2025-09-30T14:53:13.592358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7131ba9-6b360caf-b4848268-14622aa7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:13.600314Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:13.600335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:13.600338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:13.600340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:13.600349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895417546690471:7211]
2025-09-30T14:53:13.600354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895417546690471:7211]
2025-09-30T14:53:13.600358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895417546690471:7211]
2025-09-30T14:53:13.600398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:13.600404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.600405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:13.600410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:13.600412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:13.600417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:13.600576Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:13.607162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1119 sessionId: src_id|7131ba9-6b360caf-b4848268-14622aa7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:13.609883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:13.663171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895417636438782:4239]
2025-09-30T14:53:13.663469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1118, pipe: [1:7555895417636438782:4239]
2025-09-30T14:53:13.714925Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:13.715376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:13.715392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:13.715431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895417636438782:4239], now have 1 active actors on pipe
2025-09-30T14:53:13.715650Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:13.715653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:13.715686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895417636438782:4239]
2025-09-30T14:53:13.715703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:13.715706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:13.715767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1119 reason: error at write: Disconnected sessionId: src_id|7131ba9-6b360caf-b4848268-14622aa7_0
2025-09-30T14:53:13.715971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1119 sessionId: src_id|7131ba9-6b360caf-b4848268-14622aa7_0 is DEAD
2025-09-30T14:53:13.716132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7131ba9-6b360caf-b4848268-14622aa7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:13.716144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7131ba9-6b360caf-b4848268-14622aa7_0] Write session will restart in 0.007857s
2025-09-30T14:53:13.716168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7131ba9-6b360caf-b4848268-14622aa7_0] Write session: Do CDS request
2025-09-30T14:53:13.716174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7131ba9-6b360caf-b4848268-14622aa7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:13.724846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7131ba9-6b360caf-b4848268-14622aa7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:13.724869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:13.724883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1120
2025-09-30T14:53:13.725082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1120 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:13.725114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1120 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:13.725125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1120 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:13.725129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:13.725505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1120 sessionId:  describe result for acl check
2025-09-30T14:53:13.725537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:13.725544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:13.725549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:13.725555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895417636438860:4093] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:13.726160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895417636438860:4093] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:13.728476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895417636438860:4093] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:13.730945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895417636438860:4093] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:13.730959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895417636438860:4093] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:13.730962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895417636438860:4093] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:13.730970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1120 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:13.731269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:13.733693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:13.733944Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:13.733971Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:13.733982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:13.734054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:13.734101Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895417546690691:7216]
2025-09-30T14:53:13.734754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:13.735082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:13.735130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:13.735475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:13.735554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:13.735560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:13.735561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:13.735562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:13.735564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:13.735565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:13.735566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:13.735567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:13.735568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:13.735569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:13.735571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.735572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.735573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.735574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:13.735575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:13.735581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:13.735590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:13.735595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:13.735599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:13.735603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:13.735608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:13.735612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:13.735616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:13.735620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:13.735624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:13.735629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.735633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.735636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.735640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:13.735645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:13.735654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:13.735662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:13.735673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:13.735680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:13.735689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:13.735695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:13.735699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:13.735707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:13.735711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:13.735721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:13.735726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:13.735730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:13.735735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:13.735745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:13.735753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:13.735758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:13.735767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:13.735775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:13.735779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:13.735785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:13.735790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.735799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.735805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.735812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.735817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.735822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.735830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:13.735835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:13.735840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:13.735850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:13.735895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:13.741429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:13.742507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:13.742527Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:13.742530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:13.742534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:13.742540Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1119 [2:7555895417546690691:7216]
2025-09-30T14:53:13.742555Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:13.742569Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:13.742572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:13.742576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:13.742578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:13.742595Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:13.742607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:13.742614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:13.742676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.742683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.742686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.742689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:13.742691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:13.742746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:13.742752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.742764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.742783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.742797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:13.742822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895417636438992:4093], now have 1 active actors on pipe
2025-09-30T14:53:13.742832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895417636438783:2454], now have 1 active actors on pipe
2025-09-30T14:53:13.742838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895417546690685:7216]
2025-09-30T14:53:13.742840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895417546690685:7216]
2025-09-30T14:53:13.742842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895417546690685:7216]
2025-09-30T14:53:13.742858Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:13.742873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:13.742887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:13.742891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:13.742918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895417546690685:7216]
2025-09-30T14:53:13.742908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1119
2025-09-30T14:53:13.742923Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:13.742925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:13.742929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:13.742952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1119
2025-09-30T14:53:13.742931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:13.742938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:13.743043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:13.743059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:13.743104Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36128a30-47bf8256-2f9f87ca-f76fda38_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:13.743117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:13.743126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:13.743129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:13.743144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:13.743161Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:13.743180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:13.743359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:13.743370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:13.743385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:13.743474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1120 partition: 0 MaxSeqNo: 42 sessionId: src_id|36128a30-47bf8256-2f9f87ca-f76fda38_0
2025-09-30T14:53:13.743873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7131ba9-6b360caf-b4848268-14622aa7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|36128a30-47bf8256-2f9f87ca-f76fda38_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:13.746814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36128a30-47bf8256-2f9f87ca-f76fda38_0] Write session: try to update token
2025-09-30T14:53:13.746831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36128a30-47bf8256-2f9f87ca-f76fda38_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:13.755354Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:13.755375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:13.755385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895417546690685:7216]
2025-09-30T14:53:13.755434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:13.755442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:13.755624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:13.755773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:13.755924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:13.756082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:13.756336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:13.756384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:13.762272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1120 sessionId: src_id|36128a30-47bf8256-2f9f87ca-f76fda38_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:13.765149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:13.766089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:13.766130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:13.766150Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:13.766153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:13.766155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:13.766157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:13.766166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895417546690685:7216]
2025-09-30T14:53:13.766170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895417546690685:7216]
2025-09-30T14:53:13.766173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895417546690685:7216]
2025-09-30T14:53:13.766198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:13.766211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:13.766214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:13.766215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:13.766219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.766222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:13.766350Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:13.815753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895417636439015:4239]
2025-09-30T14:53:13.816030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1119, pipe: [1:7555895417636439015:4239]
2025-09-30T14:53:13.881216Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:13.881557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:13.881597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895417636439015:4239], now have 1 active actors on pipe
2025-09-30T14:53:13.881716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:13.881827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:13.881831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895417636439015:4239]
2025-09-30T14:53:13.881834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:13.881856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:13.881900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1120 reason: error at write: Disconnected sessionId: src_id|36128a30-47bf8256-2f9f87ca-f76fda38_0
2025-09-30T14:53:13.882093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1120 sessionId: src_id|36128a30-47bf8256-2f9f87ca-f76fda38_0 is DEAD
2025-09-30T14:53:13.882259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36128a30-47bf8256-2f9f87ca-f76fda38_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:13.882269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36128a30-47bf8256-2f9f87ca-f76fda38_0] Write session will restart in 0.007394s
2025-09-30T14:53:13.882292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36128a30-47bf8256-2f9f87ca-f76fda38_0] Write session: Do CDS request
2025-09-30T14:53:13.882298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36128a30-47bf8256-2f9f87ca-f76fda38_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:13.890792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36128a30-47bf8256-2f9f87ca-f76fda38_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:13.890908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:13.890924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1121
2025-09-30T14:53:13.891081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1121 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:13.891114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1121 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:13.891374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1121 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:13.891385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:13.891972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1121 sessionId:  describe result for acl check
2025-09-30T14:53:13.892016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:13.892019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:13.892021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:13.892026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895417636439065:4088] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:13.892569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895417636439065:4088] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:13.895300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895417636439065:4088] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:13.897940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895417636439065:4088] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:13.897954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895417636439065:4088] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:13.897958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895417636439065:4088] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:13.897966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1121 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:13.898659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:13.901035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:13.901272Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:13.901283Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:13.901296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:13.901360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:13.901444Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895417546690916:7228]
2025-09-30T14:53:13.902164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:13.902537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:13.902603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:13.902975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:13.903074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:13.903083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:13.903084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:13.903085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:13.903087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:13.903088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:13.903089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:13.903090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:13.903091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:13.903093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:13.903094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.903096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.903097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.903098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:13.903099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:13.903105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:13.903125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:13.903129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:13.903133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:13.903138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:13.903142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:13.903146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:13.903150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:13.903154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:13.903159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:13.903163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.903166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.903170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.903173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:13.903176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:13.903184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:13.903192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:13.903198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:13.903204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:13.903210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:13.903215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:13.903219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:13.903225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:13.903230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:13.903235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:13.903241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:13.903261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:13.903267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:13.903271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:13.903275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:13.903280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:13.903284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:13.903288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:13.903292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:13.903297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:13.903302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.903308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.903313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.903318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.903323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.903328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.903332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:13.903337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:13.903342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:13.903355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:13.903401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:13.909797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:13.911028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:13.911044Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:13.911046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:13.911050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:13.911057Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1120 [2:7555895417546690916:7228]
2025-09-30T14:53:13.911073Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:13.911089Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:13.911092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:13.911095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:13.911097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:13.911113Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:13.911120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:13.911131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:13.911192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.911201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.911203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.911207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:13.911209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:13.911297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:13.911305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.911322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:13.911334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:13.911356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:13.911380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895417636439214:4088], now have 1 active actors on pipe
2025-09-30T14:53:13.911392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895417636439016:2454], now have 1 active actors on pipe
2025-09-30T14:53:13.911398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895417546690911:7228]
2025-09-30T14:53:13.911404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895417546690911:7228]
2025-09-30T14:53:13.911406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895417546690911:7228]
2025-09-30T14:53:13.911420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:13.911438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:13.911517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1120
2025-09-30T14:53:13.911567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1120
2025-09-30T14:53:13.911458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:13.911466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:13.911465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:13.911471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:13.911474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:13.911498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895417546690911:7228]
2025-09-30T14:53:13.911503Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:13.911516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:13.911680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:13.911687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:13.911716Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37fb7b93-3fff024f-26b44f0c-9afac28a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:13.911725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:13.911729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:13.911731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:13.911742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:13.911752Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:13.911766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:13.912044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:13.912057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:13.912084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:13.912242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1121 partition: 0 MaxSeqNo: 42 sessionId: src_id|37fb7b93-3fff024f-26b44f0c-9afac28a_0
2025-09-30T14:53:13.912628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36128a30-47bf8256-2f9f87ca-f76fda38_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|37fb7b93-3fff024f-26b44f0c-9afac28a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:13.915535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37fb7b93-3fff024f-26b44f0c-9afac28a_0] Write session: try to update token
2025-09-30T14:53:13.915555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37fb7b93-3fff024f-26b44f0c-9afac28a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:13.924224Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:13.924247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:13.924251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:13.924253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:13.924262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895417546690911:7228]
2025-09-30T14:53:13.924267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895417546690911:7228]
2025-09-30T14:53:13.924272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895417546690911:7228]
2025-09-30T14:53:13.924313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:13.924318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:13.924325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:13.924327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:13.924330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:13.924340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:13.924484Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:13.931984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1121 sessionId: src_id|37fb7b93-3fff024f-26b44f0c-9afac28a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:13.934685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:13.982168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895417636439227:4239]
2025-09-30T14:53:13.982521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1120, pipe: [1:7555895417636439227:4239]
2025-09-30T14:53:14.040460Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:14.040998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:14.041017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:14.041036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895417636439227:4239], now have 1 active actors on pipe
2025-09-30T14:53:14.041247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:14.041261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:14.041254Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:14.041337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1121 reason: error at write: Disconnected sessionId: src_id|37fb7b93-3fff024f-26b44f0c-9afac28a_0
2025-09-30T14:53:14.041367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895417636439227:4239]
2025-09-30T14:53:14.041399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:14.041566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1121 sessionId: src_id|37fb7b93-3fff024f-26b44f0c-9afac28a_0 is DEAD
2025-09-30T14:53:14.041764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37fb7b93-3fff024f-26b44f0c-9afac28a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:14.041776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37fb7b93-3fff024f-26b44f0c-9afac28a_0] Write session will restart in 0.008209s
2025-09-30T14:53:14.041800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37fb7b93-3fff024f-26b44f0c-9afac28a_0] Write session: Do CDS request
2025-09-30T14:53:14.041806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37fb7b93-3fff024f-26b44f0c-9afac28a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:14.050843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37fb7b93-3fff024f-26b44f0c-9afac28a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:14.050991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:14.051007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1122
2025-09-30T14:53:14.051148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1122 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:14.051188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1122 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:14.051200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1122 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:14.051205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:14.051693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1122 sessionId:  describe result for acl check
2025-09-30T14:53:14.051740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:14.051742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:14.051744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:14.051750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895421931406562:4083] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:14.052298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895421931406562:4083] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:14.055926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895421931406562:4083] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:14.058622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895421931406562:4083] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:14.058637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895421931406562:4083] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:14.058641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895421931406562:4083] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:14.058649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1122 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:14.060373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:14.062668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:14.062897Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:14.062909Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:14.062922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:14.062998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:14.063040Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895421841658415:7230]
2025-09-30T14:53:14.063745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:14.064043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:14.064095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:14.064506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:14.064589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:14.064596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:14.064597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:14.064598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:14.064599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:14.064601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:14.064602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:14.064603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:14.064604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:14.064605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:14.064606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.064607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.064608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.064609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:14.064611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:14.064617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:14.064628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:14.064633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:14.064637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:14.064641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:14.064646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:14.064651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:14.064655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:14.064659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:14.064664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:14.064668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.064673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.064677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.064682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:14.064686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:14.064694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:14.064702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:14.064709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:14.064715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:14.064720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:14.064727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:14.064731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:14.064737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:14.064741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:14.064746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:14.064751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:14.064756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:14.064761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:14.064766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:14.064775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:14.064780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:14.064784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:14.064788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:14.064793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:14.064801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:14.064805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.064810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.064814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.064818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.064825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.064830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.064834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:14.064839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:14.064845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:14.064852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:14.064893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:14.070378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:14.071582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:14.071603Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:14.071606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:14.071609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:14.071616Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1121 [2:7555895421841658415:7230]
2025-09-30T14:53:14.071631Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:14.071646Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:14.071655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:14.071660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:14.071662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:14.071677Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:14.071689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:14.071696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:14.071756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.071763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.071765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.071769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:14.071772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:14.071841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:14.071850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.071864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.071882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.071907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:14.071947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895421931406529:2454], now have 1 active actors on pipe
2025-09-30T14:53:14.071961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895421931406726:4083], now have 1 active actors on pipe
2025-09-30T14:53:14.071967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895421841658410:7230]
2025-09-30T14:53:14.071970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895421841658410:7230]
2025-09-30T14:53:14.071972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895421841658410:7230]
2025-09-30T14:53:14.071987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:14.072003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:14.072013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:14.072020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:14.071986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1121
2025-09-30T14:53:14.072024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:14.072026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:14.072028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:14.072054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895421841658410:7230]
2025-09-30T14:53:14.072058Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:14.072060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:14.072170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1121
2025-09-30T14:53:14.072240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:14.072253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:14.072277Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab1a2103-f0e49637-573b2a8e-639f8fd9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:14.072292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:14.072296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:14.072298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:14.072308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:14.072319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:14.072336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:14.072493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:14.072503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:14.072518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:14.072598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1122 partition: 0 MaxSeqNo: 42 sessionId: src_id|ab1a2103-f0e49637-573b2a8e-639f8fd9_0
2025-09-30T14:53:14.072968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37fb7b93-3fff024f-26b44f0c-9afac28a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ab1a2103-f0e49637-573b2a8e-639f8fd9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:14.075813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab1a2103-f0e49637-573b2a8e-639f8fd9_0] Write session: try to update token
2025-09-30T14:53:14.075833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab1a2103-f0e49637-573b2a8e-639f8fd9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:14.084209Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:14.084230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:14.084240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895421841658410:7230]
2025-09-30T14:53:14.084287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:14.084287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:14.084475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:14.084632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:14.084833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:14.084981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:14.085175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:14.085218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:14.090358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1122 sessionId: src_id|ab1a2103-f0e49637-573b2a8e-639f8fd9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:14.093327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:14.093515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:14.093538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:14.093581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:14.093647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:14.094826Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:14.094844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:14.094847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:14.094849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:14.094858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895421841658410:7230]
2025-09-30T14:53:14.094862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895421841658410:7230]
2025-09-30T14:53:14.094866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895421841658410:7230]
2025-09-30T14:53:14.094903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:14.094915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:14.094917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.094920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:14.094921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:14.094924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:14.095056Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:14.141402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895421931406744:4239]
2025-09-30T14:53:14.141731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1121, pipe: [1:7555895421931406744:4239]
2025-09-30T14:53:14.203917Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:14.211617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:14.211651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:14.211824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:14.211895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:14.211972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:14.212046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:14.212092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:14.212102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:14.212178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:14.212248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:14.212318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:14.212392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:14.212439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:14.212447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:14.212517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:14.212579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:14.212639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:14.212710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:14.212758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:14.212765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:14.212842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:14.212916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:14.212993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:14.213108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:14.213150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:14.213156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:14.213217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:14.213284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:14.213353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:14.213417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:14.213458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:14.213464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:14.213530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:14.213600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:14.213668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:14.213741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:14.213791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:14.213798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:14.213867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:14.213929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:14.213991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:14.214051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:14.214094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:14.214099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:14.214174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:14.214230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:14.214300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:14.214365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:14.214409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:14.214418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:14.214484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:14.214551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:14.214617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:14.214682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:14.214740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:14.214748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:14.214816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:14.214877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:14.214941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:14.215003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:14.215053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:14.215059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:14.215148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895421931406744:4239], now have 1 active actors on pipe
2025-09-30T14:53:14.215453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:14.215463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:14.215508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895421931406744:4239]
2025-09-30T14:53:14.215627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:14.215650Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:14.215674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1122 reason: error at write: Disconnected sessionId: src_id|ab1a2103-f0e49637-573b2a8e-639f8fd9_0
2025-09-30T14:53:14.215879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1122 sessionId: src_id|ab1a2103-f0e49637-573b2a8e-639f8fd9_0 is DEAD
2025-09-30T14:53:14.216063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab1a2103-f0e49637-573b2a8e-639f8fd9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:14.216073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab1a2103-f0e49637-573b2a8e-639f8fd9_0] Write session will restart in 0.006706s
2025-09-30T14:53:14.216097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab1a2103-f0e49637-573b2a8e-639f8fd9_0] Write session: Do CDS request
2025-09-30T14:53:14.216102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab1a2103-f0e49637-573b2a8e-639f8fd9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:14.224184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab1a2103-f0e49637-573b2a8e-639f8fd9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:14.224289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:14.224306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1123
2025-09-30T14:53:14.224438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1123 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:14.224485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1123 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:14.224496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1123 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:14.224500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:14.225019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1123 sessionId:  describe result for acl check
2025-09-30T14:53:14.225067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:14.225075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:14.225077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:14.225083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895421931406810:4077] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:14.225692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895421931406810:4077] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:14.228538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895421931406810:4077] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:14.231143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895421931406810:4077] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:14.231156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895421931406810:4077] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:14.231159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895421931406810:4077] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:14.231166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1123 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:14.231379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:14.233758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:14.234080Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:14.234090Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:14.234102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:14.234176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:14.234215Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895421841658633:7234]
2025-09-30T14:53:14.234857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:14.235151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:14.235190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:14.235579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:14.235647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:14.235653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:14.235654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:14.235655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:14.235656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:14.235658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:14.235659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:14.235660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:14.235662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:14.235663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:14.235664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.235665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.235666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.235668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:14.235669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:14.235675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:14.235686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:14.235691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:14.235695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:14.235699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:14.235703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:14.235707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:14.235711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:14.235715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:14.235719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:14.235724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.235728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.235731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.235736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:14.235739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:14.235747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:14.235754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:14.235761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:14.235767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:14.235772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:14.235778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:14.235782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:14.235787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:14.235793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:14.235797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:14.235801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:14.235806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:14.235811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:14.235816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:14.235820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:14.235824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:14.235836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:14.235841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:14.235846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:14.235851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:14.235856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.235867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.235872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.235882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.235887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.235893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.235902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:14.235908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:14.235917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:14.235922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:14.235971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:14.241342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:14.242488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:14.242502Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:14.242504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:14.242508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:14.242513Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1122 [2:7555895421841658633:7234]
2025-09-30T14:53:14.242525Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:14.242537Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:14.242539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:14.242540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:14.242542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:14.242554Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:14.242558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:14.242564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:14.242620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.242628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.242630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.242633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:14.242636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:14.242707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:14.242716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.242730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.242743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.242761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:14.242783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895421931406958:4077], now have 1 active actors on pipe
2025-09-30T14:53:14.242787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895421931406757:2454], now have 1 active actors on pipe
2025-09-30T14:53:14.242793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895421841658627:7234]
2025-09-30T14:53:14.242795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895421841658627:7234]
2025-09-30T14:53:14.242797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895421841658627:7234]
2025-09-30T14:53:14.242810Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:14.242827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:14.242827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:14.242831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:14.242833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:14.242847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:14.242850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:14.242882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895421841658627:7234]
2025-09-30T14:53:14.242890Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:14.242892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:14.242864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1122
2025-09-30T14:53:14.242888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1122
2025-09-30T14:53:14.242913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:14.242923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:14.242958Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9fa61dd-1c74c9ae-916d10d6-fe2ec44d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:14.242970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:14.242975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:14.242977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:14.242986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:14.242994Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:14.243009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:14.243160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:14.243168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:14.243180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:14.243291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1123 partition: 0 MaxSeqNo: 42 sessionId: src_id|d9fa61dd-1c74c9ae-916d10d6-fe2ec44d_0
2025-09-30T14:53:14.243697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab1a2103-f0e49637-573b2a8e-639f8fd9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d9fa61dd-1c74c9ae-916d10d6-fe2ec44d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:14.246459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9fa61dd-1c74c9ae-916d10d6-fe2ec44d_0] Write session: try to update token
2025-09-30T14:53:14.246475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9fa61dd-1c74c9ae-916d10d6-fe2ec44d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:14.255020Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:14.255044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:14.255046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:14.255049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:14.255059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895421841658627:7234]
2025-09-30T14:53:14.255064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895421841658627:7234]
2025-09-30T14:53:14.255068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895421841658627:7234]
2025-09-30T14:53:14.255106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:14.255114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.255116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:14.255115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:14.255121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:14.255129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:14.255294Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:14.261803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1123 sessionId: src_id|d9fa61dd-1c74c9ae-916d10d6-fe2ec44d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:14.264556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:14.315457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895421931406971:4239]
2025-09-30T14:53:14.315752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1122, pipe: [1:7555895421931406971:4239]
2025-09-30T14:53:14.365393Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:14.365786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:14.365798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:14.365830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895421931406971:4239], now have 1 active actors on pipe
2025-09-30T14:53:14.365998Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:14.366090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895421931406971:4239]
2025-09-30T14:53:14.366092Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:14.366135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:14.366210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1123 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d9fa61dd-1c74c9ae-916d10d6-fe2ec44d_0
2025-09-30T14:53:14.366393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1123 sessionId: src_id|d9fa61dd-1c74c9ae-916d10d6-fe2ec44d_0 is DEAD
2025-09-30T14:53:14.366551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9fa61dd-1c74c9ae-916d10d6-fe2ec44d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:14.366574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9fa61dd-1c74c9ae-916d10d6-fe2ec44d_0] Write session will restart in 0.008389s
2025-09-30T14:53:14.366600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9fa61dd-1c74c9ae-916d10d6-fe2ec44d_0] Write session: Do CDS request
2025-09-30T14:53:14.366605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9fa61dd-1c74c9ae-916d10d6-fe2ec44d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:14.375835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9fa61dd-1c74c9ae-916d10d6-fe2ec44d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:14.375954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:14.375968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1124
2025-09-30T14:53:14.376127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1124 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:14.376175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1124 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:14.376183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1124 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:14.376187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:14.376585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1124 sessionId:  describe result for acl check
2025-09-30T14:53:14.376611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:14.376613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:14.376614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:14.376618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895421931407072:4074] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:14.377076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895421931407072:4074] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:14.379356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895421931407072:4074] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:14.380363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:14.382538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:14.382701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895421931407072:4074] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:14.382717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895421931407072:4074] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:14.382720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895421931407072:4074] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:14.382728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1124 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:14.382704Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:14.382712Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:14.382721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:14.382772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:14.382802Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895421841658837:7236]
2025-09-30T14:53:14.383324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:14.383589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:14.383625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:14.383870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:14.383930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:14.383935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:14.383936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:14.383937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:14.383938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:14.383938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:14.383939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:14.383940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:14.383941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:14.383942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:14.383943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.383943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.383944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.383945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:14.383945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:14.383949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:14.383956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:14.383958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:14.383960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:14.383963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:14.383965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:14.383968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:14.383970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:14.383972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:14.383975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:14.383977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.383980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.383982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.383984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:14.383987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:14.383991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:14.383997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:14.384002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:14.384006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:14.384009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:14.384012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:14.384014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:14.384017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:14.384021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:14.384024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:14.384026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:14.384029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:14.384032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:14.384035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:14.384037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:14.384040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:14.384042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:14.384045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:14.384048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:14.384051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:14.384053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.384056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.384059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.384062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.384065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.384067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.384070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:14.384073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:14.384075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:14.384078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:14.384102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:14.389407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:14.390531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:14.390546Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:14.390548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:14.390551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:14.390556Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1123 [2:7555895421841658837:7236]
2025-09-30T14:53:14.390567Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:14.390581Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:14.390583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:14.390586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:14.390587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:14.390600Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:14.390609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:14.390615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:14.390676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.390686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.390688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.390691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:14.390692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:14.390742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:14.390750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.390762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.390780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.390797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:14.390816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895421931407174:4074], now have 1 active actors on pipe
2025-09-30T14:53:14.390824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895421931406972:2454], now have 1 active actors on pipe
2025-09-30T14:53:14.390830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895421841658832:7236]
2025-09-30T14:53:14.390836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895421841658832:7236]
2025-09-30T14:53:14.390838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895421841658832:7236]
2025-09-30T14:53:14.390857Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:14.390874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:14.390895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:14.390898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:14.390898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:14.390902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:14.390906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:14.390877Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1123
2025-09-30T14:53:14.390881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1123
2025-09-30T14:53:14.390929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895421841658832:7236]
2025-09-30T14:53:14.390943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:14.390961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:14.390970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:14.390975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:14.391016Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4b04de3-9d30cd27-38d054bf-9f6e18fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:14.391029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:14.391032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:14.391035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:14.391045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:14.391059Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:14.391080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:14.391273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:14.391283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:14.391299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:14.391396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1124 partition: 0 MaxSeqNo: 42 sessionId: src_id|c4b04de3-9d30cd27-38d054bf-9f6e18fe_0
2025-09-30T14:53:14.391790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9fa61dd-1c74c9ae-916d10d6-fe2ec44d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c4b04de3-9d30cd27-38d054bf-9f6e18fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:14.394470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b04de3-9d30cd27-38d054bf-9f6e18fe_0] Write session: try to update token
2025-09-30T14:53:14.394487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b04de3-9d30cd27-38d054bf-9f6e18fe_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:14.402973Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:14.402995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:14.402996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:14.402998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:14.403006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895421841658832:7236]
2025-09-30T14:53:14.403009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895421841658832:7236]
2025-09-30T14:53:14.403012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895421841658832:7236]
2025-09-30T14:53:14.403048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:14.403054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.403057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:14.403062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:14.403070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:14.403074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:14.403187Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:14.408457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1124 sessionId: src_id|c4b04de3-9d30cd27-38d054bf-9f6e18fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:14.410948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:14.466499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895421931407186:4239]
2025-09-30T14:53:14.466805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1123, pipe: [1:7555895421931407186:4239]
2025-09-30T14:53:14.513336Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:14.513705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:14.513722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:14.513759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895421931407186:4239], now have 1 active actors on pipe
2025-09-30T14:53:14.513991Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:14.514023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:14.514026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:14.514031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:14.514089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895421931407186:4239]
2025-09-30T14:53:14.514094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1124 reason: error at write: Disconnected sessionId: src_id|c4b04de3-9d30cd27-38d054bf-9f6e18fe_0
2025-09-30T14:53:14.514317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1124 sessionId: src_id|c4b04de3-9d30cd27-38d054bf-9f6e18fe_0 is DEAD
2025-09-30T14:53:14.514456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b04de3-9d30cd27-38d054bf-9f6e18fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:14.514468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b04de3-9d30cd27-38d054bf-9f6e18fe_0] Write session will restart in 0.008445s
2025-09-30T14:53:14.514491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b04de3-9d30cd27-38d054bf-9f6e18fe_0] Write session: Do CDS request
2025-09-30T14:53:14.514497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b04de3-9d30cd27-38d054bf-9f6e18fe_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:14.523740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b04de3-9d30cd27-38d054bf-9f6e18fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:14.525898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:14.525914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1125
2025-09-30T14:53:14.526105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1125 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:14.526149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1125 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:14.526160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1125 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:14.526164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:14.526561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1125 sessionId:  describe result for acl check
2025-09-30T14:53:14.526591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:14.526595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:14.526597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:14.526603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895421931407307:4066] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:14.527134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895421931407307:4066] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:14.529187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895421931407307:4066] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:14.529832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:14.532011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:14.532128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895421931407307:4066] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:14.532143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895421931407307:4066] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:14.532146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895421931407307:4066] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:14.532154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1125 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:14.532211Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:14.532223Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:14.532234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:14.532286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:14.532322Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895421841659043:7238]
2025-09-30T14:53:14.532914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:14.533189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:14.533236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:14.533551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:14.533628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:14.533636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:14.533637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:14.533638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:14.533639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:14.533640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:14.533642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:14.533643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:14.533643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:14.533644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:14.533646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.533647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.533648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.533649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:14.533650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:14.533656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:14.533667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:14.533672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:14.533676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:14.533680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:14.533683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:14.533687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:14.533690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:14.533694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:14.533698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:14.533702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.533707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.533711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.533715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:14.533719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:14.533728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:14.533736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:14.533742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:14.533748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:14.533753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:14.533757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:14.533761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:14.533766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:14.533771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:14.533775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:14.533783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:14.533788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:14.533798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:14.533802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:14.533806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:14.533811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:14.533822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:14.533827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:14.533836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:14.533842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:14.533846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.533851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.533858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.533863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.533870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.533874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.533876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:14.533879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:14.533882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:14.533885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:14.533909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:14.539441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:14.540954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:14.540980Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:14.540985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:14.540990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:14.540999Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1124 [2:7555895421841659043:7238]
2025-09-30T14:53:14.541019Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:14.541038Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:14.541042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:14.541046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:14.541048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:14.541067Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:14.541074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:14.541082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:14.541162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.541177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.541180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.541185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:14.541188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:14.541281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:14.541296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.541313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.541326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.541344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:14.541371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895421931407392:4066], now have 1 active actors on pipe
2025-09-30T14:53:14.541375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895421931407189:2454], now have 1 active actors on pipe
2025-09-30T14:53:14.541383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895421841659038:7238]
2025-09-30T14:53:14.541385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895421841659038:7238]
2025-09-30T14:53:14.541388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895421841659038:7238]
2025-09-30T14:53:14.541437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1124
2025-09-30T14:53:14.541460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1124
2025-09-30T14:53:14.541412Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:14.541427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:14.541430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:14.541433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:14.541438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:14.541457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:14.541460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:14.541515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:14.541520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:14.541534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895421841659038:7238]
2025-09-30T14:53:14.541546Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:14.541552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:14.541582Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42266e7f-d96b0dae-9dd9cef8-9fd8620_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:14.541591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:14.541595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:14.541598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:14.541612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:14.541628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:14.541664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:14.541877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:14.541891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:14.541911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:14.542071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1125 partition: 0 MaxSeqNo: 42 sessionId: src_id|42266e7f-d96b0dae-9dd9cef8-9fd8620_0
2025-09-30T14:53:14.543474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b04de3-9d30cd27-38d054bf-9f6e18fe_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|42266e7f-d96b0dae-9dd9cef8-9fd8620_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:14.546377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42266e7f-d96b0dae-9dd9cef8-9fd8620_0] Write session: try to update token
2025-09-30T14:53:14.546400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42266e7f-d96b0dae-9dd9cef8-9fd8620_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:14.554290Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:14.554310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:14.554313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:14.554320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:14.554328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895421841659038:7238]
2025-09-30T14:53:14.554333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895421841659038:7238]
2025-09-30T14:53:14.554337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895421841659038:7238]
2025-09-30T14:53:14.554376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:14.554378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:14.554383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.554386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:14.554396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:14.554401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:14.554524Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:14.566368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1125 sessionId: src_id|42266e7f-d96b0dae-9dd9cef8-9fd8620_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:14.569157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:14.614474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895421931407404:4239]
2025-09-30T14:53:14.614754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1124, pipe: [1:7555895421931407404:4239]
2025-09-30T14:53:14.669584Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:14.669989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:14.670003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:14.670022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895421931407404:4239], now have 1 active actors on pipe
2025-09-30T14:53:14.670236Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:14.670279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:14.670297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:14.670363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1125 reason: error at write: Disconnected sessionId: src_id|42266e7f-d96b0dae-9dd9cef8-9fd8620_0
2025-09-30T14:53:14.670578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1125 sessionId: src_id|42266e7f-d96b0dae-9dd9cef8-9fd8620_0 is DEAD
2025-09-30T14:53:14.670746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42266e7f-d96b0dae-9dd9cef8-9fd8620_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:14.670758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42266e7f-d96b0dae-9dd9cef8-9fd8620_0] Write session will restart in 0.006184s
2025-09-30T14:53:14.670795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42266e7f-d96b0dae-9dd9cef8-9fd8620_0] Write session: Do CDS request
2025-09-30T14:53:14.670802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42266e7f-d96b0dae-9dd9cef8-9fd8620_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:14.670764Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:14.670805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895421931407404:4239]
2025-09-30T14:53:14.677857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42266e7f-d96b0dae-9dd9cef8-9fd8620_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:14.679193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:14.679208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1126
2025-09-30T14:53:14.679373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1126 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:14.679426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1126 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:14.679437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1126 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:14.679442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:14.680358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1126 sessionId:  describe result for acl check
2025-09-30T14:53:14.680405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:14.680407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:14.680409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:14.680418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895421931407448:4058] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:14.680963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895421931407448:4058] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:14.684977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895421931407448:4058] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:14.687466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:14.687861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895421931407448:4058] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:14.687877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895421931407448:4058] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:14.687881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895421931407448:4058] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:14.687889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1126 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:14.690282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:14.690594Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:14.690609Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:14.690632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:14.690711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:14.690766Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895421841659253:7241]
2025-09-30T14:53:14.691435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:14.691775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:14.691823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:14.692178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:14.692239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:14.692247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:14.692248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:14.692249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:14.692251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:14.692252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:14.692253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:14.692254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:14.692255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:14.692257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:14.692258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.692259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.692260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.692261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:14.692263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:14.692268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:14.692279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:14.692284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:14.692288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:14.692292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:14.692297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:14.692301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:14.692304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:14.692309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:14.692314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:14.692319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.692322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.692327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.692331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:14.692334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:14.692343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:14.692351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:14.692357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:14.692363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:14.692368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:14.692373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:14.692378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:14.692384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:14.692389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:14.692394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:14.692399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:14.692404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:14.692409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:14.692415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:14.692419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:14.692424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:14.692429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:14.692435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:14.692439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:14.692443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:14.692448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.692452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.692456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.692460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.692464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.692469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.692473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:14.692479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:14.692485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:14.692501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:14.692544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:14.698870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:14.700077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:14.700098Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:14.700101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:14.700105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:14.700112Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1125 [2:7555895421841659253:7241]
2025-09-30T14:53:14.700128Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:14.700144Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:14.700152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:14.700156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:14.700158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:14.700175Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:14.700187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:14.700194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:14.700261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.700268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.700271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.700275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:14.700277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:14.700346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:14.700356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.700371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.700385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.700406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:14.700423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895421841659247:7241]
2025-09-30T14:53:14.700431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895421841659247:7241]
2025-09-30T14:53:14.700434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895421841659247:7241]
2025-09-30T14:53:14.700447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:14.700465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:14.700486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:14.700495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:14.700533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895421841659247:7241]
2025-09-30T14:53:14.700542Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:14.701479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1125
2025-09-30T14:53:14.701522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1125
2025-09-30T14:53:14.702280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1126 partition: 0 MaxSeqNo: 42 sessionId: src_id|de82dd75-253341-ccb72266-5b6643da_0
2025-09-30T14:53:14.702844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42266e7f-d96b0dae-9dd9cef8-9fd8620_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|de82dd75-253341-ccb72266-5b6643da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:14.705667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de82dd75-253341-ccb72266-5b6643da_0] Write session: try to update token
2025-09-30T14:53:14.705686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de82dd75-253341-ccb72266-5b6643da_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:14.700968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:14.700978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:14.700981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:14.700986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:14.701432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895421931407405:2454], now have 1 active actors on pipe
2025-09-30T14:53:14.701438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895421931407607:4058], now have 1 active actors on pipe
2025-09-30T14:53:14.701732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:14.701737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:14.701764Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de82dd75-253341-ccb72266-5b6643da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:14.701774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:14.701789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:14.701791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:14.701804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:14.701816Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:14.701835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:14.702148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:14.702154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:14.702173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:14.714611Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:14.714635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:14.714637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:14.714638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:14.714647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895421841659247:7241]
2025-09-30T14:53:14.714650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895421841659247:7241]
2025-09-30T14:53:14.714654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895421841659247:7241]
2025-09-30T14:53:14.714688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:14.714693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.714695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:14.714699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:14.714706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:14.714711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:14.714831Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:14.726047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1126 sessionId: src_id|de82dd75-253341-ccb72266-5b6643da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:14.728811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:14.771212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895421931407620:4239]
2025-09-30T14:53:14.775524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1125, pipe: [1:7555895421931407620:4239]
2025-09-30T14:53:14.830102Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:14.830637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:14.830657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:14.830676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895421931407620:4239], now have 1 active actors on pipe
2025-09-30T14:53:14.830891Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:14.830917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:14.830965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:14.830967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:14.831030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1126 reason: error at write: Disconnected sessionId: src_id|de82dd75-253341-ccb72266-5b6643da_0
2025-09-30T14:53:14.831255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1126 sessionId: src_id|de82dd75-253341-ccb72266-5b6643da_0 is DEAD
2025-09-30T14:53:14.831410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de82dd75-253341-ccb72266-5b6643da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:14.831423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de82dd75-253341-ccb72266-5b6643da_0] Write session will restart in 0.008652s
2025-09-30T14:53:14.831447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de82dd75-253341-ccb72266-5b6643da_0] Write session: Do CDS request
2025-09-30T14:53:14.831453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de82dd75-253341-ccb72266-5b6643da_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:14.831448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895421931407620:4239]
2025-09-30T14:53:14.841795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de82dd75-253341-ccb72266-5b6643da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:14.841876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:14.841892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1127
2025-09-30T14:53:14.846387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1127 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:14.846441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1127 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:14.846447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1127 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:14.846452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:14.846893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1127 sessionId:  describe result for acl check
2025-09-30T14:53:14.846926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:14.846932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:14.846934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:14.846940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895421931407816:4048] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:14.847346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:14.847484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895421931407816:4048] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:14.849914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895421931407816:4048] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:14.849919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:14.850132Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:14.850143Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:14.850153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:14.850201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:14.850243Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895421841659496:7255]
2025-09-30T14:53:14.850742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:14.851030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:14.851066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:14.851416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:14.851489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:14.851494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:14.851495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:14.851496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:14.851498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:14.851499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:14.851500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:14.851502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:14.851503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:14.851504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:14.851506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.851507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.851508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.851509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:14.851510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:14.851516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:14.851526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:14.851531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:14.851535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:14.851539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:14.851544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:14.851549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:14.851552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:14.851557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:14.851561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:14.851565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.851569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.851573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.851575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:14.851578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:14.851583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:14.851588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:14.851592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:14.851595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:14.851599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:14.851602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:14.851605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:14.851608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:14.851611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:14.851614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:14.851617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:14.851620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:14.851623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:14.851626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:14.851629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:14.851632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:14.851635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:14.851638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:14.851641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:14.851644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:14.851647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.851651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.851654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.851657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.851660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.851663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.851666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:14.851669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:14.851673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:14.851677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:14.851700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:14.856975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895421931407816:4048] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:14.856994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895421931407816:4048] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:14.856998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895421931407816:4048] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:14.857007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1127 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:14.857589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:14.858705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:14.858724Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:14.858726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:14.858731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:14.858737Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1126 [2:7555895421841659496:7255]
2025-09-30T14:53:14.858752Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:14.858766Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:14.858769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:14.858773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:14.858775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:14.858794Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:14.858801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:14.858807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:14.858863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.858873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.858875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.858878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:14.858881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:14.858944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:14.858953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.858966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:14.858979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:14.858998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:14.859026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895421931407646:2454], now have 1 active actors on pipe
2025-09-30T14:53:14.859035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895421931407852:4048], now have 1 active actors on pipe
2025-09-30T14:53:14.859041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895421841659491:7255]
2025-09-30T14:53:14.859044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895421841659491:7255]
2025-09-30T14:53:14.859046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895421841659491:7255]
2025-09-30T14:53:14.859058Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:14.859073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:14.859076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:14.859076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:14.859078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:14.859091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:14.859094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:14.859091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1126
2025-09-30T14:53:14.859126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895421841659491:7255]
2025-09-30T14:53:14.859139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1126
2025-09-30T14:53:14.859139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:14.859304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:14.859334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:14.859346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:14.859377Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|783d2d97-8f216dfd-aa542884-692ecca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:14.859389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:14.859396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:14.859403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:14.859412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:14.859426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:14.859438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:14.859660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:14.859690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:14.859720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:14.859816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1127 partition: 0 MaxSeqNo: 42 sessionId: src_id|783d2d97-8f216dfd-aa542884-692ecca_0
2025-09-30T14:53:14.860227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de82dd75-253341-ccb72266-5b6643da_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|783d2d97-8f216dfd-aa542884-692ecca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:14.862940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|783d2d97-8f216dfd-aa542884-692ecca_0] Write session: try to update token
2025-09-30T14:53:14.862958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|783d2d97-8f216dfd-aa542884-692ecca_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:14.871508Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:14.871531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:14.871533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:14.871535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:14.871545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895421841659491:7255]
2025-09-30T14:53:14.871550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895421841659491:7255]
2025-09-30T14:53:14.871554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895421841659491:7255]
2025-09-30T14:53:14.871594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:14.871601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:14.871600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:14.871605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:14.871607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:14.871614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:14.871744Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:14.879176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1127 sessionId: src_id|783d2d97-8f216dfd-aa542884-692ecca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:14.882153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:14.931401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895421931407860:4239]
2025-09-30T14:53:14.931728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1126, pipe: [1:7555895421931407860:4239]
2025-09-30T14:53:14.987129Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:14.987516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:14.987541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:14.987560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895421931407860:4239], now have 1 active actors on pipe
2025-09-30T14:53:14.987774Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:14.987840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:14.987907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895421931407860:4239]
2025-09-30T14:53:14.987931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:14.988005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1127 reason: status is not ok: tablet will be restarted right now sessionId: src_id|783d2d97-8f216dfd-aa542884-692ecca_0
2025-09-30T14:53:14.988202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1127 sessionId: src_id|783d2d97-8f216dfd-aa542884-692ecca_0 is DEAD
2025-09-30T14:53:14.988394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|783d2d97-8f216dfd-aa542884-692ecca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:14.988402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|783d2d97-8f216dfd-aa542884-692ecca_0] Write session will restart in 0.009826s
2025-09-30T14:53:14.988441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|783d2d97-8f216dfd-aa542884-692ecca_0] Write session: Do CDS request
2025-09-30T14:53:14.988447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|783d2d97-8f216dfd-aa542884-692ecca_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:15.003741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|783d2d97-8f216dfd-aa542884-692ecca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:15.003806Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:15.003823Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1128
2025-09-30T14:53:15.004021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1128 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:15.004050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1128 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:15.004055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1128 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:15.004059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:15.004854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1128 sessionId:  describe result for acl check
2025-09-30T14:53:15.004883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:15.004885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:15.004899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:15.004906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895426226375309:4039] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:15.005447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895426226375309:4039] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:15.007613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895426226375309:4039] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:15.007942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:15.010843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:15.011070Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:15.011080Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:15.011111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895426226375309:4039] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:15.011126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895426226375309:4039] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:15.011130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895426226375309:4039] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:15.011143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1128 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:15.011183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:15.011270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:15.011308Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895426136627001:7257]
2025-09-30T14:53:15.011959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:15.012298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:15.012351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:15.012676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:15.012743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:15.012751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:15.012752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:15.012753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:15.012754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:15.012755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:15.012756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:15.012757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:15.012758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:15.012760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:15.012761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.012762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.012763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.012764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:15.012766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:15.012772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:15.012782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:15.012786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:15.012791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:15.012795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:15.012799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:15.012802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:15.012806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:15.012809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:15.012814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:15.012817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.012821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.012825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.012828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:15.012832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:15.012839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:15.012847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:15.012854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:15.012860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:15.012868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:15.012873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:15.012878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:15.012883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:15.012888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:15.012893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:15.012898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:15.012904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:15.012909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:15.012915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:15.012920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:15.012925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:15.012929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:15.012935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:15.012940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:15.012946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:15.012951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.012956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.012961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.012966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.012971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.012975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.012979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:15.012984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:15.012995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:15.013000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:15.013043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:15.018650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:15.019772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:15.019789Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:15.019792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:15.019795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:15.019802Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1127 [2:7555895426136627001:7257]
2025-09-30T14:53:15.019822Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:15.019836Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:15.019840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:15.019843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:15.019847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:15.019862Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:15.019869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:15.019883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:15.019943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.019954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.019956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.019959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:15.019961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:15.020032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:15.020040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.020055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.020071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.020096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:15.020119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895426226375363:4039], now have 1 active actors on pipe
2025-09-30T14:53:15.020128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895421931407864:2454], now have 1 active actors on pipe
2025-09-30T14:53:15.020134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895426136626996:7257]
2025-09-30T14:53:15.020136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895426136626996:7257]
2025-09-30T14:53:15.020138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895426136626996:7257]
2025-09-30T14:53:15.020151Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:15.020164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:15.020184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:15.020193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:15.020174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1127
2025-09-30T14:53:15.020184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1127
2025-09-30T14:53:15.020232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895426136626996:7257]
2025-09-30T14:53:15.020231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:15.020235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:15.020237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:15.020239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:15.020255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:15.020404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:15.020431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:15.020457Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b90d6dc0-65bad20d-3bd555b9-5e5ef3da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:15.020478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:15.020487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:15.020489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:15.020500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:15.020515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:15.020535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:15.020705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:15.020719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:15.020750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:15.020866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1128 partition: 0 MaxSeqNo: 42 sessionId: src_id|b90d6dc0-65bad20d-3bd555b9-5e5ef3da_0
2025-09-30T14:53:15.021296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|783d2d97-8f216dfd-aa542884-692ecca_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b90d6dc0-65bad20d-3bd555b9-5e5ef3da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:15.024253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b90d6dc0-65bad20d-3bd555b9-5e5ef3da_0] Write session: try to update token
2025-09-30T14:53:15.024276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b90d6dc0-65bad20d-3bd555b9-5e5ef3da_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:15.038142Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:15.038166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:15.038177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895426136626996:7257]
2025-09-30T14:53:15.038223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:15.038230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:15.038406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:15.038584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:15.038743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:15.038897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:15.039411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:15.039464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:15.042869Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1128 sessionId: src_id|b90d6dc0-65bad20d-3bd555b9-5e5ef3da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:15.045878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:15.046192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:15.046221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:15.046262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:15.046373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:15.049846Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:15.049872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:15.049875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:15.049878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:15.049888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895426136626996:7257]
2025-09-30T14:53:15.049893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895426136626996:7257]
2025-09-30T14:53:15.049897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895426136626996:7257]
2025-09-30T14:53:15.049933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:15.049939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.049943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:15.049943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:15.049949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:15.049954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:15.050093Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:15.088080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895426226375382:4239]
2025-09-30T14:53:15.088410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1127, pipe: [1:7555895426226375382:4239]
2025-09-30T14:53:15.162952Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:15.171821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:15.171862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:15.172050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:15.172139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:15.172211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:15.172282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:15.172338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:15.172348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:15.172422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:15.172492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:15.172580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:15.172654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:15.172704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:15.172713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:15.172791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:15.172864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:15.172938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:15.173010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:15.173428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:15.173440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:15.173515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:15.173593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:15.173666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:15.173741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:15.173792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:15.173800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:15.173872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:15.173941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:15.174008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:15.174139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:15.174189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:15.174196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:15.174273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:15.174349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:15.174422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:15.174493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:15.174546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:15.174549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:15.174628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:15.174699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:15.174772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:15.174843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:15.174901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:15.174913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:15.174991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:15.175068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:15.175132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:15.175192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:15.175392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:15.175404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:15.175481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:15.175553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:15.175618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:15.175685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:15.175811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:15.175820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:15.175903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:15.175970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:15.176514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:15.176531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:15.176532Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:15.176562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1128 reason: error at write: Disconnected sessionId: src_id|b90d6dc0-65bad20d-3bd555b9-5e5ef3da_0
2025-09-30T14:53:15.176576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895426226375382:4239]
2025-09-30T14:53:15.176755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1128 sessionId: src_id|b90d6dc0-65bad20d-3bd555b9-5e5ef3da_0 is DEAD
2025-09-30T14:53:15.176908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b90d6dc0-65bad20d-3bd555b9-5e5ef3da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:15.176929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b90d6dc0-65bad20d-3bd555b9-5e5ef3da_0] Write session will restart in 0.006353s
2025-09-30T14:53:15.176952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b90d6dc0-65bad20d-3bd555b9-5e5ef3da_0] Write session: Do CDS request
2025-09-30T14:53:15.176958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b90d6dc0-65bad20d-3bd555b9-5e5ef3da_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:15.176047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:15.176120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:15.176163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:15.176167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:15.176246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895426226375382:4239], now have 1 active actors on pipe
2025-09-30T14:53:15.177018Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:15.184841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b90d6dc0-65bad20d-3bd555b9-5e5ef3da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:15.185272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:15.185290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1129
2025-09-30T14:53:15.185449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1129 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:15.185491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1129 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:15.185503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1129 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:15.185509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:15.186000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1129 sessionId:  describe result for acl check
2025-09-30T14:53:15.186040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:15.186050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:15.186052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:15.186058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895426226375429:4032] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:15.186620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895426226375429:4032] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:15.189248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895426226375429:4032] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:15.192334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895426226375429:4032] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:15.192349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895426226375429:4032] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:15.192352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895426226375429:4032] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:15.192361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1129 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:15.193836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:15.196329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:15.196543Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:15.196553Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:15.196563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:15.196616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:15.196655Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895426136627226:7261]
2025-09-30T14:53:15.197331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:15.197664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:15.197710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:15.198048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:15.198129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:15.198136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:15.198138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:15.198139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:15.198140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:15.198141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:15.198142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:15.198144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:15.198145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:15.198146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:15.198147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.198148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.198149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.198150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:15.198151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:15.198157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:15.198167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:15.198170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:15.198174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:15.198178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:15.198182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:15.198186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:15.198190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:15.198193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:15.198198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:15.198202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.198206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.198210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.198215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:15.198219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:15.198226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:15.198235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:15.198241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:15.198247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:15.198252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:15.198256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:15.198261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:15.198266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:15.198271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:15.198276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:15.198280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:15.198286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:15.198291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:15.198297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:15.198302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:15.198307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:15.198312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:15.198318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:15.198321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:15.198327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:15.198334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.198339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.198344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.198349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.198353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.198359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.198364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:15.198375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:15.198380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:15.198386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:15.198434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:15.204014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:15.205045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:15.205061Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:15.205064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:15.205068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:15.205074Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1128 [2:7555895426136627226:7261]
2025-09-30T14:53:15.205092Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:15.205107Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:15.205110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:15.205114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:15.205117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:15.205133Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:15.205140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:15.205148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:15.205209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.205217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.205219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.205223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:15.205226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:15.205292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:15.205299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.205313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.205325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.205341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:15.205359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895426226375399:2454], now have 1 active actors on pipe
2025-09-30T14:53:15.205367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895426226375603:4032], now have 1 active actors on pipe
2025-09-30T14:53:15.205374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895426136627221:7261]
2025-09-30T14:53:15.205377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895426136627221:7261]
2025-09-30T14:53:15.205379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895426136627221:7261]
2025-09-30T14:53:15.205394Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:15.205415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:15.205430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:15.205434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:15.205468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895426136627221:7261]
2025-09-30T14:53:15.205475Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:15.205506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:15.205513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:15.205516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:15.205523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:15.205484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1128
2025-09-30T14:53:15.205496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1128
2025-09-30T14:53:15.205601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:15.205613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:15.205643Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f46b9d7-c588ec16-32477456-35ae1b1e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:15.205649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:15.205653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:15.205655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:15.205665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:15.205675Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:15.205697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:15.205852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:15.205860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:15.205872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:15.206003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1129 partition: 0 MaxSeqNo: 42 sessionId: src_id|3f46b9d7-c588ec16-32477456-35ae1b1e_0
2025-09-30T14:53:15.206395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b90d6dc0-65bad20d-3bd555b9-5e5ef3da_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3f46b9d7-c588ec16-32477456-35ae1b1e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:15.209259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f46b9d7-c588ec16-32477456-35ae1b1e_0] Write session: try to update token
2025-09-30T14:53:15.209281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f46b9d7-c588ec16-32477456-35ae1b1e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:15.217920Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:15.217937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:15.217947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895426136627221:7261]
2025-09-30T14:53:15.217994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:15.217994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:15.218205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:15.218348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:15.218494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:15.218639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:15.218834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:15.218869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:15.225405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1129 sessionId: src_id|3f46b9d7-c588ec16-32477456-35ae1b1e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:15.228321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:15.229616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:15.229635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:15.229655Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:15.229658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:15.229660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:15.229663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:15.229672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895426136627221:7261]
2025-09-30T14:53:15.229676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895426136627221:7261]
2025-09-30T14:53:15.229680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895426136627221:7261]
2025-09-30T14:53:15.229737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:15.229738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:15.229745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:15.229749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:15.229750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.229753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:15.229891Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:15.276489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895426226375618:4239]
2025-09-30T14:53:15.276873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1128, pipe: [1:7555895426226375618:4239]
2025-09-30T14:53:15.345337Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:15.345705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:15.345737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895426226375618:4239], now have 1 active actors on pipe
2025-09-30T14:53:15.345850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:15.345902Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:15.345947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:15.345954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895426226375618:4239]
2025-09-30T14:53:15.345955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:15.346020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1129 reason: error at write: Disconnected sessionId: src_id|3f46b9d7-c588ec16-32477456-35ae1b1e_0
2025-09-30T14:53:15.346196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1129 sessionId: src_id|3f46b9d7-c588ec16-32477456-35ae1b1e_0 is DEAD
2025-09-30T14:53:15.346316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f46b9d7-c588ec16-32477456-35ae1b1e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:15.346334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f46b9d7-c588ec16-32477456-35ae1b1e_0] Write session will restart in 0.008013s
2025-09-30T14:53:15.346357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f46b9d7-c588ec16-32477456-35ae1b1e_0] Write session: Do CDS request
2025-09-30T14:53:15.346362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f46b9d7-c588ec16-32477456-35ae1b1e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:15.355804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f46b9d7-c588ec16-32477456-35ae1b1e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:15.355935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:15.355951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1130
2025-09-30T14:53:15.356105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1130 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:15.356138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1130 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:15.356143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1130 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:15.356147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:15.356647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1130 sessionId:  describe result for acl check
2025-09-30T14:53:15.356693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:15.356700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:15.356706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:15.356712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895426226375700:4028] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:15.357274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895426226375700:4028] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:15.359531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895426226375700:4028] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:15.361506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:15.362234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895426226375700:4028] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:15.362247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895426226375700:4028] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:15.362249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895426226375700:4028] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:15.362257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1130 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:15.364153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:15.364370Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:15.364379Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:15.364390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:15.364442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:15.364498Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895426136627437:7263]
2025-09-30T14:53:15.365164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:15.365461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:15.365500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:15.365825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:15.365883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:15.365889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:15.365891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:15.365892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:15.365894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:15.365895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:15.365896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:15.365898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:15.365899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:15.365900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:15.365901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.365903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.365904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.365905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:15.365906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:15.365911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:15.365922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:15.365926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:15.365930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:15.365935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:15.365939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:15.365943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:15.365947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:15.365951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:15.365956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:15.365960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.365964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.365972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.365977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:15.365982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:15.365989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:15.365999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:15.366007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:15.366011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:15.366017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:15.366026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:15.366031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:15.366036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:15.366041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:15.366046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:15.366050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:15.366060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:15.366070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:15.366079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:15.366084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:15.366093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:15.366103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:15.366119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:15.366125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:15.366132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:15.366142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.366149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.366154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.366165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.366170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.366175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.366179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:15.366185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:15.366190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:15.366195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:15.366240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:15.371726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:15.372594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:15.372609Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:15.372612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:15.372616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:15.372622Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1129 [2:7555895426136627437:7263]
2025-09-30T14:53:15.372640Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:15.372656Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:15.372662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:15.372665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:15.372667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:15.372683Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:15.372690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:15.372701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:15.372760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.372767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.372770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.372773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:15.372776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:15.372851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:15.372858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.372871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.372883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.372901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:15.372923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895426226375619:2454], now have 1 active actors on pipe
2025-09-30T14:53:15.372931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895426226375828:4028], now have 1 active actors on pipe
2025-09-30T14:53:15.372938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895426136627431:7263]
2025-09-30T14:53:15.372941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895426136627431:7263]
2025-09-30T14:53:15.372943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895426136627431:7263]
2025-09-30T14:53:15.372956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:15.372973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:15.372978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:15.372982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:15.372984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:15.372992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:15.372996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:15.373024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895426136627431:7263]
2025-09-30T14:53:15.373011Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1129
2025-09-30T14:53:15.373045Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:15.373047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:15.373035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1129
2025-09-30T14:53:15.373075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:15.373083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:15.373114Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd5f653b-fd669e37-92326ced-41891a47_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:15.373124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:15.373132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:15.373134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:15.373144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:15.373158Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:15.373181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:15.373438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:15.373453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:15.373478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:15.373600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1130 partition: 0 MaxSeqNo: 42 sessionId: src_id|cd5f653b-fd669e37-92326ced-41891a47_0
2025-09-30T14:53:15.374030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f46b9d7-c588ec16-32477456-35ae1b1e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cd5f653b-fd669e37-92326ced-41891a47_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:15.376828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5f653b-fd669e37-92326ced-41891a47_0] Write session: try to update token
2025-09-30T14:53:15.376847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5f653b-fd669e37-92326ced-41891a47_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:15.385194Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:15.385214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:15.385216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:15.385219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:15.385230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895426136627431:7263]
2025-09-30T14:53:15.385234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895426136627431:7263]
2025-09-30T14:53:15.385239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895426136627431:7263]
2025-09-30T14:53:15.385279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:15.385287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.385288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:15.385292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:15.385296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:15.385299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:15.385430Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:15.391861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1130 sessionId: src_id|cd5f653b-fd669e37-92326ced-41891a47_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:15.394787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:15.445958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895426226375840:4239]
2025-09-30T14:53:15.446252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1129, pipe: [1:7555895426226375840:4239]
2025-09-30T14:53:15.504237Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:15.504514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:15.504531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:15.504569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895426226375840:4239], now have 1 active actors on pipe
2025-09-30T14:53:15.504741Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:15.504763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895426226375840:4239]
2025-09-30T14:53:15.504800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:15.504803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:15.504864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1130 reason: error at write: Disconnected sessionId: src_id|cd5f653b-fd669e37-92326ced-41891a47_0
2025-09-30T14:53:15.505047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1130 sessionId: src_id|cd5f653b-fd669e37-92326ced-41891a47_0 is DEAD
2025-09-30T14:53:15.505199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5f653b-fd669e37-92326ced-41891a47_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:15.505211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5f653b-fd669e37-92326ced-41891a47_0] Write session will restart in 0.006161s
2025-09-30T14:53:15.505232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5f653b-fd669e37-92326ced-41891a47_0] Write session: Do CDS request
2025-09-30T14:53:15.505238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5f653b-fd669e37-92326ced-41891a47_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:15.505344Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:15.512804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5f653b-fd669e37-92326ced-41891a47_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:15.512911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:15.512925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1131
2025-09-30T14:53:15.513104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1131 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:15.513142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1131 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:15.513148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1131 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:15.513152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:15.513575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1131 sessionId:  describe result for acl check
2025-09-30T14:53:15.513611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:15.513621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:15.513624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:15.513629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895426226375885:4019] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:15.514203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895426226375885:4019] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:15.517044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895426226375885:4019] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:15.519467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895426226375885:4019] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:15.519484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895426226375885:4019] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:15.519489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895426226375885:4019] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:15.519500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1131 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:15.520347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:15.522987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:15.523176Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:15.523185Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:15.523196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:15.523260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:15.523302Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895426136627649:7265]
2025-09-30T14:53:15.523951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:15.524275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:15.524319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:15.524802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:15.524885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:15.524893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:15.524894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:15.524895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:15.524897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:15.524898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:15.524899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:15.524900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:15.524902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:15.524903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:15.524904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.524905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.524906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.524907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:15.524909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:15.524915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:15.524925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:15.524929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:15.524934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:15.524938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:15.524942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:15.524945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:15.524949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:15.524953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:15.524958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:15.524962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.524967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.524971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.524975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:15.524980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:15.524988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:15.524997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:15.525003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:15.525008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:15.525015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:15.525021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:15.525026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:15.525032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:15.525037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:15.525044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:15.525055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:15.525060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:15.525072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:15.525077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:15.525082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:15.525091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:15.525095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:15.525104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:15.525108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:15.525116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:15.525121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.525129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.525133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.525141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.525145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.525153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.525157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:15.525165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:15.525169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:15.525174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:15.525210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:15.530710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:15.531568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:15.531582Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:15.531585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:15.531589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:15.531597Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1130 [2:7555895426136627649:7265]
2025-09-30T14:53:15.531614Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:15.531628Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:15.531631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:15.531635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:15.531637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:15.531652Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:15.531664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:15.531671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:15.531728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.531735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.531737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.531740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:15.531743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:15.531991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:15.532000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.531965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1130
2025-09-30T14:53:15.532015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.531970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1130
2025-09-30T14:53:15.532034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.532060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:15.532081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895426226375843:2454], now have 1 active actors on pipe
2025-09-30T14:53:15.532090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895426226376050:4019], now have 1 active actors on pipe
2025-09-30T14:53:15.532104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:15.532114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:15.532132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895426136627644:7265]
2025-09-30T14:53:15.532138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895426136627644:7265]
2025-09-30T14:53:15.532140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895426136627644:7265]
2025-09-30T14:53:15.532153Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:15.532171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:15.532173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:15.532176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:15.532178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:15.532190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:15.532193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:15.532207Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b791c539-4f6c5839-f69b19f2-96992e35_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:15.532219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:15.532223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:15.532226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:15.532236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:15.532245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:15.532285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895426136627644:7265]
2025-09-30T14:53:15.532297Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:15.532309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:15.532319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:15.532458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:15.532466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:15.532479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:15.532546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1131 partition: 0 MaxSeqNo: 42 sessionId: src_id|b791c539-4f6c5839-f69b19f2-96992e35_0
2025-09-30T14:53:15.532918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5f653b-fd669e37-92326ced-41891a47_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b791c539-4f6c5839-f69b19f2-96992e35_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:15.535841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b791c539-4f6c5839-f69b19f2-96992e35_0] Write session: try to update token
2025-09-30T14:53:15.535864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b791c539-4f6c5839-f69b19f2-96992e35_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:15.544596Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:15.544626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:15.544640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895426136627644:7265]
2025-09-30T14:53:15.544694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:15.544701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:15.545023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:15.545240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:15.545459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:15.545653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:15.545961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:15.546030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:15.551285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1131 sessionId: src_id|b791c539-4f6c5839-f69b19f2-96992e35_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:15.553999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:15.555263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:15.555284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:15.555304Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:15.555307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:15.555309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:15.555312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:15.555321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895426136627644:7265]
2025-09-30T14:53:15.555326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895426136627644:7265]
2025-09-30T14:53:15.555330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895426136627644:7265]
2025-09-30T14:53:15.555379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:15.555377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:15.555385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:15.555389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:15.555389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.555391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:15.555531Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:15.604638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895426226376064:4239]
2025-09-30T14:53:15.604939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1130, pipe: [1:7555895426226376064:4239]
2025-09-30T14:53:15.667421Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:15.667851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:15.667893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895426226376064:4239], now have 1 active actors on pipe
2025-09-30T14:53:15.668035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:15.668150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:15.668160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:15.668227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1131 reason: error at write: Disconnected sessionId: src_id|b791c539-4f6c5839-f69b19f2-96992e35_0
2025-09-30T14:53:15.668408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1131 sessionId: src_id|b791c539-4f6c5839-f69b19f2-96992e35_0 is DEAD
2025-09-30T14:53:15.668411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895426226376064:4239]
2025-09-30T14:53:15.668428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:15.668599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b791c539-4f6c5839-f69b19f2-96992e35_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:15.668608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b791c539-4f6c5839-f69b19f2-96992e35_0] Write session will restart in 0.006791s
2025-09-30T14:53:15.668632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b791c539-4f6c5839-f69b19f2-96992e35_0] Write session: Do CDS request
2025-09-30T14:53:15.668637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b791c539-4f6c5839-f69b19f2-96992e35_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:15.676750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b791c539-4f6c5839-f69b19f2-96992e35_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:15.677068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:15.677083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1132
2025-09-30T14:53:15.677215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1132 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:15.677246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1132 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:15.677252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1132 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:15.677255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:15.677711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1132 sessionId:  describe result for acl check
2025-09-30T14:53:15.677749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:15.677756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:15.677758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:15.677765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895426226376098:4015] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:15.678321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895426226376098:4015] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:15.681013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895426226376098:4015] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:15.685143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:15.685194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895426226376098:4015] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:15.685212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895426226376098:4015] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:15.685215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895426226376098:4015] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:15.685224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1132 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:15.687700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:15.688020Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:15.688033Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:15.688045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:15.688107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:15.688151Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895426136627864:7268]
2025-09-30T14:53:15.688832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:15.689197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:15.689249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:15.689592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:15.689660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:15.689666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:15.689667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:15.689668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:15.689670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:15.689671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:15.689672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:15.689674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:15.689675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:15.689676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:15.689677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.689679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.689680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.689681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:15.689682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:15.689688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:15.689699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:15.689703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:15.689707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:15.689712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:15.689715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:15.689719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:15.689723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:15.689726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:15.689731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:15.689735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.689739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.689743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.689748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:15.689752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:15.689760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:15.689767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:15.689773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:15.689780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:15.689797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:15.689803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:15.689808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:15.689814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:15.689819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:15.689824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:15.689829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:15.689834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:15.689838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:15.689843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:15.689847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:15.689853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:15.689865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:15.689870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:15.689875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:15.689886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:15.689892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.689898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.689903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.689909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.689918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.689925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.689931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:15.689942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:15.689947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:15.689958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:15.690022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:15.695773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:15.696930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:15.696945Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:15.696947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:15.696952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:15.696961Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1131 [2:7555895426136627864:7268]
2025-09-30T14:53:15.696978Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:15.696994Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:15.697003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:15.697007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:15.697017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:15.697035Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:15.697042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:15.697049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:15.697109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.697117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.697120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.697124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:15.697126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:15.697192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:15.697199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.697213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.697232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.697258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:15.697280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895426226376274:4015], now have 1 active actors on pipe
2025-09-30T14:53:15.697289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895426226376065:2454], now have 1 active actors on pipe
2025-09-30T14:53:15.697295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895426136627858:7268]
2025-09-30T14:53:15.697298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895426136627858:7268]
2025-09-30T14:53:15.697300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895426136627858:7268]
2025-09-30T14:53:15.697313Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:15.697329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:15.697348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:15.697348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:15.697351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:15.697354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:15.697357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:15.697389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895426136627858:7268]
2025-09-30T14:53:15.697398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:15.697399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:15.697358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1131
2025-09-30T14:53:15.697424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:15.697434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:15.697398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1131
2025-09-30T14:53:15.697476Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0d18a05-86f2bfeb-49a6243f-461e88b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:15.697489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:15.697497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:15.697500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:15.697508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:15.697518Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:15.697540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:15.697710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:15.697721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:15.697734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:15.697829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1132 partition: 0 MaxSeqNo: 42 sessionId: src_id|d0d18a05-86f2bfeb-49a6243f-461e88b9_0
2025-09-30T14:53:15.698297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b791c539-4f6c5839-f69b19f2-96992e35_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d0d18a05-86f2bfeb-49a6243f-461e88b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:15.701190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0d18a05-86f2bfeb-49a6243f-461e88b9_0] Write session: try to update token
2025-09-30T14:53:15.701214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0d18a05-86f2bfeb-49a6243f-461e88b9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:15.709776Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:15.709791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:15.709794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:15.709797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:15.709807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895426136627858:7268]
2025-09-30T14:53:15.709812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895426136627858:7268]
2025-09-30T14:53:15.709820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895426136627858:7268]
2025-09-30T14:53:15.709862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:15.709869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.709872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:15.709884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:15.709899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:15.709913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:15.710017Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:15.718410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1132 sessionId: src_id|d0d18a05-86f2bfeb-49a6243f-461e88b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:15.721180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:15.768481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895426226376287:4239]
2025-09-30T14:53:15.768802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1131, pipe: [1:7555895426226376287:4239]
2025-09-30T14:53:15.827685Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:15.828084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:15.828098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:15.828116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895426226376287:4239], now have 1 active actors on pipe
2025-09-30T14:53:15.828314Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:15.828434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:15.828529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1132 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d0d18a05-86f2bfeb-49a6243f-461e88b9_0
2025-09-30T14:53:15.828705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1132 sessionId: src_id|d0d18a05-86f2bfeb-49a6243f-461e88b9_0 is DEAD
2025-09-30T14:53:15.828860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0d18a05-86f2bfeb-49a6243f-461e88b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:15.828870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0d18a05-86f2bfeb-49a6243f-461e88b9_0] Write session will restart in 0.009252s
2025-09-30T14:53:15.828854Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:15.828893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0d18a05-86f2bfeb-49a6243f-461e88b9_0] Write session: Do CDS request
2025-09-30T14:53:15.828900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0d18a05-86f2bfeb-49a6243f-461e88b9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:15.828901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895426226376287:4239]
2025-09-30T14:53:15.839726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0d18a05-86f2bfeb-49a6243f-461e88b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:15.839805Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:15.839821Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1133
2025-09-30T14:53:15.839955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1133 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:15.839986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1133 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:15.840008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1133 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:15.840018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:15.840429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1133 sessionId:  describe result for acl check
2025-09-30T14:53:15.840462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:15.840464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:15.840466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:15.840473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895426226376314:4002] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:15.840966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895426226376314:4002] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:15.843504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895426226376314:4002] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:15.846984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895426226376314:4002] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:15.847000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895426226376314:4002] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:15.847003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895426226376314:4002] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:15.847010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1133 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:15.851228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:15.853515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:15.853695Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:15.853707Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:15.853717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:15.853779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:15.853825Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895426136628090:7276]
2025-09-30T14:53:15.854509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:15.854866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:15.854940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:15.855325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:15.855394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:15.855407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:15.855408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:15.855409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:15.855411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:15.855413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:15.855414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:15.855415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:15.855416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:15.855418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:15.855419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.855421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.855422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.855423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:15.855424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:15.855430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:15.855441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:15.855446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:15.855450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:15.855454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:15.855458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:15.855462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:15.855466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:15.855470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:15.855475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:15.855479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.855482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.855486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.855490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:15.855494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:15.855502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:15.855510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:15.855517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:15.855522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:15.855528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:15.855534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:15.855538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:15.855544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:15.855557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:15.855562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:15.855567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:15.855573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:15.855577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:15.855582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:15.855587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:15.855593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:15.855602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:15.855608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:15.855613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:15.855618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:15.855623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.855628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.855633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.855642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.855648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.855654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.855663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:15.855668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:15.855673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:15.855680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:15.855727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:15.861376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:15.862633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:15.862646Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:15.862648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:15.862652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:15.862660Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1132 [2:7555895426136628090:7276]
2025-09-30T14:53:15.862674Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:15.862688Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:15.862691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:15.862694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:15.862696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:15.862711Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:15.862718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:15.862724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:15.862782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.862789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.862791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.862794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:15.862796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:15.862859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:15.862862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.862874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:15.862894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:15.862916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:15.862937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895426136628085:7276]
2025-09-30T14:53:15.862944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895426136628085:7276]
2025-09-30T14:53:15.862946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895426136628085:7276]
2025-09-30T14:53:15.862957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:15.862970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895426226376301:2454], now have 1 active actors on pipe
2025-09-30T14:53:15.862971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:15.862974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:15.862975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:15.862976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895426226376434:4002], now have 1 active actors on pipe
2025-09-30T14:53:15.862983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:15.862999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:15.863001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:15.863034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895426136628085:7276]
2025-09-30T14:53:15.863041Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:15.863044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:15.863113Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1132
2025-09-30T14:53:15.863155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1132
2025-09-30T14:53:15.863903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:15.863914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:15.863939Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0bc3fc8-dbae64a-ec533a8b-4152ad13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:15.863949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:15.863953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:15.863955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:15.863965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:15.863980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:15.863998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:15.864202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:15.864213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:15.864228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:15.864318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1133 partition: 0 MaxSeqNo: 42 sessionId: src_id|c0bc3fc8-dbae64a-ec533a8b-4152ad13_0
2025-09-30T14:53:15.864742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0d18a05-86f2bfeb-49a6243f-461e88b9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c0bc3fc8-dbae64a-ec533a8b-4152ad13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:15.867548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0bc3fc8-dbae64a-ec533a8b-4152ad13_0] Write session: try to update token
2025-09-30T14:53:15.867566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0bc3fc8-dbae64a-ec533a8b-4152ad13_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:15.875514Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:15.875533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:15.875544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895426136628085:7276]
2025-09-30T14:53:15.875593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:15.875594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:15.875817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:15.876003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:15.876187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:15.876372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:15.876634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:15.876683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:15.885121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1133 sessionId: src_id|c0bc3fc8-dbae64a-ec533a8b-4152ad13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:15.886514Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:15.886527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:15.886529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:15.886531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:15.886541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895426136628085:7276]
2025-09-30T14:53:15.886546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895426136628085:7276]
2025-09-30T14:53:15.886550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895426136628085:7276]
2025-09-30T14:53:15.886591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:15.886597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:15.886598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:15.886600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:15.886604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:15.886608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:15.886747Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:15.887957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:15.929298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895426226376533:4239]
2025-09-30T14:53:15.929664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1132, pipe: [1:7555895426226376533:4239]
2025-09-30T14:53:16.002227Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:16.002772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:16.002791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:16.002810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895426226376533:4239], now have 1 active actors on pipe
2025-09-30T14:53:16.003097Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:16.003115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895426226376533:4239]
2025-09-30T14:53:16.003140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:16.003207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1133 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c0bc3fc8-dbae64a-ec533a8b-4152ad13_0
2025-09-30T14:53:16.003070Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:16.003434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1133 sessionId: src_id|c0bc3fc8-dbae64a-ec533a8b-4152ad13_0 is DEAD
2025-09-30T14:53:16.003628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0bc3fc8-dbae64a-ec533a8b-4152ad13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:16.003639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0bc3fc8-dbae64a-ec533a8b-4152ad13_0] Write session will restart in 0.008149s
2025-09-30T14:53:16.003671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0bc3fc8-dbae64a-ec533a8b-4152ad13_0] Write session: Do CDS request
2025-09-30T14:53:16.003677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0bc3fc8-dbae64a-ec533a8b-4152ad13_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:16.012842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0bc3fc8-dbae64a-ec533a8b-4152ad13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:16.012944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:16.012962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1134
2025-09-30T14:53:16.013112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1134 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:16.013156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1134 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:16.013164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1134 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:16.013169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:16.013589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1134 sessionId:  describe result for acl check
2025-09-30T14:53:16.013614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:16.013616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:16.013618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:16.013624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895430521343898:3994] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:16.014208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895430521343898:3994] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:16.016799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895430521343898:3994] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:16.020322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:16.020410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895430521343898:3994] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:16.020425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895430521343898:3994] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:16.020429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895430521343898:3994] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:16.020437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1134 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:16.023122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:16.023333Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:16.023354Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:16.023363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:16.023411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:16.023442Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895430431595623:7284]
2025-09-30T14:53:16.023931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:16.024205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:16.024246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:16.024568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:16.024623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:16.024628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:16.024629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:16.024629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:16.024630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:16.024631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:16.024632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:16.024632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:16.024633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:16.024633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:16.024634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.024635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.024635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.024636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:16.024637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:16.024640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:16.024647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:16.024650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:16.024652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:16.024655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:16.024660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:16.024664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:16.024668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:16.024673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:16.024677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:16.024681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.024684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.024686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.024689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:16.024691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:16.024696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:16.024702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:16.024705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:16.024708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:16.024711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:16.024715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:16.024720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:16.024725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:16.024729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:16.024734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:16.024738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:16.024742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:16.024746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:16.024751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:16.024755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:16.024760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:16.024765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:16.024770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:16.024774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:16.024779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:16.024783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.024789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.024793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.024798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.024802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.024806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.024810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:16.024814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:16.024819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:16.024825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:16.024854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:16.030294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:16.031618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:16.031634Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:16.031638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:16.031642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:16.031648Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1133 [2:7555895430431595623:7284]
2025-09-30T14:53:16.031664Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:16.031680Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:16.031683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:16.031686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:16.031688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:16.031703Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:16.031710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:16.031717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:16.031777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.031787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.031790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.031793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:16.031796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:16.031862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:16.031870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.031884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.031903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.031923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:16.031944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895430521343830:2454], now have 1 active actors on pipe
2025-09-30T14:53:16.031953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895430521344046:3994], now have 1 active actors on pipe
2025-09-30T14:53:16.031959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895430431595617:7284]
2025-09-30T14:53:16.031961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895430431595617:7284]
2025-09-30T14:53:16.031963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895430431595617:7284]
2025-09-30T14:53:16.031975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:16.031988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:16.031992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:16.031996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:16.031998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:16.032006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:16.032010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:16.031996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1133
2025-09-30T14:53:16.032043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895430431595617:7284]
2025-09-30T14:53:16.032051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:16.032053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:16.032004Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1133
2025-09-30T14:53:16.032072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:16.032081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:16.032127Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a98ccb9-7dcb148-260ad2c1-91c70484_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:16.032139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:16.032148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:16.032151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:16.032160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:16.032172Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:16.032193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:16.032342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:16.032350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:16.032367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:16.032486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1134 partition: 0 MaxSeqNo: 42 sessionId: src_id|1a98ccb9-7dcb148-260ad2c1-91c70484_0
2025-09-30T14:53:16.032830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0bc3fc8-dbae64a-ec533a8b-4152ad13_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1a98ccb9-7dcb148-260ad2c1-91c70484_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:16.035474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a98ccb9-7dcb148-260ad2c1-91c70484_0] Write session: try to update token
2025-09-30T14:53:16.035488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a98ccb9-7dcb148-260ad2c1-91c70484_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:16.044258Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:16.044279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:16.044282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:16.044284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:16.044293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895430431595617:7284]
2025-09-30T14:53:16.044298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895430431595617:7284]
2025-09-30T14:53:16.044302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895430431595617:7284]
2025-09-30T14:53:16.044342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:16.044349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.044351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:16.044353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:16.044357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:16.044362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:16.044498Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:16.050760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1134 sessionId: src_id|1a98ccb9-7dcb148-260ad2c1-91c70484_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:16.053693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:16.103323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895430521344065:4239]
2025-09-30T14:53:16.103536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1133, pipe: [1:7555895430521344065:4239]
2025-09-30T14:53:16.163314Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:16.163848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:16.163864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:16.163902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895430521344065:4239], now have 1 active actors on pipe
2025-09-30T14:53:16.164140Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:16.164311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:16.164365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895430521344065:4239]
2025-09-30T14:53:16.164387Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:16.164399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1134 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1a98ccb9-7dcb148-260ad2c1-91c70484_0
2025-09-30T14:53:16.164594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1134 sessionId: src_id|1a98ccb9-7dcb148-260ad2c1-91c70484_0 is DEAD
2025-09-30T14:53:16.164730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a98ccb9-7dcb148-260ad2c1-91c70484_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:16.164740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a98ccb9-7dcb148-260ad2c1-91c70484_0] Write session will restart in 0.009760s
2025-09-30T14:53:16.164762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a98ccb9-7dcb148-260ad2c1-91c70484_0] Write session: Do CDS request
2025-09-30T14:53:16.164768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a98ccb9-7dcb148-260ad2c1-91c70484_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:16.175846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a98ccb9-7dcb148-260ad2c1-91c70484_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:16.175905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:16.175923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1135
2025-09-30T14:53:16.176093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1135 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:16.176135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1135 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:16.176146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1135 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:16.176150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:16.176771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1135 sessionId:  describe result for acl check
2025-09-30T14:53:16.176806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:16.176808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:16.176810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:16.176819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895430521344158:3987] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:16.177378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895430521344158:3987] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:16.180424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895430521344158:3987] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:16.182391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:16.185093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:16.185303Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:16.185313Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:16.185324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:16.185325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895430521344158:3987] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:16.185341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895430521344158:3987] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:16.185345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895430521344158:3987] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:16.185354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1135 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:16.185374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:16.185420Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895430431595852:7288]
2025-09-30T14:53:16.186137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:16.186448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:16.186501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:16.186838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:16.186910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:16.186918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:16.186919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:16.186920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:16.186922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:16.186923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:16.186925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:16.186926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:16.186928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:16.186929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:16.186930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.186931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.186933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.186934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:16.186935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:16.186941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:16.186952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:16.186957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:16.186961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:16.186966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:16.186970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:16.186975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:16.186979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:16.186983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:16.186990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:16.186994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.186998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.187002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.187006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:16.187011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:16.187019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:16.187027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:16.187034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:16.187040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:16.187047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:16.187053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:16.187058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:16.187064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:16.187069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:16.187075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:16.187080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:16.187093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:16.187098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:16.187109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:16.187114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:16.187124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:16.187129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:16.187140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:16.187144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:16.187149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:16.187159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.187164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.187172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.187177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.187182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.187191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.187195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:16.187200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:16.187212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:16.187217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:16.187285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:16.192887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:16.194132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:16.194143Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:16.194146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:16.194150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:16.194157Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1134 [2:7555895430431595852:7288]
2025-09-30T14:53:16.194175Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:16.194190Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:16.194193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:16.194196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:16.194199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:16.194214Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:16.194222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:16.194228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:16.194289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.194299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.194302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.194305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:16.194308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:16.194375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:16.194382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.194396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.194414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.194438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:16.194462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895430521344078:2454], now have 1 active actors on pipe
2025-09-30T14:53:16.194471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895430521344290:3987], now have 1 active actors on pipe
2025-09-30T14:53:16.194477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895430431595846:7288]
2025-09-30T14:53:16.194484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895430431595846:7288]
2025-09-30T14:53:16.194487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895430431595846:7288]
2025-09-30T14:53:16.194501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:16.194519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:16.194541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:16.194548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:16.194549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:16.194554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:16.194556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:16.194539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1134
2025-09-30T14:53:16.194581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895430431595846:7288]
2025-09-30T14:53:16.194590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:16.194554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1134
2025-09-30T14:53:16.194592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:16.194606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:16.194611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:16.194659Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c683881b-54460c30-d7188fda-e82e539a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:16.194673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:16.194677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:16.194679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:16.194688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:16.194698Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:16.194719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:16.194870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:16.194879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:16.194893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:16.194993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1135 partition: 0 MaxSeqNo: 42 sessionId: src_id|c683881b-54460c30-d7188fda-e82e539a_0
2025-09-30T14:53:16.195394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a98ccb9-7dcb148-260ad2c1-91c70484_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c683881b-54460c30-d7188fda-e82e539a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:16.198224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c683881b-54460c30-d7188fda-e82e539a_0] Write session: try to update token
2025-09-30T14:53:16.198241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c683881b-54460c30-d7188fda-e82e539a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:16.207574Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:16.207600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:16.207604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:16.207606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:16.207618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895430431595846:7288]
2025-09-30T14:53:16.207626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895430431595846:7288]
2025-09-30T14:53:16.207633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895430431595846:7288]
2025-09-30T14:53:16.207685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:16.207687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:16.207694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:16.207698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.207699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:16.207701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:16.207858Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:16.213484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1135 sessionId: src_id|c683881b-54460c30-d7188fda-e82e539a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:16.216348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:16.264652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895430521344302:4239]
2025-09-30T14:53:16.264993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1134, pipe: [1:7555895430521344302:4239]
2025-09-30T14:53:16.321052Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:16.321572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:16.321594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:16.321638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895430521344302:4239], now have 1 active actors on pipe
2025-09-30T14:53:16.321844Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:16.321858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895430521344302:4239]
2025-09-30T14:53:16.321886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:16.321889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:16.321956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1135 reason: error at write: Disconnected sessionId: src_id|c683881b-54460c30-d7188fda-e82e539a_0
2025-09-30T14:53:16.321843Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:16.322192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1135 sessionId: src_id|c683881b-54460c30-d7188fda-e82e539a_0 is DEAD
2025-09-30T14:53:16.322388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c683881b-54460c30-d7188fda-e82e539a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:16.322406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c683881b-54460c30-d7188fda-e82e539a_0] Write session will restart in 0.005573s
2025-09-30T14:53:16.322428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c683881b-54460c30-d7188fda-e82e539a_0] Write session: Do CDS request
2025-09-30T14:53:16.322436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c683881b-54460c30-d7188fda-e82e539a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:16.328854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c683881b-54460c30-d7188fda-e82e539a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:16.328905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:16.328923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1136
2025-09-30T14:53:16.329106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1136 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:16.329139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1136 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:16.329150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1136 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:16.329155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:16.329604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1136 sessionId:  describe result for acl check
2025-09-30T14:53:16.329641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:16.329643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:16.329644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:16.329653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895430521344318:3978] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:16.330227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895430521344318:3978] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:16.333809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895430521344318:3978] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:16.337222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895430521344318:3978] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:16.337238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895430521344318:3978] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:16.337241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895430521344318:3978] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:16.337250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1136 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:16.338485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:16.341038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:16.341333Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:16.341343Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:16.341354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:16.341412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:16.341458Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895430431596070:7290]
2025-09-30T14:53:16.342153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:16.342597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:16.342650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:16.342999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:16.343324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:16.343331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:16.343333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:16.343334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:16.343335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:16.343337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:16.343338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:16.343339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:16.343341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:16.343342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:16.343344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.343345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.343346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.343348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:16.343349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:16.343356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:16.343368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:16.343372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:16.343377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:16.343381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:16.343385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:16.343390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:16.343395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:16.343399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:16.343404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:16.343408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.343412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.343415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.343419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:16.343422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:16.343434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:16.343442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:16.343448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:16.343454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:16.343459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:16.343464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:16.343468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:16.343479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:16.343484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:16.343489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:16.343493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:16.343500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:16.343505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:16.343510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:16.343514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:16.343519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:16.343523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:16.343528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:16.343532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:16.343537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:16.343547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.343552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.343557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.343563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.343568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.343574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.343578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:16.343583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:16.343590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:16.343600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:16.343646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:16.349413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:16.350334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:16.350354Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:16.350358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:16.350363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:16.350369Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1135 [2:7555895430431596070:7290]
2025-09-30T14:53:16.350387Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:16.350407Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:16.350416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:16.350420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:16.350422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:16.350439Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:16.350463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:16.350474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:16.350540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.350549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.350551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.350555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:16.350557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:16.350633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:16.350642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.350657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.350671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.350695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:16.350720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895430521344303:2454], now have 1 active actors on pipe
2025-09-30T14:53:16.350734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895430431596065:7290]
2025-09-30T14:53:16.350737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895430431596065:7290]
2025-09-30T14:53:16.350739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895430431596065:7290]
2025-09-30T14:53:16.350755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:16.350765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895430521344514:3978], now have 1 active actors on pipe
2025-09-30T14:53:16.350774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:16.350778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:16.350778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:16.350781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:16.350795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:16.350800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:16.350822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1135
2025-09-30T14:53:16.350836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1135
2025-09-30T14:53:16.350836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895430431596065:7290]
2025-09-30T14:53:16.350849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:16.350858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:16.350876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:16.350881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:16.350920Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c7b25e0-57c641dc-6146932f-27c399a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:16.350934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:16.350938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:16.350940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:16.350950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:16.350961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:16.350985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:16.351150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:16.351159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:16.351177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:16.351265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1136 partition: 0 MaxSeqNo: 42 sessionId: src_id|2c7b25e0-57c641dc-6146932f-27c399a0_0
2025-09-30T14:53:16.351650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c683881b-54460c30-d7188fda-e82e539a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2c7b25e0-57c641dc-6146932f-27c399a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:16.354543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7b25e0-57c641dc-6146932f-27c399a0_0] Write session: try to update token
2025-09-30T14:53:16.354563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7b25e0-57c641dc-6146932f-27c399a0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:16.363822Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:16.363843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:16.363845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:16.363847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:16.363857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895430431596065:7290]
2025-09-30T14:53:16.363861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895430431596065:7290]
2025-09-30T14:53:16.363865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895430431596065:7290]
2025-09-30T14:53:16.363910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:16.363917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.363919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:16.363935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:16.363958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:16.363966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:16.364064Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:16.370046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1136 sessionId: src_id|2c7b25e0-57c641dc-6146932f-27c399a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:16.372971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:16.421835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895430521344529:4239]
2025-09-30T14:53:16.422085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1135, pipe: [1:7555895430521344529:4239]
2025-09-30T14:53:16.477330Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:16.477743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:16.477761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:16.477800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895430521344529:4239], now have 1 active actors on pipe
2025-09-30T14:53:16.477999Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:16.477992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:16.478014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:16.478018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:16.478051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895430521344529:4239]
2025-09-30T14:53:16.478088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1136 reason: error at write: Disconnected sessionId: src_id|2c7b25e0-57c641dc-6146932f-27c399a0_0
2025-09-30T14:53:16.478300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1136 sessionId: src_id|2c7b25e0-57c641dc-6146932f-27c399a0_0 is DEAD
2025-09-30T14:53:16.478449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7b25e0-57c641dc-6146932f-27c399a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:16.478461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7b25e0-57c641dc-6146932f-27c399a0_0] Write session will restart in 0.007657s
2025-09-30T14:53:16.478482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7b25e0-57c641dc-6146932f-27c399a0_0] Write session: Do CDS request
2025-09-30T14:53:16.478488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7b25e0-57c641dc-6146932f-27c399a0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:16.487722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7b25e0-57c641dc-6146932f-27c399a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:16.487838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:16.487854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1137
2025-09-30T14:53:16.488005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1137 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:16.488051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1137 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:16.488056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1137 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:16.488060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:16.488537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1137 sessionId:  describe result for acl check
2025-09-30T14:53:16.488570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:16.488580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:16.488582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:16.488587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895430521344593:3977] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:16.489126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895430521344593:3977] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:16.491992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895430521344593:3977] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:16.494856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895430521344593:3977] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:16.494872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895430521344593:3977] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:16.494877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895430521344593:3977] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:16.494885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1137 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:16.495080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:16.497645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:16.497870Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:16.497880Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:16.497891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:16.497963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:16.498010Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895430431596287:7292]
2025-09-30T14:53:16.498709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:16.499071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:16.499135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:16.499577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:16.499673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:16.499682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:16.499683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:16.499685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:16.499686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:16.499688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:16.499689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:16.499691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:16.499692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:16.499693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:16.499694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.499695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.499697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.499698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:16.499699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:16.499706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:16.499717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:16.499722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:16.499727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:16.499732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:16.499737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:16.499742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:16.499747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:16.499751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:16.499755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:16.499758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.499762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.499767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.499772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:16.499776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:16.499786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:16.499795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:16.499802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:16.499809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:16.499813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:16.499819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:16.499824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:16.499830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:16.499835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:16.499840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:16.499845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:16.499851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:16.499856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:16.499862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:16.499871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:16.499878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:16.499883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:16.499889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:16.499894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:16.499900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:16.499910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.499920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.499930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.499936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.499946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.499952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.499960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:16.499966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:16.499976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:16.499982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:16.500036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:16.505662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:16.506924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:16.506944Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:16.506946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:16.506950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:16.506959Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1136 [2:7555895430431596287:7292]
2025-09-30T14:53:16.506976Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:16.506992Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:16.507001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:16.507004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:16.507006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:16.507022Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:16.507029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:16.507037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:16.507098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.507106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.507108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.507112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:16.507115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:16.507186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:16.507195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.507211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.507225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.507258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:16.507278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895430521344744:3977], now have 1 active actors on pipe
2025-09-30T14:53:16.507287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895430521344530:2454], now have 1 active actors on pipe
2025-09-30T14:53:16.507293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895430431596281:7292]
2025-09-30T14:53:16.507296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895430431596281:7292]
2025-09-30T14:53:16.507298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895430431596281:7292]
2025-09-30T14:53:16.507314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:16.507329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:16.507331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:16.507333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:16.507335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:16.507346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:16.507350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:16.507388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895430431596281:7292]
2025-09-30T14:53:16.507400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:16.507406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:16.507429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1136
2025-09-30T14:53:16.507435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1136
2025-09-30T14:53:16.507512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:16.507528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:16.507563Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|338a2e7d-78c8baf7-70dc1041-a02169a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:16.507577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:16.507581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:16.507583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:16.507593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:16.507605Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:16.507624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:16.507796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:16.507809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:16.507831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:16.507927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1137 partition: 0 MaxSeqNo: 42 sessionId: src_id|338a2e7d-78c8baf7-70dc1041-a02169a3_0
2025-09-30T14:53:16.508344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7b25e0-57c641dc-6146932f-27c399a0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|338a2e7d-78c8baf7-70dc1041-a02169a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:16.511238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|338a2e7d-78c8baf7-70dc1041-a02169a3_0] Write session: try to update token
2025-09-30T14:53:16.511276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|338a2e7d-78c8baf7-70dc1041-a02169a3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:16.519724Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:16.519743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:16.519746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:16.519749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:16.519759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895430431596281:7292]
2025-09-30T14:53:16.519764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895430431596281:7292]
2025-09-30T14:53:16.519768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895430431596281:7292]
2025-09-30T14:53:16.519810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:16.519817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.519820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:16.519824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:16.519831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:16.519836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:16.519960Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:16.527050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1137 sessionId: src_id|338a2e7d-78c8baf7-70dc1041-a02169a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:16.529909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:16.577989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895430521344759:4239]
2025-09-30T14:53:16.578220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1136, pipe: [1:7555895430521344759:4239]
2025-09-30T14:53:16.635600Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:16.636087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:16.636102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:16.636122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895430521344759:4239], now have 1 active actors on pipe
2025-09-30T14:53:16.636335Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:16.636383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895430521344759:4239]
2025-09-30T14:53:16.636390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:16.636394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:16.636410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:16.636472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1137 reason: error at write: Disconnected sessionId: src_id|338a2e7d-78c8baf7-70dc1041-a02169a3_0
2025-09-30T14:53:16.636670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1137 sessionId: src_id|338a2e7d-78c8baf7-70dc1041-a02169a3_0 is DEAD
2025-09-30T14:53:16.636805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|338a2e7d-78c8baf7-70dc1041-a02169a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:16.636814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|338a2e7d-78c8baf7-70dc1041-a02169a3_0] Write session will restart in 0.006808s
2025-09-30T14:53:16.636837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|338a2e7d-78c8baf7-70dc1041-a02169a3_0] Write session: Do CDS request
2025-09-30T14:53:16.636845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|338a2e7d-78c8baf7-70dc1041-a02169a3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:16.644757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|338a2e7d-78c8baf7-70dc1041-a02169a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:16.644830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:16.644864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1138
2025-09-30T14:53:16.644991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1138 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:16.645022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1138 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:16.645031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1138 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:16.645044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:16.645475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1138 sessionId:  describe result for acl check
2025-09-30T14:53:16.645504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:16.645511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:16.645513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:16.645518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895430521344818:3971] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:16.646045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895430521344818:3971] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:16.648206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895430521344818:3971] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:16.650859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895430521344818:3971] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:16.650872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895430521344818:3971] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:16.650875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895430521344818:3971] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:16.650886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1138 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:16.651454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:16.653564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:16.653816Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:16.653828Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:16.653840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:16.653900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:16.653938Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895430431596507:7295]
2025-09-30T14:53:16.654613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:16.654923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:16.654976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:16.655292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:16.655345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:16.655349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:16.655350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:16.655351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:16.655352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:16.655352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:16.655353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:16.655354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:16.655355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:16.655356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:16.655357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.655357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.655358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.655359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:16.655360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:16.655364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:16.655370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:16.655373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:16.655375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:16.655378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:16.655380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:16.655382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:16.655385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:16.655387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:16.655389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:16.655392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.655394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.655396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.655398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:16.655400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:16.655406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:16.655411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:16.655415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:16.655418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:16.655421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:16.655424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:16.655426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:16.655429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:16.655432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:16.655435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:16.655438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:16.655441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:16.655443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:16.655446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:16.655449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:16.655452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:16.655456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:16.655459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:16.655463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:16.655466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:16.655468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.655471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.655473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.655476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.655478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.655481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.655484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:16.655486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:16.655489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:16.655492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:16.655514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:16.660814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:16.661860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:16.661879Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:16.661882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:16.661886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:16.661892Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1137 [2:7555895430431596507:7295]
2025-09-30T14:53:16.661907Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:16.661922Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:16.661930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:16.661934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:16.661936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:16.661950Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:16.661962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:16.661973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:16.662037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.662048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.662050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.662054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:16.662056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:16.662139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:16.662147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.662161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.662179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.662204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:16.662227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895430521344761:2454], now have 1 active actors on pipe
2025-09-30T14:53:16.662236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895430521344976:3971], now have 1 active actors on pipe
2025-09-30T14:53:16.662243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895430431596502:7295]
2025-09-30T14:53:16.662246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895430431596502:7295]
2025-09-30T14:53:16.662248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895430431596502:7295]
2025-09-30T14:53:16.662261Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:16.662281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:16.662304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:16.662307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:16.662332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:16.662304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1137
2025-09-30T14:53:16.662336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895430431596502:7295]
2025-09-30T14:53:16.662338Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:16.662341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:16.662314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1137
2025-09-30T14:53:16.662344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:16.662350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:16.662519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:16.662528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:16.662552Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e05afb77-47a21dc8-ae8a2779-4f8217f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:16.662566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:16.662570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:16.662573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:16.662581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:16.662592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:16.662605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:16.662864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:16.662872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:16.662887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:16.662987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1138 partition: 0 MaxSeqNo: 42 sessionId: src_id|e05afb77-47a21dc8-ae8a2779-4f8217f8_0
2025-09-30T14:53:16.663409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|338a2e7d-78c8baf7-70dc1041-a02169a3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e05afb77-47a21dc8-ae8a2779-4f8217f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:16.666120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e05afb77-47a21dc8-ae8a2779-4f8217f8_0] Write session: try to update token
2025-09-30T14:53:16.666137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e05afb77-47a21dc8-ae8a2779-4f8217f8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:16.673838Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:16.673856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:16.673859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:16.673861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:16.673870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895430431596502:7295]
2025-09-30T14:53:16.673875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895430431596502:7295]
2025-09-30T14:53:16.673879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895430431596502:7295]
2025-09-30T14:53:16.673920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:16.673925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.673927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:16.673945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:16.673959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:16.673963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:16.674051Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:16.680261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1138 sessionId: src_id|e05afb77-47a21dc8-ae8a2779-4f8217f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:16.682978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:16.736704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895430521344988:4239]
2025-09-30T14:53:16.736971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1137, pipe: [1:7555895430521344988:4239]
2025-09-30T14:53:16.783827Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:16.784215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:16.784230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:16.784250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895430521344988:4239], now have 1 active actors on pipe
2025-09-30T14:53:16.784466Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:16.784524Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:16.784548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895430521344988:4239]
2025-09-30T14:53:16.784570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:16.784661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1138 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e05afb77-47a21dc8-ae8a2779-4f8217f8_0
2025-09-30T14:53:16.784850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1138 sessionId: src_id|e05afb77-47a21dc8-ae8a2779-4f8217f8_0 is DEAD
2025-09-30T14:53:16.785001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e05afb77-47a21dc8-ae8a2779-4f8217f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:16.785011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e05afb77-47a21dc8-ae8a2779-4f8217f8_0] Write session will restart in 0.008765s
2025-09-30T14:53:16.785036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e05afb77-47a21dc8-ae8a2779-4f8217f8_0] Write session: Do CDS request
2025-09-30T14:53:16.785042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e05afb77-47a21dc8-ae8a2779-4f8217f8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:16.794780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e05afb77-47a21dc8-ae8a2779-4f8217f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:16.794953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:16.794970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1139
2025-09-30T14:53:16.795071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1139 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:16.795103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1139 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:16.795113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1139 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:16.795117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:16.795606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1139 sessionId:  describe result for acl check
2025-09-30T14:53:16.795643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:16.795649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:16.795651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:16.795657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895430521345092:3967] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:16.796211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895430521345092:3967] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:16.798290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895430521345092:3967] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:16.800166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:16.802758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:16.803057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895430521345092:3967] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:16.803073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895430521345092:3967] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:16.803077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895430521345092:3967] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:16.803085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1139 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:16.803098Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:16.803107Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:16.803119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:16.803183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:16.803232Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895430431596725:7297]
2025-09-30T14:53:16.803913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:16.804212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:16.804255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:16.804590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:16.804652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:16.804657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:16.804659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:16.804660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:16.804661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:16.804662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:16.804663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:16.804665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:16.804666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:16.804667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:16.804668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.804669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.804671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.804672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:16.804673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:16.804678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:16.804690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:16.804695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:16.804699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:16.804703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:16.804708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:16.804713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:16.804718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:16.804721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:16.804726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:16.804731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.804736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.804740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.804745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:16.804748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:16.804756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:16.804764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:16.804774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:16.804781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:16.804789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:16.804795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:16.804802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:16.804808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:16.804815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:16.804824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:16.804828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:16.804838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:16.804843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:16.804852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:16.804856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:16.804862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:16.804870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:16.804876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:16.804884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:16.804890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:16.804898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.804904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.804912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.804918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.804927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.804933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.804940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:16.804946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:16.804956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:16.804966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:16.805013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:16.810471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:16.811429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:16.811442Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:16.811444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:16.811448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:16.811455Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1138 [2:7555895430431596725:7297]
2025-09-30T14:53:16.811472Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:16.811487Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:16.811490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:16.811493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:16.811496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:16.811511Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:16.811522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:16.811528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:16.811580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.811586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.811588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.811592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:16.811595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:16.811660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:16.811667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.811682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.811695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.811715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:16.811733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895430521345209:3967], now have 1 active actors on pipe
2025-09-30T14:53:16.811741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895430521344990:2454], now have 1 active actors on pipe
2025-09-30T14:53:16.811748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895430431596720:7297]
2025-09-30T14:53:16.811754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895430431596720:7297]
2025-09-30T14:53:16.811756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895430431596720:7297]
2025-09-30T14:53:16.811767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:16.811780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:16.811796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:16.811801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:16.811804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:16.811806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:16.811808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:16.811835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895430431596720:7297]
2025-09-30T14:53:16.811843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:16.811798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1138
2025-09-30T14:53:16.811846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:16.811862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:16.811803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1138
2025-09-30T14:53:16.811866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:16.811921Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15b9aac8-202c4b89-40dfa959-ef792560_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:16.811931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:16.811934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:16.811936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:16.811946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:16.811959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:16.811977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:16.812124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:16.812133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:16.812147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:16.812320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1139 partition: 0 MaxSeqNo: 42 sessionId: src_id|15b9aac8-202c4b89-40dfa959-ef792560_0
2025-09-30T14:53:16.812696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e05afb77-47a21dc8-ae8a2779-4f8217f8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|15b9aac8-202c4b89-40dfa959-ef792560_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:16.815005Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-09-30T14:53:16.815037Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 6
2025-09-30T14:53:16.815300Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 85826639 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:53:16.815364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15b9aac8-202c4b89-40dfa959-ef792560_0] Write session: try to update token
2025-09-30T14:53:16.815381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15b9aac8-202c4b89-40dfa959-ef792560_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:16.815558Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 6 DataSize: 85826639 UsedReserveSize: 0
2025-09-30T14:53:16.815593Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:53:16.824088Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:16.824110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:16.824113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:16.824115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:16.824128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895430431596720:7297]
2025-09-30T14:53:16.824133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895430431596720:7297]
2025-09-30T14:53:16.824138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895430431596720:7297]
2025-09-30T14:53:16.824188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:16.824202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.824204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:16.824203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:16.824211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:16.824216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:16.824398Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:16.830189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1139 sessionId: src_id|15b9aac8-202c4b89-40dfa959-ef792560_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:16.832901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:16.884670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895430521345236:4239]
2025-09-30T14:53:16.884934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1138, pipe: [1:7555895430521345236:4239]
2025-09-30T14:53:16.937884Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:16.938337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:16.938353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:16.938402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895430521345236:4239], now have 1 active actors on pipe
2025-09-30T14:53:16.938637Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:16.938667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:16.938696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:16.938753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1139 reason: error at write: Disconnected sessionId: src_id|15b9aac8-202c4b89-40dfa959-ef792560_0
2025-09-30T14:53:16.938930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1139 sessionId: src_id|15b9aac8-202c4b89-40dfa959-ef792560_0 is DEAD
2025-09-30T14:53:16.939075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15b9aac8-202c4b89-40dfa959-ef792560_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:16.939087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15b9aac8-202c4b89-40dfa959-ef792560_0] Write session will restart in 0.006906s
2025-09-30T14:53:16.939082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:16.939109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15b9aac8-202c4b89-40dfa959-ef792560_0] Write session: Do CDS request
2025-09-30T14:53:16.939116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15b9aac8-202c4b89-40dfa959-ef792560_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:16.939267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895430521345236:4239]
2025-09-30T14:53:16.946703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15b9aac8-202c4b89-40dfa959-ef792560_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:16.946837Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:16.946864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1140
2025-09-30T14:53:16.946990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1140 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:16.947033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1140 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:16.947043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1140 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:16.947046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:16.947530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1140 sessionId:  describe result for acl check
2025-09-30T14:53:16.947560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:16.947565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:16.947566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:16.947571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895430521345290:3945] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:16.948079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895430521345290:3945] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:16.950583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895430521345290:3945] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:16.954590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895430521345290:3945] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:16.954608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895430521345290:3945] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:16.954612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895430521345290:3945] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:16.954620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1140 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:16.955814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:16.958018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:16.958228Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:16.958238Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:16.958249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:16.958301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:16.958430Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895430431596984:7312]
2025-09-30T14:53:16.959053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:16.959400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:16.959466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:16.959820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:16.959880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:16.959886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:16.959887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:16.959888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:16.959890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:16.959893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:16.959894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:16.959895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:16.959896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:16.959897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:16.959898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.959899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.959900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.959902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:16.959903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:16.959908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:16.959919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:16.959923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:16.959927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:16.959931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:16.959935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:16.959940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:16.959948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:16.959952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:16.959956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:16.959964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.959969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.959977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.959981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:16.959989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:16.959997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:16.960010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:16.960020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:16.960025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:16.960030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:16.960036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:16.960042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:16.960047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:16.960056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:16.960061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:16.960067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:16.960077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:16.960085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:16.960094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:16.960104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:16.960113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:16.960121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:16.960127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:16.960135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:16.960141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:16.960159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.960168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.960176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.960181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.960190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.960195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.960203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:16.960209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:16.960218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:16.960227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:16.960274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:16.965455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:16.966592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:16.966607Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:16.966609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:16.966613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:16.966622Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1139 [2:7555895430431596984:7312]
2025-09-30T14:53:16.966640Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:16.966661Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:16.966664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:16.966667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:16.966669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:16.966685Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:16.966697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:16.966708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:16.966758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.966764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.966765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.966768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:16.966770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:16.966831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:16.966839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.966851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:16.966867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:16.966886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:16.966912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895430521345249:2454], now have 1 active actors on pipe
2025-09-30T14:53:16.966915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895430521345463:3945], now have 1 active actors on pipe
2025-09-30T14:53:16.966921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895430431596979:7312]
2025-09-30T14:53:16.966923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895430431596979:7312]
2025-09-30T14:53:16.966925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895430431596979:7312]
2025-09-30T14:53:16.966945Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:16.966959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:16.966960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:16.966963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:16.966965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:16.966978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:16.966981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:16.966972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1139
2025-09-30T14:53:16.966990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1139
2025-09-30T14:53:16.967012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895430431596979:7312]
2025-09-30T14:53:16.967024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:16.967029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:16.967039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:16.967048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:16.967093Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c67543ce-3c22d490-88662b11-ec68bf8d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:16.967104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:16.967107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:16.967109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:16.967115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:16.967124Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:16.967141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:16.967331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:16.967339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:16.967352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:16.967433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1140 partition: 0 MaxSeqNo: 42 sessionId: src_id|c67543ce-3c22d490-88662b11-ec68bf8d_0
2025-09-30T14:53:16.967831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15b9aac8-202c4b89-40dfa959-ef792560_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c67543ce-3c22d490-88662b11-ec68bf8d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:16.970687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c67543ce-3c22d490-88662b11-ec68bf8d_0] Write session: try to update token
2025-09-30T14:53:16.970708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c67543ce-3c22d490-88662b11-ec68bf8d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:16.979303Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:16.979322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:16.979325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:16.979327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:16.979336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895430431596979:7312]
2025-09-30T14:53:16.979342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895430431596979:7312]
2025-09-30T14:53:16.979347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895430431596979:7312]
2025-09-30T14:53:16.979386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:16.979396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:16.979399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:16.979401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:16.979423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:16.979428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:16.979535Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:16.985347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1140 sessionId: src_id|c67543ce-3c22d490-88662b11-ec68bf8d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:16.988173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:17.039305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895434816312779:4239]
2025-09-30T14:53:17.039631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1139, pipe: [1:7555895434816312779:4239]
2025-09-30T14:53:17.085917Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:17.086187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:17.086203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:17.086239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895434816312779:4239], now have 1 active actors on pipe
2025-09-30T14:53:17.086431Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:17.086490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:17.086501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:17.086506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:17.086540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895434816312779:4239]
2025-09-30T14:53:17.086582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1140 reason: error at write: Disconnected sessionId: src_id|c67543ce-3c22d490-88662b11-ec68bf8d_0
2025-09-30T14:53:17.086823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1140 sessionId: src_id|c67543ce-3c22d490-88662b11-ec68bf8d_0 is DEAD
2025-09-30T14:53:17.086968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c67543ce-3c22d490-88662b11-ec68bf8d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:17.086980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c67543ce-3c22d490-88662b11-ec68bf8d_0] Write session will restart in 0.008113s
2025-09-30T14:53:17.087005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c67543ce-3c22d490-88662b11-ec68bf8d_0] Write session: Do CDS request
2025-09-30T14:53:17.087012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c67543ce-3c22d490-88662b11-ec68bf8d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:17.096809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c67543ce-3c22d490-88662b11-ec68bf8d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:17.096987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:17.097004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1141
2025-09-30T14:53:17.097102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1141 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:17.097135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1141 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:17.097140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1141 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:17.097143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:17.097514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1141 sessionId:  describe result for acl check
2025-09-30T14:53:17.097547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:17.097549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:17.097551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:17.097557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895434816312885:3940] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:17.098025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895434816312885:3940] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:17.100311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895434816312885:3940] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:17.101827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:17.104613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:17.104725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895434816312885:3940] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:17.104740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895434816312885:3940] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:17.104744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895434816312885:3940] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:17.104753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1141 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:17.104803Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:17.104813Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:17.104823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:17.104872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:17.104911Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895434726564513:7314]
2025-09-30T14:53:17.105603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:17.105863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:17.105906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:17.106239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:17.106304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:17.106311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:17.106312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:17.106313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:17.106314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:17.106316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:17.106317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:17.106318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:17.106319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:17.106320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:17.106321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.106322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.106324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.106325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:17.106326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:17.106332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:17.106348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:17.106353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:17.106356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:17.106360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:17.106365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:17.106370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:17.106374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:17.106378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:17.106383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:17.106386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.106389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.106393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.106399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:17.106403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:17.106409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:17.106417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:17.106423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:17.106428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:17.106433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:17.106438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:17.106442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:17.106447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:17.106455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:17.106460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:17.106465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:17.106475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:17.106481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:17.106486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:17.106491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:17.106496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:17.106503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:17.106508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:17.106518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:17.106523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:17.106528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.106533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.106538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.106545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.106550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.106555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.106559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:17.106566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:17.106572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:17.106577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:17.106627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:17.111999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:17.112882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:17.112897Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:17.112900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:17.112904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:17.112911Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1140 [2:7555895434726564513:7314]
2025-09-30T14:53:17.112927Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:17.112949Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:17.112959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:17.112962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:17.112967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:17.112981Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:17.112988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:17.112997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:17.113095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.113102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.113104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.113107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:17.113109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:17.113174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:17.113181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.113195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.113213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.113232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:17.113251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895434816313002:3940], now have 1 active actors on pipe
2025-09-30T14:53:17.113260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895434816312780:2454], now have 1 active actors on pipe
2025-09-30T14:53:17.113266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895434726564496:7314]
2025-09-30T14:53:17.113268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895434726564496:7314]
2025-09-30T14:53:17.113270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895434726564496:7314]
2025-09-30T14:53:17.113285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:17.113302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:17.113312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:17.113316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:17.113319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:17.113323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:17.113325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:17.113351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895434726564496:7314]
2025-09-30T14:53:17.113358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:17.113367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:17.113338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1140
2025-09-30T14:53:17.113347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1140
2025-09-30T14:53:17.113392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:17.113401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:17.113432Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75a1e81a-c57bd5-edc62515-d4778150_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:17.113446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:17.113451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:17.113453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:17.113465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:17.113486Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:17.113504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:17.113644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:17.113656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:17.113682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:17.113807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1141 partition: 0 MaxSeqNo: 42 sessionId: src_id|75a1e81a-c57bd5-edc62515-d4778150_0
2025-09-30T14:53:17.114247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c67543ce-3c22d490-88662b11-ec68bf8d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|75a1e81a-c57bd5-edc62515-d4778150_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:17.117190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75a1e81a-c57bd5-edc62515-d4778150_0] Write session: try to update token
2025-09-30T14:53:17.117211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75a1e81a-c57bd5-edc62515-d4778150_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:17.131806Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:17.131826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:17.131835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895434726564496:7314]
2025-09-30T14:53:17.131890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:17.131912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:17.132056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:17.132199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:17.132347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:17.132492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:17.132879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:17.132924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:17.133234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1141 sessionId: src_id|75a1e81a-c57bd5-edc62515-d4778150_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:17.136051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:17.137055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:17.137079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:17.137099Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:17.137102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:17.137105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:17.137107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:17.137115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895434726564496:7314]
2025-09-30T14:53:17.137121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895434726564496:7314]
2025-09-30T14:53:17.137125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895434726564496:7314]
2025-09-30T14:53:17.137169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:17.137177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:17.137179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.137182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:17.137183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:17.137186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:17.137314Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:17.186766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895434816313026:4239]
2025-09-30T14:53:17.187117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1140, pipe: [1:7555895434816313026:4239]
2025-09-30T14:53:17.250821Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:17.251178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:17.251216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895434816313026:4239], now have 1 active actors on pipe
2025-09-30T14:53:17.251329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:17.251369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:17.251412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895434816313026:4239]
2025-09-30T14:53:17.251424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:17.251427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:17.251505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1141 reason: error at write: Disconnected sessionId: src_id|75a1e81a-c57bd5-edc62515-d4778150_0
2025-09-30T14:53:17.251672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1141 sessionId: src_id|75a1e81a-c57bd5-edc62515-d4778150_0 is DEAD
2025-09-30T14:53:17.251825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75a1e81a-c57bd5-edc62515-d4778150_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:17.251836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75a1e81a-c57bd5-edc62515-d4778150_0] Write session will restart in 0.007583s
2025-09-30T14:53:17.251859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75a1e81a-c57bd5-edc62515-d4778150_0] Write session: Do CDS request
2025-09-30T14:53:17.251865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75a1e81a-c57bd5-edc62515-d4778150_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:17.260843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75a1e81a-c57bd5-edc62515-d4778150_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:17.260935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:17.260962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1142
2025-09-30T14:53:17.261097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1142 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:17.261127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1142 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:17.261137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1142 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:17.261141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:17.261543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1142 sessionId:  describe result for acl check
2025-09-30T14:53:17.261574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:17.261583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:17.261584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:17.261590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895434816313051:3935] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:17.262145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895434816313051:3935] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:17.265628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895434816313051:3935] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:17.268925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895434816313051:3935] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:17.268944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895434816313051:3935] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:17.268948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895434816313051:3935] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:17.268957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1142 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:17.272174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:17.274910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:17.275154Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:17.275165Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:17.275178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:17.275278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:17.275326Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895434726564739:7318]
2025-09-30T14:53:17.275995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:17.276381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:17.276436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:17.276784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:17.276862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:17.276869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:17.276871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:17.276872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:17.276874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:17.276875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:17.276877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:17.276878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:17.276880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:17.276882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:17.276883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.276884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.276885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.276887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:17.276888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:17.276894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:17.276906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:17.276910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:17.276914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:17.276919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:17.276923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:17.276927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:17.276931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:17.276941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:17.276946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:17.276950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.276956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.276961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.276965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:17.276974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:17.276984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:17.276997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:17.277008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:17.277019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:17.277028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:17.277037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:17.277046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:17.277054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:17.277067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:17.277078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:17.277087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:17.277098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:17.277107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:17.277118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:17.277128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:17.277138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:17.277148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:17.277157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:17.277166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:17.277174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:17.277178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.277184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.277194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.277200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.277208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.277214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.277219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:17.277230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:17.277238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:17.277244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:17.277293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:17.283040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:17.284232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:17.284249Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:17.284252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:17.284256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:17.284269Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1141 [2:7555895434726564739:7318]
2025-09-30T14:53:17.284287Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:17.284303Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:17.284312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:17.284314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:17.284316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:17.284331Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:17.284342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:17.284349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:17.284418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.284426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.284428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.284432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:17.284435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:17.284502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:17.284513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.284527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.284539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.284555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:17.284571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895434726564734:7318]
2025-09-30T14:53:17.284573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895434726564734:7318]
2025-09-30T14:53:17.284575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895434726564734:7318]
2025-09-30T14:53:17.284586Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:17.284607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:17.284619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:17.284628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:17.284629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:17.284630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:17.284631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:17.284665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895434726564734:7318]
2025-09-30T14:53:17.284676Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:17.284685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895434816313227:3935], now have 1 active actors on pipe
2025-09-30T14:53:17.284693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895434816313027:2454], now have 1 active actors on pipe
2025-09-30T14:53:17.284703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:17.284740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1141
2025-09-30T14:53:17.284744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1141
2025-09-30T14:53:17.284845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:17.284855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:17.284878Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|813be24-701e756a-c8f67a0d-11f428f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:17.284889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:17.284893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:17.284895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:17.284905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:17.284919Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:17.284938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:17.285129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:17.285137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:17.285150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:17.285241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1142 partition: 0 MaxSeqNo: 42 sessionId: src_id|813be24-701e756a-c8f67a0d-11f428f3_0
2025-09-30T14:53:17.285626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75a1e81a-c57bd5-edc62515-d4778150_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|813be24-701e756a-c8f67a0d-11f428f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:17.288503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|813be24-701e756a-c8f67a0d-11f428f3_0] Write session: try to update token
2025-09-30T14:53:17.288525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|813be24-701e756a-c8f67a0d-11f428f3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:17.297246Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:17.297269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:17.297280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895434726564734:7318]
2025-09-30T14:53:17.297331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:17.297355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:17.297517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:17.297677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:17.297819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:17.297968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:17.298184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:17.298224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:17.308217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1142 sessionId: src_id|813be24-701e756a-c8f67a0d-11f428f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:17.308253Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:17.308270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:17.308277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:17.308279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:17.308285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895434726564734:7318]
2025-09-30T14:53:17.308289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895434726564734:7318]
2025-09-30T14:53:17.308292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895434726564734:7318]
2025-09-30T14:53:17.308331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:17.308338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.308340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:17.308484Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:17.308532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:17.308539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:17.308543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:17.311058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:17.351632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895434816313259:4239]
2025-09-30T14:53:17.351915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1141, pipe: [1:7555895434816313259:4239]
2025-09-30T14:53:17.413126Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:17.413532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:17.413549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:17.413567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895434816313259:4239], now have 1 active actors on pipe
2025-09-30T14:53:17.413697Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:17.413783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:17.413787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:17.413792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:17.413829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895434816313259:4239]
2025-09-30T14:53:17.413866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1142 reason: error at write: Disconnected sessionId: src_id|813be24-701e756a-c8f67a0d-11f428f3_0
2025-09-30T14:53:17.414073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1142 sessionId: src_id|813be24-701e756a-c8f67a0d-11f428f3_0 is DEAD
2025-09-30T14:53:17.414240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|813be24-701e756a-c8f67a0d-11f428f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:17.414249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|813be24-701e756a-c8f67a0d-11f428f3_0] Write session will restart in 0.007501s
2025-09-30T14:53:17.414272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|813be24-701e756a-c8f67a0d-11f428f3_0] Write session: Do CDS request
2025-09-30T14:53:17.414277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|813be24-701e756a-c8f67a0d-11f428f3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:17.422810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|813be24-701e756a-c8f67a0d-11f428f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:17.422921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:17.422940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1143
2025-09-30T14:53:17.423097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1143 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:17.423129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1143 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:17.423138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1143 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:17.423142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:17.423697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1143 sessionId:  describe result for acl check
2025-09-30T14:53:17.423740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:17.423748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:17.423751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:17.423757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895434816313328:3931] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:17.424349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895434816313328:3931] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:17.426503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895434816313328:3931] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:17.429239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895434816313328:3931] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:17.429253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895434816313328:3931] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:17.429256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895434816313328:3931] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:17.429264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1143 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:17.429576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:17.431964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:17.432139Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:17.432154Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:17.432165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:17.432220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:17.432251Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895434726564963:7320]
2025-09-30T14:53:17.432702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:17.432971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:17.433001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:17.433224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:17.433265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:17.433270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:17.433271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:17.433271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:17.433272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:17.433273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:17.433273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:17.433274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:17.433275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:17.433275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:17.433277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.433277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.433278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.433279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:17.433279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:17.433283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:17.433290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:17.433292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:17.433294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:17.433297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:17.433299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:17.433301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:17.433304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:17.433306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:17.433308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:17.433311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.433313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.433315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.433317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:17.433320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:17.433326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:17.433331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:17.433335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:17.433338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:17.433341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:17.433344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:17.433346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:17.433350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:17.433353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:17.433356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:17.433359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:17.433362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:17.433365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:17.433368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:17.433370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:17.433375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:17.433377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:17.433380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:17.433383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:17.433386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:17.433388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.433392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.433394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.433397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.433399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.433402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.433405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:17.433408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:17.433410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:17.433413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:17.433435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:17.438522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:17.439544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:17.439557Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:17.439559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:17.439563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:17.439569Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1142 [2:7555895434726564963:7320]
2025-09-30T14:53:17.439585Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:17.439600Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:17.439603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:17.439605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:17.439608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:17.439621Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:17.439631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:17.439638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:17.439691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.439697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.439699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.439703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:17.439705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:17.439756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:17.439765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.439776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.439787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.439804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:17.439827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895434816313260:2454], now have 1 active actors on pipe
2025-09-30T14:53:17.439837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895434816313480:3931], now have 1 active actors on pipe
2025-09-30T14:53:17.439843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895434726564958:7320]
2025-09-30T14:53:17.439846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895434726564958:7320]
2025-09-30T14:53:17.439847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895434726564958:7320]
2025-09-30T14:53:17.439859Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:17.439878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:17.439879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:17.439881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:17.439883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:17.439874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1142
2025-09-30T14:53:17.439893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:17.439889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1142
2025-09-30T14:53:17.439896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:17.439924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895434726564958:7320]
2025-09-30T14:53:17.439931Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:17.439934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:17.439956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:17.439965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:17.440000Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3670e1bf-14821a5e-f50fe30a-daf98fdd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:17.440011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:17.440015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:17.440017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:17.440025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:17.440033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:17.440055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:17.440183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:17.440190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:17.440202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:17.440261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1143 partition: 0 MaxSeqNo: 42 sessionId: src_id|3670e1bf-14821a5e-f50fe30a-daf98fdd_0
2025-09-30T14:53:17.440656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|813be24-701e756a-c8f67a0d-11f428f3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3670e1bf-14821a5e-f50fe30a-daf98fdd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:17.443368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3670e1bf-14821a5e-f50fe30a-daf98fdd_0] Write session: try to update token
2025-09-30T14:53:17.443387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3670e1bf-14821a5e-f50fe30a-daf98fdd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:17.451746Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:17.451766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:17.451769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:17.451771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:17.451780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895434726564958:7320]
2025-09-30T14:53:17.451785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895434726564958:7320]
2025-09-30T14:53:17.451789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895434726564958:7320]
2025-09-30T14:53:17.451829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:17.451836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:17.451840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.451842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:17.451843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:17.451845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:17.451998Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:17.457455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1143 sessionId: src_id|3670e1bf-14821a5e-f50fe30a-daf98fdd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:17.460220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:17.513923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895434816313495:4239]
2025-09-30T14:53:17.514223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1142, pipe: [1:7555895434816313495:4239]
2025-09-30T14:53:17.565322Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:17.565708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:17.565720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:17.565751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895434816313495:4239], now have 1 active actors on pipe
2025-09-30T14:53:17.565968Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:17.565999Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:17.566033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:17.566050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895434816313495:4239]
2025-09-30T14:53:17.566125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1143 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3670e1bf-14821a5e-f50fe30a-daf98fdd_0
2025-09-30T14:53:17.566337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1143 sessionId: src_id|3670e1bf-14821a5e-f50fe30a-daf98fdd_0 is DEAD
2025-09-30T14:53:17.566492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3670e1bf-14821a5e-f50fe30a-daf98fdd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:17.566502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3670e1bf-14821a5e-f50fe30a-daf98fdd_0] Write session will restart in 0.006231s
2025-09-30T14:53:17.566526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3670e1bf-14821a5e-f50fe30a-daf98fdd_0] Write session: Do CDS request
2025-09-30T14:53:17.566532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3670e1bf-14821a5e-f50fe30a-daf98fdd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:17.573766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3670e1bf-14821a5e-f50fe30a-daf98fdd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:17.573877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:17.573909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1144
2025-09-30T14:53:17.574033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1144 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:17.574066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1144 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:17.574077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1144 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:17.574081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:17.574555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1144 sessionId:  describe result for acl check
2025-09-30T14:53:17.574593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:17.574600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:17.574602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:17.574609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895434816313536:3922] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:17.575159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895434816313536:3922] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:17.578086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895434816313536:3922] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:17.580562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895434816313536:3922] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:17.580579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895434816313536:3922] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:17.580583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895434816313536:3922] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:17.580590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1144 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:17.581586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:17.584169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:17.584373Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:17.584384Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:17.584396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:17.584446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:17.584486Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895434726565188:7322]
2025-09-30T14:53:17.585140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:17.585448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:17.585488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:17.585823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:17.585883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:17.585890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:17.585891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:17.585892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:17.585894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:17.585895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:17.585896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:17.585897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:17.585898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:17.585899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:17.585901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.585902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.585903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.585905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:17.585906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:17.585911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:17.585922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:17.585926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:17.585930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:17.585935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:17.585939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:17.585944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:17.585949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:17.585953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:17.585958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:17.585962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.585966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.585970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.585974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:17.585978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:17.585986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:17.585994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:17.586000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:17.586006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:17.586011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:17.586017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:17.586022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:17.586027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:17.586033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:17.586039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:17.586043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:17.586049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:17.586053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:17.586059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:17.586068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:17.586075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:17.586079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:17.586089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:17.586094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:17.586113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:17.586124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.586130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.586137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.586142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.586151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.586157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.586161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:17.586171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:17.586176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:17.586181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:17.586227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:17.591810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:17.592750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:17.592768Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:17.592770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:17.592774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:17.592780Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1143 [2:7555895434726565188:7322]
2025-09-30T14:53:17.592797Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:17.592815Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:17.592823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:17.592826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:17.592829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:17.592847Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:17.592858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:17.592865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:17.593214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.593221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.593223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.593225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:17.593227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:17.593299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:17.593307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.593321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.593336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.593359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:17.593379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895434816313716:3922], now have 1 active actors on pipe
2025-09-30T14:53:17.593389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895434816313496:2454], now have 1 active actors on pipe
2025-09-30T14:53:17.593395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895434726565183:7322]
2025-09-30T14:53:17.593396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895434726565183:7322]
2025-09-30T14:53:17.593398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895434726565183:7322]
2025-09-30T14:53:17.593409Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:17.593429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:17.593430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:17.593433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:17.593445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:17.593446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:17.593449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:17.593482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895434726565183:7322]
2025-09-30T14:53:17.593494Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:17.593484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1143
2025-09-30T14:53:17.593517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:17.593486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1143
2025-09-30T14:53:17.593611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:17.593619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:17.593643Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4e01417-a92a4a29-15766f29-9bf0479e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:17.593658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:17.593666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:17.593669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:17.593679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:17.593692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:17.593709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:17.594192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:17.594203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:17.594221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:17.594329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1144 partition: 0 MaxSeqNo: 42 sessionId: src_id|d4e01417-a92a4a29-15766f29-9bf0479e_0
2025-09-30T14:53:17.594710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3670e1bf-14821a5e-f50fe30a-daf98fdd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d4e01417-a92a4a29-15766f29-9bf0479e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:17.597665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4e01417-a92a4a29-15766f29-9bf0479e_0] Write session: try to update token
2025-09-30T14:53:17.597683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4e01417-a92a4a29-15766f29-9bf0479e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:17.605932Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:17.605952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:17.605955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:17.605958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:17.605968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895434726565183:7322]
2025-09-30T14:53:17.605973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895434726565183:7322]
2025-09-30T14:53:17.605978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895434726565183:7322]
2025-09-30T14:53:17.606017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:17.606024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.606024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:17.606028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:17.606031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:17.606036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:17.606177Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:17.615464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1144 sessionId: src_id|d4e01417-a92a4a29-15766f29-9bf0479e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:17.618209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:17.665997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895434816313730:4239]
2025-09-30T14:53:17.666305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1143, pipe: [1:7555895434816313730:4239]
2025-09-30T14:53:17.718298Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:17.718696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:17.718710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:17.718729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895434816313730:4239], now have 1 active actors on pipe
2025-09-30T14:53:17.718924Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:17.718988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:17.719020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:17.719021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895434816313730:4239]
2025-09-30T14:53:17.719047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:17.719092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1144 reason: error at write: Disconnected sessionId: src_id|d4e01417-a92a4a29-15766f29-9bf0479e_0
2025-09-30T14:53:17.719339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1144 sessionId: src_id|d4e01417-a92a4a29-15766f29-9bf0479e_0 is DEAD
2025-09-30T14:53:17.719469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4e01417-a92a4a29-15766f29-9bf0479e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:17.719481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4e01417-a92a4a29-15766f29-9bf0479e_0] Write session will restart in 0.008550s
2025-09-30T14:53:17.719503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4e01417-a92a4a29-15766f29-9bf0479e_0] Write session: Do CDS request
2025-09-30T14:53:17.719509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4e01417-a92a4a29-15766f29-9bf0479e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:17.728823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4e01417-a92a4a29-15766f29-9bf0479e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:17.728929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:17.728944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1145
2025-09-30T14:53:17.729097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1145 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:17.729141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1145 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:17.729151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1145 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:17.729155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:17.729612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1145 sessionId:  describe result for acl check
2025-09-30T14:53:17.729652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:17.729654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:17.729656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:17.729662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895434816313791:3915] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:17.730241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895434816313791:3915] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:17.732895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895434816313791:3915] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:17.735696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895434816313791:3915] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:17.735712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895434816313791:3915] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:17.735716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895434816313791:3915] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:17.735724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1145 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:17.735946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:17.738136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:17.738333Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:17.738349Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:17.738361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:17.738421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:17.738463Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895434726565414:7325]
2025-09-30T14:53:17.739116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:17.739474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:17.739522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:17.739876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:17.739930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:17.739937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:17.739938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:17.739940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:17.739941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:17.739942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:17.739943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:17.739944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:17.739945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:17.739946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:17.739947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.739948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.739950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.739951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:17.739952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:17.739958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:17.739969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:17.739973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:17.739978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:17.739983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:17.739988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:17.739992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:17.739997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:17.740001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:17.740006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:17.740011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.740015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.740019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.740023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:17.740027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:17.740036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:17.740045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:17.740051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:17.740057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:17.740062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:17.740068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:17.740073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:17.740078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:17.740084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:17.740089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:17.740094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:17.740106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:17.740111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:17.740121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:17.740126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:17.740132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:17.740137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:17.740143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:17.740152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:17.740158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:17.740168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.740173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.740183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.740188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.740194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.740204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.740208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:17.740218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:17.740223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:17.740233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:17.740281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:17.745573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:17.746940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:17.746959Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:17.746962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:17.746966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:17.746972Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1144 [2:7555895434726565414:7325]
2025-09-30T14:53:17.746988Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:17.747002Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:17.747011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:17.747014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:17.747017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:17.747031Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:17.747043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:17.747055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:17.747118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.747126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.747128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.747132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:17.747134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:17.747202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:17.747210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.747223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.747259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.747286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:17.747305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895434816313953:3915], now have 1 active actors on pipe
2025-09-30T14:53:17.747312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895434816313731:2454], now have 1 active actors on pipe
2025-09-30T14:53:17.747320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895434726565408:7325]
2025-09-30T14:53:17.747327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895434726565408:7325]
2025-09-30T14:53:17.747330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895434726565408:7325]
2025-09-30T14:53:17.747343Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:17.747362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:17.747366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:17.747367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:17.747368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:17.747383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:17.747386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:17.747365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1144
2025-09-30T14:53:17.747389Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1144
2025-09-30T14:53:17.747412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895434726565408:7325]
2025-09-30T14:53:17.747421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:17.747423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:17.747436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:17.747443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:17.747491Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2aa2611-4a01afcd-594950cb-d3253026_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:17.747506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:17.747510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:17.747512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:17.747521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:17.747538Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:17.747554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:17.747753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:17.747763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:17.747777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:17.747860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1145 partition: 0 MaxSeqNo: 42 sessionId: src_id|2aa2611-4a01afcd-594950cb-d3253026_0
2025-09-30T14:53:17.748275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4e01417-a92a4a29-15766f29-9bf0479e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2aa2611-4a01afcd-594950cb-d3253026_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:17.751009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2aa2611-4a01afcd-594950cb-d3253026_0] Write session: try to update token
2025-09-30T14:53:17.751026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2aa2611-4a01afcd-594950cb-d3253026_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:17.759707Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:17.759727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:17.759730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:17.759732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:17.759741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895434726565408:7325]
2025-09-30T14:53:17.759745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895434726565408:7325]
2025-09-30T14:53:17.759748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895434726565408:7325]
2025-09-30T14:53:17.759791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:17.759797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.759800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:17.759804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:17.759812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:17.759820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:17.759965Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:17.765358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1145 sessionId: src_id|2aa2611-4a01afcd-594950cb-d3253026_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:17.768111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:17.819069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895434816313970:4239]
2025-09-30T14:53:17.819405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1144, pipe: [1:7555895434816313970:4239]
2025-09-30T14:53:17.875069Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:17.875341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:17.875360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:17.875397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895434816313970:4239], now have 1 active actors on pipe
2025-09-30T14:53:17.875610Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:17.875654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:17.875671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:17.875682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895434816313970:4239]
2025-09-30T14:53:17.875716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:17.875735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1145 reason: error at write: Disconnected sessionId: src_id|2aa2611-4a01afcd-594950cb-d3253026_0
2025-09-30T14:53:17.875909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1145 sessionId: src_id|2aa2611-4a01afcd-594950cb-d3253026_0 is DEAD
2025-09-30T14:53:17.876066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aa2611-4a01afcd-594950cb-d3253026_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:17.876077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aa2611-4a01afcd-594950cb-d3253026_0] Write session will restart in 0.005238s
2025-09-30T14:53:17.876103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aa2611-4a01afcd-594950cb-d3253026_0] Write session: Do CDS request
2025-09-30T14:53:17.876111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aa2611-4a01afcd-594950cb-d3253026_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:17.882745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2aa2611-4a01afcd-594950cb-d3253026_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:17.882938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:17.882961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1146
2025-09-30T14:53:17.883099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1146 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:17.883130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1146 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:17.883150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1146 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:17.883158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:17.883544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1146 sessionId:  describe result for acl check
2025-09-30T14:53:17.883574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:17.883580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:17.883582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:17.883587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895434816313998:3912] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:17.884127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895434816313998:3912] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:17.886600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895434816313998:3912] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:17.889730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895434816313998:3912] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:17.889744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895434816313998:3912] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:17.889748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895434816313998:3912] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:17.889756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1146 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:17.891308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:17.893651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:17.893857Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:17.893867Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:17.893877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:17.893933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:17.893972Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895434726565641:7327]
2025-09-30T14:53:17.894638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:17.894949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:17.894984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:17.895285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:17.895346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:17.895351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:17.895352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:17.895353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:17.895354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:17.895355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:17.895356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:17.895357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:17.895357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:17.895358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:17.895359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.895359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.895360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.895361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:17.895362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:17.895365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:17.895372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:17.895374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:17.895377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:17.895379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:17.895383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:17.895387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:17.895391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:17.895394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:17.895399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:17.895402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.895406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.895410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.895415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:17.895418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:17.895427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:17.895435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:17.895441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:17.895446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:17.895450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:17.895456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:17.895460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:17.895465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:17.895470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:17.895476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:17.895480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:17.895486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:17.895490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:17.895494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:17.895499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:17.895504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:17.895514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:17.895521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:17.895529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:17.895535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:17.895540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.895550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.895554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.895564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.895568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.895574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.895584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:17.895589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:17.895594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:17.895599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:17.895649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:17.900935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:17.902000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:17.902017Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:17.902019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:17.902023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:17.902030Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1145 [2:7555895434726565641:7327]
2025-09-30T14:53:17.902046Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:17.902067Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:17.902074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:17.902077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:17.902079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:17.902095Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:17.902115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:17.902123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:17.902180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.902188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.902190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.902194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:17.902196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:17.902256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:17.902264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.902277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:17.902288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:17.902305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:17.902326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895434726565636:7327]
2025-09-30T14:53:17.902333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895434726565636:7327]
2025-09-30T14:53:17.902334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895434726565636:7327]
2025-09-30T14:53:17.902347Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:17.902361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:17.902363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895434816314192:3912], now have 1 active actors on pipe
2025-09-30T14:53:17.902367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895434816313971:2454], now have 1 active actors on pipe
2025-09-30T14:53:17.902371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:17.902374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:17.902375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:17.902389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:17.902397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:17.902431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895434726565636:7327]
2025-09-30T14:53:17.902446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:17.902471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:17.902485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:17.902447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1145
2025-09-30T14:53:17.902490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:17.902457Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1145
2025-09-30T14:53:17.902521Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e140c0c-2293c234-cf944b50-5f71895d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:17.902532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:17.902537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:17.902547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:17.902556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:17.902568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:17.902586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:17.902728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:17.902735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:17.902747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:17.902869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1146 partition: 0 MaxSeqNo: 42 sessionId: src_id|9e140c0c-2293c234-cf944b50-5f71895d_0
2025-09-30T14:53:17.903296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aa2611-4a01afcd-594950cb-d3253026_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9e140c0c-2293c234-cf944b50-5f71895d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:17.905911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e140c0c-2293c234-cf944b50-5f71895d_0] Write session: try to update token
2025-09-30T14:53:17.905927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e140c0c-2293c234-cf944b50-5f71895d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:17.919826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1146 sessionId: src_id|9e140c0c-2293c234-cf944b50-5f71895d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:17.920428Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:17.920449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:17.920457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895434726565636:7327]
2025-09-30T14:53:17.920507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:17.920508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:17.920685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:17.920832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:17.920974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:17.921123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:17.921366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:17.921412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:17.922476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:17.922652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:17.922671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:17.922700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:17.922783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:17.924905Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:17.924922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:17.924925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:17.924927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:17.924935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895434726565636:7327]
2025-09-30T14:53:17.924938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895434726565636:7327]
2025-09-30T14:53:17.924942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895434726565636:7327]
2025-09-30T14:53:17.924973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:17.924979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:17.924982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:17.924981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:17.924987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:17.924991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:17.925110Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:17.975725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895434816314229:4239]
2025-09-30T14:53:17.976011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1145, pipe: [1:7555895434816314229:4239]
2025-09-30T14:53:18.037708Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:18.045539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:18.045568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:18.045734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:18.045795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:18.045860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:18.045929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:18.046393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:18.046407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:18.046479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:18.046541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:18.046608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:18.046677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:18.046724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:18.046732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:18.046804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:18.046873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:18.046940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:18.047008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:18.047051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:18.047058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:18.047133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:18.047205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:18.047291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:18.047357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:18.047405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:18.047408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:18.047478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:18.047544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:18.047615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:18.047682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:18.047726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:18.047734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:18.047802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:18.047865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:18.047930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:18.047996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:18.048042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:18.048049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:18.048131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:18.048202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:18.048268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:18.048335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:18.048390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:18.048399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:18.048473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:18.048545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:18.048611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:18.048680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:18.048727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:18.048734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:18.048811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:18.048875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:18.048943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:18.049023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:18.049075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:18.049082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:18.049153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:18.049217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:18.049291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:18.049365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:18.049411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:18.049418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:18.049487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895434816314229:4239], now have 1 active actors on pipe
2025-09-30T14:53:18.049767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:18.049782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:18.049784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895434816314229:4239]
2025-09-30T14:53:18.049803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:18.049813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1146 reason: error at write: Disconnected sessionId: src_id|9e140c0c-2293c234-cf944b50-5f71895d_0
2025-09-30T14:53:18.050032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1146 sessionId: src_id|9e140c0c-2293c234-cf944b50-5f71895d_0 is DEAD
2025-09-30T14:53:18.050084Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:18.050222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e140c0c-2293c234-cf944b50-5f71895d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:18.050233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e140c0c-2293c234-cf944b50-5f71895d_0] Write session will restart in 0.005899s
2025-09-30T14:53:18.050256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e140c0c-2293c234-cf944b50-5f71895d_0] Write session: Do CDS request
2025-09-30T14:53:18.050263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e140c0c-2293c234-cf944b50-5f71895d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:18.057812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e140c0c-2293c234-cf944b50-5f71895d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:18.057910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:18.057928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1147
2025-09-30T14:53:18.058046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1147 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:18.058080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1147 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:18.058096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1147 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:18.058112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:18.058555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1147 sessionId:  describe result for acl check
2025-09-30T14:53:18.058590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:18.058596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:18.058598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:18.058604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895439111281564:3879] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:18.059151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895439111281564:3879] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:18.061814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895439111281564:3879] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:18.064985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895439111281564:3879] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:18.064999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895439111281564:3879] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:18.065002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895439111281564:3879] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:18.065010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1147 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:18.067336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:18.069735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:18.069921Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:18.069932Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:18.069942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:18.069989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:18.070030Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895439021533201:7341]
2025-09-30T14:53:18.070735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:18.071002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:18.071043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:18.071397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:18.071454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:18.071460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:18.071461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:18.071462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:18.071464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:18.071465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:18.071467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:18.071468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:18.071469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:18.071470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:18.071472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.071473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.071474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.071475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:18.071476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:18.071482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:18.071493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:18.071497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:18.071502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:18.071507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:18.071512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:18.071516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:18.071520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:18.071525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:18.071530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:18.071535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.071539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.071544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.071548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:18.071553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:18.071560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:18.071569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:18.071575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:18.071581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:18.071586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:18.071597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:18.071602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:18.071608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:18.071616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:18.071621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:18.071630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:18.071636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:18.071642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:18.071653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:18.071657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:18.071662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:18.071669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:18.071677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:18.071681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:18.071693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:18.071699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.071708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.071713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.071722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.071726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.071736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.071741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:18.071748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:18.071757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:18.071763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:18.071811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:18.077086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:18.078076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:18.078091Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:18.078094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:18.078110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:18.078116Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1146 [2:7555895439021533201:7341]
2025-09-30T14:53:18.078133Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:18.078147Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:18.078155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:18.078158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:18.078160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:18.078173Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:18.078186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:18.078197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:18.078254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.078261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.078263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.078267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:18.078269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:18.078322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:18.078329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.078339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.078350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.078367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:18.078387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895439021533196:7341]
2025-09-30T14:53:18.078394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895439021533196:7341]
2025-09-30T14:53:18.078396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895439021533196:7341]
2025-09-30T14:53:18.078404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:18.078415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:18.078418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895439111281744:3879], now have 1 active actors on pipe
2025-09-30T14:53:18.078426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:18.078426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:18.078429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:18.078441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:18.078444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:18.078450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895439111281543:2454], now have 1 active actors on pipe
2025-09-30T14:53:18.078479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895439021533196:7341]
2025-09-30T14:53:18.078487Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:18.078463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1146
2025-09-30T14:53:18.078465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1146
2025-09-30T14:53:18.078504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:18.078524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:18.078533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:18.078556Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|370c34f5-656d54be-f846a34d-ef2f5a12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:18.078567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:18.078571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:18.078573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:18.078581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:18.078591Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:18.078607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:18.078749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:18.078757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:18.078770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:18.078864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1147 partition: 0 MaxSeqNo: 42 sessionId: src_id|370c34f5-656d54be-f846a34d-ef2f5a12_0
2025-09-30T14:53:18.079270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e140c0c-2293c234-cf944b50-5f71895d_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 175 BytesWritten: 94617674 MessagesWritten: 42 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 13516812 MessagesInflight: 10 }
2025-09-30T14:53:18.079309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e140c0c-2293c234-cf944b50-5f71895d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|370c34f5-656d54be-f846a34d-ef2f5a12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:18.082035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|370c34f5-656d54be-f846a34d-ef2f5a12_0] Write session: try to update token
2025-09-30T14:53:18.082055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|370c34f5-656d54be-f846a34d-ef2f5a12_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:18.091039Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:18.091060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:18.091070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895439021533196:7341]
2025-09-30T14:53:18.091116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:18.091124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:18.091327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:18.091485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:18.091637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:18.091790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:18.092002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:18.092043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:18.097609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1147 sessionId: src_id|370c34f5-656d54be-f846a34d-ef2f5a12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:18.100493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:18.100637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:18.100666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:18.101840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:18.101876Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:18.101879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:18.101881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:18.101883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:18.101892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895439021533196:7341]
2025-09-30T14:53:18.101896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895439021533196:7341]
2025-09-30T14:53:18.101900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895439021533196:7341]
2025-09-30T14:53:18.101924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:18.101929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:18.101930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:18.101932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:18.101938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.101941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:18.101970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:18.102075Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:18.149836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895439111281784:4239]
2025-09-30T14:53:18.150118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1146, pipe: [1:7555895439111281784:4239]
2025-09-30T14:53:18.214547Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:18.222762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:18.222789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:18.222973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:18.223041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:18.223107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:18.223171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:18.223223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:18.223233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:18.223326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:18.223395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:18.223479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:18.223551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:18.223598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:18.223605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:18.223692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:18.223758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:18.223825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:18.223897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:18.223945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:18.223953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:18.224026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:18.224087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:18.224151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:18.224216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:18.224261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:18.224268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:18.224341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:18.224405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:18.224470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:18.224536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:18.224593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:18.224604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:18.224679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:18.224743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:18.224815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:18.224884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:18.224934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:18.224941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:18.225009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:18.225074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:18.225143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:18.225211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:18.225257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:18.225264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:18.225331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:18.225400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:18.225465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:18.225528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:18.225575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:18.225584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:18.225655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:18.225719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:18.225789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:18.225866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:18.225914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:18.225921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:18.225987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:18.226054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:18.226131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:18.226198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:18.226244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:18.226254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:18.226333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895439111281784:4239], now have 1 active actors on pipe
2025-09-30T14:53:18.226593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:18.226595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895439111281784:4239]
2025-09-30T14:53:18.226607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:18.226617Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:18.226638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1147 reason: error at write: Disconnected sessionId: src_id|370c34f5-656d54be-f846a34d-ef2f5a12_0
2025-09-30T14:53:18.226847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1147 sessionId: src_id|370c34f5-656d54be-f846a34d-ef2f5a12_0 is DEAD
2025-09-30T14:53:18.226993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|370c34f5-656d54be-f846a34d-ef2f5a12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:18.227000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|370c34f5-656d54be-f846a34d-ef2f5a12_0] Write session will restart in 0.009996s
2025-09-30T14:53:18.227025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|370c34f5-656d54be-f846a34d-ef2f5a12_0] Write session: Do CDS request
2025-09-30T14:53:18.227030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|370c34f5-656d54be-f846a34d-ef2f5a12_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:18.227462Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:18.237795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|370c34f5-656d54be-f846a34d-ef2f5a12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:18.238146Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:18.238172Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1148
2025-09-30T14:53:18.238274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1148 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:18.238306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1148 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:18.238315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1148 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:18.238319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:18.238794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1148 sessionId:  describe result for acl check
2025-09-30T14:53:18.238831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:18.238837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:18.238839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:18.238846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895439111281884:3880] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:18.239417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895439111281884:3880] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:18.241602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895439111281884:3880] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:18.244121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895439111281884:3880] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:18.244132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895439111281884:3880] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:18.244135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895439111281884:3880] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:18.244143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1148 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:18.244438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:18.246989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:18.247167Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:18.247192Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:18.247205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:18.247283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:18.247321Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895439021533446:7345]
2025-09-30T14:53:18.247960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:18.248245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:18.248287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:18.248601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:18.248658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:18.248664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:18.248665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:18.248666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:18.248668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:18.248669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:18.248670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:18.248671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:18.248673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:18.248674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:18.248675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.248676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.248677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.248679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:18.248680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:18.248685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:18.248695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:18.248700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:18.248704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:18.248708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:18.248712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:18.248716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:18.248721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:18.248725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:18.248730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:18.248734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.248738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.248742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.248746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:18.248750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:18.248756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:18.248765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:18.248770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:18.248776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:18.248782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:18.248787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:18.248792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:18.248798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:18.248803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:18.248808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:18.248813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:18.248819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:18.248824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:18.248829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:18.248834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:18.248839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:18.248844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:18.248849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:18.248853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:18.248858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:18.248865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.248875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.248881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.248888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.248898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.248903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.248907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:18.248913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:18.248921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:18.248926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:18.248969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:18.254351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:18.255370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:18.255383Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:18.255386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:18.255390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:18.255395Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1147 [2:7555895439021533446:7345]
2025-09-30T14:53:18.255410Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:18.255424Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:18.255432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:18.255435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:18.255437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:18.255452Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:18.255471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:18.255479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:18.255539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.255546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.255548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.255552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:18.255555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:18.255620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:18.255628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.255640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.255656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.255679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:18.255701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895439111281797:2454], now have 1 active actors on pipe
2025-09-30T14:53:18.255711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895439111282022:3880], now have 1 active actors on pipe
2025-09-30T14:53:18.255718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895439021533439:7345]
2025-09-30T14:53:18.255721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895439021533439:7345]
2025-09-30T14:53:18.255723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895439021533439:7345]
2025-09-30T14:53:18.255736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:18.255753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:18.255756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:18.255760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:18.255762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:18.255771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:18.255774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:18.255763Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1147
2025-09-30T14:53:18.255782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1147
2025-09-30T14:53:18.255801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895439021533439:7345]
2025-09-30T14:53:18.255808Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:18.255811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:18.255825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:18.255834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:18.255882Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2283264c-f13fb2d5-b1e56b37-f465a735_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:18.255894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:18.255903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:18.255905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:18.255916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:18.255932Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:18.255954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:18.256139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:18.256148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:18.256162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:18.256250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1148 partition: 0 MaxSeqNo: 42 sessionId: src_id|2283264c-f13fb2d5-b1e56b37-f465a735_0
2025-09-30T14:53:18.256677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|370c34f5-656d54be-f846a34d-ef2f5a12_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2283264c-f13fb2d5-b1e56b37-f465a735_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:18.259345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2283264c-f13fb2d5-b1e56b37-f465a735_0] Write session: try to update token
2025-09-30T14:53:18.259364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2283264c-f13fb2d5-b1e56b37-f465a735_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:18.268039Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:18.268060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:18.268063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:18.268065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:18.268076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895439021533439:7345]
2025-09-30T14:53:18.268081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895439021533439:7345]
2025-09-30T14:53:18.268086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895439021533439:7345]
2025-09-30T14:53:18.268127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:18.268136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.268136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:18.268140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:18.268143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:18.268146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:18.268290Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:18.275715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1148 sessionId: src_id|2283264c-f13fb2d5-b1e56b37-f465a735_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:18.278420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:18.326982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895439111282036:4239]
2025-09-30T14:53:18.327341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1147, pipe: [1:7555895439111282036:4239]
2025-09-30T14:53:18.378295Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:18.378612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:18.378627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:18.378646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895439111282036:4239], now have 1 active actors on pipe
2025-09-30T14:53:18.378877Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:18.378909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895439111282036:4239]
2025-09-30T14:53:18.378886Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:18.378931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:18.378942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:18.379004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1148 reason: error at write: Disconnected sessionId: src_id|2283264c-f13fb2d5-b1e56b37-f465a735_0
2025-09-30T14:53:18.379187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1148 sessionId: src_id|2283264c-f13fb2d5-b1e56b37-f465a735_0 is DEAD
2025-09-30T14:53:18.379340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2283264c-f13fb2d5-b1e56b37-f465a735_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:18.379350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2283264c-f13fb2d5-b1e56b37-f465a735_0] Write session will restart in 0.009021s
2025-09-30T14:53:18.379374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2283264c-f13fb2d5-b1e56b37-f465a735_0] Write session: Do CDS request
2025-09-30T14:53:18.379382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2283264c-f13fb2d5-b1e56b37-f465a735_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:18.389785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2283264c-f13fb2d5-b1e56b37-f465a735_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:18.389848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:18.389867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1149
2025-09-30T14:53:18.390004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1149 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:18.390046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1149 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:18.390056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1149 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:18.390061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:18.390548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1149 sessionId:  describe result for acl check
2025-09-30T14:53:18.390580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:18.390588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:18.390591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:18.390596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895439111282141:3875] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:18.391108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895439111282141:3875] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:18.392860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895439111282141:3875] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:18.394695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:18.395164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895439111282141:3875] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:18.395180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895439111282141:3875] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:18.395184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895439111282141:3875] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:18.395191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1149 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:18.397223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:18.397390Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:18.397401Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:18.397410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:18.397451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:18.397478Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895439021533674:7347]
2025-09-30T14:53:18.397986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:18.398309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:18.398345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:18.398640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:18.398691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:18.398696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:18.398696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:18.398697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:18.398698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:18.398698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:18.398699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:18.398700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:18.398700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:18.398701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:18.398702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.398702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.398703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.398703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:18.398704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:18.398707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:18.398714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:18.398716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:18.398718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:18.398721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:18.398724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:18.398726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:18.398729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:18.398731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:18.398733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:18.398735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.398738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.398740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.398742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:18.398744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:18.398750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:18.398755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:18.398758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:18.398761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:18.398764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:18.398767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:18.398770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:18.398773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:18.398776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:18.398779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:18.398781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:18.398785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:18.398787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:18.398790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:18.398793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:18.398795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:18.398798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:18.398801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:18.398805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:18.398807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:18.398814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.398817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.398819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.398822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.398824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.398827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.398829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:18.398832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:18.398835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:18.398837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:18.398859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:18.404177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:18.405153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:18.405172Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:18.405175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:18.405179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:18.405186Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1148 [2:7555895439021533674:7347]
2025-09-30T14:53:18.405202Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:18.405215Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:18.405217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:18.405219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:18.405221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:18.405234Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:18.405247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:18.405253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:18.405311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.405316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.405318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.405321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:18.405323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:18.405372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:18.405378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.405390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.405406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.405429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:18.405450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895439021533668:7347]
2025-09-30T14:53:18.405457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895439021533668:7347]
2025-09-30T14:53:18.405459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895439021533668:7347]
2025-09-30T14:53:18.405470Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:18.405483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:18.405488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895439111282037:2454], now have 1 active actors on pipe
2025-09-30T14:53:18.405492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895439111282264:3875], now have 1 active actors on pipe
2025-09-30T14:53:18.405494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:18.405497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:18.405498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:18.405509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:18.405511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:18.405540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895439021533668:7347]
2025-09-30T14:53:18.405548Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:18.405555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:18.405564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1148
2025-09-30T14:53:18.405568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1148
2025-09-30T14:53:18.405707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:18.405719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:18.405745Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61469631-da488d1c-9d80e0f9-326f98a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:18.405756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:18.405760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:18.405762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:18.405772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:18.405786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:18.405799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:18.406007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:18.406025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:18.406050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:18.406165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1149 partition: 0 MaxSeqNo: 42 sessionId: src_id|61469631-da488d1c-9d80e0f9-326f98a6_0
2025-09-30T14:53:18.406552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2283264c-f13fb2d5-b1e56b37-f465a735_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|61469631-da488d1c-9d80e0f9-326f98a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:18.409342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61469631-da488d1c-9d80e0f9-326f98a6_0] Write session: try to update token
2025-09-30T14:53:18.409362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61469631-da488d1c-9d80e0f9-326f98a6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:18.417264Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:18.417284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:18.417294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895439021533668:7347]
2025-09-30T14:53:18.417342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:18.417353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:18.417523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:18.417675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:18.417829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:18.417969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:18.418195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:18.418246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:18.423876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1149 sessionId: src_id|61469631-da488d1c-9d80e0f9-326f98a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:18.426677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:18.427687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:18.427712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:18.427730Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:18.427733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:18.427735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:18.427737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:18.427745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895439021533668:7347]
2025-09-30T14:53:18.427749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895439021533668:7347]
2025-09-30T14:53:18.427752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895439021533668:7347]
2025-09-30T14:53:18.427798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:18.427797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:18.427802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:18.427806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:18.427808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.427810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:18.427954Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:18.479055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895439111282276:4239]
2025-09-30T14:53:18.479357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1148, pipe: [1:7555895439111282276:4239]
2025-09-30T14:53:18.539733Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:18.540281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:18.540320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895439111282276:4239], now have 1 active actors on pipe
2025-09-30T14:53:18.540452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:18.540478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:18.540520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895439111282276:4239]
2025-09-30T14:53:18.540548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:18.540558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:18.540624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1149 reason: error at write: Disconnected sessionId: src_id|61469631-da488d1c-9d80e0f9-326f98a6_0
2025-09-30T14:53:18.540794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1149 sessionId: src_id|61469631-da488d1c-9d80e0f9-326f98a6_0 is DEAD
2025-09-30T14:53:18.541021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61469631-da488d1c-9d80e0f9-326f98a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:18.541032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61469631-da488d1c-9d80e0f9-326f98a6_0] Write session will restart in 0.007876s
2025-09-30T14:53:18.541057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61469631-da488d1c-9d80e0f9-326f98a6_0] Write session: Do CDS request
2025-09-30T14:53:18.541063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61469631-da488d1c-9d80e0f9-326f98a6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:18.549816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61469631-da488d1c-9d80e0f9-326f98a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:18.549954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:18.549968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1150
2025-09-30T14:53:18.550080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1150 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:18.550115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1150 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:18.550123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1150 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:18.550127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:18.550574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1150 sessionId:  describe result for acl check
2025-09-30T14:53:18.550612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:18.550619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:18.550621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:18.550627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895439111282325:3866] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:18.551178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895439111282325:3866] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:18.553865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895439111282325:3866] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:18.556683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895439111282325:3866] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:18.556696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895439111282325:3866] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:18.556699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895439111282325:3866] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:18.556707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1150 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:18.558085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:18.560729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:18.560938Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:18.560950Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:18.560962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:18.561021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:18.561061Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895439021533905:7349]
2025-09-30T14:53:18.561739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:18.562075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:18.562171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:18.562551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:18.562626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:18.562634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:18.562635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:18.562636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:18.562637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:18.562638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:18.562640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:18.562641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:18.562643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:18.562644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:18.562645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.562646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.562648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.562649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:18.562650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:18.562657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:18.562668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:18.562672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:18.562677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:18.562680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:18.562685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:18.562689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:18.562694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:18.562698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:18.562703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:18.562706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.562711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.562715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.562719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:18.562723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:18.562731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:18.562740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:18.562746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:18.562752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:18.562757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:18.562762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:18.562781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:18.562792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:18.562797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:18.562809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:18.562813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:18.562836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:18.562845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:18.562851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:18.562861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:18.562866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:18.562871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:18.562882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:18.562887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:18.562893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:18.562903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.562909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.562919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.562925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.562933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.562940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.562950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:18.562966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:18.562975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:18.562981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:18.563032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:18.568696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:18.569660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:18.569682Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:18.569685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:18.569689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:18.569696Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1149 [2:7555895439021533905:7349]
2025-09-30T14:53:18.569714Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:18.569732Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:18.569735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:18.569738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:18.569741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:18.569758Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:18.569771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:18.569779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:18.569850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.569858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.569860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.569865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:18.569867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:18.570089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1149
2025-09-30T14:53:18.570116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1149
2025-09-30T14:53:18.570318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:18.570330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.570343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.570358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.570384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:18.570410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895439111282503:3866], now have 1 active actors on pipe
2025-09-30T14:53:18.570422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895439111282279:2454], now have 1 active actors on pipe
2025-09-30T14:53:18.570441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:18.570452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:18.570473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895439021533900:7349]
2025-09-30T14:53:18.570480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895439021533900:7349]
2025-09-30T14:53:18.570483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895439021533900:7349]
2025-09-30T14:53:18.570497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:18.570512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:18.570516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:18.570521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:18.570524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:18.570534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:18.570537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:18.570566Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7030d3ff-3540451e-45116e3c-b6918330_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:18.570579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:18.570587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:18.570590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:18.570601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:18.570615Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:18.570659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895439021533900:7349]
2025-09-30T14:53:18.570671Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:18.570675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:18.570685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:18.570850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:18.570860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:18.570876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:18.570967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1150 partition: 0 MaxSeqNo: 42 sessionId: src_id|7030d3ff-3540451e-45116e3c-b6918330_0
2025-09-30T14:53:18.571356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61469631-da488d1c-9d80e0f9-326f98a6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7030d3ff-3540451e-45116e3c-b6918330_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:18.574197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7030d3ff-3540451e-45116e3c-b6918330_0] Write session: try to update token
2025-09-30T14:53:18.574215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7030d3ff-3540451e-45116e3c-b6918330_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:18.582895Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:18.582924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:18.582928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:18.582930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:18.582943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895439021533900:7349]
2025-09-30T14:53:18.582952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895439021533900:7349]
2025-09-30T14:53:18.582960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895439021533900:7349]
2025-09-30T14:53:18.583007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:18.583018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:18.583024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:18.583027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.583028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:18.583030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:18.583175Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:18.589648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1150 sessionId: src_id|7030d3ff-3540451e-45116e3c-b6918330_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:18.592544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:18.640835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895439111282519:4239]
2025-09-30T14:53:18.641409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1149, pipe: [1:7555895439111282519:4239]
2025-09-30T14:53:18.691215Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:18.691697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:18.691713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:18.691728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895439111282519:4239], now have 1 active actors on pipe
2025-09-30T14:53:18.691957Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:18.691954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:18.691958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895439111282519:4239]
2025-09-30T14:53:18.691974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:18.691977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:18.692048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1150 reason: error at write: Disconnected sessionId: src_id|7030d3ff-3540451e-45116e3c-b6918330_0
2025-09-30T14:53:18.692279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1150 sessionId: src_id|7030d3ff-3540451e-45116e3c-b6918330_0 is DEAD
2025-09-30T14:53:18.692446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7030d3ff-3540451e-45116e3c-b6918330_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:18.692458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7030d3ff-3540451e-45116e3c-b6918330_0] Write session will restart in 0.009064s
2025-09-30T14:53:18.692479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7030d3ff-3540451e-45116e3c-b6918330_0] Write session: Do CDS request
2025-09-30T14:53:18.692487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7030d3ff-3540451e-45116e3c-b6918330_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:18.702940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7030d3ff-3540451e-45116e3c-b6918330_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:18.703047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:18.703065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1151
2025-09-30T14:53:18.703194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1151 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:18.703230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1151 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:18.703259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1151 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:18.703264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:18.703680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1151 sessionId:  describe result for acl check
2025-09-30T14:53:18.703715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:18.703722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:18.703724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:18.703729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895439111282606:3862] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:18.704262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895439111282606:3862] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:18.706568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895439111282606:3862] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:18.708608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:18.711151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:18.711315Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:18.711323Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:18.711330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:18.711364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:18.711399Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895439021534138:7352]
2025-09-30T14:53:18.711395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895439111282606:3862] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:18.711414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895439111282606:3862] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:18.711418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895439111282606:3862] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:18.711427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1151 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:18.711867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:18.712104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:18.712131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:18.712413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:18.712475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:18.712480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:18.712480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:18.712481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:18.712482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:18.712483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:18.712483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:18.712484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:18.712485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:18.712486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:18.712486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.712487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.712488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.712488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:18.712489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:18.712492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:18.712499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:18.712501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:18.712503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:18.712506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:18.712508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:18.712510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:18.712513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:18.712515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:18.712518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:18.712520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.712523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.712525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.712527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:18.712530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:18.712534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:18.712539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:18.712543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:18.712546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:18.712549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:18.712552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:18.712555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:18.712557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:18.712560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:18.712563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:18.712566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:18.712569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:18.712572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:18.712574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:18.712577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:18.712580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:18.712583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:18.712586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:18.712588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:18.712591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:18.712594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.712597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.712599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.712602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.712605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.712609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.712611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:18.712614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:18.712617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:18.712619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:18.712643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:18.718202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:18.719545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:18.719558Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:18.719560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:18.719563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:18.719568Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1150 [2:7555895439021534138:7352]
2025-09-30T14:53:18.719581Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:18.719593Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:18.719596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:18.719598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:18.719599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:18.719613Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:18.719625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:18.719632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:18.719699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.719708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.719710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.719714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:18.719717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:18.719783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:18.719792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.719805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.719822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.719845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:18.719867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895439111282520:2454], now have 1 active actors on pipe
2025-09-30T14:53:18.719875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895439111282749:3862], now have 1 active actors on pipe
2025-09-30T14:53:18.719882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895439021534133:7352]
2025-09-30T14:53:18.719885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895439021534133:7352]
2025-09-30T14:53:18.719887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895439021534133:7352]
2025-09-30T14:53:18.719900Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:18.719921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:18.719922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:18.719928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:18.719931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:18.719945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:18.719956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:18.719959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1150
2025-09-30T14:53:18.719974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1150
2025-09-30T14:53:18.719995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895439021534133:7352]
2025-09-30T14:53:18.720003Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:18.720006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:18.720019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:18.720034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:18.720092Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eedcb27b-da4b6766-de71ef2b-cd76f0d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:18.720110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:18.720120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:18.720122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:18.720132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:18.720148Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:18.720173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:18.720337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:18.720344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:18.720357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:18.720429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1151 partition: 0 MaxSeqNo: 42 sessionId: src_id|eedcb27b-da4b6766-de71ef2b-cd76f0d0_0
2025-09-30T14:53:18.720779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7030d3ff-3540451e-45116e3c-b6918330_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|eedcb27b-da4b6766-de71ef2b-cd76f0d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:18.723471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eedcb27b-da4b6766-de71ef2b-cd76f0d0_0] Write session: try to update token
2025-09-30T14:53:18.723490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eedcb27b-da4b6766-de71ef2b-cd76f0d0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:18.732275Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:18.732298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:18.732301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:18.732303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:18.732316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895439021534133:7352]
2025-09-30T14:53:18.732321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895439021534133:7352]
2025-09-30T14:53:18.732325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895439021534133:7352]
2025-09-30T14:53:18.732365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:18.732373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.732376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:18.732390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:18.732420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:18.732429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:18.732527Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:18.738323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1151 sessionId: src_id|eedcb27b-da4b6766-de71ef2b-cd76f0d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:18.740980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:18.792396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895439111282760:4239]
2025-09-30T14:53:18.792689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1150, pipe: [1:7555895439111282760:4239]
2025-09-30T14:53:18.842427Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:18.842903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:18.842919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:18.842959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895439111282760:4239], now have 1 active actors on pipe
2025-09-30T14:53:18.843190Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:18.843179Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:18.843223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895439111282760:4239]
2025-09-30T14:53:18.843258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:18.843265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:18.843327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1151 reason: error at write: Disconnected sessionId: src_id|eedcb27b-da4b6766-de71ef2b-cd76f0d0_0
2025-09-30T14:53:18.843528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1151 sessionId: src_id|eedcb27b-da4b6766-de71ef2b-cd76f0d0_0 is DEAD
2025-09-30T14:53:18.843643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eedcb27b-da4b6766-de71ef2b-cd76f0d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:18.843662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eedcb27b-da4b6766-de71ef2b-cd76f0d0_0] Write session will restart in 0.005281s
2025-09-30T14:53:18.843684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eedcb27b-da4b6766-de71ef2b-cd76f0d0_0] Write session: Do CDS request
2025-09-30T14:53:18.843690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eedcb27b-da4b6766-de71ef2b-cd76f0d0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:18.849816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eedcb27b-da4b6766-de71ef2b-cd76f0d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:18.849921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:18.849936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1152
2025-09-30T14:53:18.850072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1152 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:18.850116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1152 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:18.850127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1152 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:18.850131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:18.850587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1152 sessionId:  describe result for acl check
2025-09-30T14:53:18.850625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:18.850631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:18.850634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:18.850639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895439111282777:3856] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:18.851203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895439111282777:3856] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:18.853504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895439111282777:3856] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:18.856811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895439111282777:3856] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:18.856827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895439111282777:3856] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:18.856831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895439111282777:3856] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:18.856892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1152 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:18.860498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:18.862950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:18.863146Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:18.863154Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:18.863162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:18.863207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:18.863265Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895439021534372:7354]
2025-09-30T14:53:18.863958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:18.864300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:18.864363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:18.864755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:18.864819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:18.864830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:18.864832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:18.864833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:18.864835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:18.864840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:18.864842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:18.864843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:18.864844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:18.864846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:18.864847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.864848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.864849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.864850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:18.864851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:18.864858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:18.864869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:18.864873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:18.864878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:18.864882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:18.864886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:18.864891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:18.864895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:18.864899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:18.864904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:18.864908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.864912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.864916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.864925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:18.864928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:18.864935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:18.864948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:18.864959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:18.864969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:18.864977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:18.864981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:18.864984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:18.864987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:18.864990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:18.864993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:18.864996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:18.864999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:18.865004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:18.865007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:18.865009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:18.865012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:18.865015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:18.865018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:18.865020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:18.865024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:18.865030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.865037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.865040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.865043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.865045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.865048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.865051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:18.865054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:18.865056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:18.865061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:18.865100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:18.870712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:18.872170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:18.872191Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:18.872194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:18.872198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:18.872205Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1151 [2:7555895439021534372:7354]
2025-09-30T14:53:18.872221Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:18.872238Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:18.872241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:18.872244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:18.872245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:18.872263Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:18.872271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:18.872277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:18.872343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.872356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.872358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.872362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:18.872364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:18.872432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:18.872441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.872457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:18.872469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:18.872491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:18.872514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895439111282932:3856], now have 1 active actors on pipe
2025-09-30T14:53:18.872523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895439111282762:2454], now have 1 active actors on pipe
2025-09-30T14:53:18.872529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895439021534367:7354]
2025-09-30T14:53:18.872531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895439021534367:7354]
2025-09-30T14:53:18.872533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895439021534367:7354]
2025-09-30T14:53:18.872547Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:18.872560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:18.872562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:18.872566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:18.872569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:18.872577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:18.872580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:18.872619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895439021534367:7354]
2025-09-30T14:53:18.872628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:18.872607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1151
2025-09-30T14:53:18.872640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:18.872612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1151
2025-09-30T14:53:18.872716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:18.872726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:18.872752Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c5fbcb8-866fe54a-8f576d6d-7a4a0823_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:18.872760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:18.872766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:18.872777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:18.872790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:18.872801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:18.872817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:18.873000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:18.873025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:18.873052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:18.873149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1152 partition: 0 MaxSeqNo: 42 sessionId: src_id|5c5fbcb8-866fe54a-8f576d6d-7a4a0823_0
2025-09-30T14:53:18.873550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eedcb27b-da4b6766-de71ef2b-cd76f0d0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5c5fbcb8-866fe54a-8f576d6d-7a4a0823_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:18.876331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c5fbcb8-866fe54a-8f576d6d-7a4a0823_0] Write session: try to update token
2025-09-30T14:53:18.876349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c5fbcb8-866fe54a-8f576d6d-7a4a0823_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:18.884822Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:18.884839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:18.884849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895439021534367:7354]
2025-09-30T14:53:18.884895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:18.884897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:18.885067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:18.885211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:18.885358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:18.885508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:18.885697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:18.885742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:18.891385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1152 sessionId: src_id|5c5fbcb8-866fe54a-8f576d6d-7a4a0823_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:18.894075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:18.894418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:18.894450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:18.895587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:18.895622Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:18.895625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:18.895627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:18.895629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:18.895639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895439021534367:7354]
2025-09-30T14:53:18.895645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895439021534367:7354]
2025-09-30T14:53:18.895649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895439021534367:7354]
2025-09-30T14:53:18.895674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:18.895681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:18.895687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:18.895689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:18.895690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:18.895693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:18.895705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:18.895818Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:18.943424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895439111283003:4239]
2025-09-30T14:53:18.943696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1151, pipe: [1:7555895439111283003:4239]
2025-09-30T14:53:19.004277Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:19.012740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:19.012768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:19.012929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:19.012993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:19.013053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:19.013115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:19.013483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:19.013492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:19.013556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:19.013617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:19.013674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:19.013735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:19.013776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:19.013782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:19.013845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:19.013901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:19.013961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:19.014020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:19.014061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:19.014066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:19.014143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:19.014201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:19.014261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:19.014325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:19.014366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:19.014371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:19.014442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:19.014505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:19.014564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:19.014631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:19.014682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:19.014690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:19.014762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:19.014822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:19.014883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:19.014941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:19.014998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:19.015004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:19.015066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:19.015123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:19.015185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:19.015270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:19.015312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:19.015317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:19.015379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:19.015433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:19.015505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:19.015572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:19.015617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:19.015623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:19.015683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:19.015741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:19.015800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:19.015856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:19.015973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:19.015978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:19.016040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:19.016096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:19.016154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:19.016210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:19.016343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:19.016369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:19.016435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895439111283003:4239], now have 1 active actors on pipe
2025-09-30T14:53:19.016658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895439111283003:4239]
2025-09-30T14:53:19.016692Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:19.016987Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:19.017066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:19.017117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1152 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5c5fbcb8-866fe54a-8f576d6d-7a4a0823_0
2025-09-30T14:53:19.017331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1152 sessionId: src_id|5c5fbcb8-866fe54a-8f576d6d-7a4a0823_0 is DEAD
2025-09-30T14:53:19.017502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c5fbcb8-866fe54a-8f576d6d-7a4a0823_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:19.017513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c5fbcb8-866fe54a-8f576d6d-7a4a0823_0] Write session will restart in 0.005273s
2025-09-30T14:53:19.017534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c5fbcb8-866fe54a-8f576d6d-7a4a0823_0] Write session: Do CDS request
2025-09-30T14:53:19.017539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c5fbcb8-866fe54a-8f576d6d-7a4a0823_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:19.023793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c5fbcb8-866fe54a-8f576d6d-7a4a0823_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:19.023925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:19.023943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1153
2025-09-30T14:53:19.024120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1153 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:19.024153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1153 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:19.024159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1153 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:19.024162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:19.024733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1153 sessionId:  describe result for acl check
2025-09-30T14:53:19.024771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:19.024779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:19.024780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:19.024786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895443406250361:3842] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:19.025303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895443406250361:3842] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:19.027873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895443406250361:3842] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:19.031371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895443406250361:3842] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:19.031387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895443406250361:3842] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:19.031390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895443406250361:3842] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:19.031399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1153 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:19.032251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:19.034948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:19.035138Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:19.035146Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:19.035154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:19.035193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:19.035484Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895443316501938:7368]
2025-09-30T14:53:19.036006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:19.036293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:19.036326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:19.036568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:19.036618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:19.036622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:19.036623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:19.036624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:19.036625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:19.036626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:19.036627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:19.036627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:19.036628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:19.036629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:19.036630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.036631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.036633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.036634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:19.036636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:19.036641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:19.036651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:19.036655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:19.036660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:19.036664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:19.036668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:19.036672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:19.036676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:19.036680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:19.036686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:19.036690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.036695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.036699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.036702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:19.036705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:19.036710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:19.036716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:19.036720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:19.036723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:19.036726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:19.036731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:19.036736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:19.036741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:19.036747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:19.036753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:19.036758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:19.036764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:19.036769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:19.036774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:19.036778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:19.036784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:19.036788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:19.036794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:19.036799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:19.036805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:19.036809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.036815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.036819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.036824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.036829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.036833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.036835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:19.036838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:19.036840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:19.036843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:19.036867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:19.042516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:19.043448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:19.043469Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:19.043472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:19.043476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:19.043483Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1152 [2:7555895443316501938:7368]
2025-09-30T14:53:19.043499Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:19.043516Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:19.043519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:19.043523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:19.043525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:19.043541Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:19.043555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:19.043568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:19.043656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.043663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.043666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.043669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:19.043672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:19.043909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:19.043900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1152
2025-09-30T14:53:19.043921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.043938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.043907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1152
2025-09-30T14:53:19.043952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.043970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:19.043995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895443406250326:2454], now have 1 active actors on pipe
2025-09-30T14:53:19.044013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895443406250557:3842], now have 1 active actors on pipe
2025-09-30T14:53:19.044040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:19.044049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:19.044065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895443316501933:7368]
2025-09-30T14:53:19.044072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895443316501933:7368]
2025-09-30T14:53:19.044074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895443316501933:7368]
2025-09-30T14:53:19.044091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:19.044110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:19.044121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:19.044129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:19.044133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:19.044133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:19.044135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:19.044150Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d87e1859-a8c92575-20d9795a-5408da81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:19.044164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:19.044170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:19.044177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:19.044186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:19.044201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:19.044235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895443316501933:7368]
2025-09-30T14:53:19.044247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:19.044255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:19.044260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:19.044431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:19.044440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:19.044451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:19.044535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1153 partition: 0 MaxSeqNo: 42 sessionId: src_id|d87e1859-a8c92575-20d9795a-5408da81_0
2025-09-30T14:53:19.044993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c5fbcb8-866fe54a-8f576d6d-7a4a0823_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d87e1859-a8c92575-20d9795a-5408da81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:19.047886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d87e1859-a8c92575-20d9795a-5408da81_0] Write session: try to update token
2025-09-30T14:53:19.047904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d87e1859-a8c92575-20d9795a-5408da81_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:19.056269Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:19.056289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:19.056298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895443316501933:7368]
2025-09-30T14:53:19.056342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:19.056343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:19.056520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:19.056675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:19.056819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:19.056961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:19.057256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:19.057300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:19.062129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1153 sessionId: src_id|d87e1859-a8c92575-20d9795a-5408da81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:19.064716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:19.064908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:19.064933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:19.064973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:19.065075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:19.066871Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:19.066886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:19.066888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:19.066890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:19.066898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895443316501933:7368]
2025-09-30T14:53:19.066901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895443316501933:7368]
2025-09-30T14:53:19.066904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895443316501933:7368]
2025-09-30T14:53:19.066939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:19.066944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.066946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:19.066961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:19.066977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:19.066981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:19.067066Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:19.116992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895443406250573:4239]
2025-09-30T14:53:19.117329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1152, pipe: [1:7555895443406250573:4239]
2025-09-30T14:53:19.147398Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] Counters: { Errors: 11 CurrentSessionLifetimeMs: 181191 BytesRead: 38297624 MessagesRead: 17 BytesReadCompressed: 38297624 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 2252802 BytesInflightTotal: 4505604 MessagesInflight: 2 }
2025-09-30T14:53:19.175695Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:19.183061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:19.183092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:19.183257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:19.183322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:19.183383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:19.183439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:19.183482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:19.183485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:19.183558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:19.183613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:19.183685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:19.183754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:19.183798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:19.183805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:19.183875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:19.183939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:19.184002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:19.184092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:19.184137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:19.184144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:19.184211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:19.184277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:19.184340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:19.184406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:19.184448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:19.184455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:19.184522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:19.184580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:19.184642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:19.184705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:19.184749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:19.184756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:19.184822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:19.184884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:19.184970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:19.185051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:19.185101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:19.185108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:19.185177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:19.185231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:19.185293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:19.185362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:19.185418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:19.185425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:19.185489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:19.185549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:19.185612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:19.185675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:19.185726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:19.185733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:19.185801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:19.185863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:19.185930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:19.185994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:19.186037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:19.186043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:19.186119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:19.186180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:19.186243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:19.186307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:19.186351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:19.186358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:19.186427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895443406250573:4239], now have 1 active actors on pipe
2025-09-30T14:53:19.186728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:19.186761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895443406250573:4239]
2025-09-30T14:53:19.186792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:19.186801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:19.186828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1153 reason: error at write: Disconnected sessionId: src_id|d87e1859-a8c92575-20d9795a-5408da81_0
2025-09-30T14:53:19.187046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1153 sessionId: src_id|d87e1859-a8c92575-20d9795a-5408da81_0 is DEAD
2025-09-30T14:53:19.187213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d87e1859-a8c92575-20d9795a-5408da81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:19.187234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d87e1859-a8c92575-20d9795a-5408da81_0] Write session will restart in 0.007591s
2025-09-30T14:53:19.187278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d87e1859-a8c92575-20d9795a-5408da81_0] Write session: Do CDS request
2025-09-30T14:53:19.187285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d87e1859-a8c92575-20d9795a-5408da81_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:19.187514Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:19.195798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d87e1859-a8c92575-20d9795a-5408da81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:19.195918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:19.195932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1154
2025-09-30T14:53:19.196051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1154 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:19.196074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1154 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:19.196083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1154 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:19.196087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:19.196647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1154 sessionId:  describe result for acl check
2025-09-30T14:53:19.196683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:19.196695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:19.196698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:19.196704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895443406250640:3838] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:19.197231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895443406250640:3838] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:19.199666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895443406250640:3838] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:19.202574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895443406250640:3838] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:19.202591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895443406250640:3838] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:19.202594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895443406250640:3838] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:19.202603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1154 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:19.204471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:19.206878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:19.207182Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:19.207194Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:19.207204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:19.207277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:19.207319Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895443316502187:7372]
2025-09-30T14:53:19.207795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:19.208054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:19.208098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:19.208428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:19.208477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:19.208482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:19.208483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:19.208484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:19.208484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:19.208485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:19.208486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:19.208487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:19.208487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:19.208488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:19.208489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.208489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.208490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.208491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:19.208491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:19.208495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:19.208502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:19.208504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:19.208507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:19.208510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:19.208512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:19.208515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:19.208517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:19.208519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:19.208522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:19.208524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.208526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.208529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.208531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:19.208533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:19.208538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:19.208543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:19.208549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:19.208552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:19.208555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:19.208558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:19.208561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:19.208563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:19.208566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:19.208569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:19.208572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:19.208575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:19.208577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:19.208580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:19.208583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:19.208585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:19.208588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:19.208591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:19.208593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:19.208596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:19.208599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.208602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.208604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.208607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.208609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.208612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.208615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:19.208617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:19.208620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:19.208623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:19.208645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:19.213781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:19.214880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:19.214898Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:19.214900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:19.214903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:19.214908Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1153 [2:7555895443316502187:7372]
2025-09-30T14:53:19.214919Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:19.214932Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:19.214935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:19.214937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:19.214939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:19.214951Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:19.214956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:19.214965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:19.215009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.215016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.215017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.215019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:19.215021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:19.215079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:19.215084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.215092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.215098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.215115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:19.215128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895443316502182:7372]
2025-09-30T14:53:19.215131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895443316502182:7372]
2025-09-30T14:53:19.215133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895443316502182:7372]
2025-09-30T14:53:19.215142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:19.215153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:19.215155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:19.215157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:19.215160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:19.215168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:19.215171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:19.215181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895443406250588:2454], now have 1 active actors on pipe
2025-09-30T14:53:19.215184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895443406250817:3838], now have 1 active actors on pipe
2025-09-30T14:53:19.215213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895443316502182:7372]
2025-09-30T14:53:19.215221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:19.215276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1153
2025-09-30T14:53:19.215295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1153
2025-09-30T14:53:19.215235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:19.215561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:19.215575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:19.215602Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94beb167-ed408d89-636f5990-896eb138_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:19.215615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:19.215618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:19.215626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:19.215636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:19.215650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:19.215668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:19.215853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:19.215863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:19.215874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:19.215956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1154 partition: 0 MaxSeqNo: 42 sessionId: src_id|94beb167-ed408d89-636f5990-896eb138_0
2025-09-30T14:53:19.216353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d87e1859-a8c92575-20d9795a-5408da81_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|94beb167-ed408d89-636f5990-896eb138_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:19.219226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94beb167-ed408d89-636f5990-896eb138_0] Write session: try to update token
2025-09-30T14:53:19.219266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94beb167-ed408d89-636f5990-896eb138_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:19.227705Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:19.227728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:19.227738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895443316502182:7372]
2025-09-30T14:53:19.227781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:19.227798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:19.227976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:19.228126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:19.228284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:19.228438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:19.228649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:19.228691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:19.234245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1154 sessionId: src_id|94beb167-ed408d89-636f5990-896eb138_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:19.236892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:19.237098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:19.237123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:19.237157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:19.237247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:19.238767Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:19.238787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:19.238790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:19.238792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:19.238801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895443316502182:7372]
2025-09-30T14:53:19.238807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895443316502182:7372]
2025-09-30T14:53:19.238813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895443316502182:7372]
2025-09-30T14:53:19.238858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:19.238858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:19.238864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:19.238868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:19.238873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.238876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:19.239067Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:19.287341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895443406250831:4239]
2025-09-30T14:53:19.287672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1153, pipe: [1:7555895443406250831:4239]
2025-09-30T14:53:19.351722Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:19.359727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:19.359754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:19.359914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:19.359974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:19.360036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:19.360099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:19.360454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:19.360466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:19.360528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:19.360592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:19.360661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:19.360726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:19.360767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:19.360773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:19.360835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:19.360891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:19.360953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:19.361014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:19.361064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:19.361067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:19.361142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:19.361212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:19.361273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:19.361330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:19.361370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:19.361374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:19.361444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:19.361515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:19.361577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:19.361637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:19.361681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:19.361690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:19.361769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:19.361832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:19.361892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:19.361954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:19.361996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:19.362003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:19.362066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:19.362135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:19.362196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:19.362263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:19.362309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:19.362315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:19.362377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:19.362434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:19.362500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:19.362568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:19.362612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:19.362618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:19.362678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:19.362738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:19.362807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:19.362873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:19.362916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:19.362921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:19.362983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:19.363041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:19.363099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:19.363163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:19.363210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:19.363216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:19.363294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895443406250831:4239], now have 1 active actors on pipe
2025-09-30T14:53:19.363590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895443406250831:4239]
2025-09-30T14:53:19.363630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:19.363720Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:19.363874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:19.363928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1154 reason: status is not ok: tablet will be restarted right now sessionId: src_id|94beb167-ed408d89-636f5990-896eb138_0
2025-09-30T14:53:19.364121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1154 sessionId: src_id|94beb167-ed408d89-636f5990-896eb138_0 is DEAD
2025-09-30T14:53:19.364298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94beb167-ed408d89-636f5990-896eb138_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:19.364306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94beb167-ed408d89-636f5990-896eb138_0] Write session will restart in 0.007145s
2025-09-30T14:53:19.364329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94beb167-ed408d89-636f5990-896eb138_0] Write session: Do CDS request
2025-09-30T14:53:19.364334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94beb167-ed408d89-636f5990-896eb138_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:19.372799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94beb167-ed408d89-636f5990-896eb138_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:19.372931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:19.372949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1155
2025-09-30T14:53:19.373090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1155 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:19.373130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1155 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:19.373139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1155 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:19.373145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:19.373571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1155 sessionId:  describe result for acl check
2025-09-30T14:53:19.373604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:19.373606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:19.373607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:19.373613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895443406250871:3830] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:19.374192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895443406250871:3830] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:19.376946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895443406250871:3830] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:19.380205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895443406250871:3830] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:19.380220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895443406250871:3830] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:19.380233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895443406250871:3830] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:19.380241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1155 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:19.381543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:19.384351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:19.384552Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:19.384567Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:19.384578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:19.384702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:19.384754Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895443316502423:7374]
2025-09-30T14:53:19.385445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:19.385786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:19.385830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:19.386144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:19.386200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:19.386206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:19.386208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:19.386208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:19.386210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:19.386211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:19.386212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:19.386213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:19.386215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:19.386216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:19.386217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.386218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.386219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.386220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:19.386221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:19.386226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:19.386236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:19.386241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:19.386244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:19.386248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:19.386251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:19.386254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:19.386258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:19.386261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:19.386265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:19.386268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.386272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.386275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.386279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:19.386282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:19.386289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:19.386297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:19.386302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:19.386307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:19.386311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:19.386316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:19.386320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:19.386325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:19.386330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:19.386334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:19.386339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:19.386344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:19.386348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:19.386353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:19.386357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:19.386362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:19.386371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:19.386376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:19.386383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:19.386389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:19.386398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.386402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.386407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.386411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.386415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.386424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.386428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:19.386432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:19.386437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:19.386446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:19.386487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:19.392266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:19.393662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:19.393680Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:19.393683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:19.393686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:19.393693Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1154 [2:7555895443316502423:7374]
2025-09-30T14:53:19.393708Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:19.393725Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:19.393734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:19.393737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:19.393739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:19.393755Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:19.393761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:19.393767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:19.393828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.393835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.393837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.393840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:19.393843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:19.393910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:19.393920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.393933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.393945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.393962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:19.393981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895443406250833:2454], now have 1 active actors on pipe
2025-09-30T14:53:19.393990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895443406251064:3830], now have 1 active actors on pipe
2025-09-30T14:53:19.393995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895443316502418:7374]
2025-09-30T14:53:19.393997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895443316502418:7374]
2025-09-30T14:53:19.394000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895443316502418:7374]
2025-09-30T14:53:19.394020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:19.394037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:19.394042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:19.394056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:19.394059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:19.394060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:19.394063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:19.394090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895443316502418:7374]
2025-09-30T14:53:19.394115Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:19.394131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:19.394105Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1154
2025-09-30T14:53:19.394151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:19.394160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:19.394123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1154
2025-09-30T14:53:19.394186Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22b165c0-d1d3a9ee-3ca3e896-f7d49821_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:19.394200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:19.394204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:19.394206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:19.394215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:19.394223Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:19.394240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:19.394409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:19.394418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:19.394430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:19.394498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1155 partition: 0 MaxSeqNo: 42 sessionId: src_id|22b165c0-d1d3a9ee-3ca3e896-f7d49821_0
2025-09-30T14:53:19.394895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94beb167-ed408d89-636f5990-896eb138_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|22b165c0-d1d3a9ee-3ca3e896-f7d49821_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:19.397733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22b165c0-d1d3a9ee-3ca3e896-f7d49821_0] Write session: try to update token
2025-09-30T14:53:19.397752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22b165c0-d1d3a9ee-3ca3e896-f7d49821_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:19.406598Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:19.406621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:19.406624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:19.406626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:19.406636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895443316502418:7374]
2025-09-30T14:53:19.406640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895443316502418:7374]
2025-09-30T14:53:19.406644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895443316502418:7374]
2025-09-30T14:53:19.406686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:19.406690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:19.406696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:19.406697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.406699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:19.406700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:19.406839Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:19.416552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1155 sessionId: src_id|22b165c0-d1d3a9ee-3ca3e896-f7d49821_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:19.419445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:19.463613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895443406251078:4239]
2025-09-30T14:53:19.463953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1154, pipe: [1:7555895443406251078:4239]
2025-09-30T14:53:19.522739Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:19.523161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:19.523179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:19.523200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895443406251078:4239], now have 1 active actors on pipe
2025-09-30T14:53:19.523530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:19.523564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895443406251078:4239]
2025-09-30T14:53:19.523586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:19.523589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:19.523663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1155 reason: error at write: Disconnected sessionId: src_id|22b165c0-d1d3a9ee-3ca3e896-f7d49821_0
2025-09-30T14:53:19.523780Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:19.523914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1155 sessionId: src_id|22b165c0-d1d3a9ee-3ca3e896-f7d49821_0 is DEAD
2025-09-30T14:53:19.524057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22b165c0-d1d3a9ee-3ca3e896-f7d49821_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:19.524066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22b165c0-d1d3a9ee-3ca3e896-f7d49821_0] Write session will restart in 0.005680s
2025-09-30T14:53:19.524095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22b165c0-d1d3a9ee-3ca3e896-f7d49821_0] Write session: Do CDS request
2025-09-30T14:53:19.524104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22b165c0-d1d3a9ee-3ca3e896-f7d49821_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:19.530799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22b165c0-d1d3a9ee-3ca3e896-f7d49821_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:19.530889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:19.530906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1156
2025-09-30T14:53:19.531024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1156 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:19.531056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1156 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:19.531066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1156 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:19.531070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:19.531518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1156 sessionId:  describe result for acl check
2025-09-30T14:53:19.531550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:19.531557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:19.531559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:19.531565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895443406251097:3821] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:19.532170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895443406251097:3821] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:19.535311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895443406251097:3821] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:19.538974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895443406251097:3821] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:19.538993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895443406251097:3821] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:19.538996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895443406251097:3821] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:19.539004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1156 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:19.542886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:19.546399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:19.546800Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:19.546821Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:19.546836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:19.546922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:19.546972Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895443316502660:7376]
2025-09-30T14:53:19.547600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:19.547955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:19.548051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:19.548445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:19.548525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:19.548533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:19.548534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:19.548536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:19.548537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:19.548539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:19.548540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:19.548542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:19.548543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:19.548544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:19.548545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.548547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.548548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.548550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:19.548551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:19.548557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:19.548568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:19.548573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:19.548578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:19.548582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:19.548587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:19.548591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:19.548595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:19.548599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:19.548604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:19.548608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.548613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.548617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.548621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:19.548625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:19.548632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:19.548640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:19.548646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:19.548653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:19.548658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:19.548664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:19.548669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:19.548675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:19.548681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:19.548686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:19.548692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:19.548697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:19.548703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:19.548709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:19.548714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:19.548720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:19.548725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:19.548737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:19.548743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:19.548753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:19.548758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.548766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.548771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.548776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.548782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.548792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.548797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:19.548806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:19.548815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:19.548826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:19.548877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:19.554824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:19.556917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1155
2025-09-30T14:53:19.556924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1155
2025-09-30T14:53:19.556470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:19.556490Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:19.556493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:19.556497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:19.556504Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1155 [2:7555895443316502660:7376]
2025-09-30T14:53:19.556524Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:19.556543Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:19.556546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:19.556549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:19.556552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:19.556569Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:19.556576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:19.556584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:19.556658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.556659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.556662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.556666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:19.556668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:19.556741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:19.556744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.556759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.556768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.556783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:19.556801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895443316502655:7376]
2025-09-30T14:53:19.556803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895443316502655:7376]
2025-09-30T14:53:19.556806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895443316502655:7376]
2025-09-30T14:53:19.556824Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:19.556840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895443406251082:2454], now have 1 active actors on pipe
2025-09-30T14:53:19.556844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895443406251254:3821], now have 1 active actors on pipe
2025-09-30T14:53:19.556854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:19.556852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:19.556858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:19.556868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:19.556861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:19.556872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:19.556913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895443316502655:7376]
2025-09-30T14:53:19.556925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:19.556954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:19.557104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:19.557110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:19.557135Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fdfbf4c7-f69a8d09-6e7c2385-84bbf4c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:19.557143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:19.557148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:19.557150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:19.557161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:19.557172Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:19.557199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:19.557378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:19.557388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:19.557404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:19.557506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1156 partition: 0 MaxSeqNo: 42 sessionId: src_id|fdfbf4c7-f69a8d09-6e7c2385-84bbf4c2_0
2025-09-30T14:53:19.557919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22b165c0-d1d3a9ee-3ca3e896-f7d49821_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fdfbf4c7-f69a8d09-6e7c2385-84bbf4c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:19.565226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdfbf4c7-f69a8d09-6e7c2385-84bbf4c2_0] Write session: try to update token
2025-09-30T14:53:19.565250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdfbf4c7-f69a8d09-6e7c2385-84bbf4c2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:19.569554Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:19.569576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:19.569579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:19.569581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:19.569593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895443316502655:7376]
2025-09-30T14:53:19.569597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895443316502655:7376]
2025-09-30T14:53:19.569602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895443316502655:7376]
2025-09-30T14:53:19.569643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:19.569650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.569653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:19.569659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:19.569675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:19.569679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:19.569836Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:19.583601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1156 sessionId: src_id|fdfbf4c7-f69a8d09-6e7c2385-84bbf4c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:19.586341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:19.623889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895443406251327:4239]
2025-09-30T14:53:19.624216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1155, pipe: [1:7555895443406251327:4239]
2025-09-30T14:53:19.682759Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:19.683487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:19.683504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:19.683523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895443406251327:4239], now have 1 active actors on pipe
2025-09-30T14:53:19.683748Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:19.683766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:19.683797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895443406251327:4239]
2025-09-30T14:53:19.683815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:19.683818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:19.683880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1156 reason: error at write: Disconnected sessionId: src_id|fdfbf4c7-f69a8d09-6e7c2385-84bbf4c2_0
2025-09-30T14:53:19.684093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1156 sessionId: src_id|fdfbf4c7-f69a8d09-6e7c2385-84bbf4c2_0 is DEAD
2025-09-30T14:53:19.684250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdfbf4c7-f69a8d09-6e7c2385-84bbf4c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:19.684262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdfbf4c7-f69a8d09-6e7c2385-84bbf4c2_0] Write session will restart in 0.006684s
2025-09-30T14:53:19.684288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdfbf4c7-f69a8d09-6e7c2385-84bbf4c2_0] Write session: Do CDS request
2025-09-30T14:53:19.684294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdfbf4c7-f69a8d09-6e7c2385-84bbf4c2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:19.691808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdfbf4c7-f69a8d09-6e7c2385-84bbf4c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:19.691912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:19.691938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1157
2025-09-30T14:53:19.692099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1157 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:19.692146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1157 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:19.692158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1157 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:19.692162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:19.692614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1157 sessionId:  describe result for acl check
2025-09-30T14:53:19.692647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:19.692653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:19.692655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:19.692662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895443406251371:3817] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:19.693163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895443406251371:3817] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:19.695581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895443406251371:3817] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:19.698660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895443406251371:3817] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:19.698675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895443406251371:3817] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:19.698678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895443406251371:3817] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:19.698686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1157 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:19.701631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:19.704321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:19.704598Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:19.704611Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:19.704622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:19.704670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:19.704720Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895443316502900:7379]
2025-09-30T14:53:19.705307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:19.705679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:19.705738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:19.706018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:19.706085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:19.706091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:19.706101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:19.706103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:19.706105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:19.706106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:19.706107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:19.706108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:19.706109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:19.706109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:19.706110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.706111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.706112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.706112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:19.706113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:19.706118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:19.706126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:19.706129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:19.706131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:19.706134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:19.706136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:19.706139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:19.706141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:19.706144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:19.706146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:19.706157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.706162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.706165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.706169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:19.706174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:19.706181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:19.706190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:19.706194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:19.706198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:19.706201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:19.706204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:19.706206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:19.706209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:19.706212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:19.706215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:19.706218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:19.706222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:19.706225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:19.706228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:19.706231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:19.706233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:19.706236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:19.706241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:19.706243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:19.706246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:19.706249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.706252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.706254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.706257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.706260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.706263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.706265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:19.706268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:19.706271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:19.706274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:19.706300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:19.711785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:19.712790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:19.712804Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:19.712805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:19.712808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:19.712813Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1156 [2:7555895443316502900:7379]
2025-09-30T14:53:19.712827Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:19.712843Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:19.712847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:19.712850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:19.712853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:19.712868Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:19.712874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:19.712881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:19.712941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.712953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.712955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.712959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:19.712961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:19.713024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:19.713031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.713044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.713060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.713080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:19.713099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895443406251543:3817], now have 1 active actors on pipe
2025-09-30T14:53:19.713107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895443406251329:2454], now have 1 active actors on pipe
2025-09-30T14:53:19.713113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895443316502895:7379]
2025-09-30T14:53:19.713119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895443316502895:7379]
2025-09-30T14:53:19.713122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895443316502895:7379]
2025-09-30T14:53:19.713133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:19.713143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:19.713145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:19.713152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:19.713154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:19.713162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:19.713164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:19.713193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895443316502895:7379]
2025-09-30T14:53:19.713204Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:19.713208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:19.713242Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1156
2025-09-30T14:53:19.713264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1156
2025-09-30T14:53:19.713302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:19.713312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:19.713335Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bdcc9fd3-df2e9066-b9210eee-dc4534c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:19.713345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:19.713349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:19.713351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:19.713360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:19.713374Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:19.713390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:19.713570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:19.713579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:19.713594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:19.713694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1157 partition: 0 MaxSeqNo: 42 sessionId: src_id|bdcc9fd3-df2e9066-b9210eee-dc4534c_0
2025-09-30T14:53:19.714034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdfbf4c7-f69a8d09-6e7c2385-84bbf4c2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bdcc9fd3-df2e9066-b9210eee-dc4534c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:19.716866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdcc9fd3-df2e9066-b9210eee-dc4534c_0] Write session: try to update token
2025-09-30T14:53:19.716886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdcc9fd3-df2e9066-b9210eee-dc4534c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:19.725579Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:19.725603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:19.725605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:19.725607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:19.725616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895443316502895:7379]
2025-09-30T14:53:19.725621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895443316502895:7379]
2025-09-30T14:53:19.725626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895443316502895:7379]
2025-09-30T14:53:19.725667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:19.725674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.725677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:19.725680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:19.725687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:19.725691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:19.725825Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:19.737775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1157 sessionId: src_id|bdcc9fd3-df2e9066-b9210eee-dc4534c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:19.740629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:19.784145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895443406251586:4239]
2025-09-30T14:53:19.784462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1156, pipe: [1:7555895443406251586:4239]
2025-09-30T14:53:19.838627Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:19.838966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:19.838986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:19.839008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895443406251586:4239], now have 1 active actors on pipe
2025-09-30T14:53:19.839297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895443406251586:4239]
2025-09-30T14:53:19.839346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:19.839368Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:19.839418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1157 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bdcc9fd3-df2e9066-b9210eee-dc4534c_0
2025-09-30T14:53:19.839619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1157 sessionId: src_id|bdcc9fd3-df2e9066-b9210eee-dc4534c_0 is DEAD
2025-09-30T14:53:19.839257Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:19.839834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdcc9fd3-df2e9066-b9210eee-dc4534c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:19.839843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdcc9fd3-df2e9066-b9210eee-dc4534c_0] Write session will restart in 0.008802s
2025-09-30T14:53:19.839876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdcc9fd3-df2e9066-b9210eee-dc4534c_0] Write session: Do CDS request
2025-09-30T14:53:19.839883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdcc9fd3-df2e9066-b9210eee-dc4534c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:19.849834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdcc9fd3-df2e9066-b9210eee-dc4534c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:19.849936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:19.849963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1158
2025-09-30T14:53:19.850079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1158 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:19.850148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1158 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:19.850162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1158 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:19.850167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:19.850638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1158 sessionId:  describe result for acl check
2025-09-30T14:53:19.850684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:19.850690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:19.850692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:19.850698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895443406251649:3812] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:19.851279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895443406251649:3812] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:19.853701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895443406251649:3812] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:19.856803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895443406251649:3812] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:19.856818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895443406251649:3812] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:19.856821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895443406251649:3812] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:19.856830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1158 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:19.858422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:19.861161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:19.861380Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:19.861392Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:19.861403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:19.861456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:19.861495Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895443316503139:7381]
2025-09-30T14:53:19.862170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:19.862495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:19.862558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:19.862878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:19.862957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:19.862962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:19.862963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:19.862964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:19.862965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:19.862966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:19.862966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:19.862967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:19.862968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:19.862969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:19.862970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.862970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.862971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.862972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:19.862972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:19.862976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:19.862983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:19.862986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:19.862989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:19.862991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:19.862994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:19.862996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:19.862999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:19.863001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:19.863004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:19.863006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.863008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.863011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.863013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:19.863015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:19.863021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:19.863026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:19.863030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:19.863034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:19.863039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:19.863042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:19.863045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:19.863049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:19.863052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:19.863057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:19.863062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:19.863067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:19.863072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:19.863077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:19.863081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:19.863087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:19.863092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:19.863098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:19.863102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:19.863105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:19.863108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.863111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.863114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.863116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.863119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.863122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.863124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:19.863127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:19.863130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:19.863135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:19.863176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:19.868751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:19.870069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:19.870085Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:19.870088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:19.870101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:19.870107Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1157 [2:7555895443316503139:7381]
2025-09-30T14:53:19.870125Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:19.870141Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:19.870144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:19.870147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:19.870150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:19.870166Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:19.870180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:19.870188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:19.870246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.870254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.870256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.870260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:19.870262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:19.870332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:19.870339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.870352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:19.870365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:19.870382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:19.870405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895443406251821:3812], now have 1 active actors on pipe
2025-09-30T14:53:19.870412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895443406251588:2454], now have 1 active actors on pipe
2025-09-30T14:53:19.870417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895443316503134:7381]
2025-09-30T14:53:19.870419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895443316503134:7381]
2025-09-30T14:53:19.870421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895443316503134:7381]
2025-09-30T14:53:19.870434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:19.870457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:19.870468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:19.870472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:19.870475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:19.870482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:19.870486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:19.870516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895443316503134:7381]
2025-09-30T14:53:19.870529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:19.870506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1157
2025-09-30T14:53:19.870512Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1157
2025-09-30T14:53:19.870573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:19.870641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:19.870651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:19.870674Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e94325f7-2aefa16b-eb3b7d15-d1273b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:19.870685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:19.870689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:19.870691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:19.870702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:19.870716Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:19.870733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:19.870883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:19.870890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:19.870902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:19.870985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1158 partition: 0 MaxSeqNo: 42 sessionId: src_id|e94325f7-2aefa16b-eb3b7d15-d1273b1_0
2025-09-30T14:53:19.871405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdcc9fd3-df2e9066-b9210eee-dc4534c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e94325f7-2aefa16b-eb3b7d15-d1273b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:19.874375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e94325f7-2aefa16b-eb3b7d15-d1273b1_0] Write session: try to update token
2025-09-30T14:53:19.874392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e94325f7-2aefa16b-eb3b7d15-d1273b1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:19.889416Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:19.889446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:19.889458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895443316503134:7381]
2025-09-30T14:53:19.889514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:19.889519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:19.889762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:19.889748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1158 sessionId: src_id|e94325f7-2aefa16b-eb3b7d15-d1273b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:19.889923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:19.890110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:19.890266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:19.890492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:19.890536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:19.892503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:19.892697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:19.892717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:19.892749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:19.892846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:19.893896Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:19.893913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:19.893915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:19.893916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:19.893923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895443316503134:7381]
2025-09-30T14:53:19.893927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895443316503134:7381]
2025-09-30T14:53:19.893931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895443316503134:7381]
2025-09-30T14:53:19.893966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:19.893968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:19.893973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:19.893974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:19.893977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:19.893977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:19.894127Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:19.939313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895443406251835:4239]
2025-09-30T14:53:19.939590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1157, pipe: [1:7555895443406251835:4239]
2025-09-30T14:53:20.003054Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:20.011401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:20.011430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:20.011580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:20.011655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:20.011729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:20.011798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:20.011855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:20.011866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:20.011940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:20.012013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:20.012083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:20.012141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:20.012183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:20.012190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:20.012254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:20.012308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:20.012365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:20.012425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:20.012466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:20.012471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:20.012533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:20.012592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:20.012853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:20.012916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:20.012956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:20.012961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:20.013022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:20.013111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:20.013169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:20.013248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:20.013303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:20.013309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:20.013370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:20.013425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:20.013486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:20.013543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:20.013584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:20.013589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:20.013649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:20.013705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:20.013764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:20.013820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:20.013859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:20.013864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:20.013922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:20.013976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:20.014034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:20.014108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:20.014178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:20.014193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:20.014268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:20.014350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:20.014420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:20.014500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:20.014546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:20.014552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:20.014647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:20.014734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:20.014793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:20.014854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:20.014904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:20.014911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:20.014969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895443406251835:4239], now have 1 active actors on pipe
2025-09-30T14:53:20.015161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:20.015212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:20.015215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:20.015260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1158 reason: error at write: Disconnected sessionId: src_id|e94325f7-2aefa16b-eb3b7d15-d1273b1_0
2025-09-30T14:53:20.015450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1158 sessionId: src_id|e94325f7-2aefa16b-eb3b7d15-d1273b1_0 is DEAD
2025-09-30T14:53:20.015587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e94325f7-2aefa16b-eb3b7d15-d1273b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:20.015596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e94325f7-2aefa16b-eb3b7d15-d1273b1_0] Write session will restart in 0.008109s
2025-09-30T14:53:20.015629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e94325f7-2aefa16b-eb3b7d15-d1273b1_0] Write session: Do CDS request
2025-09-30T14:53:20.015638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e94325f7-2aefa16b-eb3b7d15-d1273b1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:20.015700Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:20.015810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895443406251835:4239]
2025-09-30T14:53:20.024815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e94325f7-2aefa16b-eb3b7d15-d1273b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:20.024897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:20.024912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1159
2025-09-30T14:53:20.025064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1159 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:20.025100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1159 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:20.025105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1159 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:20.025109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:20.025586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1159 sessionId:  describe result for acl check
2025-09-30T14:53:20.025628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:20.025631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:20.025632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:20.025638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895447701219233:3795] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:20.026152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895447701219233:3795] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:20.028454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895447701219233:3795] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:20.031178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895447701219233:3795] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:20.031196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895447701219233:3795] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:20.031200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895447701219233:3795] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:20.031207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1159 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:20.031735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:20.034300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:20.034484Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:20.034497Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:20.034508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:20.034554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:20.034588Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895447611470688:7389]
2025-09-30T14:53:20.035261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:20.035549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:20.035594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:20.035922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:20.035980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:20.035987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:20.035988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:20.035989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:20.035990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:20.035991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:20.035993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:20.035994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:20.035995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:20.035996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:20.035997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.035998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.036000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.036001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:20.036002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:20.036008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:20.036019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:20.036023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:20.036028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:20.036032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:20.036035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:20.036040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:20.036044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:20.036048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:20.036052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:20.036056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.036060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.036064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.036074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:20.036079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:20.036091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:20.036104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:20.036116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:20.036126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:20.036135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:20.036145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:20.036154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:20.036159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:20.036164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:20.036169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:20.036177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:20.036183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:20.036192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:20.036199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:20.036208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:20.036218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:20.036227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:20.036238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:20.036246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:20.036252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:20.036261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.036271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.036281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.036291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.036300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.036310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.036319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:20.036329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:20.036338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:20.036347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:20.036394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:20.041801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:20.042781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:20.042796Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:20.042798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:20.042801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:20.042806Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1158 [2:7555895447611470688:7389]
2025-09-30T14:53:20.042818Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:20.042831Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:20.042834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:20.042837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:20.042840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:20.042856Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:20.042868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:20.042880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:20.042948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.042955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.042957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.042960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:20.042961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:20.043030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:20.043040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.043051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.043062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.043078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:20.043097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895447701219387:3795], now have 1 active actors on pipe
2025-09-30T14:53:20.043106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895447701219146:2454], now have 1 active actors on pipe
2025-09-30T14:53:20.043112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895447611470683:7389]
2025-09-30T14:53:20.043115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895447611470683:7389]
2025-09-30T14:53:20.043117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895447611470683:7389]
2025-09-30T14:53:20.043131Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:20.043148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:20.043149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:20.043152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:20.043155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:20.043167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:20.043170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:20.043213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895447611470683:7389]
2025-09-30T14:53:20.043232Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:20.043233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:20.043216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1158
2025-09-30T14:53:20.043277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1158
2025-09-30T14:53:20.043292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:20.043302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:20.043332Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2483ec0b-cdbd90c2-9ccac79f-c80e347e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:20.043344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:20.043351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:20.043354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:20.043364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:20.043377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:20.043396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:20.043545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:20.043553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:20.043567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:20.043659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1159 partition: 0 MaxSeqNo: 42 sessionId: src_id|2483ec0b-cdbd90c2-9ccac79f-c80e347e_0
2025-09-30T14:53:20.044063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e94325f7-2aefa16b-eb3b7d15-d1273b1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2483ec0b-cdbd90c2-9ccac79f-c80e347e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:20.046890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2483ec0b-cdbd90c2-9ccac79f-c80e347e_0] Write session: try to update token
2025-09-30T14:53:20.046906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2483ec0b-cdbd90c2-9ccac79f-c80e347e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:20.055340Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:20.055361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:20.055363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:20.055365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:20.055373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895447611470683:7389]
2025-09-30T14:53:20.055377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895447611470683:7389]
2025-09-30T14:53:20.055380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895447611470683:7389]
2025-09-30T14:53:20.055421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:20.055423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:20.055430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.055433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:20.055435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:20.055438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:20.055578Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:20.061771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1159 sessionId: src_id|2483ec0b-cdbd90c2-9ccac79f-c80e347e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:20.064399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:20.115894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895447701219412:4239]
2025-09-30T14:53:20.116149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1158, pipe: [1:7555895447701219412:4239]
2025-09-30T14:53:20.166535Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:20.167145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:20.167165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:20.167219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895447701219412:4239], now have 1 active actors on pipe
2025-09-30T14:53:20.167462Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:20.167551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:20.167641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1159 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2483ec0b-cdbd90c2-9ccac79f-c80e347e_0
2025-09-30T14:53:20.167686Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:20.167738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895447701219412:4239]
2025-09-30T14:53:20.167856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1159 sessionId: src_id|2483ec0b-cdbd90c2-9ccac79f-c80e347e_0 is DEAD
2025-09-30T14:53:20.168039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2483ec0b-cdbd90c2-9ccac79f-c80e347e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:20.168048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2483ec0b-cdbd90c2-9ccac79f-c80e347e_0] Write session will restart in 0.008535s
2025-09-30T14:53:20.168072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2483ec0b-cdbd90c2-9ccac79f-c80e347e_0] Write session: Do CDS request
2025-09-30T14:53:20.168077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2483ec0b-cdbd90c2-9ccac79f-c80e347e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:20.177790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2483ec0b-cdbd90c2-9ccac79f-c80e347e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:20.177873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:20.177911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1160
2025-09-30T14:53:20.178043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1160 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:20.178074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1160 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:20.178085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1160 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:20.178101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:20.178650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1160 sessionId:  describe result for acl check
2025-09-30T14:53:20.178690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:20.178693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:20.178694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:20.178700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895447701219484:3794] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:20.179295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895447701219484:3794] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:20.182078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895447701219484:3794] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:20.185457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895447701219484:3794] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:20.185475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895447701219484:3794] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:20.185478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895447701219484:3794] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:20.185487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1160 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:20.187109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:20.189830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:20.190044Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:20.190056Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:20.190084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:20.190157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:20.190217Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895447611470966:7399]
2025-09-30T14:53:20.190905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:20.191309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:20.191371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:20.191734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:20.191854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:20.191864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:20.191866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:20.191867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:20.191868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:20.191869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:20.191871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:20.191872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:20.191872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:20.191874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:20.191875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.191876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.191878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.191879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:20.191880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:20.191885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:20.191893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:20.191896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:20.191898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:20.191901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:20.191903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:20.191906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:20.191908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:20.191910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:20.191913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:20.191915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.191918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.191920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.191923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:20.191925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:20.191932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:20.191938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:20.191941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:20.191945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:20.191949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:20.191955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:20.191959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:20.191965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:20.191969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:20.191974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:20.191978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:20.191983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:20.191988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:20.191993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:20.191999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:20.192004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:20.192009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:20.192016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:20.192021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:20.192026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:20.192031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.192037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.192042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.192045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.192048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.192050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.192053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:20.192056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:20.192058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:20.192062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:20.192097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:20.197802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:20.198685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:20.198702Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:20.198705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:20.198709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:20.198716Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1159 [2:7555895447611470966:7399]
2025-09-30T14:53:20.198733Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:20.198749Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:20.198752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:20.198756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:20.198758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:20.198774Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:20.198782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:20.198789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:20.198855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.198865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.198867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.198871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:20.198874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:20.199112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1159
2025-09-30T14:53:20.199124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1159
2025-09-30T14:53:20.199349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:20.199361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.199376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.199390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.199409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:20.199434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895447701219661:3794], now have 1 active actors on pipe
2025-09-30T14:53:20.199442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895447701219418:2454], now have 1 active actors on pipe
2025-09-30T14:53:20.199462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:20.199472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:20.199490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895447611470961:7399]
2025-09-30T14:53:20.199497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895447611470961:7399]
2025-09-30T14:53:20.199499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895447611470961:7399]
2025-09-30T14:53:20.199512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:20.199531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:20.199547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:20.199546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:20.199550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:20.199552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:20.199553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:20.199566Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|274141ff-37ade046-b3487bd9-c6265f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:20.199571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:20.199573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:20.199575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:20.199582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:20.199591Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:20.199631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895447611470961:7399]
2025-09-30T14:53:20.199641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:20.199650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:20.199651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:20.200047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:20.200066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:20.200089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:20.200241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1160 partition: 0 MaxSeqNo: 42 sessionId: src_id|274141ff-37ade046-b3487bd9-c6265f7_0
2025-09-30T14:53:20.200682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2483ec0b-cdbd90c2-9ccac79f-c80e347e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|274141ff-37ade046-b3487bd9-c6265f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:20.203603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|274141ff-37ade046-b3487bd9-c6265f7_0] Write session: try to update token
2025-09-30T14:53:20.203623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|274141ff-37ade046-b3487bd9-c6265f7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:20.212322Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:20.212348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:20.212351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:20.212354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:20.212364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895447611470961:7399]
2025-09-30T14:53:20.212369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895447611470961:7399]
2025-09-30T14:53:20.212373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895447611470961:7399]
2025-09-30T14:53:20.212414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:20.212421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.212421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:20.212423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:20.212428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:20.212433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:20.212606Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:20.219926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1160 sessionId: src_id|274141ff-37ade046-b3487bd9-c6265f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:20.222964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:20.267982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895447701219675:4239]
2025-09-30T14:53:20.268285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1159, pipe: [1:7555895447701219675:4239]
2025-09-30T14:53:20.325628Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:20.326212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:20.326230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:20.326250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895447701219675:4239], now have 1 active actors on pipe
2025-09-30T14:53:20.326495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895447701219675:4239]
2025-09-30T14:53:20.326502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:20.326506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:20.326533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:20.326572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1160 reason: error at write: Disconnected sessionId: src_id|274141ff-37ade046-b3487bd9-c6265f7_0
2025-09-30T14:53:20.326767Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:20.326777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1160 sessionId: src_id|274141ff-37ade046-b3487bd9-c6265f7_0 is DEAD
2025-09-30T14:53:20.326943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|274141ff-37ade046-b3487bd9-c6265f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:20.326952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|274141ff-37ade046-b3487bd9-c6265f7_0] Write session will restart in 0.006264s
2025-09-30T14:53:20.326975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|274141ff-37ade046-b3487bd9-c6265f7_0] Write session: Do CDS request
2025-09-30T14:53:20.326984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|274141ff-37ade046-b3487bd9-c6265f7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:20.334860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|274141ff-37ade046-b3487bd9-c6265f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:20.335023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:20.335042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1161
2025-09-30T14:53:20.335201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1161 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:20.335258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1161 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:20.335269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1161 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:20.335274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:20.335745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1161 sessionId:  describe result for acl check
2025-09-30T14:53:20.335786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:20.335796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:20.335801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:20.335809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895447701219702:3785] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:20.336406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895447701219702:3785] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:20.340149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895447701219702:3785] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:20.343424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895447701219702:3785] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:20.343442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895447701219702:3785] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:20.343446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895447701219702:3785] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:20.343454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1161 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:20.346308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:20.349055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:20.349268Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:20.349278Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:20.349289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:20.349352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:20.349391Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895447611471208:7401]
2025-09-30T14:53:20.349965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:20.350284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:20.350331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:20.350611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:20.350676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:20.350681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:20.350683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:20.350684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:20.350685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:20.350687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:20.350688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:20.350689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:20.350690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:20.350692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:20.350693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.350694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.350695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.350697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:20.350698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:20.350703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:20.350714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:20.350719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:20.350723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:20.350728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:20.350732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:20.350736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:20.350738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:20.350741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:20.350744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:20.350747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.350749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.350752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.350754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:20.350756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:20.350762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:20.350766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:20.350770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:20.350774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:20.350776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:20.350780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:20.350782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:20.350785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:20.350788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:20.350791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:20.350793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:20.350797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:20.350799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:20.350803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:20.350805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:20.350808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:20.350811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:20.350814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:20.350818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:20.350821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:20.350824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.350827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.350829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.350832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.350835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.350839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.350842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:20.350844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:20.350848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:20.350851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:20.350876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:20.356577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:20.357679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:20.357695Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:20.357698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:20.357702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:20.357709Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1160 [2:7555895447611471208:7401]
2025-09-30T14:53:20.357727Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:20.357743Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:20.357751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:20.357753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:20.357756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:20.357772Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:20.357780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:20.357788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:20.357856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.357864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.357866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.357870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:20.357872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:20.357949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:20.357958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.357971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.357984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.358002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:20.358027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895447701219677:2454], now have 1 active actors on pipe
2025-09-30T14:53:20.358036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895447701219884:3785], now have 1 active actors on pipe
2025-09-30T14:53:20.358043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895447611471203:7401]
2025-09-30T14:53:20.358046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895447611471203:7401]
2025-09-30T14:53:20.358048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895447611471203:7401]
2025-09-30T14:53:20.358059Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:20.358072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:20.358100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:20.358104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:20.358125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:20.358138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895447611471203:7401]
2025-09-30T14:53:20.358139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:20.358141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:20.358140Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:20.358146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:20.358130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1160
2025-09-30T14:53:20.358136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1160
2025-09-30T14:53:20.358281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:20.358296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:20.358325Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7cb9e71f-f9fb7286-15ea77f1-5322b1b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:20.358338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:20.358342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:20.358344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:20.358355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:20.358365Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:20.358380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:20.358592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:20.358603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:20.358619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:20.358734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1161 partition: 0 MaxSeqNo: 42 sessionId: src_id|7cb9e71f-f9fb7286-15ea77f1-5322b1b5_0
2025-09-30T14:53:20.359167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|274141ff-37ade046-b3487bd9-c6265f7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7cb9e71f-f9fb7286-15ea77f1-5322b1b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:20.362143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb9e71f-f9fb7286-15ea77f1-5322b1b5_0] Write session: try to update token
2025-09-30T14:53:20.362163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb9e71f-f9fb7286-15ea77f1-5322b1b5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:20.370723Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:20.370746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:20.370749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:20.370751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:20.370761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895447611471203:7401]
2025-09-30T14:53:20.370766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895447611471203:7401]
2025-09-30T14:53:20.370770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895447611471203:7401]
2025-09-30T14:53:20.370813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:20.370825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.370827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:20.370835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:20.370843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:20.370847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:20.370992Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:20.378027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1161 sessionId: src_id|7cb9e71f-f9fb7286-15ea77f1-5322b1b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:20.380980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:20.426816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895447701219927:4239]
2025-09-30T14:53:20.427111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1160, pipe: [1:7555895447701219927:4239]
2025-09-30T14:53:20.487814Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:20.488172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:20.488188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:20.488207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895447701219927:4239], now have 1 active actors on pipe
2025-09-30T14:53:20.488428Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:20.488459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:20.488470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895447701219927:4239]
2025-09-30T14:53:20.488494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:20.488571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1161 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7cb9e71f-f9fb7286-15ea77f1-5322b1b5_0
2025-09-30T14:53:20.488776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1161 sessionId: src_id|7cb9e71f-f9fb7286-15ea77f1-5322b1b5_0 is DEAD
2025-09-30T14:53:20.488983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb9e71f-f9fb7286-15ea77f1-5322b1b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:20.488995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb9e71f-f9fb7286-15ea77f1-5322b1b5_0] Write session will restart in 0.006289s
2025-09-30T14:53:20.489017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb9e71f-f9fb7286-15ea77f1-5322b1b5_0] Write session: Do CDS request
2025-09-30T14:53:20.489024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb9e71f-f9fb7286-15ea77f1-5322b1b5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:20.496839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb9e71f-f9fb7286-15ea77f1-5322b1b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:20.496965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:20.496979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1162
2025-09-30T14:53:20.497110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1162 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:20.497142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1162 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:20.497148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1162 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:20.497152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:20.497630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1162 sessionId:  describe result for acl check
2025-09-30T14:53:20.497663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:20.497670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:20.497674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:20.497681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895447701219944:3779] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:20.498310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895447701219944:3779] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:20.501542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895447701219944:3779] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:20.504585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895447701219944:3779] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:20.504602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895447701219944:3779] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:20.504605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895447701219944:3779] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:20.504613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1162 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:20.508800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:20.509278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:20.509496Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:20.509508Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:20.509518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:20.509572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:20.509610Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895447611471451:7403]
2025-09-30T14:53:20.510241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:20.511795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:20.511863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:20.512259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:20.512334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:20.512345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:20.512346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:20.512347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:20.512348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:20.512350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:20.512351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:20.512352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:20.512353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:20.512355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:20.512356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.512357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.512358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.512360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:20.512361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:20.512369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:20.512379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:20.512384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:20.512389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:20.512398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:20.512402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:20.512411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:20.512416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:20.512420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:20.512438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:20.512447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.512450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.512454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.512462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:20.512466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:20.512479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:20.512492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:20.512502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:20.512511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:20.512520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:20.512525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:20.512531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:20.512541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:20.512550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:20.512556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:20.512565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:20.512570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:20.512575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:20.512585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:20.512593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:20.512599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:20.512604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:20.512610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:20.512618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:20.512625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:20.512634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.512639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.512648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.512654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.512664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.512669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.512678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:20.512685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:20.512694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:20.512703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:20.512766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:20.518305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:20.519234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:20.519274Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:20.519277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:20.519282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:20.519290Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1161 [2:7555895447611471451:7403]
2025-09-30T14:53:20.519308Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:20.519325Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:20.519333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:20.519337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:20.519340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:20.519356Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:20.519368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:20.519375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:20.519444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.519452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.519455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.519458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:20.519461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:20.519531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:20.519538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.519553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.519569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.519589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:20.519613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895447701220085:3779], now have 1 active actors on pipe
2025-09-30T14:53:20.519622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895447701219929:2454], now have 1 active actors on pipe
2025-09-30T14:53:20.519628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895447611471446:7403]
2025-09-30T14:53:20.519631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895447611471446:7403]
2025-09-30T14:53:20.519633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895447611471446:7403]
2025-09-30T14:53:20.519653Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:20.519668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:20.519671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:20.519679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:20.519681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:20.519688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:20.519692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:20.519729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895447611471446:7403]
2025-09-30T14:53:20.519739Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:20.519740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:20.519755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:20.519718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1161
2025-09-30T14:53:20.519761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:20.519808Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|545fa0a8-15084e3e-d4cc7bd5-ce3efc1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:20.519808Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1161
2025-09-30T14:53:20.519821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:20.519823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:20.519825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:20.519835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:20.519846Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:20.519864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:20.520117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1162 partition: 0 MaxSeqNo: 42 sessionId: src_id|545fa0a8-15084e3e-d4cc7bd5-ce3efc1_0
2025-09-30T14:53:20.519994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:20.520002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:20.520015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:20.520516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb9e71f-f9fb7286-15ea77f1-5322b1b5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|545fa0a8-15084e3e-d4cc7bd5-ce3efc1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:20.523273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|545fa0a8-15084e3e-d4cc7bd5-ce3efc1_0] Write session: try to update token
2025-09-30T14:53:20.523295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|545fa0a8-15084e3e-d4cc7bd5-ce3efc1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:20.531902Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:20.531917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:20.531920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:20.531922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:20.531931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895447611471446:7403]
2025-09-30T14:53:20.531937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895447611471446:7403]
2025-09-30T14:53:20.531941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895447611471446:7403]
2025-09-30T14:53:20.531986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:20.531994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.531996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:20.531998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:20.532006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:20.532010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:20.532147Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:20.538359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1162 sessionId: src_id|545fa0a8-15084e3e-d4cc7bd5-ce3efc1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:20.541254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:20.588480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895447701220182:4239]
2025-09-30T14:53:20.588760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1161, pipe: [1:7555895447701220182:4239]
2025-09-30T14:53:20.644958Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:20.645634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:20.645649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:20.645690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895447701220182:4239], now have 1 active actors on pipe
2025-09-30T14:53:20.645908Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:20.645928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:20.645956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:20.645961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:20.645999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895447701220182:4239]
2025-09-30T14:53:20.646036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1162 reason: error at write: Disconnected sessionId: src_id|545fa0a8-15084e3e-d4cc7bd5-ce3efc1_0
2025-09-30T14:53:20.646298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1162 sessionId: src_id|545fa0a8-15084e3e-d4cc7bd5-ce3efc1_0 is DEAD
2025-09-30T14:53:20.646516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|545fa0a8-15084e3e-d4cc7bd5-ce3efc1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:20.646525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|545fa0a8-15084e3e-d4cc7bd5-ce3efc1_0] Write session will restart in 0.008778s
2025-09-30T14:53:20.646558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|545fa0a8-15084e3e-d4cc7bd5-ce3efc1_0] Write session: Do CDS request
2025-09-30T14:53:20.646567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|545fa0a8-15084e3e-d4cc7bd5-ce3efc1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:20.656834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|545fa0a8-15084e3e-d4cc7bd5-ce3efc1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:20.656946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:20.656975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1163
2025-09-30T14:53:20.657195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1163 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:20.657239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1163 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:20.657250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1163 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:20.657254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:20.657819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1163 sessionId:  describe result for acl check
2025-09-30T14:53:20.657857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:20.657859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:20.657861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:20.657866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895447701220259:3771] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:20.658494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895447701220259:3771] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:20.661030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895447701220259:3771] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:20.664010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895447701220259:3771] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:20.664024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895447701220259:3771] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:20.664027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895447701220259:3771] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:20.664041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1163 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:20.665117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:20.667729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:20.667928Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:20.667938Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:20.667949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:20.668001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:20.668045Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895447611471697:7406]
2025-09-30T14:53:20.668771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:20.669111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:20.669157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:20.669507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:20.669572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:20.669580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:20.669581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:20.669582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:20.669584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:20.669586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:20.669587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:20.669588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:20.669590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:20.669591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:20.669592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.669593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.669594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.669596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:20.669597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:20.669603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:20.669615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:20.669619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:20.669624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:20.669629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:20.669633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:20.669637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:20.669642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:20.669646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:20.669651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:20.669656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.669661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.669665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.669669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:20.669674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:20.669683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:20.669691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:20.669698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:20.669709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:20.669720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:20.669726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:20.669736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:20.669743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:20.669749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:20.669760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:20.669769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:20.669780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:20.669790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:20.669797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:20.669802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:20.669808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:20.669817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:20.669829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:20.669838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:20.669849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:20.669858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.669868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.669877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.669887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.669895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.669906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.669915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:20.669925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:20.669938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:20.669948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:20.670000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:20.675691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:20.676570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:20.676588Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:20.676592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:20.676597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:20.676604Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1162 [2:7555895447611471697:7406]
2025-09-30T14:53:20.676621Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:20.676637Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:20.676646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:20.676650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:20.676653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:20.676669Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:20.676676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:20.676684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:20.676757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.676766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.676769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.676773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:20.676775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:20.676844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:20.676853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.676868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.676881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.676901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:20.676931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895447701220184:2454], now have 1 active actors on pipe
2025-09-30T14:53:20.676942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895447701220423:3771], now have 1 active actors on pipe
2025-09-30T14:53:20.676949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895447611471692:7406]
2025-09-30T14:53:20.676951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895447611471692:7406]
2025-09-30T14:53:20.676954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895447611471692:7406]
2025-09-30T14:53:20.676970Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:20.676983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:20.676986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:20.676989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:20.676989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:20.677005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:20.677009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:20.677042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895447611471692:7406]
2025-09-30T14:53:20.677023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1162
2025-09-30T14:53:20.677033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1162
2025-09-30T14:53:20.677052Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:20.677071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:20.677117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:20.677126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:20.677150Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1315178d-d3765cc2-23515da5-c6e49e90_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:20.677161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:20.677170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:20.677172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:20.677183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:20.677196Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:20.677214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:20.677366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:20.677375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:20.677388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:20.677482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1163 partition: 0 MaxSeqNo: 42 sessionId: src_id|1315178d-d3765cc2-23515da5-c6e49e90_0
2025-09-30T14:53:20.677906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|545fa0a8-15084e3e-d4cc7bd5-ce3efc1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1315178d-d3765cc2-23515da5-c6e49e90_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:20.680968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1315178d-d3765cc2-23515da5-c6e49e90_0] Write session: try to update token
2025-09-30T14:53:20.680989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1315178d-d3765cc2-23515da5-c6e49e90_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:20.696770Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:20.696794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:20.696805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895447611471692:7406]
2025-09-30T14:53:20.696862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:20.696875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:20.697065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:20.697231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:20.697391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:20.697558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:20.697770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:20.697814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:20.699650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1163 sessionId: src_id|1315178d-d3765cc2-23515da5-c6e49e90_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:20.701093Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:20.701109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:20.701111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:20.701112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:20.701120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895447611471692:7406]
2025-09-30T14:53:20.701124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895447611471692:7406]
2025-09-30T14:53:20.701127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895447611471692:7406]
2025-09-30T14:53:20.701164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:20.701177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.701180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:20.701188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:20.701195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:20.701199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:20.701338Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:20.702413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:20.746196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895447701220436:4239]
2025-09-30T14:53:20.746519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1162, pipe: [1:7555895447701220436:4239]
2025-09-30T14:53:20.818485Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:20.819147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:20.819164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:20.819189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895447701220436:4239], now have 1 active actors on pipe
2025-09-30T14:53:20.819479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:20.819485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:20.819490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:20.819533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895447701220436:4239]
2025-09-30T14:53:20.819560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1163 reason: error at write: Disconnected sessionId: src_id|1315178d-d3765cc2-23515da5-c6e49e90_0
2025-09-30T14:53:20.819773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1163 sessionId: src_id|1315178d-d3765cc2-23515da5-c6e49e90_0 is DEAD
2025-09-30T14:53:20.819962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1315178d-d3765cc2-23515da5-c6e49e90_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:20.819973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1315178d-d3765cc2-23515da5-c6e49e90_0] Write session will restart in 0.005148s
2025-09-30T14:53:20.819441Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:20.820000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1315178d-d3765cc2-23515da5-c6e49e90_0] Write session: Do CDS request
2025-09-30T14:53:20.820009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1315178d-d3765cc2-23515da5-c6e49e90_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:20.826842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1315178d-d3765cc2-23515da5-c6e49e90_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:20.826964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:20.826984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1164
2025-09-30T14:53:20.827133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1164 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:20.827166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1164 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:20.827176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1164 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:20.827181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:20.827621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1164 sessionId:  describe result for acl check
2025-09-30T14:53:20.827658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:20.827661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:20.827664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:20.827670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895447701220460:3767] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:20.828226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895447701220460:3767] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:20.831014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895447701220460:3767] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:20.834763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895447701220460:3767] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:20.834780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895447701220460:3767] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:20.834784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895447701220460:3767] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:20.834792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1164 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:20.838386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:20.841086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:20.841297Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:20.841313Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:20.841337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:20.841389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:20.841431Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895447611471942:7408]
2025-09-30T14:53:20.842147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:20.842446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:20.842488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:20.842847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:20.842914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:20.842922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:20.842923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:20.842924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:20.842926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:20.842927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:20.842928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:20.842930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:20.842931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:20.842932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:20.842933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.842934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.842935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.842937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:20.842938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:20.842943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:20.842954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:20.842959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:20.842964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:20.842969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:20.842973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:20.842978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:20.842982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:20.842987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:20.842992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:20.842996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.843001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.843005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.843010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:20.843014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:20.843022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:20.843029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:20.843036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:20.843050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:20.843057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:20.843063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:20.843068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:20.843074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:20.843080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:20.843087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:20.843092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:20.843098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:20.843105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:20.843111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:20.843116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:20.843122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:20.843127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:20.843134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:20.843140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:20.843151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:20.843157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.843164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.843174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.843179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.843184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.843191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.843194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:20.843199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:20.843208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:20.843214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:20.843280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:20.848946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:20.850110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:20.850126Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:20.850130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:20.850134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:20.850140Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1163 [2:7555895447611471942:7408]
2025-09-30T14:53:20.850160Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:20.850197Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:20.850206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:20.850210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:20.850212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:20.850228Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:20.850235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:20.850242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:20.850310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.850319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.850321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.850325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:20.850328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:20.850397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:20.850405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.850420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:20.850432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:20.850456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:20.850480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895447701220438:2454], now have 1 active actors on pipe
2025-09-30T14:53:20.850489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895447701220614:3767], now have 1 active actors on pipe
2025-09-30T14:53:20.850496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895447611471937:7408]
2025-09-30T14:53:20.850503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895447611471937:7408]
2025-09-30T14:53:20.850505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895447611471937:7408]
2025-09-30T14:53:20.850518Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:20.850539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:20.850546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:20.850551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:20.850554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:20.850561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:20.850569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:20.850560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1163
2025-09-30T14:53:20.850570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1163
2025-09-30T14:53:20.850616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895447611471937:7408]
2025-09-30T14:53:20.850626Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:20.850628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:20.850648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:20.850652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:20.850700Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7fe98c78-85a7674a-500325c7-33d4acff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:20.850712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:20.850716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:20.850718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:20.850728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:20.850742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:20.850765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:20.850939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:20.850954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:20.850978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:20.851064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1164 partition: 0 MaxSeqNo: 42 sessionId: src_id|7fe98c78-85a7674a-500325c7-33d4acff_0
2025-09-30T14:53:20.851456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1315178d-d3765cc2-23515da5-c6e49e90_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7fe98c78-85a7674a-500325c7-33d4acff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:20.854247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe98c78-85a7674a-500325c7-33d4acff_0] Write session: try to update token
2025-09-30T14:53:20.854262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe98c78-85a7674a-500325c7-33d4acff_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:20.862863Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:20.862882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:20.862885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:20.862887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:20.862897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895447611471937:7408]
2025-09-30T14:53:20.862902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895447611471937:7408]
2025-09-30T14:53:20.862906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895447611471937:7408]
2025-09-30T14:53:20.862943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:20.862950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:20.862949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:20.862953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:20.862956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:20.862960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:20.863102Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:20.869443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1164 sessionId: src_id|7fe98c78-85a7674a-500325c7-33d4acff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:20.872402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:20.919719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895447701220693:4239]
2025-09-30T14:53:20.919956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1163, pipe: [1:7555895447701220693:4239]
2025-09-30T14:53:20.976725Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:20.977361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:20.977378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:20.977415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895447701220693:4239], now have 1 active actors on pipe
2025-09-30T14:53:20.977623Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:20.977632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895447701220693:4239]
2025-09-30T14:53:20.977641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:20.977665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:20.977668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:20.977734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1164 reason: error at write: Disconnected sessionId: src_id|7fe98c78-85a7674a-500325c7-33d4acff_0
2025-09-30T14:53:20.977915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1164 sessionId: src_id|7fe98c78-85a7674a-500325c7-33d4acff_0 is DEAD
2025-09-30T14:53:20.978084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe98c78-85a7674a-500325c7-33d4acff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:20.978107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe98c78-85a7674a-500325c7-33d4acff_0] Write session will restart in 0.007225s
2025-09-30T14:53:20.978129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe98c78-85a7674a-500325c7-33d4acff_0] Write session: Do CDS request
2025-09-30T14:53:20.978136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe98c78-85a7674a-500325c7-33d4acff_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:20.986807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe98c78-85a7674a-500325c7-33d4acff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:20.986879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:20.986898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1165
2025-09-30T14:53:20.987054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1165 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:20.987088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1165 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:20.987093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1165 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:20.987098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:20.987641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1165 sessionId:  describe result for acl check
2025-09-30T14:53:20.987678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:20.987687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:20.987691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:20.987697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895447701220740:3750] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:20.988248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895447701220740:3750] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:20.991156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895447701220740:3750] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:20.994298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895447701220740:3750] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:20.994316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895447701220740:3750] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:20.994320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895447701220740:3750] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:20.994328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1165 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:20.996580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:20.999887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:21.000109Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:21.000119Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:21.000131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:21.000191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:21.000230Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895451906439485:7410]
2025-09-30T14:53:21.000950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:21.001260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:21.001307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:21.001648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:21.001717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:21.001724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:21.001725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:21.001727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:21.001728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:21.001729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:21.001730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:21.001731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:21.001732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:21.001734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:21.001735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.001736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.001737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.001739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:21.001740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:21.001746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:21.001758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:21.001762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:21.001767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:21.001771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:21.001776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:21.001781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:21.001785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:21.001790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:21.001795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:21.001799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.001804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.001808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.001812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:21.001816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:21.001825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:21.001833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:21.001840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:21.001846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:21.001852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:21.001858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:21.001863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:21.001869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:21.001874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:21.001881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:21.001886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:21.001892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:21.001897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:21.001903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:21.001908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:21.001914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:21.001920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:21.001935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:21.001940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:21.001947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:21.001957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.001963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.001972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.001978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.001984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.001994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.001998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:21.002004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:21.002013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:21.002019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:21.002066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:21.007875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:21.008835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:21.008853Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:21.008857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:21.008862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:21.008870Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1164 [2:7555895451906439485:7410]
2025-09-30T14:53:21.008888Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:21.008905Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:21.008908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:21.008911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:21.008915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:21.008931Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:21.008939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:21.008947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:21.009022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.009030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.009033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.009037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:21.009039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:21.009111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:21.009120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.009133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.009145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.009166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:21.009190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895447701220938:3750], now have 1 active actors on pipe
2025-09-30T14:53:21.009199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895447701220696:2454], now have 1 active actors on pipe
2025-09-30T14:53:21.009205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895447611472184:7410]
2025-09-30T14:53:21.009208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895447611472184:7410]
2025-09-30T14:53:21.009210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895447611472184:7410]
2025-09-30T14:53:21.009222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:21.009236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:21.009240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:21.009245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:21.009248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:21.009255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:21.009258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:21.009294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895447611472184:7410]
2025-09-30T14:53:21.009308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:21.009290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1164
2025-09-30T14:53:21.009299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1164
2025-09-30T14:53:21.009337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:21.009347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:21.009352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:21.009382Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7372fe5-b711adf9-b54063a0-6c0055fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:21.009388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:21.009391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:21.009393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:21.009403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:21.009412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:21.009427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:21.009546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:21.009554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:21.009567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:21.009640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1165 partition: 0 MaxSeqNo: 42 sessionId: src_id|7372fe5-b711adf9-b54063a0-6c0055fd_0
2025-09-30T14:53:21.010007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe98c78-85a7674a-500325c7-33d4acff_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7372fe5-b711adf9-b54063a0-6c0055fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:21.013013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7372fe5-b711adf9-b54063a0-6c0055fd_0] Write session: try to update token
2025-09-30T14:53:21.013034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7372fe5-b711adf9-b54063a0-6c0055fd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:21.021775Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:21.021795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:21.021798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:21.021801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:21.021814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895447611472184:7410]
2025-09-30T14:53:21.021819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895447611472184:7410]
2025-09-30T14:53:21.021823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895447611472184:7410]
2025-09-30T14:53:21.021868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:21.021873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:21.021880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:21.021881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.021884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:21.021884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:21.022066Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:21.030074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1165 sessionId: src_id|7372fe5-b711adf9-b54063a0-6c0055fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:21.032854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:21.077948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895451996188271:4239]
2025-09-30T14:53:21.078251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1164, pipe: [1:7555895451996188271:4239]
2025-09-30T14:53:21.140122Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:21.140698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:21.140716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:21.140737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895451996188271:4239], now have 1 active actors on pipe
2025-09-30T14:53:21.140986Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:21.141500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7372fe5-b711adf9-b54063a0-6c0055fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:21.141522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7372fe5-b711adf9-b54063a0-6c0055fd_0] Write session will restart in 0.007600s
2025-09-30T14:53:21.141051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:21.141069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:21.141546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7372fe5-b711adf9-b54063a0-6c0055fd_0] Write session: Do CDS request
2025-09-30T14:53:21.141552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7372fe5-b711adf9-b54063a0-6c0055fd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:21.141132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1165 reason: error at write: Disconnected sessionId: src_id|7372fe5-b711adf9-b54063a0-6c0055fd_0
2025-09-30T14:53:21.141337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1165 sessionId: src_id|7372fe5-b711adf9-b54063a0-6c0055fd_0 is DEAD
2025-09-30T14:53:21.141544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895451996188271:4239]
2025-09-30T14:53:21.141619Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:21.150845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7372fe5-b711adf9-b54063a0-6c0055fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:21.150954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:21.150974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1166
2025-09-30T14:53:21.151134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1166 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:21.151170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1166 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:21.151176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1166 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:21.151181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:21.151658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1166 sessionId:  describe result for acl check
2025-09-30T14:53:21.151697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:21.151707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:21.151709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:21.151715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895451996188327:3743] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:21.152281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895451996188327:3743] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:21.155406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895451996188327:3743] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:21.159280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895451996188327:3743] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:21.159298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895451996188327:3743] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:21.159302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895451996188327:3743] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:21.159311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1166 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:21.161661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:21.164613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:21.164864Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:21.164877Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:21.164887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:21.165015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:21.165056Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895451906439781:7426]
2025-09-30T14:53:21.165719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:21.166170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:21.166250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:21.166617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:21.166721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:21.166729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:21.166731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:21.166732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:21.166733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:21.166735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:21.166736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:21.166737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:21.166739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:21.166740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:21.166742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.166743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.166744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.166746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:21.166747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:21.166753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:21.166764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:21.166769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:21.166773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:21.166778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:21.166782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:21.166786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:21.166791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:21.166795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:21.166800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:21.166804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.166808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.166812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.166816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:21.166820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:21.166830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:21.166839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:21.166845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:21.166852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:21.166857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:21.166863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:21.166869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:21.166874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:21.166879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:21.166885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:21.166893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:21.166898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:21.166903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:21.166909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:21.166919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:21.166924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:21.166934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:21.166940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:21.166944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:21.166949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:21.166953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.166959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.166965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.166986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.166991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.166996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.167001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:21.167006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:21.167011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:21.167016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:21.167073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:21.172716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:21.173884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:21.173899Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:21.173901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:21.173905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:21.173912Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1165 [2:7555895451906439781:7426]
2025-09-30T14:53:21.173929Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:21.173944Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:21.173947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:21.173950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:21.173953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:21.173968Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:21.173980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:21.173986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:21.174048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.174055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.174057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.174060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:21.174063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:21.174141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:21.174149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.174162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.174175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.174196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:21.174219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895451996188525:3743], now have 1 active actors on pipe
2025-09-30T14:53:21.174230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895451996188285:2454], now have 1 active actors on pipe
2025-09-30T14:53:21.174237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895451906439776:7426]
2025-09-30T14:53:21.174241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895451906439776:7426]
2025-09-30T14:53:21.174243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895451906439776:7426]
2025-09-30T14:53:21.174256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:21.174269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:21.174283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:21.174284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:21.174286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:21.174288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:21.174291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:21.174318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895451906439776:7426]
2025-09-30T14:53:21.174308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1165
2025-09-30T14:53:21.174328Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:21.174332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:21.174309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1165
2025-09-30T14:53:21.174360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:21.174370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:21.174403Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|199fa68d-5b754fa7-599f5602-856c3cd3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:21.174413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:21.174417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:21.174421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:21.174430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:21.174443Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:21.174457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:21.174634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:21.174642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:21.174655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:21.174767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1166 partition: 0 MaxSeqNo: 42 sessionId: src_id|199fa68d-5b754fa7-599f5602-856c3cd3_0
2025-09-30T14:53:21.175157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7372fe5-b711adf9-b54063a0-6c0055fd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|199fa68d-5b754fa7-599f5602-856c3cd3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:21.178139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|199fa68d-5b754fa7-599f5602-856c3cd3_0] Write session: try to update token
2025-09-30T14:53:21.178167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|199fa68d-5b754fa7-599f5602-856c3cd3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:21.189543Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:21.189559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:21.189561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:21.189562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:21.189570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895451906439776:7426]
2025-09-30T14:53:21.189573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895451906439776:7426]
2025-09-30T14:53:21.189577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895451906439776:7426]
2025-09-30T14:53:21.189609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:21.189614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.189617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:21.189622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:21.189629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:21.189633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:21.189759Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:21.194194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1166 sessionId: src_id|199fa68d-5b754fa7-599f5602-856c3cd3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:21.197182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:21.241808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895451996188551:4239]
2025-09-30T14:53:21.242096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1165, pipe: [1:7555895451996188551:4239]
2025-09-30T14:53:21.304765Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:21.305304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:21.305324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:21.305363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895451996188551:4239], now have 1 active actors on pipe
2025-09-30T14:53:21.305589Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:21.305620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895451996188551:4239]
2025-09-30T14:53:21.305628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:21.305633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:21.305651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:21.305710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1166 reason: error at write: Disconnected sessionId: src_id|199fa68d-5b754fa7-599f5602-856c3cd3_0
2025-09-30T14:53:21.305903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1166 sessionId: src_id|199fa68d-5b754fa7-599f5602-856c3cd3_0 is DEAD
2025-09-30T14:53:21.306041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|199fa68d-5b754fa7-599f5602-856c3cd3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:21.306051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|199fa68d-5b754fa7-599f5602-856c3cd3_0] Write session will restart in 0.007515s
2025-09-30T14:53:21.306068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|199fa68d-5b754fa7-599f5602-856c3cd3_0] Write session: Do CDS request
2025-09-30T14:53:21.306072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|199fa68d-5b754fa7-599f5602-856c3cd3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:21.314762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|199fa68d-5b754fa7-599f5602-856c3cd3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:21.314878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:21.314907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1167
2025-09-30T14:53:21.315051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1167 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:21.315093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1167 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:21.315103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1167 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:21.315108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:21.315603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1167 sessionId:  describe result for acl check
2025-09-30T14:53:21.315634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:21.315639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:21.315641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:21.315645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895451996188587:3736] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:21.316113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895451996188587:3736] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:21.319133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895451996188587:3736] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:21.322073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895451996188587:3736] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:21.322098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895451996188587:3736] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:21.322101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895451996188587:3736] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:21.322109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1167 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:21.324985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:21.327683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:21.327993Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:21.328004Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:21.328014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:21.328065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:21.328095Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895451906440028:7428]
2025-09-30T14:53:21.328687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:21.329023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:21.329072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:21.329407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:21.329457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:21.329462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:21.329462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:21.329463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:21.329464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:21.329465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:21.329466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:21.329466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:21.329467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:21.329468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:21.329469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.329469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.329470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.329471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:21.329472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:21.329476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:21.329482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:21.329485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:21.329487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:21.329489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:21.329492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:21.329494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:21.329497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:21.329499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:21.329502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:21.329504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.329506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.329509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.329511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:21.329513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:21.329520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:21.329525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:21.329529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:21.329533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:21.329535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:21.329539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:21.329541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:21.329544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:21.329548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:21.329551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:21.329553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:21.329557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:21.329560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:21.329563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:21.329567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:21.329574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:21.329578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:21.329583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:21.329586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:21.329591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:21.329596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.329601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.329605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.329610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.329614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.329618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.329620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:21.329623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:21.329626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:21.329628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:21.329654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:21.335308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:21.336188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:21.336203Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:21.336206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:21.336210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:21.336217Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1166 [2:7555895451906440028:7428]
2025-09-30T14:53:21.336235Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:21.336250Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:21.336253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:21.336257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:21.336259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:21.336275Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:21.336283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:21.336291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:21.336353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.336361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.336363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.336368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:21.336370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:21.336438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:21.336447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.336460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.336472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.336488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:21.336512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895451996188770:3736], now have 1 active actors on pipe
2025-09-30T14:53:21.336520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895451996188553:2454], now have 1 active actors on pipe
2025-09-30T14:53:21.336526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895451906440023:7428]
2025-09-30T14:53:21.336529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895451906440023:7428]
2025-09-30T14:53:21.336531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895451906440023:7428]
2025-09-30T14:53:21.336542Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:21.336556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:21.336564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:21.336567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:21.336570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:21.336574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:21.336577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:21.336578Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1166
2025-09-30T14:53:21.336614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895451906440023:7428]
2025-09-30T14:53:21.336583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1166
2025-09-30T14:53:21.336622Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:21.336625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:21.336649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:21.336657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:21.336900Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f775938d-311593af-f6f7f60c-4ec5ddb2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:21.336913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:21.336917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:21.336919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:21.336928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:21.336936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:21.336958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:21.337138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:21.337153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:21.337178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:21.337290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1167 partition: 0 MaxSeqNo: 42 sessionId: src_id|f775938d-311593af-f6f7f60c-4ec5ddb2_0
2025-09-30T14:53:21.337722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|199fa68d-5b754fa7-599f5602-856c3cd3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f775938d-311593af-f6f7f60c-4ec5ddb2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:21.340615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f775938d-311593af-f6f7f60c-4ec5ddb2_0] Write session: try to update token
2025-09-30T14:53:21.340637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f775938d-311593af-f6f7f60c-4ec5ddb2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:21.348938Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:21.348954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:21.348955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:21.348957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:21.348964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895451906440023:7428]
2025-09-30T14:53:21.348972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895451906440023:7428]
2025-09-30T14:53:21.348975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895451906440023:7428]
2025-09-30T14:53:21.349005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:21.349010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.349012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:21.349015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:21.349022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:21.349026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:21.349155Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:21.355527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1167 sessionId: src_id|f775938d-311593af-f6f7f60c-4ec5ddb2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:21.358358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:21.405642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895451996188809:4239]
2025-09-30T14:53:21.405946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1166, pipe: [1:7555895451996188809:4239]
2025-09-30T14:53:21.462590Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:21.463019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:21.463035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:21.463073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895451996188809:4239], now have 1 active actors on pipe
2025-09-30T14:53:21.463403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895451996188809:4239]
2025-09-30T14:53:21.463411Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:21.463440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:21.463514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1167 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f775938d-311593af-f6f7f60c-4ec5ddb2_0
2025-09-30T14:53:21.463720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1167 sessionId: src_id|f775938d-311593af-f6f7f60c-4ec5ddb2_0 is DEAD
2025-09-30T14:53:21.463326Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:21.463968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f775938d-311593af-f6f7f60c-4ec5ddb2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:21.463979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f775938d-311593af-f6f7f60c-4ec5ddb2_0] Write session will restart in 0.007693s
2025-09-30T14:53:21.464003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f775938d-311593af-f6f7f60c-4ec5ddb2_0] Write session: Do CDS request
2025-09-30T14:53:21.464009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f775938d-311593af-f6f7f60c-4ec5ddb2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:21.472853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f775938d-311593af-f6f7f60c-4ec5ddb2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:21.472939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:21.472956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1168
2025-09-30T14:53:21.473092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1168 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:21.473126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1168 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:21.473131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1168 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:21.473147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:21.473639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1168 sessionId:  describe result for acl check
2025-09-30T14:53:21.473688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:21.473693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:21.473696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:21.473703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895451996188849:3732] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:21.474280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895451996188849:3732] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:21.477219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895451996188849:3732] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:21.480241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895451996188849:3732] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:21.480257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895451996188849:3732] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:21.480260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895451996188849:3732] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:21.480268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1168 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:21.482371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:21.485073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:21.485476Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:21.485488Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:21.485501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:21.485594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:21.485639Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895451906440276:7430]
2025-09-30T14:53:21.486298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:21.486675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:21.486729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:21.487085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:21.487159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:21.487165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:21.487166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:21.487168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:21.487169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:21.487170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:21.487172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:21.487173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:21.487174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:21.487175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:21.487177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.487178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.487179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.487180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:21.487181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:21.487187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:21.487197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:21.487202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:21.487206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:21.487210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:21.487215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:21.487219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:21.487223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:21.487227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:21.487231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:21.487235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.487239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.487278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.487283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:21.487287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:21.487296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:21.487308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:21.487314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:21.487320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:21.487328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:21.487333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:21.487339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:21.487348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:21.487352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:21.487356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:21.487360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:21.487365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:21.487374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:21.487379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:21.487383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:21.487388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:21.487394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:21.487402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:21.487406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:21.487411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:21.487415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.487419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.487423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.487428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.487433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.487438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.487443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:21.487453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:21.487457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:21.487462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:21.487507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:21.492976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:21.494150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:21.494163Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:21.494165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:21.494168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:21.494173Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1167 [2:7555895451906440276:7430]
2025-09-30T14:53:21.494185Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:21.494198Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:21.494202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:21.494205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:21.494207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:21.494221Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:21.494233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:21.494245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:21.494304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.494316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.494318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.494321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:21.494324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:21.494379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:21.494387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.494400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.494411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.494430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:21.494454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895451996189054:3732], now have 1 active actors on pipe
2025-09-30T14:53:21.494462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895451996188810:2454], now have 1 active actors on pipe
2025-09-30T14:53:21.494466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895451906440271:7430]
2025-09-30T14:53:21.494468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895451906440271:7430]
2025-09-30T14:53:21.494470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895451906440271:7430]
2025-09-30T14:53:21.494479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:21.494490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:21.494496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:21.494500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:21.494503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:21.494505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:21.494507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:21.494536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895451906440271:7430]
2025-09-30T14:53:21.494549Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:21.494564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:21.494546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1167
2025-09-30T14:53:21.494551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1167
2025-09-30T14:53:21.494596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:21.494606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:21.494631Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44f841b-eb2215f7-43ce2536-45130053_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:21.494642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:21.494645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:21.494648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:21.494658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:21.494671Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:21.494686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:21.494816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:21.494825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:21.494837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:21.494918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1168 partition: 0 MaxSeqNo: 42 sessionId: src_id|44f841b-eb2215f7-43ce2536-45130053_0
2025-09-30T14:53:21.495319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f775938d-311593af-f6f7f60c-4ec5ddb2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|44f841b-eb2215f7-43ce2536-45130053_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:21.498146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44f841b-eb2215f7-43ce2536-45130053_0] Write session: try to update token
2025-09-30T14:53:21.498165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44f841b-eb2215f7-43ce2536-45130053_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:21.512631Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:21.512650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:21.512659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895451906440271:7430]
2025-09-30T14:53:21.512707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:21.512709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:21.512892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:21.513053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:21.513203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:21.513279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1168 sessionId: src_id|44f841b-eb2215f7-43ce2536-45130053_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:21.513345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:21.513568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:21.513620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:21.516101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:21.516271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:21.516286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:21.516321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:21.516429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:21.517461Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:21.517474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:21.517475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:21.517477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:21.517484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895451906440271:7430]
2025-09-30T14:53:21.517487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895451906440271:7430]
2025-09-30T14:53:21.517490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895451906440271:7430]
2025-09-30T14:53:21.517518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:21.517523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.517524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:21.517565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:21.517600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:21.517605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:21.517648Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:21.563347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895451996189070:4239]
2025-09-30T14:53:21.563639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1167, pipe: [1:7555895451996189070:4239]
2025-09-30T14:53:21.629450Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:21.637469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:21.637495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:21.637663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:21.637730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:21.637795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:21.637861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:21.637905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:21.637913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:21.637976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:21.638037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:21.638116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:21.638185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:21.638231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:21.638240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:21.638313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:21.638377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:21.638435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:21.638503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:21.638549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:21.638560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:21.638628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:21.638698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:21.638760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:21.638826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:21.638868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:21.638875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:21.638943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:21.639042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:21.639103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:21.639162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:21.639212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:21.639220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:21.639303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:21.639363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:21.639421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:21.639481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:21.639528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:21.639537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:21.639601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:21.639657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:21.639717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:21.639777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:21.639833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:21.639839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:21.639899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:21.639955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:21.640020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:21.640084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:21.640125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:21.640130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:21.640189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:21.640245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:21.640308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:21.640378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:21.640421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:21.640426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:21.640486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:21.640540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:21.640601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:21.640667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:21.640713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:21.640719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:21.640772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895451996189070:4239], now have 1 active actors on pipe
2025-09-30T14:53:21.641015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895451996189070:4239]
2025-09-30T14:53:21.641040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:21.641042Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:21.641044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:21.641073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1168 reason: error at write: Disconnected sessionId: src_id|44f841b-eb2215f7-43ce2536-45130053_0
2025-09-30T14:53:21.641265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1168 sessionId: src_id|44f841b-eb2215f7-43ce2536-45130053_0 is DEAD
2025-09-30T14:53:21.641372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44f841b-eb2215f7-43ce2536-45130053_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:21.641381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44f841b-eb2215f7-43ce2536-45130053_0] Write session will restart in 0.009043s
2025-09-30T14:53:21.641405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44f841b-eb2215f7-43ce2536-45130053_0] Write session: Do CDS request
2025-09-30T14:53:21.641410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44f841b-eb2215f7-43ce2536-45130053_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:21.641927Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:21.651813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44f841b-eb2215f7-43ce2536-45130053_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:21.652715Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:21.652737Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1169
2025-09-30T14:53:21.652867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1169 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:21.652905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1169 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:21.652915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1169 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:21.652922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:21.653387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1169 sessionId:  describe result for acl check
2025-09-30T14:53:21.653432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:21.653434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:21.653436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:21.653441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895451996189186:3720] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:21.653999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895451996189186:3720] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:21.656993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895451996189186:3720] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:21.658570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:21.661162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:21.661367Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:21.661377Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:21.661386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:21.661438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:21.661477Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895451906440526:7433]
2025-09-30T14:53:21.661459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895451996189186:3720] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:21.661477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895451996189186:3720] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:21.661481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895451996189186:3720] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:21.661489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1169 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:21.662152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:21.662448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:21.662504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:21.662770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:21.662817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:21.662821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:21.662822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:21.662823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:21.662824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:21.662824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:21.662825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:21.662826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:21.662827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:21.662827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:21.662829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.662829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.662830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.662830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:21.662831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:21.662835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:21.662842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:21.662844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:21.662847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:21.662850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:21.662852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:21.662854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:21.662857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:21.662859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:21.662862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:21.662864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.662866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.662869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.662871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:21.662874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:21.662880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:21.662885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:21.662889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:21.662892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:21.662895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:21.662898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:21.662900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:21.662903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:21.662906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:21.662909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:21.662911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:21.662914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:21.662917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:21.662920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:21.662923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:21.662926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:21.662930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:21.662933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:21.662935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:21.662938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:21.662942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.662945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.662948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.662950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.662953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.662956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.662958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:21.662961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:21.662964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:21.662966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:21.662999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:21.668212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:21.669254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:21.669269Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:21.669272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:21.669275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:21.669281Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1168 [2:7555895451906440526:7433]
2025-09-30T14:53:21.669295Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:21.669316Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:21.669319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:21.669321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:21.669323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:21.669337Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:21.669343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:21.669351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:21.669402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.669408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.669410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.669432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:21.669434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:21.669497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:21.669506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.669518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.669532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.669552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:21.669572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895451996189324:3720], now have 1 active actors on pipe
2025-09-30T14:53:21.669580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895451996189072:2454], now have 1 active actors on pipe
2025-09-30T14:53:21.669586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895451906440521:7433]
2025-09-30T14:53:21.669588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895451906440521:7433]
2025-09-30T14:53:21.669590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895451906440521:7433]
2025-09-30T14:53:21.669601Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:21.669613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:21.669615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:21.669618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:21.669584Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1168
2025-09-30T14:53:21.669619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:21.669588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1168
2025-09-30T14:53:21.669628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:21.669630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:21.669674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:21.669684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:21.669696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895451906440521:7433]
2025-09-30T14:53:21.669708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:21.669715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:21.669732Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67eb82b2-623ad92c-a58ee1c2-46d05ddb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:21.669744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:21.669747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:21.669749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:21.669758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:21.669770Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:21.669792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:21.670184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:21.670193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:21.670209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:21.670304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1169 partition: 0 MaxSeqNo: 42 sessionId: src_id|67eb82b2-623ad92c-a58ee1c2-46d05ddb_0
2025-09-30T14:53:21.670758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44f841b-eb2215f7-43ce2536-45130053_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|67eb82b2-623ad92c-a58ee1c2-46d05ddb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:21.674256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67eb82b2-623ad92c-a58ee1c2-46d05ddb_0] Write session: try to update token
2025-09-30T14:53:21.674285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67eb82b2-623ad92c-a58ee1c2-46d05ddb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:21.681426Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:21.681443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:21.681445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:21.681447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:21.681455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895451906440521:7433]
2025-09-30T14:53:21.681469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895451906440521:7433]
2025-09-30T14:53:21.681473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895451906440521:7433]
2025-09-30T14:53:21.681513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:21.681521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:21.681524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.681527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:21.681527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:21.681535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:21.681657Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:21.692194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1169 sessionId: src_id|67eb82b2-623ad92c-a58ee1c2-46d05ddb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:21.695050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:21.740989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895451996189336:4239]
2025-09-30T14:53:21.741282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1168, pipe: [1:7555895451996189336:4239]
2025-09-30T14:53:21.793215Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:21.793859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:21.793873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:21.793892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895451996189336:4239], now have 1 active actors on pipe
2025-09-30T14:53:21.794131Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:21.794145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895451996189336:4239]
2025-09-30T14:53:21.794171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:21.794177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:21.794182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:21.794255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1169 reason: error at write: Disconnected sessionId: src_id|67eb82b2-623ad92c-a58ee1c2-46d05ddb_0
2025-09-30T14:53:21.794491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1169 sessionId: src_id|67eb82b2-623ad92c-a58ee1c2-46d05ddb_0 is DEAD
2025-09-30T14:53:21.794639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67eb82b2-623ad92c-a58ee1c2-46d05ddb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:21.794650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67eb82b2-623ad92c-a58ee1c2-46d05ddb_0] Write session will restart in 0.006821s
2025-09-30T14:53:21.794672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67eb82b2-623ad92c-a58ee1c2-46d05ddb_0] Write session: Do CDS request
2025-09-30T14:53:21.794678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67eb82b2-623ad92c-a58ee1c2-46d05ddb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:21.802795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67eb82b2-623ad92c-a58ee1c2-46d05ddb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:21.802922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:21.802939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1170
2025-09-30T14:53:21.803121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1170 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:21.803156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1170 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:21.803166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1170 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:21.803172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:21.803650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1170 sessionId:  describe result for acl check
2025-09-30T14:53:21.803698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:21.803705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:21.803707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:21.803713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895451996189365:3714] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:21.804287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895451996189365:3714] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:21.807675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895451996189365:3714] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:21.810628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895451996189365:3714] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:21.810640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895451996189365:3714] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:21.810643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895451996189365:3714] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:21.810652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1170 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:21.813241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:21.815886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:21.816077Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:21.816088Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:21.816098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:21.816148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:21.816200Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895451906440777:7435]
2025-09-30T14:53:21.816867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:21.817140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:21.817181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:21.817507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:21.817563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:21.817569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:21.817570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:21.817571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:21.817572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:21.817573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:21.817574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:21.817575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:21.817577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:21.817578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:21.817579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.817580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.817581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.817583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:21.817584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:21.817589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:21.817601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:21.817605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:21.817609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:21.817613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:21.817618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:21.817622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:21.817626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:21.817630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:21.817635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:21.817639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.817643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.817647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.817651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:21.817655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:21.817661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:21.817669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:21.817675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:21.817681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:21.817690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:21.817695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:21.817700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:21.817710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:21.817715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:21.817725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:21.817729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:21.817734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:21.817743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:21.817750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:21.817758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:21.817764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:21.817770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:21.817780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:21.817789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:21.817795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:21.817803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.817807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.817811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.817816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.817821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.817827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.817831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:21.817841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:21.817849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:21.817858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:21.817908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:21.823285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:21.824109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:21.824123Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:21.824126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:21.824130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:21.824137Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1169 [2:7555895451906440777:7435]
2025-09-30T14:53:21.824152Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:21.824166Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:21.824169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:21.824172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:21.824176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:21.824191Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:21.824203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:21.824212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:21.824277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.824284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.824286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.824290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:21.824293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:21.824354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:21.824361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.824384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:21.824401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:21.824420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:21.824444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895451996189554:3714], now have 1 active actors on pipe
2025-09-30T14:53:21.824452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895451996189337:2454], now have 1 active actors on pipe
2025-09-30T14:53:21.824460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895451906440772:7435]
2025-09-30T14:53:21.824462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895451906440772:7435]
2025-09-30T14:53:21.824465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895451906440772:7435]
2025-09-30T14:53:21.824481Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:21.824501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:21.824519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:21.824528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:21.824547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:21.824551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:21.824554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895451906440772:7435]
2025-09-30T14:53:21.824529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1169
2025-09-30T14:53:21.824554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:21.824562Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1169
2025-09-30T14:53:21.824557Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:21.824561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:21.824640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:21.824650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:21.824676Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2586c5a3-822fcb08-45444e1-7703e83e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:21.824686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:21.824690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:21.824693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:21.824702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:21.824715Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:21.824734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:21.824982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:21.824991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:21.825007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:21.825108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1170 partition: 0 MaxSeqNo: 42 sessionId: src_id|2586c5a3-822fcb08-45444e1-7703e83e_0
2025-09-30T14:53:21.825520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67eb82b2-623ad92c-a58ee1c2-46d05ddb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2586c5a3-822fcb08-45444e1-7703e83e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:21.828518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2586c5a3-822fcb08-45444e1-7703e83e_0] Write session: try to update token
2025-09-30T14:53:21.828536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2586c5a3-822fcb08-45444e1-7703e83e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:21.837036Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:21.837053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:21.837062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895451906440772:7435]
2025-09-30T14:53:21.837106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:21.837119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:21.837306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:21.837464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:21.837612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:21.837775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:21.837993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:21.838036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:21.843284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1170 sessionId: src_id|2586c5a3-822fcb08-45444e1-7703e83e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:21.845846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:21.846070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:21.846101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:21.846149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:21.846241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:21.847336Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:21.847349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:21.847352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:21.847355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:21.847364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895451906440772:7435]
2025-09-30T14:53:21.847369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895451906440772:7435]
2025-09-30T14:53:21.847374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895451906440772:7435]
2025-09-30T14:53:21.847412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:21.847427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:21.847430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:21.847430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:21.847437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:21.847442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:21.847556Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:21.894079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895451996189598:4239]
2025-09-30T14:53:21.894391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1169, pipe: [1:7555895451996189598:4239]
2025-09-30T14:53:21.966622Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:21.975451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:21.975482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:21.975663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:21.975742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:21.975811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:21.975884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:21.975939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:21.975955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:21.976034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:21.976099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:21.976168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:21.976240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:21.976291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:21.976300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:21.976374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:21.976441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:21.976516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:21.976587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:21.976642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:21.976651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:21.976727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:21.976796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:21.976867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:21.976938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:21.976989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:21.976998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:21.977074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:21.977140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:21.977209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:21.977279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:21.977330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:21.977338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:21.977412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:21.977481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:21.977553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:21.977626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:21.977678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:21.977687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:21.977757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:21.977827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:21.977897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:21.977967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:21.978019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:21.978029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:21.978114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:21.978180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:21.978247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:21.978319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:21.978372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:21.978380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:21.978451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:21.978517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:21.978586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:21.978656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:21.978707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:21.978717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:21.978787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:21.978856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:21.978927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:21.978996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:21.979068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:21.979076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:21.979147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895451996189598:4239], now have 1 active actors on pipe
2025-09-30T14:53:21.979412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:21.979421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:21.979427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:21.979460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1170 reason: error at write: Disconnected sessionId: src_id|2586c5a3-822fcb08-45444e1-7703e83e_0
2025-09-30T14:53:21.979475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895451996189598:4239]
2025-09-30T14:53:21.979675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1170 sessionId: src_id|2586c5a3-822fcb08-45444e1-7703e83e_0 is DEAD
2025-09-30T14:53:21.979837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2586c5a3-822fcb08-45444e1-7703e83e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:21.979846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2586c5a3-822fcb08-45444e1-7703e83e_0] Write session will restart in 0.006544s
2025-09-30T14:53:21.979868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2586c5a3-822fcb08-45444e1-7703e83e_0] Write session: Do CDS request
2025-09-30T14:53:21.979874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2586c5a3-822fcb08-45444e1-7703e83e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:21.980843Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:21.987809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2586c5a3-822fcb08-45444e1-7703e83e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:21.987882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:21.987896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1171
2025-09-30T14:53:21.988074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1171 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:21.988105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1171 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:21.988112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1171 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:21.988118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:21.988552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1171 sessionId:  describe result for acl check
2025-09-30T14:53:21.988585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:21.988587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:21.988589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:21.988595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895451996189615:3710] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:21.989160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895451996189615:3710] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:21.991722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895451996189615:3710] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:21.996106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895451996189615:3710] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:21.996121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895451996189615:3710] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:21.996124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895451996189615:3710] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:21.996132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1171 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:22.001297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:22.003940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:22.004158Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:22.004169Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:22.004180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:22.004238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:22.004296Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895456201408325:7437]
2025-09-30T14:53:22.004965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:22.005320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:22.005370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:22.005725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:22.005801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:22.005807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:22.005809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:22.005810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:22.005811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:22.005812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:22.005813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:22.005815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:22.005816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:22.005817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:22.005818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.005819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.005821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.005822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:22.005823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:22.005829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:22.005840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:22.005844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:22.005848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:22.005851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:22.005855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:22.005858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:22.005862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:22.005865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:22.005869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:22.005873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.005876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.005880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.005884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:22.005887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:22.005896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:22.005903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:22.005910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:22.005914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:22.005919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:22.005924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:22.005928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:22.005934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:22.005938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:22.005944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:22.005948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:22.005954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:22.005958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:22.005974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:22.005978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:22.005984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:22.005988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:22.005999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:22.006003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:22.006009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:22.006017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.006024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.006034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.006040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.006049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.006054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.006059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:22.006064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:22.006073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:22.006079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:22.006157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:22.011828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:22.012846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:22.012861Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:22.012864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:22.012868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:22.012884Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1170 [2:7555895456201408325:7437]
2025-09-30T14:53:22.012901Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:22.012915Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:22.012923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:22.012926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:22.012929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:22.012946Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:22.012953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:22.012960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:22.013019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.013026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.013029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.013033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:22.013035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:22.013104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:22.013111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.013124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.013139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.013161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:22.013183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895451996189744:3710], now have 1 active actors on pipe
2025-09-30T14:53:22.013192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895451996189602:2454], now have 1 active actors on pipe
2025-09-30T14:53:22.013199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895456201408320:7437]
2025-09-30T14:53:22.013201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895456201408320:7437]
2025-09-30T14:53:22.013203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895456201408320:7437]
2025-09-30T14:53:22.013215Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:22.013228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:22.013229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:22.013233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:22.013235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:22.013247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:22.013250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:22.013281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895456201408320:7437]
2025-09-30T14:53:22.013297Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:22.013291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1170
2025-09-30T14:53:22.013310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:22.013397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1170
2025-09-30T14:53:22.013765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:22.013781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:22.013810Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e908ed7a-cc7a4b2c-92a42375-ed314699_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:22.013823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:22.013827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:22.013830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:22.013841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:22.013853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:22.013868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:22.014061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:22.014070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:22.014101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:22.014245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1171 partition: 0 MaxSeqNo: 42 sessionId: src_id|e908ed7a-cc7a4b2c-92a42375-ed314699_0
2025-09-30T14:53:22.014685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2586c5a3-822fcb08-45444e1-7703e83e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e908ed7a-cc7a4b2c-92a42375-ed314699_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:22.017480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e908ed7a-cc7a4b2c-92a42375-ed314699_0] Write session: try to update token
2025-09-30T14:53:22.017497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e908ed7a-cc7a4b2c-92a42375-ed314699_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:22.025987Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:22.026009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:22.026019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895456201408320:7437]
2025-09-30T14:53:22.026064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:22.026072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:22.026275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:22.026414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:22.026559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:22.026697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:22.027083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:22.027130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:22.033254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1171 sessionId: src_id|e908ed7a-cc7a4b2c-92a42375-ed314699_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:22.036083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:22.036260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:22.036280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:22.036326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:22.036428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:22.039479Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:22.039497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:22.039500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:22.039502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:22.039513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895456201408320:7437]
2025-09-30T14:53:22.039517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895456201408320:7437]
2025-09-30T14:53:22.039521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895456201408320:7437]
2025-09-30T14:53:22.039567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:22.039574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.039577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:22.039585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:22.039601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:22.039606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:22.039716Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:22.079422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895456291157161:4239]
2025-09-30T14:53:22.079703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1170, pipe: [1:7555895456291157161:4239]
2025-09-30T14:53:22.159080Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:22.167576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:22.167605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:22.167792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:22.167865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:22.167944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:22.168011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:22.168126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:22.168137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:22.168218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:22.168283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:22.168352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:22.168423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:22.168474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:22.168483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:22.168561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:22.168629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:22.168698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:22.168772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:22.168825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:22.168832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:22.168902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:22.168972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:22.169040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:22.169113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:22.169161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:22.169169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:22.169240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:22.169307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:22.169376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:22.169449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:22.169568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:22.169577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:22.169645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:22.169712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:22.169784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:22.169857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:22.169906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:22.169914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:22.169984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:22.170051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:22.170140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:22.170211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:22.170260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:22.170267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:22.170338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:22.170405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:22.170476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:22.170545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:22.170595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:22.170606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:22.170676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:22.170744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:22.170852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:22.170926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:22.170975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:22.170982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:22.171056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:22.171118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:22.171183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:22.171294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:22.171339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:22.171346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:22.171417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895456291157161:4239], now have 1 active actors on pipe
2025-09-30T14:53:22.171668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:22.171685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:22.171712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1171 reason: error at write: Disconnected sessionId: src_id|e908ed7a-cc7a4b2c-92a42375-ed314699_0
2025-09-30T14:53:22.171927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1171 sessionId: src_id|e908ed7a-cc7a4b2c-92a42375-ed314699_0 is DEAD
2025-09-30T14:53:22.172108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e908ed7a-cc7a4b2c-92a42375-ed314699_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:22.172119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e908ed7a-cc7a4b2c-92a42375-ed314699_0] Write session will restart in 0.006854s
2025-09-30T14:53:22.172144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e908ed7a-cc7a4b2c-92a42375-ed314699_0] Write session: Do CDS request
2025-09-30T14:53:22.172149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e908ed7a-cc7a4b2c-92a42375-ed314699_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:22.172142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:22.172187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895456291157161:4239]
2025-09-30T14:53:22.172679Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:22.179785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e908ed7a-cc7a4b2c-92a42375-ed314699_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:22.179861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:22.179879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1172
2025-09-30T14:53:22.179985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1172 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:22.180017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1172 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:22.180028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1172 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:22.180033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:22.180488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1172 sessionId:  describe result for acl check
2025-09-30T14:53:22.180525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:22.180532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:22.180534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:22.180540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895456291157226:3692] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:22.181077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895456291157226:3692] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:22.183632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895456291157226:3692] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:22.187069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895456291157226:3692] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:22.187086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895456291157226:3692] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:22.187089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895456291157226:3692] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:22.187097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1172 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:22.191501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:22.194320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:22.194599Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:22.194611Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:22.194622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:22.194698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:22.194741Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895456201408628:7453]
2025-09-30T14:53:22.195471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:22.195797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:22.195849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:22.196199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:22.196266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:22.196272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:22.196273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:22.196275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:22.196276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:22.196277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:22.196278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:22.196280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:22.196281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:22.196282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:22.196284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.196285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.196286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.196288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:22.196289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:22.196295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:22.196307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:22.196312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:22.196316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:22.196321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:22.196326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:22.196330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:22.196335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:22.196339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:22.196344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:22.196348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.196353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.196357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.196362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:22.196367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:22.196374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:22.196383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:22.196389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:22.196396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:22.196401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:22.196410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:22.196416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:22.196427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:22.196433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:22.196443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:22.196448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:22.196455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:22.196465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:22.196470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:22.196477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:22.196483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:22.196491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:22.196497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:22.196502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:22.196510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:22.196519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.196527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.196537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.196542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.196549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.196556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.196565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:22.196571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:22.196580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:22.196586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:22.196633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:22.202116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:22.203497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:22.203520Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:22.203523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:22.203527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:22.203533Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1171 [2:7555895456201408628:7453]
2025-09-30T14:53:22.203551Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:22.203566Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:22.203570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:22.203573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:22.203575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:22.203591Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:22.203604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:22.203611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:22.203682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.203690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.203692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.203696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:22.203699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:22.203764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:22.203776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.203789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.203802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.203824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:22.203847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895456201408623:7453]
2025-09-30T14:53:22.203855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895456201408623:7453]
2025-09-30T14:53:22.203858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895456201408623:7453]
2025-09-30T14:53:22.203874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:22.203888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895456291157192:2454], now have 1 active actors on pipe
2025-09-30T14:53:22.203898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895456291157368:3692], now have 1 active actors on pipe
2025-09-30T14:53:22.203906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:22.203911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:22.203915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:22.203917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:22.203923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:22.203926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:22.203959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895456201408623:7453]
2025-09-30T14:53:22.203969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:22.203978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:22.203951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1171
2025-09-30T14:53:22.203958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1171
2025-09-30T14:53:22.204009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:22.204018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:22.204051Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2263f71a-a0fd46aa-1f386b92-7a36ffba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:22.204066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:22.204069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:22.204072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:22.204083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:22.204092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:22.204106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:22.204310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:22.204318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:22.204333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:22.204419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1172 partition: 0 MaxSeqNo: 42 sessionId: src_id|2263f71a-a0fd46aa-1f386b92-7a36ffba_0
2025-09-30T14:53:22.204842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e908ed7a-cc7a4b2c-92a42375-ed314699_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2263f71a-a0fd46aa-1f386b92-7a36ffba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:22.207719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2263f71a-a0fd46aa-1f386b92-7a36ffba_0] Write session: try to update token
2025-09-30T14:53:22.207739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2263f71a-a0fd46aa-1f386b92-7a36ffba_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:22.216235Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:22.216259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:22.216262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:22.216264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:22.216276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895456201408623:7453]
2025-09-30T14:53:22.216282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895456201408623:7453]
2025-09-30T14:53:22.216286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895456201408623:7453]
2025-09-30T14:53:22.216331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:22.216341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.216341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:22.216344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:22.216348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:22.216354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:22.216492Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:22.226429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1172 sessionId: src_id|2263f71a-a0fd46aa-1f386b92-7a36ffba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:22.229291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:22.272492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895456291157462:4239]
2025-09-30T14:53:22.274019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1171, pipe: [1:7555895456291157462:4239]
2025-09-30T14:53:22.335464Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:22.336018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:22.336034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:22.336053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895456291157462:4239], now have 1 active actors on pipe
2025-09-30T14:53:22.336271Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:22.336295Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:22.336354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895456291157462:4239]
2025-09-30T14:53:22.336390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:22.336468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1172 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2263f71a-a0fd46aa-1f386b92-7a36ffba_0
2025-09-30T14:53:22.336660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1172 sessionId: src_id|2263f71a-a0fd46aa-1f386b92-7a36ffba_0 is DEAD
2025-09-30T14:53:22.336856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2263f71a-a0fd46aa-1f386b92-7a36ffba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:22.336866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2263f71a-a0fd46aa-1f386b92-7a36ffba_0] Write session will restart in 0.008661s
2025-09-30T14:53:22.336884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2263f71a-a0fd46aa-1f386b92-7a36ffba_0] Write session: Do CDS request
2025-09-30T14:53:22.336889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2263f71a-a0fd46aa-1f386b92-7a36ffba_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:22.346834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2263f71a-a0fd46aa-1f386b92-7a36ffba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:22.346912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:22.346929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1173
2025-09-30T14:53:22.347084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1173 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:22.347117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1173 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:22.347123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1173 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:22.347127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:22.347658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1173 sessionId:  describe result for acl check
2025-09-30T14:53:22.347695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:22.347703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:22.347704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:22.347711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895456291157531:3686] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:22.348274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895456291157531:3686] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:22.350913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895456291157531:3686] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:22.353824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895456291157531:3686] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:22.353850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895456291157531:3686] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:22.353855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895456291157531:3686] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:22.353863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1173 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:22.355525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:22.358187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:22.358413Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:22.358425Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:22.358439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:22.358504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:22.358551Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895456201408882:7455]
2025-09-30T14:53:22.359227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:22.359535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:22.359583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:22.359930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:22.359991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:22.359997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:22.359999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:22.360000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:22.360001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:22.360002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:22.360004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:22.360005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:22.360006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:22.360007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:22.360009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.360010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.360011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.360012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:22.360013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:22.360019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:22.360030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:22.360034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:22.360039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:22.360044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:22.360048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:22.360053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:22.360057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:22.360062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:22.360067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:22.360071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.360076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.360080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.360084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:22.360089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:22.360096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:22.360104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:22.360112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:22.360118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:22.360123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:22.360129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:22.360135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:22.360146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:22.360152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:22.360158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:22.360163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:22.360169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:22.360174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:22.360180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:22.360189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:22.360195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:22.360201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:22.360209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:22.360214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:22.360222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:22.360228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.360239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.360244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.360252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.360257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.360268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.360273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:22.360280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:22.360289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:22.360295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:22.360344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:22.365994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:22.366845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:22.366859Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:22.366861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:22.366865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:22.366872Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1172 [2:7555895456201408882:7455]
2025-09-30T14:53:22.366890Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:22.366904Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:22.366906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:22.366908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:22.366910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:22.366922Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:22.366927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:22.366933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:22.366991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.366999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.367002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.367005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:22.367007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:22.367060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:22.367069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.367077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.367083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.367093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:22.367108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895456291157712:3686], now have 1 active actors on pipe
2025-09-30T14:53:22.367125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895456201408877:7455]
2025-09-30T14:53:22.367127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895456201408877:7455]
2025-09-30T14:53:22.367130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895456201408877:7455]
2025-09-30T14:53:22.367141Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:22.367151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895456291157465:2454], now have 1 active actors on pipe
2025-09-30T14:53:22.367156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:22.367159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:22.367160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:22.367165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:22.367172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:22.367174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:22.367203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895456201408877:7455]
2025-09-30T14:53:22.367216Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:22.367223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:22.367238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1172
2025-09-30T14:53:22.367264Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1172
2025-09-30T14:53:22.367313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:22.367326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:22.367352Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d24bce0-8f0fb65-1fd15f03-c5b15283_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:22.367360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:22.367363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:22.367366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:22.367373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:22.367380Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:22.367392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:22.367535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:22.367556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:22.367577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:22.367655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1173 partition: 0 MaxSeqNo: 42 sessionId: src_id|6d24bce0-8f0fb65-1fd15f03-c5b15283_0
2025-09-30T14:53:22.368051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2263f71a-a0fd46aa-1f386b92-7a36ffba_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6d24bce0-8f0fb65-1fd15f03-c5b15283_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:22.370903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d24bce0-8f0fb65-1fd15f03-c5b15283_0] Write session: try to update token
2025-09-30T14:53:22.370927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d24bce0-8f0fb65-1fd15f03-c5b15283_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:22.379297Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:22.379316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:22.379319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:22.379322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:22.379334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895456201408877:7455]
2025-09-30T14:53:22.379340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895456201408877:7455]
2025-09-30T14:53:22.379345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895456201408877:7455]
2025-09-30T14:53:22.379399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:22.379409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:22.379413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.379416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:22.379416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:22.379424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:22.379628Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:22.386006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1173 sessionId: src_id|6d24bce0-8f0fb65-1fd15f03-c5b15283_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:22.388833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:22.436288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895456291157727:4239]
2025-09-30T14:53:22.436557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1172, pipe: [1:7555895456291157727:4239]
2025-09-30T14:53:22.497271Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:22.498099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:22.498118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:22.498158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895456291157727:4239], now have 1 active actors on pipe
2025-09-30T14:53:22.498376Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:22.498413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895456291157727:4239]
2025-09-30T14:53:22.498422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:22.498425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:22.498450Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:22.498498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1173 reason: error at write: Disconnected sessionId: src_id|6d24bce0-8f0fb65-1fd15f03-c5b15283_0
2025-09-30T14:53:22.498673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1173 sessionId: src_id|6d24bce0-8f0fb65-1fd15f03-c5b15283_0 is DEAD
2025-09-30T14:53:22.498888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d24bce0-8f0fb65-1fd15f03-c5b15283_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:22.498898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d24bce0-8f0fb65-1fd15f03-c5b15283_0] Write session will restart in 0.006732s
2025-09-30T14:53:22.498923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d24bce0-8f0fb65-1fd15f03-c5b15283_0] Write session: Do CDS request
2025-09-30T14:53:22.498932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d24bce0-8f0fb65-1fd15f03-c5b15283_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:22.506795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d24bce0-8f0fb65-1fd15f03-c5b15283_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:22.506893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:22.506913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1174
2025-09-30T14:53:22.507032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1174 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:22.507060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1174 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:22.507066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1174 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:22.507071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:22.507536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1174 sessionId:  describe result for acl check
2025-09-30T14:53:22.507579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:22.507581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:22.507583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:22.507588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895456291157756:3680] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:22.508187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895456291157756:3680] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:22.512779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895456291157756:3680] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:22.516026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895456291157756:3680] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:22.516052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895456291157756:3680] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:22.516056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895456291157756:3680] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:22.516065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1174 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:22.519662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:22.522723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:22.522923Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:22.522933Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:22.522943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:22.522990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:22.523035Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895456201409137:7457]
2025-09-30T14:53:22.523716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:22.524056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:22.524097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:22.524414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:22.524537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:22.524546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:22.524547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:22.524549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:22.524550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:22.524551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:22.524552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:22.524553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:22.524555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:22.524556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:22.524558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.524559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.524560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.524561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:22.524562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:22.524567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:22.524576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:22.524580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:22.524583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:22.524587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:22.524590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:22.524593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:22.524597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:22.524600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:22.524605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:22.524608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.524611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.524615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.524618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:22.524621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:22.524630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:22.524638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:22.524644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:22.524649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:22.524654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:22.524659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:22.524663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:22.524668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:22.524672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:22.524676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:22.524680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:22.524684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:22.524688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:22.524693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:22.524696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:22.524701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:22.524706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:22.524711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:22.524715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:22.524719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:22.524723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.524727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.524732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.524736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.524741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.524746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.524750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:22.524754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:22.524758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:22.524763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:22.524801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:22.530512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:22.531777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:22.531794Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:22.531796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:22.531801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:22.531807Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1173 [2:7555895456201409137:7457]
2025-09-30T14:53:22.531822Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:22.531852Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:22.531856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:22.531859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:22.531861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:22.531877Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:22.531885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:22.531899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:22.531964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.531971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.531975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.531978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:22.531981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:22.532043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:22.532051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.532064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.532077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.532101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:22.532120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895456291157930:3680], now have 1 active actors on pipe
2025-09-30T14:53:22.532132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895456291157729:2454], now have 1 active actors on pipe
2025-09-30T14:53:22.532139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895456201409132:7457]
2025-09-30T14:53:22.532141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895456201409132:7457]
2025-09-30T14:53:22.532144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895456201409132:7457]
2025-09-30T14:53:22.532155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:22.532168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:22.532168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:22.532172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:22.532174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:22.532188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:22.532191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:22.532226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895456201409132:7457]
2025-09-30T14:53:22.532235Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:22.532249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:22.532213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1173
2025-09-30T14:53:22.532274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:22.532224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1173
2025-09-30T14:53:22.532284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:22.532313Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ed1febe-e21ccd66-b24ebe43-249724ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:22.532325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:22.532329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:22.532331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:22.532341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:22.532350Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:22.532362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:22.532507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:22.532516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:22.532529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:22.532673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1174 partition: 0 MaxSeqNo: 42 sessionId: src_id|4ed1febe-e21ccd66-b24ebe43-249724ba_0
2025-09-30T14:53:22.533113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d24bce0-8f0fb65-1fd15f03-c5b15283_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4ed1febe-e21ccd66-b24ebe43-249724ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:22.535948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ed1febe-e21ccd66-b24ebe43-249724ba_0] Write session: try to update token
2025-09-30T14:53:22.535965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ed1febe-e21ccd66-b24ebe43-249724ba_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:22.546176Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:22.546195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:22.546198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:22.546200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:22.546210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895456201409132:7457]
2025-09-30T14:53:22.546216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895456201409132:7457]
2025-09-30T14:53:22.546220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895456201409132:7457]
2025-09-30T14:53:22.546262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:22.546270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.546273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:22.546281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:22.546288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:22.546293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:22.546424Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:22.551850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1174 sessionId: src_id|4ed1febe-e21ccd66-b24ebe43-249724ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:22.554622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:22.598605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895456291157994:4239]
2025-09-30T14:53:22.598925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1173, pipe: [1:7555895456291157994:4239]
2025-09-30T14:53:22.665782Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:22.666278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:22.666296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:22.666335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895456291157994:4239], now have 1 active actors on pipe
2025-09-30T14:53:22.666576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:22.666591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:22.666607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:22.666655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1174 reason: error at write: Disconnected sessionId: src_id|4ed1febe-e21ccd66-b24ebe43-249724ba_0
2025-09-30T14:53:22.666662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895456291157994:4239]
2025-09-30T14:53:22.666849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1174 sessionId: src_id|4ed1febe-e21ccd66-b24ebe43-249724ba_0 is DEAD
2025-09-30T14:53:22.666965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ed1febe-e21ccd66-b24ebe43-249724ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:22.666975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ed1febe-e21ccd66-b24ebe43-249724ba_0] Write session will restart in 0.008757s
2025-09-30T14:53:22.667001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ed1febe-e21ccd66-b24ebe43-249724ba_0] Write session: Do CDS request
2025-09-30T14:53:22.667007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ed1febe-e21ccd66-b24ebe43-249724ba_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:22.667117Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:22.676814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ed1febe-e21ccd66-b24ebe43-249724ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:22.676923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:22.676942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1175
2025-09-30T14:53:22.677081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1175 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:22.677119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1175 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:22.677130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1175 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:22.677134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:22.677603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1175 sessionId:  describe result for acl check
2025-09-30T14:53:22.677643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:22.677650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:22.677654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:22.677660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895456291158044:3672] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:22.678220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895456291158044:3672] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:22.681081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895456291158044:3672] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:22.683743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895456291158044:3672] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:22.683761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895456291158044:3672] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:22.683765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895456291158044:3672] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:22.683773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1175 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:22.686597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:22.689005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:22.689176Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:22.689187Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:22.689196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:22.689240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:22.689282Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895456201409395:7460]
2025-09-30T14:53:22.689957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:22.690242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:22.690287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:22.690616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:22.690669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:22.690675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:22.690677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:22.690678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:22.690679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:22.690680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:22.690681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:22.690683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:22.690684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:22.690685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:22.690686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.690686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.690687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.690688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:22.690690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:22.690695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:22.690705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:22.690709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:22.690714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:22.690718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:22.690723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:22.690727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:22.690732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:22.690736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:22.690741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:22.690746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.690750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.690754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.690759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:22.690763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:22.690772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:22.690780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:22.690787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:22.690793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:22.690798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:22.690804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:22.690809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:22.690815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:22.690825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:22.690830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:22.690835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:22.690841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:22.690846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:22.690870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:22.690879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:22.690884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:22.690895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:22.690900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:22.690909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:22.690916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:22.690925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.690931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.690939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.690944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.690954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.690959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.690969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:22.690975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:22.690980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:22.690985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:22.691029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:22.696496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:22.697464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:22.697477Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:22.697480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:22.697484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:22.697490Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1174 [2:7555895456201409395:7460]
2025-09-30T14:53:22.697505Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:22.697519Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:22.697523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:22.697526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:22.697528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:22.697542Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:22.697549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:22.697556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:22.697610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.697621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.697623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.697627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:22.697630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:22.697695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:22.697705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.697718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.697731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.697749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:22.697766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895456291157996:2454], now have 1 active actors on pipe
2025-09-30T14:53:22.697774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895456291158211:3672], now have 1 active actors on pipe
2025-09-30T14:53:22.697780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895456201409390:7460]
2025-09-30T14:53:22.697783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895456201409390:7460]
2025-09-30T14:53:22.697785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895456201409390:7460]
2025-09-30T14:53:22.697796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:22.697810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:22.697810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:22.697814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:22.697816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:22.697827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:22.697830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:22.697859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895456201409390:7460]
2025-09-30T14:53:22.697872Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:22.697887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:22.697871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1174
2025-09-30T14:53:22.697884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1174
2025-09-30T14:53:22.697925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:22.697935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:22.697960Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6c33118-613571aa-5eb98809-8eb12dd6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:22.697970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:22.697973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:22.697975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:22.697984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:22.697993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:22.698009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:22.698136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:22.698143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:22.698155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:22.698252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1175 partition: 0 MaxSeqNo: 42 sessionId: src_id|c6c33118-613571aa-5eb98809-8eb12dd6_0
2025-09-30T14:53:22.698636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ed1febe-e21ccd66-b24ebe43-249724ba_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c6c33118-613571aa-5eb98809-8eb12dd6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:22.701309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6c33118-613571aa-5eb98809-8eb12dd6_0] Write session: try to update token
2025-09-30T14:53:22.701328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6c33118-613571aa-5eb98809-8eb12dd6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:22.709755Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:22.709776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:22.709785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895456201409390:7460]
2025-09-30T14:53:22.709828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:22.709827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:22.710006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:22.710174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:22.710318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:22.710472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:22.710668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:22.710707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:22.715257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1175 sessionId: src_id|c6c33118-613571aa-5eb98809-8eb12dd6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:22.717821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:22.718387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:22.718408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:22.718443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:22.718530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:22.719980Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:22.719992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:22.719993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:22.719995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:22.720002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895456201409390:7460]
2025-09-30T14:53:22.720005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895456201409390:7460]
2025-09-30T14:53:22.720008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895456201409390:7460]
2025-09-30T14:53:22.720036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:22.720041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.720043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:22.720054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:22.720067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:22.720074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:22.720171Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:22.767037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895456291158261:4239]
2025-09-30T14:53:22.767331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1174, pipe: [1:7555895456291158261:4239]
2025-09-30T14:53:22.834402Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:22.842473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:22.842498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:22.842672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:22.842736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:22.842804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:22.842872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:22.843328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:22.843340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:22.843415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:22.843483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:22.843547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:22.843614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:22.843661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:22.843665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:22.843735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:22.843797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:22.843862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:22.843926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:22.843969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:22.843976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:22.844045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:22.844108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:22.844169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:22.844230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:22.844276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:22.844283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:22.844347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:22.844408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:22.844471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:22.844581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:22.844645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:22.844652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:22.844722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:22.844789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:22.844858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:22.844925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:22.844980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:22.844987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:22.845056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:22.845116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:22.845184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:22.845252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:22.845399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:22.845412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:22.845484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:22.845544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:22.845607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:22.845674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:22.845716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:22.845724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:22.845793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:22.845857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:22.845921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:22.845989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:22.846037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:22.846049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:22.846133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:22.846194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:22.846257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:22.846318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:22.846451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:22.846459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:22.846518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895456291158261:4239], now have 1 active actors on pipe
2025-09-30T14:53:22.846760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:22.846778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:22.846784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895456291158261:4239]
2025-09-30T14:53:22.846810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1175 reason: error at write: Disconnected sessionId: src_id|c6c33118-613571aa-5eb98809-8eb12dd6_0
2025-09-30T14:53:22.846812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:22.847023Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:22.847025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1175 sessionId: src_id|c6c33118-613571aa-5eb98809-8eb12dd6_0 is DEAD
2025-09-30T14:53:22.847204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6c33118-613571aa-5eb98809-8eb12dd6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:22.847212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6c33118-613571aa-5eb98809-8eb12dd6_0] Write session will restart in 0.007215s
2025-09-30T14:53:22.847233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6c33118-613571aa-5eb98809-8eb12dd6_0] Write session: Do CDS request
2025-09-30T14:53:22.847239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6c33118-613571aa-5eb98809-8eb12dd6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:22.855791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6c33118-613571aa-5eb98809-8eb12dd6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:22.855898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:22.855915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1176
2025-09-30T14:53:22.856100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1176 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:22.856134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1176 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:22.856144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1176 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:22.856149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:22.856634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1176 sessionId:  describe result for acl check
2025-09-30T14:53:22.856673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:22.856681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:22.856686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:22.856693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895456291158297:3661] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:22.857265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895456291158297:3661] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:22.860292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895456291158297:3661] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:22.864392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895456291158297:3661] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:22.864413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895456291158297:3661] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:22.864417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895456291158297:3661] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:22.864426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1176 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:22.867283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:22.870298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:22.870679Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:22.870694Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:22.870708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:22.870783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:22.870827Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895456201409652:7462]
2025-09-30T14:53:22.871517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:22.871868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:22.871920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:22.872271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:22.872334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:22.872340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:22.872342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:22.872343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:22.872344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:22.872346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:22.872347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:22.872348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:22.872350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:22.872351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:22.872353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.872354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.872355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.872357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:22.872358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:22.872378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:22.872394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:22.872403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:22.872408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:22.872413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:22.872418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:22.872428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:22.872432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:22.872441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:22.872446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:22.872450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.872454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.872458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.872462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:22.872466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:22.872473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:22.872481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:22.872492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:22.872498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:22.872508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:22.872515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:22.872523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:22.872529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:22.872534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:22.872541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:22.872546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:22.872556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:22.872565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:22.872576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:22.872581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:22.872592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:22.872597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:22.872603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:22.872608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:22.872614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:22.872619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.872624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.872630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.872636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.872640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.872647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.872651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:22.872658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:22.872665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:22.872671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:22.872719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:22.878203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:22.879508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:22.879522Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:22.879524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:22.879528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:22.879534Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1175 [2:7555895456201409652:7462]
2025-09-30T14:53:22.879549Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:22.879568Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:22.879572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:22.879574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:22.879577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:22.879592Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:22.879602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:22.879611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:22.879671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.879677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.879680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.879683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:22.879686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:22.879748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:22.879754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.879768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:22.879785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:22.879807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:22.879828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895456291158264:2454], now have 1 active actors on pipe
2025-09-30T14:53:22.879835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895456291158493:3661], now have 1 active actors on pipe
2025-09-30T14:53:22.879841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895456201409647:7462]
2025-09-30T14:53:22.879848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895456201409647:7462]
2025-09-30T14:53:22.879850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895456201409647:7462]
2025-09-30T14:53:22.879864Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:22.879880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:22.879890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:22.879899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:22.879899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:22.879902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:22.879902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:22.879931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895456201409647:7462]
2025-09-30T14:53:22.879939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:22.879914Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1175
2025-09-30T14:53:22.879961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:22.879976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:22.879926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1175
2025-09-30T14:53:22.879981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:22.880008Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18407b5c-6058bad7-442dabd9-3812e4ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:22.880018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:22.880023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:22.880029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:22.880040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:22.880052Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:22.880068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:22.880265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:22.880278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:22.880303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:22.880407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1176 partition: 0 MaxSeqNo: 42 sessionId: src_id|18407b5c-6058bad7-442dabd9-3812e4ec_0
2025-09-30T14:53:22.880825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6c33118-613571aa-5eb98809-8eb12dd6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|18407b5c-6058bad7-442dabd9-3812e4ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:22.883525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18407b5c-6058bad7-442dabd9-3812e4ec_0] Write session: try to update token
2025-09-30T14:53:22.883542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18407b5c-6058bad7-442dabd9-3812e4ec_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:22.891927Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:22.891951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:22.891954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:22.891956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:22.891967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895456201409647:7462]
2025-09-30T14:53:22.891971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895456201409647:7462]
2025-09-30T14:53:22.891976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895456201409647:7462]
2025-09-30T14:53:22.892014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:22.892027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:22.892029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:22.892036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:22.892042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:22.892057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:22.892165Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:22.897939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1176 sessionId: src_id|18407b5c-6058bad7-442dabd9-3812e4ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:22.900529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:22.946769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895456291158529:4239]
2025-09-30T14:53:22.947050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1175, pipe: [1:7555895456291158529:4239]
2025-09-30T14:53:23.000637Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:23.000905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:23.000919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:23.000956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895456291158529:4239], now have 1 active actors on pipe
2025-09-30T14:53:23.001181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:23.001197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:23.001222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895456291158529:4239]
2025-09-30T14:53:23.001245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:23.001268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1176 reason: error at write: Disconnected sessionId: src_id|18407b5c-6058bad7-442dabd9-3812e4ec_0
2025-09-30T14:53:23.001454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1176 sessionId: src_id|18407b5c-6058bad7-442dabd9-3812e4ec_0 is DEAD
2025-09-30T14:53:23.001466Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:23.001626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18407b5c-6058bad7-442dabd9-3812e4ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:23.001636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18407b5c-6058bad7-442dabd9-3812e4ec_0] Write session will restart in 0.007607s
2025-09-30T14:53:23.001652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18407b5c-6058bad7-442dabd9-3812e4ec_0] Write session: Do CDS request
2025-09-30T14:53:23.001658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18407b5c-6058bad7-442dabd9-3812e4ec_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:23.010724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18407b5c-6058bad7-442dabd9-3812e4ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:23.010840Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:23.010857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1177
2025-09-30T14:53:23.010973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1177 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:23.011006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1177 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:23.011016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1177 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:23.011020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:23.011463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1177 sessionId:  describe result for acl check
2025-09-30T14:53:23.011500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:23.011504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:23.011506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:23.011511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895460586125893:3659] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:23.012044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895460586125893:3659] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:23.014905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895460586125893:3659] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:23.019830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895460586125893:3659] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:23.019848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895460586125893:3659] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:23.019852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895460586125893:3659] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:23.019860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1177 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:23.019937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:23.022997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:23.023232Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:23.023262Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:23.023275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:23.023340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:23.023382Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895460496377206:7464]
2025-09-30T14:53:23.024062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:23.024366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:23.024415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:23.024753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:23.024816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:23.024822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:23.024824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:23.024825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:23.024827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:23.024828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:23.024830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:23.024831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:23.024832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:23.024834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:23.024835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.024836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.024837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.024838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:23.024839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:23.024844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:23.024853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:23.024858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:23.024862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:23.024866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:23.024870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:23.024875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:23.024879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:23.024884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:23.024889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:23.024893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.024897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.024902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.024906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:23.024910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:23.024919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:23.024928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:23.024934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:23.024940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:23.024945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:23.024952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:23.024960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:23.024966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:23.024972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:23.024978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:23.024984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:23.024990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:23.024995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:23.025002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:23.025012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:23.025018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:23.025025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:23.025036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:23.025041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:23.025052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:23.025057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.025067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.025073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.025084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.025089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.025100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.025105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:23.025115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:23.025120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:23.025126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:23.025182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:23.030769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:23.032148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:23.032164Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:23.032167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:23.032170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:23.032177Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1176 [2:7555895460496377206:7464]
2025-09-30T14:53:23.032194Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:23.032211Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:23.032214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:23.032218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:23.032220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:23.032236Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:23.032243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:23.032250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:23.032309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.032316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.032320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.032323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:23.032326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:23.032398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:23.032407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.032420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.032438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.032458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:23.032479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895460496377200:7464]
2025-09-30T14:53:23.032486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895460496377200:7464]
2025-09-30T14:53:23.032488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895460496377200:7464]
2025-09-30T14:53:23.032592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1176
2025-09-30T14:53:23.032610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1176
2025-09-30T14:53:23.032497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:23.032508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:23.032511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:23.032513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:23.032516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895460586125827:2454], now have 1 active actors on pipe
2025-09-30T14:53:23.032523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895460586126081:3659], now have 1 active actors on pipe
2025-09-30T14:53:23.032528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:23.032542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:23.032545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:23.032578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895460496377200:7464]
2025-09-30T14:53:23.032586Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:23.032606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:23.032659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:23.032663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:23.032692Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b9120840-dee51b54-2ad28f27-ba92ffde_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:23.032698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:23.032701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:23.032704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:23.032713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:23.032722Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:23.032738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:23.033169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:23.033184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:23.033203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:23.033330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1177 partition: 0 MaxSeqNo: 42 sessionId: src_id|b9120840-dee51b54-2ad28f27-ba92ffde_0
2025-09-30T14:53:23.033735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18407b5c-6058bad7-442dabd9-3812e4ec_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b9120840-dee51b54-2ad28f27-ba92ffde_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:23.036505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9120840-dee51b54-2ad28f27-ba92ffde_0] Write session: try to update token
2025-09-30T14:53:23.036526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9120840-dee51b54-2ad28f27-ba92ffde_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:23.044852Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:23.044867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:23.044880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895460496377200:7464]
2025-09-30T14:53:23.044924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:23.044927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:23.045094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:23.045249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:23.045400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:23.045550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:23.045739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:23.045780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:23.051452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1177 sessionId: src_id|b9120840-dee51b54-2ad28f27-ba92ffde_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:23.054030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:23.054498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:23.054521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:23.055650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:23.055681Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:23.055684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:23.055687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:23.055689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:23.055696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895460496377200:7464]
2025-09-30T14:53:23.055700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895460496377200:7464]
2025-09-30T14:53:23.055704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895460496377200:7464]
2025-09-30T14:53:23.055728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:23.055732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:23.055737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:23.055738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.055740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:23.055742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:23.055768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:23.055870Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:23.101391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895460586126104:4239]
2025-09-30T14:53:23.101656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1176, pipe: [1:7555895460586126104:4239]
2025-09-30T14:53:23.168646Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:23.176116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:23.176142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:23.176290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:23.176346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:23.176410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:23.176477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:23.176526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:23.176537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:23.176604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:23.176660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:23.176724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:23.176789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:23.176833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:23.176840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:23.176909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:23.176971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:23.177044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:23.177104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:23.177148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:23.177158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:23.177227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:23.177290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:23.177351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:23.177412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:23.177534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:23.177542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:23.177608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:23.177664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:23.177725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:23.177785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:23.177824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:23.177829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:23.177888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:23.177951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:23.178020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:23.178090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:23.178131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:23.178137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:23.178201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:23.178264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:23.178327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:23.178383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:23.178424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:23.178430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:23.178490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:23.178553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:23.178617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:23.178683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:23.178731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:23.178738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:23.178804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:23.178863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:23.178920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:23.178981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:23.179136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:23.179147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:23.179219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:23.179304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:23.179374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:23.179437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:23.179484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:23.179491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:23.179545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895460586126104:4239], now have 1 active actors on pipe
2025-09-30T14:53:23.179772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895460586126104:4239]
2025-09-30T14:53:23.179811Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:23.179851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:23.179858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:23.179881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1177 reason: error at write: Disconnected sessionId: src_id|b9120840-dee51b54-2ad28f27-ba92ffde_0
2025-09-30T14:53:23.180061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1177 sessionId: src_id|b9120840-dee51b54-2ad28f27-ba92ffde_0 is DEAD
2025-09-30T14:53:23.180207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9120840-dee51b54-2ad28f27-ba92ffde_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:23.180219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9120840-dee51b54-2ad28f27-ba92ffde_0] Write session will restart in 0.005771s
2025-09-30T14:53:23.180248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9120840-dee51b54-2ad28f27-ba92ffde_0] Write session: Do CDS request
2025-09-30T14:53:23.180254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9120840-dee51b54-2ad28f27-ba92ffde_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:23.180699Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:23.186757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9120840-dee51b54-2ad28f27-ba92ffde_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:23.186890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:23.186922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1178
2025-09-30T14:53:23.187043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1178 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:23.187069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1178 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:23.187073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1178 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:23.187077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:23.187497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1178 sessionId:  describe result for acl check
2025-09-30T14:53:23.187523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:23.187525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:23.187527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:23.187532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895460586126152:3639] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:23.188028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895460586126152:3639] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:23.189801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895460586126152:3639] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:23.193714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895460586126152:3639] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:23.193734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895460586126152:3639] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:23.193737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895460586126152:3639] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:23.193744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1178 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:23.198035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:23.200904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:23.201093Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:23.201102Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:23.201113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:23.201175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:23.201212Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895460496377496:7474]
2025-09-30T14:53:23.201872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:23.202250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:23.202298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:23.202629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:23.202683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:23.202690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:23.202691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:23.202692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:23.202693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:23.202694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:23.202695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:23.202696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:23.202697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:23.202699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:23.202700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.202701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.202702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.202703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:23.202704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:23.202709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:23.202719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:23.202723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:23.202727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:23.202731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:23.202735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:23.202739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:23.202743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:23.202747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:23.202752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:23.202756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.202760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.202763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.202767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:23.202771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:23.202779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:23.202786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:23.202792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:23.202798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:23.202804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:23.202809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:23.202813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:23.202819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:23.202823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:23.202829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:23.202833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:23.202839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:23.202844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:23.202849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:23.202853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:23.202858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:23.202862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:23.202868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:23.202872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:23.202877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:23.202881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.202887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.202891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.202896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.202900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.202905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.202914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:23.202919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:23.202923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:23.202928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:23.202972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:23.208324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:23.209539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:23.209567Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:23.209570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:23.209574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:23.209580Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1177 [2:7555895460496377496:7474]
2025-09-30T14:53:23.209594Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:23.209608Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:23.209612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:23.209615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:23.209617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:23.209631Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:23.209642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:23.209648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:23.209701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.209707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.209709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.209713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:23.209716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:23.209789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:23.209795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.209807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.209822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.209844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:23.209866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895460586126300:3639], now have 1 active actors on pipe
2025-09-30T14:53:23.209875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895460586126130:2454], now have 1 active actors on pipe
2025-09-30T14:53:23.209881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895460496377487:7474]
2025-09-30T14:53:23.209883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895460496377487:7474]
2025-09-30T14:53:23.209886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895460496377487:7474]
2025-09-30T14:53:23.209897Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:23.209911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:23.209914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:23.209920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:23.209923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:23.209928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:23.209932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:23.209931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1177
2025-09-30T14:53:23.209959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895460496377487:7474]
2025-09-30T14:53:23.209933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1177
2025-09-30T14:53:23.209967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:23.209994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:23.209995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:23.209999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:23.210029Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0da00a5-cad4b58-4e54404-32841e74_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:23.210040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:23.210042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:23.210044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:23.210052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:23.210066Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:23.210103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:23.210264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:23.210274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:23.210291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:23.210365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1178 partition: 0 MaxSeqNo: 42 sessionId: src_id|d0da00a5-cad4b58-4e54404-32841e74_0
2025-09-30T14:53:23.210734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9120840-dee51b54-2ad28f27-ba92ffde_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d0da00a5-cad4b58-4e54404-32841e74_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:23.213484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0da00a5-cad4b58-4e54404-32841e74_0] Write session: try to update token
2025-09-30T14:53:23.213505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0da00a5-cad4b58-4e54404-32841e74_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:23.221960Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:23.221981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:23.221984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:23.221986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:23.221996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895460496377487:7474]
2025-09-30T14:53:23.222001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895460496377487:7474]
2025-09-30T14:53:23.222005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895460496377487:7474]
2025-09-30T14:53:23.222045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:23.222053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.222056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:23.222058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:23.222064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:23.222068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:23.222221Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:23.228888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1178 sessionId: src_id|d0da00a5-cad4b58-4e54404-32841e74_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:23.231803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:23.280067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895460586126408:4239]
2025-09-30T14:53:23.280353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1177, pipe: [1:7555895460586126408:4239]
2025-09-30T14:53:23.338312Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:23.338629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:23.338643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:23.338665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895460586126408:4239], now have 1 active actors on pipe
2025-09-30T14:53:23.338908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:23.338939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895460586126408:4239]
2025-09-30T14:53:23.338961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:23.338964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:23.339028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1178 reason: error at write: Disconnected sessionId: src_id|d0da00a5-cad4b58-4e54404-32841e74_0
2025-09-30T14:53:23.339061Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:23.339207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1178 sessionId: src_id|d0da00a5-cad4b58-4e54404-32841e74_0 is DEAD
2025-09-30T14:53:23.339364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0da00a5-cad4b58-4e54404-32841e74_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:23.339374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0da00a5-cad4b58-4e54404-32841e74_0] Write session will restart in 0.008488s
2025-09-30T14:53:23.339409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0da00a5-cad4b58-4e54404-32841e74_0] Write session: Do CDS request
2025-09-30T14:53:23.339415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0da00a5-cad4b58-4e54404-32841e74_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:23.348807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0da00a5-cad4b58-4e54404-32841e74_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:23.348894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:23.348913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1179
2025-09-30T14:53:23.349062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1179 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:23.349095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1179 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:23.349105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1179 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:23.349110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:23.349644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1179 sessionId:  describe result for acl check
2025-09-30T14:53:23.349678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:23.349683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:23.349699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:23.349705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895460586126466:3637] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:23.350234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895460586126466:3637] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:23.353566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895460586126466:3637] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:23.356685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895460586126466:3637] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:23.356703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895460586126466:3637] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:23.356706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895460586126466:3637] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:23.356717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1179 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:23.357905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:23.360608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:23.360803Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:23.360815Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:23.360825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:23.360876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:23.360915Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895460496377775:7482]
2025-09-30T14:53:23.361603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:23.361939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:23.361991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:23.362314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:23.362384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:23.362391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:23.362392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:23.362393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:23.362394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:23.362395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:23.362397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:23.362398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:23.362399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:23.362400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:23.362402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.362403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.362404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.362405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:23.362406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:23.362411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:23.362421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:23.362425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:23.362429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:23.362432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:23.362436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:23.362440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:23.362443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:23.362448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:23.362452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:23.362456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.362459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.362463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.362467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:23.362471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:23.362478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:23.362487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:23.362493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:23.362499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:23.362504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:23.362509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:23.362513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:23.362518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:23.362522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:23.362527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:23.362531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:23.362536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:23.362543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:23.362548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:23.362558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:23.362563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:23.362567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:23.362572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:23.362579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:23.362584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:23.362589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.362599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.362605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.362613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.362618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.362628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.362632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:23.362637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:23.362647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:23.362652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:23.362700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:23.368148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:23.369080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:23.369099Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:23.369102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:23.369107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:23.369114Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1178 [2:7555895460496377775:7482]
2025-09-30T14:53:23.369130Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:23.369147Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:23.369151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:23.369154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:23.369157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:23.369174Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:23.369181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:23.369188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:23.369250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.369260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.369262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.369266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:23.369269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:23.369341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:23.369349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.369364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.369383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.369408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:23.369431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895460586126410:2454], now have 1 active actors on pipe
2025-09-30T14:53:23.369440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895460586126664:3637], now have 1 active actors on pipe
2025-09-30T14:53:23.369447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895460496377770:7482]
2025-09-30T14:53:23.369450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895460496377770:7482]
2025-09-30T14:53:23.369453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895460496377770:7482]
2025-09-30T14:53:23.369465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:23.369484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:23.369498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:23.369503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:23.369505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:23.369505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:23.369508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:23.369541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895460496377770:7482]
2025-09-30T14:53:23.369550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:23.369525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1178
2025-09-30T14:53:23.369538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1178
2025-09-30T14:53:23.369591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:23.369592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:23.369597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:23.369628Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4166a8f2-147ef86e-e10da319-b4a7f1fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:23.369635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:23.369639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:23.369641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:23.369650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:23.369660Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:23.369676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:23.369833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:23.369843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:23.369857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:23.369930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1179 partition: 0 MaxSeqNo: 42 sessionId: src_id|4166a8f2-147ef86e-e10da319-b4a7f1fc_0
2025-09-30T14:53:23.370370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0da00a5-cad4b58-4e54404-32841e74_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4166a8f2-147ef86e-e10da319-b4a7f1fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:23.373161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4166a8f2-147ef86e-e10da319-b4a7f1fc_0] Write session: try to update token
2025-09-30T14:53:23.373179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4166a8f2-147ef86e-e10da319-b4a7f1fc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:23.382259Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:23.382285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:23.382289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:23.382291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:23.382303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895460496377770:7482]
2025-09-30T14:53:23.382310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895460496377770:7482]
2025-09-30T14:53:23.382317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895460496377770:7482]
2025-09-30T14:53:23.382364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:23.382374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:23.382376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:23.382382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:23.382388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.382392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:23.382627Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:23.388081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1179 sessionId: src_id|4166a8f2-147ef86e-e10da319-b4a7f1fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:23.390848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:23.439342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895460586126678:4239]
2025-09-30T14:53:23.439615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1178, pipe: [1:7555895460586126678:4239]
2025-09-30T14:53:23.493537Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:23.494220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:23.494235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:23.494269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895460586126678:4239], now have 1 active actors on pipe
2025-09-30T14:53:23.494411Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:23.494437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:23.494462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:23.494467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:23.494495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895460586126678:4239]
2025-09-30T14:53:23.494534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1179 reason: error at write: Disconnected sessionId: src_id|4166a8f2-147ef86e-e10da319-b4a7f1fc_0
2025-09-30T14:53:23.494719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1179 sessionId: src_id|4166a8f2-147ef86e-e10da319-b4a7f1fc_0 is DEAD
2025-09-30T14:53:23.494888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4166a8f2-147ef86e-e10da319-b4a7f1fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:23.494901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4166a8f2-147ef86e-e10da319-b4a7f1fc_0] Write session will restart in 0.009393s
2025-09-30T14:53:23.494925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4166a8f2-147ef86e-e10da319-b4a7f1fc_0] Write session: Do CDS request
2025-09-30T14:53:23.494935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4166a8f2-147ef86e-e10da319-b4a7f1fc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:23.505782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4166a8f2-147ef86e-e10da319-b4a7f1fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:23.505853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:23.505872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1180
2025-09-30T14:53:23.506026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1180 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:23.506060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1180 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:23.506070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1180 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:23.506074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:23.506670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1180 sessionId:  describe result for acl check
2025-09-30T14:53:23.506711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:23.506718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:23.506721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:23.506727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895460586126732:3631] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:23.507281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895460586126732:3631] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:23.509706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895460586126732:3631] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:23.512703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895460586126732:3631] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:23.512719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895460586126732:3631] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:23.512723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895460586126732:3631] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:23.512731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1180 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:23.515725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:23.518641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:23.518884Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:23.518895Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:23.518906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:23.518962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:23.519006Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895460496378036:7484]
2025-09-30T14:53:23.519726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:23.520065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:23.520278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:23.520626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:23.520691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:23.520698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:23.520699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:23.520701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:23.520702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:23.520703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:23.520704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:23.520706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:23.520707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:23.520708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:23.520710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.520711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.520713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.520714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:23.520715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:23.520720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:23.520731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:23.520736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:23.520740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:23.520745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:23.520750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:23.520754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:23.520759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:23.520764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:23.520768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:23.520772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.520777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.520781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.520785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:23.520790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:23.520797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:23.520807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:23.520814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:23.520820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:23.520826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:23.520832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:23.520837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:23.520843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:23.520849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:23.520855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:23.520860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:23.520866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:23.520871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:23.520879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:23.520890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:23.520896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:23.520903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:23.520909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:23.520916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:23.520926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:23.520933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.520943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.520947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.520953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.520959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.520964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.520973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:23.520979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:23.520984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:23.520991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:23.521047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:23.526726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:23.527640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:23.527659Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:23.527661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:23.527665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:23.527672Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1179 [2:7555895460496378036:7484]
2025-09-30T14:53:23.527691Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:23.527712Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:23.527720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:23.527724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:23.527726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:23.527744Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:23.527758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:23.527765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:23.527831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.527843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.527845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.527849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:23.527852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:23.528075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1179
2025-09-30T14:53:23.528087Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1179
2025-09-30T14:53:23.528256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:23.528267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.528280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.528292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.528316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:23.528341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895460586126905:3631], now have 1 active actors on pipe
2025-09-30T14:53:23.528349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895460586126679:2454], now have 1 active actors on pipe
2025-09-30T14:53:23.528368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:23.528378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:23.528393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895460496378031:7484]
2025-09-30T14:53:23.528400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895460496378031:7484]
2025-09-30T14:53:23.528402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895460496378031:7484]
2025-09-30T14:53:23.528416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:23.528432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:23.528433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:23.528438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:23.528448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:23.528453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:23.528456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:23.528472Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c487d129-5f7ec78e-f0f7844f-e9c324cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:23.528483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:23.528487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:23.528489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:23.528499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:23.528514Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:23.528555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895460496378031:7484]
2025-09-30T14:53:23.528567Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:23.528575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:23.528578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:23.528746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:23.528756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:23.528770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:23.528909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1180 partition: 0 MaxSeqNo: 42 sessionId: src_id|c487d129-5f7ec78e-f0f7844f-e9c324cc_0
2025-09-30T14:53:23.529259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4166a8f2-147ef86e-e10da319-b4a7f1fc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c487d129-5f7ec78e-f0f7844f-e9c324cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:23.532017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c487d129-5f7ec78e-f0f7844f-e9c324cc_0] Write session: try to update token
2025-09-30T14:53:23.532041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c487d129-5f7ec78e-f0f7844f-e9c324cc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:23.540392Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:23.540417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:23.540427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895460496378031:7484]
2025-09-30T14:53:23.540474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:23.540476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:23.540653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:23.540798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:23.540932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:23.541070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:23.541258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:23.541303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:23.546532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1180 sessionId: src_id|c487d129-5f7ec78e-f0f7844f-e9c324cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:23.549305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:23.549540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:23.549564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:23.549613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:23.549702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:23.550904Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:23.550925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:23.550927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:23.550929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:23.550937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895460496378031:7484]
2025-09-30T14:53:23.550942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895460496378031:7484]
2025-09-30T14:53:23.550946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895460496378031:7484]
2025-09-30T14:53:23.550984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:23.550992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.550998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:23.551004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:23.551011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:23.551016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:23.551142Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:23.594956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895460586126951:4239]
2025-09-30T14:53:23.595315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1179, pipe: [1:7555895460586126951:4239]
2025-09-30T14:53:23.668749Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:23.677510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:23.677541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:23.677725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:23.677799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:23.677873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:23.677940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:23.677989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:23.677999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:23.678071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:23.678153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:23.678224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:23.678293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:23.678344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:23.678357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:23.678429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:23.678491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:23.678565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:23.678637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:23.678689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:23.678702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:23.678779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:23.678840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:23.678903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:23.678966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:23.679010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:23.679013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:23.679089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:23.679152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:23.679216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:23.679381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:23.679450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:23.679462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:23.679530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:23.679593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:23.679660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:23.679729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:23.679775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:23.679785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:23.679852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:23.679922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:23.679982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:23.680051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:23.680113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:23.680122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:23.680191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:23.680253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:23.680315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:23.680378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:23.680424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:23.680432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:23.680498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:23.680558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:23.680625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:23.680689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:23.680733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:23.680740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:23.680806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:23.680867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:23.680930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:23.681001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:23.681046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:23.681057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:23.681125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895460586126951:4239], now have 1 active actors on pipe
2025-09-30T14:53:23.681410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:23.681427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:23.681455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895460586126951:4239]
2025-09-30T14:53:23.681460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1180 reason: error at write: Disconnected sessionId: src_id|c487d129-5f7ec78e-f0f7844f-e9c324cc_0
2025-09-30T14:53:23.681478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:23.681647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1180 sessionId: src_id|c487d129-5f7ec78e-f0f7844f-e9c324cc_0 is DEAD
2025-09-30T14:53:23.681848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c487d129-5f7ec78e-f0f7844f-e9c324cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:23.681858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c487d129-5f7ec78e-f0f7844f-e9c324cc_0] Write session will restart in 0.009365s
2025-09-30T14:53:23.681889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c487d129-5f7ec78e-f0f7844f-e9c324cc_0] Write session: Do CDS request
2025-09-30T14:53:23.681895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c487d129-5f7ec78e-f0f7844f-e9c324cc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:23.682339Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:23.692815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c487d129-5f7ec78e-f0f7844f-e9c324cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:23.692914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:23.692932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1181
2025-09-30T14:53:23.693171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1181 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:23.693201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1181 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:23.693206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1181 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:23.693210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:23.693943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1181 sessionId:  describe result for acl check
2025-09-30T14:53:23.693970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:23.693972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:23.693974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:23.693980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895460586127011:3625] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:23.694551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895460586127011:3625] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:23.698245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895460586127011:3625] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:23.700955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895460586127011:3625] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:23.700971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895460586127011:3625] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:23.700975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895460586127011:3625] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:23.700984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1181 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:23.704197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:23.707623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:23.707828Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:23.707842Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:23.707853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:23.707912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:23.707956Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895460496378300:7487]
2025-09-30T14:53:23.708629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:23.709015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:23.709096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:23.709424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:23.709486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:23.709494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:23.709495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:23.709496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:23.709497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:23.709499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:23.709500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:23.709501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:23.709502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:23.709503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:23.709504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.709506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.709507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.709508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:23.709509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:23.709515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:23.709535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:23.709539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:23.709544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:23.709548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:23.709552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:23.709556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:23.709560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:23.709564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:23.709569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:23.709573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.709577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.709581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.709585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:23.709588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:23.709594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:23.709599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:23.709602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:23.709606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:23.709608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:23.709614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:23.709619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:23.709624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:23.709629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:23.709634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:23.709639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:23.709645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:23.709649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:23.709655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:23.709664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:23.709669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:23.709675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:23.709685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:23.709689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:23.709693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:23.709704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.709708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.709713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.709717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.709721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.709725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.709729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:23.709734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:23.709738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:23.709743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:23.709785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:23.715369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:23.716225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:23.716239Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:23.716241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:23.716244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:23.716252Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1180 [2:7555895460496378300:7487]
2025-09-30T14:53:23.716267Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:23.716284Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:23.716292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:23.716295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:23.716297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:23.716313Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:23.716324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:23.716332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:23.716386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.716391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.716393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.716395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:23.716397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:23.716443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:23.716452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.716460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.716467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.716476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:23.716488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895460496378295:7487]
2025-09-30T14:53:23.716489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895460496378295:7487]
2025-09-30T14:53:23.716491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895460496378295:7487]
2025-09-30T14:53:23.716497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:23.716506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:23.716507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895460586127181:3625], now have 1 active actors on pipe
2025-09-30T14:53:23.716509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:23.716511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:23.716512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895460586126954:2454], now have 1 active actors on pipe
2025-09-30T14:53:23.716516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:23.716530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:23.716533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:23.716561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895460496378295:7487]
2025-09-30T14:53:23.716567Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:23.716592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:23.716598Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1180
2025-09-30T14:53:23.716687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1180
2025-09-30T14:53:23.716721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:23.716734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:23.716760Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45de6ec9-394d8d67-f6f2f02-aa50b0f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:23.716773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:23.716779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:23.716786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:23.716808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:23.716823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:23.716842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:23.716981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:23.716987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:23.717001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:23.717106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1181 partition: 0 MaxSeqNo: 42 sessionId: src_id|45de6ec9-394d8d67-f6f2f02-aa50b0f0_0
2025-09-30T14:53:23.717518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c487d129-5f7ec78e-f0f7844f-e9c324cc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|45de6ec9-394d8d67-f6f2f02-aa50b0f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:23.720203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45de6ec9-394d8d67-f6f2f02-aa50b0f0_0] Write session: try to update token
2025-09-30T14:53:23.720217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45de6ec9-394d8d67-f6f2f02-aa50b0f0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:23.728554Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:23.728572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:23.728576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:23.728578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:23.728587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895460496378295:7487]
2025-09-30T14:53:23.728591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895460496378295:7487]
2025-09-30T14:53:23.728595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895460496378295:7487]
2025-09-30T14:53:23.728635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:23.728636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:23.728642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:23.728642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.728644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:23.728645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:23.728789Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:23.738800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1181 sessionId: src_id|45de6ec9-394d8d67-f6f2f02-aa50b0f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:23.741560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:23.781846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895460586127224:4239]
2025-09-30T14:53:23.782118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1180, pipe: [1:7555895460586127224:4239]
2025-09-30T14:53:23.843207Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:23.844161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:23.844179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:23.844201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895460586127224:4239], now have 1 active actors on pipe
2025-09-30T14:53:23.844421Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:23.844467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:23.844472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895460586127224:4239]
2025-09-30T14:53:23.844479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:23.844504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:23.844533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1181 reason: error at write: Disconnected sessionId: src_id|45de6ec9-394d8d67-f6f2f02-aa50b0f0_0
2025-09-30T14:53:23.844728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1181 sessionId: src_id|45de6ec9-394d8d67-f6f2f02-aa50b0f0_0 is DEAD
2025-09-30T14:53:23.844942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45de6ec9-394d8d67-f6f2f02-aa50b0f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:23.844953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45de6ec9-394d8d67-f6f2f02-aa50b0f0_0] Write session will restart in 0.006670s
2025-09-30T14:53:23.844977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45de6ec9-394d8d67-f6f2f02-aa50b0f0_0] Write session: Do CDS request
2025-09-30T14:53:23.844985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45de6ec9-394d8d67-f6f2f02-aa50b0f0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:23.852756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45de6ec9-394d8d67-f6f2f02-aa50b0f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:23.852905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:23.852923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1182
2025-09-30T14:53:23.853053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1182 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:23.853098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1182 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:23.853104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1182 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:23.853108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:23.853519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1182 sessionId:  describe result for acl check
2025-09-30T14:53:23.853557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:23.853565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:23.853567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:23.853572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895460586127255:3618] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:23.854155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895460586127255:3618] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:23.857087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895460586127255:3618] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:23.860114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895460586127255:3618] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:23.860132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895460586127255:3618] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:23.860136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895460586127255:3618] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:23.860144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1182 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:23.864414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:23.867342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:23.867536Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:23.867545Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:23.867555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:23.867605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:23.867644Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895460496378563:7489]
2025-09-30T14:53:23.868329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:23.868633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:23.868675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:23.868995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:23.869056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:23.869062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:23.869064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:23.869065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:23.869066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:23.869067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:23.869068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:23.869069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:23.869071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:23.869072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:23.869073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.869074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.869076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.869077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:23.869078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:23.869084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:23.869095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:23.869099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:23.869103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:23.869107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:23.869112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:23.869115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:23.869119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:23.869123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:23.869128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:23.869132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.869137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.869140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.869144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:23.869148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:23.869156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:23.869164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:23.869171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:23.869176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:23.869181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:23.869187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:23.869192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:23.869197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:23.869202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:23.869207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:23.869212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:23.869217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:23.869222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:23.869227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:23.869232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:23.869237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:23.869246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:23.869252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:23.869256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:23.869262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:23.869273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.869278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.869287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.869292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.869296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.869301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.869306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:23.869316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:23.869322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:23.869328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:23.869379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:23.874849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:23.875718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:23.875736Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:23.875739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:23.875743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:23.875750Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1181 [2:7555895460496378563:7489]
2025-09-30T14:53:23.875767Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:23.875784Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:23.875792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:23.875795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:23.875797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:23.875813Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:23.875825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:23.875832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:23.875908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.875919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.875921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.875925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:23.875927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:23.875992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:23.876000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.876013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:23.876024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:23.876042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:23.876065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895460586127226:2454], now have 1 active actors on pipe
2025-09-30T14:53:23.876078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895460496378558:7489]
2025-09-30T14:53:23.876081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895460496378558:7489]
2025-09-30T14:53:23.876083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895460496378558:7489]
2025-09-30T14:53:23.876096Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:23.876109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:23.876110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895460586127414:3618], now have 1 active actors on pipe
2025-09-30T14:53:23.876118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:23.876119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:23.876120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:23.876134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:23.876137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:23.876167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895460496378558:7489]
2025-09-30T14:53:23.876175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:23.876177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:23.876155Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1181
2025-09-30T14:53:23.876191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:23.876161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1181
2025-09-30T14:53:23.876196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:23.876244Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70e6ab68-f4b6f69c-9e5fbdea-c5571a5d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:23.876255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:23.876259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:23.876266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:23.876275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:23.876286Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:23.876310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:23.876473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:23.876481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:23.876494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:23.876575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1182 partition: 0 MaxSeqNo: 42 sessionId: src_id|70e6ab68-f4b6f69c-9e5fbdea-c5571a5d_0
2025-09-30T14:53:23.876959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45de6ec9-394d8d67-f6f2f02-aa50b0f0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|70e6ab68-f4b6f69c-9e5fbdea-c5571a5d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:23.879689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70e6ab68-f4b6f69c-9e5fbdea-c5571a5d_0] Write session: try to update token
2025-09-30T14:53:23.879709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70e6ab68-f4b6f69c-9e5fbdea-c5571a5d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:23.888569Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:23.888591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:23.888594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:23.888596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:23.888606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895460496378558:7489]
2025-09-30T14:53:23.888611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895460496378558:7489]
2025-09-30T14:53:23.888616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895460496378558:7489]
2025-09-30T14:53:23.888658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:23.888660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:23.888665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:23.888666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:23.888668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:23.888670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:23.888806Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:23.894222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1182 sessionId: src_id|70e6ab68-f4b6f69c-9e5fbdea-c5571a5d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:23.896984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:23.944635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895460586127497:4239]
2025-09-30T14:53:23.944865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1181, pipe: [1:7555895460586127497:4239]
2025-09-30T14:53:24.001044Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:24.001822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:24.001836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:24.001869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895460586127497:4239], now have 1 active actors on pipe
2025-09-30T14:53:24.002023Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:24.002098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:24.002101Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:24.002117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:24.002140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895460586127497:4239]
2025-09-30T14:53:24.002176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1182 reason: error at write: Disconnected sessionId: src_id|70e6ab68-f4b6f69c-9e5fbdea-c5571a5d_0
2025-09-30T14:53:24.002374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1182 sessionId: src_id|70e6ab68-f4b6f69c-9e5fbdea-c5571a5d_0 is DEAD
2025-09-30T14:53:24.002575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70e6ab68-f4b6f69c-9e5fbdea-c5571a5d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:24.002588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70e6ab68-f4b6f69c-9e5fbdea-c5571a5d_0] Write session will restart in 0.006011s
2025-09-30T14:53:24.002612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70e6ab68-f4b6f69c-9e5fbdea-c5571a5d_0] Write session: Do CDS request
2025-09-30T14:53:24.002621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70e6ab68-f4b6f69c-9e5fbdea-c5571a5d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:24.009746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70e6ab68-f4b6f69c-9e5fbdea-c5571a5d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:24.009843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:24.009865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1183
2025-09-30T14:53:24.009965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1183 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:24.009994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1183 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:24.010004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1183 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:24.010008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:24.010528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1183 sessionId:  describe result for acl check
2025-09-30T14:53:24.010567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:24.010574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:24.010576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:24.010582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895464881094819:3606] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:24.011128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895464881094819:3606] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:24.013825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895464881094819:3606] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:24.017264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895464881094819:3606] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:24.017285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895464881094819:3606] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:24.017289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895464881094819:3606] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:24.017297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1183 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:24.021285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:24.024136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:24.024331Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:24.024339Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:24.024349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:24.024400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:24.024438Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895464791346123:7491]
2025-09-30T14:53:24.025100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:24.025433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:24.025481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:24.025735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:24.025788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:24.025793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:24.025794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:24.025795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:24.025795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:24.025796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:24.025797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:24.025798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:24.025799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:24.025799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:24.025800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.025801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.025801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.025802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:24.025803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:24.025807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:24.025817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:24.025821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:24.025825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:24.025828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:24.025832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:24.025836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:24.025840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:24.025843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:24.025846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:24.025848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.025851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.025853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.025856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:24.025858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:24.025864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:24.025869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:24.025873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:24.025885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:24.025888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:24.025891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:24.025894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:24.025897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:24.025900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:24.025903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:24.025906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:24.025909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:24.025911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:24.025915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:24.025917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:24.025920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:24.025923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:24.025926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:24.025928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:24.025933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:24.025935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.025938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.025941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.025947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.025952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.025957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.025961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:24.025967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:24.025971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:24.025977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:24.026004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:24.031389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:24.032240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:24.032255Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:24.032258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:24.032262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:24.032268Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1182 [2:7555895464791346123:7491]
2025-09-30T14:53:24.032284Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:24.032301Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:24.032304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:24.032307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:24.032309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:24.032327Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:24.032339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:24.032346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:24.032405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.032411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.032414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.032417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:24.032420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:24.032483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:24.032492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.032504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.032517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.032540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:24.032562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895464881094795:2454], now have 1 active actors on pipe
2025-09-30T14:53:24.032570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895464881094987:3606], now have 1 active actors on pipe
2025-09-30T14:53:24.032576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895464791346118:7491]
2025-09-30T14:53:24.032582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895464791346118:7491]
2025-09-30T14:53:24.032584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895464791346118:7491]
2025-09-30T14:53:24.032596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:24.032608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:24.032612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:24.032615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:24.032617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:24.032627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:24.032630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:24.032626Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1182
2025-09-30T14:53:24.032668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895464791346118:7491]
2025-09-30T14:53:24.032631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1182
2025-09-30T14:53:24.032680Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:24.032686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:24.032696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:24.032705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:24.032748Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3780cf6-f0aa1e82-fbabcbf9-bdd33203_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:24.032758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:24.032761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:24.032763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:24.032773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:24.032786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:24.032806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:24.032923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:24.032931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:24.032942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:24.033014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1183 partition: 0 MaxSeqNo: 42 sessionId: src_id|b3780cf6-f0aa1e82-fbabcbf9-bdd33203_0
2025-09-30T14:53:24.033378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70e6ab68-f4b6f69c-9e5fbdea-c5571a5d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b3780cf6-f0aa1e82-fbabcbf9-bdd33203_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:24.036047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3780cf6-f0aa1e82-fbabcbf9-bdd33203_0] Write session: try to update token
2025-09-30T14:53:24.036063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3780cf6-f0aa1e82-fbabcbf9-bdd33203_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:24.044630Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:24.044650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:24.044652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:24.044653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:24.044661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895464791346118:7491]
2025-09-30T14:53:24.044665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895464791346118:7491]
2025-09-30T14:53:24.044668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895464791346118:7491]
2025-09-30T14:53:24.044701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:24.044707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.044708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:24.044712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:24.044717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:24.044720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:24.044847Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:24.049698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1183 sessionId: src_id|b3780cf6-f0aa1e82-fbabcbf9-bdd33203_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:24.052642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:24.102334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895464881095075:4239]
2025-09-30T14:53:24.102602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1182, pipe: [1:7555895464881095075:4239]
2025-09-30T14:53:24.153271Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:24.154133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:24.154148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:24.154186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895464881095075:4239], now have 1 active actors on pipe
2025-09-30T14:53:24.154397Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:24.154455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895464881095075:4239]
2025-09-30T14:53:24.154463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:24.154489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:24.154566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1183 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b3780cf6-f0aa1e82-fbabcbf9-bdd33203_0
2025-09-30T14:53:24.154775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1183 sessionId: src_id|b3780cf6-f0aa1e82-fbabcbf9-bdd33203_0 is DEAD
2025-09-30T14:53:24.154955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3780cf6-f0aa1e82-fbabcbf9-bdd33203_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:24.154967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3780cf6-f0aa1e82-fbabcbf9-bdd33203_0] Write session will restart in 0.005962s
2025-09-30T14:53:24.154991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3780cf6-f0aa1e82-fbabcbf9-bdd33203_0] Write session: Do CDS request
2025-09-30T14:53:24.154997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3780cf6-f0aa1e82-fbabcbf9-bdd33203_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:24.161791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3780cf6-f0aa1e82-fbabcbf9-bdd33203_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:24.161850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:24.161867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1184
2025-09-30T14:53:24.162001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1184 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:24.162035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1184 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:24.162045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1184 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:24.162049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:24.162512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1184 sessionId:  describe result for acl check
2025-09-30T14:53:24.162550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:24.162558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:24.162560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:24.162565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895464881095095:3600] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:24.163104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895464881095095:3600] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:24.165943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895464881095095:3600] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:24.169089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895464881095095:3600] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:24.169116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895464881095095:3600] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:24.169119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895464881095095:3600] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:24.169127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1184 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:24.174188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:24.176679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:24.176899Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:24.176909Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:24.176919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:24.176969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:24.177011Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895464791346402:7493]
2025-09-30T14:53:24.177670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:24.177978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:24.178039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:24.178493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:24.178572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:24.178579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:24.178580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:24.178581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:24.178583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:24.178584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:24.178585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:24.178586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:24.178588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:24.178589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:24.178590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.178591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.178593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.178594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:24.178595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:24.178602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:24.178613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:24.178617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:24.178622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:24.178627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:24.178632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:24.178636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:24.178640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:24.178645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:24.178649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:24.178654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.178659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.178663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.178668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:24.178672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:24.178681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:24.178689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:24.178701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:24.178706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:24.178711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:24.178716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:24.178721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:24.178727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:24.178732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:24.178737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:24.178742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:24.178747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:24.178751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:24.178761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:24.178765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:24.178770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:24.178775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:24.178780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:24.178786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:24.178796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:24.178802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.178808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.178813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.178819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.178824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.178832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.178836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:24.178841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:24.178846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:24.178851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:24.178894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:24.184489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:24.185820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:24.185834Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:24.185836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:24.185839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:24.185843Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1183 [2:7555895464791346402:7493]
2025-09-30T14:53:24.185855Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:24.185865Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:24.185867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:24.185869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:24.185871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:24.185885Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:24.185892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:24.185899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:24.185970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.185978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.185980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.185983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:24.185986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:24.186053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:24.186062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.186087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.186100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.186117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:24.186139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895464881095237:3600], now have 1 active actors on pipe
2025-09-30T14:53:24.186143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895464881095076:2454], now have 1 active actors on pipe
2025-09-30T14:53:24.186151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895464791346397:7493]
2025-09-30T14:53:24.186153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895464791346397:7493]
2025-09-30T14:53:24.186155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895464791346397:7493]
2025-09-30T14:53:24.186167Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:24.186183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:24.186187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:24.186193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:24.186196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:24.186202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:24.186204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:24.186193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1183
2025-09-30T14:53:24.186234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895464791346397:7493]
2025-09-30T14:53:24.186243Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:24.186245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:24.186259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:24.186263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:24.186209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1183
2025-09-30T14:53:24.186314Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|205386f0-d710735a-f45aceb8-3ded75b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:24.186326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:24.186330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:24.186332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:24.186342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:24.186352Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:24.186372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:24.186530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:24.186538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:24.186552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:24.186628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1184 partition: 0 MaxSeqNo: 42 sessionId: src_id|205386f0-d710735a-f45aceb8-3ded75b4_0
2025-09-30T14:53:24.187019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3780cf6-f0aa1e82-fbabcbf9-bdd33203_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|205386f0-d710735a-f45aceb8-3ded75b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:24.189835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|205386f0-d710735a-f45aceb8-3ded75b4_0] Write session: try to update token
2025-09-30T14:53:24.189857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|205386f0-d710735a-f45aceb8-3ded75b4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:24.198698Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:24.198719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:24.198722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:24.198724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:24.198732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895464791346397:7493]
2025-09-30T14:53:24.198736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895464791346397:7493]
2025-09-30T14:53:24.198740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895464791346397:7493]
2025-09-30T14:53:24.198781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:24.198782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:24.198785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:24.198790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.198796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:24.198796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:24.198943Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:24.204562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1184 sessionId: src_id|205386f0-d710735a-f45aceb8-3ded75b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:24.207399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:24.254434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895464881095383:4239]
2025-09-30T14:53:24.254662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1183, pipe: [1:7555895464881095383:4239]
2025-09-30T14:53:24.311224Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:24.311755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:24.311769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:24.311802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895464881095383:4239], now have 1 active actors on pipe
2025-09-30T14:53:24.311961Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:24.312074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:24.312154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895464881095383:4239]
2025-09-30T14:53:24.312166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1184 reason: status is not ok: tablet will be restarted right now sessionId: src_id|205386f0-d710735a-f45aceb8-3ded75b4_0
2025-09-30T14:53:24.312193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:24.312332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1184 sessionId: src_id|205386f0-d710735a-f45aceb8-3ded75b4_0 is DEAD
2025-09-30T14:53:24.312468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|205386f0-d710735a-f45aceb8-3ded75b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:24.312473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|205386f0-d710735a-f45aceb8-3ded75b4_0] Write session will restart in 0.009821s
2025-09-30T14:53:24.312490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|205386f0-d710735a-f45aceb8-3ded75b4_0] Write session: Do CDS request
2025-09-30T14:53:24.312495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|205386f0-d710735a-f45aceb8-3ded75b4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:24.323712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|205386f0-d710735a-f45aceb8-3ded75b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:24.323797Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:24.323817Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1185
2025-09-30T14:53:24.323951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1185 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:24.323983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1185 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:24.323993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1185 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:24.324008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:24.324405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1185 sessionId:  describe result for acl check
2025-09-30T14:53:24.324437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:24.324442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:24.324443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:24.324448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895464881095483:3588] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:24.324906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895464881095483:3588] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:24.327566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895464881095483:3588] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:24.330988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895464881095483:3588] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:24.331005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895464881095483:3588] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:24.331009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895464881095483:3588] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:24.331017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1185 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:24.331638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:24.334593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:24.334839Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:24.334851Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:24.334862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:24.334918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:24.334960Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895464791346704:7509]
2025-09-30T14:53:24.335627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:24.335993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:24.336045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:24.336374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:24.336436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:24.336442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:24.336444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:24.336445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:24.336446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:24.336448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:24.336449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:24.336450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:24.336452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:24.336453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:24.336454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.336455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.336456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.336458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:24.336459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:24.336465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:24.336476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:24.336480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:24.336485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:24.336489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:24.336494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:24.336498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:24.336502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:24.336506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:24.336511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:24.336515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.336519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.336523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.336527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:24.336531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:24.336540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:24.336548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:24.336555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:24.336561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:24.336566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:24.336572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:24.336576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:24.336582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:24.336586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:24.336592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:24.336597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:24.336602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:24.336607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:24.336613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:24.336618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:24.336624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:24.336634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:24.336640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:24.336650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:24.336656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:24.336665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.336670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.336675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.336685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.336690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.336700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.336706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:24.336717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:24.336723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:24.336728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:24.336778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:24.342470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:24.343755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:24.343773Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:24.343775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:24.343780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:24.343786Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1184 [2:7555895464791346704:7509]
2025-09-30T14:53:24.343802Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:24.343821Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:24.343824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:24.343833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:24.343835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:24.343851Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:24.343857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:24.343864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:24.343921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.343929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.343932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.343935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:24.343938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:24.344009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:24.344019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.344032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.344044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.344062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:24.344084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895464881095647:3588], now have 1 active actors on pipe
2025-09-30T14:53:24.344087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895464881095385:2454], now have 1 active actors on pipe
2025-09-30T14:53:24.344093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895464791346699:7509]
2025-09-30T14:53:24.344095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895464791346699:7509]
2025-09-30T14:53:24.344098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895464791346699:7509]
2025-09-30T14:53:24.344109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:24.344124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:24.344126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:24.344136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:24.344139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:24.344141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:24.344144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:24.344176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895464791346699:7509]
2025-09-30T14:53:24.344157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1184
2025-09-30T14:53:24.344188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:24.344161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1184
2025-09-30T14:53:24.344204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:24.344233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:24.344243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:24.344273Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ebed5183-209dcc0d-ea8791d3-4ed03ad1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:24.344283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:24.344287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:24.344289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:24.344300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:24.344313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:24.344331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:24.344501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:24.344509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:24.344523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:24.344602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1185 partition: 0 MaxSeqNo: 42 sessionId: src_id|ebed5183-209dcc0d-ea8791d3-4ed03ad1_0
2025-09-30T14:53:24.344982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|205386f0-d710735a-f45aceb8-3ded75b4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ebed5183-209dcc0d-ea8791d3-4ed03ad1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:24.348025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebed5183-209dcc0d-ea8791d3-4ed03ad1_0] Write session: try to update token
2025-09-30T14:53:24.348046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebed5183-209dcc0d-ea8791d3-4ed03ad1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:24.356325Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:24.356343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:24.356346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:24.356348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:24.356357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895464791346699:7509]
2025-09-30T14:53:24.356362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895464791346699:7509]
2025-09-30T14:53:24.356366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895464791346699:7509]
2025-09-30T14:53:24.356402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:24.356407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:24.356411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.356412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:24.356414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:24.356416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:24.356551Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:24.363182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1185 sessionId: src_id|ebed5183-209dcc0d-ea8791d3-4ed03ad1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:24.365903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:24.412105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895464881095660:4239]
2025-09-30T14:53:24.412412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1184, pipe: [1:7555895464881095660:4239]
2025-09-30T14:53:24.464537Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:24.465125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:24.465141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:24.465179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895464881095660:4239], now have 1 active actors on pipe
2025-09-30T14:53:24.465395Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:24.465462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895464881095660:4239]
2025-09-30T14:53:24.465472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:24.465492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:24.465544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1185 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ebed5183-209dcc0d-ea8791d3-4ed03ad1_0
2025-09-30T14:53:24.465769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1185 sessionId: src_id|ebed5183-209dcc0d-ea8791d3-4ed03ad1_0 is DEAD
2025-09-30T14:53:24.465972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebed5183-209dcc0d-ea8791d3-4ed03ad1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:24.465995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebed5183-209dcc0d-ea8791d3-4ed03ad1_0] Write session will restart in 0.005372s
2025-09-30T14:53:24.466020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebed5183-209dcc0d-ea8791d3-4ed03ad1_0] Write session: Do CDS request
2025-09-30T14:53:24.466026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebed5183-209dcc0d-ea8791d3-4ed03ad1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:24.472783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebed5183-209dcc0d-ea8791d3-4ed03ad1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:24.472984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:24.473012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1186
2025-09-30T14:53:24.473158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1186 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:24.473197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1186 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:24.473205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1186 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:24.473208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:24.473680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1186 sessionId:  describe result for acl check
2025-09-30T14:53:24.473719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:24.473726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:24.473728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:24.473734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895464881095685:3582] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:24.474315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895464881095685:3582] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:24.477077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895464881095685:3582] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:24.480265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895464881095685:3582] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:24.480279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895464881095685:3582] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:24.480285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895464881095685:3582] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:24.480294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1186 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:24.484429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:24.487410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:24.487605Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:24.487614Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:24.487624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:24.487673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:24.487707Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895464791346970:7511]
2025-09-30T14:53:24.488367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:24.488695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:24.488735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:24.489049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:24.489105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:24.489111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:24.489112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:24.489114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:24.489115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:24.489116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:24.489117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:24.489118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:24.489120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:24.489121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:24.489122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.489124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.489125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.489126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:24.489127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:24.489133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:24.489142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:24.489146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:24.489151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:24.489155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:24.489159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:24.489163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:24.489167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:24.489171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:24.489175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:24.489179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.489183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.489188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.489192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:24.489195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:24.489204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:24.489213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:24.489218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:24.489224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:24.489229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:24.489240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:24.489244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:24.489250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:24.489255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:24.489260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:24.489267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:24.489273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:24.489277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:24.489284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:24.489289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:24.489294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:24.489299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:24.489306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:24.489311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:24.489316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:24.489327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.489332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.489336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.489342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.489348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.489354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.489358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:24.489365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:24.489369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:24.489376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:24.489422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:24.494853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:24.496218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:24.496234Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:24.496237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:24.496240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:24.496247Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1185 [2:7555895464791346970:7511]
2025-09-30T14:53:24.496264Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:24.496280Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:24.496288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:24.496291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:24.496293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:24.496312Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:24.496318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:24.496326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:24.496385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.496392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.496394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.496398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:24.496400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:24.496461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:24.496468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.496480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.496610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1185
2025-09-30T14:53:24.496616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1185
2025-09-30T14:53:24.496493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.496528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:24.496548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895464881095661:2454], now have 1 active actors on pipe
2025-09-30T14:53:24.496551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895464881095837:3582], now have 1 active actors on pipe
2025-09-30T14:53:24.496558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895464791346965:7511]
2025-09-30T14:53:24.496561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895464791346965:7511]
2025-09-30T14:53:24.496563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895464791346965:7511]
2025-09-30T14:53:24.496579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:24.496592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:24.496594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:24.496598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:24.496599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:24.496606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:24.496609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:24.496637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895464791346965:7511]
2025-09-30T14:53:24.496640Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:24.496642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:24.496661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:24.496667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:24.496703Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1f39796-c074efe5-1d28d4f4-ce43f48e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:24.496710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:24.496714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:24.496716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:24.496726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:24.496735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:24.496752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:24.496893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:24.496895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:24.496907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:24.496975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1186 partition: 0 MaxSeqNo: 42 sessionId: src_id|e1f39796-c074efe5-1d28d4f4-ce43f48e_0
2025-09-30T14:53:24.497382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebed5183-209dcc0d-ea8791d3-4ed03ad1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e1f39796-c074efe5-1d28d4f4-ce43f48e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:24.500115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1f39796-c074efe5-1d28d4f4-ce43f48e_0] Write session: try to update token
2025-09-30T14:53:24.500131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1f39796-c074efe5-1d28d4f4-ce43f48e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:24.509053Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:24.509073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:24.509076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:24.509078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:24.509088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895464791346965:7511]
2025-09-30T14:53:24.509093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895464791346965:7511]
2025-09-30T14:53:24.509097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895464791346965:7511]
2025-09-30T14:53:24.509137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:24.509136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:24.509144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:24.509147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:24.509151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.509154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:24.509288Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:24.514395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1186 sessionId: src_id|e1f39796-c074efe5-1d28d4f4-ce43f48e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:24.517143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:24.565699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895464881095939:4239]
2025-09-30T14:53:24.566044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1185, pipe: [1:7555895464881095939:4239]
2025-09-30T14:53:24.618712Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:24.619227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:24.619261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:24.619309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895464881095939:4239], now have 1 active actors on pipe
2025-09-30T14:53:24.619504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:24.619529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895464881095939:4239]
2025-09-30T14:53:24.619536Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:24.619556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:24.619567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:24.619630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1186 reason: error at write: Disconnected sessionId: src_id|e1f39796-c074efe5-1d28d4f4-ce43f48e_0
2025-09-30T14:53:24.619827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1186 sessionId: src_id|e1f39796-c074efe5-1d28d4f4-ce43f48e_0 is DEAD
2025-09-30T14:53:24.619948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1f39796-c074efe5-1d28d4f4-ce43f48e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:24.619960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1f39796-c074efe5-1d28d4f4-ce43f48e_0] Write session will restart in 0.009813s
2025-09-30T14:53:24.619979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1f39796-c074efe5-1d28d4f4-ce43f48e_0] Write session: Do CDS request
2025-09-30T14:53:24.619986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1f39796-c074efe5-1d28d4f4-ce43f48e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:24.630859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1f39796-c074efe5-1d28d4f4-ce43f48e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:24.630964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:24.630982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1187
2025-09-30T14:53:24.631152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1187 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:24.631196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1187 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:24.631207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1187 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:24.631212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:24.631696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1187 sessionId:  describe result for acl check
2025-09-30T14:53:24.631733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:24.631735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:24.631738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:24.631744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895464881096022:3574] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:24.632266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895464881096022:3574] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:24.635838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895464881096022:3574] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:24.638235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895464881096022:3574] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:24.638250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895464881096022:3574] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:24.638253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895464881096022:3574] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:24.638261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1187 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:24.640757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:24.643754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:24.643954Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:24.643964Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:24.643974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:24.644023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:24.644075Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895464791347240:7514]
2025-09-30T14:53:24.644634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:24.644927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:24.644970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:24.645251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:24.645305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:24.645311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:24.645312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:24.645313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:24.645314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:24.645315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:24.645316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:24.645317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:24.645318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:24.645319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:24.645320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.645322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.645323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.645324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:24.645325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:24.645330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:24.645340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:24.645345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:24.645349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:24.645353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:24.645357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:24.645360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:24.645364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:24.645367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:24.645387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:24.645391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.645395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.645400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.645404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:24.645408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:24.645416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:24.645424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:24.645430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:24.645436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:24.645442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:24.645448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:24.645453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:24.645458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:24.645468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:24.645473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:24.645477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:24.645487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:24.645492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:24.645502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:24.645506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:24.645512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:24.645516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:24.645526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:24.645530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:24.645537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:24.645546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.645551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.645560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.645566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.645573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.645576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.645578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:24.645584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:24.645587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:24.645590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:24.645623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:24.651307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:24.652843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:24.652861Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:24.652864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:24.652867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:24.652874Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1186 [2:7555895464791347240:7514]
2025-09-30T14:53:24.652890Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:24.652905Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:24.652908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:24.652912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:24.652914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:24.652930Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:24.652938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:24.652945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:24.653006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.653014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.653016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.653019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:24.653022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:24.653089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:24.653096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.653111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.653128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.653145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:24.653167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895464881095940:2454], now have 1 active actors on pipe
2025-09-30T14:53:24.653175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895464881096195:3574], now have 1 active actors on pipe
2025-09-30T14:53:24.653181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895464791347235:7514]
2025-09-30T14:53:24.653184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895464791347235:7514]
2025-09-30T14:53:24.653186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895464791347235:7514]
2025-09-30T14:53:24.653198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:24.653211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:24.653216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:24.653222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:24.653225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:24.653229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:24.653232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:24.653267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895464791347235:7514]
2025-09-30T14:53:24.653279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:24.653264Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1186
2025-09-30T14:53:24.653292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1186
2025-09-30T14:53:24.653296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:24.653334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:24.653338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:24.653361Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed97a105-7b0a2ee3-ce340130-ce0d89e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:24.653368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:24.653372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:24.653374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:24.653384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:24.653394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:24.653409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:24.653588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:24.653602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:24.653627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:24.653781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1187 partition: 0 MaxSeqNo: 42 sessionId: src_id|ed97a105-7b0a2ee3-ce340130-ce0d89e2_0
2025-09-30T14:53:24.654169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1f39796-c074efe5-1d28d4f4-ce43f48e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ed97a105-7b0a2ee3-ce340130-ce0d89e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:24.656981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed97a105-7b0a2ee3-ce340130-ce0d89e2_0] Write session: try to update token
2025-09-30T14:53:24.657004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed97a105-7b0a2ee3-ce340130-ce0d89e2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:24.671705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1187 sessionId: src_id|ed97a105-7b0a2ee3-ce340130-ce0d89e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:24.673225Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:24.673243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:24.673254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895464791347235:7514]
2025-09-30T14:53:24.673300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:24.673436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:24.673482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:24.673625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:24.673776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:24.673927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:24.674147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:24.674192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:24.674422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:24.674644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:24.674662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:24.674707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:24.674809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:24.677943Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:24.677958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:24.677960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:24.677963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:24.677971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895464791347235:7514]
2025-09-30T14:53:24.677975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895464791347235:7514]
2025-09-30T14:53:24.677980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895464791347235:7514]
2025-09-30T14:53:24.678017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:24.678030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.678033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:24.678033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:24.678041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:24.678045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:24.678193Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:24.719823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895464881096217:4239]
2025-09-30T14:53:24.720114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1186, pipe: [1:7555895464881096217:4239]
2025-09-30T14:53:24.788661Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:24.796044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:24.796071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:24.796234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:24.796302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:24.796365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:24.796421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:24.796799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:24.796814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:24.796880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:24.796937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:24.796993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:24.797053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:24.797099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:24.797107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:24.797168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:24.797231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:24.797305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:24.797370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:24.797409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:24.797415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:24.797479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:24.797540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:24.797611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:24.797678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:24.797724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:24.797730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:24.797790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:24.797845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:24.797904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:24.797964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:24.798009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:24.798017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:24.798101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:24.798158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:24.798221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:24.798289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:24.798331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:24.798338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:24.798403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:24.798458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:24.798515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:24.798574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:24.798614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:24.798620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:24.798678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:24.798738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:24.798810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:24.798881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:24.798929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:24.798936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:24.798999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:24.799054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:24.799119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:24.799187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:24.799357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:24.799369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:24.799437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:24.799502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:24.799561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:24.799626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:24.799672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:24.799680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:24.799746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895464881096217:4239], now have 1 active actors on pipe
2025-09-30T14:53:24.800028Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:24.800035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:24.800040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:24.800071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1187 reason: error at write: Disconnected sessionId: src_id|ed97a105-7b0a2ee3-ce340130-ce0d89e2_0
2025-09-30T14:53:24.800095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895464881096217:4239]
2025-09-30T14:53:24.800268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1187 sessionId: src_id|ed97a105-7b0a2ee3-ce340130-ce0d89e2_0 is DEAD
2025-09-30T14:53:24.800371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed97a105-7b0a2ee3-ce340130-ce0d89e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:24.800382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed97a105-7b0a2ee3-ce340130-ce0d89e2_0] Write session will restart in 0.005404s
2025-09-30T14:53:24.800405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed97a105-7b0a2ee3-ce340130-ce0d89e2_0] Write session: Do CDS request
2025-09-30T14:53:24.800410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed97a105-7b0a2ee3-ce340130-ce0d89e2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:24.800503Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:24.806733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed97a105-7b0a2ee3-ce340130-ce0d89e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:24.806848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:24.806874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1188
2025-09-30T14:53:24.806994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1188 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:24.807038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1188 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:24.807048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1188 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:24.807052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:24.807503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1188 sessionId:  describe result for acl check
2025-09-30T14:53:24.807540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:24.807542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:24.807543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:24.807549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895464881096236:3570] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:24.808104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895464881096236:3570] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:24.811813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895464881096236:3570] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:24.815211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895464881096236:3570] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:24.815227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895464881096236:3570] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:24.815230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895464881096236:3570] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:24.815238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1188 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:24.819340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:24.822000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:24.822212Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:24.822223Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:24.822233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:24.822287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:24.822324Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895464791347509:7516]
2025-09-30T14:53:24.822901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:24.823199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:24.823237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:24.823547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:24.823599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:24.823605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:24.823606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:24.823607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:24.823608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:24.823609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:24.823610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:24.823612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:24.823613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:24.823614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:24.823615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.823616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.823617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.823618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:24.823619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:24.823624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:24.823633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:24.823637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:24.823641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:24.823645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:24.823648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:24.823651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:24.823655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:24.823658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:24.823662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:24.823665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.823669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.823673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.823676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:24.823680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:24.823688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:24.823695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:24.823700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:24.823705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:24.823709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:24.823713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:24.823717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:24.823721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:24.823725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:24.823730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:24.823733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:24.823737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:24.823741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:24.823746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:24.823750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:24.823754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:24.823759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:24.823763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:24.823766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:24.823771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:24.823777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.823781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.823790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.823794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.823798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.823802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.823806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:24.823810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:24.823814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:24.823833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:24.823868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:24.829169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:24.830150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:24.830164Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:24.830167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:24.830170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:24.830178Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1187 [2:7555895464791347509:7516]
2025-09-30T14:53:24.830194Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:24.830207Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:24.830216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:24.830218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:24.830220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:24.830235Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:24.830243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:24.830253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:24.830310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.830317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.830319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.830322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:24.830324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:24.830388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:24.830395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.830406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.830417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.830439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:24.830457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895464881096402:3570], now have 1 active actors on pipe
2025-09-30T14:53:24.830460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895464881096218:2454], now have 1 active actors on pipe
2025-09-30T14:53:24.830466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895464791347504:7516]
2025-09-30T14:53:24.830468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895464791347504:7516]
2025-09-30T14:53:24.830470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895464791347504:7516]
2025-09-30T14:53:24.830480Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:24.830493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:24.830511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:24.830518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:24.830522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:24.830527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:24.830529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:24.830545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895464791347504:7516]
2025-09-30T14:53:24.830551Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:24.830564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:24.830530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1187
2025-09-30T14:53:24.830550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1187
2025-09-30T14:53:24.830581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:24.830590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:24.830619Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f910287b-4c470128-5e09f290-5196c3cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:24.830630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:24.830633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:24.830638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:24.830649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:24.830663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:24.830681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:24.830845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:24.830856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:24.830870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:24.830952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1188 partition: 0 MaxSeqNo: 42 sessionId: src_id|f910287b-4c470128-5e09f290-5196c3cb_0
2025-09-30T14:53:24.831346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed97a105-7b0a2ee3-ce340130-ce0d89e2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f910287b-4c470128-5e09f290-5196c3cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:24.834125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f910287b-4c470128-5e09f290-5196c3cb_0] Write session: try to update token
2025-09-30T14:53:24.834146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f910287b-4c470128-5e09f290-5196c3cb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:24.842556Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:24.842578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:24.842581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:24.842584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:24.842594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895464791347504:7516]
2025-09-30T14:53:24.842598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895464791347504:7516]
2025-09-30T14:53:24.842602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895464791347504:7516]
2025-09-30T14:53:24.842642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:24.842648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.842648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:24.842651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:24.842654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:24.842659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:24.842780Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:24.848684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1188 sessionId: src_id|f910287b-4c470128-5e09f290-5196c3cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:24.851546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:24.900666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895464881096497:4239]
2025-09-30T14:53:24.900974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1187, pipe: [1:7555895464881096497:4239]
2025-09-30T14:53:24.957709Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:24.958354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:24.958371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:24.958413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895464881096497:4239], now have 1 active actors on pipe
2025-09-30T14:53:24.958624Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:24.958690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:24.958704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:24.958708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:24.958773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895464881096497:4239]
2025-09-30T14:53:24.958786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1188 reason: error at write: Disconnected sessionId: src_id|f910287b-4c470128-5e09f290-5196c3cb_0
2025-09-30T14:53:24.959024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1188 sessionId: src_id|f910287b-4c470128-5e09f290-5196c3cb_0 is DEAD
2025-09-30T14:53:24.959185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f910287b-4c470128-5e09f290-5196c3cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:24.959194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f910287b-4c470128-5e09f290-5196c3cb_0] Write session will restart in 0.009127s
2025-09-30T14:53:24.959215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f910287b-4c470128-5e09f290-5196c3cb_0] Write session: Do CDS request
2025-09-30T14:53:24.959223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f910287b-4c470128-5e09f290-5196c3cb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:24.969875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f910287b-4c470128-5e09f290-5196c3cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:24.969949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:24.969969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1189
2025-09-30T14:53:24.970145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1189 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:24.970191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1189 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:24.970201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1189 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:24.970206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:24.970757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1189 sessionId:  describe result for acl check
2025-09-30T14:53:24.970800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:24.970803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:24.970805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:24.970827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895464881096572:3556] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:24.971404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895464881096572:3556] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:24.974806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895464881096572:3556] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:24.977617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895464881096572:3556] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:24.977632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895464881096572:3556] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:24.977635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895464881096572:3556] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:24.977642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1189 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:24.978836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:24.981748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:24.981953Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:24.981963Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:24.981974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:24.982038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:24.982088Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895464791347779:7518]
2025-09-30T14:53:24.982752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:24.983063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:24.983103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:24.983457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:24.983520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:24.983527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:24.983528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:24.983529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:24.983531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:24.983532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:24.983533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:24.983534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:24.983536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:24.983537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:24.983538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.983539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.983540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.983542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:24.983543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:24.983548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:24.983559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:24.983563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:24.983567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:24.983571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:24.983576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:24.983580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:24.983584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:24.983588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:24.983593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:24.983596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.983600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.983605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.983609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:24.983612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:24.983620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:24.983629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:24.983634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:24.983639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:24.983644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:24.983650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:24.983654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:24.983659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:24.983664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:24.983670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:24.983674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:24.983679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:24.983684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:24.983690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:24.983693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:24.983699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:24.983703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:24.983709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:24.983713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:24.983719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:24.983724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.983730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.983741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.983747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.983751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.983761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.983766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:24.983775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:24.983779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:24.983785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:24.983830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:24.989437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:24.990303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:24.990318Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:24.990321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:24.990325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:24.990332Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1188 [2:7555895464791347779:7518]
2025-09-30T14:53:24.990348Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:24.990363Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:24.990370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:24.990373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:24.990376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:24.990391Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:24.990398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:24.990405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:24.990461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.990469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.990471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.990476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:24.990479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:24.990541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:24.990548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:24.990560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:24.990577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:24.990600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:24.990621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895464881096762:3556], now have 1 active actors on pipe
2025-09-30T14:53:24.990630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895464881096501:2454], now have 1 active actors on pipe
2025-09-30T14:53:24.990636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895464791347774:7518]
2025-09-30T14:53:24.990644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895464791347774:7518]
2025-09-30T14:53:24.990646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895464791347774:7518]
2025-09-30T14:53:24.990661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:24.990679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:24.990693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:24.990697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:24.990696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:24.990702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:24.990705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:24.990728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895464791347774:7518]
2025-09-30T14:53:24.990742Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:24.990713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1188
2025-09-30T14:53:24.990756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:24.990729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1188
2025-09-30T14:53:24.990781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:24.990792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:24.990822Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2611cfc2-c4af1a82-71771895-1d862a98_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:24.990833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:24.990837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:24.990839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:24.990849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:24.990857Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:24.990869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:24.991072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:24.991084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:24.991107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:24.991199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1189 partition: 0 MaxSeqNo: 42 sessionId: src_id|2611cfc2-c4af1a82-71771895-1d862a98_0
2025-09-30T14:53:24.991574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f910287b-4c470128-5e09f290-5196c3cb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2611cfc2-c4af1a82-71771895-1d862a98_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:24.994425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2611cfc2-c4af1a82-71771895-1d862a98_0] Write session: try to update token
2025-09-30T14:53:24.994442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2611cfc2-c4af1a82-71771895-1d862a98_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:25.003461Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:25.003480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:25.003482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:25.003484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:25.003496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895464791347774:7518]
2025-09-30T14:53:25.003500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895464791347774:7518]
2025-09-30T14:53:25.003504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895464791347774:7518]
2025-09-30T14:53:25.003541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:25.003548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.003548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:25.003550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:25.003555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:25.003560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:25.003682Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:25.009008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1189 sessionId: src_id|2611cfc2-c4af1a82-71771895-1d862a98_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:25.011795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:25.058760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895469176064078:4239]
2025-09-30T14:53:25.059042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1188, pipe: [1:7555895469176064078:4239]
2025-09-30T14:53:25.117041Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:25.117726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:25.117748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:25.117789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895469176064078:4239], now have 1 active actors on pipe
2025-09-30T14:53:25.118015Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:25.118007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:25.118008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:25.118029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:25.118087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895469176064078:4239]
2025-09-30T14:53:25.118108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1189 reason: error at write: Disconnected sessionId: src_id|2611cfc2-c4af1a82-71771895-1d862a98_0
2025-09-30T14:53:25.118288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1189 sessionId: src_id|2611cfc2-c4af1a82-71771895-1d862a98_0 is DEAD
2025-09-30T14:53:25.118466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2611cfc2-c4af1a82-71771895-1d862a98_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:25.118476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2611cfc2-c4af1a82-71771895-1d862a98_0] Write session will restart in 0.007462s
2025-09-30T14:53:25.118499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2611cfc2-c4af1a82-71771895-1d862a98_0] Write session: Do CDS request
2025-09-30T14:53:25.118509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2611cfc2-c4af1a82-71771895-1d862a98_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:25.126825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2611cfc2-c4af1a82-71771895-1d862a98_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:25.126916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:25.126933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1190
2025-09-30T14:53:25.127073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1190 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:25.127116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1190 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:25.127126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1190 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:25.127130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:25.127596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1190 sessionId:  describe result for acl check
2025-09-30T14:53:25.127643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:25.127653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:25.127655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:25.127660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895469176064112:3557] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:25.128212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895469176064112:3557] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:25.131384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895469176064112:3557] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:25.135114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895469176064112:3557] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:25.135129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895469176064112:3557] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:25.135133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895469176064112:3557] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:25.135142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1190 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:25.138338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:25.141078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:25.141289Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:25.141300Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:25.141310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:25.141361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:25.141401Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895469086315346:7520]
2025-09-30T14:53:25.142097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:25.142413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:25.142467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:25.142810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:25.142868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:25.142874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:25.142876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:25.142877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:25.142879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:25.142880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:25.142881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:25.142883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:25.142884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:25.142885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:25.142886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.142888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.142889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.142890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:25.142891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:25.142897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:25.142908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:25.142913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:25.142918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:25.142922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:25.142927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:25.142932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:25.142936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:25.142941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:25.142946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:25.142950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.142954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.142959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.142963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:25.142968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:25.142975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:25.142983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:25.142990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:25.142996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:25.143001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:25.143005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:25.143009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:25.143014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:25.143024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:25.143029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:25.143033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:25.143038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:25.143042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:25.143047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:25.143052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:25.143057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:25.143062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:25.143069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:25.143073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:25.143078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:25.143089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.143095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.143099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.143104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.143109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.143117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.143121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:25.143126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:25.143130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:25.143135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:25.143185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:25.148696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:25.149661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:25.149680Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:25.149682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:25.149686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:25.149693Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1189 [2:7555895469086315346:7520]
2025-09-30T14:53:25.149709Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:25.149726Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:25.149734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:25.149737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:25.149739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:25.149756Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:25.149762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:25.149772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:25.150173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.150185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.150187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.150191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:25.150194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:25.150264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:25.150273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.150287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.150300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.150325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:25.150350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895469176064083:2454], now have 1 active actors on pipe
2025-09-30T14:53:25.150358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895469176064315:3557], now have 1 active actors on pipe
2025-09-30T14:53:25.150365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895469086315341:7520]
2025-09-30T14:53:25.150367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895469086315341:7520]
2025-09-30T14:53:25.150370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895469086315341:7520]
2025-09-30T14:53:25.150382Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:25.150397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:25.150400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:25.150408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:25.150410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:25.150416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:25.150419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:25.150435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1189
2025-09-30T14:53:25.150464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895469086315341:7520]
2025-09-30T14:53:25.150472Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:25.150441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1189
2025-09-30T14:53:25.150474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:25.150501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:25.150512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:25.150545Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ebe6ff10-48275619-9c3b184d-f6cab3bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:25.150552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:25.150561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:25.150563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:25.150572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:25.150581Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:25.150602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:25.150730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:25.150738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:25.150751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:25.150823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1190 partition: 0 MaxSeqNo: 42 sessionId: src_id|ebe6ff10-48275619-9c3b184d-f6cab3bf_0
2025-09-30T14:53:25.151199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2611cfc2-c4af1a82-71771895-1d862a98_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ebe6ff10-48275619-9c3b184d-f6cab3bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:25.154024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe6ff10-48275619-9c3b184d-f6cab3bf_0] Write session: try to update token
2025-09-30T14:53:25.154047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe6ff10-48275619-9c3b184d-f6cab3bf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:25.162887Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:25.162911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:25.162913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:25.162915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:25.162924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895469086315341:7520]
2025-09-30T14:53:25.162928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895469086315341:7520]
2025-09-30T14:53:25.162931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895469086315341:7520]
2025-09-30T14:53:25.162971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:25.162974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:25.162976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.162979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:25.162983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:25.162987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:25.163129Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:25.168566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1190 sessionId: src_id|ebe6ff10-48275619-9c3b184d-f6cab3bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:25.171315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:25.218511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895469176064375:4239]
2025-09-30T14:53:25.218816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1189, pipe: [1:7555895469176064375:4239]
2025-09-30T14:53:25.279734Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:25.280179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:25.280193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:25.280230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895469176064375:4239], now have 1 active actors on pipe
2025-09-30T14:53:25.280440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:25.280459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:25.280530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1190 reason: error at write: Disconnected sessionId: src_id|ebe6ff10-48275619-9c3b184d-f6cab3bf_0
2025-09-30T14:53:25.280708Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:25.280763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1190 sessionId: src_id|ebe6ff10-48275619-9c3b184d-f6cab3bf_0 is DEAD
2025-09-30T14:53:25.280914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe6ff10-48275619-9c3b184d-f6cab3bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:25.280925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe6ff10-48275619-9c3b184d-f6cab3bf_0] Write session will restart in 0.008788s
2025-09-30T14:53:25.280947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe6ff10-48275619-9c3b184d-f6cab3bf_0] Write session: Do CDS request
2025-09-30T14:53:25.280961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe6ff10-48275619-9c3b184d-f6cab3bf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:25.281021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895469176064375:4239]
2025-09-30T14:53:25.281044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:25.290764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe6ff10-48275619-9c3b184d-f6cab3bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:25.290901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:25.290919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1191
2025-09-30T14:53:25.291081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1191 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:25.291134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1191 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:25.291143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1191 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:25.291147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:25.291616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1191 sessionId:  describe result for acl check
2025-09-30T14:53:25.291649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:25.291651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:25.291659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:25.291666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895469176064413:3539] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:25.292195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895469176064413:3539] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:25.294821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895469176064413:3539] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:25.298367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895469176064413:3539] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:25.298386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895469176064413:3539] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:25.298390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895469176064413:3539] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:25.298399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1191 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:25.304330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:25.308008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:25.308227Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:25.308239Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:25.308251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:25.308307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:25.308348Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895469086315668:7530]
2025-09-30T14:53:25.309018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:25.309353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:25.309402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:25.309737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:25.309816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:25.309824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:25.309826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:25.309827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:25.309828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:25.309830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:25.309831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:25.309833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:25.309834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:25.309835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:25.309837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.309838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.309839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.309840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:25.309842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:25.309848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:25.309859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:25.309863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:25.309868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:25.309871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:25.309875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:25.309878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:25.309882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:25.309885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:25.309889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:25.309892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.309895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.309898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.309902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:25.309905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:25.309911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:25.309919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:25.309926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:25.309931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:25.309936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:25.309942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:25.309946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:25.309950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:25.309955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:25.309960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:25.309964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:25.309969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:25.309977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:25.309982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:25.309986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:25.309991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:25.309996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:25.310001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:25.310005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:25.310010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:25.310015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.310020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.310024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.310029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.310034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.310039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.310043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:25.310048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:25.310053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:25.310057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:25.310112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:25.315693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:25.316584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:25.316602Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:25.316604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:25.316609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:25.316616Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1190 [2:7555895469086315668:7530]
2025-09-30T14:53:25.316633Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:25.316654Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:25.316660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:25.316663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:25.316665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:25.316681Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:25.316690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:25.316696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:25.316742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.316749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.316751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.316753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:25.316755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:25.316805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:25.316811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.316819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.316825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.316835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:25.316848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895469086315663:7530]
2025-09-30T14:53:25.316853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895469086315663:7530]
2025-09-30T14:53:25.316856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895469086315663:7530]
2025-09-30T14:53:25.316862Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:25.316872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:25.316880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:25.316880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:25.316882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:25.316884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:25.316886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:25.316907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895469086315663:7530]
2025-09-30T14:53:25.316913Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:25.316920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895469176064562:3539], now have 1 active actors on pipe
2025-09-30T14:53:25.316923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895469176064389:2454], now have 1 active actors on pipe
2025-09-30T14:53:25.316931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:25.317022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1190
2025-09-30T14:53:25.317025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1190
2025-09-30T14:53:25.317088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:25.317105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:25.317137Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55b23a8c-5dc31d22-adf9c612-67c70377_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:25.317150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:25.317159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:25.317162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:25.317173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:25.317191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:25.317214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:25.317376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:25.317387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:25.317408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:25.317492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1191 partition: 0 MaxSeqNo: 42 sessionId: src_id|55b23a8c-5dc31d22-adf9c612-67c70377_0
2025-09-30T14:53:25.317918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe6ff10-48275619-9c3b184d-f6cab3bf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|55b23a8c-5dc31d22-adf9c612-67c70377_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:25.320736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55b23a8c-5dc31d22-adf9c612-67c70377_0] Write session: try to update token
2025-09-30T14:53:25.320761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55b23a8c-5dc31d22-adf9c612-67c70377_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:25.329057Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:25.329078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:25.329080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:25.329083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:25.329093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895469086315663:7530]
2025-09-30T14:53:25.329099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895469086315663:7530]
2025-09-30T14:53:25.329103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895469086315663:7530]
2025-09-30T14:53:25.329144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:25.329150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:25.329155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.329156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:25.329158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:25.329160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:25.329302Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:25.337234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1191 sessionId: src_id|55b23a8c-5dc31d22-adf9c612-67c70377_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:25.340392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:25.381330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895469176064678:4239]
2025-09-30T14:53:25.381659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1190, pipe: [1:7555895469176064678:4239]
2025-09-30T14:53:25.447829Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:25.448455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:25.448473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:25.448492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895469176064678:4239], now have 1 active actors on pipe
2025-09-30T14:53:25.448696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:25.448702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895469176064678:4239]
2025-09-30T14:53:25.448719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:25.449202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55b23a8c-5dc31d22-adf9c612-67c70377_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:25.448738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:25.449230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55b23a8c-5dc31d22-adf9c612-67c70377_0] Write session will restart in 0.006604s
2025-09-30T14:53:25.448785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1191 reason: error at write: Disconnected sessionId: src_id|55b23a8c-5dc31d22-adf9c612-67c70377_0
2025-09-30T14:53:25.448977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1191 sessionId: src_id|55b23a8c-5dc31d22-adf9c612-67c70377_0 is DEAD
2025-09-30T14:53:25.449257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55b23a8c-5dc31d22-adf9c612-67c70377_0] Write session: Do CDS request
2025-09-30T14:53:25.449263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55b23a8c-5dc31d22-adf9c612-67c70377_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:25.449291Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:25.456783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55b23a8c-5dc31d22-adf9c612-67c70377_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:25.456901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:25.456919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1192
2025-09-30T14:53:25.457094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1192 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:25.457139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1192 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:25.457149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1192 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:25.457154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:25.457609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1192 sessionId:  describe result for acl check
2025-09-30T14:53:25.457643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:25.457650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:25.457653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:25.457658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895469176064694:3536] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:25.458231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895469176064694:3536] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:25.461133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895469176064694:3536] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:25.464935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895469176064694:3536] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:25.464953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895469176064694:3536] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:25.464956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895469176064694:3536] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:25.464965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1192 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:25.472853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:25.475872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:25.476095Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:25.476104Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:25.476114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:25.476163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:25.476204Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895469086315941:7538]
2025-09-30T14:53:25.476906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:25.477281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:25.477329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:25.477658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:25.477746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:25.477753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:25.477754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:25.477755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:25.477756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:25.477757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:25.477758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:25.477759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:25.477760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:25.477762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:25.477763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.477764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.477765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.477766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:25.477767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:25.477773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:25.477785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:25.477789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:25.477792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:25.477796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:25.477799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:25.477803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:25.477806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:25.477810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:25.477814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:25.477818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.477822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.477825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.477829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:25.477832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:25.477840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:25.477848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:25.477855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:25.477860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:25.477864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:25.477869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:25.477874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:25.477879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:25.477883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:25.477888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:25.477892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:25.477897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:25.477902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:25.477907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:25.477911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:25.477916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:25.477928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:25.477933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:25.477938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:25.477944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:25.477948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.477953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.477957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.477967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.477971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.477975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.477979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:25.477982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:25.477986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:25.477991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:25.478033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:25.486579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:25.487606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:25.487623Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:25.487625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:25.487630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:25.487637Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1191 [2:7555895469086315941:7538]
2025-09-30T14:53:25.487654Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:25.487681Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:25.487688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:25.487692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:25.487694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:25.487710Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:25.487722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:25.487733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:25.487796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.487804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.487806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.487810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:25.487812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:25.487876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:25.487884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.487898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.487915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.487938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:25.487959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895469176064679:2454], now have 1 active actors on pipe
2025-09-30T14:53:25.487967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895469176064818:3536], now have 1 active actors on pipe
2025-09-30T14:53:25.487974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895469086315936:7538]
2025-09-30T14:53:25.487976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895469086315936:7538]
2025-09-30T14:53:25.487978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895469086315936:7538]
2025-09-30T14:53:25.487993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:25.488005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:25.488018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:25.488023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:25.488025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:25.488026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:25.488029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:25.488043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1191
2025-09-30T14:53:25.488064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895469086315936:7538]
2025-09-30T14:53:25.488074Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:25.488093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:25.488132Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1191
2025-09-30T14:53:25.488494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:25.488511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:25.488550Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18db29a4-896656f3-5b761a13-fe5d550b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:25.488565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:25.488574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:25.488577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:25.488587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:25.488601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:25.488624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:25.488857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:25.488865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:25.488879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:25.489010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1192 partition: 0 MaxSeqNo: 42 sessionId: src_id|18db29a4-896656f3-5b761a13-fe5d550b_0
2025-09-30T14:53:25.489459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55b23a8c-5dc31d22-adf9c612-67c70377_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|18db29a4-896656f3-5b761a13-fe5d550b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:25.492317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18db29a4-896656f3-5b761a13-fe5d550b_0] Write session: try to update token
2025-09-30T14:53:25.492338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18db29a4-896656f3-5b761a13-fe5d550b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:25.500692Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:25.500712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:25.500715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:25.500717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:25.500726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895469086315936:7538]
2025-09-30T14:53:25.500731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895469086315936:7538]
2025-09-30T14:53:25.500736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895469086315936:7538]
2025-09-30T14:53:25.500774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:25.500775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:25.500778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:25.500782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.500785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:25.500785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:25.500917Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:25.507501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1192 sessionId: src_id|18db29a4-896656f3-5b761a13-fe5d550b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:25.510165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:25.548722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895469176064963:4239]
2025-09-30T14:53:25.549032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1191, pipe: [1:7555895469176064963:4239]
2025-09-30T14:53:25.612236Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:25.612502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:25.612514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:25.612546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895469176064963:4239], now have 1 active actors on pipe
2025-09-30T14:53:25.612838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895469176064963:4239]
2025-09-30T14:53:25.612849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:25.612852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:25.612870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:25.612921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1192 reason: error at write: Disconnected sessionId: src_id|18db29a4-896656f3-5b761a13-fe5d550b_0
2025-09-30T14:53:25.612953Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:25.613112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1192 sessionId: src_id|18db29a4-896656f3-5b761a13-fe5d550b_0 is DEAD
2025-09-30T14:53:25.613333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18db29a4-896656f3-5b761a13-fe5d550b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:25.613350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18db29a4-896656f3-5b761a13-fe5d550b_0] Write session will restart in 0.006815s
2025-09-30T14:53:25.613380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18db29a4-896656f3-5b761a13-fe5d550b_0] Write session: Do CDS request
2025-09-30T14:53:25.613387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18db29a4-896656f3-5b761a13-fe5d550b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:25.621946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18db29a4-896656f3-5b761a13-fe5d550b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:25.622086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:25.622104Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1193
2025-09-30T14:53:25.622295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1193 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:25.622328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1193 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:25.622337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1193 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:25.622342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:25.622836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1193 sessionId:  describe result for acl check
2025-09-30T14:53:25.622873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:25.622880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:25.622883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:25.622889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895469176065008:3519] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:25.623466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895469176065008:3519] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:25.626203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895469176065008:3519] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:25.629550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895469176065008:3519] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:25.629569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895469176065008:3519] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:25.629573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895469176065008:3519] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:25.629581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1193 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:25.633354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:25.636148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:25.636472Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:25.636487Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:25.636500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:25.636565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:25.636607Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895469086316217:7540]
2025-09-30T14:53:25.637308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:25.637627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:25.637678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:25.638022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:25.638117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:25.638124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:25.638125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:25.638126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:25.638127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:25.638128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:25.638130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:25.638131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:25.638132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:25.638133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:25.638134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.638135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.638137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.638138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:25.638139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:25.638146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:25.638157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:25.638161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:25.638165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:25.638169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:25.638173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:25.638177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:25.638181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:25.638185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:25.638189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:25.638193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.638197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.638201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.638205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:25.638209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:25.638217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:25.638226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:25.638232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:25.638238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:25.638243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:25.638248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:25.638253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:25.638259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:25.638264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:25.638268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:25.638273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:25.638279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:25.638285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:25.638290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:25.638294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:25.638301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:25.638309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:25.638320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:25.638326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:25.638331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:25.638336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.638342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.638347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.638352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.638356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.638362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.638369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:25.638374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:25.638379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:25.638385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:25.638431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:25.644087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:25.645319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:25.645337Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:25.645340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:25.645343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:25.645350Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1192 [2:7555895469086316217:7540]
2025-09-30T14:53:25.645366Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:25.645380Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:25.645383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:25.645386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:25.645389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:25.645403Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:25.645415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:25.645421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:25.645482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.645491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.645493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.645497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:25.645500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:25.645564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:25.645571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.645583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.645598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.645617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:25.645640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895469176065177:3519], now have 1 active actors on pipe
2025-09-30T14:53:25.645649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895469176064964:2454], now have 1 active actors on pipe
2025-09-30T14:53:25.645655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895469086316212:7540]
2025-09-30T14:53:25.645657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895469086316212:7540]
2025-09-30T14:53:25.645660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895469086316212:7540]
2025-09-30T14:53:25.645671Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:25.645686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:25.645685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:25.645689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:25.645692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:25.645707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:25.645710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:25.645741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895469086316212:7540]
2025-09-30T14:53:25.645753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:25.645764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:25.645745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1192
2025-09-30T14:53:25.645746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1192
2025-09-30T14:53:25.645806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:25.645814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:25.645854Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c50b85bc-6d675602-763d3ec5-e6984c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:25.645866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:25.645870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:25.645872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:25.645882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:25.645891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:25.645913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:25.646090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:25.646101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:25.646115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:25.646196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1193 partition: 0 MaxSeqNo: 42 sessionId: src_id|c50b85bc-6d675602-763d3ec5-e6984c1_0
2025-09-30T14:53:25.646721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18db29a4-896656f3-5b761a13-fe5d550b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c50b85bc-6d675602-763d3ec5-e6984c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:25.650115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c50b85bc-6d675602-763d3ec5-e6984c1_0] Write session: try to update token
2025-09-30T14:53:25.650137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c50b85bc-6d675602-763d3ec5-e6984c1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:25.657809Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:25.657826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:25.657828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:25.657830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:25.657840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895469086316212:7540]
2025-09-30T14:53:25.657845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895469086316212:7540]
2025-09-30T14:53:25.657850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895469086316212:7540]
2025-09-30T14:53:25.657890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:25.657895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:25.657897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.657899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:25.657902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:25.657907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:25.658043Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:25.665140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1193 sessionId: src_id|c50b85bc-6d675602-763d3ec5-e6984c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:25.668025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:25.713088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895469176065247:4239]
2025-09-30T14:53:25.713360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1192, pipe: [1:7555895469176065247:4239]
2025-09-30T14:53:25.774893Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:25.775451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:25.775465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:25.775485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895469176065247:4239], now have 1 active actors on pipe
2025-09-30T14:53:25.775710Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:25.775737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:25.775743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:25.775758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:25.775790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895469176065247:4239]
2025-09-30T14:53:25.775821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1193 reason: error at write: Disconnected sessionId: src_id|c50b85bc-6d675602-763d3ec5-e6984c1_0
2025-09-30T14:53:25.776024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1193 sessionId: src_id|c50b85bc-6d675602-763d3ec5-e6984c1_0 is DEAD
2025-09-30T14:53:25.776177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c50b85bc-6d675602-763d3ec5-e6984c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:25.776188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c50b85bc-6d675602-763d3ec5-e6984c1_0] Write session will restart in 0.008495s
2025-09-30T14:53:25.776223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c50b85bc-6d675602-763d3ec5-e6984c1_0] Write session: Do CDS request
2025-09-30T14:53:25.776233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c50b85bc-6d675602-763d3ec5-e6984c1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:25.785897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c50b85bc-6d675602-763d3ec5-e6984c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:25.786045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:25.786061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1194
2025-09-30T14:53:25.786228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1194 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:25.786259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1194 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:25.786270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1194 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:25.786274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:25.786695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1194 sessionId:  describe result for acl check
2025-09-30T14:53:25.786726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:25.786728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:25.786734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:25.786739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895469176065300:3526] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:25.787295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895469176065300:3526] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:25.790411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895469176065300:3526] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:25.793905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895469176065300:3526] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:25.793922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895469176065300:3526] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:25.793925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895469176065300:3526] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:25.793933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1194 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:25.796227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:25.799222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:25.799437Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:25.799448Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:25.799460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:25.799515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:25.799552Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895469086316492:7543]
2025-09-30T14:53:25.800223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:25.800497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:25.800542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:25.801044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:25.801124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:25.801131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:25.801132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:25.801133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:25.801134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:25.801136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:25.801137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:25.801138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:25.801139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:25.801140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:25.801141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.801143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.801144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.801145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:25.801146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:25.801151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:25.801162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:25.801166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:25.801170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:25.801174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:25.801178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:25.801182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:25.801187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:25.801191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:25.801195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:25.801199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.801203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.801208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.801212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:25.801216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:25.801223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:25.801230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:25.801236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:25.801242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:25.801247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:25.801253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:25.801257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:25.801262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:25.801267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:25.801273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:25.801277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:25.801282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:25.801287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:25.801292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:25.801296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:25.801302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:25.801310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:25.801315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:25.801319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:25.801331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:25.801335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.801341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.801349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.801354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.801359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.801369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.801373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:25.801377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:25.801381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:25.801385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:25.801434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:25.807006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:25.808229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:25.808243Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:25.808246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:25.808249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:25.808255Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1193 [2:7555895469086316492:7543]
2025-09-30T14:53:25.808271Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:25.808286Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:25.808289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:25.808292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:25.808294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:25.808310Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:25.808316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:25.808323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:25.808386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.808394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.808396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.808400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:25.808402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:25.808464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:25.808474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.808486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.808499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.808517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:25.808541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895469176065505:3526], now have 1 active actors on pipe
2025-09-30T14:53:25.808550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895469176065248:2454], now have 1 active actors on pipe
2025-09-30T14:53:25.808556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895469086316487:7543]
2025-09-30T14:53:25.808558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895469086316487:7543]
2025-09-30T14:53:25.808560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895469086316487:7543]
2025-09-30T14:53:25.808572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:25.808587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:25.808587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:25.808590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:25.808593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:25.808606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:25.808609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:25.808640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895469086316487:7543]
2025-09-30T14:53:25.808652Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:25.808637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1193
2025-09-30T14:53:25.808669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:25.808648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1193
2025-09-30T14:53:25.808687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:25.808697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:25.808731Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa669658-1f6b74e0-90b42091-17b006b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:25.808742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:25.808746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:25.808748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:25.808757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:25.808771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:25.808789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:25.808979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:25.808987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:25.809000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:25.809106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1194 partition: 0 MaxSeqNo: 42 sessionId: src_id|fa669658-1f6b74e0-90b42091-17b006b9_0
2025-09-30T14:53:25.809519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c50b85bc-6d675602-763d3ec5-e6984c1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fa669658-1f6b74e0-90b42091-17b006b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:25.812616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa669658-1f6b74e0-90b42091-17b006b9_0] Write session: try to update token
2025-09-30T14:53:25.812636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa669658-1f6b74e0-90b42091-17b006b9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:25.821334Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:25.821352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:25.821354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:25.821356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:25.821365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895469086316487:7543]
2025-09-30T14:53:25.821369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895469086316487:7543]
2025-09-30T14:53:25.821373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895469086316487:7543]
2025-09-30T14:53:25.821410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:25.821412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:25.821420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.821421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:25.821423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:25.821425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:25.821562Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:25.827802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1194 sessionId: src_id|fa669658-1f6b74e0-90b42091-17b006b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:25.830690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:25.875905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895469176065532:4239]
2025-09-30T14:53:25.876176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1193, pipe: [1:7555895469176065532:4239]
2025-09-30T14:53:25.938196Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:25.938694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:25.938716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:25.938757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895469176065532:4239], now have 1 active actors on pipe
2025-09-30T14:53:25.938960Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:25.939025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895469176065532:4239]
2025-09-30T14:53:25.939027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:25.939031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:25.939057Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:25.939094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1194 reason: error at write: Disconnected sessionId: src_id|fa669658-1f6b74e0-90b42091-17b006b9_0
2025-09-30T14:53:25.939296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1194 sessionId: src_id|fa669658-1f6b74e0-90b42091-17b006b9_0 is DEAD
2025-09-30T14:53:25.939427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa669658-1f6b74e0-90b42091-17b006b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:25.939437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa669658-1f6b74e0-90b42091-17b006b9_0] Write session will restart in 0.005305s
2025-09-30T14:53:25.939461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa669658-1f6b74e0-90b42091-17b006b9_0] Write session: Do CDS request
2025-09-30T14:53:25.939469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa669658-1f6b74e0-90b42091-17b006b9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:25.945697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa669658-1f6b74e0-90b42091-17b006b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:25.945811Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:25.945827Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1195
2025-09-30T14:53:25.945954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1195 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:25.945985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1195 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:25.945990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1195 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:25.945995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:25.946423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1195 sessionId:  describe result for acl check
2025-09-30T14:53:25.946457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:25.946466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:25.946468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:25.946473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895469176065548:3517] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:25.947011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895469176065548:3517] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:25.949964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895469176065548:3517] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:25.955306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895469176065548:3517] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:25.955327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895469176065548:3517] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:25.955330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895469176065548:3517] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:25.955339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1195 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:25.961984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:25.964862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:25.965037Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:25.965046Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:25.965053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:25.965094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:25.965124Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895469086316768:7545]
2025-09-30T14:53:25.965764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:25.966055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:25.966107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:25.966358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:25.966405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:25.966410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:25.966411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:25.966412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:25.966413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:25.966413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:25.966414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:25.966415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:25.966416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:25.966416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:25.966417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.966418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.966418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.966419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:25.966420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:25.966423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:25.966430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:25.966432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:25.966435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:25.966437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:25.966439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:25.966442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:25.966444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:25.966446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:25.966449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:25.966451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.966453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.966456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.966460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:25.966464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:25.966471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:25.966478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:25.966486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:25.966492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:25.966496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:25.966502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:25.966517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:25.966521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:25.966525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:25.966527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:25.966530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:25.966533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:25.966536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:25.966539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:25.966541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:25.966545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:25.966547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:25.966550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:25.966553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:25.966555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:25.966558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.966561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.966563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.966566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.966569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.966571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.966576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:25.966578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:25.966582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:25.966587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:25.966628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:25.972434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:25.973292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:25.973309Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:25.973312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:25.973316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:25.973323Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1194 [2:7555895469086316768:7545]
2025-09-30T14:53:25.973339Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:25.973356Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:25.973363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:25.973366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:25.973369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:25.973386Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:25.973398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:25.973405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:25.973468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.973474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.973477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.973481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:25.973484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:25.973724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1194
2025-09-30T14:53:25.973739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1194
2025-09-30T14:53:25.973974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:25.973985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.974000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:25.974014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:25.974037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:25.974063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895469176065533:2454], now have 1 active actors on pipe
2025-09-30T14:53:25.974081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895469176065676:3517], now have 1 active actors on pipe
2025-09-30T14:53:25.974098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:25.974108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:25.974127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895469086316763:7545]
2025-09-30T14:53:25.974129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895469086316763:7545]
2025-09-30T14:53:25.974131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895469086316763:7545]
2025-09-30T14:53:25.974144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:25.974158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:25.974161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:25.974165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:25.974167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:25.974181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:25.974184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:25.974200Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac3d08f2-2b2cbfee-2adaf1c1-d2745c81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:25.974213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:25.974221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:25.974224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:25.974233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:25.974243Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:25.974283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895469086316763:7545]
2025-09-30T14:53:25.974298Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:25.974312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:25.974321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:25.974472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:25.974482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:25.974496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:25.974631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1195 partition: 0 MaxSeqNo: 42 sessionId: src_id|ac3d08f2-2b2cbfee-2adaf1c1-d2745c81_0
2025-09-30T14:53:25.975048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa669658-1f6b74e0-90b42091-17b006b9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ac3d08f2-2b2cbfee-2adaf1c1-d2745c81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:25.978022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac3d08f2-2b2cbfee-2adaf1c1-d2745c81_0] Write session: try to update token
2025-09-30T14:53:25.978040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac3d08f2-2b2cbfee-2adaf1c1-d2745c81_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:25.987674Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:25.987700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:25.987703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:25.987706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:25.987718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895469086316763:7545]
2025-09-30T14:53:25.987724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895469086316763:7545]
2025-09-30T14:53:25.987731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895469086316763:7545]
2025-09-30T14:53:25.987782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:25.987781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:25.987788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:25.987792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:25.987800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:25.987803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:25.988018Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:25.993241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1195 sessionId: src_id|ac3d08f2-2b2cbfee-2adaf1c1-d2745c81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:25.996059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:26.039233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895473471033121:4239]
2025-09-30T14:53:26.039593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1194, pipe: [1:7555895473471033121:4239]
2025-09-30T14:53:26.103188Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:26.103519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:26.103539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:26.103581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895473471033121:4239], now have 1 active actors on pipe
2025-09-30T14:53:26.103807Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:26.103804Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:26.103855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895473471033121:4239]
2025-09-30T14:53:26.103862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:26.103865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:26.103937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1195 reason: error at write: Disconnected sessionId: src_id|ac3d08f2-2b2cbfee-2adaf1c1-d2745c81_0
2025-09-30T14:53:26.104143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1195 sessionId: src_id|ac3d08f2-2b2cbfee-2adaf1c1-d2745c81_0 is DEAD
2025-09-30T14:53:26.104316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac3d08f2-2b2cbfee-2adaf1c1-d2745c81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:26.104337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac3d08f2-2b2cbfee-2adaf1c1-d2745c81_0] Write session will restart in 0.006772s
2025-09-30T14:53:26.104358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac3d08f2-2b2cbfee-2adaf1c1-d2745c81_0] Write session: Do CDS request
2025-09-30T14:53:26.104364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac3d08f2-2b2cbfee-2adaf1c1-d2745c81_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:26.112807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac3d08f2-2b2cbfee-2adaf1c1-d2745c81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:26.112928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:26.112946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1196
2025-09-30T14:53:26.113124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1196 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:26.113160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1196 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:26.113165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1196 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:26.113169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:26.113783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1196 sessionId:  describe result for acl check
2025-09-30T14:53:26.113820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:26.113827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:26.113829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:26.113836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895473471033165:3513] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:26.114402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895473471033165:3513] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:26.117477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895473471033165:3513] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:26.122957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895473471033165:3513] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:26.122977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895473471033165:3513] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:26.122981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895473471033165:3513] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:26.122990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1196 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:26.124890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:26.127899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:26.128122Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:26.128133Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:26.128144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:26.128198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:26.128237Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895473381284341:7547]
2025-09-30T14:53:26.128927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:26.129263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:26.129322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:26.129678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:26.129738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:26.129745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:26.129747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:26.129748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:26.129749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:26.129750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:26.129751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:26.129753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:26.129754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:26.129755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:26.129756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.129758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:26.129759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:26.129760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:26.129762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:26.129767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:26.129779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:26.129783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:26.129788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:26.129793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:26.129797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:26.129802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:26.129806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:26.129811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:26.129816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:26.129820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.129825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:26.129830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:26.129834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:26.129839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:26.129846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:26.129855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:26.129862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:26.129868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:26.129873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:26.129886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:26.129891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:26.129896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:26.129907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:26.129913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:26.129923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:26.129929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:26.129939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:26.129944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:26.129954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:26.129960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:26.129966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:26.129972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:26.129977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:26.129983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:26.129990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.129996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.130006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:26.130012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:26.130022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:26.130027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:26.130032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:26.130037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:26.130042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:26.130048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:26.130114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:26.135589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:26.136571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:26.136588Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:26.136591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:26.136595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:26.136603Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1195 [2:7555895473381284341:7547]
2025-09-30T14:53:26.136620Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:26.136636Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:26.136646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:26.136649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:26.136651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:26.136666Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:26.136678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:26.136686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:26.136756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.136763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:26.136765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:26.136769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:26.136772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:26.136839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:26.136848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.136861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:26.136876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:26.136897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:26.136918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895473381284336:7547]
2025-09-30T14:53:26.136926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895473381284336:7547]
2025-09-30T14:53:26.136929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895473381284336:7547]
2025-09-30T14:53:26.136943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:26.136956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:26.136977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:26.136986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:26.137019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895473381284336:7547]
2025-09-30T14:53:26.137027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:26.137028Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:26.137031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:26.137034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:26.137041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:26.137105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895473471033125:2454], now have 1 active actors on pipe
2025-09-30T14:53:26.137109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895473471033397:3513], now have 1 active actors on pipe
2025-09-30T14:53:26.137224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1195
2025-09-30T14:53:26.137228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1195
2025-09-30T14:53:26.137315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:26.137327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:26.137350Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a06e6acd-4e6a53c8-54d2d186-4a6d5256_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:26.137362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:26.137366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:26.137369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:26.137379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:26.137388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:26.137400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:26.138097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:26.138114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:26.138138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:26.138244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1196 partition: 0 MaxSeqNo: 42 sessionId: src_id|a06e6acd-4e6a53c8-54d2d186-4a6d5256_0
2025-09-30T14:53:26.138641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac3d08f2-2b2cbfee-2adaf1c1-d2745c81_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a06e6acd-4e6a53c8-54d2d186-4a6d5256_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:26.141538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a06e6acd-4e6a53c8-54d2d186-4a6d5256_0] Write session: try to update token
2025-09-30T14:53:26.141561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a06e6acd-4e6a53c8-54d2d186-4a6d5256_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:26.149837Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:26.149860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:26.149869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895473381284336:7547]
2025-09-30T14:53:26.149915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:26.149946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:26.150089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:26.150216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:26.150361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:26.150487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:26.150664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:26.150695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:26.160166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1196 sessionId: src_id|a06e6acd-4e6a53c8-54d2d186-4a6d5256_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:26.160429Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:26.160454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:26.160457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:26.160459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:26.160469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895473381284336:7547]
2025-09-30T14:53:26.160474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895473381284336:7547]
2025-09-30T14:53:26.160481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895473381284336:7547]
2025-09-30T14:53:26.160522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:26.160529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.160529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:26.160534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:26.160536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:26.160540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:26.160673Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:26.162801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:26.204117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895473471033424:4239]
2025-09-30T14:53:26.204418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1195, pipe: [1:7555895473471033424:4239]
2025-09-30T14:53:26.275606Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:26.276446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:26.276466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:26.276486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895473471033424:4239], now have 1 active actors on pipe
2025-09-30T14:53:26.276680Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:26.276739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:26.276748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895473471033424:4239]
2025-09-30T14:53:26.276774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:26.276864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1196 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a06e6acd-4e6a53c8-54d2d186-4a6d5256_0
2025-09-30T14:53:26.277066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1196 sessionId: src_id|a06e6acd-4e6a53c8-54d2d186-4a6d5256_0 is DEAD
2025-09-30T14:53:26.277205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a06e6acd-4e6a53c8-54d2d186-4a6d5256_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:26.277213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a06e6acd-4e6a53c8-54d2d186-4a6d5256_0] Write session will restart in 0.008313s
2025-09-30T14:53:26.277236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a06e6acd-4e6a53c8-54d2d186-4a6d5256_0] Write session: Do CDS request
2025-09-30T14:53:26.277241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a06e6acd-4e6a53c8-54d2d186-4a6d5256_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:26.286847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a06e6acd-4e6a53c8-54d2d186-4a6d5256_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:26.286962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:26.286979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1197
2025-09-30T14:53:26.287111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1197 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:26.287144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1197 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:26.287154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1197 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:26.287158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:26.288201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1197 sessionId:  describe result for acl check
2025-09-30T14:53:26.288238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:26.288239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:26.288241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:26.288247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895473471033469:3507] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:26.288790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895473471033469:3507] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:26.291793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895473471033469:3507] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:26.296091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895473471033469:3507] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:26.296112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895473471033469:3507] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:26.296115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895473471033469:3507] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:26.296124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1197 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:26.299462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:26.302875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:26.303257Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:26.303271Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:26.303286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:26.303359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:26.303401Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895473381284637:7551]
2025-09-30T14:53:26.304054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:26.304413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:26.304476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:26.304854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:26.304947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:26.304954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:26.304955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:26.304957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:26.304958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:26.304959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:26.304960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:26.304962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:26.304963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:26.304964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:26.304966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.304967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:26.304969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:26.304970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:26.304971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:26.304978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:26.304989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:26.304992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:26.304996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:26.305000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:26.305003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:26.305007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:26.305010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:26.305013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:26.305018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:26.305022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.305025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:26.305028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:26.305032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:26.305036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:26.305045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:26.305054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:26.305060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:26.305065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:26.305073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:26.305078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:26.305082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:26.305087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:26.305093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:26.305098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:26.305104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:26.305109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:26.305115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:26.305120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:26.305125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:26.305130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:26.305135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:26.305140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:26.305145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:26.305151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:26.305156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.305161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.305172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:26.305178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:26.305183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:26.305188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:26.305197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:26.305203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:26.305207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:26.305212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:26.305259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:26.311397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:26.312336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:26.312352Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:26.312355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:26.312359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:26.312365Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1196 [2:7555895473381284637:7551]
2025-09-30T14:53:26.312382Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:26.312399Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:26.312407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:26.312410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:26.312412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:26.312428Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:26.312435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:26.312442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:26.312500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.312508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:26.312511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:26.312514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:26.312517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:26.312579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:26.312589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.312601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:26.312614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:26.312633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:26.312651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895473471033658:3507], now have 1 active actors on pipe
2025-09-30T14:53:26.312655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895473471033425:2454], now have 1 active actors on pipe
2025-09-30T14:53:26.312662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895473381284628:7551]
2025-09-30T14:53:26.312665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895473381284628:7551]
2025-09-30T14:53:26.312667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895473381284628:7551]
2025-09-30T14:53:26.312679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:26.312692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:26.312710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:26.312714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:26.312730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:26.312733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:26.312735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:26.312747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895473381284628:7551]
2025-09-30T14:53:26.312750Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:26.312752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:26.312890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1196
2025-09-30T14:53:26.312921Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1196
2025-09-30T14:53:26.312952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:26.312963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:26.312985Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90d56e1b-4989dccf-41f1dd1c-9b2110e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:26.312992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:26.312996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:26.312998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:26.313007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:26.313017Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:26.313030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:26.313246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:26.313259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:26.313285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:26.313428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1197 partition: 0 MaxSeqNo: 42 sessionId: src_id|90d56e1b-4989dccf-41f1dd1c-9b2110e8_0
2025-09-30T14:53:26.313866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a06e6acd-4e6a53c8-54d2d186-4a6d5256_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|90d56e1b-4989dccf-41f1dd1c-9b2110e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:26.316729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90d56e1b-4989dccf-41f1dd1c-9b2110e8_0] Write session: try to update token
2025-09-30T14:53:26.316747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90d56e1b-4989dccf-41f1dd1c-9b2110e8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:26.329504Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:26.329529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:26.329538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895473381284628:7551]
2025-09-30T14:53:26.329582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:26.329596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:26.329769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:26.329921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:26.330084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:26.330232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:26.330428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:26.330475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:26.332081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1197 sessionId: src_id|90d56e1b-4989dccf-41f1dd1c-9b2110e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:26.334963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:26.335183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:26.335205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:26.335238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:26.335323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:26.340308Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:26.340327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:26.340329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:26.340331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:26.340340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895473381284628:7551]
2025-09-30T14:53:26.340343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895473381284628:7551]
2025-09-30T14:53:26.340347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895473381284628:7551]
2025-09-30T14:53:26.340391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:26.340406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.340408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:26.340408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:26.340415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:26.340420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:26.340537Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:26.376666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895473471033735:4239]
2025-09-30T14:53:26.376931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1196, pipe: [1:7555895473471033735:4239]
2025-09-30T14:53:26.449931Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:26.458530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:26.458557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:26.458723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:26.458783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:26.458845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:26.458902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:26.458946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:26.458953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:26.459026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:26.459095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:26.459155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:26.459235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:26.459299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:26.459305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:26.459371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:26.459425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:26.459484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:26.459543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:26.459587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:26.459596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:26.459656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:26.459717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:26.459778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:26.459836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:26.459895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:26.459901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:26.459962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:26.460033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:26.460110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:26.460187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:26.460237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:26.460245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:26.460319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:26.460390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:26.460459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:26.460518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:26.460566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:26.460576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:26.460643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:26.460697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:26.460784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:26.460869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:26.460929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:26.460939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:26.461007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:26.461071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:26.461143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:26.461214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:26.461264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:26.461271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:26.461341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:26.461405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:26.461468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:26.461533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:26.461582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:26.461590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:26.461656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:26.461724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:26.461790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:26.461853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:26.461901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:26.461909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:26.461971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895473471033735:4239], now have 1 active actors on pipe
2025-09-30T14:53:26.462220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895473471033735:4239]
2025-09-30T14:53:26.462225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:26.462261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:26.462264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:26.462290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1197 reason: error at write: Disconnected sessionId: src_id|90d56e1b-4989dccf-41f1dd1c-9b2110e8_0
2025-09-30T14:53:26.462498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1197 sessionId: src_id|90d56e1b-4989dccf-41f1dd1c-9b2110e8_0 is DEAD
2025-09-30T14:53:26.462676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90d56e1b-4989dccf-41f1dd1c-9b2110e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:26.462691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90d56e1b-4989dccf-41f1dd1c-9b2110e8_0] Write session will restart in 0.007361s
2025-09-30T14:53:26.462710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90d56e1b-4989dccf-41f1dd1c-9b2110e8_0] Write session: Do CDS request
2025-09-30T14:53:26.462715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90d56e1b-4989dccf-41f1dd1c-9b2110e8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:26.463099Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:26.470855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90d56e1b-4989dccf-41f1dd1c-9b2110e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:26.470981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:26.471012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1198
2025-09-30T14:53:26.471169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1198 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:26.471203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1198 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:26.471209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1198 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:26.471213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:26.474164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1198 sessionId:  describe result for acl check
2025-09-30T14:53:26.474200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:26.474202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:26.474204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:26.474222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895473471033799:3494] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:26.474690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895473471033799:3494] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:26.477807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895473471033799:3494] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:26.481787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895473471033799:3494] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:26.481804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895473471033799:3494] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:26.481808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895473471033799:3494] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:26.481818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1198 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:26.483947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:26.486773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:26.486996Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:26.487006Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:26.487017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:26.487073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:26.487114Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895473381284947:7565]
2025-09-30T14:53:26.487855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:26.488154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:26.488195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:26.488531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:26.488594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:26.488600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:26.488601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:26.488602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:26.488603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:26.488605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:26.488606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:26.488607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:26.488608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:26.488609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:26.488611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.488612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:26.488614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:26.488615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:26.488617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:26.488623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:26.488634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:26.488640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:26.488645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:26.488650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:26.488655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:26.488660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:26.488665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:26.488669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:26.488675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:26.488680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.488684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:26.488689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:26.488694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:26.488699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:26.488706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:26.488715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:26.488726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:26.488733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:26.488744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:26.488750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:26.488759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:26.488765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:26.488776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:26.488783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:26.488792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:26.488799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:26.488804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:26.488810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:26.488816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:26.488823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:26.488833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:26.488840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:26.488849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:26.488855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:26.488861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.488872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.488878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:26.488884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:26.488894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:26.488901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:26.488910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:26.488916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:26.488926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:26.488932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:26.488990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:26.494548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:26.495977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:26.495996Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:26.495998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:26.496002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:26.496008Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1197 [2:7555895473381284947:7565]
2025-09-30T14:53:26.496026Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:26.496040Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:26.496043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:26.496046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:26.496049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:26.496064Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:26.496076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:26.496083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:26.496143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.496151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:26.496153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:26.496157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:26.496159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:26.496222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:26.496231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.496244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:26.496258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:26.496278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:26.496301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895473471034011:3494], now have 1 active actors on pipe
2025-09-30T14:53:26.496309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895473471033738:2454], now have 1 active actors on pipe
2025-09-30T14:53:26.496315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895473381284942:7565]
2025-09-30T14:53:26.496318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895473381284942:7565]
2025-09-30T14:53:26.496321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895473381284942:7565]
2025-09-30T14:53:26.496335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:26.496406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1197
2025-09-30T14:53:26.496421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1197
2025-09-30T14:53:26.496348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:26.496353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:26.496360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:26.496363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:26.496370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:26.496374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:26.496405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895473381284942:7565]
2025-09-30T14:53:26.496412Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:26.496431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:26.496594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:26.496608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:26.496639Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|802f2b62-a9af71d6-fdc308e-8a6877be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:26.496651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:26.496661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:26.496663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:26.496674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:26.496684Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:26.496704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:26.496849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:26.496857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:26.496870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:26.496992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1198 partition: 0 MaxSeqNo: 42 sessionId: src_id|802f2b62-a9af71d6-fdc308e-8a6877be_0
2025-09-30T14:53:26.497395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90d56e1b-4989dccf-41f1dd1c-9b2110e8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|802f2b62-a9af71d6-fdc308e-8a6877be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:26.500129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|802f2b62-a9af71d6-fdc308e-8a6877be_0] Write session: try to update token
2025-09-30T14:53:26.500148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|802f2b62-a9af71d6-fdc308e-8a6877be_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:26.509244Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:26.509259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:26.509262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:26.509264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:26.509274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895473381284942:7565]
2025-09-30T14:53:26.509278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895473381284942:7565]
2025-09-30T14:53:26.509283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895473381284942:7565]
2025-09-30T14:53:26.509322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:26.509329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.509332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:26.509339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:26.509346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:26.509351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:26.509461Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:26.515643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1198 sessionId: src_id|802f2b62-a9af71d6-fdc308e-8a6877be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:26.518430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:26.562500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895473471034032:4239]
2025-09-30T14:53:26.562768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1197, pipe: [1:7555895473471034032:4239]
2025-09-30T14:53:26.625689Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:26.626010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:26.626026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:26.626062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895473471034032:4239], now have 1 active actors on pipe
2025-09-30T14:53:26.626297Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:26.626351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:26.626369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:26.626370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:26.626416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895473471034032:4239]
2025-09-30T14:53:26.626432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1198 reason: error at write: Disconnected sessionId: src_id|802f2b62-a9af71d6-fdc308e-8a6877be_0
2025-09-30T14:53:26.626630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1198 sessionId: src_id|802f2b62-a9af71d6-fdc308e-8a6877be_0 is DEAD
2025-09-30T14:53:26.626760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|802f2b62-a9af71d6-fdc308e-8a6877be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:26.626769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|802f2b62-a9af71d6-fdc308e-8a6877be_0] Write session will restart in 0.006674s
2025-09-30T14:53:26.626802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|802f2b62-a9af71d6-fdc308e-8a6877be_0] Write session: Do CDS request
2025-09-30T14:53:26.626808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|802f2b62-a9af71d6-fdc308e-8a6877be_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:26.634726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|802f2b62-a9af71d6-fdc308e-8a6877be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:26.634823Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:26.634839Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1199
2025-09-30T14:53:26.634963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1199 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:26.634994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1199 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:26.635003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1199 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:26.635008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:26.635613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1199 sessionId:  describe result for acl check
2025-09-30T14:53:26.635651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:26.635654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:26.635656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:26.635662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895473471034058:3483] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:26.636210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895473471034058:3483] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:26.639521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895473471034058:3483] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:26.643013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895473471034058:3483] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:26.643029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895473471034058:3483] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:26.643034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895473471034058:3483] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:26.643042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1199 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:26.647930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:26.650972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:26.651183Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:26.651194Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:26.651204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:26.651277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:26.651317Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895473381285231:7568]
2025-09-30T14:53:26.651981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:26.652304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:26.652364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:26.652661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:26.652713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:26.652718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:26.652719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:26.652720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:26.652721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:26.652721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:26.652722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:26.652723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:26.652724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:26.652724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:26.652725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.652726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:26.652727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:26.652728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:26.652728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:26.652732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:26.652739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:26.652741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:26.652744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:26.652746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:26.652748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:26.652751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:26.652753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:26.652756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:26.652760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:26.652763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.652765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:26.652767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:26.652769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:26.652772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:26.652779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:26.652783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:26.652787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:26.652798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:26.652800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:26.652804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:26.652806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:26.652810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:26.652812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:26.652815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:26.652818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:26.652821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:26.652824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:26.652827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:26.652829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:26.652833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:26.652835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:26.652839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:26.652841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:26.652845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:26.652848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.652851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.652854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:26.652857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:26.652860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:26.652864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:26.652867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:26.652870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:26.652873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:26.652876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:26.652902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:26.658416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:26.659589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:26.659604Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:26.659606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:26.659610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:26.659617Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1198 [2:7555895473381285231:7568]
2025-09-30T14:53:26.659633Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:26.659650Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:26.659653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:26.659656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:26.659658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:26.659673Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:26.659684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:26.659692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:26.659758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.659765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:26.659767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:26.659771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:26.659774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:26.659836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:26.659844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.659857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:26.659874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:26.659893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:26.659913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895473471034034:2454], now have 1 active actors on pipe
2025-09-30T14:53:26.659917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895473471034224:3483], now have 1 active actors on pipe
2025-09-30T14:53:26.659923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895473381285226:7568]
2025-09-30T14:53:26.659926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895473381285226:7568]
2025-09-30T14:53:26.659928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895473381285226:7568]
2025-09-30T14:53:26.659941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:26.659960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:26.659972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:26.659979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:26.659983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:26.659984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:26.659987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:26.660011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895473381285226:7568]
2025-09-30T14:53:26.660022Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:26.660029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:26.660025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1198
2025-09-30T14:53:26.660028Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1198
2025-09-30T14:53:26.660117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:26.660127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:26.660151Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9341d46-7b7faf8c-28a03921-6a1e6153_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:26.660165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:26.660168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:26.660170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:26.660178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:26.660187Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:26.660201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:26.660369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:26.660377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:26.660389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:26.660490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1199 partition: 0 MaxSeqNo: 42 sessionId: src_id|a9341d46-7b7faf8c-28a03921-6a1e6153_0
2025-09-30T14:53:26.660869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|802f2b62-a9af71d6-fdc308e-8a6877be_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a9341d46-7b7faf8c-28a03921-6a1e6153_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:26.663592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9341d46-7b7faf8c-28a03921-6a1e6153_0] Write session: try to update token
2025-09-30T14:53:26.663610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9341d46-7b7faf8c-28a03921-6a1e6153_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:26.672215Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:26.672239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:26.672248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895473381285226:7568]
2025-09-30T14:53:26.672291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:26.672299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:26.672470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:26.672620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:26.672762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:26.672905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:26.673102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:26.673144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:26.677650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1199 sessionId: src_id|a9341d46-7b7faf8c-28a03921-6a1e6153_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:26.680372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:26.680569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:26.680591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:26.680624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:26.680746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:26.682952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:26.682973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:26.682975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:26.682977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:26.682988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895473381285226:7568]
2025-09-30T14:53:26.682992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895473381285226:7568]
2025-09-30T14:53:26.682997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895473381285226:7568]
2025-09-30T14:53:26.683034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:26.683039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:26.683042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.683044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:26.683045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:26.683050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:26.683179Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:26.726861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895473471034323:4239]
2025-09-30T14:53:26.727187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1198, pipe: [1:7555895473471034323:4239]
2025-09-30T14:53:26.801814Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:26.810865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:26.810902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:26.811086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:26.811153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:26.811224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:26.811354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:26.811405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:26.811415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:26.811487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:26.811557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:26.811622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:26.811695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:26.811748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:26.811757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:26.811824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:26.811888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:26.811959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:26.814812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895473471034323:4239]
2025-09-30T14:53:26.814859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:26.812027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:26.812190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:26.812193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:26.812264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:26.812330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:26.812394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:26.812480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:26.812523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:26.812526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:26.812600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:26.812661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:26.812723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:26.812792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:26.812836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:26.812839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:26.812910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:26.812972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:26.813037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:26.813108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:26.813149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:26.813152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:26.813224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:26.813285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:26.813352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:26.813419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:26.813460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:26.813463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:26.813532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:26.813591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:26.813655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:26.813723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:26.813768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:26.813771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:26.813845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:26.813909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:26.813974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:26.814038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:26.814095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:26.814098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:26.814173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:26.814237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:26.814299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:26.814362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:26.814401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:26.814404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:26.814480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895473471034323:4239], now have 1 active actors on pipe
2025-09-30T14:53:26.815287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:26.815301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:26.815327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1199 reason: error at write: Disconnected sessionId: src_id|a9341d46-7b7faf8c-28a03921-6a1e6153_0
2025-09-30T14:53:26.815507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1199 sessionId: src_id|a9341d46-7b7faf8c-28a03921-6a1e6153_0 is DEAD
2025-09-30T14:53:26.815912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9341d46-7b7faf8c-28a03921-6a1e6153_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:26.815924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9341d46-7b7faf8c-28a03921-6a1e6153_0] Write session will restart in 0.007736s
2025-09-30T14:53:26.815949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9341d46-7b7faf8c-28a03921-6a1e6153_0] Write session: Do CDS request
2025-09-30T14:53:26.815955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9341d46-7b7faf8c-28a03921-6a1e6153_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:26.815922Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:26.824727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9341d46-7b7faf8c-28a03921-6a1e6153_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:26.824812Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:26.824827Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1200
2025-09-30T14:53:26.824944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1200 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:26.824981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1200 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:26.824991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1200 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:26.824996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:26.825479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1200 sessionId:  describe result for acl check
2025-09-30T14:53:26.825522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:26.825529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:26.825530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:26.825535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895473471034338:3476] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:26.826098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895473471034338:3476] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:26.828524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895473471034338:3476] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:26.831517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895473471034338:3476] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:26.831534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895473471034338:3476] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:26.831538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895473471034338:3476] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:26.831554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1200 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:26.842891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:26.845732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:26.846084Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:26.846100Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:26.846115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:26.846193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:26.846256Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895473381285513:7570]
2025-09-30T14:53:26.846924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:26.847270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:26.847317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:26.847644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:26.847742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:26.847751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:26.847752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:26.847753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:26.847754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:26.847755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:26.847756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:26.847757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:26.847758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:26.847759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:26.847761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.847762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:26.847762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:26.847764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:26.847765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:26.847771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:26.847781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:26.847785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:26.847788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:26.847792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:26.847797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:26.847801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:26.847806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:26.847811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:26.847816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:26.847821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.847826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:26.847831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:26.847835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:26.847839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:26.847848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:26.847856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:26.847861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:26.847868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:26.847876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:26.847883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:26.847888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:26.847893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:26.847898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:26.847904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:26.847908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:26.847914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:26.847918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:26.847924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:26.847929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:26.847933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:26.847938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:26.847943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:26.847949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:26.847954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:26.847958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.847963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.847967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:26.847972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:26.847976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:26.847981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:26.847984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:26.847989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:26.847993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:26.847997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:26.848037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:26.853566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:26.854755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:26.854770Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:26.854773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:26.854777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:26.854783Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1199 [2:7555895473381285513:7570]
2025-09-30T14:53:26.854798Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:26.854813Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:26.854817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:26.854820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:26.854822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:26.854837Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:26.854849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:26.854856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:26.854916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.854925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:26.854927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:26.854931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:26.854933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:26.854992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:26.854999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.855012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:26.855026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:26.855050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:26.855073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895473471034325:2454], now have 1 active actors on pipe
2025-09-30T14:53:26.855082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895473471034385:3476], now have 1 active actors on pipe
2025-09-30T14:53:26.855088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895473381285508:7570]
2025-09-30T14:53:26.855090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895473381285508:7570]
2025-09-30T14:53:26.855092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895473381285508:7570]
2025-09-30T14:53:26.855104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:26.855121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:26.855122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:26.855131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:26.855133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:26.855139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:26.855142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:26.855169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895473381285508:7570]
2025-09-30T14:53:26.855184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:26.855193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:26.855176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1199
2025-09-30T14:53:26.855227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:26.855238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:26.855281Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|472eb34e-ceb31b37-8a1ee4e4-b3ef8c77_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:26.855288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:26.855268Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1199
2025-09-30T14:53:26.855291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:26.855293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:26.855303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:26.855312Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:26.855328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:26.855473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:26.855484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:26.855500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:26.855626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1200 partition: 0 MaxSeqNo: 42 sessionId: src_id|472eb34e-ceb31b37-8a1ee4e4-b3ef8c77_0
2025-09-30T14:53:26.855998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9341d46-7b7faf8c-28a03921-6a1e6153_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|472eb34e-ceb31b37-8a1ee4e4-b3ef8c77_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:26.858835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|472eb34e-ceb31b37-8a1ee4e4-b3ef8c77_0] Write session: try to update token
2025-09-30T14:53:26.858853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|472eb34e-ceb31b37-8a1ee4e4-b3ef8c77_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:26.868593Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:26.868612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:26.868621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895473381285508:7570]
2025-09-30T14:53:26.868666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:26.868676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:26.868864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:26.869023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:26.869171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:26.869319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:26.869515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:26.869558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:26.873378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1200 sessionId: src_id|472eb34e-ceb31b37-8a1ee4e4-b3ef8c77_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:26.876120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:26.876345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:26.876369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:26.876418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:26.876510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:26.879830Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:26.879851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:26.879854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:26.879856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:26.879866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895473381285508:7570]
2025-09-30T14:53:26.879870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895473381285508:7570]
2025-09-30T14:53:26.879874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895473381285508:7570]
2025-09-30T14:53:26.879915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:26.879918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:26.879921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:26.879924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:26.879925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:26.879929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:26.880054Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:26.914740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895473471034615:4239]
2025-09-30T14:53:26.915098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1199, pipe: [1:7555895473471034615:4239]
2025-09-30T14:53:27.000330Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:27.008619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:27.008652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:27.008819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:27.008900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:27.008975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:27.009039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:27.009086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:27.009096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:27.009166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:27.009234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:27.009304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:27.009375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:27.009427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:27.009431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:27.009500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:27.009563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:27.009626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:27.009698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:27.009747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:27.009756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:27.009824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:27.010257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:27.010327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:27.010391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:27.010436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:27.010443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:27.010519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:27.010587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:27.010650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:27.010713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:27.010756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:27.010764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:27.010833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:27.010906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:27.010973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:27.011039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:27.011085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:27.011095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:27.011163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:27.011228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:27.011312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:27.011380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:27.011427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:27.011436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:27.011504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:27.011563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:27.011625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:27.011691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:27.011740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:27.011747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:27.011816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:27.011877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:27.011941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:27.012004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:27.012048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:27.012057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:27.012125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:27.012186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:27.012281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:27.012350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:27.012395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:27.012405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:27.012462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895473471034615:4239], now have 1 active actors on pipe
2025-09-30T14:53:27.012718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895473471034615:4239]
2025-09-30T14:53:27.012756Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:27.012795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:27.012807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:27.012835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1200 reason: error at write: Disconnected sessionId: src_id|472eb34e-ceb31b37-8a1ee4e4-b3ef8c77_0
2025-09-30T14:53:27.013043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1200 sessionId: src_id|472eb34e-ceb31b37-8a1ee4e4-b3ef8c77_0 is DEAD
2025-09-30T14:53:27.013162Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:27.013211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|472eb34e-ceb31b37-8a1ee4e4-b3ef8c77_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:27.013223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|472eb34e-ceb31b37-8a1ee4e4-b3ef8c77_0] Write session will restart in 0.008941s
2025-09-30T14:53:27.013245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|472eb34e-ceb31b37-8a1ee4e4-b3ef8c77_0] Write session: Do CDS request
2025-09-30T14:53:27.013250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|472eb34e-ceb31b37-8a1ee4e4-b3ef8c77_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:27.023812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|472eb34e-ceb31b37-8a1ee4e4-b3ef8c77_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:27.023870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:27.023886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1201
2025-09-30T14:53:27.024039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1201 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:27.024073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1201 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:27.024082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1201 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:27.024086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:27.024851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1201 sessionId:  describe result for acl check
2025-09-30T14:53:27.024888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:27.024895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:27.024897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:27.024904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895477766001986:3465] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:27.025431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895477766001986:3465] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:27.029073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895477766001986:3465] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:27.032098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895477766001986:3465] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:27.032113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895477766001986:3465] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:27.032117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895477766001986:3465] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:27.032124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1201 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:27.034583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:27.037408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:27.037616Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:27.037628Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:27.037639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:27.037698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:27.037737Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895477676253092:7572]
2025-09-30T14:53:27.038439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:27.038798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:27.038867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:27.039240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:27.039331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:27.039337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:27.039338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:27.039340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:27.039341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:27.039343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:27.039344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:27.039345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:27.039347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:27.039348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:27.039349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.039351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.039352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.039353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:27.039354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:27.039360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:27.039382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:27.039387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:27.039391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:27.039396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:27.039400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:27.039405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:27.039409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:27.039413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:27.039417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:27.039421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.039425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.039429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.039433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:27.039437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:27.039446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:27.039459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:27.039469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:27.039474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:27.039479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:27.039484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:27.039489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:27.039498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:27.039503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:27.039514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:27.039518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:27.039523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:27.039532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:27.039538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:27.039546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:27.039552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:27.039556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:27.039566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:27.039571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:27.039577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:27.039587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.039591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.039599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.039604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.039609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.039619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.039623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:27.039633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:27.039638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:27.039643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:27.039691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:27.045366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:27.046446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:27.046467Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:27.046469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:27.046474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:27.046482Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1200 [2:7555895477676253092:7572]
2025-09-30T14:53:27.046500Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:27.046515Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:27.046519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:27.046522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:27.046523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:27.046540Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:27.046548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:27.046555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:27.046617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.046625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.046628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.046631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:27.046633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:27.046710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:27.046718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.046733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.046749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.046770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:27.046789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895477766002183:3465], now have 1 active actors on pipe
2025-09-30T14:53:27.046793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895477766001916:2454], now have 1 active actors on pipe
2025-09-30T14:53:27.046800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895477676253087:7572]
2025-09-30T14:53:27.046804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895477676253087:7572]
2025-09-30T14:53:27.046807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895477676253087:7572]
2025-09-30T14:53:27.046819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:27.046837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:27.046839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:27.046841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:27.046844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:27.046854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:27.046857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:27.046892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895477676253087:7572]
2025-09-30T14:53:27.046923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1200
2025-09-30T14:53:27.046945Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1200
2025-09-30T14:53:27.046920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:27.046995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:27.047045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:27.047056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:27.047082Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe9bb9ed-30c826d0-b78e9a5c-cd1f2095_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:27.047096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:27.047099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:27.047102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:27.047112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:27.047122Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:27.047141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:27.047329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:27.047342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:27.047363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:27.047472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1201 partition: 0 MaxSeqNo: 42 sessionId: src_id|fe9bb9ed-30c826d0-b78e9a5c-cd1f2095_0
2025-09-30T14:53:27.047860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|472eb34e-ceb31b37-8a1ee4e4-b3ef8c77_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fe9bb9ed-30c826d0-b78e9a5c-cd1f2095_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:27.050671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe9bb9ed-30c826d0-b78e9a5c-cd1f2095_0] Write session: try to update token
2025-09-30T14:53:27.050692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe9bb9ed-30c826d0-b78e9a5c-cd1f2095_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:27.059649Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:27.059673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:27.059675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:27.059677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:27.059687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895477676253087:7572]
2025-09-30T14:53:27.059692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895477676253087:7572]
2025-09-30T14:53:27.059697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895477676253087:7572]
2025-09-30T14:53:27.059737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:27.059744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.059746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:27.059749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:27.059757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:27.059761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:27.059888Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:27.065439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1201 sessionId: src_id|fe9bb9ed-30c826d0-b78e9a5c-cd1f2095_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:27.068145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:27.112882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895477766002215:4239]
2025-09-30T14:53:27.113178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1200, pipe: [1:7555895477766002215:4239]
2025-09-30T14:53:27.177280Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:27.177903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:27.177917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:27.177948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895477766002215:4239], now have 1 active actors on pipe
2025-09-30T14:53:27.178135Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:27.178225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:27.178247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:27.178287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895477766002215:4239]
2025-09-30T14:53:27.178301Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:53:27.178326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1201 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fe9bb9ed-30c826d0-b78e9a5c-cd1f2095_0
2025-09-30T14:53:27.178402Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 12 consumer shared/user session shared/user_1_12_6661911660038712371_v1 is DEAD
2025-09-30T14:53:27.178418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1201 sessionId: src_id|fe9bb9ed-30c826d0-b78e9a5c-cd1f2095_0 is DEAD
2025-09-30T14:53:27.178508Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895404751533176:4246] disconnected; active server actors: 1
2025-09-30T14:53:27.178517Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895404751533176:4246] client user disconnected session shared/user_1_12_6661911660038712371_v1
2025-09-30T14:53:27.178724Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:53:27.178723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe9bb9ed-30c826d0-b78e9a5c-cd1f2095_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:27.178757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe9bb9ed-30c826d0-b78e9a5c-cd1f2095_0] Write session will restart in 0.009941s
2025-09-30T14:53:27.178783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe9bb9ed-30c826d0-b78e9a5c-cd1f2095_0] Write session: Do CDS request
2025-09-30T14:53:27.178789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe9bb9ed-30c826d0-b78e9a5c-cd1f2095_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:27.178869Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:53:27.178874Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:53:27.178881Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.005841s
2025-09-30T14:53:27.185665Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:53:27.185890Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:53:27.185903Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 13
2025-09-30T14:53:27.186081Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 13 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:53:27.186135Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:53:27.186211Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 auth for : user
2025-09-30T14:53:27.186425Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 Handle describe topics response
2025-09-30T14:53:27.186459Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 auth is DEAD
2025-09-30T14:53:27.186470Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:53:27.186735Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:53:27.186832Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_13_7105340681634718141_v1
2025-09-30T14:53:27.186914Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895477766002245:3460] connected; active server actors: 1
2025-09-30T14:53:27.186935Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555895477766002245:3460] session shared/user_1_13_7105340681634718141_v1
2025-09-30T14:53:27.186944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:53:27.186956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:53:27.186962Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_13_7105340681634718141_v1" (Sender=[1:7555895477766002240:3460], Pipe=[1:7555895477766002245:3460], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:53:27.186970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:53:27.186982Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:53:27.186988Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_13_7105340681634718141_v1" (Sender=[1:7555895477766002240:3460], Pipe=[1:7555895477766002245:3460], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:53:27.186995Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_13_7105340681634718141_v1" sender [1:7555895477766002240:3460] lock partition 0 for ReadingSession "shared/user_1_13_7105340681634718141_v1" (Sender=[1:7555895477766002240:3460], Pipe=[1:7555895477766002245:3460], Partitions=[], ActiveFamilyCount=1) generation 1 step 13
2025-09-30T14:53:27.187006Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:53:27.187009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000025s
2025-09-30T14:53:27.187181Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 13 Session: "shared/user_1_13_7105340681634718141_v1" ClientId: "user" PipeClient { RawX1: 7555895477766002245 RawX2: 4503603922341252 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:53:27.187198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:53:27.189675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe9bb9ed-30c826d0-b78e9a5c-cd1f2095_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:27.189725Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:27.189739Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1202
2025-09-30T14:53:27.189918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1202 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:27.189948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1202 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:27.189953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1202 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:27.189956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:27.190320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1202 sessionId:  describe result for acl check
2025-09-30T14:53:27.190348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:27.190355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:27.190357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:27.190362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895477766002320:3458] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:27.190789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895477766002320:3458] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:27.192784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895477766002320:3458] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:27.196033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895477766002320:3458] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:27.196060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895477766002320:3458] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:27.196063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895477766002320:3458] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:27.196071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1202 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:27.197939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:27.200827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:27.201038Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:27.201050Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:27.201061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:27.201117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:27.201157Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895477676253390:7576]
2025-09-30T14:53:27.201754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:27.202082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:27.202129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:27.202379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:27.202432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:27.202440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:27.202441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:27.202442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:27.202443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:27.202445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:27.202446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:27.202448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:27.202449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:27.202450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:27.202451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.202452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.202454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.202454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:27.202455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:27.202459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:27.202466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:27.202468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:27.202471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:27.202473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:27.202476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:27.202479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:27.202481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:27.202483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:27.202486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:27.202488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.202490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.202493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.202495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:27.202497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:27.202503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:27.202508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:27.202513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:27.202516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:27.202519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:27.202522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:27.202525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:27.202529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:27.202532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:27.202534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:27.202537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:27.202540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:27.202543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:27.202546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:27.202549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:27.202552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:27.202555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:27.202558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:27.202560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:27.202563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:27.202568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.202570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.202573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.202576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.202578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.202581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.202583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:27.202586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:27.202589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:27.202592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:27.202625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:27.208111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:27.208954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:27.208971Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:27.208974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:27.208979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:27.208986Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1201 [2:7555895477676253390:7576]
2025-09-30T14:53:27.209003Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:27.209018Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:27.209026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:27.209029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:27.209032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:27.209047Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:27.209059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:27.209066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:27.209133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.209141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.209143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.209147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:27.209150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:27.209216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:27.209224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.209237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.209255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.209280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:27.209305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895477766002255:3461], now have 1 active actors on pipe
2025-09-30T14:53:27.209313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895477766002514:3458], now have 1 active actors on pipe
2025-09-30T14:53:27.209316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895477766002218:2454], now have 1 active actors on pipe
2025-09-30T14:53:27.209322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895477676253385:7576]
2025-09-30T14:53:27.209325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895477676253385:7576]
2025-09-30T14:53:27.209328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895477676253385:7576]
2025-09-30T14:53:27.209340Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:27.209358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:27.209366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:27.209370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:27.209372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:27.209373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:27.209377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:27.209408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895477676253385:7576]
2025-09-30T14:53:27.209416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:27.209419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:27.209390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1201
2025-09-30T14:53:27.209396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1201, pipe: [1:7555895477766002255:3461]
2025-09-30T14:53:27.209425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1201
2025-09-30T14:53:27.209443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:27.209452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:27.209468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:27.209475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:27.209481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_13_7105340681634718141_v1 on pipe: [1:7555895477766002255:3461]
2025-09-30T14:53:27.209513Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_13_7105340681634718141_v1:1 with generation 1201
2025-09-30T14:53:27.209525Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54e0a328-e0de483f-de1de4b6-7cbffb39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:27.209531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:27.209536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:27.209544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:27.209553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:27.209566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:27.209582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:27.209591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:27.209593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:27.209607Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_13_7105340681634718141_v1
2025-09-30T14:53:27.209614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:27.209647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:27.209661Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:53:27.209772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:27.209780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:27.209793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:27.209895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1202 partition: 0 MaxSeqNo: 42 sessionId: src_id|54e0a328-e0de483f-de1de4b6-7cbffb39_0
2025-09-30T14:53:27.210349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe9bb9ed-30c826d0-b78e9a5c-cd1f2095_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|54e0a328-e0de483f-de1de4b6-7cbffb39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:27.213069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54e0a328-e0de483f-de1de4b6-7cbffb39_0] Write session: try to update token
2025-09-30T14:53:27.213088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54e0a328-e0de483f-de1de4b6-7cbffb39_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:27.214158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:53:27.214215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:53:27.214226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:27.214231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:27.214234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:27.214244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:53:27.214257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:53:27.214411Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759244007209 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:53:27.214436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:53:27.214472Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 sending to client partition status
2025-09-30T14:53:27.222899Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:27.222926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:27.222929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:27.222932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:27.222941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895477676253385:7576]
2025-09-30T14:53:27.222947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895477676253385:7576]
2025-09-30T14:53:27.222952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895477676253385:7576]
2025-09-30T14:53:27.222992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:27.223000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.223003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:27.223010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:27.223017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:27.223022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:27.223154Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:27.227620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1202 sessionId: src_id|54e0a328-e0de483f-de1de4b6-7cbffb39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:27.230495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:27.337671Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:27.338434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:27.338450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:27.338651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_13_7105340681634718141_v1
2025-09-30T14:53:27.338674Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:27.338699Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_13_7105340681634718141_v1
2025-09-30T14:53:27.338731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895477766002255:3461]
2025-09-30T14:53:27.338746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:27.338772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:27.338843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1202 reason: status is not ok: tablet will be restarted right now sessionId: src_id|54e0a328-e0de483f-de1de4b6-7cbffb39_0
2025-09-30T14:53:27.339053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1202 sessionId: src_id|54e0a328-e0de483f-de1de4b6-7cbffb39_0 is DEAD
2025-09-30T14:53:27.339220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54e0a328-e0de483f-de1de4b6-7cbffb39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:27.339228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54e0a328-e0de483f-de1de4b6-7cbffb39_0] Write session will restart in 0.005349s
2025-09-30T14:53:27.339276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54e0a328-e0de483f-de1de4b6-7cbffb39_0] Write session: Do CDS request
2025-09-30T14:53:27.339285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54e0a328-e0de483f-de1de4b6-7cbffb39_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:27.345754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54e0a328-e0de483f-de1de4b6-7cbffb39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:27.345867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:27.345883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1203
2025-09-30T14:53:27.345999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1203 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:27.346030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1203 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:27.346039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1203 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:27.346044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:27.346442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1203 sessionId:  describe result for acl check
2025-09-30T14:53:27.346473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:27.346478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:27.346479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:27.346484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895477766002545:3448] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:27.346887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895477766002545:3448] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:27.349094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895477766002545:3448] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:27.352754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895477766002545:3448] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:27.352777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895477766002545:3448] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:27.352781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895477766002545:3448] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:27.352789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1203 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:27.359710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:27.362761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:27.362978Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:27.362988Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:27.362999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:27.363055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:27.363087Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895477676253689:7578]
2025-09-30T14:53:27.363667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:27.364040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:27.364097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:27.364467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:27.364550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:27.364556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:27.364558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:27.364559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:27.364560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:27.364561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:27.364563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:27.364564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:27.364565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:27.364567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:27.364568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.364570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.364571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.364572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:27.364573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:27.364579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:27.364592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:27.364597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:27.364601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:27.364606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:27.364610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:27.364614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:27.364618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:27.364622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:27.364627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:27.364631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.364635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.364639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.364643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:27.364647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:27.364655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:27.364664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:27.364670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:27.364675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:27.364680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:27.364685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:27.364689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:27.364694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:27.364698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:27.364703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:27.364707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:27.364713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:27.364718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:27.364729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:27.364734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:27.364739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:27.364743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:27.364748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:27.364755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:27.364762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:27.364770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.364775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.364779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.364785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.364794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.364799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.364803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:27.364808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:27.364812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:27.364818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:27.364860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:27.370476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:27.371563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:27.371578Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:27.371583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:27.371587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:27.371592Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1202 [2:7555895477676253689:7578]
2025-09-30T14:53:27.371605Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:27.371619Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:27.371621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:27.371624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:27.371627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:27.371642Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:27.371647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:27.371654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:27.371708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.371715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.371717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.371721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:27.371724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:27.371782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:27.371791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.371805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.371818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.371835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:27.371860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895477766002530:2454], now have 1 active actors on pipe
2025-09-30T14:53:27.371863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895477766002667:3448], now have 1 active actors on pipe
2025-09-30T14:53:27.371869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895477676253675:7578]
2025-09-30T14:53:27.371872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895477676253675:7578]
2025-09-30T14:53:27.371874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895477676253675:7578]
2025-09-30T14:53:27.371886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:27.371898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:27.371916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:27.371922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:27.371937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:27.371941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:27.371943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:27.371955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895477676253675:7578]
2025-09-30T14:53:27.371958Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:27.371961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:27.371960Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1202
2025-09-30T14:53:27.372007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1202
2025-09-30T14:53:27.372084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:27.372095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:27.372115Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8654988e-d35453a-9d0bcf71-b963090_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:27.372127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:27.372131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:27.372137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:27.372147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:27.372157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:27.372173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:27.372307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:27.372316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:27.372327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:27.372400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1203 partition: 0 MaxSeqNo: 42 sessionId: src_id|8654988e-d35453a-9d0bcf71-b963090_0
2025-09-30T14:53:27.372828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54e0a328-e0de483f-de1de4b6-7cbffb39_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8654988e-d35453a-9d0bcf71-b963090_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:27.375693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8654988e-d35453a-9d0bcf71-b963090_0] Write session: try to update token
2025-09-30T14:53:27.375711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8654988e-d35453a-9d0bcf71-b963090_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:27.384121Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:27.384142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:27.384144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:27.384146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:27.384154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895477676253675:7578]
2025-09-30T14:53:27.384159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895477676253675:7578]
2025-09-30T14:53:27.384162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895477676253675:7578]
2025-09-30T14:53:27.384207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:27.384212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:27.384213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.384216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:27.384218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:27.384222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:27.384380Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:27.390339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1203 sessionId: src_id|8654988e-d35453a-9d0bcf71-b963090_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:27.393063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:27.439056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895477766002844:3461]
2025-09-30T14:53:27.439394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1202, pipe: [1:7555895477766002844:3461]
2025-09-30T14:53:27.497139Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:27.497486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:27.497500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:27.497537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895477766002844:3461], now have 1 active actors on pipe
2025-09-30T14:53:27.497763Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:27.497758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:27.497773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895477766002844:3461]
2025-09-30T14:53:27.497795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:27.497798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:27.497874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1203 reason: error at write: Disconnected sessionId: src_id|8654988e-d35453a-9d0bcf71-b963090_0
2025-09-30T14:53:27.498079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1203 sessionId: src_id|8654988e-d35453a-9d0bcf71-b963090_0 is DEAD
2025-09-30T14:53:27.498246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8654988e-d35453a-9d0bcf71-b963090_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:27.498256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8654988e-d35453a-9d0bcf71-b963090_0] Write session will restart in 0.008079s
2025-09-30T14:53:27.498280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8654988e-d35453a-9d0bcf71-b963090_0] Write session: Do CDS request
2025-09-30T14:53:27.498288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8654988e-d35453a-9d0bcf71-b963090_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:27.507821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8654988e-d35453a-9d0bcf71-b963090_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:27.507920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:27.507937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1204
2025-09-30T14:53:27.508072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1204 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:27.508107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1204 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:27.508117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1204 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:27.508121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:27.508617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1204 sessionId:  describe result for acl check
2025-09-30T14:53:27.508655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:27.508662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:27.508664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:27.508670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895477766002887:3432] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:27.509223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895477766002887:3432] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:27.513578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895477766002887:3432] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:27.518513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895477766002887:3432] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:27.518533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895477766002887:3432] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:27.518540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895477766002887:3432] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:27.518549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1204 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:27.519708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:27.522551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:27.522896Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:27.522912Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:27.522927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:27.523002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:27.523046Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895477676253997:7592]
2025-09-30T14:53:27.523761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:27.524086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:27.524141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:27.524508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:27.524584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:27.524593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:27.524594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:27.524595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:27.524596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:27.524598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:27.524599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:27.524600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:27.524601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:27.524603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:27.524604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.524606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.524607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.524608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:27.524609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:27.524617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:27.524628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:27.524632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:27.524638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:27.524642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:27.524647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:27.524652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:27.524656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:27.524660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:27.524665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:27.524669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.524674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.524678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.524683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:27.524687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:27.524696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:27.524705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:27.524712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:27.524719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:27.524724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:27.524730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:27.524735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:27.524741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:27.524746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:27.524753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:27.524758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:27.524764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:27.524769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:27.524775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:27.524782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:27.524788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:27.524794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:27.524800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:27.524804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:27.524810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:27.524820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.524826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.524831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.524837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.524843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.524849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.524859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:27.524865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:27.524870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:27.524876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:27.524931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:27.530782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:27.532325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:27.532345Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:27.532348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:27.532352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:27.532359Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1203 [2:7555895477676253997:7592]
2025-09-30T14:53:27.532375Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:27.532390Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:27.532399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:27.532402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:27.532405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:27.532421Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:27.532433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:27.532440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:27.532519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.532526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.532529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.532533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:27.532536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:27.532604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:27.532612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.532627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.532644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.532666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:27.532693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895477766002845:2454], now have 1 active actors on pipe
2025-09-30T14:53:27.532702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895477766003126:3432], now have 1 active actors on pipe
2025-09-30T14:53:27.532709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895477676253992:7592]
2025-09-30T14:53:27.532716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895477676253992:7592]
2025-09-30T14:53:27.532719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895477676253992:7592]
2025-09-30T14:53:27.532732Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:27.532747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:27.532758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:27.532763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:27.532766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:27.532772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:27.532774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:27.532804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895477676253992:7592]
2025-09-30T14:53:27.532820Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:27.532809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1203
2025-09-30T14:53:27.532839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:27.532823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1203
2025-09-30T14:53:27.532858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:27.532867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:27.532895Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1d40251-62b94587-63bae57f-a08f1d78_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:27.532907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:27.532911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:27.532913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:27.532923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:27.532932Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:27.532950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:27.533192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:27.533206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:27.533230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:27.533375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1204 partition: 0 MaxSeqNo: 42 sessionId: src_id|c1d40251-62b94587-63bae57f-a08f1d78_0
2025-09-30T14:53:27.533818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8654988e-d35453a-9d0bcf71-b963090_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c1d40251-62b94587-63bae57f-a08f1d78_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:27.536721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d40251-62b94587-63bae57f-a08f1d78_0] Write session: try to update token
2025-09-30T14:53:27.536744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d40251-62b94587-63bae57f-a08f1d78_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:27.545532Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:27.545556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:27.545566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895477676253992:7592]
2025-09-30T14:53:27.545616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:27.545623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:27.545806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:27.545959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:27.546119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:27.546269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:27.546487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:27.546541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:27.557264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1204 sessionId: src_id|c1d40251-62b94587-63bae57f-a08f1d78_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:27.557503Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:27.557529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:27.557532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:27.557534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:27.557545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895477676253992:7592]
2025-09-30T14:53:27.557549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895477676253992:7592]
2025-09-30T14:53:27.557553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895477676253992:7592]
2025-09-30T14:53:27.557598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:27.557610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.557612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:27.557759Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:27.559401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:27.559423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:27.559428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:27.560115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:27.597797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895477766003141:3461]
2025-09-30T14:53:27.598113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1203, pipe: [1:7555895477766003141:3461]
2025-09-30T14:53:27.674158Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:27.674453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:27.674469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:27.674489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895477766003141:3461], now have 1 active actors on pipe
2025-09-30T14:53:27.674684Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:27.675210Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:27.675241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895477766003141:3461]
2025-09-30T14:53:27.675281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:27.675367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1204 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c1d40251-62b94587-63bae57f-a08f1d78_0
2025-09-30T14:53:27.675596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1204 sessionId: src_id|c1d40251-62b94587-63bae57f-a08f1d78_0 is DEAD
2025-09-30T14:53:27.675835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d40251-62b94587-63bae57f-a08f1d78_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:27.675847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d40251-62b94587-63bae57f-a08f1d78_0] Write session will restart in 0.009576s
2025-09-30T14:53:27.675873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d40251-62b94587-63bae57f-a08f1d78_0] Write session: Do CDS request
2025-09-30T14:53:27.675880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d40251-62b94587-63bae57f-a08f1d78_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:27.687527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d40251-62b94587-63bae57f-a08f1d78_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:27.687696Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:27.687712Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1205
2025-09-30T14:53:27.688432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1205 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:27.688486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1205 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:27.688494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1205 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:27.688498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:27.688964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1205 sessionId:  describe result for acl check
2025-09-30T14:53:27.689003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:27.689005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:27.689008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:27.689014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895477766003214:3429] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:27.689629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895477766003214:3429] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:27.694991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895477766003214:3429] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:27.701828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895477766003214:3429] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:27.701847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895477766003214:3429] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:27.701850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895477766003214:3429] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:27.701859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1205 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:27.702522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:27.703162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:27.703370Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:27.703374Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:27.703385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:27.703449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:27.703483Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895477676254285:7595]
2025-09-30T14:53:27.704143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:27.706033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:27.706114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:27.706470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:27.706563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:27.706564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:27.706566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:27.706567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:27.706568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:27.706570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:27.706571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:27.706573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:27.706574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:27.706575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:27.706576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.706577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.706578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.706580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:27.706581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:27.706588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:27.706598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:27.706601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:27.706605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:27.706609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:27.706613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:27.706616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:27.706620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:27.706624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:27.706628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:27.706631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.706635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.706639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.706643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:27.706647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:27.706657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:27.706664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:27.706670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:27.706675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:27.706680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:27.706685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:27.706690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:27.706695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:27.706700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:27.706704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:27.706709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:27.706713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:27.706718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:27.706723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:27.706728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:27.706734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:27.706743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:27.706749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:27.706754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:27.706759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:27.706764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.706769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.706774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.706779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.706783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.706789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.706793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:27.706798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:27.706802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:27.706807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:27.706852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:27.712838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:27.714321Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1204
2025-09-30T14:53:27.714324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1204
2025-09-30T14:53:27.713853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:27.713872Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:27.713875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:27.713880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:27.713888Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1204 [2:7555895477676254285:7595]
2025-09-30T14:53:27.713906Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:27.713921Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:27.713924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:27.713928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:27.713930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:27.713945Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:27.713952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:27.713960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:27.714021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.714023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.714026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.714030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:27.714032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:27.714557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:27.714561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.714574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.714587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.714605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:27.714627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895477766003143:2454], now have 1 active actors on pipe
2025-09-30T14:53:27.714631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895477766003423:3429], now have 1 active actors on pipe
2025-09-30T14:53:27.714646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:27.714650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:27.714672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895477676254279:7595]
2025-09-30T14:53:27.714674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895477676254279:7595]
2025-09-30T14:53:27.714676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895477676254279:7595]
2025-09-30T14:53:27.714693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:27.714722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:27.714725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:27.714729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:27.714731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:27.714737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:27.714739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:27.714757Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1c2cec2-36f69b46-f67ae87d-98d477db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:27.714765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:27.714768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:27.714771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:27.714781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:27.714792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:27.714829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895477676254279:7595]
2025-09-30T14:53:27.714839Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:27.714846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:27.714849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:27.715072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:27.715080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:27.715102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:27.715259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1205 partition: 0 MaxSeqNo: 42 sessionId: src_id|f1c2cec2-36f69b46-f67ae87d-98d477db_0
2025-09-30T14:53:27.716234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d40251-62b94587-63bae57f-a08f1d78_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f1c2cec2-36f69b46-f67ae87d-98d477db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:27.719000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1c2cec2-36f69b46-f67ae87d-98d477db_0] Write session: try to update token
2025-09-30T14:53:27.719021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1c2cec2-36f69b46-f67ae87d-98d477db_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:27.727803Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:27.727824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:27.727827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:27.727829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:27.727839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895477676254279:7595]
2025-09-30T14:53:27.727843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895477676254279:7595]
2025-09-30T14:53:27.727848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895477676254279:7595]
2025-09-30T14:53:27.727888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:27.727895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.727898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:27.727904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:27.727910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:27.727915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:27.728049Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:27.734037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1205 sessionId: src_id|f1c2cec2-36f69b46-f67ae87d-98d477db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:27.736995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:27.775457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895477766003437:3461]
2025-09-30T14:53:27.775752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1204, pipe: [1:7555895477766003437:3461]
2025-09-30T14:53:27.848223Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:27.848535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:27.848554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:27.848595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895477766003437:3461], now have 1 active actors on pipe
2025-09-30T14:53:27.848899Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:27.849442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1c2cec2-36f69b46-f67ae87d-98d477db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:27.849453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1c2cec2-36f69b46-f67ae87d-98d477db_0] Write session will restart in 0.008328s
2025-09-30T14:53:27.849489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1c2cec2-36f69b46-f67ae87d-98d477db_0] Write session: Do CDS request
2025-09-30T14:53:27.849495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1c2cec2-36f69b46-f67ae87d-98d477db_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:27.848837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895477766003437:3461]
2025-09-30T14:53:27.848882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:27.848917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:27.848920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:27.848983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1205 reason: error at write: Disconnected sessionId: src_id|f1c2cec2-36f69b46-f67ae87d-98d477db_0
2025-09-30T14:53:27.849275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1205 sessionId: src_id|f1c2cec2-36f69b46-f67ae87d-98d477db_0 is DEAD
2025-09-30T14:53:27.858777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1c2cec2-36f69b46-f67ae87d-98d477db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:27.858952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:27.858981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1206
2025-09-30T14:53:27.859165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1206 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:27.859200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1206 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:27.859204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1206 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:27.859213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:27.859725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1206 sessionId:  describe result for acl check
2025-09-30T14:53:27.859778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:27.859780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:27.859782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:27.859788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895477766003452:3422] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:27.860336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895477766003452:3422] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:27.862351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895477766003452:3422] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:27.866023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895477766003452:3422] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:27.866038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895477766003452:3422] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:27.866052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895477766003452:3422] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:27.866074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1206 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:27.876033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:27.879230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:27.879464Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:27.879477Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:27.879488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:27.879542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:27.879587Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895477676254572:7597]
2025-09-30T14:53:27.880269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:27.880601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:27.880655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:27.881009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:27.881073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:27.881079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:27.881081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:27.881082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:27.881083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:27.881085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:27.881086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:27.881087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:27.881089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:27.881090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:27.881091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.881093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.881094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.881095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:27.881097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:27.881102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:27.881114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:27.881119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:27.881123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:27.881128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:27.881133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:27.881137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:27.881142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:27.881146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:27.881152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:27.881156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.881161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.881166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.881170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:27.881175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:27.881182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:27.881191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:27.881197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:27.881204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:27.881210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:27.881216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:27.881221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:27.881227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:27.881238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:27.881244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:27.881254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:27.881260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:27.881270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:27.881277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:27.881287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:27.881293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:27.881303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:27.881309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:27.881314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:27.881324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:27.881329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.881341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.881346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.881355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.881360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.881367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.881372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:27.881378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:27.881388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:27.881393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:27.881448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:27.887117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:27.888625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:27.888647Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:27.888649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:27.888653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:27.888660Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1205 [2:7555895477676254572:7597]
2025-09-30T14:53:27.888676Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:27.888690Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:27.888694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:27.888697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:27.888699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:27.888717Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:27.888738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:27.888745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:27.888806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.888814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.888816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.888820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:27.888823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:27.888894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:27.888904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.888920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:27.888935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:27.888955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:27.888983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895477766003439:2454], now have 1 active actors on pipe
2025-09-30T14:53:27.888991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895477766003529:3422], now have 1 active actors on pipe
2025-09-30T14:53:27.888998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895477676254567:7597]
2025-09-30T14:53:27.889000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895477676254567:7597]
2025-09-30T14:53:27.889002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895477676254567:7597]
2025-09-30T14:53:27.889016Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:27.889029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:27.889034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:27.889037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:27.889040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:27.889050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:27.889058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:27.889042Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1205
2025-09-30T14:53:27.889059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1205
2025-09-30T14:53:27.889091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895477676254567:7597]
2025-09-30T14:53:27.889101Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:27.889106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:27.889122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:27.889131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:27.889182Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c328bf6-85e7cf13-aeefa113-dc4868eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:27.889194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:27.889198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:27.889200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:27.889210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:27.889222Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:27.889248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:27.889460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:27.889473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:27.889497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:27.889607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1206 partition: 0 MaxSeqNo: 42 sessionId: src_id|5c328bf6-85e7cf13-aeefa113-dc4868eb_0
2025-09-30T14:53:27.889983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1c2cec2-36f69b46-f67ae87d-98d477db_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5c328bf6-85e7cf13-aeefa113-dc4868eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:27.892743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c328bf6-85e7cf13-aeefa113-dc4868eb_0] Write session: try to update token
2025-09-30T14:53:27.892766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c328bf6-85e7cf13-aeefa113-dc4868eb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:27.901457Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:27.901481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:27.901484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:27.901487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:27.901496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895477676254567:7597]
2025-09-30T14:53:27.901502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895477676254567:7597]
2025-09-30T14:53:27.901506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895477676254567:7597]
2025-09-30T14:53:27.901547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:27.901554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:27.901553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:27.901557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:27.901561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:27.901566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:27.901690Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:27.910664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1206 sessionId: src_id|5c328bf6-85e7cf13-aeefa113-dc4868eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:27.913419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:27.949000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895477766003735:3461]
2025-09-30T14:53:27.949308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1205, pipe: [1:7555895477766003735:3461]
2025-09-30T14:53:28.018508Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:28.018826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:28.018840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:28.018859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895477766003735:3461], now have 1 active actors on pipe
2025-09-30T14:53:28.019107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895477766003735:3461]
2025-09-30T14:53:28.019142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:28.019214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1206 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5c328bf6-85e7cf13-aeefa113-dc4868eb_0
2025-09-30T14:53:28.019438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1206 sessionId: src_id|5c328bf6-85e7cf13-aeefa113-dc4868eb_0 is DEAD
2025-09-30T14:53:28.019465Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:28.019552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c328bf6-85e7cf13-aeefa113-dc4868eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:28.019563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c328bf6-85e7cf13-aeefa113-dc4868eb_0] Write session will restart in 0.009538s
2025-09-30T14:53:28.019601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c328bf6-85e7cf13-aeefa113-dc4868eb_0] Write session: Do CDS request
2025-09-30T14:53:28.019608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c328bf6-85e7cf13-aeefa113-dc4868eb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:28.019070Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:28.030777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c328bf6-85e7cf13-aeefa113-dc4868eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:28.031042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:28.031058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1207
2025-09-30T14:53:28.031167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1207 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:28.031193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1207 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:28.031198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1207 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:28.031203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:28.031793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1207 sessionId:  describe result for acl check
2025-09-30T14:53:28.031827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:28.031833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:28.031835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:28.031840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895482060971103:3417] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:28.032373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895482060971103:3417] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:28.035022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895482060971103:3417] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:28.038362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895482060971103:3417] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:28.038376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895482060971103:3417] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:28.038380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895482060971103:3417] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:28.038388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1207 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:28.045483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:28.048509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:28.048774Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:28.048787Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:28.048799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:28.048864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:28.048906Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895481971222156:7599]
2025-09-30T14:53:28.049560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:28.050007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:28.050085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:28.050460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:28.050535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:28.050542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:28.050543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:28.050544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:28.050545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:28.050547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:28.050548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:28.050549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:28.050551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:28.050552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:28.050553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.050554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.050555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.050556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:28.050558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:28.050564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:28.050575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:28.050579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:28.050584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:28.050588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:28.050593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:28.050597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:28.050601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:28.050606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:28.050611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:28.050614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.050619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.050623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.050627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:28.050641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:28.050649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:28.050657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:28.050665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:28.050671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:28.050677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:28.050683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:28.050688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:28.050693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:28.050698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:28.050705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:28.050709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:28.050715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:28.050720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:28.050725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:28.050730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:28.050736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:28.050741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:28.050747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:28.050751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:28.050756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:28.050761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.050767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.050771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.050777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.050781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.050787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.050792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:28.050797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:28.050801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:28.050806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:28.050852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:28.056654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:28.058082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:28.058098Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:28.058101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:28.058105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:28.058112Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1206 [2:7555895481971222156:7599]
2025-09-30T14:53:28.058128Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:28.058143Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:28.058147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:28.058150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:28.058152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:28.058168Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:28.058175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:28.058187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:28.058245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.058252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.058254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.058257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:28.058260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:28.058332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:28.058340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.058354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.058370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.058525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1206
2025-09-30T14:53:28.058533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1206
2025-09-30T14:53:28.058390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:28.058410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895481971222151:7599]
2025-09-30T14:53:28.058412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895481971222151:7599]
2025-09-30T14:53:28.058416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895481971222151:7599]
2025-09-30T14:53:28.058425Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:28.058435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:28.058438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:28.058439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895482060971237:3417], now have 1 active actors on pipe
2025-09-30T14:53:28.058441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:28.058443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895482060971033:2454], now have 1 active actors on pipe
2025-09-30T14:53:28.058451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:28.058465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:28.058469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:28.058504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895481971222151:7599]
2025-09-30T14:53:28.058513Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:28.058526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:28.059020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:28.059035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:28.059063Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9850bdcb-803ecd88-1aa7f294-7d6737d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:28.059071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:28.059078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:28.059080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:28.059101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:28.059119Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:28.059138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:28.059365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:28.059377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:28.059393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:28.059504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1207 partition: 0 MaxSeqNo: 42 sessionId: src_id|9850bdcb-803ecd88-1aa7f294-7d6737d_0
2025-09-30T14:53:28.059923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c328bf6-85e7cf13-aeefa113-dc4868eb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9850bdcb-803ecd88-1aa7f294-7d6737d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:28.062763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9850bdcb-803ecd88-1aa7f294-7d6737d_0] Write session: try to update token
2025-09-30T14:53:28.062782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9850bdcb-803ecd88-1aa7f294-7d6737d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:28.070994Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:28.071021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:28.071023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:28.071026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:28.071036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895481971222151:7599]
2025-09-30T14:53:28.071041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895481971222151:7599]
2025-09-30T14:53:28.071045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895481971222151:7599]
2025-09-30T14:53:28.071088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:28.071096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.071099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:28.071102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:28.071109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:28.071114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:28.071240Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:28.078732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1207 sessionId: src_id|9850bdcb-803ecd88-1aa7f294-7d6737d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:28.081525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:28.118988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895482060971340:3461]
2025-09-30T14:53:28.119316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1206, pipe: [1:7555895482060971340:3461]
2025-09-30T14:53:28.187477Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:28.187810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:28.187826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:28.187846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895482060971340:3461], now have 1 active actors on pipe
2025-09-30T14:53:28.188065Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:28.188095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:28.188101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895482060971340:3461]
2025-09-30T14:53:28.188112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:28.188123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:28.188177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1207 reason: error at write: Disconnected sessionId: src_id|9850bdcb-803ecd88-1aa7f294-7d6737d_0
2025-09-30T14:53:28.188353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1207 sessionId: src_id|9850bdcb-803ecd88-1aa7f294-7d6737d_0 is DEAD
2025-09-30T14:53:28.188559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9850bdcb-803ecd88-1aa7f294-7d6737d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:28.188570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9850bdcb-803ecd88-1aa7f294-7d6737d_0] Write session will restart in 0.009082s
2025-09-30T14:53:28.188595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9850bdcb-803ecd88-1aa7f294-7d6737d_0] Write session: Do CDS request
2025-09-30T14:53:28.188603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9850bdcb-803ecd88-1aa7f294-7d6737d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:28.198808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9850bdcb-803ecd88-1aa7f294-7d6737d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:28.198888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:28.198919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1208
2025-09-30T14:53:28.199066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1208 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:28.199100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1208 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:28.199111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1208 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:28.199115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:28.199570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1208 sessionId:  describe result for acl check
2025-09-30T14:53:28.199610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:28.199617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:28.199619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:28.199625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895482060971408:3402] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:28.200183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895482060971408:3402] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:28.203214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895482060971408:3402] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:28.206782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895482060971408:3402] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:28.206801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895482060971408:3402] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:28.206805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895482060971408:3402] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:28.206813Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1208 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:28.210337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:28.213410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:28.213619Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:28.213632Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:28.213643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:28.213693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:28.213735Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895481971222459:7603]
2025-09-30T14:53:28.214436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:28.214739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:28.214782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:28.215306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:28.215406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:28.215414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:28.215415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:28.215416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:28.215417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:28.215418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:28.215420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:28.215421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:28.215422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:28.215424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:28.215425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.215426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.215427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.215428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:28.215429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:28.215435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:28.215444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:28.215447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:28.215451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:28.215455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:28.215459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:28.215463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:28.215467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:28.215471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:28.215475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:28.215479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.215483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.215487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.215491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:28.215495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:28.215506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:28.215514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:28.215520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:28.215528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:28.215533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:28.215538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:28.215542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:28.215548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:28.215552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:28.215558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:28.215562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:28.215567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:28.215572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:28.215576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:28.215588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:28.215594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:28.215603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:28.215608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:28.215617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:28.215622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:28.215631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.215636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.215645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.215650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.215655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.215664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.215669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:28.215675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:28.215679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:28.215684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:28.215729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:28.221241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:28.222176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:28.222192Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:28.222194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:28.222197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:28.222202Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1207 [2:7555895481971222459:7603]
2025-09-30T14:53:28.222218Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:28.222229Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:28.222234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:28.222236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:28.222238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:28.222254Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:28.222261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:28.222273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:28.222338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.222347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.222349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.222353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:28.222355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:28.222426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:28.222436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.222450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.222462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.222479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:28.222499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895482060971580:3402], now have 1 active actors on pipe
2025-09-30T14:53:28.222502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895482060971342:2454], now have 1 active actors on pipe
2025-09-30T14:53:28.222509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895481971222454:7603]
2025-09-30T14:53:28.222517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895481971222454:7603]
2025-09-30T14:53:28.222520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895481971222454:7603]
2025-09-30T14:53:28.222533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:28.222544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:28.222553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:28.222555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:28.222557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:28.222568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:28.222571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:28.222557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1207
2025-09-30T14:53:28.222560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1207
2025-09-30T14:53:28.222601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895481971222454:7603]
2025-09-30T14:53:28.222611Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:28.222611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:28.222625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:28.222631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:28.222679Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4be4d278-b5389102-e3f6b9d2-1df26f3d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:28.222690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:28.222695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:28.222697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:28.222706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:28.222715Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:28.222736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:28.222894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:28.222903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:28.222916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:28.222991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1208 partition: 0 MaxSeqNo: 42 sessionId: src_id|4be4d278-b5389102-e3f6b9d2-1df26f3d_0
2025-09-30T14:53:28.223435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9850bdcb-803ecd88-1aa7f294-7d6737d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4be4d278-b5389102-e3f6b9d2-1df26f3d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:28.226267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4be4d278-b5389102-e3f6b9d2-1df26f3d_0] Write session: try to update token
2025-09-30T14:53:28.226284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4be4d278-b5389102-e3f6b9d2-1df26f3d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:28.235630Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:28.235659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:28.235662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:28.235664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:28.235674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895481971222454:7603]
2025-09-30T14:53:28.235677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895481971222454:7603]
2025-09-30T14:53:28.235681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895481971222454:7603]
2025-09-30T14:53:28.235721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:28.235724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:28.235727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.235730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:28.235731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:28.235734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:28.235880Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:28.241394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1208 sessionId: src_id|4be4d278-b5389102-e3f6b9d2-1df26f3d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:28.244153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:28.288430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895482060971652:3461]
2025-09-30T14:53:28.288739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1207, pipe: [1:7555895482060971652:3461]
2025-09-30T14:53:28.350600Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:28.351487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:28.351508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:28.351547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895482060971652:3461], now have 1 active actors on pipe
2025-09-30T14:53:28.351796Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:28.351829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895482060971652:3461]
2025-09-30T14:53:28.351841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:28.351846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:28.351862Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:28.351920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1208 reason: error at write: Disconnected sessionId: src_id|4be4d278-b5389102-e3f6b9d2-1df26f3d_0
2025-09-30T14:53:28.352138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1208 sessionId: src_id|4be4d278-b5389102-e3f6b9d2-1df26f3d_0 is DEAD
2025-09-30T14:53:28.352274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4be4d278-b5389102-e3f6b9d2-1df26f3d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:28.352284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4be4d278-b5389102-e3f6b9d2-1df26f3d_0] Write session will restart in 0.005507s
2025-09-30T14:53:28.352306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4be4d278-b5389102-e3f6b9d2-1df26f3d_0] Write session: Do CDS request
2025-09-30T14:53:28.352314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4be4d278-b5389102-e3f6b9d2-1df26f3d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:28.358831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4be4d278-b5389102-e3f6b9d2-1df26f3d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:28.358916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:28.358935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1209
2025-09-30T14:53:28.359106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1209 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:28.359142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1209 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:28.359148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1209 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:28.359160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:28.359636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1209 sessionId:  describe result for acl check
2025-09-30T14:53:28.359679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:28.359687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:28.359689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:28.359695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895482060971669:3397] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:28.360279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895482060971669:3397] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:28.363261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895482060971669:3397] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:28.367557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895482060971669:3397] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:28.367574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895482060971669:3397] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:28.367578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895482060971669:3397] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:28.367586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1209 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:28.376288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:28.379271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:28.379524Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:28.379537Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:28.379548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:28.379608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:28.379656Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895481971222749:7605]
2025-09-30T14:53:28.380412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:28.380807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:28.380888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:28.381296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:28.381377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:28.381385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:28.381386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:28.381388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:28.381389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:28.381390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:28.381392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:28.381393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:28.381394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:28.381395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:28.381397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.381398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.381399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.381401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:28.381402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:28.381409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:28.381420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:28.381424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:28.381428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:28.381433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:28.381437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:28.381442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:28.381446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:28.381450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:28.381455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:28.381459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.381463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.381467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.381471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:28.381475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:28.381485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:28.381494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:28.381500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:28.381507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:28.381513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:28.381519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:28.381524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:28.381530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:28.381536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:28.381542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:28.381547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:28.381567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:28.381573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:28.381579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:28.381584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:28.381590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:28.381604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:28.381610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:28.381615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:28.381621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:28.381627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.381634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.381639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.381645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.381651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.381657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.381663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:28.381669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:28.381674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:28.381680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:28.381731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:28.387442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:28.388902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:28.388922Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:28.388925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:28.388929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:28.388936Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1208 [2:7555895481971222749:7605]
2025-09-30T14:53:28.388953Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:28.388968Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:28.388972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:28.388975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:28.388978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:28.388994Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:28.389001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:28.389008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:28.389071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.389081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.389084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.389088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:28.389090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:28.389156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:28.389164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.389177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.389194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.389214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:28.389238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895482060971793:3397], now have 1 active actors on pipe
2025-09-30T14:53:28.389248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895482060971654:2454], now have 1 active actors on pipe
2025-09-30T14:53:28.389255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895481971222744:7605]
2025-09-30T14:53:28.389257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895481971222744:7605]
2025-09-30T14:53:28.389259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895481971222744:7605]
2025-09-30T14:53:28.389271Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:28.389287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:28.389292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:28.389292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:28.389294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:28.389307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:28.389310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:28.389332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1208
2025-09-30T14:53:28.389333Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1208
2025-09-30T14:53:28.389345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895481971222744:7605]
2025-09-30T14:53:28.389354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:28.389359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:28.389409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:28.389419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:28.389452Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6174446f-b8bfcd9c-43bbb04c-ed36d595_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:28.389463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:28.389473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:28.389475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:28.389485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:28.389499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:28.389517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:28.389798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1209 partition: 0 MaxSeqNo: 42 sessionId: src_id|6174446f-b8bfcd9c-43bbb04c-ed36d595_0
2025-09-30T14:53:28.389692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:28.389700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:28.389713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:28.390241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4be4d278-b5389102-e3f6b9d2-1df26f3d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6174446f-b8bfcd9c-43bbb04c-ed36d595_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:28.393067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6174446f-b8bfcd9c-43bbb04c-ed36d595_0] Write session: try to update token
2025-09-30T14:53:28.393086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6174446f-b8bfcd9c-43bbb04c-ed36d595_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:28.402110Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:28.402133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:28.402136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:28.402138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:28.402148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895481971222744:7605]
2025-09-30T14:53:28.402153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895481971222744:7605]
2025-09-30T14:53:28.402157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895481971222744:7605]
2025-09-30T14:53:28.402198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:28.402206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.402208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:28.402215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:28.402221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:28.402225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:28.402343Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:28.408511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1209 sessionId: src_id|6174446f-b8bfcd9c-43bbb04c-ed36d595_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:28.411616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:28.451767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895482060971973:3461]
2025-09-30T14:53:28.451975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1208, pipe: [1:7555895482060971973:3461]
2025-09-30T14:53:28.517742Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:28.518025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:28.518041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:28.518091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895482060971973:3461], now have 1 active actors on pipe
2025-09-30T14:53:28.518258Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:28.518352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895482060971973:3461]
2025-09-30T14:53:28.518379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:28.518386Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:28.518485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1209 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6174446f-b8bfcd9c-43bbb04c-ed36d595_0
2025-09-30T14:53:28.518706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1209 sessionId: src_id|6174446f-b8bfcd9c-43bbb04c-ed36d595_0 is DEAD
2025-09-30T14:53:28.518912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6174446f-b8bfcd9c-43bbb04c-ed36d595_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:28.518923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6174446f-b8bfcd9c-43bbb04c-ed36d595_0] Write session will restart in 0.007973s
2025-09-30T14:53:28.518947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6174446f-b8bfcd9c-43bbb04c-ed36d595_0] Write session: Do CDS request
2025-09-30T14:53:28.518953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6174446f-b8bfcd9c-43bbb04c-ed36d595_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:28.528068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6174446f-b8bfcd9c-43bbb04c-ed36d595_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:28.528221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:28.528241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1210
2025-09-30T14:53:28.528389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1210 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:28.528432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1210 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:28.528437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1210 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:28.528442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:28.529411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1210 sessionId:  describe result for acl check
2025-09-30T14:53:28.529453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:28.529461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:28.529463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:28.529470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895482060972009:3382] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:28.530024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895482060972009:3382] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:28.532555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895482060972009:3382] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:28.536959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895482060972009:3382] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:28.536975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895482060972009:3382] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:28.536978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895482060972009:3382] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:28.536986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1210 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:28.542432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:28.548292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:28.548558Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:28.548575Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:28.548588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:28.548656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:28.548701Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895481971223076:7619]
2025-09-30T14:53:28.549426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:28.549795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:28.549845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:28.550206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:28.550423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:28.550432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:28.550434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:28.550435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:28.550437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:28.550438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:28.550440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:28.550441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:28.550443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:28.550444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:28.550446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.550447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.550449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.550451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:28.550452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:28.550459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:28.550470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:28.550474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:28.550479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:28.550484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:28.550488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:28.550493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:28.550497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:28.550502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:28.550508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:28.550513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.550517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.550522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.550526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:28.550531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:28.550539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:28.550547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:28.550555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:28.550562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:28.550567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:28.550573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:28.550579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:28.550590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:28.550597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:28.550604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:28.550608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:28.550628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:28.550639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:28.550645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:28.550651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:28.550657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:28.550665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:28.550671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:28.550677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:28.550683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:28.550688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.550694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.550699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.550704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.550709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.550714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.550718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:28.550724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:28.550730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:28.550736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:28.550784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:28.556514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:28.557777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:28.557796Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:28.557798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:28.557802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:28.557810Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1209 [2:7555895481971223076:7619]
2025-09-30T14:53:28.557826Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:28.557839Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:28.557843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:28.557846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:28.557849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:28.557865Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:28.557878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:28.557888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:28.557949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.557956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.557958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.557962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:28.557965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:28.558031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:28.558038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.558051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.558080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.558102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:28.558128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895482060971978:2454], now have 1 active actors on pipe
2025-09-30T14:53:28.558132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895482060972167:3382], now have 1 active actors on pipe
2025-09-30T14:53:28.558139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895481971223071:7619]
2025-09-30T14:53:28.558142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895481971223071:7619]
2025-09-30T14:53:28.558144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895481971223071:7619]
2025-09-30T14:53:28.558158Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:28.558175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:28.558161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1209
2025-09-30T14:53:28.558193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1209
2025-09-30T14:53:28.558187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:28.558192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:28.558195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:28.558198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:28.558201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:28.558227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895481971223071:7619]
2025-09-30T14:53:28.558231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:28.558242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:28.558251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:28.558256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:28.558303Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|110a03d2-cb981b86-2847ef2f-40661c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:28.558310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:28.558314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:28.558316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:28.558326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:28.558335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:28.558354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:28.558488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:28.558497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:28.558511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:28.558605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1210 partition: 0 MaxSeqNo: 42 sessionId: src_id|110a03d2-cb981b86-2847ef2f-40661c_0
2025-09-30T14:53:28.558994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6174446f-b8bfcd9c-43bbb04c-ed36d595_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|110a03d2-cb981b86-2847ef2f-40661c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:28.561969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|110a03d2-cb981b86-2847ef2f-40661c_0] Write session: try to update token
2025-09-30T14:53:28.561986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|110a03d2-cb981b86-2847ef2f-40661c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:28.570465Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:28.570483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:28.570485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:28.570487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:28.570498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895481971223071:7619]
2025-09-30T14:53:28.570502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895481971223071:7619]
2025-09-30T14:53:28.570507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895481971223071:7619]
2025-09-30T14:53:28.570547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:28.570554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.570555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:28.570557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:28.570562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:28.570566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:28.570688Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:28.577011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1210 sessionId: src_id|110a03d2-cb981b86-2847ef2f-40661c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:28.579978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:28.618689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895482060972278:3461]
2025-09-30T14:53:28.618966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1209, pipe: [1:7555895482060972278:3461]
2025-09-30T14:53:28.683684Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:28.684180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:28.684200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:28.684238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895482060972278:3461], now have 1 active actors on pipe
2025-09-30T14:53:28.684428Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:28.684454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:28.684517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895482060972278:3461]
2025-09-30T14:53:28.684544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:28.684622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1210 reason: status is not ok: tablet will be restarted right now sessionId: src_id|110a03d2-cb981b86-2847ef2f-40661c_0
2025-09-30T14:53:28.684821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1210 sessionId: src_id|110a03d2-cb981b86-2847ef2f-40661c_0 is DEAD
2025-09-30T14:53:28.684978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|110a03d2-cb981b86-2847ef2f-40661c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:28.684988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|110a03d2-cb981b86-2847ef2f-40661c_0] Write session will restart in 0.007835s
2025-09-30T14:53:28.685010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|110a03d2-cb981b86-2847ef2f-40661c_0] Write session: Do CDS request
2025-09-30T14:53:28.685016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|110a03d2-cb981b86-2847ef2f-40661c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:28.693841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|110a03d2-cb981b86-2847ef2f-40661c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:28.693931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:28.693965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1211
2025-09-30T14:53:28.694127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1211 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:28.694165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1211 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:28.694175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1211 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:28.694180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:28.694626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1211 sessionId:  describe result for acl check
2025-09-30T14:53:28.694675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:28.694683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:28.694684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:28.694690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895482060972309:3381] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:28.695232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895482060972309:3381] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:28.699367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895482060972309:3381] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:28.702864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895482060972309:3381] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:28.702882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895482060972309:3381] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:28.702885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895482060972309:3381] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:28.702894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1211 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:28.708724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:28.712058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:28.712303Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:28.712313Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:28.712324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:28.712384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:28.712426Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895481971223370:7622]
2025-09-30T14:53:28.713101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:28.713497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:28.713558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:28.713934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:28.713999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:28.714003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:28.714004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:28.714006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:28.714007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:28.714008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:28.714010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:28.714011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:28.714012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:28.714014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:28.714015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.714016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.714017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.714018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:28.714019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:28.714025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:28.714037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:28.714041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:28.714046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:28.714050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:28.714054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:28.714084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:28.714088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:28.714093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:28.714099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:28.714104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.714108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.714113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.714117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:28.714122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:28.714132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:28.714141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:28.714147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:28.714154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:28.714159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:28.714165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:28.714170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:28.714176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:28.714182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:28.714188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:28.714192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:28.714199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:28.714204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:28.714210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:28.714215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:28.714221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:28.714226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:28.714234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:28.714239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:28.714245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:28.714250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.714256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.714261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.714267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.714272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.714278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.714283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:28.714289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:28.714295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:28.714301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:28.714351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:28.724064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:28.725269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:28.725284Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:28.725287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:28.725291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:28.725298Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1210 [2:7555895481971223370:7622]
2025-09-30T14:53:28.725317Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:28.725333Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:28.725337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:28.725340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:28.725342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:28.725358Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:28.725370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:28.725383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:28.725447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.725454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.725456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.725460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:28.725462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:28.725533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:28.725541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.725555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.725568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.725590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:28.725612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895482060972280:2454], now have 1 active actors on pipe
2025-09-30T14:53:28.725624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895482060972489:3381], now have 1 active actors on pipe
2025-09-30T14:53:28.725630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895481971223365:7622]
2025-09-30T14:53:28.725632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895481971223365:7622]
2025-09-30T14:53:28.725635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895481971223365:7622]
2025-09-30T14:53:28.725648Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:28.725662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:28.725673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:28.725677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:28.725679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:28.725681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:28.725684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:28.725731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895481971223365:7622]
2025-09-30T14:53:28.725747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:28.725759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:28.725887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:28.725899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:28.725922Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|448d541b-6517811e-b302d0e0-249ff402_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:28.725934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:28.725942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:28.725944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:28.725954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:28.725964Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:28.725978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:28.726135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:28.726142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:28.726157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:28.726607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|110a03d2-cb981b86-2847ef2f-40661c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|448d541b-6517811e-b302d0e0-249ff402_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:28.725760Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1210
2025-09-30T14:53:28.725814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1210
2025-09-30T14:53:28.726228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1211 partition: 0 MaxSeqNo: 42 sessionId: src_id|448d541b-6517811e-b302d0e0-249ff402_0
2025-09-30T14:53:28.729502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|448d541b-6517811e-b302d0e0-249ff402_0] Write session: try to update token
2025-09-30T14:53:28.729521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|448d541b-6517811e-b302d0e0-249ff402_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:28.739814Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:28.739834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:28.739837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:28.739839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:28.739849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895481971223365:7622]
2025-09-30T14:53:28.739853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895481971223365:7622]
2025-09-30T14:53:28.739858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895481971223365:7622]
2025-09-30T14:53:28.739898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:28.739909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:28.739912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.739915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:28.739919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:28.739923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:28.740062Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:28.744898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1211 sessionId: src_id|448d541b-6517811e-b302d0e0-249ff402_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:28.747704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:28.784762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895482060972580:3461]
2025-09-30T14:53:28.785087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1210, pipe: [1:7555895482060972580:3461]
2025-09-30T14:53:28.856957Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:28.857458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:28.857475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:28.857515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895482060972580:3461], now have 1 active actors on pipe
2025-09-30T14:53:28.857770Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:28.857767Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:28.857818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895482060972580:3461]
2025-09-30T14:53:28.857821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:28.857824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:28.857883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1211 reason: error at write: Disconnected sessionId: src_id|448d541b-6517811e-b302d0e0-249ff402_0
2025-09-30T14:53:28.858219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|448d541b-6517811e-b302d0e0-249ff402_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:28.858227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|448d541b-6517811e-b302d0e0-249ff402_0] Write session will restart in 0.009613s
2025-09-30T14:53:28.858260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|448d541b-6517811e-b302d0e0-249ff402_0] Write session: Do CDS request
2025-09-30T14:53:28.858266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|448d541b-6517811e-b302d0e0-249ff402_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:28.858083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1211 sessionId: src_id|448d541b-6517811e-b302d0e0-249ff402_0 is DEAD
2025-09-30T14:53:28.868881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|448d541b-6517811e-b302d0e0-249ff402_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:28.868926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:28.868943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1212
2025-09-30T14:53:28.869527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1212 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:28.869576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1212 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:28.869586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1212 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:28.869590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:28.870433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1212 sessionId:  describe result for acl check
2025-09-30T14:53:28.870470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:28.870473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:28.870474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:28.870481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895482060972630:3371] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:28.871047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895482060972630:3371] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:28.875725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895482060972630:3371] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:28.879403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895482060972630:3371] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:28.879422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895482060972630:3371] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:28.879426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895482060972630:3371] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:28.879435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1212 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:28.884104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:28.887324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:28.887720Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:28.887730Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:28.887743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:28.887807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:28.887844Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895481971223663:7624]
2025-09-30T14:53:28.888463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:28.888802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:28.888859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:28.889193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:28.889265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:28.889271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:28.889272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:28.889273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:28.889274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:28.889276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:28.889277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:28.889278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:28.889279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:28.889280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:28.889281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.889282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.889284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.889285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:28.889286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:28.889292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:28.889302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:28.889306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:28.889311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:28.889315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:28.889319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:28.889323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:28.889327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:28.889330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:28.889335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:28.889338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.889342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.889346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.889350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:28.889353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:28.889361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:28.889368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:28.889374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:28.889379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:28.889384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:28.889389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:28.889393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:28.889398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:28.889404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:28.889409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:28.889413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:28.889418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:28.889424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:28.889432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:28.889442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:28.889448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:28.889460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:28.889465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:28.889470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:28.889475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:28.889483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.889489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.889493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.889498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.889502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.889507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.889512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:28.889516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:28.889520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:28.889525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:28.889572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:28.895286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:28.896186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:28.896199Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:28.896203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:28.896207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:28.896215Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1211 [2:7555895481971223663:7624]
2025-09-30T14:53:28.896233Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:28.896253Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:28.896261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:28.896265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:28.896268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:28.896283Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:28.896293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:28.896300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:28.896366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.896377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.896379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.896383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:28.896386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:28.896612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1211
2025-09-30T14:53:28.896616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1211
2025-09-30T14:53:28.896848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:28.896861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.896875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:28.896888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:28.896908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:28.896932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895482060972791:3371], now have 1 active actors on pipe
2025-09-30T14:53:28.896940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895482060972582:2454], now have 1 active actors on pipe
2025-09-30T14:53:28.896957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:28.896961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:28.896977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895481971223658:7624]
2025-09-30T14:53:28.896983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895481971223658:7624]
2025-09-30T14:53:28.896986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895481971223658:7624]
2025-09-30T14:53:28.896997Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:28.897014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:28.897019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:28.897023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:28.897025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:28.897031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:28.897034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:28.897051Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e755f469-8ff3fd83-af761c25-73313bc1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:28.897064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:28.897072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:28.897074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:28.897083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:28.897094Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:28.897136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895481971223658:7624]
2025-09-30T14:53:28.897147Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:28.897161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:28.897167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:28.897397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:28.897412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:28.897428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:28.897546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1212 partition: 0 MaxSeqNo: 42 sessionId: src_id|e755f469-8ff3fd83-af761c25-73313bc1_0
2025-09-30T14:53:28.897938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|448d541b-6517811e-b302d0e0-249ff402_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e755f469-8ff3fd83-af761c25-73313bc1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:28.900820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e755f469-8ff3fd83-af761c25-73313bc1_0] Write session: try to update token
2025-09-30T14:53:28.900839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e755f469-8ff3fd83-af761c25-73313bc1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:28.911501Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:28.911520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:28.911522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:28.911524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:28.911534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895481971223658:7624]
2025-09-30T14:53:28.911539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895481971223658:7624]
2025-09-30T14:53:28.911543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895481971223658:7624]
2025-09-30T14:53:28.911583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:28.911590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:28.911589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:28.911593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:28.911596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:28.911600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:28.911734Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:28.918606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1212 sessionId: src_id|e755f469-8ff3fd83-af761c25-73313bc1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:28.921495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:28.958187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895482060972884:3461]
2025-09-30T14:53:28.959737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1211, pipe: [1:7555895482060972884:3461]
2025-09-30T14:53:29.069257Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:29.069588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:29.069604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:29.069638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895482060972884:3461], now have 1 active actors on pipe
2025-09-30T14:53:29.069860Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:29.070256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895482060972884:3461]
2025-09-30T14:53:29.070277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:29.070289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:29.070346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1212 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e755f469-8ff3fd83-af761c25-73313bc1_0
2025-09-30T14:53:29.070546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1212 sessionId: src_id|e755f469-8ff3fd83-af761c25-73313bc1_0 is DEAD
2025-09-30T14:53:29.070716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e755f469-8ff3fd83-af761c25-73313bc1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:29.070727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e755f469-8ff3fd83-af761c25-73313bc1_0] Write session will restart in 0.005451s
2025-09-30T14:53:29.070760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e755f469-8ff3fd83-af761c25-73313bc1_0] Write session: Do CDS request
2025-09-30T14:53:29.070766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e755f469-8ff3fd83-af761c25-73313bc1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:29.077787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e755f469-8ff3fd83-af761c25-73313bc1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:29.077896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:29.077911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1213
2025-09-30T14:53:29.078044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1213 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:29.078087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1213 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:29.078093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1213 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:29.078096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:29.078998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1213 sessionId:  describe result for acl check
2025-09-30T14:53:29.079032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:29.079034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:29.079036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:29.079042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895486355940212:3366] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:29.079643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895486355940212:3366] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:29.083230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895486355940212:3366] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:29.088165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895486355940212:3366] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:29.088181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895486355940212:3366] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:29.088185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895486355940212:3366] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:29.088193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1213 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:29.095265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:29.098391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:29.098599Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:29.098616Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:29.098628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:29.098685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:29.098724Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895486266191254:7626]
2025-09-30T14:53:29.099456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:29.099775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:29.099822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:29.100163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:29.100232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:29.100238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:29.100239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:29.100240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:29.100241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:29.100242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:29.100244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:29.100245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:29.100246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:29.100247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:29.100248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.100249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.100251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.100252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:29.100254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:29.100259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:29.100270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:29.100274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:29.100279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:29.100282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:29.100286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:29.100291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:29.100294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:29.100298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:29.100302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:29.100305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.100309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.100313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.100317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:29.100322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:29.100330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:29.100339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:29.100345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:29.100351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:29.100356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:29.100362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:29.100367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:29.100373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:29.100386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:29.100392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:29.100397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:29.100402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:29.100411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:29.100417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:29.100423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:29.100430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:29.100435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:29.100440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:29.100445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:29.100451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:29.100458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.100467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.100471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.100477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.100482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.100487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.100491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:29.100501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:29.100509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:29.100514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:29.100557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:29.106319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:29.107470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:29.107489Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:29.107492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:29.107496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:29.107504Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1212 [2:7555895486266191254:7626]
2025-09-30T14:53:29.107520Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:29.107536Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:29.107544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:29.107547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:29.107550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:29.107566Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:29.107573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:29.107585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:29.107650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.107658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.107661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.107664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:29.107667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:29.107733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:29.107740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.107754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.107771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.107792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:29.107815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895486355940188:2454], now have 1 active actors on pipe
2025-09-30T14:53:29.107828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895486355940388:3366], now have 1 active actors on pipe
2025-09-30T14:53:29.107834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895486266191249:7626]
2025-09-30T14:53:29.107837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895486266191249:7626]
2025-09-30T14:53:29.107839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895486266191249:7626]
2025-09-30T14:53:29.107855Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:29.107871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:29.107873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:29.107877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:29.107880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:29.107886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:29.107889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:29.107869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1212
2025-09-30T14:53:29.107877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1212
2025-09-30T14:53:29.107926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895486266191249:7626]
2025-09-30T14:53:29.107938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:29.107946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:29.107955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:29.107959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:29.108277Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6243d4b3-d2796401-d3eb9011-8c10fbc8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:29.108292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:29.108297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:29.108299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:29.108309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:29.108319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:29.108344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:29.108547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:29.108556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:29.108570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:29.108670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1213 partition: 0 MaxSeqNo: 42 sessionId: src_id|6243d4b3-d2796401-d3eb9011-8c10fbc8_0
2025-09-30T14:53:29.109067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e755f469-8ff3fd83-af761c25-73313bc1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6243d4b3-d2796401-d3eb9011-8c10fbc8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:29.111785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6243d4b3-d2796401-d3eb9011-8c10fbc8_0] Write session: try to update token
2025-09-30T14:53:29.111802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6243d4b3-d2796401-d3eb9011-8c10fbc8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:29.120419Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:29.120436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:29.120439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:29.120442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:29.120451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895486266191249:7626]
2025-09-30T14:53:29.120456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895486266191249:7626]
2025-09-30T14:53:29.120460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895486266191249:7626]
2025-09-30T14:53:29.120497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:29.120503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.120506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:29.120533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:29.120546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:29.120551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:29.120649Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:29.135086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1213 sessionId: src_id|6243d4b3-d2796401-d3eb9011-8c10fbc8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:29.137895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:29.171335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895486355940493:3461]
2025-09-30T14:53:29.171557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1212, pipe: [1:7555895486355940493:3461]
2025-09-30T14:53:29.239406Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:29.239884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:29.239900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:29.239919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895486355940493:3461], now have 1 active actors on pipe
2025-09-30T14:53:29.240172Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:29.243380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:29.243386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:29.243390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:29.243471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1213 reason: error at write: Disconnected sessionId: src_id|6243d4b3-d2796401-d3eb9011-8c10fbc8_0
2025-09-30T14:53:29.243559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895486355940493:3461]
2025-09-30T14:53:29.243674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1213 sessionId: src_id|6243d4b3-d2796401-d3eb9011-8c10fbc8_0 is DEAD
2025-09-30T14:53:29.243827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6243d4b3-d2796401-d3eb9011-8c10fbc8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:29.243837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6243d4b3-d2796401-d3eb9011-8c10fbc8_0] Write session will restart in 0.006091s
2025-09-30T14:53:29.243862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6243d4b3-d2796401-d3eb9011-8c10fbc8_0] Write session: Do CDS request
2025-09-30T14:53:29.243870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6243d4b3-d2796401-d3eb9011-8c10fbc8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:29.250799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6243d4b3-d2796401-d3eb9011-8c10fbc8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:29.250890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:29.250907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1214
2025-09-30T14:53:29.251026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1214 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:29.251060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1214 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:29.251065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1214 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:29.251069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:29.251509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1214 sessionId:  describe result for acl check
2025-09-30T14:53:29.251552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:29.251559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:29.251561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:29.251566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895486355940523:3357] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:29.252124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895486355940523:3357] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:29.254911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895486355940523:3357] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:29.258872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895486355940523:3357] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:29.258889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895486355940523:3357] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:29.258892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895486355940523:3357] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:29.258899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1214 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:29.266206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:29.269317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:29.269603Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:29.269621Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:29.269634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:29.269701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:29.269745Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895486266191563:7630]
2025-09-30T14:53:29.270451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:29.270841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:29.270902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:29.271238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:29.271335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:29.271346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:29.271347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:29.271349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:29.271350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:29.271351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:29.271352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:29.271354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:29.271355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:29.271356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:29.271357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.271359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.271360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.271361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:29.271362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:29.271369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:29.271378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:29.271382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:29.271386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:29.271389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:29.271393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:29.271396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:29.271399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:29.271403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:29.271407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:29.271410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.271414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.271417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.271421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:29.271425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:29.271435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:29.271443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:29.271450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:29.271455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:29.271460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:29.271465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:29.271469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:29.271474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:29.271480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:29.271484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:29.271489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:29.271494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:29.271498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:29.271503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:29.271507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:29.271513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:29.271517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:29.271523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:29.271527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:29.271531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:29.271536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.271541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.271545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.271550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.271555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.271559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.271563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:29.271569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:29.271574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:29.271579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:29.271620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:29.279863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:29.280748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:29.280764Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:29.280766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:29.280769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:29.280775Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1213 [2:7555895486266191563:7630]
2025-09-30T14:53:29.280788Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:29.280802Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:29.280804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:29.280807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:29.280809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:29.280822Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:29.280827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:29.280833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:29.280880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.280886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.280887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.280890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:29.280893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:29.280952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:29.280960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.280969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.280976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.280986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:29.280999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895486266191558:7630]
2025-09-30T14:53:29.281004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895486266191558:7630]
2025-09-30T14:53:29.281006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895486266191558:7630]
2025-09-30T14:53:29.281013Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:29.281028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:29.281035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:29.281040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:29.281042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:29.281044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:29.281046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:29.281049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895486355940659:3357], now have 1 active actors on pipe
2025-09-30T14:53:29.281052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895486355940507:2454], now have 1 active actors on pipe
2025-09-30T14:53:29.281147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1213
2025-09-30T14:53:29.281152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1213
2025-09-30T14:53:29.281335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895486266191558:7630]
2025-09-30T14:53:29.281347Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:29.281374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:29.281381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:29.281381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:29.281411Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8600c48-2e48f421-e60ac724-68bc8263_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:29.281421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:29.281423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:29.281425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:29.281432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:29.281438Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:29.281462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:29.281622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:29.281631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:29.281646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:29.281761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1214 partition: 0 MaxSeqNo: 42 sessionId: src_id|f8600c48-2e48f421-e60ac724-68bc8263_0
2025-09-30T14:53:29.282150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6243d4b3-d2796401-d3eb9011-8c10fbc8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f8600c48-2e48f421-e60ac724-68bc8263_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:29.284919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8600c48-2e48f421-e60ac724-68bc8263_0] Write session: try to update token
2025-09-30T14:53:29.284938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8600c48-2e48f421-e60ac724-68bc8263_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:29.296201Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:29.296221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:29.296223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:29.296225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:29.296235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895486266191558:7630]
2025-09-30T14:53:29.296240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895486266191558:7630]
2025-09-30T14:53:29.296244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895486266191558:7630]
2025-09-30T14:53:29.296285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:29.296286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:29.296290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:29.296293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.296294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:29.296296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:29.296431Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:29.302241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1214 sessionId: src_id|f8600c48-2e48f421-e60ac724-68bc8263_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:29.305150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:29.343686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895486355940812:3461]
2025-09-30T14:53:29.343958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1213, pipe: [1:7555895486355940812:3461]
2025-09-30T14:53:29.417269Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:29.417654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:29.417670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:29.417703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895486355940812:3461], now have 1 active actors on pipe
2025-09-30T14:53:29.417876Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:29.417941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:29.417943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895486355940812:3461]
2025-09-30T14:53:29.417958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:29.417961Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:29.418019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1214 reason: error at write: Disconnected sessionId: src_id|f8600c48-2e48f421-e60ac724-68bc8263_0
2025-09-30T14:53:29.418245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1214 sessionId: src_id|f8600c48-2e48f421-e60ac724-68bc8263_0 is DEAD
2025-09-30T14:53:29.418343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8600c48-2e48f421-e60ac724-68bc8263_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:29.418353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8600c48-2e48f421-e60ac724-68bc8263_0] Write session will restart in 0.007165s
2025-09-30T14:53:29.418376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8600c48-2e48f421-e60ac724-68bc8263_0] Write session: Do CDS request
2025-09-30T14:53:29.418383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8600c48-2e48f421-e60ac724-68bc8263_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:29.426819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8600c48-2e48f421-e60ac724-68bc8263_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:29.426900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:29.426917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1215
2025-09-30T14:53:29.427065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1215 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:29.427112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1215 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:29.427124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1215 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:29.427129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:29.427546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1215 sessionId:  describe result for acl check
2025-09-30T14:53:29.427576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:29.427578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:29.427579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:29.427587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895486355940841:3351] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:29.428133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895486355940841:3351] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:29.431181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895486355940841:3351] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:29.434477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895486355940841:3351] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:29.434493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895486355940841:3351] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:29.434496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895486355940841:3351] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:29.434505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1215 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:29.440522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:29.443848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:29.444054Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:29.444063Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:29.444073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:29.444122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:29.444159Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895486266191859:7632]
2025-09-30T14:53:29.444825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:29.445109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:29.445153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:29.445485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:29.445542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:29.445547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:29.445549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:29.445550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:29.445551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:29.445552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:29.445554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:29.445555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:29.445556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:29.445557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:29.445558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.445560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.445561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.445562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:29.445563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:29.445568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:29.445579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:29.445584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:29.445588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:29.445592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:29.445597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:29.445601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:29.445605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:29.445609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:29.445613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:29.445618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.445622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.445626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.445630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:29.445634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:29.445643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:29.445651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:29.445657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:29.445663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:29.445667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:29.445672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:29.445677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:29.445682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:29.445687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:29.445692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:29.445697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:29.445702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:29.445707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:29.445711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:29.445715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:29.445719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:29.445727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:29.445732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:29.445736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:29.445742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:29.445748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.445756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.445760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.445764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.445768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.445773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.445777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:29.445783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:29.445788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:29.445793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:29.445850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:29.451435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:29.452786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:29.452801Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:29.452804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:29.452808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:29.452815Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1214 [2:7555895486266191859:7632]
2025-09-30T14:53:29.452833Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:29.452848Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:29.452855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:29.452858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:29.452861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:29.452876Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:29.452887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:29.452894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:29.452956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.452963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.452965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.452969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:29.452971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:29.453038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:29.453049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.453062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.453072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.453087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:29.453102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895486266191854:7632]
2025-09-30T14:53:29.453105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895486266191854:7632]
2025-09-30T14:53:29.453107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895486266191854:7632]
2025-09-30T14:53:29.453116Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:29.453134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:29.453151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:29.453158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:29.453188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895486266191854:7632]
2025-09-30T14:53:29.453192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:29.453195Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:29.453208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:29.453215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:29.453222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:29.453227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895486355940990:3351], now have 1 active actors on pipe
2025-09-30T14:53:29.453234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895486355940813:2454], now have 1 active actors on pipe
2025-09-30T14:53:29.453324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1214
2025-09-30T14:53:29.453344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1214
2025-09-30T14:53:29.453360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:29.453369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:29.453397Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7207fc2f-3d4cbaa6-3c850d7-c6852ea4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:29.453407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:29.453411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:29.453413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:29.453422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:29.453432Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:29.453447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:29.453642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:29.453668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:29.453691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:29.453808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1215 partition: 0 MaxSeqNo: 42 sessionId: src_id|7207fc2f-3d4cbaa6-3c850d7-c6852ea4_0
2025-09-30T14:53:29.454249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8600c48-2e48f421-e60ac724-68bc8263_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7207fc2f-3d4cbaa6-3c850d7-c6852ea4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:29.456984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7207fc2f-3d4cbaa6-3c850d7-c6852ea4_0] Write session: try to update token
2025-09-30T14:53:29.457001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7207fc2f-3d4cbaa6-3c850d7-c6852ea4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:29.465679Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:29.465697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:29.465706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895486266191854:7632]
2025-09-30T14:53:29.465748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:29.465755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:29.465924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:29.466100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:29.466244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:29.466381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:29.466583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:29.466627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:29.473641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1215 sessionId: src_id|7207fc2f-3d4cbaa6-3c850d7-c6852ea4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:29.476474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:29.477137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:29.477163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:29.477183Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:29.477186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:29.477188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:29.477190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:29.477199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895486266191854:7632]
2025-09-30T14:53:29.477202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895486266191854:7632]
2025-09-30T14:53:29.477206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895486266191854:7632]
2025-09-30T14:53:29.477248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:29.477257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:29.477261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:29.477263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.477264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:29.477266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:29.477399Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:29.518285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895486355941143:3461]
2025-09-30T14:53:29.518546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1214, pipe: [1:7555895486355941143:3461]
2025-09-30T14:53:29.589218Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:29.589681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:29.589716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895486355941143:3461], now have 1 active actors on pipe
2025-09-30T14:53:29.589817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:29.589972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895486355941143:3461]
2025-09-30T14:53:29.590001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:29.601992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:29.602008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:29.602031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1215 reason: error at write: Disconnected sessionId: src_id|7207fc2f-3d4cbaa6-3c850d7-c6852ea4_0
2025-09-30T14:53:29.602180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1215 sessionId: src_id|7207fc2f-3d4cbaa6-3c850d7-c6852ea4_0 is DEAD
2025-09-30T14:53:29.602344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7207fc2f-3d4cbaa6-3c850d7-c6852ea4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:29.602355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7207fc2f-3d4cbaa6-3c850d7-c6852ea4_0] Write session will restart in 0.008437s
2025-09-30T14:53:29.602379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7207fc2f-3d4cbaa6-3c850d7-c6852ea4_0] Write session: Do CDS request
2025-09-30T14:53:29.602393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7207fc2f-3d4cbaa6-3c850d7-c6852ea4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:29.611897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7207fc2f-3d4cbaa6-3c850d7-c6852ea4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:29.612002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:29.612021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1216
2025-09-30T14:53:29.612153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1216 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:29.612184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1216 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:29.612189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1216 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:29.612193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:29.612623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1216 sessionId:  describe result for acl check
2025-09-30T14:53:29.612658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:29.612664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:29.612666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:29.612682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895486355941229:3330] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:29.613721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895486355941229:3330] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:29.617816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895486355941229:3330] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:29.620913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895486355941229:3330] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:29.620929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895486355941229:3330] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:29.620933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895486355941229:3330] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:29.620956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1216 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:29.625545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:29.626161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:29.626368Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:29.626379Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:29.626391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:29.626449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:29.626493Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895486266192193:7646]
2025-09-30T14:53:29.627139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:29.627492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:29.627539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:29.627863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:29.627928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:29.627934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:29.627935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:29.627937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:29.627938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:29.627939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:29.627940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:29.627942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:29.627943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:29.627945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:29.627946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.627947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.627949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.627950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:29.627951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:29.627957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:29.627968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:29.627973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:29.627978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:29.627981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:29.627986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:29.627990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:29.627994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:29.627998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:29.628003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:29.628007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.628011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.628015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.628019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:29.628022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:29.628030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:29.628038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:29.628044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:29.628055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:29.628061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:29.628067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:29.628072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:29.628077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:29.628083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:29.628088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:29.628093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:29.628102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:29.628107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:29.628112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:29.628122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:29.628127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:29.628138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:29.628143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:29.628147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:29.628153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:29.628158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.628163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.628168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.628173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.628178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.628183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.628188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:29.628198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:29.628204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:29.628210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:29.628272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:29.633797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:29.635423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:29.635437Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:29.635439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:29.635443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:29.635450Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1215 [2:7555895486266192193:7646]
2025-09-30T14:53:29.635468Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:29.635483Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:29.635490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:29.635493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:29.635495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:29.635512Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:29.635523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:29.635530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:29.635588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.635595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.635598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.635601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:29.635604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:29.635669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:29.635681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.635696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.635710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.635729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:29.635752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895486355941436:3330], now have 1 active actors on pipe
2025-09-30T14:53:29.635760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895486355941144:2454], now have 1 active actors on pipe
2025-09-30T14:53:29.635766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895486266192188:7646]
2025-09-30T14:53:29.635768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895486266192188:7646]
2025-09-30T14:53:29.635770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895486266192188:7646]
2025-09-30T14:53:29.635782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:29.635795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:29.635802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:29.635806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:29.635809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:29.635816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:29.635819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:29.635842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1215
2025-09-30T14:53:29.635850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895486266192188:7646]
2025-09-30T14:53:29.635846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1215
2025-09-30T14:53:29.635866Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:29.635869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:29.635903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:29.635909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:29.635933Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b0ffe49-9ad0052b-db93a61c-2dc33044_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:29.635946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:29.635950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:29.635954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:29.635969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:29.635982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:29.635999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:29.636142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:29.636152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:29.636169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:29.636262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1216 partition: 0 MaxSeqNo: 42 sessionId: src_id|6b0ffe49-9ad0052b-db93a61c-2dc33044_0
2025-09-30T14:53:29.636639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7207fc2f-3d4cbaa6-3c850d7-c6852ea4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6b0ffe49-9ad0052b-db93a61c-2dc33044_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:29.639429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b0ffe49-9ad0052b-db93a61c-2dc33044_0] Write session: try to update token
2025-09-30T14:53:29.639449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b0ffe49-9ad0052b-db93a61c-2dc33044_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:29.647965Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:29.647982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:29.647985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:29.647987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:29.647997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895486266192188:7646]
2025-09-30T14:53:29.648002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895486266192188:7646]
2025-09-30T14:53:29.648007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895486266192188:7646]
2025-09-30T14:53:29.648047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:29.648055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.648058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:29.648061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:29.648069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:29.648073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:29.648194Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:29.656076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1216 sessionId: src_id|6b0ffe49-9ad0052b-db93a61c-2dc33044_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:29.658699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:29.690314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895486355941451:3461]
2025-09-30T14:53:29.690570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1215, pipe: [1:7555895486355941451:3461]
2025-09-30T14:53:29.763725Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:29.764182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:29.764195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:29.764214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895486355941451:3461], now have 1 active actors on pipe
2025-09-30T14:53:29.764448Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:29.764489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:29.764494Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:29.764506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:29.764541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895486355941451:3461]
2025-09-30T14:53:29.764557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1216 reason: error at write: Disconnected sessionId: src_id|6b0ffe49-9ad0052b-db93a61c-2dc33044_0
2025-09-30T14:53:29.764946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b0ffe49-9ad0052b-db93a61c-2dc33044_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:29.764965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b0ffe49-9ad0052b-db93a61c-2dc33044_0] Write session will restart in 0.009989s
2025-09-30T14:53:29.764989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b0ffe49-9ad0052b-db93a61c-2dc33044_0] Write session: Do CDS request
2025-09-30T14:53:29.764761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1216 sessionId: src_id|6b0ffe49-9ad0052b-db93a61c-2dc33044_0 is DEAD
2025-09-30T14:53:29.764995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b0ffe49-9ad0052b-db93a61c-2dc33044_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:29.779689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b0ffe49-9ad0052b-db93a61c-2dc33044_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:29.779785Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:29.779801Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1217
2025-09-30T14:53:29.779934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1217 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:29.779982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1217 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:29.779987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1217 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:29.779992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:29.780464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1217 sessionId:  describe result for acl check
2025-09-30T14:53:29.780491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:29.780493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:29.780495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:29.780501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895486355941536:3327] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:29.781042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895486355941536:3327] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:29.784392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895486355941536:3327] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:29.788757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895486355941536:3327] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:29.788774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895486355941536:3327] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:29.788777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895486355941536:3327] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:29.788786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1217 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:29.791492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:29.794458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:29.794660Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:29.794670Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:29.794681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:29.794735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:29.794775Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895486266192490:7649]
2025-09-30T14:53:29.795458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:29.795822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:29.795876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:29.796256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:29.796330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:29.796336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:29.796337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:29.796338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:29.796339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:29.796340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:29.796341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:29.796342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:29.796343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:29.796344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:29.796346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.796347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.796348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.796349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:29.796350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:29.796356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:29.796366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:29.796371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:29.796375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:29.796380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:29.796384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:29.796389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:29.796393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:29.796397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:29.796402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:29.796406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.796410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.796414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.796419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:29.796423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:29.796433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:29.796441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:29.796447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:29.796453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:29.796458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:29.796463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:29.796468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:29.796473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:29.796477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:29.796482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:29.796487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:29.796493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:29.796497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:29.796502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:29.796506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:29.796511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:29.796516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:29.796522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:29.796526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:29.796532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:29.796539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.796545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.796555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.796561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.796566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.796573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.796578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:29.796583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:29.796588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:29.796598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:29.796640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:29.802248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:29.803316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:29.803329Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:29.803332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:29.803336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:29.803343Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1216 [2:7555895486266192490:7649]
2025-09-30T14:53:29.803359Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:29.803376Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:29.803384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:29.803387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:29.803390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:29.803405Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:29.803412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:29.803419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:29.803481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.803489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.803492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.803495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:29.803498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:29.803573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:29.803585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.803598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.803613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.803636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:29.803659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895486355941740:3327], now have 1 active actors on pipe
2025-09-30T14:53:29.803668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895486355941452:2454], now have 1 active actors on pipe
2025-09-30T14:53:29.803675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895486266192485:7649]
2025-09-30T14:53:29.803681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895486266192485:7649]
2025-09-30T14:53:29.803684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895486266192485:7649]
2025-09-30T14:53:29.803698Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:29.803717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:29.803733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:29.803740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:29.803740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:29.803719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1216
2025-09-30T14:53:29.803746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:29.803748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:29.803773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895486266192485:7649]
2025-09-30T14:53:29.803730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1216
2025-09-30T14:53:29.803777Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:29.803781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:29.803792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:29.803797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:29.804108Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ead67508-458206db-a76e1968-82d5faf2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:29.804121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:29.804126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:29.804128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:29.804138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:29.804153Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:29.804185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:29.804353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:29.804361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:29.804375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:29.804489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1217 partition: 0 MaxSeqNo: 42 sessionId: src_id|ead67508-458206db-a76e1968-82d5faf2_0
2025-09-30T14:53:29.804886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b0ffe49-9ad0052b-db93a61c-2dc33044_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ead67508-458206db-a76e1968-82d5faf2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:29.807618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ead67508-458206db-a76e1968-82d5faf2_0] Write session: try to update token
2025-09-30T14:53:29.807636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ead67508-458206db-a76e1968-82d5faf2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:29.816268Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:29.816284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:29.816287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:29.816289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:29.816301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895486266192485:7649]
2025-09-30T14:53:29.816306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895486266192485:7649]
2025-09-30T14:53:29.816310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895486266192485:7649]
2025-09-30T14:53:29.816346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:29.816351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.816354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:29.816367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:29.816373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:29.816378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:29.816485Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:29.823698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1217 sessionId: src_id|ead67508-458206db-a76e1968-82d5faf2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:29.826575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:29.864910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895486355941759:3461]
2025-09-30T14:53:29.865190Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1216, pipe: [1:7555895486355941759:3461]
2025-09-30T14:53:29.930429Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:29.930745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:29.930759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:29.930778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895486355941759:3461], now have 1 active actors on pipe
2025-09-30T14:53:29.931044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:29.931050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895486355941759:3461]
2025-09-30T14:53:29.931061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:29.931069Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:29.931122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1217 reason: error at write: Disconnected sessionId: src_id|ead67508-458206db-a76e1968-82d5faf2_0
2025-09-30T14:53:29.931050Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:29.931351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1217 sessionId: src_id|ead67508-458206db-a76e1968-82d5faf2_0 is DEAD
2025-09-30T14:53:29.931491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ead67508-458206db-a76e1968-82d5faf2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:29.931502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ead67508-458206db-a76e1968-82d5faf2_0] Write session will restart in 0.005885s
2025-09-30T14:53:29.931524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ead67508-458206db-a76e1968-82d5faf2_0] Write session: Do CDS request
2025-09-30T14:53:29.931533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ead67508-458206db-a76e1968-82d5faf2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:29.938816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ead67508-458206db-a76e1968-82d5faf2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:29.938936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:29.938961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1218
2025-09-30T14:53:29.939090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1218 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:29.939124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1218 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:29.939135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1218 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:29.939139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:29.939607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1218 sessionId:  describe result for acl check
2025-09-30T14:53:29.939645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:29.939650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:29.939654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:29.939660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895486355941778:3319] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:29.940216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895486355941778:3319] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:29.942460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895486355941778:3319] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:29.948668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895486355941778:3319] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:29.948687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895486355941778:3319] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:29.948690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895486355941778:3319] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:29.948698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1218 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:29.955921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:29.959132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:29.959371Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:29.959383Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:29.959397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:29.959465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:29.959508Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895486266192788:7651]
2025-09-30T14:53:29.960169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:29.960519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:29.960570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:29.960937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:29.961018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:29.961025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:29.961026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:29.961027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:29.961028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:29.961030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:29.961031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:29.961032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:29.961033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:29.961035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:29.961036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.961037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.961039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.961040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:29.961041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:29.961047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:29.961057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:29.961062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:29.961066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:29.961070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:29.961074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:29.961078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:29.961082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:29.961087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:29.961091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:29.961096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.961099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.961103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.961112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:29.961116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:29.961129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:29.961142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:29.961149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:29.961165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:29.961170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:29.961176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:29.961181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:29.961186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:29.961191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:29.961196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:29.961201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:29.961206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:29.961211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:29.961216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:29.961221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:29.961226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:29.961231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:29.961236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:29.961240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:29.961246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:29.961251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.961256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.961261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.961267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.961275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.961286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.961293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:29.961299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:29.961303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:29.961308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:29.961351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:29.966916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:29.967989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:29.968001Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:29.968004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:29.968008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:29.968015Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1217 [2:7555895486266192788:7651]
2025-09-30T14:53:29.968031Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:29.968045Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:29.968052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:29.968056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:29.968058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:29.968075Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:29.968081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:29.968087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:29.968151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.968159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.968161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.968164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:29.968167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:29.968377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1217
2025-09-30T14:53:29.968416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1217
2025-09-30T14:53:29.968609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:29.968621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:29.968634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:29.968647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:29.968666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:29.968691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895486355941760:2454], now have 1 active actors on pipe
2025-09-30T14:53:29.968699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895486355941956:3319], now have 1 active actors on pipe
2025-09-30T14:53:29.968720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:29.968730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:29.968744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895486266192783:7651]
2025-09-30T14:53:29.968751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895486266192783:7651]
2025-09-30T14:53:29.968753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895486266192783:7651]
2025-09-30T14:53:29.968766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:29.968779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:29.968782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:29.968788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:29.968791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:29.968797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:29.968800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:29.968816Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4bafa23-58005ce5-175017ac-a34e9925_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:29.968823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:29.968826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:29.968828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:29.968837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:29.968847Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:29.968884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895486266192783:7651]
2025-09-30T14:53:29.968895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:29.968907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:29.968908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:29.969063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:29.969074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:29.969089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:29.969218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1218 partition: 0 MaxSeqNo: 42 sessionId: src_id|b4bafa23-58005ce5-175017ac-a34e9925_0
2025-09-30T14:53:29.969600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ead67508-458206db-a76e1968-82d5faf2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b4bafa23-58005ce5-175017ac-a34e9925_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:29.972518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4bafa23-58005ce5-175017ac-a34e9925_0] Write session: try to update token
2025-09-30T14:53:29.972539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4bafa23-58005ce5-175017ac-a34e9925_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:29.988249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1218 sessionId: src_id|b4bafa23-58005ce5-175017ac-a34e9925_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:29.991074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:29.994411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:29.994436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:29.994459Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:29.994462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:29.994471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895486266192783:7651]
2025-09-30T14:53:29.994524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:29.994527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:29.994696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:29.994854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:29.994991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:29.995127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:29.995330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:29.995376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:29.995403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:29.995503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:30.000814Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:30.000830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:30.000833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:30.000836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:30.000849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895486266192783:7651]
2025-09-30T14:53:30.000853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895486266192783:7651]
2025-09-30T14:53:30.000857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895486266192783:7651]
2025-09-30T14:53:30.000894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:30.000898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:30.000901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.000904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:30.000904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:30.000908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:30.001034Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:30.031294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895490650909369:3461]
2025-09-30T14:53:30.031613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1217, pipe: [1:7555895490650909369:3461]
2025-09-30T14:53:30.117091Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:30.125942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:30.125976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:30.126187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:30.126257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:30.126331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:30.126401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:30.126457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:30.126467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:30.126548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:30.126620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:30.126696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:30.126770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:30.126823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:30.126831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:30.126905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:30.126977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:30.127049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:30.127126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:30.127178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:30.127186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:30.127283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:30.127356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:30.127427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:30.127501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:30.127548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:30.127556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:30.127637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:30.127713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:30.127788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:30.127864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:30.127997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:30.128005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:30.128083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:30.128159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:30.128228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:30.128306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:30.128358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:30.128369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:30.128441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:30.128511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:30.128588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:30.128660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:30.128713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:30.128721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:30.128793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:30.128868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:30.128942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:30.129018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:30.129070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:30.129078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:30.129155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:30.129226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:30.129291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:30.129370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:30.129508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:30.129520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:30.129592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:30.129662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:30.129730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:30.129800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:30.129849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:30.129857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:30.129934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895490650909369:3461], now have 1 active actors on pipe
2025-09-30T14:53:30.130271Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:30.130322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:30.130327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895490650909369:3461]
2025-09-30T14:53:30.130336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:30.130369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1218 reason: error at write: Disconnected sessionId: src_id|b4bafa23-58005ce5-175017ac-a34e9925_0
2025-09-30T14:53:30.130582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1218 sessionId: src_id|b4bafa23-58005ce5-175017ac-a34e9925_0 is DEAD
2025-09-30T14:53:30.130760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4bafa23-58005ce5-175017ac-a34e9925_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:30.130770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4bafa23-58005ce5-175017ac-a34e9925_0] Write session will restart in 0.007640s
2025-09-30T14:53:30.130804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4bafa23-58005ce5-175017ac-a34e9925_0] Write session: Do CDS request
2025-09-30T14:53:30.130810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4bafa23-58005ce5-175017ac-a34e9925_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:30.131341Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:30.139797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4bafa23-58005ce5-175017ac-a34e9925_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:30.139943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:30.139961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1219
2025-09-30T14:53:30.140119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1219 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:30.140166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1219 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:30.140179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1219 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:30.140183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:30.140655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1219 sessionId:  describe result for acl check
2025-09-30T14:53:30.140696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:30.140705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:30.140707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:30.140713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895490650909389:3318] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:30.141294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895490650909389:3318] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:30.144120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895490650909389:3318] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:30.152341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895490650909389:3318] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:30.152361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895490650909389:3318] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:30.152365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895490650909389:3318] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:30.152374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1219 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:30.160802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:30.164603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:30.165035Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:30.165049Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:30.165064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:30.165142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:30.165195Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895490561160385:7653]
2025-09-30T14:53:30.165864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:30.166227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:30.166277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:30.166638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:30.166713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:30.166719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:30.166721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:30.166722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:30.166723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:30.166724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:30.166726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:30.166727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:30.166729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:30.166730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:30.166731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.166732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:30.166734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:30.166735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:30.166736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:30.166741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:30.166752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:30.166756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:30.166760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:30.166765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:30.166769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:30.166773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:30.166777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:30.166780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:30.166785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:30.166788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.166792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:30.166796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:30.166800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:30.166804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:30.166813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:30.166821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:30.166827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:30.166833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:30.166838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:30.166844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:30.166848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:30.166853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:30.166858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:30.166864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:30.166868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:30.166874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:30.166878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:30.166884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:30.166888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:30.166894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:30.166899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:30.166905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:30.166910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:30.166915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:30.166922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.166928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.166932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:30.166937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:30.166947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:30.166951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:30.166957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:30.166968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:30.166972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:30.166976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:30.167016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:30.172791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:30.174016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:30.174032Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:30.174034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:30.174038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:30.174044Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1218 [2:7555895490561160385:7653]
2025-09-30T14:53:30.174069Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:30.174085Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:30.174088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:30.174091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:30.174094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:30.174112Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:30.174119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:30.174125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:30.174357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1218
2025-09-30T14:53:30.174380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1218
2025-09-30T14:53:30.174188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.174198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:30.174199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:30.174202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:30.174205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:30.174266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:30.174268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.174280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:30.174290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:30.174306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:30.174325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895490650909551:3318], now have 1 active actors on pipe
2025-09-30T14:53:30.174328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895490650909374:2454], now have 1 active actors on pipe
2025-09-30T14:53:30.174335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895490561160380:7653]
2025-09-30T14:53:30.174337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895490561160380:7653]
2025-09-30T14:53:30.174339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895490561160380:7653]
2025-09-30T14:53:30.174348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:30.174357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:30.174360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:30.174362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:30.174362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:30.174377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:30.174380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:30.174413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895490561160380:7653]
2025-09-30T14:53:30.174416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:30.174428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:30.174434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:30.174439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:30.174492Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c94589cb-f4d8df8c-92b8fd3e-e7e4e26a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:30.174499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:30.174502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:30.174505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:30.174513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:30.174523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:30.174540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:30.174806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:30.174818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:30.174839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:30.174946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1219 partition: 0 MaxSeqNo: 42 sessionId: src_id|c94589cb-f4d8df8c-92b8fd3e-e7e4e26a_0
2025-09-30T14:53:30.175349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4bafa23-58005ce5-175017ac-a34e9925_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c94589cb-f4d8df8c-92b8fd3e-e7e4e26a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:30.178459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c94589cb-f4d8df8c-92b8fd3e-e7e4e26a_0] Write session: try to update token
2025-09-30T14:53:30.178482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c94589cb-f4d8df8c-92b8fd3e-e7e4e26a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:30.187392Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:30.187405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:30.187407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:30.187410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:30.187417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895490561160380:7653]
2025-09-30T14:53:30.187421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895490561160380:7653]
2025-09-30T14:53:30.187425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895490561160380:7653]
2025-09-30T14:53:30.187467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:30.187474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.187475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:30.187477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:30.187483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:30.187488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:30.187622Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:30.195430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1219 sessionId: src_id|c94589cb-f4d8df8c-92b8fd3e-e7e4e26a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:30.198552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:30.230494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895490650909695:3461]
2025-09-30T14:53:30.231334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1218, pipe: [1:7555895490650909695:3461]
2025-09-30T14:53:30.300786Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:30.301305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:30.301324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:30.301343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895490650909695:3461], now have 1 active actors on pipe
2025-09-30T14:53:30.301591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:30.301611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:30.301629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895490650909695:3461]
2025-09-30T14:53:30.301650Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:30.301674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1219 reason: error at write: Disconnected sessionId: src_id|c94589cb-f4d8df8c-92b8fd3e-e7e4e26a_0
2025-09-30T14:53:30.301733Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:30.301887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1219 sessionId: src_id|c94589cb-f4d8df8c-92b8fd3e-e7e4e26a_0 is DEAD
2025-09-30T14:53:30.302305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c94589cb-f4d8df8c-92b8fd3e-e7e4e26a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:30.302330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c94589cb-f4d8df8c-92b8fd3e-e7e4e26a_0] Write session will restart in 0.007362s
2025-09-30T14:53:30.302353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c94589cb-f4d8df8c-92b8fd3e-e7e4e26a_0] Write session: Do CDS request
2025-09-30T14:53:30.302362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c94589cb-f4d8df8c-92b8fd3e-e7e4e26a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:30.310752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c94589cb-f4d8df8c-92b8fd3e-e7e4e26a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:30.310909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:30.310929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1220
2025-09-30T14:53:30.311076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1220 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:30.311118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1220 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:30.311128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1220 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:30.311148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:30.311614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1220 sessionId:  describe result for acl check
2025-09-30T14:53:30.311651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:30.311658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:30.311660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:30.311667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895490650909721:3313] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:30.312242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895490650909721:3313] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:30.315390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895490650909721:3313] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:30.319151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895490650909721:3313] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:30.319178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895490650909721:3313] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:30.319181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895490650909721:3313] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:30.319189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1220 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:30.324390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:30.327842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:30.328065Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:30.328080Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:30.328091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:30.328142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:30.328181Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895490561160697:7657]
2025-09-30T14:53:30.328845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:30.329164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:30.329208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:30.329487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:30.329548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:30.329554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:30.329555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:30.329557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:30.329558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:30.329559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:30.329561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:30.329562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:30.329564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:30.329565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:30.329566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.329568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:30.329570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:30.329571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:30.329572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:30.329578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:30.329588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:30.329593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:30.329596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:30.329598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:30.329600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:30.329603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:30.329605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:30.329607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:30.329610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:30.329613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.329615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:30.329618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:30.329620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:30.329623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:30.329630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:30.329635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:30.329639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:30.329644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:30.329647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:30.329650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:30.329652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:30.329655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:30.329658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:30.329661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:30.329663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:30.329666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:30.329668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:30.329671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:30.329673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:30.329676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:30.329679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:30.329682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:30.329687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:30.329692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:30.329696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.329701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.329705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:30.329709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:30.329714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:30.329719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:30.329723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:30.329728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:30.329732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:30.329737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:30.329782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:30.335656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:30.336782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:30.336797Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:30.336800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:30.336804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:30.336813Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1219 [2:7555895490561160697:7657]
2025-09-30T14:53:30.336831Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:30.336848Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:30.336855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:30.336859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:30.336862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:30.336881Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:30.336895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:30.336902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:30.336963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.336970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:30.336972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:30.336975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:30.336978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:30.337054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:30.337061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.337074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:30.337086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:30.337105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:30.337125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895490561160692:7657]
2025-09-30T14:53:30.337128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895490561160692:7657]
2025-09-30T14:53:30.337129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895490561160692:7657]
2025-09-30T14:53:30.337145Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:30.337164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895490650909696:2454], now have 1 active actors on pipe
2025-09-30T14:53:30.337172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895490650909889:3313], now have 1 active actors on pipe
2025-09-30T14:53:30.337180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:30.337181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:30.337186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:30.337188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:30.337199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:30.337202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:30.337248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895490561160692:7657]
2025-09-30T14:53:30.337260Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:30.337266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:30.337273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1219
2025-09-30T14:53:30.337317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:30.337327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:30.337336Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1219
2025-09-30T14:53:30.337352Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3614858-e5a6edd4-35f88716-31d81bf1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:30.337365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:30.337369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:30.337371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:30.337382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:30.337392Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:30.337410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:30.337577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:30.337592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:30.337629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:30.337725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1220 partition: 0 MaxSeqNo: 42 sessionId: src_id|c3614858-e5a6edd4-35f88716-31d81bf1_0
2025-09-30T14:53:30.338084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c94589cb-f4d8df8c-92b8fd3e-e7e4e26a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c3614858-e5a6edd4-35f88716-31d81bf1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:30.341171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3614858-e5a6edd4-35f88716-31d81bf1_0] Write session: try to update token
2025-09-30T14:53:30.341193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3614858-e5a6edd4-35f88716-31d81bf1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:30.349701Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:30.349721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:30.349732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895490561160692:7657]
2025-09-30T14:53:30.349778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:30.349778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:30.349955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:30.350274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:30.350490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:30.350642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:30.350865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:30.350914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:30.356992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1220 sessionId: src_id|c3614858-e5a6edd4-35f88716-31d81bf1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:30.359769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:30.360005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:30.360023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:30.361194Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:30.361206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:30.361208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:30.361209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:30.361217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895490561160692:7657]
2025-09-30T14:53:30.361220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895490561160692:7657]
2025-09-30T14:53:30.361223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895490561160692:7657]
2025-09-30T14:53:30.361255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:30.361265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:30.361273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:30.361276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:30.361280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.361281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:30.361282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:30.361413Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:30.361399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:30.401992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895490650910007:3461]
2025-09-30T14:53:30.402287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1219, pipe: [1:7555895490650910007:3461]
2025-09-30T14:53:30.478078Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:30.487215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:30.487262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:30.487445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:30.487512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:30.487589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:30.487657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:30.487712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:30.487723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:30.487794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:30.487857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:30.487925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:30.487999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:30.488047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:30.488054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:30.488125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:30.488189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:30.488252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:30.488322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:30.488369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:30.488375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:30.488449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:30.488520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:30.488590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:30.488652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:30.488698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:30.488706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:30.488776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:30.488840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:30.488907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:30.488977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:30.489023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:30.489030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:30.489102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:30.489170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:30.489234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:30.489299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:30.489370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:30.489375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:30.489444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:30.489511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:30.489579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:30.489640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:30.489682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:30.489687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:30.489749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:30.489806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:30.489864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:30.489928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:30.489970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:30.489980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:30.490073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:30.490139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:30.490206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:30.490271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:30.490321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:30.490328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:30.490399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:30.490463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:30.490530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:30.490600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:30.490649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:30.490656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:30.490725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895490650910007:3461], now have 1 active actors on pipe
2025-09-30T14:53:30.490991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:30.490998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895490650910007:3461]
2025-09-30T14:53:30.491040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:30.491043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:30.491083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1220 reason: error at write: Disconnected sessionId: src_id|c3614858-e5a6edd4-35f88716-31d81bf1_0
2025-09-30T14:53:30.491303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1220 sessionId: src_id|c3614858-e5a6edd4-35f88716-31d81bf1_0 is DEAD
2025-09-30T14:53:30.491487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3614858-e5a6edd4-35f88716-31d81bf1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:30.491499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3614858-e5a6edd4-35f88716-31d81bf1_0] Write session will restart in 0.007453s
2025-09-30T14:53:30.491535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3614858-e5a6edd4-35f88716-31d81bf1_0] Write session: Do CDS request
2025-09-30T14:53:30.491541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3614858-e5a6edd4-35f88716-31d81bf1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:30.491966Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:30.499808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3614858-e5a6edd4-35f88716-31d81bf1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:30.499882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:30.499898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1221
2025-09-30T14:53:30.500126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1221 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:30.500159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1221 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:30.500172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1221 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:30.500176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:30.500754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1221 sessionId:  describe result for acl check
2025-09-30T14:53:30.500791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:30.500793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:30.500795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:30.500801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895490650910033:3309] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:30.501353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895490650910033:3309] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:30.505463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895490650910033:3309] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:30.509532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895490650910033:3309] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:30.509553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895490650910033:3309] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:30.509556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895490650910033:3309] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:30.509566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1221 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:30.517039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:30.520485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:30.520747Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:30.520757Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:30.520769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:30.520837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:30.520878Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895490561161011:7659]
2025-09-30T14:53:30.521516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:30.521883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:30.521936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:30.522292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:30.522580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:30.522589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:30.522590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:30.522591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:30.522594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:30.522596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:30.522597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:30.522598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:30.522599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:30.522600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:30.522601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.522603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:30.522604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:30.522605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:30.522606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:30.522613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:30.522623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:30.522627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:30.522631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:30.522635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:30.522638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:30.522642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:30.522646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:30.522650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:30.522654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:30.522658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.522662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:30.522665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:30.522669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:30.522671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:30.522680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:30.522687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:30.522693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:30.522699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:30.522703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:30.522708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:30.522712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:30.522717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:30.522726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:30.522731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:30.522736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:30.522741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:30.522749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:30.522754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:30.522758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:30.522763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:30.522768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:30.522773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:30.522777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:30.522782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:30.522789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.522800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.522804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:30.522811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:30.522820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:30.522825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:30.522829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:30.522839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:30.522844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:30.522849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:30.522895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:30.528718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:30.529804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:30.529821Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:30.529823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:30.529827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:30.529834Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1220 [2:7555895490561161011:7659]
2025-09-30T14:53:30.529848Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:30.529863Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:30.529866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:30.529872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:30.529874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:30.529889Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:30.529895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:30.529907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:30.529964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.529972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:30.529974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:30.529977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:30.529980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:30.530047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:30.530073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.530086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:30.530097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:30.530114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:30.530137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895490650910198:3309], now have 1 active actors on pipe
2025-09-30T14:53:30.530145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895490650910009:2454], now have 1 active actors on pipe
2025-09-30T14:53:30.530152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895490561161006:7659]
2025-09-30T14:53:30.530159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895490561161006:7659]
2025-09-30T14:53:30.530161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895490561161006:7659]
2025-09-30T14:53:30.530174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:30.530188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:30.530188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:30.530191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:30.530193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:30.530207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:30.530211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:30.530229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1220
2025-09-30T14:53:30.530267Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1220
2025-09-30T14:53:30.530245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895490561161006:7659]
2025-09-30T14:53:30.530257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:30.530259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:30.530282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:30.530287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:30.530326Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3eead98-8edc5b85-b1d99ef6-f61f450d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:30.530339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:30.530343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:30.530345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:30.530353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:30.530364Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:30.530390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:30.530618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:30.530626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:30.530640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:30.530743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1221 partition: 0 MaxSeqNo: 42 sessionId: src_id|d3eead98-8edc5b85-b1d99ef6-f61f450d_0
2025-09-30T14:53:30.531138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3614858-e5a6edd4-35f88716-31d81bf1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d3eead98-8edc5b85-b1d99ef6-f61f450d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:30.533966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3eead98-8edc5b85-b1d99ef6-f61f450d_0] Write session: try to update token
2025-09-30T14:53:30.533984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3eead98-8edc5b85-b1d99ef6-f61f450d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:30.549587Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:30.549608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:30.549610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:30.549612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:30.549621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895490561161006:7659]
2025-09-30T14:53:30.549625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895490561161006:7659]
2025-09-30T14:53:30.549629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895490561161006:7659]
2025-09-30T14:53:30.549675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:30.549682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.549685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:30.549825Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:30.549952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1221 sessionId: src_id|d3eead98-8edc5b85-b1d99ef6-f61f450d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:30.551452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:30.551469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:30.551486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:30.552816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:30.591437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895490650910344:3461]
2025-09-30T14:53:30.591726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1220, pipe: [1:7555895490650910344:3461]
2025-09-30T14:53:30.666906Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:30.667181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:30.667195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:30.667234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895490650910344:3461], now have 1 active actors on pipe
2025-09-30T14:53:30.667481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895490650910344:3461]
2025-09-30T14:53:30.667492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:30.667496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:30.667523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:30.667570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1221 reason: error at write: Disconnected sessionId: src_id|d3eead98-8edc5b85-b1d99ef6-f61f450d_0
2025-09-30T14:53:30.667787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1221 sessionId: src_id|d3eead98-8edc5b85-b1d99ef6-f61f450d_0 is DEAD
2025-09-30T14:53:30.667974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3eead98-8edc5b85-b1d99ef6-f61f450d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:30.667985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3eead98-8edc5b85-b1d99ef6-f61f450d_0] Write session will restart in 0.007654s
2025-09-30T14:53:30.668012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3eead98-8edc5b85-b1d99ef6-f61f450d_0] Write session: Do CDS request
2025-09-30T14:53:30.668018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3eead98-8edc5b85-b1d99ef6-f61f450d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:30.667508Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:30.676803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3eead98-8edc5b85-b1d99ef6-f61f450d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:30.676845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:30.676861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1222
2025-09-30T14:53:30.677017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1222 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:30.677047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1222 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:30.677052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1222 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:30.677057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:30.677570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1222 sessionId:  describe result for acl check
2025-09-30T14:53:30.677605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:30.677612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:30.677614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:30.677620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895490650910360:3292] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:30.678535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895490650910360:3292] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:30.680410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895490650910360:3292] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:30.689632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895490650910360:3292] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:30.689653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895490650910360:3292] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:30.689659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895490650910360:3292] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:30.689669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1222 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:30.697880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:30.701119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:30.701344Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:30.701353Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:30.701362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:30.701411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:30.701452Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895490561161339:7674]
2025-09-30T14:53:30.702111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:30.702472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:30.702514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:30.702855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:30.702924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:30.702932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:30.702933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:30.702934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:30.702935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:30.702936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:30.702937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:30.702938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:30.702939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:30.702941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:30.702942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.702943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:30.702944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:30.702945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:30.702946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:30.702952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:30.702963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:30.702967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:30.702971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:30.702975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:30.702980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:30.702984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:30.702988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:30.702992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:30.702996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:30.703000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.703004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:30.703008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:30.703012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:30.703016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:30.703023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:30.703031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:30.703038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:30.703045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:30.703050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:30.703056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:30.703060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:30.703066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:30.703074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:30.703080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:30.703085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:30.703090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:30.703095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:30.703100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:30.703104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:30.703109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:30.703113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:30.703118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:30.703122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:30.703127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:30.703133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.703138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.703142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:30.703146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:30.703151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:30.703155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:30.703159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:30.703164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:30.703168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:30.703173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:30.703217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:30.709704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:30.710934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:30.710952Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:30.710954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:30.710958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:30.710966Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1221 [2:7555895490561161339:7674]
2025-09-30T14:53:30.710983Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:30.710998Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:30.711001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:30.711005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:30.711007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:30.711024Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:30.711031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:30.711038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:30.711105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.711114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:30.711116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:30.711120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:30.711122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:30.711191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:30.711198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.711213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:30.711227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:30.711266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:30.711295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895490650910345:2454], now have 1 active actors on pipe
2025-09-30T14:53:30.711299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895490650910531:3292], now have 1 active actors on pipe
2025-09-30T14:53:30.711305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895490561161334:7674]
2025-09-30T14:53:30.711308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895490561161334:7674]
2025-09-30T14:53:30.711310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895490561161334:7674]
2025-09-30T14:53:30.711324Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:30.711338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:30.711340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:30.711342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:30.711345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:30.711359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:30.711362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:30.711374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1221
2025-09-30T14:53:30.711398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895490561161334:7674]
2025-09-30T14:53:30.711408Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:30.711380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1221
2025-09-30T14:53:30.711411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:30.711435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:30.711439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:30.711476Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0185f60-6779b869-747eba1d-39caa34b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:30.711489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:30.711493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:30.711495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:30.711504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:30.711513Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:30.711536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:30.711672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:30.711679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:30.711691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:30.711761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1222 partition: 0 MaxSeqNo: 42 sessionId: src_id|c0185f60-6779b869-747eba1d-39caa34b_0
2025-09-30T14:53:30.712179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3eead98-8edc5b85-b1d99ef6-f61f450d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c0185f60-6779b869-747eba1d-39caa34b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:30.714990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0185f60-6779b869-747eba1d-39caa34b_0] Write session: try to update token
2025-09-30T14:53:30.715007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0185f60-6779b869-747eba1d-39caa34b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:30.727477Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:30.727497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:30.727500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:30.727501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:30.727511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895490561161334:7674]
2025-09-30T14:53:30.727515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895490561161334:7674]
2025-09-30T14:53:30.727520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895490561161334:7674]
2025-09-30T14:53:30.727566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:30.727573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.727576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:30.727731Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:30.731313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:30.731336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:30.731341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:30.736210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1222 sessionId: src_id|c0185f60-6779b869-747eba1d-39caa34b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:30.739055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:30.767562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895490650910658:3461]
2025-09-30T14:53:30.767904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1221, pipe: [1:7555895490650910658:3461]
2025-09-30T14:53:30.843734Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:30.844323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:30.844337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:30.844353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895490650910658:3461], now have 1 active actors on pipe
2025-09-30T14:53:30.844527Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:30.844604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895490650910658:3461]
2025-09-30T14:53:30.844634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:30.844639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:30.844711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1222 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c0185f60-6779b869-747eba1d-39caa34b_0
2025-09-30T14:53:30.844939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1222 sessionId: src_id|c0185f60-6779b869-747eba1d-39caa34b_0 is DEAD
2025-09-30T14:53:30.845113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0185f60-6779b869-747eba1d-39caa34b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:30.845123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0185f60-6779b869-747eba1d-39caa34b_0] Write session will restart in 0.006441s
2025-09-30T14:53:30.845147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0185f60-6779b869-747eba1d-39caa34b_0] Write session: Do CDS request
2025-09-30T14:53:30.845154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0185f60-6779b869-747eba1d-39caa34b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:30.852793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0185f60-6779b869-747eba1d-39caa34b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:30.852893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:30.852910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1223
2025-09-30T14:53:30.853070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1223 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:30.853101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1223 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:30.853111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1223 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:30.853115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:30.853541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1223 sessionId:  describe result for acl check
2025-09-30T14:53:30.853577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:30.853584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:30.853586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:30.853591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895490650910677:3283] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:30.854141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895490650910677:3283] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:30.856318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895490650910677:3283] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:30.859958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895490650910677:3283] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:30.859976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895490650910677:3283] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:30.859979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895490650910677:3283] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:30.859988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1223 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:30.868301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:30.871717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:30.871933Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:30.871944Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:30.871954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:30.872008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:30.872050Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895490561161648:7676]
2025-09-30T14:53:30.872722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:30.873602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:30.873656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:30.873987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:30.874117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:30.874123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:30.874124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:30.874125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:30.874126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:30.874127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:30.874128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:30.874129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:30.874131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:30.874132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:30.874134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.874135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:30.874136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:30.874137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:30.874139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:30.874146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:30.874157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:30.874161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:30.874165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:30.874169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:30.874173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:30.874177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:30.874180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:30.874184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:30.874189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:30.874193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.874197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:30.874201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:30.874205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:30.874209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:30.874225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:30.874232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:30.874238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:30.874244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:30.874249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:30.874254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:30.874258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:30.874262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:30.874267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:30.874273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:30.874282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:30.874288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:30.874293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:30.874298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:30.874301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:30.874306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:30.874311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:30.874320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:30.874325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:30.874330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:30.874339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.874344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.874354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:30.874360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:30.874366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:30.874372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:30.874380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:30.874386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:30.874391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:30.874401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:30.874446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:30.880124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:30.881222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:30.881237Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:30.881240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:30.881244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:30.881252Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1222 [2:7555895490561161648:7676]
2025-09-30T14:53:30.881268Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:30.881283Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:30.881285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:30.881288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:30.881291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:30.881306Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:30.881318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:30.881325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:30.881385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.881391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:30.881394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:30.881398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:30.881400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:30.881468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:30.881475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.881487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:30.881501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:30.881521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:30.881544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895490650910805:3283], now have 1 active actors on pipe
2025-09-30T14:53:30.881552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895490650910660:2454], now have 1 active actors on pipe
2025-09-30T14:53:30.881557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895490561161638:7676]
2025-09-30T14:53:30.881559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895490561161638:7676]
2025-09-30T14:53:30.881561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895490561161638:7676]
2025-09-30T14:53:30.881573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:30.881587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:30.881591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:30.881596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:30.881599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:30.881605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:30.881608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:30.881639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895490561161638:7676]
2025-09-30T14:53:30.881652Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:30.881651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1222
2025-09-30T14:53:30.881685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:30.881723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1222
2025-09-30T14:53:30.881794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:30.881803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:30.881825Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e0c5e8d-fc7ecd50-73571784-ba336598_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:30.881837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:30.881841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:30.881843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:30.881853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:30.881862Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:30.881878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:30.882103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:30.882112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:30.882128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:30.882213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1223 partition: 0 MaxSeqNo: 42 sessionId: src_id|8e0c5e8d-fc7ecd50-73571784-ba336598_0
2025-09-30T14:53:30.882603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0185f60-6779b869-747eba1d-39caa34b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8e0c5e8d-fc7ecd50-73571784-ba336598_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:30.885390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e0c5e8d-fc7ecd50-73571784-ba336598_0] Write session: try to update token
2025-09-30T14:53:30.885411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e0c5e8d-fc7ecd50-73571784-ba336598_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:30.893879Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:30.893899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:30.893902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:30.893904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:30.893913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895490561161638:7676]
2025-09-30T14:53:30.893918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895490561161638:7676]
2025-09-30T14:53:30.893922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895490561161638:7676]
2025-09-30T14:53:30.893966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:30.893976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:30.893979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:30.893980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:30.893987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:30.893991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:30.894124Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:30.900537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1223 sessionId: src_id|8e0c5e8d-fc7ecd50-73571784-ba336598_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:30.903263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:30.944688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895490650910977:3461]
2025-09-30T14:53:30.944989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1222, pipe: [1:7555895490650910977:3461]
2025-09-30T14:53:31.011790Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:31.012544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:31.012562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:31.012599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895490650910977:3461], now have 1 active actors on pipe
2025-09-30T14:53:31.012853Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:31.012869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:31.012939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:31.013031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1223 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8e0c5e8d-fc7ecd50-73571784-ba336598_0
2025-09-30T14:53:31.013244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1223 sessionId: src_id|8e0c5e8d-fc7ecd50-73571784-ba336598_0 is DEAD
2025-09-30T14:53:31.013407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e0c5e8d-fc7ecd50-73571784-ba336598_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:31.013418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e0c5e8d-fc7ecd50-73571784-ba336598_0] Write session will restart in 0.006238s
2025-09-30T14:53:31.013448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e0c5e8d-fc7ecd50-73571784-ba336598_0] Write session: Do CDS request
2025-09-30T14:53:31.013454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e0c5e8d-fc7ecd50-73571784-ba336598_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:31.013437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895490650910977:3461]
2025-09-30T14:53:31.020783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e0c5e8d-fc7ecd50-73571784-ba336598_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:31.020897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:31.020913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1224
2025-09-30T14:53:31.021048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1224 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:31.021084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1224 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:31.021095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1224 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:31.021099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:31.021184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:31.021560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1224 sessionId:  describe result for acl check
2025-09-30T14:53:31.021604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:31.021611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:31.021613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:31.021619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895494945878298:3275] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:31.022177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895494945878298:3275] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:31.022676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:31.022851Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:31.022860Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:31.022870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:31.022915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:31.022969Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895494856129006:7678]
2025-09-30T14:53:31.023576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:31.023884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:31.023929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:31.024249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:31.024311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:31.024317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:31.024318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:31.024319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:31.024320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:31.024322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:31.024323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:31.024324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:31.024326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:31.024327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:31.024328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.024329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.024330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.024350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895494945878298:3275] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:31.024331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:31.024332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:31.024337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:31.024347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:31.024351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:31.024356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:31.024360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:31.024364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:31.024369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:31.024373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:31.024378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:31.024382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:31.024386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.024390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.024394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.024398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:31.024402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:31.024410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:31.024418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:31.024424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:31.024430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:31.024435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:31.024440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:31.024445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:31.024451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:31.024456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:31.024462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:31.024466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:31.024472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:31.024477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:31.024482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:31.024488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:31.024493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:31.024499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:31.024510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:31.024514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:31.024518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:31.024523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.024528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.024533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.024538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.024546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.024550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.024555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:31.024559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:31.024563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:31.024567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:31.024614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:31.029782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895494945878298:3275] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:31.029804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895494945878298:3275] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:31.029808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895494945878298:3275] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:31.029817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1224 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:31.030114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:31.031129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:31.031145Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:31.031147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:31.031151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:31.031158Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1223 [2:7555895494856129006:7678]
2025-09-30T14:53:31.031172Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:31.031187Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:31.031190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:31.031193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:31.031195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:31.031209Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:31.031216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:31.031223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:31.031296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.031308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.031310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.031312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:31.031315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:31.031377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:31.031385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.031398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.031415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.031436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:31.031458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895494945878278:2454], now have 1 active actors on pipe
2025-09-30T14:53:31.031466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895494945878344:3275], now have 1 active actors on pipe
2025-09-30T14:53:31.031473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895494856129001:7678]
2025-09-30T14:53:31.031475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895494856129001:7678]
2025-09-30T14:53:31.031478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895494856129001:7678]
2025-09-30T14:53:31.031491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:31.031504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:31.031511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:31.031515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:31.031517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:31.031521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:31.031524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:31.031537Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1223
2025-09-30T14:53:31.031548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1223
2025-09-30T14:53:31.031565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895494856129001:7678]
2025-09-30T14:53:31.031572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:31.031574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:31.031598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:31.031607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:31.031635Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|700f2578-44378566-c96da987-8418e30_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:31.031646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:31.031650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:31.031652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:31.031664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:31.031679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:31.031701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:31.031901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:31.031913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:31.031936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:31.032039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1224 partition: 0 MaxSeqNo: 42 sessionId: src_id|700f2578-44378566-c96da987-8418e30_0
2025-09-30T14:53:31.032429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e0c5e8d-fc7ecd50-73571784-ba336598_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|700f2578-44378566-c96da987-8418e30_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:31.035314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|700f2578-44378566-c96da987-8418e30_0] Write session: try to update token
2025-09-30T14:53:31.035334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|700f2578-44378566-c96da987-8418e30_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:31.043954Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:31.043970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:31.043973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:31.043975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:31.043986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895494856129001:7678]
2025-09-30T14:53:31.043990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895494856129001:7678]
2025-09-30T14:53:31.043994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895494856129001:7678]
2025-09-30T14:53:31.044040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:31.044048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.044051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:31.044061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:31.044069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:31.044074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:31.044190Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:31.052899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1224 sessionId: src_id|700f2578-44378566-c96da987-8418e30_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:31.055981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:31.113682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895494945878355:3461]
2025-09-30T14:53:31.113978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1223, pipe: [1:7555895494945878355:3461]
2025-09-30T14:53:31.159458Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:31.159856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:31.159871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:31.159893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895494945878355:3461], now have 1 active actors on pipe
2025-09-30T14:53:31.160181Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:31.160199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:31.160203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:31.160246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895494945878355:3461]
2025-09-30T14:53:31.160278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1224 reason: error at write: Disconnected sessionId: src_id|700f2578-44378566-c96da987-8418e30_0
2025-09-30T14:53:31.160334Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:31.160496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1224 sessionId: src_id|700f2578-44378566-c96da987-8418e30_0 is DEAD
2025-09-30T14:53:31.163496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|700f2578-44378566-c96da987-8418e30_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:31.163509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|700f2578-44378566-c96da987-8418e30_0] Write session will restart in 0.007371s
2025-09-30T14:53:31.163535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|700f2578-44378566-c96da987-8418e30_0] Write session: Do CDS request
2025-09-30T14:53:31.163544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|700f2578-44378566-c96da987-8418e30_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:31.169770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:31.171512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:31.171728Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:31.171736Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:31.171752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|700f2578-44378566-c96da987-8418e30_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:31.171755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:31.171815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:31.171859Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895494856129066:7681]
2025-09-30T14:53:31.171839Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:31.171859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1225
2025-09-30T14:53:31.172043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1225 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:31.172075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1225 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:31.172085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1225 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:31.172089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:31.172506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1225 sessionId:  describe result for acl check
2025-09-30T14:53:31.172516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:31.172544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:31.172550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:31.172552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:31.172558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895494945878376:3274] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:31.172867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:31.172938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:31.173121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895494945878376:3274] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:31.173273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:31.173359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:31.173365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:31.173366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:31.173367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:31.173369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:31.173371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:31.173372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:31.173374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:31.173375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:31.173379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:31.173380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.173381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.173382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.173384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:31.173385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:31.173391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:31.173401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:31.173405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:31.173409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:31.173413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:31.173419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:31.173423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:31.173427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:31.173431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:31.173435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:31.173439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.173443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.173446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.173450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:31.173454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:31.173473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:31.173481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:31.173486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:31.173492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:31.173497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:31.173502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:31.173507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:31.173512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:31.173516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:31.173522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:31.173528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:31.173534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:31.173544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:31.173549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:31.173553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:31.173559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:31.173563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:31.173574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:31.173588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:31.173601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:31.173605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.173610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.173615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.173625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.173630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.173635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.173639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:31.173644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:31.173648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:31.173653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:31.173702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:31.174939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895494945878376:3274] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:31.178850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895494945878376:3274] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:31.178874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895494945878376:3274] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:31.178878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895494945878376:3274] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:31.178889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1225 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:31.179267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:31.180638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1224
2025-09-30T14:53:31.180640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1224
2025-09-30T14:53:31.181024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1225 partition: 0 MaxSeqNo: 42 sessionId: src_id|db70472-2dc8bbb3-6950aa12-dfe7f63f_0
2025-09-30T14:53:31.181438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|700f2578-44378566-c96da987-8418e30_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|db70472-2dc8bbb3-6950aa12-dfe7f63f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:31.180245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:31.180262Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:31.180264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:31.180268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:31.180275Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1224 [2:7555895494856129066:7681]
2025-09-30T14:53:31.180289Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:31.180304Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:31.180310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:31.180313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:31.180315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:31.180331Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:31.180338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:31.180344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:31.180406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.180409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.180411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.180415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:31.180417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:31.180486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:31.180489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.180500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.180510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.180526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:31.180545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895494945878356:2454], now have 1 active actors on pipe
2025-09-30T14:53:31.180548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895494945878416:3274], now have 1 active actors on pipe
2025-09-30T14:53:31.180554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895494856129061:7681]
2025-09-30T14:53:31.180556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895494856129061:7681]
2025-09-30T14:53:31.180558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895494856129061:7681]
2025-09-30T14:53:31.180575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:31.180589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:31.180603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:31.180601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:31.180605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:31.180606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:31.180608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:31.180640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895494856129061:7681]
2025-09-30T14:53:31.180651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:31.180686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:31.180691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:31.180714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:31.180717Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db70472-2dc8bbb3-6950aa12-dfe7f63f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:31.180724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:31.180733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:31.180735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:31.180745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:31.180755Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:31.180768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:31.180939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:31.180944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:31.180962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:31.184333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db70472-2dc8bbb3-6950aa12-dfe7f63f_0] Write session: try to update token
2025-09-30T14:53:31.184349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db70472-2dc8bbb3-6950aa12-dfe7f63f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:31.194629Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:31.194647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:31.194651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:31.194653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:31.194663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895494856129061:7681]
2025-09-30T14:53:31.194671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895494856129061:7681]
2025-09-30T14:53:31.194675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895494856129061:7681]
2025-09-30T14:53:31.194717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:31.194725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.194725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:31.194728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:31.194733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:31.194738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:31.194872Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:31.199680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1225 sessionId: src_id|db70472-2dc8bbb3-6950aa12-dfe7f63f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:31.202522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:31.260642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895494945878435:3461]
2025-09-30T14:53:31.261078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1224, pipe: [1:7555895494945878435:3461]
2025-09-30T14:53:31.311806Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:31.312215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:31.312234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:31.312274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895494945878435:3461], now have 1 active actors on pipe
2025-09-30T14:53:31.312522Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:31.313737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db70472-2dc8bbb3-6950aa12-dfe7f63f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:31.313748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db70472-2dc8bbb3-6950aa12-dfe7f63f_0] Write session will restart in 0.007328s
2025-09-30T14:53:31.313772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db70472-2dc8bbb3-6950aa12-dfe7f63f_0] Write session: Do CDS request
2025-09-30T14:53:31.313778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db70472-2dc8bbb3-6950aa12-dfe7f63f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:31.312621Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:31.312689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:31.312691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895494945878435:3461]
2025-09-30T14:53:31.312694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:31.312765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1225 reason: error at write: Disconnected sessionId: src_id|db70472-2dc8bbb3-6950aa12-dfe7f63f_0
2025-09-30T14:53:31.312994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1225 sessionId: src_id|db70472-2dc8bbb3-6950aa12-dfe7f63f_0 is DEAD
2025-09-30T14:53:31.322916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db70472-2dc8bbb3-6950aa12-dfe7f63f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:31.323056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:31.323075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1226
2025-09-30T14:53:31.323271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1226 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:31.323312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1226 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:31.323317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1226 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:31.323323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:31.323911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1226 sessionId:  describe result for acl check
2025-09-30T14:53:31.323952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:31.323959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:31.323961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:31.323968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895494945878456:3259] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:31.324548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895494945878456:3259] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:31.325042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:31.328343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895494945878456:3259] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:31.327374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:31.327602Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:31.327607Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:31.327618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:31.327673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:31.327709Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895494856129138:7684]
2025-09-30T14:53:31.328396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:31.328802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:31.328870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:31.329244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:31.329334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:31.329341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:31.329343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:31.329344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:31.329346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:31.329348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:31.329349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:31.329351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:31.329352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:31.329353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:31.329355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.329356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.329358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.329359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:31.329361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:31.329367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:31.329378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:31.329383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:31.329388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:31.329391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:31.329396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:31.329400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:31.329404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:31.329408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:31.329414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:31.329418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.329422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.329426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.329430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:31.329434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:31.329443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:31.329452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:31.329458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:31.329464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:31.329470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:31.329476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:31.329481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:31.329487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:31.329493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:31.329498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:31.329503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:31.329509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:31.329522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:31.329528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:31.329533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:31.329538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:31.329544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:31.329549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:31.329554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:31.329560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:31.329566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.329572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.329577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.329583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.329588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.329594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.329600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:31.329606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:31.329611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:31.329617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:31.329668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:31.338079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895494945878456:3259] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:31.338103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895494945878456:3259] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:31.338107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895494945878456:3259] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:31.338119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1226 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:31.338352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:31.339298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:31.339313Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:31.339316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:31.339321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:31.339328Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1225 [2:7555895494856129138:7684]
2025-09-30T14:53:31.339348Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:31.339365Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:31.339369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:31.339372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:31.339374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:31.339391Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:31.339397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:31.339407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:31.339464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.339471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.339473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.339476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:31.339478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:31.339545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:31.339554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.339567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.339580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.339602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:31.339623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895494945878436:2454], now have 1 active actors on pipe
2025-09-30T14:53:31.339627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895494945878496:3259], now have 1 active actors on pipe
2025-09-30T14:53:31.339633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895494856129133:7684]
2025-09-30T14:53:31.339640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895494856129133:7684]
2025-09-30T14:53:31.339642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895494856129133:7684]
2025-09-30T14:53:31.339654Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:31.339667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:31.339668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:31.339675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:31.339678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:31.339683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:31.339686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:31.339721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1225
2025-09-30T14:53:31.339723Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1225
2025-09-30T14:53:31.339720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895494856129133:7684]
2025-09-30T14:53:31.339737Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:31.339758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:31.339776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:31.339780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:31.339805Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e50f9df-d01b79b-eff9df70-d4fdced7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:31.339811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:31.339814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:31.339816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:31.339825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:31.339834Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:31.339846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:31.340074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:31.340085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:31.340101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:31.340189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1226 partition: 0 MaxSeqNo: 42 sessionId: src_id|7e50f9df-d01b79b-eff9df70-d4fdced7_0
2025-09-30T14:53:31.340599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db70472-2dc8bbb3-6950aa12-dfe7f63f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7e50f9df-d01b79b-eff9df70-d4fdced7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:31.343594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e50f9df-d01b79b-eff9df70-d4fdced7_0] Write session: try to update token
2025-09-30T14:53:31.343615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e50f9df-d01b79b-eff9df70-d4fdced7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:31.352287Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:31.352309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:31.352311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:31.352313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:31.352323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895494856129133:7684]
2025-09-30T14:53:31.352328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895494856129133:7684]
2025-09-30T14:53:31.352332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895494856129133:7684]
2025-09-30T14:53:31.352376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:31.352384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.352386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:31.352391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:31.352394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:31.352397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:31.352544Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:31.364589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1226 sessionId: src_id|7e50f9df-d01b79b-eff9df70-d4fdced7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:31.367468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:31.412881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895494945878504:3461]
2025-09-30T14:53:31.413270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1225, pipe: [1:7555895494945878504:3461]
2025-09-30T14:53:31.469182Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:31.469642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:31.469658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:31.469679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895494945878504:3461], now have 1 active actors on pipe
2025-09-30T14:53:31.470335Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:31.470391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:31.470400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:31.470461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1226 reason: error at write: Disconnected sessionId: src_id|7e50f9df-d01b79b-eff9df70-d4fdced7_0
2025-09-30T14:53:31.470453Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:31.470690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1226 sessionId: src_id|7e50f9df-d01b79b-eff9df70-d4fdced7_0 is DEAD
2025-09-30T14:53:31.470890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895494945878504:3461]
2025-09-30T14:53:31.470930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e50f9df-d01b79b-eff9df70-d4fdced7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:31.470947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e50f9df-d01b79b-eff9df70-d4fdced7_0] Write session will restart in 0.007038s
2025-09-30T14:53:31.470980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e50f9df-d01b79b-eff9df70-d4fdced7_0] Write session: Do CDS request
2025-09-30T14:53:31.470991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e50f9df-d01b79b-eff9df70-d4fdced7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:31.478929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e50f9df-d01b79b-eff9df70-d4fdced7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:31.479137Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:31.479158Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1227
2025-09-30T14:53:31.479413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1227 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:31.479453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1227 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:31.479463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1227 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:31.479468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:31.479924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1227 sessionId:  describe result for acl check
2025-09-30T14:53:31.479963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:31.479971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:31.479973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:31.479979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895494945878517:3257] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:31.480527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895494945878517:3257] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:31.483457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:31.484009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895494945878517:3257] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:31.485405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:31.485604Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:31.485615Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:31.485625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:31.485681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:31.485722Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895494856129198:7686]
2025-09-30T14:53:31.486400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:31.486744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:31.486805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:31.487198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:31.487293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:31.487310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:31.487317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:31.487318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:31.487320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:31.487321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:31.487322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:31.487324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:31.487325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:31.487326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:31.487327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.487328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.487332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.487335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:31.487336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:31.487343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:31.487351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:31.487355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:31.487360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:31.487363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:31.487367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:31.487370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:31.487387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:31.487391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:31.487396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:31.487400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.487405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.487409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.487414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:31.487418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:31.487428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:31.487437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:31.487443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:31.487450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:31.487455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:31.487461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:31.487466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:31.487472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:31.487480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:31.487486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:31.487496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:31.487502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:31.487507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:31.487515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:31.487520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:31.487531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:31.487537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:31.487547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:31.487553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:31.487559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:31.487569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.487574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.487579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.487584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.487589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.487594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.487599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:31.487605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:31.487609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:31.487615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:31.487666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:31.487676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895494945878517:3257] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:31.487693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895494945878517:3257] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:31.487697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895494945878517:3257] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:31.487705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1227 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:31.493578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:31.494507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:31.494519Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:31.494522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:31.494527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:31.494534Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1226 [2:7555895494856129198:7686]
2025-09-30T14:53:31.494553Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:31.494578Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:31.494588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:31.494592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:31.494594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:31.494613Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:31.494631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:31.494638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:31.494702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.494713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.494716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.494719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:31.494722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:31.494787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:31.494790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.494814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.494831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.494854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:31.494879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895494856129193:7686]
2025-09-30T14:53:31.494885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895494856129193:7686]
2025-09-30T14:53:31.494887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895494856129193:7686]
2025-09-30T14:53:31.494896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:31.494906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:31.494909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:31.494911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:31.494915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895494945878505:2454], now have 1 active actors on pipe
2025-09-30T14:53:31.494919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895494945878564:3257], now have 1 active actors on pipe
2025-09-30T14:53:31.494927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:31.494946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:31.494953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:31.494989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895494856129193:7686]
2025-09-30T14:53:31.494978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1226
2025-09-30T14:53:31.494998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1226
2025-09-30T14:53:31.494998Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:31.495004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:31.495195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:31.495208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:31.495239Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e698c00-882b6222-aa82f085-8284cdd0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:31.495272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:31.495280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:31.495282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:31.495293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:31.495305Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:31.495327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:31.495678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:31.495689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:31.495713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:31.495947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1227 partition: 0 MaxSeqNo: 42 sessionId: src_id|7e698c00-882b6222-aa82f085-8284cdd0_0
2025-09-30T14:53:31.496424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e50f9df-d01b79b-eff9df70-d4fdced7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7e698c00-882b6222-aa82f085-8284cdd0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:31.499385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e698c00-882b6222-aa82f085-8284cdd0_0] Write session: try to update token
2025-09-30T14:53:31.499405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e698c00-882b6222-aa82f085-8284cdd0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:31.511703Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:31.511721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:31.511724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:31.511726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:31.511737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895494856129193:7686]
2025-09-30T14:53:31.511742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895494856129193:7686]
2025-09-30T14:53:31.511747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895494856129193:7686]
2025-09-30T14:53:31.511791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:31.511802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.511805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:31.511813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:31.511821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:31.511827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:31.511966Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:31.521100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1227 sessionId: src_id|7e698c00-882b6222-aa82f085-8284cdd0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:31.524310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:31.573170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895494945878589:3461]
2025-09-30T14:53:31.573496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1226, pipe: [1:7555895494945878589:3461]
2025-09-30T14:53:31.631753Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:31.632113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:31.632130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:31.632149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895494945878589:3461], now have 1 active actors on pipe
2025-09-30T14:53:31.632440Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:31.632467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:31.632537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:31.632545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:31.632604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895494945878589:3461]
2025-09-30T14:53:31.632625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1227 reason: error at write: Disconnected sessionId: src_id|7e698c00-882b6222-aa82f085-8284cdd0_0
2025-09-30T14:53:31.632876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1227 sessionId: src_id|7e698c00-882b6222-aa82f085-8284cdd0_0 is DEAD
2025-09-30T14:53:31.633040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e698c00-882b6222-aa82f085-8284cdd0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:31.633052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e698c00-882b6222-aa82f085-8284cdd0_0] Write session will restart in 0.008307s
2025-09-30T14:53:31.633088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e698c00-882b6222-aa82f085-8284cdd0_0] Write session: Do CDS request
2025-09-30T14:53:31.633094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e698c00-882b6222-aa82f085-8284cdd0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:31.642876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e698c00-882b6222-aa82f085-8284cdd0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:31.642984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:31.643000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1228
2025-09-30T14:53:31.643156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1228 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:31.643190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1228 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:31.643204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1228 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:31.643208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:31.643709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1228 sessionId:  describe result for acl check
2025-09-30T14:53:31.643750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:31.643758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:31.643761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:31.643768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895494945878609:3238] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:31.644344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895494945878609:3238] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:31.646611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895494945878609:3238] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:31.649750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895494945878609:3238] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:31.649764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895494945878609:3238] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:31.649768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895494945878609:3238] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:31.649776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1228 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:31.650869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:31.652420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:31.652629Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:31.652638Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:31.652649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:31.652701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:31.652745Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895494856129298:7701]
2025-09-30T14:53:31.653406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:31.653720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:31.653764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:31.654096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:31.654167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:31.654173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:31.654175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:31.654176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:31.654179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:31.654180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:31.654182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:31.654184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:31.654185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:31.654186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:31.654187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.654188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.654189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.654191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:31.654192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:31.654197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:31.654207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:31.654212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:31.654216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:31.654220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:31.654224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:31.654228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:31.654232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:31.654237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:31.654241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:31.654245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.654249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.654252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.654256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:31.654259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:31.654267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:31.654275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:31.654281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:31.654286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:31.654290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:31.654299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:31.654303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:31.654309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:31.654314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:31.654321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:31.654328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:31.654334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:31.654338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:31.654343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:31.654350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:31.654355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:31.654359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:31.654365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:31.654369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:31.654374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:31.654378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.654383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.654387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.654392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.654396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.654401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.654405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:31.654410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:31.654423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:31.654428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:31.654472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:31.660127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:31.661007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:31.661023Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:31.661026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:31.661030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:31.661038Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1227 [2:7555895494856129298:7701]
2025-09-30T14:53:31.661054Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:31.661076Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:31.661079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:31.661083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:31.661085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:31.661100Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:31.661108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:31.661114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:31.661171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.661173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.661176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.661179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:31.661181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:31.661251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:31.661254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.661267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.661279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.661296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:31.661314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895494945878654:3238], now have 1 active actors on pipe
2025-09-30T14:53:31.661317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895494945878602:2454], now have 1 active actors on pipe
2025-09-30T14:53:31.661323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895494856129293:7701]
2025-09-30T14:53:31.661325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895494856129293:7701]
2025-09-30T14:53:31.661329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895494856129293:7701]
2025-09-30T14:53:31.661343Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:31.661357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:31.661371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:31.661378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:31.661378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:31.661381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:31.661384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:31.661410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895494856129293:7701]
2025-09-30T14:53:31.661422Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:31.661448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:31.661580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:31.661590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:31.661622Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9eb0d8fd-9f9da4e0-425efacf-a39218dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:31.661631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:31.661645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:31.661647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:31.661658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:31.661677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:31.661695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:31.661425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1227
2025-09-30T14:53:31.661474Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1227
2025-09-30T14:53:31.662889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:31.662902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:31.662925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:31.663045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1228 partition: 0 MaxSeqNo: 42 sessionId: src_id|9eb0d8fd-9f9da4e0-425efacf-a39218dc_0
2025-09-30T14:53:31.663475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e698c00-882b6222-aa82f085-8284cdd0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9eb0d8fd-9f9da4e0-425efacf-a39218dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:31.666334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9eb0d8fd-9f9da4e0-425efacf-a39218dc_0] Write session: try to update token
2025-09-30T14:53:31.666348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9eb0d8fd-9f9da4e0-425efacf-a39218dc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:31.673763Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:31.673783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:31.673785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:31.673790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:31.673800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895494856129293:7701]
2025-09-30T14:53:31.673807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895494856129293:7701]
2025-09-30T14:53:31.673811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895494856129293:7701]
2025-09-30T14:53:31.673850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:31.673858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:31.673862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.673865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:31.673865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:31.673869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:31.674002Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:31.687639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1228 sessionId: src_id|9eb0d8fd-9f9da4e0-425efacf-a39218dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:31.690862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:31.732712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895494945878669:3461]
2025-09-30T14:53:31.733051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1227, pipe: [1:7555895494945878669:3461]
2025-09-30T14:53:31.793619Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:31.794027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:31.794042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:31.794075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895494945878669:3461], now have 1 active actors on pipe
2025-09-30T14:53:31.794347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895494945878669:3461]
2025-09-30T14:53:31.794354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:31.794359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:31.794386Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:31.794431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1228 reason: error at write: Disconnected sessionId: src_id|9eb0d8fd-9f9da4e0-425efacf-a39218dc_0
2025-09-30T14:53:31.794672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1228 sessionId: src_id|9eb0d8fd-9f9da4e0-425efacf-a39218dc_0 is DEAD
2025-09-30T14:53:31.794890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eb0d8fd-9f9da4e0-425efacf-a39218dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:31.794904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eb0d8fd-9f9da4e0-425efacf-a39218dc_0] Write session will restart in 0.008019s
2025-09-30T14:53:31.794937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eb0d8fd-9f9da4e0-425efacf-a39218dc_0] Write session: Do CDS request
2025-09-30T14:53:31.794945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eb0d8fd-9f9da4e0-425efacf-a39218dc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:31.794299Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:31.803977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9eb0d8fd-9f9da4e0-425efacf-a39218dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:31.804748Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:31.804775Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1229
2025-09-30T14:53:31.804962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1229 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:31.805001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1229 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:31.805006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1229 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:31.805010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:31.805441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1229 sessionId:  describe result for acl check
2025-09-30T14:53:31.805482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:31.805484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:31.805486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:31.805492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895494945878695:3235] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:31.806069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895494945878695:3235] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:31.806978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:31.808568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:31.808777Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:31.808787Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:31.808797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:31.808848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:31.808838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895494945878695:3235] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:31.808897Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895494856129359:7703]
2025-09-30T14:53:31.809589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:31.809941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:31.809998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:31.810373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:31.810435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:31.810441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:31.810443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:31.810444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:31.810445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:31.810446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:31.810448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:31.810449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:31.810451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:31.810452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:31.810453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.810454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.810458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.810459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:31.810460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:31.810465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:31.810474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:31.810478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:31.810482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:31.810487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:31.810491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:31.810495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:31.810499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:31.810505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:31.810509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:31.810513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.810517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.810521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.810525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:31.810529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:31.810536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:31.810544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:31.810562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:31.810568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:31.810573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:31.810579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:31.810583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:31.810589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:31.810599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:31.810604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:31.810608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:31.810612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:31.810621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:31.810627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:31.810631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:31.810635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:31.810644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:31.810650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:31.810654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:31.810660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:31.810665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.810670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.810674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.810680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.810684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.810689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.810699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:31.810704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:31.810708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:31.810718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:31.810764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:31.815935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895494945878695:3235] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:31.815958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895494945878695:3235] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:31.815962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895494945878695:3235] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:31.815972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1229 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:31.818935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:31.819874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:31.819892Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:31.819895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:31.819898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:31.819906Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1228 [2:7555895494856129359:7703]
2025-09-30T14:53:31.819923Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:31.819939Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:31.819942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:31.819946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:31.819951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:31.819967Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:31.819983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:31.819992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:31.820054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.820062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.820064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.820068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:31.820070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:31.820135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:31.820143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.820156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.820167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.820184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:31.820206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895494945878737:3235], now have 1 active actors on pipe
2025-09-30T14:53:31.820214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895494945878671:2454], now have 1 active actors on pipe
2025-09-30T14:53:31.820220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895494856129354:7703]
2025-09-30T14:53:31.820222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895494856129354:7703]
2025-09-30T14:53:31.820224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895494856129354:7703]
2025-09-30T14:53:31.820236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:31.820252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:31.820252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:31.820256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:31.820259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:31.820271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:31.820274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:31.820331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1228
2025-09-30T14:53:31.820366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1228
2025-09-30T14:53:31.820311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895494856129354:7703]
2025-09-30T14:53:31.820326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:31.820333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:31.820512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:31.820520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:31.820550Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96215af2-f53a80a3-2ceaf3ea-8b7de1cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:31.820563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:31.820567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:31.820570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:31.820582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:31.820596Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:31.820618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:31.820864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:31.820875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:31.820891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:31.821004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1229 partition: 0 MaxSeqNo: 42 sessionId: src_id|96215af2-f53a80a3-2ceaf3ea-8b7de1cb_0
2025-09-30T14:53:31.821581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eb0d8fd-9f9da4e0-425efacf-a39218dc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|96215af2-f53a80a3-2ceaf3ea-8b7de1cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:31.825263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96215af2-f53a80a3-2ceaf3ea-8b7de1cb_0] Write session: try to update token
2025-09-30T14:53:31.825291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96215af2-f53a80a3-2ceaf3ea-8b7de1cb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:31.832901Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:31.832921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:31.832924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:31.832926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:31.832935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895494856129354:7703]
2025-09-30T14:53:31.832940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895494856129354:7703]
2025-09-30T14:53:31.832945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895494856129354:7703]
2025-09-30T14:53:31.832992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:31.832999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.833002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:31.833001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:31.833024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:31.833035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:31.833137Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:31.842926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1229 sessionId: src_id|96215af2-f53a80a3-2ceaf3ea-8b7de1cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:31.845698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:31.894475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895494945878744:3461]
2025-09-30T14:53:31.894801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1228, pipe: [1:7555895494945878744:3461]
2025-09-30T14:53:31.949790Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:31.950197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:31.950211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:31.950231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895494945878744:3461], now have 1 active actors on pipe
2025-09-30T14:53:31.950434Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:31.952157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96215af2-f53a80a3-2ceaf3ea-8b7de1cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:31.952169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96215af2-f53a80a3-2ceaf3ea-8b7de1cb_0] Write session will restart in 0.008899s
2025-09-30T14:53:31.952191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96215af2-f53a80a3-2ceaf3ea-8b7de1cb_0] Write session: Do CDS request
2025-09-30T14:53:31.952196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96215af2-f53a80a3-2ceaf3ea-8b7de1cb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:31.951453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895494945878744:3461]
2025-09-30T14:53:31.951487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:31.951552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1229 reason: status is not ok: tablet will be restarted right now sessionId: src_id|96215af2-f53a80a3-2ceaf3ea-8b7de1cb_0
2025-09-30T14:53:31.951755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1229 sessionId: src_id|96215af2-f53a80a3-2ceaf3ea-8b7de1cb_0 is DEAD
2025-09-30T14:53:31.951939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:31.961973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96215af2-f53a80a3-2ceaf3ea-8b7de1cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:31.962160Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:31.962181Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1230
2025-09-30T14:53:31.962263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:31.962351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1230 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:31.962393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1230 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:31.962421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1230 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:31.962429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:31.962865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1230 sessionId:  describe result for acl check
2025-09-30T14:53:31.962909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:31.962917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:31.962919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:31.962925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895494945878773:3231] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:31.963615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895494945878773:3231] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:31.964013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:31.964210Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:31.964226Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:31.964239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:31.964297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:31.964347Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895494856129423:7705]
2025-09-30T14:53:31.965053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:31.965360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:31.965397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895494945878773:3231] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:31.965407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:31.965801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:31.965874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:31.965886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:31.965887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:31.965888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:31.965890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:31.965891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:31.965892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:31.965893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:31.965894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:31.965895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:31.965897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.965898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.965899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.965900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:31.965901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:31.965906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:31.965915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:31.965921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:31.965926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:31.965930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:31.965935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:31.965939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:31.965944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:31.965948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:31.965953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:31.965957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.965961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.965965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.965969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:31.965972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:31.965979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:31.965989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:31.965996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:31.966002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:31.966007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:31.966013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:31.966018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:31.966024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:31.966029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:31.966035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:31.966039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:31.966058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:31.966063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:31.966071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:31.966075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:31.966081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:31.966087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:31.966093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:31.966098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:31.966104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:31.966110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.966116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.966128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.966134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.966139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.966145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.966149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:31.966155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:31.966161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:31.966166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:31.966233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:31.971450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895494945878773:3231] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:31.971469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895494945878773:3231] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:31.971472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895494945878773:3231] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:31.971482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1230 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:31.976103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:31.977002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:31.977013Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:31.977016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:31.977024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:31.977032Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1229 [2:7555895494856129423:7705]
2025-09-30T14:53:31.977050Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:31.977066Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:31.977071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:31.977074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:31.977077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:31.977094Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:31.977101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:31.977109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:31.977175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.977177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.977179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.977183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:31.977185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:31.977264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:31.977267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:31.977282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:31.977295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:31.977315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:31.977335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895494945878809:3231], now have 1 active actors on pipe
2025-09-30T14:53:31.977339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895494945878748:2454], now have 1 active actors on pipe
2025-09-30T14:53:31.977345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895494856129417:7705]
2025-09-30T14:53:31.977348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895494856129417:7705]
2025-09-30T14:53:31.977350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895494856129417:7705]
2025-09-30T14:53:31.977370Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:31.977384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:31.977387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:31.977388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:31.977391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:31.977405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:31.977408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:31.977443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895494856129417:7705]
2025-09-30T14:53:31.977453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:31.977486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:31.977891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1229
2025-09-30T14:53:31.977928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1229
2025-09-30T14:53:31.978245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:31.978265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:31.978295Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8814edd6-134d283b-2ac9415c-43282d03_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:31.978304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:31.978311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:31.978313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:31.978323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:31.978334Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:31.978355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:31.978609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:31.978621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:31.978638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:31.978745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1230 partition: 0 MaxSeqNo: 42 sessionId: src_id|8814edd6-134d283b-2ac9415c-43282d03_0
2025-09-30T14:53:31.979155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96215af2-f53a80a3-2ceaf3ea-8b7de1cb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8814edd6-134d283b-2ac9415c-43282d03_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:31.982080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8814edd6-134d283b-2ac9415c-43282d03_0] Write session: try to update token
2025-09-30T14:53:31.982099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8814edd6-134d283b-2ac9415c-43282d03_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:31.999738Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:31.999761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:31.999772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895494856129417:7705]
2025-09-30T14:53:31.999823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:32.000004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:32.000147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:32.000292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:32.000425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:32.000624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:32.000665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:32.002014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:32.004584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1230 sessionId: src_id|8814edd6-134d283b-2ac9415c-43282d03_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:32.004588Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:32.004603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:32.004606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:32.004608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:32.004616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895494856129417:7705]
2025-09-30T14:53:32.004621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895494856129417:7705]
2025-09-30T14:53:32.004625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895494856129417:7705]
2025-09-30T14:53:32.004666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:32.004674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.004676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:32.004823Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:32.004899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:32.004911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:32.004915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:32.007286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:32.051152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895499240846118:3461]
2025-09-30T14:53:32.051436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1229, pipe: [1:7555895499240846118:3461]
2025-09-30T14:53:32.120524Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:32.120818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:32.120836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:32.120856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895499240846118:3461], now have 1 active actors on pipe
2025-09-30T14:53:32.121071Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:32.121080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:32.121096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:32.121163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1230 reason: error at write: Disconnected sessionId: src_id|8814edd6-134d283b-2ac9415c-43282d03_0
2025-09-30T14:53:32.121209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:32.121273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895499240846118:3461]
2025-09-30T14:53:32.121383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1230 sessionId: src_id|8814edd6-134d283b-2ac9415c-43282d03_0 is DEAD
2025-09-30T14:53:32.121599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8814edd6-134d283b-2ac9415c-43282d03_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:32.121614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8814edd6-134d283b-2ac9415c-43282d03_0] Write session will restart in 0.007838s
2025-09-30T14:53:32.121647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8814edd6-134d283b-2ac9415c-43282d03_0] Write session: Do CDS request
2025-09-30T14:53:32.121657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8814edd6-134d283b-2ac9415c-43282d03_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:32.130539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:32.130904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8814edd6-134d283b-2ac9415c-43282d03_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:32.130971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:32.130988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1231
2025-09-30T14:53:32.131182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1231 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:32.131230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1231 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:32.131240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1231 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:32.131258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:32.131694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1231 sessionId:  describe result for acl check
2025-09-30T14:53:32.131732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:32.131737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:32.131739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:32.131744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895499240846150:3220] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:32.132230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:32.132330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895499240846150:3220] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:32.132462Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:32.132477Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:32.132491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:32.132570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:32.132623Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895499151096782:7707]
2025-09-30T14:53:32.133257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:32.133538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:32.133587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:32.133912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:32.133981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:32.133988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:32.133989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:32.133990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:32.133992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:32.133993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:32.133994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:32.133995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:32.133996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:32.133997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:32.133998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.134000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.134001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.134002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:32.134003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:32.134009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:32.134017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:32.134021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:32.134025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:32.134029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:32.134033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:32.134037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:32.134041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:32.134057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:32.134061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:32.134068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.134072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.134076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.134080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:32.134085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:32.134097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:32.134106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:32.134113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:32.134119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:32.134125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:32.134131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:32.134147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:32.134153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:32.134157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:32.134163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:32.134169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:32.134175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:32.134185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:32.134191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:32.134210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:32.134217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:32.134222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:32.134228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:32.134233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:32.134238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:32.134244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.134250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.134254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.134260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.134264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.134269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.134203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895499240846150:3220] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:32.134275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:32.134280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:32.134285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:32.134290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:32.134335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:32.139837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895499240846150:3220] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:32.139855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895499240846150:3220] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:32.139858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895499240846150:3220] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:32.139868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1231 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:32.139983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:32.140888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:32.140904Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:32.140906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:32.140910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:32.140917Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1230 [2:7555895499151096782:7707]
2025-09-30T14:53:32.140936Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:32.140952Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:32.140955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:32.140959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:32.140961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:32.140978Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:32.140988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:32.140996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:32.141051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.141057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.141059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.141062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:32.141065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:32.141129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:32.141136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.141149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.141165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.141188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:32.141208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895499240846189:3220], now have 1 active actors on pipe
2025-09-30T14:53:32.141216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895499240846123:2454], now have 1 active actors on pipe
2025-09-30T14:53:32.141224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895499151096777:7707]
2025-09-30T14:53:32.141226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895499151096777:7707]
2025-09-30T14:53:32.141228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895499151096777:7707]
2025-09-30T14:53:32.141241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:32.141254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:32.141262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:32.141267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:32.141245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1230
2025-09-30T14:53:32.141269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:32.141251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1230
2025-09-30T14:53:32.141274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:32.141277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:32.141303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895499151096777:7707]
2025-09-30T14:53:32.141305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:32.141309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:32.141324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:32.141328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:32.141369Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee905504-a3aaeaf9-cf3852fa-ff683ca9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:32.141381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:32.141384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:32.141386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:32.141397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:32.141407Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:32.141429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:32.141596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:32.141606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:32.141619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:32.141702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1231 partition: 0 MaxSeqNo: 42 sessionId: src_id|ee905504-a3aaeaf9-cf3852fa-ff683ca9_0
2025-09-30T14:53:32.142199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8814edd6-134d283b-2ac9415c-43282d03_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ee905504-a3aaeaf9-cf3852fa-ff683ca9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:32.145653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee905504-a3aaeaf9-cf3852fa-ff683ca9_0] Write session: try to update token
2025-09-30T14:53:32.145684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee905504-a3aaeaf9-cf3852fa-ff683ca9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:32.154155Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:32.154177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:32.154179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:32.154182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:32.154199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895499151096777:7707]
2025-09-30T14:53:32.154203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895499151096777:7707]
2025-09-30T14:53:32.154207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895499151096777:7707]
2025-09-30T14:53:32.154253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:32.154261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.154264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:32.154280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:32.154288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:32.154292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:32.154431Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:32.165062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1231 sessionId: src_id|ee905504-a3aaeaf9-cf3852fa-ff683ca9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:32.168311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:32.221667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895499240846208:3461]
2025-09-30T14:53:32.221987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1230, pipe: [1:7555895499240846208:3461]
2025-09-30T14:53:32.270329Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:32.270732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:32.270754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:32.270787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895499240846208:3461], now have 1 active actors on pipe
2025-09-30T14:53:32.271020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:32.271038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:32.271099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1231 reason: error at write: Disconnected sessionId: src_id|ee905504-a3aaeaf9-cf3852fa-ff683ca9_0
2025-09-30T14:53:32.271102Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:32.271155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895499240846208:3461]
2025-09-30T14:53:32.271351Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:32.271361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1231 sessionId: src_id|ee905504-a3aaeaf9-cf3852fa-ff683ca9_0 is DEAD
2025-09-30T14:53:32.271563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee905504-a3aaeaf9-cf3852fa-ff683ca9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:32.271576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee905504-a3aaeaf9-cf3852fa-ff683ca9_0] Write session will restart in 0.005947s
2025-09-30T14:53:32.271608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee905504-a3aaeaf9-cf3852fa-ff683ca9_0] Write session: Do CDS request
2025-09-30T14:53:32.271616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee905504-a3aaeaf9-cf3852fa-ff683ca9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:32.278979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee905504-a3aaeaf9-cf3852fa-ff683ca9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:32.279107Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:32.279130Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1232
2025-09-30T14:53:32.279337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1232 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:32.279394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1232 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:32.279410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1232 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:32.279422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:32.279798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:32.280012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1232 sessionId:  describe result for acl check
2025-09-30T14:53:32.280066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:32.280075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:32.280078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:32.280085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895499240846236:3213] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:32.280809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895499240846236:3213] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:32.281609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:32.281803Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:32.281815Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:32.281826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:32.281876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:32.281919Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895499151096860:7711]
2025-09-30T14:53:32.282642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:32.282925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:32.282968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:32.283313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:32.283341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895499240846236:3213] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:32.283383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:32.283389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:32.283391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:32.283392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:32.283394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:32.283395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:32.283397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:32.283398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:32.283400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:32.283401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:32.283402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.283404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.283405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.283406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:32.283407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:32.283413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:32.283424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:32.283429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:32.283434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:32.283439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:32.283444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:32.283448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:32.283451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:32.283457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:32.283460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:32.283463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.283467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.283470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.283473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:32.283476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:32.283484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:32.283493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:32.283498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:32.283504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:32.283508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:32.283514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:32.283519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:32.283524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:32.283529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:32.283535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:32.283540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:32.283546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:32.283552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:32.283558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:32.283563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:32.283569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:32.283580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:32.283585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:32.283589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:32.283600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:32.283605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.283610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.283615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.283620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.283626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.283634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.283639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:32.283644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:32.283649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:32.283659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:32.283710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:32.289093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895499240846236:3213] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:32.289115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895499240846236:3213] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:32.289120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895499240846236:3213] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:32.289130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1232 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:32.289347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:32.290413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:32.290431Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:32.290435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:32.290439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:32.290447Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1231 [2:7555895499151096860:7711]
2025-09-30T14:53:32.290467Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:32.290483Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:32.290486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:32.290490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:32.290493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:32.290512Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:32.290525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:32.290536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:32.290600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.290613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.290615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.290618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:32.290620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:32.290693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:32.290695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.290708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.290722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.290742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:32.290763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895499240846209:2454], now have 1 active actors on pipe
2025-09-30T14:53:32.290777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895499151096855:7711]
2025-09-30T14:53:32.290784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895499151096855:7711]
2025-09-30T14:53:32.290786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895499151096855:7711]
2025-09-30T14:53:32.290804Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:32.290817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895499240846275:3213], now have 1 active actors on pipe
2025-09-30T14:53:32.290828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:32.290829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:32.290834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:32.290837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:32.290842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:32.290845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:32.290879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895499151096855:7711]
2025-09-30T14:53:32.290888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:32.290875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1231
2025-09-30T14:53:32.290886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1231
2025-09-30T14:53:32.290933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:32.290943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:32.290935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:32.290967Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e066104-bc415668-a8190e72-3c063c45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:32.290979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:32.290982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:32.290985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:32.290993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:32.291002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:32.291019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:32.291210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:32.291218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:32.291232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:32.291337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1232 partition: 0 MaxSeqNo: 42 sessionId: src_id|e066104-bc415668-a8190e72-3c063c45_0
2025-09-30T14:53:32.291773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee905504-a3aaeaf9-cf3852fa-ff683ca9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e066104-bc415668-a8190e72-3c063c45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:32.295148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e066104-bc415668-a8190e72-3c063c45_0] Write session: try to update token
2025-09-30T14:53:32.295169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e066104-bc415668-a8190e72-3c063c45_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:32.303775Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:32.303804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:32.303808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:32.303811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:32.303823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895499151096855:7711]
2025-09-30T14:53:32.303828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895499151096855:7711]
2025-09-30T14:53:32.303834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895499151096855:7711]
2025-09-30T14:53:32.303885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:32.303894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.303897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:32.303905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:32.303913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:32.303919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:32.304074Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:32.315168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1232 sessionId: src_id|e066104-bc415668-a8190e72-3c063c45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:32.318642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:32.371155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895499240846283:3461]
2025-09-30T14:53:32.371548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1231, pipe: [1:7555895499240846283:3461]
2025-09-30T14:53:32.425018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895499240846283:3461]
2025-09-30T14:53:32.425096Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:32.425164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:32.425174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:32.425285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1232 reason: error at write: Disconnected sessionId: src_id|e066104-bc415668-a8190e72-3c063c45_0
2025-09-30T14:53:32.425559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1232 sessionId: src_id|e066104-bc415668-a8190e72-3c063c45_0 is DEAD
2025-09-30T14:53:32.425801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e066104-bc415668-a8190e72-3c063c45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:32.425816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e066104-bc415668-a8190e72-3c063c45_0] Write session will restart in 0.007356s
2025-09-30T14:53:32.425847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e066104-bc415668-a8190e72-3c063c45_0] Write session: Do CDS request
2025-09-30T14:53:32.425856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e066104-bc415668-a8190e72-3c063c45_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:32.424375Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:32.424676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:32.424684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:32.424702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895499240846283:3461], now have 1 active actors on pipe
2025-09-30T14:53:32.425769Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:32.433243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:32.434969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e066104-bc415668-a8190e72-3c063c45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:32.434971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:32.435179Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:32.435191Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:32.435204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:32.435296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:32.435339Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895499151096926:7713]
2025-09-30T14:53:32.436031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:32.436321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:32.436367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:32.436695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:32.436758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:32.436766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:32.436767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:32.436768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:32.436770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:32.436771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:32.436772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:32.436773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:32.436775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:32.436776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:32.436778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.436779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.436781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.436782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:32.436783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:32.436789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:32.436799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:32.436804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:32.436809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:32.436814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:32.436819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:32.436823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:32.436828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:32.436833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:32.436838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:32.436842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.436863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.436868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.436872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:32.436878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:32.436889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:32.436898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:32.436905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:32.436911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:32.436916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:32.436922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:32.436927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:32.436934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:32.436939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:32.436944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:32.436949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:32.436956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:32.436961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:32.436967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:32.436972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:32.436979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:32.436984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:32.436990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:32.436995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:32.437001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:32.437006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.437013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.437018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.437025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.437034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.437040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.437051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:32.437057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:32.437063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:32.437069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:32.437121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:32.435046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:32.435063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1233
2025-09-30T14:53:32.435233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1233 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:32.435266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1233 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:32.435271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1233 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:32.435276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:32.435655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1233 sessionId:  describe result for acl check
2025-09-30T14:53:32.435680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:32.435682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:32.435684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:32.435689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895499240846312:3208] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:32.436177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895499240846312:3208] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:32.437854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895499240846312:3208] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:32.442117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895499240846312:3208] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:32.442140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895499240846312:3208] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:32.442143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895499240846312:3208] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:32.442152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1233 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:32.442502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:32.443385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:32.443409Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:32.443413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:32.443417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:32.443424Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1232 [2:7555895499151096926:7713]
2025-09-30T14:53:32.443441Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:32.443455Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:32.443458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:32.443462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:32.443464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:32.443480Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:32.443487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:32.443493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:32.443550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.443564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.443568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.443571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:32.443574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:32.443720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:32.443732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.443744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.443760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.443786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:32.443784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1232
2025-09-30T14:53:32.443795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1232
2025-09-30T14:53:32.443814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895499240846351:3208], now have 1 active actors on pipe
2025-09-30T14:53:32.443825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895499240846284:2454], now have 1 active actors on pipe
2025-09-30T14:53:32.443832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895499151096921:7713]
2025-09-30T14:53:32.443834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895499151096921:7713]
2025-09-30T14:53:32.443837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895499151096921:7713]
2025-09-30T14:53:32.443850Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:32.443863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:32.443867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:32.443869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:32.443873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:32.443889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:32.443893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:32.443935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:32.443946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:32.443964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895499151096921:7713]
2025-09-30T14:53:32.443980Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:32.444014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:32.444017Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42de3161-ef5bce8f-fa29cc3-22049124_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:32.444023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:32.444027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:32.444029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:32.444040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:32.444050Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:32.444076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:32.444255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:32.444264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:32.444279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:32.444372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1233 partition: 0 MaxSeqNo: 42 sessionId: src_id|42de3161-ef5bce8f-fa29cc3-22049124_0
2025-09-30T14:53:32.444933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e066104-bc415668-a8190e72-3c063c45_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|42de3161-ef5bce8f-fa29cc3-22049124_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:32.448388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42de3161-ef5bce8f-fa29cc3-22049124_0] Write session: try to update token
2025-09-30T14:53:32.448412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42de3161-ef5bce8f-fa29cc3-22049124_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:32.456242Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:32.456265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:32.456267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:32.456270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:32.456279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895499151096921:7713]
2025-09-30T14:53:32.456288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895499151096921:7713]
2025-09-30T14:53:32.456292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895499151096921:7713]
2025-09-30T14:53:32.456332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:32.456339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.456342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:32.456350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:32.456358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:32.456361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:32.456504Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:32.466622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1233 sessionId: src_id|42de3161-ef5bce8f-fa29cc3-22049124_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:32.469274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:32.525249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895499240846361:3461]
2025-09-30T14:53:32.525603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1232, pipe: [1:7555895499240846361:3461]
2025-09-30T14:53:32.574742Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:32.575127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:32.575148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:32.575169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895499240846361:3461], now have 1 active actors on pipe
2025-09-30T14:53:32.575447Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:32.575469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:32.575488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:32.575554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1233 reason: error at write: Disconnected sessionId: src_id|42de3161-ef5bce8f-fa29cc3-22049124_0
2025-09-30T14:53:32.575735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895499240846361:3461]
2025-09-30T14:53:32.575739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1233 sessionId: src_id|42de3161-ef5bce8f-fa29cc3-22049124_0 is DEAD
2025-09-30T14:53:32.575753Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:32.576168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42de3161-ef5bce8f-fa29cc3-22049124_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:32.576179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42de3161-ef5bce8f-fa29cc3-22049124_0] Write session will restart in 0.006158s
2025-09-30T14:53:32.576204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42de3161-ef5bce8f-fa29cc3-22049124_0] Write session: Do CDS request
2025-09-30T14:53:32.576210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42de3161-ef5bce8f-fa29cc3-22049124_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:32.583817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42de3161-ef5bce8f-fa29cc3-22049124_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:32.587373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:32.587388Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1234
2025-09-30T14:53:32.587610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1234 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:32.587649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1234 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:32.587653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1234 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:32.587657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:32.588020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1234 sessionId:  describe result for acl check
2025-09-30T14:53:32.588042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:32.588043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:32.588045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:32.588050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895499240846370:3199] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:32.588528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895499240846370:3199] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:32.593101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895499240846370:3199] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:32.598091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895499240846370:3199] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:32.598111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895499240846370:3199] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:32.598114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895499240846370:3199] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:32.598122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1234 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:32.600104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:32.601597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:32.601809Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:32.601813Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:32.601825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:32.601891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:32.601929Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895499151096995:7715]
2025-09-30T14:53:32.602616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:32.603050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:32.603102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:32.603454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:32.603530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:32.603532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:32.603533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:32.603534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:32.603535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:32.603537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:32.603538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:32.603539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:32.603541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:32.603542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:32.603543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.603545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.603546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.603547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:32.603548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:32.603556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:32.603567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:32.603572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:32.603577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:32.603582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:32.603586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:32.603590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:32.603594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:32.603598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:32.603602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:32.603607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.603612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.603616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.603621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:32.603625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:32.603632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:32.603640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:32.603646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:32.603652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:32.603656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:32.603661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:32.603666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:32.603671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:32.603676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:32.603681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:32.603686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:32.603691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:32.603696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:32.603701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:32.603706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:32.603711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:32.603949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:32.603966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:32.603973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:32.603979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:32.603986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.603991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.603997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.604002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.604007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.604013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.604017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:32.604022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:32.604027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:32.604031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:32.604078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:32.610175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:32.611088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:32.611095Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:32.611098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:32.611103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:32.611110Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1233 [2:7555895499151096995:7715]
2025-09-30T14:53:32.611127Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:32.611145Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:32.611148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:32.611150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:32.611153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:32.611169Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:32.611176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:32.611184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:32.611269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.611272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.611274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.611277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:32.611279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:32.611348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:32.611351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.611367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.611380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.611397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:32.611414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895499151096990:7715]
2025-09-30T14:53:32.611416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895499151096990:7715]
2025-09-30T14:53:32.611418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895499151096990:7715]
2025-09-30T14:53:32.611432Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:32.611447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:32.611459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:32.611462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:32.611465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:32.611472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:32.611473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:32.611496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895499151096990:7715]
2025-09-30T14:53:32.611500Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:32.611526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:32.612324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1233
2025-09-30T14:53:32.612355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1233
2025-09-30T14:53:32.612288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895499240846422:3199], now have 1 active actors on pipe
2025-09-30T14:53:32.612300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895499240846362:2454], now have 1 active actors on pipe
2025-09-30T14:53:32.612538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:32.612544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:32.612578Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6200c6fd-54d6f74f-a6e0707-2e973630_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:32.612588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:32.612593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:32.612596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:32.612607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:32.612620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:32.612632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:32.616068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:32.616091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:32.616120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:32.616288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1234 partition: 0 MaxSeqNo: 42 sessionId: src_id|6200c6fd-54d6f74f-a6e0707-2e973630_0
2025-09-30T14:53:32.616721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42de3161-ef5bce8f-fa29cc3-22049124_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6200c6fd-54d6f74f-a6e0707-2e973630_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:32.619717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6200c6fd-54d6f74f-a6e0707-2e973630_0] Write session: try to update token
2025-09-30T14:53:32.619738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6200c6fd-54d6f74f-a6e0707-2e973630_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:32.632426Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:32.632452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:32.632456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:32.632457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:32.632466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895499151096990:7715]
2025-09-30T14:53:32.632470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895499151096990:7715]
2025-09-30T14:53:32.632474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895499151096990:7715]
2025-09-30T14:53:32.632517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:32.632523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.632525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:32.632532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:32.632553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:32.632565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:32.632665Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:32.636357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1234 sessionId: src_id|6200c6fd-54d6f74f-a6e0707-2e973630_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:32.639172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:32.675779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895499240846460:3461]
2025-09-30T14:53:32.676098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1233, pipe: [1:7555895499240846460:3461]
2025-09-30T14:53:32.749857Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:32.750450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:32.750466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:32.750485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895499240846460:3461], now have 1 active actors on pipe
2025-09-30T14:53:32.750770Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:32.750741Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:32.750789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:32.750792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:32.750853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1234 reason: error at write: Disconnected sessionId: src_id|6200c6fd-54d6f74f-a6e0707-2e973630_0
2025-09-30T14:53:32.751017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895499240846460:3461]
2025-09-30T14:53:32.751041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1234 sessionId: src_id|6200c6fd-54d6f74f-a6e0707-2e973630_0 is DEAD
2025-09-30T14:53:32.753359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6200c6fd-54d6f74f-a6e0707-2e973630_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:32.753372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6200c6fd-54d6f74f-a6e0707-2e973630_0] Write session will restart in 0.005526s
2025-09-30T14:53:32.753395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6200c6fd-54d6f74f-a6e0707-2e973630_0] Write session: Do CDS request
2025-09-30T14:53:32.753403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6200c6fd-54d6f74f-a6e0707-2e973630_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:32.759888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6200c6fd-54d6f74f-a6e0707-2e973630_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:32.760039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:32.760056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1235
2025-09-30T14:53:32.760238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1235 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:32.760275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1235 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:32.760280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1235 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:32.760284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:32.760957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1235 sessionId:  describe result for acl check
2025-09-30T14:53:32.760989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:32.760996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:32.760998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:32.761004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895499240846489:3185] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:32.761547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895499240846489:3185] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:32.762450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:32.763654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895499240846489:3185] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:32.764247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:32.764433Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:32.764446Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:32.764457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:32.764509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:32.764560Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895499151097100:7730]
2025-09-30T14:53:32.765211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:32.765589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:32.765648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:32.766002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:32.766075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:32.766082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:32.766084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:32.766085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:32.766086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:32.766087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:32.766089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:32.766090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:32.766091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:32.766092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:32.766094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.766095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.766096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.766097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:32.766099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:32.766105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:32.766116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:32.766120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:32.766124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:32.766127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:32.766132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:32.766136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:32.766141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:32.766146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:32.766152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:32.766156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.766162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.766166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.766171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:32.766175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:32.766182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:32.766191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:32.766198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:32.766204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:32.766209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:32.766215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:32.766220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:32.766226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:32.766231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:32.766237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:32.766242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:32.766247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:32.766252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:32.766258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:32.766263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:32.766269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:32.766275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:32.766281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:32.766285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:32.766292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:32.766297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.766303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.766308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.766314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.766319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.766325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.766330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:32.766335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:32.766341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:32.766348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:32.766636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895499240846489:3185] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:32.766652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895499240846489:3185] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:32.766398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:32.766656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895499240846489:3185] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:32.766663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1235 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:32.772309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:32.773284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:32.773299Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:32.773302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:32.773306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:32.773312Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1234 [2:7555895499151097100:7730]
2025-09-30T14:53:32.773327Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:32.773342Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:32.773345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:32.773348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:32.773354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:32.773368Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:32.773380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:32.773398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:32.773453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.773461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.773463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.773467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:32.773469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:32.773531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:32.773538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.773551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.773571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.773595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:32.773617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895499240846529:3185], now have 1 active actors on pipe
2025-09-30T14:53:32.773626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895499240846461:2454], now have 1 active actors on pipe
2025-09-30T14:53:32.773632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895499151097095:7730]
2025-09-30T14:53:32.773638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895499151097095:7730]
2025-09-30T14:53:32.773641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895499151097095:7730]
2025-09-30T14:53:32.773654Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:32.773666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:32.773685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:32.773690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:32.773692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:32.773693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:32.773696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:32.773723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895499151097095:7730]
2025-09-30T14:53:32.773730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:32.773734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:32.773711Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1234
2025-09-30T14:53:32.773724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1234
2025-09-30T14:53:32.773765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:32.773773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:32.773799Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26bb2c6f-af168931-c9103919-5f7a8dc1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:32.773811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:32.773814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:32.773816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:32.773825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:32.773833Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:32.773845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:32.773981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:32.773994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:32.774030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:32.774150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1235 partition: 0 MaxSeqNo: 42 sessionId: src_id|26bb2c6f-af168931-c9103919-5f7a8dc1_0
2025-09-30T14:53:32.774507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6200c6fd-54d6f74f-a6e0707-2e973630_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|26bb2c6f-af168931-c9103919-5f7a8dc1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:32.777332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26bb2c6f-af168931-c9103919-5f7a8dc1_0] Write session: try to update token
2025-09-30T14:53:32.777351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26bb2c6f-af168931-c9103919-5f7a8dc1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:32.786934Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:32.786956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:32.786959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:32.786961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:32.786972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895499151097095:7730]
2025-09-30T14:53:32.786976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895499151097095:7730]
2025-09-30T14:53:32.786981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895499151097095:7730]
2025-09-30T14:53:32.787021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:32.787025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:32.787029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.787031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:32.787032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:32.787036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:32.787594Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:32.792037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1235 sessionId: src_id|26bb2c6f-af168931-c9103919-5f7a8dc1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:32.794773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:32.851404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895499240846539:3461]
2025-09-30T14:53:32.851695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1234, pipe: [1:7555895499240846539:3461]
2025-09-30T14:53:32.902538Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:32.902959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:32.902974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:32.903014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895499240846539:3461], now have 1 active actors on pipe
2025-09-30T14:53:32.903342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:32.903360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:32.903260Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:32.903426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1235 reason: error at write: Disconnected sessionId: src_id|26bb2c6f-af168931-c9103919-5f7a8dc1_0
2025-09-30T14:53:32.903641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1235 sessionId: src_id|26bb2c6f-af168931-c9103919-5f7a8dc1_0 is DEAD
2025-09-30T14:53:32.903862Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:32.904072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895499240846539:3461]
2025-09-30T14:53:32.907541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26bb2c6f-af168931-c9103919-5f7a8dc1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:32.907557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26bb2c6f-af168931-c9103919-5f7a8dc1_0] Write session will restart in 0.007963s
2025-09-30T14:53:32.907593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26bb2c6f-af168931-c9103919-5f7a8dc1_0] Write session: Do CDS request
2025-09-30T14:53:32.907603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26bb2c6f-af168931-c9103919-5f7a8dc1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:32.916825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:32.917640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26bb2c6f-af168931-c9103919-5f7a8dc1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:32.918086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:32.918107Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1236
2025-09-30T14:53:32.918309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1236 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:32.918358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1236 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:32.918368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1236 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:32.918372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:32.918661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:32.918884Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:32.918871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1236 sessionId:  describe result for acl check
2025-09-30T14:53:32.918898Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:32.918909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:32.918908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:32.918911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:32.918913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:32.918920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895499240846572:3180] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:32.918976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:32.919033Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895499151097169:7732]
2025-09-30T14:53:32.919528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895499240846572:3180] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:32.919727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:32.920036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:32.920085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:32.920420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:32.920503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:32.920513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:32.920514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:32.920515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:32.920516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:32.920518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:32.920519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:32.920520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:32.920522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:32.920523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:32.920525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.920526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.920527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.920528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:32.920529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:32.920536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:32.920545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:32.920550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:32.920554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:32.920557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:32.920562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:32.920565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:32.920569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:32.920573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:32.920578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:32.920583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.920587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.920592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.920596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:32.920600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:32.920607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:32.920615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:32.920622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:32.920628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:32.920633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:32.920638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:32.920645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:32.920650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:32.920654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:32.920659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:32.920664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:32.920670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:32.920675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:32.920681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:32.920685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:32.920692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:32.920702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:32.920708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:32.920717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:32.920723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:32.920731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.920736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.920745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.920751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.920759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.920764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.920769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:32.920778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:32.920782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:32.920788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:32.920835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:32.921234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895499240846572:3180] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:32.925902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895499240846572:3180] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:32.925922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895499240846572:3180] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:32.925927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895499240846572:3180] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:32.925936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1236 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:32.926320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:32.927233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:32.927267Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:32.927269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:32.927272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:32.927277Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1235 [2:7555895499151097169:7732]
2025-09-30T14:53:32.927291Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:32.927304Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:32.927307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:32.927310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:32.927313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:32.927329Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:32.927335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:32.927342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:32.927389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.927398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.927400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.927403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:32.927405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:32.927475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:32.927485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.927497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:32.927508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:32.927526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:32.927550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895499151097164:7732]
2025-09-30T14:53:32.927558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895499151097164:7732]
2025-09-30T14:53:32.927560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895499151097164:7732]
2025-09-30T14:53:32.927572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:32.927589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:32.927610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:32.927613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:32.927624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:32.927635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:32.927637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:32.927644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895499151097164:7732]
2025-09-30T14:53:32.927647Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:32.927717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:32.927833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895499240846540:2454], now have 1 active actors on pipe
2025-09-30T14:53:32.927845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895499240846609:3180], now have 1 active actors on pipe
2025-09-30T14:53:32.927923Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1235
2025-09-30T14:53:32.927959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1235
2025-09-30T14:53:32.927981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:32.928002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:32.928033Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87e820ac-b8ac668b-e5bb7f62-89633fe7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:32.928045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:32.928049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:32.928052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:32.928060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:32.928072Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:32.928090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:32.928278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:32.928287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:32.928302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:32.928414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1236 partition: 0 MaxSeqNo: 42 sessionId: src_id|87e820ac-b8ac668b-e5bb7f62-89633fe7_0
2025-09-30T14:53:32.928835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26bb2c6f-af168931-c9103919-5f7a8dc1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|87e820ac-b8ac668b-e5bb7f62-89633fe7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:32.931841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87e820ac-b8ac668b-e5bb7f62-89633fe7_0] Write session: try to update token
2025-09-30T14:53:32.931862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87e820ac-b8ac668b-e5bb7f62-89633fe7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:32.946744Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:32.946763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:32.946781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895499151097164:7732]
2025-09-30T14:53:32.946832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:32.947026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:32.947215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:32.947356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:32.947427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:32.947543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1236 sessionId: src_id|87e820ac-b8ac668b-e5bb7f62-89633fe7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:32.947579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:32.947789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:32.947841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:32.950522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:32.951150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:32.951172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:32.951190Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:32.951193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:32.951196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:32.951201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:32.951208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895499151097164:7732]
2025-09-30T14:53:32.951212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895499151097164:7732]
2025-09-30T14:53:32.951216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895499151097164:7732]
2025-09-30T14:53:32.951279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:32.951281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:32.951285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:32.951288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:32.951289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:32.951291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:32.951434Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:33.003926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895503535813914:3461]
2025-09-30T14:53:33.004195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1235, pipe: [1:7555895503535813914:3461]
2025-09-30T14:53:33.068771Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:33.069142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:33.069196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895503535813914:3461], now have 1 active actors on pipe
2025-09-30T14:53:33.069293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:33.069411Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:33.069478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895503535813914:3461]
2025-09-30T14:53:33.079375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:33.080721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:33.080737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:33.080765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1236 reason: error at write: Disconnected sessionId: src_id|87e820ac-b8ac668b-e5bb7f62-89633fe7_0
2025-09-30T14:53:33.080896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1236 sessionId: src_id|87e820ac-b8ac668b-e5bb7f62-89633fe7_0 is DEAD
2025-09-30T14:53:33.081070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87e820ac-b8ac668b-e5bb7f62-89633fe7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:33.081077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87e820ac-b8ac668b-e5bb7f62-89633fe7_0] Write session will restart in 0.007062s
2025-09-30T14:53:33.081100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87e820ac-b8ac668b-e5bb7f62-89633fe7_0] Write session: Do CDS request
2025-09-30T14:53:33.081110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87e820ac-b8ac668b-e5bb7f62-89633fe7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:33.086979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:33.087216Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:33.087225Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:33.087237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:33.087317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:33.087358Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895503446064535:7734]
2025-09-30T14:53:33.088016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:33.088353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:33.088419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:33.088758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:33.088808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:33.088813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:33.088814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:33.088814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:33.088815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:33.088816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:33.088816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:33.088817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:33.088818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:33.088819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:33.088820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.088820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.088821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.088822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:33.088823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:33.088826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:33.088835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:33.088839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:33.088841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:33.088844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:33.088846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:33.088848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:33.088850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:33.088852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:33.088855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:33.088857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.088859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.088862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.088864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:33.088866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:33.088874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:33.088878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:33.088884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:33.088887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:33.088890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:33.088893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:33.088895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:33.088898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:33.088901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:33.088904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:33.088907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:33.088909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:33.088914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:33.088918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:33.088922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:33.088927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:33.088931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:33.088938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:33.088941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:33.088946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:33.088949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.088954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.088958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.088962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.088966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.088970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.088974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:33.088979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:33.088983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:33.088986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:33.089009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:33.089963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87e820ac-b8ac668b-e5bb7f62-89633fe7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:33.090003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:33.090020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1237
2025-09-30T14:53:33.090352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1237 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:33.090391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1237 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:33.090410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1237 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:33.090419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:33.090825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1237 sessionId:  describe result for acl check
2025-09-30T14:53:33.090858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:33.090865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:33.090867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:33.090872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895503535813965:3168] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:33.091417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895503535813965:3168] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:33.094738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:33.095185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895503535813965:3168] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:33.095676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:33.095691Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:33.095694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:33.095698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:33.095705Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1236 [2:7555895503446064535:7734]
2025-09-30T14:53:33.095721Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:33.095735Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:33.095738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:33.095741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:33.095744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:33.095760Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:33.095766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:33.095774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:33.095833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.095835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.095837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.095840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:33.095842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:33.095905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:33.095907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.095918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.095930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.095947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:33.095965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895503446064529:7734]
2025-09-30T14:53:33.095976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895503446064529:7734]
2025-09-30T14:53:33.095978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895503446064529:7734]
2025-09-30T14:53:33.095990Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:33.095999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:33.096008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:33.096010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:33.096033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:33.096036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:33.096038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:33.096040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895503446064529:7734]
2025-09-30T14:53:33.096042Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:33.096044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:33.096151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895503535813927:2454], now have 1 active actors on pipe
2025-09-30T14:53:33.096559Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1236
2025-09-30T14:53:33.101879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895503535813965:3168] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:33.101899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895503535813965:3168] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:33.101902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895503535813965:3168] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:33.101911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1237 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:33.102184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895503535814006:3168], now have 1 active actors on pipe
2025-09-30T14:53:33.102239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1236
2025-09-30T14:53:33.102296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:33.102310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:33.102337Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6d31ef8-ffec75f3-77c91c02-991088b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:33.102354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:33.102361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:33.102364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:33.102377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:33.102394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:33.102411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:33.102621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:33.102629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:33.102642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:33.102753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1237 partition: 0 MaxSeqNo: 42 sessionId: src_id|d6d31ef8-ffec75f3-77c91c02-991088b9_0
2025-09-30T14:53:33.103182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87e820ac-b8ac668b-e5bb7f62-89633fe7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d6d31ef8-ffec75f3-77c91c02-991088b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:33.105922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d31ef8-ffec75f3-77c91c02-991088b9_0] Write session: try to update token
2025-09-30T14:53:33.105939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d31ef8-ffec75f3-77c91c02-991088b9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:33.108421Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:33.108442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:33.108452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895503446064529:7734]
2025-09-30T14:53:33.108499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:33.108511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:33.108675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:33.108824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:33.108975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:33.109125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:33.109316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:33.109359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:33.119786Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:33.119807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:33.119810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:33.119812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:33.119823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895503446064529:7734]
2025-09-30T14:53:33.119828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895503446064529:7734]
2025-09-30T14:53:33.119831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895503446064529:7734]
2025-09-30T14:53:33.119870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:33.119874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:33.119877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.119879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:33.119893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:33.119905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:33.120068Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:33.121935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1237 sessionId: src_id|d6d31ef8-ffec75f3-77c91c02-991088b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:33.124784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:33.169878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895503535814010:3461]
2025-09-30T14:53:33.170199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1236, pipe: [1:7555895503535814010:3461]
2025-09-30T14:53:33.236518Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:33.236836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:33.236850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:33.236870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895503535814010:3461], now have 1 active actors on pipe
2025-09-30T14:53:33.237104Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:33.237078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:33.237094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:33.237098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:33.237136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895503535814010:3461]
2025-09-30T14:53:33.237163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1237 reason: error at write: Disconnected sessionId: src_id|d6d31ef8-ffec75f3-77c91c02-991088b9_0
2025-09-30T14:53:33.237334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1237 sessionId: src_id|d6d31ef8-ffec75f3-77c91c02-991088b9_0 is DEAD
2025-09-30T14:53:33.237499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d31ef8-ffec75f3-77c91c02-991088b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:33.237507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d31ef8-ffec75f3-77c91c02-991088b9_0] Write session will restart in 0.006722s
2025-09-30T14:53:33.237529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d31ef8-ffec75f3-77c91c02-991088b9_0] Write session: Do CDS request
2025-09-30T14:53:33.237537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d31ef8-ffec75f3-77c91c02-991088b9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:33.245734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:33.246602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d31ef8-ffec75f3-77c91c02-991088b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:33.246681Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:33.246699Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1238
2025-09-30T14:53:33.246833Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1238 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:33.246878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1238 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:33.246888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1238 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:33.246892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:33.247348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:33.247431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1238 sessionId:  describe result for acl check
2025-09-30T14:53:33.247460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:33.247467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:33.247469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:33.247476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895503535814056:3167] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:33.247536Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:33.247545Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:33.247555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:33.247609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:33.247652Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895503446064619:7738]
2025-09-30T14:53:33.247994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895503535814056:3167] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:33.248237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:33.248562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:33.248619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:33.248944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:33.249030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:33.249038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:33.249039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:33.249041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:33.249042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:33.249046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:33.249047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:33.249049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:33.249050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:33.249052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:33.249053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.249055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.249056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.249058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:33.249059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:33.249065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:33.249076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:33.249080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:33.249085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:33.249090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:33.249094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:33.249098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:33.249102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:33.249107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:33.249111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:33.249115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.249119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.249124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.249128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:33.249133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:33.249141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:33.249154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:33.249160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:33.249167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:33.249172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:33.249178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:33.249191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:33.249197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:33.249206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:33.249212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:33.249216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:33.249227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:33.249232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:33.249241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:33.249245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:33.249255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:33.249263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:33.249273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:33.249278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:33.249288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:33.249294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.249299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.249308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.249314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.249321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.249326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.249335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:33.249341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:33.249350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:33.249357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:33.249409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:33.249952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895503535814056:3167] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:33.254572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895503535814056:3167] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:33.254588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895503535814056:3167] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:33.254592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895503535814056:3167] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:33.254601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1238 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:33.254892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:33.255846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:33.255864Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:33.255868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:33.255872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:33.255878Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1237 [2:7555895503446064619:7738]
2025-09-30T14:53:33.255892Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:33.255910Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:33.255912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:33.255915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:33.255919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:33.255934Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:33.255945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:33.255951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:33.256000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.256009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.256011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.256013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:33.256016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:33.256078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:33.256085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.256097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.256110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.256133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:33.256154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895503535814023:2454], now have 1 active actors on pipe
2025-09-30T14:53:33.256158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895503535814095:3167], now have 1 active actors on pipe
2025-09-30T14:53:33.256164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895503446064614:7738]
2025-09-30T14:53:33.256166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895503446064614:7738]
2025-09-30T14:53:33.256168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895503446064614:7738]
2025-09-30T14:53:33.256180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:33.256193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:33.256197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:33.256201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:33.256204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:33.256211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:33.256214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:33.256218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1237
2025-09-30T14:53:33.256230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1237
2025-09-30T14:53:33.256245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895503446064614:7738]
2025-09-30T14:53:33.256257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:33.256260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:33.256284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:33.256289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:33.256372Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6897d772-621a9d86-fc23e948-3bd15582_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:33.256388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:33.256392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:33.256394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:33.256403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:33.256412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:33.256434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:33.256563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:33.256571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:33.256584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:33.256674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1238 partition: 0 MaxSeqNo: 42 sessionId: src_id|6897d772-621a9d86-fc23e948-3bd15582_0
2025-09-30T14:53:33.257055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d31ef8-ffec75f3-77c91c02-991088b9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6897d772-621a9d86-fc23e948-3bd15582_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:33.259852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6897d772-621a9d86-fc23e948-3bd15582_0] Write session: try to update token
2025-09-30T14:53:33.259871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6897d772-621a9d86-fc23e948-3bd15582_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:33.268579Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:33.268601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:33.268604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:33.268605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:33.268615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895503446064614:7738]
2025-09-30T14:53:33.268619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895503446064614:7738]
2025-09-30T14:53:33.268623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895503446064614:7738]
2025-09-30T14:53:33.268663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:33.268664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:33.268668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:33.268672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:33.268686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.268689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:33.268823Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:33.277692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1238 sessionId: src_id|6897d772-621a9d86-fc23e948-3bd15582_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:33.284752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:33.343389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895503535814103:3461]
2025-09-30T14:53:33.344736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1237, pipe: [1:7555895503535814103:3461]
2025-09-30T14:53:33.385448Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:33.386037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:33.386068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:33.386087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895503535814103:3461], now have 1 active actors on pipe
2025-09-30T14:53:33.386413Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:33.386956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6897d772-621a9d86-fc23e948-3bd15582_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:33.386969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6897d772-621a9d86-fc23e948-3bd15582_0] Write session will restart in 0.006937s
2025-09-30T14:53:33.387001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6897d772-621a9d86-fc23e948-3bd15582_0] Write session: Do CDS request
2025-09-30T14:53:33.387008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6897d772-621a9d86-fc23e948-3bd15582_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:33.386379Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:33.386435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895503535814103:3461]
2025-09-30T14:53:33.386442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:33.386447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:33.386523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1238 reason: error at write: Disconnected sessionId: src_id|6897d772-621a9d86-fc23e948-3bd15582_0
2025-09-30T14:53:33.386744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1238 sessionId: src_id|6897d772-621a9d86-fc23e948-3bd15582_0 is DEAD
2025-09-30T14:53:33.395089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6897d772-621a9d86-fc23e948-3bd15582_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:33.395198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:33.395218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1239
2025-09-30T14:53:33.395365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1239 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:33.395403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1239 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:33.395422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1239 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:33.395430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:33.396064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1239 sessionId:  describe result for acl check
2025-09-30T14:53:33.396101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:33.396103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:33.396105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:33.396111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895503535814135:3160] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:33.396648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895503535814135:3160] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:33.397000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:33.399516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:33.399765Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:33.399776Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:33.399789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:33.399856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:33.399902Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895503446064692:7740]
2025-09-30T14:53:33.400657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:33.400713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895503535814135:3160] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:33.401074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:33.401121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:33.401519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:33.401604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:33.401610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:33.401611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:33.401612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:33.401614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:33.401615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:33.401634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:33.401635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:33.401637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:33.401638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:33.401639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.401640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.401641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.401642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:33.401643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:33.401649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:33.401659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:33.401663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:33.401666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:33.401670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:33.401674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:33.401677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:33.401681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:33.401684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:33.401691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:33.401695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.401698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.401702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.401706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:33.401710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:33.401718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:33.401725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:33.401731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:33.401736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:33.401740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:33.401745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:33.401749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:33.401756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:33.401760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:33.401764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:33.401769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:33.401774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:33.401778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:33.401783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:33.401787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:33.401792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:33.401796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:33.401801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:33.401809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:33.401814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:33.401825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.401830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.401836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.401845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.401849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.401855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.401862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:33.401867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:33.401872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:33.401877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:33.401934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:33.407844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895503535814135:3160] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:33.407873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895503535814135:3160] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:33.407880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895503535814135:3160] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:33.407888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1239 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:33.408185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:33.409846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:33.409861Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:33.409864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:33.409869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:33.409877Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1238 [2:7555895503446064692:7740]
2025-09-30T14:53:33.409893Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:33.409906Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:33.409914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:33.409917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:33.409919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:33.409937Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:33.409943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:33.409949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:33.410008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.410016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.410018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.410021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:33.410024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:33.410102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:33.410109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.410122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.410138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.410161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:33.410185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895503535814104:2454], now have 1 active actors on pipe
2025-09-30T14:53:33.410193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895503535814177:3160], now have 1 active actors on pipe
2025-09-30T14:53:33.410199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895503446064686:7740]
2025-09-30T14:53:33.410202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895503446064686:7740]
2025-09-30T14:53:33.410204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895503446064686:7740]
2025-09-30T14:53:33.410221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:33.410242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:33.410245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:33.410249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:33.410252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:33.410257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:33.410260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:33.410294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895503446064686:7740]
2025-09-30T14:53:33.410304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:33.410321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:33.410311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1238
2025-09-30T14:53:33.410315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1238
2025-09-30T14:53:33.410397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:33.410406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:33.410429Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2431cc88-cbc24adb-851f4b7f-ea5ff779_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:33.410442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:33.410446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:33.410448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:33.410458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:33.410466Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:33.410485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:33.410642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:33.410654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:33.410675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:33.410772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1239 partition: 0 MaxSeqNo: 42 sessionId: src_id|2431cc88-cbc24adb-851f4b7f-ea5ff779_0
2025-09-30T14:53:33.411188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6897d772-621a9d86-fc23e948-3bd15582_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2431cc88-cbc24adb-851f4b7f-ea5ff779_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:33.418277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2431cc88-cbc24adb-851f4b7f-ea5ff779_0] Write session: try to update token
2025-09-30T14:53:33.418301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2431cc88-cbc24adb-851f4b7f-ea5ff779_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:33.424300Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:33.424319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:33.424330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895503446064686:7740]
2025-09-30T14:53:33.424381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:33.424381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:33.424751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:33.425119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:33.425301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:33.425461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:33.425657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:33.425694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:33.434814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1239 sessionId: src_id|2431cc88-cbc24adb-851f4b7f-ea5ff779_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:33.437819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:33.438682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:33.438708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:33.438732Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:33.438735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:33.438738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:33.438741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:33.438751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895503446064686:7740]
2025-09-30T14:53:33.438754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895503446064686:7740]
2025-09-30T14:53:33.438758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895503446064686:7740]
2025-09-30T14:53:33.438801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:33.438806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:33.438812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.438816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:33.438817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:33.438821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:33.438958Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:33.486795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895503535814185:3461]
2025-09-30T14:53:33.487094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1238, pipe: [1:7555895503535814185:3461]
2025-09-30T14:53:33.553314Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:33.553634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:33.553674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895503535814185:3461], now have 1 active actors on pipe
2025-09-30T14:53:33.553793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:33.553835Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:33.553880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895503535814185:3461]
2025-09-30T14:53:33.553891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:33.553894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:33.553975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1239 reason: error at write: Disconnected sessionId: src_id|2431cc88-cbc24adb-851f4b7f-ea5ff779_0
2025-09-30T14:53:33.554145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1239 sessionId: src_id|2431cc88-cbc24adb-851f4b7f-ea5ff779_0 is DEAD
2025-09-30T14:53:33.554338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2431cc88-cbc24adb-851f4b7f-ea5ff779_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:33.554350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2431cc88-cbc24adb-851f4b7f-ea5ff779_0] Write session will restart in 0.008676s
2025-09-30T14:53:33.554379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2431cc88-cbc24adb-851f4b7f-ea5ff779_0] Write session: Do CDS request
2025-09-30T14:53:33.554385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2431cc88-cbc24adb-851f4b7f-ea5ff779_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:33.563795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2431cc88-cbc24adb-851f4b7f-ea5ff779_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:33.563901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:33.563916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1240
2025-09-30T14:53:33.564041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1240 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:33.564066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1240 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:33.564073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1240 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:33.564076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:33.564485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1240 sessionId:  describe result for acl check
2025-09-30T14:53:33.564523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:33.564530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:33.564532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:33.564537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895503535814222:3156] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:33.565058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895503535814222:3156] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:33.566767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895503535814222:3156] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:33.567833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:33.569141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:33.569350Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:33.569360Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:33.569372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:33.569434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:33.569452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895503535814222:3156] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:33.569469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895503535814222:3156] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:33.569473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895503535814222:3156] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:33.569480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1240 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:33.569473Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895503446064765:7742]
2025-09-30T14:53:33.570145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:33.570438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:33.570490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:33.570843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:33.570917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:33.570925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:33.570926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:33.570930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:33.570931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:33.570932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:33.570934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:33.570935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:33.570936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:33.570938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:33.570939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.570940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.570942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.570943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:33.570944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:33.570950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:33.570961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:33.570966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:33.570971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:33.570975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:33.570980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:33.570984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:33.570988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:33.570992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:33.570996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:33.571000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.571004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.571008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.571013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:33.571017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:33.571029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:33.571042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:33.571052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:33.571063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:33.571074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:33.571084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:33.571093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:33.571098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:33.571108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:33.571118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:33.571123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:33.571128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:33.571133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:33.571142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:33.571149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:33.571155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:33.571165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:33.571174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:33.571182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:33.571187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:33.571191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.571200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.571205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.571215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.571219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.571224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.571231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:33.571236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:33.571265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:33.571270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:33.571317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:33.577405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:33.578385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:33.578402Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:33.578405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:33.578413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:33.578419Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1239 [2:7555895503446064765:7742]
2025-09-30T14:53:33.578437Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:33.578463Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:33.578466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:33.578469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:33.578471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:33.578486Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:33.578494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:33.578502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:33.578567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.578575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.578578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.578581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:33.578584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:33.578651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:33.578659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.578671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.578682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.578704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:33.578727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895503535814188:2454], now have 1 active actors on pipe
2025-09-30T14:53:33.578737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895503535814258:3156], now have 1 active actors on pipe
2025-09-30T14:53:33.578743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895503446064760:7742]
2025-09-30T14:53:33.578747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895503446064760:7742]
2025-09-30T14:53:33.578750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895503446064760:7742]
2025-09-30T14:53:33.578763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:33.578781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:33.578781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:33.578785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:33.578787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:33.578801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:33.578805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:33.578801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1239
2025-09-30T14:53:33.578822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1239
2025-09-30T14:53:33.578856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895503446064760:7742]
2025-09-30T14:53:33.578868Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:33.578876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:33.578888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:33.578892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:33.578938Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|377e2ee-a21ff306-b4fa115-d5a767_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:33.578953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:33.578956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:33.578959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:33.578969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:33.578982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:33.579002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:33.579144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:33.579151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:33.579165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:33.579270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1240 partition: 0 MaxSeqNo: 42 sessionId: src_id|377e2ee-a21ff306-b4fa115-d5a767_0
2025-09-30T14:53:33.579668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2431cc88-cbc24adb-851f4b7f-ea5ff779_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|377e2ee-a21ff306-b4fa115-d5a767_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:33.582546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|377e2ee-a21ff306-b4fa115-d5a767_0] Write session: try to update token
2025-09-30T14:53:33.582567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|377e2ee-a21ff306-b4fa115-d5a767_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:33.591745Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:33.591767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:33.591769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:33.591774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:33.591783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895503446064760:7742]
2025-09-30T14:53:33.591787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895503446064760:7742]
2025-09-30T14:53:33.591791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895503446064760:7742]
2025-09-30T14:53:33.591831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:33.591834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:33.591837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.591839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:33.591841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:33.591845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:33.591974Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:33.597424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1240 sessionId: src_id|377e2ee-a21ff306-b4fa115-d5a767_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:33.600471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:33.654233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895503535814271:3461]
2025-09-30T14:53:33.654536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1239, pipe: [1:7555895503535814271:3461]
2025-09-30T14:53:33.709460Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:33.709811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:33.709826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:33.709863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895503535814271:3461], now have 1 active actors on pipe
2025-09-30T14:53:33.710100Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:33.710487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:33.710571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1240 reason: status is not ok: tablet will be restarted right now sessionId: src_id|377e2ee-a21ff306-b4fa115-d5a767_0
2025-09-30T14:53:33.710762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1240 sessionId: src_id|377e2ee-a21ff306-b4fa115-d5a767_0 is DEAD
2025-09-30T14:53:33.710948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|377e2ee-a21ff306-b4fa115-d5a767_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:33.710959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|377e2ee-a21ff306-b4fa115-d5a767_0] Write session will restart in 0.006551s
2025-09-30T14:53:33.710929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:33.710985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|377e2ee-a21ff306-b4fa115-d5a767_0] Write session: Do CDS request
2025-09-30T14:53:33.710976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895503535814271:3461]
2025-09-30T14:53:33.710991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|377e2ee-a21ff306-b4fa115-d5a767_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:33.718785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|377e2ee-a21ff306-b4fa115-d5a767_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:33.718895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:33.718920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1241
2025-09-30T14:53:33.719066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1241 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:33.719108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1241 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:33.719123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1241 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:33.719127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:33.719574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1241 sessionId:  describe result for acl check
2025-09-30T14:53:33.719609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:33.719616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:33.719617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:33.719624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895503535814332:3133] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:33.719745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:33.720112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895503535814332:3133] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:33.721470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:33.721674Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:33.721686Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:33.721698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:33.721789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:33.721832Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895503446064876:7751]
2025-09-30T14:53:33.721966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895503535814332:3133] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:33.722562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:33.722844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:33.722900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:33.723275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:33.723347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:33.723356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:33.723357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:33.723358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:33.723359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:33.723360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:33.723362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:33.723363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:33.723364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:33.723365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:33.723367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.723368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.723369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.723370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:33.723372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:33.723377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:33.723387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:33.723392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:33.723396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:33.723401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:33.723405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:33.723409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:33.723413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:33.723417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:33.723422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:33.723426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.723430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.723434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.723439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:33.723444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:33.723452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:33.723460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:33.723468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:33.723474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:33.723479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:33.723484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:33.723489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:33.723494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:33.723502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:33.723507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:33.723512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:33.723518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:33.723523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:33.723529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:33.723533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:33.723539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:33.723546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:33.723552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:33.723557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:33.723563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:33.723568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.723573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.723578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.723583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.723588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.723594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.723599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:33.723604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:33.723609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:33.723614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:33.723658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:33.724964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895503535814332:3133] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:33.724981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895503535814332:3133] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:33.724984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895503535814332:3133] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:33.724992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1241 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:33.729834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:33.730914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:33.730926Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:33.730929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:33.730936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:33.730943Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1240 [2:7555895503446064876:7751]
2025-09-30T14:53:33.730959Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:33.730974Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:33.730984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:33.730988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:33.730990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:33.731005Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:33.731016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:33.731022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:33.731084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.731093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.731095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.731098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:33.731101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:33.731178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:33.731190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.731203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.731215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.731232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:33.731266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895503535814285:2454], now have 1 active actors on pipe
2025-09-30T14:53:33.731273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895503535814368:3133], now have 1 active actors on pipe
2025-09-30T14:53:33.731279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895503446064871:7751]
2025-09-30T14:53:33.731282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895503446064871:7751]
2025-09-30T14:53:33.731283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895503446064871:7751]
2025-09-30T14:53:33.731302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1240
2025-09-30T14:53:33.731304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1240
2025-09-30T14:53:33.731297Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:33.731315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:33.731329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:33.731327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:33.731331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:33.731332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:33.731334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:33.731388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:33.731398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:33.731409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895503446064871:7751]
2025-09-30T14:53:33.731420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:33.731435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:33.731452Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5cd2b552-abb9396d-de69d82c-bc6d82e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:33.731462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:33.731473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:33.731476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:33.731486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:33.731499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:33.731527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:33.731720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:33.731733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:33.731749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:33.731864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1241 partition: 0 MaxSeqNo: 42 sessionId: src_id|5cd2b552-abb9396d-de69d82c-bc6d82e7_0
2025-09-30T14:53:33.732252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|377e2ee-a21ff306-b4fa115-d5a767_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5cd2b552-abb9396d-de69d82c-bc6d82e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:33.735170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd2b552-abb9396d-de69d82c-bc6d82e7_0] Write session: try to update token
2025-09-30T14:53:33.735187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd2b552-abb9396d-de69d82c-bc6d82e7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:33.744750Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:33.744775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:33.744777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:33.744780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:33.744790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895503446064871:7751]
2025-09-30T14:53:33.744795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895503446064871:7751]
2025-09-30T14:53:33.744799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895503446064871:7751]
2025-09-30T14:53:33.744842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:33.744853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.744856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:33.745002Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:33.745163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:33.745178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:33.745183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:33.750702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1241 sessionId: src_id|5cd2b552-abb9396d-de69d82c-bc6d82e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:33.753755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:33.811400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895503535814376:3461]
2025-09-30T14:53:33.811724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1240, pipe: [1:7555895503535814376:3461]
2025-09-30T14:53:33.859603Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:33.859997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:33.860012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:33.860050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895503535814376:3461], now have 1 active actors on pipe
2025-09-30T14:53:33.860277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:33.860296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:33.860373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1241 reason: error at write: Disconnected sessionId: src_id|5cd2b552-abb9396d-de69d82c-bc6d82e7_0
2025-09-30T14:53:33.860263Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:33.860557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1241 sessionId: src_id|5cd2b552-abb9396d-de69d82c-bc6d82e7_0 is DEAD
2025-09-30T14:53:33.860730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895503535814376:3461]
2025-09-30T14:53:33.860741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd2b552-abb9396d-de69d82c-bc6d82e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:33.860752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd2b552-abb9396d-de69d82c-bc6d82e7_0] Write session will restart in 0.006851s
2025-09-30T14:53:33.860758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:33.860775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd2b552-abb9396d-de69d82c-bc6d82e7_0] Write session: Do CDS request
2025-09-30T14:53:33.860783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd2b552-abb9396d-de69d82c-bc6d82e7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:33.868758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd2b552-abb9396d-de69d82c-bc6d82e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:33.868859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:33.868876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1242
2025-09-30T14:53:33.869041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1242 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:33.869078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1242 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:33.869086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1242 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:33.869091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:33.869259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:33.869561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1242 sessionId:  describe result for acl check
2025-09-30T14:53:33.869598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:33.869604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:33.869606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:33.869613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895503535814413:3129] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:33.870154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895503535814413:3129] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:33.870700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:33.870910Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:33.870921Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:33.870932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:33.870999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:33.871043Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895503446064950:7759]
2025-09-30T14:53:33.871705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:33.871978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:33.872037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:33.872316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895503535814413:3129] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:33.872437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:33.872502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:33.872509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:33.872510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:33.872511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:33.872513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:33.872514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:33.872516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:33.872517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:33.872519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:33.872520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:33.872521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.872523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.872524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.872525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:33.872527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:33.872533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:33.872544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:33.872548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:33.872554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:33.872559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:33.872563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:33.872568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:33.872572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:33.872576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:33.872581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:33.872585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.872590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.872595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.872599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:33.872604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:33.872612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:33.872623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:33.872634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:33.872641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:33.872651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:33.872657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:33.872662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:33.872672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:33.872694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:33.872706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:33.872711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:33.872717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:33.872723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:33.872728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:33.872733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:33.872738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:33.872743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:33.872749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:33.872762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:33.872768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:33.872777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.872783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.872787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.872797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.872802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.872807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.872816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:33.872822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:33.872832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:33.872847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:33.872924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:33.878708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895503535814413:3129] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:33.878726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895503535814413:3129] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:33.878730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895503535814413:3129] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:33.878739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1242 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:33.879110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:33.879998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:33.880013Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:33.880015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:33.880018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:33.880023Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1241 [2:7555895503446064950:7759]
2025-09-30T14:53:33.880035Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:33.880047Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:33.880049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:33.880051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:33.880052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:33.880067Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:33.880075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:33.880080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:33.880142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.880150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.880152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.880156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:33.880159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:33.880210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:33.880215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.880224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:33.880230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:33.880243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:33.880259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895503446064945:7759]
2025-09-30T14:53:33.880263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895503446064945:7759]
2025-09-30T14:53:33.880264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895503446064945:7759]
2025-09-30T14:53:33.880271Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:33.880282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:33.880285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:33.880289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:33.880291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:33.880297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:33.880299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:33.880308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895503535814377:2454], now have 1 active actors on pipe
2025-09-30T14:53:33.880312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895503535814453:3129], now have 1 active actors on pipe
2025-09-30T14:53:33.880342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895503446064945:7759]
2025-09-30T14:53:33.880353Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:33.880364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:33.880363Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1241
2025-09-30T14:53:33.880369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1241
2025-09-30T14:53:33.880502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:33.880520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:33.880551Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bdd75e45-93994a33-c43a31ea-8cdced17_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:33.880564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:33.880569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:33.880572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:33.880581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:33.880592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:33.880607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:33.880760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:33.880768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:33.880782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:33.880930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1242 partition: 0 MaxSeqNo: 42 sessionId: src_id|bdd75e45-93994a33-c43a31ea-8cdced17_0
2025-09-30T14:53:33.881291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd2b552-abb9396d-de69d82c-bc6d82e7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bdd75e45-93994a33-c43a31ea-8cdced17_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:33.884233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdd75e45-93994a33-c43a31ea-8cdced17_0] Write session: try to update token
2025-09-30T14:53:33.884251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdd75e45-93994a33-c43a31ea-8cdced17_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:33.893734Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:33.893759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:33.893762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:33.893764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:33.893776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895503446064945:7759]
2025-09-30T14:53:33.893782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895503446064945:7759]
2025-09-30T14:53:33.893788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895503446064945:7759]
2025-09-30T14:53:33.893833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:33.893842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:33.893841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:33.893845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:33.893850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:33.893856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:33.894027Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:33.903515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1242 sessionId: src_id|bdd75e45-93994a33-c43a31ea-8cdced17_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:33.906210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:33.960888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895503535814460:3461]
2025-09-30T14:53:33.961173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1241, pipe: [1:7555895503535814460:3461]
2025-09-30T14:53:34.006241Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:34.006600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:34.006616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:34.006635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895503535814460:3461], now have 1 active actors on pipe
2025-09-30T14:53:34.006876Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:34.006864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:34.006943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:34.006947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895503535814460:3461]
2025-09-30T14:53:34.007028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1242 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bdd75e45-93994a33-c43a31ea-8cdced17_0
2025-09-30T14:53:34.007204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1242 sessionId: src_id|bdd75e45-93994a33-c43a31ea-8cdced17_0 is DEAD
2025-09-30T14:53:34.007369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdd75e45-93994a33-c43a31ea-8cdced17_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:34.007380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdd75e45-93994a33-c43a31ea-8cdced17_0] Write session will restart in 0.008871s
2025-09-30T14:53:34.007403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdd75e45-93994a33-c43a31ea-8cdced17_0] Write session: Do CDS request
2025-09-30T14:53:34.007410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdd75e45-93994a33-c43a31ea-8cdced17_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:34.016745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:34.017795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdd75e45-93994a33-c43a31ea-8cdced17_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:34.017889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:34.017906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1243
2025-09-30T14:53:34.018062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1243 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:34.018100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1243 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:34.018110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1243 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:34.018115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:34.018520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:34.018537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1243 sessionId:  describe result for acl check
2025-09-30T14:53:34.018576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:34.018578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:34.018580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:34.018585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895507830781797:3123] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:34.018745Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:34.018756Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:34.018768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:34.018830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:34.018868Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895507741032323:7761]
2025-09-30T14:53:34.019123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895507830781797:3123] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:34.019537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:34.019873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:34.019930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:34.020266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:34.020356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:34.020362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:34.020363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:34.020364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:34.020365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:34.020366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:34.020367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:34.020368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:34.020370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:34.020371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:34.020372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.020373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.020374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.020376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:34.020377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:34.020382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:34.020391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:34.020396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:34.020400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:34.020403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:34.020407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:34.020410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:34.020423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:34.020426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:34.020430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:34.020433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.020436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.020439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.020442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:34.020446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:34.020453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:34.020460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:34.020466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:34.020472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:34.020481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:34.020485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:34.020490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:34.020495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:34.020502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:34.020508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:34.020517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:34.020522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:34.020526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:34.020531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:34.020539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:34.020544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:34.020548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:34.020553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:34.020558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:34.020563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:34.020568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.020572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.020576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.020580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.020586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.020590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.020599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:34.020604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:34.020608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:34.020617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:34.020664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:34.021104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895507830781797:3123] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:34.025919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895507830781797:3123] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:34.025936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895507830781797:3123] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:34.025940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895507830781797:3123] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:34.025957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1243 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:34.026141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:34.026968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:34.026983Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:34.026986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:34.026989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:34.026996Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1242 [2:7555895507741032323:7761]
2025-09-30T14:53:34.027013Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:34.027026Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:34.027030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:34.027033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:34.027035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:34.027052Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:34.027059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:34.027068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:34.027116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.027122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.027123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.027125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:34.027126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:34.027173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:34.027180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.027188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.027194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.027204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:34.027216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895507741032317:7761]
2025-09-30T14:53:34.027218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895507741032317:7761]
2025-09-30T14:53:34.027221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895507741032317:7761]
2025-09-30T14:53:34.027227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:34.027240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895507830781835:3123], now have 1 active actors on pipe
2025-09-30T14:53:34.027239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:34.027260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:34.027262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:34.027264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895507830781758:2454], now have 1 active actors on pipe
2025-09-30T14:53:34.027269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:34.027283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:34.027286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:34.027305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1242
2025-09-30T14:53:34.027314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895507741032317:7761]
2025-09-30T14:53:34.027324Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:34.027336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:34.027342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1242
2025-09-30T14:53:34.027361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:34.027381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:34.027422Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11b2d4b3-d813ff8b-ac4658d3-d5d2e7be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:34.027434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:34.027437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:34.027439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:34.027450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:34.027459Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:34.027472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:34.027629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:34.027637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:34.027650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:34.027745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1243 partition: 0 MaxSeqNo: 42 sessionId: src_id|11b2d4b3-d813ff8b-ac4658d3-d5d2e7be_0
2025-09-30T14:53:34.028102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdd75e45-93994a33-c43a31ea-8cdced17_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|11b2d4b3-d813ff8b-ac4658d3-d5d2e7be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:34.030979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11b2d4b3-d813ff8b-ac4658d3-d5d2e7be_0] Write session: try to update token
2025-09-30T14:53:34.031000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11b2d4b3-d813ff8b-ac4658d3-d5d2e7be_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:34.040398Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:34.040417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:34.040419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:34.040421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:34.040430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895507741032317:7761]
2025-09-30T14:53:34.040436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895507741032317:7761]
2025-09-30T14:53:34.040439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895507741032317:7761]
2025-09-30T14:53:34.040480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:34.040483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:34.040485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.040488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:34.040490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:34.040495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:34.040672Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:34.045698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1243 sessionId: src_id|11b2d4b3-d813ff8b-ac4658d3-d5d2e7be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:34.048501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:34.107365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895507830781850:3461]
2025-09-30T14:53:34.107719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1242, pipe: [1:7555895507830781850:3461]
2025-09-30T14:53:34.152270Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:34.152714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:34.152730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:34.152772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895507830781850:3461], now have 1 active actors on pipe
2025-09-30T14:53:34.155553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:34.155570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:34.155571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895507830781850:3461]
2025-09-30T14:53:34.155594Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:34.155648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1243 reason: error at write: Disconnected sessionId: src_id|11b2d4b3-d813ff8b-ac4658d3-d5d2e7be_0
2025-09-30T14:53:34.155864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1243 sessionId: src_id|11b2d4b3-d813ff8b-ac4658d3-d5d2e7be_0 is DEAD
2025-09-30T14:53:34.156023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11b2d4b3-d813ff8b-ac4658d3-d5d2e7be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:34.156035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11b2d4b3-d813ff8b-ac4658d3-d5d2e7be_0] Write session will restart in 0.007901s
2025-09-30T14:53:34.156062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11b2d4b3-d813ff8b-ac4658d3-d5d2e7be_0] Write session: Do CDS request
2025-09-30T14:53:34.156068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11b2d4b3-d813ff8b-ac4658d3-d5d2e7be_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:34.156229Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:34.165157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11b2d4b3-d813ff8b-ac4658d3-d5d2e7be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:34.165281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:34.165301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1244
2025-09-30T14:53:34.165427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1244 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:34.165458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1244 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:34.165468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1244 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:34.165472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:34.165919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1244 sessionId:  describe result for acl check
2025-09-30T14:53:34.165957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:34.165961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:34.165965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:34.165971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895507830781890:3119] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:34.166486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895507830781890:3119] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:34.166872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:34.168750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895507830781890:3119] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:34.168869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:34.169068Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:34.169075Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:34.169085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:34.169135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:34.169177Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895507741032402:7763]
2025-09-30T14:53:34.169848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:34.170196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:34.170240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:34.170575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:34.170642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:34.170649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:34.170650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:34.170651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:34.170652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:34.170654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:34.170655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:34.170657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:34.170658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:34.170659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:34.170661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.170662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.170663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.170665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:34.170666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:34.170672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:34.170683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:34.170688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:34.170693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:34.170698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:34.170703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:34.170708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:34.170712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:34.170717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:34.170722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:34.170727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.170731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.170738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.170742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:34.170747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:34.170754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:34.170762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:34.170768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:34.170775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:34.170779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:34.170785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:34.170790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:34.170796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:34.170801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:34.170807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:34.170812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:34.170823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:34.170828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:34.170834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:34.170839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:34.170846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:34.170852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:34.170864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:34.170869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:34.170875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:34.170880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.170886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.170891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.170896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.170902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.170908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.170912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:34.170918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:34.170924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:34.170929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:34.170979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:34.176093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895507830781890:3119] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:34.176112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895507830781890:3119] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:34.176116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895507830781890:3119] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:34.176125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1244 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:34.176835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:34.177727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:34.177743Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:34.177746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:34.177751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:34.177759Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1243 [2:7555895507741032402:7763]
2025-09-30T14:53:34.177778Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:34.177795Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:34.177798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:34.177802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:34.177804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:34.177820Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:34.177832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:34.177839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:34.177905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.177913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.177915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.177919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:34.177923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:34.177989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:34.177998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.178010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.178023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.178050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:34.178069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895507830781852:2454], now have 1 active actors on pipe
2025-09-30T14:53:34.178077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895507830781929:3119], now have 1 active actors on pipe
2025-09-30T14:53:34.178084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895507741032396:7763]
2025-09-30T14:53:34.178086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895507741032396:7763]
2025-09-30T14:53:34.178088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895507741032396:7763]
2025-09-30T14:53:34.178101Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:34.178120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:34.178126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:34.178131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:34.178134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:34.178137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:34.178141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:34.178147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1243
2025-09-30T14:53:34.178164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1243
2025-09-30T14:53:34.178172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895507741032396:7763]
2025-09-30T14:53:34.178182Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:34.178185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:34.178209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:34.178213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:34.178265Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|209c2e30-5c09226e-93e3d695-21d47f57_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:34.178277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:34.178283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:34.178290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:34.178299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:34.178309Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:34.178328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:34.178522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:34.178536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:34.178561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:34.178649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1244 partition: 0 MaxSeqNo: 42 sessionId: src_id|209c2e30-5c09226e-93e3d695-21d47f57_0
2025-09-30T14:53:34.179058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11b2d4b3-d813ff8b-ac4658d3-d5d2e7be_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|209c2e30-5c09226e-93e3d695-21d47f57_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:34.182029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|209c2e30-5c09226e-93e3d695-21d47f57_0] Write session: try to update token
2025-09-30T14:53:34.182064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|209c2e30-5c09226e-93e3d695-21d47f57_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:34.190692Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:34.190709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:34.190712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:34.190713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:34.190724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895507741032396:7763]
2025-09-30T14:53:34.190729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895507741032396:7763]
2025-09-30T14:53:34.190733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895507741032396:7763]
2025-09-30T14:53:34.190776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:34.190777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:34.190783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.190784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:34.190786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:34.190789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:34.190924Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:34.197315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1244 sessionId: src_id|209c2e30-5c09226e-93e3d695-21d47f57_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:34.200117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:34.255814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895507830781949:3461]
2025-09-30T14:53:34.256174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1243, pipe: [1:7555895507830781949:3461]
2025-09-30T14:53:34.305724Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:34.306088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:34.306105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:34.306145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895507830781949:3461], now have 1 active actors on pipe
2025-09-30T14:53:34.306373Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:34.306993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|209c2e30-5c09226e-93e3d695-21d47f57_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:34.307003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|209c2e30-5c09226e-93e3d695-21d47f57_0] Write session will restart in 0.006834s
2025-09-30T14:53:34.307026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|209c2e30-5c09226e-93e3d695-21d47f57_0] Write session: Do CDS request
2025-09-30T14:53:34.307031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|209c2e30-5c09226e-93e3d695-21d47f57_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:34.306376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:34.306381Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:34.306395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:34.306430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895507830781949:3461]
2025-09-30T14:53:34.306475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1244 reason: error at write: Disconnected sessionId: src_id|209c2e30-5c09226e-93e3d695-21d47f57_0
2025-09-30T14:53:34.306704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1244 sessionId: src_id|209c2e30-5c09226e-93e3d695-21d47f57_0 is DEAD
2025-09-30T14:53:34.315791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|209c2e30-5c09226e-93e3d695-21d47f57_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:34.316265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:34.318862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:34.319105Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:34.319119Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:34.319131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:34.319197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:34.319273Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895507741032492:7767]
2025-09-30T14:53:34.319614Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:34.319631Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1245
2025-09-30T14:53:34.319790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1245 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:34.319824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1245 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:34.319830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1245 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:34.319835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:34.319979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:34.320236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1245 sessionId:  describe result for acl check
2025-09-30T14:53:34.320272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:34.320274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:34.320276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:34.320282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895507830781994:3115] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:34.320839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895507830781994:3115] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:34.322326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:34.322404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:34.322858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:34.322943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:34.322950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:34.322952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:34.322953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:34.322954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:34.322956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:34.322958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:34.322959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:34.322960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:34.322962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:34.322963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.322965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.322966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.322968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:34.322969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:34.322976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:34.322987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:34.322992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:34.322996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:34.323000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:34.323004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:34.323008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:34.323013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:34.323017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:34.323022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:34.323028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.323031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.323035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.323040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:34.323045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:34.323053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:34.323062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:34.323069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:34.323075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:34.323080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:34.323087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:34.323093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:34.323099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:34.323105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:34.323111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:34.323116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:34.323122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:34.323135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:34.323142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:34.323147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:34.323154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:34.323160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:34.323166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:34.323171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:34.323177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:34.323183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.323189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.323194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.323200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.323206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.323212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.323218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:34.323224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:34.323230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:34.323259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:34.323305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:34.324015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895507830781994:3115] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:34.329538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:34.330549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895507830781994:3115] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:34.330585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895507830781994:3115] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:34.330589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895507830781994:3115] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:34.330598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1245 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:34.330671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:34.330695Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:34.330698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:34.330702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:34.330709Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1244 [2:7555895507741032492:7767]
2025-09-30T14:53:34.330731Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:34.330763Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:34.330772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:34.330775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:34.330778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:34.330795Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:34.330807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:34.330814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:34.330880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.330889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.330891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.330894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:34.330899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:34.330966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:34.330973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.330988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.331006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.331030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:34.331047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895507830781951:2454], now have 1 active actors on pipe
2025-09-30T14:53:34.331056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895507830782030:3115], now have 1 active actors on pipe
2025-09-30T14:53:34.331062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895507741032486:7767]
2025-09-30T14:53:34.331065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895507741032486:7767]
2025-09-30T14:53:34.331067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895507741032486:7767]
2025-09-30T14:53:34.331080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:34.331099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:34.331107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:34.331111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:34.331114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:34.331118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:34.331122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:34.331134Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1244
2025-09-30T14:53:34.331155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895507741032486:7767]
2025-09-30T14:53:34.331155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1244
2025-09-30T14:53:34.331164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:34.331173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:34.331196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:34.331205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:34.331239Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b4dc111-aad55a2e-d464bdd9-1584ce61_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:34.331269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:34.331273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:34.331274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:34.331284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:34.331293Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:34.331313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:34.331519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:34.331529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:34.331546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:34.331649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1245 partition: 0 MaxSeqNo: 42 sessionId: src_id|7b4dc111-aad55a2e-d464bdd9-1584ce61_0
2025-09-30T14:53:34.332105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|209c2e30-5c09226e-93e3d695-21d47f57_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7b4dc111-aad55a2e-d464bdd9-1584ce61_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:34.335027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b4dc111-aad55a2e-d464bdd9-1584ce61_0] Write session: try to update token
2025-09-30T14:53:34.335048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b4dc111-aad55a2e-d464bdd9-1584ce61_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:34.344019Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:34.344036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:34.344038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:34.344044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:34.344056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895507741032486:7767]
2025-09-30T14:53:34.344059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895507741032486:7767]
2025-09-30T14:53:34.344063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895507741032486:7767]
2025-09-30T14:53:34.344104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:34.344115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.344117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:34.344124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:34.344141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:34.344146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:34.344267Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:34.350897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1245 sessionId: src_id|7b4dc111-aad55a2e-d464bdd9-1584ce61_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:34.354014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:34.406310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895507830782037:3461]
2025-09-30T14:53:34.406587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1244, pipe: [1:7555895507830782037:3461]
2025-09-30T14:53:34.462198Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:34.462622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:34.462636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:34.462674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895507830782037:3461], now have 1 active actors on pipe
2025-09-30T14:53:34.462932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:34.462940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895507830782037:3461]
2025-09-30T14:53:34.462948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:34.462970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:34.463011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1245 reason: error at write: Disconnected sessionId: src_id|7b4dc111-aad55a2e-d464bdd9-1584ce61_0
2025-09-30T14:53:34.463314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1245 sessionId: src_id|7b4dc111-aad55a2e-d464bdd9-1584ce61_0 is DEAD
2025-09-30T14:53:34.463385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b4dc111-aad55a2e-d464bdd9-1584ce61_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:34.463395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b4dc111-aad55a2e-d464bdd9-1584ce61_0] Write session will restart in 0.005806s
2025-09-30T14:53:34.463417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b4dc111-aad55a2e-d464bdd9-1584ce61_0] Write session: Do CDS request
2025-09-30T14:53:34.463422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b4dc111-aad55a2e-d464bdd9-1584ce61_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:34.463481Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:34.470808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b4dc111-aad55a2e-d464bdd9-1584ce61_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:34.471196Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:34.471213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1246
2025-09-30T14:53:34.471911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1246 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:34.471963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1246 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:34.471973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1246 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:34.471978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:34.472411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1246 sessionId:  describe result for acl check
2025-09-30T14:53:34.472442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:34.472450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:34.472452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:34.472458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895507830782079:3105] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:34.472518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:34.473039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895507830782079:3105] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:34.474592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:34.474812Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:34.474822Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:34.474835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:34.474899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:34.474943Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895507741032571:7769]
2025-09-30T14:53:34.475061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895507830782079:3105] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:34.475659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:34.475976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:34.476033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:34.476373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:34.476440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:34.476452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:34.476454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:34.476455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:34.476456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:34.476458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:34.476459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:34.476484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:34.476485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:34.476486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:34.476487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.476488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.476489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.476490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:34.476491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:34.476498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:34.476509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:34.476513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:34.476517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:34.476524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:34.476529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:34.476533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:34.476537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:34.476542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:34.476548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:34.476552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.476556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.476560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.476564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:34.476568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:34.476575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:34.476594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:34.476600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:34.476605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:34.476609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:34.476615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:34.476623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:34.476628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:34.476638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:34.476642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:34.476647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:34.476651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:34.476658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:34.476663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:34.476668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:34.476673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:34.476679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:34.476684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:34.476694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:34.476700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:34.476706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.476715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.476719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.476724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.476731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.476736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.476740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:34.476745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:34.476749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:34.476753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:34.476795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:34.477821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895507830782079:3105] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:34.477836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895507830782079:3105] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:34.477840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895507830782079:3105] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:34.477848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1246 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:34.483141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:34.484080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:34.484099Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:34.484102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:34.484106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:34.484113Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1245 [2:7555895507741032571:7769]
2025-09-30T14:53:34.484133Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:34.484152Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:34.484155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:34.484159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:34.484161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:34.484178Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:34.484193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:34.484200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:34.484270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.484279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.484282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.484285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:34.484287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:34.484354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:34.484364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.484379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.484395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.484417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:34.484441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895507830782038:2454], now have 1 active actors on pipe
2025-09-30T14:53:34.484450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895507830782119:3105], now have 1 active actors on pipe
2025-09-30T14:53:34.484459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895507741032565:7769]
2025-09-30T14:53:34.484461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895507741032565:7769]
2025-09-30T14:53:34.484463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895507741032565:7769]
2025-09-30T14:53:34.484477Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:34.484497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:34.484499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:34.484501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:34.484504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:34.484514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:34.484518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:34.484511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1245
2025-09-30T14:53:34.484512Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1245
2025-09-30T14:53:34.484554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895507741032565:7769]
2025-09-30T14:53:34.484567Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:34.484574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:34.484588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:34.484592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:34.484639Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40f9c29b-57d5aee1-538b363a-e996a347_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:34.484649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:34.484653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:34.484655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:34.484664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:34.484678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:34.484699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:34.485100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:34.485114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:34.485149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:34.485278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1246 partition: 0 MaxSeqNo: 42 sessionId: src_id|40f9c29b-57d5aee1-538b363a-e996a347_0
2025-09-30T14:53:34.485908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b4dc111-aad55a2e-d464bdd9-1584ce61_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|40f9c29b-57d5aee1-538b363a-e996a347_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:34.489216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40f9c29b-57d5aee1-538b363a-e996a347_0] Write session: try to update token
2025-09-30T14:53:34.489241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40f9c29b-57d5aee1-538b363a-e996a347_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:34.498152Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:34.498174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:34.498184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895507741032565:7769]
2025-09-30T14:53:34.498232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:34.498234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:34.498416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:34.498585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:34.498729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:34.498875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:34.499094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:34.499145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:34.507394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1246 sessionId: src_id|40f9c29b-57d5aee1-538b363a-e996a347_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:34.508891Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:34.508914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:34.508918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:34.508920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:34.508931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895507741032565:7769]
2025-09-30T14:53:34.508936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895507741032565:7769]
2025-09-30T14:53:34.508940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895507741032565:7769]
2025-09-30T14:53:34.508981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:34.508997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.509001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:34.509116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:34.509130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:34.509135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:34.509163Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:34.510821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:34.563037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895507830782128:3461]
2025-09-30T14:53:34.563450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1245, pipe: [1:7555895507830782128:3461]
2025-09-30T14:53:34.630928Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:34.631396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:34.631415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:34.631436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895507830782128:3461], now have 1 active actors on pipe
2025-09-30T14:53:34.631670Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:34.631674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895507830782128:3461]
2025-09-30T14:53:34.631679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:34.631713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:34.631716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:34.631781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1246 reason: error at write: Disconnected sessionId: src_id|40f9c29b-57d5aee1-538b363a-e996a347_0
2025-09-30T14:53:34.631986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1246 sessionId: src_id|40f9c29b-57d5aee1-538b363a-e996a347_0 is DEAD
2025-09-30T14:53:34.632213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40f9c29b-57d5aee1-538b363a-e996a347_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:34.632223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40f9c29b-57d5aee1-538b363a-e996a347_0] Write session will restart in 0.006379s
2025-09-30T14:53:34.632255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40f9c29b-57d5aee1-538b363a-e996a347_0] Write session: Do CDS request
2025-09-30T14:53:34.632262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40f9c29b-57d5aee1-538b363a-e996a347_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:34.639716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40f9c29b-57d5aee1-538b363a-e996a347_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:34.639971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:34.639989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1247
2025-09-30T14:53:34.640190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1247 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:34.640239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1247 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:34.640244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1247 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:34.640249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:34.640636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1247 sessionId:  describe result for acl check
2025-09-30T14:53:34.640681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:34.640684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:34.640685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:34.640691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895507830782171:3096] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:34.641258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895507830782171:3096] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:34.643326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895507830782171:3096] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:34.640712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:34.642525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:34.642726Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:34.642730Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:34.642739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:34.642791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:34.642827Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895507741032652:7772]
2025-09-30T14:53:34.643512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:34.643779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:34.643843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:34.644203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:34.644259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:34.644260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:34.644261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:34.644263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:34.644264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:34.644265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:34.644266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:34.644268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:34.644269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:34.644270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:34.644273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.644275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.644276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.644277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:34.644279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:34.644285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:34.644295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:34.644300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:34.644305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:34.644309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:34.644314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:34.644318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:34.644323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:34.644327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:34.644332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:34.644336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.644341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.644345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.644349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:34.644354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:34.644362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:34.644370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:34.644376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:34.644382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:34.644389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:34.644394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:34.644398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:34.644404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:34.644410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:34.644416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:34.644421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:34.644428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:34.644434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:34.644440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:34.644445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:34.644450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:34.644455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:34.644461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:34.644465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:34.644471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:34.644476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.644482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.644487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.644493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.644497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.644503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.644507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:34.644512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:34.644518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:34.644523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:34.644568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:34.649355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895507830782171:3096] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:34.649375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895507830782171:3096] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:34.649379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895507830782171:3096] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:34.649388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1247 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:34.650174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:34.651005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:34.651025Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:34.651028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:34.651033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:34.651039Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1246 [2:7555895507741032652:7772]
2025-09-30T14:53:34.651055Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:34.651071Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:34.651074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:34.651077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:34.651079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:34.651096Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:34.651104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:34.651113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:34.651172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.651179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.651181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.651184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:34.651187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:34.651277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:34.651285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.651299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.651312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.651336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:34.651356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895507830782212:3096], now have 1 active actors on pipe
2025-09-30T14:53:34.651359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895507830782129:2454], now have 1 active actors on pipe
2025-09-30T14:53:34.651366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895507741032647:7772]
2025-09-30T14:53:34.651369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895507741032647:7772]
2025-09-30T14:53:34.651371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895507741032647:7772]
2025-09-30T14:53:34.651385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:34.651402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:34.651412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:34.651416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:34.651419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:34.651423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:34.651425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:34.651460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895507741032647:7772]
2025-09-30T14:53:34.651436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1246
2025-09-30T14:53:34.651474Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1246
2025-09-30T14:53:34.651471Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:34.651479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:34.651679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:34.651692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:34.651719Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c6fe14f-f9b5dd84-785297d-a662a72c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:34.651727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:34.651737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:34.651739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:34.651749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:34.651758Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:34.651776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:34.654690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:34.654707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:34.654743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:34.654912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1247 partition: 0 MaxSeqNo: 42 sessionId: src_id|3c6fe14f-f9b5dd84-785297d-a662a72c_0
2025-09-30T14:53:34.655382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40f9c29b-57d5aee1-538b363a-e996a347_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3c6fe14f-f9b5dd84-785297d-a662a72c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:34.658467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c6fe14f-f9b5dd84-785297d-a662a72c_0] Write session: try to update token
2025-09-30T14:53:34.658486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c6fe14f-f9b5dd84-785297d-a662a72c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:34.664329Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:34.664351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:34.664354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:34.664356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:34.664365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895507741032647:7772]
2025-09-30T14:53:34.664370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895507741032647:7772]
2025-09-30T14:53:34.664375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895507741032647:7772]
2025-09-30T14:53:34.664416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:34.664423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.664426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:34.664562Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:34.664716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:34.664731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:34.664736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:34.676621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1247 sessionId: src_id|3c6fe14f-f9b5dd84-785297d-a662a72c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:34.679793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:34.732272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895507830782232:3461]
2025-09-30T14:53:34.732574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1246, pipe: [1:7555895507830782232:3461]
2025-09-30T14:53:34.785363Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:34.785687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:34.785700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:34.785721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895507830782232:3461], now have 1 active actors on pipe
2025-09-30T14:53:34.785946Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:34.785989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895507830782232:3461]
2025-09-30T14:53:34.785990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:34.785995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:34.786023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:34.786076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1247 reason: error at write: Disconnected sessionId: src_id|3c6fe14f-f9b5dd84-785297d-a662a72c_0
2025-09-30T14:53:34.786301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1247 sessionId: src_id|3c6fe14f-f9b5dd84-785297d-a662a72c_0 is DEAD
2025-09-30T14:53:34.786446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c6fe14f-f9b5dd84-785297d-a662a72c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:34.786458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c6fe14f-f9b5dd84-785297d-a662a72c_0] Write session will restart in 0.009221s
2025-09-30T14:53:34.786484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c6fe14f-f9b5dd84-785297d-a662a72c_0] Write session: Do CDS request
2025-09-30T14:53:34.786492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c6fe14f-f9b5dd84-785297d-a662a72c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:34.795793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:34.796797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c6fe14f-f9b5dd84-785297d-a662a72c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:34.796886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:34.796902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1248
2025-09-30T14:53:34.797007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1248 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:34.797038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1248 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:34.797047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1248 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:34.797052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:34.797510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1248 sessionId:  describe result for acl check
2025-09-30T14:53:34.797552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:34.797559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:34.797546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:34.797561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:34.797568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895507830782289:3085] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:34.797738Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:34.797747Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:34.797757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:34.797799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:34.797838Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895507741032769:7786]
2025-09-30T14:53:34.798167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895507830782289:3085] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:34.798489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:34.798765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:34.798808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:34.799131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:34.799196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:34.799203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:34.799204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:34.799205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:34.799206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:34.799208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:34.799209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:34.799210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:34.799211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:34.799213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:34.799214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.799215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.799216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.799217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:34.799218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:34.799223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:34.799232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:34.799236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:34.799240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:34.799262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:34.799266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:34.799271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:34.799275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:34.799281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:34.799286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:34.799290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.799294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.799298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.799302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:34.799306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:34.799312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:34.799320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:34.799326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:34.799331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:34.799336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:34.799342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:34.799346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:34.799351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:34.799355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:34.799360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:34.799363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:34.799369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:34.799373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:34.799378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:34.799383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:34.799388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:34.799393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:34.799410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:34.799414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:34.799420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:34.799425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.799430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.799434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.799440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.799445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.799451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.799455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:34.799459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:34.799464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:34.799471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:34.799534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:34.800737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895507830782289:3085] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:34.804944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895507830782289:3085] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:34.804958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895507830782289:3085] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:34.804961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895507830782289:3085] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:34.804970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1248 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:34.805244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:34.806108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:34.806120Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:34.806122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:34.806126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:34.806130Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1247 [2:7555895507741032769:7786]
2025-09-30T14:53:34.806144Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:34.806158Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:34.806160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:34.806162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:34.806164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:34.806175Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:34.806179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:34.806184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:34.806231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.806238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.806240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.806246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:34.806248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:34.806373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:34.806381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.806391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.806407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.806428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:34.806422Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1247
2025-09-30T14:53:34.806449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895507830782245:2454], now have 1 active actors on pipe
2025-09-30T14:53:34.806457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895507830782325:3085], now have 1 active actors on pipe
2025-09-30T14:53:34.806463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895507741032763:7786]
2025-09-30T14:53:34.806465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895507741032763:7786]
2025-09-30T14:53:34.806467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895507741032763:7786]
2025-09-30T14:53:34.806438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1247
2025-09-30T14:53:34.806475Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:34.806486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:34.806492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:34.806498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:34.806501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:34.806508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:34.806512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:34.806531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:34.806538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:34.806571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895507741032763:7786]
2025-09-30T14:53:34.806583Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:34.806587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:34.806600Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1bb5ea37-f5784bd-eb439a59-94cbf3c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:34.806606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:34.806614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:34.806615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:34.806623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:34.806629Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:34.806661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:34.806827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:34.806835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:34.806849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:34.806921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1248 partition: 0 MaxSeqNo: 42 sessionId: src_id|1bb5ea37-f5784bd-eb439a59-94cbf3c9_0
2025-09-30T14:53:34.807304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c6fe14f-f9b5dd84-785297d-a662a72c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1bb5ea37-f5784bd-eb439a59-94cbf3c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:34.809988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bb5ea37-f5784bd-eb439a59-94cbf3c9_0] Write session: try to update token
2025-09-30T14:53:34.810005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bb5ea37-f5784bd-eb439a59-94cbf3c9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:34.818970Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:34.818992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:34.818995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:34.818999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:34.819011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895507741032763:7786]
2025-09-30T14:53:34.819016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895507741032763:7786]
2025-09-30T14:53:34.819020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895507741032763:7786]
2025-09-30T14:53:34.819051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:34.819056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.819058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:34.819069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:34.819076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:34.819080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:34.819204Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:34.829861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1248 sessionId: src_id|1bb5ea37-f5784bd-eb439a59-94cbf3c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:34.832703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:34.886091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895507830782332:3461]
2025-09-30T14:53:34.886426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1247, pipe: [1:7555895507830782332:3461]
2025-09-30T14:53:34.933342Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:34.933799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:34.933815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:34.933853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895507830782332:3461], now have 1 active actors on pipe
2025-09-30T14:53:34.934071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895507830782332:3461]
2025-09-30T14:53:34.934075Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:34.934130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:34.934133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:34.934192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1248 reason: error at write: Disconnected sessionId: src_id|1bb5ea37-f5784bd-eb439a59-94cbf3c9_0
2025-09-30T14:53:34.934410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1248 sessionId: src_id|1bb5ea37-f5784bd-eb439a59-94cbf3c9_0 is DEAD
2025-09-30T14:53:34.934590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bb5ea37-f5784bd-eb439a59-94cbf3c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:34.934601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bb5ea37-f5784bd-eb439a59-94cbf3c9_0] Write session will restart in 0.009606s
2025-09-30T14:53:34.934624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bb5ea37-f5784bd-eb439a59-94cbf3c9_0] Write session: Do CDS request
2025-09-30T14:53:34.934630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bb5ea37-f5784bd-eb439a59-94cbf3c9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:34.934396Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:34.943972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:34.945792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bb5ea37-f5784bd-eb439a59-94cbf3c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:34.945876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:34.945893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1249
2025-09-30T14:53:34.945973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:34.946087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1249 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:34.946120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1249 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:34.946130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1249 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:34.946134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:34.946203Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:34.946212Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:34.946233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:34.946296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:34.946335Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895507741032849:7788]
2025-09-30T14:53:34.946565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1249 sessionId:  describe result for acl check
2025-09-30T14:53:34.946597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:34.946605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:34.946607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:34.946613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895507830782379:3078] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:34.947069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:34.947152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895507830782379:3078] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:34.948516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:34.948592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:34.948970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:34.949032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:34.949040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:34.949041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:34.949043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:34.949044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:34.949045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:34.949046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:34.949048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:34.949049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:34.949050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:34.949051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.949052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.949053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.949054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:34.949055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:34.949062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:34.949075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:34.949080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:34.949086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:34.949090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:34.949095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:34.949100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:34.949105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:34.949109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:34.949115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:34.949120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.949125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.949129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.949135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:34.949139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:34.949147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:34.949155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:34.949162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:34.949169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:34.949174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:34.949181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:34.949186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:34.949193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:34.949198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:34.949205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:34.949210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:34.949215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:34.949222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:34.949228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:34.949233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:34.949239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:34.949246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:34.949253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:34.949258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:34.949275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:34.949281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.949287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.949292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.949296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895507830782379:3078] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:34.949298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.949303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.949309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.949314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:34.949320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:34.949325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:34.949331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:34.949383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:34.954909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895507830782379:3078] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:34.954928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895507830782379:3078] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:34.954931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895507830782379:3078] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:34.954940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1249 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:34.955184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:34.956198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:34.956213Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:34.956216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:34.956220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:34.956226Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1248 [2:7555895507741032849:7788]
2025-09-30T14:53:34.956244Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:34.956258Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:34.956262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:34.956264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:34.956267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:34.956279Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:34.956283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:34.956289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:34.956342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.956344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.956346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.956349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:34.956351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:34.956421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:34.956430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.956443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:34.956452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:34.956469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:34.956576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1248
2025-09-30T14:53:34.956599Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1248
2025-09-30T14:53:34.956492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895507830782417:3078], now have 1 active actors on pipe
2025-09-30T14:53:34.956503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895507830782334:2454], now have 1 active actors on pipe
2025-09-30T14:53:34.956509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895507741032843:7788]
2025-09-30T14:53:34.956511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895507741032843:7788]
2025-09-30T14:53:34.956512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895507741032843:7788]
2025-09-30T14:53:34.956525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:34.956537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:34.956550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:34.956550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:34.956553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:34.956555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:34.956557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:34.956586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895507741032843:7788]
2025-09-30T14:53:34.956591Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:34.956606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:34.956633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:34.956637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:34.956664Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f7e152d-4210507-917a6a84-18cb9854_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:34.956673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:34.956676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:34.956678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:34.956688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:34.956698Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:34.956711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:34.956893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:34.956904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:34.956919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:34.956991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1249 partition: 0 MaxSeqNo: 42 sessionId: src_id|8f7e152d-4210507-917a6a84-18cb9854_0
2025-09-30T14:53:34.957422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bb5ea37-f5784bd-eb439a59-94cbf3c9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8f7e152d-4210507-917a6a84-18cb9854_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:34.960296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f7e152d-4210507-917a6a84-18cb9854_0] Write session: try to update token
2025-09-30T14:53:34.960317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f7e152d-4210507-917a6a84-18cb9854_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:34.968836Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:34.968856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:34.968861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:34.968864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:34.968872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895507741032843:7788]
2025-09-30T14:53:34.968877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895507741032843:7788]
2025-09-30T14:53:34.968881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895507741032843:7788]
2025-09-30T14:53:34.968918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:34.968925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:34.968928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:34.968930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:34.968937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:34.968941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:34.969074Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:34.974911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1249 sessionId: src_id|8f7e152d-4210507-917a6a84-18cb9854_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:34.977673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:35.034046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895512125749726:3461]
2025-09-30T14:53:35.034400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1248, pipe: [1:7555895512125749726:3461]
2025-09-30T14:53:35.086656Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:35.086975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:35.086990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:35.087028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895512125749726:3461], now have 1 active actors on pipe
2025-09-30T14:53:35.087275Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:35.087324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895512125749726:3461]
2025-09-30T14:53:35.087326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:35.087330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:35.087359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:35.087393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1249 reason: error at write: Disconnected sessionId: src_id|8f7e152d-4210507-917a6a84-18cb9854_0
2025-09-30T14:53:35.087632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1249 sessionId: src_id|8f7e152d-4210507-917a6a84-18cb9854_0 is DEAD
2025-09-30T14:53:35.087799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f7e152d-4210507-917a6a84-18cb9854_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:35.087810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f7e152d-4210507-917a6a84-18cb9854_0] Write session will restart in 0.005380s
2025-09-30T14:53:35.087849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f7e152d-4210507-917a6a84-18cb9854_0] Write session: Do CDS request
2025-09-30T14:53:35.087858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f7e152d-4210507-917a6a84-18cb9854_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:35.094855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f7e152d-4210507-917a6a84-18cb9854_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:35.094945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:35.094962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1250
2025-09-30T14:53:35.095084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1250 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:35.095116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1250 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:35.095127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1250 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:35.095131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:35.095592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1250 sessionId:  describe result for acl check
2025-09-30T14:53:35.095627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:35.095629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:35.095631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:35.095636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895512125749770:3067] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:35.096003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:35.096220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895512125749770:3067] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:35.098095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:35.098329Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:35.098338Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:35.098349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:35.098404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:35.098448Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895512036000226:7790]
2025-09-30T14:53:35.098801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895512125749770:3067] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:35.099097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:35.099423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:35.099470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:35.099812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:35.099873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:35.099879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:35.099881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:35.099882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:35.099883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:35.099885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:35.099886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:35.099887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:35.099890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:35.099892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:35.099892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.099893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.099894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.099895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:35.099896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:35.099900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:35.099911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:35.099915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:35.099919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:35.099923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:35.099926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:35.099930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:35.099934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:35.099938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:35.099942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:35.099945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.099948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.099952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.099956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:35.099960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:35.099967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:35.099975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:35.099981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:35.099987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:35.099992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:35.099997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:35.100002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:35.100008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:35.100012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:35.100019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:35.100024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:35.100029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:35.100034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:35.100039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:35.100043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:35.100048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:35.100051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:35.100056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:35.100060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:35.100064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:35.100069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.100073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.100078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.100082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.100088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.100093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.100097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:35.100102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:35.100108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:35.100112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:35.100155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:35.108281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895512125749770:3067] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:35.108300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895512125749770:3067] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:35.108303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895512125749770:3067] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:35.108311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1250 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:35.109257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:35.110304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:35.110322Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:35.110326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:35.110332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:35.110339Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1249 [2:7555895512036000226:7790]
2025-09-30T14:53:35.110359Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:35.110376Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:35.110384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:35.110389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:35.110392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:35.110407Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:35.110414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:35.110421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:35.110483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.110491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.110493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.110497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:35.110499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:35.110566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:35.110575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.110587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.110605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.110629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:35.110655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895512125749727:2454], now have 1 active actors on pipe
2025-09-30T14:53:35.110659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895512125749814:3067], now have 1 active actors on pipe
2025-09-30T14:53:35.110666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895512036000221:7790]
2025-09-30T14:53:35.110668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895512036000221:7790]
2025-09-30T14:53:35.110670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895512036000221:7790]
2025-09-30T14:53:35.110683Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:35.110697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:35.110697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:35.110701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:35.110704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:35.110713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:35.110724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:35.110707Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1249
2025-09-30T14:53:35.110725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1249
2025-09-30T14:53:35.110758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895512036000221:7790]
2025-09-30T14:53:35.110770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:35.110776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:35.110787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:35.110791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:35.110843Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b519936-4c66c4cd-e90754e0-57f6ea2f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:35.110856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:35.110859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:35.110861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:35.110871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:35.110880Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:35.110904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:35.111087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:35.111095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:35.111110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:35.111216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1250 partition: 0 MaxSeqNo: 42 sessionId: src_id|7b519936-4c66c4cd-e90754e0-57f6ea2f_0
2025-09-30T14:53:35.111656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f7e152d-4210507-917a6a84-18cb9854_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7b519936-4c66c4cd-e90754e0-57f6ea2f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:35.114465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b519936-4c66c4cd-e90754e0-57f6ea2f_0] Write session: try to update token
2025-09-30T14:53:35.114485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b519936-4c66c4cd-e90754e0-57f6ea2f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:35.123352Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:35.123371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:35.123375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:35.123377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:35.123387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895512036000221:7790]
2025-09-30T14:53:35.123395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895512036000221:7790]
2025-09-30T14:53:35.123400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895512036000221:7790]
2025-09-30T14:53:35.123442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:35.123448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:35.123451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.123454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:35.123457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:35.123459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:35.123605Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:35.131594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1250 sessionId: src_id|7b519936-4c66c4cd-e90754e0-57f6ea2f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:35.134446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:35.187641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895512125749822:3461]
2025-09-30T14:53:35.187873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1249, pipe: [1:7555895512125749822:3461]
2025-09-30T14:53:35.235923Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:35.236229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:35.236246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:35.236265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895512125749822:3461], now have 1 active actors on pipe
2025-09-30T14:53:35.236452Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:35.236531Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:35.236596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:35.236604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:35.236608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895512125749822:3461]
2025-09-30T14:53:35.236672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1250 reason: error at write: Disconnected sessionId: src_id|7b519936-4c66c4cd-e90754e0-57f6ea2f_0
2025-09-30T14:53:35.236891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1250 sessionId: src_id|7b519936-4c66c4cd-e90754e0-57f6ea2f_0 is DEAD
2025-09-30T14:53:35.237045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b519936-4c66c4cd-e90754e0-57f6ea2f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:35.237053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b519936-4c66c4cd-e90754e0-57f6ea2f_0] Write session will restart in 0.007040s
2025-09-30T14:53:35.237076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b519936-4c66c4cd-e90754e0-57f6ea2f_0] Write session: Do CDS request
2025-09-30T14:53:35.237082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b519936-4c66c4cd-e90754e0-57f6ea2f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:35.245822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b519936-4c66c4cd-e90754e0-57f6ea2f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:35.245859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:35.245904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:35.245922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1251
2025-09-30T14:53:35.246097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1251 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:35.246130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1251 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:35.246149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1251 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:35.246157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:35.246587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1251 sessionId:  describe result for acl check
2025-09-30T14:53:35.246623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:35.246629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:35.246630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:35.246636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895512125749881:3061] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:35.247131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895512125749881:3061] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:35.247716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:35.247895Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:35.247906Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:35.247916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:35.247985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:35.248040Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895512036000323:7794]
2025-09-30T14:53:35.248683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:35.248689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895512125749881:3061] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:35.248930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:35.248964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:35.249248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:35.249308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:35.249318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:35.249321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:35.249323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:35.249324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:35.249325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:35.249326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:35.249327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:35.249329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:35.249330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:35.249331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.249332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.249333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.249335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:35.249336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:35.249341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:35.249351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:35.249354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:35.249358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:35.249362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:35.249366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:35.249370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:35.249374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:35.249378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:35.249384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:35.249388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.249391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.249396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.249401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:35.249404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:35.249412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:35.249420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:35.249425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:35.249432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:35.249436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:35.249441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:35.249445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:35.249450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:35.249454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:35.249460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:35.249464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:35.249468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:35.249473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:35.249478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:35.249482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:35.249487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:35.249491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:35.249496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:35.249507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:35.249512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:35.249517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.249522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.249530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.249537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.249546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.249552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.249560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:35.249566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:35.249571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:35.249576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:35.249624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:35.254749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895512125749881:3061] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:35.254768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895512125749881:3061] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:35.254772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895512125749881:3061] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:35.254781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1251 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:35.255041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:35.256040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:35.256058Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:35.256061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:35.256066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:35.256072Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1250 [2:7555895512036000323:7794]
2025-09-30T14:53:35.256089Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:35.256104Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:35.256107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:35.256112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:35.256115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:35.256131Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:35.256138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:35.256143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:35.256201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.256211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.256213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.256217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:35.256219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:35.256279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:35.256288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.256302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.256314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.256332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:35.256349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895512125749835:2454], now have 1 active actors on pipe
2025-09-30T14:53:35.256358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895512125749920:3061], now have 1 active actors on pipe
2025-09-30T14:53:35.256364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895512036000318:7794]
2025-09-30T14:53:35.256366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895512036000318:7794]
2025-09-30T14:53:35.256368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895512036000318:7794]
2025-09-30T14:53:35.256380Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:35.256397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:35.256406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:35.256409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:35.256386Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1250
2025-09-30T14:53:35.256412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:35.256394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1250
2025-09-30T14:53:35.256415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:35.256418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:35.256448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895512036000318:7794]
2025-09-30T14:53:35.256461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:35.256466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:35.256478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:35.256482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:35.256525Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44c2af08-d586f021-9d6faa56-3a369fda_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:35.256536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:35.256539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:35.256541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:35.256550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:35.256562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:35.256581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:35.256753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:35.256765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:35.256783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:35.256873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1251 partition: 0 MaxSeqNo: 42 sessionId: src_id|44c2af08-d586f021-9d6faa56-3a369fda_0
2025-09-30T14:53:35.257273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b519936-4c66c4cd-e90754e0-57f6ea2f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|44c2af08-d586f021-9d6faa56-3a369fda_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:35.260065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44c2af08-d586f021-9d6faa56-3a369fda_0] Write session: try to update token
2025-09-30T14:53:35.260085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44c2af08-d586f021-9d6faa56-3a369fda_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:35.268464Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:35.268481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:35.268484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:35.268486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:35.268496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895512036000318:7794]
2025-09-30T14:53:35.268500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895512036000318:7794]
2025-09-30T14:53:35.268507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895512036000318:7794]
2025-09-30T14:53:35.268554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:35.268561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.268562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:35.268563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:35.268568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:35.268572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:35.268694Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:35.274988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1251 sessionId: src_id|44c2af08-d586f021-9d6faa56-3a369fda_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:35.277995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:35.336632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895512125749928:3461]
2025-09-30T14:53:35.336993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1250, pipe: [1:7555895512125749928:3461]
2025-09-30T14:53:35.382529Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:35.382861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:35.382878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:35.382917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895512125749928:3461], now have 1 active actors on pipe
2025-09-30T14:53:35.383197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:35.383224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:35.383229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:35.383267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895512125749928:3461]
2025-09-30T14:53:35.383309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1251 reason: error at write: Disconnected sessionId: src_id|44c2af08-d586f021-9d6faa56-3a369fda_0
2025-09-30T14:53:35.383500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1251 sessionId: src_id|44c2af08-d586f021-9d6faa56-3a369fda_0 is DEAD
2025-09-30T14:53:35.383666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44c2af08-d586f021-9d6faa56-3a369fda_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:35.383678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44c2af08-d586f021-9d6faa56-3a369fda_0] Write session will restart in 0.007288s
2025-09-30T14:53:35.383363Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:35.383702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44c2af08-d586f021-9d6faa56-3a369fda_0] Write session: Do CDS request
2025-09-30T14:53:35.383711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44c2af08-d586f021-9d6faa56-3a369fda_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:35.391742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44c2af08-d586f021-9d6faa56-3a369fda_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:35.391877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:35.391895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1252
2025-09-30T14:53:35.392039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1252 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:35.392072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1252 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:35.392079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1252 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:35.392090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:35.392215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:35.392552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1252 sessionId:  describe result for acl check
2025-09-30T14:53:35.392594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:35.392602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:35.392605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:35.392611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895512125749976:3057] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:35.393197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895512125749976:3057] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:35.394220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:35.394434Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:35.394447Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:35.394459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:35.394529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:35.394572Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895512036000407:7796]
2025-09-30T14:53:35.395273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:35.395280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895512125749976:3057] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:35.395552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:35.395597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:35.395932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:35.395996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:35.396002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:35.396003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:35.396004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:35.396006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:35.396007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:35.396008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:35.396009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:35.396011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:35.396012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:35.396013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.396015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.396016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.396017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:35.396018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:35.396024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:35.396035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:35.396039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:35.396044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:35.396048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:35.396053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:35.396057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:35.396061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:35.396066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:35.396071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:35.396075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.396079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.396083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.396088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:35.396092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:35.396100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:35.396108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:35.396119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:35.396127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:35.396132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:35.396143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:35.396149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:35.396159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:35.396169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:35.396174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:35.396183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:35.396189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:35.396199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:35.396209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:35.396213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:35.396224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:35.396230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:35.396238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:35.396243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:35.396249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:35.396257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.396262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.396272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.396278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.396283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.396290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.396295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:35.396300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:35.396306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:35.396312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:35.396358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:35.401643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895512125749976:3057] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:35.401670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895512125749976:3057] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:35.401674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895512125749976:3057] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:35.401683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1252 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:35.401862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:35.402811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:35.402828Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:35.402831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:35.402835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:35.402841Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1251 [2:7555895512036000407:7796]
2025-09-30T14:53:35.402860Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:35.402877Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:35.402885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:35.402889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:35.402891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:35.402907Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:35.402917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:35.402924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:35.402988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.402996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.402999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.403002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:35.403005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:35.403072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:35.403080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.403093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.403112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.403135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:35.403158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895512125750015:3057], now have 1 active actors on pipe
2025-09-30T14:53:35.403167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895512125749929:2454], now have 1 active actors on pipe
2025-09-30T14:53:35.403174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895512036000402:7796]
2025-09-30T14:53:35.403176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895512036000402:7796]
2025-09-30T14:53:35.403178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895512036000402:7796]
2025-09-30T14:53:35.403190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:35.403204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:35.403205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:35.403208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:35.403210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:35.403224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:35.403227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:35.403187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1251
2025-09-30T14:53:35.403194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1251
2025-09-30T14:53:35.403277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895512036000402:7796]
2025-09-30T14:53:35.403295Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:35.403316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:35.403326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:35.403359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:35.403377Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ca88fc1-8818be97-9f020582-834ff76e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:35.403385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:35.403392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:35.403394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:35.403403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:35.403412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:35.403427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:35.403631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:35.403639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:35.403651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:35.403738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1252 partition: 0 MaxSeqNo: 42 sessionId: src_id|8ca88fc1-8818be97-9f020582-834ff76e_0
2025-09-30T14:53:35.404118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44c2af08-d586f021-9d6faa56-3a369fda_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8ca88fc1-8818be97-9f020582-834ff76e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:35.406917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ca88fc1-8818be97-9f020582-834ff76e_0] Write session: try to update token
2025-09-30T14:53:35.406938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ca88fc1-8818be97-9f020582-834ff76e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:35.415576Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:35.415599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:35.415602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:35.415604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:35.415614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895512036000402:7796]
2025-09-30T14:53:35.415619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895512036000402:7796]
2025-09-30T14:53:35.415626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895512036000402:7796]
2025-09-30T14:53:35.415670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:35.415678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.415681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:35.415815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:35.415832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:35.415836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:35.415842Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:35.422424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1252 sessionId: src_id|8ca88fc1-8818be97-9f020582-834ff76e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:35.425258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:35.483619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895512125750023:3461]
2025-09-30T14:53:35.483923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1251, pipe: [1:7555895512125750023:3461]
2025-09-30T14:53:35.535628Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:35.536058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:35.536075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:35.536113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895512125750023:3461], now have 1 active actors on pipe
2025-09-30T14:53:35.536343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:35.536361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:35.536375Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:35.536423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1252 reason: error at write: Disconnected sessionId: src_id|8ca88fc1-8818be97-9f020582-834ff76e_0
2025-09-30T14:53:35.536641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1252 sessionId: src_id|8ca88fc1-8818be97-9f020582-834ff76e_0 is DEAD
2025-09-30T14:53:35.536817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ca88fc1-8818be97-9f020582-834ff76e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:35.536828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ca88fc1-8818be97-9f020582-834ff76e_0] Write session will restart in 0.007440s
2025-09-30T14:53:35.536737Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:35.536788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895512125750023:3461]
2025-09-30T14:53:35.536863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ca88fc1-8818be97-9f020582-834ff76e_0] Write session: Do CDS request
2025-09-30T14:53:35.536870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ca88fc1-8818be97-9f020582-834ff76e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:35.545820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ca88fc1-8818be97-9f020582-834ff76e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:35.545931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:35.545949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1253
2025-09-30T14:53:35.546100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1253 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:35.546133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1253 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:35.546143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1253 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:35.546147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:35.546636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1253 sessionId:  describe result for acl check
2025-09-30T14:53:35.546680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:35.546687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:35.546689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:35.546695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895512125750070:3052] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:35.547341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895512125750070:3052] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:35.548853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:35.550262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895512125750070:3052] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:35.551139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:35.551414Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:35.551427Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:35.551440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:35.551508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:35.551544Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895512036000493:7798]
2025-09-30T14:53:35.552204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:35.552542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:35.552594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:35.552937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:35.553014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:35.553021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:35.553015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895512125750070:3052] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:35.553022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:35.553032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895512125750070:3052] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:35.553023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:35.553036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895512125750070:3052] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:35.553045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1253 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:35.553025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:35.553026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:35.553027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:35.553028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:35.553032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:35.553033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:35.553034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.553035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.553037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.553038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:35.553039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:35.553044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:35.553055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:35.553059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:35.553064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:35.553067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:35.553071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:35.553075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:35.553079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:35.553082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:35.553087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:35.553091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.553095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.553099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.553103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:35.553106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:35.553113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:35.553121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:35.553127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:35.553132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:35.553137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:35.553142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:35.553146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:35.553151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:35.553157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:35.553164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:35.553168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:35.553173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:35.553178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:35.553184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:35.553188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:35.553193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:35.553198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:35.553203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:35.553207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:35.553212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:35.553218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.553223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.553227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.553232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.553236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.553241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.553245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:35.553250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:35.553256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:35.553261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:35.553302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:35.564031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:35.564968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:35.564985Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:35.564988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:35.564992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:35.564999Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1252 [2:7555895512036000493:7798]
2025-09-30T14:53:35.565016Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:35.565036Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:35.565039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:35.565042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:35.565044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:35.565065Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:35.565072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:35.565079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:35.565142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.565150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.565152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.565155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:35.565157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:35.565224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:35.565233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.565246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.565257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.565271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:35.565286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895512036000486:7798]
2025-09-30T14:53:35.565293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895512036000486:7798]
2025-09-30T14:53:35.565295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895512036000486:7798]
2025-09-30T14:53:35.565305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:35.565317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:35.565330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:35.565333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:35.565367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895512036000486:7798]
2025-09-30T14:53:35.565371Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:35.565422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:35.565434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:35.565436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:35.565443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:35.565515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895512125750111:3052], now have 1 active actors on pipe
2025-09-30T14:53:35.565526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895512125750026:2454], now have 1 active actors on pipe
2025-09-30T14:53:35.565714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1252
2025-09-30T14:53:35.565756Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1252
2025-09-30T14:53:35.565869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:35.565879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:35.565910Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d92455c6-66dae9d0-d3535f13-56906e2e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:35.565923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:35.565929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:35.565931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:35.565941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:35.565952Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:35.565970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:35.566205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:35.566216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:35.566233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:35.566344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1253 partition: 0 MaxSeqNo: 42 sessionId: src_id|d92455c6-66dae9d0-d3535f13-56906e2e_0
2025-09-30T14:53:35.566794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ca88fc1-8818be97-9f020582-834ff76e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d92455c6-66dae9d0-d3535f13-56906e2e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:35.569569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d92455c6-66dae9d0-d3535f13-56906e2e_0] Write session: try to update token
2025-09-30T14:53:35.569591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d92455c6-66dae9d0-d3535f13-56906e2e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:35.580392Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:35.580413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:35.580415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:35.580420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:35.580429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895512036000486:7798]
2025-09-30T14:53:35.580434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895512036000486:7798]
2025-09-30T14:53:35.580438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895512036000486:7798]
2025-09-30T14:53:35.580480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:35.580487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.580490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:35.580497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:35.580505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:35.580514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:35.580628Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:35.584970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1253 sessionId: src_id|d92455c6-66dae9d0-d3535f13-56906e2e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:35.587914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:35.637188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895512125750120:3461]
2025-09-30T14:53:35.637492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1252, pipe: [1:7555895512125750120:3461]
2025-09-30T14:53:35.699156Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:35.699512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:35.699535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:35.699584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895512125750120:3461], now have 1 active actors on pipe
2025-09-30T14:53:35.699858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:35.699875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:35.699940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1253 reason: error at write: Disconnected sessionId: src_id|d92455c6-66dae9d0-d3535f13-56906e2e_0
2025-09-30T14:53:35.700154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1253 sessionId: src_id|d92455c6-66dae9d0-d3535f13-56906e2e_0 is DEAD
2025-09-30T14:53:35.699907Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:35.700305Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:35.700322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d92455c6-66dae9d0-d3535f13-56906e2e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:35.700318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895512125750120:3461]
2025-09-30T14:53:35.700352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d92455c6-66dae9d0-d3535f13-56906e2e_0] Write session will restart in 0.006402s
2025-09-30T14:53:35.700377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d92455c6-66dae9d0-d3535f13-56906e2e_0] Write session: Do CDS request
2025-09-30T14:53:35.700386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d92455c6-66dae9d0-d3535f13-56906e2e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:35.707783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d92455c6-66dae9d0-d3535f13-56906e2e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:35.707844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:35.707871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1254
2025-09-30T14:53:35.707992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1254 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:35.708032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1254 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:35.708042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1254 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:35.708047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:35.708517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1254 sessionId:  describe result for acl check
2025-09-30T14:53:35.708549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:35.708558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:35.708562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:35.708567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895512125750156:3048] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:35.709105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895512125750156:3048] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:35.710422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:35.711831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895512125750156:3048] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:35.712694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:35.712916Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:35.712928Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:35.712940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:35.713006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:35.713057Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895512036000581:7801]
2025-09-30T14:53:35.713799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:35.714188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:35.714274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:35.714667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:35.714745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:35.714754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:35.714755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:35.714757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:35.714758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:35.714759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:35.714761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:35.714762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:35.714763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:35.714764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:35.714765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.714767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.714768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.714769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:35.714770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:35.714777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:35.714788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:35.714793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:35.714796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:35.714801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:35.714805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:35.714809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:35.714813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:35.714820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:35.714824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:35.714829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.714833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.714837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.714841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:35.714845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:35.714853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:35.714861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:35.714868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:35.714874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:35.714880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:35.714885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:35.714891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:35.714897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:35.714904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:35.714913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:35.714918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:35.714924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:35.714930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:35.714937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:35.714942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:35.714948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:35.714953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:35.714960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:35.714966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:35.714972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:35.714984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.714989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.714993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.714999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.715009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.715014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.715019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:35.715026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:35.715032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:35.715037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:35.714819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895512125750156:3048] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:35.714835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895512125750156:3048] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:35.714842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895512125750156:3048] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:35.715088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:35.714851Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1254 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:35.721086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:35.721987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:35.722009Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:35.722012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:35.722017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:35.722025Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1253 [2:7555895512036000581:7801]
2025-09-30T14:53:35.722057Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:35.722075Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:35.722078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:35.722081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:35.722083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:35.722101Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:35.722119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:35.722127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:35.722301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.722318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.722321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.722324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:35.722327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:35.722395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:35.722403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.722415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.722428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.722452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:35.722475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895512125750207:3048], now have 1 active actors on pipe
2025-09-30T14:53:35.722485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895512125750122:2454], now have 1 active actors on pipe
2025-09-30T14:53:35.722492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895512036000576:7801]
2025-09-30T14:53:35.722494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895512036000576:7801]
2025-09-30T14:53:35.722496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895512036000576:7801]
2025-09-30T14:53:35.722510Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:35.722527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:35.722539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:35.722547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:35.722550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:35.722550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:35.722552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:35.722585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895512036000576:7801]
2025-09-30T14:53:35.722599Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:35.722615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:35.722772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1253
2025-09-30T14:53:35.722773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1253
2025-09-30T14:53:35.722859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:35.722870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:35.722900Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd002831-6a308850-d7df4391-c43379af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:35.722913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:35.722922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:35.722925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:35.722935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:35.722953Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:35.722972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:35.723134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:35.723143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:35.723155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:35.723240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1254 partition: 0 MaxSeqNo: 42 sessionId: src_id|dd002831-6a308850-d7df4391-c43379af_0
2025-09-30T14:53:35.723625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d92455c6-66dae9d0-d3535f13-56906e2e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dd002831-6a308850-d7df4391-c43379af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:35.726400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd002831-6a308850-d7df4391-c43379af_0] Write session: try to update token
2025-09-30T14:53:35.726421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd002831-6a308850-d7df4391-c43379af_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:35.735382Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:35.735406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:35.735409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:35.735410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:35.735419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895512036000576:7801]
2025-09-30T14:53:35.735424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895512036000576:7801]
2025-09-30T14:53:35.735428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895512036000576:7801]
2025-09-30T14:53:35.735469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:35.735475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.735480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:35.735481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:35.735488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:35.735492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:35.735623Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:35.744071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1254 sessionId: src_id|dd002831-6a308850-d7df4391-c43379af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:35.747313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:35.800506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895512125750229:3461]
2025-09-30T14:53:35.800803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1253, pipe: [1:7555895512125750229:3461]
2025-09-30T14:53:35.851199Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:35.851595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:35.851613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:35.851632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895512125750229:3461], now have 1 active actors on pipe
2025-09-30T14:53:35.851875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:35.851890Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:35.851892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:35.851894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895512125750229:3461]
2025-09-30T14:53:35.851931Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:35.851971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1254 reason: error at write: Disconnected sessionId: src_id|dd002831-6a308850-d7df4391-c43379af_0
2025-09-30T14:53:35.852199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1254 sessionId: src_id|dd002831-6a308850-d7df4391-c43379af_0 is DEAD
2025-09-30T14:53:35.852449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd002831-6a308850-d7df4391-c43379af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:35.852466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd002831-6a308850-d7df4391-c43379af_0] Write session will restart in 0.009270s
2025-09-30T14:53:35.852498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd002831-6a308850-d7df4391-c43379af_0] Write session: Do CDS request
2025-09-30T14:53:35.852505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd002831-6a308850-d7df4391-c43379af_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:35.861709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:35.862909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd002831-6a308850-d7df4391-c43379af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:35.863322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:35.863394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:35.863411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1255
2025-09-30T14:53:35.863534Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:35.863545Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:35.863539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1255 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:35.863558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:35.863587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1255 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:35.863597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1255 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:35.863601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:35.863622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:35.863664Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895512036000704:7815]
2025-09-30T14:53:35.864004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1255 sessionId:  describe result for acl check
2025-09-30T14:53:35.864040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:35.864048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:35.864050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:35.864055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895512125750291:3032] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:35.864346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:35.864586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895512125750291:3032] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:35.864665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:35.864711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:35.865070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:35.865126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:35.865132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:35.865134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:35.865135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:35.865136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:35.865137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:35.865139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:35.865140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:35.865141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:35.865143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:35.865144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.865145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.865147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.865148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:35.865149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:35.865154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:35.865165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:35.865171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:35.865175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:35.865180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:35.865184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:35.865189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:35.865193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:35.865198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:35.865203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:35.865207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.865211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.865216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.865220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:35.865225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:35.865231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:35.865242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:35.865248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:35.865253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:35.865257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:35.865262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:35.865266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:35.865272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:35.865277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:35.865283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:35.865287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:35.865292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:35.865298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:35.865304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:35.865308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:35.865312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:35.865317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:35.865323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:35.865328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:35.865333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:35.865344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.865350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.865356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.865366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.865370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.865376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.865380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:35.865386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:35.865393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:35.865398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:35.865450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:35.866268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895512125750291:3032] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:35.870527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895512125750291:3032] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:35.870556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895512125750291:3032] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:35.870561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895512125750291:3032] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:35.870569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1255 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:35.870909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:35.871803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:35.871820Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:35.871823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:35.871828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:35.871835Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1254 [2:7555895512036000704:7815]
2025-09-30T14:53:35.871851Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:35.871865Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:35.871869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:35.871872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:35.871874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:35.871889Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:35.871894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:35.871901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:35.871963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.871973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.871976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.871979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:35.871982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:35.872145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:35.872153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.872168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:35.872181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:35.872154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1254
2025-09-30T14:53:35.872173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1254
2025-09-30T14:53:35.872199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:35.872225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895512125750329:3032], now have 1 active actors on pipe
2025-09-30T14:53:35.872229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895512125750240:2454], now have 1 active actors on pipe
2025-09-30T14:53:35.872236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895512036000699:7815]
2025-09-30T14:53:35.872239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895512036000699:7815]
2025-09-30T14:53:35.872241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895512036000699:7815]
2025-09-30T14:53:35.872253Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:35.872267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:35.872278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:35.872280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:35.872286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:35.872290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:35.872305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:35.872325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:35.872332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:35.872373Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10a06242-c15bb86b-292f61a5-f9d4f52b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:35.872384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:35.872387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:35.872389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:35.872399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:35.872411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:35.872420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895512036000699:7815]
2025-09-30T14:53:35.872427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:35.872432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:35.872450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:35.872594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:35.872604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:35.872618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:35.872726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1255 partition: 0 MaxSeqNo: 42 sessionId: src_id|10a06242-c15bb86b-292f61a5-f9d4f52b_0
2025-09-30T14:53:35.873120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd002831-6a308850-d7df4391-c43379af_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|10a06242-c15bb86b-292f61a5-f9d4f52b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:35.876008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10a06242-c15bb86b-292f61a5-f9d4f52b_0] Write session: try to update token
2025-09-30T14:53:35.876027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10a06242-c15bb86b-292f61a5-f9d4f52b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:35.884788Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:35.884811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:35.884813Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:35.884815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:35.884825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895512036000699:7815]
2025-09-30T14:53:35.884829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895512036000699:7815]
2025-09-30T14:53:35.884833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895512036000699:7815]
2025-09-30T14:53:35.884877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:35.884884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:35.884886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:35.884889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:35.884899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:35.884924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:35.885020Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:35.890780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1255 sessionId: src_id|10a06242-c15bb86b-292f61a5-f9d4f52b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:35.893655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:35.952055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895512125750336:3461]
2025-09-30T14:53:35.952267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1254, pipe: [1:7555895512125750336:3461]
2025-09-30T14:53:36.002533Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:36.002867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:36.002885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:36.002927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895512125750336:3461], now have 1 active actors on pipe
2025-09-30T14:53:36.003192Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:36.003722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10a06242-c15bb86b-292f61a5-f9d4f52b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:36.003735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10a06242-c15bb86b-292f61a5-f9d4f52b_0] Write session will restart in 0.009281s
2025-09-30T14:53:36.003760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10a06242-c15bb86b-292f61a5-f9d4f52b_0] Write session: Do CDS request
2025-09-30T14:53:36.003765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10a06242-c15bb86b-292f61a5-f9d4f52b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:36.003203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895512125750336:3461]
2025-09-30T14:53:36.003262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:36.003265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:36.003329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1255 reason: error at write: Disconnected sessionId: src_id|10a06242-c15bb86b-292f61a5-f9d4f52b_0
2025-09-30T14:53:36.003546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1255 sessionId: src_id|10a06242-c15bb86b-292f61a5-f9d4f52b_0 is DEAD
2025-09-30T14:53:36.003726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:36.013859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10a06242-c15bb86b-292f61a5-f9d4f52b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:36.013955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:36.013975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1256
2025-09-30T14:53:36.014158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1256 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:36.014209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1256 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:36.014214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1256 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:36.014219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:36.014653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1256 sessionId:  describe result for acl check
2025-09-30T14:53:36.014682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:36.014684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:36.014687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:36.014693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895516420717682:3027] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:36.015282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895516420717682:3027] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:36.016203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:36.017561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895516420717682:3027] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:36.017892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:36.018123Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:36.018133Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:36.018143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:36.018200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:36.018235Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895516330968090:7817]
2025-09-30T14:53:36.018924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:36.019210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:36.019264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:36.019608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:36.019667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:36.019673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:36.019675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:36.019676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:36.019677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:36.019678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:36.019679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:36.019681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:36.019682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:36.019683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:36.019684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.019685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.019686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.019688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:36.019689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:36.019695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:36.019705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:36.019709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:36.019713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:36.019716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:36.019720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:36.019724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:36.019727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:36.019731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:36.019735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:36.019739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.019742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.019745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.019749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:36.019752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:36.019762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:36.019770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:36.019775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:36.019780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:36.019784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:36.019789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:36.019793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:36.019798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:36.019803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:36.019808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:36.019812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:36.019819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:36.019823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:36.019828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:36.019832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:36.019837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:36.019845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:36.019849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:36.019854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:36.019859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:36.019863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.019868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.019872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.019876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.019881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.019887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.019892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:36.019897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:36.019901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:36.019906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:36.019952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:36.020339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895516420717682:3027] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:36.020365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895516420717682:3027] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:36.020369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895516420717682:3027] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:36.020377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1256 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:36.025728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:36.026714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:36.026733Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:36.026736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:36.026740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:36.026748Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1255 [2:7555895516330968090:7817]
2025-09-30T14:53:36.026765Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:36.026785Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:36.026788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:36.026791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:36.026794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:36.026818Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:36.026829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:36.026837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:36.026897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.026905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.026907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.026911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:36.026913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:36.026975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:36.026983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.026996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.027009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.027031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:36.027054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895516420717724:3027], now have 1 active actors on pipe
2025-09-30T14:53:36.027063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895516420717634:2454], now have 1 active actors on pipe
2025-09-30T14:53:36.027069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895516330968084:7817]
2025-09-30T14:53:36.027071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895516330968084:7817]
2025-09-30T14:53:36.027073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895516330968084:7817]
2025-09-30T14:53:36.027086Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:36.027101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:36.027110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:36.027114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:36.027118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:36.027122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:36.027125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:36.027124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1255
2025-09-30T14:53:36.027124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1255
2025-09-30T14:53:36.027158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895516330968084:7817]
2025-09-30T14:53:36.027166Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:36.027175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:36.027202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:36.027212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:36.027238Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3770c76-bc24176-1897c623-6bc21dfa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:36.027267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:36.027270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:36.027273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:36.027283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:36.027297Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:36.027315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:36.027478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:36.027489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:36.027504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:36.027614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1256 partition: 0 MaxSeqNo: 42 sessionId: src_id|f3770c76-bc24176-1897c623-6bc21dfa_0
2025-09-30T14:53:36.028024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10a06242-c15bb86b-292f61a5-f9d4f52b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f3770c76-bc24176-1897c623-6bc21dfa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:36.030948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3770c76-bc24176-1897c623-6bc21dfa_0] Write session: try to update token
2025-09-30T14:53:36.030967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3770c76-bc24176-1897c623-6bc21dfa_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:36.039597Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:36.039618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:36.039621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:36.039623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:36.039633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895516330968084:7817]
2025-09-30T14:53:36.039639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895516330968084:7817]
2025-09-30T14:53:36.039643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895516330968084:7817]
2025-09-30T14:53:36.039688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:36.039692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:36.039698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.039703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:36.039706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:36.039711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:36.039862Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:36.046720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1256 sessionId: src_id|f3770c76-bc24176-1897c623-6bc21dfa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:36.049565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:36.103602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895516420717739:3461]
2025-09-30T14:53:36.103952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1255, pipe: [1:7555895516420717739:3461]
2025-09-30T14:53:36.157220Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:36.157609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:36.157624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:36.157644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895516420717739:3461], now have 1 active actors on pipe
2025-09-30T14:53:36.157865Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:36.157938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895516420717739:3461]
2025-09-30T14:53:36.157983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:36.158063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1256 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f3770c76-bc24176-1897c623-6bc21dfa_0
2025-09-30T14:53:36.158070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:36.158257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1256 sessionId: src_id|f3770c76-bc24176-1897c623-6bc21dfa_0 is DEAD
2025-09-30T14:53:36.158405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3770c76-bc24176-1897c623-6bc21dfa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:36.158417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3770c76-bc24176-1897c623-6bc21dfa_0] Write session will restart in 0.007139s
2025-09-30T14:53:36.158441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3770c76-bc24176-1897c623-6bc21dfa_0] Write session: Do CDS request
2025-09-30T14:53:36.158447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3770c76-bc24176-1897c623-6bc21dfa_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:36.166859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3770c76-bc24176-1897c623-6bc21dfa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:36.166947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:36.166981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1257
2025-09-30T14:53:36.167150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1257 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:36.167195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1257 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:36.167201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1257 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:36.167205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:36.167687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1257 sessionId:  describe result for acl check
2025-09-30T14:53:36.167722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:36.167727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:36.167732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:36.167739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895516420717793:3021] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:36.168285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895516420717793:3021] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:36.170961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895516420717793:3021] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:36.168066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:36.170060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:36.170259Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:36.170263Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:36.170274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:36.170325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:36.170358Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895516330968183:7819]
2025-09-30T14:53:36.171014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:36.171386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:36.171473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:36.171832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:36.171911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:36.171931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:36.171932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:36.171933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:36.171935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:36.171936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:36.171937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:36.171939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:36.171940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:36.171941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:36.171942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.171944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.171945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.171947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:36.171948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:36.171956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:36.171966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:36.171970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:36.171974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:36.171978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:36.171983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:36.171987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:36.171991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:36.171995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:36.171999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:36.172003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.172007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.172011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.172015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:36.172019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:36.172026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:36.172035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:36.172042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:36.172047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:36.172052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:36.172058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:36.172062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:36.172068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:36.172072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:36.172079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:36.172083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:36.172088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:36.172093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:36.172098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:36.172102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:36.172106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:36.172111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:36.172116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:36.172120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:36.172133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:36.172138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.172143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.172152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.172156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.172161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.172167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.172181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:36.172191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:36.172195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:36.172201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:36.172247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:36.176968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895516420717793:3021] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:36.176985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895516420717793:3021] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:36.176988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895516420717793:3021] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:36.176997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1257 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:36.177689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:36.178737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:36.178756Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:36.178759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:36.178763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:36.178770Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1256 [2:7555895516330968183:7819]
2025-09-30T14:53:36.178785Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:36.178801Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:36.178804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:36.178807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:36.178810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:36.178825Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:36.178838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:36.178844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:36.178913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.178923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.178925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.178928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:36.178930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:36.178993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:36.179000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.179014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.179031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.179051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:36.179073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895516420717742:2454], now have 1 active actors on pipe
2025-09-30T14:53:36.179081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895516420717833:3021], now have 1 active actors on pipe
2025-09-30T14:53:36.179088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895516330968177:7819]
2025-09-30T14:53:36.179089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895516330968177:7819]
2025-09-30T14:53:36.179091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895516330968177:7819]
2025-09-30T14:53:36.179106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:36.179126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:36.179131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:36.179136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:36.179139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:36.179144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:36.179148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:36.179161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1256
2025-09-30T14:53:36.179181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1256
2025-09-30T14:53:36.179182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895516330968177:7819]
2025-09-30T14:53:36.179194Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:36.179202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:36.179232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:36.179263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:36.179295Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|635350d9-a31b674-5111fe78-9557843_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:36.179309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:36.179321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:36.179331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:36.179391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:36.179418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:36.179434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:36.179608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:36.179618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:36.179634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:36.179925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1257 partition: 0 MaxSeqNo: 42 sessionId: src_id|635350d9-a31b674-5111fe78-9557843_0
2025-09-30T14:53:36.180353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3770c76-bc24176-1897c623-6bc21dfa_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|635350d9-a31b674-5111fe78-9557843_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:36.183559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|635350d9-a31b674-5111fe78-9557843_0] Write session: try to update token
2025-09-30T14:53:36.183582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|635350d9-a31b674-5111fe78-9557843_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:36.191622Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:36.191648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:36.191651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:36.191653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:36.191662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895516330968177:7819]
2025-09-30T14:53:36.191666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895516330968177:7819]
2025-09-30T14:53:36.191670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895516330968177:7819]
2025-09-30T14:53:36.191718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:36.191721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:36.191729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:36.191733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.191734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:36.191737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:36.191911Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:36.199651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1257 sessionId: src_id|635350d9-a31b674-5111fe78-9557843_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:36.202469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:36.258248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895516420717852:3461]
2025-09-30T14:53:36.258563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1256, pipe: [1:7555895516420717852:3461]
2025-09-30T14:53:36.308320Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:36.308807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:36.308822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:36.308843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895516420717852:3461], now have 1 active actors on pipe
2025-09-30T14:53:36.309057Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:36.309161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:36.309215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:36.309218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:36.309223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895516420717852:3461]
2025-09-30T14:53:36.309280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1257 reason: error at write: Disconnected sessionId: src_id|635350d9-a31b674-5111fe78-9557843_0
2025-09-30T14:53:36.309520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1257 sessionId: src_id|635350d9-a31b674-5111fe78-9557843_0 is DEAD
2025-09-30T14:53:36.309710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|635350d9-a31b674-5111fe78-9557843_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:36.309722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|635350d9-a31b674-5111fe78-9557843_0] Write session will restart in 0.008522s
2025-09-30T14:53:36.309744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|635350d9-a31b674-5111fe78-9557843_0] Write session: Do CDS request
2025-09-30T14:53:36.309753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|635350d9-a31b674-5111fe78-9557843_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:36.318953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:36.319783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|635350d9-a31b674-5111fe78-9557843_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:36.319859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:36.319878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1258
2025-09-30T14:53:36.320046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1258 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:36.320086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1258 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:36.320097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1258 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:36.320101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:36.320508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1258 sessionId:  describe result for acl check
2025-09-30T14:53:36.320545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:36.320547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:36.320549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:36.320555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895516420717907:3014] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:36.320844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:36.321064Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:36.321077Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:36.321089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:36.321082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895516420717907:3014] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:36.321157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:36.321199Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895516330968286:7823]
2025-09-30T14:53:36.321830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:36.322142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:36.322218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:36.322615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:36.322681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:36.322690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:36.322692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:36.322693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:36.322694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:36.322696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:36.322697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:36.322699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:36.322700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:36.322701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:36.322703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.322704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.322705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.322706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:36.322707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:36.322714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:36.322725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:36.322730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:36.322734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:36.322739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:36.322744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:36.322749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:36.322754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:36.322758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:36.322763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:36.322768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.322772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.322777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.322781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:36.322786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:36.322793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:36.322801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:36.322810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:36.322822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:36.322826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:36.322836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:36.322840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:36.322846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:36.322856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:36.322862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:36.322867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:36.322873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:36.322883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:36.322889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:36.322898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:36.322904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:36.322909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:36.322920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:36.322925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:36.322936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:36.322941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.322950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.322954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.322959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.322969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.322974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.322983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:36.322989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:36.322999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:36.323004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:36.323063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:36.323143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895516420717907:3014] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:36.328231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895516420717907:3014] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:36.328251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895516420717907:3014] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:36.328256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895516420717907:3014] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:36.328265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1258 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:36.328554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:36.329484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:36.329500Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:36.329502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:36.329506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:36.329511Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1257 [2:7555895516330968286:7823]
2025-09-30T14:53:36.329523Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:36.329537Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:36.329539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:36.329541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:36.329544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:36.329555Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:36.329560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:36.329565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:36.329622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.329630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.329632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.329636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:36.329638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:36.329700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:36.329707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.329720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.329738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.329760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:36.329778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895516420717946:3014], now have 1 active actors on pipe
2025-09-30T14:53:36.329785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895516420717854:2454], now have 1 active actors on pipe
2025-09-30T14:53:36.329789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895516330968280:7823]
2025-09-30T14:53:36.329791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895516330968280:7823]
2025-09-30T14:53:36.329792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895516330968280:7823]
2025-09-30T14:53:36.329803Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:36.329816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:36.329817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:36.329821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:36.329823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:36.329830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:36.329834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:36.329866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895516330968280:7823]
2025-09-30T14:53:36.329864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1257
2025-09-30T14:53:36.329879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:36.329882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1257
2025-09-30T14:53:36.329893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:36.329930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:36.329939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:36.329962Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|565b91bb-1a356d46-26d3368f-559e4ae1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:36.329972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:36.329976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:36.329977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:36.329988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:36.329997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:36.330015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:36.330168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:36.330174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:36.330185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:36.330272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1258 partition: 0 MaxSeqNo: 42 sessionId: src_id|565b91bb-1a356d46-26d3368f-559e4ae1_0
2025-09-30T14:53:36.330650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|635350d9-a31b674-5111fe78-9557843_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|565b91bb-1a356d46-26d3368f-559e4ae1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:36.333761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|565b91bb-1a356d46-26d3368f-559e4ae1_0] Write session: try to update token
2025-09-30T14:53:36.333780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|565b91bb-1a356d46-26d3368f-559e4ae1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:36.348640Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:36.348661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:36.348671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895516330968280:7823]
2025-09-30T14:53:36.348719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:36.348732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:36.348902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:36.349087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:36.349235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:36.349409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:36.349638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:36.349690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:36.350011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1258 sessionId: src_id|565b91bb-1a356d46-26d3368f-559e4ae1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:36.352722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:36.353382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:36.353406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:36.353426Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:36.353429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:36.353431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:36.353436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:36.353444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895516330968280:7823]
2025-09-30T14:53:36.353447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895516330968280:7823]
2025-09-30T14:53:36.353450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895516330968280:7823]
2025-09-30T14:53:36.353496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:36.353508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.353510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:36.353515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:36.353532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:36.353536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:36.353633Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:36.409291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895516420717953:3461]
2025-09-30T14:53:36.409552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1257, pipe: [1:7555895516420717953:3461]
2025-09-30T14:53:36.469352Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:36.469734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:36.469772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895516420717953:3461], now have 1 active actors on pipe
2025-09-30T14:53:36.469917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:36.469974Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:36.470021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895516420717953:3461]
2025-09-30T14:53:36.470042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:36.470045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:36.470114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1258 reason: error at write: Disconnected sessionId: src_id|565b91bb-1a356d46-26d3368f-559e4ae1_0
2025-09-30T14:53:36.470304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1258 sessionId: src_id|565b91bb-1a356d46-26d3368f-559e4ae1_0 is DEAD
2025-09-30T14:53:36.470447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|565b91bb-1a356d46-26d3368f-559e4ae1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:36.470468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|565b91bb-1a356d46-26d3368f-559e4ae1_0] Write session will restart in 0.009227s
2025-09-30T14:53:36.470492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|565b91bb-1a356d46-26d3368f-559e4ae1_0] Write session: Do CDS request
2025-09-30T14:53:36.470497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|565b91bb-1a356d46-26d3368f-559e4ae1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:36.479381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:36.480752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|565b91bb-1a356d46-26d3368f-559e4ae1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:36.480876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:36.480891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1259
2025-09-30T14:53:36.481039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1259 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:36.481034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:36.481079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1259 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:36.481090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1259 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:36.481094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:36.481235Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:36.481249Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:36.481261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:36.481317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:36.481356Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895516330968376:7825]
2025-09-30T14:53:36.481518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1259 sessionId:  describe result for acl check
2025-09-30T14:53:36.481562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:36.481569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:36.481571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:36.481578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895516420718010:3011] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:36.481975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:36.482166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895516420718010:3011] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:36.482308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:36.482356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:36.482699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:36.482822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:36.482828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:36.482832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:36.482834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:36.482835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:36.482837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:36.482838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:36.482839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:36.482841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:36.482842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:36.482843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.482843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.482844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.482845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:36.482846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:36.482850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:36.482856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:36.482859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:36.482861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:36.482864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:36.482866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:36.482868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:36.482870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:36.482873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:36.482875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:36.482877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.482880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.482882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.482885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:36.482889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:36.482897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:36.482906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:36.482912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:36.482919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:36.482922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:36.482926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:36.482928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:36.482931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:36.482933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:36.482937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:36.482939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:36.482942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:36.482945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:36.482949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:36.482951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:36.482954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:36.482958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:36.482963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:36.482967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:36.482973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:36.482979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.482985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.482989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.482994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.482999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.483001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.483004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:36.483006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:36.483009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:36.483012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:36.483035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:36.484285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895516420718010:3011] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:36.488155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895516420718010:3011] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:36.488175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895516420718010:3011] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:36.488180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895516420718010:3011] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:36.488190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1259 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:36.488449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:36.489248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:36.489263Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:36.489264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:36.489267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:36.489272Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1258 [2:7555895516330968376:7825]
2025-09-30T14:53:36.489286Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:36.489298Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:36.489299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:36.489301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:36.489302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:36.489314Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:36.489318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:36.489323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:36.489362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.489368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.489369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.489372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:36.489374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:36.489436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:36.489443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.489454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.489470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.489491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:36.489515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895516420718048:3011], now have 1 active actors on pipe
2025-09-30T14:53:36.489523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895516420717954:2454], now have 1 active actors on pipe
2025-09-30T14:53:36.489528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895516330968370:7825]
2025-09-30T14:53:36.489533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895516330968370:7825]
2025-09-30T14:53:36.489540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895516330968370:7825]
2025-09-30T14:53:36.489543Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1258
2025-09-30T14:53:36.489553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:36.489544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1258
2025-09-30T14:53:36.489573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:36.489583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:36.489586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:36.489586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:36.489589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:36.489590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:36.489628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:36.489637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:36.489651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895516330968370:7825]
2025-09-30T14:53:36.489660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:36.489680Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e7009cd-720133e7-d01a906a-5588a8a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:36.489684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:36.489691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:36.489695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:36.489697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:36.489706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:36.489714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:36.489737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:36.489929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:36.489938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:36.489954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:36.490045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1259 partition: 0 MaxSeqNo: 42 sessionId: src_id|5e7009cd-720133e7-d01a906a-5588a8a7_0
2025-09-30T14:53:36.490426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|565b91bb-1a356d46-26d3368f-559e4ae1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5e7009cd-720133e7-d01a906a-5588a8a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:36.493178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e7009cd-720133e7-d01a906a-5588a8a7_0] Write session: try to update token
2025-09-30T14:53:36.493196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e7009cd-720133e7-d01a906a-5588a8a7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:36.501684Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:36.501702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:36.501705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:36.501707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:36.501718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895516330968370:7825]
2025-09-30T14:53:36.501722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895516330968370:7825]
2025-09-30T14:53:36.501726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895516330968370:7825]
2025-09-30T14:53:36.501765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:36.501773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.501781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:36.501779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:36.501786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:36.501790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:36.501918Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:36.507545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1259 sessionId: src_id|5e7009cd-720133e7-d01a906a-5588a8a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:36.510275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:36.570078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895516420718057:3461]
2025-09-30T14:53:36.570393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1258, pipe: [1:7555895516420718057:3461]
2025-09-30T14:53:36.613981Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:36.614343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:36.614359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:36.614396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895516420718057:3461], now have 1 active actors on pipe
2025-09-30T14:53:36.614597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:36.614614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:36.614634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:36.614651Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:36.614673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1259 reason: error at write: Disconnected sessionId: src_id|5e7009cd-720133e7-d01a906a-5588a8a7_0
2025-09-30T14:53:36.614699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895516420718057:3461]
2025-09-30T14:53:36.614886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1259 sessionId: src_id|5e7009cd-720133e7-d01a906a-5588a8a7_0 is DEAD
2025-09-30T14:53:36.615045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e7009cd-720133e7-d01a906a-5588a8a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:36.615055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e7009cd-720133e7-d01a906a-5588a8a7_0] Write session will restart in 0.005491s
2025-09-30T14:53:36.615080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e7009cd-720133e7-d01a906a-5588a8a7_0] Write session: Do CDS request
2025-09-30T14:53:36.615090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e7009cd-720133e7-d01a906a-5588a8a7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:36.621809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e7009cd-720133e7-d01a906a-5588a8a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:36.621884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:36.621901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1260
2025-09-30T14:53:36.622114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1260 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:36.622160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1260 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:36.622171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1260 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:36.622175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:36.622625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1260 sessionId:  describe result for acl check
2025-09-30T14:53:36.622664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:36.622671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:36.622673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:36.622680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895516420718091:3004] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:36.623285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895516420718091:3004] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:36.624707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:36.625060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895516420718091:3004] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:36.626496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:36.626682Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:36.626694Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:36.626705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:36.626757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:36.626794Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895516330968470:7827]
2025-09-30T14:53:36.627470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:36.627582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895516420718091:3004] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:36.627599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895516420718091:3004] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:36.627603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895516420718091:3004] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:36.627611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1260 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:36.627758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:36.627800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:36.628129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:36.628200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:36.628207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:36.628208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:36.628209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:36.628210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:36.628211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:36.628213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:36.628214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:36.628216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:36.628217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:36.628218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.628220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.628222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.628224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:36.628225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:36.628230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:36.628241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:36.628245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:36.628249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:36.628253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:36.628257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:36.628261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:36.628265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:36.628269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:36.628273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:36.628277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.628281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.628285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.628288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:36.628292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:36.628308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:36.628321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:36.628332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:36.628337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:36.628342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:36.628347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:36.628351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:36.628356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:36.628361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:36.628366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:36.628376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:36.628381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:36.628386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:36.628392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:36.628409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:36.628414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:36.628417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:36.628422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:36.628427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:36.628431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:36.628435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.628444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.628448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.628453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.628460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.628465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.628469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:36.628476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:36.628481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:36.628486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:36.628534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:36.634086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:36.634920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:36.634938Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:36.634940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:36.634945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:36.634951Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1259 [2:7555895516330968470:7827]
2025-09-30T14:53:36.634966Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:36.634986Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:36.634990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:36.634993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:36.634995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:36.635010Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:36.635026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:36.635033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:36.635093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.635103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.635106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.635109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:36.635112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:36.635183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:36.635191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.635202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.635217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.635238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:36.635279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895516420718058:2454], now have 1 active actors on pipe
2025-09-30T14:53:36.635288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895516420718149:3004], now have 1 active actors on pipe
2025-09-30T14:53:36.635294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895516330968463:7827]
2025-09-30T14:53:36.635297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895516330968463:7827]
2025-09-30T14:53:36.635299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895516330968463:7827]
2025-09-30T14:53:36.635311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:36.635323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:36.635327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:36.635328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:36.635329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:36.635343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:36.635346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:36.635344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1259
2025-09-30T14:53:36.635375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895516330968463:7827]
2025-09-30T14:53:36.635373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1259
2025-09-30T14:53:36.635383Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:36.635385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:36.635427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:36.635436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:36.635466Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a441a5f-245163b9-6ce44790-6412b4b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:36.635476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:36.635481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:36.635483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:36.635518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:36.635534Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:36.635552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:36.635739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:36.635749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:36.635762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:36.635900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1260 partition: 0 MaxSeqNo: 42 sessionId: src_id|9a441a5f-245163b9-6ce44790-6412b4b5_0
2025-09-30T14:53:36.636339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e7009cd-720133e7-d01a906a-5588a8a7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9a441a5f-245163b9-6ce44790-6412b4b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:36.639157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a441a5f-245163b9-6ce44790-6412b4b5_0] Write session: try to update token
2025-09-30T14:53:36.639176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a441a5f-245163b9-6ce44790-6412b4b5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:36.648024Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:36.648047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:36.648050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:36.648052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:36.648062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895516330968463:7827]
2025-09-30T14:53:36.648070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895516330968463:7827]
2025-09-30T14:53:36.648074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895516330968463:7827]
2025-09-30T14:53:36.648101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:36.648105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:36.648111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:36.648112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:36.648118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.648120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:36.648247Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:36.653768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1260 sessionId: src_id|9a441a5f-245163b9-6ce44790-6412b4b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:36.656616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:36.714946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895516420718159:3461]
2025-09-30T14:53:36.715270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1259, pipe: [1:7555895516420718159:3461]
2025-09-30T14:53:36.763323Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:36.763638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:36.763654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:36.763693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895516420718159:3461], now have 1 active actors on pipe
2025-09-30T14:53:36.763912Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:36.763941Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:36.763959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:36.763976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:36.764000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895516420718159:3461]
2025-09-30T14:53:36.764039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1260 reason: error at write: Disconnected sessionId: src_id|9a441a5f-245163b9-6ce44790-6412b4b5_0
2025-09-30T14:53:36.764209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1260 sessionId: src_id|9a441a5f-245163b9-6ce44790-6412b4b5_0 is DEAD
2025-09-30T14:53:36.764371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a441a5f-245163b9-6ce44790-6412b4b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:36.764381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a441a5f-245163b9-6ce44790-6412b4b5_0] Write session will restart in 0.005950s
2025-09-30T14:53:36.764405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a441a5f-245163b9-6ce44790-6412b4b5_0] Write session: Do CDS request
2025-09-30T14:53:36.764410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a441a5f-245163b9-6ce44790-6412b4b5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:36.771735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a441a5f-245163b9-6ce44790-6412b4b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:36.771910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:36.771929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1261
2025-09-30T14:53:36.772098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1261 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:36.772143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1261 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:36.772148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1261 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:36.772154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:36.772628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1261 sessionId:  describe result for acl check
2025-09-30T14:53:36.772659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:36.772666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:36.772668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:36.772677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895516420718175:2998] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:36.773207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895516420718175:2998] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:36.775214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895516420718175:2998] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:36.775639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:36.777467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:36.777696Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:36.777706Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:36.777715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:36.777771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:36.777813Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895516330968566:7830]
2025-09-30T14:53:36.778512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:36.778929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:36.778985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:36.779097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895516420718175:2998] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:36.779114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895516420718175:2998] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:36.779118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895516420718175:2998] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:36.779127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1261 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:36.779341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:36.779423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:36.779432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:36.779433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:36.779434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:36.779435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:36.779436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:36.779438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:36.779439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:36.779440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:36.779442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:36.779443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.779444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.779445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.779446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:36.779450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:36.779456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:36.779467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:36.779471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:36.779476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:36.779480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:36.779483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:36.779487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:36.779491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:36.779495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:36.779499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:36.779503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.779507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.779511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.779514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:36.779518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:36.779526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:36.779535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:36.779542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:36.779547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:36.779552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:36.779557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:36.779561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:36.779566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:36.779574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:36.779580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:36.779584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:36.779589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:36.779594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:36.779599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:36.779603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:36.779610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:36.779696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:36.779711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:36.779716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:36.779721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:36.779725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.779731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.779735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.779740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.779745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.779750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.779760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:36.779765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:36.779770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:36.779780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:36.779824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:36.785619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:36.786539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:36.786557Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:36.786560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:36.786568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:36.786575Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1260 [2:7555895516330968566:7830]
2025-09-30T14:53:36.786592Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:36.786608Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:36.786618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:36.786624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:36.786626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:36.786639Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:36.786644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:36.786650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:36.786695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.786702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.786703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.786705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:36.786707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:36.786755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:36.786760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.786770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.786776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.786786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:36.786800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895516330968560:7830]
2025-09-30T14:53:36.786802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895516330968560:7830]
2025-09-30T14:53:36.786804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895516330968560:7830]
2025-09-30T14:53:36.786812Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:36.786828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895516420718160:2454], now have 1 active actors on pipe
2025-09-30T14:53:36.786834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:36.786847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:36.786850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:36.786865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:36.786868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:36.786871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:36.786885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895516330968560:7830]
2025-09-30T14:53:36.786891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:36.786892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:36.786909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895516420718253:2998], now have 1 active actors on pipe
2025-09-30T14:53:36.787295Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1260
2025-09-30T14:53:36.787340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1260
2025-09-30T14:53:36.787464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:36.787479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:36.787504Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4d45436-bca13d41-f2fa584b-c611903a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:36.787511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:36.787514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:36.787516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:36.787527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:36.787538Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:36.787550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:36.787729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:36.787737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:36.787752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:36.788081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1261 partition: 0 MaxSeqNo: 42 sessionId: src_id|f4d45436-bca13d41-f2fa584b-c611903a_0
2025-09-30T14:53:36.788447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a441a5f-245163b9-6ce44790-6412b4b5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f4d45436-bca13d41-f2fa584b-c611903a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:36.791127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d45436-bca13d41-f2fa584b-c611903a_0] Write session: try to update token
2025-09-30T14:53:36.791146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d45436-bca13d41-f2fa584b-c611903a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:36.799190Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:36.799207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:36.799209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:36.799211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:36.799221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895516330968560:7830]
2025-09-30T14:53:36.799225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895516330968560:7830]
2025-09-30T14:53:36.799228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895516330968560:7830]
2025-09-30T14:53:36.799288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:36.799291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:36.799298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.799301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:36.799301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:36.799306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:36.799454Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:36.805687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1261 sessionId: src_id|f4d45436-bca13d41-f2fa584b-c611903a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:36.808433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:36.864474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895516420718276:3461]
2025-09-30T14:53:36.864928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1260, pipe: [1:7555895516420718276:3461]
2025-09-30T14:53:36.912452Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:36.912704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:36.912720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:36.912752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895516420718276:3461], now have 1 active actors on pipe
2025-09-30T14:53:36.912985Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:36.913054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895516420718276:3461]
2025-09-30T14:53:36.913078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:36.912915Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:36.913199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1261 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f4d45436-bca13d41-f2fa584b-c611903a_0
2025-09-30T14:53:36.913410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1261 sessionId: src_id|f4d45436-bca13d41-f2fa584b-c611903a_0 is DEAD
2025-09-30T14:53:36.913544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d45436-bca13d41-f2fa584b-c611903a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:36.913551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d45436-bca13d41-f2fa584b-c611903a_0] Write session will restart in 0.006270s
2025-09-30T14:53:36.913569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d45436-bca13d41-f2fa584b-c611903a_0] Write session: Do CDS request
2025-09-30T14:53:36.913573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d45436-bca13d41-f2fa584b-c611903a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:36.920785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d45436-bca13d41-f2fa584b-c611903a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:36.921152Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:36.921172Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1262
2025-09-30T14:53:36.921286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1262 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:36.921318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1262 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:36.921327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1262 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:36.921332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:36.921801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1262 sessionId:  describe result for acl check
2025-09-30T14:53:36.921840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:36.921842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:36.921845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:36.921850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895516420718320:2977] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:36.922443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895516420718320:2977] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:36.924762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:36.925027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895516420718320:2977] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:36.926945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:36.927119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895516420718320:2977] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:36.927134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895516420718320:2977] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:36.927137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895516420718320:2977] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:36.927145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1262 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:36.927174Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:36.927189Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:36.927200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:36.927273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:36.927310Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895516330968697:7844]
2025-09-30T14:53:36.927981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:36.928326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:36.928403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:36.928757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:36.928824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:36.928832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:36.928833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:36.928834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:36.928834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:36.928836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:36.928837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:36.928838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:36.928839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:36.928840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:36.928841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.928842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.928843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.928844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:36.928845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:36.928850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:36.928858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:36.928862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:36.928865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:36.928868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:36.928872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:36.928875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:36.928878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:36.928881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:36.928886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:36.928889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.928892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.928897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.928901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:36.928904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:36.928911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:36.928918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:36.928923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:36.928928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:36.928933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:36.928938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:36.928941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:36.928946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:36.928950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:36.928954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:36.928958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:36.928962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:36.928967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:36.928975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:36.928979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:36.928983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:36.928988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:36.928993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:36.928999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:36.929004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:36.929008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.929012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.929016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.929020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.929025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.929030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.929033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:36.929037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:36.929042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:36.929046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:36.929082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:36.935100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:36.936190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:36.936210Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:36.936213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:36.936217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:36.936224Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1261 [2:7555895516330968697:7844]
2025-09-30T14:53:36.936242Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:36.936258Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:36.936262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:36.936265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:36.936268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:36.936285Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:36.936291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:36.936299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:36.936364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.936372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.936374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.936377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:36.936380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:36.936451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:36.936457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.936473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:36.936491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:36.936514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:36.936538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895516420718378:2977], now have 1 active actors on pipe
2025-09-30T14:53:36.936548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895516330968691:7844]
2025-09-30T14:53:36.936554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895516330968691:7844]
2025-09-30T14:53:36.936558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895516330968691:7844]
2025-09-30T14:53:36.936572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:36.936589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:36.936607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:36.936613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:36.936619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895516420718286:2454], now have 1 active actors on pipe
2025-09-30T14:53:36.936628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:36.936642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:36.936644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:36.936654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895516330968691:7844]
2025-09-30T14:53:36.936658Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:36.936660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:36.937355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:36.937375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:36.937403Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42c1082-1ae40f68-f89f5f08-48b41f33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:36.937412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:36.937420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:36.937422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:36.937433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:36.937445Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:36.937469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:36.937743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:36.937755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:36.937769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:36.938406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d45436-bca13d41-f2fa584b-c611903a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|42c1082-1ae40f68-f89f5f08-48b41f33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:36.936810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1261
2025-09-30T14:53:36.936840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1261
2025-09-30T14:53:36.937984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1262 partition: 0 MaxSeqNo: 42 sessionId: src_id|42c1082-1ae40f68-f89f5f08-48b41f33_0
2025-09-30T14:53:36.941306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42c1082-1ae40f68-f89f5f08-48b41f33_0] Write session: try to update token
2025-09-30T14:53:36.941326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42c1082-1ae40f68-f89f5f08-48b41f33_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:36.950108Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:36.950132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:36.950135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:36.950137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:36.950146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895516330968691:7844]
2025-09-30T14:53:36.950150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895516330968691:7844]
2025-09-30T14:53:36.950154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895516330968691:7844]
2025-09-30T14:53:36.950194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:36.950202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:36.950205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:36.950362Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:36.950382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:36.950389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:36.950393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:36.958656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1262 sessionId: src_id|42c1082-1ae40f68-f89f5f08-48b41f33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:36.961458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:37.013463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895520715685686:3461]
2025-09-30T14:53:37.013694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1261, pipe: [1:7555895520715685686:3461]
2025-09-30T14:53:37.065738Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:37.066202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:37.066212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:37.066250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895520715685686:3461], now have 1 active actors on pipe
2025-09-30T14:53:37.066660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:37.066693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895520715685686:3461]
2025-09-30T14:53:37.066688Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:37.066719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:37.066723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:37.066793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1262 reason: error at write: Disconnected sessionId: src_id|42c1082-1ae40f68-f89f5f08-48b41f33_0
2025-09-30T14:53:37.067412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42c1082-1ae40f68-f89f5f08-48b41f33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:37.067421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42c1082-1ae40f68-f89f5f08-48b41f33_0] Write session will restart in 0.007459s
2025-09-30T14:53:37.067467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42c1082-1ae40f68-f89f5f08-48b41f33_0] Write session: Do CDS request
2025-09-30T14:53:37.067473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42c1082-1ae40f68-f89f5f08-48b41f33_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:37.067018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1262 sessionId: src_id|42c1082-1ae40f68-f89f5f08-48b41f33_0 is DEAD
2025-09-30T14:53:37.075824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42c1082-1ae40f68-f89f5f08-48b41f33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:37.075981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:37.075999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1263
2025-09-30T14:53:37.076123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1263 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:37.076168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1263 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:37.076174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1263 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:37.076178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:37.076426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:37.076691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1263 sessionId:  describe result for acl check
2025-09-30T14:53:37.076728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:37.076735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:37.076737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:37.076743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895520715685749:2978] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:37.077362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895520715685749:2978] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:37.079299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895520715685749:2978] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:37.081124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:37.081358Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:37.081366Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:37.081379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:37.081439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:37.081584Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895520625936089:7846]
2025-09-30T14:53:37.082179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895520715685749:2978] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:37.082193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895520715685749:2978] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:37.082197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895520715685749:2978] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:37.082205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1263 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:37.082255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:37.082577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:37.082630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:37.082975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:37.083038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:37.083044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:37.083046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:37.083047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:37.083048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:37.083050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:37.083051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:37.083053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:37.083054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:37.083055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:37.083056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.083057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.083061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.083062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:37.083063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:37.083069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:37.083079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:37.083084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:37.083088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:37.083092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:37.083097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:37.083101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:37.083105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:37.083109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:37.083113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:37.083117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.083121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.083125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.083129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:37.083133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:37.083140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:37.083148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:37.083154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:37.083159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:37.083165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:37.083170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:37.083174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:37.083182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:37.083187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:37.083192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:37.083202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:37.083208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:37.083217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:37.083223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:37.083229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:37.083235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:37.083239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:37.083258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:37.083262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:37.083268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:37.083273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.083278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.083282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.083287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.083296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.083301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.083305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:37.083315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:37.083319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:37.083324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:37.083374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:37.089830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:37.091220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1262
2025-09-30T14:53:37.091237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1262
2025-09-30T14:53:37.090792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:37.090813Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:37.090816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:37.090820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:37.090827Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1262 [2:7555895520625936089:7846]
2025-09-30T14:53:37.090843Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:37.090859Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:37.090864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:37.090868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:37.090870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:37.090885Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:37.090895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:37.090901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:37.090966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.090970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.090972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.090975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:37.090977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:37.091044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:37.091047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.091060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.091072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.091088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:37.091104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895520625936083:7846]
2025-09-30T14:53:37.091106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895520625936083:7846]
2025-09-30T14:53:37.091108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895520625936083:7846]
2025-09-30T14:53:37.091115Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:37.091127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:37.091131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:37.091132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895520715685785:2978], now have 1 active actors on pipe
2025-09-30T14:53:37.091134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:37.091140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:37.091154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:37.091158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:37.091163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895520715685692:2454], now have 1 active actors on pipe
2025-09-30T14:53:37.091192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895520625936083:7846]
2025-09-30T14:53:37.091203Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:37.091210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:37.091276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:37.091281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:37.091316Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c20bf16-8fc9b864-26a84ec4-dd973bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:37.091323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:37.091327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:37.091329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:37.091339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:37.091350Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:37.091363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:37.091683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:37.091717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:37.091742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:37.091837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1263 partition: 0 MaxSeqNo: 42 sessionId: src_id|7c20bf16-8fc9b864-26a84ec4-dd973bf_0
2025-09-30T14:53:37.092272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42c1082-1ae40f68-f89f5f08-48b41f33_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7c20bf16-8fc9b864-26a84ec4-dd973bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:37.095100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c20bf16-8fc9b864-26a84ec4-dd973bf_0] Write session: try to update token
2025-09-30T14:53:37.095119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c20bf16-8fc9b864-26a84ec4-dd973bf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:37.103664Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:37.103689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:37.103699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895520625936083:7846]
2025-09-30T14:53:37.103742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:37.103744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:37.103921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:37.104076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:37.104226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:37.104376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:37.104583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:37.104629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:37.112120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1263 sessionId: src_id|7c20bf16-8fc9b864-26a84ec4-dd973bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:37.114971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:37.115159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:37.115185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:37.115223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:37.115343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:37.120729Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:37.120752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:37.120755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:37.120758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:37.120768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895520625936083:7846]
2025-09-30T14:53:37.120772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895520625936083:7846]
2025-09-30T14:53:37.120780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895520625936083:7846]
2025-09-30T14:53:37.120818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:37.120823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:37.120825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.120828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:37.120838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:37.120842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:37.120976Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:37.167052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895520715685800:3461]
2025-09-30T14:53:37.167366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1262, pipe: [1:7555895520715685800:3461]
2025-09-30T14:53:37.236905Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:37.245271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:37.245304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:37.245487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:37.245556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:37.245620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:37.245680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:37.246127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:37.246137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:37.246214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:37.246280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:37.246366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:37.246438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:37.246482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:37.246486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:37.246558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:37.246618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:37.246685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:37.246753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:37.246801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:37.246806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:37.246882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:37.246946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:37.247009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:37.247072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:37.247114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:37.247118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:37.247192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:37.247412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:37.247493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:37.247565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:37.247618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:37.247627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:37.247701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:37.249588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:37.249605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:37.249614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:37.249633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1263 reason: error at write: Disconnected sessionId: src_id|7c20bf16-8fc9b864-26a84ec4-dd973bf_0
2025-09-30T14:53:37.249664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895520715685800:3461]
2025-09-30T14:53:37.249874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1263 sessionId: src_id|7c20bf16-8fc9b864-26a84ec4-dd973bf_0 is DEAD
2025-09-30T14:53:37.247778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:37.247847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:37.247904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:37.247947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:37.247951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:37.250067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c20bf16-8fc9b864-26a84ec4-dd973bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:37.248020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:37.250075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c20bf16-8fc9b864-26a84ec4-dd973bf_0] Write session will restart in 0.008926s
2025-09-30T14:53:37.248088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:37.248153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:37.248213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:37.248257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:37.248260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:37.248329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:37.248388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:37.248452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:37.248511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:37.250111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c20bf16-8fc9b864-26a84ec4-dd973bf_0] Write session: Do CDS request
2025-09-30T14:53:37.248554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:37.248557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:37.250117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c20bf16-8fc9b864-26a84ec4-dd973bf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:37.248648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:37.248708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:37.248773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:37.248836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:37.248969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:37.248972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:37.249046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:37.249105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:37.249166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:37.249224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:37.249270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:37.249273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:37.249348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895520715685800:3461], now have 1 active actors on pipe
2025-09-30T14:53:37.249700Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:37.259815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c20bf16-8fc9b864-26a84ec4-dd973bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:37.259971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:37.261880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:37.262159Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:37.262172Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:37.262185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:37.262257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:37.262299Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895520625936200:7850]
2025-09-30T14:53:37.262928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:37.263310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:37.263360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:37.263674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:37.263747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:37.263749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:37.263750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:37.263751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:37.263753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:37.263754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:37.263755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:37.263756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:37.263757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:37.263759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:37.263760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.263761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.263762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.263763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:37.263764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:37.263771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:37.263781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:37.263784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:37.263788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:37.263792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:37.263796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:37.263800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:37.263804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:37.263808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:37.263812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:37.263816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.263819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.263825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.263828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:37.263832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:37.263839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:37.263848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:37.263853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:37.263858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:37.263862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:37.263868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:37.263872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:37.263876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:37.263881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:37.263886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:37.263892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:37.263899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:37.263903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:37.263908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:37.263912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:37.263916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:37.263920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:37.263925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:37.263928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:37.263933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:37.263937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.263942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.263946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.263950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.263955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.263959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.263962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:37.263967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:37.263974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:37.263978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:37.264017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:37.263591Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:37.263610Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1264
2025-09-30T14:53:37.266219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1264 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:37.266269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1264 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:37.266279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1264 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:37.266285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:37.266766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1264 sessionId:  describe result for acl check
2025-09-30T14:53:37.266816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:37.266825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:37.266827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:37.266833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895520715685878:2961] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:37.267401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895520715685878:2961] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:37.269898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:37.270825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:37.270830Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:37.270833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:37.270837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:37.270843Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1263 [2:7555895520625936200:7850]
2025-09-30T14:53:37.270858Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:37.270872Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:37.270876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:37.270879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:37.270881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:37.270896Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:37.270916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:37.270923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:37.270990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.270997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.270999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.271003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:37.271005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:37.271074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:37.271084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.271098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.271145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895520715685878:2961] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:37.271204Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1263
2025-09-30T14:53:37.271112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.271131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:37.271151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895520715685814:2454], now have 1 active actors on pipe
2025-09-30T14:53:37.271157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895520625936194:7850]
2025-09-30T14:53:37.271159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895520625936194:7850]
2025-09-30T14:53:37.271160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895520625936194:7850]
2025-09-30T14:53:37.271173Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:37.271188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:37.271190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:37.271194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:37.271197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:37.271202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:37.271204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:37.271237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895520625936194:7850]
2025-09-30T14:53:37.271239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:37.271277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:37.276744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895520715685878:2961] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:37.276769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895520715685878:2961] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:37.276787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895520715685878:2961] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:37.276797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1264 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:37.283300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895520715685915:2961], now have 1 active actors on pipe
2025-09-30T14:53:37.283663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1263
2025-09-30T14:53:37.284516Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:37.284535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:37.284538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:37.284539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:37.284549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895520625936194:7850]
2025-09-30T14:53:37.284553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895520625936194:7850]
2025-09-30T14:53:37.284557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895520625936194:7850]
2025-09-30T14:53:37.284599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:37.284605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.284613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:37.284648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:37.284663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:37.284669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:37.284742Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:37.351313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895520715685920:3461]
2025-09-30T14:53:37.351607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1263, pipe: [1:7555895520715685920:3461]
2025-09-30T14:53:37.402791Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:37.403077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:37.403093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:37.403129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895520715685920:3461], now have 1 active actors on pipe
2025-09-30T14:53:37.403340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:37.403372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:37.403374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1264 reason: pipe to partition's 0 tablet is dead #2 sessionId: 
2025-09-30T14:53:37.403366Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:37.403419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895520715685920:3461]
2025-09-30T14:53:37.403599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1264 sessionId:  is DEAD
2025-09-30T14:53:37.403786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c20bf16-8fc9b864-26a84ec4-dd973bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-09-30T14:53:37.403797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c20bf16-8fc9b864-26a84ec4-dd973bf_0] Write session will restart in 0.015731s
2025-09-30T14:53:37.403824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c20bf16-8fc9b864-26a84ec4-dd973bf_0] Write session: Do CDS request
2025-09-30T14:53:37.403831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c20bf16-8fc9b864-26a84ec4-dd973bf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:37.414018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:37.415827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:37.416041Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:37.416054Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:37.416066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:37.416119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:37.416159Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895520625936298:7852]
2025-09-30T14:53:37.416765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:37.417074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:37.417121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:37.417458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:37.417526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:37.417534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:37.417535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:37.417536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:37.417537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:37.417538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:37.417540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:37.417541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:37.417542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:37.417544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:37.417545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.417546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.417547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.417549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:37.417550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:37.417555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:37.417565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:37.417568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:37.417572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:37.417576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:37.417580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:37.417583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:37.417587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:37.417591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:37.417596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:37.417601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.417604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.417607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.417611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:37.417615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:37.417622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:37.417629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:37.417635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:37.417641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:37.417645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:37.417651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:37.417656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:37.417660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:37.417665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:37.417670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:37.417674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:37.417679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:37.417685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:37.417690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:37.417700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:37.417705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:37.417709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:37.417713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:37.417722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:37.417727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:37.417731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.417736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.417744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.417749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.417755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.417761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.417770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:37.417775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:37.417779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:37.417784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:37.417830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:37.420867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c20bf16-8fc9b864-26a84ec4-dd973bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:37.420926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:37.420945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1265
2025-09-30T14:53:37.421115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1265 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:37.421148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1265 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:37.421159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1265 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:37.421164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:37.421607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1265 sessionId:  describe result for acl check
2025-09-30T14:53:37.421642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:37.421649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:37.421652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:37.421658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895520715685986:2964] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:37.422247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895520715685986:2964] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:37.423272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:37.424284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:37.424301Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:37.424304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:37.424307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:37.424314Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1264 [2:7555895520625936298:7852]
2025-09-30T14:53:37.424330Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:37.424344Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:37.424348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:37.424351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:37.424353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:37.424369Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:37.424381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:37.424388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:37.424426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895520715685986:2964] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:37.424448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.424455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.424457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.424461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:37.424464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:37.424525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:37.424533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.424546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.424565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.424581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:37.424601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895520715685921:2454], now have 1 active actors on pipe
2025-09-30T14:53:37.424613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895520625936292:7852]
2025-09-30T14:53:37.424615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895520625936292:7852]
2025-09-30T14:53:37.424617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895520625936292:7852]
2025-09-30T14:53:37.424629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:37.424642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:37.424642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:37.424646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:37.424648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:37.424663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:37.424665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:37.424696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895520625936292:7852]
2025-09-30T14:53:37.424708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:37.424715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:37.424654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1264
2025-09-30T14:53:37.430146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895520715685986:2964] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:37.430163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895520715685986:2964] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:37.430166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895520715685986:2964] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:37.430175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1265 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:37.430422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895520715686024:2964], now have 1 active actors on pipe
2025-09-30T14:53:37.430578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:37.430590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:37.430621Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6788ecfb-558d2f44-36050fd3-27cf96f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:37.430637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:37.430642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:37.430645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:37.430656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:37.430676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:37.430698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:37.430463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1264
2025-09-30T14:53:37.430862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:37.430878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:37.430901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:37.430998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1265 partition: 0 MaxSeqNo: 42 sessionId: src_id|6788ecfb-558d2f44-36050fd3-27cf96f9_0
2025-09-30T14:53:37.431428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c20bf16-8fc9b864-26a84ec4-dd973bf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6788ecfb-558d2f44-36050fd3-27cf96f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:37.434212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6788ecfb-558d2f44-36050fd3-27cf96f9_0] Write session: try to update token
2025-09-30T14:53:37.434231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6788ecfb-558d2f44-36050fd3-27cf96f9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:37.437673Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:37.437692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:37.437701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895520625936292:7852]
2025-09-30T14:53:37.437743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:37.437746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:37.437919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:37.438083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:37.438237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:37.438385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:37.438586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:37.438624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:37.450216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1265 sessionId: src_id|6788ecfb-558d2f44-36050fd3-27cf96f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:37.450444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:37.450466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:37.450468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:37.450471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:37.450482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895520625936292:7852]
2025-09-30T14:53:37.450487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895520625936292:7852]
2025-09-30T14:53:37.450492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895520625936292:7852]
2025-09-30T14:53:37.450530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:37.450540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.450539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:37.450543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:37.450546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:37.450551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:37.450673Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:37.452973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:37.503419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895520715686028:3461]
2025-09-30T14:53:37.503762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1264, pipe: [1:7555895520715686028:3461]
2025-09-30T14:53:37.565672Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:37.566126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:37.566141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:37.566163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895520715686028:3461], now have 1 active actors on pipe
2025-09-30T14:53:37.566422Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:37.566863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6788ecfb-558d2f44-36050fd3-27cf96f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:37.566873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6788ecfb-558d2f44-36050fd3-27cf96f9_0] Write session will restart in 0.006438s
2025-09-30T14:53:37.566387Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:37.566895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6788ecfb-558d2f44-36050fd3-27cf96f9_0] Write session: Do CDS request
2025-09-30T14:53:37.566420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895520715686028:3461]
2025-09-30T14:53:37.566441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:37.566901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6788ecfb-558d2f44-36050fd3-27cf96f9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:37.566444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:37.566520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1265 reason: error at write: Disconnected sessionId: src_id|6788ecfb-558d2f44-36050fd3-27cf96f9_0
2025-09-30T14:53:37.566700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1265 sessionId: src_id|6788ecfb-558d2f44-36050fd3-27cf96f9_0 is DEAD
2025-09-30T14:53:37.574750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6788ecfb-558d2f44-36050fd3-27cf96f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:37.575115Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:37.575133Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1266
2025-09-30T14:53:37.575313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1266 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:37.575348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1266 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:37.575353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1266 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:37.575357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:37.576241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1266 sessionId:  describe result for acl check
2025-09-30T14:53:37.576282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:37.576291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:37.576295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:37.576301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895520715686089:2952] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:37.576889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895520715686089:2952] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:37.578401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:37.578799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895520715686089:2952] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:37.581701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895520715686089:2952] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:37.581716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895520715686089:2952] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:37.581728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895520715686089:2952] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:37.581736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1266 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:37.581372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:37.581606Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:37.581611Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:37.581623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:37.581697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:37.581732Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895520625936397:7854]
2025-09-30T14:53:37.582399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:37.582905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:37.582978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:37.583360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:37.583439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:37.583445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:37.583447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:37.583448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:37.583450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:37.583451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:37.583453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:37.583454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:37.583456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:37.583457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:37.583459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.583460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.583461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.583463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:37.583464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:37.583471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:37.583482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:37.583486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:37.583502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:37.583506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:37.583511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:37.583516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:37.583520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:37.583530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:37.583535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:37.583545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.583549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.583559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.583564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:37.583572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:37.583580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:37.583609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:37.583620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:37.583624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:37.583629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:37.583635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:37.583639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:37.583645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:37.583651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:37.583658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:37.583663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:37.583670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:37.583675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:37.583682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:37.583686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:37.583693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:37.583698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:37.583704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:37.583709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:37.583715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:37.583720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.583726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.583731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.583736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.583741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.583747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.583752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:37.583756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:37.583762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:37.583768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:37.583817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:37.590838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:37.591805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:37.591825Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:37.591828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:37.591833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:37.591840Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1265 [2:7555895520625936397:7854]
2025-09-30T14:53:37.591859Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:37.591878Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:37.591882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:37.591885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:37.591888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:37.591906Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:37.591913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:37.591923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:37.591981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.591989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.591992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.591997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:37.591999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:37.592274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1265
2025-09-30T14:53:37.592323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1265
2025-09-30T14:53:37.592070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:37.592078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.592091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.592103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.592119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:37.592138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895520715686031:2454], now have 1 active actors on pipe
2025-09-30T14:53:37.592142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895520715686127:2952], now have 1 active actors on pipe
2025-09-30T14:53:37.592149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895520625936391:7854]
2025-09-30T14:53:37.592152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895520625936391:7854]
2025-09-30T14:53:37.592154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895520625936391:7854]
2025-09-30T14:53:37.592166Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:37.592181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:37.592186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:37.592190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:37.592192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:37.592198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:37.592201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:37.592238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895520625936391:7854]
2025-09-30T14:53:37.592246Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:37.592524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:37.592616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:37.592623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:37.592645Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d36cae9-2fe093be-e2bfd647-dc6ef5f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:37.592663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:37.592666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:37.592669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:37.592680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:37.592693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:37.592710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:37.593000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:37.593010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:37.593031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:37.593148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1266 partition: 0 MaxSeqNo: 42 sessionId: src_id|5d36cae9-2fe093be-e2bfd647-dc6ef5f6_0
2025-09-30T14:53:37.593547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6788ecfb-558d2f44-36050fd3-27cf96f9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5d36cae9-2fe093be-e2bfd647-dc6ef5f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:37.596297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d36cae9-2fe093be-e2bfd647-dc6ef5f6_0] Write session: try to update token
2025-09-30T14:53:37.596318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d36cae9-2fe093be-e2bfd647-dc6ef5f6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:37.621593Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:37.621615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:37.621618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:37.621620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:37.621629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895520625936391:7854]
2025-09-30T14:53:37.621636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895520625936391:7854]
2025-09-30T14:53:37.621642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895520625936391:7854]
2025-09-30T14:53:37.621681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:37.621688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.621691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:37.621724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:37.621730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:37.621733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:37.621832Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:37.621947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1266 sessionId: src_id|5d36cae9-2fe093be-e2bfd647-dc6ef5f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:37.624502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:37.666762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895520715686139:3461]
2025-09-30T14:53:37.667056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1265, pipe: [1:7555895520715686139:3461]
2025-09-30T14:53:37.755489Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:37.755835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:37.755851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:37.755892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895520715686139:3461], now have 1 active actors on pipe
2025-09-30T14:53:37.756149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:37.756165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:37.756230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1266 reason: error at write: Disconnected sessionId: src_id|5d36cae9-2fe093be-e2bfd647-dc6ef5f6_0
2025-09-30T14:53:37.756310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895520715686139:3461]
2025-09-30T14:53:37.756336Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:37.756143Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:37.756430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1266 sessionId: src_id|5d36cae9-2fe093be-e2bfd647-dc6ef5f6_0 is DEAD
2025-09-30T14:53:37.756580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d36cae9-2fe093be-e2bfd647-dc6ef5f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:37.756586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d36cae9-2fe093be-e2bfd647-dc6ef5f6_0] Write session will restart in 0.005309s
2025-09-30T14:53:37.756609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d36cae9-2fe093be-e2bfd647-dc6ef5f6_0] Write session: Do CDS request
2025-09-30T14:53:37.756628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d36cae9-2fe093be-e2bfd647-dc6ef5f6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:37.762724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d36cae9-2fe093be-e2bfd647-dc6ef5f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:37.762835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:37.762856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1267
2025-09-30T14:53:37.763021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1267 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:37.763076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1267 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:37.763096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1267 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:37.763101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:37.763576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1267 sessionId:  describe result for acl check
2025-09-30T14:53:37.763610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:37.763617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:37.763619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:37.763625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895520715686156:2947] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:37.764159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895520715686156:2947] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:37.767876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895520715686156:2947] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:37.769092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:37.770617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:37.770818Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:37.770814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895520715686156:2947] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:37.770828Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:37.770835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895520715686156:2947] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:37.770839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895520715686156:2947] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:37.770847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1267 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:37.770839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:37.770901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:37.770939Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895520625936499:7857]
2025-09-30T14:53:37.771648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:37.772021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:37.772078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:37.772418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:37.772474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:37.772482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:37.772483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:37.772484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:37.772485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:37.772486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:37.772487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:37.772488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:37.772490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:37.772491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:37.772492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.772493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.772495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.772496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:37.772497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:37.772503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:37.772514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:37.772518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:37.772523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:37.772528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:37.772532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:37.772537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:37.772541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:37.772546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:37.772551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:37.772555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.772559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.772564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.772568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:37.772573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:37.772580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:37.772588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:37.772595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:37.772601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:37.772607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:37.772613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:37.772618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:37.772623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:37.772629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:37.772635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:37.772640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:37.772646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:37.772651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:37.772657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:37.772662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:37.772668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:37.772674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:37.772679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:37.772684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:37.772690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:37.772697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.772712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.772717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.772722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.772727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.772732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.772737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:37.772743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:37.772748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:37.772753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:37.772803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:37.780500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:37.781526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:37.781543Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:37.781545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:37.781550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:37.781556Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1266 [2:7555895520625936499:7857]
2025-09-30T14:53:37.781575Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:37.781595Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:37.781602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:37.781607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:37.781610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:37.781626Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:37.781633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:37.781640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:37.781714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.781723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.781724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.781728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:37.781730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:37.781803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:37.781811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.781826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.781837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.781857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:37.781882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895520625936494:7857]
2025-09-30T14:53:37.781885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895520625936494:7857]
2025-09-30T14:53:37.781887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895520625936494:7857]
2025-09-30T14:53:37.781896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:37.781905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:37.781909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:37.781911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895520715686238:2947], now have 1 active actors on pipe
2025-09-30T14:53:37.781912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:37.781916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895520715686141:2454], now have 1 active actors on pipe
2025-09-30T14:53:37.781925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:37.781939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:37.781948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:37.781985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895520625936494:7857]
2025-09-30T14:53:37.782001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:37.782036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:37.782394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1266
2025-09-30T14:53:37.782406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1266
2025-09-30T14:53:37.782513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:37.782529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:37.782565Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f0e98cd-bedcab3e-b2f871-ab31a67f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:37.782580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:37.782588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:37.782591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:37.782601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:37.782621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:37.782641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:37.782831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:37.782844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:37.782866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:37.782987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1267 partition: 0 MaxSeqNo: 42 sessionId: src_id|3f0e98cd-bedcab3e-b2f871-ab31a67f_0
2025-09-30T14:53:37.783404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d36cae9-2fe093be-e2bfd647-dc6ef5f6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3f0e98cd-bedcab3e-b2f871-ab31a67f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:37.786435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0e98cd-bedcab3e-b2f871-ab31a67f_0] Write session: try to update token
2025-09-30T14:53:37.786459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0e98cd-bedcab3e-b2f871-ab31a67f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:37.795461Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:37.795493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:37.795505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895520625936494:7857]
2025-09-30T14:53:37.795551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:37.795565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:37.795867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:37.796114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:37.796355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:37.796594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:37.796830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:37.796882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:37.803276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1267 sessionId: src_id|3f0e98cd-bedcab3e-b2f871-ab31a67f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:37.806053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:37.807199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:37.807228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:37.807283Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:37.807287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:37.807289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:37.807298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:37.807306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895520625936494:7857]
2025-09-30T14:53:37.807310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895520625936494:7857]
2025-09-30T14:53:37.807313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895520625936494:7857]
2025-09-30T14:53:37.807362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:37.807365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:37.807372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:37.807373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.807375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:37.807376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:37.807508Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:37.856719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895520715686250:3461]
2025-09-30T14:53:37.857001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1266, pipe: [1:7555895520715686250:3461]
2025-09-30T14:53:37.922897Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:37.923161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:37.923191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895520715686250:3461], now have 1 active actors on pipe
2025-09-30T14:53:37.923282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:37.923468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895520715686250:3461]
2025-09-30T14:53:37.923494Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:37.934191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:37.935779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:37.935795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:37.935820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1267 reason: error at write: Disconnected sessionId: src_id|3f0e98cd-bedcab3e-b2f871-ab31a67f_0
2025-09-30T14:53:37.935959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1267 sessionId: src_id|3f0e98cd-bedcab3e-b2f871-ab31a67f_0 is DEAD
2025-09-30T14:53:37.936117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0e98cd-bedcab3e-b2f871-ab31a67f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:37.936130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0e98cd-bedcab3e-b2f871-ab31a67f_0] Write session will restart in 0.006274s
2025-09-30T14:53:37.936154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0e98cd-bedcab3e-b2f871-ab31a67f_0] Write session: Do CDS request
2025-09-30T14:53:37.936163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0e98cd-bedcab3e-b2f871-ab31a67f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:37.942761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:37.943161Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:37.943178Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:37.943193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:37.943294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:37.943348Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895520625936636:7871]
2025-09-30T14:53:37.944007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:37.944420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:37.944495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:37.944859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:37.944945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:37.944953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:37.944954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:37.944956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:37.944957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:37.944958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:37.944959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:37.944961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:37.944962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:37.944963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:37.944965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.944965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.944967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.944968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:37.944969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:37.944976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:37.944987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:37.944992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:37.944996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:37.945001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:37.945005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:37.945010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:37.945014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:37.945018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:37.945023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:37.945027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.945031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.945035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.945040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:37.945044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:37.945054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:37.945064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:37.945071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:37.945077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:37.945081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:37.945087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:37.945091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:37.945096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:37.945101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:37.945107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:37.945111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:37.945117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:37.945129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:37.945136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:37.945147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:37.945152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:37.945162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:37.945167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:37.945174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:37.945179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:37.945186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.945191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.945200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.945205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.945210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.945215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.945219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:37.945224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:37.945229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:37.945239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:37.945288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:37.947522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0e98cd-bedcab3e-b2f871-ab31a67f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:37.947916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:37.947938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1268
2025-09-30T14:53:37.948046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1268 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:37.948083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1268 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:37.948088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1268 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:37.948093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:37.949064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1268 sessionId:  describe result for acl check
2025-09-30T14:53:37.949101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:37.949107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:37.949110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:37.949116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895520715686344:2924] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:37.949658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895520715686344:2924] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:37.952311Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1267
2025-09-30T14:53:37.950900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:37.951834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:37.951842Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:37.951849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:37.951853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:37.951860Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1267 [2:7555895520625936636:7871]
2025-09-30T14:53:37.951874Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:37.951888Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:37.951891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:37.951894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:37.951896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:37.951910Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:37.951917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:37.951924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:37.951983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.951985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.951988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.951991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:37.951993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:37.952062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:37.952064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.952078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:37.952092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:37.952110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:37.952128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895520715686276:2454], now have 1 active actors on pipe
2025-09-30T14:53:37.952135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895520625936630:7871]
2025-09-30T14:53:37.952137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895520625936630:7871]
2025-09-30T14:53:37.952139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895520625936630:7871]
2025-09-30T14:53:37.952159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:37.952174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:37.952178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:37.952182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:37.952184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:37.952190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:37.952192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:37.952225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895520625936630:7871]
2025-09-30T14:53:37.952233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:37.952239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:37.952988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895520715686344:2924] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:37.960354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895520715686344:2924] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:37.960373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895520715686344:2924] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:37.960377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895520715686344:2924] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:37.960386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1268 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:37.960668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1267
2025-09-30T14:53:37.960699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895520715686379:2924], now have 1 active actors on pipe
2025-09-30T14:53:37.960738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:37.960745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:37.960773Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|810ade06-5ba4d82f-650bc64a-adfa8783_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:37.960790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:37.960798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:37.960801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:37.960814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:37.960831Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:37.960849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:37.961203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:37.961216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:37.961235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:37.961344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1268 partition: 0 MaxSeqNo: 42 sessionId: src_id|810ade06-5ba4d82f-650bc64a-adfa8783_0
2025-09-30T14:53:37.961761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0e98cd-bedcab3e-b2f871-ab31a67f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|810ade06-5ba4d82f-650bc64a-adfa8783_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:37.964541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|810ade06-5ba4d82f-650bc64a-adfa8783_0] Write session: try to update token
2025-09-30T14:53:37.964560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|810ade06-5ba4d82f-650bc64a-adfa8783_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:37.964800Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:37.964822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:37.964831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895520625936630:7871]
2025-09-30T14:53:37.964871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:37.964884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:37.965057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:37.965229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:37.965386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:37.965533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:37.965742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:37.965789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:37.976572Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:37.976592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:37.976595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:37.976597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:37.976608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895520625936630:7871]
2025-09-30T14:53:37.976613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895520625936630:7871]
2025-09-30T14:53:37.976621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895520625936630:7871]
2025-09-30T14:53:37.976659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:37.976667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:37.976670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:37.976674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:37.976681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:37.976686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:37.976810Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:37.980483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1268 sessionId: src_id|810ade06-5ba4d82f-650bc64a-adfa8783_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:37.983089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:38.023847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895525010653679:3461]
2025-09-30T14:53:38.024212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1267, pipe: [1:7555895525010653679:3461]
2025-09-30T14:53:38.090333Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:38.090687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:38.090704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:38.090724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895525010653679:3461], now have 1 active actors on pipe
2025-09-30T14:53:38.090959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:38.090969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895525010653679:3461]
2025-09-30T14:53:38.090999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:38.091002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:38.091072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1268 reason: error at write: Disconnected sessionId: src_id|810ade06-5ba4d82f-650bc64a-adfa8783_0
2025-09-30T14:53:38.091295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1268 sessionId: src_id|810ade06-5ba4d82f-650bc64a-adfa8783_0 is DEAD
2025-09-30T14:53:38.091479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|810ade06-5ba4d82f-650bc64a-adfa8783_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:38.091111Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:38.091489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|810ade06-5ba4d82f-650bc64a-adfa8783_0] Write session will restart in 0.008755s
2025-09-30T14:53:38.091518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|810ade06-5ba4d82f-650bc64a-adfa8783_0] Write session: Do CDS request
2025-09-30T14:53:38.091526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|810ade06-5ba4d82f-650bc64a-adfa8783_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:38.101796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|810ade06-5ba4d82f-650bc64a-adfa8783_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:38.101842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:38.101870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1269
2025-09-30T14:53:38.102049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1269 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:38.102089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1269 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:38.102094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1269 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:38.102099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:38.102479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:38.102545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1269 sessionId:  describe result for acl check
2025-09-30T14:53:38.102584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:38.102590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:38.102591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:38.102597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895525010653756:2914] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:38.103158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895525010653756:2914] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:38.104380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:38.104639Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:38.104650Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:38.104662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:38.104723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:38.104766Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895524920904034:7873]
2025-09-30T14:53:38.105457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:38.105468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895525010653756:2914] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:38.105774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:38.105820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:38.106152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:38.106228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:38.106235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:38.106236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:38.106237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:38.106239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:38.106240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:38.106241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:38.106242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:38.106244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:38.106245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:38.106246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.106247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.106248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.106249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:38.106250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:38.106255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:38.106266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:38.106270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:38.106274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:38.106278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:38.106282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:38.106286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:38.106292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:38.106295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:38.106300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:38.106303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.106307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.106311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.106315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:38.106319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:38.106327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:38.106335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:38.106342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:38.106347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:38.106352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:38.106358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:38.106369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:38.106374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:38.106383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:38.106389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:38.106393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:38.106399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:38.106404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:38.106409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:38.106414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:38.106419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:38.106432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:38.106438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:38.106448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:38.106453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:38.106463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.106468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.106473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.106479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.106484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.106489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.106494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:38.106499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:38.106505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:38.106511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:38.106559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:38.112089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895525010653756:2914] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:38.112109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895525010653756:2914] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:38.112113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895525010653756:2914] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:38.112122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1269 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:38.112222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:38.113188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:38.113206Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:38.113209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:38.113213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:38.113220Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1268 [2:7555895524920904034:7873]
2025-09-30T14:53:38.113235Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:38.113250Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:38.113253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:38.113256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:38.113259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:38.113274Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:38.113281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:38.113287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:38.113340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.113347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.113349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.113351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:38.113353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:38.113404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:38.113411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.113427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.113446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.113456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:38.113471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895525010653689:2454], now have 1 active actors on pipe
2025-09-30T14:53:38.113477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895525010653795:2914], now have 1 active actors on pipe
2025-09-30T14:53:38.113483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895524920904028:7873]
2025-09-30T14:53:38.113485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895524920904028:7873]
2025-09-30T14:53:38.113487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895524920904028:7873]
2025-09-30T14:53:38.113498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:38.113513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:38.113521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:38.113523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:38.113526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:38.113541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:38.113544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:38.113574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895524920904028:7873]
2025-09-30T14:53:38.113581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:38.113583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:38.113551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1268
2025-09-30T14:53:38.113579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1268
2025-09-30T14:53:38.113615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:38.113621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:38.113642Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d25533f-772a8bdd-855d3240-ca26dfa5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:38.113653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:38.113655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:38.113657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:38.113663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:38.113672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:38.113686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:38.113808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:38.113816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:38.113829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:38.113906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1269 partition: 0 MaxSeqNo: 42 sessionId: src_id|6d25533f-772a8bdd-855d3240-ca26dfa5_0
2025-09-30T14:53:38.114280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|810ade06-5ba4d82f-650bc64a-adfa8783_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6d25533f-772a8bdd-855d3240-ca26dfa5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:38.117024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d25533f-772a8bdd-855d3240-ca26dfa5_0] Write session: try to update token
2025-09-30T14:53:38.117043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d25533f-772a8bdd-855d3240-ca26dfa5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:38.126267Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:38.126289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:38.126292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:38.126294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:38.126304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895524920904028:7873]
2025-09-30T14:53:38.126310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895524920904028:7873]
2025-09-30T14:53:38.126316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895524920904028:7873]
2025-09-30T14:53:38.126363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:38.126365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:38.126369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:38.126374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:38.126376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.126379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:38.126534Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:38.131561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1269 sessionId: src_id|6d25533f-772a8bdd-855d3240-ca26dfa5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:38.134459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:38.191058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895525010653803:3461]
2025-09-30T14:53:38.191750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1268, pipe: [1:7555895525010653803:3461]
2025-09-30T14:53:38.241687Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:38.242059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:38.242074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:38.242116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895525010653803:3461], now have 1 active actors on pipe
2025-09-30T14:53:38.242402Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:38.242438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895525010653803:3461]
2025-09-30T14:53:38.242469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:38.242501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:38.242594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1269 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6d25533f-772a8bdd-855d3240-ca26dfa5_0
2025-09-30T14:53:38.242820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1269 sessionId: src_id|6d25533f-772a8bdd-855d3240-ca26dfa5_0 is DEAD
2025-09-30T14:53:38.242983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d25533f-772a8bdd-855d3240-ca26dfa5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:38.242994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d25533f-772a8bdd-855d3240-ca26dfa5_0] Write session will restart in 0.007687s
2025-09-30T14:53:38.243018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d25533f-772a8bdd-855d3240-ca26dfa5_0] Write session: Do CDS request
2025-09-30T14:53:38.243024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d25533f-772a8bdd-855d3240-ca26dfa5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:38.252069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d25533f-772a8bdd-855d3240-ca26dfa5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:38.252207Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:38.252236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1270
2025-09-30T14:53:38.252389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1270 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:38.252436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1270 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:38.252442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1270 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:38.252447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:38.253050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1270 sessionId:  describe result for acl check
2025-09-30T14:53:38.253085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:38.253091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:38.253092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:38.253098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895525010653866:2908] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:38.253662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895525010653866:2908] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:38.255086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:38.257057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:38.257262Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:38.257272Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:38.257283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:38.257332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:38.257374Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895524920904151:7877]
2025-09-30T14:53:38.258094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:38.258315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895525010653866:2908] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:38.258811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:38.258857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:38.259204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:38.259286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:38.259295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:38.259296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:38.259297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:38.259299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:38.259300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:38.259302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:38.259303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:38.259305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:38.259306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:38.259307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.259309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.259310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.259311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:38.259312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:38.259318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:38.259341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:38.259346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:38.259351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:38.259356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:38.259361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:38.259365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:38.259370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:38.259375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:38.259380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:38.259384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.259389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.259394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.259398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:38.259403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:38.259411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:38.259420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:38.259426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:38.259433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:38.259439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:38.259445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:38.259462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:38.259466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:38.259472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:38.259478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:38.259483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:38.259488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:38.259494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:38.259509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:38.259513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:38.259519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:38.259525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:38.259531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:38.259536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:38.259542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:38.259546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.259553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.259558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.259563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.259568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.259574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.259579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:38.259585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:38.259590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:38.259595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:38.259653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:38.265292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895525010653866:2908] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:38.265314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895525010653866:2908] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:38.265318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895525010653866:2908] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:38.265328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1270 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:38.265474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:38.266573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:38.266591Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:38.266594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:38.266600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:38.266606Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1269 [2:7555895524920904151:7877]
2025-09-30T14:53:38.266624Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:38.266641Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:38.266645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:38.266647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:38.266650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:38.266665Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:38.266679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:38.266686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:38.266748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.266756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.266758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.266761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:38.266764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:38.266829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:38.266853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.266868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.266882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.266901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:38.266920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895525010653920:2908], now have 1 active actors on pipe
2025-09-30T14:53:38.266929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895525010653816:2454], now have 1 active actors on pipe
2025-09-30T14:53:38.266935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895524920904145:7877]
2025-09-30T14:53:38.266937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895524920904145:7877]
2025-09-30T14:53:38.266939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895524920904145:7877]
2025-09-30T14:53:38.266954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:38.266966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:38.266951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1269
2025-09-30T14:53:38.266981Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1269
2025-09-30T14:53:38.266978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:38.266982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:38.266985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:38.266990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:38.266993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:38.267019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895524920904145:7877]
2025-09-30T14:53:38.267027Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:38.267038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:38.267043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:38.267048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:38.267104Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91d2c7ae-76ccdf0d-fc6003b2-1d12e51_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:38.267116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:38.267121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:38.267124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:38.267133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:38.267143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:38.267164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:38.267365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:38.267375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:38.267390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:38.267459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1270 partition: 0 MaxSeqNo: 42 sessionId: src_id|91d2c7ae-76ccdf0d-fc6003b2-1d12e51_0
2025-09-30T14:53:38.267868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d25533f-772a8bdd-855d3240-ca26dfa5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|91d2c7ae-76ccdf0d-fc6003b2-1d12e51_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:38.270524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91d2c7ae-76ccdf0d-fc6003b2-1d12e51_0] Write session: try to update token
2025-09-30T14:53:38.270542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91d2c7ae-76ccdf0d-fc6003b2-1d12e51_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:38.279930Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:38.279949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:38.279952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:38.279954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:38.279964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895524920904145:7877]
2025-09-30T14:53:38.279968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895524920904145:7877]
2025-09-30T14:53:38.279973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895524920904145:7877]
2025-09-30T14:53:38.280019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:38.280025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:38.280026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.280029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:38.280031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:38.280035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:38.280166Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:38.285980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1270 sessionId: src_id|91d2c7ae-76ccdf0d-fc6003b2-1d12e51_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:38.288880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:38.342609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895525010653928:3461]
2025-09-30T14:53:38.342914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1269, pipe: [1:7555895525010653928:3461]
2025-09-30T14:53:38.399694Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:38.400004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:38.400021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:38.400062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895525010653928:3461], now have 1 active actors on pipe
2025-09-30T14:53:38.400298Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:38.400300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:38.400328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895525010653928:3461]
2025-09-30T14:53:38.400353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:38.400423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1270 reason: status is not ok: tablet will be restarted right now sessionId: src_id|91d2c7ae-76ccdf0d-fc6003b2-1d12e51_0
2025-09-30T14:53:38.400638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1270 sessionId: src_id|91d2c7ae-76ccdf0d-fc6003b2-1d12e51_0 is DEAD
2025-09-30T14:53:38.400775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91d2c7ae-76ccdf0d-fc6003b2-1d12e51_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:38.400782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91d2c7ae-76ccdf0d-fc6003b2-1d12e51_0] Write session will restart in 0.008038s
2025-09-30T14:53:38.400806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91d2c7ae-76ccdf0d-fc6003b2-1d12e51_0] Write session: Do CDS request
2025-09-30T14:53:38.400812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91d2c7ae-76ccdf0d-fc6003b2-1d12e51_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:38.409802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91d2c7ae-76ccdf0d-fc6003b2-1d12e51_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:38.409902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:38.409918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1271
2025-09-30T14:53:38.410083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1271 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:38.410113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1271 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:38.410123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1271 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:38.410128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:38.410576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1271 sessionId:  describe result for acl check
2025-09-30T14:53:38.410613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:38.410621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:38.410624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:38.410629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895525010653993:2898] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:38.411182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895525010653993:2898] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:38.411429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:38.413091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895525010653993:2898] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:38.413227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:38.413401Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:38.413412Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:38.413421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:38.413472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:38.413506Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895524920904255:7879]
2025-09-30T14:53:38.414169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:38.414448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:38.414520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:38.414905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:38.414979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:38.414986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:38.414987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:38.414989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:38.414990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:38.414991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:38.414992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:38.414993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:38.414995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:38.414996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:38.414997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.414998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.415000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.415001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:38.415002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:38.415008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:38.415019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:38.415024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:38.415029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:38.415033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:38.415037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:38.415041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:38.415045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:38.415050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:38.415055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:38.415060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.415064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.415068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.415072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:38.415076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:38.415084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:38.415092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:38.415099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:38.415105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:38.415111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:38.415117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:38.415122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:38.415127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:38.415132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:38.415138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:38.415143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:38.415157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:38.415162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:38.415168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:38.415173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:38.415179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:38.415184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:38.415189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:38.415193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:38.415199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:38.415204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.415209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.415215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.415220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.415225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.415230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.415234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:38.415240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:38.415263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:38.415268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:38.415306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:38.415982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895525010653993:2898] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:38.415998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895525010653993:2898] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:38.416001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895525010653993:2898] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:38.416009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1271 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:38.420797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:38.421667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:38.421686Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:38.421689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:38.421693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:38.421701Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1270 [2:7555895524920904255:7879]
2025-09-30T14:53:38.421719Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:38.421735Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:38.421742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:38.421746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:38.421748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:38.421766Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:38.421773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:38.421780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:38.421845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.421851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.421854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.421857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:38.421860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:38.422034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:38.422044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.422058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.422071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.422089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:38.422112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895525010654034:2898], now have 1 active actors on pipe
2025-09-30T14:53:38.422120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895525010653929:2454], now have 1 active actors on pipe
2025-09-30T14:53:38.422127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895524920904249:7879]
2025-09-30T14:53:38.422108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1270
2025-09-30T14:53:38.422130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895524920904249:7879]
2025-09-30T14:53:38.422109Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1270
2025-09-30T14:53:38.422131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895524920904249:7879]
2025-09-30T14:53:38.422148Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:38.422165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:38.422169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:38.422171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:38.422176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:38.422191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:38.422194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:38.422246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:38.422256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:38.422268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895524920904249:7879]
2025-09-30T14:53:38.422276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:38.422286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:38.422308Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8be557-9ad40d47-56bae221-d5c96737_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:38.422319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:38.422323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:38.422325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:38.422336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:38.422350Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:38.422376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:38.422528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:38.422536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:38.422550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:38.422758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1271 partition: 0 MaxSeqNo: 42 sessionId: src_id|e8be557-9ad40d47-56bae221-d5c96737_0
2025-09-30T14:53:38.423188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91d2c7ae-76ccdf0d-fc6003b2-1d12e51_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e8be557-9ad40d47-56bae221-d5c96737_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:38.426073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8be557-9ad40d47-56bae221-d5c96737_0] Write session: try to update token
2025-09-30T14:53:38.426093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8be557-9ad40d47-56bae221-d5c96737_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:38.434618Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:38.434638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:38.434640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:38.434643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:38.434652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895524920904249:7879]
2025-09-30T14:53:38.434657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895524920904249:7879]
2025-09-30T14:53:38.434661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895524920904249:7879]
2025-09-30T14:53:38.434701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:38.434708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.434711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:38.434718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:38.434725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:38.434729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:38.434858Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:38.441135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1271 sessionId: src_id|e8be557-9ad40d47-56bae221-d5c96737_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:38.444017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:38.500291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895525010654042:3461]
2025-09-30T14:53:38.500567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1270, pipe: [1:7555895525010654042:3461]
2025-09-30T14:53:38.551376Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:38.551807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:38.551822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:38.551860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895525010654042:3461], now have 1 active actors on pipe
2025-09-30T14:53:38.552090Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:38.552146Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:38.552209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895525010654042:3461]
2025-09-30T14:53:38.552243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:38.552333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1271 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e8be557-9ad40d47-56bae221-d5c96737_0
2025-09-30T14:53:38.552542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1271 sessionId: src_id|e8be557-9ad40d47-56bae221-d5c96737_0 is DEAD
2025-09-30T14:53:38.553125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8be557-9ad40d47-56bae221-d5c96737_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:38.553136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8be557-9ad40d47-56bae221-d5c96737_0] Write session will restart in 0.005000s
2025-09-30T14:53:38.553159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8be557-9ad40d47-56bae221-d5c96737_0] Write session: Do CDS request
2025-09-30T14:53:38.553164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8be557-9ad40d47-56bae221-d5c96737_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:38.559756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8be557-9ad40d47-56bae221-d5c96737_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:38.559881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:38.559899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1272
2025-09-30T14:53:38.560024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1272 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:38.560054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1272 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:38.560064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1272 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:38.560068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:38.560526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1272 sessionId:  describe result for acl check
2025-09-30T14:53:38.560563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:38.560571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:38.560573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:38.560579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895525010654058:2896] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:38.561129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895525010654058:2896] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:38.563228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895525010654058:2896] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:38.565929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895525010654058:2896] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:38.565943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895525010654058:2896] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:38.565956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895525010654058:2896] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:38.565964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1272 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:38.566712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:38.568284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:38.568556Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:38.568566Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:38.568578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:38.568643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:38.568684Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895524920904361:7881]
2025-09-30T14:53:38.569327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:38.569619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:38.569661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:38.570005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:38.570078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:38.570085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:38.570087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:38.570088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:38.570089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:38.570090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:38.570092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:38.570093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:38.570094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:38.570095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:38.570096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.570097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.570098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.570099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:38.570100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:38.570105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:38.570114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:38.570118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:38.570121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:38.570125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:38.570130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:38.570134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:38.570137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:38.570141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:38.570145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:38.570149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.570153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.570157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.570161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:38.570165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:38.570172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:38.570181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:38.570187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:38.570193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:38.570197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:38.570203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:38.570207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:38.570212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:38.570217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:38.570222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:38.570226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:38.570231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:38.570237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:38.570243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:38.570247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:38.570252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:38.570257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:38.570262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:38.570266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:38.570274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:38.570279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.570284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.570288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.570293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.570299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.570304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.570309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:38.570314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:38.570326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:38.570331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:38.570374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:38.575927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:38.576836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:38.576850Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:38.576853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:38.576863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:38.576869Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1271 [2:7555895524920904361:7881]
2025-09-30T14:53:38.576886Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:38.576902Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:38.576905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:38.576907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:38.576910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:38.576927Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:38.576934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:38.576949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:38.577006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.577013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.577016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.577020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:38.577022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:38.577079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:38.577085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.577098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.577114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.577134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:38.577157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895525010654149:2896], now have 1 active actors on pipe
2025-09-30T14:53:38.577160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895525010654045:2454], now have 1 active actors on pipe
2025-09-30T14:53:38.577166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895524920904356:7881]
2025-09-30T14:53:38.577173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895524920904356:7881]
2025-09-30T14:53:38.577175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895524920904356:7881]
2025-09-30T14:53:38.577187Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:38.577199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:38.577202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:38.577204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:38.577210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:38.577223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:38.577226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:38.577256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895524920904356:7881]
2025-09-30T14:53:38.577263Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:38.577268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:38.577261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1271
2025-09-30T14:53:38.577325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1271
2025-09-30T14:53:38.577416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:38.577426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:38.577447Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96f14c71-9f37930d-cbc9eb75-9c741598_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:38.577454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:38.577460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:38.577467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:38.577478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:38.577491Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:38.577509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:38.577703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:38.577716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:38.577736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:38.577842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1272 partition: 0 MaxSeqNo: 42 sessionId: src_id|96f14c71-9f37930d-cbc9eb75-9c741598_0
2025-09-30T14:53:38.578218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8be557-9ad40d47-56bae221-d5c96737_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|96f14c71-9f37930d-cbc9eb75-9c741598_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:38.581056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96f14c71-9f37930d-cbc9eb75-9c741598_0] Write session: try to update token
2025-09-30T14:53:38.581075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96f14c71-9f37930d-cbc9eb75-9c741598_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:38.590151Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:38.590167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:38.590170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:38.590172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:38.590182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895524920904356:7881]
2025-09-30T14:53:38.590188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895524920904356:7881]
2025-09-30T14:53:38.590195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895524920904356:7881]
2025-09-30T14:53:38.590240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:38.590247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.590249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:38.590258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:38.590271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:38.590275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:38.590388Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:38.597810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1272 sessionId: src_id|96f14c71-9f37930d-cbc9eb75-9c741598_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:38.600537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:38.651329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895525010654163:3461]
2025-09-30T14:53:38.651599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1271, pipe: [1:7555895525010654163:3461]
2025-09-30T14:53:38.705554Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:38.705903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:38.705916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:38.705935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895525010654163:3461], now have 1 active actors on pipe
2025-09-30T14:53:38.706158Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:38.706224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:38.706278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895525010654163:3461]
2025-09-30T14:53:38.706296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:38.706369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1272 reason: status is not ok: tablet will be restarted right now sessionId: src_id|96f14c71-9f37930d-cbc9eb75-9c741598_0
2025-09-30T14:53:38.706671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96f14c71-9f37930d-cbc9eb75-9c741598_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:38.706684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96f14c71-9f37930d-cbc9eb75-9c741598_0] Write session will restart in 0.005015s
2025-09-30T14:53:38.706718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96f14c71-9f37930d-cbc9eb75-9c741598_0] Write session: Do CDS request
2025-09-30T14:53:38.706724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96f14c71-9f37930d-cbc9eb75-9c741598_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:38.706544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1272 sessionId: src_id|96f14c71-9f37930d-cbc9eb75-9c741598_0 is DEAD
2025-09-30T14:53:38.712782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96f14c71-9f37930d-cbc9eb75-9c741598_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:38.712873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:38.712891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1273
2025-09-30T14:53:38.713041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1273 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:38.713077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1273 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:38.713088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1273 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:38.713092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:38.713545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1273 sessionId:  describe result for acl check
2025-09-30T14:53:38.713585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:38.713592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:38.713594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:38.713600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895525010654179:2889] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:38.714142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895525010654179:2889] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:38.716164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895525010654179:2889] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:38.717330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:38.719003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:38.719181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895525010654179:2889] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:38.719194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895525010654179:2889] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:38.719197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895525010654179:2889] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:38.719205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1273 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:38.719191Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:38.719201Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:38.719211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:38.719276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:38.719323Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895524920904468:7884]
2025-09-30T14:53:38.719977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:38.720292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:38.720336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:38.720653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:38.720807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:38.720813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:38.720815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:38.720816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:38.720817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:38.720818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:38.720819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:38.720821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:38.720822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:38.720823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:38.720824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.720826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.720827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.720828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:38.720829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:38.720834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:38.720844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:38.720848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:38.720852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:38.720856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:38.720860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:38.720864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:38.720868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:38.720871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:38.720875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:38.720879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.720884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.720887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.720891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:38.720894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:38.720902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:38.720909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:38.720915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:38.720921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:38.720925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:38.720930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:38.720934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:38.720938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:38.720942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:38.720947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:38.720951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:38.720956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:38.720960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:38.720965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:38.720969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:38.720974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:38.720978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:38.720982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:38.720986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:38.720991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:38.720996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.721000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.721004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.721009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.721014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.721023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.721027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:38.721037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:38.721041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:38.721045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:38.721083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:38.726513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:38.727481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:38.727498Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:38.727500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:38.727504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:38.727511Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1272 [2:7555895524920904468:7884]
2025-09-30T14:53:38.727529Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:38.727544Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:38.727547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:38.727550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:38.727553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:38.727570Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:38.727576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:38.727588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:38.727643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.727651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.727653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.727657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:38.727659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:38.727725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:38.727732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.727744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.727756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.727773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:38.727794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895525010654164:2454], now have 1 active actors on pipe
2025-09-30T14:53:38.727804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895524920904462:7884]
2025-09-30T14:53:38.727809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895524920904462:7884]
2025-09-30T14:53:38.727811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895524920904462:7884]
2025-09-30T14:53:38.727823Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:38.727835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895525010654268:2889], now have 1 active actors on pipe
2025-09-30T14:53:38.727846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:38.727847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:38.727850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:38.727852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:38.727864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:38.727868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:38.727902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895524920904462:7884]
2025-09-30T14:53:38.727909Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:38.727912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:38.727878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1272
2025-09-30T14:53:38.727881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1272
2025-09-30T14:53:38.727980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:38.727989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:38.728016Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64f5c763-5304cf7f-8c69c3da-5d42f72d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:38.728027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:38.728030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:38.728032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:38.728042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:38.728051Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:38.728063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:38.728279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:38.728287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:38.728301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:38.728407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1273 partition: 0 MaxSeqNo: 42 sessionId: src_id|64f5c763-5304cf7f-8c69c3da-5d42f72d_0
2025-09-30T14:53:38.728789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96f14c71-9f37930d-cbc9eb75-9c741598_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|64f5c763-5304cf7f-8c69c3da-5d42f72d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:38.731564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64f5c763-5304cf7f-8c69c3da-5d42f72d_0] Write session: try to update token
2025-09-30T14:53:38.731583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64f5c763-5304cf7f-8c69c3da-5d42f72d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:38.739933Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:38.739955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:38.739958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:38.739964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:38.739976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895524920904462:7884]
2025-09-30T14:53:38.739981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895524920904462:7884]
2025-09-30T14:53:38.739985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895524920904462:7884]
2025-09-30T14:53:38.740026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:38.740030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:38.740033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.740036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:38.740037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:38.740041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:38.740191Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:38.745745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1273 sessionId: src_id|64f5c763-5304cf7f-8c69c3da-5d42f72d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:38.748544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:38.806490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895525010654279:3461]
2025-09-30T14:53:38.806773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1272, pipe: [1:7555895525010654279:3461]
2025-09-30T14:53:38.851292Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:38.851606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:38.851622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:38.851660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895525010654279:3461], now have 1 active actors on pipe
2025-09-30T14:53:38.851899Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:38.851956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:38.851981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:38.852048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1273 reason: error at write: Disconnected sessionId: src_id|64f5c763-5304cf7f-8c69c3da-5d42f72d_0
2025-09-30T14:53:38.852089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:38.852143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895525010654279:3461]
2025-09-30T14:53:38.852263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1273 sessionId: src_id|64f5c763-5304cf7f-8c69c3da-5d42f72d_0 is DEAD
2025-09-30T14:53:38.852458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64f5c763-5304cf7f-8c69c3da-5d42f72d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:38.852482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64f5c763-5304cf7f-8c69c3da-5d42f72d_0] Write session will restart in 0.007351s
2025-09-30T14:53:38.852506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64f5c763-5304cf7f-8c69c3da-5d42f72d_0] Write session: Do CDS request
2025-09-30T14:53:38.852513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64f5c763-5304cf7f-8c69c3da-5d42f72d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:38.860794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64f5c763-5304cf7f-8c69c3da-5d42f72d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:38.860893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:38.860909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1274
2025-09-30T14:53:38.861044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1274 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:38.861076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1274 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:38.861086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1274 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:38.861090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:38.861523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1274 sessionId:  describe result for acl check
2025-09-30T14:53:38.861569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:38.861571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:38.861573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:38.861578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895525010654349:2885] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:38.861722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:38.862154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895525010654349:2885] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:38.863540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:38.863720Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:38.863730Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:38.863740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:38.863785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:38.863837Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895524920904574:7886]
2025-09-30T14:53:38.864098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895525010654349:2885] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:38.864471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:38.864769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:38.864810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:38.865122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:38.865178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:38.865183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:38.865184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:38.865185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:38.865186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:38.865188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:38.865189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:38.865190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:38.865191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:38.865192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:38.865193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.865194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.865195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.865196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:38.865197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:38.865202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:38.865211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:38.865215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:38.865219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:38.865222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:38.865226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:38.865230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:38.865234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:38.865238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:38.865242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:38.865246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.865249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.865253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.865256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:38.865259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:38.865266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:38.865273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:38.865278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:38.865282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:38.865287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:38.865292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:38.865295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:38.865300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:38.865305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:38.865309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:38.865313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:38.865318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:38.865322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:38.865327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:38.865331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:38.865336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:38.865345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:38.865351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:38.865354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:38.865359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:38.865367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.865372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.865377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.865383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.865389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.865394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.865398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:38.865404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:38.865409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:38.865413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:38.865462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:38.870566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895525010654349:2885] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:38.870587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895525010654349:2885] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:38.870590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895525010654349:2885] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:38.870598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1274 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:38.870858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:38.871738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:38.871754Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:38.871757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:38.871760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:38.871767Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1273 [2:7555895524920904574:7886]
2025-09-30T14:53:38.871782Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:38.871799Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:38.871802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:38.871805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:38.871808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:38.871822Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:38.871829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:38.871839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:38.871894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.871900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.871902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.871905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:38.871908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:38.871968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:38.871976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.871988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:38.872000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:38.872017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:38.872033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895525010654281:2454], now have 1 active actors on pipe
2025-09-30T14:53:38.872041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895525010654389:2885], now have 1 active actors on pipe
2025-09-30T14:53:38.872047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895524920904569:7886]
2025-09-30T14:53:38.872049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895524920904569:7886]
2025-09-30T14:53:38.872051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895524920904569:7886]
2025-09-30T14:53:38.872063Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:38.872076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:38.872081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:38.872084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:38.872086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:38.872092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:38.872095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:38.872099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1273
2025-09-30T14:53:38.872123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895524920904569:7886]
2025-09-30T14:53:38.872121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1273
2025-09-30T14:53:38.872130Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:38.872132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:38.872157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:38.872163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:38.872192Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a45c750f-3dd2bf4e-70129209-5f33cb4f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:38.872203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:38.872205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:38.872207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:38.872215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:38.872225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:38.872240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:38.872382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:38.872389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:38.872400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:38.872516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1274 partition: 0 MaxSeqNo: 42 sessionId: src_id|a45c750f-3dd2bf4e-70129209-5f33cb4f_0
2025-09-30T14:53:38.872873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64f5c763-5304cf7f-8c69c3da-5d42f72d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a45c750f-3dd2bf4e-70129209-5f33cb4f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:38.875601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a45c750f-3dd2bf4e-70129209-5f33cb4f_0] Write session: try to update token
2025-09-30T14:53:38.875622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a45c750f-3dd2bf4e-70129209-5f33cb4f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:38.890187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1274 sessionId: src_id|a45c750f-3dd2bf4e-70129209-5f33cb4f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:38.892834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:38.889467Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:38.889487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:38.889490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:38.889492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:38.889502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895524920904569:7886]
2025-09-30T14:53:38.889510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895524920904569:7886]
2025-09-30T14:53:38.889515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895524920904569:7886]
2025-09-30T14:53:38.889559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:38.889564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:38.889568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:38.889571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:38.889571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:38.889576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:38.889719Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:38.952368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895525010654409:3461]
2025-09-30T14:53:38.952664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1273, pipe: [1:7555895525010654409:3461]
2025-09-30T14:53:39.007760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:39.007767Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:39.007776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:39.007813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895525010654409:3461]
2025-09-30T14:53:39.007837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1274 reason: error at write: Disconnected sessionId: src_id|a45c750f-3dd2bf4e-70129209-5f33cb4f_0
2025-09-30T14:53:39.008025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1274 sessionId: src_id|a45c750f-3dd2bf4e-70129209-5f33cb4f_0 is DEAD
2025-09-30T14:53:39.008137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a45c750f-3dd2bf4e-70129209-5f33cb4f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:39.008162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a45c750f-3dd2bf4e-70129209-5f33cb4f_0] Write session will restart in 0.009647s
2025-09-30T14:53:39.008185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a45c750f-3dd2bf4e-70129209-5f33cb4f_0] Write session: Do CDS request
2025-09-30T14:53:39.008191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a45c750f-3dd2bf4e-70129209-5f33cb4f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:39.007103Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:39.007443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:39.007453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:39.007492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895525010654409:3461], now have 1 active actors on pipe
2025-09-30T14:53:39.007709Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:39.018623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:39.019694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a45c750f-3dd2bf4e-70129209-5f33cb4f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:39.019763Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:39.019781Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1275
2025-09-30T14:53:39.019913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1275 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:39.019940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1275 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:39.019945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1275 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:39.019950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:39.020369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1275 sessionId:  describe result for acl check
2025-09-30T14:53:39.020399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:39.020401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:39.020403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:39.020408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895529305621787:2870] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:39.020539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:39.020708Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:39.020719Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:39.020729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:39.020789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:39.020824Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895529215872015:7900]
2025-09-30T14:53:39.020930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895529305621787:2870] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:39.021497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:39.021913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:39.021970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:39.022318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:39.022378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:39.022384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:39.022385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:39.022386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:39.022387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:39.022388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:39.022389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:39.022390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:39.022392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:39.022393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:39.022394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.022395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.022396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.022397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:39.022398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:39.022403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:39.022412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:39.022416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:39.022420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:39.022423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:39.022427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:39.022430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:39.022434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:39.022437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:39.022441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:39.022445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.022448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.022452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.022455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:39.022459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:39.022465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:39.022472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:39.022478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:39.022483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:39.022487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:39.022491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:39.022496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:39.022500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:39.022505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:39.022510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:39.022514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:39.022519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:39.022524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:39.022529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:39.022532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:39.022537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:39.022541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:39.022546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:39.022551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:39.022556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:39.022560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.022564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.022568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.022572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.022576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.022581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.022585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:39.022589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:39.022593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:39.022599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:39.022638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:39.022804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895529305621787:2870] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:39.028037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895529305621787:2870] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:39.028052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895529305621787:2870] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:39.028056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895529305621787:2870] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:39.028063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1275 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:39.029426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1274
2025-09-30T14:53:39.029446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1274
2025-09-30T14:53:39.028021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:39.029073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:39.029079Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:39.029083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:39.029086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:39.029093Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1274 [2:7555895529215872015:7900]
2025-09-30T14:53:39.029111Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:39.029125Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:39.029128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:39.029131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:39.029133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:39.029149Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:39.029154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:39.029161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:39.029216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.029219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.029220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.029223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:39.029226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:39.029294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:39.029297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.029309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.029320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.029339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:39.029354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895529215872009:7900]
2025-09-30T14:53:39.029356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895529215872009:7900]
2025-09-30T14:53:39.029358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895529215872009:7900]
2025-09-30T14:53:39.029367Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:39.029376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:39.029380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:39.029382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:39.029385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895529305621716:2454], now have 1 active actors on pipe
2025-09-30T14:53:39.029391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:39.029404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:39.029407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:39.029412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895529305621825:2870], now have 1 active actors on pipe
2025-09-30T14:53:39.029439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895529215872009:7900]
2025-09-30T14:53:39.029442Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:39.029453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:39.029484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:39.029489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:39.029512Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b478531a-e661b99c-5a4a2160-f0aa459d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:39.029520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:39.029523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:39.029525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:39.029534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:39.029544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:39.029557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:39.029777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:39.029784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:39.029807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:39.029875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1275 partition: 0 MaxSeqNo: 42 sessionId: src_id|b478531a-e661b99c-5a4a2160-f0aa459d_0
2025-09-30T14:53:39.030446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a45c750f-3dd2bf4e-70129209-5f33cb4f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b478531a-e661b99c-5a4a2160-f0aa459d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:39.033194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b478531a-e661b99c-5a4a2160-f0aa459d_0] Write session: try to update token
2025-09-30T14:53:39.033212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b478531a-e661b99c-5a4a2160-f0aa459d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:39.041660Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:39.041683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:39.041687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:39.041690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:39.041702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895529215872009:7900]
2025-09-30T14:53:39.041706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895529215872009:7900]
2025-09-30T14:53:39.041710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895529215872009:7900]
2025-09-30T14:53:39.041760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:39.041765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:39.041772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:39.041772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.041776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:39.041776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:39.042005Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:39.047571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1275 sessionId: src_id|b478531a-e661b99c-5a4a2160-f0aa459d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:39.050328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:39.108043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895529305621842:3461]
2025-09-30T14:53:39.108370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1274, pipe: [1:7555895529305621842:3461]
2025-09-30T14:53:39.153736Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:39.154095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:39.154112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:39.154163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895529305621842:3461], now have 1 active actors on pipe
2025-09-30T14:53:39.154356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:39.154406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895529305621842:3461]
2025-09-30T14:53:39.154418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:39.154421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:39.154461Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:39.154842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b478531a-e661b99c-5a4a2160-f0aa459d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:39.154854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b478531a-e661b99c-5a4a2160-f0aa459d_0] Write session will restart in 0.008410s
2025-09-30T14:53:39.154877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b478531a-e661b99c-5a4a2160-f0aa459d_0] Write session: Do CDS request
2025-09-30T14:53:39.154883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b478531a-e661b99c-5a4a2160-f0aa459d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:39.154495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1275 reason: error at write: Disconnected sessionId: src_id|b478531a-e661b99c-5a4a2160-f0aa459d_0
2025-09-30T14:53:39.154685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1275 sessionId: src_id|b478531a-e661b99c-5a4a2160-f0aa459d_0 is DEAD
2025-09-30T14:53:39.164533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:39.164790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b478531a-e661b99c-5a4a2160-f0aa459d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:39.164857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:39.164874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1276
2025-09-30T14:53:39.165037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1276 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:39.165073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1276 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:39.165083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1276 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:39.165088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:39.165544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1276 sessionId:  describe result for acl check
2025-09-30T14:53:39.165583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:39.165590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:39.165592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:39.165598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895529305621915:2863] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:39.166369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895529305621915:2863] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:39.166480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:39.166649Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:39.166658Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:39.166677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:39.166735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:39.166770Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895529215872126:7902]
2025-09-30T14:53:39.167339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:39.167711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:39.167769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:39.168126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:39.168156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895529305621915:2863] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:39.168187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:39.168191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:39.168192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:39.168193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:39.168194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:39.168196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:39.168197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:39.168198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:39.168200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:39.168201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:39.168202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.168203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.168204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.168205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:39.168207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:39.168212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:39.168222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:39.168226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:39.168230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:39.168234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:39.168238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:39.168242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:39.168246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:39.168249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:39.168254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:39.168258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.168261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.168265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.168269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:39.168273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:39.168280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:39.168290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:39.168296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:39.168301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:39.168306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:39.168312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:39.168316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:39.168321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:39.168326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:39.168331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:39.168336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:39.168341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:39.168346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:39.168352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:39.168356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:39.168362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:39.168367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:39.168372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:39.168377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:39.168382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:39.168386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.168391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.168400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.168406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.168411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.168418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.168422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:39.168440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:39.168446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:39.168451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:39.168495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:39.173569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895529305621915:2863] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:39.173584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895529305621915:2863] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:39.173587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895529305621915:2863] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:39.173594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1276 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:39.173963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:39.174845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:39.174858Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:39.174861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:39.174865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:39.174871Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1275 [2:7555895529215872126:7902]
2025-09-30T14:53:39.174888Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:39.174903Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:39.174908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:39.174913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:39.174916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:39.174930Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:39.174941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:39.174947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:39.175009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.175016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.175018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.175022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:39.175024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:39.175085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:39.175099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.175111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.175124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.175140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:39.175158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895529305621953:2863], now have 1 active actors on pipe
2025-09-30T14:53:39.175169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895529215872120:7902]
2025-09-30T14:53:39.175171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895529215872120:7902]
2025-09-30T14:53:39.175173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895529215872120:7902]
2025-09-30T14:53:39.175186Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:39.175195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895529305621844:2454], now have 1 active actors on pipe
2025-09-30T14:53:39.175200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:39.175203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:39.175206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:39.175207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:39.175224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:39.175226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:39.175273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895529215872120:7902]
2025-09-30T14:53:39.175287Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:39.175311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:39.175310Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1275
2025-09-30T14:53:39.175314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1275
2025-09-30T14:53:39.175393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:39.175402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:39.175424Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9673e59-9a4dd2a0-678c36d9-c5437ca6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:39.175436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:39.175439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:39.175441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:39.175451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:39.175460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:39.175473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:39.175671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:39.175679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:39.175691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:39.175755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1276 partition: 0 MaxSeqNo: 42 sessionId: src_id|9673e59-9a4dd2a0-678c36d9-c5437ca6_0
2025-09-30T14:53:39.176110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b478531a-e661b99c-5a4a2160-f0aa459d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9673e59-9a4dd2a0-678c36d9-c5437ca6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:39.178891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9673e59-9a4dd2a0-678c36d9-c5437ca6_0] Write session: try to update token
2025-09-30T14:53:39.178910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9673e59-9a4dd2a0-678c36d9-c5437ca6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:39.187560Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:39.187579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:39.187583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:39.187585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:39.187595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895529215872120:7902]
2025-09-30T14:53:39.187600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895529215872120:7902]
2025-09-30T14:53:39.187609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895529215872120:7902]
2025-09-30T14:53:39.187651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:39.187658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.187659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:39.187662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:39.187667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:39.187671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:39.187804Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:39.193794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1276 sessionId: src_id|9673e59-9a4dd2a0-678c36d9-c5437ca6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:39.196611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:39.254476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895529305621973:3461]
2025-09-30T14:53:39.254844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1275, pipe: [1:7555895529305621973:3461]
2025-09-30T14:53:39.298940Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:39.299324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:39.299339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:39.299373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895529305621973:3461], now have 1 active actors on pipe
2025-09-30T14:53:39.299627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:39.299675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895529305621973:3461]
2025-09-30T14:53:39.299684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:39.299777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1276 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9673e59-9a4dd2a0-678c36d9-c5437ca6_0
2025-09-30T14:53:39.299587Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:39.299947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1276 sessionId: src_id|9673e59-9a4dd2a0-678c36d9-c5437ca6_0 is DEAD
2025-09-30T14:53:39.300079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9673e59-9a4dd2a0-678c36d9-c5437ca6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:39.300090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9673e59-9a4dd2a0-678c36d9-c5437ca6_0] Write session will restart in 0.008875s
2025-09-30T14:53:39.300114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9673e59-9a4dd2a0-678c36d9-c5437ca6_0] Write session: Do CDS request
2025-09-30T14:53:39.300119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9673e59-9a4dd2a0-678c36d9-c5437ca6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:39.309722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:39.309817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9673e59-9a4dd2a0-678c36d9-c5437ca6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:39.309887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:39.309913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1277
2025-09-30T14:53:39.310050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1277 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:39.310081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1277 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:39.310091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1277 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:39.310095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:39.310482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1277 sessionId:  describe result for acl check
2025-09-30T14:53:39.310518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:39.310522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:39.310534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:39.310545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895529305622046:2852] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:39.311142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895529305622046:2852] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:39.311421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:39.311617Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:39.311629Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:39.311640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:39.311695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:39.311736Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895529215872246:7906]
2025-09-30T14:53:39.312452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:39.312736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:39.312799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:39.313123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:39.313187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:39.313194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:39.313195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:39.313177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895529305622046:2852] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:39.313197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:39.313198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:39.313199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:39.313200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:39.313202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:39.313203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:39.313204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:39.313206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.313207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.313208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.313210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:39.313211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:39.313218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:39.313228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:39.313233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:39.313237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:39.313241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:39.313246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:39.313250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:39.313255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:39.313259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:39.313264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:39.313269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.313273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.313277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.313282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:39.313286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:39.313294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:39.313302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:39.313308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:39.313314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:39.313325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:39.313332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:39.313341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:39.313347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:39.313355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:39.313360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:39.313367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:39.313373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:39.313379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:39.313390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:39.313396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:39.313402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:39.313411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:39.313417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:39.313422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:39.313429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:39.313439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.313444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.313453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.313459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.313464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.313474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.313481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:39.313491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:39.313497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:39.313507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:39.313554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:39.318652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895529305622046:2852] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:39.318666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895529305622046:2852] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:39.318669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895529305622046:2852] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:39.318676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1277 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:39.318967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:39.320075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:39.320089Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:39.320092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:39.320096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:39.320102Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1276 [2:7555895529215872246:7906]
2025-09-30T14:53:39.320119Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:39.320137Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:39.320146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:39.320149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:39.320151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:39.320169Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:39.320181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:39.320190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:39.320247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.320254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.320255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.320260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:39.320262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:39.320329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:39.320342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.320355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.320366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.320382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:39.320400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895529305621974:2454], now have 1 active actors on pipe
2025-09-30T14:53:39.320409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895529305622086:2852], now have 1 active actors on pipe
2025-09-30T14:53:39.320415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895529215872240:7906]
2025-09-30T14:53:39.320418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895529215872240:7906]
2025-09-30T14:53:39.320420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895529215872240:7906]
2025-09-30T14:53:39.320432Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:39.320446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:39.320449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:39.320454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:39.320456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:39.320464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:39.320466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:39.320470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1276
2025-09-30T14:53:39.320497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895529215872240:7906]
2025-09-30T14:53:39.320505Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:39.320508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:39.320510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1276
2025-09-30T14:53:39.320538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:39.320547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:39.320572Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d97cb83e-b0d43817-cdb5009e-d6d3065a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:39.320586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:39.320591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:39.320593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:39.320601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:39.320609Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:39.320620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:39.320799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:39.320806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:39.320821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:39.320905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1277 partition: 0 MaxSeqNo: 42 sessionId: src_id|d97cb83e-b0d43817-cdb5009e-d6d3065a_0
2025-09-30T14:53:39.321262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9673e59-9a4dd2a0-678c36d9-c5437ca6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d97cb83e-b0d43817-cdb5009e-d6d3065a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:39.323847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d97cb83e-b0d43817-cdb5009e-d6d3065a_0] Write session: try to update token
2025-09-30T14:53:39.323861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d97cb83e-b0d43817-cdb5009e-d6d3065a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:39.332625Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:39.332647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:39.332649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:39.332652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:39.332661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895529215872240:7906]
2025-09-30T14:53:39.332666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895529215872240:7906]
2025-09-30T14:53:39.332671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895529215872240:7906]
2025-09-30T14:53:39.332713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:39.332717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:39.332727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.332729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:39.332736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:39.332740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:39.332860Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:39.345384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1277 sessionId: src_id|d97cb83e-b0d43817-cdb5009e-d6d3065a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:39.348546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:39.399924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895529305622093:3461]
2025-09-30T14:53:39.400257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1276, pipe: [1:7555895529305622093:3461]
2025-09-30T14:53:39.452310Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:39.452670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:39.452684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:39.452703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895529305622093:3461], now have 1 active actors on pipe
2025-09-30T14:53:39.452927Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:39.452930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:39.452950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:39.452954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:39.452987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895529305622093:3461]
2025-09-30T14:53:39.453013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1277 reason: error at write: Disconnected sessionId: src_id|d97cb83e-b0d43817-cdb5009e-d6d3065a_0
2025-09-30T14:53:39.453221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1277 sessionId: src_id|d97cb83e-b0d43817-cdb5009e-d6d3065a_0 is DEAD
2025-09-30T14:53:39.453585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d97cb83e-b0d43817-cdb5009e-d6d3065a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:39.453596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d97cb83e-b0d43817-cdb5009e-d6d3065a_0] Write session will restart in 0.009106s
2025-09-30T14:53:39.453629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d97cb83e-b0d43817-cdb5009e-d6d3065a_0] Write session: Do CDS request
2025-09-30T14:53:39.453638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d97cb83e-b0d43817-cdb5009e-d6d3065a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:39.463973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d97cb83e-b0d43817-cdb5009e-d6d3065a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:39.464127Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:39.464162Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1278
2025-09-30T14:53:39.464365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1278 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:39.464425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1278 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:39.464457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1278 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:39.464464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:39.465047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1278 sessionId:  describe result for acl check
2025-09-30T14:53:39.465092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:39.465102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:39.465105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:39.465112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895529305622167:2844] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:39.465130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:39.465773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895529305622167:2844] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:39.467125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:39.467318Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:39.467330Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:39.467343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:39.467400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:39.467439Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895529215872357:7908]
2025-09-30T14:53:39.467897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895529305622167:2844] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:39.468050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:39.468360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:39.468419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:39.468800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:39.468869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:39.468875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:39.468876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:39.468878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:39.468879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:39.468880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:39.468881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:39.468882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:39.468884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:39.468885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:39.468887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.468888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.468889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.468890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:39.468891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:39.468898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:39.468908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:39.468912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:39.468916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:39.468921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:39.468926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:39.468930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:39.468942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:39.468946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:39.468950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:39.468955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.468959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.468963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.468967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:39.468972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:39.468979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:39.468987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:39.468994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:39.469000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:39.469005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:39.469010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:39.469015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:39.469020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:39.469026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:39.469031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:39.469036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:39.469041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:39.469046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:39.469052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:39.469057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:39.469062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:39.469067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:39.469072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:39.469078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:39.469083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:39.469089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.469099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.469104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.469111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.469121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.469126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.469136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:39.469141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:39.469151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:39.469156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:39.469205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:39.471457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895529305622167:2844] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:39.471474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895529305622167:2844] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:39.471477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895529305622167:2844] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:39.471489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1278 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:39.474757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:39.475682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:39.475697Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:39.475700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:39.475704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:39.475710Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1277 [2:7555895529215872357:7908]
2025-09-30T14:53:39.475728Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:39.475743Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:39.475746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:39.475750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:39.475752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:39.475767Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:39.475773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:39.475782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:39.475836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.475843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.475845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.475849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:39.475851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:39.476045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:39.476055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.476068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.476081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.476096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:39.476121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895529305622206:2844], now have 1 active actors on pipe
2025-09-30T14:53:39.476129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895529305622094:2454], now have 1 active actors on pipe
2025-09-30T14:53:39.476097Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1277
2025-09-30T14:53:39.476135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895529215872351:7908]
2025-09-30T14:53:39.476138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895529215872351:7908]
2025-09-30T14:53:39.476110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1277
2025-09-30T14:53:39.476140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895529215872351:7908]
2025-09-30T14:53:39.476148Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:39.476162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:39.476174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:39.476176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:39.476178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:39.476179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:39.476182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:39.476227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:39.476238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:39.476248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895529215872351:7908]
2025-09-30T14:53:39.476259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:39.476295Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b79f419b-2e2a59ad-1def5a0c-df26f9e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:39.476297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:39.476305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:39.476309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:39.476311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:39.476321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:39.476329Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:39.476353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:39.476520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:39.476528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:39.476541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:39.476631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1278 partition: 0 MaxSeqNo: 42 sessionId: src_id|b79f419b-2e2a59ad-1def5a0c-df26f9e5_0
2025-09-30T14:53:39.477037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d97cb83e-b0d43817-cdb5009e-d6d3065a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b79f419b-2e2a59ad-1def5a0c-df26f9e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:39.479843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b79f419b-2e2a59ad-1def5a0c-df26f9e5_0] Write session: try to update token
2025-09-30T14:53:39.479863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b79f419b-2e2a59ad-1def5a0c-df26f9e5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:39.488493Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:39.488512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:39.488514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:39.488516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:39.488526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895529215872351:7908]
2025-09-30T14:53:39.488531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895529215872351:7908]
2025-09-30T14:53:39.488535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895529215872351:7908]
2025-09-30T14:53:39.488576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:39.488585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.488587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:39.488592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:39.488600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:39.488604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:39.488726Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:39.495067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1278 sessionId: src_id|b79f419b-2e2a59ad-1def5a0c-df26f9e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:39.497882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:39.552947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895529305622216:3461]
2025-09-30T14:53:39.553228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1277, pipe: [1:7555895529305622216:3461]
2025-09-30T14:53:39.604212Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:39.604556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:39.604570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:39.604612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895529305622216:3461], now have 1 active actors on pipe
2025-09-30T14:53:39.604833Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:39.604876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:39.604893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:39.604966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1278 reason: error at write: Disconnected sessionId: src_id|b79f419b-2e2a59ad-1def5a0c-df26f9e5_0
2025-09-30T14:53:39.605316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b79f419b-2e2a59ad-1def5a0c-df26f9e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:39.605328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b79f419b-2e2a59ad-1def5a0c-df26f9e5_0] Write session will restart in 0.009754s
2025-09-30T14:53:39.605363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b79f419b-2e2a59ad-1def5a0c-df26f9e5_0] Write session: Do CDS request
2025-09-30T14:53:39.605369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b79f419b-2e2a59ad-1def5a0c-df26f9e5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:39.605188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1278 sessionId: src_id|b79f419b-2e2a59ad-1def5a0c-df26f9e5_0 is DEAD
2025-09-30T14:53:39.605366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:39.605395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895529305622216:3461]
2025-09-30T14:53:39.616808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b79f419b-2e2a59ad-1def5a0c-df26f9e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:39.616921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:39.616941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1279
2025-09-30T14:53:39.617111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1279 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:39.617144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1279 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:39.617149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1279 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:39.617154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:39.617606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1279 sessionId:  describe result for acl check
2025-09-30T14:53:39.617645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:39.617654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:39.617656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:39.617661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895529305622233:2837] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:39.618228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895529305622233:2837] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:39.620330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895529305622233:2837] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:39.623089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:39.623154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895529305622233:2837] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:39.623169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895529305622233:2837] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:39.623172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895529305622233:2837] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:39.623179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1279 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:39.624901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:39.625135Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:39.625147Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:39.625157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:39.625216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:39.625256Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895529215872470:7910]
2025-09-30T14:53:39.625879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:39.626206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:39.626253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:39.626595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:39.626669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:39.626675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:39.626677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:39.626678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:39.626679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:39.626680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:39.626681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:39.626682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:39.626684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:39.626685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:39.626686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.626687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.626689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.626690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:39.626691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:39.626697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:39.626708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:39.626712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:39.626717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:39.626721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:39.626725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:39.626729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:39.626733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:39.626737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:39.626742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:39.626746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.626750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.626753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.626757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:39.626762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:39.626771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:39.626777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:39.626783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:39.626788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:39.626792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:39.626797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:39.626801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:39.626806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:39.626810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:39.626815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:39.626819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:39.626825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:39.626830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:39.626841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:39.626845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:39.626849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:39.626854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:39.626860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:39.626864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:39.626874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:39.626881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.626887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.626895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.626900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.626904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.626909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.626916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:39.626921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:39.626926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:39.626932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:39.626972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:39.632581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:39.633574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:39.633587Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:39.633590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:39.633594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:39.633601Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1278 [2:7555895529215872470:7910]
2025-09-30T14:53:39.633615Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:39.633631Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:39.633635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:39.633638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:39.633641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:39.633657Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:39.633664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:39.633671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:39.633729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.633738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.633741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.633744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:39.633747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:39.633811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:39.633821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.633834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.633847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.633866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:39.633889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895529305622217:2454], now have 1 active actors on pipe
2025-09-30T14:53:39.633893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895529305622326:2837], now have 1 active actors on pipe
2025-09-30T14:53:39.633899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895529215872464:7910]
2025-09-30T14:53:39.633901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895529215872464:7910]
2025-09-30T14:53:39.633903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895529215872464:7910]
2025-09-30T14:53:39.633915Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:39.633929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:39.633936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:39.633939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:39.633941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:39.633946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:39.633950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:39.633983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895529215872464:7910]
2025-09-30T14:53:39.633996Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:39.634003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:39.633983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1278
2025-09-30T14:53:39.633978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1278
2025-09-30T14:53:39.634048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:39.634058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:39.634094Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|444def9-6ea5a890-516b886c-15ac9e69_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:39.634105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:39.634109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:39.634111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:39.634121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:39.634134Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:39.634154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:39.634311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:39.634318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:39.634331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:39.634456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1279 partition: 0 MaxSeqNo: 42 sessionId: src_id|444def9-6ea5a890-516b886c-15ac9e69_0
2025-09-30T14:53:39.634827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b79f419b-2e2a59ad-1def5a0c-df26f9e5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|444def9-6ea5a890-516b886c-15ac9e69_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:39.637568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|444def9-6ea5a890-516b886c-15ac9e69_0] Write session: try to update token
2025-09-30T14:53:39.637587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|444def9-6ea5a890-516b886c-15ac9e69_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:39.646626Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:39.646643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:39.646646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:39.646653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:39.646664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895529215872464:7910]
2025-09-30T14:53:39.646673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895529215872464:7910]
2025-09-30T14:53:39.646680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895529215872464:7910]
2025-09-30T14:53:39.646731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:39.646743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.646744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:39.646747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:39.646751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:39.646755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:39.646920Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:39.652710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1279 sessionId: src_id|444def9-6ea5a890-516b886c-15ac9e69_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:39.655599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:39.705525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895529305622338:3461]
2025-09-30T14:53:39.705790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1278, pipe: [1:7555895529305622338:3461]
2025-09-30T14:53:39.759266Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:39.759625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:39.759641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:39.759682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895529305622338:3461], now have 1 active actors on pipe
2025-09-30T14:53:39.759906Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:39.759940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:39.759958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:39.759969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895529305622338:3461]
2025-09-30T14:53:39.759991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:39.760029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1279 reason: error at write: Disconnected sessionId: src_id|444def9-6ea5a890-516b886c-15ac9e69_0
2025-09-30T14:53:39.760255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1279 sessionId: src_id|444def9-6ea5a890-516b886c-15ac9e69_0 is DEAD
2025-09-30T14:53:39.760417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|444def9-6ea5a890-516b886c-15ac9e69_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:39.760425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|444def9-6ea5a890-516b886c-15ac9e69_0] Write session will restart in 0.009351s
2025-09-30T14:53:39.760449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|444def9-6ea5a890-516b886c-15ac9e69_0] Write session: Do CDS request
2025-09-30T14:53:39.760459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|444def9-6ea5a890-516b886c-15ac9e69_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:39.769833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:39.770737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|444def9-6ea5a890-516b886c-15ac9e69_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:39.770806Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:39.770824Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1280
2025-09-30T14:53:39.770976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1280 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:39.771010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1280 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:39.771021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1280 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:39.771025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:39.771468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1280 sessionId:  describe result for acl check
2025-09-30T14:53:39.771503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:39.771509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:39.771511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:39.771518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895529305622415:2833] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:39.772091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895529305622415:2833] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:39.772249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:39.772451Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:39.772460Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:39.772470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:39.772515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:39.772553Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895529215872584:7913]
2025-09-30T14:53:39.773080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:39.773354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:39.773393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:39.773678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:39.773736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:39.773743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:39.773744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:39.773745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:39.773747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:39.773748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:39.773749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:39.773750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:39.773752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:39.773753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:39.773754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.773755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.773757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.773758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:39.773759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:39.773764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:39.773774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:39.773778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:39.773782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:39.773786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:39.773791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:39.773795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:39.773799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:39.773803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:39.773807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:39.773811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.773815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.773820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.773824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:39.773828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:39.773837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:39.773844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:39.773850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:39.773860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:39.773865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:39.773876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:39.773880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:39.773891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:39.773890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895529305622415:2833] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:39.773896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:39.773906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:39.773911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:39.773916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:39.773921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:39.773926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:39.773931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:39.773936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:39.773940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:39.773946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:39.773950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:39.773955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:39.773960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.773966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.773970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.773980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.773985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.773994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.773998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:39.774003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:39.774012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:39.774029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:39.774078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:39.779366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895529305622415:2833] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:39.779384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895529305622415:2833] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:39.779388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895529305622415:2833] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:39.779397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1280 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:39.779627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:39.780523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:39.780536Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:39.780538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:39.780542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:39.780548Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1279 [2:7555895529215872584:7913]
2025-09-30T14:53:39.780565Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:39.780581Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:39.780590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:39.780594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:39.780596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:39.780612Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:39.780623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:39.780630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:39.780691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.780699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.780701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.780703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:39.780705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:39.780772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:39.780781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.780794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.780804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.780824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:39.780849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895529215872578:7913]
2025-09-30T14:53:39.780851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895529215872578:7913]
2025-09-30T14:53:39.780853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895529215872578:7913]
2025-09-30T14:53:39.780863Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:39.780876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895529305622453:2833], now have 1 active actors on pipe
2025-09-30T14:53:39.780877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:39.780880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895529305622339:2454], now have 1 active actors on pipe
2025-09-30T14:53:39.780882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:39.780884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:39.780890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:39.780904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:39.780906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:39.780927Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1279
2025-09-30T14:53:39.780928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1279
2025-09-30T14:53:39.780939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895529215872578:7913]
2025-09-30T14:53:39.780947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:39.780959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:39.780992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:39.781001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:39.781026Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c36bc59e-bd023cd0-5b553849-10f58b9a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:39.781038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:39.781041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:39.781043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:39.781055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:39.781069Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:39.781085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:39.781209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:39.781217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:39.781230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:39.781309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1280 partition: 0 MaxSeqNo: 42 sessionId: src_id|c36bc59e-bd023cd0-5b553849-10f58b9a_0
2025-09-30T14:53:39.781676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|444def9-6ea5a890-516b886c-15ac9e69_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c36bc59e-bd023cd0-5b553849-10f58b9a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:39.784494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c36bc59e-bd023cd0-5b553849-10f58b9a_0] Write session: try to update token
2025-09-30T14:53:39.784515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c36bc59e-bd023cd0-5b553849-10f58b9a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:39.799213Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:39.799231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:39.799258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895529215872578:7913]
2025-09-30T14:53:39.799308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:39.799337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:39.799482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1280 sessionId: src_id|c36bc59e-bd023cd0-5b553849-10f58b9a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:39.799641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:39.799797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:39.799953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:39.800101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:39.800330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:39.800376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:39.802169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:39.802371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:39.802389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:39.802424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:39.802514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:39.804142Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:39.804155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:39.804158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:39.804161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:39.804171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895529215872578:7913]
2025-09-30T14:53:39.804175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895529215872578:7913]
2025-09-30T14:53:39.804182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895529215872578:7913]
2025-09-30T14:53:39.804219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:39.804222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:39.804226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.804228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:39.804228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:39.804232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:39.804368Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:39.859653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895529305622461:3461]
2025-09-30T14:53:39.859931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1279, pipe: [1:7555895529305622461:3461]
2025-09-30T14:53:39.916137Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:39.924920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:39.924947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:39.925120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:39.925181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:39.925246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:39.925311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:39.925610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:39.925616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:39.925692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:39.925753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:39.925809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:39.925872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:39.925911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:39.925913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:39.925984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:39.926061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:39.926125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:39.926188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:39.926229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:39.926232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:39.926304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:39.926365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:39.926424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:39.926482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:39.926521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:39.926524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:39.926591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:39.926674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:39.926737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:39.926800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:39.926847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:39.926850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:39.926924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:39.926989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:39.927048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:39.927106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:39.927146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:39.927149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:39.927222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:39.927500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:39.927574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:39.927641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:39.927708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:39.927715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:39.927784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:39.927855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:39.927919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:39.927983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:39.928030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:39.928039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:39.928107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:39.928176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:39.928243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:39.928307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:39.928354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:39.928361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:39.928428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:39.928491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:39.928556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:39.928627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:39.928670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:39.928678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:39.928743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895529305622461:3461], now have 1 active actors on pipe
2025-09-30T14:53:39.929221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895529305622461:3461]
2025-09-30T14:53:39.929236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:39.929241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:39.929255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:39.929268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1280 reason: error at write: Disconnected sessionId: src_id|c36bc59e-bd023cd0-5b553849-10f58b9a_0
2025-09-30T14:53:39.929377Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:39.929476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1280 sessionId: src_id|c36bc59e-bd023cd0-5b553849-10f58b9a_0 is DEAD
2025-09-30T14:53:39.929634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c36bc59e-bd023cd0-5b553849-10f58b9a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:39.929643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c36bc59e-bd023cd0-5b553849-10f58b9a_0] Write session will restart in 0.005579s
2025-09-30T14:53:39.929666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c36bc59e-bd023cd0-5b553849-10f58b9a_0] Write session: Do CDS request
2025-09-30T14:53:39.929672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c36bc59e-bd023cd0-5b553849-10f58b9a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:39.936809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c36bc59e-bd023cd0-5b553849-10f58b9a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:39.936881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:39.936911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1281
2025-09-30T14:53:39.937029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1281 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:39.937062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1281 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:39.937068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1281 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:39.937072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:39.937542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1281 sessionId:  describe result for acl check
2025-09-30T14:53:39.937577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:39.937586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:39.937588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:39.937594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895529305622495:2818] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:39.938161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895529305622495:2818] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:39.941740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895529305622495:2818] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:39.944239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895529305622495:2818] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:39.944255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895529305622495:2818] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:39.944258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895529305622495:2818] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:39.944267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1281 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:39.944945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:39.947360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:39.947582Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:39.947591Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:39.947601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:39.947667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:39.947715Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895529215872699:7915]
2025-09-30T14:53:39.948406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:39.948739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:39.948784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:39.949116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:39.949184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:39.949190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:39.949191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:39.949192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:39.949194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:39.949195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:39.949196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:39.949197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:39.949199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:39.949200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:39.949201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.949202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.949204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.949205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:39.949206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:39.949212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:39.949222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:39.949226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:39.949231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:39.949235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:39.949239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:39.949244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:39.949248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:39.949252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:39.949257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:39.949261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.949265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.949269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.949273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:39.949277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:39.949287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:39.949294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:39.949301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:39.949307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:39.949315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:39.949321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:39.949326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:39.949331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:39.949336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:39.949341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:39.949345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:39.949351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:39.949362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:39.949368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:39.949372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:39.949377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:39.949382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:39.949387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:39.949393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:39.949399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:39.949403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.949408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.949413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.949418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.949423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.949428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.949433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:39.949438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:39.949443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:39.949448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:39.949495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:39.955120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:39.956190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:39.956207Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:39.956211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:39.956215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:39.956224Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1280 [2:7555895529215872699:7915]
2025-09-30T14:53:39.956242Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:39.956258Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:39.956261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:39.956264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:39.956266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:39.956283Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:39.956295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:39.956304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:39.956388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.956403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.956405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.956409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:39.956412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:39.956508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:39.956517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.956532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:39.956551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:39.956575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:39.956604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895529215872693:7915]
2025-09-30T14:53:39.956614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895529215872693:7915]
2025-09-30T14:53:39.956617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895529215872693:7915]
2025-09-30T14:53:39.956638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:39.956658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:39.956679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:39.956683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:39.956688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:39.956691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:39.956694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:39.956729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895529215872693:7915]
2025-09-30T14:53:39.956734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:39.956743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:39.956750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895529305622570:2818], now have 1 active actors on pipe
2025-09-30T14:53:39.956778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895529305622462:2454], now have 1 active actors on pipe
2025-09-30T14:53:39.956868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1280
2025-09-30T14:53:39.956926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:39.956940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:39.956917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1280
2025-09-30T14:53:39.956966Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20308668-e71e5b02-3851a7af-6c8ed3be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:39.956978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:39.956982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:39.956984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:39.956996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:39.957013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:39.957033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:39.957165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:39.957171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:39.957185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:39.957273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1281 partition: 0 MaxSeqNo: 42 sessionId: src_id|20308668-e71e5b02-3851a7af-6c8ed3be_0
2025-09-30T14:53:39.957659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c36bc59e-bd023cd0-5b553849-10f58b9a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|20308668-e71e5b02-3851a7af-6c8ed3be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:39.960487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20308668-e71e5b02-3851a7af-6c8ed3be_0] Write session: try to update token
2025-09-30T14:53:39.960505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20308668-e71e5b02-3851a7af-6c8ed3be_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:39.969295Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:39.969313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:39.969322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895529215872693:7915]
2025-09-30T14:53:39.969366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:39.969367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:39.969549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:39.969698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:39.969855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:39.969988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:39.970709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:39.970747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:39.975034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1281 sessionId: src_id|20308668-e71e5b02-3851a7af-6c8ed3be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:39.977689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:39.977895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:39.977923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:39.977956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:39.978061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:39.980182Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:39.980200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:39.980202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:39.980204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:39.980216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895529215872693:7915]
2025-09-30T14:53:39.980221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895529215872693:7915]
2025-09-30T14:53:39.980224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895529215872693:7915]
2025-09-30T14:53:39.980261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:39.980267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:39.980270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:39.980289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:39.980302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:39.980306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:39.980415Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:40.029624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895533600589903:3461]
2025-09-30T14:53:40.029888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1280, pipe: [1:7555895533600589903:3461]
2025-09-30T14:53:40.091558Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:40.098988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:40.099013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:40.099177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:40.099269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:40.099341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:40.099415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:40.099774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:40.099785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:40.099852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:40.099916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:40.099975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:40.100036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:40.100075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:40.100081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:40.100144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:40.100201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:40.100258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:40.100317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:40.100358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:40.100364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:40.100424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:40.100485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:40.100549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:40.100609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:40.100648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:40.100653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:40.100716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:40.100777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:40.100835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:40.100892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:40.100933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:40.100939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:40.101010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:40.101067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:40.101124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:40.101180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:40.101221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:40.101230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:40.101301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:40.101550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:40.101611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:40.101671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:40.101718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:40.101726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:40.101787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:40.101842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:40.101900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:40.101962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:40.102006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:40.102026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:40.102096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:40.102152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:40.102211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:40.102272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:40.102316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:40.102323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:40.102386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:40.102443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:40.102502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:40.102560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:40.102601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:40.102606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:40.102658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895533600589903:3461], now have 1 active actors on pipe
2025-09-30T14:53:40.102912Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:40.102982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:40.102990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:40.103019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1281 reason: error at write: Disconnected sessionId: src_id|20308668-e71e5b02-3851a7af-6c8ed3be_0
2025-09-30T14:53:40.103090Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:40.103265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1281 sessionId: src_id|20308668-e71e5b02-3851a7af-6c8ed3be_0 is DEAD
2025-09-30T14:53:40.103337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895533600589903:3461]
2025-09-30T14:53:40.103432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20308668-e71e5b02-3851a7af-6c8ed3be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:40.103441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20308668-e71e5b02-3851a7af-6c8ed3be_0] Write session will restart in 0.009392s
2025-09-30T14:53:40.103463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20308668-e71e5b02-3851a7af-6c8ed3be_0] Write session: Do CDS request
2025-09-30T14:53:40.103469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20308668-e71e5b02-3851a7af-6c8ed3be_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:40.113370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:40.113773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20308668-e71e5b02-3851a7af-6c8ed3be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:40.113855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:40.113883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1282
2025-09-30T14:53:40.114009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1282 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:40.114052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1282 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:40.114057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1282 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:40.114061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:40.114479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1282 sessionId:  describe result for acl check
2025-09-30T14:53:40.114509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:40.114516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:40.114518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:40.114523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895533600589990:2809] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:40.115019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895533600589990:2809] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:40.115062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:40.115268Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:40.115281Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:40.115291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:40.115341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:40.115378Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895533510840144:7929]
2025-09-30T14:53:40.116032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:40.116263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:40.116304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:40.116639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:40.116702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:40.116708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:40.116709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:40.116710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:40.116711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:40.116712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:40.116713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:40.116715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:40.116716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:40.116717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:40.116718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.116719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.116720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.116721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:40.116722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:40.116727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:40.116736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:40.116740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:40.116744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:40.116748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:40.116751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:40.116755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:40.116758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:40.116761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:40.116765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:40.116769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.116773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.116776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.116779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:40.116783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:40.116789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:40.116795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:40.116801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:40.116806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:40.116810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:40.116815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:40.116819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:40.116823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:40.116827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:40.116832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:40.116836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:40.116840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:40.116845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:40.116849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:40.116853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:40.116858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:40.116862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:40.116867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:40.116871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:40.116876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:40.116881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.116885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.116889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.116894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.116898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.116903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.116907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:40.116913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:40.116918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:40.116922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:40.116962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:40.117024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895533600589990:2809] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:40.121947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895533600589990:2809] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:40.121966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895533600589990:2809] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:40.121970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895533600589990:2809] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:40.121979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1282 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:40.122246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:40.123297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:40.123311Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:40.123314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:40.123318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:40.123324Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1281 [2:7555895533510840144:7929]
2025-09-30T14:53:40.123338Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:40.123352Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:40.123355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:40.123359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:40.123361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:40.123375Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:40.123383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:40.123388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:40.123444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.123452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.123454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.123457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:40.123459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:40.123518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:40.123525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.123537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.123552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.123570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:40.123591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895533600589911:2454], now have 1 active actors on pipe
2025-09-30T14:53:40.123594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895533600590029:2809], now have 1 active actors on pipe
2025-09-30T14:53:40.123599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895533510840138:7929]
2025-09-30T14:53:40.123606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895533510840138:7929]
2025-09-30T14:53:40.123607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895533510840138:7929]
2025-09-30T14:53:40.123619Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:40.123633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:40.123638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:40.123642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:40.123644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:40.123651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:40.123654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:40.123653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1281
2025-09-30T14:53:40.123681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895533510840138:7929]
2025-09-30T14:53:40.123655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1281
2025-09-30T14:53:40.123689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:40.123691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:40.123716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:40.123724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:40.123759Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|353f5733-d448d82e-1ea4c1a5-98c9cc9f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:40.123770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:40.123773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:40.123776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:40.123787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:40.123799Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:40.123817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:40.123952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:40.123962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:40.123977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:40.124057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1282 partition: 0 MaxSeqNo: 42 sessionId: src_id|353f5733-d448d82e-1ea4c1a5-98c9cc9f_0
2025-09-30T14:53:40.124398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20308668-e71e5b02-3851a7af-6c8ed3be_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|353f5733-d448d82e-1ea4c1a5-98c9cc9f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:40.127369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|353f5733-d448d82e-1ea4c1a5-98c9cc9f_0] Write session: try to update token
2025-09-30T14:53:40.127386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|353f5733-d448d82e-1ea4c1a5-98c9cc9f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:40.135802Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:40.135820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:40.135823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:40.135826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:40.135835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895533510840138:7929]
2025-09-30T14:53:40.135839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895533510840138:7929]
2025-09-30T14:53:40.135843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895533510840138:7929]
2025-09-30T14:53:40.135885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:40.135894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.135897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:40.135903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:40.135911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:40.135916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:40.136030Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:40.142205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1282 sessionId: src_id|353f5733-d448d82e-1ea4c1a5-98c9cc9f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:40.144961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:40.203203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895533600590037:3461]
2025-09-30T14:53:40.203501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1281, pipe: [1:7555895533600590037:3461]
2025-09-30T14:53:40.251826Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:40.252165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:40.252192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:40.252244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895533600590037:3461], now have 1 active actors on pipe
2025-09-30T14:53:40.252527Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:40.252519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:40.252525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:40.252536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:40.252569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895533600590037:3461]
2025-09-30T14:53:40.252607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1282 reason: error at write: Disconnected sessionId: src_id|353f5733-d448d82e-1ea4c1a5-98c9cc9f_0
2025-09-30T14:53:40.252786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1282 sessionId: src_id|353f5733-d448d82e-1ea4c1a5-98c9cc9f_0 is DEAD
2025-09-30T14:53:40.252971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|353f5733-d448d82e-1ea4c1a5-98c9cc9f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:40.252983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|353f5733-d448d82e-1ea4c1a5-98c9cc9f_0] Write session will restart in 0.009812s
2025-09-30T14:53:40.253006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|353f5733-d448d82e-1ea4c1a5-98c9cc9f_0] Write session: Do CDS request
2025-09-30T14:53:40.253015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|353f5733-d448d82e-1ea4c1a5-98c9cc9f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:40.263431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:40.263808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|353f5733-d448d82e-1ea4c1a5-98c9cc9f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:40.263897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:40.263915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1283
2025-09-30T14:53:40.264099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1283 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:40.264134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1283 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:40.264143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1283 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:40.264147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:40.264565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1283 sessionId:  describe result for acl check
2025-09-30T14:53:40.264603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:40.264611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:40.264616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:40.264622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895533600590129:2801] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:40.265190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895533600590129:2801] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:40.265644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:40.265840Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:40.265849Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:40.265859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:40.265908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:40.265949Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895533510840273:7933]
2025-09-30T14:53:40.266587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:40.266885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:40.266890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895533600590129:2801] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:40.266929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:40.267237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:40.267313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:40.267319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:40.267320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:40.267322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:40.267323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:40.267324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:40.267325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:40.267326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:40.267328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:40.267329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:40.267330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.267331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.267332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.267333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:40.267334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:40.267339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:40.267349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:40.267353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:40.267357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:40.267361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:40.267364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:40.267368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:40.267372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:40.267376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:40.267380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:40.267383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.267386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.267390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.267394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:40.267397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:40.267404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:40.267412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:40.267417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:40.267422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:40.267427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:40.267432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:40.267437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:40.267441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:40.267447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:40.267452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:40.267457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:40.267461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:40.267466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:40.267470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:40.267474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:40.267485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:40.267492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:40.267501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:40.267504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:40.267509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:40.267513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.267522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.267526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.267535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.267542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.267550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.267554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:40.267563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:40.267567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:40.267576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:40.267616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:40.272854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895533600590129:2801] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:40.272874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895533600590129:2801] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:40.272878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895533600590129:2801] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:40.272887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1283 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:40.273181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:40.274090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:40.274106Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:40.274109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:40.274113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:40.274119Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1282 [2:7555895533510840273:7933]
2025-09-30T14:53:40.274136Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:40.274152Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:40.274155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:40.274158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:40.274160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:40.274176Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:40.274184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:40.274191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:40.274252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.274262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.274263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.274267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:40.274270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:40.274340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:40.274348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.274362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.274373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.274388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:40.274409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895533510840267:7933]
2025-09-30T14:53:40.274416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895533510840267:7933]
2025-09-30T14:53:40.274418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895533510840267:7933]
2025-09-30T14:53:40.274434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:40.274449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:40.274462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:40.274465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:40.274486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:40.274495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:40.274498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:40.274499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895533510840267:7933]
2025-09-30T14:53:40.274501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:40.274504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:40.274640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895533600590167:2801], now have 1 active actors on pipe
2025-09-30T14:53:40.274660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895533600590050:2454], now have 1 active actors on pipe
2025-09-30T14:53:40.274706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1282
2025-09-30T14:53:40.274722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1282
2025-09-30T14:53:40.274869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:40.274885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:40.274921Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e68743df-73f843d2-bef19dc9-d01e144a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:40.274930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:40.274935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:40.274938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:40.274963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:40.274977Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:40.275001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:40.275207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:40.275218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:40.275235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:40.275355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1283 partition: 0 MaxSeqNo: 42 sessionId: src_id|e68743df-73f843d2-bef19dc9-d01e144a_0
2025-09-30T14:53:40.275735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|353f5733-d448d82e-1ea4c1a5-98c9cc9f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e68743df-73f843d2-bef19dc9-d01e144a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:40.278684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e68743df-73f843d2-bef19dc9-d01e144a_0] Write session: try to update token
2025-09-30T14:53:40.278705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e68743df-73f843d2-bef19dc9-d01e144a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:40.293143Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:40.293161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:40.293171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895533510840267:7933]
2025-09-30T14:53:40.293221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:40.293238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:40.293412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:40.293580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:40.293738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:40.293898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:40.294132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:40.294183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:40.294561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1283 sessionId: src_id|e68743df-73f843d2-bef19dc9-d01e144a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:40.297422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:40.298306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:40.298325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:40.298341Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:40.298344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:40.298346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:40.298348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:40.298354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895533510840267:7933]
2025-09-30T14:53:40.298358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895533510840267:7933]
2025-09-30T14:53:40.298364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895533510840267:7933]
2025-09-30T14:53:40.298404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:40.298405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:40.298409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.298410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:40.298411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:40.298412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:40.298540Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:40.352688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895533600590175:3461]
2025-09-30T14:53:40.352959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1282, pipe: [1:7555895533600590175:3461]
2025-09-30T14:53:40.411386Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:40.411741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:40.411777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895533600590175:3461], now have 1 active actors on pipe
2025-09-30T14:53:40.411907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:40.412001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:40.412010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:40.412055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895533600590175:3461]
2025-09-30T14:53:40.412073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1283 reason: error at write: Disconnected sessionId: src_id|e68743df-73f843d2-bef19dc9-d01e144a_0
2025-09-30T14:53:40.412075Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:40.412220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1283 sessionId: src_id|e68743df-73f843d2-bef19dc9-d01e144a_0 is DEAD
2025-09-30T14:53:40.412401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68743df-73f843d2-bef19dc9-d01e144a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:40.412413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68743df-73f843d2-bef19dc9-d01e144a_0] Write session will restart in 0.005018s
2025-09-30T14:53:40.412435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68743df-73f843d2-bef19dc9-d01e144a_0] Write session: Do CDS request
2025-09-30T14:53:40.412441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68743df-73f843d2-bef19dc9-d01e144a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:40.418798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e68743df-73f843d2-bef19dc9-d01e144a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:40.418882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:40.418896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1284
2025-09-30T14:53:40.419089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1284 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:40.419145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1284 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:40.419172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1284 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:40.419181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:40.419634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1284 sessionId:  describe result for acl check
2025-09-30T14:53:40.419680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:40.419688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:40.419690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:40.419696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895533600590192:2798] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:40.420237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895533600590192:2798] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:40.422462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895533600590192:2798] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:40.423512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:40.425695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:40.425904Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:40.425915Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:40.425928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:40.425994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:40.426046Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895533510840389:7935]
2025-09-30T14:53:40.426056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895533600590192:2798] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:40.426070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895533600590192:2798] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:40.426074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895533600590192:2798] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:40.426082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1284 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:40.426698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:40.427047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:40.427090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:40.427349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:40.427397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:40.427403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:40.427404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:40.427405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:40.427406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:40.427407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:40.427409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:40.427410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:40.427412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:40.427412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:40.427413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.427414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.427416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.427416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:40.427417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:40.427423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:40.427433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:40.427436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:40.427441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:40.427445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:40.427449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:40.427453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:40.427458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:40.427461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:40.427463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:40.427466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.427468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.427471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.427473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:40.427475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:40.427481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:40.427486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:40.427490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:40.427494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:40.427496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:40.427499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:40.427502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:40.427505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:40.427508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:40.427512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:40.427515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:40.427517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:40.427520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:40.427523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:40.427526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:40.427530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:40.427532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:40.427535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:40.427537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:40.427540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:40.427543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.427545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.427548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.427550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.427553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.427557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.427559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:40.427562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:40.427565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:40.427568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:40.427594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:40.433031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:40.433882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:40.433894Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:40.433897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:40.433900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:40.433906Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1283 [2:7555895533510840389:7935]
2025-09-30T14:53:40.433919Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:40.433932Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:40.433934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:40.433936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:40.433938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:40.433951Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:40.433956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:40.433961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:40.434024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.434032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.434034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.434037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:40.434039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:40.434103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:40.434106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.434118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.434134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.434149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:40.434171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895533510840383:7935]
2025-09-30T14:53:40.434178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895533510840383:7935]
2025-09-30T14:53:40.434180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895533510840383:7935]
2025-09-30T14:53:40.434188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:40.434194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:40.434197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:40.434200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:40.434203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895533600590290:2798], now have 1 active actors on pipe
2025-09-30T14:53:40.434208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895533600590176:2454], now have 1 active actors on pipe
2025-09-30T14:53:40.434217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:40.434236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:40.434243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:40.434274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895533510840383:7935]
2025-09-30T14:53:40.434283Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:40.434264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1283
2025-09-30T14:53:40.434306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:40.434266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1283
2025-09-30T14:53:40.434317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:40.434321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:40.434350Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea2f3a25-23b6fcc6-ae5827a4-b9d5e7a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:40.434363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:40.434371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:40.434373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:40.434382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:40.434392Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:40.434413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:40.434578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:40.434584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:40.434597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:40.434671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1284 partition: 0 MaxSeqNo: 42 sessionId: src_id|ea2f3a25-23b6fcc6-ae5827a4-b9d5e7a3_0
2025-09-30T14:53:40.435017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68743df-73f843d2-bef19dc9-d01e144a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ea2f3a25-23b6fcc6-ae5827a4-b9d5e7a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:40.437663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea2f3a25-23b6fcc6-ae5827a4-b9d5e7a3_0] Write session: try to update token
2025-09-30T14:53:40.437680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea2f3a25-23b6fcc6-ae5827a4-b9d5e7a3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:40.446631Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:40.446652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:40.446655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:40.446657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:40.446667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895533510840383:7935]
2025-09-30T14:53:40.446672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895533510840383:7935]
2025-09-30T14:53:40.446677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895533510840383:7935]
2025-09-30T14:53:40.446721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:40.446726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:40.446729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.446732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:40.446733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:40.446737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:40.446869Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:40.455236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1284 sessionId: src_id|ea2f3a25-23b6fcc6-ae5827a4-b9d5e7a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:40.458004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:40.512450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895533600590302:3461]
2025-09-30T14:53:40.512694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1283, pipe: [1:7555895533600590302:3461]
2025-09-30T14:53:40.562981Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:40.563402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:40.563424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:40.563446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895533600590302:3461], now have 1 active actors on pipe
2025-09-30T14:53:40.563720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:40.563727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895533600590302:3461]
2025-09-30T14:53:40.563738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:40.563746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:40.563813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1284 reason: error at write: Disconnected sessionId: src_id|ea2f3a25-23b6fcc6-ae5827a4-b9d5e7a3_0
2025-09-30T14:53:40.564243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea2f3a25-23b6fcc6-ae5827a4-b9d5e7a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:40.564265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea2f3a25-23b6fcc6-ae5827a4-b9d5e7a3_0] Write session will restart in 0.007928s
2025-09-30T14:53:40.564011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1284 sessionId: src_id|ea2f3a25-23b6fcc6-ae5827a4-b9d5e7a3_0 is DEAD
2025-09-30T14:53:40.564295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea2f3a25-23b6fcc6-ae5827a4-b9d5e7a3_0] Write session: Do CDS request
2025-09-30T14:53:40.564303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea2f3a25-23b6fcc6-ae5827a4-b9d5e7a3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:40.564949Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:40.573963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea2f3a25-23b6fcc6-ae5827a4-b9d5e7a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:40.574091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:40.574111Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1285
2025-09-30T14:53:40.574299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1285 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:40.574358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1285 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:40.574369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1285 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:40.574389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:40.574884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1285 sessionId:  describe result for acl check
2025-09-30T14:53:40.574930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:40.574939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:40.574942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:40.574948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895533600590384:2792] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:40.575581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895533600590384:2792] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:40.575795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:40.577784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895533600590384:2792] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:40.578222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:40.578423Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:40.578435Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:40.578454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:40.578501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:40.578537Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895533510840506:7937]
2025-09-30T14:53:40.579136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:40.579563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:40.579622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:40.579997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:40.580060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:40.580068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:40.580070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:40.580070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:40.580072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:40.580073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:40.580074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:40.580076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:40.580077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:40.580078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:40.580079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.580080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.580082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.580083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:40.580084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:40.580090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:40.580101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:40.580106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:40.580111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:40.580115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:40.580120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:40.580124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:40.580128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:40.580133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:40.580138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:40.580142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.580147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.580151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.580156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:40.580161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:40.580169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:40.580177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:40.580185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:40.580191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:40.580196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:40.580201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:40.580206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:40.580212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:40.580217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:40.580223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:40.580227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:40.580233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:40.580239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:40.580245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:40.580250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:40.580235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895533600590384:2792] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:40.580246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895533600590384:2792] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:40.580250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895533600590384:2792] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:40.580258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1285 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:40.580256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:40.580269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:40.580274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:40.580279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:40.580285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:40.580290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.580295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.580301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.580307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.580312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.580317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.580322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:40.580328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:40.580335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:40.580341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:40.580401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:40.585823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:40.586720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:40.586737Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:40.586740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:40.586745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:40.586751Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1284 [2:7555895533510840506:7937]
2025-09-30T14:53:40.586769Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:40.586785Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:40.586789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:40.586792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:40.586794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:40.586811Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:40.586822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:40.586833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:40.586893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.586904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.586906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.586910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:40.586913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:40.586979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:40.586990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.587003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.587017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.587042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:40.587067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895533600590305:2454], now have 1 active actors on pipe
2025-09-30T14:53:40.587076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895533600590422:2792], now have 1 active actors on pipe
2025-09-30T14:53:40.587082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895533510840501:7937]
2025-09-30T14:53:40.587085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895533510840501:7937]
2025-09-30T14:53:40.587087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895533510840501:7937]
2025-09-30T14:53:40.587102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:40.587112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1284
2025-09-30T14:53:40.587122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:40.587137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:40.587141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:40.587143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:40.587148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:40.587151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:40.587174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895533510840501:7937]
2025-09-30T14:53:40.587177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:40.587171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1284
2025-09-30T14:53:40.587185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:40.587336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:40.587347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:40.587369Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c87e120d-49d07b8b-8c557634-48dcb5da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:40.587382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:40.587386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:40.587388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:40.587397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:40.587410Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:40.587426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:40.587612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:40.587623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:40.587636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:40.587716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1285 partition: 0 MaxSeqNo: 42 sessionId: src_id|c87e120d-49d07b8b-8c557634-48dcb5da_0
2025-09-30T14:53:40.588203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea2f3a25-23b6fcc6-ae5827a4-b9d5e7a3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c87e120d-49d07b8b-8c557634-48dcb5da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:40.591647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c87e120d-49d07b8b-8c557634-48dcb5da_0] Write session: try to update token
2025-09-30T14:53:40.591678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c87e120d-49d07b8b-8c557634-48dcb5da_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:40.599543Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:40.599569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:40.599571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:40.599573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:40.599584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895533510840501:7937]
2025-09-30T14:53:40.599588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895533510840501:7937]
2025-09-30T14:53:40.599596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895533510840501:7937]
2025-09-30T14:53:40.599639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:40.599647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.599647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:40.599654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:40.599657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:40.599662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:40.599804Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:40.617204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1285 sessionId: src_id|c87e120d-49d07b8b-8c557634-48dcb5da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:40.620028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:40.663964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895533600590432:3461]
2025-09-30T14:53:40.664259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1284, pipe: [1:7555895533600590432:3461]
2025-09-30T14:53:40.715936Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:40.716262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:40.716276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:40.716295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895533600590432:3461], now have 1 active actors on pipe
2025-09-30T14:53:40.717056Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:40.717196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c87e120d-49d07b8b-8c557634-48dcb5da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:40.717221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c87e120d-49d07b8b-8c557634-48dcb5da_0] Write session will restart in 0.007591s
2025-09-30T14:53:40.717254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c87e120d-49d07b8b-8c557634-48dcb5da_0] Write session: Do CDS request
2025-09-30T14:53:40.717262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c87e120d-49d07b8b-8c557634-48dcb5da_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:40.716589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895533600590432:3461]
2025-09-30T14:53:40.716630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:40.716674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:40.716676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:40.716745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1285 reason: error at write: Disconnected sessionId: src_id|c87e120d-49d07b8b-8c557634-48dcb5da_0
2025-09-30T14:53:40.716945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1285 sessionId: src_id|c87e120d-49d07b8b-8c557634-48dcb5da_0 is DEAD
2025-09-30T14:53:40.725930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c87e120d-49d07b8b-8c557634-48dcb5da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:40.725936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:40.725954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1286
2025-09-30T14:53:40.726293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1286 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:40.726330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1286 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:40.726340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1286 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:40.726344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:40.726806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1286 sessionId:  describe result for acl check
2025-09-30T14:53:40.726842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:40.726844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:40.726846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:40.726852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895533600590458:2785] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:40.727430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895533600590458:2785] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:40.730578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895533600590458:2785] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:40.731673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:40.733574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:40.733766Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:40.733779Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:40.733790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:40.733851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:40.733892Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895533510840626:7940]
2025-09-30T14:53:40.734000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895533600590458:2785] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:40.734033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895533600590458:2785] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:40.734037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895533600590458:2785] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:40.734046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1286 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:40.734564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:40.734872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:40.734917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:40.735399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:40.735481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:40.735486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:40.735486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:40.735487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:40.735488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:40.735489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:40.735490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:40.735490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:40.735491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:40.735492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:40.735493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.735494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.735494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.735495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:40.735496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:40.735500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:40.735507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:40.735509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:40.735512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:40.735514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:40.735516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:40.735519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:40.735521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:40.735523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:40.735526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:40.735528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.735530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.735533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.735536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:40.735538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:40.735544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:40.735549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:40.735553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:40.735556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:40.735559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:40.735563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:40.735567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:40.735573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:40.735578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:40.735583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:40.735588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:40.735594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:40.735599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:40.735604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:40.735608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:40.735614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:40.735620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:40.735625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:40.735630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:40.735635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:40.735641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.735647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.735650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.735656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.735663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.735669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.735673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:40.735678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:40.735682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:40.735687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:40.735730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:40.741300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:40.742285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:40.742314Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:40.742317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:40.742322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:40.742328Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1285 [2:7555895533510840626:7940]
2025-09-30T14:53:40.742343Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:40.742358Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:40.742362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:40.742364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:40.742367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:40.742383Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:40.742394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:40.742401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:40.742455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.742461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.742466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.742470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:40.742473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:40.742532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:40.742540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.742552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.742569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.742589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:40.742611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895533510840621:7940]
2025-09-30T14:53:40.742618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895533510840621:7940]
2025-09-30T14:53:40.742620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895533510840621:7940]
2025-09-30T14:53:40.742632Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:40.742647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:40.742651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895533600590549:2785], now have 1 active actors on pipe
2025-09-30T14:53:40.742656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895533600590433:2454], now have 1 active actors on pipe
2025-09-30T14:53:40.742656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:40.742658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:40.742664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:40.742679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:40.742687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:40.742720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1285
2025-09-30T14:53:40.742712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1285
2025-09-30T14:53:40.742723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895533510840621:7940]
2025-09-30T14:53:40.742730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:40.742750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:40.742763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:40.742767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:40.742795Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b97e9f55-23ffa869-1ce5068d-36f02555_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:40.742800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:40.742803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:40.742805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:40.742815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:40.742824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:40.742837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:40.742964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:40.742968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:40.742982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:40.743066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1286 partition: 0 MaxSeqNo: 42 sessionId: src_id|b97e9f55-23ffa869-1ce5068d-36f02555_0
2025-09-30T14:53:40.743500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c87e120d-49d07b8b-8c557634-48dcb5da_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b97e9f55-23ffa869-1ce5068d-36f02555_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:40.746549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b97e9f55-23ffa869-1ce5068d-36f02555_0] Write session: try to update token
2025-09-30T14:53:40.746570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b97e9f55-23ffa869-1ce5068d-36f02555_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:40.755053Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:40.755074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:40.755088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895533510840621:7940]
2025-09-30T14:53:40.755131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:40.755132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:40.755315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:40.755465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:40.755603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:40.755746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:40.755954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:40.756008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:40.762793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1286 sessionId: src_id|b97e9f55-23ffa869-1ce5068d-36f02555_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:40.765806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:40.766422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:40.766448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:40.766471Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:40.766475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:40.766477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:40.766479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:40.766489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895533510840621:7940]
2025-09-30T14:53:40.766493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895533510840621:7940]
2025-09-30T14:53:40.766497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895533510840621:7940]
2025-09-30T14:53:40.766542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:40.766547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:40.766553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.766555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:40.766556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:40.766569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:40.766694Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:40.814065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895533600590560:3461]
2025-09-30T14:53:40.814405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1285, pipe: [1:7555895533600590560:3461]
2025-09-30T14:53:40.884461Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:40.884837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:40.884874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895533600590560:3461], now have 1 active actors on pipe
2025-09-30T14:53:40.884984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:40.885067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:40.885105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:40.885108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:40.885119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895533600590560:3461]
2025-09-30T14:53:40.885173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1286 reason: error at write: Disconnected sessionId: src_id|b97e9f55-23ffa869-1ce5068d-36f02555_0
2025-09-30T14:53:40.885346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1286 sessionId: src_id|b97e9f55-23ffa869-1ce5068d-36f02555_0 is DEAD
2025-09-30T14:53:40.885478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b97e9f55-23ffa869-1ce5068d-36f02555_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:40.885486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b97e9f55-23ffa869-1ce5068d-36f02555_0] Write session will restart in 0.006514s
2025-09-30T14:53:40.885512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b97e9f55-23ffa869-1ce5068d-36f02555_0] Write session: Do CDS request
2025-09-30T14:53:40.885518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b97e9f55-23ffa869-1ce5068d-36f02555_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:40.892814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b97e9f55-23ffa869-1ce5068d-36f02555_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:40.892879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:40.892897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1287
2025-09-30T14:53:40.893037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1287 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:40.893074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1287 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:40.893080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1287 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:40.893089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:40.893534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1287 sessionId:  describe result for acl check
2025-09-30T14:53:40.893569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:40.893576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:40.893578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:40.893583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895533600590598:2784] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:40.894177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895533600590598:2784] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:40.896207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895533600590598:2784] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:40.896654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:40.898618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:40.898811Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:40.898820Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:40.898829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:40.898884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:40.899033Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895533510840745:7942]
2025-09-30T14:53:40.899048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895533600590598:2784] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:40.899065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895533600590598:2784] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:40.899069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895533600590598:2784] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:40.899077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1287 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:40.899585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:40.899878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:40.899931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:40.900240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:40.900303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:40.900308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:40.900310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:40.900311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:40.900312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:40.900313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:40.900315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:40.900316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:40.900317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:40.900318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:40.900320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.900321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.900322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.900323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:40.900324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:40.900329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:40.900339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:40.900342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:40.900346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:40.900350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:40.900354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:40.900357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:40.900362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:40.900366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:40.900371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:40.900376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.900381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.900385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.900390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:40.900394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:40.900402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:40.900410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:40.900417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:40.900423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:40.900428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:40.900434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:40.900441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:40.900447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:40.900453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:40.900474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:40.900482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:40.900488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:40.900496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:40.900505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:40.900510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:40.900519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:40.900524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:40.900534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:40.900538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:40.900547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:40.900552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.900558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.900567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.900572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.900578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.900584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.900592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:40.900597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:40.900604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:40.900609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:40.900656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:40.906310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:40.907203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:40.907218Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:40.907221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:40.907225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:40.907233Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1286 [2:7555895533510840745:7942]
2025-09-30T14:53:40.907262Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:40.907278Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:40.907281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:40.907285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:40.907288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:40.907306Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:40.907319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:40.907327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:40.907391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.907399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.907402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.907405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:40.907408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:40.907474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:40.907480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.907492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:40.907505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:40.907527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:40.907547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895533510840740:7942]
2025-09-30T14:53:40.907552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895533510840740:7942]
2025-09-30T14:53:40.907554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895533510840740:7942]
2025-09-30T14:53:40.907580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:40.907582Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:40.907590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:40.907593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:40.907594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895533600590679:2784], now have 1 active actors on pipe
2025-09-30T14:53:40.907597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895533600590562:2454], now have 1 active actors on pipe
2025-09-30T14:53:40.907606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:40.907621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:40.907628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:40.907662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895533510840740:7942]
2025-09-30T14:53:40.907669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:40.907694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:40.907704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:40.907709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:40.907738Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a4afcde-7454891c-da0ef283-50e2c941_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:40.907744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:40.907748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:40.907750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:40.907760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:40.907767Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:40.907781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:40.907943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:40.907950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:40.907962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:40.908451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b97e9f55-23ffa869-1ce5068d-36f02555_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5a4afcde-7454891c-da0ef283-50e2c941_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:40.907646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1286
2025-09-30T14:53:40.907662Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1286
2025-09-30T14:53:40.908067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1287 partition: 0 MaxSeqNo: 42 sessionId: src_id|5a4afcde-7454891c-da0ef283-50e2c941_0
2025-09-30T14:53:40.911357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a4afcde-7454891c-da0ef283-50e2c941_0] Write session: try to update token
2025-09-30T14:53:40.911378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a4afcde-7454891c-da0ef283-50e2c941_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:40.920118Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:40.920135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:40.920148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895533510840740:7942]
2025-09-30T14:53:40.920191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:40.920223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:40.920361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:40.920510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:40.920652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:40.920801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:40.920999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:40.921041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:40.928546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1287 sessionId: src_id|5a4afcde-7454891c-da0ef283-50e2c941_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:40.931383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:40.931549Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:40.931567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:40.931570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:40.931576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:40.931587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895533510840740:7942]
2025-09-30T14:53:40.931591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895533510840740:7942]
2025-09-30T14:53:40.931596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895533510840740:7942]
2025-09-30T14:53:40.931632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:40.931645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:40.931647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:40.931650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:40.931654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:40.931672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:40.931686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:40.931689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:40.931839Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:40.985530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895533600590694:3461]
2025-09-30T14:53:40.985727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1286, pipe: [1:7555895533600590694:3461]
2025-09-30T14:53:41.048156Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:41.048500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895533600590694:3461], now have 1 active actors on pipe
2025-09-30T14:53:41.048778Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:41.048822Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:41.048873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:41.048946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1287 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5a4afcde-7454891c-da0ef283-50e2c941_0
2025-09-30T14:53:41.049160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1287 sessionId: src_id|5a4afcde-7454891c-da0ef283-50e2c941_0 is DEAD
2025-09-30T14:53:41.049320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a4afcde-7454891c-da0ef283-50e2c941_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:41.049328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a4afcde-7454891c-da0ef283-50e2c941_0] Write session will restart in 0.007029s
2025-09-30T14:53:41.049372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a4afcde-7454891c-da0ef283-50e2c941_0] Write session: Do CDS request
2025-09-30T14:53:41.049379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a4afcde-7454891c-da0ef283-50e2c941_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:41.049456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895533600590694:3461]
2025-09-30T14:53:41.057771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a4afcde-7454891c-da0ef283-50e2c941_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:41.057965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:41.057985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1288
2025-09-30T14:53:41.058210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1288 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:41.058249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1288 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:41.058253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1288 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:41.058257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:41.058776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1288 sessionId:  describe result for acl check
2025-09-30T14:53:41.058810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:41.058817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:41.058818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:41.058823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895537895558068:2763] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:41.059371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895537895558068:2763] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:41.061513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895537895558068:2763] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:41.062266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:41.064632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:41.064893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895537895558068:2763] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:41.064907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895537895558068:2763] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:41.064910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895537895558068:2763] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:41.064929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1288 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:41.064825Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:41.064842Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:41.064854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:41.064918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:41.064948Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895537805808199:7950]
2025-09-30T14:53:41.065567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:41.065834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:41.065889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:41.066224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:41.066297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:41.066304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:41.066305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:41.066306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:41.066308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:41.066309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:41.066310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:41.066311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:41.066313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:41.066314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:41.066316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.066317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.066318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.066319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:41.066320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:41.066326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:41.066337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:41.066342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:41.066347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:41.066351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:41.066356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:41.066361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:41.066365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:41.066368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:41.066373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:41.066377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.066382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.066386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.066390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:41.066394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:41.066402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:41.066410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:41.066416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:41.066422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:41.066428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:41.066434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:41.066439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:41.066445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:41.066450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:41.066456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:41.066461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:41.066467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:41.066471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:41.066477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:41.066481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:41.066498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:41.066503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:41.066509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:41.066513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:41.066519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:41.066524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.066530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.066535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.066541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.066546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.066552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.066556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:41.066562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:41.066567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:41.066573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:41.066619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:41.072270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:41.073462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:41.073479Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:41.073482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:41.073486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:41.073493Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1287 [2:7555895537805808199:7950]
2025-09-30T14:53:41.073509Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:41.073525Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:41.073529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:41.073532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:41.073534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:41.073550Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:41.073557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:41.073563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:41.073627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.073637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.073640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.073643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:41.073646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:41.073730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:41.073739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.073754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.073768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.073788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:41.073812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895537895558140:2763], now have 1 active actors on pipe
2025-09-30T14:53:41.073820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895537895558013:2454], now have 1 active actors on pipe
2025-09-30T14:53:41.073827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895537805808179:7950]
2025-09-30T14:53:41.073829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895537805808179:7950]
2025-09-30T14:53:41.073831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895537805808179:7950]
2025-09-30T14:53:41.073845Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:41.073852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1287
2025-09-30T14:53:41.073852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1287
2025-09-30T14:53:41.073860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:41.073870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:41.073874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:41.073876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:41.073879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:41.073882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:41.073918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895537805808179:7950]
2025-09-30T14:53:41.073926Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:41.073931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:41.073947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:41.073952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:41.074000Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d2993825-e24ea4b3-5ad1eca8-998d3139_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:41.074024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:41.074030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:41.074033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:41.074044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:41.074060Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:41.074087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:41.074262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:41.074275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:41.074290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:41.074379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1288 partition: 0 MaxSeqNo: 42 sessionId: src_id|d2993825-e24ea4b3-5ad1eca8-998d3139_0
2025-09-30T14:53:41.074765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a4afcde-7454891c-da0ef283-50e2c941_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d2993825-e24ea4b3-5ad1eca8-998d3139_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:41.077599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2993825-e24ea4b3-5ad1eca8-998d3139_0] Write session: try to update token
2025-09-30T14:53:41.077620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2993825-e24ea4b3-5ad1eca8-998d3139_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:41.087208Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:41.087230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:41.087232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:41.087234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:41.087265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895537805808179:7950]
2025-09-30T14:53:41.087270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895537805808179:7950]
2025-09-30T14:53:41.087275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895537805808179:7950]
2025-09-30T14:53:41.087317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:41.087322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:41.087323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.087326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:41.087337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:41.087341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:41.087470Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:41.095479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1288 sessionId: src_id|d2993825-e24ea4b3-5ad1eca8-998d3139_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:41.098317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:41.149396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895537895558154:3461]
2025-09-30T14:53:41.149734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1287, pipe: [1:7555895537895558154:3461]
2025-09-30T14:53:41.210842Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:41.211091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:41.211105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:41.211142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895537895558154:3461], now have 1 active actors on pipe
2025-09-30T14:53:41.211335Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:41.211362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:41.211380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:41.211404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895537895558154:3461]
2025-09-30T14:53:41.211423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:41.211448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1288 reason: error at write: Disconnected sessionId: src_id|d2993825-e24ea4b3-5ad1eca8-998d3139_0
2025-09-30T14:53:41.211644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1288 sessionId: src_id|d2993825-e24ea4b3-5ad1eca8-998d3139_0 is DEAD
2025-09-30T14:53:41.211804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2993825-e24ea4b3-5ad1eca8-998d3139_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:41.211814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2993825-e24ea4b3-5ad1eca8-998d3139_0] Write session will restart in 0.006707s
2025-09-30T14:53:41.211837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2993825-e24ea4b3-5ad1eca8-998d3139_0] Write session: Do CDS request
2025-09-30T14:53:41.211843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2993825-e24ea4b3-5ad1eca8-998d3139_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:41.219809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2993825-e24ea4b3-5ad1eca8-998d3139_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:41.219881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:41.219898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1289
2025-09-30T14:53:41.220044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1289 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:41.220085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1289 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:41.220095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1289 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:41.220099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:41.220592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1289 sessionId:  describe result for acl check
2025-09-30T14:53:41.220635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:41.220641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:41.220643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:41.220649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895537895558219:2760] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:41.221245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895537895558219:2760] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:41.223023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:41.223539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895537895558219:2760] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:41.225142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:41.225346Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:41.225356Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:41.225367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:41.225420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:41.225458Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895537805808335:7960]
2025-09-30T14:53:41.225801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895537895558219:2760] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:41.225817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895537895558219:2760] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:41.225819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895537895558219:2760] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:41.225828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1289 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:41.226088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:41.226353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:41.226425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:41.226774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:41.226845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:41.226851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:41.226853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:41.226854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:41.226855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:41.226856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:41.226857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:41.226859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:41.226860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:41.226861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:41.226863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.226863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.226865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.226866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:41.226867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:41.226872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:41.226882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:41.226886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:41.226890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:41.226893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:41.226896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:41.226900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:41.226905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:41.226908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:41.226912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:41.226915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.226919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.226922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.226926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:41.226930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:41.226938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:41.226945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:41.226950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:41.226955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:41.226959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:41.226964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:41.226968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:41.226985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:41.226991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:41.226996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:41.227000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:41.227004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:41.227009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:41.227014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:41.227018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:41.227022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:41.227027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:41.227031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:41.227035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:41.227040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:41.227044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.227048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.227051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.227056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.227063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.227067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.227071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:41.227075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:41.227086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:41.227091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:41.227128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:41.232907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:41.233924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:41.233939Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:41.233942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:41.233947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:41.233955Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1288 [2:7555895537805808335:7960]
2025-09-30T14:53:41.233972Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:41.233990Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:41.233997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:41.234000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:41.234002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:41.234031Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:41.234047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:41.234055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:41.234116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.234124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.234128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.234131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:41.234134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:41.234203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:41.234211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.234225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.234239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.234263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:41.234285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895537805808329:7960]
2025-09-30T14:53:41.234292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895537805808329:7960]
2025-09-30T14:53:41.234294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895537805808329:7960]
2025-09-30T14:53:41.234303Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:41.234314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:41.234317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895537895558156:2454], now have 1 active actors on pipe
2025-09-30T14:53:41.234323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895537895558281:2760], now have 1 active actors on pipe
2025-09-30T14:53:41.234328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:41.234331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:41.234333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:41.234343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:41.234347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:41.234386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895537805808329:7960]
2025-09-30T14:53:41.234398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:41.234426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:41.234537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1288
2025-09-30T14:53:41.234538Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1288
2025-09-30T14:53:41.234619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:41.234631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:41.234660Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe72ea6-8381a0c2-4addc8d8-1f68e39b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:41.234670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:41.234679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:41.234681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:41.234706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:41.234722Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:41.234741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:41.234943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:41.234954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:41.234975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:41.235062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1289 partition: 0 MaxSeqNo: 42 sessionId: src_id|fe72ea6-8381a0c2-4addc8d8-1f68e39b_0
2025-09-30T14:53:41.235504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2993825-e24ea4b3-5ad1eca8-998d3139_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fe72ea6-8381a0c2-4addc8d8-1f68e39b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:41.238286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe72ea6-8381a0c2-4addc8d8-1f68e39b_0] Write session: try to update token
2025-09-30T14:53:41.238304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe72ea6-8381a0c2-4addc8d8-1f68e39b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:41.248145Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:41.248167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:41.248176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895537805808329:7960]
2025-09-30T14:53:41.248223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:41.248226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:41.248405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:41.248560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:41.248716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:41.248869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:41.249070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:41.249113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:41.253834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1289 sessionId: src_id|fe72ea6-8381a0c2-4addc8d8-1f68e39b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:41.256697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:41.256976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:41.256997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:41.257035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:41.257136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:41.259377Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:41.259391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:41.259394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:41.259396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:41.259406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895537805808329:7960]
2025-09-30T14:53:41.259410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895537805808329:7960]
2025-09-30T14:53:41.259414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895537805808329:7960]
2025-09-30T14:53:41.259454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:41.259459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:41.259468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.259469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:41.259472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:41.259472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:41.259612Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:41.311703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895537895558298:3461]
2025-09-30T14:53:41.311977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1288, pipe: [1:7555895537895558298:3461]
2025-09-30T14:53:41.372449Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:41.380400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:41.380428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:41.380612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:41.380682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:41.380754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:41.380824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:41.380875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:41.380884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:41.380954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:41.381018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:41.381090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:41.381164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:41.381219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:41.381227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:41.381300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:41.381367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:41.381436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:41.381516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:41.381561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:41.381568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:41.381638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:41.382035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:41.382107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:41.382175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:41.382219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:41.382230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:41.382300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:41.382367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:41.382437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:41.382507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:41.382556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:41.382564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:41.382636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:41.382700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:41.382766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:41.382831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:41.382881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:41.382888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:41.382960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:41.383026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:41.383092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:41.383161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:41.383211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:41.383218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:41.383312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:41.383380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:41.383449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:41.383514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:41.383561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:41.383568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:41.383635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:41.383702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:41.383771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:41.383839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:41.383889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:41.383897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:41.383967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:41.384036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:41.384104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:41.384169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:41.384217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:41.384224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:41.384286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895537895558298:3461], now have 1 active actors on pipe
2025-09-30T14:53:41.384514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895537895558298:3461]
2025-09-30T14:53:41.384525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:41.384556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:41.384569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:41.384598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1289 reason: error at write: Disconnected sessionId: src_id|fe72ea6-8381a0c2-4addc8d8-1f68e39b_0
2025-09-30T14:53:41.384842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1289 sessionId: src_id|fe72ea6-8381a0c2-4addc8d8-1f68e39b_0 is DEAD
2025-09-30T14:53:41.384989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe72ea6-8381a0c2-4addc8d8-1f68e39b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:41.384997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe72ea6-8381a0c2-4addc8d8-1f68e39b_0] Write session will restart in 0.008470s
2025-09-30T14:53:41.384982Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:41.385032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe72ea6-8381a0c2-4addc8d8-1f68e39b_0] Write session: Do CDS request
2025-09-30T14:53:41.385039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe72ea6-8381a0c2-4addc8d8-1f68e39b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:41.394883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe72ea6-8381a0c2-4addc8d8-1f68e39b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:41.394946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:41.394970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1290
2025-09-30T14:53:41.395128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1290 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:41.395172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1290 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:41.395181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1290 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:41.395186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:41.395638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1290 sessionId:  describe result for acl check
2025-09-30T14:53:41.395680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:41.395687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:41.395689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:41.395696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895537895558385:2753] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:41.395970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:41.396275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895537895558385:2753] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:41.397909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:41.398122Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:41.398134Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:41.398146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:41.398208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:41.398250Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895537805808459:7962]
2025-09-30T14:53:41.398877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895537895558385:2753] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:41.398920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:41.399241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:41.399306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:41.399636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:41.399712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:41.399719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:41.399721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:41.399722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:41.399723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:41.399724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:41.399726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:41.399727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:41.399728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:41.399729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:41.399730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.399731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.399733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.399734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:41.399735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:41.399740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:41.399750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:41.399754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:41.399758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:41.399761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:41.399765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:41.399772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:41.399775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:41.399779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:41.399784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:41.399787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.399791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.399796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.399800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:41.399804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:41.399813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:41.399822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:41.399829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:41.399834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:41.399839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:41.399844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:41.399849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:41.399855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:41.399859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:41.399863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:41.399868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:41.399873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:41.399878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:41.399883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:41.399887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:41.399891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:41.399896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:41.399902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:41.399906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:41.399912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:41.399916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.399921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.399933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.399938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.399944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.399948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.399957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:41.399962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:41.399967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:41.399977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:41.400019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:41.405207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895537895558385:2753] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:41.405230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895537895558385:2753] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:41.405233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895537895558385:2753] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:41.405241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1290 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:41.405531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:41.406380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:41.406398Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:41.406401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:41.406405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:41.406412Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1289 [2:7555895537805808459:7962]
2025-09-30T14:53:41.406429Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:41.406449Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:41.406453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:41.406456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:41.406458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:41.406473Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:41.406480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:41.406488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:41.406546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.406553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.406556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.406559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:41.406562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:41.406627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:41.406637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.406651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.406664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.406683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:41.406709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895537895558425:2753], now have 1 active actors on pipe
2025-09-30T14:53:41.406713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895537895558300:2454], now have 1 active actors on pipe
2025-09-30T14:53:41.406719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895537805808453:7962]
2025-09-30T14:53:41.406722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895537805808453:7962]
2025-09-30T14:53:41.406724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895537805808453:7962]
2025-09-30T14:53:41.406737Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:41.406750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:41.406751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:41.406753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:41.406756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:41.406767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:41.406776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:41.406806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895537805808453:7962]
2025-09-30T14:53:41.406816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:41.406904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1289
2025-09-30T14:53:41.406906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1289
2025-09-30T14:53:41.406839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:41.407012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:41.407020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:41.407052Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85800ca-147b25dc-8e43871e-5e462859_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:41.407060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:41.407067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:41.407076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:41.407090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:41.407108Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:41.407128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:41.407375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:41.407388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:41.407410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:41.408013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1290 partition: 0 MaxSeqNo: 42 sessionId: src_id|85800ca-147b25dc-8e43871e-5e462859_0
2025-09-30T14:53:41.408445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe72ea6-8381a0c2-4addc8d8-1f68e39b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|85800ca-147b25dc-8e43871e-5e462859_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:41.411371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85800ca-147b25dc-8e43871e-5e462859_0] Write session: try to update token
2025-09-30T14:53:41.411390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85800ca-147b25dc-8e43871e-5e462859_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:41.419197Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:41.419218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:41.419228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895537805808453:7962]
2025-09-30T14:53:41.419291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:41.419477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:41.419627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:41.419776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:41.419925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:41.420126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:41.420174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:41.420279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:41.427837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1290 sessionId: src_id|85800ca-147b25dc-8e43871e-5e462859_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:41.430500Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:41.430518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:41.430520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:41.430522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:41.430533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895537805808453:7962]
2025-09-30T14:53:41.430537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895537805808453:7962]
2025-09-30T14:53:41.430541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895537805808453:7962]
2025-09-30T14:53:41.430578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:41.430583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:41.430588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.430591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:41.430592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:41.430595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:41.430577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:41.430731Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:41.484912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895537895558437:3461]
2025-09-30T14:53:41.485207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1289, pipe: [1:7555895537895558437:3461]
2025-09-30T14:53:41.548179Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:41.548571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:41.548586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:41.548605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895537895558437:3461], now have 1 active actors on pipe
2025-09-30T14:53:41.548891Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:41.548873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:41.548892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:41.548895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895537895558437:3461]
2025-09-30T14:53:41.548914Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:41.548971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1290 reason: error at write: Disconnected sessionId: src_id|85800ca-147b25dc-8e43871e-5e462859_0
2025-09-30T14:53:41.549190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1290 sessionId: src_id|85800ca-147b25dc-8e43871e-5e462859_0 is DEAD
2025-09-30T14:53:41.549351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85800ca-147b25dc-8e43871e-5e462859_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:41.549361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85800ca-147b25dc-8e43871e-5e462859_0] Write session will restart in 0.009380s
2025-09-30T14:53:41.549385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85800ca-147b25dc-8e43871e-5e462859_0] Write session: Do CDS request
2025-09-30T14:53:41.549391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85800ca-147b25dc-8e43871e-5e462859_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:41.559770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85800ca-147b25dc-8e43871e-5e462859_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:41.559891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:41.559922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1291
2025-09-30T14:53:41.560070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1291 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:41.560106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1291 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:41.560111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1291 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:41.560115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:41.560602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1291 sessionId:  describe result for acl check
2025-09-30T14:53:41.560639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:41.560649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:41.560651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:41.560657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895537895558509:2748] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:41.561218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895537895558509:2748] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:41.562930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:41.563435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895537895558509:2748] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:41.565230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:41.565446Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:41.565457Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:41.565691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895537895558509:2748] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:41.565703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895537895558509:2748] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:41.565706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895537895558509:2748] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:41.565714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1291 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:41.565477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:41.565536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:41.565572Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895537805808584:7964]
2025-09-30T14:53:41.566264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:41.566546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:41.566587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:41.566903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:41.566957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:41.566964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:41.566965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:41.566967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:41.566968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:41.566969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:41.566970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:41.566971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:41.566973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:41.566974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:41.566975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.566976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.566977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.566978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:41.566979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:41.566985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:41.566994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:41.567011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:41.567014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:41.567018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:41.567022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:41.567026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:41.567029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:41.567032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:41.567036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:41.567039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.567043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.567046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.567049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:41.567053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:41.567060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:41.567068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:41.567074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:41.567079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:41.567083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:41.567088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:41.567092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:41.567096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:41.567101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:41.567106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:41.567110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:41.567115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:41.567119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:41.567124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:41.567128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:41.567132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:41.567137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:41.567142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:41.567146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:41.567152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:41.567157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.567162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.567168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.567173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.567178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.567183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.567187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:41.567194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:41.567198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:41.567203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:41.567261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:41.573716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1290
2025-09-30T14:53:41.573726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1290
2025-09-30T14:53:41.574249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1291 partition: 0 MaxSeqNo: 42 sessionId: src_id|4896bbd6-3f167d0a-3ada76ff-ef4ad1d3_0
2025-09-30T14:53:41.574626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85800ca-147b25dc-8e43871e-5e462859_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4896bbd6-3f167d0a-3ada76ff-ef4ad1d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:41.572535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:41.573362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:41.573369Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:41.573372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:41.573376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:41.573383Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1290 [2:7555895537805808584:7964]
2025-09-30T14:53:41.573398Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:41.573412Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:41.573415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:41.573419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:41.573421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:41.573436Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:41.573443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:41.573451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:41.573503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.573505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.573507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.573510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:41.573512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:41.573579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:41.573582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.573593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.573604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.573620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:41.573636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895537895558445:2454], now have 1 active actors on pipe
2025-09-30T14:53:41.573640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895537895558567:2748], now have 1 active actors on pipe
2025-09-30T14:53:41.573648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895537805808579:7964]
2025-09-30T14:53:41.573651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895537805808579:7964]
2025-09-30T14:53:41.573652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895537805808579:7964]
2025-09-30T14:53:41.573664Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:41.573672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:41.573674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:41.573677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:41.573679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:41.573693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:41.573696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:41.573723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895537805808579:7964]
2025-09-30T14:53:41.573731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:41.573780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:41.573826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:41.573840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:41.573861Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4896bbd6-3f167d0a-3ada76ff-ef4ad1d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:41.573869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:41.573872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:41.573877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:41.573886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:41.573895Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:41.573907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:41.574046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:41.574048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:41.574061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:41.577293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4896bbd6-3f167d0a-3ada76ff-ef4ad1d3_0] Write session: try to update token
2025-09-30T14:53:41.577311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4896bbd6-3f167d0a-3ada76ff-ef4ad1d3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:41.592272Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:41.592291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:41.592302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895537805808579:7964]
2025-09-30T14:53:41.592350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:41.592356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:41.592532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:41.592687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:41.592843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:41.593015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:41.593216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:41.593258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:41.594436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1291 sessionId: src_id|4896bbd6-3f167d0a-3ada76ff-ef4ad1d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:41.596499Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:41.596515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:41.596518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:41.596520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:41.596529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895537805808579:7964]
2025-09-30T14:53:41.596533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895537805808579:7964]
2025-09-30T14:53:41.596538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895537805808579:7964]
2025-09-30T14:53:41.596572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:41.596579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.596584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:41.596585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:41.596591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:41.596596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:41.596723Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:41.597123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:41.649109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895537895558579:3461]
2025-09-30T14:53:41.649483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1290, pipe: [1:7555895537895558579:3461]
2025-09-30T14:53:41.712938Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:41.713374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:41.713392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:41.713428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895537895558579:3461], now have 1 active actors on pipe
2025-09-30T14:53:41.713642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:41.713663Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:41.713655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895537895558579:3461]
2025-09-30T14:53:41.713678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:41.713681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:41.713753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1291 reason: error at write: Disconnected sessionId: src_id|4896bbd6-3f167d0a-3ada76ff-ef4ad1d3_0
2025-09-30T14:53:41.713965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1291 sessionId: src_id|4896bbd6-3f167d0a-3ada76ff-ef4ad1d3_0 is DEAD
2025-09-30T14:53:41.714113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4896bbd6-3f167d0a-3ada76ff-ef4ad1d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:41.714125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4896bbd6-3f167d0a-3ada76ff-ef4ad1d3_0] Write session will restart in 0.009586s
2025-09-30T14:53:41.714152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4896bbd6-3f167d0a-3ada76ff-ef4ad1d3_0] Write session: Do CDS request
2025-09-30T14:53:41.714160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4896bbd6-3f167d0a-3ada76ff-ef4ad1d3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:41.724813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4896bbd6-3f167d0a-3ada76ff-ef4ad1d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:41.724920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:41.724938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1292
2025-09-30T14:53:41.725065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1292 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:41.725106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1292 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:41.725117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1292 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:41.725122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:41.725560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1292 sessionId:  describe result for acl check
2025-09-30T14:53:41.725598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:41.725606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:41.725608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:41.725613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895537895558666:2740] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:41.726243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895537895558666:2740] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:41.727001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:41.728352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895537895558666:2740] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:41.729190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:41.729398Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:41.729409Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:41.729419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:41.729470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:41.729509Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895537805808712:7967]
2025-09-30T14:53:41.730204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:41.730575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:41.730623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:41.730961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:41.731024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:41.731030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:41.731031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:41.731032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:41.731034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:41.731035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:41.731037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:41.731037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:41.731039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:41.731040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:41.731041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.731043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.731044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.731045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:41.731046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:41.731052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:41.731063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:41.731069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:41.731074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:41.731079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:41.731084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:41.731089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:41.731094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:41.731098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:41.731104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:41.731108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.731113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.731118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.731122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:41.731127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:41.731135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:41.731145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:41.731151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:41.731158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:41.731166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:41.731172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:41.731179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:41.731185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:41.731190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:41.731197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:41.731204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:41.731190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895537895558666:2740] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:41.731210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:41.731221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:41.731207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895537895558666:2740] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:41.731226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:41.731212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895537895558666:2740] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:41.731231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:41.731221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1292 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:41.731237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:41.731257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:41.731264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:41.731269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:41.731276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:41.731281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.731287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.731292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.731303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.731313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.731319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.731328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:41.731333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:41.731340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:41.731356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:41.731413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:41.736978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:41.737927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:41.737946Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:41.737950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:41.737954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:41.737962Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1291 [2:7555895537805808712:7967]
2025-09-30T14:53:41.737980Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:41.737996Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:41.738000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:41.738003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:41.738019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:41.738035Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:41.738043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:41.738050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:41.738112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.738123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.738125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.738129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:41.738132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:41.738201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:41.738210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.738223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.738240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.738266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:41.738289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895537895558581:2454], now have 1 active actors on pipe
2025-09-30T14:53:41.738299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895537895558704:2740], now have 1 active actors on pipe
2025-09-30T14:53:41.738306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895537805808707:7967]
2025-09-30T14:53:41.738309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895537805808707:7967]
2025-09-30T14:53:41.738312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895537805808707:7967]
2025-09-30T14:53:41.738324Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:41.738338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:41.738341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:41.738345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:41.738348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:41.738355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:41.738358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:41.738391Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1291
2025-09-30T14:53:41.738464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1291
2025-09-30T14:53:41.738523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895537805808707:7967]
2025-09-30T14:53:41.738543Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:41.738572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:41.738583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:41.738588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:41.738627Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e34d4679-6e143c13-77e0b23f-6967cfa2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:41.738642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:41.738646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:41.738648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:41.738658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:41.738668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:41.738690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:41.738939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:41.738954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:41.738991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:41.739115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1292 partition: 0 MaxSeqNo: 42 sessionId: src_id|e34d4679-6e143c13-77e0b23f-6967cfa2_0
2025-09-30T14:53:41.739580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4896bbd6-3f167d0a-3ada76ff-ef4ad1d3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e34d4679-6e143c13-77e0b23f-6967cfa2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:41.742548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e34d4679-6e143c13-77e0b23f-6967cfa2_0] Write session: try to update token
2025-09-30T14:53:41.742570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e34d4679-6e143c13-77e0b23f-6967cfa2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:41.750975Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:41.750998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:41.751001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:41.751003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:41.751013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895537805808707:7967]
2025-09-30T14:53:41.751017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895537805808707:7967]
2025-09-30T14:53:41.751021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895537805808707:7967]
2025-09-30T14:53:41.751065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:41.751072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.751073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:41.751074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:41.751078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:41.751087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:41.751207Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:41.759216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1292 sessionId: src_id|e34d4679-6e143c13-77e0b23f-6967cfa2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:41.761951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:41.813960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895537895558714:3461]
2025-09-30T14:53:41.814257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1291, pipe: [1:7555895537895558714:3461]
2025-09-30T14:53:41.866987Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:41.867308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:41.867321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:41.867338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895537895558714:3461], now have 1 active actors on pipe
2025-09-30T14:53:41.867533Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:41.867592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:41.867604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:41.867608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:41.867651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895537895558714:3461]
2025-09-30T14:53:41.867679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1292 reason: error at write: Disconnected sessionId: src_id|e34d4679-6e143c13-77e0b23f-6967cfa2_0
2025-09-30T14:53:41.867886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1292 sessionId: src_id|e34d4679-6e143c13-77e0b23f-6967cfa2_0 is DEAD
2025-09-30T14:53:41.868157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e34d4679-6e143c13-77e0b23f-6967cfa2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:41.868174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e34d4679-6e143c13-77e0b23f-6967cfa2_0] Write session will restart in 0.007451s
2025-09-30T14:53:41.868206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e34d4679-6e143c13-77e0b23f-6967cfa2_0] Write session: Do CDS request
2025-09-30T14:53:41.868214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e34d4679-6e143c13-77e0b23f-6967cfa2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:41.878959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:41.879773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e34d4679-6e143c13-77e0b23f-6967cfa2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:41.879878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:41.879896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1293
2025-09-30T14:53:41.880041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1293 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:41.880070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1293 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:41.880079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1293 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:41.880083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:41.880566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1293 sessionId:  describe result for acl check
2025-09-30T14:53:41.880601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:41.880610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:41.880612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:41.880618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895537895558805:2737] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:41.880884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:41.881067Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:41.881076Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:41.881086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:41.881130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:41.881144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895537895558805:2737] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:41.881166Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895537805808838:7969]
2025-09-30T14:53:41.881804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:41.882182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:41.882257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:41.882624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:41.882722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:41.882729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:41.882731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:41.882732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:41.882733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:41.882735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:41.882736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:41.882737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:41.882738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:41.882740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:41.882741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.882743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.882744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.882745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:41.882746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:41.882752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:41.882762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:41.882767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:41.882771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:41.882775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:41.882780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:41.882784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:41.882788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:41.882792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:41.882797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:41.882801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.882805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.882809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.882814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:41.882818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:41.882826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:41.882835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:41.882841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:41.882847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:41.882852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:41.882858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:41.882862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:41.882874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:41.882879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:41.882884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:41.882889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:41.882895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:41.882900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:41.882911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:41.882916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:41.882923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:41.882932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:41.882937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:41.882947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:41.882952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:41.882959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.882964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.882969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.882975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.882979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.882985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.882989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:41.882994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:41.883003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:41.883009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:41.883060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:41.883270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895537895558805:2737] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:41.888089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895537895558805:2737] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:41.888106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895537895558805:2737] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:41.888110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895537895558805:2737] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:41.888118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1293 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:41.888469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:41.889363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:41.889383Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:41.889385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:41.889389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:41.889396Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1292 [2:7555895537805808838:7969]
2025-09-30T14:53:41.889412Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:41.889427Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:41.889436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:41.889439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:41.889441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:41.889456Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:41.889467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:41.889473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:41.889532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.889540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.889543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.889546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:41.889549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:41.889613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:41.889621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.889635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:41.889654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:41.889677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:41.889700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895537895558716:2454], now have 1 active actors on pipe
2025-09-30T14:53:41.889711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895537895558842:2737], now have 1 active actors on pipe
2025-09-30T14:53:41.889717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895537805808832:7969]
2025-09-30T14:53:41.889720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895537805808832:7969]
2025-09-30T14:53:41.889722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895537805808832:7969]
2025-09-30T14:53:41.889735Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:41.889748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:41.889748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:41.889752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:41.889754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:41.889769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:41.889772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:41.889758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1292
2025-09-30T14:53:41.889770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1292
2025-09-30T14:53:41.889802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895537805808832:7969]
2025-09-30T14:53:41.889816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:41.889822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:41.889832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:41.889837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:41.889888Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5dd192e7-b0275014-a0c437c6-cd8af8d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:41.889900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:41.889909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:41.889912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:41.889921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:41.889935Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:41.889959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:41.890150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:41.890165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:41.890192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:41.890283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1293 partition: 0 MaxSeqNo: 42 sessionId: src_id|5dd192e7-b0275014-a0c437c6-cd8af8d0_0
2025-09-30T14:53:41.890664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e34d4679-6e143c13-77e0b23f-6967cfa2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5dd192e7-b0275014-a0c437c6-cd8af8d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:41.893499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd192e7-b0275014-a0c437c6-cd8af8d0_0] Write session: try to update token
2025-09-30T14:53:41.893518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd192e7-b0275014-a0c437c6-cd8af8d0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:41.902430Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:41.902454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:41.902457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:41.902459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:41.902470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895537805808832:7969]
2025-09-30T14:53:41.902475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895537805808832:7969]
2025-09-30T14:53:41.902480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895537805808832:7969]
2025-09-30T14:53:41.902525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:41.902540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:41.902540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:41.902544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:41.902549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:41.902553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:41.902705Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:41.908517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1293 sessionId: src_id|5dd192e7-b0275014-a0c437c6-cd8af8d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:41.911330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:41.968054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895537895558850:3461]
2025-09-30T14:53:41.968407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1292, pipe: [1:7555895537895558850:3461]
2025-09-30T14:53:42.018487Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:42.018966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:42.018980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:42.019018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895537895558850:3461], now have 1 active actors on pipe
2025-09-30T14:53:42.019256Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:42.019354Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:42.019403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:42.019413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895537895558850:3461]
2025-09-30T14:53:42.019508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1293 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5dd192e7-b0275014-a0c437c6-cd8af8d0_0
2025-09-30T14:53:42.019711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1293 sessionId: src_id|5dd192e7-b0275014-a0c437c6-cd8af8d0_0 is DEAD
2025-09-30T14:53:42.019854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd192e7-b0275014-a0c437c6-cd8af8d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:42.019863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd192e7-b0275014-a0c437c6-cd8af8d0_0] Write session will restart in 0.009155s
2025-09-30T14:53:42.019898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd192e7-b0275014-a0c437c6-cd8af8d0_0] Write session: Do CDS request
2025-09-30T14:53:42.019904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd192e7-b0275014-a0c437c6-cd8af8d0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:42.029780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd192e7-b0275014-a0c437c6-cd8af8d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:42.029887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:42.029915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1294
2025-09-30T14:53:42.030086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1294 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:42.030118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1294 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:42.030128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1294 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:42.030132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:42.030565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1294 sessionId:  describe result for acl check
2025-09-30T14:53:42.030605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:42.030611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:42.030613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:42.030619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895542190526236:2733] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:42.030639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:42.031143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895542190526236:2733] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:42.032638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:42.032835Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:42.032845Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:42.032855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:42.032915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:42.032955Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895542100776261:7971]
2025-09-30T14:53:42.033559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895542190526236:2733] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:42.033585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:42.033885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:42.033930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:42.034278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:42.034341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:42.034343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:42.034344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:42.034344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:42.034346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:42.034347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:42.034348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:42.034349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:42.034350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:42.034351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:42.034352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.034354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.034355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.034356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:42.034357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:42.034362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:42.034372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:42.034376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:42.034380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:42.034383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:42.034387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:42.034391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:42.034395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:42.034399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:42.034403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:42.034407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.034410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.034414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.034417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:42.034421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:42.034427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:42.034435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:42.034441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:42.034446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:42.034451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:42.034457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:42.034461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:42.034465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:42.034469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:42.034474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:42.034479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:42.034483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:42.034487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:42.034493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:42.034497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:42.034503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:42.034508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:42.034515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:42.034519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:42.034524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:42.034528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.034534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.034538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.034544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.034548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.034553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.034557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:42.034562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:42.034567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:42.034572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:42.034613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:42.039683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895542190526236:2733] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:42.039713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895542190526236:2733] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:42.039719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895542190526236:2733] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:42.039727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1294 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:42.040026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:42.040885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:42.040900Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:42.040903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:42.040907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:42.040915Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1293 [2:7555895542100776261:7971]
2025-09-30T14:53:42.040930Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:42.040944Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:42.040947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:42.040950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:42.040953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:42.040968Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:42.040974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:42.040980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:42.041041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.041049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.041051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.041055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:42.041057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:42.041115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:42.041123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.041135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.041152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.041175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:42.041200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895542190526148:2454], now have 1 active actors on pipe
2025-09-30T14:53:42.041209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895542190526281:2733], now have 1 active actors on pipe
2025-09-30T14:53:42.041216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895542100776255:7971]
2025-09-30T14:53:42.041218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895542100776255:7971]
2025-09-30T14:53:42.041221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895542100776255:7971]
2025-09-30T14:53:42.041237Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:42.041255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:42.041275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:42.041285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:42.041271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1293
2025-09-30T14:53:42.041279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1293
2025-09-30T14:53:42.041316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895542100776255:7971]
2025-09-30T14:53:42.041324Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:42.041359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:42.041368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:42.041370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:42.041377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:42.041461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:42.041467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:42.041490Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1886242a-fd54116f-347c2c86-774eb590_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:42.041497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:42.041500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:42.041503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:42.041514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:42.041523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:42.041535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:42.041804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:42.041814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:42.041828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:42.041928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1294 partition: 0 MaxSeqNo: 42 sessionId: src_id|1886242a-fd54116f-347c2c86-774eb590_0
2025-09-30T14:53:42.042372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd192e7-b0275014-a0c437c6-cd8af8d0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1886242a-fd54116f-347c2c86-774eb590_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:42.045093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1886242a-fd54116f-347c2c86-774eb590_0] Write session: try to update token
2025-09-30T14:53:42.045111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1886242a-fd54116f-347c2c86-774eb590_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:42.060820Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:42.060839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:42.060842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:42.060844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:42.060853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895542100776255:7971]
2025-09-30T14:53:42.060858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895542100776255:7971]
2025-09-30T14:53:42.060867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895542100776255:7971]
2025-09-30T14:53:42.060907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:42.060911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:42.060914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.060916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:42.060918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:42.060935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:42.061049Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:42.069349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1294 sessionId: src_id|1886242a-fd54116f-347c2c86-774eb590_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:42.072254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:42.119597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895542190526313:3461]
2025-09-30T14:53:42.119975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1293, pipe: [1:7555895542190526313:3461]
2025-09-30T14:53:42.187038Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:42.187439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:42.187457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:42.187478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895542190526313:3461], now have 1 active actors on pipe
2025-09-30T14:53:42.187723Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:42.188164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895542190526313:3461]
2025-09-30T14:53:42.188197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:42.188224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:42.188652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1886242a-fd54116f-347c2c86-774eb590_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:42.188664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1886242a-fd54116f-347c2c86-774eb590_0] Write session will restart in 0.006297s
2025-09-30T14:53:42.188687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1886242a-fd54116f-347c2c86-774eb590_0] Write session: Do CDS request
2025-09-30T14:53:42.188693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1886242a-fd54116f-347c2c86-774eb590_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:42.188301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1294 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1886242a-fd54116f-347c2c86-774eb590_0
2025-09-30T14:53:42.188480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1294 sessionId: src_id|1886242a-fd54116f-347c2c86-774eb590_0 is DEAD
2025-09-30T14:53:42.195740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1886242a-fd54116f-347c2c86-774eb590_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:42.195836Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:42.195853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1295
2025-09-30T14:53:42.195976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1295 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:42.196006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1295 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:42.196011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1295 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:42.196015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:42.196412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1295 sessionId:  describe result for acl check
2025-09-30T14:53:42.196438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:42.196440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:42.196442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:42.196448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895542190526330:2714] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:42.197027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895542190526330:2714] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:42.199419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895542190526330:2714] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:42.202352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:42.202770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895542190526330:2714] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:42.202786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895542190526330:2714] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:42.202790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895542190526330:2714] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:42.202799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1295 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:42.204396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:42.204723Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:42.204737Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:42.204749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:42.204812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:42.204852Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895542100776440:7986]
2025-09-30T14:53:42.205470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:42.205757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:42.205804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:42.206147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:42.206207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:42.206213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:42.206214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:42.206215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:42.206216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:42.206218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:42.206219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:42.206220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:42.206222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:42.206223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:42.206225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.206226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.206227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.206228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:42.206229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:42.206234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:42.206244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:42.206249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:42.206253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:42.206257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:42.206261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:42.206265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:42.206269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:42.206274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:42.206279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:42.206283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.206287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.206291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.206295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:42.206299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:42.206306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:42.206315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:42.206321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:42.206327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:42.206331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:42.206338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:42.206342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:42.206347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:42.206352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:42.206357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:42.206361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:42.206367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:42.206372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:42.206377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:42.206381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:42.206386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:42.206390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:42.206396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:42.206401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:42.206406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:42.206412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.206423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.206428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.206432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.206443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.206451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.206459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:42.206465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:42.206471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:42.206481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:42.206524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:42.212510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:42.213466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:42.213483Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:42.213485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:42.213489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:42.213496Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1294 [2:7555895542100776440:7986]
2025-09-30T14:53:42.213511Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:42.213527Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:42.213530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:42.213533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:42.213535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:42.213553Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:42.213559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:42.213568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:42.213631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.213639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.213644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.213649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:42.213652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:42.213718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:42.213727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.213739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.213750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.213767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:42.213786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895542190526439:2714], now have 1 active actors on pipe
2025-09-30T14:53:42.213790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895542190526315:2454], now have 1 active actors on pipe
2025-09-30T14:53:42.213796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895542100776426:7986]
2025-09-30T14:53:42.213800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895542100776426:7986]
2025-09-30T14:53:42.213802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895542100776426:7986]
2025-09-30T14:53:42.213815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:42.213827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:42.213829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:42.213837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:42.213840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:42.213843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:42.213846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:42.213882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895542100776426:7986]
2025-09-30T14:53:42.213900Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:42.213906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:42.213937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:42.213941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:42.213971Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41456489-f856eab1-d5b397cd-63bc7048_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:42.213985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:42.213990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:42.213993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:42.214002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:42.214025Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:42.213882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1294
2025-09-30T14:53:42.213897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1294
2025-09-30T14:53:42.214043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:42.214207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:42.214216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:42.214232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:42.214322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1295 partition: 0 MaxSeqNo: 42 sessionId: src_id|41456489-f856eab1-d5b397cd-63bc7048_0
2025-09-30T14:53:42.214743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1886242a-fd54116f-347c2c86-774eb590_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|41456489-f856eab1-d5b397cd-63bc7048_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:42.217494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41456489-f856eab1-d5b397cd-63bc7048_0] Write session: try to update token
2025-09-30T14:53:42.217514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41456489-f856eab1-d5b397cd-63bc7048_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:42.226405Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:42.226426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:42.226429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:42.226434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:42.226446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895542100776426:7986]
2025-09-30T14:53:42.226450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895542100776426:7986]
2025-09-30T14:53:42.226454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895542100776426:7986]
2025-09-30T14:53:42.226493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:42.226499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.226502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:42.226502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:42.226509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:42.226513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:42.226641Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:42.238756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1295 sessionId: src_id|41456489-f856eab1-d5b397cd-63bc7048_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:42.241732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:42.288586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895542190526462:3461]
2025-09-30T14:53:42.288960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1294, pipe: [1:7555895542190526462:3461]
2025-09-30T14:53:42.340382Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:42.340743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:42.340761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:42.340781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895542190526462:3461], now have 1 active actors on pipe
2025-09-30T14:53:42.340999Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:42.341077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:42.341096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:42.341105Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:42.341157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895542190526462:3461]
2025-09-30T14:53:42.341169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1295 reason: error at write: Disconnected sessionId: src_id|41456489-f856eab1-d5b397cd-63bc7048_0
2025-09-30T14:53:42.341379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1295 sessionId: src_id|41456489-f856eab1-d5b397cd-63bc7048_0 is DEAD
2025-09-30T14:53:42.341507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41456489-f856eab1-d5b397cd-63bc7048_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:42.341517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41456489-f856eab1-d5b397cd-63bc7048_0] Write session will restart in 0.005117s
2025-09-30T14:53:42.341541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41456489-f856eab1-d5b397cd-63bc7048_0] Write session: Do CDS request
2025-09-30T14:53:42.341548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41456489-f856eab1-d5b397cd-63bc7048_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:42.347761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41456489-f856eab1-d5b397cd-63bc7048_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:42.347821Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:42.347840Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1296
2025-09-30T14:53:42.348123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1296 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:42.348152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1296 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:42.348157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1296 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:42.348161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:42.348639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1296 sessionId:  describe result for acl check
2025-09-30T14:53:42.348667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:42.348672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:42.348673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:42.348679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895542190526479:2703] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:42.349225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895542190526479:2703] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:42.351888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895542190526479:2703] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:42.353960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:42.355904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:42.356109Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:42.356121Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:42.356131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:42.356197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:42.356236Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895542100776568:7989]
2025-09-30T14:53:42.356087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895542190526479:2703] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:42.356104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895542190526479:2703] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:42.356109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895542190526479:2703] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:42.356120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1296 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:42.356926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:42.357619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:42.357674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:42.358028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:42.358119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:42.358126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:42.358127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:42.358128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:42.358130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:42.358131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:42.358132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:42.358134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:42.358135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:42.358136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:42.358137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.358139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.358140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.358141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:42.358142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:42.358149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:42.358159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:42.358164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:42.358169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:42.358173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:42.358177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:42.358181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:42.358186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:42.358190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:42.358195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:42.358199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.358203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.358207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.358212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:42.358216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:42.358224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:42.358233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:42.358239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:42.358245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:42.358250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:42.358255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:42.358260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:42.358265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:42.358270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:42.358276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:42.358281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:42.358287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:42.358292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:42.358308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:42.358313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:42.358319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:42.358324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:42.358329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:42.358335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:42.358340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:42.358345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.358350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.358355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.358361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.358365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.358371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.358376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:42.358381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:42.358386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:42.358391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:42.358440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:42.364144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:42.365236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:42.365255Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:42.365258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:42.365263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:42.365269Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1295 [2:7555895542100776568:7989]
2025-09-30T14:53:42.365286Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:42.365300Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:42.365303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:42.365307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:42.365310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:42.365327Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:42.365341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:42.365349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:42.365411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.365418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.365421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.365424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:42.365427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:42.365494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:42.365506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.365519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.365533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.365549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:42.365569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895542190526590:2703], now have 1 active actors on pipe
2025-09-30T14:53:42.365578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895542190526464:2454], now have 1 active actors on pipe
2025-09-30T14:53:42.365584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895542100776563:7989]
2025-09-30T14:53:42.365587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895542100776563:7989]
2025-09-30T14:53:42.365590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895542100776563:7989]
2025-09-30T14:53:42.365605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:42.365618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:42.365623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:42.365627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:42.365630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:42.365639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:42.365642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:42.365672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895542100776563:7989]
2025-09-30T14:53:42.365679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:42.365684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:42.365657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1295
2025-09-30T14:53:42.365656Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1295
2025-09-30T14:53:42.365717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:42.365727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:42.365760Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61f3d8e0-7a18a8a-a2670894-4240790a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:42.365770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:42.365773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:42.365775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:42.365785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:42.365794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:42.365811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:42.365924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:42.365933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:42.365947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:42.366138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1296 partition: 0 MaxSeqNo: 42 sessionId: src_id|61f3d8e0-7a18a8a-a2670894-4240790a_0
2025-09-30T14:53:42.366521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41456489-f856eab1-d5b397cd-63bc7048_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|61f3d8e0-7a18a8a-a2670894-4240790a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:42.369317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61f3d8e0-7a18a8a-a2670894-4240790a_0] Write session: try to update token
2025-09-30T14:53:42.369335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61f3d8e0-7a18a8a-a2670894-4240790a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:42.378912Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:42.378935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:42.378937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:42.378939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:42.378949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895542100776563:7989]
2025-09-30T14:53:42.378954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895542100776563:7989]
2025-09-30T14:53:42.378958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895542100776563:7989]
2025-09-30T14:53:42.379005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:42.379009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:42.379017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:42.379017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.379020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:42.379025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:42.379167Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:42.384483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1296 sessionId: src_id|61f3d8e0-7a18a8a-a2670894-4240790a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:42.387178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:42.443239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895542190526601:3461]
2025-09-30T14:53:42.443703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1295, pipe: [1:7555895542190526601:3461]
2025-09-30T14:53:42.499585Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:42.499901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:42.499917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:42.499959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895542190526601:3461], now have 1 active actors on pipe
2025-09-30T14:53:42.500230Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:42.500237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:42.500248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895542190526601:3461]
2025-09-30T14:53:42.500256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:42.500270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:42.500318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1296 reason: error at write: Disconnected sessionId: src_id|61f3d8e0-7a18a8a-a2670894-4240790a_0
2025-09-30T14:53:42.500506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1296 sessionId: src_id|61f3d8e0-7a18a8a-a2670894-4240790a_0 is DEAD
2025-09-30T14:53:42.500685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61f3d8e0-7a18a8a-a2670894-4240790a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:42.500695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61f3d8e0-7a18a8a-a2670894-4240790a_0] Write session will restart in 0.005989s
2025-09-30T14:53:42.500728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61f3d8e0-7a18a8a-a2670894-4240790a_0] Write session: Do CDS request
2025-09-30T14:53:42.500750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61f3d8e0-7a18a8a-a2670894-4240790a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:42.507819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61f3d8e0-7a18a8a-a2670894-4240790a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:42.508133Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:42.508151Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1297
2025-09-30T14:53:42.508283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1297 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:42.508319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1297 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:42.508329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1297 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:42.508334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:42.508770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1297 sessionId:  describe result for acl check
2025-09-30T14:53:42.508813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:42.508820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:42.508822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:42.508828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895542190526628:2704] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:42.509388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895542190526628:2704] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:42.513198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895542190526628:2704] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:42.514787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:42.516623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:42.516844Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:42.516856Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:42.516867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:42.516922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:42.516959Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895542100776698:7991]
2025-09-30T14:53:42.517649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:42.517935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:42.517984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:42.518335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:42.518408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:42.518414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:42.518415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:42.518416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:42.518418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:42.518419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:42.518421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:42.518422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:42.518424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:42.518425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:42.518427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.518428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.518430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.518431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:42.518432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:42.518438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:42.518449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:42.518454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:42.518459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:42.518463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:42.518468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:42.518472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:42.518477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:42.518482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:42.518487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:42.518492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.518496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.518500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.518505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:42.518509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:42.518517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:42.518525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:42.518531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:42.518538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:42.518543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:42.518549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:42.518554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:42.518560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:42.518566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:42.518571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:42.518581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:42.518587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:42.518598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:42.518604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:42.518613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:42.518619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:42.518624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:42.518630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:42.518636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:42.518643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:42.518648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.518659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.518664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.518674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.518680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.518690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.518695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:42.518701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:42.518711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:42.518717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:42.518770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:42.519652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895542190526628:2704] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:42.519673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895542190526628:2704] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:42.519677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895542190526628:2704] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:42.519685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1297 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:42.524802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:42.525704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:42.525721Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:42.525724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:42.525730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:42.525738Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1296 [2:7555895542100776698:7991]
2025-09-30T14:53:42.525755Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:42.525771Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:42.525774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:42.525777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:42.525780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:42.525797Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:42.525805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:42.525818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:42.525883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.525894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.525896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.525900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:42.525902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:42.525969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:42.525977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.525991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.526023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.526048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:42.526068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895542190526736:2704], now have 1 active actors on pipe
2025-09-30T14:53:42.526077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895542190526603:2454], now have 1 active actors on pipe
2025-09-30T14:53:42.526084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895542100776693:7991]
2025-09-30T14:53:42.526086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895542100776693:7991]
2025-09-30T14:53:42.526089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895542100776693:7991]
2025-09-30T14:53:42.526101Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:42.526118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:42.526117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:42.526121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:42.526123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:42.526141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:42.526144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:42.526180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895542100776693:7991]
2025-09-30T14:53:42.526193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:42.526210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:42.526251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:42.526265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:42.526294Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6653b44c-cecdcd39-fc6f1e91-b5de8222_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:42.526306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:42.526309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:42.526312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:42.526321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:42.526331Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:42.526350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:42.526494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:42.526501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:42.526514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:42.527010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61f3d8e0-7a18a8a-a2670894-4240790a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6653b44c-cecdcd39-fc6f1e91-b5de8222_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:42.526192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1296
2025-09-30T14:53:42.526193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1296
2025-09-30T14:53:42.526603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1297 partition: 0 MaxSeqNo: 42 sessionId: src_id|6653b44c-cecdcd39-fc6f1e91-b5de8222_0
2025-09-30T14:53:42.529968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6653b44c-cecdcd39-fc6f1e91-b5de8222_0] Write session: try to update token
2025-09-30T14:53:42.529987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6653b44c-cecdcd39-fc6f1e91-b5de8222_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:42.540680Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:42.540699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:42.540709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895542100776693:7991]
2025-09-30T14:53:42.540761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:42.540764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:42.540966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:42.541119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:42.541268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:42.541413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:42.541769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:42.541809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:42.546986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1297 sessionId: src_id|6653b44c-cecdcd39-fc6f1e91-b5de8222_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:42.549741Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:42.549756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:42.549761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:42.549763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:42.549765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:42.549776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895542100776693:7991]
2025-09-30T14:53:42.549781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895542100776693:7991]
2025-09-30T14:53:42.549785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895542100776693:7991]
2025-09-30T14:53:42.549829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:42.549836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.549839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:42.549846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:42.549852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:42.549857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:42.549976Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:42.600408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895542190526743:3461]
2025-09-30T14:53:42.600758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1296, pipe: [1:7555895542190526743:3461]
2025-09-30T14:53:42.667148Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:42.667632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:42.667648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:42.667669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895542190526743:3461], now have 1 active actors on pipe
2025-09-30T14:53:42.667896Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:42.668460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6653b44c-cecdcd39-fc6f1e91-b5de8222_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:42.668471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6653b44c-cecdcd39-fc6f1e91-b5de8222_0] Write session will restart in 0.006425s
2025-09-30T14:53:42.668495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6653b44c-cecdcd39-fc6f1e91-b5de8222_0] Write session: Do CDS request
2025-09-30T14:53:42.668501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6653b44c-cecdcd39-fc6f1e91-b5de8222_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:42.667998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:42.668001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:42.668019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:42.668065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895542190526743:3461]
2025-09-30T14:53:42.668102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1297 reason: error at write: Disconnected sessionId: src_id|6653b44c-cecdcd39-fc6f1e91-b5de8222_0
2025-09-30T14:53:42.668307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1297 sessionId: src_id|6653b44c-cecdcd39-fc6f1e91-b5de8222_0 is DEAD
2025-09-30T14:53:42.675778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6653b44c-cecdcd39-fc6f1e91-b5de8222_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:42.676238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:42.676256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1298
2025-09-30T14:53:42.676395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1298 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:42.676424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1298 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:42.676429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1298 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:42.676434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:42.676865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1298 sessionId:  describe result for acl check
2025-09-30T14:53:42.676903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:42.676906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:42.676908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:42.676914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895542190526760:2700] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:42.677481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895542190526760:2700] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:42.680556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895542190526760:2700] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:42.683431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:42.683549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895542190526760:2700] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:42.683568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895542190526760:2700] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:42.683571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895542190526760:2700] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:42.683580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1298 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:42.685649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:42.685849Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:42.685861Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:42.685872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:42.685927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:42.685969Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895542100776832:7994]
2025-09-30T14:53:42.686626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:42.687004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:42.687056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:42.687337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:42.687416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:42.687425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:42.687426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:42.687427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:42.687429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:42.687430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:42.687431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:42.687433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:42.687434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:42.687435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:42.687437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.687438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.687439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.687440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:42.687442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:42.687447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:42.687457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:42.687461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:42.687466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:42.687470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:42.687473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:42.687477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:42.687480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:42.687484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:42.687488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:42.687491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.687503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.687507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.687511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:42.687514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:42.687522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:42.687530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:42.687536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:42.687542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:42.687547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:42.687552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:42.687557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:42.687563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:42.687568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:42.687574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:42.687578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:42.687583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:42.687586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:42.687589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:42.687591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:42.687594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:42.687597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:42.687600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:42.687604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:42.687607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:42.687610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.687613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.687615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.687618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.687621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.687624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.687626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:42.687629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:42.687634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:42.687639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:42.687681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:42.693349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:42.694285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:42.694301Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:42.694303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:42.694307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:42.694312Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1297 [2:7555895542100776832:7994]
2025-09-30T14:53:42.694325Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:42.694338Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:42.694340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:42.694342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:42.694343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:42.694357Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:42.694364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:42.694371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:42.694425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.694434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.694436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.694440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:42.694442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:42.694496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:42.694501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.694510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.694523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.694544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:42.694562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895542100776826:7994]
2025-09-30T14:53:42.694565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895542100776826:7994]
2025-09-30T14:53:42.694567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895542100776826:7994]
2025-09-30T14:53:42.694575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:42.694585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:42.694589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895542190526745:2454], now have 1 active actors on pipe
2025-09-30T14:53:42.694594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:42.694596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:42.694598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:42.694603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:42.694606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:42.694613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895542190526874:2700], now have 1 active actors on pipe
2025-09-30T14:53:42.694642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895542100776826:7994]
2025-09-30T14:53:42.694655Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:42.694693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:42.694693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1297
2025-09-30T14:53:42.694717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1297
2025-09-30T14:53:42.694832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:42.694841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:42.694861Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d8c9ab3-89d81a74-7a915dbe-afd3272b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:42.694872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:42.694876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:42.694878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:42.694888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:42.694896Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:42.694911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:42.695031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:42.695038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:42.695052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:42.695240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1298 partition: 0 MaxSeqNo: 42 sessionId: src_id|2d8c9ab3-89d81a74-7a915dbe-afd3272b_0
2025-09-30T14:53:42.695670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6653b44c-cecdcd39-fc6f1e91-b5de8222_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2d8c9ab3-89d81a74-7a915dbe-afd3272b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:42.698584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d8c9ab3-89d81a74-7a915dbe-afd3272b_0] Write session: try to update token
2025-09-30T14:53:42.698604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d8c9ab3-89d81a74-7a915dbe-afd3272b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:42.708752Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:42.708771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:42.708781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895542100776826:7994]
2025-09-30T14:53:42.708831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:42.708841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:42.709070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:42.709367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:42.709673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:42.709930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:42.710341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:42.710410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:42.715781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1298 sessionId: src_id|2d8c9ab3-89d81a74-7a915dbe-afd3272b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:42.718770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:42.719841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:42.719869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:42.719889Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:42.719892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:42.719895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:42.719897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:42.719906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895542100776826:7994]
2025-09-30T14:53:42.719910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895542100776826:7994]
2025-09-30T14:53:42.719914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895542100776826:7994]
2025-09-30T14:53:42.719959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:42.719965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:42.719966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:42.719971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:42.719972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.719975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:42.720116Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:42.767832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895542190526885:3461]
2025-09-30T14:53:42.768383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1297, pipe: [1:7555895542190526885:3461]
2025-09-30T14:53:42.836060Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:42.836495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:42.836528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895542190526885:3461], now have 1 active actors on pipe
2025-09-30T14:53:42.836855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:42.836939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:42.836968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:42.836972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:42.836977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895542190526885:3461]
2025-09-30T14:53:42.837050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1298 reason: error at write: Disconnected sessionId: src_id|2d8c9ab3-89d81a74-7a915dbe-afd3272b_0
2025-09-30T14:53:42.837194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1298 sessionId: src_id|2d8c9ab3-89d81a74-7a915dbe-afd3272b_0 is DEAD
2025-09-30T14:53:42.839496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d8c9ab3-89d81a74-7a915dbe-afd3272b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:42.839508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d8c9ab3-89d81a74-7a915dbe-afd3272b_0] Write session will restart in 0.006425s
2025-09-30T14:53:42.839533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d8c9ab3-89d81a74-7a915dbe-afd3272b_0] Write session: Do CDS request
2025-09-30T14:53:42.839539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d8c9ab3-89d81a74-7a915dbe-afd3272b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:42.846784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d8c9ab3-89d81a74-7a915dbe-afd3272b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:42.846895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:42.846914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1299
2025-09-30T14:53:42.847190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1299 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:42.847238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1299 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:42.847261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1299 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:42.847273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:42.848377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1299 sessionId:  describe result for acl check
2025-09-30T14:53:42.848418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:42.848420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:42.848422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:42.848428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895542190526969:2696] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:42.848982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895542190526969:2696] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:42.850730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:42.852250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895542190526969:2696] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:42.854051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:42.854257Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:42.854270Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:42.854282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:42.854341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:42.854382Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895542100776963:7996]
2025-09-30T14:53:42.855099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:42.855481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:42.855522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:42.855870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:42.855943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:42.855950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:42.855951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:42.855953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:42.855954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:42.855955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:42.855957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:42.855958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:42.855959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:42.855961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:42.855962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.855963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.855965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.855966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:42.855967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:42.855973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:42.855984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:42.855988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:42.855992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:42.855996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:42.856000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:42.856004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:42.856009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:42.856013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:42.856020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:42.856024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.856029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.856033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.856038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:42.856042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:42.856050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:42.856059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:42.856065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:42.856072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:42.856077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:42.856083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:42.856088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:42.856094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:42.856100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:42.856112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:42.856118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:42.856123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:42.856133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:42.856138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:42.856148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:42.856154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:42.856159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:42.856170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:42.856175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:42.856181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:42.856191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.856196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.856201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.856211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.856216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.856222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.856227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:42.856232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:42.856255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:42.856260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:42.856313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:42.859832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895542190526969:2696] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:42.859853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895542190526969:2696] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:42.859856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895542190526969:2696] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:42.859864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1299 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:42.862664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:42.863616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:42.863633Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:42.863636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:42.863641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:42.863648Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1298 [2:7555895542100776963:7996]
2025-09-30T14:53:42.863666Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:42.863683Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:42.863691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:42.863695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:42.863698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:42.863714Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:42.863725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:42.863733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:42.863803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.863810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.863812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.863816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:42.863819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:42.863885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:42.863895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.863909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:42.863920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:42.863949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:42.863967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895542190527021:2696], now have 1 active actors on pipe
2025-09-30T14:53:42.863971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895542190526887:2454], now have 1 active actors on pipe
2025-09-30T14:53:42.863978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895542100776957:7996]
2025-09-30T14:53:42.863980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895542100776957:7996]
2025-09-30T14:53:42.863982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895542100776957:7996]
2025-09-30T14:53:42.863997Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:42.864011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:42.864011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:42.864014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:42.864016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:42.864031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:42.864034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:42.864068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895542100776957:7996]
2025-09-30T14:53:42.864079Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:42.864083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:42.864106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1298
2025-09-30T14:53:42.864154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1298
2025-09-30T14:53:42.864289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:42.864302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:42.864332Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c58c0c40-54de5a4b-2ec7ce3c-8f625ab2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:42.864344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:42.864348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:42.864350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:42.864360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:42.864371Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:42.864388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:42.864570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:42.864581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:42.864599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:42.864927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1299 partition: 0 MaxSeqNo: 42 sessionId: src_id|c58c0c40-54de5a4b-2ec7ce3c-8f625ab2_0
2025-09-30T14:53:42.865527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d8c9ab3-89d81a74-7a915dbe-afd3272b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c58c0c40-54de5a4b-2ec7ce3c-8f625ab2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:42.868513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c58c0c40-54de5a4b-2ec7ce3c-8f625ab2_0] Write session: try to update token
2025-09-30T14:53:42.868535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c58c0c40-54de5a4b-2ec7ce3c-8f625ab2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:42.877152Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:42.877178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:42.877180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:42.877182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:42.877197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895542100776957:7996]
2025-09-30T14:53:42.877202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895542100776957:7996]
2025-09-30T14:53:42.877210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895542100776957:7996]
2025-09-30T14:53:42.877253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:42.877261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:42.877264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:42.877265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:42.877276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:42.877283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:42.877407Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:42.888589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1299 sessionId: src_id|c58c0c40-54de5a4b-2ec7ce3c-8f625ab2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:42.891419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:42.937298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895542190527028:3461]
2025-09-30T14:53:42.937678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1298, pipe: [1:7555895542190527028:3461]
2025-09-30T14:53:42.997832Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:42.998164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:42.998173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:42.998193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895542190527028:3461], now have 1 active actors on pipe
2025-09-30T14:53:42.998420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:42.998437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:42.998500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1299 reason: error at write: Disconnected sessionId: src_id|c58c0c40-54de5a4b-2ec7ce3c-8f625ab2_0
2025-09-30T14:53:42.998506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895542190527028:3461]
2025-09-30T14:53:42.998528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:42.998459Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:42.998739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1299 sessionId: src_id|c58c0c40-54de5a4b-2ec7ce3c-8f625ab2_0 is DEAD
2025-09-30T14:53:43.003354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c58c0c40-54de5a4b-2ec7ce3c-8f625ab2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:43.003368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c58c0c40-54de5a4b-2ec7ce3c-8f625ab2_0] Write session will restart in 0.009544s
2025-09-30T14:53:43.003392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c58c0c40-54de5a4b-2ec7ce3c-8f625ab2_0] Write session: Do CDS request
2025-09-30T14:53:43.003400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c58c0c40-54de5a4b-2ec7ce3c-8f625ab2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:43.015683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c58c0c40-54de5a4b-2ec7ce3c-8f625ab2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:43.015828Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:43.015847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1300
2025-09-30T14:53:43.015959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1300 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:43.015991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1300 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:43.016001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1300 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:43.016006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:43.016468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1300 sessionId:  describe result for acl check
2025-09-30T14:53:43.016513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:43.016515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:43.016518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:43.016523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895546485494422:2691] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:43.017093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895546485494422:2691] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:43.013192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:43.015392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:43.015614Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:43.015618Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:43.015630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:43.015694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:43.015728Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895546395744392:7998]
2025-09-30T14:53:43.016374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:43.016837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:43.016883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:43.017178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:43.017244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:43.017245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:43.017247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:43.017248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:43.017249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:43.017250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:43.019327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895546485494422:2691] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:43.017252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:43.017253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:43.017254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:43.017255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:43.017256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.017257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.017258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.017259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:43.017261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:43.017266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:43.017276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:43.017279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:43.017283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:43.017286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:43.017291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:43.017294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:43.017298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:43.017302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:43.017306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:43.017310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.017313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.017316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.017320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:43.017323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:43.017330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:43.017338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:43.017345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:43.017350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:43.017354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:43.017359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:43.017363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:43.017369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:43.017374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:43.017379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:43.017383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:43.017388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:43.017395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:43.017400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:43.017404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:43.017409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:43.017413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:43.017420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:43.017424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:43.017429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:43.017433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.017438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.017442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.017447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.017451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.017455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.017459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:43.017464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:43.017468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:43.017472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:43.017531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:43.023360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895546485494422:2691] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:43.023379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895546485494422:2691] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:43.023383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895546485494422:2691] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:43.023392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1300 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:43.025163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1299
2025-09-30T14:53:43.025164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1299
2025-09-30T14:53:43.025676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1300 partition: 0 MaxSeqNo: 42 sessionId: src_id|60a13353-cede7ed0-d6a580fb-528ac483_0
2025-09-30T14:53:43.026090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c58c0c40-54de5a4b-2ec7ce3c-8f625ab2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|60a13353-cede7ed0-d6a580fb-528ac483_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:43.023786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:43.024760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:43.024767Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:43.024770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:43.024775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:43.024783Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1299 [2:7555895546395744392:7998]
2025-09-30T14:53:43.024801Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:43.024817Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:43.024821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:43.024825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:43.024827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:43.024845Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:43.024853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:43.024860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:43.024926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.024928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.024931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.024935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:43.024938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:43.025009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:43.025012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.025026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.025039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.025058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:43.025074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895546395744387:7998]
2025-09-30T14:53:43.025077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895546395744387:7998]
2025-09-30T14:53:43.025079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895546395744387:7998]
2025-09-30T14:53:43.025087Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:43.025098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:43.025102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:43.025105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:43.025106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895542190527030:2454], now have 1 active actors on pipe
2025-09-30T14:53:43.025112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:43.025129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:43.025132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:43.025138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895546485494460:2691], now have 1 active actors on pipe
2025-09-30T14:53:43.025170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895546395744387:7998]
2025-09-30T14:53:43.025179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:43.025210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:43.025263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:43.025268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:43.025293Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60a13353-cede7ed0-d6a580fb-528ac483_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:43.025301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:43.025305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:43.025308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:43.025317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:43.025326Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:43.025341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:43.025514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:43.025521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:43.025546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:43.029082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60a13353-cede7ed0-d6a580fb-528ac483_0] Write session: try to update token
2025-09-30T14:53:43.029101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60a13353-cede7ed0-d6a580fb-528ac483_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:43.040511Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:43.040533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:43.040543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895546395744387:7998]
2025-09-30T14:53:43.040592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:43.040602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:43.040771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:43.040909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:43.041043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:43.041191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:43.041384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:43.041419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:43.051058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1300 sessionId: src_id|60a13353-cede7ed0-d6a580fb-528ac483_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:43.052184Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:43.052204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:43.052206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:43.052208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:43.052218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895546395744387:7998]
2025-09-30T14:53:43.052223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895546395744387:7998]
2025-09-30T14:53:43.052227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895546395744387:7998]
2025-09-30T14:53:43.052271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:43.052281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.052290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:43.052435Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:43.053067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:43.053082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:43.053086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:43.054025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:43.098581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895546485494475:3461]
2025-09-30T14:53:43.098949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1299, pipe: [1:7555895546485494475:3461]
2025-09-30T14:53:43.182917Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:43.183392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:43.183410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:43.183431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895546485494475:3461], now have 1 active actors on pipe
2025-09-30T14:53:43.183663Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:43.183904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895546485494475:3461]
2025-09-30T14:53:43.183942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:43.184009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:43.184099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1300 reason: status is not ok: tablet will be restarted right now sessionId: src_id|60a13353-cede7ed0-d6a580fb-528ac483_0
2025-09-30T14:53:43.184333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1300 sessionId: src_id|60a13353-cede7ed0-d6a580fb-528ac483_0 is DEAD
2025-09-30T14:53:43.187459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a13353-cede7ed0-d6a580fb-528ac483_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:43.187472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a13353-cede7ed0-d6a580fb-528ac483_0] Write session will restart in 0.006800s
2025-09-30T14:53:43.187508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a13353-cede7ed0-d6a580fb-528ac483_0] Write session: Do CDS request
2025-09-30T14:53:43.187515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a13353-cede7ed0-d6a580fb-528ac483_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:43.195800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60a13353-cede7ed0-d6a580fb-528ac483_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:43.195931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:43.195951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1301
2025-09-30T14:53:43.196085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1301 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:43.196112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1301 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:43.196118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1301 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:43.196122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:43.196728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1301 sessionId:  describe result for acl check
2025-09-30T14:53:43.196755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:43.196758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:43.196760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:43.196766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895546485494580:2669] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:43.197304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895546485494580:2669] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:43.198882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:43.199278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895546485494580:2669] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:43.200949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:43.201174Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:43.201183Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:43.201195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:43.201251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:43.201299Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895546395744563:8013]
2025-09-30T14:53:43.201926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:43.202238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:43.202295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:43.202202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895546485494580:2669] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:43.202221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895546485494580:2669] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:43.202225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895546485494580:2669] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:43.202233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1301 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:43.202649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:43.202713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:43.202720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:43.202721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:43.202722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:43.202723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:43.202724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:43.202725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:43.202726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:43.202727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:43.202728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:43.202730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.202731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.202732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.202733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:43.202734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:43.202740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:43.202749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:43.202752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:43.202756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:43.202759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:43.202762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:43.202766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:43.202770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:43.202774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:43.202779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:43.202783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.202787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.202791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.202795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:43.202799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:43.202807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:43.202814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:43.202820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:43.202825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:43.202831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:43.202836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:43.202840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:43.202846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:43.202851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:43.202857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:43.202861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:43.202866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:43.202871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:43.202877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:43.202887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:43.202893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:43.202898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:43.202903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:43.202911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:43.202917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:43.202921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.202926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.202931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.202936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.202941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.202946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.202950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:43.202959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:43.202963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:43.202969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:43.203016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:43.208658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:43.209717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:43.209733Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:43.209736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:43.209740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:43.209747Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1300 [2:7555895546395744563:8013]
2025-09-30T14:53:43.209763Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:43.209779Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:43.209790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:43.209794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:43.209796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:43.209812Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:43.209824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:43.209830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:43.209889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.209897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.209899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.209902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:43.209905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:43.209970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:43.209977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.209990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.210025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.210048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:43.210072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895546485494505:2454], now have 1 active actors on pipe
2025-09-30T14:53:43.210080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895546485494635:2669], now have 1 active actors on pipe
2025-09-30T14:53:43.210087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895546395744558:8013]
2025-09-30T14:53:43.210089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895546395744558:8013]
2025-09-30T14:53:43.210092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895546395744558:8013]
2025-09-30T14:53:43.210107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:43.210124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:43.210135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:43.210144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:43.210145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:43.210147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:43.210148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:43.210137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1300
2025-09-30T14:53:43.210150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1300
2025-09-30T14:53:43.210183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895546395744558:8013]
2025-09-30T14:53:43.210193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:43.210195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:43.210219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:43.210228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:43.210264Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|382c5d66-4d2d68c4-6042a9f7-7d9ef220_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:43.210276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:43.210279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:43.210281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:43.210290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:43.210301Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:43.210322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:43.210467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:43.210478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:43.210508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:43.210578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1301 partition: 0 MaxSeqNo: 42 sessionId: src_id|382c5d66-4d2d68c4-6042a9f7-7d9ef220_0
2025-09-30T14:53:43.210959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a13353-cede7ed0-d6a580fb-528ac483_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|382c5d66-4d2d68c4-6042a9f7-7d9ef220_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:43.213788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|382c5d66-4d2d68c4-6042a9f7-7d9ef220_0] Write session: try to update token
2025-09-30T14:53:43.213808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|382c5d66-4d2d68c4-6042a9f7-7d9ef220_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:43.223773Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:43.223791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:43.223794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:43.223797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:43.223807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895546395744558:8013]
2025-09-30T14:53:43.223812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895546395744558:8013]
2025-09-30T14:53:43.223816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895546395744558:8013]
2025-09-30T14:53:43.223855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:43.223867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.223870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:43.224022Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:43.227540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:43.227562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:43.227567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:43.230797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1301 sessionId: src_id|382c5d66-4d2d68c4-6042a9f7-7d9ef220_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:43.233862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:43.283906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895546485494656:3461]
2025-09-30T14:53:43.284169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1300, pipe: [1:7555895546485494656:3461]
2025-09-30T14:53:43.340536Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:43.340954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:43.340974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:43.340996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895546485494656:3461], now have 1 active actors on pipe
2025-09-30T14:53:43.341231Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:43.341270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:43.341310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895546485494656:3461]
2025-09-30T14:53:43.341329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:43.341334Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:53:43.341400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1301 reason: status is not ok: tablet will be restarted right now sessionId: src_id|382c5d66-4d2d68c4-6042a9f7-7d9ef220_0
2025-09-30T14:53:43.341457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1301 sessionId: src_id|382c5d66-4d2d68c4-6042a9f7-7d9ef220_0 is DEAD
2025-09-30T14:53:43.341548Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 13 consumer shared/user session shared/user_1_13_7105340681634718141_v1 is DEAD
2025-09-30T14:53:43.341710Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895477766002245:3460] disconnected; active server actors: 1
2025-09-30T14:53:43.341730Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895477766002245:3460] client user disconnected session shared/user_1_13_7105340681634718141_v1
2025-09-30T14:53:43.343552Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:53:43.343663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|382c5d66-4d2d68c4-6042a9f7-7d9ef220_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:43.343676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|382c5d66-4d2d68c4-6042a9f7-7d9ef220_0] Write session will restart in 0.007514s
2025-09-30T14:53:43.343703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|382c5d66-4d2d68c4-6042a9f7-7d9ef220_0] Write session: Do CDS request
2025-09-30T14:53:43.343709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|382c5d66-4d2d68c4-6042a9f7-7d9ef220_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:43.343727Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:53:43.343733Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:53:43.343740Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.006848s
2025-09-30T14:53:43.351612Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:53:43.351895Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:53:43.351911Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 14
2025-09-30T14:53:43.352291Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 14 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:53:43.352346Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:53:43.352460Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 auth for : user
2025-09-30T14:53:43.352695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|382c5d66-4d2d68c4-6042a9f7-7d9ef220_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:43.352693Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:43.352701Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1302
2025-09-30T14:53:43.352727Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 Handle describe topics response
2025-09-30T14:53:43.352751Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 auth is DEAD
2025-09-30T14:53:43.352753Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:53:43.352902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1302 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:43.352934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1302 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:43.352944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1302 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:43.352948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:43.353019Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:53:43.353095Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895546485494756:2665] connected; active server actors: 1
2025-09-30T14:53:43.353104Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_14_6350084907575744875_v1
2025-09-30T14:53:43.353106Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555895546485494756:2665] session shared/user_1_14_6350084907575744875_v1
2025-09-30T14:53:43.353130Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:53:43.353143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:53:43.353150Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_14_6350084907575744875_v1" (Sender=[1:7555895546485494732:2665], Pipe=[1:7555895546485494756:2665], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:53:43.353159Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:53:43.353170Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:53:43.353178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_14_6350084907575744875_v1" (Sender=[1:7555895546485494732:2665], Pipe=[1:7555895546485494756:2665], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:53:43.353188Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_14_6350084907575744875_v1" sender [1:7555895546485494732:2665] lock partition 0 for ReadingSession "shared/user_1_14_6350084907575744875_v1" (Sender=[1:7555895546485494732:2665], Pipe=[1:7555895546485494756:2665], Partitions=[], ActiveFamilyCount=1) generation 1 step 14
2025-09-30T14:53:43.353203Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:53:43.353208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000036s
2025-09-30T14:53:43.353252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1302 sessionId:  describe result for acl check
2025-09-30T14:53:43.353278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:43.353285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:43.353287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:43.353292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895546485494759:2660] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:43.353422Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 14 Session: "shared/user_1_14_6350084907575744875_v1" ClientId: "user" PipeClient { RawX1: 7555895546485494756 RawX2: 4503603922340457 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:53:43.353442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:53:43.353818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895546485494759:2660] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:43.354312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:43.355941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895546485494759:2660] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:43.356279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:43.356475Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:43.356488Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:43.356499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:43.356550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:43.356611Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895546395744710:8016]
2025-09-30T14:53:43.357320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:43.357791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:43.357845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:43.358197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:43.358262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:43.358268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:43.358270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:43.358271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:43.358272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:43.358273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:43.358275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:43.358276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:43.358277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:43.358278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:43.358279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.358280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.358281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.358282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:43.358284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:43.358289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:43.358299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:43.358303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:43.358307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:43.358311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:43.358315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:43.358319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:43.358323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:43.358327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:43.358332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:43.358336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.358340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.358344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.358347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:43.358351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:43.358357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:43.358364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:43.358370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:43.358375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:43.358380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:43.358400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:43.358406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:43.358412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:43.358417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:43.358423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:43.358428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:43.358434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:43.358439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:43.358451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:43.358456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:43.358466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:43.358472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:43.358478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:43.358488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:43.358494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:43.358503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.358509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.358514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.358525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.358530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.358541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.358546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:43.358557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:43.358563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:43.358573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:43.358625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:43.358993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895546485494759:2660] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:43.359009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895546485494759:2660] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:43.359013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895546485494759:2660] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:43.359022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1302 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:43.364351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:43.365492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:43.365515Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:43.365517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:43.365522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:43.365528Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1301 [2:7555895546395744710:8016]
2025-09-30T14:53:43.365545Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:43.365562Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:43.365565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:43.365568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:43.365570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:43.365588Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:43.365594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:43.365601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:43.365662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.365672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.365674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.365678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:43.365681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:43.365749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:43.365760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.365775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.365787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.365818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:43.365839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895546395744705:8016]
2025-09-30T14:53:43.365850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895546395744705:8016]
2025-09-30T14:53:43.365852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895546395744705:8016]
2025-09-30T14:53:43.365861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:43.365871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:43.365875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895546485494801:2660], now have 1 active actors on pipe
2025-09-30T14:53:43.365875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:43.365877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:43.365880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895546485494762:2659], now have 1 active actors on pipe
2025-09-30T14:53:43.365883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895546485494659:2454], now have 1 active actors on pipe
2025-09-30T14:53:43.365891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:43.365906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:43.365909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:43.365924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1301
2025-09-30T14:53:43.365969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1301, pipe: [1:7555895546485494762:2659]
2025-09-30T14:53:43.366014Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1301
2025-09-30T14:53:43.365944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895546395744705:8016]
2025-09-30T14:53:43.365947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:43.365985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:43.365990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:43.366027Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc850877-d2436508-3370743b-4f330200_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:43.366034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:43.366037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:43.366039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:43.366048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:43.366057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:43.366074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:43.366076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:43.366081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_14_6350084907575744875_v1 on pipe: [1:7555895546485494762:2659]
2025-09-30T14:53:43.366104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:43.366117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:43.366119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:43.366121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:43.366123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:43.366123Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_14_6350084907575744875_v1:1 with generation 1301
2025-09-30T14:53:43.366135Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_14_6350084907575744875_v1
2025-09-30T14:53:43.366137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:43.366158Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:53:43.366356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:43.366368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:43.366391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:43.366559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1302 partition: 0 MaxSeqNo: 42 sessionId: src_id|bc850877-d2436508-3370743b-4f330200_0
2025-09-30T14:53:43.367027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|382c5d66-4d2d68c4-6042a9f7-7d9ef220_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bc850877-d2436508-3370743b-4f330200_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:43.369515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:53:43.369562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:53:43.369572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:43.369575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:43.369578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:43.369587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:53:43.369599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:53:43.369785Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759244023365 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:53:43.369808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:53:43.369845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc850877-d2436508-3370743b-4f330200_0] Write session: try to update token
2025-09-30T14:53:43.369840Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 sending to client partition status
2025-09-30T14:53:43.369873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc850877-d2436508-3370743b-4f330200_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:43.379183Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:43.379200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:43.379203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:43.379205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:43.379215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895546395744705:8016]
2025-09-30T14:53:43.379219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895546395744705:8016]
2025-09-30T14:53:43.379224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895546395744705:8016]
2025-09-30T14:53:43.379278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:43.379286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.379291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:43.379318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:43.379336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:43.379341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:43.379436Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:43.391973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1302 sessionId: src_id|bc850877-d2436508-3370743b-4f330200_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:43.394649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:43.496807Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:43.497119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:43.497128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:43.497408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_14_6350084907575744875_v1
2025-09-30T14:53:43.497432Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:43.497462Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_14_6350084907575744875_v1
2025-09-30T14:53:43.497855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc850877-d2436508-3370743b-4f330200_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:43.497863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc850877-d2436508-3370743b-4f330200_0] Write session will restart in 0.009426s
2025-09-30T14:53:43.497885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc850877-d2436508-3370743b-4f330200_0] Write session: Do CDS request
2025-09-30T14:53:43.497891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc850877-d2436508-3370743b-4f330200_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:43.497408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:43.497421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895546485494762:2659]
2025-09-30T14:53:43.497423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:43.497442Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:43.497489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1302 reason: error at write: Disconnected sessionId: src_id|bc850877-d2436508-3370743b-4f330200_0
2025-09-30T14:53:43.497676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1302 sessionId: src_id|bc850877-d2436508-3370743b-4f330200_0 is DEAD
2025-09-30T14:53:43.508813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc850877-d2436508-3370743b-4f330200_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:43.508899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:43.508919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1303
2025-09-30T14:53:43.509056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1303 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:43.509091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1303 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:43.509097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1303 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:43.509102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:43.509548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1303 sessionId:  describe result for acl check
2025-09-30T14:53:43.509581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:43.509584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:43.509586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:43.509591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895546485494908:2655] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:43.510193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895546485494908:2655] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:43.510520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:43.512383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895546485494908:2655] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:43.512859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:43.513105Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:43.513116Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:43.513126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:43.513186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:43.513227Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895546395744847:8018]
2025-09-30T14:53:43.513937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:43.514279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:43.514324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:43.514682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:43.514745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:43.514756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:43.514758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:43.514759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:43.514761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:43.514762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:43.514763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:43.514765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:43.514767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:43.514768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:43.514769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.514771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.514772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.514773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:43.514775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:43.514781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:43.514792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:43.514797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:43.514802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:43.514807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:43.514812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:43.514816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:43.514821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:43.514825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:43.514829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:43.514834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.514838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.514843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.514848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:43.514852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:43.514860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:43.514869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:43.514876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:43.514882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:43.514887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:43.514893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:43.514899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:43.514905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:43.514911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:43.514916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:43.514921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:43.514928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:43.514939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:43.514944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:43.514949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:43.514955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:43.514960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:43.514966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:43.514975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:43.514981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:43.514987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.514998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.515003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.515013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.515018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.515030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.515039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:43.515045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:43.515054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:43.515060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:43.515111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:43.515592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895546485494908:2655] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:43.515610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895546485494908:2655] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:43.515613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895546485494908:2655] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:43.515622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1303 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:43.520593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:43.521511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:43.521533Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:43.521535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:43.521540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:43.521547Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1302 [2:7555895546395744847:8018]
2025-09-30T14:53:43.521565Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:43.521583Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:43.521586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:43.521589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:43.521592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:43.521609Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:43.521621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:43.521634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:43.521693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.521704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.521706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.521710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:43.521713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:43.521787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:43.521796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.521811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.521832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.521851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:43.521871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895546485494948:2655], now have 1 active actors on pipe
2025-09-30T14:53:43.521881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895546485494811:2454], now have 1 active actors on pipe
2025-09-30T14:53:43.521888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895546395744842:8018]
2025-09-30T14:53:43.521890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895546395744842:8018]
2025-09-30T14:53:43.521892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895546395744842:8018]
2025-09-30T14:53:43.521905Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:43.521920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:43.521929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:43.521937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:43.521941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:43.521947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:43.521950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:43.521975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895546395744842:8018]
2025-09-30T14:53:43.521979Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:43.521949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1302
2025-09-30T14:53:43.521988Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1302
2025-09-30T14:53:43.521994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:43.522025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:43.522030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:43.522058Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|354dab22-9207428-16ad8ee6-f8c847a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:43.522071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:43.522080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:43.522083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:43.522092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:43.522106Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:43.522127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:43.522285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:43.522294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:43.522308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:43.522422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1303 partition: 0 MaxSeqNo: 42 sessionId: src_id|354dab22-9207428-16ad8ee6-f8c847a_0
2025-09-30T14:53:43.522752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc850877-d2436508-3370743b-4f330200_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|354dab22-9207428-16ad8ee6-f8c847a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:43.525651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|354dab22-9207428-16ad8ee6-f8c847a_0] Write session: try to update token
2025-09-30T14:53:43.525671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|354dab22-9207428-16ad8ee6-f8c847a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:43.535030Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:43.535053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:43.535056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:43.535059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:43.535069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895546395744842:8018]
2025-09-30T14:53:43.535074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895546395744842:8018]
2025-09-30T14:53:43.535079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895546395744842:8018]
2025-09-30T14:53:43.535123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:43.535130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.535135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:43.535136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:43.535143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:43.535148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:43.535299Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:43.540392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1303 sessionId: src_id|354dab22-9207428-16ad8ee6-f8c847a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:43.543328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:43.597778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895546485494957:2659]
2025-09-30T14:53:43.598305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1302, pipe: [1:7555895546485494957:2659]
2025-09-30T14:53:43.657767Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:43.658314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:43.658330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:43.658368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895546485494957:2659], now have 1 active actors on pipe
2025-09-30T14:53:43.658655Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:43.658624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895546485494957:2659]
2025-09-30T14:53:43.658634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:43.658638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:43.658670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:43.658699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1303 reason: error at write: Disconnected sessionId: src_id|354dab22-9207428-16ad8ee6-f8c847a_0
2025-09-30T14:53:43.658884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1303 sessionId: src_id|354dab22-9207428-16ad8ee6-f8c847a_0 is DEAD
2025-09-30T14:53:43.659085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|354dab22-9207428-16ad8ee6-f8c847a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:43.659097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|354dab22-9207428-16ad8ee6-f8c847a_0] Write session will restart in 0.005367s
2025-09-30T14:53:43.659121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|354dab22-9207428-16ad8ee6-f8c847a_0] Write session: Do CDS request
2025-09-30T14:53:43.659130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|354dab22-9207428-16ad8ee6-f8c847a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:43.667719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|354dab22-9207428-16ad8ee6-f8c847a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:43.668023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:43.668041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1304
2025-09-30T14:53:43.671093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1304 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:43.671142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1304 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:43.671148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1304 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:43.671153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:43.671732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1304 sessionId:  describe result for acl check
2025-09-30T14:53:43.671769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:43.671771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:43.671773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:43.671780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895546485495059:2648] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:43.672308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895546485495059:2648] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:43.671260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:43.674192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:43.674380Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:43.674384Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:43.674395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:43.674445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:43.675194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895546485495059:2648] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:43.674482Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895546395744985:8021]
2025-09-30T14:53:43.675140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:43.675447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:43.675497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:43.675840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:43.675901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:43.675908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:43.675909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:43.675910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:43.675912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:43.675913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:43.675914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:43.675916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:43.675917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:43.675918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:43.675920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.675921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.675922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.675924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:43.675925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:43.675930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:43.675941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:43.675946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:43.675951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:43.675956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:43.675961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:43.675966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:43.675970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:43.675975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:43.675981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:43.675985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.675989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.675993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.675998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:43.676002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:43.676009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:43.676018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:43.676024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:43.676031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:43.676036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:43.676046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:43.676052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:43.676058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:43.676065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:43.676071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:43.676081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:43.676087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:43.676092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:43.676102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:43.676106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:43.676112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:43.676121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:43.676127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:43.676132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:43.676143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:43.676148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.676154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.676159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.676164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.676170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.676180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.676185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:43.676196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:43.676201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:43.676208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:43.676258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:43.682061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:43.681884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895546485495059:2648] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:43.681906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895546485495059:2648] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:43.681910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895546485495059:2648] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:43.681920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1304 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:43.683640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1303
2025-09-30T14:53:43.683676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1303
2025-09-30T14:53:43.684448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1304 partition: 0 MaxSeqNo: 42 sessionId: src_id|157133c0-66c8a744-3a5fc032-83325016_0
2025-09-30T14:53:43.684856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|354dab22-9207428-16ad8ee6-f8c847a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|157133c0-66c8a744-3a5fc032-83325016_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:43.683096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:43.683113Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:43.683116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:43.683120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:43.683127Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1303 [2:7555895546395744985:8021]
2025-09-30T14:53:43.683142Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:43.683156Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:43.683159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:43.683162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:43.683166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:43.683181Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:43.683188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:43.683195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:43.683274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.683277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.683279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.683283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:43.683286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:43.683364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:43.683366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.683380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.683392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.683408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:43.683424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895546395744980:8021]
2025-09-30T14:53:43.683427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895546395744980:8021]
2025-09-30T14:53:43.683429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895546395744980:8021]
2025-09-30T14:53:43.683437Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:43.683451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:43.683467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:43.683470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:43.683501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895546395744980:8021]
2025-09-30T14:53:43.683504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:43.683515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:43.683519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:43.683521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:43.683528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:43.683542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895546485494958:2454], now have 1 active actors on pipe
2025-09-30T14:53:43.683546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895546485495096:2648], now have 1 active actors on pipe
2025-09-30T14:53:43.683838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:43.683844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:43.683871Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|157133c0-66c8a744-3a5fc032-83325016_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:43.683883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:43.683887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:43.683890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:43.683901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:43.683913Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:43.683927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:43.684115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:43.684120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:43.684141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:43.687845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|157133c0-66c8a744-3a5fc032-83325016_0] Write session: try to update token
2025-09-30T14:53:43.687865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|157133c0-66c8a744-3a5fc032-83325016_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:43.698046Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:43.698073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:43.698075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:43.698077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:43.698087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895546395744980:8021]
2025-09-30T14:53:43.698092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895546395744980:8021]
2025-09-30T14:53:43.698096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895546395744980:8021]
2025-09-30T14:53:43.698140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:43.698147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.698151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:43.698164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:43.698172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:43.698177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:43.698289Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:43.706115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1304 sessionId: src_id|157133c0-66c8a744-3a5fc032-83325016_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:43.708918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:43.755473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895546485495104:2659]
2025-09-30T14:53:43.755978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1303, pipe: [1:7555895546485495104:2659]
2025-09-30T14:53:43.820150Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:43.820456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:43.820470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:43.820507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895546485495104:2659], now have 1 active actors on pipe
2025-09-30T14:53:43.820843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:43.820853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895546485495104:2659]
2025-09-30T14:53:43.820882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:43.820885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:43.820906Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:43.820944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1304 reason: error at write: Disconnected sessionId: src_id|157133c0-66c8a744-3a5fc032-83325016_0
2025-09-30T14:53:43.821305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|157133c0-66c8a744-3a5fc032-83325016_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:43.821317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|157133c0-66c8a744-3a5fc032-83325016_0] Write session will restart in 0.007121s
2025-09-30T14:53:43.821348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|157133c0-66c8a744-3a5fc032-83325016_0] Write session: Do CDS request
2025-09-30T14:53:43.821354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|157133c0-66c8a744-3a5fc032-83325016_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:43.821146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1304 sessionId: src_id|157133c0-66c8a744-3a5fc032-83325016_0 is DEAD
2025-09-30T14:53:43.829758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|157133c0-66c8a744-3a5fc032-83325016_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:43.829818Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:43.829845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1305
2025-09-30T14:53:43.830177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1305 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:43.830229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1305 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:43.830236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1305 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:43.830253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:43.831054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1305 sessionId:  describe result for acl check
2025-09-30T14:53:43.831091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:43.831093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:43.831095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:43.831103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895546485495130:2640] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:43.831757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895546485495130:2640] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:43.834265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895546485495130:2640] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:43.840160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895546485495130:2640] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:43.840178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895546485495130:2640] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:43.840182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895546485495130:2640] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:43.840191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1305 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:43.843582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:43.847043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:43.847285Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:43.847295Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:43.847309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:43.847373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:43.847416Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895546395745123:8023]
2025-09-30T14:53:43.848074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:43.848514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:43.848584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:43.848939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:43.849004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:43.849012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:43.849013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:43.849015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:43.849016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:43.849017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:43.849019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:43.849020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:43.849022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:43.849023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:43.849025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.849026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.849027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.849028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:43.849030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:43.849036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:43.849047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:43.849052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:43.849056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:43.849061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:43.849065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:43.849070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:43.849074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:43.849078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:43.849083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:43.849087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.849091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.849096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.849100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:43.849104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:43.849112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:43.849121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:43.849127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:43.849133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:43.849138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:43.849144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:43.849150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:43.849156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:43.849161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:43.849166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:43.849171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:43.849177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:43.849182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:43.849187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:43.849192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:43.849197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:43.849204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:43.849210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:43.849220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:43.849226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:43.849231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.849239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.849244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.849249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.849255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.849265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.849271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:43.849281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:43.849286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:43.849292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:43.849340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:43.855202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:43.856192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:43.856210Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:43.856214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:43.856218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:43.856226Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1304 [2:7555895546395745123:8023]
2025-09-30T14:53:43.856244Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:43.856261Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:43.856270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:43.856274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:43.856276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:43.856293Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:43.856301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:43.856312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:43.856375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.856382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.856384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.856388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:43.856391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:43.856461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:43.856470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.856485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:43.856503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:43.856526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:43.856549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895546395745116:8023]
2025-09-30T14:53:43.856556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895546395745116:8023]
2025-09-30T14:53:43.856559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895546395745116:8023]
2025-09-30T14:53:43.856571Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:43.856584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:43.856590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895546485495239:2640], now have 1 active actors on pipe
2025-09-30T14:53:43.856595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895546485495105:2454], now have 1 active actors on pipe
2025-09-30T14:53:43.856602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:43.856606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:43.856609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:43.856616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:43.856619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:43.856657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895546395745116:8023]
2025-09-30T14:53:43.856673Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:43.856675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1304
2025-09-30T14:53:43.856720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1304
2025-09-30T14:53:43.856698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:43.857062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:43.857076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:43.857118Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92980fc-baf78146-ba384086-f10acdef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:43.857131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:43.857135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:43.857138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:43.857148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:43.857159Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:43.857175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:43.857368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:43.857378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:43.857393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:43.857488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1305 partition: 0 MaxSeqNo: 42 sessionId: src_id|92980fc-baf78146-ba384086-f10acdef_0
2025-09-30T14:53:43.857899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|157133c0-66c8a744-3a5fc032-83325016_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|92980fc-baf78146-ba384086-f10acdef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:43.860869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92980fc-baf78146-ba384086-f10acdef_0] Write session: try to update token
2025-09-30T14:53:43.860892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92980fc-baf78146-ba384086-f10acdef_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:43.869882Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:43.869904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:43.869907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:43.869910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:43.869922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895546395745116:8023]
2025-09-30T14:53:43.869927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895546395745116:8023]
2025-09-30T14:53:43.869932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895546395745116:8023]
2025-09-30T14:53:43.869973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:43.869980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:43.869983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:43.870132Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:43.876091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:43.876115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:43.876119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:43.881477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1305 sessionId: src_id|92980fc-baf78146-ba384086-f10acdef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:43.884266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:43.920829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895546485495252:2659]
2025-09-30T14:53:43.921086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1304, pipe: [1:7555895546485495252:2659]
2025-09-30T14:53:43.991222Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:43.991582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:43.991602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:43.991641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895546485495252:2659], now have 1 active actors on pipe
2025-09-30T14:53:43.991891Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:43.992282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:43.992290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895546485495252:2659]
2025-09-30T14:53:43.992312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:43.992390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1305 reason: status is not ok: tablet will be restarted right now sessionId: src_id|92980fc-baf78146-ba384086-f10acdef_0
2025-09-30T14:53:43.992575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1305 sessionId: src_id|92980fc-baf78146-ba384086-f10acdef_0 is DEAD
2025-09-30T14:53:43.992944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92980fc-baf78146-ba384086-f10acdef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:43.992950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92980fc-baf78146-ba384086-f10acdef_0] Write session will restart in 0.008630s
2025-09-30T14:53:43.992973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92980fc-baf78146-ba384086-f10acdef_0] Write session: Do CDS request
2025-09-30T14:53:43.992979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92980fc-baf78146-ba384086-f10acdef_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:44.002776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92980fc-baf78146-ba384086-f10acdef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:44.003380Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:44.003398Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1306
2025-09-30T14:53:44.003578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1306 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:44.003608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1306 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:44.003613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1306 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:44.003617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:44.004749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1306 sessionId:  describe result for acl check
2025-09-30T14:53:44.004785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:44.004787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:44.004790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:44.004795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895550780462561:2637] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:44.005341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895550780462561:2637] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:44.009876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895550780462561:2637] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:44.016222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895550780462561:2637] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:44.016243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895550780462561:2637] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:44.016247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895550780462561:2637] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:44.016257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1306 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:44.018011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:44.020413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:44.020645Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:44.020659Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:44.020670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:44.020724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:44.020769Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895550690712557:8025]
2025-09-30T14:53:44.021498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:44.021830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:44.021875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:44.022262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:44.022327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:44.022333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:44.022335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:44.022336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:44.022337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:44.022339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:44.022340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:44.022342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:44.022343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:44.022345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:44.022346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.022347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.022348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.022350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:44.022351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:44.022357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:44.022368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:44.022373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:44.022379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:44.022383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:44.022388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:44.022393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:44.022399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:44.022403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:44.022410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:44.022415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.022419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.022424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.022428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:44.022432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:44.022441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:44.022450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:44.022456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:44.022463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:44.022468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:44.022475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:44.022482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:44.022489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:44.022495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:44.022506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:44.022511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:44.022518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:44.022528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:44.022533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:44.022541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:44.022546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:44.022550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:44.022555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:44.022559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:44.022563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:44.022572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.022579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.022583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.022588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.022593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.022597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.022604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:44.022609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:44.022614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:44.022620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:44.022675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:44.034569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:44.036171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1305
2025-09-30T14:53:44.036204Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1305
2025-09-30T14:53:44.035783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:44.035802Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:44.035805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:44.035810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:44.035817Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1305 [2:7555895550690712557:8025]
2025-09-30T14:53:44.035835Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:44.035851Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:44.035855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:44.035858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:44.035861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:44.035880Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:44.035888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:44.035896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:44.035963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.035966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.035969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.035973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:44.035976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:44.036050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:44.036053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.036070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.036084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.036106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:44.036126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895550780462684:2637], now have 1 active actors on pipe
2025-09-30T14:53:44.036130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895546485495253:2454], now have 1 active actors on pipe
2025-09-30T14:53:44.036136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895550690712552:8025]
2025-09-30T14:53:44.036141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895550690712552:8025]
2025-09-30T14:53:44.036143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895550690712552:8025]
2025-09-30T14:53:44.036159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:44.036172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:44.036186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:44.036190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:44.036227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895550690712552:8025]
2025-09-30T14:53:44.036229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:44.036274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:44.036279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:44.036281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:44.036288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:44.036478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:44.036486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:44.036519Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33b7185-b115b6ce-3a8ee750-3b664e6f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:44.036546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:44.036556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:44.036559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:44.036570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:44.036586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:44.036609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:44.036824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:44.036833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:44.036849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:44.036944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1306 partition: 0 MaxSeqNo: 42 sessionId: src_id|33b7185-b115b6ce-3a8ee750-3b664e6f_0
2025-09-30T14:53:44.037367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92980fc-baf78146-ba384086-f10acdef_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|33b7185-b115b6ce-3a8ee750-3b664e6f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:44.040431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33b7185-b115b6ce-3a8ee750-3b664e6f_0] Write session: try to update token
2025-09-30T14:53:44.040450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33b7185-b115b6ce-3a8ee750-3b664e6f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:44.050866Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:44.050888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:44.050891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:44.050893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:44.050904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895550690712552:8025]
2025-09-30T14:53:44.050910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895550690712552:8025]
2025-09-30T14:53:44.050915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895550690712552:8025]
2025-09-30T14:53:44.050958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:44.050966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.050969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:44.050975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:44.050982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:44.050986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:44.051129Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:44.058052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1306 sessionId: src_id|33b7185-b115b6ce-3a8ee750-3b664e6f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:44.061009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:44.095355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895550780462703:2659]
2025-09-30T14:53:44.095642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1305, pipe: [1:7555895550780462703:2659]
2025-09-30T14:53:44.177354Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:44.177806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:44.177824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:44.177843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895550780462703:2659], now have 1 active actors on pipe
2025-09-30T14:53:44.178074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895550780462703:2659]
2025-09-30T14:53:44.178115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:44.178119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:44.178174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1306 reason: error at write: Disconnected sessionId: src_id|33b7185-b115b6ce-3a8ee750-3b664e6f_0
2025-09-30T14:53:44.178059Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:44.178387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1306 sessionId: src_id|33b7185-b115b6ce-3a8ee750-3b664e6f_0 is DEAD
2025-09-30T14:53:44.178558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33b7185-b115b6ce-3a8ee750-3b664e6f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:44.178568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33b7185-b115b6ce-3a8ee750-3b664e6f_0] Write session will restart in 0.007711s
2025-09-30T14:53:44.178544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:44.178591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33b7185-b115b6ce-3a8ee750-3b664e6f_0] Write session: Do CDS request
2025-09-30T14:53:44.178599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33b7185-b115b6ce-3a8ee750-3b664e6f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:44.191335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33b7185-b115b6ce-3a8ee750-3b664e6f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:44.191430Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:44.191461Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1307
2025-09-30T14:53:44.191683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1307 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:44.191729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1307 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:44.191736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1307 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:44.191750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:44.192190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1307 sessionId:  describe result for acl check
2025-09-30T14:53:44.192223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:44.192229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:44.192231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:44.192236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895550780462818:2624] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:44.192792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895550780462818:2624] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:44.194284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:44.194737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895550780462818:2624] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:44.197680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:44.197935Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:44.197946Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:44.197957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:44.198025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:44.198061Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895550690712711:8034]
2025-09-30T14:53:44.198746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:44.199153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:44.199210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:44.200835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895550780462818:2624] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:44.200856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895550780462818:2624] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:44.200860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895550780462818:2624] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:44.200868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1307 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:44.199598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:44.199678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:44.199679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:44.199681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:44.199682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:44.199683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:44.199685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:44.199686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:44.199687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:44.199689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:44.199690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:44.199691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.199692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.199693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.199695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:44.199696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:44.199702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:44.199710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:44.199715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:44.199719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:44.199724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:44.199729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:44.199733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:44.199737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:44.199741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:44.199746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:44.199749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.199753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.199756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.199760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:44.199764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:44.199771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:44.199779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:44.199786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:44.199792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:44.199797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:44.199803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:44.199808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:44.199814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:44.199820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:44.199825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:44.199830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:44.199835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:44.199839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:44.199844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:44.199848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:44.199854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:44.199859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:44.199865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:44.199872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:44.199878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:44.199898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.199904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.199910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.199915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.199921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.199926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.199930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:44.199934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:44.199939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:44.199944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:44.199999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:44.206985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:44.208631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1306
2025-09-30T14:53:44.208670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1306
2025-09-30T14:53:44.208065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:44.208078Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:44.208080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:44.208083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:44.208088Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1306 [2:7555895550690712711:8034]
2025-09-30T14:53:44.208102Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:44.208117Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:44.208120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:44.208123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:44.208126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:44.208140Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:44.208145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:44.208150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:44.208196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.208197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.208198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.208201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:44.208202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:44.208266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:44.208268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.208280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.208290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.208307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:44.208326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895550780462722:2454], now have 1 active actors on pipe
2025-09-30T14:53:44.208333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895550690712706:8034]
2025-09-30T14:53:44.208335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895550690712706:8034]
2025-09-30T14:53:44.208338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895550690712706:8034]
2025-09-30T14:53:44.208345Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:44.208356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:44.208356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:44.208359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:44.208361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:44.208370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:44.208373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:44.208406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895550780462862:2624], now have 1 active actors on pipe
2025-09-30T14:53:44.208409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895550690712706:8034]
2025-09-30T14:53:44.208416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:44.208451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:44.209313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:44.209321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:44.209347Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5bdfbcd-e8062dbc-66b8f054-f01c5367_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:44.209355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:44.209359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:44.209361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:44.209372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:44.209384Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:44.209398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:44.209872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:44.209886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:44.209907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:44.210060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1307 partition: 0 MaxSeqNo: 42 sessionId: src_id|b5bdfbcd-e8062dbc-66b8f054-f01c5367_0
2025-09-30T14:53:44.210455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33b7185-b115b6ce-3a8ee750-3b664e6f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b5bdfbcd-e8062dbc-66b8f054-f01c5367_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:44.213173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5bdfbcd-e8062dbc-66b8f054-f01c5367_0] Write session: try to update token
2025-09-30T14:53:44.213190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5bdfbcd-e8062dbc-66b8f054-f01c5367_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:44.230392Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:44.230409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:44.230411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:44.230414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:44.230424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895550690712706:8034]
2025-09-30T14:53:44.230428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895550690712706:8034]
2025-09-30T14:53:44.230432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895550690712706:8034]
2025-09-30T14:53:44.230470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:44.230478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:44.230478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:44.230482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:44.230485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.230488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:44.230627Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:44.231343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1307 sessionId: src_id|b5bdfbcd-e8062dbc-66b8f054-f01c5367_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:44.234423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:44.278237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895550780462891:2659]
2025-09-30T14:53:44.279900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1306, pipe: [1:7555895550780462891:2659]
2025-09-30T14:53:44.359468Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:44.359839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:44.359855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:44.359893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895550780462891:2659], now have 1 active actors on pipe
2025-09-30T14:53:44.360122Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:44.360455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:44.360455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:44.360460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:44.360509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895550780462891:2659]
2025-09-30T14:53:44.360520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1307 reason: error at write: Disconnected sessionId: src_id|b5bdfbcd-e8062dbc-66b8f054-f01c5367_0
2025-09-30T14:53:44.360741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1307 sessionId: src_id|b5bdfbcd-e8062dbc-66b8f054-f01c5367_0 is DEAD
2025-09-30T14:53:44.360963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5bdfbcd-e8062dbc-66b8f054-f01c5367_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:44.360975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5bdfbcd-e8062dbc-66b8f054-f01c5367_0] Write session will restart in 0.006274s
2025-09-30T14:53:44.360999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5bdfbcd-e8062dbc-66b8f054-f01c5367_0] Write session: Do CDS request
2025-09-30T14:53:44.361007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5bdfbcd-e8062dbc-66b8f054-f01c5367_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:44.368819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5bdfbcd-e8062dbc-66b8f054-f01c5367_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:44.368876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:44.368895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1308
2025-09-30T14:53:44.369122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1308 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:44.369179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1308 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:44.369190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1308 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:44.369194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:44.369623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1308 sessionId:  describe result for acl check
2025-09-30T14:53:44.369657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:44.369664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:44.369666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:44.369672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895550780462937:2615] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:44.370248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895550780462937:2615] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:44.372993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895550780462937:2615] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:44.373787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:44.375694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:44.375887Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:44.375901Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:44.375913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:44.375972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:44.376015Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895550690712887:8043]
2025-09-30T14:53:44.376638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:44.376286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895550780462937:2615] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:44.376301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895550780462937:2615] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:44.376304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895550780462937:2615] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:44.376312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1308 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:44.376957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:44.377015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:44.377375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:44.377453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:44.377460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:44.377461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:44.377463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:44.377464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:44.377465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:44.377466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:44.377467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:44.377469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:44.377470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:44.377471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.377472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.377473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.377474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:44.377475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:44.377481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:44.377492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:44.377497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:44.377501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:44.377506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:44.377511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:44.377516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:44.377520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:44.377525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:44.377530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:44.377534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.377539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.377543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.377548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:44.377552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:44.377559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:44.377568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:44.377574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:44.377580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:44.377585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:44.377591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:44.377595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:44.377603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:44.377607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:44.377613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:44.377618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:44.377623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:44.377628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:44.377633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:44.377639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:44.377645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:44.377650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:44.377665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:44.377669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:44.377675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:44.377680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.377686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.377691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.377696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.377701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.377707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.377711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:44.377718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:44.377723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:44.377729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:44.377778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:44.384683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1307
2025-09-30T14:53:44.384685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1307
2025-09-30T14:53:44.383427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:44.384315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:44.384320Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:44.384323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:44.384327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:44.384335Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1307 [2:7555895550690712887:8043]
2025-09-30T14:53:44.384352Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:44.384367Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:44.384370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:44.384373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:44.384376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:44.384392Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:44.384398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:44.384407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:44.384468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.384470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.384473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.384476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:44.384479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:44.384552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:44.384556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.384570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.384585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.384605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:44.384624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895550780462893:2454], now have 1 active actors on pipe
2025-09-30T14:53:44.384627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895550780463031:2615], now have 1 active actors on pipe
2025-09-30T14:53:44.384634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895550690712882:8043]
2025-09-30T14:53:44.384636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895550690712882:8043]
2025-09-30T14:53:44.384639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895550690712882:8043]
2025-09-30T14:53:44.384657Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:44.384669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:44.384683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:44.384688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:44.384690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:44.384705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:44.384708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:44.384745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895550690712882:8043]
2025-09-30T14:53:44.384755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:44.384771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:44.384773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:44.384778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:44.384825Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e837b710-182da29-5ec74abb-3f56ef4c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:44.384832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:44.384839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:44.384841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:44.384851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:44.384859Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:44.384883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:44.385098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:44.385106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:44.385152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:44.385230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1308 partition: 0 MaxSeqNo: 42 sessionId: src_id|e837b710-182da29-5ec74abb-3f56ef4c_0
2025-09-30T14:53:44.385646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5bdfbcd-e8062dbc-66b8f054-f01c5367_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e837b710-182da29-5ec74abb-3f56ef4c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:44.388567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e837b710-182da29-5ec74abb-3f56ef4c_0] Write session: try to update token
2025-09-30T14:53:44.388590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e837b710-182da29-5ec74abb-3f56ef4c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:44.397155Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:44.397176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:44.397178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:44.397180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:44.397189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895550690712882:8043]
2025-09-30T14:53:44.397193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895550690712882:8043]
2025-09-30T14:53:44.397198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895550690712882:8043]
2025-09-30T14:53:44.397242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:44.397249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.397252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:44.397427Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:44.399305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:44.399324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:44.399329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:44.404133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1308 sessionId: src_id|e837b710-182da29-5ec74abb-3f56ef4c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:44.406905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:44.461607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895550780463043:2659]
2025-09-30T14:53:44.462300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1307, pipe: [1:7555895550780463043:2659]
2025-09-30T14:53:44.510761Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:44.511166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:44.511189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:44.511233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895550780463043:2659], now have 1 active actors on pipe
2025-09-30T14:53:44.511494Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:44.511504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895550780463043:2659]
2025-09-30T14:53:44.511543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:44.511546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:44.511603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1308 reason: error at write: Disconnected sessionId: src_id|e837b710-182da29-5ec74abb-3f56ef4c_0
2025-09-30T14:53:44.511673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:44.511788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1308 sessionId: src_id|e837b710-182da29-5ec74abb-3f56ef4c_0 is DEAD
2025-09-30T14:53:44.512043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e837b710-182da29-5ec74abb-3f56ef4c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:44.512054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e837b710-182da29-5ec74abb-3f56ef4c_0] Write session will restart in 0.007093s
2025-09-30T14:53:44.512078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e837b710-182da29-5ec74abb-3f56ef4c_0] Write session: Do CDS request
2025-09-30T14:53:44.512085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e837b710-182da29-5ec74abb-3f56ef4c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:44.520815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e837b710-182da29-5ec74abb-3f56ef4c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:44.520961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:44.520981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1309
2025-09-30T14:53:44.521093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1309 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:44.521155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1309 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:44.521166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1309 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:44.521170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:44.521655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1309 sessionId:  describe result for acl check
2025-09-30T14:53:44.521698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:44.521705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:44.521707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:44.521713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895550780463099:2610] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:44.522318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895550780463099:2610] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:44.524982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895550780463099:2610] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:44.528037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895550780463099:2610] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:44.528059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895550780463099:2610] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:44.528063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895550780463099:2610] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:44.528071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1309 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:44.529867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:44.532644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:44.532867Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:44.532875Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:44.532886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:44.532941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:44.532985Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895550690713030:8045]
2025-09-30T14:53:44.533619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:44.533947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:44.533993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:44.534333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:44.534410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:44.534418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:44.534420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:44.534421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:44.534422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:44.534423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:44.534424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:44.534426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:44.534427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:44.534428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:44.534430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.534431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.534432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.534433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:44.534434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:44.534439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:44.534449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:44.534453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:44.534456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:44.534460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:44.534463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:44.534467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:44.534471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:44.534474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:44.534478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:44.534481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.534485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.534489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.534492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:44.534496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:44.534503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:44.534511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:44.534516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:44.534522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:44.534526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:44.534530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:44.534536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:44.534541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:44.534546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:44.534550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:44.534555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:44.534559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:44.534564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:44.534569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:44.534573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:44.534578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:44.534583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:44.534588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:44.534592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:44.534598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:44.534603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.534607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.534612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.534617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.534623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.534628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.534633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:44.534639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:44.534643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:44.534647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:44.534688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:44.541406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:44.542367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:44.542389Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:44.542393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:44.542397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:44.542405Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1308 [2:7555895550690713030:8045]
2025-09-30T14:53:44.542424Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:44.542441Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:44.542444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:44.542448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:44.542451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:44.542468Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:44.542476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:44.542490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:44.542561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.542570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.542572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.542575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:44.542579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:44.542649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:44.542658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.542672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.542684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.542702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:44.542720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895550780463045:2454], now have 1 active actors on pipe
2025-09-30T14:53:44.542732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895550690713025:8045]
2025-09-30T14:53:44.542735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895550690713025:8045]
2025-09-30T14:53:44.542737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895550690713025:8045]
2025-09-30T14:53:44.542745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:44.542755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895550780463185:2610], now have 1 active actors on pipe
2025-09-30T14:53:44.542756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:44.542760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:44.542763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:44.542763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:44.542779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:44.542793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:44.542832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895550690713025:8045]
2025-09-30T14:53:44.542849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:44.542945Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1308
2025-09-30T14:53:44.542987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1308
2025-09-30T14:53:44.542885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:44.543129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:44.543141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:44.543168Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|46001615-e31b33b9-3585155f-e0b337bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:44.543175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:44.543179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:44.543181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:44.543192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:44.543205Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:44.543226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:44.543531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:44.543546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:44.543569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:44.543687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1309 partition: 0 MaxSeqNo: 42 sessionId: src_id|46001615-e31b33b9-3585155f-e0b337bb_0
2025-09-30T14:53:44.544098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e837b710-182da29-5ec74abb-3f56ef4c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|46001615-e31b33b9-3585155f-e0b337bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:44.547177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46001615-e31b33b9-3585155f-e0b337bb_0] Write session: try to update token
2025-09-30T14:53:44.547199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46001615-e31b33b9-3585155f-e0b337bb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:44.560986Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:44.561008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:44.561011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:44.561013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:44.561022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895550690713025:8045]
2025-09-30T14:53:44.561027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895550690713025:8045]
2025-09-30T14:53:44.561032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895550690713025:8045]
2025-09-30T14:53:44.561082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:44.561087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:44.561090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.561093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:44.561095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:44.561099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:44.561233Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:44.570495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1309 sessionId: src_id|46001615-e31b33b9-3585155f-e0b337bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:44.573451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:44.611530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895550780463197:2659]
2025-09-30T14:53:44.612434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1308, pipe: [1:7555895550780463197:2659]
2025-09-30T14:53:44.679101Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:44.679633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:44.679650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:44.679691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895550780463197:2659], now have 1 active actors on pipe
2025-09-30T14:53:44.679924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:44.679983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895550780463197:2659]
2025-09-30T14:53:44.680003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:44.680006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:44.679929Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:44.680520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46001615-e31b33b9-3585155f-e0b337bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:44.680529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46001615-e31b33b9-3585155f-e0b337bb_0] Write session will restart in 0.005059s
2025-09-30T14:53:44.680553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46001615-e31b33b9-3585155f-e0b337bb_0] Write session: Do CDS request
2025-09-30T14:53:44.680559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46001615-e31b33b9-3585155f-e0b337bb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:44.680131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1309 reason: error at write: Disconnected sessionId: src_id|46001615-e31b33b9-3585155f-e0b337bb_0
2025-09-30T14:53:44.680325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1309 sessionId: src_id|46001615-e31b33b9-3585155f-e0b337bb_0 is DEAD
2025-09-30T14:53:44.686807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46001615-e31b33b9-3585155f-e0b337bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:44.686923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:44.686940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1310
2025-09-30T14:53:44.687121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1310 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:44.687151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1310 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:44.687157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1310 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:44.687160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:44.687667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1310 sessionId:  describe result for acl check
2025-09-30T14:53:44.687704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:44.687707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:44.687708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:44.687714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895550780463206:2604] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:44.688229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895550780463206:2604] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:44.691445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895550780463206:2604] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:44.697659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895550780463206:2604] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:44.697682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895550780463206:2604] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:44.697685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895550780463206:2604] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:44.697694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1310 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:44.701071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:44.703666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:44.703887Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:44.703898Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:44.703908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:44.703959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:44.704001Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895550690713175:8048]
2025-09-30T14:53:44.704670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:44.704992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:44.705049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:44.705422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:44.705505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:44.705512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:44.705514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:44.705515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:44.705515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:44.705517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:44.705518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:44.705519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:44.705520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:44.705521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:44.705522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.705523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.705524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.705525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:44.705526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:44.705532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:44.705542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:44.705546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:44.705551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:44.705555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:44.705559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:44.705563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:44.705568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:44.705572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:44.705576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:44.705580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.705583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.705588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.705591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:44.705595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:44.705604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:44.705612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:44.705619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:44.705625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:44.705630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:44.705637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:44.705643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:44.705648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:44.705653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:44.705659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:44.705665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:44.705671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:44.705682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:44.705687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:44.705692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:44.705697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:44.705703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:44.705708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:44.705714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:44.705719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:44.705732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.705737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.705742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.705751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.705756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.705760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.705765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:44.705769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:44.705773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:44.705778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:44.705826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:44.711672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:44.712799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:44.712818Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:44.712820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:44.712824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:44.712832Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1309 [2:7555895550690713175:8048]
2025-09-30T14:53:44.712849Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:44.712866Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:44.712870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:44.712873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:44.712876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:44.712894Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:44.712908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:44.712920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:44.712986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.712993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.712995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.713000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:44.713002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:44.713068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:44.713076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.713088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.713105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.713130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:44.713154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895550780463311:2604], now have 1 active actors on pipe
2025-09-30T14:53:44.713163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895550780463199:2454], now have 1 active actors on pipe
2025-09-30T14:53:44.713169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895550690713170:8048]
2025-09-30T14:53:44.713176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895550690713170:8048]
2025-09-30T14:53:44.713178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895550690713170:8048]
2025-09-30T14:53:44.713190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:44.713204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:44.713207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:44.713210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:44.713212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:44.713230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:44.713233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:44.713227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1309
2025-09-30T14:53:44.713270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895550690713170:8048]
2025-09-30T14:53:44.713282Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:44.713237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1309
2025-09-30T14:53:44.713288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:44.713300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:44.713305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:44.713353Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97245078-ca134b7c-f3529a07-c7749ed6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:44.713366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:44.713373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:44.713375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:44.713385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:44.713394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:44.713415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:44.713596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:44.713606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:44.713629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:44.713751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1310 partition: 0 MaxSeqNo: 42 sessionId: src_id|97245078-ca134b7c-f3529a07-c7749ed6_0
2025-09-30T14:53:44.714143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46001615-e31b33b9-3585155f-e0b337bb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|97245078-ca134b7c-f3529a07-c7749ed6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:44.716922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97245078-ca134b7c-f3529a07-c7749ed6_0] Write session: try to update token
2025-09-30T14:53:44.716942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97245078-ca134b7c-f3529a07-c7749ed6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:44.726298Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:44.726318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:44.726320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:44.726323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:44.726333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895550690713170:8048]
2025-09-30T14:53:44.726337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895550690713170:8048]
2025-09-30T14:53:44.726341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895550690713170:8048]
2025-09-30T14:53:44.726381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:44.726385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:44.726388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.726391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:44.726391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:44.726395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:44.726525Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:44.735110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1310 sessionId: src_id|97245078-ca134b7c-f3529a07-c7749ed6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:44.737991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:44.779939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895550780463350:2659]
2025-09-30T14:53:44.780253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1309, pipe: [1:7555895550780463350:2659]
2025-09-30T14:53:44.845804Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:44.846204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:44.846218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:44.846238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895550780463350:2659], now have 1 active actors on pipe
2025-09-30T14:53:44.846535Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:44.846553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:44.846554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895550780463350:2659]
2025-09-30T14:53:44.846570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:44.846575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:44.846641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1310 reason: error at write: Disconnected sessionId: src_id|97245078-ca134b7c-f3529a07-c7749ed6_0
2025-09-30T14:53:44.846857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1310 sessionId: src_id|97245078-ca134b7c-f3529a07-c7749ed6_0 is DEAD
2025-09-30T14:53:44.847052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97245078-ca134b7c-f3529a07-c7749ed6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:44.847071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97245078-ca134b7c-f3529a07-c7749ed6_0] Write session will restart in 0.005520s
2025-09-30T14:53:44.847095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97245078-ca134b7c-f3529a07-c7749ed6_0] Write session: Do CDS request
2025-09-30T14:53:44.847103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97245078-ca134b7c-f3529a07-c7749ed6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:44.853820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97245078-ca134b7c-f3529a07-c7749ed6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:44.853933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:44.853962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1311
2025-09-30T14:53:44.854143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1311 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:44.854181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1311 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:44.854187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1311 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:44.854191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:44.854646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1311 sessionId:  describe result for acl check
2025-09-30T14:53:44.854697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:44.854704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:44.854706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:44.854712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895550780463365:2601] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:44.855289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895550780463365:2601] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:44.857249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895550780463365:2601] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:44.860200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895550780463365:2601] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:44.860216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895550780463365:2601] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:44.860220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895550780463365:2601] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:44.860230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1311 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:44.867170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:44.872011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:44.872259Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:44.872271Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:44.872282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:44.872338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:44.872385Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895550690713319:8050]
2025-09-30T14:53:44.873094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:44.873459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:44.873511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:44.873857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:44.873921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:44.873929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:44.873930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:44.873931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:44.873933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:44.873933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:44.873935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:44.873936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:44.873938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:44.873939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:44.873940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.873941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.873942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.873943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:44.873945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:44.873951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:44.873961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:44.873966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:44.873970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:44.873975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:44.873979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:44.873984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:44.873989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:44.873993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:44.874013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:44.874017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.874021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.874026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.874031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:44.874036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:44.874046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:44.874054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:44.874061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:44.874067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:44.874072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:44.874078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:44.874083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:44.874090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:44.874096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:44.874102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:44.874107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:44.874113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:44.874118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:44.874125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:44.874130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:44.874136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:44.874146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:44.874153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:44.874161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:44.874167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:44.874172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.874179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.874184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.874196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.874202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.874208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.874213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:44.874219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:44.874224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:44.874231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:44.874281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:44.880121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:44.880986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:44.881007Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:44.881011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:44.881016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:44.881024Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1310 [2:7555895550690713319:8050]
2025-09-30T14:53:44.881040Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:44.881057Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:44.881061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:44.881064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:44.881067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:44.881083Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:44.881099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:44.881106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:44.881167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.881176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.881179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.881183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:44.881186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:44.881253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:44.881263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.881277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:44.881291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:44.881318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:44.881341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895550690713314:8050]
2025-09-30T14:53:44.881349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895550690713314:8050]
2025-09-30T14:53:44.881352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895550690713314:8050]
2025-09-30T14:53:44.881367Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:44.881383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895550780463352:2454], now have 1 active actors on pipe
2025-09-30T14:53:44.881393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895550780463402:2601], now have 1 active actors on pipe
2025-09-30T14:53:44.881401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:44.881417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:44.881425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:44.881461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895550690713314:8050]
2025-09-30T14:53:44.881469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:44.881657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:44.881667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:44.881670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:44.881677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:44.881930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:44.881946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:44.881977Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8aed141c-81c08eb7-1dfbd95a-d2c7ec4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:44.881987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:44.882011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:44.882014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:44.882025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:44.882042Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:44.882063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:44.882309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:44.882323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:44.882345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:44.882867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97245078-ca134b7c-f3529a07-c7749ed6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8aed141c-81c08eb7-1dfbd95a-d2c7ec4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:44.881499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1310
2025-09-30T14:53:44.881510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1310
2025-09-30T14:53:44.882470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1311 partition: 0 MaxSeqNo: 42 sessionId: src_id|8aed141c-81c08eb7-1dfbd95a-d2c7ec4_0
2025-09-30T14:53:44.885642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8aed141c-81c08eb7-1dfbd95a-d2c7ec4_0] Write session: try to update token
2025-09-30T14:53:44.885661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8aed141c-81c08eb7-1dfbd95a-d2c7ec4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:44.895269Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:44.895290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:44.895292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:44.895294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:44.895305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895550690713314:8050]
2025-09-30T14:53:44.895310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895550690713314:8050]
2025-09-30T14:53:44.895314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895550690713314:8050]
2025-09-30T14:53:44.895353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:44.895360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:44.895363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:44.895554Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:44.896028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:44.896044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:44.896048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:44.905969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1311 sessionId: src_id|8aed141c-81c08eb7-1dfbd95a-d2c7ec4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:44.909137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:44.946893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895550780463504:2659]
2025-09-30T14:53:44.947350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1310, pipe: [1:7555895550780463504:2659]
2025-09-30T14:53:45.017736Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:45.018087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:45.018120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:45.018142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895550780463504:2659], now have 1 active actors on pipe
2025-09-30T14:53:45.018360Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:45.018592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:45.018618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895550780463504:2659]
2025-09-30T14:53:45.019160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8aed141c-81c08eb7-1dfbd95a-d2c7ec4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:45.018646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:45.019171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8aed141c-81c08eb7-1dfbd95a-d2c7ec4_0] Write session will restart in 0.006929s
2025-09-30T14:53:45.018722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1311 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8aed141c-81c08eb7-1dfbd95a-d2c7ec4_0
2025-09-30T14:53:45.018934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1311 sessionId: src_id|8aed141c-81c08eb7-1dfbd95a-d2c7ec4_0 is DEAD
2025-09-30T14:53:45.019195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8aed141c-81c08eb7-1dfbd95a-d2c7ec4_0] Write session: Do CDS request
2025-09-30T14:53:45.019202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8aed141c-81c08eb7-1dfbd95a-d2c7ec4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:45.027807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8aed141c-81c08eb7-1dfbd95a-d2c7ec4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:45.027936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:45.027955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1312
2025-09-30T14:53:45.031515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1312 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:45.031577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1312 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:45.031588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1312 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:45.031594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:45.032103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1312 sessionId:  describe result for acl check
2025-09-30T14:53:45.032161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:45.032170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:45.032172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:45.032179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895555075430888:2595] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:45.032746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895555075430888:2595] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:45.035141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895555075430888:2595] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:45.035913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:45.037639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:45.037874Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:45.037886Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:45.037897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:45.037961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:45.038018Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895554985680759:8052]
2025-09-30T14:53:45.038436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895555075430888:2595] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:45.038462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895555075430888:2595] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:45.038467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895555075430888:2595] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:45.038476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1312 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:45.038734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:45.039096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:45.039155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:45.039528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:45.039609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:45.039622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:45.039623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:45.039624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:45.039626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:45.039627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:45.039628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:45.039629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:45.039630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:45.039631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:45.039632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.039634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.039635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.039636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:45.039637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:45.039643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:45.039655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:45.039660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:45.039664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:45.039668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:45.039672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:45.039676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:45.039680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:45.039684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:45.039688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:45.039692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.039696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.039700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.039703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:45.039708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:45.039717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:45.039725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:45.039731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:45.039737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:45.039742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:45.039748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:45.039753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:45.039759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:45.039764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:45.039770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:45.039775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:45.039781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:45.039786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:45.039792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:45.039802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:45.039808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:45.039814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:45.039820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:45.039824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:45.039830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:45.039843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.039849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.039855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.039860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.039865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.039870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.039877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:45.039882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:45.039889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:45.039895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:45.039941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:45.045917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:45.047071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:45.047090Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:45.047092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:45.047096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:45.047105Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1311 [2:7555895554985680759:8052]
2025-09-30T14:53:45.047122Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:45.047139Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:45.047146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:45.047150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:45.047153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:45.047171Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:45.047179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:45.047191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:45.047274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.047286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.047288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.047292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:45.047295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:45.047370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:45.047378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.047393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.047407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.047433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:45.047458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895554985680754:8052]
2025-09-30T14:53:45.047461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895554985680754:8052]
2025-09-30T14:53:45.047463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895554985680754:8052]
2025-09-30T14:53:45.047476Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:45.047496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895555075430951:2595], now have 1 active actors on pipe
2025-09-30T14:53:45.047505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895555075430802:2454], now have 1 active actors on pipe
2025-09-30T14:53:45.047509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:45.047513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:45.047514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:45.047516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:45.047531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:45.047539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:45.047582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895554985680754:8052]
2025-09-30T14:53:45.047594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:45.047603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:45.047589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1311
2025-09-30T14:53:45.047590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1311
2025-09-30T14:53:45.048186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1312 partition: 0 MaxSeqNo: 42 sessionId: src_id|9540b87f-8d1e94c8-7eccad01-b5073718_0
2025-09-30T14:53:45.047747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:45.047759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:45.047791Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9540b87f-8d1e94c8-7eccad01-b5073718_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:45.047801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:45.047805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:45.047807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:45.047819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:45.047831Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:45.047849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:45.048055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:45.048062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:45.048084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:45.051357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8aed141c-81c08eb7-1dfbd95a-d2c7ec4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9540b87f-8d1e94c8-7eccad01-b5073718_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:45.054401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9540b87f-8d1e94c8-7eccad01-b5073718_0] Write session: try to update token
2025-09-30T14:53:45.054427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9540b87f-8d1e94c8-7eccad01-b5073718_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:45.061794Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:45.061816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:45.061819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:45.061821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:45.061831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895554985680754:8052]
2025-09-30T14:53:45.061836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895554985680754:8052]
2025-09-30T14:53:45.061845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895554985680754:8052]
2025-09-30T14:53:45.061885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:45.061891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:45.061896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.061899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:45.061899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:45.061903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:45.062063Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:45.082034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1312 sessionId: src_id|9540b87f-8d1e94c8-7eccad01-b5073718_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:45.084862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:45.118878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895555075430968:2659]
2025-09-30T14:53:45.119953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1311, pipe: [1:7555895555075430968:2659]
2025-09-30T14:53:45.184534Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:45.184991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:45.185008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:45.185026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895555075430968:2659], now have 1 active actors on pipe
2025-09-30T14:53:45.185323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:45.185325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:45.185329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:45.185380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895555075430968:2659]
2025-09-30T14:53:45.185395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1312 reason: error at write: Disconnected sessionId: src_id|9540b87f-8d1e94c8-7eccad01-b5073718_0
2025-09-30T14:53:45.185250Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:45.185628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1312 sessionId: src_id|9540b87f-8d1e94c8-7eccad01-b5073718_0 is DEAD
2025-09-30T14:53:45.187859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9540b87f-8d1e94c8-7eccad01-b5073718_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:45.187872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9540b87f-8d1e94c8-7eccad01-b5073718_0] Write session will restart in 0.006510s
2025-09-30T14:53:45.187898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9540b87f-8d1e94c8-7eccad01-b5073718_0] Write session: Do CDS request
2025-09-30T14:53:45.187907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9540b87f-8d1e94c8-7eccad01-b5073718_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:45.195807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9540b87f-8d1e94c8-7eccad01-b5073718_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:45.195999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:45.196021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1313
2025-09-30T14:53:45.196236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1313 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:45.196284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1313 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:45.196294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1313 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:45.196299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:45.196866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1313 sessionId:  describe result for acl check
2025-09-30T14:53:45.196930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:45.196941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:45.196947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:45.196953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895555075430978:2587] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:45.197630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895555075430978:2587] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:45.202546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895555075430978:2587] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:45.206640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895555075430978:2587] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:45.206660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895555075430978:2587] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:45.206664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895555075430978:2587] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:45.206673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1313 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:45.218296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:45.223888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:45.224182Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:45.224196Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:45.224210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:45.224278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:45.224321Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895554985680920:8055]
2025-09-30T14:53:45.225042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:45.225610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:45.225690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:45.226100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:45.226184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:45.226186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:45.226187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:45.226189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:45.226190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:45.226192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:45.226194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:45.226196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:45.226198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:45.226199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:45.226201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.226202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.226204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.226205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:45.226207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:45.226215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:45.226226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:45.226231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:45.226236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:45.226241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:45.226246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:45.226250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:45.226254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:45.226258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:45.226263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:45.226267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.226272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.226276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.226281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:45.226286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:45.226297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:45.226306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:45.226313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:45.226318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:45.226324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:45.226334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:45.226339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:45.226345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:45.226352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:45.226357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:45.226362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:45.226368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:45.226373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:45.226378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:45.226383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:45.226390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:45.226394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:45.226399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:45.226405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:45.226411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:45.226417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.226423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.226429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.226435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.226440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.226446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.226451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:45.226456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:45.226461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:45.226467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:45.226522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:45.234399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:45.235460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:45.235480Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:45.235483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:45.235488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:45.235496Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1312 [2:7555895554985680920:8055]
2025-09-30T14:53:45.235515Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:45.235534Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:45.235537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:45.235540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:45.235543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:45.235561Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:45.235569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:45.235576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:45.235843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.235854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.235857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.235860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:45.235864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:45.235938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:45.235942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.235956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.235970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.235990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:45.236008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895554985680915:8055]
2025-09-30T14:53:45.236010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895554985680915:8055]
2025-09-30T14:53:45.236012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895554985680915:8055]
2025-09-30T14:53:45.236030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:45.236046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:45.236069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:45.236072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:45.236106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:45.236113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895554985680915:8055]
2025-09-30T14:53:45.236115Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:45.236118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:45.236120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:45.236128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:45.236315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895555075430970:2454], now have 1 active actors on pipe
2025-09-30T14:53:45.236326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895555075431030:2587], now have 1 active actors on pipe
2025-09-30T14:53:45.236519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1312
2025-09-30T14:53:45.236572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1312
2025-09-30T14:53:45.236822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:45.236833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:45.236860Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ec6d0b0-21458d6b-d3ad2d31-f620a67b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:45.236869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:45.236873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:45.236875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:45.236888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:45.236900Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:45.236921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:45.237140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:45.237149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:45.237166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:45.237253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1313 partition: 0 MaxSeqNo: 42 sessionId: src_id|5ec6d0b0-21458d6b-d3ad2d31-f620a67b_0
2025-09-30T14:53:45.237715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9540b87f-8d1e94c8-7eccad01-b5073718_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5ec6d0b0-21458d6b-d3ad2d31-f620a67b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:45.240824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ec6d0b0-21458d6b-d3ad2d31-f620a67b_0] Write session: try to update token
2025-09-30T14:53:45.240844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ec6d0b0-21458d6b-d3ad2d31-f620a67b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:45.261027Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:45.261058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:45.261061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:45.261063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:45.261071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895554985680915:8055]
2025-09-30T14:53:45.261078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895554985680915:8055]
2025-09-30T14:53:45.261082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895554985680915:8055]
2025-09-30T14:53:45.261126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:45.261133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.261132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:45.261139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:45.261140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:45.261143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:45.261284Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:45.263589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1313 sessionId: src_id|5ec6d0b0-21458d6b-d3ad2d31-f620a67b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:45.266553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:45.287476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895555075431149:2659]
2025-09-30T14:53:45.287865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1312, pipe: [1:7555895555075431149:2659]
2025-09-30T14:53:45.381945Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:45.382425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:45.382442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:45.382483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895555075431149:2659], now have 1 active actors on pipe
2025-09-30T14:53:45.382732Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:45.382755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:45.383537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ec6d0b0-21458d6b-d3ad2d31-f620a67b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:45.383549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ec6d0b0-21458d6b-d3ad2d31-f620a67b_0] Write session will restart in 0.005329s
2025-09-30T14:53:45.383573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ec6d0b0-21458d6b-d3ad2d31-f620a67b_0] Write session: Do CDS request
2025-09-30T14:53:45.383578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ec6d0b0-21458d6b-d3ad2d31-f620a67b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:45.382827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895555075431149:2659]
2025-09-30T14:53:45.382853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:45.382867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:45.382940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1313 reason: error at write: Disconnected sessionId: src_id|5ec6d0b0-21458d6b-d3ad2d31-f620a67b_0
2025-09-30T14:53:45.383118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1313 sessionId: src_id|5ec6d0b0-21458d6b-d3ad2d31-f620a67b_0 is DEAD
2025-09-30T14:53:45.389768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ec6d0b0-21458d6b-d3ad2d31-f620a67b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:45.389873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:45.389891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1314
2025-09-30T14:53:45.390074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1314 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:45.390109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1314 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:45.390119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1314 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:45.390124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:45.390606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1314 sessionId:  describe result for acl check
2025-09-30T14:53:45.390642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:45.390649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:45.390652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:45.390657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895555075431176:2571] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:45.391225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895555075431176:2571] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:45.394391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895555075431176:2571] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:45.397500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895555075431176:2571] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:45.397517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895555075431176:2571] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:45.397521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895555075431176:2571] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:45.397529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1314 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:45.400896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:45.403407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:45.403714Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:45.403720Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:45.403732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:45.403789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:45.403837Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895554985681104:8070]
2025-09-30T14:53:45.404506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:45.404858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:45.404912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:45.405308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:45.405403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:45.405404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:45.405406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:45.405407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:45.405408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:45.405409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:45.405411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:45.405412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:45.405414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:45.405415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:45.405416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.405417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.405418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.405420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:45.405421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:45.405427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:45.405438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:45.405442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:45.405446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:45.405450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:45.405454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:45.405458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:45.405462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:45.405467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:45.405472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:45.405477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.405481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.405485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.405490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:45.405495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:45.405503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:45.405510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:45.405515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:45.405521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:45.405528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:45.405533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:45.405536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:45.405542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:45.405546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:45.405551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:45.405555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:45.405559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:45.405563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:45.405568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:45.405572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:45.405577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:45.405582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:45.405586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:45.405590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:45.405597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:45.405602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.405607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.405613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.405618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.405622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.405627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.405631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:45.405636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:45.405640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:45.405644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:45.405686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:45.411600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:45.412484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:45.412490Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:45.412493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:45.412497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:45.412504Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1313 [2:7555895554985681104:8070]
2025-09-30T14:53:45.412523Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:45.412540Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:45.412544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:45.412547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:45.412550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:45.412567Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:45.412574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:45.412585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:45.412648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.415334Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1313
2025-09-30T14:53:45.415334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1313
2025-09-30T14:53:45.412650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.412652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.412656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:45.412659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:45.412733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:45.412736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.412748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.412761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.412779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:45.412799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895555075431161:2454], now have 1 active actors on pipe
2025-09-30T14:53:45.412806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895554985681099:8070]
2025-09-30T14:53:45.412809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895554985681099:8070]
2025-09-30T14:53:45.412811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895554985681099:8070]
2025-09-30T14:53:45.412821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:45.412835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:45.412841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:45.412845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:45.412848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:45.412851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:45.412854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:45.412860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895555075431279:2571], now have 1 active actors on pipe
2025-09-30T14:53:45.412891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895554985681099:8070]
2025-09-30T14:53:45.412901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:45.412937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:45.415501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:45.415509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:45.416145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1314 partition: 0 MaxSeqNo: 42 sessionId: src_id|e9fb3000-a6061ed-1ecf064c-dd8f3ca7_0
2025-09-30T14:53:45.416585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ec6d0b0-21458d6b-d3ad2d31-f620a67b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e9fb3000-a6061ed-1ecf064c-dd8f3ca7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:45.415538Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9fb3000-a6061ed-1ecf064c-dd8f3ca7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:45.415558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:45.415562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:45.415565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:45.415579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:45.415606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:45.415624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:45.415968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:45.415975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:45.415995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:45.419524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9fb3000-a6061ed-1ecf064c-dd8f3ca7_0] Write session: try to update token
2025-09-30T14:53:45.419544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9fb3000-a6061ed-1ecf064c-dd8f3ca7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:45.426676Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:45.426693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:45.426701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895554985681099:8070]
2025-09-30T14:53:45.426737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:45.426911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:45.427046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:45.427173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:45.427324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:45.427797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:45.427849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:45.428834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:45.436725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1314 sessionId: src_id|e9fb3000-a6061ed-1ecf064c-dd8f3ca7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:45.439596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:45.443624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:45.443648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:45.444797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:45.444825Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:45.444828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:45.444831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:45.444834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:45.444844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895554985681099:8070]
2025-09-30T14:53:45.444848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895554985681099:8070]
2025-09-30T14:53:45.444855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895554985681099:8070]
2025-09-30T14:53:45.444887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:45.444893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.444896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:45.445028Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:45.447456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:45.447468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:45.447473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:45.447582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:45.477573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895555075431316:2659]
2025-09-30T14:53:45.479200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1313, pipe: [1:7555895555075431316:2659]
2025-09-30T14:53:45.578142Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:45.578586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895555075431316:2659], now have 1 active actors on pipe
2025-09-30T14:53:45.587740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:45.587771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:45.587981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:45.588058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:45.588131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:45.588204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:45.588797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:45.588816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:45.588911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:45.588980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:45.589061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:45.589141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:45.589186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:45.589189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:45.589270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:45.589339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:45.589413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:45.589481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:45.589526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:45.589530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:45.589609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:45.589681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:45.589746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:45.589813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:45.589858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:45.589861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:45.589937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:45.590018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:45.590082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:45.590149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:45.590195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:45.590198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:45.590279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:45.590344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:45.590408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:45.590475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:45.590520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:45.590523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:45.590598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:45.590664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:45.590731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:45.590797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:45.591120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:45.591124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:45.591212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:45.591562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:45.591641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:45.591717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:45.591767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:45.591780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:45.591868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:45.591938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:45.592013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:45.592084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:45.592130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:45.592133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:45.592213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:45.592281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:45.592377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:45.592450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:45.592495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:45.592499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:45.593341Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:45.593341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:45.593361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:45.593393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1314 reason: error at write: Disconnected sessionId: src_id|e9fb3000-a6061ed-1ecf064c-dd8f3ca7_0
2025-09-30T14:53:45.593626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1314 sessionId: src_id|e9fb3000-a6061ed-1ecf064c-dd8f3ca7_0 is DEAD
2025-09-30T14:53:45.593881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895555075431316:2659]
2025-09-30T14:53:45.594123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:45.594340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9fb3000-a6061ed-1ecf064c-dd8f3ca7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:45.594351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9fb3000-a6061ed-1ecf064c-dd8f3ca7_0] Write session will restart in 0.006135s
2025-09-30T14:53:45.594375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9fb3000-a6061ed-1ecf064c-dd8f3ca7_0] Write session: Do CDS request
2025-09-30T14:53:45.594380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9fb3000-a6061ed-1ecf064c-dd8f3ca7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:45.603870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9fb3000-a6061ed-1ecf064c-dd8f3ca7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:45.604084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:45.604106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1315
2025-09-30T14:53:45.604238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1315 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:45.604282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1315 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:45.604293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1315 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:45.604297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:45.604758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1315 sessionId:  describe result for acl check
2025-09-30T14:53:45.604804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:45.604811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:45.604813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:45.604818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895555075431329:2560] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:45.605369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895555075431329:2560] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:45.608038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895555075431329:2560] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:45.612579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895555075431329:2560] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:45.612597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895555075431329:2560] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:45.612600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895555075431329:2560] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:45.612608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1315 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:45.617555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:45.620300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:45.620543Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:45.620555Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:45.620567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:45.620624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:45.620664Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895554985681252:8072]
2025-09-30T14:53:45.621359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:45.622051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:45.622113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:45.622452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:45.622562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:45.622570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:45.622571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:45.622572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:45.622573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:45.622575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:45.622576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:45.622577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:45.622578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:45.622579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:45.622581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.622582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.622583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.622584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:45.622585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:45.622591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:45.622602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:45.622607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:45.622611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:45.622615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:45.622619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:45.622624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:45.622628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:45.622632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:45.622637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:45.622642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.622646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.622651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.622656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:45.622660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:45.622669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:45.622678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:45.622685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:45.622691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:45.622696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:45.622702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:45.622707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:45.622714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:45.622718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:45.622724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:45.622728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:45.622734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:45.622745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:45.622751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:45.622756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:45.622762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:45.622767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:45.622772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:45.622777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:45.622783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:45.622787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.622792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.622797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.622803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.622816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.622823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.622829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:45.622834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:45.622839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:45.622845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:45.622900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:45.629623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:45.630517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:45.630533Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:45.630535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:45.630539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:45.630546Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1314 [2:7555895554985681252:8072]
2025-09-30T14:53:45.630563Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:45.630578Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:45.630581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:45.630585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:45.630587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:45.630602Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:45.630608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:45.630615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:45.630671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.630679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.630681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.630685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:45.630687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:45.630893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1314
2025-09-30T14:53:45.630753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:45.630760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.630771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.630781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.630796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:45.630813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895555075431423:2560], now have 1 active actors on pipe
2025-09-30T14:53:45.630820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895554985681246:8072]
2025-09-30T14:53:45.630822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895554985681246:8072]
2025-09-30T14:53:45.630824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895554985681246:8072]
2025-09-30T14:53:45.630832Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:45.630847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:45.630849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:45.630852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:45.630855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:45.630862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:45.630864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:45.630896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895554985681246:8072]
2025-09-30T14:53:45.630903Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:45.630908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895555075431321:2454], now have 1 active actors on pipe
2025-09-30T14:53:45.630929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:45.631070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:45.631075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:45.631100Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25e77868-b5948db-e3934e53-cec3a621_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:45.631107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:45.631110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:45.631113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:45.631123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:45.631132Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:45.631144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:45.631321Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1314
2025-09-30T14:53:45.631790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:45.631804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:45.631829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:45.632344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9fb3000-a6061ed-1ecf064c-dd8f3ca7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|25e77868-b5948db-e3934e53-cec3a621_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:45.634951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25e77868-b5948db-e3934e53-cec3a621_0] Write session: try to update token
2025-09-30T14:53:45.634965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25e77868-b5948db-e3934e53-cec3a621_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:45.631982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1315 partition: 0 MaxSeqNo: 42 sessionId: src_id|25e77868-b5948db-e3934e53-cec3a621_0
2025-09-30T14:53:45.646388Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:45.646408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:45.646411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:45.646413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:45.646422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895554985681246:8072]
2025-09-30T14:53:45.646427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895554985681246:8072]
2025-09-30T14:53:45.646431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895554985681246:8072]
2025-09-30T14:53:45.646475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:45.646482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.646486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:45.646653Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:45.655426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:45.655450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:45.655455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:45.656728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1315 sessionId: src_id|25e77868-b5948db-e3934e53-cec3a621_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:45.659624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:45.695770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895555075431478:2659]
2025-09-30T14:53:45.696163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1314, pipe: [1:7555895555075431478:2659]
2025-09-30T14:53:45.768600Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:45.769086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:45.769095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:45.769113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895555075431478:2659], now have 1 active actors on pipe
2025-09-30T14:53:45.769501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:45.769558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:45.769561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:45.769581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895555075431478:2659]
2025-09-30T14:53:45.769651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1315 reason: error at write: Disconnected sessionId: src_id|25e77868-b5948db-e3934e53-cec3a621_0
2025-09-30T14:53:45.769509Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:45.769849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1315 sessionId: src_id|25e77868-b5948db-e3934e53-cec3a621_0 is DEAD
2025-09-30T14:53:45.770022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25e77868-b5948db-e3934e53-cec3a621_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:45.770033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25e77868-b5948db-e3934e53-cec3a621_0] Write session will restart in 0.006386s
2025-09-30T14:53:45.770057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25e77868-b5948db-e3934e53-cec3a621_0] Write session: Do CDS request
2025-09-30T14:53:45.770062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25e77868-b5948db-e3934e53-cec3a621_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:45.777838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25e77868-b5948db-e3934e53-cec3a621_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:45.777934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:45.777952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1316
2025-09-30T14:53:45.778123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1316 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:45.778159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1316 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:45.778169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1316 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:45.778173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:45.778670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1316 sessionId:  describe result for acl check
2025-09-30T14:53:45.778706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:45.778712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:45.778715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:45.778720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895555075431497:2557] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:45.779258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895555075431497:2557] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:45.781552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895555075431497:2557] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:45.784882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895555075431497:2557] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:45.784897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895555075431497:2557] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:45.784901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895555075431497:2557] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:45.784909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1316 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:45.786476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:45.788724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:45.788934Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:45.788938Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:45.788949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:45.789002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:45.789034Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895554985681403:8075]
2025-09-30T14:53:45.789653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:45.789950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:45.789987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:45.790316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:45.790373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:45.790374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:45.790375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:45.790376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:45.790378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:45.790379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:45.790381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:45.790382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:45.790383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:45.790384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:45.790385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.790386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.790388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.790389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:45.790390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:45.790395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:45.790405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:45.790409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:45.790413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:45.790417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:45.790420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:45.790423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:45.790428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:45.790431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:45.790436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:45.790439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.790442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.790446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.790450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:45.790453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:45.790459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:45.790467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:45.790473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:45.790477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:45.790482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:45.790486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:45.790491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:45.790496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:45.790502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:45.790506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:45.790511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:45.790534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:45.790538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:45.790543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:45.790547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:45.790551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:45.790556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:45.790561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:45.790565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:45.790569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:45.790574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.790579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.790582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.790587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.790591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.790596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.790599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:45.790604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:45.790609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:45.790613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:45.790652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:45.799045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:45.799993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:45.800013Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:45.800016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:45.800020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:45.800028Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1315 [2:7555895554985681403:8075]
2025-09-30T14:53:45.800046Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:45.800064Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:45.800072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:45.800076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:45.800078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:45.800094Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:45.800101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:45.800108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:45.800180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.800187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.800190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.800194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:45.800197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:45.800432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:45.800416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1315
2025-09-30T14:53:45.800445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.800424Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1315
2025-09-30T14:53:45.800458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.800470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.800486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:45.800505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895555075431623:2557], now have 1 active actors on pipe
2025-09-30T14:53:45.800513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895555075431479:2454], now have 1 active actors on pipe
2025-09-30T14:53:45.800533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:45.800541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:45.800556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895554985681398:8075]
2025-09-30T14:53:45.800562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895554985681398:8075]
2025-09-30T14:53:45.800565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895554985681398:8075]
2025-09-30T14:53:45.800579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:45.800592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:45.800595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:45.800598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:45.800600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:45.800611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:45.800614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:45.800632Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31e2e34b-5856b916-2df9dd91-aaa687a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:45.800643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:45.800653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:45.800655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:45.800664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:45.800677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:45.800719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895554985681398:8075]
2025-09-30T14:53:45.800731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:45.800737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:45.800745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:45.800892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:45.800902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:45.800922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:45.801019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1316 partition: 0 MaxSeqNo: 42 sessionId: src_id|31e2e34b-5856b916-2df9dd91-aaa687a8_0
2025-09-30T14:53:45.801379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25e77868-b5948db-e3934e53-cec3a621_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|31e2e34b-5856b916-2df9dd91-aaa687a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:45.804382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31e2e34b-5856b916-2df9dd91-aaa687a8_0] Write session: try to update token
2025-09-30T14:53:45.804403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31e2e34b-5856b916-2df9dd91-aaa687a8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:45.813454Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:45.813481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:45.813492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895554985681398:8075]
2025-09-30T14:53:45.813549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:45.813550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:45.813741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:45.813894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:45.814059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:45.814212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:45.814402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:45.814445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:45.822560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1316 sessionId: src_id|31e2e34b-5856b916-2df9dd91-aaa687a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:45.825362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:45.825625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:45.825652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:45.825692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:45.827427Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:45.827447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:45.827449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:45.827451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:45.827462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895554985681398:8075]
2025-09-30T14:53:45.827466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895554985681398:8075]
2025-09-30T14:53:45.827469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895554985681398:8075]
2025-09-30T14:53:45.827505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:45.827517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.827516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:45.827519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:45.827523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:45.827527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:45.827677Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:45.825849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:45.869514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895555075431638:2659]
2025-09-30T14:53:45.870080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1315, pipe: [1:7555895555075431638:2659]
2025-09-30T14:53:45.946893Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:45.955925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:45.955957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:45.956144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:45.956208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:45.956273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:45.956338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:45.956388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:45.956393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:45.956468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:45.956530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:45.956595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:45.956670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:45.956713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:45.956717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:45.956791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:45.956855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:45.956920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:45.956987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:45.957029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:45.957032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:45.957108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:45.957173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:45.957244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:45.957310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:45.957566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:45.957571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:45.957646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:45.957713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:45.957778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:45.957846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:45.957891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:45.957894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:45.957973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:45.958054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:45.958118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:45.958182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:45.958224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:45.958228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:45.958310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:45.958371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:45.958439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:45.958502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:45.958552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:45.958555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:45.958628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:45.958688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:45.958750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:45.958823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:45.958872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:45.958876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:45.958954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:45.959019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:45.959079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:45.959136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:45.959176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:45.959178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:45.959271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:45.959338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:45.959401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:45.959463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:45.959506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:45.959509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:45.959584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895555075431638:2659], now have 1 active actors on pipe
2025-09-30T14:53:45.960653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e2e34b-5856b916-2df9dd91-aaa687a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:45.960666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e2e34b-5856b916-2df9dd91-aaa687a8_0] Write session will restart in 0.005056s
2025-09-30T14:53:45.960690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e2e34b-5856b916-2df9dd91-aaa687a8_0] Write session: Do CDS request
2025-09-30T14:53:45.960695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e2e34b-5856b916-2df9dd91-aaa687a8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:45.960669Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:45.959922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:45.959939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:45.959979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1316 reason: error at write: Disconnected sessionId: src_id|31e2e34b-5856b916-2df9dd91-aaa687a8_0
2025-09-30T14:53:45.960189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1316 sessionId: src_id|31e2e34b-5856b916-2df9dd91-aaa687a8_0 is DEAD
2025-09-30T14:53:45.960401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895555075431638:2659]
2025-09-30T14:53:45.960420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:45.966759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31e2e34b-5856b916-2df9dd91-aaa687a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:45.967069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:45.967099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1317
2025-09-30T14:53:45.967318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1317 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:45.967355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1317 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:45.967362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1317 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:45.967367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:45.967857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1317 sessionId:  describe result for acl check
2025-09-30T14:53:45.967887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:45.967889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:45.967891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:45.967898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895555075431658:2552] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:45.968556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895555075431658:2552] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:45.972508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895555075431658:2552] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:45.982103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895555075431658:2552] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:45.982128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895555075431658:2552] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:45.982133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895555075431658:2552] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:45.982145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1317 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:45.982509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:45.983160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:45.983500Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:45.983518Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:45.983533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:45.983607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:45.983665Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895554985681554:8077]
2025-09-30T14:53:45.984472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:45.985102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:45.985164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:45.985616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:45.985705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:45.985713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:45.985714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:45.985716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:45.985717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:45.985718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:45.985720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:45.985721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:45.985724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:45.985725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:45.985727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.985728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.985730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.985731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:45.985733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:45.985741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:45.985754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:45.985759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:45.985763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:45.985768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:45.985773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:45.985778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:45.985782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:45.985785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:45.985789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:45.985793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.985797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.985801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.985805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:45.985809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:45.985819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:45.985829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:45.985836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:45.985843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:45.985850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:45.985856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:45.985862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:45.985867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:45.985873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:45.985879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:45.985884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:45.985889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:45.985896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:45.985901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:45.985906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:45.985913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:45.985918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:45.985924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:45.985929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:45.985935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:45.985940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.985945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:45.985950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.985956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:45.985972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.985978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:45.985982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:45.985988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:45.986011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:45.986017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:45.986074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:46.008100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:46.009114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:46.009137Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:46.009142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:46.009146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:46.009155Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1316 [2:7555895554985681554:8077]
2025-09-30T14:53:46.009177Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:46.009199Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:46.009203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:46.009206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:46.009210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:46.009232Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:46.009242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:46.009251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:46.009337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.009347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:46.009349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:46.009354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:46.009357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:46.009445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:46.009454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.009469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:46.009480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:46.009500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:46.009522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895554985681547:8077]
2025-09-30T14:53:46.009526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895554985681547:8077]
2025-09-30T14:53:46.009529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895554985681547:8077]
2025-09-30T14:53:46.009541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:46.009560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:46.009587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:46.009588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:46.009594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:46.009596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:46.009597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:46.009609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895555075431643:2454], now have 1 active actors on pipe
2025-09-30T14:53:46.009613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895555075431786:2552], now have 1 active actors on pipe
2025-09-30T14:53:46.009657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895554985681547:8077]
2025-09-30T14:53:46.009672Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:46.009752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:46.009763Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1316
2025-09-30T14:53:46.009829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1316
2025-09-30T14:53:46.013404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:46.013433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:46.013489Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13e27c9c-3c093e2d-719e0cdd-bbb6d1f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:46.013509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:46.013515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:46.013519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:46.013547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:46.013569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:46.013594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:46.014003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:46.014020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:46.014061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:46.014253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1317 partition: 0 MaxSeqNo: 42 sessionId: src_id|13e27c9c-3c093e2d-719e0cdd-bbb6d1f_0
2025-09-30T14:53:46.014716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e2e34b-5856b916-2df9dd91-aaa687a8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|13e27c9c-3c093e2d-719e0cdd-bbb6d1f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:46.017503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13e27c9c-3c093e2d-719e0cdd-bbb6d1f_0] Write session: try to update token
2025-09-30T14:53:46.017545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13e27c9c-3c093e2d-719e0cdd-bbb6d1f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:46.033227Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:46.033253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:46.033257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:46.033260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:46.033273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895554985681547:8077]
2025-09-30T14:53:46.033279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895554985681547:8077]
2025-09-30T14:53:46.033284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895554985681547:8077]
2025-09-30T14:53:46.033335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:46.033344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.033347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:46.033545Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:46.035368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:46.035376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:46.035380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:46.051194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1317 sessionId: src_id|13e27c9c-3c093e2d-719e0cdd-bbb6d1f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:46.053947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:46.059963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895559370399100:2659]
2025-09-30T14:53:46.060833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1316, pipe: [1:7555895559370399100:2659]
2025-09-30T14:53:46.154724Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:46.155436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:46.155453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:46.155473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895559370399100:2659], now have 1 active actors on pipe
2025-09-30T14:53:46.155718Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:46.156694Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:46.156755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:46.156850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1317 reason: status is not ok: tablet will be restarted right now sessionId: src_id|13e27c9c-3c093e2d-719e0cdd-bbb6d1f_0
2025-09-30T14:53:46.157067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1317 sessionId: src_id|13e27c9c-3c093e2d-719e0cdd-bbb6d1f_0 is DEAD
2025-09-30T14:53:46.157247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895559370399100:2659]
2025-09-30T14:53:46.159421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13e27c9c-3c093e2d-719e0cdd-bbb6d1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:46.159435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13e27c9c-3c093e2d-719e0cdd-bbb6d1f_0] Write session will restart in 0.007106s
2025-09-30T14:53:46.159470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13e27c9c-3c093e2d-719e0cdd-bbb6d1f_0] Write session: Do CDS request
2025-09-30T14:53:46.159478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13e27c9c-3c093e2d-719e0cdd-bbb6d1f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:46.167900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13e27c9c-3c093e2d-719e0cdd-bbb6d1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:46.171739Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:46.171759Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1318
2025-09-30T14:53:46.172212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1318 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:46.172256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1318 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:46.172262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1318 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:46.172267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:46.172749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1318 sessionId:  describe result for acl check
2025-09-30T14:53:46.172782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:46.172784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:46.172786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:46.172793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895559370399119:2549] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:46.173446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895559370399119:2549] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:46.175810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895559370399119:2549] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:46.180841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895559370399119:2549] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:46.180865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895559370399119:2549] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:46.180869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895559370399119:2549] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:46.180878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1318 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:46.183912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:46.187704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:46.187943Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:46.187952Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:46.187963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:46.188028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:46.188080Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895559280649003:8079]
2025-09-30T14:53:46.188733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:46.189129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:46.189191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:46.189576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:46.189650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:46.189656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:46.189658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:46.189659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:46.189660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:46.189662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:46.189663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:46.189665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:46.189666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:46.189668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:46.189669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.189670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:46.189672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:46.189673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:46.189674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:46.189681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:46.189691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:46.189696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:46.189700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:46.189705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:46.189709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:46.189713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:46.189718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:46.189722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:46.189727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:46.189732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.189736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:46.189739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:46.189744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:46.189748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:46.189757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:46.189765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:46.189772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:46.189778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:46.189783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:46.189788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:46.189792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:46.189797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:46.189802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:46.189808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:46.189815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:46.189820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:46.189824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:46.189829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:46.189833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:46.189840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:46.189853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:46.189858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:46.189862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:46.189868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:46.189873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.189878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.189883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:46.189889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:46.189899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:46.189905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:46.189913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:46.189919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:46.189926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:46.189931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:46.189980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:46.198200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:46.199263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:46.199286Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:46.199289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:46.199294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:46.199304Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1317 [2:7555895559280649003:8079]
2025-09-30T14:53:46.199898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1317
2025-09-30T14:53:46.199906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1317
2025-09-30T14:53:46.199326Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:46.199347Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:46.199352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:46.199356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:46.199359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:46.199380Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:46.199389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:46.199398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:46.199476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.199479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:46.199482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:46.199486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:46.199490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:46.199586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:46.199590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.199609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:46.199622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:46.199639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:46.199661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895559280648998:8079]
2025-09-30T14:53:46.199664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895559280648998:8079]
2025-09-30T14:53:46.199666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895559280648998:8079]
2025-09-30T14:53:46.199678Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:46.199690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:46.199695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:46.199697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:46.199699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895559370399238:2549], now have 1 active actors on pipe
2025-09-30T14:53:46.199705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:46.199721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:46.199725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:46.199732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895559370399105:2454], now have 1 active actors on pipe
2025-09-30T14:53:46.199776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895559280648998:8079]
2025-09-30T14:53:46.199787Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:46.199996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:46.200206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:46.200221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:46.200255Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56c81a62-4e0cce1b-35d8c1d0-ad3eac8e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:46.200265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:46.200269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:46.200272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:46.200285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:46.200301Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:46.200329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:46.200715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:46.200724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:46.200741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:46.203773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1318 partition: 0 MaxSeqNo: 42 sessionId: src_id|56c81a62-4e0cce1b-35d8c1d0-ad3eac8e_0
2025-09-30T14:53:46.204280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13e27c9c-3c093e2d-719e0cdd-bbb6d1f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|56c81a62-4e0cce1b-35d8c1d0-ad3eac8e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:46.207199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56c81a62-4e0cce1b-35d8c1d0-ad3eac8e_0] Write session: try to update token
2025-09-30T14:53:46.207223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56c81a62-4e0cce1b-35d8c1d0-ad3eac8e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:46.216538Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:46.216582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:46.216585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:46.216588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:46.216600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895559280648998:8079]
2025-09-30T14:53:46.216605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895559280648998:8079]
2025-09-30T14:53:46.216615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895559280648998:8079]
2025-09-30T14:53:46.216678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:46.216684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:46.216688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.216691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:46.216692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:46.216697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:46.216848Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:46.232527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1318 sessionId: src_id|56c81a62-4e0cce1b-35d8c1d0-ad3eac8e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:46.235380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:46.257610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895559370399277:2659]
2025-09-30T14:53:46.258076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1317, pipe: [1:7555895559370399277:2659]
2025-09-30T14:53:46.338079Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:46.338600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:46.338617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:46.338637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895559370399277:2659], now have 1 active actors on pipe
2025-09-30T14:53:46.339022Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:46.338865Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:46.339381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:46.339496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1318 reason: status is not ok: tablet will be restarted right now sessionId: src_id|56c81a62-4e0cce1b-35d8c1d0-ad3eac8e_0
2025-09-30T14:53:46.339727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1318 sessionId: src_id|56c81a62-4e0cce1b-35d8c1d0-ad3eac8e_0 is DEAD
2025-09-30T14:53:46.339927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895559370399277:2659]
2025-09-30T14:53:46.343643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56c81a62-4e0cce1b-35d8c1d0-ad3eac8e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:46.343657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56c81a62-4e0cce1b-35d8c1d0-ad3eac8e_0] Write session will restart in 0.008352s
2025-09-30T14:53:46.343696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56c81a62-4e0cce1b-35d8c1d0-ad3eac8e_0] Write session: Do CDS request
2025-09-30T14:53:46.343701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56c81a62-4e0cce1b-35d8c1d0-ad3eac8e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:46.352844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56c81a62-4e0cce1b-35d8c1d0-ad3eac8e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:46.353191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:46.353211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1319
2025-09-30T14:53:46.353352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1319 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:46.353381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1319 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:46.353386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1319 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:46.353390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:46.353851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1319 sessionId:  describe result for acl check
2025-09-30T14:53:46.353888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:46.353892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:46.353894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:46.353899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895559370399308:2530] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:46.354442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895559370399308:2530] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:46.356365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895559370399308:2530] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:46.364221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895559370399308:2530] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:46.364243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895559370399308:2530] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:46.364249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895559370399308:2530] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:46.364258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1319 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:46.368546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:46.370879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:46.371111Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:46.371132Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:46.371143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:46.371196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:46.371236Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895559280649200:8089]
2025-09-30T14:53:46.371950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:46.372250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:46.372296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:46.372657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:46.372718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:46.372725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:46.372726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:46.372727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:46.372728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:46.372730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:46.372731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:46.372733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:46.372734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:46.372735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:46.372737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.372738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:46.372740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:46.372741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:46.372742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:46.372748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:46.372759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:46.372765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:46.372770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:46.372775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:46.372779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:46.372784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:46.372789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:46.372793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:46.372799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:46.372803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.372808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:46.372812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:46.372817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:46.372821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:46.372829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:46.372838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:46.372845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:46.372855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:46.372860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:46.372872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:46.372877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:46.372887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:46.372893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:46.372899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:46.372909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:46.372915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:46.372925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:46.372931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:46.372939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:46.372945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:46.372952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:46.372959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:46.372969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:46.372975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:46.372980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.372987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.372993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:46.372999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:46.373006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:46.373012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:46.373021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:46.373028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:46.373037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:46.373044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:46.373103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:46.380029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:46.381568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:46.381587Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:46.381589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:46.381593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:46.381600Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1318 [2:7555895559280649200:8089]
2025-09-30T14:53:46.381616Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:46.381634Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:46.381637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:46.382222Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1318
2025-09-30T14:53:46.382274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1318
2025-09-30T14:53:46.381639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:46.381642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:46.381659Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:46.381666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:46.381673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:46.381740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.381743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:46.381745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:46.381749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:46.381751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:46.381822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:46.381824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.381834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:46.381841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:46.381851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:46.381863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895559280649191:8089]
2025-09-30T14:53:46.381865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895559280649191:8089]
2025-09-30T14:53:46.381866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895559280649191:8089]
2025-09-30T14:53:46.381878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:46.381889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:46.381900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:46.381902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:46.381932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895559280649191:8089]
2025-09-30T14:53:46.381933Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:46.381947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:46.381951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:46.381953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:46.381960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:46.382110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895559370399291:2454], now have 1 active actors on pipe
2025-09-30T14:53:46.382118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895559370399405:2530], now have 1 active actors on pipe
2025-09-30T14:53:46.382383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:46.382391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:46.382419Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2d5d9f-9bde0013-1abb081a-6d386c22_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:46.382428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:46.382432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:46.382434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:46.382445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:46.382456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:46.382474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:46.382741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:46.382755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:46.382779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:46.382907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1319 partition: 0 MaxSeqNo: 42 sessionId: src_id|c2d5d9f-9bde0013-1abb081a-6d386c22_0
2025-09-30T14:53:46.383319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56c81a62-4e0cce1b-35d8c1d0-ad3eac8e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c2d5d9f-9bde0013-1abb081a-6d386c22_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:46.386154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2d5d9f-9bde0013-1abb081a-6d386c22_0] Write session: try to update token
2025-09-30T14:53:46.386174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2d5d9f-9bde0013-1abb081a-6d386c22_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:46.396965Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:46.396987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:46.396997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895559280649191:8089]
2025-09-30T14:53:46.397043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:46.397049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:46.397228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:46.397404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:46.397575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:46.397725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:46.397967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:46.398029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:46.404343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1319 sessionId: src_id|c2d5d9f-9bde0013-1abb081a-6d386c22_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:46.407388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:46.409149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:46.408945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:46.408969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:46.409005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:46.413093Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:46.413113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:46.413116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:46.413118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:46.413129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895559280649191:8089]
2025-09-30T14:53:46.413134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895559280649191:8089]
2025-09-30T14:53:46.413138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895559280649191:8089]
2025-09-30T14:53:46.413175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:46.413184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:46.413188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.413191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:46.413191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:46.413197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:46.413430Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:46.439860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895559370399462:2659]
2025-09-30T14:53:46.440210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1318, pipe: [1:7555895559370399462:2659]
2025-09-30T14:53:46.529760Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:46.538355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:46.538382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:46.538556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:46.538625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:46.538690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:46.538758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:46.538804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:46.538814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:46.538883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:46.538947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:46.539012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:46.539081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:46.539127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:46.539135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:46.539204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:46.539294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:46.539359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:46.539422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:46.539474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:46.539482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:46.539551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:46.539617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:46.539684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:46.539756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:46.539806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:46.539814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:46.539885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:46.539947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:46.540011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:46.540077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:46.540123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:46.540130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:46.540198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:46.540267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:46.540330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:46.540393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:46.540441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:46.540450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:46.540518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:46.540581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:46.540644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:46.540717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:46.540760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:46.540768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:46.540837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:46.540898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:46.540972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:46.541041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:46.541087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:46.541094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:46.542002Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:46.542018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895559370399462:2659]
2025-09-30T14:53:46.542047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:46.542050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:46.542076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1319 reason: error at write: Disconnected sessionId: src_id|c2d5d9f-9bde0013-1abb081a-6d386c22_0
2025-09-30T14:53:46.542277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1319 sessionId: src_id|c2d5d9f-9bde0013-1abb081a-6d386c22_0 is DEAD
2025-09-30T14:53:46.542404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2d5d9f-9bde0013-1abb081a-6d386c22_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:46.542410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2d5d9f-9bde0013-1abb081a-6d386c22_0] Write session will restart in 0.006351s
2025-09-30T14:53:46.542434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2d5d9f-9bde0013-1abb081a-6d386c22_0] Write session: Do CDS request
2025-09-30T14:53:46.542440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2d5d9f-9bde0013-1abb081a-6d386c22_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:46.541162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:46.541228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:46.541290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:46.541350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:46.541398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:46.541401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:46.541471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:46.541527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:46.541587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:46.541648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:46.541692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:46.541695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:46.541758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895559370399462:2659], now have 1 active actors on pipe
2025-09-30T14:53:46.543010Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:46.549822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2d5d9f-9bde0013-1abb081a-6d386c22_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:46.549947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:46.549967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1320
2025-09-30T14:53:46.550187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1320 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:46.550225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1320 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:46.550235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1320 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:46.550239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:46.550772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1320 sessionId:  describe result for acl check
2025-09-30T14:53:46.550813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:46.550822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:46.550825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:46.550830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895559370399498:2518] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:46.551421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895559370399498:2518] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:46.554831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895559370399498:2518] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:46.557116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:46.559513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:46.559759Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:46.559770Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:46.559782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:46.559852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:46.559892Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895559280649355:8097]
2025-09-30T14:53:46.560037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895559370399498:2518] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:46.560059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895559370399498:2518] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:46.560062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895559370399498:2518] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:46.560071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1320 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:46.560535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:46.561116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:46.561172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:46.561534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:46.561602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:46.561609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:46.561610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:46.561612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:46.561613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:46.561614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:46.561615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:46.561616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:46.561617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:46.561619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:46.561620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.561621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:46.561623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:46.561624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:46.561625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:46.561631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:46.561642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:46.561647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:46.561652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:46.561656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:46.561660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:46.561664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:46.561669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:46.561673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:46.561678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:46.561682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.561694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:46.561698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:46.561702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:46.561706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:46.561715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:46.561723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:46.561730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:46.561735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:46.561740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:46.561746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:46.561751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:46.561768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:46.561773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:46.561778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:46.561783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:46.561789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:46.561794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:46.561797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:46.561800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:46.561803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:46.561806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:46.561809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:46.561812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:46.561815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:46.561818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.561822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.561825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:46.561828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:46.561830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:46.561834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:46.561839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:46.561850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:46.561854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:46.561859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:46.561906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:46.567943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:46.569202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:46.569217Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:46.569220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:46.569224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:46.569229Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1319 [2:7555895559280649355:8097]
2025-09-30T14:53:46.569245Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:46.569260Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:46.569263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:46.569266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:46.569269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:46.569283Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:46.569289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:46.569294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:46.569350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.569356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:46.569358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:46.569361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:46.569364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:46.569432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:46.569440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.569455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:46.569470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:46.569492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:46.569513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895559280649350:8097]
2025-09-30T14:53:46.569522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895559280649350:8097]
2025-09-30T14:53:46.569524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895559280649350:8097]
2025-09-30T14:53:46.569533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:46.569545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:46.569555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:46.569557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:46.569559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:46.569559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:46.569562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:46.569593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895559280649350:8097]
2025-09-30T14:53:46.569596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:46.569600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:46.569606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895559370399617:2518], now have 1 active actors on pipe
2025-09-30T14:53:46.569610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895559370399467:2454], now have 1 active actors on pipe
2025-09-30T14:53:46.569779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:46.569790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:46.569820Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|856bed01-54353ec5-3d8b862a-61d3fec7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:46.569835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:46.569853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:46.569860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:46.569869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:46.569880Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:46.569729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1319
2025-09-30T14:53:46.569740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1319
2025-09-30T14:53:46.569900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:46.570139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:46.570149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:46.570166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:46.570281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1320 partition: 0 MaxSeqNo: 42 sessionId: src_id|856bed01-54353ec5-3d8b862a-61d3fec7_0
2025-09-30T14:53:46.570721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2d5d9f-9bde0013-1abb081a-6d386c22_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|856bed01-54353ec5-3d8b862a-61d3fec7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:46.573497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|856bed01-54353ec5-3d8b862a-61d3fec7_0] Write session: try to update token
2025-09-30T14:53:46.573516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|856bed01-54353ec5-3d8b862a-61d3fec7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:46.584336Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:46.584363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:46.584374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895559280649350:8097]
2025-09-30T14:53:46.584422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:46.584601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:46.584752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:46.584897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:46.585043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:46.585252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:46.585295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:46.585430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:46.588664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1320 sessionId: src_id|856bed01-54353ec5-3d8b862a-61d3fec7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:46.591479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:46.591944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:46.591973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:46.592011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:46.592180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:46.598232Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:46.598254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:46.598257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:46.598264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:46.598274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895559280649350:8097]
2025-09-30T14:53:46.598279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895559280649350:8097]
2025-09-30T14:53:46.598283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895559280649350:8097]
2025-09-30T14:53:46.598327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:46.598335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.598337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:46.598348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:46.598356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:46.598361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:46.598480Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:46.642096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895559370399628:2659]
2025-09-30T14:53:46.642580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1319, pipe: [1:7555895559370399628:2659]
2025-09-30T14:53:46.736856Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:46.745444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:46.745473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:46.745659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:46.745728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:46.745797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:46.745864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:46.745911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:46.745917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:46.746010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:46.746072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:46.746147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:46.746218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:46.746262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:46.746265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:46.746342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:46.746403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:46.746470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:46.746535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:46.746578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:46.746581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:46.746656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:46.746725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:46.746790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:46.746862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:46.746907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:46.746910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:46.746987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:46.747114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:46.750701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|856bed01-54353ec5-3d8b862a-61d3fec7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:46.750716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|856bed01-54353ec5-3d8b862a-61d3fec7_0] Write session will restart in 0.006216s
2025-09-30T14:53:46.750748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|856bed01-54353ec5-3d8b862a-61d3fec7_0] Write session: Do CDS request
2025-09-30T14:53:46.750754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|856bed01-54353ec5-3d8b862a-61d3fec7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:46.747442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:46.747520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:46.747563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:46.747567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:46.747646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:46.747711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:46.747779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:46.747847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:46.747893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:46.747897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:46.747969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:46.748034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:46.748099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:46.748167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:46.748210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:46.748213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:46.748291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:46.748360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:46.748425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:46.748493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:46.748537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:46.748541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:46.748616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:46.748678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:46.748743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:46.748813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:46.748857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:46.748863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:46.748934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:46.749014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:46.749084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:46.749148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:46.749194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:46.749199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:46.749273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895559370399628:2659], now have 1 active actors on pipe
2025-09-30T14:53:46.750442Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:46.750300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895559370399628:2659]
2025-09-30T14:53:46.750335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:46.750337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:46.750368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1320 reason: error at write: Disconnected sessionId: src_id|856bed01-54353ec5-3d8b862a-61d3fec7_0
2025-09-30T14:53:46.750548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1320 sessionId: src_id|856bed01-54353ec5-3d8b862a-61d3fec7_0 is DEAD
2025-09-30T14:53:46.750841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:46.757798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|856bed01-54353ec5-3d8b862a-61d3fec7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:46.757935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:46.757962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1321
2025-09-30T14:53:46.759713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1321 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:46.759762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1321 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:46.759768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1321 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:46.759772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:46.760274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1321 sessionId:  describe result for acl check
2025-09-30T14:53:46.760314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:46.760316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:46.760318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:46.760323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895559370399646:2506] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:46.760891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895559370399646:2506] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:46.766897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895559370399646:2506] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:46.776415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895559370399646:2506] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:46.776435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895559370399646:2506] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:46.776438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895559370399646:2506] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:46.776451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1321 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:46.783730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:46.786667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:46.786928Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:46.786942Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:46.786953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:46.787017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:46.787088Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895559280649513:8100]
2025-09-30T14:53:46.787720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:46.788156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:46.788204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:46.788559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:46.788637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:46.788639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:46.788640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:46.788642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:46.788644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:46.788645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:46.788646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:46.788648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:46.788649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:46.788651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:46.788652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.788654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:46.788655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:46.788656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:46.788658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:46.788664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:46.788675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:46.788680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:46.788684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:46.788688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:46.788693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:46.788697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:46.788701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:46.788704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:46.788709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:46.788713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.788717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:46.788721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:46.788726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:46.788730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:46.788738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:46.788746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:46.788752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:46.788758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:46.788766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:46.788772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:46.788776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:46.788783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:46.788788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:46.788794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:46.788799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:46.788804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:46.788809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:46.788813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:46.788818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:46.788822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:46.788827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:46.788833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:46.788838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:46.788844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:46.788849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.788853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.788858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:46.788862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:46.788866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:46.788871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:46.788875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:46.788880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:46.788885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:46.788889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:46.788931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:46.799547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:46.800453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:46.800460Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:46.800463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:46.800468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:46.800475Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1320 [2:7555895559280649513:8100]
2025-09-30T14:53:46.800493Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:46.800511Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:46.800515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:46.800518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:46.800521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:46.800537Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:46.800545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:46.800552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:46.800619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.800622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:46.800624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:46.800629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:46.800631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:46.800710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:46.800713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.800726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:46.800739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:46.800754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:46.800771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895559280649508:8100]
2025-09-30T14:53:46.800774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895559280649508:8100]
2025-09-30T14:53:46.800777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895559280649508:8100]
2025-09-30T14:53:46.800795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:46.800809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:46.800824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:46.800827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:46.800867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895559280649508:8100]
2025-09-30T14:53:46.800871Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:46.801365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:46.801374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:46.801376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:46.801382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:46.801732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895559370399631:2454], now have 1 active actors on pipe
2025-09-30T14:53:46.801743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895559370399725:2506], now have 1 active actors on pipe
2025-09-30T14:53:46.801912Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1320
2025-09-30T14:53:46.801960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1320
2025-09-30T14:53:46.806304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:46.806336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:46.806367Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dece1b54-5fec541c-74234558-446d9f6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:46.806388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:46.806393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:46.806396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:46.806410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:46.806426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:46.806447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:46.807286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:46.807298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:46.807328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:46.807523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1321 partition: 0 MaxSeqNo: 42 sessionId: src_id|dece1b54-5fec541c-74234558-446d9f6b_0
2025-09-30T14:53:46.807900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|856bed01-54353ec5-3d8b862a-61d3fec7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dece1b54-5fec541c-74234558-446d9f6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:46.818000Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-09-30T14:53:46.818037Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 7
2025-09-30T14:53:46.819441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dece1b54-5fec541c-74234558-446d9f6b_0] Write session: try to update token
2025-09-30T14:53:46.819460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dece1b54-5fec541c-74234558-446d9f6b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:46.821718Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:46.821734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:46.821737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:46.821740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:46.821750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895559280649508:8100]
2025-09-30T14:53:46.821754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895559280649508:8100]
2025-09-30T14:53:46.821758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895559280649508:8100]
2025-09-30T14:53:46.822273Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 85826639 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:53:46.822655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:46.822672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:46.822677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:46.823008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:46.823021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.823024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:46.823166Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:46.827097Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 7 DataSize: 85826639 UsedReserveSize: 0
2025-09-30T14:53:46.827161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:53:46.843132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1321 sessionId: src_id|dece1b54-5fec541c-74234558-446d9f6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:46.850516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895559370399800:2659]
2025-09-30T14:53:46.850972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1320, pipe: [1:7555895559370399800:2659]
2025-09-30T14:53:46.852204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:46.948577Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:46.948890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895559370399800:2659], now have 1 active actors on pipe
2025-09-30T14:53:46.948916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:46.948922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:46.949268Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:46.949661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dece1b54-5fec541c-74234558-446d9f6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:46.949673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dece1b54-5fec541c-74234558-446d9f6b_0] Write session will restart in 0.007348s
2025-09-30T14:53:46.949697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dece1b54-5fec541c-74234558-446d9f6b_0] Write session: Do CDS request
2025-09-30T14:53:46.949703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dece1b54-5fec541c-74234558-446d9f6b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:46.949214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:46.949238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:46.949243Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 0
2025-09-30T14:53:46.949243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:46.949288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895559370399800:2659]
2025-09-30T14:53:46.949318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1321 reason: error at write: Disconnected sessionId: src_id|dece1b54-5fec541c-74234558-446d9f6b_0
2025-09-30T14:53:46.949526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1321 sessionId: src_id|dece1b54-5fec541c-74234558-446d9f6b_0 is DEAD
2025-09-30T14:53:46.957812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dece1b54-5fec541c-74234558-446d9f6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:46.957922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:46.957943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1322
2025-09-30T14:53:46.958075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1322 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:46.958121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1322 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:46.958126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1322 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:46.958130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:46.958537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1322 sessionId:  describe result for acl check
2025-09-30T14:53:46.958572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:46.958575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:46.958576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:46.958582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895559370399823:2502] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:46.959165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895559370399823:2502] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:46.962387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895559370399823:2502] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:46.965726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895559370399823:2502] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:46.965744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895559370399823:2502] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:46.965748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895559370399823:2502] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:46.965756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1322 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:46.967060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:46.969549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:46.969782Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:46.969791Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:46.969802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:46.969857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:46.969897Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895559280649670:8103]
2025-09-30T14:53:46.970592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:46.971017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:46.971091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:46.971486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:46.971579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:46.971581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:46.971582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:46.971584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:46.971585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:46.971587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:46.971588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:46.971589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:46.971591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:46.971592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:46.971593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.971595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:46.971596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:46.971598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:46.971599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:46.971606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:46.971618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:46.971623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:46.971628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:46.971633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:46.971638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:46.971642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:46.971647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:46.971651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:46.971657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:46.971661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.971666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:46.971670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:46.971675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:46.971679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:46.971688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:46.971697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:46.971717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:46.971724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:46.971731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:46.971737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:46.971742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:46.971748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:46.971754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:46.971759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:46.971764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:46.971770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:46.971776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:46.971782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:46.971788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:46.971793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:46.971798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:46.971804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:46.971809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:46.971815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:46.971820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.971826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.971831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:46.971837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:46.971842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:46.971848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:46.971853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:46.971858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:46.971864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:46.971870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:46.971919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:46.981320Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1321
2025-09-30T14:53:46.981345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1321
2025-09-30T14:53:46.981849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 8 DataSize: 85826639 UsedReserveSize: 0
2025-09-30T14:53:46.981885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:53:46.982213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1322 partition: 0 MaxSeqNo: 42 sessionId: src_id|378fd7e1-74996bbb-21248ed8-5c5db7ea_0
2025-09-30T14:53:46.979928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:46.980814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:46.980820Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:46.980823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:46.980828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:46.980835Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1321 [2:7555895559280649670:8103]
2025-09-30T14:53:46.980854Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:46.980871Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:46.980875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:46.980878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:46.980881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:46.980899Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:46.980906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:46.980914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:46.980980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.980983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:46.980986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:46.980990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:46.980993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:46.981065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:46.981069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:46.981080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:46.981091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:46.981107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:46.981125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895559280649665:8103]
2025-09-30T14:53:46.981127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895559280649665:8103]
2025-09-30T14:53:46.981129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895559280649665:8103]
2025-09-30T14:53:46.981137Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:46.981149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:46.981152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895559370399805:2454], now have 1 active actors on pipe
2025-09-30T14:53:46.981154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:46.981157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:46.981161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895559370399955:2502], now have 1 active actors on pipe
2025-09-30T14:53:46.981167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:46.981180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:46.981183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:46.981220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895559280649665:8103]
2025-09-30T14:53:46.981230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:46.981267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:46.981558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:46.981564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:46.981616Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 85826639 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:53:46.981647Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|378fd7e1-74996bbb-21248ed8-5c5db7ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:46.981654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:46.981658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:46.981661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:46.981672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:46.981683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:46.981697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:46.982060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:46.982065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:46.982083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:46.982607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dece1b54-5fec541c-74234558-446d9f6b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|378fd7e1-74996bbb-21248ed8-5c5db7ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:46.985497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|378fd7e1-74996bbb-21248ed8-5c5db7ea_0] Write session: try to update token
2025-09-30T14:53:46.985517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|378fd7e1-74996bbb-21248ed8-5c5db7ea_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:47.005686Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:47.005710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:47.005712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:47.005715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:47.005724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895559280649665:8103]
2025-09-30T14:53:47.005729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895559280649665:8103]
2025-09-30T14:53:47.005733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895559280649665:8103]
2025-09-30T14:53:47.005740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1322 sessionId: src_id|378fd7e1-74996bbb-21248ed8-5c5db7ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:47.005774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:47.005781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.005783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:47.005786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:47.005793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:47.005798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:47.005918Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:47.008662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:47.052808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895563665367273:2659]
2025-09-30T14:53:47.053136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1321, pipe: [1:7555895563665367273:2659]
2025-09-30T14:53:47.125307Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:47.125629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:47.125649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:47.125689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895563665367273:2659], now have 1 active actors on pipe
2025-09-30T14:53:47.127546Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:47.128934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:47.128961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895563665367273:2659]
2025-09-30T14:53:47.128998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:47.129074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1322 reason: status is not ok: tablet will be restarted right now sessionId: src_id|378fd7e1-74996bbb-21248ed8-5c5db7ea_0
2025-09-30T14:53:47.129302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1322 sessionId: src_id|378fd7e1-74996bbb-21248ed8-5c5db7ea_0 is DEAD
2025-09-30T14:53:47.129447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|378fd7e1-74996bbb-21248ed8-5c5db7ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:47.129456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|378fd7e1-74996bbb-21248ed8-5c5db7ea_0] Write session will restart in 0.006361s
2025-09-30T14:53:47.129480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|378fd7e1-74996bbb-21248ed8-5c5db7ea_0] Write session: Do CDS request
2025-09-30T14:53:47.129486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|378fd7e1-74996bbb-21248ed8-5c5db7ea_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:47.136784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|378fd7e1-74996bbb-21248ed8-5c5db7ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:47.136915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:47.136934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1323
2025-09-30T14:53:47.138832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1323 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:47.138880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1323 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:47.138885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1323 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:47.138892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:47.139433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1323 sessionId:  describe result for acl check
2025-09-30T14:53:47.139472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:47.139474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:47.139476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:47.139483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895563665367310:2498] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:47.140048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895563665367310:2498] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:47.145440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:47.145770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895563665367310:2498] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:47.146320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:47.146497Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:47.146508Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:47.146517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:47.146560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:47.146604Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895563575617123:8106]
2025-09-30T14:53:47.147197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:47.148351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:47.148421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:47.148731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:47.148797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:47.148798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:47.148800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:47.148801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:47.148802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:47.148804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:47.148805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:47.148806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:47.148807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:47.148808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:47.148810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.148811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:47.148812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:47.148813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:47.148814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:47.148820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:47.148840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:47.148844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:47.148849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:47.148853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:47.148857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:47.148861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:47.148866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:47.148870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:47.148874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:47.148876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.148878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:47.148883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:47.148887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:47.148891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:47.148899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:47.148908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:47.148914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:47.148920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:47.148925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:47.148930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:47.148934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:47.148940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:47.148945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:47.148948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:47.148951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:47.148954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:47.148957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:47.148960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:47.148963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:47.148966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:47.148969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:47.148972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:47.148974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:47.148978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:47.148981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.148984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.148986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:47.148989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:47.148993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:47.148996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:47.148999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:47.149002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:47.149005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:47.149008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:47.149032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:47.157834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895563665367310:2498] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:47.157856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895563665367310:2498] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:47.157860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895563665367310:2498] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:47.157870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1323 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:47.160766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:47.161746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:47.161764Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:47.161767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:47.161771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:47.161779Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1322 [2:7555895563575617123:8106]
2025-09-30T14:53:47.161798Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:47.161816Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:47.161826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:47.161829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:47.161832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:47.161849Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:47.161862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:47.161875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:47.161946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.161957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:47.161959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:47.161963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:47.161966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:47.162048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:47.162057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.162071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:47.162087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:47.162108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:47.162130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895563575617117:8106]
2025-09-30T14:53:47.162137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895563575617117:8106]
2025-09-30T14:53:47.162139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895563575617117:8106]
2025-09-30T14:53:47.162149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:47.162158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:47.162160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:47.162163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:47.162166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895563665367447:2498], now have 1 active actors on pipe
2025-09-30T14:53:47.162169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895563665367281:2454], now have 1 active actors on pipe
2025-09-30T14:53:47.162174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:47.162188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:47.162191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:47.162244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895563575617117:8106]
2025-09-30T14:53:47.162251Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:47.162262Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1322
2025-09-30T14:53:47.162266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1322
2025-09-30T14:53:47.162335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:47.162643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:47.162657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:47.162684Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8eced4d-a8f9611b-3d16df24-71c3e770_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:47.162693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:47.162703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:47.162705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:47.162724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:47.162735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:47.162753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:47.163136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:47.163150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:47.163173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:47.163321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1323 partition: 0 MaxSeqNo: 42 sessionId: src_id|f8eced4d-a8f9611b-3d16df24-71c3e770_0
2025-09-30T14:53:47.163792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|378fd7e1-74996bbb-21248ed8-5c5db7ea_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f8eced4d-a8f9611b-3d16df24-71c3e770_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:47.166755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8eced4d-a8f9611b-3d16df24-71c3e770_0] Write session: try to update token
2025-09-30T14:53:47.166775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8eced4d-a8f9611b-3d16df24-71c3e770_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:47.180658Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:47.180678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:47.180681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:47.180683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:47.180694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895563575617117:8106]
2025-09-30T14:53:47.180699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895563575617117:8106]
2025-09-30T14:53:47.180703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895563575617117:8106]
2025-09-30T14:53:47.180746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:47.180753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:47.180755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.180758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:47.180758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:47.180765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:47.180893Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:47.192258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1323 sessionId: src_id|f8eced4d-a8f9611b-3d16df24-71c3e770_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:47.195017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:47.229377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895563665367455:2659]
2025-09-30T14:53:47.229741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1322, pipe: [1:7555895563665367455:2659]
2025-09-30T14:53:47.319810Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:47.320355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:47.320371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:47.320411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895563665367455:2659], now have 1 active actors on pipe
2025-09-30T14:53:47.320618Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:47.321192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:47.321195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:47.321209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:47.321241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895563665367455:2659]
2025-09-30T14:53:47.321277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1323 reason: error at write: Disconnected sessionId: src_id|f8eced4d-a8f9611b-3d16df24-71c3e770_0
2025-09-30T14:53:47.321468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1323 sessionId: src_id|f8eced4d-a8f9611b-3d16df24-71c3e770_0 is DEAD
2025-09-30T14:53:47.325466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8eced4d-a8f9611b-3d16df24-71c3e770_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:47.325478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8eced4d-a8f9611b-3d16df24-71c3e770_0] Write session will restart in 0.006265s
2025-09-30T14:53:47.325506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8eced4d-a8f9611b-3d16df24-71c3e770_0] Write session: Do CDS request
2025-09-30T14:53:47.325515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8eced4d-a8f9611b-3d16df24-71c3e770_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:47.336225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8eced4d-a8f9611b-3d16df24-71c3e770_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:47.336587Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:47.336618Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1324
2025-09-30T14:53:47.339748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1324 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:47.339809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1324 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:47.339815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1324 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:47.339820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:47.342324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1324 sessionId:  describe result for acl check
2025-09-30T14:53:47.342369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:47.342371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:47.342374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:47.342381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895563665367486:2490] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:47.342953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895563665367486:2490] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:47.349100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895563665367486:2490] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:47.353084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895563665367486:2490] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:47.353104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895563665367486:2490] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:47.353108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895563665367486:2490] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:47.353118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1324 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:47.353354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:47.356078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:47.356257Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:47.356267Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:47.356278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:47.356334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:47.356375Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895563575617295:8110]
2025-09-30T14:53:47.357005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:47.357586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:47.357636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:47.357902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:47.357960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:47.357966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:47.357968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:47.357969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:47.357970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:47.357971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:47.357972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:47.357973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:47.357974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:47.357975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:47.357976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.357976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:47.357977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:47.357978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:47.357979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:47.357997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:47.358005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:47.358010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:47.358014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:47.358019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:47.358024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:47.358028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:47.358032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:47.358036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:47.358040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:47.358044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.358048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:47.358052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:47.358056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:47.358061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:47.358067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:47.358075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:47.358080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:47.358085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:47.358093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:47.358098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:47.358102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:47.358106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:47.358110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:47.358116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:47.358119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:47.358125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:47.358129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:47.358144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:47.358148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:47.358153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:47.358159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:47.358164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:47.358168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:47.358174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:47.358178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.358184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.358188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:47.358193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:47.358199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:47.358204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:47.358208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:47.358212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:47.358217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:47.358221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:47.358267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:47.367535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:47.368443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:47.368463Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:47.368466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:47.368470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:47.368477Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1323 [2:7555895563575617295:8110]
2025-09-30T14:53:47.368494Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:47.368510Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:47.368514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:47.368517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:47.368520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:47.368536Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:47.368543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:47.368560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:47.368623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.368632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:47.368634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:47.368637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:47.368640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:47.368711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:47.368719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.368733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:47.368748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:47.368770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:47.368794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895563665367470:2454], now have 1 active actors on pipe
2025-09-30T14:53:47.368803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895563665367623:2490], now have 1 active actors on pipe
2025-09-30T14:53:47.368810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895563575617288:8110]
2025-09-30T14:53:47.368820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895563575617288:8110]
2025-09-30T14:53:47.368823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895563575617288:8110]
2025-09-30T14:53:47.368836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:47.368851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:47.368865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:47.368868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:47.368906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895563575617288:8110]
2025-09-30T14:53:47.368909Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:47.368914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:47.368918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:47.368920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:47.368927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:47.369395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:47.369408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:47.369434Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91ef7912-8b021f65-d4a90557-90a3037f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:47.369444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:47.369453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:47.369456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:47.369467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:47.369483Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:47.369502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:47.369887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:47.369902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:47.369938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:47.370539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8eced4d-a8f9611b-3d16df24-71c3e770_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|91ef7912-8b021f65-d4a90557-90a3037f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:47.369081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1323
2025-09-30T14:53:47.369126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1323
2025-09-30T14:53:47.370111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1324 partition: 0 MaxSeqNo: 42 sessionId: src_id|91ef7912-8b021f65-d4a90557-90a3037f_0
2025-09-30T14:53:47.373647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91ef7912-8b021f65-d4a90557-90a3037f_0] Write session: try to update token
2025-09-30T14:53:47.373667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91ef7912-8b021f65-d4a90557-90a3037f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:47.393607Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:47.393626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:47.393628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:47.393630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:47.393639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895563575617288:8110]
2025-09-30T14:53:47.393642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895563575617288:8110]
2025-09-30T14:53:47.393649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895563575617288:8110]
2025-09-30T14:53:47.393690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:47.393697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.393708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:47.393877Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:47.395467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1324 sessionId: src_id|91ef7912-8b021f65-d4a90557-90a3037f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:47.396611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:47.396635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:47.396640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:47.399849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:47.421378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895563665367648:2659]
2025-09-30T14:53:47.422120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1323, pipe: [1:7555895563665367648:2659]
2025-09-30T14:53:47.517308Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:47.517762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:47.517777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:47.517817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895563665367648:2659], now have 1 active actors on pipe
2025-09-30T14:53:47.518506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895563665367648:2659]
2025-09-30T14:53:47.518538Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:47.518569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:47.518573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:47.518200Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:47.518642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1324 reason: error at write: Disconnected sessionId: src_id|91ef7912-8b021f65-d4a90557-90a3037f_0
2025-09-30T14:53:47.518850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1324 sessionId: src_id|91ef7912-8b021f65-d4a90557-90a3037f_0 is DEAD
2025-09-30T14:53:47.519476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91ef7912-8b021f65-d4a90557-90a3037f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:47.519490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91ef7912-8b021f65-d4a90557-90a3037f_0] Write session will restart in 0.007395s
2025-09-30T14:53:47.519520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91ef7912-8b021f65-d4a90557-90a3037f_0] Write session: Do CDS request
2025-09-30T14:53:47.519529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91ef7912-8b021f65-d4a90557-90a3037f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:47.531709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91ef7912-8b021f65-d4a90557-90a3037f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:47.535568Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:47.535590Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1325
2025-09-30T14:53:47.535830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1325 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:47.535862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1325 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:47.535867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1325 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:47.535871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:47.536552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1325 sessionId:  describe result for acl check
2025-09-30T14:53:47.536585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:47.536587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:47.536589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:47.536595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895563665367676:2464] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:47.537151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895563665367676:2464] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:47.551284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895563665367676:2464] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:47.566485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:47.564142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895563665367676:2464] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:47.564164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895563665367676:2464] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:47.564167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895563665367676:2464] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:47.564177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1325 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:47.569153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:47.569347Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:47.569351Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:47.569362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:47.569410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:47.569450Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895563575617488:8124]
2025-09-30T14:53:47.570185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:47.570592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:47.570636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:47.570982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:47.571037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:47.571038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:47.571040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:47.571042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:47.571044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:47.571045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:47.571047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:47.571049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:47.571051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:47.571052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:47.571054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.571055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:47.571057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:47.571058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:47.571060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:47.571066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:47.571077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:47.571082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:47.571088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:47.571092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:47.571097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:47.571101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:47.571106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:47.571110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:47.571115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:47.571120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.571125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:47.571129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:47.571134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:47.571138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:47.571145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:47.571154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:47.571160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:47.571167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:47.571172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:47.571180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:47.571184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:47.571191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:47.571196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:47.571202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:47.571207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:47.571213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:47.571218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:47.571224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:47.571229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:47.571235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:47.571240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:47.571267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:47.571272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:47.571277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:47.571283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.571289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.571296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:47.571302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:47.571307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:47.571313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:47.571317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:47.571323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:47.571329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:47.571335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:47.571387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:47.580162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:47.581408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:47.581423Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:47.581427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:47.581432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:47.581438Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1324 [2:7555895563575617488:8124]
2025-09-30T14:53:47.581459Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:47.581476Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:47.581480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:47.581483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:47.581486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:47.581504Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:47.581511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:47.581518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:47.581588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.581591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:47.581596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:47.581600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:47.581603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:47.581676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:47.581678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.581692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:47.581705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:47.581725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:47.581743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895563575617482:8124]
2025-09-30T14:53:47.581746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895563575617482:8124]
2025-09-30T14:53:47.581749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895563575617482:8124]
2025-09-30T14:53:47.581764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:47.581778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:47.581794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:47.581798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:47.581836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895563575617482:8124]
2025-09-30T14:53:47.581839Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:47.581955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:47.581958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:47.581960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:47.581966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:47.582560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895563665367660:2454], now have 1 active actors on pipe
2025-09-30T14:53:47.582570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895563665367815:2464], now have 1 active actors on pipe
2025-09-30T14:53:47.582661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1324
2025-09-30T14:53:47.582702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1324
2025-09-30T14:53:47.583459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:47.583472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:47.583501Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69c6714a-7ec1a1af-40e42263-5a0482d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:47.583522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:47.583527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:47.583530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:47.583544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:47.583558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:47.583578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:47.587480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:47.587497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:47.587529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:47.587729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1325 partition: 0 MaxSeqNo: 42 sessionId: src_id|69c6714a-7ec1a1af-40e42263-5a0482d8_0
2025-09-30T14:53:47.591528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91ef7912-8b021f65-d4a90557-90a3037f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|69c6714a-7ec1a1af-40e42263-5a0482d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:47.594263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69c6714a-7ec1a1af-40e42263-5a0482d8_0] Write session: try to update token
2025-09-30T14:53:47.594286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69c6714a-7ec1a1af-40e42263-5a0482d8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:47.598269Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:47.598290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:47.598293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:47.598294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:47.598304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895563575617482:8124]
2025-09-30T14:53:47.598308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895563575617482:8124]
2025-09-30T14:53:47.598313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895563575617482:8124]
2025-09-30T14:53:47.598352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:47.598358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.598361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:47.598501Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:47.599755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:47.599768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:47.599773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:47.619639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895563665367828:2659]
2025-09-30T14:53:47.625141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1324, pipe: [1:7555895563665367828:2659]
2025-09-30T14:53:47.625172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1325 sessionId: src_id|69c6714a-7ec1a1af-40e42263-5a0482d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:47.627917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:47.729332Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:47.729918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895563665367828:2659], now have 1 active actors on pipe
2025-09-30T14:53:47.729951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:47.729963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:47.730251Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:47.730334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895563665367828:2659]
2025-09-30T14:53:47.731359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c6714a-7ec1a1af-40e42263-5a0482d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:47.731370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c6714a-7ec1a1af-40e42263-5a0482d8_0] Write session will restart in 0.005482s
2025-09-30T14:53:47.731394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c6714a-7ec1a1af-40e42263-5a0482d8_0] Write session: Do CDS request
2025-09-30T14:53:47.731400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c6714a-7ec1a1af-40e42263-5a0482d8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:47.730689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:47.730772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1325 reason: status is not ok: tablet will be restarted right now sessionId: src_id|69c6714a-7ec1a1af-40e42263-5a0482d8_0
2025-09-30T14:53:47.730967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1325 sessionId: src_id|69c6714a-7ec1a1af-40e42263-5a0482d8_0 is DEAD
2025-09-30T14:53:47.731083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:47.737789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69c6714a-7ec1a1af-40e42263-5a0482d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:47.738145Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:47.738160Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1326
2025-09-30T14:53:47.738298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1326 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:47.738345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1326 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:47.738359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1326 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:47.738364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:47.738868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1326 sessionId:  describe result for acl check
2025-09-30T14:53:47.738908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:47.738911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:47.738913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:47.738919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895563665367846:2459] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:47.739519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895563665367846:2459] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:47.742953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895563665367846:2459] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:47.745531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:47.745738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895563665367846:2459] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:47.745755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895563665367846:2459] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:47.745759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895563665367846:2459] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:47.745768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1326 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:47.748206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:47.748433Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:47.748443Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:47.748454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:47.748519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:47.748561Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895563575617648:8127]
2025-09-30T14:53:47.749216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:47.749602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:47.749674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:47.750044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:47.750119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:47.750126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:47.750127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:47.750128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:47.750129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:47.750131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:47.750132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:47.750134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:47.750135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:47.750136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:47.750138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.750139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:47.750140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:47.750141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:47.750142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:47.750149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:47.750160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:47.750165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:47.750169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:47.750174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:47.750179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:47.750183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:47.750188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:47.750192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:47.750197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:47.750201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.750206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:47.750210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:47.750215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:47.750219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:47.750229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:47.750238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:47.750245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:47.750251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:47.750256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:47.750261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:47.750266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:47.750273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:47.750278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:47.750284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:47.750289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:47.750295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:47.750301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:47.750306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:47.750311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:47.750317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:47.750321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:47.750327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:47.750331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:47.750337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:47.750342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.750348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.750352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:47.750358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:47.750364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:47.750378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:47.750382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:47.750393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:47.750398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:47.750409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:47.750456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:47.756580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:47.757504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:47.757522Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:47.757525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:47.757530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:47.757536Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1325 [2:7555895563575617648:8127]
2025-09-30T14:53:47.757553Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:47.757570Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:47.757573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:47.757577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:47.757580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:47.757598Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:47.757612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:47.757620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:47.757684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.757694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:47.757696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:47.757700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:47.757703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:47.757968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1325
2025-09-30T14:53:47.757980Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1325
2025-09-30T14:53:47.757777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:47.757785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.757799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:47.757811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:47.757830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:47.757851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895563665367986:2459], now have 1 active actors on pipe
2025-09-30T14:53:47.757854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895563665367831:2454], now have 1 active actors on pipe
2025-09-30T14:53:47.757861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895563575617642:8127]
2025-09-30T14:53:47.757863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895563575617642:8127]
2025-09-30T14:53:47.757867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895563575617642:8127]
2025-09-30T14:53:47.757879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:47.757893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:47.757904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:47.757908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:47.757909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:47.757911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:47.757911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:47.757947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895563575617642:8127]
2025-09-30T14:53:47.757956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:47.757963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:47.758138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:47.758146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:47.758172Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|453ecd63-56be2397-3874e882-e1aee5f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:47.758181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:47.758184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:47.758186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:47.758201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:47.758215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:47.758240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:47.758473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:47.758488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:47.758511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:47.758597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1326 partition: 0 MaxSeqNo: 42 sessionId: src_id|453ecd63-56be2397-3874e882-e1aee5f5_0
2025-09-30T14:53:47.759175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c6714a-7ec1a1af-40e42263-5a0482d8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|453ecd63-56be2397-3874e882-e1aee5f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:47.762136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|453ecd63-56be2397-3874e882-e1aee5f5_0] Write session: try to update token
2025-09-30T14:53:47.762158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|453ecd63-56be2397-3874e882-e1aee5f5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:47.771475Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:47.771496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:47.771506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895563575617642:8127]
2025-09-30T14:53:47.771553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:47.771737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:47.771901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:47.772055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:47.772215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:47.772431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:47.772467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:47.775345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:47.783465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1326 sessionId: src_id|453ecd63-56be2397-3874e882-e1aee5f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:47.786214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:47.786655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:47.786681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:47.786715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:47.789612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:47.804120Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:47.804144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:47.804147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:47.804149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:47.804160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895563575617642:8127]
2025-09-30T14:53:47.804164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895563575617642:8127]
2025-09-30T14:53:47.804169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895563575617642:8127]
2025-09-30T14:53:47.804213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:47.804219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.804222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:47.804297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:47.804312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:47.804316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:47.804355Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:47.830453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895563665367999:2659]
2025-09-30T14:53:47.830799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1325, pipe: [1:7555895563665367999:2659]
2025-09-30T14:53:47.919395Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:47.927856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:47.927886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:47.928044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:47.928100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:47.928156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:47.928216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:47.928268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:47.928273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:47.928343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:47.928415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:47.928479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:47.928543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:47.928584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:47.928587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:47.928659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:47.928719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:47.928780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:47.928850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:47.928891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:47.928893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:47.928963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:47.929025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:47.929092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:47.929153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:47.929196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:47.929199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:47.929270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:47.929347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:47.929397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:47.929448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:47.929490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:47.929492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:47.929559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:47.929608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:47.929664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:47.929718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:47.929762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:47.929765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:47.929836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:47.929889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:47.929954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:47.930034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:47.930085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:47.930088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:47.930152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:47.930203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:47.930255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:47.930320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:47.930359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:47.930361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:47.930427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:47.930482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:47.930541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:47.930609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:47.930651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:47.930655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:47.930730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:47.930793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:47.930864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:47.930930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:47.930967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:47.930970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:47.931032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895563665367999:2659], now have 1 active actors on pipe
2025-09-30T14:53:47.931667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:47.931686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:47.931714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1326 reason: error at write: Disconnected sessionId: src_id|453ecd63-56be2397-3874e882-e1aee5f5_0
2025-09-30T14:53:47.931926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1326 sessionId: src_id|453ecd63-56be2397-3874e882-e1aee5f5_0 is DEAD
2025-09-30T14:53:47.932090Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:47.932124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:47.932162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895563665367999:2659]
2025-09-30T14:53:47.935490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|453ecd63-56be2397-3874e882-e1aee5f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:47.935503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|453ecd63-56be2397-3874e882-e1aee5f5_0] Write session will restart in 0.006461s
2025-09-30T14:53:47.935524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|453ecd63-56be2397-3874e882-e1aee5f5_0] Write session: Do CDS request
2025-09-30T14:53:47.935529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|453ecd63-56be2397-3874e882-e1aee5f5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:47.943179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|453ecd63-56be2397-3874e882-e1aee5f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:47.944303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:47.944321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1327
2025-09-30T14:53:47.944477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1327 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:47.944541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1327 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:47.944551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1327 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:47.944556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:47.945106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1327 sessionId:  describe result for acl check
2025-09-30T14:53:47.945145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:47.945153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:47.945155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:47.945161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895563665368062:2452] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:47.945702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895563665368062:2452] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:47.949512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895563665368062:2452] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:47.953684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:47.954155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895563665368062:2452] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:47.954172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895563665368062:2452] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:47.954175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895563665368062:2452] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:47.954183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1327 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:47.954667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:47.954887Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:47.954897Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:47.954908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:47.954959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:47.955003Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895563575617807:8129]
2025-09-30T14:53:47.955594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:47.956331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:47.956384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:47.956707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:47.956764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:47.956770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:47.956771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:47.956773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:47.956774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:47.956775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:47.956776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:47.956778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:47.956779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:47.956780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:47.956782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.956783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:47.956784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:47.956785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:47.956786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:47.956792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:47.956803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:47.956807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:47.956812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:47.956816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:47.956820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:47.956824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:47.956829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:47.956833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:47.956837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:47.956842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.956846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:47.956850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:47.956854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:47.956858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:47.956866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:47.956874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:47.956880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:47.956885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:47.956889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:47.956895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:47.956900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:47.956906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:47.956910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:47.956916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:47.956920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:47.956925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:47.956930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:47.956936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:47.956940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:47.956945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:47.956950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:47.956956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:47.956961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:47.956967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:47.956976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.956981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.956986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:47.956993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:47.956999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:47.957007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:47.957012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:47.957017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:47.957022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:47.957028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:47.957069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:47.962911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:47.963835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:47.963852Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:47.963855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:47.963859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:47.963867Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1326 [2:7555895563575617807:8129]
2025-09-30T14:53:47.963884Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:47.963899Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:47.963902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:47.963905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:47.963908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:47.963924Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:47.963930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:47.963937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:47.963994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.964002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:47.964004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:47.964008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:47.964011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:47.964082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:47.964091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.964104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:47.964116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:47.964135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:47.964158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895563665368001:2454], now have 1 active actors on pipe
2025-09-30T14:53:47.964167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895563665368156:2452], now have 1 active actors on pipe
2025-09-30T14:53:47.964173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895563575617800:8129]
2025-09-30T14:53:47.964176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895563575617800:8129]
2025-09-30T14:53:47.964178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895563575617800:8129]
2025-09-30T14:53:47.964191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:47.964204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:47.964206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:47.964211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:47.964213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:47.964222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:47.964225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:47.964256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895563575617800:8129]
2025-09-30T14:53:47.964227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1326
2025-09-30T14:53:47.964267Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:47.964249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1326
2025-09-30T14:53:47.964275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:47.964440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:47.964453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:47.964480Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|118a7749-47250cc8-541f3e4d-23ff9360_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:47.964494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:47.964502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:47.964505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:47.964516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:47.964527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:47.964560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:47.965012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1327 partition: 0 MaxSeqNo: 42 sessionId: src_id|118a7749-47250cc8-541f3e4d-23ff9360_0
2025-09-30T14:53:47.965707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|453ecd63-56be2397-3874e882-e1aee5f5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|118a7749-47250cc8-541f3e4d-23ff9360_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:47.968385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|118a7749-47250cc8-541f3e4d-23ff9360_0] Write session: try to update token
2025-09-30T14:53:47.968403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|118a7749-47250cc8-541f3e4d-23ff9360_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:47.964877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:47.964889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:47.964905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:47.977488Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:47.977513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:47.977516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:47.977519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:47.977529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895563575617800:8129]
2025-09-30T14:53:47.977533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895563575617800:8129]
2025-09-30T14:53:47.977538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895563575617800:8129]
2025-09-30T14:53:47.977579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:47.977586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:47.977589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:47.977739Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:47.983324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:47.983348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:47.983353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:47.985223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1327 sessionId: src_id|118a7749-47250cc8-541f3e4d-23ff9360_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:47.987941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:48.032184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895567960335465:2659]
2025-09-30T14:53:48.032523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1326, pipe: [1:7555895567960335465:2659]
2025-09-30T14:53:48.094429Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:48.095107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:48.095125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:48.095163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895567960335465:2659], now have 1 active actors on pipe
2025-09-30T14:53:48.095946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:48.095999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:48.096069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1327 reason: status is not ok: tablet will be restarted right now sessionId: src_id|118a7749-47250cc8-541f3e4d-23ff9360_0
2025-09-30T14:53:48.096137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895567960335465:2659]
2025-09-30T14:53:48.096249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1327 sessionId: src_id|118a7749-47250cc8-541f3e4d-23ff9360_0 is DEAD
2025-09-30T14:53:48.096440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|118a7749-47250cc8-541f3e4d-23ff9360_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:48.096466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|118a7749-47250cc8-541f3e4d-23ff9360_0] Write session will restart in 0.007897s
2025-09-30T14:53:48.096490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|118a7749-47250cc8-541f3e4d-23ff9360_0] Write session: Do CDS request
2025-09-30T14:53:48.096497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|118a7749-47250cc8-541f3e4d-23ff9360_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:48.095495Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:48.106757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|118a7749-47250cc8-541f3e4d-23ff9360_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:48.107495Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:48.107513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1328
2025-09-30T14:53:48.107655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1328 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:48.107699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1328 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:48.107712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1328 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:48.107716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:48.108135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1328 sessionId:  describe result for acl check
2025-09-30T14:53:48.108172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:48.108179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:48.108181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:48.108186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895567960335579:2441] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:48.108719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895567960335579:2441] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:48.110995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895567960335579:2441] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:48.111728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:48.113856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:48.114070Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:48.114092Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:48.114103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:48.114162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:48.114212Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895567870585262:8131]
2025-09-30T14:53:48.114466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895567960335579:2441] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:48.114481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895567960335579:2441] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:48.114488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895567960335579:2441] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:48.114496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1328 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:48.114853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:48.115188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:48.115264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:48.115695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:48.115779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:48.115787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:48.115788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:48.115790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:48.115791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:48.115792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:48.115793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:48.115794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:48.115796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:48.115797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:48.115798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.115799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:48.115800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:48.115801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:48.115802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:48.115808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:48.115819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:48.115823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:48.115827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:48.115832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:48.115836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:48.115840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:48.115844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:48.115848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:48.115852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:48.115856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.115861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:48.115864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:48.115867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:48.115871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:48.115880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:48.115889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:48.115895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:48.115901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:48.115906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:48.115911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:48.115915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:48.115922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:48.115927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:48.115933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:48.115946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:48.115951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:48.115960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:48.115965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:48.115969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:48.115973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:48.115978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:48.115987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:48.115992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:48.115997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:48.116007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.116012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.116021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:48.116026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:48.116031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:48.116040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:48.116045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:48.116054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:48.116059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:48.116064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:48.116113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:48.123122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:48.124024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:48.124049Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:48.124052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:48.124056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:48.124062Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1327 [2:7555895567870585262:8131]
2025-09-30T14:53:48.124079Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:48.124096Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:48.124099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:48.124102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:48.124104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:48.124121Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:48.124128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:48.124136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:48.124206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.124215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:48.124217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:48.124221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:48.124224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:48.124293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:48.124300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.124316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:48.124332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:48.124348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:48.124366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895567960335632:2441], now have 1 active actors on pipe
2025-09-30T14:53:48.124376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895567960335474:2454], now have 1 active actors on pipe
2025-09-30T14:53:48.124382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895567870585257:8131]
2025-09-30T14:53:48.124384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895567870585257:8131]
2025-09-30T14:53:48.124386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895567870585257:8131]
2025-09-30T14:53:48.124399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:48.124414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:48.124417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:48.124425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:48.124427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:48.124431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:48.124434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:48.124468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895567870585257:8131]
2025-09-30T14:53:48.124480Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:48.124486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:48.124496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:48.124501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:48.124547Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|414129cf-4969ffcd-41e465a9-c37ed063_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:48.124559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:48.124562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:48.124565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:48.124577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:48.124590Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:48.124617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:48.124788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:48.124796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:48.124811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:48.124423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1327
2025-09-30T14:53:48.124543Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1327
2025-09-30T14:53:48.124882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1328 partition: 0 MaxSeqNo: 42 sessionId: src_id|414129cf-4969ffcd-41e465a9-c37ed063_0
2025-09-30T14:53:48.125291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|118a7749-47250cc8-541f3e4d-23ff9360_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|414129cf-4969ffcd-41e465a9-c37ed063_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:48.128235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|414129cf-4969ffcd-41e465a9-c37ed063_0] Write session: try to update token
2025-09-30T14:53:48.128254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|414129cf-4969ffcd-41e465a9-c37ed063_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:48.139882Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:48.139907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:48.139910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:48.139913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:48.139922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895567870585257:8131]
2025-09-30T14:53:48.139926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895567870585257:8131]
2025-09-30T14:53:48.139931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895567870585257:8131]
2025-09-30T14:53:48.139974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:48.139982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.139990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:48.139998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:48.140014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:48.140018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:48.140126Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:48.143980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1328 sessionId: src_id|414129cf-4969ffcd-41e465a9-c37ed063_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:48.146655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:48.196540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895567960335647:2659]
2025-09-30T14:53:48.197298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1327, pipe: [1:7555895567960335647:2659]
2025-09-30T14:53:48.256247Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:48.256772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:48.256782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:48.256820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895567960335647:2659], now have 1 active actors on pipe
2025-09-30T14:53:48.257044Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:48.257917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:48.258036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1328 reason: status is not ok: tablet will be restarted right now sessionId: src_id|414129cf-4969ffcd-41e465a9-c37ed063_0
2025-09-30T14:53:48.258233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1328 sessionId: src_id|414129cf-4969ffcd-41e465a9-c37ed063_0 is DEAD
2025-09-30T14:53:48.258365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895567960335647:2659]
2025-09-30T14:53:48.258378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:48.259479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|414129cf-4969ffcd-41e465a9-c37ed063_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:48.259491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|414129cf-4969ffcd-41e465a9-c37ed063_0] Write session will restart in 0.007133s
2025-09-30T14:53:48.259515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|414129cf-4969ffcd-41e465a9-c37ed063_0] Write session: Do CDS request
2025-09-30T14:53:48.259521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|414129cf-4969ffcd-41e465a9-c37ed063_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:48.267806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|414129cf-4969ffcd-41e465a9-c37ed063_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:48.268226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:48.268245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1329
2025-09-30T14:53:48.268436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1329 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:48.268468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1329 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:48.268473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1329 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:48.268477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:48.269038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1329 sessionId:  describe result for acl check
2025-09-30T14:53:48.269079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:48.269081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:48.269083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:48.269088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895567960335684:2432] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:48.269650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895567960335684:2432] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:48.275141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895567960335684:2432] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:48.279749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895567960335684:2432] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:48.279767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895567960335684:2432] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:48.279770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895567960335684:2432] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:48.279779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1329 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:48.280994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:48.283742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:48.283968Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:48.283979Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:48.283991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:48.284046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:48.284086Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895567870585438:8135]
2025-09-30T14:53:48.284769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:48.285186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:48.285257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:48.285627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:48.285699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:48.285701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:48.285702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:48.285703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:48.285705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:48.285706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:48.285708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:48.285709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:48.285710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:48.285712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:48.285713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.285714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:48.285716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:48.285717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:48.285718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:48.285724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:48.285735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:48.285739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:48.285744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:48.285748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:48.285752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:48.285755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:48.285758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:48.285761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:48.285768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:48.285772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.285775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:48.285780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:48.285784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:48.285789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:48.285797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:48.285806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:48.285812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:48.285818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:48.285823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:48.285829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:48.285833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:48.285839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:48.285844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:48.285850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:48.285854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:48.285861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:48.285866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:48.285871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:48.285876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:48.285882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:48.285887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:48.285893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:48.285898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:48.285904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:48.285909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.285915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.285919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:48.285924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:48.285930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:48.285935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:48.285939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:48.285944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:48.285949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:48.285954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:48.286023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:48.291937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:48.292819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:48.292840Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:48.292843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:48.292847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:48.292856Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1328 [2:7555895567870585438:8135]
2025-09-30T14:53:48.292874Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:48.292891Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:48.292900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:48.292903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:48.292907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:48.292923Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:48.292936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:48.292943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:48.293011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.293023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:48.293026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:48.293030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:48.293034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:48.293109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:48.293113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.293127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:48.293139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:48.293156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:48.293174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895567870585432:8135]
2025-09-30T14:53:48.293177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895567870585432:8135]
2025-09-30T14:53:48.293179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895567870585432:8135]
2025-09-30T14:53:48.293188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:48.293202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:48.293217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:48.293219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:48.293221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:48.293224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:48.293226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:48.293259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895567870585432:8135]
2025-09-30T14:53:48.293262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:48.293266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:48.293272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895567960335814:2432], now have 1 active actors on pipe
2025-09-30T14:53:48.293279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895567960335660:2454], now have 1 active actors on pipe
2025-09-30T14:53:48.293802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1328
2025-09-30T14:53:48.293844Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1328
2025-09-30T14:53:48.294188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:48.294203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:48.294231Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7098f1da-eb9fc3d7-df4d12f7-9664f00_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:48.294250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:48.294254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:48.294257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:48.294270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:48.294281Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:48.294299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:48.294503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:48.294512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:48.294525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:48.294609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1329 partition: 0 MaxSeqNo: 42 sessionId: src_id|7098f1da-eb9fc3d7-df4d12f7-9664f00_0
2025-09-30T14:53:48.295008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|414129cf-4969ffcd-41e465a9-c37ed063_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7098f1da-eb9fc3d7-df4d12f7-9664f00_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:48.297898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7098f1da-eb9fc3d7-df4d12f7-9664f00_0] Write session: try to update token
2025-09-30T14:53:48.297920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7098f1da-eb9fc3d7-df4d12f7-9664f00_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:48.309931Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:48.309952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:48.309955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:48.309957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:48.309967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895567870585432:8135]
2025-09-30T14:53:48.309973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895567870585432:8135]
2025-09-30T14:53:48.309977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895567870585432:8135]
2025-09-30T14:53:48.310038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:48.310045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.310048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:48.310192Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:48.315659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:48.315682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:48.315689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:48.316705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1329 sessionId: src_id|7098f1da-eb9fc3d7-df4d12f7-9664f00_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:48.319505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:48.363329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895567960335830:2659]
2025-09-30T14:53:48.363687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1328, pipe: [1:7555895567960335830:2659]
2025-09-30T14:53:48.462921Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:48.463425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:48.463445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:48.463485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895567960335830:2659], now have 1 active actors on pipe
2025-09-30T14:53:48.463853Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:48.464863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7098f1da-eb9fc3d7-df4d12f7-9664f00_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:48.464872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7098f1da-eb9fc3d7-df4d12f7-9664f00_0] Write session will restart in 0.008672s
2025-09-30T14:53:48.464888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7098f1da-eb9fc3d7-df4d12f7-9664f00_0] Write session: Do CDS request
2025-09-30T14:53:48.464892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7098f1da-eb9fc3d7-df4d12f7-9664f00_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:48.464036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895567960335830:2659]
2025-09-30T14:53:48.464069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:48.464071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:48.464124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1329 reason: error at write: Disconnected sessionId: src_id|7098f1da-eb9fc3d7-df4d12f7-9664f00_0
2025-09-30T14:53:48.464317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1329 sessionId: src_id|7098f1da-eb9fc3d7-df4d12f7-9664f00_0 is DEAD
2025-09-30T14:53:48.464486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:48.475819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7098f1da-eb9fc3d7-df4d12f7-9664f00_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:48.475949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:48.475984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1330
2025-09-30T14:53:48.476149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1330 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:48.476196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1330 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:48.476201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1330 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:48.476206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:48.476602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1330 sessionId:  describe result for acl check
2025-09-30T14:53:48.476630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:48.476632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:48.476636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:48.476642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895567960335853:2416] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:48.477216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895567960335853:2416] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:48.480999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895567960335853:2416] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:48.483573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895567960335853:2416] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:48.483589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895567960335853:2416] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:48.483592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895567960335853:2416] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:48.483600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1330 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:48.503373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:48.507693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:48.507950Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:48.507960Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:48.507971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:48.508028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:48.508066Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895567870585638:8143]
2025-09-30T14:53:48.508771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:48.509128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:48.509189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:48.509556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:48.509625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:48.509633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:48.509634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:48.509635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:48.509637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:48.509638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:48.509639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:48.509641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:48.509642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:48.509643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:48.509645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.509646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:48.509647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:48.509648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:48.509650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:48.509656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:48.509667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:48.509671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:48.509675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:48.509679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:48.509684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:48.509689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:48.509693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:48.509697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:48.509702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:48.509706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.509711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:48.509716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:48.509720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:48.509724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:48.509732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:48.509740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:48.509746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:48.509752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:48.509757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:48.509762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:48.509767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:48.509773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:48.509779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:48.509785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:48.509790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:48.509796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:48.509801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:48.509807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:48.509812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:48.509818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:48.509824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:48.509829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:48.509834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:48.509840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:48.509846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.509852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.509857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:48.509863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:48.509868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:48.509873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:48.509878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:48.509885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:48.509890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:48.509896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:48.509951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:48.517866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:48.519009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:48.519029Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:48.519032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:48.519036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:48.519044Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1329 [2:7555895567870585638:8143]
2025-09-30T14:53:48.519062Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:48.519078Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:48.519081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:48.519085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:48.519087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:48.519104Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:48.519110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:48.519118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:48.519182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.519192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:48.519194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:48.519198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:48.519201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:48.519287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:48.519297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.519312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:48.519323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:48.519338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:48.519355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895567870585633:8143]
2025-09-30T14:53:48.519357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895567870585633:8143]
2025-09-30T14:53:48.519360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895567870585633:8143]
2025-09-30T14:53:48.519369Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:48.519381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:48.519384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:48.519384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:48.519387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:48.519400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:48.519404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:48.519414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895567960335895:2416], now have 1 active actors on pipe
2025-09-30T14:53:48.519418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895567960335845:2454], now have 1 active actors on pipe
2025-09-30T14:53:48.519451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895567870585633:8143]
2025-09-30T14:53:48.519461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:48.519489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:48.520214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1329
2025-09-30T14:53:48.520258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1329
2025-09-30T14:53:48.520510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:48.520525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:48.520557Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c7ee2482-32f3d3d8-fa715d28-9640e281_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:48.520566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:48.520570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:48.520573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:48.520583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:48.520596Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:48.520613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:48.521143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:48.521154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:48.521175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:48.521868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7098f1da-eb9fc3d7-df4d12f7-9664f00_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c7ee2482-32f3d3d8-fa715d28-9640e281_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:48.524715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ee2482-32f3d3d8-fa715d28-9640e281_0] Write session: try to update token
2025-09-30T14:53:48.524737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ee2482-32f3d3d8-fa715d28-9640e281_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:48.521420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1330 partition: 0 MaxSeqNo: 42 sessionId: src_id|c7ee2482-32f3d3d8-fa715d28-9640e281_0
2025-09-30T14:53:48.536420Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:48.536444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:48.536446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:48.536448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:48.536458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895567870585633:8143]
2025-09-30T14:53:48.536467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895567870585633:8143]
2025-09-30T14:53:48.536471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895567870585633:8143]
2025-09-30T14:53:48.536512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:48.536520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.536522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:48.536668Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:48.539322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:48.539344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:48.539352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:48.546961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1330 sessionId: src_id|c7ee2482-32f3d3d8-fa715d28-9640e281_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:48.549785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:48.566630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895567960336028:2659]
2025-09-30T14:53:48.567493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1329, pipe: [1:7555895567960336028:2659]
2025-09-30T14:53:48.657611Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:48.658108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:48.658119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:48.658139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895567960336028:2659], now have 1 active actors on pipe
2025-09-30T14:53:48.658453Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:48.659360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:48.659438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1330 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c7ee2482-32f3d3d8-fa715d28-9640e281_0
2025-09-30T14:53:48.659644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1330 sessionId: src_id|c7ee2482-32f3d3d8-fa715d28-9640e281_0 is DEAD
2025-09-30T14:53:48.659827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:48.659861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895567960336028:2659]
2025-09-30T14:53:48.664586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ee2482-32f3d3d8-fa715d28-9640e281_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:48.664600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ee2482-32f3d3d8-fa715d28-9640e281_0] Write session will restart in 0.008186s
2025-09-30T14:53:48.664628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ee2482-32f3d3d8-fa715d28-9640e281_0] Write session: Do CDS request
2025-09-30T14:53:48.664635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ee2482-32f3d3d8-fa715d28-9640e281_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:48.673882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ee2482-32f3d3d8-fa715d28-9640e281_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:48.673922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:48.673940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1331
2025-09-30T14:53:48.675480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1331 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:48.675528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1331 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:48.675538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1331 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:48.675544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:48.675961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1331 sessionId:  describe result for acl check
2025-09-30T14:53:48.675997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:48.676005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:48.676007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:48.676013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895567960336076:2403] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:48.676559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895567960336076:2403] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:48.682708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895567960336076:2403] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:48.685213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895567960336076:2403] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:48.685232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895567960336076:2403] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:48.685238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895567960336076:2403] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:48.685247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1331 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:48.685365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:48.687953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:48.688166Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:48.688183Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:48.688196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:48.688258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:48.688296Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895567870585804:8152]
2025-09-30T14:53:48.688992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:48.689381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:48.689450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:48.689843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:48.689928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:48.689935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:48.689937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:48.689938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:48.689939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:48.689940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:48.689941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:48.689943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:48.689944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:48.689946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:48.689947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.689948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:48.689950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:48.689951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:48.689953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:48.689959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:48.689971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:48.689976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:48.689996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:48.690002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:48.690007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:48.690011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:48.690015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:48.690020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:48.690026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:48.690031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.690035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:48.690039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:48.690042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:48.690045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:48.690053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:48.690062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:48.690068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:48.690074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:48.690079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:48.690083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:48.690088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:48.690100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:48.690105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:48.690110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:48.690114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:48.690118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:48.690122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:48.690133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:48.690137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:48.690141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:48.690148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:48.690153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:48.690158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:48.690166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:48.690171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.690176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.690180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:48.690185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:48.690190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:48.690194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:48.690198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:48.690203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:48.690214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:48.690218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:48.690261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:48.697218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:48.698211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:48.698230Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:48.698233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:48.698237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:48.698246Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1330 [2:7555895567870585804:8152]
2025-09-30T14:53:48.698264Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:48.698290Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:48.698294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:48.698297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:48.698299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:48.698316Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:48.698328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:48.698336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:48.698406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.698413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:48.698416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:48.698420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:48.698423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:48.698491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:48.698503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.698517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:48.698532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:48.698549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:48.698569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895567960336191:2403], now have 1 active actors on pipe
2025-09-30T14:53:48.698573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895567960336031:2454], now have 1 active actors on pipe
2025-09-30T14:53:48.698581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895567870585797:8152]
2025-09-30T14:53:48.698585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895567870585797:8152]
2025-09-30T14:53:48.698588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895567870585797:8152]
2025-09-30T14:53:48.698602Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:48.698617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:48.698625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:48.698629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:48.698632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:48.698640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:48.698643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:48.698684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895567870585797:8152]
2025-09-30T14:53:48.698697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:48.698689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1330
2025-09-30T14:53:48.698732Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1330
2025-09-30T14:53:48.698723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:48.698745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:48.698751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:48.698776Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d183c1-2d7b95cd-856f4eac-a176c5e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:48.698784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:48.698788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:48.698791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:48.698801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:48.698811Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:48.698830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:48.699144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:48.699157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:48.699175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:48.699741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ee2482-32f3d3d8-fa715d28-9640e281_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d183c1-2d7b95cd-856f4eac-a176c5e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:48.702563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d183c1-2d7b95cd-856f4eac-a176c5e8_0] Write session: try to update token
2025-09-30T14:53:48.702584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d183c1-2d7b95cd-856f4eac-a176c5e8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:48.699302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1331 partition: 0 MaxSeqNo: 42 sessionId: src_id|d183c1-2d7b95cd-856f4eac-a176c5e8_0
2025-09-30T14:53:48.724824Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:48.724865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:48.724880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895567870585797:8152]
2025-09-30T14:53:48.724947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:48.725601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:48.725696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:48.725861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:48.726035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:48.726191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:48.726440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:48.726523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:48.727011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1331 sessionId: src_id|d183c1-2d7b95cd-856f4eac-a176c5e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:48.729767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:48.730572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:48.730598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:48.730655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:48.731165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:48.744404Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:48.744430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:48.744433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:48.744436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:48.744446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895567870585797:8152]
2025-09-30T14:53:48.744451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895567870585797:8152]
2025-09-30T14:53:48.744455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895567870585797:8152]
2025-09-30T14:53:48.744503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:48.744511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.744513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:48.744660Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:48.745017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:48.745031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:48.745036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:48.760546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895567960336203:2659]
2025-09-30T14:53:48.760816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1330, pipe: [1:7555895567960336203:2659]
2025-09-30T14:53:48.874580Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:48.884179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:48.884211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:48.884416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:48.884478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:48.884557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:48.884619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:48.884663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:48.884670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:48.884743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:48.884804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:48.884872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:48.884937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:48.884982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:48.884986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:48.885059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:48.885122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:48.885194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:48.885260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:48.885314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:48.885317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:48.885391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:48.885459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:48.885524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:48.885589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:48.885630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:48.885972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:48.886070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:48.886133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:48.886193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:48.886256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:48.886302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:48.886306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:48.886377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:48.886438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:48.886507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:48.886574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:48.886617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:48.886620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:48.886697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:48.886760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:48.886822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:48.886883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:48.886924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:48.886927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:48.886995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:48.887054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:48.887116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:48.887174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:48.887218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:48.887221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:48.887317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:48.887381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:48.887448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:48.887512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:48.887638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:48.887642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:48.887710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:48.887776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:48.887841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:48.887922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:48.887980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:48.887983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:48.888065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895567960336203:2659], now have 1 active actors on pipe
2025-09-30T14:53:48.889850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:48.889866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:48.889896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1331 reason: error at write: Disconnected sessionId: src_id|d183c1-2d7b95cd-856f4eac-a176c5e8_0
2025-09-30T14:53:48.890128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1331 sessionId: src_id|d183c1-2d7b95cd-856f4eac-a176c5e8_0 is DEAD
2025-09-30T14:53:48.890305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895567960336203:2659]
2025-09-30T14:53:48.890319Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:48.890693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d183c1-2d7b95cd-856f4eac-a176c5e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:48.890702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d183c1-2d7b95cd-856f4eac-a176c5e8_0] Write session will restart in 0.006399s
2025-09-30T14:53:48.890726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d183c1-2d7b95cd-856f4eac-a176c5e8_0] Write session: Do CDS request
2025-09-30T14:53:48.890732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d183c1-2d7b95cd-856f4eac-a176c5e8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:48.890346Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:48.898804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d183c1-2d7b95cd-856f4eac-a176c5e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:48.900745Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:48.900763Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1332
2025-09-30T14:53:48.900967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1332 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:48.900998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1332 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:48.901003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1332 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:48.901007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:48.901590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1332 sessionId:  describe result for acl check
2025-09-30T14:53:48.901632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:48.901634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:48.901639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:48.901644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895567960336218:2397] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:48.902211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895567960336218:2397] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:48.906996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895567960336218:2397] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:48.914012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895567960336218:2397] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:48.914032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895567960336218:2397] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:48.914035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895567960336218:2397] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:48.914046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1332 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:48.924916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:48.929723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:48.929967Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:48.929972Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:48.930000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:48.930058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:48.930097Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895567870585969:8154]
2025-09-30T14:53:48.930776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:48.931299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:48.931362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:48.931764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:48.931836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:48.931843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:48.931844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:48.931846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:48.931847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:48.931849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:48.931850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:48.931860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:48.931861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:48.931863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:48.931864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.931866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:48.931867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:48.931869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:48.931871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:48.931877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:48.931888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:48.931893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:48.931898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:48.931903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:48.931908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:48.931913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:48.931917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:48.931922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:48.931927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:48.931932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.931937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:48.931941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:48.931946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:48.931950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:48.931958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:48.931968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:48.931974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:48.931986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:48.931991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:48.931999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:48.932008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:48.932015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:48.932019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:48.932030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:48.932035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:48.932041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:48.932051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:48.932057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:48.932063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:48.932073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:48.932078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:48.932083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:48.932092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:48.932098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:48.932103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.932109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.932118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:48.932124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:48.932129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:48.932134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:48.932143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:48.932148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:48.932155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:48.932165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:48.932210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:48.937799Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:11802 } ]
2025-09-30T14:53:48.938998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:48.940213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:48.940220Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:48.940223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:48.940227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:48.940234Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1331 [2:7555895567870585969:8154]
2025-09-30T14:53:48.940251Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:48.940267Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:48.940271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:48.940275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:48.940278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:48.940296Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:48.940304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:48.940311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:48.940379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.940381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:48.940385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:48.940389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:48.940391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:48.940464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:48.940467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.940480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:48.940491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:48.940506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:48.940523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895567870585963:8154]
2025-09-30T14:53:48.940526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895567870585963:8154]
2025-09-30T14:53:48.940528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895567870585963:8154]
2025-09-30T14:53:48.940540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:48.940554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:48.940567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:48.940569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:48.940605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895567870585963:8154]
2025-09-30T14:53:48.940607Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:48.940908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:48.940918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:48.940920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:48.940925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:48.941634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1331
2025-09-30T14:53:48.941675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1331
2025-09-30T14:53:48.945941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895567960336206:2454], now have 1 active actors on pipe
2025-09-30T14:53:48.945958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895567960336300:2397], now have 1 active actors on pipe
2025-09-30T14:53:48.946001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:48.946008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:48.946041Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c723a5f8-e52cb27a-3dd47ecb-47acddf4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:48.946052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:48.946057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:48.946060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:48.946074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:48.946092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:48.946110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:48.947403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:48.947415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:48.947441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:48.947994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d183c1-2d7b95cd-856f4eac-a176c5e8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c723a5f8-e52cb27a-3dd47ecb-47acddf4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:48.950682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c723a5f8-e52cb27a-3dd47ecb-47acddf4_0] Write session: try to update token
2025-09-30T14:53:48.950699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c723a5f8-e52cb27a-3dd47ecb-47acddf4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:48.947613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1332 partition: 0 MaxSeqNo: 42 sessionId: src_id|c723a5f8-e52cb27a-3dd47ecb-47acddf4_0
2025-09-30T14:53:48.968170Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:48.968193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:48.968196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:48.968198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:48.968210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895567870585963:8154]
2025-09-30T14:53:48.968215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895567870585963:8154]
2025-09-30T14:53:48.968219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895567870585963:8154]
2025-09-30T14:53:48.968264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:48.968272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:48.968274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:48.968286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:48.968294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:48.968299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:48.968416Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:48.977071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1332 sessionId: src_id|c723a5f8-e52cb27a-3dd47ecb-47acddf4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:48.979916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:48.991328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895567960336380:2659]
2025-09-30T14:53:48.992247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1331, pipe: [1:7555895567960336380:2659]
2025-09-30T14:53:49.099103Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:49.099576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:49.099592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:49.099612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895567960336380:2659], now have 1 active actors on pipe
2025-09-30T14:53:49.099879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895567960336380:2659]
2025-09-30T14:53:49.099914Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:49.099956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:49.100034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1332 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c723a5f8-e52cb27a-3dd47ecb-47acddf4_0
2025-09-30T14:53:49.099875Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:49.100258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1332 sessionId: src_id|c723a5f8-e52cb27a-3dd47ecb-47acddf4_0 is DEAD
2025-09-30T14:53:49.103340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c723a5f8-e52cb27a-3dd47ecb-47acddf4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:49.103354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c723a5f8-e52cb27a-3dd47ecb-47acddf4_0] Write session will restart in 0.005473s
2025-09-30T14:53:49.103381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c723a5f8-e52cb27a-3dd47ecb-47acddf4_0] Write session: Do CDS request
2025-09-30T14:53:49.103388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c723a5f8-e52cb27a-3dd47ecb-47acddf4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:49.109828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c723a5f8-e52cb27a-3dd47ecb-47acddf4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:49.113689Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:49.113710Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1333
2025-09-30T14:53:49.113872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1333 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:49.113905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1333 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:49.113918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1333 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:49.113928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:49.114431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1333 sessionId:  describe result for acl check
2025-09-30T14:53:49.114471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:49.114479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:49.114481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:49.114487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895572255303795:2388] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:49.114999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895572255303795:2388] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:49.117968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:49.118470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:49.118677Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:49.118688Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:49.118700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:49.118749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:49.118792Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895572165553430:8156]
2025-09-30T14:53:49.118622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895572255303795:2388] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:49.119508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:49.121161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:49.121220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:49.121618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:49.121680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:49.121687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:49.121688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:49.121689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:49.121691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:49.121692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:49.121693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:49.121694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:49.121696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:49.121697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:49.121698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.121699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:49.121700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:49.121702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:49.121703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:49.121709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:49.121720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:49.121725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:49.121730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:49.121734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:49.121738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:49.121742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:49.121746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:49.121750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:49.121754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:49.121758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.121762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:49.121765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:49.121770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:49.121774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:49.121782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:49.121791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:49.121798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:49.121804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:49.121810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:49.121816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:49.121820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:49.121826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:49.121831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:49.121837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:49.121842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:49.121848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:49.121853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:49.121859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:49.121864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:49.121870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:49.121876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:49.121881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:49.121893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:49.121901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:49.121906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.121912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.121917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:49.121923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:49.121928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:49.121934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:49.121939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:49.121945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:49.121950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:49.121956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:49.122024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:49.126163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895572255303795:2388] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:49.126182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895572255303795:2388] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:49.126185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895572255303795:2388] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:49.126194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1333 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:49.134190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:49.135112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:49.135132Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:49.135136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:49.135141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:49.135150Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1332 [2:7555895572165553430:8156]
2025-09-30T14:53:49.135168Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:49.135187Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:49.135196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:49.135199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:49.135202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:49.135219Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:49.135231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:49.135239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:49.135330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.135343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:49.135346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:49.135350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:49.135353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:49.135425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:49.135433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.135447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:49.135466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:49.135485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:49.135504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895572165553425:8156]
2025-09-30T14:53:49.135507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895572165553425:8156]
2025-09-30T14:53:49.135509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895572165553425:8156]
2025-09-30T14:53:49.135519Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:49.135528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:49.135531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:49.135534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:49.135538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895572255303852:2388], now have 1 active actors on pipe
2025-09-30T14:53:49.135545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895572255303683:2454], now have 1 active actors on pipe
2025-09-30T14:53:49.135551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:49.135565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:49.135569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:49.135611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895572165553425:8156]
2025-09-30T14:53:49.135621Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:49.135657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:49.136795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1332
2025-09-30T14:53:49.136833Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1332
2025-09-30T14:53:49.137000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:49.137018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:49.137062Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45028f77-9acddc00-d6bb5662-edcac9ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:49.137077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:49.137086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:49.137090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:49.137104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:49.137122Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:49.137144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:49.137411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:49.137421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:49.137436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:49.137615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1333 partition: 0 MaxSeqNo: 42 sessionId: src_id|45028f77-9acddc00-d6bb5662-edcac9ca_0
2025-09-30T14:53:49.138043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c723a5f8-e52cb27a-3dd47ecb-47acddf4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|45028f77-9acddc00-d6bb5662-edcac9ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:49.140847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45028f77-9acddc00-d6bb5662-edcac9ca_0] Write session: try to update token
2025-09-30T14:53:49.140869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45028f77-9acddc00-d6bb5662-edcac9ca_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:49.158811Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:49.158835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:49.158838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:49.158841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:49.158850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895572165553425:8156]
2025-09-30T14:53:49.158856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895572165553425:8156]
2025-09-30T14:53:49.158862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895572165553425:8156]
2025-09-30T14:53:49.158903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:49.158911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.158914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:49.159079Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:49.159445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:49.159452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:49.159456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:49.162786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1333 sessionId: src_id|45028f77-9acddc00-d6bb5662-edcac9ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:49.165797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:49.201315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895572255303861:2659]
2025-09-30T14:53:49.201691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1332, pipe: [1:7555895572255303861:2659]
2025-09-30T14:53:49.284882Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:49.285495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:49.285506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:49.285552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895572255303861:2659], now have 1 active actors on pipe
2025-09-30T14:53:49.285816Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:49.286477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45028f77-9acddc00-d6bb5662-edcac9ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:49.286487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45028f77-9acddc00-d6bb5662-edcac9ca_0] Write session will restart in 0.005308s
2025-09-30T14:53:49.286513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45028f77-9acddc00-d6bb5662-edcac9ca_0] Write session: Do CDS request
2025-09-30T14:53:49.286519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45028f77-9acddc00-d6bb5662-edcac9ca_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:49.285938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895572255303861:2659]
2025-09-30T14:53:49.285988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:49.285990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:49.286054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1333 reason: error at write: Disconnected sessionId: src_id|45028f77-9acddc00-d6bb5662-edcac9ca_0
2025-09-30T14:53:49.286298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1333 sessionId: src_id|45028f77-9acddc00-d6bb5662-edcac9ca_0 is DEAD
2025-09-30T14:53:49.286300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:49.292867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45028f77-9acddc00-d6bb5662-edcac9ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:49.295512Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:49.295533Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1334
2025-09-30T14:53:49.296732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1334 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:49.296787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1334 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:49.296793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1334 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:49.296799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:49.298310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1334 sessionId:  describe result for acl check
2025-09-30T14:53:49.298349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:49.298353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:49.298355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:49.298362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895572255303882:2383] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:49.298934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895572255303882:2383] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:49.304256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895572255303882:2383] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:49.310703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895572255303882:2383] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:49.310723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895572255303882:2383] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:49.310726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895572255303882:2383] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:49.310735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1334 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:49.328076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:49.330264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:49.330636Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:49.330655Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:49.330676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:49.330777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:49.330846Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895572165553613:8160]
2025-09-30T14:53:49.331643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:49.332057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:49.332117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:49.332542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:49.332644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:49.332657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:49.332658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:49.332660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:49.332661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:49.332663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:49.332664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:49.332666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:49.332668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:49.332669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:49.332670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.332671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:49.332673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:49.332674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:49.332676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:49.332683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:49.332694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:49.332699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:49.332703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:49.332708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:49.332713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:49.332718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:49.332723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:49.332727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:49.332733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:49.332737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.332741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:49.332746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:49.332749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:49.332753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:49.332768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:49.332777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:49.332784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:49.332791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:49.332798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:49.332803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:49.332809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:49.332815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:49.332822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:49.332827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:49.332832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:49.332837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:49.332842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:49.332848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:49.332853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:49.332859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:49.332869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:49.332876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:49.332880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:49.332887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:49.332892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.332898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.332902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:49.332906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:49.332912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:49.332917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:49.332922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:49.332927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:49.332932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:49.332938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:49.332985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:49.342869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:49.343974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:49.343995Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:49.343999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:49.344004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:49.344013Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1333 [2:7555895572165553613:8160]
2025-09-30T14:53:49.344034Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:49.344054Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:49.344058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:49.344061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:49.344064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:49.344081Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:49.344091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:49.344099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:49.344170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.344179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:49.344182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:49.344186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:49.344189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:49.344267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:49.344278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.344293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:49.344305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:49.344322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:49.344342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895572255303922:2383], now have 1 active actors on pipe
2025-09-30T14:53:49.344346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895572255303875:2454], now have 1 active actors on pipe
2025-09-30T14:53:49.344352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895572165553608:8160]
2025-09-30T14:53:49.344355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895572165553608:8160]
2025-09-30T14:53:49.344357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895572165553608:8160]
2025-09-30T14:53:49.344373Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:49.344384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:49.344387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:49.344387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:49.344389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:49.344402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:49.344405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:49.344450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895572165553608:8160]
2025-09-30T14:53:49.344457Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:49.344462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:49.344888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1333
2025-09-30T14:53:49.344929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1333
2025-09-30T14:53:49.345492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1334 partition: 0 MaxSeqNo: 42 sessionId: src_id|6bb008f6-e2d64d8c-d374d1ff-c8778e2d_0
2025-09-30T14:53:49.345866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45028f77-9acddc00-d6bb5662-edcac9ca_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6bb008f6-e2d64d8c-d374d1ff-c8778e2d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:49.344982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:49.345001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:49.345040Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6bb008f6-e2d64d8c-d374d1ff-c8778e2d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:49.345050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:49.345055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:49.345058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:49.345070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:49.345084Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:49.345108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:49.345338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:49.345342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:49.345360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:49.348950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bb008f6-e2d64d8c-d374d1ff-c8778e2d_0] Write session: try to update token
2025-09-30T14:53:49.348973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bb008f6-e2d64d8c-d374d1ff-c8778e2d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:49.357627Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:49.357651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:49.357654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:49.357656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:49.357666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895572165553608:8160]
2025-09-30T14:53:49.357672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895572165553608:8160]
2025-09-30T14:53:49.357676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895572165553608:8160]
2025-09-30T14:53:49.357717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:49.357724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.357728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:49.357732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:49.357735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:49.357740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:49.357868Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:49.375296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1334 sessionId: src_id|6bb008f6-e2d64d8c-d374d1ff-c8778e2d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:49.378137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:49.391320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895572255304051:2659]
2025-09-30T14:53:49.399344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1333, pipe: [1:7555895572255304051:2659]
2025-09-30T14:53:49.475828Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:49.476175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:49.476185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:49.476204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895572255304051:2659], now have 1 active actors on pipe
2025-09-30T14:53:49.476470Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:49.476570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:49.476813Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:49.476904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895572255304051:2659]
2025-09-30T14:53:49.477861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1334 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6bb008f6-e2d64d8c-d374d1ff-c8778e2d_0
2025-09-30T14:53:49.478055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1334 sessionId: src_id|6bb008f6-e2d64d8c-d374d1ff-c8778e2d_0 is DEAD
2025-09-30T14:53:49.478440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bb008f6-e2d64d8c-d374d1ff-c8778e2d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:49.478451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bb008f6-e2d64d8c-d374d1ff-c8778e2d_0] Write session will restart in 0.005094s
2025-09-30T14:53:49.478474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bb008f6-e2d64d8c-d374d1ff-c8778e2d_0] Write session: Do CDS request
2025-09-30T14:53:49.478480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bb008f6-e2d64d8c-d374d1ff-c8778e2d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:49.484883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bb008f6-e2d64d8c-d374d1ff-c8778e2d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:49.484979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:49.485004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1335
2025-09-30T14:53:49.485161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1335 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:49.485211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1335 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:49.485217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1335 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:49.485222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:49.485642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1335 sessionId:  describe result for acl check
2025-09-30T14:53:49.485664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:49.485666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:49.485667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:49.485672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895572255304063:2369] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:49.486249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895572255304063:2369] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:49.488293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895572255304063:2369] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:49.493202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895572255304063:2369] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:49.493233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895572255304063:2369] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:49.493237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895572255304063:2369] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:49.493246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1335 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:49.502779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:49.504609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:49.504867Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:49.504878Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:49.504890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:49.504951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:49.504996Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895572165553785:8162]
2025-09-30T14:53:49.505661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:49.506004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:49.506056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:49.506420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:49.506483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:49.506490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:49.506491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:49.506492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:49.506494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:49.506495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:49.506496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:49.506498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:49.506499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:49.506500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:49.506502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.506503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:49.506504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:49.506505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:49.506507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:49.506513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:49.506524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:49.506529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:49.506534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:49.506539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:49.506544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:49.506548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:49.506553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:49.506558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:49.506563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:49.506567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.506573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:49.506578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:49.506582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:49.506587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:49.506594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:49.506603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:49.506609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:49.506615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:49.506622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:49.506628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:49.506633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:49.506647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:49.506653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:49.506660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:49.506664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:49.506670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:49.506676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:49.506687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:49.506691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:49.506697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:49.506708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:49.506719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:49.506724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:49.506731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:49.506742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.506747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.506752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:49.506758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:49.506763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:49.506769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:49.506779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:49.506785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:49.506794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:49.506801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:49.506851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:49.515990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:49.516880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:49.516902Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:49.516906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:49.516910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:49.516917Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1334 [2:7555895572165553785:8162]
2025-09-30T14:53:49.516936Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:49.516956Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:49.516959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:49.516962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:49.516965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:49.516982Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:49.516994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:49.517000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:49.517064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.517072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:49.517075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:49.517078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:49.517081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:49.517356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:49.517368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.517383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:49.517405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:49.517429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:49.517510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1334
2025-09-30T14:53:49.517558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1334
2025-09-30T14:53:49.517449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895572255304053:2454], now have 1 active actors on pipe
2025-09-30T14:53:49.517462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895572255304140:2369], now have 1 active actors on pipe
2025-09-30T14:53:49.517469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895572165553776:8162]
2025-09-30T14:53:49.517471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895572165553776:8162]
2025-09-30T14:53:49.517473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895572165553776:8162]
2025-09-30T14:53:49.517487Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:49.517502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:49.517508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:49.517511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:49.517513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:49.517518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:49.517522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:49.517560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895572165553776:8162]
2025-09-30T14:53:49.517568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:49.517575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:49.517768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:49.517773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:49.517797Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3226d2a-4e62b157-5e883e8f-203bc03_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:49.517804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:49.517808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:49.517810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:49.517820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:49.517831Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:49.517844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:49.518055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:49.518063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:49.518086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:49.518199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1335 partition: 0 MaxSeqNo: 42 sessionId: src_id|d3226d2a-4e62b157-5e883e8f-203bc03_0
2025-09-30T14:53:49.518564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bb008f6-e2d64d8c-d374d1ff-c8778e2d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d3226d2a-4e62b157-5e883e8f-203bc03_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:49.521568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3226d2a-4e62b157-5e883e8f-203bc03_0] Write session: try to update token
2025-09-30T14:53:49.521592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3226d2a-4e62b157-5e883e8f-203bc03_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:49.532461Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:49.532483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:49.532486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:49.532488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:49.532497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895572165553776:8162]
2025-09-30T14:53:49.532501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895572165553776:8162]
2025-09-30T14:53:49.532505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895572165553776:8162]
2025-09-30T14:53:49.532551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:49.532557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.532560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:49.532564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:49.532572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:49.532576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:49.532713Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:49.559067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1335 sessionId: src_id|d3226d2a-4e62b157-5e883e8f-203bc03_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:49.562143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:49.576917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895572255304254:2659]
2025-09-30T14:53:49.577306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1334, pipe: [1:7555895572255304254:2659]
2025-09-30T14:53:49.655573Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:49.655920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:49.655933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:49.655961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895572255304254:2659], now have 1 active actors on pipe
2025-09-30T14:53:49.657151Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:49.657709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3226d2a-4e62b157-5e883e8f-203bc03_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:49.657736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3226d2a-4e62b157-5e883e8f-203bc03_0] Write session will restart in 0.009352s
2025-09-30T14:53:49.657760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3226d2a-4e62b157-5e883e8f-203bc03_0] Write session: Do CDS request
2025-09-30T14:53:49.657767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3226d2a-4e62b157-5e883e8f-203bc03_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:49.657189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895572255304254:2659]
2025-09-30T14:53:49.657218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:49.657253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:49.657324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1335 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d3226d2a-4e62b157-5e883e8f-203bc03_0
2025-09-30T14:53:49.657538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1335 sessionId: src_id|d3226d2a-4e62b157-5e883e8f-203bc03_0 is DEAD
2025-09-30T14:53:49.668888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3226d2a-4e62b157-5e883e8f-203bc03_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:49.668975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:49.668994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1336
2025-09-30T14:53:49.669130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1336 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:49.669180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1336 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:49.669190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1336 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:49.669195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:49.669709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1336 sessionId:  describe result for acl check
2025-09-30T14:53:49.669745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:49.669747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:49.669749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:49.669757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895572255304386:2355] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:49.670315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895572255304386:2355] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:49.672390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895572255304386:2355] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:49.676112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:49.679998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895572255304386:2355] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:49.680020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895572255304386:2355] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:49.680024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895572255304386:2355] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:49.680033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1336 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:49.683162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:49.683429Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:49.683441Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:49.683452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:49.683513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:49.683554Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895572165553989:8177]
2025-09-30T14:53:49.684279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:49.684674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:49.684738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:49.685091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:49.685160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:49.685161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:49.685163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:49.685164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:49.685166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:49.685167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:49.685169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:49.685170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:49.685172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:49.685173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:49.685175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.685176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:49.685177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:49.685179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:49.685181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:49.685187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:49.685198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:49.685203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:49.685208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:49.685212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:49.685216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:49.685221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:49.685225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:49.685229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:49.685234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:49.685238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.685243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:49.685247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:49.685251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:49.685255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:49.685263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:49.685272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:49.685278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:49.685284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:49.685288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:49.685293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:49.685297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:49.685302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:49.685307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:49.685314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:49.685319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:49.685325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:49.685330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:49.685335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:49.685340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:49.685347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:49.685352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:49.685358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:49.685362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:49.685367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:49.685373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.685378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.685382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:49.685388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:49.685393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:49.685398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:49.685403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:49.685409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:49.685417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:49.685423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:49.685468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:49.692909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:49.693860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:49.693884Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:49.693887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:49.693892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:49.693899Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1335 [2:7555895572165553989:8177]
2025-09-30T14:53:49.693958Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:49.693995Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:49.694003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:49.694007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:49.694009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:49.694027Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:49.694034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:49.694041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:49.694110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.694120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:49.694123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:49.694126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:49.694129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:49.694195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:49.694203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.694216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:49.694232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:49.694253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:49.694274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895572165553982:8177]
2025-09-30T14:53:49.694280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895572165553982:8177]
2025-09-30T14:53:49.694282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895572165553982:8177]
2025-09-30T14:53:49.694296Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:49.694314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:49.694329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:49.694332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:49.694371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895572165553982:8177]
2025-09-30T14:53:49.694380Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:49.695460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:49.695472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:49.695475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:49.695482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:49.695824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1335
2025-09-30T14:53:49.695864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1335
2025-09-30T14:53:49.695876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895572255304423:2355], now have 1 active actors on pipe
2025-09-30T14:53:49.695888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895572255304257:2454], now have 1 active actors on pipe
2025-09-30T14:53:49.696037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:49.696043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:49.696073Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8b14039-9a9ac9da-67800782-90287dd2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:49.696083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:49.696087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:49.696101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:49.696112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:49.696126Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:49.696144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:49.696406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:49.696415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:49.696434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:49.696544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1336 partition: 0 MaxSeqNo: 42 sessionId: src_id|e8b14039-9a9ac9da-67800782-90287dd2_0
2025-09-30T14:53:49.696919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3226d2a-4e62b157-5e883e8f-203bc03_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e8b14039-9a9ac9da-67800782-90287dd2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:49.699870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8b14039-9a9ac9da-67800782-90287dd2_0] Write session: try to update token
2025-09-30T14:53:49.699890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8b14039-9a9ac9da-67800782-90287dd2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:49.708456Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:49.708479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:49.708481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:49.708484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:49.708494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895572165553982:8177]
2025-09-30T14:53:49.708500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895572165553982:8177]
2025-09-30T14:53:49.708505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895572165553982:8177]
2025-09-30T14:53:49.708547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:49.708560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.708563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:49.708562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:49.708569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:49.708573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:49.708703Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:49.716974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1336 sessionId: src_id|e8b14039-9a9ac9da-67800782-90287dd2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:49.720010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:49.759381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895572255304434:2659]
2025-09-30T14:53:49.762426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1335, pipe: [1:7555895572255304434:2659]
2025-09-30T14:53:49.831136Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:49.831574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:49.831588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:49.831607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895572255304434:2659], now have 1 active actors on pipe
2025-09-30T14:53:49.831779Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:49.833178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8b14039-9a9ac9da-67800782-90287dd2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:49.833191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8b14039-9a9ac9da-67800782-90287dd2_0] Write session will restart in 0.008351s
2025-09-30T14:53:49.833218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8b14039-9a9ac9da-67800782-90287dd2_0] Write session: Do CDS request
2025-09-30T14:53:49.833225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8b14039-9a9ac9da-67800782-90287dd2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:49.832240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:49.832334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1336 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e8b14039-9a9ac9da-67800782-90287dd2_0
2025-09-30T14:53:49.832515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1336 sessionId: src_id|e8b14039-9a9ac9da-67800782-90287dd2_0 is DEAD
2025-09-30T14:53:49.832640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:49.832680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895572255304434:2659]
2025-09-30T14:53:49.842932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8b14039-9a9ac9da-67800782-90287dd2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:49.843132Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:49.843148Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1337
2025-09-30T14:53:49.843282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1337 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:49.843319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1337 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:49.843329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1337 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:49.843334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:49.843838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1337 sessionId:  describe result for acl check
2025-09-30T14:53:49.843885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:49.843891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:49.843893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:49.843899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895572255304503:2342] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:49.844415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895572255304503:2342] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:49.847161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895572255304503:2342] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:49.848091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:49.850836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:49.851048Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:49.851059Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:49.851070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:49.851124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:49.851162Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895572165554158:8179]
2025-09-30T14:53:49.851187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895572255304503:2342] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:49.851206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895572255304503:2342] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:49.851209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895572255304503:2342] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:49.851218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1337 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:49.851862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:49.852215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:49.852259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:49.852582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:49.852661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:49.852662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:49.852663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:49.852664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:49.852666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:49.852668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:49.852669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:49.852670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:49.852672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:49.852673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:49.852675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.852676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:49.852678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:49.852679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:49.852681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:49.852685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:49.852697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:49.852702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:49.852706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:49.852711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:49.852715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:49.852720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:49.852725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:49.852730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:49.852734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:49.852739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.852743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:49.852747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:49.852751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:49.852756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:49.852764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:49.852773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:49.852780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:49.852785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:49.852790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:49.852796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:49.852801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:49.852807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:49.852812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:49.852817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:49.852823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:49.852828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:49.852834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:49.852840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:49.852845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:49.852850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:49.852856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:49.852862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:49.852866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:49.852872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:49.852877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.852883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.852887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:49.852893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:49.852898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:49.852904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:49.852909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:49.852915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:49.852920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:49.852926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:49.852974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:49.859969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:49.860859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:49.860880Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:49.860884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:49.860888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:49.860916Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1336 [2:7555895572165554158:8179]
2025-09-30T14:53:49.860934Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:49.860950Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:49.860958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:49.860962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:49.860964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:49.860980Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:49.860992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:49.860999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:49.861063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.861071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:49.861073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:49.861077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:49.861079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:49.861149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:49.861158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.861172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:49.861191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:49.861214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:49.861237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895572255304604:2342], now have 1 active actors on pipe
2025-09-30T14:53:49.861241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895572255304436:2454], now have 1 active actors on pipe
2025-09-30T14:53:49.861247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895572165554152:8179]
2025-09-30T14:53:49.861249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895572165554152:8179]
2025-09-30T14:53:49.861251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895572165554152:8179]
2025-09-30T14:53:49.861267Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:49.861283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:49.861301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:49.861305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:49.861340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895572165554152:8179]
2025-09-30T14:53:49.861349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:49.861360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:49.861338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1336
2025-09-30T14:53:49.861384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1336
2025-09-30T14:53:49.861380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:49.861388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:49.861395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:49.861866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:49.861882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:49.861912Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e26ed4b9-e606310b-e29ba3db-b1af8fc4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:49.861928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:49.861937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:49.861939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:49.861964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:49.861990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:49.862010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:49.862307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:49.862322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:49.862346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:49.862562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1337 partition: 0 MaxSeqNo: 42 sessionId: src_id|e26ed4b9-e606310b-e29ba3db-b1af8fc4_0
2025-09-30T14:53:49.862985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8b14039-9a9ac9da-67800782-90287dd2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e26ed4b9-e606310b-e29ba3db-b1af8fc4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:49.865845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e26ed4b9-e606310b-e29ba3db-b1af8fc4_0] Write session: try to update token
2025-09-30T14:53:49.865866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e26ed4b9-e606310b-e29ba3db-b1af8fc4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:49.880125Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:49.880147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:49.880150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:49.880153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:49.880164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895572165554152:8179]
2025-09-30T14:53:49.880169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895572165554152:8179]
2025-09-30T14:53:49.880174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895572165554152:8179]
2025-09-30T14:53:49.880218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:49.880227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:49.880230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:49.880243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:49.880262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:49.880267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:49.880379Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:49.881499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1337 sessionId: src_id|e26ed4b9-e606310b-e29ba3db-b1af8fc4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:49.884325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:49.932744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895572255304615:2659]
2025-09-30T14:53:49.933051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1336, pipe: [1:7555895572255304615:2659]
2025-09-30T14:53:49.997558Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:49.997901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:49.997917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:49.997958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895572255304615:2659], now have 1 active actors on pipe
2025-09-30T14:53:49.999388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e26ed4b9-e606310b-e29ba3db-b1af8fc4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:49.999400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e26ed4b9-e606310b-e29ba3db-b1af8fc4_0] Write session will restart in 0.007216s
2025-09-30T14:53:49.998915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895572255304615:2659]
2025-09-30T14:53:49.998954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:49.999023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1337 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e26ed4b9-e606310b-e29ba3db-b1af8fc4_0
2025-09-30T14:53:49.999236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1337 sessionId: src_id|e26ed4b9-e606310b-e29ba3db-b1af8fc4_0 is DEAD
2025-09-30T14:53:49.999319Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:49.999435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e26ed4b9-e606310b-e29ba3db-b1af8fc4_0] Write session: Do CDS request
2025-09-30T14:53:49.999441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e26ed4b9-e606310b-e29ba3db-b1af8fc4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:49.998241Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:50.007750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e26ed4b9-e606310b-e29ba3db-b1af8fc4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:50.007962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:50.007983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1338
2025-09-30T14:53:50.008122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1338 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:50.008155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1338 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:50.008160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1338 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:50.008165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:50.008574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1338 sessionId:  describe result for acl check
2025-09-30T14:53:50.008611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:50.008613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:50.008616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:50.008621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895576550271926:2349] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:50.009182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895576550271926:2349] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:50.011646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895576550271926:2349] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:50.016470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895576550271926:2349] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:50.016488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895576550271926:2349] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:50.016491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895576550271926:2349] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:50.016500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1338 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:50.021866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:50.024993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:50.025372Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:50.025387Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:50.025400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:50.025465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:50.025510Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895576460521626:8181]
2025-09-30T14:53:50.026168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:50.026551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:50.026601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:50.026942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:50.027017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:50.027024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:50.027025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:50.027026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:50.027028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:50.027029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:50.027030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:50.027031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:50.027032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:50.027033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:50.027035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.027036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.027037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.027039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:50.027040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:50.027046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:50.027056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:50.027061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:50.027065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:50.027070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:50.027074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:50.027078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:50.027082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:50.027087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:50.027091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:50.027094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.027098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.027101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.027105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:50.027108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:50.027116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:50.027123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:50.027129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:50.027134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:50.027139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:50.027144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:50.027149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:50.027155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:50.027162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:50.027167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:50.027171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:50.027176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:50.027181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:50.027186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:50.027190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:50.027196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:50.027207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:50.027216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:50.027222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:50.027227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:50.027384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.027397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.027402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.027407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.027411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.027422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.027427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:50.027459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:50.027475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:50.027480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:50.027515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:50.034146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:50.035376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:50.035394Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:50.035397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:50.035400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:50.035407Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1337 [2:7555895576460521626:8181]
2025-09-30T14:53:50.035424Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:50.035439Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:50.035442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:50.035445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:50.035448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:50.035464Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:50.035471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:50.035478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:50.035541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.035552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.035554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.035557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:50.035559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:50.035630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:50.035640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.035654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.035668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.035689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:50.035708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895572255304618:2454], now have 1 active actors on pipe
2025-09-30T14:53:50.035718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895576550271999:2349], now have 1 active actors on pipe
2025-09-30T14:53:50.035725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895576460521621:8181]
2025-09-30T14:53:50.035728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895576460521621:8181]
2025-09-30T14:53:50.035731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895576460521621:8181]
2025-09-30T14:53:50.035743Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:50.035759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:50.035762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:50.035769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:50.035771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:50.035778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:50.035782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:50.035817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895576460521621:8181]
2025-09-30T14:53:50.035827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:50.035830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:50.035853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:50.035857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:50.035895Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9fa32cb5-1c0703ce-870321dd-ec291b0b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:50.035766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1337
2025-09-30T14:53:50.035775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1337
2025-09-30T14:53:50.035908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:50.035917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:50.035920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:50.035929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:50.035937Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:50.035956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:50.036416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:50.036431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:50.036454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:50.036585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1338 partition: 0 MaxSeqNo: 42 sessionId: src_id|9fa32cb5-1c0703ce-870321dd-ec291b0b_0
2025-09-30T14:53:50.037041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e26ed4b9-e606310b-e29ba3db-b1af8fc4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9fa32cb5-1c0703ce-870321dd-ec291b0b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:50.039899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa32cb5-1c0703ce-870321dd-ec291b0b_0] Write session: try to update token
2025-09-30T14:53:50.039919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa32cb5-1c0703ce-870321dd-ec291b0b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:50.048410Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:50.048433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:50.048436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:50.048438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:50.048449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895576460521621:8181]
2025-09-30T14:53:50.048456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895576460521621:8181]
2025-09-30T14:53:50.048461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895576460521621:8181]
2025-09-30T14:53:50.048503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:50.048511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.048511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:50.048513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:50.048518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:50.048523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:50.048655Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:50.058787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1338 sessionId: src_id|9fa32cb5-1c0703ce-870321dd-ec291b0b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:50.061750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:50.099140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895576550272097:2659]
2025-09-30T14:53:50.099447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1337, pipe: [1:7555895576550272097:2659]
2025-09-30T14:53:50.168274Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:50.168840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:50.168857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:50.168877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895576550272097:2659], now have 1 active actors on pipe
2025-09-30T14:53:50.169107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:50.169127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:50.169199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1338 reason: error at write: Disconnected sessionId: src_id|9fa32cb5-1c0703ce-870321dd-ec291b0b_0
2025-09-30T14:53:50.169401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1338 sessionId: src_id|9fa32cb5-1c0703ce-870321dd-ec291b0b_0 is DEAD
2025-09-30T14:53:50.169638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:50.169676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895576550272097:2659]
2025-09-30T14:53:50.169113Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:50.169947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa32cb5-1c0703ce-870321dd-ec291b0b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:50.169970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa32cb5-1c0703ce-870321dd-ec291b0b_0] Write session will restart in 0.008831s
2025-09-30T14:53:50.170010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa32cb5-1c0703ce-870321dd-ec291b0b_0] Write session: Do CDS request
2025-09-30T14:53:50.170016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa32cb5-1c0703ce-870321dd-ec291b0b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:50.179753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa32cb5-1c0703ce-870321dd-ec291b0b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:50.180157Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:50.180178Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1339
2025-09-30T14:53:50.180339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1339 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:50.180382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1339 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:50.180393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1339 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:50.180398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:50.181058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1339 sessionId:  describe result for acl check
2025-09-30T14:53:50.181096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:50.181098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:50.181100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:50.181109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895576550272137:2338] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:50.181647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895576550272137:2338] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:50.184835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895576550272137:2338] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:50.187303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895576550272137:2338] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:50.187327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895576550272137:2338] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:50.187332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895576550272137:2338] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:50.187341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1339 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:50.187572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:50.189771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:50.190003Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:50.190014Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:50.190026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:50.190083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:50.190124Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895576460521800:8183]
2025-09-30T14:53:50.190787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:50.191118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:50.191165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:50.191541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:50.191624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:50.191625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:50.191626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:50.191628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:50.191629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:50.191631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:50.191632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:50.191633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:50.191635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:50.191636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:50.191638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.191639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.191640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.191642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:50.191644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:50.191649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:50.191662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:50.191667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:50.191671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:50.191675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:50.191680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:50.191684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:50.191689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:50.191693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:50.191699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:50.191703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.191707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.191711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.191715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:50.191719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:50.191726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:50.191734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:50.191741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:50.191746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:50.191751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:50.191757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:50.191762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:50.191768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:50.191772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:50.191778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:50.191783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:50.191789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:50.191795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:50.191800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:50.191804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:50.191809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:50.191814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:50.191820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:50.191826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:50.191832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:50.191838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.191844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.191848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.191853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.191859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.191864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.191869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:50.191875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:50.191880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:50.191885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:50.191932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:50.197931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:50.198982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:50.198999Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:50.199002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:50.199006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:50.199013Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1338 [2:7555895576460521800:8183]
2025-09-30T14:53:50.199031Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:50.199048Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:50.199052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:50.199055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:50.199058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:50.199074Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:50.199086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:50.199093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:50.199170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.199181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.199184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.199188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:50.199190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:50.199279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:50.199287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.199301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.199319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.199342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:50.199364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895576460521794:8183]
2025-09-30T14:53:50.199370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895576460521794:8183]
2025-09-30T14:53:50.199373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895576460521794:8183]
2025-09-30T14:53:50.199382Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:50.199390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:50.199398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:50.199404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:50.199406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:50.199414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:50.199417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:50.199427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895576550272271:2338], now have 1 active actors on pipe
2025-09-30T14:53:50.199433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895576550272102:2454], now have 1 active actors on pipe
2025-09-30T14:53:50.199470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895576460521794:8183]
2025-09-30T14:53:50.199483Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:50.199489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:50.199504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1338
2025-09-30T14:53:50.199530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1338
2025-09-30T14:53:50.199657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:50.199668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:50.199705Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13a1ebf6-8ec83f8f-52a18e36-f8392b2b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:50.199720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:50.199728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:50.199730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:50.199741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:50.199754Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:50.199785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:50.200025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:50.200045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:50.200063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:50.200175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1339 partition: 0 MaxSeqNo: 42 sessionId: src_id|13a1ebf6-8ec83f8f-52a18e36-f8392b2b_0
2025-09-30T14:53:50.200566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa32cb5-1c0703ce-870321dd-ec291b0b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|13a1ebf6-8ec83f8f-52a18e36-f8392b2b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:50.203662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13a1ebf6-8ec83f8f-52a18e36-f8392b2b_0] Write session: try to update token
2025-09-30T14:53:50.203684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13a1ebf6-8ec83f8f-52a18e36-f8392b2b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:50.213593Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:50.213618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:50.213620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:50.213623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:50.213633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895576460521794:8183]
2025-09-30T14:53:50.213638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895576460521794:8183]
2025-09-30T14:53:50.213643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895576460521794:8183]
2025-09-30T14:53:50.213688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:50.213695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:50.213701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.213702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:50.213705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:50.213707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:50.213852Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:50.219714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1339 sessionId: src_id|13a1ebf6-8ec83f8f-52a18e36-f8392b2b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:50.222546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:50.269646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895576550272295:2659]
2025-09-30T14:53:50.270073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1338, pipe: [1:7555895576550272295:2659]
2025-09-30T14:53:50.339650Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:50.340159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:50.340183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:50.340243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895576550272295:2659], now have 1 active actors on pipe
2025-09-30T14:53:50.340609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895576550272295:2659]
2025-09-30T14:53:50.340652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:50.340655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:50.340722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1339 reason: error at write: Disconnected sessionId: src_id|13a1ebf6-8ec83f8f-52a18e36-f8392b2b_0
2025-09-30T14:53:50.341066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13a1ebf6-8ec83f8f-52a18e36-f8392b2b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:50.341079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13a1ebf6-8ec83f8f-52a18e36-f8392b2b_0] Write session will restart in 0.006104s
2025-09-30T14:53:50.341103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13a1ebf6-8ec83f8f-52a18e36-f8392b2b_0] Write session: Do CDS request
2025-09-30T14:53:50.341109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13a1ebf6-8ec83f8f-52a18e36-f8392b2b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:50.340727Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:50.340902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1339 sessionId: src_id|13a1ebf6-8ec83f8f-52a18e36-f8392b2b_0 is DEAD
2025-09-30T14:53:50.340941Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:50.348820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13a1ebf6-8ec83f8f-52a18e36-f8392b2b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:50.348904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:50.348922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1340
2025-09-30T14:53:50.349056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1340 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:50.349096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1340 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:50.349110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1340 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:50.349127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:50.349600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1340 sessionId:  describe result for acl check
2025-09-30T14:53:50.349639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:50.349645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:50.349647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:50.349654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895576550272312:2332] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:50.350235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895576550272312:2332] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:50.352741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895576550272312:2332] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:50.356029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895576550272312:2332] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:50.356050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895576550272312:2332] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:50.356056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895576550272312:2332] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:50.356065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1340 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:50.358500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:50.361289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:50.361559Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:50.361573Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:50.361587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:50.361645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:50.361682Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895576460521985:8187]
2025-09-30T14:53:50.362344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:50.364282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:50.364356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:50.364772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:50.364865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:50.364874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:50.364875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:50.364877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:50.364878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:50.364880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:50.364881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:50.364882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:50.364884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:50.364885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:50.364886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.364888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.364890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.364891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:50.364892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:50.364898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:50.364909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:50.364913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:50.364917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:50.364921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:50.364925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:50.364929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:50.364934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:50.364938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:50.364942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:50.364946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.364950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.364954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.364958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:50.364962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:50.364972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:50.364981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:50.364988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:50.364997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:50.365004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:50.365010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:50.365014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:50.365019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:50.365025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:50.365030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:50.365035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:50.365040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:50.365045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:50.365050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:50.365055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:50.365060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:50.365066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:50.365071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:50.365076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:50.365082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:50.365095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.365101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.365106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.365112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.365123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.365128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.365134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:50.365142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:50.365147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:50.365153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:50.365208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:50.371283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:50.372470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:50.372478Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:50.372481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:50.372485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:50.372492Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1339 [2:7555895576460521985:8187]
2025-09-30T14:53:50.372509Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:50.372526Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:50.372530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:50.372533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:50.372535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:50.372552Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:50.372559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:50.372566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:50.372625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.372636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.372637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.372640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:50.372641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:50.372697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:50.372703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.372715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.372726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.372744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:50.372766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895576460521980:8187]
2025-09-30T14:53:50.372773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895576460521980:8187]
2025-09-30T14:53:50.372774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895576460521980:8187]
2025-09-30T14:53:50.372785Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:50.372795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:50.372799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:50.372808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:50.372811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:50.372814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:50.372817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:50.372827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895576550272462:2332], now have 1 active actors on pipe
2025-09-30T14:53:50.372830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895576550272297:2454], now have 1 active actors on pipe
2025-09-30T14:53:50.372862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895576460521980:8187]
2025-09-30T14:53:50.372875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:50.372882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:50.373082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1339
2025-09-30T14:53:50.373118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1339
2025-09-30T14:53:50.373158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:50.373171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:50.373197Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb636210-9af80149-f9d72bd9-7a101190_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:50.373205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:50.373209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:50.373211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:50.373229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:50.373239Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:50.373261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:50.373642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:50.373657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:50.373681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:50.373816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1340 partition: 0 MaxSeqNo: 42 sessionId: src_id|eb636210-9af80149-f9d72bd9-7a101190_0
2025-09-30T14:53:50.374809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13a1ebf6-8ec83f8f-52a18e36-f8392b2b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|eb636210-9af80149-f9d72bd9-7a101190_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:50.377805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb636210-9af80149-f9d72bd9-7a101190_0] Write session: try to update token
2025-09-30T14:53:50.377827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb636210-9af80149-f9d72bd9-7a101190_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:50.385567Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:50.385593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:50.385604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895576460521980:8187]
2025-09-30T14:53:50.385650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:50.385651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:50.385835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:50.386012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:50.386162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:50.386307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:50.386514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:50.386566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:50.395212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1340 sessionId: src_id|eb636210-9af80149-f9d72bd9-7a101190_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:50.397186Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:50.397209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:50.397211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:50.397214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:50.397225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895576460521980:8187]
2025-09-30T14:53:50.397229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895576460521980:8187]
2025-09-30T14:53:50.397234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895576460521980:8187]
2025-09-30T14:53:50.397278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:50.397290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.397293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:50.397309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:50.397315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:50.397320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:50.397442Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:50.398200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:50.443330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895576550272479:2659]
2025-09-30T14:53:50.443868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1339, pipe: [1:7555895576550272479:2659]
2025-09-30T14:53:50.517490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb636210-9af80149-f9d72bd9-7a101190_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:50.517505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb636210-9af80149-f9d72bd9-7a101190_0] Write session will restart in 0.006973s
2025-09-30T14:53:50.517538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb636210-9af80149-f9d72bd9-7a101190_0] Write session: Do CDS request
2025-09-30T14:53:50.517543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb636210-9af80149-f9d72bd9-7a101190_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:50.516363Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:50.516809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:50.516820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:50.516842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895576550272479:2659], now have 1 active actors on pipe
2025-09-30T14:53:50.517069Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:50.517043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:50.517047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895576550272479:2659]
2025-09-30T14:53:50.517061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:50.517064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:50.517137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1340 reason: error at write: Disconnected sessionId: src_id|eb636210-9af80149-f9d72bd9-7a101190_0
2025-09-30T14:53:50.517332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1340 sessionId: src_id|eb636210-9af80149-f9d72bd9-7a101190_0 is DEAD
2025-09-30T14:53:50.525782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb636210-9af80149-f9d72bd9-7a101190_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:50.525885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:50.525906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1341
2025-09-30T14:53:50.526062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1341 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:50.526110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1341 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:50.526121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1341 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:50.526127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:50.526746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1341 sessionId:  describe result for acl check
2025-09-30T14:53:50.526783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:50.526785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:50.526787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:50.526793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895576550272508:2320] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:50.527383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895576550272508:2320] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:50.532738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895576550272508:2320] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:50.534863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:50.537650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:50.537860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895576550272508:2320] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:50.537878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895576550272508:2320] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:50.537899Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:50.537882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895576550272508:2320] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:50.537910Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:50.537891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1341 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:50.537922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:50.537996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:50.538046Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895576460522158:8189]
2025-09-30T14:53:50.538726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:50.539061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:50.539123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:50.539739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:50.539836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:50.539845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:50.539846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:50.539847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:50.539848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:50.539850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:50.539852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:50.539853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:50.539854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:50.539855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:50.539857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.539858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.539859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.539861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:50.539862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:50.539868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:50.539878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:50.539883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:50.539887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:50.539891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:50.539895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:50.539899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:50.539903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:50.539907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:50.539912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:50.539917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.539921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.539925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.539929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:50.539933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:50.539941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:50.539949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:50.539956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:50.539962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:50.539967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:50.539972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:50.539983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:50.539989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:50.539998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:50.540004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:50.540008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:50.540014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:50.540019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:50.540025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:50.540035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:50.540040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:50.540049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:50.540054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:50.540058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:50.540063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:50.540068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.540074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.540078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.540082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.540087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.540092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.540102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:50.540108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:50.540114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:50.540127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:50.540169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:50.546629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:50.547838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:50.547856Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:50.547859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:50.547862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:50.547869Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1340 [2:7555895576460522158:8189]
2025-09-30T14:53:50.547888Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:50.547905Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:50.547908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:50.547911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:50.547913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:50.547928Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:50.547937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:50.547952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:50.548014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.548022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.548024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.548027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:50.548030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:50.548100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:50.548109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.548122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.548138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.548158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:50.548179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895576460522153:8189]
2025-09-30T14:53:50.548187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895576460522153:8189]
2025-09-30T14:53:50.548189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895576460522153:8189]
2025-09-30T14:53:50.548201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:50.548214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:50.548229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:50.548238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:50.548275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895576460522153:8189]
2025-09-30T14:53:50.548282Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:50.548410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:50.548417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:50.548419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:50.548425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:50.548754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1340
2025-09-30T14:53:50.548782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895576550272655:2320], now have 1 active actors on pipe
2025-09-30T14:53:50.548792Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1340
2025-09-30T14:53:50.548793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895576550272481:2454], now have 1 active actors on pipe
2025-09-30T14:53:50.548898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:50.548908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:50.548936Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|322ea71b-a2786291-811429c7-d67647ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:50.548945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:50.548953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:50.548961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:50.548971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:50.548987Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:50.549018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:50.549285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:50.549292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:50.549310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:50.549708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1341 partition: 0 MaxSeqNo: 42 sessionId: src_id|322ea71b-a2786291-811429c7-d67647ae_0
2025-09-30T14:53:50.555374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb636210-9af80149-f9d72bd9-7a101190_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|322ea71b-a2786291-811429c7-d67647ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:50.558363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|322ea71b-a2786291-811429c7-d67647ae_0] Write session: try to update token
2025-09-30T14:53:50.558390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|322ea71b-a2786291-811429c7-d67647ae_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:50.563717Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:50.563735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:50.563738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:50.563739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:50.563748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895576460522153:8189]
2025-09-30T14:53:50.563752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895576460522153:8189]
2025-09-30T14:53:50.563756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895576460522153:8189]
2025-09-30T14:53:50.563790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:50.563796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.563798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:50.563804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:50.563810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:50.563814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:50.563952Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:50.578494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1341 sessionId: src_id|322ea71b-a2786291-811429c7-d67647ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:50.581453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:50.617277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895576550272687:2659]
2025-09-30T14:53:50.617592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1340, pipe: [1:7555895576550272687:2659]
2025-09-30T14:53:50.677325Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:50.677694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:50.677704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:50.677724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895576550272687:2659], now have 1 active actors on pipe
2025-09-30T14:53:50.678004Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:50.678925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895576550272687:2659]
2025-09-30T14:53:50.678972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:50.679461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|322ea71b-a2786291-811429c7-d67647ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:50.679474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|322ea71b-a2786291-811429c7-d67647ae_0] Write session will restart in 0.008001s
2025-09-30T14:53:50.679499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|322ea71b-a2786291-811429c7-d67647ae_0] Write session: Do CDS request
2025-09-30T14:53:50.679505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|322ea71b-a2786291-811429c7-d67647ae_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:50.679070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1341 reason: status is not ok: tablet will be restarted right now sessionId: src_id|322ea71b-a2786291-811429c7-d67647ae_0
2025-09-30T14:53:50.679279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:50.679437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1341 sessionId: src_id|322ea71b-a2786291-811429c7-d67647ae_0 is DEAD
2025-09-30T14:53:50.689624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|322ea71b-a2786291-811429c7-d67647ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:50.689768Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:50.689786Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1342
2025-09-30T14:53:50.689901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1342 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:50.689940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1342 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:50.689946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1342 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:50.689950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:50.690489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1342 sessionId:  describe result for acl check
2025-09-30T14:53:50.690530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:50.690532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:50.690536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:50.690542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895576550272705:8200] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:50.691103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895576550272705:8200] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:50.694322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895576550272705:8200] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:50.701343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895576550272705:8200] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:50.701361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895576550272705:8200] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:50.701365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895576550272705:8200] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:50.701375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1342 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:50.708662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:50.710988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:50.711197Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:50.711202Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:50.711212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:50.711282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:50.711320Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895576460522372:8204]
2025-09-30T14:53:50.712042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:50.713523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:50.713589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:50.713986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:50.714060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:50.714072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:50.714073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:50.714075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:50.714076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:50.714078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:50.714079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:50.714081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:50.714083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:50.714084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:50.714086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.714087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.714088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.714089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:50.714091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:50.714097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:50.714110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:50.714115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:50.714120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:50.714125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:50.714130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:50.714135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:50.714139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:50.714144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:50.714149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:50.714153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.714158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.714163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.714168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:50.714173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:50.714181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:50.714191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:50.714198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:50.714204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:50.714213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:50.714219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:50.714224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:50.714230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:50.714236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:50.714243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:50.714248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:50.714255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:50.714261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:50.714267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:50.714272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:50.714277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:50.714282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:50.714295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:50.714300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:50.714307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:50.714312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.714318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.714328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.714334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.714339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.714345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.714350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:50.714356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:50.714366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:50.714370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:50.714420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:50.720741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:50.721786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:50.721792Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:50.721795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:50.721800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:50.721807Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1341 [2:7555895576460522372:8204]
2025-09-30T14:53:50.721824Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:50.721842Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:50.721845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:50.721849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:50.721852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:50.721872Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:50.721879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:50.721886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:50.721948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.721950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.721952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.721956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:50.721958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:50.722047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:50.722060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.722073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.722084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.722109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:50.722126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895576460522367:8204]
2025-09-30T14:53:50.722129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895576460522367:8204]
2025-09-30T14:53:50.722131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895576460522367:8204]
2025-09-30T14:53:50.722139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:50.722151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:50.722153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:50.722154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:50.722157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:50.722169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:50.722172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:50.722183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895576550272690:2454], now have 1 active actors on pipe
2025-09-30T14:53:50.722195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895576550272800:8200], now have 1 active actors on pipe
2025-09-30T14:53:50.722229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895576460522367:8204]
2025-09-30T14:53:50.722237Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:50.722267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:50.722352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1341
2025-09-30T14:53:50.722642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:50.722659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:50.722396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1341
2025-09-30T14:53:50.722699Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6df4da9-6cdbc515-f26710a4-6cb5c26b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:50.722713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:50.722717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:50.722719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:50.722731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:50.722748Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:50.722765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:50.723108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:50.723119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:50.723137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:50.723744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|322ea71b-a2786291-811429c7-d67647ae_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e6df4da9-6cdbc515-f26710a4-6cb5c26b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:50.726458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6df4da9-6cdbc515-f26710a4-6cb5c26b_0] Write session: try to update token
2025-09-30T14:53:50.726473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6df4da9-6cdbc515-f26710a4-6cb5c26b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:50.723231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1342 partition: 0 MaxSeqNo: 42 sessionId: src_id|e6df4da9-6cdbc515-f26710a4-6cb5c26b_0
2025-09-30T14:53:50.743326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:50.743356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:50.743358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:50.743360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:50.743371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895576460522367:8204]
2025-09-30T14:53:50.743376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895576460522367:8204]
2025-09-30T14:53:50.743381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895576460522367:8204]
2025-09-30T14:53:50.743423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:50.743437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.743440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:50.743430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:50.743449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:50.743455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:50.743588Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:50.756574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1342 sessionId: src_id|e6df4da9-6cdbc515-f26710a4-6cb5c26b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:50.759504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:50.779072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895576550272873:2659]
2025-09-30T14:53:50.782852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1341, pipe: [1:7555895576550272873:2659]
2025-09-30T14:53:50.861279Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:50.861690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:50.861705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:50.861743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895576550272873:2659], now have 1 active actors on pipe
2025-09-30T14:53:50.862204Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:50.862497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895576550272873:2659]
2025-09-30T14:53:50.862530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:50.862565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:50.862643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1342 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e6df4da9-6cdbc515-f26710a4-6cb5c26b_0
2025-09-30T14:53:50.862827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1342 sessionId: src_id|e6df4da9-6cdbc515-f26710a4-6cb5c26b_0 is DEAD
2025-09-30T14:53:50.863443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6df4da9-6cdbc515-f26710a4-6cb5c26b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:50.863455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6df4da9-6cdbc515-f26710a4-6cb5c26b_0] Write session will restart in 0.005953s
2025-09-30T14:53:50.863478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6df4da9-6cdbc515-f26710a4-6cb5c26b_0] Write session: Do CDS request
2025-09-30T14:53:50.863485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6df4da9-6cdbc515-f26710a4-6cb5c26b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:50.883728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6df4da9-6cdbc515-f26710a4-6cb5c26b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:50.886833Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:50.886852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1343
2025-09-30T14:53:50.887195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1343 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:50.887231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1343 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:50.887236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1343 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:50.887240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:50.887660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1343 sessionId:  describe result for acl check
2025-09-30T14:53:50.887689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:50.887696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:50.887698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:50.887704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895576550272984:8204] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:50.888272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895576550272984:8204] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:50.891390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895576550272984:8204] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:50.893693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:50.896213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:50.896424Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:50.896434Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:50.896444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:50.896460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895576550272984:8204] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:50.896476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895576550272984:8204] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:50.896479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895576550272984:8204] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:50.896488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1343 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:50.896500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:50.896541Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895576460522547:8206]
2025-09-30T14:53:50.897193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:50.897479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:50.897537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:50.897879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:50.897953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:50.897958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:50.897960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:50.897982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:50.897984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:50.897985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:50.897987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:50.897988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:50.897990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:50.897991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:50.897993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.897994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.897995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.897996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:50.897998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:50.898004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:50.898015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:50.898020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:50.898024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:50.898029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:50.898034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:50.898038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:50.898047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:50.898052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:50.898057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:50.898065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.898069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.898074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.898080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:50.898085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:50.898094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:50.898106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:50.898116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:50.898121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:50.898126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:50.898132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:50.898137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:50.898143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:50.898152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:50.898159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:50.898167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:50.898173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:50.898179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:50.898185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:50.898189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:50.898195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:50.898199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:50.898205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:50.898210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:50.898216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:50.898228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.898233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.898237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.898241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.898246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.898251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.898256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:50.898261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:50.898265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:50.898271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:50.898315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:50.908334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:50.909581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:50.909588Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:50.909590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:50.909594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:50.909601Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1342 [2:7555895576460522547:8206]
2025-09-30T14:53:50.909618Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:50.909634Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:50.909641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:50.909645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:50.909649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:50.909666Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:50.909675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:50.909682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:50.909744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.909747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.909749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.909753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:50.909756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:50.909825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:50.909828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.909842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:50.909857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:50.909877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:50.909894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895576460522542:8206]
2025-09-30T14:53:50.909897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895576460522542:8206]
2025-09-30T14:53:50.909899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895576460522542:8206]
2025-09-30T14:53:50.909916Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:50.909930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:50.909946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:50.909950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:50.909994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:50.909999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:50.910000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895576460522542:8206]
2025-09-30T14:53:50.910002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:50.910003Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:50.910009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:50.910135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895576550273048:8204], now have 1 active actors on pipe
2025-09-30T14:53:50.910144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895576550272876:2454], now have 1 active actors on pipe
2025-09-30T14:53:50.911298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1342
2025-09-30T14:53:50.911327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1342
2025-09-30T14:53:50.911687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:50.911709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:50.911743Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65205e5b-79cb489f-4d40f5f6-6ad4ef58_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:50.911753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:50.911758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:50.911761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:50.911773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:50.911787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:50.911809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:50.912495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:50.912509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:50.912530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:50.912657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1343 partition: 0 MaxSeqNo: 42 sessionId: src_id|65205e5b-79cb489f-4d40f5f6-6ad4ef58_0
2025-09-30T14:53:50.913076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6df4da9-6cdbc515-f26710a4-6cb5c26b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|65205e5b-79cb489f-4d40f5f6-6ad4ef58_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:50.915965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65205e5b-79cb489f-4d40f5f6-6ad4ef58_0] Write session: try to update token
2025-09-30T14:53:50.915983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65205e5b-79cb489f-4d40f5f6-6ad4ef58_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:50.930299Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:50.930366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:50.930375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895576460522542:8206]
2025-09-30T14:53:50.930426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:50.930427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:50.930595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:50.930725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:50.930853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:50.930979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:50.931162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:50.931195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:50.943599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1343 sessionId: src_id|65205e5b-79cb489f-4d40f5f6-6ad4ef58_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:50.946584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:50.946851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:50.946902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:50.946952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:50.947142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:50.948950Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:50.948972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:50.948975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:50.948977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:50.948990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895576460522542:8206]
2025-09-30T14:53:50.948995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895576460522542:8206]
2025-09-30T14:53:50.949000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895576460522542:8206]
2025-09-30T14:53:50.949048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:50.949058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:50.949064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:50.949103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:50.949109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:50.949114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:50.949236Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:50.962870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895576550273062:2659]
2025-09-30T14:53:50.966359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1342, pipe: [1:7555895576550273062:2659]
2025-09-30T14:53:51.145368Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:51.145937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895576550273062:2659], now have 1 active actors on pipe
2025-09-30T14:53:51.154680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:51.154717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:51.154910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:51.154976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:51.155039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:51.155105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:51.155778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:51.155800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:51.155878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:51.155938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:51.155997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:51.156074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:51.156417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:51.156421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:51.156501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:51.156560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:51.156622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:51.156685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:51.156729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:51.156732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:51.156813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:51.156884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:51.156950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:51.157015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:51.157057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:51.157061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:51.157141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:51.157204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:51.157269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:51.157335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:51.157403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:51.157407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:51.157485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:51.157544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:51.157606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:51.157668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:51.157805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:51.157808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:51.157881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:51.157937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:51.158015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:51.158078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:51.158118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:51.158121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:51.158200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:51.158260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:51.158323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:51.158388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:51.158432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:51.158434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:51.158504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:51.158564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:51.158630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:51.158708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:51.158759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:51.158761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:51.158843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:51.158910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:51.158983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:51.159054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:51.159103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:51.159107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:51.160462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65205e5b-79cb489f-4d40f5f6-6ad4ef58_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:51.160473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65205e5b-79cb489f-4d40f5f6-6ad4ef58_0] Write session will restart in 0.007966s
2025-09-30T14:53:51.160498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65205e5b-79cb489f-4d40f5f6-6ad4ef58_0] Write session: Do CDS request
2025-09-30T14:53:51.160503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65205e5b-79cb489f-4d40f5f6-6ad4ef58_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:51.160018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:51.160040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:51.160080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1343 reason: error at write: Disconnected sessionId: src_id|65205e5b-79cb489f-4d40f5f6-6ad4ef58_0
2025-09-30T14:53:51.160303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1343 sessionId: src_id|65205e5b-79cb489f-4d40f5f6-6ad4ef58_0 is DEAD
2025-09-30T14:53:51.160490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895576550273062:2659]
2025-09-30T14:53:51.160506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:51.159991Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:51.169817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65205e5b-79cb489f-4d40f5f6-6ad4ef58_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:51.170155Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:51.170178Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1344
2025-09-30T14:53:51.170299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1344 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:51.170333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1344 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:51.170345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1344 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:51.170350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:51.171015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1344 sessionId:  describe result for acl check
2025-09-30T14:53:51.171073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:51.171085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:51.171087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:51.171106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895580845240386:8209] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:51.171798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895580845240386:8209] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:51.179020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895580845240386:8209] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:51.190267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895580845240386:8209] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:51.190288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895580845240386:8209] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:51.190293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895580845240386:8209] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:51.190302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1344 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:51.200664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:51.203326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:51.203565Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:51.203570Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:51.203581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:51.203638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:51.203675Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895580755490027:8208]
2025-09-30T14:53:51.204381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:51.204732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:51.204784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:51.205151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:51.205205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:51.205207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:51.205209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:51.205210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:51.205212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:51.205213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:51.205215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:51.205216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:51.205217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:51.205219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:51.205220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:51.205221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:51.205223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:51.205224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:51.205225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:51.205231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:51.205242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:51.205247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:51.205252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:51.205256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:51.205262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:51.205267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:51.205271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:51.205276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:51.205281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:51.205285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:51.205290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:51.205295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:51.205298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:51.205301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:51.205309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:51.205316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:51.205322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:51.205329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:51.205333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:51.205340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:51.205344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:51.205350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:51.205356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:51.205362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:51.205367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:51.205372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:51.205378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:51.205384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:51.205389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:51.205395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:51.205399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:51.205405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:51.205410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:51.205416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:51.205421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:51.205427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:51.205432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:51.205438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:51.205443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:51.205449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:51.205454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:51.205460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:51.205465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:51.205470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:51.205518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:51.213111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:51.215030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:51.215048Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:51.215051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:51.215056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:51.215065Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1343 [2:7555895580755490027:8208]
2025-09-30T14:53:51.215088Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:51.215107Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:51.215111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:51.215115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:51.215117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:51.215139Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:51.215148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:51.215157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:51.215235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:51.215238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:51.215254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:51.215259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:51.215263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:51.215363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:51.215366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:51.215383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:51.215400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:51.215418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:51.215438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895580755490022:8208]
2025-09-30T14:53:51.215441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895580755490022:8208]
2025-09-30T14:53:51.215443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895580755490022:8208]
2025-09-30T14:53:51.215464Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:51.215484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:51.215501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:51.215510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:51.215558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895580755490022:8208]
2025-09-30T14:53:51.215567Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:51.215675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:51.215695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:51.215702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:51.215711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:51.215786Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1343
2025-09-30T14:53:51.215850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1343
2025-09-30T14:53:51.216973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895580845240377:2454], now have 1 active actors on pipe
2025-09-30T14:53:51.217005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895580845240462:8209], now have 1 active actors on pipe
2025-09-30T14:53:51.217037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:51.217044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:51.217092Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3379771-54185225-dab810e6-a3480abb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:51.217107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:51.217112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:51.217124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:51.217139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:51.217157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:51.217185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:51.217497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:51.217518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:51.217565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:51.217752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1344 partition: 0 MaxSeqNo: 42 sessionId: src_id|3379771-54185225-dab810e6-a3480abb_0
2025-09-30T14:53:51.219837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65205e5b-79cb489f-4d40f5f6-6ad4ef58_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3379771-54185225-dab810e6-a3480abb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:51.223239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3379771-54185225-dab810e6-a3480abb_0] Write session: try to update token
2025-09-30T14:53:51.223281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3379771-54185225-dab810e6-a3480abb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:51.248159Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:51.248188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:51.248192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:51.248195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:51.248215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895580755490022:8208]
2025-09-30T14:53:51.248225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895580755490022:8208]
2025-09-30T14:53:51.248229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895580755490022:8208]
2025-09-30T14:53:51.248275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:51.248283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:51.248286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:51.248460Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:51.251681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:51.251701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:51.251706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:51.260848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895580845240565:2659]
2025-09-30T14:53:51.261035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1344 sessionId: src_id|3379771-54185225-dab810e6-a3480abb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:51.261589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1343, pipe: [1:7555895580845240565:2659]
2025-09-30T14:53:51.263870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:51.379446Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:51.379846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895580845240565:2659], now have 1 active actors on pipe
2025-09-30T14:53:51.379873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:51.379880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:51.380289Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:51.384118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3379771-54185225-dab810e6-a3480abb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:51.384131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3379771-54185225-dab810e6-a3480abb_0] Write session will restart in 0.008893s
2025-09-30T14:53:51.384155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3379771-54185225-dab810e6-a3480abb_0] Write session: Do CDS request
2025-09-30T14:53:51.384161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3379771-54185225-dab810e6-a3480abb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:51.383619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895580845240565:2659]
2025-09-30T14:53:51.383658Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:51.383694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:51.383771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1344 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3379771-54185225-dab810e6-a3480abb_0
2025-09-30T14:53:51.383966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1344 sessionId: src_id|3379771-54185225-dab810e6-a3480abb_0 is DEAD
2025-09-30T14:53:51.393839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3379771-54185225-dab810e6-a3480abb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:51.395406Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:51.395425Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1345
2025-09-30T14:53:51.395736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1345 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:51.395787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1345 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:51.395799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1345 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:51.395804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:51.396323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1345 sessionId:  describe result for acl check
2025-09-30T14:53:51.396370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:51.396372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:51.396374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:51.396380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895580845240619:8214] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:51.396968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895580845240619:8214] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:51.401118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895580845240619:8214] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:51.404724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895580845240619:8214] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:51.404742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895580845240619:8214] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:51.404747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895580845240619:8214] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:51.404756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1345 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:51.406010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:51.408912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:51.409143Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:51.409155Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:51.409167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:51.409233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:51.409288Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895580755490218:8212]
2025-09-30T14:53:51.410022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:51.410390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:51.410443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:51.410801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:51.410862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:51.410864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:51.410865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:51.410866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:51.410868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:51.410870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:51.410872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:51.410873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:51.410874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:51.410876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:51.410877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:51.410878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:51.410880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:51.410881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:51.410882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:51.410889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:51.410900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:51.410905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:51.410910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:51.410914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:51.410919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:51.410924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:51.410928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:51.410932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:51.410938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:51.410943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:51.410947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:51.410952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:51.410956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:51.410961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:51.410971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:51.410980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:51.410987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:51.410993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:51.410999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:51.411005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:51.411010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:51.411016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:51.411022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:51.411028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:51.411033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:51.411040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:51.411046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:51.411052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:51.411057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:51.411063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:51.411069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:51.411075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:51.411080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:51.411086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:51.411091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:51.411098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:51.411103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:51.411109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:51.411117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:51.411122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:51.411127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:51.411133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:51.411138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:51.411144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:51.411194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:51.417719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:51.418858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:51.418865Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:51.418867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:51.418871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:51.418879Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1344 [2:7555895580755490218:8212]
2025-09-30T14:53:51.418898Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:51.418914Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:51.418917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:51.418920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:51.418923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:51.418941Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:51.418948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:51.418956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:51.419019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:51.419021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:51.419023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:51.419027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:51.419030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:51.419108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:51.419111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:51.419125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:51.419136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:51.419153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:51.419170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895580755490213:8212]
2025-09-30T14:53:51.419173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895580755490213:8212]
2025-09-30T14:53:51.419176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895580755490213:8212]
2025-09-30T14:53:51.419185Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:51.419201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:51.419212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:51.419216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:51.419218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:51.419219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:51.419222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:51.419229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895580845240579:2454], now have 1 active actors on pipe
2025-09-30T14:53:51.419234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895580845240748:8214], now have 1 active actors on pipe
2025-09-30T14:53:51.419289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895580755490213:8212]
2025-09-30T14:53:51.419300Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:51.419330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:51.422560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1344
2025-09-30T14:53:51.422612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1344
2025-09-30T14:53:51.423943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:51.423962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:51.423996Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d27d806f-2f8a1395-bd2ebe86-77cc1b9c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:51.424008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:51.424012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:51.424015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:51.424028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:51.424046Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:51.424061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:51.424408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:51.424416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:51.424431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:51.424574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1345 partition: 0 MaxSeqNo: 42 sessionId: src_id|d27d806f-2f8a1395-bd2ebe86-77cc1b9c_0
2025-09-30T14:53:51.425028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3379771-54185225-dab810e6-a3480abb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d27d806f-2f8a1395-bd2ebe86-77cc1b9c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:51.428012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d27d806f-2f8a1395-bd2ebe86-77cc1b9c_0] Write session: try to update token
2025-09-30T14:53:51.428035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d27d806f-2f8a1395-bd2ebe86-77cc1b9c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:51.445034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1345 sessionId: src_id|d27d806f-2f8a1395-bd2ebe86-77cc1b9c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:51.447918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:51.448145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:51.448169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:51.448204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:51.450374Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:51.450397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:51.450400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:51.450402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:51.450412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895580755490213:8212]
2025-09-30T14:53:51.450417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895580755490213:8212]
2025-09-30T14:53:51.450422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895580755490213:8212]
2025-09-30T14:53:51.450460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:51.450467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:51.450469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:51.450618Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:51.448741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:51.454435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:51.454460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:51.454465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:51.483782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895580845240762:2659]
2025-09-30T14:53:51.484378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1344, pipe: [1:7555895580845240762:2659]
2025-09-30T14:53:51.572066Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:51.581035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:51.581072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:51.581262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:51.581325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:51.581388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:51.581455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:51.581498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:51.581504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:51.581577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:51.581641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:51.581707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:51.581774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:51.581818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:51.581822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:51.581904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:51.581994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:51.582059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:51.582127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:51.582171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:51.582175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:51.582256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:51.582330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:51.582406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:51.582480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:51.582534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:51.582537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:51.582617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:51.582679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:51.582749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:51.582821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:51.582863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:51.582867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:51.582941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:51.583004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:51.583072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:51.583140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:51.583184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:51.583188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:51.586133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:51.586197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895580845240762:2659]
2025-09-30T14:53:51.586224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:51.586236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:51.583481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:51.583564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:51.583637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:51.583704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:51.583751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:51.583754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:51.583837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:51.583903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:51.583969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:51.584033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:51.584075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:51.584078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:51.584149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:51.584209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:51.584274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:51.584339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:51.584383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:51.584386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:51.584458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:51.584516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:51.584579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:51.586632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d27d806f-2f8a1395-bd2ebe86-77cc1b9c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:51.586650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d27d806f-2f8a1395-bd2ebe86-77cc1b9c_0] Write session will restart in 0.009420s
2025-09-30T14:53:51.584652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:51.586672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d27d806f-2f8a1395-bd2ebe86-77cc1b9c_0] Write session: Do CDS request
2025-09-30T14:53:51.584696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:51.584699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:51.586679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d27d806f-2f8a1395-bd2ebe86-77cc1b9c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:51.584779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895580845240762:2659], now have 1 active actors on pipe
2025-09-30T14:53:51.586175Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:51.586264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1345 reason: error at write: Disconnected sessionId: src_id|d27d806f-2f8a1395-bd2ebe86-77cc1b9c_0
2025-09-30T14:53:51.586561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1345 sessionId: src_id|d27d806f-2f8a1395-bd2ebe86-77cc1b9c_0 is DEAD
2025-09-30T14:53:51.600434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d27d806f-2f8a1395-bd2ebe86-77cc1b9c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:51.600753Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:51.600773Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1346
2025-09-30T14:53:51.600927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1346 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:51.600979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1346 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:51.600985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1346 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:51.600990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:51.602382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1346 sessionId:  describe result for acl check
2025-09-30T14:53:51.602419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:51.602421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:51.602424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:51.602430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895580845240781:8219] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:51.602993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895580845240781:8219] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:51.609899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895580845240781:8219] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:51.615826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895580845240781:8219] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:51.615851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895580845240781:8219] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:51.615855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895580845240781:8219] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:51.615865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1346 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:51.648461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:51.652122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:51.652366Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:51.652371Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:51.652383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:51.652448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:51.652520Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895580755490405:8214]
2025-09-30T14:53:51.653230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:51.653845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:51.653902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:51.654290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:51.654355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:51.654362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:51.654363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:51.654364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:51.654366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:51.654368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:51.654369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:51.654371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:51.654372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:51.654374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:51.654375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:51.654377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:51.654378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:51.654379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:51.654381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:51.654387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:51.654415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:51.654419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:51.654424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:51.654429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:51.654434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:51.654437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:51.654442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:51.654445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:51.654449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:51.654453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:51.654456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:51.654460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:51.654463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:51.654467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:51.654475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:51.654484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:51.654490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:51.654496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:51.654501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:51.654507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:51.654512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:51.654518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:51.654524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:51.654530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:51.654535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:51.654541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:51.654553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:51.654559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:51.654564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:51.654570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:51.654575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:51.654582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:51.654586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:51.654593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:51.654598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:51.654604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:51.654609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:51.654615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:51.654621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:51.654626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:51.654632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:51.654637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:51.654642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:51.654649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:51.654695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:51.664088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:51.664991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:51.665008Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:51.665011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:51.665015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:51.665022Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1345 [2:7555895580755490405:8214]
2025-09-30T14:53:51.665037Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:51.665051Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:51.665061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:51.665064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:51.665066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:51.665081Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:51.665092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:51.665099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:51.665165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:51.665173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:51.665175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:51.665179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:51.665181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:51.665248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:51.665257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:51.665270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:51.665289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:51.665309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:51.665327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895580755490395:8214]
2025-09-30T14:53:51.665334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895580755490395:8214]
2025-09-30T14:53:51.665336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895580755490395:8214]
2025-09-30T14:53:51.665354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:51.665372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:51.665394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:51.665403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:51.665407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:51.665411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:51.665428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:51.665436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895580755490395:8214]
2025-09-30T14:53:51.665438Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:51.665443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:51.665687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895580845240845:8219], now have 1 active actors on pipe
2025-09-30T14:53:51.665698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895580845240767:2454], now have 1 active actors on pipe
2025-09-30T14:53:51.667408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1345
2025-09-30T14:53:51.667465Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1345
2025-09-30T14:53:51.667678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:51.667697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:51.667741Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7809c27-6c345773-e96d9a1c-33f46e01_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:51.667752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:51.667756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:51.667761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:51.667777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:51.667793Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:51.667811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:51.669070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:51.669085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:51.669104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:51.669217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1346 partition: 0 MaxSeqNo: 42 sessionId: src_id|d7809c27-6c345773-e96d9a1c-33f46e01_0
2025-09-30T14:53:51.669606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d27d806f-2f8a1395-bd2ebe86-77cc1b9c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d7809c27-6c345773-e96d9a1c-33f46e01_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:51.672524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7809c27-6c345773-e96d9a1c-33f46e01_0] Write session: try to update token
2025-09-30T14:53:51.672545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7809c27-6c345773-e96d9a1c-33f46e01_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:51.680747Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:51.680779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:51.680782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:51.680802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:51.680813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895580755490395:8214]
2025-09-30T14:53:51.680827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895580755490395:8214]
2025-09-30T14:53:51.680830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895580755490395:8214]
2025-09-30T14:53:51.680891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:51.680900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:51.680903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:51.680975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:51.680982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:51.680985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:51.681086Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:51.687351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895580845240968:2659]
2025-09-30T14:53:51.687816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1345, pipe: [1:7555895580845240968:2659]
2025-09-30T14:53:51.696296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1346 sessionId: src_id|d7809c27-6c345773-e96d9a1c-33f46e01_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:51.699009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:51.801109Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:51.801438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895580845240968:2659], now have 1 active actors on pipe
2025-09-30T14:53:51.801495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:51.801512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:51.801822Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:51.802227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895580845240968:2659]
2025-09-30T14:53:51.802266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:51.802331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1346 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d7809c27-6c345773-e96d9a1c-33f46e01_0
2025-09-30T14:53:51.802518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1346 sessionId: src_id|d7809c27-6c345773-e96d9a1c-33f46e01_0 is DEAD
2025-09-30T14:53:51.802651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:51.802671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7809c27-6c345773-e96d9a1c-33f46e01_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:51.802707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7809c27-6c345773-e96d9a1c-33f46e01_0] Write session will restart in 0.008277s
2025-09-30T14:53:51.802733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7809c27-6c345773-e96d9a1c-33f46e01_0] Write session: Do CDS request
2025-09-30T14:53:51.802739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7809c27-6c345773-e96d9a1c-33f46e01_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:51.812026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7809c27-6c345773-e96d9a1c-33f46e01_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:51.812388Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:51.812410Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1347
2025-09-30T14:53:51.812645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1347 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:51.812699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1347 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:51.812710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1347 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:51.812715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:51.813169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1347 sessionId:  describe result for acl check
2025-09-30T14:53:51.813215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:51.813217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:51.813219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:51.813225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895580845240986:8230] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:51.813824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895580845240986:8230] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:51.815671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895580845240986:8230] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:51.818193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895580845240986:8230] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:51.818208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895580845240986:8230] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:51.818211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895580845240986:8230] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:51.818220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1347 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:51.832101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:51.835698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:51.835938Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:51.835943Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:51.835954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:51.836006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:51.836046Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895580755490614:8229]
2025-09-30T14:53:51.836763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:51.837195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:51.837242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:51.837594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:51.837658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:51.837660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:51.837661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:51.837662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:51.837663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:51.837665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:51.837666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:51.837667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:51.837669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:51.837670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:51.837671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:51.837673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:51.837674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:51.837676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:51.837677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:51.837682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:51.837694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:51.837699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:51.837703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:51.837708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:51.837712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:51.837716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:51.837721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:51.837725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:51.837730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:51.837734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:51.837738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:51.837743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:51.837747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:51.837752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:51.837760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:51.837769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:51.837776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:51.837782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:51.837787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:51.837793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:51.837800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:51.837806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:51.837811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:51.837817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:51.837822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:51.837829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:51.837834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:51.837839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:51.837844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:51.837850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:51.837854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:51.837861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:51.837866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:51.837872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:51.837879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:51.837885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:51.837890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:51.837896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:51.837900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:51.837906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:51.837910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:51.837916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:51.837921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:51.837926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:51.837991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:51.850550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:51.852371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1346
2025-09-30T14:53:51.852422Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1346
2025-09-30T14:53:51.853351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1347 partition: 0 MaxSeqNo: 42 sessionId: src_id|2613cd9c-19de198e-3177a7c6-8c61eaf8_0
2025-09-30T14:53:51.853809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7809c27-6c345773-e96d9a1c-33f46e01_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2613cd9c-19de198e-3177a7c6-8c61eaf8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:51.851445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:51.851463Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:51.851467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:51.851471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:51.851479Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1346 [2:7555895580755490614:8229]
2025-09-30T14:53:51.851495Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:51.851513Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:51.851517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:51.851520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:51.851523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:51.851541Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:51.851547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:51.851556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:51.851622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:51.851625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:51.851628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:51.851632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:51.851635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:51.851711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:51.851714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:51.851728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:51.851740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:51.851759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:51.851777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895580755490608:8229]
2025-09-30T14:53:51.851780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895580755490608:8229]
2025-09-30T14:53:51.851783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895580755490608:8229]
2025-09-30T14:53:51.851800Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:51.851813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:51.851831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:51.851835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:51.851870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895580755490608:8229]
2025-09-30T14:53:51.851873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:51.851903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895580845241024:8230], now have 1 active actors on pipe
2025-09-30T14:53:51.851907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895580845240979:2454], now have 1 active actors on pipe
2025-09-30T14:53:51.851934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:51.851938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:51.851940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:51.851947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:51.852614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:51.852622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:51.852654Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2613cd9c-19de198e-3177a7c6-8c61eaf8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:51.852664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:51.852669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:51.852672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:51.852684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:51.852696Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:51.852799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:51.853060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:51.853065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:51.853082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:51.856768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2613cd9c-19de198e-3177a7c6-8c61eaf8_0] Write session: try to update token
2025-09-30T14:53:51.856790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2613cd9c-19de198e-3177a7c6-8c61eaf8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:51.874142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1347 sessionId: src_id|2613cd9c-19de198e-3177a7c6-8c61eaf8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:51.877118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:51.877101Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:51.877126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:51.877128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:51.877131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:51.877140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895580755490608:8229]
2025-09-30T14:53:51.877145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895580755490608:8229]
2025-09-30T14:53:51.877149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895580755490608:8229]
2025-09-30T14:53:51.877189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:51.877196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:51.877199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:51.877202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:51.877209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:51.877226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:51.877326Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:51.901374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895580845241168:2659]
2025-09-30T14:53:51.901769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1346, pipe: [1:7555895580845241168:2659]
2025-09-30T14:53:51.996914Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:51.997498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:51.997515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:51.997552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895580845241168:2659], now have 1 active actors on pipe
2025-09-30T14:53:51.997766Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:51.998260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2613cd9c-19de198e-3177a7c6-8c61eaf8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:51.998269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2613cd9c-19de198e-3177a7c6-8c61eaf8_0] Write session will restart in 0.007627s
2025-09-30T14:53:51.998299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2613cd9c-19de198e-3177a7c6-8c61eaf8_0] Write session: Do CDS request
2025-09-30T14:53:51.998305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2613cd9c-19de198e-3177a7c6-8c61eaf8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:51.997785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:51.997813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:51.997820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895580845241168:2659]
2025-09-30T14:53:51.997841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:51.997892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1347 reason: error at write: Disconnected sessionId: src_id|2613cd9c-19de198e-3177a7c6-8c61eaf8_0
2025-09-30T14:53:51.998121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1347 sessionId: src_id|2613cd9c-19de198e-3177a7c6-8c61eaf8_0 is DEAD
2025-09-30T14:53:52.006841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2613cd9c-19de198e-3177a7c6-8c61eaf8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:52.007068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:52.007085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1348
2025-09-30T14:53:52.007193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1348 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:52.007220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1348 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:52.007225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1348 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:52.007229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:52.007666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1348 sessionId:  describe result for acl check
2025-09-30T14:53:52.007695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:52.007697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:52.007700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:52.007706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895585140208481:8234] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:52.008271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895585140208481:8234] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:52.014780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895585140208481:8234] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:52.018417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895585140208481:8234] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:52.018438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895585140208481:8234] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:52.018441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895585140208481:8234] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:52.018451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1348 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:52.027319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:52.030032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:52.030280Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:52.030293Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:52.030305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:52.030372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:52.030603Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895585050458091:8231]
2025-09-30T14:53:52.031196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:52.031507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:52.031557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:52.031845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:52.031909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:52.031917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:52.031919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:52.031920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:52.031921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:52.031923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:52.031925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:52.031926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:52.031927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:52.031928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:52.031930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.031931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.031932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.031934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:52.031935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:52.031941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:52.031951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:52.031955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:52.031959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:52.031962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:52.031966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:52.031969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:52.031974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:52.031979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:52.031984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:52.031988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.031992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.031996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.032000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:52.032005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:52.032012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:52.032020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:52.032027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:52.032034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:52.032039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:52.032044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:52.032049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:52.032055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:52.032061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:52.032067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:52.032072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:52.032078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:52.032086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:52.032091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:52.032096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:52.032101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:52.032106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:52.032111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:52.032116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:52.032122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:52.032126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.032132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.032137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.032141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.032144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.032147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.032150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:52.032152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:52.032155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:52.032161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:52.032204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:52.037896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:52.038883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:52.038898Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:52.038901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:52.038905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:52.038913Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1347 [2:7555895585050458091:8231]
2025-09-30T14:53:52.038929Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:52.038946Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:52.038953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:52.038956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:52.038958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:52.038975Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:52.038986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:52.038998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:52.039655Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1347
2025-09-30T14:53:52.039685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1347
2025-09-30T14:53:52.039071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.039080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.039082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.039088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:52.039090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:52.039155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:52.039157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.039171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.039182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.039197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:52.039214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895585050458085:8231]
2025-09-30T14:53:52.039216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895585050458085:8231]
2025-09-30T14:53:52.039218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895585050458085:8231]
2025-09-30T14:53:52.039233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:52.039262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:52.039277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:52.039280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:52.039290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:52.039294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:52.039296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:52.039317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895585050458085:8231]
2025-09-30T14:53:52.039320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:52.039357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:52.040124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895585140208618:8234], now have 1 active actors on pipe
2025-09-30T14:53:52.040134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895580845241173:2454], now have 1 active actors on pipe
2025-09-30T14:53:52.040154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:52.040159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:52.040183Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b7838ca-3f9bcad2-98021128-4f2147a2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:52.040191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:52.040195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:52.040197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:52.040206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:52.040216Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:52.040230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:52.040663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:52.040672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:52.040688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:52.040837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1348 partition: 0 MaxSeqNo: 42 sessionId: src_id|8b7838ca-3f9bcad2-98021128-4f2147a2_0
2025-09-30T14:53:52.041286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2613cd9c-19de198e-3177a7c6-8c61eaf8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8b7838ca-3f9bcad2-98021128-4f2147a2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:52.044300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7838ca-3f9bcad2-98021128-4f2147a2_0] Write session: try to update token
2025-09-30T14:53:52.044321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7838ca-3f9bcad2-98021128-4f2147a2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:52.051777Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:52.051799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:52.051801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:52.051808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:52.051817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895585050458085:8231]
2025-09-30T14:53:52.051821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895585050458085:8231]
2025-09-30T14:53:52.051825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895585050458085:8231]
2025-09-30T14:53:52.051865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:52.051872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.051876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:52.051881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:52.051887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:52.051891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:52.052006Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:52.067899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1348 sessionId: src_id|8b7838ca-3f9bcad2-98021128-4f2147a2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:52.070761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:52.097963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895585140208660:2659]
2025-09-30T14:53:52.099432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1347, pipe: [1:7555895585140208660:2659]
2025-09-30T14:53:52.189719Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:52.190086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:52.190104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:52.190142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895585140208660:2659], now have 1 active actors on pipe
2025-09-30T14:53:52.190503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895585140208660:2659]
2025-09-30T14:53:52.190539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:52.190551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:52.190557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:52.190620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1348 reason: error at write: Disconnected sessionId: src_id|8b7838ca-3f9bcad2-98021128-4f2147a2_0
2025-09-30T14:53:52.190793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1348 sessionId: src_id|8b7838ca-3f9bcad2-98021128-4f2147a2_0 is DEAD
2025-09-30T14:53:52.190989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7838ca-3f9bcad2-98021128-4f2147a2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:52.190998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7838ca-3f9bcad2-98021128-4f2147a2_0] Write session will restart in 0.007749s
2025-09-30T14:53:52.191023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7838ca-3f9bcad2-98021128-4f2147a2_0] Write session: Do CDS request
2025-09-30T14:53:52.191029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7838ca-3f9bcad2-98021128-4f2147a2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:52.191736Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:52.200592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7838ca-3f9bcad2-98021128-4f2147a2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:52.200668Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:52.200688Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1349
2025-09-30T14:53:52.200871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1349 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:52.200905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1349 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:52.200916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1349 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:52.200919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:52.201405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1349 sessionId:  describe result for acl check
2025-09-30T14:53:52.201448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:52.201455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:52.201457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:52.201464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895585140208686:8239] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:52.202066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895585140208686:8239] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:52.206384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895585140208686:8239] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:52.210949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895585140208686:8239] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:52.210971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895585140208686:8239] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:52.210975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895585140208686:8239] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:52.210984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1349 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:52.211853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:52.214763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:52.214962Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:52.214973Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:52.214983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:52.215031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:52.215070Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895585050458274:8234]
2025-09-30T14:53:52.215807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:52.216344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:52.216414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:52.216742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:52.216820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:52.216827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:52.216829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:52.216830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:52.216831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:52.216832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:52.216833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:52.216835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:52.216836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:52.216837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:52.216839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.216840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.216841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.216842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:52.216844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:52.216849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:52.216859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:52.216863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:52.216868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:52.216872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:52.216876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:52.216880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:52.216885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:52.216889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:52.216893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:52.216898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.216902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.216906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.216910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:52.216914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:52.216923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:52.216932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:52.216938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:52.216944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:52.216949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:52.216953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:52.216956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:52.216959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:52.216962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:52.216965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:52.216967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:52.216970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:52.216973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:52.216976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:52.216979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:52.216982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:52.216985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:52.216988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:52.216990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:52.216995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:52.216997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.217001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.217003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.217006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.217009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.217012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.217015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:52.217017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:52.217020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:52.217023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:52.217047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:52.223463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:52.225132Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1348
2025-09-30T14:53:52.225171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1348
2025-09-30T14:53:52.224689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:52.224710Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:52.224712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:52.224717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:52.224724Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1348 [2:7555895585050458274:8234]
2025-09-30T14:53:52.224742Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:52.224758Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:52.224761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:52.224764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:52.224767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:52.224783Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:52.224791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:52.224797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:52.224857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.224859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.224861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.224865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:52.224868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:52.224941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:52.224945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.224960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.224974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.224994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:52.225014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895585140208666:2454], now have 1 active actors on pipe
2025-09-30T14:53:52.225018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895585140208843:8239], now have 1 active actors on pipe
2025-09-30T14:53:52.225024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895585050458269:8234]
2025-09-30T14:53:52.225027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895585050458269:8234]
2025-09-30T14:53:52.225029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895585050458269:8234]
2025-09-30T14:53:52.225045Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:52.225058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:52.225061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:52.225065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:52.225067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:52.225074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:52.225077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:52.225112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895585050458269:8234]
2025-09-30T14:53:52.225122Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:52.225158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:52.226209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:52.226216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:52.226245Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|731beea2-e9e7384f-cfa3283a-2bd8e066_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:52.226266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:52.226270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:52.226273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:52.226285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:52.226297Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:52.226314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:52.227690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:52.227697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:52.227719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:52.231337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1349 partition: 0 MaxSeqNo: 42 sessionId: src_id|731beea2-e9e7384f-cfa3283a-2bd8e066_0
2025-09-30T14:53:52.235574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7838ca-3f9bcad2-98021128-4f2147a2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|731beea2-e9e7384f-cfa3283a-2bd8e066_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:52.238444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|731beea2-e9e7384f-cfa3283a-2bd8e066_0] Write session: try to update token
2025-09-30T14:53:52.238467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|731beea2-e9e7384f-cfa3283a-2bd8e066_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:52.239833Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:52.239857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:52.239860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:52.239862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:52.239873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895585050458269:8234]
2025-09-30T14:53:52.239878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895585050458269:8234]
2025-09-30T14:53:52.239882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895585050458269:8234]
2025-09-30T14:53:52.239925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:52.239938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.239938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:52.239940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:52.239945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:52.239950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:52.240087Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:52.263299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1349 sessionId: src_id|731beea2-e9e7384f-cfa3283a-2bd8e066_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:52.265986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:52.290645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895585140208868:2659]
2025-09-30T14:53:52.291095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1348, pipe: [1:7555895585140208868:2659]
2025-09-30T14:53:52.370697Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:52.371106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:52.371122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:52.371142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895585140208868:2659], now have 1 active actors on pipe
2025-09-30T14:53:52.371358Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:52.373887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:52.373937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:52.374013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1349 reason: status is not ok: tablet will be restarted right now sessionId: src_id|731beea2-e9e7384f-cfa3283a-2bd8e066_0
2025-09-30T14:53:52.374177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1349 sessionId: src_id|731beea2-e9e7384f-cfa3283a-2bd8e066_0 is DEAD
2025-09-30T14:53:52.374338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895585140208868:2659]
2025-09-30T14:53:52.374656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|731beea2-e9e7384f-cfa3283a-2bd8e066_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:52.374665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|731beea2-e9e7384f-cfa3283a-2bd8e066_0] Write session will restart in 0.007551s
2025-09-30T14:53:52.374688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|731beea2-e9e7384f-cfa3283a-2bd8e066_0] Write session: Do CDS request
2025-09-30T14:53:52.374694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|731beea2-e9e7384f-cfa3283a-2bd8e066_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:52.383721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|731beea2-e9e7384f-cfa3283a-2bd8e066_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:52.383848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:52.383866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1350
2025-09-30T14:53:52.383979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1350 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:52.384010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1350 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:52.384021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1350 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:52.384026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:52.384458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1350 sessionId:  describe result for acl check
2025-09-30T14:53:52.384493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:52.384502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:52.384503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:52.384509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895585140208883:8244] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:52.385058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895585140208883:8244] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:52.387738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895585140208883:8244] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:52.395966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895585140208883:8244] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:52.395987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895585140208883:8244] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:52.395992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895585140208883:8244] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:52.396000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1350 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:52.412075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:52.415416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:52.415661Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:52.415666Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:52.415679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:52.415746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:52.415787Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895585050458468:8237]
2025-09-30T14:53:52.416521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:52.419364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:52.419438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:52.419822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:52.419903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:52.419912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:52.419914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:52.419915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:52.419917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:52.419918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:52.419919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:52.419921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:52.419922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:52.419923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:52.419925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.419926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.419928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.419929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:52.419930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:52.419936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:52.419947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:52.419952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:52.419956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:52.419962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:52.419966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:52.419971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:52.419975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:52.419979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:52.419984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:52.419987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.419992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.419996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.420000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:52.420004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:52.420012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:52.420020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:52.420027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:52.420033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:52.420039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:52.420045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:52.420051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:52.420057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:52.420063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:52.420069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:52.420074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:52.420081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:52.420087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:52.420092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:52.420097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:52.420102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:52.420108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:52.420114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:52.420119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:52.420126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:52.420130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.420136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.420141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.420147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.420154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.420159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.420170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:52.420178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:52.420184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:52.420191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:52.420238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:52.427331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:52.428231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:52.428238Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:52.428241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:52.428246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:52.428253Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1349 [2:7555895585050458468:8237]
2025-09-30T14:53:52.428272Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:52.428287Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:52.428291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:52.428294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:52.428297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:52.428313Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:52.428321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:52.428327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:52.428386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.428388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.428390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.428394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:52.428397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:52.428457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:52.428461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.428476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.428490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.428510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:52.428526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895585050458463:8237]
2025-09-30T14:53:52.428529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895585050458463:8237]
2025-09-30T14:53:52.428531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895585050458463:8237]
2025-09-30T14:53:52.428539Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:52.428553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:52.428570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:52.428572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:52.428605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895585050458463:8237]
2025-09-30T14:53:52.428608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:52.428724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:52.428726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:52.428728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:52.428734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:52.429057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1349
2025-09-30T14:53:52.429104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1349
2025-09-30T14:53:52.429354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895585140208983:8244], now have 1 active actors on pipe
2025-09-30T14:53:52.429368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895585140208871:2454], now have 1 active actors on pipe
2025-09-30T14:53:52.429383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:52.429389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:52.429417Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a252a917-9b80c334-1341881-efb3ef1c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:52.429426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:52.429430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:52.429433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:52.429443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:52.429455Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:52.429471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:52.430078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:52.430090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:52.430110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:52.430321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1350 partition: 0 MaxSeqNo: 42 sessionId: src_id|a252a917-9b80c334-1341881-efb3ef1c_0
2025-09-30T14:53:52.430721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|731beea2-e9e7384f-cfa3283a-2bd8e066_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a252a917-9b80c334-1341881-efb3ef1c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:52.433587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a252a917-9b80c334-1341881-efb3ef1c_0] Write session: try to update token
2025-09-30T14:53:52.433605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a252a917-9b80c334-1341881-efb3ef1c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:52.448106Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:52.448131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:52.448134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:52.448136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:52.448145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895585050458463:8237]
2025-09-30T14:53:52.448150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895585050458463:8237]
2025-09-30T14:53:52.448154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895585050458463:8237]
2025-09-30T14:53:52.448193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:52.448200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.448202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:52.448353Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:52.451467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:52.451485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:52.451491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:52.454170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1350 sessionId: src_id|a252a917-9b80c334-1341881-efb3ef1c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:52.456968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:52.478844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895585140209062:2659]
2025-09-30T14:53:52.479573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1349, pipe: [1:7555895585140209062:2659]
2025-09-30T14:53:52.569614Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:52.570056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:52.570073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:52.570112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895585140209062:2659], now have 1 active actors on pipe
2025-09-30T14:53:52.570380Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:52.570376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:52.570395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:52.570421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:52.570459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1350 reason: error at write: Disconnected sessionId: src_id|a252a917-9b80c334-1341881-efb3ef1c_0
2025-09-30T14:53:52.570468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895585140209062:2659]
2025-09-30T14:53:52.570659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1350 sessionId: src_id|a252a917-9b80c334-1341881-efb3ef1c_0 is DEAD
2025-09-30T14:53:52.570860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a252a917-9b80c334-1341881-efb3ef1c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:52.570917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a252a917-9b80c334-1341881-efb3ef1c_0] Write session will restart in 0.005059s
2025-09-30T14:53:52.570942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a252a917-9b80c334-1341881-efb3ef1c_0] Write session: Do CDS request
2025-09-30T14:53:52.570947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a252a917-9b80c334-1341881-efb3ef1c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:52.577952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a252a917-9b80c334-1341881-efb3ef1c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:52.581695Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:52.581715Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1351
2025-09-30T14:53:52.581924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1351 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:52.581960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1351 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:52.581982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1351 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:52.581991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:52.583016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1351 sessionId:  describe result for acl check
2025-09-30T14:53:52.583053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:52.583062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:52.583065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:52.583072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895585140209091:8249] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:52.583636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895585140209091:8249] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:52.586064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895585140209091:8249] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:52.593360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895585140209091:8249] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:52.593380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895585140209091:8249] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:52.593385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895585140209091:8249] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:52.593394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1351 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:52.610657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:52.613847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:52.614105Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:52.614109Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:52.614121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:52.614179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:52.614218Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895585050458651:8239]
2025-09-30T14:53:52.614922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:52.615278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:52.615325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:52.615664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:52.615722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:52.615723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:52.615725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:52.615726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:52.615728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:52.615729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:52.615730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:52.615732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:52.615733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:52.615735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:52.615736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.615737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.615739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.615741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:52.615742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:52.615747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:52.615758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:52.615763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:52.615768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:52.615773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:52.615777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:52.615781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:52.615786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:52.615790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:52.615795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:52.615800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.615805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.615810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.615814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:52.615819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:52.615828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:52.615837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:52.615844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:52.615850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:52.615856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:52.615862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:52.615867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:52.615873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:52.615878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:52.615885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:52.615890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:52.615896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:52.615902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:52.615908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:52.615913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:52.615918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:52.615927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:52.615933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:52.615938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:52.615944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:52.615949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.615955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.615960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.615965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.615970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.615976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.615981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:52.615987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:52.615992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:52.615997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:52.616045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:52.622810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:52.624041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:52.624059Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:52.624061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:52.624066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:52.624073Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1350 [2:7555895585050458651:8239]
2025-09-30T14:53:52.624091Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:52.624106Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:52.624110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:52.624114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:52.624116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:52.624132Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:52.624139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:52.624147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:52.624211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.624223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.624225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.624229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:52.624232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:52.624300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:52.624303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.624318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.624332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.624351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:52.624370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895585050458646:8239]
2025-09-30T14:53:52.624372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895585050458646:8239]
2025-09-30T14:53:52.624374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895585050458646:8239]
2025-09-30T14:53:52.624382Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:52.624392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:52.624395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:52.624396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895585140209067:2454], now have 1 active actors on pipe
2025-09-30T14:53:52.624397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:52.624400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895585140209170:8249], now have 1 active actors on pipe
2025-09-30T14:53:52.624408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:52.624424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:52.624427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:52.624465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895585050458646:8239]
2025-09-30T14:53:52.624475Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:52.624617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:52.624951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1350
2025-09-30T14:53:52.624996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1350
2025-09-30T14:53:52.629439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:52.629470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:52.629505Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b2ca1da-25e4ee72-748e4ca4-69fee0db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:52.629517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:52.629521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:52.629526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:52.629539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:52.629555Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:52.629575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:52.629996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:52.630007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:52.630021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:52.630137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1351 partition: 0 MaxSeqNo: 42 sessionId: src_id|6b2ca1da-25e4ee72-748e4ca4-69fee0db_0
2025-09-30T14:53:52.630569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a252a917-9b80c334-1341881-efb3ef1c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6b2ca1da-25e4ee72-748e4ca4-69fee0db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:52.633426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b2ca1da-25e4ee72-748e4ca4-69fee0db_0] Write session: try to update token
2025-09-30T14:53:52.633447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b2ca1da-25e4ee72-748e4ca4-69fee0db_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:52.639440Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:52.639463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:52.639466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:52.639469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:52.639478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895585050458646:8239]
2025-09-30T14:53:52.639483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895585050458646:8239]
2025-09-30T14:53:52.639487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895585050458646:8239]
2025-09-30T14:53:52.639529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:52.639536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.639540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:52.639678Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:52.643318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:52.643345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:52.643350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:52.650973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1351 sessionId: src_id|6b2ca1da-25e4ee72-748e4ca4-69fee0db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:52.653689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:52.670390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895585140209260:2659]
2025-09-30T14:53:52.670656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1350, pipe: [1:7555895585140209260:2659]
2025-09-30T14:53:52.759192Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:52.759571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:52.759589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:52.759604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895585140209260:2659], now have 1 active actors on pipe
2025-09-30T14:53:52.759786Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:52.759952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:52.760003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895585140209260:2659]
2025-09-30T14:53:52.760021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:52.760089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1351 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6b2ca1da-25e4ee72-748e4ca4-69fee0db_0
2025-09-30T14:53:52.760296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1351 sessionId: src_id|6b2ca1da-25e4ee72-748e4ca4-69fee0db_0 is DEAD
2025-09-30T14:53:52.763515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b2ca1da-25e4ee72-748e4ca4-69fee0db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:52.763527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b2ca1da-25e4ee72-748e4ca4-69fee0db_0] Write session will restart in 0.006396s
2025-09-30T14:53:52.763552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b2ca1da-25e4ee72-748e4ca4-69fee0db_0] Write session: Do CDS request
2025-09-30T14:53:52.763557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b2ca1da-25e4ee72-748e4ca4-69fee0db_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:52.771818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b2ca1da-25e4ee72-748e4ca4-69fee0db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:52.775413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:52.775439Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1352
2025-09-30T14:53:52.775651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1352 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:52.775689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1352 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:52.775695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1352 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:52.775699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:52.776073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1352 sessionId:  describe result for acl check
2025-09-30T14:53:52.776097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:52.776099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:52.776100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:52.776105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895585140209432:8260] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:52.776594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895585140209432:8260] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:52.778747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:52.779897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895585140209432:8260] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:52.781751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:52.781983Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:52.781994Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:52.782006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:52.782063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:52.782104Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895585050458873:8250]
2025-09-30T14:53:52.782607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895585140209432:8260] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:52.782621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895585140209432:8260] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:52.782624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895585140209432:8260] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:52.782632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1352 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:52.782752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:52.783444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:52.783513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:52.783886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:52.783982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:52.783989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:52.783990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:52.783992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:52.783993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:52.783994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:52.783996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:52.783997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:52.783998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:52.783999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:52.784001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.784002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.784004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.784005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:52.784006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:52.784013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:52.784024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:52.784029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:52.784034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:52.784039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:52.784044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:52.784048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:52.784053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:52.784058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:52.784063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:52.784068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.784072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.784077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.784081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:52.784086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:52.784095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:52.784103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:52.784109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:52.784115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:52.784123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:52.784128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:52.784133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:52.784139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:52.784144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:52.784150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:52.784158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:52.784164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:52.784170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:52.784178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:52.784183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:52.784189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:52.784196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:52.784202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:52.784207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:52.784216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:52.784221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.784227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.784238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.784244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.784249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.784255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.784262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:52.784269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:52.784276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:52.784282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:52.784334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:52.790273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:52.791402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:52.791421Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:52.791424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:52.791427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:52.791434Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1351 [2:7555895585050458873:8250]
2025-09-30T14:53:52.791450Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:52.791465Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:52.791469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:52.791472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:52.791475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:52.791491Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:52.791498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:52.791505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:52.791563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.791565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.791567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.791571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:52.791574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:52.791639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:52.791780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.791794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.791807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.791826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:52.791846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895585050458868:8250]
2025-09-30T14:53:52.791849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895585050458868:8250]
2025-09-30T14:53:52.791851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895585050458868:8250]
2025-09-30T14:53:52.791876Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:52.791891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:52.791907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:52.791910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:52.791928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:52.791933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:52.791935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:52.791944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895585050458868:8250]
2025-09-30T14:53:52.791947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:52.792018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:52.792196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895585140209465:8260], now have 1 active actors on pipe
2025-09-30T14:53:52.792207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895585140209279:2454], now have 1 active actors on pipe
2025-09-30T14:53:52.792366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1351
2025-09-30T14:53:52.792421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1351
2025-09-30T14:53:52.795464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:52.795482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:52.795512Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff669f5e-b255356d-e02d3eaf-f75f6aeb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:52.795524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:52.795528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:52.795531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:52.795544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:52.795558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:52.795573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:52.796077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1352 partition: 0 MaxSeqNo: 42 sessionId: src_id|ff669f5e-b255356d-e02d3eaf-f75f6aeb_0
2025-09-30T14:53:52.796502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b2ca1da-25e4ee72-748e4ca4-69fee0db_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ff669f5e-b255356d-e02d3eaf-f75f6aeb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:52.799167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff669f5e-b255356d-e02d3eaf-f75f6aeb_0] Write session: try to update token
2025-09-30T14:53:52.799185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff669f5e-b255356d-e02d3eaf-f75f6aeb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:52.795913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:52.795930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:52.795955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:52.805480Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:52.805503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:52.805506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:52.805508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:52.805517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895585050458868:8250]
2025-09-30T14:53:52.805522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895585050458868:8250]
2025-09-30T14:53:52.805527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895585050458868:8250]
2025-09-30T14:53:52.805569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:52.805575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:52.805582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:52.805585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.805586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:52.805588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:52.805717Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:52.818862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1352 sessionId: src_id|ff669f5e-b255356d-e02d3eaf-f75f6aeb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:52.821806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:52.857297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895585140209478:2659]
2025-09-30T14:53:52.857736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1351, pipe: [1:7555895585140209478:2659]
2025-09-30T14:53:52.923711Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:52.924061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:52.924080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:52.924100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895585140209478:2659], now have 1 active actors on pipe
2025-09-30T14:53:52.924329Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:52.927453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:52.927475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895585140209478:2659]
2025-09-30T14:53:52.927516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:52.927599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1352 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ff669f5e-b255356d-e02d3eaf-f75f6aeb_0
2025-09-30T14:53:52.927765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1352 sessionId: src_id|ff669f5e-b255356d-e02d3eaf-f75f6aeb_0 is DEAD
2025-09-30T14:53:52.931338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff669f5e-b255356d-e02d3eaf-f75f6aeb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:52.931351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff669f5e-b255356d-e02d3eaf-f75f6aeb_0] Write session will restart in 0.008835s
2025-09-30T14:53:52.931374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff669f5e-b255356d-e02d3eaf-f75f6aeb_0] Write session: Do CDS request
2025-09-30T14:53:52.931381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff669f5e-b255356d-e02d3eaf-f75f6aeb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:52.941761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff669f5e-b255356d-e02d3eaf-f75f6aeb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:52.942246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:52.942266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1353
2025-09-30T14:53:52.942512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1353 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:52.942547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1353 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:52.942553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1353 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:52.942558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:52.942935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1353 sessionId:  describe result for acl check
2025-09-30T14:53:52.942967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:52.942969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:52.942974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:52.942979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895585140209487:8264] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:52.943495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895585140209487:8264] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:52.949588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895585140209487:8264] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:52.955648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895585140209487:8264] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:52.955669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895585140209487:8264] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:52.955673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895585140209487:8264] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:52.955682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1353 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:52.964886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:52.967313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:52.967514Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:52.967518Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:52.967529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:52.967588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:52.967622Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895585050459060:8256]
2025-09-30T14:53:52.968309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:52.969233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:52.969291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:52.969659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:52.969742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:52.969749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:52.969750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:52.969751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:52.969752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:52.969753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:52.969754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:52.969755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:52.969757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:52.969758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:52.969759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.969760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.969762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.969763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:52.969764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:52.969770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:52.969781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:52.969786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:52.969790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:52.969794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:52.969798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:52.969802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:52.969806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:52.969810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:52.969814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:52.969818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.969822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.969826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.969830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:52.969834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:52.969842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:52.969850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:52.969855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:52.969861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:52.969880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:52.969886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:52.969891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:52.969897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:52.969902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:52.969908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:52.969912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:52.969917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:52.969923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:52.969929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:52.969939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:52.969944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:52.969951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:52.969956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:52.969975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:52.969980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:52.969987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.969992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.969996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.970002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.970006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.970012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.970016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:52.970021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:52.970026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:52.970042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:52.970082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:52.977928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:52.979120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:52.979140Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:52.979143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:52.979147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:52.979154Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1352 [2:7555895585050459060:8256]
2025-09-30T14:53:52.979169Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:52.979186Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:52.979189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:52.979192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:52.979194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:52.979210Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:52.979218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:52.979225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:52.979312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.979314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.979317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.979320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:52.979323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:52.979393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:52.979396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:52.979427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:52.979440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:52.979460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:52.979477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895585050459055:8256]
2025-09-30T14:53:52.979479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895585050459055:8256]
2025-09-30T14:53:52.979482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895585050459055:8256]
2025-09-30T14:53:52.979497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:52.979511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:52.979527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:52.979530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:52.979566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895585050459055:8256]
2025-09-30T14:53:52.979569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:52.979690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:52.979695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:52.979697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:52.979704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:52.980312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1352
2025-09-30T14:53:52.980351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1352
2025-09-30T14:53:52.985192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895585140209479:2454], now have 1 active actors on pipe
2025-09-30T14:53:52.985222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895585140209566:8264], now have 1 active actors on pipe
2025-09-30T14:53:52.987191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:52.987211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:52.987253Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2be1b4f9-7480ceb7-924159e-dbe8aae9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:52.987270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:52.987279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:52.987283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:52.987298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:52.987321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:52.987344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:52.988349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:52.988358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:52.988378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:52.988623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1353 partition: 0 MaxSeqNo: 42 sessionId: src_id|2be1b4f9-7480ceb7-924159e-dbe8aae9_0
2025-09-30T14:53:52.989239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff669f5e-b255356d-e02d3eaf-f75f6aeb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2be1b4f9-7480ceb7-924159e-dbe8aae9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:52.992176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2be1b4f9-7480ceb7-924159e-dbe8aae9_0] Write session: try to update token
2025-09-30T14:53:52.992201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2be1b4f9-7480ceb7-924159e-dbe8aae9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:53.004434Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:53.004460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:53.004463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:53.004466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:53.004476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895585050459055:8256]
2025-09-30T14:53:53.004480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895585050459055:8256]
2025-09-30T14:53:53.004485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895585050459055:8256]
2025-09-30T14:53:53.004529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:53.004537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.004540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:53.004676Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:53.010052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1353 sessionId: src_id|2be1b4f9-7480ceb7-924159e-dbe8aae9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:53.007334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:53.007357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:53.007362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:53.012983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:53.031386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895589435176971:2659]
2025-09-30T14:53:53.031835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1352, pipe: [1:7555895589435176971:2659]
2025-09-30T14:53:53.147771Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:53.148367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:53.148379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:53.148425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895589435176971:2659], now have 1 active actors on pipe
2025-09-30T14:53:53.148842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:53.148915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895589435176971:2659]
2025-09-30T14:53:53.148936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:53.148939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:53.149012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1353 reason: error at write: Disconnected sessionId: src_id|2be1b4f9-7480ceb7-924159e-dbe8aae9_0
2025-09-30T14:53:53.149215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1353 sessionId: src_id|2be1b4f9-7480ceb7-924159e-dbe8aae9_0 is DEAD
2025-09-30T14:53:53.149663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2be1b4f9-7480ceb7-924159e-dbe8aae9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:53.149672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2be1b4f9-7480ceb7-924159e-dbe8aae9_0] Write session will restart in 0.005147s
2025-09-30T14:53:53.149695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2be1b4f9-7480ceb7-924159e-dbe8aae9_0] Write session: Do CDS request
2025-09-30T14:53:53.149701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2be1b4f9-7480ceb7-924159e-dbe8aae9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:53.148919Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:53.155742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2be1b4f9-7480ceb7-924159e-dbe8aae9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:53.155904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:53.155926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1354
2025-09-30T14:53:53.156167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1354 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:53.156203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1354 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:53.156213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1354 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:53.156217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:53.156824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1354 sessionId:  describe result for acl check
2025-09-30T14:53:53.156864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:53.156871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:53.156873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:53.156880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895589435176991:8271] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:53.157418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895589435176991:8271] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:53.160597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895589435176991:8271] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:53.175896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895589435176991:8271] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:53.175924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895589435176991:8271] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:53.175928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895589435176991:8271] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:53.175939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1354 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:53.217666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:53.221147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:53.221625Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:53.221630Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:53.221644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:53.221718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:53.221758Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895589345426546:8258]
2025-09-30T14:53:53.222465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:53.222931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:53.222993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:53.223346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:53.223430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:53.223432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:53.223433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:53.223434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:53.223436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:53.223437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:53.223439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:53.223440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:53.223441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:53.223442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:53.223444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.223445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:53.223446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:53.223448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:53.223449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:53.223455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:53.223466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:53.223471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:53.223475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:53.223479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:53.223483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:53.223486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:53.223491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:53.223495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:53.223499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:53.223503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.223507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:53.223510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:53.223514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:53.223518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:53.223526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:53.223535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:53.223541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:53.223547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:53.223552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:53.223558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:53.223563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:53.223571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:53.223577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:53.223582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:53.223586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:53.223591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:53.223603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:53.223608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:53.223613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:53.223618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:53.223623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:53.223629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:53.223633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:53.223638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:53.223642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.223646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.223665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:53.223671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:53.223676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:53.223681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:53.223685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:53.223692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:53.223696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:53.223702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:53.223744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:53.231122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:53.232233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:53.232241Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:53.232244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:53.232248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:53.232256Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1353 [2:7555895589345426546:8258]
2025-09-30T14:53:53.232274Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:53.232293Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:53.232297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:53.232300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:53.232303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:53.232321Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:53.232329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:53.232337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:53.232414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.232416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:53.232419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:53.232422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:53.232425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:53.232593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:53.232597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.232615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:53.232628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:53.232648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:53.232667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895589345426540:8258]
2025-09-30T14:53:53.232670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895589345426540:8258]
2025-09-30T14:53:53.232673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895589345426540:8258]
2025-09-30T14:53:53.232686Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:53.232701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:53.232717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:53.232720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:53.232764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895589345426540:8258]
2025-09-30T14:53:53.232766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:53.233592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1353
2025-09-30T14:53:53.233638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1353
2025-09-30T14:53:53.233037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:53.233048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:53.233050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:53.233056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:53.236619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895589435176984:2454], now have 1 active actors on pipe
2025-09-30T14:53:53.236636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895589435177043:8271], now have 1 active actors on pipe
2025-09-30T14:53:53.236662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:53.236669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:53.236703Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb1249f2-a75e0e0c-a107a192-25e5ce5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:53.236715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:53.236722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:53.236726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:53.236739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:53.236756Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:53.236774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:53.237567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1354 partition: 0 MaxSeqNo: 42 sessionId: src_id|bb1249f2-a75e0e0c-a107a192-25e5ce5_0
2025-09-30T14:53:53.237133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:53.237161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:53.237192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:53.242920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2be1b4f9-7480ceb7-924159e-dbe8aae9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bb1249f2-a75e0e0c-a107a192-25e5ce5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:53.246129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb1249f2-a75e0e0c-a107a192-25e5ce5_0] Write session: try to update token
2025-09-30T14:53:53.246156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb1249f2-a75e0e0c-a107a192-25e5ce5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:53.247797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895589435177178:2659]
2025-09-30T14:53:53.249119Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:53.249140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:53.249142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:53.249144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:53.249153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895589345426540:8258]
2025-09-30T14:53:53.249157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895589345426540:8258]
2025-09-30T14:53:53.249160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895589345426540:8258]
2025-09-30T14:53:53.249195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:53.249215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.249217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:53.249356Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:53.251509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:53.251525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:53.251534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:53.251922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1353, pipe: [1:7555895589435177178:2659]
2025-09-30T14:53:53.277072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1354 sessionId: src_id|bb1249f2-a75e0e0c-a107a192-25e5ce5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:53.279915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:53.399520Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:53.399920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895589435177178:2659], now have 1 active actors on pipe
2025-09-30T14:53:53.399978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:53.399992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:53.400269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:53.400299Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:53.400784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb1249f2-a75e0e0c-a107a192-25e5ce5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:53.400794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb1249f2-a75e0e0c-a107a192-25e5ce5_0] Write session will restart in 0.007086s
2025-09-30T14:53:53.400830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb1249f2-a75e0e0c-a107a192-25e5ce5_0] Write session: Do CDS request
2025-09-30T14:53:53.400836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb1249f2-a75e0e0c-a107a192-25e5ce5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:53.400339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895589435177178:2659]
2025-09-30T14:53:53.400362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:53.400365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:53.400436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1354 reason: error at write: Disconnected sessionId: src_id|bb1249f2-a75e0e0c-a107a192-25e5ce5_0
2025-09-30T14:53:53.400658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1354 sessionId: src_id|bb1249f2-a75e0e0c-a107a192-25e5ce5_0 is DEAD
2025-09-30T14:53:53.408825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb1249f2-a75e0e0c-a107a192-25e5ce5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:53.408904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:53.408921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1355
2025-09-30T14:53:53.409146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1355 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:53.409180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1355 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:53.409185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1355 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:53.409189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:53.409598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1355 sessionId:  describe result for acl check
2025-09-30T14:53:53.409626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:53.409629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:53.409633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:53.409640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895589435177220:8276] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:53.410239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895589435177220:8276] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:53.414082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895589435177220:8276] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:53.420367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895589435177220:8276] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:53.420387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895589435177220:8276] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:53.420391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895589435177220:8276] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:53.420399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1355 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:53.423500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:53.425974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:53.426185Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:53.426198Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:53.426210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:53.426269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:53.426497Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895589345426746:8262]
2025-09-30T14:53:53.427171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:53.427585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:53.427669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:53.428053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:53.428130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:53.428138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:53.428139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:53.428141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:53.428142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:53.428144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:53.428145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:53.428147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:53.428149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:53.428150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:53.428152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.428154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:53.428155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:53.428156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:53.428158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:53.428165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:53.428177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:53.428181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:53.428186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:53.428191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:53.428196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:53.428201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:53.428205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:53.428209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:53.428214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:53.428218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.428222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:53.428226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:53.428230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:53.428235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:53.428243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:53.428251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:53.428263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:53.428268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:53.428275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:53.428280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:53.428289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:53.428294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:53.428301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:53.428310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:53.428315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:53.428320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:53.428324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:53.428335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:53.428340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:53.428349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:53.428357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:53.428367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:53.428372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:53.428377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:53.428386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.428391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.428396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:53.428407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:53.428412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:53.428421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:53.428426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:53.428432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:53.428441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:53.428446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:53.428486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:53.434255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:53.435341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:53.435356Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:53.435359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:53.435363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:53.435370Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1354 [2:7555895589345426746:8262]
2025-09-30T14:53:53.435387Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:53.435402Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:53.435406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:53.435409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:53.435411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:53.435427Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:53.435433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:53.435448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:53.435506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.435509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:53.435511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:53.435515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:53.435518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:53.435581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:53.435584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.435599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:53.435610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:53.435627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:53.435642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895589345426741:8262]
2025-09-30T14:53:53.435644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895589345426741:8262]
2025-09-30T14:53:53.435646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895589345426741:8262]
2025-09-30T14:53:53.435659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:53.435674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:53.435689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:53.435692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:53.435714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:53.435717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:53.435719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:53.435724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895589345426741:8262]
2025-09-30T14:53:53.435727Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:53.435777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:53.435966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895589435177363:8276], now have 1 active actors on pipe
2025-09-30T14:53:53.435983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895589435177195:2454], now have 1 active actors on pipe
2025-09-30T14:53:53.436204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1354
2025-09-30T14:53:53.436245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1354
2025-09-30T14:53:53.436313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:53.436326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:53.436353Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eafeadd0-28c7bcd7-59bccf09-41f6cd5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:53.436368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:53.436371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:53.436376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:53.436387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:53.436398Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:53.436417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:53.436558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:53.436565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:53.436577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:53.436679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1355 partition: 0 MaxSeqNo: 42 sessionId: src_id|eafeadd0-28c7bcd7-59bccf09-41f6cd5_0
2025-09-30T14:53:53.437072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb1249f2-a75e0e0c-a107a192-25e5ce5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|eafeadd0-28c7bcd7-59bccf09-41f6cd5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:53.439862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eafeadd0-28c7bcd7-59bccf09-41f6cd5_0] Write session: try to update token
2025-09-30T14:53:53.439882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eafeadd0-28c7bcd7-59bccf09-41f6cd5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:53.449774Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:53.449798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:53.449801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:53.449803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:53.449813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895589345426741:8262]
2025-09-30T14:53:53.449818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895589345426741:8262]
2025-09-30T14:53:53.449823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895589345426741:8262]
2025-09-30T14:53:53.449864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:53.449871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.449875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:53.449882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:53.449900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:53.449904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:53.450037Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:53.456887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1355 sessionId: src_id|eafeadd0-28c7bcd7-59bccf09-41f6cd5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:53.459760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:53.500483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895589435177391:2659]
2025-09-30T14:53:53.500868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1354, pipe: [1:7555895589435177391:2659]
2025-09-30T14:53:53.574553Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:53.574966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:53.574982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:53.575001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895589435177391:2659], now have 1 active actors on pipe
2025-09-30T14:53:53.575229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:53.575260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895589435177391:2659]
2025-09-30T14:53:53.575263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:53.575289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:53.576026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eafeadd0-28c7bcd7-59bccf09-41f6cd5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:53.576037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eafeadd0-28c7bcd7-59bccf09-41f6cd5_0] Write session will restart in 0.008200s
2025-09-30T14:53:53.576060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eafeadd0-28c7bcd7-59bccf09-41f6cd5_0] Write session: Do CDS request
2025-09-30T14:53:53.576065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eafeadd0-28c7bcd7-59bccf09-41f6cd5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:53.575426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1355 reason: error at write: Disconnected sessionId: src_id|eafeadd0-28c7bcd7-59bccf09-41f6cd5_0
2025-09-30T14:53:53.575642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1355 sessionId: src_id|eafeadd0-28c7bcd7-59bccf09-41f6cd5_0 is DEAD
2025-09-30T14:53:53.575459Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:53.585816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eafeadd0-28c7bcd7-59bccf09-41f6cd5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:53.586085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:53.586103Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1356
2025-09-30T14:53:53.586308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1356 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:53.586340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1356 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:53.586346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1356 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:53.586350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:53.587389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1356 sessionId:  describe result for acl check
2025-09-30T14:53:53.587431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:53.587433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:53.587435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:53.587441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895589435177409:8281] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:53.588024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895589435177409:8281] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:53.591835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895589435177409:8281] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:53.596833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895589435177409:8281] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:53.596852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895589435177409:8281] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:53.596855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895589435177409:8281] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:53.596864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1356 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:53.620086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:53.623340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:53.623681Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:53.623686Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:53.623699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:53.623790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:53.623827Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895589345426936:8264]
2025-09-30T14:53:53.624491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:53.624961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:53.625014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:53.625376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:53.625462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:53.625463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:53.625465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:53.625466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:53.625467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:53.625468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:53.625469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:53.625470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:53.625472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:53.625473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:53.625474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.625475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:53.625476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:53.625477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:53.625482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:53.625489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:53.625500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:53.625504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:53.625508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:53.625513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:53.625517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:53.625521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:53.625525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:53.625529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:53.625533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:53.625536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.625540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:53.625544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:53.625547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:53.625551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:53.625559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:53.625567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:53.625572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:53.625578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:53.625583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:53.625588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:53.625592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:53.625597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:53.625602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:53.625607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:53.625611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:53.625616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:53.625621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:53.625626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:53.625631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:53.625637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:53.625652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:53.625659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:53.625664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:53.625671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:53.625676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.625690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.625694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:53.625699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:53.625704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:53.625709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:53.625715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:53.625720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:53.625726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:53.625731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:53.625778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:53.632008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:53.633220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:53.633226Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:53.633229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:53.633233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:53.633240Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1355 [2:7555895589345426936:8264]
2025-09-30T14:53:53.633259Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:53.633275Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:53.633278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:53.633281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:53.633286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:53.633302Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:53.633308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:53.633315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:53.633374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.633376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:53.633378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:53.633381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:53.633383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:53.633447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:53.633449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.633463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:53.633476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:53.633491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:53.633508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895589345426930:8264]
2025-09-30T14:53:53.633510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895589345426930:8264]
2025-09-30T14:53:53.633511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895589345426930:8264]
2025-09-30T14:53:53.633523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:53.633536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:53.633550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:53.633552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:53.633584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895589345426930:8264]
2025-09-30T14:53:53.633587Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:53.634181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:53.634185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:53.634187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:53.634193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:53.634957Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1355
2025-09-30T14:53:53.635000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1355
2025-09-30T14:53:53.635327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895589435177395:2454], now have 1 active actors on pipe
2025-09-30T14:53:53.635340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895589435177445:8281], now have 1 active actors on pipe
2025-09-30T14:53:53.635356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:53.635361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:53.635388Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35fd534c-17cf0b3d-f445132-2438b142_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:53.635400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:53.635403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:53.635406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:53.635417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:53.635429Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:53.635445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:53.636030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:53.636042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:53.636061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:53.636236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1356 partition: 0 MaxSeqNo: 42 sessionId: src_id|35fd534c-17cf0b3d-f445132-2438b142_0
2025-09-30T14:53:53.639560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eafeadd0-28c7bcd7-59bccf09-41f6cd5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|35fd534c-17cf0b3d-f445132-2438b142_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:53.642283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35fd534c-17cf0b3d-f445132-2438b142_0] Write session: try to update token
2025-09-30T14:53:53.642304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35fd534c-17cf0b3d-f445132-2438b142_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:53.651203Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:53.651221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:53.651224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:53.651226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:53.651235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895589345426930:8264]
2025-09-30T14:53:53.651254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895589345426930:8264]
2025-09-30T14:53:53.651259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895589345426930:8264]
2025-09-30T14:53:53.651299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:53.651305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.651308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:53.651450Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:53.652565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:53.652584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:53.652589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:53.670405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1356 sessionId: src_id|35fd534c-17cf0b3d-f445132-2438b142_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:53.673132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:53.675435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895589435177594:2659]
2025-09-30T14:53:53.677736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1355, pipe: [1:7555895589435177594:2659]
2025-09-30T14:53:53.771507Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:53.771834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:53.771850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:53.771886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895589435177594:2659], now have 1 active actors on pipe
2025-09-30T14:53:53.772147Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:53.772937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35fd534c-17cf0b3d-f445132-2438b142_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:53.772948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35fd534c-17cf0b3d-f445132-2438b142_0] Write session will restart in 0.008644s
2025-09-30T14:53:53.772482Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:53.772984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35fd534c-17cf0b3d-f445132-2438b142_0] Write session: Do CDS request
2025-09-30T14:53:53.772541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895589435177594:2659]
2025-09-30T14:53:53.772560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:53.772990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35fd534c-17cf0b3d-f445132-2438b142_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:53.772563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:53.772620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1356 reason: error at write: Disconnected sessionId: src_id|35fd534c-17cf0b3d-f445132-2438b142_0
2025-09-30T14:53:53.772793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1356 sessionId: src_id|35fd534c-17cf0b3d-f445132-2438b142_0 is DEAD
2025-09-30T14:53:53.782825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35fd534c-17cf0b3d-f445132-2438b142_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:53.782935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:53.782954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1357
2025-09-30T14:53:53.783094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1357 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:53.783128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1357 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:53.783139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1357 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:53.783143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:53.783682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1357 sessionId:  describe result for acl check
2025-09-30T14:53:53.783722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:53.783733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:53.783737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:53.783743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895589435177629:8291] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:53.784276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895589435177629:8291] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:53.788181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895589435177629:8291] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:53.791709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895589435177629:8291] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:53.791730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895589435177629:8291] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:53.791733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895589435177629:8291] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:53.791741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1357 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:53.793921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:53.796892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:53.797263Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:53.797279Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:53.797294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:53.797368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:53.797411Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895589345427141:8269]
2025-09-30T14:53:53.798119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:53.798446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:53.798514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:53.798904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:53.798970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:53.798977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:53.798978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:53.798979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:53.798981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:53.798982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:53.798984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:53.798985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:53.798986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:53.798987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:53.798989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.798990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:53.798991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:53.798992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:53.798994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:53.799000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:53.799011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:53.799015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:53.799019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:53.799024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:53.799029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:53.799033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:53.799038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:53.799043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:53.799049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:53.799053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.799057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:53.799061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:53.799066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:53.799071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:53.799077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:53.799086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:53.799093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:53.799100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:53.799105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:53.799112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:53.799117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:53.799122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:53.799133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:53.799139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:53.799149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:53.799154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:53.799165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:53.799171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:53.799180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:53.799186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:53.799191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:53.799200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:53.799205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:53.799210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:53.799220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.799226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.799235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:53.799241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:53.799269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:53.799274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:53.799278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:53.799282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:53.799287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:53.799292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:53.799339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:53.806877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:53.808046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:53.808062Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:53.808065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:53.808070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:53.808076Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1356 [2:7555895589345427141:8269]
2025-09-30T14:53:53.808093Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:53.808107Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:53.808111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:53.808113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:53.808116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:53.808131Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:53.808142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:53.808148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:53.808206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.808215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:53.808217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:53.808222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:53.808224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:53.808286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:53.808294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.808307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:53.808325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:53.808343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:53.808366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895589345427136:8269]
2025-09-30T14:53:53.808373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895589345427136:8269]
2025-09-30T14:53:53.808375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895589345427136:8269]
2025-09-30T14:53:53.808391Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:53.808407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:53.808422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:53.808425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:53.808459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895589345427136:8269]
2025-09-30T14:53:53.808461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:53.808486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:53.808490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:53.808492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:53.808507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:53.808702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895589435177786:8291], now have 1 active actors on pipe
2025-09-30T14:53:53.808707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895589435177609:2454], now have 1 active actors on pipe
2025-09-30T14:53:53.809885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1356
2025-09-30T14:53:53.809918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1356
2025-09-30T14:53:53.810538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1357 partition: 0 MaxSeqNo: 42 sessionId: src_id|b31d3d49-6e5677f1-bfed664e-c6588bc2_0
2025-09-30T14:53:53.810895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35fd534c-17cf0b3d-f445132-2438b142_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b31d3d49-6e5677f1-bfed664e-c6588bc2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:53.813626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b31d3d49-6e5677f1-bfed664e-c6588bc2_0] Write session: try to update token
2025-09-30T14:53:53.813643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b31d3d49-6e5677f1-bfed664e-c6588bc2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:53.809995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:53.810015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:53.810060Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b31d3d49-6e5677f1-bfed664e-c6588bc2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:53.810070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:53.810074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:53.810076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:53.810087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:53.810111Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:53.810128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:53.810418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:53.810424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:53.810443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:53.822074Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:53.822105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:53.822109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:53.822113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:53.822126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895589345427136:8269]
2025-09-30T14:53:53.822133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895589345427136:8269]
2025-09-30T14:53:53.822140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895589345427136:8269]
2025-09-30T14:53:53.822183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:53.822196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:53.822198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:53.822203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:53.822205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.822210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:53.822430Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:53.828735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1357 sessionId: src_id|b31d3d49-6e5677f1-bfed664e-c6588bc2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:53.831509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:53.872580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895589435177817:2659]
2025-09-30T14:53:53.872912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1356, pipe: [1:7555895589435177817:2659]
2025-09-30T14:53:53.938752Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:53.939083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:53.939102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:53.939123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895589435177817:2659], now have 1 active actors on pipe
2025-09-30T14:53:53.939823Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:53.940812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31d3d49-6e5677f1-bfed664e-c6588bc2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:53.940822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31d3d49-6e5677f1-bfed664e-c6588bc2_0] Write session will restart in 0.007592s
2025-09-30T14:53:53.940843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31d3d49-6e5677f1-bfed664e-c6588bc2_0] Write session: Do CDS request
2025-09-30T14:53:53.940849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31d3d49-6e5677f1-bfed664e-c6588bc2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:53.939599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:53.939617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:53.940272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1357 reason: error at write: Disconnected sessionId: src_id|b31d3d49-6e5677f1-bfed664e-c6588bc2_0
2025-09-30T14:53:53.940430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1357 sessionId: src_id|b31d3d49-6e5677f1-bfed664e-c6588bc2_0 is DEAD
2025-09-30T14:53:53.940564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:53.940637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895589435177817:2659]
2025-09-30T14:53:53.951693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b31d3d49-6e5677f1-bfed664e-c6588bc2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:53.951831Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:53.951849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1358
2025-09-30T14:53:53.952003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1358 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:53.952037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1358 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:53.952042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1358 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:53.952046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:53.952572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1358 sessionId:  describe result for acl check
2025-09-30T14:53:53.952615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:53.952617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:53.952619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:53.952625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895589435177834:8296] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:53.953191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895589435177834:8296] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:53.955554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895589435177834:8296] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:53.958288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895589435177834:8296] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:53.958304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895589435177834:8296] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:53.958307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895589435177834:8296] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:53.958324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1358 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:53.967368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:53.969676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:53.969932Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:53.969942Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:53.969953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:53.970020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:53.970067Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895589345427355:8281]
2025-09-30T14:53:53.970766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:53.971122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:53.971180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:53.971557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:53.971634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:53.971642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:53.971643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:53.971645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:53.971646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:53.971647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:53.971648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:53.971649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:53.971651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:53.971652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:53.971653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.971654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:53.971655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:53.971656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:53.971658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:53.971664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:53.971674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:53.971677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:53.971681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:53.971685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:53.971689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:53.971692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:53.971696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:53.971699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:53.971712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:53.971716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.971719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:53.971722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:53.971726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:53.971730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:53.971738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:53.971747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:53.971752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:53.971757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:53.971761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:53.971766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:53.971770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:53.971775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:53.971779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:53.971783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:53.971787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:53.971792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:53.971796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:53.971801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:53.971805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:53.971810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:53.971816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:53.971821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:53.971825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:53.971829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:53.971833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.971838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.971841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:53.971846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:53.971850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:53.971854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:53.971858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:53.971863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:53.971870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:53.971874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:53.971913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:53.978401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:53.979597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:53.979603Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:53.979606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:53.979609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:53.979617Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1357 [2:7555895589345427355:8281]
2025-09-30T14:53:53.979633Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:53.979649Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:53.979652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:53.979655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:53.979657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:53.979674Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:53.979681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:53.979687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:53.979741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.979743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:53.979745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:53.979749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:53.979752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:53.979821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:53.979824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.979837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:53.979848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:53.979865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:53.979880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895589345427350:8281]
2025-09-30T14:53:53.979883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895589345427350:8281]
2025-09-30T14:53:53.979885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895589345427350:8281]
2025-09-30T14:53:53.979898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:53.979911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:53.979924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:53.979927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:53.979965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895589345427350:8281]
2025-09-30T14:53:53.979968Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:53.980326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:53.980334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:53.980336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:53.980342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:53.980693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895589435177878:8296], now have 1 active actors on pipe
2025-09-30T14:53:53.980701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895589435177820:2454], now have 1 active actors on pipe
2025-09-30T14:53:53.980875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1357
2025-09-30T14:53:53.981013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1357
2025-09-30T14:53:53.981178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:53.981189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:53.981216Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eccca8a5-339e6347-8feb6c4e-f1c34351_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:53.981225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:53.981229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:53.981232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:53.981243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:53.981254Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:53.981272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:53.981870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:53.981884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:53.981907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:53.982044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1358 partition: 0 MaxSeqNo: 42 sessionId: src_id|eccca8a5-339e6347-8feb6c4e-f1c34351_0
2025-09-30T14:53:53.982458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31d3d49-6e5677f1-bfed664e-c6588bc2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|eccca8a5-339e6347-8feb6c4e-f1c34351_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:53.985258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eccca8a5-339e6347-8feb6c4e-f1c34351_0] Write session: try to update token
2025-09-30T14:53:53.985275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eccca8a5-339e6347-8feb6c4e-f1c34351_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:53.994851Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:53.994874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:53.994877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:53.994879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:53.994889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895589345427350:8281]
2025-09-30T14:53:53.994894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895589345427350:8281]
2025-09-30T14:53:53.994898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895589345427350:8281]
2025-09-30T14:53:53.994940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:53.994947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:53.994950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:53.995094Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:53.995453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:53.995460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:53.995464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:54.005531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1358 sessionId: src_id|eccca8a5-339e6347-8feb6c4e-f1c34351_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:54.008584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:54.040499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895593730145319:2659]
2025-09-30T14:53:54.040751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1357, pipe: [1:7555895593730145319:2659]
2025-09-30T14:53:54.140028Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:54.140566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:54.140582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:54.140621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895593730145319:2659], now have 1 active actors on pipe
2025-09-30T14:53:54.141002Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:54.140900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:54.140907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:54.140912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:54.140975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1358 reason: error at write: Disconnected sessionId: src_id|eccca8a5-339e6347-8feb6c4e-f1c34351_0
2025-09-30T14:53:54.140977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895593730145319:2659]
2025-09-30T14:53:54.141160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1358 sessionId: src_id|eccca8a5-339e6347-8feb6c4e-f1c34351_0 is DEAD
2025-09-30T14:53:54.142476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eccca8a5-339e6347-8feb6c4e-f1c34351_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:54.142488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eccca8a5-339e6347-8feb6c4e-f1c34351_0] Write session will restart in 0.005276s
2025-09-30T14:53:54.142512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eccca8a5-339e6347-8feb6c4e-f1c34351_0] Write session: Do CDS request
2025-09-30T14:53:54.142521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eccca8a5-339e6347-8feb6c4e-f1c34351_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:54.151977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eccca8a5-339e6347-8feb6c4e-f1c34351_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:54.152070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:54.152102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1359
2025-09-30T14:53:54.152250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1359 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:54.152286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1359 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:54.152291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1359 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:54.152297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:54.152777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1359 sessionId:  describe result for acl check
2025-09-30T14:53:54.152818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:54.152826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:54.152829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:54.152835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895593730145340:8301] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:54.153392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895593730145340:8301] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:54.156950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895593730145340:8301] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:54.164141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895593730145340:8301] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:54.164162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895593730145340:8301] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:54.164166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895593730145340:8301] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:54.164175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1359 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:54.167453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:54.170720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:54.170960Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:54.170976Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:54.170989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:54.171097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:54.171144Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895593640394843:8283]
2025-09-30T14:53:54.171825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:54.172741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:54.172793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:54.173169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:54.173252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:54.173253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:54.173254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:54.173255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:54.173257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:54.173259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:54.173260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:54.173262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:54.173263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:54.173265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:54.173266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.173268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:54.173269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:54.173271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:54.173272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:54.173279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:54.173290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:54.173294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:54.173298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:54.173302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:54.173305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:54.173309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:54.173314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:54.173317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:54.173322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:54.173327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.173331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:54.173336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:54.173341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:54.173345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:54.173357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:54.173366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:54.173373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:54.173380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:54.173385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:54.173391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:54.173396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:54.173403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:54.173408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:54.173414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:54.173419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:54.173426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:54.173432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:54.173438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:54.173446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:54.173452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:54.173458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:54.173464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:54.173470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:54.173476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:54.173481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.173487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.173491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:54.173497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:54.173501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:54.173508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:54.173513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:54.173533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:54.173538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:54.173545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:54.173597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:54.179862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:54.181019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:54.181039Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:54.181041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:54.181045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:54.181053Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1358 [2:7555895593640394843:8283]
2025-09-30T14:53:54.181071Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:54.181091Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:54.181094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:54.181097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:54.181099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:54.181115Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:54.181127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:54.181133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:54.181199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.181206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:54.181208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:54.181211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:54.181214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:54.181284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:54.181289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.181302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:54.181312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:54.181327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:54.181348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895593640394838:8283]
2025-09-30T14:53:54.181359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895593640394838:8283]
2025-09-30T14:53:54.181361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895593640394838:8283]
2025-09-30T14:53:54.181373Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:54.181389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:54.181409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:54.181416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:54.181453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895593640394838:8283]
2025-09-30T14:53:54.181460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:54.181814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:54.181824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:54.181826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:54.181831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:54.182209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1358
2025-09-30T14:53:54.182265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1358
2025-09-30T14:53:54.184770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895593730145324:2454], now have 1 active actors on pipe
2025-09-30T14:53:54.184788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895593730145510:8301], now have 1 active actors on pipe
2025-09-30T14:53:54.184814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:54.184820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:54.184852Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f4bc8bb-40886734-3399ceb5-8e87261a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:54.184873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:54.184878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:54.184882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:54.184895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:54.184909Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:54.184926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:54.185492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:54.185502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:54.185520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:54.185665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1359 partition: 0 MaxSeqNo: 42 sessionId: src_id|7f4bc8bb-40886734-3399ceb5-8e87261a_0
2025-09-30T14:53:54.186151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eccca8a5-339e6347-8feb6c4e-f1c34351_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7f4bc8bb-40886734-3399ceb5-8e87261a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:54.189173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f4bc8bb-40886734-3399ceb5-8e87261a_0] Write session: try to update token
2025-09-30T14:53:54.189193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f4bc8bb-40886734-3399ceb5-8e87261a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:54.209727Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:54.209755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:54.209758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:54.209761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:54.209771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895593640394838:8283]
2025-09-30T14:53:54.209777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895593640394838:8283]
2025-09-30T14:53:54.209781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895593640394838:8283]
2025-09-30T14:53:54.209825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:54.209832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.209835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:54.210000Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:54.211366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:54.211385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:54.211389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:54.218409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1359 sessionId: src_id|7f4bc8bb-40886734-3399ceb5-8e87261a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:54.221404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:54.241340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895593730145525:2659]
2025-09-30T14:53:54.241820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1358, pipe: [1:7555895593730145525:2659]
2025-09-30T14:53:54.337538Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:54.337990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:54.338000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:54.338045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895593730145525:2659], now have 1 active actors on pipe
2025-09-30T14:53:54.338288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895593730145525:2659]
2025-09-30T14:53:54.338326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:54.338359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:54.338367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:54.338403Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:54.338433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1359 reason: error at write: Disconnected sessionId: src_id|7f4bc8bb-40886734-3399ceb5-8e87261a_0
2025-09-30T14:53:54.338628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1359 sessionId: src_id|7f4bc8bb-40886734-3399ceb5-8e87261a_0 is DEAD
2025-09-30T14:53:54.338803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f4bc8bb-40886734-3399ceb5-8e87261a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:54.338815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f4bc8bb-40886734-3399ceb5-8e87261a_0] Write session will restart in 0.005554s
2025-09-30T14:53:54.338837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f4bc8bb-40886734-3399ceb5-8e87261a_0] Write session: Do CDS request
2025-09-30T14:53:54.338843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f4bc8bb-40886734-3399ceb5-8e87261a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:54.345766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f4bc8bb-40886734-3399ceb5-8e87261a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:54.345840Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:54.345857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1360
2025-09-30T14:53:54.346015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1360 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:54.346051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1360 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:54.346061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1360 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:54.346066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:54.346541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1360 sessionId:  describe result for acl check
2025-09-30T14:53:54.346576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:54.346578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:54.346580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:54.346586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895593730145553:8306] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:54.347134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895593730145553:8306] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:54.349264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895593730145553:8306] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:54.352536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895593730145553:8306] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:54.352554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895593730145553:8306] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:54.352560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895593730145553:8306] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:54.352569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1360 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:54.358439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:54.361455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:54.361669Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:54.361673Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:54.361685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:54.361732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:54.361767Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895593640395050:8287]
2025-09-30T14:53:54.362450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:54.362856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:54.362918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:54.363213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:54.363291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:54.363298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:54.363299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:54.363300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:54.363301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:54.363303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:54.363304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:54.363306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:54.363307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:54.363309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:54.363310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.363311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:54.363312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:54.363313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:54.363314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:54.363319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:54.363326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:54.363329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:54.363331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:54.363334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:54.363336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:54.363339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:54.363341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:54.363344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:54.363346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:54.363349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.363351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:54.363353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:54.363356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:54.363358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:54.363365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:54.363370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:54.363374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:54.363377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:54.363380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:54.363383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:54.363386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:54.363390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:54.363393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:54.363396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:54.363399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:54.363402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:54.363405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:54.363409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:54.363411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:54.363415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:54.363418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:54.363421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:54.363423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:54.363426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:54.363431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.363434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.363437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:54.363440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:54.363443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:54.363446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:54.363448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:54.363451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:54.363455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:54.363458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:54.363483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:54.373626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:54.374604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:54.374625Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:54.374629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:54.374633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:54.374641Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1359 [2:7555895593640395050:8287]
2025-09-30T14:53:54.374658Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:54.374678Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:54.374682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:54.374684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:54.374687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:54.374705Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:54.374712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:54.374720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:54.374784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.374786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:54.374788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:54.374792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:54.374795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:54.374881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:54.374884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.374897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:54.374908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:54.374923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:54.374939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895593640395045:8287]
2025-09-30T14:53:54.374942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895593640395045:8287]
2025-09-30T14:53:54.374944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895593640395045:8287]
2025-09-30T14:53:54.374952Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:54.374967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:54.374978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:54.374982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:54.374982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:54.374984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:54.374985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:54.375041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895593640395045:8287]
2025-09-30T14:53:54.375051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:54.375061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895593730145540:2454], now have 1 active actors on pipe
2025-09-30T14:53:54.375065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895593730145628:8306], now have 1 active actors on pipe
2025-09-30T14:53:54.375306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:54.375426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:54.375442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:54.375472Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b2d8a38-41e853a7-dbafc511-3cbdf13d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:54.375488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:54.375497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:54.375500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:54.375512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:54.375529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:54.375548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:54.376635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f4bc8bb-40886734-3399ceb5-8e87261a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8b2d8a38-41e853a7-dbafc511-3cbdf13d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:54.376005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:54.376018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:54.376035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:54.375235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1359
2025-09-30T14:53:54.375237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1359
2025-09-30T14:53:54.376198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1360 partition: 0 MaxSeqNo: 42 sessionId: src_id|8b2d8a38-41e853a7-dbafc511-3cbdf13d_0
2025-09-30T14:53:54.379692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2d8a38-41e853a7-dbafc511-3cbdf13d_0] Write session: try to update token
2025-09-30T14:53:54.379711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2d8a38-41e853a7-dbafc511-3cbdf13d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:54.388907Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:54.388936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:54.388939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:54.388942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:54.388951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895593640395045:8287]
2025-09-30T14:53:54.388957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895593640395045:8287]
2025-09-30T14:53:54.388964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895593640395045:8287]
2025-09-30T14:53:54.389005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:54.389009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:54.389013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.389016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:54.389016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:54.389020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:54.389161Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:54.401828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1360 sessionId: src_id|8b2d8a38-41e853a7-dbafc511-3cbdf13d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:54.404611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:54.442994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895593730145741:2659]
2025-09-30T14:53:54.446477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1359, pipe: [1:7555895593730145741:2659]
2025-09-30T14:53:54.524207Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:54.524536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:54.524546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:54.524565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895593730145741:2659], now have 1 active actors on pipe
2025-09-30T14:53:54.524805Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:54.524902Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:54.524963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:54.524962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895593730145741:2659]
2025-09-30T14:53:54.524966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:54.525036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1360 reason: error at write: Disconnected sessionId: src_id|8b2d8a38-41e853a7-dbafc511-3cbdf13d_0
2025-09-30T14:53:54.525249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1360 sessionId: src_id|8b2d8a38-41e853a7-dbafc511-3cbdf13d_0 is DEAD
2025-09-30T14:53:54.525685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2d8a38-41e853a7-dbafc511-3cbdf13d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:54.525708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2d8a38-41e853a7-dbafc511-3cbdf13d_0] Write session will restart in 0.009199s
2025-09-30T14:53:54.525732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2d8a38-41e853a7-dbafc511-3cbdf13d_0] Write session: Do CDS request
2025-09-30T14:53:54.525739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2d8a38-41e853a7-dbafc511-3cbdf13d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:54.535830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2d8a38-41e853a7-dbafc511-3cbdf13d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:54.536181Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:54.536199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1361
2025-09-30T14:53:54.536311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1361 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:54.536342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1361 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:54.536348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1361 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:54.536353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:54.536850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1361 sessionId:  describe result for acl check
2025-09-30T14:53:54.536891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:54.536898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:54.536900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:54.536907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895593730145811:8311] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:54.537483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895593730145811:8311] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:54.540550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895593730145811:8311] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:54.544246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895593730145811:8311] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:54.544263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895593730145811:8311] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:54.544266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895593730145811:8311] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:54.544277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1361 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:54.545329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:54.547697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:54.547893Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:54.547904Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:54.547914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:54.547964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:54.548001Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895593640395245:8289]
2025-09-30T14:53:54.548738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:54.549075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:54.549121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:54.549468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:54.549532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:54.549534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:54.549535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:54.549536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:54.549538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:54.549539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:54.549541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:54.549542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:54.549543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:54.549545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:54.549546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.549547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:54.549549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:54.549550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:54.549552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:54.549558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:54.549569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:54.549573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:54.549578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:54.549583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:54.549588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:54.549592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:54.549597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:54.549602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:54.549607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:54.549611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.549616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:54.549620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:54.549625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:54.549629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:54.549637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:54.549645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:54.549652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:54.549659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:54.549664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:54.549670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:54.549675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:54.549681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:54.549686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:54.549692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:54.549697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:54.549703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:54.549708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:54.549713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:54.549718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:54.549724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:54.549729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:54.549735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:54.549740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:54.549746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:54.549752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.549758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.549763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:54.549769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:54.549775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:54.549781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:54.549786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:54.549792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:54.549800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:54.549805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:54.549854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:54.557756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:54.558900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:54.558922Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:54.558925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:54.558930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:54.558938Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1360 [2:7555895593640395245:8289]
2025-09-30T14:53:54.558956Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:54.558991Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:54.558995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:54.558999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:54.559001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:54.559019Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:54.559026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:54.559033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:54.559102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.559104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:54.559106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:54.559109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:54.559112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:54.559185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:54.559188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.559203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:54.559216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:54.559235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:54.559266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895593640395240:8289]
2025-09-30T14:53:54.559268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895593640395240:8289]
2025-09-30T14:53:54.559270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895593640395240:8289]
2025-09-30T14:53:54.559278Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:54.559289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:54.559292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895593730145934:8311], now have 1 active actors on pipe
2025-09-30T14:53:54.559293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:54.559295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:54.559296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895593730145744:2454], now have 1 active actors on pipe
2025-09-30T14:53:54.559303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:54.559319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:54.559322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:54.559359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895593640395240:8289]
2025-09-30T14:53:54.559367Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:54.559377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:54.559540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1360
2025-09-30T14:53:54.559586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1360
2025-09-30T14:53:54.559630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:54.559642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:54.559667Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|814e112e-837a4d2-593862e8-79634d56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:54.559674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:54.559678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:54.559681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:54.559690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:54.559700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:54.559714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:54.560305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:54.560325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:54.560341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:54.560459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1361 partition: 0 MaxSeqNo: 42 sessionId: src_id|814e112e-837a4d2-593862e8-79634d56_0
2025-09-30T14:53:54.560837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2d8a38-41e853a7-dbafc511-3cbdf13d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|814e112e-837a4d2-593862e8-79634d56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:54.564036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|814e112e-837a4d2-593862e8-79634d56_0] Write session: try to update token
2025-09-30T14:53:54.564056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|814e112e-837a4d2-593862e8-79634d56_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:54.573030Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:54.573051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:54.573061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895593640395240:8289]
2025-09-30T14:53:54.573103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:54.573114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:54.573283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:54.573425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:54.573570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:54.573708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:54.573916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:54.573953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:54.583316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1361 sessionId: src_id|814e112e-837a4d2-593862e8-79634d56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:54.586003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:54.584397Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:54.584418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:54.584421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:54.584423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:54.584433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895593640395240:8289]
2025-09-30T14:53:54.584437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895593640395240:8289]
2025-09-30T14:53:54.584441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895593640395240:8289]
2025-09-30T14:53:54.584487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:54.584493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.584495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:54.584637Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:54.584680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:54.584687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:54.584691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:54.625225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895593730145948:2659]
2025-09-30T14:53:54.625534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1360, pipe: [1:7555895593730145948:2659]
2025-09-30T14:53:54.711063Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:54.711435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:54.711454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:54.711475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895593730145948:2659], now have 1 active actors on pipe
2025-09-30T14:53:54.711752Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:54.712150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:54.712236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1361 reason: status is not ok: tablet will be restarted right now sessionId: src_id|814e112e-837a4d2-593862e8-79634d56_0
2025-09-30T14:53:54.712421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1361 sessionId: src_id|814e112e-837a4d2-593862e8-79634d56_0 is DEAD
2025-09-30T14:53:54.712559Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:54.712592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895593730145948:2659]
2025-09-30T14:53:54.722552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|814e112e-837a4d2-593862e8-79634d56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:54.722569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|814e112e-837a4d2-593862e8-79634d56_0] Write session will restart in 0.008996s
2025-09-30T14:53:54.722594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|814e112e-837a4d2-593862e8-79634d56_0] Write session: Do CDS request
2025-09-30T14:53:54.722600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|814e112e-837a4d2-593862e8-79634d56_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:54.732840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|814e112e-837a4d2-593862e8-79634d56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:54.735011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:54.735030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1362
2025-09-30T14:53:54.735285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1362 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:54.735318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1362 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:54.735323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1362 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:54.735327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:54.736348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1362 sessionId:  describe result for acl check
2025-09-30T14:53:54.736383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:54.736386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:54.736388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:54.736393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895593730146055:8315] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:54.736910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895593730146055:8315] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:54.742228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895593730146055:8315] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:54.749048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:54.748978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895593730146055:8315] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:54.748997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895593730146055:8315] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:54.749000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895593730146055:8315] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:54.749010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1362 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:54.752489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:54.752887Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:54.752898Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:54.752911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:54.752979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:54.753038Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895593640395442:8292]
2025-09-30T14:53:54.753739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:54.754112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:54.754167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:54.754554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:54.754629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:54.754630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:54.754632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:54.754633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:54.754634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:54.754636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:54.754637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:54.754638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:54.754639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:54.754640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:54.754642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.754643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:54.754644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:54.754645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:54.754646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:54.754651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:54.754660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:54.754664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:54.754668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:54.754672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:54.754676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:54.754681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:54.754685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:54.754689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:54.754694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:54.754698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.754702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:54.754706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:54.754710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:54.754714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:54.754722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:54.754730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:54.754736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:54.754741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:54.754747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:54.754752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:54.754756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:54.754762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:54.754767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:54.754772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:54.754777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:54.754783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:54.754788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:54.754794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:54.754799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:54.754805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:54.754811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:54.754816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:54.754821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:54.754826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:54.754833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.754838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.754843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:54.754847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:54.754851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:54.754856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:54.754878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:54.754884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:54.754888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:54.754893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:54.754933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:54.761881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:54.762782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:54.762802Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:54.762804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:54.762808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:54.762815Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1361 [2:7555895593640395442:8292]
2025-09-30T14:53:54.762832Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:54.762852Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:54.762855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:54.762858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:54.762860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:54.762876Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:54.762883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:54.762896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:54.762956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.762965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:54.762967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:54.762970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:54.762973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:54.763050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:54.763059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.763073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:54.763086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:54.763103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:54.763127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895593730145951:2454], now have 1 active actors on pipe
2025-09-30T14:53:54.763135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895593730146140:8315], now have 1 active actors on pipe
2025-09-30T14:53:54.763142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895593640395436:8292]
2025-09-30T14:53:54.763144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895593640395436:8292]
2025-09-30T14:53:54.763149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895593640395436:8292]
2025-09-30T14:53:54.763164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:54.763284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1361
2025-09-30T14:53:54.763289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1361
2025-09-30T14:53:54.763182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:54.763201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:54.763205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:54.763308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:54.763326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:54.763329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:54.763399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895593640395436:8292]
2025-09-30T14:53:54.763416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:54.763454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:54.763463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:54.763501Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c09d5718-bb38573f-be73eda8-eec4555e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:54.763509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:54.763512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:54.763515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:54.763523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:54.763534Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:54.763550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:54.763595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:54.763900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:54.763911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:54.763930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:54.764035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1362 partition: 0 MaxSeqNo: 42 sessionId: src_id|c09d5718-bb38573f-be73eda8-eec4555e_0
2025-09-30T14:53:54.767205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|814e112e-837a4d2-593862e8-79634d56_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c09d5718-bb38573f-be73eda8-eec4555e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:54.770016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c09d5718-bb38573f-be73eda8-eec4555e_0] Write session: try to update token
2025-09-30T14:53:54.770036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c09d5718-bb38573f-be73eda8-eec4555e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:54.778719Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:54.778751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:54.778754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:54.778756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:54.778765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895593640395436:8292]
2025-09-30T14:53:54.778770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895593640395436:8292]
2025-09-30T14:53:54.778775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895593640395436:8292]
2025-09-30T14:53:54.778817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:54.778825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.778828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:54.778833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:54.778841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:54.778845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:54.778968Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:54.790293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1362 sessionId: src_id|c09d5718-bb38573f-be73eda8-eec4555e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:54.793113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:54.812602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895593730146153:2659]
2025-09-30T14:53:54.812876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1361, pipe: [1:7555895593730146153:2659]
2025-09-30T14:53:54.900249Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:54.900760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:54.900775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:54.900881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895593730146153:2659], now have 1 active actors on pipe
2025-09-30T14:53:54.901246Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:54.902184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c09d5718-bb38573f-be73eda8-eec4555e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:54.902195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c09d5718-bb38573f-be73eda8-eec4555e_0] Write session will restart in 0.009260s
2025-09-30T14:53:54.902219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c09d5718-bb38573f-be73eda8-eec4555e_0] Write session: Do CDS request
2025-09-30T14:53:54.902225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c09d5718-bb38573f-be73eda8-eec4555e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:54.901521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:54.901574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895593730146153:2659]
2025-09-30T14:53:54.901590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:54.901654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1362 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c09d5718-bb38573f-be73eda8-eec4555e_0
2025-09-30T14:53:54.901835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1362 sessionId: src_id|c09d5718-bb38573f-be73eda8-eec4555e_0 is DEAD
2025-09-30T14:53:54.916207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c09d5718-bb38573f-be73eda8-eec4555e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:54.919634Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:54.919655Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1363
2025-09-30T14:53:54.923791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1363 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:54.923842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1363 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:54.923847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1363 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:54.923852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:54.924450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1363 sessionId:  describe result for acl check
2025-09-30T14:53:54.924484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:54.924486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:54.924487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:54.924492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895593730146231:8326] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:54.924950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895593730146231:8326] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:54.935432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895593730146231:8326] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:54.944454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:54.944754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:54.944910Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:54.944915Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:54.944925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:54.944967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:54.945003Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895593640395673:8306]
2025-09-30T14:53:54.945719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:54.946312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:54.946365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:54.946715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:54.946769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:54.946771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:54.946772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:54.946774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:54.946775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:54.946776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:54.946778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:54.946779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:54.946781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:54.946782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:54.946784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.946785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:54.946787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:54.946788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:54.946790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:54.946796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:54.946808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:54.946813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:54.946818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:54.946823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:54.946828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:54.946833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:54.946838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:54.946843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:54.946848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:54.946852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.946856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:54.946861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:54.946865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:54.946870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:54.946879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:54.946887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:54.946894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:54.946900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:54.946921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:54.946927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:54.946933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:54.946939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:54.946945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:54.946952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:54.946956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:54.946963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:54.946969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:54.946975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:54.946980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:54.946986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:54.946991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:54.946996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:54.947001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:54.947006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:54.947011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.947016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.947021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:54.947026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:54.947031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:54.947036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:54.947040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:54.947044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:54.947049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:54.947054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:54.947097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:54.949875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895593730146231:8326] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:54.949898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895593730146231:8326] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:54.949903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895593730146231:8326] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:54.949913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1363 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:54.955902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:54.956770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:54.956789Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:54.956792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:54.956796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:54.956804Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1362 [2:7555895593640395673:8306]
2025-09-30T14:53:54.956821Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:54.956836Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:54.956844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:54.956848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:54.956851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:54.956867Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:54.956879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:54.956887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:54.956955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.956963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:54.956966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:54.956970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:54.956972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:54.957041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:54.957048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.957062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:54.957075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:54.957094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:54.957110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895593640395667:8306]
2025-09-30T14:53:54.957113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895593640395667:8306]
2025-09-30T14:53:54.957115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895593640395667:8306]
2025-09-30T14:53:54.957123Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:54.957132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:54.957134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:54.957139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:54.957141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895593730146180:2454], now have 1 active actors on pipe
2025-09-30T14:53:54.957147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:54.957163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:54.957166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:54.957173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895593730146373:8326], now have 1 active actors on pipe
2025-09-30T14:53:54.957206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895593640395667:8306]
2025-09-30T14:53:54.957213Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:54.957274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:54.958007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:54.958019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:54.958046Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e36e3c3-4a1934b4-a76d9e30-aadb102f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:54.958055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:54.958059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:54.958062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:54.958072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:54.958084Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:54.958099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:54.957423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1362
2025-09-30T14:53:54.957463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1362
2025-09-30T14:53:54.961862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:54.961879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:54.961911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:54.963382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c09d5718-bb38573f-be73eda8-eec4555e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e36e3c3-4a1934b4-a76d9e30-aadb102f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:54.962155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1363 partition: 0 MaxSeqNo: 42 sessionId: src_id|e36e3c3-4a1934b4-a76d9e30-aadb102f_0
2025-09-30T14:53:54.966269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e36e3c3-4a1934b4-a76d9e30-aadb102f_0] Write session: try to update token
2025-09-30T14:53:54.966290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e36e3c3-4a1934b4-a76d9e30-aadb102f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:54.973361Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:54.973382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:54.973385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:54.973387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:54.973397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895593640395667:8306]
2025-09-30T14:53:54.973402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895593640395667:8306]
2025-09-30T14:53:54.973406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895593640395667:8306]
2025-09-30T14:53:54.973445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:54.973452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:54.973455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:54.973591Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:54.976006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:54.976021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:54.976025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:54.995295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1363 sessionId: src_id|e36e3c3-4a1934b4-a76d9e30-aadb102f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:54.998052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:55.001553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895598025113677:2659]
2025-09-30T14:53:55.001827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1362, pipe: [1:7555895598025113677:2659]
2025-09-30T14:53:55.118457Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:55.119030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:55.119040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:55.119062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895598025113677:2659], now have 1 active actors on pipe
2025-09-30T14:53:55.119404Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:55.119971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e36e3c3-4a1934b4-a76d9e30-aadb102f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:55.119982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e36e3c3-4a1934b4-a76d9e30-aadb102f_0] Write session will restart in 0.005900s
2025-09-30T14:53:55.120004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e36e3c3-4a1934b4-a76d9e30-aadb102f_0] Write session: Do CDS request
2025-09-30T14:53:55.120009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e36e3c3-4a1934b4-a76d9e30-aadb102f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:55.119540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895598025113677:2659]
2025-09-30T14:53:55.119570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:55.119604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:55.119607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:55.119663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1363 reason: error at write: Disconnected sessionId: src_id|e36e3c3-4a1934b4-a76d9e30-aadb102f_0
2025-09-30T14:53:55.119844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1363 sessionId: src_id|e36e3c3-4a1934b4-a76d9e30-aadb102f_0 is DEAD
2025-09-30T14:53:55.127272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e36e3c3-4a1934b4-a76d9e30-aadb102f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:55.127379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:55.127398Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1364
2025-09-30T14:53:55.131602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1364 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:55.131657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1364 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:55.131662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1364 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:55.131668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:55.132096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1364 sessionId:  describe result for acl check
2025-09-30T14:53:55.132119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:55.132121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:55.132123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:55.132129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895598025113704:8331] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:55.132651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895598025113704:8331] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:55.136499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895598025113704:8331] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:55.140162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895598025113704:8331] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:55.140179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895598025113704:8331] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:55.140182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895598025113704:8331] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:55.140191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1364 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:55.150703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:55.153326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:55.153556Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:55.153561Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:55.153574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:55.153654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:55.153696Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895597935363168:8308]
2025-09-30T14:53:55.154360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:55.154844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:55.154903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:55.155185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:55.155261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:55.155267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:55.155269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:55.155270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:55.155271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:55.155272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:55.155274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:55.155275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:55.155276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:55.155277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:55.155279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.155280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:55.155281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:55.155283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:55.155284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:55.155289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:55.155299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:55.155304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:55.155309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:55.155314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:55.155319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:55.155322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:55.155325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:55.155329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:55.155333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:55.155336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.155341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:55.155346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:55.155350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:55.155354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:55.155362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:55.155371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:55.155378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:55.155385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:55.155390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:55.155396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:55.155400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:55.155407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:55.155412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:55.155418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:55.155423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:55.155429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:55.155439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:55.155446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:55.155455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:55.155466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:55.155475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:55.155484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:55.155489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:55.155493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:55.155500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.155504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.155508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:55.155513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:55.155517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:55.155521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:55.155525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:55.155529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:55.155534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:55.155540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:55.155590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:55.162821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:55.163890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:55.163907Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:55.163910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:55.163914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:55.163921Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1363 [2:7555895597935363168:8308]
2025-09-30T14:53:55.163940Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:55.163957Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:55.163960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:55.163963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:55.163966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:55.163982Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:55.163991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:55.163998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:55.164063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.164065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:55.164067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:55.164071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:55.164073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:55.164141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:55.164144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.164158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:55.164170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:55.164188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:55.164206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895597935363162:8308]
2025-09-30T14:53:55.164209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895597935363162:8308]
2025-09-30T14:53:55.164211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895597935363162:8308]
2025-09-30T14:53:55.164225Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:55.164240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:55.164254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:55.164257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:55.164296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895597935363162:8308]
2025-09-30T14:53:55.164300Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:55.164766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:55.164769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:55.164771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:55.164778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:55.164978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895598025113685:2454], now have 1 active actors on pipe
2025-09-30T14:53:55.164990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895598025113811:8331], now have 1 active actors on pipe
2025-09-30T14:53:55.165037Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1363
2025-09-30T14:53:55.165086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1363
2025-09-30T14:53:55.168537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:55.168556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:55.168594Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83477c44-70fc5e69-461c9017-a1d6105c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:55.168609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:55.168614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:55.168618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:55.168633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:55.168649Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:55.168678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:55.169054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:55.169062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:55.169079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:55.169243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1364 partition: 0 MaxSeqNo: 42 sessionId: src_id|83477c44-70fc5e69-461c9017-a1d6105c_0
2025-09-30T14:53:55.170244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e36e3c3-4a1934b4-a76d9e30-aadb102f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|83477c44-70fc5e69-461c9017-a1d6105c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:55.173357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83477c44-70fc5e69-461c9017-a1d6105c_0] Write session: try to update token
2025-09-30T14:53:55.173381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83477c44-70fc5e69-461c9017-a1d6105c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:55.191675Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:55.191696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:55.191707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895597935363162:8308]
2025-09-30T14:53:55.191758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:55.191772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:55.191929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:55.192076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:55.192225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:55.192371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:55.192583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:55.192629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:55.195348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1364 sessionId: src_id|83477c44-70fc5e69-461c9017-a1d6105c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:55.196353Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:55.196373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:55.196376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:55.196378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:55.196387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895597935363162:8308]
2025-09-30T14:53:55.196392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895597935363162:8308]
2025-09-30T14:53:55.196396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895597935363162:8308]
2025-09-30T14:53:55.196435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:55.196444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:55.196449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.196451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:55.196452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:55.196456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:55.196596Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:55.198286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:55.221308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895598025113894:2659]
2025-09-30T14:53:55.221766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1363, pipe: [1:7555895598025113894:2659]
2025-09-30T14:53:55.312436Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:55.312827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:55.312845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:55.312865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895598025113894:2659], now have 1 active actors on pipe
2025-09-30T14:53:55.313087Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:55.313125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895598025113894:2659]
2025-09-30T14:53:55.313162Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:55.313198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:55.313287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1364 reason: status is not ok: tablet will be restarted right now sessionId: src_id|83477c44-70fc5e69-461c9017-a1d6105c_0
2025-09-30T14:53:55.313496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1364 sessionId: src_id|83477c44-70fc5e69-461c9017-a1d6105c_0 is DEAD
2025-09-30T14:53:55.313669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83477c44-70fc5e69-461c9017-a1d6105c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:55.313677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83477c44-70fc5e69-461c9017-a1d6105c_0] Write session will restart in 0.005913s
2025-09-30T14:53:55.313712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83477c44-70fc5e69-461c9017-a1d6105c_0] Write session: Do CDS request
2025-09-30T14:53:55.313718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83477c44-70fc5e69-461c9017-a1d6105c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:55.320787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83477c44-70fc5e69-461c9017-a1d6105c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:55.327417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:55.327435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1365
2025-09-30T14:53:55.327612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1365 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:55.327663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1365 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:55.327673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1365 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:55.327678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:55.328164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1365 sessionId:  describe result for acl check
2025-09-30T14:53:55.328204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:55.328206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:55.328208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:55.328215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895598025114066:8336] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:55.328786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895598025114066:8336] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:55.329279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:55.330686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895598025114066:8336] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:55.331903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:55.332143Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:55.332155Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:55.332169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:55.332235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:55.332301Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895597935363379:8312]
2025-09-30T14:53:55.332957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:55.333442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:55.333503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:55.333773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895598025114066:8336] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:55.333790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895598025114066:8336] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:55.333793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895598025114066:8336] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:55.333802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1365 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:55.333870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:55.333971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:55.333979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:55.333981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:55.333982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:55.333983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:55.333984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:55.333986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:55.333987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:55.333989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:55.333990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:55.333991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.333993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:55.333994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:55.333995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:55.333997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:55.334004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:55.334015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:55.334020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:55.334025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:55.334029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:55.334034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:55.334038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:55.334041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:55.334046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:55.334051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:55.334056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.334061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:55.334066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:55.334069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:55.334073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:55.334080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:55.334088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:55.334095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:55.334101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:55.334107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:55.334114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:55.334118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:55.334124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:55.334129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:55.334134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:55.334138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:55.334144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:55.334149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:55.334155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:55.334167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:55.334172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:55.334177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:55.334187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:55.334193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:55.334199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:55.334220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.334231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.334236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:55.334241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:55.334248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:55.334254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:55.334259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:55.334265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:55.334270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:55.334276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:55.334326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:55.342281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:55.343174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:55.343193Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:55.343197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:55.343202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:55.343209Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1364 [2:7555895597935363379:8312]
2025-09-30T14:53:55.343225Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:55.343241Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:55.343262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:55.343266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:55.343269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:55.343286Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:55.343293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:55.343306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:55.343377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.343389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:55.343392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:55.343396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:55.343399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:55.343487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:55.343496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.343510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:55.343523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:55.343545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:55.343571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895598025114105:8336], now have 1 active actors on pipe
2025-09-30T14:53:55.343581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895598025113908:2454], now have 1 active actors on pipe
2025-09-30T14:53:55.343587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895597935363374:8312]
2025-09-30T14:53:55.343589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895597935363374:8312]
2025-09-30T14:53:55.343591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895597935363374:8312]
2025-09-30T14:53:55.343605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:55.343620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:55.343635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:55.343639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:55.343641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:55.343646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:55.343614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1364
2025-09-30T14:53:55.343649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:55.343640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1364
2025-09-30T14:53:55.343679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895597935363374:8312]
2025-09-30T14:53:55.343693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:55.343710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:55.343716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:55.343720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:55.343773Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9077541f-ec9b4321-e7397d32-44e544f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:55.343785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:55.343789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:55.343791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:55.343801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:55.343817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:55.343842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:55.343988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:55.343997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:55.344011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:55.344107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1365 partition: 0 MaxSeqNo: 42 sessionId: src_id|9077541f-ec9b4321-e7397d32-44e544f1_0
2025-09-30T14:53:55.344496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83477c44-70fc5e69-461c9017-a1d6105c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9077541f-ec9b4321-e7397d32-44e544f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:55.347448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9077541f-ec9b4321-e7397d32-44e544f1_0] Write session: try to update token
2025-09-30T14:53:55.347475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9077541f-ec9b4321-e7397d32-44e544f1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:55.356354Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:55.356378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:55.356380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:55.356383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:55.356393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895597935363374:8312]
2025-09-30T14:53:55.356398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895597935363374:8312]
2025-09-30T14:53:55.356403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895597935363374:8312]
2025-09-30T14:53:55.356445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:55.356454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.356456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:55.356539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:55.356552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:55.356557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:55.356607Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:55.369785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1365 sessionId: src_id|9077541f-ec9b4321-e7397d32-44e544f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:55.372605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:55.415442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895598025114115:2659]
2025-09-30T14:53:55.419807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1364, pipe: [1:7555895598025114115:2659]
2025-09-30T14:53:55.474714Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:55.475347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:55.475362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:55.475383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895598025114115:2659], now have 1 active actors on pipe
2025-09-30T14:53:55.475840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:55.475893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895598025114115:2659]
2025-09-30T14:53:55.475977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:55.475988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:55.476048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1365 reason: error at write: Disconnected sessionId: src_id|9077541f-ec9b4321-e7397d32-44e544f1_0
2025-09-30T14:53:55.476360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9077541f-ec9b4321-e7397d32-44e544f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:55.476370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9077541f-ec9b4321-e7397d32-44e544f1_0] Write session will restart in 0.008679s
2025-09-30T14:53:55.476392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9077541f-ec9b4321-e7397d32-44e544f1_0] Write session: Do CDS request
2025-09-30T14:53:55.476397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9077541f-ec9b4321-e7397d32-44e544f1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:55.476729Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:55.476222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1365 sessionId: src_id|9077541f-ec9b4321-e7397d32-44e544f1_0 is DEAD
2025-09-30T14:53:55.487884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9077541f-ec9b4321-e7397d32-44e544f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:55.488588Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:55.488607Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1366
2025-09-30T14:53:55.488797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1366 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:55.488822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1366 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:55.488826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1366 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:55.488830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:55.489280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1366 sessionId:  describe result for acl check
2025-09-30T14:53:55.489320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:55.489322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:55.489325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:55.489331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895598025114123:8340] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:55.489823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895598025114123:8340] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:55.496264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895598025114123:8340] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:55.500629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895598025114123:8340] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:55.500652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895598025114123:8340] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:55.500666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895598025114123:8340] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:55.500674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1366 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:55.524395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:55.530419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:55.530657Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:55.530661Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:55.530673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:55.530728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:55.530766Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895597935363579:8314]
2025-09-30T14:53:55.531465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:55.532094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:55.532167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:55.532533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:55.532620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:55.532622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:55.532623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:55.532625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:55.532626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:55.532628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:55.532629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:55.532631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:55.532632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:55.532633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:55.532635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.532637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:55.532638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:55.532639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:55.532641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:55.532646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:55.532657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:55.532661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:55.532665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:55.532669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:55.532674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:55.532678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:55.532681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:55.532685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:55.532691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:55.532695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.532699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:55.532704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:55.532707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:55.532712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:55.532720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:55.532729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:55.532736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:55.532742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:55.532748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:55.532754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:55.532759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:55.532765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:55.532770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:55.532775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:55.532780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:55.532785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:55.532790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:55.532796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:55.532800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:55.532805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:55.532811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:55.532817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:55.532823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:55.532828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:55.532833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.532838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.532843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:55.532850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:55.532855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:55.532860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:55.532865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:55.532870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:55.532874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:55.532880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:55.532923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:55.540208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:55.541075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:55.541093Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:55.541096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:55.541101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:55.541108Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1365 [2:7555895597935363579:8314]
2025-09-30T14:53:55.541125Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:55.541142Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:55.541146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:55.541150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:55.541153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:55.541168Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:55.541175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:55.541183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:55.541243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.541245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:55.541247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:55.541250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:55.541253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:55.541321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:55.541324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.541337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:55.541348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:55.541367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:55.541384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895597935363573:8314]
2025-09-30T14:53:55.541386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895597935363573:8314]
2025-09-30T14:53:55.541388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895597935363573:8314]
2025-09-30T14:53:55.541401Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:55.541414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:55.541429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:55.541433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:55.541466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895597935363573:8314]
2025-09-30T14:53:55.541469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:55.541593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:55.541596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:55.541598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:55.541604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:55.541747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895598025114165:8340], now have 1 active actors on pipe
2025-09-30T14:53:55.541754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895598025114116:2454], now have 1 active actors on pipe
2025-09-30T14:53:55.542255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1365
2025-09-30T14:53:55.542291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1365
2025-09-30T14:53:55.545733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:55.545755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:55.545792Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c79dc1da-ce4a9f9e-49185740-aaa2bae4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:55.545803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:55.545808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:55.545811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:55.545824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:55.545841Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:55.545860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:55.548250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:55.548268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:55.548299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:55.548434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1366 partition: 0 MaxSeqNo: 42 sessionId: src_id|c79dc1da-ce4a9f9e-49185740-aaa2bae4_0
2025-09-30T14:53:55.551382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9077541f-ec9b4321-e7397d32-44e544f1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c79dc1da-ce4a9f9e-49185740-aaa2bae4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:55.554425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c79dc1da-ce4a9f9e-49185740-aaa2bae4_0] Write session: try to update token
2025-09-30T14:53:55.554455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c79dc1da-ce4a9f9e-49185740-aaa2bae4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:55.562762Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:55.562788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:55.562791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:55.562794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:55.562804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895597935363573:8314]
2025-09-30T14:53:55.562809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895597935363573:8314]
2025-09-30T14:53:55.562815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895597935363573:8314]
2025-09-30T14:53:55.562855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:55.562861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.562862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:55.562870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:55.562880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:55.562884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:55.563008Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:55.575988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895598025114326:2659]
2025-09-30T14:53:55.580653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1366 sessionId: src_id|c79dc1da-ce4a9f9e-49185740-aaa2bae4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:55.583396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1365, pipe: [1:7555895598025114326:2659]
2025-09-30T14:53:55.583544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:55.700556Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:55.701161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895598025114326:2659], now have 1 active actors on pipe
2025-09-30T14:53:55.701198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:55.701205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:55.701454Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:55.701527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:55.701547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:55.701614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1366 reason: error at write: Disconnected sessionId: src_id|c79dc1da-ce4a9f9e-49185740-aaa2bae4_0
2025-09-30T14:53:55.701828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:55.701850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1366 sessionId: src_id|c79dc1da-ce4a9f9e-49185740-aaa2bae4_0 is DEAD
2025-09-30T14:53:55.702034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c79dc1da-ce4a9f9e-49185740-aaa2bae4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:55.702050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c79dc1da-ce4a9f9e-49185740-aaa2bae4_0] Write session will restart in 0.009705s
2025-09-30T14:53:55.701879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895598025114326:2659]
2025-09-30T14:53:55.702073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c79dc1da-ce4a9f9e-49185740-aaa2bae4_0] Write session: Do CDS request
2025-09-30T14:53:55.702082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c79dc1da-ce4a9f9e-49185740-aaa2bae4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:55.713708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c79dc1da-ce4a9f9e-49185740-aaa2bae4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:55.714089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:55.714114Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1367
2025-09-30T14:53:55.714298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1367 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:55.714333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1367 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:55.714338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1367 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:55.714347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:55.714836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1367 sessionId:  describe result for acl check
2025-09-30T14:53:55.714874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:55.714881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:55.714883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:55.714889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895598025114345:8345] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:55.715411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895598025114345:8345] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:55.719685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895598025114345:8345] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:55.723972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895598025114345:8345] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:55.723991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895598025114345:8345] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:55.723995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895598025114345:8345] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:55.724004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1367 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:55.731866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:55.735703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:55.735959Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:55.735971Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:55.735984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:55.736049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:55.736212Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895597935363782:8317]
2025-09-30T14:53:55.736940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:55.737373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:55.737429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:55.737780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:55.737843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:55.737844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:55.737846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:55.737847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:55.737849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:55.737850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:55.737851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:55.737853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:55.737854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:55.737855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:55.737858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.737859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:55.737860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:55.737862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:55.737863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:55.737870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:55.737882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:55.737887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:55.737892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:55.737897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:55.737902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:55.737907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:55.737912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:55.737917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:55.737921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:55.737925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.737928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:55.737932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:55.737936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:55.737939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:55.737949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:55.737969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:55.737975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:55.737982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:55.737988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:55.737994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:55.738000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:55.738006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:55.738011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:55.738016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:55.738021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:55.738027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:55.738033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:55.738039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:55.738044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:55.738050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:55.738055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:55.738061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:55.738067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:55.738073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:55.738092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.738099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.738104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:55.738112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:55.738120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:55.738125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:55.738130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:55.738135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:55.738140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:55.738145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:55.738192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:55.748752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:55.749615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:55.749634Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:55.749638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:55.749642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:55.749650Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1366 [2:7555895597935363782:8317]
2025-09-30T14:53:55.749668Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:55.749685Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:55.749694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:55.749697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:55.749700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:55.749717Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:55.749729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:55.749736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:55.749804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.749813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:55.749831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:55.749839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:55.749842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:55.749909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:55.749919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.749931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:55.749944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:55.749977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:55.750001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895598025114480:8345], now have 1 active actors on pipe
2025-09-30T14:53:55.750009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895598025114329:2454], now have 1 active actors on pipe
2025-09-30T14:53:55.750015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895597935363777:8317]
2025-09-30T14:53:55.750018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895597935363777:8317]
2025-09-30T14:53:55.750020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895597935363777:8317]
2025-09-30T14:53:55.750032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:55.750046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:55.750048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:55.750051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:55.750053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:55.750065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:55.750069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:55.750090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1366
2025-09-30T14:53:55.750098Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1366
2025-09-30T14:53:55.750105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895597935363777:8317]
2025-09-30T14:53:55.750116Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:55.750132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:55.750304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:55.750315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:55.750344Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3371d28-f291d659-bf8dc5e8-17af0981_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:55.750357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:55.750366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:55.750369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:55.750381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:55.750395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:55.750415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:55.750557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:55.750565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:55.750577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:55.750677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1367 partition: 0 MaxSeqNo: 42 sessionId: src_id|d3371d28-f291d659-bf8dc5e8-17af0981_0
2025-09-30T14:53:55.751104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c79dc1da-ce4a9f9e-49185740-aaa2bae4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d3371d28-f291d659-bf8dc5e8-17af0981_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:55.754139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3371d28-f291d659-bf8dc5e8-17af0981_0] Write session: try to update token
2025-09-30T14:53:55.754163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3371d28-f291d659-bf8dc5e8-17af0981_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:55.762441Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:55.762466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:55.762475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895597935363777:8317]
2025-09-30T14:53:55.762521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:55.762523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:55.762692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:55.762847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:55.762997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:55.763141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:55.763360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:55.763406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:55.770887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1367 sessionId: src_id|d3371d28-f291d659-bf8dc5e8-17af0981_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:55.773488Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:55.773509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:55.773512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:55.773515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:55.773525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895597935363777:8317]
2025-09-30T14:53:55.773530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895597935363777:8317]
2025-09-30T14:53:55.773537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895597935363777:8317]
2025-09-30T14:53:55.773583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:55.773590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.773593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:55.773605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:55.773613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:55.773618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:55.773739Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:55.773751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:55.801788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895598025114537:2659]
2025-09-30T14:53:55.802131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1366, pipe: [1:7555895598025114537:2659]
2025-09-30T14:53:55.889774Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:55.890360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:55.890367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:55.890383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895598025114537:2659], now have 1 active actors on pipe
2025-09-30T14:53:55.890588Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:55.891178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:55.891232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:55.891336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1367 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d3371d28-f291d659-bf8dc5e8-17af0981_0
2025-09-30T14:53:55.891504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1367 sessionId: src_id|d3371d28-f291d659-bf8dc5e8-17af0981_0 is DEAD
2025-09-30T14:53:55.891645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895598025114537:2659]
2025-09-30T14:53:55.891941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3371d28-f291d659-bf8dc5e8-17af0981_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:55.891950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3371d28-f291d659-bf8dc5e8-17af0981_0] Write session will restart in 0.005730s
2025-09-30T14:53:55.891973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3371d28-f291d659-bf8dc5e8-17af0981_0] Write session: Do CDS request
2025-09-30T14:53:55.891978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3371d28-f291d659-bf8dc5e8-17af0981_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:55.898709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3371d28-f291d659-bf8dc5e8-17af0981_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:55.899054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:55.899072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1368
2025-09-30T14:53:55.899163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1368 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:55.899187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1368 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:55.899192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1368 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:55.899197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:55.899704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1368 sessionId:  describe result for acl check
2025-09-30T14:53:55.899742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:55.899744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:55.899745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:55.899753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895598025114560:8355] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:55.900291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895598025114560:8355] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:55.904720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895598025114560:8355] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:55.911904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895598025114560:8355] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:55.911924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895598025114560:8355] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:55.911928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895598025114560:8355] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:55.911936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1368 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:55.939732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:55.940496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:55.940677Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:55.940690Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:55.940701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:55.940756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:55.940794Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895597935364018:8325]
2025-09-30T14:53:55.941351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:55.942761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:55.942805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:55.943047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:55.943082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:55.943083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:55.943084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:55.943084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:55.943085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:55.943086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:55.943086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:55.943087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:55.943087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:55.943088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:55.943089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.943089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:55.943090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:55.943091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:55.943091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:55.943095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:55.943102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:55.943104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:55.943107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:55.943109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:55.943112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:55.943114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:55.943116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:55.943118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:55.943121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:55.943123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.943125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:55.943127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:55.943130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:55.943132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:55.943138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:55.943143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:55.943146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:55.943149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:55.943152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:55.943155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:55.943157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:55.943160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:55.943164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:55.943167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:55.943170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:55.943173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:55.943175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:55.943178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:55.943181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:55.943184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:55.943186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:55.943189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:55.943195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:55.943198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:55.943200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.943203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.943206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:55.943209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:55.943211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:55.943214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:55.943217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:55.943220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:55.943223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:55.943226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:55.943267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:55.949132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:55.950057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:55.950078Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:55.950082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:55.950086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:55.950094Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1367 [2:7555895597935364018:8325]
2025-09-30T14:53:55.950112Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:55.950130Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:55.950133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:55.950136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:55.950139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:55.950157Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:55.950164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:55.950171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:55.950237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.950239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:55.950241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:55.950246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:55.950248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:55.950320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:55.950324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.950338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:55.950350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:55.950369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:55.950387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895597935364012:8325]
2025-09-30T14:53:55.950390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895597935364012:8325]
2025-09-30T14:53:55.950393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895597935364012:8325]
2025-09-30T14:53:55.950402Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:55.950416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:55.950424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:55.950428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:55.950433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:55.950433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:55.950437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:55.950473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895597935364012:8325]
2025-09-30T14:53:55.950484Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:55.950494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895598025114602:8355], now have 1 active actors on pipe
2025-09-30T14:53:55.950499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895598025114553:2454], now have 1 active actors on pipe
2025-09-30T14:53:55.950648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:55.951339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1367
2025-09-30T14:53:55.951371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1367
2025-09-30T14:53:55.951747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:55.951765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:55.951794Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7057a8b0-e2d9c903-98a756e3-e7b18478_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:55.951810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:55.951815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:55.951817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:55.951828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:55.951842Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:55.951864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:55.952065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:55.952074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:55.952089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:55.952195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1368 partition: 0 MaxSeqNo: 42 sessionId: src_id|7057a8b0-e2d9c903-98a756e3-e7b18478_0
2025-09-30T14:53:55.952574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3371d28-f291d659-bf8dc5e8-17af0981_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7057a8b0-e2d9c903-98a756e3-e7b18478_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:55.955457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7057a8b0-e2d9c903-98a756e3-e7b18478_0] Write session: try to update token
2025-09-30T14:53:55.955479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7057a8b0-e2d9c903-98a756e3-e7b18478_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:55.968291Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:55.968315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:55.968318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:55.968319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:55.968329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895597935364012:8325]
2025-09-30T14:53:55.968335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895597935364012:8325]
2025-09-30T14:53:55.968340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895597935364012:8325]
2025-09-30T14:53:55.968382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:55.968390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:55.968393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:55.968404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:55.968412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:55.968416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:55.968537Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:55.972913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1368 sessionId: src_id|7057a8b0-e2d9c903-98a756e3-e7b18478_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:55.975682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:55.991704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895598025114770:2659]
2025-09-30T14:53:55.992201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1367, pipe: [1:7555895598025114770:2659]
2025-09-30T14:53:56.084492Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:56.084961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:56.084971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:56.085012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895598025114770:2659], now have 1 active actors on pipe
2025-09-30T14:53:56.085857Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:56.086337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7057a8b0-e2d9c903-98a756e3-e7b18478_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:56.086349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7057a8b0-e2d9c903-98a756e3-e7b18478_0] Write session will restart in 0.008670s
2025-09-30T14:53:56.086372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7057a8b0-e2d9c903-98a756e3-e7b18478_0] Write session: Do CDS request
2025-09-30T14:53:56.086378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7057a8b0-e2d9c903-98a756e3-e7b18478_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:56.085661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:56.085721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:56.085722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895598025114770:2659]
2025-09-30T14:53:56.085723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:56.085780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1368 reason: error at write: Disconnected sessionId: src_id|7057a8b0-e2d9c903-98a756e3-e7b18478_0
2025-09-30T14:53:56.085970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1368 sessionId: src_id|7057a8b0-e2d9c903-98a756e3-e7b18478_0 is DEAD
2025-09-30T14:53:56.095785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7057a8b0-e2d9c903-98a756e3-e7b18478_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:56.096139Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:56.096159Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1369
2025-09-30T14:53:56.096298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1369 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:56.096334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1369 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:56.096339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1369 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:56.096344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:56.097036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1369 sessionId:  describe result for acl check
2025-09-30T14:53:56.097065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:56.097067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:56.097070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:56.097076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895602320082096:8361] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:56.097624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895602320082096:8361] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:56.111575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:56.112201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895602320082096:8361] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:56.114798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:56.115017Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:56.115027Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:56.115038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:56.115093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:56.115136Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895602230331515:8333]
2025-09-30T14:53:56.115816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:56.116125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:56.116189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:56.116568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:56.116645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:56.116646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:56.116647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:56.116648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:56.116649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:56.116651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:56.116652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:56.116653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:56.116654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:56.116656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:56.116657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.116658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:56.116659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:56.116660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:56.116662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:56.116667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:56.116677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:56.116681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:56.116685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:56.116689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:56.116693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:56.116696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:56.116699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:56.116702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:56.116705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:56.116709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.116713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:56.116717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:56.116721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:56.116725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:56.116733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:56.116741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:56.116747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:56.116752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:56.116757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:56.116761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:56.116766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:56.116770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:56.116775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:56.116780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:56.116784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:56.116789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:56.116794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:56.116799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:56.116803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:56.116808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:56.116814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:56.116819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:56.116823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:56.116828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:56.116835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.116839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.116843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:56.116848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:56.116852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:56.116857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:56.116861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:56.116866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:56.116870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:56.116875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:56.116921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:56.122360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895602320082096:8361] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:56.122380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895602320082096:8361] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:56.122383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895602320082096:8361] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:56.122392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1369 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:56.122717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:56.123728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:56.123746Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:56.123749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:56.123753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:56.123759Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1368 [2:7555895602230331515:8333]
2025-09-30T14:53:56.123774Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:56.123791Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:56.123794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:56.123797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:56.123800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:56.123816Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:56.123823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:56.123829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:56.123887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.123890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:56.123892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:56.123896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:56.123899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:56.123964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:56.123967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.123980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:56.123993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:56.124011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:56.124027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895602230331509:8333]
2025-09-30T14:53:56.124029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895602230331509:8333]
2025-09-30T14:53:56.124031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895602230331509:8333]
2025-09-30T14:53:56.124044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:56.124057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:56.124073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:56.124076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:56.124112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895602230331509:8333]
2025-09-30T14:53:56.124114Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:56.124139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895602320082076:2454], now have 1 active actors on pipe
2025-09-30T14:53:56.124143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895602320082278:8361], now have 1 active actors on pipe
2025-09-30T14:53:56.124172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:56.124175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:56.124176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:56.124181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:56.124615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1368
2025-09-30T14:53:56.124653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1368
2025-09-30T14:53:56.128128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:56.128145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:56.128180Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac1e5ddd-56835bf3-b1743523-43c38763_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:56.128192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:56.128197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:56.128200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:56.128212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:56.128228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:56.128245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:56.128497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:56.128525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:56.128557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:56.128692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1369 partition: 0 MaxSeqNo: 42 sessionId: src_id|ac1e5ddd-56835bf3-b1743523-43c38763_0
2025-09-30T14:53:56.129100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7057a8b0-e2d9c903-98a756e3-e7b18478_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ac1e5ddd-56835bf3-b1743523-43c38763_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:56.132053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1e5ddd-56835bf3-b1743523-43c38763_0] Write session: try to update token
2025-09-30T14:53:56.132075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1e5ddd-56835bf3-b1743523-43c38763_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:56.140625Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:56.140649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:56.140652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:56.140654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:56.140664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895602230331509:8333]
2025-09-30T14:53:56.140669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895602230331509:8333]
2025-09-30T14:53:56.140674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895602230331509:8333]
2025-09-30T14:53:56.140720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:56.140722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:56.140727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.140729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:56.140730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:56.140737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:56.140877Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:56.154522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1369 sessionId: src_id|ac1e5ddd-56835bf3-b1743523-43c38763_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:56.157448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:56.186319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895602320082290:2659]
2025-09-30T14:53:56.186808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1368, pipe: [1:7555895602320082290:2659]
2025-09-30T14:53:56.266944Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:56.267317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:56.267334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:56.267354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895602320082290:2659], now have 1 active actors on pipe
2025-09-30T14:53:56.267649Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:56.267754Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:56.268864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:56.268981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1369 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ac1e5ddd-56835bf3-b1743523-43c38763_0
2025-09-30T14:53:56.269225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1369 sessionId: src_id|ac1e5ddd-56835bf3-b1743523-43c38763_0 is DEAD
2025-09-30T14:53:56.269435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895602320082290:2659]
2025-09-30T14:53:56.271358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1e5ddd-56835bf3-b1743523-43c38763_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:56.271372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1e5ddd-56835bf3-b1743523-43c38763_0] Write session will restart in 0.006951s
2025-09-30T14:53:56.271398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1e5ddd-56835bf3-b1743523-43c38763_0] Write session: Do CDS request
2025-09-30T14:53:56.271405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1e5ddd-56835bf3-b1743523-43c38763_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:56.283752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1e5ddd-56835bf3-b1743523-43c38763_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:56.287407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:56.287430Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1370
2025-09-30T14:53:56.287655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1370 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:56.287690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1370 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:56.287696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1370 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:56.287701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:56.288470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1370 sessionId:  describe result for acl check
2025-09-30T14:53:56.288506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:56.288508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:56.288511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:56.288517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895602320082382:8366] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:56.289088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895602320082382:8366] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:56.292803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895602320082382:8366] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:56.295817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895602320082382:8366] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:56.295839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895602320082382:8366] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:56.295842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895602320082382:8366] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:56.295852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1370 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:56.300079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:56.302964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:56.303200Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:56.303205Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:56.303217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:56.303304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:56.303345Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895602230331734:8337]
2025-09-30T14:53:56.304085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:56.304836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:56.304925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:56.305339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:56.305411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:56.305418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:56.305420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:56.305421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:56.305423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:56.305424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:56.305427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:56.305428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:56.305430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:56.305432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:56.305434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.305436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:56.305437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:56.305439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:56.305440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:56.305448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:56.305460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:56.305465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:56.305471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:56.305476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:56.305481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:56.305485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:56.305489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:56.305493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:56.305498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:56.305502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.305506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:56.305510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:56.305515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:56.305519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:56.305529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:56.305539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:56.305558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:56.305565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:56.305571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:56.305577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:56.305588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:56.305594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:56.305605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:56.305612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:56.305622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:56.305629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:56.305639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:56.305645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:56.305655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:56.305662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:56.305668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:56.305674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:56.305684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:56.305690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:56.305701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.305707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.305717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:56.305724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:56.305731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:56.305737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:56.305752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:56.305758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:56.305769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:56.305775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:56.305835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:56.313542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:56.314547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:56.314572Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:56.314577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:56.314581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:56.314590Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1369 [2:7555895602230331734:8337]
2025-09-30T14:53:56.314609Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:56.314627Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:56.314632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:56.314635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:56.314638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:56.314656Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:56.314678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:56.314685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:56.314752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.314761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:56.314763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:56.314768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:56.314771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:56.314848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:56.314857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.314872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:56.314891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:56.314913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:56.314935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895602230331728:8337]
2025-09-30T14:53:56.314942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895602230331728:8337]
2025-09-30T14:53:56.314948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895602230331728:8337]
2025-09-30T14:53:56.314961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:56.314980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:56.315001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:56.315009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:56.315047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895602230331728:8337]
2025-09-30T14:53:56.315056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:56.315352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:56.315363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:56.315366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:56.315373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:56.315439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895602320082492:8366], now have 1 active actors on pipe
2025-09-30T14:53:56.315458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895602320082292:2454], now have 1 active actors on pipe
2025-09-30T14:53:56.315625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1369
2025-09-30T14:53:56.315666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1369
2025-09-30T14:53:56.316326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:56.316341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:56.316373Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|413b4fe0-c05221db-c76d6ee5-ee8e9a9c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:56.316382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:56.316386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:56.316389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:56.316400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:56.316415Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:56.316433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:56.316703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:56.316713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:56.316728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:56.316857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1370 partition: 0 MaxSeqNo: 42 sessionId: src_id|413b4fe0-c05221db-c76d6ee5-ee8e9a9c_0
2025-09-30T14:53:56.317317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1e5ddd-56835bf3-b1743523-43c38763_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|413b4fe0-c05221db-c76d6ee5-ee8e9a9c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:56.320319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|413b4fe0-c05221db-c76d6ee5-ee8e9a9c_0] Write session: try to update token
2025-09-30T14:53:56.320342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|413b4fe0-c05221db-c76d6ee5-ee8e9a9c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:56.337904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1370 sessionId: src_id|413b4fe0-c05221db-c76d6ee5-ee8e9a9c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:56.340836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:56.340998Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:56.341025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:56.341027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:56.341030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:56.341040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895602230331728:8337]
2025-09-30T14:53:56.341044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895602230331728:8337]
2025-09-30T14:53:56.341049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895602230331728:8337]
2025-09-30T14:53:56.341088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:56.341096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.341099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:56.341245Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:56.343932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:56.343948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:56.343953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:56.367576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895602320082517:2659]
2025-09-30T14:53:56.368174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1369, pipe: [1:7555895602320082517:2659]
2025-09-30T14:53:56.460033Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:56.460566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:56.460585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:56.460623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895602320082517:2659], now have 1 active actors on pipe
2025-09-30T14:53:56.460863Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:56.460884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:56.460891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:56.460904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:56.460937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895602320082517:2659]
2025-09-30T14:53:56.460968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1370 reason: error at write: Disconnected sessionId: src_id|413b4fe0-c05221db-c76d6ee5-ee8e9a9c_0
2025-09-30T14:53:56.461145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1370 sessionId: src_id|413b4fe0-c05221db-c76d6ee5-ee8e9a9c_0 is DEAD
2025-09-30T14:53:56.461413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|413b4fe0-c05221db-c76d6ee5-ee8e9a9c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:56.461422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|413b4fe0-c05221db-c76d6ee5-ee8e9a9c_0] Write session will restart in 0.007973s
2025-09-30T14:53:56.461446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|413b4fe0-c05221db-c76d6ee5-ee8e9a9c_0] Write session: Do CDS request
2025-09-30T14:53:56.461454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|413b4fe0-c05221db-c76d6ee5-ee8e9a9c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:56.472174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|413b4fe0-c05221db-c76d6ee5-ee8e9a9c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:56.472408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:56.472435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1371
2025-09-30T14:53:56.473616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1371 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:56.473662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1371 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:56.473672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1371 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:56.473677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:56.474183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1371 sessionId:  describe result for acl check
2025-09-30T14:53:56.474222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:56.474228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:56.474230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:56.474236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895602320082534:8370] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:56.474785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895602320082534:8370] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:56.480903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895602320082534:8370] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:56.485375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895602320082534:8370] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:56.485394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895602320082534:8370] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:56.485398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895602320082534:8370] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:56.485408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1371 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:56.492403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:56.499578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:56.499832Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:56.499837Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:56.499848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:56.499913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:56.499953Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895602230331940:8339]
2025-09-30T14:53:56.500647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:56.503668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:56.503760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:56.504168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:56.504228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:56.504229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:56.504230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:56.504232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:56.504233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:56.504234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:56.504235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:56.504237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:56.504238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:56.504239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:56.504241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.504242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:56.504243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:56.504245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:56.504246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:56.504253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:56.504263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:56.504267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:56.504271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:56.504275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:56.504279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:56.504282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:56.504286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:56.504289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:56.504293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:56.504297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.504300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:56.504304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:56.504308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:56.504311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:56.504320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:56.504328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:56.504334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:56.504340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:56.504345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:56.504350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:56.504354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:56.504359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:56.504364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:56.504369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:56.504372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:56.504377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:56.504384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:56.504389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:56.504394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:56.504399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:56.504404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:56.504409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:56.504413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:56.504419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:56.504424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.504429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.504433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:56.504438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:56.504442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:56.504447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:56.504451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:56.504455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:56.504460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:56.504465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:56.504505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:56.511486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:56.512500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:56.512519Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:56.512523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:56.512527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:56.512535Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1370 [2:7555895602230331940:8339]
2025-09-30T14:53:56.512551Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:56.512568Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:56.512571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:56.512575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:56.512577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:56.512594Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:56.512602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:56.512608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:56.512678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.512680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:56.512682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:56.512686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:56.512689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:56.513716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1370
2025-09-30T14:53:56.513783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1370
2025-09-30T14:53:56.512760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:56.512770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.512782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:56.512792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:56.512807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:56.512825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895602230331932:8339]
2025-09-30T14:53:56.512827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895602230331932:8339]
2025-09-30T14:53:56.512831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895602230331932:8339]
2025-09-30T14:53:56.512839Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:56.512858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:56.512876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:56.512879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:56.512881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:56.512885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:56.512896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:56.512919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895602230331932:8339]
2025-09-30T14:53:56.512923Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:56.512926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:56.512935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895602320082519:2454], now have 1 active actors on pipe
2025-09-30T14:53:56.512939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895602320082694:8370], now have 1 active actors on pipe
2025-09-30T14:53:56.513965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:56.513981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:56.514006Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|659eb538-44b7c24f-427fda05-757fff64_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:56.514015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:56.514019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:56.514022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:56.514032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:56.514045Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:56.514061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:56.514385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:56.514390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:56.514416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:56.514887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1371 partition: 0 MaxSeqNo: 42 sessionId: src_id|659eb538-44b7c24f-427fda05-757fff64_0
2025-09-30T14:53:56.515380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|413b4fe0-c05221db-c76d6ee5-ee8e9a9c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|659eb538-44b7c24f-427fda05-757fff64_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:56.518230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|659eb538-44b7c24f-427fda05-757fff64_0] Write session: try to update token
2025-09-30T14:53:56.518249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|659eb538-44b7c24f-427fda05-757fff64_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:56.530164Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:56.530188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:56.530191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:56.530194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:56.530204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895602230331932:8339]
2025-09-30T14:53:56.530209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895602230331932:8339]
2025-09-30T14:53:56.530213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895602230331932:8339]
2025-09-30T14:53:56.530256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:56.530262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.530265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:56.530273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:56.530281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:56.530285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:56.530402Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:56.546936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1371 sessionId: src_id|659eb538-44b7c24f-427fda05-757fff64_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:56.549531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:56.561103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895602320082738:2659]
2025-09-30T14:53:56.561525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1370, pipe: [1:7555895602320082738:2659]
2025-09-30T14:53:56.674916Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:56.675304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:56.675321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:56.675341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895602320082738:2659], now have 1 active actors on pipe
2025-09-30T14:53:56.675569Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:56.676018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:56.676071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895602320082738:2659]
2025-09-30T14:53:56.676089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:56.676155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1371 reason: status is not ok: tablet will be restarted right now sessionId: src_id|659eb538-44b7c24f-427fda05-757fff64_0
2025-09-30T14:53:56.676326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1371 sessionId: src_id|659eb538-44b7c24f-427fda05-757fff64_0 is DEAD
2025-09-30T14:53:56.677934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|659eb538-44b7c24f-427fda05-757fff64_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:56.677946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|659eb538-44b7c24f-427fda05-757fff64_0] Write session will restart in 0.009625s
2025-09-30T14:53:56.678003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|659eb538-44b7c24f-427fda05-757fff64_0] Write session: Do CDS request
2025-09-30T14:53:56.678009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|659eb538-44b7c24f-427fda05-757fff64_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:56.688803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|659eb538-44b7c24f-427fda05-757fff64_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:56.689164Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:56.689190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1372
2025-09-30T14:53:56.689340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1372 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:56.689371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1372 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:56.689377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1372 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:56.689381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:56.689929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1372 sessionId:  describe result for acl check
2025-09-30T14:53:56.689972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:56.689975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:56.689976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:56.689982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895602320082751:8375] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:56.690544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895602320082751:8375] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:56.699666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895602320082751:8375] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:56.714167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895602320082751:8375] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:56.714187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895602320082751:8375] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:56.714190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895602320082751:8375] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:56.714199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1372 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:56.728277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:56.733545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:56.733778Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:56.733790Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:56.733801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:56.733854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:56.733899Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895602230332150:8342]
2025-09-30T14:53:56.734687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:56.735072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:56.735138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:56.735518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:56.735614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:56.735624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:56.735625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:56.735626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:56.735627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:56.735628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:56.735630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:56.735631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:56.735632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:56.735633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:56.735635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.735636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:56.735637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:56.735638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:56.735639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:56.735646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:56.735656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:56.735660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:56.735664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:56.735668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:56.735671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:56.735675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:56.735679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:56.735683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:56.735687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:56.735690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.735695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:56.735698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:56.735712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:56.735715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:56.735723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:56.735732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:56.735740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:56.735746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:56.735751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:56.735756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:56.735760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:56.735765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:56.735770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:56.735776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:56.735780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:56.735785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:56.735790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:56.735794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:56.735798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:56.735803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:56.735810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:56.735815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:56.735819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:56.735824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:56.735829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.735834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.735839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:56.735843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:56.735848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:56.735853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:56.735858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:56.735863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:56.735868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:56.735873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:56.735919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:56.741889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:56.743263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:56.743268Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:56.743271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:56.743275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:56.743282Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1371 [2:7555895602230332150:8342]
2025-09-30T14:53:56.743303Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:56.743318Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:56.743322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:56.743325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:56.743327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:56.743342Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:56.743349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:56.743355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:56.743415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.743417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:56.743420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:56.743424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:56.743427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:56.743498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:56.743500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.743516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:56.743529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:56.743548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:56.743563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895602230332144:8342]
2025-09-30T14:53:56.743566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895602230332144:8342]
2025-09-30T14:53:56.743569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895602230332144:8342]
2025-09-30T14:53:56.743576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:56.743589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:56.743594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:56.743598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:56.743601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:56.743603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:56.743606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:56.743616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895602320082863:8375], now have 1 active actors on pipe
2025-09-30T14:53:56.743620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895602320082741:2454], now have 1 active actors on pipe
2025-09-30T14:53:56.743649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895602230332144:8342]
2025-09-30T14:53:56.743659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:56.743683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:56.744010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1371
2025-09-30T14:53:56.744055Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1371
2025-09-30T14:53:56.744072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:56.744086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:56.744116Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31171155-82e74f6e-8f08bc9-a7dc6bfd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:56.744125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:56.744129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:56.744132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:56.744142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:56.744152Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:56.744165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:56.744394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:56.744410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:56.744436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:56.744552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1372 partition: 0 MaxSeqNo: 42 sessionId: src_id|31171155-82e74f6e-8f08bc9-a7dc6bfd_0
2025-09-30T14:53:56.744973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|659eb538-44b7c24f-427fda05-757fff64_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|31171155-82e74f6e-8f08bc9-a7dc6bfd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:56.747934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31171155-82e74f6e-8f08bc9-a7dc6bfd_0] Write session: try to update token
2025-09-30T14:53:56.747954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31171155-82e74f6e-8f08bc9-a7dc6bfd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:56.756297Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:56.756322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:56.756325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:56.756327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:56.756337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895602230332144:8342]
2025-09-30T14:53:56.756342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895602230332144:8342]
2025-09-30T14:53:56.756347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895602230332144:8342]
2025-09-30T14:53:56.756391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:56.756398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.756400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:56.756401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:56.756408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:56.756412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:56.756531Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:56.768667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1372 sessionId: src_id|31171155-82e74f6e-8f08bc9-a7dc6bfd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:56.771026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895602320082955:2659]
2025-09-30T14:53:56.771303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1371, pipe: [1:7555895602320082955:2659]
2025-09-30T14:53:56.771592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:56.872808Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:56.873136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895602320082955:2659], now have 1 active actors on pipe
2025-09-30T14:53:56.873167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:56.873178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:56.873407Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:56.873477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:56.873495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:56.873566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1372 reason: error at write: Disconnected sessionId: src_id|31171155-82e74f6e-8f08bc9-a7dc6bfd_0
2025-09-30T14:53:56.873748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1372 sessionId: src_id|31171155-82e74f6e-8f08bc9-a7dc6bfd_0 is DEAD
2025-09-30T14:53:56.873787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895602320082955:2659]
2025-09-30T14:53:56.873803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:56.875603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31171155-82e74f6e-8f08bc9-a7dc6bfd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:56.875614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31171155-82e74f6e-8f08bc9-a7dc6bfd_0] Write session will restart in 0.009620s
2025-09-30T14:53:56.875640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31171155-82e74f6e-8f08bc9-a7dc6bfd_0] Write session: Do CDS request
2025-09-30T14:53:56.875649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31171155-82e74f6e-8f08bc9-a7dc6bfd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:56.887519Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:56.887537Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1373
2025-09-30T14:53:56.887844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31171155-82e74f6e-8f08bc9-a7dc6bfd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:56.888067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1373 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:56.888117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1373 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:56.888135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1373 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:56.888141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:56.889000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1373 sessionId:  describe result for acl check
2025-09-30T14:53:56.889050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:56.889052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:56.889054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:56.889060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895602320083002:8379] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:56.889633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895602320083002:8379] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:56.893423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895602320083002:8379] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:56.896547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895602320083002:8379] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:56.896564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895602320083002:8379] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:56.896568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895602320083002:8379] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:56.896576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1373 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:56.899650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:56.902429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:56.902669Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:56.902682Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:56.902705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:56.902776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:56.902820Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895602230332356:8344]
2025-09-30T14:53:56.903586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:56.905417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:56.905473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:56.905853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:56.905906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:56.905908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:56.905909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:56.905911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:56.905913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:56.905914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:56.905916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:56.905917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:56.905919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:56.905920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:56.905922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.905924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:56.905926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:56.905927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:56.905929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:56.905935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:56.905959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:56.905964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:56.905969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:56.905973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:56.905978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:56.905983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:56.905987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:56.905992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:56.905998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:56.906002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.906006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:56.906011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:56.906015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:56.906020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:56.906029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:56.906038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:56.906045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:56.906051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:56.906057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:56.906063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:56.906068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:56.906074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:56.906079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:56.906085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:56.906090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:56.906096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:56.906102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:56.906108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:56.906113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:56.906119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:56.906125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:56.906130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:56.906135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:56.906141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:56.906147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.906152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.906158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:56.906164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:56.906170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:56.906177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:56.906182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:56.906188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:56.906194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:56.906199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:56.906246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:56.914898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1372
2025-09-30T14:53:56.914942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1372
2025-09-30T14:53:56.912953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:56.914268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:56.914277Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:56.914280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:56.914284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:56.914292Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1372 [2:7555895602230332356:8344]
2025-09-30T14:53:56.914309Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:56.914326Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:56.914329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:56.914332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:56.914334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:56.914352Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:56.914359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:56.914367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:56.914430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.914432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:56.914434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:56.914437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:56.914440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:56.914522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:56.914525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.914540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:56.914551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:56.914568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:56.914589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895602320082958:2454], now have 1 active actors on pipe
2025-09-30T14:53:56.914596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895602230332351:8344]
2025-09-30T14:53:56.914600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895602230332351:8344]
2025-09-30T14:53:56.914602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895602230332351:8344]
2025-09-30T14:53:56.914611Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:56.914623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:56.914622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:56.914627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:56.914629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:56.914636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:56.914639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:56.914644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895602320083132:8379], now have 1 active actors on pipe
2025-09-30T14:53:56.914680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895602230332351:8344]
2025-09-30T14:53:56.914689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:56.914696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:56.915033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:56.915039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:56.915067Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|177f291d-b7146351-5f3a8fc7-dd9bec01_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:56.915074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:56.915078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:56.915080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:56.915091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:56.915102Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:56.915115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:56.915336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:56.915339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:56.915353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:56.915466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1373 partition: 0 MaxSeqNo: 42 sessionId: src_id|177f291d-b7146351-5f3a8fc7-dd9bec01_0
2025-09-30T14:53:56.919370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31171155-82e74f6e-8f08bc9-a7dc6bfd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|177f291d-b7146351-5f3a8fc7-dd9bec01_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:56.922271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|177f291d-b7146351-5f3a8fc7-dd9bec01_0] Write session: try to update token
2025-09-30T14:53:56.922294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|177f291d-b7146351-5f3a8fc7-dd9bec01_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:56.927684Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:56.927711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:56.927713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:56.927716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:56.927726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895602230332351:8344]
2025-09-30T14:53:56.927730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895602230332351:8344]
2025-09-30T14:53:56.927734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895602230332351:8344]
2025-09-30T14:53:56.927778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:56.927785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:56.927788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:56.927939Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:56.930522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:56.930546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:56.930551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:56.952389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1373 sessionId: src_id|177f291d-b7146351-5f3a8fc7-dd9bec01_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:56.955194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:56.979321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895602320083185:2659]
2025-09-30T14:53:56.983501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1372, pipe: [1:7555895602320083185:2659]
2025-09-30T14:53:57.046442Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:57.046842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:57.046850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:57.046867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895602320083185:2659], now have 1 active actors on pipe
2025-09-30T14:53:57.047103Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:57.047953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895602320083185:2659]
2025-09-30T14:53:57.047995Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:57.048027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:57.048096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1373 reason: status is not ok: tablet will be restarted right now sessionId: src_id|177f291d-b7146351-5f3a8fc7-dd9bec01_0
2025-09-30T14:53:57.048249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1373 sessionId: src_id|177f291d-b7146351-5f3a8fc7-dd9bec01_0 is DEAD
2025-09-30T14:53:57.048548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|177f291d-b7146351-5f3a8fc7-dd9bec01_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:57.048557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|177f291d-b7146351-5f3a8fc7-dd9bec01_0] Write session will restart in 0.008853s
2025-09-30T14:53:57.048581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|177f291d-b7146351-5f3a8fc7-dd9bec01_0] Write session: Do CDS request
2025-09-30T14:53:57.048588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|177f291d-b7146351-5f3a8fc7-dd9bec01_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:57.058704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|177f291d-b7146351-5f3a8fc7-dd9bec01_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:57.058806Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:57.058823Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1374
2025-09-30T14:53:57.059241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1374 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:57.059304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1374 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:57.059314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1374 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:57.059329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:57.059842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1374 sessionId:  describe result for acl check
2025-09-30T14:53:57.059877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:57.059883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:57.059885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:57.059892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895606615050597:8391] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:57.060451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895606615050597:8391] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:57.063200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895606615050597:8391] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:57.067969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:57.067968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895606615050597:8391] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:57.067988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895606615050597:8391] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:57.067992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895606615050597:8391] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:57.068001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1374 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:57.071492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:57.071746Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:57.071760Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:57.071774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:57.071841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:57.072033Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895606525299895:8358]
2025-09-30T14:53:57.072743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:57.073081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:57.073136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:57.073488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:57.073553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:57.073560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:57.073561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:57.073563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:57.073564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:57.073565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:57.073567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:57.073568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:57.073570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:57.073571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:57.073573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.073574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.073576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.073577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:57.073579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:57.073585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:57.073597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:57.073602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:57.073607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:57.073612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:57.073617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:57.073621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:57.073626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:57.073631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:57.073635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:57.073639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.073643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.073648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.073653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:57.073658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:57.073665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:57.073673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:57.073680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:57.073686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:57.073691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:57.073697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:57.073701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:57.073707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:57.073712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:57.073719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:57.073724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:57.073730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:57.073738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:57.073749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:57.073753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:57.073764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:57.073769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:57.073780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:57.073785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:57.073796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:57.073801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.073807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.073817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.073823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.073832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.073839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.073847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:57.073853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:57.073862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:57.073868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:57.073930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:57.079652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:57.080833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:57.080851Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:57.080853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:57.080857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:57.080865Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1373 [2:7555895606525299895:8358]
2025-09-30T14:53:57.080890Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:57.080904Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:57.080908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:57.080911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:57.080914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:57.080931Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:57.080938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:57.080945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:57.081004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.081015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.081017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.081021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:57.081024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:57.081089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:57.081098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.081111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.081125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.081142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:57.081165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895606615050499:2454], now have 1 active actors on pipe
2025-09-30T14:53:57.081174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895606615050702:8391], now have 1 active actors on pipe
2025-09-30T14:53:57.081180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895606525299888:8358]
2025-09-30T14:53:57.081183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895606525299888:8358]
2025-09-30T14:53:57.081185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895606525299888:8358]
2025-09-30T14:53:57.081252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1373
2025-09-30T14:53:57.081273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1373
2025-09-30T14:53:57.081199Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:57.081221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:57.081225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:57.081229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:57.081232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:57.081237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:57.081240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:57.081277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895606525299888:8358]
2025-09-30T14:53:57.081281Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:57.081286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:57.081317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:57.081322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:57.081351Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99a0b929-c3869484-e993c284-8fbbd206_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:57.081357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:57.081361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:57.081363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:57.081372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:57.081381Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:57.081394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:57.081689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:57.081703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:57.081728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:57.081845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1374 partition: 0 MaxSeqNo: 42 sessionId: src_id|99a0b929-c3869484-e993c284-8fbbd206_0
2025-09-30T14:53:57.082267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|177f291d-b7146351-5f3a8fc7-dd9bec01_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|99a0b929-c3869484-e993c284-8fbbd206_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:57.085201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99a0b929-c3869484-e993c284-8fbbd206_0] Write session: try to update token
2025-09-30T14:53:57.085220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99a0b929-c3869484-e993c284-8fbbd206_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:57.093411Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:57.093438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:57.093444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:57.093446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:57.093456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895606525299888:8358]
2025-09-30T14:53:57.093459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895606525299888:8358]
2025-09-30T14:53:57.093462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895606525299888:8358]
2025-09-30T14:53:57.093494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:57.093500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.093501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:57.093526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:57.093545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:57.093550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:57.093640Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:57.102967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1374 sessionId: src_id|99a0b929-c3869484-e993c284-8fbbd206_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:57.105694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:57.148351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895606615050719:2659]
2025-09-30T14:53:57.150023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1373, pipe: [1:7555895606615050719:2659]
2025-09-30T14:53:57.210794Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:57.212033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:57.212059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:57.212081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895606615050719:2659], now have 1 active actors on pipe
2025-09-30T14:53:57.212308Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:57.212376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:57.212400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:57.212472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1374 reason: error at write: Disconnected sessionId: src_id|99a0b929-c3869484-e993c284-8fbbd206_0
2025-09-30T14:53:57.212676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1374 sessionId: src_id|99a0b929-c3869484-e993c284-8fbbd206_0 is DEAD
2025-09-30T14:53:57.212836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99a0b929-c3869484-e993c284-8fbbd206_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:57.212850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99a0b929-c3869484-e993c284-8fbbd206_0] Write session will restart in 0.007190s
2025-09-30T14:53:57.212854Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:57.212888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99a0b929-c3869484-e993c284-8fbbd206_0] Write session: Do CDS request
2025-09-30T14:53:57.212894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99a0b929-c3869484-e993c284-8fbbd206_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:57.212902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895606615050719:2659]
2025-09-30T14:53:57.223141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99a0b929-c3869484-e993c284-8fbbd206_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:57.223837Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:57.223857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1375
2025-09-30T14:53:57.224011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1375 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:57.224055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1375 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:57.224065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1375 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:57.224070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:57.224690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1375 sessionId:  describe result for acl check
2025-09-30T14:53:57.224735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:57.224743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:57.224745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:57.224752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895606615050792:8395] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:57.225299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895606615050792:8395] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:57.228702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895606615050792:8395] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:57.231713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895606615050792:8395] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:57.231732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895606615050792:8395] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:57.231735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895606615050792:8395] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:57.231744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1375 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:57.231728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:57.235873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:57.236128Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:57.236140Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:57.236155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:57.236228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:57.236330Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895606525300105:8361]
2025-09-30T14:53:57.236992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:57.237355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:57.237425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:57.237793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:57.237868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:57.237869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:57.237870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:57.237872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:57.237873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:57.237875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:57.237876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:57.237877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:57.237879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:57.237880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:57.237881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.237883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.237884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.237886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:57.237887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:57.237892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:57.237902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:57.237906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:57.237910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:57.237914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:57.237917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:57.237921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:57.237924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:57.237927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:57.237934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:57.237940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.237944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.237959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.237963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:57.237966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:57.237976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:57.237985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:57.237991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:57.237997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:57.238002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:57.238008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:57.238012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:57.238017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:57.238023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:57.238028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:57.238033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:57.238038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:57.238045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:57.238051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:57.238056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:57.238061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:57.238067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:57.238072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:57.238076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:57.238081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:57.238086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.238092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.238097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.238103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.238107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.238112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.238117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:57.238122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:57.238127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:57.238132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:57.238184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:57.244481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:57.245780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:57.245803Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:57.245805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:57.245809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:57.245816Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1374 [2:7555895606525300105:8361]
2025-09-30T14:53:57.245835Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:57.245853Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:57.245856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:57.245859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:57.245861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:57.245879Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:57.245887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:57.245894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:57.245979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.245989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.245991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.245997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:57.245999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:57.246071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:57.246074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.246089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.246101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.246118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:57.246141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895606525300099:8361]
2025-09-30T14:53:57.246150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895606525300099:8361]
2025-09-30T14:53:57.246152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895606525300099:8361]
2025-09-30T14:53:57.246166Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:57.246181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895606615050925:8395], now have 1 active actors on pipe
2025-09-30T14:53:57.246182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:57.246185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895606615050721:2454], now have 1 active actors on pipe
2025-09-30T14:53:57.246186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:57.246189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:57.246194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:57.246208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:57.246212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:57.246250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895606525300099:8361]
2025-09-30T14:53:57.246266Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:57.246282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:57.246250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1374
2025-09-30T14:53:57.246269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1374
2025-09-30T14:53:57.246321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:57.246331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:57.246360Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd86e729-133c67b1-cdc32350-b04eb0c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:57.246371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:57.246375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:57.246382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:57.246392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:57.246403Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:57.246421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:57.246562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:57.246571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:57.246585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:57.247300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99a0b929-c3869484-e993c284-8fbbd206_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dd86e729-133c67b1-cdc32350-b04eb0c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:57.250344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd86e729-133c67b1-cdc32350-b04eb0c2_0] Write session: try to update token
2025-09-30T14:53:57.250366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd86e729-133c67b1-cdc32350-b04eb0c2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:57.246932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1375 partition: 0 MaxSeqNo: 42 sessionId: src_id|dd86e729-133c67b1-cdc32350-b04eb0c2_0
2025-09-30T14:53:57.261360Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:57.261386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:57.261399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895606525300099:8361]
2025-09-30T14:53:57.261453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:57.261452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:57.261644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:57.261790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:57.261939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:57.262124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:57.262348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:57.262384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:57.272771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1375 sessionId: src_id|dd86e729-133c67b1-cdc32350-b04eb0c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:57.274355Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:57.274377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:57.274380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:57.274382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:57.274391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895606525300099:8361]
2025-09-30T14:53:57.274395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895606525300099:8361]
2025-09-30T14:53:57.274398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895606525300099:8361]
2025-09-30T14:53:57.274439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:57.274443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:57.274458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.274461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:57.274470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:57.274474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:57.274604Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:57.275555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:57.313294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895606615050949:2659]
2025-09-30T14:53:57.313789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1374, pipe: [1:7555895606615050949:2659]
2025-09-30T14:53:57.390172Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:57.390583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:57.390594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:57.390614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895606615050949:2659], now have 1 active actors on pipe
2025-09-30T14:53:57.390866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:57.390884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:57.390875Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:57.390950Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:57.390952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1375 reason: error at write: Disconnected sessionId: src_id|dd86e729-133c67b1-cdc32350-b04eb0c2_0
2025-09-30T14:53:57.391002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895606615050949:2659]
2025-09-30T14:53:57.391120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1375 sessionId: src_id|dd86e729-133c67b1-cdc32350-b04eb0c2_0 is DEAD
2025-09-30T14:53:57.391405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd86e729-133c67b1-cdc32350-b04eb0c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:57.391417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd86e729-133c67b1-cdc32350-b04eb0c2_0] Write session will restart in 0.008575s
2025-09-30T14:53:57.391457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd86e729-133c67b1-cdc32350-b04eb0c2_0] Write session: Do CDS request
2025-09-30T14:53:57.391466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd86e729-133c67b1-cdc32350-b04eb0c2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:57.400797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd86e729-133c67b1-cdc32350-b04eb0c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:57.400861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:57.400880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1376
2025-09-30T14:53:57.401199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1376 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:57.401233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1376 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:57.401253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1376 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:57.401263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:57.401732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1376 sessionId:  describe result for acl check
2025-09-30T14:53:57.401775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:57.401777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:57.401780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:57.401785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895606615050976:8400] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:57.402369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895606615050976:8400] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:57.405889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895606615050976:8400] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:57.410210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895606615050976:8400] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:57.410231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895606615050976:8400] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:57.410235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895606615050976:8400] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:57.410244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1376 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:57.414067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:57.417503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:57.417721Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:57.417731Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:57.417742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:57.417802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:57.417838Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895606525300327:8364]
2025-09-30T14:53:57.418554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:57.418860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:57.418906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:57.419240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:57.419308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:57.419315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:57.419316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:57.419317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:57.419319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:57.419320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:57.419321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:57.419323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:57.419324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:57.419325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:57.419327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.419328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.419330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.419331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:57.419332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:57.419337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:57.419348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:57.419352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:57.419356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:57.419360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:57.419365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:57.419369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:57.419373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:57.419377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:57.419381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:57.419385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.419389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.419394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.419398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:57.419402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:57.419410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:57.419418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:57.419423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:57.419430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:57.419440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:57.419446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:57.419450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:57.419456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:57.419461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:57.419466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:57.419470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:57.419475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:57.419482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:57.419485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:57.419488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:57.419491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:57.419494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:57.419497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:57.419500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:57.419503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:57.419505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.419509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.419511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.419515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.419517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.419522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.419528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:57.419534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:57.419539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:57.419545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:57.419569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:57.425259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:57.426187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:57.426204Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:57.426207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:57.426212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:57.426218Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1375 [2:7555895606525300327:8364]
2025-09-30T14:53:57.426235Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:57.426258Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:57.426265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:57.426268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:57.426274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:57.426290Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:57.426301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:57.426309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:57.426374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.426382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.426384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.426388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:57.426391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:57.426458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:57.426468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.426481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.426492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.426509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:57.426526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895606615051114:8400], now have 1 active actors on pipe
2025-09-30T14:53:57.426530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895606615050951:2454], now have 1 active actors on pipe
2025-09-30T14:53:57.426536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895606525300322:8364]
2025-09-30T14:53:57.426539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895606525300322:8364]
2025-09-30T14:53:57.426541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895606525300322:8364]
2025-09-30T14:53:57.426556Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:57.426569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:57.426571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:57.426575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:57.426577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:57.426584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:57.426588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:57.426620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895606525300322:8364]
2025-09-30T14:53:57.426627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:57.426633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:57.426882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1375
2025-09-30T14:53:57.426897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1375
2025-09-30T14:53:57.427048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:57.427060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:57.427089Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71f166b8-f04b4148-1dd49d8b-3801b265_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:57.427102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:57.427111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:57.427113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:57.427127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:57.427142Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:57.427162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:57.427367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:57.427382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:57.427404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:57.427514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1376 partition: 0 MaxSeqNo: 42 sessionId: src_id|71f166b8-f04b4148-1dd49d8b-3801b265_0
2025-09-30T14:53:57.427880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd86e729-133c67b1-cdc32350-b04eb0c2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|71f166b8-f04b4148-1dd49d8b-3801b265_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:57.430674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71f166b8-f04b4148-1dd49d8b-3801b265_0] Write session: try to update token
2025-09-30T14:53:57.430692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71f166b8-f04b4148-1dd49d8b-3801b265_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:57.439301Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:57.439326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:57.439336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895606525300322:8364]
2025-09-30T14:53:57.439381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:57.439383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:57.439559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:57.439726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:57.439880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:57.440018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:57.440201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:57.440234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:57.447976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1376 sessionId: src_id|71f166b8-f04b4148-1dd49d8b-3801b265_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:57.450254Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:57.450284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:57.450287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:57.450289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:57.450299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895606525300322:8364]
2025-09-30T14:53:57.450303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895606525300322:8364]
2025-09-30T14:53:57.450307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895606525300322:8364]
2025-09-30T14:53:57.450346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:57.450354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.450356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:57.450350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:57.450368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:57.450381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:57.450701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:57.450499Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:57.491322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895606615051169:2659]
2025-09-30T14:53:57.495502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1375, pipe: [1:7555895606615051169:2659]
2025-09-30T14:53:57.569921Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:57.570678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:57.570713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:57.570738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895606615051169:2659], now have 1 active actors on pipe
2025-09-30T14:53:57.570982Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:57.572082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71f166b8-f04b4148-1dd49d8b-3801b265_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:57.572096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71f166b8-f04b4148-1dd49d8b-3801b265_0] Write session will restart in 0.005703s
2025-09-30T14:53:57.572122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71f166b8-f04b4148-1dd49d8b-3801b265_0] Write session: Do CDS request
2025-09-30T14:53:57.572127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71f166b8-f04b4148-1dd49d8b-3801b265_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:57.571626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:57.571705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1376 reason: status is not ok: tablet will be restarted right now sessionId: src_id|71f166b8-f04b4148-1dd49d8b-3801b265_0
2025-09-30T14:53:57.571918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1376 sessionId: src_id|71f166b8-f04b4148-1dd49d8b-3801b265_0 is DEAD
2025-09-30T14:53:57.572080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:57.572111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895606615051169:2659]
2025-09-30T14:53:57.578884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71f166b8-f04b4148-1dd49d8b-3801b265_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:57.578907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:57.578921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1377
2025-09-30T14:53:57.579136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1377 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:57.579172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1377 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:57.579182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1377 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:57.579186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:57.579666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1377 sessionId:  describe result for acl check
2025-09-30T14:53:57.579707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:57.579711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:57.579713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:57.579719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895606615051185:8405] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:57.580265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895606615051185:8405] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:57.583023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895606615051185:8405] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:57.587256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895606615051185:8405] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:57.587274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895606615051185:8405] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:57.587278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895606615051185:8405] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:57.587286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1377 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:57.599831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:57.602953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:57.603175Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:57.603179Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:57.603190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:57.603241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:57.603299Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895606525300537:8366]
2025-09-30T14:53:57.604014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:57.604408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:57.604466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:57.604828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:57.604888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:57.604894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:57.604895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:57.604897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:57.604898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:57.604900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:57.604902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:57.604903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:57.604904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:57.604906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:57.604907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.604908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.604909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.604911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:57.604912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:57.604917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:57.604929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:57.604934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:57.604939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:57.604943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:57.604948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:57.604953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:57.604957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:57.604962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:57.604967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:57.604972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.604976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.604981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.604985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:57.604990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:57.604997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:57.605006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:57.605016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:57.605023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:57.605030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:57.605036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:57.605041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:57.605046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:57.605052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:57.605058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:57.605063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:57.605069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:57.605075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:57.605080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:57.605086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:57.605092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:57.605098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:57.605104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:57.605111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:57.605117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:57.605122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.605128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.605132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.605138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.605144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.605149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.605153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:57.605159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:57.605165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:57.605171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:57.605220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:57.610952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:57.612000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:57.612017Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:57.612020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:57.612024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:57.612031Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1376 [2:7555895606525300537:8366]
2025-09-30T14:53:57.612047Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:57.612063Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:57.612067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:57.612071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:57.612073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:57.612090Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:57.612097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:57.612104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:57.612162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.612164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.612167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.612171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:57.612174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:57.612246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:57.612249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.612262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.612276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.612297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:57.612316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895606615051173:2454], now have 1 active actors on pipe
2025-09-30T14:53:57.612320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895606615051255:8405], now have 1 active actors on pipe
2025-09-30T14:53:57.612326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895606525300532:8366]
2025-09-30T14:53:57.612329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895606525300532:8366]
2025-09-30T14:53:57.612331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895606525300532:8366]
2025-09-30T14:53:57.612344Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:57.612358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:57.612358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:57.612362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:57.612367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:57.612376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:57.612380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:57.612413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895606525300532:8366]
2025-09-30T14:53:57.612422Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:57.612466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:57.612871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:57.612885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:57.612916Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|458bab60-6af2c06e-9e058be1-cd72a4a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:57.612930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:57.612934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:57.612936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:57.612948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:57.612958Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:57.612973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:57.613342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:57.613353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:57.613370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:57.614047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71f166b8-f04b4148-1dd49d8b-3801b265_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|458bab60-6af2c06e-9e058be1-cd72a4a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:57.612580Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1376
2025-09-30T14:53:57.612623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1376
2025-09-30T14:53:57.613462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1377 partition: 0 MaxSeqNo: 42 sessionId: src_id|458bab60-6af2c06e-9e058be1-cd72a4a7_0
2025-09-30T14:53:57.616985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|458bab60-6af2c06e-9e058be1-cd72a4a7_0] Write session: try to update token
2025-09-30T14:53:57.617006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|458bab60-6af2c06e-9e058be1-cd72a4a7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:57.625467Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:57.625489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:57.625497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895606525300532:8366]
2025-09-30T14:53:57.625532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:57.625545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:57.625696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:57.625839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:57.625983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:57.626119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:57.626300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:57.626337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:57.636597Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:57.636620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:57.636623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:57.636626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:57.636637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895606525300532:8366]
2025-09-30T14:53:57.636646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895606525300532:8366]
2025-09-30T14:53:57.636656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895606525300532:8366]
2025-09-30T14:53:57.636705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:57.636710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:57.636713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.636716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:57.636717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:57.636734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:57.636862Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:57.641935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1377 sessionId: src_id|458bab60-6af2c06e-9e058be1-cd72a4a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:57.644714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:57.671314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895606615051392:2659]
2025-09-30T14:53:57.671617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1376, pipe: [1:7555895606615051392:2659]
2025-09-30T14:53:57.754115Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:57.754696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:57.754706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:57.754727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895606615051392:2659], now have 1 active actors on pipe
2025-09-30T14:53:57.754946Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:57.756171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:57.756277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1377 reason: status is not ok: tablet will be restarted right now sessionId: src_id|458bab60-6af2c06e-9e058be1-cd72a4a7_0
2025-09-30T14:53:57.756396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:57.756438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895606615051392:2659]
2025-09-30T14:53:57.756495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1377 sessionId: src_id|458bab60-6af2c06e-9e058be1-cd72a4a7_0 is DEAD
2025-09-30T14:53:57.756839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|458bab60-6af2c06e-9e058be1-cd72a4a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:57.756849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|458bab60-6af2c06e-9e058be1-cd72a4a7_0] Write session will restart in 0.008774s
2025-09-30T14:53:57.756871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|458bab60-6af2c06e-9e058be1-cd72a4a7_0] Write session: Do CDS request
2025-09-30T14:53:57.756876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|458bab60-6af2c06e-9e058be1-cd72a4a7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:57.767783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|458bab60-6af2c06e-9e058be1-cd72a4a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:57.767890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:57.767908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1378
2025-09-30T14:53:57.771495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1378 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:57.771562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1378 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:57.771573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1378 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:57.771578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:57.772240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1378 sessionId:  describe result for acl check
2025-09-30T14:53:57.772294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:57.772297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:57.772299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:57.772305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895606615051429:8409] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:57.772867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895606615051429:8409] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:57.775104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895606615051429:8409] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:57.779734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895606615051429:8409] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:57.779752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895606615051429:8409] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:57.779755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895606615051429:8409] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:57.779764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1378 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:57.784863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:57.788183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:57.788401Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:57.788414Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:57.788425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:57.788480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:57.788521Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895606525300750:8369]
2025-09-30T14:53:57.789163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:57.789566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:57.789615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:57.789965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:57.790036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:57.790043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:57.790044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:57.790045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:57.790046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:57.790047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:57.790049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:57.790050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:57.790051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:57.790052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:57.790054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.790055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.790056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.790057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:57.790058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:57.790064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:57.790074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:57.790078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:57.790082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:57.790086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:57.790090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:57.790093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:57.790097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:57.790101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:57.790105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:57.790109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.790113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.790116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.790120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:57.790124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:57.790131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:57.790139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:57.790145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:57.790151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:57.790160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:57.790165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:57.790169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:57.790175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:57.790180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:57.790186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:57.790201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:57.790205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:57.790210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:57.790215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:57.790222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:57.790226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:57.790231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:57.790235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:57.790240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:57.790248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:57.790252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.790258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.790263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.790268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.790272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.790277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.790281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:57.790286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:57.790291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:57.790296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:57.790337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:57.800631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:57.801655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:57.801673Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:57.801676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:57.801680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:57.801686Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1377 [2:7555895606525300750:8369]
2025-09-30T14:53:57.801704Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:57.801720Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:57.801723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:57.801727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:57.801729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:57.801745Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:57.801752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:57.801759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:57.801820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.801830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.801833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.801837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:57.801840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:57.801910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:57.801921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.801935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.801965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.801987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:57.802008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895606525300745:8369]
2025-09-30T14:53:57.802016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895606525300745:8369]
2025-09-30T14:53:57.802018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895606525300745:8369]
2025-09-30T14:53:57.802033Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:57.802053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:57.802075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:57.802083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:57.802120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895606525300745:8369]
2025-09-30T14:53:57.802129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:57.802217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:57.802224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:57.802227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:57.802232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:57.802503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895606615051395:2454], now have 1 active actors on pipe
2025-09-30T14:53:57.802517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895606615051550:8409], now have 1 active actors on pipe
2025-09-30T14:53:57.802523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1377
2025-09-30T14:53:57.802567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1377
2025-09-30T14:53:57.802780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:57.802792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:57.802818Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40e379c5-b47f0a53-58c88778-a3b4230f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:57.802831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:57.802837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:57.802840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:57.802850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:57.802861Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:57.802876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:57.803182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:57.803191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:57.803203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:57.803684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|458bab60-6af2c06e-9e058be1-cd72a4a7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|40e379c5-b47f0a53-58c88778-a3b4230f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:57.803320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1378 partition: 0 MaxSeqNo: 42 sessionId: src_id|40e379c5-b47f0a53-58c88778-a3b4230f_0
2025-09-30T14:53:57.806601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40e379c5-b47f0a53-58c88778-a3b4230f_0] Write session: try to update token
2025-09-30T14:53:57.806624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40e379c5-b47f0a53-58c88778-a3b4230f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:57.816184Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:57.816211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:57.816215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:57.816218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:57.816227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895606525300745:8369]
2025-09-30T14:53:57.816232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895606525300745:8369]
2025-09-30T14:53:57.816236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895606525300745:8369]
2025-09-30T14:53:57.816279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:57.816286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.816289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:57.816435Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:57.818398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:57.818420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:57.818425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:57.825493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1378 sessionId: src_id|40e379c5-b47f0a53-58c88778-a3b4230f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:57.828272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:57.855915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895606615051615:2659]
2025-09-30T14:53:57.856324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1377, pipe: [1:7555895606615051615:2659]
2025-09-30T14:53:57.933341Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:57.933661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:57.933671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:57.933713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895606615051615:2659], now have 1 active actors on pipe
2025-09-30T14:53:57.933988Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:57.934109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895606615051615:2659]
2025-09-30T14:53:57.934364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:57.934466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1378 reason: status is not ok: tablet will be restarted right now sessionId: src_id|40e379c5-b47f0a53-58c88778-a3b4230f_0
2025-09-30T14:53:57.934521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:57.934849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40e379c5-b47f0a53-58c88778-a3b4230f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:57.934860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40e379c5-b47f0a53-58c88778-a3b4230f_0] Write session will restart in 0.008673s
2025-09-30T14:53:57.934888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40e379c5-b47f0a53-58c88778-a3b4230f_0] Write session: Do CDS request
2025-09-30T14:53:57.934896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40e379c5-b47f0a53-58c88778-a3b4230f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:57.934691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1378 sessionId: src_id|40e379c5-b47f0a53-58c88778-a3b4230f_0 is DEAD
2025-09-30T14:53:57.944825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40e379c5-b47f0a53-58c88778-a3b4230f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:57.945299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:57.945317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1379
2025-09-30T14:53:57.945972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1379 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:57.946025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1379 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:57.946030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1379 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:57.946035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:57.946846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1379 sessionId:  describe result for acl check
2025-09-30T14:53:57.946905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:57.946906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:57.946908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:57.946914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895606615051629:8413] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:57.947526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895606615051629:8413] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:57.949797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895606615051629:8413] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:57.959996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895606615051629:8413] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:57.960017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895606615051629:8413] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:57.960021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895606615051629:8413] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:57.960030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1379 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:57.971857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:57.977713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:57.977973Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:57.977985Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:57.977998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:57.978066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:57.978115Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895606525300962:8371]
2025-09-30T14:53:57.978804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:57.979105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:57.979156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:57.979492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:57.979566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:57.979567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:57.979568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:57.979570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:57.979571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:57.979573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:57.979574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:57.979575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:57.979577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:57.979578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:57.979579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.979580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.979582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.979583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:57.979584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:57.979590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:57.979601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:57.979605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:57.979609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:57.979613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:57.979617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:57.979621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:57.979625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:57.979629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:57.979633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:57.979637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.979641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.979644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.979648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:57.979652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:57.979659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:57.979666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:57.979672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:57.979677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:57.979682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:57.979687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:57.979692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:57.979697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:57.979702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:57.979707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:57.979711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:57.979716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:57.979723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:57.979728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:57.979732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:57.979737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:57.979741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:57.979746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:57.979750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:57.979755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:57.979763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.979769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.979774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.979780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.979784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.979788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.979793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:57.979798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:57.979802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:57.979807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:57.979852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:57.987510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1378
2025-09-30T14:53:57.987510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1378
2025-09-30T14:53:57.986019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:57.987011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:57.987018Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:57.987022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:57.987026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:57.987034Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1378 [2:7555895606525300962:8371]
2025-09-30T14:53:57.987051Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:57.987067Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:57.987070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:57.987073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:57.987076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:57.987092Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:57.987099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:57.987105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:57.987167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.987169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.987171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.987175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:57.987177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:57.987264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:57.987267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:57.987280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:57.987293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:57.987312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:57.987328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895606525300957:8371]
2025-09-30T14:53:57.987331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895606525300957:8371]
2025-09-30T14:53:57.987335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895606525300957:8371]
2025-09-30T14:53:57.987346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:57.987361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:57.987361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:57.987366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:57.987369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:57.987375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:57.987379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:57.987693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895606615051616:2454], now have 1 active actors on pipe
2025-09-30T14:53:57.987696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895606615051706:8413], now have 1 active actors on pipe
2025-09-30T14:53:57.987700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895606525300957:8371]
2025-09-30T14:53:57.987712Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:57.987727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:57.987749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:57.987754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:57.987790Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1fd45b3-cc1e5ecd-7e84a907-4523155f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:57.987797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:57.987800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:57.987802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:57.987811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:57.987823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:57.987839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:57.988157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:57.988169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:57.988328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1379 partition: 0 MaxSeqNo: 42 sessionId: src_id|c1fd45b3-cc1e5ecd-7e84a907-4523155f_0
2025-09-30T14:53:57.988199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:57.988698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40e379c5-b47f0a53-58c88778-a3b4230f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c1fd45b3-cc1e5ecd-7e84a907-4523155f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:57.991432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fd45b3-cc1e5ecd-7e84a907-4523155f_0] Write session: try to update token
2025-09-30T14:53:57.991450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fd45b3-cc1e5ecd-7e84a907-4523155f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:58.007187Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:58.007213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:58.007215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:58.007217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:58.007226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895606525300957:8371]
2025-09-30T14:53:58.007232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895606525300957:8371]
2025-09-30T14:53:58.007236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895606525300957:8371]
2025-09-30T14:53:58.007294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:58.007301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.007304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:58.007302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:58.007311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:58.007316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:58.008048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1379 sessionId: src_id|c1fd45b3-cc1e5ecd-7e84a907-4523155f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:58.011350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:58.007466Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:58.034089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895610910019147:2659]
2025-09-30T14:53:58.039883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1378, pipe: [1:7555895610910019147:2659]
2025-09-30T14:53:58.126116Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:58.126581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:58.126592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:58.126632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895610910019147:2659], now have 1 active actors on pipe
2025-09-30T14:53:58.128357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fd45b3-cc1e5ecd-7e84a907-4523155f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:58.128368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fd45b3-cc1e5ecd-7e84a907-4523155f_0] Write session will restart in 0.005161s
2025-09-30T14:53:58.128386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fd45b3-cc1e5ecd-7e84a907-4523155f_0] Write session: Do CDS request
2025-09-30T14:53:58.128390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fd45b3-cc1e5ecd-7e84a907-4523155f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:58.126978Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:58.127915Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:58.127968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:58.128036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1379 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c1fd45b3-cc1e5ecd-7e84a907-4523155f_0
2025-09-30T14:53:58.128232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1379 sessionId: src_id|c1fd45b3-cc1e5ecd-7e84a907-4523155f_0 is DEAD
2025-09-30T14:53:58.128357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895610910019147:2659]
2025-09-30T14:53:58.135713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fd45b3-cc1e5ecd-7e84a907-4523155f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:58.136919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:58.136937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1380
2025-09-30T14:53:58.137116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1380 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:58.137148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1380 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:58.137156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1380 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:58.137161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:58.137674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1380 sessionId:  describe result for acl check
2025-09-30T14:53:58.137725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:58.137728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:58.137730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:58.137736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895610910019177:8427] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:58.138409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895610910019177:8427] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:58.145340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895610910019177:8427] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:58.154984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895610910019177:8427] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:58.155004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895610910019177:8427] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:58.155007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895610910019177:8427] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:58.155016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1380 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:58.166327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:58.169619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:58.169825Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:58.169837Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:58.169847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:58.169901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:58.169959Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895610820268507:8385]
2025-09-30T14:53:58.170605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:58.170987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:58.171040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:58.171417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:58.171490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:58.171491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:58.171492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:58.171494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:58.171495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:58.171496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:58.171497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:58.171499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:58.171500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:58.171502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:58.171503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.171504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:58.171506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:58.171507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:58.171508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:58.171514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:58.171524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:58.171528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:58.171532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:58.171536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:58.171541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:58.171545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:58.171549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:58.171555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:58.171560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:58.171564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.171568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:58.171572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:58.171576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:58.171580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:58.171588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:58.171596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:58.171603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:58.171608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:58.171613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:58.171618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:58.171622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:58.171627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:58.171633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:58.171638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:58.171642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:58.171647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:58.171652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:58.171657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:58.171662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:58.171668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:58.171673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:58.171678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:58.171682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:58.171688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:58.171693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.171698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.171703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:58.171708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:58.171715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:58.171720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:58.171724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:58.171729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:58.171733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:58.171738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:58.171784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:58.178961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:58.180004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:58.180025Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:58.180028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:58.180032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:58.180040Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1379 [2:7555895610820268507:8385]
2025-09-30T14:53:58.180058Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:58.180076Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:58.180080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:58.180084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:58.180086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:58.180102Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:58.180116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:58.180123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:58.180195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.180203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:58.180209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:58.180213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:58.180215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:58.180290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:58.180298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.180312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:58.180326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:58.180349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:58.180371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895610820268502:8385]
2025-09-30T14:53:58.180378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895610820268502:8385]
2025-09-30T14:53:58.180380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895610820268502:8385]
2025-09-30T14:53:58.180394Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:58.180414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:58.180438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:58.180445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:58.180481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895610820268502:8385]
2025-09-30T14:53:58.180488Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:58.180880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:58.180892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:58.180895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:58.180900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:58.181540Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1379
2025-09-30T14:53:58.181555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1379
2025-09-30T14:53:58.181199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895610910019169:2454], now have 1 active actors on pipe
2025-09-30T14:53:58.181209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895610910019264:8427], now have 1 active actors on pipe
2025-09-30T14:53:58.181883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:58.181896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:58.181927Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|683a52c8-b948830e-e0abcbad-fbeef952_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:58.181939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:58.181952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:58.181955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:58.181966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:58.181979Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:58.181997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:58.186753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:58.186772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:58.186799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:58.186979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1380 partition: 0 MaxSeqNo: 42 sessionId: src_id|683a52c8-b948830e-e0abcbad-fbeef952_0
2025-09-30T14:53:58.187406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fd45b3-cc1e5ecd-7e84a907-4523155f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|683a52c8-b948830e-e0abcbad-fbeef952_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:58.190116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|683a52c8-b948830e-e0abcbad-fbeef952_0] Write session: try to update token
2025-09-30T14:53:58.190139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|683a52c8-b948830e-e0abcbad-fbeef952_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:58.206400Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:58.206424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:58.206427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:58.206430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:58.206440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895610820268502:8385]
2025-09-30T14:53:58.206444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895610820268502:8385]
2025-09-30T14:53:58.206450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895610820268502:8385]
2025-09-30T14:53:58.206501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:58.206508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.206511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:58.206658Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:58.209876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:58.209895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:58.209900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:58.210669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1380 sessionId: src_id|683a52c8-b948830e-e0abcbad-fbeef952_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:58.213330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:58.233649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895610910019391:2659]
2025-09-30T14:53:58.234096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1379, pipe: [1:7555895610910019391:2659]
2025-09-30T14:53:58.331812Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:58.332204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:58.332214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:58.332252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895610910019391:2659], now have 1 active actors on pipe
2025-09-30T14:53:58.332514Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:58.334924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895610910019391:2659]
2025-09-30T14:53:58.334965Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:58.335005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:58.335095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1380 reason: status is not ok: tablet will be restarted right now sessionId: src_id|683a52c8-b948830e-e0abcbad-fbeef952_0
2025-09-30T14:53:58.335337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1380 sessionId: src_id|683a52c8-b948830e-e0abcbad-fbeef952_0 is DEAD
2025-09-30T14:53:58.335567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|683a52c8-b948830e-e0abcbad-fbeef952_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:58.335579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|683a52c8-b948830e-e0abcbad-fbeef952_0] Write session will restart in 0.007343s
2025-09-30T14:53:58.335604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|683a52c8-b948830e-e0abcbad-fbeef952_0] Write session: Do CDS request
2025-09-30T14:53:58.335611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|683a52c8-b948830e-e0abcbad-fbeef952_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:58.346227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|683a52c8-b948830e-e0abcbad-fbeef952_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:58.346339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:58.346360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1381
2025-09-30T14:53:58.346478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1381 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:58.346512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1381 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:58.346522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1381 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:58.346527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:58.347102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1381 sessionId:  describe result for acl check
2025-09-30T14:53:58.347140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:58.347156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:58.347163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:58.347169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895610910019473:8432] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:58.347784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895610910019473:8432] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:58.350316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895610910019473:8432] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:58.354193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895610910019473:8432] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:58.354210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895610910019473:8432] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:58.354213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895610910019473:8432] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:58.354222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1381 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:58.354684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:58.358678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:58.359149Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:58.359176Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:58.359196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:58.359385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:58.359482Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895610820268736:8389]
2025-09-30T14:53:58.360118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:58.360620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:58.360673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:58.361044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:58.361127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:58.361133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:58.361134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:58.361135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:58.361136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:58.361137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:58.361138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:58.361140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:58.361141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:58.361142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:58.361143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.361144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:58.361146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:58.361147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:58.361148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:58.361154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:58.361165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:58.361169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:58.361174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:58.361178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:58.361182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:58.361186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:58.361190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:58.361194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:58.361198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:58.361202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.361206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:58.361210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:58.361214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:58.361218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:58.361227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:58.361235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:58.361242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:58.361248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:58.361253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:58.361258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:58.361263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:58.361268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:58.361273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:58.361278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:58.361283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:58.361288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:58.361296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:58.361302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:58.361307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:58.361313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:58.361319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:58.361324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:58.361335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:58.361340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:58.361344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.361350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.361354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:58.361365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:58.361380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:58.361390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:58.361393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:58.361398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:58.361407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:58.361412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:58.361452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:58.367900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:58.369045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:58.369064Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:58.369067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:58.369071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:58.369079Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1380 [2:7555895610820268736:8389]
2025-09-30T14:53:58.369098Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:58.369113Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:58.369116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:58.369119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:58.369121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:58.369138Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:58.369144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:58.369153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:58.369214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.369227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:58.369229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:58.369233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:58.369235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:58.369301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:58.369312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.369325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:58.369338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:58.369362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:58.369385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895610910019405:2454], now have 1 active actors on pipe
2025-09-30T14:53:58.369394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895610910019615:8432], now have 1 active actors on pipe
2025-09-30T14:53:58.369400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895610820268731:8389]
2025-09-30T14:53:58.369402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895610820268731:8389]
2025-09-30T14:53:58.369405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895610820268731:8389]
2025-09-30T14:53:58.369417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:58.369435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:58.369441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:58.369446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:58.369448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:58.369451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:58.369453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:58.369457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1380
2025-09-30T14:53:58.369457Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1380
2025-09-30T14:53:58.369488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895610820268731:8389]
2025-09-30T14:53:58.369504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:58.369532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:58.369878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:58.369892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:58.369923Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4b62af-c7329344-ccda962e-f43af802_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:58.369932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:58.369936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:58.369938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:58.369961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:58.369972Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:58.370008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:58.370254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:58.370264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:58.370284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:58.370401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1381 partition: 0 MaxSeqNo: 42 sessionId: src_id|f4b62af-c7329344-ccda962e-f43af802_0
2025-09-30T14:53:58.370825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|683a52c8-b948830e-e0abcbad-fbeef952_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f4b62af-c7329344-ccda962e-f43af802_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:58.373546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4b62af-c7329344-ccda962e-f43af802_0] Write session: try to update token
2025-09-30T14:53:58.373565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4b62af-c7329344-ccda962e-f43af802_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:58.383830Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:58.383857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:58.383867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895610820268731:8389]
2025-09-30T14:53:58.383918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:58.384101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:58.384255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:58.384392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:58.384528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:58.384718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:58.384753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:58.384998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:58.394649Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:58.394670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:58.394672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:58.394675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:58.394687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895610820268731:8389]
2025-09-30T14:53:58.394691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895610820268731:8389]
2025-09-30T14:53:58.394696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895610820268731:8389]
2025-09-30T14:53:58.394741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:58.394748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:58.394753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.394755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:58.394757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:58.394759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:58.394896Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:58.397753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1381 sessionId: src_id|f4b62af-c7329344-ccda962e-f43af802_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:58.400507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:58.441888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895610910019628:2659]
2025-09-30T14:53:58.442279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1380, pipe: [1:7555895610910019628:2659]
2025-09-30T14:53:58.539218Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:58.539633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:58.539653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:58.539677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895610910019628:2659], now have 1 active actors on pipe
2025-09-30T14:53:58.543547Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:58.543515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:58.543589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895610910019628:2659]
2025-09-30T14:53:58.543611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:58.543614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:58.543689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1381 reason: error at write: Disconnected sessionId: src_id|f4b62af-c7329344-ccda962e-f43af802_0
2025-09-30T14:53:58.543876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1381 sessionId: src_id|f4b62af-c7329344-ccda962e-f43af802_0 is DEAD
2025-09-30T14:53:58.547340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4b62af-c7329344-ccda962e-f43af802_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:58.547355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4b62af-c7329344-ccda962e-f43af802_0] Write session will restart in 0.005708s
2025-09-30T14:53:58.547381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4b62af-c7329344-ccda962e-f43af802_0] Write session: Do CDS request
2025-09-30T14:53:58.547389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4b62af-c7329344-ccda962e-f43af802_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:58.555731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4b62af-c7329344-ccda962e-f43af802_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:58.555872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:58.555888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1382
2025-09-30T14:53:58.556212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1382 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:58.556250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1382 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:58.556256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1382 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:58.556260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:58.556708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1382 sessionId:  describe result for acl check
2025-09-30T14:53:58.556738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:58.556740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:58.556743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:58.556750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895610910019648:8437] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:58.557353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895610910019648:8437] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:58.560144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895610910019648:8437] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:58.566191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895610910019648:8437] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:58.566212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895610910019648:8437] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:58.566218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895610910019648:8437] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:58.566227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1382 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:58.571615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:58.574529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:58.574800Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:58.574811Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:58.574822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:58.574880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:58.574931Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895610820268952:8391]
2025-09-30T14:53:58.575658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:58.576052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:58.576131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:58.576513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:58.576582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:58.576583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:58.576585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:58.576586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:58.576588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:58.576590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:58.576591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:58.576593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:58.576594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:58.576596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:58.576597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.576599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:58.576600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:58.576602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:58.576604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:58.576610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:58.576621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:58.576625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:58.576629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:58.576634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:58.576638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:58.576642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:58.576646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:58.576650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:58.576655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:58.576659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.576662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:58.576666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:58.576670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:58.576675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:58.576684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:58.576693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:58.576699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:58.576706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:58.576711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:58.576717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:58.576722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:58.576727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:58.576735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:58.576740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:58.576745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:58.576751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:58.576756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:58.576762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:58.576766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:58.576772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:58.576778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:58.576783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:58.576789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:58.576794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:58.576800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.576806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.576810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:58.576816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:58.576821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:58.576826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:58.576830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:58.576836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:58.576841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:58.576846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:58.576889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:58.583311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:58.584588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:58.584605Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:58.584608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:58.584612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:58.584619Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1381 [2:7555895610820268952:8391]
2025-09-30T14:53:58.584636Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:58.584651Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:58.584662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:58.584665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:58.584667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:58.584683Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:58.584690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:58.584698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:58.584761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.584771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:58.584773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:58.584777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:58.584779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:58.584847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:58.584850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.584866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:58.584878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:58.584896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:58.584914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895610910019788:8437], now have 1 active actors on pipe
2025-09-30T14:53:58.584918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895610910019633:2454], now have 1 active actors on pipe
2025-09-30T14:53:58.584924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895610820268947:8391]
2025-09-30T14:53:58.584926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895610820268947:8391]
2025-09-30T14:53:58.584928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895610820268947:8391]
2025-09-30T14:53:58.584938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:58.584951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:58.584965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:58.584968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:58.585006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895610820268947:8391]
2025-09-30T14:53:58.585008Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:58.585027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:58.585030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:58.585032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:58.585038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:58.585170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:58.585180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:58.585208Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70dfe35c-7f1eb3a3-3b6bf32f-d8de7ea5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:58.585214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:58.585218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:58.585220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:58.585230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:58.585240Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:58.585254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:58.585583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:58.585612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:58.585633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:58.585006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1381
2025-09-30T14:53:58.585051Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1381
2025-09-30T14:53:58.587333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1382 partition: 0 MaxSeqNo: 42 sessionId: src_id|70dfe35c-7f1eb3a3-3b6bf32f-d8de7ea5_0
2025-09-30T14:53:58.588170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4b62af-c7329344-ccda962e-f43af802_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|70dfe35c-7f1eb3a3-3b6bf32f-d8de7ea5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:58.591201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70dfe35c-7f1eb3a3-3b6bf32f-d8de7ea5_0] Write session: try to update token
2025-09-30T14:53:58.591220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70dfe35c-7f1eb3a3-3b6bf32f-d8de7ea5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:58.599559Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:58.599583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:58.599593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895610820268947:8391]
2025-09-30T14:53:58.599635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:58.599640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:58.599808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:58.599958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:58.600108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:58.600251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:58.600445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:58.600485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:58.610758Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:58.610784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:58.610786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:58.610789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:58.610800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895610820268947:8391]
2025-09-30T14:53:58.610804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895610820268947:8391]
2025-09-30T14:53:58.610808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895610820268947:8391]
2025-09-30T14:53:58.610847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:58.610859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.610857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:58.610862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:58.610864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:58.610868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:58.610998Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:58.611058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1382 sessionId: src_id|70dfe35c-7f1eb3a3-3b6bf32f-d8de7ea5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:58.613924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:58.647450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895610910019855:2659]
2025-09-30T14:53:58.647854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1381, pipe: [1:7555895610910019855:2659]
2025-09-30T14:53:58.730558Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:58.731177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:58.731192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:58.731213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895610910019855:2659], now have 1 active actors on pipe
2025-09-30T14:53:58.731450Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:58.732282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70dfe35c-7f1eb3a3-3b6bf32f-d8de7ea5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:53:58.732294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70dfe35c-7f1eb3a3-3b6bf32f-d8de7ea5_0] Write session will restart in 0.008413s
2025-09-30T14:53:58.732318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70dfe35c-7f1eb3a3-3b6bf32f-d8de7ea5_0] Write session: Do CDS request
2025-09-30T14:53:58.732325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70dfe35c-7f1eb3a3-3b6bf32f-d8de7ea5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:58.731779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:58.731895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1382 reason: status is not ok: tablet will be restarted right now sessionId: src_id|70dfe35c-7f1eb3a3-3b6bf32f-d8de7ea5_0
2025-09-30T14:53:58.732118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1382 sessionId: src_id|70dfe35c-7f1eb3a3-3b6bf32f-d8de7ea5_0 is DEAD
2025-09-30T14:53:58.732307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895610910019855:2659]
2025-09-30T14:53:58.732321Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:58.741844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70dfe35c-7f1eb3a3-3b6bf32f-d8de7ea5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:58.741961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:58.741988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1383
2025-09-30T14:53:58.742126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1383 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:58.742176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1383 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:58.742186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1383 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:58.742192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:58.742719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1383 sessionId:  describe result for acl check
2025-09-30T14:53:58.742755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:58.742757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:58.742759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:58.742765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895610910019873:8441] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:58.743326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895610910019873:8441] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:58.747159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895610910019873:8441] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:58.751225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895610910019873:8441] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:58.751264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895610910019873:8441] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:58.751268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895610910019873:8441] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:58.751277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1383 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:58.763515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:58.766698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:58.766942Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:58.766954Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:58.766966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:58.767024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:58.767067Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895610820269171:8394]
2025-09-30T14:53:58.767795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:58.768169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:58.768235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:58.768647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:58.768726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:58.768733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:58.768734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:58.768736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:58.768737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:58.768738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:58.768740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:58.768741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:58.768743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:58.768744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:58.768746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.768747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:58.768749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:58.768750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:58.768751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:58.768758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:58.768770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:58.768775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:58.768780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:58.768785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:58.768790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:58.768795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:58.768800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:58.768805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:58.768810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:58.768814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.768819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:58.768824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:58.768828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:58.768833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:58.768844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:58.768852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:58.768859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:58.768866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:58.768871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:58.768883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:58.768888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:58.768894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:58.768899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:58.768904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:58.768909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:58.768915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:58.768925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:58.768931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:58.768940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:58.768948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:58.768958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:58.768964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:58.768973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:58.768980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:58.768985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.768991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.768996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:58.769002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:58.769008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:58.769014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:58.769025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:58.769031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:58.769036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:58.769042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:58.769092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:58.774900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:58.775801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:58.775822Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:58.775826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:58.775830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:58.775837Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1382 [2:7555895610820269171:8394]
2025-09-30T14:53:58.775856Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:58.775872Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:58.775876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:58.775891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:58.775899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:58.775916Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:58.775929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:58.775941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:58.776007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.776016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:58.776018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:58.776022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:58.776024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:58.776102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:58.776111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.776125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:58.776137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:58.776159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:58.776180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895610820269166:8394]
2025-09-30T14:53:58.776187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895610820269166:8394]
2025-09-30T14:53:58.776189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895610820269166:8394]
2025-09-30T14:53:58.776203Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:58.776216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:58.776239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:58.776243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:58.776261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:58.776276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:58.776276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895610820269166:8394]
2025-09-30T14:53:58.776278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:58.776279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:58.776284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:58.776396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895610910019858:2454], now have 1 active actors on pipe
2025-09-30T14:53:58.776410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895610910019938:8441], now have 1 active actors on pipe
2025-09-30T14:53:58.776497Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1382
2025-09-30T14:53:58.776552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1382
2025-09-30T14:53:58.776809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:58.776821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:58.776848Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|225afeba-48eaf553-401e6d1e-385fcde3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:58.776861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:58.776871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:58.776873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:58.776888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:58.776905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:58.776925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:58.777174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:58.777188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:58.777210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:58.777316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1383 partition: 0 MaxSeqNo: 42 sessionId: src_id|225afeba-48eaf553-401e6d1e-385fcde3_0
2025-09-30T14:53:58.777720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70dfe35c-7f1eb3a3-3b6bf32f-d8de7ea5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|225afeba-48eaf553-401e6d1e-385fcde3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:58.780548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|225afeba-48eaf553-401e6d1e-385fcde3_0] Write session: try to update token
2025-09-30T14:53:58.780567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|225afeba-48eaf553-401e6d1e-385fcde3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:58.789075Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:58.789102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:58.789112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895610820269166:8394]
2025-09-30T14:53:58.789156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:58.789168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:58.789363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:58.789528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:58.789683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:58.789834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:58.790044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:58.790087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:58.801833Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1383 sessionId: src_id|225afeba-48eaf553-401e6d1e-385fcde3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:58.804715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:58.805017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:58.805047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:58.805067Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:58.805071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:58.805073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:58.805075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:58.805083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895610820269166:8394]
2025-09-30T14:53:58.805087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895610820269166:8394]
2025-09-30T14:53:58.805090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895610820269166:8394]
2025-09-30T14:53:58.805140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:58.805152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.805155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:58.805290Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:58.807302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:58.807322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:58.807327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:58.832504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895610910020082:2659]
2025-09-30T14:53:58.832951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1382, pipe: [1:7555895610910020082:2659]
2025-09-30T14:53:58.934425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:58.934521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:58.934524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:58.934588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1383 reason: error at write: Disconnected sessionId: src_id|225afeba-48eaf553-401e6d1e-385fcde3_0
2025-09-30T14:53:58.934723Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:58.934727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1383 sessionId: src_id|225afeba-48eaf553-401e6d1e-385fcde3_0 is DEAD
2025-09-30T14:53:58.934761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895610910020082:2659]
2025-09-30T14:53:58.935112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|225afeba-48eaf553-401e6d1e-385fcde3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:58.935122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|225afeba-48eaf553-401e6d1e-385fcde3_0] Write session will restart in 0.008651s
2025-09-30T14:53:58.935145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|225afeba-48eaf553-401e6d1e-385fcde3_0] Write session: Do CDS request
2025-09-30T14:53:58.935151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|225afeba-48eaf553-401e6d1e-385fcde3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:58.933399Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:58.933881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:58.933906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895610910020082:2659], now have 1 active actors on pipe
2025-09-30T14:53:58.944740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|225afeba-48eaf553-401e6d1e-385fcde3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:58.944807Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:58.944828Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1384
2025-09-30T14:53:58.945020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1384 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:58.945058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1384 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:58.945068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1384 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:58.945073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:58.945982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1384 sessionId:  describe result for acl check
2025-09-30T14:53:58.946025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:58.946027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:58.946029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:58.946036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895610910020110:8445] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:58.946620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895610910020110:8445] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:58.949913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895610910020110:8445] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:58.956366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895610910020110:8445] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:58.956388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895610910020110:8445] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:58.956391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895610910020110:8445] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:58.956400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1384 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:58.959543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:58.966892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:58.967134Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:58.967146Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:58.967168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:58.967232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:58.967290Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895610820269388:8396]
2025-09-30T14:53:58.968015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:58.968462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:58.968528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:58.969178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:58.969287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:58.969293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:58.969295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:58.969296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:58.969298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:58.969299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:58.969300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:58.969302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:58.969303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:58.969305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:58.969306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.969307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:58.969309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:58.969310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:58.969311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:58.969317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:58.969329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:58.969334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:58.969339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:58.969344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:58.969349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:58.969354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:58.969358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:58.969363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:58.969369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:58.969374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.969379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:58.969383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:58.969388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:58.969392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:58.969402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:58.969410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:58.969417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:58.969423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:58.969429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:58.969435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:58.969440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:58.969447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:58.969468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:58.969480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:58.969486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:58.969497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:58.969503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:58.969508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:58.969516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:58.969524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:58.969534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:58.969540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:58.969550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:58.969555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:58.969561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.969567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.969572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:58.969578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:58.969583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:58.969589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:58.969594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:58.969600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:58.969611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:58.969616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:58.969665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:58.980680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:58.981861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:58.981880Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:58.981883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:58.981886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:58.981894Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1383 [2:7555895610820269388:8396]
2025-09-30T14:53:58.981911Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:58.981932Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:58.981955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:58.981959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:58.981961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:58.981975Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:58.981985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:58.981992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:58.982056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.982064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:58.982066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:58.982071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:58.982074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:58.982140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:58.982148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:58.982161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:58.982180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:58.982203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:58.982223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895610820269383:8396]
2025-09-30T14:53:58.982231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895610820269383:8396]
2025-09-30T14:53:58.982234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895610820269383:8396]
2025-09-30T14:53:58.982243Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:58.982253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:58.982256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:58.982257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:58.982259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:58.982274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:58.982282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:58.982291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895610910020264:8445], now have 1 active actors on pipe
2025-09-30T14:53:58.982300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895610910020085:2454], now have 1 active actors on pipe
2025-09-30T14:53:58.982333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895610820269383:8396]
2025-09-30T14:53:58.982349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:58.982395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:58.982781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1383
2025-09-30T14:53:58.982819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1383
2025-09-30T14:53:58.982985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:58.982999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:58.983027Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e122e6fb-9f8a7407-1d25d7cb-afdcf599_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:58.983040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:58.983049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:58.983051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:58.983061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:58.983071Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:58.983092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:58.983603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:58.983612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:58.983627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:58.984038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1384 partition: 0 MaxSeqNo: 42 sessionId: src_id|e122e6fb-9f8a7407-1d25d7cb-afdcf599_0
2025-09-30T14:53:58.984420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|225afeba-48eaf553-401e6d1e-385fcde3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e122e6fb-9f8a7407-1d25d7cb-afdcf599_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:58.987367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e122e6fb-9f8a7407-1d25d7cb-afdcf599_0] Write session: try to update token
2025-09-30T14:53:58.987390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e122e6fb-9f8a7407-1d25d7cb-afdcf599_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:59.003767Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:53:59.003791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:59.003801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895610820269383:8396]
2025-09-30T14:53:59.003858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:53:59.003857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:53:59.004030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:53:59.004174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:59.004316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:59.004453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:53:59.004646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:53:59.004680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:53:59.010045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1384 sessionId: src_id|e122e6fb-9f8a7407-1d25d7cb-afdcf599_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:59.012839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:59.015129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:59.015158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:59.015194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:59.016099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:59.018418Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:59.018438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:59.018440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:59.018442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:59.018452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895610820269383:8396]
2025-09-30T14:53:59.018456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895610820269383:8396]
2025-09-30T14:53:59.018460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895610820269383:8396]
2025-09-30T14:53:59.018504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:59.018509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:59.018515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:59.018516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:59.018518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:59.018520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:59.018657Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:59.034585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895615204987607:2659]
2025-09-30T14:53:59.039347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1383, pipe: [1:7555895615204987607:2659]
2025-09-30T14:53:59.147499Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:59.147853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895615204987607:2659], now have 1 active actors on pipe
2025-09-30T14:53:59.156385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:59.156408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:59.156580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:59.156637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:59.156700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:59.156761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:59.156805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:59.156809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:59.156880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:59.156938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:59.156996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:59.157064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:59.157105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:59.157108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:59.157180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:59.157243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:59.157302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:59.157364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:59.157723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:59.157730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:59.157810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:59.157875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:59.157956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:59.158026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:59.158139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:59.158142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:59.158216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:59.158277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:59.158338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:59.158403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:59.158444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:59.158447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:59.158521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:59.158582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:59.158646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:59.158711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:59.158760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:59.158763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:59.158835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:59.158894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:59.158960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:59.159024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:59.159064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:59.159067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:59.159138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:59.159197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:59.159495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:59.159564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:59.159609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:59.159612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:59.159684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:59.159743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:59.159810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:59.159881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:59.159924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:59.159929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:59.159999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:59.160056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:59.160120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:59.160192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:59.160235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:59.160238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:59.161386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:59.161403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:59.161431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1384 reason: error at write: Disconnected sessionId: src_id|e122e6fb-9f8a7407-1d25d7cb-afdcf599_0
2025-09-30T14:53:59.161520Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:59.161557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895615204987607:2659]
2025-09-30T14:53:59.161610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1384 sessionId: src_id|e122e6fb-9f8a7407-1d25d7cb-afdcf599_0 is DEAD
2025-09-30T14:53:59.162103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e122e6fb-9f8a7407-1d25d7cb-afdcf599_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:59.162114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e122e6fb-9f8a7407-1d25d7cb-afdcf599_0] Write session will restart in 0.007284s
2025-09-30T14:53:59.162137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e122e6fb-9f8a7407-1d25d7cb-afdcf599_0] Write session: Do CDS request
2025-09-30T14:53:59.162143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e122e6fb-9f8a7407-1d25d7cb-afdcf599_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:59.161962Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:59.175851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e122e6fb-9f8a7407-1d25d7cb-afdcf599_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:59.175957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:59.175975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1385
2025-09-30T14:53:59.176118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1385 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:59.176150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1385 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:59.176156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1385 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:59.176160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:59.176597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1385 sessionId:  describe result for acl check
2025-09-30T14:53:59.176630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:59.176633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:59.176635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:59.176640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895615204987664:8457] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:59.177187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895615204987664:8457] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:59.181412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895615204987664:8457] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:59.189791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895615204987664:8457] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:59.189823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895615204987664:8457] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:59.189827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895615204987664:8457] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:59.189835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1385 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:59.189900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:59.192707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:59.192932Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:59.192937Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:59.192952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:59.193029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:59.193082Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895615115236941:8410]
2025-09-30T14:53:59.193847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:59.194522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:59.194583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:59.195020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:59.195109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:59.195110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:59.195112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:59.195114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:59.195115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:59.195117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:59.195118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:59.195120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:59.195122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:59.195123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:59.195124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:59.195126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:59.195127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:59.195128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:59.195130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:59.195136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:59.195148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:59.195153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:59.195157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:59.195161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:59.195166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:59.195170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:59.195174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:59.195179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:59.195184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:59.195188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:59.195193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:59.195197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:59.195202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:59.195206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:59.195217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:59.195227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:59.195236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:59.195268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:59.195276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:59.195282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:59.195289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:59.195296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:59.195301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:59.195306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:59.195312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:59.195317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:59.195326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:59.195331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:59.195335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:59.195340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:59.195345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:59.195350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:59.195354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:59.195359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:59.195365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:59.195370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:59.195377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:59.195383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:59.195388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:59.195394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:59.195399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:59.195405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:59.195411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:59.195417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:59.195463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:59.208358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:59.209269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:59.209275Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:59.209278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:59.209282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:59.209290Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1384 [2:7555895615115236941:8410]
2025-09-30T14:53:59.209307Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:59.209325Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:59.209328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:59.209332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:59.209335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:59.209353Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:59.209359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:59.209366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:59.209431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:59.209434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:59.209437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:59.209441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:59.209444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:59.209776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:59.209780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:59.209795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:59.209808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:59.209829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:59.209846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895615115236933:8410]
2025-09-30T14:53:59.209850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895615115236933:8410]
2025-09-30T14:53:59.209852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895615115236933:8410]
2025-09-30T14:53:59.209867Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:59.209884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:59.209901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:59.209904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:59.209952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895615115236933:8410]
2025-09-30T14:53:59.209954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:59.210504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1384
2025-09-30T14:53:59.210512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1384
2025-09-30T14:53:59.210185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:59.210190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:59.210192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:59.210198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:59.211775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895615204987853:8457], now have 1 active actors on pipe
2025-09-30T14:53:59.211789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895615204987642:2454], now have 1 active actors on pipe
2025-09-30T14:53:59.211806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:59.211813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:59.211845Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7deaba3-e8cee5ba-4cd67464-2a4e888c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:59.211856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:59.211861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:59.211866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:59.211879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:59.211892Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:59.211909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:59.212163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:59.212176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:59.212199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:59.212429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1385 partition: 0 MaxSeqNo: 42 sessionId: src_id|d7deaba3-e8cee5ba-4cd67464-2a4e888c_0
2025-09-30T14:53:59.212852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e122e6fb-9f8a7407-1d25d7cb-afdcf599_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d7deaba3-e8cee5ba-4cd67464-2a4e888c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:59.215604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7deaba3-e8cee5ba-4cd67464-2a4e888c_0] Write session: try to update token
2025-09-30T14:53:59.215625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7deaba3-e8cee5ba-4cd67464-2a4e888c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:59.228351Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:59.228367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:59.228370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:59.228372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:59.228381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895615115236933:8410]
2025-09-30T14:53:59.228386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895615115236933:8410]
2025-09-30T14:53:59.228390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895615115236933:8410]
2025-09-30T14:53:59.228430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:59.228436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:59.228439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:59.228578Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:59.229704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:59.229711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:59.229714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:59.247325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1385 sessionId: src_id|d7deaba3-e8cee5ba-4cd67464-2a4e888c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:59.250122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:59.261887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895615204987866:2659]
2025-09-30T14:53:59.262332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1384, pipe: [1:7555895615204987866:2659]
2025-09-30T14:53:59.362725Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:59.364261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:59.364277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:59.364343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1385 reason: error at write: Disconnected sessionId: src_id|d7deaba3-e8cee5ba-4cd67464-2a4e888c_0
2025-09-30T14:53:59.363571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:59.363588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:59.363611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895615204987866:2659], now have 1 active actors on pipe
2025-09-30T14:53:59.364525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1385 sessionId: src_id|d7deaba3-e8cee5ba-4cd67464-2a4e888c_0 is DEAD
2025-09-30T14:53:59.364732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895615204987866:2659]
2025-09-30T14:53:59.364964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:59.365541Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:59.367372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7deaba3-e8cee5ba-4cd67464-2a4e888c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:59.367384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7deaba3-e8cee5ba-4cd67464-2a4e888c_0] Write session will restart in 0.007942s
2025-09-30T14:53:59.367409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7deaba3-e8cee5ba-4cd67464-2a4e888c_0] Write session: Do CDS request
2025-09-30T14:53:59.367417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7deaba3-e8cee5ba-4cd67464-2a4e888c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:59.376875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7deaba3-e8cee5ba-4cd67464-2a4e888c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:59.379393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:59.379423Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1386
2025-09-30T14:53:59.379609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1386 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:59.379657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1386 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:59.379663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1386 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:59.379668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:59.380235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1386 sessionId:  describe result for acl check
2025-09-30T14:53:59.380264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:59.380266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:59.380268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:59.380274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895615204987897:8462] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:59.380833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895615204987897:8462] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:59.388365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895615204987897:8462] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:59.392268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895615204987897:8462] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:59.392288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895615204987897:8462] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:59.392292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895615204987897:8462] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:59.392300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1386 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:59.397438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:59.403762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:59.404013Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:59.404023Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:59.404035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:59.404091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:59.404143Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895615115237172:8414]
2025-09-30T14:53:59.404869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:59.405195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:59.405239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:59.405591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:59.405654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:59.405660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:59.405662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:59.405663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:59.405664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:59.405665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:59.405667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:59.405668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:59.405669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:59.405670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:59.405672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:59.405673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:59.405675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:59.405676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:59.405677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:59.405683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:59.405694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:59.405699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:59.405705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:59.405709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:59.405715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:59.405719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:59.405724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:59.405729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:59.405733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:59.405737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:59.405742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:59.405747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:59.405751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:59.405756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:59.405765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:59.405774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:59.405780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:59.405787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:59.405793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:59.405798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:59.405804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:59.405809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:59.405814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:59.405818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:59.405831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:59.405836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:59.405840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:59.405850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:59.405854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:59.405860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:59.405870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:59.405875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:59.405881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:59.405891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:59.405896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:59.405902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:59.405911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:59.405917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:59.405923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:59.405933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:59.405954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:59.405963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:59.405969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:59.405974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:59.406025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:59.421868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:59.423578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:59.424046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1385
2025-09-30T14:53:59.424082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1385
2025-09-30T14:53:59.423594Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:59.423596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:59.423600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:59.423608Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1385 [2:7555895615115237172:8414]
2025-09-30T14:53:59.423625Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:59.423641Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:59.423644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:59.423648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:59.423651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:59.423667Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:59.423674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:59.423680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:59.423746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:59.423748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:59.423751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:59.423755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:59.423758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:59.423838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:59.423841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:59.423857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:59.423870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:59.423887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:59.423904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895615115237167:8414]
2025-09-30T14:53:59.423907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895615115237167:8414]
2025-09-30T14:53:59.423909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895615115237167:8414]
2025-09-30T14:53:59.423916Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:59.423927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:59.423930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:59.423931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:59.423932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:59.423944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:59.423947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:59.423958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895615204988085:8462], now have 1 active actors on pipe
2025-09-30T14:53:59.423961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895615204987881:2454], now have 1 active actors on pipe
2025-09-30T14:53:59.424001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895615115237167:8414]
2025-09-30T14:53:59.424009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:59.424734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:59.424953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:59.424966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:59.424997Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e143817e-9be0627b-ee74b3ba-a5744988_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:59.425006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:59.425012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:59.425014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:59.425033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:59.425046Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:59.425068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:59.425437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:59.425446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:59.425461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:59.425549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1386 partition: 0 MaxSeqNo: 42 sessionId: src_id|e143817e-9be0627b-ee74b3ba-a5744988_0
2025-09-30T14:53:59.425909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7deaba3-e8cee5ba-4cd67464-2a4e888c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e143817e-9be0627b-ee74b3ba-a5744988_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:59.428704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e143817e-9be0627b-ee74b3ba-a5744988_0] Write session: try to update token
2025-09-30T14:53:59.428724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e143817e-9be0627b-ee74b3ba-a5744988_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:59.449010Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:59.449027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:59.449029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:59.449031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:59.449041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895615115237167:8414]
2025-09-30T14:53:59.449046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895615115237167:8414]
2025-09-30T14:53:59.449050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895615115237167:8414]
2025-09-30T14:53:59.449092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:59.449098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:59.449101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:59.449239Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:59.451780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:59.451793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:59.451798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:59.453274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1386 sessionId: src_id|e143817e-9be0627b-ee74b3ba-a5744988_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:59.456162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:59.464630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895615204988108:2659]
2025-09-30T14:53:59.473023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1385, pipe: [1:7555895615204988108:2659]
2025-09-30T14:53:59.582273Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:59.582992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:59.583003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:59.583045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895615204988108:2659], now have 1 active actors on pipe
2025-09-30T14:53:59.583639Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:59.583729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:59.583779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:59.583782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:59.583838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1386 reason: error at write: Disconnected sessionId: src_id|e143817e-9be0627b-ee74b3ba-a5744988_0
2025-09-30T14:53:59.584018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1386 sessionId: src_id|e143817e-9be0627b-ee74b3ba-a5744988_0 is DEAD
2025-09-30T14:53:59.584140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895615204988108:2659]
2025-09-30T14:53:59.587417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e143817e-9be0627b-ee74b3ba-a5744988_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:59.587424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e143817e-9be0627b-ee74b3ba-a5744988_0] Write session will restart in 0.007675s
2025-09-30T14:53:59.587447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e143817e-9be0627b-ee74b3ba-a5744988_0] Write session: Do CDS request
2025-09-30T14:53:59.587456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e143817e-9be0627b-ee74b3ba-a5744988_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:59.597028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e143817e-9be0627b-ee74b3ba-a5744988_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:59.597118Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:59.597138Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1387
2025-09-30T14:53:59.597389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1387 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:59.597423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1387 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:59.597428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1387 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:59.597432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:59.597995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1387 sessionId:  describe result for acl check
2025-09-30T14:53:59.598031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:59.598034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:59.598038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:59.598045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895615204988123:8467] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:59.598566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895615204988123:8467] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:59.610214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895615204988123:8467] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:59.616312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895615204988123:8467] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:59.616335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895615204988123:8467] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:59.616339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895615204988123:8467] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:59.616349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1387 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:59.627297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:59.630589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:59.630852Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:59.630857Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:59.630868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:59.630929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:59.630974Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895615115237393:8416]
2025-09-30T14:53:59.631500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:59.632571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:59.632625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:59.632952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:59.633020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:59.633021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:59.633023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:59.633024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:59.633026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:59.633027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:59.633028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:59.633030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:59.633031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:59.633033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:59.633034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:59.633035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:59.633037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:59.633038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:59.633039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:59.633044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:59.633051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:59.633054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:59.633056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:59.633059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:59.633061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:59.633064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:59.633066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:59.633069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:59.633071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:59.633074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:59.633077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:59.633079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:59.633082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:59.633084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:59.633092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:59.633098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:59.633101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:59.633105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:59.633108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:59.633112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:59.633115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:59.633118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:59.633121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:59.633125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:59.633128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:59.633131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:59.633135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:59.633139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:59.633142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:59.633145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:59.633148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:59.633151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:59.633154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:59.633157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:59.633162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:59.633165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:59.633168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:59.633173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:59.633179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:59.633183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:59.633187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:59.633192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:59.633196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:59.633200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:59.633241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:59.639640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:59.640836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:59.640843Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:59.640846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:59.640852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:59.640859Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1386 [2:7555895615115237393:8416]
2025-09-30T14:53:59.640876Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:59.640894Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:59.640897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:59.640901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:59.640904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:59.640920Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:59.640927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:59.640934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:59.641000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:59.641003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:59.641005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:59.641008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:59.641011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:59.641087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:59.641090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:59.641104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:59.641116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:59.641133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:59.641152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895615115237388:8416]
2025-09-30T14:53:59.641154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895615115237388:8416]
2025-09-30T14:53:59.641157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895615115237388:8416]
2025-09-30T14:53:59.641170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:59.641185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:59.641200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:59.641203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:59.641240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895615115237388:8416]
2025-09-30T14:53:59.641243Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:59.641544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:59.641551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:59.641555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:59.641562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:59.642026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895615204988241:8467], now have 1 active actors on pipe
2025-09-30T14:53:59.642034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895615204988113:2454], now have 1 active actors on pipe
2025-09-30T14:53:59.642205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1386
2025-09-30T14:53:59.642242Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1386
2025-09-30T14:53:59.642567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:59.642575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:59.642612Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b89c1717-7dd50ea7-8b8b4481-862b79e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:59.642619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:59.642623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:59.642625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:59.642634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:59.642644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:59.642660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:59.646624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:59.646638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:59.646667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:59.648252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1387 partition: 0 MaxSeqNo: 42 sessionId: src_id|b89c1717-7dd50ea7-8b8b4481-862b79e3_0
2025-09-30T14:53:59.649494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e143817e-9be0627b-ee74b3ba-a5744988_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b89c1717-7dd50ea7-8b8b4481-862b79e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:59.652356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b89c1717-7dd50ea7-8b8b4481-862b79e3_0] Write session: try to update token
2025-09-30T14:53:59.652377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b89c1717-7dd50ea7-8b8b4481-862b79e3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:59.675975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1387 sessionId: src_id|b89c1717-7dd50ea7-8b8b4481-862b79e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:59.678758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:59.679117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:59.679137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:59.679168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:53:59.679476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:53:59.682431Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:59.682449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:59.682452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:59.682454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:59.682463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895615115237388:8416]
2025-09-30T14:53:59.682467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895615115237388:8416]
2025-09-30T14:53:59.682471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895615115237388:8416]
2025-09-30T14:53:59.682511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:59.682518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:59.682521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:59.682694Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:59.685687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895615204988340:2659]
2025-09-30T14:53:59.686079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1386, pipe: [1:7555895615204988340:2659]
2025-09-30T14:53:59.685628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:59.685648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:59.685654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:59.809306Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:53:59.809760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895615204988340:2659], now have 1 active actors on pipe
2025-09-30T14:53:59.817918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:59.817961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:59.818157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:59.818249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:59.818359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:59.818453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:59.818499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:59.818504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:59.818598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:59.818672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:59.818763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:59.818836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:59.819188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:59.819199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:59.819371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:59.819442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:59.819508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:59.819575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:59.819702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:59.819710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:59.819788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:59.819871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:59.819940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:59.820005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:59.820052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:59.820055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:59.820127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:59.820188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:59.820249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:59.820309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:59.820349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:59.820352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:59.820421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:59.820477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:59.820543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:59.820609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:59.820650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:59.820653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:59.820723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:59.820777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:59.820843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:59.820906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:59.820952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:59.820955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:59.821024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:59.821081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:59.821143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:59.821208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:59.821267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:59.821270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:59.821339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:59.821400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:59.821460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:59.821519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:59.821560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:59.821563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:59.821630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:53:59.821689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:53:59.821749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:53:59.821813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:53:59.821852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:53:59.821855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:53:59.823366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b89c1717-7dd50ea7-8b8b4481-862b79e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:53:59.823389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b89c1717-7dd50ea7-8b8b4481-862b79e3_0] Write session will restart in 0.007088s
2025-09-30T14:53:59.823413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b89c1717-7dd50ea7-8b8b4481-862b79e3_0] Write session: Do CDS request
2025-09-30T14:53:59.823419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b89c1717-7dd50ea7-8b8b4481-862b79e3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:53:59.823215Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:53:59.822936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:53:59.822954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:53:59.822981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1387 reason: error at write: Disconnected sessionId: src_id|b89c1717-7dd50ea7-8b8b4481-862b79e3_0
2025-09-30T14:53:59.822989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895615204988340:2659]
2025-09-30T14:53:59.823012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:53:59.823203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1387 sessionId: src_id|b89c1717-7dd50ea7-8b8b4481-862b79e3_0 is DEAD
2025-09-30T14:53:59.836002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b89c1717-7dd50ea7-8b8b4481-862b79e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:59.836379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:53:59.836399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1388
2025-09-30T14:53:59.836601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1388 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:53:59.836642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1388 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:53:59.836647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1388 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:53:59.836652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:53:59.837059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1388 sessionId:  describe result for acl check
2025-09-30T14:53:59.837098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:53:59.837100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:53:59.837101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:53:59.837107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895615204988389:8471] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:53:59.837637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895615204988389:8471] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:53:59.845779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895615204988389:8471] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:53:59.851134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895615204988389:8471] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:53:59.851153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895615204988389:8471] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:53:59.851157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895615204988389:8471] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:53:59.851166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1388 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:53:59.852918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:53:59.855974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:53:59.856336Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:53:59.856341Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:53:59.856354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:53:59.856428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:53:59.856466Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895615115237616:8419]
2025-09-30T14:53:59.857158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:53:59.857619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:53:59.857685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:53:59.858065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:53:59.858140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:59.858141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:59.858143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:59.858144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:59.858146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:59.858147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:59.858149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:59.858150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:59.858151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:59.858153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:59.858154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:59.858155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:59.858157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:59.858158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:59.858160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:59.858166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:59.858176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:59.858180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:59.858184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:59.858188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:59.858192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:59.858195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:59.858199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:59.858204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:59.858208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:59.858212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:59.858216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:59.858219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:59.858223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:59.858227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:59.858236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:59.858244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:53:59.858250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:59.858256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:53:59.858260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:59.858265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:53:59.858269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:59.858275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:53:59.858280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:59.858285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:53:59.858290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:59.858295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:53:59.858300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:59.858306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:53:59.858310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:59.858316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:53:59.858321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:59.858327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:53:59.858331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:59.858336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:53:59.858341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:59.858347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:59.858352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:59.858357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:59.858362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:59.858369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:59.858374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:59.858379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:53:59.858384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:59.858390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:53:59.858434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:53:59.865589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:53:59.866752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:53:59.866774Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:53:59.866777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:53:59.866781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:53:59.866788Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1387 [2:7555895615115237616:8419]
2025-09-30T14:53:59.866805Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:53:59.866821Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:53:59.866830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:59.866833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:59.866835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:59.866852Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:53:59.866859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:53:59.866865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:53:59.866930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:59.866938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:59.866940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:59.866944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:53:59.866946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:53:59.867014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:53:59.867024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:59.867038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:53:59.867051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:53:59.867069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:53:59.867087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895615115237611:8419]
2025-09-30T14:53:59.867090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895615115237611:8419]
2025-09-30T14:53:59.867092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895615115237611:8419]
2025-09-30T14:53:59.867108Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:53:59.867125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895615204988343:2454], now have 1 active actors on pipe
2025-09-30T14:53:59.867129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895615204988558:8471], now have 1 active actors on pipe
2025-09-30T14:53:59.867138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:53:59.867154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:53:59.867162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:53:59.867197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895615115237611:8419]
2025-09-30T14:53:59.867204Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:53:59.867199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1387
2025-09-30T14:53:59.867262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1387
2025-09-30T14:53:59.867279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:53:59.867286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:53:59.867288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:53:59.867293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:53:59.867679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:59.867687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:59.867718Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b91948f1-3b252d75-8241edbb-b1aa016c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:53:59.867727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:53:59.867731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:53:59.867733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:53:59.867744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:53:59.867771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:53:59.867796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:59.868007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:53:59.868016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:53:59.868036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:53:59.868158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1388 partition: 0 MaxSeqNo: 42 sessionId: src_id|b91948f1-3b252d75-8241edbb-b1aa016c_0
2025-09-30T14:53:59.871349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b89c1717-7dd50ea7-8b8b4481-862b79e3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b91948f1-3b252d75-8241edbb-b1aa016c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:53:59.874344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b91948f1-3b252d75-8241edbb-b1aa016c_0] Write session: try to update token
2025-09-30T14:53:59.874365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b91948f1-3b252d75-8241edbb-b1aa016c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:53:59.880840Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:53:59.880859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:53:59.880862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:53:59.880864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:53:59.880873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895615115237611:8419]
2025-09-30T14:53:59.880877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895615115237611:8419]
2025-09-30T14:53:59.880884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895615115237611:8419]
2025-09-30T14:53:59.880930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:53:59.880937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:53:59.880940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:53:59.880953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:53:59.880960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:53:59.880965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:53:59.881085Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:53:59.894434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1388 sessionId: src_id|b91948f1-3b252d75-8241edbb-b1aa016c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:53:59.897241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:53:59.922882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895615204988573:2659]
2025-09-30T14:53:59.923119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1387, pipe: [1:7555895615204988573:2659]
2025-09-30T14:54:00.017826Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:00.018197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:00.018213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:00.018234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895615204988573:2659], now have 1 active actors on pipe
2025-09-30T14:54:00.021124Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:00.022180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b91948f1-3b252d75-8241edbb-b1aa016c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:00.022192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b91948f1-3b252d75-8241edbb-b1aa016c_0] Write session will restart in 0.005112s
2025-09-30T14:54:00.021667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895615204988573:2659]
2025-09-30T14:54:00.022215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b91948f1-3b252d75-8241edbb-b1aa016c_0] Write session: Do CDS request
2025-09-30T14:54:00.021700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:00.022221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b91948f1-3b252d75-8241edbb-b1aa016c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:00.021770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1388 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b91948f1-3b252d75-8241edbb-b1aa016c_0
2025-09-30T14:54:00.021964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1388 sessionId: src_id|b91948f1-3b252d75-8241edbb-b1aa016c_0 is DEAD
2025-09-30T14:54:00.022116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:00.032278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b91948f1-3b252d75-8241edbb-b1aa016c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:00.038240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:00.038259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1389
2025-09-30T14:54:00.038444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1389 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:00.038482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1389 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:00.038488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1389 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:00.038493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:00.038920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1389 sessionId:  describe result for acl check
2025-09-30T14:54:00.038953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:00.038961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:00.038964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:00.038971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895619499955888:8475] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:00.039531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895619499955888:8475] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:00.044714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895619499955888:8475] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:00.054513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895619499955888:8475] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:00.054536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895619499955888:8475] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:00.054540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895619499955888:8475] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:00.054550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1389 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:00.055921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:00.058819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:00.059065Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:00.059076Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:00.059087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:00.059144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:00.059186Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895619410205135:8421]
2025-09-30T14:54:00.059879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:00.060217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:00.060302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:00.060698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:00.060788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:00.060799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:00.060800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:00.060801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:00.060802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:00.060804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:00.060805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:00.060808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:00.060809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:00.060811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:00.060812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.060814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:00.060815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:00.060817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:00.060818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:00.060826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:00.060837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:00.060842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:00.060846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:00.060851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:00.060855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:00.060860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:00.060865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:00.060869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:00.060874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:00.060878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.060883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:00.060887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:00.060891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:00.060895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:00.060904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:00.060916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:00.060922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:00.060928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:00.060934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:00.060939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:00.060947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:00.060953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:00.060959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:00.060964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:00.060969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:00.060974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:00.060980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:00.060987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:00.060991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:00.060997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:00.061009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:00.061015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:00.061020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:00.061025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:00.061030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.061037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.061045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:00.061050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:00.061058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:00.061064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:00.061069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:00.061075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:00.061081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:00.061087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:00.061141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:00.068151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:00.069542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:00.069572Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:00.069576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:00.069581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:00.069589Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1388 [2:7555895619410205135:8421]
2025-09-30T14:54:00.069607Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:00.069624Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:00.069628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:00.069631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:00.069633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:00.069653Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:00.069666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:00.069673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:00.069760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.069767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:00.069770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:00.069773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:00.069777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:00.069855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:00.069858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.069876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:00.069890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:00.069911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:00.069929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895619410205130:8421]
2025-09-30T14:54:00.069931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895619410205130:8421]
2025-09-30T14:54:00.069950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895619410205130:8421]
2025-09-30T14:54:00.069967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:00.069981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:00.069996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:00.069998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:00.070037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895619410205130:8421]
2025-09-30T14:54:00.070040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:00.070170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:00.070174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:00.070177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:00.070183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:00.070450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895619499956094:8475], now have 1 active actors on pipe
2025-09-30T14:54:00.070461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895619499955871:2454], now have 1 active actors on pipe
2025-09-30T14:54:00.070538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1388
2025-09-30T14:54:00.070551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1388
2025-09-30T14:54:00.070712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:00.070723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:00.070756Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0469b70-b95f093c-fe2fa39e-e17e82cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:00.070766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:00.070771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:00.070774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:00.070785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:00.070797Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:00.070825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:00.071086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:00.071093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:00.071107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:00.071298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1389 partition: 0 MaxSeqNo: 42 sessionId: src_id|c0469b70-b95f093c-fe2fa39e-e17e82cd_0
2025-09-30T14:54:00.072648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b91948f1-3b252d75-8241edbb-b1aa016c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c0469b70-b95f093c-fe2fa39e-e17e82cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:00.076501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0469b70-b95f093c-fe2fa39e-e17e82cd_0] Write session: try to update token
2025-09-30T14:54:00.076532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0469b70-b95f093c-fe2fa39e-e17e82cd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:00.091380Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:00.091400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:00.091404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:00.091406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:00.091417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895619410205130:8421]
2025-09-30T14:54:00.091423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895619410205130:8421]
2025-09-30T14:54:00.091429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895619410205130:8421]
2025-09-30T14:54:00.091476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:00.091484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.091487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:00.091636Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:00.095382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:00.095403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:00.095408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:00.097719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1389 sessionId: src_id|c0469b70-b95f093c-fe2fa39e-e17e82cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:00.100699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:00.121029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895619499956107:2659]
2025-09-30T14:54:00.121641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1388, pipe: [1:7555895619499956107:2659]
2025-09-30T14:54:00.298212Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:00.298556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:00.298567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:00.298617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895619499956107:2659], now have 1 active actors on pipe
2025-09-30T14:54:00.298882Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:00.299690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:00.299756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1389 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c0469b70-b95f093c-fe2fa39e-e17e82cd_0
2025-09-30T14:54:00.299938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1389 sessionId: src_id|c0469b70-b95f093c-fe2fa39e-e17e82cd_0 is DEAD
2025-09-30T14:54:00.300036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895619499956107:2659]
2025-09-30T14:54:00.300046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:00.303348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0469b70-b95f093c-fe2fa39e-e17e82cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:00.303362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0469b70-b95f093c-fe2fa39e-e17e82cd_0] Write session will restart in 0.009375s
2025-09-30T14:54:00.303388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0469b70-b95f093c-fe2fa39e-e17e82cd_0] Write session: Do CDS request
2025-09-30T14:54:00.303396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0469b70-b95f093c-fe2fa39e-e17e82cd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:00.313867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0469b70-b95f093c-fe2fa39e-e17e82cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:00.315415Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:00.315437Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1390
2025-09-30T14:54:00.315903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1390 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:00.315938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1390 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:00.315945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1390 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:00.315950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:00.316663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1390 sessionId:  describe result for acl check
2025-09-30T14:54:00.316706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:00.316708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:00.316711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:00.316718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895619499956171:8488] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:00.317351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895619499956171:8488] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:00.325380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895619499956171:8488] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:00.333802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895619499956171:8488] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:00.333844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895619499956171:8488] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:00.333848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895619499956171:8488] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:00.333860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1390 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:00.338818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:00.339727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:00.340043Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:00.340060Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:00.340073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:00.340139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:00.340184Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895619410205408:8437]
2025-09-30T14:54:00.340918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:00.342333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:00.342392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:00.342785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:00.342853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:00.342854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:00.342856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:00.342857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:00.342859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:00.342861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:00.342862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:00.342864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:00.342866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:00.342867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:00.342869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.342870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:00.342871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:00.342872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:00.342874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:00.342895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:00.342907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:00.342911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:00.342916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:00.342920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:00.342924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:00.342928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:00.342931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:00.342935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:00.342939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:00.342943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.342946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:00.342950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:00.342954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:00.342959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:00.342967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:00.342976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:00.342983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:00.342988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:00.342993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:00.342999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:00.343003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:00.343008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:00.343013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:00.343018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:00.343022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:00.343027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:00.343032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:00.343038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:00.343043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:00.343049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:00.343057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:00.343063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:00.343068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:00.343074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:00.343080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.343085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.343091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:00.343097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:00.343103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:00.343110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:00.343115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:00.343120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:00.343125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:00.343132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:00.343184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:00.350020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:00.350897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:00.350903Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:00.350907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:00.350911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:00.350919Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1389 [2:7555895619410205408:8437]
2025-09-30T14:54:00.350938Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:00.350954Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:00.350958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:00.350961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:00.350964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:00.350981Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:00.350988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:00.350996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:00.351060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.351063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:00.351065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:00.351068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:00.351072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:00.351152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:00.351155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.351170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:00.351180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:00.351199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:00.351218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895619410205403:8437]
2025-09-30T14:54:00.351221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895619410205403:8437]
2025-09-30T14:54:00.351441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1389
2025-09-30T14:54:00.351495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1389
2025-09-30T14:54:00.351224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895619410205403:8437]
2025-09-30T14:54:00.351233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:00.351263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:00.351267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:00.351270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:00.351270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:00.351290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:00.351295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:00.351306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895619499956142:2454], now have 1 active actors on pipe
2025-09-30T14:54:00.351310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895619499956340:8488], now have 1 active actors on pipe
2025-09-30T14:54:00.351347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895619410205403:8437]
2025-09-30T14:54:00.351359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:00.351603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:00.351895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:00.351914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:00.351940Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|220c1730-cf4481e6-83d96bd9-65f11340_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:00.351948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:00.351952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:00.351955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:00.351966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:00.351978Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:00.351997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:00.352275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:00.352283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:00.352298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:00.352474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1390 partition: 0 MaxSeqNo: 42 sessionId: src_id|220c1730-cf4481e6-83d96bd9-65f11340_0
2025-09-30T14:54:00.357539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0469b70-b95f093c-fe2fa39e-e17e82cd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|220c1730-cf4481e6-83d96bd9-65f11340_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:00.360376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|220c1730-cf4481e6-83d96bd9-65f11340_0] Write session: try to update token
2025-09-30T14:54:00.360397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|220c1730-cf4481e6-83d96bd9-65f11340_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:00.365730Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:00.365751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:00.365754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:00.365756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:00.365765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895619410205403:8437]
2025-09-30T14:54:00.365770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895619410205403:8437]
2025-09-30T14:54:00.365774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895619410205403:8437]
2025-09-30T14:54:00.365816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:00.365824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.365828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:00.365981Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:00.369291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:00.369302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:00.369306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:00.392005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1390 sessionId: src_id|220c1730-cf4481e6-83d96bd9-65f11340_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:00.394992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:00.400067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895619499956378:2659]
2025-09-30T14:54:00.400424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1389, pipe: [1:7555895619499956378:2659]
2025-09-30T14:54:00.494985Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:00.495590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:00.495606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:00.495627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895619499956378:2659], now have 1 active actors on pipe
2025-09-30T14:54:00.495833Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:00.496857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|220c1730-cf4481e6-83d96bd9-65f11340_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:00.496868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|220c1730-cf4481e6-83d96bd9-65f11340_0] Write session will restart in 0.006039s
2025-09-30T14:54:00.496891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|220c1730-cf4481e6-83d96bd9-65f11340_0] Write session: Do CDS request
2025-09-30T14:54:00.496897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|220c1730-cf4481e6-83d96bd9-65f11340_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:00.496221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:00.496282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:00.496356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1390 reason: status is not ok: tablet will be restarted right now sessionId: src_id|220c1730-cf4481e6-83d96bd9-65f11340_0
2025-09-30T14:54:00.496549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1390 sessionId: src_id|220c1730-cf4481e6-83d96bd9-65f11340_0 is DEAD
2025-09-30T14:54:00.496673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895619499956378:2659]
2025-09-30T14:54:00.503962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|220c1730-cf4481e6-83d96bd9-65f11340_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:00.507630Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:00.507653Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1391
2025-09-30T14:54:00.507964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1391 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:00.508009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1391 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:00.508015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1391 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:00.508020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:00.509495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1391 sessionId:  describe result for acl check
2025-09-30T14:54:00.509536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:00.509538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:00.509544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:00.509551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895619499956400:8492] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:00.510158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895619499956400:8492] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:00.514870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895619499956400:8492] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:00.521437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895619499956400:8492] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:00.521459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895619499956400:8492] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:00.521463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895619499956400:8492] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:00.521471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1391 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:00.525766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:00.529228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:00.529462Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:00.529472Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:00.529483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:00.529534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:00.529580Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895619410205631:8439]
2025-09-30T14:54:00.530325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:00.530735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:00.530807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:00.531212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:00.531329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:00.531334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:00.531335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:00.531336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:00.531338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:00.531340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:00.531341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:00.531343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:00.531345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:00.531346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:00.531348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.531349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:00.531350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:00.531352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:00.531353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:00.531361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:00.531372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:00.531376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:00.531381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:00.531385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:00.531389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:00.531394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:00.531398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:00.531402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:00.531406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:00.531409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.531413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:00.531418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:00.531423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:00.531428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:00.531438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:00.531447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:00.531454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:00.531462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:00.531468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:00.531474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:00.531478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:00.531486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:00.531491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:00.531496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:00.531501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:00.531506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:00.531517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:00.531524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:00.531537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:00.531543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:00.531549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:00.531555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:00.531560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:00.531566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:00.531572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.531580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.531586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:00.531592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:00.531597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:00.531603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:00.531608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:00.531615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:00.531621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:00.531636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:00.531698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:00.538224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:00.539155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:00.539175Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:00.539178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:00.539183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:00.539191Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1390 [2:7555895619410205631:8439]
2025-09-30T14:54:00.539209Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:00.539228Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:00.539231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:00.539234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:00.539236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:00.539271Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:00.539278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:00.539286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:00.539351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.539362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:00.539364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:00.539368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:00.539371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:00.539441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:00.539448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.539461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:00.539477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:00.539496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:00.539514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895619410205626:8439]
2025-09-30T14:54:00.539522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895619410205626:8439]
2025-09-30T14:54:00.539524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895619410205626:8439]
2025-09-30T14:54:00.539846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1390
2025-09-30T14:54:00.539904Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1390
2025-09-30T14:54:00.539538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:00.539556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:00.539570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:00.539573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:00.539574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:00.539578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:00.539580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:00.539612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895619410205626:8439]
2025-09-30T14:54:00.539615Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:00.539690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:00.539753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895619499956572:8492], now have 1 active actors on pipe
2025-09-30T14:54:00.539758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895619499956379:2454], now have 1 active actors on pipe
2025-09-30T14:54:00.539951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:00.539958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:00.539990Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7644c26c-7ec2f6ad-1fc115c0-14e5410e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:00.539999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:00.540003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:00.540006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:00.540017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:00.540030Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:00.540058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:00.540374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:00.540389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:00.540420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:00.540553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1391 partition: 0 MaxSeqNo: 42 sessionId: src_id|7644c26c-7ec2f6ad-1fc115c0-14e5410e_0
2025-09-30T14:54:00.541000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|220c1730-cf4481e6-83d96bd9-65f11340_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7644c26c-7ec2f6ad-1fc115c0-14e5410e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:00.543948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7644c26c-7ec2f6ad-1fc115c0-14e5410e_0] Write session: try to update token
2025-09-30T14:54:00.543970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7644c26c-7ec2f6ad-1fc115c0-14e5410e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:00.552788Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:00.552810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:00.552814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:00.552816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:00.552830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895619410205626:8439]
2025-09-30T14:54:00.552835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895619410205626:8439]
2025-09-30T14:54:00.552841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895619410205626:8439]
2025-09-30T14:54:00.552887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:00.552896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.552890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:00.552904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:00.552906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:00.552910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:00.553047Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:00.567782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1391 sessionId: src_id|7644c26c-7ec2f6ad-1fc115c0-14e5410e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:00.570749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:00.599318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895619499956614:2659]
2025-09-30T14:54:00.603646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1390, pipe: [1:7555895619499956614:2659]
2025-09-30T14:54:00.681376Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:00.682182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:00.682199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:00.682220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895619499956614:2659], now have 1 active actors on pipe
2025-09-30T14:54:00.682514Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:00.682514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:00.682531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:00.682684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1391 reason: error at write: Disconnected sessionId: src_id|7644c26c-7ec2f6ad-1fc115c0-14e5410e_0
2025-09-30T14:54:00.683063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7644c26c-7ec2f6ad-1fc115c0-14e5410e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:00.683078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7644c26c-7ec2f6ad-1fc115c0-14e5410e_0] Write session will restart in 0.007522s
2025-09-30T14:54:00.682779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895619499956614:2659]
2025-09-30T14:54:00.682798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:00.682885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1391 sessionId: src_id|7644c26c-7ec2f6ad-1fc115c0-14e5410e_0 is DEAD
2025-09-30T14:54:00.683114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7644c26c-7ec2f6ad-1fc115c0-14e5410e_0] Write session: Do CDS request
2025-09-30T14:54:00.683125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7644c26c-7ec2f6ad-1fc115c0-14e5410e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:00.691774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7644c26c-7ec2f6ad-1fc115c0-14e5410e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:00.692168Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:00.692199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1392
2025-09-30T14:54:00.692375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1392 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:00.692421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1392 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:00.692429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1392 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:00.692439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:00.693030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1392 sessionId:  describe result for acl check
2025-09-30T14:54:00.693071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:00.693076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:00.693078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:00.693084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895619499956631:8497] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:00.693688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895619499956631:8497] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:00.696447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895619499956631:8497] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:00.700100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895619499956631:8497] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:00.700129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895619499956631:8497] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:00.700132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895619499956631:8497] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:00.700141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1392 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:00.712576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:00.718702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:00.718959Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:00.718975Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:00.718989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:00.719064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:00.719109Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895619410205857:8442]
2025-09-30T14:54:00.719891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:00.720594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:00.720677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:00.721115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:00.721204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:00.721211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:00.721212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:00.721214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:00.721216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:00.721218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:00.721220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:00.721222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:00.721223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:00.721225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:00.721227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.721228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:00.721230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:00.721232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:00.721234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:00.721241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:00.721252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:00.721257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:00.721262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:00.721266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:00.721270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:00.721274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:00.721279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:00.721283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:00.721288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:00.721293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.721298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:00.721302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:00.721307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:00.721311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:00.721322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:00.721331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:00.721347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:00.721353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:00.721359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:00.721365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:00.721371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:00.721378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:00.721384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:00.721389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:00.721395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:00.721402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:00.721412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:00.721418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:00.721424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:00.721430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:00.721437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:00.721450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:00.721455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:00.721461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:00.721468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.721476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.721483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:00.721495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:00.721500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:00.721518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:00.721523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:00.721530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:00.721535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:00.721541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:00.721606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:00.727778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:00.728993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:00.729000Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:00.729004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:00.729008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:00.729016Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1391 [2:7555895619410205857:8442]
2025-09-30T14:54:00.729036Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:00.729052Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:00.729056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:00.729060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:00.729062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:00.729080Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:00.729088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:00.729095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:00.729166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.729167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:00.729170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:00.729174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:00.729177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:00.729258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:00.729261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.729276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:00.729288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:00.729304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:00.729322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895619410205851:8442]
2025-09-30T14:54:00.729325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895619410205851:8442]
2025-09-30T14:54:00.729328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895619410205851:8442]
2025-09-30T14:54:00.729343Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:00.729358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:00.729373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:00.729377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:00.729396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:00.729400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:00.729403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:00.729415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895619410205851:8442]
2025-09-30T14:54:00.729418Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:00.729490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:00.729733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895619499956616:2454], now have 1 active actors on pipe
2025-09-30T14:54:00.729744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895619499956765:8497], now have 1 active actors on pipe
2025-09-30T14:54:00.729839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1391
2025-09-30T14:54:00.729875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1391
2025-09-30T14:54:00.730121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:00.730137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:00.730168Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3246a5b1-fb43b97c-f1230c3a-9e37452a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:00.730184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:00.730189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:00.730191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:00.730203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:00.730215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:00.730234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:00.730450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:00.730460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:00.730476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:00.730583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1392 partition: 0 MaxSeqNo: 42 sessionId: src_id|3246a5b1-fb43b97c-f1230c3a-9e37452a_0
2025-09-30T14:54:00.731023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7644c26c-7ec2f6ad-1fc115c0-14e5410e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3246a5b1-fb43b97c-f1230c3a-9e37452a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:00.734201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3246a5b1-fb43b97c-f1230c3a-9e37452a_0] Write session: try to update token
2025-09-30T14:54:00.734225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3246a5b1-fb43b97c-f1230c3a-9e37452a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:00.751005Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:00.751029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:00.751033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:00.751038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:00.751054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895619410205851:8442]
2025-09-30T14:54:00.751063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895619410205851:8442]
2025-09-30T14:54:00.751081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895619410205851:8442]
2025-09-30T14:54:00.751126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:00.751139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.751141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:00.751141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:00.751150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:00.751154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:00.751312Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:00.755556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1392 sessionId: src_id|3246a5b1-fb43b97c-f1230c3a-9e37452a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:00.758449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:00.778968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895619499956850:2659]
2025-09-30T14:54:00.779374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1391, pipe: [1:7555895619499956850:2659]
2025-09-30T14:54:00.869294Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:00.870101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:00.870113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:00.870156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895619499956850:2659], now have 1 active actors on pipe
2025-09-30T14:54:00.870510Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:00.870547Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:00.870621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895619499956850:2659]
2025-09-30T14:54:00.870656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:00.870660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:00.870723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1392 reason: error at write: Disconnected sessionId: src_id|3246a5b1-fb43b97c-f1230c3a-9e37452a_0
2025-09-30T14:54:00.870921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1392 sessionId: src_id|3246a5b1-fb43b97c-f1230c3a-9e37452a_0 is DEAD
2025-09-30T14:54:00.871302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3246a5b1-fb43b97c-f1230c3a-9e37452a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:00.871317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3246a5b1-fb43b97c-f1230c3a-9e37452a_0] Write session will restart in 0.005866s
2025-09-30T14:54:00.871345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3246a5b1-fb43b97c-f1230c3a-9e37452a_0] Write session: Do CDS request
2025-09-30T14:54:00.871354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3246a5b1-fb43b97c-f1230c3a-9e37452a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:00.878871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3246a5b1-fb43b97c-f1230c3a-9e37452a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:00.878931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:00.878959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1393
2025-09-30T14:54:00.879148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1393 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:00.879192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1393 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:00.879197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1393 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:00.879202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:00.879705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1393 sessionId:  describe result for acl check
2025-09-30T14:54:00.879740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:00.879742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:00.879744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:00.879750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895619499956868:8501] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:00.880391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895619499956868:8501] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:00.889207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895619499956868:8501] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:00.896547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895619499956868:8501] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:00.896570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895619499956868:8501] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:00.896574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895619499956868:8501] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:00.896584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1393 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:00.908903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:00.912974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:00.913411Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:00.913423Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:00.913438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:00.913514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:00.913565Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895619410206082:8444]
2025-09-30T14:54:00.914329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:00.915695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:00.915776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:00.916169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:00.916245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:00.916247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:00.916249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:00.916251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:00.916253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:00.916255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:00.916256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:00.916258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:00.916260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:00.916261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:00.916263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.916265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:00.916266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:00.916267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:00.916269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:00.916276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:00.916289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:00.916294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:00.916298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:00.916303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:00.916307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:00.916311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:00.916315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:00.916319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:00.916323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:00.916327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.916331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:00.916335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:00.916339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:00.916343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:00.916354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:00.916364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:00.916371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:00.916380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:00.916386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:00.916391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:00.916396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:00.916401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:00.916406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:00.916410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:00.916414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:00.916419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:00.916425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:00.916430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:00.916435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:00.916441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:00.916446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:00.916452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:00.916457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:00.916463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:00.916469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.916474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.916479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:00.916484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:00.916489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:00.916494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:00.916498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:00.916504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:00.916509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:00.916514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:00.916562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:00.923271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:00.924251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:00.924270Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:00.924274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:00.924279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:00.924287Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1392 [2:7555895619410206082:8444]
2025-09-30T14:54:00.924305Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:00.924325Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:00.924329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:00.924332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:00.924334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:00.924354Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:00.924365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:00.924371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:00.924444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.924457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:00.924459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:00.924463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:00.924466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:00.924541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:00.924549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.924565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:00.924577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:00.924598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:00.924620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895619410206077:8444]
2025-09-30T14:54:00.924630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895619410206077:8444]
2025-09-30T14:54:00.924632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895619410206077:8444]
2025-09-30T14:54:00.924647Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:00.924664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:00.924680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:00.924683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:00.924722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895619410206077:8444]
2025-09-30T14:54:00.924725Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:00.925141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:00.925147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895619499957041:8501], now have 1 active actors on pipe
2025-09-30T14:54:00.925151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:00.925154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:00.925155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895619499956852:2454], now have 1 active actors on pipe
2025-09-30T14:54:00.925161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:00.927351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1392
2025-09-30T14:54:00.927359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1392
2025-09-30T14:54:00.928168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:00.928192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:00.928230Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2fa70a-babd2515-c69cfb8f-ef2470fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:00.928242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:00.928247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:00.928251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:00.928273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:00.928289Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:00.928309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:00.931584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:00.931605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:00.931641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:00.935338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1393 partition: 0 MaxSeqNo: 42 sessionId: src_id|2fa70a-babd2515-c69cfb8f-ef2470fc_0
2025-09-30T14:54:00.936133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3246a5b1-fb43b97c-f1230c3a-9e37452a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2fa70a-babd2515-c69cfb8f-ef2470fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:00.939076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fa70a-babd2515-c69cfb8f-ef2470fc_0] Write session: try to update token
2025-09-30T14:54:00.939099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fa70a-babd2515-c69cfb8f-ef2470fc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:00.941202Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:00.941221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:00.941224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:00.941227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:00.941237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895619410206077:8444]
2025-09-30T14:54:00.941241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895619410206077:8444]
2025-09-30T14:54:00.941245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895619410206077:8444]
2025-09-30T14:54:00.941287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:00.941288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:00.941295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:00.941298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:00.941300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:00.941304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:00.941486Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:00.963421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1393 sessionId: src_id|2fa70a-babd2515-c69cfb8f-ef2470fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:00.965329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895619499957089:2659]
2025-09-30T14:54:00.966428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:00.967536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1392, pipe: [1:7555895619499957089:2659]
2025-09-30T14:54:01.090398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:01.090419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:01.090479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1393 reason: error at write: Disconnected sessionId: src_id|2fa70a-babd2515-c69cfb8f-ef2470fc_0
2025-09-30T14:54:01.090656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1393 sessionId: src_id|2fa70a-babd2515-c69cfb8f-ef2470fc_0 is DEAD
2025-09-30T14:54:01.090722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:01.090760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895619499957089:2659]
2025-09-30T14:54:01.088982Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:01.089816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:01.089826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:01.089848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895619499957089:2659], now have 1 active actors on pipe
2025-09-30T14:54:01.091201Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:01.091449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fa70a-babd2515-c69cfb8f-ef2470fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:01.091511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fa70a-babd2515-c69cfb8f-ef2470fc_0] Write session will restart in 0.006959s
2025-09-30T14:54:01.091537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fa70a-babd2515-c69cfb8f-ef2470fc_0] Write session: Do CDS request
2025-09-30T14:54:01.091546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fa70a-babd2515-c69cfb8f-ef2470fc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:01.101412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fa70a-babd2515-c69cfb8f-ef2470fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:01.101863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:01.101883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1394
2025-09-30T14:54:01.102160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1394 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:01.102196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1394 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:01.102201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1394 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:01.102205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:01.102656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1394 sessionId:  describe result for acl check
2025-09-30T14:54:01.102687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:01.102689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:01.102691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:01.102698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895623794924412:8506] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:01.103310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895623794924412:8506] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:01.114831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895623794924412:8506] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:01.128615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895623794924412:8506] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:01.128645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895623794924412:8506] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:01.128649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895623794924412:8506] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:01.128698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1394 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:01.130123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:01.133378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:01.133682Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:01.133687Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:01.133700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:01.133772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:01.133825Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895623705173606:8446]
2025-09-30T14:54:01.134498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:01.134933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:01.134977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:01.135337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:01.135402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:01.135403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:01.135405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:01.135406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:01.135407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:01.135409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:01.135411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:01.135412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:01.135414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:01.135415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:01.135416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.135417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:01.135419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:01.135420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:01.135422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:01.135427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:01.135437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:01.135442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:01.135446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:01.135450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:01.135455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:01.135459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:01.135463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:01.135467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:01.135472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:01.135476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.135481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:01.135485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:01.135490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:01.135495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:01.135503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:01.135512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:01.135517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:01.135524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:01.135529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:01.135534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:01.135539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:01.135545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:01.135550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:01.135556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:01.135560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:01.135566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:01.135571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:01.135577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:01.135583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:01.135588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:01.135593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:01.135598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:01.135603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:01.135609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:01.135625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.135630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.135635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:01.135641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:01.135647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:01.135652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:01.135657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:01.135663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:01.135667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:01.135673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:01.135718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:01.142657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:01.143830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:01.143838Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:01.143841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:01.143845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:01.143853Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1393 [2:7555895623705173606:8446]
2025-09-30T14:54:01.143872Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:01.143892Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:01.143895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:01.143899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:01.143901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:01.143919Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:01.143926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:01.143935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:01.144006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.144008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:01.144011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:01.144015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:01.144018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:01.144099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:01.144101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.144116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:01.144127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:01.144144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:01.144162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895623705173599:8446]
2025-09-30T14:54:01.144165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895623705173599:8446]
2025-09-30T14:54:01.144167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895623705173599:8446]
2025-09-30T14:54:01.144184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:01.144200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:01.144219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:01.144222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:01.144261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895623705173599:8446]
2025-09-30T14:54:01.144264Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:01.144443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:01.144453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:01.144455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:01.144463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:01.145466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1393
2025-09-30T14:54:01.145504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1393
2025-09-30T14:54:01.144908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895623794924621:8506], now have 1 active actors on pipe
2025-09-30T14:54:01.144934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895623794924396:2454], now have 1 active actors on pipe
2025-09-30T14:54:01.149856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:01.149871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:01.149915Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d4529f4-1f55a218-61be1518-52f1616_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:01.149947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:01.149953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:01.149957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:01.149983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:01.150001Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:01.150030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:01.153443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:01.153470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:01.153510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:01.153981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1394 partition: 0 MaxSeqNo: 42 sessionId: src_id|7d4529f4-1f55a218-61be1518-52f1616_0
2025-09-30T14:54:01.154540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fa70a-babd2515-c69cfb8f-ef2470fc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7d4529f4-1f55a218-61be1518-52f1616_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:01.157488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4529f4-1f55a218-61be1518-52f1616_0] Write session: try to update token
2025-09-30T14:54:01.157513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4529f4-1f55a218-61be1518-52f1616_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:01.165436Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:01.165458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:01.165462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:01.165464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:01.165473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895623705173599:8446]
2025-09-30T14:54:01.165478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895623705173599:8446]
2025-09-30T14:54:01.165483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895623705173599:8446]
2025-09-30T14:54:01.165526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:01.165533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.165535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:01.165807Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:01.167540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:01.167552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:01.167557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:01.191340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895623794924634:2659]
2025-09-30T14:54:01.195363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1393, pipe: [1:7555895623794924634:2659]
2025-09-30T14:54:01.197402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1394 sessionId: src_id|7d4529f4-1f55a218-61be1518-52f1616_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:01.200538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:01.311146Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:01.311847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895623794924634:2659], now have 1 active actors on pipe
2025-09-30T14:54:01.311873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:01.311881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:01.312366Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:01.313104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:01.313186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1394 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7d4529f4-1f55a218-61be1518-52f1616_0
2025-09-30T14:54:01.313362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1394 sessionId: src_id|7d4529f4-1f55a218-61be1518-52f1616_0 is DEAD
2025-09-30T14:54:01.313464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895623794924634:2659]
2025-09-30T14:54:01.313483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:01.313718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4529f4-1f55a218-61be1518-52f1616_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:01.313727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4529f4-1f55a218-61be1518-52f1616_0] Write session will restart in 0.007488s
2025-09-30T14:54:01.313751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4529f4-1f55a218-61be1518-52f1616_0] Write session: Do CDS request
2025-09-30T14:54:01.313757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4529f4-1f55a218-61be1518-52f1616_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:01.322803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4529f4-1f55a218-61be1518-52f1616_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:01.323172Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:01.323190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1395
2025-09-30T14:54:01.323326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1395 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:01.323357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1395 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:01.323363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1395 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:01.323368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:01.323907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1395 sessionId:  describe result for acl check
2025-09-30T14:54:01.323934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:01.323936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:01.323937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:01.323941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895623794924688:8518] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:01.324409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895623794924688:8518] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:01.328594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895623794924688:8518] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:01.336083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895623794924688:8518] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:01.336109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895623794924688:8518] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:01.336112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895623794924688:8518] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:01.336122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1395 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:01.349708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:01.353557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:01.353843Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:01.353859Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:01.353875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:01.353986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:01.354036Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895623705173884:8462]
2025-09-30T14:54:01.354720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:01.355278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:01.355343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:01.355698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:01.355760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:01.355762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:01.355763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:01.355765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:01.355766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:01.355767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:01.355769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:01.355771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:01.355773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:01.355775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:01.355776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.355778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:01.355779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:01.355781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:01.355783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:01.355789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:01.355800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:01.355805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:01.355810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:01.355814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:01.355819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:01.355824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:01.355829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:01.355833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:01.355838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:01.355842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.355847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:01.355851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:01.355856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:01.355860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:01.355871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:01.355879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:01.355885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:01.355891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:01.355897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:01.355904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:01.355909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:01.355915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:01.355921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:01.355926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:01.355931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:01.355938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:01.355944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:01.355950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:01.355955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:01.355961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:01.355967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:01.355972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:01.355977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:01.355983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:01.355989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.355995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.356001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:01.356006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:01.356012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:01.356020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:01.356024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:01.356030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:01.356036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:01.356042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:01.356094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:01.362440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:01.363965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:01.363986Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:01.363989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:01.363993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:01.364001Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1394 [2:7555895623705173884:8462]
2025-09-30T14:54:01.364018Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:01.364036Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:01.364039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:01.364042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:01.364045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:01.364062Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:01.364070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:01.364077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:01.364146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.364149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:01.364151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:01.364466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1394
2025-09-30T14:54:01.364510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1394
2025-09-30T14:54:01.364155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:01.364158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:01.364236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:01.364239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.364255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:01.364268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:01.364283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:01.364301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895623705173879:8462]
2025-09-30T14:54:01.364303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895623705173879:8462]
2025-09-30T14:54:01.364306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895623705173879:8462]
2025-09-30T14:54:01.364323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:01.364337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895623794924770:8518], now have 1 active actors on pipe
2025-09-30T14:54:01.364341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895623794924673:2454], now have 1 active actors on pipe
2025-09-30T14:54:01.364349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:01.364364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:01.364368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:01.364406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895623705173879:8462]
2025-09-30T14:54:01.364408Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:01.364453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:01.364456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:01.364458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:01.364464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:01.364773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:01.364783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:01.364812Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|73b4a3c-215ac845-c40c98e3-a6d6ceb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:01.364820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:01.364824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:01.364827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:01.364836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:01.364846Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:01.364861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:01.365105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:01.365114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:01.365132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:01.365228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1395 partition: 0 MaxSeqNo: 42 sessionId: src_id|73b4a3c-215ac845-c40c98e3-a6d6ceb_0
2025-09-30T14:54:01.365657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4529f4-1f55a218-61be1518-52f1616_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|73b4a3c-215ac845-c40c98e3-a6d6ceb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:01.368614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73b4a3c-215ac845-c40c98e3-a6d6ceb_0] Write session: try to update token
2025-09-30T14:54:01.368635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73b4a3c-215ac845-c40c98e3-a6d6ceb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:01.385968Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:01.385984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:01.385995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895623705173879:8462]
2025-09-30T14:54:01.386048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:01.386399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:01.386468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:01.386642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:01.386884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:01.387056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:01.387339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:01.387391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:01.395365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1395 sessionId: src_id|73b4a3c-215ac845-c40c98e3-a6d6ceb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:01.398071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:01.395806Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:01.395826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:01.395829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:01.395831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:01.395841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895623705173879:8462]
2025-09-30T14:54:01.395846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895623705173879:8462]
2025-09-30T14:54:01.395851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895623705173879:8462]
2025-09-30T14:54:01.395894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:01.395901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.395904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:01.396126Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:01.398239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:01.398245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:01.398254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:01.412286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895623794924907:2659]
2025-09-30T14:54:01.415481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1394, pipe: [1:7555895623794924907:2659]
2025-09-30T14:54:01.513631Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:01.514162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:01.514182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:01.514208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895623794924907:2659], now have 1 active actors on pipe
2025-09-30T14:54:01.514947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73b4a3c-215ac845-c40c98e3-a6d6ceb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:01.514445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:01.514960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73b4a3c-215ac845-c40c98e3-a6d6ceb_0] Write session will restart in 0.007851s
2025-09-30T14:54:01.514454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:01.514462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:01.514499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895623794924907:2659]
2025-09-30T14:54:01.514523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1395 reason: error at write: Disconnected sessionId: src_id|73b4a3c-215ac845-c40c98e3-a6d6ceb_0
2025-09-30T14:54:01.514752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1395 sessionId: src_id|73b4a3c-215ac845-c40c98e3-a6d6ceb_0 is DEAD
2025-09-30T14:54:01.514988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73b4a3c-215ac845-c40c98e3-a6d6ceb_0] Write session: Do CDS request
2025-09-30T14:54:01.514994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73b4a3c-215ac845-c40c98e3-a6d6ceb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:01.514483Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:01.523815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73b4a3c-215ac845-c40c98e3-a6d6ceb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:01.524550Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:01.524576Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1396
2025-09-30T14:54:01.524701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1396 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:01.524731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1396 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:01.524736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1396 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:01.524740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:01.525196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1396 sessionId:  describe result for acl check
2025-09-30T14:54:01.525233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:01.525235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:01.525238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:01.525244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895623794924935:8522] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:01.525804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895623794924935:8522] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:01.529918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895623794924935:8522] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:01.536460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895623794924935:8522] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:01.536489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895623794924935:8522] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:01.536493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895623794924935:8522] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:01.536502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1396 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:01.544236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:01.549887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:01.550179Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:01.550184Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:01.550195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:01.550259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:01.550301Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895623705174113:8464]
2025-09-30T14:54:01.551018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:01.551448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:01.551495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:01.551846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:01.551932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:01.551933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:01.551934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:01.551936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:01.551938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:01.551939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:01.551941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:01.551943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:01.551944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:01.551945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:01.551947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.551948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:01.551949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:01.551951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:01.551952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:01.551958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:01.551971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:01.551975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:01.551980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:01.551985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:01.551988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:01.551993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:01.551998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:01.552003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:01.552007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:01.552012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.552016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:01.552020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:01.552025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:01.552030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:01.552039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:01.552047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:01.552054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:01.552061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:01.552067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:01.552074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:01.552079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:01.552085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:01.552092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:01.552099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:01.552105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:01.552110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:01.552116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:01.552123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:01.552128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:01.552136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:01.552142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:01.552149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:01.552154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:01.552160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:01.552165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.552171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.552178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:01.552184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:01.552189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:01.552196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:01.552201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:01.552207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:01.552212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:01.552218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:01.552269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:01.560634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:01.561593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:01.561602Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:01.561606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:01.561611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:01.561619Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1395 [2:7555895623705174113:8464]
2025-09-30T14:54:01.561639Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:01.561658Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:01.561662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:01.561665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:01.561669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:01.562530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1395
2025-09-30T14:54:01.562553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1395
2025-09-30T14:54:01.561686Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:01.561694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:01.561702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:01.561776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.561779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:01.561782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:01.561786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:01.561788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:01.561872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:01.561876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.561891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:01.561906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:01.561925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:01.561957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895623705174108:8464]
2025-09-30T14:54:01.561960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895623705174108:8464]
2025-09-30T14:54:01.561962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895623705174108:8464]
2025-09-30T14:54:01.561972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:01.561987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:01.561998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:01.562003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:01.562003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:01.562006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:01.562007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:01.562056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895623794924909:2454], now have 1 active actors on pipe
2025-09-30T14:54:01.562060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895623794925126:8522], now have 1 active actors on pipe
2025-09-30T14:54:01.562063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895623705174108:8464]
2025-09-30T14:54:01.562077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:01.562087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:01.564957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:01.564981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:01.565016Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cbbc722a-4b5f6ebe-af5e5005-4b967b32_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:01.565029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:01.565033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:01.565036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:01.565053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:01.565078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:01.565097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:01.565503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:01.565518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:01.565559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:01.565711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1396 partition: 0 MaxSeqNo: 42 sessionId: src_id|cbbc722a-4b5f6ebe-af5e5005-4b967b32_0
2025-09-30T14:54:01.566136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73b4a3c-215ac845-c40c98e3-a6d6ceb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cbbc722a-4b5f6ebe-af5e5005-4b967b32_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:01.569160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbbc722a-4b5f6ebe-af5e5005-4b967b32_0] Write session: try to update token
2025-09-30T14:54:01.569183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbbc722a-4b5f6ebe-af5e5005-4b967b32_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:01.576324Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:01.576345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:01.576347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:01.576349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:01.576359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895623705174108:8464]
2025-09-30T14:54:01.576366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895623705174108:8464]
2025-09-30T14:54:01.576370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895623705174108:8464]
2025-09-30T14:54:01.576416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:01.576425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.576427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:01.576627Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:01.578147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:01.578163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:01.578167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:01.597472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1396 sessionId: src_id|cbbc722a-4b5f6ebe-af5e5005-4b967b32_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:01.600574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:01.615331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895623794925149:2659]
2025-09-30T14:54:01.615681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1395, pipe: [1:7555895623794925149:2659]
2025-09-30T14:54:01.697525Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:01.698152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:01.698177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:01.698198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895623794925149:2659], now have 1 active actors on pipe
2025-09-30T14:54:01.698621Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:01.699193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbbc722a-4b5f6ebe-af5e5005-4b967b32_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:01.699205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbbc722a-4b5f6ebe-af5e5005-4b967b32_0] Write session will restart in 0.006830s
2025-09-30T14:54:01.699233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbbc722a-4b5f6ebe-af5e5005-4b967b32_0] Write session: Do CDS request
2025-09-30T14:54:01.699239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbbc722a-4b5f6ebe-af5e5005-4b967b32_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:01.698640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:01.698715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895623794925149:2659]
2025-09-30T14:54:01.698737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:01.698739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:01.698800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1396 reason: error at write: Disconnected sessionId: src_id|cbbc722a-4b5f6ebe-af5e5005-4b967b32_0
2025-09-30T14:54:01.699017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1396 sessionId: src_id|cbbc722a-4b5f6ebe-af5e5005-4b967b32_0 is DEAD
2025-09-30T14:54:01.706885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbbc722a-4b5f6ebe-af5e5005-4b967b32_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:01.707410Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:01.707437Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1397
2025-09-30T14:54:01.707582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1397 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:01.707619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1397 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:01.707631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1397 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:01.707635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:01.708181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1397 sessionId:  describe result for acl check
2025-09-30T14:54:01.708220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:01.708230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:01.708232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:01.708239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895623794925158:8527] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:01.708846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895623794925158:8527] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:01.711685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895623794925158:8527] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:01.715943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895623794925158:8527] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:01.715964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895623794925158:8527] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:01.715968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895623794925158:8527] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:01.715977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1397 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:01.748329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:01.754097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:01.754374Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:01.754385Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:01.754397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:01.754466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:01.754524Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895623705174345:8467]
2025-09-30T14:54:01.755241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:01.759788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:01.759887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:01.760306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:01.760386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:01.760388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:01.760389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:01.760391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:01.760392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:01.760394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:01.760395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:01.760397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:01.760399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:01.760400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:01.760402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.760403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:01.760405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:01.760406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:01.760408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:01.760416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:01.760428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:01.760433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:01.760438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:01.760443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:01.760448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:01.760453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:01.760458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:01.760462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:01.760469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:01.760473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.760478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:01.760483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:01.760487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:01.760491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:01.760501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:01.760510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:01.760518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:01.760525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:01.760531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:01.760537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:01.760543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:01.760550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:01.760557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:01.760563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:01.760569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:01.760575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:01.760581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:01.760587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:01.760593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:01.760599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:01.760605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:01.760629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:01.760634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:01.760640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:01.760650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.760656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.760661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:01.760667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:01.760672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:01.760678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:01.760683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:01.760689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:01.760694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:01.760700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:01.760751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:01.769536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:01.770539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:01.770560Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:01.770564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:01.770569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:01.770577Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1396 [2:7555895623705174345:8467]
2025-09-30T14:54:01.770598Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:01.770622Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:01.770629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:01.770633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:01.770636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:01.770654Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:01.770668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:01.770677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:01.770758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.770769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:01.770772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:01.770776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:01.770779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:01.770858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:01.770867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.770881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:01.770898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:01.770920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:01.770944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895623705174340:8467]
2025-09-30T14:54:01.770952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895623705174340:8467]
2025-09-30T14:54:01.770955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895623705174340:8467]
2025-09-30T14:54:01.770965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:01.770976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:01.770982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:01.770991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:01.770993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:01.770998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:01.771001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:01.771012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895623794925151:2454], now have 1 active actors on pipe
2025-09-30T14:54:01.771016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895623794925199:8527], now have 1 active actors on pipe
2025-09-30T14:54:01.771055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895623705174340:8467]
2025-09-30T14:54:01.771072Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:01.771136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:01.775516Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1396
2025-09-30T14:54:01.775575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1396
2025-09-30T14:54:01.775992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:01.776012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:01.776047Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4808177-ae4461cb-d9f4bcf0-5d37f197_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:01.776058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:01.776063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:01.776066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:01.776080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:01.776095Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:01.776115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:01.778412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:01.778431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:01.778462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:01.778618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1397 partition: 0 MaxSeqNo: 42 sessionId: src_id|e4808177-ae4461cb-d9f4bcf0-5d37f197_0
2025-09-30T14:54:01.780292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbbc722a-4b5f6ebe-af5e5005-4b967b32_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e4808177-ae4461cb-d9f4bcf0-5d37f197_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:01.783216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4808177-ae4461cb-d9f4bcf0-5d37f197_0] Write session: try to update token
2025-09-30T14:54:01.783237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4808177-ae4461cb-d9f4bcf0-5d37f197_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:01.793090Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:01.793111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:01.793113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:01.793115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:01.793125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895623705174340:8467]
2025-09-30T14:54:01.793130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895623705174340:8467]
2025-09-30T14:54:01.793134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895623705174340:8467]
2025-09-30T14:54:01.793175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:01.793184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.793187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:01.793196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:01.793203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:01.793207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:01.793375Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:01.799846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895623794925390:2659]
2025-09-30T14:54:01.805349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1396, pipe: [1:7555895623794925390:2659]
2025-09-30T14:54:01.805829Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1397 sessionId: src_id|e4808177-ae4461cb-d9f4bcf0-5d37f197_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:01.808810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:01.914224Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:01.914958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895623794925390:2659], now have 1 active actors on pipe
2025-09-30T14:54:01.915016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:01.915024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:01.915806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895623794925390:2659]
2025-09-30T14:54:01.915844Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:01.915881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:01.915963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1397 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e4808177-ae4461cb-d9f4bcf0-5d37f197_0
2025-09-30T14:54:01.915506Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:01.916264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1397 sessionId: src_id|e4808177-ae4461cb-d9f4bcf0-5d37f197_0 is DEAD
2025-09-30T14:54:01.916462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4808177-ae4461cb-d9f4bcf0-5d37f197_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:01.916493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4808177-ae4461cb-d9f4bcf0-5d37f197_0] Write session will restart in 0.007096s
2025-09-30T14:54:01.916520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4808177-ae4461cb-d9f4bcf0-5d37f197_0] Write session: Do CDS request
2025-09-30T14:54:01.916526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4808177-ae4461cb-d9f4bcf0-5d37f197_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:01.924804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4808177-ae4461cb-d9f4bcf0-5d37f197_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:01.927113Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:01.927136Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1398
2025-09-30T14:54:01.927283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1398 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:01.927318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1398 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:01.927329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1398 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:01.927333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:01.927735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1398 sessionId:  describe result for acl check
2025-09-30T14:54:01.927764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:01.927767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:01.927769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:01.927775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895623794925424:8531] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:01.928380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895623794925424:8531] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:01.933238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895623794925424:8531] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:01.941798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:01.941693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895623794925424:8531] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:01.941715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895623794925424:8531] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:01.941719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895623794925424:8531] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:01.941730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1398 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:01.945430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:01.945661Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:01.945674Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:01.945685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:01.945741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:01.945793Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895623705174576:8469]
2025-09-30T14:54:01.946558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:01.946968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:01.947016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:01.947391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:01.947464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:01.947473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:01.947474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:01.947476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:01.947478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:01.947479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:01.947481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:01.947483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:01.947484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:01.947486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:01.947487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.947489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:01.947490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:01.947492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:01.947493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:01.947499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:01.947509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:01.947514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:01.947519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:01.947524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:01.947529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:01.947534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:01.947538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:01.947542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:01.947547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:01.947551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.947556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:01.947560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:01.947564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:01.947569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:01.947577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:01.947588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:01.947594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:01.947601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:01.947606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:01.947612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:01.947618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:01.947625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:01.947630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:01.947637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:01.947642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:01.947649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:01.947655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:01.947661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:01.947667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:01.947672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:01.947678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:01.947685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:01.947689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:01.947695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:01.947703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.947709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.947714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:01.947733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:01.947738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:01.947743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:01.947749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:01.947755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:01.947760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:01.947765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:01.947814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:01.954719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:01.956043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:01.956059Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:01.956062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:01.956066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:01.956074Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1397 [2:7555895623705174576:8469]
2025-09-30T14:54:01.956095Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:01.956110Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:01.956114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:01.956117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:01.956119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:01.956136Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:01.956143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:01.956149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:01.956212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.956220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:01.956222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:01.956226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:01.956229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:01.956303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:01.956314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.956329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:01.956343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:01.956361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:01.956380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895623794925395:2454], now have 1 active actors on pipe
2025-09-30T14:54:01.956385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895623794925621:8531], now have 1 active actors on pipe
2025-09-30T14:54:01.956391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895623705174569:8469]
2025-09-30T14:54:01.956393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895623705174569:8469]
2025-09-30T14:54:01.956396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895623705174569:8469]
2025-09-30T14:54:01.956409Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:01.956423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:01.956425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:01.956548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1397
2025-09-30T14:54:01.956607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1397
2025-09-30T14:54:01.956438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:01.956440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:01.956443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:01.956447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:01.956490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895623705174569:8469]
2025-09-30T14:54:01.956498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:01.956508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:01.956740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:01.956745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:01.956769Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|341256d3-6e8b5ad6-a6cdc872-83487b43_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:01.956781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:01.956784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:01.956786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:01.956797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:01.956807Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:01.956822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:01.959884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:01.959900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:01.959936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:01.960162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1398 partition: 0 MaxSeqNo: 42 sessionId: src_id|341256d3-6e8b5ad6-a6cdc872-83487b43_0
2025-09-30T14:54:01.960752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4808177-ae4461cb-d9f4bcf0-5d37f197_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|341256d3-6e8b5ad6-a6cdc872-83487b43_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:01.963723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|341256d3-6e8b5ad6-a6cdc872-83487b43_0] Write session: try to update token
2025-09-30T14:54:01.963742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|341256d3-6e8b5ad6-a6cdc872-83487b43_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:01.970700Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:01.970721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:01.970724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:01.970727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:01.970736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895623705174569:8469]
2025-09-30T14:54:01.970741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895623705174569:8469]
2025-09-30T14:54:01.970745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895623705174569:8469]
2025-09-30T14:54:01.970785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:01.970790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:01.970792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:01.970795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:01.970797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:01.970811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:01.970953Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:01.984745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1398 sessionId: src_id|341256d3-6e8b5ad6-a6cdc872-83487b43_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:01.987568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:02.015971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895628089892932:2659]
2025-09-30T14:54:02.016810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1397, pipe: [1:7555895628089892932:2659]
2025-09-30T14:54:02.101129Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:02.101692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:02.101703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:02.101743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895628089892932:2659], now have 1 active actors on pipe
2025-09-30T14:54:02.103166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|341256d3-6e8b5ad6-a6cdc872-83487b43_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:02.103180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|341256d3-6e8b5ad6-a6cdc872-83487b43_0] Write session will restart in 0.008691s
2025-09-30T14:54:02.103212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|341256d3-6e8b5ad6-a6cdc872-83487b43_0] Write session: Do CDS request
2025-09-30T14:54:02.103219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|341256d3-6e8b5ad6-a6cdc872-83487b43_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:02.102711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895628089892932:2659]
2025-09-30T14:54:02.102749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:02.102752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:02.102807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1398 reason: error at write: Disconnected sessionId: src_id|341256d3-6e8b5ad6-a6cdc872-83487b43_0
2025-09-30T14:54:02.102994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1398 sessionId: src_id|341256d3-6e8b5ad6-a6cdc872-83487b43_0 is DEAD
2025-09-30T14:54:02.103169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:02.104041Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:02.112815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|341256d3-6e8b5ad6-a6cdc872-83487b43_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:02.113045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:02.113069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1399
2025-09-30T14:54:02.113309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1399 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:02.113362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1399 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:02.113373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1399 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:02.113378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:02.114116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1399 sessionId:  describe result for acl check
2025-09-30T14:54:02.114164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:02.114173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:02.114175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:02.114183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895628089892946:8536] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:02.114767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895628089892946:8536] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:02.121212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895628089892946:8536] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:02.125681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895628089892946:8536] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:02.125710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895628089892946:8536] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:02.125714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895628089892946:8536] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:02.125725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1399 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:02.142577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:02.147334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:02.147702Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:02.147713Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:02.147726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:02.147796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:02.147853Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895628000142107:8471]
2025-09-30T14:54:02.148592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:02.148986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:02.149042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:02.149435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:02.149517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:02.149523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:02.149524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:02.149526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:02.149527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:02.149529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:02.149530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:02.149532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:02.149533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:02.149535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:02.149536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:02.149538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:02.149540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:02.149541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:02.149543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:02.149549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:02.149560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:02.149563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:02.149568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:02.149571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:02.149575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:02.149578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:02.149582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:02.149586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:02.149590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:02.149594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:02.149597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:02.149601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:02.149606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:02.149610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:02.149621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:02.149630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:02.149636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:02.149642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:02.149647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:02.149652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:02.149657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:02.149662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:02.149667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:02.149673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:02.149677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:02.149684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:02.149688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:02.149693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:02.149699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:02.149705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:02.149711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:02.149718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:02.149747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:02.149755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:02.149761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:02.149766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:02.149771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:02.149778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:02.149783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:02.149790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:02.149795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:02.149802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:02.149807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:02.149816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:02.149869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:02.157250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:02.158285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:02.158292Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:02.158296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:02.158300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:02.158308Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1398 [2:7555895628000142107:8471]
2025-09-30T14:54:02.158346Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:02.158368Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:02.158372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:02.158376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:02.158379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:02.158400Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:02.158408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:02.158417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:02.158489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:02.158492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:02.158495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:02.158499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:02.158502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:02.158584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:02.158587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:02.158601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:02.158612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:02.158629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:02.158647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895628000142100:8471]
2025-09-30T14:54:02.158652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895628000142100:8471]
2025-09-30T14:54:02.158655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895628000142100:8471]
2025-09-30T14:54:02.158673Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:02.158687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:02.158703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:02.158706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:02.158744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895628000142100:8471]
2025-09-30T14:54:02.158747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:02.158880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:02.158884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:02.158886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:02.158893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:02.159213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1398
2025-09-30T14:54:02.159286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1398
2025-09-30T14:54:02.159832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895628089892939:2454], now have 1 active actors on pipe
2025-09-30T14:54:02.159848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895628089892988:8536], now have 1 active actors on pipe
2025-09-30T14:54:02.159878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:02.159884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:02.159914Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36b30b81-8dd54fa5-1c065cf2-c6c58644_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:02.159924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:02.159929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:02.159932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:02.159943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:02.159958Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:02.159977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:02.162525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:02.162547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:02.162581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:02.163012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1399 partition: 0 MaxSeqNo: 42 sessionId: src_id|36b30b81-8dd54fa5-1c065cf2-c6c58644_0
2025-09-30T14:54:02.163493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|341256d3-6e8b5ad6-a6cdc872-83487b43_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|36b30b81-8dd54fa5-1c065cf2-c6c58644_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:02.166700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36b30b81-8dd54fa5-1c065cf2-c6c58644_0] Write session: try to update token
2025-09-30T14:54:02.166728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36b30b81-8dd54fa5-1c065cf2-c6c58644_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:02.176096Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:02.176119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:02.176122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:02.176124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:02.176135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895628000142100:8471]
2025-09-30T14:54:02.176140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895628000142100:8471]
2025-09-30T14:54:02.176143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895628000142100:8471]
2025-09-30T14:54:02.176189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:02.176197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:02.176201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:02.176377Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:02.182899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:02.182925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:02.182931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:02.199786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895628089893183:2659]
2025-09-30T14:54:02.200290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1398, pipe: [1:7555895628089893183:2659]
2025-09-30T14:54:02.200991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1399 sessionId: src_id|36b30b81-8dd54fa5-1c065cf2-c6c58644_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:02.203890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:02.326583Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:02.332330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895628089893183:2659], now have 1 active actors on pipe
2025-09-30T14:54:02.332381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:02.332388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:02.336267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895628089893183:2659]
2025-09-30T14:54:02.336318Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:02.336363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:02.336365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:02.336446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1399 reason: error at write: Disconnected sessionId: src_id|36b30b81-8dd54fa5-1c065cf2-c6c58644_0
2025-09-30T14:54:02.336644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1399 sessionId: src_id|36b30b81-8dd54fa5-1c065cf2-c6c58644_0 is DEAD
2025-09-30T14:54:02.337167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36b30b81-8dd54fa5-1c065cf2-c6c58644_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:02.337179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36b30b81-8dd54fa5-1c065cf2-c6c58644_0] Write session will restart in 0.005968s
2025-09-30T14:54:02.337205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36b30b81-8dd54fa5-1c065cf2-c6c58644_0] Write session: Do CDS request
2025-09-30T14:54:02.337211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36b30b81-8dd54fa5-1c065cf2-c6c58644_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:02.336808Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:02.351696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36b30b81-8dd54fa5-1c065cf2-c6c58644_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:02.351925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:02.351945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1400
2025-09-30T14:54:02.352145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1400 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:02.352179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1400 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:02.352187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1400 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:02.352191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:02.352663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1400 sessionId:  describe result for acl check
2025-09-30T14:54:02.352691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:02.352693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:02.352694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:02.352698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895628089893225:8547] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:02.353115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895628089893225:8547] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:02.358505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895628089893225:8547] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:02.366660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895628089893225:8547] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:02.366683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895628089893225:8547] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:02.366686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895628089893225:8547] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:02.366694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1400 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:02.378288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:02.381487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:02.381788Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:02.381793Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:02.381806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:02.381866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:02.381900Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895628000142390:8481]
2025-09-30T14:54:02.382615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:02.382976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:02.383060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:02.383475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:02.383586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:02.383594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:02.383595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:02.383597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:02.383598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:02.383599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:02.383601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:02.383602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:02.383604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:02.383605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:02.383606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:02.383608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:02.383609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:02.383610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:02.383615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:02.383622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:02.383634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:02.383639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:02.383643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:02.383648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:02.383652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:02.383657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:02.383662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:02.383666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:02.383671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:02.383676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:02.383680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:02.383685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:02.383689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:02.383693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:02.383701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:02.383710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:02.383717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:02.383723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:02.383734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:02.383740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:02.383745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:02.383752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:02.383758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:02.383770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:02.383774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:02.383780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:02.383790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:02.383796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:02.383807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:02.383815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:02.383825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:02.383831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:02.383840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:02.383846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:02.383857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:02.383862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:02.383872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:02.383878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:02.383884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:02.383891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:02.383896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:02.383907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:02.383912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:02.383918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:02.383971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:02.390783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:02.391790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:02.391813Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:02.391816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:02.391821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:02.391828Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1399 [2:7555895628000142390:8481]
2025-09-30T14:54:02.391848Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:02.391868Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:02.391871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:02.391875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:02.391879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:02.391896Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:02.391905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:02.391912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:02.391982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:02.391985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:02.391987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:02.391991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:02.391994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:02.392070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:02.392073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:02.392089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:02.392103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:02.392123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:02.392140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895628000142370:8481]
2025-09-30T14:54:02.392159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895628000142370:8481]
2025-09-30T14:54:02.392162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895628000142370:8481]
2025-09-30T14:54:02.392178Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:02.392192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:02.392209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:02.392212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:02.392253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895628000142370:8481]
2025-09-30T14:54:02.392256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:02.392536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:02.392542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:02.392545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:02.392551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:02.393843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895628089893344:8547], now have 1 active actors on pipe
2025-09-30T14:54:02.393853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895628089893211:2454], now have 1 active actors on pipe
2025-09-30T14:54:02.393869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:02.393874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:02.393905Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23f837f2-d9a6d787-6c4a4d3a-4c56416a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:02.393914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:02.393920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:02.393940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:02.393954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:02.393968Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:02.393988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:02.394320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:02.394328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:02.394344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:02.393572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1399
2025-09-30T14:54:02.393612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1399
2025-09-30T14:54:02.394491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1400 partition: 0 MaxSeqNo: 42 sessionId: src_id|23f837f2-d9a6d787-6c4a4d3a-4c56416a_0
2025-09-30T14:54:02.395410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36b30b81-8dd54fa5-1c065cf2-c6c58644_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|23f837f2-d9a6d787-6c4a4d3a-4c56416a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:02.398352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23f837f2-d9a6d787-6c4a4d3a-4c56416a_0] Write session: try to update token
2025-09-30T14:54:02.398375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23f837f2-d9a6d787-6c4a4d3a-4c56416a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:02.410639Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:02.410657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:02.410661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:02.410664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:02.410674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895628000142370:8481]
2025-09-30T14:54:02.410679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895628000142370:8481]
2025-09-30T14:54:02.410684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895628000142370:8481]
2025-09-30T14:54:02.410729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:02.410736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:02.410738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:02.410738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:02.410747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:02.410753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:02.410904Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:02.437063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895628089893461:2659]
2025-09-30T14:54:02.437108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1400 sessionId: src_id|23f837f2-d9a6d787-6c4a4d3a-4c56416a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:02.440133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:02.447361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1399, pipe: [1:7555895628089893461:2659]
2025-09-30T14:54:02.534655Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:02.535511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:02.535534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:02.535558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895628089893461:2659], now have 1 active actors on pipe
2025-09-30T14:54:02.536864Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:02.538931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:02.539025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1400 reason: status is not ok: tablet will be restarted right now sessionId: src_id|23f837f2-d9a6d787-6c4a4d3a-4c56416a_0
2025-09-30T14:54:02.539264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1400 sessionId: src_id|23f837f2-d9a6d787-6c4a4d3a-4c56416a_0 is DEAD
2025-09-30T14:54:02.539366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895628089893461:2659]
2025-09-30T14:54:02.539403Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:02.543421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f837f2-d9a6d787-6c4a4d3a-4c56416a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:02.543440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f837f2-d9a6d787-6c4a4d3a-4c56416a_0] Write session will restart in 0.006881s
2025-09-30T14:54:02.543469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f837f2-d9a6d787-6c4a4d3a-4c56416a_0] Write session: Do CDS request
2025-09-30T14:54:02.543476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f837f2-d9a6d787-6c4a4d3a-4c56416a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:02.555082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23f837f2-d9a6d787-6c4a4d3a-4c56416a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:02.555132Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:02.555150Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1401
2025-09-30T14:54:02.555446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1401 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:02.555493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1401 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:02.555498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1401 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:02.555503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:02.556406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1401 sessionId:  describe result for acl check
2025-09-30T14:54:02.556444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:02.556446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:02.556451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:02.556456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895628089893477:8553] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:02.556994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895628089893477:8553] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:02.573821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895628089893477:8553] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:02.582231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895628089893477:8553] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:02.582257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895628089893477:8553] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:02.582261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895628089893477:8553] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:02.582271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1401 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:02.600869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:02.606314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:02.606894Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:02.606899Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:02.606916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:02.607000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:02.607041Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895628000142624:8489]
2025-09-30T14:54:02.607757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:02.608232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:02.608312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:02.608693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:02.608796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:02.608803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:02.608805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:02.608806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:02.608807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:02.608809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:02.608810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:02.608812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:02.608813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:02.608815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:02.608816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:02.608818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:02.608819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:02.608820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:02.608822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:02.608829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:02.608840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:02.608844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:02.608848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:02.608853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:02.608857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:02.608860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:02.608863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:02.608867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:02.608871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:02.608875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:02.608879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:02.608883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:02.608886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:02.608890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:02.608898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:02.608906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:02.608914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:02.608920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:02.608926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:02.608930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:02.608935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:02.608939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:02.608944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:02.608950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:02.608954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:02.608958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:02.608969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:02.608973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:02.608978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:02.608982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:02.608987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:02.608993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:02.608997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:02.609005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:02.609016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:02.609021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:02.609026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:02.609033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:02.609037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:02.609048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:02.609052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:02.609057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:02.609061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:02.609066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:02.609107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:02.615462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:02.616415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:02.616421Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:02.616425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:02.616430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:02.616438Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1400 [2:7555895628000142624:8489]
2025-09-30T14:54:02.616458Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:02.616476Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:02.616480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:02.616484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:02.616487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:02.616505Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:02.616513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:02.616522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:02.616590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:02.616592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:02.616595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:02.616598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:02.616601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:02.616677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:02.616680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:02.616696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:02.616709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:02.616729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:02.616748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895628000142619:8489]
2025-09-30T14:54:02.616750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895628000142619:8489]
2025-09-30T14:54:02.616753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895628000142619:8489]
2025-09-30T14:54:02.616763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:02.616779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:02.616782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:02.616786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:02.616789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:02.616794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:02.616798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:02.616810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895628089893558:8553], now have 1 active actors on pipe
2025-09-30T14:54:02.616814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895628089893467:2454], now have 1 active actors on pipe
2025-09-30T14:54:02.616851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895628000142619:8489]
2025-09-30T14:54:02.616860Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:02.616867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:02.617309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1400
2025-09-30T14:54:02.617351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1400
2025-09-30T14:54:02.617788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:02.617804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:02.617835Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|722ed525-77131299-8278c311-94b13018_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:02.617850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:02.617859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:02.617862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:02.617874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:02.617892Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:02.617914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:02.618173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:02.618199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:02.618230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:02.618348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1401 partition: 0 MaxSeqNo: 42 sessionId: src_id|722ed525-77131299-8278c311-94b13018_0
2025-09-30T14:54:02.619022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f837f2-d9a6d787-6c4a4d3a-4c56416a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|722ed525-77131299-8278c311-94b13018_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:02.622128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|722ed525-77131299-8278c311-94b13018_0] Write session: try to update token
2025-09-30T14:54:02.622152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|722ed525-77131299-8278c311-94b13018_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:02.631810Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:02.631835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:02.631838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:02.631841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:02.631853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895628000142619:8489]
2025-09-30T14:54:02.631857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895628000142619:8489]
2025-09-30T14:54:02.631861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895628000142619:8489]
2025-09-30T14:54:02.631907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:02.631913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:02.631917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:02.632066Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:02.635772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:02.635795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:02.635800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:02.639551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895628089893707:2659]
2025-09-30T14:54:02.640043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1400, pipe: [1:7555895628089893707:2659]
2025-09-30T14:54:02.645610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1401 sessionId: src_id|722ed525-77131299-8278c311-94b13018_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:02.648675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:02.780910Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:02.781308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895628089893707:2659], now have 1 active actors on pipe
2025-09-30T14:54:02.781377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:02.781392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:02.781822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:02.781915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1401 reason: status is not ok: tablet will be restarted right now sessionId: src_id|722ed525-77131299-8278c311-94b13018_0
2025-09-30T14:54:02.781646Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:02.782148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1401 sessionId: src_id|722ed525-77131299-8278c311-94b13018_0 is DEAD
2025-09-30T14:54:02.782421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:02.782462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895628089893707:2659]
2025-09-30T14:54:02.782483Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:54:02.782595Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 14 consumer shared/user session shared/user_1_14_6350084907575744875_v1 is DEAD
2025-09-30T14:54:02.782736Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895546485494756:2665] disconnected; active server actors: 1
2025-09-30T14:54:02.782745Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895546485494756:2665] client user disconnected session shared/user_1_14_6350084907575744875_v1
2025-09-30T14:54:02.782819Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:54:02.782979Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:54:02.782984Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:54:02.782992Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.007141s
2025-09-30T14:54:02.784595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|722ed525-77131299-8278c311-94b13018_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:02.784609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|722ed525-77131299-8278c311-94b13018_0] Write session will restart in 0.005786s
2025-09-30T14:54:02.784633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|722ed525-77131299-8278c311-94b13018_0] Write session: Do CDS request
2025-09-30T14:54:02.784640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|722ed525-77131299-8278c311-94b13018_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:02.790781Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:54:02.795506Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:54:02.795523Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 15
2025-09-30T14:54:02.796065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|722ed525-77131299-8278c311-94b13018_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:02.795803Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 15 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:54:02.795855Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:54:02.795946Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 auth for : user
2025-09-30T14:54:02.797223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:02.797236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1402
2025-09-30T14:54:02.798388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1402 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:02.798437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1402 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:02.798443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1402 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:02.798448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:02.798908Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 Handle describe topics response
2025-09-30T14:54:02.798942Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 auth is DEAD
2025-09-30T14:54:02.798951Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:54:02.799347Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:54:02.799421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1402 sessionId:  describe result for acl check
2025-09-30T14:54:02.799456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:02.799458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:02.799460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:02.799467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895628089893727:8559] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:02.800174Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_15_5234116388836621563_v1
2025-09-30T14:54:02.800040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895628089893727:8559] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:02.801145Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895628089893726:8557] connected; active server actors: 1
2025-09-30T14:54:02.801237Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555895628089893726:8557] session shared/user_1_15_5234116388836621563_v1
2025-09-30T14:54:02.801249Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:54:02.801258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:54:02.801265Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_15_5234116388836621563_v1" (Sender=[1:7555895628089893715:8557], Pipe=[1:7555895628089893726:8557], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:54:02.801269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:54:02.801289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:54:02.801297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_15_5234116388836621563_v1" (Sender=[1:7555895628089893715:8557], Pipe=[1:7555895628089893726:8557], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:54:02.801307Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_15_5234116388836621563_v1" sender [1:7555895628089893715:8557] lock partition 0 for ReadingSession "shared/user_1_15_5234116388836621563_v1" (Sender=[1:7555895628089893715:8557], Pipe=[1:7555895628089893726:8557], Partitions=[], ActiveFamilyCount=1) generation 1 step 15
2025-09-30T14:54:02.801315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:54:02.801320Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000029s
2025-09-30T14:54:02.801566Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 15 Session: "shared/user_1_15_5234116388836621563_v1" ClientId: "user" PipeClient { RawX1: 7555895628089893726 RawX2: 4503603922346349 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:54:02.801583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:54:02.810169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895628089893727:8559] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:02.823023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895628089893727:8559] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:02.823061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895628089893727:8559] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:02.823066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895628089893727:8559] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:02.823075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1402 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:02.837165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:02.843734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:02.844012Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:02.844018Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:02.844031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:02.844104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:02.844172Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895628000142864:8492]
2025-09-30T14:54:02.844939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:02.845879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:02.845974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:02.846251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:02.846315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:02.846322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:02.846323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:02.846324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:02.846326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:02.846327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:02.846329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:02.846330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:02.846331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:02.846333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:02.846334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:02.846336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:02.846337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:02.846338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:02.846340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:02.846347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:02.846359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:02.846363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:02.846367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:02.846372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:02.846377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:02.846381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:02.846386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:02.846391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:02.846396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:02.846401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:02.846405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:02.846410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:02.846415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:02.846420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:02.846429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:02.846445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:02.846451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:02.846458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:02.846463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:02.846467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:02.846469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:02.846472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:02.846475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:02.846479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:02.846482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:02.846486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:02.846490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:02.846493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:02.846496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:02.846499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:02.846503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:02.846506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:02.846509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:02.846512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:02.846515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:02.846520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:02.846523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:02.846526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:02.846529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:02.846532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:02.846535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:02.846538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:02.846541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:02.846544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:02.846572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:02.854706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:02.856038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:02.856057Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:02.856060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:02.856064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:02.856071Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1401 [2:7555895628000142864:8492]
2025-09-30T14:54:02.856090Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:02.856107Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:02.856111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:02.856114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:02.856117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:02.856134Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:02.856141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:02.856163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:02.856239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:02.856248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:02.856250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:02.856255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:02.856257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:02.856332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:02.856341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:02.856358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:02.856377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:02.856402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:02.856424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895628000142858:8492]
2025-09-30T14:54:02.856432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895628000142858:8492]
2025-09-30T14:54:02.856434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895628000142858:8492]
2025-09-30T14:54:02.856451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:02.856478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:02.856500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:02.856509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:02.856550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895628000142858:8492]
2025-09-30T14:54:02.856558Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:02.856609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:02.856620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:02.856622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:02.856629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:02.856785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895628089893855:8559], now have 1 active actors on pipe
2025-09-30T14:54:02.856798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895628089893737:8563], now have 1 active actors on pipe
2025-09-30T14:54:02.856801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895628089893709:2454], now have 1 active actors on pipe
2025-09-30T14:54:02.857089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1401, pipe: [1:7555895628089893737:8563]
2025-09-30T14:54:02.857122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1401
2025-09-30T14:54:02.857140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1401
2025-09-30T14:54:02.857597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:02.857611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:02.857626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_15_5234116388836621563_v1 on pipe: [1:7555895628089893737:8563]
2025-09-30T14:54:02.857649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:02.857656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:02.857673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:02.857686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:02.857688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:02.857710Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_15_5234116388836621563_v1
2025-09-30T14:54:02.857713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:02.857751Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c780d682-48af4f26-187ec737-97fce576_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:02.857762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:54:02.857768Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:54:02.857896Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_15_5234116388836621563_v1:1 with generation 1401
2025-09-30T14:54:02.869816Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759244042856 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:54:02.869842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:54:02.869907Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 sending to client partition status
2025-09-30T14:54:02.870723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1402 partition: 0 MaxSeqNo: 42 sessionId: src_id|c780d682-48af4f26-187ec737-97fce576_0
2025-09-30T14:54:02.869372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:54:02.869414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:54:02.869426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:02.869433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:02.869436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:02.869451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:02.869467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:02.869477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:54:02.869492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:54:02.869511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:02.870531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:02.870541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:02.870568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:02.873055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|722ed525-77131299-8278c311-94b13018_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c780d682-48af4f26-187ec737-97fce576_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:02.876251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c780d682-48af4f26-187ec737-97fce576_0] Write session: try to update token
2025-09-30T14:54:02.876274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c780d682-48af4f26-187ec737-97fce576_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:02.881343Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:02.881365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:02.881376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895628000142858:8492]
2025-09-30T14:54:02.881784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:02.881980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:02.882046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:02.882132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:02.882287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:02.882432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:02.882633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:02.882671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:02.894779Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:02.894802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:02.894805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:02.894807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:02.894818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895628000142858:8492]
2025-09-30T14:54:02.894823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895628000142858:8492]
2025-09-30T14:54:02.894827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895628000142858:8492]
2025-09-30T14:54:02.894874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:02.894882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:02.894884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:02.894894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:02.894902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:02.894907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:02.895022Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:02.897057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1402 sessionId: src_id|c780d682-48af4f26-187ec737-97fce576_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:02.899961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:03.045317Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:03.045739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:03.045751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:03.045955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_15_5234116388836621563_v1
2025-09-30T14:54:03.045971Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:03.046225Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_15_5234116388836621563_v1
2025-09-30T14:54:03.046457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:03.046539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1402 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c780d682-48af4f26-187ec737-97fce576_0
2025-09-30T14:54:03.046726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1402 sessionId: src_id|c780d682-48af4f26-187ec737-97fce576_0 is DEAD
2025-09-30T14:54:03.046787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895628089893737:8563]
2025-09-30T14:54:03.046805Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:03.046885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c780d682-48af4f26-187ec737-97fce576_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:03.046896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c780d682-48af4f26-187ec737-97fce576_0] Write session will restart in 0.005501s
2025-09-30T14:54:03.046923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c780d682-48af4f26-187ec737-97fce576_0] Write session: Do CDS request
2025-09-30T14:54:03.046932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c780d682-48af4f26-187ec737-97fce576_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:03.055811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c780d682-48af4f26-187ec737-97fce576_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:03.056834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:03.056855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1403
2025-09-30T14:54:03.056969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1403 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:03.057014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1403 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:03.057020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1403 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:03.057025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:03.057421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1403 sessionId:  describe result for acl check
2025-09-30T14:54:03.057455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:03.057462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:03.057464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:03.057470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895632384861275:8566] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:03.058034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895632384861275:8566] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:03.063422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895632384861275:8566] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:03.073136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895632384861275:8566] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:03.073159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895632384861275:8566] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:03.073163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895632384861275:8566] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:03.073173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1403 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:03.093352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:03.096497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:03.096732Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:03.096735Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:03.096747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:03.096806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:03.096843Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895632295110398:8494]
2025-09-30T14:54:03.097490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:03.097874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:03.097906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:03.098243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:03.098313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:03.098314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:03.098315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:03.098317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:03.098318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:03.098319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:03.098320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:03.098322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:03.098323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:03.098324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:03.098325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:03.098326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:03.098328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:03.098329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:03.098330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:03.098336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:03.098346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:03.098351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:03.098355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:03.098359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:03.098363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:03.098367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:03.098371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:03.098375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:03.098380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:03.098384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:03.098388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:03.098392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:03.098396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:03.098400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:03.098409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:03.098417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:03.098424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:03.098429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:03.098433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:03.098437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:03.098441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:03.098446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:03.098451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:03.098457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:03.098461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:03.098466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:03.098471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:03.098476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:03.098480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:03.098484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:03.098489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:03.098494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:03.098499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:03.098503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:03.098508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:03.098513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:03.098516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:03.098521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:03.098527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:03.098531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:03.098535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:03.098542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:03.098546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:03.098551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:03.098591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:03.112984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:03.114019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:03.114041Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:03.114045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:03.114050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:03.114059Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1402 [2:7555895632295110398:8494]
2025-09-30T14:54:03.114079Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:03.114098Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:03.114102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:03.114106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:03.114109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:03.114126Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:03.114142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:03.114151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:03.114226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:03.114235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:03.114237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:03.114241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:03.114244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:03.114321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:03.114333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:03.114348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:03.114359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:03.114377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:03.114397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895632384861353:8566], now have 1 active actors on pipe
2025-09-30T14:54:03.114405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895632295110392:8494]
2025-09-30T14:54:03.114408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895632295110392:8494]
2025-09-30T14:54:03.114411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895632295110392:8494]
2025-09-30T14:54:03.114424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:03.114434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895632384861261:2454], now have 1 active actors on pipe
2025-09-30T14:54:03.114443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:03.114460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:03.114463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:03.114553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1402
2025-09-30T14:54:03.114597Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1402
2025-09-30T14:54:03.114495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:03.114502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:03.114505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895632295110392:8494]
2025-09-30T14:54:03.114505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:03.114508Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:03.114512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:03.114773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:03.114779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:03.114813Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20afc308-ab710e4d-11122054-4b2444d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:03.114834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:03.114838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:03.114841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:03.114852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:03.114863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:03.114883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:03.115087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:03.115097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:03.115113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:03.115228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1403 partition: 0 MaxSeqNo: 42 sessionId: src_id|20afc308-ab710e4d-11122054-4b2444d0_0
2025-09-30T14:54:03.119553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c780d682-48af4f26-187ec737-97fce576_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|20afc308-ab710e4d-11122054-4b2444d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:03.122517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20afc308-ab710e4d-11122054-4b2444d0_0] Write session: try to update token
2025-09-30T14:54:03.122542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20afc308-ab710e4d-11122054-4b2444d0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:03.140790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:03.140815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:03.140819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:03.140821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:03.140831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895632295110392:8494]
2025-09-30T14:54:03.140837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895632295110392:8494]
2025-09-30T14:54:03.140843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895632295110392:8494]
2025-09-30T14:54:03.140892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:03.140900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:03.140904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:03.141066Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:03.143427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:03.143444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:03.143449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:03.143931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895632384861519:8563]
2025-09-30T14:54:03.147724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1402, pipe: [1:7555895632384861519:8563]
2025-09-30T14:54:03.153111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1403 sessionId: src_id|20afc308-ab710e4d-11122054-4b2444d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:03.156225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:03.273318Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:03.274190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895632384861519:8563], now have 1 active actors on pipe
2025-09-30T14:54:03.274222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:03.274229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:03.278145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895632384861519:8563]
2025-09-30T14:54:03.278188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:03.278262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1403 reason: status is not ok: tablet will be restarted right now sessionId: src_id|20afc308-ab710e4d-11122054-4b2444d0_0
2025-09-30T14:54:03.278489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1403 sessionId: src_id|20afc308-ab710e4d-11122054-4b2444d0_0 is DEAD
2025-09-30T14:54:03.278616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:03.278934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20afc308-ab710e4d-11122054-4b2444d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:03.278946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20afc308-ab710e4d-11122054-4b2444d0_0] Write session will restart in 0.007127s
2025-09-30T14:54:03.278973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20afc308-ab710e4d-11122054-4b2444d0_0] Write session: Do CDS request
2025-09-30T14:54:03.278980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20afc308-ab710e4d-11122054-4b2444d0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:03.275661Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:03.294758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20afc308-ab710e4d-11122054-4b2444d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:03.295594Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:03.295617Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1404
2025-09-30T14:54:03.296050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1404 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:03.296115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1404 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:03.296127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1404 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:03.296137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:03.296721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1404 sessionId:  describe result for acl check
2025-09-30T14:54:03.296766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:03.296768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:03.296771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:03.296777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895632384861529:8572] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:03.297374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895632384861529:8572] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:03.303644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895632384861529:8572] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:03.314262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895632384861529:8572] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:03.314288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895632384861529:8572] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:03.314292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895632384861529:8572] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:03.314302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1404 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:03.346473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:03.358478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:03.358734Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:03.358750Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:03.358761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:03.358823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:03.358874Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895632295110651:8497]
2025-09-30T14:54:03.359614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:03.360102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:03.360159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:03.360548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:03.360616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:03.360618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:03.360619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:03.360621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:03.360622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:03.360624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:03.360626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:03.360628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:03.360629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:03.360630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:03.360632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:03.360634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:03.360635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:03.360637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:03.360638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:03.360644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:03.360656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:03.360662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:03.360667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:03.360672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:03.360676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:03.360681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:03.360686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:03.360691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:03.360696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:03.360702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:03.360706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:03.360711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:03.360716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:03.360720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:03.360731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:03.360739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:03.360746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:03.360751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:03.360757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:03.360763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:03.360769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:03.360775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:03.360793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:03.360799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:03.360804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:03.360811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:03.360817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:03.360823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:03.360828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:03.360834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:03.360840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:03.360845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:03.360851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:03.360858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:03.360864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:03.360870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:03.360875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:03.360882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:03.360887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:03.360894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:03.360899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:03.360906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:03.360911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:03.360918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:03.360969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:03.370390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:03.371414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:03.371430Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:03.371432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:03.371436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:03.371443Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1403 [2:7555895632295110651:8497]
2025-09-30T14:54:03.371458Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:03.371472Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:03.371475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:03.371478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:03.371480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:03.371497Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:03.371506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:03.371513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:03.371576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:03.371578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:03.371581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:03.371584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:03.371587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:03.371661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:03.371664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:03.371676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:03.371688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:03.371708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:03.371725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895632295110645:8497]
2025-09-30T14:54:03.371728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895632295110645:8497]
2025-09-30T14:54:03.371731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895632295110645:8497]
2025-09-30T14:54:03.371739Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:03.371755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:03.371757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:03.371762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:03.371764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:03.371771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:03.371774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:03.371784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895632384861569:8572], now have 1 active actors on pipe
2025-09-30T14:54:03.371788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895632384861520:2454], now have 1 active actors on pipe
2025-09-30T14:54:03.371823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895632295110645:8497]
2025-09-30T14:54:03.371832Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:03.371840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:03.374086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1403
2025-09-30T14:54:03.374185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1403
2025-09-30T14:54:03.375342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:03.375357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:03.375396Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74405f90-58537488-7ee0ff6d-fc8d1d37_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:03.375408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:03.375413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:03.375415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:03.375427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:03.375443Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:03.375465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:03.382565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895632384861790:8563]
2025-09-30T14:54:03.383415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:03.383436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:03.383456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895632384861790:8563], now have 1 active actors on pipe
2025-09-30T14:54:03.383478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:03.384544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1403, pipe: [1:7555895632384861790:8563]
2025-09-30T14:54:03.384600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1404 partition: 0 MaxSeqNo: 42 sessionId: src_id|74405f90-58537488-7ee0ff6d-fc8d1d37_0
2025-09-30T14:54:03.387110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20afc308-ab710e4d-11122054-4b2444d0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|74405f90-58537488-7ee0ff6d-fc8d1d37_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:03.390039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74405f90-58537488-7ee0ff6d-fc8d1d37_0] Write session: try to update token
2025-09-30T14:54:03.390057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74405f90-58537488-7ee0ff6d-fc8d1d37_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:03.396643Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:03.396664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:03.396666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:03.396669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:03.396679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895632295110645:8497]
2025-09-30T14:54:03.396684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895632295110645:8497]
2025-09-30T14:54:03.396688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895632295110645:8497]
2025-09-30T14:54:03.396734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:03.396743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:03.396747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:03.396756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:03.396763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:03.396771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:03.396918Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:03.424935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1404 sessionId: src_id|74405f90-58537488-7ee0ff6d-fc8d1d37_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:03.428105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:03.567600Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:03.568136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:03.568146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:03.568652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:03.568674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:03.568743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1404 reason: error at write: Disconnected sessionId: src_id|74405f90-58537488-7ee0ff6d-fc8d1d37_0
2025-09-30T14:54:03.568960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1404 sessionId: src_id|74405f90-58537488-7ee0ff6d-fc8d1d37_0 is DEAD
2025-09-30T14:54:03.568976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:03.569025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895632384861790:8563]
2025-09-30T14:54:03.569450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74405f90-58537488-7ee0ff6d-fc8d1d37_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:03.569459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74405f90-58537488-7ee0ff6d-fc8d1d37_0] Write session will restart in 0.008010s
2025-09-30T14:54:03.569483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74405f90-58537488-7ee0ff6d-fc8d1d37_0] Write session: Do CDS request
2025-09-30T14:54:03.569488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74405f90-58537488-7ee0ff6d-fc8d1d37_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:03.569604Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:03.578834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74405f90-58537488-7ee0ff6d-fc8d1d37_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:03.578924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:03.578945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1405
2025-09-30T14:54:03.579132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1405 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:03.579172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1405 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:03.579178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1405 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:03.579184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:03.579629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1405 sessionId:  describe result for acl check
2025-09-30T14:54:03.579667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:03.579669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:03.579672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:03.579678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895632384861821:8585] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:03.580257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895632384861821:8585] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:03.585082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895632384861821:8585] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:03.594127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895632384861821:8585] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:03.594148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895632384861821:8585] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:03.594152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895632384861821:8585] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:03.594161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1405 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:03.612034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:03.615826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:03.616094Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:03.616105Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:03.616119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:03.616184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:03.616226Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895632295110925:8512]
2025-09-30T14:54:03.616899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:03.618340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:03.618407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:03.618828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:03.618897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:03.618906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:03.618907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:03.618909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:03.618910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:03.618912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:03.618913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:03.618915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:03.618916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:03.618917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:03.618918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:03.618920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:03.618921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:03.618922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:03.618923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:03.618930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:03.618942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:03.618947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:03.618952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:03.618956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:03.618961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:03.618965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:03.618970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:03.618974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:03.618979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:03.618983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:03.618986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:03.618991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:03.618995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:03.618999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:03.619008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:03.619019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:03.619025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:03.619031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:03.619036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:03.619042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:03.619047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:03.619053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:03.619058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:03.619063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:03.619068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:03.619074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:03.619079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:03.619085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:03.619090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:03.619096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:03.619101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:03.619107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:03.619112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:03.619118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:03.619123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:03.619129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:03.619134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:03.619140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:03.619146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:03.619151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:03.619155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:03.619161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:03.619166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:03.619172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:03.619222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:03.632188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:03.633294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:03.633315Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:03.633318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:03.633323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:03.633331Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1404 [2:7555895632295110925:8512]
2025-09-30T14:54:03.633349Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:03.633368Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:03.633372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:03.633375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:03.633378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:03.633396Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:03.633404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:03.633417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:03.633489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:03.633501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:03.633503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:03.633508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:03.633510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:03.633585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:03.633594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:03.633608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:03.633621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:03.633640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:03.633663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895632295110919:8512]
2025-09-30T14:54:03.633670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895632295110919:8512]
2025-09-30T14:54:03.633674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895632295110919:8512]
2025-09-30T14:54:03.633685Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:03.633703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:03.633704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:03.633707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:03.633712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:03.633722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:03.633725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:03.633749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895632384861932:8585], now have 1 active actors on pipe
2025-09-30T14:54:03.633759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895632384861808:2454], now have 1 active actors on pipe
2025-09-30T14:54:03.633802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895632295110919:8512]
2025-09-30T14:54:03.633816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:03.633948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:03.639609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1404
2025-09-30T14:54:03.639654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1404
2025-09-30T14:54:03.640086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:03.640110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:03.640158Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e47bb68b-c3395b63-95ff246a-9d742a12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:03.640171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:03.640177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:03.640180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:03.640195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:03.640213Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:03.640246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:03.644081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:03.644112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:03.644147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:03.647680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1405 partition: 0 MaxSeqNo: 42 sessionId: src_id|e47bb68b-c3395b63-95ff246a-9d742a12_0
2025-09-30T14:54:03.651526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74405f90-58537488-7ee0ff6d-fc8d1d37_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e47bb68b-c3395b63-95ff246a-9d742a12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:03.654645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e47bb68b-c3395b63-95ff246a-9d742a12_0] Write session: try to update token
2025-09-30T14:54:03.654668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e47bb68b-c3395b63-95ff246a-9d742a12_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:03.652487Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:03.652506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:03.652509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:03.652512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:03.652521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895632295110919:8512]
2025-09-30T14:54:03.652526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895632295110919:8512]
2025-09-30T14:54:03.652530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895632295110919:8512]
2025-09-30T14:54:03.652572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:03.652578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:03.652581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:03.652731Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:03.655594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:03.655611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:03.655619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:03.667649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895632384862055:8563]
2025-09-30T14:54:03.668073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1404, pipe: [1:7555895632384862055:8563]
2025-09-30T14:54:03.685510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1405 sessionId: src_id|e47bb68b-c3395b63-95ff246a-9d742a12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:03.688429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:03.783305Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:03.783692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895632384862055:8563], now have 1 active actors on pipe
2025-09-30T14:54:03.783727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:03.783740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:03.785096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e47bb68b-c3395b63-95ff246a-9d742a12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:03.785109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e47bb68b-c3395b63-95ff246a-9d742a12_0] Write session will restart in 0.006254s
2025-09-30T14:54:03.785134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e47bb68b-c3395b63-95ff246a-9d742a12_0] Write session: Do CDS request
2025-09-30T14:54:03.785140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e47bb68b-c3395b63-95ff246a-9d742a12_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:03.785264Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:03.784614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:03.784631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:03.784695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1405 reason: error at write: Disconnected sessionId: src_id|e47bb68b-c3395b63-95ff246a-9d742a12_0
2025-09-30T14:54:03.784901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1405 sessionId: src_id|e47bb68b-c3395b63-95ff246a-9d742a12_0 is DEAD
2025-09-30T14:54:03.785035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:03.785070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895632384862055:8563]
2025-09-30T14:54:03.795882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e47bb68b-c3395b63-95ff246a-9d742a12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:03.797730Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:03.797752Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1406
2025-09-30T14:54:03.797988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1406 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:03.798045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1406 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:03.798050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1406 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:03.798054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:03.798650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1406 sessionId:  describe result for acl check
2025-09-30T14:54:03.798697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:03.798705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:03.798708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:03.798714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895632384862065:8589] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:03.799312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895632384862065:8589] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:03.806309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895632384862065:8589] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:03.812327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895632384862065:8589] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:03.812345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895632384862065:8589] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:03.812348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895632384862065:8589] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:03.812355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1406 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:03.827362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:03.830327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:03.830534Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:03.830538Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:03.830550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:03.830598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:03.830633Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895632295111168:8515]
2025-09-30T14:54:03.831332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:03.831748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:03.831798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:03.832140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:03.832192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:03.832193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:03.832194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:03.832195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:03.832196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:03.832197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:03.832199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:03.832200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:03.832202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:03.832203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:03.832204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:03.832205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:03.832207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:03.832208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:03.832209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:03.832215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:03.832227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:03.832231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:03.832236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:03.832240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:03.832245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:03.832249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:03.832253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:03.832257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:03.832262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:03.832266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:03.832270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:03.832274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:03.832278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:03.832282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:03.832291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:03.832299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:03.832305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:03.832311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:03.832316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:03.832322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:03.832326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:03.832332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:03.832337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:03.832342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:03.832346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:03.832352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:03.832358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:03.832363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:03.832367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:03.832371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:03.832376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:03.832385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:03.832391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:03.832396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:03.832401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:03.832407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:03.832411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:03.832416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:03.832422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:03.832427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:03.832431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:03.832437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:03.832442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:03.832462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:03.832511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:03.838757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:03.839676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:03.839696Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:03.839699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:03.839703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:03.839710Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1405 [2:7555895632295111168:8515]
2025-09-30T14:54:03.839729Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:03.839746Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:03.839764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:03.839768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:03.839770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:03.839788Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:03.839795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:03.839803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:03.839854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:03.839856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:03.839858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:03.839861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:03.839863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:03.839918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:03.839920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:03.839929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:03.839936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:03.839952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:03.839969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895632295111163:8515]
2025-09-30T14:54:03.839971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895632295111163:8515]
2025-09-30T14:54:03.839974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895632295111163:8515]
2025-09-30T14:54:03.839986Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:03.839999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:03.840015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:03.840018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:03.840051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895632295111163:8515]
2025-09-30T14:54:03.840054Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:03.840176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:03.840179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:03.840181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:03.840185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:03.840879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1405
2025-09-30T14:54:03.840911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1405
2025-09-30T14:54:03.841627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895632384862116:8589], now have 1 active actors on pipe
2025-09-30T14:54:03.841638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895632384862057:2454], now have 1 active actors on pipe
2025-09-30T14:54:03.841651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:03.841663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:03.841694Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a312be0d-6b37abca-6b0addcc-80d8b662_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:03.841703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:03.841708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:03.841711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:03.841722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:03.841735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:03.841753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:03.842092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:03.842098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:03.842113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:03.842258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1406 partition: 0 MaxSeqNo: 42 sessionId: src_id|a312be0d-6b37abca-6b0addcc-80d8b662_0
2025-09-30T14:54:03.843345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e47bb68b-c3395b63-95ff246a-9d742a12_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a312be0d-6b37abca-6b0addcc-80d8b662_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:03.846170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a312be0d-6b37abca-6b0addcc-80d8b662_0] Write session: try to update token
2025-09-30T14:54:03.846191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a312be0d-6b37abca-6b0addcc-80d8b662_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:03.855274Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:03.855292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:03.855294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:03.855297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:03.855307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895632295111163:8515]
2025-09-30T14:54:03.855312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895632295111163:8515]
2025-09-30T14:54:03.855317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895632295111163:8515]
2025-09-30T14:54:03.855362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:03.855369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:03.855373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:03.855363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:03.855379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:03.855388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:03.855531Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:03.871639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1406 sessionId: src_id|a312be0d-6b37abca-6b0addcc-80d8b662_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:03.874566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:03.887600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895632384862305:8563]
2025-09-30T14:54:03.891544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1405, pipe: [1:7555895632384862305:8563]
2025-09-30T14:54:03.983621Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:03.984357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:03.984368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:03.984407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895632384862305:8563], now have 1 active actors on pipe
2025-09-30T14:54:03.984766Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:03.984760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:03.984779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:03.984847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1406 reason: error at write: Disconnected sessionId: src_id|a312be0d-6b37abca-6b0addcc-80d8b662_0
2025-09-30T14:54:03.985019Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:03.985067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1406 sessionId: src_id|a312be0d-6b37abca-6b0addcc-80d8b662_0 is DEAD
2025-09-30T14:54:03.985072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895632384862305:8563]
2025-09-30T14:54:03.985543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a312be0d-6b37abca-6b0addcc-80d8b662_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:03.985554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a312be0d-6b37abca-6b0addcc-80d8b662_0] Write session will restart in 0.008553s
2025-09-30T14:54:03.985578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a312be0d-6b37abca-6b0addcc-80d8b662_0] Write session: Do CDS request
2025-09-30T14:54:03.985588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a312be0d-6b37abca-6b0addcc-80d8b662_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:04.000156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a312be0d-6b37abca-6b0addcc-80d8b662_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:04.003348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:04.003371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1407
2025-09-30T14:54:04.003565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1407 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:04.003596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1407 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:04.003602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1407 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:04.003607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:04.007555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1407 sessionId:  describe result for acl check
2025-09-30T14:54:04.007604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:04.007607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:04.007609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:04.007616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895636679829673:8593] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:04.008230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895636679829673:8593] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:04.015858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895636679829673:8593] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:04.024133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895636679829673:8593] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:04.024163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895636679829673:8593] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:04.024170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895636679829673:8593] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:04.024191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1407 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:04.029086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:04.033707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:04.033994Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:04.034011Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:04.034024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:04.034089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:04.034277Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895636590078704:8517]
2025-09-30T14:54:04.035003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:04.035419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:04.035471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:04.035822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:04.035882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:04.035884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:04.035885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:04.035886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:04.035888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:04.035889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:04.035891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:04.035892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:04.035894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:04.035895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:04.035896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.035898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:04.035899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:04.035900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:04.035902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:04.035908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:04.035919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:04.035924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:04.035929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:04.035933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:04.035938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:04.035943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:04.035947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:04.035951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:04.035956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:04.035961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.035965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:04.035970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:04.035974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:04.035979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:04.035986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:04.035995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:04.036002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:04.036009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:04.036015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:04.036021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:04.036029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:04.036035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:04.036040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:04.036046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:04.036052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:04.036058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:04.036063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:04.036069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:04.036074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:04.036080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:04.036086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:04.036092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:04.036097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:04.036102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:04.036107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.036115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.036120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:04.036126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:04.036131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:04.036137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:04.036141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:04.036146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:04.036151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:04.036157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:04.036206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:04.043515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:04.044761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:04.044778Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:04.044781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:04.044786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:04.044793Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1406 [2:7555895636590078704:8517]
2025-09-30T14:54:04.044809Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:04.044825Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:04.044834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:04.044838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:04.044840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:04.044860Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:04.044871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:04.044882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:04.044947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.044954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:04.044956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:04.044960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:04.044963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:04.045032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:04.045039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.045054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:04.045066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:04.045083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:04.045103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895636679829838:8593], now have 1 active actors on pipe
2025-09-30T14:54:04.045113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895632384862310:2454], now have 1 active actors on pipe
2025-09-30T14:54:04.045119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895636590078698:8517]
2025-09-30T14:54:04.045121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895636590078698:8517]
2025-09-30T14:54:04.045124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895636590078698:8517]
2025-09-30T14:54:04.045138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:04.045152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:04.045156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:04.045162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:04.045165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:04.045171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:04.045175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:04.045212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895636590078698:8517]
2025-09-30T14:54:04.045226Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:04.045243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:04.045260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1406
2025-09-30T14:54:04.045301Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1406
2025-09-30T14:54:04.045447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:04.045459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:04.045491Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33244b6-70c9e5ac-8989a046-dcd65e50_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:04.045497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:04.045500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:04.045501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:04.045509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:04.045517Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:04.045529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:04.045758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:04.045775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:04.045809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:04.045944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1407 partition: 0 MaxSeqNo: 42 sessionId: src_id|33244b6-70c9e5ac-8989a046-dcd65e50_0
2025-09-30T14:54:04.048020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a312be0d-6b37abca-6b0addcc-80d8b662_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|33244b6-70c9e5ac-8989a046-dcd65e50_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:04.050941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33244b6-70c9e5ac-8989a046-dcd65e50_0] Write session: try to update token
2025-09-30T14:54:04.050965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33244b6-70c9e5ac-8989a046-dcd65e50_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:04.060308Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:04.060327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:04.060329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:04.060331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:04.060344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895636590078698:8517]
2025-09-30T14:54:04.060349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895636590078698:8517]
2025-09-30T14:54:04.060354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895636590078698:8517]
2025-09-30T14:54:04.060399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:04.060406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.060409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:04.060569Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:04.061526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:04.061533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:04.061538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:04.081790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1407 sessionId: src_id|33244b6-70c9e5ac-8989a046-dcd65e50_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:04.083931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895636679829856:8563]
2025-09-30T14:54:04.084766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:04.085061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1406, pipe: [1:7555895636679829856:8563]
2025-09-30T14:54:04.182800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:04.182815Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:04.182819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:04.182870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895636679829856:8563]
2025-09-30T14:54:04.182884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1407 reason: error at write: Disconnected sessionId: src_id|33244b6-70c9e5ac-8989a046-dcd65e50_0
2025-09-30T14:54:04.183300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33244b6-70c9e5ac-8989a046-dcd65e50_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:04.183313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33244b6-70c9e5ac-8989a046-dcd65e50_0] Write session will restart in 0.005177s
2025-09-30T14:54:04.183338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33244b6-70c9e5ac-8989a046-dcd65e50_0] Write session: Do CDS request
2025-09-30T14:54:04.183345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33244b6-70c9e5ac-8989a046-dcd65e50_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:04.183104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1407 sessionId: src_id|33244b6-70c9e5ac-8989a046-dcd65e50_0 is DEAD
2025-09-30T14:54:04.182129Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:04.182456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:04.182464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:04.182480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895636679829856:8563], now have 1 active actors on pipe
2025-09-30T14:54:04.183130Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:04.191857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33244b6-70c9e5ac-8989a046-dcd65e50_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:04.191945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:04.191965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1408
2025-09-30T14:54:04.195626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1408 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:04.195688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1408 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:04.195694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1408 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:04.195700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:04.196317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1408 sessionId:  describe result for acl check
2025-09-30T14:54:04.196354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:04.196356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:04.196359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:04.196365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895636679829869:8598] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:04.196946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895636679829869:8598] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:04.202384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895636679829869:8598] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:04.212612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895636679829869:8598] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:04.212636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895636679829869:8598] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:04.212640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895636679829869:8598] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:04.212650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1408 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:04.224552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:04.227881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:04.228123Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:04.228127Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:04.228139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:04.228194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:04.228236Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895636590078947:8519]
2025-09-30T14:54:04.228946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:04.229431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:04.229514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:04.229916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:04.230006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:04.230013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:04.230014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:04.230016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:04.230017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:04.230018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:04.230019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:04.230020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:04.230022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:04.230023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:04.230024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.230025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:04.230026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:04.230028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:04.230029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:04.230035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:04.230047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:04.230052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:04.230055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:04.230059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:04.230063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:04.230068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:04.230073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:04.230078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:04.230082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:04.230087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.230090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:04.230094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:04.230098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:04.230101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:04.230111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:04.230120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:04.230127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:04.230133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:04.230139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:04.230145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:04.230150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:04.230157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:04.230162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:04.230169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:04.230180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:04.230186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:04.230192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:04.230197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:04.230202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:04.230208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:04.230213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:04.230219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:04.230224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:04.230229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:04.230235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.230240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.230245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:04.230251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:04.230258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:04.230263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:04.230268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:04.230273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:04.230277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:04.230284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:04.230329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:04.237540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:04.238580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:04.238601Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:04.238605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:04.238610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:04.238617Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1407 [2:7555895636590078947:8519]
2025-09-30T14:54:04.238640Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:04.238660Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:04.238663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:04.238666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:04.238669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:04.238686Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:04.238700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:04.238708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:04.238786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.238794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:04.238796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:04.238801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:04.238803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:04.238885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:04.238893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.238909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:04.238926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:04.238943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:04.238969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895636679829937:8598], now have 1 active actors on pipe
2025-09-30T14:54:04.238973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895636679829862:2454], now have 1 active actors on pipe
2025-09-30T14:54:04.238981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895636590078942:8519]
2025-09-30T14:54:04.238983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895636590078942:8519]
2025-09-30T14:54:04.238986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895636590078942:8519]
2025-09-30T14:54:04.239000Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:04.239014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:04.239017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:04.239018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:04.239021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:04.239035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:04.239039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:04.239083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895636590078942:8519]
2025-09-30T14:54:04.239098Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:04.239122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:04.239380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1407
2025-09-30T14:54:04.239420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1407
2025-09-30T14:54:04.239784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:04.239800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:04.239834Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7418afb3-5ddf24ab-39827772-e8622e26_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:04.239850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:04.239860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:04.239863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:04.239877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:04.239901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:04.239926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:04.240665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:04.240680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:04.240705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:04.240832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1408 partition: 0 MaxSeqNo: 42 sessionId: src_id|7418afb3-5ddf24ab-39827772-e8622e26_0
2025-09-30T14:54:04.243747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33244b6-70c9e5ac-8989a046-dcd65e50_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7418afb3-5ddf24ab-39827772-e8622e26_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:04.246930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7418afb3-5ddf24ab-39827772-e8622e26_0] Write session: try to update token
2025-09-30T14:54:04.246957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7418afb3-5ddf24ab-39827772-e8622e26_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:04.259592Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:04.259615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:04.259617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:04.259620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:04.259631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895636590078942:8519]
2025-09-30T14:54:04.259636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895636590078942:8519]
2025-09-30T14:54:04.259640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895636590078942:8519]
2025-09-30T14:54:04.259685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:04.259693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.259696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:04.259845Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:04.262284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:04.262303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:04.262309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:04.283281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895636679830111:8563]
2025-09-30T14:54:04.283330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1408 sessionId: src_id|7418afb3-5ddf24ab-39827772-e8622e26_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:04.286612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:04.287335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1407, pipe: [1:7555895636679830111:8563]
2025-09-30T14:54:04.377472Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:04.378179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:04.378190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:04.378210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895636679830111:8563], now have 1 active actors on pipe
2025-09-30T14:54:04.384486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7418afb3-5ddf24ab-39827772-e8622e26_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:04.384503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7418afb3-5ddf24ab-39827772-e8622e26_0] Write session will restart in 0.007960s
2025-09-30T14:54:04.384553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7418afb3-5ddf24ab-39827772-e8622e26_0] Write session: Do CDS request
2025-09-30T14:54:04.384560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7418afb3-5ddf24ab-39827772-e8622e26_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:04.384008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:04.384122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1408 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7418afb3-5ddf24ab-39827772-e8622e26_0
2025-09-30T14:54:04.384314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1408 sessionId: src_id|7418afb3-5ddf24ab-39827772-e8622e26_0 is DEAD
2025-09-30T14:54:04.384450Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:04.384487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895636679830111:8563]
2025-09-30T14:54:04.383564Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:04.393883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7418afb3-5ddf24ab-39827772-e8622e26_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:04.393981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:04.394010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1409
2025-09-30T14:54:04.394250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1409 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:04.394297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1409 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:04.394304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1409 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:04.394308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:04.394814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1409 sessionId:  describe result for acl check
2025-09-30T14:54:04.394856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:04.394859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:04.394863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:04.394868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895636679830134:8603] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:04.395447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895636679830134:8603] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:04.398744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895636679830134:8603] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:04.407096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895636679830134:8603] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:04.407121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895636679830134:8603] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:04.407125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895636679830134:8603] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:04.407136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1409 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:04.417958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:04.421776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:04.422103Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:04.422114Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:04.422126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:04.422214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:04.422260Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895636590079201:8523]
2025-09-30T14:54:04.422934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:04.423302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:04.423373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:04.423751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:04.423830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:04.423838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:04.423839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:04.423840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:04.423841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:04.423843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:04.423844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:04.423845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:04.423847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:04.423848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:04.423850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.423851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:04.423852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:04.423853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:04.423854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:04.423860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:04.423871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:04.423874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:04.423878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:04.423882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:04.423887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:04.423891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:04.423895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:04.423899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:04.423903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:04.423907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.423910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:04.423914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:04.423917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:04.423921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:04.423931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:04.423940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:04.423946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:04.423952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:04.423957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:04.423962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:04.423966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:04.423972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:04.423977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:04.423983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:04.423988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:04.423993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:04.423998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:04.424003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:04.424008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:04.424014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:04.424019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:04.424024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:04.424029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:04.424035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:04.424041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.424045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.424050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:04.424056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:04.424062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:04.424068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:04.424072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:04.424078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:04.424087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:04.424092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:04.424136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:04.432828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:04.434150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:04.434177Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:04.434179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:04.434183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:04.434189Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1408 [2:7555895636590079201:8523]
2025-09-30T14:54:04.434206Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:04.434224Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:04.434227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:04.434231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:04.434233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:04.434249Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:04.434256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:04.434264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:04.434330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.434340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:04.434343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:04.434347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:04.434349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:04.434421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:04.434430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.434444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:04.434464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:04.434488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:04.434633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1408
2025-09-30T14:54:04.434633Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1408
2025-09-30T14:54:04.434513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895636679830126:2454], now have 1 active actors on pipe
2025-09-30T14:54:04.434526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895636679830223:8603], now have 1 active actors on pipe
2025-09-30T14:54:04.434533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895636590079196:8523]
2025-09-30T14:54:04.434536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895636590079196:8523]
2025-09-30T14:54:04.434539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895636590079196:8523]
2025-09-30T14:54:04.434553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:04.434568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:04.434573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:04.434577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:04.434580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:04.434585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:04.434588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:04.434629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895636590079196:8523]
2025-09-30T14:54:04.434636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:04.434643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:04.434696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:04.434702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:04.434731Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6ee9387d-e96129b7-a5f24691-1bbd691a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:04.434738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:04.434743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:04.434746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:04.434756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:04.434765Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:04.434781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:04.435299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:04.435311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:04.435335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:04.435472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1409 partition: 0 MaxSeqNo: 42 sessionId: src_id|6ee9387d-e96129b7-a5f24691-1bbd691a_0
2025-09-30T14:54:04.435894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7418afb3-5ddf24ab-39827772-e8622e26_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6ee9387d-e96129b7-a5f24691-1bbd691a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:04.438916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ee9387d-e96129b7-a5f24691-1bbd691a_0] Write session: try to update token
2025-09-30T14:54:04.438937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ee9387d-e96129b7-a5f24691-1bbd691a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:04.458193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1409 sessionId: src_id|6ee9387d-e96129b7-a5f24691-1bbd691a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:04.461133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:04.461414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:04.461440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:04.461477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:04.464147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:04.469028Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:04.469047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:04.469049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:04.469052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:04.469061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895636590079196:8523]
2025-09-30T14:54:04.469066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895636590079196:8523]
2025-09-30T14:54:04.469070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895636590079196:8523]
2025-09-30T14:54:04.469114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:04.469119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:04.469121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.469123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:04.469126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:04.469130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:04.469268Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:04.487454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895636679830390:8563]
2025-09-30T14:54:04.489304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1408, pipe: [1:7555895636679830390:8563]
2025-09-30T14:54:04.595554Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:04.604973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:04.605011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:04.605211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:04.605282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:04.605354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:04.605425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:04.606065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:04.606080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:04.606162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:04.606226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:04.606297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:04.606397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:04.606444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:04.606456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:04.606531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:04.606603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:04.606672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:04.606744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:04.606791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:04.606798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:04.606874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:04.606955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:04.607051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:04.607129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:04.607181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:04.607188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:04.607293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:04.607366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:04.607440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:04.607508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:04.610232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895636679830390:8563]
2025-09-30T14:54:04.610289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:04.610292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:04.610335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1409 reason: error at write: Disconnected sessionId: src_id|6ee9387d-e96129b7-a5f24691-1bbd691a_0
2025-09-30T14:54:04.610568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1409 sessionId: src_id|6ee9387d-e96129b7-a5f24691-1bbd691a_0 is DEAD
2025-09-30T14:54:04.610754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ee9387d-e96129b7-a5f24691-1bbd691a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:04.610764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ee9387d-e96129b7-a5f24691-1bbd691a_0] Write session will restart in 0.005582s
2025-09-30T14:54:04.610799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ee9387d-e96129b7-a5f24691-1bbd691a_0] Write session: Do CDS request
2025-09-30T14:54:04.610805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ee9387d-e96129b7-a5f24691-1bbd691a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:04.610710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:04.607564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:04.607576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:04.607654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:04.607718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:04.607784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:04.607846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:04.607890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:04.607894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:04.607967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:04.608029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:04.608096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:04.608158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:04.608200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:04.608203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:04.608273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:04.608330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:04.608398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:04.608462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:04.608734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:04.608737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:04.608810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:04.608869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:04.608929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:04.608989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:04.609080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:04.609084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:04.609160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:04.609219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:04.609309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:04.609376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:04.609433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:04.609436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:04.609537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895636679830390:8563], now have 1 active actors on pipe
2025-09-30T14:54:04.610816Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:04.617876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ee9387d-e96129b7-a5f24691-1bbd691a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:04.617986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:04.618009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1410
2025-09-30T14:54:04.618252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1410 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:04.618288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1410 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:04.618293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1410 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:04.618298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:04.618889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1410 sessionId:  describe result for acl check
2025-09-30T14:54:04.618925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:04.618928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:04.618930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:04.618937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895636679830413:8615] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:04.619598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895636679830413:8615] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:04.622785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895636679830413:8615] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:04.629273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895636679830413:8615] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:04.629293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895636679830413:8615] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:04.629297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895636679830413:8615] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:04.629306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1410 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:04.708025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895636679830643:8563]
2025-09-30T14:54:04.713331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:04.719605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:04.719896Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:04.719902Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:04.719915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:04.719993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:04.720039Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895636590079483:8537]
2025-09-30T14:54:04.720801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:04.724453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:04.724548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:04.724981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:04.725060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:04.725062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:04.725063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:04.725065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:04.725066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:04.725068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:04.725069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:04.725071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:04.725073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:04.725074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:04.725076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.725077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:04.725079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:04.725080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:04.725082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:04.725090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:04.725102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:04.725107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:04.725112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:04.725117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:04.725127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:04.725132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:04.725136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:04.725141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:04.725146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:04.725153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.725157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:04.725162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:04.725168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:04.725172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:04.725182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:04.725194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:04.725201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:04.725207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:04.725213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:04.725219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:04.725224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:04.725230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:04.725235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:04.725241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:04.725246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:04.725252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:04.725258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:04.725264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:04.725269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:04.725275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:04.725280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:04.725286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:04.725291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:04.725299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:04.725304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.725310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.725315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:04.725321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:04.725328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:04.725334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:04.725340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:04.725347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:04.725352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:04.725360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:04.725410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:04.736261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:04.738080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:04.738088Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:04.738091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:04.738095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:04.738103Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1409 [2:7555895636590079483:8537]
2025-09-30T14:54:04.738120Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:04.738136Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:04.738140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:04.738144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:04.738146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:04.738165Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:04.738172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:04.738180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:04.738250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.738252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:04.738255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:04.738259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:04.738261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:04.738338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:04.738341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.738357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:04.738370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:04.738390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:04.738408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895636590079477:8537]
2025-09-30T14:54:04.738411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895636590079477:8537]
2025-09-30T14:54:04.738413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895636590079477:8537]
2025-09-30T14:54:04.738429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:04.738444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:04.738462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:04.738465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:04.738509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895636590079477:8537]
2025-09-30T14:54:04.738512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:04.738610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:04.738613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:04.738617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:04.738622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:04.739692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895636679830446:8615], now have 1 active actors on pipe
2025-09-30T14:54:04.739710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895636679830405:2454], now have 1 active actors on pipe
2025-09-30T14:54:04.739713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895636679830643:8563], now have 1 active actors on pipe
2025-09-30T14:54:04.739731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:04.739738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:04.739768Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7eb6a9ef-595f1f77-f0d5d672-9afec6b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:04.739778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:04.739783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:04.739785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:04.739797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:04.739811Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:04.739831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:04.740151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:04.740157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:04.740179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:04.739315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1409
2025-09-30T14:54:04.739374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1409
2025-09-30T14:54:04.740778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ee9387d-e96129b7-a5f24691-1bbd691a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7eb6a9ef-595f1f77-f0d5d672-9afec6b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:04.739399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1409, pipe: [1:7555895636679830643:8563]
2025-09-30T14:54:04.740309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1410 partition: 0 MaxSeqNo: 42 sessionId: src_id|7eb6a9ef-595f1f77-f0d5d672-9afec6b2_0
2025-09-30T14:54:04.743802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7eb6a9ef-595f1f77-f0d5d672-9afec6b2_0] Write session: try to update token
2025-09-30T14:54:04.743820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7eb6a9ef-595f1f77-f0d5d672-9afec6b2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:04.767202Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:04.767223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:04.767228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:04.767230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:04.767257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895636590079477:8537]
2025-09-30T14:54:04.767263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895636590079477:8537]
2025-09-30T14:54:04.767268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895636590079477:8537]
2025-09-30T14:54:04.767314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:04.767324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.767327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:04.767489Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:04.767878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:04.767885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:04.767893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:04.772660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1410 sessionId: src_id|7eb6a9ef-595f1f77-f0d5d672-9afec6b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:04.775894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:04.910278Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:04.910628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:04.910644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:04.911002Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:04.911109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:04.911129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:04.911214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1410 reason: error at write: Disconnected sessionId: src_id|7eb6a9ef-595f1f77-f0d5d672-9afec6b2_0
2025-09-30T14:54:04.911437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1410 sessionId: src_id|7eb6a9ef-595f1f77-f0d5d672-9afec6b2_0 is DEAD
2025-09-30T14:54:04.911504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:04.911552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895636679830643:8563]
2025-09-30T14:54:04.911890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eb6a9ef-595f1f77-f0d5d672-9afec6b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:04.911900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eb6a9ef-595f1f77-f0d5d672-9afec6b2_0] Write session will restart in 0.008970s
2025-09-30T14:54:04.911921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eb6a9ef-595f1f77-f0d5d672-9afec6b2_0] Write session: Do CDS request
2025-09-30T14:54:04.911926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eb6a9ef-595f1f77-f0d5d672-9afec6b2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:04.924262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7eb6a9ef-595f1f77-f0d5d672-9afec6b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:04.925778Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:04.925802Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1411
2025-09-30T14:54:04.925980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1411 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:04.926020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1411 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:04.926030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1411 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:04.926035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:04.932339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1411 sessionId:  describe result for acl check
2025-09-30T14:54:04.932390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:04.932393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:04.932395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:04.932401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895636679830671:8619] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:04.932994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895636679830671:8619] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:04.944685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895636679830671:8619] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:04.951109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895636679830671:8619] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:04.951132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895636679830671:8619] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:04.951136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895636679830671:8619] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:04.951146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1411 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:04.967230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:04.972636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:04.972884Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:04.972896Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:04.972908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:04.972963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:04.973011Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895636590079725:8540]
2025-09-30T14:54:04.973772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:04.974234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:04.974290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:04.974651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:04.974731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:04.974737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:04.974739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:04.974740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:04.974742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:04.974743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:04.974744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:04.974746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:04.974748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:04.974749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:04.974750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.974752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:04.974753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:04.974755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:04.974756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:04.974762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:04.974773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:04.974778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:04.974783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:04.974787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:04.974792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:04.974796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:04.974800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:04.974805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:04.974810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:04.974813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.974817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:04.974821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:04.974825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:04.974829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:04.974839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:04.974847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:04.974853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:04.974865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:04.974871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:04.974877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:04.974885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:04.974891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:04.974896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:04.974904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:04.974913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:04.974919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:04.974925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:04.974930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:04.974935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:04.974942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:04.974948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:04.974958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:04.974965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:04.974975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:04.974981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.974991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.974998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:04.975006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:04.975015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:04.975020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:04.975026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:04.975033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:04.975038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:04.975054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:04.975109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:04.981816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:04.982755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:04.982763Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:04.982766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:04.982771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:04.982779Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1410 [2:7555895636590079725:8540]
2025-09-30T14:54:04.982815Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:04.982835Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:04.982839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:04.982843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:04.982845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:04.982863Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:04.982871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:04.982880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:04.982952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.982954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:04.982956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:04.982960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:04.982963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:04.983044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:04.983048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.983063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:04.983078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:04.983098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:04.983117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895636590079719:8540]
2025-09-30T14:54:04.983120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895636590079719:8540]
2025-09-30T14:54:04.983122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895636590079719:8540]
2025-09-30T14:54:04.983138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:04.983152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:04.983169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:04.983172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:04.983211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895636590079719:8540]
2025-09-30T14:54:04.983214Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:04.983339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:04.983341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:04.983344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:04.983350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:04.983636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895636679830657:2454], now have 1 active actors on pipe
2025-09-30T14:54:04.983654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895636679830792:8619], now have 1 active actors on pipe
2025-09-30T14:54:04.984638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1410
2025-09-30T14:54:04.984648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1410
2025-09-30T14:54:04.986568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:04.986590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:04.986625Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48e84e17-883eb6ab-ccaff8f2-4b02a120_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:04.986649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:04.986654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:04.986658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:04.986673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:04.986689Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:04.986708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:04.987038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:04.987055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:04.987081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:04.987217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1411 partition: 0 MaxSeqNo: 42 sessionId: src_id|48e84e17-883eb6ab-ccaff8f2-4b02a120_0
2025-09-30T14:54:04.987722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eb6a9ef-595f1f77-f0d5d672-9afec6b2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|48e84e17-883eb6ab-ccaff8f2-4b02a120_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:04.990863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48e84e17-883eb6ab-ccaff8f2-4b02a120_0] Write session: try to update token
2025-09-30T14:54:04.990887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48e84e17-883eb6ab-ccaff8f2-4b02a120_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:04.998519Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:04.998541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:04.998544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:04.998546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:04.998557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895636590079719:8540]
2025-09-30T14:54:04.998562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895636590079719:8540]
2025-09-30T14:54:04.998565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895636590079719:8540]
2025-09-30T14:54:04.998611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:04.998621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:04.998629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:04.998772Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:05.003368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:05.003379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:05.003396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:05.011787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895640974798206:8563]
2025-09-30T14:54:05.017461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1410, pipe: [1:7555895640974798206:8563]
2025-09-30T14:54:05.022982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1411 sessionId: src_id|48e84e17-883eb6ab-ccaff8f2-4b02a120_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:05.026094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:05.132768Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:05.133703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895640974798206:8563], now have 1 active actors on pipe
2025-09-30T14:54:05.133732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:05.133739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:05.134494Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:05.134542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895640974798206:8563]
2025-09-30T14:54:05.134560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:05.134563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:05.134616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1411 reason: error at write: Disconnected sessionId: src_id|48e84e17-883eb6ab-ccaff8f2-4b02a120_0
2025-09-30T14:54:05.134795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1411 sessionId: src_id|48e84e17-883eb6ab-ccaff8f2-4b02a120_0 is DEAD
2025-09-30T14:54:05.135011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48e84e17-883eb6ab-ccaff8f2-4b02a120_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:05.135037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48e84e17-883eb6ab-ccaff8f2-4b02a120_0] Write session will restart in 0.006543s
2025-09-30T14:54:05.135063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48e84e17-883eb6ab-ccaff8f2-4b02a120_0] Write session: Do CDS request
2025-09-30T14:54:05.135070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48e84e17-883eb6ab-ccaff8f2-4b02a120_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:05.135542Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:05.147704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48e84e17-883eb6ab-ccaff8f2-4b02a120_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:05.149036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:05.149056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1412
2025-09-30T14:54:05.149249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1412 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:05.149283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1412 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:05.149291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1412 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:05.149295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:05.149719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1412 sessionId:  describe result for acl check
2025-09-30T14:54:05.149749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:05.149751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:05.149753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:05.149760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895640974798240:8624] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:05.150378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895640974798240:8624] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:05.155172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895640974798240:8624] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:05.166566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895640974798240:8624] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:05.166590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895640974798240:8624] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:05.166594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895640974798240:8624] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:05.166606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1412 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:05.173353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:05.186024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:05.186291Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:05.186295Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:05.186308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:05.186366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:05.186406Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895640885047266:8542]
2025-09-30T14:54:05.187110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:05.187984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:05.188048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:05.188428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:05.188490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:05.188491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:05.188493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:05.188494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:05.188496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:05.188498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:05.188499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:05.188501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:05.188503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:05.188504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:05.188506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:05.188507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:05.188509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:05.188510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:05.188512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:05.188518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:05.188530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:05.188534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:05.188539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:05.188543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:05.188548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:05.188553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:05.188557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:05.188561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:05.188566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:05.188571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:05.188575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:05.188579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:05.188583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:05.188587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:05.188596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:05.188604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:05.188612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:05.188619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:05.188626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:05.188631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:05.188639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:05.188645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:05.188651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:05.188657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:05.188662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:05.188667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:05.188673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:05.188679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:05.188685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:05.188691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:05.188697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:05.188702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:05.188707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:05.188712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:05.188719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:05.188724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:05.188729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:05.188734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:05.188741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:05.188746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:05.188752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:05.188758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:05.188763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:05.188768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:05.188816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:05.195898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:05.197061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:05.197067Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:05.197070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:05.197075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:05.197082Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1411 [2:7555895640885047266:8542]
2025-09-30T14:54:05.197098Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:05.197115Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:05.197119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:05.197122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:05.197125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:05.197142Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:05.197149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:05.197156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:05.197222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:05.197224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:05.197226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:05.197232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:05.197235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:05.197306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:05.197309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:05.197322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:05.197332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:05.197347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:05.197366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895640885047260:8542]
2025-09-30T14:54:05.197370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895640885047260:8542]
2025-09-30T14:54:05.197372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895640885047260:8542]
2025-09-30T14:54:05.197381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:05.197396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:05.197411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:05.197414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:05.197417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:05.197422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:05.197424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:05.197453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895640885047260:8542]
2025-09-30T14:54:05.197457Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:05.197460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:05.197468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895640974798435:8624], now have 1 active actors on pipe
2025-09-30T14:54:05.197472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895640974798216:2454], now have 1 active actors on pipe
2025-09-30T14:54:05.197819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1411
2025-09-30T14:54:05.197861Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1411
2025-09-30T14:54:05.202472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:05.202495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:05.202536Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e377240b-3c95c0da-f6d9233e-4629f380_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:05.202550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:05.202555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:05.202558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:05.202573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:05.202590Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:05.202614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:05.204339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:05.204360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:05.204394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:05.204912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1412 partition: 0 MaxSeqNo: 42 sessionId: src_id|e377240b-3c95c0da-f6d9233e-4629f380_0
2025-09-30T14:54:05.205419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48e84e17-883eb6ab-ccaff8f2-4b02a120_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e377240b-3c95c0da-f6d9233e-4629f380_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:05.208537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e377240b-3c95c0da-f6d9233e-4629f380_0] Write session: try to update token
2025-09-30T14:54:05.208560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e377240b-3c95c0da-f6d9233e-4629f380_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:05.220822Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:05.220846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:05.220849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:05.220852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:05.220863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895640885047260:8542]
2025-09-30T14:54:05.220868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895640885047260:8542]
2025-09-30T14:54:05.220872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895640885047260:8542]
2025-09-30T14:54:05.220937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:05.220945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:05.220948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:05.221101Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:05.223761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:05.223775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:05.223779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:05.233087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1412 sessionId: src_id|e377240b-3c95c0da-f6d9233e-4629f380_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:05.235035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895640974798469:8563]
2025-09-30T14:54:05.235777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1411, pipe: [1:7555895640974798469:8563]
2025-09-30T14:54:05.236172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:05.356576Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:05.356889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895640974798469:8563], now have 1 active actors on pipe
2025-09-30T14:54:05.356923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:05.356930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:05.357273Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:05.357253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895640974798469:8563]
2025-09-30T14:54:05.357294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:05.357296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:05.357382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1412 reason: error at write: Disconnected sessionId: src_id|e377240b-3c95c0da-f6d9233e-4629f380_0
2025-09-30T14:54:05.357563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1412 sessionId: src_id|e377240b-3c95c0da-f6d9233e-4629f380_0 is DEAD
2025-09-30T14:54:05.357696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:05.357940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e377240b-3c95c0da-f6d9233e-4629f380_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:05.357953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e377240b-3c95c0da-f6d9233e-4629f380_0] Write session will restart in 0.006130s
2025-09-30T14:54:05.357979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e377240b-3c95c0da-f6d9233e-4629f380_0] Write session: Do CDS request
2025-09-30T14:54:05.357988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e377240b-3c95c0da-f6d9233e-4629f380_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:05.365770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e377240b-3c95c0da-f6d9233e-4629f380_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:05.367768Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:05.367788Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1413
2025-09-30T14:54:05.371233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1413 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:05.371305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1413 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:05.371311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1413 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:05.371318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:05.372611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1413 sessionId:  describe result for acl check
2025-09-30T14:54:05.372667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:05.372670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:05.372671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:05.372678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895640974798509:8629] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:05.373239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895640974798509:8629] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:05.378924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895640974798509:8629] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:05.387461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895640974798509:8629] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:05.387491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895640974798509:8629] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:05.387495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895640974798509:8629] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:05.387506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1413 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:05.399912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:05.403989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:05.404265Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:05.404277Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:05.404291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:05.404351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:05.404404Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895640885047524:8546]
2025-09-30T14:54:05.405124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:05.405564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:05.405625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:05.406014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:05.406101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:05.406107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:05.406109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:05.406110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:05.406111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:05.406113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:05.406114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:05.406116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:05.406117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:05.406119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:05.406121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:05.406122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:05.406123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:05.406125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:05.406126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:05.406132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:05.406143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:05.406147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:05.406151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:05.406156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:05.406160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:05.406165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:05.406169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:05.406174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:05.406179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:05.406184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:05.406189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:05.406193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:05.406198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:05.406201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:05.406212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:05.406221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:05.406227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:05.406232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:05.406237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:05.406242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:05.406247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:05.406253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:05.406264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:05.406270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:05.406274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:05.406279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:05.406284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:05.406289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:05.406296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:05.406301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:05.406306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:05.406312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:05.406316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:05.406321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:05.406328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:05.406333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:05.406337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:05.406343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:05.406350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:05.406356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:05.406362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:05.406368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:05.406373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:05.406384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:05.406428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:05.415314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:05.416602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:05.416625Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:05.416629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:05.416633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:05.416641Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1412 [2:7555895640885047524:8546]
2025-09-30T14:54:05.416660Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:05.416680Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:05.416688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:05.416692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:05.416695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:05.416716Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:05.416729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:05.416736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:05.416818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:05.416826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:05.416828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:05.416833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:05.416835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:05.416917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:05.416928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:05.416942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:05.416953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:05.416972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:05.416993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895640974798636:8629], now have 1 active actors on pipe
2025-09-30T14:54:05.417001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895640885047518:8546]
2025-09-30T14:54:05.417003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895640885047518:8546]
2025-09-30T14:54:05.417005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895640885047518:8546]
2025-09-30T14:54:05.417018Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:05.417028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895640974798484:2454], now have 1 active actors on pipe
2025-09-30T14:54:05.417036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:05.417051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:05.417054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:05.417154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1412
2025-09-30T14:54:05.417202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1412
2025-09-30T14:54:05.417095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895640885047518:8546]
2025-09-30T14:54:05.417103Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:05.417263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:05.417267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:05.417269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:05.417276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:05.417615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:05.417632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:05.417667Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|246531e3-77b32238-af164bde-a9c915c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:05.417681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:05.417691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:05.417694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:05.417707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:05.417724Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:05.417752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:05.418373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1413 partition: 0 MaxSeqNo: 42 sessionId: src_id|246531e3-77b32238-af164bde-a9c915c4_0
2025-09-30T14:54:05.418866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e377240b-3c95c0da-f6d9233e-4629f380_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|246531e3-77b32238-af164bde-a9c915c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:05.418169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:05.418184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:05.418207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:05.421870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|246531e3-77b32238-af164bde-a9c915c4_0] Write session: try to update token
2025-09-30T14:54:05.421891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|246531e3-77b32238-af164bde-a9c915c4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:05.431577Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:05.431603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:05.431606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:05.431608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:05.431619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895640885047518:8546]
2025-09-30T14:54:05.431625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895640885047518:8546]
2025-09-30T14:54:05.431630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895640885047518:8546]
2025-09-30T14:54:05.431675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:05.431684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:05.431694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:05.431753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:05.431768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:05.431773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:05.431848Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:05.448925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1413 sessionId: src_id|246531e3-77b32238-af164bde-a9c915c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:05.452124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:05.457599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895640974798737:8563]
2025-09-30T14:54:05.458984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1412, pipe: [1:7555895640974798737:8563]
2025-09-30T14:54:05.574414Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:05.574886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:05.574898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:05.574944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895640974798737:8563], now have 1 active actors on pipe
2025-09-30T14:54:05.575827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:05.575845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:05.575923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1413 reason: error at write: Disconnected sessionId: src_id|246531e3-77b32238-af164bde-a9c915c4_0
2025-09-30T14:54:05.576116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1413 sessionId: src_id|246531e3-77b32238-af164bde-a9c915c4_0 is DEAD
2025-09-30T14:54:05.576264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895640974798737:8563]
2025-09-30T14:54:05.576286Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:05.575734Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:05.579510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|246531e3-77b32238-af164bde-a9c915c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:05.579526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|246531e3-77b32238-af164bde-a9c915c4_0] Write session will restart in 0.008941s
2025-09-30T14:54:05.579555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|246531e3-77b32238-af164bde-a9c915c4_0] Write session: Do CDS request
2025-09-30T14:54:05.579564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|246531e3-77b32238-af164bde-a9c915c4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:05.592012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|246531e3-77b32238-af164bde-a9c915c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:05.593018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:05.593039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1414
2025-09-30T14:54:05.594867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1414 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:05.594917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1414 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:05.594923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1414 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:05.594928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:05.596243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1414 sessionId:  describe result for acl check
2025-09-30T14:54:05.596287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:05.596290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:05.596291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:05.596298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895640974798810:8641] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:05.596870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895640974798810:8641] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:05.606883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895640974798810:8641] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:05.612090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895640974798810:8641] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:05.612108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895640974798810:8641] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:05.612111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895640974798810:8641] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:05.612118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1414 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:05.627471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:05.630359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:05.630561Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:05.630564Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:05.630573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:05.630612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:05.630643Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895640885047807:8560]
2025-09-30T14:54:05.631117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:05.631511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:05.631821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:05.632088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:05.632135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:05.632137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:05.632138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:05.632138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:05.632139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:05.632140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:05.632141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:05.632142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:05.632143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:05.632143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:05.632144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:05.632145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:05.632146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:05.632147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:05.632147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:05.632151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:05.632159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:05.632161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:05.632164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:05.632166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:05.632169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:05.632172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:05.632174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:05.632177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:05.632179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:05.632182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:05.632184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:05.632187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:05.632190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:05.632192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:05.632198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:05.632204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:05.632207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:05.632211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:05.632214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:05.632218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:05.632221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:05.632224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:05.632227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:05.632231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:05.632235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:05.632238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:05.632240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:05.632243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:05.632246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:05.632249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:05.632252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:05.632254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:05.632258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:05.632261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:05.632263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:05.632267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:05.632269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:05.632273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:05.632277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:05.632280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:05.632283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:05.632286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:05.632289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:05.632292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:05.632317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:05.639241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:05.640311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:05.640334Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:05.640338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:05.640343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:05.640351Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1413 [2:7555895640885047807:8560]
2025-09-30T14:54:05.640371Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:05.640391Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:05.640395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:05.640399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:05.640402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:05.640420Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:05.640427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:05.640437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:05.640519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:05.640529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:05.640532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:05.640536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:05.640539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:05.640620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:05.640624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:05.640641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:05.640766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:05.640788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:05.640810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895640974798893:8641], now have 1 active actors on pipe
2025-09-30T14:54:05.640813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895640974798767:2454], now have 1 active actors on pipe
2025-09-30T14:54:05.640820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895640885047802:8560]
2025-09-30T14:54:05.640822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895640885047802:8560]
2025-09-30T14:54:05.640824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895640885047802:8560]
2025-09-30T14:54:05.640837Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:05.640853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:05.640864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:05.640867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:05.640868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:05.640870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:05.640871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:05.640913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895640885047802:8560]
2025-09-30T14:54:05.640925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:05.640930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:05.640944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:05.640949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:05.641003Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e6e048a-69442c18-d2d939fe-ff28824c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:05.641010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:05.641014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:05.641016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:05.641026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:05.641037Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:05.641054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:05.641551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:05.641566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:05.641586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:05.642227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|246531e3-77b32238-af164bde-a9c915c4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5e6e048a-69442c18-d2d939fe-ff28824c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:05.640790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1413
2025-09-30T14:54:05.640792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1413
2025-09-30T14:54:05.641701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1414 partition: 0 MaxSeqNo: 42 sessionId: src_id|5e6e048a-69442c18-d2d939fe-ff28824c_0
2025-09-30T14:54:05.645440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e6e048a-69442c18-d2d939fe-ff28824c_0] Write session: try to update token
2025-09-30T14:54:05.645461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e6e048a-69442c18-d2d939fe-ff28824c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:05.661293Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:05.661324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:05.661336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895640885047802:8560]
2025-09-30T14:54:05.661409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:05.661658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:05.661840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:05.662022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:05.662200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:05.662442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:05.662517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:05.662666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:05.665022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1414 sessionId: src_id|5e6e048a-69442c18-d2d939fe-ff28824c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:05.667032Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:05.667057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:05.667059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:05.667063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:05.667077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895640885047802:8560]
2025-09-30T14:54:05.667083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895640885047802:8560]
2025-09-30T14:54:05.667087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895640885047802:8560]
2025-09-30T14:54:05.667131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:05.667138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:05.667141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:05.667142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:05.667149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:05.667156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:05.667317Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:05.668163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:05.675696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895640974799020:8563]
2025-09-30T14:54:05.676218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1413, pipe: [1:7555895640974799020:8563]
2025-09-30T14:54:05.801996Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:05.802433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:05.802453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:05.802475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895640974799020:8563], now have 1 active actors on pipe
2025-09-30T14:54:05.802766Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:05.803880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:05.803977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1414 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5e6e048a-69442c18-d2d939fe-ff28824c_0
2025-09-30T14:54:05.804181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1414 sessionId: src_id|5e6e048a-69442c18-d2d939fe-ff28824c_0 is DEAD
2025-09-30T14:54:05.804368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e6e048a-69442c18-d2d939fe-ff28824c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:05.804382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e6e048a-69442c18-d2d939fe-ff28824c_0] Write session will restart in 0.007423s
2025-09-30T14:54:05.804386Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:05.804406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e6e048a-69442c18-d2d939fe-ff28824c_0] Write session: Do CDS request
2025-09-30T14:54:05.804421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e6e048a-69442c18-d2d939fe-ff28824c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:05.804430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895640974799020:8563]
2025-09-30T14:54:05.812774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e6e048a-69442c18-d2d939fe-ff28824c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:05.812900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:05.812923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1415
2025-09-30T14:54:05.813103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1415 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:05.813146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1415 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:05.813151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1415 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:05.813157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:05.813652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1415 sessionId:  describe result for acl check
2025-09-30T14:54:05.813685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:05.813687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:05.813689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:05.813696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895640974799037:8645] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:05.814306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895640974799037:8645] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:05.819483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895640974799037:8645] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:05.828660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895640974799037:8645] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:05.828685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895640974799037:8645] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:05.828689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895640974799037:8645] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:05.828700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1415 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:05.835050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:05.838664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:05.839378Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:05.839393Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:05.839412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:05.839518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:05.839569Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895640885048058:8563]
2025-09-30T14:54:05.840250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:05.840767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:05.840826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:05.841207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:05.841271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:05.841272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:05.841274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:05.841275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:05.841276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:05.841278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:05.841280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:05.841281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:05.841282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:05.841284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:05.841285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:05.841287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:05.841289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:05.841290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:05.841291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:05.841298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:05.841309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:05.841313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:05.841318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:05.841323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:05.841328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:05.841332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:05.841336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:05.841340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:05.841348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:05.841352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:05.841356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:05.841359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:05.841362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:05.841365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:05.841376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:05.841384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:05.841391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:05.841397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:05.841401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:05.841407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:05.841412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:05.841418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:05.841426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:05.841432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:05.841437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:05.841443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:05.841448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:05.841454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:05.841458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:05.841464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:05.841470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:05.841475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:05.841480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:05.841486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:05.841491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:05.841497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:05.841501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:05.841507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:05.841512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:05.841517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:05.841522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:05.841527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:05.841533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:05.841539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:05.841587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:05.849807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1414
2025-09-30T14:54:05.849832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1414
2025-09-30T14:54:05.848277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:05.849232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:05.849240Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:05.849243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:05.849248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:05.849256Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1414 [2:7555895640885048058:8563]
2025-09-30T14:54:05.849275Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:05.849296Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:05.849299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:05.849303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:05.849306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:05.849324Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:05.849332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:05.849339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:05.849414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:05.849416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:05.849419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:05.849423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:05.849427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:05.849738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:05.849742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:05.849761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:05.849776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:05.849795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:05.849820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895640974799191:8645], now have 1 active actors on pipe
2025-09-30T14:54:05.849823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895640974799022:2454], now have 1 active actors on pipe
2025-09-30T14:54:05.849830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895640885048053:8563]
2025-09-30T14:54:05.849833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895640885048053:8563]
2025-09-30T14:54:05.849835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895640885048053:8563]
2025-09-30T14:54:05.849855Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:05.849872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:05.849888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:05.849891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:05.849947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895640885048053:8563]
2025-09-30T14:54:05.849950Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:05.850140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:05.850144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:05.850147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:05.850154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:05.850271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:05.850277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:05.850309Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38422148-bc57f8c2-a3c6b71f-36aa355b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:05.850318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:05.850333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:05.850336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:05.850349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:05.850362Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:05.850379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:05.851809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1415 partition: 0 MaxSeqNo: 42 sessionId: src_id|38422148-bc57f8c2-a3c6b71f-36aa355b_0
2025-09-30T14:54:05.852295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e6e048a-69442c18-d2d939fe-ff28824c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|38422148-bc57f8c2-a3c6b71f-36aa355b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:05.851609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:05.851627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:05.851661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:05.859376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38422148-bc57f8c2-a3c6b71f-36aa355b_0] Write session: try to update token
2025-09-30T14:54:05.859405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38422148-bc57f8c2-a3c6b71f-36aa355b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:05.869036Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:05.869065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:05.869069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:05.869071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:05.869082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895640885048053:8563]
2025-09-30T14:54:05.869088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895640885048053:8563]
2025-09-30T14:54:05.869093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895640885048053:8563]
2025-09-30T14:54:05.869141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:05.869149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:05.869152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:05.869303Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:05.871329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:05.871353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:05.871358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:05.880257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1415 sessionId: src_id|38422148-bc57f8c2-a3c6b71f-36aa355b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:05.884439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:05.904611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895640974799278:8563]
2025-09-30T14:54:05.907622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1414, pipe: [1:7555895640974799278:8563]
2025-09-30T14:54:05.999127Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:05.999741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:05.999761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:05.999783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895640974799278:8563], now have 1 active actors on pipe
2025-09-30T14:54:06.000157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:06.000176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:06.000254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1415 reason: error at write: Disconnected sessionId: src_id|38422148-bc57f8c2-a3c6b71f-36aa355b_0
2025-09-30T14:54:06.000440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:06.000462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1415 sessionId: src_id|38422148-bc57f8c2-a3c6b71f-36aa355b_0 is DEAD
2025-09-30T14:54:06.000495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895640974799278:8563]
2025-09-30T14:54:06.000891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38422148-bc57f8c2-a3c6b71f-36aa355b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:06.000904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38422148-bc57f8c2-a3c6b71f-36aa355b_0] Write session will restart in 0.005038s
2025-09-30T14:54:06.000930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38422148-bc57f8c2-a3c6b71f-36aa355b_0] Write session: Do CDS request
2025-09-30T14:54:06.000937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38422148-bc57f8c2-a3c6b71f-36aa355b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:06.000272Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:06.006817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38422148-bc57f8c2-a3c6b71f-36aa355b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:06.007487Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:06.007513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1416
2025-09-30T14:54:06.007683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1416 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:06.007742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1416 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:06.007753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1416 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:06.007758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:06.008224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1416 sessionId:  describe result for acl check
2025-09-30T14:54:06.008263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:06.008269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:06.008271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:06.008278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895645269766586:8649] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:06.008872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895645269766586:8649] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:06.011348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895645269766586:8649] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:06.018229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895645269766586:8649] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:06.018256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895645269766586:8649] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:06.018260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895645269766586:8649] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:06.018271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1416 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:06.066489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:06.070913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:06.071213Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:06.071218Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:06.071231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:06.071321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:06.071367Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895645180015604:8565]
2025-09-30T14:54:06.072006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:06.074354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:06.074433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:06.074890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:06.074983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:06.074990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:06.074992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:06.074993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:06.074995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:06.074996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:06.074998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:06.074999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:06.075001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:06.075003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:06.075004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:06.075006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:06.075008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:06.075009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:06.075010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:06.075018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:06.075031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:06.075036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:06.075041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:06.075045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:06.075049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:06.075053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:06.075057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:06.075062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:06.075083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:06.075087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:06.075092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:06.075096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:06.075100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:06.075104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:06.075114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:06.075124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:06.075133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:06.075140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:06.075149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:06.075161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:06.075168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:06.075180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:06.075185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:06.075191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:06.075197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:06.075209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:06.075215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:06.075221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:06.075229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:06.075235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:06.075260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:06.075271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:06.075277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:06.075283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:06.075289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:06.075295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:06.075305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:06.075310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:06.075315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:06.075325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:06.075330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:06.075335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:06.075341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:06.075347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:06.075395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:06.082495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:06.083809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:06.083834Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:06.083837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:06.083842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:06.083849Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1415 [2:7555895645180015604:8565]
2025-09-30T14:54:06.083867Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:06.083887Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:06.083891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:06.083895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:06.083898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:06.083916Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:06.083926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:06.083934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:06.084011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:06.084013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:06.084016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:06.084019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:06.084022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:06.084106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:06.084109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:06.084125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:06.084137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:06.084153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:06.084174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895645180015599:8565]
2025-09-30T14:54:06.084176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895645180015599:8565]
2025-09-30T14:54:06.084179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895645180015599:8565]
2025-09-30T14:54:06.084196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:06.084213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:06.084229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:06.084232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:06.084276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895645180015599:8565]
2025-09-30T14:54:06.084279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:06.084348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:06.084352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:06.084354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:06.084363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:06.084792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895645269766619:8649], now have 1 active actors on pipe
2025-09-30T14:54:06.084807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895640974799283:2454], now have 1 active actors on pipe
2025-09-30T14:54:06.084966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1415
2025-09-30T14:54:06.085010Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1415
2025-09-30T14:54:06.086006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:06.086027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:06.086065Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e8f8b7-4e1ec7e2-f44ec658-a5f48b3a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:06.086078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:06.086082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:06.086085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:06.086098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:06.086114Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:06.086136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:06.086928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:06.086942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:06.086967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:06.087126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1416 partition: 0 MaxSeqNo: 42 sessionId: src_id|3e8f8b7-4e1ec7e2-f44ec658-a5f48b3a_0
2025-09-30T14:54:06.087710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38422148-bc57f8c2-a3c6b71f-36aa355b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3e8f8b7-4e1ec7e2-f44ec658-a5f48b3a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:06.091725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e8f8b7-4e1ec7e2-f44ec658-a5f48b3a_0] Write session: try to update token
2025-09-30T14:54:06.091750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e8f8b7-4e1ec7e2-f44ec658-a5f48b3a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:06.101179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895645269766838:8563]
2025-09-30T14:54:06.101821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1415, pipe: [1:7555895645269766838:8563]
2025-09-30T14:54:06.108376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895645269766838:8563], now have 1 active actors on pipe
2025-09-30T14:54:06.108406Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:06.108410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:06.108420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895645180015599:8565]
2025-09-30T14:54:06.108473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:06.108669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:06.108825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:06.108982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:06.109127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:06.109334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:06.109372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:06.110123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:06.116203Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:06.116233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:06.116236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:06.116239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:06.116250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895645180015599:8565]
2025-09-30T14:54:06.116254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895645180015599:8565]
2025-09-30T14:54:06.116258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895645180015599:8565]
2025-09-30T14:54:06.116297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:06.116303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:06.116305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:06.116308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:06.116315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:06.116318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:06.116460Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:06.127129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1416 sessionId: src_id|3e8f8b7-4e1ec7e2-f44ec658-a5f48b3a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:06.130540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:06.239713Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:06.240278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:06.240303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:06.240638Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:06.241431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:06.241521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1416 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3e8f8b7-4e1ec7e2-f44ec658-a5f48b3a_0
2025-09-30T14:54:06.241753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1416 sessionId: src_id|3e8f8b7-4e1ec7e2-f44ec658-a5f48b3a_0 is DEAD
2025-09-30T14:54:06.241931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895645269766838:8563]
2025-09-30T14:54:06.241946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:06.243392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e8f8b7-4e1ec7e2-f44ec658-a5f48b3a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:06.243408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e8f8b7-4e1ec7e2-f44ec658-a5f48b3a_0] Write session will restart in 0.009171s
2025-09-30T14:54:06.243436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e8f8b7-4e1ec7e2-f44ec658-a5f48b3a_0] Write session: Do CDS request
2025-09-30T14:54:06.243443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e8f8b7-4e1ec7e2-f44ec658-a5f48b3a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:06.253792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e8f8b7-4e1ec7e2-f44ec658-a5f48b3a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:06.254045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:06.254064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1417
2025-09-30T14:54:06.254192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1417 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:06.254225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1417 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:06.254232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1417 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:06.254237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:06.254706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1417 sessionId:  describe result for acl check
2025-09-30T14:54:06.254749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:06.254751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:06.254754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:06.254760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895645269766857:8654] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:06.255371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895645269766857:8654] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:06.258396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895645269766857:8654] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:06.268250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895645269766857:8654] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:06.268273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895645269766857:8654] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:06.268276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895645269766857:8654] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:06.268285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1417 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:06.287398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:06.292361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:06.292889Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:06.292905Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:06.292923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:06.293003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:06.293046Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895645180015856:8568]
2025-09-30T14:54:06.293697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:06.295173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:06.295240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:06.295660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:06.295745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:06.295752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:06.295753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:06.295755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:06.295757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:06.295759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:06.295760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:06.295762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:06.295763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:06.295765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:06.295766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:06.295768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:06.295770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:06.295771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:06.295773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:06.295780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:06.295792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:06.295797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:06.295801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:06.295805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:06.295810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:06.295814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:06.295818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:06.295822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:06.295826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:06.295830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:06.295834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:06.295839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:06.295843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:06.295847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:06.295856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:06.295865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:06.295872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:06.295878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:06.295883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:06.295890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:06.295896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:06.295907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:06.295913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:06.295918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:06.295925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:06.295931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:06.295941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:06.295947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:06.295952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:06.295962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:06.295969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:06.295974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:06.295984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:06.295990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:06.295995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:06.296006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:06.296010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:06.296016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:06.296030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:06.296041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:06.296046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:06.296051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:06.296059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:06.296065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:06.296114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:06.308518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:06.309759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:06.309766Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:06.309770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:06.309774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:06.309782Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1416 [2:7555895645180015856:8568]
2025-09-30T14:54:06.309800Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:06.309816Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:06.309820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:06.309824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:06.309827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:06.309845Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:06.309854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:06.309862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:06.309955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:06.309958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:06.309962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:06.309967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:06.309970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:06.310099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:06.310104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:06.310123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:06.310136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:06.310156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:06.310184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895645180015851:8568]
2025-09-30T14:54:06.310187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895645180015851:8568]
2025-09-30T14:54:06.310189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895645180015851:8568]
2025-09-30T14:54:06.310212Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:06.310235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:06.310251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:06.310254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:06.310274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:06.310279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:06.310289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:06.310310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895645180015851:8568]
2025-09-30T14:54:06.310315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:06.310399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:06.310784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895645269766919:8654], now have 1 active actors on pipe
2025-09-30T14:54:06.310802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895645269766844:2454], now have 1 active actors on pipe
2025-09-30T14:54:06.311326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1416
2025-09-30T14:54:06.311369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1416
2025-09-30T14:54:06.311529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:06.311551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:06.311590Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|226afbb1-1fd05d4f-d62129c3-6a69ae9b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:06.311603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:06.311609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:06.311613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:06.311628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:06.311645Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:06.311667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:06.312697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:06.312716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:06.312746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:06.313433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e8f8b7-4e1ec7e2-f44ec658-a5f48b3a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|226afbb1-1fd05d4f-d62129c3-6a69ae9b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:06.316803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|226afbb1-1fd05d4f-d62129c3-6a69ae9b_0] Write session: try to update token
2025-09-30T14:54:06.316894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|226afbb1-1fd05d4f-d62129c3-6a69ae9b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:06.312918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1417 partition: 0 MaxSeqNo: 42 sessionId: src_id|226afbb1-1fd05d4f-d62129c3-6a69ae9b_0
2025-09-30T14:54:06.342333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895645269767102:8563]
2025-09-30T14:54:06.342806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1416, pipe: [1:7555895645269767102:8563]
2025-09-30T14:54:06.342830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895645269767102:8563], now have 1 active actors on pipe
2025-09-30T14:54:06.344230Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:06.344248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:06.344250Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:06.344252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:06.344259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895645180015851:8568]
2025-09-30T14:54:06.344264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895645180015851:8568]
2025-09-30T14:54:06.344268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895645180015851:8568]
2025-09-30T14:54:06.344313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:06.344321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:06.344324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:06.344503Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:06.347656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:06.347681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:06.347687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:06.365412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1417 sessionId: src_id|226afbb1-1fd05d4f-d62129c3-6a69ae9b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:06.368574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:06.489385Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:06.489883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:06.489894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:06.490815Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:06.490765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:06.490834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895645269767102:8563]
2025-09-30T14:54:06.490856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:06.490859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:06.490925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1417 reason: error at write: Disconnected sessionId: src_id|226afbb1-1fd05d4f-d62129c3-6a69ae9b_0
2025-09-30T14:54:06.491139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1417 sessionId: src_id|226afbb1-1fd05d4f-d62129c3-6a69ae9b_0 is DEAD
2025-09-30T14:54:06.491799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|226afbb1-1fd05d4f-d62129c3-6a69ae9b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:06.491806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|226afbb1-1fd05d4f-d62129c3-6a69ae9b_0] Write session will restart in 0.007129s
2025-09-30T14:54:06.491830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|226afbb1-1fd05d4f-d62129c3-6a69ae9b_0] Write session: Do CDS request
2025-09-30T14:54:06.491837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|226afbb1-1fd05d4f-d62129c3-6a69ae9b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:06.500590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|226afbb1-1fd05d4f-d62129c3-6a69ae9b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:06.500733Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:06.500765Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1418
2025-09-30T14:54:06.500949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1418 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:06.500993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1418 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:06.501012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1418 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:06.501022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:06.501603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1418 sessionId:  describe result for acl check
2025-09-30T14:54:06.501648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:06.501656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:06.501658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:06.501665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895645269767125:8659] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:06.502316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895645269767125:8659] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:06.506940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895645269767125:8659] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:06.516564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895645269767125:8659] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:06.516587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895645269767125:8659] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:06.516591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895645269767125:8659] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:06.516603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1418 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:06.549241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:06.558379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:06.558959Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:06.558965Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:06.558981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:06.559065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:06.559108Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895645180016121:8571]
2025-09-30T14:54:06.559823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:06.560368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:06.560460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:06.560866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:06.560940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:06.560942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:06.560943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:06.560944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:06.560946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:06.560947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:06.560948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:06.560962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:06.560963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:06.560964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:06.560966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:06.560968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:06.560969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:06.560970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:06.560972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:06.560979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:06.560990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:06.560994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:06.560999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:06.561003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:06.561007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:06.561011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:06.561015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:06.561018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:06.561023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:06.561027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:06.561031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:06.561035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:06.561039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:06.561042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:06.561051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:06.561060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:06.561067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:06.561073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:06.561085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:06.561090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:06.561095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:06.561100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:06.561105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:06.561110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:06.561115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:06.561121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:06.561126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:06.561131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:06.561135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:06.561141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:06.561146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:06.561151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:06.561156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:06.561162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:06.561167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:06.561172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:06.561176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:06.561181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:06.561186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:06.561195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:06.561199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:06.561204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:06.561209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:06.561214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:06.561257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:06.568510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:06.569534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:06.569557Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:06.569560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:06.569565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:06.569573Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1417 [2:7555895645180016121:8571]
2025-09-30T14:54:06.569594Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:06.569612Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:06.569616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:06.569620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:06.569623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:06.569640Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:06.569656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:06.569664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:06.569734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:06.569743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:06.569747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:06.569750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:06.569753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:06.569832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:06.569841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:06.569856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:06.569868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:06.569884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:06.569921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895645269767176:8659], now have 1 active actors on pipe
2025-09-30T14:54:06.569925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895645269767117:2454], now have 1 active actors on pipe
2025-09-30T14:54:06.569932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895645180016115:8571]
2025-09-30T14:54:06.569934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895645180016115:8571]
2025-09-30T14:54:06.569936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895645180016115:8571]
2025-09-30T14:54:06.569950Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:06.569965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:06.569981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:06.569990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:06.569999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:06.570011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:06.570015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:06.570034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895645180016115:8571]
2025-09-30T14:54:06.570042Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:06.570047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:06.570033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1417
2025-09-30T14:54:06.570067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1417
2025-09-30T14:54:06.570250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:06.570260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:06.570292Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0dfa16a-94d5d103-9244cdec-fe6f641c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:06.570305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:06.570315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:06.570318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:06.570332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:06.570347Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:06.570362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:06.570527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:06.570535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:06.570549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:06.570660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1418 partition: 0 MaxSeqNo: 42 sessionId: src_id|e0dfa16a-94d5d103-9244cdec-fe6f641c_0
2025-09-30T14:54:06.571153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|226afbb1-1fd05d4f-d62129c3-6a69ae9b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e0dfa16a-94d5d103-9244cdec-fe6f641c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:06.574367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0dfa16a-94d5d103-9244cdec-fe6f641c_0] Write session: try to update token
2025-09-30T14:54:06.574391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0dfa16a-94d5d103-9244cdec-fe6f641c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:06.588111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895645269767392:8563]
2025-09-30T14:54:06.588815Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:06.588836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:06.588839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:06.588841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:06.588850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895645180016115:8571]
2025-09-30T14:54:06.588855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895645180016115:8571]
2025-09-30T14:54:06.588859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895645180016115:8571]
2025-09-30T14:54:06.588914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:06.588922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:06.588925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:06.589024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:06.589037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:06.589041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:06.589080Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:06.590638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1417, pipe: [1:7555895645269767392:8563]
2025-09-30T14:54:06.608910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1418 sessionId: src_id|e0dfa16a-94d5d103-9244cdec-fe6f641c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:06.611920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:06.752795Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:06.753576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895645269767392:8563], now have 1 active actors on pipe
2025-09-30T14:54:06.753632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:06.753638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:06.755060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:06.755080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:06.754493Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:06.755142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1418 reason: error at write: Disconnected sessionId: src_id|e0dfa16a-94d5d103-9244cdec-fe6f641c_0
2025-09-30T14:54:06.755352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1418 sessionId: src_id|e0dfa16a-94d5d103-9244cdec-fe6f641c_0 is DEAD
2025-09-30T14:54:06.755524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895645269767392:8563]
2025-09-30T14:54:06.755538Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:06.758962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0dfa16a-94d5d103-9244cdec-fe6f641c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:06.758977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0dfa16a-94d5d103-9244cdec-fe6f641c_0] Write session will restart in 0.006606s
2025-09-30T14:54:06.759006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0dfa16a-94d5d103-9244cdec-fe6f641c_0] Write session: Do CDS request
2025-09-30T14:54:06.759013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0dfa16a-94d5d103-9244cdec-fe6f641c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:06.766840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0dfa16a-94d5d103-9244cdec-fe6f641c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:06.766994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:06.767014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1419
2025-09-30T14:54:06.767685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1419 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:06.767741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1419 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:06.767752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1419 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:06.767757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:06.769377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1419 sessionId:  describe result for acl check
2025-09-30T14:54:06.769433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:06.769437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:06.769439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:06.769446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895645269767428:8671] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:06.770068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895645269767428:8671] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:06.775385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895645269767428:8671] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:06.780211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895645269767428:8671] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:06.780233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895645269767428:8671] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:06.780240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895645269767428:8671] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:06.780250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1419 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:06.793780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:06.797633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:06.798232Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:06.798239Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:06.798256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:06.798364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:06.798404Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895645180016412:8586]
2025-09-30T14:54:06.799106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:06.799554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:06.799615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:06.800002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:06.800060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:06.800061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:06.800063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:06.800065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:06.800066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:06.800068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:06.800069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:06.800071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:06.800072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:06.800074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:06.800075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:06.800077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:06.800078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:06.800080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:06.800081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:06.800087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:06.800096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:06.800100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:06.800104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:06.800109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:06.800113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:06.800118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:06.800122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:06.800126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:06.800132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:06.800136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:06.800141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:06.800145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:06.800150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:06.800154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:06.800163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:06.800172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:06.800179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:06.800185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:06.800196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:06.800202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:06.800208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:06.800213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:06.800219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:06.800225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:06.800233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:06.800239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:06.800244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:06.800251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:06.800256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:06.800262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:06.800267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:06.800273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:06.800278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:06.800284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:06.800303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:06.800308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:06.800313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:06.800319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:06.800324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:06.800330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:06.800336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:06.800342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:06.800347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:06.800353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:06.800403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:06.808445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:06.809751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:06.809775Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:06.809778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:06.809782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:06.809789Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1418 [2:7555895645180016412:8586]
2025-09-30T14:54:06.809810Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:06.809827Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:06.809833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:06.809836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:06.809838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:06.809854Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:06.809862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:06.809869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:06.809955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:06.809964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:06.809966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:06.809969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:06.809972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:06.810052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:06.810059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:06.810073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:06.810088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:06.810109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:06.810134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895645180016407:8586]
2025-09-30T14:54:06.810142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895645180016407:8586]
2025-09-30T14:54:06.810145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895645180016407:8586]
2025-09-30T14:54:06.810620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1418
2025-09-30T14:54:06.810637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1418
2025-09-30T14:54:06.810160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:06.810180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:06.810195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:06.810199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:06.810212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:06.810215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:06.810217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:06.810238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895645180016407:8586]
2025-09-30T14:54:06.810242Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:06.810313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:06.810441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895645269767407:2454], now have 1 active actors on pipe
2025-09-30T14:54:06.810449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895645269767501:8671], now have 1 active actors on pipe
2025-09-30T14:54:06.811070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:06.811082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:06.811114Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6722aa4e-cffff4ab-86a863bd-9da845aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:06.811124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:06.811128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:06.811131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:06.811142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:06.811156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:06.811173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:06.814206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:06.814225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:06.814262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:06.814499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1419 partition: 0 MaxSeqNo: 42 sessionId: src_id|6722aa4e-cffff4ab-86a863bd-9da845aa_0
2025-09-30T14:54:06.815009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0dfa16a-94d5d103-9244cdec-fe6f641c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6722aa4e-cffff4ab-86a863bd-9da845aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:06.818248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6722aa4e-cffff4ab-86a863bd-9da845aa_0] Write session: try to update token
2025-09-30T14:54:06.818272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6722aa4e-cffff4ab-86a863bd-9da845aa_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:06.825280Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:06.825304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:06.825317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895645180016407:8586]
2025-09-30T14:54:06.825364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:06.825552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:06.825700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:06.825850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:06.826025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:06.826534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:06.826576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:06.827461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:06.840183Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:06.840210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:06.840212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:06.840215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:06.840225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895645180016407:8586]
2025-09-30T14:54:06.840231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895645180016407:8586]
2025-09-30T14:54:06.840235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895645180016407:8586]
2025-09-30T14:54:06.840277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:06.840285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:06.840288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:06.840434Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:06.843486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:06.843513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:06.843517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:06.847986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1419 sessionId: src_id|6722aa4e-cffff4ab-86a863bd-9da845aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:06.850982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:06.854318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895645269767666:8563]
2025-09-30T14:54:06.855604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1418, pipe: [1:7555895645269767666:8563]
2025-09-30T14:54:07.011014Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:07.011519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:07.011537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:07.011560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895645269767666:8563], now have 1 active actors on pipe
2025-09-30T14:54:07.012028Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:07.015889Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:07.015955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:07.016045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1419 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6722aa4e-cffff4ab-86a863bd-9da845aa_0
2025-09-30T14:54:07.016388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6722aa4e-cffff4ab-86a863bd-9da845aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:07.016397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6722aa4e-cffff4ab-86a863bd-9da845aa_0] Write session will restart in 0.009130s
2025-09-30T14:54:07.016424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6722aa4e-cffff4ab-86a863bd-9da845aa_0] Write session: Do CDS request
2025-09-30T14:54:07.016432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6722aa4e-cffff4ab-86a863bd-9da845aa_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:07.016262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1419 sessionId: src_id|6722aa4e-cffff4ab-86a863bd-9da845aa_0 is DEAD
2025-09-30T14:54:07.016467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895645269767666:8563]
2025-09-30T14:54:07.026958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6722aa4e-cffff4ab-86a863bd-9da845aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:07.028150Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:07.028177Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1420
2025-09-30T14:54:07.035350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1420 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:07.035416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1420 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:07.035422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1420 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:07.035429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:07.039717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1420 sessionId:  describe result for acl check
2025-09-30T14:54:07.039769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:07.039775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:07.039777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:07.039784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895649564735013:8675] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:07.040361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895649564735013:8675] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:07.047957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895649564735013:8675] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:07.063003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895649564735013:8675] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:07.063026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895649564735013:8675] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:07.063030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895649564735013:8675] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:07.063040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1420 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:07.084643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:07.089192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:07.089456Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:07.089469Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:07.089482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:07.089554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:07.089602Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895649474983963:8588]
2025-09-30T14:54:07.090231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:07.090634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:07.090694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:07.090957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:07.091006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:07.091008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:07.091009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:07.091011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:07.091013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:07.091014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:07.091015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:07.091016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:07.091018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:07.091019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:07.091021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.091022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:07.091023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:07.091024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:07.091026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:07.091032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:07.091042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:07.091047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:07.091051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:07.091055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:07.091060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:07.091063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:07.091068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:07.091072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:07.091077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:07.091082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.091085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:07.091087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:07.091090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:07.091092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:07.091098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:07.091103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:07.091107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:07.091110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:07.091118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:07.091124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:07.091129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:07.091135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:07.091141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:07.091146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:07.091151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:07.091157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:07.091161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:07.091164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:07.091167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:07.091171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:07.091173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:07.091176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:07.091179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:07.091185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:07.091188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.091191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.091193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:07.091196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:07.091199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:07.091202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:07.091206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:07.091212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:07.091216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:07.091221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:07.091290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:07.097517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:07.098744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:07.098766Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:07.098769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:07.098773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:07.098781Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1419 [2:7555895649474983963:8588]
2025-09-30T14:54:07.098799Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:07.098817Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:07.098821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:07.098824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:07.098827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:07.098845Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:07.098852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:07.098859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:07.098930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.098933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:07.098935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:07.098938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:07.098941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:07.099020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:07.099023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.099037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:07.099049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:07.099065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:07.099084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895649564735119:8675], now have 1 active actors on pipe
2025-09-30T14:54:07.099088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895649564734967:2454], now have 1 active actors on pipe
2025-09-30T14:54:07.099094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895649474983957:8588]
2025-09-30T14:54:07.099097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895649474983957:8588]
2025-09-30T14:54:07.099099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895649474983957:8588]
2025-09-30T14:54:07.099107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:07.099122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:07.099124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:07.099127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:07.099130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:07.099139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:07.099143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:07.099184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895649474983957:8588]
2025-09-30T14:54:07.099196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:07.099211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:07.103350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1419
2025-09-30T14:54:07.103401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1419
2025-09-30T14:54:07.103516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:07.103544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:07.103601Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c307ff98-b1800d35-df0c4d4c-e188e64e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:07.103622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:07.103628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:07.103632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:07.103647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:07.103666Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:07.103688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:07.104889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:07.104921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:07.104950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:07.105147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1420 partition: 0 MaxSeqNo: 42 sessionId: src_id|c307ff98-b1800d35-df0c4d4c-e188e64e_0
2025-09-30T14:54:07.105612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6722aa4e-cffff4ab-86a863bd-9da845aa_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c307ff98-b1800d35-df0c4d4c-e188e64e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:07.108784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c307ff98-b1800d35-df0c4d4c-e188e64e_0] Write session: try to update token
2025-09-30T14:54:07.108809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c307ff98-b1800d35-df0c4d4c-e188e64e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:07.118346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895649564735228:8563]
2025-09-30T14:54:07.118618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1419, pipe: [1:7555895649564735228:8563]
2025-09-30T14:54:07.119900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895649564735228:8563], now have 1 active actors on pipe
2025-09-30T14:54:07.119932Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:07.119934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:07.119937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:07.119939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:07.119945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895649474983957:8588]
2025-09-30T14:54:07.119948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895649474983957:8588]
2025-09-30T14:54:07.119951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895649474983957:8588]
2025-09-30T14:54:07.119989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:07.119999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.120001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:07.120036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:07.120056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:07.120061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:07.120161Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:07.134695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1420 sessionId: src_id|c307ff98-b1800d35-df0c4d4c-e188e64e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:07.137922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:07.257580Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:07.258210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:07.258231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:07.258533Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:07.258522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:07.258540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:07.258557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895649564735228:8563]
2025-09-30T14:54:07.258588Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:07.258618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1420 reason: error at write: Disconnected sessionId: src_id|c307ff98-b1800d35-df0c4d4c-e188e64e_0
2025-09-30T14:54:07.258850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1420 sessionId: src_id|c307ff98-b1800d35-df0c4d4c-e188e64e_0 is DEAD
2025-09-30T14:54:07.259373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c307ff98-b1800d35-df0c4d4c-e188e64e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:07.259383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c307ff98-b1800d35-df0c4d4c-e188e64e_0] Write session will restart in 0.007177s
2025-09-30T14:54:07.259416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c307ff98-b1800d35-df0c4d4c-e188e64e_0] Write session: Do CDS request
2025-09-30T14:54:07.259421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c307ff98-b1800d35-df0c4d4c-e188e64e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:07.268478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c307ff98-b1800d35-df0c4d4c-e188e64e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:07.268872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:07.268893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1421
2025-09-30T14:54:07.269065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1421 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:07.269100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1421 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:07.269105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1421 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:07.269109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:07.269583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1421 sessionId:  describe result for acl check
2025-09-30T14:54:07.269619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:07.269621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:07.269623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:07.269629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895649564735244:8680] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:07.270247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895649564735244:8680] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:07.273614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895649564735244:8680] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:07.281359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895649564735244:8680] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:07.281388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895649564735244:8680] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:07.281392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895649564735244:8680] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:07.281401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1421 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:07.300829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:07.304392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:07.304909Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:07.304924Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:07.304940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:07.305026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:07.305074Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895649474984219:8591]
2025-09-30T14:54:07.305785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:07.306242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:07.306301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:07.306680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:07.306768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:07.306769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:07.306771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:07.306772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:07.306773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:07.306776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:07.306777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:07.306779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:07.306780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:07.306782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:07.306783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.306785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:07.306786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:07.306787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:07.306789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:07.306796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:07.306807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:07.306813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:07.306818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:07.306821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:07.306826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:07.306830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:07.306834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:07.306839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:07.306844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:07.306848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.306852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:07.306857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:07.306861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:07.306865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:07.306876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:07.306885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:07.306891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:07.306897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:07.306902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:07.306907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:07.306912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:07.306917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:07.306923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:07.306943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:07.306948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:07.306954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:07.306959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:07.306965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:07.306969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:07.306975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:07.306981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:07.306987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:07.306991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:07.306996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:07.307000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.307004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.307008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:07.307013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:07.307018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:07.307022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:07.307028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:07.307033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:07.307037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:07.307043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:07.307091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:07.317420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:07.319285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1420
2025-09-30T14:54:07.319285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1420
2025-09-30T14:54:07.318426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:07.318451Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:07.318455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:07.318460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:07.318469Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1420 [2:7555895649474984219:8591]
2025-09-30T14:54:07.318490Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:07.318512Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:07.318515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:07.318519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:07.318522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:07.318541Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:07.318549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:07.318558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:07.318636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.318639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:07.318642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:07.318646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:07.318648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:07.318734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:07.318737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.318752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:07.318764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:07.318780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:07.318798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895649474984214:8591]
2025-09-30T14:54:07.318801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895649474984214:8591]
2025-09-30T14:54:07.318804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895649474984214:8591]
2025-09-30T14:54:07.318814Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:07.318831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:07.318847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:07.318851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:07.318852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:07.318854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:07.318855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:07.318896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895649474984214:8591]
2025-09-30T14:54:07.318908Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:07.318918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895649564735307:8680], now have 1 active actors on pipe
2025-09-30T14:54:07.318922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895649564735236:2454], now have 1 active actors on pipe
2025-09-30T14:54:07.319380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:07.319629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:07.319639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:07.319668Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d56f91c-cf85d61d-726e9549-be24a194_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:07.319680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:07.319687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:07.319690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:07.319702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:07.319718Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:07.319736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:07.320178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:07.320193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:07.320215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:07.320372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1421 partition: 0 MaxSeqNo: 42 sessionId: src_id|6d56f91c-cf85d61d-726e9549-be24a194_0
2025-09-30T14:54:07.323514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c307ff98-b1800d35-df0c4d4c-e188e64e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6d56f91c-cf85d61d-726e9549-be24a194_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:07.326727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d56f91c-cf85d61d-726e9549-be24a194_0] Write session: try to update token
2025-09-30T14:54:07.326754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d56f91c-cf85d61d-726e9549-be24a194_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:07.335656Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:07.335683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:07.335686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:07.335688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:07.335699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895649474984214:8591]
2025-09-30T14:54:07.335703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895649474984214:8591]
2025-09-30T14:54:07.335707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895649474984214:8591]
2025-09-30T14:54:07.335750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:07.335758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.335761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:07.335912Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:07.336313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:07.336321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:07.336325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:07.344669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1421 sessionId: src_id|6d56f91c-cf85d61d-726e9549-be24a194_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:07.347858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:07.358468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895649564735499:8563]
2025-09-30T14:54:07.359046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1420, pipe: [1:7555895649564735499:8563]
2025-09-30T14:54:07.456211Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:07.456687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:07.456698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:07.456741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895649564735499:8563], now have 1 active actors on pipe
2025-09-30T14:54:07.457026Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:07.459199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:07.459337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895649564735499:8563]
2025-09-30T14:54:07.459361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:07.459451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1421 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6d56f91c-cf85d61d-726e9549-be24a194_0
2025-09-30T14:54:07.459633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1421 sessionId: src_id|6d56f91c-cf85d61d-726e9549-be24a194_0 is DEAD
2025-09-30T14:54:07.460195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d56f91c-cf85d61d-726e9549-be24a194_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:07.460208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d56f91c-cf85d61d-726e9549-be24a194_0] Write session will restart in 0.006508s
2025-09-30T14:54:07.460233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d56f91c-cf85d61d-726e9549-be24a194_0] Write session: Do CDS request
2025-09-30T14:54:07.460240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d56f91c-cf85d61d-726e9549-be24a194_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:07.468048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d56f91c-cf85d61d-726e9549-be24a194_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:07.469792Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:07.469819Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1422
2025-09-30T14:54:07.469983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1422 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:07.470018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1422 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:07.470024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1422 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:07.470028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:07.473202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1422 sessionId:  describe result for acl check
2025-09-30T14:54:07.473262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:07.473264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:07.473266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:07.473273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895649564735537:8685] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:07.473837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895649564735537:8685] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:07.480641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895649564735537:8685] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:07.492807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895649564735537:8685] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:07.492846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895649564735537:8685] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:07.492851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895649564735537:8685] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:07.492860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1422 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:07.512584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:07.517642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:07.517916Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:07.517927Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:07.517939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:07.517997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:07.518046Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895649474984487:8594]
2025-09-30T14:54:07.518744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:07.519213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:07.519285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:07.519689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:07.519773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:07.519780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:07.519782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:07.519784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:07.519785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:07.519787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:07.519789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:07.519790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:07.519792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:07.519793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:07.519794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.519796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:07.519797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:07.519798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:07.519800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:07.519807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:07.519817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:07.519821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:07.519825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:07.519829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:07.519834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:07.519837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:07.519841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:07.519845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:07.519850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:07.519854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.519859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:07.519863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:07.519868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:07.519872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:07.519880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:07.519888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:07.519895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:07.519902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:07.519907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:07.519913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:07.519918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:07.519923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:07.519928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:07.519933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:07.519938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:07.519943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:07.519948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:07.519954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:07.519959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:07.519964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:07.519969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:07.519975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:07.519979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:07.519984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:07.519989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.519995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.519999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:07.520019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:07.520024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:07.520030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:07.520035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:07.520041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:07.520046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:07.520051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:07.520098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:07.526811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:07.528232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:07.528240Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:07.528244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:07.528247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:07.528258Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1421 [2:7555895649474984487:8594]
2025-09-30T14:54:07.528276Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:07.528293Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:07.528297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:07.528300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:07.528303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:07.528322Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:07.528330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:07.528337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:07.528404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.528407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:07.528409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:07.528413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:07.528415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:07.528491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:07.528494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.528510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:07.528522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:07.528541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:07.528559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895649474984481:8594]
2025-09-30T14:54:07.528743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1421
2025-09-30T14:54:07.528801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1421
2025-09-30T14:54:07.528562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895649474984481:8594]
2025-09-30T14:54:07.528564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895649474984481:8594]
2025-09-30T14:54:07.528573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:07.528587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:07.528598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:07.528605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:07.528606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:07.528608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:07.528608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:07.528647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895649474984481:8594]
2025-09-30T14:54:07.528659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:07.528670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895649564735515:2454], now have 1 active actors on pipe
2025-09-30T14:54:07.528674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895649564735659:8685], now have 1 active actors on pipe
2025-09-30T14:54:07.528960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:07.529131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:07.529155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:07.529183Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b87af583-812f7c6d-20311e43-7dff66a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:07.529199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:07.529208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:07.529211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:07.529223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:07.529243Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:07.529268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:07.529520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:07.529529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:07.529545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:07.529666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1422 partition: 0 MaxSeqNo: 42 sessionId: src_id|b87af583-812f7c6d-20311e43-7dff66a1_0
2025-09-30T14:54:07.534037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d56f91c-cf85d61d-726e9549-be24a194_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b87af583-812f7c6d-20311e43-7dff66a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:07.537124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b87af583-812f7c6d-20311e43-7dff66a1_0] Write session: try to update token
2025-09-30T14:54:07.537150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b87af583-812f7c6d-20311e43-7dff66a1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:07.542449Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:07.542473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:07.542476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:07.542479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:07.542487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895649474984481:8594]
2025-09-30T14:54:07.542492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895649474984481:8594]
2025-09-30T14:54:07.542497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895649474984481:8594]
2025-09-30T14:54:07.542541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:07.542546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:07.542548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.542551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:07.542552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:07.542557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:07.542697Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:07.558139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1422 sessionId: src_id|b87af583-812f7c6d-20311e43-7dff66a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:07.559353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895649564735778:8563]
2025-09-30T14:54:07.560039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1421, pipe: [1:7555895649564735778:8563]
2025-09-30T14:54:07.561162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:07.664624Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:07.665179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895649564735778:8563], now have 1 active actors on pipe
2025-09-30T14:54:07.665214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:07.665227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:07.665462Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:07.665818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:07.665839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:07.665927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1422 reason: error at write: Disconnected sessionId: src_id|b87af583-812f7c6d-20311e43-7dff66a1_0
2025-09-30T14:54:07.666116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1422 sessionId: src_id|b87af583-812f7c6d-20311e43-7dff66a1_0 is DEAD
2025-09-30T14:54:07.666274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895649564735778:8563]
2025-09-30T14:54:07.666312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:07.666298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b87af583-812f7c6d-20311e43-7dff66a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:07.666340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b87af583-812f7c6d-20311e43-7dff66a1_0] Write session will restart in 0.008248s
2025-09-30T14:54:07.666366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b87af583-812f7c6d-20311e43-7dff66a1_0] Write session: Do CDS request
2025-09-30T14:54:07.666376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b87af583-812f7c6d-20311e43-7dff66a1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:07.675878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b87af583-812f7c6d-20311e43-7dff66a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:07.675972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:07.675991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1423
2025-09-30T14:54:07.676404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1423 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:07.676449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1423 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:07.676461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1423 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:07.676466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:07.676943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1423 sessionId:  describe result for acl check
2025-09-30T14:54:07.676978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:07.676980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:07.676982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:07.676988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895649564735805:8690] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:07.677509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895649564735805:8690] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:07.681311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895649564735805:8690] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:07.685831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895649564735805:8690] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:07.685853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895649564735805:8690] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:07.685859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895649564735805:8690] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:07.685867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1423 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:07.689272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:07.692902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:07.693244Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:07.693248Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:07.693263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:07.693349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:07.693541Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895649474984758:8596]
2025-09-30T14:54:07.694234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:07.694704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:07.694776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:07.695118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:07.695207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:07.695209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:07.695210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:07.695211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:07.695215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:07.695217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:07.695218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:07.695219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:07.695220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:07.695222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:07.695223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.695224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:07.695225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:07.695226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:07.695227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:07.695233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:07.695259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:07.695264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:07.695268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:07.695272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:07.695276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:07.695280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:07.695283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:07.695287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:07.695292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:07.695295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.695299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:07.695302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:07.695306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:07.695309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:07.695318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:07.695326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:07.695332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:07.695337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:07.695341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:07.695347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:07.695351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:07.695356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:07.695362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:07.695366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:07.695371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:07.695376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:07.695380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:07.695385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:07.695389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:07.695393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:07.695397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:07.695402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:07.695405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:07.695410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:07.695425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.695430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.695436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:07.695441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:07.695445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:07.695449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:07.695453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:07.695457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:07.695461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:07.695466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:07.695508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:07.702238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:07.703275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:07.703291Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:07.703293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:07.703297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:07.703304Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1422 [2:7555895649474984758:8596]
2025-09-30T14:54:07.703321Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:07.703338Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:07.703341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:07.703344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:07.703346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:07.703362Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:07.703375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:07.703385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:07.703454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.703462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:07.703464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:07.703468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:07.703470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:07.703590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:07.703595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.703608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:07.703621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:07.703641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:07.703659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895649474984753:8596]
2025-09-30T14:54:07.703666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895649474984753:8596]
2025-09-30T14:54:07.703668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895649474984753:8596]
2025-09-30T14:54:07.703680Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:07.703695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:07.703711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:07.703714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:07.703754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895649474984753:8596]
2025-09-30T14:54:07.703762Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:07.703894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:07.703901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:07.703903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:07.703909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:07.704726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895649564736006:8690], now have 1 active actors on pipe
2025-09-30T14:54:07.704739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895649564735780:2454], now have 1 active actors on pipe
2025-09-30T14:54:07.704753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:07.704759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:07.704788Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ff22ed4-7f7e6081-ef69c34a-a972f6d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:07.704797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:07.704804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:07.704806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:07.704817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:07.704828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:07.704845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:07.705180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:07.705186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:07.705200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:07.705741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b87af583-812f7c6d-20311e43-7dff66a1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3ff22ed4-7f7e6081-ef69c34a-a972f6d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:07.704294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1422
2025-09-30T14:54:07.704346Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1422
2025-09-30T14:54:07.705333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1423 partition: 0 MaxSeqNo: 42 sessionId: src_id|3ff22ed4-7f7e6081-ef69c34a-a972f6d1_0
2025-09-30T14:54:07.708600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff22ed4-7f7e6081-ef69c34a-a972f6d1_0] Write session: try to update token
2025-09-30T14:54:07.708619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff22ed4-7f7e6081-ef69c34a-a972f6d1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:07.717269Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:07.717292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:07.717295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:07.717296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:07.717306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895649474984753:8596]
2025-09-30T14:54:07.717310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895649474984753:8596]
2025-09-30T14:54:07.717314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895649474984753:8596]
2025-09-30T14:54:07.717352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:07.717358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.717361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:07.717512Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:07.719393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:07.719407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:07.719411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:07.732290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1423 sessionId: src_id|3ff22ed4-7f7e6081-ef69c34a-a972f6d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:07.735795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:07.762589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895649564736067:8563]
2025-09-30T14:54:07.763128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1422, pipe: [1:7555895649564736067:8563]
2025-09-30T14:54:07.860482Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:07.860943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:07.860953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:07.860975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895649564736067:8563], now have 1 active actors on pipe
2025-09-30T14:54:07.861220Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:07.862185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff22ed4-7f7e6081-ef69c34a-a972f6d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:07.862196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff22ed4-7f7e6081-ef69c34a-a972f6d1_0] Write session will restart in 0.005337s
2025-09-30T14:54:07.862220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff22ed4-7f7e6081-ef69c34a-a972f6d1_0] Write session: Do CDS request
2025-09-30T14:54:07.862226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff22ed4-7f7e6081-ef69c34a-a972f6d1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:07.861696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895649564736067:8563]
2025-09-30T14:54:07.861749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:07.861823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1423 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3ff22ed4-7f7e6081-ef69c34a-a972f6d1_0
2025-09-30T14:54:07.862022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1423 sessionId: src_id|3ff22ed4-7f7e6081-ef69c34a-a972f6d1_0 is DEAD
2025-09-30T14:54:07.862237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:07.868848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff22ed4-7f7e6081-ef69c34a-a972f6d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:07.869045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:07.869065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1424
2025-09-30T14:54:07.869344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1424 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:07.869389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1424 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:07.869395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1424 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:07.869400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:07.869937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1424 sessionId:  describe result for acl check
2025-09-30T14:54:07.869989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:07.869995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:07.869997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:07.870003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895649564736083:8701] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:07.870559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895649564736083:8701] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:07.873954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895649564736083:8701] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:07.878445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895649564736083:8701] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:07.878467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895649564736083:8701] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:07.878472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895649564736083:8701] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:07.878482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1424 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:07.888949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:07.892071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:07.892328Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:07.892354Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:07.892367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:07.892437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:07.892489Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895649474985037:8611]
2025-09-30T14:54:07.893145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:07.893626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:07.893696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:07.894074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:07.894153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:07.894161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:07.894162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:07.894164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:07.894166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:07.894168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:07.894170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:07.894172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:07.894173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:07.894175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:07.894177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.894179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:07.894180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:07.894182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:07.894184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:07.894191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:07.894203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:07.894208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:07.894212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:07.894217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:07.894222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:07.894227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:07.894232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:07.894237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:07.894242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:07.894247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.894251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:07.894256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:07.894260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:07.894264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:07.894273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:07.894283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:07.894299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:07.894306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:07.894312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:07.894317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:07.894322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:07.894327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:07.894332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:07.894337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:07.894342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:07.894348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:07.894354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:07.894361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:07.894366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:07.894373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:07.894378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:07.894384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:07.894389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:07.894401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:07.894410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.894421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.894427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:07.894437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:07.894443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:07.894449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:07.894454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:07.894461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:07.894469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:07.894475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:07.894528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:07.901627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:07.902704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:07.902722Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:07.902725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:07.902729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:07.902736Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1423 [2:7555895649474985037:8611]
2025-09-30T14:54:07.902754Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:07.902773Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:07.902781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:07.902784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:07.902787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:07.902804Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:07.902818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:07.902826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:07.902890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.902897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:07.902899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:07.902903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:07.902906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:07.902979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:07.902987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.903001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:07.903019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:07.903187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1423
2025-09-30T14:54:07.903190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1423
2025-09-30T14:54:07.903042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:07.903065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895649564736070:2454], now have 1 active actors on pipe
2025-09-30T14:54:07.903069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895649564736192:8701], now have 1 active actors on pipe
2025-09-30T14:54:07.903075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895649474985032:8611]
2025-09-30T14:54:07.903078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895649474985032:8611]
2025-09-30T14:54:07.903080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895649474985032:8611]
2025-09-30T14:54:07.903093Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:07.903109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:07.903115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:07.903119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:07.903121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:07.903124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:07.903128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:07.903166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895649474985032:8611]
2025-09-30T14:54:07.903174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:07.903181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:07.903312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:07.903317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:07.903342Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|437acc21-e25e9fb6-cc5c681c-133b2f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:07.903349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:07.903353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:07.903355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:07.903365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:07.903375Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:07.903390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:07.903788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:07.903802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:07.903816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:07.903935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1424 partition: 0 MaxSeqNo: 42 sessionId: src_id|437acc21-e25e9fb6-cc5c681c-133b2f7_0
2025-09-30T14:54:07.904473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff22ed4-7f7e6081-ef69c34a-a972f6d1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|437acc21-e25e9fb6-cc5c681c-133b2f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:07.907511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|437acc21-e25e9fb6-cc5c681c-133b2f7_0] Write session: try to update token
2025-09-30T14:54:07.907534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|437acc21-e25e9fb6-cc5c681c-133b2f7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:07.916736Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:07.916761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:07.916773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895649474985032:8611]
2025-09-30T14:54:07.916824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:07.916831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:07.917026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:07.917186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:07.917346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:07.917504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:07.917716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:07.917765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:07.932788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1424 sessionId: src_id|437acc21-e25e9fb6-cc5c681c-133b2f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:07.935922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:07.936973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:07.936999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:07.937019Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:07.937021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:07.937023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:07.937025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:07.937034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895649474985032:8611]
2025-09-30T14:54:07.937037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895649474985032:8611]
2025-09-30T14:54:07.937040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895649474985032:8611]
2025-09-30T14:54:07.937086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:07.937093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:07.937095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:07.937102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:07.937110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:07.937115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:07.937231Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:07.961807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895649564736335:8563]
2025-09-30T14:54:07.962230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1423, pipe: [1:7555895649564736335:8563]
2025-09-30T14:54:08.055357Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:08.056124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:08.056171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895649564736335:8563], now have 1 active actors on pipe
2025-09-30T14:54:08.056901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|437acc21-e25e9fb6-cc5c681c-133b2f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:08.056911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|437acc21-e25e9fb6-cc5c681c-133b2f7_0] Write session will restart in 0.007648s
2025-09-30T14:54:08.056937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|437acc21-e25e9fb6-cc5c681c-133b2f7_0] Write session: Do CDS request
2025-09-30T14:54:08.056944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|437acc21-e25e9fb6-cc5c681c-133b2f7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:08.056350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:08.056471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:08.056474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:08.056549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1424 reason: error at write: Disconnected sessionId: src_id|437acc21-e25e9fb6-cc5c681c-133b2f7_0
2025-09-30T14:54:08.056751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1424 sessionId: src_id|437acc21-e25e9fb6-cc5c681c-133b2f7_0 is DEAD
2025-09-30T14:54:08.056914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895649564736335:8563]
2025-09-30T14:54:08.056929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:08.065858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|437acc21-e25e9fb6-cc5c681c-133b2f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:08.065979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:08.066000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1425
2025-09-30T14:54:08.066180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1425 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:08.066217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1425 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:08.066222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1425 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:08.066232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:08.066705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1425 sessionId:  describe result for acl check
2025-09-30T14:54:08.066746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:08.066755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:08.066758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:08.066764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895653859703657:8708] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:08.067350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895653859703657:8708] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:08.070220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895653859703657:8708] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:08.074836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895653859703657:8708] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:08.074856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895653859703657:8708] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:08.074861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895653859703657:8708] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:08.074872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1425 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:08.084127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:08.087283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:08.087560Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:08.087574Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:08.087587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:08.087650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:08.087699Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895653769952590:8613]
2025-09-30T14:54:08.088411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:08.088870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:08.088926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:08.089299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:08.089378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:08.089398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:08.089404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:08.089405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:08.089406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:08.089408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:08.089409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:08.089411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:08.089412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:08.089414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:08.089415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.089416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:08.089418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:08.089419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:08.089420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:08.089426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:08.089436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:08.089441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:08.089445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:08.089449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:08.089453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:08.089456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:08.089460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:08.089464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:08.089469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:08.089473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.089477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:08.089481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:08.089485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:08.089489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:08.089497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:08.089506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:08.089512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:08.089519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:08.089524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:08.089530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:08.089534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:08.089549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:08.089558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:08.089564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:08.089569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:08.089576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:08.089581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:08.089592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:08.089597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:08.089602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:08.089607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:08.089613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:08.089617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:08.089628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:08.089633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.089637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.089647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:08.089653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:08.089662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:08.089667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:08.089677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:08.089683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:08.089693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:08.089698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:08.089747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:08.095917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:08.097357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:08.097382Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:08.097385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:08.097390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:08.097397Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1424 [2:7555895653769952590:8613]
2025-09-30T14:54:08.097414Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:08.097431Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:08.097434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:08.097437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:08.097439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:08.097457Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:08.097473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:08.097480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:08.097555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.097563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:08.097565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:08.097569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:08.097572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:08.097648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:08.097658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.097672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:08.097683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:08.097701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:08.097723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895653769952585:8613]
2025-09-30T14:54:08.097726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895653769952585:8613]
2025-09-30T14:54:08.097728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895653769952585:8613]
2025-09-30T14:54:08.097743Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:08.097761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:08.097781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:08.097788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:08.097797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:08.097801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:08.097804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:08.097838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895653769952585:8613]
2025-09-30T14:54:08.097846Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:08.097898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:08.097984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895653859703634:2454], now have 1 active actors on pipe
2025-09-30T14:54:08.098000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895653859703770:8708], now have 1 active actors on pipe
2025-09-30T14:54:08.098068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1424
2025-09-30T14:54:08.098081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1424
2025-09-30T14:54:08.098245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:08.098258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:08.098289Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a5d79f0-ea32f026-a0a866c8-d8bedf49_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:08.098315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:08.098325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:08.098328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:08.098340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:08.098352Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:08.098369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:08.098663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:08.098673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:08.098690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:08.098801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1425 partition: 0 MaxSeqNo: 42 sessionId: src_id|1a5d79f0-ea32f026-a0a866c8-d8bedf49_0
2025-09-30T14:54:08.099172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|437acc21-e25e9fb6-cc5c681c-133b2f7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1a5d79f0-ea32f026-a0a866c8-d8bedf49_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:08.102145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a5d79f0-ea32f026-a0a866c8-d8bedf49_0] Write session: try to update token
2025-09-30T14:54:08.102167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a5d79f0-ea32f026-a0a866c8-d8bedf49_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:08.113064Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:08.113093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:08.113104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895653769952585:8613]
2025-09-30T14:54:08.113158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:08.113410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:08.113572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:08.113601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:08.113759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:08.113943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:08.114173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:08.114233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:08.128100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1425 sessionId: src_id|1a5d79f0-ea32f026-a0a866c8-d8bedf49_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:08.129757Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:08.129783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:08.129786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:08.129788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:08.129799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895653769952585:8613]
2025-09-30T14:54:08.129804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895653769952585:8613]
2025-09-30T14:54:08.129808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895653769952585:8613]
2025-09-30T14:54:08.129854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:08.129863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.129865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:08.129868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:08.129876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:08.129880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:08.130038Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:08.131028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:08.159499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895653859703911:8563]
2025-09-30T14:54:08.159888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1424, pipe: [1:7555895653859703911:8563]
2025-09-30T14:54:08.258258Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:08.258862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:08.258872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:08.258896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895653859703911:8563], now have 1 active actors on pipe
2025-09-30T14:54:08.259157Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:08.259319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:08.259445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1425 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1a5d79f0-ea32f026-a0a866c8-d8bedf49_0
2025-09-30T14:54:08.259705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1425 sessionId: src_id|1a5d79f0-ea32f026-a0a866c8-d8bedf49_0 is DEAD
2025-09-30T14:54:08.259879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:08.259931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895653859703911:8563]
2025-09-30T14:54:08.267372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a5d79f0-ea32f026-a0a866c8-d8bedf49_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:08.267387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a5d79f0-ea32f026-a0a866c8-d8bedf49_0] Write session will restart in 0.009663s
2025-09-30T14:54:08.267414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a5d79f0-ea32f026-a0a866c8-d8bedf49_0] Write session: Do CDS request
2025-09-30T14:54:08.267421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a5d79f0-ea32f026-a0a866c8-d8bedf49_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:08.278891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a5d79f0-ea32f026-a0a866c8-d8bedf49_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:08.279410Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:08.279437Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1426
2025-09-30T14:54:08.279877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1426 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:08.279935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1426 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:08.279942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1426 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:08.279948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:08.280624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1426 sessionId:  describe result for acl check
2025-09-30T14:54:08.280677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:08.280680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:08.280683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:08.280691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895653859704100:8712] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:08.281652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895653859704100:8712] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:08.283859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895653859704100:8712] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:08.291409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895653859704100:8712] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:08.291439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895653859704100:8712] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:08.291443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895653859704100:8712] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:08.291539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1426 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:08.291693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:08.295944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:08.296238Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:08.296251Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:08.296264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:08.296329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:08.296380Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895653769952850:8616]
2025-09-30T14:54:08.297138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:08.297590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:08.297665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:08.298068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:08.298160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:08.298168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:08.298169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:08.298171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:08.298173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:08.298175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:08.298177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:08.298179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:08.298181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:08.298182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:08.298183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.298185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:08.298186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:08.298188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:08.298189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:08.298196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:08.298209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:08.298213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:08.298219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:08.298223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:08.298228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:08.298232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:08.298236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:08.298240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:08.298245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:08.298250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.298255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:08.298259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:08.298263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:08.298285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:08.298295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:08.298305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:08.298311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:08.298317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:08.298323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:08.298329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:08.298335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:08.298341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:08.298347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:08.298353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:08.298358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:08.298370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:08.298376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:08.298382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:08.298387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:08.298392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:08.298398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:08.298403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:08.298412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:08.298423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:08.298429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.298436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.298441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:08.298447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:08.298453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:08.298459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:08.298464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:08.298470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:08.298476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:08.298481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:08.298532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:08.310950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:08.311988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:08.312012Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:08.312028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:08.312033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:08.312041Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1425 [2:7555895653769952850:8616]
2025-09-30T14:54:08.312063Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:08.312082Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:08.312085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:08.312088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:08.312091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:08.312111Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:08.312121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:08.312130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:08.312207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.312217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:08.312219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:08.312224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:08.312227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:08.312548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1425
2025-09-30T14:54:08.312554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1425
2025-09-30T14:54:08.312303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:08.312314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.312328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:08.312339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:08.312356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:08.312377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895653769952844:8616]
2025-09-30T14:54:08.312380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895653769952844:8616]
2025-09-30T14:54:08.312382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895653769952844:8616]
2025-09-30T14:54:08.312392Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:08.312407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:08.312409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895653859704168:8712], now have 1 active actors on pipe
2025-09-30T14:54:08.312410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:08.312412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:08.312413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895653859703914:2454], now have 1 active actors on pipe
2025-09-30T14:54:08.312421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:08.312437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:08.312441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:08.312481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895653769952844:8616]
2025-09-30T14:54:08.312490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:08.312724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:08.312894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:08.312906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:08.312941Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5e305a1-b36749db-b2505553-a670f75b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:08.312950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:08.312955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:08.312958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:08.312969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:08.312980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:08.312999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:08.313392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:08.313403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:08.313422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:08.313882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1426 partition: 0 MaxSeqNo: 42 sessionId: src_id|b5e305a1-b36749db-b2505553-a670f75b_0
2025-09-30T14:54:08.314363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a5d79f0-ea32f026-a0a866c8-d8bedf49_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b5e305a1-b36749db-b2505553-a670f75b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:08.317562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5e305a1-b36749db-b2505553-a670f75b_0] Write session: try to update token
2025-09-30T14:54:08.317587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5e305a1-b36749db-b2505553-a670f75b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:08.327773Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:08.327799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:08.327802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:08.327805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:08.327815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895653769952844:8616]
2025-09-30T14:54:08.327821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895653769952844:8616]
2025-09-30T14:54:08.327826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895653769952844:8616]
2025-09-30T14:54:08.327874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:08.327883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.327886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:08.328045Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:08.335337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:08.335368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:08.335374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:08.351198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1426 sessionId: src_id|b5e305a1-b36749db-b2505553-a670f75b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:08.354228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:08.359621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895653859704181:8563]
2025-09-30T14:54:08.359971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1425, pipe: [1:7555895653859704181:8563]
2025-09-30T14:54:08.457884Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:08.458950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:08.458964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:08.458986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895653859704181:8563], now have 1 active actors on pipe
2025-09-30T14:54:08.459742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:08.459759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:08.459833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1426 reason: error at write: Disconnected sessionId: src_id|b5e305a1-b36749db-b2505553-a670f75b_0
2025-09-30T14:54:08.459842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895653859704181:8563]
2025-09-30T14:54:08.459859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:08.460054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1426 sessionId: src_id|b5e305a1-b36749db-b2505553-a670f75b_0 is DEAD
2025-09-30T14:54:08.459308Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:08.460517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5e305a1-b36749db-b2505553-a670f75b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:08.460529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5e305a1-b36749db-b2505553-a670f75b_0] Write session will restart in 0.006581s
2025-09-30T14:54:08.460554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5e305a1-b36749db-b2505553-a670f75b_0] Write session: Do CDS request
2025-09-30T14:54:08.460564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5e305a1-b36749db-b2505553-a670f75b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:08.468827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5e305a1-b36749db-b2505553-a670f75b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:08.468952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:08.468972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1427
2025-09-30T14:54:08.469133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1427 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:08.469166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1427 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:08.469179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1427 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:08.469185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:08.469673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1427 sessionId:  describe result for acl check
2025-09-30T14:54:08.469714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:08.469716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:08.469718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:08.469726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895653859704202:8717] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:08.470231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895653859704202:8717] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:08.475381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895653859704202:8717] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:08.484636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895653859704202:8717] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:08.484660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895653859704202:8717] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:08.484663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895653859704202:8717] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:08.484672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1427 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:08.530592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:08.531754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:08.531978Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:08.531994Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:08.532008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:08.532089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:08.532237Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895653769953122:8619]
2025-09-30T14:54:08.532929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:08.533381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:08.533439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:08.533792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:08.533871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:08.533872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:08.533874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:08.533875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:08.533877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:08.533879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:08.533880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:08.533882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:08.533884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:08.533885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:08.533887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.533888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:08.533890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:08.533892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:08.533893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:08.533919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:08.533930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:08.533934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:08.533939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:08.533942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:08.533946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:08.533950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:08.533954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:08.533959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:08.533966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:08.533970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.533974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:08.533977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:08.533981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:08.533984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:08.533994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:08.534003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:08.534009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:08.534015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:08.534020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:08.534026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:08.534031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:08.534037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:08.534043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:08.534049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:08.534054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:08.534075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:08.534080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:08.534085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:08.534089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:08.534093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:08.534098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:08.534103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:08.534107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:08.534112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:08.534117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.534122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.534126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:08.534130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:08.534136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:08.534141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:08.534145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:08.534149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:08.534154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:08.534160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:08.534204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:08.542603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:08.543607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:08.543616Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:08.543620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:08.543625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:08.543634Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1426 [2:7555895653769953122:8619]
2025-09-30T14:54:08.543654Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:08.543674Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:08.543677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:08.543681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:08.543684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:08.543702Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:08.543713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:08.543721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:08.543787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.543791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:08.543794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:08.543798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:08.543800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:08.543882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:08.543884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.543898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:08.543911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:08.543928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:08.543944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895653769953117:8619]
2025-09-30T14:54:08.543947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895653769953117:8619]
2025-09-30T14:54:08.543949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895653769953117:8619]
2025-09-30T14:54:08.543963Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:08.543977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:08.543992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:08.543996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:08.544030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895653769953117:8619]
2025-09-30T14:54:08.544032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:08.544459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:08.544467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:08.544470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:08.544476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:08.545448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1426
2025-09-30T14:54:08.545492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1426
2025-09-30T14:54:08.546333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895653859704195:2454], now have 1 active actors on pipe
2025-09-30T14:54:08.546350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895653859704241:8717], now have 1 active actors on pipe
2025-09-30T14:54:08.546374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:08.546380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:08.546414Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6616992-d64fb376-7dd10813-3d0876db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:08.546427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:08.546431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:08.546435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:08.546450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:08.546467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:08.546491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:08.550458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:08.550483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:08.550523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:08.550782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1427 partition: 0 MaxSeqNo: 42 sessionId: src_id|f6616992-d64fb376-7dd10813-3d0876db_0
2025-09-30T14:54:08.551541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5e305a1-b36749db-b2505553-a670f75b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f6616992-d64fb376-7dd10813-3d0876db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:08.554562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6616992-d64fb376-7dd10813-3d0876db_0] Write session: try to update token
2025-09-30T14:54:08.554584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6616992-d64fb376-7dd10813-3d0876db_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:08.557267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895653859704464:8563]
2025-09-30T14:54:08.558068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1426, pipe: [1:7555895653859704464:8563]
2025-09-30T14:54:08.559126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895653859704464:8563], now have 1 active actors on pipe
2025-09-30T14:54:08.561519Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:08.561541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:08.561544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:08.561545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:08.561555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895653769953117:8619]
2025-09-30T14:54:08.561560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895653769953117:8619]
2025-09-30T14:54:08.561565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895653769953117:8619]
2025-09-30T14:54:08.561610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:08.561616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.561619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:08.561761Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:08.563632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:08.563663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:08.563669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:08.589380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1427 sessionId: src_id|f6616992-d64fb376-7dd10813-3d0876db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:08.592467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:08.681398Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:08.681838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:08.681859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:08.682139Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:08.682202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895653859704464:8563]
2025-09-30T14:54:08.682222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:08.682224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:08.682279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1427 reason: error at write: Disconnected sessionId: src_id|f6616992-d64fb376-7dd10813-3d0876db_0
2025-09-30T14:54:08.682480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1427 sessionId: src_id|f6616992-d64fb376-7dd10813-3d0876db_0 is DEAD
2025-09-30T14:54:08.682940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6616992-d64fb376-7dd10813-3d0876db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:08.682949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6616992-d64fb376-7dd10813-3d0876db_0] Write session will restart in 0.009197s
2025-09-30T14:54:08.682979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6616992-d64fb376-7dd10813-3d0876db_0] Write session: Do CDS request
2025-09-30T14:54:08.682985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6616992-d64fb376-7dd10813-3d0876db_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:08.682184Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:08.694475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6616992-d64fb376-7dd10813-3d0876db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:08.694608Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:08.694642Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1428
2025-09-30T14:54:08.695493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1428 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:08.695537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1428 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:08.695542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1428 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:08.695550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:08.696199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1428 sessionId:  describe result for acl check
2025-09-30T14:54:08.696245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:08.696255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:08.696257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:08.696262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895653859704503:8722] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:08.696861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895653859704503:8722] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:08.701808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895653859704503:8722] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:08.707766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895653859704503:8722] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:08.707787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895653859704503:8722] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:08.707791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895653859704503:8722] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:08.707800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1428 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:08.712585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:08.716571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:08.716871Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:08.716884Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:08.716896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:08.716965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:08.717017Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895653769953384:8622]
2025-09-30T14:54:08.717743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:08.718148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:08.718203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:08.718584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:08.718657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:08.718658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:08.718659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:08.718660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:08.718661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:08.718663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:08.718664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:08.718666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:08.718667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:08.718668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:08.718669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.718671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:08.718672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:08.718674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:08.718675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:08.718682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:08.718692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:08.718696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:08.718701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:08.718705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:08.718709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:08.718713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:08.718717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:08.718721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:08.718725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:08.718729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.718733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:08.718737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:08.718740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:08.718744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:08.718752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:08.718761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:08.718767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:08.718774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:08.718779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:08.718785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:08.718791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:08.718797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:08.718802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:08.718807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:08.718812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:08.718817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:08.718822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:08.718828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:08.718833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:08.718838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:08.718844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:08.718848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:08.718855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:08.718861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:08.718866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.718871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.718876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:08.718882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:08.718887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:08.718892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:08.718897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:08.718902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:08.718911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:08.718916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:08.718964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:08.726094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:08.728547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:08.728573Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:08.728577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:08.728581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:08.728589Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1427 [2:7555895653769953384:8622]
2025-09-30T14:54:08.728615Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:08.728634Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:08.728639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:08.728642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:08.728645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:08.728663Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:08.728670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:08.728677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:08.728758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.728768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:08.728771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:08.728774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:08.728777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:08.728856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:08.728865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.728882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:08.728894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:08.728915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:08.728932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895653769953379:8622]
2025-09-30T14:54:08.728935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895653769953379:8622]
2025-09-30T14:54:08.728937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895653769953379:8622]
2025-09-30T14:54:08.728953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:08.728968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:08.728984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:08.728987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:08.729028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895653769953379:8622]
2025-09-30T14:54:08.729035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:08.729166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:08.729176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:08.729179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:08.729185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:08.729530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1427
2025-09-30T14:54:08.729584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1427
2025-09-30T14:54:08.729849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895653859704469:2454], now have 1 active actors on pipe
2025-09-30T14:54:08.729863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895653859704720:8722], now have 1 active actors on pipe
2025-09-30T14:54:08.729887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:08.729892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:08.729991Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1c9941-25e002ec-2cad97ef-88eb5044_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:08.730008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:08.730020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:08.730022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:08.730035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:08.730047Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:08.730064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:08.730294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:08.730303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:08.730319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:08.730425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1428 partition: 0 MaxSeqNo: 42 sessionId: src_id|c1c9941-25e002ec-2cad97ef-88eb5044_0
2025-09-30T14:54:08.730876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6616992-d64fb376-7dd10813-3d0876db_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c1c9941-25e002ec-2cad97ef-88eb5044_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:08.738518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1c9941-25e002ec-2cad97ef-88eb5044_0] Write session: try to update token
2025-09-30T14:54:08.738546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1c9941-25e002ec-2cad97ef-88eb5044_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:08.752998Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:08.753026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:08.753029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:08.753032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:08.753042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895653769953379:8622]
2025-09-30T14:54:08.753047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895653769953379:8622]
2025-09-30T14:54:08.753052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895653769953379:8622]
2025-09-30T14:54:08.753092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:08.753093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:08.753096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:08.753100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.753100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:08.753103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:08.753240Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:08.771877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1428 sessionId: src_id|c1c9941-25e002ec-2cad97ef-88eb5044_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:08.774845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:08.782551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895653859704751:8563]
2025-09-30T14:54:08.783017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1427, pipe: [1:7555895653859704751:8563]
2025-09-30T14:54:08.888228Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:08.888809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:08.888821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:08.888863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895653859704751:8563], now have 1 active actors on pipe
2025-09-30T14:54:08.889127Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:08.891565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1c9941-25e002ec-2cad97ef-88eb5044_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:08.891578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1c9941-25e002ec-2cad97ef-88eb5044_0] Write session will restart in 0.009288s
2025-09-30T14:54:08.890026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:08.890115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1428 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c1c9941-25e002ec-2cad97ef-88eb5044_0
2025-09-30T14:54:08.890336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1428 sessionId: src_id|c1c9941-25e002ec-2cad97ef-88eb5044_0 is DEAD
2025-09-30T14:54:08.890937Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:08.891605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1c9941-25e002ec-2cad97ef-88eb5044_0] Write session: Do CDS request
2025-09-30T14:54:08.890981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895653859704751:8563]
2025-09-30T14:54:08.891611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1c9941-25e002ec-2cad97ef-88eb5044_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:08.903791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1c9941-25e002ec-2cad97ef-88eb5044_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:08.907446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:08.907471Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1429
2025-09-30T14:54:08.907661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1429 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:08.907709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1429 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:08.907721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1429 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:08.907727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:08.908311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1429 sessionId:  describe result for acl check
2025-09-30T14:54:08.908383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:08.908392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:08.908394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:08.908401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895653859704883:8733] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:08.908987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895653859704883:8733] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:08.911760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895653859704883:8733] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:08.920240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895653859704883:8733] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:08.920268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895653859704883:8733] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:08.920272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895653859704883:8733] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:08.920281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1429 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:08.920339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:08.926859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:08.927122Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:08.927126Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:08.927137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:08.927195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:08.927234Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895653769953682:8636]
2025-09-30T14:54:08.928004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:08.928431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:08.928498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:08.928878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:08.928965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:08.928976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:08.928978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:08.928979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:08.928980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:08.928982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:08.928983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:08.928984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:08.928986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:08.928987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:08.928988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.928990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:08.928991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:08.928992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:08.928994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:08.929001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:08.929011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:08.929016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:08.929020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:08.929024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:08.929028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:08.929032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:08.929036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:08.929041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:08.929045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:08.929050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.929054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:08.929058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:08.929062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:08.929066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:08.929076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:08.929084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:08.929091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:08.929096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:08.929100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:08.929110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:08.929114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:08.929120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:08.929126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:08.929131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:08.929136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:08.929142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:08.929147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:08.929153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:08.929158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:08.929164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:08.929169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:08.929180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:08.929185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:08.929191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:08.929197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.929202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.929208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:08.929223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:08.929228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:08.929240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:08.929245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:08.929253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:08.929258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:08.929270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:08.929316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:08.936045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:08.937086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:08.937107Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:08.937111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:08.937115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:08.937122Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1428 [2:7555895653769953682:8636]
2025-09-30T14:54:08.937142Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:08.937158Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:08.937168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:08.937172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:08.937175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:08.937193Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:08.937200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:08.937207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:08.937276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.937284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:08.937287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:08.937291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:08.937308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:08.937377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:08.937387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.937402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:08.937417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:08.937438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:08.937459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895653859704773:2454], now have 1 active actors on pipe
2025-09-30T14:54:08.937470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895653859705030:8733], now have 1 active actors on pipe
2025-09-30T14:54:08.937476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895653769953675:8636]
2025-09-30T14:54:08.937479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895653769953675:8636]
2025-09-30T14:54:08.937482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895653769953675:8636]
2025-09-30T14:54:08.937495Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:08.937514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:08.937530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:08.937539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:08.937573Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1428
2025-09-30T14:54:08.937649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1428
2025-09-30T14:54:08.937579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895653769953675:8636]
2025-09-30T14:54:08.937587Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:08.937596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:08.937600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:08.937603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:08.937609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:08.937765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:08.937770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:08.937795Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7642e893-c6f284e4-e9a10efc-93f8452d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:08.937802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:08.937806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:08.937809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:08.937819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:08.937829Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:08.937843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:08.938069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:08.938079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:08.938094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:08.938189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1429 partition: 0 MaxSeqNo: 42 sessionId: src_id|7642e893-c6f284e4-e9a10efc-93f8452d_0
2025-09-30T14:54:08.938574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1c9941-25e002ec-2cad97ef-88eb5044_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7642e893-c6f284e4-e9a10efc-93f8452d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:08.941611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7642e893-c6f284e4-e9a10efc-93f8452d_0] Write session: try to update token
2025-09-30T14:54:08.941634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7642e893-c6f284e4-e9a10efc-93f8452d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:08.953666Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:08.953690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:08.953693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:08.953695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:08.953705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895653769953675:8636]
2025-09-30T14:54:08.953710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895653769953675:8636]
2025-09-30T14:54:08.953715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895653769953675:8636]
2025-09-30T14:54:08.953757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:08.953765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:08.953768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:08.953788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:08.953796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:08.953800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:08.953944Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:08.959480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1429 sessionId: src_id|7642e893-c6f284e4-e9a10efc-93f8452d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:08.962514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:08.990913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895653859705046:8563]
2025-09-30T14:54:08.991709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1428, pipe: [1:7555895653859705046:8563]
2025-09-30T14:54:09.074833Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:09.076071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:09.076091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:09.076158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1429 reason: error at write: Disconnected sessionId: src_id|7642e893-c6f284e4-e9a10efc-93f8452d_0
2025-09-30T14:54:09.076382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1429 sessionId: src_id|7642e893-c6f284e4-e9a10efc-93f8452d_0 is DEAD
2025-09-30T14:54:09.076545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:09.076943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895653859705046:8563]
2025-09-30T14:54:09.075656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:09.075678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:09.075721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895653859705046:8563], now have 1 active actors on pipe
2025-09-30T14:54:09.077267Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:09.078761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7642e893-c6f284e4-e9a10efc-93f8452d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:09.078773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7642e893-c6f284e4-e9a10efc-93f8452d_0] Write session will restart in 0.006625s
2025-09-30T14:54:09.078812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7642e893-c6f284e4-e9a10efc-93f8452d_0] Write session: Do CDS request
2025-09-30T14:54:09.078821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7642e893-c6f284e4-e9a10efc-93f8452d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:09.087087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7642e893-c6f284e4-e9a10efc-93f8452d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:09.087282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:09.087305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1430
2025-09-30T14:54:09.087584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1430 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:09.087619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1430 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:09.087624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1430 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:09.087629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:09.088365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1430 sessionId:  describe result for acl check
2025-09-30T14:54:09.088405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:09.088407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:09.088409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:09.088414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895658154672361:8738] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:09.089009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895658154672361:8738] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:09.092317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895658154672361:8738] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:09.107292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895658154672361:8738] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:09.107316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895658154672361:8738] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:09.107321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895658154672361:8738] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:09.107331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1430 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:09.116311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:09.120200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:09.120483Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:09.120503Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:09.120519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:09.120603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:09.120665Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895658064921241:8638]
2025-09-30T14:54:09.121420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:09.121915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:09.121985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:09.122407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:09.122574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:09.122582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:09.122583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:09.122584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:09.122586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:09.122588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:09.122589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:09.122590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:09.122591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:09.122593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:09.122594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.122595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:09.122596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:09.122597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:09.122599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:09.122605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:09.122616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:09.122620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:09.122625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:09.122629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:09.122633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:09.122637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:09.122641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:09.122646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:09.122650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:09.122654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.122658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:09.122661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:09.122665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:09.122668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:09.122677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:09.122686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:09.122692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:09.122699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:09.122705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:09.122710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:09.122714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:09.122719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:09.122725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:09.122729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:09.122733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:09.122738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:09.122744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:09.122749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:09.122754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:09.122758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:09.122763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:09.122769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:09.122774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:09.122779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:09.122784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.122790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.122795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:09.122799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:09.122804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:09.122809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:09.122813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:09.122821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:09.122827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:09.122832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:09.122879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:09.132753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:09.134211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:09.134236Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:09.134239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:09.134243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:09.134251Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1429 [2:7555895658064921241:8638]
2025-09-30T14:54:09.134269Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:09.134286Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:09.134290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:09.134293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:09.134296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:09.134312Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:09.134320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:09.134328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:09.134408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.134416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:09.134418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:09.134422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:09.134426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:09.134499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:09.134507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.134521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:09.134535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:09.134553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:09.134571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895658064921236:8638]
2025-09-30T14:54:09.134578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895658064921236:8638]
2025-09-30T14:54:09.134581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895658064921236:8638]
2025-09-30T14:54:09.134590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:09.134606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:09.134616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:09.134619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:09.134621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:09.134628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:09.134631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:09.134754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1429
2025-09-30T14:54:09.134816Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1429
2025-09-30T14:54:09.134675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895658154672351:2454], now have 1 active actors on pipe
2025-09-30T14:54:09.134685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895658154672477:8738], now have 1 active actors on pipe
2025-09-30T14:54:09.134688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895658064921236:8638]
2025-09-30T14:54:09.134695Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:09.134706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:09.134913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:09.134924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:09.134952Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b1a41c-b05e9153-298d60e3-8df70479_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:09.134961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:09.134966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:09.134968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:09.134979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:09.134990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:09.135009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:09.135185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:09.135194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:09.135209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:09.135382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1430 partition: 0 MaxSeqNo: 42 sessionId: src_id|1b1a41c-b05e9153-298d60e3-8df70479_0
2025-09-30T14:54:09.135836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7642e893-c6f284e4-e9a10efc-93f8452d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1b1a41c-b05e9153-298d60e3-8df70479_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:09.138816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1a41c-b05e9153-298d60e3-8df70479_0] Write session: try to update token
2025-09-30T14:54:09.138836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1a41c-b05e9153-298d60e3-8df70479_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:09.158108Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:09.158135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:09.158138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:09.158140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:09.158151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895658064921236:8638]
2025-09-30T14:54:09.158156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895658064921236:8638]
2025-09-30T14:54:09.158161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895658064921236:8638]
2025-09-30T14:54:09.158204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:09.158213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.158216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:09.158273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:09.158280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:09.158286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:09.158377Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:09.159538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1430 sessionId: src_id|1b1a41c-b05e9153-298d60e3-8df70479_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:09.162813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:09.175753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895658154672628:8563]
2025-09-30T14:54:09.176085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1429, pipe: [1:7555895658154672628:8563]
2025-09-30T14:54:09.286612Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:09.287223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:09.287237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:09.287275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895658154672628:8563], now have 1 active actors on pipe
2025-09-30T14:54:09.287582Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:09.291926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895658154672628:8563]
2025-09-30T14:54:09.291962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:09.292006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:09.292090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1430 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1b1a41c-b05e9153-298d60e3-8df70479_0
2025-09-30T14:54:09.292327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1430 sessionId: src_id|1b1a41c-b05e9153-298d60e3-8df70479_0 is DEAD
2025-09-30T14:54:09.292842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1a41c-b05e9153-298d60e3-8df70479_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:09.292851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1a41c-b05e9153-298d60e3-8df70479_0] Write session will restart in 0.009556s
2025-09-30T14:54:09.292876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1a41c-b05e9153-298d60e3-8df70479_0] Write session: Do CDS request
2025-09-30T14:54:09.292883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1a41c-b05e9153-298d60e3-8df70479_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:09.303823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1a41c-b05e9153-298d60e3-8df70479_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:09.303973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:09.303996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1431
2025-09-30T14:54:09.304165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1431 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:09.304201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1431 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:09.304212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1431 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:09.304218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:09.304756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1431 sessionId:  describe result for acl check
2025-09-30T14:54:09.304796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:09.304799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:09.304801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:09.304807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895658154672645:8742] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:09.305369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895658154672645:8742] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:09.308692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895658154672645:8742] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:09.313555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895658154672645:8742] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:09.313588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895658154672645:8742] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:09.313591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895658154672645:8742] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:09.313599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1431 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:09.326665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:09.334961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:09.335262Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:09.335268Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:09.335281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:09.335349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:09.335390Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895658064921508:8641]
2025-09-30T14:54:09.336068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:09.336493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:09.336574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:09.336973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:09.337039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:09.337040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:09.337041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:09.337043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:09.337045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:09.337046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:09.337048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:09.337050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:09.337051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:09.337052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:09.337054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.337056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:09.337057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:09.337059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:09.337060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:09.337067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:09.337079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:09.337084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:09.337089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:09.337094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:09.337098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:09.337103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:09.337108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:09.337112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:09.337117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:09.337121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.337126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:09.337130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:09.337135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:09.337139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:09.337147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:09.337157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:09.337164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:09.337171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:09.337177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:09.337184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:09.337189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:09.337197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:09.337202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:09.337208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:09.337213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:09.337219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:09.337244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:09.337250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:09.337255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:09.337261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:09.337267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:09.337273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:09.337278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:09.337285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:09.337290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.337296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.337301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:09.337307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:09.337313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:09.337319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:09.337325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:09.337331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:09.337336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:09.337342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:09.337396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:09.343414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:09.345128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:09.345151Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:09.345154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:09.345158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:09.345166Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1430 [2:7555895658064921508:8641]
2025-09-30T14:54:09.345183Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:09.345198Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:09.345202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:09.345205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:09.345208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:09.345224Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:09.345231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:09.345238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:09.345303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.345305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:09.345307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:09.345310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:09.345313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:09.345385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:09.345388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.345402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:09.345416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:09.345437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:09.345456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895658064921503:8641]
2025-09-30T14:54:09.345459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895658064921503:8641]
2025-09-30T14:54:09.345461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895658064921503:8641]
2025-09-30T14:54:09.345468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:09.345481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:09.345498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:09.345500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:09.345537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895658064921503:8641]
2025-09-30T14:54:09.345540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:09.345561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:09.345565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:09.345567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:09.345574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:09.345857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895658154672732:8742], now have 1 active actors on pipe
2025-09-30T14:54:09.345873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895658154672630:2454], now have 1 active actors on pipe
2025-09-30T14:54:09.346038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:09.346049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:09.346076Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b5097e4-a1f66a14-230dcaef-b2936a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:09.346100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:09.346104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:09.346106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:09.346121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:09.346134Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:09.346151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:09.345910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1430
2025-09-30T14:54:09.346229Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1430
2025-09-30T14:54:09.346581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1431 partition: 0 MaxSeqNo: 42 sessionId: src_id|7b5097e4-a1f66a14-230dcaef-b2936a4_0
2025-09-30T14:54:09.347345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1a41c-b05e9153-298d60e3-8df70479_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7b5097e4-a1f66a14-230dcaef-b2936a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:09.346344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:09.346357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:09.346392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:09.350173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b5097e4-a1f66a14-230dcaef-b2936a4_0] Write session: try to update token
2025-09-30T14:54:09.350192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b5097e4-a1f66a14-230dcaef-b2936a4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:09.358607Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:09.358636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:09.358638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:09.358641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:09.358651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895658064921503:8641]
2025-09-30T14:54:09.358655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895658064921503:8641]
2025-09-30T14:54:09.358659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895658064921503:8641]
2025-09-30T14:54:09.358701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:09.358709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.358712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:09.358863Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:09.363335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:09.363361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:09.363367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:09.371637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1431 sessionId: src_id|7b5097e4-a1f66a14-230dcaef-b2936a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:09.374424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:09.394077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895658154672915:8563]
2025-09-30T14:54:09.394473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1430, pipe: [1:7555895658154672915:8563]
2025-09-30T14:54:09.490949Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:09.491431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:09.491450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:09.491472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895658154672915:8563], now have 1 active actors on pipe
2025-09-30T14:54:09.491784Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:09.492250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b5097e4-a1f66a14-230dcaef-b2936a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:09.492262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b5097e4-a1f66a14-230dcaef-b2936a4_0] Write session will restart in 0.007119s
2025-09-30T14:54:09.492287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b5097e4-a1f66a14-230dcaef-b2936a4_0] Write session: Do CDS request
2025-09-30T14:54:09.492292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b5097e4-a1f66a14-230dcaef-b2936a4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:09.491783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895658154672915:8563]
2025-09-30T14:54:09.491784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:09.491789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:09.491827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:09.491877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1431 reason: error at write: Disconnected sessionId: src_id|7b5097e4-a1f66a14-230dcaef-b2936a4_0
2025-09-30T14:54:09.492093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1431 sessionId: src_id|7b5097e4-a1f66a14-230dcaef-b2936a4_0 is DEAD
2025-09-30T14:54:09.500894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b5097e4-a1f66a14-230dcaef-b2936a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:09.501031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:09.501053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1432
2025-09-30T14:54:09.501278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1432 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:09.501313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1432 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:09.501318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1432 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:09.501323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:09.501797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1432 sessionId:  describe result for acl check
2025-09-30T14:54:09.501826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:09.501828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:09.501831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:09.501837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895658154672924:8747] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:09.502462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895658154672924:8747] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:09.505633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895658154672924:8747] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:09.512129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895658154672924:8747] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:09.512153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895658154672924:8747] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:09.512157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895658154672924:8747] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:09.512171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1432 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:09.546138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:09.550530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:09.550814Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:09.550819Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:09.550831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:09.550892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:09.550929Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895658064921786:8644]
2025-09-30T14:54:09.551690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:09.552251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:09.552310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:09.552674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:09.552745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:09.552747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:09.552748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:09.552750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:09.552751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:09.552753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:09.552755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:09.552756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:09.552758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:09.552759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:09.552761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.552762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:09.552764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:09.552765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:09.552767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:09.552774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:09.552786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:09.552791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:09.552796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:09.552801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:09.552805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:09.552810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:09.552814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:09.552819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:09.552823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:09.552827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.552830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:09.552834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:09.552837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:09.552841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:09.552850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:09.552859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:09.552864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:09.552870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:09.552877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:09.552882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:09.552887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:09.552892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:09.552897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:09.552903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:09.552907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:09.552912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:09.552917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:09.552924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:09.552929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:09.552935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:09.552941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:09.552947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:09.552952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:09.552958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:09.552966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.552972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.552977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:09.552983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:09.552989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:09.552994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:09.553000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:09.553005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:09.553014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:09.553020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:09.553069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:09.560205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:09.561349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:09.561356Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:09.561360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:09.561364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:09.561372Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1431 [2:7555895658064921786:8644]
2025-09-30T14:54:09.561390Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:09.561408Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:09.561412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:09.561416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:09.561419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:09.561440Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:09.561447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:09.561455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:09.561522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.561525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:09.561527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:09.561531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:09.561533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:09.561617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:09.561620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.561634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:09.561648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:09.561669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:09.561688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895658064921781:8644]
2025-09-30T14:54:09.561691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895658064921781:8644]
2025-09-30T14:54:09.561693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895658064921781:8644]
2025-09-30T14:54:09.561707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:09.561721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:09.561738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:09.561742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:09.561782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895658064921781:8644]
2025-09-30T14:54:09.561785Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:09.562041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:09.562052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:09.562055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:09.562060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:09.563104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895658154672967:8747], now have 1 active actors on pipe
2025-09-30T14:54:09.563116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895658154672917:2454], now have 1 active actors on pipe
2025-09-30T14:54:09.563131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:09.563137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:09.563167Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54449f7b-eb745b44-74db2eaf-b628de6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:09.563177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:09.563182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:09.563185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:09.563197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:09.563211Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:09.563230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:09.563608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:09.563616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:09.563630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:09.564271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b5097e4-a1f66a14-230dcaef-b2936a4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|54449f7b-eb745b44-74db2eaf-b628de6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:09.562868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1431
2025-09-30T14:54:09.562904Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1431
2025-09-30T14:54:09.563819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1432 partition: 0 MaxSeqNo: 42 sessionId: src_id|54449f7b-eb745b44-74db2eaf-b628de6b_0
2025-09-30T14:54:09.567223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54449f7b-eb745b44-74db2eaf-b628de6b_0] Write session: try to update token
2025-09-30T14:54:09.568375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54449f7b-eb745b44-74db2eaf-b628de6b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:09.592083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895658154673191:8563]
2025-09-30T14:54:09.592614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1431, pipe: [1:7555895658154673191:8563]
2025-09-30T14:54:09.592487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895658154673191:8563], now have 1 active actors on pipe
2025-09-30T14:54:09.595397Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:09.595418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:09.595420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:09.595422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:09.595437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895658064921781:8644]
2025-09-30T14:54:09.595442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895658064921781:8644]
2025-09-30T14:54:09.595448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895658064921781:8644]
2025-09-30T14:54:09.595488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:09.595495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.595499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:09.595667Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:09.599634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:09.599660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:09.599664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:09.608521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1432 sessionId: src_id|54449f7b-eb745b44-74db2eaf-b628de6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:09.611338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:09.731304Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:09.732573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:09.732588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:09.732921Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:09.739343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895658154673191:8563]
2025-09-30T14:54:09.739352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:09.739384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:09.739443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1432 reason: status is not ok: tablet will be restarted right now sessionId: src_id|54449f7b-eb745b44-74db2eaf-b628de6b_0
2025-09-30T14:54:09.739647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1432 sessionId: src_id|54449f7b-eb745b44-74db2eaf-b628de6b_0 is DEAD
2025-09-30T14:54:09.739813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54449f7b-eb745b44-74db2eaf-b628de6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:09.739823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54449f7b-eb745b44-74db2eaf-b628de6b_0] Write session will restart in 0.006213s
2025-09-30T14:54:09.739848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54449f7b-eb745b44-74db2eaf-b628de6b_0] Write session: Do CDS request
2025-09-30T14:54:09.739856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54449f7b-eb745b44-74db2eaf-b628de6b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:09.746824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54449f7b-eb745b44-74db2eaf-b628de6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:09.746932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:09.746956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1433
2025-09-30T14:54:09.749651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1433 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:09.749709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1433 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:09.749727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1433 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:09.749733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:09.750423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1433 sessionId:  describe result for acl check
2025-09-30T14:54:09.750468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:09.750478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:09.750482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:09.750488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895658154673218:8752] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:09.751029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895658154673218:8752] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:09.756511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895658154673218:8752] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:09.761783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895658154673218:8752] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:09.761809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895658154673218:8752] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:09.761812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895658154673218:8752] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:09.761821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1433 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:09.770052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:09.772998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:09.773281Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:09.773295Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:09.773306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:09.773361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:09.773408Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895658064922054:8647]
2025-09-30T14:54:09.774495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:09.774902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:09.774981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:09.775385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:09.775466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:09.775473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:09.775474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:09.775475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:09.775477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:09.775478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:09.775479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:09.775481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:09.775482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:09.775484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:09.775498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.775499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:09.775501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:09.775501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:09.775503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:09.775509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:09.775521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:09.775524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:09.775528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:09.775533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:09.775538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:09.775543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:09.775546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:09.775550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:09.775553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:09.775557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.775561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:09.775565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:09.775569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:09.775573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:09.775582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:09.775590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:09.775597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:09.775603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:09.775609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:09.775615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:09.775623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:09.775629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:09.775638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:09.775645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:09.775654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:09.775660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:09.775669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:09.775675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:09.775679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:09.775685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:09.775689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:09.775695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:09.775700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:09.775708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:09.775717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.775723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.775732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:09.775738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:09.775747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:09.775753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:09.775759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:09.775765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:09.775774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:09.775780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:09.775846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:09.782666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:09.784157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:09.784164Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:09.784167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:09.784171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:09.784179Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1432 [2:7555895658064922054:8647]
2025-09-30T14:54:09.784197Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:09.784213Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:09.784216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:09.784220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:09.784222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:09.784241Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:09.784248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:09.784255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:09.784322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.784324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:09.784327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:09.784331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:09.784334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:09.784406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:09.784409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.784426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:09.784440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:09.784459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:09.784477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895658064922049:8647]
2025-09-30T14:54:09.784480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895658064922049:8647]
2025-09-30T14:54:09.784483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895658064922049:8647]
2025-09-30T14:54:09.784496Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:09.784510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:09.784526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:09.784529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:09.784569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895658064922049:8647]
2025-09-30T14:54:09.784571Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:09.785116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:09.785133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:09.785136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:09.785145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:09.785440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895658154673346:8752], now have 1 active actors on pipe
2025-09-30T14:54:09.785449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895658154673199:2454], now have 1 active actors on pipe
2025-09-30T14:54:09.786117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1432
2025-09-30T14:54:09.786157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1432
2025-09-30T14:54:09.788021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:09.788042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:09.788094Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1fc20111-6045190c-66be4eb9-13211ea4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:09.788120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:09.788130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:09.788134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:09.788147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:09.788164Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:09.788187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:09.791495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:09.791515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:09.791547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:09.791680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1433 partition: 0 MaxSeqNo: 42 sessionId: src_id|1fc20111-6045190c-66be4eb9-13211ea4_0
2025-09-30T14:54:09.792088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54449f7b-eb745b44-74db2eaf-b628de6b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1fc20111-6045190c-66be4eb9-13211ea4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:09.799714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fc20111-6045190c-66be4eb9-13211ea4_0] Write session: try to update token
2025-09-30T14:54:09.799739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fc20111-6045190c-66be4eb9-13211ea4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:09.805521Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:09.805547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:09.805550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:09.805552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:09.805562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895658064922049:8647]
2025-09-30T14:54:09.805570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895658064922049:8647]
2025-09-30T14:54:09.805575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895658064922049:8647]
2025-09-30T14:54:09.805618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:09.805624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.805628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:09.805864Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:09.809776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:09.809800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:09.809805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:09.819111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1433 sessionId: src_id|1fc20111-6045190c-66be4eb9-13211ea4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:09.821919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:09.838787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895658154673485:8563]
2025-09-30T14:54:09.839108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1432, pipe: [1:7555895658154673485:8563]
2025-09-30T14:54:09.924680Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:09.925274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:09.925281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:09.925299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895658154673485:8563], now have 1 active actors on pipe
2025-09-30T14:54:09.925657Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:09.926331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fc20111-6045190c-66be4eb9-13211ea4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:09.926344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fc20111-6045190c-66be4eb9-13211ea4_0] Write session will restart in 0.006914s
2025-09-30T14:54:09.926369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fc20111-6045190c-66be4eb9-13211ea4_0] Write session: Do CDS request
2025-09-30T14:54:09.926375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fc20111-6045190c-66be4eb9-13211ea4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:09.925832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895658154673485:8563]
2025-09-30T14:54:09.925873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:09.925876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:09.925970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1433 reason: error at write: Disconnected sessionId: src_id|1fc20111-6045190c-66be4eb9-13211ea4_0
2025-09-30T14:54:09.926204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1433 sessionId: src_id|1fc20111-6045190c-66be4eb9-13211ea4_0 is DEAD
2025-09-30T14:54:09.926353Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:09.935173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fc20111-6045190c-66be4eb9-13211ea4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:09.935512Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:09.935536Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1434
2025-09-30T14:54:09.939366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1434 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:09.939441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1434 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:09.939447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1434 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:09.939464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:09.940313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1434 sessionId:  describe result for acl check
2025-09-30T14:54:09.940341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:09.940343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:09.940345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:09.940351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895658154673546:8763] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:09.940934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895658154673546:8763] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:09.944071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895658154673546:8763] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:09.949657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895658154673546:8763] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:09.949676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895658154673546:8763] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:09.949680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895658154673546:8763] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:09.949688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1434 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:09.958524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:09.959403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:09.959585Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:09.959596Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:09.959608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:09.959660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:09.959699Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895658064922357:8661]
2025-09-30T14:54:09.960411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:09.962021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:09.962083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:09.962447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:09.962520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:09.962528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:09.962529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:09.962530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:09.962532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:09.962533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:09.962534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:09.962535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:09.962536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:09.962537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:09.962538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.962540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:09.962541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:09.962542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:09.962543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:09.962549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:09.962559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:09.962564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:09.962567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:09.962570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:09.962574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:09.962578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:09.962582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:09.962587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:09.962597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:09.962606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.962610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:09.962614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:09.962619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:09.962623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:09.962632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:09.962645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:09.962656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:09.962661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:09.962671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:09.962676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:09.962681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:09.962686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:09.962692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:09.962705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:09.962710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:09.962716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:09.962721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:09.962726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:09.962731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:09.962736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:09.962741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:09.962746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:09.962753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:09.962758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:09.962763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.962768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.962774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:09.962779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:09.962784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:09.962789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:09.962794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:09.962799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:09.962805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:09.962810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:09.962858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:09.969688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:09.970718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:09.970741Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:09.970744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:09.970749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:09.970756Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1433 [2:7555895658064922357:8661]
2025-09-30T14:54:09.970772Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:09.970788Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:09.970796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:09.970800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:09.970803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:09.970819Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:09.970826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:09.970843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:09.970908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.970911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:09.970914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:09.970918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:09.970920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:09.970993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:09.970996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:09.971011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:09.971025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:09.971043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:09.971063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895658154673499:2454], now have 1 active actors on pipe
2025-09-30T14:54:09.971071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895658064922352:8661]
2025-09-30T14:54:09.971073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895658064922352:8661]
2025-09-30T14:54:09.971076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895658064922352:8661]
2025-09-30T14:54:09.971091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:09.971105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:09.971122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:09.971125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:09.971132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895658154673680:8763], now have 1 active actors on pipe
2025-09-30T14:54:09.971164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895658064922352:8661]
2025-09-30T14:54:09.971167Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:09.971208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1433
2025-09-30T14:54:09.971226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1433
2025-09-30T14:54:09.971401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:09.971417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:09.971419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:09.971425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:09.971675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:09.971687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:09.971712Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c76be517-dd075e3c-4920781d-88c64af4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:09.971720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:09.971723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:09.971726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:09.971736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:09.971747Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:09.971762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:09.973709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:09.973726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:09.973752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:09.973949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1434 partition: 0 MaxSeqNo: 42 sessionId: src_id|c76be517-dd075e3c-4920781d-88c64af4_0
2025-09-30T14:54:09.974308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fc20111-6045190c-66be4eb9-13211ea4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c76be517-dd075e3c-4920781d-88c64af4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:09.977256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c76be517-dd075e3c-4920781d-88c64af4_0] Write session: try to update token
2025-09-30T14:54:09.977278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c76be517-dd075e3c-4920781d-88c64af4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:09.993590Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:09.993616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:09.993628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895658064922352:8661]
2025-09-30T14:54:09.993686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:09.993885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:09.994055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:09.994205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:09.994565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:09.995351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:09.995600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:09.995652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:09.998988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1434 sessionId: src_id|c76be517-dd075e3c-4920781d-88c64af4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:10.001529Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:10.001559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:10.001562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:10.001564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:10.001575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895658064922352:8661]
2025-09-30T14:54:10.001579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895658064922352:8661]
2025-09-30T14:54:10.001583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895658064922352:8661]
2025-09-30T14:54:10.001626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:10.001640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.001640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:10.001643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:10.001645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:10.001650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:10.001792Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:10.001991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:10.027438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895662449641069:8563]
2025-09-30T14:54:10.027809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1433, pipe: [1:7555895662449641069:8563]
2025-09-30T14:54:10.122420Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:10.123173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:10.123196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:10.123217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895662449641069:8563], now have 1 active actors on pipe
2025-09-30T14:54:10.123430Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:10.124280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c76be517-dd075e3c-4920781d-88c64af4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:10.124291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c76be517-dd075e3c-4920781d-88c64af4_0] Write session will restart in 0.008847s
2025-09-30T14:54:10.124315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c76be517-dd075e3c-4920781d-88c64af4_0] Write session: Do CDS request
2025-09-30T14:54:10.124321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c76be517-dd075e3c-4920781d-88c64af4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:10.123619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:10.123643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:10.123653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895662449641069:8563]
2025-09-30T14:54:10.123676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:10.123713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1434 reason: error at write: Disconnected sessionId: src_id|c76be517-dd075e3c-4920781d-88c64af4_0
2025-09-30T14:54:10.123925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1434 sessionId: src_id|c76be517-dd075e3c-4920781d-88c64af4_0 is DEAD
2025-09-30T14:54:10.134879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c76be517-dd075e3c-4920781d-88c64af4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:10.135280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:10.135302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1435
2025-09-30T14:54:10.135406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1435 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:10.135433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1435 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:10.135438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1435 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:10.135442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:10.136025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1435 sessionId:  describe result for acl check
2025-09-30T14:54:10.136059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:10.136061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:10.136063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:10.136071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895662449641085:8768] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:10.136695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895662449641085:8768] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:10.138761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895662449641085:8768] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:10.141845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895662449641085:8768] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:10.141866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895662449641085:8768] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:10.141870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895662449641085:8768] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:10.141878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1435 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:10.156651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:10.159644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:10.159911Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:10.159923Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:10.159935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:10.160002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:10.160053Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895662359889921:8663]
2025-09-30T14:54:10.160745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:10.161101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:10.161159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:10.161508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:10.161569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:10.161574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:10.161576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:10.161577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:10.161579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:10.161580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:10.161581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:10.161583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:10.161584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:10.161586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:10.161587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.161589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:10.161590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:10.161591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:10.161593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:10.161599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:10.161610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:10.161615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:10.161620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:10.161624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:10.161629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:10.161632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:10.161637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:10.161641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:10.161646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:10.161650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.161654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:10.161658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:10.161662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:10.161667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:10.161675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:10.161683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:10.161690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:10.161696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:10.161701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:10.161706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:10.161710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:10.161715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:10.161721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:10.161727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:10.161732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:10.161737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:10.161743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:10.161748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:10.161753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:10.161759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:10.161764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:10.161770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:10.161780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:10.161786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:10.161791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.161801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.161806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:10.161812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:10.161821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:10.161827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:10.161832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:10.161841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:10.161848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:10.161858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:10.161917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:10.172077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:10.173548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:10.173567Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:10.173570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:10.173575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:10.173583Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1434 [2:7555895662359889921:8663]
2025-09-30T14:54:10.173600Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:10.173615Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:10.173623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:10.173627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:10.173629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:10.173644Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:10.173655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:10.173662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:10.173722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.173729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:10.173731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:10.173735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:10.173737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:10.173808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:10.173816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.173831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:10.173848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:10.173869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:10.173892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895662449641126:8768], now have 1 active actors on pipe
2025-09-30T14:54:10.173915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895662449641076:2454], now have 1 active actors on pipe
2025-09-30T14:54:10.173923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895662359889916:8663]
2025-09-30T14:54:10.173930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895662359889916:8663]
2025-09-30T14:54:10.173932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895662359889916:8663]
2025-09-30T14:54:10.173946Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:10.173965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:10.173973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:10.173977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:10.173980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:10.173981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:10.173984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:10.174023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895662359889916:8663]
2025-09-30T14:54:10.174035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:10.174041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:10.174052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:10.174056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:10.174104Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1a526a7-73caae1f-bca5e777-ecf5f6c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:10.174118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:10.174127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:10.174130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:10.174138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:10.174152Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:10.174175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:10.174416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:10.174428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:10.174445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:10.174961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c76be517-dd075e3c-4920781d-88c64af4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f1a526a7-73caae1f-bca5e777-ecf5f6c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:10.173967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1434
2025-09-30T14:54:10.173979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1434
2025-09-30T14:54:10.174560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1435 partition: 0 MaxSeqNo: 42 sessionId: src_id|f1a526a7-73caae1f-bca5e777-ecf5f6c_0
2025-09-30T14:54:10.177759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a526a7-73caae1f-bca5e777-ecf5f6c_0] Write session: try to update token
2025-09-30T14:54:10.177781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a526a7-73caae1f-bca5e777-ecf5f6c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:10.188079Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:10.188104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:10.188107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:10.188109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:10.188119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895662359889916:8663]
2025-09-30T14:54:10.188124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895662359889916:8663]
2025-09-30T14:54:10.188129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895662359889916:8663]
2025-09-30T14:54:10.188172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:10.188180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.188183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:10.188199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:10.188206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:10.188211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:10.188396Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:10.205936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1435 sessionId: src_id|f1a526a7-73caae1f-bca5e777-ecf5f6c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:10.208869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:10.227365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895662449641356:8563]
2025-09-30T14:54:10.234749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1434, pipe: [1:7555895662449641356:8563]
2025-09-30T14:54:10.305558Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:10.306139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:10.306156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:10.306175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895662449641356:8563], now have 1 active actors on pipe
2025-09-30T14:54:10.306369Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:10.306922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a526a7-73caae1f-bca5e777-ecf5f6c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:10.306939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a526a7-73caae1f-bca5e777-ecf5f6c_0] Write session will restart in 0.007594s
2025-09-30T14:54:10.306400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:10.306454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:10.306538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1435 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f1a526a7-73caae1f-bca5e777-ecf5f6c_0
2025-09-30T14:54:10.306720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895662449641356:8563]
2025-09-30T14:54:10.306978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a526a7-73caae1f-bca5e777-ecf5f6c_0] Write session: Do CDS request
2025-09-30T14:54:10.306769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1435 sessionId: src_id|f1a526a7-73caae1f-bca5e777-ecf5f6c_0 is DEAD
2025-09-30T14:54:10.306985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a526a7-73caae1f-bca5e777-ecf5f6c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:10.315861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a526a7-73caae1f-bca5e777-ecf5f6c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:10.315969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:10.316001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1436
2025-09-30T14:54:10.316144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1436 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:10.316179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1436 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:10.316190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1436 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:10.316195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:10.316757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1436 sessionId:  describe result for acl check
2025-09-30T14:54:10.316803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:10.316810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:10.316815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:10.316825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895662449641377:8772] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:10.317342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895662449641377:8772] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:10.319847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895662449641377:8772] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:10.323532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895662449641377:8772] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:10.323556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895662449641377:8772] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:10.323560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895662449641377:8772] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:10.323569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1436 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:10.330521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:10.334052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:10.334341Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:10.334354Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:10.334367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:10.334437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:10.334494Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895662359890193:8666]
2025-09-30T14:54:10.335348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:10.335752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:10.335830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:10.336366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:10.336479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:10.336489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:10.336491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:10.336492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:10.336494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:10.336495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:10.336496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:10.336498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:10.336499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:10.336501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:10.336502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.336503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:10.336504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:10.336505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:10.336507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:10.336514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:10.336525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:10.336530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:10.336534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:10.336538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:10.336542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:10.336546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:10.336551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:10.336556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:10.336561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:10.336565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.336569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:10.336573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:10.336577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:10.336581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:10.336592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:10.336600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:10.336607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:10.336613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:10.336617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:10.336623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:10.336627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:10.336632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:10.336638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:10.336644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:10.336649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:10.336669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:10.336682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:10.336687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:10.336697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:10.336702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:10.336707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:10.336712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:10.336715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:10.336720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:10.336725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.336731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.336742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:10.336748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:10.336759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:10.336764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:10.336769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:10.336780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:10.336785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:10.336790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:10.336843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:10.343533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:10.344544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:10.344566Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:10.344569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:10.344574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:10.344581Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1435 [2:7555895662359890193:8666]
2025-09-30T14:54:10.344600Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:10.344619Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:10.344628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:10.344631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:10.344634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:10.344652Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:10.344665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:10.344677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:10.344739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.344746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:10.344748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:10.344752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:10.344754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:10.344827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:10.344835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.344848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:10.344864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:10.344886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:10.344912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895662449641504:8772], now have 1 active actors on pipe
2025-09-30T14:54:10.344920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895662449641358:2454], now have 1 active actors on pipe
2025-09-30T14:54:10.344927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895662359890187:8666]
2025-09-30T14:54:10.344930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895662359890187:8666]
2025-09-30T14:54:10.344932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895662359890187:8666]
2025-09-30T14:54:10.344945Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:10.344965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:10.344966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:10.344969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:10.344972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:10.344985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:10.344988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:10.345027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895662359890187:8666]
2025-09-30T14:54:10.345043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:10.345051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:10.345224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1435
2025-09-30T14:54:10.345272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1435
2025-09-30T14:54:10.345351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:10.345365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:10.345395Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27e3ff7c-1b62f2e7-15b5fed1-3dd7c58d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:10.345408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:10.345412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:10.345414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:10.345426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:10.345441Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:10.345464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:10.345739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:10.345749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:10.345764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:10.345883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1436 partition: 0 MaxSeqNo: 42 sessionId: src_id|27e3ff7c-1b62f2e7-15b5fed1-3dd7c58d_0
2025-09-30T14:54:10.346330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a526a7-73caae1f-bca5e777-ecf5f6c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|27e3ff7c-1b62f2e7-15b5fed1-3dd7c58d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:10.349665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27e3ff7c-1b62f2e7-15b5fed1-3dd7c58d_0] Write session: try to update token
2025-09-30T14:54:10.349689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27e3ff7c-1b62f2e7-15b5fed1-3dd7c58d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:10.361981Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:10.362009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:10.362020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895662359890187:8666]
2025-09-30T14:54:10.362075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:10.362087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:10.362285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:10.362453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:10.362614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:10.362778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:10.363762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:10.363830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:10.373234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1436 sessionId: src_id|27e3ff7c-1b62f2e7-15b5fed1-3dd7c58d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:10.375114Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:10.375142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:10.375145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:10.375147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:10.375158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895662359890187:8666]
2025-09-30T14:54:10.375164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895662359890187:8666]
2025-09-30T14:54:10.375169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895662359890187:8666]
2025-09-30T14:54:10.375213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:10.375216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:10.375223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.375226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:10.375234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:10.375239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:10.375428Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:10.376178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:10.407635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895662449641648:8563]
2025-09-30T14:54:10.407953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1435, pipe: [1:7555895662449641648:8563]
2025-09-30T14:54:10.492832Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:10.493106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:10.493119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:10.493136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895662449641648:8563], now have 1 active actors on pipe
2025-09-30T14:54:10.493387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895662449641648:8563]
2025-09-30T14:54:10.493425Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:10.493421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:10.493421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:10.493425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:10.493488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1436 reason: error at write: Disconnected sessionId: src_id|27e3ff7c-1b62f2e7-15b5fed1-3dd7c58d_0
2025-09-30T14:54:10.493670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1436 sessionId: src_id|27e3ff7c-1b62f2e7-15b5fed1-3dd7c58d_0 is DEAD
2025-09-30T14:54:10.493836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27e3ff7c-1b62f2e7-15b5fed1-3dd7c58d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:10.493849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27e3ff7c-1b62f2e7-15b5fed1-3dd7c58d_0] Write session will restart in 0.007394s
2025-09-30T14:54:10.493874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27e3ff7c-1b62f2e7-15b5fed1-3dd7c58d_0] Write session: Do CDS request
2025-09-30T14:54:10.493885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27e3ff7c-1b62f2e7-15b5fed1-3dd7c58d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:10.503741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27e3ff7c-1b62f2e7-15b5fed1-3dd7c58d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:10.503956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:10.503977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1437
2025-09-30T14:54:10.504140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1437 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:10.504185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1437 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:10.504197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1437 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:10.504201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:10.505158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1437 sessionId:  describe result for acl check
2025-09-30T14:54:10.505205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:10.505207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:10.505209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:10.505220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895662449641676:8777] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:10.505793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895662449641676:8777] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:10.512454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895662449641676:8777] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:10.517351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895662449641676:8777] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:10.517374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895662449641676:8777] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:10.517377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895662449641676:8777] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:10.517387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1437 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:10.522860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:10.525721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:10.525987Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:10.526000Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:10.526013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:10.526077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:10.526126Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895662359890475:8669]
2025-09-30T14:54:10.526760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:10.527152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:10.527219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:10.527622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:10.527703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:10.527710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:10.527711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:10.527712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:10.527714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:10.527715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:10.527716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:10.527717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:10.527718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:10.527719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:10.527721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.527722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:10.527723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:10.527724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:10.527725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:10.527732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:10.527743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:10.527748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:10.527752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:10.527756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:10.527761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:10.527766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:10.527769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:10.527774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:10.527778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:10.527783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.527787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:10.527791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:10.527795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:10.527799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:10.527808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:10.527817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:10.527824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:10.527830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:10.527835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:10.527844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:10.527849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:10.527855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:10.527864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:10.527870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:10.527875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:10.527884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:10.527890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:10.527899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:10.527904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:10.527908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:10.527914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:10.527918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:10.527923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:10.527929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:10.527936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.527942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.527951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:10.527956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:10.527961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:10.527967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:10.527971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:10.527981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:10.527985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:10.527991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:10.528036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:10.534095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:10.535326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:10.535346Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:10.535350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:10.535354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:10.535361Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1436 [2:7555895662359890475:8669]
2025-09-30T14:54:10.535379Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:10.535397Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:10.535405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:10.535410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:10.535413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:10.535430Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:10.535442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:10.535449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:10.535519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.535534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:10.535536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:10.535540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:10.535543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:10.535613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:10.535622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.535637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:10.535654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:10.535677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:10.535699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895662359890470:8669]
2025-09-30T14:54:10.535706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895662359890470:8669]
2025-09-30T14:54:10.535709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895662359890470:8669]
2025-09-30T14:54:10.535718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:10.535733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:10.535755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:10.535763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:10.535799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895662359890470:8669]
2025-09-30T14:54:10.535806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:10.535888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:10.535899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:10.535901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:10.535907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:10.535954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895662449641650:2454], now have 1 active actors on pipe
2025-09-30T14:54:10.535970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895662449641859:8777], now have 1 active actors on pipe
2025-09-30T14:54:10.536380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1436
2025-09-30T14:54:10.536389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1436
2025-09-30T14:54:10.536595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:10.536612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:10.536645Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eea5d5a9-dda531df-22a9cb50-18684152_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:10.536659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:10.536664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:10.536666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:10.536679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:10.536696Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:10.536726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:10.536992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:10.537006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:10.537029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:10.537109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1437 partition: 0 MaxSeqNo: 42 sessionId: src_id|eea5d5a9-dda531df-22a9cb50-18684152_0
2025-09-30T14:54:10.537545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27e3ff7c-1b62f2e7-15b5fed1-3dd7c58d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|eea5d5a9-dda531df-22a9cb50-18684152_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:10.540467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eea5d5a9-dda531df-22a9cb50-18684152_0] Write session: try to update token
2025-09-30T14:54:10.540485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eea5d5a9-dda531df-22a9cb50-18684152_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:10.550224Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:10.550249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:10.550259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895662359890470:8669]
2025-09-30T14:54:10.550307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:10.550497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:10.550661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:10.550817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:10.550982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:10.551327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:10.551371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:10.552230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:10.566553Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:10.566574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:10.566576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:10.566579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:10.566590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895662359890470:8669]
2025-09-30T14:54:10.566596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895662359890470:8669]
2025-09-30T14:54:10.566601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895662359890470:8669]
2025-09-30T14:54:10.566651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:10.566663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.566667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:10.566675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:10.566684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:10.566689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:10.566815Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:10.568537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1437 sessionId: src_id|eea5d5a9-dda531df-22a9cb50-18684152_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:10.571908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:10.593494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895662449641931:8563]
2025-09-30T14:54:10.593859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1436, pipe: [1:7555895662449641931:8563]
2025-09-30T14:54:10.697530Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:10.698353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:10.698364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:10.698387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895662449641931:8563], now have 1 active actors on pipe
2025-09-30T14:54:10.698623Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:10.699275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:10.699361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1437 reason: status is not ok: tablet will be restarted right now sessionId: src_id|eea5d5a9-dda531df-22a9cb50-18684152_0
2025-09-30T14:54:10.699423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895662449641931:8563]
2025-09-30T14:54:10.699439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:10.699589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1437 sessionId: src_id|eea5d5a9-dda531df-22a9cb50-18684152_0 is DEAD
2025-09-30T14:54:10.707190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eea5d5a9-dda531df-22a9cb50-18684152_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:10.707212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eea5d5a9-dda531df-22a9cb50-18684152_0] Write session will restart in 0.006045s
2025-09-30T14:54:10.707261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eea5d5a9-dda531df-22a9cb50-18684152_0] Write session: Do CDS request
2025-09-30T14:54:10.707269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eea5d5a9-dda531df-22a9cb50-18684152_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:10.715792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eea5d5a9-dda531df-22a9cb50-18684152_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:10.719413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:10.719433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1438
2025-09-30T14:54:10.719656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1438 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:10.719687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1438 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:10.719693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1438 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:10.719697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:10.720134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1438 sessionId:  describe result for acl check
2025-09-30T14:54:10.720160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:10.720163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:10.720165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:10.720172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895662449641950:8782] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:10.720741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895662449641950:8782] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:10.724251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895662449641950:8782] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:10.730677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895662449641950:8782] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:10.730698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895662449641950:8782] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:10.730701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895662449641950:8782] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:10.730711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1438 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:10.765887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:10.770407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:10.770642Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:10.770647Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:10.770659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:10.770722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:10.770761Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895662359890749:8672]
2025-09-30T14:54:10.771495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:10.774797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:10.774888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:10.775418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:10.775514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:10.775515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:10.775517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:10.775518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:10.775519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:10.775520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:10.775522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:10.775523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:10.775528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:10.775529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:10.775531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.775532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:10.775533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:10.775535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:10.775536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:10.775543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:10.775554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:10.775558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:10.775562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:10.775565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:10.775569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:10.775573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:10.775577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:10.775581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:10.775585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:10.775589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.775593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:10.775597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:10.775601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:10.775606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:10.775615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:10.775624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:10.775631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:10.775637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:10.775641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:10.775647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:10.775652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:10.775657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:10.775670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:10.775676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:10.775682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:10.775688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:10.775693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:10.775698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:10.775703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:10.775708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:10.775713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:10.775719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:10.775723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:10.775729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:10.775733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.775742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.775746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:10.775752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:10.775758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:10.775763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:10.775767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:10.775773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:10.775778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:10.775783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:10.775833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:10.782804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:10.784893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1437
2025-09-30T14:54:10.784938Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1437
2025-09-30T14:54:10.783800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:10.783820Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:10.783824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:10.783828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:10.783836Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1437 [2:7555895662359890749:8672]
2025-09-30T14:54:10.783855Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:10.783875Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:10.783879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:10.783883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:10.783886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:10.783903Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:10.783910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:10.783919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:10.783989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.783992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:10.783994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:10.783999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:10.784001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:10.784083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:10.784086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.784100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:10.784111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:10.784125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:10.784143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895662359890744:8672]
2025-09-30T14:54:10.784145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895662359890744:8672]
2025-09-30T14:54:10.784148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895662359890744:8672]
2025-09-30T14:54:10.784157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:10.784174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:10.784189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:10.784192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:10.784233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895662359890744:8672]
2025-09-30T14:54:10.784236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:10.784472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:10.784475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:10.784477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:10.784483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:10.787330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895662449642052:8782], now have 1 active actors on pipe
2025-09-30T14:54:10.787340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895662449641934:2454], now have 1 active actors on pipe
2025-09-30T14:54:10.787361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:10.787368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:10.787402Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c04695d7-36a38162-191c1395-4944aa3d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:10.787413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:10.787418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:10.787430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:10.787445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:10.787460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:10.787480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:10.796494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1438 partition: 0 MaxSeqNo: 42 sessionId: src_id|c04695d7-36a38162-191c1395-4944aa3d_0
2025-09-30T14:54:10.796288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:10.796312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:10.796350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:10.798547Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:10.798552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:10.798554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:10.798556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:10.798565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895662359890744:8672]
2025-09-30T14:54:10.798570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895662359890744:8672]
2025-09-30T14:54:10.798574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895662359890744:8672]
2025-09-30T14:54:10.798618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:10.798626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.798628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:10.798781Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:10.799501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eea5d5a9-dda531df-22a9cb50-18684152_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c04695d7-36a38162-191c1395-4944aa3d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:10.800019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:10.800032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:10.800037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:10.802541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c04695d7-36a38162-191c1395-4944aa3d_0] Write session: try to update token
2025-09-30T14:54:10.802563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c04695d7-36a38162-191c1395-4944aa3d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:10.803480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895662449642213:8563]
2025-09-30T14:54:10.809827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1437, pipe: [1:7555895662449642213:8563]
2025-09-30T14:54:10.837784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1438 sessionId: src_id|c04695d7-36a38162-191c1395-4944aa3d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:10.840701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:10.930730Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:10.931713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895662449642213:8563], now have 1 active actors on pipe
2025-09-30T14:54:10.931777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:10.931784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:10.932662Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:10.933624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895662449642213:8563]
2025-09-30T14:54:10.933669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:10.933739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1438 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c04695d7-36a38162-191c1395-4944aa3d_0
2025-09-30T14:54:10.933953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1438 sessionId: src_id|c04695d7-36a38162-191c1395-4944aa3d_0 is DEAD
2025-09-30T14:54:10.934161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:10.935472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c04695d7-36a38162-191c1395-4944aa3d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:10.935485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c04695d7-36a38162-191c1395-4944aa3d_0] Write session will restart in 0.007883s
2025-09-30T14:54:10.935510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c04695d7-36a38162-191c1395-4944aa3d_0] Write session: Do CDS request
2025-09-30T14:54:10.935516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c04695d7-36a38162-191c1395-4944aa3d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:10.944837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c04695d7-36a38162-191c1395-4944aa3d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:10.947388Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:10.947419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1439
2025-09-30T14:54:10.951565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1439 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:10.951622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1439 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:10.951628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1439 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:10.951633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:10.953037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1439 sessionId:  describe result for acl check
2025-09-30T14:54:10.953070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:10.953075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:10.953076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:10.953083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895662449642344:8793] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:10.953642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895662449642344:8793] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:10.958960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895662449642344:8793] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:10.964015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895662449642344:8793] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:10.964022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895662449642344:8793] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:10.964025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895662449642344:8793] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:10.964034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1439 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:10.975978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:10.980190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:10.980437Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:10.980447Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:10.980457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:10.980513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:10.980551Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895662359891058:8680]
2025-09-30T14:54:10.981273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:10.982058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:10.982116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:10.982525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:10.982593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:10.982594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:10.982596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:10.982598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:10.982599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:10.982601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:10.982602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:10.982604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:10.982606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:10.982607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:10.982608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.982610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:10.982611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:10.982613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:10.982614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:10.982621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:10.982633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:10.982638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:10.982643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:10.982648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:10.982653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:10.982658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:10.982663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:10.982667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:10.982672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:10.982677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.982682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:10.982686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:10.982691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:10.982695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:10.982704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:10.982713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:10.982720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:10.982726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:10.982732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:10.982738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:10.982743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:10.982750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:10.982755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:10.982761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:10.982766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:10.982771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:10.982776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:10.982782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:10.982787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:10.982793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:10.982798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:10.982804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:10.982811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:10.982817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:10.982822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.982828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.982833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:10.982838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:10.982843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:10.982847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:10.982852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:10.982857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:10.982861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:10.982866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:10.982914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:10.992190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:10.993394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:10.993404Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:10.993406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:10.993411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:10.993418Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1438 [2:7555895662359891058:8680]
2025-09-30T14:54:10.993435Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:10.993453Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:10.993456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:10.993460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:10.993462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:10.993479Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:10.993486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:10.993493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:10.993561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.993563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:10.993565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:10.993569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:10.993572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:10.993651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:10.993653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:10.993670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:10.993684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:10.993702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:10.993723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895662449642467:8793], now have 1 active actors on pipe
2025-09-30T14:54:10.993726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895662449642232:2454], now have 1 active actors on pipe
2025-09-30T14:54:10.993733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895662359891053:8680]
2025-09-30T14:54:10.993736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895662359891053:8680]
2025-09-30T14:54:10.993738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895662359891053:8680]
2025-09-30T14:54:10.993755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:10.993770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:10.993769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:10.993775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:10.993784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:10.993785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:10.993787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:10.993831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895662359891053:8680]
2025-09-30T14:54:10.993841Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:10.993875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:10.993982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1438
2025-09-30T14:54:10.994020Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1438
2025-09-30T14:54:10.994229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:10.994240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:10.994271Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66629d2a-62f54f01-9ec258d9-162fec64_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:10.994280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:10.994285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:10.994287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:10.994298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:10.994309Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:10.994326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:10.994958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1439 partition: 0 MaxSeqNo: 42 sessionId: src_id|66629d2a-62f54f01-9ec258d9-162fec64_0
2025-09-30T14:54:10.995507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c04695d7-36a38162-191c1395-4944aa3d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|66629d2a-62f54f01-9ec258d9-162fec64_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:10.998407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66629d2a-62f54f01-9ec258d9-162fec64_0] Write session: try to update token
2025-09-30T14:54:10.998427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66629d2a-62f54f01-9ec258d9-162fec64_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:10.994723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:10.994736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:10.994771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:11.008650Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:11.008670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:11.008673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:11.008675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:11.008684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895662359891053:8680]
2025-09-30T14:54:11.008689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895662359891053:8680]
2025-09-30T14:54:11.008693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895662359891053:8680]
2025-09-30T14:54:11.008736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:11.008742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.008745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:11.008962Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:11.009716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:11.009729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:11.009733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:11.024453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1439 sessionId: src_id|66629d2a-62f54f01-9ec258d9-162fec64_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:11.027148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:11.033782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895666744609819:8563]
2025-09-30T14:54:11.034336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1438, pipe: [1:7555895666744609819:8563]
2025-09-30T14:54:11.124668Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:11.125443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:11.125462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:11.125482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895666744609819:8563], now have 1 active actors on pipe
2025-09-30T14:54:11.125737Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:11.126265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:11.126287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:11.126349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1439 reason: error at write: Disconnected sessionId: src_id|66629d2a-62f54f01-9ec258d9-162fec64_0
2025-09-30T14:54:11.126562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1439 sessionId: src_id|66629d2a-62f54f01-9ec258d9-162fec64_0 is DEAD
2025-09-30T14:54:11.126714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:11.126750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895666744609819:8563]
2025-09-30T14:54:11.128622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66629d2a-62f54f01-9ec258d9-162fec64_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:11.128634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66629d2a-62f54f01-9ec258d9-162fec64_0] Write session will restart in 0.005768s
2025-09-30T14:54:11.128664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66629d2a-62f54f01-9ec258d9-162fec64_0] Write session: Do CDS request
2025-09-30T14:54:11.128673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66629d2a-62f54f01-9ec258d9-162fec64_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:11.135917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66629d2a-62f54f01-9ec258d9-162fec64_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:11.139419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:11.139443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1440
2025-09-30T14:54:11.143397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1440 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:11.143464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1440 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:11.143470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1440 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:11.143476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:11.143924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1440 sessionId:  describe result for acl check
2025-09-30T14:54:11.143964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:11.143966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:11.143970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:11.143977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895666744609837:8798] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:11.144515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895666744609837:8798] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:11.147529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895666744609837:8798] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:11.151946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895666744609837:8798] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:11.151968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895666744609837:8798] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:11.151972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895666744609837:8798] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:11.151982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1440 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:11.170405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:11.173749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:11.174014Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:11.174024Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:11.174036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:11.174095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:11.174140Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895666654858628:8688]
2025-09-30T14:54:11.174811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:11.175194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:11.175276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:11.175661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:11.175743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:11.175750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:11.175751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:11.175752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:11.175753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:11.175755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:11.175756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:11.175758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:11.175760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:11.175761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:11.175762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.175764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:11.175765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:11.175766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:11.175767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:11.175774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:11.175785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:11.175789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:11.175793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:11.175797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:11.175801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:11.175805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:11.175809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:11.175812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:11.175817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:11.175820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.175824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:11.175828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:11.175832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:11.175836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:11.175846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:11.175855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:11.175862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:11.175868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:11.175873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:11.175878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:11.175883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:11.175889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:11.175894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:11.175900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:11.175904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:11.175910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:11.175915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:11.175921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:11.175926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:11.175931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:11.175938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:11.175943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:11.175950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:11.175955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:11.175963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.175968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.175973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:11.175978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:11.175983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:11.175988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:11.175999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:11.176004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:11.176009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:11.176017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:11.176065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:11.183336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:11.184784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:11.184802Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:11.184805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:11.184810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:11.184817Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1439 [2:7555895666654858628:8688]
2025-09-30T14:54:11.184835Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:11.184854Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:11.184857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:11.184861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:11.184863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:11.184882Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:11.184889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:11.184896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:11.184967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.184970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:11.184972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:11.184976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:11.184979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:11.185055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:11.185058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.185074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:11.185088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:11.185107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:11.185126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895666744609828:2454], now have 1 active actors on pipe
2025-09-30T14:54:11.185131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895666744609881:8798], now have 1 active actors on pipe
2025-09-30T14:54:11.185138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895666654858622:8688]
2025-09-30T14:54:11.185141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895666654858622:8688]
2025-09-30T14:54:11.185143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895666654858622:8688]
2025-09-30T14:54:11.185157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:11.185172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:11.185185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:11.185189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:11.185190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:11.185192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:11.185194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:11.185233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895666654858622:8688]
2025-09-30T14:54:11.185241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:11.185258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:11.185793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1439
2025-09-30T14:54:11.185851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1439
2025-09-30T14:54:11.187446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:11.187468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:11.187503Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6cea5ca-ac380c4b-944fa566-fa7cec57_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:11.187521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:11.187531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:11.187534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:11.187546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:11.187563Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:11.187586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:11.187866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:11.187878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:11.187897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:11.188147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1440 partition: 0 MaxSeqNo: 42 sessionId: src_id|6cea5ca-ac380c4b-944fa566-fa7cec57_0
2025-09-30T14:54:11.188598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66629d2a-62f54f01-9ec258d9-162fec64_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6cea5ca-ac380c4b-944fa566-fa7cec57_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:11.192013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cea5ca-ac380c4b-944fa566-fa7cec57_0] Write session: try to update token
2025-09-30T14:54:11.192039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cea5ca-ac380c4b-944fa566-fa7cec57_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:11.198718Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:11.198743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:11.198745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:11.198747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:11.198758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895666654858622:8688]
2025-09-30T14:54:11.198762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895666654858622:8688]
2025-09-30T14:54:11.198767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895666654858622:8688]
2025-09-30T14:54:11.198814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:11.198821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.198824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:11.198839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:11.198847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:11.198854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:11.198980Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:11.216200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1440 sessionId: src_id|6cea5ca-ac380c4b-944fa566-fa7cec57_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:11.219006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:11.226787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895666744610113:8563]
2025-09-30T14:54:11.227133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1439, pipe: [1:7555895666744610113:8563]
2025-09-30T14:54:11.315832Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:11.316452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:11.316463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:11.316483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895666744610113:8563], now have 1 active actors on pipe
2025-09-30T14:54:11.322826Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:11.322895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:11.322897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:11.322964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1440 reason: error at write: Disconnected sessionId: src_id|6cea5ca-ac380c4b-944fa566-fa7cec57_0
2025-09-30T14:54:11.323087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895666744610113:8563]
2025-09-30T14:54:11.323166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1440 sessionId: src_id|6cea5ca-ac380c4b-944fa566-fa7cec57_0 is DEAD
2025-09-30T14:54:11.323569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cea5ca-ac380c4b-944fa566-fa7cec57_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:11.323576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cea5ca-ac380c4b-944fa566-fa7cec57_0] Write session will restart in 0.008422s
2025-09-30T14:54:11.323599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cea5ca-ac380c4b-944fa566-fa7cec57_0] Write session: Do CDS request
2025-09-30T14:54:11.323604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cea5ca-ac380c4b-944fa566-fa7cec57_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:11.322814Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:11.332749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cea5ca-ac380c4b-944fa566-fa7cec57_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:11.332908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:11.332927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1441
2025-09-30T14:54:11.333077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1441 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:11.333112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1441 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:11.333132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1441 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:11.333144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:11.333561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1441 sessionId:  describe result for acl check
2025-09-30T14:54:11.333595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:11.333597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:11.333599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:11.333607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895666744610128:8802] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:11.334143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895666744610128:8802] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:11.336832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895666744610128:8802] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:11.341998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895666744610128:8802] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:11.342022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895666744610128:8802] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:11.342026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895666744610128:8802] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:11.342033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1441 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:11.362767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:11.363668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:11.363876Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:11.363880Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:11.363890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:11.363942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:11.363982Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895666654858916:8691]
2025-09-30T14:54:11.364660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:11.365022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:11.365086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:11.365437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:11.365521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:11.365527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:11.365529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:11.365530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:11.365531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:11.365533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:11.365534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:11.365535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:11.365537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:11.365538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:11.365539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.365541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:11.365542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:11.365543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:11.365545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:11.365550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:11.365561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:11.365565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:11.365569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:11.365573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:11.365578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:11.365582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:11.365586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:11.365590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:11.365594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:11.365598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.365602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:11.365607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:11.365611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:11.365615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:11.365623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:11.365631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:11.365639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:11.365645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:11.365651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:11.365656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:11.365661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:11.365667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:11.365671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:11.365677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:11.365682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:11.365687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:11.365692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:11.365698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:11.365703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:11.365708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:11.365713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:11.365720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:11.365727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:11.365733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:11.365744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.365750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.365755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:11.365765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:11.365770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:11.365776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:11.365780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:11.365785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:11.365791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:11.365801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:11.365847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:11.371969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:11.372950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:11.372967Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:11.372971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:11.372975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:11.372983Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1440 [2:7555895666654858916:8691]
2025-09-30T14:54:11.373001Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:11.373017Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:11.373029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:11.373032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:11.373035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:11.373054Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:11.373066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:11.373074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:11.373141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.373149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:11.373151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:11.373155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:11.373158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:11.373246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:11.373259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.373275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:11.373296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:11.373320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:11.373417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1440
2025-09-30T14:54:11.373431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1440
2025-09-30T14:54:11.373346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895666744610246:8802], now have 1 active actors on pipe
2025-09-30T14:54:11.373357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895666744610115:2454], now have 1 active actors on pipe
2025-09-30T14:54:11.373364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895666654858911:8691]
2025-09-30T14:54:11.373366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895666654858911:8691]
2025-09-30T14:54:11.373369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895666654858911:8691]
2025-09-30T14:54:11.373385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:11.373401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:11.373416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:11.373408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:11.373420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:11.373422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:11.373425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:11.373456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895666654858911:8691]
2025-09-30T14:54:11.373459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:11.373470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:11.373488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:11.373492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:11.373528Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3f8a475-19213fcf-ac7296c4-7927fcd9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:11.373535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:11.373540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:11.373542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:11.373555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:11.373565Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:11.373584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:11.373807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:11.373816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:11.373833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:11.373943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1441 partition: 0 MaxSeqNo: 42 sessionId: src_id|b3f8a475-19213fcf-ac7296c4-7927fcd9_0
2025-09-30T14:54:11.378008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cea5ca-ac380c4b-944fa566-fa7cec57_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b3f8a475-19213fcf-ac7296c4-7927fcd9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:11.380865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3f8a475-19213fcf-ac7296c4-7927fcd9_0] Write session: try to update token
2025-09-30T14:54:11.380888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3f8a475-19213fcf-ac7296c4-7927fcd9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:11.386214Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:11.386232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:11.386234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:11.386237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:11.386246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895666654858911:8691]
2025-09-30T14:54:11.386251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895666654858911:8691]
2025-09-30T14:54:11.386255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895666654858911:8691]
2025-09-30T14:54:11.386298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:11.386301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:11.386306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:11.386309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.386310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:11.386311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:11.386459Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:11.400588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1441 sessionId: src_id|b3f8a475-19213fcf-ac7296c4-7927fcd9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:11.403378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:11.423444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895666744610413:8563]
2025-09-30T14:54:11.427519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1440, pipe: [1:7555895666744610413:8563]
2025-09-30T14:54:11.502945Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:11.503683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:11.503699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:11.503738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895666744610413:8563], now have 1 active actors on pipe
2025-09-30T14:54:11.504000Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:11.504378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895666744610413:8563]
2025-09-30T14:54:11.504416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:11.504499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1441 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b3f8a475-19213fcf-ac7296c4-7927fcd9_0
2025-09-30T14:54:11.504726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1441 sessionId: src_id|b3f8a475-19213fcf-ac7296c4-7927fcd9_0 is DEAD
2025-09-30T14:54:11.504900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:11.505649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3f8a475-19213fcf-ac7296c4-7927fcd9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:11.505659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3f8a475-19213fcf-ac7296c4-7927fcd9_0] Write session will restart in 0.005405s
2025-09-30T14:54:11.505685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3f8a475-19213fcf-ac7296c4-7927fcd9_0] Write session: Do CDS request
2025-09-30T14:54:11.505691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3f8a475-19213fcf-ac7296c4-7927fcd9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:11.512811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3f8a475-19213fcf-ac7296c4-7927fcd9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:11.512989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:11.513008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1442
2025-09-30T14:54:11.515367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1442 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:11.515420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1442 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:11.515431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1442 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:11.515437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:11.516102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1442 sessionId:  describe result for acl check
2025-09-30T14:54:11.516155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:11.516163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:11.516166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:11.516172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895666744610451:8809] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:11.516721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895666744610451:8809] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:11.519828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895666744610451:8809] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:11.526034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895666744610451:8809] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:11.526057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895666744610451:8809] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:11.526061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895666744610451:8809] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:11.526070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1442 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:11.532550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:11.536082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:11.536320Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:11.536330Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:11.536340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:11.536393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:11.536438Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895666654859198:8698]
2025-09-30T14:54:11.537164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:11.537498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:11.537549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:11.537804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:11.537849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:11.537855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:11.537856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:11.537856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:11.537857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:11.537858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:11.537859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:11.537860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:11.537861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:11.537861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:11.537862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.537863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:11.537864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:11.537864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:11.537866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:11.537870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:11.537877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:11.537880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:11.537883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:11.537885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:11.537901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:11.537906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:11.537910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:11.537912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:11.537915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:11.537917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.537920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:11.537922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:11.537925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:11.537927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:11.537933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:11.537939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:11.537943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:11.537946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:11.537950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:11.537953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:11.537956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:11.537959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:11.537962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:11.537965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:11.537967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:11.537980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:11.537983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:11.537986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:11.537989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:11.537993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:11.537995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:11.537999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:11.538001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:11.538005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:11.538008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.538011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.538013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:11.538017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:11.538021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:11.538024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:11.538030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:11.538033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:11.538036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:11.538039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:11.538080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:11.544764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:11.545834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:11.545851Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:11.545853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:11.545857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:11.545864Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1441 [2:7555895666654859198:8698]
2025-09-30T14:54:11.545881Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:11.545913Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:11.545916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:11.545919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:11.545921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:11.545939Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:11.545945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:11.545952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:11.546010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.546020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:11.546021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:11.546024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:11.546027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:11.546097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:11.546105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.546117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:11.546132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:11.546151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:11.546175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895666744610612:8809], now have 1 active actors on pipe
2025-09-30T14:54:11.546183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895666744610418:2454], now have 1 active actors on pipe
2025-09-30T14:54:11.546189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895666654859193:8698]
2025-09-30T14:54:11.546191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895666654859193:8698]
2025-09-30T14:54:11.546193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895666654859193:8698]
2025-09-30T14:54:11.546206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:11.546220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:11.546224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:11.546225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:11.546226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:11.546239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:11.546242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:11.546278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895666654859193:8698]
2025-09-30T14:54:11.546293Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:11.546307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:11.546285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1441
2025-09-30T14:54:11.546290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1441
2025-09-30T14:54:11.546709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:11.546722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:11.546762Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a8b8b5-ca659798-fd478858-cb6da66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:11.546774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:11.546778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:11.546780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:11.546789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:11.546799Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:11.546819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:11.546981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:11.546988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:11.546999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:11.547118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1442 partition: 0 MaxSeqNo: 42 sessionId: src_id|5a8b8b5-ca659798-fd478858-cb6da66_0
2025-09-30T14:54:11.547527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3f8a475-19213fcf-ac7296c4-7927fcd9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5a8b8b5-ca659798-fd478858-cb6da66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:11.550378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a8b8b5-ca659798-fd478858-cb6da66_0] Write session: try to update token
2025-09-30T14:54:11.550399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a8b8b5-ca659798-fd478858-cb6da66_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:11.560574Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:11.560595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:11.560598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:11.560600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:11.560609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895666654859193:8698]
2025-09-30T14:54:11.560617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895666654859193:8698]
2025-09-30T14:54:11.560621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895666654859193:8698]
2025-09-30T14:54:11.560662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:11.560669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.560668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:11.560671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:11.560673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:11.560678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:11.560821Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:11.565668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1442 sessionId: src_id|5a8b8b5-ca659798-fd478858-cb6da66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:11.568543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:11.604201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895666744610705:8563]
2025-09-30T14:54:11.604545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1441, pipe: [1:7555895666744610705:8563]
2025-09-30T14:54:11.676374Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:11.676685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:11.676697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:11.676734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895666744610705:8563], now have 1 active actors on pipe
2025-09-30T14:54:11.676945Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:11.677515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a8b8b5-ca659798-fd478858-cb6da66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:11.677523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a8b8b5-ca659798-fd478858-cb6da66_0] Write session will restart in 0.009663s
2025-09-30T14:54:11.677547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a8b8b5-ca659798-fd478858-cb6da66_0] Write session: Do CDS request
2025-09-30T14:54:11.677552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a8b8b5-ca659798-fd478858-cb6da66_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:11.677004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895666744610705:8563]
2025-09-30T14:54:11.677059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:11.677146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1442 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5a8b8b5-ca659798-fd478858-cb6da66_0
2025-09-30T14:54:11.677361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1442 sessionId: src_id|5a8b8b5-ca659798-fd478858-cb6da66_0 is DEAD
2025-09-30T14:54:11.677514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:11.688794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a8b8b5-ca659798-fd478858-cb6da66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:11.688910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:11.688933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1443
2025-09-30T14:54:11.689076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1443 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:11.689124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1443 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:11.689136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1443 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:11.689141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:11.689744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1443 sessionId:  describe result for acl check
2025-09-30T14:54:11.689786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:11.689794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:11.689797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:11.689803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895666744610746:8814] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:11.690442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895666744610746:8814] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:11.694093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895666744610746:8814] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:11.698930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895666744610746:8814] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:11.698953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895666744610746:8814] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:11.698957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895666744610746:8814] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:11.698966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1443 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:11.703958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:11.706643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:11.706886Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:11.706897Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:11.706910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:11.706984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:11.707027Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895666654859479:8700]
2025-09-30T14:54:11.707738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:11.708255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:11.708320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:11.708702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:11.708792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:11.708793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:11.708795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:11.708796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:11.708797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:11.708798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:11.708800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:11.708801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:11.708802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:11.708803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:11.708805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.708806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:11.708807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:11.708808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:11.708809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:11.708816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:11.708828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:11.708833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:11.708838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:11.708842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:11.708846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:11.708851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:11.708855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:11.708860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:11.708865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:11.708869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.708874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:11.708887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:11.708892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:11.708897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:11.708905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:11.708914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:11.708921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:11.708927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:11.708932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:11.708939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:11.708944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:11.708951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:11.708956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:11.708962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:11.708967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:11.708972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:11.708978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:11.708984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:11.708989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:11.708993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:11.709000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:11.709006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:11.709011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:11.709017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:11.709022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.709028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.709033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:11.709038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:11.709043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:11.709050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:11.709054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:11.709073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:11.709078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:11.709083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:11.709131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:11.714999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:11.715932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:11.715948Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:11.715951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:11.715956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:11.715962Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1442 [2:7555895666654859479:8700]
2025-09-30T14:54:11.715981Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:11.716002Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:11.716010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:11.716014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:11.716016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:11.716033Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:11.716044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:11.716052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:11.716120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.716129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:11.716132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:11.716135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:11.716138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:11.716205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:11.716214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.716227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:11.716244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:11.716263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:11.716282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895666744610706:2454], now have 1 active actors on pipe
2025-09-30T14:54:11.716293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895666744610917:8814], now have 1 active actors on pipe
2025-09-30T14:54:11.716300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895666654859474:8700]
2025-09-30T14:54:11.716302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895666654859474:8700]
2025-09-30T14:54:11.716305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895666654859474:8700]
2025-09-30T14:54:11.716320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:11.716334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:11.716348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:11.716352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:11.716387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895666654859474:8700]
2025-09-30T14:54:11.716396Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:11.716378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1442
2025-09-30T14:54:11.716425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1442
2025-09-30T14:54:11.716486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:11.716498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:11.716500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:11.716508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:11.716597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:11.716608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:11.716635Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5fd9e691-bef9480d-7ea1f91a-25f9532c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:11.716642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:11.716646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:11.716649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:11.716659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:11.716673Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:11.716688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:11.716900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:11.716912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:11.716926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:11.717024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1443 partition: 0 MaxSeqNo: 42 sessionId: src_id|5fd9e691-bef9480d-7ea1f91a-25f9532c_0
2025-09-30T14:54:11.717460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a8b8b5-ca659798-fd478858-cb6da66_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5fd9e691-bef9480d-7ea1f91a-25f9532c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:11.720398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fd9e691-bef9480d-7ea1f91a-25f9532c_0] Write session: try to update token
2025-09-30T14:54:11.720422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fd9e691-bef9480d-7ea1f91a-25f9532c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:11.728995Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:11.729016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:11.729019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:11.729021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:11.729031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895666654859474:8700]
2025-09-30T14:54:11.729035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895666654859474:8700]
2025-09-30T14:54:11.729040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895666654859474:8700]
2025-09-30T14:54:11.729085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:11.729092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.729095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:11.729094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:11.729101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:11.729104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:11.729245Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:11.740289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1443 sessionId: src_id|5fd9e691-bef9480d-7ea1f91a-25f9532c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:11.743139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:11.777228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895666744610992:8563]
2025-09-30T14:54:11.777549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1442, pipe: [1:7555895666744610992:8563]
2025-09-30T14:54:11.851134Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:11.852077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:11.852095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:11.852115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895666744610992:8563], now have 1 active actors on pipe
2025-09-30T14:54:11.852839Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:11.853794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fd9e691-bef9480d-7ea1f91a-25f9532c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:11.853805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fd9e691-bef9480d-7ea1f91a-25f9532c_0] Write session will restart in 0.008074s
2025-09-30T14:54:11.853829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fd9e691-bef9480d-7ea1f91a-25f9532c_0] Write session: Do CDS request
2025-09-30T14:54:11.853835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fd9e691-bef9480d-7ea1f91a-25f9532c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:11.852787Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:11.852841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895666744610992:8563]
2025-09-30T14:54:11.852861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:11.852864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:11.852924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1443 reason: error at write: Disconnected sessionId: src_id|5fd9e691-bef9480d-7ea1f91a-25f9532c_0
2025-09-30T14:54:11.853147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1443 sessionId: src_id|5fd9e691-bef9480d-7ea1f91a-25f9532c_0 is DEAD
2025-09-30T14:54:11.862708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fd9e691-bef9480d-7ea1f91a-25f9532c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:11.863011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:11.863031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1444
2025-09-30T14:54:11.863192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1444 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:11.863221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1444 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:11.863227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1444 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:11.863235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:11.863835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1444 sessionId:  describe result for acl check
2025-09-30T14:54:11.863880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:11.863883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:11.863885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:11.863891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895666744611010:8818] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:11.864442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895666744611010:8818] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:11.876501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895666744611010:8818] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:11.886380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895666744611010:8818] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:11.886406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895666744611010:8818] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:11.886410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895666744611010:8818] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:11.886419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1444 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:11.900448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:11.904919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:11.905172Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:11.905177Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:11.905188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:11.905243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:11.905281Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895666654859756:8703]
2025-09-30T14:54:11.905903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:11.907329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:11.907400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:11.907805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:11.907900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:11.907926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:11.907932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:11.907934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:11.907936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:11.907938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:11.907939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:11.907941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:11.907942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:11.907943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:11.907945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.907946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:11.907947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:11.907948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:11.907950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:11.907957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:11.907968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:11.907973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:11.907977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:11.907981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:11.907995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:11.908000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:11.908003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:11.908007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:11.908014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:11.908019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.908023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:11.908027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:11.908032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:11.908035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:11.908047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:11.908056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:11.908062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:11.908077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:11.908087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:11.908092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:11.908102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:11.908108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:11.908119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:11.908125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:11.908130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:11.908140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:11.908145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:11.908152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:11.908156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:11.908162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:11.908167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:11.908173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:11.908184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:11.908191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:11.908197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.908203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.908208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:11.908219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:11.908224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:11.908229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:11.908238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:11.908243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:11.908247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:11.908253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:11.908296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:11.924172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:11.925419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:11.925427Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:11.925430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:11.925434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:11.925441Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1443 [2:7555895666654859756:8703]
2025-09-30T14:54:11.925458Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:11.925478Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:11.925482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:11.925485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:11.925488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:11.925505Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:11.925512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:11.925520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:11.925597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.925599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:11.925601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:11.925605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:11.925607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:11.925688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:11.925691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.925706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:11.925719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:11.925737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:11.925757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895666744611216:8818], now have 1 active actors on pipe
2025-09-30T14:54:11.925764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895666654859750:8703]
2025-09-30T14:54:11.925766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895666654859750:8703]
2025-09-30T14:54:11.925769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895666654859750:8703]
2025-09-30T14:54:11.925779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:11.925795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:11.925795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:11.925798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:11.925801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:11.925809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:11.925813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:11.925852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895666744610994:2454], now have 1 active actors on pipe
2025-09-30T14:54:11.925855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895666654859750:8703]
2025-09-30T14:54:11.925865Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:11.926155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:11.927436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1443
2025-09-30T14:54:11.927859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:11.927488Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1443
2025-09-30T14:54:11.927878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:11.927920Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95b5d7-b9814ba4-796efd6-f702a864_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:11.927931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:11.927941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:11.927945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:11.927956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:11.927976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:11.928000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:11.930376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:11.930392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:11.930424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:11.930696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1444 partition: 0 MaxSeqNo: 42 sessionId: src_id|95b5d7-b9814ba4-796efd6-f702a864_0
2025-09-30T14:54:11.935716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fd9e691-bef9480d-7ea1f91a-25f9532c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|95b5d7-b9814ba4-796efd6-f702a864_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:11.938601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95b5d7-b9814ba4-796efd6-f702a864_0] Write session: try to update token
2025-09-30T14:54:11.938632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95b5d7-b9814ba4-796efd6-f702a864_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:11.943602Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:11.943620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:11.943622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:11.943625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:11.943638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895666654859750:8703]
2025-09-30T14:54:11.943643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895666654859750:8703]
2025-09-30T14:54:11.943647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895666654859750:8703]
2025-09-30T14:54:11.943687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:11.943693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:11.943696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:11.943838Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:11.951622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:11.951642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:11.951647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:11.957503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895666744611293:8563]
2025-09-30T14:54:11.957843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1443, pipe: [1:7555895666744611293:8563]
2025-09-30T14:54:11.976803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1444 sessionId: src_id|95b5d7-b9814ba4-796efd6-f702a864_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:11.979914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:12.071125Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:12.071855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895666744611293:8563], now have 1 active actors on pipe
2025-09-30T14:54:12.071891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:12.071899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:12.072181Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:12.072249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895666744611293:8563]
2025-09-30T14:54:12.072268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:12.072271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:12.072315Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:12.072791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95b5d7-b9814ba4-796efd6-f702a864_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:12.072801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95b5d7-b9814ba4-796efd6-f702a864_0] Write session will restart in 0.007944s
2025-09-30T14:54:12.072826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95b5d7-b9814ba4-796efd6-f702a864_0] Write session: Do CDS request
2025-09-30T14:54:12.072833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95b5d7-b9814ba4-796efd6-f702a864_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:12.072346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1444 reason: error at write: Disconnected sessionId: src_id|95b5d7-b9814ba4-796efd6-f702a864_0
2025-09-30T14:54:12.072567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1444 sessionId: src_id|95b5d7-b9814ba4-796efd6-f702a864_0 is DEAD
2025-09-30T14:54:12.081862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95b5d7-b9814ba4-796efd6-f702a864_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:12.083576Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:12.083599Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1445
2025-09-30T14:54:12.083777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1445 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:12.083815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1445 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:12.083821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1445 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:12.083824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:12.084245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1445 sessionId:  describe result for acl check
2025-09-30T14:54:12.084283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:12.084291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:12.084293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:12.084299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895671039578622:8830] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:12.084846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895671039578622:8830] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:12.086986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895671039578622:8830] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:12.093278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895671039578622:8830] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:12.093307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895671039578622:8830] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:12.093311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895671039578622:8830] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:12.093320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1445 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:12.099846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:12.106964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:12.107201Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:12.107211Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:12.107222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:12.107291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:12.107331Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895670949827367:8717]
2025-09-30T14:54:12.108061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:12.108624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:12.108673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:12.109037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:12.109105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:12.109112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:12.109114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:12.109115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:12.109117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:12.109118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:12.109120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:12.109122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:12.109123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:12.109124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:12.109125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.109127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:12.109128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:12.109129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:12.109130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:12.109137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:12.109148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:12.109153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:12.109157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:12.109161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:12.109165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:12.109169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:12.109174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:12.109193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:12.109198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:12.109202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.109207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:12.109211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:12.109216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:12.109220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:12.109229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:12.109238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:12.109246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:12.109252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:12.109258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:12.109270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:12.109275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:12.109281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:12.109287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:12.109301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:12.109307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:12.109313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:12.109319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:12.109325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:12.109330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:12.109336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:12.109341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:12.109348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:12.109354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:12.109359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:12.109365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.109371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.109376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:12.109382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:12.109388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:12.109394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:12.109398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:12.109404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:12.109410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:12.109417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:12.109465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:12.116700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:12.117795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:12.117810Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:12.117813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:12.117817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:12.117824Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1444 [2:7555895670949827367:8717]
2025-09-30T14:54:12.117842Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:12.117860Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:12.117863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:12.117866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:12.117869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:12.117901Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:12.117909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:12.117917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:12.117977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.117988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:12.117991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:12.117995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:12.117998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:12.118061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:12.118065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.118079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:12.118093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:12.118113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:12.118130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895670949827362:8717]
2025-09-30T14:54:12.118133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895670949827362:8717]
2025-09-30T14:54:12.118135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895670949827362:8717]
2025-09-30T14:54:12.118149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:12.118163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:12.118179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:12.118182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:12.118216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895670949827362:8717]
2025-09-30T14:54:12.118219Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:12.118231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:12.118235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:12.118238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:12.118238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895671039578750:8830], now have 1 active actors on pipe
2025-09-30T14:54:12.118244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:12.118502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895671039578608:2454], now have 1 active actors on pipe
2025-09-30T14:54:12.118941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1444
2025-09-30T14:54:12.118976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1444
2025-09-30T14:54:12.119181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:12.119191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:12.119221Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75c2ab24-ff673ab-b1fcb358-3a0643df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:12.119230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:12.119235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:12.119237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:12.119267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:12.119279Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:12.119298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:12.122132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:12.122147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:12.122176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:12.122343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1445 partition: 0 MaxSeqNo: 42 sessionId: src_id|75c2ab24-ff673ab-b1fcb358-3a0643df_0
2025-09-30T14:54:12.123370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95b5d7-b9814ba4-796efd6-f702a864_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|75c2ab24-ff673ab-b1fcb358-3a0643df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:12.126305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75c2ab24-ff673ab-b1fcb358-3a0643df_0] Write session: try to update token
2025-09-30T14:54:12.126329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75c2ab24-ff673ab-b1fcb358-3a0643df_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:12.132416Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:12.132435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:12.132438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:12.132440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:12.132449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895670949827362:8717]
2025-09-30T14:54:12.132454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895670949827362:8717]
2025-09-30T14:54:12.132459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895670949827362:8717]
2025-09-30T14:54:12.132506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:12.132513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.132516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:12.132671Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:12.134652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:12.134667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:12.134672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:12.155374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1445 sessionId: src_id|75c2ab24-ff673ab-b1fcb358-3a0643df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:12.158223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:12.172506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895671039578895:8563]
2025-09-30T14:54:12.172809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1444, pipe: [1:7555895671039578895:8563]
2025-09-30T14:54:12.256107Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:12.256902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:12.256913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:12.256936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895671039578895:8563], now have 1 active actors on pipe
2025-09-30T14:54:12.257311Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:12.258248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75c2ab24-ff673ab-b1fcb358-3a0643df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:12.258259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75c2ab24-ff673ab-b1fcb358-3a0643df_0] Write session will restart in 0.007324s
2025-09-30T14:54:12.258296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75c2ab24-ff673ab-b1fcb358-3a0643df_0] Write session: Do CDS request
2025-09-30T14:54:12.258302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75c2ab24-ff673ab-b1fcb358-3a0643df_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:12.257746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:12.257804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895671039578895:8563]
2025-09-30T14:54:12.257824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:12.257901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1445 reason: status is not ok: tablet will be restarted right now sessionId: src_id|75c2ab24-ff673ab-b1fcb358-3a0643df_0
2025-09-30T14:54:12.258094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1445 sessionId: src_id|75c2ab24-ff673ab-b1fcb358-3a0643df_0 is DEAD
2025-09-30T14:54:12.267901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75c2ab24-ff673ab-b1fcb358-3a0643df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:12.271747Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:12.271769Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1446
2025-09-30T14:54:12.272055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1446 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:12.272089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1446 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:12.272095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1446 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:12.272100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:12.272667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1446 sessionId:  describe result for acl check
2025-09-30T14:54:12.272701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:12.272703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:12.272706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:12.272712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895671039578905:8834] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:12.273303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895671039578905:8834] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:12.279463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895671039578905:8834] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:12.295760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895671039578905:8834] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:12.295785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895671039578905:8834] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:12.295789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895671039578905:8834] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:12.295808Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1446 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:12.303891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:12.307852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:12.308230Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:12.308243Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:12.308257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:12.308326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:12.308368Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895670949827648:8720]
2025-09-30T14:54:12.309041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:12.309458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:12.309521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:12.309850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:12.309940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:12.309947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:12.309948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:12.309949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:12.309950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:12.309951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:12.309952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:12.309954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:12.309955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:12.309956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:12.309958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.309959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:12.309961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:12.309962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:12.309963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:12.309970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:12.309981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:12.309985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:12.309990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:12.309995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:12.309999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:12.310004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:12.310007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:12.310012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:12.310017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:12.310021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.310026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:12.310031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:12.310035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:12.310040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:12.310048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:12.310057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:12.310062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:12.310068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:12.310072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:12.310078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:12.310082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:12.310087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:12.310091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:12.310096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:12.310099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:12.310104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:12.310109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:12.310114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:12.310118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:12.310124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:12.310129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:12.310135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:12.310140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:12.310145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:12.310149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.310154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.310160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:12.310166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:12.310171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:12.310177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:12.310181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:12.310186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:12.310192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:12.310197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:12.310247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:12.317692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:12.319193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:12.319209Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:12.319211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:12.319215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:12.319223Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1445 [2:7555895670949827648:8720]
2025-09-30T14:54:12.319240Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:12.319275Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:12.319282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:12.319286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:12.319288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:12.319305Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:12.319315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:12.319322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:12.319398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.319407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:12.319410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:12.319415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:12.319418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:12.319525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:12.319529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.319546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:12.319559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:12.319577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:12.319597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895670949827642:8720]
2025-09-30T14:54:12.319601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895670949827642:8720]
2025-09-30T14:54:12.319604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895670949827642:8720]
2025-09-30T14:54:12.319614Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:12.319626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:12.319629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:12.319631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:12.319636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:12.319655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:12.319660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:12.319673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895671039579067:8834], now have 1 active actors on pipe
2025-09-30T14:54:12.319679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895671039578897:2454], now have 1 active actors on pipe
2025-09-30T14:54:12.319727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895670949827642:8720]
2025-09-30T14:54:12.319746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:12.319950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:12.320119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:12.320126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:12.320155Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb2d13c0-4efb5241-81d2e84e-435b18c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:12.320164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:12.320167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:12.320170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:12.320181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:12.320193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:12.320220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:12.320390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:12.320398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:12.320412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:12.319776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1445
2025-09-30T14:54:12.319782Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1445
2025-09-30T14:54:12.320527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1446 partition: 0 MaxSeqNo: 42 sessionId: src_id|cb2d13c0-4efb5241-81d2e84e-435b18c5_0
2025-09-30T14:54:12.323361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75c2ab24-ff673ab-b1fcb358-3a0643df_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cb2d13c0-4efb5241-81d2e84e-435b18c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:12.326307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb2d13c0-4efb5241-81d2e84e-435b18c5_0] Write session: try to update token
2025-09-30T14:54:12.326330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb2d13c0-4efb5241-81d2e84e-435b18c5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:12.337069Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:12.337094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:12.337098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:12.337100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:12.337110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895670949827642:8720]
2025-09-30T14:54:12.337120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895670949827642:8720]
2025-09-30T14:54:12.337125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895670949827642:8720]
2025-09-30T14:54:12.337178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:12.337186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.337189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:12.337183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:12.337199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:12.337206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:12.337347Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:12.353731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1446 sessionId: src_id|cb2d13c0-4efb5241-81d2e84e-435b18c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:12.354455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895671039579185:8563]
2025-09-30T14:54:12.355770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1445, pipe: [1:7555895671039579185:8563]
2025-09-30T14:54:12.356776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:12.480655Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:12.481222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895671039579185:8563], now have 1 active actors on pipe
2025-09-30T14:54:12.481265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:12.481271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:12.481675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:12.481704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:12.481775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1446 reason: error at write: Disconnected sessionId: src_id|cb2d13c0-4efb5241-81d2e84e-435b18c5_0
2025-09-30T14:54:12.481979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1446 sessionId: src_id|cb2d13c0-4efb5241-81d2e84e-435b18c5_0 is DEAD
2025-09-30T14:54:12.482083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895671039579185:8563]
2025-09-30T14:54:12.482114Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:12.481607Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:12.482495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb2d13c0-4efb5241-81d2e84e-435b18c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:12.482506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb2d13c0-4efb5241-81d2e84e-435b18c5_0] Write session will restart in 0.005176s
2025-09-30T14:54:12.482535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb2d13c0-4efb5241-81d2e84e-435b18c5_0] Write session: Do CDS request
2025-09-30T14:54:12.482543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb2d13c0-4efb5241-81d2e84e-435b18c5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:12.491874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb2d13c0-4efb5241-81d2e84e-435b18c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:12.492162Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:12.492183Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1447
2025-09-30T14:54:12.492466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1447 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:12.492498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1447 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:12.492504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1447 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:12.492508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:12.493160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1447 sessionId:  describe result for acl check
2025-09-30T14:54:12.493195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:12.493198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:12.493199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:12.493205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895671039579207:8839] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:12.493761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895671039579207:8839] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:12.497565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895671039579207:8839] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:12.501028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895671039579207:8839] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:12.501048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895671039579207:8839] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:12.501052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895671039579207:8839] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:12.501061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1447 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:12.528393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:12.529530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:12.529737Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:12.529742Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:12.529753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:12.529828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:12.529870Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895670949827941:8723]
2025-09-30T14:54:12.530583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:12.532388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:12.532459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:12.532750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:12.532815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:12.532822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:12.532823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:12.532824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:12.532825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:12.532827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:12.532828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:12.532829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:12.532831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:12.532832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:12.532833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.532834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:12.532835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:12.532837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:12.532838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:12.532844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:12.532854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:12.532859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:12.532863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:12.532867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:12.532872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:12.532876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:12.532880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:12.532896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:12.532903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:12.532907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.532912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:12.532916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:12.532920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:12.532924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:12.532936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:12.532946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:12.532952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:12.532958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:12.532962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:12.532965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:12.532968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:12.532972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:12.532975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:12.532978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:12.532980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:12.532984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:12.532987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:12.532990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:12.532992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:12.532996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:12.532999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:12.533002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:12.533006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:12.533011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:12.533016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.533022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.533026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:12.533032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:12.533037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:12.533048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:12.533053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:12.533063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:12.533070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:12.533079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:12.533133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:12.539166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:12.540161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:12.540181Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:12.540185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:12.540190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:12.540199Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1446 [2:7555895670949827941:8723]
2025-09-30T14:54:12.540216Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:12.540233Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:12.540237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:12.540240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:12.540243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:12.540262Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:12.540276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:12.540283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:12.540352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.540360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:12.540362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:12.540366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:12.540369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:12.540437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:12.540447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.540460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:12.540472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:12.540489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:12.540597Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1446
2025-09-30T14:54:12.540685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1446
2025-09-30T14:54:12.540509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895671039579248:8839], now have 1 active actors on pipe
2025-09-30T14:54:12.540524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895671039579199:2454], now have 1 active actors on pipe
2025-09-30T14:54:12.540530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895670949827935:8723]
2025-09-30T14:54:12.540533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895670949827935:8723]
2025-09-30T14:54:12.540535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895670949827935:8723]
2025-09-30T14:54:12.540548Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:12.540563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:12.540572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:12.540576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:12.540577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:12.540578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:12.540581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:12.540624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895670949827935:8723]
2025-09-30T14:54:12.540628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:12.540631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:12.541126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:12.541138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:12.541163Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|643dc6d3-e3a84519-b7703dd7-e93153be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:12.541171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:12.541175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:12.541177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:12.541188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:12.541207Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:12.541223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:12.541420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:12.541428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:12.541442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:12.541522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1447 partition: 0 MaxSeqNo: 42 sessionId: src_id|643dc6d3-e3a84519-b7703dd7-e93153be_0
2025-09-30T14:54:12.541928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb2d13c0-4efb5241-81d2e84e-435b18c5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|643dc6d3-e3a84519-b7703dd7-e93153be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:12.545132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|643dc6d3-e3a84519-b7703dd7-e93153be_0] Write session: try to update token
2025-09-30T14:54:12.545154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|643dc6d3-e3a84519-b7703dd7-e93153be_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:12.553632Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:12.553655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:12.553658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:12.553660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:12.553671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895670949827935:8723]
2025-09-30T14:54:12.553676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895670949827935:8723]
2025-09-30T14:54:12.553681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895670949827935:8723]
2025-09-30T14:54:12.553727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:12.553737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.553740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:12.553900Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:12.553998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:12.554013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:12.554017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:12.565328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1447 sessionId: src_id|643dc6d3-e3a84519-b7703dd7-e93153be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:12.568606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:12.583386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895671039579490:8563]
2025-09-30T14:54:12.584566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1446, pipe: [1:7555895671039579490:8563]
2025-09-30T14:54:12.675954Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:12.676297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:12.676314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:12.676335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895671039579490:8563], now have 1 active actors on pipe
2025-09-30T14:54:12.676582Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:12.677107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895671039579490:8563]
2025-09-30T14:54:12.677154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:12.677209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:12.677281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1447 reason: status is not ok: tablet will be restarted right now sessionId: src_id|643dc6d3-e3a84519-b7703dd7-e93153be_0
2025-09-30T14:54:12.677500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1447 sessionId: src_id|643dc6d3-e3a84519-b7703dd7-e93153be_0 is DEAD
2025-09-30T14:54:12.677673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|643dc6d3-e3a84519-b7703dd7-e93153be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:12.677684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|643dc6d3-e3a84519-b7703dd7-e93153be_0] Write session will restart in 0.009532s
2025-09-30T14:54:12.677709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|643dc6d3-e3a84519-b7703dd7-e93153be_0] Write session: Do CDS request
2025-09-30T14:54:12.677715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|643dc6d3-e3a84519-b7703dd7-e93153be_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:12.688873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|643dc6d3-e3a84519-b7703dd7-e93153be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:12.689117Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:12.689139Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1448
2025-09-30T14:54:12.689290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1448 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:12.689346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1448 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:12.689358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1448 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:12.689363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:12.689846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1448 sessionId:  describe result for acl check
2025-09-30T14:54:12.689910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:12.689921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:12.689923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:12.689929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895671039579554:8844] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:12.690526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895671039579554:8844] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:12.694414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895671039579554:8844] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:12.700746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895671039579554:8844] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:12.700770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895671039579554:8844] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:12.700774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895671039579554:8844] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:12.700794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1448 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:12.703754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:12.707048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:12.707290Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:12.707300Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:12.707311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:12.707369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:12.707417Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895670949828224:8725]
2025-09-30T14:54:12.708092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:12.708463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:12.708509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:12.708795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:12.708850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:12.708857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:12.708858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:12.708860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:12.708861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:12.708862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:12.708863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:12.708865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:12.708866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:12.708867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:12.708868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.708869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:12.708870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:12.708871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:12.708872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:12.708878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:12.708887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:12.708892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:12.708897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:12.708901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:12.708906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:12.708909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:12.708911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:12.708913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:12.708916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:12.708918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.708921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:12.708924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:12.708926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:12.708929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:12.708935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:12.708940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:12.708944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:12.708947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:12.708950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:12.708953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:12.708956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:12.708959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:12.708962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:12.708966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:12.708971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:12.708975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:12.708980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:12.708985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:12.708992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:12.708997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:12.709002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:12.709008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:12.709011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:12.709017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:12.709022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.709027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.709031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:12.709037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:12.709042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:12.709047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:12.709051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:12.709058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:12.709063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:12.709068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:12.709115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:12.714992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:12.716184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:12.716197Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:12.716200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:12.716204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:12.716211Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1447 [2:7555895670949828224:8725]
2025-09-30T14:54:12.716227Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:12.716244Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:12.716254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:12.716257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:12.716260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:12.716278Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:12.716290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:12.716299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:12.716362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.716370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:12.716372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:12.716376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:12.716378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:12.716454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:12.716462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.716476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:12.716491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:12.716514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:12.716535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895670949828219:8725]
2025-09-30T14:54:12.716542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895670949828219:8725]
2025-09-30T14:54:12.716545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895670949828219:8725]
2025-09-30T14:54:12.716560Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:12.716581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:12.716600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:12.716607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:12.716644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895670949828219:8725]
2025-09-30T14:54:12.716651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:12.716653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:12.716656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:12.716658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:12.716661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895671039579759:8844], now have 1 active actors on pipe
2025-09-30T14:54:12.716666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895671039579492:2454], now have 1 active actors on pipe
2025-09-30T14:54:12.716673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:12.716752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1447
2025-09-30T14:54:12.716803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1447
2025-09-30T14:54:12.716934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:12.716944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:12.716972Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b9bdfc97-ea70425e-319a4785-1fa54e81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:12.716979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:12.716987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:12.716990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:12.716999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:12.717013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:12.717033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:12.717199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:12.717207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:12.717220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:12.717337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1448 partition: 0 MaxSeqNo: 42 sessionId: src_id|b9bdfc97-ea70425e-319a4785-1fa54e81_0
2025-09-30T14:54:12.717750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|643dc6d3-e3a84519-b7703dd7-e93153be_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b9bdfc97-ea70425e-319a4785-1fa54e81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:12.720742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9bdfc97-ea70425e-319a4785-1fa54e81_0] Write session: try to update token
2025-09-30T14:54:12.720764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9bdfc97-ea70425e-319a4785-1fa54e81_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:12.729366Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:12.729386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:12.729389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:12.729391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:12.729400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895670949828219:8725]
2025-09-30T14:54:12.729405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895670949828219:8725]
2025-09-30T14:54:12.729408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895670949828219:8725]
2025-09-30T14:54:12.729454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:12.729461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.729460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:12.729464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:12.729466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:12.729473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:12.729627Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:12.736172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1448 sessionId: src_id|b9bdfc97-ea70425e-319a4785-1fa54e81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:12.739118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:12.777145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895671039579782:8563]
2025-09-30T14:54:12.777455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1447, pipe: [1:7555895671039579782:8563]
2025-09-30T14:54:12.848422Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:12.848768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:12.848786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:12.848806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895671039579782:8563], now have 1 active actors on pipe
2025-09-30T14:54:12.849097Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:12.849117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895671039579782:8563]
2025-09-30T14:54:12.849149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:12.849153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:12.849222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1448 reason: error at write: Disconnected sessionId: src_id|b9bdfc97-ea70425e-319a4785-1fa54e81_0
2025-09-30T14:54:12.849265Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:12.849454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1448 sessionId: src_id|b9bdfc97-ea70425e-319a4785-1fa54e81_0 is DEAD
2025-09-30T14:54:12.851467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9bdfc97-ea70425e-319a4785-1fa54e81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:12.851479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9bdfc97-ea70425e-319a4785-1fa54e81_0] Write session will restart in 0.007105s
2025-09-30T14:54:12.851509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9bdfc97-ea70425e-319a4785-1fa54e81_0] Write session: Do CDS request
2025-09-30T14:54:12.851515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9bdfc97-ea70425e-319a4785-1fa54e81_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:12.861982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9bdfc97-ea70425e-319a4785-1fa54e81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:12.862067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:12.862088Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1449
2025-09-30T14:54:12.862207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1449 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:12.862241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1449 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:12.862246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1449 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:12.862250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:12.862723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1449 sessionId:  describe result for acl check
2025-09-30T14:54:12.862760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:12.862767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:12.862768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:12.862775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895671039579825:8848] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:12.863335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895671039579825:8848] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:12.868487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895671039579825:8848] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:12.874951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895671039579825:8848] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:12.874977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895671039579825:8848] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:12.874981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895671039579825:8848] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:12.874991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1449 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:12.892665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:12.896873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:12.897122Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:12.897140Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:12.897153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:12.897222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:12.897270Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895670949828506:8728]
2025-09-30T14:54:12.897984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:12.898384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:12.898440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:12.899102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:12.899229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:12.899240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:12.899256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:12.899258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:12.899259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:12.899260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:12.899262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:12.899263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:12.899264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:12.899265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:12.899266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.899267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:12.899269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:12.899270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:12.899271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:12.899278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:12.899288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:12.899293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:12.899297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:12.899301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:12.899306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:12.899309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:12.899314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:12.899318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:12.899323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:12.899327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.899331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:12.899346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:12.899351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:12.899355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:12.899365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:12.899373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:12.899380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:12.899387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:12.899392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:12.899399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:12.899404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:12.899409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:12.899415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:12.899420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:12.899425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:12.899430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:12.899436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:12.899442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:12.899447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:12.899452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:12.899457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:12.899463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:12.899468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:12.899473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:12.899479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.899485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.899489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:12.899495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:12.899500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:12.899506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:12.899511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:12.899516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:12.899521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:12.899526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:12.899576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:12.906235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:12.907169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:12.907189Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:12.907192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:12.907196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:12.907204Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1448 [2:7555895670949828506:8728]
2025-09-30T14:54:12.907222Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:12.907240Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:12.907262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:12.907271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:12.907273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:12.907290Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:12.907303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:12.907315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:12.907388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.907396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:12.907399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:12.907403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:12.907406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:12.907477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:12.907488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.907503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:12.907516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:12.907535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:12.907559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895671039579783:2454], now have 1 active actors on pipe
2025-09-30T14:54:12.907563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895671039579990:8848], now have 1 active actors on pipe
2025-09-30T14:54:12.907569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895670949828500:8728]
2025-09-30T14:54:12.907572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895670949828500:8728]
2025-09-30T14:54:12.907575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895670949828500:8728]
2025-09-30T14:54:12.907592Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:12.907608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:12.907614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:12.907618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:12.907621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:12.907626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:12.907630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:12.907667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895670949828500:8728]
2025-09-30T14:54:12.907675Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:12.907683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:12.907752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1448
2025-09-30T14:54:12.907816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1448
2025-09-30T14:54:12.908125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:12.908139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:12.908167Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22399015-e993178c-7bfdb56-a7c323d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:12.908182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:12.908189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:12.908192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:12.908202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:12.908225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:12.908241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:12.908410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:12.908421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:12.908441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:12.908579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1449 partition: 0 MaxSeqNo: 42 sessionId: src_id|22399015-e993178c-7bfdb56-a7c323d4_0
2025-09-30T14:54:12.908997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9bdfc97-ea70425e-319a4785-1fa54e81_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|22399015-e993178c-7bfdb56-a7c323d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:12.911824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22399015-e993178c-7bfdb56-a7c323d4_0] Write session: try to update token
2025-09-30T14:54:12.911841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22399015-e993178c-7bfdb56-a7c323d4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:12.920582Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:12.920605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:12.920615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895670949828500:8728]
2025-09-30T14:54:12.920664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:12.920678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:12.920856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:12.921017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:12.921193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:12.921345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:12.921552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:12.921618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:12.930527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1449 sessionId: src_id|22399015-e993178c-7bfdb56-a7c323d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:12.933532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:12.934991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:12.935013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:12.935033Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:12.935036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:12.935038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:12.935041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:12.935049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895670949828500:8728]
2025-09-30T14:54:12.935052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895670949828500:8728]
2025-09-30T14:54:12.935059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895670949828500:8728]
2025-09-30T14:54:12.935109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:12.935121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:12.935124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:12.935124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:12.935131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:12.935136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:12.935280Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:12.949209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895671039580075:8563]
2025-09-30T14:54:12.949625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1448, pipe: [1:7555895671039580075:8563]
2025-09-30T14:54:13.056895Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:13.057337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:13.057367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895671039580075:8563], now have 1 active actors on pipe
2025-09-30T14:54:13.057646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:13.060567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:13.061016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895671039580075:8563]
2025-09-30T14:54:13.070681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22399015-e993178c-7bfdb56-a7c323d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:13.070698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22399015-e993178c-7bfdb56-a7c323d4_0] Write session will restart in 0.007417s
2025-09-30T14:54:13.070722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22399015-e993178c-7bfdb56-a7c323d4_0] Write session: Do CDS request
2025-09-30T14:54:13.070728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22399015-e993178c-7bfdb56-a7c323d4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:13.069925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:13.069943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:13.069965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1449 reason: error at write: Disconnected sessionId: src_id|22399015-e993178c-7bfdb56-a7c323d4_0
2025-09-30T14:54:13.070122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1449 sessionId: src_id|22399015-e993178c-7bfdb56-a7c323d4_0 is DEAD
2025-09-30T14:54:13.079835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22399015-e993178c-7bfdb56-a7c323d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:13.080024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:13.080047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1450
2025-09-30T14:54:13.080596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1450 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:13.080636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1450 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:13.080643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1450 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:13.080648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:13.081182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1450 sessionId:  describe result for acl check
2025-09-30T14:54:13.081232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:13.081234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:13.081237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:13.081243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895675334547415:8862] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:13.081849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895675334547415:8862] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:13.086140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895675334547415:8862] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:13.096129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895675334547415:8862] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:13.096151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895675334547415:8862] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:13.096155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895675334547415:8862] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:13.096164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1450 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:13.128094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:13.131927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:13.132199Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:13.132213Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:13.132227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:13.132304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:13.132362Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895675244796122:8742]
2025-09-30T14:54:13.133036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:13.133521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:13.133592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:13.133994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:13.134085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:13.134094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:13.134096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:13.134097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:13.134098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:13.134100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:13.134102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:13.134103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:13.134105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:13.134106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:13.134107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.134109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:13.134111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:13.134112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:13.134114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:13.134122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:13.134134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:13.134140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:13.134145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:13.134150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:13.134155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:13.134159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:13.134164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:13.134169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:13.134175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:13.134180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.134185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:13.134190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:13.134195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:13.134200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:13.134211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:13.134227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:13.134239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:13.134248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:13.134259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:13.134266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:13.134279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:13.134290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:13.134296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:13.134301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:13.134307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:13.134313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:13.134319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:13.134331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:13.134336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:13.134341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:13.134347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:13.134352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:13.134357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:13.134363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:13.134376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.134383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.134393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:13.134399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:13.134410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:13.134416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:13.134426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:13.134433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:13.134444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:13.134451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:13.134512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:13.140902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:13.142460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:13.142483Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:13.142485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:13.142489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:13.142497Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1449 [2:7555895675244796122:8742]
2025-09-30T14:54:13.142520Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:13.142541Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:13.142545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:13.142548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:13.142551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:13.142570Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:13.142578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:13.142586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:13.142663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.142674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:13.142676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:13.142680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:13.142683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:13.142765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:13.142775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.142793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:13.142805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:13.142822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:13.142849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895675334547392:2454], now have 1 active actors on pipe
2025-09-30T14:54:13.142862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895675334547454:8862], now have 1 active actors on pipe
2025-09-30T14:54:13.142869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895675244796117:8742]
2025-09-30T14:54:13.142871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895675244796117:8742]
2025-09-30T14:54:13.142873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895675244796117:8742]
2025-09-30T14:54:13.142888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:13.142903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:13.142923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:13.142932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:13.142928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1449
2025-09-30T14:54:13.142954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:13.142964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:13.142966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:13.142973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895675244796117:8742]
2025-09-30T14:54:13.142976Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:13.142988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:13.143288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1449
2025-09-30T14:54:13.143445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:13.143459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:13.143499Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6bae1a79-caf5d410-d0a24253-49265fed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:13.143514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:13.143524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:13.143528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:13.143541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:13.143554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:13.143576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:13.143969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:13.143980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:13.143998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:13.144097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1450 partition: 0 MaxSeqNo: 42 sessionId: src_id|6bae1a79-caf5d410-d0a24253-49265fed_0
2025-09-30T14:54:13.144556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22399015-e993178c-7bfdb56-a7c323d4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6bae1a79-caf5d410-d0a24253-49265fed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:13.147715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bae1a79-caf5d410-d0a24253-49265fed_0] Write session: try to update token
2025-09-30T14:54:13.147737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bae1a79-caf5d410-d0a24253-49265fed_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:13.156698Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:13.156720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:13.156722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:13.156725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:13.156735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895675244796117:8742]
2025-09-30T14:54:13.156739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895675244796117:8742]
2025-09-30T14:54:13.156744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895675244796117:8742]
2025-09-30T14:54:13.156790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:13.156798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.156801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:13.156959Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:13.158166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:13.158183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:13.158188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:13.162644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895675334547698:8563]
2025-09-30T14:54:13.163026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1449, pipe: [1:7555895675334547698:8563]
2025-09-30T14:54:13.166358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1450 sessionId: src_id|6bae1a79-caf5d410-d0a24253-49265fed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:13.169549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:13.275962Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:13.276449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895675334547698:8563], now have 1 active actors on pipe
2025-09-30T14:54:13.276505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:13.276513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:13.276782Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:13.277063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895675334547698:8563]
2025-09-30T14:54:13.277099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:13.277101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:13.277161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1450 reason: error at write: Disconnected sessionId: src_id|6bae1a79-caf5d410-d0a24253-49265fed_0
2025-09-30T14:54:13.277329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1450 sessionId: src_id|6bae1a79-caf5d410-d0a24253-49265fed_0 is DEAD
2025-09-30T14:54:13.277483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:13.283499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bae1a79-caf5d410-d0a24253-49265fed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:13.283513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bae1a79-caf5d410-d0a24253-49265fed_0] Write session will restart in 0.007744s
2025-09-30T14:54:13.283540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bae1a79-caf5d410-d0a24253-49265fed_0] Write session: Do CDS request
2025-09-30T14:54:13.283549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bae1a79-caf5d410-d0a24253-49265fed_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:13.293311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bae1a79-caf5d410-d0a24253-49265fed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:13.293421Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:13.293454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1451
2025-09-30T14:54:13.299549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1451 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:13.299630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1451 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:13.299641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1451 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:13.299647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:13.300105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1451 sessionId:  describe result for acl check
2025-09-30T14:54:13.300164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:13.300171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:13.300173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:13.300179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895675334547878:8866] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:13.300749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895675334547878:8866] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:13.307048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895675334547878:8866] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:13.309089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:13.313108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:13.313398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895675334547878:8866] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:13.313421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895675334547878:8866] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:13.313424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895675334547878:8866] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:13.313433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1451 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:13.313540Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:13.313552Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:13.313565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:13.313651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:13.313706Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895675244796407:8745]
2025-09-30T14:54:13.314381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:13.314752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:13.314801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:13.315163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:13.315229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:13.315236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:13.315237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:13.315239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:13.315240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:13.315256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:13.315258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:13.315259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:13.315261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:13.315262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:13.315263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.315264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:13.315265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:13.315267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:13.315268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:13.315274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:13.315284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:13.315288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:13.315292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:13.315295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:13.315299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:13.315303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:13.315307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:13.315310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:13.315315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:13.315318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.315323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:13.315327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:13.315331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:13.315336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:13.315345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:13.315353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:13.315360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:13.315365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:13.315370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:13.315376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:13.315380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:13.315386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:13.315391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:13.315396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:13.315401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:13.315407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:13.315412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:13.315418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:13.315422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:13.315428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:13.315433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:13.315440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:13.315444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:13.315451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:13.315464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.315470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.315475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:13.315480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:13.315484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:13.315489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:13.315494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:13.315500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:13.315508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:13.315513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:13.315555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:13.329104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:13.330404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:13.330422Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:13.330424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:13.330429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:13.330437Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1450 [2:7555895675244796407:8745]
2025-09-30T14:54:13.330455Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:13.330475Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:13.330478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:13.330481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:13.330484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:13.330500Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:13.330508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:13.330515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:13.330586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.330595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:13.330597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:13.330600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:13.330603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:13.330676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:13.330684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.330697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:13.330707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:13.330730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:13.330750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895675244796401:8745]
2025-09-30T14:54:13.330757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895675244796401:8745]
2025-09-30T14:54:13.330759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895675244796401:8745]
2025-09-30T14:54:13.330773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:13.330791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:13.330809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:13.330816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:13.330858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895675244796401:8745]
2025-09-30T14:54:13.330865Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:13.331011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:13.331019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:13.331021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:13.331029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:13.331379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895675334547981:8866], now have 1 active actors on pipe
2025-09-30T14:54:13.331386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895675334547701:2454], now have 1 active actors on pipe
2025-09-30T14:54:13.331391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1450
2025-09-30T14:54:13.331450Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1450
2025-09-30T14:54:13.331660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:13.331676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:13.331705Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9672fa4c-ac240a30-9fcab1df-41793241_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:13.331715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:13.331720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:13.331725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:13.331736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:13.331748Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:13.331770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:13.331960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:13.331976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:13.332002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:13.332633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1451 partition: 0 MaxSeqNo: 42 sessionId: src_id|9672fa4c-ac240a30-9fcab1df-41793241_0
2025-09-30T14:54:13.333083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bae1a79-caf5d410-d0a24253-49265fed_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9672fa4c-ac240a30-9fcab1df-41793241_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:13.336255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9672fa4c-ac240a30-9fcab1df-41793241_0] Write session: try to update token
2025-09-30T14:54:13.336280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9672fa4c-ac240a30-9fcab1df-41793241_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:13.355058Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:13.355079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:13.355082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:13.355084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:13.355093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895675244796401:8745]
2025-09-30T14:54:13.355098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895675244796401:8745]
2025-09-30T14:54:13.355103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895675244796401:8745]
2025-09-30T14:54:13.355145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:13.355153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.355156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:13.355339Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:13.356782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:13.356798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:13.356803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:13.365009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1451 sessionId: src_id|9672fa4c-ac240a30-9fcab1df-41793241_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:13.367849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:13.377262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895675334547993:8563]
2025-09-30T14:54:13.377732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1450, pipe: [1:7555895675334547993:8563]
2025-09-30T14:54:13.478458Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:13.478918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:13.478929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:13.478950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895675334547993:8563], now have 1 active actors on pipe
2025-09-30T14:54:13.479215Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:13.483005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:13.483104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1451 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9672fa4c-ac240a30-9fcab1df-41793241_0
2025-09-30T14:54:13.483348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895675334547993:8563]
2025-09-30T14:54:13.483366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:13.484018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1451 sessionId: src_id|9672fa4c-ac240a30-9fcab1df-41793241_0 is DEAD
2025-09-30T14:54:13.487628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9672fa4c-ac240a30-9fcab1df-41793241_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:13.487642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9672fa4c-ac240a30-9fcab1df-41793241_0] Write session will restart in 0.009077s
2025-09-30T14:54:13.487668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9672fa4c-ac240a30-9fcab1df-41793241_0] Write session: Do CDS request
2025-09-30T14:54:13.487675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9672fa4c-ac240a30-9fcab1df-41793241_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:13.497815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9672fa4c-ac240a30-9fcab1df-41793241_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:13.498267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:13.498288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1452
2025-09-30T14:54:13.498435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1452 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:13.498471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1452 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:13.498476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1452 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:13.498482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:13.499008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1452 sessionId:  describe result for acl check
2025-09-30T14:54:13.499044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:13.499046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:13.499049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:13.499055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895675334548023:8871] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:13.499662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895675334548023:8871] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:13.502362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895675334548023:8871] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:13.509012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895675334548023:8871] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:13.509036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895675334548023:8871] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:13.509042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895675334548023:8871] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:13.509051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1452 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:13.529159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:13.533452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:13.533687Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:13.533691Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:13.533704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:13.533771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:13.533813Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895675244796705:8748]
2025-09-30T14:54:13.534526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:13.535098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:13.535167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:13.535593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:13.535679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:13.535686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:13.535688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:13.535690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:13.535691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:13.535692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:13.535694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:13.535696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:13.535697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:13.535698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:13.535700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.535701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:13.535703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:13.535704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:13.535706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:13.535713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:13.535724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:13.535728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:13.535733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:13.535738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:13.535742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:13.535747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:13.535751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:13.535755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:13.535760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:13.535764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.535768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:13.535772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:13.535776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:13.535780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:13.535789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:13.535797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:13.535804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:13.535809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:13.535820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:13.535834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:13.535840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:13.535845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:13.535850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:13.535855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:13.535860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:13.535865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:13.535870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:13.535876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:13.535880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:13.535887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:13.535891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:13.535897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:13.535902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:13.535908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:13.535912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.535918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.535923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:13.535928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:13.535934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:13.535939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:13.535943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:13.535949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:13.535954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:13.535960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:13.536004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:13.542322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:13.543706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:13.543726Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:13.543728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:13.543733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:13.543740Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1451 [2:7555895675244796705:8748]
2025-09-30T14:54:13.543757Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:13.543776Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:13.543780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:13.543783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:13.543786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:13.543803Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:13.543817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:13.543825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:13.543903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.543914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:13.543916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:13.543920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:13.543923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:13.543997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:13.544005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.544021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:13.544039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:13.544063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:13.544085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895675244796700:8748]
2025-09-30T14:54:13.544093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895675244796700:8748]
2025-09-30T14:54:13.544095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895675244796700:8748]
2025-09-30T14:54:13.544113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:13.544128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895675334548007:2454], now have 1 active actors on pipe
2025-09-30T14:54:13.544130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:13.544132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895675334548092:8871], now have 1 active actors on pipe
2025-09-30T14:54:13.544134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:13.544137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:13.544142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:13.544157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:13.544168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:13.544208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895675244796700:8748]
2025-09-30T14:54:13.544221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:13.544224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1451
2025-09-30T14:54:13.544279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1451
2025-09-30T14:54:13.544337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:13.544532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:13.544546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:13.544573Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d6e01d7-dd9f9fba-c798424c-a94e5985_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:13.544582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:13.544586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:13.544588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:13.544598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:13.544608Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:13.544623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:13.545644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:13.545663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:13.545689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:13.545834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1452 partition: 0 MaxSeqNo: 42 sessionId: src_id|6d6e01d7-dd9f9fba-c798424c-a94e5985_0
2025-09-30T14:54:13.546273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9672fa4c-ac240a30-9fcab1df-41793241_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6d6e01d7-dd9f9fba-c798424c-a94e5985_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:13.549265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6e01d7-dd9f9fba-c798424c-a94e5985_0] Write session: try to update token
2025-09-30T14:54:13.549286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6e01d7-dd9f9fba-c798424c-a94e5985_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:13.562160Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:13.562176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:13.562178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:13.562180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:13.562186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895675244796700:8748]
2025-09-30T14:54:13.562190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895675244796700:8748]
2025-09-30T14:54:13.562194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895675244796700:8748]
2025-09-30T14:54:13.562225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:13.562229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.562231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:13.562246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:13.562257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:13.562261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:13.562354Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:13.568567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1452 sessionId: src_id|6d6e01d7-dd9f9fba-c798424c-a94e5985_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:13.571520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:13.583550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895675334548303:8563]
2025-09-30T14:54:13.583856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1451, pipe: [1:7555895675334548303:8563]
2025-09-30T14:54:13.677024Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:13.677486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:13.677505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:13.677547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895675334548303:8563], now have 1 active actors on pipe
2025-09-30T14:54:13.677932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895675334548303:8563]
2025-09-30T14:54:13.677933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:13.677938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:13.677970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:13.678022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1452 reason: error at write: Disconnected sessionId: src_id|6d6e01d7-dd9f9fba-c798424c-a94e5985_0
2025-09-30T14:54:13.677922Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:13.678254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1452 sessionId: src_id|6d6e01d7-dd9f9fba-c798424c-a94e5985_0 is DEAD
2025-09-30T14:54:13.679448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6e01d7-dd9f9fba-c798424c-a94e5985_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:13.679459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6e01d7-dd9f9fba-c798424c-a94e5985_0] Write session will restart in 0.005474s
2025-09-30T14:54:13.679485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6e01d7-dd9f9fba-c798424c-a94e5985_0] Write session: Do CDS request
2025-09-30T14:54:13.679492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6e01d7-dd9f9fba-c798424c-a94e5985_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:13.685866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6e01d7-dd9f9fba-c798424c-a94e5985_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:13.687553Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:13.687573Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1453
2025-09-30T14:54:13.687703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1453 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:13.687736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1453 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:13.687741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1453 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:13.687746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:13.689407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1453 sessionId:  describe result for acl check
2025-09-30T14:54:13.689449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:13.689452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:13.689454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:13.689468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895675334548323:8876] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:13.690045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895675334548323:8876] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:13.699974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895675334548323:8876] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:13.706392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895675334548323:8876] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:13.706413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895675334548323:8876] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:13.706417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895675334548323:8876] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:13.706425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1453 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:13.714469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:13.718520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:13.718753Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:13.718757Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:13.718768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:13.718822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:13.718861Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895675244796994:8750]
2025-09-30T14:54:13.719709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:13.720086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:13.720139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:13.720532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:13.720597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:13.720604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:13.720606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:13.720608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:13.720609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:13.720611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:13.720613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:13.720614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:13.720615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:13.720617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:13.720618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.720619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:13.720621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:13.720622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:13.720624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:13.720629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:13.720640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:13.720645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:13.720649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:13.720654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:13.720659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:13.720664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:13.720669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:13.720674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:13.720679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:13.720684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.720688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:13.720693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:13.720698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:13.720703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:13.720711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:13.720720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:13.720727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:13.720735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:13.720739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:13.720746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:13.720752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:13.720759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:13.720764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:13.720771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:13.720776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:13.720783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:13.720801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:13.720813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:13.720818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:13.720825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:13.720830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:13.720847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:13.720852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:13.720866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:13.720871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.720877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.720884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:13.720895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:13.720900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:13.720910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:13.720916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:13.720927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:13.720932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:13.720938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:13.720988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:13.727463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:13.728568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:13.728586Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:13.728590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:13.728594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:13.728602Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1452 [2:7555895675244796994:8750]
2025-09-30T14:54:13.728621Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:13.728636Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:13.728640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:13.728644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:13.728646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:13.728664Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:13.728676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:13.728684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:13.728750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.728752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:13.728755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:13.728759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:13.728762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:13.728837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:13.728840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.728855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:13.728870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:13.728891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:13.728907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895675244796988:8750]
2025-09-30T14:54:13.728910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895675244796988:8750]
2025-09-30T14:54:13.728914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895675244796988:8750]
2025-09-30T14:54:13.728929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:13.728944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:13.728961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:13.728964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:13.729002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895675244796988:8750]
2025-09-30T14:54:13.729006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:13.729027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895675334548491:8876], now have 1 active actors on pipe
2025-09-30T14:54:13.729026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:13.729030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:13.729032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:13.729038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:13.729287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895675334548305:2454], now have 1 active actors on pipe
2025-09-30T14:54:13.731335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1452
2025-09-30T14:54:13.731377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1452
2025-09-30T14:54:13.731518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:13.731536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:13.731575Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d549246b-703a127-6c2d665f-faf0bdc5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:13.731592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:13.731597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:13.731601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:13.731614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:13.731628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:13.731648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:13.732056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:13.732067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:13.732085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:13.734023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6e01d7-dd9f9fba-c798424c-a94e5985_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d549246b-703a127-6c2d665f-faf0bdc5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:13.732503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1453 partition: 0 MaxSeqNo: 42 sessionId: src_id|d549246b-703a127-6c2d665f-faf0bdc5_0
2025-09-30T14:54:13.736986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d549246b-703a127-6c2d665f-faf0bdc5_0] Write session: try to update token
2025-09-30T14:54:13.737007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d549246b-703a127-6c2d665f-faf0bdc5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:13.742794Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:13.742813Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:13.742816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:13.742819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:13.742832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895675244796988:8750]
2025-09-30T14:54:13.742836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895675244796988:8750]
2025-09-30T14:54:13.742973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895675244796988:8750]
2025-09-30T14:54:13.743020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:13.743028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.743030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:13.743172Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:13.743331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:13.743341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:13.743346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:13.779398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895675334548600:8563]
2025-09-30T14:54:13.779539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1453 sessionId: src_id|d549246b-703a127-6c2d665f-faf0bdc5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:13.782563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:13.787584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1452, pipe: [1:7555895675334548600:8563]
2025-09-30T14:54:13.874333Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:13.874829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:13.874846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:13.874867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895675334548600:8563], now have 1 active actors on pipe
2025-09-30T14:54:13.875079Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:13.875114Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:13.875174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:13.875628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d549246b-703a127-6c2d665f-faf0bdc5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:13.875641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d549246b-703a127-6c2d665f-faf0bdc5_0] Write session will restart in 0.006187s
2025-09-30T14:54:13.875660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d549246b-703a127-6c2d665f-faf0bdc5_0] Write session: Do CDS request
2025-09-30T14:54:13.875665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d549246b-703a127-6c2d665f-faf0bdc5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:13.875267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1453 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d549246b-703a127-6c2d665f-faf0bdc5_0
2025-09-30T14:54:13.875463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1453 sessionId: src_id|d549246b-703a127-6c2d665f-faf0bdc5_0 is DEAD
2025-09-30T14:54:13.875684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895675334548600:8563]
2025-09-30T14:54:13.882813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d549246b-703a127-6c2d665f-faf0bdc5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:13.882942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:13.882961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1454
2025-09-30T14:54:13.883105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1454 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:13.883138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1454 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:13.883149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1454 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:13.883154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:13.883624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1454 sessionId:  describe result for acl check
2025-09-30T14:54:13.883673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:13.883679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:13.883681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:13.883687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895675334548618:8880] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:13.884241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895675334548618:8880] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:13.886269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895675334548618:8880] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:13.890771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895675334548618:8880] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:13.890792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895675334548618:8880] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:13.890796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895675334548618:8880] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:13.890805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1454 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:13.901291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:13.904267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:13.904507Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:13.904516Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:13.904527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:13.904585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:13.904631Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895675244797281:8753]
2025-09-30T14:54:13.905298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:13.905617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:13.905664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:13.906027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:13.906109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:13.906115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:13.906116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:13.906117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:13.906118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:13.906120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:13.906121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:13.906122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:13.906123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:13.906124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:13.906125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.906127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:13.906128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:13.906129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:13.906130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:13.906135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:13.906146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:13.906151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:13.906155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:13.906159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:13.906164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:13.906168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:13.906172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:13.906177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:13.906182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:13.906187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.906191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:13.906195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:13.906199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:13.906203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:13.906211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:13.906220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:13.906226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:13.906232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:13.906238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:13.906244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:13.906250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:13.906256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:13.906262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:13.906268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:13.906272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:13.906277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:13.906283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:13.906289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:13.906293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:13.906304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:13.906310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:13.906315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:13.906325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:13.906330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:13.906336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.906341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.906346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:13.906356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:13.906361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:13.906366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:13.906377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:13.906383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:13.906390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:13.906396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:13.906444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:13.912116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:13.913406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:13.913424Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:13.913426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:13.913430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:13.913437Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1453 [2:7555895675244797281:8753]
2025-09-30T14:54:13.913454Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:13.913470Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:13.913478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:13.913482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:13.913484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:13.913499Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:13.913510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:13.913517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:13.913581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.913588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:13.913590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:13.913594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:13.913597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:13.913664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:13.913672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.913686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:13.913705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:13.913730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:13.913749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895675334548701:8880], now have 1 active actors on pipe
2025-09-30T14:54:13.913753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895675334548603:2454], now have 1 active actors on pipe
2025-09-30T14:54:13.913760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895675244797276:8753]
2025-09-30T14:54:13.913762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895675244797276:8753]
2025-09-30T14:54:13.913764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895675244797276:8753]
2025-09-30T14:54:13.913777Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:13.913791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:13.913794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:13.913797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:13.913799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:13.913815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:13.913816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1453
2025-09-30T14:54:13.913818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:13.913853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895675244797276:8753]
2025-09-30T14:54:13.913860Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:13.913864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1453
2025-09-30T14:54:13.913876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:13.913892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:13.913894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:13.913948Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfda91b7-c0dec11d-1084f492-77086360_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:13.913959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:13.913965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:13.913967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:13.913977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:13.913992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:13.914021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:13.914204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:13.914215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:13.914231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:13.914310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1454 partition: 0 MaxSeqNo: 42 sessionId: src_id|cfda91b7-c0dec11d-1084f492-77086360_0
2025-09-30T14:54:13.914724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d549246b-703a127-6c2d665f-faf0bdc5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cfda91b7-c0dec11d-1084f492-77086360_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:13.917500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfda91b7-c0dec11d-1084f492-77086360_0] Write session: try to update token
2025-09-30T14:54:13.917518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfda91b7-c0dec11d-1084f492-77086360_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:13.926458Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:13.926480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:13.926483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:13.926486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:13.926496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895675244797276:8753]
2025-09-30T14:54:13.926502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895675244797276:8753]
2025-09-30T14:54:13.926507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895675244797276:8753]
2025-09-30T14:54:13.926552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:13.926560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:13.926563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:13.926562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:13.926569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:13.926572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:13.926727Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:13.937031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1454 sessionId: src_id|cfda91b7-c0dec11d-1084f492-77086360_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:13.939872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:13.975779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895675334548898:8563]
2025-09-30T14:54:13.976129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1453, pipe: [1:7555895675334548898:8563]
2025-09-30T14:54:14.045102Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:14.045678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:14.045695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:14.045718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895675334548898:8563], now have 1 active actors on pipe
2025-09-30T14:54:14.045954Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:14.046001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:14.046067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895675334548898:8563]
2025-09-30T14:54:14.046089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:14.046168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1454 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cfda91b7-c0dec11d-1084f492-77086360_0
2025-09-30T14:54:14.046407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1454 sessionId: src_id|cfda91b7-c0dec11d-1084f492-77086360_0 is DEAD
2025-09-30T14:54:14.047336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfda91b7-c0dec11d-1084f492-77086360_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:14.047349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfda91b7-c0dec11d-1084f492-77086360_0] Write session will restart in 0.009429s
2025-09-30T14:54:14.047376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfda91b7-c0dec11d-1084f492-77086360_0] Write session: Do CDS request
2025-09-30T14:54:14.047382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfda91b7-c0dec11d-1084f492-77086360_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:14.057864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfda91b7-c0dec11d-1084f492-77086360_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:14.058000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:14.058021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1455
2025-09-30T14:54:14.058206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1455 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:14.058238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1455 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:14.058248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1455 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:14.058253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:14.058785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1455 sessionId:  describe result for acl check
2025-09-30T14:54:14.058839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:14.058846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:14.058849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:14.058855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895679629516255:8884] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:14.059475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895679629516255:8884] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:14.063069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895679629516255:8884] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:14.067170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895679629516255:8884] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:14.067195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895679629516255:8884] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:14.067199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895679629516255:8884] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:14.067208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1455 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:14.071008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:14.074267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:14.074545Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:14.074556Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:14.074567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:14.074857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:14.074909Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895679539764878:8755]
2025-09-30T14:54:14.075541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:14.075917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:14.075966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:14.076306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:14.076380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:14.076388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:14.076389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:14.076390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:14.076391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:14.076392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:14.076393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:14.076394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:14.076395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:14.076397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:14.076398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.076399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:14.076400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:14.076401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:14.076402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:14.076408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:14.076417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:14.076420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:14.076424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:14.076427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:14.076431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:14.076434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:14.076437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:14.076441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:14.076445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:14.076448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.076451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:14.076455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:14.076458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:14.076461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:14.076467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:14.076475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:14.076482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:14.076487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:14.076491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:14.076495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:14.076499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:14.076504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:14.076508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:14.076512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:14.076517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:14.076523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:14.076527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:14.076531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:14.076535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:14.076540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:14.076543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:14.076548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:14.076551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:14.076555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:14.076561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.076566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.076569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:14.076574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:14.076578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:14.076582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:14.076585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:14.076589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:14.076593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:14.076597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:14.076634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:14.085964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:14.087025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:14.087044Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:14.087048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:14.087052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:14.087059Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1454 [2:7555895679539764878:8755]
2025-09-30T14:54:14.087074Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:14.087091Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:14.087095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:14.087098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:14.087101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:14.087118Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:14.087130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:14.087165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:14.087234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.087262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:14.087269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:14.087273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:14.087276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:14.087482Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1454
2025-09-30T14:54:14.087542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1454
2025-09-30T14:54:14.087347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:14.087357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.087370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:14.087381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:14.087398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:14.087417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895679629516455:8884], now have 1 active actors on pipe
2025-09-30T14:54:14.087421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895679629516196:2454], now have 1 active actors on pipe
2025-09-30T14:54:14.087428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895679539764873:8755]
2025-09-30T14:54:14.087430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895679539764873:8755]
2025-09-30T14:54:14.087432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895679539764873:8755]
2025-09-30T14:54:14.087445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:14.087457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:14.087460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:14.087462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:14.087464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:14.087479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:14.087483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:14.087522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895679539764873:8755]
2025-09-30T14:54:14.087524Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:14.087531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:14.087610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:14.087615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:14.087639Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55427b2e-6c2d5bc3-fc451c9e-2e28906a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:14.087648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:14.087651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:14.087653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:14.087663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:14.087676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:14.087691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:14.087918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:14.087931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:14.087947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:14.088024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1455 partition: 0 MaxSeqNo: 42 sessionId: src_id|55427b2e-6c2d5bc3-fc451c9e-2e28906a_0
2025-09-30T14:54:14.088498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfda91b7-c0dec11d-1084f492-77086360_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|55427b2e-6c2d5bc3-fc451c9e-2e28906a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:14.091457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55427b2e-6c2d5bc3-fc451c9e-2e28906a_0] Write session: try to update token
2025-09-30T14:54:14.091476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55427b2e-6c2d5bc3-fc451c9e-2e28906a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:14.100967Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:14.100989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:14.100991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:14.100996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:14.101005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895679539764873:8755]
2025-09-30T14:54:14.101010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895679539764873:8755]
2025-09-30T14:54:14.101016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895679539764873:8755]
2025-09-30T14:54:14.101060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:14.101066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.101065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:14.101068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:14.101072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:14.101077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:14.101220Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:14.108505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1455 sessionId: src_id|55427b2e-6c2d5bc3-fc451c9e-2e28906a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:14.111590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:14.146233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895679629516520:8563]
2025-09-30T14:54:14.146536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1454, pipe: [1:7555895679629516520:8563]
2025-09-30T14:54:14.218904Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:14.219261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:14.219276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:14.219296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895679629516520:8563], now have 1 active actors on pipe
2025-09-30T14:54:14.219551Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:14.220216Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:14.220273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895679629516520:8563]
2025-09-30T14:54:14.220300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:14.220368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1455 reason: status is not ok: tablet will be restarted right now sessionId: src_id|55427b2e-6c2d5bc3-fc451c9e-2e28906a_0
2025-09-30T14:54:14.220531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1455 sessionId: src_id|55427b2e-6c2d5bc3-fc451c9e-2e28906a_0 is DEAD
2025-09-30T14:54:14.220863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55427b2e-6c2d5bc3-fc451c9e-2e28906a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:14.220875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55427b2e-6c2d5bc3-fc451c9e-2e28906a_0] Write session will restart in 0.006323s
2025-09-30T14:54:14.220900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55427b2e-6c2d5bc3-fc451c9e-2e28906a_0] Write session: Do CDS request
2025-09-30T14:54:14.220907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55427b2e-6c2d5bc3-fc451c9e-2e28906a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:14.228806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55427b2e-6c2d5bc3-fc451c9e-2e28906a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:14.228919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:14.228942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1456
2025-09-30T14:54:14.229064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1456 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:14.229106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1456 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:14.229112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1456 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:14.229116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:14.229631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1456 sessionId:  describe result for acl check
2025-09-30T14:54:14.229674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:14.229683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:14.229685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:14.229691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895679629516534:8896] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:14.230291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895679629516534:8896] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:14.233708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895679629516534:8896] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:14.242113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895679629516534:8896] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:14.242138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895679629516534:8896] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:14.242141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895679629516534:8896] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:14.242150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1456 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:14.252050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:14.255738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:14.256230Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:14.256249Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:14.256268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:14.256376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:14.256438Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895679539765193:8770]
2025-09-30T14:54:14.257130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:14.257589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:14.257716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:14.258115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:14.258195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:14.258196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:14.258197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:14.258198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:14.258200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:14.258201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:14.258202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:14.258203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:14.258205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:14.258206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:14.258207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.258208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:14.258210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:14.258211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:14.258212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:14.258218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:14.258227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:14.258231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:14.258234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:14.258238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:14.258242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:14.258245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:14.258249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:14.258253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:14.258257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:14.258261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.258264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:14.258267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:14.258271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:14.258275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:14.258282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:14.258290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:14.258296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:14.258301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:14.258306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:14.258311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:14.258316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:14.258320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:14.258324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:14.258329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:14.258333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:14.258338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:14.258343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:14.258349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:14.258355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:14.258359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:14.258364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:14.258368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:14.258372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:14.258377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:14.258381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.258386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.258390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:14.258395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:14.258399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:14.258404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:14.258410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:14.258416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:14.258422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:14.258428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:14.258467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:14.265801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:14.267337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:14.267354Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:14.267357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:14.267360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:14.267368Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1455 [2:7555895679539765193:8770]
2025-09-30T14:54:14.267385Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:14.267404Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:14.267409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:14.267412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:14.267414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:14.267432Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:14.267440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:14.267448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:14.267516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.267529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:14.267531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:14.267534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:14.267537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:14.267612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:14.267622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.267636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:14.267648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:14.267668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:14.267690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895679539765188:8770]
2025-09-30T14:54:14.267698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895679539765188:8770]
2025-09-30T14:54:14.267700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895679539765188:8770]
2025-09-30T14:54:14.267709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:14.267723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:14.267738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:14.267744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:14.267745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:14.267747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:14.267749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:14.267793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895679629516525:2454], now have 1 active actors on pipe
2025-09-30T14:54:14.267803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895679539765188:8770]
2025-09-30T14:54:14.267814Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:14.267824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895679629516653:8896], now have 1 active actors on pipe
2025-09-30T14:54:14.267846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:14.267850Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1455
2025-09-30T14:54:14.267880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1455
2025-09-30T14:54:14.268085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:14.268095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:14.268124Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b68cb03d-1a7b45ca-ecffc179-b3e66906_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:14.268137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:14.268142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:14.268144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:14.268156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:14.268184Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:14.268205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:14.268456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:14.268466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:14.268485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:14.268667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1456 partition: 0 MaxSeqNo: 42 sessionId: src_id|b68cb03d-1a7b45ca-ecffc179-b3e66906_0
2025-09-30T14:54:14.269087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55427b2e-6c2d5bc3-fc451c9e-2e28906a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b68cb03d-1a7b45ca-ecffc179-b3e66906_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:14.272452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b68cb03d-1a7b45ca-ecffc179-b3e66906_0] Write session: try to update token
2025-09-30T14:54:14.272469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b68cb03d-1a7b45ca-ecffc179-b3e66906_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:14.290562Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:14.290582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:14.290594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895679539765188:8770]
2025-09-30T14:54:14.290668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:14.290952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:14.291206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:14.291411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:14.291811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:14.291904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:14.292167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:14.292207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:14.294064Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:14.294078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:14.294080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:14.294082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:14.294089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895679539765188:8770]
2025-09-30T14:54:14.294093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895679539765188:8770]
2025-09-30T14:54:14.294096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895679539765188:8770]
2025-09-30T14:54:14.294124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:14.294130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.294131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:14.294153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:14.294159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:14.294163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:14.294142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1456 sessionId: src_id|b68cb03d-1a7b45ca-ecffc179-b3e66906_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:14.294265Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:14.297321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:14.318814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895679629516823:8563]
2025-09-30T14:54:14.319136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1455, pipe: [1:7555895679629516823:8563]
2025-09-30T14:54:14.410013Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:14.410316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:14.410331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:14.410352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895679629516823:8563], now have 1 active actors on pipe
2025-09-30T14:54:14.410529Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:14.410580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:14.410596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:14.410632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895679629516823:8563]
2025-09-30T14:54:14.410659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1456 reason: error at write: Disconnected sessionId: src_id|b68cb03d-1a7b45ca-ecffc179-b3e66906_0
2025-09-30T14:54:14.410669Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:14.410890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1456 sessionId: src_id|b68cb03d-1a7b45ca-ecffc179-b3e66906_0 is DEAD
2025-09-30T14:54:14.411064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b68cb03d-1a7b45ca-ecffc179-b3e66906_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:14.411076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b68cb03d-1a7b45ca-ecffc179-b3e66906_0] Write session will restart in 0.006966s
2025-09-30T14:54:14.411099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b68cb03d-1a7b45ca-ecffc179-b3e66906_0] Write session: Do CDS request
2025-09-30T14:54:14.411117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b68cb03d-1a7b45ca-ecffc179-b3e66906_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:14.419846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b68cb03d-1a7b45ca-ecffc179-b3e66906_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:14.419957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:14.419982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1457
2025-09-30T14:54:14.420137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1457 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:14.420170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1457 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:14.420175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1457 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:14.420180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:14.420779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1457 sessionId:  describe result for acl check
2025-09-30T14:54:14.420824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:14.420831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:14.420833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:14.420839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895679629516863:8901] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:14.421394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895679629516863:8901] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:14.424271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895679629516863:8901] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:14.427976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895679629516863:8901] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:14.427991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895679629516863:8901] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:14.427994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895679629516863:8901] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:14.428002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1457 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:14.433441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:14.433955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:14.434146Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:14.434156Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:14.434166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:14.434213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:14.434254Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895679539765495:8773]
2025-09-30T14:54:14.434962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:14.437409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:14.437490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:14.437913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:14.437980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:14.437982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:14.437983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:14.437985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:14.437986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:14.437988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:14.437989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:14.437991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:14.437992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:14.437993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:14.437995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.437996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:14.437997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:14.437999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:14.438000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:14.438007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:14.438018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:14.438023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:14.438028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:14.438032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:14.438037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:14.438042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:14.438046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:14.438051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:14.438056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:14.438060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.438064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:14.438069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:14.438074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:14.438078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:14.438086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:14.438095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:14.438102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:14.438108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:14.438113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:14.438119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:14.438124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:14.438129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:14.438134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:14.438140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:14.438145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:14.438151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:14.438156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:14.438162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:14.438165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:14.438171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:14.438176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:14.438182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:14.438188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:14.438194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:14.438199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.438205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.438209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:14.438215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:14.438221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:14.438227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:14.438232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:14.438237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:14.438242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:14.438249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:14.438298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:14.445546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:14.446487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:14.446504Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:14.446507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:14.446512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:14.446519Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1456 [2:7555895679539765495:8773]
2025-09-30T14:54:14.446550Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:14.446573Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:14.446581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:14.446584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:14.446587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:14.446604Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:14.446616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:14.446623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:14.446689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.446696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:14.446699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:14.446704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:14.446707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:14.446779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:14.446787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.446800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:14.446818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:14.446841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:14.446865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895679629516838:2454], now have 1 active actors on pipe
2025-09-30T14:54:14.446873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895679629517016:8901], now have 1 active actors on pipe
2025-09-30T14:54:14.446880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895679539765490:8773]
2025-09-30T14:54:14.446888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895679539765490:8773]
2025-09-30T14:54:14.446890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895679539765490:8773]
2025-09-30T14:54:14.446906Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:14.446920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:14.446924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:14.446931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:14.446934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:14.446941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:14.446944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:14.446981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895679539765490:8773]
2025-09-30T14:54:14.446993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:14.447000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:14.447007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1456
2025-09-30T14:54:14.447007Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1456
2025-09-30T14:54:14.447052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:14.447065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:14.447092Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|467cebf8-3fb95f7f-5987b9d8-11f2a8c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:14.447099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:14.447103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:14.447106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:14.447116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:14.447126Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:14.447141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:14.447343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:14.447352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:14.447368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:14.447470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1457 partition: 0 MaxSeqNo: 42 sessionId: src_id|467cebf8-3fb95f7f-5987b9d8-11f2a8c0_0
2025-09-30T14:54:14.447926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b68cb03d-1a7b45ca-ecffc179-b3e66906_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|467cebf8-3fb95f7f-5987b9d8-11f2a8c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:14.451069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|467cebf8-3fb95f7f-5987b9d8-11f2a8c0_0] Write session: try to update token
2025-09-30T14:54:14.451093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|467cebf8-3fb95f7f-5987b9d8-11f2a8c0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:14.460226Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:14.460245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:14.460255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895679539765490:8773]
2025-09-30T14:54:14.460304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:14.460320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:14.460549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:14.460699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:14.460839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:14.460983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:14.461187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:14.461220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:14.469985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1457 sessionId: src_id|467cebf8-3fb95f7f-5987b9d8-11f2a8c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:14.473921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:14.473341Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:14.473361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:14.473364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:14.473366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:14.473377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895679539765490:8773]
2025-09-30T14:54:14.473381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895679539765490:8773]
2025-09-30T14:54:14.473385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895679539765490:8773]
2025-09-30T14:54:14.473427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:14.473437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.473440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:14.473580Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:14.474209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:14.474223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:14.474227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:14.510815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895679629517136:8563]
2025-09-30T14:54:14.511119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1456, pipe: [1:7555895679629517136:8563]
2025-09-30T14:54:14.592380Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:14.593167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:14.593180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:14.593202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895679629517136:8563], now have 1 active actors on pipe
2025-09-30T14:54:14.593457Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:14.594675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|467cebf8-3fb95f7f-5987b9d8-11f2a8c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:14.594688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|467cebf8-3fb95f7f-5987b9d8-11f2a8c0_0] Write session will restart in 0.006821s
2025-09-30T14:54:14.594722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|467cebf8-3fb95f7f-5987b9d8-11f2a8c0_0] Write session: Do CDS request
2025-09-30T14:54:14.594728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|467cebf8-3fb95f7f-5987b9d8-11f2a8c0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:14.593551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895679629517136:8563]
2025-09-30T14:54:14.593583Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:14.593631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:14.593634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:14.593703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1457 reason: error at write: Disconnected sessionId: src_id|467cebf8-3fb95f7f-5987b9d8-11f2a8c0_0
2025-09-30T14:54:14.593953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1457 sessionId: src_id|467cebf8-3fb95f7f-5987b9d8-11f2a8c0_0 is DEAD
2025-09-30T14:54:14.602848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|467cebf8-3fb95f7f-5987b9d8-11f2a8c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:14.603082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:14.603098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1458
2025-09-30T14:54:14.603213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1458 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:14.603259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1458 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:14.603265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1458 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:14.603269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:14.603853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1458 sessionId:  describe result for acl check
2025-09-30T14:54:14.603895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:14.603898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:14.603903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:14.603910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895679629517148:8906] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:14.604486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895679629517148:8906] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:14.608953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895679629517148:8906] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:14.619526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895679629517148:8906] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:14.619541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895679629517148:8906] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:14.619545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895679629517148:8906] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:14.619554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1458 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:14.634478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:14.638138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:14.638516Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:14.638529Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:14.638543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:14.638610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:14.638653Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895679539765786:8775]
2025-09-30T14:54:14.639341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:14.639794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:14.639868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:14.640253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:14.640349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:14.640357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:14.640359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:14.640361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:14.640362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:14.640364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:14.640366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:14.640367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:14.640369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:14.640370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:14.640372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.640373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:14.640375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:14.640376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:14.640377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:14.640384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:14.640396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:14.640400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:14.640405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:14.640409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:14.640414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:14.640418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:14.640422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:14.640427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:14.640432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:14.640436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.640441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:14.640445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:14.640450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:14.640455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:14.640464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:14.640473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:14.640480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:14.640487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:14.640493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:14.640499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:14.640512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:14.640519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:14.640525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:14.640532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:14.640537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:14.640544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:14.640549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:14.640561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:14.640566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:14.640576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:14.640584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:14.640595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:14.640600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:14.640607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:14.640618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.640624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.640629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:14.640635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:14.640645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:14.640652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:14.640661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:14.640667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:14.640673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:14.640686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:14.640741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:14.646699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:14.647669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:14.647692Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:14.647696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:14.647700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:14.647708Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1457 [2:7555895679539765786:8775]
2025-09-30T14:54:14.647728Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:14.647747Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:14.647750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:14.647753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:14.647756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:14.647773Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:14.647780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:14.647788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:14.647855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.647867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:14.647869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:14.647873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:14.647877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:14.647954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:14.647963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.647978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:14.647990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:14.648007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:14.648028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895679629517246:8906], now have 1 active actors on pipe
2025-09-30T14:54:14.648036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895679539765781:8775]
2025-09-30T14:54:14.648039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895679539765781:8775]
2025-09-30T14:54:14.648042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895679539765781:8775]
2025-09-30T14:54:14.648051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:14.648062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:14.648065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:14.648065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:14.648068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:14.648084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:14.648087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:14.648095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895679629517141:2454], now have 1 active actors on pipe
2025-09-30T14:54:14.648123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1457
2025-09-30T14:54:14.648130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895679539765781:8775]
2025-09-30T14:54:14.648142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:14.648176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:14.648136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1457
2025-09-30T14:54:14.648242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:14.648258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:14.648288Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a545c637-69aeadc0-ffeffa6-d6f6cbdb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:14.648296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:14.648307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:14.648310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:14.648321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:14.648338Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:14.648355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:14.648554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:14.648567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:14.648586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:14.648694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1458 partition: 0 MaxSeqNo: 42 sessionId: src_id|a545c637-69aeadc0-ffeffa6-d6f6cbdb_0
2025-09-30T14:54:14.649124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|467cebf8-3fb95f7f-5987b9d8-11f2a8c0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a545c637-69aeadc0-ffeffa6-d6f6cbdb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:14.651930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a545c637-69aeadc0-ffeffa6-d6f6cbdb_0] Write session: try to update token
2025-09-30T14:54:14.651952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a545c637-69aeadc0-ffeffa6-d6f6cbdb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:14.673052Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:14.673073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:14.673084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895679539765781:8775]
2025-09-30T14:54:14.673139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:14.673150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:14.673326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:14.673477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:14.673619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:14.673768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:14.673999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:14.674183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:14.680672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1458 sessionId: src_id|a545c637-69aeadc0-ffeffa6-d6f6cbdb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:14.683700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:14.683912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:14.683934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:14.683970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:14.684070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:14.691412Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:14.691433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:14.691436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:14.691438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:14.691448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895679539765781:8775]
2025-09-30T14:54:14.691453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895679539765781:8775]
2025-09-30T14:54:14.691458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895679539765781:8775]
2025-09-30T14:54:14.691499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:14.691505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.691508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:14.691649Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:14.695387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:14.695400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:14.695404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:14.695321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895679629517440:8563]
2025-09-30T14:54:14.697849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1457, pipe: [1:7555895679629517440:8563]
2025-09-30T14:54:14.817819Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:14.818547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895679629517440:8563], now have 1 active actors on pipe
2025-09-30T14:54:14.827103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:14.827140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:14.827353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:14.827429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:14.827508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:14.827581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:14.827632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:14.827642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:14.827721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:14.827786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:14.827862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:14.827930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:14.827971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:14.827974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:14.828051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:14.828112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:14.828177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:14.828243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:14.828314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:14.828318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:14.828391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:14.828455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:14.828566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:14.828630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:14.828673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:14.828677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:14.828749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:14.828807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:14.828867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:14.828944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:14.829008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:14.829012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:14.829082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:14.829141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:14.829208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:14.829293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:14.829353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:14.829357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:14.829430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:14.829508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:14.829571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:14.829631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:14.829677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:14.829681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:14.829755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:14.829815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:14.829900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:14.829968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:14.830013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:14.830017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:14.830089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:14.830147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:14.830209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:14.830270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:14.830323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:14.830327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:14.830396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:14.830457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:14.830527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:14.830591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:14.830635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:14.830638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:14.831647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:14.831707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:14.831713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895679629517440:8563]
2025-09-30T14:54:14.831715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:14.831752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1458 reason: error at write: Disconnected sessionId: src_id|a545c637-69aeadc0-ffeffa6-d6f6cbdb_0
2025-09-30T14:54:14.832156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a545c637-69aeadc0-ffeffa6-d6f6cbdb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:14.832168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a545c637-69aeadc0-ffeffa6-d6f6cbdb_0] Write session will restart in 0.006400s
2025-09-30T14:54:14.831962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1458 sessionId: src_id|a545c637-69aeadc0-ffeffa6-d6f6cbdb_0 is DEAD
2025-09-30T14:54:14.832195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a545c637-69aeadc0-ffeffa6-d6f6cbdb_0] Write session: Do CDS request
2025-09-30T14:54:14.832202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a545c637-69aeadc0-ffeffa6-d6f6cbdb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:14.832333Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:14.839732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a545c637-69aeadc0-ffeffa6-d6f6cbdb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:14.839928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:14.839940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1459
2025-09-30T14:54:14.840086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1459 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:14.840114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1459 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:14.840120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1459 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:14.840124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:14.840589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1459 sessionId:  describe result for acl check
2025-09-30T14:54:14.840623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:14.840625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:14.840627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:14.840633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895679629517454:8910] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:14.841179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895679629517454:8910] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:14.843800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895679629517454:8910] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:14.849794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895679629517454:8910] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:14.849813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895679629517454:8910] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:14.849817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895679629517454:8910] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:14.849826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1459 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:14.861842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:14.865149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:14.865362Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:14.865374Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:14.865384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:14.865437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:14.865484Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895679539766080:8778]
2025-09-30T14:54:14.866170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:14.866532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:14.866615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:14.867007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:14.867101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:14.867107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:14.867109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:14.867110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:14.867112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:14.867113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:14.867114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:14.867116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:14.867117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:14.867118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:14.867120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.867121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:14.867123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:14.867124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:14.867125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:14.867132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:14.867144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:14.867149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:14.867153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:14.867158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:14.867163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:14.867167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:14.867172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:14.867176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:14.867180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:14.867185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.867188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:14.867192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:14.867196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:14.867200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:14.867210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:14.867218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:14.867224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:14.867230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:14.867235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:14.867240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:14.867262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:14.867268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:14.867272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:14.867278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:14.867283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:14.867288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:14.867293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:14.867298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:14.867303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:14.867307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:14.867312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:14.867319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:14.867324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:14.867329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:14.867334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.867339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.867349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:14.867354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:14.867359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:14.867364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:14.867368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:14.867373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:14.867379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:14.867385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:14.867435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:14.873206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:14.874360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:14.874378Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:14.874381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:14.874385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:14.874392Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1458 [2:7555895679539766080:8778]
2025-09-30T14:54:14.874409Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:14.874425Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:14.874429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:14.874434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:14.874442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:14.874458Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:14.874470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:14.874478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:14.874550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.874558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:14.874560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:14.874564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:14.874567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:14.874636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:14.874644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.874656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:14.874667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:14.874684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:14.874701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895679539766075:8778]
2025-09-30T14:54:14.874709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895679539766075:8778]
2025-09-30T14:54:14.874712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895679539766075:8778]
2025-09-30T14:54:14.874727Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:14.874745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:14.874767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:14.874775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:14.874778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:14.874782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:14.874785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:14.874810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895679539766075:8778]
2025-09-30T14:54:14.874820Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:14.874871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:14.874992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895679629517443:2454], now have 1 active actors on pipe
2025-09-30T14:54:14.875002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895679629517527:8910], now have 1 active actors on pipe
2025-09-30T14:54:14.874995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1458
2025-09-30T14:54:14.875005Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1458
2025-09-30T14:54:14.875116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:14.875126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:14.875157Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b651766-9114a21f-4bbeb304-6260f7ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:14.875169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:14.875175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:14.875181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:14.875191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:14.875201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:14.875218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:14.879201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:14.879220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:14.879271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:14.879445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1459 partition: 0 MaxSeqNo: 42 sessionId: src_id|2b651766-9114a21f-4bbeb304-6260f7ad_0
2025-09-30T14:54:14.879850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a545c637-69aeadc0-ffeffa6-d6f6cbdb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2b651766-9114a21f-4bbeb304-6260f7ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:14.882851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b651766-9114a21f-4bbeb304-6260f7ad_0] Write session: try to update token
2025-09-30T14:54:14.882872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b651766-9114a21f-4bbeb304-6260f7ad_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:14.887611Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:14.887631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:14.887642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895679539766075:8778]
2025-09-30T14:54:14.887688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:14.887689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:14.887867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:14.888023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:14.888174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:14.888324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:14.888525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:14.888568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:14.901152Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:14.901173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:14.901176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:14.901179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:14.901189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895679539766075:8778]
2025-09-30T14:54:14.901194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895679539766075:8778]
2025-09-30T14:54:14.901199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895679539766075:8778]
2025-09-30T14:54:14.901243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:14.901250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:14.901253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:14.901401Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:14.902535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:14.902550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:14.902554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:14.903119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1459 sessionId: src_id|2b651766-9114a21f-4bbeb304-6260f7ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:14.906202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:14.937602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895679629517744:8563]
2025-09-30T14:54:14.937988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1458, pipe: [1:7555895679629517744:8563]
2025-09-30T14:54:15.036482Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:15.037082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:15.037098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:15.037118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895679629517744:8563], now have 1 active actors on pipe
2025-09-30T14:54:15.039505Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:15.040991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:15.041037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895679629517744:8563]
2025-09-30T14:54:15.041059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:15.041129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1459 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2b651766-9114a21f-4bbeb304-6260f7ad_0
2025-09-30T14:54:15.041335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1459 sessionId: src_id|2b651766-9114a21f-4bbeb304-6260f7ad_0 is DEAD
2025-09-30T14:54:15.041710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b651766-9114a21f-4bbeb304-6260f7ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:15.041722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b651766-9114a21f-4bbeb304-6260f7ad_0] Write session will restart in 0.007797s
2025-09-30T14:54:15.041750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b651766-9114a21f-4bbeb304-6260f7ad_0] Write session: Do CDS request
2025-09-30T14:54:15.041756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b651766-9114a21f-4bbeb304-6260f7ad_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:15.052165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b651766-9114a21f-4bbeb304-6260f7ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:15.052607Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:15.052623Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1460
2025-09-30T14:54:15.052894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1460 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:15.052926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1460 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:15.052932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1460 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:15.052936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:15.057031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1460 sessionId:  describe result for acl check
2025-09-30T14:54:15.057072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:15.057075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:15.057077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:15.057083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895683924485051:8914] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:15.057662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895683924485051:8914] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:15.072358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895683924485051:8914] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:15.087136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895683924485051:8914] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:15.087153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895683924485051:8914] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:15.087156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895683924485051:8914] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:15.087166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1460 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:15.111806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:15.113035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:15.113239Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:15.113243Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:15.113254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:15.113304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:15.113344Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895683834733671:8780]
2025-09-30T14:54:15.114068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:15.114578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:15.114625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:15.114954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:15.115014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:15.115015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:15.115017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:15.115018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:15.115019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:15.115021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:15.115022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:15.115023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:15.115025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:15.115027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:15.115028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:15.115029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:15.115031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:15.115032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:15.115034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:15.115040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:15.115050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:15.115054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:15.115058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:15.115061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:15.115066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:15.115069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:15.115073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:15.115077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:15.115081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:15.115085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:15.115089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:15.115094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:15.115097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:15.115101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:15.115109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:15.115117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:15.115123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:15.115129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:15.115134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:15.115138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:15.115144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:15.115149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:15.115154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:15.115160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:15.115164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:15.115169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:15.115174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:15.115179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:15.115183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:15.115188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:15.115193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:15.115198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:15.115202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:15.115207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:15.115213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:15.115218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:15.115223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:15.115228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:15.115233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:15.115238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:15.115266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:15.115271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:15.115275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:15.115280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:15.115324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:15.131260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:15.132453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:15.132460Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:15.132463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:15.132467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:15.132474Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1459 [2:7555895683834733671:8780]
2025-09-30T14:54:15.132490Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:15.132508Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:15.132511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:15.132514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:15.132517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:15.132534Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:15.132540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:15.132547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:15.132607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:15.132609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:15.132611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:15.132614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:15.132617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:15.132683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:15.132686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:15.132701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:15.132711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:15.132725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:15.132743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895683924485217:8914], now have 1 active actors on pipe
2025-09-30T14:54:15.132746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895683924485043:2454], now have 1 active actors on pipe
2025-09-30T14:54:15.132753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895683834733666:8780]
2025-09-30T14:54:15.132755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895683834733666:8780]
2025-09-30T14:54:15.132757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895683834733666:8780]
2025-09-30T14:54:15.132774Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:15.132783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:15.132786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:15.132787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:15.132789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:15.132801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:15.132805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:15.132846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895683834733666:8780]
2025-09-30T14:54:15.132848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:15.132879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:15.133147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1459
2025-09-30T14:54:15.133178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1459
2025-09-30T14:54:15.133831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:15.133844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:15.133872Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9fbe62e0-c3f1f855-d4e5e218-905190e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:15.133902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:15.133907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:15.133909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:15.133919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:15.133931Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:15.133948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:15.134310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:15.134322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:15.134337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:15.138045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1460 partition: 0 MaxSeqNo: 42 sessionId: src_id|9fbe62e0-c3f1f855-d4e5e218-905190e_0
2025-09-30T14:54:15.141984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895683924485359:8563]
2025-09-30T14:54:15.143640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b651766-9114a21f-4bbeb304-6260f7ad_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9fbe62e0-c3f1f855-d4e5e218-905190e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:15.143542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895683924485359:8563], now have 1 active actors on pipe
2025-09-30T14:54:15.143881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1459, pipe: [1:7555895683924485359:8563]
2025-09-30T14:54:15.146519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fbe62e0-c3f1f855-d4e5e218-905190e_0] Write session: try to update token
2025-09-30T14:54:15.146543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fbe62e0-c3f1f855-d4e5e218-905190e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:15.159785Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:15.159805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:15.159815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895683834733666:8780]
2025-09-30T14:54:15.159859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:15.160049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:15.160198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:15.160373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:15.160525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:15.161044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:15.161086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:15.161400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:15.176449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1460 sessionId: src_id|9fbe62e0-c3f1f855-d4e5e218-905190e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:15.179299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:15.179768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:15.179787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:15.179821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:15.180001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:15.184966Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:15.184986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:15.184989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:15.184991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:15.185000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895683834733666:8780]
2025-09-30T14:54:15.185004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895683834733666:8780]
2025-09-30T14:54:15.185008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895683834733666:8780]
2025-09-30T14:54:15.185046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:15.185052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:15.185055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:15.185195Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:15.187479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:15.187493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:15.187496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:15.371823Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:15.380359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:15.380384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:15.380555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:15.380616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:15.380679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:15.380739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:15.380781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:15.380785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:15.380865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:15.380928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:15.380990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:15.381189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:15.381233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:15.381237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:15.381305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:15.381365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:15.381430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:15.381497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:15.381538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:15.381542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:15.381615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:15.381682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:15.381750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:15.381816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:15.381861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:15.381864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:15.381952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:15.382015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:15.382106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:15.382169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:15.382215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:15.382218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:15.382288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:15.382351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:15.382412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:15.382480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:15.382522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:15.382524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:15.382594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:15.382653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:15.382721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:15.382777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:15.382820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:15.382825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:15.382894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:15.382956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:15.383017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:15.383080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:15.383124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:15.383127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:15.383208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:15.383292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:15.383364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:15.383431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:15.383496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:15.383499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:15.383572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:15.383639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:15.383704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:15.383773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:15.383815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:15.383817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:15.384965Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:15.385138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fbe62e0-c3f1f855-d4e5e218-905190e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:15.385153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fbe62e0-c3f1f855-d4e5e218-905190e_0] Write session will restart in 0.006019s
2025-09-30T14:54:15.385178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fbe62e0-c3f1f855-d4e5e218-905190e_0] Write session: Do CDS request
2025-09-30T14:54:15.385184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fbe62e0-c3f1f855-d4e5e218-905190e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:15.384693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895683924485359:8563]
2025-09-30T14:54:15.384732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:15.384735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:15.384762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1460 reason: error at write: Disconnected sessionId: src_id|9fbe62e0-c3f1f855-d4e5e218-905190e_0
2025-09-30T14:54:15.384968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1460 sessionId: src_id|9fbe62e0-c3f1f855-d4e5e218-905190e_0 is DEAD
2025-09-30T14:54:15.385111Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:15.392756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fbe62e0-c3f1f855-d4e5e218-905190e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:15.393123Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:15.393136Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1461
2025-09-30T14:54:15.395421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1461 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:15.395472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1461 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:15.395477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1461 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:15.395482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:15.395879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1461 sessionId:  describe result for acl check
2025-09-30T14:54:15.395911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:15.395913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:15.395915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:15.395921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895683924485403:8927] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:15.396476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895683924485403:8927] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:15.413477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895683924485403:8927] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:15.420230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895683924485403:8927] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:15.420251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895683924485403:8927] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:15.420254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895683924485403:8927] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:15.420263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1461 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:15.458395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:15.464610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:15.464879Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:15.464892Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:15.464904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:15.464965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:15.465015Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895683834734015:8796]
2025-09-30T14:54:15.465734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:15.469396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:15.469480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:15.470011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:15.470082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:15.470083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:15.470085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:15.470086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:15.470088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:15.470090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:15.470092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:15.470093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:15.470095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:15.470096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:15.470098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:15.470099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:15.470101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:15.470102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:15.470104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:15.470111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:15.470123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:15.470129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:15.470133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:15.470138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:15.470142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:15.470146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:15.470150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:15.470154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:15.470159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:15.470163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:15.470167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:15.470171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:15.470175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:15.470179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:15.470188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:15.470198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:15.470205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:15.470212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:15.470217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:15.470224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:15.470229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:15.470235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:15.470240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:15.470246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:15.470251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:15.470256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:15.470261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:15.470268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:15.470272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:15.470278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:15.470286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:15.470292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:15.470296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:15.470302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:15.470309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:15.470315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:15.470321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:15.470327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:15.470332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:15.470337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:15.470343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:15.470349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:15.470355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:15.470361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:15.470429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:15.481003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:15.481912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:15.481919Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:15.481923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:15.481927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:15.481935Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1460 [2:7555895683834734015:8796]
2025-09-30T14:54:15.481952Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:15.481969Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:15.481973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:15.481976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:15.481978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:15.481995Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:15.482002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:15.482010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:15.482077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:15.482080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:15.482082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:15.482086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:15.482089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:15.482162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:15.482165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:15.482180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:15.482194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:15.482213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:15.482231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895683834734009:8796]
2025-09-30T14:54:15.482235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895683834734009:8796]
2025-09-30T14:54:15.482238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895683834734009:8796]
2025-09-30T14:54:15.482247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:15.482261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:15.482277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:15.482278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:15.482281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:15.482283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:15.482286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:15.482316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895683834734009:8796]
2025-09-30T14:54:15.482320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:15.482323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:15.482329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895683924485446:8927], now have 1 active actors on pipe
2025-09-30T14:54:15.482333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895683924485385:2454], now have 1 active actors on pipe
2025-09-30T14:54:15.489480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:15.489506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:15.489549Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8cc398a0-3faf7df3-b7cebf3b-58e362c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:15.489564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:15.489569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:15.489573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:15.489590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:15.489607Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:15.489628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:15.487381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1460
2025-09-30T14:54:15.487426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1460
2025-09-30T14:54:15.487458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895683924485697:8563]
2025-09-30T14:54:15.499946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1461 partition: 0 MaxSeqNo: 42 sessionId: src_id|8cc398a0-3faf7df3-b7cebf3b-58e362c5_0
2025-09-30T14:54:15.501300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fbe62e0-c3f1f855-d4e5e218-905190e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8cc398a0-3faf7df3-b7cebf3b-58e362c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:15.501832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1460, pipe: [1:7555895683924485697:8563]
2025-09-30T14:54:15.497950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:15.497975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:15.499194Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:15.499198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:15.499201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:15.499204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:15.499214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895683834734009:8796]
2025-09-30T14:54:15.499219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895683834734009:8796]
2025-09-30T14:54:15.499224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895683834734009:8796]
2025-09-30T14:54:15.499291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:15.499320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:15.499327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:15.499330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:15.499458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:15.499466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:15.499470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:15.499471Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:15.504316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc398a0-3faf7df3-b7cebf3b-58e362c5_0] Write session: try to update token
2025-09-30T14:54:15.504335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc398a0-3faf7df3-b7cebf3b-58e362c5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:15.531314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1461 sessionId: src_id|8cc398a0-3faf7df3-b7cebf3b-58e362c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:15.534046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:15.699907Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:15.700651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895683924485697:8563], now have 1 active actors on pipe
2025-09-30T14:54:15.700702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:15.700708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:15.701481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895683924485697:8563]
2025-09-30T14:54:15.701520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:15.701523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:15.701582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1461 reason: error at write: Disconnected sessionId: src_id|8cc398a0-3faf7df3-b7cebf3b-58e362c5_0
2025-09-30T14:54:15.701996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc398a0-3faf7df3-b7cebf3b-58e362c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:15.702016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc398a0-3faf7df3-b7cebf3b-58e362c5_0] Write session will restart in 0.005105s
2025-09-30T14:54:15.701761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1461 sessionId: src_id|8cc398a0-3faf7df3-b7cebf3b-58e362c5_0 is DEAD
2025-09-30T14:54:15.701918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:15.702062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc398a0-3faf7df3-b7cebf3b-58e362c5_0] Write session: Do CDS request
2025-09-30T14:54:15.702071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc398a0-3faf7df3-b7cebf3b-58e362c5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:15.701973Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:15.711701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc398a0-3faf7df3-b7cebf3b-58e362c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:15.712027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:15.712041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1462
2025-09-30T14:54:15.712191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1462 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:15.712223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1462 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:15.712228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1462 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:15.712232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:15.712645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1462 sessionId:  describe result for acl check
2025-09-30T14:54:15.712666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:15.712668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:15.712669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:15.712674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895683924485720:8932] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:15.713127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895683924485720:8932] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:15.726303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895683924485720:8932] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:15.733908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895683924485720:8932] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:15.733928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895683924485720:8932] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:15.733932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895683924485720:8932] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:15.733941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1462 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:15.743324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:15.745688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:15.745921Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:15.745926Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:15.745938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:15.745997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:15.746038Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895683834734311:8799]
2025-09-30T14:54:15.746734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:15.747397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:15.747452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:15.747807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:15.747864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:15.747866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:15.747867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:15.747868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:15.747870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:15.747871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:15.747873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:15.747874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:15.747876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:15.747877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:15.747879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:15.747880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:15.747882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:15.747883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:15.747884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:15.747890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:15.747902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:15.747907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:15.747911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:15.747915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:15.747920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:15.747925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:15.747929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:15.747933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:15.747937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:15.747941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:15.747945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:15.747949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:15.747953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:15.747958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:15.747968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:15.747978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:15.747984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:15.747991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:15.747997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:15.748003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:15.748009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:15.748015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:15.748020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:15.748027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:15.748032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:15.748038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:15.748043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:15.748049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:15.748054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:15.748059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:15.748064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:15.748071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:15.748076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:15.748082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:15.748087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:15.748093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:15.748098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:15.748104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:15.748110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:15.748115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:15.748120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:15.748125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:15.748129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:15.748135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:15.748183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:15.760190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:15.761087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:15.761094Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:15.761099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:15.761103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:15.761111Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1461 [2:7555895683834734311:8799]
2025-09-30T14:54:15.761128Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:15.761149Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:15.761153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:15.761157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:15.761159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:15.761176Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:15.761183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:15.761191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:15.761256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:15.761259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:15.761261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:15.761266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:15.761269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:15.761335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:15.761337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:15.761352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:15.761366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:15.761386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:15.761403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895683834734306:8799]
2025-09-30T14:54:15.761406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895683834734306:8799]
2025-09-30T14:54:15.761409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895683834734306:8799]
2025-09-30T14:54:15.761420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:15.761434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:15.761451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:15.761454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:15.761492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895683834734306:8799]
2025-09-30T14:54:15.761495Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:15.761770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:15.761780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:15.761782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:15.761788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:15.762121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895683924485939:8932], now have 1 active actors on pipe
2025-09-30T14:54:15.762128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895683924485706:2454], now have 1 active actors on pipe
2025-09-30T14:54:15.762268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1461
2025-09-30T14:54:15.762309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1461
2025-09-30T14:54:15.762357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:15.762367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:15.762394Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b92b169f-410dbc91-caba4b6b-89ac8743_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:15.762403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:15.762407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:15.762410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:15.762422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:15.762434Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:15.762452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:15.768380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:15.768403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:15.768440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:15.771350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1462 partition: 0 MaxSeqNo: 42 sessionId: src_id|b92b169f-410dbc91-caba4b6b-89ac8743_0
2025-09-30T14:54:15.771810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc398a0-3faf7df3-b7cebf3b-58e362c5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b92b169f-410dbc91-caba4b6b-89ac8743_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:15.774911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b92b169f-410dbc91-caba4b6b-89ac8743_0] Write session: try to update token
2025-09-30T14:54:15.774938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b92b169f-410dbc91-caba4b6b-89ac8743_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:15.779960Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:15.779979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:15.779982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:15.779985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:15.779995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895683834734306:8799]
2025-09-30T14:54:15.780000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895683834734306:8799]
2025-09-30T14:54:15.780004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895683834734306:8799]
2025-09-30T14:54:15.780042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:15.780049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:15.780052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:15.780183Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:15.781440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:15.781451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:15.781455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:15.802056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895683924486008:8563]
2025-09-30T14:54:15.803533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1461, pipe: [1:7555895683924486008:8563]
2025-09-30T14:54:15.810329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1462 sessionId: src_id|b92b169f-410dbc91-caba4b6b-89ac8743_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:15.813273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:15.906438Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:15.907115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895683924486008:8563], now have 1 active actors on pipe
2025-09-30T14:54:15.907164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:15.907171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:15.907434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895683924486008:8563]
2025-09-30T14:54:15.907510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:15.907513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:15.907565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1462 reason: error at write: Disconnected sessionId: src_id|b92b169f-410dbc91-caba4b6b-89ac8743_0
2025-09-30T14:54:15.907743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1462 sessionId: src_id|b92b169f-410dbc91-caba4b6b-89ac8743_0 is DEAD
2025-09-30T14:54:15.907883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b92b169f-410dbc91-caba4b6b-89ac8743_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:15.907896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b92b169f-410dbc91-caba4b6b-89ac8743_0] Write session will restart in 0.007023s
2025-09-30T14:54:15.907920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b92b169f-410dbc91-caba4b6b-89ac8743_0] Write session: Do CDS request
2025-09-30T14:54:15.907926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b92b169f-410dbc91-caba4b6b-89ac8743_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:15.907456Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:15.907921Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:15.915793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b92b169f-410dbc91-caba4b6b-89ac8743_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:15.915948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:15.915962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1463
2025-09-30T14:54:15.916238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1463 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:15.916273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1463 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:15.916278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1463 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:15.916283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:15.917457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1463 sessionId:  describe result for acl check
2025-09-30T14:54:15.917494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:15.917497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:15.917498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:15.917504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895683924486018:8936] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:15.918307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895683924486018:8936] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:15.920144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895683924486018:8936] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:15.923984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895683924486018:8936] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:15.924000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895683924486018:8936] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:15.924007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895683924486018:8936] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:15.924015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1463 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:15.960798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:15.965581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:15.965817Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:15.965828Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:15.965839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:15.965918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:15.965976Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895683834734607:8801]
2025-09-30T14:54:15.966647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:15.967307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:15.967365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:15.967734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:15.967811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:15.967817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:15.967818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:15.967819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:15.967820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:15.967822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:15.967823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:15.967824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:15.967825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:15.967827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:15.967828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:15.967829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:15.967830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:15.967831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:15.967833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:15.967840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:15.967858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:15.967863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:15.967867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:15.967871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:15.967875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:15.967879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:15.967883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:15.967887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:15.967892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:15.967896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:15.967899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:15.967904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:15.967908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:15.967913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:15.967921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:15.967929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:15.967935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:15.967947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:15.967953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:15.967959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:15.967968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:15.967973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:15.967978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:15.967988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:15.967993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:15.968000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:15.968011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:15.968016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:15.968021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:15.968027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:15.968032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:15.968038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:15.968042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:15.968047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:15.968057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:15.968063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:15.968070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:15.968075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:15.968086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:15.968092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:15.968101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:15.968105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:15.968109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:15.968114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:15.968156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:15.976369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:15.977266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:15.977282Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:15.977286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:15.977290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:15.977297Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1462 [2:7555895683834734607:8801]
2025-09-30T14:54:15.977314Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:15.977333Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:15.977336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:15.977340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:15.977343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:15.977361Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:15.977369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:15.977376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:15.977438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:15.977441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:15.977444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:15.977449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:15.977452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:15.977528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:15.977538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:15.977552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:15.977567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:15.977768Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1462
2025-09-30T14:54:15.977822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1462
2025-09-30T14:54:15.977592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:15.977617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895683924486011:2454], now have 1 active actors on pipe
2025-09-30T14:54:15.977623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895683924486053:8936], now have 1 active actors on pipe
2025-09-30T14:54:15.977629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895683834734601:8801]
2025-09-30T14:54:15.977632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895683834734601:8801]
2025-09-30T14:54:15.977634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895683834734601:8801]
2025-09-30T14:54:15.977647Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:15.977661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:15.977661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:15.977665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:15.977667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:15.977678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:15.977682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:15.977718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895683834734601:8801]
2025-09-30T14:54:15.977727Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:15.977737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:15.978035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:15.978046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:15.978073Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9886d39d-78728e5c-73fdd056-7aa70573_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:15.978096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:15.978105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:15.978108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:15.978120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:15.978130Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:15.978144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:15.978620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:15.978630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:15.978646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:15.980114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1463 partition: 0 MaxSeqNo: 42 sessionId: src_id|9886d39d-78728e5c-73fdd056-7aa70573_0
2025-09-30T14:54:15.980561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b92b169f-410dbc91-caba4b6b-89ac8743_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9886d39d-78728e5c-73fdd056-7aa70573_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:15.983575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9886d39d-78728e5c-73fdd056-7aa70573_0] Write session: try to update token
2025-09-30T14:54:15.983598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9886d39d-78728e5c-73fdd056-7aa70573_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:16.002090Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:16.002106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:16.002117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895683834734601:8801]
2025-09-30T14:54:16.002166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:16.002523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:16.002683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:16.002861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:16.003006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:16.003201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:16.003240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:16.003711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:16.007707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895688219453611:8563]
2025-09-30T14:54:16.008175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1463 sessionId: src_id|9886d39d-78728e5c-73fdd056-7aa70573_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:16.008250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1462, pipe: [1:7555895688219453611:8563]
2025-09-30T14:54:16.010827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:16.009114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895688219453611:8563], now have 1 active actors on pipe
2025-09-30T14:54:16.010261Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:16.010265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:16.010266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:16.010267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:16.010275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895683834734601:8801]
2025-09-30T14:54:16.010279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895683834734601:8801]
2025-09-30T14:54:16.010282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895683834734601:8801]
2025-09-30T14:54:16.010324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:16.010332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.010334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:16.010338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:16.010345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:16.010349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:16.010478Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:16.126463Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:16.126768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:16.126779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:16.127077Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:16.127367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895688219453611:8563]
2025-09-30T14:54:16.127394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:16.127423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:16.127425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:16.127483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1463 reason: error at write: Disconnected sessionId: src_id|9886d39d-78728e5c-73fdd056-7aa70573_0
2025-09-30T14:54:16.127677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1463 sessionId: src_id|9886d39d-78728e5c-73fdd056-7aa70573_0 is DEAD
2025-09-30T14:54:16.128685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9886d39d-78728e5c-73fdd056-7aa70573_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:16.128694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9886d39d-78728e5c-73fdd056-7aa70573_0] Write session will restart in 0.009480s
2025-09-30T14:54:16.128718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9886d39d-78728e5c-73fdd056-7aa70573_0] Write session: Do CDS request
2025-09-30T14:54:16.128724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9886d39d-78728e5c-73fdd056-7aa70573_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:16.139748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9886d39d-78728e5c-73fdd056-7aa70573_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:16.139880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:16.139895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1464
2025-09-30T14:54:16.143585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1464 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:16.143633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1464 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:16.143639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1464 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:16.143644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:16.144219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1464 sessionId:  describe result for acl check
2025-09-30T14:54:16.144256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:16.144259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:16.144260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:16.144266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895688219453645:8941] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:16.144867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895688219453645:8941] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:16.149797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895688219453645:8941] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:16.156775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895688219453645:8941] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:16.156796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895688219453645:8941] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:16.156800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895688219453645:8941] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:16.156810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1464 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:16.172119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:16.175551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:16.175783Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:16.175787Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:16.175799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:16.175862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:16.175901Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895688129702200:8803]
2025-09-30T14:54:16.176550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:16.176964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:16.177019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:16.177348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:16.177436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:16.177437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:16.177438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:16.177439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:16.177440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:16.177442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:16.177443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:16.177444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:16.177446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:16.177447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:16.177448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.177449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:16.177450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:16.177451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:16.177453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:16.177458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:16.177468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:16.177472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:16.177476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:16.177479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:16.177483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:16.177486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:16.177490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:16.177494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:16.177497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:16.177501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.177505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:16.177508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:16.177511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:16.177515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:16.177523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:16.177530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:16.177535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:16.177540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:16.177544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:16.177549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:16.177552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:16.177558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:16.177563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:16.177568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:16.177572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:16.177578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:16.177582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:16.177586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:16.177590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:16.177596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:16.177600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:16.177605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:16.177610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:16.177615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:16.177619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.177624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.177628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:16.177633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:16.177641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:16.177646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:16.177651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:16.177657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:16.177661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:16.177665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:16.177703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:16.184229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:16.185471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:16.185491Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:16.185494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:16.185498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:16.185506Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1463 [2:7555895688129702200:8803]
2025-09-30T14:54:16.185524Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:16.185541Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:16.185543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:16.185547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:16.185549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:16.185566Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:16.185578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:16.185586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:16.185653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.185660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:16.185662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:16.185666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:16.185669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:16.185746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:16.185752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.185767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:16.185781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:16.185802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:16.185826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895688219453781:8941], now have 1 active actors on pipe
2025-09-30T14:54:16.185830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895688219453620:2454], now have 1 active actors on pipe
2025-09-30T14:54:16.185837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895688129702195:8803]
2025-09-30T14:54:16.185840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895688129702195:8803]
2025-09-30T14:54:16.185842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895688129702195:8803]
2025-09-30T14:54:16.185855Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:16.185879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:16.185885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:16.185890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:16.185894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:16.185903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:16.185907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:16.185948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895688129702195:8803]
2025-09-30T14:54:16.185960Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:16.185966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:16.185966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1463
2025-09-30T14:54:16.185970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1463
2025-09-30T14:54:16.186186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:16.186198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:16.186237Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|86e94993-c70cd0ab-6032683f-28e764a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:16.186250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:16.186260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:16.186262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:16.186274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:16.186302Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:16.186317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:16.186497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:16.186508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:16.186525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:16.186607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1464 partition: 0 MaxSeqNo: 42 sessionId: src_id|86e94993-c70cd0ab-6032683f-28e764a8_0
2025-09-30T14:54:16.187010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9886d39d-78728e5c-73fdd056-7aa70573_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|86e94993-c70cd0ab-6032683f-28e764a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:16.189976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86e94993-c70cd0ab-6032683f-28e764a8_0] Write session: try to update token
2025-09-30T14:54:16.189998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86e94993-c70cd0ab-6032683f-28e764a8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:16.199105Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:16.199126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:16.199129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:16.199131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:16.199140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895688129702195:8803]
2025-09-30T14:54:16.199145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895688129702195:8803]
2025-09-30T14:54:16.199150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895688129702195:8803]
2025-09-30T14:54:16.199201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:16.199204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:16.199208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.199211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:16.199211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:16.199215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:16.199378Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:16.221769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1464 sessionId: src_id|86e94993-c70cd0ab-6032683f-28e764a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:16.224665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:16.227010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895688219453929:8563]
2025-09-30T14:54:16.227639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1463, pipe: [1:7555895688219453929:8563]
2025-09-30T14:54:16.315816Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:16.316131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:16.316147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:16.316165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895688219453929:8563], now have 1 active actors on pipe
2025-09-30T14:54:16.316604Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:16.316542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895688219453929:8563]
2025-09-30T14:54:16.316578Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:16.316612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:16.316614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:16.316683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1464 reason: error at write: Disconnected sessionId: src_id|86e94993-c70cd0ab-6032683f-28e764a8_0
2025-09-30T14:54:16.316860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1464 sessionId: src_id|86e94993-c70cd0ab-6032683f-28e764a8_0 is DEAD
2025-09-30T14:54:16.318114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86e94993-c70cd0ab-6032683f-28e764a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:16.318121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86e94993-c70cd0ab-6032683f-28e764a8_0] Write session will restart in 0.005027s
2025-09-30T14:54:16.318145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86e94993-c70cd0ab-6032683f-28e764a8_0] Write session: Do CDS request
2025-09-30T14:54:16.318154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86e94993-c70cd0ab-6032683f-28e764a8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:16.324909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86e94993-c70cd0ab-6032683f-28e764a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:16.327425Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:16.327442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1465
2025-09-30T14:54:16.327624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1465 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:16.327656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1465 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:16.327662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1465 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:16.327667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:16.328117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1465 sessionId:  describe result for acl check
2025-09-30T14:54:16.328146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:16.328149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:16.328151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:16.328156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895688219453971:8952] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:16.328701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895688219453971:8952] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:16.332570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895688219453971:8952] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:16.338286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895688219453971:8952] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:16.338304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895688219453971:8952] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:16.338311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895688219453971:8952] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:16.338320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1465 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:16.349812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:16.353886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:16.354146Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:16.354151Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:16.354162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:16.354218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:16.354266Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895688129702536:8818]
2025-09-30T14:54:16.354968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:16.355665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:16.355721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:16.356115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:16.356188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:16.356189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:16.356190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:16.356191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:16.356192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:16.356193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:16.356194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:16.356196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:16.356197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:16.356198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:16.356199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.356201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:16.356202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:16.356203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:16.356204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:16.356211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:16.356221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:16.356225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:16.356229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:16.356233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:16.356237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:16.356241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:16.356245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:16.356250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:16.356254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:16.356258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.356262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:16.356266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:16.356270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:16.356274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:16.356283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:16.356291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:16.356297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:16.356303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:16.356309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:16.356315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:16.356320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:16.356326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:16.356331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:16.356337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:16.356342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:16.356348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:16.356353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:16.356359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:16.356363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:16.356369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:16.356375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:16.356380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:16.356385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:16.356391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:16.356395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.356401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.356406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:16.356411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:16.356418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:16.356424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:16.356427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:16.356432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:16.356438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:16.356443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:16.356486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:16.365257Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1464
2025-09-30T14:54:16.365310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1464
2025-09-30T14:54:16.367208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1465 partition: 0 MaxSeqNo: 42 sessionId: src_id|4f41ce8-462f9260-12d123e-1c79b4e1_0
2025-09-30T14:54:16.363972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:16.364914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:16.364919Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:16.364922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:16.364925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:16.364930Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1464 [2:7555895688129702536:8818]
2025-09-30T14:54:16.364943Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:16.364956Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:16.364959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:16.364961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:16.364963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:16.364976Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:16.364981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:16.364986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:16.365036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.365038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:16.365040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:16.365043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:16.365045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:16.365115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:16.365117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.365125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:16.365137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:16.365152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:16.365171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895688219453955:2454], now have 1 active actors on pipe
2025-09-30T14:54:16.365175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895688219454120:8952], now have 1 active actors on pipe
2025-09-30T14:54:16.365182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895688129702531:8818]
2025-09-30T14:54:16.365184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895688129702531:8818]
2025-09-30T14:54:16.365187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895688129702531:8818]
2025-09-30T14:54:16.365197Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:16.365212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:16.365220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:16.365224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:16.365226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:16.365226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:16.365229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:16.365266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895688129702531:8818]
2025-09-30T14:54:16.365275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:16.365289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:16.365716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:16.365724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:16.365755Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f41ce8-462f9260-12d123e-1c79b4e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:16.365764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:16.365770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:16.365772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:16.365786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:16.365798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:16.365814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:16.367044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:16.367051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:16.367073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:16.373214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86e94993-c70cd0ab-6032683f-28e764a8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4f41ce8-462f9260-12d123e-1c79b4e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:16.376227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f41ce8-462f9260-12d123e-1c79b4e1_0] Write session: try to update token
2025-09-30T14:54:16.376263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f41ce8-462f9260-12d123e-1c79b4e1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:16.381282Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:16.381301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:16.381310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895688129702531:8818]
2025-09-30T14:54:16.381350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:16.381533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:16.381678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:16.381813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:16.381976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:16.382401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:16.382438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:16.382883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:16.398062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1465 sessionId: src_id|4f41ce8-462f9260-12d123e-1c79b4e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:16.400862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:16.398532Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:16.398554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:16.398556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:16.398559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:16.398568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895688129702531:8818]
2025-09-30T14:54:16.398571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895688129702531:8818]
2025-09-30T14:54:16.398578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895688129702531:8818]
2025-09-30T14:54:16.398617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:16.398623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.398626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:16.398771Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:16.401170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:16.401177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:16.401180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:16.419450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895688219454271:8563]
2025-09-30T14:54:16.420342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1464, pipe: [1:7555895688219454271:8563]
2025-09-30T14:54:16.517589Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:16.518069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:16.518091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:16.518113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895688219454271:8563], now have 1 active actors on pipe
2025-09-30T14:54:16.518532Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:16.518495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:16.519015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f41ce8-462f9260-12d123e-1c79b4e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:16.519049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f41ce8-462f9260-12d123e-1c79b4e1_0] Write session will restart in 0.008725s
2025-09-30T14:54:16.518547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:16.518550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:16.518628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1465 reason: error at write: Disconnected sessionId: src_id|4f41ce8-462f9260-12d123e-1c79b4e1_0
2025-09-30T14:54:16.519087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f41ce8-462f9260-12d123e-1c79b4e1_0] Write session: Do CDS request
2025-09-30T14:54:16.518826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1465 sessionId: src_id|4f41ce8-462f9260-12d123e-1c79b4e1_0 is DEAD
2025-09-30T14:54:16.519094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f41ce8-462f9260-12d123e-1c79b4e1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:16.518965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895688219454271:8563]
2025-09-30T14:54:16.529423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f41ce8-462f9260-12d123e-1c79b4e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:16.530509Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:16.530524Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1466
2025-09-30T14:54:16.531652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1466 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:16.531698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1466 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:16.531704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1466 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:16.531709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:16.532262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1466 sessionId:  describe result for acl check
2025-09-30T14:54:16.532297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:16.532299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:16.532301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:16.532307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895688219454280:8957] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:16.532847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895688219454280:8957] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:16.536572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895688219454280:8957] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:16.540661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895688219454280:8957] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:16.540677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895688219454280:8957] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:16.540681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895688219454280:8957] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:16.540690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1466 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:16.570599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:16.576032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:16.576296Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:16.576310Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:16.576322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:16.576383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:16.576432Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895688129702847:8821]
2025-09-30T14:54:16.577174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:16.577625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:16.577696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:16.578106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:16.578185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:16.578193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:16.578194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:16.578196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:16.578197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:16.578199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:16.578200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:16.578202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:16.578203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:16.578204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:16.578205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.578207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:16.578208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:16.578209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:16.578211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:16.578218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:16.578230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:16.578234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:16.578239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:16.578243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:16.578248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:16.578253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:16.578258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:16.578261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:16.578267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:16.578271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.578275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:16.578280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:16.578285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:16.578289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:16.578298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:16.578307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:16.578314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:16.578320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:16.578325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:16.578332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:16.578337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:16.578343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:16.578348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:16.578354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:16.578359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:16.578375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:16.578380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:16.578386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:16.578392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:16.578396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:16.578402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:16.578408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:16.578413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:16.578419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:16.578425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.578431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.578436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:16.578442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:16.578448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:16.578453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:16.578461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:16.578467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:16.578472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:16.578478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:16.578527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:16.586448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:16.588533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1465
2025-09-30T14:54:16.588566Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1465
2025-09-30T14:54:16.587492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:16.587511Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:16.587514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:16.587518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:16.587525Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1465 [2:7555895688129702847:8821]
2025-09-30T14:54:16.587541Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:16.587560Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:16.587563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:16.587566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:16.587569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:16.587587Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:16.587594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:16.587601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:16.587668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.587671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:16.587673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:16.587677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:16.587680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:16.587751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:16.587755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.587767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:16.587778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:16.587795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:16.587814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895688129702842:8821]
2025-09-30T14:54:16.587816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895688129702842:8821]
2025-09-30T14:54:16.587818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895688129702842:8821]
2025-09-30T14:54:16.587834Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:16.587849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:16.587864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:16.587867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:16.587910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895688129702842:8821]
2025-09-30T14:54:16.587913Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:16.588162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:16.588165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:16.588167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:16.588173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:16.588602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895688219454322:8957], now have 1 active actors on pipe
2025-09-30T14:54:16.588607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895688219454273:2454], now have 1 active actors on pipe
2025-09-30T14:54:16.588776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:16.588782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:16.588811Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|beb0dcfb-5875b8ee-7193a040-6cd8d7ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:16.588820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:16.588824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:16.588827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:16.588838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:16.588849Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:16.588865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:16.590333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:16.590341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:16.590361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:16.590617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1466 partition: 0 MaxSeqNo: 42 sessionId: src_id|beb0dcfb-5875b8ee-7193a040-6cd8d7ce_0
2025-09-30T14:54:16.591049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f41ce8-462f9260-12d123e-1c79b4e1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|beb0dcfb-5875b8ee-7193a040-6cd8d7ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:16.593970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|beb0dcfb-5875b8ee-7193a040-6cd8d7ce_0] Write session: try to update token
2025-09-30T14:54:16.593993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|beb0dcfb-5875b8ee-7193a040-6cd8d7ce_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:16.604574Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:16.604591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:16.604594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:16.604596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:16.604606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895688129702842:8821]
2025-09-30T14:54:16.604610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895688129702842:8821]
2025-09-30T14:54:16.604614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895688129702842:8821]
2025-09-30T14:54:16.604653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:16.604659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.604662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:16.604795Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:16.607748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:16.607762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:16.607767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:16.619141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895688219454586:8563]
2025-09-30T14:54:16.620413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1465, pipe: [1:7555895688219454586:8563]
2025-09-30T14:54:16.620434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1466 sessionId: src_id|beb0dcfb-5875b8ee-7193a040-6cd8d7ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:16.623194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:16.739991Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:16.740328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895688219454586:8563], now have 1 active actors on pipe
2025-09-30T14:54:16.740358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:16.740370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:16.740763Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:16.741278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beb0dcfb-5875b8ee-7193a040-6cd8d7ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:16.741289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beb0dcfb-5875b8ee-7193a040-6cd8d7ce_0] Write session will restart in 0.009273s
2025-09-30T14:54:16.741313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beb0dcfb-5875b8ee-7193a040-6cd8d7ce_0] Write session: Do CDS request
2025-09-30T14:54:16.741318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beb0dcfb-5875b8ee-7193a040-6cd8d7ce_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:16.740873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:16.740884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:16.740944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1466 reason: error at write: Disconnected sessionId: src_id|beb0dcfb-5875b8ee-7193a040-6cd8d7ce_0
2025-09-30T14:54:16.741145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1466 sessionId: src_id|beb0dcfb-5875b8ee-7193a040-6cd8d7ce_0 is DEAD
2025-09-30T14:54:16.741296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895688219454586:8563]
2025-09-30T14:54:16.741318Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:16.757774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|beb0dcfb-5875b8ee-7193a040-6cd8d7ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:16.758383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:16.758398Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1467
2025-09-30T14:54:16.758562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1467 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:16.758606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1467 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:16.758611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1467 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:16.758616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:16.759102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1467 sessionId:  describe result for acl check
2025-09-30T14:54:16.759129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:16.759132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:16.759134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:16.759140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895688219454664:8962] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:16.759735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895688219454664:8962] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:16.762483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895688219454664:8962] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:16.769733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895688219454664:8962] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:16.769748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895688219454664:8962] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:16.769751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895688219454664:8962] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:16.769762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1467 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:16.780732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:16.784308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:16.784503Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:16.784507Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:16.784518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:16.784584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:16.784610Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895688129703149:8824]
2025-09-30T14:54:16.785056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:16.785507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:16.785561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:16.785955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:16.786033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:16.786035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:16.786036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:16.786037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:16.786038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:16.786040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:16.786041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:16.786043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:16.786044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:16.786045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:16.786046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.786047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:16.786049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:16.786050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:16.786052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:16.786059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:16.786070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:16.786075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:16.786079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:16.786083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:16.786088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:16.786092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:16.786096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:16.786100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:16.786105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:16.786108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.786112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:16.786116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:16.786120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:16.786124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:16.786133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:16.786142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:16.786149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:16.786155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:16.786161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:16.786167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:16.786173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:16.786179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:16.786184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:16.786190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:16.786195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:16.786201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:16.786206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:16.786211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:16.786215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:16.786221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:16.786226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:16.786232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:16.786237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:16.786243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:16.786248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.786254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.786259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:16.786265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:16.786270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:16.786277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:16.786282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:16.786287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:16.786292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:16.786300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:16.786351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:16.797174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1466
2025-09-30T14:54:16.797181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1466
2025-09-30T14:54:16.795811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:16.796681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:16.796689Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:16.796692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:16.796696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:16.796704Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1466 [2:7555895688129703149:8824]
2025-09-30T14:54:16.796722Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:16.796738Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:16.796740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:16.796742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:16.796744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:16.796758Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:16.796763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:16.796769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:16.796828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.796831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:16.796834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:16.796838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:16.796840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:16.796899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:16.796901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.796910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:16.796917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:16.796927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:16.796940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895688129703144:8824]
2025-09-30T14:54:16.796943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895688129703144:8824]
2025-09-30T14:54:16.796945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895688129703144:8824]
2025-09-30T14:54:16.796953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:16.796968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:16.796983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:16.796987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:16.797018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:16.797020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895688129703144:8824]
2025-09-30T14:54:16.797022Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:16.797023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:16.797025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:16.797037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:16.797056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895688219454589:2454], now have 1 active actors on pipe
2025-09-30T14:54:16.797060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895688219454796:8962], now have 1 active actors on pipe
2025-09-30T14:54:16.797292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:16.797298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:16.797325Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78e0c094-6f7171b6-2b14dc76-f44bdda6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:16.797334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:16.797339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:16.797342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:16.797354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:16.797365Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:16.797392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:16.799181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:16.799195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:16.799217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:16.799458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1467 partition: 0 MaxSeqNo: 42 sessionId: src_id|78e0c094-6f7171b6-2b14dc76-f44bdda6_0
2025-09-30T14:54:16.799902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beb0dcfb-5875b8ee-7193a040-6cd8d7ce_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|78e0c094-6f7171b6-2b14dc76-f44bdda6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:16.802751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78e0c094-6f7171b6-2b14dc76-f44bdda6_0] Write session: try to update token
2025-09-30T14:54:16.802774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78e0c094-6f7171b6-2b14dc76-f44bdda6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:16.813492Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:16.813510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:16.813513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:16.813515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:16.813524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895688129703144:8824]
2025-09-30T14:54:16.813528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895688129703144:8824]
2025-09-30T14:54:16.813532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895688129703144:8824]
2025-09-30T14:54:16.813574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:16.813571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:16.813581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.813584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:16.813584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:16.813587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:16.813718Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:16.818305Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-09-30T14:54:16.818326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 8
2025-09-30T14:54:16.834847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1467 sessionId: src_id|78e0c094-6f7171b6-2b14dc76-f44bdda6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:16.837576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:16.843580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895688219454901:8563]
2025-09-30T14:54:16.844112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1466, pipe: [1:7555895688219454901:8563]
2025-09-30T14:54:16.934295Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:16.935625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:16.935642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:16.935662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895688219454901:8563], now have 1 active actors on pipe
2025-09-30T14:54:16.935987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:16.936009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 8
2025-09-30T14:54:16.936050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:16.936053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:16.936116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1467 reason: error at write: Disconnected sessionId: src_id|78e0c094-6f7171b6-2b14dc76-f44bdda6_0
2025-09-30T14:54:16.936302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1467 sessionId: src_id|78e0c094-6f7171b6-2b14dc76-f44bdda6_0 is DEAD
2025-09-30T14:54:16.936459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895688219454901:8563]
2025-09-30T14:54:16.936488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78e0c094-6f7171b6-2b14dc76-f44bdda6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:16.936499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78e0c094-6f7171b6-2b14dc76-f44bdda6_0] Write session will restart in 0.009661s
2025-09-30T14:54:16.936533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78e0c094-6f7171b6-2b14dc76-f44bdda6_0] Write session: Do CDS request
2025-09-30T14:54:16.936544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78e0c094-6f7171b6-2b14dc76-f44bdda6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:16.936154Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:16.947894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78e0c094-6f7171b6-2b14dc76-f44bdda6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:16.951625Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:16.951640Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1468
2025-09-30T14:54:16.951858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1468 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:16.951904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1468 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:16.951910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1468 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:16.951914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:16.952838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1468 sessionId:  describe result for acl check
2025-09-30T14:54:16.952870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:16.952875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:16.952876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:16.952882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895688219454958:8966] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:16.953446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895688219454958:8966] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:16.957124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895688219454958:8966] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:16.961246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895688219454958:8966] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:16.961261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895688219454958:8966] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:16.961265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895688219454958:8966] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:16.961274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1468 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:16.973157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:16.976287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:16.976452Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:16.976456Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:16.976466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:16.976509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:16.976537Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895688129703452:8827]
2025-09-30T14:54:16.976995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:16.977271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:16.977302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:16.977561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:16.977613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:16.977614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:16.977615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:16.977616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:16.977616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:16.977617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:16.977618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:16.977618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:16.977619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:16.977620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:16.977621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.977621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:16.977622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:16.977623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:16.977624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:16.977627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:16.977634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:16.977637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:16.977639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:16.977641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:16.977644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:16.977647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:16.977649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:16.977651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:16.977655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:16.977658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.977661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:16.977663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:16.977666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:16.977668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:16.977674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:16.977680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:16.977684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:16.977687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:16.977690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:16.977693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:16.977696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:16.977699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:16.977702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:16.977705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:16.977709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:16.977712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:16.977714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:16.977717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:16.977719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:16.977722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:16.977725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:16.977728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:16.977730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:16.977733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:16.977736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.977739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.977741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:16.977744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:16.977746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:16.977749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:16.977751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:16.977754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:16.977756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:16.977759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:16.977783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:16.984788Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1467
2025-09-30T14:54:16.984835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1467
2025-09-30T14:54:16.983169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:16.984437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:16.984442Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:16.984444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:16.984447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:16.984452Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1467 [2:7555895688129703452:8827]
2025-09-30T14:54:16.984465Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:16.984478Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:16.984481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:16.984483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:16.984484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:16.984496Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:16.984500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:16.984505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:16.984550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.984551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:16.984554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:16.984557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:16.984558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:16.984624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:16.984626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.984637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:16.984648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:16.984664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:16.984682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895688219454903:2454], now have 1 active actors on pipe
2025-09-30T14:54:16.984688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895688129703446:8827]
2025-09-30T14:54:16.984690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895688129703446:8827]
2025-09-30T14:54:16.984692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895688129703446:8827]
2025-09-30T14:54:16.984704Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:16.984713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895688219455052:8966], now have 1 active actors on pipe
2025-09-30T14:54:16.984720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:16.984733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:16.984749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:16.984786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895688129703446:8827]
2025-09-30T14:54:16.984788Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:16.984871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:16.984874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:16.984876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:16.984883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:16.985032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:16.985037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:16.985099Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 85826639 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:54:16.985136Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a99e68d9-16add85c-a6f5d785-789e65a2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:16.985145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:16.985149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:16.985151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:16.985161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:16.985171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:16.985185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:16.986038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:16.986048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:16.986067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:16.986566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78e0c094-6f7171b6-2b14dc76-f44bdda6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a99e68d9-16add85c-a6f5d785-789e65a2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:16.985635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 9 DataSize: 85826639 UsedReserveSize: 0
2025-09-30T14:54:16.985678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:54:16.986178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1468 partition: 0 MaxSeqNo: 42 sessionId: src_id|a99e68d9-16add85c-a6f5d785-789e65a2_0
2025-09-30T14:54:16.989470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a99e68d9-16add85c-a6f5d785-789e65a2_0] Write session: try to update token
2025-09-30T14:54:16.989489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a99e68d9-16add85c-a6f5d785-789e65a2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:16.998371Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:16.998389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:16.998392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:16.998395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:16.998405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895688129703446:8827]
2025-09-30T14:54:16.998409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895688129703446:8827]
2025-09-30T14:54:16.998413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895688129703446:8827]
2025-09-30T14:54:16.998458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:16.998464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:16.998465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:16.998467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:16.998472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:16.998476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:16.998631Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:17.005825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1468 sessionId: src_id|a99e68d9-16add85c-a6f5d785-789e65a2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:17.008859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:17.036510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895692514422512:8563]
2025-09-30T14:54:17.043679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1467, pipe: [1:7555895692514422512:8563]
2025-09-30T14:54:17.109407Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:17.109978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:17.109993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:17.110034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895692514422512:8563], now have 1 active actors on pipe
2025-09-30T14:54:17.110265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:17.110322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895692514422512:8563]
2025-09-30T14:54:17.110340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:17.110343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:17.110415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1468 reason: error at write: Disconnected sessionId: src_id|a99e68d9-16add85c-a6f5d785-789e65a2_0
2025-09-30T14:54:17.110623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1468 sessionId: src_id|a99e68d9-16add85c-a6f5d785-789e65a2_0 is DEAD
2025-09-30T14:54:17.110916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a99e68d9-16add85c-a6f5d785-789e65a2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:17.110923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a99e68d9-16add85c-a6f5d785-789e65a2_0] Write session will restart in 0.008502s
2025-09-30T14:54:17.110946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a99e68d9-16add85c-a6f5d785-789e65a2_0] Write session: Do CDS request
2025-09-30T14:54:17.110952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a99e68d9-16add85c-a6f5d785-789e65a2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:17.111465Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:17.120746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a99e68d9-16add85c-a6f5d785-789e65a2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:17.120855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:17.120878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1469
2025-09-30T14:54:17.121013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1469 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:17.121070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1469 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:17.121081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1469 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:17.121085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:17.121554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1469 sessionId:  describe result for acl check
2025-09-30T14:54:17.121587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:17.121595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:17.121597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:17.121603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895692514422537:8971] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:17.122176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895692514422537:8971] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:17.127066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895692514422537:8971] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:17.133010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895692514422537:8971] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:17.133029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895692514422537:8971] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:17.133033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895692514422537:8971] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:17.133041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1469 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:17.145293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:17.148926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:17.149146Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:17.149157Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:17.149165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:17.149211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:17.149241Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895692424671052:8830]
2025-09-30T14:54:17.149749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:17.150100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:17.150136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:17.150361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:17.150402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:17.150407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:17.150408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:17.150409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:17.150410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:17.150411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:17.150411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:17.150413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:17.150413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:17.150414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:17.150415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.150416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:17.150417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:17.150418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:17.150418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:17.150422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:17.150441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:17.150444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:17.150446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:17.150449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:17.150452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:17.150454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:17.150457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:17.150459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:17.150462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:17.150464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.150466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:17.150469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:17.150471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:17.150473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:17.150479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:17.150484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:17.150488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:17.150492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:17.150495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:17.150498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:17.150501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:17.150505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:17.150508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:17.150511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:17.150514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:17.150518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:17.150520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:17.150524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:17.150526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:17.150529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:17.150532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:17.150536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:17.150538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:17.150542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:17.150544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.150548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.150550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:17.150553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:17.150556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:17.150560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:17.150568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:17.150571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:17.150574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:17.150577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:17.150604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:17.156342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:17.157692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:17.157711Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:17.157714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:17.157718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:17.157724Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1468 [2:7555895692424671052:8830]
2025-09-30T14:54:17.157742Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:17.157758Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:17.157761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:17.157764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:17.157766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:17.157782Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:17.157789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:17.157795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:17.157855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.157858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:17.157860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:17.157863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:17.157881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:17.157960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:17.157962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.157976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:17.157988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:17.158016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:17.158034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895692424671045:8830]
2025-09-30T14:54:17.158036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895692424671045:8830]
2025-09-30T14:54:17.158039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895692424671045:8830]
2025-09-30T14:54:17.158056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:17.158068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:17.158084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:17.158086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:17.158119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:17.158122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895692424671045:8830]
2025-09-30T14:54:17.158123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:17.158125Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:17.158126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:17.158131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:17.158455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1468
2025-09-30T14:54:17.158508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1468
2025-09-30T14:54:17.158507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895692514422521:2454], now have 1 active actors on pipe
2025-09-30T14:54:17.158516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895692514422669:8971], now have 1 active actors on pipe
2025-09-30T14:54:17.158861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:17.158884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:17.158913Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5bc704b-f1d97458-fbb71e41-d11b0e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:17.158923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:17.158935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:17.158937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:17.158949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:17.158961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:17.158977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:17.159204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:17.159215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:17.159235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:17.159372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1469 partition: 0 MaxSeqNo: 42 sessionId: src_id|d5bc704b-f1d97458-fbb71e41-d11b0e2_0
2025-09-30T14:54:17.159826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a99e68d9-16add85c-a6f5d785-789e65a2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d5bc704b-f1d97458-fbb71e41-d11b0e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:17.162627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5bc704b-f1d97458-fbb71e41-d11b0e2_0] Write session: try to update token
2025-09-30T14:54:17.162644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5bc704b-f1d97458-fbb71e41-d11b0e2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:17.171677Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:17.171698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:17.171709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895692424671045:8830]
2025-09-30T14:54:17.171755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:17.171936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:17.172080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:17.172220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:17.172371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:17.172567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:17.172605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:17.172847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:17.191903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1469 sessionId: src_id|d5bc704b-f1d97458-fbb71e41-d11b0e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:17.192599Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:17.192618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:17.192620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:17.192625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:17.192632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895692424671045:8830]
2025-09-30T14:54:17.192636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895692424671045:8830]
2025-09-30T14:54:17.192639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895692424671045:8830]
2025-09-30T14:54:17.192679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:17.192684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.192686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:17.192701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:17.192709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:17.192713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:17.192831Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:17.195025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:17.211288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895692514422836:8563]
2025-09-30T14:54:17.212664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1468, pipe: [1:7555895692514422836:8563]
2025-09-30T14:54:17.322165Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:17.322778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:17.322803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:17.322823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895692514422836:8563], now have 1 active actors on pipe
2025-09-30T14:54:17.323358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895692514422836:8563]
2025-09-30T14:54:17.323387Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:17.323415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:17.323417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:17.323482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1469 reason: error at write: Disconnected sessionId: src_id|d5bc704b-f1d97458-fbb71e41-d11b0e2_0
2025-09-30T14:54:17.323629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1469 sessionId: src_id|d5bc704b-f1d97458-fbb71e41-d11b0e2_0 is DEAD
2025-09-30T14:54:17.323687Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:17.327511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5bc704b-f1d97458-fbb71e41-d11b0e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:17.327531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5bc704b-f1d97458-fbb71e41-d11b0e2_0] Write session will restart in 0.008655s
2025-09-30T14:54:17.327555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5bc704b-f1d97458-fbb71e41-d11b0e2_0] Write session: Do CDS request
2025-09-30T14:54:17.327566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5bc704b-f1d97458-fbb71e41-d11b0e2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:17.337968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5bc704b-f1d97458-fbb71e41-d11b0e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:17.342696Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:17.342713Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1470
2025-09-30T14:54:17.342939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1470 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:17.342977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1470 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:17.342987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1470 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:17.342992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:17.344453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1470 sessionId:  describe result for acl check
2025-09-30T14:54:17.344496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:17.344498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:17.344500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:17.344507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895692514422877:8981] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:17.345047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895692514422877:8981] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:17.367201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895692514422877:8981] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:17.371283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895692514422877:8981] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:17.371298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895692514422877:8981] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:17.371301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895692514422877:8981] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:17.371310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1470 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:17.373567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:17.377480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:17.377698Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:17.377708Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:17.377718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:17.377770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:17.377808Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895692424671393:8839]
2025-09-30T14:54:17.378403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:17.378738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:17.378795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:17.379102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:17.379174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:17.379181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:17.379182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:17.379182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:17.379183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:17.379184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:17.379185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:17.379186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:17.379187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:17.379188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:17.379189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.379190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:17.379191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:17.379192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:17.379193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:17.379198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:17.379207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:17.379211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:17.379214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:17.379217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:17.379221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:17.379224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:17.379227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:17.379230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:17.379233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:17.379237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.379240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:17.379260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:17.379263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:17.379266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:17.379273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:17.379281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:17.379286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:17.379291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:17.379295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:17.379300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:17.379304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:17.379308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:17.379313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:17.379317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:17.379320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:17.379325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:17.379329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:17.379333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:17.379337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:17.379342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:17.379350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:17.379355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:17.379359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:17.379364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:17.379368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.379373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.379377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:17.379382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:17.379387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:17.379391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:17.379395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:17.379399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:17.379404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:17.379409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:17.379446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:17.385103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:17.386283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:17.386304Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:17.386306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:17.386310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:17.386316Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1469 [2:7555895692424671393:8839]
2025-09-30T14:54:17.386330Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:17.386344Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:17.386347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:17.386351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:17.386353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:17.386369Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:17.386385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:17.386392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:17.386437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.386443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:17.386444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:17.386447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:17.386448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:17.386512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:17.386519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.386532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:17.386543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:17.386558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:17.386582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895692514422852:2454], now have 1 active actors on pipe
2025-09-30T14:54:17.386586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895692514423171:8981], now have 1 active actors on pipe
2025-09-30T14:54:17.386592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895692424671372:8839]
2025-09-30T14:54:17.386594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895692424671372:8839]
2025-09-30T14:54:17.386596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895692424671372:8839]
2025-09-30T14:54:17.386604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:17.386614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:17.386618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:17.386619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:17.386621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:17.386632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:17.386635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:17.386596Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1469
2025-09-30T14:54:17.386622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1469
2025-09-30T14:54:17.386669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895692424671372:8839]
2025-09-30T14:54:17.386678Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:17.386697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:17.386703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:17.386705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:17.386742Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37b31509-9a65d880-ccc1edee-773a0d07_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:17.386755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:17.386758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:17.386760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:17.386769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:17.386777Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:17.386793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:17.386978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:17.386996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:17.387017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:17.387097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1470 partition: 0 MaxSeqNo: 42 sessionId: src_id|37b31509-9a65d880-ccc1edee-773a0d07_0
2025-09-30T14:54:17.387457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5bc704b-f1d97458-fbb71e41-d11b0e2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|37b31509-9a65d880-ccc1edee-773a0d07_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:17.390206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37b31509-9a65d880-ccc1edee-773a0d07_0] Write session: try to update token
2025-09-30T14:54:17.390230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37b31509-9a65d880-ccc1edee-773a0d07_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:17.399223Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:17.399289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:17.399291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:17.399293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:17.399303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895692424671372:8839]
2025-09-30T14:54:17.399308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895692424671372:8839]
2025-09-30T14:54:17.399312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895692424671372:8839]
2025-09-30T14:54:17.399361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:17.399374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.399377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:17.399380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:17.399387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:17.399391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:17.399519Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:17.408062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1470 sessionId: src_id|37b31509-9a65d880-ccc1edee-773a0d07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:17.411670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:17.423602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895692514423197:8563]
2025-09-30T14:54:17.424055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1469, pipe: [1:7555895692514423197:8563]
2025-09-30T14:54:17.527638Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:17.528262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:17.528273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:17.528315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895692514423197:8563], now have 1 active actors on pipe
2025-09-30T14:54:17.528941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:17.528962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:17.529064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1470 reason: error at write: Disconnected sessionId: src_id|37b31509-9a65d880-ccc1edee-773a0d07_0
2025-09-30T14:54:17.529221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:17.529277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895692514423197:8563]
2025-09-30T14:54:17.529282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1470 sessionId: src_id|37b31509-9a65d880-ccc1edee-773a0d07_0 is DEAD
2025-09-30T14:54:17.529491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37b31509-9a65d880-ccc1edee-773a0d07_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:17.529505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37b31509-9a65d880-ccc1edee-773a0d07_0] Write session will restart in 0.009915s
2025-09-30T14:54:17.529545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37b31509-9a65d880-ccc1edee-773a0d07_0] Write session: Do CDS request
2025-09-30T14:54:17.529554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37b31509-9a65d880-ccc1edee-773a0d07_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:17.528986Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:17.543871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37b31509-9a65d880-ccc1edee-773a0d07_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:17.544562Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:17.544580Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1471
2025-09-30T14:54:17.544807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1471 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:17.544870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1471 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:17.544877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1471 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:17.544883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:17.545529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1471 sessionId:  describe result for acl check
2025-09-30T14:54:17.545569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:17.545572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:17.545574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:17.545581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895692514423216:8987] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:17.546297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895692514423216:8987] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:17.550353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895692514423216:8987] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:17.559408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895692514423216:8987] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:17.559426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895692514423216:8987] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:17.559430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895692514423216:8987] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:17.559439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1471 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:17.581268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:17.585626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:17.586077Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:17.586084Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:17.586111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:17.586204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:17.586255Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895692424671709:8848]
2025-09-30T14:54:17.587071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:17.588286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:17.588394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:17.588838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:17.588916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:17.588924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:17.588926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:17.588927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:17.588928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:17.588929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:17.588931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:17.588932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:17.588934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:17.588935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:17.588936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.588937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:17.588939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:17.588940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:17.588941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:17.588948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:17.588959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:17.588963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:17.588967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:17.588971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:17.588974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:17.588979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:17.588982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:17.588986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:17.588990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:17.588994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.588998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:17.589002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:17.589006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:17.589010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:17.589020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:17.589029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:17.589035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:17.589041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:17.589045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:17.589050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:17.589054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:17.589060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:17.589065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:17.589071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:17.589077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:17.589083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:17.589088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:17.589093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:17.589097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:17.589103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:17.589108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:17.589114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:17.589118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:17.589124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:17.589130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.589136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.589141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:17.589146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:17.589151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:17.589157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:17.589162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:17.589167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:17.589172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:17.589177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:17.589230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:17.600307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:17.601631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:17.601652Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:17.601655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:17.601659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:17.601667Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1470 [2:7555895692424671709:8848]
2025-09-30T14:54:17.601683Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:17.601701Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:17.601704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:17.601707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:17.601710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:17.601727Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:17.601734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:17.601741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:17.601807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.601809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:17.601811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:17.601814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:17.601817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:17.601936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:17.601940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.601956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:17.601969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:17.601988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:17.602012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895692424671704:8848]
2025-09-30T14:54:17.602015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895692424671704:8848]
2025-09-30T14:54:17.602017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895692424671704:8848]
2025-09-30T14:54:17.602032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:17.602046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:17.602062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:17.602066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:17.602105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895692424671704:8848]
2025-09-30T14:54:17.602108Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:17.602133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:17.602138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:17.602140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:17.602147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:17.602443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895692514423327:8987], now have 1 active actors on pipe
2025-09-30T14:54:17.602455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895692514423199:2454], now have 1 active actors on pipe
2025-09-30T14:54:17.602770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1470
2025-09-30T14:54:17.602806Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1470
2025-09-30T14:54:17.604955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:17.604974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:17.605013Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b8f444-fb345c05-9d911795-c7764f7d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:17.605025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:17.605030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:17.605034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:17.605048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:17.605084Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:17.605105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:17.606897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:17.606916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:17.606945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:17.607208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1471 partition: 0 MaxSeqNo: 42 sessionId: src_id|6b8f444-fb345c05-9d911795-c7764f7d_0
2025-09-30T14:54:17.610547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37b31509-9a65d880-ccc1edee-773a0d07_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6b8f444-fb345c05-9d911795-c7764f7d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:17.613429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b8f444-fb345c05-9d911795-c7764f7d_0] Write session: try to update token
2025-09-30T14:54:17.613455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b8f444-fb345c05-9d911795-c7764f7d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:17.621118Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:17.621140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:17.621143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:17.621146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:17.621155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895692424671704:8848]
2025-09-30T14:54:17.621159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895692424671704:8848]
2025-09-30T14:54:17.621164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895692424671704:8848]
2025-09-30T14:54:17.621208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:17.621215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.621225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:17.621370Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:17.621438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:17.621460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:17.621467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:17.635463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895692514423515:8563]
2025-09-30T14:54:17.636032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1470, pipe: [1:7555895692514423515:8563]
2025-09-30T14:54:17.641974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1471 sessionId: src_id|6b8f444-fb345c05-9d911795-c7764f7d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:17.645344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:17.734953Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:17.735824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895692514423515:8563]
2025-09-30T14:54:17.735877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:17.735881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:17.735966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1471 reason: error at write: Disconnected sessionId: src_id|6b8f444-fb345c05-9d911795-c7764f7d_0
2025-09-30T14:54:17.735441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895692514423515:8563], now have 1 active actors on pipe
2025-09-30T14:54:17.735477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:17.735485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:17.736215Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:17.736293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1471 sessionId: src_id|6b8f444-fb345c05-9d911795-c7764f7d_0 is DEAD
2025-09-30T14:54:17.736323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b8f444-fb345c05-9d911795-c7764f7d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:17.736337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b8f444-fb345c05-9d911795-c7764f7d_0] Write session will restart in 0.005373s
2025-09-30T14:54:17.736363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b8f444-fb345c05-9d911795-c7764f7d_0] Write session: Do CDS request
2025-09-30T14:54:17.736369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b8f444-fb345c05-9d911795-c7764f7d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:17.736556Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:17.742740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b8f444-fb345c05-9d911795-c7764f7d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:17.743579Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:17.743601Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1472
2025-09-30T14:54:17.743887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1472 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:17.743930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1472 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:17.743936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1472 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:17.743942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:17.744582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1472 sessionId:  describe result for acl check
2025-09-30T14:54:17.744629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:17.744634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:17.744637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:17.744644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895692514423530:8992] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:17.745338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895692514423530:8992] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:17.747746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895692514423530:8992] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:17.753038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895692514423530:8992] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:17.753057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895692514423530:8992] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:17.753062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895692514423530:8992] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:17.753072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1472 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:17.778163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:17.786496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:17.786746Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:17.786757Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:17.786770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:17.786833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:17.786877Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895692424672025:8851]
2025-09-30T14:54:17.787567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:17.787873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:17.787938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:17.788324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:17.788384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:17.788392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:17.788394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:17.788395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:17.788396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:17.788397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:17.788399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:17.788400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:17.788401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:17.788402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:17.788404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.788405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:17.788407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:17.788408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:17.788410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:17.788416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:17.788426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:17.788430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:17.788435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:17.788440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:17.788445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:17.788449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:17.788454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:17.788458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:17.788465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:17.788470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.788475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:17.788479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:17.788484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:17.788488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:17.788496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:17.788506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:17.788512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:17.788518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:17.788525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:17.788530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:17.788538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:17.788544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:17.788550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:17.788561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:17.788566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:17.788577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:17.788582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:17.788588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:17.788593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:17.788599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:17.788604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:17.788610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:17.788616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:17.788622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:17.788628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.788633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.788650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:17.788660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:17.788665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:17.788673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:17.788678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:17.788688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:17.788693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:17.788703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:17.788751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:17.797410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:17.798345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:17.798364Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:17.798367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:17.798371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:17.798379Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1471 [2:7555895692424672025:8851]
2025-09-30T14:54:17.798397Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:17.798431Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:17.798439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:17.798443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:17.798446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:17.798463Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:17.798474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:17.798482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:17.798552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.798560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:17.798563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:17.798566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:17.798569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:17.798636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:17.798645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.798659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:17.798674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:17.798696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:17.798721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895692514423520:2454], now have 1 active actors on pipe
2025-09-30T14:54:17.798725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895692514423596:8992], now have 1 active actors on pipe
2025-09-30T14:54:17.798732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895692424672011:8851]
2025-09-30T14:54:17.798734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895692424672011:8851]
2025-09-30T14:54:17.798737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895692424672011:8851]
2025-09-30T14:54:17.798750Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:17.798763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:17.798765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:17.798767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:17.798769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:17.798782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:17.798785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:17.798824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895692424672011:8851]
2025-09-30T14:54:17.798839Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:17.798857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:17.799096Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1471
2025-09-30T14:54:17.799170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1471
2025-09-30T14:54:17.802004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:17.802023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:17.802054Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea08dc79-8b35cf01-21818db1-2fa932d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:17.802065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:17.802070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:17.802073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:17.802086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:17.802107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:17.802130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:17.803504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:17.803521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:17.803542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:17.804086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b8f444-fb345c05-9d911795-c7764f7d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ea08dc79-8b35cf01-21818db1-2fa932d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:17.803687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1472 partition: 0 MaxSeqNo: 42 sessionId: src_id|ea08dc79-8b35cf01-21818db1-2fa932d1_0
2025-09-30T14:54:17.806898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea08dc79-8b35cf01-21818db1-2fa932d1_0] Write session: try to update token
2025-09-30T14:54:17.806915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea08dc79-8b35cf01-21818db1-2fa932d1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:17.817980Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:17.818004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:17.818007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:17.818009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:17.818018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895692424672011:8851]
2025-09-30T14:54:17.818023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895692424672011:8851]
2025-09-30T14:54:17.818028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895692424672011:8851]
2025-09-30T14:54:17.818073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:17.818080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.818083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:17.818143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:17.818156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:17.818160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:17.818219Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:17.829237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1472 sessionId: src_id|ea08dc79-8b35cf01-21818db1-2fa932d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:17.832276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:17.835708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895692514423834:8563]
2025-09-30T14:54:17.836166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1471, pipe: [1:7555895692514423834:8563]
2025-09-30T14:54:17.939125Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:17.939847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:17.939863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:17.939899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895692514423834:8563], now have 1 active actors on pipe
2025-09-30T14:54:17.940189Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:17.940140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:17.940191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895692514423834:8563]
2025-09-30T14:54:17.940213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:17.940216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:17.940273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1472 reason: error at write: Disconnected sessionId: src_id|ea08dc79-8b35cf01-21818db1-2fa932d1_0
2025-09-30T14:54:17.940442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1472 sessionId: src_id|ea08dc79-8b35cf01-21818db1-2fa932d1_0 is DEAD
2025-09-30T14:54:17.941111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea08dc79-8b35cf01-21818db1-2fa932d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:17.941124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea08dc79-8b35cf01-21818db1-2fa932d1_0] Write session will restart in 0.009780s
2025-09-30T14:54:17.941148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea08dc79-8b35cf01-21818db1-2fa932d1_0] Write session: Do CDS request
2025-09-30T14:54:17.941156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea08dc79-8b35cf01-21818db1-2fa932d1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:17.950353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:17.953269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:17.953528Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:17.953540Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:17.953552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:17.953616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:17.953663Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895692424672083:8853]
2025-09-30T14:54:17.954314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:17.954704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:17.954780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:17.954950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea08dc79-8b35cf01-21818db1-2fa932d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:17.955034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:17.955050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1473
2025-09-30T14:54:17.955158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:17.955167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1473 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:17.955210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1473 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:17.955220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1473 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:17.955224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:17.955230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:17.955238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:17.955240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:17.955241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:17.955262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:17.955264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:17.955265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:17.955266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:17.955267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:17.955268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:17.955269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.955271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:17.955271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:17.955272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:17.955274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:17.955279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:17.955289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:17.955293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:17.955297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:17.955301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:17.955305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:17.955309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:17.955312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:17.955316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:17.955320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:17.955325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.955333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:17.955336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:17.955340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:17.955343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:17.955351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:17.955360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:17.955365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:17.955371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:17.955376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:17.955381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:17.955387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:17.955392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:17.955397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:17.955404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:17.955409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:17.955414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:17.955419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:17.955426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:17.955432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:17.955438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:17.955443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:17.955449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:17.955453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:17.955458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:17.955462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.955467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.955471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:17.955476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:17.955480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:17.955485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:17.955488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:17.955494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:17.955498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:17.955509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:17.955559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:17.955724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1473 sessionId:  describe result for acl check
2025-09-30T14:54:17.955760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:17.955762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:17.955766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:17.955772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895692514423862:8996] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:17.956353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895692514423862:8996] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:17.958776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895692514423862:8996] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:17.961560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:17.961601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895692514423862:8996] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:17.961614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895692514423862:8996] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:17.961617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895692514423862:8996] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:17.961626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1473 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:17.962566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:17.962588Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:17.962590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:17.962594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:17.962600Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1472 [2:7555895692424672083:8853]
2025-09-30T14:54:17.962615Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:17.962631Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:17.962634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:17.962637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:17.962640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:17.962654Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:17.962662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:17.962676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:17.962732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.962738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:17.962740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:17.962743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:17.962745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:17.962811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:17.962818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.962830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:17.962844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:17.962864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:17.962885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895692514423836:2454], now have 1 active actors on pipe
2025-09-30T14:54:17.962894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895692514423894:8996], now have 1 active actors on pipe
2025-09-30T14:54:17.962899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895692424672077:8853]
2025-09-30T14:54:17.962901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895692424672077:8853]
2025-09-30T14:54:17.962903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895692424672077:8853]
2025-09-30T14:54:17.962919Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:17.962934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:17.962953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:17.962959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:17.962996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895692424672077:8853]
2025-09-30T14:54:17.963002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:17.963035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:17.963045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:17.962976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1472
2025-09-30T14:54:17.963048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:17.962985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1472
2025-09-30T14:54:17.963055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:17.963149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:17.963159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:17.963185Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35bf474b-f2e8657c-5900ca17-5c2425a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:17.963192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:17.963196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:17.963198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:17.963209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:17.963218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:17.963238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:17.963682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:17.963696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:17.963729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:17.963861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1473 partition: 0 MaxSeqNo: 42 sessionId: src_id|35bf474b-f2e8657c-5900ca17-5c2425a5_0
2025-09-30T14:54:17.964238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea08dc79-8b35cf01-21818db1-2fa932d1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|35bf474b-f2e8657c-5900ca17-5c2425a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:17.967206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35bf474b-f2e8657c-5900ca17-5c2425a5_0] Write session: try to update token
2025-09-30T14:54:17.967226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35bf474b-f2e8657c-5900ca17-5c2425a5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:17.982877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1473 sessionId: src_id|35bf474b-f2e8657c-5900ca17-5c2425a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:17.985682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:17.988281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:17.988309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:17.988332Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:17.988335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:17.988345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895692424672077:8853]
2025-09-30T14:54:17.988403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:17.988433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:17.988599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:17.988773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:17.989110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:17.989269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:17.989481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:17.989525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:17.989564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:17.989662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:17.992276Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:17.992296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:17.992298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:17.992300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:17.992309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895692424672077:8853]
2025-09-30T14:54:17.992313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895692424672077:8853]
2025-09-30T14:54:17.992320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895692424672077:8853]
2025-09-30T14:54:17.992353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:17.992358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:17.992361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:17.992371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:17.992378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:17.992381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:17.992496Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:18.043444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895696809391208:8563]
2025-09-30T14:54:18.043882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1472, pipe: [1:7555895696809391208:8563]
2025-09-30T14:54:18.108879Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:18.117514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:18.117547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:18.117722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:18.117782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:18.117841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:18.117913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:18.118321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:18.118325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:18.118392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:18.118444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:18.118516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:18.118586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:18.118626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:18.118629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:18.118705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:18.118763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:18.118819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:18.118873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:18.118910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:18.118912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:18.118976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:18.119035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:18.119093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:18.119160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:18.119198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:18.119201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:18.119588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:18.119658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:18.119721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:18.119787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:18.119903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:18.119907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:18.119980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:18.120040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:18.120107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:18.120170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:18.120212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:18.120215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:18.120290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:18.120353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:18.120424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:18.120486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:18.120530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:18.120533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:18.120611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:18.120674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:18.120742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:18.120809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:18.120853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:18.120860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:18.120935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:18.120997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:18.121067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:18.121134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:18.121201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:18.121204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:18.121275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:18.121341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:18.121408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:18.121476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:18.121541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:18.121545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:18.121655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895696809391208:8563], now have 1 active actors on pipe
2025-09-30T14:54:18.121994Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:18.123599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895696809391208:8563]
2025-09-30T14:54:18.123640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:18.123686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:18.123735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1473 reason: status is not ok: tablet will be restarted right now sessionId: src_id|35bf474b-f2e8657c-5900ca17-5c2425a5_0
2025-09-30T14:54:18.123918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1473 sessionId: src_id|35bf474b-f2e8657c-5900ca17-5c2425a5_0 is DEAD
2025-09-30T14:54:18.125401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35bf474b-f2e8657c-5900ca17-5c2425a5_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 161 BytesWritten: 94617674 MessagesWritten: 42 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 13516812 MessagesInflight: 10 }
2025-09-30T14:54:18.125436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35bf474b-f2e8657c-5900ca17-5c2425a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:18.125441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35bf474b-f2e8657c-5900ca17-5c2425a5_0] Write session will restart in 0.008806s
2025-09-30T14:54:18.125467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35bf474b-f2e8657c-5900ca17-5c2425a5_0] Write session: Do CDS request
2025-09-30T14:54:18.125474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35bf474b-f2e8657c-5900ca17-5c2425a5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:18.135765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35bf474b-f2e8657c-5900ca17-5c2425a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:18.139487Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:18.139504Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1474
2025-09-30T14:54:18.139749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1474 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:18.139789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1474 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:18.139800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1474 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:18.139805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:18.140309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1474 sessionId:  describe result for acl check
2025-09-30T14:54:18.140352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:18.140358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:18.140361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:18.140367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895696809391227:9009] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:18.140947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895696809391227:9009] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:18.149531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895696809391227:9009] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:18.152527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:18.156185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895696809391227:9009] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:18.156208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895696809391227:9009] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:18.156211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895696809391227:9009] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:18.156220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1474 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:18.156984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:18.157285Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:18.157290Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:18.157304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:18.157384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:18.157428Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895696719639439:8855]
2025-09-30T14:54:18.158115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:18.158727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:18.158781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:18.159149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:18.159219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:18.159221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:18.159222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:18.159223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:18.159225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:18.159226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:18.159227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:18.159229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:18.159230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:18.159232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:18.159235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.159236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:18.159237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:18.159239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:18.159240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:18.159259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:18.159270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:18.159277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:18.159282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:18.159286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:18.159290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:18.159294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:18.159298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:18.159302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:18.159306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:18.159310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.159314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:18.159319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:18.159322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:18.159325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:18.159333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:18.159340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:18.159346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:18.159351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:18.159356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:18.159361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:18.159365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:18.159369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:18.159375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:18.159380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:18.159384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:18.159389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:18.159394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:18.159399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:18.159403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:18.159408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:18.159413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:18.159418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:18.159425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:18.159430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:18.159437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.159441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.159446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:18.159450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:18.159455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:18.159460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:18.159463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:18.159467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:18.159471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:18.159475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:18.159518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:18.171112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:18.172102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:18.172121Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:18.172124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:18.172128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:18.172135Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1473 [2:7555895696719639439:8855]
2025-09-30T14:54:18.172153Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:18.172171Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:18.172174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:18.172181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:18.172185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:18.172201Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:18.172208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:18.172215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:18.172290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.172292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:18.172293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:18.172296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:18.172298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:18.172380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:18.172383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.172399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:18.172410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:18.172427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:18.172446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895696719639432:8855]
2025-09-30T14:54:18.172448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895696719639432:8855]
2025-09-30T14:54:18.172449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895696719639432:8855]
2025-09-30T14:54:18.172459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:18.172473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:18.172472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:18.172484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:18.172486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:18.172486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:18.172489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:18.172499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895696809391276:9009], now have 1 active actors on pipe
2025-09-30T14:54:18.172502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895696809391217:2454], now have 1 active actors on pipe
2025-09-30T14:54:18.172539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895696719639432:8855]
2025-09-30T14:54:18.172554Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:18.172828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:18.175348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1473
2025-09-30T14:54:18.175386Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1473
2025-09-30T14:54:18.175507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:18.175531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:18.175570Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c7aa7161-6f181208-6562eb9c-8434d117_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:18.175581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:18.175585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:18.175588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:18.175604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:18.175618Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:18.175643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:18.182255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:18.182282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:18.182321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:18.187440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1474 partition: 0 MaxSeqNo: 42 sessionId: src_id|c7aa7161-6f181208-6562eb9c-8434d117_0
2025-09-30T14:54:18.187825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35bf474b-f2e8657c-5900ca17-5c2425a5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c7aa7161-6f181208-6562eb9c-8434d117_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:18.190696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7aa7161-6f181208-6562eb9c-8434d117_0] Write session: try to update token
2025-09-30T14:54:18.190721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7aa7161-6f181208-6562eb9c-8434d117_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:18.192407Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:18.192431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:18.192434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:18.192436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:18.192446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895696719639432:8855]
2025-09-30T14:54:18.192452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895696719639432:8855]
2025-09-30T14:54:18.192458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895696719639432:8855]
2025-09-30T14:54:18.192505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:18.192512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.192515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:18.192667Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:18.195351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:18.195362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:18.195367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:18.224159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895696809391288:8563]
2025-09-30T14:54:18.224633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1473, pipe: [1:7555895696809391288:8563]
2025-09-30T14:54:18.224650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1474 sessionId: src_id|c7aa7161-6f181208-6562eb9c-8434d117_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:18.227622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:18.316656Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:18.317025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895696809391288:8563], now have 1 active actors on pipe
2025-09-30T14:54:18.317055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:18.317061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:18.317557Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:18.318101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7aa7161-6f181208-6562eb9c-8434d117_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:18.318130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7aa7161-6f181208-6562eb9c-8434d117_0] Write session will restart in 0.007790s
2025-09-30T14:54:18.318154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7aa7161-6f181208-6562eb9c-8434d117_0] Write session: Do CDS request
2025-09-30T14:54:18.318160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7aa7161-6f181208-6562eb9c-8434d117_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:18.317664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895696809391288:8563]
2025-09-30T14:54:18.317699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:18.317702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:18.317764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1474 reason: error at write: Disconnected sessionId: src_id|c7aa7161-6f181208-6562eb9c-8434d117_0
2025-09-30T14:54:18.317970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1474 sessionId: src_id|c7aa7161-6f181208-6562eb9c-8434d117_0 is DEAD
2025-09-30T14:54:18.318136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:18.326810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7aa7161-6f181208-6562eb9c-8434d117_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:18.327598Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:18.327614Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1475
2025-09-30T14:54:18.327739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1475 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:18.327768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1475 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:18.327774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1475 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:18.327779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:18.328231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1475 sessionId:  describe result for acl check
2025-09-30T14:54:18.328258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:18.328261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:18.328263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:18.328269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895696809391304:9013] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:18.328837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895696809391304:9013] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:18.330915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895696809391304:9013] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:18.333028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:18.335629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895696809391304:9013] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:18.335650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895696809391304:9013] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:18.335665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895696809391304:9013] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:18.335675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1475 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:18.335886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:18.336128Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:18.336141Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:18.336154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:18.336239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:18.336279Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895696719639501:8858]
2025-09-30T14:54:18.336961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:18.337381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:18.337436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:18.337778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:18.337843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:18.337849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:18.337851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:18.337852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:18.337853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:18.337855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:18.337856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:18.337858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:18.337859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:18.337870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:18.337872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.337873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:18.337874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:18.337876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:18.337877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:18.337883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:18.337894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:18.337898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:18.337903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:18.337907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:18.337911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:18.337915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:18.337920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:18.337925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:18.337930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:18.337934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.337938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:18.337943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:18.337947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:18.337951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:18.337961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:18.337969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:18.337975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:18.337981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:18.337986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:18.337992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:18.337997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:18.338002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:18.338008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:18.338013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:18.338018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:18.338022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:18.338027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:18.338031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:18.338044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:18.338049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:18.338054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:18.338064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:18.338069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:18.338074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:18.338080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.338086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.338092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:18.338097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:18.338103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:18.338108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:18.338113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:18.338119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:18.338124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:18.338130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:18.338176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:18.343979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:18.345086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:18.345102Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:18.345106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:18.345109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:18.345116Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1474 [2:7555895696719639501:8858]
2025-09-30T14:54:18.345133Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:18.345149Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:18.345157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:18.345161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:18.345164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:18.345179Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:18.345190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:18.345197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:18.345254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.345262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:18.345264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:18.345267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:18.345270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:18.345338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:18.345347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.345360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:18.345372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:18.345389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:18.345411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895696719639495:8858]
2025-09-30T14:54:18.345414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895696719639495:8858]
2025-09-30T14:54:18.345416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895696719639495:8858]
2025-09-30T14:54:18.345429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:18.345442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:18.345460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:18.345467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:18.345507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:18.345510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895696719639495:8858]
2025-09-30T14:54:18.345512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:18.345517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:18.345519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:18.345520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895696809391347:9013], now have 1 active actors on pipe
2025-09-30T14:54:18.345526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:18.345596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1474
2025-09-30T14:54:18.345693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895696809391291:2454], now have 1 active actors on pipe
2025-09-30T14:54:18.345712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:18.345718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:18.345745Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2411c219-4b745774-5a17e67d-1162a930_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:18.345757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:18.345760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:18.345762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:18.345772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:18.345783Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:18.345797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:18.345910Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1474
2025-09-30T14:54:18.346040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:18.346056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:18.346080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:18.346220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1475 partition: 0 MaxSeqNo: 42 sessionId: src_id|2411c219-4b745774-5a17e67d-1162a930_0
2025-09-30T14:54:18.346604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7aa7161-6f181208-6562eb9c-8434d117_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2411c219-4b745774-5a17e67d-1162a930_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:18.349416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2411c219-4b745774-5a17e67d-1162a930_0] Write session: try to update token
2025-09-30T14:54:18.349439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2411c219-4b745774-5a17e67d-1162a930_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:18.358518Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:18.358543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:18.358552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895696719639495:8858]
2025-09-30T14:54:18.358602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:18.358624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:18.358780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:18.358932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:18.359072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:18.359265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:18.359580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:18.359621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:18.368933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1475 sessionId: src_id|2411c219-4b745774-5a17e67d-1162a930_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:18.370205Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:18.370231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:18.370234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:18.370237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:18.370251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895696719639495:8858]
2025-09-30T14:54:18.370255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895696719639495:8858]
2025-09-30T14:54:18.370259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895696719639495:8858]
2025-09-30T14:54:18.370300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:18.370302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:18.370306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:18.370311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:18.370310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.370316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:18.370459Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:18.371739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:18.419879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895696809391382:8563]
2025-09-30T14:54:18.420319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1474, pipe: [1:7555895696809391382:8563]
2025-09-30T14:54:18.492478Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:18.492802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:18.492811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:18.492832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895696809391382:8563], now have 1 active actors on pipe
2025-09-30T14:54:18.493133Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:18.496609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2411c219-4b745774-5a17e67d-1162a930_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:18.496626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2411c219-4b745774-5a17e67d-1162a930_0] Write session will restart in 0.009722s
2025-09-30T14:54:18.496670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2411c219-4b745774-5a17e67d-1162a930_0] Write session: Do CDS request
2025-09-30T14:54:18.496677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2411c219-4b745774-5a17e67d-1162a930_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:18.495699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:18.495747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:18.496230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1475 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2411c219-4b745774-5a17e67d-1162a930_0
2025-09-30T14:54:18.496401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1475 sessionId: src_id|2411c219-4b745774-5a17e67d-1162a930_0 is DEAD
2025-09-30T14:54:18.496539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895696809391382:8563]
2025-09-30T14:54:18.507899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2411c219-4b745774-5a17e67d-1162a930_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:18.508288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:18.508308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1476
2025-09-30T14:54:18.508494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1476 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:18.508526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1476 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:18.508532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1476 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:18.508536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:18.509016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1476 sessionId:  describe result for acl check
2025-09-30T14:54:18.509055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:18.509058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:18.509061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:18.509069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895696809391407:9025] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:18.509697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895696809391407:9025] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:18.514603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:18.511999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895696809391407:9025] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:18.517750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:18.518009Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:18.518025Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:18.518040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:18.518040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895696809391407:9025] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:18.518057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895696809391407:9025] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:18.518061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895696809391407:9025] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:18.518070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1476 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:18.518129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:18.518182Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895696719639608:8873]
2025-09-30T14:54:18.518861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:18.519352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:18.519430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:18.519850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:18.519932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:18.519939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:18.519941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:18.519942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:18.519943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:18.519944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:18.519946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:18.519947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:18.519949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:18.519950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:18.519952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.519953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:18.519955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:18.519956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:18.519958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:18.519964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:18.519976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:18.519981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:18.519984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:18.519989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:18.519993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:18.519998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:18.520002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:18.520007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:18.520011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:18.520015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.520020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:18.520024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:18.520029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:18.520033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:18.520042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:18.520049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:18.520056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:18.520062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:18.520066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:18.520072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:18.520083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:18.520089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:18.520094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:18.520099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:18.520104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:18.520110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:18.520114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:18.520122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:18.520127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:18.520132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:18.520138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:18.520144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:18.520150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:18.520155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:18.520160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.520165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.520170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:18.520175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:18.520180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:18.520186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:18.520193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:18.520201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:18.520205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:18.520209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:18.520261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:18.526774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:18.527822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:18.527827Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:18.527829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:18.527832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:18.527838Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1475 [2:7555895696719639608:8873]
2025-09-30T14:54:18.527854Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:18.527868Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:18.527870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:18.527874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:18.528203Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1475
2025-09-30T14:54:18.528207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1475
2025-09-30T14:54:18.527875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:18.527887Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:18.527892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:18.527898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:18.527944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.527946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:18.527947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:18.527951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:18.527952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:18.528024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:18.528026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.528039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:18.528049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:18.528065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:18.528083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895696809391451:9025], now have 1 active actors on pipe
2025-09-30T14:54:18.528088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895696809391394:2454], now have 1 active actors on pipe
2025-09-30T14:54:18.528094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895696719639603:8873]
2025-09-30T14:54:18.528096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895696719639603:8873]
2025-09-30T14:54:18.528097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895696719639603:8873]
2025-09-30T14:54:18.528105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:18.528117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:18.528125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:18.528127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:18.528130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:18.528131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:18.528134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:18.528167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895696719639603:8873]
2025-09-30T14:54:18.528177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:18.528181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:18.528492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:18.528498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:18.528526Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b67fd42-72eecb06-4e5b4c16-fc974a87_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:18.528536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:18.528539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:18.528542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:18.528552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:18.528562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:18.528583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:18.529003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:18.529193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1476 partition: 0 MaxSeqNo: 42 sessionId: src_id|5b67fd42-72eecb06-4e5b4c16-fc974a87_0
2025-09-30T14:54:18.529018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:18.529041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:18.529659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2411c219-4b745774-5a17e67d-1162a930_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5b67fd42-72eecb06-4e5b4c16-fc974a87_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:18.532641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b67fd42-72eecb06-4e5b4c16-fc974a87_0] Write session: try to update token
2025-09-30T14:54:18.532666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b67fd42-72eecb06-4e5b4c16-fc974a87_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:18.546798Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:18.546820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:18.546826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:18.546828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:18.546839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895696719639603:8873]
2025-09-30T14:54:18.546844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895696719639603:8873]
2025-09-30T14:54:18.546849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895696719639603:8873]
2025-09-30T14:54:18.546892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:18.546893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:18.546897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:18.546900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.546901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:18.546903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:18.547048Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:18.551084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1476 sessionId: src_id|5b67fd42-72eecb06-4e5b4c16-fc974a87_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:18.554014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:18.596516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895696809391465:8563]
2025-09-30T14:54:18.596962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1475, pipe: [1:7555895696809391465:8563]
2025-09-30T14:54:18.662899Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:18.663220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:18.663229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:18.663289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895696809391465:8563], now have 1 active actors on pipe
2025-09-30T14:54:18.663697Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:18.664605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:18.664615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:18.664641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895696809391465:8563]
2025-09-30T14:54:18.664661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:18.664663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1476 reason: error at write: Disconnected sessionId: src_id|5b67fd42-72eecb06-4e5b4c16-fc974a87_0
2025-09-30T14:54:18.664817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1476 sessionId: src_id|5b67fd42-72eecb06-4e5b4c16-fc974a87_0 is DEAD
2025-09-30T14:54:18.667498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b67fd42-72eecb06-4e5b4c16-fc974a87_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:18.667512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b67fd42-72eecb06-4e5b4c16-fc974a87_0] Write session will restart in 0.006916s
2025-09-30T14:54:18.667538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b67fd42-72eecb06-4e5b4c16-fc974a87_0] Write session: Do CDS request
2025-09-30T14:54:18.667544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b67fd42-72eecb06-4e5b4c16-fc974a87_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:18.675739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b67fd42-72eecb06-4e5b4c16-fc974a87_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:18.676145Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:18.676158Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1477
2025-09-30T14:54:18.676362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1477 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:18.676392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1477 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:18.676397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1477 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:18.676401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:18.676806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1477 sessionId:  describe result for acl check
2025-09-30T14:54:18.676832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:18.676834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:18.676836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:18.676842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895696809391483:9030] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:18.677343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895696809391483:9030] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:18.682395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895696809391483:9030] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:18.684582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:18.688890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:18.689107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895696809391483:9030] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:18.689125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895696809391483:9030] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:18.689131Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:18.689146Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:18.689129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895696809391483:9030] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:18.689159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:18.689146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1477 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:18.689225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:18.689271Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895696719639669:8875]
2025-09-30T14:54:18.689939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:18.690354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:18.690425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:18.690849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:18.690923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:18.690931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:18.690933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:18.690934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:18.690935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:18.690937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:18.690938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:18.690940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:18.690941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:18.690942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:18.690943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.690945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:18.690946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:18.690947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:18.690949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:18.690955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:18.690965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:18.690969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:18.690973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:18.690977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:18.690981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:18.690985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:18.690989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:18.690993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:18.690998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:18.691001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.691005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:18.691008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:18.691012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:18.691016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:18.691024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:18.691033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:18.691039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:18.691045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:18.691050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:18.691056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:18.691062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:18.691067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:18.691072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:18.691078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:18.691083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:18.691089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:18.691095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:18.691101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:18.691106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:18.691111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:18.691117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:18.691122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:18.691127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:18.691132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:18.691137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.691145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.691150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:18.691155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:18.691161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:18.691166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:18.691171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:18.691177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:18.691182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:18.691188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:18.691230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:18.697472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:18.698372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:18.698390Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:18.698394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:18.698398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:18.698407Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1476 [2:7555895696719639669:8875]
2025-09-30T14:54:18.698423Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:18.698440Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:18.698443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:18.698446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:18.698449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:18.698465Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:18.698481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:18.698489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:18.698555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.698558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:18.698560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:18.698564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:18.698566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:18.698642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:18.698644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.698658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:18.698672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:18.698691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:18.698709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895696719639664:8875]
2025-09-30T14:54:18.698711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895696719639664:8875]
2025-09-30T14:54:18.698714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895696719639664:8875]
2025-09-30T14:54:18.698722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:18.698735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:18.698742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:18.698745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:18.698748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:18.698751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:18.698753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:18.698765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895696809391467:2454], now have 1 active actors on pipe
2025-09-30T14:54:18.698798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895696809391526:9030], now have 1 active actors on pipe
2025-09-30T14:54:18.698801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895696719639664:8875]
2025-09-30T14:54:18.698810Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:18.698835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:18.699185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1476
2025-09-30T14:54:18.699233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1476
2025-09-30T14:54:18.699474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:18.699483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:18.699510Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|659cd05b-7c5f657e-f777d90a-6f6429ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:18.699520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:18.699523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:18.699525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:18.699544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:18.699554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:18.699569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:18.703672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:18.703696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:18.703729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:18.707352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1477 partition: 0 MaxSeqNo: 42 sessionId: src_id|659cd05b-7c5f657e-f777d90a-6f6429ab_0
2025-09-30T14:54:18.707767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b67fd42-72eecb06-4e5b4c16-fc974a87_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|659cd05b-7c5f657e-f777d90a-6f6429ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:18.710818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|659cd05b-7c5f657e-f777d90a-6f6429ab_0] Write session: try to update token
2025-09-30T14:54:18.710840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|659cd05b-7c5f657e-f777d90a-6f6429ab_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:18.720820Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:18.720845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:18.720858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895696719639664:8875]
2025-09-30T14:54:18.720909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:18.721117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:18.721270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:18.721419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:18.721559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:18.721757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:18.721795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:18.722645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:18.740335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1477 sessionId: src_id|659cd05b-7c5f657e-f777d90a-6f6429ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:18.743175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:18.742309Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:18.742332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:18.742335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:18.742338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:18.742348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895696719639664:8875]
2025-09-30T14:54:18.742352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895696719639664:8875]
2025-09-30T14:54:18.742357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895696719639664:8875]
2025-09-30T14:54:18.742400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:18.742406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.742409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:18.742555Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:18.743360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:18.743365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:18.743368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:18.767386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895696809391537:8563]
2025-09-30T14:54:18.767834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1476, pipe: [1:7555895696809391537:8563]
2025-09-30T14:54:18.864328Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:18.864786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:18.864801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:18.864822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895696809391537:8563], now have 1 active actors on pipe
2025-09-30T14:54:18.865191Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:18.867065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|659cd05b-7c5f657e-f777d90a-6f6429ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:18.867077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|659cd05b-7c5f657e-f777d90a-6f6429ab_0] Write session will restart in 0.009051s
2025-09-30T14:54:18.867101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|659cd05b-7c5f657e-f777d90a-6f6429ab_0] Write session: Do CDS request
2025-09-30T14:54:18.867106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|659cd05b-7c5f657e-f777d90a-6f6429ab_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:18.865167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:18.865243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895696809391537:8563]
2025-09-30T14:54:18.865264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:18.865267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:18.865330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1477 reason: error at write: Disconnected sessionId: src_id|659cd05b-7c5f657e-f777d90a-6f6429ab_0
2025-09-30T14:54:18.865510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1477 sessionId: src_id|659cd05b-7c5f657e-f777d90a-6f6429ab_0 is DEAD
2025-09-30T14:54:18.877707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|659cd05b-7c5f657e-f777d90a-6f6429ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:18.883417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:18.883435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1478
2025-09-30T14:54:18.883603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1478 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:18.883662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1478 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:18.883672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1478 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:18.883676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:18.884144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1478 sessionId:  describe result for acl check
2025-09-30T14:54:18.884176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:18.884178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:18.884179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:18.884184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895696809391554:9034] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:18.884731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895696809391554:9034] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:18.886719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895696809391554:9034] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:18.887622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:18.889855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895696809391554:9034] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:18.889886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895696809391554:9034] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:18.889890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895696809391554:9034] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:18.889899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1478 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:18.889740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:18.890018Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:18.890022Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:18.890035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:18.890098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:18.890133Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895696719639733:8878]
2025-09-30T14:54:18.890781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:18.891042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:18.891102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:18.891519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:18.891591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:18.891593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:18.891594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:18.891595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:18.891597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:18.891599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:18.891600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:18.891601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:18.891602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:18.891604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:18.891605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.891606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:18.891608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:18.891609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:18.891610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:18.891616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:18.891628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:18.891632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:18.891636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:18.891640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:18.891644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:18.891649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:18.891653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:18.891656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:18.891662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:18.891666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.891670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:18.891674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:18.891678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:18.891682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:18.891690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:18.891699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:18.891705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:18.891710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:18.891715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:18.891720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:18.891724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:18.891729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:18.891734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:18.891739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:18.891743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:18.891749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:18.891755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:18.891760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:18.891765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:18.891770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:18.891775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:18.891780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:18.891784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:18.891789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:18.891794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.891800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.891804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:18.891809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:18.891813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:18.891818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:18.891824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:18.891829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:18.891833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:18.891838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:18.891888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:18.901242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1477
2025-09-30T14:54:18.901250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1477
2025-09-30T14:54:18.899913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:18.900787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:18.900794Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:18.900797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:18.900803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:18.900811Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1477 [2:7555895696719639733:8878]
2025-09-30T14:54:18.900827Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:18.900843Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:18.900847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:18.900850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:18.900853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:18.900869Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:18.900876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:18.900884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:18.900942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.900945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:18.900947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:18.900950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:18.900953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:18.901025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:18.901030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.901043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:18.901055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:18.901074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:18.901090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895696719639728:8878]
2025-09-30T14:54:18.901095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895696719639728:8878]
2025-09-30T14:54:18.901099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895696719639728:8878]
2025-09-30T14:54:18.901106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:18.901118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:18.901119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:18.901122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:18.901124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:18.901134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:18.901136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:18.901147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895696809391605:9034], now have 1 active actors on pipe
2025-09-30T14:54:18.901151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895696809391540:2454], now have 1 active actors on pipe
2025-09-30T14:54:18.901183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895696719639728:8878]
2025-09-30T14:54:18.901191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:18.901217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:18.901638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:18.901654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:18.901681Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dabd7f57-47473fc5-248bc898-989a1406_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:18.901694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:18.901703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:18.901705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:18.901717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:18.901734Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:18.901754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:18.902916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:18.902929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:18.902953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:18.904933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1478 partition: 0 MaxSeqNo: 42 sessionId: src_id|dabd7f57-47473fc5-248bc898-989a1406_0
2025-09-30T14:54:18.907352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|659cd05b-7c5f657e-f777d90a-6f6429ab_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dabd7f57-47473fc5-248bc898-989a1406_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:18.910202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dabd7f57-47473fc5-248bc898-989a1406_0] Write session: try to update token
2025-09-30T14:54:18.910223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dabd7f57-47473fc5-248bc898-989a1406_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:18.914594Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:18.914614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:18.914617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:18.914619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:18.914629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895696719639728:8878]
2025-09-30T14:54:18.914634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895696719639728:8878]
2025-09-30T14:54:18.914642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895696719639728:8878]
2025-09-30T14:54:18.914685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:18.914688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:18.914692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:18.914695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:18.914695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:18.914699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:18.914835Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:18.939817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1478 sessionId: src_id|dabd7f57-47473fc5-248bc898-989a1406_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:18.942587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:18.964165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895696809391619:8563]
2025-09-30T14:54:18.964501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1477, pipe: [1:7555895696809391619:8563]
2025-09-30T14:54:19.040482Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:19.040887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:19.040901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:19.040922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895696809391619:8563], now have 1 active actors on pipe
2025-09-30T14:54:19.041215Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:19.041707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dabd7f57-47473fc5-248bc898-989a1406_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:19.041718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dabd7f57-47473fc5-248bc898-989a1406_0] Write session will restart in 0.008163s
2025-09-30T14:54:19.041742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dabd7f57-47473fc5-248bc898-989a1406_0] Write session: Do CDS request
2025-09-30T14:54:19.041748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dabd7f57-47473fc5-248bc898-989a1406_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:19.041221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895696809391619:8563]
2025-09-30T14:54:19.041257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:19.041260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:19.041347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1478 reason: error at write: Disconnected sessionId: src_id|dabd7f57-47473fc5-248bc898-989a1406_0
2025-09-30T14:54:19.041557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1478 sessionId: src_id|dabd7f57-47473fc5-248bc898-989a1406_0 is DEAD
2025-09-30T14:54:19.041719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:19.050871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dabd7f57-47473fc5-248bc898-989a1406_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:19.053827Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:19.053854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1479
2025-09-30T14:54:19.059395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1479 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:19.059456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1479 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:19.059467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1479 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:19.059472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:19.059947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1479 sessionId:  describe result for acl check
2025-09-30T14:54:19.059978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:19.059984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:19.059986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:19.059992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895701104358943:9038] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:19.060196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:19.060536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895701104358943:9038] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:19.063112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895701104358943:9038] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:19.065757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:19.065980Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:19.065992Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:19.066003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:19.066059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:19.066102Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895701014607092:8880]
2025-09-30T14:54:19.066105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895701104358943:9038] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:19.066120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895701104358943:9038] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:19.066123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895701104358943:9038] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:19.066132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1479 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:19.066690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:19.066975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:19.067019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:19.067319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:19.067389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:19.067396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:19.067398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:19.067399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:19.067400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:19.067401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:19.067402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:19.067406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:19.067407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:19.067408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:19.067409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.067410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.067411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.067413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:19.067414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:19.067419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:19.067430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:19.067435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:19.067439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:19.067443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:19.067447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:19.067451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:19.067455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:19.067459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:19.067464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:19.067468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.067472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.067475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.067479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:19.067483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:19.067491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:19.067500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:19.067507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:19.067512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:19.067517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:19.067522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:19.067526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:19.067532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:19.067537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:19.067542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:19.067546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:19.067551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:19.067556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:19.067562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:19.067573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:19.067579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:19.067583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:19.067588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:19.067593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:19.067598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:19.067603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.067608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.067612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.067618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.067622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.067627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.067631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:19.067636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:19.067640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:19.067645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:19.067689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:19.073386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:19.074453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:19.074467Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:19.074470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:19.074474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:19.074481Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1478 [2:7555895701014607092:8880]
2025-09-30T14:54:19.074498Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:19.074519Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:19.074522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:19.074525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:19.074527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:19.074543Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:19.074557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:19.074564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:19.074624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.074631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.074633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.074636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:19.074639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:19.074701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:19.074714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.074727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.074738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.074753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:19.074769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895701014607087:8880]
2025-09-30T14:54:19.074771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895701014607087:8880]
2025-09-30T14:54:19.074773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895701014607087:8880]
2025-09-30T14:54:19.074780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:19.074799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:19.074802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:19.074807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:19.074809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:19.074821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:19.074824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:19.074863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895701104358916:2454], now have 1 active actors on pipe
2025-09-30T14:54:19.074872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895701104358978:9038], now have 1 active actors on pipe
2025-09-30T14:54:19.074876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895701014607087:8880]
2025-09-30T14:54:19.074884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:19.074918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:19.074919Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1478
2025-09-30T14:54:19.074922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1478
2025-09-30T14:54:19.075170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:19.075183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:19.075210Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|961c359a-78e78b5f-b3914538-26b34bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:19.075224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:19.075227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:19.075229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:19.075240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:19.075292Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:19.075312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:19.075500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:19.075514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:19.075528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:19.075656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1479 partition: 0 MaxSeqNo: 42 sessionId: src_id|961c359a-78e78b5f-b3914538-26b34bb_0
2025-09-30T14:54:19.076045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dabd7f57-47473fc5-248bc898-989a1406_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|961c359a-78e78b5f-b3914538-26b34bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:19.078860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|961c359a-78e78b5f-b3914538-26b34bb_0] Write session: try to update token
2025-09-30T14:54:19.078880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|961c359a-78e78b5f-b3914538-26b34bb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:19.091408Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:19.091428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:19.091430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:19.091432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:19.091444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895701014607087:8880]
2025-09-30T14:54:19.091447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895701014607087:8880]
2025-09-30T14:54:19.091452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895701014607087:8880]
2025-09-30T14:54:19.091593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:19.091603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:19.091607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:19.091834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:19.091847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.091852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:19.092001Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:19.097190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1479 sessionId: src_id|961c359a-78e78b5f-b3914538-26b34bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:19.100154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:19.141337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895701104358994:8563]
2025-09-30T14:54:19.141607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1478, pipe: [1:7555895701104358994:8563]
2025-09-30T14:54:19.218215Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:19.218576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:19.218592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:19.218637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895701104358994:8563], now have 1 active actors on pipe
2025-09-30T14:54:19.219265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:19.219321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:19.219330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:19.219393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1479 reason: error at write: Disconnected sessionId: src_id|961c359a-78e78b5f-b3914538-26b34bb_0
2025-09-30T14:54:19.219147Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:19.219897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|961c359a-78e78b5f-b3914538-26b34bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:19.219584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1479 sessionId: src_id|961c359a-78e78b5f-b3914538-26b34bb_0 is DEAD
2025-09-30T14:54:19.219913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|961c359a-78e78b5f-b3914538-26b34bb_0] Write session will restart in 0.005367s
2025-09-30T14:54:19.219662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895701104358994:8563]
2025-09-30T14:54:19.219943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|961c359a-78e78b5f-b3914538-26b34bb_0] Write session: Do CDS request
2025-09-30T14:54:19.219955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|961c359a-78e78b5f-b3914538-26b34bb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:19.227157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|961c359a-78e78b5f-b3914538-26b34bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:19.227232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:19.227259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1480
2025-09-30T14:54:19.227385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1480 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:19.227416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1480 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:19.227426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1480 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:19.227430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:19.227931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1480 sessionId:  describe result for acl check
2025-09-30T14:54:19.227968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:19.227974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:19.227981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:19.227987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895701104359009:9043] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:19.228581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895701104359009:9043] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:19.231437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895701104359009:9043] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:19.234812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895701104359009:9043] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:19.234827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895701104359009:9043] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:19.234830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895701104359009:9043] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:19.234839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1480 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:19.234822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:19.237111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:19.237324Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:19.237335Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:19.237346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:19.237400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:19.237448Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895701014607157:8882]
2025-09-30T14:54:19.238154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:19.238534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:19.238580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:19.238957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:19.239028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:19.239036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:19.239037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:19.239039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:19.239040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:19.239043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:19.239044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:19.239045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:19.239046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:19.239048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:19.239049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.239050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.239051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.239052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:19.239054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:19.239059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:19.239071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:19.239076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:19.239081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:19.239086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:19.239090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:19.239094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:19.239099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:19.239103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:19.239111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:19.239115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.239119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.239123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.239127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:19.239131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:19.239140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:19.239148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:19.239154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:19.239160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:19.239165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:19.239171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:19.239176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:19.239183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:19.239193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:19.239198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:19.239203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:19.239209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:19.239214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:19.239219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:19.239224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:19.239231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:19.239237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:19.239260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:19.239264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:19.239269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:19.239272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.239277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.239281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.239286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.239292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.239298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.239303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:19.239307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:19.239311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:19.239315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:19.239357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:19.245440Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] Counters: { Errors: 14 CurrentSessionLifetimeMs: 241289 BytesRead: 38297624 MessagesRead: 17 BytesReadCompressed: 38297624 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 2252802 BytesInflightTotal: 4505604 MessagesInflight: 2 }
2025-09-30T14:54:19.247636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:19.248603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:19.248619Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:19.248622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:19.248626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:19.248637Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1479 [2:7555895701014607157:8882]
2025-09-30T14:54:19.248658Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:19.248680Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:19.248687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:19.248691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:19.248693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:19.248711Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:19.248722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:19.248729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:19.248795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.248803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.248805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.248812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:19.248815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:19.248885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:19.248892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.248909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.248920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.248938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:19.248958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895701104358998:2454], now have 1 active actors on pipe
2025-09-30T14:54:19.248964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895701014607151:8882]
2025-09-30T14:54:19.248967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895701014607151:8882]
2025-09-30T14:54:19.248969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895701014607151:8882]
2025-09-30T14:54:19.248977Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:19.248987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895701104359059:9043], now have 1 active actors on pipe
2025-09-30T14:54:19.248987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:19.248990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:19.248992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:19.248995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:19.249011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:19.249014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:19.249053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895701014607151:8882]
2025-09-30T14:54:19.249061Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:19.249092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:19.249081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1479
2025-09-30T14:54:19.249129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1479
2025-09-30T14:54:19.249272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:19.249283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:19.249311Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a52df503-c0e3827f-ca113988-42415110_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:19.249323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:19.249326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:19.249328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:19.249339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:19.249352Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:19.249371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:19.250112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:19.250127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:19.250149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:19.250299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1480 partition: 0 MaxSeqNo: 42 sessionId: src_id|a52df503-c0e3827f-ca113988-42415110_0
2025-09-30T14:54:19.250703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|961c359a-78e78b5f-b3914538-26b34bb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a52df503-c0e3827f-ca113988-42415110_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:19.253585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a52df503-c0e3827f-ca113988-42415110_0] Write session: try to update token
2025-09-30T14:54:19.253607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a52df503-c0e3827f-ca113988-42415110_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:19.270528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1480 sessionId: src_id|a52df503-c0e3827f-ca113988-42415110_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:19.273456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:19.273645Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:19.273664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:19.273676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895701014607151:8882]
2025-09-30T14:54:19.273711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:19.273728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:19.273739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:19.273765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:19.273955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:19.274102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:19.274241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:19.274378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:19.274563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:19.274613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:19.274636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:19.274995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:19.282677Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:19.282698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:19.282701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:19.282703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:19.282713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895701014607151:8882]
2025-09-30T14:54:19.282717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895701014607151:8882]
2025-09-30T14:54:19.282725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895701014607151:8882]
2025-09-30T14:54:19.282763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:19.282770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.282775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:19.282774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:19.282781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:19.282785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:19.282914Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:19.319509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895701104359072:8563]
2025-09-30T14:54:19.319810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1479, pipe: [1:7555895701104359072:8563]
2025-09-30T14:54:19.409609Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:19.418423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:19.418453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:19.418655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:19.418722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:19.418790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:19.418856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:19.418900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:19.418911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:19.418989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:19.419050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:19.419114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:19.419191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:19.419233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:19.419237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:19.422569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:19.422573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895701104359072:8563]
2025-09-30T14:54:19.422611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:19.422614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:19.422642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1480 reason: error at write: Disconnected sessionId: src_id|a52df503-c0e3827f-ca113988-42415110_0
2025-09-30T14:54:19.422880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1480 sessionId: src_id|a52df503-c0e3827f-ca113988-42415110_0 is DEAD
2025-09-30T14:54:19.419490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:19.419572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:19.419638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:19.419712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:19.419759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:19.419762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:19.419847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:19.419915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:19.419984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:19.420054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:19.420097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:19.420104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:19.420178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:19.420235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:19.420299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:19.420361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:19.420406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:19.420409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:19.420492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:19.420556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:19.420623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:19.420691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:19.420734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:19.420738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:19.420808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:19.420871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:19.420938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:19.420998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:19.421065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:19.421068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:19.421138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:19.421206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:19.421271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:19.421334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:19.421377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:19.421379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:19.421456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:19.421516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:19.421582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:19.421649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:19.421714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:19.421717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:19.421790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:19.421854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:19.421939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:19.422001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:19.422064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:19.422067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:19.422146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895701104359072:8563], now have 1 active actors on pipe
2025-09-30T14:54:19.423451Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:19.423521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a52df503-c0e3827f-ca113988-42415110_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:19.423535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a52df503-c0e3827f-ca113988-42415110_0] Write session will restart in 0.008362s
2025-09-30T14:54:19.423559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a52df503-c0e3827f-ca113988-42415110_0] Write session: Do CDS request
2025-09-30T14:54:19.423565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a52df503-c0e3827f-ca113988-42415110_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:19.438838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a52df503-c0e3827f-ca113988-42415110_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:19.439347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:19.439361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1481
2025-09-30T14:54:19.439541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1481 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:19.439875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:19.439575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1481 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:19.439586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1481 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:19.439591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:19.440727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1481 sessionId:  describe result for acl check
2025-09-30T14:54:19.440768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:19.440770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:19.440772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:19.440781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895701104359118:9050] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:19.441222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895701104359118:9050] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:19.443204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:19.443479Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:19.443492Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:19.443505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:19.443568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:19.443602Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895701014607241:8886]
2025-09-30T14:54:19.443607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895701104359118:9050] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:19.444262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:19.447835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:19.447916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:19.448316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:19.448384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:19.448386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:19.448387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:19.448388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:19.448389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:19.448391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:19.448392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:19.448394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:19.448395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:19.448397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:19.448398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.448399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.448400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.448401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:19.448402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:19.448413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:19.448424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:19.448427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:19.448432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:19.448436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:19.448440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:19.448445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:19.448449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:19.448454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:19.448458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:19.448462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.448466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.448471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.448476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:19.448480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:19.448488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:19.448497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:19.448504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:19.448510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:19.448515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:19.448520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:19.448525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:19.448531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:19.448538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:19.448543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:19.448548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:19.448554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:19.448559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:19.448564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:19.448568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:19.448574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:19.448580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:19.448586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:19.448590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:19.448595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:19.448600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.448605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.448609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.448615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.448619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.448624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.448629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:19.448635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:19.448640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:19.448648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:19.448696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:19.454330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895701104359118:9050] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:19.454346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895701104359118:9050] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:19.454350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895701104359118:9050] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:19.454358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1481 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:19.457971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:19.458892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:19.458898Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:19.458900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:19.458904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:19.458911Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1480 [2:7555895701014607241:8886]
2025-09-30T14:54:19.458928Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:19.458943Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:19.458946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:19.458950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:19.458952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:19.458968Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:19.458976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:19.458983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:19.459047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.459049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.459052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.459055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:19.459057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:19.459137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:19.459140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.459155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.459169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.459189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:19.459208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895701104359165:9050], now have 1 active actors on pipe
2025-09-30T14:54:19.459212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895701104359075:2454], now have 1 active actors on pipe
2025-09-30T14:54:19.459219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895701014607233:8886]
2025-09-30T14:54:19.459221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895701014607233:8886]
2025-09-30T14:54:19.459223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895701014607233:8886]
2025-09-30T14:54:19.459238Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:19.459268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:19.459284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:19.459283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:19.459287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:19.459289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:19.459294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:19.459323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895701014607233:8886]
2025-09-30T14:54:19.459332Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:19.459353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:19.459485Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1480
2025-09-30T14:54:19.459521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1480
2025-09-30T14:54:19.460501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:19.460514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:19.460540Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d001494-b62e3328-d1f229bf-8b0e4f66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:19.460548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:19.460552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:19.460556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:19.460571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:19.460583Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:19.460598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:19.460909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:19.460926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:19.460950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:19.461181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1481 partition: 0 MaxSeqNo: 42 sessionId: src_id|7d001494-b62e3328-d1f229bf-8b0e4f66_0
2025-09-30T14:54:19.461567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a52df503-c0e3827f-ca113988-42415110_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7d001494-b62e3328-d1f229bf-8b0e4f66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:19.464471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d001494-b62e3328-d1f229bf-8b0e4f66_0] Write session: try to update token
2025-09-30T14:54:19.464491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d001494-b62e3328-d1f229bf-8b0e4f66_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:19.489898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1481 sessionId: src_id|7d001494-b62e3328-d1f229bf-8b0e4f66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:19.492769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:19.490175Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:19.490196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:19.490199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:19.490201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:19.490209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895701014607233:8886]
2025-09-30T14:54:19.490213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895701014607233:8886]
2025-09-30T14:54:19.490216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895701014607233:8886]
2025-09-30T14:54:19.490260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:19.490266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:19.490269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.490271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:19.490272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:19.490276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:19.490413Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:19.522778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895701104359182:8563]
2025-09-30T14:54:19.523211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1480, pipe: [1:7555895701104359182:8563]
2025-09-30T14:54:19.607626Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:19.608050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:19.608059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:19.608098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895701104359182:8563], now have 1 active actors on pipe
2025-09-30T14:54:19.608333Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:19.609405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d001494-b62e3328-d1f229bf-8b0e4f66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:19.609424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d001494-b62e3328-d1f229bf-8b0e4f66_0] Write session will restart in 0.006502s
2025-09-30T14:54:19.609470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d001494-b62e3328-d1f229bf-8b0e4f66_0] Write session: Do CDS request
2025-09-30T14:54:19.609479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d001494-b62e3328-d1f229bf-8b0e4f66_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:19.608756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:19.608854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1481 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7d001494-b62e3328-d1f229bf-8b0e4f66_0
2025-09-30T14:54:19.609026Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:19.609036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1481 sessionId: src_id|7d001494-b62e3328-d1f229bf-8b0e4f66_0 is DEAD
2025-09-30T14:54:19.609059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895701104359182:8563]
2025-09-30T14:54:19.616910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d001494-b62e3328-d1f229bf-8b0e4f66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:19.617071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:19.617086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1482
2025-09-30T14:54:19.618844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:19.618736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1482 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:19.618779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1482 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:19.618785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1482 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:19.618803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:19.619568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1482 sessionId:  describe result for acl check
2025-09-30T14:54:19.619596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:19.619597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:19.619598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:19.619603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895701104359215:9060] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:19.620106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895701104359215:9060] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:19.620812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:19.621005Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:19.621016Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:19.621027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:19.621080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:19.621125Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895701014607336:8900]
2025-09-30T14:54:19.621661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:19.621957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:19.622001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:19.622325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:19.622396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:19.622397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:19.622399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:19.622400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:19.622403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:19.622405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:19.622406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:19.622407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:19.622409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:19.622410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:19.622411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.622413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.622414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.622415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:19.622417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:19.622422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:19.622432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:19.622437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:19.622441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:19.622445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:19.622449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:19.622453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:19.622457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:19.622461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:19.622466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:19.622473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.622476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.622480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.622483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:19.622487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:19.622496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:19.622504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:19.622511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:19.622517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:19.622522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:19.622527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:19.622533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:19.622539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:19.622543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:19.622548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:19.622553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:19.622558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:19.622563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:19.622568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:19.622572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:19.622577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:19.622582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:19.622588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:19.622592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:19.622598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:19.622603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.622609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.622613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.622618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.622622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.622627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.622633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:19.622639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:19.622643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:19.622649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:19.622694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:19.624409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895701104359215:9060] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:19.628606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895701104359215:9060] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:19.628621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895701104359215:9060] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:19.628625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895701104359215:9060] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:19.628636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1482 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:19.628742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:19.630224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1481
2025-09-30T14:54:19.629742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:19.629749Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:19.629753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:19.629759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:19.629767Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1481 [2:7555895701014607336:8900]
2025-09-30T14:54:19.629786Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:19.629804Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:19.629807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:19.630247Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1481
2025-09-30T14:54:19.629810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:19.629813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:19.629829Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:19.629836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:19.629843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:19.629926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.629928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.629930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.629934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:19.629939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:19.630041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:19.630044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.630055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.630067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.630087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:19.630106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895701104359254:9060], now have 1 active actors on pipe
2025-09-30T14:54:19.630110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895701104359186:2454], now have 1 active actors on pipe
2025-09-30T14:54:19.630115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895701014607331:8900]
2025-09-30T14:54:19.630118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895701014607331:8900]
2025-09-30T14:54:19.630120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895701014607331:8900]
2025-09-30T14:54:19.630132Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:19.630149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:19.630151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:19.630155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:19.630157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:19.630164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:19.630166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:19.630203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895701014607331:8900]
2025-09-30T14:54:19.630211Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:19.630251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:19.630535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:19.630546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:19.630572Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9200aa4c-444258f4-6133b291-9939259_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:19.630580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:19.630584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:19.630587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:19.630597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:19.630606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:19.630620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:19.630812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:19.630826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:19.630850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:19.630992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1482 partition: 0 MaxSeqNo: 42 sessionId: src_id|9200aa4c-444258f4-6133b291-9939259_0
2025-09-30T14:54:19.631394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d001494-b62e3328-d1f229bf-8b0e4f66_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9200aa4c-444258f4-6133b291-9939259_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:19.634471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9200aa4c-444258f4-6133b291-9939259_0] Write session: try to update token
2025-09-30T14:54:19.634497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9200aa4c-444258f4-6133b291-9939259_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:19.645704Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:19.645724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:19.645731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:19.645733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:19.645746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895701014607331:8900]
2025-09-30T14:54:19.645749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895701014607331:8900]
2025-09-30T14:54:19.645753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895701014607331:8900]
2025-09-30T14:54:19.645794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:19.645806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.645809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:19.645814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:19.645820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:19.645824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:19.645988Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:19.651906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1482 sessionId: src_id|9200aa4c-444258f4-6133b291-9939259_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:19.655036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:19.709112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895701104359261:8563]
2025-09-30T14:54:19.709452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1481, pipe: [1:7555895701104359261:8563]
2025-09-30T14:54:19.761131Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:19.761515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:19.761531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:19.761571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895701104359261:8563], now have 1 active actors on pipe
2025-09-30T14:54:19.761827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:19.761916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895701104359261:8563]
2025-09-30T14:54:19.762180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:19.762190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:19.762236Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:19.762261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1482 reason: error at write: Disconnected sessionId: src_id|9200aa4c-444258f4-6133b291-9939259_0
2025-09-30T14:54:19.762437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1482 sessionId: src_id|9200aa4c-444258f4-6133b291-9939259_0 is DEAD
2025-09-30T14:54:19.763620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9200aa4c-444258f4-6133b291-9939259_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:19.763636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9200aa4c-444258f4-6133b291-9939259_0] Write session will restart in 0.008933s
2025-09-30T14:54:19.763666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9200aa4c-444258f4-6133b291-9939259_0] Write session: Do CDS request
2025-09-30T14:54:19.763675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9200aa4c-444258f4-6133b291-9939259_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:19.772557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:19.773973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9200aa4c-444258f4-6133b291-9939259_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:19.774397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:19.774612Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:19.774625Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:19.774607Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:19.774636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:19.774623Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1483
2025-09-30T14:54:19.774687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:19.774723Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895701014607405:8903]
2025-09-30T14:54:19.774850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1483 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:19.774880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1483 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:19.774889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1483 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:19.774894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:19.775320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1483 sessionId:  describe result for acl check
2025-09-30T14:54:19.775352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:19.775355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:19.775357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:19.775365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895701104359293:9064] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:19.775456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:19.775789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:19.775835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:19.776183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:19.776248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:19.776256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:19.776258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:19.776259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:19.776260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:19.776262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:19.776263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:19.776264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:19.776265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:19.776267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:19.776268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.776269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.776270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.776271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:19.776272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:19.776278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:19.776289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:19.776293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:19.776297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:19.776301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:19.776305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:19.776309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:19.776313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:19.776317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:19.776322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:19.776325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.776329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.776333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.776337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:19.776341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:19.776349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:19.776357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:19.776363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:19.776369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:19.776374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:19.776379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:19.776385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:19.776390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:19.776395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:19.776400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:19.776404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:19.776409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:19.776415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:19.776420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:19.776424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:19.776429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:19.776435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:19.776441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:19.776445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:19.776450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:19.776454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.776459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.776474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.776479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.776484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.776489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.775922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895701104359293:9064] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:19.776492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:19.776497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:19.776501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:19.776506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:19.776550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:19.778805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895701104359293:9064] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:19.782638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:19.783600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:19.783617Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:19.783624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:19.783628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:19.783636Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1482 [2:7555895701014607405:8903]
2025-09-30T14:54:19.783652Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:19.783669Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:19.783677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:19.783680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:19.783683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:19.783702Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:19.783714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:19.783721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:19.783782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.783793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.783797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.783802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:19.783804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:19.783887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:19.783889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.783902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.783914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.783930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:19.783949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895701104359263:2454], now have 1 active actors on pipe
2025-09-30T14:54:19.783956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895701014607400:8903]
2025-09-30T14:54:19.783958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895701014607400:8903]
2025-09-30T14:54:19.783960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895701014607400:8903]
2025-09-30T14:54:19.783974Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:19.783987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:19.783987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:19.783991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:19.783993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:19.784001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:19.784003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:19.784036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895701014607400:8903]
2025-09-30T14:54:19.784042Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:19.784076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:19.784432Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1482
2025-09-30T14:54:19.788877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895701104359293:9064] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:19.788894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895701104359293:9064] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:19.788897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895701104359293:9064] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:19.788906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1483 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:19.790741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1482
2025-09-30T14:54:19.790673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895701104359335:9064], now have 1 active actors on pipe
2025-09-30T14:54:19.790859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:19.790869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:19.790897Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77901b98-a8c734e6-4063c4c9-149d5606_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:19.790909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:19.790914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:19.790917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:19.790934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:19.790948Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:19.790970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:19.791695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:19.791705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:19.791724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:19.791890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1483 partition: 0 MaxSeqNo: 42 sessionId: src_id|77901b98-a8c734e6-4063c4c9-149d5606_0
2025-09-30T14:54:19.792273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9200aa4c-444258f4-6133b291-9939259_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|77901b98-a8c734e6-4063c4c9-149d5606_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:19.795035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77901b98-a8c734e6-4063c4c9-149d5606_0] Write session: try to update token
2025-09-30T14:54:19.795055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77901b98-a8c734e6-4063c4c9-149d5606_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:19.798601Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:19.798621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:19.798624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:19.798626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:19.798635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895701014607400:8903]
2025-09-30T14:54:19.798639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895701014607400:8903]
2025-09-30T14:54:19.798643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895701014607400:8903]
2025-09-30T14:54:19.798681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:19.798688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.798690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:19.798847Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:19.803730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:19.803746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:19.803750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:19.814879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1483 sessionId: src_id|77901b98-a8c734e6-4063c4c9-149d5606_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:19.817633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:19.863378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895701104359338:8563]
2025-09-30T14:54:19.863839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1482, pipe: [1:7555895701104359338:8563]
2025-09-30T14:54:19.923318Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:19.923741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:19.923758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:19.923806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895701104359338:8563], now have 1 active actors on pipe
2025-09-30T14:54:19.924613Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:19.927467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77901b98-a8c734e6-4063c4c9-149d5606_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:19.927480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77901b98-a8c734e6-4063c4c9-149d5606_0] Write session will restart in 0.007693s
2025-09-30T14:54:19.927504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77901b98-a8c734e6-4063c4c9-149d5606_0] Write session: Do CDS request
2025-09-30T14:54:19.927511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77901b98-a8c734e6-4063c4c9-149d5606_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:19.926943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:19.927026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1483 reason: status is not ok: tablet will be restarted right now sessionId: src_id|77901b98-a8c734e6-4063c4c9-149d5606_0
2025-09-30T14:54:19.927232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1483 sessionId: src_id|77901b98-a8c734e6-4063c4c9-149d5606_0 is DEAD
2025-09-30T14:54:19.927410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895701104359338:8563]
2025-09-30T14:54:19.927425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:19.938370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77901b98-a8c734e6-4063c4c9-149d5606_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:19.938652Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:19.938670Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1484
2025-09-30T14:54:19.939418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1484 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:19.939458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1484 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:19.939462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1484 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:19.939465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:19.940058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1484 sessionId:  describe result for acl check
2025-09-30T14:54:19.940094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:19.940096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:19.940098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:19.940104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895701104359369:9068] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:19.940549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895701104359369:9068] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:19.943070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:19.943752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:19.943960Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:19.943971Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:19.943981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:19.944028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:19.944061Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895701014607474:8905]
2025-09-30T14:54:19.944731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:19.945375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895701104359369:9068] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:19.945507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:19.945575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:19.945967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:19.946042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:19.946049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:19.946050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:19.946052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:19.946053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:19.946054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:19.946056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:19.946057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:19.946058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:19.946059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:19.946060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.946061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.946062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.946063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:19.946064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:19.946071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:19.946081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:19.946085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:19.946089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:19.946093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:19.946096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:19.946101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:19.946105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:19.946109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:19.946114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:19.946118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.946125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.946129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.946133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:19.946136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:19.946144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:19.946152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:19.946159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:19.946164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:19.946170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:19.946176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:19.946180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:19.946186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:19.946191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:19.946196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:19.946201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:19.946206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:19.946211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:19.946216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:19.946240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:19.946250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:19.946254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:19.946260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:19.946265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:19.946270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:19.946275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.946280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.946283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.946288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.946294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.946299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.946302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:19.946307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:19.946313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:19.946317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:19.946366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:19.952619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895701104359369:9068] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:19.952639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895701104359369:9068] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:19.952642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895701104359369:9068] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:19.952652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1484 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:19.952671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:19.953623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:19.953629Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:19.953632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:19.953636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:19.953643Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1483 [2:7555895701014607474:8905]
2025-09-30T14:54:19.953660Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:19.953676Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:19.953679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:19.953685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:19.953688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:19.953705Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:19.953713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:19.953720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:19.953786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.953788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.953791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.953795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:19.953797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:19.953890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:19.953893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.953906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:19.953920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:19.953938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:19.953960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895701104359408:9068], now have 1 active actors on pipe
2025-09-30T14:54:19.953967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895701014607469:8905]
2025-09-30T14:54:19.953972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895701014607469:8905]
2025-09-30T14:54:19.953975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895701014607469:8905]
2025-09-30T14:54:19.953991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:19.954000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895701104359340:2454], now have 1 active actors on pipe
2025-09-30T14:54:19.954003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:19.954007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:19.954008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:19.954010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:19.954023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:19.954026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:19.954135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1483
2025-09-30T14:54:19.954161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1483
2025-09-30T14:54:19.954059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895701014607469:8905]
2025-09-30T14:54:19.954068Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:19.954098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:19.954330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:19.954336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:19.954364Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|109d4be0-f162381f-e361e0d9-4ca89ca1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:19.954372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:19.954474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:19.954477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:19.954490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:19.954502Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:19.954520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:19.955145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:19.955168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:19.955193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:19.955335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1484 partition: 0 MaxSeqNo: 42 sessionId: src_id|109d4be0-f162381f-e361e0d9-4ca89ca1_0
2025-09-30T14:54:19.959709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77901b98-a8c734e6-4063c4c9-149d5606_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|109d4be0-f162381f-e361e0d9-4ca89ca1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:19.962612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|109d4be0-f162381f-e361e0d9-4ca89ca1_0] Write session: try to update token
2025-09-30T14:54:19.962634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|109d4be0-f162381f-e361e0d9-4ca89ca1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:19.967797Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:19.967817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:19.967820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:19.967822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:19.967832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895701014607469:8905]
2025-09-30T14:54:19.967837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895701014607469:8905]
2025-09-30T14:54:19.967841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895701014607469:8905]
2025-09-30T14:54:19.967883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:19.967889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:19.967892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:19.967894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:19.967894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:19.967899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:19.968042Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:19.990971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1484 sessionId: src_id|109d4be0-f162381f-e361e0d9-4ca89ca1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:19.993819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:20.027598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895705399326712:8563]
2025-09-30T14:54:20.030474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1483, pipe: [1:7555895705399326712:8563]
2025-09-30T14:54:20.089728Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:20.090103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:20.090123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:20.090146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895705399326712:8563], now have 1 active actors on pipe
2025-09-30T14:54:20.090393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895705399326712:8563]
2025-09-30T14:54:20.090427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:20.090440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:20.090409Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:20.090509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1484 reason: error at write: Disconnected sessionId: src_id|109d4be0-f162381f-e361e0d9-4ca89ca1_0
2025-09-30T14:54:20.090699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1484 sessionId: src_id|109d4be0-f162381f-e361e0d9-4ca89ca1_0 is DEAD
2025-09-30T14:54:20.090879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|109d4be0-f162381f-e361e0d9-4ca89ca1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:20.090887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|109d4be0-f162381f-e361e0d9-4ca89ca1_0] Write session will restart in 0.005145s
2025-09-30T14:54:20.090912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|109d4be0-f162381f-e361e0d9-4ca89ca1_0] Write session: Do CDS request
2025-09-30T14:54:20.090917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|109d4be0-f162381f-e361e0d9-4ca89ca1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:20.090813Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:20.096837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|109d4be0-f162381f-e361e0d9-4ca89ca1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:20.099710Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:20.099741Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1485
2025-09-30T14:54:20.099918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1485 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:20.099953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1485 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:20.099962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1485 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:20.099967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:20.102516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1485 sessionId:  describe result for acl check
2025-09-30T14:54:20.102556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:20.102571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:20.102578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:20.102584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895705399326735:9073] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:20.103161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895705399326735:9073] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:20.106381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:20.106149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895705399326735:9073] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:20.108639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:20.108832Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:20.108836Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:20.108846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:20.108901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:20.108948Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895705309574839:8907]
2025-09-30T14:54:20.109612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:20.109927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:20.109990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:20.110345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:20.110419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:20.110426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:20.110427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:20.110428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:20.110430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:20.110431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:20.110432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:20.110434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:20.110435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:20.110436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:20.110437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.110438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.110440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.110441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:20.110443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:20.110448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:20.110460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:20.110465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:20.110470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:20.110477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:20.110482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:20.110486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:20.110491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:20.110495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:20.110500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:20.110504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.110508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.110512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.110515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:20.110519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:20.110527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:20.110549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895705399326735:9073] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:20.110566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895705399326735:9073] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:20.110570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895705399326735:9073] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:20.110578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1485 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:20.110536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:20.110547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:20.110553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:20.110557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:20.110561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:20.110565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:20.110569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:20.110573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:20.110578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:20.110581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:20.110586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:20.110590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:20.110595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:20.110599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:20.110604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:20.110619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:20.110624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:20.110627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:20.110632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:20.110639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.110643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.110647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.110652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.110657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.110662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.110666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:20.110671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:20.110676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:20.110680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:20.110717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:20.118599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:20.119534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:20.119551Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:20.119558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:20.119562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:20.119570Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1484 [2:7555895705309574839:8907]
2025-09-30T14:54:20.119588Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:20.119605Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:20.119608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:20.119611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:20.119614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:20.119631Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:20.119644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:20.119651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:20.119725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.119736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.119738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.119742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:20.119745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:20.119820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:20.119823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.119837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.119847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.119864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:20.119882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895705309574833:8907]
2025-09-30T14:54:20.119884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895705309574833:8907]
2025-09-30T14:54:20.119886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895705309574833:8907]
2025-09-30T14:54:20.119901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:20.119919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:20.119932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:20.119935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:20.119978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895705309574833:8907]
2025-09-30T14:54:20.119980Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:20.120111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:20.120114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:20.120117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:20.120122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:20.120334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895705399326719:2454], now have 1 active actors on pipe
2025-09-30T14:54:20.120342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895705399326786:9073], now have 1 active actors on pipe
2025-09-30T14:54:20.120682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1484
2025-09-30T14:54:20.120697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1484
2025-09-30T14:54:20.121303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:20.121317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:20.121358Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da20ae9-237835c5-64c16604-b9d59cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:20.121375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:20.121380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:20.121383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:20.121394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:20.121408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:20.121425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:20.124019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:20.124035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:20.124080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:20.124224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1485 partition: 0 MaxSeqNo: 42 sessionId: src_id|da20ae9-237835c5-64c16604-b9d59cd_0
2025-09-30T14:54:20.124683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|109d4be0-f162381f-e361e0d9-4ca89ca1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|da20ae9-237835c5-64c16604-b9d59cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:20.127999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da20ae9-237835c5-64c16604-b9d59cd_0] Write session: try to update token
2025-09-30T14:54:20.128017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da20ae9-237835c5-64c16604-b9d59cd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:20.138597Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:20.138619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:20.138622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:20.138624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:20.138634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895705309574833:8907]
2025-09-30T14:54:20.138639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895705309574833:8907]
2025-09-30T14:54:20.138645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895705309574833:8907]
2025-09-30T14:54:20.138696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:20.138703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.138706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:20.138715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:20.138724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:20.138728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:20.138862Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:20.152951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1485 sessionId: src_id|da20ae9-237835c5-64c16604-b9d59cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:20.156062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:20.190442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895705399326799:8563]
2025-09-30T14:54:20.190782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1484, pipe: [1:7555895705399326799:8563]
2025-09-30T14:54:20.264785Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:20.265138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:20.265147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:20.265166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895705399326799:8563], now have 1 active actors on pipe
2025-09-30T14:54:20.265521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:20.265570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:20.265574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:20.265640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1485 reason: error at write: Disconnected sessionId: src_id|da20ae9-237835c5-64c16604-b9d59cd_0
2025-09-30T14:54:20.265543Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:20.265876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1485 sessionId: src_id|da20ae9-237835c5-64c16604-b9d59cd_0 is DEAD
2025-09-30T14:54:20.266025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da20ae9-237835c5-64c16604-b9d59cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:20.266033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da20ae9-237835c5-64c16604-b9d59cd_0] Write session will restart in 0.008663s
2025-09-30T14:54:20.266034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895705399326799:8563]
2025-09-30T14:54:20.266059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da20ae9-237835c5-64c16604-b9d59cd_0] Write session: Do CDS request
2025-09-30T14:54:20.266069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da20ae9-237835c5-64c16604-b9d59cd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:20.275858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da20ae9-237835c5-64c16604-b9d59cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:20.275938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:20.275953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1486
2025-09-30T14:54:20.276121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1486 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:20.276172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1486 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:20.276178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1486 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:20.276183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:20.277210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1486 sessionId:  describe result for acl check
2025-09-30T14:54:20.277252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:20.277257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:20.277259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:20.277267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895705399326833:9077] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:20.277850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895705399326833:9077] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:20.278541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:20.281202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:20.281411Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:20.281423Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:20.281433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:20.281489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:20.281533Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895705309574911:8910]
2025-09-30T14:54:20.281441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895705399326833:9077] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:20.282260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:20.282823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:20.282882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:20.283267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:20.283333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:20.283340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:20.283342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:20.283345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:20.283346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:20.283347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:20.283348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:20.283349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:20.283351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:20.283352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:20.283353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.283354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.283355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.283356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:20.283357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:20.283364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:20.283375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:20.283380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:20.283385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:20.283390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:20.283394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:20.283398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:20.283403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:20.283407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:20.283412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:20.283416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.283420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.283425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.283429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:20.283433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:20.283441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:20.283449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:20.283456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:20.283463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:20.283469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:20.283475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:20.283480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:20.283485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:20.283490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:20.283496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:20.283501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:20.283506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:20.283518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:20.283524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:20.283530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:20.283535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:20.283540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:20.283545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:20.283550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:20.283556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:20.283560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.283565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.283570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.283575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.283580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.283584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.283588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:20.283593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:20.283598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:20.283604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:20.283653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:20.284479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895705399326833:9077] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:20.284494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895705399326833:9077] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:20.284498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895705399326833:9077] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:20.284506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1486 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:20.294166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1485
2025-09-30T14:54:20.294209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1485
2025-09-30T14:54:20.292708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:20.293656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:20.293663Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:20.293666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:20.293673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:20.293681Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1485 [2:7555895705309574911:8910]
2025-09-30T14:54:20.293701Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:20.293720Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:20.293723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:20.293726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:20.293728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:20.293747Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:20.293754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:20.293760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:20.293828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.293830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.293832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.293836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:20.293838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:20.293922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:20.293925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.293941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.293951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.293966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:20.293984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895705309574906:8910]
2025-09-30T14:54:20.293986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895705309574906:8910]
2025-09-30T14:54:20.293988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895705309574906:8910]
2025-09-30T14:54:20.293995Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:20.294012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:20.294016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:20.294019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:20.294022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:20.294027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:20.294032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:20.294071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895705309574906:8910]
2025-09-30T14:54:20.294080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:20.294089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895705399326873:9077], now have 1 active actors on pipe
2025-09-30T14:54:20.294092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895705399326801:2454], now have 1 active actors on pipe
2025-09-30T14:54:20.294606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:20.297832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1486 partition: 0 MaxSeqNo: 42 sessionId: src_id|2d3e2c26-7ab429a8-5b911b7c-c79ab1a4_0
2025-09-30T14:54:20.298270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da20ae9-237835c5-64c16604-b9d59cd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2d3e2c26-7ab429a8-5b911b7c-c79ab1a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:20.295200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:20.295220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:20.295263Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d3e2c26-7ab429a8-5b911b7c-c79ab1a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:20.295273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:20.295277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:20.295280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:20.295292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:20.295305Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:20.295326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:20.297656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:20.297667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:20.297699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:20.301382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d3e2c26-7ab429a8-5b911b7c-c79ab1a4_0] Write session: try to update token
2025-09-30T14:54:20.301405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d3e2c26-7ab429a8-5b911b7c-c79ab1a4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:20.313977Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:20.313999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:20.314005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:20.314008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:20.314017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895705309574906:8910]
2025-09-30T14:54:20.314022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895705309574906:8910]
2025-09-30T14:54:20.314027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895705309574906:8910]
2025-09-30T14:54:20.314068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:20.314076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.314082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:20.314290Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:20.317475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:20.317497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:20.317503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:20.337803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1486 sessionId: src_id|2d3e2c26-7ab429a8-5b911b7c-c79ab1a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:20.341112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:20.367960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895705399326880:8563]
2025-09-30T14:54:20.368443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1485, pipe: [1:7555895705399326880:8563]
2025-09-30T14:54:20.438322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:20.438335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:20.438391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1486 reason: error at write: Disconnected sessionId: src_id|2d3e2c26-7ab429a8-5b911b7c-c79ab1a4_0
2025-09-30T14:54:20.438568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1486 sessionId: src_id|2d3e2c26-7ab429a8-5b911b7c-c79ab1a4_0 is DEAD
2025-09-30T14:54:20.438710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:20.438751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895705399326880:8563]
2025-09-30T14:54:20.439569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d3e2c26-7ab429a8-5b911b7c-c79ab1a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:20.439581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d3e2c26-7ab429a8-5b911b7c-c79ab1a4_0] Write session will restart in 0.006360s
2025-09-30T14:54:20.439608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d3e2c26-7ab429a8-5b911b7c-c79ab1a4_0] Write session: Do CDS request
2025-09-30T14:54:20.439616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d3e2c26-7ab429a8-5b911b7c-c79ab1a4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:20.437502Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:20.437944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:20.437954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:20.437976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895705399326880:8563], now have 1 active actors on pipe
2025-09-30T14:54:20.439109Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:20.451963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d3e2c26-7ab429a8-5b911b7c-c79ab1a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:20.452273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:20.454154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:20.454406Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:20.454419Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:20.454437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:20.454502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:20.454548Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895705309574994:8913]
2025-09-30T14:54:20.455239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:20.455624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:20.455688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:20.456066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:20.456134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:20.456140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:20.456142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:20.456143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:20.456145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:20.456147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:20.456148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:20.456150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:20.456151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:20.456153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:20.456155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.456156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.456157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.456159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:20.456160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:20.456167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:20.456178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:20.456185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:20.456190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:20.456194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:20.456198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:20.456202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:20.456206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:20.456211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:20.456216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:20.456221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.456225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.456229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.456234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:20.456238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:20.456246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:20.456255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:20.456262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:20.456268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:20.456274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:20.456279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:20.456285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:20.456291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:20.456299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:20.456305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:20.456310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:20.456316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:20.456322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:20.456333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:20.456337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:20.456347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:20.456352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:20.456363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:20.456368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:20.456374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:20.456379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.456384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.456388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.456393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.456398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.456407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.456411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:20.456416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:20.456423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:20.456428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:20.456474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:20.458399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:20.458416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1487
2025-09-30T14:54:20.458672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1487 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:20.458711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1487 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:20.458722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1487 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:20.458727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:20.459216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1487 sessionId:  describe result for acl check
2025-09-30T14:54:20.459273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:20.459276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:20.459279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:20.459285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895705399326933:9082] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:20.459870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895705399326933:9082] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:20.462518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895705399326933:9082] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:20.462743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:20.463743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:20.463763Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:20.463766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:20.463773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:20.463781Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1486 [2:7555895705309574994:8913]
2025-09-30T14:54:20.463799Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:20.463816Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:20.463819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:20.463823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:20.463825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:20.463843Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:20.463850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:20.463857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:20.463930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.463943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.463945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.463948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:20.463951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:20.464018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:20.464025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.464040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.464054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.464071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:20.464089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895705309574989:8913]
2025-09-30T14:54:20.464092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895705309574989:8913]
2025-09-30T14:54:20.464094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895705309574989:8913]
2025-09-30T14:54:20.464109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:20.464123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:20.464142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:20.464146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:20.464165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:20.464167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:20.464170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:20.464182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895705309574989:8913]
2025-09-30T14:54:20.464186Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:20.464201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:20.464214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895705399326882:2454], now have 1 active actors on pipe
2025-09-30T14:54:20.464571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1486
2025-09-30T14:54:20.479107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895705399326933:9082] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:20.479128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895705399326933:9082] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:20.479132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895705399326933:9082] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:20.479142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1487 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:20.480579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1486
2025-09-30T14:54:20.481184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895705399326970:9082], now have 1 active actors on pipe
2025-09-30T14:54:20.481221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:20.481230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:20.481252Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:20.481256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:20.481264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895705309574989:8913]
2025-09-30T14:54:20.481314Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9a528c9-45dfebe5-a87ff26a-297e125a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:20.481327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:20.481336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:20.481338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:20.481353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:20.481369Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:20.481390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:20.481591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:20.481749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:20.481923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:20.482080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:20.482290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:20.482336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:20.482352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:20.482713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:20.486150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d3e2c26-7ab429a8-5b911b7c-c79ab1a4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f9a528c9-45dfebe5-a87ff26a-297e125a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:20.485672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1487 partition: 0 MaxSeqNo: 42 sessionId: src_id|f9a528c9-45dfebe5-a87ff26a-297e125a_0
2025-09-30T14:54:20.485115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:20.485150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:20.485183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:20.489238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9a528c9-45dfebe5-a87ff26a-297e125a_0] Write session: try to update token
2025-09-30T14:54:20.489259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9a528c9-45dfebe5-a87ff26a-297e125a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:20.496100Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:20.496123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:20.496125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:20.496127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:20.496137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895705309574989:8913]
2025-09-30T14:54:20.496141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895705309574989:8913]
2025-09-30T14:54:20.496146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895705309574989:8913]
2025-09-30T14:54:20.496192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:20.496200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.496203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:20.496205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:20.496213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:20.496217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:20.496348Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:20.510473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1487 sessionId: src_id|f9a528c9-45dfebe5-a87ff26a-297e125a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:20.513457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:20.539263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895705399326995:8563]
2025-09-30T14:54:20.542552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1486, pipe: [1:7555895705399326995:8563]
2025-09-30T14:54:20.613825Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:20.614500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:20.614511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:20.614530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895705399326995:8563], now have 1 active actors on pipe
2025-09-30T14:54:20.614903Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:20.615198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:20.615270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895705399326995:8563]
2025-09-30T14:54:20.615290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:20.615363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1487 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f9a528c9-45dfebe5-a87ff26a-297e125a_0
2025-09-30T14:54:20.615573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1487 sessionId: src_id|f9a528c9-45dfebe5-a87ff26a-297e125a_0 is DEAD
2025-09-30T14:54:20.619484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9a528c9-45dfebe5-a87ff26a-297e125a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:20.619499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9a528c9-45dfebe5-a87ff26a-297e125a_0] Write session will restart in 0.007157s
2025-09-30T14:54:20.619524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9a528c9-45dfebe5-a87ff26a-297e125a_0] Write session: Do CDS request
2025-09-30T14:54:20.619530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9a528c9-45dfebe5-a87ff26a-297e125a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:20.627771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9a528c9-45dfebe5-a87ff26a-297e125a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:20.628356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:20.630575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:20.630819Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:20.630832Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:20.630845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:20.630916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:20.630964Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895705309575102:8927]
2025-09-30T14:54:20.631619Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:20.631634Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1488
2025-09-30T14:54:20.631707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:20.631860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1488 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:20.631896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1488 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:20.631901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1488 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:20.631905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:20.632294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1488 sessionId:  describe result for acl check
2025-09-30T14:54:20.632320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:20.632326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:20.632328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:20.632334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895705399327037:9094] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:20.633050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895705399327037:9094] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:20.633504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:20.633582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:20.633963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:20.634049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:20.634050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:20.634051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:20.634053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:20.634054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:20.634056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:20.634057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:20.634059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:20.634060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:20.634061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:20.634063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.634064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.634065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.634067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:20.634068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:20.634075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:20.634083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:20.634087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:20.634091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:20.634094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:20.634099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:20.634103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:20.634107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:20.634111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:20.634115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:20.634119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.634123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.634127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.634131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:20.634138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:20.634147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:20.634155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:20.634162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:20.634167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:20.634171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:20.634177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:20.634181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:20.634187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:20.634192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:20.634199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:20.634204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:20.634210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:20.634220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:20.634226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:20.634231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:20.634238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:20.634242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:20.634247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:20.634256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:20.634261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:20.634266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.634271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.634276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.634280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.634285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.634291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.634296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:20.634302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:20.634307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:20.634312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:20.634363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:20.638325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895705399327037:9094] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:20.642637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:20.643999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:20.644022Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:20.644026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:20.644031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:20.644041Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1487 [2:7555895705309575102:8927]
2025-09-30T14:54:20.644067Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:20.644091Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:20.644095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:20.644099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:20.644102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:20.644125Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:20.644135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:20.644143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:20.644235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.644238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.644240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.644246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:20.644249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:20.644345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:20.644349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.644372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.644385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.644405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:20.644430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895705309575097:8927]
2025-09-30T14:54:20.644432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895705309575097:8927]
2025-09-30T14:54:20.644435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895705309575097:8927]
2025-09-30T14:54:20.644452Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:20.644471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:20.644489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:20.644493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:20.644544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895705309575097:8927]
2025-09-30T14:54:20.644547Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:20.645477Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1487
2025-09-30T14:54:20.645835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895705399327037:9094] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:20.645849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895705399327037:9094] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:20.645866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895705399327037:9094] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:20.645876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1488 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:20.644900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:20.644911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:20.644914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:20.644922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:20.647327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895705399327000:2454], now have 1 active actors on pipe
2025-09-30T14:54:20.649509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895705399327074:9094], now have 1 active actors on pipe
2025-09-30T14:54:20.649612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1487
2025-09-30T14:54:20.649733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:20.649746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:20.649778Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64b3ccd8-372406f2-3714ef89-585f4420_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:20.649795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:20.649805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:20.649809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:20.649834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:20.649863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:20.649890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:20.650293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:20.650319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:20.650357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:20.650543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1488 partition: 0 MaxSeqNo: 42 sessionId: src_id|64b3ccd8-372406f2-3714ef89-585f4420_0
2025-09-30T14:54:20.651122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9a528c9-45dfebe5-a87ff26a-297e125a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|64b3ccd8-372406f2-3714ef89-585f4420_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:20.654190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64b3ccd8-372406f2-3714ef89-585f4420_0] Write session: try to update token
2025-09-30T14:54:20.654215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64b3ccd8-372406f2-3714ef89-585f4420_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:20.680842Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:20.680863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:20.680865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:20.680866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:20.680877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895705309575097:8927]
2025-09-30T14:54:20.680880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895705309575097:8927]
2025-09-30T14:54:20.680883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895705309575097:8927]
2025-09-30T14:54:20.680922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:20.680931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.680933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:20.681077Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:20.682187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:20.682210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:20.682215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:20.694581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1488 sessionId: src_id|64b3ccd8-372406f2-3714ef89-585f4420_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:20.697957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:20.715526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895705399327080:8563]
2025-09-30T14:54:20.715810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1487, pipe: [1:7555895705399327080:8563]
2025-09-30T14:54:20.804672Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:20.805010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:20.805028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:20.805070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895705399327080:8563], now have 1 active actors on pipe
2025-09-30T14:54:20.805326Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:20.805355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:20.805409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895705399327080:8563]
2025-09-30T14:54:20.805535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:20.805539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:20.805603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1488 reason: error at write: Disconnected sessionId: src_id|64b3ccd8-372406f2-3714ef89-585f4420_0
2025-09-30T14:54:20.805777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1488 sessionId: src_id|64b3ccd8-372406f2-3714ef89-585f4420_0 is DEAD
2025-09-30T14:54:20.811348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b3ccd8-372406f2-3714ef89-585f4420_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:20.811363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b3ccd8-372406f2-3714ef89-585f4420_0] Write session will restart in 0.007078s
2025-09-30T14:54:20.811388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b3ccd8-372406f2-3714ef89-585f4420_0] Write session: Do CDS request
2025-09-30T14:54:20.811397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b3ccd8-372406f2-3714ef89-585f4420_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:20.815770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:20.818326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:20.818582Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:20.818587Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:20.818599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:20.818676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:20.818714Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895705309575177:8930]
2025-09-30T14:54:20.819351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:20.819783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64b3ccd8-372406f2-3714ef89-585f4420_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:20.819923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:20.819973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:20.820299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:20.820353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:20.820354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:20.820355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:20.820356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:20.820360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:20.820361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:20.820362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:20.820363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:20.820364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:20.820365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:20.820366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.820367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.820368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.820369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:20.820370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:20.820374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:20.820383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:20.820387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:20.820390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:20.820393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:20.820397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:20.820400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:20.820403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:20.820407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:20.820411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:20.820414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.820418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.820422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.820425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:20.820429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:20.820438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:20.820447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:20.820453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:20.820458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:20.820463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:20.820470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:20.820474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:20.820479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:20.820483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:20.820488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:20.820491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:20.820496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:20.820500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:20.820505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:20.820509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:20.820514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:20.820518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:20.820522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:20.820526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:20.820541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:20.820548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.820552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.820556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.820560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.820564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.820568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.820572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:20.820576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:20.820581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:20.820586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:20.820627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:20.820158Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:20.820173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1489
2025-09-30T14:54:20.820412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1489 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:20.820451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1489 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:20.820457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1489 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:20.820461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:20.820938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1489 sessionId:  describe result for acl check
2025-09-30T14:54:20.820969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:20.820972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:20.820974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:20.820980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895705399327130:9098] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:20.821543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895705399327130:9098] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:20.827241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:20.828177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:20.828184Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:20.828187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:20.828192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:20.828199Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1488 [2:7555895705309575177:8930]
2025-09-30T14:54:20.828216Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:20.828238Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:20.828241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:20.828244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:20.828247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:20.828264Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:20.828271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:20.828279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:20.828342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.828346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.828348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.828352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:20.828354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:20.828427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:20.828430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.828444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.828455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.828473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:20.828489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895705309575171:8930]
2025-09-30T14:54:20.828492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895705309575171:8930]
2025-09-30T14:54:20.828494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895705309575171:8930]
2025-09-30T14:54:20.828501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:20.828516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:20.828518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:20.828520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:20.828523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:20.828532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:20.828537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:20.828548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895705399327083:2454], now have 1 active actors on pipe
2025-09-30T14:54:20.828583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895705309575171:8930]
2025-09-30T14:54:20.828592Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:20.828656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:20.828803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1488
2025-09-30T14:54:20.830978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895705399327130:9098] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:20.838548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895705399327169:9098], now have 1 active actors on pipe
2025-09-30T14:54:20.838833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:20.838841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:20.838868Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa055482-705ffdbd-63927010-625b2018_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:20.838880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:20.837684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895705399327130:9098] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:20.837701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895705399327130:9098] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:20.837705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895705399327130:9098] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:20.837713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1489 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:20.838690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1488
2025-09-30T14:54:20.838888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:20.838891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:20.838904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:20.838919Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:20.838938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:20.839205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:20.839209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:20.839221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:20.840267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b3ccd8-372406f2-3714ef89-585f4420_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|aa055482-705ffdbd-63927010-625b2018_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:20.842508Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:20.842527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:20.842530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:20.842532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:20.842541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895705309575171:8930]
2025-09-30T14:54:20.842545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895705309575171:8930]
2025-09-30T14:54:20.842549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895705309575171:8930]
2025-09-30T14:54:20.842599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:20.842610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.842614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:20.842756Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:20.843075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa055482-705ffdbd-63927010-625b2018_0] Write session: try to update token
2025-09-30T14:54:20.843092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa055482-705ffdbd-63927010-625b2018_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:20.839415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1489 partition: 0 MaxSeqNo: 42 sessionId: src_id|aa055482-705ffdbd-63927010-625b2018_0
2025-09-30T14:54:20.843544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:20.843561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:20.843565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:20.870836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1489 sessionId: src_id|aa055482-705ffdbd-63927010-625b2018_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:20.873546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:20.905656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895705399327174:8563]
2025-09-30T14:54:20.906039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1488, pipe: [1:7555895705399327174:8563]
2025-09-30T14:54:20.964563Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:20.964891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:20.964906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:20.964927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895705399327174:8563], now have 1 active actors on pipe
2025-09-30T14:54:20.965156Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:20.965508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:20.965548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:20.965600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1489 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aa055482-705ffdbd-63927010-625b2018_0
2025-09-30T14:54:20.965935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa055482-705ffdbd-63927010-625b2018_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:20.965944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa055482-705ffdbd-63927010-625b2018_0] Write session will restart in 0.009399s
2025-09-30T14:54:20.965977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa055482-705ffdbd-63927010-625b2018_0] Write session: Do CDS request
2025-09-30T14:54:20.965984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa055482-705ffdbd-63927010-625b2018_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:20.965776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1489 sessionId: src_id|aa055482-705ffdbd-63927010-625b2018_0 is DEAD
2025-09-30T14:54:20.965947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895705399327174:8563]
2025-09-30T14:54:20.976779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa055482-705ffdbd-63927010-625b2018_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:20.977105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:20.977122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1490
2025-09-30T14:54:20.977298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1490 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:20.977354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1490 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:20.977365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1490 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:20.977370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:20.977898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1490 sessionId:  describe result for acl check
2025-09-30T14:54:20.977938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:20.977945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:20.977947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:20.977953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895705399327192:9102] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:20.978515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895705399327192:9102] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:20.980863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895705399327192:9102] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:20.984099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895705399327192:9102] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:20.984115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895705399327192:9102] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:20.984119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895705399327192:9102] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:20.984127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1490 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:20.986927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:20.989006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:20.989224Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:20.989237Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:20.989248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:20.989303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:20.989342Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895705309575253:8932]
2025-09-30T14:54:20.989968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:20.990254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:20.990292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:20.990553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:20.990599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:20.990604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:20.990605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:20.990606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:20.990606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:20.990607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:20.990608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:20.990609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:20.990609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:20.990610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:20.990611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.990612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.990612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.990613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:20.990614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:20.990620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:20.990627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:20.990629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:20.990632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:20.990634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:20.990636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:20.990639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:20.990642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:20.990646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:20.990650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:20.990655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.990658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.990662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.990666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:20.990670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:20.990678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:20.990686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:20.990691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:20.990697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:20.990702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:20.990707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:20.990712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:20.990718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:20.990723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:20.990728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:20.990733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:20.990740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:20.990744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:20.990750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:20.990754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:20.990759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:20.990763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:20.990766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:20.990768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:20.990771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:20.990774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.990777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.990779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.990782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.990785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.990788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.990790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:20.990793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:20.990795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:20.990798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:20.990822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:20.996906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:20.997902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:20.997923Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:20.997926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:20.997930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:20.997937Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1489 [2:7555895705309575253:8932]
2025-09-30T14:54:20.997954Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:20.997974Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:20.997977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:20.997979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:20.997982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:20.997998Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:20.998005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:20.998013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:20.998079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.998088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.998089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.998093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:20.998096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:20.998167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:20.998175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:20.998190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:20.998205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:20.998227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:20.998248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895705309575248:8932]
2025-09-30T14:54:20.998252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895705309575248:8932]
2025-09-30T14:54:20.998254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895705309575248:8932]
2025-09-30T14:54:20.998266Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:20.998280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895705399327226:9102], now have 1 active actors on pipe
2025-09-30T14:54:20.998283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895705399327180:2454], now have 1 active actors on pipe
2025-09-30T14:54:20.998291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:20.998290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:20.998294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:20.998297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:20.998305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:20.998308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:20.998339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895705309575248:8932]
2025-09-30T14:54:20.998347Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:20.998373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:20.998388Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1489
2025-09-30T14:54:20.998388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1489
2025-09-30T14:54:20.998757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:20.998772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:20.998799Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e4d28c7-98b46c1e-6323f0f9-d11f69a2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:20.998809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:20.998820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:20.998826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:20.998839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:20.998855Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:20.998873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:20.999090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:20.999102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:20.999120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:20.999237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1490 partition: 0 MaxSeqNo: 42 sessionId: src_id|2e4d28c7-98b46c1e-6323f0f9-d11f69a2_0
2025-09-30T14:54:21.003526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa055482-705ffdbd-63927010-625b2018_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2e4d28c7-98b46c1e-6323f0f9-d11f69a2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:21.007003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e4d28c7-98b46c1e-6323f0f9-d11f69a2_0] Write session: try to update token
2025-09-30T14:54:21.007035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e4d28c7-98b46c1e-6323f0f9-d11f69a2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:21.015329Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:21.015349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:21.015359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895705309575248:8932]
2025-09-30T14:54:21.015408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:21.015413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:21.015592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:21.015738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:21.015883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:21.016029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:21.016233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:21.016272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:21.032413Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:21.032445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:21.032448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:21.032450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:21.032460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895705309575248:8932]
2025-09-30T14:54:21.032465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895705309575248:8932]
2025-09-30T14:54:21.032469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895705309575248:8932]
2025-09-30T14:54:21.032512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:21.032520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.032523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:21.032529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:21.032537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:21.032542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:21.032669Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:21.033885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1490 sessionId: src_id|2e4d28c7-98b46c1e-6323f0f9-d11f69a2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:21.036742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:21.067195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895709694294558:8563]
2025-09-30T14:54:21.067538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1489, pipe: [1:7555895709694294558:8563]
2025-09-30T14:54:21.178243Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:21.178578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:21.178595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:21.178614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895709694294558:8563], now have 1 active actors on pipe
2025-09-30T14:54:21.178866Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:21.180091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e4d28c7-98b46c1e-6323f0f9-d11f69a2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:21.180104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e4d28c7-98b46c1e-6323f0f9-d11f69a2_0] Write session will restart in 0.005562s
2025-09-30T14:54:21.180130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e4d28c7-98b46c1e-6323f0f9-d11f69a2_0] Write session: Do CDS request
2025-09-30T14:54:21.180137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e4d28c7-98b46c1e-6323f0f9-d11f69a2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:21.179329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:21.179418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1490 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2e4d28c7-98b46c1e-6323f0f9-d11f69a2_0
2025-09-30T14:54:21.179617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1490 sessionId: src_id|2e4d28c7-98b46c1e-6323f0f9-d11f69a2_0 is DEAD
2025-09-30T14:54:21.179826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895709694294558:8563]
2025-09-30T14:54:21.179839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:21.186945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e4d28c7-98b46c1e-6323f0f9-d11f69a2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:21.187295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:21.187311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1491
2025-09-30T14:54:21.187515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1491 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:21.187549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1491 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:21.187562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1491 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:21.187567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:21.188179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1491 sessionId:  describe result for acl check
2025-09-30T14:54:21.188226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:21.188228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:21.188230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:21.188237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895709694294580:9107] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:21.188814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895709694294580:9107] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:21.194395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895709694294580:9107] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:21.200152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895709694294580:9107] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:21.200167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895709694294580:9107] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:21.200172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895709694294580:9107] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:21.200181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1491 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:21.208964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:21.221424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:21.221684Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:21.221707Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:21.221732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:21.221811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:21.221888Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895709604542627:8934]
2025-09-30T14:54:21.222570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:21.222956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:21.223015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:21.223375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:21.223446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:21.223448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:21.223449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:21.223450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:21.223451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:21.223452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:21.223453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:21.223454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:21.223455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:21.223456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:21.223457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.223459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:21.223459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:21.223461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:21.223462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:21.223467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:21.223477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:21.223481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:21.223485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:21.223488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:21.223492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:21.223495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:21.223499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:21.223502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:21.223506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:21.223513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.223516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:21.223520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:21.223523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:21.223527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:21.223534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:21.223553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:21.223559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:21.223564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:21.223570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:21.223575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:21.223580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:21.223584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:21.223589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:21.223593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:21.223597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:21.223602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:21.223607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:21.223612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:21.223616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:21.223620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:21.223625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:21.223630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:21.223634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:21.223638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:21.223645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.223650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.223653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:21.223660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:21.223665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:21.223670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:21.223677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:21.223683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:21.223688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:21.223693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:21.223742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:21.236218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:21.237095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:21.237102Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:21.237104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:21.237108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:21.237116Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1490 [2:7555895709604542627:8934]
2025-09-30T14:54:21.237137Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:21.237154Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:21.237157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:21.237161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:21.237165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:21.237183Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:21.237190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:21.237197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:21.237261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.237264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:21.237266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:21.237272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:21.237275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:21.237419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:21.237422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.237436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:21.237449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:21.237471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:21.237487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895709604542621:8934]
2025-09-30T14:54:21.237490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895709604542621:8934]
2025-09-30T14:54:21.237494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895709604542621:8934]
2025-09-30T14:54:21.237508Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:21.237521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:21.237536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:21.237539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:21.237574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895709604542621:8934]
2025-09-30T14:54:21.237576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:21.237970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:21.237979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:21.237981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:21.237986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:21.239543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1490
2025-09-30T14:54:21.239580Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1490
2025-09-30T14:54:21.241549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895709694294622:9107], now have 1 active actors on pipe
2025-09-30T14:54:21.241579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895709694294575:2454], now have 1 active actors on pipe
2025-09-30T14:54:21.241615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:21.241626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:21.241899Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a3203024-915ba14a-fedfdc36-d707a4d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:21.241925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:21.241931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:21.241934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:21.241951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:21.241979Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:21.242014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:21.243663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:21.243683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:21.243727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:21.247523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1491 partition: 0 MaxSeqNo: 42 sessionId: src_id|a3203024-915ba14a-fedfdc36-d707a4d5_0
2025-09-30T14:54:21.248058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e4d28c7-98b46c1e-6323f0f9-d11f69a2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a3203024-915ba14a-fedfdc36-d707a4d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:21.250947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3203024-915ba14a-fedfdc36-d707a4d5_0] Write session: try to update token
2025-09-30T14:54:21.250968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3203024-915ba14a-fedfdc36-d707a4d5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:21.256562Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:21.256587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:21.256597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895709604542621:8934]
2025-09-30T14:54:21.256643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:21.256827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:21.256975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:21.257114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:21.257260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:21.257453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:21.257491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:21.257694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:21.276908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1491 sessionId: src_id|a3203024-915ba14a-fedfdc36-d707a4d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:21.279734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:21.280014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895709694294657:8563]
2025-09-30T14:54:21.280906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1490, pipe: [1:7555895709694294657:8563]
2025-09-30T14:54:21.280158Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:21.280180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:21.280184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:21.280189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:21.280203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895709604542621:8934]
2025-09-30T14:54:21.280207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895709604542621:8934]
2025-09-30T14:54:21.280210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895709604542621:8934]
2025-09-30T14:54:21.280250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:21.280257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.280259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:21.280403Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:21.280715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:21.280721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:21.280725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:21.411945Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:21.412336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:21.412345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:21.412366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895709694294657:8563], now have 1 active actors on pipe
2025-09-30T14:54:21.412859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895709694294657:8563]
2025-09-30T14:54:21.412898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:21.412901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:21.412963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1491 reason: error at write: Disconnected sessionId: src_id|a3203024-915ba14a-fedfdc36-d707a4d5_0
2025-09-30T14:54:21.413107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:21.413131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1491 sessionId: src_id|a3203024-915ba14a-fedfdc36-d707a4d5_0 is DEAD
2025-09-30T14:54:21.413758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3203024-915ba14a-fedfdc36-d707a4d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:21.413768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3203024-915ba14a-fedfdc36-d707a4d5_0] Write session will restart in 0.005905s
2025-09-30T14:54:21.413792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3203024-915ba14a-fedfdc36-d707a4d5_0] Write session: Do CDS request
2025-09-30T14:54:21.413799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3203024-915ba14a-fedfdc36-d707a4d5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:21.413557Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:21.423660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3203024-915ba14a-fedfdc36-d707a4d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:21.427216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:21.429677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:21.429905Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:21.429917Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:21.429928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:21.429987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:21.430030Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895709604542716:8938]
2025-09-30T14:54:21.430739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:21.431416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:21.431432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1492
2025-09-30T14:54:21.431135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:21.431178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:21.431530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:21.431596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:21.431597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:21.431599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:21.431599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:21.431600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:21.431602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:21.431603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:21.431604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:21.431605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:21.431607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:21.431608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.431609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:21.431611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:21.431612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:21.431613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:21.431617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:21.431628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:21.431633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:21.431637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:21.431641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:21.431645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:21.431649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:21.431654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:21.431658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:21.431663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:21.431667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.431671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:21.431675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:21.431679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:21.431683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:21.431691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:21.431701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:21.431707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:21.431713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:21.431718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:21.431735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:21.431739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:21.431745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:21.431749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:21.431755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:21.431759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:21.431764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:21.431770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:21.431775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:21.431780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:21.431786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:21.431793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:21.431798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:21.431802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:21.431807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:21.431811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.431815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.431819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:21.431823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:21.431827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:21.431832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:21.431836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:21.431841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:21.431845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:21.431849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:21.431904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:21.431667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1492 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:21.431713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1492 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:21.431722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1492 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:21.431727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:21.432967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1492 sessionId:  describe result for acl check
2025-09-30T14:54:21.432999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:21.433001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:21.433002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:21.433009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895709694294704:9111] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:21.433571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895709694294704:9111] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:21.435457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895709694294704:9111] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:21.438823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895709694294704:9111] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:21.438830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895709694294704:9111] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:21.438834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895709694294704:9111] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:21.438843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1492 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:21.439816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:21.440821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:21.440842Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:21.440845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:21.440850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:21.440856Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1491 [2:7555895709604542716:8938]
2025-09-30T14:54:21.440875Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:21.440891Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:21.440900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:21.440903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:21.440906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:21.440925Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:21.440937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:21.440945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:21.441018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.441028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:21.441030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:21.441033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:21.441036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:21.441111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:21.441123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.441141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:21.441154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:21.441173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:21.441193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895709694294738:9111], now have 1 active actors on pipe
2025-09-30T14:54:21.441202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895709694294661:2454], now have 1 active actors on pipe
2025-09-30T14:54:21.441209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895709604542709:8938]
2025-09-30T14:54:21.441211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895709604542709:8938]
2025-09-30T14:54:21.441214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895709604542709:8938]
2025-09-30T14:54:21.441226Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:21.441274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:21.441291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:21.441294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:21.441338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895709604542709:8938]
2025-09-30T14:54:21.441341Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:21.441419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:21.441422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:21.441424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:21.441431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:21.442089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:21.442112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:21.442148Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f452055-9d0dc87-11b8c8ff-51e6bc7d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:21.442157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:21.442161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:21.442164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:21.442175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:21.442187Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:21.442203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:21.442784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:21.442793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:21.442811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:21.443373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3203024-915ba14a-fedfdc36-d707a4d5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8f452055-9d0dc87-11b8c8ff-51e6bc7d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:21.441315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1491
2025-09-30T14:54:21.441347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1491
2025-09-30T14:54:21.442951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1492 partition: 0 MaxSeqNo: 42 sessionId: src_id|8f452055-9d0dc87-11b8c8ff-51e6bc7d_0
2025-09-30T14:54:21.446230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f452055-9d0dc87-11b8c8ff-51e6bc7d_0] Write session: try to update token
2025-09-30T14:54:21.446253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f452055-9d0dc87-11b8c8ff-51e6bc7d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:21.457511Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:21.457540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:21.457543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:21.457545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:21.457555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895709604542709:8938]
2025-09-30T14:54:21.457560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895709604542709:8938]
2025-09-30T14:54:21.457564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895709604542709:8938]
2025-09-30T14:54:21.457605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:21.457613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.457616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:21.457767Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:21.459231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:21.459256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:21.459261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:21.468313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1492 sessionId: src_id|8f452055-9d0dc87-11b8c8ff-51e6bc7d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:21.471138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:21.511864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895709694294757:8563]
2025-09-30T14:54:21.512253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1491, pipe: [1:7555895709694294757:8563]
2025-09-30T14:54:21.579818Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:21.580500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:21.580509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:21.580531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895709694294757:8563], now have 1 active actors on pipe
2025-09-30T14:54:21.583319Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:21.584153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:21.584239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1492 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8f452055-9d0dc87-11b8c8ff-51e6bc7d_0
2025-09-30T14:54:21.584421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1492 sessionId: src_id|8f452055-9d0dc87-11b8c8ff-51e6bc7d_0 is DEAD
2025-09-30T14:54:21.584649Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:21.584687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895709694294757:8563]
2025-09-30T14:54:21.584959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f452055-9d0dc87-11b8c8ff-51e6bc7d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:21.584967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f452055-9d0dc87-11b8c8ff-51e6bc7d_0] Write session will restart in 0.007343s
2025-09-30T14:54:21.584991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f452055-9d0dc87-11b8c8ff-51e6bc7d_0] Write session: Do CDS request
2025-09-30T14:54:21.584996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f452055-9d0dc87-11b8c8ff-51e6bc7d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:21.596324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f452055-9d0dc87-11b8c8ff-51e6bc7d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:21.596720Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:21.596734Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1493
2025-09-30T14:54:21.596890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1493 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:21.596919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1493 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:21.596923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1493 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:21.596927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:21.603697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1493 sessionId:  describe result for acl check
2025-09-30T14:54:21.603748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:21.603751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:21.603753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:21.603759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895709694294782:9123] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:21.604302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895709694294782:9123] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:21.609464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895709694294782:9123] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:21.616263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895709694294782:9123] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:21.616283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895709694294782:9123] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:21.616288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895709694294782:9123] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:21.616297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1493 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:21.621637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:21.627423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:21.627708Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:21.627713Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:21.627726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:21.627804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:21.627891Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895709604542814:8946]
2025-09-30T14:54:21.628566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:21.629011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:21.629079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:21.629450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:21.629531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:21.629532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:21.629534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:21.629535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:21.629536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:21.629537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:21.629539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:21.629540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:21.629542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:21.629543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:21.629544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.629546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:21.629547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:21.629548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:21.629550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:21.629555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:21.629566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:21.629570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:21.629575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:21.629579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:21.629583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:21.629588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:21.629591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:21.629599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:21.629603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:21.629607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.629611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:21.629615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:21.629619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:21.629623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:21.629630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:21.629648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:21.629654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:21.629660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:21.629665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:21.629670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:21.629676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:21.629682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:21.629688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:21.629693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:21.629697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:21.629702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:21.629707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:21.629721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:21.629726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:21.629731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:21.629736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:21.629741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:21.629745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:21.629751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:21.629757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.629762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.629766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:21.629772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:21.629778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:21.629784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:21.629789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:21.629794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:21.629800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:21.629805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:21.629862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:21.639306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:21.640623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:21.640631Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:21.640634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:21.640639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:21.640646Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1492 [2:7555895709604542814:8946]
2025-09-30T14:54:21.640663Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:21.640681Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:21.640685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:21.640688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:21.640691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:21.640708Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:21.640714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:21.640721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:21.640781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.640784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:21.640786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:21.640789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:21.640792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:21.640866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:21.640869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.640884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:21.640896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:21.640915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:21.640933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895709604542809:8946]
2025-09-30T14:54:21.640936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895709604542809:8946]
2025-09-30T14:54:21.640938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895709604542809:8946]
2025-09-30T14:54:21.640946Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:21.640958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:21.640959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895709694294774:2454], now have 1 active actors on pipe
2025-09-30T14:54:21.640962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:21.640964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895709694294845:9123], now have 1 active actors on pipe
2025-09-30T14:54:21.640965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:21.640972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:21.640988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:21.640991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:21.641029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895709604542809:8946]
2025-09-30T14:54:21.641041Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:21.641083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:21.641383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:21.641397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:21.641431Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1553a9d6-771b854d-71b1b257-8764e9c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:21.641440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:21.641445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:21.641448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:21.641459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:21.641472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:21.641490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:21.641796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:21.641804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:21.641823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:21.642347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f452055-9d0dc87-11b8c8ff-51e6bc7d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1553a9d6-771b854d-71b1b257-8764e9c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:21.641250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1492
2025-09-30T14:54:21.641294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1492
2025-09-30T14:54:21.641934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1493 partition: 0 MaxSeqNo: 42 sessionId: src_id|1553a9d6-771b854d-71b1b257-8764e9c2_0
2025-09-30T14:54:21.645452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1553a9d6-771b854d-71b1b257-8764e9c2_0] Write session: try to update token
2025-09-30T14:54:21.645477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1553a9d6-771b854d-71b1b257-8764e9c2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:21.668856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1493 sessionId: src_id|1553a9d6-771b854d-71b1b257-8764e9c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:21.668817Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:21.668838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:21.668848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895709604542809:8946]
2025-09-30T14:54:21.668898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:21.669092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:21.669246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:21.669394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:21.669544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:21.669752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:21.669791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:21.670005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:21.671665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:21.671960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:21.671982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:21.672016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:21.672135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:21.674683Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:21.674702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:21.674704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:21.674707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:21.674718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895709604542809:8946]
2025-09-30T14:54:21.674723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895709604542809:8946]
2025-09-30T14:54:21.674731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895709604542809:8946]
2025-09-30T14:54:21.674772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:21.674784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.674787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:21.674800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:21.674806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:21.674809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:21.674944Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:21.684933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895709694294869:8563]
2025-09-30T14:54:21.685220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1492, pipe: [1:7555895709694294869:8563]
2025-09-30T14:54:21.797161Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:21.797562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895709694294869:8563], now have 1 active actors on pipe
2025-09-30T14:54:21.806389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:21.806423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:21.806604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:21.806682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:21.806749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:21.806827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:21.806880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:21.806891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:21.806969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:21.807040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:21.807115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:21.807179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:21.807220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:21.807224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:21.807417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:21.807486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:21.807548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:21.807613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:21.807730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:21.807734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:21.807807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:21.807870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:21.807934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:21.808005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:21.808050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:21.808054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:21.808145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:21.808206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:21.808273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:21.808359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:21.808404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:21.808408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:21.808483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:21.808545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:21.808606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:21.808674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:21.808719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:21.808722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:21.808792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:21.808856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:21.808922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:21.808984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:21.809030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:21.809033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:21.809107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:21.809165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:21.809226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:21.809295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:21.809341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:21.809344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:21.809417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:21.809481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:21.809544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:21.809617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:21.809662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:21.809668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:21.809743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:21.809807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:21.809888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:21.809954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:21.809998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:21.810001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:21.812507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:21.812560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895709694294869:8563]
2025-09-30T14:54:21.812583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:21.812592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:21.812618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1493 reason: error at write: Disconnected sessionId: src_id|1553a9d6-771b854d-71b1b257-8764e9c2_0
2025-09-30T14:54:21.812826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1493 sessionId: src_id|1553a9d6-771b854d-71b1b257-8764e9c2_0 is DEAD
2025-09-30T14:54:21.812561Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:21.815370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1553a9d6-771b854d-71b1b257-8764e9c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:21.815388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1553a9d6-771b854d-71b1b257-8764e9c2_0] Write session will restart in 0.005091s
2025-09-30T14:54:21.815422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1553a9d6-771b854d-71b1b257-8764e9c2_0] Write session: Do CDS request
2025-09-30T14:54:21.815429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1553a9d6-771b854d-71b1b257-8764e9c2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:21.823689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1553a9d6-771b854d-71b1b257-8764e9c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:21.823988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:21.824003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1494
2025-09-30T14:54:21.824615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1494 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:21.824653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1494 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:21.824658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1494 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:21.824663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:21.825106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1494 sessionId:  describe result for acl check
2025-09-30T14:54:21.825149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:21.825156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:21.825158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:21.825164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895709694294910:9128] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:21.825710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895709694294910:9128] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:21.826833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:21.830568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895709694294910:9128] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:21.830142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:21.830355Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:21.830359Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:21.830370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:21.830424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:21.830463Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895709604542910:8955]
2025-09-30T14:54:21.831131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:21.831528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:21.831605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:21.831988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:21.832049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:21.832055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:21.832057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:21.832058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:21.832060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:21.832061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:21.832065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:21.832066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:21.832067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:21.832068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:21.832070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.832071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:21.832072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:21.832073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:21.832074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:21.832080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:21.832091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:21.832095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:21.832099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:21.832103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:21.832106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:21.832111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:21.832115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:21.832119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:21.832124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:21.832128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.832132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:21.832136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:21.832140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:21.832144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:21.832152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:21.832171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:21.832183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:21.832189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:21.832194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:21.832202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:21.832206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:21.832212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:21.832216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:21.832222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:21.832226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:21.832231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:21.832236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:21.832241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:21.832247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:21.832253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:21.832257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:21.832262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:21.832267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:21.832272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:21.832276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.832282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.832285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:21.832290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:21.832295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:21.832300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:21.832304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:21.832308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:21.832311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:21.832315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:21.832358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:21.838166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895709694294910:9128] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:21.838186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895709694294910:9128] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:21.838192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895709694294910:9128] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:21.838203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1494 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:21.838468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:21.839381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:21.839398Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:21.839401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:21.839405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:21.839413Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1493 [2:7555895709604542910:8955]
2025-09-30T14:54:21.839430Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:21.839453Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:21.839458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:21.839462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:21.839464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:21.839480Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:21.839492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:21.839499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:21.839565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.839572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:21.839575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:21.839579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:21.839582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:21.839651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:21.839658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.839671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:21.839687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:21.839710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:21.839734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895709694294872:2454], now have 1 active actors on pipe
2025-09-30T14:54:21.839742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895709694294950:9128], now have 1 active actors on pipe
2025-09-30T14:54:21.839748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895709604542903:8955]
2025-09-30T14:54:21.839750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895709604542903:8955]
2025-09-30T14:54:21.839751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895709604542903:8955]
2025-09-30T14:54:21.839766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:21.839784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:21.839800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:21.839808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:21.839845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895709604542903:8955]
2025-09-30T14:54:21.839850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:21.839854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:21.839856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:21.839858Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:21.839865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:21.839976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1493
2025-09-30T14:54:21.840032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1493
2025-09-30T14:54:21.840137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:21.840151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:21.840191Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39da02c0-135e3072-59cae8f7-450cb33f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:21.840205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:21.840208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:21.840210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:21.840222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:21.840236Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:21.840256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:21.840532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:21.840544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:21.840568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:21.840663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1494 partition: 0 MaxSeqNo: 42 sessionId: src_id|39da02c0-135e3072-59cae8f7-450cb33f_0
2025-09-30T14:54:21.844244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1553a9d6-771b854d-71b1b257-8764e9c2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|39da02c0-135e3072-59cae8f7-450cb33f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:21.847111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39da02c0-135e3072-59cae8f7-450cb33f_0] Write session: try to update token
2025-09-30T14:54:21.847139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39da02c0-135e3072-59cae8f7-450cb33f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:21.852694Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:21.852714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:21.852717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:21.852719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:21.852736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895709604542903:8955]
2025-09-30T14:54:21.852740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895709604542903:8955]
2025-09-30T14:54:21.852744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895709604542903:8955]
2025-09-30T14:54:21.852785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:21.852791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.852794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:21.852830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:21.852847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:21.852851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:21.852942Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:21.865631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1494 sessionId: src_id|39da02c0-135e3072-59cae8f7-450cb33f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:21.868569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:21.912765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895709694294959:8563]
2025-09-30T14:54:21.913981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1493, pipe: [1:7555895709694294959:8563]
2025-09-30T14:54:21.972998Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:21.973497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:21.973513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:21.973535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895709694294959:8563], now have 1 active actors on pipe
2025-09-30T14:54:21.974402Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:21.974466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:21.974518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:21.974533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895709694294959:8563]
2025-09-30T14:54:21.974602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1494 reason: status is not ok: tablet will be restarted right now sessionId: src_id|39da02c0-135e3072-59cae8f7-450cb33f_0
2025-09-30T14:54:21.974780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1494 sessionId: src_id|39da02c0-135e3072-59cae8f7-450cb33f_0 is DEAD
2025-09-30T14:54:21.975632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39da02c0-135e3072-59cae8f7-450cb33f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:21.975653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39da02c0-135e3072-59cae8f7-450cb33f_0] Write session will restart in 0.005418s
2025-09-30T14:54:21.975688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39da02c0-135e3072-59cae8f7-450cb33f_0] Write session: Do CDS request
2025-09-30T14:54:21.975696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39da02c0-135e3072-59cae8f7-450cb33f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:21.983185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39da02c0-135e3072-59cae8f7-450cb33f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:21.983374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:21.983389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1495
2025-09-30T14:54:21.983574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1495 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:21.983616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1495 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:21.983625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1495 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:21.983632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:21.984307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1495 sessionId:  describe result for acl check
2025-09-30T14:54:21.984342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:21.984350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:21.984352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:21.984358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895709694294984:9132] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:21.984945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895709694294984:9132] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:21.987699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:21.988751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895709694294984:9132] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:21.990101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:21.990313Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:21.990317Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:21.990327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:21.990383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:21.990423Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895709604542988:8957]
2025-09-30T14:54:21.991089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:21.991566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895709694294984:9132] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:21.991584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895709694294984:9132] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:21.991588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895709694294984:9132] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:21.991598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1495 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:21.991403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:21.991451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:21.991789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:21.991846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:21.991847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:21.991848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:21.991850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:21.991851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:21.991852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:21.991853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:21.991854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:21.991855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:21.991855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:21.991857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.991858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:21.991859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:21.991859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:21.991860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:21.991866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:21.991876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:21.991881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:21.991885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:21.991889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:21.991893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:21.991898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:21.991902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:21.991906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:21.991910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:21.991914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.991918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:21.991923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:21.991927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:21.991931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:21.991939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:21.991947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:21.991953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:21.991959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:21.991964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:21.991969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:21.991974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:21.991979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:21.991984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:21.991989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:21.991994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:21.991999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:21.992004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:21.992011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:21.992016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:21.992021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:21.992026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:21.992031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:21.992037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:21.992043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:21.992048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.992053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.992057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:21.992063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:21.992067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:21.992073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:21.992077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:21.992082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:21.992089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:21.992094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:21.992140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:21.997971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:21.998923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:21.998941Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:21.998944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:21.998948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:21.998955Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1494 [2:7555895709604542988:8957]
2025-09-30T14:54:21.998969Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:21.998987Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:21.998992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:21.998994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:21.998996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:21.999008Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:21.999013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:21.999018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:21.999065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.999073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:21.999075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:21.999077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:21.999079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:21.999135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:21.999142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:21.999151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:21.999157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:21.999166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:21.999184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895709604542983:8957]
2025-09-30T14:54:21.999189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895709604542983:8957]
2025-09-30T14:54:21.999191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895709604542983:8957]
2025-09-30T14:54:21.999196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:21.999209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:21.999217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:21.999219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:21.999222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:21.999225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:21.999227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:21.999271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895709694295037:9132], now have 1 active actors on pipe
2025-09-30T14:54:21.999281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895709694294960:2454], now have 1 active actors on pipe
2025-09-30T14:54:21.999285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895709604542983:8957]
2025-09-30T14:54:21.999293Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:21.999311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:21.999355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1494
2025-09-30T14:54:21.999357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1494
2025-09-30T14:54:21.999455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:21.999467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:21.999499Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77885100-a801fa1d-1364e9f4-55655a30_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:21.999507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:21.999510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:21.999513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:21.999524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:21.999534Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:21.999548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:21.999774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:21.999783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:21.999798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:21.999933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1495 partition: 0 MaxSeqNo: 42 sessionId: src_id|77885100-a801fa1d-1364e9f4-55655a30_0
2025-09-30T14:54:22.000311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39da02c0-135e3072-59cae8f7-450cb33f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|77885100-a801fa1d-1364e9f4-55655a30_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:22.003233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77885100-a801fa1d-1364e9f4-55655a30_0] Write session: try to update token
2025-09-30T14:54:22.003277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77885100-a801fa1d-1364e9f4-55655a30_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:22.011914Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:22.011934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:22.011944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895709604542983:8957]
2025-09-30T14:54:22.011992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:22.011995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:22.012183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:22.012343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:22.012510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:22.012662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:22.012873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:22.012921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:22.020179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1495 sessionId: src_id|77885100-a801fa1d-1364e9f4-55655a30_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:22.023063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:22.023309Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:22.023331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:22.023334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:22.023336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:22.023345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895709604542983:8957]
2025-09-30T14:54:22.023349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895709604542983:8957]
2025-09-30T14:54:22.023354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895709604542983:8957]
2025-09-30T14:54:22.023403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:22.023403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:22.023408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:22.023412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:22.023413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:22.023432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:22.023440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.023443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:22.023585Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:22.074559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895713989262343:8563]
2025-09-30T14:54:22.075033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1494, pipe: [1:7555895713989262343:8563]
2025-09-30T14:54:22.141298Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:22.141739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895713989262343:8563], now have 1 active actors on pipe
2025-09-30T14:54:22.141996Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:22.142004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:22.142019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:22.142090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1495 reason: error at write: Disconnected sessionId: src_id|77885100-a801fa1d-1364e9f4-55655a30_0
2025-09-30T14:54:22.142334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1495 sessionId: src_id|77885100-a801fa1d-1364e9f4-55655a30_0 is DEAD
2025-09-30T14:54:22.142542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77885100-a801fa1d-1364e9f4-55655a30_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:22.142554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77885100-a801fa1d-1364e9f4-55655a30_0] Write session will restart in 0.009388s
2025-09-30T14:54:22.142578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77885100-a801fa1d-1364e9f4-55655a30_0] Write session: Do CDS request
2025-09-30T14:54:22.142584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77885100-a801fa1d-1364e9f4-55655a30_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:22.142415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895713989262343:8563]
2025-09-30T14:54:22.142437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:22.152843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77885100-a801fa1d-1364e9f4-55655a30_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:22.153304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:22.155566Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:22.155580Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1496
2025-09-30T14:54:22.155777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1496 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:22.155809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1496 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:22.155818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1496 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:22.155823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:22.155024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:22.155292Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:22.155297Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:22.155308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:22.155367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:22.155423Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895713899510364:8959]
2025-09-30T14:54:22.156110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:22.156264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1496 sessionId:  describe result for acl check
2025-09-30T14:54:22.156297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:22.156299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:22.156301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:22.156306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895713989262397:9137] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:22.156852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895713989262397:9137] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:22.156474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:22.156528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:22.156897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:22.156978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:22.156979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:22.156980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:22.156981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:22.156982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:22.156984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:22.156985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:22.156986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:22.156988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:22.156989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:22.156990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.156991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:22.156992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:22.156993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:22.156994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:22.157000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:22.157013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:22.157017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:22.157021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:22.157025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:22.157029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:22.157034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:22.157038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:22.157042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:22.157047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:22.157051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.157055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:22.157059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:22.157063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:22.157067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:22.157074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:22.157082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:22.157089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:22.157095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:22.157100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:22.157105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:22.157110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:22.157115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:22.157121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:22.157126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:22.157131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:22.157137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:22.157142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:22.157148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:22.157152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:22.157157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:22.157163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:22.157171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:22.157176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:22.157181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:22.157186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.157191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.157200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:22.157205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:22.157210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:22.157215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:22.157221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:22.157227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:22.157231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:22.157237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:22.157282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:22.158991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895713989262397:9137] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:22.163918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:22.164805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:22.164811Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:22.164814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:22.164821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:22.164828Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1495 [2:7555895713899510364:8959]
2025-09-30T14:54:22.164847Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:22.164862Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:22.164866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:22.164870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:22.164873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:22.164890Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:22.164897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:22.164908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:22.164973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.164975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:22.164977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:22.164981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:22.164983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:22.165059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:22.165062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.165077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:22.165091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:22.165111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:22.165128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895713899510359:8959]
2025-09-30T14:54:22.165131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895713899510359:8959]
2025-09-30T14:54:22.165133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895713899510359:8959]
2025-09-30T14:54:22.165151Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:22.165165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:22.165187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:22.165190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:22.165197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:22.165202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:22.165205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:22.165226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895713899510359:8959]
2025-09-30T14:54:22.165229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:22.165278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:22.165351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895713989262350:2454], now have 1 active actors on pipe
2025-09-30T14:54:22.165891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1495
2025-09-30T14:54:22.168120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895713989262397:9137] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:22.168138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895713989262397:9137] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:22.168142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895713989262397:9137] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:22.168151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1496 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:22.169007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895713989262437:9137], now have 1 active actors on pipe
2025-09-30T14:54:22.169038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1495
2025-09-30T14:54:22.169246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:22.169258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:22.169288Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e91025b4-ffd2f93a-952ae3bd-e287cd66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:22.169304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:22.169316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:22.169319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:22.169334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:22.169353Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:22.169374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:22.169597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:22.169612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:22.169638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:22.169742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1496 partition: 0 MaxSeqNo: 42 sessionId: src_id|e91025b4-ffd2f93a-952ae3bd-e287cd66_0
2025-09-30T14:54:22.170175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77885100-a801fa1d-1364e9f4-55655a30_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e91025b4-ffd2f93a-952ae3bd-e287cd66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:22.173035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e91025b4-ffd2f93a-952ae3bd-e287cd66_0] Write session: try to update token
2025-09-30T14:54:22.173057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e91025b4-ffd2f93a-952ae3bd-e287cd66_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:22.185675Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:22.185699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:22.185701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:22.185704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:22.185713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895713899510359:8959]
2025-09-30T14:54:22.185718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895713899510359:8959]
2025-09-30T14:54:22.185722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895713899510359:8959]
2025-09-30T14:54:22.185766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:22.185777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.185780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:22.185952Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:22.190317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:22.190340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:22.190350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:22.190862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1496 sessionId: src_id|e91025b4-ffd2f93a-952ae3bd-e287cd66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:22.193779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:22.242520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895713989262441:8563]
2025-09-30T14:54:22.243032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1495, pipe: [1:7555895713989262441:8563]
2025-09-30T14:54:22.305252Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:22.305727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:22.305745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:22.305789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895713989262441:8563], now have 1 active actors on pipe
2025-09-30T14:54:22.306118Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:22.306425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:22.306477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:22.306554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1496 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e91025b4-ffd2f93a-952ae3bd-e287cd66_0
2025-09-30T14:54:22.306779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1496 sessionId: src_id|e91025b4-ffd2f93a-952ae3bd-e287cd66_0 is DEAD
2025-09-30T14:54:22.306950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895713989262441:8563]
2025-09-30T14:54:22.306985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e91025b4-ffd2f93a-952ae3bd-e287cd66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:22.306998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e91025b4-ffd2f93a-952ae3bd-e287cd66_0] Write session will restart in 0.008107s
2025-09-30T14:54:22.307035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e91025b4-ffd2f93a-952ae3bd-e287cd66_0] Write session: Do CDS request
2025-09-30T14:54:22.307041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e91025b4-ffd2f93a-952ae3bd-e287cd66_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:22.317900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e91025b4-ffd2f93a-952ae3bd-e287cd66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:22.317967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:22.317983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1497
2025-09-30T14:54:22.319471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1497 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:22.319528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1497 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:22.319540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1497 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:22.319545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:22.320057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1497 sessionId:  describe result for acl check
2025-09-30T14:54:22.320092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:22.320094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:22.320096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:22.320102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895713989262467:9141] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:22.320655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895713989262467:9141] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:22.323001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:22.325424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895713989262467:9141] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:22.326271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:22.326510Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:22.326514Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:22.326525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:22.326594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:22.326630Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895713899510447:8962]
2025-09-30T14:54:22.327311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:22.327994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:22.328068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:22.328489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:22.328566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:22.328567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:22.328569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:22.328571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:22.328572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:22.328574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:22.328576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:22.328578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:22.328579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:22.328581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:22.328583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.328585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:22.328586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:22.328587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:22.328588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:22.328598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:22.328609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:22.328613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:22.328618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:22.328623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:22.328627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:22.328633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:22.328637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:22.328641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:22.328648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:22.328653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.328658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:22.328663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:22.328667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:22.328671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:22.328680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:22.328702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:22.328709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:22.328716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:22.328721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:22.328726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:22.328731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:22.328739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:22.328744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:22.328750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:22.328755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:22.328761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:22.328767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:22.328772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:22.328777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:22.328783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:22.328789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:22.328795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:22.328807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:22.328813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:22.328818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.328822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.328827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:22.328834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:22.328839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:22.328844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:22.328851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:22.328856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:22.328861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:22.328866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:22.328916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:22.329768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895713989262467:9141] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:22.329786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895713989262467:9141] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:22.329790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895713989262467:9141] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:22.329799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1497 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:22.336250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:22.337221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:22.337245Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:22.337248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:22.337253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:22.337262Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1496 [2:7555895713899510447:8962]
2025-09-30T14:54:22.337283Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:22.337301Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:22.337314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:22.337318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:22.337321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:22.337340Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:22.337354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:22.337363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:22.337443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.337451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:22.337454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:22.337458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:22.337460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:22.337537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:22.337547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.337562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:22.337573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:22.337588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:22.337608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895713899510442:8962]
2025-09-30T14:54:22.337610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895713899510442:8962]
2025-09-30T14:54:22.337612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895713899510442:8962]
2025-09-30T14:54:22.337628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:22.337644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:22.337660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:22.337664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:22.337687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:22.337692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:22.337694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:22.337710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895713899510442:8962]
2025-09-30T14:54:22.337714Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:22.337804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:22.337874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895713989262524:9141], now have 1 active actors on pipe
2025-09-30T14:54:22.337878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895713989262443:2454], now have 1 active actors on pipe
2025-09-30T14:54:22.338293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:22.338299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:22.338326Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9842260c-dbb72536-29c76ce3-e0cb531c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:22.338333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:22.338337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:22.338339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:22.338351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:22.338361Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:22.338375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:22.338534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:22.338535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:22.338544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:22.338102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1496
2025-09-30T14:54:22.338131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1496
2025-09-30T14:54:22.338657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1497 partition: 0 MaxSeqNo: 42 sessionId: src_id|9842260c-dbb72536-29c76ce3-e0cb531c_0
2025-09-30T14:54:22.342268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e91025b4-ffd2f93a-952ae3bd-e287cd66_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9842260c-dbb72536-29c76ce3-e0cb531c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:22.345910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9842260c-dbb72536-29c76ce3-e0cb531c_0] Write session: try to update token
2025-09-30T14:54:22.345939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9842260c-dbb72536-29c76ce3-e0cb531c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:22.353428Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:22.353454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:22.353457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:22.353460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:22.353470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895713899510442:8962]
2025-09-30T14:54:22.353474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895713899510442:8962]
2025-09-30T14:54:22.353480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895713899510442:8962]
2025-09-30T14:54:22.353522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:22.353530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.353537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:22.353606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:22.353621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:22.353627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:22.353692Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:22.379016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1497 sessionId: src_id|9842260c-dbb72536-29c76ce3-e0cb531c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:22.382108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:22.408786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895713989262532:8563]
2025-09-30T14:54:22.410457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1496, pipe: [1:7555895713989262532:8563]
2025-09-30T14:54:22.502083Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:22.502419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:22.502434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:22.502474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895713989262532:8563], now have 1 active actors on pipe
2025-09-30T14:54:22.502932Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:22.503338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895713989262532:8563]
2025-09-30T14:54:22.503373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:22.503454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1497 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9842260c-dbb72536-29c76ce3-e0cb531c_0
2025-09-30T14:54:22.503644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1497 sessionId: src_id|9842260c-dbb72536-29c76ce3-e0cb531c_0 is DEAD
2025-09-30T14:54:22.503778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:22.504007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9842260c-dbb72536-29c76ce3-e0cb531c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:22.504018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9842260c-dbb72536-29c76ce3-e0cb531c_0] Write session will restart in 0.009045s
2025-09-30T14:54:22.504045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9842260c-dbb72536-29c76ce3-e0cb531c_0] Write session: Do CDS request
2025-09-30T14:54:22.504051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9842260c-dbb72536-29c76ce3-e0cb531c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:22.517566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9842260c-dbb72536-29c76ce3-e0cb531c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:22.519514Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:22.519530Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1498
2025-09-30T14:54:22.519761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1498 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:22.519793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1498 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:22.519799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1498 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:22.519804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:22.520297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1498 sessionId:  describe result for acl check
2025-09-30T14:54:22.520329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:22.520331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:22.520333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:22.520338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895713989262589:9146] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:22.520879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895713989262589:9146] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:22.524747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895713989262589:9146] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:22.527020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:22.528634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:22.528862Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:22.528874Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:22.528885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:22.528950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:22.529002Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895713899510543:8965]
2025-09-30T14:54:22.528904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895713989262589:9146] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:22.528921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895713989262589:9146] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:22.528925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895713989262589:9146] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:22.528935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1498 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:22.529691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:22.530031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:22.530081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:22.530433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:22.530498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:22.530505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:22.530506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:22.530507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:22.530509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:22.530510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:22.530511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:22.530513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:22.530515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:22.530516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:22.530517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.530518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:22.530519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:22.530521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:22.530522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:22.530527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:22.530538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:22.530543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:22.530548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:22.530553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:22.530558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:22.530562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:22.530567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:22.530570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:22.530574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:22.530581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.530586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:22.530590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:22.530595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:22.530599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:22.530607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:22.530616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:22.530623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:22.530628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:22.530634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:22.530646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:22.530651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:22.530661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:22.530667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:22.530678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:22.530683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:22.530694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:22.530700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:22.530712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:22.530717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:22.530727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:22.530732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:22.530743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:22.530748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:22.530758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:22.530764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.530774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.530779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:22.530789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:22.530794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:22.530804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:22.530810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:22.530816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:22.530826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:22.530833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:22.530887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:22.539695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:22.541496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:22.541524Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:22.541528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:22.541533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:22.541544Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1497 [2:7555895713899510543:8965]
2025-09-30T14:54:22.541570Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:22.541596Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:22.541609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:22.541613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:22.541618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:22.541641Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:22.541650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:22.541669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:22.541764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.541777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:22.541779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:22.541784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:22.541792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:22.541904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:22.541917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.541935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:22.541952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:22.541972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:22.542002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895713899510538:8965]
2025-09-30T14:54:22.542012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895713899510538:8965]
2025-09-30T14:54:22.542014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895713899510538:8965]
2025-09-30T14:54:22.542030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:22.542059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:22.542082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:22.542092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:22.542149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895713899510538:8965]
2025-09-30T14:54:22.542160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:22.542296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:22.542307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:22.542309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:22.542317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:22.543287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1497
2025-09-30T14:54:22.543299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1497
2025-09-30T14:54:22.549009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895713989262549:2454], now have 1 active actors on pipe
2025-09-30T14:54:22.549035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895713989262626:9146], now have 1 active actors on pipe
2025-09-30T14:54:22.549182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:22.549193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:22.549233Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37ba3cd7-d7ab7ab5-f941836-4c9576ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:22.549246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:22.549252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:22.549255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:22.549394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:22.549414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:22.549433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:22.551972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1498 partition: 0 MaxSeqNo: 42 sessionId: src_id|37ba3cd7-d7ab7ab5-f941836-4c9576ec_0
2025-09-30T14:54:22.551364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:22.551388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:22.551427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:22.553936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9842260c-dbb72536-29c76ce3-e0cb531c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|37ba3cd7-d7ab7ab5-f941836-4c9576ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:22.556866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37ba3cd7-d7ab7ab5-f941836-4c9576ec_0] Write session: try to update token
2025-09-30T14:54:22.556895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37ba3cd7-d7ab7ab5-f941836-4c9576ec_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:22.561732Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:22.561754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:22.561757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:22.561760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:22.561776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895713899510538:8965]
2025-09-30T14:54:22.561779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895713899510538:8965]
2025-09-30T14:54:22.561782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895713899510538:8965]
2025-09-30T14:54:22.561820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:22.561826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.561828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:22.562266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:22.562275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:22.562278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:22.563425Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:22.578782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1498 sessionId: src_id|37ba3cd7-d7ab7ab5-f941836-4c9576ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:22.581792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:22.603475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895713989262640:8563]
2025-09-30T14:54:22.603895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1497, pipe: [1:7555895713989262640:8563]
2025-09-30T14:54:22.691188Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:22.691807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:22.691826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:22.691852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895713989262640:8563], now have 1 active actors on pipe
2025-09-30T14:54:22.692172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:22.692207Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:22.692214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:22.692218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:22.692242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895713989262640:8563]
2025-09-30T14:54:22.692296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1498 reason: error at write: Disconnected sessionId: src_id|37ba3cd7-d7ab7ab5-f941836-4c9576ec_0
2025-09-30T14:54:22.692550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1498 sessionId: src_id|37ba3cd7-d7ab7ab5-f941836-4c9576ec_0 is DEAD
2025-09-30T14:54:22.692691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37ba3cd7-d7ab7ab5-f941836-4c9576ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:22.692704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37ba3cd7-d7ab7ab5-f941836-4c9576ec_0] Write session will restart in 0.008100s
2025-09-30T14:54:22.692727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37ba3cd7-d7ab7ab5-f941836-4c9576ec_0] Write session: Do CDS request
2025-09-30T14:54:22.692735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37ba3cd7-d7ab7ab5-f941836-4c9576ec_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:22.701753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37ba3cd7-d7ab7ab5-f941836-4c9576ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:22.701857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:22.701872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1499
2025-09-30T14:54:22.702012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1499 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:22.702045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1499 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:22.702057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1499 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:22.702062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:22.702575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1499 sessionId:  describe result for acl check
2025-09-30T14:54:22.702613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:22.702622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:22.702624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:22.702631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895713989262709:9158] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:22.703213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895713989262709:9158] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:22.705468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895713989262709:9158] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:22.707076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:22.709887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:22.710095Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:22.710109Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:22.710120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:22.710173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:22.710227Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895713899510664:8980]
2025-09-30T14:54:22.710339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895713989262709:9158] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:22.710356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895713989262709:9158] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:22.710360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895713989262709:9158] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:22.710368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1499 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:22.710919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:22.711240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:22.711303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:22.711647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:22.711697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:22.711698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:22.711700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:22.711701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:22.711702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:22.711704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:22.711705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:22.711707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:22.711709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:22.711710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:22.711711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.711713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:22.711714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:22.711717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:22.711718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:22.711724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:22.711736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:22.711740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:22.711745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:22.711749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:22.711754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:22.711758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:22.711762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:22.711766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:22.711771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:22.711776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.711780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:22.711784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:22.711788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:22.711792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:22.711799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:22.711807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:22.711813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:22.711819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:22.711824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:22.711830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:22.711835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:22.711841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:22.711846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:22.711851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:22.711856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:22.711862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:22.711867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:22.711873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:22.711879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:22.711885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:22.711891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:22.711897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:22.711901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:22.711907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:22.711912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.711918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.711924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:22.711930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:22.711936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:22.711942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:22.711947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:22.711953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:22.711958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:22.711964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:22.712014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:22.718470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:22.720795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1498
2025-09-30T14:54:22.720834Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1498
2025-09-30T14:54:22.722287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1499 partition: 0 MaxSeqNo: 42 sessionId: src_id|a17ce6a1-3fe64319-9b545f6f-3dead1f0_0
2025-09-30T14:54:22.722698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37ba3cd7-d7ab7ab5-f941836-4c9576ec_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a17ce6a1-3fe64319-9b545f6f-3dead1f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:22.719511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:22.719530Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:22.719535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:22.719540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:22.719548Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1498 [2:7555895713899510664:8980]
2025-09-30T14:54:22.719567Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:22.719585Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:22.719592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:22.719598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:22.719600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:22.719616Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:22.719622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:22.719630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:22.719706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.719709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:22.719711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:22.719715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:22.719717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:22.719799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:22.719802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.719815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:22.719827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:22.719844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:22.719863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895713899510659:8980]
2025-09-30T14:54:22.719867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895713899510659:8980]
2025-09-30T14:54:22.719870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895713899510659:8980]
2025-09-30T14:54:22.719879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:22.719896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:22.719912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:22.719914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:22.719915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:22.719918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:22.719920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:22.719955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895713989262742:9158], now have 1 active actors on pipe
2025-09-30T14:54:22.719958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895713989262666:2454], now have 1 active actors on pipe
2025-09-30T14:54:22.719961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895713899510659:8980]
2025-09-30T14:54:22.719974Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:22.720069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:22.721696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:22.721706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:22.721735Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a17ce6a1-3fe64319-9b545f6f-3dead1f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:22.721745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:22.721748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:22.721752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:22.721767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:22.721782Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:22.721797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:22.722137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:22.722143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:22.722164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:22.725704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a17ce6a1-3fe64319-9b545f6f-3dead1f0_0] Write session: try to update token
2025-09-30T14:54:22.725723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a17ce6a1-3fe64319-9b545f6f-3dead1f0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:22.735162Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:22.735190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:22.735193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:22.735195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:22.735204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895713899510659:8980]
2025-09-30T14:54:22.735209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895713899510659:8980]
2025-09-30T14:54:22.735213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895713899510659:8980]
2025-09-30T14:54:22.735270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:22.735278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.735282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:22.735455Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:22.739424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:22.739448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:22.739454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:22.742082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1499 sessionId: src_id|a17ce6a1-3fe64319-9b545f6f-3dead1f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:22.744938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:22.792415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895713989262755:8563]
2025-09-30T14:54:22.794426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1498, pipe: [1:7555895713989262755:8563]
2025-09-30T14:54:22.852799Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:22.853171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:22.853182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:22.853223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895713989262755:8563], now have 1 active actors on pipe
2025-09-30T14:54:22.853735Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:22.859888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a17ce6a1-3fe64319-9b545f6f-3dead1f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:22.859903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a17ce6a1-3fe64319-9b545f6f-3dead1f0_0] Write session will restart in 0.007410s
2025-09-30T14:54:22.859929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a17ce6a1-3fe64319-9b545f6f-3dead1f0_0] Write session: Do CDS request
2025-09-30T14:54:22.859935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a17ce6a1-3fe64319-9b545f6f-3dead1f0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:22.859258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:22.859340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895713989262755:8563]
2025-09-30T14:54:22.859373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:22.859481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1499 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a17ce6a1-3fe64319-9b545f6f-3dead1f0_0
2025-09-30T14:54:22.859705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1499 sessionId: src_id|a17ce6a1-3fe64319-9b545f6f-3dead1f0_0 is DEAD
2025-09-30T14:54:22.868720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a17ce6a1-3fe64319-9b545f6f-3dead1f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:22.869244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:22.869262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1500
2025-09-30T14:54:22.869465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1500 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:22.869505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1500 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:22.869511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1500 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:22.869516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:22.870193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1500 sessionId:  describe result for acl check
2025-09-30T14:54:22.870234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:22.870237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:22.870239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:22.870247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895713989262765:9162] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:22.870908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895713989262765:9162] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:22.875593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895713989262765:9162] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:22.878970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895713989262765:9162] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:22.878994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895713989262765:9162] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:22.878998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895713989262765:9162] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:22.879007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1500 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:22.884838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:22.887156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:22.887526Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:22.887536Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:22.887551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:22.887622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:22.887667Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895713899510749:8982]
2025-09-30T14:54:22.888576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:22.889083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:22.889135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:22.889548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:22.889614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:22.889616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:22.889617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:22.889619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:22.889620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:22.889622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:22.889624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:22.889629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:22.889630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:22.889631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:22.889633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.889634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:22.889636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:22.889637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:22.889638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:22.889645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:22.889658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:22.889663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:22.889667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:22.889672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:22.889677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:22.889682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:22.889687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:22.889691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:22.889697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:22.889702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.889707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:22.889711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:22.889716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:22.889720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:22.889730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:22.889739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:22.889746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:22.889752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:22.889761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:22.889767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:22.889772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:22.889778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:22.889788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:22.889795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:22.889800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:22.889806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:22.889812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:22.889819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:22.889826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:22.889831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:22.889837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:22.889860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:22.889865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:22.889872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:22.889878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.889885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.889893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:22.889899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:22.889904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:22.889910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:22.889915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:22.889921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:22.889929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:22.889936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:22.889991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:22.896990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:22.898041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:22.898049Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:22.898054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:22.898059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:22.898067Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1499 [2:7555895713899510749:8982]
2025-09-30T14:54:22.898090Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:22.898109Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:22.898114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:22.898118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:22.898121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:22.898149Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:22.898158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:22.898168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:22.898251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.898258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:22.898263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:22.898268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:22.898271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:22.898365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:22.898369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.898384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:22.898398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:22.898417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:22.898439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895713899510743:8982]
2025-09-30T14:54:22.898442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895713899510743:8982]
2025-09-30T14:54:22.898445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895713899510743:8982]
2025-09-30T14:54:22.898460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:22.898481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:22.898497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:22.898501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:22.898549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895713899510743:8982]
2025-09-30T14:54:22.898552Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:22.898940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:22.898949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:22.898952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:22.898958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:22.900267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895713989262807:9162], now have 1 active actors on pipe
2025-09-30T14:54:22.900284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895713989262757:2454], now have 1 active actors on pipe
2025-09-30T14:54:22.900309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:22.900319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:22.900366Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31252fe5-7e3ee0d5-c955dfd3-f0059b1f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:22.900385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:22.900396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:22.900404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:22.900422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:22.900440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:22.900465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:22.901220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:22.901230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:22.901250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:22.899543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1499
2025-09-30T14:54:22.899582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1499
2025-09-30T14:54:22.901410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1500 partition: 0 MaxSeqNo: 42 sessionId: src_id|31252fe5-7e3ee0d5-c955dfd3-f0059b1f_0
2025-09-30T14:54:22.903468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a17ce6a1-3fe64319-9b545f6f-3dead1f0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|31252fe5-7e3ee0d5-c955dfd3-f0059b1f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:22.906234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31252fe5-7e3ee0d5-c955dfd3-f0059b1f_0] Write session: try to update token
2025-09-30T14:54:22.906259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31252fe5-7e3ee0d5-c955dfd3-f0059b1f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:22.914031Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:22.914056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:22.914069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895713899510743:8982]
2025-09-30T14:54:22.914124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:22.914332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:22.914498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:22.914656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:22.914811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:22.915044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:22.915090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:22.915468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:22.928074Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:22.928102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:22.928105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:22.928108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:22.928121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895713899510743:8982]
2025-09-30T14:54:22.928125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895713899510743:8982]
2025-09-30T14:54:22.928132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895713899510743:8982]
2025-09-30T14:54:22.928176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:22.928183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:22.928185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:22.928334Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:22.928809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:22.928829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:22.928837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:22.938303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1500 sessionId: src_id|31252fe5-7e3ee0d5-c955dfd3-f0059b1f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:22.941725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:22.959424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895713989262850:8563]
2025-09-30T14:54:22.959860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1499, pipe: [1:7555895713989262850:8563]
2025-09-30T14:54:23.054253Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:23.054575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:23.054585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:23.054603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895713989262850:8563], now have 1 active actors on pipe
2025-09-30T14:54:23.054860Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:23.055555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31252fe5-7e3ee0d5-c955dfd3-f0059b1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:23.055567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31252fe5-7e3ee0d5-c955dfd3-f0059b1f_0] Write session will restart in 0.008298s
2025-09-30T14:54:23.055593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31252fe5-7e3ee0d5-c955dfd3-f0059b1f_0] Write session: Do CDS request
2025-09-30T14:54:23.055599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31252fe5-7e3ee0d5-c955dfd3-f0059b1f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:23.054967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895713989262850:8563]
2025-09-30T14:54:23.055001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:23.055003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:23.055076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1500 reason: error at write: Disconnected sessionId: src_id|31252fe5-7e3ee0d5-c955dfd3-f0059b1f_0
2025-09-30T14:54:23.055320Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:23.055591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1500 sessionId: src_id|31252fe5-7e3ee0d5-c955dfd3-f0059b1f_0 is DEAD
2025-09-30T14:54:23.064808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31252fe5-7e3ee0d5-c955dfd3-f0059b1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:23.067668Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:23.067690Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1501
2025-09-30T14:54:23.067870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1501 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:23.067907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1501 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:23.067914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1501 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:23.067919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:23.070161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1501 sessionId:  describe result for acl check
2025-09-30T14:54:23.070197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:23.070199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:23.070201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:23.070209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895718284230160:9166] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:23.070858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895718284230160:9166] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:23.075375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895718284230160:9166] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:23.081792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:23.082339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895718284230160:9166] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:23.082356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895718284230160:9166] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:23.082360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895718284230160:9166] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:23.082368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1501 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:23.083626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:23.083849Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:23.083860Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:23.083871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:23.083929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:23.083979Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895718194478130:8984]
2025-09-30T14:54:23.084665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:23.085379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:23.085439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:23.085827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:23.085915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:23.085922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:23.085923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:23.085925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:23.085926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:23.085927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:23.085928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:23.085930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:23.085931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:23.085932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:23.085934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.085935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.085937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.085938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:23.085939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:23.085946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:23.085956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:23.085961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:23.085965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:23.085968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:23.085972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:23.085975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:23.085979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:23.085983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:23.085988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:23.085991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.085995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.085999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.086002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:23.086006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:23.086013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:23.086021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:23.086027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:23.086032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:23.086038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:23.086043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:23.086048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:23.086053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:23.086060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:23.086065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:23.086069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:23.086075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:23.086080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:23.086086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:23.086090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:23.086095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:23.086100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:23.086113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:23.086119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:23.086125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:23.086130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.086135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.086140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.086146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.086150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.086156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.086161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:23.086167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:23.086172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:23.086178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:23.086224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:23.092653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:23.093606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:23.093614Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:23.093618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:23.093625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:23.093633Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1500 [2:7555895718194478130:8984]
2025-09-30T14:54:23.093651Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:23.093670Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:23.093674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:23.093677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:23.093679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:23.093697Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:23.093705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:23.093712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:23.093780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.093782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.093787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.093794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:23.093797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:23.093999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:23.094004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.094020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.094035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.094057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:23.094076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895718284230234:9166], now have 1 active actors on pipe
2025-09-30T14:54:23.094081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895718284230148:2454], now have 1 active actors on pipe
2025-09-30T14:54:23.094088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895718194478124:8984]
2025-09-30T14:54:23.094090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895718194478124:8984]
2025-09-30T14:54:23.094092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895718194478124:8984]
2025-09-30T14:54:23.094112Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:23.094128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:23.094143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:23.094149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:23.094187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895718194478124:8984]
2025-09-30T14:54:23.094190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:23.094452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:23.094463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:23.094466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:23.094471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:23.095085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:23.095102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:23.095132Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20df0289-f9785456-46da7530-2674a49_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:23.095142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:23.095146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:23.095150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:23.095161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:23.094453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1500
2025-09-30T14:54:23.095174Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:23.095194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:23.094492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1500
2025-09-30T14:54:23.099662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:23.099686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:23.099718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:23.099847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1501 partition: 0 MaxSeqNo: 42 sessionId: src_id|20df0289-f9785456-46da7530-2674a49_0
2025-09-30T14:54:23.100338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31252fe5-7e3ee0d5-c955dfd3-f0059b1f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|20df0289-f9785456-46da7530-2674a49_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:23.103368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20df0289-f9785456-46da7530-2674a49_0] Write session: try to update token
2025-09-30T14:54:23.103391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20df0289-f9785456-46da7530-2674a49_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:23.107625Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:23.107648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:23.107650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:23.107654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:23.107663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895718194478124:8984]
2025-09-30T14:54:23.107668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895718194478124:8984]
2025-09-30T14:54:23.107672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895718194478124:8984]
2025-09-30T14:54:23.107710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:23.107716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.107720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:23.107736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:23.107754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:23.107758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:23.107858Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:23.124957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1501 sessionId: src_id|20df0289-f9785456-46da7530-2674a49_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:23.127692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:23.154675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895718284230250:8563]
2025-09-30T14:54:23.155284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1500, pipe: [1:7555895718284230250:8563]
2025-09-30T14:54:23.223191Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:23.223533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:23.223547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:23.223567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895718284230250:8563], now have 1 active actors on pipe
2025-09-30T14:54:23.226836Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:23.227796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20df0289-f9785456-46da7530-2674a49_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:23.227808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20df0289-f9785456-46da7530-2674a49_0] Write session will restart in 0.009216s
2025-09-30T14:54:23.227844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20df0289-f9785456-46da7530-2674a49_0] Write session: Do CDS request
2025-09-30T14:54:23.227850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20df0289-f9785456-46da7530-2674a49_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:23.227324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:23.227437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1501 reason: status is not ok: tablet will be restarted right now sessionId: src_id|20df0289-f9785456-46da7530-2674a49_0
2025-09-30T14:54:23.227649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1501 sessionId: src_id|20df0289-f9785456-46da7530-2674a49_0 is DEAD
2025-09-30T14:54:23.227784Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:23.227820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895718284230250:8563]
2025-09-30T14:54:23.227838Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:54:23.227933Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 15 consumer shared/user session shared/user_1_15_5234116388836621563_v1 is DEAD
2025-09-30T14:54:23.228616Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895628089893726:8557] disconnected; active server actors: 1
2025-09-30T14:54:23.228621Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895628089893726:8557] client user disconnected session shared/user_1_15_5234116388836621563_v1
2025-09-30T14:54:23.231480Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:54:23.231636Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:54:23.231642Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:54:23.231650Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.006576s
2025-09-30T14:54:23.237768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20df0289-f9785456-46da7530-2674a49_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:23.238298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:23.238319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1502
2025-09-30T14:54:23.238569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1502 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:23.238625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1502 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:23.238639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1502 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:23.238646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:23.239072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1502 sessionId:  describe result for acl check
2025-09-30T14:54:23.239108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:23.239109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:23.239112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:23.239117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895718284230266:9173] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:23.239713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895718284230266:9173] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:23.242385Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:54:23.242433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895718284230266:9173] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:23.242579Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:54:23.242588Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 16
2025-09-30T14:54:23.242990Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 16 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:54:23.243044Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:54:23.243130Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 auth for : user
2025-09-30T14:54:23.243965Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 Handle describe topics response
2025-09-30T14:54:23.243992Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 auth is DEAD
2025-09-30T14:54:23.244007Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:54:23.244294Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:54:23.244402Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_16_2213676333351772861_v1
2025-09-30T14:54:23.244598Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895718284230333:9177] connected; active server actors: 1
2025-09-30T14:54:23.244630Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555895718284230333:9177] session shared/user_1_16_2213676333351772861_v1
2025-09-30T14:54:23.244643Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:54:23.244659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:54:23.244669Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_16_2213676333351772861_v1" (Sender=[1:7555895718284230309:9177], Pipe=[1:7555895718284230333:9177], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:54:23.244672Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:54:23.244685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:54:23.244698Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_16_2213676333351772861_v1" (Sender=[1:7555895718284230309:9177], Pipe=[1:7555895718284230333:9177], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:54:23.244714Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_16_2213676333351772861_v1" sender [1:7555895718284230309:9177] lock partition 0 for ReadingSession "shared/user_1_16_2213676333351772861_v1" (Sender=[1:7555895718284230309:9177], Pipe=[1:7555895718284230333:9177], Partitions=[], ActiveFamilyCount=1) generation 1 step 16
2025-09-30T14:54:23.244722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:54:23.244729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000034s
2025-09-30T14:54:23.244942Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 16 Session: "shared/user_1_16_2213676333351772861_v1" ClientId: "user" PipeClient { RawX1: 7555895718284230333 RawX2: 4503603922346969 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:54:23.244964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:54:23.245712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:23.247476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:23.247665Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:23.247677Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:23.247688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:23.247741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:23.247653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895718284230266:9173] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:23.247666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895718284230266:9173] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:23.247669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895718284230266:9173] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:23.247677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1502 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:23.247782Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895718194478216:8986]
2025-09-30T14:54:23.248457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:23.248750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:23.248798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:23.249140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:23.249198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:23.249203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:23.249204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:23.249205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:23.249206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:23.249208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:23.249209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:23.249210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:23.249211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:23.249212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:23.249213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.249214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.249215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.249217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:23.249217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:23.249222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:23.249232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:23.249235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:23.249239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:23.249242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:23.249245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:23.249251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:23.249254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:23.249257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:23.249261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:23.249264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.249267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.249271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.249274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:23.249277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:23.249284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:23.249291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:23.249296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:23.249301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:23.249305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:23.249309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:23.249313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:23.249318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:23.249323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:23.249327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:23.249331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:23.249335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:23.249340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:23.249345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:23.249348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:23.249353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:23.249357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:23.249362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:23.249366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:23.249371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:23.249375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.249379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.249385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.249390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.249396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.249400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.249404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:23.249409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:23.249413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:23.249417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:23.249465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:23.255261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:23.256115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:23.256132Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:23.256135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:23.256139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:23.256146Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1501 [2:7555895718194478216:8986]
2025-09-30T14:54:23.256162Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:23.256177Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:23.256180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:23.256184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:23.256187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:23.256202Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:23.256221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:23.256233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:23.256292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.256301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.256303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.256307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:23.256309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:23.256372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:23.256379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.256392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.256404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.256423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:23.256441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895718194478211:8986]
2025-09-30T14:54:23.256444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895718194478211:8986]
2025-09-30T14:54:23.256446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895718194478211:8986]
2025-09-30T14:54:23.256454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:23.256461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:23.256464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:23.256466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:23.256468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:23.256484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:23.256486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:23.256497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895718284230345:9173], now have 1 active actors on pipe
2025-09-30T14:54:23.256501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895718284230337:9180], now have 1 active actors on pipe
2025-09-30T14:54:23.256504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895718284230254:2454], now have 1 active actors on pipe
2025-09-30T14:54:23.256534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895718194478211:8986]
2025-09-30T14:54:23.256541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:23.256630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1501
2025-09-30T14:54:23.256686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1501, pipe: [1:7555895718284230337:9180]
2025-09-30T14:54:23.256707Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1501
2025-09-30T14:54:23.256591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:23.256779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:23.256784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:23.256801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:23.256803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:23.256809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_16_2213676333351772861_v1 on pipe: [1:7555895718284230337:9180]
2025-09-30T14:54:23.256844Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9efd6262-4d140cc-eae413c8-181e5d5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:23.256846Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_16_2213676333351772861_v1:1 with generation 1501
2025-09-30T14:54:23.256861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:23.256865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:23.256867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:23.256881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:23.256890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:23.256900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:23.256904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:23.256905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:23.256919Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_16_2213676333351772861_v1
2025-09-30T14:54:23.256927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:23.256952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:23.256972Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:54:23.257261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:23.257271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:23.257285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:23.257463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1502 partition: 0 MaxSeqNo: 42 sessionId: src_id|9efd6262-4d140cc-eae413c8-181e5d5c_0
2025-09-30T14:54:23.257962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20df0289-f9785456-46da7530-2674a49_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9efd6262-4d140cc-eae413c8-181e5d5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:23.260387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:54:23.260437Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:54:23.260447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:23.260455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:23.260458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:23.260469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:54:23.260480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:54:23.260670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9efd6262-4d140cc-eae413c8-181e5d5c_0] Write session: try to update token
2025-09-30T14:54:23.260687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9efd6262-4d140cc-eae413c8-181e5d5c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:23.260644Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759244063254 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:54:23.260666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:54:23.260699Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 sending to client partition status
2025-09-30T14:54:23.269770Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:23.269792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:23.269794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:23.269796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:23.269806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895718194478211:8986]
2025-09-30T14:54:23.269811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895718194478211:8986]
2025-09-30T14:54:23.269816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895718194478211:8986]
2025-09-30T14:54:23.269876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:23.269881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:23.269882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:23.269886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:23.269889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.269892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:23.270042Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:23.276010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1502 sessionId: src_id|9efd6262-4d140cc-eae413c8-181e5d5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:23.279158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:23.388487Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:23.388842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:23.388857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:23.389115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_16_2213676333351772861_v1
2025-09-30T14:54:23.389136Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:23.389151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:23.389181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:23.389218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895718284230337:9180]
2025-09-30T14:54:23.389265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1502 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9efd6262-4d140cc-eae413c8-181e5d5c_0
2025-09-30T14:54:23.389460Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_16_2213676333351772861_v1
2025-09-30T14:54:23.389481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1502 sessionId: src_id|9efd6262-4d140cc-eae413c8-181e5d5c_0 is DEAD
2025-09-30T14:54:23.389665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9efd6262-4d140cc-eae413c8-181e5d5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:23.389676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9efd6262-4d140cc-eae413c8-181e5d5c_0] Write session will restart in 0.005614s
2025-09-30T14:54:23.389700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9efd6262-4d140cc-eae413c8-181e5d5c_0] Write session: Do CDS request
2025-09-30T14:54:23.389717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9efd6262-4d140cc-eae413c8-181e5d5c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:23.396774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9efd6262-4d140cc-eae413c8-181e5d5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:23.396863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:23.396881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1503
2025-09-30T14:54:23.397011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1503 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:23.397048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1503 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:23.397059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1503 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:23.397064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:23.397509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1503 sessionId:  describe result for acl check
2025-09-30T14:54:23.397542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:23.397549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:23.397551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:23.397557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895718284230373:9181] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:23.398136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895718284230373:9181] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:23.399838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895718284230373:9181] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:23.400063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:23.402090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:23.402316Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:23.402333Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:23.402344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:23.402407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:23.402469Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895718194478307:8989]
2025-09-30T14:54:23.403182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:23.403546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:23.403597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:23.403966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895718284230373:9181] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:23.403983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895718284230373:9181] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:23.403989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895718284230373:9181] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:23.403998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1503 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:23.403946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:23.404041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:23.404043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:23.404044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:23.404045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:23.404047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:23.404048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:23.404049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:23.404051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:23.404052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:23.404053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:23.404055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.404056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.404057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.404059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:23.404060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:23.404066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:23.404077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:23.404081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:23.404086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:23.404090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:23.404094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:23.404098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:23.404103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:23.404107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:23.404112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:23.404116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.404120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.404124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.404131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:23.404136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:23.404144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:23.404153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:23.404159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:23.404165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:23.404171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:23.404177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:23.404181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:23.404187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:23.404192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:23.404197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:23.404203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:23.404208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:23.404216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:23.404222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:23.404227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:23.404233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:23.404238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:23.404244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:23.404247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:23.404251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:23.404255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.404259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.404264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.404270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.404275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.404280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.404285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:23.404290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:23.404298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:23.404306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:23.404355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:23.409988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:23.410911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:23.410928Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:23.410931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:23.410936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:23.410942Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1502 [2:7555895718194478307:8989]
2025-09-30T14:54:23.410960Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:23.410976Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:23.410980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:23.410983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:23.410986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:23.411001Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:23.411008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:23.411015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:23.411076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.411079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.411082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.411085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:23.411090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:23.411157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:23.411160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.411173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.411186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.411205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:23.411228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895718284230358:2454], now have 1 active actors on pipe
2025-09-30T14:54:23.411235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895718194478301:8989]
2025-09-30T14:54:23.411237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895718194478301:8989]
2025-09-30T14:54:23.411239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895718194478301:8989]
2025-09-30T14:54:23.411273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:23.411283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895718284230444:9181], now have 1 active actors on pipe
2025-09-30T14:54:23.411291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:23.411308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:23.411311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:23.411345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895718194478301:8989]
2025-09-30T14:54:23.411348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:23.411524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:23.411528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:23.411531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:23.411537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:23.411702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:23.411713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:23.411739Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43a7ac8c-1ff907d0-4d94de5f-c2188f03_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:23.411747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:23.411751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:23.411753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:23.411765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:23.411777Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:23.411789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:23.412173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:23.412182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:23.412199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:23.412719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9efd6262-4d140cc-eae413c8-181e5d5c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|43a7ac8c-1ff907d0-4d94de5f-c2188f03_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:23.415492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43a7ac8c-1ff907d0-4d94de5f-c2188f03_0] Write session: try to update token
2025-09-30T14:54:23.415516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43a7ac8c-1ff907d0-4d94de5f-c2188f03_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:23.411360Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1502
2025-09-30T14:54:23.411408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1502
2025-09-30T14:54:23.412332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1503 partition: 0 MaxSeqNo: 42 sessionId: src_id|43a7ac8c-1ff907d0-4d94de5f-c2188f03_0
2025-09-30T14:54:23.424866Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:23.424888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:23.424891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:23.424893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:23.424903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895718194478301:8989]
2025-09-30T14:54:23.424911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895718194478301:8989]
2025-09-30T14:54:23.424916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895718194478301:8989]
2025-09-30T14:54:23.424955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:23.424961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.424964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:23.424970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:23.424977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:23.424981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:23.425104Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:23.435203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1503 sessionId: src_id|43a7ac8c-1ff907d0-4d94de5f-c2188f03_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:23.438030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:23.489218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895718284230466:9180]
2025-09-30T14:54:23.489523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1502, pipe: [1:7555895718284230466:9180]
2025-09-30T14:54:23.547090Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:23.547606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:23.547627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:23.547648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895718284230466:9180], now have 1 active actors on pipe
2025-09-30T14:54:23.547907Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:23.547923Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:23.547980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895718284230466:9180]
2025-09-30T14:54:23.548001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:23.548003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:23.548073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1503 reason: error at write: Disconnected sessionId: src_id|43a7ac8c-1ff907d0-4d94de5f-c2188f03_0
2025-09-30T14:54:23.548282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1503 sessionId: src_id|43a7ac8c-1ff907d0-4d94de5f-c2188f03_0 is DEAD
2025-09-30T14:54:23.548758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43a7ac8c-1ff907d0-4d94de5f-c2188f03_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:23.548770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43a7ac8c-1ff907d0-4d94de5f-c2188f03_0] Write session will restart in 0.009937s
2025-09-30T14:54:23.548794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43a7ac8c-1ff907d0-4d94de5f-c2188f03_0] Write session: Do CDS request
2025-09-30T14:54:23.548799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43a7ac8c-1ff907d0-4d94de5f-c2188f03_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:23.562021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:23.563889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43a7ac8c-1ff907d0-4d94de5f-c2188f03_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:23.564174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:23.564410Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:23.564422Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:23.564435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:23.564515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:23.564559Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895718194478407:8992]
2025-09-30T14:54:23.565227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:23.565623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:23.565687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:23.565891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:23.565906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1504
2025-09-30T14:54:23.566073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:23.566083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1504 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:23.566145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:23.566152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:23.566153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:23.566154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:23.566139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1504 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:23.566156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:23.566149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1504 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:23.566158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:23.566153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:23.566159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:23.566161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:23.566162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:23.566163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:23.566165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.566166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.566168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.566171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:23.566173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:23.566179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:23.566190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:23.566195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:23.566200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:23.566204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:23.566209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:23.566214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:23.566218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:23.566222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:23.566227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:23.566232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.566236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.566241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.566245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:23.566250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:23.566258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:23.566267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:23.566274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:23.566280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:23.566288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:23.566293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:23.566299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:23.566305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:23.566310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:23.566321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:23.566326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:23.566332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:23.566342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:23.566347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:23.566355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:23.566361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:23.566370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:23.566376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:23.566380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:23.566385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:23.566394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.566400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.566410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.566415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.566425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.566430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.566435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:23.566440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:23.566449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:23.566454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:23.566496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:23.566674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1504 sessionId:  describe result for acl check
2025-09-30T14:54:23.566713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:23.566720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:23.566722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:23.566728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895718284230520:9186] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:23.567356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895718284230520:9186] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:23.573101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895718284230520:9186] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:23.575878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:23.576957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:23.576979Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:23.576982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:23.576986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:23.576994Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1503 [2:7555895718194478407:8992]
2025-09-30T14:54:23.577012Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:23.577032Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:23.577034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:23.577038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:23.577040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:23.577058Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:23.577065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:23.577074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:23.577135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.577144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.577147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.577151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:23.577153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:23.577226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:23.577234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.577249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.577267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.577291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:23.577312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895718194478402:8992]
2025-09-30T14:54:23.577322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895718194478402:8992]
2025-09-30T14:54:23.577324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895718194478402:8992]
2025-09-30T14:54:23.577334Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:23.577347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:23.577363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:23.577365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:23.577373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:23.577393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:23.577395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:23.577403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895718194478402:8992]
2025-09-30T14:54:23.577405Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:23.577412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:23.577425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895718284230467:2454], now have 1 active actors on pipe
2025-09-30T14:54:23.577792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895718284230520:9186] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:23.577813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895718284230520:9186] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:23.577817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895718284230520:9186] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:23.577827Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1504 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:23.577979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1503
2025-09-30T14:54:23.578567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1503
2025-09-30T14:54:23.579591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895718284230556:9186], now have 1 active actors on pipe
2025-09-30T14:54:23.579619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:23.579626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:23.579657Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eaf3b6d6-18c38029-bfe94efb-d51d206c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:23.579673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:23.579679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:23.579682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:23.579694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:23.579732Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:23.579754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:23.579997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:23.580015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:23.580044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:23.580193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1504 partition: 0 MaxSeqNo: 42 sessionId: src_id|eaf3b6d6-18c38029-bfe94efb-d51d206c_0
2025-09-30T14:54:23.582685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43a7ac8c-1ff907d0-4d94de5f-c2188f03_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|eaf3b6d6-18c38029-bfe94efb-d51d206c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:23.586262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf3b6d6-18c38029-bfe94efb-d51d206c_0] Write session: try to update token
2025-09-30T14:54:23.586290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf3b6d6-18c38029-bfe94efb-d51d206c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:23.592474Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:23.592496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:23.592507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895718194478402:8992]
2025-09-30T14:54:23.592560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:23.592751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:23.592916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:23.593067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:23.593218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:23.593427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:23.593476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:23.593561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:23.604720Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:23.604744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:23.604749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:23.604752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:23.604763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895718194478402:8992]
2025-09-30T14:54:23.604769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895718194478402:8992]
2025-09-30T14:54:23.604777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895718194478402:8992]
2025-09-30T14:54:23.604822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:23.604830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.604833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:23.607094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1504 sessionId: src_id|eaf3b6d6-18c38029-bfe94efb-d51d206c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:23.604982Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:23.607370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:23.607387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:23.607392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:23.609867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:23.647957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895718284230567:9180]
2025-09-30T14:54:23.648301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1503, pipe: [1:7555895718284230567:9180]
2025-09-30T14:54:23.727352Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:23.727802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:23.727823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:23.727842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895718284230567:9180], now have 1 active actors on pipe
2025-09-30T14:54:23.728022Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:23.728114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895718284230567:9180]
2025-09-30T14:54:23.728189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:23.728237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:23.728376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1504 reason: status is not ok: tablet will be restarted right now sessionId: src_id|eaf3b6d6-18c38029-bfe94efb-d51d206c_0
2025-09-30T14:54:23.728575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1504 sessionId: src_id|eaf3b6d6-18c38029-bfe94efb-d51d206c_0 is DEAD
2025-09-30T14:54:23.728780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf3b6d6-18c38029-bfe94efb-d51d206c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:23.728790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf3b6d6-18c38029-bfe94efb-d51d206c_0] Write session will restart in 0.006856s
2025-09-30T14:54:23.728812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf3b6d6-18c38029-bfe94efb-d51d206c_0] Write session: Do CDS request
2025-09-30T14:54:23.728818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf3b6d6-18c38029-bfe94efb-d51d206c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:23.736800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf3b6d6-18c38029-bfe94efb-d51d206c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:23.736882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:23.736897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1505
2025-09-30T14:54:23.737035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1505 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:23.737090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1505 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:23.737101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1505 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:23.737105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:23.737516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1505 sessionId:  describe result for acl check
2025-09-30T14:54:23.737548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:23.737555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:23.737557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:23.737563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895718284230641:9198] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:23.738112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895718284230641:9198] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:23.739226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:23.740488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895718284230641:9198] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:23.740991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:23.741189Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:23.741200Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:23.741211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:23.741283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:23.741326Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895718194478534:9001]
2025-09-30T14:54:23.741967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:23.742312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:23.742573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:23.742934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:23.743036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:23.743044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:23.743045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:23.743047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:23.743048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:23.743049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:23.743050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:23.743052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:23.743053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:23.743054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:23.743056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.743057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.743058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.743060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:23.743061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:23.743068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:23.743080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:23.743085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:23.743090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:23.743095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:23.743099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:23.743104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:23.743109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:23.743113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:23.743119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:23.743123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.743127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.743143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.743148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:23.743152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:23.743161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:23.743169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:23.743176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:23.743182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:23.743188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:23.743194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:23.743199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:23.743206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:23.743216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:23.743222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:23.743229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:23.743235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:23.743240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:23.743260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:23.743266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:23.743271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:23.743282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:23.743288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:23.743293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:23.743300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:23.743310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.743316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.743321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.743328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.743333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.743356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.743365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:23.743372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:23.743379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:23.743385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:23.743438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:23.743840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895718284230641:9198] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:23.743856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895718284230641:9198] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:23.743860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895718284230641:9198] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:23.743868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1505 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:23.749241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:23.750154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:23.750175Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:23.750180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:23.750185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:23.750192Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1504 [2:7555895718194478534:9001]
2025-09-30T14:54:23.750211Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:23.750227Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:23.750235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:23.750239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:23.750241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:23.750256Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:23.750263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:23.750271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:23.750335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.750344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.750346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.750349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:23.750353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:23.750425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:23.750434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.750447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.750466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.750489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:23.750512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895718194478528:9001]
2025-09-30T14:54:23.750520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895718194478528:9001]
2025-09-30T14:54:23.750522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895718194478528:9001]
2025-09-30T14:54:23.750531Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:23.750541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:23.750549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:23.750553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:23.750556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:23.750564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:23.750567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:23.750578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895718284230581:2454], now have 1 active actors on pipe
2025-09-30T14:54:23.750582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895718284230680:9198], now have 1 active actors on pipe
2025-09-30T14:54:23.750613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895718194478528:9001]
2025-09-30T14:54:23.750627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:23.750650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:23.750928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1504
2025-09-30T14:54:23.750970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1504
2025-09-30T14:54:23.751180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:23.751194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:23.751221Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6fff29ad-5217dcf8-310e4c2f-ff29cf12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:23.751229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:23.751233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:23.751235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:23.751261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:23.751272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:23.751292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:23.751521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:23.751532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:23.751545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:23.751661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1505 partition: 0 MaxSeqNo: 42 sessionId: src_id|6fff29ad-5217dcf8-310e4c2f-ff29cf12_0
2025-09-30T14:54:23.752021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf3b6d6-18c38029-bfe94efb-d51d206c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6fff29ad-5217dcf8-310e4c2f-ff29cf12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:23.754862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fff29ad-5217dcf8-310e4c2f-ff29cf12_0] Write session: try to update token
2025-09-30T14:54:23.754883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fff29ad-5217dcf8-310e4c2f-ff29cf12_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:23.763066Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:23.763088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:23.763098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895718194478528:9001]
2025-09-30T14:54:23.763139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:23.763234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:23.763355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:23.763511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:23.763660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:23.763805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:23.764009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:23.764057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:23.773358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1505 sessionId: src_id|6fff29ad-5217dcf8-310e4c2f-ff29cf12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:23.774285Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:23.774307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:23.774310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:23.774312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:23.774322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895718194478528:9001]
2025-09-30T14:54:23.774327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895718194478528:9001]
2025-09-30T14:54:23.774331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895718194478528:9001]
2025-09-30T14:54:23.774374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:23.774387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.774390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:23.774536Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:23.774641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:23.774656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:23.774672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:23.776171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:23.828353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895718284230688:9180]
2025-09-30T14:54:23.828761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1504, pipe: [1:7555895718284230688:9180]
2025-09-30T14:54:23.895186Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:23.895657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:23.895672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:23.895693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895718284230688:9180], now have 1 active actors on pipe
2025-09-30T14:54:23.895902Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:23.896542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fff29ad-5217dcf8-310e4c2f-ff29cf12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:23.896554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fff29ad-5217dcf8-310e4c2f-ff29cf12_0] Write session will restart in 0.005912s
2025-09-30T14:54:23.896578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fff29ad-5217dcf8-310e4c2f-ff29cf12_0] Write session: Do CDS request
2025-09-30T14:54:23.896583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fff29ad-5217dcf8-310e4c2f-ff29cf12_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:23.895983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:23.896043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895718284230688:9180]
2025-09-30T14:54:23.896073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:23.896160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1505 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6fff29ad-5217dcf8-310e4c2f-ff29cf12_0
2025-09-30T14:54:23.896377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1505 sessionId: src_id|6fff29ad-5217dcf8-310e4c2f-ff29cf12_0 is DEAD
2025-09-30T14:54:23.903866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fff29ad-5217dcf8-310e4c2f-ff29cf12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:23.903955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:23.903970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1506
2025-09-30T14:54:23.904114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1506 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:23.904154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1506 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:23.904164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1506 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:23.904168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:23.904579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1506 sessionId:  describe result for acl check
2025-09-30T14:54:23.904606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:23.904613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:23.904615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:23.904620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895718284230722:9202] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:23.905157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895718284230722:9202] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:23.906576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:23.907361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895718284230722:9202] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:23.908253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:23.908448Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:23.908459Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:23.908470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:23.908520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:23.908556Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895718194478623:9009]
2025-09-30T14:54:23.909187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:23.909521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:23.909562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:23.909700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895718284230722:9202] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:23.909713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895718284230722:9202] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:23.909717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895718284230722:9202] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:23.909725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1506 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:23.909897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:23.909964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:23.909971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:23.909972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:23.909973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:23.909975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:23.909976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:23.909977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:23.909978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:23.909979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:23.909980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:23.909981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.909982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.909984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.909985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:23.909986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:23.909991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:23.910001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:23.910005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:23.910010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:23.910013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:23.910018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:23.910022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:23.910026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:23.910029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:23.910034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:23.910038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.910042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.910046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.910050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:23.910054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:23.910061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:23.910069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:23.910075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:23.910080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:23.910085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:23.910090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:23.910094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:23.910098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:23.910102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:23.910106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:23.910110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:23.910115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:23.910119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:23.910125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:23.910130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:23.910135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:23.910140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:23.910145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:23.910149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:23.910166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:23.910170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.910175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.910179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.910183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.910188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.910194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.910199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:23.910205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:23.910210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:23.910215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:23.910259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:23.915734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:23.916623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:23.916640Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:23.916645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:23.916649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:23.916656Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1505 [2:7555895718194478623:9009]
2025-09-30T14:54:23.916672Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:23.916686Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:23.916689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:23.916692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:23.916696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:23.916709Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:23.916714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:23.916720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:23.916780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.916788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.916790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.916793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:23.916796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:23.916865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:23.916873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.916885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:23.916895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:23.916914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:23.916935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895718194478617:9009]
2025-09-30T14:54:23.916942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895718194478617:9009]
2025-09-30T14:54:23.916944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895718194478617:9009]
2025-09-30T14:54:23.916959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:23.916979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:23.916991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:23.916994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:23.916997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:23.916999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:23.917001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:23.917025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895718194478617:9009]
2025-09-30T14:54:23.917032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:23.917085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:23.917176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895718284230689:2454], now have 1 active actors on pipe
2025-09-30T14:54:23.917185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895718284230779:9202], now have 1 active actors on pipe
2025-09-30T14:54:23.917223Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1505
2025-09-30T14:54:23.917236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1505
2025-09-30T14:54:23.917282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:23.917292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:23.917320Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f79cfda9-fe4b2d44-15eeabc4-ecf87813_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:23.917327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:23.917331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:23.917333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:23.917345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:23.917354Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:23.917368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:23.917648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:23.917659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:23.917672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:23.917781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1506 partition: 0 MaxSeqNo: 42 sessionId: src_id|f79cfda9-fe4b2d44-15eeabc4-ecf87813_0
2025-09-30T14:54:23.918227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fff29ad-5217dcf8-310e4c2f-ff29cf12_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f79cfda9-fe4b2d44-15eeabc4-ecf87813_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:23.921109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f79cfda9-fe4b2d44-15eeabc4-ecf87813_0] Write session: try to update token
2025-09-30T14:54:23.921126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f79cfda9-fe4b2d44-15eeabc4-ecf87813_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:23.930025Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:23.930046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:23.930060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895718194478617:9009]
2025-09-30T14:54:23.930122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:23.930125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:23.930358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:23.930518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:23.930672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:23.930827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:23.931044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:23.931092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:23.937770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1506 sessionId: src_id|f79cfda9-fe4b2d44-15eeabc4-ecf87813_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:23.940764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:23.941059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:23.941088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:23.941113Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:23.941116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:23.941118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:23.941123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:23.941132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895718194478617:9009]
2025-09-30T14:54:23.941135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895718194478617:9009]
2025-09-30T14:54:23.941138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895718194478617:9009]
2025-09-30T14:54:23.941185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:23.941184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:23.941191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:23.941195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:23.941196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:23.941199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:23.941330Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:23.996132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895718284230789:9180]
2025-09-30T14:54:23.997224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1505, pipe: [1:7555895718284230789:9180]
2025-09-30T14:54:24.056702Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:24.057028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:24.057068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895718284230789:9180], now have 1 active actors on pipe
2025-09-30T14:54:24.057198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:24.057210Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:24.057262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895718284230789:9180]
2025-09-30T14:54:24.057349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:24.057362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:24.057436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1506 reason: error at write: Disconnected sessionId: src_id|f79cfda9-fe4b2d44-15eeabc4-ecf87813_0
2025-09-30T14:54:24.057594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1506 sessionId: src_id|f79cfda9-fe4b2d44-15eeabc4-ecf87813_0 is DEAD
2025-09-30T14:54:24.059461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f79cfda9-fe4b2d44-15eeabc4-ecf87813_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:24.059475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f79cfda9-fe4b2d44-15eeabc4-ecf87813_0] Write session will restart in 0.005411s
2025-09-30T14:54:24.059515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f79cfda9-fe4b2d44-15eeabc4-ecf87813_0] Write session: Do CDS request
2025-09-30T14:54:24.059522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f79cfda9-fe4b2d44-15eeabc4-ecf87813_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:24.065750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f79cfda9-fe4b2d44-15eeabc4-ecf87813_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:24.065989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:24.066016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1507
2025-09-30T14:54:24.066147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1507 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:24.066190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1507 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:24.066200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1507 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:24.066204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:24.066608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1507 sessionId:  describe result for acl check
2025-09-30T14:54:24.066642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:24.066644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:24.066646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:24.066652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895722579198106:9206] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:24.067190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895722579198106:9206] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:24.069227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895722579198106:9206] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:24.069834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:24.071583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:24.071783Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:24.071795Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:24.071806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:24.071856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:24.071910Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895722489446009:9011]
2025-09-30T14:54:24.071928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895722579198106:9206] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:24.071941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895722579198106:9206] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:24.071944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895722579198106:9206] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:24.071952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1507 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:24.072601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:24.072906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:24.072954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:24.073274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:24.073335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:24.073342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:24.073344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:24.073345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:24.073346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:24.073348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:24.073349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:24.073350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:24.073352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:24.073353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:24.073354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.073356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.073357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.073358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:24.073359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:24.073367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:24.073378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:24.073383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:24.073387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:24.073391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:24.073395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:24.073400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:24.073404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:24.073408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:24.073413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:24.073417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.073422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.073426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.073430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:24.073435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:24.073442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:24.073449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:24.073456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:24.073462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:24.073467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:24.073473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:24.073487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:24.073493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:24.073498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:24.073504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:24.073509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:24.073515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:24.073526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:24.073532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:24.073541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:24.073547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:24.073557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:24.073563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:24.073572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:24.073578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:24.073587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.073591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.073599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.073604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.073609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.073614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.073618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:24.073624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:24.073629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:24.073634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:24.073690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:24.079543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:24.080377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:24.080399Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:24.080402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:24.080406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:24.080414Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1506 [2:7555895722489446009:9011]
2025-09-30T14:54:24.080431Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:24.080447Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:24.080450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:24.080454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:24.080456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:24.080471Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:24.080484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:24.080491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:24.080558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.080567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.080569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.080573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:24.080575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:24.080775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1506
2025-09-30T14:54:24.080834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1506
2025-09-30T14:54:24.080642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:24.080654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.080667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.080681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.080701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:24.080719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895722579198086:2454], now have 1 active actors on pipe
2025-09-30T14:54:24.080723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895722579198174:9206], now have 1 active actors on pipe
2025-09-30T14:54:24.080731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895722489446003:9011]
2025-09-30T14:54:24.080733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895722489446003:9011]
2025-09-30T14:54:24.080735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895722489446003:9011]
2025-09-30T14:54:24.080749Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:24.080764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:24.080765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:24.080769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:24.080771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:24.080779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:24.080782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:24.080812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895722489446003:9011]
2025-09-30T14:54:24.080815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:24.080818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:24.080983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:24.080994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:24.081018Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33171de9-ccd8b3b3-a1138c19-28c65ac8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:24.081028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:24.081037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:24.081039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:24.081049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:24.081062Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:24.081080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:24.081301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:24.081315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:24.081340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:24.081432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1507 partition: 0 MaxSeqNo: 42 sessionId: src_id|33171de9-ccd8b3b3-a1138c19-28c65ac8_0
2025-09-30T14:54:24.081808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f79cfda9-fe4b2d44-15eeabc4-ecf87813_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|33171de9-ccd8b3b3-a1138c19-28c65ac8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:24.084601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33171de9-ccd8b3b3-a1138c19-28c65ac8_0] Write session: try to update token
2025-09-30T14:54:24.084621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33171de9-ccd8b3b3-a1138c19-28c65ac8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:24.094012Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:24.094034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:24.094043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895722489446003:9011]
2025-09-30T14:54:24.094090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:24.094095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:24.094292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:24.094483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:24.094633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:24.094827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:24.095131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:24.095195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:24.102055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1507 sessionId: src_id|33171de9-ccd8b3b3-a1138c19-28c65ac8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:24.104904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:24.105256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:24.105284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:24.105303Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:24.105306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:24.105308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:24.105311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:24.105319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895722489446003:9011]
2025-09-30T14:54:24.105324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895722489446003:9011]
2025-09-30T14:54:24.105327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895722489446003:9011]
2025-09-30T14:54:24.105369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:24.105372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:24.105379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.105384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:24.105384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:24.105388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:24.105519Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:24.154316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895722579198191:9180]
2025-09-30T14:54:24.154679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1506, pipe: [1:7555895722579198191:9180]
2025-09-30T14:54:24.221503Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:24.221978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:24.222022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895722579198191:9180], now have 1 active actors on pipe
2025-09-30T14:54:24.222509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:24.222634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:24.222637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:24.222709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1507 reason: error at write: Disconnected sessionId: src_id|33171de9-ccd8b3b3-a1138c19-28c65ac8_0
2025-09-30T14:54:24.222929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1507 sessionId: src_id|33171de9-ccd8b3b3-a1138c19-28c65ac8_0 is DEAD
2025-09-30T14:54:24.223258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:24.223308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895722579198191:9180]
2025-09-30T14:54:24.227637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33171de9-ccd8b3b3-a1138c19-28c65ac8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:24.227653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33171de9-ccd8b3b3-a1138c19-28c65ac8_0] Write session will restart in 0.008690s
2025-09-30T14:54:24.227681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33171de9-ccd8b3b3-a1138c19-28c65ac8_0] Write session: Do CDS request
2025-09-30T14:54:24.227688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33171de9-ccd8b3b3-a1138c19-28c65ac8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:24.237870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33171de9-ccd8b3b3-a1138c19-28c65ac8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:24.237943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:24.237968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1508
2025-09-30T14:54:24.238111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1508 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:24.238161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1508 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:24.238172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1508 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:24.238177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:24.238870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1508 sessionId:  describe result for acl check
2025-09-30T14:54:24.238906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:24.238913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:24.238915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:24.238921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895722579198250:9211] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:24.239388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:24.239537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895722579198250:9211] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:24.241656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:24.241875Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:24.241887Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:24.241899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:24.241950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:24.241992Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895722489446100:9013]
2025-09-30T14:54:24.242007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895722579198250:9211] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:24.242680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:24.243074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:24.243113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:24.243454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:24.243527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:24.243528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:24.243529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:24.243530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:24.243532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:24.243533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:24.243534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:24.243535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:24.243537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:24.243538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:24.243540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.243541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.243542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.243543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:24.243545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:24.243553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:24.243563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:24.243566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:24.243570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:24.243573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:24.243577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:24.243580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:24.243583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:24.243587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:24.243591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:24.243594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.243597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.243601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.243604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:24.243607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:24.243614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:24.243620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:24.243625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:24.243631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:24.243635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:24.243639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:24.243643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:24.243648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:24.243652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:24.243657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:24.243660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:24.243664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:24.243668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:24.243672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:24.243676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:24.243680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:24.243688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:24.243693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:24.243698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:24.243704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:24.243709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.243714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.243719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.243724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.243729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.243734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.243738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:24.243743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:24.243747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:24.243753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:24.243799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:24.249166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895722579198250:9211] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:24.249182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895722579198250:9211] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:24.249187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895722579198250:9211] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:24.249196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1508 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:24.249720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:24.250656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:24.250674Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:24.250677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:24.250681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:24.250688Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1507 [2:7555895722489446100:9013]
2025-09-30T14:54:24.250704Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:24.250719Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:24.250727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:24.250731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:24.250733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:24.250749Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:24.250760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:24.250767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:24.250822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.250829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.250832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.250835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:24.250838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:24.250903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:24.250912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.250925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.250937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.250962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:24.250984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895722579198289:9211], now have 1 active actors on pipe
2025-09-30T14:54:24.250993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895722579198195:2454], now have 1 active actors on pipe
2025-09-30T14:54:24.251000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895722489446095:9013]
2025-09-30T14:54:24.251007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895722489446095:9013]
2025-09-30T14:54:24.251010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895722489446095:9013]
2025-09-30T14:54:24.251027Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:24.251049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:24.251038Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1507
2025-09-30T14:54:24.251049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:24.251053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:24.251039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1507
2025-09-30T14:54:24.251057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:24.251068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:24.251072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:24.251119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895722489446095:9013]
2025-09-30T14:54:24.251132Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:24.251150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:24.251156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:24.251162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:24.251211Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85afdd5b-35a30615-2a92d1ac-37671d88_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:24.251223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:24.251227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:24.251228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:24.251237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:24.251260Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:24.251277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:24.251470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:24.251481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:24.251497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:24.251565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1508 partition: 0 MaxSeqNo: 42 sessionId: src_id|85afdd5b-35a30615-2a92d1ac-37671d88_0
2025-09-30T14:54:24.251951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33171de9-ccd8b3b3-a1138c19-28c65ac8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|85afdd5b-35a30615-2a92d1ac-37671d88_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:24.254860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85afdd5b-35a30615-2a92d1ac-37671d88_0] Write session: try to update token
2025-09-30T14:54:24.254884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85afdd5b-35a30615-2a92d1ac-37671d88_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:24.264056Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:24.264083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:24.264086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:24.264089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:24.264099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895722489446095:9013]
2025-09-30T14:54:24.264104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895722489446095:9013]
2025-09-30T14:54:24.264108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895722489446095:9013]
2025-09-30T14:54:24.264148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:24.264156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.264154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:24.264159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:24.264163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:24.264167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:24.264319Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:24.276958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1508 sessionId: src_id|85afdd5b-35a30615-2a92d1ac-37671d88_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:24.279738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:24.322249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895722579198297:9180]
2025-09-30T14:54:24.322538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1507, pipe: [1:7555895722579198297:9180]
2025-09-30T14:54:24.384705Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:24.385118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:24.385131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:24.385151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895722579198297:9180], now have 1 active actors on pipe
2025-09-30T14:54:24.385427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895722579198297:9180]
2025-09-30T14:54:24.385430Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:24.385431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:24.385476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:24.385487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:24.385555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1508 reason: error at write: Disconnected sessionId: src_id|85afdd5b-35a30615-2a92d1ac-37671d88_0
2025-09-30T14:54:24.385935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85afdd5b-35a30615-2a92d1ac-37671d88_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:24.385949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85afdd5b-35a30615-2a92d1ac-37671d88_0] Write session will restart in 0.008974s
2025-09-30T14:54:24.385763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1508 sessionId: src_id|85afdd5b-35a30615-2a92d1ac-37671d88_0 is DEAD
2025-09-30T14:54:24.385992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85afdd5b-35a30615-2a92d1ac-37671d88_0] Write session: Do CDS request
2025-09-30T14:54:24.386001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85afdd5b-35a30615-2a92d1ac-37671d88_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:24.395839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85afdd5b-35a30615-2a92d1ac-37671d88_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:24.395880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:24.395895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1509
2025-09-30T14:54:24.396064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1509 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:24.396098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1509 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:24.396103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1509 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:24.396107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:24.396152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:24.396553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1509 sessionId:  describe result for acl check
2025-09-30T14:54:24.396588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:24.396596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:24.396598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:24.396603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895722579198353:9215] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:24.397120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895722579198353:9215] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:24.398026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:24.398846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895722579198353:9215] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:24.398235Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:24.398249Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:24.398260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:24.398320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:24.398355Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895722489446194:9016]
2025-09-30T14:54:24.399060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:24.399377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:24.399436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:24.399804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:24.399877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:24.399884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:24.399885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:24.399886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:24.399888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:24.399890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:24.399891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:24.399893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:24.399894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:24.399895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:24.399896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.399898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.399899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.399900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:24.399902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:24.399907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:24.399917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:24.399921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:24.399928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:24.399932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:24.399936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:24.399939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:24.399944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:24.399948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:24.399953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:24.399957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.399961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.399965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.399969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:24.399974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:24.399982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:24.399990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:24.399998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:24.400005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:24.400010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:24.400018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:24.400022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:24.400028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:24.400033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:24.400038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:24.400044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:24.400049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:24.400055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:24.400061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:24.400071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:24.400077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:24.400082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:24.400092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:24.400097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:24.400107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:24.400113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.400123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.400127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.400133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.400141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.400146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.400156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:24.400161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:24.400166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:24.400172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:24.400221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:24.405507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895722579198353:9215] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:24.405526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895722579198353:9215] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:24.405534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895722579198353:9215] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:24.405544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1509 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:24.405797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:24.406676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:24.406691Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:24.406693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:24.406696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:24.406700Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1508 [2:7555895722489446194:9016]
2025-09-30T14:54:24.406713Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:24.406726Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:24.406729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:24.406731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:24.406733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:24.406745Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:24.406754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:24.406760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:24.406814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.406822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.406826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.406829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:24.406832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:24.406885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:24.406891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.406899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.406905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.406915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:24.406929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895722579198298:2454], now have 1 active actors on pipe
2025-09-30T14:54:24.406932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895722579198392:9215], now have 1 active actors on pipe
2025-09-30T14:54:24.406937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895722489446188:9016]
2025-09-30T14:54:24.406938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895722489446188:9016]
2025-09-30T14:54:24.406939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895722489446188:9016]
2025-09-30T14:54:24.406953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:24.406966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:24.406965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:24.406969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:24.406971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:24.406978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:24.406982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:24.407015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895722489446188:9016]
2025-09-30T14:54:24.407028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:24.407028Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:24.407011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1508
2025-09-30T14:54:24.407054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1508
2025-09-30T14:54:24.407060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:24.407069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:24.407089Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3052b2f5-d501f517-134e9fe-f73ae056_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:24.407096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:24.407100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:24.407102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:24.407112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:24.407123Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:24.407135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:24.407364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:24.407378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:24.407404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:24.407517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1509 partition: 0 MaxSeqNo: 42 sessionId: src_id|3052b2f5-d501f517-134e9fe-f73ae056_0
2025-09-30T14:54:24.407861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85afdd5b-35a30615-2a92d1ac-37671d88_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3052b2f5-d501f517-134e9fe-f73ae056_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:24.410647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3052b2f5-d501f517-134e9fe-f73ae056_0] Write session: try to update token
2025-09-30T14:54:24.410665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3052b2f5-d501f517-134e9fe-f73ae056_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:24.419529Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:24.419549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:24.419552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:24.419555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:24.419564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895722489446188:9016]
2025-09-30T14:54:24.419568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895722489446188:9016]
2025-09-30T14:54:24.419573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895722489446188:9016]
2025-09-30T14:54:24.419614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:24.419622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.419625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:24.419623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:24.419634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:24.419639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:24.419764Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:24.425507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1509 sessionId: src_id|3052b2f5-d501f517-134e9fe-f73ae056_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:24.428218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:24.485586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895722579198412:9180]
2025-09-30T14:54:24.490391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1508, pipe: [1:7555895722579198412:9180]
2025-09-30T14:54:24.536052Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:24.536386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:24.536398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:24.536437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895722579198412:9180], now have 1 active actors on pipe
2025-09-30T14:54:24.536690Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:24.537071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:24.537196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1509 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3052b2f5-d501f517-134e9fe-f73ae056_0
2025-09-30T14:54:24.537440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1509 sessionId: src_id|3052b2f5-d501f517-134e9fe-f73ae056_0 is DEAD
2025-09-30T14:54:24.537598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3052b2f5-d501f517-134e9fe-f73ae056_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:24.537622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3052b2f5-d501f517-134e9fe-f73ae056_0] Write session will restart in 0.007707s
2025-09-30T14:54:24.537627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895722579198412:9180]
2025-09-30T14:54:24.537646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3052b2f5-d501f517-134e9fe-f73ae056_0] Write session: Do CDS request
2025-09-30T14:54:24.537652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3052b2f5-d501f517-134e9fe-f73ae056_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:24.537650Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:24.546819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3052b2f5-d501f517-134e9fe-f73ae056_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:24.546953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:24.546970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1510
2025-09-30T14:54:24.547094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1510 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:24.547123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1510 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:24.547128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1510 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:24.547133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:24.547572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1510 sessionId:  describe result for acl check
2025-09-30T14:54:24.547599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:24.547601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:24.547603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:24.547609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895722579198468:9220] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:24.548222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895722579198468:9220] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:24.553731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895722579198468:9220] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:24.552318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:24.555258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:24.555466Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:24.555471Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:24.555482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:24.555535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:24.555569Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895722489446299:9019]
2025-09-30T14:54:24.556298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:24.556670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:24.556730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:24.557130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:24.557230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:24.557240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:24.557242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:24.557243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:24.557245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:24.557247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:24.557248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:24.557250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:24.557252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:24.557253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:24.557255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.557256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.557258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.557259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:24.557261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:24.557268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:24.557279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:24.557284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:24.557289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:24.557293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:24.557298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:24.557303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:24.557307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:24.557311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:24.557316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:24.557321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.557325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.557330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.557335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:24.557339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:24.557348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:24.557358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:24.557365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:24.557385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:24.557392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:24.557398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:24.557403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:24.557409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:24.557415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:24.557420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:24.557425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:24.557434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:24.557439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:24.557444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:24.557449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:24.557476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:24.557489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:24.557495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:24.557499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:24.557506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:24.557512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.557517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.557522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.557528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.557538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.557544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.557549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:24.557555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:24.557561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:24.557566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:24.557615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:24.558266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895722579198468:9220] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:24.558281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895722579198468:9220] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:24.558285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895722579198468:9220] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:24.558293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1510 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:24.564312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:24.565285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:24.565308Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:24.565312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:24.565316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:24.565327Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1509 [2:7555895722489446299:9019]
2025-09-30T14:54:24.565348Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:24.565364Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:24.565368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:24.565372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:24.565374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:24.565394Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:24.565402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:24.565416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:24.565484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.565492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.565495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.565499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:24.565501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:24.565583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:24.565592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.565608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.565629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.565649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:24.565674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895722579198505:9220], now have 1 active actors on pipe
2025-09-30T14:54:24.565685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895722579198413:2454], now have 1 active actors on pipe
2025-09-30T14:54:24.565691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895722489446294:9019]
2025-09-30T14:54:24.565693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895722489446294:9019]
2025-09-30T14:54:24.565696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895722489446294:9019]
2025-09-30T14:54:24.565712Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:24.565731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:24.565752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:24.565760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:24.565770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1509
2025-09-30T14:54:24.565775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1509
2025-09-30T14:54:24.565801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895722489446294:9019]
2025-09-30T14:54:24.565808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:24.565812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:24.565813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:24.565815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:24.565821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:24.565953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:24.565964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:24.565992Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd4ee0eb-27ac3dff-dd12a331-27f2f9d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:24.566001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:24.566004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:24.566007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:24.566017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:24.566029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:24.566044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:24.566215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:24.566228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:24.566246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:24.566347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1510 partition: 0 MaxSeqNo: 42 sessionId: src_id|fd4ee0eb-27ac3dff-dd12a331-27f2f9d9_0
2025-09-30T14:54:24.566740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3052b2f5-d501f517-134e9fe-f73ae056_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fd4ee0eb-27ac3dff-dd12a331-27f2f9d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:24.569757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd4ee0eb-27ac3dff-dd12a331-27f2f9d9_0] Write session: try to update token
2025-09-30T14:54:24.569782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd4ee0eb-27ac3dff-dd12a331-27f2f9d9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:24.584472Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:24.584500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:24.584502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:24.584504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:24.584514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895722489446294:9019]
2025-09-30T14:54:24.584520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895722489446294:9019]
2025-09-30T14:54:24.584524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895722489446294:9019]
2025-09-30T14:54:24.584566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:24.584584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.584584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:24.584591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:24.584593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:24.584596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:24.584741Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:24.595952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1510 sessionId: src_id|fd4ee0eb-27ac3dff-dd12a331-27f2f9d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:24.598847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:24.637629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895722579198518:9180]
2025-09-30T14:54:24.637967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1509, pipe: [1:7555895722579198518:9180]
2025-09-30T14:54:24.710207Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:24.710689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:24.710730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:24.710751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895722579198518:9180], now have 1 active actors on pipe
2025-09-30T14:54:24.711030Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:24.711062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:24.711075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:24.711148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1510 reason: error at write: Disconnected sessionId: src_id|fd4ee0eb-27ac3dff-dd12a331-27f2f9d9_0
2025-09-30T14:54:24.711365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895722579198518:9180]
2025-09-30T14:54:24.711383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1510 sessionId: src_id|fd4ee0eb-27ac3dff-dd12a331-27f2f9d9_0 is DEAD
2025-09-30T14:54:24.711403Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:24.711792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd4ee0eb-27ac3dff-dd12a331-27f2f9d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:24.711802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd4ee0eb-27ac3dff-dd12a331-27f2f9d9_0] Write session will restart in 0.005097s
2025-09-30T14:54:24.711824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd4ee0eb-27ac3dff-dd12a331-27f2f9d9_0] Write session: Do CDS request
2025-09-30T14:54:24.711833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd4ee0eb-27ac3dff-dd12a331-27f2f9d9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:24.717845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd4ee0eb-27ac3dff-dd12a331-27f2f9d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:24.717943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:24.717960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1511
2025-09-30T14:54:24.718102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1511 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:24.718133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1511 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:24.718147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1511 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:24.718152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:24.718624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1511 sessionId:  describe result for acl check
2025-09-30T14:54:24.718659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:24.718668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:24.718670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:24.718676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895722579198535:9225] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:24.719233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895722579198535:9225] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:24.721712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895722579198535:9225] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:24.724371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:24.724528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895722579198535:9225] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:24.724550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895722579198535:9225] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:24.724554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895722579198535:9225] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:24.724563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1511 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:24.726630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:24.726836Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:24.726850Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:24.726861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:24.726924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:24.726974Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895722489446394:9021]
2025-09-30T14:54:24.727762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:24.728136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:24.728188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:24.728561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:24.728636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:24.728642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:24.728643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:24.728644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:24.728645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:24.728647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:24.728648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:24.728649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:24.728650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:24.728651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:24.728653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.728654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.728655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.728656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:24.728657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:24.728662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:24.728672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:24.728676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:24.728680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:24.728684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:24.728687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:24.728691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:24.728695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:24.728699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:24.728703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:24.728707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.728711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.728715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.728719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:24.728722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:24.728731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:24.728739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:24.728744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:24.728750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:24.728754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:24.728760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:24.728764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:24.728770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:24.728775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:24.728780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:24.728784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:24.728789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:24.728793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:24.728799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:24.728803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:24.728807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:24.728816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:24.728823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:24.728833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:24.728839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:24.728850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.728856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.728861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.728867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.728889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.728895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.728899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:24.728905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:24.728911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:24.728917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:24.728973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:24.734718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:24.735718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:24.735740Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:24.735744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:24.735748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:24.735756Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1510 [2:7555895722489446394:9021]
2025-09-30T14:54:24.735772Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:24.735788Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:24.735800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:24.735814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:24.735816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:24.735834Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:24.735845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:24.735852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:24.735912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.735920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.735922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.735925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:24.735928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:24.735995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:24.736004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.736016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.736028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.736046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:24.736734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1510
2025-09-30T14:54:24.736769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1510
2025-09-30T14:54:24.736064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895722489446388:9021]
2025-09-30T14:54:24.736084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895722489446388:9021]
2025-09-30T14:54:24.736087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895722489446388:9021]
2025-09-30T14:54:24.736100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:24.736115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:24.736132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:24.736135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:24.736170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895722489446388:9021]
2025-09-30T14:54:24.736174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:24.736266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:24.736270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:24.736273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:24.736279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895722579198611:9225], now have 1 active actors on pipe
2025-09-30T14:54:24.736280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:24.736283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895722579198519:2454], now have 1 active actors on pipe
2025-09-30T14:54:24.737066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:24.737072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:24.737097Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e0b3f97-c611788c-e6818f84-8b91b67e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:24.737105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:24.737108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:24.737113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:24.737123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:24.737134Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:24.737148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:24.737470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:24.737485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:24.737507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:24.737707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1511 partition: 0 MaxSeqNo: 42 sessionId: src_id|6e0b3f97-c611788c-e6818f84-8b91b67e_0
2025-09-30T14:54:24.738115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd4ee0eb-27ac3dff-dd12a331-27f2f9d9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6e0b3f97-c611788c-e6818f84-8b91b67e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:24.740943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e0b3f97-c611788c-e6818f84-8b91b67e_0] Write session: try to update token
2025-09-30T14:54:24.740964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e0b3f97-c611788c-e6818f84-8b91b67e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:24.753483Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:24.753509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:24.753512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:24.753514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:24.753523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895722489446388:9021]
2025-09-30T14:54:24.753528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895722489446388:9021]
2025-09-30T14:54:24.753531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895722489446388:9021]
2025-09-30T14:54:24.753577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:24.753584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.753589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:24.753729Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:24.755402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:24.755422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:24.755427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:24.773626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1511 sessionId: src_id|6e0b3f97-c611788c-e6818f84-8b91b67e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:24.776439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:24.811722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895722579198646:9180]
2025-09-30T14:54:24.812239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1510, pipe: [1:7555895722579198646:9180]
2025-09-30T14:54:24.886247Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:24.886922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:24.886931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:24.886973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895722579198646:9180], now have 1 active actors on pipe
2025-09-30T14:54:24.887260Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:24.887315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895722579198646:9180]
2025-09-30T14:54:24.887352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:24.887355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:24.887412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1511 reason: error at write: Disconnected sessionId: src_id|6e0b3f97-c611788c-e6818f84-8b91b67e_0
2025-09-30T14:54:24.887613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1511 sessionId: src_id|6e0b3f97-c611788c-e6818f84-8b91b67e_0 is DEAD
2025-09-30T14:54:24.887725Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:24.888042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e0b3f97-c611788c-e6818f84-8b91b67e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:24.888053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e0b3f97-c611788c-e6818f84-8b91b67e_0] Write session will restart in 0.005175s
2025-09-30T14:54:24.888081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e0b3f97-c611788c-e6818f84-8b91b67e_0] Write session: Do CDS request
2025-09-30T14:54:24.888087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e0b3f97-c611788c-e6818f84-8b91b67e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:24.894803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e0b3f97-c611788c-e6818f84-8b91b67e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:24.895442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:24.895471Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1512
2025-09-30T14:54:24.895641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1512 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:24.895687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1512 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:24.895698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1512 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:24.895703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:24.896158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1512 sessionId:  describe result for acl check
2025-09-30T14:54:24.896192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:24.896194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:24.896196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:24.896202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895722579198660:9236] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:24.896783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895722579198660:9236] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:24.900695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895722579198660:9236] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:24.903227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:24.904794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:24.905015Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:24.905027Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:24.905039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:24.905103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:24.905141Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895722489446527:9036]
2025-09-30T14:54:24.905245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895722579198660:9236] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:24.905260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895722579198660:9236] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:24.905263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895722579198660:9236] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:24.905272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1512 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:24.905888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:24.906196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:24.906247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:24.906581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:24.906644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:24.906652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:24.906654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:24.906655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:24.906656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:24.906657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:24.906659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:24.906660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:24.906661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:24.906663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:24.906664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.906665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.906666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.906667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:24.906668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:24.906674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:24.906685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:24.906690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:24.906694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:24.906698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:24.906702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:24.906706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:24.906711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:24.906714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:24.906719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:24.906723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.906727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.906730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.906734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:24.906739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:24.906746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:24.906754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:24.906761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:24.906767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:24.906771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:24.906777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:24.906781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:24.906787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:24.906791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:24.906797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:24.906801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:24.906807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:24.906812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:24.906817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:24.906822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:24.906827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:24.906832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:24.906838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:24.906842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:24.906847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:24.906852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.906858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.906862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.906867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.906872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.906877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.906881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:24.906887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:24.906892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:24.906898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:24.906945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:24.912774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:24.913952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:24.913971Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:24.913974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:24.913978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:24.913986Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1511 [2:7555895722489446527:9036]
2025-09-30T14:54:24.914002Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:24.914019Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:24.914023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:24.914027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:24.914030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:24.914046Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:24.914053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:24.914060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:24.914126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.914138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.914140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.914144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:24.914147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:24.914216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:24.914225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.914239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:24.914256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:24.914281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:24.914377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1511
2025-09-30T14:54:24.914429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1511
2025-09-30T14:54:24.914305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895722579198648:2454], now have 1 active actors on pipe
2025-09-30T14:54:24.914314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895722579198740:9236], now have 1 active actors on pipe
2025-09-30T14:54:24.914320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895722489446522:9036]
2025-09-30T14:54:24.914323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895722489446522:9036]
2025-09-30T14:54:24.914325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895722489446522:9036]
2025-09-30T14:54:24.914338Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:24.914354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:24.914364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:24.914368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:24.914370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:24.914372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:24.914373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:24.914412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895722489446522:9036]
2025-09-30T14:54:24.914420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:24.914429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:24.914772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:24.914787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:24.914815Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34390be0-452ed6ad-ef775a06-ea3e362b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:24.914829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:24.914839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:24.914841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:24.914852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:24.914867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:24.914886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:24.915452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:24.915468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:24.915487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:24.915609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1512 partition: 0 MaxSeqNo: 42 sessionId: src_id|34390be0-452ed6ad-ef775a06-ea3e362b_0
2025-09-30T14:54:24.916036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e0b3f97-c611788c-e6818f84-8b91b67e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|34390be0-452ed6ad-ef775a06-ea3e362b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:24.918885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34390be0-452ed6ad-ef775a06-ea3e362b_0] Write session: try to update token
2025-09-30T14:54:24.918903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34390be0-452ed6ad-ef775a06-ea3e362b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:24.928734Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:24.928756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:24.928763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895722489446522:9036]
2025-09-30T14:54:24.928802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:24.928966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:24.929107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:24.929251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:24.929384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:24.929567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:24.929595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:24.930472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:24.940532Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:24.940557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:24.940560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:24.940563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:24.940578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895722489446522:9036]
2025-09-30T14:54:24.940583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895722489446522:9036]
2025-09-30T14:54:24.940586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895722489446522:9036]
2025-09-30T14:54:24.940630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:24.940643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:24.940646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:24.940714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:24.940747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:24.940755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:24.940799Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:24.942047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1512 sessionId: src_id|34390be0-452ed6ad-ef775a06-ea3e362b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:24.944864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:24.987339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895722579198753:9180]
2025-09-30T14:54:24.987773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1511, pipe: [1:7555895722579198753:9180]
2025-09-30T14:54:25.055217Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:25.055672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:25.055686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:25.055707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895722579198753:9180], now have 1 active actors on pipe
2025-09-30T14:54:25.055917Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:25.055944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895722579198753:9180]
2025-09-30T14:54:25.055980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:25.056067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1512 reason: status is not ok: tablet will be restarted right now sessionId: src_id|34390be0-452ed6ad-ef775a06-ea3e362b_0
2025-09-30T14:54:25.056201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:25.056301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1512 sessionId: src_id|34390be0-452ed6ad-ef775a06-ea3e362b_0 is DEAD
2025-09-30T14:54:25.059559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34390be0-452ed6ad-ef775a06-ea3e362b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:25.059571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34390be0-452ed6ad-ef775a06-ea3e362b_0] Write session will restart in 0.006960s
2025-09-30T14:54:25.059607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34390be0-452ed6ad-ef775a06-ea3e362b_0] Write session: Do CDS request
2025-09-30T14:54:25.059613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34390be0-452ed6ad-ef775a06-ea3e362b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:25.066897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:25.068725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:25.068943Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:25.068954Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:25.068965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:25.069016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:25.069058Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895726784413920:9038]
2025-09-30T14:54:25.069715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:25.070079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:25.070133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:25.070510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:25.070584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:25.070591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:25.070592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:25.070593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:25.070594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:25.070596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:25.070597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:25.070598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:25.070599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:25.070601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:25.070602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.070603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.070604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.070606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:25.070607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:25.070613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:25.070624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:25.070628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:25.070632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:25.070636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:25.070640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:25.070645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:25.070649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:25.070653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:25.070658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:25.070662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.070666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.070670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.070674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:25.070677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:25.070688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:25.070696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:25.070702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:25.070709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:25.070713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:25.070719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:25.070723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:25.070729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:25.070741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:25.070746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:25.070751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:25.070756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:25.070761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:25.070772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:25.070776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:25.070788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:25.070794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:25.070804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:25.070809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:25.070818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:25.070823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.070828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.070836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.070841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.070846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.070851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.070860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:25.070865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:25.070871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:25.070878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:25.070921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:25.071791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34390be0-452ed6ad-ef775a06-ea3e362b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:25.071878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:25.071895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1513
2025-09-30T14:54:25.072127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1513 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:25.072161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1513 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:25.072171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1513 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:25.072176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:25.072630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1513 sessionId:  describe result for acl check
2025-09-30T14:54:25.072682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:25.072685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:25.072687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:25.072693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895726874166115:9240] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:25.073232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895726874166115:9240] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:25.075223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895726874166115:9240] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:25.076637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:25.077649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:25.077666Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:25.077669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:25.077673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:25.077679Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1512 [2:7555895726784413920:9038]
2025-09-30T14:54:25.077696Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:25.077711Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:25.077715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:25.077718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:25.077721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:25.077737Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:25.077700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895726874166115:9240] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:25.077717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895726874166115:9240] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:25.077721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895726874166115:9240] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:25.077730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1513 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:25.077747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:25.077759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:25.077816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.077824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.077827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.077830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:25.077832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:25.077916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:25.077924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.077938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.077955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.077976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:25.077997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895726784413914:9038]
2025-09-30T14:54:25.078004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895726784413914:9038]
2025-09-30T14:54:25.078006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895726784413914:9038]
2025-09-30T14:54:25.078014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:25.078029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:25.078036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:25.078039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:25.078041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:25.078048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:25.078051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:25.078062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895726874166050:2454], now have 1 active actors on pipe
2025-09-30T14:54:25.078071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895726874166149:9240], now have 1 active actors on pipe
2025-09-30T14:54:25.078062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1512
2025-09-30T14:54:25.078101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895726784413914:9038]
2025-09-30T14:54:25.078094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1512
2025-09-30T14:54:25.078116Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:25.078137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:25.078140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:25.078145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:25.078186Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a3e7cf1-ba55c143-6717163b-6432eb01_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:25.078197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:25.078203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:25.078210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:25.078219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:25.078233Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:25.078254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:25.078430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:25.078439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:25.078451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:25.078547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1513 partition: 0 MaxSeqNo: 42 sessionId: src_id|6a3e7cf1-ba55c143-6717163b-6432eb01_0
2025-09-30T14:54:25.078915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34390be0-452ed6ad-ef775a06-ea3e362b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6a3e7cf1-ba55c143-6717163b-6432eb01_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:25.081683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a3e7cf1-ba55c143-6717163b-6432eb01_0] Write session: try to update token
2025-09-30T14:54:25.081705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a3e7cf1-ba55c143-6717163b-6432eb01_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:25.090599Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:25.090624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:25.090628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:25.090630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:25.090640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895726784413914:9038]
2025-09-30T14:54:25.090645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895726784413914:9038]
2025-09-30T14:54:25.090649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895726784413914:9038]
2025-09-30T14:54:25.090697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:25.090704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.090707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:25.090714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:25.090721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:25.090726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:25.090851Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:25.098457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1513 sessionId: src_id|6a3e7cf1-ba55c143-6717163b-6432eb01_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:25.101307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:25.156259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895726874166162:9180]
2025-09-30T14:54:25.156539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1512, pipe: [1:7555895726874166162:9180]
2025-09-30T14:54:25.205724Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:25.206102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:25.206119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:25.206138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895726874166162:9180], now have 1 active actors on pipe
2025-09-30T14:54:25.206374Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:25.206608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:25.206699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1513 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6a3e7cf1-ba55c143-6717163b-6432eb01_0
2025-09-30T14:54:25.206742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895726874166162:9180]
2025-09-30T14:54:25.206767Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:25.206936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1513 sessionId: src_id|6a3e7cf1-ba55c143-6717163b-6432eb01_0 is DEAD
2025-09-30T14:54:25.207113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a3e7cf1-ba55c143-6717163b-6432eb01_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:25.207124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a3e7cf1-ba55c143-6717163b-6432eb01_0] Write session will restart in 0.009837s
2025-09-30T14:54:25.207148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a3e7cf1-ba55c143-6717163b-6432eb01_0] Write session: Do CDS request
2025-09-30T14:54:25.207155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a3e7cf1-ba55c143-6717163b-6432eb01_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:25.217870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a3e7cf1-ba55c143-6717163b-6432eb01_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:25.218284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:25.218301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1514
2025-09-30T14:54:25.218512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1514 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:25.218547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1514 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:25.218552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1514 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:25.218557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:25.219108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1514 sessionId:  describe result for acl check
2025-09-30T14:54:25.219141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:25.219144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:25.219146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:25.219152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895726874166223:9245] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:25.219720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895726874166223:9245] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:25.220069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:25.222418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:25.222635Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:25.222645Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:25.222655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:25.222707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:25.222751Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895726784414018:9040]
2025-09-30T14:54:25.223131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895726874166223:9245] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:25.223484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:25.223813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:25.223861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:25.224214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:25.224276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:25.224283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:25.224284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:25.224286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:25.224287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:25.224289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:25.224290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:25.224291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:25.224293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:25.224294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:25.224295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.224297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.224298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.224299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:25.224300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:25.224306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:25.224317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:25.224322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:25.224326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:25.224330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:25.224334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:25.224338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:25.224343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:25.224347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:25.224352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:25.224357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.224361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.224365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.224369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:25.224374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:25.224381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:25.224389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:25.224397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:25.224403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:25.224408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:25.224413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:25.224418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:25.224424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:25.224431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:25.224437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:25.224447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:25.224453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:25.224458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:25.224464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:25.224471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:25.224477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:25.224482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:25.224488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:25.224492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:25.224497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:25.224502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.224512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.224517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.224523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.224528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.224538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.224542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:25.224553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:25.224558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:25.224568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:25.224608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:25.230061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895726874166223:9245] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:25.230084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895726874166223:9245] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:25.230087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895726874166223:9245] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:25.230097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1514 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:25.230402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:25.231339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:25.231357Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:25.231360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:25.231364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:25.231372Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1513 [2:7555895726784414018:9040]
2025-09-30T14:54:25.231389Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:25.231407Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:25.231416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:25.231419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:25.231422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:25.231440Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:25.231453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:25.231463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:25.231512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.231519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.231520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.231522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:25.231524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:25.231577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:25.231578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.231588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.231595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.231606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:25.231626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895726784414012:9040]
2025-09-30T14:54:25.231634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895726784414012:9040]
2025-09-30T14:54:25.231637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895726784414012:9040]
2025-09-30T14:54:25.231645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:25.231655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:25.231658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:25.231659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895726874166166:2454], now have 1 active actors on pipe
2025-09-30T14:54:25.231660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:25.231666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895726874166265:9245], now have 1 active actors on pipe
2025-09-30T14:54:25.231672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:25.231687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:25.231695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:25.231724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895726784414012:9040]
2025-09-30T14:54:25.231732Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:25.231773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:25.231787Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1513
2025-09-30T14:54:25.231848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1513
2025-09-30T14:54:25.231989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:25.232003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:25.232028Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5150304e-a866a0bf-11ed4d15-ac6d11e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:25.232036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:25.232041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:25.232043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:25.232054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:25.232064Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:25.232087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:25.232272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:25.232287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:25.232412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1514 partition: 0 MaxSeqNo: 42 sessionId: src_id|5150304e-a866a0bf-11ed4d15-ac6d11e4_0
2025-09-30T14:54:25.232756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a3e7cf1-ba55c143-6717163b-6432eb01_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5150304e-a866a0bf-11ed4d15-ac6d11e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:25.232310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:25.235749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5150304e-a866a0bf-11ed4d15-ac6d11e4_0] Write session: try to update token
2025-09-30T14:54:25.235771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5150304e-a866a0bf-11ed4d15-ac6d11e4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:25.244535Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:25.244562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:25.244573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895726784414012:9040]
2025-09-30T14:54:25.244621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:25.244626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:25.244803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:25.244967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:25.245138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:25.245316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:25.245545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:25.245601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:25.252972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1514 sessionId: src_id|5150304e-a866a0bf-11ed4d15-ac6d11e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:25.255856Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:25.255881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:25.255885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:25.255887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:25.255899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895726784414012:9040]
2025-09-30T14:54:25.255904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895726784414012:9040]
2025-09-30T14:54:25.255909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895726784414012:9040]
2025-09-30T14:54:25.255956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:25.255965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.255965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:25.255972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:25.255973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:25.255977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:25.256127Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:25.256002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:25.306845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895726874166273:9180]
2025-09-30T14:54:25.307131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1513, pipe: [1:7555895726874166273:9180]
2025-09-30T14:54:25.367669Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:25.368017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:25.368029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:25.368046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895726874166273:9180], now have 1 active actors on pipe
2025-09-30T14:54:25.368317Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:25.368316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:25.368330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:25.368334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895726874166273:9180]
2025-09-30T14:54:25.368353Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:25.368401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1514 reason: error at write: Disconnected sessionId: src_id|5150304e-a866a0bf-11ed4d15-ac6d11e4_0
2025-09-30T14:54:25.368608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1514 sessionId: src_id|5150304e-a866a0bf-11ed4d15-ac6d11e4_0 is DEAD
2025-09-30T14:54:25.368760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5150304e-a866a0bf-11ed4d15-ac6d11e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:25.368771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5150304e-a866a0bf-11ed4d15-ac6d11e4_0] Write session will restart in 0.008249s
2025-09-30T14:54:25.368796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5150304e-a866a0bf-11ed4d15-ac6d11e4_0] Write session: Do CDS request
2025-09-30T14:54:25.368804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5150304e-a866a0bf-11ed4d15-ac6d11e4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:25.377823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5150304e-a866a0bf-11ed4d15-ac6d11e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:25.378655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:25.377917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:25.377944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1515
2025-09-30T14:54:25.378167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1515 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:25.378202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1515 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:25.378207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1515 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:25.378212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:25.378662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1515 sessionId:  describe result for acl check
2025-09-30T14:54:25.378688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:25.378690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:25.378692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:25.378699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895726874166334:9249] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:25.379220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895726874166334:9249] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:25.380755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:25.380963Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:25.380975Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:25.380986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:25.381040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:25.381079Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895726784414119:9043]
2025-09-30T14:54:25.381337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895726874166334:9249] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:25.381680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:25.381960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:25.382009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:25.382337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:25.382409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:25.382416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:25.382417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:25.382418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:25.382419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:25.382421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:25.382422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:25.382423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:25.382425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:25.382426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:25.382427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.382428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.382429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.382430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:25.382431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:25.382436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:25.382445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:25.382460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:25.382464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:25.382467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:25.382471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:25.382475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:25.382479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:25.382483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:25.382487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:25.382491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.382495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.382499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.382503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:25.382507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:25.382516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:25.382524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:25.382530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:25.382536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:25.382540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:25.382547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:25.382551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:25.382558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:25.382562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:25.382567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:25.382571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:25.382580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:25.382585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:25.382590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:25.382594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:25.382599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:25.382603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:25.382613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:25.382617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:25.382622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:25.382627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.382631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.382640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.382645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.382650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.382655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.382664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:25.382667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:25.382670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:25.382673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:25.382697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:25.387423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895726874166334:9249] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:25.387442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895726874166334:9249] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:25.387445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895726874166334:9249] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:25.387454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1515 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:25.388209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:25.389111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:25.389129Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:25.389132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:25.389136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:25.389143Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1514 [2:7555895726784414119:9043]
2025-09-30T14:54:25.389159Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:25.389182Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:25.389185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:25.389188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:25.389190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:25.389207Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:25.389217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:25.389223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:25.389285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.389297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.389299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.389303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:25.389306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:25.389368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:25.389376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.389389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.389404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.389423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:25.389445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895726874166373:9249], now have 1 active actors on pipe
2025-09-30T14:54:25.389453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895726874166274:2454], now have 1 active actors on pipe
2025-09-30T14:54:25.389458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895726784414113:9043]
2025-09-30T14:54:25.389460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895726784414113:9043]
2025-09-30T14:54:25.389462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895726784414113:9043]
2025-09-30T14:54:25.389474Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:25.389486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:25.389499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:25.389501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:25.389504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1514
2025-09-30T14:54:25.389504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:25.389514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1514
2025-09-30T14:54:25.389507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:25.389508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:25.389537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895726784414113:9043]
2025-09-30T14:54:25.389540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:25.389543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:25.389567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:25.389572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:25.389602Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|762f1d31-4ab7013a-6ab36e87-1640ad7e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:25.389613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:25.389616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:25.389618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:25.389628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:25.389640Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:25.389655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:25.389883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:25.389890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:25.389903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:25.389973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1515 partition: 0 MaxSeqNo: 42 sessionId: src_id|762f1d31-4ab7013a-6ab36e87-1640ad7e_0
2025-09-30T14:54:25.390407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5150304e-a866a0bf-11ed4d15-ac6d11e4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|762f1d31-4ab7013a-6ab36e87-1640ad7e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:25.393229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|762f1d31-4ab7013a-6ab36e87-1640ad7e_0] Write session: try to update token
2025-09-30T14:54:25.393247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|762f1d31-4ab7013a-6ab36e87-1640ad7e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:25.402002Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:25.402018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:25.402021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:25.402022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:25.402033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895726784414113:9043]
2025-09-30T14:54:25.402039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895726784414113:9043]
2025-09-30T14:54:25.402043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895726784414113:9043]
2025-09-30T14:54:25.402085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:25.402089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:25.402092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.402094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:25.402097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:25.402101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:25.402255Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:25.409205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1515 sessionId: src_id|762f1d31-4ab7013a-6ab36e87-1640ad7e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:25.412315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:25.468579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895726874166394:9180]
2025-09-30T14:54:25.468810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1514, pipe: [1:7555895726874166394:9180]
2025-09-30T14:54:25.518189Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:25.518475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:25.518488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:25.518520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895726874166394:9180], now have 1 active actors on pipe
2025-09-30T14:54:25.518761Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:25.518799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:25.518814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:25.518814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895726874166394:9180]
2025-09-30T14:54:25.518842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:25.518870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1515 reason: error at write: Disconnected sessionId: src_id|762f1d31-4ab7013a-6ab36e87-1640ad7e_0
2025-09-30T14:54:25.519073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1515 sessionId: src_id|762f1d31-4ab7013a-6ab36e87-1640ad7e_0 is DEAD
2025-09-30T14:54:25.519465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|762f1d31-4ab7013a-6ab36e87-1640ad7e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:25.519476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|762f1d31-4ab7013a-6ab36e87-1640ad7e_0] Write session will restart in 0.008730s
2025-09-30T14:54:25.519501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|762f1d31-4ab7013a-6ab36e87-1640ad7e_0] Write session: Do CDS request
2025-09-30T14:54:25.519510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|762f1d31-4ab7013a-6ab36e87-1640ad7e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:25.529816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|762f1d31-4ab7013a-6ab36e87-1640ad7e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:25.530096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:25.529969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:25.529985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1516
2025-09-30T14:54:25.530244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1516 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:25.530277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1516 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:25.530283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1516 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:25.530287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:25.530696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1516 sessionId:  describe result for acl check
2025-09-30T14:54:25.530725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:25.530728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:25.530730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:25.530737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895726874166458:9254] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:25.531361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895726874166458:9254] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:25.532139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:25.532364Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:25.532378Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:25.532390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:25.532466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:25.532506Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895726784414231:9046]
2025-09-30T14:54:25.533175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:25.533507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:25.533562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:25.533577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895726874166458:9254] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:25.533929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:25.533999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:25.534013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:25.534020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:25.534021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:25.534023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:25.534024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:25.534025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:25.534026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:25.534027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:25.534029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:25.534030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.534031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.534032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.534033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:25.534034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:25.534039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:25.534050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:25.534055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:25.534060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:25.534064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:25.534068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:25.534072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:25.534077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:25.534080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:25.534083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:25.534088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.534091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.534096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.534099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:25.534103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:25.534111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:25.534119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:25.534124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:25.534129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:25.534133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:25.534137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:25.534142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:25.534146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:25.534151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:25.534156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:25.534160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:25.534164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:25.534170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:25.534191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:25.534200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:25.534206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:25.534211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:25.534216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:25.534225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:25.534234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:25.534241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.534250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.534255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.534264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.534269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.534279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.534283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:25.534288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:25.534296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:25.534301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:25.534350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:25.539957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895726874166458:9254] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:25.539974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895726874166458:9254] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:25.539978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895726874166458:9254] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:25.539988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1516 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:25.540262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:25.541172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:25.541186Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:25.541189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:25.541193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:25.541200Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1515 [2:7555895726784414231:9046]
2025-09-30T14:54:25.541216Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:25.541231Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:25.541235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:25.541239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:25.541241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:25.541258Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:25.541269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:25.541276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:25.541343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.541350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.541352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.541356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:25.541359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:25.541445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:25.541452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.541467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.541486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.541511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:25.541530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895726874166495:9254], now have 1 active actors on pipe
2025-09-30T14:54:25.541539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895726874166395:2454], now have 1 active actors on pipe
2025-09-30T14:54:25.541545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895726784414225:9046]
2025-09-30T14:54:25.541548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895726784414225:9046]
2025-09-30T14:54:25.541550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895726784414225:9046]
2025-09-30T14:54:25.541564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:25.541579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:25.541578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:25.541582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:25.541585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:25.541594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:25.541597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:25.541606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1515
2025-09-30T14:54:25.541674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1515
2025-09-30T14:54:25.541630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895726784414225:9046]
2025-09-30T14:54:25.541643Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:25.541645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:25.541658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:25.541663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:25.541707Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|553bfc69-1fcdd4f1-5a09b57-64dea18c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:25.541713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:25.541717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:25.541720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:25.541730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:25.541737Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:25.541762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:25.542115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:25.542129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:25.542152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:25.542274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1516 partition: 0 MaxSeqNo: 42 sessionId: src_id|553bfc69-1fcdd4f1-5a09b57-64dea18c_0
2025-09-30T14:54:25.542698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|762f1d31-4ab7013a-6ab36e87-1640ad7e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|553bfc69-1fcdd4f1-5a09b57-64dea18c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:25.545521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|553bfc69-1fcdd4f1-5a09b57-64dea18c_0] Write session: try to update token
2025-09-30T14:54:25.545540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|553bfc69-1fcdd4f1-5a09b57-64dea18c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:25.554455Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:25.554478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:25.554484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:25.554486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:25.554497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895726784414225:9046]
2025-09-30T14:54:25.554501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895726784414225:9046]
2025-09-30T14:54:25.554507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895726784414225:9046]
2025-09-30T14:54:25.554553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:25.554560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.554563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:25.554701Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:25.555355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:25.555370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:25.555375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:25.565386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1516 sessionId: src_id|553bfc69-1fcdd4f1-5a09b57-64dea18c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:25.568341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:25.619381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895726874166506:9180]
2025-09-30T14:54:25.619777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1515, pipe: [1:7555895726874166506:9180]
2025-09-30T14:54:25.676512Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:25.676891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:25.676907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:25.676927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895726874166506:9180], now have 1 active actors on pipe
2025-09-30T14:54:25.677171Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:25.677210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895726874166506:9180]
2025-09-30T14:54:25.677250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:25.677253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:25.677314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1516 reason: error at write: Disconnected sessionId: src_id|553bfc69-1fcdd4f1-5a09b57-64dea18c_0
2025-09-30T14:54:25.677460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:25.677539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1516 sessionId: src_id|553bfc69-1fcdd4f1-5a09b57-64dea18c_0 is DEAD
2025-09-30T14:54:25.679690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|553bfc69-1fcdd4f1-5a09b57-64dea18c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:25.679705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|553bfc69-1fcdd4f1-5a09b57-64dea18c_0] Write session will restart in 0.007112s
2025-09-30T14:54:25.679728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|553bfc69-1fcdd4f1-5a09b57-64dea18c_0] Write session: Do CDS request
2025-09-30T14:54:25.679733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|553bfc69-1fcdd4f1-5a09b57-64dea18c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:25.687791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|553bfc69-1fcdd4f1-5a09b57-64dea18c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:25.687849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:25.687867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1517
2025-09-30T14:54:25.688052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1517 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:25.688090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1517 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:25.688099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1517 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:25.688103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:25.688509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1517 sessionId:  describe result for acl check
2025-09-30T14:54:25.688546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:25.688548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:25.688550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:25.688555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895726874166568:9259] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:25.689068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895726874166568:9259] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:25.689361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:25.691089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895726874166568:9259] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:25.691178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:25.691411Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:25.691422Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:25.691433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:25.691491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:25.691531Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895726784414332:9048]
2025-09-30T14:54:25.692132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:25.692408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:25.692442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:25.692720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:25.692764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:25.692768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:25.692769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:25.692770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:25.692771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:25.692772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:25.692772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:25.692773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:25.692773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:25.692774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:25.692775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.692776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.692776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.692777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:25.692778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:25.692782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:25.692788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:25.692790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:25.692795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:25.692799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:25.692803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:25.692807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:25.692811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:25.692815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:25.692820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:25.692823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.692827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.692832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.692836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:25.692839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:25.692845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:25.692851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:25.692857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:25.692863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:25.692868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:25.692875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:25.692880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:25.692885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:25.692888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:25.692890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:25.692893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:25.692896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:25.692898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:25.692902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:25.692904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:25.692907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:25.692910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:25.692912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:25.692915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:25.692918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:25.692920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.692923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.692926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.692928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.692931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.692933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.692936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:25.692938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:25.692941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:25.692946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:25.692984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:25.693472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895726874166568:9259] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:25.693485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895726874166568:9259] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:25.693488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895726874166568:9259] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:25.693497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1517 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:25.698392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:25.699235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:25.699264Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:25.699267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:25.699270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:25.699277Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1516 [2:7555895726784414332:9048]
2025-09-30T14:54:25.699293Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:25.699311Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:25.699322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:25.699325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:25.699327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:25.699343Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:25.699349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:25.699356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:25.699410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.699419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.699421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.699424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:25.699427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:25.699492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:25.699499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.699511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.699524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.699547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:25.699571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895726874166609:9259], now have 1 active actors on pipe
2025-09-30T14:54:25.699574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895726874166507:2454], now have 1 active actors on pipe
2025-09-30T14:54:25.699581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895726784414326:9048]
2025-09-30T14:54:25.699583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895726784414326:9048]
2025-09-30T14:54:25.699585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895726784414326:9048]
2025-09-30T14:54:25.699600Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:25.699613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:25.699627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:25.699633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:25.699637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:25.699638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:25.699641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:25.699668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895726784414326:9048]
2025-09-30T14:54:25.699677Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:25.699684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:25.699657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1516
2025-09-30T14:54:25.699665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1516
2025-09-30T14:54:25.699825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:25.699835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:25.699859Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12550363-418357c4-3ba1e750-b962b64b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:25.699871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:25.699874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:25.699877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:25.699889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:25.699903Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:25.699917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:25.700086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:25.700097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:25.700121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:25.700245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1517 partition: 0 MaxSeqNo: 42 sessionId: src_id|12550363-418357c4-3ba1e750-b962b64b_0
2025-09-30T14:54:25.700638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|553bfc69-1fcdd4f1-5a09b57-64dea18c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|12550363-418357c4-3ba1e750-b962b64b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:25.703556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12550363-418357c4-3ba1e750-b962b64b_0] Write session: try to update token
2025-09-30T14:54:25.703580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12550363-418357c4-3ba1e750-b962b64b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:25.713036Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:25.713059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:25.713062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:25.713064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:25.713074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895726784414326:9048]
2025-09-30T14:54:25.713079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895726784414326:9048]
2025-09-30T14:54:25.713084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895726784414326:9048]
2025-09-30T14:54:25.713127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:25.713135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.713137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:25.713142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:25.713150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:25.713156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:25.713286Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:25.726570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1517 sessionId: src_id|12550363-418357c4-3ba1e750-b962b64b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:25.729433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:25.777366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895726874166617:9180]
2025-09-30T14:54:25.777753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1516, pipe: [1:7555895726874166617:9180]
2025-09-30T14:54:25.824219Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:25.824668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:25.824685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:25.824704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895726874166617:9180], now have 1 active actors on pipe
2025-09-30T14:54:25.824958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:25.824971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:25.825065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1517 reason: error at write: Disconnected sessionId: src_id|12550363-418357c4-3ba1e750-b962b64b_0
2025-09-30T14:54:25.825156Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:25.825276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1517 sessionId: src_id|12550363-418357c4-3ba1e750-b962b64b_0 is DEAD
2025-09-30T14:54:25.825473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:25.825517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895726874166617:9180]
2025-09-30T14:54:25.827333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12550363-418357c4-3ba1e750-b962b64b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:25.827345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12550363-418357c4-3ba1e750-b962b64b_0] Write session will restart in 0.006303s
2025-09-30T14:54:25.827368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12550363-418357c4-3ba1e750-b962b64b_0] Write session: Do CDS request
2025-09-30T14:54:25.827376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12550363-418357c4-3ba1e750-b962b64b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:25.834759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12550363-418357c4-3ba1e750-b962b64b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:25.835302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:25.835324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1518
2025-09-30T14:54:25.835505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1518 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:25.835552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1518 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:25.835556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1518 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:25.835560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:25.836251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1518 sessionId:  describe result for acl check
2025-09-30T14:54:25.836283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:25.836285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:25.836286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:25.836290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895726874166703:9270] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:25.836859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895726874166703:9270] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:25.837795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:25.838683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895726874166703:9270] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:25.840083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:25.840280Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:25.840293Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:25.840305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:25.840401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:25.840445Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895726784414471:9057]
2025-09-30T14:54:25.841059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:25.841324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:25.841368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:25.841703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:25.841767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:25.841776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:25.841778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:25.841779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:25.841780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:25.841781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:25.841782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:25.841783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:25.841784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:25.841785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:25.841790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.841791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.841792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.841793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:25.841794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:25.841799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:25.841809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:25.841813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:25.841816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:25.841820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:25.841823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:25.841827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:25.841846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:25.841850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:25.841854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:25.841857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.841861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.841864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.841868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:25.841872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:25.841878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:25.841886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:25.841893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:25.841898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:25.841902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:25.841907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:25.841911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:25.841916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:25.841920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:25.841925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:25.841929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:25.841936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:25.841940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:25.841945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:25.841949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:25.841953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:25.841958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:25.841962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:25.841967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:25.841971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:25.841976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.841981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.841985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.841991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.841996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.842000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.842004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:25.842010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:25.842014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:25.842018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:25.842059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:25.842123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895726874166703:9270] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:25.842139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895726874166703:9270] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:25.842142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895726874166703:9270] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:25.842150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1518 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:25.847759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:25.848830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:25.848846Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:25.848849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:25.848854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:25.848861Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1517 [2:7555895726784414471:9057]
2025-09-30T14:54:25.848878Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:25.848903Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:25.848911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:25.848915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:25.848917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:25.848937Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:25.848948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:25.848955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:25.849020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.849029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.849031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.849035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:25.849037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:25.849112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:25.849121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.849133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.849149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.849170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:25.849194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895726874166631:2454], now have 1 active actors on pipe
2025-09-30T14:54:25.849203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895726874166740:9270], now have 1 active actors on pipe
2025-09-30T14:54:25.849211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895726784414466:9057]
2025-09-30T14:54:25.849217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895726784414466:9057]
2025-09-30T14:54:25.849220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895726784414466:9057]
2025-09-30T14:54:25.849236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:25.849256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:25.849261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:25.849266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:25.849268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:25.849275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:25.849278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:25.849251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1517
2025-09-30T14:54:25.849313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895726784414466:9057]
2025-09-30T14:54:25.849259Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1517
2025-09-30T14:54:25.849325Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:25.849350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:25.849359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:25.849361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:25.849407Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|166e8790-c9ee3715-dbfdfcff-10de73ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:25.849420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:25.849428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:25.849432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:25.849441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:25.849450Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:25.849472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:25.849696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:25.849710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:25.849724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:25.849795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1518 partition: 0 MaxSeqNo: 42 sessionId: src_id|166e8790-c9ee3715-dbfdfcff-10de73ed_0
2025-09-30T14:54:25.850219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12550363-418357c4-3ba1e750-b962b64b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|166e8790-c9ee3715-dbfdfcff-10de73ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:25.852988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|166e8790-c9ee3715-dbfdfcff-10de73ed_0] Write session: try to update token
2025-09-30T14:54:25.853010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|166e8790-c9ee3715-dbfdfcff-10de73ed_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:25.861867Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:25.861884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:25.861887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:25.861889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:25.861897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895726784414466:9057]
2025-09-30T14:54:25.861902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895726784414466:9057]
2025-09-30T14:54:25.861910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895726784414466:9057]
2025-09-30T14:54:25.861950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:25.861958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:25.861962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.861964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:25.861965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:25.861981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:25.862128Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:25.868260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1518 sessionId: src_id|166e8790-c9ee3715-dbfdfcff-10de73ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:25.871523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:25.925822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895726874166751:9180]
2025-09-30T14:54:25.926125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1517, pipe: [1:7555895726874166751:9180]
2025-09-30T14:54:25.977097Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:25.977426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:25.977442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:25.977461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895726874166751:9180], now have 1 active actors on pipe
2025-09-30T14:54:25.977773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:25.977778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895726874166751:9180]
2025-09-30T14:54:25.977805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:25.977807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:25.977848Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:25.977887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1518 reason: error at write: Disconnected sessionId: src_id|166e8790-c9ee3715-dbfdfcff-10de73ed_0
2025-09-30T14:54:25.978258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|166e8790-c9ee3715-dbfdfcff-10de73ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:25.978266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|166e8790-c9ee3715-dbfdfcff-10de73ed_0] Write session will restart in 0.009483s
2025-09-30T14:54:25.978241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1518 sessionId: src_id|166e8790-c9ee3715-dbfdfcff-10de73ed_0 is DEAD
2025-09-30T14:54:25.978305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|166e8790-c9ee3715-dbfdfcff-10de73ed_0] Write session: Do CDS request
2025-09-30T14:54:25.978312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|166e8790-c9ee3715-dbfdfcff-10de73ed_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:25.988645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:25.988828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|166e8790-c9ee3715-dbfdfcff-10de73ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:25.988970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:25.988986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1519
2025-09-30T14:54:25.989122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1519 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:25.989154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1519 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:25.989164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1519 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:25.989168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:25.989534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1519 sessionId:  describe result for acl check
2025-09-30T14:54:25.989571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:25.989576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:25.989578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:25.989584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895726874166818:9274] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:25.990070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895726874166818:9274] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:25.990727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:25.990922Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:25.990934Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:25.990945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:25.990996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:25.991036Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895726784414574:9065]
2025-09-30T14:54:25.991679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:25.991986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:25.992030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:25.992182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895726874166818:9274] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:25.992370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:25.992429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:25.992436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:25.992437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:25.992438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:25.992439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:25.992440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:25.992441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:25.992443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:25.992444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:25.992445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:25.992446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.992447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.992448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.992449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:25.992450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:25.992456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:25.992464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:25.992468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:25.992471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:25.992475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:25.992479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:25.992482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:25.992485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:25.992489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:25.992493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:25.992496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.992500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.992503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.992507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:25.992511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:25.992518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:25.992525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:25.992531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:25.992535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:25.992539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:25.992544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:25.992547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:25.992552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:25.992557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:25.992562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:25.992566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:25.992570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:25.992575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:25.992579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:25.992583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:25.992588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:25.992592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:25.992597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:25.992600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:25.992606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:25.992610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.992615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.992619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.992623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.992626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.992631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.992643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:25.992647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:25.992654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:25.992663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:25.992701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:25.997706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895726874166818:9274] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:25.997725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895726874166818:9274] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:25.997728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895726874166818:9274] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:25.997738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1519 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:25.997999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:25.998868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:25.998882Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:25.998885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:25.998889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:25.998898Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1518 [2:7555895726784414574:9065]
2025-09-30T14:54:25.998913Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:25.998932Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:25.998935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:25.998938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:25.998941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:25.998957Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:25.998968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:25.998975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:25.999033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.999040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.999042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.999045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:25.999047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:25.999109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:25.999116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:25.999131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:25.999146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:25.999166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:25.999190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895726874166855:9274], now have 1 active actors on pipe
2025-09-30T14:54:25.999197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895726874166752:2454], now have 1 active actors on pipe
2025-09-30T14:54:25.999203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895726784414568:9065]
2025-09-30T14:54:25.999205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895726784414568:9065]
2025-09-30T14:54:25.999207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895726784414568:9065]
2025-09-30T14:54:25.999221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:25.999237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:25.999239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:25.999256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:25.999259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:25.999277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:25.999279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:25.999314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895726784414568:9065]
2025-09-30T14:54:25.999295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1518
2025-09-30T14:54:25.999326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1518
2025-09-30T14:54:25.999321Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:25.999343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:25.999357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:25.999361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:25.999388Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b1670ee-2a740f4c-922f7f45-5f9c8e1a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:25.999401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:25.999405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:25.999407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:25.999416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:25.999429Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:25.999447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:25.999702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:25.999713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:25.999728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:25.999892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1519 partition: 0 MaxSeqNo: 42 sessionId: src_id|5b1670ee-2a740f4c-922f7f45-5f9c8e1a_0
2025-09-30T14:54:26.000325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|166e8790-c9ee3715-dbfdfcff-10de73ed_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5b1670ee-2a740f4c-922f7f45-5f9c8e1a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:26.003187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b1670ee-2a740f4c-922f7f45-5f9c8e1a_0] Write session: try to update token
2025-09-30T14:54:26.003206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b1670ee-2a740f4c-922f7f45-5f9c8e1a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:26.011672Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:26.011692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:26.011694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:26.011696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:26.011706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895726784414568:9065]
2025-09-30T14:54:26.011710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895726784414568:9065]
2025-09-30T14:54:26.011714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895726784414568:9065]
2025-09-30T14:54:26.011756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:26.011765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:26.011768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.011771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:26.011782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:26.011786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:26.011923Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:26.018733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1519 sessionId: src_id|5b1670ee-2a740f4c-922f7f45-5f9c8e1a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:26.021785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:26.077914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895731169134161:9180]
2025-09-30T14:54:26.078145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1518, pipe: [1:7555895731169134161:9180]
2025-09-30T14:54:26.122891Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:26.123194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:26.123204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:26.123222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895731169134161:9180], now have 1 active actors on pipe
2025-09-30T14:54:26.123468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:26.123482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:26.123562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895731169134161:9180]
2025-09-30T14:54:26.123566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1519 reason: error at write: Disconnected sessionId: src_id|5b1670ee-2a740f4c-922f7f45-5f9c8e1a_0
2025-09-30T14:54:26.123588Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:26.123666Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:26.123781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1519 sessionId: src_id|5b1670ee-2a740f4c-922f7f45-5f9c8e1a_0 is DEAD
2025-09-30T14:54:26.123969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b1670ee-2a740f4c-922f7f45-5f9c8e1a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:26.123977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b1670ee-2a740f4c-922f7f45-5f9c8e1a_0] Write session will restart in 0.009850s
2025-09-30T14:54:26.124000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b1670ee-2a740f4c-922f7f45-5f9c8e1a_0] Write session: Do CDS request
2025-09-30T14:54:26.124006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b1670ee-2a740f4c-922f7f45-5f9c8e1a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:26.134763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b1670ee-2a740f4c-922f7f45-5f9c8e1a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:26.134823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:26.134866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:26.134882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1520
2025-09-30T14:54:26.135026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1520 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:26.135062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1520 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:26.135067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1520 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:26.135071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:26.135497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1520 sessionId:  describe result for acl check
2025-09-30T14:54:26.135534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:26.135542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:26.135544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:26.135550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895731169134233:9279] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:26.136138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895731169134233:9279] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:26.136932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:26.137129Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:26.137142Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:26.137153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:26.137211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:26.137262Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895731079381975:9067]
2025-09-30T14:54:26.137967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:26.138306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:26.138371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:26.138713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:26.138777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:26.138784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:26.138785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:26.138786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:26.138787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:26.138788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:26.138789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:26.138791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:26.138792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:26.138793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:26.138794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.138796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.138797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.138799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:26.138800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:26.138806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:26.138811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895731169134233:9279] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:26.138816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:26.138821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:26.138825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:26.138829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:26.138834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:26.138838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:26.138842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:26.138846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:26.138850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:26.138854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.138857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.138861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.138864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:26.138868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:26.138875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:26.138882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:26.138887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:26.138893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:26.138898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:26.138904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:26.138908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:26.138914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:26.138918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:26.138924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:26.138929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:26.138934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:26.138944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:26.138950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:26.138955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:26.138965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:26.138970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:26.138975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:26.138983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:26.138989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:26.138994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.139003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.139007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.139012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.139017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.139022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.139026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:26.139031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:26.139035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:26.139040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:26.139086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:26.144413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895731169134233:9279] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:26.144432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895731169134233:9279] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:26.144435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895731169134233:9279] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:26.144444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1520 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:26.144694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:26.145583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:26.145604Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:26.145607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:26.145611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:26.145618Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1519 [2:7555895731079381975:9067]
2025-09-30T14:54:26.145634Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:26.145649Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:26.145653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:26.145656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:26.145659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:26.145676Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:26.145691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:26.145701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:26.145765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.145773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.145775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.145779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:26.145781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:26.145863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:26.145874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.145887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.145916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.145937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:26.145957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895731169134271:9279], now have 1 active actors on pipe
2025-09-30T14:54:26.145966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895731169134168:2454], now have 1 active actors on pipe
2025-09-30T14:54:26.145973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895731079381968:9067]
2025-09-30T14:54:26.145975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895731079381968:9067]
2025-09-30T14:54:26.145978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895731079381968:9067]
2025-09-30T14:54:26.145993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:26.146013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:26.146020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:26.146033Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1519
2025-09-30T14:54:26.146037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1519
2025-09-30T14:54:26.146023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:26.146026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:26.146030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:26.146033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:26.146067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895731079381968:9067]
2025-09-30T14:54:26.146074Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:26.146081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:26.146238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:26.146249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:26.146274Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9cfbe865-6838d3c5-d8ab0f7-5ca1aa79_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:26.146281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:26.146286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:26.146293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:26.146305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:26.146319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:26.146338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:26.146503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:26.146512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:26.146525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:26.146654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1520 partition: 0 MaxSeqNo: 42 sessionId: src_id|9cfbe865-6838d3c5-d8ab0f7-5ca1aa79_0
2025-09-30T14:54:26.147039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b1670ee-2a740f4c-922f7f45-5f9c8e1a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9cfbe865-6838d3c5-d8ab0f7-5ca1aa79_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:26.150009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cfbe865-6838d3c5-d8ab0f7-5ca1aa79_0] Write session: try to update token
2025-09-30T14:54:26.150032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cfbe865-6838d3c5-d8ab0f7-5ca1aa79_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:26.158326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:26.158345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:26.158355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895731079381968:9067]
2025-09-30T14:54:26.158401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:26.158409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:26.158576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:26.158723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:26.158869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:26.159017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:26.159211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:26.159272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:26.165251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1520 sessionId: src_id|9cfbe865-6838d3c5-d8ab0f7-5ca1aa79_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:26.168113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:26.169415Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:26.169433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:26.169436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:26.169438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:26.169448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895731079381968:9067]
2025-09-30T14:54:26.169452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895731079381968:9067]
2025-09-30T14:54:26.169456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895731079381968:9067]
2025-09-30T14:54:26.169494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:26.169502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.169505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:26.169508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:26.169514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:26.169518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:26.169637Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:26.188749Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:11802 } ]
2025-09-30T14:54:26.223812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895731169134282:9180]
2025-09-30T14:54:26.224101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1519, pipe: [1:7555895731169134282:9180]
2025-09-30T14:54:26.286538Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:26.287035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:26.287050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:26.287070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895731169134282:9180], now have 1 active actors on pipe
2025-09-30T14:54:26.287301Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:26.287491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895731169134282:9180]
2025-09-30T14:54:26.287492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:26.287525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:26.287583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1520 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9cfbe865-6838d3c5-d8ab0f7-5ca1aa79_0
2025-09-30T14:54:26.287777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1520 sessionId: src_id|9cfbe865-6838d3c5-d8ab0f7-5ca1aa79_0 is DEAD
2025-09-30T14:54:26.287944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cfbe865-6838d3c5-d8ab0f7-5ca1aa79_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:26.287953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cfbe865-6838d3c5-d8ab0f7-5ca1aa79_0] Write session will restart in 0.006374s
2025-09-30T14:54:26.287979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cfbe865-6838d3c5-d8ab0f7-5ca1aa79_0] Write session: Do CDS request
2025-09-30T14:54:26.287985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cfbe865-6838d3c5-d8ab0f7-5ca1aa79_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:26.296269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cfbe865-6838d3c5-d8ab0f7-5ca1aa79_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:26.296363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:26.296379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1521
2025-09-30T14:54:26.296566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1521 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:26.296620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1521 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:26.296650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1521 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:26.296659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:26.297744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1521 sessionId:  describe result for acl check
2025-09-30T14:54:26.297779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:26.297781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:26.297783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:26.297789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895731169134343:9283] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:26.298339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895731169134343:9283] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:26.300487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895731169134343:9283] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:26.301522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:26.303955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:26.304191Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:26.304203Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:26.304215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:26.304276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:26.304322Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895731079382082:9070]
2025-09-30T14:54:26.305077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:26.305566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:26.305645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:26.306073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:26.306184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:26.306193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:26.306195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:26.306196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:26.306198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:26.306199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:26.306200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:26.306202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:26.306203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:26.306204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:26.306206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.306207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.306208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.306210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:26.306211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:26.306218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:26.306229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:26.306249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:26.306253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:26.306257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:26.306262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:26.306265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:26.306269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:26.306273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:26.306277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:26.306281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.306284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.306288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.306292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:26.306296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:26.306308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:26.306317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:26.306324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:26.306330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:26.306335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:26.306341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:26.306346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:26.306353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:26.306359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:26.306373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:26.306378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:26.306385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:26.306396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:26.306402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:26.306219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895731169134343:9283] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:26.306235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895731169134343:9283] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:26.306239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895731169134343:9283] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:26.306414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:26.306420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:26.306427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:26.306433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:26.306439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:26.306445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:26.306452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.306461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.306467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.306473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.306479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.306484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.306489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:26.306495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:26.306500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:26.306506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:26.306247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1521 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:26.306553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:26.312674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:26.313588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:26.313603Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:26.313610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:26.313615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:26.313622Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1520 [2:7555895731079382082:9070]
2025-09-30T14:54:26.313639Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:26.313661Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:26.313671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:26.313675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:26.313677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:26.313694Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:26.313700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:26.313708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:26.313782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.313790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.313793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.313796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:26.313799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:26.313883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:26.313892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.313907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.313919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.313943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:26.313965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895731169134284:2454], now have 1 active actors on pipe
2025-09-30T14:54:26.313973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895731169134388:9283], now have 1 active actors on pipe
2025-09-30T14:54:26.313979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895731079382076:9070]
2025-09-30T14:54:26.313982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895731079382076:9070]
2025-09-30T14:54:26.313985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895731079382076:9070]
2025-09-30T14:54:26.314007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:26.314023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:26.314026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:26.314026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:26.314028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:26.314042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:26.314047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:26.314089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895731079382076:9070]
2025-09-30T14:54:26.314100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:26.314120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:26.314107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1520
2025-09-30T14:54:26.314158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1520
2025-09-30T14:54:26.314216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:26.314231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:26.314259Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae57d00f-94f481ac-34e91378-30650258_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:26.314285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:26.314293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:26.314296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:26.314308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:26.314322Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:26.314351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:26.314542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:26.314554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:26.314577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:26.315331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1521 partition: 0 MaxSeqNo: 42 sessionId: src_id|ae57d00f-94f481ac-34e91378-30650258_0
2025-09-30T14:54:26.315786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cfbe865-6838d3c5-d8ab0f7-5ca1aa79_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ae57d00f-94f481ac-34e91378-30650258_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:26.319347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae57d00f-94f481ac-34e91378-30650258_0] Write session: try to update token
2025-09-30T14:54:26.319377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae57d00f-94f481ac-34e91378-30650258_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:26.326950Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:26.326968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:26.326970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:26.326972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:26.326985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895731079382076:9070]
2025-09-30T14:54:26.326989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895731079382076:9070]
2025-09-30T14:54:26.326993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895731079382076:9070]
2025-09-30T14:54:26.327041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:26.327047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.327050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:26.327051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:26.327057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:26.327061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:26.327185Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:26.338037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1521 sessionId: src_id|ae57d00f-94f481ac-34e91378-30650258_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:26.340799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:26.387646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895731169134397:9180]
2025-09-30T14:54:26.387912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1520, pipe: [1:7555895731169134397:9180]
2025-09-30T14:54:26.437907Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:26.438338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:26.438353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:26.438372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895731169134397:9180], now have 1 active actors on pipe
2025-09-30T14:54:26.438589Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:26.438759Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:26.438760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:26.438765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:26.438812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895731169134397:9180]
2025-09-30T14:54:26.438828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1521 reason: error at write: Disconnected sessionId: src_id|ae57d00f-94f481ac-34e91378-30650258_0
2025-09-30T14:54:26.439054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1521 sessionId: src_id|ae57d00f-94f481ac-34e91378-30650258_0 is DEAD
2025-09-30T14:54:26.439225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae57d00f-94f481ac-34e91378-30650258_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:26.439232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae57d00f-94f481ac-34e91378-30650258_0] Write session will restart in 0.008410s
2025-09-30T14:54:26.439264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae57d00f-94f481ac-34e91378-30650258_0] Write session: Do CDS request
2025-09-30T14:54:26.439272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae57d00f-94f481ac-34e91378-30650258_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:26.448768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae57d00f-94f481ac-34e91378-30650258_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:26.448848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:26.448864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1522
2025-09-30T14:54:26.449031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1522 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:26.449065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1522 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:26.449075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1522 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:26.449080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:26.449499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1522 sessionId:  describe result for acl check
2025-09-30T14:54:26.449531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:26.449534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:26.449518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:26.449536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:26.449541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895731169134466:9287] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:26.450099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895731169134466:9287] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:26.451537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:26.451738Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:26.451746Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:26.451757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:26.451806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:26.451843Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895731079382199:9073]
2025-09-30T14:54:26.451987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895731169134466:9287] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:26.452500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:26.452761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:26.452797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:26.453102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:26.453159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:26.453166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:26.453167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:26.453169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:26.453170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:26.453171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:26.453172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:26.453174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:26.453175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:26.453176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:26.453177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.453179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.453180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.453181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:26.453182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:26.453187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:26.453196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:26.453200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:26.453203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:26.453207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:26.453211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:26.453215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:26.453220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:26.453224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:26.453229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:26.453233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.453237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.453242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.453246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:26.453250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:26.453256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:26.453264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:26.453270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:26.453276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:26.453280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:26.453286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:26.453290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:26.453295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:26.453300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:26.453306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:26.453311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:26.453316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:26.453320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:26.453326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:26.453336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:26.453342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:26.453351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:26.453356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:26.453366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:26.453371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:26.453381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.453387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.453391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.453397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.453402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.453407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.453412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:26.453417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:26.453422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:26.453427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:26.453477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:26.455597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895731169134466:9287] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:26.455610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895731169134466:9287] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:26.455614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895731169134466:9287] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:26.455622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1522 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:26.458893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:26.459752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:26.459766Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:26.459769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:26.459773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:26.459780Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1521 [2:7555895731079382199:9073]
2025-09-30T14:54:26.459795Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:26.459809Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:26.459818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:26.459822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:26.459824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:26.459838Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:26.459850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:26.459857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:26.459907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.459914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.459916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.459920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:26.459923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:26.459984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:26.459991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.460003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.460015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.460034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:26.460056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895731169134506:9287], now have 1 active actors on pipe
2025-09-30T14:54:26.460064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895731169134399:2454], now have 1 active actors on pipe
2025-09-30T14:54:26.460072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895731079382193:9073]
2025-09-30T14:54:26.460075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895731079382193:9073]
2025-09-30T14:54:26.460077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895731079382193:9073]
2025-09-30T14:54:26.460089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:26.460105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:26.460106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:26.460109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:26.460088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1521
2025-09-30T14:54:26.460122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:26.460097Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1521
2025-09-30T14:54:26.460123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:26.460126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:26.460171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:26.460181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:26.460192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895731079382193:9073]
2025-09-30T14:54:26.460206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:26.460234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:26.460240Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e91782af-26095d3e-e1f68966-1b40751c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:26.460246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:26.460249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:26.460252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:26.460261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:26.460269Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:26.460291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:26.460451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:26.460461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:26.460475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:26.460546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1522 partition: 0 MaxSeqNo: 42 sessionId: src_id|e91782af-26095d3e-e1f68966-1b40751c_0
2025-09-30T14:54:26.460942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae57d00f-94f481ac-34e91378-30650258_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e91782af-26095d3e-e1f68966-1b40751c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:26.463859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e91782af-26095d3e-e1f68966-1b40751c_0] Write session: try to update token
2025-09-30T14:54:26.463887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e91782af-26095d3e-e1f68966-1b40751c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:26.472254Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:26.472274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:26.472277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:26.472279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:26.472288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895731079382193:9073]
2025-09-30T14:54:26.472293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895731079382193:9073]
2025-09-30T14:54:26.472300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895731079382193:9073]
2025-09-30T14:54:26.472341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:26.472343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:26.472349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.472350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:26.472352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:26.472353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:26.472512Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:26.478524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1522 sessionId: src_id|e91782af-26095d3e-e1f68966-1b40751c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:26.481223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:26.538691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895731169134526:9180]
2025-09-30T14:54:26.539003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1521, pipe: [1:7555895731169134526:9180]
2025-09-30T14:54:26.583920Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:26.584178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:26.584193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:26.584229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895731169134526:9180], now have 1 active actors on pipe
2025-09-30T14:54:26.584438Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:26.584467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895731169134526:9180]
2025-09-30T14:54:26.584477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:26.584481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:26.584495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:26.584545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1522 reason: error at write: Disconnected sessionId: src_id|e91782af-26095d3e-e1f68966-1b40751c_0
2025-09-30T14:54:26.584780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1522 sessionId: src_id|e91782af-26095d3e-e1f68966-1b40751c_0 is DEAD
2025-09-30T14:54:26.584932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e91782af-26095d3e-e1f68966-1b40751c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:26.584945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e91782af-26095d3e-e1f68966-1b40751c_0] Write session will restart in 0.007682s
2025-09-30T14:54:26.584969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e91782af-26095d3e-e1f68966-1b40751c_0] Write session: Do CDS request
2025-09-30T14:54:26.584978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e91782af-26095d3e-e1f68966-1b40751c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:26.593820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e91782af-26095d3e-e1f68966-1b40751c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:26.593924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:26.593940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1523
2025-09-30T14:54:26.594095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1523 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:26.594129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1523 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:26.594143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1523 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:26.594149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:26.594591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1523 sessionId:  describe result for acl check
2025-09-30T14:54:26.594629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:26.594636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:26.594638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:26.594644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895731169134600:9293] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:26.595153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895731169134600:9293] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:26.595664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:26.597546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895731169134600:9293] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:26.597536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:26.597731Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:26.597744Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:26.597757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:26.597820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:26.597879Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895731079382310:9075]
2025-09-30T14:54:26.598503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:26.599057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:26.599109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:26.599454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:26.599528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:26.599534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:26.599535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:26.599536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:26.599537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:26.599538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:26.599539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:26.599540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:26.599542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:26.599543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:26.599544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.599546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.599547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.599548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:26.599549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:26.599555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:26.599566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:26.599570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:26.599574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:26.599579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:26.599583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:26.599587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:26.599591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:26.599595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:26.599599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:26.599603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.599607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.599610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.599614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:26.599617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:26.599624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:26.599632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:26.599638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:26.599643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:26.599648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:26.599653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:26.599657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:26.599661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:26.599666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:26.599671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:26.599676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:26.599681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:26.599686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:26.599691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:26.599696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:26.599701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:26.599706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:26.599713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:26.599717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:26.599723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:26.599727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.599732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.599743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.599749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.599753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.599757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.599766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:26.599772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:26.599779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:26.599751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895731169134600:9293] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:26.599784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:26.599764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895731169134600:9293] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:26.599767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895731169134600:9293] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:26.599778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1523 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:26.599834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:26.605542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:26.606449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:26.606465Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:26.606469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:26.606474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:26.606481Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1522 [2:7555895731079382310:9075]
2025-09-30T14:54:26.606498Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:26.606516Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:26.606523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:26.606531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:26.606533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:26.606550Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:26.606564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:26.606571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:26.606635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.606643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.606646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.606650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:26.606652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:26.606746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:26.606756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.606769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.606784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.606805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:26.606830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895731169134640:9293], now have 1 active actors on pipe
2025-09-30T14:54:26.606838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895731169134533:2454], now have 1 active actors on pipe
2025-09-30T14:54:26.606844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895731079382304:9075]
2025-09-30T14:54:26.606847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895731079382304:9075]
2025-09-30T14:54:26.606849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895731079382304:9075]
2025-09-30T14:54:26.606862Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:26.606878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:26.606885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:26.606890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:26.606892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:26.606898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:26.606903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:26.606898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1522
2025-09-30T14:54:26.606909Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1522
2025-09-30T14:54:26.606950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895731079382304:9075]
2025-09-30T14:54:26.606965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:26.606977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:26.607005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:26.607016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:26.607045Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36532e64-8fc92b73-b8f217ea-ff1fc55f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:26.607057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:26.607060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:26.607062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:26.607074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:26.607085Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:26.607104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:26.607283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:26.607297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:26.607335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:26.607457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1523 partition: 0 MaxSeqNo: 42 sessionId: src_id|36532e64-8fc92b73-b8f217ea-ff1fc55f_0
2025-09-30T14:54:26.607881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e91782af-26095d3e-e1f68966-1b40751c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|36532e64-8fc92b73-b8f217ea-ff1fc55f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:26.610619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36532e64-8fc92b73-b8f217ea-ff1fc55f_0] Write session: try to update token
2025-09-30T14:54:26.610638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36532e64-8fc92b73-b8f217ea-ff1fc55f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:26.625416Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:26.625437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:26.625448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895731079382304:9075]
2025-09-30T14:54:26.625496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:26.625501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:26.625690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:26.625861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:26.626015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:26.626167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:26.626373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:26.626419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:26.630276Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:26.630291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:26.630293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:26.630295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:26.630302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895731079382304:9075]
2025-09-30T14:54:26.630308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895731079382304:9075]
2025-09-30T14:54:26.630311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895731079382304:9075]
2025-09-30T14:54:26.630345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:26.630352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.630354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:26.630396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1523 sessionId: src_id|36532e64-8fc92b73-b8f217ea-ff1fc55f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:26.630485Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:26.630512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:26.630524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:26.630528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:26.633148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:26.684628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895731169134649:9180]
2025-09-30T14:54:26.684948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1522, pipe: [1:7555895731169134649:9180]
2025-09-30T14:54:26.745177Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:26.745663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:26.745684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:26.745709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895731169134649:9180], now have 1 active actors on pipe
2025-09-30T14:54:26.745925Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:26.745965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:26.745979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:26.746056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1523 reason: error at write: Disconnected sessionId: src_id|36532e64-8fc92b73-b8f217ea-ff1fc55f_0
2025-09-30T14:54:26.746089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:26.746136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895731169134649:9180]
2025-09-30T14:54:26.746282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1523 sessionId: src_id|36532e64-8fc92b73-b8f217ea-ff1fc55f_0 is DEAD
2025-09-30T14:54:26.746490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36532e64-8fc92b73-b8f217ea-ff1fc55f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:26.746500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36532e64-8fc92b73-b8f217ea-ff1fc55f_0] Write session will restart in 0.006280s
2025-09-30T14:54:26.746523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36532e64-8fc92b73-b8f217ea-ff1fc55f_0] Write session: Do CDS request
2025-09-30T14:54:26.746530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36532e64-8fc92b73-b8f217ea-ff1fc55f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:26.753850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36532e64-8fc92b73-b8f217ea-ff1fc55f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:26.753902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:26.753917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1524
2025-09-30T14:54:26.754133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1524 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:26.754166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1524 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:26.754176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1524 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:26.754182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:26.754669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1524 sessionId:  describe result for acl check
2025-09-30T14:54:26.754708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:26.754717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:26.754719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:26.754726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895731169134665:9297] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:26.755324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895731169134665:9297] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:26.757760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895731169134665:9297] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:26.758645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:26.760644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:26.760808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895731169134665:9297] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:26.760828Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:26.760824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895731169134665:9297] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:26.760838Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:26.760849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:26.760828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895731169134665:9297] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:26.760836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1524 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:26.760898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:26.760936Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895731079382420:9078]
2025-09-30T14:54:26.761623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:26.761941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:26.761988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:26.762329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:26.762388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:26.762394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:26.762396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:26.762397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:26.762399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:26.762400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:26.762401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:26.762403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:26.762404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:26.762405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:26.762406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.762408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.762409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.762410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:26.762411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:26.762417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:26.762429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:26.762434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:26.762438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:26.762442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:26.762448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:26.762452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:26.762457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:26.762462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:26.762467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:26.762471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.762475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.762480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.762485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:26.762489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:26.762497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:26.762506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:26.762512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:26.762519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:26.762523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:26.762529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:26.762534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:26.762547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:26.762552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:26.762558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:26.762568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:26.762574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:26.762583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:26.762590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:26.762594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:26.762599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:26.762606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:26.762611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:26.762621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:26.762627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:26.762632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.762642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.762646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.762651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.762661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.762667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.762671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:26.762681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:26.762686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:26.762691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:26.762747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:26.768339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:26.769213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:26.769229Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:26.769233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:26.769237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:26.769244Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1523 [2:7555895731079382420:9078]
2025-09-30T14:54:26.769261Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:26.769280Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:26.769284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:26.769287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:26.769290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:26.769306Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:26.769318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:26.769326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:26.769388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.769395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.769398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.769404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:26.769407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:26.769474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:26.769482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.769497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.769516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.769539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:26.769561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895731169134756:9297], now have 1 active actors on pipe
2025-09-30T14:54:26.769570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895731169134650:2454], now have 1 active actors on pipe
2025-09-30T14:54:26.769576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895731079382415:9078]
2025-09-30T14:54:26.769579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895731079382415:9078]
2025-09-30T14:54:26.769581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895731079382415:9078]
2025-09-30T14:54:26.769594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:26.769612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:26.769620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:26.769625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:26.769627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:26.769629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:26.769596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1523
2025-09-30T14:54:26.769633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:26.769600Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1523
2025-09-30T14:54:26.769664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895731079382415:9078]
2025-09-30T14:54:26.769678Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:26.769689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:26.769702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:26.769710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:26.769762Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|847d8de2-73b47d76-53be3385-a7f878f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:26.769772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:26.769776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:26.769778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:26.769788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:26.769796Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:26.769819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:26.770046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:26.770055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:26.770070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:26.770147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1524 partition: 0 MaxSeqNo: 42 sessionId: src_id|847d8de2-73b47d76-53be3385-a7f878f1_0
2025-09-30T14:54:26.770535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36532e64-8fc92b73-b8f217ea-ff1fc55f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|847d8de2-73b47d76-53be3385-a7f878f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:26.773425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|847d8de2-73b47d76-53be3385-a7f878f1_0] Write session: try to update token
2025-09-30T14:54:26.773443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|847d8de2-73b47d76-53be3385-a7f878f1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:26.782033Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:26.782055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:26.782057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:26.782064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:26.782073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895731079382415:9078]
2025-09-30T14:54:26.782077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895731079382415:9078]
2025-09-30T14:54:26.782082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895731079382415:9078]
2025-09-30T14:54:26.782123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:26.782131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.782134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:26.782135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:26.782142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:26.782146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:26.782281Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:26.789969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1524 sessionId: src_id|847d8de2-73b47d76-53be3385-a7f878f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:26.792897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:26.846406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895731169134781:9180]
2025-09-30T14:54:26.846689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1523, pipe: [1:7555895731169134781:9180]
2025-09-30T14:54:26.897298Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:26.897745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:26.897759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:26.897777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895731169134781:9180], now have 1 active actors on pipe
2025-09-30T14:54:26.897999Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:26.898057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:26.898074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:26.898081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895731169134781:9180]
2025-09-30T14:54:26.898099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:26.898135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1524 reason: error at write: Disconnected sessionId: src_id|847d8de2-73b47d76-53be3385-a7f878f1_0
2025-09-30T14:54:26.898302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1524 sessionId: src_id|847d8de2-73b47d76-53be3385-a7f878f1_0 is DEAD
2025-09-30T14:54:26.898438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|847d8de2-73b47d76-53be3385-a7f878f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:26.898457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|847d8de2-73b47d76-53be3385-a7f878f1_0] Write session will restart in 0.006127s
2025-09-30T14:54:26.898480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|847d8de2-73b47d76-53be3385-a7f878f1_0] Write session: Do CDS request
2025-09-30T14:54:26.898489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|847d8de2-73b47d76-53be3385-a7f878f1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:26.905844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|847d8de2-73b47d76-53be3385-a7f878f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:26.905905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:26.905919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1525
2025-09-30T14:54:26.906090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1525 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:26.906123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1525 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:26.906132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1525 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:26.906137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:26.906632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1525 sessionId:  describe result for acl check
2025-09-30T14:54:26.906665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:26.906672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:26.906673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:26.906679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895731169134818:9308] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:26.907218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895731169134818:9308] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:26.909146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895731169134818:9308] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:26.909477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:26.911222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:26.911402Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:26.911412Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:26.911421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:26.911480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:26.911516Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895731079382565:9092]
2025-09-30T14:54:26.912064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895731169134818:9308] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:26.912076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895731169134818:9308] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:26.912078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895731169134818:9308] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:26.912084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1525 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:26.912184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:26.912418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:26.912461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:26.912783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:26.912841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:26.912847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:26.912848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:26.912849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:26.912851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:26.912852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:26.912853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:26.912854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:26.912855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:26.912856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:26.912857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.912859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.912860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.912861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:26.912862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:26.912867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:26.912877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:26.912881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:26.912886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:26.912890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:26.912894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:26.912898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:26.912902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:26.912906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:26.912910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:26.912914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.912918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.912922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.912926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:26.912930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:26.912938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:26.912946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:26.912952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:26.912957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:26.912962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:26.912967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:26.912972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:26.912977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:26.912982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:26.912987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:26.912992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:26.912998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:26.913003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:26.913008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:26.913013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:26.913018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:26.913023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:26.913033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:26.913038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:26.913044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:26.913049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.913053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.913057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.913061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.913067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.913071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.913075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:26.913079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:26.913084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:26.913091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:26.913139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:26.918304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:26.919322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:26.919334Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:26.919336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:26.919339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:26.919345Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1524 [2:7555895731079382565:9092]
2025-09-30T14:54:26.919361Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:26.919378Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:26.919381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:26.919384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:26.919387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:26.919401Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:26.919408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:26.919414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:26.919462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.919469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.919470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.919473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:26.919475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:26.919524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:26.919532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.919547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:26.919563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:26.919585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:26.919606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895731169134794:2454], now have 1 active actors on pipe
2025-09-30T14:54:26.919614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895731169134896:9308], now have 1 active actors on pipe
2025-09-30T14:54:26.919620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895731079382559:9092]
2025-09-30T14:54:26.919622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895731079382559:9092]
2025-09-30T14:54:26.919624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895731079382559:9092]
2025-09-30T14:54:26.919635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:26.919649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:26.919649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:26.919653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:26.919655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:26.919668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:26.919670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:26.919704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895731079382559:9092]
2025-09-30T14:54:26.919680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1524
2025-09-30T14:54:26.919712Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:26.919714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:26.919685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1524
2025-09-30T14:54:26.919739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:26.919748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:26.919777Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|285c0f1-71dbc945-4eac912e-88dd71b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:26.919788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:26.919791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:26.919795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:26.919803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:26.919815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:26.919836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:26.919962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:26.919970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:26.919981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:26.920059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1525 partition: 0 MaxSeqNo: 42 sessionId: src_id|285c0f1-71dbc945-4eac912e-88dd71b5_0
2025-09-30T14:54:26.920445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|847d8de2-73b47d76-53be3385-a7f878f1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|285c0f1-71dbc945-4eac912e-88dd71b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:26.923178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|285c0f1-71dbc945-4eac912e-88dd71b5_0] Write session: try to update token
2025-09-30T14:54:26.923192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|285c0f1-71dbc945-4eac912e-88dd71b5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:26.931817Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:26.931835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:26.931837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:26.931839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:26.931848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895731079382559:9092]
2025-09-30T14:54:26.931854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895731079382559:9092]
2025-09-30T14:54:26.931858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895731079382559:9092]
2025-09-30T14:54:26.931898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:26.931905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:26.931906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:26.931909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:26.931913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:26.931918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:26.932057Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:26.938001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1525 sessionId: src_id|285c0f1-71dbc945-4eac912e-88dd71b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:26.941013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:26.998458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895731169134909:9180]
2025-09-30T14:54:26.998657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1524, pipe: [1:7555895731169134909:9180]
2025-09-30T14:54:27.043150Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:27.043490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:27.043505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:27.043543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895731169134909:9180], now have 1 active actors on pipe
2025-09-30T14:54:27.043772Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:27.043779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895731169134909:9180]
2025-09-30T14:54:27.043808Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:27.044252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|285c0f1-71dbc945-4eac912e-88dd71b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:27.044264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|285c0f1-71dbc945-4eac912e-88dd71b5_0] Write session will restart in 0.007620s
2025-09-30T14:54:27.043813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:27.043816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:27.043877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1525 reason: error at write: Disconnected sessionId: src_id|285c0f1-71dbc945-4eac912e-88dd71b5_0
2025-09-30T14:54:27.044054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1525 sessionId: src_id|285c0f1-71dbc945-4eac912e-88dd71b5_0 is DEAD
2025-09-30T14:54:27.044286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|285c0f1-71dbc945-4eac912e-88dd71b5_0] Write session: Do CDS request
2025-09-30T14:54:27.044291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|285c0f1-71dbc945-4eac912e-88dd71b5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:27.052738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|285c0f1-71dbc945-4eac912e-88dd71b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:27.052865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:27.052879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1526
2025-09-30T14:54:27.053002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1526 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:27.053035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1526 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:27.053045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1526 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:27.053057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:27.053486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1526 sessionId:  describe result for acl check
2025-09-30T14:54:27.053527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:27.053534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:27.053536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:27.053542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895735464102276:9312] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:27.054127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895735464102276:9312] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:27.054574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:27.056053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895735464102276:9312] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:27.056323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:27.056528Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:27.056539Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:27.056551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:27.056618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:27.056665Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895735374349971:9094]
2025-09-30T14:54:27.057223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:27.057527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:27.057557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:27.057767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:27.057819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:27.057820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:27.057822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:27.057823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:27.057824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:27.057839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:27.057840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:27.057842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:27.057843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:27.057844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:27.057846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.057847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.057848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.057850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:27.057851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:27.057856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:27.057866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:27.057870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:27.057875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:27.057880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:27.057883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:27.057887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:27.057892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:27.057896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:27.057900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:27.057904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.057909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.057913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.057917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:27.057921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:27.057929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:27.057937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:27.057949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:27.057955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:27.057961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:27.057967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:27.057973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:27.057980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:27.057985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:27.057991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:27.057996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:27.058002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:27.058007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:27.058013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:27.058019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:27.058025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:27.058030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:27.058039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:27.058045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:27.058051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:27.058057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.058062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.058067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.058073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.058078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.058084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.058089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:27.058095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:27.058100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:27.058105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:27.058138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:27.058520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895735464102276:9312] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:27.058532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895735464102276:9312] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:27.058536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895735464102276:9312] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:27.058544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1526 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:27.063480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:27.064567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:27.064586Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:27.064588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:27.064591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:27.064595Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1525 [2:7555895735374349971:9094]
2025-09-30T14:54:27.064608Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:27.064623Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:27.064627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:27.064630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:27.064632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:27.064648Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:27.064654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:27.064661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:27.064714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.064722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.064724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.064727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:27.064730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:27.064793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:27.064800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.064814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.064822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.064836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:27.064849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895735374349965:9094]
2025-09-30T14:54:27.064855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895735374349965:9094]
2025-09-30T14:54:27.064857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895735374349965:9094]
2025-09-30T14:54:27.064865Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:27.064874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:27.064879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895735464102317:9312], now have 1 active actors on pipe
2025-09-30T14:54:27.064883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:27.064883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895735464102206:2454], now have 1 active actors on pipe
2025-09-30T14:54:27.064885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:27.064891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:27.064906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:27.064913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:27.064943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895735374349965:9094]
2025-09-30T14:54:27.064952Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:27.064962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:27.064966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1525
2025-09-30T14:54:27.064971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1525
2025-09-30T14:54:27.065090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:27.065100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:27.065125Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|473f80d1-14a3b6bb-a0691306-6fc0738f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:27.065137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:27.065142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:27.065143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:27.065152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:27.065165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:27.065179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:27.065335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:27.065342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:27.065355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:27.065448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1526 partition: 0 MaxSeqNo: 42 sessionId: src_id|473f80d1-14a3b6bb-a0691306-6fc0738f_0
2025-09-30T14:54:27.065790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|285c0f1-71dbc945-4eac912e-88dd71b5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|473f80d1-14a3b6bb-a0691306-6fc0738f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:27.068461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|473f80d1-14a3b6bb-a0691306-6fc0738f_0] Write session: try to update token
2025-09-30T14:54:27.068478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|473f80d1-14a3b6bb-a0691306-6fc0738f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:27.076767Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:27.076784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:27.076793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895735374349965:9094]
2025-09-30T14:54:27.076835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:27.076837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:27.077018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:27.077165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:27.077328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:27.077538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:27.077733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:27.077774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:27.082332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1526 sessionId: src_id|473f80d1-14a3b6bb-a0691306-6fc0738f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:27.084970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:27.085178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:27.085197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:27.085233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:27.085332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:27.087298Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:27.087312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:27.087314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:27.087315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:27.087324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895735374349965:9094]
2025-09-30T14:54:27.087327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895735374349965:9094]
2025-09-30T14:54:27.087329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895735374349965:9094]
2025-09-30T14:54:27.087360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:27.087365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.087366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:27.087369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:27.087375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:27.087380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:27.087486Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:27.143881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895735464102335:9180]
2025-09-30T14:54:27.144178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1525, pipe: [1:7555895735464102335:9180]
2025-09-30T14:54:27.193662Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:27.201094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:27.201118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:27.201267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:27.201323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:27.201384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:27.201440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:27.201818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:27.201846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:27.201908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:27.201966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:27.202023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:27.202083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:27.202123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:27.202128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:27.202189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:27.202247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:27.202306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:27.202363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:27.202401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:27.202409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:27.202470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:27.202532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:27.202590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:27.202663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:27.202708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:27.202714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:27.202773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:27.202829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:27.202888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:27.202947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:27.202986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:27.202994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:27.203054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:27.203112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:27.203173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:27.203229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:27.203297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:27.203303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:27.203368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:27.203423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:27.203481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:27.203541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:27.203601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:27.203606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:27.203669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:27.203725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:27.203785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:27.203848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:27.203888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:27.203890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:27.203953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:27.204013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:27.204071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:27.204132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:27.204187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:27.204193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:27.204252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:27.204309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:27.204370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:27.204427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:27.204476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:27.204485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:27.204550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895735464102335:9180], now have 1 active actors on pipe
2025-09-30T14:54:27.204826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:27.204839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:27.204840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895735464102335:9180]
2025-09-30T14:54:27.204864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:27.204867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1526 reason: error at write: Disconnected sessionId: src_id|473f80d1-14a3b6bb-a0691306-6fc0738f_0
2025-09-30T14:54:27.204992Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:27.205224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|473f80d1-14a3b6bb-a0691306-6fc0738f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:27.205233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|473f80d1-14a3b6bb-a0691306-6fc0738f_0] Write session will restart in 0.008718s
2025-09-30T14:54:27.205255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|473f80d1-14a3b6bb-a0691306-6fc0738f_0] Write session: Do CDS request
2025-09-30T14:54:27.205261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|473f80d1-14a3b6bb-a0691306-6fc0738f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:27.205487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1526 sessionId: src_id|473f80d1-14a3b6bb-a0691306-6fc0738f_0 is DEAD
2025-09-30T14:54:27.214823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|473f80d1-14a3b6bb-a0691306-6fc0738f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:27.214901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:27.214916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1527
2025-09-30T14:54:27.215059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1527 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:27.215093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1527 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:27.215102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1527 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:27.215117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:27.215550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1527 sessionId:  describe result for acl check
2025-09-30T14:54:27.215588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:27.215596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:27.215597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:27.215604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895735464102409:9317] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:27.216146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895735464102409:9317] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:27.216961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:27.218465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895735464102409:9317] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:27.218911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:27.219073Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:27.219090Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:27.219100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:27.219138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:27.219166Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895735374350082:9096]
2025-09-30T14:54:27.219625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:27.219911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:27.219940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:27.220161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:27.220199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:27.220204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:27.220204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:27.220205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:27.220206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:27.220206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:27.220208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:27.220208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:27.220209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:27.220210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:27.220211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.220212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.220213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.220213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:27.220214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:27.220218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:27.220224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:27.220227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:27.220229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:27.220231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:27.220234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:27.220236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:27.220238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:27.220241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:27.220243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:27.220246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.220248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.220250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.220253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:27.220255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:27.220260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:27.220265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:27.220269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:27.220272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:27.220276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:27.220279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:27.220282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:27.220285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:27.220297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:27.220300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:27.220303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:27.220306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:27.220309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:27.220312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:27.220315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:27.220318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:27.220321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:27.220324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:27.220328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:27.220331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:27.220333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.220336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.220338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.220341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.220344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.220347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.220349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:27.220353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:27.220355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:27.220358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:27.220383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:27.220870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895735464102409:9317] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:27.220880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895735464102409:9317] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:27.220883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895735464102409:9317] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:27.220889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1527 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:27.225821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:27.226773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:27.226790Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:27.226793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:27.226798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:27.226806Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1526 [2:7555895735374350082:9096]
2025-09-30T14:54:27.226824Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:27.226847Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:27.226850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:27.226854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:27.226857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:27.226874Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:27.226887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:27.226894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:27.226958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.226966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.226968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.226972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:27.226975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:27.227041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:27.227050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.227064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.227083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.227107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:27.227131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895735464102339:2454], now have 1 active actors on pipe
2025-09-30T14:54:27.227141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895735464102451:9317], now have 1 active actors on pipe
2025-09-30T14:54:27.227148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895735374350077:9096]
2025-09-30T14:54:27.227156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895735374350077:9096]
2025-09-30T14:54:27.227159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895735374350077:9096]
2025-09-30T14:54:27.227171Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:27.227186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:27.227192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:27.227196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:27.227198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:27.227210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:27.227213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:27.227193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1526
2025-09-30T14:54:27.227209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1526
2025-09-30T14:54:27.227284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:27.227295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:27.227308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895735374350077:9096]
2025-09-30T14:54:27.227321Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:27.227344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:27.227359Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e1fe537-9918e91c-de398c50-6a37a0d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:27.227371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:27.227375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:27.227378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:27.227389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:27.227403Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:27.227435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:27.227600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:27.227609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:27.227626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:27.227720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1527 partition: 0 MaxSeqNo: 42 sessionId: src_id|5e1fe537-9918e91c-de398c50-6a37a0d6_0
2025-09-30T14:54:27.228072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|473f80d1-14a3b6bb-a0691306-6fc0738f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5e1fe537-9918e91c-de398c50-6a37a0d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:27.230606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e1fe537-9918e91c-de398c50-6a37a0d6_0] Write session: try to update token
2025-09-30T14:54:27.230621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e1fe537-9918e91c-de398c50-6a37a0d6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:27.239385Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:27.239403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:27.239406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:27.239409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:27.239419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895735374350077:9096]
2025-09-30T14:54:27.239423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895735374350077:9096]
2025-09-30T14:54:27.239428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895735374350077:9096]
2025-09-30T14:54:27.239471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:27.239478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:27.239480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.239483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:27.239491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:27.239495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:27.239631Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:27.244792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1527 sessionId: src_id|5e1fe537-9918e91c-de398c50-6a37a0d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:27.247639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:27.305142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895735464102459:9180]
2025-09-30T14:54:27.305449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1526, pipe: [1:7555895735464102459:9180]
2025-09-30T14:54:27.359281Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:27.359605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:27.359620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:27.359660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895735464102459:9180], now have 1 active actors on pipe
2025-09-30T14:54:27.359916Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:27.359960Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:27.359990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:27.360038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895735464102459:9180]
2025-09-30T14:54:27.360084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1527 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5e1fe537-9918e91c-de398c50-6a37a0d6_0
2025-09-30T14:54:27.360305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1527 sessionId: src_id|5e1fe537-9918e91c-de398c50-6a37a0d6_0 is DEAD
2025-09-30T14:54:27.360513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e1fe537-9918e91c-de398c50-6a37a0d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:27.360522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e1fe537-9918e91c-de398c50-6a37a0d6_0] Write session will restart in 0.007744s
2025-09-30T14:54:27.360548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e1fe537-9918e91c-de398c50-6a37a0d6_0] Write session: Do CDS request
2025-09-30T14:54:27.360553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e1fe537-9918e91c-de398c50-6a37a0d6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:27.369892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e1fe537-9918e91c-de398c50-6a37a0d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:27.369984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:27.370001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1528
2025-09-30T14:54:27.370139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1528 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:27.370180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1528 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:27.370190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1528 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:27.370195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:27.370644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1528 sessionId:  describe result for acl check
2025-09-30T14:54:27.370677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:27.370680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:27.370682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:27.370688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895735464102531:9321] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:27.371274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895735464102531:9321] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:27.371694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:27.373218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895735464102531:9321] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:27.373773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:27.374021Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:27.374036Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:27.374048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:27.374121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:27.374163Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895735374350196:9099]
2025-09-30T14:54:27.374875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:27.375224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:27.375293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:27.375666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:27.375733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:27.375741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:27.375743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:27.375744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:27.375745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:27.375746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:27.375748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:27.375749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:27.375750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:27.375751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:27.375752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.375754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.375755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.375756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:27.375758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:27.375764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:27.375774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:27.375779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:27.375784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:27.375788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:27.375793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:27.375798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:27.375803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:27.375808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:27.375812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:27.375817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.375821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.375826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.375830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:27.375834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:27.375841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:27.375850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:27.375857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:27.375863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:27.375868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:27.375874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:27.375879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:27.375884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:27.375890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:27.375896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:27.375901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:27.375908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:27.375914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:27.375919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:27.375924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:27.375930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:27.375942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:27.375947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:27.375953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:27.375964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:27.375970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.375981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.375990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.376000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.376006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.376015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.376020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:27.376027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:27.376033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:27.376043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:27.376030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895735464102531:9321] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:27.376048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895735464102531:9321] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:27.376053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895735464102531:9321] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:27.376091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:27.376062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1528 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:27.381746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:27.382646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:27.382664Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:27.382671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:27.382675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:27.382682Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1527 [2:7555895735374350196:9099]
2025-09-30T14:54:27.382695Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:27.382711Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:27.382714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:27.382718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:27.382720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:27.382737Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:27.382744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:27.382750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:27.382810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.382818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.382820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.382822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:27.382824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:27.382885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:27.382892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.382906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.382924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.382946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:27.382972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895735464102571:9321], now have 1 active actors on pipe
2025-09-30T14:54:27.382976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895735464102460:2454], now have 1 active actors on pipe
2025-09-30T14:54:27.382983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895735374350190:9099]
2025-09-30T14:54:27.382990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895735374350190:9099]
2025-09-30T14:54:27.382993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895735374350190:9099]
2025-09-30T14:54:27.383007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:27.383026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:27.383028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:27.383032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:27.383034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:27.383046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:27.383054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:27.383091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895735374350190:9099]
2025-09-30T14:54:27.383062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1527
2025-09-30T14:54:27.383100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:27.383062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1527
2025-09-30T14:54:27.383102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:27.383132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:27.383137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:27.383303Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|597cc544-d41e5569-2c24f731-addf9233_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:27.383316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:27.383320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:27.383327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:27.383338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:27.383351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:27.383378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:27.383504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:27.383510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:27.383520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:27.383617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1528 partition: 0 MaxSeqNo: 42 sessionId: src_id|597cc544-d41e5569-2c24f731-addf9233_0
2025-09-30T14:54:27.384049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e1fe537-9918e91c-de398c50-6a37a0d6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|597cc544-d41e5569-2c24f731-addf9233_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:27.386763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|597cc544-d41e5569-2c24f731-addf9233_0] Write session: try to update token
2025-09-30T14:54:27.386780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|597cc544-d41e5569-2c24f731-addf9233_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:27.395088Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:27.395107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:27.395110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:27.395113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:27.395124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895735374350190:9099]
2025-09-30T14:54:27.395129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895735374350190:9099]
2025-09-30T14:54:27.395132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895735374350190:9099]
2025-09-30T14:54:27.395179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:27.395190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.395193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:27.395197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:27.395203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:27.395215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:27.395358Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:27.401985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1528 sessionId: src_id|597cc544-d41e5569-2c24f731-addf9233_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:27.404736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:27.460289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895735464102581:9180]
2025-09-30T14:54:27.460581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1527, pipe: [1:7555895735464102581:9180]
2025-09-30T14:54:27.505409Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:27.505762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:27.505779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:27.505815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895735464102581:9180], now have 1 active actors on pipe
2025-09-30T14:54:27.506036Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:27.506078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895735464102581:9180]
2025-09-30T14:54:27.506084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:27.506087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:27.506086Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:27.506146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1528 reason: error at write: Disconnected sessionId: src_id|597cc544-d41e5569-2c24f731-addf9233_0
2025-09-30T14:54:27.506347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1528 sessionId: src_id|597cc544-d41e5569-2c24f731-addf9233_0 is DEAD
2025-09-30T14:54:27.506502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|597cc544-d41e5569-2c24f731-addf9233_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:27.506515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|597cc544-d41e5569-2c24f731-addf9233_0] Write session will restart in 0.005539s
2025-09-30T14:54:27.506551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|597cc544-d41e5569-2c24f731-addf9233_0] Write session: Do CDS request
2025-09-30T14:54:27.506562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|597cc544-d41e5569-2c24f731-addf9233_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:27.513694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|597cc544-d41e5569-2c24f731-addf9233_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:27.513816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:27.513836Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1529
2025-09-30T14:54:27.513944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1529 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:27.513977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1529 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:27.513987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1529 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:27.513992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:27.514423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1529 sessionId:  describe result for acl check
2025-09-30T14:54:27.514456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:27.514464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:27.514466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:27.514473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895735464102631:9326] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:27.515019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895735464102631:9326] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:27.516612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:27.516822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895735464102631:9326] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:27.518342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:27.518528Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:27.518538Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:27.518548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:27.518594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:27.518640Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895735374350321:9102]
2025-09-30T14:54:27.519222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895735464102631:9326] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:27.519236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895735464102631:9326] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:27.519261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895735464102631:9326] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:27.519269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1529 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:27.519301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:27.519585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:27.519626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:27.519927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:27.519980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:27.519987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:27.519987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:27.519989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:27.519990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:27.519991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:27.519992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:27.519993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:27.519994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:27.519995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:27.519996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.519997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.519998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.519999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:27.520000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:27.520005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:27.520013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:27.520016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:27.520020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:27.520023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:27.520027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:27.520030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:27.520033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:27.520037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:27.520040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:27.520044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.520048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.520051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.520055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:27.520058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:27.520064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:27.520072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:27.520077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:27.520081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:27.520085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:27.520091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:27.520094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:27.520099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:27.520103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:27.520107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:27.520111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:27.520115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:27.520120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:27.520124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:27.520128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:27.520133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:27.520137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:27.520142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:27.520146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:27.520151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:27.520155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.520159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.520165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.520169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.520173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.520177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.520180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:27.520184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:27.520188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:27.520193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:27.520230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:27.525735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:27.526802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:27.526823Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:27.526826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:27.526830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:27.526838Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1528 [2:7555895735374350321:9102]
2025-09-30T14:54:27.526852Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:27.526867Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:27.526870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:27.526873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:27.526875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:27.526890Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:27.526897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:27.526905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:27.526966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.526972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.526973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.526977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:27.526979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:27.527044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:27.527051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.527062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.527072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.527087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:27.527105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895735464102594:2454], now have 1 active actors on pipe
2025-09-30T14:54:27.527115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895735374350315:9102]
2025-09-30T14:54:27.527117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895735374350315:9102]
2025-09-30T14:54:27.527118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895735374350315:9102]
2025-09-30T14:54:27.527130Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:27.527139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895735464102704:9326], now have 1 active actors on pipe
2025-09-30T14:54:27.527146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:27.527153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:27.527158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:27.527160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:27.527164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:27.527167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:27.527193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895735374350315:9102]
2025-09-30T14:54:27.527203Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:27.527210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:27.527218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1528
2025-09-30T14:54:27.527260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1528
2025-09-30T14:54:27.527334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:27.527343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:27.527365Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c254ad1e-9bc99072-4dcb9809-812c949b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:27.527377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:27.527385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:27.527387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:27.527396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:27.527404Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:27.527422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:27.527613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:27.527626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:27.527640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:27.527747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1529 partition: 0 MaxSeqNo: 42 sessionId: src_id|c254ad1e-9bc99072-4dcb9809-812c949b_0
2025-09-30T14:54:27.528185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|597cc544-d41e5569-2c24f731-addf9233_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c254ad1e-9bc99072-4dcb9809-812c949b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:27.531045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c254ad1e-9bc99072-4dcb9809-812c949b_0] Write session: try to update token
2025-09-30T14:54:27.531064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c254ad1e-9bc99072-4dcb9809-812c949b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:27.544807Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:27.544828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:27.544838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895735374350315:9102]
2025-09-30T14:54:27.544891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:27.544892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:27.545086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:27.545237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:27.545380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:27.545527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:27.545732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:27.545773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:27.546062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1529 sessionId: src_id|c254ad1e-9bc99072-4dcb9809-812c949b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:27.548785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:27.549024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:27.549047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:27.550261Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:27.550277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:27.550279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:27.550281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:27.550292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895735374350315:9102]
2025-09-30T14:54:27.550298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895735374350315:9102]
2025-09-30T14:54:27.550302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895735374350315:9102]
2025-09-30T14:54:27.550337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:27.550341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:27.550353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:27.550357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:27.550361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:27.550365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.550368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:27.550454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:27.550510Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:27.606205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895735464102718:9180]
2025-09-30T14:54:27.606438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1528, pipe: [1:7555895735464102718:9180]
2025-09-30T14:54:27.656607Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:27.663648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:27.663673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:27.663827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:27.663889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:27.663954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:27.664014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:27.664055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:27.664063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:27.664136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:27.664194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:27.664255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:27.664313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:27.664359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:27.664368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:27.664432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:27.664495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:27.664562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:27.664624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:27.664671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:27.664679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:27.664741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:27.664798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:27.664857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:27.664922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:27.664961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:27.664967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:27.665028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:27.665081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:27.665150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:27.665213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:27.665255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:27.665260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:27.665321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:27.665384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:27.665448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:27.665506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:27.665552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:27.665559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:27.665623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:27.665685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:27.665743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:27.665800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:27.665941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:27.665948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:27.666009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:27.666067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:27.666127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:27.666195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:27.666239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:27.666244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:27.666304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:27.666359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:27.666421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:27.666479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:27.666520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:27.666525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:27.666584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:27.666647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:27.666711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:27.666772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:27.666813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:27.666819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:27.666859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895735464102718:9180], now have 1 active actors on pipe
2025-09-30T14:54:27.667063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895735464102718:9180]
2025-09-30T14:54:27.667074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:27.667099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:27.667102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:27.667131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1529 reason: error at write: Disconnected sessionId: src_id|c254ad1e-9bc99072-4dcb9809-812c949b_0
2025-09-30T14:54:27.667355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1529 sessionId: src_id|c254ad1e-9bc99072-4dcb9809-812c949b_0 is DEAD
2025-09-30T14:54:27.667505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c254ad1e-9bc99072-4dcb9809-812c949b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:27.667514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c254ad1e-9bc99072-4dcb9809-812c949b_0] Write session will restart in 0.007032s
2025-09-30T14:54:27.667531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c254ad1e-9bc99072-4dcb9809-812c949b_0] Write session: Do CDS request
2025-09-30T14:54:27.667536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c254ad1e-9bc99072-4dcb9809-812c949b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:27.667728Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:27.675684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c254ad1e-9bc99072-4dcb9809-812c949b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:27.675757Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:27.675784Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1530
2025-09-30T14:54:27.675927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1530 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:27.675952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1530 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:27.675959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1530 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:27.675963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:27.676323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1530 sessionId:  describe result for acl check
2025-09-30T14:54:27.676349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:27.676350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:27.676351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:27.676355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895735464102793:9331] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:27.676835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:27.677087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895735464102793:9331] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:27.678381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:27.678532Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:27.678539Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:27.678547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:27.678586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:27.678616Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895735374350434:9104]
2025-09-30T14:54:27.679050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:27.679132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895735464102793:9331] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:27.679211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:27.679241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:27.679476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:27.679520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:27.679525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:27.679526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:27.679527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:27.679528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:27.679529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:27.679529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:27.679530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:27.679531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:27.679531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:27.679532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.679533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.679533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.679534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:27.679535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:27.679538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:27.679544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:27.679546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:27.679548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:27.679551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:27.679553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:27.679555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:27.679557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:27.679560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:27.679562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:27.679564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.679566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.679569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.679571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:27.679573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:27.679578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:27.679583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:27.679586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:27.679590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:27.679592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:27.679595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:27.679598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:27.679601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:27.679604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:27.679607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:27.679609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:27.679612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:27.679615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:27.679618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:27.679620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:27.679623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:27.679626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:27.679629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:27.679631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:27.679634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:27.679637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.679640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.679642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.679645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.679648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.679651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.679653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:27.679657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:27.679660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:27.679663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:27.679686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:27.684288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895735464102793:9331] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:27.684303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895735464102793:9331] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:27.684307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895735464102793:9331] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:27.684315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1530 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:27.684617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:27.685584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:27.685600Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:27.685602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:27.685606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:27.685612Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1529 [2:7555895735374350434:9104]
2025-09-30T14:54:27.685626Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:27.685640Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:27.685642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:27.685644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:27.685646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:27.685657Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:27.685666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:27.685672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:27.685713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.685718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.685720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.685722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:27.685724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:27.685769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:27.685774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.685782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.685791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.685801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:27.685816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895735374350429:9104]
2025-09-30T14:54:27.685821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895735374350429:9104]
2025-09-30T14:54:27.685822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895735374350429:9104]
2025-09-30T14:54:27.685840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:27.685851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:27.685858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:27.685862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:27.685864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:27.685868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:27.685875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:27.685884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895735464102834:9331], now have 1 active actors on pipe
2025-09-30T14:54:27.685891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895735464102719:2454], now have 1 active actors on pipe
2025-09-30T14:54:27.685910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895735374350429:9104]
2025-09-30T14:54:27.685918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:27.685924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:27.685929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1529
2025-09-30T14:54:27.685930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1529
2025-09-30T14:54:27.685984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:27.685992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:27.686012Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|587ce308-4dbda1b4-c91b12f9-6754808a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:27.686022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:27.686028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:27.686029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:27.686037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:27.686047Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:27.686059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:27.686216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:27.686230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:27.686254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:27.686354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1530 partition: 0 MaxSeqNo: 42 sessionId: src_id|587ce308-4dbda1b4-c91b12f9-6754808a_0
2025-09-30T14:54:27.686721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c254ad1e-9bc99072-4dcb9809-812c949b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|587ce308-4dbda1b4-c91b12f9-6754808a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:27.689419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|587ce308-4dbda1b4-c91b12f9-6754808a_0] Write session: try to update token
2025-09-30T14:54:27.689435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|587ce308-4dbda1b4-c91b12f9-6754808a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:27.697247Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:27.697264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:27.697273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895735374350429:9104]
2025-09-30T14:54:27.697321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:27.697320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:27.697498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:27.697649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:27.697782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:27.697933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:27.698129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:27.698173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:27.703597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1530 sessionId: src_id|587ce308-4dbda1b4-c91b12f9-6754808a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:27.706302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:27.706531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:27.706547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:27.707623Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:27.707639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:27.707642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:27.707643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:27.707652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895735374350429:9104]
2025-09-30T14:54:27.707656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895735374350429:9104]
2025-09-30T14:54:27.707660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895735374350429:9104]
2025-09-30T14:54:27.707694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:27.707703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:27.707711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:27.707716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.707717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:27.707718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:27.707722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:27.707792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:27.707841Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:27.767491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895735464102842:9180]
2025-09-30T14:54:27.767782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1529, pipe: [1:7555895735464102842:9180]
2025-09-30T14:54:27.812631Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:27.819856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:27.819886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:27.820039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:27.820097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:27.820157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:27.820218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:27.820263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:27.820272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:27.820336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:27.820393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:27.820452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:27.820512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:27.820557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:27.820563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:27.820626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:27.820681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:27.820740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:27.820800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:27.820846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:27.820852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:27.820924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:27.820992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:27.821051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:27.821112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:27.821356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:27.821363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:27.821425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:27.821487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:27.821557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:27.821616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:27.821659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:27.821664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:27.821726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:27.821784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:27.821857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:27.821916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:27.821960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:27.821965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:27.822027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:27.822083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:27.822144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:27.822208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:27.822317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:27.822323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:27.822383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:27.822438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:27.822502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:27.822558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:27.822599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:27.822605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:27.822665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:27.822730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:27.822788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:27.822849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:27.822890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:27.822896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:27.822961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:27.823027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:27.823097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:27.823155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:27.823196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:27.823203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:27.823295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895735464102842:9180], now have 1 active actors on pipe
2025-09-30T14:54:27.823606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895735464102842:9180]
2025-09-30T14:54:27.823611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:27.823615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:27.823634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:27.823642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1530 reason: error at write: Disconnected sessionId: src_id|587ce308-4dbda1b4-c91b12f9-6754808a_0
2025-09-30T14:54:27.823844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1530 sessionId: src_id|587ce308-4dbda1b4-c91b12f9-6754808a_0 is DEAD
2025-09-30T14:54:27.823978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|587ce308-4dbda1b4-c91b12f9-6754808a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:27.823988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|587ce308-4dbda1b4-c91b12f9-6754808a_0] Write session will restart in 0.007136s
2025-09-30T14:54:27.824010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|587ce308-4dbda1b4-c91b12f9-6754808a_0] Write session: Do CDS request
2025-09-30T14:54:27.824015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|587ce308-4dbda1b4-c91b12f9-6754808a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:27.824048Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:27.832725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|587ce308-4dbda1b4-c91b12f9-6754808a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:27.832818Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:27.832838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1531
2025-09-30T14:54:27.832963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1531 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:27.832997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1531 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:27.833002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1531 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:27.833006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:27.833430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1531 sessionId:  describe result for acl check
2025-09-30T14:54:27.833470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:27.833478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:27.833480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:27.833485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895735464102917:9335] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:27.834012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895735464102917:9335] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:27.834118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:27.834547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:27.834692Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:27.834702Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:27.834712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:27.834768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:27.834818Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895735374350551:9107]
2025-09-30T14:54:27.835392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:27.836290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895735464102917:9335] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:27.836317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:27.836375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:27.836698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:27.836769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:27.836787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:27.836788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:27.836789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:27.836790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:27.836791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:27.836792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:27.836793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:27.836794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:27.836795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:27.836796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.836797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.836798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.836799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:27.836799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:27.836805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:27.836814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:27.836818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:27.836821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:27.836826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:27.836829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:27.836833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:27.836836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:27.836840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:27.836844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:27.836848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.836851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.836855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.836858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:27.836862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:27.836868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:27.836875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:27.836881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:27.836886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:27.836891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:27.836895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:27.836899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:27.836904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:27.836908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:27.836913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:27.836917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:27.836921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:27.836927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:27.836932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:27.836936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:27.836940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:27.836945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:27.836949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:27.836954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:27.836958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:27.836962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.836972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.836976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.836980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.836985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.836994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.836998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:27.837002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:27.837006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:27.837014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:27.837062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:27.842082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895735464102917:9335] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:27.842096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895735464102917:9335] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:27.842100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895735464102917:9335] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:27.842108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1531 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:27.842396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:27.843313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:27.843325Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:27.843328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:27.843331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:27.843337Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1530 [2:7555895735374350551:9107]
2025-09-30T14:54:27.843353Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:27.843371Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:27.843376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:27.843379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:27.843380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:27.843393Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:27.843401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:27.843406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:27.843445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.843449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.843451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.843453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:27.843455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:27.843502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:27.843509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.843517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.843523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.843532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:27.843543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895735374350546:9107]
2025-09-30T14:54:27.843545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895735374350546:9107]
2025-09-30T14:54:27.843546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895735374350546:9107]
2025-09-30T14:54:27.843553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:27.843562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:27.843564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:27.843565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:27.843566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:27.843572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:27.843574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:27.843581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895735464102843:2454], now have 1 active actors on pipe
2025-09-30T14:54:27.843585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895735464102958:9335], now have 1 active actors on pipe
2025-09-30T14:54:27.843612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895735374350546:9107]
2025-09-30T14:54:27.843623Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:27.843627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:27.843648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1530
2025-09-30T14:54:27.843650Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1530
2025-09-30T14:54:27.843694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:27.843705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:27.843726Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7a3aa18-b0416b25-d0112e0d-62a5e908_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:27.843735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:27.843738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:27.843739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:27.843746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:27.843753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:27.843768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:27.843937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:27.843944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:27.843953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:27.844023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1531 partition: 0 MaxSeqNo: 42 sessionId: src_id|f7a3aa18-b0416b25-d0112e0d-62a5e908_0
2025-09-30T14:54:27.844369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|587ce308-4dbda1b4-c91b12f9-6754808a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f7a3aa18-b0416b25-d0112e0d-62a5e908_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:27.847027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7a3aa18-b0416b25-d0112e0d-62a5e908_0] Write session: try to update token
2025-09-30T14:54:27.847044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7a3aa18-b0416b25-d0112e0d-62a5e908_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:27.855419Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:27.855436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:27.855438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:27.855439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:27.855446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895735374350546:9107]
2025-09-30T14:54:27.855450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895735374350546:9107]
2025-09-30T14:54:27.855452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895735374350546:9107]
2025-09-30T14:54:27.855482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:27.855490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.855493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:27.855510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:27.855517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:27.855521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:27.855647Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:27.861920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1531 sessionId: src_id|f7a3aa18-b0416b25-d0112e0d-62a5e908_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:27.864625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:27.923646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895735464102979:9180]
2025-09-30T14:54:27.923949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1530, pipe: [1:7555895735464102979:9180]
2025-09-30T14:54:27.964130Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:27.964384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:27.964395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:27.964411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895735464102979:9180], now have 1 active actors on pipe
2025-09-30T14:54:27.964593Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:27.964632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895735464102979:9180]
2025-09-30T14:54:27.964641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:27.964645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:27.964664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:27.964717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1531 reason: error at write: Disconnected sessionId: src_id|f7a3aa18-b0416b25-d0112e0d-62a5e908_0
2025-09-30T14:54:27.964867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1531 sessionId: src_id|f7a3aa18-b0416b25-d0112e0d-62a5e908_0 is DEAD
2025-09-30T14:54:27.965071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7a3aa18-b0416b25-d0112e0d-62a5e908_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:27.965079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7a3aa18-b0416b25-d0112e0d-62a5e908_0] Write session will restart in 0.007057s
2025-09-30T14:54:27.965095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7a3aa18-b0416b25-d0112e0d-62a5e908_0] Write session: Do CDS request
2025-09-30T14:54:27.965099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7a3aa18-b0416b25-d0112e0d-62a5e908_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:27.973712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7a3aa18-b0416b25-d0112e0d-62a5e908_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:27.973795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:27.973801Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:27.973813Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1532
2025-09-30T14:54:27.973947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1532 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:27.973973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1532 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:27.973981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1532 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:27.973984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:27.974369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1532 sessionId:  describe result for acl check
2025-09-30T14:54:27.974398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:27.974405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:27.974406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:27.974412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895735464103068:9346] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:27.974808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895735464103068:9346] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:27.975588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:27.975745Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:27.975755Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:27.975765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:27.975809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:27.975847Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895735374350702:9121]
2025-09-30T14:54:27.976301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:27.976536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:27.976575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:27.976758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895735464103068:9346] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:27.976875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:27.976929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:27.976934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:27.976935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:27.976937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:27.976938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:27.976939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:27.976940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:27.976942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:27.976943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:27.976944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:27.976945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.976946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.976948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.976949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:27.976950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:27.976955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:27.976965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:27.976969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:27.976973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:27.976977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:27.976981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:27.976985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:27.976989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:27.976993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:27.976998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:27.977001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.977005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.977009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.977012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:27.977017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:27.977022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:27.977030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:27.977035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:27.977041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:27.977045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:27.977051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:27.977055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:27.977060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:27.977065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:27.977070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:27.977074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:27.977080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:27.977089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:27.977094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:27.977098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:27.977105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:27.977110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:27.977115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:27.977124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:27.977129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:27.977138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.977143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.977148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.977158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.977162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.977172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.977176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:27.977182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:27.977191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:27.977197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:27.977245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:27.981962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895735464103068:9346] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:27.981977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895735464103068:9346] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:27.981980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895735464103068:9346] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:27.981987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1532 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:27.982262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:27.983196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:27.983211Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:27.983213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:27.983215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:27.983220Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1531 [2:7555895735374350702:9121]
2025-09-30T14:54:27.983233Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:27.983262Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:27.983270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:27.983273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:27.983275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:27.983292Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:27.983303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:27.983314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:27.983362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.983368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.983369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.983371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:27.983373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:27.983428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:27.983436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.983447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:27.983458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:27.983473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:27.983494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895735464103107:9346], now have 1 active actors on pipe
2025-09-30T14:54:27.983503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895735464102990:2454], now have 1 active actors on pipe
2025-09-30T14:54:27.983508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895735374350697:9121]
2025-09-30T14:54:27.983510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895735374350697:9121]
2025-09-30T14:54:27.983511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895735374350697:9121]
2025-09-30T14:54:27.983522Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:27.983534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:27.983538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:27.983522Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1531
2025-09-30T14:54:27.983541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:27.983525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1531
2025-09-30T14:54:27.983543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:27.983553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:27.983556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:27.983591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:27.983600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:27.983611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895735374350697:9121]
2025-09-30T14:54:27.983627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:27.983653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:27.983660Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|182fa72e-4b29220-76dcae8-d4c5e223_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:27.983667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:27.983670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:27.983672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:27.983680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:27.983691Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:27.983714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:27.983828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:27.983836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:27.983848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:27.983911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1532 partition: 0 MaxSeqNo: 42 sessionId: src_id|182fa72e-4b29220-76dcae8-d4c5e223_0
2025-09-30T14:54:27.984283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7a3aa18-b0416b25-d0112e0d-62a5e908_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|182fa72e-4b29220-76dcae8-d4c5e223_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:27.986993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|182fa72e-4b29220-76dcae8-d4c5e223_0] Write session: try to update token
2025-09-30T14:54:27.987009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|182fa72e-4b29220-76dcae8-d4c5e223_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:27.995183Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:27.995201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:27.995203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:27.995205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:27.995214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895735374350697:9121]
2025-09-30T14:54:27.995220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895735374350697:9121]
2025-09-30T14:54:27.995225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895735374350697:9121]
2025-09-30T14:54:27.995277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:27.995280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:27.995283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:27.995286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:27.995296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:27.995299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:27.995421Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:28.001118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1532 sessionId: src_id|182fa72e-4b29220-76dcae8-d4c5e223_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:28.003598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:28.064953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895739759070410:9180]
2025-09-30T14:54:28.065267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1531, pipe: [1:7555895739759070410:9180]
2025-09-30T14:54:28.099358Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:28.099627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:28.099639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:28.099670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895739759070410:9180], now have 1 active actors on pipe
2025-09-30T14:54:28.099827Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:28.099896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895739759070410:9180]
2025-09-30T14:54:28.100028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:28.100103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1532 reason: status is not ok: tablet will be restarted right now sessionId: src_id|182fa72e-4b29220-76dcae8-d4c5e223_0
2025-09-30T14:54:28.100138Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:28.100292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1532 sessionId: src_id|182fa72e-4b29220-76dcae8-d4c5e223_0 is DEAD
2025-09-30T14:54:28.100409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|182fa72e-4b29220-76dcae8-d4c5e223_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:28.100419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|182fa72e-4b29220-76dcae8-d4c5e223_0] Write session will restart in 0.008092s
2025-09-30T14:54:28.100442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|182fa72e-4b29220-76dcae8-d4c5e223_0] Write session: Do CDS request
2025-09-30T14:54:28.100447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|182fa72e-4b29220-76dcae8-d4c5e223_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:28.109753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|182fa72e-4b29220-76dcae8-d4c5e223_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:28.109759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:28.109842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:28.109856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1533
2025-09-30T14:54:28.109981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1533 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:28.110012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1533 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:28.110021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1533 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:28.110025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:28.110456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1533 sessionId:  describe result for acl check
2025-09-30T14:54:28.110487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:28.110494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:28.110495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:28.110501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895739759070499:9353] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:28.111019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895739759070499:9353] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:28.111541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:28.111692Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:28.111700Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:28.111707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:28.111752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:28.111779Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895739669318116:9123]
2025-09-30T14:54:28.112242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:28.112495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:28.112526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:28.112668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895739759070499:9353] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:28.112756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:28.112798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:28.112803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:28.112804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:28.112805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:28.112805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:28.112806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:28.112807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:28.112808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:28.112809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:28.112810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:28.112811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.112812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.112813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.112813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:28.112814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:28.112817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:28.112823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:28.112826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:28.112828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:28.112831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:28.112833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:28.112836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:28.112838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:28.112840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:28.112843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:28.112847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.112851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.112855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.112859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:28.112863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:28.112870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:28.112878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:28.112882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:28.112886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:28.112889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:28.112892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:28.112894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:28.112897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:28.112900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:28.112903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:28.112907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:28.112910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:28.112912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:28.112915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:28.112918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:28.112921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:28.112923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:28.112926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:28.112929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:28.112932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:28.112937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.112939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.112942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.112945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.112947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.112950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.112953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:28.112955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:28.112958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:28.112961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:28.112986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:28.118324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895739759070499:9353] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:28.118341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895739759070499:9353] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:28.118344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895739759070499:9353] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:28.118353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1533 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:28.118589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:28.119459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:28.119474Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:28.119476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:28.119480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:28.119487Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1532 [2:7555895739669318116:9123]
2025-09-30T14:54:28.119503Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:28.119518Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:28.119521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:28.119524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:28.119527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:28.119543Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:28.119550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:28.119557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:28.119614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.119623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.119625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.119628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:28.119631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:28.119692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:28.119700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.119712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.119725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.119743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:28.119763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895739759070420:2454], now have 1 active actors on pipe
2025-09-30T14:54:28.119771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895739759070537:9353], now have 1 active actors on pipe
2025-09-30T14:54:28.119779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895739669318111:9123]
2025-09-30T14:54:28.119781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895739669318111:9123]
2025-09-30T14:54:28.119783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895739669318111:9123]
2025-09-30T14:54:28.119797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:28.119813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:28.119817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:28.119821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:28.119824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:28.119829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:28.119832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:28.119859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895739669318111:9123]
2025-09-30T14:54:28.119843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1532
2025-09-30T14:54:28.119866Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:28.119877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:28.119884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1532
2025-09-30T14:54:28.119915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:28.119923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:28.119945Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a4e869b-453f48e6-6e894518-d5e18c6f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:28.119956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:28.119960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:28.119962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:28.119970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:28.119983Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:28.119996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:28.120130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:28.120139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:28.120151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:28.120228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1533 partition: 0 MaxSeqNo: 42 sessionId: src_id|1a4e869b-453f48e6-6e894518-d5e18c6f_0
2025-09-30T14:54:28.120593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|182fa72e-4b29220-76dcae8-d4c5e223_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1a4e869b-453f48e6-6e894518-d5e18c6f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:28.123352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a4e869b-453f48e6-6e894518-d5e18c6f_0] Write session: try to update token
2025-09-30T14:54:28.123368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a4e869b-453f48e6-6e894518-d5e18c6f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:28.132125Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:28.132140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:28.132150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895739669318111:9123]
2025-09-30T14:54:28.132190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:28.132194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:28.132356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:28.132501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:28.132639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:28.132779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:28.132968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:28.133006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:28.137417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1533 sessionId: src_id|1a4e869b-453f48e6-6e894518-d5e18c6f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:28.139968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:28.140180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:28.140210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:28.140262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:28.140373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:28.142979Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:28.143000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:28.143003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:28.143006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:28.143020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895739669318111:9123]
2025-09-30T14:54:28.143025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895739669318111:9123]
2025-09-30T14:54:28.143040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895739669318111:9123]
2025-09-30T14:54:28.143093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:28.143095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:28.143102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:28.143105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.143107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:28.143109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:28.143293Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:28.200146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895739759070547:9180]
2025-09-30T14:54:28.200467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1532, pipe: [1:7555895739759070547:9180]
2025-09-30T14:54:28.255630Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:28.263832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:28.263858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:28.264010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:28.264071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:28.264130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:28.264192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:28.264234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:28.264241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:28.264305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:28.264361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:28.264421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:28.264483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:28.264528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:28.264533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:28.264592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:28.264649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:28.264709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:28.264767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:28.264809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:28.264815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:28.264880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:28.264958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:28.265025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:28.265096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:28.265142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:28.265149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:28.265220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:28.265290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:28.265364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:28.265436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:28.265489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:28.265500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:28.265573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:28.265645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:28.265716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:28.265790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:28.265848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:28.265855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:28.265934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:28.265996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:28.266063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:28.266131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:28.266174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:28.266177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:28.266255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:28.266318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:28.266378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:28.266437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:28.266480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:28.266484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:28.266555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:28.266618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:28.266680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:28.266746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:28.266791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:28.266797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:28.266867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:28.266931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:28.266995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:28.267059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:28.267103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:28.267106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:28.267169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895739759070547:9180], now have 1 active actors on pipe
2025-09-30T14:54:28.267358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:28.267368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895739759070547:9180]
2025-09-30T14:54:28.267396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:28.267399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:28.267431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1533 reason: error at write: Disconnected sessionId: src_id|1a4e869b-453f48e6-6e894518-d5e18c6f_0
2025-09-30T14:54:28.267622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1533 sessionId: src_id|1a4e869b-453f48e6-6e894518-d5e18c6f_0 is DEAD
2025-09-30T14:54:28.267709Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:28.267782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a4e869b-453f48e6-6e894518-d5e18c6f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:28.267789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a4e869b-453f48e6-6e894518-d5e18c6f_0] Write session will restart in 0.007140s
2025-09-30T14:54:28.267812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a4e869b-453f48e6-6e894518-d5e18c6f_0] Write session: Do CDS request
2025-09-30T14:54:28.267818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a4e869b-453f48e6-6e894518-d5e18c6f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:28.275754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a4e869b-453f48e6-6e894518-d5e18c6f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:28.275881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:28.275897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1534
2025-09-30T14:54:28.276002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1534 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:28.276036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1534 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:28.276045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1534 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:28.276050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:28.276513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1534 sessionId:  describe result for acl check
2025-09-30T14:54:28.276555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:28.276563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:28.276566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:28.276571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895739759070584:9357] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:28.277118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895739759070584:9357] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:28.279437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:28.279851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895739759070584:9357] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:28.281358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:28.281545Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:28.281555Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:28.281565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:28.281619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:28.281660Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895739669318236:9126]
2025-09-30T14:54:28.282347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:28.282732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895739759070584:9357] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:28.282747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895739759070584:9357] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:28.282750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895739759070584:9357] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:28.282759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1534 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:28.282732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:28.282777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:28.283091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:28.283152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:28.283158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:28.283159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:28.283160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:28.283161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:28.283161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:28.283162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:28.283163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:28.283164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:28.283166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:28.283166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.283167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.283169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.283170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:28.283171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:28.283176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:28.283187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:28.283191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:28.283196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:28.283200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:28.283204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:28.283219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:28.283223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:28.283227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:28.283231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:28.283235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.283239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.283259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.283262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:28.283266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:28.283273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:28.283281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:28.283293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:28.283299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:28.283308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:28.283313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:28.283322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:28.283327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:28.283331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:28.283340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:28.283345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:28.283350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:28.283358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:28.283362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:28.283366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:28.283370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:28.283375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:28.283379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:28.283383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:28.283387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:28.283391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.283395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.283399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.283409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.283413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.283418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.283426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:28.283430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:28.283439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:28.283444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:28.283495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:28.289083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:28.290501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:28.290519Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:28.290522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:28.290526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:28.290533Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1533 [2:7555895739669318236:9126]
2025-09-30T14:54:28.290549Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:28.290567Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:28.290570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:28.290574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:28.290576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:28.290594Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:28.290608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:28.290622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:28.290684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.290692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.290694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.290698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:28.290701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:28.290767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:28.290774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.290788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.290799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.290815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:28.290837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895739669318230:9126]
2025-09-30T14:54:28.290845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895739669318230:9126]
2025-09-30T14:54:28.290847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895739669318230:9126]
2025-09-30T14:54:28.290856Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:28.290867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:28.290869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:28.290870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:28.290873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:28.290883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:28.290886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:28.290896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895739759070666:9357], now have 1 active actors on pipe
2025-09-30T14:54:28.290900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895739759070549:2454], now have 1 active actors on pipe
2025-09-30T14:54:28.290930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895739669318230:9126]
2025-09-30T14:54:28.290937Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:28.290970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1533
2025-09-30T14:54:28.290971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1533
2025-09-30T14:54:28.290947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:28.291206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:28.291219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:28.291263Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aed3e874-24c2337f-c900a7a0-b98af564_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:28.291271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:28.291275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:28.291277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:28.291288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:28.291298Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:28.291317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:28.291564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:28.291584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:28.291598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:28.291732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1534 partition: 0 MaxSeqNo: 42 sessionId: src_id|aed3e874-24c2337f-c900a7a0-b98af564_0
2025-09-30T14:54:28.292116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a4e869b-453f48e6-6e894518-d5e18c6f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|aed3e874-24c2337f-c900a7a0-b98af564_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:28.294972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aed3e874-24c2337f-c900a7a0-b98af564_0] Write session: try to update token
2025-09-30T14:54:28.294993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aed3e874-24c2337f-c900a7a0-b98af564_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:28.307910Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:28.307929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:28.307940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895739669318230:9126]
2025-09-30T14:54:28.307989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:28.308000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:28.308188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:28.308360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:28.308513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:28.308664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:28.309100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:28.309154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:28.311057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1534 sessionId: src_id|aed3e874-24c2337f-c900a7a0-b98af564_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:28.313991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:28.314335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:28.314376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:28.314429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:28.314553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:28.319619Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:28.319640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:28.319643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:28.319646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:28.319656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895739669318230:9126]
2025-09-30T14:54:28.319661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895739669318230:9126]
2025-09-30T14:54:28.319668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895739669318230:9126]
2025-09-30T14:54:28.319711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:28.319715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:28.319722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.319724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:28.319730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:28.319735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:28.319873Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:28.367574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895739759070675:9180]
2025-09-30T14:54:28.367902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1533, pipe: [1:7555895739759070675:9180]
2025-09-30T14:54:28.434671Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:28.442484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:28.442516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:28.442685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:28.442746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:28.442823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:28.442891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:28.442941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:28.442955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:28.443027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:28.443098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:28.443163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:28.443232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:28.443296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:28.443303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:28.443373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:28.443439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:28.443512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:28.443580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:28.443625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:28.443632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:28.443708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:28.443776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:28.443850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:28.443915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:28.443960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:28.443967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:28.444047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:28.444110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:28.444174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:28.444250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:28.444296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:28.444303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:28.444373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:28.444438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:28.444503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:28.444575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:28.444661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:28.444674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:28.444751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:28.446593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aed3e874-24c2337f-c900a7a0-b98af564_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:28.446604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aed3e874-24c2337f-c900a7a0-b98af564_0] Write session will restart in 0.008841s
2025-09-30T14:54:28.446628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aed3e874-24c2337f-c900a7a0-b98af564_0] Write session: Do CDS request
2025-09-30T14:54:28.446633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aed3e874-24c2337f-c900a7a0-b98af564_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:28.444821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:28.444892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:28.444962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:28.445006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:28.446195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:28.445011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:28.446207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895739759070675:9180]
2025-09-30T14:54:28.445078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:28.445133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:28.445191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:28.445254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:28.445308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:28.445311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:28.445386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:28.445438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:28.445495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:28.445561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:28.445603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:28.445606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:28.445675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:28.445737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:28.445795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:28.445869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:28.445914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:28.445917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:28.445984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895739759070675:9180], now have 1 active actors on pipe
2025-09-30T14:54:28.447322Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:28.446234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:28.446237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:28.446274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1534 reason: error at write: Disconnected sessionId: src_id|aed3e874-24c2337f-c900a7a0-b98af564_0
2025-09-30T14:54:28.446531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1534 sessionId: src_id|aed3e874-24c2337f-c900a7a0-b98af564_0 is DEAD
2025-09-30T14:54:28.456782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aed3e874-24c2337f-c900a7a0-b98af564_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:28.456825Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:28.456841Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1535
2025-09-30T14:54:28.456994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1535 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:28.457030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1535 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:28.457042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1535 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:28.457047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:28.457575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1535 sessionId:  describe result for acl check
2025-09-30T14:54:28.457610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:28.457613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:28.457615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:28.457620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895739759070756:9361] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:28.458154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895739759070756:9361] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:28.460919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:28.460765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895739759070756:9361] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:28.462511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:28.462708Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:28.462719Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:28.462729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:28.462782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:28.462825Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895739669318367:9129]
2025-09-30T14:54:28.463502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:28.463890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:28.463943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:28.464211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895739759070756:9361] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:28.464229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895739759070756:9361] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:28.464232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895739759070756:9361] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:28.464241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1535 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:28.464216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:28.464259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:28.464259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:28.464260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:28.464261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:28.464262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:28.464262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:28.464263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:28.464264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:28.464265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:28.464266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:28.464266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.464267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.464268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.464269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:28.464270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:28.464273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:28.464280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:28.464283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:28.464285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:28.464288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:28.464290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:28.464293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:28.464295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:28.464298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:28.464300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:28.464302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.464304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.464307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.464309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:28.464311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:28.464318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:28.464323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:28.464327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:28.464330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:28.464333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:28.464336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:28.464339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:28.464342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:28.464345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:28.464348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:28.464352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:28.464355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:28.464357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:28.464360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:28.464363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:28.464366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:28.464370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:28.464373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:28.464376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:28.464379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:28.464382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.464385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.464389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.464392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.464395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.464398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.464400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:28.464403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:28.464406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:28.464409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:28.464452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:28.469989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:28.470944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:28.470962Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:28.470965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:28.470969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:28.470976Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1534 [2:7555895739669318367:9129]
2025-09-30T14:54:28.470995Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:28.471011Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:28.471015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:28.471018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:28.471021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:28.471039Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:28.471046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:28.471052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:28.471109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.471117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.471119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.471123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:28.471125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:28.471189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:28.471199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.471211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.471223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.471238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:28.471272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895739759070795:9361], now have 1 active actors on pipe
2025-09-30T14:54:28.471284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895739669318362:9129]
2025-09-30T14:54:28.471287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895739669318362:9129]
2025-09-30T14:54:28.471289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895739669318362:9129]
2025-09-30T14:54:28.471303Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:28.471314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895739759070678:2454], now have 1 active actors on pipe
2025-09-30T14:54:28.471322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:28.471327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:28.471332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:28.471335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:28.471343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:28.471346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:28.471380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895739669318362:9129]
2025-09-30T14:54:28.471392Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:28.471410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:28.471448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:28.471454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:28.471481Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|965b74d5-880b100b-3b7692f4-a19daede_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:28.471495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:28.471499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:28.471506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:28.471517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:28.471531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:28.471549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:28.471699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:28.471707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:28.471373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1534
2025-09-30T14:54:28.471720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:28.471406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1534
2025-09-30T14:54:28.471843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1535 partition: 0 MaxSeqNo: 42 sessionId: src_id|965b74d5-880b100b-3b7692f4-a19daede_0
2025-09-30T14:54:28.472200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aed3e874-24c2337f-c900a7a0-b98af564_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|965b74d5-880b100b-3b7692f4-a19daede_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:28.474993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|965b74d5-880b100b-3b7692f4-a19daede_0] Write session: try to update token
2025-09-30T14:54:28.475012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|965b74d5-880b100b-3b7692f4-a19daede_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:28.483554Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:28.483575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:28.483587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895739669318362:9129]
2025-09-30T14:54:28.483632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:28.483631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:28.483803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:28.483944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:28.484083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:28.484232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:28.484426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:28.484470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:28.489988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1535 sessionId: src_id|965b74d5-880b100b-3b7692f4-a19daede_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:28.493035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:28.493218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:28.493243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:28.493289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:28.493384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:28.494503Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:28.494522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:28.494525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:28.494527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:28.494536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895739669318362:9129]
2025-09-30T14:54:28.494544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895739669318362:9129]
2025-09-30T14:54:28.494548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895739669318362:9129]
2025-09-30T14:54:28.494582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:28.494589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.494592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:28.494594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:28.494599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:28.494603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:28.494725Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:28.546259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895739759070817:9180]
2025-09-30T14:54:28.546616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1534, pipe: [1:7555895739759070817:9180]
2025-09-30T14:54:28.615604Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:28.623796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:28.623826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:28.624013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:28.624080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:28.624149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:28.624221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:28.624276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:28.624288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:28.624362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:28.624429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:28.624494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:28.624562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:28.624611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:28.624620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:28.624691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:28.624756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:28.624825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:28.624898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:28.624944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:28.624952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:28.625021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:28.625091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:28.625154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:28.625221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:28.625268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:28.625276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:28.625348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:28.625410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:28.625476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:28.625544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:28.625591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:28.625599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:28.625667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:28.625731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:28.625796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:28.625887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:28.625936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:28.625944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:28.626016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:28.626085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:28.626153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:28.626220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:28.626267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:28.626275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:28.626349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:28.626419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:28.626487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:28.626554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:28.626604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:28.626613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:28.626681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:28.626744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:28.626812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:28.626878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:28.626929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:28.626938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:28.627004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:28.627068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:28.627138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:28.627206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:28.627268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:28.627276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:28.627339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895739759070817:9180], now have 1 active actors on pipe
2025-09-30T14:54:28.627580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:28.627598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:28.627604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895739759070817:9180]
2025-09-30T14:54:28.627630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1535 reason: error at write: Disconnected sessionId: src_id|965b74d5-880b100b-3b7692f4-a19daede_0
2025-09-30T14:54:28.627637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:28.627839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1535 sessionId: src_id|965b74d5-880b100b-3b7692f4-a19daede_0 is DEAD
2025-09-30T14:54:28.628013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|965b74d5-880b100b-3b7692f4-a19daede_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:28.628025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|965b74d5-880b100b-3b7692f4-a19daede_0] Write session will restart in 0.007936s
2025-09-30T14:54:28.628049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|965b74d5-880b100b-3b7692f4-a19daede_0] Write session: Do CDS request
2025-09-30T14:54:28.628054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|965b74d5-880b100b-3b7692f4-a19daede_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:28.628434Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:28.636803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|965b74d5-880b100b-3b7692f4-a19daede_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:28.636888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:28.636904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1536
2025-09-30T14:54:28.637081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1536 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:28.637136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1536 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:28.637147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1536 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:28.637152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:28.637673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1536 sessionId:  describe result for acl check
2025-09-30T14:54:28.637705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:28.637709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:28.637711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:28.637719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895739759070847:9367] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:28.638242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895739759070847:9367] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:28.641246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895739759070847:9367] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:28.641996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:28.643963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:28.644173Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:28.644189Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:28.644200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:28.644256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:28.644298Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895739669318487:9131]
2025-09-30T14:54:28.644509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895739759070847:9367] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:28.644525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895739759070847:9367] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:28.644531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895739759070847:9367] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:28.644538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1536 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:28.644955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:28.645220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:28.645271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:28.645642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:28.645718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:28.645725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:28.645726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:28.645727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:28.645729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:28.645730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:28.645731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:28.645732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:28.645733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:28.645734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:28.645735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.645737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.645738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.645739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:28.645740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:28.645745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:28.645757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:28.645762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:28.645766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:28.645770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:28.645773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:28.645777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:28.645781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:28.645785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:28.645790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:28.645794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.645798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.645802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.645806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:28.645810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:28.645832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:28.645841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:28.645847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:28.645852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:28.645856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:28.645862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:28.645867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:28.645872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:28.645878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:28.645883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:28.645895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:28.645901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:28.645910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:28.645915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:28.645924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:28.645930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:28.645935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:28.645945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:28.645949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:28.645955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:28.645965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.645971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.645980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.645986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.645991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.645997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.646002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:28.646007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:28.646012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:28.646018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:28.646065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:28.651469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:28.652303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:28.652321Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:28.652324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:28.652328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:28.652336Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1535 [2:7555895739669318487:9131]
2025-09-30T14:54:28.652352Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:28.652369Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:28.652372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:28.652375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:28.652390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:28.652406Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:28.652413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:28.652421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:28.652483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.652492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.652494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.652498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:28.652501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:28.652568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:28.652578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.652592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.652605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.652623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:28.652643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895739759070938:9367], now have 1 active actors on pipe
2025-09-30T14:54:28.652654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895739759070822:2454], now have 1 active actors on pipe
2025-09-30T14:54:28.652661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895739669318482:9131]
2025-09-30T14:54:28.652664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895739669318482:9131]
2025-09-30T14:54:28.652666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895739669318482:9131]
2025-09-30T14:54:28.652679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:28.652695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1535
2025-09-30T14:54:28.652705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1535
2025-09-30T14:54:28.652694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:28.652710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:28.652713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:28.652717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:28.652723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:28.652725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:28.652742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895739669318482:9131]
2025-09-30T14:54:28.652745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:28.652760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:28.652792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:28.652797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:28.652822Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49e76e2b-4b27444d-e2c88570-ae296a19_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:28.652837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:28.652840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:28.652842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:28.652852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:28.652861Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:28.652879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:28.653118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:28.653135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:28.653157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:28.653329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1536 partition: 0 MaxSeqNo: 42 sessionId: src_id|49e76e2b-4b27444d-e2c88570-ae296a19_0
2025-09-30T14:54:28.653690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|965b74d5-880b100b-3b7692f4-a19daede_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|49e76e2b-4b27444d-e2c88570-ae296a19_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:28.656428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49e76e2b-4b27444d-e2c88570-ae296a19_0] Write session: try to update token
2025-09-30T14:54:28.656447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49e76e2b-4b27444d-e2c88570-ae296a19_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:28.665365Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:28.665386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:28.665389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:28.665391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:28.665401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895739669318482:9131]
2025-09-30T14:54:28.665407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895739669318482:9131]
2025-09-30T14:54:28.665411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895739669318482:9131]
2025-09-30T14:54:28.665451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:28.665455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:28.665461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.665463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:28.665464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:28.665467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:28.665612Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:28.671143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1536 sessionId: src_id|49e76e2b-4b27444d-e2c88570-ae296a19_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:28.674134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:28.728024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895739759070950:9180]
2025-09-30T14:54:28.728455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1535, pipe: [1:7555895739759070950:9180]
2025-09-30T14:54:28.785603Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:28.786042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:28.786064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:28.786106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895739759070950:9180], now have 1 active actors on pipe
2025-09-30T14:54:28.786378Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:28.786399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895739759070950:9180]
2025-09-30T14:54:28.786414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:28.786419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:28.786443Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:28.786504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1536 reason: error at write: Disconnected sessionId: src_id|49e76e2b-4b27444d-e2c88570-ae296a19_0
2025-09-30T14:54:28.786667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1536 sessionId: src_id|49e76e2b-4b27444d-e2c88570-ae296a19_0 is DEAD
2025-09-30T14:54:28.786817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49e76e2b-4b27444d-e2c88570-ae296a19_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:28.786841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49e76e2b-4b27444d-e2c88570-ae296a19_0] Write session will restart in 0.007376s
2025-09-30T14:54:28.786866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49e76e2b-4b27444d-e2c88570-ae296a19_0] Write session: Do CDS request
2025-09-30T14:54:28.786872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49e76e2b-4b27444d-e2c88570-ae296a19_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:28.795775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49e76e2b-4b27444d-e2c88570-ae296a19_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:28.795908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:28.795925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1537
2025-09-30T14:54:28.796057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1537 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:28.796101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1537 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:28.796106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1537 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:28.796111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:28.796589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1537 sessionId:  describe result for acl check
2025-09-30T14:54:28.796627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:28.796630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:28.796632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:28.796637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895739759070967:9371] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:28.797166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895739759070967:9371] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:28.799395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895739759070967:9371] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:28.802511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895739759070967:9371] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:28.802526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895739759070967:9371] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:28.802542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895739759070967:9371] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:28.802551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1537 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:28.803565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:28.805491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:28.805695Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:28.805709Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:28.805720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:28.805771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:28.805817Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895739669318611:9134]
2025-09-30T14:54:28.806503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:28.806846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:28.806907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:28.807295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:28.807361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:28.807368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:28.807369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:28.807370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:28.807372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:28.807373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:28.807375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:28.807376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:28.807377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:28.807379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:28.807380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.807381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.807383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.807384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:28.807385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:28.807390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:28.807401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:28.807404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:28.807408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:28.807412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:28.807417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:28.807421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:28.807425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:28.807429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:28.807433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:28.807437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.807441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.807445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.807449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:28.807453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:28.807460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:28.807468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:28.807475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:28.807480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:28.807485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:28.807490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:28.807496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:28.807501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:28.807507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:28.807517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:28.807522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:28.807527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:28.807531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:28.807536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:28.807541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:28.807546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:28.807555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:28.807561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:28.807565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:28.807575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:28.807579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.807585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.807597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.807602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.807607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.807613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.807617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:28.807622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:28.807627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:28.807632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:28.807680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:28.814086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:28.815030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:28.815051Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:28.815055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:28.815060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:28.815067Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1536 [2:7555895739669318611:9134]
2025-09-30T14:54:28.815086Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:28.815108Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:28.815111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:28.815114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:28.815117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:28.815135Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:28.815142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:28.815156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:28.815225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.815234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.815236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.815239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:28.815259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:28.815340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:28.815348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.815363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.815379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.815400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:28.815427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895739759070952:2454], now have 1 active actors on pipe
2025-09-30T14:54:28.815431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895739759071068:9371], now have 1 active actors on pipe
2025-09-30T14:54:28.815437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895739669318606:9134]
2025-09-30T14:54:28.815439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895739669318606:9134]
2025-09-30T14:54:28.815441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895739669318606:9134]
2025-09-30T14:54:28.815455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:28.815470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:28.815480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:28.815482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:28.815484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:28.815485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:28.815489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:28.815527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895739669318606:9134]
2025-09-30T14:54:28.815492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1536
2025-09-30T14:54:28.815562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1536
2025-09-30T14:54:28.815530Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:28.815540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:28.815665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:28.815677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:28.815701Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1198dfa-f76c920f-39c55b3c-fc9e7b2d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:28.815713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:28.815718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:28.815721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:28.815731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:28.815741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:28.815757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:28.815904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:28.815912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:28.815925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:28.816032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1537 partition: 0 MaxSeqNo: 42 sessionId: src_id|b1198dfa-f76c920f-39c55b3c-fc9e7b2d_0
2025-09-30T14:54:28.816457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49e76e2b-4b27444d-e2c88570-ae296a19_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b1198dfa-f76c920f-39c55b3c-fc9e7b2d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:28.819373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1198dfa-f76c920f-39c55b3c-fc9e7b2d_0] Write session: try to update token
2025-09-30T14:54:28.819399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1198dfa-f76c920f-39c55b3c-fc9e7b2d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:28.827940Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:28.827960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:28.827970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895739669318606:9134]
2025-09-30T14:54:28.828016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:28.828039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:28.828206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:28.828367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:28.828518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:28.828671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:28.828885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:28.828929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:28.837017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1537 sessionId: src_id|b1198dfa-f76c920f-39c55b3c-fc9e7b2d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:28.839923Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:28.839948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:28.839951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:28.839954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:28.839972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:28.839969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895739669318606:9134]
2025-09-30T14:54:28.839974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895739669318606:9134]
2025-09-30T14:54:28.839978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895739669318606:9134]
2025-09-30T14:54:28.840038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:28.840054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.840054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:28.840058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:28.840061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:28.840065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:28.840238Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:28.886744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895739759071081:9180]
2025-09-30T14:54:28.887056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1536, pipe: [1:7555895739759071081:9180]
2025-09-30T14:54:28.966768Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:28.967633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:28.967656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:28.967679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895739759071081:9180], now have 1 active actors on pipe
2025-09-30T14:54:28.967888Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:28.968224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:28.968327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1537 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b1198dfa-f76c920f-39c55b3c-fc9e7b2d_0
2025-09-30T14:54:28.968539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1537 sessionId: src_id|b1198dfa-f76c920f-39c55b3c-fc9e7b2d_0 is DEAD
2025-09-30T14:54:28.968924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1198dfa-f76c920f-39c55b3c-fc9e7b2d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:28.968947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1198dfa-f76c920f-39c55b3c-fc9e7b2d_0] Write session will restart in 0.005583s
2025-09-30T14:54:28.968970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1198dfa-f76c920f-39c55b3c-fc9e7b2d_0] Write session: Do CDS request
2025-09-30T14:54:28.968975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1198dfa-f76c920f-39c55b3c-fc9e7b2d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:28.969005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895739759071081:9180]
2025-09-30T14:54:28.969040Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:28.975819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1198dfa-f76c920f-39c55b3c-fc9e7b2d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:28.975937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:28.975957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1538
2025-09-30T14:54:28.976077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1538 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:28.976112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1538 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:28.976125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1538 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:28.976129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:28.976623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1538 sessionId:  describe result for acl check
2025-09-30T14:54:28.976663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:28.976665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:28.976667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:28.976674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895739759071111:9381] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:28.977338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895739759071111:9381] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:28.979268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895739759071111:9381] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:28.982494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895739759071111:9381] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:28.982511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895739759071111:9381] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:28.982515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895739759071111:9381] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:28.982523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1538 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:28.992201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:28.995292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:28.995632Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:28.995657Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:28.995669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:28.995751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:28.995795Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895739669318769:9142]
2025-09-30T14:54:28.996433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:28.996847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:28.996899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:28.997230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:28.997291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:28.997292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:28.997294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:28.997296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:28.997298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:28.997299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:28.997300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:28.997301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:28.997303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:28.997304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:28.997305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.997306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.997307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.997309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:28.997310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:28.997316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:28.997344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:28.997351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:28.997357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:28.997361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:28.997365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:28.997370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:28.997374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:28.997378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:28.997382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:28.997386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.997390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.997394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.997398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:28.997402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:28.997411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:28.997419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:28.997425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:28.997431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:28.997436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:28.997443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:28.997448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:28.997454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:28.997459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:28.997465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:28.997471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:28.997477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:28.997482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:28.997487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:28.997492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:28.997498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:28.997503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:28.997509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:28.997516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:28.997522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:28.997526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.997532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:28.997536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.997541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:28.997547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.997552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:28.997557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:28.997562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:28.997567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:28.997573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:28.997618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:29.003904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:29.005104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:29.005128Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:29.005131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:29.005134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:29.005142Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1537 [2:7555895739669318769:9142]
2025-09-30T14:54:29.005160Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:29.005179Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:29.005189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:29.005192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:29.005199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:29.005215Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:29.005223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:29.005229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:29.005292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.005301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.005303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.005307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:29.005310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:29.005384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:29.005392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.005406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.005419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.005438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:29.005461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895739669318764:9142]
2025-09-30T14:54:29.005468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895739669318764:9142]
2025-09-30T14:54:29.005471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895739669318764:9142]
2025-09-30T14:54:29.005485Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:29.005503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:29.005517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:29.005520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:29.005526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:29.005529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:29.005531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:29.005555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895739669318764:9142]
2025-09-30T14:54:29.005559Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:29.005611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:29.005799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895739759071099:2454], now have 1 active actors on pipe
2025-09-30T14:54:29.005809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895739759071145:9381], now have 1 active actors on pipe
2025-09-30T14:54:29.005913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1537
2025-09-30T14:54:29.005913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1537
2025-09-30T14:54:29.006115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:29.006127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:29.006155Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1c1cacc-43c06ca4-28f331ec-7667e89e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:29.006164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:29.006168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:29.006171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:29.006183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:29.006194Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:29.006209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:29.006670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:29.006680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:29.006700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:29.006843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1538 partition: 0 MaxSeqNo: 42 sessionId: src_id|d1c1cacc-43c06ca4-28f331ec-7667e89e_0
2025-09-30T14:54:29.007260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1198dfa-f76c920f-39c55b3c-fc9e7b2d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d1c1cacc-43c06ca4-28f331ec-7667e89e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:29.010382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c1cacc-43c06ca4-28f331ec-7667e89e_0] Write session: try to update token
2025-09-30T14:54:29.010401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c1cacc-43c06ca4-28f331ec-7667e89e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:29.018964Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:29.018985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:29.018988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:29.018990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:29.019000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895739669318764:9142]
2025-09-30T14:54:29.019006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895739669318764:9142]
2025-09-30T14:54:29.019010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895739669318764:9142]
2025-09-30T14:54:29.019055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:29.019062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.019065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:29.019074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:29.019081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:29.019085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:29.019206Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:29.026658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1538 sessionId: src_id|d1c1cacc-43c06ca4-28f331ec-7667e89e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:29.029277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:29.069036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895744054038531:9180]
2025-09-30T14:54:29.069403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1537, pipe: [1:7555895744054038531:9180]
2025-09-30T14:54:29.131458Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:29.131735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:29.131746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:29.131764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895744054038531:9180], now have 1 active actors on pipe
2025-09-30T14:54:29.132002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895744054038531:9180]
2025-09-30T14:54:29.132028Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:29.132014Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:29.132039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:29.132042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:29.132105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1538 reason: error at write: Disconnected sessionId: src_id|d1c1cacc-43c06ca4-28f331ec-7667e89e_0
2025-09-30T14:54:29.132341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1538 sessionId: src_id|d1c1cacc-43c06ca4-28f331ec-7667e89e_0 is DEAD
2025-09-30T14:54:29.132565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c1cacc-43c06ca4-28f331ec-7667e89e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:29.132576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c1cacc-43c06ca4-28f331ec-7667e89e_0] Write session will restart in 0.009672s
2025-09-30T14:54:29.132608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c1cacc-43c06ca4-28f331ec-7667e89e_0] Write session: Do CDS request
2025-09-30T14:54:29.132618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c1cacc-43c06ca4-28f331ec-7667e89e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:29.143790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c1cacc-43c06ca4-28f331ec-7667e89e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:29.143920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:29.143936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1539
2025-09-30T14:54:29.144057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1539 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:29.144093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1539 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:29.144103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1539 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:29.144107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:29.144554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1539 sessionId:  describe result for acl check
2025-09-30T14:54:29.144589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:29.144593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:29.144596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:29.144601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895744054038622:9387] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:29.145164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895744054038622:9387] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:29.145580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:29.148857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895744054038622:9387] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:29.149269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:29.149513Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:29.149527Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:29.149539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:29.149598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:29.149640Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895743964286187:9150]
2025-09-30T14:54:29.150352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:29.150726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:29.150779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:29.151127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:29.151207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:29.151214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:29.151216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:29.151217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:29.151219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:29.151220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:29.151222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:29.151223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:29.151224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:29.151226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:29.151227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.151228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.151229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.151231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:29.151232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:29.151238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:29.151274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:29.151279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:29.151283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:29.151289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:29.151294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:29.151298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:29.151303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:29.151308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:29.151312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:29.151317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.151321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.151324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.151328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:29.151332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:29.151341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:29.151349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:29.151356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:29.151362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:29.151367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:29.151375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:29.151386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:29.151392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:29.151402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:29.151408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:29.151416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:29.151424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:29.151433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:29.151443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:29.151448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:29.151457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:29.151464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:29.151474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:29.151483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:29.151489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:29.151498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.151508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.151513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.151522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.151528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.151537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.151542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:29.151552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:29.151560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:29.151569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:29.151620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:29.152696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895744054038622:9387] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:29.152717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895744054038622:9387] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:29.152721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895744054038622:9387] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:29.152731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1539 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:29.158062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:29.159102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:29.159125Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:29.159128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:29.159133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:29.159142Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1538 [2:7555895743964286187:9150]
2025-09-30T14:54:29.159169Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:29.159191Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:29.159203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:29.159207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:29.159211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:29.159233Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:29.159266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:29.159276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:29.159355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.159368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.159371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.159375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:29.159378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:29.159472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:29.159484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.159501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.159515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.159535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:29.159560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895744054038539:2454], now have 1 active actors on pipe
2025-09-30T14:54:29.159570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895744054038663:9387], now have 1 active actors on pipe
2025-09-30T14:54:29.159581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895743964286181:9150]
2025-09-30T14:54:29.159585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895743964286181:9150]
2025-09-30T14:54:29.159587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895743964286181:9150]
2025-09-30T14:54:29.159604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:29.159619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:29.159622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:29.159630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:29.159633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:29.159641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:29.159645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:29.159693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895743964286181:9150]
2025-09-30T14:54:29.159705Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:29.159724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:29.159671Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1538
2025-09-30T14:54:29.159754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:29.159766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:29.159684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1538
2025-09-30T14:54:29.159808Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68c91499-efce8672-ecd6c12b-3844f4f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:29.159822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:29.159827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:29.159829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:29.159844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:29.159861Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:29.159880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:29.160065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:29.160080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:29.160106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:29.160209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1539 partition: 0 MaxSeqNo: 42 sessionId: src_id|68c91499-efce8672-ecd6c12b-3844f4f9_0
2025-09-30T14:54:29.160697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c1cacc-43c06ca4-28f331ec-7667e89e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|68c91499-efce8672-ecd6c12b-3844f4f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:29.163811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68c91499-efce8672-ecd6c12b-3844f4f9_0] Write session: try to update token
2025-09-30T14:54:29.163836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68c91499-efce8672-ecd6c12b-3844f4f9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:29.173433Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:29.173458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:29.173462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:29.173464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:29.173476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895743964286181:9150]
2025-09-30T14:54:29.173482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895743964286181:9150]
2025-09-30T14:54:29.173487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895743964286181:9150]
2025-09-30T14:54:29.173544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:29.173544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:29.173552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:29.173553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.173556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:29.173557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:29.173755Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:29.180309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1539 sessionId: src_id|68c91499-efce8672-ecd6c12b-3844f4f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:29.183752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:29.232355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895744054038673:9180]
2025-09-30T14:54:29.232724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1538, pipe: [1:7555895744054038673:9180]
2025-09-30T14:54:29.297562Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:29.298117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:29.298136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:29.298156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895744054038673:9180], now have 1 active actors on pipe
2025-09-30T14:54:29.298440Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:29.298533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:29.298579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:29.298612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895744054038673:9180]
2025-09-30T14:54:29.298716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1539 reason: status is not ok: tablet will be restarted right now sessionId: src_id|68c91499-efce8672-ecd6c12b-3844f4f9_0
2025-09-30T14:54:29.298956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1539 sessionId: src_id|68c91499-efce8672-ecd6c12b-3844f4f9_0 is DEAD
2025-09-30T14:54:29.299197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68c91499-efce8672-ecd6c12b-3844f4f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:29.299207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68c91499-efce8672-ecd6c12b-3844f4f9_0] Write session will restart in 0.007987s
2025-09-30T14:54:29.299239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68c91499-efce8672-ecd6c12b-3844f4f9_0] Write session: Do CDS request
2025-09-30T14:54:29.299263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68c91499-efce8672-ecd6c12b-3844f4f9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:29.308823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68c91499-efce8672-ecd6c12b-3844f4f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:29.308936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:29.308953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1540
2025-09-30T14:54:29.309112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1540 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:29.309150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1540 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:29.309161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1540 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:29.309166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:29.309729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1540 sessionId:  describe result for acl check
2025-09-30T14:54:29.309786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:29.309892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:29.309906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:29.309915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895744054038744:9391] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:29.310591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895744054038744:9391] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:29.312007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:29.312673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895744054038744:9391] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:29.314649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:29.314875Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:29.314886Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:29.314898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:29.314960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:29.315024Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895743964286313:9153]
2025-09-30T14:54:29.315669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:29.315736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895744054038744:9391] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:29.315752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895744054038744:9391] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:29.315756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895744054038744:9391] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:29.315767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1540 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:29.316047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:29.316097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:29.316360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:29.316411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:29.316417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:29.316418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:29.316419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:29.316419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:29.316420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:29.316421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:29.316422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:29.316423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:29.316424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:29.316425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.316425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.316426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.316427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:29.316428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:29.316432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:29.316438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:29.316441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:29.316444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:29.316448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:29.316453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:29.316457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:29.316461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:29.316464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:29.316471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:29.316475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.316479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.316482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.316486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:29.316490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:29.316498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:29.316505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:29.316513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:29.316518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:29.316521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:29.316524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:29.316527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:29.316530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:29.316533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:29.316536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:29.316539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:29.316543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:29.316546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:29.316549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:29.316552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:29.316555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:29.316560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:29.316565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:29.316569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:29.316575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:29.316581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.316586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.316596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.316602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.316611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.316615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.316624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:29.316629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:29.316634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:29.316639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:29.316682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:29.323165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:29.324233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:29.324256Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:29.324260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:29.324265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:29.324276Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1539 [2:7555895743964286313:9153]
2025-09-30T14:54:29.324312Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:29.324345Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:29.324355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:29.324359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:29.324362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:29.324388Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:29.324404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:29.324415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:29.324502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.324512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.324515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.324520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:29.324523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:29.324622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:29.324632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.324649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.324668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.324693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:29.324722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895743964286308:9153]
2025-09-30T14:54:29.324731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895743964286308:9153]
2025-09-30T14:54:29.324734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895743964286308:9153]
2025-09-30T14:54:29.324747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:29.324758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:29.324763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:29.324766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:29.324770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895744054038675:2454], now have 1 active actors on pipe
2025-09-30T14:54:29.324781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:29.324802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:29.324812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:29.324819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895744054038796:9391], now have 1 active actors on pipe
2025-09-30T14:54:29.324823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1539
2025-09-30T14:54:29.324871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895743964286308:9153]
2025-09-30T14:54:29.324826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1539
2025-09-30T14:54:29.324882Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:29.324902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:29.324935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:29.324948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:29.324991Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3569f36c-b0d086d3-d6ff9871-ee89d7e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:29.325006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:29.325010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:29.325013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:29.325028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:29.325045Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:29.325068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:29.325316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:29.325336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:29.325366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:29.325585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1540 partition: 0 MaxSeqNo: 42 sessionId: src_id|3569f36c-b0d086d3-d6ff9871-ee89d7e7_0
2025-09-30T14:54:29.325971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68c91499-efce8672-ecd6c12b-3844f4f9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3569f36c-b0d086d3-d6ff9871-ee89d7e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:29.328847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3569f36c-b0d086d3-d6ff9871-ee89d7e7_0] Write session: try to update token
2025-09-30T14:54:29.328870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3569f36c-b0d086d3-d6ff9871-ee89d7e7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:29.338321Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:29.338347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:29.338350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:29.338353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:29.338367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895743964286308:9153]
2025-09-30T14:54:29.338373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895743964286308:9153]
2025-09-30T14:54:29.338377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895743964286308:9153]
2025-09-30T14:54:29.338431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:29.338439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.338443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:29.338442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:29.338452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:29.338458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:29.338655Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:29.344837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1540 sessionId: src_id|3569f36c-b0d086d3-d6ff9871-ee89d7e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:29.347820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:29.398755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895744054038807:9180]
2025-09-30T14:54:29.399087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1539, pipe: [1:7555895744054038807:9180]
2025-09-30T14:54:29.460906Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:29.461603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:29.461628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:29.461676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895744054038807:9180], now have 1 active actors on pipe
2025-09-30T14:54:29.462000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895744054038807:9180]
2025-09-30T14:54:29.462001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:29.462048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:29.462052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:29.462033Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:29.462134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1540 reason: error at write: Disconnected sessionId: src_id|3569f36c-b0d086d3-d6ff9871-ee89d7e7_0
2025-09-30T14:54:29.462322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1540 sessionId: src_id|3569f36c-b0d086d3-d6ff9871-ee89d7e7_0 is DEAD
2025-09-30T14:54:29.462493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3569f36c-b0d086d3-d6ff9871-ee89d7e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:29.462504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3569f36c-b0d086d3-d6ff9871-ee89d7e7_0] Write session will restart in 0.008375s
2025-09-30T14:54:29.462530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3569f36c-b0d086d3-d6ff9871-ee89d7e7_0] Write session: Do CDS request
2025-09-30T14:54:29.462538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3569f36c-b0d086d3-d6ff9871-ee89d7e7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:29.471881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3569f36c-b0d086d3-d6ff9871-ee89d7e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:29.472090Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:29.472112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1541
2025-09-30T14:54:29.472292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1541 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:29.472329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1541 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:29.472344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1541 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:29.472349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:29.472985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1541 sessionId:  describe result for acl check
2025-09-30T14:54:29.473035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:29.473043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:29.473046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:29.473053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895744054038833:9395] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:29.473735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895744054038833:9395] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:29.476569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895744054038833:9395] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:29.477611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:29.480447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:29.480654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895744054038833:9395] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:29.480675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895744054038833:9395] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:29.480679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895744054038833:9395] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:29.480689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1541 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:29.480776Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:29.480793Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:29.480808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:29.480899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:29.480956Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895743964286450:9156]
2025-09-30T14:54:29.481730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:29.482058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:29.482112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:29.482499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:29.482585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:29.482596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:29.482598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:29.482600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:29.482602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:29.482603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:29.482605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:29.482606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:29.482608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:29.482610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:29.482611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.482613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.482614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.482615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:29.482617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:29.482624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:29.482637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:29.482642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:29.482646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:29.482650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:29.482655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:29.482659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:29.482664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:29.482669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:29.482674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:29.482679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.482684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.482688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.482693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:29.482698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:29.482707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:29.482716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:29.482724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:29.482731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:29.482737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:29.482743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:29.482750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:29.482757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:29.482763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:29.482770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:29.482775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:29.482781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:29.482789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:29.482795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:29.482801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:29.482807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:29.482813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:29.482820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:29.482825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:29.482832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:29.482838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.482843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.482850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.482855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.482862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.482867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.482872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:29.482878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:29.482884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:29.482891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:29.482942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:29.493038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:29.494375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:29.494395Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:29.494398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:29.494401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:29.494408Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1540 [2:7555895743964286450:9156]
2025-09-30T14:54:29.494425Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:29.494445Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:29.494450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:29.494454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:29.494458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:29.494479Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:29.494488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:29.494504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:29.494586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.494596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.494600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.494604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:29.494608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:29.494703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:29.494712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.494729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.494742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.494761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:29.494784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895744054038943:9395], now have 1 active actors on pipe
2025-09-30T14:54:29.494796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895744054038809:2454], now have 1 active actors on pipe
2025-09-30T14:54:29.494805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895743964286445:9156]
2025-09-30T14:54:29.494808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895743964286445:9156]
2025-09-30T14:54:29.494812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895743964286445:9156]
2025-09-30T14:54:29.494826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:29.494844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:29.494843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:29.494848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:29.494851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:29.494872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:29.494888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1540
2025-09-30T14:54:29.494899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1540
2025-09-30T14:54:29.494876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:29.494933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895743964286445:9156]
2025-09-30T14:54:29.494941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:29.494949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:29.494966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:29.494972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:29.495040Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bcecfd88-5c77be49-424fdf81-95b8688e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:29.495059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:29.495063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:29.495066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:29.495081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:29.495093Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:29.495119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:29.495338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:29.495349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:29.495366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:29.495468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1541 partition: 0 MaxSeqNo: 42 sessionId: src_id|bcecfd88-5c77be49-424fdf81-95b8688e_0
2025-09-30T14:54:29.495946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3569f36c-b0d086d3-d6ff9871-ee89d7e7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bcecfd88-5c77be49-424fdf81-95b8688e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:29.498850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcecfd88-5c77be49-424fdf81-95b8688e_0] Write session: try to update token
2025-09-30T14:54:29.498872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcecfd88-5c77be49-424fdf81-95b8688e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:29.508669Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:29.508693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:29.508696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:29.508699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:29.508711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895743964286445:9156]
2025-09-30T14:54:29.508720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895743964286445:9156]
2025-09-30T14:54:29.508730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895743964286445:9156]
2025-09-30T14:54:29.508781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:29.508791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:29.508794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.508798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:29.508799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:29.508803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:29.509008Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:29.514728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1541 sessionId: src_id|bcecfd88-5c77be49-424fdf81-95b8688e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:29.517473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:29.562082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895744054038954:9180]
2025-09-30T14:54:29.562490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1540, pipe: [1:7555895744054038954:9180]
2025-09-30T14:54:29.631704Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:29.632119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:29.632136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:29.632189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895744054038954:9180], now have 1 active actors on pipe
2025-09-30T14:54:29.632386Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:29.632434Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:29.632447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:29.632452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:29.632521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895744054038954:9180]
2025-09-30T14:54:29.632724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1541 reason: error at write: Disconnected sessionId: src_id|bcecfd88-5c77be49-424fdf81-95b8688e_0
2025-09-30T14:54:29.632944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1541 sessionId: src_id|bcecfd88-5c77be49-424fdf81-95b8688e_0 is DEAD
2025-09-30T14:54:29.633135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcecfd88-5c77be49-424fdf81-95b8688e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:29.633146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcecfd88-5c77be49-424fdf81-95b8688e_0] Write session will restart in 0.006130s
2025-09-30T14:54:29.633173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcecfd88-5c77be49-424fdf81-95b8688e_0] Write session: Do CDS request
2025-09-30T14:54:29.633182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcecfd88-5c77be49-424fdf81-95b8688e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:29.640786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcecfd88-5c77be49-424fdf81-95b8688e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:29.640894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:29.640913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1542
2025-09-30T14:54:29.641106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1542 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:29.641141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1542 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:29.641153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1542 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:29.641157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:29.641743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1542 sessionId:  describe result for acl check
2025-09-30T14:54:29.641781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:29.641790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:29.641793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:29.641799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895744054038978:9401] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:29.642485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895744054038978:9401] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:29.646503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895744054038978:9401] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:29.647883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:29.650560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:29.650921Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:29.650944Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:29.650986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:29.650998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895744054038978:9401] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:29.651015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895744054038978:9401] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:29.651019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895744054038978:9401] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:29.651028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1542 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:29.651167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:29.651227Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895743964286576:9158]
2025-09-30T14:54:29.651920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:29.652267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:29.652333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:29.652698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:29.652797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:29.652806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:29.652807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:29.652809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:29.652810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:29.652812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:29.652813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:29.652815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:29.652816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:29.652818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:29.652819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.652821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.652822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.652823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:29.652825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:29.652833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:29.652844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:29.652849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:29.652854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:29.652859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:29.652863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:29.652867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:29.652872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:29.652876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:29.652883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:29.652887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.652892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.652896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.652901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:29.652906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:29.652915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:29.652931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:29.652943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:29.652956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:29.652967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:29.652978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:29.652988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:29.652995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:29.653000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:29.653006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:29.653013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:29.653024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:29.653035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:29.653047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:29.653056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:29.653062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:29.653074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:29.653088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:29.653094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:29.653115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:29.653126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.653131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.653138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.653149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.653157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.653167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.653175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:29.653185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:29.653190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:29.653197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:29.653250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:29.659549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:29.660394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:29.660415Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:29.660418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:29.660422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:29.660430Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1541 [2:7555895743964286576:9158]
2025-09-30T14:54:29.660448Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:29.660462Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:29.660471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:29.660475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:29.660478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:29.660494Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:29.660506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:29.660514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:29.660582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.660593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.660596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.660600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:29.660603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:29.660676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:29.660684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.660698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.660717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.660739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:29.660763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895744054038958:2454], now have 1 active actors on pipe
2025-09-30T14:54:29.660768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895744054039082:9401], now have 1 active actors on pipe
2025-09-30T14:54:29.660781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895743964286571:9158]
2025-09-30T14:54:29.660784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895743964286571:9158]
2025-09-30T14:54:29.660787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895743964286571:9158]
2025-09-30T14:54:29.660801Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:29.660818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:29.660826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:29.660832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:29.660834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:29.660839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:29.660843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:29.660832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1541
2025-09-30T14:54:29.660877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895743964286571:9158]
2025-09-30T14:54:29.660847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1541
2025-09-30T14:54:29.660889Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:29.660893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:29.660924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:29.660934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:29.660971Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e77ff21b-1bcc517a-bbd8f1d-e15c1cc2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:29.660983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:29.660987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:29.660989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:29.660999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:29.661012Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:29.661038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:29.661224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:29.661235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:29.661251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:29.661349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1542 partition: 0 MaxSeqNo: 42 sessionId: src_id|e77ff21b-1bcc517a-bbd8f1d-e15c1cc2_0
2025-09-30T14:54:29.661766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcecfd88-5c77be49-424fdf81-95b8688e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e77ff21b-1bcc517a-bbd8f1d-e15c1cc2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:29.665405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e77ff21b-1bcc517a-bbd8f1d-e15c1cc2_0] Write session: try to update token
2025-09-30T14:54:29.665433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e77ff21b-1bcc517a-bbd8f1d-e15c1cc2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:29.674070Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:29.674099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:29.674103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:29.674105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:29.674114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895743964286571:9158]
2025-09-30T14:54:29.674120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895743964286571:9158]
2025-09-30T14:54:29.674125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895743964286571:9158]
2025-09-30T14:54:29.674167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:29.674174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.674177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:29.674186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:29.674217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:29.674222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:29.674337Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:29.682935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1542 sessionId: src_id|e77ff21b-1bcc517a-bbd8f1d-e15c1cc2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:29.686209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:29.732585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895744054039093:9180]
2025-09-30T14:54:29.732890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1541, pipe: [1:7555895744054039093:9180]
2025-09-30T14:54:29.784195Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:29.784734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:29.784750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:29.784767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895744054039093:9180], now have 1 active actors on pipe
2025-09-30T14:54:29.784983Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:29.785054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:29.785087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895744054039093:9180]
2025-09-30T14:54:29.785126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:29.785242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1542 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e77ff21b-1bcc517a-bbd8f1d-e15c1cc2_0
2025-09-30T14:54:29.785451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1542 sessionId: src_id|e77ff21b-1bcc517a-bbd8f1d-e15c1cc2_0 is DEAD
2025-09-30T14:54:29.785617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e77ff21b-1bcc517a-bbd8f1d-e15c1cc2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:29.785627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e77ff21b-1bcc517a-bbd8f1d-e15c1cc2_0] Write session will restart in 0.007530s
2025-09-30T14:54:29.785657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e77ff21b-1bcc517a-bbd8f1d-e15c1cc2_0] Write session: Do CDS request
2025-09-30T14:54:29.785662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e77ff21b-1bcc517a-bbd8f1d-e15c1cc2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:29.794847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e77ff21b-1bcc517a-bbd8f1d-e15c1cc2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:29.794868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:29.794886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1543
2025-09-30T14:54:29.795118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1543 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:29.795159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1543 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:29.795171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1543 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:29.795177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:29.795714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1543 sessionId:  describe result for acl check
2025-09-30T14:54:29.795765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:29.795772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:29.795775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:29.795781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895744054039148:9405] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:29.796446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895744054039148:9405] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:29.798443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:29.798818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895744054039148:9405] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:29.802097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895744054039148:9405] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:29.802116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895744054039148:9405] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:29.802120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895744054039148:9405] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:29.802130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1543 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:29.802246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:29.802464Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:29.802475Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:29.802487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:29.802545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:29.802589Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895743964286706:9161]
2025-09-30T14:54:29.803323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:29.803721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:29.803766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:29.804101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:29.804170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:29.804176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:29.804178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:29.804179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:29.804181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:29.804183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:29.804184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:29.804186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:29.804187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:29.804188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:29.804190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.804191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.804192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.804193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:29.804194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:29.804200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:29.804212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:29.804217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:29.804222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:29.804227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:29.804231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:29.804236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:29.804240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:29.804244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:29.804250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:29.804254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.804258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.804263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.804271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:29.804281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:29.804294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:29.804307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:29.804323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:29.804330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:29.804335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:29.804342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:29.804347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:29.804355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:29.804360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:29.804365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:29.804370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:29.804376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:29.804381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:29.804387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:29.804392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:29.804397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:29.804402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:29.804415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:29.804420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:29.804432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:29.804441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.804452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.804462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.804472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.804482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.804492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.804500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:29.804506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:29.804516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:29.804526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:29.804581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:29.810555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:29.811561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:29.811578Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:29.811581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:29.811585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:29.811593Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1542 [2:7555895743964286706:9161]
2025-09-30T14:54:29.811607Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:29.811621Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:29.811623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:29.811626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:29.811628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:29.811640Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:29.811646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:29.811653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:29.811711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.811722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.811725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.811728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:29.811731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:29.811797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:29.811807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.811821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.811837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.811859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:29.811883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895744054039219:9405], now have 1 active actors on pipe
2025-09-30T14:54:29.811892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895744054039095:2454], now have 1 active actors on pipe
2025-09-30T14:54:29.811899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895743964286700:9161]
2025-09-30T14:54:29.811905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895743964286700:9161]
2025-09-30T14:54:29.811908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895743964286700:9161]
2025-09-30T14:54:29.811922Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:29.811941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:29.811945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:29.811951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:29.811957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:29.811961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:29.811966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:29.811991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895743964286700:9161]
2025-09-30T14:54:29.811995Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:29.811999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:29.812025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1542
2025-09-30T14:54:29.812033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1542
2025-09-30T14:54:29.812192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:29.812204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:29.812229Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfd507f2-921eed89-e36357a2-d303a189_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:29.812240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:29.812243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:29.812245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:29.812252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:29.812264Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:29.812281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:29.812469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:29.812477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:29.812492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:29.812613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1543 partition: 0 MaxSeqNo: 42 sessionId: src_id|cfd507f2-921eed89-e36357a2-d303a189_0
2025-09-30T14:54:29.813029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e77ff21b-1bcc517a-bbd8f1d-e15c1cc2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cfd507f2-921eed89-e36357a2-d303a189_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:29.816104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfd507f2-921eed89-e36357a2-d303a189_0] Write session: try to update token
2025-09-30T14:54:29.816132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfd507f2-921eed89-e36357a2-d303a189_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:29.825171Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:29.825197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:29.825205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:29.825207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:29.825217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895743964286700:9161]
2025-09-30T14:54:29.825221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895743964286700:9161]
2025-09-30T14:54:29.825225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895743964286700:9161]
2025-09-30T14:54:29.825268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:29.825273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:29.825281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.825283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:29.825284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:29.825287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:29.825425Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:29.832917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1543 sessionId: src_id|cfd507f2-921eed89-e36357a2-d303a189_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:29.835668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:29.885121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895744054039230:9180]
2025-09-30T14:54:29.885519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1542, pipe: [1:7555895744054039230:9180]
2025-09-30T14:54:29.944045Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:29.944374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:29.944388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:29.944406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895744054039230:9180], now have 1 active actors on pipe
2025-09-30T14:54:29.944665Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:29.944739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:29.944755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:29.944796Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:29.944831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1543 reason: error at write: Disconnected sessionId: src_id|cfd507f2-921eed89-e36357a2-d303a189_0
2025-09-30T14:54:29.944874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895744054039230:9180]
2025-09-30T14:54:29.944993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1543 sessionId: src_id|cfd507f2-921eed89-e36357a2-d303a189_0 is DEAD
2025-09-30T14:54:29.945172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfd507f2-921eed89-e36357a2-d303a189_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:29.945179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfd507f2-921eed89-e36357a2-d303a189_0] Write session will restart in 0.005309s
2025-09-30T14:54:29.945206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfd507f2-921eed89-e36357a2-d303a189_0] Write session: Do CDS request
2025-09-30T14:54:29.945216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfd507f2-921eed89-e36357a2-d303a189_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:29.951893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfd507f2-921eed89-e36357a2-d303a189_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:29.952051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:29.952065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1544
2025-09-30T14:54:29.952214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1544 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:29.952259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1544 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:29.952265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1544 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:29.952269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:29.952742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1544 sessionId:  describe result for acl check
2025-09-30T14:54:29.952782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:29.952785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:29.952787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:29.952793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895744054039248:9409] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:29.953366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895744054039248:9409] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:29.955969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895744054039248:9409] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:29.959181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:29.959279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895744054039248:9409] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:29.959300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895744054039248:9409] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:29.959304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895744054039248:9409] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:29.959314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1544 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:29.962118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:29.962381Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:29.962403Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:29.962418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:29.962479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:29.962538Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895743964286834:9163]
2025-09-30T14:54:29.963271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:29.963683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:29.963752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:29.964152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:29.964223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:29.964230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:29.964231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:29.964232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:29.964232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:29.964233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:29.964235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:29.964236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:29.964237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:29.964237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:29.964239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.964240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.964241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.964241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:29.964243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:29.964248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:29.964257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:29.964260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:29.964262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:29.964265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:29.964268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:29.964270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:29.964273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:29.964276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:29.964281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:29.964283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.964286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.964288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.964290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:29.964293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:29.964301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:29.964309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:29.964314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:29.964318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:29.964321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:29.964326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:29.964329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:29.964332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:29.964336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:29.964340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:29.964343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:29.964346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:29.964350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:29.964354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:29.964357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:29.964361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:29.964364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:29.964369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:29.964372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:29.964376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:29.964379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.964383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.964386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.964390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.964394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.964397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.964400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:29.964403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:29.964409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:29.964412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:29.964437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:29.970839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:29.972071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:29.972088Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:29.972092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:29.972096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:29.972105Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1543 [2:7555895743964286834:9163]
2025-09-30T14:54:29.972136Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:29.972157Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:29.972167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:29.972171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:29.972174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:29.972195Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:29.972209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:29.972223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:29.972316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.972325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.972328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.972332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:29.972335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:29.972421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:29.972431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.972446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:29.972458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:29.972478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:29.972511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895744054039232:2454], now have 1 active actors on pipe
2025-09-30T14:54:29.972527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895743964286828:9163]
2025-09-30T14:54:29.972530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895743964286828:9163]
2025-09-30T14:54:29.972533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895743964286828:9163]
2025-09-30T14:54:29.972548Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:29.972567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895744054039356:9409], now have 1 active actors on pipe
2025-09-30T14:54:29.972571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:29.972576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:29.972582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:29.972579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:29.972600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:29.972605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:29.972652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895743964286828:9163]
2025-09-30T14:54:29.972664Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:29.972635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1543
2025-09-30T14:54:29.972676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1543
2025-09-30T14:54:29.972691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:29.972716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:29.972728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:29.972766Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f68a70e9-1fbb9933-327495b-8eea0b66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:29.972780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:29.972785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:29.972788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:29.972801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:29.972819Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:29.972844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:29.973086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:29.973100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:29.973122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:29.973232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1544 partition: 0 MaxSeqNo: 42 sessionId: src_id|f68a70e9-1fbb9933-327495b-8eea0b66_0
2025-09-30T14:54:29.973680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfd507f2-921eed89-e36357a2-d303a189_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f68a70e9-1fbb9933-327495b-8eea0b66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:29.977341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f68a70e9-1fbb9933-327495b-8eea0b66_0] Write session: try to update token
2025-09-30T14:54:29.977365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f68a70e9-1fbb9933-327495b-8eea0b66_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:29.986626Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:29.986650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:29.986653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:29.986656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:29.986667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895743964286828:9163]
2025-09-30T14:54:29.986673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895743964286828:9163]
2025-09-30T14:54:29.986679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895743964286828:9163]
2025-09-30T14:54:29.986722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:29.986733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:29.986736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:29.986741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:29.986749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:29.986754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:29.986924Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:29.995051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1544 sessionId: src_id|f68a70e9-1fbb9933-327495b-8eea0b66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:29.997764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:30.044839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895748349006686:9180]
2025-09-30T14:54:30.045093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1543, pipe: [1:7555895748349006686:9180]
2025-09-30T14:54:30.100342Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:30.100732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:30.100761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:30.100788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895748349006686:9180], now have 1 active actors on pipe
2025-09-30T14:54:30.101005Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:30.101007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895748349006686:9180]
2025-09-30T14:54:30.101040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:30.101043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:30.101115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1544 reason: error at write: Disconnected sessionId: src_id|f68a70e9-1fbb9933-327495b-8eea0b66_0
2025-09-30T14:54:30.101291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1544 sessionId: src_id|f68a70e9-1fbb9933-327495b-8eea0b66_0 is DEAD
2025-09-30T14:54:30.101314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:30.101405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f68a70e9-1fbb9933-327495b-8eea0b66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:30.101424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f68a70e9-1fbb9933-327495b-8eea0b66_0] Write session will restart in 0.005898s
2025-09-30T14:54:30.101447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f68a70e9-1fbb9933-327495b-8eea0b66_0] Write session: Do CDS request
2025-09-30T14:54:30.101453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f68a70e9-1fbb9933-327495b-8eea0b66_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:30.108861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f68a70e9-1fbb9933-327495b-8eea0b66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:30.109054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:30.109069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1545
2025-09-30T14:54:30.109206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1545 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:30.109232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1545 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:30.109239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1545 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:30.109244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:30.109631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1545 sessionId:  describe result for acl check
2025-09-30T14:54:30.109659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:30.109665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:30.109667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:30.109671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895748349006737:9421] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:30.110126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895748349006737:9421] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:30.112348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:30.112469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895748349006737:9421] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:30.114562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:30.114791Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:30.114802Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:30.114814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:30.114864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:30.114895Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895748259254293:9177]
2025-09-30T14:54:30.115447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:30.115529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895748349006737:9421] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:30.115546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895748349006737:9421] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:30.115549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895748349006737:9421] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:30.115558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1545 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:30.115711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:30.115744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:30.115966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:30.116006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:30.116009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:30.116010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:30.116011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:30.116012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:30.116013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:30.116014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:30.116015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:30.116016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:30.116017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:30.116018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.116019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.116019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.116020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:30.116021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:30.116024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:30.116032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:30.116034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:30.116037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:30.116040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:30.116042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:30.116045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:30.116047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:30.116050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:30.116052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:30.116055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.116057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.116059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.116062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:30.116064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:30.116069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:30.116074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:30.116078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:30.116081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:30.116084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:30.116087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:30.116090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:30.116094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:30.116097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:30.116099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:30.116102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:30.116106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:30.116108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:30.116111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:30.116114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:30.116117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:30.116120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:30.116124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:30.116126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:30.116129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:30.116134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.116137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.116139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.116142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.116145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.116148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.116151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:30.116154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:30.116157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:30.116160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:30.116185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:30.121715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:30.122588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:30.122605Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:30.122607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:30.122611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:30.122617Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1544 [2:7555895748259254293:9177]
2025-09-30T14:54:30.122630Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:30.122644Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:30.122646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:30.122649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:30.122651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:30.122664Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:30.122669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:30.122674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:30.122738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.122745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.122747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.122749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:30.122751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:30.122820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:30.122829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.122843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.122858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.122873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:30.122888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895748349006821:9421], now have 1 active actors on pipe
2025-09-30T14:54:30.122895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895748349006693:2454], now have 1 active actors on pipe
2025-09-30T14:54:30.122900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895748259254287:9177]
2025-09-30T14:54:30.122901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895748259254287:9177]
2025-09-30T14:54:30.122903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895748259254287:9177]
2025-09-30T14:54:30.122913Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:30.122926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:30.122937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:30.122941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:30.122945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:30.122949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:30.122951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:30.122978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895748259254287:9177]
2025-09-30T14:54:30.122988Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:30.122995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:30.122983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1544
2025-09-30T14:54:30.123026Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1544
2025-09-30T14:54:30.123043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:30.123051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:30.123087Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2f990bb-cf56ea6a-604add38-d706b8e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:30.123097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:30.123100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:30.123102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:30.123111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:30.123121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:30.123132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:30.123287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:30.123293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:30.123303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:30.123374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1545 partition: 0 MaxSeqNo: 42 sessionId: src_id|f2f990bb-cf56ea6a-604add38-d706b8e5_0
2025-09-30T14:54:30.123791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f68a70e9-1fbb9933-327495b-8eea0b66_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f2f990bb-cf56ea6a-604add38-d706b8e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:30.127132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2f990bb-cf56ea6a-604add38-d706b8e5_0] Write session: try to update token
2025-09-30T14:54:30.127156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2f990bb-cf56ea6a-604add38-d706b8e5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:30.135275Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:30.135295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:30.135305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895748259254287:9177]
2025-09-30T14:54:30.135342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:30.135349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:30.135503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:30.135635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:30.135765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:30.135896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:30.136096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:30.136139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:30.144726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1545 sessionId: src_id|f2f990bb-cf56ea6a-604add38-d706b8e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:30.146373Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:30.146394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:30.146396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:30.146399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:30.146409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895748259254287:9177]
2025-09-30T14:54:30.146413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895748259254287:9177]
2025-09-30T14:54:30.146418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895748259254287:9177]
2025-09-30T14:54:30.146452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:30.146462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.146463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:30.146471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:30.146477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:30.146482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:30.146597Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:30.148079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:30.201053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895748349006833:9180]
2025-09-30T14:54:30.201295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1544, pipe: [1:7555895748349006833:9180]
2025-09-30T14:54:30.252180Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:30.252500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:30.252515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:30.252533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895748349006833:9180], now have 1 active actors on pipe
2025-09-30T14:54:30.252736Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:30.252839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:30.252843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895748349006833:9180]
2025-09-30T14:54:30.252854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:30.252879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:30.252919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1545 reason: error at write: Disconnected sessionId: src_id|f2f990bb-cf56ea6a-604add38-d706b8e5_0
2025-09-30T14:54:30.253076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1545 sessionId: src_id|f2f990bb-cf56ea6a-604add38-d706b8e5_0 is DEAD
2025-09-30T14:54:30.253224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2f990bb-cf56ea6a-604add38-d706b8e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:30.253233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2f990bb-cf56ea6a-604add38-d706b8e5_0] Write session will restart in 0.005106s
2025-09-30T14:54:30.253254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2f990bb-cf56ea6a-604add38-d706b8e5_0] Write session: Do CDS request
2025-09-30T14:54:30.253260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2f990bb-cf56ea6a-604add38-d706b8e5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:30.259815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2f990bb-cf56ea6a-604add38-d706b8e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:30.259890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:30.259908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1546
2025-09-30T14:54:30.260095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1546 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:30.260121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1546 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:30.260129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1546 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:30.260132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:30.260494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1546 sessionId:  describe result for acl check
2025-09-30T14:54:30.260519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:30.260523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:30.260525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:30.260531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895748349006863:9425] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:30.260970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895748349006863:9425] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:30.263282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895748349006863:9425] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:30.264058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:30.266061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:30.266262Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:30.266274Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:30.266286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:30.266339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:30.266381Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895748259254423:9179]
2025-09-30T14:54:30.266458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895748349006863:9425] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:30.266472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895748349006863:9425] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:30.266475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895748349006863:9425] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:30.266484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1546 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:30.267030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:30.267386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:30.267431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:30.267762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:30.267821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:30.267826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:30.267828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:30.267829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:30.267830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:30.267832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:30.267833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:30.267835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:30.267836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:30.267837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:30.267838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.267840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.267841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.267843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:30.267844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:30.267849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:30.267860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:30.267864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:30.267869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:30.267873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:30.267877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:30.267881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:30.267885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:30.267890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:30.267895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:30.267904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.267907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.267915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.267918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:30.267921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:30.267933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:30.267946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:30.267956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:30.267967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:30.267976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:30.267986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:30.267996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:30.268009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:30.268014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:30.268020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:30.268025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:30.268030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:30.268034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:30.268040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:30.268045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:30.268050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:30.268055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:30.268062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:30.268067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:30.268074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:30.268083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.268092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.268100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.268106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.268114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.268124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.268134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:30.268144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:30.268148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:30.268158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:30.268210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:30.273539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:30.274613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:30.274626Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:30.274628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:30.274631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:30.274636Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1545 [2:7555895748259254423:9179]
2025-09-30T14:54:30.274650Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:30.274667Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:30.274676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:30.274679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:30.274681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:30.274696Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:30.274708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:30.274714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:30.274757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.274763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.274764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.274766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:30.274768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:30.274813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:30.274824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.274837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.274849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.274867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:30.274891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895748349006962:9425], now have 1 active actors on pipe
2025-09-30T14:54:30.274899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895748349006834:2454], now have 1 active actors on pipe
2025-09-30T14:54:30.274904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895748259254415:9179]
2025-09-30T14:54:30.274911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895748259254415:9179]
2025-09-30T14:54:30.274913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895748259254415:9179]
2025-09-30T14:54:30.274926Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:30.274938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:30.274952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:30.274956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:30.274958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:30.274959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:30.274961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:30.274989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895748259254415:9179]
2025-09-30T14:54:30.274997Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:30.274978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1545
2025-09-30T14:54:30.275008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:30.274977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1545
2025-09-30T14:54:30.275029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:30.275034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:30.275062Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f1bbbd7-28ac0c3a-6a46d611-3dbd3798_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:30.275073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:30.275081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:30.275082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:30.275090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:30.275099Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:30.275114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:30.275237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:30.275262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:30.275278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:30.275439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1546 partition: 0 MaxSeqNo: 42 sessionId: src_id|7f1bbbd7-28ac0c3a-6a46d611-3dbd3798_0
2025-09-30T14:54:30.275815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2f990bb-cf56ea6a-604add38-d706b8e5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7f1bbbd7-28ac0c3a-6a46d611-3dbd3798_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:30.279079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f1bbbd7-28ac0c3a-6a46d611-3dbd3798_0] Write session: try to update token
2025-09-30T14:54:30.279100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f1bbbd7-28ac0c3a-6a46d611-3dbd3798_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:30.286619Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:30.286638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:30.286640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:30.286641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:30.286649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895748259254415:9179]
2025-09-30T14:54:30.286652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895748259254415:9179]
2025-09-30T14:54:30.286656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895748259254415:9179]
2025-09-30T14:54:30.286689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:30.286694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.286697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:30.286707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:30.286713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:30.286718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:30.286824Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:30.296589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1546 sessionId: src_id|7f1bbbd7-28ac0c3a-6a46d611-3dbd3798_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:30.299451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:30.353124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895748349006973:9180]
2025-09-30T14:54:30.353486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1545, pipe: [1:7555895748349006973:9180]
2025-09-30T14:54:30.392306Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:30.392797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:30.392816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:30.392846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895748349006973:9180], now have 1 active actors on pipe
2025-09-30T14:54:30.393079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:30.393103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:30.393106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895748349006973:9180]
2025-09-30T14:54:30.393129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:30.393164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1546 reason: error at write: Disconnected sessionId: src_id|7f1bbbd7-28ac0c3a-6a46d611-3dbd3798_0
2025-09-30T14:54:30.393161Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:30.393333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1546 sessionId: src_id|7f1bbbd7-28ac0c3a-6a46d611-3dbd3798_0 is DEAD
2025-09-30T14:54:30.393488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f1bbbd7-28ac0c3a-6a46d611-3dbd3798_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:30.393495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f1bbbd7-28ac0c3a-6a46d611-3dbd3798_0] Write session will restart in 0.005043s
2025-09-30T14:54:30.393518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f1bbbd7-28ac0c3a-6a46d611-3dbd3798_0] Write session: Do CDS request
2025-09-30T14:54:30.393524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f1bbbd7-28ac0c3a-6a46d611-3dbd3798_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:30.399798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f1bbbd7-28ac0c3a-6a46d611-3dbd3798_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:30.399924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:30.399941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1547
2025-09-30T14:54:30.400154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1547 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:30.400235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1547 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:30.400247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1547 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:30.400253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:30.400797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1547 sessionId:  describe result for acl check
2025-09-30T14:54:30.400834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:30.400836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:30.400838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:30.400843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895748349006989:9429] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:30.401413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895748349006989:9429] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:30.404088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895748349006989:9429] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:30.405328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:30.407859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:30.407990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895748349006989:9429] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:30.408005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895748349006989:9429] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:30.408009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895748349006989:9429] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:30.408018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1547 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:30.408108Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:30.408122Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:30.408134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:30.408202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:30.408246Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895748259254553:9182]
2025-09-30T14:54:30.408856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:30.409158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:30.409204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:30.409508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:30.409579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:30.409587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:30.409588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:30.409589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:30.409590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:30.409591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:30.409592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:30.409593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:30.409594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:30.409595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:30.409596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.409597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.409599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.409600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:30.409601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:30.409607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:30.409618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:30.409622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:30.409626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:30.409630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:30.409633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:30.409637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:30.409640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:30.409644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:30.409647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:30.409651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.409654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.409658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.409661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:30.409665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:30.409673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:30.409680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:30.409686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:30.409691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:30.409695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:30.409700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:30.409705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:30.409710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:30.409714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:30.409725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:30.409729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:30.409734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:30.409743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:30.409748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:30.409757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:30.409762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:30.409767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:30.409772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:30.409781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:30.409786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:30.409791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.409800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.409804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.409810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.409831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.409836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.409840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:30.409845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:30.409849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:30.409855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:30.409894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:30.415620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:30.416644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:30.416662Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:30.416665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:30.416670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:30.416679Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1546 [2:7555895748259254553:9182]
2025-09-30T14:54:30.416690Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:30.416704Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:30.416707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:30.416709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:30.416711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:30.416722Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:30.416728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:30.416735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:30.416794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.416801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.416802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.416804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:30.416807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:30.416869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:30.416877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.416891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.416908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.416922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:30.416936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895748349007103:9429], now have 1 active actors on pipe
2025-09-30T14:54:30.416942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895748349006974:2454], now have 1 active actors on pipe
2025-09-30T14:54:30.416947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895748259254548:9182]
2025-09-30T14:54:30.416948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895748259254548:9182]
2025-09-30T14:54:30.416950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895748259254548:9182]
2025-09-30T14:54:30.416961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:30.416971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:30.416973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:30.416983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:30.416983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:30.416984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:30.416986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:30.417017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895748259254548:9182]
2025-09-30T14:54:30.417031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:30.417064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:30.417044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1546
2025-09-30T14:54:30.417051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1546
2025-09-30T14:54:30.417176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:30.417186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:30.417213Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c7ec65ab-a0a85e48-d27a1348-58d9745b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:30.417223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:30.417228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:30.417230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:30.417241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:30.417255Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:30.417267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:30.417433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:30.417451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:30.417468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:30.417568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1547 partition: 0 MaxSeqNo: 42 sessionId: src_id|c7ec65ab-a0a85e48-d27a1348-58d9745b_0
2025-09-30T14:54:30.417961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f1bbbd7-28ac0c3a-6a46d611-3dbd3798_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c7ec65ab-a0a85e48-d27a1348-58d9745b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:30.421107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ec65ab-a0a85e48-d27a1348-58d9745b_0] Write session: try to update token
2025-09-30T14:54:30.421126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ec65ab-a0a85e48-d27a1348-58d9745b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:30.430168Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:30.430189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:30.430192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:30.430193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:30.430204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895748259254548:9182]
2025-09-30T14:54:30.430209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895748259254548:9182]
2025-09-30T14:54:30.430212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895748259254548:9182]
2025-09-30T14:54:30.430255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:30.430265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.430269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:30.430269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:30.430277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:30.430300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:30.430416Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:30.437403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1547 sessionId: src_id|c7ec65ab-a0a85e48-d27a1348-58d9745b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:30.450500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:30.493384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895748349007127:9180]
2025-09-30T14:54:30.493691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1546, pipe: [1:7555895748349007127:9180]
2025-09-30T14:54:30.539591Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:30.539965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:30.539982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:30.539998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895748349007127:9180], now have 1 active actors on pipe
2025-09-30T14:54:30.540224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:30.540265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:30.540264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895748349007127:9180]
2025-09-30T14:54:30.540267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:30.540328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1547 reason: error at write: Disconnected sessionId: src_id|c7ec65ab-a0a85e48-d27a1348-58d9745b_0
2025-09-30T14:54:30.540505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1547 sessionId: src_id|c7ec65ab-a0a85e48-d27a1348-58d9745b_0 is DEAD
2025-09-30T14:54:30.540653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ec65ab-a0a85e48-d27a1348-58d9745b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:30.540660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ec65ab-a0a85e48-d27a1348-58d9745b_0] Write session will restart in 0.009578s
2025-09-30T14:54:30.540677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ec65ab-a0a85e48-d27a1348-58d9745b_0] Write session: Do CDS request
2025-09-30T14:54:30.540681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ec65ab-a0a85e48-d27a1348-58d9745b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:30.540819Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:30.549925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:30.550610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:30.550789Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:30.550799Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:30.550809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:30.550852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:30.550890Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895748259254695:9185]
2025-09-30T14:54:30.551443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:30.551771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:30.551799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ec65ab-a0a85e48-d27a1348-58d9745b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:30.551815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:30.551835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:30.551849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1548
2025-09-30T14:54:30.552029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1548 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:30.552054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1548 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:30.552061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1548 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:30.552066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:30.552083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:30.552130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:30.552138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:30.552138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:30.552139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:30.552140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:30.552141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:30.552142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:30.552143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:30.552144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:30.552145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:30.552146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.552147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.552147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.552148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:30.552149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:30.552153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:30.552161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:30.552164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:30.552166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:30.552169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:30.552171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:30.552174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:30.552177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:30.552179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:30.552182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:30.552185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.552187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.552190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.552193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:30.552195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:30.552201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:30.552206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:30.552211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:30.552215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:30.552221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:30.552225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:30.552229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:30.552232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:30.552236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:30.552239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:30.552243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:30.552247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:30.552250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:30.552253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:30.552256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:30.552260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:30.552262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:30.552266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:30.552269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:30.552273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:30.552276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.552279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.552282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.552285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.552288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.552292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.552295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:30.552299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:30.552301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:30.552305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:30.552329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:30.552468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1548 sessionId:  describe result for acl check
2025-09-30T14:54:30.552508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:30.552515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:30.552517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:30.552523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895748349007305:9434] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:30.552942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895748349007305:9434] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:30.554980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895748349007305:9434] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:30.557689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895748349007305:9434] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:30.557726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895748349007305:9434] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:30.557730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895748349007305:9434] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:30.557738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1548 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:30.557935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:30.559087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:30.559104Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:30.559106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:30.559109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:30.559114Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1547 [2:7555895748259254695:9185]
2025-09-30T14:54:30.559128Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:30.559144Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:30.559146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:30.559149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:30.559151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:30.559167Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:30.559173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:30.559181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:30.559238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.559270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.559271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.559274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:30.559276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:30.559346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:30.559357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.559370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.559384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.559397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:30.559421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895748349007341:9434], now have 1 active actors on pipe
2025-09-30T14:54:30.559433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895748349007130:2454], now have 1 active actors on pipe
2025-09-30T14:54:30.559439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895748259254690:9185]
2025-09-30T14:54:30.559441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895748259254690:9185]
2025-09-30T14:54:30.559443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895748259254690:9185]
2025-09-30T14:54:30.559461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:30.559474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:30.559484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:30.559486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:30.559502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1547
2025-09-30T14:54:30.559502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1547
2025-09-30T14:54:30.559516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895748259254690:9185]
2025-09-30T14:54:30.559518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:30.559522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:30.559524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:30.559525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:30.559532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:30.559600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:30.559611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:30.559637Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|76258514-463726a5-148e11d0-3c35be23_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:30.559648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:30.559652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:30.559654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:30.559664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:30.559674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:30.559704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:30.559882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:30.559889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:30.559906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:30.560019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1548 partition: 0 MaxSeqNo: 42 sessionId: src_id|76258514-463726a5-148e11d0-3c35be23_0
2025-09-30T14:54:30.560385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ec65ab-a0a85e48-d27a1348-58d9745b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|76258514-463726a5-148e11d0-3c35be23_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:30.563357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76258514-463726a5-148e11d0-3c35be23_0] Write session: try to update token
2025-09-30T14:54:30.563374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76258514-463726a5-148e11d0-3c35be23_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:30.574055Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:30.574082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:30.574095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895748259254690:9185]
2025-09-30T14:54:30.574156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:30.574164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:30.574366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:30.574544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:30.574714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:30.574892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:30.575143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:30.575195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:30.578508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1548 sessionId: src_id|76258514-463726a5-148e11d0-3c35be23_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:30.581745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:30.582081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:30.582107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:30.583354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:30.583390Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:30.583393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:30.583398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:30.583400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:30.583407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895748259254690:9185]
2025-09-30T14:54:30.583409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895748259254690:9185]
2025-09-30T14:54:30.583412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895748259254690:9185]
2025-09-30T14:54:30.583437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:30.583439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:30.583445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.583446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:30.583451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:30.583455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:30.583510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:30.583588Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:30.640336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895748349007351:9180]
2025-09-30T14:54:30.640602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1547, pipe: [1:7555895748349007351:9180]
2025-09-30T14:54:30.693642Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:30.701021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:30.701059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:30.701229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:30.701299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:30.701365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:30.701431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:30.701483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:30.701493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:30.701566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:30.701629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:30.701698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:30.701794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:30.701856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:30.701866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:30.701941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:30.702005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:30.702076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:30.702142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:30.702190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:30.702198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:30.702277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:30.702349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:30.702410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:30.702473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:30.702514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:30.702520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:30.702594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:30.702664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:30.702732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:30.702800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:30.702849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:30.702857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:30.702936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:30.703006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:30.703072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:30.703145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:30.703194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:30.703200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:30.703295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:30.703377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:30.703449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:30.703515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:30.703630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:30.703639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:30.703710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:30.703774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:30.703839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:30.703906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:30.703952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:30.703959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:30.704027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:30.704091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:30.704163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:30.704241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:30.704289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:30.704297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:30.704371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:30.704436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:30.704503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:30.704575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:30.704624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:30.704633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:30.704701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895748349007351:9180], now have 1 active actors on pipe
2025-09-30T14:54:30.705016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:30.705030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895748349007351:9180]
2025-09-30T14:54:30.705031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:30.705066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1548 reason: error at write: Disconnected sessionId: src_id|76258514-463726a5-148e11d0-3c35be23_0
2025-09-30T14:54:30.705072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:30.705263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1548 sessionId: src_id|76258514-463726a5-148e11d0-3c35be23_0 is DEAD
2025-09-30T14:54:30.705419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76258514-463726a5-148e11d0-3c35be23_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:30.705427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76258514-463726a5-148e11d0-3c35be23_0] Write session will restart in 0.007703s
2025-09-30T14:54:30.705453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76258514-463726a5-148e11d0-3c35be23_0] Write session: Do CDS request
2025-09-30T14:54:30.705459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76258514-463726a5-148e11d0-3c35be23_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:30.705902Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:30.714793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76258514-463726a5-148e11d0-3c35be23_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:30.714918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:30.714931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1549
2025-09-30T14:54:30.715081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1549 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:30.715107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1549 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:30.715112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1549 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:30.715115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:30.715550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1549 sessionId:  describe result for acl check
2025-09-30T14:54:30.715589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:30.715596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:30.715598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:30.715603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895748349007519:9439] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:30.716069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895748349007519:9439] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:30.717540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:30.718179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:30.718297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895748349007519:9439] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:30.718342Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:30.718352Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:30.718361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:30.718407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:30.718442Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895748259254828:9187]
2025-09-30T14:54:30.719328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:30.719661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:30.719720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:30.720108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:30.720166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:30.720173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:30.720174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:30.720176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:30.720177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:30.720178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:30.720179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:30.720180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:30.720181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:30.720183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:30.720184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.720186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.720187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.720188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:30.720189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:30.720195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:30.720205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:30.720210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:30.720214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:30.720218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:30.720223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:30.720227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:30.720231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:30.720235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:30.720239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:30.720243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.720247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.720251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.720255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:30.720259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:30.720266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:30.720274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:30.720280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:30.720285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:30.720290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:30.720296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:30.720300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:30.720306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:30.720311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:30.720316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:30.720320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:30.720326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:30.720331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:30.720338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:30.720345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:30.720350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:30.720357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:30.720362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:30.720371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:30.720376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:30.720381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.720392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.720397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.720402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.720407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.720412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.720418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:30.720424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:30.720428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:30.720431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:30.720457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:30.723272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895748349007519:9439] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:30.723289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895748349007519:9439] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:30.723293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895748349007519:9439] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:30.723302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1549 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:30.726014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:30.727162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:30.727180Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:30.727183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:30.727187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:30.727194Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1548 [2:7555895748259254828:9187]
2025-09-30T14:54:30.727212Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:30.727228Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:30.727236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:30.727240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:30.727266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:30.727283Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:30.727296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:30.727305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:30.727373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.727381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.727383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.727387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:30.727390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:30.727460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:30.727468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.727480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.727495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.727517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:30.727540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895748349007352:2454], now have 1 active actors on pipe
2025-09-30T14:54:30.727548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895748349007562:9439], now have 1 active actors on pipe
2025-09-30T14:54:30.727555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895748259254823:9187]
2025-09-30T14:54:30.727557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895748259254823:9187]
2025-09-30T14:54:30.727559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895748259254823:9187]
2025-09-30T14:54:30.727573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:30.727591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:30.727602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:30.727607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:30.727609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:30.727610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:30.727614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:30.727607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1548
2025-09-30T14:54:30.727651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895748259254823:9187]
2025-09-30T14:54:30.727631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1548
2025-09-30T14:54:30.727658Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:30.727661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:30.727690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:30.727700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:30.727733Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cec5da07-caf5e019-ade4d16-afa11044_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:30.727744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:30.727748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:30.727750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:30.727761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:30.727770Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:30.727787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:30.727948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:30.727955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:30.727968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:30.728056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1549 partition: 0 MaxSeqNo: 42 sessionId: src_id|cec5da07-caf5e019-ade4d16-afa11044_0
2025-09-30T14:54:30.728406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76258514-463726a5-148e11d0-3c35be23_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cec5da07-caf5e019-ade4d16-afa11044_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:30.731374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cec5da07-caf5e019-ade4d16-afa11044_0] Write session: try to update token
2025-09-30T14:54:30.731393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cec5da07-caf5e019-ade4d16-afa11044_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:30.740192Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:30.740214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:30.740217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:30.740219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:30.740231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895748259254823:9187]
2025-09-30T14:54:30.740236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895748259254823:9187]
2025-09-30T14:54:30.740240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895748259254823:9187]
2025-09-30T14:54:30.740277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:30.740283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.740285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:30.740288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:30.740291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:30.740295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:30.740436Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:30.745694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1549 sessionId: src_id|cec5da07-caf5e019-ade4d16-afa11044_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:30.748488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:30.805210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895748349007570:9180]
2025-09-30T14:54:30.805544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1548, pipe: [1:7555895748349007570:9180]
2025-09-30T14:54:30.857149Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:30.857635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:30.857660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:30.857701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895748349007570:9180], now have 1 active actors on pipe
2025-09-30T14:54:30.858034Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:30.858111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895748349007570:9180]
2025-09-30T14:54:30.858123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:30.858154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:30.858230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1549 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cec5da07-caf5e019-ade4d16-afa11044_0
2025-09-30T14:54:30.858409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1549 sessionId: src_id|cec5da07-caf5e019-ade4d16-afa11044_0 is DEAD
2025-09-30T14:54:30.858545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cec5da07-caf5e019-ade4d16-afa11044_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:30.858555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cec5da07-caf5e019-ade4d16-afa11044_0] Write session will restart in 0.007462s
2025-09-30T14:54:30.858573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cec5da07-caf5e019-ade4d16-afa11044_0] Write session: Do CDS request
2025-09-30T14:54:30.858578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cec5da07-caf5e019-ade4d16-afa11044_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:30.866771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cec5da07-caf5e019-ade4d16-afa11044_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:30.866887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:30.866907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1550
2025-09-30T14:54:30.867035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1550 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:30.867072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1550 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:30.867078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1550 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:30.867082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:30.867599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1550 sessionId:  describe result for acl check
2025-09-30T14:54:30.867637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:30.867644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:30.867646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:30.867652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895748349007674:9443] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:30.868345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895748349007674:9443] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:30.870630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895748349007674:9443] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:30.871292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:30.872053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:30.872295Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:30.872307Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:30.872319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:30.872372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:30.872437Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895748259254963:9190]
2025-09-30T14:54:30.873222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:30.873534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895748349007674:9443] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:30.873550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895748349007674:9443] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:30.873553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895748349007674:9443] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:30.873561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1550 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:30.873581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:30.873660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:30.874074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:30.874136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:30.874143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:30.874144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:30.874146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:30.874147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:30.874148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:30.874150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:30.874151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:30.874153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:30.874154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:30.874155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.874156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.874158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.874159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:30.874160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:30.874166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:30.874178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:30.874182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:30.874187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:30.874191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:30.874195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:30.874199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:30.874203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:30.874207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:30.874212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:30.874216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.874221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.874225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.874229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:30.874233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:30.874241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:30.874250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:30.874255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:30.874261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:30.874274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:30.874280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:30.874299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:30.874309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:30.874314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:30.874323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:30.874328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:30.874333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:30.874342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:30.874347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:30.874354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:30.874364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:30.874369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:30.874379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:30.874384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:30.874394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:30.874399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.874405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.874409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.874415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.874420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.874425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.874430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:30.874437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:30.874441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:30.874447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:30.874496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:30.880317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:30.881195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:30.881212Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:30.881216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:30.881220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:30.881228Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1549 [2:7555895748259254963:9190]
2025-09-30T14:54:30.881246Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:30.881263Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:30.881272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:30.881276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:30.881279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:30.881296Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:30.881304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:30.881317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:30.881380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.881388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.881391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.881394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:30.881397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:30.881491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:30.881500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.881513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:30.881531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:30.881554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:30.881579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895748349007779:9443], now have 1 active actors on pipe
2025-09-30T14:54:30.881596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895748349007571:2454], now have 1 active actors on pipe
2025-09-30T14:54:30.881607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895748259254958:9190]
2025-09-30T14:54:30.881610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895748259254958:9190]
2025-09-30T14:54:30.881613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895748259254958:9190]
2025-09-30T14:54:30.881627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:30.881647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:30.881660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:30.881667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:30.881670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:30.881679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:30.881682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:30.881705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895748259254958:9190]
2025-09-30T14:54:30.881713Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:30.881734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:30.881749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:30.881760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:30.881694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1549
2025-09-30T14:54:30.881793Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2baec5d4-c72601ec-5e6a15a-d7daeda7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:30.881807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:30.881822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:30.881824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:30.881705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1549
2025-09-30T14:54:30.881834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:30.881848Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:30.881867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:30.882050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:30.882058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:30.882072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:30.882184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1550 partition: 0 MaxSeqNo: 42 sessionId: src_id|2baec5d4-c72601ec-5e6a15a-d7daeda7_0
2025-09-30T14:54:30.882606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cec5da07-caf5e019-ade4d16-afa11044_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2baec5d4-c72601ec-5e6a15a-d7daeda7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:30.885465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2baec5d4-c72601ec-5e6a15a-d7daeda7_0] Write session: try to update token
2025-09-30T14:54:30.885484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2baec5d4-c72601ec-5e6a15a-d7daeda7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:30.894969Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:30.894992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:30.894995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:30.894998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:30.895009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895748259254958:9190]
2025-09-30T14:54:30.895014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895748259254958:9190]
2025-09-30T14:54:30.895018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895748259254958:9190]
2025-09-30T14:54:30.895064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:30.895071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:30.895073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:30.895082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:30.895091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:30.895096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:30.895226Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:30.900448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1550 sessionId: src_id|2baec5d4-c72601ec-5e6a15a-d7daeda7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:30.903744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:30.958253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895748349007792:9180]
2025-09-30T14:54:30.958504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1549, pipe: [1:7555895748349007792:9180]
2025-09-30T14:54:31.005774Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:31.006129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:31.006145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:31.006184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895748349007792:9180], now have 1 active actors on pipe
2025-09-30T14:54:31.006433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895748349007792:9180]
2025-09-30T14:54:31.006437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:31.006442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:31.006465Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:31.006511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1550 reason: error at write: Disconnected sessionId: src_id|2baec5d4-c72601ec-5e6a15a-d7daeda7_0
2025-09-30T14:54:31.006647Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:31.006702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1550 sessionId: src_id|2baec5d4-c72601ec-5e6a15a-d7daeda7_0 is DEAD
2025-09-30T14:54:31.006873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2baec5d4-c72601ec-5e6a15a-d7daeda7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:31.006884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2baec5d4-c72601ec-5e6a15a-d7daeda7_0] Write session will restart in 0.005537s
2025-09-30T14:54:31.006910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2baec5d4-c72601ec-5e6a15a-d7daeda7_0] Write session: Do CDS request
2025-09-30T14:54:31.006919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2baec5d4-c72601ec-5e6a15a-d7daeda7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:31.013747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2baec5d4-c72601ec-5e6a15a-d7daeda7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:31.013800Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:31.013825Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1551
2025-09-30T14:54:31.014068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1551 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:31.014104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1551 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:31.014114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1551 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:31.014119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:31.014619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1551 sessionId:  describe result for acl check
2025-09-30T14:54:31.014655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:31.014663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:31.014665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:31.014671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895752643975252:9447] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:31.015266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895752643975252:9447] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:31.016265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:31.017136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:31.017299Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:31.017310Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:31.017320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:31.017371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:31.017409Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895752554222393:9192]
2025-09-30T14:54:31.017502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895752643975252:9447] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:31.018020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:31.018335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:31.018398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:31.018767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:31.018824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:31.018831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:31.018832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:31.018833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:31.018834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:31.018836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:31.018837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:31.018838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:31.018839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:31.018840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:31.018842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.018843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.018844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.018845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:31.018847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:31.018852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:31.018862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:31.018867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:31.018871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:31.018876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:31.018880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:31.018885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:31.018889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:31.018893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:31.018897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:31.018902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.018906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.018910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.018914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:31.018918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:31.018926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:31.018934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:31.018946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:31.018952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:31.018962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:31.018967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:31.018977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:31.018983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:31.018987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:31.018993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:31.019001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:31.019011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:31.019016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:31.019026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:31.019030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:31.019036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:31.019045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:31.019051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:31.019057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:31.019062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:31.019072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.019077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.019086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.019091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.019100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.019106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.019115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:31.019124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:31.019134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:31.019143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:31.019188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:31.019997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895752643975252:9447] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:31.020014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895752643975252:9447] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:31.020018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895752643975252:9447] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:31.020027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1551 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:31.024700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:31.025808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:31.025839Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:31.025842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:31.025846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:31.025853Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1550 [2:7555895752554222393:9192]
2025-09-30T14:54:31.025873Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:31.025894Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:31.025901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:31.025906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:31.025908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:31.025926Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:31.025937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:31.025944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:31.026005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.026013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.026017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.026020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:31.026023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:31.026091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:31.026098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.026110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.026126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.026146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:31.026172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895752643975091:2454], now have 1 active actors on pipe
2025-09-30T14:54:31.026175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895752643975303:9447], now have 1 active actors on pipe
2025-09-30T14:54:31.026181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895752554222388:9192]
2025-09-30T14:54:31.026183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895752554222388:9192]
2025-09-30T14:54:31.026185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895752554222388:9192]
2025-09-30T14:54:31.026198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:31.026213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:31.026216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:31.026222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:31.026225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:31.026233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:31.026237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:31.026272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895752554222388:9192]
2025-09-30T14:54:31.026248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1550
2025-09-30T14:54:31.026260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1550
2025-09-30T14:54:31.026284Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:31.026287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:31.026305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:31.026309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:31.026355Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4371027f-34e2f79d-9e0ab17a-cde2b6a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:31.026364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:31.026368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:31.026370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:31.026379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:31.026388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:31.026406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:31.026547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:31.026555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:31.026569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:31.026638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1551 partition: 0 MaxSeqNo: 42 sessionId: src_id|4371027f-34e2f79d-9e0ab17a-cde2b6a9_0
2025-09-30T14:54:31.026991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2baec5d4-c72601ec-5e6a15a-d7daeda7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4371027f-34e2f79d-9e0ab17a-cde2b6a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:31.029696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4371027f-34e2f79d-9e0ab17a-cde2b6a9_0] Write session: try to update token
2025-09-30T14:54:31.029720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4371027f-34e2f79d-9e0ab17a-cde2b6a9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:31.038984Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:31.039011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:31.039014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:31.039016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:31.039043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895752554222388:9192]
2025-09-30T14:54:31.039050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895752554222388:9192]
2025-09-30T14:54:31.039055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895752554222388:9192]
2025-09-30T14:54:31.039105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:31.039112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:31.039120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.039123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:31.039124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:31.039127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:31.039311Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:31.043441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1551 sessionId: src_id|4371027f-34e2f79d-9e0ab17a-cde2b6a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:31.045907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:31.106751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895752643975339:9180]
2025-09-30T14:54:31.106987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1550, pipe: [1:7555895752643975339:9180]
2025-09-30T14:54:31.150285Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:31.150649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:31.150664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:31.150705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895752643975339:9180], now have 1 active actors on pipe
2025-09-30T14:54:31.150910Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:31.151009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895752643975339:9180]
2025-09-30T14:54:31.151022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:31.151038Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:31.151109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1551 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4371027f-34e2f79d-9e0ab17a-cde2b6a9_0
2025-09-30T14:54:31.151329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1551 sessionId: src_id|4371027f-34e2f79d-9e0ab17a-cde2b6a9_0 is DEAD
2025-09-30T14:54:31.151463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4371027f-34e2f79d-9e0ab17a-cde2b6a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:31.151476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4371027f-34e2f79d-9e0ab17a-cde2b6a9_0] Write session will restart in 0.008036s
2025-09-30T14:54:31.151501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4371027f-34e2f79d-9e0ab17a-cde2b6a9_0] Write session: Do CDS request
2025-09-30T14:54:31.151507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4371027f-34e2f79d-9e0ab17a-cde2b6a9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:31.160767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4371027f-34e2f79d-9e0ab17a-cde2b6a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:31.160826Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:31.160842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1552
2025-09-30T14:54:31.161008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1552 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:31.161042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1552 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:31.161053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1552 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:31.161057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:31.161509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1552 sessionId:  describe result for acl check
2025-09-30T14:54:31.161547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:31.161554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:31.161556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:31.161563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895752643975513:9459] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:31.161741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:31.162098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895752643975513:9459] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:31.162424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:31.162583Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:31.162592Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:31.162601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:31.162648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:31.162716Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895752554222565:9206]
2025-09-30T14:54:31.163357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:31.163671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:31.163719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895752643975513:9459] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:31.163733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:31.164098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:31.164158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:31.164164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:31.164165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:31.164166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:31.164167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:31.164168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:31.164170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:31.164171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:31.164172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:31.164173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:31.164174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.164176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.164177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.164178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:31.164179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:31.164185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:31.164195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:31.164200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:31.164204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:31.164208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:31.164212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:31.164225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:31.164234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:31.164239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:31.164244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:31.164248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.164252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.164260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.164265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:31.164269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:31.164276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:31.164288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:31.164299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:31.164304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:31.164314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:31.164320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:31.164329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:31.164334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:31.164339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:31.164344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:31.164349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:31.164354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:31.164364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:31.164369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:31.164383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:31.164393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:31.164398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:31.164407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:31.164412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:31.164421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:31.164431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.164440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.164450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.164459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.164468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.164477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.164485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:31.164490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:31.164498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:31.164503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:31.164552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:31.169349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895752643975513:9459] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:31.169365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895752643975513:9459] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:31.169369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895752643975513:9459] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:31.169378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1552 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:31.169687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:31.170752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:31.170770Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:31.170772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:31.170776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:31.170783Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1551 [2:7555895752554222565:9206]
2025-09-30T14:54:31.170797Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:31.170815Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:31.170822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:31.170825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:31.170827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:31.170842Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:31.170849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:31.170855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:31.170916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.170922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.170924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.170927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:31.170930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:31.170992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:31.171001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.171013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.171032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.171054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:31.171079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895752643975556:9459], now have 1 active actors on pipe
2025-09-30T14:54:31.171089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895752643975340:2454], now have 1 active actors on pipe
2025-09-30T14:54:31.171096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895752554222560:9206]
2025-09-30T14:54:31.171104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895752554222560:9206]
2025-09-30T14:54:31.171106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895752554222560:9206]
2025-09-30T14:54:31.171123Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:31.171131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:31.171109Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1551
2025-09-30T14:54:31.171111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1551
2025-09-30T14:54:31.171134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:31.171135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:31.171149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:31.171164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:31.171168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:31.171212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:31.171227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:31.171240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895752554222560:9206]
2025-09-30T14:54:31.171275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:31.171280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:31.171318Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc9f5150-ce8638fb-24be2cab-a57654f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:31.171332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:31.171341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:31.171344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:31.171355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:31.171368Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:31.171398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:31.171550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:31.171559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:31.171573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:31.171655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1552 partition: 0 MaxSeqNo: 42 sessionId: src_id|fc9f5150-ce8638fb-24be2cab-a57654f6_0
2025-09-30T14:54:31.172027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4371027f-34e2f79d-9e0ab17a-cde2b6a9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fc9f5150-ce8638fb-24be2cab-a57654f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:31.174778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9f5150-ce8638fb-24be2cab-a57654f6_0] Write session: try to update token
2025-09-30T14:54:31.174795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9f5150-ce8638fb-24be2cab-a57654f6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:31.183325Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:31.183345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:31.183348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:31.183350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:31.183359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895752554222560:9206]
2025-09-30T14:54:31.183363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895752554222560:9206]
2025-09-30T14:54:31.183367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895752554222560:9206]
2025-09-30T14:54:31.183403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:31.183411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:31.183414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.183417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:31.183420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:31.183422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:31.183553Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:31.189104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1552 sessionId: src_id|fc9f5150-ce8638fb-24be2cab-a57654f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:31.191846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:31.251155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895752643975563:9180]
2025-09-30T14:54:31.251490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1551, pipe: [1:7555895752643975563:9180]
2025-09-30T14:54:31.294350Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:31.294744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:31.294760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:31.294799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895752643975563:9180], now have 1 active actors on pipe
2025-09-30T14:54:31.295020Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:31.295039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:31.295056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:31.295131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1552 reason: error at write: Disconnected sessionId: src_id|fc9f5150-ce8638fb-24be2cab-a57654f6_0
2025-09-30T14:54:31.295219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:31.295293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895752643975563:9180]
2025-09-30T14:54:31.295354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1552 sessionId: src_id|fc9f5150-ce8638fb-24be2cab-a57654f6_0 is DEAD
2025-09-30T14:54:31.295488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9f5150-ce8638fb-24be2cab-a57654f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:31.295497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9f5150-ce8638fb-24be2cab-a57654f6_0] Write session will restart in 0.005878s
2025-09-30T14:54:31.295521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9f5150-ce8638fb-24be2cab-a57654f6_0] Write session: Do CDS request
2025-09-30T14:54:31.295527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9f5150-ce8638fb-24be2cab-a57654f6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:31.303694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9f5150-ce8638fb-24be2cab-a57654f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:31.303999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:31.304017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1553
2025-09-30T14:54:31.304184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1553 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:31.304226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1553 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:31.304235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1553 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:31.304240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:31.304751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1553 sessionId:  describe result for acl check
2025-09-30T14:54:31.304787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:31.304789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:31.304791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:31.304797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895752643975696:9463] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:31.305409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895752643975696:9463] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:31.307159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895752643975696:9463] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:31.307436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:31.308095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:31.308270Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:31.308279Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:31.308289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:31.308342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:31.308383Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895752554222705:9209]
2025-09-30T14:54:31.309062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:31.309366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:31.309448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:31.309653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895752643975696:9463] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:31.309667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895752643975696:9463] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:31.309670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895752643975696:9463] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:31.309679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1553 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:31.309822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:31.309890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:31.309897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:31.309898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:31.309899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:31.309901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:31.309902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:31.309903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:31.309905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:31.309906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:31.309908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:31.309909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.309910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.309912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.309913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:31.309914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:31.309921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:31.309932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:31.309937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:31.309943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:31.309947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:31.309952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:31.309957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:31.309961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:31.309965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:31.309970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:31.309975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.309979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.309983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.309988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:31.309993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:31.310000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:31.310010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:31.310025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:31.310031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:31.310035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:31.310041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:31.310046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:31.310052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:31.310062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:31.310068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:31.310078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:31.310084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:31.310089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:31.310095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:31.310100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:31.310106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:31.310116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:31.310123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:31.310129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:31.310139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:31.310144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.310154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.310159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.310169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.310174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.310184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.310189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:31.310195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:31.310203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:31.310209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:31.310257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:31.315920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:31.317067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:31.317086Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:31.317089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:31.317093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:31.317100Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1552 [2:7555895752554222705:9209]
2025-09-30T14:54:31.317120Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:31.317142Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:31.317150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:31.317153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:31.317155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:31.317172Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:31.317179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:31.317186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:31.317245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.317253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.317255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.317259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:31.317262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:31.317332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:31.317340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.317356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.317374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.317397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:31.317419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895752554222700:9209]
2025-09-30T14:54:31.317426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895752554222700:9209]
2025-09-30T14:54:31.317429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895752554222700:9209]
2025-09-30T14:54:31.317444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:31.317462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895752643975777:9463], now have 1 active actors on pipe
2025-09-30T14:54:31.317471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895752643975565:2454], now have 1 active actors on pipe
2025-09-30T14:54:31.317470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:31.317476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:31.317479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:31.317479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:31.317495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:31.317502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:31.317512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1552
2025-09-30T14:54:31.317539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895752554222700:9209]
2025-09-30T14:54:31.317517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1552
2025-09-30T14:54:31.317551Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:31.317565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:31.317585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:31.317591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:31.317624Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d7e224b-4e9db8e0-a5165cbb-97ae9b77_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:31.317640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:31.317644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:31.317646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:31.317657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:31.317672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:31.317692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:31.317841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:31.317850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:31.317863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:31.317946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1553 partition: 0 MaxSeqNo: 42 sessionId: src_id|7d7e224b-4e9db8e0-a5165cbb-97ae9b77_0
2025-09-30T14:54:31.318323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9f5150-ce8638fb-24be2cab-a57654f6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7d7e224b-4e9db8e0-a5165cbb-97ae9b77_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:31.321307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d7e224b-4e9db8e0-a5165cbb-97ae9b77_0] Write session: try to update token
2025-09-30T14:54:31.321328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d7e224b-4e9db8e0-a5165cbb-97ae9b77_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:31.330064Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:31.330085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:31.330089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:31.330091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:31.330102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895752554222700:9209]
2025-09-30T14:54:31.330107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895752554222700:9209]
2025-09-30T14:54:31.330112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895752554222700:9209]
2025-09-30T14:54:31.330159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:31.330172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.330171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:31.330178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:31.330180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:31.330183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:31.330330Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:31.336984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1553 sessionId: src_id|7d7e224b-4e9db8e0-a5165cbb-97ae9b77_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:31.339821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:31.395564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895752643975786:9180]
2025-09-30T14:54:31.395887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1552, pipe: [1:7555895752643975786:9180]
2025-09-30T14:54:31.451117Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:31.451599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:31.451635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:31.451665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895752643975786:9180], now have 1 active actors on pipe
2025-09-30T14:54:31.451930Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:31.451929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895752643975786:9180]
2025-09-30T14:54:31.451955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:31.451968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:31.451971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:31.452043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1553 reason: error at write: Disconnected sessionId: src_id|7d7e224b-4e9db8e0-a5165cbb-97ae9b77_0
2025-09-30T14:54:31.452226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1553 sessionId: src_id|7d7e224b-4e9db8e0-a5165cbb-97ae9b77_0 is DEAD
2025-09-30T14:54:31.452409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d7e224b-4e9db8e0-a5165cbb-97ae9b77_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:31.452420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d7e224b-4e9db8e0-a5165cbb-97ae9b77_0] Write session will restart in 0.008772s
2025-09-30T14:54:31.452445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d7e224b-4e9db8e0-a5165cbb-97ae9b77_0] Write session: Do CDS request
2025-09-30T14:54:31.452453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d7e224b-4e9db8e0-a5165cbb-97ae9b77_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:31.462741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d7e224b-4e9db8e0-a5165cbb-97ae9b77_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:31.462969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:31.462993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1554
2025-09-30T14:54:31.463133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1554 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:31.463168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1554 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:31.463173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1554 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:31.463176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:31.463630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1554 sessionId:  describe result for acl check
2025-09-30T14:54:31.463669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:31.463676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:31.463679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:31.463685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895752643975963:9467] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:31.464237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895752643975963:9467] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:31.464409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:31.465194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:31.465383Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:31.465395Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:31.465408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:31.465463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:31.465507Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895752554222855:9212]
2025-09-30T14:54:31.466152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:31.466438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:31.466426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895752643975963:9467] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:31.466505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:31.466908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:31.466984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:31.466991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:31.466992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:31.466993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:31.466995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:31.466996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:31.466998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:31.466999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:31.467001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:31.467002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:31.467003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.467005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.467006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.467007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:31.467008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:31.467014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:31.467025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:31.467029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:31.467034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:31.467038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:31.467042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:31.467046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:31.467050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:31.467053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:31.467057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:31.467061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.467065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.467069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.467072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:31.467076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:31.467083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:31.467091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:31.467096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:31.467101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:31.467106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:31.467118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:31.467122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:31.467128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:31.467136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:31.467141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:31.467150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:31.467168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:31.467178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:31.467183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:31.467188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:31.467193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:31.467200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:31.467206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:31.467212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:31.467220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:31.467224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.467234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.467238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.467256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.467261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.467268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.467273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:31.467279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:31.467283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:31.467291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:31.467336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:31.472527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895752643975963:9467] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:31.472549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895752643975963:9467] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:31.472552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895752643975963:9467] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:31.472561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1554 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:31.472864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:31.473879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:31.473894Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:31.473896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:31.473899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:31.473905Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1553 [2:7555895752554222855:9212]
2025-09-30T14:54:31.473919Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:31.473937Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:31.473939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:31.473941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:31.473942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:31.473955Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:31.473960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:31.473966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:31.474040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.474048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.474051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.474054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:31.474056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:31.474125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:31.474132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.474145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.474163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.474184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:31.474208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895752643975788:2454], now have 1 active actors on pipe
2025-09-30T14:54:31.474217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895752643976003:9467], now have 1 active actors on pipe
2025-09-30T14:54:31.474223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895752554222850:9212]
2025-09-30T14:54:31.474226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895752554222850:9212]
2025-09-30T14:54:31.474228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895752554222850:9212]
2025-09-30T14:54:31.474241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:31.474258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:31.474278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:31.474276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1553
2025-09-30T14:54:31.474280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:31.474289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1553
2025-09-30T14:54:31.474283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:31.474292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:31.474294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:31.474319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895752554222850:9212]
2025-09-30T14:54:31.474322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:31.474324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:31.474359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:31.474363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:31.474390Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|441f74ba-d71e3849-1ea2fe1f-5426389a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:31.474403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:31.474411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:31.474414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:31.474423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:31.474435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:31.474451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:31.474579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:31.474592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:31.474606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:31.474721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1554 partition: 0 MaxSeqNo: 42 sessionId: src_id|441f74ba-d71e3849-1ea2fe1f-5426389a_0
2025-09-30T14:54:31.475070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d7e224b-4e9db8e0-a5165cbb-97ae9b77_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|441f74ba-d71e3849-1ea2fe1f-5426389a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:31.477884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|441f74ba-d71e3849-1ea2fe1f-5426389a_0] Write session: try to update token
2025-09-30T14:54:31.477903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|441f74ba-d71e3849-1ea2fe1f-5426389a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:31.486895Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:31.486918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:31.486921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:31.486924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:31.486933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895752554222850:9212]
2025-09-30T14:54:31.486938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895752554222850:9212]
2025-09-30T14:54:31.486942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895752554222850:9212]
2025-09-30T14:54:31.486986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:31.486994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.486993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:31.486997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:31.487000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:31.487004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:31.487144Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:31.493172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1554 sessionId: src_id|441f74ba-d71e3849-1ea2fe1f-5426389a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:31.495934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:31.552217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895752643976022:9180]
2025-09-30T14:54:31.552490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1553, pipe: [1:7555895752643976022:9180]
2025-09-30T14:54:31.610783Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:31.611181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:31.611198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:31.611238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895752643976022:9180], now have 1 active actors on pipe
2025-09-30T14:54:31.611913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:31.611971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895752643976022:9180]
2025-09-30T14:54:31.611994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:31.612007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:31.612069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1554 reason: error at write: Disconnected sessionId: src_id|441f74ba-d71e3849-1ea2fe1f-5426389a_0
2025-09-30T14:54:31.612233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1554 sessionId: src_id|441f74ba-d71e3849-1ea2fe1f-5426389a_0 is DEAD
2025-09-30T14:54:31.612035Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:31.613665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|441f74ba-d71e3849-1ea2fe1f-5426389a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:31.613677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|441f74ba-d71e3849-1ea2fe1f-5426389a_0] Write session will restart in 0.009130s
2025-09-30T14:54:31.613701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|441f74ba-d71e3849-1ea2fe1f-5426389a_0] Write session: Do CDS request
2025-09-30T14:54:31.613711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|441f74ba-d71e3849-1ea2fe1f-5426389a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:31.625289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|441f74ba-d71e3849-1ea2fe1f-5426389a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:31.627583Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:31.627602Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1555
2025-09-30T14:54:31.627892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1555 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:31.627933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1555 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:31.627945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1555 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:31.627949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:31.628357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1555 sessionId:  describe result for acl check
2025-09-30T14:54:31.628387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:31.628389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:31.628392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:31.628399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895752643976183:9473] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:31.628981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895752643976183:9473] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:31.634507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:31.636635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:31.636850Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:31.636855Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:31.636867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:31.636930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:31.636966Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895752554222994:9214]
2025-09-30T14:54:31.637692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:31.638939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895752643976183:9473] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:31.639013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:31.639074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:31.639477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:31.639554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:31.639556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:31.639557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:31.639559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:31.639561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:31.639562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:31.639564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:31.639566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:31.639568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:31.639569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:31.639570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.639572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.639574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.639575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:31.639576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:31.639583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:31.639595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:31.639599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:31.639603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:31.639609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:31.639614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:31.639618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:31.639623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:31.639627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:31.639633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:31.639637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.639641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.639646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.639650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:31.639654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:31.639663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:31.639672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:31.639679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:31.639685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:31.639690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:31.639695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:31.639699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:31.639704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:31.639710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:31.639716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:31.639721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:31.639728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:31.639734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:31.639741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:31.639746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:31.639751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:31.639757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:31.639763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:31.639768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:31.639774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:31.639778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.639785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.639792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.639798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.639804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.639809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.639814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:31.639820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:31.639831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:31.639837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:31.639885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:31.646441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895752643976183:9473] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:31.646460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895752643976183:9473] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:31.646464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895752643976183:9473] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:31.646474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1555 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:31.647661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:31.648563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:31.648579Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:31.648582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:31.648586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:31.648593Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1554 [2:7555895752554222994:9214]
2025-09-30T14:54:31.648610Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:31.648628Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:31.648631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:31.648635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:31.648637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:31.648652Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:31.648664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:31.648672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:31.648737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.648746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.648748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.648752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:31.648755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:31.648830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:31.648837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.648850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.648862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.648881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:31.648900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895752643976026:2454], now have 1 active actors on pipe
2025-09-30T14:54:31.648907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895752554222989:9214]
2025-09-30T14:54:31.648910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895752554222989:9214]
2025-09-30T14:54:31.648912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895752554222989:9214]
2025-09-30T14:54:31.648924Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:31.648935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895752643976241:9473], now have 1 active actors on pipe
2025-09-30T14:54:31.648942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:31.648957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:31.648960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:31.648994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895752554222989:9214]
2025-09-30T14:54:31.649001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:31.649032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:31.649034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:31.649037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:31.649043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:31.649275Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1554
2025-09-30T14:54:31.649313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1554
2025-09-30T14:54:31.649754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:31.649767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:31.649791Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6edbce38-93949ee7-cd820ead-b4a381e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:31.649817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:31.649822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:31.649825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:31.649836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:31.649849Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:31.649863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:31.654519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:31.654551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:31.654600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:31.657907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1555 partition: 0 MaxSeqNo: 42 sessionId: src_id|6edbce38-93949ee7-cd820ead-b4a381e0_0
2025-09-30T14:54:31.658352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|441f74ba-d71e3849-1ea2fe1f-5426389a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6edbce38-93949ee7-cd820ead-b4a381e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:31.661262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6edbce38-93949ee7-cd820ead-b4a381e0_0] Write session: try to update token
2025-09-30T14:54:31.661282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6edbce38-93949ee7-cd820ead-b4a381e0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:31.671110Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:31.671138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:31.671142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:31.671145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:31.671157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895752554222989:9214]
2025-09-30T14:54:31.671163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895752554222989:9214]
2025-09-30T14:54:31.671170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895752554222989:9214]
2025-09-30T14:54:31.671222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:31.671231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.671235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:31.671446Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:31.673190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:31.673208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:31.673213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:31.694556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1555 sessionId: src_id|6edbce38-93949ee7-cd820ead-b4a381e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:31.697603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:31.710408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895752643976249:9180]
2025-09-30T14:54:31.710993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1554, pipe: [1:7555895752643976249:9180]
2025-09-30T14:54:31.794912Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:31.796685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895752643976249:9180]
2025-09-30T14:54:31.796726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:31.796831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1555 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6edbce38-93949ee7-cd820ead-b4a381e0_0
2025-09-30T14:54:31.797050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1555 sessionId: src_id|6edbce38-93949ee7-cd820ead-b4a381e0_0 is DEAD
2025-09-30T14:54:31.797322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:31.795379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:31.795398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:31.795442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895752643976249:9180], now have 1 active actors on pipe
2025-09-30T14:54:31.795739Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:31.799730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6edbce38-93949ee7-cd820ead-b4a381e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:31.799740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6edbce38-93949ee7-cd820ead-b4a381e0_0] Write session will restart in 0.009562s
2025-09-30T14:54:31.799766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6edbce38-93949ee7-cd820ead-b4a381e0_0] Write session: Do CDS request
2025-09-30T14:54:31.799772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6edbce38-93949ee7-cd820ead-b4a381e0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:31.810650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6edbce38-93949ee7-cd820ead-b4a381e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:31.810854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:31.810874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1556
2025-09-30T14:54:31.811069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1556 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:31.811106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1556 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:31.811112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1556 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:31.811116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:31.811705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1556 sessionId:  describe result for acl check
2025-09-30T14:54:31.811750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:31.811760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:31.811765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:31.811772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895752643976272:9477] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:31.812378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895752643976272:9477] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:31.815631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895752643976272:9477] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:31.823696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895752643976272:9477] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:31.823720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895752643976272:9477] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:31.823724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895752643976272:9477] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:31.823734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1556 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:31.824288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:31.825507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:31.825716Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:31.825720Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:31.825732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:31.825796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:31.825848Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895752554223137:9217]
2025-09-30T14:54:31.826503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:31.826868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:31.826915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:31.827274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:31.827352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:31.827353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:31.827355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:31.827356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:31.827357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:31.827359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:31.827360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:31.827361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:31.827363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:31.827364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:31.827365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.827366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.827367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.827369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:31.827370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:31.827376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:31.827387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:31.827391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:31.827396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:31.827399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:31.827404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:31.827408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:31.827412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:31.827416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:31.827421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:31.827425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.827429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.827434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.827438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:31.827442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:31.827451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:31.827459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:31.827466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:31.827471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:31.827478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:31.827484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:31.827488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:31.827494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:31.827499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:31.827504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:31.827509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:31.827515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:31.827520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:31.827527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:31.827532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:31.827561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:31.827566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:31.827572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:31.827576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:31.827583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:31.827588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.827595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.827600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.827606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.827613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.827619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.827624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:31.827629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:31.827634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:31.827641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:31.827690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:31.833543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:31.834758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:31.834775Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:31.834778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:31.834781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:31.834789Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1555 [2:7555895752554223137:9217]
2025-09-30T14:54:31.834806Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:31.834821Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:31.834825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:31.834828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:31.834831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:31.834847Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:31.834854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:31.834861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:31.834925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.834934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.834936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.834940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:31.834943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:31.835017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:31.835028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.835041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.835054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.835077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:31.835101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895752643976467:9477], now have 1 active actors on pipe
2025-09-30T14:54:31.835110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895752643976252:2454], now have 1 active actors on pipe
2025-09-30T14:54:31.835117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895752554223131:9217]
2025-09-30T14:54:31.835120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895752554223131:9217]
2025-09-30T14:54:31.835122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895752554223131:9217]
2025-09-30T14:54:31.835137Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:31.835153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:31.835162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:31.835166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:31.835168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:31.835174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:31.835177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:31.835181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1555
2025-09-30T14:54:31.835215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895752554223131:9217]
2025-09-30T14:54:31.835182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1555
2025-09-30T14:54:31.835224Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:31.835227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:31.835267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:31.835277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:31.835326Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97f5797b-a62dbe04-32e467cf-62c27d5b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:31.835340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:31.835345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:31.835347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:31.835357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:31.835367Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:31.835390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:31.835549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:31.835562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:31.835579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:31.835673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1556 partition: 0 MaxSeqNo: 42 sessionId: src_id|97f5797b-a62dbe04-32e467cf-62c27d5b_0
2025-09-30T14:54:31.836041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6edbce38-93949ee7-cd820ead-b4a381e0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|97f5797b-a62dbe04-32e467cf-62c27d5b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:31.838946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97f5797b-a62dbe04-32e467cf-62c27d5b_0] Write session: try to update token
2025-09-30T14:54:31.838967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97f5797b-a62dbe04-32e467cf-62c27d5b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:31.848871Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:31.848894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:31.848899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:31.848901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:31.848914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895752554223131:9217]
2025-09-30T14:54:31.848918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895752554223131:9217]
2025-09-30T14:54:31.848923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895752554223131:9217]
2025-09-30T14:54:31.848967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:31.848974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.848976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:31.849122Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:31.849185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:31.849203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:31.849212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:31.859171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1556 sessionId: src_id|97f5797b-a62dbe04-32e467cf-62c27d5b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:31.862090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:31.896817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895752643976480:9180]
2025-09-30T14:54:31.897123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1555, pipe: [1:7555895752643976480:9180]
2025-09-30T14:54:31.971282Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:31.971670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:31.971685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:31.971704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895752643976480:9180], now have 1 active actors on pipe
2025-09-30T14:54:31.972168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:31.972225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895752643976480:9180]
2025-09-30T14:54:31.972241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:31.972248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:31.972316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1556 reason: error at write: Disconnected sessionId: src_id|97f5797b-a62dbe04-32e467cf-62c27d5b_0
2025-09-30T14:54:31.972503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1556 sessionId: src_id|97f5797b-a62dbe04-32e467cf-62c27d5b_0 is DEAD
2025-09-30T14:54:31.972640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97f5797b-a62dbe04-32e467cf-62c27d5b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:31.972650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97f5797b-a62dbe04-32e467cf-62c27d5b_0] Write session will restart in 0.005652s
2025-09-30T14:54:31.972674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97f5797b-a62dbe04-32e467cf-62c27d5b_0] Write session: Do CDS request
2025-09-30T14:54:31.972680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97f5797b-a62dbe04-32e467cf-62c27d5b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:31.971925Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:31.979722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97f5797b-a62dbe04-32e467cf-62c27d5b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:31.980658Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:31.980673Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1557
2025-09-30T14:54:31.980922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1557 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:31.980985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1557 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:31.980996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1557 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:31.981001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:31.981464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1557 sessionId:  describe result for acl check
2025-09-30T14:54:31.981502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:31.981505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:31.981507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:31.981513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895752643976598:9481] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:31.982098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895752643976598:9481] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:31.985692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895752643976598:9481] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:31.987073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:31.988445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:31.988706Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:31.988721Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:31.988737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:31.988803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:31.988851Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895752554223278:9219]
2025-09-30T14:54:31.988734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895752643976598:9481] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:31.988748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895752643976598:9481] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:31.988751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895752643976598:9481] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:31.988760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1557 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:31.989594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:31.989909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:31.989959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:31.990350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:31.990433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:31.990442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:31.990444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:31.990445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:31.990447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:31.990449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:31.990451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:31.990453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:31.990454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:31.990456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:31.990458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.990459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.990460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.990462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:31.990463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:31.990469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:31.990481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:31.990485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:31.990490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:31.990495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:31.990500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:31.990504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:31.990509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:31.990513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:31.990518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:31.990523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.990528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.990532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.990537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:31.990541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:31.990551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:31.990560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:31.990569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:31.990576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:31.990582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:31.990587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:31.990593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:31.990599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:31.990605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:31.990612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:31.990617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:31.990623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:31.990629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:31.990634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:31.990640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:31.990646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:31.990652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:31.990657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:31.990663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:31.990669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:31.990674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.990681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:31.990687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.990693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:31.990698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.990705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:31.990710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:31.990717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:31.990723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:31.990729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:31.990780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:31.999969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:32.001027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:32.001053Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:32.001058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:32.001067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:32.001077Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1556 [2:7555895752554223278:9219]
2025-09-30T14:54:32.001104Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:32.001136Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:32.001148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:32.001153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:32.001157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:32.001182Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:32.001197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:32.001206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:32.001314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.001325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:32.001334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:32.001341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:32.001345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:32.001444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:32.001455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.001474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:32.001495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:32.001512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:32.001540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895752643976485:2454], now have 1 active actors on pipe
2025-09-30T14:54:32.001553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895752643976695:9481], now have 1 active actors on pipe
2025-09-30T14:54:32.001562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895752554223273:9219]
2025-09-30T14:54:32.001569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895752554223273:9219]
2025-09-30T14:54:32.001571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895752554223273:9219]
2025-09-30T14:54:32.001591Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:32.001616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:32.001620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:32.001626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:32.001631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:32.001637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:32.001641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:32.001692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895752554223273:9219]
2025-09-30T14:54:32.001703Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:32.001738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:32.001693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1556
2025-09-30T14:54:32.001693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1556
2025-09-30T14:54:32.002098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:32.002114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:32.002166Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c7e4039-e7b94df9-27391361-a397ac66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:32.002184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:32.002189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:32.002192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:32.002210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:32.002230Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:32.002256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:32.002644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1557 partition: 0 MaxSeqNo: 42 sessionId: src_id|5c7e4039-e7b94df9-27391361-a397ac66_0
2025-09-30T14:54:32.003309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97f5797b-a62dbe04-32e467cf-62c27d5b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5c7e4039-e7b94df9-27391361-a397ac66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:32.006258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c7e4039-e7b94df9-27391361-a397ac66_0] Write session: try to update token
2025-09-30T14:54:32.006281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c7e4039-e7b94df9-27391361-a397ac66_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:32.002500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:32.002512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:32.002528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:32.018278Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:32.018302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:32.018305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:32.018307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:32.018321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895752554223273:9219]
2025-09-30T14:54:32.018325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895752554223273:9219]
2025-09-30T14:54:32.018328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895752554223273:9219]
2025-09-30T14:54:32.018378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:32.018386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:32.018389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.018391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:32.018394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:32.018402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:32.018566Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:32.027505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1557 sessionId: src_id|5c7e4039-e7b94df9-27391361-a397ac66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:32.030390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:32.072399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895756938944002:9180]
2025-09-30T14:54:32.072730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1556, pipe: [1:7555895756938944002:9180]
2025-09-30T14:54:32.142444Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:32.142989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:32.143012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:32.143055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895756938944002:9180], now have 1 active actors on pipe
2025-09-30T14:54:32.143340Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:32.143442Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:32.143941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c7e4039-e7b94df9-27391361-a397ac66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:32.143951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c7e4039-e7b94df9-27391361-a397ac66_0] Write session will restart in 0.008696s
2025-09-30T14:54:32.143981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c7e4039-e7b94df9-27391361-a397ac66_0] Write session: Do CDS request
2025-09-30T14:54:32.143507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895756938944002:9180]
2025-09-30T14:54:32.143535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:32.143987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c7e4039-e7b94df9-27391361-a397ac66_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:32.143607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1557 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5c7e4039-e7b94df9-27391361-a397ac66_0
2025-09-30T14:54:32.143786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1557 sessionId: src_id|5c7e4039-e7b94df9-27391361-a397ac66_0 is DEAD
2025-09-30T14:54:32.153839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c7e4039-e7b94df9-27391361-a397ac66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:32.153921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:32.153937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1558
2025-09-30T14:54:32.154097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1558 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:32.154131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1558 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:32.154137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1558 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:32.154141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:32.154658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1558 sessionId:  describe result for acl check
2025-09-30T14:54:32.154697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:32.154704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:32.154705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:32.154712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895756938944212:9493] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:32.155304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895756938944212:9493] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:32.156021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:32.157217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:32.157412Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:32.157426Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:32.157447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895756938944212:9493] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:32.157438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:32.157489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:32.157520Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895756849190752:9233]
2025-09-30T14:54:32.158203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:32.158472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:32.158517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:32.158844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:32.158910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:32.158916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:32.158917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:32.158918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:32.158919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:32.158921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:32.158922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:32.158923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:32.158925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:32.158926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:32.158927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.158928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:32.158929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:32.158931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:32.158932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:32.158937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:32.158948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:32.158952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:32.158956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:32.158961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:32.158965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:32.158969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:32.158973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:32.158978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:32.158983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:32.158987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.158992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:32.158996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:32.158999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:32.159004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:32.159012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:32.159020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:32.159026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:32.159032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:32.159036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:32.159042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:32.159047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:32.159052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:32.159057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:32.159062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:32.159066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:32.159072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:32.159077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:32.159082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:32.159087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:32.159092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:32.159096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:32.159102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:32.159107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:32.159112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:32.159117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.159122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.159128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:32.159133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:32.159140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:32.159145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:32.159154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:32.159159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:32.159164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:32.159169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:32.159219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:32.160081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895756938944212:9493] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:32.160095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895756938944212:9493] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:32.160100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895756938944212:9493] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:32.160108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1558 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:32.165955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:32.167281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:32.167301Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:32.167303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:32.167308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:32.167318Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1557 [2:7555895756849190752:9233]
2025-09-30T14:54:32.167334Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:32.167355Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:32.167364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:32.167367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:32.167369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:32.167386Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:32.167398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:32.167409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:32.167479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.167487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:32.167490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:32.167493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:32.167496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:32.167570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:32.167579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.167595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:32.167608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:32.167632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:32.167657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895756938944251:9493], now have 1 active actors on pipe
2025-09-30T14:54:32.167670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895756849190747:9233]
2025-09-30T14:54:32.167676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895756849190747:9233]
2025-09-30T14:54:32.167678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895756849190747:9233]
2025-09-30T14:54:32.167693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:32.167709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895756938944035:2454], now have 1 active actors on pipe
2025-09-30T14:54:32.167717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:32.167717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:32.167721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:32.167723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:32.167732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:32.167735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:32.167775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895756849190747:9233]
2025-09-30T14:54:32.167784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:32.167786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:32.167746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1557
2025-09-30T14:54:32.167751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1557
2025-09-30T14:54:32.167815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:32.167828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:32.167866Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6d3e2d7-f6da7515-bf42edfe-b8f860db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:32.167876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:32.167880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:32.167882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:32.167893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:32.167907Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:32.167934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:32.168315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:32.168326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:32.168343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:32.168422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1558 partition: 0 MaxSeqNo: 42 sessionId: src_id|b6d3e2d7-f6da7515-bf42edfe-b8f860db_0
2025-09-30T14:54:32.168792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c7e4039-e7b94df9-27391361-a397ac66_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b6d3e2d7-f6da7515-bf42edfe-b8f860db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:32.171784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6d3e2d7-f6da7515-bf42edfe-b8f860db_0] Write session: try to update token
2025-09-30T14:54:32.171807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6d3e2d7-f6da7515-bf42edfe-b8f860db_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:32.183058Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:32.183082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:32.183084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:32.183086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:32.183097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895756849190747:9233]
2025-09-30T14:54:32.183106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895756849190747:9233]
2025-09-30T14:54:32.183110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895756849190747:9233]
2025-09-30T14:54:32.183153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:32.183166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:32.183168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.183171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:32.183173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:32.183177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:32.183348Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:32.188105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1558 sessionId: src_id|b6d3e2d7-f6da7515-bf42edfe-b8f860db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:32.190929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:32.243911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895756938944261:9180]
2025-09-30T14:54:32.244219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1557, pipe: [1:7555895756938944261:9180]
2025-09-30T14:54:32.300129Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:32.300500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:32.300518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:32.300554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895756938944261:9180], now have 1 active actors on pipe
2025-09-30T14:54:32.300765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:32.300783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:32.300788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:32.300840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895756938944261:9180]
2025-09-30T14:54:32.300856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1558 reason: error at write: Disconnected sessionId: src_id|b6d3e2d7-f6da7515-bf42edfe-b8f860db_0
2025-09-30T14:54:32.300774Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:32.301047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1558 sessionId: src_id|b6d3e2d7-f6da7515-bf42edfe-b8f860db_0 is DEAD
2025-09-30T14:54:32.301214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6d3e2d7-f6da7515-bf42edfe-b8f860db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:32.301224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6d3e2d7-f6da7515-bf42edfe-b8f860db_0] Write session will restart in 0.007620s
2025-09-30T14:54:32.301249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6d3e2d7-f6da7515-bf42edfe-b8f860db_0] Write session: Do CDS request
2025-09-30T14:54:32.301254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6d3e2d7-f6da7515-bf42edfe-b8f860db_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:32.309830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6d3e2d7-f6da7515-bf42edfe-b8f860db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:32.309960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:32.309978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1559
2025-09-30T14:54:32.310119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1559 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:32.310158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1559 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:32.310169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1559 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:32.310174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:32.310669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1559 sessionId:  describe result for acl check
2025-09-30T14:54:32.310704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:32.310706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:32.310708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:32.310714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895756938944351:9497] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:32.311328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895756938944351:9497] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:32.313572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895756938944351:9497] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:32.316136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:32.316264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895756938944351:9497] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:32.316283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895756938944351:9497] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:32.316287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895756938944351:9497] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:32.316295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1559 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:32.317214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:32.317439Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:32.317454Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:32.317466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:32.317538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:32.317583Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895756849190898:9236]
2025-09-30T14:54:32.318214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:32.318604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:32.318683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:32.319044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:32.319105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:32.319112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:32.319113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:32.319114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:32.319115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:32.319116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:32.319118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:32.319119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:32.319120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:32.319121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:32.319122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.319124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:32.319125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:32.319126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:32.319128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:32.319134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:32.319146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:32.319151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:32.319156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:32.319160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:32.319164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:32.319169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:32.319174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:32.319184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:32.319189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:32.319199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.319203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:32.319212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:32.319221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:32.319225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:32.319237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:32.319262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:32.319270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:32.319281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:32.319287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:32.319297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:32.319302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:32.319312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:32.319322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:32.319329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:32.319333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:32.319339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:32.319345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:32.319351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:32.319360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:32.319366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:32.319371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:32.319381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:32.319391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:32.319401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:32.319411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.319417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.319422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:32.319433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:32.319438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:32.319448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:32.319454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:32.319465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:32.319475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:32.319485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:32.319539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:32.325466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:32.326580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:32.326601Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:32.326604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:32.326608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:32.326615Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1558 [2:7555895756849190898:9236]
2025-09-30T14:54:32.326631Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:32.326648Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:32.326651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:32.326655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:32.326658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:32.326674Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:32.326687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:32.326694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:32.326762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.326771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:32.326774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:32.326777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:32.326779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:32.326847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:32.326856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.326868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:32.326885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:32.326903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:32.326928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895756938944480:9497], now have 1 active actors on pipe
2025-09-30T14:54:32.326936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895756938944263:2454], now have 1 active actors on pipe
2025-09-30T14:54:32.326943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895756849190892:9236]
2025-09-30T14:54:32.326945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895756849190892:9236]
2025-09-30T14:54:32.326948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895756849190892:9236]
2025-09-30T14:54:32.326962Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:32.326977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:32.326979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:32.326989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:32.326991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:32.326994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:32.326997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:32.327035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895756849190892:9236]
2025-09-30T14:54:32.327048Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:32.327038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1558
2025-09-30T14:54:32.327063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:32.327085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:32.327090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:32.327117Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23973bb4-61c0428a-42dca9cf-297ccbe2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:32.327129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:32.327133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:32.327135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:32.327144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:32.327153Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:32.327170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:32.327362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:32.327375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:32.327402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:32.327423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1558
2025-09-30T14:54:32.327498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1559 partition: 0 MaxSeqNo: 42 sessionId: src_id|23973bb4-61c0428a-42dca9cf-297ccbe2_0
2025-09-30T14:54:32.327878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6d3e2d7-f6da7515-bf42edfe-b8f860db_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|23973bb4-61c0428a-42dca9cf-297ccbe2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:32.330869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23973bb4-61c0428a-42dca9cf-297ccbe2_0] Write session: try to update token
2025-09-30T14:54:32.330891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23973bb4-61c0428a-42dca9cf-297ccbe2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:32.340919Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:32.340948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:32.340963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895756849190892:9236]
2025-09-30T14:54:32.341028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:32.341029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:32.341249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:32.341427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:32.341599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:32.341781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:32.342043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:32.342103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:32.346785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1559 sessionId: src_id|23973bb4-61c0428a-42dca9cf-297ccbe2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:32.349560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:32.349842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:32.349877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:32.349931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:32.350042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:32.352477Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:32.352502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:32.352505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:32.352507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:32.352523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895756849190892:9236]
2025-09-30T14:54:32.352532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895756849190892:9236]
2025-09-30T14:54:32.352536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895756849190892:9236]
2025-09-30T14:54:32.352582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:32.352588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:32.352595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.352597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:32.352598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:32.352602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:32.352771Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:32.401109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895756938944491:9180]
2025-09-30T14:54:32.401484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1558, pipe: [1:7555895756938944491:9180]
2025-09-30T14:54:32.469244Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:32.478063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:32.478098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:32.478281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:32.478504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:32.478577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:32.478640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:32.479140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:32.479145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:32.479233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:32.479392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:32.479463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:32.479538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:32.479586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:32.479589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:32.479672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:32.479735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:32.479799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:32.479865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:32.479907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:32.479910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:32.479987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:32.480047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:32.480105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:32.480163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:32.480202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:32.480204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:32.480274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:32.480342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:32.480408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:32.480480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:32.480522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:32.480524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:32.480603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:32.480671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:32.480738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:32.480809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:32.480857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:32.480860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:32.480936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:32.481001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:32.481073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:32.481136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:32.481177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:32.481183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:32.481248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:32.481303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:32.481368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:32.481442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:32.481507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:32.481510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:32.481587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:32.481642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:32.481701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:32.481759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:32.481799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:32.481801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:32.481890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:32.481959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:32.482026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:32.482082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:32.482124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:32.482126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:32.482207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895756938944491:9180], now have 1 active actors on pipe
2025-09-30T14:54:32.483124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895756938944491:9180]
2025-09-30T14:54:32.483175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:32.483178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:32.483208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1559 reason: error at write: Disconnected sessionId: src_id|23973bb4-61c0428a-42dca9cf-297ccbe2_0
2025-09-30T14:54:32.483013Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:32.483437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1559 sessionId: src_id|23973bb4-61c0428a-42dca9cf-297ccbe2_0 is DEAD
2025-09-30T14:54:32.483630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23973bb4-61c0428a-42dca9cf-297ccbe2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:32.483644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23973bb4-61c0428a-42dca9cf-297ccbe2_0] Write session will restart in 0.008468s
2025-09-30T14:54:32.483680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23973bb4-61c0428a-42dca9cf-297ccbe2_0] Write session: Do CDS request
2025-09-30T14:54:32.483686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23973bb4-61c0428a-42dca9cf-297ccbe2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:32.483718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:32.493775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23973bb4-61c0428a-42dca9cf-297ccbe2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:32.493883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:32.493898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1560
2025-09-30T14:54:32.494065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1560 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:32.494107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1560 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:32.494116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1560 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:32.494120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:32.494532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1560 sessionId:  describe result for acl check
2025-09-30T14:54:32.494565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:32.494572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:32.494574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:32.494580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895756938944542:9502] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:32.495137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895756938944542:9502] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:32.500081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895756938944542:9502] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:32.505958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895756938944542:9502] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:32.505976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895756938944542:9502] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:32.505979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895756938944542:9502] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:32.505989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1560 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:32.507618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:32.508974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:32.509196Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:32.509201Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:32.509212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:32.509272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:32.509307Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895756849191054:9239]
2025-09-30T14:54:32.510048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:32.510343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:32.510388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:32.510737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:32.510797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:32.510799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:32.510800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:32.510802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:32.510804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:32.510805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:32.510806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:32.510808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:32.510809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:32.510811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:32.510812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.510813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:32.510815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:32.510816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:32.510817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:32.510823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:32.510850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:32.510855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:32.510859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:32.510862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:32.510866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:32.510870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:32.510873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:32.510877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:32.510880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:32.510884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.510887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:32.510891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:32.510895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:32.510899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:32.510908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:32.510916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:32.510922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:32.510927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:32.510932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:32.510938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:32.510942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:32.510947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:32.510952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:32.510957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:32.510962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:32.510966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:32.510971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:32.510976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:32.510980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:32.510985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:32.510990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:32.510996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:32.511000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:32.511005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:32.511010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.511016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.511022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:32.511027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:32.511032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:32.511038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:32.511043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:32.511047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:32.511052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:32.511056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:32.511104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:32.520378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:32.521574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:32.521581Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:32.521584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:32.521588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:32.521596Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1559 [2:7555895756849191054:9239]
2025-09-30T14:54:32.521614Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:32.521632Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:32.521636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:32.521640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:32.521643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:32.521661Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:32.521668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:32.521676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:32.521745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.521747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:32.521749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:32.521753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:32.521756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:32.521849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:32.521853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.521868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:32.521882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:32.521902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:32.521920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895756849191048:9239]
2025-09-30T14:54:32.521924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895756849191048:9239]
2025-09-30T14:54:32.521926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895756849191048:9239]
2025-09-30T14:54:32.521941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:32.521955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:32.521971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:32.521974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:32.522017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895756849191048:9239]
2025-09-30T14:54:32.522019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:32.522434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:32.522446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:32.522449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:32.522454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:32.522627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895756938944719:9502], now have 1 active actors on pipe
2025-09-30T14:54:32.522635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895756938944496:2454], now have 1 active actors on pipe
2025-09-30T14:54:32.522927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1559
2025-09-30T14:54:32.522974Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1559
2025-09-30T14:54:32.523422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:32.523438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:32.523469Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5c3aa0d-5f1c421d-ed4eb311-5cfd9939_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:32.523479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:32.523484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:32.523487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:32.523499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:32.523513Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:32.523532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:32.526403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:32.526422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:32.526451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:32.526704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1560 partition: 0 MaxSeqNo: 42 sessionId: src_id|a5c3aa0d-5f1c421d-ed4eb311-5cfd9939_0
2025-09-30T14:54:32.531789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23973bb4-61c0428a-42dca9cf-297ccbe2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a5c3aa0d-5f1c421d-ed4eb311-5cfd9939_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:32.534950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5c3aa0d-5f1c421d-ed4eb311-5cfd9939_0] Write session: try to update token
2025-09-30T14:54:32.534973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5c3aa0d-5f1c421d-ed4eb311-5cfd9939_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:32.540363Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:32.540394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:32.540397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:32.540400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:32.540412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895756849191048:9239]
2025-09-30T14:54:32.540419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895756849191048:9239]
2025-09-30T14:54:32.540424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895756849191048:9239]
2025-09-30T14:54:32.540476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:32.540485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.540489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:32.540677Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:32.543438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:32.543447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:32.543452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:32.558781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1560 sessionId: src_id|a5c3aa0d-5f1c421d-ed4eb311-5cfd9939_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:32.561333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:32.583561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895756938944735:9180]
2025-09-30T14:54:32.587793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1559, pipe: [1:7555895756938944735:9180]
2025-09-30T14:54:32.728630Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:32.729259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:32.729272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:32.729327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895756938944735:9180], now have 1 active actors on pipe
2025-09-30T14:54:32.731802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5c3aa0d-5f1c421d-ed4eb311-5cfd9939_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:32.731818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5c3aa0d-5f1c421d-ed4eb311-5cfd9939_0] Write session will restart in 0.009059s
2025-09-30T14:54:32.731860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5c3aa0d-5f1c421d-ed4eb311-5cfd9939_0] Write session: Do CDS request
2025-09-30T14:54:32.731866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5c3aa0d-5f1c421d-ed4eb311-5cfd9939_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:32.731385Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:32.731345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:32.731361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:32.731408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:32.731437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1560 reason: error at write: Disconnected sessionId: src_id|a5c3aa0d-5f1c421d-ed4eb311-5cfd9939_0
2025-09-30T14:54:32.731478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895756938944735:9180]
2025-09-30T14:54:32.731607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1560 sessionId: src_id|a5c3aa0d-5f1c421d-ed4eb311-5cfd9939_0 is DEAD
2025-09-30T14:54:32.741832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5c3aa0d-5f1c421d-ed4eb311-5cfd9939_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:32.743414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:32.743435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1561
2025-09-30T14:54:32.743620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1561 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:32.743651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1561 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:32.743657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1561 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:32.743661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:32.744210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1561 sessionId:  describe result for acl check
2025-09-30T14:54:32.744242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:32.744244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:32.744247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:32.744252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895756938944748:9507] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:32.744826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895756938944748:9507] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:32.748491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895756938944748:9507] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:32.751903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895756938944748:9507] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:32.751919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895756938944748:9507] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:32.751923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895756938944748:9507] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:32.751933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1561 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:32.758734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:32.759663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:32.759830Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:32.759834Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:32.759843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:32.759887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:32.759920Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895756849191202:9242]
2025-09-30T14:54:32.760607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:32.760853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:32.760893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:32.761226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:32.761277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:32.761278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:32.761279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:32.761280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:32.761281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:32.761282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:32.761283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:32.761285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:32.761286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:32.761287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:32.761289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.761290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:32.761291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:32.761292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:32.761293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:32.761299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:32.761309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:32.761313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:32.761317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:32.761321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:32.761325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:32.761328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:32.761332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:32.761336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:32.761342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:32.761347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.761351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:32.761356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:32.761360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:32.761364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:32.761372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:32.761382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:32.761388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:32.761394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:32.761399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:32.761405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:32.761410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:32.761416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:32.761421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:32.761427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:32.761432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:32.761438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:32.761443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:32.761449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:32.761454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:32.761460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:32.761466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:32.761471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:32.761476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:32.761482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:32.761487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.761492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.761497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:32.761503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:32.761508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:32.761514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:32.761519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:32.761525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:32.761530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:32.761535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:32.761580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:32.767293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:32.768365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:32.768385Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:32.768388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:32.768392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:32.768398Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1560 [2:7555895756849191202:9242]
2025-09-30T14:54:32.768415Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:32.768430Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:32.768433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:32.768437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:32.768440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:32.768455Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:32.768468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:32.768490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:32.768557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.768568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:32.768570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:32.768574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:32.768577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:32.768638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:32.768644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.768659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:32.768673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:32.768697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:32.768721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895756938944805:9507], now have 1 active actors on pipe
2025-09-30T14:54:32.768730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895756938944741:2454], now have 1 active actors on pipe
2025-09-30T14:54:32.768736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895756849191197:9242]
2025-09-30T14:54:32.768739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895756849191197:9242]
2025-09-30T14:54:32.768741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895756849191197:9242]
2025-09-30T14:54:32.768754Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:32.768767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:32.768780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:32.768787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:32.768791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:32.768793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:32.768795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:32.768820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895756849191197:9242]
2025-09-30T14:54:32.768828Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:32.768838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:32.768845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1560
2025-09-30T14:54:32.768878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1560
2025-09-30T14:54:32.769010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:32.769021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:32.769048Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2d573d2-f005abf9-bff8b5bd-1bb6b220_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:32.769056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:32.769060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:32.769063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:32.769073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:32.769082Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:32.769096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:32.769243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:32.769250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:32.769263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:32.769369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1561 partition: 0 MaxSeqNo: 42 sessionId: src_id|e2d573d2-f005abf9-bff8b5bd-1bb6b220_0
2025-09-30T14:54:32.769750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5c3aa0d-5f1c421d-ed4eb311-5cfd9939_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e2d573d2-f005abf9-bff8b5bd-1bb6b220_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:32.772789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2d573d2-f005abf9-bff8b5bd-1bb6b220_0] Write session: try to update token
2025-09-30T14:54:32.772813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2d573d2-f005abf9-bff8b5bd-1bb6b220_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:32.793424Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:32.793449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:32.793459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895756849191197:9242]
2025-09-30T14:54:32.793510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:32.793516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:32.793687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:32.793862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:32.794017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:32.794169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:32.794370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:32.794417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:32.800004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1561 sessionId: src_id|e2d573d2-f005abf9-bff8b5bd-1bb6b220_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:32.802718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:32.803308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:32.803332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:32.804491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:32.804526Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:32.804529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:32.804531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:32.804535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:32.804544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895756849191197:9242]
2025-09-30T14:54:32.804549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895756849191197:9242]
2025-09-30T14:54:32.804555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895756849191197:9242]
2025-09-30T14:54:32.804585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:32.804592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:32.804596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.804597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:32.804599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:32.804602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:32.804608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:32.804734Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:32.833833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895756938944969:9180]
2025-09-30T14:54:32.834235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1560, pipe: [1:7555895756938944969:9180]
2025-09-30T14:54:32.929075Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:32.942522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:32.942559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:32.942751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:32.942813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:32.942875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:32.942945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:32.943237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:32.947329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:32.947443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:32.947510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:32.947575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:32.947653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:32.947698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:32.947702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:32.947775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:32.947835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:32.947895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:32.948009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:32.948051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:32.948055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:32.948127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:32.948551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:32.948620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:32.948685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:32.948733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:32.948736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:32.948806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:32.948867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:32.948932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:32.948999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:32.949041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:32.949044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:32.949118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:32.949185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:32.949251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:32.949318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:32.949364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:32.949367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:32.949439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:32.949500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:32.949572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:32.949636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:32.949678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:32.949684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:32.949761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:32.949846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:32.949921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:32.949987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:32.950031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:32.950034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:32.950107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:32.950170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:32.950240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:32.950308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:32.950352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:32.950356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:32.950432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:32.950497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:32.950563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:32.950633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:32.950676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:32.950681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:32.950780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895756938944969:9180], now have 1 active actors on pipe
2025-09-30T14:54:32.951686Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:32.951618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:32.951633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:32.951674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1561 reason: error at write: Disconnected sessionId: src_id|e2d573d2-f005abf9-bff8b5bd-1bb6b220_0
2025-09-30T14:54:32.951858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:32.951866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1561 sessionId: src_id|e2d573d2-f005abf9-bff8b5bd-1bb6b220_0 is DEAD
2025-09-30T14:54:32.951897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895756938944969:9180]
2025-09-30T14:54:32.954125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2d573d2-f005abf9-bff8b5bd-1bb6b220_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:32.954141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2d573d2-f005abf9-bff8b5bd-1bb6b220_0] Write session will restart in 0.006184s
2025-09-30T14:54:32.954168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2d573d2-f005abf9-bff8b5bd-1bb6b220_0] Write session: Do CDS request
2025-09-30T14:54:32.954182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2d573d2-f005abf9-bff8b5bd-1bb6b220_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:32.962034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2d573d2-f005abf9-bff8b5bd-1bb6b220_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:32.962459Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:32.962476Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1562
2025-09-30T14:54:32.962668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1562 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:32.962697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1562 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:32.962702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1562 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:32.962707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:32.963231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1562 sessionId:  describe result for acl check
2025-09-30T14:54:32.963285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:32.963288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:32.963290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:32.963305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895756938944982:9511] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:32.963927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895756938944982:9511] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:32.966732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895756938944982:9511] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:32.972362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895756938944982:9511] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:32.972383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895756938944982:9511] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:32.972387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895756938944982:9511] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:32.972396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1562 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:32.980206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:32.981213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:32.981584Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:32.981595Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:32.981608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:32.981678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:32.981718Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895756849191349:9244]
2025-09-30T14:54:32.982467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:32.982821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:32.982869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:32.983209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:32.983293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:32.983300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:32.983301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:32.983302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:32.983304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:32.983305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:32.983306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:32.983307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:32.983309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:32.983310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:32.983311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.983313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:32.983314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:32.983315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:32.983316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:32.983321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:32.983332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:32.983337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:32.983341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:32.983357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:32.983362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:32.983366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:32.983371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:32.983375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:32.983381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:32.983386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.983390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:32.983394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:32.983398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:32.983407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:32.983416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:32.983430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:32.983439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:32.983444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:32.983454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:32.983459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:32.983468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:32.983474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:32.983479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:32.983489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:32.983493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:32.983504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:32.983513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:32.983518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:32.983527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:32.983533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:32.983542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:32.983548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:32.983557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:32.983563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:32.983572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.983577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.983586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:32.983592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:32.983601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:32.983607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:32.983616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:32.983622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:32.983631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:32.983637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:32.983682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:32.990422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:32.991715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:32.991743Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:32.991747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:32.991752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:32.991760Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1561 [2:7555895756849191349:9244]
2025-09-30T14:54:32.991783Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:32.991806Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:32.991818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:32.991823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:32.991826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:32.991847Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:32.991863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:32.991872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:32.991963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.991976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:32.991979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:32.991987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:32.991991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:32.992087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:32.992097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:32.992116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:32.992132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:32.992151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:32.992176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895756938945019:9511], now have 1 active actors on pipe
2025-09-30T14:54:32.992180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895756938944974:2454], now have 1 active actors on pipe
2025-09-30T14:54:32.992190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895756849191344:9244]
2025-09-30T14:54:32.992198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895756849191344:9244]
2025-09-30T14:54:32.992201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895756849191344:9244]
2025-09-30T14:54:32.992217Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:32.992238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:32.992238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:32.992244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:32.992247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:32.992261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:32.992265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:32.992314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895756849191344:9244]
2025-09-30T14:54:32.992330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:32.992339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:32.992305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1561
2025-09-30T14:54:32.992343Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1561
2025-09-30T14:54:32.992534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:32.992553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:32.992591Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2453a02c-8f7c9c06-cdb15e8a-37b949e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:32.992601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:32.992607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:32.992610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:32.992623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:32.992637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:32.992659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:32.993007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:32.993022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:32.993054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:32.993196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1562 partition: 0 MaxSeqNo: 42 sessionId: src_id|2453a02c-8f7c9c06-cdb15e8a-37b949e9_0
2025-09-30T14:54:32.993626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2d573d2-f005abf9-bff8b5bd-1bb6b220_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2453a02c-8f7c9c06-cdb15e8a-37b949e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:32.996489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2453a02c-8f7c9c06-cdb15e8a-37b949e9_0] Write session: try to update token
2025-09-30T14:54:32.996516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2453a02c-8f7c9c06-cdb15e8a-37b949e9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:33.006856Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:33.006892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:33.006895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:33.006905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:33.006915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895756849191344:9244]
2025-09-30T14:54:33.006920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895756849191344:9244]
2025-09-30T14:54:33.006924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895756849191344:9244]
2025-09-30T14:54:33.006980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:33.006990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:33.006996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.007000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:33.007003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:33.007004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:33.007185Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:33.014556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1562 sessionId: src_id|2453a02c-8f7c9c06-cdb15e8a-37b949e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:33.017501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:33.051312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895761233912497:9180]
2025-09-30T14:54:33.051652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1561, pipe: [1:7555895761233912497:9180]
2025-09-30T14:54:33.129924Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:33.130304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:33.130322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:33.130344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895761233912497:9180], now have 1 active actors on pipe
2025-09-30T14:54:33.130673Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:33.130775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:33.130796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:33.130848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895761233912497:9180]
2025-09-30T14:54:33.130865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1562 reason: error at write: Disconnected sessionId: src_id|2453a02c-8f7c9c06-cdb15e8a-37b949e9_0
2025-09-30T14:54:33.130879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:33.131038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1562 sessionId: src_id|2453a02c-8f7c9c06-cdb15e8a-37b949e9_0 is DEAD
2025-09-30T14:54:33.131213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2453a02c-8f7c9c06-cdb15e8a-37b949e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:33.131224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2453a02c-8f7c9c06-cdb15e8a-37b949e9_0] Write session will restart in 0.009600s
2025-09-30T14:54:33.131266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2453a02c-8f7c9c06-cdb15e8a-37b949e9_0] Write session: Do CDS request
2025-09-30T14:54:33.131274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2453a02c-8f7c9c06-cdb15e8a-37b949e9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:33.141774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2453a02c-8f7c9c06-cdb15e8a-37b949e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:33.142403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:33.142421Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1563
2025-09-30T14:54:33.142517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1563 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:33.142544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1563 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:33.142549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1563 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:33.142553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:33.142962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1563 sessionId:  describe result for acl check
2025-09-30T14:54:33.142990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:33.142992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:33.142994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:33.142999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895761233912624:9524] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:33.143680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895761233912624:9524] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:33.146496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895761233912624:9524] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:33.147798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:33.149150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:33.149412Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:33.149426Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:33.149440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:33.149511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:33.149694Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895761144158804:9246]
2025-09-30T14:54:33.149925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895761233912624:9524] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:33.149944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895761233912624:9524] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:33.149947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895761233912624:9524] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:33.149956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1563 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:33.150359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:33.150700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:33.150757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:33.151144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:33.151206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:33.151212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:33.151213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:33.151214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:33.151215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:33.151217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:33.151219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:33.151220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:33.151221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:33.151223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:33.151225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.151226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:33.151227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:33.151228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:33.151230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:33.151236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:33.151260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:33.151263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:33.151266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:33.151269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:33.151271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:33.151274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:33.151276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:33.151279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:33.151282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:33.151285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.151288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:33.151290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:33.151293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:33.151295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:33.151307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:33.151315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:33.151321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:33.151327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:33.151332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:33.151337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:33.151342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:33.151348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:33.151354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:33.151360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:33.151364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:33.151367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:33.151370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:33.151373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:33.151377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:33.151380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:33.151383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:33.151386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:33.151389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:33.151394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:33.151397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.151400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.151403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:33.151407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:33.151412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:33.151417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:33.151421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:33.151427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:33.151431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:33.151437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:33.151469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:33.157834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:33.159281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:33.159305Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:33.159308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:33.159314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:33.159322Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1562 [2:7555895761144158804:9246]
2025-09-30T14:54:33.159353Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:33.159810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1562
2025-09-30T14:54:33.159861Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1562
2025-09-30T14:54:33.159372Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:33.159382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:33.159385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:33.159388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:33.159414Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:33.159422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:33.159431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:33.159511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.159513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:33.159516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:33.159519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:33.159522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:33.159609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:33.159613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.159632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:33.159644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:33.159663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:33.159688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895761233912744:9524], now have 1 active actors on pipe
2025-09-30T14:54:33.159692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895761233912511:2454], now have 1 active actors on pipe
2025-09-30T14:54:33.159699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895761144158799:9246]
2025-09-30T14:54:33.159702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895761144158799:9246]
2025-09-30T14:54:33.159704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895761144158799:9246]
2025-09-30T14:54:33.159721Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:33.159739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:33.159756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:33.159761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:33.159806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895761144158799:9246]
2025-09-30T14:54:33.159809Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:33.159866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:33.159870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:33.159872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:33.159880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:33.160792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:33.160817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:33.160869Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d32cda34-68bfa1e9-ae1e0986-9c522197_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:33.160881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:33.160886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:33.160890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:33.160904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:33.160932Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:33.160954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:33.161781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:33.161799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:33.161843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:33.162047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1563 partition: 0 MaxSeqNo: 42 sessionId: src_id|d32cda34-68bfa1e9-ae1e0986-9c522197_0
2025-09-30T14:54:33.162526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2453a02c-8f7c9c06-cdb15e8a-37b949e9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d32cda34-68bfa1e9-ae1e0986-9c522197_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:33.165463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d32cda34-68bfa1e9-ae1e0986-9c522197_0] Write session: try to update token
2025-09-30T14:54:33.165485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d32cda34-68bfa1e9-ae1e0986-9c522197_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:33.182251Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:33.182275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:33.182278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:33.182279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:33.182290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895761144158799:9246]
2025-09-30T14:54:33.182295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895761144158799:9246]
2025-09-30T14:54:33.182298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895761144158799:9246]
2025-09-30T14:54:33.182344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:33.182356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.182357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:33.182359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:33.182364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:33.182368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:33.182548Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:33.184495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1563 sessionId: src_id|d32cda34-68bfa1e9-ae1e0986-9c522197_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:33.187929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:33.231056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895761233912768:9180]
2025-09-30T14:54:33.231488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1562, pipe: [1:7555895761233912768:9180]
2025-09-30T14:54:33.302977Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:33.303499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:33.303518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:33.303568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895761233912768:9180], now have 1 active actors on pipe
2025-09-30T14:54:33.304150Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:33.307440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:33.307454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895761233912768:9180]
2025-09-30T14:54:33.307503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:33.307593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1563 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d32cda34-68bfa1e9-ae1e0986-9c522197_0
2025-09-30T14:54:33.307802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1563 sessionId: src_id|d32cda34-68bfa1e9-ae1e0986-9c522197_0 is DEAD
2025-09-30T14:54:33.308207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d32cda34-68bfa1e9-ae1e0986-9c522197_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:33.308221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d32cda34-68bfa1e9-ae1e0986-9c522197_0] Write session will restart in 0.008557s
2025-09-30T14:54:33.308246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d32cda34-68bfa1e9-ae1e0986-9c522197_0] Write session: Do CDS request
2025-09-30T14:54:33.308253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d32cda34-68bfa1e9-ae1e0986-9c522197_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:33.317891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d32cda34-68bfa1e9-ae1e0986-9c522197_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:33.317994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:33.318011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1564
2025-09-30T14:54:33.318154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1564 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:33.318194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1564 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:33.318199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1564 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:33.318204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:33.318671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1564 sessionId:  describe result for acl check
2025-09-30T14:54:33.318700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:33.318702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:33.318704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:33.318710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895761233912873:9529] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:33.319320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895761233912873:9529] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:33.325478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:33.327102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:33.323179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895761233912873:9529] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:33.325972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895761233912873:9529] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:33.325982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895761233912873:9529] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:33.325986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895761233912873:9529] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:33.326006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1564 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:33.327394Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:33.327405Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:33.327420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:33.327483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:33.327540Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895761144158978:9261]
2025-09-30T14:54:33.328287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:33.328727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:33.328785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:33.329197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:33.329300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:33.329309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:33.329310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:33.329312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:33.329313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:33.329314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:33.329316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:33.329317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:33.329318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:33.329320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:33.329321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.329323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:33.329324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:33.329325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:33.329327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:33.329334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:33.329346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:33.329350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:33.329355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:33.329359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:33.329364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:33.329368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:33.329371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:33.329375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:33.329379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:33.329383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.329387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:33.329391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:33.329394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:33.329398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:33.329407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:33.329415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:33.329422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:33.329428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:33.329433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:33.329438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:33.329443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:33.329449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:33.329458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:33.329463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:33.329469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:33.329474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:33.329479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:33.329487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:33.329492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:33.329497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:33.329502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:33.329508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:33.329513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:33.329519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:33.329524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.329530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.329535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:33.329540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:33.329545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:33.329551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:33.329557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:33.329562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:33.329567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:33.329573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:33.329633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:33.336002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:33.337206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:33.337229Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:33.337233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:33.337238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:33.337247Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1563 [2:7555895761144158978:9261]
2025-09-30T14:54:33.337269Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:33.337295Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:33.337299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:33.337304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:33.337307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:33.337329Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:33.337345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:33.337355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:33.337441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.337450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:33.337453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:33.337458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:33.337461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:33.337547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:33.337557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.337573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:33.337586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:33.337605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:33.337636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895761233912769:2454], now have 1 active actors on pipe
2025-09-30T14:54:33.337645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895761233912990:9529], now have 1 active actors on pipe
2025-09-30T14:54:33.337653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895761144158972:9261]
2025-09-30T14:54:33.337662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895761144158972:9261]
2025-09-30T14:54:33.337665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895761144158972:9261]
2025-09-30T14:54:33.337680Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:33.337691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:33.337695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:33.337697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:33.337703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:33.337722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:33.337725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:33.337774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895761144158972:9261]
2025-09-30T14:54:33.337787Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:33.337814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:33.337768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1563
2025-09-30T14:54:33.337778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1563
2025-09-30T14:54:33.338112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:33.338124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:33.338160Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f21b8d4f-39903ac9-7cbeb4e9-9de91f8a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:33.338176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:33.338185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:33.338188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:33.338200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:33.338213Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:33.338235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:33.338478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:33.338500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:33.338528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:33.338673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1564 partition: 0 MaxSeqNo: 42 sessionId: src_id|f21b8d4f-39903ac9-7cbeb4e9-9de91f8a_0
2025-09-30T14:54:33.339017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d32cda34-68bfa1e9-ae1e0986-9c522197_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f21b8d4f-39903ac9-7cbeb4e9-9de91f8a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:33.341741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f21b8d4f-39903ac9-7cbeb4e9-9de91f8a_0] Write session: try to update token
2025-09-30T14:54:33.341760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f21b8d4f-39903ac9-7cbeb4e9-9de91f8a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:33.350962Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:33.350987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:33.350989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:33.350991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:33.351000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895761144158972:9261]
2025-09-30T14:54:33.351003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895761144158972:9261]
2025-09-30T14:54:33.351007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895761144158972:9261]
2025-09-30T14:54:33.351048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:33.351055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.351057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:33.351071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:33.351079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:33.351084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:33.351286Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:33.356675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1564 sessionId: src_id|f21b8d4f-39903ac9-7cbeb4e9-9de91f8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:33.359486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:33.407721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895761233913002:9180]
2025-09-30T14:54:33.408201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1563, pipe: [1:7555895761233913002:9180]
2025-09-30T14:54:33.473045Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:33.473476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:33.473493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:33.473534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895761233913002:9180], now have 1 active actors on pipe
2025-09-30T14:54:33.473836Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:33.473833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:33.473833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895761233913002:9180]
2025-09-30T14:54:33.473849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:33.473856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:33.473928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1564 reason: error at write: Disconnected sessionId: src_id|f21b8d4f-39903ac9-7cbeb4e9-9de91f8a_0
2025-09-30T14:54:33.474097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1564 sessionId: src_id|f21b8d4f-39903ac9-7cbeb4e9-9de91f8a_0 is DEAD
2025-09-30T14:54:33.474249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f21b8d4f-39903ac9-7cbeb4e9-9de91f8a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:33.474276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f21b8d4f-39903ac9-7cbeb4e9-9de91f8a_0] Write session will restart in 0.007037s
2025-09-30T14:54:33.474300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f21b8d4f-39903ac9-7cbeb4e9-9de91f8a_0] Write session: Do CDS request
2025-09-30T14:54:33.474319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f21b8d4f-39903ac9-7cbeb4e9-9de91f8a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:33.482757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f21b8d4f-39903ac9-7cbeb4e9-9de91f8a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:33.482937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:33.482953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1565
2025-09-30T14:54:33.483170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1565 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:33.483204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1565 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:33.483215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1565 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:33.483219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:33.483689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1565 sessionId:  describe result for acl check
2025-09-30T14:54:33.483726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:33.483733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:33.483735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:33.483742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895761233913115:9533] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:33.484288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895761233913115:9533] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:33.486659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895761233913115:9533] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:33.488048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:33.489415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:33.489729Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:33.489753Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:33.489792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:33.489884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895761233913115:9533] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:33.489902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895761233913115:9533] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:33.489906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895761233913115:9533] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:33.489916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1565 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:33.489988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:33.490042Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895761144159138:9264]
2025-09-30T14:54:33.490619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:33.490914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:33.490970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:33.491327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:33.491396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:33.491403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:33.491404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:33.491405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:33.491406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:33.491407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:33.491408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:33.491409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:33.491410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:33.491410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:33.491411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.491412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:33.491413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:33.491414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:33.491415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:33.491420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:33.491427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:33.491429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:33.491432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:33.491435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:33.491437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:33.491440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:33.491443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:33.491445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:33.491448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:33.491450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.491453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:33.491456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:33.491460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:33.491464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:33.491474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:33.491482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:33.491489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:33.491495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:33.491500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:33.491505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:33.491510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:33.491515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:33.491521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:33.491527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:33.491532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:33.491538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:33.491544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:33.491547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:33.491550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:33.491554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:33.491559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:33.491562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:33.491565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:33.491569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:33.491572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.491575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.491578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:33.491581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:33.491584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:33.491587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:33.491592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:33.491598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:33.491603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:33.491610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:33.491650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:33.497672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:33.498966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:33.498981Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:33.498983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:33.498987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:33.498994Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1564 [2:7555895761144159138:9264]
2025-09-30T14:54:33.499010Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:33.499026Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:33.499030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:33.499034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:33.499037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:33.499058Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:33.499072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:33.499078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:33.499137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.499146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:33.499148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:33.499152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:33.499155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:33.499227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:33.499234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.499263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:33.499280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:33.499303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:33.499331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895761233913236:9533], now have 1 active actors on pipe
2025-09-30T14:54:33.499339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895761233913003:2454], now have 1 active actors on pipe
2025-09-30T14:54:33.499348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895761144159133:9264]
2025-09-30T14:54:33.499355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895761144159133:9264]
2025-09-30T14:54:33.499358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895761144159133:9264]
2025-09-30T14:54:33.499373Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:33.499392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:33.499400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:33.499404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:33.499406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:33.499414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:33.499421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:33.499408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1564
2025-09-30T14:54:33.499427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1564
2025-09-30T14:54:33.499464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895761144159133:9264]
2025-09-30T14:54:33.499475Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:33.499481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:33.499498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:33.499506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:33.499553Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e23f830-e3cfec4f-80febc08-684768c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:33.499563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:33.499572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:33.499576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:33.499589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:33.499604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:33.499631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:33.499814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:33.499824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:33.499839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:33.499929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1565 partition: 0 MaxSeqNo: 42 sessionId: src_id|8e23f830-e3cfec4f-80febc08-684768c8_0
2025-09-30T14:54:33.500413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f21b8d4f-39903ac9-7cbeb4e9-9de91f8a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8e23f830-e3cfec4f-80febc08-684768c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:33.503302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e23f830-e3cfec4f-80febc08-684768c8_0] Write session: try to update token
2025-09-30T14:54:33.503325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e23f830-e3cfec4f-80febc08-684768c8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:33.512527Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:33.512542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:33.512546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:33.512549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:33.512562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895761144159133:9264]
2025-09-30T14:54:33.512569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895761144159133:9264]
2025-09-30T14:54:33.512574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895761144159133:9264]
2025-09-30T14:54:33.512625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:33.512628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:33.512634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.512635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:33.512638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:33.512640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:33.512855Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:33.518480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1565 sessionId: src_id|8e23f830-e3cfec4f-80febc08-684768c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:33.521450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:33.574084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895761233913249:9180]
2025-09-30T14:54:33.574491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1564, pipe: [1:7555895761233913249:9180]
2025-09-30T14:54:33.638601Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:33.639138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:33.639158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:33.639220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895761233913249:9180], now have 1 active actors on pipe
2025-09-30T14:54:33.639530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:33.639549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:33.639555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:33.639515Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:33.639614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895761233913249:9180]
2025-09-30T14:54:33.639647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1565 reason: error at write: Disconnected sessionId: src_id|8e23f830-e3cfec4f-80febc08-684768c8_0
2025-09-30T14:54:33.639827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1565 sessionId: src_id|8e23f830-e3cfec4f-80febc08-684768c8_0 is DEAD
2025-09-30T14:54:33.639981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e23f830-e3cfec4f-80febc08-684768c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:33.639992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e23f830-e3cfec4f-80febc08-684768c8_0] Write session will restart in 0.008199s
2025-09-30T14:54:33.640016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e23f830-e3cfec4f-80febc08-684768c8_0] Write session: Do CDS request
2025-09-30T14:54:33.640023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e23f830-e3cfec4f-80febc08-684768c8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:33.649849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e23f830-e3cfec4f-80febc08-684768c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:33.649952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:33.649970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1566
2025-09-30T14:54:33.650247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1566 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:33.650287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1566 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:33.650298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1566 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:33.650303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:33.650819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1566 sessionId:  describe result for acl check
2025-09-30T14:54:33.650857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:33.650859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:33.650862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:33.650870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895761233913340:9539] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:33.651524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895761233913340:9539] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:33.654153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895761233913340:9539] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:33.656863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:33.657208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895761233913340:9539] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:33.657227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895761233913340:9539] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:33.657231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895761233913340:9539] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:33.657239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1566 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:33.658861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:33.659075Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:33.659099Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:33.659110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:33.659167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:33.659210Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895761144159289:9266]
2025-09-30T14:54:33.659893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:33.660242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:33.660295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:33.660673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:33.660751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:33.660759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:33.660761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:33.660762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:33.660764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:33.660765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:33.660767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:33.660768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:33.660769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:33.660771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:33.660772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.660773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:33.660775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:33.660776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:33.660778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:33.660785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:33.660797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:33.660802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:33.660807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:33.660812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:33.660816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:33.660821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:33.660826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:33.660831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:33.660835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:33.660840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.660844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:33.660849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:33.660852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:33.660857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:33.660866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:33.660875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:33.660881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:33.660888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:33.660893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:33.660899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:33.660904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:33.660911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:33.660917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:33.660923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:33.660928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:33.660934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:33.660940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:33.660946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:33.660951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:33.660957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:33.660963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:33.660971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:33.660977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:33.660983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:33.660988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.660994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.660999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:33.661004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:33.661010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:33.661016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:33.661021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:33.661027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:33.661032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:33.661037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:33.661082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:33.666856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:33.668026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:33.668049Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:33.668052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:33.668056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:33.668063Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1565 [2:7555895761144159289:9266]
2025-09-30T14:54:33.668080Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:33.668097Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:33.668101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:33.668105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:33.668107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:33.668123Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:33.668131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:33.668138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:33.668199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.668213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:33.668215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:33.668218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:33.668220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:33.668303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:33.668311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.668328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:33.668341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:33.668364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:33.668392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895761233913252:2454], now have 1 active actors on pipe
2025-09-30T14:54:33.668411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895761233913477:9539], now have 1 active actors on pipe
2025-09-30T14:54:33.668417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895761144159283:9266]
2025-09-30T14:54:33.668420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895761144159283:9266]
2025-09-30T14:54:33.668422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895761144159283:9266]
2025-09-30T14:54:33.668435Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:33.668449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:33.668450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:33.668454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:33.668456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:33.668464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:33.668467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:33.668504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895761144159283:9266]
2025-09-30T14:54:33.668518Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:33.668554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:33.668552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1565
2025-09-30T14:54:33.668570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1565
2025-09-30T14:54:33.668718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:33.668733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:33.668762Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45c6f5fe-3cabee6a-b3e87732-a278d17a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:33.668776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:33.668780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:33.668783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:33.668794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:33.668812Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:33.668836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:33.669072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:33.669085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:33.669110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:33.669252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1566 partition: 0 MaxSeqNo: 42 sessionId: src_id|45c6f5fe-3cabee6a-b3e87732-a278d17a_0
2025-09-30T14:54:33.669636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e23f830-e3cfec4f-80febc08-684768c8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|45c6f5fe-3cabee6a-b3e87732-a278d17a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:33.672689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c6f5fe-3cabee6a-b3e87732-a278d17a_0] Write session: try to update token
2025-09-30T14:54:33.672713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c6f5fe-3cabee6a-b3e87732-a278d17a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:33.681326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:33.681344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:33.681354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895761144159283:9266]
2025-09-30T14:54:33.681400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:33.681417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:33.681603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:33.681763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:33.681937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:33.682091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:33.682317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:33.682360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:33.689985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1566 sessionId: src_id|45c6f5fe-3cabee6a-b3e87732-a278d17a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:33.692969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:33.693558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:33.693583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:33.693611Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:33.693615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:33.693617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:33.693619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:33.693632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895761144159283:9266]
2025-09-30T14:54:33.693636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895761144159283:9266]
2025-09-30T14:54:33.693640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895761144159283:9266]
2025-09-30T14:54:33.693681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:33.693688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:33.693692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:33.693693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:33.693698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.693701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:33.693863Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:33.740462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895761233913488:9180]
2025-09-30T14:54:33.747450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1565, pipe: [1:7555895761233913488:9180]
2025-09-30T14:54:33.811538Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:33.811898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:33.811927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895761233913488:9180], now have 1 active actors on pipe
2025-09-30T14:54:33.812194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:33.812626Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:33.812683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895761233913488:9180]
2025-09-30T14:54:33.825326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:33.825346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:33.825376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1566 reason: error at write: Disconnected sessionId: src_id|45c6f5fe-3cabee6a-b3e87732-a278d17a_0
2025-09-30T14:54:33.826094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1566 sessionId: src_id|45c6f5fe-3cabee6a-b3e87732-a278d17a_0 is DEAD
2025-09-30T14:54:33.828246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c6f5fe-3cabee6a-b3e87732-a278d17a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:33.828258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c6f5fe-3cabee6a-b3e87732-a278d17a_0] Write session will restart in 0.006062s
2025-09-30T14:54:33.828284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c6f5fe-3cabee6a-b3e87732-a278d17a_0] Write session: Do CDS request
2025-09-30T14:54:33.828291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c6f5fe-3cabee6a-b3e87732-a278d17a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:33.835754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c6f5fe-3cabee6a-b3e87732-a278d17a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:33.837470Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:33.837486Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1567
2025-09-30T14:54:33.837660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1567 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:33.837712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1567 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:33.837724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1567 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:33.837728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:33.838788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1567 sessionId:  describe result for acl check
2025-09-30T14:54:33.838825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:33.838830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:33.838831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:33.838838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895761233913525:9543] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:33.839406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895761233913525:9543] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:33.842887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895761233913525:9543] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:33.845620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895761233913525:9543] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:33.845635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895761233913525:9543] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:33.845639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895761233913525:9543] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:33.845647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1567 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:33.846864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:33.849172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:33.849421Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:33.849430Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:33.849440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:33.849502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:33.849544Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895761144159442:9269]
2025-09-30T14:54:33.850232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:33.850566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:33.850619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:33.851025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:33.851102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:33.851108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:33.851109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:33.851110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:33.851112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:33.851113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:33.851115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:33.851116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:33.851117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:33.851119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:33.851120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.851122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:33.851123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:33.851124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:33.851125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:33.851131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:33.851143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:33.851147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:33.851151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:33.851156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:33.851160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:33.851164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:33.851168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:33.851172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:33.851178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:33.851183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.851186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:33.851190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:33.851194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:33.851198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:33.851205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:33.851213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:33.851224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:33.851230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:33.851239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:33.851279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:33.851289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:33.851295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:33.851301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:33.851313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:33.851318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:33.851327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:33.851333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:33.851343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:33.851348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:33.851353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:33.851364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:33.851369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:33.851374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:33.851380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:33.851389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.851394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.851404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:33.851409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:33.851418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:33.851423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:33.851428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:33.851438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:33.851443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:33.851448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:33.851496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:33.860503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:33.861656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:33.861674Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:33.861677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:33.861682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:33.861689Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1566 [2:7555895761144159442:9269]
2025-09-30T14:54:33.861707Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:33.861724Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:33.861729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:33.861733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:33.861735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:33.861751Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:33.861764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:33.861772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:33.861858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.861871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:33.861873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:33.861877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:33.861880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:33.861952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:33.861960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.861976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:33.861996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:33.862016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:33.862042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895761233913713:9543], now have 1 active actors on pipe
2025-09-30T14:54:33.862052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895761233913489:2454], now have 1 active actors on pipe
2025-09-30T14:54:33.862058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895761144159437:9269]
2025-09-30T14:54:33.862060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895761144159437:9269]
2025-09-30T14:54:33.862063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895761144159437:9269]
2025-09-30T14:54:33.862078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:33.862098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:33.862119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:33.862123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:33.862127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:33.862127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:33.862130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:33.862203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1566
2025-09-30T14:54:33.862245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1566
2025-09-30T14:54:33.862164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895761144159437:9269]
2025-09-30T14:54:33.862178Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:33.862254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:33.862512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:33.862523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:33.862555Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dadab98d-45108bcc-1071d71a-99bb0d05_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:33.862563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:33.862567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:33.862570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:33.862581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:33.862592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:33.862612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:33.862836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:33.862843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:33.862859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:33.862963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1567 partition: 0 MaxSeqNo: 42 sessionId: src_id|dadab98d-45108bcc-1071d71a-99bb0d05_0
2025-09-30T14:54:33.863387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c6f5fe-3cabee6a-b3e87732-a278d17a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dadab98d-45108bcc-1071d71a-99bb0d05_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:33.866209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dadab98d-45108bcc-1071d71a-99bb0d05_0] Write session: try to update token
2025-09-30T14:54:33.866227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dadab98d-45108bcc-1071d71a-99bb0d05_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:33.875429Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:33.875450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:33.875454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:33.875461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:33.875473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895761144159437:9269]
2025-09-30T14:54:33.875479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895761144159437:9269]
2025-09-30T14:54:33.875484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895761144159437:9269]
2025-09-30T14:54:33.875539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:33.875547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:33.875545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:33.875551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:33.875555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:33.875561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:33.875722Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:33.884548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1567 sessionId: src_id|dadab98d-45108bcc-1071d71a-99bb0d05_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:33.887318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:33.914449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895761233913726:9180]
2025-09-30T14:54:33.914788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1566, pipe: [1:7555895761233913726:9180]
2025-09-30T14:54:33.998436Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:33.999040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:33.999057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:33.999082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895761233913726:9180], now have 1 active actors on pipe
2025-09-30T14:54:33.999367Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:33.999564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:33.999567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895761233913726:9180]
2025-09-30T14:54:33.999590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:33.999691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1567 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dadab98d-45108bcc-1071d71a-99bb0d05_0
2025-09-30T14:54:33.999880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1567 sessionId: src_id|dadab98d-45108bcc-1071d71a-99bb0d05_0 is DEAD
2025-09-30T14:54:34.000050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dadab98d-45108bcc-1071d71a-99bb0d05_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:34.000062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dadab98d-45108bcc-1071d71a-99bb0d05_0] Write session will restart in 0.008724s
2025-09-30T14:54:34.000086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dadab98d-45108bcc-1071d71a-99bb0d05_0] Write session: Do CDS request
2025-09-30T14:54:34.000093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dadab98d-45108bcc-1071d71a-99bb0d05_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:34.009763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dadab98d-45108bcc-1071d71a-99bb0d05_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:34.010057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:34.010072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1568
2025-09-30T14:54:34.010209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1568 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:34.010244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1568 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:34.010250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1568 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:34.010263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:34.010740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1568 sessionId:  describe result for acl check
2025-09-30T14:54:34.010779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:34.010787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:34.010789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:34.010796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895765528881146:9547] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:34.011393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895765528881146:9547] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:34.014426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895765528881146:9547] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:34.016570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:34.018155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:34.018380Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:34.018392Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:34.018402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:34.018455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:34.018498Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895765439126889:9271]
2025-09-30T14:54:34.018326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895765528881146:9547] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:34.018343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895765528881146:9547] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:34.018346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895765528881146:9547] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:34.018356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1568 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:34.019089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:34.019440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:34.019498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:34.019860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:34.019952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:34.019960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:34.019961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:34.019962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:34.019964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:34.019965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:34.019966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:34.019967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:34.019968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:34.019969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:34.019970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.019972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.019973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.019974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:34.019976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:34.019981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:34.019990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:34.019995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:34.019999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:34.020003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:34.020007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:34.020011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:34.020015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:34.020019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:34.020024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:34.020028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.020032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.020036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.020040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:34.020044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:34.020054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:34.020072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:34.020079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:34.020084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:34.020089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:34.020094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:34.020098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:34.020103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:34.020107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:34.020111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:34.020115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:34.020120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:34.020125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:34.020131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:34.020136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:34.020141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:34.020146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:34.020151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:34.020155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:34.020161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:34.020166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.020173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.020177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.020182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.020187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.020192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.020197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:34.020202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:34.020207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:34.020212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:34.020256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:34.026153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:34.027505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:34.027521Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:34.027524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:34.027528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:34.027535Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1567 [2:7555895765439126889:9271]
2025-09-30T14:54:34.027553Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:34.027570Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:34.027575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:34.027578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:34.027580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:34.027598Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:34.027606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:34.027613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:34.027678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.027687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.027690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.027694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:34.027696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:34.027768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:34.027778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.027793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.027804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.027828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:34.027845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895765439126884:9271]
2025-09-30T14:54:34.027853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895765439126884:9271]
2025-09-30T14:54:34.027856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895765439126884:9271]
2025-09-30T14:54:34.027871Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:34.027891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:34.027912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:34.027921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:34.027931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:34.027945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:34.027953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:34.027959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895765439126884:9271]
2025-09-30T14:54:34.027963Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:34.028033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:34.028329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895761233913728:2454], now have 1 active actors on pipe
2025-09-30T14:54:34.028337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895765528881249:9547], now have 1 active actors on pipe
2025-09-30T14:54:34.028544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:34.028556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:34.028589Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32cc1e1f-8434a41e-30a95553-7db03061_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:34.028602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:34.028611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:34.028614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:34.028626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:34.028636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:34.028657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:34.029179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:34.029200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:34.029222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:34.028277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1567
2025-09-30T14:54:34.028327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1567
2025-09-30T14:54:34.029749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dadab98d-45108bcc-1071d71a-99bb0d05_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|32cc1e1f-8434a41e-30a95553-7db03061_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:34.032577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32cc1e1f-8434a41e-30a95553-7db03061_0] Write session: try to update token
2025-09-30T14:54:34.032599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32cc1e1f-8434a41e-30a95553-7db03061_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:34.029350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1568 partition: 0 MaxSeqNo: 42 sessionId: src_id|32cc1e1f-8434a41e-30a95553-7db03061_0
2025-09-30T14:54:34.042799Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:34.042824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:34.042828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:34.042832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:34.042846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895765439126884:9271]
2025-09-30T14:54:34.042853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895765439126884:9271]
2025-09-30T14:54:34.042859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895765439126884:9271]
2025-09-30T14:54:34.042922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:34.042931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:34.042940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:34.042941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.042945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:34.042946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:34.043131Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:34.048489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1568 sessionId: src_id|32cc1e1f-8434a41e-30a95553-7db03061_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:34.051211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:34.103322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895765528881266:9180]
2025-09-30T14:54:34.105986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1567, pipe: [1:7555895765528881266:9180]
2025-09-30T14:54:34.171866Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:34.172381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:34.172403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:34.172457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895765528881266:9180], now have 1 active actors on pipe
2025-09-30T14:54:34.172781Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:34.173146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:34.173162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:34.173217Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:34.173253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1568 reason: error at write: Disconnected sessionId: src_id|32cc1e1f-8434a41e-30a95553-7db03061_0
2025-09-30T14:54:34.173266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895765528881266:9180]
2025-09-30T14:54:34.173433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1568 sessionId: src_id|32cc1e1f-8434a41e-30a95553-7db03061_0 is DEAD
2025-09-30T14:54:34.173574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32cc1e1f-8434a41e-30a95553-7db03061_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:34.173585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32cc1e1f-8434a41e-30a95553-7db03061_0] Write session will restart in 0.009626s
2025-09-30T14:54:34.173610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32cc1e1f-8434a41e-30a95553-7db03061_0] Write session: Do CDS request
2025-09-30T14:54:34.173616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32cc1e1f-8434a41e-30a95553-7db03061_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:34.184949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32cc1e1f-8434a41e-30a95553-7db03061_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:34.185531Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:34.185545Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1569
2025-09-30T14:54:34.185788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1569 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:34.185835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1569 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:34.185845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1569 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:34.185853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:34.186442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1569 sessionId:  describe result for acl check
2025-09-30T14:54:34.186482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:34.186489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:34.186491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:34.186497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895765528881393:9552] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:34.187049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895765528881393:9552] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:34.193687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895765528881393:9552] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:34.195688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:34.198008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:34.198225Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:34.198230Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:34.198241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:34.198304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:34.198342Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895765439127055:9273]
2025-09-30T14:54:34.199001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:34.199910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:34.199973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:34.200337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:34.200400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:34.200406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:34.200407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:34.200408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:34.200410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:34.200411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:34.200412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:34.200414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:34.200415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:34.200416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:34.200417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.200418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.200420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.200421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:34.200422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:34.200428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:34.200438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:34.200442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:34.200445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:34.200449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:34.200452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:34.200457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:34.200460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:34.200464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:34.200468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:34.200471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.200475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.200478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.200481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:34.200485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:34.200492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:34.200499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:34.200504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:34.200510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:34.200514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:34.200526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:34.200530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:34.200539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:34.200544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:34.200553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:34.200562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:34.200571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:34.200577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:34.200582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:34.200586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:34.200592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:34.200606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:34.200611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:34.200615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:34.200620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:34.200625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.200630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.200634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.200638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.200642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.200647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.200652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:34.200657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:34.200661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:34.200666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:34.200711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:34.203136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895765528881393:9552] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:34.203151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895765528881393:9552] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:34.203154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895765528881393:9552] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:34.203162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1569 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:34.208584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:34.209636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:34.209654Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:34.209656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:34.209660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:34.209667Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1568 [2:7555895765439127055:9273]
2025-09-30T14:54:34.209682Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:34.209698Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:34.209706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:34.209709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:34.209711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:34.209726Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:34.209736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:34.209746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:34.209823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.209832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.209834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.209837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:34.209840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:34.209906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:34.209913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.209926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.209941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.209962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:34.209982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895765439127049:9273]
2025-09-30T14:54:34.209989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895765439127049:9273]
2025-09-30T14:54:34.209991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895765439127049:9273]
2025-09-30T14:54:34.210004Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:34.210021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:34.210040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:34.210047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:34.210082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895765439127049:9273]
2025-09-30T14:54:34.210089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:34.210222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:34.210231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:34.210232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:34.210238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:34.210860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1568
2025-09-30T14:54:34.210881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1568
2025-09-30T14:54:34.211384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895765528881513:9552], now have 1 active actors on pipe
2025-09-30T14:54:34.211401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895765528881271:2454], now have 1 active actors on pipe
2025-09-30T14:54:34.211420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:34.211428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:34.211461Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a927450f-838ed6cd-3acdbd3c-36b5590f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:34.211472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:34.211477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:34.211479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:34.211501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:34.211514Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:34.211533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:34.211754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:34.211777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:34.211792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:34.214336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1569 partition: 0 MaxSeqNo: 42 sessionId: src_id|a927450f-838ed6cd-3acdbd3c-36b5590f_0
2025-09-30T14:54:34.214726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32cc1e1f-8434a41e-30a95553-7db03061_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a927450f-838ed6cd-3acdbd3c-36b5590f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:34.217586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a927450f-838ed6cd-3acdbd3c-36b5590f_0] Write session: try to update token
2025-09-30T14:54:34.217606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a927450f-838ed6cd-3acdbd3c-36b5590f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:34.232613Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:34.232639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:34.232642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:34.232644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:34.232662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895765439127049:9273]
2025-09-30T14:54:34.232668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895765439127049:9273]
2025-09-30T14:54:34.232673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895765439127049:9273]
2025-09-30T14:54:34.232727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:34.232741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.232746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:34.232936Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:34.233938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:34.233956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:34.233960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:34.249004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1569 sessionId: src_id|a927450f-838ed6cd-3acdbd3c-36b5590f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:34.251940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:34.271678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895765528881530:9180]
2025-09-30T14:54:34.272096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1568, pipe: [1:7555895765528881530:9180]
2025-09-30T14:54:34.360434Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:34.361139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:34.361156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:34.361193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895765528881530:9180], now have 1 active actors on pipe
2025-09-30T14:54:34.361656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895765528881530:9180]
2025-09-30T14:54:34.361698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:34.361701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:34.361780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1569 reason: error at write: Disconnected sessionId: src_id|a927450f-838ed6cd-3acdbd3c-36b5590f_0
2025-09-30T14:54:34.361987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1569 sessionId: src_id|a927450f-838ed6cd-3acdbd3c-36b5590f_0 is DEAD
2025-09-30T14:54:34.361989Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:34.362275Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:34.363619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a927450f-838ed6cd-3acdbd3c-36b5590f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:34.363634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a927450f-838ed6cd-3acdbd3c-36b5590f_0] Write session will restart in 0.008213s
2025-09-30T14:54:34.363661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a927450f-838ed6cd-3acdbd3c-36b5590f_0] Write session: Do CDS request
2025-09-30T14:54:34.363673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a927450f-838ed6cd-3acdbd3c-36b5590f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:34.373159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a927450f-838ed6cd-3acdbd3c-36b5590f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:34.375394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:34.375411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1570
2025-09-30T14:54:34.375608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1570 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:34.375658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1570 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:34.375663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1570 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:34.375668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:34.376249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1570 sessionId:  describe result for acl check
2025-09-30T14:54:34.376290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:34.376292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:34.376294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:34.376301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895765528881601:9563] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:34.377011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895765528881601:9563] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:34.379897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895765528881601:9563] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:34.387821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895765528881601:9563] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:34.387841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895765528881601:9563] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:34.387845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895765528881601:9563] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:34.387854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1570 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:34.399952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:34.401847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:34.402081Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:34.402091Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:34.402102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:34.402161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:34.402205Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895765439127235:9288]
2025-09-30T14:54:34.402895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:34.403211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:34.403300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:34.403637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:34.403701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:34.403703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:34.403704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:34.403705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:34.403706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:34.403707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:34.403709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:34.403710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:34.403712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:34.403713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:34.403714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.403715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.403716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.403717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:34.403718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:34.403724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:34.403735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:34.403739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:34.403744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:34.403748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:34.403752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:34.403756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:34.403760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:34.403764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:34.403768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:34.403772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.403776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.403780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.403784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:34.403788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:34.403796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:34.403804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:34.403810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:34.403816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:34.403821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:34.403827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:34.403831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:34.403837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:34.403842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:34.403848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:34.403852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:34.403858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:34.403864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:34.403869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:34.403875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:34.403881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:34.403885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:34.403891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:34.403895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:34.403902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:34.403907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.403913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.403917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.403922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.403927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.403933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.403937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:34.403943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:34.403947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:34.403953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:34.404012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:34.412310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:34.413819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1569
2025-09-30T14:54:34.413869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1569
2025-09-30T14:54:34.413296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:34.413316Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:34.413319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:34.413324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:34.413332Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1569 [2:7555895765439127235:9288]
2025-09-30T14:54:34.413352Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:34.413370Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:34.413373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:34.413376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:34.413379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:34.413399Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:34.413409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:34.413416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:34.413494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.413497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.413500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.413504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:34.413507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:34.413584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:34.413587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.413601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.413614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.413630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:34.413648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895765439127230:9288]
2025-09-30T14:54:34.413651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895765439127230:9288]
2025-09-30T14:54:34.413654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895765439127230:9288]
2025-09-30T14:54:34.413666Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:34.413682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:34.413682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:34.413685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:34.413696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:34.413697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:34.413701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:34.413711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895765528881533:2454], now have 1 active actors on pipe
2025-09-30T14:54:34.413715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895765528881671:9563], now have 1 active actors on pipe
2025-09-30T14:54:34.413754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895765439127230:9288]
2025-09-30T14:54:34.413765Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:34.413777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:34.414056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:34.414066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:34.414101Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aecfb45c-ca43635c-228706aa-b78f3f85_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:34.414112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:34.414116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:34.414119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:34.414130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:34.414143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:34.414164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:34.414379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:34.414389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:34.414406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:34.414530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1570 partition: 0 MaxSeqNo: 42 sessionId: src_id|aecfb45c-ca43635c-228706aa-b78f3f85_0
2025-09-30T14:54:34.414956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a927450f-838ed6cd-3acdbd3c-36b5590f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|aecfb45c-ca43635c-228706aa-b78f3f85_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:34.417890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aecfb45c-ca43635c-228706aa-b78f3f85_0] Write session: try to update token
2025-09-30T14:54:34.417911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aecfb45c-ca43635c-228706aa-b78f3f85_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:34.428535Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:34.428552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:34.428555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:34.428557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:34.428567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895765439127230:9288]
2025-09-30T14:54:34.428573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895765439127230:9288]
2025-09-30T14:54:34.428577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895765439127230:9288]
2025-09-30T14:54:34.428625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:34.428633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.428636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:34.428638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:34.428648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:34.428653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:34.428826Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:34.436326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1570 sessionId: src_id|aecfb45c-ca43635c-228706aa-b78f3f85_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:34.439369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:34.461907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895765528881771:9180]
2025-09-30T14:54:34.462218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1569, pipe: [1:7555895765528881771:9180]
2025-09-30T14:54:34.542495Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:34.543086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:34.543101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:34.543122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895765528881771:9180], now have 1 active actors on pipe
2025-09-30T14:54:34.543414Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:34.543440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895765528881771:9180]
2025-09-30T14:54:34.543453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:34.543489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:34.543622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1570 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aecfb45c-ca43635c-228706aa-b78f3f85_0
2025-09-30T14:54:34.543859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1570 sessionId: src_id|aecfb45c-ca43635c-228706aa-b78f3f85_0 is DEAD
2025-09-30T14:54:34.544796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aecfb45c-ca43635c-228706aa-b78f3f85_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:34.544810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aecfb45c-ca43635c-228706aa-b78f3f85_0] Write session will restart in 0.006308s
2025-09-30T14:54:34.544852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aecfb45c-ca43635c-228706aa-b78f3f85_0] Write session: Do CDS request
2025-09-30T14:54:34.544858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aecfb45c-ca43635c-228706aa-b78f3f85_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:34.552790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aecfb45c-ca43635c-228706aa-b78f3f85_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:34.552962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:34.552981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1571
2025-09-30T14:54:34.553179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1571 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:34.553216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1571 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:34.553225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1571 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:34.553231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:34.553885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1571 sessionId:  describe result for acl check
2025-09-30T14:54:34.553929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:34.553932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:34.553935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:34.553943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895765528881871:9568] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:34.554609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895765528881871:9568] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:34.557287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895765528881871:9568] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:34.561119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895765528881871:9568] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:34.561137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895765528881871:9568] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:34.561142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895765528881871:9568] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:34.561152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1571 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:34.561387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:34.562894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:34.563151Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:34.563162Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:34.563177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:34.563274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:34.563325Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895765439127402:9291]
2025-09-30T14:54:34.564067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:34.564406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:34.564462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:34.564843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:34.564933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:34.564941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:34.564942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:34.564944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:34.564945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:34.564947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:34.564948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:34.564949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:34.564951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:34.564952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:34.564953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.564955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.564956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.564958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:34.564959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:34.564966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:34.564979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:34.564984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:34.564989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:34.564993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:34.564997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:34.565001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:34.565004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:34.565008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:34.565014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:34.565018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.565022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.565026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.565031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:34.565035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:34.565047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:34.565056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:34.565062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:34.565068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:34.565073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:34.565080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:34.565083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:34.565089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:34.565095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:34.565101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:34.565106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:34.565113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:34.565124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:34.565131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:34.565137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:34.565143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:34.565148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:34.565155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:34.565160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:34.565166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:34.565173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.565178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.565182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.565188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.565192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.565197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.565201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:34.565207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:34.565215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:34.565220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:34.565265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:34.571596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:34.572808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:34.572827Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:34.572831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:34.572836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:34.572844Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1570 [2:7555895765439127402:9291]
2025-09-30T14:54:34.572865Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:34.572885Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:34.572889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:34.572893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:34.572896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:34.572918Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:34.572927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:34.572936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:34.573018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.573030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.573033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.573037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:34.573040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:34.573134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:34.573144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.573158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.573172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.573197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:34.573228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895765528882013:9568], now have 1 active actors on pipe
2025-09-30T14:54:34.573237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895765528881785:2454], now have 1 active actors on pipe
2025-09-30T14:54:34.573246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895765439127396:9291]
2025-09-30T14:54:34.573259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895765439127396:9291]
2025-09-30T14:54:34.573261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895765439127396:9291]
2025-09-30T14:54:34.573277Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:34.573292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:34.573295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:34.573298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:34.573298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:34.573317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:34.573321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:34.573308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1570
2025-09-30T14:54:34.573320Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1570
2025-09-30T14:54:34.573370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895765439127396:9291]
2025-09-30T14:54:34.573385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:34.573409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:34.573411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:34.573418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:34.573475Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1334149-c2e65024-adf1738a-a0adc6a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:34.573491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:34.573501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:34.573503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:34.573520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:34.573533Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:34.573562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:34.573760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:34.573771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:34.573789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:34.574230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1571 partition: 0 MaxSeqNo: 42 sessionId: src_id|a1334149-c2e65024-adf1738a-a0adc6a4_0
2025-09-30T14:54:34.574792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aecfb45c-ca43635c-228706aa-b78f3f85_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a1334149-c2e65024-adf1738a-a0adc6a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:34.577638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1334149-c2e65024-adf1738a-a0adc6a4_0] Write session: try to update token
2025-09-30T14:54:34.577661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1334149-c2e65024-adf1738a-a0adc6a4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:34.586938Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:34.586962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:34.586965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:34.586967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:34.586980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895765439127396:9291]
2025-09-30T14:54:34.586985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895765439127396:9291]
2025-09-30T14:54:34.586990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895765439127396:9291]
2025-09-30T14:54:34.587043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:34.587047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:34.587053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.587055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:34.587056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:34.587059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:34.587272Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:34.595128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1571 sessionId: src_id|a1334149-c2e65024-adf1738a-a0adc6a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:34.598802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:34.643667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895765528882027:9180]
2025-09-30T14:54:34.644021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1570, pipe: [1:7555895765528882027:9180]
2025-09-30T14:54:34.708351Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:34.708688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:34.708704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:34.708745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895765528882027:9180], now have 1 active actors on pipe
2025-09-30T14:54:34.709039Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:34.709203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895765528882027:9180]
2025-09-30T14:54:34.709225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:34.709246Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:34.709316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1571 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a1334149-c2e65024-adf1738a-a0adc6a4_0
2025-09-30T14:54:34.709490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1571 sessionId: src_id|a1334149-c2e65024-adf1738a-a0adc6a4_0 is DEAD
2025-09-30T14:54:34.709664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1334149-c2e65024-adf1738a-a0adc6a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:34.709676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1334149-c2e65024-adf1738a-a0adc6a4_0] Write session will restart in 0.006602s
2025-09-30T14:54:34.709701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1334149-c2e65024-adf1738a-a0adc6a4_0] Write session: Do CDS request
2025-09-30T14:54:34.709706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1334149-c2e65024-adf1738a-a0adc6a4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:34.718603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1334149-c2e65024-adf1738a-a0adc6a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:34.718730Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:34.718747Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1572
2025-09-30T14:54:34.719054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1572 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:34.719098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1572 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:34.719109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1572 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:34.719118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:34.719591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1572 sessionId:  describe result for acl check
2025-09-30T14:54:34.719632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:34.719638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:34.719640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:34.719646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895765528882121:9573] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:34.720197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895765528882121:9573] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:34.722847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895765528882121:9573] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:34.724942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:34.726019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:34.726190Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:34.726201Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:34.726209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:34.726248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:34.726284Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895765439127557:9293]
2025-09-30T14:54:34.726836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:34.727079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895765528882121:9573] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:34.727099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895765528882121:9573] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:34.727102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895765528882121:9573] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:34.727111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1572 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:34.727148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:34.727182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:34.727491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:34.727570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:34.727576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:34.727578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:34.727579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:34.727580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:34.727582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:34.727583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:34.727585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:34.727586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:34.727588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:34.727589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.727590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.727591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.727592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:34.727594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:34.727600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:34.727623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:34.727627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:34.727631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:34.727635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:34.727639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:34.727643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:34.727648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:34.727652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:34.727657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:34.727661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.727666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.727670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.727674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:34.727678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:34.727688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:34.727697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:34.727703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:34.727710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:34.727716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:34.727723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:34.727727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:34.727734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:34.727738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:34.727741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:34.727744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:34.727748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:34.727751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:34.727754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:34.727757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:34.727760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:34.727763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:34.727766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:34.727769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:34.727772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:34.727775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.727778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.727781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.727784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.727787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.727790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.727793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:34.727795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:34.727798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:34.727801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:34.727836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:34.733827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:34.734864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:34.734882Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:34.734886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:34.734891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:34.734901Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1571 [2:7555895765439127557:9293]
2025-09-30T14:54:34.734922Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:34.734943Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:34.734948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:34.734951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:34.734954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:34.734975Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:34.734985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:34.734995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:34.735076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.735079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.735082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.735087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:34.735091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:34.735178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:34.735181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.735195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.735210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.735229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:34.735276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895765528882260:9573], now have 1 active actors on pipe
2025-09-30T14:54:34.735285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895765439127552:9293]
2025-09-30T14:54:34.735288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895765439127552:9293]
2025-09-30T14:54:34.735291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895765439127552:9293]
2025-09-30T14:54:34.735308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:34.735325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895765528882029:2454], now have 1 active actors on pipe
2025-09-30T14:54:34.735329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:34.735331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:34.735334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:34.735337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:34.735347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:34.735352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:34.735394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895765439127552:9293]
2025-09-30T14:54:34.735402Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:34.735409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:34.735460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1571
2025-09-30T14:54:34.735461Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1571
2025-09-30T14:54:34.735613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:34.735626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:34.735663Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|acbb0b6b-3e07cd97-ec98aa63-bd1b4d13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:34.735670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:34.735674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:34.735676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:34.735688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:34.735699Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:34.735715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:34.735972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:34.735981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:34.735999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:34.739345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1572 partition: 0 MaxSeqNo: 42 sessionId: src_id|acbb0b6b-3e07cd97-ec98aa63-bd1b4d13_0
2025-09-30T14:54:34.739725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1334149-c2e65024-adf1738a-a0adc6a4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|acbb0b6b-3e07cd97-ec98aa63-bd1b4d13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:34.742611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acbb0b6b-3e07cd97-ec98aa63-bd1b4d13_0] Write session: try to update token
2025-09-30T14:54:34.742632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acbb0b6b-3e07cd97-ec98aa63-bd1b4d13_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:34.755336Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:34.755357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:34.755370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895765439127552:9293]
2025-09-30T14:54:34.755434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:34.755449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:34.755633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:34.755800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:34.755964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:34.756122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:34.756351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:34.756403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:34.760926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1572 sessionId: src_id|acbb0b6b-3e07cd97-ec98aa63-bd1b4d13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:34.761065Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:34.761086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:34.761089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:34.761092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:34.761104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895765439127552:9293]
2025-09-30T14:54:34.761110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895765439127552:9293]
2025-09-30T14:54:34.761119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895765439127552:9293]
2025-09-30T14:54:34.761169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:34.761178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.761186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:34.761365Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:34.761446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:34.761464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:34.761484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:34.763881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:34.809562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895765528882269:9180]
2025-09-30T14:54:34.810002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1571, pipe: [1:7555895765528882269:9180]
2025-09-30T14:54:34.884477Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:34.885102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:34.885117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:34.885140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895765528882269:9180], now have 1 active actors on pipe
2025-09-30T14:54:34.885364Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:34.885503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:34.885527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:34.885573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895765528882269:9180]
2025-09-30T14:54:34.885625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1572 reason: status is not ok: tablet will be restarted right now sessionId: src_id|acbb0b6b-3e07cd97-ec98aa63-bd1b4d13_0
2025-09-30T14:54:34.885815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1572 sessionId: src_id|acbb0b6b-3e07cd97-ec98aa63-bd1b4d13_0 is DEAD
2025-09-30T14:54:34.886172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acbb0b6b-3e07cd97-ec98aa63-bd1b4d13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:34.886180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acbb0b6b-3e07cd97-ec98aa63-bd1b4d13_0] Write session will restart in 0.007199s
2025-09-30T14:54:34.886203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acbb0b6b-3e07cd97-ec98aa63-bd1b4d13_0] Write session: Do CDS request
2025-09-30T14:54:34.886209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acbb0b6b-3e07cd97-ec98aa63-bd1b4d13_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:34.894866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:34.894883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1573
2025-09-30T14:54:34.894916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acbb0b6b-3e07cd97-ec98aa63-bd1b4d13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:34.895157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1573 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:34.895193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1573 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:34.895209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1573 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:34.895214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:34.895664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1573 sessionId:  describe result for acl check
2025-09-30T14:54:34.895709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:34.895716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:34.895718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:34.895725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895765528882367:9577] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:34.896299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895765528882367:9577] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:34.898569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895765528882367:9577] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:34.900806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895765528882367:9577] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:34.900817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895765528882367:9577] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:34.900820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895765528882367:9577] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:34.900833Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1573 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:34.900819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:34.902150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:34.902358Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:34.902374Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:34.902384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:34.902433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:34.902466Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895765439127717:9296]
2025-09-30T14:54:34.903126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:34.903517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:34.903601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:34.903978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:34.904053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:34.904061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:34.904062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:34.904063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:34.904065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:34.904067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:34.904068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:34.904069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:34.904071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:34.904072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:34.904074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.904075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.904077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.904078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:34.904080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:34.904086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:34.904097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:34.904103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:34.904107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:34.904112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:34.904116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:34.904119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:34.904123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:34.904127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:34.904132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:34.904137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.904141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.904145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.904149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:34.904153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:34.904161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:34.904170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:34.904175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:34.904181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:34.904185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:34.904190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:34.904196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:34.904201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:34.904206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:34.904211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:34.904216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:34.904222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:34.904227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:34.904233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:34.904238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:34.904243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:34.904249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:34.904254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:34.904258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:34.904265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:34.904270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.904276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.904281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.904286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.904291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.904296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.904300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:34.904305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:34.904310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:34.904317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:34.904361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:34.909902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:34.910816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:34.910833Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:34.910837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:34.910841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:34.910849Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1572 [2:7555895765439127717:9296]
2025-09-30T14:54:34.910867Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:34.910883Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:34.910887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:34.910890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:34.910893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:34.910910Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:34.910918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:34.910926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:34.910989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.911005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.911007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.911011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:34.911014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:34.911085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:34.911088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.911102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:34.911115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:34.911132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:34.911156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895765439127711:9296]
2025-09-30T14:54:34.911166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895765439127711:9296]
2025-09-30T14:54:34.911168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895765439127711:9296]
2025-09-30T14:54:34.911177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:34.911193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895765528882271:2454], now have 1 active actors on pipe
2025-09-30T14:54:34.911193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:34.911200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:34.911205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895765528882501:9577], now have 1 active actors on pipe
2025-09-30T14:54:34.911205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:34.911212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:34.911229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:34.911232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:34.911266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1572
2025-09-30T14:54:34.911272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1572
2025-09-30T14:54:34.911311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895765439127711:9296]
2025-09-30T14:54:34.911321Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:34.911333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:34.911354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:34.911365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:34.911629Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97a2059e-9c776218-53780b53-6fc1c440_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:34.911647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:34.911651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:34.911654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:34.911664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:34.911674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:34.911707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:34.911928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:34.911955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:34.911981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:34.912095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1573 partition: 0 MaxSeqNo: 42 sessionId: src_id|97a2059e-9c776218-53780b53-6fc1c440_0
2025-09-30T14:54:34.912444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acbb0b6b-3e07cd97-ec98aa63-bd1b4d13_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|97a2059e-9c776218-53780b53-6fc1c440_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:34.915399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97a2059e-9c776218-53780b53-6fc1c440_0] Write session: try to update token
2025-09-30T14:54:34.915418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97a2059e-9c776218-53780b53-6fc1c440_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:34.923881Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:34.923902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:34.923905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:34.923907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:34.923917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895765439127711:9296]
2025-09-30T14:54:34.923922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895765439127711:9296]
2025-09-30T14:54:34.923928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895765439127711:9296]
2025-09-30T14:54:34.923971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:34.923977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:34.923980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:34.923984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:34.923991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:34.923999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:34.924129Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:34.932390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1573 sessionId: src_id|97a2059e-9c776218-53780b53-6fc1c440_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:34.935433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:34.985671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895765528882514:9180]
2025-09-30T14:54:34.985984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1572, pipe: [1:7555895765528882514:9180]
2025-09-30T14:54:35.039147Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:35.039514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:35.039529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:35.039549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895765528882514:9180], now have 1 active actors on pipe
2025-09-30T14:54:35.039791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:35.039813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:35.039818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:35.039859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895765528882514:9180]
2025-09-30T14:54:35.039915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1573 reason: error at write: Disconnected sessionId: src_id|97a2059e-9c776218-53780b53-6fc1c440_0
2025-09-30T14:54:35.040043Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:35.040118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1573 sessionId: src_id|97a2059e-9c776218-53780b53-6fc1c440_0 is DEAD
2025-09-30T14:54:35.040321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a2059e-9c776218-53780b53-6fc1c440_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:35.040338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a2059e-9c776218-53780b53-6fc1c440_0] Write session will restart in 0.007269s
2025-09-30T14:54:35.040370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a2059e-9c776218-53780b53-6fc1c440_0] Write session: Do CDS request
2025-09-30T14:54:35.040381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a2059e-9c776218-53780b53-6fc1c440_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:35.048945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97a2059e-9c776218-53780b53-6fc1c440_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:35.048987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:35.049005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1574
2025-09-30T14:54:35.049208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1574 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:35.049242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1574 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:35.049248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1574 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:35.049252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:35.049714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1574 sessionId:  describe result for acl check
2025-09-30T14:54:35.049758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:35.049764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:35.049766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:35.049772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895769823849922:9581] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:35.050346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895769823849922:9581] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:35.052676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895769823849922:9581] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:35.056056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:35.057537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:35.057768Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:35.057783Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:35.057806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:35.057867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:35.057925Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895769734095170:9298]
2025-09-30T14:54:35.058609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:35.058744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895769823849922:9581] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:35.058762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895769823849922:9581] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:35.058767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895769823849922:9581] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:35.058776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1574 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:35.058872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:35.058912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:35.059256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:35.059318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:35.059326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:35.059327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:35.059329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:35.059330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:35.059331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:35.059333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:35.059334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:35.059336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:35.059337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:35.059338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.059339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.059341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.059342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:35.059343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:35.059348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:35.059360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:35.059366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:35.059370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:35.059375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:35.059380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:35.059385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:35.059389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:35.059394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:35.059399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:35.059404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.059408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.059412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.059417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:35.059421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:35.059431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:35.059439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:35.059446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:35.059452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:35.059458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:35.059464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:35.059469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:35.059475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:35.059481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:35.059487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:35.059491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:35.059497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:35.059502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:35.059508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:35.059513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:35.059519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:35.059525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:35.059531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:35.059536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:35.059541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:35.059546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.059552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.059557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.059563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.059568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.059573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.059579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:35.059585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:35.059590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:35.059596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:35.059647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:35.066055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:35.067179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:35.067196Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:35.067199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:35.067203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:35.067211Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1573 [2:7555895769734095170:9298]
2025-09-30T14:54:35.067230Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:35.067265Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:35.067274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:35.067277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:35.067280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:35.067298Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:35.067311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:35.067323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:35.067395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.067405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.067407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.067411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:35.067414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:35.067744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1573
2025-09-30T14:54:35.067819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1573
2025-09-30T14:54:35.067488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:35.067495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.067509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.067521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.067542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:35.067559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895769734095165:9298]
2025-09-30T14:54:35.067562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895769734095165:9298]
2025-09-30T14:54:35.067565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895769734095165:9298]
2025-09-30T14:54:35.067574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:35.067591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:35.067607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:35.067610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:35.067616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:35.067622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:35.067625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:35.067651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895769823849811:2454], now have 1 active actors on pipe
2025-09-30T14:54:35.067655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895769823850043:9581], now have 1 active actors on pipe
2025-09-30T14:54:35.067658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895769734095165:9298]
2025-09-30T14:54:35.067669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:35.067687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:35.067869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:35.067874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:35.067900Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96346a2f-4b3f9f88-71ccd455-a18747b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:35.067907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:35.067911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:35.067913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:35.067926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:35.067935Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:35.067949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:35.068187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:35.068206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:35.068246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:35.068390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1574 partition: 0 MaxSeqNo: 42 sessionId: src_id|96346a2f-4b3f9f88-71ccd455-a18747b7_0
2025-09-30T14:54:35.068844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a2059e-9c776218-53780b53-6fc1c440_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|96346a2f-4b3f9f88-71ccd455-a18747b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:35.072299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96346a2f-4b3f9f88-71ccd455-a18747b7_0] Write session: try to update token
2025-09-30T14:54:35.072328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96346a2f-4b3f9f88-71ccd455-a18747b7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:35.081659Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:35.081684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:35.081687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:35.081689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:35.081699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895769734095165:9298]
2025-09-30T14:54:35.081704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895769734095165:9298]
2025-09-30T14:54:35.081709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895769734095165:9298]
2025-09-30T14:54:35.081754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:35.081759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:35.081762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.081765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:35.081766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:35.081771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:35.081923Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:35.091722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1574 sessionId: src_id|96346a2f-4b3f9f88-71ccd455-a18747b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:35.095064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:35.139756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895769823850058:9180]
2025-09-30T14:54:35.140098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1573, pipe: [1:7555895769823850058:9180]
2025-09-30T14:54:35.198350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895769823850058:9180]
2025-09-30T14:54:35.198357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:35.198415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:35.198418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:35.198486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1574 reason: error at write: Disconnected sessionId: src_id|96346a2f-4b3f9f88-71ccd455-a18747b7_0
2025-09-30T14:54:35.198660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1574 sessionId: src_id|96346a2f-4b3f9f88-71ccd455-a18747b7_0 is DEAD
2025-09-30T14:54:35.199349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96346a2f-4b3f9f88-71ccd455-a18747b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:35.197413Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:35.197891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:35.197900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:35.197921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895769823850058:9180], now have 1 active actors on pipe
2025-09-30T14:54:35.198393Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:35.199367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96346a2f-4b3f9f88-71ccd455-a18747b7_0] Write session will restart in 0.009475s
2025-09-30T14:54:35.202785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96346a2f-4b3f9f88-71ccd455-a18747b7_0] Write session: Do CDS request
2025-09-30T14:54:35.202799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96346a2f-4b3f9f88-71ccd455-a18747b7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:35.213976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96346a2f-4b3f9f88-71ccd455-a18747b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:35.214460Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:35.214487Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1575
2025-09-30T14:54:35.214942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1575 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:35.214992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1575 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:35.214999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1575 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:35.215016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:35.215612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1575 sessionId:  describe result for acl check
2025-09-30T14:54:35.215660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:35.215662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:35.215664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:35.215671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895769823850169:9586] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:35.216305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895769823850169:9586] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:35.220513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895769823850169:9586] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:35.224340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895769823850169:9586] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:35.224356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895769823850169:9586] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:35.224358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895769823850169:9586] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:35.224367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1575 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:35.225876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:35.227814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:35.228026Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:35.228039Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:35.228052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:35.228118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:35.228165Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895769734095330:9300]
2025-09-30T14:54:35.228844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:35.229133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:35.229187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:35.229534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:35.229615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:35.229621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:35.229623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:35.229624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:35.229626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:35.229627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:35.229629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:35.229630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:35.229631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:35.229632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:35.229634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.229635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.229636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.229638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:35.229639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:35.229645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:35.229656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:35.229660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:35.229665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:35.229669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:35.229673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:35.229677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:35.229681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:35.229686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:35.229690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:35.229695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.229699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.229704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.229707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:35.229711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:35.229720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:35.229729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:35.229735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:35.229740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:35.229752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:35.229758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:35.229762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:35.229772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:35.229777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:35.229782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:35.229790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:35.229809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:35.229814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:35.229819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:35.229824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:35.229830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:35.229835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:35.229846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:35.229852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:35.229857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:35.229867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.229872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.229879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.229890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.229896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.229905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.229909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:35.229915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:35.229920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:35.229926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:35.229977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:35.235743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:35.236672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:35.236690Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:35.236694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:35.236698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:35.236706Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1574 [2:7555895769734095330:9300]
2025-09-30T14:54:35.236723Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:35.236740Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:35.236743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:35.236746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:35.236749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:35.236766Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:35.236780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:35.236786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:35.236857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.236864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.236866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.236870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:35.236873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:35.236942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:35.236949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.236966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.236982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.237006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:35.237025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895769823850293:9586], now have 1 active actors on pipe
2025-09-30T14:54:35.237029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895769823850063:2454], now have 1 active actors on pipe
2025-09-30T14:54:35.237036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895769734095325:9300]
2025-09-30T14:54:35.237040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895769734095325:9300]
2025-09-30T14:54:35.237043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895769734095325:9300]
2025-09-30T14:54:35.237056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:35.237075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:35.237094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:35.237096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:35.237094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1574
2025-09-30T14:54:35.237094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1574
2025-09-30T14:54:35.237132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895769734095325:9300]
2025-09-30T14:54:35.237142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:35.237150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:35.237154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:35.237158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:35.237165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:35.237320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:35.237331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:35.237357Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49b7928f-a3e1b3ae-def06389-cd983335_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:35.237369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:35.237377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:35.237379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:35.237392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:35.237406Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:35.237424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:35.237612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:35.237619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:35.237635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:35.238118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1575 partition: 0 MaxSeqNo: 42 sessionId: src_id|49b7928f-a3e1b3ae-def06389-cd983335_0
2025-09-30T14:54:35.238536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96346a2f-4b3f9f88-71ccd455-a18747b7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|49b7928f-a3e1b3ae-def06389-cd983335_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:35.241644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49b7928f-a3e1b3ae-def06389-cd983335_0] Write session: try to update token
2025-09-30T14:54:35.241664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49b7928f-a3e1b3ae-def06389-cd983335_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:35.250636Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:35.250658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:35.250667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895769734095325:9300]
2025-09-30T14:54:35.250708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:35.250727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:35.250898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:35.251047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:35.251186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:35.251364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:35.251790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:35.251838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:35.262697Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:35.262717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:35.262722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:35.262724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:35.262736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895769734095325:9300]
2025-09-30T14:54:35.262740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895769734095325:9300]
2025-09-30T14:54:35.262745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895769734095325:9300]
2025-09-30T14:54:35.262787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:35.262794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.262797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:35.262795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:35.262803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:35.262807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:35.262953Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:35.264095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1575 sessionId: src_id|49b7928f-a3e1b3ae-def06389-cd983335_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:35.266979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:35.296552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895769823850321:9180]
2025-09-30T14:54:35.296961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1574, pipe: [1:7555895769823850321:9180]
2025-09-30T14:54:35.385355Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:35.385772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:35.385783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:35.385821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895769823850321:9180], now have 1 active actors on pipe
2025-09-30T14:54:35.390723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:35.390822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1575 reason: status is not ok: tablet will be restarted right now sessionId: src_id|49b7928f-a3e1b3ae-def06389-cd983335_0
2025-09-30T14:54:35.391007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1575 sessionId: src_id|49b7928f-a3e1b3ae-def06389-cd983335_0 is DEAD
2025-09-30T14:54:35.391188Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:35.388549Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:35.391241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895769823850321:9180]
2025-09-30T14:54:35.399404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b7928f-a3e1b3ae-def06389-cd983335_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:35.399422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b7928f-a3e1b3ae-def06389-cd983335_0] Write session will restart in 0.007840s
2025-09-30T14:54:35.399451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b7928f-a3e1b3ae-def06389-cd983335_0] Write session: Do CDS request
2025-09-30T14:54:35.399457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b7928f-a3e1b3ae-def06389-cd983335_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:35.408778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49b7928f-a3e1b3ae-def06389-cd983335_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:35.409360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:35.409377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1576
2025-09-30T14:54:35.415463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1576 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:35.415543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1576 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:35.415551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1576 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:35.415558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:35.416895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1576 sessionId:  describe result for acl check
2025-09-30T14:54:35.416950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:35.416953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:35.416954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:35.416962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895769823850365:9597] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:35.417564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895769823850365:9597] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:35.420674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895769823850365:9597] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:35.428985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895769823850365:9597] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:35.429011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895769823850365:9597] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:35.429015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895769823850365:9597] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:35.429025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1576 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:35.448322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:35.450346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:35.450563Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:35.450568Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:35.450582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:35.450652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:35.450696Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895769734095539:9315]
2025-09-30T14:54:35.451393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:35.451847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:35.451899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:35.452229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:35.452297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:35.452298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:35.452300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:35.452301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:35.452303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:35.452304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:35.452305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:35.452306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:35.452307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:35.452308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:35.452310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.452311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.452315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.452317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:35.452318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:35.452324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:35.452333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:35.452337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:35.452341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:35.452345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:35.452348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:35.452352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:35.452355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:35.452360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:35.452364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:35.452368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.452372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.452376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.452380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:35.452384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:35.452393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:35.452402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:35.452409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:35.452414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:35.452420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:35.452425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:35.452431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:35.452437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:35.452442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:35.452447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:35.452451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:35.452455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:35.452464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:35.452472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:35.452476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:35.452480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:35.452484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:35.452490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:35.452495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:35.452499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:35.452503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.452508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.452512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.452518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.452522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.452526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.452530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:35.452535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:35.452540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:35.452545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:35.452588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:35.463218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1575
2025-09-30T14:54:35.463265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1575
2025-09-30T14:54:35.465395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1576 partition: 0 MaxSeqNo: 42 sessionId: src_id|2f5082b5-bf661fd-c09e7a81-6d3fa6cc_0
2025-09-30T14:54:35.461397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:35.462675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:35.462682Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:35.462686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:35.462691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:35.462699Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1575 [2:7555895769734095539:9315]
2025-09-30T14:54:35.462718Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:35.462742Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:35.462747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:35.462751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:35.462754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:35.462778Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:35.462786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:35.462794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:35.462877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.462880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.462884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.462888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:35.462891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:35.462982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:35.462986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.463004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.463017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.463035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:35.463058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895769734095532:9315]
2025-09-30T14:54:35.463061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895769734095532:9315]
2025-09-30T14:54:35.463064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895769734095532:9315]
2025-09-30T14:54:35.463078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:35.463099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895769823850458:9597], now have 1 active actors on pipe
2025-09-30T14:54:35.463104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895769823850336:2454], now have 1 active actors on pipe
2025-09-30T14:54:35.463107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:35.463113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:35.463114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:35.463115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:35.463128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:35.463133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:35.463184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895769734095532:9315]
2025-09-30T14:54:35.463196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:35.463210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:35.463909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:35.463927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:35.463973Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f5082b5-bf661fd-c09e7a81-6d3fa6cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:35.463983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:35.463989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:35.463992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:35.464008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:35.464022Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:35.464050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:35.465117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:35.465124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:35.465157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:35.469690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b7928f-a3e1b3ae-def06389-cd983335_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2f5082b5-bf661fd-c09e7a81-6d3fa6cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:35.473206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5082b5-bf661fd-c09e7a81-6d3fa6cc_0] Write session: try to update token
2025-09-30T14:54:35.473236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5082b5-bf661fd-c09e7a81-6d3fa6cc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:35.479323Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:35.479341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:35.479344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:35.479345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:35.479353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895769734095532:9315]
2025-09-30T14:54:35.479357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895769734095532:9315]
2025-09-30T14:54:35.479361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895769734095532:9315]
2025-09-30T14:54:35.479403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:35.479412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.479415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:35.479417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:35.479423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:35.479427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:35.479547Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:35.491010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895769823850576:9180]
2025-09-30T14:54:35.491308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1575, pipe: [1:7555895769823850576:9180]
2025-09-30T14:54:35.502663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1576 sessionId: src_id|2f5082b5-bf661fd-c09e7a81-6d3fa6cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:35.506393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:35.594090Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:35.594390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895769823850576:9180], now have 1 active actors on pipe
2025-09-30T14:54:35.594421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:35.594432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:35.594688Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:35.595339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:35.595471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1576 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2f5082b5-bf661fd-c09e7a81-6d3fa6cc_0
2025-09-30T14:54:35.595693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1576 sessionId: src_id|2f5082b5-bf661fd-c09e7a81-6d3fa6cc_0 is DEAD
2025-09-30T14:54:35.595891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:35.595939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895769823850576:9180]
2025-09-30T14:54:35.596320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5082b5-bf661fd-c09e7a81-6d3fa6cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:35.596334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5082b5-bf661fd-c09e7a81-6d3fa6cc_0] Write session will restart in 0.007958s
2025-09-30T14:54:35.596358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5082b5-bf661fd-c09e7a81-6d3fa6cc_0] Write session: Do CDS request
2025-09-30T14:54:35.596364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5082b5-bf661fd-c09e7a81-6d3fa6cc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:35.605778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5082b5-bf661fd-c09e7a81-6d3fa6cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:35.605936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:35.605965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1577
2025-09-30T14:54:35.606146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1577 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:35.606185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1577 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:35.606191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1577 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:35.606196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:35.606791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1577 sessionId:  describe result for acl check
2025-09-30T14:54:35.606838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:35.606846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:35.606849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:35.606856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895769823850723:9603] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:35.607540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895769823850723:9603] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:35.610282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895769823850723:9603] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:35.613277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:35.614032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895769823850723:9603] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:35.614057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895769823850723:9603] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:35.614062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895769823850723:9603] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:35.614074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1577 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:35.615738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:35.616093Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:35.616110Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:35.616137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:35.616269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:35.616318Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895769734095699:9318]
2025-09-30T14:54:35.616805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:35.617199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:35.617231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:35.617466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:35.617510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:35.617515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:35.617516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:35.617517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:35.617517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:35.617518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:35.617520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:35.617520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:35.617521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:35.617522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:35.617523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.617524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.617525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.617525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:35.617526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:35.617531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:35.617541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:35.617545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:35.617549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:35.617553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:35.617558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:35.617561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:35.617565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:35.617570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:35.617575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:35.617578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.617581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.617583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.617586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:35.617589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:35.617595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:35.617602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:35.617608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:35.617614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:35.617617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:35.617622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:35.617626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:35.617632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:35.617637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:35.617642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:35.617646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:35.617652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:35.617657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:35.617663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:35.617668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:35.617671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:35.617674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:35.617677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:35.617681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:35.617684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:35.617687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.617690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.617692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.617700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.617703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.617706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.617709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:35.617716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:35.617719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:35.617723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:35.617748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:35.626789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:35.628400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:35.628422Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:35.628426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:35.628430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:35.628440Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1576 [2:7555895769734095699:9318]
2025-09-30T14:54:35.628464Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:35.628486Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:35.628491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:35.628495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:35.628498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:35.628522Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:35.628537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:35.628551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:35.628641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.628651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.628654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.628659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:35.628662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:35.628947Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1576
2025-09-30T14:54:35.629010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1576
2025-09-30T14:54:35.628754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:35.628766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.628783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.628796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.628815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:35.628842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895769823850592:2454], now have 1 active actors on pipe
2025-09-30T14:54:35.628847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895769823850830:9603], now have 1 active actors on pipe
2025-09-30T14:54:35.628855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895769734095693:9318]
2025-09-30T14:54:35.628858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895769734095693:9318]
2025-09-30T14:54:35.628860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895769734095693:9318]
2025-09-30T14:54:35.628881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:35.628898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:35.628913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:35.628916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:35.628918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:35.628920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:35.628920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:35.628969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895769734095693:9318]
2025-09-30T14:54:35.628973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:35.628990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:35.629133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:35.629143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:35.629177Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a959499b-2ebb1f2c-8fcfa274-c45e0405_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:35.629196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:35.629202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:35.629205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:35.629232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:35.629247Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:35.629277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:35.629495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:35.629507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:35.629552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:35.629681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1577 partition: 0 MaxSeqNo: 42 sessionId: src_id|a959499b-2ebb1f2c-8fcfa274-c45e0405_0
2025-09-30T14:54:35.630175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5082b5-bf661fd-c09e7a81-6d3fa6cc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a959499b-2ebb1f2c-8fcfa274-c45e0405_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:35.633343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a959499b-2ebb1f2c-8fcfa274-c45e0405_0] Write session: try to update token
2025-09-30T14:54:35.633366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a959499b-2ebb1f2c-8fcfa274-c45e0405_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:35.642326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:35.642346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:35.642349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:35.642352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:35.642363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895769734095693:9318]
2025-09-30T14:54:35.642369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895769734095693:9318]
2025-09-30T14:54:35.642373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895769734095693:9318]
2025-09-30T14:54:35.642422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:35.642430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.642434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:35.642512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:35.642530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:35.642536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:35.642610Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:35.649063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1577 sessionId: src_id|a959499b-2ebb1f2c-8fcfa274-c45e0405_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:35.652088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:35.696409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895769823850845:9180]
2025-09-30T14:54:35.696793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1576, pipe: [1:7555895769823850845:9180]
2025-09-30T14:54:35.771057Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:35.771625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:35.771646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:35.771703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895769823850845:9180], now have 1 active actors on pipe
2025-09-30T14:54:35.772022Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:35.772126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895769823850845:9180]
2025-09-30T14:54:35.772157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:35.772177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:35.772258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1577 reason: error at write: Disconnected sessionId: src_id|a959499b-2ebb1f2c-8fcfa274-c45e0405_0
2025-09-30T14:54:35.772387Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:35.772642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a959499b-2ebb1f2c-8fcfa274-c45e0405_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:35.772651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a959499b-2ebb1f2c-8fcfa274-c45e0405_0] Write session will restart in 0.005428s
2025-09-30T14:54:35.772676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a959499b-2ebb1f2c-8fcfa274-c45e0405_0] Write session: Do CDS request
2025-09-30T14:54:35.772682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a959499b-2ebb1f2c-8fcfa274-c45e0405_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:35.772468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1577 sessionId: src_id|a959499b-2ebb1f2c-8fcfa274-c45e0405_0 is DEAD
2025-09-30T14:54:35.779819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a959499b-2ebb1f2c-8fcfa274-c45e0405_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:35.779956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:35.779979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1578
2025-09-30T14:54:35.780100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1578 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:35.780144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1578 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:35.780149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1578 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:35.780154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:35.780651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1578 sessionId:  describe result for acl check
2025-09-30T14:54:35.780686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:35.780688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:35.780690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:35.780696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895769823850869:9607] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:35.781271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895769823850869:9607] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:35.784029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895769823850869:9607] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:35.789071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895769823850869:9607] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:35.789089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895769823850869:9607] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:35.789092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895769823850869:9607] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:35.789101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1578 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:35.792798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:35.794384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:35.794621Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:35.794627Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:35.794640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:35.794698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:35.794746Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895769734095862:9321]
2025-09-30T14:54:35.795514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:35.795935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:35.796007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:35.796411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:35.796508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:35.796516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:35.796517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:35.796519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:35.796520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:35.796521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:35.796523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:35.796525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:35.796526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:35.796528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:35.796529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.796530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.796532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.796533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:35.796534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:35.796541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:35.796552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:35.796555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:35.796560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:35.796563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:35.796567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:35.796571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:35.796575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:35.796579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:35.796583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:35.796586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.796590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.796594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.796597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:35.796601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:35.796610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:35.796620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:35.796627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:35.796634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:35.796639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:35.796644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:35.796650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:35.796655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:35.796660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:35.796665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:35.796670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:35.796676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:35.796682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:35.796688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:35.796693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:35.796699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:35.796705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:35.796710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:35.796715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:35.796721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:35.796726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.796731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.796736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.796742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.796751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.796757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.796761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:35.796766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:35.796772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:35.796777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:35.796827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:35.803469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:35.804564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:35.804573Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:35.804577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:35.804583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:35.804593Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1577 [2:7555895769734095862:9321]
2025-09-30T14:54:35.804617Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:35.804640Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:35.804644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:35.804649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:35.804653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:35.804677Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:35.804687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:35.804696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:35.804794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.804797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.804800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.804805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:35.804808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:35.804929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:35.804944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.804961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.804974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.804996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:35.805028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895769823851062:9607], now have 1 active actors on pipe
2025-09-30T14:54:35.805036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895769823850846:2454], now have 1 active actors on pipe
2025-09-30T14:54:35.805045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895769734095857:9321]
2025-09-30T14:54:35.805047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895769734095857:9321]
2025-09-30T14:54:35.805050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895769734095857:9321]
2025-09-30T14:54:35.805067Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:35.805091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:35.805112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:35.805112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:35.805116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:35.805118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:35.805121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:35.805168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895769734095857:9321]
2025-09-30T14:54:35.805185Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:35.805227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:35.805198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1577
2025-09-30T14:54:35.805248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1577
2025-09-30T14:54:35.805393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:35.805407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:35.805448Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|182248f6-4f36552a-a5b03736-7d0b2771_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:35.805465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:35.805469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:35.805473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:35.805489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:35.805504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:35.805526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:35.805957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:35.805989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:35.806011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:35.806180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1578 partition: 0 MaxSeqNo: 42 sessionId: src_id|182248f6-4f36552a-a5b03736-7d0b2771_0
2025-09-30T14:54:35.806669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a959499b-2ebb1f2c-8fcfa274-c45e0405_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|182248f6-4f36552a-a5b03736-7d0b2771_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:35.809660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|182248f6-4f36552a-a5b03736-7d0b2771_0] Write session: try to update token
2025-09-30T14:54:35.809684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|182248f6-4f36552a-a5b03736-7d0b2771_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:35.819038Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:35.819056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:35.819058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:35.819060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:35.819071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895769734095857:9321]
2025-09-30T14:54:35.819076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895769734095857:9321]
2025-09-30T14:54:35.819082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895769734095857:9321]
2025-09-30T14:54:35.819129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:35.819143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.819143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:35.819146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:35.819151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:35.819158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:35.819325Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:35.829052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1578 sessionId: src_id|182248f6-4f36552a-a5b03736-7d0b2771_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:35.832469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:35.873452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895769823851101:9180]
2025-09-30T14:54:35.873825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1577, pipe: [1:7555895769823851101:9180]
2025-09-30T14:54:35.940301Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:35.940860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:35.940879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:35.940903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895769823851101:9180], now have 1 active actors on pipe
2025-09-30T14:54:35.941183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895769823851101:9180]
2025-09-30T14:54:35.941220Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:35.941244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:35.941250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:35.941245Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:35.941746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|182248f6-4f36552a-a5b03736-7d0b2771_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:35.941763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|182248f6-4f36552a-a5b03736-7d0b2771_0] Write session will restart in 0.006112s
2025-09-30T14:54:35.941816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|182248f6-4f36552a-a5b03736-7d0b2771_0] Write session: Do CDS request
2025-09-30T14:54:35.941823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|182248f6-4f36552a-a5b03736-7d0b2771_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:35.941333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1578 reason: error at write: Disconnected sessionId: src_id|182248f6-4f36552a-a5b03736-7d0b2771_0
2025-09-30T14:54:35.941556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1578 sessionId: src_id|182248f6-4f36552a-a5b03736-7d0b2771_0 is DEAD
2025-09-30T14:54:35.948833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|182248f6-4f36552a-a5b03736-7d0b2771_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:35.948975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:35.948995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1579
2025-09-30T14:54:35.949188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1579 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:35.949233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1579 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:35.949247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1579 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:35.949253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:35.949872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1579 sessionId:  describe result for acl check
2025-09-30T14:54:35.949928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:35.949940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:35.949942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:35.949953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895769823851154:9611] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:35.951024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895769823851154:9611] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:35.954132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895769823851154:9611] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:35.957885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895769823851154:9611] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:35.957903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895769823851154:9611] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:35.957906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895769823851154:9611] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:35.957915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1579 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:35.958081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:35.960718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:35.960940Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:35.960951Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:35.960961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:35.961014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:35.961060Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895769734096024:9323]
2025-09-30T14:54:35.961804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:35.962183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:35.962232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:35.962574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:35.962637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:35.962644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:35.962645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:35.962646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:35.962648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:35.962649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:35.962650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:35.962652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:35.962653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:35.962654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:35.962656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.962657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.962658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.962659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:35.962660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:35.962666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:35.962677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:35.962682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:35.962687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:35.962691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:35.962696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:35.962701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:35.962705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:35.962710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:35.962715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:35.962720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.962724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.962729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.962732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:35.962736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:35.962744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:35.962753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:35.962760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:35.962766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:35.962772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:35.962778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:35.962783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:35.962790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:35.962795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:35.962801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:35.962811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:35.962818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:35.962823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:35.962834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:35.962838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:35.962843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:35.962849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:35.962855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:35.962860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:35.962867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:35.962872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.962883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.962888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.962898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.962903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.962910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.962915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:35.962920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:35.962926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:35.962932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:35.962980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:35.968849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:35.969983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:35.970004Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:35.970006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:35.970010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:35.970017Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1578 [2:7555895769734096024:9323]
2025-09-30T14:54:35.970035Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:35.970047Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:35.970050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:35.970052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:35.970054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:35.970066Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:35.970072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:35.970079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:35.970138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.970146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.970148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.970151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:35.970153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:35.970214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:35.970221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.970230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:35.970237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:35.970251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:35.970268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895769734096018:9323]
2025-09-30T14:54:35.970273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895769734096018:9323]
2025-09-30T14:54:35.970275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895769734096018:9323]
2025-09-30T14:54:35.970281Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:35.970291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895769823851102:2454], now have 1 active actors on pipe
2025-09-30T14:54:35.970292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:35.970295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:35.970297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895769823851338:9611], now have 1 active actors on pipe
2025-09-30T14:54:35.970298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:35.970304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:35.970312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:35.970315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:35.970341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895769734096018:9323]
2025-09-30T14:54:35.970353Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:35.970360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:35.970408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1578
2025-09-30T14:54:35.970448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1578
2025-09-30T14:54:35.970491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:35.970500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:35.970528Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96444bf0-9ced9320-47cac202-e17da92a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:35.970541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:35.970545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:35.970547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:35.970557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:35.970567Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:35.970581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:35.970741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:35.970748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:35.970762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:35.970867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1579 partition: 0 MaxSeqNo: 42 sessionId: src_id|96444bf0-9ced9320-47cac202-e17da92a_0
2025-09-30T14:54:35.971303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|182248f6-4f36552a-a5b03736-7d0b2771_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|96444bf0-9ced9320-47cac202-e17da92a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:35.974158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96444bf0-9ced9320-47cac202-e17da92a_0] Write session: try to update token
2025-09-30T14:54:35.974181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96444bf0-9ced9320-47cac202-e17da92a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:35.982994Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:35.983017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:35.983031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895769734096018:9323]
2025-09-30T14:54:35.983086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:35.983089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:35.983419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:35.983598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:35.983816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:35.984042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:35.984588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:35.984648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:35.989212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1579 sessionId: src_id|96444bf0-9ced9320-47cac202-e17da92a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:35.992024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:35.992252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:35.992274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:35.992310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:35.992403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:35.994969Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:35.994987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:35.994990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:35.994991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:35.995003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895769734096018:9323]
2025-09-30T14:54:35.995008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895769734096018:9323]
2025-09-30T14:54:35.995012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895769734096018:9323]
2025-09-30T14:54:35.995065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:35.995074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:35.995077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:35.995081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:35.995081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:35.995085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:35.995217Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:36.041421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895774118818647:9180]
2025-09-30T14:54:36.041719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1578, pipe: [1:7555895774118818647:9180]
2025-09-30T14:54:36.114496Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:36.123112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:36.123146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:36.123359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:36.123428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:36.123497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:36.123566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:36.123615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:36.123626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:36.123701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:36.123773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:36.123845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:36.123919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:36.123971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:36.123980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:36.124056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:36.124122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:36.124193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:36.124259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:36.124304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:36.124311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:36.124382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:36.124473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:36.124542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:36.124603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:36.124653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:36.124660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:36.124731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:36.124796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:36.124862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:36.124931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:36.124990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:36.124997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:36.125068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:36.125131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:36.125200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:36.127134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:36.127164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:36.127174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895774118818647:9180]
2025-09-30T14:54:36.127195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1579 reason: error at write: Disconnected sessionId: src_id|96444bf0-9ced9320-47cac202-e17da92a_0
2025-09-30T14:54:36.127203Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:36.125263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:36.125319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:36.125323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:36.125392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:36.125460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:36.125525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:36.125606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:36.125800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:36.125806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:36.125875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:36.125930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:36.125990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:36.126053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:36.126098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:36.126101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:36.126168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:36.126239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:36.126304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:36.126365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:36.126431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:36.126434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:36.126505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:36.126558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:36.126627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:36.126688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:36.126734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:36.126737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:36.126812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895774118818647:9180], now have 1 active actors on pipe
2025-09-30T14:54:36.127438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1579 sessionId: src_id|96444bf0-9ced9320-47cac202-e17da92a_0 is DEAD
2025-09-30T14:54:36.127700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96444bf0-9ced9320-47cac202-e17da92a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:36.127725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96444bf0-9ced9320-47cac202-e17da92a_0] Write session will restart in 0.007565s
2025-09-30T14:54:36.127757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96444bf0-9ced9320-47cac202-e17da92a_0] Write session: Do CDS request
2025-09-30T14:54:36.127764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96444bf0-9ced9320-47cac202-e17da92a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:36.128098Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:36.136977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96444bf0-9ced9320-47cac202-e17da92a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:36.137128Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:36.137147Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1580
2025-09-30T14:54:36.137390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1580 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:36.137447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1580 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:36.137458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1580 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:36.137464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:36.138034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1580 sessionId:  describe result for acl check
2025-09-30T14:54:36.138084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:36.138095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:36.138098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:36.138106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895774118818841:9616] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:36.138983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895774118818841:9616] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:36.141682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895774118818841:9616] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:36.142630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:36.143665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:36.143875Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:36.143887Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:36.143897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:36.143947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:36.143984Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895774029063482:9325]
2025-09-30T14:54:36.144639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895774118818841:9616] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:36.144656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895774118818841:9616] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:36.144661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895774118818841:9616] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:36.144672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1580 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:36.144730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:36.145023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:36.145101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:36.145503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:36.145570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:36.145577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:36.145578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:36.145579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:36.145581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:36.145591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:36.145593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:36.145594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:36.145596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:36.145597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:36.145598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.145600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:36.145601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:36.145602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:36.145604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:36.145609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:36.145621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:36.145626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:36.145630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:36.145635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:36.145639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:36.145643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:36.145647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:36.145650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:36.145654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:36.145657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.145661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:36.145665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:36.145668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:36.145672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:36.145680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:36.145687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:36.145693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:36.145699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:36.145704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:36.145709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:36.145713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:36.145718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:36.145723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:36.145728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:36.145733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:36.145738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:36.145744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:36.145749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:36.145753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:36.145759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:36.145764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:36.145770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:36.145778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:36.145786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:36.145807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.145814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.145819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:36.145829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:36.145835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:36.145840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:36.145845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:36.145854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:36.145859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:36.145865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:36.145917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:36.151757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:36.152770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:36.152788Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:36.152791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:36.152795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:36.152802Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1579 [2:7555895774029063482:9325]
2025-09-30T14:54:36.152832Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:36.152849Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:36.152858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:36.152862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:36.152864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:36.152890Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:36.152906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:36.152913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:36.152997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.152999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:36.153304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1579
2025-09-30T14:54:36.153002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:36.153351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1579
2025-09-30T14:54:36.153006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:36.153008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:36.153086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:36.153090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.153103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:36.153113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:36.153128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:36.153146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895774029063477:9325]
2025-09-30T14:54:36.153148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895774029063477:9325]
2025-09-30T14:54:36.153151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895774029063477:9325]
2025-09-30T14:54:36.153160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:36.153178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:36.153193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:36.153197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:36.153207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895774118818892:9616], now have 1 active actors on pipe
2025-09-30T14:54:36.153211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895774118818655:2454], now have 1 active actors on pipe
2025-09-30T14:54:36.153250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895774029063477:9325]
2025-09-30T14:54:36.153253Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:36.153269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:36.153273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:36.153276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:36.153283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:36.153418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:36.153422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:36.153448Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18b10aa6-3888ff1f-ab366c9a-e5e264cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:36.153457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:36.153461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:36.153463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:36.153475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:36.153485Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:36.153499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:36.153683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:36.153698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:36.153711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:36.153818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1580 partition: 0 MaxSeqNo: 42 sessionId: src_id|18b10aa6-3888ff1f-ab366c9a-e5e264cb_0
2025-09-30T14:54:36.154324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96444bf0-9ced9320-47cac202-e17da92a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|18b10aa6-3888ff1f-ab366c9a-e5e264cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:36.157966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18b10aa6-3888ff1f-ab366c9a-e5e264cb_0] Write session: try to update token
2025-09-30T14:54:36.157993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18b10aa6-3888ff1f-ab366c9a-e5e264cb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:36.166024Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:36.166044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:36.166048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:36.166050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:36.166061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895774029063477:9325]
2025-09-30T14:54:36.166066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895774029063477:9325]
2025-09-30T14:54:36.166070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895774029063477:9325]
2025-09-30T14:54:36.166112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:36.166116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:36.166119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.166122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:36.166122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:36.166125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:36.166267Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:36.179621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1580 sessionId: src_id|18b10aa6-3888ff1f-ab366c9a-e5e264cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:36.182986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:36.227320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895774118818906:9180]
2025-09-30T14:54:36.231985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1579, pipe: [1:7555895774118818906:9180]
2025-09-30T14:54:36.281554Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:36.282076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:36.282086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:36.282106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895774118818906:9180], now have 1 active actors on pipe
2025-09-30T14:54:36.282358Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:36.282413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:36.282429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:36.282518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1580 reason: error at write: Disconnected sessionId: src_id|18b10aa6-3888ff1f-ab366c9a-e5e264cb_0
2025-09-30T14:54:36.282715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1580 sessionId: src_id|18b10aa6-3888ff1f-ab366c9a-e5e264cb_0 is DEAD
2025-09-30T14:54:36.282774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895774118818906:9180]
2025-09-30T14:54:36.282798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:36.283190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18b10aa6-3888ff1f-ab366c9a-e5e264cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:36.283201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18b10aa6-3888ff1f-ab366c9a-e5e264cb_0] Write session will restart in 0.007649s
2025-09-30T14:54:36.283233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18b10aa6-3888ff1f-ab366c9a-e5e264cb_0] Write session: Do CDS request
2025-09-30T14:54:36.283259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18b10aa6-3888ff1f-ab366c9a-e5e264cb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:36.291846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18b10aa6-3888ff1f-ab366c9a-e5e264cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:36.291976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:36.292007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1581
2025-09-30T14:54:36.292227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1581 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:36.292269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1581 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:36.292275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1581 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:36.292279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:36.292852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1581 sessionId:  describe result for acl check
2025-09-30T14:54:36.292889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:36.292891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:36.292893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:36.292900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895774118819079:9620] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:36.293487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895774118819079:9620] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:36.295647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895774118819079:9620] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:36.300392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:36.300364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895774118819079:9620] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:36.300381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895774118819079:9620] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:36.300385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895774118819079:9620] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:36.300403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1581 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:36.302486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:36.303052Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:36.303070Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:36.303101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:36.303290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:36.303338Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895774029063662:9327]
2025-09-30T14:54:36.304036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:36.304519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:36.304568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:36.304897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:36.304982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:36.304984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:36.304985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:36.304986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:36.304988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:36.304989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:36.304990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:36.304995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:36.304996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:36.304998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:36.304999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.305000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:36.305002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:36.305003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:36.305004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:36.305010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:36.305022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:36.305027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:36.305031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:36.305035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:36.305040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:36.305044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:36.305048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:36.305052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:36.305057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:36.305061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.305065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:36.305069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:36.305074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:36.305078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:36.305086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:36.305095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:36.305101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:36.305107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:36.305112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:36.305118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:36.305122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:36.305128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:36.305137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:36.305143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:36.305147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:36.305152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:36.305168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:36.305173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:36.305178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:36.305185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:36.305194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:36.305200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:36.305204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:36.305210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:36.305214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.305220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.305224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:36.305230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:36.305235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:36.305240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:36.305245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:36.305250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:36.305255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:36.305260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:36.305307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:36.312578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:36.313782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:36.313819Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:36.313823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:36.313828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:36.313837Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1580 [2:7555895774029063662:9327]
2025-09-30T14:54:36.313858Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:36.313879Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:36.313885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:36.313888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:36.313896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:36.313916Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:36.313925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:36.313933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:36.314113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.314116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:36.314119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:36.314122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:36.314125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:36.314218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:36.314221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.314237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:36.314248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:36.314264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:36.314288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895774029063649:9327]
2025-09-30T14:54:36.314291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895774029063649:9327]
2025-09-30T14:54:36.314293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895774029063649:9327]
2025-09-30T14:54:36.314308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:36.314324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:36.314326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895774118818907:2454], now have 1 active actors on pipe
2025-09-30T14:54:36.314328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:36.314330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:36.314333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895774118819144:9620], now have 1 active actors on pipe
2025-09-30T14:54:36.314340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:36.314355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:36.314358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:36.314408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895774029063649:9327]
2025-09-30T14:54:36.314419Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:36.314424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:36.314591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:36.314598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:36.314635Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83700bfb-aac8e767-261bf959-52507f95_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:36.314644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:36.314649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:36.314652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:36.314664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:36.314677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:36.314707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:36.314883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:36.314892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:36.314909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:36.314456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1580
2025-09-30T14:54:36.314497Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1580
2025-09-30T14:54:36.315148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1581 partition: 0 MaxSeqNo: 42 sessionId: src_id|83700bfb-aac8e767-261bf959-52507f95_0
2025-09-30T14:54:36.315592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18b10aa6-3888ff1f-ab366c9a-e5e264cb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|83700bfb-aac8e767-261bf959-52507f95_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:36.319199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83700bfb-aac8e767-261bf959-52507f95_0] Write session: try to update token
2025-09-30T14:54:36.319220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83700bfb-aac8e767-261bf959-52507f95_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:36.331357Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:36.331378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:36.331392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895774029063649:9327]
2025-09-30T14:54:36.331448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:36.331476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:36.331681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:36.331887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:36.332073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:36.332309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:36.332570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:36.332614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:36.338762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1581 sessionId: src_id|83700bfb-aac8e767-261bf959-52507f95_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:36.342260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:36.343444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:36.343473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:36.343497Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:36.343501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:36.343504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:36.343506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:36.343521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895774029063649:9327]
2025-09-30T14:54:36.343530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895774029063649:9327]
2025-09-30T14:54:36.343536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895774029063649:9327]
2025-09-30T14:54:36.343587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:36.343601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:36.343602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:36.343607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:36.343608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.343611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:36.343791Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:36.382433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895774118819178:9180]
2025-09-30T14:54:36.382849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1580, pipe: [1:7555895774118819178:9180]
2025-09-30T14:54:36.469467Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:36.469962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:36.470029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895774118819178:9180], now have 1 active actors on pipe
2025-09-30T14:54:36.470175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:36.470786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895774118819178:9180]
2025-09-30T14:54:36.470820Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:36.483947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:36.483963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:36.483989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1581 reason: error at write: Disconnected sessionId: src_id|83700bfb-aac8e767-261bf959-52507f95_0
2025-09-30T14:54:36.484527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83700bfb-aac8e767-261bf959-52507f95_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:36.484540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83700bfb-aac8e767-261bf959-52507f95_0] Write session will restart in 0.007274s
2025-09-30T14:54:36.484566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83700bfb-aac8e767-261bf959-52507f95_0] Write session: Do CDS request
2025-09-30T14:54:36.484574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83700bfb-aac8e767-261bf959-52507f95_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:36.484120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1581 sessionId: src_id|83700bfb-aac8e767-261bf959-52507f95_0 is DEAD
2025-09-30T14:54:36.495881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83700bfb-aac8e767-261bf959-52507f95_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:36.497054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:36.497072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1582
2025-09-30T14:54:36.497916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1582 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:36.497945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1582 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:36.497950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1582 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:36.497954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:36.498535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1582 sessionId:  describe result for acl check
2025-09-30T14:54:36.498560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:36.498561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:36.498563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:36.498569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895774118819263:9631] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:36.499298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895774118819263:9631] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:36.502429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895774118819263:9631] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:36.505767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895774118819263:9631] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:36.505784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895774118819263:9631] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:36.505795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895774118819263:9631] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:36.505803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1582 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:36.508439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:36.510422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:36.510613Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:36.510623Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:36.510631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:36.510673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:36.510733Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895774029063864:9343]
2025-09-30T14:54:36.511263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:36.511598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:36.511640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:36.511952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:36.512016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:36.512025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:36.512026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:36.512027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:36.512029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:36.512030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:36.512031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:36.512033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:36.512034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:36.512035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:36.512036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.512037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:36.512038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:36.512039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:36.512041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:36.512047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:36.512057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:36.512062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:36.512066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:36.512070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:36.512074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:36.512078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:36.512082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:36.512086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:36.512091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:36.512095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.512099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:36.512104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:36.512108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:36.512112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:36.512120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:36.512128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:36.512134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:36.512140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:36.512145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:36.512151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:36.512156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:36.512162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:36.512166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:36.512172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:36.512177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:36.512182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:36.512187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:36.512193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:36.512197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:36.512203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:36.512208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:36.512214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:36.512219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:36.512224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:36.512230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.512235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.512240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:36.512246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:36.512251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:36.512257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:36.512261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:36.512266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:36.512272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:36.512277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:36.512321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:36.518170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:36.519006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:36.519025Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:36.519028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:36.519033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:36.519041Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1581 [2:7555895774029063864:9343]
2025-09-30T14:54:36.519059Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:36.519076Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:36.519081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:36.519084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:36.519099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:36.519117Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:36.519128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:36.519138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:36.519192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.519198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:36.519200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:36.519204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:36.519207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:36.519296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:36.519309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.519321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:36.519334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:36.519352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:36.519367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895774029063859:9343]
2025-09-30T14:54:36.519375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895774029063859:9343]
2025-09-30T14:54:36.519377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895774029063859:9343]
2025-09-30T14:54:36.519386Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:36.519397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:36.519400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:36.519403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:36.519404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895774118819426:9631], now have 1 active actors on pipe
2025-09-30T14:54:36.519413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:36.519430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:36.519434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:36.519440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895774118819181:2454], now have 1 active actors on pipe
2025-09-30T14:54:36.519472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895774029063859:9343]
2025-09-30T14:54:36.519485Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:36.519529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:36.519509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1581
2025-09-30T14:54:36.519980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1581
2025-09-30T14:54:36.520043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:36.520054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:36.520078Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|46824bba-48ad8264-5fc4cbd-faba8595_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:36.520093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:36.520096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:36.520099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:36.520109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:36.520119Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:36.520134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:36.520308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:36.520316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:36.520329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:36.520429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1582 partition: 0 MaxSeqNo: 42 sessionId: src_id|46824bba-48ad8264-5fc4cbd-faba8595_0
2025-09-30T14:54:36.520836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83700bfb-aac8e767-261bf959-52507f95_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|46824bba-48ad8264-5fc4cbd-faba8595_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:36.524020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46824bba-48ad8264-5fc4cbd-faba8595_0] Write session: try to update token
2025-09-30T14:54:36.524039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46824bba-48ad8264-5fc4cbd-faba8595_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:36.532305Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:36.532328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:36.532338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895774029063859:9343]
2025-09-30T14:54:36.532385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:36.532386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:36.532572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:36.532738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:36.532900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:36.533056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:36.533270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:36.533319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:36.540491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1582 sessionId: src_id|46824bba-48ad8264-5fc4cbd-faba8595_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:36.543327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:36.543562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:36.543585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:36.543620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:36.543711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:36.547917Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:36.547938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:36.547941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:36.547944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:36.547955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895774029063859:9343]
2025-09-30T14:54:36.547959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895774029063859:9343]
2025-09-30T14:54:36.547964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895774029063859:9343]
2025-09-30T14:54:36.548007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:36.548015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.548018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:36.548017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:36.548034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:36.548043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:36.548182Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:36.570827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895774118819443:9180]
2025-09-30T14:54:36.571079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1581, pipe: [1:7555895774118819443:9180]
2025-09-30T14:54:36.668104Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:36.676980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:36.677016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:36.677204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:36.677275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:36.677345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:36.677415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:36.677464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:36.677474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:36.677552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:36.677618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:36.677684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:36.677755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:36.677817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:36.677825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:36.677900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:36.677966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:36.678033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:36.678102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:36.678151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:36.678158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:36.678227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:36.678293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:36.678361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:36.678429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:36.678479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:36.678488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:36.678558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:36.678622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:36.678693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:36.678760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:36.678808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:36.678816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:36.678888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:36.678954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:36.679021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:36.679088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:36.679139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:36.679147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:36.679217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:36.679310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:36.679384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:36.679452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:36.679501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:36.679508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:36.679579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:36.679643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:36.679708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:36.679775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:36.679819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:36.679831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:36.679899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:36.679961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:36.680027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:36.680100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:36.680147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:36.680155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:36.680226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:36.681369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46824bba-48ad8264-5fc4cbd-faba8595_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:36.681382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46824bba-48ad8264-5fc4cbd-faba8595_0] Write session will restart in 0.009317s
2025-09-30T14:54:36.681406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46824bba-48ad8264-5fc4cbd-faba8595_0] Write session: Do CDS request
2025-09-30T14:54:36.681413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46824bba-48ad8264-5fc4cbd-faba8595_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:36.680884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895774118819443:9180]
2025-09-30T14:54:36.680930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:36.680933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:36.680971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1582 reason: error at write: Disconnected sessionId: src_id|46824bba-48ad8264-5fc4cbd-faba8595_0
2025-09-30T14:54:36.681178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1582 sessionId: src_id|46824bba-48ad8264-5fc4cbd-faba8595_0 is DEAD
2025-09-30T14:54:36.681568Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:36.680294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:36.680367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:36.680428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:36.680471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:36.680474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:36.680547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895774118819443:9180], now have 1 active actors on pipe
2025-09-30T14:54:36.682036Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:36.691906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46824bba-48ad8264-5fc4cbd-faba8595_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:36.695692Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:36.695707Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1583
2025-09-30T14:54:36.695905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1583 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:36.695940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1583 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:36.695947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1583 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:36.695951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:36.699681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1583 sessionId:  describe result for acl check
2025-09-30T14:54:36.699727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:36.699732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:36.699734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:36.699741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895774118819588:9637] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:36.700345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895774118819588:9637] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:36.711029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895774118819588:9637] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:36.716300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895774118819588:9637] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:36.716321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895774118819588:9637] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:36.716326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895774118819588:9637] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:36.716336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1583 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:36.716330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:36.718456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:36.718664Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:36.718679Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:36.718688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:36.718743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:36.718786Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895774029064032:9345]
2025-09-30T14:54:36.719515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:36.719900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:36.719947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:36.720304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:36.720368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:36.720374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:36.720376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:36.720378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:36.720379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:36.720381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:36.720382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:36.720384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:36.720385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:36.720387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:36.720388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.720390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:36.720392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:36.720393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:36.720395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:36.720401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:36.720413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:36.720418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:36.720423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:36.720427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:36.720432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:36.720437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:36.720442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:36.720446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:36.720450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:36.720455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.720459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:36.720464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:36.720470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:36.720474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:36.720483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:36.720492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:36.720498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:36.720504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:36.720510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:36.720516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:36.720526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:36.720532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:36.720538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:36.720548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:36.720553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:36.720564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:36.720569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:36.720580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:36.720586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:36.720597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:36.720603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:36.720611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:36.720616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:36.720622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:36.720647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.720658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.720663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:36.720669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:36.720680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:36.720686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:36.720695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:36.720701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:36.720712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:36.720718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:36.720772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:36.727053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:36.728212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:36.728230Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:36.728234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:36.728238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:36.728246Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1582 [2:7555895774029064032:9345]
2025-09-30T14:54:36.728262Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:36.728279Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:36.728283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:36.728286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:36.728289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:36.728305Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:36.728313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:36.728321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:36.728384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.728386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:36.728389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:36.728393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:36.728395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:36.728466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:36.728469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.728484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:36.728498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:36.728516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:36.728535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895774029064026:9345]
2025-09-30T14:54:36.728538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895774029064026:9345]
2025-09-30T14:54:36.728540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895774029064026:9345]
2025-09-30T14:54:36.728557Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:36.728571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:36.728587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:36.728591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:36.728611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:36.728615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:36.728617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:36.728624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895774029064026:9345]
2025-09-30T14:54:36.728627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:36.728687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:36.728995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895774118819448:2454], now have 1 active actors on pipe
2025-09-30T14:54:36.729003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895774118819686:9637], now have 1 active actors on pipe
2025-09-30T14:54:36.729016Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1582
2025-09-30T14:54:36.729062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1582
2025-09-30T14:54:36.729320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:36.729329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:36.729359Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8925e72-38fd459f-d25f2c47-9c3d9064_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:36.729367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:36.729372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:36.729375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:36.729387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:36.729399Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:36.729415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:36.729677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:36.729683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:36.729698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:36.729831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1583 partition: 0 MaxSeqNo: 42 sessionId: src_id|d8925e72-38fd459f-d25f2c47-9c3d9064_0
2025-09-30T14:54:36.731430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46824bba-48ad8264-5fc4cbd-faba8595_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d8925e72-38fd459f-d25f2c47-9c3d9064_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:36.734841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8925e72-38fd459f-d25f2c47-9c3d9064_0] Write session: try to update token
2025-09-30T14:54:36.734865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8925e72-38fd459f-d25f2c47-9c3d9064_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:36.743900Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:36.743920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:36.743923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:36.743925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:36.743934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895774029064026:9345]
2025-09-30T14:54:36.743937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895774029064026:9345]
2025-09-30T14:54:36.743941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895774029064026:9345]
2025-09-30T14:54:36.743980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:36.743986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.743989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:36.744119Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:36.747417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:36.747435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:36.747440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:36.764991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1583 sessionId: src_id|d8925e72-38fd459f-d25f2c47-9c3d9064_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:36.768049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:36.783381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895774118819699:9180]
2025-09-30T14:54:36.787604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1582, pipe: [1:7555895774118819699:9180]
2025-09-30T14:54:36.870946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:36.870964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:36.871013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895774118819699:9180]
2025-09-30T14:54:36.871037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1583 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d8925e72-38fd459f-d25f2c47-9c3d9064_0
2025-09-30T14:54:36.871225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1583 sessionId: src_id|d8925e72-38fd459f-d25f2c47-9c3d9064_0 is DEAD
2025-09-30T14:54:36.869146Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:36.869658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:36.869668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:36.869689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895774118819699:9180], now have 1 active actors on pipe
2025-09-30T14:54:36.870394Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:36.871587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8925e72-38fd459f-d25f2c47-9c3d9064_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:36.871597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8925e72-38fd459f-d25f2c47-9c3d9064_0] Write session will restart in 0.009829s
2025-09-30T14:54:36.871620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8925e72-38fd459f-d25f2c47-9c3d9064_0] Write session: Do CDS request
2025-09-30T14:54:36.871626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8925e72-38fd459f-d25f2c47-9c3d9064_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:36.882819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8925e72-38fd459f-d25f2c47-9c3d9064_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:36.883225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:36.883256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1584
2025-09-30T14:54:36.883514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1584 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:36.883544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1584 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:36.883552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1584 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:36.883556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:36.884006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1584 sessionId:  describe result for acl check
2025-09-30T14:54:36.884038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:36.884040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:36.884042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:36.884049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895774118819754:9641] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:36.884602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895774118819754:9641] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:36.888182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895774118819754:9641] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:36.891684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895774118819754:9641] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:36.891698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895774118819754:9641] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:36.891701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895774118819754:9641] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:36.891710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1584 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:36.897102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:36.898956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:36.899188Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:36.899200Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:36.899211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:36.899282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:36.899329Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895774029064203:9348]
2025-09-30T14:54:36.899983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:36.900311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:36.900355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:36.900717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:36.900779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:36.900785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:36.900787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:36.900788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:36.900789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:36.900791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:36.900792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:36.900793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:36.900795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:36.900796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:36.900797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.900799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:36.900800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:36.900802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:36.900803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:36.900809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:36.900820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:36.900825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:36.900829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:36.900834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:36.900838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:36.900843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:36.900847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:36.900851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:36.900856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:36.900860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.900864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:36.900868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:36.900872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:36.900876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:36.900886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:36.900900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:36.900911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:36.900919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:36.900924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:36.900929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:36.900934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:36.900939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:36.900944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:36.900950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:36.900961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:36.900967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:36.900976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:36.900981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:36.900990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:36.900994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:36.901002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:36.901012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:36.901016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:36.901021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:36.901025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.901031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.901035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:36.901040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:36.901045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:36.901050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:36.901055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:36.901060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:36.901064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:36.901070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:36.901113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:36.906743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:36.907682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:36.907699Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:36.907703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:36.907707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:36.907715Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1583 [2:7555895774029064203:9348]
2025-09-30T14:54:36.907733Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:36.907749Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:36.907753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:36.907756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:36.907758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:36.907775Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:36.907782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:36.907789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:36.907850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.907859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:36.907862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:36.907866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:36.907869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:36.907940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:36.907950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.907964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:36.907975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:36.907991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:36.908010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895774118819876:9641], now have 1 active actors on pipe
2025-09-30T14:54:36.908019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895774118819701:2454], now have 1 active actors on pipe
2025-09-30T14:54:36.908026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895774029064198:9348]
2025-09-30T14:54:36.908030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895774029064198:9348]
2025-09-30T14:54:36.908032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895774029064198:9348]
2025-09-30T14:54:36.908047Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:36.908065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:36.908084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:36.908127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:36.908137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1583
2025-09-30T14:54:36.908171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895774029064198:9348]
2025-09-30T14:54:36.908141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1583
2025-09-30T14:54:36.908179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:36.908182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:36.908187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:36.908190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:36.908197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:36.908521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:36.908535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:36.908574Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6eed37d-a6106689-5be6702c-a98c9646_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:36.908590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:36.908594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:36.908596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:36.908608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:36.908619Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:36.908635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:36.908850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:36.908864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:36.908885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:36.909765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1584 partition: 0 MaxSeqNo: 42 sessionId: src_id|6eed37d-a6106689-5be6702c-a98c9646_0
2025-09-30T14:54:36.910184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8925e72-38fd459f-d25f2c47-9c3d9064_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6eed37d-a6106689-5be6702c-a98c9646_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:36.913245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6eed37d-a6106689-5be6702c-a98c9646_0] Write session: try to update token
2025-09-30T14:54:36.913264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6eed37d-a6106689-5be6702c-a98c9646_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:36.921093Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:36.921114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:36.921117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:36.921119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:36.921129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895774029064198:9348]
2025-09-30T14:54:36.921134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895774029064198:9348]
2025-09-30T14:54:36.921138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895774029064198:9348]
2025-09-30T14:54:36.921180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:36.921187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:36.921190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:36.921201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:36.921208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:36.921213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:36.921325Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:36.945287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1584 sessionId: src_id|6eed37d-a6106689-5be6702c-a98c9646_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:36.948160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:36.971240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895774118819955:9180]
2025-09-30T14:54:36.973946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1583, pipe: [1:7555895774118819955:9180]
2025-09-30T14:54:37.041698Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:37.042153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:37.042174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:37.042194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895774118819955:9180], now have 1 active actors on pipe
2025-09-30T14:54:37.042412Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:37.042439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:37.042443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:37.042448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:37.042496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895774118819955:9180]
2025-09-30T14:54:37.042527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1584 reason: error at write: Disconnected sessionId: src_id|6eed37d-a6106689-5be6702c-a98c9646_0
2025-09-30T14:54:37.042708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1584 sessionId: src_id|6eed37d-a6106689-5be6702c-a98c9646_0 is DEAD
2025-09-30T14:54:37.043105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eed37d-a6106689-5be6702c-a98c9646_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:37.043116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eed37d-a6106689-5be6702c-a98c9646_0] Write session will restart in 0.008841s
2025-09-30T14:54:37.043139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eed37d-a6106689-5be6702c-a98c9646_0] Write session: Do CDS request
2025-09-30T14:54:37.043148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eed37d-a6106689-5be6702c-a98c9646_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:37.052778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6eed37d-a6106689-5be6702c-a98c9646_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:37.053129Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:37.053145Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1585
2025-09-30T14:54:37.053270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1585 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:37.053306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1585 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:37.053317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1585 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:37.053322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:37.054135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1585 sessionId:  describe result for acl check
2025-09-30T14:54:37.054168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:37.054170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:37.054173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:37.054178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895778413787338:9645] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:37.054736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895778413787338:9645] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:37.061936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895778413787338:9645] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:37.064928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895778413787338:9645] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:37.064945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895778413787338:9645] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:37.064949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895778413787338:9645] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:37.064958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1585 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:37.067333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:37.069169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:37.069391Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:37.069395Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:37.069405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:37.069456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:37.069494Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895778324031668:9350]
2025-09-30T14:54:37.070163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:37.070482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:37.070519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:37.070844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:37.070896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:37.070898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:37.070899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:37.070900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:37.070901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:37.070902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:37.070903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:37.070905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:37.070906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:37.070907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:37.070908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.070910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.070911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.070912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:37.070913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:37.070918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:37.070928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:37.070931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:37.070935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:37.070939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:37.070943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:37.070946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:37.070949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:37.070952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:37.070958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:37.070961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.070964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.070967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.070970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:37.070974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:37.070981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:37.070989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:37.070994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:37.070999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:37.071003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:37.071008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:37.071014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:37.071018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:37.071023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:37.071027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:37.071032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:37.071036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:37.071041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:37.071046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:37.071050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:37.071054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:37.071059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:37.071063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:37.071067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:37.071073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:37.071078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.071082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.071086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.071090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.071095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.071099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.071103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:37.071108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:37.071112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:37.071116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:37.071200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:37.077481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:37.078446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:37.078469Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:37.078473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:37.078477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:37.078484Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1584 [2:7555895778324031668:9350]
2025-09-30T14:54:37.078503Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:37.078522Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:37.078530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:37.078533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:37.078536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:37.078554Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:37.078560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:37.078567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:37.078631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.078640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.078642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.078646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:37.078649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:37.078727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:37.078736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.078751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.078763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.078779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:37.078800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895778413787252:2454], now have 1 active actors on pipe
2025-09-30T14:54:37.078810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895778413787490:9645], now have 1 active actors on pipe
2025-09-30T14:54:37.078817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895778324031663:9350]
2025-09-30T14:54:37.078820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895778324031663:9350]
2025-09-30T14:54:37.078822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895778324031663:9350]
2025-09-30T14:54:37.078835Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:37.078850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:37.078853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:37.078857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:37.078859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:37.078870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:37.078873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:37.078915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895778324031663:9350]
2025-09-30T14:54:37.078929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:37.078961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:37.079302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1584
2025-09-30T14:54:37.079348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1584
2025-09-30T14:54:37.079934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1585 partition: 0 MaxSeqNo: 42 sessionId: src_id|95cf25e7-7329467-46edd7d8-a38e3634_0
2025-09-30T14:54:37.080305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eed37d-a6106689-5be6702c-a98c9646_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|95cf25e7-7329467-46edd7d8-a38e3634_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:37.079449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:37.079464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:37.079490Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95cf25e7-7329467-46edd7d8-a38e3634_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:37.079498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:37.079502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:37.079517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:37.079528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:37.079539Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:37.079555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:37.079783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:37.079791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:37.079815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:37.083460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95cf25e7-7329467-46edd7d8-a38e3634_0] Write session: try to update token
2025-09-30T14:54:37.083479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95cf25e7-7329467-46edd7d8-a38e3634_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:37.095270Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:37.095290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:37.095293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:37.095295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:37.095306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895778324031663:9350]
2025-09-30T14:54:37.095311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895778324031663:9350]
2025-09-30T14:54:37.095317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895778324031663:9350]
2025-09-30T14:54:37.095361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:37.095369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.095369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:37.095372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:37.095376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:37.095381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:37.095524Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:37.104930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1585 sessionId: src_id|95cf25e7-7329467-46edd7d8-a38e3634_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:37.107912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:37.142739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895778413787512:9180]
2025-09-30T14:54:37.143109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1584, pipe: [1:7555895778413787512:9180]
2025-09-30T14:54:37.212952Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:37.213636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:37.213655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:37.213678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895778413787512:9180], now have 1 active actors on pipe
2025-09-30T14:54:37.214139Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:37.214477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895778413787512:9180]
2025-09-30T14:54:37.214509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:37.214547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:37.214621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1585 reason: status is not ok: tablet will be restarted right now sessionId: src_id|95cf25e7-7329467-46edd7d8-a38e3634_0
2025-09-30T14:54:37.214816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1585 sessionId: src_id|95cf25e7-7329467-46edd7d8-a38e3634_0 is DEAD
2025-09-30T14:54:37.214943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95cf25e7-7329467-46edd7d8-a38e3634_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:37.214951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95cf25e7-7329467-46edd7d8-a38e3634_0] Write session will restart in 0.007737s
2025-09-30T14:54:37.214975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95cf25e7-7329467-46edd7d8-a38e3634_0] Write session: Do CDS request
2025-09-30T14:54:37.214992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95cf25e7-7329467-46edd7d8-a38e3634_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:37.223835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95cf25e7-7329467-46edd7d8-a38e3634_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:37.224070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:37.224088Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1586
2025-09-30T14:54:37.224273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1586 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:37.224320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1586 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:37.224330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1586 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:37.224335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:37.224840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1586 sessionId:  describe result for acl check
2025-09-30T14:54:37.224908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:37.224910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:37.224915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:37.224921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895778413787608:9650] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:37.225577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895778413787608:9650] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:37.227570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895778413787608:9650] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:37.230172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:37.230564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895778413787608:9650] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:37.230586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895778413787608:9650] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:37.230590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895778413787608:9650] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:37.230598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1586 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:37.231753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:37.231948Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:37.231960Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:37.231970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:37.232019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:37.232061Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895778324031838:9352]
2025-09-30T14:54:37.232737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:37.233006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:37.233048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:37.233402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:37.233460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:37.233466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:37.233468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:37.233469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:37.233470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:37.233472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:37.233473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:37.233474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:37.233476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:37.233477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:37.233478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.233479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.233480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.233482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:37.233483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:37.233488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:37.233499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:37.233503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:37.233507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:37.233511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:37.233516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:37.233520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:37.233524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:37.233528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:37.233533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:37.233537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.233541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.233545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.233549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:37.233553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:37.233562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:37.233570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:37.233575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:37.233581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:37.233586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:37.233592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:37.233596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:37.233602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:37.233606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:37.233612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:37.233617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:37.233622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:37.233642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:37.233648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:37.233653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:37.233658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:37.233663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:37.233668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:37.233673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:37.233679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:37.233683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.233689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.233694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.233700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.233705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.233711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.233715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:37.233720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:37.233725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:37.233730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:37.233775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:37.239605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:37.240602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:37.240618Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:37.240620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:37.240623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:37.240628Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1585 [2:7555895778324031838:9352]
2025-09-30T14:54:37.240641Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:37.240654Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:37.240657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:37.240659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:37.240661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:37.240677Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:37.240684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:37.240691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:37.240757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.240765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.240768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.240772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:37.240774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:37.240847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:37.240856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.240869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.240887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.240899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:37.240918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895778413787759:9650], now have 1 active actors on pipe
2025-09-30T14:54:37.240927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895778413787516:2454], now have 1 active actors on pipe
2025-09-30T14:54:37.240934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895778324031832:9352]
2025-09-30T14:54:37.240936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895778324031832:9352]
2025-09-30T14:54:37.240938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895778324031832:9352]
2025-09-30T14:54:37.240957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:37.240978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:37.240981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:37.240985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:37.240987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:37.240995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:37.240984Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1585
2025-09-30T14:54:37.241005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1585
2025-09-30T14:54:37.240999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:37.241037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895778324031832:9352]
2025-09-30T14:54:37.241046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:37.241052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:37.241066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:37.241070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:37.241120Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e315a8f-e2bc717a-bfb5726-dedfc3e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:37.241132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:37.241136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:37.241138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:37.241147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:37.241161Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:37.241183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:37.241365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:37.241375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:37.241391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:37.241612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1586 partition: 0 MaxSeqNo: 42 sessionId: src_id|e315a8f-e2bc717a-bfb5726-dedfc3e7_0
2025-09-30T14:54:37.242049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95cf25e7-7329467-46edd7d8-a38e3634_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e315a8f-e2bc717a-bfb5726-dedfc3e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:37.244909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e315a8f-e2bc717a-bfb5726-dedfc3e7_0] Write session: try to update token
2025-09-30T14:54:37.244931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e315a8f-e2bc717a-bfb5726-dedfc3e7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:37.254336Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:37.254363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:37.254366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:37.254368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:37.254381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895778324031832:9352]
2025-09-30T14:54:37.254391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895778324031832:9352]
2025-09-30T14:54:37.254397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895778324031832:9352]
2025-09-30T14:54:37.254452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:37.254457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:37.254466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:37.254469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.254471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:37.254473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:37.254654Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:37.260444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1586 sessionId: src_id|e315a8f-e2bc717a-bfb5726-dedfc3e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:37.263424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:37.314760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895778413787772:9180]
2025-09-30T14:54:37.315130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1585, pipe: [1:7555895778413787772:9180]
2025-09-30T14:54:37.383163Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:37.383807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:37.383824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:37.383867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895778413787772:9180], now have 1 active actors on pipe
2025-09-30T14:54:37.384109Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:37.384192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895778413787772:9180]
2025-09-30T14:54:37.384260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:37.384270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:37.384391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1586 reason: error at write: Disconnected sessionId: src_id|e315a8f-e2bc717a-bfb5726-dedfc3e7_0
2025-09-30T14:54:37.384457Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:37.384653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1586 sessionId: src_id|e315a8f-e2bc717a-bfb5726-dedfc3e7_0 is DEAD
2025-09-30T14:54:37.384862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e315a8f-e2bc717a-bfb5726-dedfc3e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:37.384875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e315a8f-e2bc717a-bfb5726-dedfc3e7_0] Write session will restart in 0.005156s
2025-09-30T14:54:37.384899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e315a8f-e2bc717a-bfb5726-dedfc3e7_0] Write session: Do CDS request
2025-09-30T14:54:37.384905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e315a8f-e2bc717a-bfb5726-dedfc3e7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:37.390883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e315a8f-e2bc717a-bfb5726-dedfc3e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:37.390938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:37.390958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1587
2025-09-30T14:54:37.391186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1587 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:37.391225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1587 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:37.391235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1587 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:37.391252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:37.391733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1587 sessionId:  describe result for acl check
2025-09-30T14:54:37.391768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:37.391777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:37.391779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:37.391786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895778413787801:9660] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:37.392413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895778413787801:9660] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:37.395165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895778413787801:9660] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:37.399372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895778413787801:9660] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:37.399386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895778413787801:9660] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:37.399388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895778413787801:9660] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:37.399396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1587 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:37.401572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:37.404700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:37.405915Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:37.405934Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:37.405961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:37.406103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:37.406156Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895778324032040:9361]
2025-09-30T14:54:37.406750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:37.407183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:37.407233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:37.407561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:37.407635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:37.407644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:37.407645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:37.407647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:37.407648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:37.407650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:37.407651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:37.407652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:37.407653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:37.407655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:37.407656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.407657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.407658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.407659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:37.407661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:37.407667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:37.407676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:37.407680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:37.407684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:37.407688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:37.407691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:37.407695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:37.407698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:37.407701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:37.407705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:37.407709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.407713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.407716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.407720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:37.407724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:37.407732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:37.407739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:37.407745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:37.407750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:37.407755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:37.407760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:37.407764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:37.407769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:37.407773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:37.407778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:37.407782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:37.407787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:37.407791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:37.407797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:37.407800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:37.407805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:37.407814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:37.407819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:37.407824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:37.407830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:37.407834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.407839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.407843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.407847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.407852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.407857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.407861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:37.407866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:37.407870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:37.407875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:37.407915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:37.414351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:37.415270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:37.415287Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:37.415290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:37.415293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:37.415300Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1586 [2:7555895778324032040:9361]
2025-09-30T14:54:37.415316Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:37.415332Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:37.415342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:37.415345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:37.415348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:37.415365Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:37.415372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:37.415380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:37.415444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.415460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.415462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.415468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:37.415471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:37.415544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:37.415547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.415560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.415574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.415599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:37.415623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895778324032034:9361]
2025-09-30T14:54:37.415632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895778324032034:9361]
2025-09-30T14:54:37.415635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895778324032034:9361]
2025-09-30T14:54:37.415644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:37.415659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895778413788026:9660], now have 1 active actors on pipe
2025-09-30T14:54:37.415667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:37.415671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:37.415672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895778413787786:2454], now have 1 active actors on pipe
2025-09-30T14:54:37.415674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:37.415677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:37.415693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:37.415696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:37.415731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895778324032034:9361]
2025-09-30T14:54:37.415746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:37.415757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:37.415774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1586
2025-09-30T14:54:37.415825Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1586
2025-09-30T14:54:37.415906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:37.415921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:37.415954Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a34cb2d-3a3f1516-701ba957-700e16f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:37.415968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:37.415979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:37.415987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:37.415998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:37.416007Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:37.416024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:37.416282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:37.416304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:37.416331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:37.416446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1587 partition: 0 MaxSeqNo: 42 sessionId: src_id|7a34cb2d-3a3f1516-701ba957-700e16f3_0
2025-09-30T14:54:37.416890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e315a8f-e2bc717a-bfb5726-dedfc3e7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7a34cb2d-3a3f1516-701ba957-700e16f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:37.420407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a34cb2d-3a3f1516-701ba957-700e16f3_0] Write session: try to update token
2025-09-30T14:54:37.420430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a34cb2d-3a3f1516-701ba957-700e16f3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:37.429215Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:37.429241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:37.429252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895778324032034:9361]
2025-09-30T14:54:37.429297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:37.429303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:37.429478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:37.429630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:37.429802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:37.429951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:37.430159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:37.430203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:37.440815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1587 sessionId: src_id|7a34cb2d-3a3f1516-701ba957-700e16f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:37.441974Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:37.441996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:37.441999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:37.442002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:37.442013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895778324032034:9361]
2025-09-30T14:54:37.442018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895778324032034:9361]
2025-09-30T14:54:37.442023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895778324032034:9361]
2025-09-30T14:54:37.442070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:37.442084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.442087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:37.442102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:37.442119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:37.442123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:37.442240Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:37.444051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:37.484241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895778413788051:9180]
2025-09-30T14:54:37.484515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1586, pipe: [1:7555895778413788051:9180]
2025-09-30T14:54:37.561721Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:37.562336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:37.562355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:37.562376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895778413788051:9180], now have 1 active actors on pipe
2025-09-30T14:54:37.562648Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:37.562784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:37.562877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1587 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7a34cb2d-3a3f1516-701ba957-700e16f3_0
2025-09-30T14:54:37.563059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1587 sessionId: src_id|7a34cb2d-3a3f1516-701ba957-700e16f3_0 is DEAD
2025-09-30T14:54:37.563206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895778413788051:9180]
2025-09-30T14:54:37.563233Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:37.563544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a34cb2d-3a3f1516-701ba957-700e16f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:37.563559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a34cb2d-3a3f1516-701ba957-700e16f3_0] Write session will restart in 0.008191s
2025-09-30T14:54:37.563592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a34cb2d-3a3f1516-701ba957-700e16f3_0] Write session: Do CDS request
2025-09-30T14:54:37.563600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a34cb2d-3a3f1516-701ba957-700e16f3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:37.572926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a34cb2d-3a3f1516-701ba957-700e16f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:37.572999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:37.573016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1588
2025-09-30T14:54:37.573241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1588 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:37.573279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1588 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:37.573289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1588 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:37.573293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:37.573706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1588 sessionId:  describe result for acl check
2025-09-30T14:54:37.573739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:37.573748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:37.573750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:37.573755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895778413788154:9666] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:37.574286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895778413788154:9666] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:37.576997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895778413788154:9666] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:37.581454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895778413788154:9666] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:37.581473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895778413788154:9666] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:37.581477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895778413788154:9666] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:37.581487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1588 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:37.583680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:37.585097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:37.585285Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:37.585289Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:37.585298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:37.585358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:37.585396Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895778324032231:9370]
2025-09-30T14:54:37.586088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:37.586583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:37.586643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:37.586990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:37.587077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:37.587085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:37.587087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:37.587088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:37.587089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:37.587091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:37.587092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:37.587093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:37.587095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:37.587097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:37.587098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.587099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.587101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.587102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:37.587103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:37.587110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:37.587121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:37.587125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:37.587130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:37.587135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:37.587139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:37.587142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:37.587146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:37.587160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:37.587166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:37.587170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.587173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.587177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.587182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:37.587186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:37.587196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:37.587207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:37.587214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:37.587226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:37.587232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:37.587238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:37.587259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:37.587265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:37.587270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:37.587276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:37.587291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:37.587297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:37.587302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:37.587309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:37.587315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:37.587322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:37.587326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:37.587332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:37.587337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:37.587343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:37.587354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.587360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.587370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.587376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.587382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.587392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.587397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:37.587406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:37.587411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:37.587417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:37.587472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:37.594931Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1587
2025-09-30T14:54:37.594948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1587
2025-09-30T14:54:37.593458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:37.594422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:37.594428Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:37.594431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:37.594435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:37.594443Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1587 [2:7555895778324032231:9370]
2025-09-30T14:54:37.594462Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:37.594478Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:37.594482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:37.594485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:37.594488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:37.594504Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:37.594510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:37.594518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:37.594583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.594585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.594588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.594592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:37.594595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:37.594670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:37.594673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.594687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.594701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.594721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:37.594739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895778413788065:2454], now have 1 active actors on pipe
2025-09-30T14:54:37.594746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895778324032226:9370]
2025-09-30T14:54:37.594748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895778324032226:9370]
2025-09-30T14:54:37.594750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895778324032226:9370]
2025-09-30T14:54:37.594768Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:37.594781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895778413788306:9666], now have 1 active actors on pipe
2025-09-30T14:54:37.594789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:37.594788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:37.594793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:37.594795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:37.594804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:37.594807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:37.594839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895778324032226:9370]
2025-09-30T14:54:37.594849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:37.594860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:37.595130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:37.595136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:37.595159Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b47c935-e6721b62-b7d0def5-119221c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:37.595166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:37.595170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:37.595173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:37.595182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:37.595192Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:37.595208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:37.595451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:37.595458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:37.595478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:37.595581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1588 partition: 0 MaxSeqNo: 42 sessionId: src_id|7b47c935-e6721b62-b7d0def5-119221c6_0
2025-09-30T14:54:37.596109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a34cb2d-3a3f1516-701ba957-700e16f3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7b47c935-e6721b62-b7d0def5-119221c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:37.599745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b47c935-e6721b62-b7d0def5-119221c6_0] Write session: try to update token
2025-09-30T14:54:37.599773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b47c935-e6721b62-b7d0def5-119221c6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:37.608840Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:37.608865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:37.608868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:37.608870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:37.608878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895778324032226:9370]
2025-09-30T14:54:37.608883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895778324032226:9370]
2025-09-30T14:54:37.608892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895778324032226:9370]
2025-09-30T14:54:37.608935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:37.608942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.608945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:37.608953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:37.608981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:37.608986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:37.609103Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:37.619229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1588 sessionId: src_id|7b47c935-e6721b62-b7d0def5-119221c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:37.622160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:37.667424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895778413788324:9180]
2025-09-30T14:54:37.667842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1587, pipe: [1:7555895778413788324:9180]
2025-09-30T14:54:37.728345Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:37.728695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:37.728705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:37.728727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895778413788324:9180], now have 1 active actors on pipe
2025-09-30T14:54:37.728997Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:37.729030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895778413788324:9180]
2025-09-30T14:54:37.729069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:37.729153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1588 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7b47c935-e6721b62-b7d0def5-119221c6_0
2025-09-30T14:54:37.729280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:37.729316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1588 sessionId: src_id|7b47c935-e6721b62-b7d0def5-119221c6_0 is DEAD
2025-09-30T14:54:37.729723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b47c935-e6721b62-b7d0def5-119221c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:37.729731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b47c935-e6721b62-b7d0def5-119221c6_0] Write session will restart in 0.005142s
2025-09-30T14:54:37.729754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b47c935-e6721b62-b7d0def5-119221c6_0] Write session: Do CDS request
2025-09-30T14:54:37.729759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b47c935-e6721b62-b7d0def5-119221c6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:37.735731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b47c935-e6721b62-b7d0def5-119221c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:37.736437Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:37.736454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1589
2025-09-30T14:54:37.737141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1589 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:37.737177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1589 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:37.737183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1589 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:37.737187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:37.737549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1589 sessionId:  describe result for acl check
2025-09-30T14:54:37.737574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:37.737575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:37.737577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:37.737581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895778413788358:9671] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:37.738023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895778413788358:9671] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:37.740520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895778413788358:9671] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:37.743702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895778413788358:9671] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:37.743717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895778413788358:9671] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:37.743721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895778413788358:9671] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:37.743736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1589 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:37.747531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:37.751990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:37.752310Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:37.752315Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:37.752326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:37.752386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:37.752425Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895778324032406:9372]
2025-09-30T14:54:37.752970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:37.753409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:37.753514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:37.753971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:37.754065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:37.754074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:37.754075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:37.754077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:37.754078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:37.754079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:37.754081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:37.754082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:37.754084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:37.754086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:37.754087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.754089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.754090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.754091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:37.754093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:37.754100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:37.754111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:37.754116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:37.754121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:37.754124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:37.754129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:37.754133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:37.754137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:37.754141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:37.754146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:37.754151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.754155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.754159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.754163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:37.754167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:37.754179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:37.754187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:37.754195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:37.754200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:37.754206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:37.754212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:37.754217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:37.754222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:37.754227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:37.754233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:37.754238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:37.754244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:37.754249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:37.754254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:37.754260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:37.754265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:37.754277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:37.754282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:37.754293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:37.754299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:37.754310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.754315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.754325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.754331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.754341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.754347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.754352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:37.754357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:37.754363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:37.754370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:37.754436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:37.760607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:37.761915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:37.761934Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:37.761938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:37.761942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:37.761950Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1588 [2:7555895778324032406:9372]
2025-09-30T14:54:37.761967Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:37.761985Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:37.761994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:37.761997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:37.761999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:37.762018Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:37.762029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:37.762036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:37.762111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.762118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.762120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.762124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:37.762127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:37.762198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:37.762206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.762221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.762233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.762256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:37.762278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895778324032401:9372]
2025-09-30T14:54:37.762284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895778324032401:9372]
2025-09-30T14:54:37.762288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895778324032401:9372]
2025-09-30T14:54:37.762297Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:37.762318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:37.762337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:37.762344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:37.762360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:37.762372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:37.762374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:37.762386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895778324032401:9372]
2025-09-30T14:54:37.762398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:37.762409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895778413788521:9671], now have 1 active actors on pipe
2025-09-30T14:54:37.762418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895778413788325:2454], now have 1 active actors on pipe
2025-09-30T14:54:37.762450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:37.762517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1588
2025-09-30T14:54:37.762556Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1588
2025-09-30T14:54:37.762692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:37.762705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:37.762736Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b22efc2a-c8d64453-8a2d4558-bb737dab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:37.762755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:37.762759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:37.762761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:37.762774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:37.762798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:37.762818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:37.763021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:37.763043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:37.763068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:37.763274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1589 partition: 0 MaxSeqNo: 42 sessionId: src_id|b22efc2a-c8d64453-8a2d4558-bb737dab_0
2025-09-30T14:54:37.763652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b47c935-e6721b62-b7d0def5-119221c6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b22efc2a-c8d64453-8a2d4558-bb737dab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:37.766845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b22efc2a-c8d64453-8a2d4558-bb737dab_0] Write session: try to update token
2025-09-30T14:54:37.766866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b22efc2a-c8d64453-8a2d4558-bb737dab_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:37.776070Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:37.776094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:37.776096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:37.776098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:37.776108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895778324032401:9372]
2025-09-30T14:54:37.776113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895778324032401:9372]
2025-09-30T14:54:37.776117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895778324032401:9372]
2025-09-30T14:54:37.776157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:37.776164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.776167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:37.776303Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:37.776570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:37.776577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:37.776586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:37.786314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1589 sessionId: src_id|b22efc2a-c8d64453-8a2d4558-bb737dab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:37.789159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:37.829348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895778413788583:9180]
2025-09-30T14:54:37.830552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1588, pipe: [1:7555895778413788583:9180]
2025-09-30T14:54:37.893772Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:37.894074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:37.894089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:37.894110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895778413788583:9180], now have 1 active actors on pipe
2025-09-30T14:54:37.894381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:37.894411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:37.894429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895778413788583:9180]
2025-09-30T14:54:37.894453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:37.894487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1589 reason: error at write: Disconnected sessionId: src_id|b22efc2a-c8d64453-8a2d4558-bb737dab_0
2025-09-30T14:54:37.894638Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:37.894678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1589 sessionId: src_id|b22efc2a-c8d64453-8a2d4558-bb737dab_0 is DEAD
2025-09-30T14:54:37.894908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b22efc2a-c8d64453-8a2d4558-bb737dab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:37.894920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b22efc2a-c8d64453-8a2d4558-bb737dab_0] Write session will restart in 0.009042s
2025-09-30T14:54:37.894943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b22efc2a-c8d64453-8a2d4558-bb737dab_0] Write session: Do CDS request
2025-09-30T14:54:37.894949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b22efc2a-c8d64453-8a2d4558-bb737dab_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:37.904839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b22efc2a-c8d64453-8a2d4558-bb737dab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:37.904920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:37.904936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1590
2025-09-30T14:54:37.905115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1590 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:37.905162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1590 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:37.905168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1590 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:37.905173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:37.905741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1590 sessionId:  describe result for acl check
2025-09-30T14:54:37.905778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:37.905798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:37.905802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:37.905809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895778413788741:9675] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:37.906330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895778413788741:9675] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:37.908572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895778413788741:9675] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:37.909302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:37.911334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:37.911536Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:37.911547Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:37.911559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:37.911627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:37.911671Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895778324032579:9375]
2025-09-30T14:54:37.912034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895778413788741:9675] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:37.912050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895778413788741:9675] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:37.912054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895778413788741:9675] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:37.912062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1590 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:37.912347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:37.912686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:37.912746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:37.913110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:37.913176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:37.913183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:37.913185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:37.913186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:37.913188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:37.913189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:37.913191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:37.913193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:37.913194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:37.913195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:37.913197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.913198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.913199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.913201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:37.913202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:37.913209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:37.913220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:37.913225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:37.913229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:37.913234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:37.913238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:37.913242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:37.913246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:37.913251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:37.913256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:37.913260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.913265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.913269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.913274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:37.913278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:37.913287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:37.913295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:37.913302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:37.913308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:37.913314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:37.913320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:37.913330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:37.913336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:37.913342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:37.913348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:37.913355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:37.913361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:37.913365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:37.913371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:37.913377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:37.913382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:37.913388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:37.913394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:37.913399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:37.913404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:37.913415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.913420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.913429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.913435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.913445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.913450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.913459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:37.913466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:37.913474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:37.913480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:37.913527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:37.919225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:37.920205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:37.920235Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:37.920238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:37.920243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:37.920250Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1589 [2:7555895778324032579:9375]
2025-09-30T14:54:37.920269Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:37.920286Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:37.920295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:37.920299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:37.920302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:37.920318Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:37.920328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:37.920340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:37.920405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.920415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.920418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.920421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:37.920425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:37.920490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:37.920499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.920513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:37.920531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:37.920555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:37.920576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895778324032574:9375]
2025-09-30T14:54:37.920583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895778324032574:9375]
2025-09-30T14:54:37.920586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895778324032574:9375]
2025-09-30T14:54:37.920599Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:37.920619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895778413788832:9675], now have 1 active actors on pipe
2025-09-30T14:54:37.920620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:37.920623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:37.920626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:37.920627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895778413788584:2454], now have 1 active actors on pipe
2025-09-30T14:54:37.920636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:37.920652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:37.920656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:37.920693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895778324032574:9375]
2025-09-30T14:54:37.920707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:37.920738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:37.920761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1589
2025-09-30T14:54:37.920797Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1589
2025-09-30T14:54:37.920914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:37.920927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:37.920956Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff891e66-cb4dc4c5-851365a4-d24dd12c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:37.920968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:37.920975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:37.920982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:37.920994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:37.921008Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:37.921028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:37.921246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:37.921254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:37.921268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:37.921376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1590 partition: 0 MaxSeqNo: 42 sessionId: src_id|ff891e66-cb4dc4c5-851365a4-d24dd12c_0
2025-09-30T14:54:37.921756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b22efc2a-c8d64453-8a2d4558-bb737dab_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ff891e66-cb4dc4c5-851365a4-d24dd12c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:37.924748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff891e66-cb4dc4c5-851365a4-d24dd12c_0] Write session: try to update token
2025-09-30T14:54:37.924770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff891e66-cb4dc4c5-851365a4-d24dd12c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:37.933542Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:37.933562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:37.933573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895778324032574:9375]
2025-09-30T14:54:37.933623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:37.933631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:37.933852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:37.934027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:37.934206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:37.934466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:37.934792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:37.934841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:37.942893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1590 sessionId: src_id|ff891e66-cb4dc4c5-851365a4-d24dd12c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:37.945649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:37.945976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:37.946010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:37.946063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:37.946176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:37.953632Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:37.953655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:37.953659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:37.953661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:37.953676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895778324032574:9375]
2025-09-30T14:54:37.953681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895778324032574:9375]
2025-09-30T14:54:37.953686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895778324032574:9375]
2025-09-30T14:54:37.953737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:37.953737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:37.953746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:37.953748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:37.953750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:37.953751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:37.953948Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:37.994704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895778413788844:9180]
2025-09-30T14:54:37.995009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1589, pipe: [1:7555895778413788844:9180]
2025-09-30T14:54:38.074075Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:38.086026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:38.086069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:38.086303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:38.086388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:38.086469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:38.086561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:38.086630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:38.086644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:38.086742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:38.086825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:38.086913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:38.087010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:38.087099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:38.087109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:38.087208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:38.087316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:38.087408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:38.087500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:38.087567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:38.087577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:38.087667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:38.087746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:38.087837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:38.087928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:38.087995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:38.088003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:38.088098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:38.088180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:38.088272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:38.088358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:38.088429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:38.088438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:38.088530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:38.088609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:38.088690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:38.088772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:38.088833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:38.088842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:38.088926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:38.089014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:38.089101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:38.089186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:38.089250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:38.089258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:38.089346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:38.089421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:38.089505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:38.089588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:38.089652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:38.089666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:38.089755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:38.089851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:38.089939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:38.090024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:38.090090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:38.090102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:38.090189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:38.090274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:38.090362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:38.090449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:38.090525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:38.090535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:38.090632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895778413788844:9180], now have 1 active actors on pipe
2025-09-30T14:54:38.090935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:38.090950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895778413788844:9180]
2025-09-30T14:54:38.090953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:38.090975Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:38.091013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1590 reason: error at write: Disconnected sessionId: src_id|ff891e66-cb4dc4c5-851365a4-d24dd12c_0
2025-09-30T14:54:38.091202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1590 sessionId: src_id|ff891e66-cb4dc4c5-851365a4-d24dd12c_0 is DEAD
2025-09-30T14:54:38.091371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff891e66-cb4dc4c5-851365a4-d24dd12c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:38.091384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff891e66-cb4dc4c5-851365a4-d24dd12c_0] Write session will restart in 0.006881s
2025-09-30T14:54:38.091409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff891e66-cb4dc4c5-851365a4-d24dd12c_0] Write session: Do CDS request
2025-09-30T14:54:38.091415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff891e66-cb4dc4c5-851365a4-d24dd12c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:38.092548Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:38.099925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff891e66-cb4dc4c5-851365a4-d24dd12c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:38.100054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:38.100069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1591
2025-09-30T14:54:38.100236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1591 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:38.100271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1591 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:38.100282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1591 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:38.100286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:38.100725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1591 sessionId:  describe result for acl check
2025-09-30T14:54:38.100764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:38.100768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:38.100770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:38.100776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895782708756228:9682] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:38.101385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895782708756228:9682] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:38.104674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895782708756228:9682] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:38.107293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895782708756228:9682] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:38.107314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895782708756228:9682] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:38.107316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895782708756228:9682] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:38.107323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1591 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:38.107267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:38.108776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:38.108979Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:38.108992Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:38.109003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:38.109056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:38.109098Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895782619000051:9377]
2025-09-30T14:54:38.109804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:38.110187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:38.110234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:38.110562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:38.110633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:38.110639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:38.110653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:38.110654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:38.110655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:38.110656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:38.110657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:38.110659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:38.110660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:38.110661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:38.110662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.110663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:38.110665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:38.110666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:38.110667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:38.110672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:38.110683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:38.110687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:38.110692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:38.110696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:38.110699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:38.110703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:38.110708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:38.110712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:38.110717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:38.110722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.110726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:38.110730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:38.110735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:38.110739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:38.110746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:38.110754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:38.110760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:38.110767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:38.110777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:38.110783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:38.110789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:38.110801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:38.110805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:38.110811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:38.110820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:38.110826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:38.110831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:38.110837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:38.110847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:38.110852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:38.110861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:38.110868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:38.110872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:38.110883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:38.110888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.110895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.110900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:38.110909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:38.110914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:38.110919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:38.110928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:38.110934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:38.110940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:38.110951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:38.110999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:38.116588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:38.117546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:38.117564Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:38.117568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:38.117572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:38.117579Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1590 [2:7555895782619000051:9377]
2025-09-30T14:54:38.117596Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:38.117612Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:38.117614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:38.117617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:38.117618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:38.117635Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:38.117645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:38.117653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:38.117721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.117728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:38.117730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:38.117733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:38.117736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:38.117992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1590
2025-09-30T14:54:38.118025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1590
2025-09-30T14:54:38.118063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:38.118077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.118092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:38.118105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:38.118126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:38.118145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895782708756147:2454], now have 1 active actors on pipe
2025-09-30T14:54:38.118152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895782708756397:9682], now have 1 active actors on pipe
2025-09-30T14:54:38.118170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:38.118180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:38.118200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895782619000045:9377]
2025-09-30T14:54:38.118207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895782619000045:9377]
2025-09-30T14:54:38.118210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895782619000045:9377]
2025-09-30T14:54:38.118224Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:38.118240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:38.118243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:38.118244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:38.118246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:38.118258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:38.118262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:38.118282Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62e02f29-55d3b451-139f084d-dd80515c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:38.118295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:38.118304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:38.118307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:38.118317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:38.118331Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:38.118374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895782619000045:9377]
2025-09-30T14:54:38.118384Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:38.118396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:38.118430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:38.118583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:38.118593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:38.118608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:38.118707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1591 partition: 0 MaxSeqNo: 42 sessionId: src_id|62e02f29-55d3b451-139f084d-dd80515c_0
2025-09-30T14:54:38.119124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff891e66-cb4dc4c5-851365a4-d24dd12c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|62e02f29-55d3b451-139f084d-dd80515c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:38.122353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62e02f29-55d3b451-139f084d-dd80515c_0] Write session: try to update token
2025-09-30T14:54:38.122380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62e02f29-55d3b451-139f084d-dd80515c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:38.131073Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:38.131096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:38.131099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:38.131101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:38.131111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895782619000045:9377]
2025-09-30T14:54:38.131116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895782619000045:9377]
2025-09-30T14:54:38.131121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895782619000045:9377]
2025-09-30T14:54:38.131166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:38.131175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.131179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:38.131178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:38.131185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:38.131190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:38.131343Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:38.139995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1591 sessionId: src_id|62e02f29-55d3b451-139f084d-dd80515c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:38.142776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:38.191321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895782708756413:9180]
2025-09-30T14:54:38.191682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1590, pipe: [1:7555895782708756413:9180]
2025-09-30T14:54:38.248784Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:38.249260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:38.249276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:38.249316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895782708756413:9180], now have 1 active actors on pipe
2025-09-30T14:54:38.249589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895782708756413:9180]
2025-09-30T14:54:38.249593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:38.249597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:38.249619Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:38.249684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1591 reason: error at write: Disconnected sessionId: src_id|62e02f29-55d3b451-139f084d-dd80515c_0
2025-09-30T14:54:38.249927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1591 sessionId: src_id|62e02f29-55d3b451-139f084d-dd80515c_0 is DEAD
2025-09-30T14:54:38.249575Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:38.250088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62e02f29-55d3b451-139f084d-dd80515c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:38.250099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62e02f29-55d3b451-139f084d-dd80515c_0] Write session will restart in 0.006681s
2025-09-30T14:54:38.250122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62e02f29-55d3b451-139f084d-dd80515c_0] Write session: Do CDS request
2025-09-30T14:54:38.250131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62e02f29-55d3b451-139f084d-dd80515c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:38.257760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62e02f29-55d3b451-139f084d-dd80515c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:38.257913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:38.257940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1592
2025-09-30T14:54:38.258500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1592 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:38.258539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1592 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:38.258549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1592 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:38.258553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:38.259087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1592 sessionId:  describe result for acl check
2025-09-30T14:54:38.259127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:38.259135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:38.259137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:38.259143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895782708756429:9686] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:38.259762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895782708756429:9686] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:38.262114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895782708756429:9686] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:38.265701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895782708756429:9686] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:38.265723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895782708756429:9686] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:38.265727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895782708756429:9686] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:38.265736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1592 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:38.272045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:38.273887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:38.274112Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:38.274126Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:38.274140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:38.274220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:38.274266Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895782619000227:9379]
2025-09-30T14:54:38.274878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:38.275393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:38.275447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:38.275801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:38.275877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:38.275883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:38.275885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:38.275886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:38.275887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:38.275889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:38.275891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:38.275893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:38.275894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:38.275895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:38.275897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.275898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:38.275900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:38.275901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:38.275902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:38.275908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:38.275919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:38.275923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:38.275928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:38.275932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:38.275937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:38.275941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:38.275945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:38.275961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:38.275965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:38.275970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.275974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:38.275978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:38.275982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:38.275987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:38.275996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:38.276004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:38.276010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:38.276020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:38.276025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:38.276032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:38.276041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:38.276046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:38.276051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:38.276055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:38.276063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:38.276068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:38.276073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:38.276082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:38.276087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:38.276091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:38.276096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:38.276115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:38.276120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:38.276130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:38.276136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.276143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.276148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:38.276158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:38.276163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:38.276168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:38.276179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:38.276184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:38.276189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:38.276194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:38.276249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:38.282541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:38.283538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:38.283557Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:38.283561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:38.283565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:38.283574Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1591 [2:7555895782619000227:9379]
2025-09-30T14:54:38.283592Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:38.283609Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:38.283613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:38.283618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:38.283620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:38.283640Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:38.283649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:38.283661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:38.283730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.283737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:38.283740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:38.283743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:38.283746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:38.283814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:38.283821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.283834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:38.283850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:38.283872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:38.283899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895782708756414:2454], now have 1 active actors on pipe
2025-09-30T14:54:38.283907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895782708756618:9686], now have 1 active actors on pipe
2025-09-30T14:54:38.283915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895782619000222:9379]
2025-09-30T14:54:38.283921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895782619000222:9379]
2025-09-30T14:54:38.283924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895782619000222:9379]
2025-09-30T14:54:38.283938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:38.283960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:38.283980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:38.283988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:38.284023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895782619000222:9379]
2025-09-30T14:54:38.284033Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:38.284066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:38.284069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:38.284071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:38.284076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:38.284104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1591
2025-09-30T14:54:38.284172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1591
2025-09-30T14:54:38.284248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:38.284259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:38.284288Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93cf4fbb-e17c8b0-cb38b85-c749c5f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:38.284296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:38.284299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:38.284302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:38.284312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:38.284321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:38.284336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:38.285546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:38.285563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:38.285587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:38.285736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1592 partition: 0 MaxSeqNo: 42 sessionId: src_id|93cf4fbb-e17c8b0-cb38b85-c749c5f9_0
2025-09-30T14:54:38.286140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62e02f29-55d3b451-139f084d-dd80515c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|93cf4fbb-e17c8b0-cb38b85-c749c5f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:38.288996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93cf4fbb-e17c8b0-cb38b85-c749c5f9_0] Write session: try to update token
2025-09-30T14:54:38.289014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93cf4fbb-e17c8b0-cb38b85-c749c5f9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:38.297178Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:38.297201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:38.297205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:38.297207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:38.297216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895782619000222:9379]
2025-09-30T14:54:38.297221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895782619000222:9379]
2025-09-30T14:54:38.297226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895782619000222:9379]
2025-09-30T14:54:38.297268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:38.297276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.297278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:38.297284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:38.297292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:38.297297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:38.297439Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:38.315952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1592 sessionId: src_id|93cf4fbb-e17c8b0-cb38b85-c749c5f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:38.318818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:38.349534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895782708756675:9180]
2025-09-30T14:54:38.350102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1591, pipe: [1:7555895782708756675:9180]
2025-09-30T14:54:38.451415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:38.451479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895782708756675:9180]
2025-09-30T14:54:38.451499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:38.451594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1592 reason: status is not ok: tablet will be restarted right now sessionId: src_id|93cf4fbb-e17c8b0-cb38b85-c749c5f9_0
2025-09-30T14:54:38.451775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1592 sessionId: src_id|93cf4fbb-e17c8b0-cb38b85-c749c5f9_0 is DEAD
2025-09-30T14:54:38.450068Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:38.450778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:38.450789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:38.450815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895782708756675:9180], now have 1 active actors on pipe
2025-09-30T14:54:38.451094Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:38.454798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93cf4fbb-e17c8b0-cb38b85-c749c5f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:38.454813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93cf4fbb-e17c8b0-cb38b85-c749c5f9_0] Write session will restart in 0.008885s
2025-09-30T14:54:38.454844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93cf4fbb-e17c8b0-cb38b85-c749c5f9_0] Write session: Do CDS request
2025-09-30T14:54:38.454851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93cf4fbb-e17c8b0-cb38b85-c749c5f9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:38.464903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93cf4fbb-e17c8b0-cb38b85-c749c5f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:38.464955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:38.464985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1593
2025-09-30T14:54:38.467605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1593 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:38.467659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1593 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:38.467663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1593 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:38.467668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:38.468326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1593 sessionId:  describe result for acl check
2025-09-30T14:54:38.468362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:38.468365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:38.468367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:38.468373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895782708756729:9696] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:38.468960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895782708756729:9696] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:38.472425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895782708756729:9696] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:38.476372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895782708756729:9696] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:38.476388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895782708756729:9696] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:38.476392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895782708756729:9696] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:38.476399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1593 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:38.485822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:38.489120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:38.489326Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:38.489329Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:38.489337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:38.489393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:38.489435Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895782619000455:9393]
2025-09-30T14:54:38.490008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:38.490498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:38.490532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:38.490782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:38.490824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:38.490825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:38.490826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:38.490827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:38.490828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:38.490829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:38.490831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:38.490832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:38.490834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:38.490835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:38.490836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.490838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:38.490840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:38.490841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:38.490842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:38.490848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:38.490858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:38.490862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:38.490866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:38.490870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:38.490874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:38.490878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:38.490882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:38.490885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:38.490888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:38.490892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.490896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:38.490899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:38.490902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:38.490906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:38.490914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:38.490922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:38.490927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:38.490933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:38.490938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:38.490943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:38.490949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:38.490955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:38.490960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:38.490965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:38.490969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:38.490974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:38.490982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:38.490988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:38.490993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:38.490998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:38.491003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:38.491008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:38.491013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:38.491022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:38.491027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.491032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.491037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:38.491042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:38.491047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:38.491053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:38.491058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:38.491064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:38.491070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:38.491076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:38.491121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:38.497767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:38.499238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:38.499271Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:38.499275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:38.499280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:38.499290Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1592 [2:7555895782619000455:9393]
2025-09-30T14:54:38.499317Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:38.499340Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:38.499344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:38.499348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:38.499351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:38.499374Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:38.499384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:38.499393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:38.499976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1592
2025-09-30T14:54:38.500018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1592
2025-09-30T14:54:38.502388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1593 partition: 0 MaxSeqNo: 42 sessionId: src_id|782b70e1-3c1fba-86e9fd1e-b48d1c26_0
2025-09-30T14:54:38.502891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93cf4fbb-e17c8b0-cb38b85-c749c5f9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|782b70e1-3c1fba-86e9fd1e-b48d1c26_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:38.499484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.499502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:38.499506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:38.499510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:38.499513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:38.499605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:38.499608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.499625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:38.499638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:38.499656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:38.499679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895782619000450:9393]
2025-09-30T14:54:38.499683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895782619000450:9393]
2025-09-30T14:54:38.499685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895782619000450:9393]
2025-09-30T14:54:38.499699Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:38.499712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:38.499720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895782708756844:9696], now have 1 active actors on pipe
2025-09-30T14:54:38.499720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:38.499723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:38.499740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895782708756691:2454], now have 1 active actors on pipe
2025-09-30T14:54:38.499748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:38.499765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:38.499770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:38.499821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895782619000450:9393]
2025-09-30T14:54:38.499833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:38.499847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:38.500194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:38.500203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:38.500254Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|782b70e1-3c1fba-86e9fd1e-b48d1c26_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:38.500266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:38.500272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:38.500275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:38.500291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:38.500305Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:38.500327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:38.501842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:38.501850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:38.501876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:38.506458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|782b70e1-3c1fba-86e9fd1e-b48d1c26_0] Write session: try to update token
2025-09-30T14:54:38.506484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|782b70e1-3c1fba-86e9fd1e-b48d1c26_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:38.517562Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:38.517586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:38.517589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:38.517592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:38.517602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895782619000450:9393]
2025-09-30T14:54:38.517608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895782619000450:9393]
2025-09-30T14:54:38.517612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895782619000450:9393]
2025-09-30T14:54:38.517659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:38.517668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.517671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:38.517699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:38.517723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:38.517728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:38.517840Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:38.529315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1593 sessionId: src_id|782b70e1-3c1fba-86e9fd1e-b48d1c26_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:38.532682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:38.551276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895782708756974:9180]
2025-09-30T14:54:38.551606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1592, pipe: [1:7555895782708756974:9180]
2025-09-30T14:54:38.637232Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:38.637970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:38.637987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:38.638028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895782708756974:9180], now have 1 active actors on pipe
2025-09-30T14:54:38.638370Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:38.638316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895782708756974:9180]
2025-09-30T14:54:38.638357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:38.638360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:38.638425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1593 reason: error at write: Disconnected sessionId: src_id|782b70e1-3c1fba-86e9fd1e-b48d1c26_0
2025-09-30T14:54:38.638638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1593 sessionId: src_id|782b70e1-3c1fba-86e9fd1e-b48d1c26_0 is DEAD
2025-09-30T14:54:38.638799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:38.639520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|782b70e1-3c1fba-86e9fd1e-b48d1c26_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:38.639534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|782b70e1-3c1fba-86e9fd1e-b48d1c26_0] Write session will restart in 0.005810s
2025-09-30T14:54:38.639568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|782b70e1-3c1fba-86e9fd1e-b48d1c26_0] Write session: Do CDS request
2025-09-30T14:54:38.639578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|782b70e1-3c1fba-86e9fd1e-b48d1c26_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:38.651832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|782b70e1-3c1fba-86e9fd1e-b48d1c26_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:38.652109Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:38.652137Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1594
2025-09-30T14:54:38.652315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1594 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:38.652356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1594 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:38.652367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1594 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:38.652372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:38.652984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1594 sessionId:  describe result for acl check
2025-09-30T14:54:38.653027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:38.653029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:38.653032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:38.653040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895782708757049:9703] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:38.653703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895782708757049:9703] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:38.657096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895782708757049:9703] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:38.660042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895782708757049:9703] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:38.660060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895782708757049:9703] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:38.660064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895782708757049:9703] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:38.660073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1594 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:38.662769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:38.664453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:38.664654Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:38.664658Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:38.664668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:38.664720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:38.664759Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895782619000633:9397]
2025-09-30T14:54:38.665454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:38.665814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:38.665879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:38.666213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:38.666280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:38.666281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:38.666283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:38.666284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:38.666286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:38.666287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:38.666289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:38.666290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:38.666291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:38.666293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:38.666294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.666296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:38.666297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:38.666298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:38.666300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:38.666306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:38.666317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:38.666320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:38.666324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:38.666328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:38.666332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:38.666337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:38.666342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:38.666346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:38.666351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:38.666355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.666376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:38.666381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:38.666386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:38.666390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:38.666398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:38.666406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:38.666413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:38.666419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:38.666425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:38.666431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:38.666436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:38.666442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:38.666447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:38.666453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:38.666460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:38.666466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:38.666471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:38.666477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:38.666482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:38.666488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:38.666493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:38.666500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:38.666507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:38.666512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:38.666518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.666524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.666529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:38.666535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:38.666540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:38.666546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:38.666551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:38.666557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:38.666563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:38.666569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:38.666615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:38.673840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1593
2025-09-30T14:54:38.673892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1593
2025-09-30T14:54:38.674738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1594 partition: 0 MaxSeqNo: 42 sessionId: src_id|7181c56e-3a63c964-88c9c1e9-c44ee110_0
2025-09-30T14:54:38.675263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|782b70e1-3c1fba-86e9fd1e-b48d1c26_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7181c56e-3a63c964-88c9c1e9-c44ee110_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:38.672336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:38.673205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:38.673211Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:38.673215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:38.673219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:38.673226Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1593 [2:7555895782619000633:9397]
2025-09-30T14:54:38.673245Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:38.673263Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:38.673267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:38.673271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:38.673274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:38.673291Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:38.673298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:38.673306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:38.673367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.673370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:38.673372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:38.673377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:38.673380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:38.673460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:38.673463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.673476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:38.673488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:38.673505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:38.673522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895782619000628:9397]
2025-09-30T14:54:38.673525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895782619000628:9397]
2025-09-30T14:54:38.673527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895782619000628:9397]
2025-09-30T14:54:38.673535Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:38.673550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:38.673551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:38.673555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:38.673558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:38.673566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:38.673570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:38.673579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895782708756979:2454], now have 1 active actors on pipe
2025-09-30T14:54:38.673584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895782708757227:9703], now have 1 active actors on pipe
2025-09-30T14:54:38.673612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895782619000628:9397]
2025-09-30T14:54:38.673624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:38.673653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:38.674091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:38.674098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:38.674127Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7181c56e-3a63c964-88c9c1e9-c44ee110_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:38.674137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:38.674141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:38.674144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:38.674156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:38.674169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:38.674185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:38.674591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:38.674596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:38.674614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:38.678849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7181c56e-3a63c964-88c9c1e9-c44ee110_0] Write session: try to update token
2025-09-30T14:54:38.678879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7181c56e-3a63c964-88c9c1e9-c44ee110_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:38.688520Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:38.688546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:38.688548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:38.688551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:38.688563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895782619000628:9397]
2025-09-30T14:54:38.688568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895782619000628:9397]
2025-09-30T14:54:38.688573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895782619000628:9397]
2025-09-30T14:54:38.688629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:38.688638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.688641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:38.688645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:38.688653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:38.688662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:38.688828Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:38.701537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1594 sessionId: src_id|7181c56e-3a63c964-88c9c1e9-c44ee110_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:38.705280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:38.735626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895782708757241:9180]
2025-09-30T14:54:38.736108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1593, pipe: [1:7555895782708757241:9180]
2025-09-30T14:54:38.814186Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:38.814942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:38.814958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:38.814984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895782708757241:9180], now have 1 active actors on pipe
2025-09-30T14:54:38.815301Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:38.815324Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:38.815384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:38.815387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:38.815466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1594 reason: error at write: Disconnected sessionId: src_id|7181c56e-3a63c964-88c9c1e9-c44ee110_0
2025-09-30T14:54:38.815473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895782708757241:9180]
2025-09-30T14:54:38.815752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1594 sessionId: src_id|7181c56e-3a63c964-88c9c1e9-c44ee110_0 is DEAD
2025-09-30T14:54:38.815891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7181c56e-3a63c964-88c9c1e9-c44ee110_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:38.815902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7181c56e-3a63c964-88c9c1e9-c44ee110_0] Write session will restart in 0.005100s
2025-09-30T14:54:38.815932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7181c56e-3a63c964-88c9c1e9-c44ee110_0] Write session: Do CDS request
2025-09-30T14:54:38.815939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7181c56e-3a63c964-88c9c1e9-c44ee110_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:38.821904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7181c56e-3a63c964-88c9c1e9-c44ee110_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:38.822062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:38.822078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1595
2025-09-30T14:54:38.822270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1595 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:38.822305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1595 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:38.822312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1595 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:38.822320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:38.822791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1595 sessionId:  describe result for acl check
2025-09-30T14:54:38.822829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:38.822831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:38.822833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:38.822839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895782708757257:9707] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:38.823464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895782708757257:9707] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:38.826368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895782708757257:9707] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:38.830053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895782708757257:9707] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:38.830079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895782708757257:9707] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:38.830084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895782708757257:9707] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:38.830096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1595 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:38.870363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:38.873091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:38.873367Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:38.873372Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:38.873385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:38.873452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:38.873503Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895782619000815:9400]
2025-09-30T14:54:38.874296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:38.875181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:38.875277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:38.875707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:38.875809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:38.875810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:38.875811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:38.875813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:38.875814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:38.875816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:38.875818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:38.875819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:38.875821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:38.875823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:38.875824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.875826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:38.875827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:38.875829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:38.875830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:38.875838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:38.875851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:38.875856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:38.875861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:38.875865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:38.875870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:38.875873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:38.875877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:38.875882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:38.875891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:38.875895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.875900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:38.875904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:38.875908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:38.875913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:38.875925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:38.875934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:38.875941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:38.875948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:38.875958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:38.875978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:38.875984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:38.875990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:38.875996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:38.876002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:38.876008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:38.876013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:38.876020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:38.876026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:38.876031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:38.876037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:38.876043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:38.876048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:38.876055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:38.876064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:38.876069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.876074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.876079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:38.876084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:38.876090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:38.876095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:38.876100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:38.876105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:38.876110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:38.876116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:38.876168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:38.882829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:38.884412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:38.884435Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:38.884439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:38.884444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:38.884454Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1594 [2:7555895782619000815:9400]
2025-09-30T14:54:38.884479Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:38.884500Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:38.884510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:38.884514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:38.884517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:38.884540Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:38.884554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:38.884563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:38.884652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.884660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:38.884663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:38.884668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:38.884671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:38.884757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:38.884766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.884783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:38.884799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:38.884821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:38.884849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895782708757243:2454], now have 1 active actors on pipe
2025-09-30T14:54:38.884857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895782708757329:9707], now have 1 active actors on pipe
2025-09-30T14:54:38.884866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895782619000810:9400]
2025-09-30T14:54:38.884873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895782619000810:9400]
2025-09-30T14:54:38.884875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895782619000810:9400]
2025-09-30T14:54:38.884892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:38.884908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:38.884911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:38.884916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:38.884918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:38.884930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:38.884934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:38.884985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895782619000810:9400]
2025-09-30T14:54:38.885000Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:38.885002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:38.884992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1594
2025-09-30T14:54:38.885051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:38.885062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:38.885080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1594
2025-09-30T14:54:38.885093Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4443f4b1-9e20a6cc-8e523dd-eb2aa182_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:38.885110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:38.885120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:38.885122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:38.885137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:38.885152Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:38.885183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:38.885392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:38.885404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:38.885425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:38.885520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1595 partition: 0 MaxSeqNo: 42 sessionId: src_id|4443f4b1-9e20a6cc-8e523dd-eb2aa182_0
2025-09-30T14:54:38.886055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7181c56e-3a63c964-88c9c1e9-c44ee110_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4443f4b1-9e20a6cc-8e523dd-eb2aa182_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:38.889674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4443f4b1-9e20a6cc-8e523dd-eb2aa182_0] Write session: try to update token
2025-09-30T14:54:38.889706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4443f4b1-9e20a6cc-8e523dd-eb2aa182_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:38.902356Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:38.902388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:38.902393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:38.902397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:38.902411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895782619000810:9400]
2025-09-30T14:54:38.902423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895782619000810:9400]
2025-09-30T14:54:38.902433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895782619000810:9400]
2025-09-30T14:54:38.902505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:38.902511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:38.902521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:38.902523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:38.902526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:38.902527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:38.902815Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:38.913471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1595 sessionId: src_id|4443f4b1-9e20a6cc-8e523dd-eb2aa182_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:38.915753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895782708757507:9180]
2025-09-30T14:54:38.916197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1594, pipe: [1:7555895782708757507:9180]
2025-09-30T14:54:38.917003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:39.028589Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:39.029145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895782708757507:9180], now have 1 active actors on pipe
2025-09-30T14:54:39.029182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:39.029191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:39.029500Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:39.029480Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:39.029536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895782708757507:9180]
2025-09-30T14:54:39.029545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:39.029548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:39.029624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1595 reason: error at write: Disconnected sessionId: src_id|4443f4b1-9e20a6cc-8e523dd-eb2aa182_0
2025-09-30T14:54:39.029839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1595 sessionId: src_id|4443f4b1-9e20a6cc-8e523dd-eb2aa182_0 is DEAD
2025-09-30T14:54:39.030043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4443f4b1-9e20a6cc-8e523dd-eb2aa182_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:39.030056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4443f4b1-9e20a6cc-8e523dd-eb2aa182_0] Write session will restart in 0.006248s
2025-09-30T14:54:39.030086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4443f4b1-9e20a6cc-8e523dd-eb2aa182_0] Write session: Do CDS request
2025-09-30T14:54:39.030096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4443f4b1-9e20a6cc-8e523dd-eb2aa182_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:39.037900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4443f4b1-9e20a6cc-8e523dd-eb2aa182_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:39.038075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:39.038092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1596
2025-09-30T14:54:39.038268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1596 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:39.038302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1596 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:39.038313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1596 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:39.038318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:39.038801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1596 sessionId:  describe result for acl check
2025-09-30T14:54:39.038841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:39.038843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:39.038846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:39.038852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895787003724841:9711] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:39.039460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895787003724841:9711] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:39.041474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895787003724841:9711] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:39.044511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895787003724841:9711] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:39.044528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895787003724841:9711] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:39.044532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895787003724841:9711] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:39.044540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1596 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:39.049816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:39.051414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:39.051645Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:39.051658Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:39.051671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:39.051733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:39.051784Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895786913968291:9402]
2025-09-30T14:54:39.052516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:39.052876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:39.052924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:39.053273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:39.053342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:39.053347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:39.053349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:39.053350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:39.053352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:39.053354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:39.053356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:39.053357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:39.053358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:39.053360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:39.053361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.053363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.053365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.053366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:39.053368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:39.053374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:39.053384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:39.053389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:39.053393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:39.053398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:39.053402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:39.053407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:39.053412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:39.053416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:39.053422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:39.053426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.053435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.053440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.053444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:39.053449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:39.053464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:39.053476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:39.053487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:39.053498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:39.053508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:39.053516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:39.053525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:39.053531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:39.053537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:39.053543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:39.053548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:39.053555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:39.053564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:39.053571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:39.053580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:39.053587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:39.053596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:39.053605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:39.053610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:39.053615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:39.053622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.053628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.053633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.053647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.053653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.053659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.053664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:39.053669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:39.053675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:39.053681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:39.053729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:39.060147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:39.061131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:39.061156Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:39.061159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:39.061164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:39.061173Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1595 [2:7555895786913968291:9402]
2025-09-30T14:54:39.061192Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:39.061211Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:39.061220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:39.061224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:39.061227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:39.061244Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:39.061255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:39.061262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:39.061318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.061324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.061326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.061329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:39.061331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:39.061395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:39.061403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.061412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.061419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.061434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:39.061452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895786913968286:9402]
2025-09-30T14:54:39.061457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895786913968286:9402]
2025-09-30T14:54:39.061460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895786913968286:9402]
2025-09-30T14:54:39.061470Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:39.061485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:39.061492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:39.061495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:39.061498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:39.061509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:39.061517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:39.061562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895787003725020:9711], now have 1 active actors on pipe
2025-09-30T14:54:39.061571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895787003724808:2454], now have 1 active actors on pipe
2025-09-30T14:54:39.061573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895786913968286:9402]
2025-09-30T14:54:39.061584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:39.061620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:39.061653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1595
2025-09-30T14:54:39.061665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1595
2025-09-30T14:54:39.061815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:39.061831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:39.061864Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d844169-5026431c-1b8236c1-484a2eac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:39.061889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:39.061898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:39.061901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:39.061915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:39.061933Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:39.061950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:39.062181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:39.062190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:39.062205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:39.062382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1596 partition: 0 MaxSeqNo: 42 sessionId: src_id|6d844169-5026431c-1b8236c1-484a2eac_0
2025-09-30T14:54:39.062839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4443f4b1-9e20a6cc-8e523dd-eb2aa182_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6d844169-5026431c-1b8236c1-484a2eac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:39.066487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d844169-5026431c-1b8236c1-484a2eac_0] Write session: try to update token
2025-09-30T14:54:39.066512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d844169-5026431c-1b8236c1-484a2eac_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:39.082222Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:39.082250Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:39.082264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895786913968286:9402]
2025-09-30T14:54:39.082326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:39.082342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:39.082536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:39.082917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:39.083081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:39.083269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:39.083491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:39.083549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:39.091759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1596 sessionId: src_id|6d844169-5026431c-1b8236c1-484a2eac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:39.093168Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:39.093191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:39.093194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:39.093197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:39.093209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895786913968286:9402]
2025-09-30T14:54:39.093215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895786913968286:9402]
2025-09-30T14:54:39.093224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895786913968286:9402]
2025-09-30T14:54:39.093275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:39.093284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.093287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:39.093296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:39.093314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:39.093320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:39.093457Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:39.094527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:39.130407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895787003725080:9180]
2025-09-30T14:54:39.130878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1595, pipe: [1:7555895787003725080:9180]
2025-09-30T14:54:39.224202Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:39.225208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:39.225227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:39.225259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895787003725080:9180], now have 1 active actors on pipe
2025-09-30T14:54:39.225689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:39.225846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:39.225860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:39.225928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895787003725080:9180]
2025-09-30T14:54:39.225950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1596 reason: error at write: Disconnected sessionId: src_id|6d844169-5026431c-1b8236c1-484a2eac_0
2025-09-30T14:54:39.225546Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:39.226149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1596 sessionId: src_id|6d844169-5026431c-1b8236c1-484a2eac_0 is DEAD
2025-09-30T14:54:39.227581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d844169-5026431c-1b8236c1-484a2eac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:39.227594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d844169-5026431c-1b8236c1-484a2eac_0] Write session will restart in 0.005325s
2025-09-30T14:54:39.227634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d844169-5026431c-1b8236c1-484a2eac_0] Write session: Do CDS request
2025-09-30T14:54:39.227645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d844169-5026431c-1b8236c1-484a2eac_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:39.235902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d844169-5026431c-1b8236c1-484a2eac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:39.235887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:39.235907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1597
2025-09-30T14:54:39.236138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1597 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:39.236175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1597 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:39.236182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1597 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:39.236186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:39.236685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1597 sessionId:  describe result for acl check
2025-09-30T14:54:39.236718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:39.236720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:39.236723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:39.236730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895787003725138:9716] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:39.237399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895787003725138:9716] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:39.246921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895787003725138:9716] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:39.257586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895787003725138:9716] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:39.257605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895787003725138:9716] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:39.257610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895787003725138:9716] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:39.257621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1597 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:39.259102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:39.263370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:39.263688Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:39.263693Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:39.263706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:39.263794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:39.263851Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895786913968472:9404]
2025-09-30T14:54:39.264647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:39.266998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:39.267096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:39.267628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:39.267744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:39.267746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:39.267748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:39.267749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:39.267751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:39.267753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:39.267755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:39.267757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:39.267758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:39.267760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:39.267762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.267764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.267765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.267767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:39.267768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:39.267777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:39.267790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:39.267795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:39.267801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:39.267805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:39.267811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:39.267817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:39.267822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:39.267826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:39.267830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:39.267835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.267839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.267842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.267847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:39.267851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:39.267866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:39.267877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:39.267884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:39.267894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:39.267900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:39.267905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:39.267911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:39.267918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:39.267924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:39.267931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:39.267936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:39.267942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:39.267948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:39.267955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:39.267962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:39.267968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:39.267976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:39.267982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:39.267988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:39.267995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:39.268002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.268009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.268014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.268019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.268025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.268031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.268037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:39.268044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:39.268050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:39.268057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:39.268116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:39.277460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:39.278918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:39.278928Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:39.278932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:39.278937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:39.278946Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1596 [2:7555895786913968472:9404]
2025-09-30T14:54:39.278968Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:39.278989Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:39.278995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:39.278998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:39.279001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:39.279022Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:39.279035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:39.279044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:39.279135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.279137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.279140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.279145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:39.279149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:39.279267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:39.279270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.279288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.279571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1596
2025-09-30T14:54:39.279609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1596
2025-09-30T14:54:39.279301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.279321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:39.279342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895786913968465:9404]
2025-09-30T14:54:39.279346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895786913968465:9404]
2025-09-30T14:54:39.279348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895786913968465:9404]
2025-09-30T14:54:39.279358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:39.279375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:39.279393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:39.279393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:39.279397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:39.279397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:39.279400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:39.279445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895786913968465:9404]
2025-09-30T14:54:39.279457Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:39.279472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895787003725336:9716], now have 1 active actors on pipe
2025-09-30T14:54:39.279476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895787003725084:2454], now have 1 active actors on pipe
2025-09-30T14:54:39.279689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:39.280081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:39.280101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:39.280139Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db3654b2-6ccaf466-a0d5b6ef-8d7cacd5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:39.280153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:39.280166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:39.280169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:39.280183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:39.280199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:39.280220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:39.280469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:39.280481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:39.280500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:39.280694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1597 partition: 0 MaxSeqNo: 42 sessionId: src_id|db3654b2-6ccaf466-a0d5b6ef-8d7cacd5_0
2025-09-30T14:54:39.281292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d844169-5026431c-1b8236c1-484a2eac_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|db3654b2-6ccaf466-a0d5b6ef-8d7cacd5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:39.284693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db3654b2-6ccaf466-a0d5b6ef-8d7cacd5_0] Write session: try to update token
2025-09-30T14:54:39.284717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db3654b2-6ccaf466-a0d5b6ef-8d7cacd5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:39.294036Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:39.294063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:39.294067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:39.294069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:39.294082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895786913968465:9404]
2025-09-30T14:54:39.294089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895786913968465:9404]
2025-09-30T14:54:39.294095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895786913968465:9404]
2025-09-30T14:54:39.294148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:39.294157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.294160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:39.294164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:39.294167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:39.294174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:39.294336Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:39.309297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1597 sessionId: src_id|db3654b2-6ccaf466-a0d5b6ef-8d7cacd5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:39.312492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:39.325936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895787003725350:9180]
2025-09-30T14:54:39.326314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1596, pipe: [1:7555895787003725350:9180]
2025-09-30T14:54:39.424408Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:39.425953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:39.426078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1597 reason: status is not ok: tablet will be restarted right now sessionId: src_id|db3654b2-6ccaf466-a0d5b6ef-8d7cacd5_0
2025-09-30T14:54:39.426078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895787003725350:9180]
2025-09-30T14:54:39.426106Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:39.424988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:39.425013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:39.425039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895787003725350:9180], now have 1 active actors on pipe
2025-09-30T14:54:39.425384Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:39.426442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db3654b2-6ccaf466-a0d5b6ef-8d7cacd5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:39.426452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db3654b2-6ccaf466-a0d5b6ef-8d7cacd5_0] Write session will restart in 0.008881s
2025-09-30T14:54:39.426475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db3654b2-6ccaf466-a0d5b6ef-8d7cacd5_0] Write session: Do CDS request
2025-09-30T14:54:39.426482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db3654b2-6ccaf466-a0d5b6ef-8d7cacd5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:39.426274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1597 sessionId: src_id|db3654b2-6ccaf466-a0d5b6ef-8d7cacd5_0 is DEAD
2025-09-30T14:54:39.436844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db3654b2-6ccaf466-a0d5b6ef-8d7cacd5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:39.436980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:39.436998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1598
2025-09-30T14:54:39.437140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1598 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:39.437186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1598 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:39.437196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1598 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:39.437200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:39.437729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1598 sessionId:  describe result for acl check
2025-09-30T14:54:39.437772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:39.437788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:39.437790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:39.437798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895787003725421:9720] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:39.438405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895787003725421:9720] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:39.441089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895787003725421:9720] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:39.444811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895787003725421:9720] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:39.444835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895787003725421:9720] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:39.444839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895787003725421:9720] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:39.444849Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1598 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:39.446897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:39.448732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:39.449007Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:39.449016Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:39.449030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:39.449090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:39.449168Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895786913968656:9407]
2025-09-30T14:54:39.449975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:39.450315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:39.450363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:39.450771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:39.450848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:39.450850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:39.450851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:39.450853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:39.450854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:39.450856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:39.450857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:39.450859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:39.450861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:39.450862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:39.450864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.450866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.450868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.450870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:39.450871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:39.450878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:39.450891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:39.450896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:39.450901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:39.450906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:39.450911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:39.450915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:39.450919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:39.450924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:39.450928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:39.450933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.450937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.450941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.450945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:39.450950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:39.450959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:39.450967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:39.450975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:39.450981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:39.450987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:39.450994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:39.450999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:39.451005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:39.451012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:39.451018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:39.451023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:39.451029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:39.451035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:39.451041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:39.451047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:39.451053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:39.451061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:39.451067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:39.451072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:39.451078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:39.451083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.451089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.451094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.451098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.451104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.451110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.451116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:39.451140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:39.451163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:39.451169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:39.451220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:39.462866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:39.464430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:39.464454Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:39.464457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:39.464461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:39.464471Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1597 [2:7555895786913968656:9407]
2025-09-30T14:54:39.464491Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:39.464510Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:39.464515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:39.464518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:39.464521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:39.464545Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:39.464561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:39.464575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:39.464664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.464674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.464677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.464680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:39.464683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:39.464772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:39.464781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.464797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.464814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.464836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:39.464868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895787003725352:2454], now have 1 active actors on pipe
2025-09-30T14:54:39.464877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895787003725604:9720], now have 1 active actors on pipe
2025-09-30T14:54:39.464885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895786913968651:9407]
2025-09-30T14:54:39.464892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895786913968651:9407]
2025-09-30T14:54:39.464894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895786913968651:9407]
2025-09-30T14:54:39.464917Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:39.464936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:39.464946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:39.464949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:39.464952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:39.464959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:39.464976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:39.464956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1597
2025-09-30T14:54:39.465032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895786913968651:9407]
2025-09-30T14:54:39.465044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:39.464991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1597
2025-09-30T14:54:39.465054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:39.465263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:39.465279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:39.465318Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dab73474-7381ea1a-29224869-2f12495c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:39.465329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:39.465341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:39.465344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:39.465356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:39.465371Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:39.465397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:39.465767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1598 partition: 0 MaxSeqNo: 42 sessionId: src_id|dab73474-7381ea1a-29224869-2f12495c_0
2025-09-30T14:54:39.465606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:39.465615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:39.465634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:39.466228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db3654b2-6ccaf466-a0d5b6ef-8d7cacd5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dab73474-7381ea1a-29224869-2f12495c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:39.469399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dab73474-7381ea1a-29224869-2f12495c_0] Write session: try to update token
2025-09-30T14:54:39.469422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dab73474-7381ea1a-29224869-2f12495c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:39.479662Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:39.479686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:39.479698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895786913968651:9407]
2025-09-30T14:54:39.479752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:39.479756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:39.479955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:39.480120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:39.480283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:39.480442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:39.480675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:39.480731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:39.493834Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:39.493857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:39.493862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:39.493864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:39.493875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895786913968651:9407]
2025-09-30T14:54:39.493878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895786913968651:9407]
2025-09-30T14:54:39.493881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895786913968651:9407]
2025-09-30T14:54:39.493921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:39.493928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.493930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:39.493932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:39.493940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:39.493946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:39.494118Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:39.494724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1598 sessionId: src_id|dab73474-7381ea1a-29224869-2f12495c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:39.497751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:39.526098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895787003725644:9180]
2025-09-30T14:54:39.526370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1597, pipe: [1:7555895787003725644:9180]
2025-09-30T14:54:39.624130Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:39.624645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:39.624663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:39.624688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895787003725644:9180], now have 1 active actors on pipe
2025-09-30T14:54:39.625250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:39.624942Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:39.625338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895787003725644:9180]
2025-09-30T14:54:39.625378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:39.625444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1598 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dab73474-7381ea1a-29224869-2f12495c_0
2025-09-30T14:54:39.625668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1598 sessionId: src_id|dab73474-7381ea1a-29224869-2f12495c_0 is DEAD
2025-09-30T14:54:39.625861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dab73474-7381ea1a-29224869-2f12495c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:39.625871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dab73474-7381ea1a-29224869-2f12495c_0] Write session will restart in 0.007745s
2025-09-30T14:54:39.625899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dab73474-7381ea1a-29224869-2f12495c_0] Write session: Do CDS request
2025-09-30T14:54:39.625905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dab73474-7381ea1a-29224869-2f12495c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:39.634902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dab73474-7381ea1a-29224869-2f12495c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:39.635464Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:39.635492Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1599
2025-09-30T14:54:39.635629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1599 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:39.635668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1599 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:39.635682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1599 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:39.635687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:39.636285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1599 sessionId:  describe result for acl check
2025-09-30T14:54:39.636378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:39.636387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:39.636389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:39.636395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895787003725693:9733] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:39.637152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895787003725693:9733] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:39.640568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895787003725693:9733] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:39.647132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895787003725693:9733] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:39.647152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895787003725693:9733] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:39.647157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895787003725693:9733] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:39.647169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1599 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:39.647639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:39.649372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:39.649866Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:39.649880Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:39.649898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:39.649986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:39.650046Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895786913968887:9422]
2025-09-30T14:54:39.650821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:39.651280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:39.651353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:39.651749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:39.651827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:39.651828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:39.651830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:39.651831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:39.651833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:39.651835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:39.651837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:39.651838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:39.651839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:39.651841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:39.651842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.651843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.651845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.651847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:39.651849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:39.651856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:39.651869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:39.651873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:39.651878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:39.651883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:39.651889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:39.651893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:39.651898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:39.651903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:39.651908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:39.651913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.651917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.651921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.651926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:39.651931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:39.651942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:39.651951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:39.651971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:39.651979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:39.651986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:39.651993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:39.651999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:39.652006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:39.652015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:39.652021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:39.652027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:39.652034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:39.652041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:39.652047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:39.652053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:39.652058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:39.652064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:39.652071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:39.652076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:39.652084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:39.652090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.652096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.652101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.652108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.652115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.652121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.652127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:39.652133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:39.652141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:39.652147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:39.652203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:39.660426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:39.661611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:39.661633Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:39.661640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:39.661645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:39.661653Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1598 [2:7555895786913968887:9422]
2025-09-30T14:54:39.661673Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:39.661700Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:39.661704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:39.661708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:39.661710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:39.661733Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:39.661743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:39.661752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:39.661833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.661842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.661844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.661848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:39.661851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:39.661938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:39.661949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.661963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.661974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.661989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:39.662012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895786913968881:9422]
2025-09-30T14:54:39.662014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895786913968881:9422]
2025-09-30T14:54:39.662016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895786913968881:9422]
2025-09-30T14:54:39.662025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:39.662045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:39.662061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:39.662069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:39.662099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:39.662101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:39.662104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:39.662118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895786913968881:9422]
2025-09-30T14:54:39.662122Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:39.662127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:39.662150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895787003725657:2454], now have 1 active actors on pipe
2025-09-30T14:54:39.662153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895787003725912:9733], now have 1 active actors on pipe
2025-09-30T14:54:39.662563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1598
2025-09-30T14:54:39.662609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1598
2025-09-30T14:54:39.663326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:39.663359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:39.663403Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3084220-550dd66-78d86c86-88144b47_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:39.663423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:39.663434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:39.663438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:39.663453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:39.663479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:39.663517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:39.667337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:39.667361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:39.667405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:39.667781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1599 partition: 0 MaxSeqNo: 42 sessionId: src_id|f3084220-550dd66-78d86c86-88144b47_0
2025-09-30T14:54:39.668294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dab73474-7381ea1a-29224869-2f12495c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f3084220-550dd66-78d86c86-88144b47_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:39.672209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3084220-550dd66-78d86c86-88144b47_0] Write session: try to update token
2025-09-30T14:54:39.672237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3084220-550dd66-78d86c86-88144b47_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:39.679872Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:39.679896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:39.679898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:39.679900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:39.679912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895786913968881:9422]
2025-09-30T14:54:39.679917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895786913968881:9422]
2025-09-30T14:54:39.679922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895786913968881:9422]
2025-09-30T14:54:39.679971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:39.679995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.679998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:39.680171Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:39.683323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:39.683344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:39.683349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:39.693139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1599 sessionId: src_id|f3084220-550dd66-78d86c86-88144b47_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:39.696794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:39.725905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895787003725925:9180]
2025-09-30T14:54:39.726407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1598, pipe: [1:7555895787003725925:9180]
2025-09-30T14:54:39.806816Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:39.807782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:39.807831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:39.807899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895787003725925:9180], now have 1 active actors on pipe
2025-09-30T14:54:39.808521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:39.808538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895787003725925:9180]
2025-09-30T14:54:39.808573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:39.808576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:39.808666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1599 reason: error at write: Disconnected sessionId: src_id|f3084220-550dd66-78d86c86-88144b47_0
2025-09-30T14:54:39.808851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1599 sessionId: src_id|f3084220-550dd66-78d86c86-88144b47_0 is DEAD
2025-09-30T14:54:39.809068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3084220-550dd66-78d86c86-88144b47_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:39.809081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3084220-550dd66-78d86c86-88144b47_0] Write session will restart in 0.005901s
2025-09-30T14:54:39.809144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3084220-550dd66-78d86c86-88144b47_0] Write session: Do CDS request
2025-09-30T14:54:39.809153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3084220-550dd66-78d86c86-88144b47_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:39.808665Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:39.818419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3084220-550dd66-78d86c86-88144b47_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:39.818546Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:39.818565Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1600
2025-09-30T14:54:39.818789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1600 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:39.818830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1600 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:39.818842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1600 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:39.818848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:39.819378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1600 sessionId:  describe result for acl check
2025-09-30T14:54:39.819428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:39.819437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:39.819439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:39.819446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895787003725943:9737] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:39.820000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895787003725943:9737] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:39.825485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895787003725943:9737] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:39.829036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895787003725943:9737] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:39.829056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895787003725943:9737] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:39.829060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895787003725943:9737] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:39.829069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1600 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:39.834718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:39.836516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:39.836721Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:39.836734Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:39.836745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:39.836795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:39.836838Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895786913969074:9425]
2025-09-30T14:54:39.837506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:39.837828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:39.837893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:39.838255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:39.838340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:39.838348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:39.838349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:39.838350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:39.838352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:39.838353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:39.838354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:39.838356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:39.838357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:39.838358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:39.838359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.838361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.838362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.838363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:39.838364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:39.838370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:39.838381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:39.838385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:39.838389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:39.838393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:39.838397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:39.838401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:39.838405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:39.838410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:39.838414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:39.838418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.838422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.838426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.838431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:39.838435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:39.838444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:39.838451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:39.838459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:39.838464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:39.838469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:39.838475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:39.838479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:39.838485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:39.838490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:39.838496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:39.838501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:39.838506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:39.838511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:39.838517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:39.838521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:39.838527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:39.838532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:39.838538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:39.838543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:39.838549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:39.838565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.838570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.838575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.838579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.838581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.838584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.838587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:39.838590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:39.838593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:39.838596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:39.838621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:39.844966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:39.846149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:39.846167Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:39.846171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:39.846175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:39.846185Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1599 [2:7555895786913969074:9425]
2025-09-30T14:54:39.846208Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:39.846230Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:39.846234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:39.846239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:39.846242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:39.846266Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:39.846275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:39.846299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:39.846390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.846399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.846402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.846406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:39.846409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:39.846499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:39.846508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.846524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.846542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.846565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:39.846596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895787003726086:9737], now have 1 active actors on pipe
2025-09-30T14:54:39.846606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895787003725928:2454], now have 1 active actors on pipe
2025-09-30T14:54:39.846614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895786913969069:9425]
2025-09-30T14:54:39.846622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895786913969069:9425]
2025-09-30T14:54:39.846625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895786913969069:9425]
2025-09-30T14:54:39.846644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:39.846669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:39.846670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:39.846675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:39.846678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:39.846692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:39.846696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:39.846649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1599
2025-09-30T14:54:39.846650Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1599
2025-09-30T14:54:39.846756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895786913969069:9425]
2025-09-30T14:54:39.846771Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:39.846780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:39.846797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:39.846807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:39.846877Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc6e0d7f-219fab07-8cace638-32f706d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:39.846892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:39.846903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:39.846906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:39.846920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:39.846937Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:39.846966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:39.847194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:39.847204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:39.847224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:39.850213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1600 partition: 0 MaxSeqNo: 42 sessionId: src_id|cc6e0d7f-219fab07-8cace638-32f706d2_0
2025-09-30T14:54:39.850797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3084220-550dd66-78d86c86-88144b47_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cc6e0d7f-219fab07-8cace638-32f706d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:39.854206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc6e0d7f-219fab07-8cace638-32f706d2_0] Write session: try to update token
2025-09-30T14:54:39.854232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc6e0d7f-219fab07-8cace638-32f706d2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:39.859558Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:39.859582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:39.859585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:39.859587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:39.859596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895786913969069:9425]
2025-09-30T14:54:39.859601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895786913969069:9425]
2025-09-30T14:54:39.859606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895786913969069:9425]
2025-09-30T14:54:39.859633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:39.859638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:39.859641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:39.859642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:39.859649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.859652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:39.859786Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:39.873589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1600 sessionId: src_id|cc6e0d7f-219fab07-8cace638-32f706d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:39.876329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:39.908562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895787003726196:9180]
2025-09-30T14:54:39.908992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1599, pipe: [1:7555895787003726196:9180]
2025-09-30T14:54:39.973728Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:39.974286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:39.974305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:39.974325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895787003726196:9180], now have 1 active actors on pipe
2025-09-30T14:54:39.974633Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:39.974633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895787003726196:9180]
2025-09-30T14:54:39.974677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:39.974694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:39.974698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:39.974763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1600 reason: error at write: Disconnected sessionId: src_id|cc6e0d7f-219fab07-8cace638-32f706d2_0
2025-09-30T14:54:39.974946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1600 sessionId: src_id|cc6e0d7f-219fab07-8cace638-32f706d2_0 is DEAD
2025-09-30T14:54:39.975162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc6e0d7f-219fab07-8cace638-32f706d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:39.975173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc6e0d7f-219fab07-8cace638-32f706d2_0] Write session will restart in 0.007654s
2025-09-30T14:54:39.975202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc6e0d7f-219fab07-8cace638-32f706d2_0] Write session: Do CDS request
2025-09-30T14:54:39.975220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc6e0d7f-219fab07-8cace638-32f706d2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:39.983886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc6e0d7f-219fab07-8cace638-32f706d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:39.983984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:39.983999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1601
2025-09-30T14:54:39.984214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1601 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:39.984252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1601 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:39.984264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1601 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:39.984268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:39.984755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1601 sessionId:  describe result for acl check
2025-09-30T14:54:39.984791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:39.984793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:39.984795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:39.984800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895787003726310:9741] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:39.985364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895787003726310:9741] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:39.987461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895787003726310:9741] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:39.990828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895787003726310:9741] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:39.990859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895787003726310:9741] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:39.990863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895787003726310:9741] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:39.990872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1601 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:39.992165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:39.994245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:39.994505Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:39.994519Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:39.994532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:39.994598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:39.994647Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895786913969259:9427]
2025-09-30T14:54:39.995431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:39.995865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:39.995966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:39.996359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:39.996426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:39.996434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:39.996435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:39.996436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:39.996437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:39.996437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:39.996438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:39.996439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:39.996440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:39.996440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:39.996441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.996442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.996443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.996444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:39.996445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:39.996451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:39.996462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:39.996466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:39.996471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:39.996476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:39.996480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:39.996485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:39.996489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:39.996491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:39.996496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:39.996499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.996501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.996504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.996506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:39.996508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:39.996516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:39.996521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:39.996526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:39.996529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:39.996533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:39.996536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:39.996540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:39.996543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:39.996546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:39.996549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:39.996552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:39.996556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:39.996559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:39.996562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:39.996568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:39.996574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:39.996597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:39.996603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:39.996609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:39.996616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:39.996621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.996627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:39.996633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.996639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:39.996644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.996650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:39.996655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:39.996660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:39.996666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:39.996672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:39.996707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:40.002423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:40.003699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:40.003721Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:40.003723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:40.003726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:40.003732Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1600 [2:7555895786913969259:9427]
2025-09-30T14:54:40.003748Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:40.003762Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:40.003765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:40.003767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:40.003768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:40.003783Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:40.003788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:40.003794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:40.003844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.003845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:40.003847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:40.003850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:40.003851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:40.003906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:40.003908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.003918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:40.003924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:40.003934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:40.003948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895786913969254:9427]
2025-09-30T14:54:40.003954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895786913969254:9427]
2025-09-30T14:54:40.003955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895786913969254:9427]
2025-09-30T14:54:40.003962Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:40.003972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:40.003981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:40.003985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:40.003987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:40.003988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:40.003989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:40.003997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895787003726201:2454], now have 1 active actors on pipe
2025-09-30T14:54:40.004000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895787003726454:9741], now have 1 active actors on pipe
2025-09-30T14:54:40.004026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895786913969254:9427]
2025-09-30T14:54:40.004042Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:40.004061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:40.004147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:40.004155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:40.004175Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61b92de3-5f6eb4c9-96f616ee-5b7ce94e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:40.004185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:40.004188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:40.004189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:40.004200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:40.004208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:40.004218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:40.004087Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1600
2025-09-30T14:54:40.004099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1600
2025-09-30T14:54:40.004345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:40.004353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:40.004363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:40.004557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1601 partition: 0 MaxSeqNo: 42 sessionId: src_id|61b92de3-5f6eb4c9-96f616ee-5b7ce94e_0
2025-09-30T14:54:40.004992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc6e0d7f-219fab07-8cace638-32f706d2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|61b92de3-5f6eb4c9-96f616ee-5b7ce94e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:40.008138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61b92de3-5f6eb4c9-96f616ee-5b7ce94e_0] Write session: try to update token
2025-09-30T14:54:40.008160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61b92de3-5f6eb4c9-96f616ee-5b7ce94e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:40.016564Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:40.016592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:40.016595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:40.016597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:40.016606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895786913969254:9427]
2025-09-30T14:54:40.016611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895786913969254:9427]
2025-09-30T14:54:40.016616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895786913969254:9427]
2025-09-30T14:54:40.016658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:40.016667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.016670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:40.016668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:40.016685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:40.016690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:40.016826Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:40.024820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1601 sessionId: src_id|61b92de3-5f6eb4c9-96f616ee-5b7ce94e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:40.027663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:40.074943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895791298693763:9180]
2025-09-30T14:54:40.075214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1600, pipe: [1:7555895791298693763:9180]
2025-09-30T14:54:40.141561Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:40.141913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:40.141930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:40.141950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895791298693763:9180], now have 1 active actors on pipe
2025-09-30T14:54:40.142158Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:40.142270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:40.142273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895791298693763:9180]
2025-09-30T14:54:40.142352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:40.142369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1601 reason: status is not ok: tablet will be restarted right now sessionId: src_id|61b92de3-5f6eb4c9-96f616ee-5b7ce94e_0
2025-09-30T14:54:40.142389Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:54:40.142457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1601 sessionId: src_id|61b92de3-5f6eb4c9-96f616ee-5b7ce94e_0 is DEAD
2025-09-30T14:54:40.142483Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 16 consumer shared/user session shared/user_1_16_2213676333351772861_v1 is DEAD
2025-09-30T14:54:40.142594Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895718284230333:9177] disconnected; active server actors: 1
2025-09-30T14:54:40.142603Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895718284230333:9177] client user disconnected session shared/user_1_16_2213676333351772861_v1
2025-09-30T14:54:40.142813Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:54:40.142834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61b92de3-5f6eb4c9-96f616ee-5b7ce94e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:40.142845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61b92de3-5f6eb4c9-96f616ee-5b7ce94e_0] Write session will restart in 0.009490s
2025-09-30T14:54:40.142867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61b92de3-5f6eb4c9-96f616ee-5b7ce94e_0] Write session: Do CDS request
2025-09-30T14:54:40.142881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61b92de3-5f6eb4c9-96f616ee-5b7ce94e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:40.142978Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:54:40.142986Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:54:40.142993Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.006773s
2025-09-30T14:54:40.150704Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:54:40.150872Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:54:40.150896Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 17
2025-09-30T14:54:40.151119Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 17 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:54:40.151197Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:54:40.151301Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 auth for : user
2025-09-30T14:54:40.151505Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 Handle describe topics response
2025-09-30T14:54:40.151537Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 auth is DEAD
2025-09-30T14:54:40.151543Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:54:40.151783Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:54:40.151886Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_17_7543637519477031915_v1
2025-09-30T14:54:40.151897Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895791298693869:9746] connected; active server actors: 1
2025-09-30T14:54:40.151916Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555895791298693869:9746] session shared/user_1_17_7543637519477031915_v1
2025-09-30T14:54:40.151924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:54:40.151935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:54:40.151941Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_17_7543637519477031915_v1" (Sender=[1:7555895791298693824:9746], Pipe=[1:7555895791298693869:9746], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:54:40.151952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:54:40.151974Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:54:40.151987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_17_7543637519477031915_v1" (Sender=[1:7555895791298693824:9746], Pipe=[1:7555895791298693869:9746], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:54:40.151998Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_17_7543637519477031915_v1" sender [1:7555895791298693824:9746] lock partition 0 for ReadingSession "shared/user_1_17_7543637519477031915_v1" (Sender=[1:7555895791298693824:9746], Pipe=[1:7555895791298693869:9746], Partitions=[], ActiveFamilyCount=1) generation 1 step 17
2025-09-30T14:54:40.152016Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:54:40.152020Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000040s
2025-09-30T14:54:40.152332Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 17 Session: "shared/user_1_17_7543637519477031915_v1" ClientId: "user" PipeClient { RawX1: 7555895791298693869 RawX2: 4503603922347538 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:54:40.152354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:54:40.153672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61b92de3-5f6eb4c9-96f616ee-5b7ce94e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:40.153757Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:40.153770Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1602
2025-09-30T14:54:40.153887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1602 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:40.153915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1602 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:40.153923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1602 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:40.153927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:40.154355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1602 sessionId:  describe result for acl check
2025-09-30T14:54:40.154384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:40.154386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:40.154388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:40.154394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895791298693965:9750] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:40.154913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895791298693965:9750] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:40.156620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895791298693965:9750] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:40.157194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:40.158863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:40.159181Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:40.159202Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:40.159186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895791298693965:9750] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:40.159216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:40.159199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895791298693965:9750] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:40.159203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895791298693965:9750] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:40.159212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1602 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:40.159304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:40.159359Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895791208936741:9429]
2025-09-30T14:54:40.160134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:40.160613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:40.160688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:40.161195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:40.161323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:40.161335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:40.161336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:40.161338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:40.161340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:40.161342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:40.161343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:40.161345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:40.161347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:40.161348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:40.161350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.161352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:40.161353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:40.161355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:40.161357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:40.161365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:40.161378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:40.161382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:40.161386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:40.161390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:40.161395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:40.161399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:40.161404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:40.161409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:40.161413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:40.161418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.161423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:40.161427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:40.161431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:40.161435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:40.161448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:40.161458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:40.161466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:40.161474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:40.161482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:40.161490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:40.161507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:40.161515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:40.161531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:40.161545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:40.161553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:40.161561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:40.161574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:40.161586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:40.161593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:40.161603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:40.161615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:40.161626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:40.161633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:40.161647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:40.161659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.161671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.161683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:40.161690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:40.161700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:40.161707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:40.161713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:40.161720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:40.161726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:40.161733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:40.161808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:40.168293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:40.169898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:40.169924Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:40.169928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:40.169933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:40.169943Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1601 [2:7555895791208936741:9429]
2025-09-30T14:54:40.169965Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:40.169986Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:40.169994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:40.169998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:40.170007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:40.170029Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:40.170044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:40.170059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:40.170152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.170162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:40.170165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:40.170169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:40.170173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:40.170273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:40.170283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.170300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:40.170313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:40.170338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:40.170369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895791298694037:9750], now have 1 active actors on pipe
2025-09-30T14:54:40.170379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895791298693894:9749], now have 1 active actors on pipe
2025-09-30T14:54:40.170383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895791298693771:2454], now have 1 active actors on pipe
2025-09-30T14:54:40.170392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895791208936735:9429]
2025-09-30T14:54:40.170401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895791208936735:9429]
2025-09-30T14:54:40.170404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895791208936735:9429]
2025-09-30T14:54:40.170424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:40.170449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:40.170463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:40.170469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:40.170472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:40.170485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:40.170489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:40.170452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1601
2025-09-30T14:54:40.170482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1601, pipe: [1:7555895791298693894:9749]
2025-09-30T14:54:40.170500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1601
2025-09-30T14:54:40.170557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:40.170570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:40.170594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:40.170602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:40.170610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_17_7543637519477031915_v1 on pipe: [1:7555895791298693894:9749]
2025-09-30T14:54:40.170632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895791208936735:9429]
2025-09-30T14:54:40.170648Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:40.170671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:40.170672Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_17_7543637519477031915_v1:1 with generation 1601
2025-09-30T14:54:40.170702Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd0d295f-84ad47ab-64ec0071-7b28a69f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:40.170717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:40.170726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:40.170730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:40.170743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:40.170756Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:40.170776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:40.170787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:40.170789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:40.170808Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_17_7543637519477031915_v1
2025-09-30T14:54:40.170817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:40.170868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:40.170892Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:54:40.171197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:40.171214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:40.171483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:40.171609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1602 partition: 0 MaxSeqNo: 42 sessionId: src_id|cd0d295f-84ad47ab-64ec0071-7b28a69f_0
2025-09-30T14:54:40.172013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61b92de3-5f6eb4c9-96f616ee-5b7ce94e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cd0d295f-84ad47ab-64ec0071-7b28a69f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:40.174854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd0d295f-84ad47ab-64ec0071-7b28a69f_0] Write session: try to update token
2025-09-30T14:54:40.174873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd0d295f-84ad47ab-64ec0071-7b28a69f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:40.175679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:54:40.175728Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:54:40.175741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:40.175746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:40.175749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:40.175761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:54:40.175781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:54:40.175992Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759244080170 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:54:40.176015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:54:40.176062Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 sending to client partition status
2025-09-30T14:54:40.183455Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:40.183481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:40.183485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:40.183488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:40.183500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895791208936735:9429]
2025-09-30T14:54:40.183506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895791208936735:9429]
2025-09-30T14:54:40.183511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895791208936735:9429]
2025-09-30T14:54:40.183565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:40.183573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.183576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:40.183577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:40.183586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:40.183590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:40.183746Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:40.192685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1602 sessionId: src_id|cd0d295f-84ad47ab-64ec0071-7b28a69f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:40.195574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:40.304535Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:40.305227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:40.305251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:40.305553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_17_7543637519477031915_v1
2025-09-30T14:54:40.305579Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:40.305554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:40.305571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:40.305589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895791298693894:9749]
2025-09-30T14:54:40.305606Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_17_7543637519477031915_v1
2025-09-30T14:54:40.305614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:40.305666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1602 reason: error at write: Disconnected sessionId: src_id|cd0d295f-84ad47ab-64ec0071-7b28a69f_0
2025-09-30T14:54:40.305951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1602 sessionId: src_id|cd0d295f-84ad47ab-64ec0071-7b28a69f_0 is DEAD
2025-09-30T14:54:40.306121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd0d295f-84ad47ab-64ec0071-7b28a69f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:40.306141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd0d295f-84ad47ab-64ec0071-7b28a69f_0] Write session will restart in 0.009934s
2025-09-30T14:54:40.306164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd0d295f-84ad47ab-64ec0071-7b28a69f_0] Write session: Do CDS request
2025-09-30T14:54:40.306168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd0d295f-84ad47ab-64ec0071-7b28a69f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:40.317869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd0d295f-84ad47ab-64ec0071-7b28a69f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:40.317933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:40.317949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1603
2025-09-30T14:54:40.318146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1603 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:40.318183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1603 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:40.318189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1603 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:40.318195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:40.318684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1603 sessionId:  describe result for acl check
2025-09-30T14:54:40.318736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:40.318738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:40.318741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:40.318747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895791298694197:9754] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:40.319413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895791298694197:9754] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:40.321905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895791298694197:9754] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:40.325600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895791298694197:9754] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:40.325620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895791298694197:9754] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:40.325625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895791298694197:9754] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:40.325636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1603 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:40.330054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:40.331879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:40.332105Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:40.332116Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:40.332129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:40.332190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:40.332237Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895791208936933:9432]
2025-09-30T14:54:40.333011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:40.333711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:40.333760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:40.334184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:40.334263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:40.334269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:40.334271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:40.334272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:40.334274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:40.334275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:40.334277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:40.334278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:40.334280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:40.334281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:40.334283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.334284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:40.334286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:40.334287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:40.334289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:40.334296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:40.334309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:40.334314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:40.334319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:40.334323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:40.334328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:40.334332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:40.334337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:40.334342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:40.334347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:40.334352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.334356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:40.334360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:40.334365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:40.334369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:40.334378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:40.334387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:40.334394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:40.334401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:40.334409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:40.334416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:40.334427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:40.334433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:40.334439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:40.334449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:40.334454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:40.334459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:40.334469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:40.334475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:40.334485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:40.334491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:40.334502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:40.334508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:40.334514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:40.334527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:40.334537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.334544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.334553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:40.334558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:40.334564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:40.334569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:40.334574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:40.334581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:40.334586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:40.334592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:40.334651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:40.341065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:40.342187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:40.342208Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:40.342212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:40.342217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:40.342225Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1602 [2:7555895791208936933:9432]
2025-09-30T14:54:40.342247Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:40.342268Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:40.342277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:40.342281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:40.342286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:40.342308Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:40.342322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:40.342334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:40.342416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.342424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:40.342427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:40.342432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:40.342435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:40.342526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:40.342536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.342550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:40.342561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:40.342578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:40.342610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895791298694275:9754], now have 1 active actors on pipe
2025-09-30T14:54:40.342620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895791298694053:2454], now have 1 active actors on pipe
2025-09-30T14:54:40.342628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895791208936928:9432]
2025-09-30T14:54:40.342636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895791208936928:9432]
2025-09-30T14:54:40.342639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895791208936928:9432]
2025-09-30T14:54:40.342734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1602
2025-09-30T14:54:40.342656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:40.342748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1602
2025-09-30T14:54:40.342675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:40.342678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:40.342680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:40.342682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:40.342696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:40.342701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:40.342747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895791208936928:9432]
2025-09-30T14:54:40.342765Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:40.342777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:40.342813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:40.342820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:40.342867Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1cd0446a-ca954029-5dee5f2d-232b68cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:40.342882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:40.342887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:40.342889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:40.342903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:40.342920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:40.342946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:40.343190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:40.343214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:40.343312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:40.343495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1603 partition: 0 MaxSeqNo: 42 sessionId: src_id|1cd0446a-ca954029-5dee5f2d-232b68cd_0
2025-09-30T14:54:40.343958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd0d295f-84ad47ab-64ec0071-7b28a69f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1cd0446a-ca954029-5dee5f2d-232b68cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:40.346791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cd0446a-ca954029-5dee5f2d-232b68cd_0] Write session: try to update token
2025-09-30T14:54:40.346815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cd0446a-ca954029-5dee5f2d-232b68cd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:40.356845Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:40.356883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:40.356886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:40.356889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:40.356899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895791208936928:9432]
2025-09-30T14:54:40.356904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895791208936928:9432]
2025-09-30T14:54:40.356910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895791208936928:9432]
2025-09-30T14:54:40.356953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:40.356966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.356965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:40.356970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:40.356972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:40.356977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:40.357119Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:40.364408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1603 sessionId: src_id|1cd0446a-ca954029-5dee5f2d-232b68cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:40.367738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:40.405726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895791298694324:9749]
2025-09-30T14:54:40.406080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1602, pipe: [1:7555895791298694324:9749]
2025-09-30T14:54:40.473031Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:40.473355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:40.473364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:40.473380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895791298694324:9749], now have 1 active actors on pipe
2025-09-30T14:54:40.473693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895791298694324:9749]
2025-09-30T14:54:40.473710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:40.473738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:40.473645Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:40.473859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1603 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1cd0446a-ca954029-5dee5f2d-232b68cd_0
2025-09-30T14:54:40.474078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1603 sessionId: src_id|1cd0446a-ca954029-5dee5f2d-232b68cd_0 is DEAD
2025-09-30T14:54:40.474285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cd0446a-ca954029-5dee5f2d-232b68cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:40.474297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cd0446a-ca954029-5dee5f2d-232b68cd_0] Write session will restart in 0.007048s
2025-09-30T14:54:40.474325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cd0446a-ca954029-5dee5f2d-232b68cd_0] Write session: Do CDS request
2025-09-30T14:54:40.474333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cd0446a-ca954029-5dee5f2d-232b68cd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:40.483634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cd0446a-ca954029-5dee5f2d-232b68cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:40.483750Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:40.483768Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1604
2025-09-30T14:54:40.483914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1604 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:40.483955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1604 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:40.483961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1604 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:40.483966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:40.484574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1604 sessionId:  describe result for acl check
2025-09-30T14:54:40.484619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:40.484622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:40.484625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:40.484632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895791298694341:9758] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:40.485308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895791298694341:9758] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:40.487946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895791298694341:9758] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:40.491376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895791298694341:9758] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:40.491400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895791298694341:9758] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:40.491404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895791298694341:9758] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:40.491413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1604 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:40.497909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:40.500265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:40.500558Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:40.500571Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:40.500585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:40.500649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:40.500709Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895791208937133:9435]
2025-09-30T14:54:40.501484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:40.501835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:40.501893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:40.502317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:40.502396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:40.502402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:40.502404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:40.502405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:40.502407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:40.502409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:40.502410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:40.502412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:40.502413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:40.502414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:40.502416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.502417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:40.502419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:40.502420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:40.502422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:40.502429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:40.502440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:40.502445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:40.502450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:40.502455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:40.502459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:40.502463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:40.502467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:40.502471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:40.502476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:40.502481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.502485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:40.502490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:40.502494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:40.502498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:40.502506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:40.502515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:40.502523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:40.502529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:40.502534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:40.502541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:40.502546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:40.502552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:40.502558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:40.502564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:40.502570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:40.502576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:40.502585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:40.502591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:40.502605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:40.502611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:40.502625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:40.502642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:40.502653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:40.502660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:40.502671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.502677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.502687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:40.502693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:40.502723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:40.502743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:40.502751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:40.502757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:40.502765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:40.502771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:40.502828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:40.509490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:40.511134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:40.511739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1603
2025-09-30T14:54:40.511739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1603
2025-09-30T14:54:40.511157Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:40.511160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:40.511166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:40.511175Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1603 [2:7555895791208937133:9435]
2025-09-30T14:54:40.511195Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:40.511215Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:40.511220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:40.511224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:40.511226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:40.511289Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:40.511298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:40.511307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:40.511392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.511395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:40.511398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:40.511403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:40.511407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:40.511502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:40.511505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.511524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:40.511536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:40.511725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:40.511754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895791298694500:9758], now have 1 active actors on pipe
2025-09-30T14:54:40.511758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895791298694326:2454], now have 1 active actors on pipe
2025-09-30T14:54:40.511767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895791208937128:9435]
2025-09-30T14:54:40.511769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895791208937128:9435]
2025-09-30T14:54:40.511773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895791208937128:9435]
2025-09-30T14:54:40.511796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:40.511809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:40.511812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:40.511814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:40.511814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:40.511829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:40.511833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:40.511881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895791208937128:9435]
2025-09-30T14:54:40.511888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:40.511911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:40.511958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:40.511964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:40.511995Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1e968ce-99b24889-f759efb0-1690ca1b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:40.512007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:40.512011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:40.512014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:40.512025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:40.512038Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:40.512056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:40.512475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:40.512495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:40.512522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:40.512703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1604 partition: 0 MaxSeqNo: 42 sessionId: src_id|e1e968ce-99b24889-f759efb0-1690ca1b_0
2025-09-30T14:54:40.513135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cd0446a-ca954029-5dee5f2d-232b68cd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e1e968ce-99b24889-f759efb0-1690ca1b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:40.516815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e968ce-99b24889-f759efb0-1690ca1b_0] Write session: try to update token
2025-09-30T14:54:40.516841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e968ce-99b24889-f759efb0-1690ca1b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:40.545404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1604 sessionId: src_id|e1e968ce-99b24889-f759efb0-1690ca1b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:40.548380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:40.549623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:40.548173Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:40.548203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:40.548218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895791208937128:9435]
2025-09-30T14:54:40.548285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:40.548296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:40.548500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:40.548664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:40.548826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:40.548987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:40.549275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:40.549343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:40.549356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:40.549382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:40.549432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:40.559894Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:40.559924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:40.559927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:40.559930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:40.559941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895791208937128:9435]
2025-09-30T14:54:40.559945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895791208937128:9435]
2025-09-30T14:54:40.559949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895791208937128:9435]
2025-09-30T14:54:40.560002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:40.560012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.560015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:40.560192Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:40.563188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:40.563223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:40.563229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:40.573587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895791298694623:9749]
2025-09-30T14:54:40.573797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1603, pipe: [1:7555895791298694623:9749]
2025-09-30T14:54:40.683898Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:40.684387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895791298694623:9749], now have 1 active actors on pipe
2025-09-30T14:54:40.692826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:40.692859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:40.693045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:40.693122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:40.693195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:40.693274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:40.693322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:40.693333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:40.693409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:40.693477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:40.693550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:40.693628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:40.693675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:40.693684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:40.693757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:40.693833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:40.693898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:40.693967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:40.694019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:40.694029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:40.694103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:40.694176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:40.694242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:40.694315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:40.694365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:40.694375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:40.694532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:40.694600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:40.694670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:40.694735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:40.694784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:40.694798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:40.694868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:40.694931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:40.695008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:40.695083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:40.695133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:40.695145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:40.695213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:40.695303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:40.695372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:40.695440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:40.695495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:40.695503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:40.695580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:40.695646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:40.695720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:40.695791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:40.695835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:40.695844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:40.695916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:40.695985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:40.696051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:40.696118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:40.696305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:40.696330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:40.696455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:40.696543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:40.696640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:40.696726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:40.696790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:40.696804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:40.697162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895791298694623:9749]
2025-09-30T14:54:40.697190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:40.697383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:40.697393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:40.697421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1604 reason: error at write: Disconnected sessionId: src_id|e1e968ce-99b24889-f759efb0-1690ca1b_0
2025-09-30T14:54:40.697613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1604 sessionId: src_id|e1e968ce-99b24889-f759efb0-1690ca1b_0 is DEAD
2025-09-30T14:54:40.697865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e968ce-99b24889-f759efb0-1690ca1b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:40.697882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e968ce-99b24889-f759efb0-1690ca1b_0] Write session will restart in 0.008509s
2025-09-30T14:54:40.697927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e968ce-99b24889-f759efb0-1690ca1b_0] Write session: Do CDS request
2025-09-30T14:54:40.697935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e968ce-99b24889-f759efb0-1690ca1b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:40.697937Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:40.707906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e968ce-99b24889-f759efb0-1690ca1b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:40.708506Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:40.708533Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1605
2025-09-30T14:54:40.708710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1605 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:40.708757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1605 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:40.708767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1605 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:40.708772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:40.709261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1605 sessionId:  describe result for acl check
2025-09-30T14:54:40.709311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:40.709313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:40.709316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:40.709321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895791298694751:9771] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:40.709925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895791298694751:9771] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:40.712571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895791298694751:9771] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:40.716993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895791298694751:9771] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:40.717016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895791298694751:9771] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:40.717020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895791298694751:9771] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:40.717032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1605 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:40.717832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:40.719784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:40.720006Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:40.720015Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:40.720024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:40.720068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:40.720110Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895791208937359:9449]
2025-09-30T14:54:40.720698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:40.721043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:40.721102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:40.721413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:40.721468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:40.721473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:40.721474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:40.721474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:40.721475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:40.721476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:40.721477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:40.721478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:40.721478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:40.721479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:40.721480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.721481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:40.721482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:40.721483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:40.721483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:40.721488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:40.721495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:40.721497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:40.721500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:40.721502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:40.721504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:40.721507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:40.721509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:40.721512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:40.721514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:40.721517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.721519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:40.721521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:40.721524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:40.721527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:40.721534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:40.721539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:40.721544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:40.721547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:40.721551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:40.721554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:40.721557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:40.721560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:40.721563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:40.721567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:40.721570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:40.721573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:40.721576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:40.721579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:40.721582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:40.721585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:40.721588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:40.721591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:40.721594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:40.721597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:40.721600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.721604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.721607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:40.721610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:40.721615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:40.721618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:40.721622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:40.721625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:40.721628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:40.721631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:40.721670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:40.727651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:40.729096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:40.729119Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:40.729123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:40.729127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:40.729135Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1604 [2:7555895791208937359:9449]
2025-09-30T14:54:40.729155Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:40.729174Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:40.729178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:40.729183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:40.729186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:40.729206Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:40.729220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:40.729229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:40.729305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.729315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:40.729318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:40.729323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:40.729327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:40.729407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:40.729416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.729431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:40.729450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:40.729475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:40.729500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895791298694896:9771], now have 1 active actors on pipe
2025-09-30T14:54:40.729507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895791298694637:2454], now have 1 active actors on pipe
2025-09-30T14:54:40.729515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895791208937354:9449]
2025-09-30T14:54:40.729518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895791208937354:9449]
2025-09-30T14:54:40.729521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895791208937354:9449]
2025-09-30T14:54:40.729535Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:40.729550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:40.729557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:40.729563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:40.729566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:40.729574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:40.729579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:40.729621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895791208937354:9449]
2025-09-30T14:54:40.729630Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:40.729634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:40.729583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1604
2025-09-30T14:54:40.729668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:40.729597Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1604
2025-09-30T14:54:40.729678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:40.729721Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7dc6ce40-80222b30-c0758fe5-d80a17cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:40.729734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:40.729739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:40.729742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:40.729754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:40.729784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:40.729808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:40.729962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:40.729971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:40.729988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:40.730094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1605 partition: 0 MaxSeqNo: 42 sessionId: src_id|7dc6ce40-80222b30-c0758fe5-d80a17cb_0
2025-09-30T14:54:40.730523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e968ce-99b24889-f759efb0-1690ca1b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7dc6ce40-80222b30-c0758fe5-d80a17cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:40.733957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dc6ce40-80222b30-c0758fe5-d80a17cb_0] Write session: try to update token
2025-09-30T14:54:40.733980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dc6ce40-80222b30-c0758fe5-d80a17cb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:40.743450Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:40.743474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:40.743477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:40.743480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:40.743492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895791208937354:9449]
2025-09-30T14:54:40.743498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895791208937354:9449]
2025-09-30T14:54:40.743503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895791208937354:9449]
2025-09-30T14:54:40.743552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:40.743557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:40.743565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.743566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:40.743568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:40.743571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:40.743738Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:40.751426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1605 sessionId: src_id|7dc6ce40-80222b30-c0758fe5-d80a17cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:40.754195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:40.797369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895791298694911:9749]
2025-09-30T14:54:40.797677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1604, pipe: [1:7555895791298694911:9749]
2025-09-30T14:54:40.867655Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:40.868441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:40.868461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:40.868510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895791298694911:9749], now have 1 active actors on pipe
2025-09-30T14:54:40.868837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895791298694911:9749]
2025-09-30T14:54:40.868854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:40.868861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:40.868883Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:40.869435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dc6ce40-80222b30-c0758fe5-d80a17cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:40.869448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dc6ce40-80222b30-c0758fe5-d80a17cb_0] Write session will restart in 0.006275s
2025-09-30T14:54:40.869479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dc6ce40-80222b30-c0758fe5-d80a17cb_0] Write session: Do CDS request
2025-09-30T14:54:40.869485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dc6ce40-80222b30-c0758fe5-d80a17cb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:40.869001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1605 reason: error at write: Disconnected sessionId: src_id|7dc6ce40-80222b30-c0758fe5-d80a17cb_0
2025-09-30T14:54:40.869261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1605 sessionId: src_id|7dc6ce40-80222b30-c0758fe5-d80a17cb_0 is DEAD
2025-09-30T14:54:40.869658Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:40.876878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dc6ce40-80222b30-c0758fe5-d80a17cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:40.876974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:40.876999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1606
2025-09-30T14:54:40.877191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1606 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:40.877257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1606 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:40.877270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1606 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:40.877276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:40.877890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1606 sessionId:  describe result for acl check
2025-09-30T14:54:40.877939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:40.877950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:40.877952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:40.877960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895791298694927:9775] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:40.878684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895791298694927:9775] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:40.881411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895791298694927:9775] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:40.884305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895791298694927:9775] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:40.884318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895791298694927:9775] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:40.884324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895791298694927:9775] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:40.884333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1606 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:40.888449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:40.890619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:40.890881Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:40.890894Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:40.890906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:40.890967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:40.891014Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895791208937551:9452]
2025-09-30T14:54:40.891733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:40.894338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:40.894412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:40.894736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:40.894792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:40.894802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:40.894804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:40.894805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:40.894806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:40.894808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:40.894809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:40.894810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:40.894812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:40.894813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:40.894815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.894816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:40.894817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:40.894818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:40.894819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:40.894826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:40.894838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:40.894842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:40.894847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:40.894851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:40.894856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:40.894861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:40.894866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:40.894870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:40.894873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:40.894875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.894877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:40.894880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:40.894882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:40.894885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:40.894894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:40.894900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:40.894905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:40.894909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:40.894912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:40.894915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:40.894918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:40.894922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:40.894928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:40.894931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:40.894934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:40.894940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:40.894946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:40.894951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:40.894955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:40.894961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:40.894966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:40.894971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:40.894976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:40.894982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:40.894988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.894995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.895000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:40.895005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:40.895011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:40.895016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:40.895021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:40.895026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:40.895031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:40.895036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:40.895097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:40.902041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:40.903622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:40.903643Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:40.903646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:40.903650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:40.903833Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1605 [2:7555895791208937551:9452]
2025-09-30T14:54:40.903866Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:40.903894Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:40.903904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:40.903908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:40.903911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:40.903936Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:40.903960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:40.903970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:40.904061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.904071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:40.904073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:40.904077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:40.904081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:40.904172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:40.904179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.904196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:40.904209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:40.904233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:40.904256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895791298695122:9775], now have 1 active actors on pipe
2025-09-30T14:54:40.904273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895791208937546:9452]
2025-09-30T14:54:40.904276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895791208937546:9452]
2025-09-30T14:54:40.904278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895791208937546:9452]
2025-09-30T14:54:40.904304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:40.904316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895791298694912:2454], now have 1 active actors on pipe
2025-09-30T14:54:40.904325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:40.904341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:40.904345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:40.904346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:40.904357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:40.904369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:40.904392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895791208937546:9452]
2025-09-30T14:54:40.904407Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:40.904429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:40.904457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:40.904462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:40.904392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1605
2025-09-30T14:54:40.904395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1605
2025-09-30T14:54:40.904504Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40c10cda-e4cbf3b6-b10e9925-d8b81aa4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:40.904519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:40.904524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:40.904526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:40.904542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:40.904555Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:40.904579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:40.904834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:40.904869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:40.904902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:40.905003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1606 partition: 0 MaxSeqNo: 42 sessionId: src_id|40c10cda-e4cbf3b6-b10e9925-d8b81aa4_0
2025-09-30T14:54:40.905367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dc6ce40-80222b30-c0758fe5-d80a17cb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|40c10cda-e4cbf3b6-b10e9925-d8b81aa4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:40.908777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40c10cda-e4cbf3b6-b10e9925-d8b81aa4_0] Write session: try to update token
2025-09-30T14:54:40.908800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40c10cda-e4cbf3b6-b10e9925-d8b81aa4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:40.918103Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:40.918131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:40.918143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895791208937546:9452]
2025-09-30T14:54:40.918206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:40.918211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:40.918406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:40.918595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:40.918747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:40.918926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:40.919148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:40.919193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:40.931884Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:40.931912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:40.931916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:40.931919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:40.931934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895791208937546:9452]
2025-09-30T14:54:40.931941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895791208937546:9452]
2025-09-30T14:54:40.931947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895791208937546:9452]
2025-09-30T14:54:40.932005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:40.932020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:40.932028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:40.932024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1606 sessionId: src_id|40c10cda-e4cbf3b6-b10e9925-d8b81aa4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:40.932145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:40.932169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:40.932175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:40.932238Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:40.935094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:40.968897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895791298695190:9749]
2025-09-30T14:54:40.969188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1605, pipe: [1:7555895791298695190:9749]
2025-09-30T14:54:41.048579Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:41.049003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:41.049021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:41.049041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895791298695190:9749], now have 1 active actors on pipe
2025-09-30T14:54:41.049328Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:41.049446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895791298695190:9749]
2025-09-30T14:54:41.049483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:41.049577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1606 reason: status is not ok: tablet will be restarted right now sessionId: src_id|40c10cda-e4cbf3b6-b10e9925-d8b81aa4_0
2025-09-30T14:54:41.049674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:41.049779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1606 sessionId: src_id|40c10cda-e4cbf3b6-b10e9925-d8b81aa4_0 is DEAD
2025-09-30T14:54:41.049945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40c10cda-e4cbf3b6-b10e9925-d8b81aa4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:41.049955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40c10cda-e4cbf3b6-b10e9925-d8b81aa4_0] Write session will restart in 0.008807s
2025-09-30T14:54:41.049981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40c10cda-e4cbf3b6-b10e9925-d8b81aa4_0] Write session: Do CDS request
2025-09-30T14:54:41.049988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40c10cda-e4cbf3b6-b10e9925-d8b81aa4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:41.059791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40c10cda-e4cbf3b6-b10e9925-d8b81aa4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:41.059872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:41.059890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1607
2025-09-30T14:54:41.060027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1607 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:41.060060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1607 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:41.060065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1607 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:41.060068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:41.060559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1607 sessionId:  describe result for acl check
2025-09-30T14:54:41.060602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:41.060609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:41.060612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:41.060617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895795593662623:9779] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:41.061207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895795593662623:9779] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:41.064204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895795593662623:9779] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:41.066426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895795593662623:9779] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:41.066441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895795593662623:9779] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:41.066445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895795593662623:9779] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:41.066453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1607 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:41.067492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:41.069718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:41.069938Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:41.069943Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:41.069954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:41.070014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:41.070050Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895795503905039:9454]
2025-09-30T14:54:41.070672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:41.071017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:41.071057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:41.071395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:41.071487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:41.071492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:41.071493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:41.071494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:41.071495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:41.071497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:41.071498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:41.071500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:41.071501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:41.071503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:41.071504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.071505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.071506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.071507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:41.071508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:41.071514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:41.071525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:41.071530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:41.071535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:41.071540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:41.071544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:41.071549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:41.071554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:41.071558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:41.071564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:41.071568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.071573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.071577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.071581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:41.071586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:41.071596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:41.071605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:41.071612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:41.071619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:41.071624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:41.071632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:41.071637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:41.071643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:41.071648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:41.071655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:41.071660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:41.071666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:41.071671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:41.071677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:41.071683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:41.071689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:41.071696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:41.071709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:41.071714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:41.071725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:41.071733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.071741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.071746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.071756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.071761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.071767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.071777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:41.071782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:41.071787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:41.071792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:41.071841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:41.077858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:41.079030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:41.079051Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:41.079054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:41.079058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:41.079065Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1606 [2:7555895795503905039:9454]
2025-09-30T14:54:41.079085Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:41.079101Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:41.079104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:41.079107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:41.079110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:41.079128Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:41.079139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:41.079153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:41.079220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.079229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.079232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.079235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:41.079238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:41.079323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:41.079331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.079346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.079361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.079382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:41.079404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895795503905034:9454]
2025-09-30T14:54:41.079411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895795503905034:9454]
2025-09-30T14:54:41.079414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895795503905034:9454]
2025-09-30T14:54:41.079427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:41.079441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:41.079444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895795593662756:9779], now have 1 active actors on pipe
2025-09-30T14:54:41.079447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895795593662493:2454], now have 1 active actors on pipe
2025-09-30T14:54:41.079456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:41.079456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:41.079458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:41.079471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:41.079475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:41.079514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895795503905034:9454]
2025-09-30T14:54:41.079603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1606
2025-09-30T14:54:41.079605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1606
2025-09-30T14:54:41.079526Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:41.079532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:41.079826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:41.079838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:41.079866Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be647e0b-708bada7-a4ae4361-260b27e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:41.079875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:41.079879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:41.079881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:41.079893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:41.079905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:41.079922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:41.080081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:41.080090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:41.080106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:41.080231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1607 partition: 0 MaxSeqNo: 42 sessionId: src_id|be647e0b-708bada7-a4ae4361-260b27e6_0
2025-09-30T14:54:41.080649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40c10cda-e4cbf3b6-b10e9925-d8b81aa4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|be647e0b-708bada7-a4ae4361-260b27e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:41.083811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be647e0b-708bada7-a4ae4361-260b27e6_0] Write session: try to update token
2025-09-30T14:54:41.083838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be647e0b-708bada7-a4ae4361-260b27e6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:41.092914Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:41.092946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:41.092949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:41.092952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:41.092966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895795503905034:9454]
2025-09-30T14:54:41.092971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895795503905034:9454]
2025-09-30T14:54:41.092977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895795503905034:9454]
2025-09-30T14:54:41.093033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:41.093050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.093048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:41.093055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:41.093057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:41.093063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:41.093234Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:41.103010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1607 sessionId: src_id|be647e0b-708bada7-a4ae4361-260b27e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:41.106173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:41.149665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895795593662774:9749]
2025-09-30T14:54:41.150112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1606, pipe: [1:7555895795593662774:9749]
2025-09-30T14:54:41.218804Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:41.219531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:41.219557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:41.219609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895795593662774:9749], now have 1 active actors on pipe
2025-09-30T14:54:41.219968Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:41.219982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895795593662774:9749]
2025-09-30T14:54:41.220023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:41.220026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:41.220107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1607 reason: error at write: Disconnected sessionId: src_id|be647e0b-708bada7-a4ae4361-260b27e6_0
2025-09-30T14:54:41.220307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1607 sessionId: src_id|be647e0b-708bada7-a4ae4361-260b27e6_0 is DEAD
2025-09-30T14:54:41.220441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:41.222641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be647e0b-708bada7-a4ae4361-260b27e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:41.222655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be647e0b-708bada7-a4ae4361-260b27e6_0] Write session will restart in 0.006505s
2025-09-30T14:54:41.222682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be647e0b-708bada7-a4ae4361-260b27e6_0] Write session: Do CDS request
2025-09-30T14:54:41.222693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be647e0b-708bada7-a4ae4361-260b27e6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:41.230877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be647e0b-708bada7-a4ae4361-260b27e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:41.230977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:41.230994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1608
2025-09-30T14:54:41.231134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1608 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:41.231171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1608 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:41.231182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1608 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:41.231187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:41.231619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1608 sessionId:  describe result for acl check
2025-09-30T14:54:41.231655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:41.231661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:41.231665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:41.231671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895795593662886:9784] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:41.232224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895795593662886:9784] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:41.234565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895795593662886:9784] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:41.244364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:41.244395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895795593662886:9784] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:41.244415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895795593662886:9784] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:41.244423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895795593662886:9784] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:41.244453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1608 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:41.249499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:41.249748Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:41.249763Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:41.249787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:41.249863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:41.249909Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895795503905231:9456]
2025-09-30T14:54:41.250564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:41.250957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:41.251010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:41.251393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:41.251481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:41.251489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:41.251491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:41.251493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:41.251495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:41.251497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:41.251498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:41.251500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:41.251501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:41.251502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:41.251504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.251505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.251506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.251508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:41.251509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:41.251516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:41.251528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:41.251533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:41.251538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:41.251543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:41.251548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:41.251553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:41.251558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:41.251563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:41.251568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:41.251572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.251577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.251582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.251586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:41.251591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:41.251599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:41.251608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:41.251615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:41.251621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:41.251627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:41.251634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:41.251640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:41.251646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:41.251653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:41.251660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:41.251664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:41.251671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:41.251677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:41.251683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:41.251688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:41.251694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:41.251700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:41.251707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:41.251712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:41.251719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:41.251727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.251733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.251738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.251744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.251750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.251756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.251761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:41.251768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:41.251773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:41.251779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:41.251831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:41.261991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:41.263102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:41.263110Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:41.263114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:41.263119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:41.263130Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1607 [2:7555895795503905231:9456]
2025-09-30T14:54:41.263154Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:41.263178Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:41.263183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:41.263187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:41.263191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:41.263213Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:41.263222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:41.263232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:41.263355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.263360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.263363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.263368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:41.263372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:41.263473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:41.263476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.263493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.263504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.263521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:41.263543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895795503905224:9456]
2025-09-30T14:54:41.263546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895795503905224:9456]
2025-09-30T14:54:41.263549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895795503905224:9456]
2025-09-30T14:54:41.263570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:41.263589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:41.263605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:41.263608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:41.263661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895795503905224:9456]
2025-09-30T14:54:41.263664Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:41.263702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895795593662778:2454], now have 1 active actors on pipe
2025-09-30T14:54:41.263708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895795593663042:9784], now have 1 active actors on pipe
2025-09-30T14:54:41.263889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:41.263897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:41.263901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:41.263864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1607
2025-09-30T14:54:41.263867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1607
2025-09-30T14:54:41.263910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:41.264459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:41.264478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:41.264525Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e36d2c0-b5019939-6327c340-61d2538a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:41.264536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:41.264541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:41.264544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:41.264561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:41.264576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:41.264596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:41.265008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:41.265018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:41.265035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:41.265206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1608 partition: 0 MaxSeqNo: 42 sessionId: src_id|3e36d2c0-b5019939-6327c340-61d2538a_0
2025-09-30T14:54:41.265702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be647e0b-708bada7-a4ae4361-260b27e6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3e36d2c0-b5019939-6327c340-61d2538a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:41.268888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e36d2c0-b5019939-6327c340-61d2538a_0] Write session: try to update token
2025-09-30T14:54:41.268914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e36d2c0-b5019939-6327c340-61d2538a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:41.284911Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:41.284939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:41.284942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:41.284945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:41.284972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895795503905224:9456]
2025-09-30T14:54:41.284978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895795503905224:9456]
2025-09-30T14:54:41.284984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895795503905224:9456]
2025-09-30T14:54:41.285049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:41.285061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.285064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:41.285082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:41.285093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:41.285098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:41.285252Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:41.288760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1608 sessionId: src_id|3e36d2c0-b5019939-6327c340-61d2538a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:41.292061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:41.321631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895795593663056:9749]
2025-09-30T14:54:41.321939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1607, pipe: [1:7555895795593663056:9749]
2025-09-30T14:54:41.411345Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:41.412334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:41.412348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:41.412403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895795593663056:9749], now have 1 active actors on pipe
2025-09-30T14:54:41.412910Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:41.412930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:41.412934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:41.412980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895795593663056:9749]
2025-09-30T14:54:41.413004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1608 reason: error at write: Disconnected sessionId: src_id|3e36d2c0-b5019939-6327c340-61d2538a_0
2025-09-30T14:54:41.412787Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:41.413188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1608 sessionId: src_id|3e36d2c0-b5019939-6327c340-61d2538a_0 is DEAD
2025-09-30T14:54:41.413357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e36d2c0-b5019939-6327c340-61d2538a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:41.413369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e36d2c0-b5019939-6327c340-61d2538a_0] Write session will restart in 0.008572s
2025-09-30T14:54:41.413402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e36d2c0-b5019939-6327c340-61d2538a_0] Write session: Do CDS request
2025-09-30T14:54:41.413413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e36d2c0-b5019939-6327c340-61d2538a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:41.423270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e36d2c0-b5019939-6327c340-61d2538a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:41.423459Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:41.423478Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1609
2025-09-30T14:54:41.423745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1609 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:41.423799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1609 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:41.423812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1609 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:41.423818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:41.424399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1609 sessionId:  describe result for acl check
2025-09-30T14:54:41.424443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:41.424453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:41.424456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:41.424464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895795593663094:9788] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:41.425132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895795593663094:9788] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:41.428178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895795593663094:9788] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:41.431965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895795593663094:9788] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:41.431985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895795593663094:9788] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:41.431990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895795593663094:9788] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:41.432001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1609 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:41.433589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:41.435586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:41.435800Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:41.435810Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:41.435821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:41.435873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:41.435914Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895795503905426:9459]
2025-09-30T14:54:41.436565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:41.436888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:41.436938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:41.437257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:41.437322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:41.437332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:41.437333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:41.437334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:41.437336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:41.437337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:41.437338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:41.437339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:41.437341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:41.437342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:41.437344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.437345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.437346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.437347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:41.437348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:41.437355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:41.437366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:41.437370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:41.437375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:41.437379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:41.437384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:41.437388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:41.437392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:41.437397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:41.437402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:41.437406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.437410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.437415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.437419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:41.437423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:41.437431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:41.437439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:41.437445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:41.437451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:41.437456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:41.437462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:41.437467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:41.437473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:41.437478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:41.437482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:41.437487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:41.437492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:41.437498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:41.437503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:41.437508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:41.437512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:41.437517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:41.437524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:41.437528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:41.437533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:41.437538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.437543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.437547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.437563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.437568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.437574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.437578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:41.437583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:41.437588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:41.437593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:41.437645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:41.443440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:41.444739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:41.444764Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:41.444767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:41.444772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:41.444779Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1608 [2:7555895795503905426:9459]
2025-09-30T14:54:41.444797Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:41.444814Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:41.444818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:41.444821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:41.444824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:41.444844Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:41.444852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:41.444859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:41.444928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.444939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.444942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.444946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:41.444949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:41.445025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:41.445035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.445050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.445070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.445092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:41.445116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895795503905421:9459]
2025-09-30T14:54:41.445124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895795503905421:9459]
2025-09-30T14:54:41.445126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895795503905421:9459]
2025-09-30T14:54:41.445141Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:41.445155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:41.445176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:41.445185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:41.445210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:41.445226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:41.445226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895795503905421:9459]
2025-09-30T14:54:41.445228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:41.445229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:41.445240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:41.445364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895795593663321:9788], now have 1 active actors on pipe
2025-09-30T14:54:41.445387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895795593663058:2454], now have 1 active actors on pipe
2025-09-30T14:54:41.445534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1608
2025-09-30T14:54:41.445545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1608
2025-09-30T14:54:41.445614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:41.445637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:41.445670Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f745a894-d0e2a577-406684f3-f4df13fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:41.445688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:41.445695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:41.445697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:41.445709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:41.445721Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:41.445737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:41.445999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:41.446015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:41.446039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:41.446153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1609 partition: 0 MaxSeqNo: 42 sessionId: src_id|f745a894-d0e2a577-406684f3-f4df13fd_0
2025-09-30T14:54:41.446675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e36d2c0-b5019939-6327c340-61d2538a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f745a894-d0e2a577-406684f3-f4df13fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:41.450246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f745a894-d0e2a577-406684f3-f4df13fd_0] Write session: try to update token
2025-09-30T14:54:41.450270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f745a894-d0e2a577-406684f3-f4df13fd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:41.458016Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:41.458045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:41.458059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895795503905421:9459]
2025-09-30T14:54:41.458124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:41.458130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:41.458332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:41.458528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:41.458692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:41.458860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:41.459101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:41.459161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:41.470235Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:41.470265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:41.470268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:41.470270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:41.470282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895795503905421:9459]
2025-09-30T14:54:41.470287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895795503905421:9459]
2025-09-30T14:54:41.470294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895795503905421:9459]
2025-09-30T14:54:41.470346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:41.470354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.470358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:41.470532Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:41.471922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1609 sessionId: src_id|f745a894-d0e2a577-406684f3-f4df13fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:41.474835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:41.475001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:41.475036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:41.475041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:41.513164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895795593663337:9749]
2025-09-30T14:54:41.513484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1608, pipe: [1:7555895795593663337:9749]
2025-09-30T14:54:41.592322Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:41.592794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:41.592814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:41.592839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895795593663337:9749], now have 1 active actors on pipe
2025-09-30T14:54:41.593095Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:41.593123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:41.593189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:41.593300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1609 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f745a894-d0e2a577-406684f3-f4df13fd_0
2025-09-30T14:54:41.593533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1609 sessionId: src_id|f745a894-d0e2a577-406684f3-f4df13fd_0 is DEAD
2025-09-30T14:54:41.593763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f745a894-d0e2a577-406684f3-f4df13fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:41.593782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f745a894-d0e2a577-406684f3-f4df13fd_0] Write session will restart in 0.007198s
2025-09-30T14:54:41.593812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f745a894-d0e2a577-406684f3-f4df13fd_0] Write session: Do CDS request
2025-09-30T14:54:41.593819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f745a894-d0e2a577-406684f3-f4df13fd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:41.593849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895795593663337:9749]
2025-09-30T14:54:41.601919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f745a894-d0e2a577-406684f3-f4df13fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:41.603021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:41.603040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1610
2025-09-30T14:54:41.603217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1610 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:41.603291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1610 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:41.603302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1610 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:41.603308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:41.603835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1610 sessionId:  describe result for acl check
2025-09-30T14:54:41.603882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:41.603888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:41.603890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:41.603897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895795593663469:9802] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:41.604592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895795593663469:9802] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:41.607441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895795593663469:9802] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:41.610848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895795593663469:9802] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:41.610863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895795593663469:9802] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:41.610867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895795593663469:9802] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:41.610875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1610 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:41.611239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:41.613390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:41.613623Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:41.613635Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:41.613649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:41.613702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:41.613747Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895795503905648:9468]
2025-09-30T14:54:41.614524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:41.614986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:41.615030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:41.615406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:41.615473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:41.615480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:41.615481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:41.615482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:41.615484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:41.615485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:41.615486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:41.615488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:41.615490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:41.615491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:41.615493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.615494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.615496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.615497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:41.615499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:41.615505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:41.615516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:41.615520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:41.615524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:41.615529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:41.615533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:41.615537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:41.615542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:41.615546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:41.615551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:41.615555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.615559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.615563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.615568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:41.615572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:41.615579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:41.615587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:41.615593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:41.615605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:41.615610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:41.615621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:41.615626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:41.615632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:41.615637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:41.615642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:41.615647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:41.615653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:41.615658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:41.615664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:41.615668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:41.615678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:41.615683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:41.615688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:41.615693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:41.615699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:41.615709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.615715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.615724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.615729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.615740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.615746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.615751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:41.615759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:41.615764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:41.615775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:41.615825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:41.622063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:41.623637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:41.623656Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:41.623659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:41.623663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:41.623670Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1609 [2:7555895795503905648:9468]
2025-09-30T14:54:41.623690Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:41.623710Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:41.623713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:41.623717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:41.623720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:41.623742Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:41.623757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:41.623765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:41.623845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.623853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.623855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.623860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:41.623863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:41.623962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:41.623969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.624153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1609
2025-09-30T14:54:41.624213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1609
2025-09-30T14:54:41.623984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.623998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.624013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:41.624038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895795593663373:2454], now have 1 active actors on pipe
2025-09-30T14:54:41.624042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895795593663639:9802], now have 1 active actors on pipe
2025-09-30T14:54:41.624051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895795503905642:9468]
2025-09-30T14:54:41.624053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895795503905642:9468]
2025-09-30T14:54:41.624055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895795503905642:9468]
2025-09-30T14:54:41.624070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:41.624085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:41.624097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:41.624100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:41.624100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:41.624103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:41.624114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:41.624155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895795503905642:9468]
2025-09-30T14:54:41.624158Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:41.624183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:41.624383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:41.624401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:41.624479Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cdc94f01-ab69cf47-2c41fb50-e4a5e8f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:41.624517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:41.624535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:41.624540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:41.624560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:41.624588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:41.624626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:41.624844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:41.624853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:41.624872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:41.624970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1610 partition: 0 MaxSeqNo: 42 sessionId: src_id|cdc94f01-ab69cf47-2c41fb50-e4a5e8f7_0
2025-09-30T14:54:41.625419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f745a894-d0e2a577-406684f3-f4df13fd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cdc94f01-ab69cf47-2c41fb50-e4a5e8f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:41.629234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc94f01-ab69cf47-2c41fb50-e4a5e8f7_0] Write session: try to update token
2025-09-30T14:54:41.629270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc94f01-ab69cf47-2c41fb50-e4a5e8f7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:41.638208Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:41.638226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:41.638236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895795503905642:9468]
2025-09-30T14:54:41.638293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:41.638306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:41.638489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:41.638653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:41.638799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:41.638949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:41.639719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:41.639779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:41.651036Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:41.651053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:41.651055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:41.651057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:41.651069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895795503905642:9468]
2025-09-30T14:54:41.651073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895795503905642:9468]
2025-09-30T14:54:41.651077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895795503905642:9468]
2025-09-30T14:54:41.651122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:41.651127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:41.651131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.651132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:41.651134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:41.651137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:41.651310Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:41.652349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1610 sessionId: src_id|cdc94f01-ab69cf47-2c41fb50-e4a5e8f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:41.655368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:41.693912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895795593663662:9749]
2025-09-30T14:54:41.694304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1609, pipe: [1:7555895795593663662:9749]
2025-09-30T14:54:41.772826Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:41.773219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:41.773237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:41.773262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895795593663662:9749], now have 1 active actors on pipe
2025-09-30T14:54:41.773542Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:41.773596Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:41.773664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:41.773764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1610 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cdc94f01-ab69cf47-2c41fb50-e4a5e8f7_0
2025-09-30T14:54:41.774078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895795593663662:9749]
2025-09-30T14:54:41.774106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1610 sessionId: src_id|cdc94f01-ab69cf47-2c41fb50-e4a5e8f7_0 is DEAD
2025-09-30T14:54:41.774187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc94f01-ab69cf47-2c41fb50-e4a5e8f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:41.774200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc94f01-ab69cf47-2c41fb50-e4a5e8f7_0] Write session will restart in 0.005724s
2025-09-30T14:54:41.774231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc94f01-ab69cf47-2c41fb50-e4a5e8f7_0] Write session: Do CDS request
2025-09-30T14:54:41.774238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc94f01-ab69cf47-2c41fb50-e4a5e8f7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:41.780923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc94f01-ab69cf47-2c41fb50-e4a5e8f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:41.781198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:41.781231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1611
2025-09-30T14:54:41.781421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1611 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:41.781465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1611 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:41.781480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1611 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:41.781488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:41.782026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1611 sessionId:  describe result for acl check
2025-09-30T14:54:41.782063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:41.782066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:41.782068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:41.782075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895795593663671:9807] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:41.782624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895795593663671:9807] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:41.788191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895795593663671:9807] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:41.793251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895795593663671:9807] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:41.793269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895795593663671:9807] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:41.793272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895795593663671:9807] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:41.793279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1611 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:41.800399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:41.802772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:41.803028Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:41.803039Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:41.803053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:41.803127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:41.803182Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895795503905868:9477]
2025-09-30T14:54:41.804004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:41.804379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:41.804436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:41.804778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:41.804845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:41.804851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:41.804852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:41.804853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:41.804854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:41.804855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:41.804856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:41.804858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:41.804859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:41.804860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:41.804861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.804863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.804864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.804865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:41.804866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:41.804873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:41.804883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:41.804887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:41.804890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:41.804894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:41.804897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:41.804901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:41.804904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:41.804908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:41.804912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:41.804915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.804919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.804922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.804926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:41.804929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:41.804936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:41.804944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:41.804952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:41.804957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:41.804962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:41.804970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:41.804975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:41.804980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:41.804985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:41.804990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:41.804994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:41.804999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:41.805003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:41.805014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:41.805018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:41.805027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:41.805036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:41.805040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:41.805049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:41.805054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:41.805063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.805071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.805076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.805080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.805084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.805093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.805097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:41.805105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:41.805110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:41.805118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:41.805162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:41.811976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:41.813553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:41.813571Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:41.813575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:41.813580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:41.813588Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1610 [2:7555895795503905868:9477]
2025-09-30T14:54:41.813612Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:41.813635Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:41.813644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:41.813648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:41.813651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:41.813674Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:41.813687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:41.813702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:41.813788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.813797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.813800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.813804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:41.813807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:41.813898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:41.813907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.813923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.813941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.813960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:41.813986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895795593663664:2454], now have 1 active actors on pipe
2025-09-30T14:54:41.813995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895795593663779:9807], now have 1 active actors on pipe
2025-09-30T14:54:41.814003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895795503905863:9477]
2025-09-30T14:54:41.814012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895795503905863:9477]
2025-09-30T14:54:41.814014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895795503905863:9477]
2025-09-30T14:54:41.814030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:41.814048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:41.814050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:41.814059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:41.814061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:41.814067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:41.814071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:41.814121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895795503905863:9477]
2025-09-30T14:54:41.814138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:41.814174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:41.814255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1610
2025-09-30T14:54:41.814309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1610
2025-09-30T14:54:41.819340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:41.819364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:41.819410Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dcdded-6c39358a-9a52ffcc-eb18e678_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:41.819429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:41.819435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:41.819439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:41.819459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:41.819486Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:41.819517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:41.819878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:41.819894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:41.819921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:41.820053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1611 partition: 0 MaxSeqNo: 42 sessionId: src_id|dcdded-6c39358a-9a52ffcc-eb18e678_0
2025-09-30T14:54:41.820463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc94f01-ab69cf47-2c41fb50-e4a5e8f7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dcdded-6c39358a-9a52ffcc-eb18e678_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:41.823636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcdded-6c39358a-9a52ffcc-eb18e678_0] Write session: try to update token
2025-09-30T14:54:41.823660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcdded-6c39358a-9a52ffcc-eb18e678_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:41.838501Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:41.838518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:41.838533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895795503905863:9477]
2025-09-30T14:54:41.838590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:41.838594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:41.838804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:41.838986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:41.839179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:41.839450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:41.839728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:41.839806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:41.841316Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:41.841328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:41.841331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:41.841333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:41.841343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895795503905863:9477]
2025-09-30T14:54:41.841347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895795503905863:9477]
2025-09-30T14:54:41.841352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895795503905863:9477]
2025-09-30T14:54:41.841393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:41.841406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.841410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:41.841604Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:41.841712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:41.841727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:41.841737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:41.841729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1611 sessionId: src_id|dcdded-6c39358a-9a52ffcc-eb18e678_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:41.844461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:41.874120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895795593663945:9749]
2025-09-30T14:54:41.874808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1610, pipe: [1:7555895795593663945:9749]
2025-09-30T14:54:41.964589Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:41.965044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:41.965053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:41.965075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895795593663945:9749], now have 1 active actors on pipe
2025-09-30T14:54:41.965461Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:41.965466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:41.965471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:41.965534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1611 reason: error at write: Disconnected sessionId: src_id|dcdded-6c39358a-9a52ffcc-eb18e678_0
2025-09-30T14:54:41.965536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895795593663945:9749]
2025-09-30T14:54:41.965719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1611 sessionId: src_id|dcdded-6c39358a-9a52ffcc-eb18e678_0 is DEAD
2025-09-30T14:54:41.965658Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:41.967325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcdded-6c39358a-9a52ffcc-eb18e678_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:41.967337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcdded-6c39358a-9a52ffcc-eb18e678_0] Write session will restart in 0.008447s
2025-09-30T14:54:41.967362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcdded-6c39358a-9a52ffcc-eb18e678_0] Write session: Do CDS request
2025-09-30T14:54:41.967371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcdded-6c39358a-9a52ffcc-eb18e678_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:41.979710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcdded-6c39358a-9a52ffcc-eb18e678_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:41.979813Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:41.979830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1612
2025-09-30T14:54:41.979959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1612 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:41.979987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1612 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:41.979993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1612 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:41.979999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:41.980559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1612 sessionId:  describe result for acl check
2025-09-30T14:54:41.980595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:41.980610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:41.980612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:41.980617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895795593664170:9811] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:41.981193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895795593664170:9811] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:41.982927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895795593664170:9811] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:41.983229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:41.985430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:41.985747Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:41.985780Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:41.985825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:41.986000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:41.986058Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895795503906064:9479]
2025-09-30T14:54:41.986291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895795593664170:9811] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:41.986307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895795593664170:9811] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:41.986310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895795593664170:9811] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:41.986320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1612 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:41.986794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:41.987124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:41.987181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:41.987596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:41.987680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:41.987687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:41.987689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:41.987690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:41.987692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:41.987694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:41.987696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:41.987697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:41.987699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:41.987701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:41.987703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.987704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.987706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.987707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:41.987709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:41.987716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:41.987728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:41.987733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:41.987738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:41.987743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:41.987748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:41.987752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:41.987757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:41.987761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:41.987767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:41.987771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.987776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.987781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.987786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:41.987790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:41.987799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:41.987808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:41.987815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:41.987822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:41.987828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:41.987835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:41.987849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:41.987856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:41.987863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:41.987871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:41.987876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:41.987888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:41.987895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:41.987904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:41.987909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:41.987922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:41.987928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:41.987939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:41.987945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:41.987952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:41.987958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.987970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.987978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.987988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.987994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.988005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.988010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:41.988017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:41.988023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:41.988029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:41.988082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:41.994050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:41.995088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:41.995108Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:41.995112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:41.995117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:41.995126Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1611 [2:7555895795503906064:9479]
2025-09-30T14:54:41.995149Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:41.995171Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:41.995175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:41.995179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:41.995183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:41.995205Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:41.995214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:41.995224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:41.995342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.995345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.995348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.995353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:41.995356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:41.995448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:41.995460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:41.995476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:41.995491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:41.995511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:41.995540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895795593664215:9811], now have 1 active actors on pipe
2025-09-30T14:54:41.995545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895795593663949:2454], now have 1 active actors on pipe
2025-09-30T14:54:41.995558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895795503906059:9479]
2025-09-30T14:54:41.995565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895795503906059:9479]
2025-09-30T14:54:41.995568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895795503906059:9479]
2025-09-30T14:54:41.995585Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:41.995607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:41.995624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:41.995630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:41.995634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:41.995635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:41.995638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:41.995674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895795503906059:9479]
2025-09-30T14:54:41.995683Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:41.995654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1611
2025-09-30T14:54:41.995655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1611
2025-09-30T14:54:41.995710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:41.995732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:41.995738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:41.995776Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40d74e6b-1642be97-dbd77625-419b304c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:41.995790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:41.995800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:41.995805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:41.995818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:41.995833Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:41.995855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:41.996062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:41.996073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:41.996091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:41.996235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1612 partition: 0 MaxSeqNo: 42 sessionId: src_id|40d74e6b-1642be97-dbd77625-419b304c_0
2025-09-30T14:54:41.996640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcdded-6c39358a-9a52ffcc-eb18e678_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|40d74e6b-1642be97-dbd77625-419b304c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:41.999453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40d74e6b-1642be97-dbd77625-419b304c_0] Write session: try to update token
2025-09-30T14:54:41.999473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40d74e6b-1642be97-dbd77625-419b304c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:42.008274Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:42.008294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:42.008297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:42.008299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:42.008309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895795503906059:9479]
2025-09-30T14:54:42.008317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895795503906059:9479]
2025-09-30T14:54:42.008322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895795503906059:9479]
2025-09-30T14:54:42.008368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:42.008376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.008380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:42.008431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:42.008441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:42.008445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:42.008525Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:42.022733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1612 sessionId: src_id|40d74e6b-1642be97-dbd77625-419b304c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:42.025467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:42.065625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895799888631523:9749]
2025-09-30T14:54:42.065921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1611, pipe: [1:7555895799888631523:9749]
2025-09-30T14:54:42.123197Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:42.123900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:42.123919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:42.123940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895799888631523:9749], now have 1 active actors on pipe
2025-09-30T14:54:42.124160Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:42.124164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:42.124181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:42.124188Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:42.124234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895799888631523:9749]
2025-09-30T14:54:42.124242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1612 reason: error at write: Disconnected sessionId: src_id|40d74e6b-1642be97-dbd77625-419b304c_0
2025-09-30T14:54:42.124412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1612 sessionId: src_id|40d74e6b-1642be97-dbd77625-419b304c_0 is DEAD
2025-09-30T14:54:42.124563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40d74e6b-1642be97-dbd77625-419b304c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:42.124576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40d74e6b-1642be97-dbd77625-419b304c_0] Write session will restart in 0.006406s
2025-09-30T14:54:42.124600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40d74e6b-1642be97-dbd77625-419b304c_0] Write session: Do CDS request
2025-09-30T14:54:42.124609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40d74e6b-1642be97-dbd77625-419b304c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:42.131830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40d74e6b-1642be97-dbd77625-419b304c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:42.131895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:42.131912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1613
2025-09-30T14:54:42.132062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1613 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:42.132092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1613 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:42.132098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1613 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:42.132103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:42.132535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1613 sessionId:  describe result for acl check
2025-09-30T14:54:42.132562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:42.132564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:42.132567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:42.132573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895799888631571:9816] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:42.133122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895799888631571:9816] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:42.135163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895799888631571:9816] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:42.138225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895799888631571:9816] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:42.138241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895799888631571:9816] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:42.138245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895799888631571:9816] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:42.138253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1613 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:42.140116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:42.142071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:42.142275Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:42.142285Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:42.142296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:42.142356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:42.142393Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895799798873558:9481]
2025-09-30T14:54:42.143075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:42.143438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:42.143492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:42.143822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:42.143879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:42.143885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:42.143886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:42.143888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:42.143889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:42.143890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:42.143892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:42.143893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:42.143894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:42.143895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:42.143897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.143898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.143899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.143901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:42.143902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:42.143907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:42.143918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:42.143922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:42.143927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:42.143931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:42.143935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:42.143939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:42.143943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:42.143948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:42.143954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:42.143958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.143962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.143966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.143970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:42.143974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:42.143981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:42.143989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:42.143995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:42.144001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:42.144005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:42.144011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:42.144016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:42.144024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:42.144030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:42.144035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:42.144040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:42.144045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:42.144054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:42.144060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:42.144065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:42.144075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:42.144080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:42.144090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:42.144095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:42.144100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:42.144109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.144115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.144121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.144128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.144136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.144141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.144147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:42.144154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:42.144159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:42.144164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:42.144215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:42.149947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:42.150851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:42.150867Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:42.150870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:42.150874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:42.150881Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1612 [2:7555895799798873558:9481]
2025-09-30T14:54:42.150899Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:42.150916Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:42.150925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:42.150928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:42.150931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:42.150947Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:42.150958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:42.150965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:42.151037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.151044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.151047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.151051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:42.151054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:42.151130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:42.151140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.151152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.151162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.151179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:42.151198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895799888631530:2454], now have 1 active actors on pipe
2025-09-30T14:54:42.151202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895799888631798:9816], now have 1 active actors on pipe
2025-09-30T14:54:42.151209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895799798873553:9481]
2025-09-30T14:54:42.151212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895799798873553:9481]
2025-09-30T14:54:42.151214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895799798873553:9481]
2025-09-30T14:54:42.151228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:42.151266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:42.151277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:42.151281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:42.151281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:42.151284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:42.151284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:42.151318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895799798873553:9481]
2025-09-30T14:54:42.151328Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:42.151318Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1612
2025-09-30T14:54:42.151332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:42.151368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:42.151372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:42.151322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1612
2025-09-30T14:54:42.151402Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb9a6cd-c0146ed8-71d06cb3-cb025bc5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:42.151416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:42.151420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:42.151422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:42.151434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:42.151443Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:42.151456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:42.151601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:42.151609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:42.151620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:42.151707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1613 partition: 0 MaxSeqNo: 42 sessionId: src_id|fb9a6cd-c0146ed8-71d06cb3-cb025bc5_0
2025-09-30T14:54:42.152069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40d74e6b-1642be97-dbd77625-419b304c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fb9a6cd-c0146ed8-71d06cb3-cb025bc5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:42.154894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb9a6cd-c0146ed8-71d06cb3-cb025bc5_0] Write session: try to update token
2025-09-30T14:54:42.154912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb9a6cd-c0146ed8-71d06cb3-cb025bc5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:42.164114Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:42.164136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:42.164138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:42.164140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:42.164150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895799798873553:9481]
2025-09-30T14:54:42.164154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895799798873553:9481]
2025-09-30T14:54:42.164160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895799798873553:9481]
2025-09-30T14:54:42.164201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:42.164203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:42.164206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.164208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:42.164209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:42.164212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:42.164356Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:42.170566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1613 sessionId: src_id|fb9a6cd-c0146ed8-71d06cb3-cb025bc5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:42.173421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:42.224346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895799888631815:9749]
2025-09-30T14:54:42.224650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1612, pipe: [1:7555895799888631815:9749]
2025-09-30T14:54:42.276377Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:42.277063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:42.277079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:42.277118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895799888631815:9749], now have 1 active actors on pipe
2025-09-30T14:54:42.277352Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:42.277341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:42.277341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895799888631815:9749]
2025-09-30T14:54:42.277355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:42.277365Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:42.277420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1613 reason: error at write: Disconnected sessionId: src_id|fb9a6cd-c0146ed8-71d06cb3-cb025bc5_0
2025-09-30T14:54:42.277648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1613 sessionId: src_id|fb9a6cd-c0146ed8-71d06cb3-cb025bc5_0 is DEAD
2025-09-30T14:54:42.277802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb9a6cd-c0146ed8-71d06cb3-cb025bc5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:42.277812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb9a6cd-c0146ed8-71d06cb3-cb025bc5_0] Write session will restart in 0.006074s
2025-09-30T14:54:42.277835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb9a6cd-c0146ed8-71d06cb3-cb025bc5_0] Write session: Do CDS request
2025-09-30T14:54:42.277841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb9a6cd-c0146ed8-71d06cb3-cb025bc5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:42.284839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb9a6cd-c0146ed8-71d06cb3-cb025bc5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:42.284969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:42.284985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1614
2025-09-30T14:54:42.285121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1614 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:42.285169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1614 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:42.285179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1614 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:42.285186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:42.285600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1614 sessionId:  describe result for acl check
2025-09-30T14:54:42.285646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:42.285653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:42.285655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:42.285675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895799888631864:9820] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:42.286289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895799888631864:9820] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:42.288544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895799888631864:9820] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:42.291960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895799888631864:9820] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:42.291978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895799888631864:9820] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:42.291983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895799888631864:9820] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:42.291992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1614 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:42.293699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:42.295846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:42.296072Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:42.296083Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:42.296095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:42.296157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:42.296203Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895799798873756:9483]
2025-09-30T14:54:42.296882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:42.297258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:42.297335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:42.297728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:42.297805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:42.297811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:42.297811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:42.297812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:42.297813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:42.297814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:42.297815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:42.297816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:42.297817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:42.297818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:42.297820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.297821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.297822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.297823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:42.297824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:42.297830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:42.297842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:42.297846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:42.297861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:42.297865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:42.297870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:42.297874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:42.297878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:42.297882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:42.297887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:42.297891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.297895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.297900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.297904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:42.297908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:42.297916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:42.297925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:42.297932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:42.297938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:42.297943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:42.297949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:42.297953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:42.297959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:42.297964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:42.297969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:42.297975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:42.297980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:42.297985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:42.297992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:42.297996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:42.298002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:42.298007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:42.298013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:42.298017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:42.298022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:42.298027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.298034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.298038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.298043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.298047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.298053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.298057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:42.298068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:42.298072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:42.298077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:42.298127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:42.303954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:42.304861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:42.304880Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:42.304882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:42.304885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:42.304892Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1613 [2:7555895799798873756:9483]
2025-09-30T14:54:42.304906Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:42.304921Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:42.304924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:42.304926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:42.304928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:42.304944Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:42.304950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:42.304957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:42.305023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.305034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.305036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.305039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:42.305041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:42.305101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:42.305103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.305113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.305120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.305130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:42.305143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895799798873751:9483]
2025-09-30T14:54:42.305145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895799798873751:9483]
2025-09-30T14:54:42.305147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895799798873751:9483]
2025-09-30T14:54:42.305155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:42.305167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:42.305169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:42.305171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:42.305174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:42.305182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:42.305185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:42.305195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895799888631816:2454], now have 1 active actors on pipe
2025-09-30T14:54:42.305199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895799888632084:9820], now have 1 active actors on pipe
2025-09-30T14:54:42.305237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895799798873751:9483]
2025-09-30T14:54:42.305251Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:42.305258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:42.305300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1613
2025-09-30T14:54:42.305304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1613
2025-09-30T14:54:42.305395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:42.305405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:42.305432Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4cece0ce-243289cf-198d4720-cbbc8ac4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:42.305444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:42.305447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:42.305450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:42.305461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:42.305475Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:42.305490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:42.305609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:42.305616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:42.305628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:42.305716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1614 partition: 0 MaxSeqNo: 42 sessionId: src_id|4cece0ce-243289cf-198d4720-cbbc8ac4_0
2025-09-30T14:54:42.306101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb9a6cd-c0146ed8-71d06cb3-cb025bc5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4cece0ce-243289cf-198d4720-cbbc8ac4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:42.309066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cece0ce-243289cf-198d4720-cbbc8ac4_0] Write session: try to update token
2025-09-30T14:54:42.309087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cece0ce-243289cf-198d4720-cbbc8ac4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:42.323498Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:42.323513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:42.323527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895799798873751:9483]
2025-09-30T14:54:42.323577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:42.323583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:42.323773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:42.323935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:42.324083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:42.324231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:42.324455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:42.324506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:42.324485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1614 sessionId: src_id|4cece0ce-243289cf-198d4720-cbbc8ac4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:42.327318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:42.328536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:42.328566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:42.328586Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:42.328589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:42.328591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:42.328593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:42.328602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895799798873751:9483]
2025-09-30T14:54:42.328606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895799798873751:9483]
2025-09-30T14:54:42.328610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895799798873751:9483]
2025-09-30T14:54:42.328656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:42.328656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:42.328662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:42.328666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:42.328667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.328669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:42.328805Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:42.377419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895799888632099:9749]
2025-09-30T14:54:42.377720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1613, pipe: [1:7555895799888632099:9749]
2025-09-30T14:54:42.443796Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:42.444361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:42.444393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895799888632099:9749], now have 1 active actors on pipe
2025-09-30T14:54:42.444510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:42.444635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895799888632099:9749]
2025-09-30T14:54:42.444665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:42.456964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:42.456980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:42.457006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1614 reason: error at write: Disconnected sessionId: src_id|4cece0ce-243289cf-198d4720-cbbc8ac4_0
2025-09-30T14:54:42.457167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1614 sessionId: src_id|4cece0ce-243289cf-198d4720-cbbc8ac4_0 is DEAD
2025-09-30T14:54:42.457287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cece0ce-243289cf-198d4720-cbbc8ac4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:42.457301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cece0ce-243289cf-198d4720-cbbc8ac4_0] Write session will restart in 0.005214s
2025-09-30T14:54:42.457365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cece0ce-243289cf-198d4720-cbbc8ac4_0] Write session: Do CDS request
2025-09-30T14:54:42.457371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cece0ce-243289cf-198d4720-cbbc8ac4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:42.463778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cece0ce-243289cf-198d4720-cbbc8ac4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:42.463876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:42.463894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1615
2025-09-30T14:54:42.464030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1615 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:42.464064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1615 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:42.464075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1615 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:42.464079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:42.464467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1615 sessionId:  describe result for acl check
2025-09-30T14:54:42.464502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:42.464507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:42.464509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:42.464515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895799888632292:9824] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:42.465054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895799888632292:9824] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:42.468221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:42.469260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895799888632292:9824] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:42.471601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:42.471827Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:42.471837Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:42.471849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:42.471916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:42.472201Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895799798873968:9486]
2025-09-30T14:54:42.472269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895799888632292:9824] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:42.472285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895799888632292:9824] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:42.472288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895799888632292:9824] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:42.472296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1615 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:42.472854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:42.473164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:42.473209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:42.473551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:42.473631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:42.473637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:42.473638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:42.473639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:42.473640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:42.473641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:42.473642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:42.473643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:42.473644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:42.473645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:42.473646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.473648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.473649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.473650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:42.473651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:42.473656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:42.473666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:42.473671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:42.473675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:42.473679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:42.473684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:42.473688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:42.473692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:42.473696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:42.473701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:42.473705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.473709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.473714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.473717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:42.473721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:42.473728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:42.473735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:42.473741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:42.473747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:42.473752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:42.473758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:42.473772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:42.473778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:42.473783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:42.473788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:42.473793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:42.473799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:42.473805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:42.473810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:42.473815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:42.473820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:42.473832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:42.473837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:42.473846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:42.473852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:42.473856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.473866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.473871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.473879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.473884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.473893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.473897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:42.473904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:42.473914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:42.473920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:42.473967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:42.479543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:42.480385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:42.480409Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:42.480412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:42.480416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:42.480424Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1614 [2:7555895799798873968:9486]
2025-09-30T14:54:42.480441Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:42.480458Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:42.480461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:42.480464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:42.480467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:42.480484Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:42.480491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:42.480498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:42.480560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.480570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.480572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.480575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:42.480578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:42.480645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:42.480654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.480666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.480679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.480695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:42.480714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895799888632100:2454], now have 1 active actors on pipe
2025-09-30T14:54:42.480723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895799888632374:9824], now have 1 active actors on pipe
2025-09-30T14:54:42.480730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895799798873954:9486]
2025-09-30T14:54:42.480732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895799798873954:9486]
2025-09-30T14:54:42.480734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895799798873954:9486]
2025-09-30T14:54:42.480746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:42.480761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:42.480762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:42.480766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:42.480769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:42.480775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:42.480779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:42.480816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895799798873954:9486]
2025-09-30T14:54:42.480829Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:42.480844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:42.480817Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1614
2025-09-30T14:54:42.480833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1614
2025-09-30T14:54:42.480886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:42.480896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:42.480919Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ac6006-b6a6216b-9b2fcb7a-99f7b449_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:42.480934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:42.480938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:42.480940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:42.480949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:42.480959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:42.480972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:42.481102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:42.481110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:42.481122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:42.481218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1615 partition: 0 MaxSeqNo: 42 sessionId: src_id|3ac6006-b6a6216b-9b2fcb7a-99f7b449_0
2025-09-30T14:54:42.481546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cece0ce-243289cf-198d4720-cbbc8ac4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3ac6006-b6a6216b-9b2fcb7a-99f7b449_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:42.484299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ac6006-b6a6216b-9b2fcb7a-99f7b449_0] Write session: try to update token
2025-09-30T14:54:42.484314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ac6006-b6a6216b-9b2fcb7a-99f7b449_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:42.493201Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:42.493219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:42.493228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895799798873954:9486]
2025-09-30T14:54:42.493270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:42.493290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:42.493444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:42.493599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:42.493745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:42.493904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:42.494106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:42.494148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:42.498683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1615 sessionId: src_id|3ac6006-b6a6216b-9b2fcb7a-99f7b449_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:42.501391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:42.501579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:42.501602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:42.501641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:42.501750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:42.504212Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:42.504227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:42.504229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:42.504231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:42.504239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895799798873954:9486]
2025-09-30T14:54:42.504242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895799798873954:9486]
2025-09-30T14:54:42.504246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895799798873954:9486]
2025-09-30T14:54:42.504274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:42.504280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.504286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:42.504296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:42.504303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:42.504307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:42.504430Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:42.544843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895799888632397:9749]
2025-09-30T14:54:42.545150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1614, pipe: [1:7555895799888632397:9749]
2025-09-30T14:54:42.620347Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:42.629132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:42.629159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:42.629328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:42.629397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:42.629470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:42.629537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:42.629946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:42.629959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:42.630035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:42.630107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:42.630181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:42.630253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:42.630306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:42.630315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:42.630397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:42.630466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:42.630539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:42.630610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:42.630656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:42.630664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:42.630738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:42.630822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:42.630905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:42.630973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:42.631019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:42.631028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:42.631108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:42.631183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:42.631277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:42.631347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:42.631394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:42.631405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:42.631476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:42.631546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:42.631616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:42.631686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:42.631735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:42.631746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:42.631821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:42.631883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:42.631956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:42.632029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:42.632172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:42.632181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:42.632257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:42.632330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:42.632395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:42.632467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:42.632537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:42.632544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:42.632614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:42.632681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:42.632751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:42.632826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:42.632876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:42.632883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:42.632954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:42.633021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:42.633090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:42.633159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:42.633210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:42.633218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:42.633275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895799888632397:9749], now have 1 active actors on pipe
2025-09-30T14:54:42.633507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:42.633518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895799888632397:9749]
2025-09-30T14:54:42.633547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:42.633550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:42.633589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1615 reason: error at write: Disconnected sessionId: src_id|3ac6006-b6a6216b-9b2fcb7a-99f7b449_0
2025-09-30T14:54:42.633799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1615 sessionId: src_id|3ac6006-b6a6216b-9b2fcb7a-99f7b449_0 is DEAD
2025-09-30T14:54:42.633908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ac6006-b6a6216b-9b2fcb7a-99f7b449_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:42.633918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ac6006-b6a6216b-9b2fcb7a-99f7b449_0] Write session will restart in 0.008114s
2025-09-30T14:54:42.633941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ac6006-b6a6216b-9b2fcb7a-99f7b449_0] Write session: Do CDS request
2025-09-30T14:54:42.633947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ac6006-b6a6216b-9b2fcb7a-99f7b449_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:42.634009Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:42.642801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ac6006-b6a6216b-9b2fcb7a-99f7b449_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:42.642886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:42.642902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1616
2025-09-30T14:54:42.643031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1616 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:42.643063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1616 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:42.643072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1616 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:42.643076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:42.643491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1616 sessionId:  describe result for acl check
2025-09-30T14:54:42.643525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:42.643528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:42.643531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:42.643537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895799888632514:9836] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:42.644072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895799888632514:9836] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:42.646418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895799888632514:9836] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:42.649537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895799888632514:9836] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:42.649551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895799888632514:9836] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:42.649558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895799888632514:9836] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:42.649566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1616 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:42.650643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:42.652627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:42.652855Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:42.652866Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:42.652877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:42.652932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:42.652969Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895799798874182:9495]
2025-09-30T14:54:42.653657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:42.654006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:42.654045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:42.654384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:42.654444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:42.654450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:42.654451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:42.654452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:42.654454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:42.654455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:42.654456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:42.654458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:42.654459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:42.654460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:42.654461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.654462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.654463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.654465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:42.654466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:42.654471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:42.654481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:42.654486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:42.654490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:42.654494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:42.654498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:42.654503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:42.654507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:42.654511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:42.654515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:42.654519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.654523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.654527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.654531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:42.654535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:42.654541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:42.654550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:42.654556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:42.654562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:42.654569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:42.654575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:42.654584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:42.654589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:42.654598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:42.654604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:42.654613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:42.654618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:42.654627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:42.654633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:42.654643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:42.654648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:42.654654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:42.654664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:42.654668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:42.654673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:42.654681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.654690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.654694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.654699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.654708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.654713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.654718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:42.654728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:42.654732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:42.654742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:42.654786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:42.660709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:42.661734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:42.661750Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:42.661753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:42.661757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:42.661776Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1615 [2:7555895799798874182:9495]
2025-09-30T14:54:42.661793Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:42.661808Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:42.661811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:42.661814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:42.661816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:42.661832Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:42.661843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:42.661850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:42.661913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.661924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.661926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.661930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:42.661932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:42.661998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:42.662005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.662017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.662031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.662051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:42.662077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895799888632685:9836], now have 1 active actors on pipe
2025-09-30T14:54:42.662085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895799888632400:2454], now have 1 active actors on pipe
2025-09-30T14:54:42.662102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895799798874177:9495]
2025-09-30T14:54:42.662104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895799798874177:9495]
2025-09-30T14:54:42.662106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895799798874177:9495]
2025-09-30T14:54:42.662120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:42.662138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:42.662157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:42.662157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:42.662162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:42.662164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:42.662165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:42.662201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895799798874177:9495]
2025-09-30T14:54:42.662204Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:42.662191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1615
2025-09-30T14:54:42.662230Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1615
2025-09-30T14:54:42.662222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:42.662235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:42.662239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:42.662263Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4df869d-de0e1846-a45a034-751ac797_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:42.662271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:42.662274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:42.662277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:42.662286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:42.662294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:42.662312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:42.662570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:42.662585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:42.662611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:42.662689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1616 partition: 0 MaxSeqNo: 42 sessionId: src_id|d4df869d-de0e1846-a45a034-751ac797_0
2025-09-30T14:54:42.663067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ac6006-b6a6216b-9b2fcb7a-99f7b449_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d4df869d-de0e1846-a45a034-751ac797_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:42.666011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4df869d-de0e1846-a45a034-751ac797_0] Write session: try to update token
2025-09-30T14:54:42.666029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4df869d-de0e1846-a45a034-751ac797_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:42.675378Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:42.675396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:42.675398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:42.675400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:42.675410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895799798874177:9495]
2025-09-30T14:54:42.675414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895799798874177:9495]
2025-09-30T14:54:42.675417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895799798874177:9495]
2025-09-30T14:54:42.675459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:42.675464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:42.675466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.675468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:42.675482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:42.675487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:42.675627Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:42.683478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1616 sessionId: src_id|d4df869d-de0e1846-a45a034-751ac797_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:42.686494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:42.735359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895799888632708:9749]
2025-09-30T14:54:42.739437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1615, pipe: [1:7555895799888632708:9749]
2025-09-30T14:54:42.791639Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:42.792752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:42.792776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:42.792825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895799888632708:9749], now have 1 active actors on pipe
2025-09-30T14:54:42.793070Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:42.793491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895799888632708:9749]
2025-09-30T14:54:42.793533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:42.793571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:42.793657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1616 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d4df869d-de0e1846-a45a034-751ac797_0
2025-09-30T14:54:42.793827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1616 sessionId: src_id|d4df869d-de0e1846-a45a034-751ac797_0 is DEAD
2025-09-30T14:54:42.793965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4df869d-de0e1846-a45a034-751ac797_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:42.793975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4df869d-de0e1846-a45a034-751ac797_0] Write session will restart in 0.009409s
2025-09-30T14:54:42.793998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4df869d-de0e1846-a45a034-751ac797_0] Write session: Do CDS request
2025-09-30T14:54:42.794003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4df869d-de0e1846-a45a034-751ac797_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:42.804777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4df869d-de0e1846-a45a034-751ac797_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:42.804884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:42.804900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1617
2025-09-30T14:54:42.805036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1617 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:42.805074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1617 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:42.805083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1617 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:42.805088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:42.805567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1617 sessionId:  describe result for acl check
2025-09-30T14:54:42.805606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:42.805613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:42.805615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:42.805621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895799888632877:9841] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:42.806212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895799888632877:9841] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:42.808727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895799888632877:9841] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:42.809994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:42.811986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:42.812179Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:42.812206Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:42.812217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:42.812271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:42.812312Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895799798874406:9504]
2025-09-30T14:54:42.812385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895799888632877:9841] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:42.812401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895799888632877:9841] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:42.812404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895799888632877:9841] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:42.812413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1617 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:42.812804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:42.813096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:42.813128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:42.813438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:42.813500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:42.813507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:42.813509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:42.813510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:42.813511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:42.813512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:42.813513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:42.813515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:42.813516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:42.813517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:42.813518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.813519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.813520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.813521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:42.813523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:42.813528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:42.813540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:42.813544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:42.813548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:42.813552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:42.813556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:42.813560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:42.813564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:42.813568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:42.813573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:42.813577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.813582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.813586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.813590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:42.813595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:42.813601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:42.813609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:42.813615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:42.813621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:42.813627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:42.813632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:42.813636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:42.813641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:42.813646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:42.813651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:42.813656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:42.813661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:42.813665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:42.813670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:42.813673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:42.813678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:42.813683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:42.813687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:42.813691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:42.813697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:42.813700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.813705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.813710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.813715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.813720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.813725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.813729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:42.813735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:42.813739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:42.813745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:42.813810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:42.819396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:42.820718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:42.820730Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:42.820733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:42.820737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:42.820743Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1616 [2:7555895799798874406:9504]
2025-09-30T14:54:42.820760Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:42.820775Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:42.820779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:42.820781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:42.820784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:42.820799Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:42.820811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:42.820820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:42.820883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.820890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.820893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.820896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:42.820899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:42.820965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:42.820972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.820986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.821003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.821020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:42.821042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895799888632983:9841], now have 1 active actors on pipe
2025-09-30T14:54:42.821050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895799888632709:2454], now have 1 active actors on pipe
2025-09-30T14:54:42.821056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895799798874401:9504]
2025-09-30T14:54:42.821060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895799798874401:9504]
2025-09-30T14:54:42.821062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895799798874401:9504]
2025-09-30T14:54:42.821075Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:42.821091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:42.821095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:42.821099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:42.821102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:42.821110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:42.821113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:42.821117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1616
2025-09-30T14:54:42.821143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895799798874401:9504]
2025-09-30T14:54:42.821153Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:42.821138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1616
2025-09-30T14:54:42.821157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:42.821194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:42.821198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:42.821220Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a5b58a1-140e272e-ac5ac06f-406a23a2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:42.821234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:42.821239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:42.821244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:42.821254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:42.821262Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:42.821274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:42.821430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:42.821439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:42.821452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:42.821525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1617 partition: 0 MaxSeqNo: 42 sessionId: src_id|3a5b58a1-140e272e-ac5ac06f-406a23a2_0
2025-09-30T14:54:42.821906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4df869d-de0e1846-a45a034-751ac797_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3a5b58a1-140e272e-ac5ac06f-406a23a2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:42.824782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a5b58a1-140e272e-ac5ac06f-406a23a2_0] Write session: try to update token
2025-09-30T14:54:42.824801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a5b58a1-140e272e-ac5ac06f-406a23a2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:42.833560Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:42.833580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:42.833590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895799798874401:9504]
2025-09-30T14:54:42.833632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:42.833645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:42.833819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:42.833973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:42.834119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:42.834267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:42.834467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:42.834508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:42.840860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1617 sessionId: src_id|3a5b58a1-140e272e-ac5ac06f-406a23a2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:42.843601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:42.844691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:42.844717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:42.844737Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:42.844740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:42.844743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:42.844745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:42.844753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895799798874401:9504]
2025-09-30T14:54:42.844758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895799798874401:9504]
2025-09-30T14:54:42.844762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895799798874401:9504]
2025-09-30T14:54:42.844812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:42.844812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:42.844819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:42.844822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.844823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:42.844825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:42.844969Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:42.893479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895799888632995:9749]
2025-09-30T14:54:42.893772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1616, pipe: [1:7555895799888632995:9749]
2025-09-30T14:54:42.957954Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:42.958234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:42.958267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895799888632995:9749], now have 1 active actors on pipe
2025-09-30T14:54:42.958383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:42.958480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895799888632995:9749]
2025-09-30T14:54:42.958495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:42.958498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:42.958508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:42.958576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1617 reason: error at write: Disconnected sessionId: src_id|3a5b58a1-140e272e-ac5ac06f-406a23a2_0
2025-09-30T14:54:42.958715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1617 sessionId: src_id|3a5b58a1-140e272e-ac5ac06f-406a23a2_0 is DEAD
2025-09-30T14:54:42.958923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a5b58a1-140e272e-ac5ac06f-406a23a2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:42.958933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a5b58a1-140e272e-ac5ac06f-406a23a2_0] Write session will restart in 0.006804s
2025-09-30T14:54:42.958955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a5b58a1-140e272e-ac5ac06f-406a23a2_0] Write session: Do CDS request
2025-09-30T14:54:42.958961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a5b58a1-140e272e-ac5ac06f-406a23a2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:42.966662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a5b58a1-140e272e-ac5ac06f-406a23a2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:42.966738Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:42.966769Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1618
2025-09-30T14:54:42.966895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1618 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:42.966929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1618 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:42.966939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1618 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:42.966944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:42.967400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1618 sessionId:  describe result for acl check
2025-09-30T14:54:42.967438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:42.967447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:42.967449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:42.967456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895799888633072:9845] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:42.968026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895799888633072:9845] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:42.970093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895799888633072:9845] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:42.972940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895799888633072:9845] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:42.972956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895799888633072:9845] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:42.972959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895799888633072:9845] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:42.972968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1618 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:42.974424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:42.976786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:42.977002Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:42.977014Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:42.977025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:42.977076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:42.977115Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895799798874608:9506]
2025-09-30T14:54:42.977812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:42.978110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:42.978155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:42.978496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:42.978555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:42.978561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:42.978562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:42.978564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:42.978566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:42.978567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:42.978568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:42.978569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:42.978570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:42.978572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:42.978573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.978575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.978576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.978577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:42.978578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:42.978583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:42.978594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:42.978599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:42.978604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:42.978608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:42.978612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:42.978616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:42.978620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:42.978624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:42.978628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:42.978632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.978635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.978643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.978647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:42.978655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:42.978663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:42.978674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:42.978685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:42.978691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:42.978701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:42.978706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:42.978716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:42.978721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:42.978731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:42.978736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:42.978741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:42.978751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:42.978756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:42.978765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:42.978770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:42.978776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:42.978783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:42.978792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:42.978797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:42.978802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:42.978807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.978817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.978821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.978827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.978835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.978841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.978849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:42.978866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:42.978875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:42.978881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:42.978932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:42.984319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:42.985552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:42.985567Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:42.985570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:42.985574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:42.985579Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1617 [2:7555895799798874608:9506]
2025-09-30T14:54:42.985595Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:42.985610Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:42.985614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:42.985616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:42.985618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:42.985635Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:42.985642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:42.985650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:42.985705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.985713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.985715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.985719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:42.985721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:42.985796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:42.985805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.985817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:42.985832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:42.985851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:42.985874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895799888632999:2454], now have 1 active actors on pipe
2025-09-30T14:54:42.985882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895799888633269:9845], now have 1 active actors on pipe
2025-09-30T14:54:42.985889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895799798874603:9506]
2025-09-30T14:54:42.985891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895799798874603:9506]
2025-09-30T14:54:42.985895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895799798874603:9506]
2025-09-30T14:54:42.985908Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:42.985928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:42.985931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:42.985936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:42.985940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:42.985946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:42.985949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:42.985917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1617
2025-09-30T14:54:42.985974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895799798874603:9506]
2025-09-30T14:54:42.985948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1617
2025-09-30T14:54:42.985981Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:42.986002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:42.986005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:42.986012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:42.986045Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1db0923-27982fcc-371f0fd7-e1a5346c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:42.986059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:42.986063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:42.986065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:42.986074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:42.986083Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:42.986097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:42.986248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:42.986255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:42.986268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:42.986351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1618 partition: 0 MaxSeqNo: 42 sessionId: src_id|e1db0923-27982fcc-371f0fd7-e1a5346c_0
2025-09-30T14:54:42.986696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a5b58a1-140e272e-ac5ac06f-406a23a2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e1db0923-27982fcc-371f0fd7-e1a5346c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:42.989474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1db0923-27982fcc-371f0fd7-e1a5346c_0] Write session: try to update token
2025-09-30T14:54:42.989490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1db0923-27982fcc-371f0fd7-e1a5346c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:42.998426Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:42.998452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:42.998454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:42.998456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:42.998468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895799798874603:9506]
2025-09-30T14:54:42.998475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895799798874603:9506]
2025-09-30T14:54:42.998480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895799798874603:9506]
2025-09-30T14:54:42.998526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:42.998527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:42.998533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:42.998537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:42.998543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:42.998545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:42.998737Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:43.006318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1618 sessionId: src_id|e1db0923-27982fcc-371f0fd7-e1a5346c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:43.009139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:43.058897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895804183600579:9749]
2025-09-30T14:54:43.059185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1617, pipe: [1:7555895804183600579:9749]
2025-09-30T14:54:43.107335Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:43.107600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:43.107613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:43.107631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895804183600579:9749], now have 1 active actors on pipe
2025-09-30T14:54:43.107843Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:43.107838Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:43.107880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:43.107882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:43.107884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895804183600579:9749]
2025-09-30T14:54:43.107949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1618 reason: error at write: Disconnected sessionId: src_id|e1db0923-27982fcc-371f0fd7-e1a5346c_0
2025-09-30T14:54:43.108127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1618 sessionId: src_id|e1db0923-27982fcc-371f0fd7-e1a5346c_0 is DEAD
2025-09-30T14:54:43.108296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1db0923-27982fcc-371f0fd7-e1a5346c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:43.108304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1db0923-27982fcc-371f0fd7-e1a5346c_0] Write session will restart in 0.009278s
2025-09-30T14:54:43.108327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1db0923-27982fcc-371f0fd7-e1a5346c_0] Write session: Do CDS request
2025-09-30T14:54:43.108332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1db0923-27982fcc-371f0fd7-e1a5346c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:43.118751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1db0923-27982fcc-371f0fd7-e1a5346c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:43.118832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:43.118864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1619
2025-09-30T14:54:43.119002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1619 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:43.119040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1619 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:43.119050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1619 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:43.119054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:43.119480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1619 sessionId:  describe result for acl check
2025-09-30T14:54:43.119514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:43.119521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:43.119522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:43.119528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895804183600769:9852] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:43.120101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895804183600769:9852] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:43.122355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895804183600769:9852] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:43.123153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:43.124766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:43.124946Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:43.124958Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:43.124970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:43.124952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895804183600769:9852] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:43.124969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895804183600769:9852] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:43.124973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895804183600769:9852] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:43.124980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1619 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:43.125023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:43.125058Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895804093842105:9508]
2025-09-30T14:54:43.125610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:43.125883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:43.125920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:43.126202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:43.126245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:43.126250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:43.126251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:43.126251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:43.126252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:43.126253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:43.126253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:43.126254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:43.126254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:43.126255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:43.126256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.126256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.126257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.126258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:43.126258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:43.126262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:43.126268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:43.126271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:43.126273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:43.126276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:43.126278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:43.126280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:43.126282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:43.126285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:43.126287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:43.126290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.126292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.126294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.126296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:43.126299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:43.126303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:43.126309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:43.126313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:43.126316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:43.126319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:43.126322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:43.126325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:43.126329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:43.126332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:43.126337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:43.126341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:43.126346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:43.126350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:43.126355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:43.126359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:43.126366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:43.126371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:43.126376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:43.126379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:43.126384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:43.126389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.126393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.126397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.126402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.126406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.126411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.126416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:43.126421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:43.126425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:43.126430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:43.126475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:43.131594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:43.132531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:43.132549Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:43.132552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:43.132556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:43.132561Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1618 [2:7555895804093842105:9508]
2025-09-30T14:54:43.132576Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:43.132590Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:43.132598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:43.132601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:43.132603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:43.132617Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:43.132627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:43.132634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:43.132691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.132699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.132702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.132705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:43.132708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:43.132770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:43.132778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.132789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.132805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.132825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:43.132847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895804183600865:9852], now have 1 active actors on pipe
2025-09-30T14:54:43.132855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895804183600588:2454], now have 1 active actors on pipe
2025-09-30T14:54:43.132862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895804093842100:9508]
2025-09-30T14:54:43.132864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895804093842100:9508]
2025-09-30T14:54:43.132866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895804093842100:9508]
2025-09-30T14:54:43.132882Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:43.132898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:43.132894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1618
2025-09-30T14:54:43.132911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:43.132917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:43.132920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:43.132921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:43.132923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:43.132943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895804093842100:9508]
2025-09-30T14:54:43.132946Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:43.132943Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1618
2025-09-30T14:54:43.132958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:43.132961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:43.132966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:43.133024Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6987a77d-26f65584-bac3b1f4-7b97b569_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:43.133037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:43.133041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:43.133043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:43.133052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:43.133060Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:43.133082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:43.133239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:43.133248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:43.133261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:43.133326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1619 partition: 0 MaxSeqNo: 42 sessionId: src_id|6987a77d-26f65584-bac3b1f4-7b97b569_0
2025-09-30T14:54:43.133653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1db0923-27982fcc-371f0fd7-e1a5346c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6987a77d-26f65584-bac3b1f4-7b97b569_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:43.136346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6987a77d-26f65584-bac3b1f4-7b97b569_0] Write session: try to update token
2025-09-30T14:54:43.136361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6987a77d-26f65584-bac3b1f4-7b97b569_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:43.144588Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:43.144607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:43.144609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:43.144611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:43.144622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895804093842100:9508]
2025-09-30T14:54:43.144626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895804093842100:9508]
2025-09-30T14:54:43.144631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895804093842100:9508]
2025-09-30T14:54:43.144672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:43.144675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:43.144681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.144681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:43.144683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:43.144685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:43.144820Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:43.150814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1619 sessionId: src_id|6987a77d-26f65584-bac3b1f4-7b97b569_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:43.153477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:43.207887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895804183600880:9749]
2025-09-30T14:54:43.208171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1618, pipe: [1:7555895804183600880:9749]
2025-09-30T14:54:43.260934Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:43.261591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:43.261614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:43.261651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895804183600880:9749], now have 1 active actors on pipe
2025-09-30T14:54:43.261877Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:43.261949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:43.261983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895804183600880:9749]
2025-09-30T14:54:43.262011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:43.262090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1619 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6987a77d-26f65584-bac3b1f4-7b97b569_0
2025-09-30T14:54:43.262282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1619 sessionId: src_id|6987a77d-26f65584-bac3b1f4-7b97b569_0 is DEAD
2025-09-30T14:54:43.262445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6987a77d-26f65584-bac3b1f4-7b97b569_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:43.262456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6987a77d-26f65584-bac3b1f4-7b97b569_0] Write session will restart in 0.009376s
2025-09-30T14:54:43.262489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6987a77d-26f65584-bac3b1f4-7b97b569_0] Write session: Do CDS request
2025-09-30T14:54:43.262495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6987a77d-26f65584-bac3b1f4-7b97b569_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:43.272832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6987a77d-26f65584-bac3b1f4-7b97b569_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:43.272911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:43.272928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1620
2025-09-30T14:54:43.273068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1620 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:43.273099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1620 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:43.273110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1620 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:43.273115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:43.273659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1620 sessionId:  describe result for acl check
2025-09-30T14:54:43.273700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:43.273708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:43.273710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:43.273717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895804183601045:9856] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:43.274284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895804183601045:9856] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:43.276865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895804183601045:9856] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:43.278903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:43.279174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895804183601045:9856] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:43.279188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895804183601045:9856] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:43.279191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895804183601045:9856] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:43.279199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1620 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:43.280855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:43.281045Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:43.281056Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:43.281067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:43.281117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:43.281159Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895804093842309:9510]
2025-09-30T14:54:43.281831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:43.282185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:43.282242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:43.282584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:43.282650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:43.282657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:43.282658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:43.282659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:43.282660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:43.282661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:43.282662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:43.282663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:43.282664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:43.282665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:43.282666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.282667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.282669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.282670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:43.282671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:43.282676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:43.282688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:43.282693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:43.282698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:43.282702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:43.282707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:43.282710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:43.282715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:43.282718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:43.282723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:43.282727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.282732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.282736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.282740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:43.282745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:43.282752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:43.282760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:43.282767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:43.282773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:43.282778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:43.282787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:43.282793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:43.282800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:43.282809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:43.282815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:43.282823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:43.282829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:43.282833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:43.282839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:43.282844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:43.282852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:43.282860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:43.282866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:43.282875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:43.282881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:43.282888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.282894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.282902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.282907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.282912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.282918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.282922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:43.282931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:43.282937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:43.282942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:43.282990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:43.288941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:43.290072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:43.290088Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:43.290091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:43.290095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:43.290101Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1619 [2:7555895804093842309:9510]
2025-09-30T14:54:43.290118Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:43.290134Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:43.290138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:43.290141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:43.290143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:43.290159Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:43.290170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:43.290177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:43.290237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.290244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.290246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.290249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:43.290252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:43.290321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:43.290330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.290344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.290357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.290375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:43.290394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895804183600881:2454], now have 1 active actors on pipe
2025-09-30T14:54:43.290403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895804183601158:9856], now have 1 active actors on pipe
2025-09-30T14:54:43.290409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895804093842303:9510]
2025-09-30T14:54:43.290411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895804093842303:9510]
2025-09-30T14:54:43.290413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895804093842303:9510]
2025-09-30T14:54:43.290426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:43.290432Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1619
2025-09-30T14:54:43.290458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1619
2025-09-30T14:54:43.290441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:43.290446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:43.290449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:43.290451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:43.290464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:43.290467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:43.290524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:43.290528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:43.290540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895804093842303:9510]
2025-09-30T14:54:43.290549Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:43.290555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:43.290578Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab61abb7-4ecc43cb-ca4e6cda-1a53afe4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:43.290585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:43.290589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:43.290591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:43.290600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:43.290609Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:43.290633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:43.290797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:43.290807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:43.290824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:43.290923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1620 partition: 0 MaxSeqNo: 42 sessionId: src_id|ab61abb7-4ecc43cb-ca4e6cda-1a53afe4_0
2025-09-30T14:54:43.291286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6987a77d-26f65584-bac3b1f4-7b97b569_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ab61abb7-4ecc43cb-ca4e6cda-1a53afe4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:43.294018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab61abb7-4ecc43cb-ca4e6cda-1a53afe4_0] Write session: try to update token
2025-09-30T14:54:43.294033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab61abb7-4ecc43cb-ca4e6cda-1a53afe4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:43.302890Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:43.302909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:43.302911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:43.302912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:43.302919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895804093842303:9510]
2025-09-30T14:54:43.302923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895804093842303:9510]
2025-09-30T14:54:43.302926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895804093842303:9510]
2025-09-30T14:54:43.302959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:43.302965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.302967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:43.302983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:43.302989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:43.302994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:43.303093Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:43.310402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1620 sessionId: src_id|ab61abb7-4ecc43cb-ca4e6cda-1a53afe4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:43.313324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:43.361999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895804183601170:9749]
2025-09-30T14:54:43.362368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1619, pipe: [1:7555895804183601170:9749]
2025-09-30T14:54:43.417310Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:43.417777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:43.417796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:43.417816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895804183601170:9749], now have 1 active actors on pipe
2025-09-30T14:54:43.418065Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:43.418179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:43.418192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:43.418200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:43.418236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895804183601170:9749]
2025-09-30T14:54:43.418250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1620 reason: error at write: Disconnected sessionId: src_id|ab61abb7-4ecc43cb-ca4e6cda-1a53afe4_0
2025-09-30T14:54:43.418410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1620 sessionId: src_id|ab61abb7-4ecc43cb-ca4e6cda-1a53afe4_0 is DEAD
2025-09-30T14:54:43.418553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab61abb7-4ecc43cb-ca4e6cda-1a53afe4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:43.418562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab61abb7-4ecc43cb-ca4e6cda-1a53afe4_0] Write session will restart in 0.005969s
2025-09-30T14:54:43.418585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab61abb7-4ecc43cb-ca4e6cda-1a53afe4_0] Write session: Do CDS request
2025-09-30T14:54:43.418591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab61abb7-4ecc43cb-ca4e6cda-1a53afe4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:43.425831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab61abb7-4ecc43cb-ca4e6cda-1a53afe4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:43.425952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:43.425969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1621
2025-09-30T14:54:43.426126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1621 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:43.426156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1621 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:43.426162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1621 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:43.426165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:43.426655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1621 sessionId:  describe result for acl check
2025-09-30T14:54:43.426687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:43.426689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:43.426690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:43.426695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895804183601213:9860] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:43.427315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895804183601213:9860] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:43.430202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895804183601213:9860] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:43.433584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895804183601213:9860] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:43.433598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895804183601213:9860] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:43.433600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895804183601213:9860] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:43.433619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1621 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:43.435097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:43.437411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:43.437598Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:43.437609Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:43.437620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:43.437673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:43.437712Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895804093842515:9513]
2025-09-30T14:54:43.438314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:43.438654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:43.438701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:43.439017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:43.439091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:43.439098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:43.439100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:43.439101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:43.439102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:43.439103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:43.439104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:43.439105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:43.439106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:43.439108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:43.439109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.439110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.439111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.439112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:43.439113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:43.439118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:43.439128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:43.439131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:43.439135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:43.439139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:43.439142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:43.439146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:43.439150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:43.439153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:43.439157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:43.439160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.439164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.439167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.439171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:43.439174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:43.439181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:43.439188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:43.439194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:43.439199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:43.439203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:43.439208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:43.439212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:43.439218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:43.439222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:43.439228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:43.439232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:43.439237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:43.439259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:43.439265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:43.439270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:43.439281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:43.439287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:43.439297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:43.439303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:43.439316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:43.439326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.439331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.439340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.439345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.439355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.439360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.439365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:43.439375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:43.439380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:43.439390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:43.439434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:43.444954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:43.446169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:43.446184Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:43.446187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:43.446191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:43.446197Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1620 [2:7555895804093842515:9513]
2025-09-30T14:54:43.446211Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:43.446224Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:43.446227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:43.446230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:43.446232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:43.446248Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:43.446259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:43.446271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:43.446332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.446338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.446340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.446344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:43.446346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:43.446414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:43.446421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.446435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.446453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.446475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:43.446497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895804183601446:9860], now have 1 active actors on pipe
2025-09-30T14:54:43.446505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895804183601171:2454], now have 1 active actors on pipe
2025-09-30T14:54:43.446512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895804093842510:9513]
2025-09-30T14:54:43.446519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895804093842510:9513]
2025-09-30T14:54:43.446521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895804093842510:9513]
2025-09-30T14:54:43.446533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:43.446551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:43.446558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:43.446562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:43.446564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:43.446568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:43.446571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:43.446602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895804093842510:9513]
2025-09-30T14:54:43.446614Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:43.446621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:43.446616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1620
2025-09-30T14:54:43.446624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1620
2025-09-30T14:54:43.446686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:43.446692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:43.446716Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce0c06ba-fb599f9e-2ec9ca31-876cfc08_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:43.446728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:43.446731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:43.446734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:43.446742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:43.446751Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:43.446766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:43.446958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:43.446969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:43.446982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:43.447066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1621 partition: 0 MaxSeqNo: 42 sessionId: src_id|ce0c06ba-fb599f9e-2ec9ca31-876cfc08_0
2025-09-30T14:54:43.447518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab61abb7-4ecc43cb-ca4e6cda-1a53afe4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ce0c06ba-fb599f9e-2ec9ca31-876cfc08_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:43.450102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce0c06ba-fb599f9e-2ec9ca31-876cfc08_0] Write session: try to update token
2025-09-30T14:54:43.450118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce0c06ba-fb599f9e-2ec9ca31-876cfc08_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:43.459069Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:43.459090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:43.459093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:43.459096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:43.459108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895804093842510:9513]
2025-09-30T14:54:43.459114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895804093842510:9513]
2025-09-30T14:54:43.459120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895804093842510:9513]
2025-09-30T14:54:43.459162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:43.459169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.459172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:43.459202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:43.459213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:43.459220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:43.459858Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:43.464582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1621 sessionId: src_id|ce0c06ba-fb599f9e-2ec9ca31-876cfc08_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:43.467199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:43.518687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895804183601461:9749]
2025-09-30T14:54:43.519045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1620, pipe: [1:7555895804183601461:9749]
2025-09-30T14:54:43.586293Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:43.586738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:43.586756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:43.586802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895804183601461:9749], now have 1 active actors on pipe
2025-09-30T14:54:43.587034Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:43.587086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895804183601461:9749]
2025-09-30T14:54:43.587096Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:43.587132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:43.587207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1621 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ce0c06ba-fb599f9e-2ec9ca31-876cfc08_0
2025-09-30T14:54:43.587447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1621 sessionId: src_id|ce0c06ba-fb599f9e-2ec9ca31-876cfc08_0 is DEAD
2025-09-30T14:54:43.587622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce0c06ba-fb599f9e-2ec9ca31-876cfc08_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:43.587632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce0c06ba-fb599f9e-2ec9ca31-876cfc08_0] Write session will restart in 0.007660s
2025-09-30T14:54:43.587660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce0c06ba-fb599f9e-2ec9ca31-876cfc08_0] Write session: Do CDS request
2025-09-30T14:54:43.587675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce0c06ba-fb599f9e-2ec9ca31-876cfc08_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:43.596791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce0c06ba-fb599f9e-2ec9ca31-876cfc08_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:43.596887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:43.596904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1622
2025-09-30T14:54:43.597033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1622 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:43.597077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1622 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:43.597087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1622 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:43.597092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:43.597574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1622 sessionId:  describe result for acl check
2025-09-30T14:54:43.597610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:43.597618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:43.597620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:43.597627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895804183601583:9866] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:43.598239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895804183601583:9866] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:43.600948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895804183601583:9866] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:43.603766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895804183601583:9866] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:43.603780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895804183601583:9866] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:43.603784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895804183601583:9866] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:43.603792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1622 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:43.603975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:43.605649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:43.605847Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:43.605855Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:43.605866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:43.605922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:43.605988Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895804093842732:9516]
2025-09-30T14:54:43.606448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:43.606747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:43.606786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:43.607019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:43.607070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:43.607076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:43.607078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:43.607079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:43.607080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:43.607081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:43.607082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:43.607083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:43.607085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:43.607086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:43.607088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.607089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.607091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.607092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:43.607093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:43.607099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:43.607110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:43.607114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:43.607119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:43.607122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:43.607126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:43.607130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:43.607134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:43.607138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:43.607142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:43.607146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.607150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.607154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.607159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:43.607163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:43.607170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:43.607179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:43.607190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:43.607197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:43.607205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:43.607211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:43.607219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:43.607225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:43.607234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:43.607239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:43.607262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:43.607268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:43.607275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:43.607284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:43.607289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:43.607299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:43.607304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:43.607313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:43.607320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:43.607326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:43.607334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.607340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.607348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.607353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.607362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.607371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.607376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:43.607382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:43.607388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:43.607394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:43.607430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:43.613026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:43.615291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:43.615313Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:43.615318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:43.615323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:43.615332Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1621 [2:7555895804093842732:9516]
2025-09-30T14:54:43.615350Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:43.615377Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:43.615387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:43.615391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:43.615394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:43.615416Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:43.615431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:43.615441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:43.615559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.615576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.615580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.615585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:43.615590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:43.615739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:43.615756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.615780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.615806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.615829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:43.615860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895804183601755:9866], now have 1 active actors on pipe
2025-09-30T14:54:43.615869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895804183601474:2454], now have 1 active actors on pipe
2025-09-30T14:54:43.615830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1621
2025-09-30T14:54:43.615848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1621
2025-09-30T14:54:43.615880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895804093842726:9516]
2025-09-30T14:54:43.615888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895804093842726:9516]
2025-09-30T14:54:43.615891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895804093842726:9516]
2025-09-30T14:54:43.615903Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:43.615918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:43.615924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:43.615933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:43.615936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:43.615941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:43.615945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:43.615968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:43.615982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:43.616046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895804093842726:9516]
2025-09-30T14:54:43.616064Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:43.616071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:43.616094Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a481e45f-42552408-b9e7c5a3-89bd6e6a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:43.616117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:43.616132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:43.616146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:43.616168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:43.616197Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:43.616288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:43.616520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:43.616543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:43.616573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:43.616677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1622 partition: 0 MaxSeqNo: 42 sessionId: src_id|a481e45f-42552408-b9e7c5a3-89bd6e6a_0
2025-09-30T14:54:43.617072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce0c06ba-fb599f9e-2ec9ca31-876cfc08_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a481e45f-42552408-b9e7c5a3-89bd6e6a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:43.619913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a481e45f-42552408-b9e7c5a3-89bd6e6a_0] Write session: try to update token
2025-09-30T14:54:43.619942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a481e45f-42552408-b9e7c5a3-89bd6e6a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:43.634693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1622 sessionId: src_id|a481e45f-42552408-b9e7c5a3-89bd6e6a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:43.634851Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:43.634873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:43.634884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895804093842726:9516]
2025-09-30T14:54:43.634933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:43.634960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:43.635131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:43.635317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:43.635483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:43.635647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:43.635880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:43.635932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:43.637430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:43.637614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:43.637634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:43.639114Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:43.639133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:43.639136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:43.639139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:43.639150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895804093842726:9516]
2025-09-30T14:54:43.639155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895804093842726:9516]
2025-09-30T14:54:43.639160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895804093842726:9516]
2025-09-30T14:54:43.639207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:43.639215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:43.639225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:43.639228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:43.639232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:43.639232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.639235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:43.639391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:43.639438Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:43.687077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895804183601768:9749]
2025-09-30T14:54:43.687305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1621, pipe: [1:7555895804183601768:9749]
2025-09-30T14:54:43.760947Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:43.771790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:43.771832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:43.772083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:43.772183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:43.772271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:43.772357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:43.772755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:43.772774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:43.772864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:43.772944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:43.773029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:43.773134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:43.773193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:43.773201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:43.773291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:43.773362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:43.773440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:43.773513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:43.774045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:43.774054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:43.774134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:43.774453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:43.774541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:43.774628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:43.774824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:43.774848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:43.774942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:43.775004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:43.775077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:43.775164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:43.775227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:43.775237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:43.775327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:43.775387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:43.775452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:43.775519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:43.775574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:43.775584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:43.775651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:43.775719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:43.775793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:43.775871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:43.775926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:43.775939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:43.776008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:43.776071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:43.776135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:43.776202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:43.776250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:43.776257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:43.776322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:43.776382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:43.776446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:43.776511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:43.776565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:43.776572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:43.776632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:43.776693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:43.776772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:43.776841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:43.776895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:43.776904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:43.776982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895804183601768:9749], now have 1 active actors on pipe
2025-09-30T14:54:43.777287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895804183601768:9749]
2025-09-30T14:54:43.777314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:43.777374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:43.777378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:43.777405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1622 reason: error at write: Disconnected sessionId: src_id|a481e45f-42552408-b9e7c5a3-89bd6e6a_0
2025-09-30T14:54:43.777449Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:43.777576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1622 sessionId: src_id|a481e45f-42552408-b9e7c5a3-89bd6e6a_0 is DEAD
2025-09-30T14:54:43.777716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a481e45f-42552408-b9e7c5a3-89bd6e6a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:43.777727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a481e45f-42552408-b9e7c5a3-89bd6e6a_0] Write session will restart in 0.005440s
2025-09-30T14:54:43.777754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a481e45f-42552408-b9e7c5a3-89bd6e6a_0] Write session: Do CDS request
2025-09-30T14:54:43.777773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a481e45f-42552408-b9e7c5a3-89bd6e6a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:43.784785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a481e45f-42552408-b9e7c5a3-89bd6e6a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:43.784868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:43.784894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1623
2025-09-30T14:54:43.785072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1623 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:43.785110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1623 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:43.785120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1623 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:43.785124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:43.785551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1623 sessionId:  describe result for acl check
2025-09-30T14:54:43.785585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:43.785590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:43.785592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:43.785597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895804183601820:9877] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:43.786055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895804183601820:9877] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:43.788468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895804183601820:9877] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:43.791454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895804183601820:9877] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:43.791465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895804183601820:9877] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:43.791467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895804183601820:9877] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:43.791476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1623 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:43.795873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:43.798665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:43.798952Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:43.798966Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:43.798981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:43.799047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:43.799104Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895804093842977:9531]
2025-09-30T14:54:43.799788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:43.800119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:43.800165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:43.800474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:43.800531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:43.800538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:43.800539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:43.800541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:43.800542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:43.800544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:43.800546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:43.800547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:43.800548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:43.800548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:43.800550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.800550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.800551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.800552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:43.800553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:43.800559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:43.800570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:43.800574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:43.800578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:43.800583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:43.800588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:43.800592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:43.800597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:43.800601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:43.800603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:43.800607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.800611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.800615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.800618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:43.800622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:43.800630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:43.800638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:43.800644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:43.800650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:43.800655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:43.800660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:43.800665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:43.800671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:43.800677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:43.800683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:43.800689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:43.800695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:43.800700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:43.800706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:43.800710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:43.800716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:43.800723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:43.800729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:43.800740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:43.800746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:43.800752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.800759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.800769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.800772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.800776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.800779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.800782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:43.800784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:43.800788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:43.800791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:43.800822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:43.806531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:43.808029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:43.808045Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:43.808048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:43.808054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:43.808062Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1622 [2:7555895804093842977:9531]
2025-09-30T14:54:43.808080Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:43.808098Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:43.808102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:43.808106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:43.808110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:43.808130Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:43.808153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:43.808161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:43.808242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.808250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.808253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.808258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:43.808261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:43.808347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:43.808355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.808368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.808386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.808406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:43.808436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895804183601996:9877], now have 1 active actors on pipe
2025-09-30T14:54:43.808440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895804183601794:2454], now have 1 active actors on pipe
2025-09-30T14:54:43.808449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895804093842972:9531]
2025-09-30T14:54:43.808458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895804093842972:9531]
2025-09-30T14:54:43.808461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895804093842972:9531]
2025-09-30T14:54:43.808475Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:43.808495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:43.808509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:43.808516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:43.808517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:43.808520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:43.808520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:43.808503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1622
2025-09-30T14:54:43.808502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1622
2025-09-30T14:54:43.808559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895804093842972:9531]
2025-09-30T14:54:43.808571Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:43.808575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:43.808595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:43.808607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:43.808669Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b8f5667-6069da8-e58f5595-29c1f042_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:43.808682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:43.808686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:43.808691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:43.808705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:43.808721Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:43.808742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:43.808891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:43.808898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:43.808915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:43.809036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1623 partition: 0 MaxSeqNo: 42 sessionId: src_id|7b8f5667-6069da8-e58f5595-29c1f042_0
2025-09-30T14:54:43.809391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a481e45f-42552408-b9e7c5a3-89bd6e6a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7b8f5667-6069da8-e58f5595-29c1f042_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:43.812161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b8f5667-6069da8-e58f5595-29c1f042_0] Write session: try to update token
2025-09-30T14:54:43.812181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b8f5667-6069da8-e58f5595-29c1f042_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:43.821388Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:43.821411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:43.821413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:43.821416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:43.821432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895804093842972:9531]
2025-09-30T14:54:43.821438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895804093842972:9531]
2025-09-30T14:54:43.821443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895804093842972:9531]
2025-09-30T14:54:43.821489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:43.821490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:43.821496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:43.821498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.821502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:43.821504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:43.821671Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:43.827071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1623 sessionId: src_id|7b8f5667-6069da8-e58f5595-29c1f042_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:43.829662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:43.877551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895804183602083:9749]
2025-09-30T14:54:43.877839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1622, pipe: [1:7555895804183602083:9749]
2025-09-30T14:54:43.932277Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:43.932867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:43.932887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:43.932930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895804183602083:9749], now have 1 active actors on pipe
2025-09-30T14:54:43.933184Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:43.933235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:43.933286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895804183602083:9749]
2025-09-30T14:54:43.933540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:43.933609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1623 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7b8f5667-6069da8-e58f5595-29c1f042_0
2025-09-30T14:54:43.933774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1623 sessionId: src_id|7b8f5667-6069da8-e58f5595-29c1f042_0 is DEAD
2025-09-30T14:54:43.933976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b8f5667-6069da8-e58f5595-29c1f042_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:43.933986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b8f5667-6069da8-e58f5595-29c1f042_0] Write session will restart in 0.009663s
2025-09-30T14:54:43.934004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b8f5667-6069da8-e58f5595-29c1f042_0] Write session: Do CDS request
2025-09-30T14:54:43.934008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b8f5667-6069da8-e58f5595-29c1f042_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:43.944746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b8f5667-6069da8-e58f5595-29c1f042_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:43.944872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:43.944890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1624
2025-09-30T14:54:43.944994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1624 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:43.945025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1624 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:43.945034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1624 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:43.945038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:43.945437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1624 sessionId:  describe result for acl check
2025-09-30T14:54:43.945468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:43.945474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:43.945476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:43.945482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895804183602264:9881] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:43.946023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895804183602264:9881] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:43.948316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895804183602264:9881] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:43.949815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:43.953297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:43.953503Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:43.953514Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:43.953525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:43.953501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895804183602264:9881] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:43.953519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895804183602264:9881] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:43.953524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895804183602264:9881] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:43.953532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1624 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:43.953581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:43.953623Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895804093843184:9533]
2025-09-30T14:54:43.954256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:43.954656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:43.954703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:43.955039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:43.955103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:43.955109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:43.955110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:43.955111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:43.955112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:43.955114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:43.955115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:43.955116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:43.955117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:43.955119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:43.955120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.955121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.955123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.955124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:43.955125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:43.955131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:43.955142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:43.955146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:43.955151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:43.955155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:43.955160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:43.955164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:43.955168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:43.955172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:43.955177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:43.955181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.955185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.955189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.955191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:43.955193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:43.955198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:43.955204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:43.955209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:43.955212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:43.955216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:43.955219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:43.955222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:43.955227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:43.955237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:43.955260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:43.955268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:43.955273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:43.955279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:43.955286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:43.955291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:43.955296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:43.955307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:43.955313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:43.955319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:43.955324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:43.955333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.955337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.955342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.955346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.955351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.955357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.955361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:43.955370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:43.955375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:43.955384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:43.955430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:43.961653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:43.962461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:43.962480Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:43.962483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:43.962487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:43.962493Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1623 [2:7555895804093843184:9533]
2025-09-30T14:54:43.962509Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:43.962524Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:43.962527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:43.962530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:43.962532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:43.962547Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:43.962554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:43.962559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:43.962600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.962607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.962609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.962612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:43.962614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:43.962667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:43.962673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.962681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:43.962687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:43.962697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:43.962711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895804093843179:9533]
2025-09-30T14:54:43.962716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895804093843179:9533]
2025-09-30T14:54:43.962718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895804093843179:9533]
2025-09-30T14:54:43.962724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:43.962735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:43.962740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:43.962745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:43.962747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:43.962755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895804183602366:9881], now have 1 active actors on pipe
2025-09-30T14:54:43.962758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895804183602085:2454], now have 1 active actors on pipe
2025-09-30T14:54:43.962762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:43.962764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:43.962778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895804093843179:9533]
2025-09-30T14:54:43.962782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:43.962785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:43.962853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1623
2025-09-30T14:54:43.962858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1623
2025-09-30T14:54:43.962934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:43.962946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:43.962965Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|878d077-1ba04c24-651634c0-442fb6a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:43.962970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:43.962974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:43.962976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:43.962983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:43.962995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:43.963009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:43.963159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:43.963169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:43.963181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:43.963270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1624 partition: 0 MaxSeqNo: 42 sessionId: src_id|878d077-1ba04c24-651634c0-442fb6a7_0
2025-09-30T14:54:43.963574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b8f5667-6069da8-e58f5595-29c1f042_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|878d077-1ba04c24-651634c0-442fb6a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:43.966216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|878d077-1ba04c24-651634c0-442fb6a7_0] Write session: try to update token
2025-09-30T14:54:43.966230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|878d077-1ba04c24-651634c0-442fb6a7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:43.975662Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:43.975681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:43.975683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:43.975684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:43.975692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895804093843179:9533]
2025-09-30T14:54:43.975695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895804093843179:9533]
2025-09-30T14:54:43.975698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895804093843179:9533]
2025-09-30T14:54:43.975733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:43.975739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:43.975741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:43.975755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:43.975767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:43.975771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:43.975867Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:43.979907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1624 sessionId: src_id|878d077-1ba04c24-651634c0-442fb6a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:43.982489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:44.033238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895808478569674:9749]
2025-09-30T14:54:44.033553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1623, pipe: [1:7555895808478569674:9749]
2025-09-30T14:54:44.082405Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:44.082706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:44.082718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:44.082752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895808478569674:9749], now have 1 active actors on pipe
2025-09-30T14:54:44.082978Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:44.083053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:44.083069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895808478569674:9749]
2025-09-30T14:54:44.083073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:44.083088Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:44.083141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1624 reason: error at write: Disconnected sessionId: src_id|878d077-1ba04c24-651634c0-442fb6a7_0
2025-09-30T14:54:44.083330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1624 sessionId: src_id|878d077-1ba04c24-651634c0-442fb6a7_0 is DEAD
2025-09-30T14:54:44.083497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|878d077-1ba04c24-651634c0-442fb6a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:44.083509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|878d077-1ba04c24-651634c0-442fb6a7_0] Write session will restart in 0.006982s
2025-09-30T14:54:44.083534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|878d077-1ba04c24-651634c0-442fb6a7_0] Write session: Do CDS request
2025-09-30T14:54:44.083542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|878d077-1ba04c24-651634c0-442fb6a7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:44.091750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|878d077-1ba04c24-651634c0-442fb6a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:44.091820Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:44.091837Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1625
2025-09-30T14:54:44.091961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1625 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:44.092003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1625 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:44.092009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1625 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:44.092013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:44.092391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1625 sessionId:  describe result for acl check
2025-09-30T14:54:44.092420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:44.092423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:44.092427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:44.092431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895808478569744:9886] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:44.092895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895808478569744:9886] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:44.095878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895808478569744:9886] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:44.099356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895808478569744:9886] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:44.099370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895808478569744:9886] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:44.099373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895808478569744:9886] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:44.099379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1625 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:44.101302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:44.103596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:44.103802Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:44.103813Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:44.103825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:44.103878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:44.103919Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895808388810690:9535]
2025-09-30T14:54:44.104606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:44.104961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:44.105012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:44.105367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:44.105436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:44.105442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:44.105444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:44.105445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:44.105446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:44.105447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:44.105449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:44.105450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:44.105452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:44.105453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:44.105455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.105456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.105457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.105459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:44.105460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:44.105466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:44.105477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:44.105482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:44.105486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:44.105491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:44.105495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:44.105499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:44.105503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:44.105508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:44.105513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:44.105517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.105521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.105525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.105528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:44.105532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:44.105540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:44.105547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:44.105554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:44.105559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:44.105563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:44.105568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:44.105573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:44.105578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:44.105584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:44.105589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:44.105593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:44.105598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:44.105603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:44.105609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:44.105614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:44.105620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:44.105627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:44.105634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:44.105639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:44.105645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:44.105650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.105656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.105660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.105666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.105671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.105677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.105682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:44.105693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:44.105698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:44.105704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:44.105768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:44.111977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:44.112866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:44.112884Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:44.112887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:44.112891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:44.112898Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1624 [2:7555895808388810690:9535]
2025-09-30T14:54:44.112914Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:44.112929Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:44.112937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:44.112941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:44.112944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:44.112960Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:44.112967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:44.112979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:44.113043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.113054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.113056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.113060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:44.113063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:44.113143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:44.113152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.113164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.113177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.113200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:44.113223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895808478569959:9886], now have 1 active actors on pipe
2025-09-30T14:54:44.113233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895808478569675:2454], now have 1 active actors on pipe
2025-09-30T14:54:44.113240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895808388810685:9535]
2025-09-30T14:54:44.113242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895808388810685:9535]
2025-09-30T14:54:44.113245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895808388810685:9535]
2025-09-30T14:54:44.113261Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:44.113275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:44.113288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:44.113291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:44.113291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:44.113294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:44.113297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:44.113319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895808388810685:9535]
2025-09-30T14:54:44.113325Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:44.113315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1624
2025-09-30T14:54:44.113354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:44.113355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:44.113361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:44.113389Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44abfa04-76109c8e-31a9a976-f8e26ea7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:44.113401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:44.113405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:44.113408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:44.113419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:44.113434Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:44.113451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:44.113465Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1624
2025-09-30T14:54:44.113599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:44.113607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:44.113619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:44.113720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1625 partition: 0 MaxSeqNo: 42 sessionId: src_id|44abfa04-76109c8e-31a9a976-f8e26ea7_0
2025-09-30T14:54:44.114078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|878d077-1ba04c24-651634c0-442fb6a7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|44abfa04-76109c8e-31a9a976-f8e26ea7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:44.117008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44abfa04-76109c8e-31a9a976-f8e26ea7_0] Write session: try to update token
2025-09-30T14:54:44.117028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44abfa04-76109c8e-31a9a976-f8e26ea7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:44.127153Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:44.127172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:44.127175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:44.127177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:44.127187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895808388810685:9535]
2025-09-30T14:54:44.127192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895808388810685:9535]
2025-09-30T14:54:44.127200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895808388810685:9535]
2025-09-30T14:54:44.127266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:44.127274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:44.127279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.127281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:44.127282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:44.127286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:44.127436Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:44.132477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1625 sessionId: src_id|44abfa04-76109c8e-31a9a976-f8e26ea7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:44.135162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:44.183240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895808478569977:9749]
2025-09-30T14:54:44.183538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1624, pipe: [1:7555895808478569977:9749]
2025-09-30T14:54:44.236990Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:44.237284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:44.237300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:44.237344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895808478569977:9749], now have 1 active actors on pipe
2025-09-30T14:54:44.237528Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:44.237624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895808478569977:9749]
2025-09-30T14:54:44.237630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:44.237656Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:44.237722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1625 reason: status is not ok: tablet will be restarted right now sessionId: src_id|44abfa04-76109c8e-31a9a976-f8e26ea7_0
2025-09-30T14:54:44.237910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1625 sessionId: src_id|44abfa04-76109c8e-31a9a976-f8e26ea7_0 is DEAD
2025-09-30T14:54:44.238100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44abfa04-76109c8e-31a9a976-f8e26ea7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:44.238111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44abfa04-76109c8e-31a9a976-f8e26ea7_0] Write session will restart in 0.006838s
2025-09-30T14:54:44.238137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44abfa04-76109c8e-31a9a976-f8e26ea7_0] Write session: Do CDS request
2025-09-30T14:54:44.238144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44abfa04-76109c8e-31a9a976-f8e26ea7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:44.245782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44abfa04-76109c8e-31a9a976-f8e26ea7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:44.245818Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:44.245832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1626
2025-09-30T14:54:44.246016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1626 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:44.246055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1626 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:44.246060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1626 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:44.246064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:44.246550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1626 sessionId:  describe result for acl check
2025-09-30T14:54:44.246576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:44.246579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:44.246580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:44.246584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895808478570077:9890] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:44.247030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895808478570077:9890] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:44.249156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895808478570077:9890] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:44.252036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895808478570077:9890] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:44.252048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895808478570077:9890] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:44.252051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895808478570077:9890] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:44.252059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1626 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:44.252819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:44.254930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:44.255168Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:44.255186Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:44.255202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:44.255307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:44.255362Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895808388810900:9537]
2025-09-30T14:54:44.256099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:44.256476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:44.256543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:44.256971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:44.257064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:44.257075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:44.257076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:44.257077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:44.257079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:44.257080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:44.257081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:44.257083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:44.257084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:44.257085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:44.257086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.257087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.257088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.257090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:44.257091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:44.257099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:44.257111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:44.257117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:44.257121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:44.257126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:44.257130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:44.257134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:44.257139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:44.257143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:44.257149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:44.257153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.257158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.257162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.257167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:44.257171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:44.257181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:44.257190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:44.257206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:44.257212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:44.257223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:44.257229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:44.257235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:44.257242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:44.257250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:44.257262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:44.257267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:44.257279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:44.257285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:44.257291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:44.257297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:44.257304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:44.257310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:44.257322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:44.257328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:44.257340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:44.257347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.257358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.257364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.257376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.257382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.257394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.257401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:44.257413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:44.257422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:44.257432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:44.257481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:44.263592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:44.264981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:44.265001Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:44.265005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:44.265010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:44.265019Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1625 [2:7555895808388810900:9537]
2025-09-30T14:54:44.265041Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:44.265063Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:44.265074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:44.265078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:44.265082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:44.265105Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:44.265120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:44.265129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:44.265220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.265231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.265234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.265238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:44.265242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:44.265331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:44.265341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.265356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.265370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.265403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:44.265428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895808478570259:9890], now have 1 active actors on pipe
2025-09-30T14:54:44.265433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895808478569978:2454], now have 1 active actors on pipe
2025-09-30T14:54:44.265442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895808388810895:9537]
2025-09-30T14:54:44.265446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895808388810895:9537]
2025-09-30T14:54:44.265449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895808388810895:9537]
2025-09-30T14:54:44.265470Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:44.265493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:44.265511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:44.265515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:44.265522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:44.265537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:44.265540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:44.265563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895808388810895:9537]
2025-09-30T14:54:44.265576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:44.265582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:44.265563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1625
2025-09-30T14:54:44.265692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1625
2025-09-30T14:54:44.265793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:44.265813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:44.265849Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6844d721-ddcd7a7a-5a002c5f-c34da757_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:44.265866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:44.265876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:44.265880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:44.265893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:44.265915Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:44.265942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:44.266107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:44.266117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:44.266132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:44.266242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1626 partition: 0 MaxSeqNo: 42 sessionId: src_id|6844d721-ddcd7a7a-5a002c5f-c34da757_0
2025-09-30T14:54:44.266609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44abfa04-76109c8e-31a9a976-f8e26ea7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6844d721-ddcd7a7a-5a002c5f-c34da757_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:44.269463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6844d721-ddcd7a7a-5a002c5f-c34da757_0] Write session: try to update token
2025-09-30T14:54:44.269485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6844d721-ddcd7a7a-5a002c5f-c34da757_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:44.278134Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:44.278156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:44.278159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:44.278162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:44.278173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895808388810895:9537]
2025-09-30T14:54:44.278178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895808388810895:9537]
2025-09-30T14:54:44.278183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895808388810895:9537]
2025-09-30T14:54:44.278224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:44.278229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:44.278229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:44.278232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:44.278236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.278239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:44.278381Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:44.284967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1626 sessionId: src_id|6844d721-ddcd7a7a-5a002c5f-c34da757_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:44.287981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:44.337895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895808478570273:9749]
2025-09-30T14:54:44.338303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1625, pipe: [1:7555895808478570273:9749]
2025-09-30T14:54:44.399803Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:44.400401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:44.400417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:44.400456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895808478570273:9749], now have 1 active actors on pipe
2025-09-30T14:54:44.400751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:44.400765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:44.400775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895808478570273:9749]
2025-09-30T14:54:44.400810Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:44.400827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1626 reason: error at write: Disconnected sessionId: src_id|6844d721-ddcd7a7a-5a002c5f-c34da757_0
2025-09-30T14:54:44.401000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1626 sessionId: src_id|6844d721-ddcd7a7a-5a002c5f-c34da757_0 is DEAD
2025-09-30T14:54:44.400702Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:44.401136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6844d721-ddcd7a7a-5a002c5f-c34da757_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:44.401146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6844d721-ddcd7a7a-5a002c5f-c34da757_0] Write session will restart in 0.007333s
2025-09-30T14:54:44.401171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6844d721-ddcd7a7a-5a002c5f-c34da757_0] Write session: Do CDS request
2025-09-30T14:54:44.401180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6844d721-ddcd7a7a-5a002c5f-c34da757_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:44.409777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6844d721-ddcd7a7a-5a002c5f-c34da757_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:44.409867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:44.409885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1627
2025-09-30T14:54:44.410026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1627 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:44.410060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1627 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:44.410067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1627 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:44.410071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:44.410532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1627 sessionId:  describe result for acl check
2025-09-30T14:54:44.410567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:44.410576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:44.410579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:44.410585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895808478570351:9894] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:44.411171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895808478570351:9894] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:44.413903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895808478570351:9894] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:44.416617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895808478570351:9894] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:44.416633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895808478570351:9894] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:44.416636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895808478570351:9894] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:44.416645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1627 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:44.418379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:44.420267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:44.420465Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:44.420479Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:44.420491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:44.420554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:44.420598Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895808388811113:9540]
2025-09-30T14:54:44.421245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:44.421600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:44.421657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:44.422036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:44.422129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:44.422136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:44.422137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:44.422138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:44.422140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:44.422142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:44.422143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:44.422144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:44.422145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:44.422146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:44.422147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.422149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.422150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.422151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:44.422152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:44.422159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:44.422169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:44.422174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:44.422178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:44.422182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:44.422187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:44.422191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:44.422195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:44.422199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:44.422204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:44.422208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.422212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.422216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.422220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:44.422224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:44.422231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:44.422240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:44.422246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:44.422253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:44.422257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:44.422262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:44.422267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:44.422273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:44.422279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:44.422284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:44.422288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:44.422294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:44.422299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:44.422304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:44.422309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:44.422314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:44.422319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:44.422324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:44.422329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:44.422333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:44.422340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.422346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.422351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.422356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.422361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.422366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.422376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:44.422383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:44.422387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:44.422397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:44.422446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:44.428157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:44.429183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:44.429200Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:44.429203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:44.429208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:44.429215Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1626 [2:7555895808388811113:9540]
2025-09-30T14:54:44.429233Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:44.429249Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:44.429252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:44.429255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:44.429258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:44.429273Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:44.429281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:44.429292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:44.429352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.429359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.429360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.429363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:44.429365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:44.429416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:44.429418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.429428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.429435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.429446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:44.429464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895808388811108:9540]
2025-09-30T14:54:44.429469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895808388811108:9540]
2025-09-30T14:54:44.429471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895808388811108:9540]
2025-09-30T14:54:44.429477Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:44.429488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:44.429489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:44.429493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:44.429495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:44.429501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:44.429503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:44.429511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895808478570555:9894], now have 1 active actors on pipe
2025-09-30T14:54:44.429514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895808478570274:2454], now have 1 active actors on pipe
2025-09-30T14:54:44.429550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895808388811108:9540]
2025-09-30T14:54:44.429561Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:44.429575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:44.429626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1626
2025-09-30T14:54:44.429630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1626
2025-09-30T14:54:44.429705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:44.429715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:44.429740Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4bbd1c76-6669ebea-b90d9140-4c236706_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:44.429752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:44.429770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:44.429776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:44.429788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:44.429802Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:44.429819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:44.429947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:44.429957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:44.429971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:44.430096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1627 partition: 0 MaxSeqNo: 42 sessionId: src_id|4bbd1c76-6669ebea-b90d9140-4c236706_0
2025-09-30T14:54:44.430423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6844d721-ddcd7a7a-5a002c5f-c34da757_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4bbd1c76-6669ebea-b90d9140-4c236706_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:44.433210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bbd1c76-6669ebea-b90d9140-4c236706_0] Write session: try to update token
2025-09-30T14:54:44.433228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bbd1c76-6669ebea-b90d9140-4c236706_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:44.441579Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:44.441598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:44.441607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895808388811108:9540]
2025-09-30T14:54:44.441652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:44.441658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:44.441848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:44.442003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:44.442167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:44.442321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:44.442545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:44.442586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:44.448455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1627 sessionId: src_id|4bbd1c76-6669ebea-b90d9140-4c236706_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:44.451729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:44.452477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:44.452504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:44.454023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:44.454068Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:44.454072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:44.454075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:44.454078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:44.454091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895808388811108:9540]
2025-09-30T14:54:44.454096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895808388811108:9540]
2025-09-30T14:54:44.454102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895808388811108:9540]
2025-09-30T14:54:44.454138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:44.454143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:44.454154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:44.454159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:44.454166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.454169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:44.454173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:44.454356Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:44.501191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895808478570570:9749]
2025-09-30T14:54:44.501451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1626, pipe: [1:7555895808478570570:9749]
2025-09-30T14:54:44.573538Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:44.581777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:44.581803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:44.581983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:44.582066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:44.582147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:44.582226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:44.582282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:44.582293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:44.582372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:44.582448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:44.582518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:44.582594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:44.582644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:44.582653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:44.582731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:44.582800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:44.582873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:44.582942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:44.582997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:44.583005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:44.583073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:44.583135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:44.583206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:44.583304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:44.583353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:44.583360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:44.583438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:44.583508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:44.583577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:44.583635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:44.583677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:44.583683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:44.583748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:44.583806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:44.583866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:44.583927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:44.583978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:44.583986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:44.584059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:44.584125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:44.584200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:44.584267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:44.584312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:44.584327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:44.584408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:44.584478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:44.584550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:44.584615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:44.584671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:44.584679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:44.584749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:44.584825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:44.584900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:44.584977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:44.585028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:44.585036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:44.585106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:44.585173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:44.585240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:44.585303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:44.585352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:44.585361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:44.585419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895808478570570:9749], now have 1 active actors on pipe
2025-09-30T14:54:44.585692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895808478570570:9749]
2025-09-30T14:54:44.585767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:44.585787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:44.585809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:44.585827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1627 reason: error at write: Disconnected sessionId: src_id|4bbd1c76-6669ebea-b90d9140-4c236706_0
2025-09-30T14:54:44.586089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1627 sessionId: src_id|4bbd1c76-6669ebea-b90d9140-4c236706_0 is DEAD
2025-09-30T14:54:44.586266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bbd1c76-6669ebea-b90d9140-4c236706_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:44.586275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bbd1c76-6669ebea-b90d9140-4c236706_0] Write session will restart in 0.008731s
2025-09-30T14:54:44.586301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bbd1c76-6669ebea-b90d9140-4c236706_0] Write session: Do CDS request
2025-09-30T14:54:44.586307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bbd1c76-6669ebea-b90d9140-4c236706_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:44.586771Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:44.595798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bbd1c76-6669ebea-b90d9140-4c236706_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:44.595877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:44.595903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1628
2025-09-30T14:54:44.596051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1628 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:44.596086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1628 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:44.596092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1628 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:44.596096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:44.596710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1628 sessionId:  describe result for acl check
2025-09-30T14:54:44.596776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:44.596783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:44.596786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:44.596795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895808478570681:9900] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:44.597516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895808478570681:9900] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:44.600346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895808478570681:9900] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:44.603046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:44.603268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895808478570681:9900] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:44.603286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895808478570681:9900] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:44.603290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895808478570681:9900] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:44.603301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1628 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:44.604875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:44.605068Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:44.605079Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:44.605091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:44.605152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:44.605193Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895808388811337:9543]
2025-09-30T14:54:44.605861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:44.606231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:44.606276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:44.606589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:44.606657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:44.606664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:44.606665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:44.606666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:44.606667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:44.606669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:44.606670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:44.606672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:44.606673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:44.606674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:44.606675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.606678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.606680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.606681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:44.606682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:44.606688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:44.606698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:44.606702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:44.606707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:44.606710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:44.606714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:44.606719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:44.606723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:44.606727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:44.606732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:44.606736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.606740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.606744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.606749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:44.606753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:44.606761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:44.606770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:44.606776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:44.606783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:44.606789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:44.606794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:44.606799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:44.606804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:44.606809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:44.606815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:44.606821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:44.606826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:44.606832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:44.606837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:44.606841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:44.606846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:44.606851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:44.606857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:44.606866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:44.606872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:44.606882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.606886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.606890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.606895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.606898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.606902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.606906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:44.606911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:44.606918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:44.606923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:44.606969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:44.612716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:44.613584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:44.613600Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:44.613602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:44.613605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:44.613613Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1627 [2:7555895808388811337:9543]
2025-09-30T14:54:44.613632Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:44.613653Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:44.613658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:44.613661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:44.613663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:44.613676Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:44.613681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:44.613690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:44.613741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.613749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.613750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.613753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:44.613768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:44.613824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:44.613830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.613839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.613846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.613856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:44.613869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895808388811331:9543]
2025-09-30T14:54:44.613875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895808388811331:9543]
2025-09-30T14:54:44.613877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895808388811331:9543]
2025-09-30T14:54:44.613888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:44.613901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:44.613918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:44.613924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:44.613931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:44.613937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:44.613941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:44.613955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895808388811331:9543]
2025-09-30T14:54:44.613958Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:44.613964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:44.613967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895808478570871:9900], now have 1 active actors on pipe
2025-09-30T14:54:44.613970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895808478570584:2454], now have 1 active actors on pipe
2025-09-30T14:54:44.614066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1627
2025-09-30T14:54:44.614096Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1627
2025-09-30T14:54:44.614172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:44.614183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:44.614208Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44845d61-6536c2b9-6063dbe6-c8754c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:44.614218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:44.614224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:44.614226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:44.614234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:44.614242Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:44.614257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:44.614450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:44.614459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:44.614472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:44.614580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1628 partition: 0 MaxSeqNo: 42 sessionId: src_id|44845d61-6536c2b9-6063dbe6-c8754c3_0
2025-09-30T14:54:44.614941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bbd1c76-6669ebea-b90d9140-4c236706_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|44845d61-6536c2b9-6063dbe6-c8754c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:44.617729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44845d61-6536c2b9-6063dbe6-c8754c3_0] Write session: try to update token
2025-09-30T14:54:44.617748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44845d61-6536c2b9-6063dbe6-c8754c3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:44.627390Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:44.627415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:44.627429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895808388811331:9543]
2025-09-30T14:54:44.627490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:44.627495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:44.627720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:44.627919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:44.628083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:44.628256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:44.628514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:44.628573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:44.634287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1628 sessionId: src_id|44845d61-6536c2b9-6063dbe6-c8754c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:44.637072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:44.637609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:44.637639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:44.639099Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:44.639121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:44.639124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:44.639127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:44.639141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895808388811331:9543]
2025-09-30T14:54:44.639146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895808388811331:9543]
2025-09-30T14:54:44.639152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895808388811331:9543]
2025-09-30T14:54:44.639201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:44.639233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:44.639265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.639269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:44.639362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:44.639379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:44.639364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:44.639385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:44.639437Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:44.686017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895808478570883:9749]
2025-09-30T14:54:44.686309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1627, pipe: [1:7555895808478570883:9749]
2025-09-30T14:54:44.761078Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:44.770351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:44.770380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:44.770576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:44.770650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:44.770722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:44.770797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:44.770853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:44.770866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:44.770947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:44.771018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:44.771090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:44.771170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:44.771221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:44.771229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:44.771324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:44.771392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:44.771472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:44.771546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:44.771597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:44.771605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:44.771683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:44.771762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:44.771838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:44.771909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:44.771958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:44.771969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:44.772043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:44.772110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:44.772180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:44.772252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:44.772302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:44.772310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:44.772385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:44.772455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:44.772531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:44.772607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:44.772657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:44.772664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:44.772735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:44.772799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:44.772874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:44.772951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:44.773006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:44.773014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:44.773086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:44.773153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:44.773221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:44.773291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:44.773338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:44.773346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:44.773437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:44.773504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:44.773574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:44.773645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:44.773699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:44.773707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:44.773789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:44.773859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:44.773929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:44.773999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:44.774047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:44.774055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:44.774113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895808478570883:9749], now have 1 active actors on pipe
2025-09-30T14:54:44.774600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895808478570883:9749]
2025-09-30T14:54:44.774638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:44.774640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:44.774674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1628 reason: error at write: Disconnected sessionId: src_id|44845d61-6536c2b9-6063dbe6-c8754c3_0
2025-09-30T14:54:44.774884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1628 sessionId: src_id|44845d61-6536c2b9-6063dbe6-c8754c3_0 is DEAD
2025-09-30T14:54:44.775042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44845d61-6536c2b9-6063dbe6-c8754c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:44.775071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44845d61-6536c2b9-6063dbe6-c8754c3_0] Write session will restart in 0.008395s
2025-09-30T14:54:44.775101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44845d61-6536c2b9-6063dbe6-c8754c3_0] Write session: Do CDS request
2025-09-30T14:54:44.775111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44845d61-6536c2b9-6063dbe6-c8754c3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:44.775180Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:44.775370Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:44.785012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44845d61-6536c2b9-6063dbe6-c8754c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:44.785041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:44.785058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1629
2025-09-30T14:54:44.785361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1629 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:44.785397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1629 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:44.785424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1629 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:44.785429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:44.785925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1629 sessionId:  describe result for acl check
2025-09-30T14:54:44.785956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:44.785970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:44.785971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:44.785976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895808478571084:9911] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:44.786552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895808478571084:9911] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:44.789414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895808478571084:9911] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:44.790077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:44.796353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:44.796626Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:44.796637Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:44.796648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:44.796704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:44.796744Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895808388811587:9554]
2025-09-30T14:54:44.796971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895808478571084:9911] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:44.796994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895808478571084:9911] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:44.797001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895808478571084:9911] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:44.797011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1629 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:44.797354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:44.797678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:44.797736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:44.797994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:44.798051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:44.798059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:44.798060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:44.798060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:44.798061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:44.798062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:44.798063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:44.798064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:44.798065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:44.798066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:44.798066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.798067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.798068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.798068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:44.798069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:44.798073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:44.798081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:44.798084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:44.798086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:44.798089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:44.798091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:44.798094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:44.798096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:44.798099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:44.798102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:44.798104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.798107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.798109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.798112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:44.798114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:44.798120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:44.798125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:44.798129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:44.798133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:44.798137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:44.798143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:44.798146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:44.798150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:44.798155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:44.798158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:44.798160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:44.798163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:44.798166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:44.798169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:44.798171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:44.798174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:44.798178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:44.798181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:44.798183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:44.798186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:44.798189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.798192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.798195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.798198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.798201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.798205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.798207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:44.798210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:44.798213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:44.798216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:44.798241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:44.806691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:44.808456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:44.808479Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:44.808482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:44.808487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:44.808496Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1628 [2:7555895808388811587:9554]
2025-09-30T14:54:44.808519Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:44.808541Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:44.808545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:44.808549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:44.808552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:44.808575Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:44.808585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:44.808601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:44.808696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.808706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.808709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.808714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:44.808717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:44.808805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:44.808816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.808836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.808854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.808876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:44.808908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895808478570911:2454], now have 1 active actors on pipe
2025-09-30T14:54:44.808919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895808478571192:9911], now have 1 active actors on pipe
2025-09-30T14:54:44.808927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895808388811582:9554]
2025-09-30T14:54:44.808936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895808388811582:9554]
2025-09-30T14:54:44.808945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895808388811582:9554]
2025-09-30T14:54:44.808964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:44.808989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:44.808996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:44.809001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:44.809004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:44.809013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:44.809017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:44.809011Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1628
2025-09-30T14:54:44.809049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1628
2025-09-30T14:54:44.809089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895808388811582:9554]
2025-09-30T14:54:44.809106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:44.809116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:44.809138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:44.809151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:44.809220Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9a49bc4-fc178ccc-e93faa6-5c4c6a82_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:44.809239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:44.809244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:44.809247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:44.809261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:44.809273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:44.809297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:44.809524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:44.809536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:44.809613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:44.809731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1629 partition: 0 MaxSeqNo: 42 sessionId: src_id|e9a49bc4-fc178ccc-e93faa6-5c4c6a82_0
2025-09-30T14:54:44.810147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44845d61-6536c2b9-6063dbe6-c8754c3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e9a49bc4-fc178ccc-e93faa6-5c4c6a82_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:44.821496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a49bc4-fc178ccc-e93faa6-5c4c6a82_0] Write session: try to update token
2025-09-30T14:54:44.821522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a49bc4-fc178ccc-e93faa6-5c4c6a82_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:44.824106Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:44.824131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:44.824134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:44.824136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:44.824147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895808388811582:9554]
2025-09-30T14:54:44.824154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895808388811582:9554]
2025-09-30T14:54:44.824158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895808388811582:9554]
2025-09-30T14:54:44.824203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:44.824212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.824220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:44.824236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:44.824252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:44.824257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:44.824369Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:44.840678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1629 sessionId: src_id|e9a49bc4-fc178ccc-e93faa6-5c4c6a82_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:44.849022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:44.874934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895808478571204:9749]
2025-09-30T14:54:44.875318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1628, pipe: [1:7555895808478571204:9749]
2025-09-30T14:54:44.937797Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:44.938220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:44.938236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:44.938253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895808478571204:9749], now have 1 active actors on pipe
2025-09-30T14:54:44.938443Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:44.938475Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:44.938503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:44.938508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:44.938530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895808478571204:9749]
2025-09-30T14:54:44.938578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1629 reason: error at write: Disconnected sessionId: src_id|e9a49bc4-fc178ccc-e93faa6-5c4c6a82_0
2025-09-30T14:54:44.938746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1629 sessionId: src_id|e9a49bc4-fc178ccc-e93faa6-5c4c6a82_0 is DEAD
2025-09-30T14:54:44.938952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a49bc4-fc178ccc-e93faa6-5c4c6a82_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:44.938963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a49bc4-fc178ccc-e93faa6-5c4c6a82_0] Write session will restart in 0.009861s
2025-09-30T14:54:44.938985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a49bc4-fc178ccc-e93faa6-5c4c6a82_0] Write session: Do CDS request
2025-09-30T14:54:44.938990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a49bc4-fc178ccc-e93faa6-5c4c6a82_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:44.949750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a49bc4-fc178ccc-e93faa6-5c4c6a82_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:44.949917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:44.949934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1630
2025-09-30T14:54:44.950055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1630 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:44.950090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1630 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:44.950100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1630 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:44.950105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:44.950752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1630 sessionId:  describe result for acl check
2025-09-30T14:54:44.950793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:44.950795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:44.950797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:44.950803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895808478571369:9915] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:44.951478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895808478571369:9915] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:44.953820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895808478571369:9915] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:44.956513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895808478571369:9915] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:44.956527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895808478571369:9915] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:44.956530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895808478571369:9915] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:44.956538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1630 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:44.956835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:44.958588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:44.958758Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:44.958769Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:44.958778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:44.958823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:44.958872Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895808388811802:9560]
2025-09-30T14:54:44.959544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:44.959806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:44.959847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:44.960188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:44.960250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:44.960256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:44.960257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:44.960258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:44.960259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:44.960261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:44.960262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:44.960264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:44.960265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:44.960266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:44.960268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.960269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.960270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.960272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:44.960273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:44.960279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:44.960290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:44.960295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:44.960299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:44.960303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:44.960308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:44.960313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:44.960317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:44.960321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:44.960326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:44.960331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.960335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.960339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.960343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:44.960347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:44.960354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:44.960363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:44.960373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:44.960380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:44.960390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:44.960396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:44.960401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:44.960412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:44.960417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:44.960428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:44.960433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:44.960444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:44.960449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:44.960460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:44.960465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:44.960474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:44.960480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:44.960485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:44.960495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:44.960501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:44.960509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.960516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.960525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.960531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.960541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.960546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.960551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:44.960561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:44.960566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:44.960576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:44.960627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:44.965897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:44.966739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:44.966756Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:44.966760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:44.966764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:44.966772Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1629 [2:7555895808388811802:9560]
2025-09-30T14:54:44.966789Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:44.966805Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:44.966808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:44.966812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:44.966815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:44.966829Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:44.966842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:44.966849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:44.966909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.966917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.966920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.966923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:44.966926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:44.966989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:44.966999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.967011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:44.967024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:44.967040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:44.967066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895808478571492:9915], now have 1 active actors on pipe
2025-09-30T14:54:44.967070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895808478571205:2454], now have 1 active actors on pipe
2025-09-30T14:54:44.967077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895808388811797:9560]
2025-09-30T14:54:44.967079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895808388811797:9560]
2025-09-30T14:54:44.967082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895808388811797:9560]
2025-09-30T14:54:44.967097Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:44.967118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:44.967120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:44.967121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:44.967123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:44.967136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:44.967139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:44.967132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1629
2025-09-30T14:54:44.967151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1629
2025-09-30T14:54:44.967169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895808388811797:9560]
2025-09-30T14:54:44.967178Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:44.967181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:44.967195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:44.967204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:44.967274Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36ceb299-48fd15de-96db5d3b-de048d2f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:44.967285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:44.967289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:44.967292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:44.967302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:44.967315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:44.967337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:44.967507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:44.967516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:44.967531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:44.967616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1630 partition: 0 MaxSeqNo: 42 sessionId: src_id|36ceb299-48fd15de-96db5d3b-de048d2f_0
2025-09-30T14:54:44.967931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a49bc4-fc178ccc-e93faa6-5c4c6a82_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|36ceb299-48fd15de-96db5d3b-de048d2f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:44.970635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36ceb299-48fd15de-96db5d3b-de048d2f_0] Write session: try to update token
2025-09-30T14:54:44.970653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36ceb299-48fd15de-96db5d3b-de048d2f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:44.979713Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:44.979735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:44.979738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:44.979740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:44.979752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895808388811797:9560]
2025-09-30T14:54:44.979757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895808388811797:9560]
2025-09-30T14:54:44.979760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895808388811797:9560]
2025-09-30T14:54:44.979801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:44.979810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:44.979813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:44.979804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:44.979829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:44.979832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:44.979965Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:44.985838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1630 sessionId: src_id|36ceb299-48fd15de-96db5d3b-de048d2f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:44.989949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:45.038801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895812773538801:9749]
2025-09-30T14:54:45.039166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1629, pipe: [1:7555895812773538801:9749]
2025-09-30T14:54:45.090176Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:45.090943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:45.090962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:45.091004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895812773538801:9749], now have 1 active actors on pipe
2025-09-30T14:54:45.091257Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:45.091309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895812773538801:9749]
2025-09-30T14:54:45.091312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:45.091317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:45.091334Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:45.091398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1630 reason: error at write: Disconnected sessionId: src_id|36ceb299-48fd15de-96db5d3b-de048d2f_0
2025-09-30T14:54:45.091593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1630 sessionId: src_id|36ceb299-48fd15de-96db5d3b-de048d2f_0 is DEAD
2025-09-30T14:54:45.091757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36ceb299-48fd15de-96db5d3b-de048d2f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:45.091778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36ceb299-48fd15de-96db5d3b-de048d2f_0] Write session will restart in 0.009784s
2025-09-30T14:54:45.091805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36ceb299-48fd15de-96db5d3b-de048d2f_0] Write session: Do CDS request
2025-09-30T14:54:45.091815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36ceb299-48fd15de-96db5d3b-de048d2f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:45.102758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36ceb299-48fd15de-96db5d3b-de048d2f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:45.102878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:45.102895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1631
2025-09-30T14:54:45.103045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1631 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:45.103095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1631 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:45.103106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1631 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:45.103113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:45.103625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1631 sessionId:  describe result for acl check
2025-09-30T14:54:45.103660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:45.103671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:45.103672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:45.103679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895812773538965:9920] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:45.104223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895812773538965:9920] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:45.106720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895812773538965:9920] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:45.109184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:45.109673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895812773538965:9920] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:45.109690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895812773538965:9920] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:45.109694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895812773538965:9920] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:45.109703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1631 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:45.111293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:45.111478Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:45.111492Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:45.111502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:45.111555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:45.111589Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895812683779313:9562]
2025-09-30T14:54:45.112212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:45.112532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:45.112590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:45.112954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:45.113018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:45.113024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:45.113025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:45.113026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:45.113028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:45.113029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:45.113030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:45.113031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:45.113033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:45.113034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:45.113035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.113036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.113037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.113038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:45.113039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:45.113045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:45.113056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:45.113060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:45.113064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:45.113068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:45.113073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:45.113077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:45.113081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:45.113085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:45.113090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:45.113094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.113098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.113102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.113106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:45.113110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:45.113117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:45.113125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:45.113131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:45.113137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:45.113142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:45.113149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:45.113154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:45.113163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:45.113168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:45.113174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:45.113178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:45.113188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:45.113197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:45.113207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:45.113215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:45.113220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:45.113229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:45.113248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:45.113252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:45.113257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:45.113261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.113268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.113272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.113277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.113281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.113287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.113291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:45.113296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:45.113301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:45.113307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:45.113354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:45.118951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:45.120348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:45.120362Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:45.120365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:45.120369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:45.120377Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1630 [2:7555895812683779313:9562]
2025-09-30T14:54:45.120394Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:45.120410Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:45.120418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:45.120421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:45.120425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:45.120441Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:45.120448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:45.120455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:45.120523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.120532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.120534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.120537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:45.120540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:45.120616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:45.120624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.120637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.120654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.120678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:45.120696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895812773538802:2454], now have 1 active actors on pipe
2025-09-30T14:54:45.120704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895812773539099:9920], now have 1 active actors on pipe
2025-09-30T14:54:45.120711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895812683779307:9562]
2025-09-30T14:54:45.120713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895812683779307:9562]
2025-09-30T14:54:45.120715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895812683779307:9562]
2025-09-30T14:54:45.120728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:45.120740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:45.120742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:45.120744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:45.120747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:45.120762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:45.120766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:45.120811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895812683779307:9562]
2025-09-30T14:54:45.120819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:45.120827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:45.120795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1630
2025-09-30T14:54:45.120798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1630
2025-09-30T14:54:45.120861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:45.120871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:45.120907Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2b15ce1-7ea40319-5910e7b-b985a5ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:45.120918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:45.120924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:45.120926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:45.120936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:45.120953Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:45.120970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:45.121099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:45.121105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:45.121119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:45.121195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1631 partition: 0 MaxSeqNo: 42 sessionId: src_id|e2b15ce1-7ea40319-5910e7b-b985a5ad_0
2025-09-30T14:54:45.121581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36ceb299-48fd15de-96db5d3b-de048d2f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e2b15ce1-7ea40319-5910e7b-b985a5ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:45.124540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2b15ce1-7ea40319-5910e7b-b985a5ad_0] Write session: try to update token
2025-09-30T14:54:45.124563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2b15ce1-7ea40319-5910e7b-b985a5ad_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:45.133612Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:45.133639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:45.133642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:45.133645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:45.133659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895812683779307:9562]
2025-09-30T14:54:45.133666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895812683779307:9562]
2025-09-30T14:54:45.133671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895812683779307:9562]
2025-09-30T14:54:45.133724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:45.133733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.133734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:45.133737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:45.133743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:45.133748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:45.133934Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:45.140139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1631 sessionId: src_id|e2b15ce1-7ea40319-5910e7b-b985a5ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:45.142986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:45.191351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895812773539114:9749]
2025-09-30T14:54:45.191694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1630, pipe: [1:7555895812773539114:9749]
2025-09-30T14:54:45.261480Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:45.262116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:45.262136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:45.262157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895812773539114:9749], now have 1 active actors on pipe
2025-09-30T14:54:45.262373Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:45.262377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895812773539114:9749]
2025-09-30T14:54:45.262409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:45.262412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:45.262508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1631 reason: error at write: Disconnected sessionId: src_id|e2b15ce1-7ea40319-5910e7b-b985a5ad_0
2025-09-30T14:54:45.262713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1631 sessionId: src_id|e2b15ce1-7ea40319-5910e7b-b985a5ad_0 is DEAD
2025-09-30T14:54:45.262875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2b15ce1-7ea40319-5910e7b-b985a5ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:45.262885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2b15ce1-7ea40319-5910e7b-b985a5ad_0] Write session will restart in 0.008761s
2025-09-30T14:54:45.262910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2b15ce1-7ea40319-5910e7b-b985a5ad_0] Write session: Do CDS request
2025-09-30T14:54:45.262916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2b15ce1-7ea40319-5910e7b-b985a5ad_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:45.263095Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:45.272734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2b15ce1-7ea40319-5910e7b-b985a5ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:45.272809Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:45.272828Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1632
2025-09-30T14:54:45.272988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1632 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:45.273022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1632 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:45.273027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1632 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:45.273031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:45.273497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1632 sessionId:  describe result for acl check
2025-09-30T14:54:45.273534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:45.273545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:45.273547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:45.273553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895812773539237:9924] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:45.274130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895812773539237:9924] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:45.276724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895812773539237:9924] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:45.279676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895812773539237:9924] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:45.279692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895812773539237:9924] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:45.279696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895812773539237:9924] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:45.279705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1632 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:45.280179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:45.282171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:45.282419Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:45.282434Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:45.282448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:45.282511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:45.282556Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895812683779530:9564]
2025-09-30T14:54:45.283310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:45.283687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:45.283750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:45.284119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:45.284201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:45.284210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:45.284212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:45.284213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:45.284214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:45.284216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:45.284217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:45.284219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:45.284220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:45.284221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:45.284222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.284224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.284225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.284226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:45.284228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:45.284235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:45.284245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:45.284249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:45.284253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:45.284257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:45.284261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:45.284265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:45.284269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:45.284273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:45.284277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:45.284280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.284284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.284288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.284292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:45.284295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:45.284304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:45.284312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:45.284323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:45.284328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:45.284333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:45.284338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:45.284342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:45.284347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:45.284352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:45.284358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:45.284362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:45.284367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:45.284373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:45.284378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:45.284383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:45.284389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:45.284395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:45.284400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:45.284407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:45.284414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:45.284419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.284425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.284429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.284435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.284440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.284447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.284458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:45.284465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:45.284470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:45.284475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:45.284525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:45.290245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:45.291161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:45.291179Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:45.291182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:45.291186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:45.291193Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1631 [2:7555895812683779530:9564]
2025-09-30T14:54:45.291210Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:45.291227Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:45.291235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:45.291239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:45.291262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:45.291279Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:45.291287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:45.291301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:45.291362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.291371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.291373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.291377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:45.291380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:45.291448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:45.291457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.291470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.291481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.291504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:45.291529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895812773539404:9924], now have 1 active actors on pipe
2025-09-30T14:54:45.291538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895812773539115:2454], now have 1 active actors on pipe
2025-09-30T14:54:45.291545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895812683779524:9564]
2025-09-30T14:54:45.291548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895812683779524:9564]
2025-09-30T14:54:45.291550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895812683779524:9564]
2025-09-30T14:54:45.291564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:45.291582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:45.291592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:45.291603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:45.291604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:45.291606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:45.291607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:45.291639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895812683779524:9564]
2025-09-30T14:54:45.291648Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:45.291626Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1631
2025-09-30T14:54:45.291668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:45.291694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1631
2025-09-30T14:54:45.291733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:45.291744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:45.291769Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4ae1cb3-d3f5fb83-912ecfc9-547cf4f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:45.291781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:45.291785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:45.291792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:45.291803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:45.291812Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:45.291826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:45.292017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:45.292025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:45.292038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:45.292145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1632 partition: 0 MaxSeqNo: 42 sessionId: src_id|e4ae1cb3-d3f5fb83-912ecfc9-547cf4f7_0
2025-09-30T14:54:45.292534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2b15ce1-7ea40319-5910e7b-b985a5ad_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e4ae1cb3-d3f5fb83-912ecfc9-547cf4f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:45.295360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ae1cb3-d3f5fb83-912ecfc9-547cf4f7_0] Write session: try to update token
2025-09-30T14:54:45.295380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ae1cb3-d3f5fb83-912ecfc9-547cf4f7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:45.304591Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:45.304614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:45.304618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:45.304620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:45.304632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895812683779524:9564]
2025-09-30T14:54:45.304638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895812683779524:9564]
2025-09-30T14:54:45.304645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895812683779524:9564]
2025-09-30T14:54:45.304708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:45.304712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:45.304721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:45.304725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.304727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:45.304728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:45.304930Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:45.314128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1632 sessionId: src_id|e4ae1cb3-d3f5fb83-912ecfc9-547cf4f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:45.316954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:45.362382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895812773539416:9749]
2025-09-30T14:54:45.362695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1631, pipe: [1:7555895812773539416:9749]
2025-09-30T14:54:45.417166Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:45.417605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:45.417620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:45.417637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895812773539416:9749], now have 1 active actors on pipe
2025-09-30T14:54:45.417979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895812773539416:9749]
2025-09-30T14:54:45.417979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:45.418019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:45.418022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:45.418087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1632 reason: error at write: Disconnected sessionId: src_id|e4ae1cb3-d3f5fb83-912ecfc9-547cf4f7_0
2025-09-30T14:54:45.418256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1632 sessionId: src_id|e4ae1cb3-d3f5fb83-912ecfc9-547cf4f7_0 is DEAD
2025-09-30T14:54:45.418423Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:45.418680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ae1cb3-d3f5fb83-912ecfc9-547cf4f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:45.418691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ae1cb3-d3f5fb83-912ecfc9-547cf4f7_0] Write session will restart in 0.006254s
2025-09-30T14:54:45.418715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ae1cb3-d3f5fb83-912ecfc9-547cf4f7_0] Write session: Do CDS request
2025-09-30T14:54:45.418725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ae1cb3-d3f5fb83-912ecfc9-547cf4f7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:45.425790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ae1cb3-d3f5fb83-912ecfc9-547cf4f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:45.425886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:45.425903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1633
2025-09-30T14:54:45.426034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1633 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:45.426066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1633 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:45.426075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1633 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:45.426079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:45.426448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1633 sessionId:  describe result for acl check
2025-09-30T14:54:45.426479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:45.426481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:45.426483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:45.426489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895812773539468:9928] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:45.426975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895812773539468:9928] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:45.428934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895812773539468:9928] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:45.431960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895812773539468:9928] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:45.431975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895812773539468:9928] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:45.431979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895812773539468:9928] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:45.431986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1633 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:45.434620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:45.436788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:45.436996Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:45.437006Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:45.437017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:45.437066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:45.437106Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895812683779749:9567]
2025-09-30T14:54:45.437809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:45.438087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:45.438125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:45.438455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:45.438518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:45.438524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:45.438525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:45.438526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:45.438528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:45.438529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:45.438530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:45.438531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:45.438533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:45.438534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:45.438535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.438537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.438538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.438539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:45.438540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:45.438546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:45.438557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:45.438562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:45.438566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:45.438571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:45.438575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:45.438579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:45.438584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:45.438588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:45.438593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:45.438597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.438601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.438605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.438609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:45.438614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:45.438621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:45.438629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:45.438636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:45.438642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:45.438646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:45.438658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:45.438663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:45.438673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:45.438679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:45.438684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:45.438693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:45.438700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:45.438709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:45.438715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:45.438723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:45.438729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:45.438733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:45.438739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:45.438743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:45.438748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:45.438753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.438764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.438768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.438773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.438778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.438788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.438793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:45.438800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:45.438804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:45.438810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:45.438869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:45.444524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:45.445387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:45.445402Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:45.445405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:45.445408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:45.445413Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1632 [2:7555895812683779749:9567]
2025-09-30T14:54:45.445426Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:45.445442Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:45.445447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:45.445450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:45.445452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:45.445466Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:45.445475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:45.445481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:45.445527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.445533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.445535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.445537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:45.445540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:45.445590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:45.445597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.445606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.445624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.445640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:45.445658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895812773539417:2454], now have 1 active actors on pipe
2025-09-30T14:54:45.445677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895812683779744:9567]
2025-09-30T14:54:45.445679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895812683779744:9567]
2025-09-30T14:54:45.445682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895812683779744:9567]
2025-09-30T14:54:45.445696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:45.445706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895812773539676:9928], now have 1 active actors on pipe
2025-09-30T14:54:45.445715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:45.445723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:45.445728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:45.445729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:45.445730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:45.445732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:45.445771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895812683779744:9567]
2025-09-30T14:54:45.445780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:45.445783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:45.445748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1632
2025-09-30T14:54:45.445765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1632
2025-09-30T14:54:45.446112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:45.446124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:45.446143Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6fb294f1-bcef780-dd685fcf-9f213fa1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:45.446150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:45.446153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:45.446156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:45.446165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:45.446176Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:45.446191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:45.446381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:45.446392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:45.446411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:45.446511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1633 partition: 0 MaxSeqNo: 42 sessionId: src_id|6fb294f1-bcef780-dd685fcf-9f213fa1_0
2025-09-30T14:54:45.446900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ae1cb3-d3f5fb83-912ecfc9-547cf4f7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6fb294f1-bcef780-dd685fcf-9f213fa1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:45.449838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fb294f1-bcef780-dd685fcf-9f213fa1_0] Write session: try to update token
2025-09-30T14:54:45.449859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fb294f1-bcef780-dd685fcf-9f213fa1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:45.458169Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:45.458202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:45.458215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895812683779744:9567]
2025-09-30T14:54:45.458276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:45.458276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:45.458490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:45.458656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:45.458819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:45.458965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:45.459181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:45.459232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:45.465263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1633 sessionId: src_id|6fb294f1-bcef780-dd685fcf-9f213fa1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:45.468078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:45.472706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:45.472739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:45.472769Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:45.472773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:45.472776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:45.472779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:45.472793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895812683779744:9567]
2025-09-30T14:54:45.472814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895812683779744:9567]
2025-09-30T14:54:45.472820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895812683779744:9567]
2025-09-30T14:54:45.472888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:45.472888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:45.472897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:45.472902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:45.472906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.472910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:45.473081Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:45.518029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895812773539719:9749]
2025-09-30T14:54:45.518419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1632, pipe: [1:7555895812773539719:9749]
2025-09-30T14:54:45.587824Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:45.588317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:45.588352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895812773539719:9749], now have 1 active actors on pipe
2025-09-30T14:54:45.588502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:45.588669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895812773539719:9749]
2025-09-30T14:54:45.588704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:45.600639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:45.600653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:45.600687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1633 reason: error at write: Disconnected sessionId: src_id|6fb294f1-bcef780-dd685fcf-9f213fa1_0
2025-09-30T14:54:45.600840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1633 sessionId: src_id|6fb294f1-bcef780-dd685fcf-9f213fa1_0 is DEAD
2025-09-30T14:54:45.600949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fb294f1-bcef780-dd685fcf-9f213fa1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:45.600956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fb294f1-bcef780-dd685fcf-9f213fa1_0] Write session will restart in 0.008267s
2025-09-30T14:54:45.600979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fb294f1-bcef780-dd685fcf-9f213fa1_0] Write session: Do CDS request
2025-09-30T14:54:45.600984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fb294f1-bcef780-dd685fcf-9f213fa1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:45.610802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fb294f1-bcef780-dd685fcf-9f213fa1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:45.611088Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:45.611103Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1634
2025-09-30T14:54:45.611264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1634 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:45.611308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1634 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:45.611314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1634 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:45.611318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:45.611361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:45.611813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1634 sessionId:  describe result for acl check
2025-09-30T14:54:45.611853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:45.611859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:45.611861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:45.611867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895812773539991:9934] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:45.612406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895812773539991:9934] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:45.614341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:45.615617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895812773539991:9934] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:45.614676Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:45.614697Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:45.614715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:45.614802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:45.614910Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895812683779978:9570]
2025-09-30T14:54:45.615687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:45.616064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:45.616129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:45.616515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:45.616618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:45.616627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:45.616628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:45.616630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:45.616631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:45.616632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:45.616646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:45.616648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:45.616649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:45.616651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:45.616652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.616654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.616655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.616657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:45.616658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:45.616665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:45.616678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:45.616683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:45.616687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:45.616690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:45.616695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:45.616699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:45.616704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:45.616708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:45.616713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:45.616717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.616721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.616725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.616729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:45.616733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:45.616744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:45.616758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:45.616770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:45.616776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:45.616786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:45.616793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:45.616804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:45.616809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:45.616817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:45.616823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:45.616833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:45.616843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:45.616853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:45.616864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:45.616869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:45.616875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:45.616884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:45.616891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:45.616900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:45.616907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:45.616916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.616921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.616931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.616937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.616944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.616954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.616959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:45.616966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:45.616971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:45.616981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:45.617032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:45.622504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895812773539991:9934] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:45.622520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895812773539991:9934] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:45.622522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895812773539991:9934] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:45.622530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1634 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:45.623090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:45.624774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:45.624797Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:45.624801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:45.624806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:45.624816Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1633 [2:7555895812683779978:9570]
2025-09-30T14:54:45.624839Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:45.624860Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:45.624865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:45.624869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:45.624872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:45.624894Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:45.624904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:45.624916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:45.625010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.625018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.625021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.625025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:45.625029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:45.625124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:45.625133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.625150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.625168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.625196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:45.625222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895812773539732:2454], now have 1 active actors on pipe
2025-09-30T14:54:45.625227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895812773540029:9934], now have 1 active actors on pipe
2025-09-30T14:54:45.625236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895812683779973:9570]
2025-09-30T14:54:45.625239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895812683779973:9570]
2025-09-30T14:54:45.625242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895812683779973:9570]
2025-09-30T14:54:45.625265Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:45.625287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:45.625289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:45.625295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:45.625298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:45.625308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:45.625312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:45.625294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1633
2025-09-30T14:54:45.625302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1633
2025-09-30T14:54:45.625361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895812683779973:9570]
2025-09-30T14:54:45.625371Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:45.625376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:45.625420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:45.625434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:45.625481Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b185219-3468dd27-a5d23fd8-639eeb11_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:45.625493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:45.625498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:45.625506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:45.625519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:45.625534Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:45.625569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:45.625805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:45.625818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:45.625838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:45.625941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1634 partition: 0 MaxSeqNo: 42 sessionId: src_id|6b185219-3468dd27-a5d23fd8-639eeb11_0
2025-09-30T14:54:45.626327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fb294f1-bcef780-dd685fcf-9f213fa1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6b185219-3468dd27-a5d23fd8-639eeb11_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:45.629393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b185219-3468dd27-a5d23fd8-639eeb11_0] Write session: try to update token
2025-09-30T14:54:45.629415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b185219-3468dd27-a5d23fd8-639eeb11_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:45.638336Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:45.638362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:45.638365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:45.638368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:45.638379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895812683779973:9570]
2025-09-30T14:54:45.638386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895812683779973:9570]
2025-09-30T14:54:45.638392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895812683779973:9570]
2025-09-30T14:54:45.638442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:45.638446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:45.638451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.638453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:45.638454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:45.638457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:45.638644Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:45.647141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1634 sessionId: src_id|6b185219-3468dd27-a5d23fd8-639eeb11_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:45.650271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:45.689002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895812773540038:9749]
2025-09-30T14:54:45.689304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1633, pipe: [1:7555895812773540038:9749]
2025-09-30T14:54:45.748478Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:45.749007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:45.749025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:45.749046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895812773540038:9749], now have 1 active actors on pipe
2025-09-30T14:54:45.749285Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:45.749385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:45.749412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895812773540038:9749]
2025-09-30T14:54:45.749435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:45.749525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1634 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6b185219-3468dd27-a5d23fd8-639eeb11_0
2025-09-30T14:54:45.749697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1634 sessionId: src_id|6b185219-3468dd27-a5d23fd8-639eeb11_0 is DEAD
2025-09-30T14:54:45.749875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b185219-3468dd27-a5d23fd8-639eeb11_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:45.749886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b185219-3468dd27-a5d23fd8-639eeb11_0] Write session will restart in 0.007739s
2025-09-30T14:54:45.749917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b185219-3468dd27-a5d23fd8-639eeb11_0] Write session: Do CDS request
2025-09-30T14:54:45.749924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b185219-3468dd27-a5d23fd8-639eeb11_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:45.758792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b185219-3468dd27-a5d23fd8-639eeb11_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:45.758857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:45.758880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1635
2025-09-30T14:54:45.759077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1635 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:45.759111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1635 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:45.759119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1635 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:45.759124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:45.759589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1635 sessionId:  describe result for acl check
2025-09-30T14:54:45.759625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:45.759632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:45.759634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:45.759641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895812773540127:9938] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:45.760270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895812773540127:9938] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:45.762680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895812773540127:9938] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:45.766022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895812773540127:9938] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:45.766037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895812773540127:9938] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:45.766041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895812773540127:9938] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:45.766049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1635 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:45.767176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:45.769130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:45.769317Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:45.769329Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:45.769336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:45.769374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:45.769406Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895812683780198:9572]
2025-09-30T14:54:45.769875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:45.770170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:45.770206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:45.770447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:45.770495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:45.770501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:45.770502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:45.770503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:45.770504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:45.770505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:45.770505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:45.770506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:45.770507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:45.770508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:45.770509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.770509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.770510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.770511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:45.770511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:45.770514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:45.770521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:45.770524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:45.770526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:45.770529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:45.770531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:45.770534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:45.770536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:45.770538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:45.770541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:45.770544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.770546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.770549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.770551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:45.770553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:45.770559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:45.770565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:45.770568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:45.770572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:45.770575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:45.770579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:45.770583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:45.770586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:45.770589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:45.770592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:45.770595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:45.770598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:45.770601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:45.770604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:45.770606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:45.770610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:45.770612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:45.770616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:45.770619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:45.770622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:45.770624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.770629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.770631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.770634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.770637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.770640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.770642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:45.770645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:45.770648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:45.770651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:45.770674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:45.776505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:45.777561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:45.777580Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:45.777584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:45.777589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:45.777599Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1634 [2:7555895812683780198:9572]
2025-09-30T14:54:45.777619Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:45.777644Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:45.777647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:45.777650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:45.777653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:45.777670Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:45.777677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:45.777686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:45.777766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.777774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.777776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.777780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:45.777783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:45.778005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:45.778015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.778026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.778034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.778010Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1634
2025-09-30T14:54:45.778047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:45.778059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1634
2025-09-30T14:54:45.778082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895812773540039:2454], now have 1 active actors on pipe
2025-09-30T14:54:45.778087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895812773540328:9938], now have 1 active actors on pipe
2025-09-30T14:54:45.778094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895812683780193:9572]
2025-09-30T14:54:45.778096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895812683780193:9572]
2025-09-30T14:54:45.778098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895812683780193:9572]
2025-09-30T14:54:45.778113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:45.778132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:45.778138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:45.778148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:45.778149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:45.778151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:45.778151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:45.778168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:45.778172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:45.778230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895812683780193:9572]
2025-09-30T14:54:45.778242Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:45.778252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:45.778258Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5e1fc8e-36d4b665-61d281a-2afa98c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:45.778265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:45.778269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:45.778271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:45.778281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:45.778291Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:45.778343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:45.778555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:45.778580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:45.778607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:45.778736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1635 partition: 0 MaxSeqNo: 42 sessionId: src_id|c5e1fc8e-36d4b665-61d281a-2afa98c1_0
2025-09-30T14:54:45.779172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b185219-3468dd27-a5d23fd8-639eeb11_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c5e1fc8e-36d4b665-61d281a-2afa98c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:45.782016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5e1fc8e-36d4b665-61d281a-2afa98c1_0] Write session: try to update token
2025-09-30T14:54:45.782041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5e1fc8e-36d4b665-61d281a-2afa98c1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:45.790570Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:45.790595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:45.790598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:45.790600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:45.790609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895812683780193:9572]
2025-09-30T14:54:45.790613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895812683780193:9572]
2025-09-30T14:54:45.790620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895812683780193:9572]
2025-09-30T14:54:45.790663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:45.790670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.790670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:45.790673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:45.790677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:45.790682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:45.790810Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:45.797872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1635 sessionId: src_id|c5e1fc8e-36d4b665-61d281a-2afa98c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:45.800674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:45.849815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895812773540365:9749]
2025-09-30T14:54:45.850147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1634, pipe: [1:7555895812773540365:9749]
2025-09-30T14:54:45.911117Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:45.911826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:45.911842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:45.911882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895812773540365:9749], now have 1 active actors on pipe
2025-09-30T14:54:45.912134Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:45.912167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895812773540365:9749]
2025-09-30T14:54:45.912183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:45.912203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:45.912261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1635 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c5e1fc8e-36d4b665-61d281a-2afa98c1_0
2025-09-30T14:54:45.912430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1635 sessionId: src_id|c5e1fc8e-36d4b665-61d281a-2afa98c1_0 is DEAD
2025-09-30T14:54:45.912580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5e1fc8e-36d4b665-61d281a-2afa98c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:45.912591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5e1fc8e-36d4b665-61d281a-2afa98c1_0] Write session will restart in 0.006148s
2025-09-30T14:54:45.912614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5e1fc8e-36d4b665-61d281a-2afa98c1_0] Write session: Do CDS request
2025-09-30T14:54:45.912621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5e1fc8e-36d4b665-61d281a-2afa98c1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:45.919720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5e1fc8e-36d4b665-61d281a-2afa98c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:45.919816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:45.919831Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1636
2025-09-30T14:54:45.919968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1636 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:45.920009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1636 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:45.920020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1636 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:45.920024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:45.920506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1636 sessionId:  describe result for acl check
2025-09-30T14:54:45.920543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:45.920545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:45.920547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:45.920553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895812773540420:9949] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:45.921103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895812773540420:9949] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:45.923506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895812773540420:9949] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:45.927306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895812773540420:9949] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:45.927336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895812773540420:9949] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:45.927340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895812773540420:9949] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:45.927349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1636 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:45.928724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:45.930607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:45.930788Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:45.930798Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:45.930809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:45.930856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:45.930896Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895812683780456:9587]
2025-09-30T14:54:45.931568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:45.931902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:45.931958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:45.932291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:45.932346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:45.932350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:45.932351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:45.932352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:45.932353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:45.932354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:45.932355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:45.932355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:45.932356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:45.932357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:45.932357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.932358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.932359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.932359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:45.932360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:45.932364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:45.932371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:45.932373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:45.932376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:45.932378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:45.932380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:45.932383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:45.932385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:45.932388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:45.932390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:45.932392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.932395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.932397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.932399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:45.932402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:45.932408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:45.932413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:45.932417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:45.932421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:45.932424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:45.932428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:45.932430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:45.932433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:45.932436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:45.932439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:45.932442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:45.932445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:45.932447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:45.932450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:45.932454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:45.932456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:45.932459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:45.932463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:45.932466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:45.932469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:45.932473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.932476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.932479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.932483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.932487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.932492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.932495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:45.932501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:45.932505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:45.932509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:45.932548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:45.938156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:45.939295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:45.939309Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:45.939312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:45.939316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:45.939323Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1635 [2:7555895812683780456:9587]
2025-09-30T14:54:45.939338Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:45.939354Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:45.939357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:45.939359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:45.939360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:45.939373Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:45.939378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:45.939384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:45.939440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.939449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.939451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.939454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:45.939457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:45.939526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:45.939535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.939548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:45.939561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:45.939578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:45.939604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895812773540366:2454], now have 1 active actors on pipe
2025-09-30T14:54:45.939613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895812773540656:9949], now have 1 active actors on pipe
2025-09-30T14:54:45.939620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895812683780450:9587]
2025-09-30T14:54:45.939627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895812683780450:9587]
2025-09-30T14:54:45.939630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895812683780450:9587]
2025-09-30T14:54:45.939643Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:45.939657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:45.939659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:45.939662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:45.939665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:45.939677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:45.939680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:45.939712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895812683780450:9587]
2025-09-30T14:54:45.939720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:45.939724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:45.939695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1635
2025-09-30T14:54:45.939713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1635
2025-09-30T14:54:45.939767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:45.939781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:45.939809Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6d2b8a2-9f7bbbb3-dfbec95c-c3681f6c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:45.939821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:45.939826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:45.939828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:45.939838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:45.939851Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:45.939864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:45.940051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:45.940059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:45.940072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:45.940155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1636 partition: 0 MaxSeqNo: 42 sessionId: src_id|f6d2b8a2-9f7bbbb3-dfbec95c-c3681f6c_0
2025-09-30T14:54:45.940522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5e1fc8e-36d4b665-61d281a-2afa98c1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f6d2b8a2-9f7bbbb3-dfbec95c-c3681f6c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:45.943448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6d2b8a2-9f7bbbb3-dfbec95c-c3681f6c_0] Write session: try to update token
2025-09-30T14:54:45.943469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6d2b8a2-9f7bbbb3-dfbec95c-c3681f6c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:45.952498Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:45.952521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:45.952531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895812683780450:9587]
2025-09-30T14:54:45.952582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:45.952596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:45.952774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:45.952931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:45.953083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:45.953244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:45.953467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:45.953528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:45.958906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1636 sessionId: src_id|f6d2b8a2-9f7bbbb3-dfbec95c-c3681f6c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:45.961842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:45.962747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:45.962775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:45.964823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:45.964867Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:45.964870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:45.964873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:45.964875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:45.964885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895812683780450:9587]
2025-09-30T14:54:45.964889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895812683780450:9587]
2025-09-30T14:54:45.964896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895812683780450:9587]
2025-09-30T14:54:45.964930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:45.964936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:45.964938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:45.964937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:45.964943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:45.964948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:45.964982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:45.965071Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:46.012166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895817068507967:9749]
2025-09-30T14:54:46.012525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1635, pipe: [1:7555895817068507967:9749]
2025-09-30T14:54:46.076441Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:46.087973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:46.088012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:46.088255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:46.088340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:46.088425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:46.088513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:46.089282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:46.089298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:46.089386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:46.089470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:46.089545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:46.089621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:46.089676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:46.089684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:46.089781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:46.089858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:46.089938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:46.090014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:46.090070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:46.090079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:46.090160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:46.090232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:46.090314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:46.090391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:46.090458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:46.090465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:46.090542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:46.090608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:46.090678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:46.090748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:46.090818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:46.090834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:46.090915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:46.090992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:46.091073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:46.091151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:46.091209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:46.091216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:46.091328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:46.091403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:46.091512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:46.091588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:46.091646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:46.091654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:46.091735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:46.091819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:46.091902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:46.091980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:46.092041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:46.092049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:46.092127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:46.092198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:46.092275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:46.092362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:46.092422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:46.092431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:46.092512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:46.092580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:46.092652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:46.092725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:46.092791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:46.092801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:46.092898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895817068507967:9749], now have 1 active actors on pipe
2025-09-30T14:54:46.093183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:46.093197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:46.093201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:46.093232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1636 reason: error at write: Disconnected sessionId: src_id|f6d2b8a2-9f7bbbb3-dfbec95c-c3681f6c_0
2025-09-30T14:54:46.093254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895817068507967:9749]
2025-09-30T14:54:46.093447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1636 sessionId: src_id|f6d2b8a2-9f7bbbb3-dfbec95c-c3681f6c_0 is DEAD
2025-09-30T14:54:46.093579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6d2b8a2-9f7bbbb3-dfbec95c-c3681f6c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:46.093590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6d2b8a2-9f7bbbb3-dfbec95c-c3681f6c_0] Write session will restart in 0.006321s
2025-09-30T14:54:46.093616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6d2b8a2-9f7bbbb3-dfbec95c-c3681f6c_0] Write session: Do CDS request
2025-09-30T14:54:46.093622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6d2b8a2-9f7bbbb3-dfbec95c-c3681f6c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:46.093800Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:46.100822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6d2b8a2-9f7bbbb3-dfbec95c-c3681f6c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:46.100941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:46.100958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1637
2025-09-30T14:54:46.101087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1637 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:46.101121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1637 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:46.101127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1637 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:46.101130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:46.101514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1637 sessionId:  describe result for acl check
2025-09-30T14:54:46.101550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:46.101553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:46.101554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:46.101559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895817068508001:9954] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:46.102078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895817068508001:9954] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:46.104067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895817068508001:9954] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:46.106698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895817068508001:9954] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:46.106711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895817068508001:9954] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:46.106715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895817068508001:9954] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:46.106722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1637 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:46.111995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:46.114924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:46.115293Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:46.115307Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:46.115323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:46.115407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:46.115463Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895816978747973:9589]
2025-09-30T14:54:46.116243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:46.116720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:46.116815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:46.117251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:46.117364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:46.117371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:46.117373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:46.117375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:46.117377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:46.117378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:46.117380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:46.117381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:46.117383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:46.117385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:46.117386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.117388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.117390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.117391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:46.117393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:46.117401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:46.117413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:46.117418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:46.117423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:46.117429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:46.117434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:46.117439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:46.117443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:46.117447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:46.117453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:46.117457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.117462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.117467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.117471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:46.117475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:46.117488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:46.117497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:46.117511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:46.117522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:46.117532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:46.117538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:46.117548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:46.117555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:46.117566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:46.117573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:46.117584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:46.117589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:46.117594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:46.117607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:46.117611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:46.117621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:46.117627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:46.117632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:46.117638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:46.117644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:46.117650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.117661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.117667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.117678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.117684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.117694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.117699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:46.117708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:46.117713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:46.117719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:46.117788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:46.123796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:46.125386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:46.125410Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:46.125414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:46.125418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:46.125427Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1636 [2:7555895816978747973:9589]
2025-09-30T14:54:46.125447Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:46.125471Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:46.125475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:46.125479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:46.125482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:46.125502Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:46.125516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:46.125530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:46.125615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.125625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.125627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.125631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:46.125635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:46.125725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:46.125733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.125761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.125779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.125803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:46.125832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895817068507971:2454], now have 1 active actors on pipe
2025-09-30T14:54:46.125841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895817068508179:9954], now have 1 active actors on pipe
2025-09-30T14:54:46.125850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895816978747968:9589]
2025-09-30T14:54:46.125853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895816978747968:9589]
2025-09-30T14:54:46.125855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895816978747968:9589]
2025-09-30T14:54:46.125872Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:46.125896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:46.125905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:46.125918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:46.125884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1636
2025-09-30T14:54:46.125922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:46.125905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1636
2025-09-30T14:54:46.125924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:46.125927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:46.125967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895816978747968:9589]
2025-09-30T14:54:46.125976Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:46.125980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:46.126018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:46.126027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:46.126072Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68b0ce0-2522df13-26c0d41e-a43f4719_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:46.126086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:46.126091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:46.126093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:46.126106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:46.126124Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:46.126152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:46.126355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:46.126366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:46.126388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:46.126485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1637 partition: 0 MaxSeqNo: 42 sessionId: src_id|68b0ce0-2522df13-26c0d41e-a43f4719_0
2025-09-30T14:54:46.126877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6d2b8a2-9f7bbbb3-dfbec95c-c3681f6c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|68b0ce0-2522df13-26c0d41e-a43f4719_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:46.130023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68b0ce0-2522df13-26c0d41e-a43f4719_0] Write session: try to update token
2025-09-30T14:54:46.130043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68b0ce0-2522df13-26c0d41e-a43f4719_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:46.139145Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:46.139172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:46.139176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:46.139179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:46.139191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895816978747968:9589]
2025-09-30T14:54:46.139197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895816978747968:9589]
2025-09-30T14:54:46.139204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895816978747968:9589]
2025-09-30T14:54:46.139281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:46.139281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:46.139291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.139292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:46.139294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:46.139297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:46.139486Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:46.146867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1637 sessionId: src_id|68b0ce0-2522df13-26c0d41e-a43f4719_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:46.149760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:46.193371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895817068508283:9749]
2025-09-30T14:54:46.193693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1636, pipe: [1:7555895817068508283:9749]
2025-09-30T14:54:46.263052Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:46.263656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:46.263680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:46.263708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895817068508283:9749], now have 1 active actors on pipe
2025-09-30T14:54:46.263949Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:46.264020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895817068508283:9749]
2025-09-30T14:54:46.264032Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:46.264054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:46.264159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1637 reason: status is not ok: tablet will be restarted right now sessionId: src_id|68b0ce0-2522df13-26c0d41e-a43f4719_0
2025-09-30T14:54:46.264341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1637 sessionId: src_id|68b0ce0-2522df13-26c0d41e-a43f4719_0 is DEAD
2025-09-30T14:54:46.264473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68b0ce0-2522df13-26c0d41e-a43f4719_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:46.264484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68b0ce0-2522df13-26c0d41e-a43f4719_0] Write session will restart in 0.006218s
2025-09-30T14:54:46.264509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68b0ce0-2522df13-26c0d41e-a43f4719_0] Write session: Do CDS request
2025-09-30T14:54:46.264514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68b0ce0-2522df13-26c0d41e-a43f4719_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:46.271681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68b0ce0-2522df13-26c0d41e-a43f4719_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:46.271761Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:46.271779Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1638
2025-09-30T14:54:46.271892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1638 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:46.271927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1638 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:46.271936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1638 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:46.271940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:46.272421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1638 sessionId:  describe result for acl check
2025-09-30T14:54:46.272459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:46.272461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:46.272463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:46.272472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895817068508318:9958] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:46.273172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895817068508318:9958] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:46.276194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895817068508318:9958] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:46.279367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895817068508318:9958] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:46.279384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895817068508318:9958] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:46.279388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895817068508318:9958] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:46.279397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1638 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:46.282500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:46.284323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:46.284675Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:46.284688Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:46.284705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:46.284806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:46.284864Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895816978748195:9591]
2025-09-30T14:54:46.285666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:46.286054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:46.286116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:46.286541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:46.286634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:46.286640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:46.286642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:46.286644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:46.286646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:46.286647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:46.286649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:46.286650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:46.286652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:46.286653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:46.286655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.286656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.286658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.286660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:46.286661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:46.286669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:46.286681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:46.286685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:46.286690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:46.286694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:46.286699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:46.286703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:46.286708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:46.286712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:46.286719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:46.286724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.286729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.286734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.286738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:46.286742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:46.286752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:46.286760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:46.286767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:46.286773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:46.286779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:46.286786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:46.286792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:46.286798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:46.286803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:46.286806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:46.286812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:46.286815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:46.286820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:46.286824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:46.286827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:46.286830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:46.286833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:46.286838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:46.286842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:46.286845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:46.286849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.286852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.286856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.286860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.286863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.286867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.286869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:46.286873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:46.286877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:46.286880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:46.286918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:46.292899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:46.294184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:46.294202Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:46.294205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:46.294210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:46.294217Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1637 [2:7555895816978748195:9591]
2025-09-30T14:54:46.294236Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:46.294253Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:46.294257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:46.294260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:46.294262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:46.294278Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:46.294285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:46.294291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:46.294352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.294363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.294365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.294369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:46.294373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:46.294440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:46.294450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.294467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.294490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.294509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:46.294536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895817068508548:9958], now have 1 active actors on pipe
2025-09-30T14:54:46.294548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895817068508284:2454], now have 1 active actors on pipe
2025-09-30T14:54:46.294554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895816978748190:9591]
2025-09-30T14:54:46.294556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895816978748190:9591]
2025-09-30T14:54:46.294557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895816978748190:9591]
2025-09-30T14:54:46.294569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:46.294583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:46.294593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:46.294597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:46.294599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:46.294614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1637
2025-09-30T14:54:46.294599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:46.294602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:46.294615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1637
2025-09-30T14:54:46.294639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895816978748190:9591]
2025-09-30T14:54:46.294642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:46.294651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:46.294677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:46.294682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:46.294713Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49a6420a-cd4f7065-e8ae896d-80b6965e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:46.294730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:46.294736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:46.294739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:46.294750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:46.294759Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:46.294777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:46.294913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:46.294924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:46.294938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:46.295029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1638 partition: 0 MaxSeqNo: 42 sessionId: src_id|49a6420a-cd4f7065-e8ae896d-80b6965e_0
2025-09-30T14:54:46.295410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68b0ce0-2522df13-26c0d41e-a43f4719_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|49a6420a-cd4f7065-e8ae896d-80b6965e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:46.298325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49a6420a-cd4f7065-e8ae896d-80b6965e_0] Write session: try to update token
2025-09-30T14:54:46.298343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49a6420a-cd4f7065-e8ae896d-80b6965e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:46.307605Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:46.307626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:46.307629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:46.307632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:46.307644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895816978748190:9591]
2025-09-30T14:54:46.307651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895816978748190:9591]
2025-09-30T14:54:46.307657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895816978748190:9591]
2025-09-30T14:54:46.307707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:46.307717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.307719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:46.307720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:46.307727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:46.307732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:46.307895Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:46.317746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1638 sessionId: src_id|49a6420a-cd4f7065-e8ae896d-80b6965e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:46.320624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:46.364373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895817068508592:9749]
2025-09-30T14:54:46.364710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1637, pipe: [1:7555895817068508592:9749]
2025-09-30T14:54:46.428127Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:46.428511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:46.428540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:46.428570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895817068508592:9749], now have 1 active actors on pipe
2025-09-30T14:54:46.428844Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:46.428851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:46.428862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895817068508592:9749]
2025-09-30T14:54:46.428891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:46.428894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:46.428949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1638 reason: error at write: Disconnected sessionId: src_id|49a6420a-cd4f7065-e8ae896d-80b6965e_0
2025-09-30T14:54:46.429120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1638 sessionId: src_id|49a6420a-cd4f7065-e8ae896d-80b6965e_0 is DEAD
2025-09-30T14:54:46.429249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49a6420a-cd4f7065-e8ae896d-80b6965e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:46.429261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49a6420a-cd4f7065-e8ae896d-80b6965e_0] Write session will restart in 0.006733s
2025-09-30T14:54:46.429282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49a6420a-cd4f7065-e8ae896d-80b6965e_0] Write session: Do CDS request
2025-09-30T14:54:46.429291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49a6420a-cd4f7065-e8ae896d-80b6965e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:46.436803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49a6420a-cd4f7065-e8ae896d-80b6965e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:46.436958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:46.436991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1639
2025-09-30T14:54:46.437170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1639 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:46.437211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1639 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:46.437224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1639 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:46.437229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:46.437774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1639 sessionId:  describe result for acl check
2025-09-30T14:54:46.437827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:46.437836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:46.437838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:46.437845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895817068508636:9962] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:46.438522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895817068508636:9962] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:46.441208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895817068508636:9962] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:46.444510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895817068508636:9962] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:46.444530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895817068508636:9962] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:46.444535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895817068508636:9962] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:46.444544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1639 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:46.448581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:46.451654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:46.451991Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:46.452009Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:46.452034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:46.452196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:46.452252Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895816978748420:9594]
2025-09-30T14:54:46.452824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:46.453204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:46.453259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:46.453569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:46.453655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:46.453663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:46.453665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:46.453666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:46.453667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:46.453669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:46.453671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:46.453672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:46.453674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:46.453676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:46.453677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.453679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.453680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.453681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:46.453683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:46.453690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:46.453701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:46.453705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:46.453710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:46.453714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:46.453718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:46.453722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:46.453724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:46.453727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:46.453730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:46.453732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.453735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.453737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.453740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:46.453743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:46.453761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:46.453768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:46.453777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:46.453783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:46.453788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:46.453794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:46.453800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:46.453805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:46.453811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:46.453816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:46.453822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:46.453827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:46.453833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:46.453839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:46.453844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:46.453850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:46.453856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:46.453862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:46.453866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:46.453871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:46.453880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.453888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.453893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.453899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.453904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.453910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.453915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:46.453921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:46.453925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:46.453931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:46.453966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:46.460676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:46.461898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:46.461918Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:46.461929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:46.461934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:46.461943Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1638 [2:7555895816978748420:9594]
2025-09-30T14:54:46.461961Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:46.461978Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:46.461982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:46.461985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:46.461988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:46.462005Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:46.462012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:46.462019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:46.462090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.462100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.462102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.462106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:46.462111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:46.462188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:46.462197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.462213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.462240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.462262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:46.462291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895817068508829:9962], now have 1 active actors on pipe
2025-09-30T14:54:46.462297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895816978748415:9594]
2025-09-30T14:54:46.462300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895816978748415:9594]
2025-09-30T14:54:46.462303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895816978748415:9594]
2025-09-30T14:54:46.462319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:46.462331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895817068508593:2454], now have 1 active actors on pipe
2025-09-30T14:54:46.462338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:46.462347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:46.462354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:46.462357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:46.462361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:46.462364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:46.462393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895816978748415:9594]
2025-09-30T14:54:46.462408Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:46.462424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:46.462511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:46.462516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:46.462542Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|653b061a-59633ac0-5be0e200-cc244dc3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:46.462550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:46.462553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:46.462556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:46.462568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:46.462577Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:46.462597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:46.462817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:46.462828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:46.462842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:46.462423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1638
2025-09-30T14:54:46.462474Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1638
2025-09-30T14:54:46.463129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1639 partition: 0 MaxSeqNo: 42 sessionId: src_id|653b061a-59633ac0-5be0e200-cc244dc3_0
2025-09-30T14:54:46.463601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49a6420a-cd4f7065-e8ae896d-80b6965e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|653b061a-59633ac0-5be0e200-cc244dc3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:46.466485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|653b061a-59633ac0-5be0e200-cc244dc3_0] Write session: try to update token
2025-09-30T14:54:46.466506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|653b061a-59633ac0-5be0e200-cc244dc3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:46.476701Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:46.476726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:46.476729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:46.476732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:46.476748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895816978748415:9594]
2025-09-30T14:54:46.476753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895816978748415:9594]
2025-09-30T14:54:46.476759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895816978748415:9594]
2025-09-30T14:54:46.476810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:46.476820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.476823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:46.476826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:46.476833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:46.476838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:46.477029Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:46.485700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1639 sessionId: src_id|653b061a-59633ac0-5be0e200-cc244dc3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:46.489051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:46.529240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895817068508901:9749]
2025-09-30T14:54:46.529620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1638, pipe: [1:7555895817068508901:9749]
2025-09-30T14:54:46.596187Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:46.596472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:46.596486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:46.596503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895817068508901:9749], now have 1 active actors on pipe
2025-09-30T14:54:46.596726Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:46.596834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895817068508901:9749]
2025-09-30T14:54:46.596873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:46.596890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:46.596999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1639 reason: status is not ok: tablet will be restarted right now sessionId: src_id|653b061a-59633ac0-5be0e200-cc244dc3_0
2025-09-30T14:54:46.597258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1639 sessionId: src_id|653b061a-59633ac0-5be0e200-cc244dc3_0 is DEAD
2025-09-30T14:54:46.597458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|653b061a-59633ac0-5be0e200-cc244dc3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:46.597472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|653b061a-59633ac0-5be0e200-cc244dc3_0] Write session will restart in 0.005129s
2025-09-30T14:54:46.597503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|653b061a-59633ac0-5be0e200-cc244dc3_0] Write session: Do CDS request
2025-09-30T14:54:46.597510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|653b061a-59633ac0-5be0e200-cc244dc3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:46.603826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|653b061a-59633ac0-5be0e200-cc244dc3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:46.603896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:46.603913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1640
2025-09-30T14:54:46.604181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1640 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:46.604222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1640 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:46.604235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1640 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:46.604240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:46.604773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1640 sessionId:  describe result for acl check
2025-09-30T14:54:46.604807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:46.604813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:46.604815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:46.604821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895817068508935:9968] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:46.605357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895817068508935:9968] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:46.608025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895817068508935:9968] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:46.612277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895817068508935:9968] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:46.612292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895817068508935:9968] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:46.612296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895817068508935:9968] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:46.612305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1640 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:46.616181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:46.618782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:46.619046Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:46.619060Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:46.619073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:46.619142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:46.619199Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895816978748656:9597]
2025-09-30T14:54:46.619842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:46.620526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:46.620571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:46.620899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:46.620958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:46.620965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:46.620966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:46.620968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:46.620970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:46.620972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:46.620973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:46.620975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:46.620977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:46.620978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:46.620979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.620981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.620982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.620983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:46.620985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:46.620991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:46.621001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:46.621004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:46.621006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:46.621009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:46.621012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:46.621015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:46.621018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:46.621020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:46.621023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:46.621026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.621028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.621031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.621033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:46.621036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:46.621043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:46.621048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:46.621053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:46.621057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:46.621062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:46.621066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:46.621069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:46.621074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:46.621077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:46.621080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:46.621084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:46.621087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:46.621092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:46.621097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:46.621102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:46.621109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:46.621114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:46.621120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:46.621125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:46.621132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:46.621137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.621140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.621143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.621146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.621149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.621152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.621155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:46.621158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:46.621161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:46.621164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:46.621195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:46.628583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:46.629654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:46.629675Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:46.629680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:46.629685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:46.629694Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1639 [2:7555895816978748656:9597]
2025-09-30T14:54:46.629716Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:46.629737Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:46.629741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:46.629755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:46.629760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:46.629781Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:46.629794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:46.629803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:46.629883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.629892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.629896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.629900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:46.629904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:46.629997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:46.630006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.630021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.630040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.630065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:46.630097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895817068508916:2454], now have 1 active actors on pipe
2025-09-30T14:54:46.630108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895817068509166:9968], now have 1 active actors on pipe
2025-09-30T14:54:46.630116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895816978748651:9597]
2025-09-30T14:54:46.630120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895816978748651:9597]
2025-09-30T14:54:46.630122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895816978748651:9597]
2025-09-30T14:54:46.630138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:46.630159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:46.630167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:46.630171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:46.630174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:46.630177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:46.630181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:46.630232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895816978748651:9597]
2025-09-30T14:54:46.630245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:46.630275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:46.630241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1639
2025-09-30T14:54:46.630331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:46.630342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:46.630243Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1639
2025-09-30T14:54:46.630451Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d950400-a62baceb-312b42e0-61aae70_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:46.630481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:46.630487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:46.630490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:46.630504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:46.630522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:46.630543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:46.630751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:46.630764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:46.630780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:46.630917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1640 partition: 0 MaxSeqNo: 42 sessionId: src_id|8d950400-a62baceb-312b42e0-61aae70_0
2025-09-30T14:54:46.631310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|653b061a-59633ac0-5be0e200-cc244dc3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8d950400-a62baceb-312b42e0-61aae70_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:46.634121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d950400-a62baceb-312b42e0-61aae70_0] Write session: try to update token
2025-09-30T14:54:46.634142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d950400-a62baceb-312b42e0-61aae70_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:46.643727Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:46.643755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:46.643767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895816978748651:9597]
2025-09-30T14:54:46.643824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:46.643841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:46.644028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:46.644191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:46.644355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:46.644525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:46.644757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:46.644814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:46.651933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1640 sessionId: src_id|8d950400-a62baceb-312b42e0-61aae70_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:46.655009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:46.655480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:46.655513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:46.655542Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:46.655545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:46.655549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:46.655552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:46.655564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895816978748651:9597]
2025-09-30T14:54:46.655569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895816978748651:9597]
2025-09-30T14:54:46.655574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895816978748651:9597]
2025-09-30T14:54:46.655632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:46.655636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:46.655645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.655647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:46.655648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:46.655652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:46.655801Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:46.697154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895817068509225:9749]
2025-09-30T14:54:46.697582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1639, pipe: [1:7555895817068509225:9749]
2025-09-30T14:54:46.782635Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:46.783480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:46.783533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895817068509225:9749], now have 1 active actors on pipe
2025-09-30T14:54:46.783757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895817068509225:9749]
2025-09-30T14:54:46.783761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:46.783795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:46.783856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:46.783859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:46.783929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1640 reason: error at write: Disconnected sessionId: src_id|8d950400-a62baceb-312b42e0-61aae70_0
2025-09-30T14:54:46.784081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1640 sessionId: src_id|8d950400-a62baceb-312b42e0-61aae70_0 is DEAD
2025-09-30T14:54:46.784282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d950400-a62baceb-312b42e0-61aae70_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:46.784296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d950400-a62baceb-312b42e0-61aae70_0] Write session will restart in 0.009871s
2025-09-30T14:54:46.784320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d950400-a62baceb-312b42e0-61aae70_0] Write session: Do CDS request
2025-09-30T14:54:46.784327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d950400-a62baceb-312b42e0-61aae70_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:46.795763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d950400-a62baceb-312b42e0-61aae70_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:46.796055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:46.796078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1641
2025-09-30T14:54:46.796213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1641 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:46.796249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1641 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:46.796258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1641 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:46.796262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:46.796737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1641 sessionId:  describe result for acl check
2025-09-30T14:54:46.796779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:46.796789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:46.796791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:46.796798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895817068509329:9972] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:46.797369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895817068509329:9972] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:46.800069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895817068509329:9972] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:46.803806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895817068509329:9972] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:46.803831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895817068509329:9972] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:46.803835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895817068509329:9972] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:46.803847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1641 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:46.805619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:46.809078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:46.809310Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:46.809325Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:46.809341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:46.809412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:46.809467Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895816978748883:9600]
2025-09-30T14:54:46.810165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:46.810524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:46.810579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:46.810931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:46.811002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:46.811012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:46.811013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:46.811015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:46.811016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:46.811018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:46.811019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:46.811020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:46.811021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:46.811023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:46.811024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.811025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.811026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.811027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:46.811029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:46.811034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:46.811046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:46.811051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:46.811057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:46.811061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:46.811066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:46.811070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:46.811074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:46.811078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:46.811083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:46.811087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.811092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.811096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.811100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:46.811105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:46.811113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:46.811122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:46.811128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:46.811134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:46.811139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:46.811144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:46.811149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:46.811156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:46.811161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:46.811166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:46.811171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:46.811177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:46.811183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:46.811189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:46.811194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:46.811200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:46.811205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:46.811211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:46.811216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:46.811222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:46.811227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.811233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.811238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.811267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.811277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.811284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.811294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:46.811300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:46.811307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:46.811313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:46.811364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:46.817043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:46.818469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-09-30T14:54:46.818493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 9
2025-09-30T14:54:46.819586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:46.819606Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:46.819609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:46.819613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:46.819621Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1640 [2:7555895816978748883:9600]
2025-09-30T14:54:46.819640Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:46.819657Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:46.819660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:46.819664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:46.819666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:46.819682Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:46.819689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:46.819698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:46.819759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.819761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.819764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.819767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:46.819771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:46.819976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1640
2025-09-30T14:54:46.820083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1640
2025-09-30T14:54:46.820191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:46.820204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.820220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.820238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.820266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:46.820287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895817068509521:9972], now have 1 active actors on pipe
2025-09-30T14:54:46.820297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895817068509227:2454], now have 1 active actors on pipe
2025-09-30T14:54:46.820316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:46.820327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:46.820368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895816978748878:9600]
2025-09-30T14:54:46.820376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895816978748878:9600]
2025-09-30T14:54:46.820378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895816978748878:9600]
2025-09-30T14:54:46.820392Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:46.820405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:46.820413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:46.820416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:46.820420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:46.820430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:46.820439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:46.820456Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65258e0-59ecd36d-bf1270db-6f309ef1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:46.820468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:46.820473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:46.820475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:46.820485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:46.820501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:46.820554Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 85826639 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:54:46.820613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895816978748878:9600]
2025-09-30T14:54:46.820629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:46.820639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:46.820645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:46.820782Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 10 DataSize: 85826639 UsedReserveSize: 0
2025-09-30T14:54:46.820818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:54:46.820916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:46.820928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:46.820945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:46.821043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1641 partition: 0 MaxSeqNo: 42 sessionId: src_id|65258e0-59ecd36d-bf1270db-6f309ef1_0
2025-09-30T14:54:46.821400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d950400-a62baceb-312b42e0-61aae70_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|65258e0-59ecd36d-bf1270db-6f309ef1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:46.824228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65258e0-59ecd36d-bf1270db-6f309ef1_0] Write session: try to update token
2025-09-30T14:54:46.824246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65258e0-59ecd36d-bf1270db-6f309ef1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:46.848683Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:46.848701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:46.848710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895816978748878:9600]
2025-09-30T14:54:46.848743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:46.849919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:46.850105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:46.850260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:46.850411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:46.850564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:46.850761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:46.850795Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:46.850802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:46.850804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:46.850805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:46.850812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895816978748878:9600]
2025-09-30T14:54:46.850816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895816978748878:9600]
2025-09-30T14:54:46.850819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895816978748878:9600]
2025-09-30T14:54:46.850857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:46.850869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:46.850874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:46.850877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:46.850880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:46.850886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.850888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:46.851021Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:46.851955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1641 sessionId: src_id|65258e0-59ecd36d-bf1270db-6f309ef1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:46.854736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:46.884009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895817068509564:9749]
2025-09-30T14:54:46.884201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1640, pipe: [1:7555895817068509564:9749]
2025-09-30T14:54:46.960532Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:46.960988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:46.961001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:46.961018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895817068509564:9749], now have 1 active actors on pipe
2025-09-30T14:54:46.961180Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:46.961248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895817068509564:9749]
2025-09-30T14:54:46.961254Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:46.961269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 0
2025-09-30T14:54:46.961294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:46.961377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1641 reason: status is not ok: tablet will be restarted right now sessionId: src_id|65258e0-59ecd36d-bf1270db-6f309ef1_0
2025-09-30T14:54:46.961536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1641 sessionId: src_id|65258e0-59ecd36d-bf1270db-6f309ef1_0 is DEAD
2025-09-30T14:54:46.961685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65258e0-59ecd36d-bf1270db-6f309ef1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:46.961697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65258e0-59ecd36d-bf1270db-6f309ef1_0] Write session will restart in 0.005463s
2025-09-30T14:54:46.961721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65258e0-59ecd36d-bf1270db-6f309ef1_0] Write session: Do CDS request
2025-09-30T14:54:46.961727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65258e0-59ecd36d-bf1270db-6f309ef1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:46.968779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65258e0-59ecd36d-bf1270db-6f309ef1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:46.968832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:46.968845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1642
2025-09-30T14:54:46.969009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1642 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:46.969040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1642 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:46.969050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1642 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:46.969054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:46.969603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1642 sessionId:  describe result for acl check
2025-09-30T14:54:46.969635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:46.969637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:46.969638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:46.969644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895817068509630:9983] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:46.970089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895817068509630:9983] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:46.972606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895817068509630:9983] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:46.975642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895817068509630:9983] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:46.975657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895817068509630:9983] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:46.975662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895817068509630:9983] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:46.975680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1642 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:46.979093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:46.979563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:46.979781Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:46.979792Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:46.979802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:46.979856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:46.979894Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895816978749146:9615]
2025-09-30T14:54:46.980569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:46.980844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:46.980893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:46.981232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:46.981289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:46.981295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:46.981297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:46.981298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:46.981299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:46.981301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:46.981302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:46.981303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:46.981305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:46.981306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:46.981307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.981308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.981309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.981311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:46.981312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:46.981317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:46.981329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:46.981333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:46.981337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:46.981342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:46.981346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:46.981349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:46.981354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:46.981358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:46.981363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:46.981367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.981376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.981380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.981389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:46.981393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:46.981402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:46.981415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:46.981425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:46.981430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:46.981439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:46.981444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:46.981453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:46.981459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:46.981464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:46.981470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:46.981475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:46.981481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:46.981487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:46.981494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:46.981498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:46.981504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:46.981509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:46.981519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:46.981523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:46.981528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:46.981537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.981542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.981553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.981564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.981570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.981580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.981589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:46.981594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:46.981604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:46.981614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:46.981666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:46.987076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:46.988387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:46.988405Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:46.988407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:46.988411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:46.988418Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1641 [2:7555895816978749146:9615]
2025-09-30T14:54:46.988435Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:46.988454Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:46.988461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:46.988464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:46.988466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:46.988482Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:46.988493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:46.988500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:46.988559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.988570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.988572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.988576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:46.988579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:46.988644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:46.988651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:46.988663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:46.988678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:46.988696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:46.988720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895817068509572:2454], now have 1 active actors on pipe
2025-09-30T14:54:46.988727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895817068509866:9983], now have 1 active actors on pipe
2025-09-30T14:54:46.988733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895816978749141:9615]
2025-09-30T14:54:46.988739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895816978749141:9615]
2025-09-30T14:54:46.988741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895816978749141:9615]
2025-09-30T14:54:46.988754Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:46.988764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:46.988766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:46.988767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:46.988775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:46.988788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:46.988791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:46.988781Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1641
2025-09-30T14:54:46.988820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1641
2025-09-30T14:54:46.988823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895816978749141:9615]
2025-09-30T14:54:46.988830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:46.988839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:46.988877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:46.988886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:46.988944Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 85826639 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:54:46.988974Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a167da0d-c1ca98bc-75bfcc3-c416756d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:46.988985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:46.988989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:46.988991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:46.989003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:46.989013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:46.989038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:46.989131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 11 DataSize: 85826639 UsedReserveSize: 0
2025-09-30T14:54:46.989161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:54:46.989195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:46.989203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:46.989217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:46.989308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1642 partition: 0 MaxSeqNo: 42 sessionId: src_id|a167da0d-c1ca98bc-75bfcc3-c416756d_0
2025-09-30T14:54:46.989653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65258e0-59ecd36d-bf1270db-6f309ef1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a167da0d-c1ca98bc-75bfcc3-c416756d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:46.992529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a167da0d-c1ca98bc-75bfcc3-c416756d_0] Write session: try to update token
2025-09-30T14:54:46.992549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a167da0d-c1ca98bc-75bfcc3-c416756d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:47.001122Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:47.001139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:47.001142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:47.001145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:47.001155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895816978749141:9615]
2025-09-30T14:54:47.001160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895816978749141:9615]
2025-09-30T14:54:47.001164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895816978749141:9615]
2025-09-30T14:54:47.001206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:47.001213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.001216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:47.001224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:47.001240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:47.001256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:47.001401Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:47.011278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1642 sessionId: src_id|a167da0d-c1ca98bc-75bfcc3-c416756d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:47.014049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:47.061196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895821363477179:9749]
2025-09-30T14:54:47.061474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1641, pipe: [1:7555895821363477179:9749]
2025-09-30T14:54:47.111175Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:47.111500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:47.111518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:47.111535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895821363477179:9749], now have 1 active actors on pipe
2025-09-30T14:54:47.111805Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:47.111896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895821363477179:9749]
2025-09-30T14:54:47.111939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:47.111990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:47.112074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1642 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a167da0d-c1ca98bc-75bfcc3-c416756d_0
2025-09-30T14:54:47.112379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1642 sessionId: src_id|a167da0d-c1ca98bc-75bfcc3-c416756d_0 is DEAD
2025-09-30T14:54:47.112534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a167da0d-c1ca98bc-75bfcc3-c416756d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:47.112544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a167da0d-c1ca98bc-75bfcc3-c416756d_0] Write session will restart in 0.008488s
2025-09-30T14:54:47.112575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a167da0d-c1ca98bc-75bfcc3-c416756d_0] Write session: Do CDS request
2025-09-30T14:54:47.112582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a167da0d-c1ca98bc-75bfcc3-c416756d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:47.122884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a167da0d-c1ca98bc-75bfcc3-c416756d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:47.122986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:47.123002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1643
2025-09-30T14:54:47.123165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1643 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:47.123200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1643 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:47.123208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1643 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:47.123211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:47.123758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1643 sessionId:  describe result for acl check
2025-09-30T14:54:47.123804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:47.123813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:47.123815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:47.123821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895821363477346:9988] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:47.124355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895821363477346:9988] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:47.127048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895821363477346:9988] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:47.129148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:47.129402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895821363477346:9988] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:47.129415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895821363477346:9988] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:47.129418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895821363477346:9988] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:47.129425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1643 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:47.131127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:47.131295Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:47.131303Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:47.131311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:47.131350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:47.131382Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895821273716671:9618]
2025-09-30T14:54:47.131933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:47.132555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:47.132613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:47.132952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:47.133037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:47.133044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:47.133045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:47.133046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:47.133047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:47.133048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:47.133049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:47.133050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:47.133051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:47.133052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:47.133053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.133055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.133056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.133057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:47.133058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:47.133064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:47.133075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:47.133079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:47.133082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:47.133086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:47.133090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:47.133094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:47.133097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:47.133102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:47.133106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:47.133109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.133114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.133118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.133121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:47.133124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:47.133134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:47.133143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:47.133149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:47.133156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:47.133161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:47.133166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:47.133170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:47.133182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:47.133188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:47.133194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:47.133204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:47.133208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:47.133213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:47.133224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:47.133229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:47.133234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:47.133239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:47.133244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:47.133250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:47.133255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:47.133272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.133278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.133283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.133289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.133293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.133298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.133303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:47.133307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:47.133311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:47.133316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:47.133363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:47.138750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:47.139846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:47.139859Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:47.139861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:47.139864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:47.139869Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1642 [2:7555895821273716671:9618]
2025-09-30T14:54:47.139881Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:47.139893Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:47.139896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:47.139898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:47.139900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:47.139916Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:47.139922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:47.139929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:47.139972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.139979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.139981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.139983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:47.139986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:47.140039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:47.140047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.140057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.140064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.140079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:47.140095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895821363477188:2454], now have 1 active actors on pipe
2025-09-30T14:54:47.140104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895821273716665:9618]
2025-09-30T14:54:47.140106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895821273716665:9618]
2025-09-30T14:54:47.140107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895821273716665:9618]
2025-09-30T14:54:47.140120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:47.140130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895821363477489:9988], now have 1 active actors on pipe
2025-09-30T14:54:47.140136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:47.140145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:47.140149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:47.140150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:47.140151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:47.140152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:47.140174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895821273716665:9618]
2025-09-30T14:54:47.140180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:47.140170Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1642
2025-09-30T14:54:47.140214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1642
2025-09-30T14:54:47.140208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:47.140291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:47.140299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:47.140318Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a568205b-2ee8d80e-164b0e9f-6c9e7ac1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:47.140326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:47.140329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:47.140330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:47.140338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:47.140344Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:47.140357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:47.140485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:47.140497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:47.140512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:47.140596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1643 partition: 0 MaxSeqNo: 42 sessionId: src_id|a568205b-2ee8d80e-164b0e9f-6c9e7ac1_0
2025-09-30T14:54:47.140980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a167da0d-c1ca98bc-75bfcc3-c416756d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a568205b-2ee8d80e-164b0e9f-6c9e7ac1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:47.144446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a568205b-2ee8d80e-164b0e9f-6c9e7ac1_0] Write session: try to update token
2025-09-30T14:54:47.144467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a568205b-2ee8d80e-164b0e9f-6c9e7ac1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:47.152033Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:47.152057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:47.152067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895821273716665:9618]
2025-09-30T14:54:47.152116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:47.152117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:47.152304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:47.152452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:47.152637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:47.152809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:47.152992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:47.153027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:47.162721Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:47.162737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:47.162739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:47.162741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:47.162748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895821273716665:9618]
2025-09-30T14:54:47.162751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895821273716665:9618]
2025-09-30T14:54:47.162755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895821273716665:9618]
2025-09-30T14:54:47.162785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:47.162791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.162793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:47.162798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:47.162803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:47.162807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:47.162927Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:47.163021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1643 sessionId: src_id|a568205b-2ee8d80e-164b0e9f-6c9e7ac1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:47.165734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:47.212246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895821363477504:9749]
2025-09-30T14:54:47.212564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1642, pipe: [1:7555895821363477504:9749]
2025-09-30T14:54:47.272388Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:47.273026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:47.273046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:47.273066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895821363477504:9749], now have 1 active actors on pipe
2025-09-30T14:54:47.273331Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:47.273342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:47.273346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:47.273397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895821363477504:9749]
2025-09-30T14:54:47.273408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1643 reason: error at write: Disconnected sessionId: src_id|a568205b-2ee8d80e-164b0e9f-6c9e7ac1_0
2025-09-30T14:54:47.273466Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:47.273583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1643 sessionId: src_id|a568205b-2ee8d80e-164b0e9f-6c9e7ac1_0 is DEAD
2025-09-30T14:54:47.273733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a568205b-2ee8d80e-164b0e9f-6c9e7ac1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:47.273741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a568205b-2ee8d80e-164b0e9f-6c9e7ac1_0] Write session will restart in 0.007829s
2025-09-30T14:54:47.273782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a568205b-2ee8d80e-164b0e9f-6c9e7ac1_0] Write session: Do CDS request
2025-09-30T14:54:47.273792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a568205b-2ee8d80e-164b0e9f-6c9e7ac1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:47.282847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a568205b-2ee8d80e-164b0e9f-6c9e7ac1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:47.282985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:47.283001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1644
2025-09-30T14:54:47.283151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1644 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:47.283184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1644 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:47.283191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1644 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:47.283195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:47.283614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1644 sessionId:  describe result for acl check
2025-09-30T14:54:47.283645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:47.283649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:47.283650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:47.283655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895821363477618:9992] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:47.284135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895821363477618:9992] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:47.286886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895821363477618:9992] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:47.289619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:47.289634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895821363477618:9992] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:47.289649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895821363477618:9992] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:47.289652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895821363477618:9992] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:47.289660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1644 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:47.291714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:47.291909Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:47.291919Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:47.291930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:47.291984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:47.292023Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895821273716899:9620]
2025-09-30T14:54:47.292693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:47.292973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:47.293011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:47.293357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:47.293421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:47.293428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:47.293439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:47.293440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:47.293441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:47.293443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:47.293444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:47.293445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:47.293447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:47.293448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:47.293450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.293451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.293452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.293453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:47.293454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:47.293459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:47.293470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:47.293474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:47.293478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:47.293482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:47.293487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:47.293490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:47.293495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:47.293499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:47.293504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:47.293508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.293512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.293516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.293520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:47.293524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:47.293531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:47.293539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:47.293545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:47.293550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:47.293555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:47.293560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:47.293565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:47.293571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:47.293581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:47.293587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:47.293591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:47.293597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:47.293602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:47.293607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:47.293611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:47.293616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:47.293621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:47.293627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:47.293636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:47.293643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:47.293652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.293657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.293661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.293671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.293676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.293682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.293691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:47.293696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:47.293705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:47.293710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:47.293769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:47.299542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:47.300645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:47.300665Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:47.300668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:47.300672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:47.300679Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1643 [2:7555895821273716899:9620]
2025-09-30T14:54:47.300697Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:47.300716Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:47.300719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:47.300722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:47.300724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:47.300740Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:47.300747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:47.300754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:47.300825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.300834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.300837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.300840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:47.300842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:47.301113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1643
2025-09-30T14:54:47.301113Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1643
2025-09-30T14:54:47.301448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:47.301460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.301477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.301490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.301510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:47.301541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895821363477505:2454], now have 1 active actors on pipe
2025-09-30T14:54:47.301551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895821363477805:9992], now have 1 active actors on pipe
2025-09-30T14:54:47.301575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:47.301584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:47.301603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895821273716893:9620]
2025-09-30T14:54:47.301610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895821273716893:9620]
2025-09-30T14:54:47.301613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895821273716893:9620]
2025-09-30T14:54:47.301628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:47.301647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:47.301663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:47.301662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:47.301667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:47.301669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:47.301673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:47.301699Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df05bcd0-ea86f2a8-be0a175c-76729824_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:47.301713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:47.301718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:47.301720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:47.301731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:47.301751Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:47.301803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895821273716893:9620]
2025-09-30T14:54:47.301818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:47.301829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:47.301841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:47.302010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:47.302020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:47.302036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:47.302147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1644 partition: 0 MaxSeqNo: 42 sessionId: src_id|df05bcd0-ea86f2a8-be0a175c-76729824_0
2025-09-30T14:54:47.302508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a568205b-2ee8d80e-164b0e9f-6c9e7ac1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|df05bcd0-ea86f2a8-be0a175c-76729824_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:47.305464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df05bcd0-ea86f2a8-be0a175c-76729824_0] Write session: try to update token
2025-09-30T14:54:47.305481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df05bcd0-ea86f2a8-be0a175c-76729824_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:47.314718Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:47.314745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:47.314748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:47.314750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:47.314763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895821273716893:9620]
2025-09-30T14:54:47.314769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895821273716893:9620]
2025-09-30T14:54:47.314773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895821273716893:9620]
2025-09-30T14:54:47.314840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:47.314849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.314846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:47.314852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:47.314856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:47.314861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:47.315051Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:47.321476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1644 sessionId: src_id|df05bcd0-ea86f2a8-be0a175c-76729824_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:47.324319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:47.373520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895821363477818:9749]
2025-09-30T14:54:47.373867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1643, pipe: [1:7555895821363477818:9749]
2025-09-30T14:54:47.425008Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:47.425470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:47.425483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:47.425500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895821363477818:9749], now have 1 active actors on pipe
2025-09-30T14:54:47.425672Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:47.425765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895821363477818:9749]
2025-09-30T14:54:47.425905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:47.425920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:47.425946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:47.425980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1644 reason: error at write: Disconnected sessionId: src_id|df05bcd0-ea86f2a8-be0a175c-76729824_0
2025-09-30T14:54:47.426153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1644 sessionId: src_id|df05bcd0-ea86f2a8-be0a175c-76729824_0 is DEAD
2025-09-30T14:54:47.426328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df05bcd0-ea86f2a8-be0a175c-76729824_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:47.426338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df05bcd0-ea86f2a8-be0a175c-76729824_0] Write session will restart in 0.007420s
2025-09-30T14:54:47.426362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df05bcd0-ea86f2a8-be0a175c-76729824_0] Write session: Do CDS request
2025-09-30T14:54:47.426368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df05bcd0-ea86f2a8-be0a175c-76729824_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:47.434857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df05bcd0-ea86f2a8-be0a175c-76729824_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:47.435001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:47.435017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1645
2025-09-30T14:54:47.435200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1645 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:47.435234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1645 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:47.435265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1645 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:47.435275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:47.435765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1645 sessionId:  describe result for acl check
2025-09-30T14:54:47.435804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:47.435811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:47.435813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:47.435817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895821363477921:9996] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:47.436365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895821363477921:9996] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:47.438463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895821363477921:9996] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:47.441697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895821363477921:9996] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:47.441714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895821363477921:9996] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:47.441718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895821363477921:9996] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:47.441727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1645 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:47.443100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:47.445435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:47.445630Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:47.445642Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:47.445653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:47.445704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:47.445757Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895821273717130:9623]
2025-09-30T14:54:47.446439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:47.446759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:47.446805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:47.447174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:47.447255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:47.447263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:47.447264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:47.447265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:47.447268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:47.447269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:47.447271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:47.447272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:47.447274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:47.447275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:47.447276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.447277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.447279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.447280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:47.447281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:47.447287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:47.447299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:47.447304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:47.447309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:47.447313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:47.447318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:47.447323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:47.447327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:47.447331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:47.447336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:47.447341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.447345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.447348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.447353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:47.447357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:47.447366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:47.447374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:47.447388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:47.447394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:47.447404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:47.447410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:47.447420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:47.447427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:47.447437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:47.447443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:47.447453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:47.447461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:47.447467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:47.447478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:47.447483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:47.447494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:47.447500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:47.447510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:47.447515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:47.447526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:47.447531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.447542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.447547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.447553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.447558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.447563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.447570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:47.447575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:47.447585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:47.447591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:47.447638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:47.453217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:47.454093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:47.454113Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:47.454115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:47.454120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:47.454127Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1644 [2:7555895821273717130:9623]
2025-09-30T14:54:47.454146Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:47.454163Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:47.454167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:47.454170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:47.454173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:47.454189Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:47.454202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:47.454214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:47.454272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.454281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.454284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.454288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:47.454291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:47.454357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:47.454367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.454381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.454400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.454424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:47.454448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895821363477819:2454], now have 1 active actors on pipe
2025-09-30T14:54:47.454458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895821363478118:9996], now have 1 active actors on pipe
2025-09-30T14:54:47.454464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895821273717125:9623]
2025-09-30T14:54:47.454472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895821273717125:9623]
2025-09-30T14:54:47.454474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895821273717125:9623]
2025-09-30T14:54:47.454489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:47.454507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:47.454507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:47.454511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:47.454513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:47.454527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:47.454531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:47.454507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1644
2025-09-30T14:54:47.454548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1644
2025-09-30T14:54:47.454561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895821273717125:9623]
2025-09-30T14:54:47.454579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:47.454587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:47.454601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:47.454610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:47.454656Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3f175c5-b7cea576-88a1adf-694c1261_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:47.454667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:47.454671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:47.454673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:47.454683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:47.454698Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:47.454719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:47.454879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:47.454888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:47.454903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:47.455011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1645 partition: 0 MaxSeqNo: 42 sessionId: src_id|c3f175c5-b7cea576-88a1adf-694c1261_0
2025-09-30T14:54:47.455408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df05bcd0-ea86f2a8-be0a175c-76729824_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c3f175c5-b7cea576-88a1adf-694c1261_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:47.458644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f175c5-b7cea576-88a1adf-694c1261_0] Write session: try to update token
2025-09-30T14:54:47.458668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f175c5-b7cea576-88a1adf-694c1261_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:47.466728Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:47.466752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:47.466755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:47.466758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:47.466767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895821273717125:9623]
2025-09-30T14:54:47.466772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895821273717125:9623]
2025-09-30T14:54:47.466778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895821273717125:9623]
2025-09-30T14:54:47.466821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:47.466830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.466830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:47.466833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:47.466837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:47.466841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:47.467010Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:47.475121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1645 sessionId: src_id|c3f175c5-b7cea576-88a1adf-694c1261_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:47.478067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:47.526092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895821363478133:9749]
2025-09-30T14:54:47.526393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1644, pipe: [1:7555895821363478133:9749]
2025-09-30T14:54:47.587966Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:47.588613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:47.588629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:47.588649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895821363478133:9749], now have 1 active actors on pipe
2025-09-30T14:54:47.588906Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:47.588913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895821363478133:9749]
2025-09-30T14:54:47.588949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:47.588952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:47.588953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:47.589070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1645 reason: error at write: Disconnected sessionId: src_id|c3f175c5-b7cea576-88a1adf-694c1261_0
2025-09-30T14:54:47.589259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1645 sessionId: src_id|c3f175c5-b7cea576-88a1adf-694c1261_0 is DEAD
2025-09-30T14:54:47.589430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f175c5-b7cea576-88a1adf-694c1261_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:47.589442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f175c5-b7cea576-88a1adf-694c1261_0] Write session will restart in 0.007424s
2025-09-30T14:54:47.589466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f175c5-b7cea576-88a1adf-694c1261_0] Write session: Do CDS request
2025-09-30T14:54:47.589476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f175c5-b7cea576-88a1adf-694c1261_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:47.597815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f175c5-b7cea576-88a1adf-694c1261_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:47.597952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:47.597969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1646
2025-09-30T14:54:47.598113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1646 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:47.598148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1646 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:47.598158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1646 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:47.598163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:47.598725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1646 sessionId:  describe result for acl check
2025-09-30T14:54:47.598767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:47.598774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:47.598776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:47.598782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895821363478219:10002] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:47.599370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895821363478219:10002] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:47.601638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895821363478219:10002] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:47.604822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895821363478219:10002] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:47.604838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895821363478219:10002] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:47.604841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895821363478219:10002] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:47.604859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1646 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:47.606597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:47.608731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:47.608932Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:47.608948Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:47.608959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:47.609005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:47.609038Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895821273717372:9626]
2025-09-30T14:54:47.609579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:47.609957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:47.610008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:47.610336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:47.610393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:47.610408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:47.610410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:47.610411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:47.610412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:47.610414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:47.610415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:47.610416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:47.610418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:47.610419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:47.610420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.610421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.610423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.610424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:47.610425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:47.610431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:47.610441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:47.610446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:47.610450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:47.610453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:47.610458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:47.610462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:47.610466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:47.610470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:47.610475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:47.610478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.610483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.610487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.610491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:47.610506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:47.610513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:47.610521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:47.610527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:47.610533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:47.610540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:47.610551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:47.610557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:47.610562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:47.610566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:47.610571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:47.610582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:47.610588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:47.610593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:47.610598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:47.610603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:47.610608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:47.610617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:47.610623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:47.610628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:47.610634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:47.610640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.610645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.610655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.610659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.610663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.610667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.610671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:47.610685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:47.610693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:47.610699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:47.610742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:47.616235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:47.617563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:47.617585Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:47.617588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:47.617592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:47.617599Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1645 [2:7555895821273717372:9626]
2025-09-30T14:54:47.617617Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:47.617635Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:47.617645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:47.617649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:47.617651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:47.617668Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:47.617675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:47.617688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:47.617769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.617778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.617780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.617783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:47.617786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:47.617857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:47.617865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.617881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.617900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.617924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:47.617948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895821363478448:10002], now have 1 active actors on pipe
2025-09-30T14:54:47.617956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895821363478146:2454], now have 1 active actors on pipe
2025-09-30T14:54:47.617963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895821273717367:9626]
2025-09-30T14:54:47.617966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895821273717367:9626]
2025-09-30T14:54:47.617969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895821273717367:9626]
2025-09-30T14:54:47.617983Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:47.618001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:47.618001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:47.618004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:47.618007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:47.618022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:47.618030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:47.618034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1645
2025-09-30T14:54:47.618033Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1645
2025-09-30T14:54:47.618064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895821273717367:9626]
2025-09-30T14:54:47.618075Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:47.618078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:47.618092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:47.618097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:47.618149Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49e6cd8-efd11bcb-a3cbb704-b6826c31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:47.618161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:47.618165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:47.618168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:47.618180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:47.618189Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:47.618210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:47.618376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:47.618387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:47.618405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:47.618482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1646 partition: 0 MaxSeqNo: 42 sessionId: src_id|49e6cd8-efd11bcb-a3cbb704-b6826c31_0
2025-09-30T14:54:47.618871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f175c5-b7cea576-88a1adf-694c1261_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|49e6cd8-efd11bcb-a3cbb704-b6826c31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:47.622051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49e6cd8-efd11bcb-a3cbb704-b6826c31_0] Write session: try to update token
2025-09-30T14:54:47.622074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49e6cd8-efd11bcb-a3cbb704-b6826c31_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:47.630664Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:47.630692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:47.630694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:47.630696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:47.630706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895821273717367:9626]
2025-09-30T14:54:47.630710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895821273717367:9626]
2025-09-30T14:54:47.630715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895821273717367:9626]
2025-09-30T14:54:47.630756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:47.630765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.630767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:47.630785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:47.630803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:47.630808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:47.630947Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:47.638107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1646 sessionId: src_id|49e6cd8-efd11bcb-a3cbb704-b6826c31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:47.640742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:47.688897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895821363478463:9749]
2025-09-30T14:54:47.689216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1645, pipe: [1:7555895821363478463:9749]
2025-09-30T14:54:47.740053Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:47.740350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:47.740367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:47.740384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895821363478463:9749], now have 1 active actors on pipe
2025-09-30T14:54:47.740595Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:47.740641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:47.740658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:47.740663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895821363478463:9749]
2025-09-30T14:54:47.740687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:47.740722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1646 reason: error at write: Disconnected sessionId: src_id|49e6cd8-efd11bcb-a3cbb704-b6826c31_0
2025-09-30T14:54:47.740883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1646 sessionId: src_id|49e6cd8-efd11bcb-a3cbb704-b6826c31_0 is DEAD
2025-09-30T14:54:47.741060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49e6cd8-efd11bcb-a3cbb704-b6826c31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:47.741073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49e6cd8-efd11bcb-a3cbb704-b6826c31_0] Write session will restart in 0.009222s
2025-09-30T14:54:47.741096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49e6cd8-efd11bcb-a3cbb704-b6826c31_0] Write session: Do CDS request
2025-09-30T14:54:47.741105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49e6cd8-efd11bcb-a3cbb704-b6826c31_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:47.751675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49e6cd8-efd11bcb-a3cbb704-b6826c31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:47.751814Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:47.751830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1647
2025-09-30T14:54:47.751947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1647 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:47.751978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1647 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:47.751987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1647 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:47.751991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:47.752510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1647 sessionId:  describe result for acl check
2025-09-30T14:54:47.752543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:47.752550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:47.752552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:47.752558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895821363478657:10006] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:47.753095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895821363478657:10006] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:47.755346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895821363478657:10006] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:47.756351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:47.758221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:47.758404Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:47.758417Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:47.758427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:47.758477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:47.758483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895821363478657:10006] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:47.758498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895821363478657:10006] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:47.758501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895821363478657:10006] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:47.758515Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895821273717601:9628]
2025-09-30T14:54:47.758510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1647 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:47.759175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:47.759477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:47.759533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:47.759806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:47.759860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:47.759871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:47.759872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:47.759873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:47.759874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:47.759876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:47.759877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:47.759878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:47.759879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:47.759881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:47.759882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.759883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.759884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.759885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:47.759887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:47.759893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:47.759901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:47.759903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:47.759906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:47.759908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:47.759910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:47.759913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:47.759916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:47.759918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:47.759921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:47.759923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.759926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.759928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.759930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:47.759933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:47.759939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:47.759944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:47.759948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:47.759951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:47.759954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:47.759957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:47.759960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:47.759963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:47.759966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:47.759969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:47.759972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:47.759975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:47.759979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:47.759981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:47.759984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:47.759988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:47.759993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:47.759998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:47.760003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:47.760008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:47.760012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.760018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.760021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.760026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.760031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.760036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.760040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:47.760046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:47.760052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:47.760057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:47.760087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:47.765033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:47.766414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:47.766434Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:47.766437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:47.766440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:47.766446Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1646 [2:7555895821273717601:9628]
2025-09-30T14:54:47.766462Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:47.766476Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:47.766479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:47.766482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:47.766484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:47.766500Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:47.766506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:47.766520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:47.766579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.766587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.766589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.766593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:47.766596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:47.766668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:47.766676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.766690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.766709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.766735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:47.766753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895821363478464:2454], now have 1 active actors on pipe
2025-09-30T14:54:47.766756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895821363478768:10006], now have 1 active actors on pipe
2025-09-30T14:54:47.766763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895821273717596:9628]
2025-09-30T14:54:47.766765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895821273717596:9628]
2025-09-30T14:54:47.766767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895821273717596:9628]
2025-09-30T14:54:47.766777Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:47.766788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:47.766790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:47.766792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:47.766794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:47.766803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:47.766770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1646
2025-09-30T14:54:47.766806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:47.766807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1646
2025-09-30T14:54:47.766851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:47.766860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:47.766872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895821273717596:9628]
2025-09-30T14:54:47.766884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:47.766898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:47.766916Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20bbf90f-774d88d2-d4b90356-12c33440_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:47.766926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:47.766934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:47.766936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:47.766944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:47.766957Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:47.766983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:47.767104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:47.767110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:47.767121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:47.767184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1647 partition: 0 MaxSeqNo: 42 sessionId: src_id|20bbf90f-774d88d2-d4b90356-12c33440_0
2025-09-30T14:54:47.767544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49e6cd8-efd11bcb-a3cbb704-b6826c31_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|20bbf90f-774d88d2-d4b90356-12c33440_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:47.770268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20bbf90f-774d88d2-d4b90356-12c33440_0] Write session: try to update token
2025-09-30T14:54:47.770285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20bbf90f-774d88d2-d4b90356-12c33440_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:47.779004Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:47.779023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:47.779025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:47.779026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:47.779034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895821273717596:9628]
2025-09-30T14:54:47.779038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895821273717596:9628]
2025-09-30T14:54:47.779042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895821273717596:9628]
2025-09-30T14:54:47.779085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:47.779090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:47.779095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.779097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:47.779099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:47.779104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:47.779266Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:47.785114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1647 sessionId: src_id|20bbf90f-774d88d2-d4b90356-12c33440_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:47.787747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:47.841001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895821363478780:9749]
2025-09-30T14:54:47.841410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1646, pipe: [1:7555895821363478780:9749]
2025-09-30T14:54:47.883387Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:47.883660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:47.883674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:47.883714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895821363478780:9749], now have 1 active actors on pipe
2025-09-30T14:54:47.883866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:47.883897Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:47.883881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:47.883942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1647 reason: error at write: Disconnected sessionId: src_id|20bbf90f-774d88d2-d4b90356-12c33440_0
2025-09-30T14:54:47.884115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1647 sessionId: src_id|20bbf90f-774d88d2-d4b90356-12c33440_0 is DEAD
2025-09-30T14:54:47.884267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20bbf90f-774d88d2-d4b90356-12c33440_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:47.884276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20bbf90f-774d88d2-d4b90356-12c33440_0] Write session will restart in 0.007977s
2025-09-30T14:54:47.884316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20bbf90f-774d88d2-d4b90356-12c33440_0] Write session: Do CDS request
2025-09-30T14:54:47.884322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20bbf90f-774d88d2-d4b90356-12c33440_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:47.884309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895821363478780:9749]
2025-09-30T14:54:47.884338Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:47.893713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20bbf90f-774d88d2-d4b90356-12c33440_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:47.893861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:47.893880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1648
2025-09-30T14:54:47.893998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1648 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:47.894043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1648 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:47.894053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1648 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:47.894059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:47.894441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1648 sessionId:  describe result for acl check
2025-09-30T14:54:47.894477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:47.894479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:47.894481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:47.894486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895821363478916:10016] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:47.895008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895821363478916:10016] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:47.897731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895821363478916:10016] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:47.900528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895821363478916:10016] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:47.900541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895821363478916:10016] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:47.900545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895821363478916:10016] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:47.900552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1648 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:47.901112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:47.903295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:47.903494Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:47.903505Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:47.903516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:47.903567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:47.903606Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895821273717848:9637]
2025-09-30T14:54:47.904265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:47.904559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:47.904612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:47.904928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:47.904991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:47.904997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:47.904999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:47.905000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:47.905001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:47.905002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:47.905003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:47.905004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:47.905006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:47.905007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:47.905008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.905010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.905011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.905012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:47.905013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:47.905019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:47.905030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:47.905034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:47.905039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:47.905043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:47.905047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:47.905051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:47.905056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:47.905060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:47.905064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:47.905068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.905072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.905087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.905096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:47.905100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:47.905107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:47.905120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:47.905131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:47.905136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:47.905146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:47.905151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:47.905160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:47.905166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:47.905175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:47.905180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:47.905189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:47.905194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:47.905204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:47.905209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:47.905215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:47.905220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:47.905230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:47.905236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:47.905241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:47.905252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:47.905256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.905265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.905269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.905276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.905284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.905289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.905294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:47.905302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:47.905307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:47.905317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:47.905361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:47.910875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:47.912177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:47.912194Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:47.912196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:47.912199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:47.912206Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1647 [2:7555895821273717848:9637]
2025-09-30T14:54:47.912220Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:47.912235Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:47.912238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:47.912240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:47.912242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:47.912258Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:47.912264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:47.912270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:47.912354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.912365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.912367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.912371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:47.912374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:47.912464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:47.912474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.912484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:47.912491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:47.912501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:47.912525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895821363478794:2454], now have 1 active actors on pipe
2025-09-30T14:54:47.912534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895821363479095:10016], now have 1 active actors on pipe
2025-09-30T14:54:47.912540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895821273717843:9637]
2025-09-30T14:54:47.912542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895821273717843:9637]
2025-09-30T14:54:47.912544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895821273717843:9637]
2025-09-30T14:54:47.912558Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:47.912576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:47.912578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:47.912582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:47.912584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:47.912558Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1647
2025-09-30T14:54:47.912592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:47.912605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1647
2025-09-30T14:54:47.912594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:47.912640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895821273717843:9637]
2025-09-30T14:54:47.912650Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:47.912658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:47.912831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:47.912845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:47.912890Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4052ccfa-bdac7e7a-323036b4-9c07708f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:47.912904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:47.912908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:47.912911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:47.912926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:47.912942Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:47.912957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:47.913107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:47.913115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:47.913127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:47.913211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1648 partition: 0 MaxSeqNo: 42 sessionId: src_id|4052ccfa-bdac7e7a-323036b4-9c07708f_0
2025-09-30T14:54:47.913586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20bbf90f-774d88d2-d4b90356-12c33440_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4052ccfa-bdac7e7a-323036b4-9c07708f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:47.916459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4052ccfa-bdac7e7a-323036b4-9c07708f_0] Write session: try to update token
2025-09-30T14:54:47.916477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4052ccfa-bdac7e7a-323036b4-9c07708f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:47.924602Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:47.924623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:47.924625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:47.924627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:47.924635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895821273717843:9637]
2025-09-30T14:54:47.924639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895821273717843:9637]
2025-09-30T14:54:47.924642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895821273717843:9637]
2025-09-30T14:54:47.924681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:47.924687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:47.924690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:47.924709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:47.924724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:47.924728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:47.924834Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:47.934478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1648 sessionId: src_id|4052ccfa-bdac7e7a-323036b4-9c07708f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:47.937203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:47.984331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895821363479119:9749]
2025-09-30T14:54:47.984677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1647, pipe: [1:7555895821363479119:9749]
2025-09-30T14:54:48.033679Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:48.034193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:48.034212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:48.034229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895821363479119:9749], now have 1 active actors on pipe
2025-09-30T14:54:48.034502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895821363479119:9749]
2025-09-30T14:54:48.034540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:48.034485Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:48.034619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1648 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4052ccfa-bdac7e7a-323036b4-9c07708f_0
2025-09-30T14:54:48.034811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1648 sessionId: src_id|4052ccfa-bdac7e7a-323036b4-9c07708f_0 is DEAD
2025-09-30T14:54:48.034955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4052ccfa-bdac7e7a-323036b4-9c07708f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:48.034967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4052ccfa-bdac7e7a-323036b4-9c07708f_0] Write session will restart in 0.005704s
2025-09-30T14:54:48.034991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4052ccfa-bdac7e7a-323036b4-9c07708f_0] Write session: Do CDS request
2025-09-30T14:54:48.034997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4052ccfa-bdac7e7a-323036b4-9c07708f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:48.035118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:48.041771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4052ccfa-bdac7e7a-323036b4-9c07708f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:48.041871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:48.041891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1649
2025-09-30T14:54:48.042025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1649 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:48.042058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1649 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:48.042068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1649 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:48.042072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:48.042534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1649 sessionId:  describe result for acl check
2025-09-30T14:54:48.042568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:48.042571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:48.042572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:48.042577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895825658446449:10021] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:48.043082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895825658446449:10021] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:48.045353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895825658446449:10021] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:48.048338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895825658446449:10021] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:48.048351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895825658446449:10021] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:48.048354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895825658446449:10021] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:48.048361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1649 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:48.051137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:48.052964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:48.053184Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:48.053194Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:48.053204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:48.053272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:48.053325Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895825568685399:9645]
2025-09-30T14:54:48.053802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:48.054151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:48.054213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:48.054485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:48.054532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:48.054537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:48.054538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:48.054539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:48.054539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:48.054540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:48.054541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:48.054542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:48.054542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:48.054543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:48.054544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.054544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.054545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.054546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:48.054546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:48.054550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:48.054557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:48.054560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:48.054562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:48.054565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:48.054567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:48.054570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:48.054572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:48.054574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:48.054577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:48.054579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.054581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.054583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.054586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:48.054588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:48.054593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:48.054598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:48.054603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:48.054609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:48.054613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:48.054618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:48.054625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:48.054630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:48.054634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:48.054637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:48.054640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:48.054642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:48.054645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:48.054648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:48.054650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:48.054653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:48.054656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:48.054658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:48.054661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:48.054664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:48.054667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.054669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.054672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.054675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.054678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.054680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.054684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:48.054686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:48.054689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:48.054692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:48.054717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:48.060023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:48.061196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:48.061215Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:48.061216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:48.061219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:48.061224Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1648 [2:7555895825568685399:9645]
2025-09-30T14:54:48.061236Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:48.061251Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:48.061255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:48.061258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:48.061260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:48.061276Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:48.061283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:48.061289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:48.061341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.061350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.061352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.061356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:48.061358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:48.061422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:48.061429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.061441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.061448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.061457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:48.061475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895825658446671:10021], now have 1 active actors on pipe
2025-09-30T14:54:48.061484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895825568685394:9645]
2025-09-30T14:54:48.061486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895825568685394:9645]
2025-09-30T14:54:48.061487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895825568685394:9645]
2025-09-30T14:54:48.061497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:48.061508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895825658446416:2454], now have 1 active actors on pipe
2025-09-30T14:54:48.061515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:48.061523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:48.061524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:48.061525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:48.061528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:48.061530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:48.061548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895825568685394:9645]
2025-09-30T14:54:48.061557Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:48.061558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:48.061601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1648
2025-09-30T14:54:48.061603Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1648
2025-09-30T14:54:48.061689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:48.061698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:48.061722Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|503c23d3-ca914fed-b572f2bb-3afee42d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:48.061733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:48.061737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:48.061739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:48.061757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:48.061768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:48.061778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:48.061936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:48.061946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:48.061973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:48.062062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1649 partition: 0 MaxSeqNo: 42 sessionId: src_id|503c23d3-ca914fed-b572f2bb-3afee42d_0
2025-09-30T14:54:48.062408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4052ccfa-bdac7e7a-323036b4-9c07708f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|503c23d3-ca914fed-b572f2bb-3afee42d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:48.065097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|503c23d3-ca914fed-b572f2bb-3afee42d_0] Write session: try to update token
2025-09-30T14:54:48.065111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|503c23d3-ca914fed-b572f2bb-3afee42d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:48.073076Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:48.073101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:48.073110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895825568685394:9645]
2025-09-30T14:54:48.073151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:48.073155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:48.073323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:48.073476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:48.073630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:48.074510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:48.074820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:48.074879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:48.079674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1649 sessionId: src_id|503c23d3-ca914fed-b572f2bb-3afee42d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:48.082247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:48.083447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:48.083470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:48.083488Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:48.083491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:48.083494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:48.083496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:48.083505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895825568685394:9645]
2025-09-30T14:54:48.083510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895825568685394:9645]
2025-09-30T14:54:48.083514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895825568685394:9645]
2025-09-30T14:54:48.083555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:48.083560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:48.083566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.083568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:48.083569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:48.083571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:48.083737Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:48.134856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895825658446740:9749]
2025-09-30T14:54:48.135155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1648, pipe: [1:7555895825658446740:9749]
2025-09-30T14:54:48.196560Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:48.197413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:48.197454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895825658446740:9749], now have 1 active actors on pipe
2025-09-30T14:54:48.197578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:48.197804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895825658446740:9749]
2025-09-30T14:54:48.198213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:48.214476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:48.215871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:48.215887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:48.216058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1649 reason: error at write: Disconnected sessionId: src_id|503c23d3-ca914fed-b572f2bb-3afee42d_0
2025-09-30T14:54:48.216180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1649 sessionId: src_id|503c23d3-ca914fed-b572f2bb-3afee42d_0 is DEAD
2025-09-30T14:54:48.216423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|503c23d3-ca914fed-b572f2bb-3afee42d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:48.216433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|503c23d3-ca914fed-b572f2bb-3afee42d_0] Write session will restart in 0.007822s
2025-09-30T14:54:48.216465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|503c23d3-ca914fed-b572f2bb-3afee42d_0] Write session: Do CDS request
2025-09-30T14:54:48.216474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|503c23d3-ca914fed-b572f2bb-3afee42d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:48.221648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:48.221868Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:48.221877Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:48.221885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:48.221934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:48.221968Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895825568685631:9647]
2025-09-30T14:54:48.222433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:48.222784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:48.222852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:48.223215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:48.223311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:48.223317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:48.223318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:48.223319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:48.223321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:48.223322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:48.223323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:48.223324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:48.223326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:48.223327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:48.223328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.223329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.223330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.223331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:48.223332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:48.223338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:48.223349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:48.223353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:48.223357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:48.223361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:48.223366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:48.223371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:48.223375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:48.223379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:48.223385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:48.223389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.223393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.223398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.223401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:48.223406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:48.223416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:48.223425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:48.223431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:48.223437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:48.223443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:48.223448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:48.223454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:48.223460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:48.223468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:48.223479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:48.223484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:48.223492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:48.223500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:48.223508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:48.223515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:48.223520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:48.223525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:48.223535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:48.223540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:48.223550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:48.223555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.223560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.223566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.223572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.223581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.223587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.223596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:48.223602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:48.223612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:48.223622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:48.223668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:48.225782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|503c23d3-ca914fed-b572f2bb-3afee42d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:48.226093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:48.226108Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1650
2025-09-30T14:54:48.226247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1650 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:48.226279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1650 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:48.226288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1650 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:48.226292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:48.226768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1650 sessionId:  describe result for acl check
2025-09-30T14:54:48.226810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:48.226816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:48.226819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:48.226826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895825658447022:10028] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:48.227435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895825658447022:10028] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:48.228913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:48.229976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895825658447022:10028] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:48.230567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:48.230585Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:48.230586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:48.230589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:48.230594Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1649 [2:7555895825568685631:9647]
2025-09-30T14:54:48.230608Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:48.230618Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:48.230620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:48.230622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:48.230624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:48.230635Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:48.230640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:48.230644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:48.230683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.230690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.230692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.230694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:48.230695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:48.230745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:48.230748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.230757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.230763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.230780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:48.230802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895825658446745:2454], now have 1 active actors on pipe
2025-09-30T14:54:48.230813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895825568685626:9647]
2025-09-30T14:54:48.230815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895825568685626:9647]
2025-09-30T14:54:48.230817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895825568685626:9647]
2025-09-30T14:54:48.230828Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:48.230844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:48.230843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:48.230847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:48.230849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:48.230859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:48.230861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:48.230886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895825568685626:9647]
2025-09-30T14:54:48.230898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:48.230916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:48.230922Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1649
2025-09-30T14:54:48.235568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895825658447022:10028] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:48.235583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895825658447022:10028] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:48.235587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895825658447022:10028] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:48.235595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1650 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:48.235823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895825658447060:10028], now have 1 active actors on pipe
2025-09-30T14:54:48.235876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1649
2025-09-30T14:54:48.235946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:48.235965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:48.235997Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c04fd32c-893f9de0-d84f4c5d-a6192425_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:48.236009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:48.236012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:48.236014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:48.236023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:48.236035Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:48.236057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:48.236234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:48.236254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:48.236275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:48.236355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1650 partition: 0 MaxSeqNo: 42 sessionId: src_id|c04fd32c-893f9de0-d84f4c5d-a6192425_0
2025-09-30T14:54:48.236710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|503c23d3-ca914fed-b572f2bb-3afee42d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c04fd32c-893f9de0-d84f4c5d-a6192425_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:48.239505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c04fd32c-893f9de0-d84f4c5d-a6192425_0] Write session: try to update token
2025-09-30T14:54:48.239524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c04fd32c-893f9de0-d84f4c5d-a6192425_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:48.242836Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:48.242864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:48.242867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:48.242869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:48.242878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895825568685626:9647]
2025-09-30T14:54:48.242883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895825568685626:9647]
2025-09-30T14:54:48.242886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895825568685626:9647]
2025-09-30T14:54:48.242929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:48.242936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.242938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:48.242939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:48.242957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:48.242961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:48.243096Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:48.260304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1650 sessionId: src_id|c04fd32c-893f9de0-d84f4c5d-a6192425_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:48.262927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:48.298176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895825658447063:9749]
2025-09-30T14:54:48.298507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1649, pipe: [1:7555895825658447063:9749]
2025-09-30T14:54:48.352187Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:48.352504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:48.352516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:48.352534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895825658447063:9749], now have 1 active actors on pipe
2025-09-30T14:54:48.352721Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:48.352815Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:48.352848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895825658447063:9749]
2025-09-30T14:54:48.352867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:48.352945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1650 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c04fd32c-893f9de0-d84f4c5d-a6192425_0
2025-09-30T14:54:48.353112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1650 sessionId: src_id|c04fd32c-893f9de0-d84f4c5d-a6192425_0 is DEAD
2025-09-30T14:54:48.353300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c04fd32c-893f9de0-d84f4c5d-a6192425_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:48.353310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c04fd32c-893f9de0-d84f4c5d-a6192425_0] Write session will restart in 0.008020s
2025-09-30T14:54:48.353334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c04fd32c-893f9de0-d84f4c5d-a6192425_0] Write session: Do CDS request
2025-09-30T14:54:48.353340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c04fd32c-893f9de0-d84f4c5d-a6192425_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:48.362735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c04fd32c-893f9de0-d84f4c5d-a6192425_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:48.362853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:48.362868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1651
2025-09-30T14:54:48.363002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1651 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:48.363035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1651 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:48.363040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1651 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:48.363044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:48.363566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1651 sessionId:  describe result for acl check
2025-09-30T14:54:48.363616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:48.363625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:48.363627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:48.363638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895825658447180:10032] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:48.364277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895825658447180:10032] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:48.366476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895825658447180:10032] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:48.368924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895825658447180:10032] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:48.368938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895825658447180:10032] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:48.368942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895825658447180:10032] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:48.368949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1651 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:48.370417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:48.372427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:48.372644Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:48.372658Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:48.372671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:48.372734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:48.372777Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895825568685868:9650]
2025-09-30T14:54:48.373424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:48.373780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:48.373830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:48.374163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:48.374250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:48.374258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:48.374259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:48.374260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:48.374261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:48.374263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:48.374264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:48.374265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:48.374266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:48.374268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:48.374269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.374270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.374271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.374273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:48.374274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:48.374279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:48.374289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:48.374293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:48.374297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:48.374301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:48.374305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:48.374309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:48.374313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:48.374317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:48.374322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:48.374325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.374329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.374333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.374337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:48.374340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:48.374351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:48.374359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:48.374373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:48.374384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:48.374393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:48.374404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:48.374413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:48.374419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:48.374429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:48.374440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:48.374444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:48.374449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:48.374454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:48.374464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:48.374469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:48.374475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:48.374485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:48.374494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:48.374503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:48.374515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:48.374523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.374531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.374534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.374545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.374550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.374559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.374563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:48.374568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:48.374577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:48.374583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:48.374635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:48.380246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:48.381353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:48.381369Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:48.381371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:48.381374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:48.381380Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1650 [2:7555895825568685868:9650]
2025-09-30T14:54:48.381393Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:48.381410Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:48.381413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:48.381420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:48.381422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:48.381437Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:48.381443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:48.381450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:48.381508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.381516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.381518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.381522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:48.381524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:48.381604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:48.381614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.381626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.381636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.381653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:48.381671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895825658447065:2454], now have 1 active actors on pipe
2025-09-30T14:54:48.381675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895825658447370:10032], now have 1 active actors on pipe
2025-09-30T14:54:48.381681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895825568685863:9650]
2025-09-30T14:54:48.381690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895825568685863:9650]
2025-09-30T14:54:48.381692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895825568685863:9650]
2025-09-30T14:54:48.381704Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:48.381714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:48.381718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:48.381724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:48.381726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:48.381732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:48.381735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:48.381781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895825568685863:9650]
2025-09-30T14:54:48.381735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1650
2025-09-30T14:54:48.381794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:48.381766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1650
2025-09-30T14:54:48.381799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:48.381807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:48.381811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:48.381981Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d66475ea-93117dfc-d7c6faa6-9b3a5665_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:48.381996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:48.382004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:48.382006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:48.382015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:48.382030Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:48.382058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:48.382208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:48.382216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:48.382229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:48.382332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1651 partition: 0 MaxSeqNo: 42 sessionId: src_id|d66475ea-93117dfc-d7c6faa6-9b3a5665_0
2025-09-30T14:54:48.382673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c04fd32c-893f9de0-d84f4c5d-a6192425_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d66475ea-93117dfc-d7c6faa6-9b3a5665_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:48.385432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d66475ea-93117dfc-d7c6faa6-9b3a5665_0] Write session: try to update token
2025-09-30T14:54:48.385451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d66475ea-93117dfc-d7c6faa6-9b3a5665_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:48.393713Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:48.393737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:48.393754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:48.393756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:48.393767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895825568685863:9650]
2025-09-30T14:54:48.393773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895825568685863:9650]
2025-09-30T14:54:48.393778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895825568685863:9650]
2025-09-30T14:54:48.393817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:48.393827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.393829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:48.393828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:48.393833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:48.393837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:48.393967Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:48.404727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1651 sessionId: src_id|d66475ea-93117dfc-d7c6faa6-9b3a5665_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:48.407314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:48.452801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895825658447384:9749]
2025-09-30T14:54:48.453205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1650, pipe: [1:7555895825658447384:9749]
2025-09-30T14:54:48.504995Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:48.505510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:48.505540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:48.505562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895825658447384:9749], now have 1 active actors on pipe
2025-09-30T14:54:48.505816Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:48.505785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:48.505824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895825658447384:9749]
2025-09-30T14:54:48.505829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:48.505831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:48.505885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1651 reason: error at write: Disconnected sessionId: src_id|d66475ea-93117dfc-d7c6faa6-9b3a5665_0
2025-09-30T14:54:48.506027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1651 sessionId: src_id|d66475ea-93117dfc-d7c6faa6-9b3a5665_0 is DEAD
2025-09-30T14:54:48.506164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d66475ea-93117dfc-d7c6faa6-9b3a5665_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:48.506172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d66475ea-93117dfc-d7c6faa6-9b3a5665_0] Write session will restart in 0.009694s
2025-09-30T14:54:48.506189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d66475ea-93117dfc-d7c6faa6-9b3a5665_0] Write session: Do CDS request
2025-09-30T14:54:48.506193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d66475ea-93117dfc-d7c6faa6-9b3a5665_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:48.516754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d66475ea-93117dfc-d7c6faa6-9b3a5665_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:48.516865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:48.516880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1652
2025-09-30T14:54:48.516999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1652 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:48.517034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1652 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:48.517041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1652 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:48.517044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:48.517439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1652 sessionId:  describe result for acl check
2025-09-30T14:54:48.517470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:48.517477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:48.517479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:48.517485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895825658447551:10036] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:48.518025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895825658447551:10036] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:48.520772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895825658447551:10036] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:48.523084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895825658447551:10036] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:48.523095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895825658447551:10036] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:48.523098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895825658447551:10036] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:48.523103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1652 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:48.524147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:48.526231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:48.526421Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:48.526433Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:48.526444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:48.526493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:48.526533Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895825568686115:9653]
2025-09-30T14:54:48.527216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:48.527561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:48.527609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:48.527946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:48.528139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:48.528148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:48.528149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:48.528151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:48.528152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:48.528153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:48.528154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:48.528155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:48.528156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:48.528157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:48.528159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.528160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.528161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.528162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:48.528163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:48.528168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:48.528180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:48.528185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:48.528190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:48.528195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:48.528200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:48.528204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:48.528209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:48.528214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:48.528219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:48.528224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.528229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.528234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.528238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:48.528243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:48.528251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:48.528261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:48.528266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:48.528271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:48.528276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:48.528281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:48.528293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:48.528300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:48.528304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:48.528317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:48.528321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:48.528331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:48.528335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:48.528340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:48.528344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:48.528351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:48.528356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:48.528366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:48.528370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:48.528377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:48.528382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.528387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.528393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.528399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.528404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.528413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.528418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:48.528423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:48.528432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:48.528438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:48.528483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:48.533798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:48.534665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:48.534682Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:48.534684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:48.534688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:48.534695Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1651 [2:7555895825568686115:9653]
2025-09-30T14:54:48.534713Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:48.534733Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:48.534736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:48.534739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:48.534741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:48.534756Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:48.534762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:48.534768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:48.534825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.534833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.534836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.534839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:48.534842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:48.534912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:48.534920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.534935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.534948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.534975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:48.534997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895825658447692:10036], now have 1 active actors on pipe
2025-09-30T14:54:48.535006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895825658447386:2454], now have 1 active actors on pipe
2025-09-30T14:54:48.535012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895825568686110:9653]
2025-09-30T14:54:48.535014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895825568686110:9653]
2025-09-30T14:54:48.535016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895825568686110:9653]
2025-09-30T14:54:48.535031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:48.535048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:48.535025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1651
2025-09-30T14:54:48.535068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:48.535075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:48.535051Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1651
2025-09-30T14:54:48.535089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:48.535099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895825568686110:9653]
2025-09-30T14:54:48.535100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:48.535102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:48.535103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:48.535109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:48.535118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:48.535128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:48.535174Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ffe85386-7aa73637-40209632-732ca594_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:48.535185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:48.535193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:48.535196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:48.535204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:48.535216Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:48.535236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:48.535435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:48.535446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:48.535461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:48.535565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1652 partition: 0 MaxSeqNo: 42 sessionId: src_id|ffe85386-7aa73637-40209632-732ca594_0
2025-09-30T14:54:48.535881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d66475ea-93117dfc-d7c6faa6-9b3a5665_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ffe85386-7aa73637-40209632-732ca594_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:48.538463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffe85386-7aa73637-40209632-732ca594_0] Write session: try to update token
2025-09-30T14:54:48.538477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffe85386-7aa73637-40209632-732ca594_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:48.547189Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:48.547213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:48.547215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:48.547217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:48.547225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895825568686110:9653]
2025-09-30T14:54:48.547233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895825568686110:9653]
2025-09-30T14:54:48.547236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895825568686110:9653]
2025-09-30T14:54:48.547286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:48.547290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:48.547292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:48.547296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:48.547296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.547299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:48.547435Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:48.552702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1652 sessionId: src_id|ffe85386-7aa73637-40209632-732ca594_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:48.555238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:48.605868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895825658447720:9749]
2025-09-30T14:54:48.606180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1651, pipe: [1:7555895825658447720:9749]
2025-09-30T14:54:48.657959Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:48.658285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:48.658298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:48.658329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895825658447720:9749], now have 1 active actors on pipe
2025-09-30T14:54:48.658521Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:48.658617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895825658447720:9749]
2025-09-30T14:54:48.658632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:48.658636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:48.658647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:48.658702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1652 reason: error at write: Disconnected sessionId: src_id|ffe85386-7aa73637-40209632-732ca594_0
2025-09-30T14:54:48.658892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1652 sessionId: src_id|ffe85386-7aa73637-40209632-732ca594_0 is DEAD
2025-09-30T14:54:48.659026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffe85386-7aa73637-40209632-732ca594_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:48.659043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffe85386-7aa73637-40209632-732ca594_0] Write session will restart in 0.008946s
2025-09-30T14:54:48.659066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffe85386-7aa73637-40209632-732ca594_0] Write session: Do CDS request
2025-09-30T14:54:48.659075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffe85386-7aa73637-40209632-732ca594_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:48.668735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffe85386-7aa73637-40209632-732ca594_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:48.668813Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:48.668828Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1653
2025-09-30T14:54:48.668932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1653 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:48.668974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1653 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:48.668984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1653 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:48.668989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:48.669392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1653 sessionId:  describe result for acl check
2025-09-30T14:54:48.669421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:48.669428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:48.669430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:48.669435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895825658447901:10042] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:48.669927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895825658447901:10042] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:48.671933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895825658447901:10042] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:48.673993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895825658447901:10042] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:48.674005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895825658447901:10042] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:48.674009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895825658447901:10042] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:48.674016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1653 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:48.674011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:48.676321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:48.676488Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:48.676501Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:48.676510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:48.676550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:48.676586Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895825568686351:9655]
2025-09-30T14:54:48.677146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:48.677380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:48.677422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:48.677731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:48.678044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:48.678054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:48.678055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:48.678056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:48.678057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:48.678059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:48.678060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:48.678061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:48.678062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:48.678064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:48.678065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.678066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.678067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.678069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:48.678070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:48.678076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:48.678086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:48.678091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:48.678095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:48.678099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:48.678103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:48.678108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:48.678113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:48.678117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:48.678121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:48.678125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.678129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.678133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.678137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:48.678142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:48.678149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:48.678158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:48.678169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:48.678175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:48.678185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:48.678191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:48.678197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:48.678203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:48.678208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:48.678213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:48.678217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:48.678222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:48.678227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:48.678232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:48.678240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:48.678245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:48.678255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:48.678265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:48.678269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:48.678278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:48.678288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.678298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.678306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.678311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.678320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.678328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.678332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:48.678342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:48.678347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:48.678356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:48.678403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:48.683923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:48.685299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:48.685320Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:48.685322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:48.685325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:48.685332Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1652 [2:7555895825568686351:9655]
2025-09-30T14:54:48.685347Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:48.685362Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:48.685366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:48.685369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:48.685372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:48.685388Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:48.685399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:48.685405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:48.685472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.685481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.685486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.685489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:48.685492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:48.685561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:48.685568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.685579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.685589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.685610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:48.685634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895825658447722:2454], now have 1 active actors on pipe
2025-09-30T14:54:48.685645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895825568686345:9655]
2025-09-30T14:54:48.685647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895825568686345:9655]
2025-09-30T14:54:48.685650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895825568686345:9655]
2025-09-30T14:54:48.685665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:48.685673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895825658448031:10042], now have 1 active actors on pipe
2025-09-30T14:54:48.685681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:48.685681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:48.685684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:48.685686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:48.685690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:48.685692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:48.685702Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1652
2025-09-30T14:54:48.685716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1652
2025-09-30T14:54:48.685734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895825568686345:9655]
2025-09-30T14:54:48.685757Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:48.685764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:48.685776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:48.685780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:48.685817Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70665858-968823b3-db75199-52cc89aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:48.685829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:48.685833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:48.685836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:48.685845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:48.685854Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:48.685874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:48.686040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:48.686048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:48.686062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:48.686160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1653 partition: 0 MaxSeqNo: 42 sessionId: src_id|70665858-968823b3-db75199-52cc89aa_0
2025-09-30T14:54:48.686504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffe85386-7aa73637-40209632-732ca594_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|70665858-968823b3-db75199-52cc89aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:48.689363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70665858-968823b3-db75199-52cc89aa_0] Write session: try to update token
2025-09-30T14:54:48.689383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70665858-968823b3-db75199-52cc89aa_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:48.697907Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:48.697931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:48.697934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:48.697936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:48.697945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895825568686345:9655]
2025-09-30T14:54:48.697950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895825568686345:9655]
2025-09-30T14:54:48.697955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895825568686345:9655]
2025-09-30T14:54:48.697996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:48.698003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.698002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:48.698006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:48.698009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:48.698013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:48.698403Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:48.705040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1653 sessionId: src_id|70665858-968823b3-db75199-52cc89aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:48.707952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:48.758996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895825658448043:9749]
2025-09-30T14:54:48.759270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1652, pipe: [1:7555895825658448043:9749]
2025-09-30T14:54:48.817501Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:48.817915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:48.817933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:48.817952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895825658448043:9749], now have 1 active actors on pipe
2025-09-30T14:54:48.818211Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:48.818259Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:48.818264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895825658448043:9749]
2025-09-30T14:54:48.818298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:48.818368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1653 reason: status is not ok: tablet will be restarted right now sessionId: src_id|70665858-968823b3-db75199-52cc89aa_0
2025-09-30T14:54:48.818529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1653 sessionId: src_id|70665858-968823b3-db75199-52cc89aa_0 is DEAD
2025-09-30T14:54:48.818675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70665858-968823b3-db75199-52cc89aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:48.818685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70665858-968823b3-db75199-52cc89aa_0] Write session will restart in 0.007605s
2025-09-30T14:54:48.818713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70665858-968823b3-db75199-52cc89aa_0] Write session: Do CDS request
2025-09-30T14:54:48.818719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70665858-968823b3-db75199-52cc89aa_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:48.827749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70665858-968823b3-db75199-52cc89aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:48.827788Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:48.827803Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1654
2025-09-30T14:54:48.827955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1654 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:48.828000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1654 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:48.828011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1654 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:48.828015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:48.828446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1654 sessionId:  describe result for acl check
2025-09-30T14:54:48.828488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:48.828496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:48.828499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:48.828504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895825658448184:10046] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:48.829096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895825658448184:10046] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:48.831550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895825658448184:10046] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:48.834442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895825658448184:10046] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:48.834460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895825658448184:10046] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:48.834464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895825658448184:10046] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:48.834471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1654 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:48.834732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:48.836710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:48.837047Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:48.837061Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:48.837074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:48.837137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:48.837176Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895825568686590:9658]
2025-09-30T14:54:48.837874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:48.838308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:48.838361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:48.838674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:48.838748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:48.838754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:48.838755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:48.838757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:48.838758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:48.838759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:48.838760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:48.838761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:48.838763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:48.838764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:48.838765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.838767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.838768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.838769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:48.838770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:48.838775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:48.838786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:48.838790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:48.838794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:48.838798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:48.838802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:48.838806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:48.838810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:48.838815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:48.838819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:48.838823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.838827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.838831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.838839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:48.838844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:48.838857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:48.838868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:48.838879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:48.838889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:48.838898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:48.838907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:48.838918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:48.838923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:48.838928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:48.838938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:48.838947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:48.838956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:48.838961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:48.838967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:48.838972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:48.838981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:48.838990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:48.838998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:48.839002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:48.839012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:48.839021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.839031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.839039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.839048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.839057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.839066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.839071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:48.839080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:48.839089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:48.839098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:48.839148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:48.844371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:48.845414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:48.845428Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:48.845430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:48.845433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:48.845441Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1653 [2:7555895825568686590:9658]
2025-09-30T14:54:48.845452Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:48.845463Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:48.845465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:48.845467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:48.845468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:48.845480Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:48.845484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:48.845490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:48.845533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.845540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.845542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.845544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:48.845545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:48.845595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:48.845599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.845607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.845617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.845627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:48.845643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895825568686584:9658]
2025-09-30T14:54:48.845644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895825568686584:9658]
2025-09-30T14:54:48.845646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895825568686584:9658]
2025-09-30T14:54:48.845653Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:48.845665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:48.845665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:48.845669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:48.845671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:48.845679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:48.845682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:48.845692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895825658448355:10046], now have 1 active actors on pipe
2025-09-30T14:54:48.845695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895825658448045:2454], now have 1 active actors on pipe
2025-09-30T14:54:48.845720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895825568686584:9658]
2025-09-30T14:54:48.845762Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:48.845776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:48.845800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1653
2025-09-30T14:54:48.845802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1653
2025-09-30T14:54:48.845902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:48.845916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:48.845947Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30847dad-92c4dd9a-ea371027-a4b75038_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:48.845961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:48.845969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:48.845971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:48.845982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:48.845997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:48.846016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:48.846161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:48.846170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:48.846182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:48.846302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1654 partition: 0 MaxSeqNo: 42 sessionId: src_id|30847dad-92c4dd9a-ea371027-a4b75038_0
2025-09-30T14:54:48.846669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70665858-968823b3-db75199-52cc89aa_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|30847dad-92c4dd9a-ea371027-a4b75038_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:48.849264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30847dad-92c4dd9a-ea371027-a4b75038_0] Write session: try to update token
2025-09-30T14:54:48.849279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30847dad-92c4dd9a-ea371027-a4b75038_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:48.857434Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:48.857461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:48.857464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:48.857466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:48.857475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895825568686584:9658]
2025-09-30T14:54:48.857480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895825568686584:9658]
2025-09-30T14:54:48.857484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895825568686584:9658]
2025-09-30T14:54:48.857522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:48.857533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.857532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:48.857536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:48.857539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:48.857543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:48.857683Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:48.863125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1654 sessionId: src_id|30847dad-92c4dd9a-ea371027-a4b75038_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:48.865868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:48.918203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895825658448367:9749]
2025-09-30T14:54:48.918553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1653, pipe: [1:7555895825658448367:9749]
2025-09-30T14:54:48.967100Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:48.968499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:48.968516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:48.968550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895825658448367:9749], now have 1 active actors on pipe
2025-09-30T14:54:48.968686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:48.968698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895825658448367:9749]
2025-09-30T14:54:48.968700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:48.968723Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:48.968750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1654 reason: error at write: Disconnected sessionId: src_id|30847dad-92c4dd9a-ea371027-a4b75038_0
2025-09-30T14:54:48.968790Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:48.968927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1654 sessionId: src_id|30847dad-92c4dd9a-ea371027-a4b75038_0 is DEAD
2025-09-30T14:54:48.969043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30847dad-92c4dd9a-ea371027-a4b75038_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:48.969057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30847dad-92c4dd9a-ea371027-a4b75038_0] Write session will restart in 0.005531s
2025-09-30T14:54:48.969078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30847dad-92c4dd9a-ea371027-a4b75038_0] Write session: Do CDS request
2025-09-30T14:54:48.969086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30847dad-92c4dd9a-ea371027-a4b75038_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:48.975710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30847dad-92c4dd9a-ea371027-a4b75038_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:48.975781Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:48.975797Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1655
2025-09-30T14:54:48.975926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1655 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:48.975965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1655 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:48.975974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1655 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:48.975978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:48.976351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1655 sessionId:  describe result for acl check
2025-09-30T14:54:48.976383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:48.976389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:48.976391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:48.976396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895825658448414:10057] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:48.976915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895825658448414:10057] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:48.979091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895825658448414:10057] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:48.982277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895825658448414:10057] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:48.982304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895825658448414:10057] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:48.982307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895825658448414:10057] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:48.982314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1655 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:48.985992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:48.988204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:48.988387Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:48.988399Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:48.988409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:48.988458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:48.988500Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895825568686865:9672]
2025-09-30T14:54:48.989154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:48.989458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:48.989519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:48.989909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:48.989974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:48.989989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:48.989990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:48.989992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:48.989993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:48.989994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:48.989995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:48.989996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:48.989997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:48.989998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:48.989999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.990000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.990001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.990002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:48.990002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:48.990009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:48.990021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:48.990026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:48.990029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:48.990033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:48.990038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:48.990042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:48.990046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:48.990050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:48.990055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:48.990059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.990063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.990068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.990073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:48.990077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:48.990086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:48.990094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:48.990100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:48.990106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:48.990111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:48.990118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:48.990129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:48.990139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:48.990144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:48.990154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:48.990158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:48.990168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:48.990174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:48.990183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:48.990187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:48.990192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:48.990201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:48.990207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:48.990215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:48.990221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:48.990229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.990235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.990244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.990250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.990258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.990264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.990272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:48.990278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:48.990285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:48.990291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:48.990338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:48.995714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:48.996794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:48.996814Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:48.996817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:48.996822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:48.996828Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1654 [2:7555895825568686865:9672]
2025-09-30T14:54:48.996843Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:48.996858Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:48.996860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:48.996863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:48.996865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:48.996880Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:48.996887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:48.996893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:48.996952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.996959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.996962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.996967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:48.996970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:48.997034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:48.997042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:48.997055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:48.997071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:48.997091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:48.997115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895825658448392:2454], now have 1 active actors on pipe
2025-09-30T14:54:48.997123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895825658448639:10057], now have 1 active actors on pipe
2025-09-30T14:54:48.997130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895825568686860:9672]
2025-09-30T14:54:48.997134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895825568686860:9672]
2025-09-30T14:54:48.997136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895825568686860:9672]
2025-09-30T14:54:48.997149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:48.997164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:48.997168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:48.997176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:48.997178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:48.997196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:48.997198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1654
2025-09-30T14:54:48.997206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:48.997201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1654
2025-09-30T14:54:48.997240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895825568686860:9672]
2025-09-30T14:54:48.997244Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:48.997246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:48.997266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:48.997270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:48.997319Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c463535f-29f664fb-5f09978c-5e1fade_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:48.997330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:48.997334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:48.997336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:48.997346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:48.997355Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:48.997378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:48.997582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:48.997594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:48.997617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:48.997703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1655 partition: 0 MaxSeqNo: 42 sessionId: src_id|c463535f-29f664fb-5f09978c-5e1fade_0
2025-09-30T14:54:48.998100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30847dad-92c4dd9a-ea371027-a4b75038_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c463535f-29f664fb-5f09978c-5e1fade_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:49.000908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c463535f-29f664fb-5f09978c-5e1fade_0] Write session: try to update token
2025-09-30T14:54:49.000929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c463535f-29f664fb-5f09978c-5e1fade_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:49.009422Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:49.009447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:49.009449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:49.009451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:49.009461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895825568686860:9672]
2025-09-30T14:54:49.009464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895825568686860:9672]
2025-09-30T14:54:49.009468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895825568686860:9672]
2025-09-30T14:54:49.009509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:49.009517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.009519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:49.009526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:49.009555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:49.009559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:49.009692Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:49.015702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1655 sessionId: src_id|c463535f-29f664fb-5f09978c-5e1fade_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:49.018413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:49.068758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895829953416019:9749]
2025-09-30T14:54:49.069043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1654, pipe: [1:7555895829953416019:9749]
2025-09-30T14:54:49.120351Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:49.120695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:49.120712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:49.120753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895829953416019:9749], now have 1 active actors on pipe
2025-09-30T14:54:49.120980Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:49.121063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:49.121073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:49.121117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895829953416019:9749]
2025-09-30T14:54:49.121163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1655 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c463535f-29f664fb-5f09978c-5e1fade_0
2025-09-30T14:54:49.121389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1655 sessionId: src_id|c463535f-29f664fb-5f09978c-5e1fade_0 is DEAD
2025-09-30T14:54:49.121528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c463535f-29f664fb-5f09978c-5e1fade_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:49.121552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c463535f-29f664fb-5f09978c-5e1fade_0] Write session will restart in 0.008496s
2025-09-30T14:54:49.121577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c463535f-29f664fb-5f09978c-5e1fade_0] Write session: Do CDS request
2025-09-30T14:54:49.121583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c463535f-29f664fb-5f09978c-5e1fade_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:49.131745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c463535f-29f664fb-5f09978c-5e1fade_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:49.131823Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:49.131840Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1656
2025-09-30T14:54:49.131946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1656 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:49.131995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1656 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:49.132007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1656 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:49.132012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:49.132401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1656 sessionId:  describe result for acl check
2025-09-30T14:54:49.132436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:49.132438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:49.132442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:49.132448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895829953416149:10062] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:49.132991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895829953416149:10062] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:49.135441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895829953416149:10062] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:49.138056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895829953416149:10062] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:49.138069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895829953416149:10062] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:49.138072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895829953416149:10062] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:49.138080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1656 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:49.139227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:49.141396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:49.141786Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:49.141800Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:49.141814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:49.141884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:49.141927Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895829863654401:9674]
2025-09-30T14:54:49.142578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:49.142921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:49.142979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:49.143340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:49.143436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:49.143444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:49.143445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:49.143446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:49.143448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:49.143449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:49.143450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:49.143452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:49.143453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:49.143454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:49.143456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.143457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.143458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.143460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:49.143461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:49.143468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:49.143479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:49.143483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:49.143488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:49.143492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:49.143496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:49.143500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:49.143504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:49.143508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:49.143511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:49.143515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.143518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.143523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.143527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:49.143531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:49.143539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:49.143547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:49.143554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:49.143560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:49.143565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:49.143571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:49.143576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:49.143582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:49.143587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:49.143593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:49.143599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:49.143606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:49.143611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:49.143617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:49.143622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:49.143628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:49.143633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:49.143638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:49.143651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:49.143657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:49.143663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.143668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.143673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.143678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.143684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.143690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.143694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:49.143701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:49.143714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:49.143719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:49.143772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:49.149567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:49.150918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:49.150933Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:49.150936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:49.150940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:49.150947Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1655 [2:7555895829863654401:9674]
2025-09-30T14:54:49.150963Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:49.150979Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:49.150983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:49.150985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:49.150988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:49.151006Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:49.151022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:49.151034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:49.151101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.151108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.151112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.151115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:49.151118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:49.151189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:49.151199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.151212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.151224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.151240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:49.151276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895829953416026:2454], now have 1 active actors on pipe
2025-09-30T14:54:49.151285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895829953416337:10062], now have 1 active actors on pipe
2025-09-30T14:54:49.151291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895829863654396:9674]
2025-09-30T14:54:49.151293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895829863654396:9674]
2025-09-30T14:54:49.151295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895829863654396:9674]
2025-09-30T14:54:49.151309Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:49.151328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:49.151329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:49.151340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:49.151342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:49.151344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:49.151347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:49.151385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895829863654396:9674]
2025-09-30T14:54:49.151399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:49.151423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:49.151408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1655
2025-09-30T14:54:49.151412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1655
2025-09-30T14:54:49.151560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:49.151570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:49.151592Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52936975-f611ec7f-c2ba86a5-c007d809_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:49.151608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:49.151619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:49.151621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:49.151632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:49.151647Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:49.151666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:49.152048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:49.152061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:49.152082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:49.152227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1656 partition: 0 MaxSeqNo: 42 sessionId: src_id|52936975-f611ec7f-c2ba86a5-c007d809_0
2025-09-30T14:54:49.152641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c463535f-29f664fb-5f09978c-5e1fade_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|52936975-f611ec7f-c2ba86a5-c007d809_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:49.155586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52936975-f611ec7f-c2ba86a5-c007d809_0] Write session: try to update token
2025-09-30T14:54:49.155614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52936975-f611ec7f-c2ba86a5-c007d809_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:49.163984Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:49.164010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:49.164014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:49.164017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:49.164028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895829863654396:9674]
2025-09-30T14:54:49.164035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895829863654396:9674]
2025-09-30T14:54:49.164041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895829863654396:9674]
2025-09-30T14:54:49.164096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:49.164099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:49.164106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.164110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:49.164111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:49.164116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:49.164335Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:49.170935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1656 sessionId: src_id|52936975-f611ec7f-c2ba86a5-c007d809_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:49.173621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:49.221304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895829953416354:9749]
2025-09-30T14:54:49.221547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1655, pipe: [1:7555895829953416354:9749]
2025-09-30T14:54:49.279139Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:49.279564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:49.279591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:49.279623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895829953416354:9749], now have 1 active actors on pipe
2025-09-30T14:54:49.279894Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:49.279902Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:49.280089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:49.280097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:49.280102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895829953416354:9749]
2025-09-30T14:54:49.280174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1656 reason: error at write: Disconnected sessionId: src_id|52936975-f611ec7f-c2ba86a5-c007d809_0
2025-09-30T14:54:49.280368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1656 sessionId: src_id|52936975-f611ec7f-c2ba86a5-c007d809_0 is DEAD
2025-09-30T14:54:49.280518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52936975-f611ec7f-c2ba86a5-c007d809_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:49.280525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52936975-f611ec7f-c2ba86a5-c007d809_0] Write session will restart in 0.005822s
2025-09-30T14:54:49.280548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52936975-f611ec7f-c2ba86a5-c007d809_0] Write session: Do CDS request
2025-09-30T14:54:49.280557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52936975-f611ec7f-c2ba86a5-c007d809_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:49.287813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52936975-f611ec7f-c2ba86a5-c007d809_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:49.287873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:49.287889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1657
2025-09-30T14:54:49.288005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1657 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:49.288037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1657 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:49.288048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1657 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:49.288053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:49.288542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1657 sessionId:  describe result for acl check
2025-09-30T14:54:49.288578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:49.288590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:49.288592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:49.288599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895829953416376:10066] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:49.289168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895829953416376:10066] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:49.291634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895829953416376:10066] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:49.294628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895829953416376:10066] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:49.294643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895829953416376:10066] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:49.294647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895829953416376:10066] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:49.294654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1657 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:49.300436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:49.302459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:49.302759Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:49.302773Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:49.302786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:49.302859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:49.302901Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895829863654643:9676]
2025-09-30T14:54:49.303564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:49.303875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:49.303925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:49.304275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:49.304359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:49.304367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:49.304368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:49.304369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:49.304371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:49.304372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:49.304374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:49.304375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:49.304376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:49.304378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:49.304379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.304380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.304381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.304383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:49.304384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:49.304390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:49.304400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:49.304404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:49.304408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:49.304411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:49.304415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:49.304419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:49.304422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:49.304427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:49.304430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:49.304434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.304437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.304441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.304444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:49.304448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:49.304456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:49.304464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:49.304469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:49.304475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:49.304479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:49.304485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:49.304489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:49.304494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:49.304500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:49.304505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:49.304509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:49.304514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:49.304519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:49.304524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:49.304528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:49.304535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:49.304542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:49.304547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:49.304552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:49.304557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:49.304561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.304566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.304579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.304583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.304593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.304598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.304608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:49.304613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:49.304617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:49.304628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:49.304672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:49.310609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:49.312045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:49.312062Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:49.312065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:49.312068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:49.312075Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1656 [2:7555895829863654643:9676]
2025-09-30T14:54:49.312092Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:49.312108Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:49.312117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:49.312122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:49.312124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:49.312140Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:49.312147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:49.312154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:49.312229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.312240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.312243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.312246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:49.312248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:49.312330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:49.312341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.312358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.312374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.312404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:49.312429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895829953416355:2454], now have 1 active actors on pipe
2025-09-30T14:54:49.312439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895829953416564:10066], now have 1 active actors on pipe
2025-09-30T14:54:49.312446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895829863654635:9676]
2025-09-30T14:54:49.312449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895829863654635:9676]
2025-09-30T14:54:49.312452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895829863654635:9676]
2025-09-30T14:54:49.312467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:49.312487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:49.312491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:49.312496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:49.312499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:49.312511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:49.312515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:49.312555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895829863654635:9676]
2025-09-30T14:54:49.312568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:49.312546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1656
2025-09-30T14:54:49.312584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:49.312559Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1656
2025-09-30T14:54:49.312628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:49.312638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:49.312663Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5aa0c8d0-b686ec30-cb339244-12aeb96c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:49.312675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:49.312678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:49.312681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:49.312690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:49.312706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:49.312726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:49.312874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:49.312883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:49.312897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:49.313000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1657 partition: 0 MaxSeqNo: 42 sessionId: src_id|5aa0c8d0-b686ec30-cb339244-12aeb96c_0
2025-09-30T14:54:49.313392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52936975-f611ec7f-c2ba86a5-c007d809_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5aa0c8d0-b686ec30-cb339244-12aeb96c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:49.316086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5aa0c8d0-b686ec30-cb339244-12aeb96c_0] Write session: try to update token
2025-09-30T14:54:49.316107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5aa0c8d0-b686ec30-cb339244-12aeb96c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:49.325154Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:49.325168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:49.325179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895829863654635:9676]
2025-09-30T14:54:49.325220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:49.325232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:49.325405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:49.325563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:49.325770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:49.326000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:49.326226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:49.326277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:49.333353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1657 sessionId: src_id|5aa0c8d0-b686ec30-cb339244-12aeb96c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:49.335980Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:49.335998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:49.336000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:49.336002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:49.336012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895829863654635:9676]
2025-09-30T14:54:49.336019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895829863654635:9676]
2025-09-30T14:54:49.336023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895829863654635:9676]
2025-09-30T14:54:49.336062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:49.336071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.336075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:49.336079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:49.336087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:49.336093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:49.336221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:49.336237Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:49.380035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895829953416681:9749]
2025-09-30T14:54:49.380373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1656, pipe: [1:7555895829953416681:9749]
2025-09-30T14:54:49.445111Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:49.445394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:49.445409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:49.445427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895829953416681:9749], now have 1 active actors on pipe
2025-09-30T14:54:49.445638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:49.445653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895829953416681:9749]
2025-09-30T14:54:49.445673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:49.445676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:49.445703Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:49.445751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1657 reason: error at write: Disconnected sessionId: src_id|5aa0c8d0-b686ec30-cb339244-12aeb96c_0
2025-09-30T14:54:49.445908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1657 sessionId: src_id|5aa0c8d0-b686ec30-cb339244-12aeb96c_0 is DEAD
2025-09-30T14:54:49.446130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aa0c8d0-b686ec30-cb339244-12aeb96c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:49.446141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aa0c8d0-b686ec30-cb339244-12aeb96c_0] Write session will restart in 0.006229s
2025-09-30T14:54:49.446164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aa0c8d0-b686ec30-cb339244-12aeb96c_0] Write session: Do CDS request
2025-09-30T14:54:49.446170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aa0c8d0-b686ec30-cb339244-12aeb96c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:49.454720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5aa0c8d0-b686ec30-cb339244-12aeb96c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:49.454812Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:49.454829Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1658
2025-09-30T14:54:49.454927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1658 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:49.454960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1658 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:49.454980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1658 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:49.454990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:49.455510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1658 sessionId:  describe result for acl check
2025-09-30T14:54:49.455544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:49.455551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:49.455552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:49.455558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895829953416751:10070] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:49.456145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895829953416751:10070] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:49.459428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895829953416751:10070] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:49.462564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895829953416751:10070] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:49.462582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895829953416751:10070] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:49.462585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895829953416751:10070] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:49.462593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1658 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:49.465232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:49.467339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:49.467562Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:49.467572Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:49.467584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:49.467655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:49.467701Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895829863654884:9679]
2025-09-30T14:54:49.468285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:49.468562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:49.468634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:49.468990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:49.469081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:49.469086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:49.469087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:49.469089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:49.469090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:49.469091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:49.469092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:49.469094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:49.469095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:49.469096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:49.469098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.469099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.469100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.469102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:49.469103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:49.469109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:49.469120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:49.469124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:49.469128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:49.469131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:49.469135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:49.469139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:49.469143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:49.469148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:49.469152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:49.469156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.469160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.469164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.469167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:49.469171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:49.469180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:49.469189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:49.469195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:49.469201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:49.469205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:49.469209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:49.469213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:49.469218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:49.469221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:49.469226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:49.469230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:49.469234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:49.469239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:49.469245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:49.469250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:49.469256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:49.469261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:49.469267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:49.469271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:49.469276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:49.469280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.469286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.469290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.469295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.469300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.469305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.469309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:49.469313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:49.469317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:49.469322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:49.469368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:49.474809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:49.475838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:49.475852Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:49.475854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:49.475857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:49.475863Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1657 [2:7555895829863654884:9679]
2025-09-30T14:54:49.475875Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:49.475886Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:49.475892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:49.475894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:49.475896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:49.475909Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:49.475918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:49.475924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:49.475987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.475993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.475995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.475997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:49.476000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:49.476051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:49.476059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.476070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.476079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.476094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:49.476111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895829863654879:9679]
2025-09-30T14:54:49.476119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895829863654879:9679]
2025-09-30T14:54:49.476120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895829863654879:9679]
2025-09-30T14:54:49.476127Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:49.476139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895829953416682:2454], now have 1 active actors on pipe
2025-09-30T14:54:49.476143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895829953416970:10070], now have 1 active actors on pipe
2025-09-30T14:54:49.476145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:49.476149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:49.476152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:49.476153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:49.476167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:49.476171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:49.476205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895829863654879:9679]
2025-09-30T14:54:49.476213Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:49.476223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:49.476194Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1657
2025-09-30T14:54:49.476230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1657
2025-09-30T14:54:49.476272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:49.476279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:49.476299Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2c64a99-2883d30c-dd29bf4-cd970908_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:49.476309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:49.476312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:49.476313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:49.476321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:49.476328Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:49.476341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:49.476574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:49.476582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:49.476594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:49.476680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1658 partition: 0 MaxSeqNo: 42 sessionId: src_id|c2c64a99-2883d30c-dd29bf4-cd970908_0
2025-09-30T14:54:49.477028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aa0c8d0-b686ec30-cb339244-12aeb96c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c2c64a99-2883d30c-dd29bf4-cd970908_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:49.479673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2c64a99-2883d30c-dd29bf4-cd970908_0] Write session: try to update token
2025-09-30T14:54:49.479689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2c64a99-2883d30c-dd29bf4-cd970908_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:49.487978Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:49.487996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:49.487999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:49.488002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:49.488011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895829863654879:9679]
2025-09-30T14:54:49.488016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895829863654879:9679]
2025-09-30T14:54:49.488020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895829863654879:9679]
2025-09-30T14:54:49.488062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:49.488073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.488076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:49.488088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:49.488103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:49.488108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:49.488209Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:49.494636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1658 sessionId: src_id|c2c64a99-2883d30c-dd29bf4-cd970908_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:49.497192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:49.545926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895829953417009:9749]
2025-09-30T14:54:49.546244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1657, pipe: [1:7555895829953417009:9749]
2025-09-30T14:54:49.593623Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:49.593920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:49.593935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:49.593954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895829953417009:9749], now have 1 active actors on pipe
2025-09-30T14:54:49.594284Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:49.594242Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:49.594282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:49.594286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:49.594289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895829953417009:9749]
2025-09-30T14:54:49.594346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1658 reason: error at write: Disconnected sessionId: src_id|c2c64a99-2883d30c-dd29bf4-cd970908_0
2025-09-30T14:54:49.594490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1658 sessionId: src_id|c2c64a99-2883d30c-dd29bf4-cd970908_0 is DEAD
2025-09-30T14:54:49.594627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2c64a99-2883d30c-dd29bf4-cd970908_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:49.594643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2c64a99-2883d30c-dd29bf4-cd970908_0] Write session will restart in 0.009021s
2025-09-30T14:54:49.594673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2c64a99-2883d30c-dd29bf4-cd970908_0] Write session: Do CDS request
2025-09-30T14:54:49.594682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2c64a99-2883d30c-dd29bf4-cd970908_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:49.604774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2c64a99-2883d30c-dd29bf4-cd970908_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:49.604880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:49.604894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1659
2025-09-30T14:54:49.605004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1659 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:49.605038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1659 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:49.605048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1659 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:49.605053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:49.605605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1659 sessionId:  describe result for acl check
2025-09-30T14:54:49.605636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:49.605641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:49.605642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:49.605647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895829953417165:10076] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:49.606093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895829953417165:10076] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:49.608289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895829953417165:10076] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:49.610613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895829953417165:10076] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:49.610623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895829953417165:10076] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:49.610626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895829953417165:10076] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:49.610643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1659 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:49.611546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:49.613589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:49.613769Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:49.613778Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:49.613788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:49.613835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:49.613873Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895829863655139:9682]
2025-09-30T14:54:49.614300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:49.614556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:49.614584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:49.615027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:49.615118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:49.615127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:49.615128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:49.615129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:49.615131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:49.615132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:49.615133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:49.615134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:49.615136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:49.615137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:49.615138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.615140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.615141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.615142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:49.615144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:49.615149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:49.615159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:49.615164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:49.615168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:49.615172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:49.615176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:49.615180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:49.615184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:49.615188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:49.615192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:49.615196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.615201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.615205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.615209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:49.615213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:49.615221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:49.615230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:49.615236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:49.615257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:49.615263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:49.615268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:49.615273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:49.615280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:49.615284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:49.615290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:49.615294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:49.615300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:49.615306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:49.615312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:49.615316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:49.615321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:49.615326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:49.615330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:49.615335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:49.615340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:49.615344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.615351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.615361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.615367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.615374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.615385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.615390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:49.615402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:49.615407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:49.615412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:49.615460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:49.620627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:49.621681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:49.621695Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:49.621698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:49.621701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:49.621707Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1658 [2:7555895829863655139:9682]
2025-09-30T14:54:49.621722Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:49.621746Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:49.621753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:49.621756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:49.621759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:49.621774Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:49.621785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:49.621791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:49.621846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.621853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.621855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.621859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:49.621861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:49.621920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:49.621927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.621939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.621956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.621977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:49.621998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895829953417024:2454], now have 1 active actors on pipe
2025-09-30T14:54:49.622006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895829953417337:10076], now have 1 active actors on pipe
2025-09-30T14:54:49.622014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895829863655134:9682]
2025-09-30T14:54:49.622021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895829863655134:9682]
2025-09-30T14:54:49.622023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895829863655134:9682]
2025-09-30T14:54:49.622035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:49.622049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:49.622051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:49.622056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:49.622058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:49.622031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1658
2025-09-30T14:54:49.622064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:49.622032Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1658
2025-09-30T14:54:49.622066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:49.622097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:49.622106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:49.622122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895829863655134:9682]
2025-09-30T14:54:49.622134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:49.622149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:49.622160Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|318c3889-ffce2c9f-38ae90d4-ac80528b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:49.622167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:49.622170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:49.622172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:49.622180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:49.622193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:49.622219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:49.622370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:49.622377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:49.622390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:49.622462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1659 partition: 0 MaxSeqNo: 42 sessionId: src_id|318c3889-ffce2c9f-38ae90d4-ac80528b_0
2025-09-30T14:54:49.622770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2c64a99-2883d30c-dd29bf4-cd970908_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|318c3889-ffce2c9f-38ae90d4-ac80528b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:49.625296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|318c3889-ffce2c9f-38ae90d4-ac80528b_0] Write session: try to update token
2025-09-30T14:54:49.625310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|318c3889-ffce2c9f-38ae90d4-ac80528b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:49.633668Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:49.633684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:49.633687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:49.633689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:49.633697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895829863655134:9682]
2025-09-30T14:54:49.633702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895829863655134:9682]
2025-09-30T14:54:49.633706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895829863655134:9682]
2025-09-30T14:54:49.633756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:49.633763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.633766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:49.633774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:49.633781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:49.633785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:49.633984Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:49.638324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1659 sessionId: src_id|318c3889-ffce2c9f-38ae90d4-ac80528b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:49.641018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:49.694419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895829953417352:9749]
2025-09-30T14:54:49.694730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1658, pipe: [1:7555895829953417352:9749]
2025-09-30T14:54:49.744629Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:49.744888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:49.744899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:49.744930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895829953417352:9749], now have 1 active actors on pipe
2025-09-30T14:54:49.745104Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:49.745181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:49.745190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:49.745199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:49.745251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895829953417352:9749]
2025-09-30T14:54:49.745274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1659 reason: error at write: Disconnected sessionId: src_id|318c3889-ffce2c9f-38ae90d4-ac80528b_0
2025-09-30T14:54:49.745455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1659 sessionId: src_id|318c3889-ffce2c9f-38ae90d4-ac80528b_0 is DEAD
2025-09-30T14:54:49.745594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|318c3889-ffce2c9f-38ae90d4-ac80528b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:49.745603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|318c3889-ffce2c9f-38ae90d4-ac80528b_0] Write session will restart in 0.009993s
2025-09-30T14:54:49.745621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|318c3889-ffce2c9f-38ae90d4-ac80528b_0] Write session: Do CDS request
2025-09-30T14:54:49.745625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|318c3889-ffce2c9f-38ae90d4-ac80528b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:49.756757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|318c3889-ffce2c9f-38ae90d4-ac80528b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:49.756791Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:49.756805Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1660
2025-09-30T14:54:49.756980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1660 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:49.757019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1660 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:49.757024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1660 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:49.757027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:49.757590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1660 sessionId:  describe result for acl check
2025-09-30T14:54:49.757627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:49.757633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:49.757635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:49.757642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895829953417565:10080] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:49.758192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895829953417565:10080] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:49.760236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895829953417565:10080] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:49.761960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:49.764067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:49.764238Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:49.764248Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:49.764255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:49.764297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:49.764286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895829953417565:10080] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:49.764304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895829953417565:10080] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:49.764331Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895829863655382:9684]
2025-09-30T14:54:49.764308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895829953417565:10080] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:49.764317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1660 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:49.764851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:49.765151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:49.765214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:49.765576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:49.765643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:49.765644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:49.765645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:49.765647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:49.765649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:49.765650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:49.765651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:49.765653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:49.765654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:49.765656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:49.765657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.765658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.765660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.765661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:49.765663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:49.765669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:49.765679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:49.765683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:49.765688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:49.765692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:49.765696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:49.765701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:49.765705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:49.765709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:49.765713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:49.765717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.765722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.765726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.765730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:49.765745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:49.765752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:49.765764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:49.765775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:49.765782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:49.765787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:49.765792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:49.765797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:49.765802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:49.765807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:49.765812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:49.765820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:49.765823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:49.765826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:49.765829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:49.765831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:49.765834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:49.765837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:49.765840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:49.765845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:49.765850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:49.765855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.765861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.765870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.765873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.765875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.765878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.765882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:49.765885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:49.765888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:49.765891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:49.765916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:49.771447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:49.772640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:49.772656Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:49.772659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:49.772663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:49.772669Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1659 [2:7555895829863655382:9684]
2025-09-30T14:54:49.772684Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:49.772698Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:49.772699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:49.772701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:49.772703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:49.772714Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:49.772719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:49.772724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:49.772769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.772775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.772776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.772778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:49.772780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:49.772829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:49.772834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.772842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.772849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.772862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:49.772878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895829863655377:9684]
2025-09-30T14:54:49.772886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895829863655377:9684]
2025-09-30T14:54:49.772887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895829863655377:9684]
2025-09-30T14:54:49.772894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:49.772909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:49.772914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:49.772917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:49.772919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:49.772924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:49.772926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:49.772935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895829953417670:10080], now have 1 active actors on pipe
2025-09-30T14:54:49.772938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895829953417353:2454], now have 1 active actors on pipe
2025-09-30T14:54:49.772969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895829863655377:9684]
2025-09-30T14:54:49.772980Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:49.772994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:49.773046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1659
2025-09-30T14:54:49.773056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1659
2025-09-30T14:54:49.773156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:49.773172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:49.773199Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b47d686f-b92ce9e2-4ee5924d-2b11586a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:49.773216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:49.773220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:49.773222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:49.773233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:49.773253Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:49.773273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:49.773410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:49.773419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:49.773433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:49.773531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1660 partition: 0 MaxSeqNo: 42 sessionId: src_id|b47d686f-b92ce9e2-4ee5924d-2b11586a_0
2025-09-30T14:54:49.773886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|318c3889-ffce2c9f-38ae90d4-ac80528b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b47d686f-b92ce9e2-4ee5924d-2b11586a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:49.776545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b47d686f-b92ce9e2-4ee5924d-2b11586a_0] Write session: try to update token
2025-09-30T14:54:49.776567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b47d686f-b92ce9e2-4ee5924d-2b11586a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:49.784884Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:49.784908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:49.784920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895829863655377:9684]
2025-09-30T14:54:49.784967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:49.784974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:49.785209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:49.785363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:49.785513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:49.785654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:49.785879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:49.785920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:49.790636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1660 sessionId: src_id|b47d686f-b92ce9e2-4ee5924d-2b11586a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:49.793210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:49.793432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:49.793452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:49.793489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:49.793587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:49.795410Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:49.795422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:49.795424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:49.795426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:49.795434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895829863655377:9684]
2025-09-30T14:54:49.795439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895829863655377:9684]
2025-09-30T14:54:49.795442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895829863655377:9684]
2025-09-30T14:54:49.795474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:49.795477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:49.795481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:49.795482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.795483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:49.795485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:49.795625Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:49.845470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895829953417682:9749]
2025-09-30T14:54:49.845893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1659, pipe: [1:7555895829953417682:9749]
2025-09-30T14:54:49.906179Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:49.914310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:49.914338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:49.914511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:49.914579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:49.914649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:49.914721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:49.914772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:49.914783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:49.914851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:49.914917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:49.914981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:49.915214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:49.915273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:49.915283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:49.915349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:49.915411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:49.915476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:49.915542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:49.915677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:49.915686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:49.915751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:49.916103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:49.916171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:49.916242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:49.916289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:49.916298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:49.916365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:49.916428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:49.916495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:49.916601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:49.916650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:49.916659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:49.916726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:49.916816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:49.916926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:49.916990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:49.917041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:49.917050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:49.917119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:49.917180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:49.917254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:49.917321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:49.917388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:49.917397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:49.917460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:49.917519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:49.917586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:49.917650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:49.917783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:49.917793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:49.917861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:49.917925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:49.917988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:49.918053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:49.918096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:49.918107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:49.918172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:49.918233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:49.918296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:49.918365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:49.918499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:49.918507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:49.918573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895829953417682:9749], now have 1 active actors on pipe
2025-09-30T14:54:49.918908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895829953417682:9749]
2025-09-30T14:54:49.918914Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:49.918958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:49.918961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:49.919001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1660 reason: error at write: Disconnected sessionId: src_id|b47d686f-b92ce9e2-4ee5924d-2b11586a_0
2025-09-30T14:54:49.919159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1660 sessionId: src_id|b47d686f-b92ce9e2-4ee5924d-2b11586a_0 is DEAD
2025-09-30T14:54:49.919306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b47d686f-b92ce9e2-4ee5924d-2b11586a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:49.919317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b47d686f-b92ce9e2-4ee5924d-2b11586a_0] Write session will restart in 0.006452s
2025-09-30T14:54:49.919349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b47d686f-b92ce9e2-4ee5924d-2b11586a_0] Write session: Do CDS request
2025-09-30T14:54:49.919355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b47d686f-b92ce9e2-4ee5924d-2b11586a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:49.919415Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:49.926747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b47d686f-b92ce9e2-4ee5924d-2b11586a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:49.926837Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:49.926854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1661
2025-09-30T14:54:49.927003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1661 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:49.927037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1661 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:49.927042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1661 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:49.927046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:49.927513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1661 sessionId:  describe result for acl check
2025-09-30T14:54:49.927546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:49.927553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:49.927555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:49.927560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895829953417754:10084] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:49.928073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895829953417754:10084] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:49.930983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895829953417754:10084] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:49.933741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895829953417754:10084] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:49.933754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895829953417754:10084] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:49.933756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895829953417754:10084] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:49.933762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1661 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:49.937047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:49.940066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:49.940300Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:49.940312Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:49.940325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:49.940391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:49.940445Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895829863655630:9687]
2025-09-30T14:54:49.941135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:49.941466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:49.941521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:49.941902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:49.941988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:49.941993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:49.941995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:49.941996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:49.941998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:49.941999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:49.942001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:49.942003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:49.942004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:49.942006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:49.942007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.942008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.942010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.942011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:49.942012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:49.942019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:49.942032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:49.942036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:49.942040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:49.942044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:49.942049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:49.942053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:49.942057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:49.942061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:49.942065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:49.942070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.942074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.942078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.942083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:49.942087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:49.942095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:49.942109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:49.942121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:49.942129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:49.942132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:49.942139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:49.942143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:49.942146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:49.942151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:49.942155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:49.942158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:49.942161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:49.942164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:49.942168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:49.942170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:49.942174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:49.942176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:49.942179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:49.942182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:49.942185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:49.942189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.942192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.942195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.942198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.942200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.942203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.942206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:49.942220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:49.942226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:49.942229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:49.942253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:49.947931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:49.949236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:49.949256Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:49.949259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:49.949262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:49.949269Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1660 [2:7555895829863655630:9687]
2025-09-30T14:54:49.949288Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:49.949305Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:49.949315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:49.949318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:49.949320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:49.949337Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:49.949345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:49.949352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:49.949418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.949426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.949428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.949432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:49.949434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:49.949507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:49.949518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.949534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:49.949547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:49.949566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:49.949590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895829953417959:10084], now have 1 active actors on pipe
2025-09-30T14:54:49.949599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895829953417683:2454], now have 1 active actors on pipe
2025-09-30T14:54:49.949606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895829863655625:9687]
2025-09-30T14:54:49.949609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895829863655625:9687]
2025-09-30T14:54:49.949611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895829863655625:9687]
2025-09-30T14:54:49.949628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:49.949644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:49.949647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:49.949659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:49.949661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:49.949663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:49.949666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:49.949701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895829863655625:9687]
2025-09-30T14:54:49.949715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:49.949721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:49.949695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1660
2025-09-30T14:54:49.949706Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1660
2025-09-30T14:54:49.949882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:49.949893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:49.949918Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74f3bc8d-d4def3ab-4d7d3656-2b2607e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:49.949930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:49.949933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:49.949935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:49.949945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:49.949953Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:49.949967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:49.950136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:49.950152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:49.950165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:49.950323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1661 partition: 0 MaxSeqNo: 42 sessionId: src_id|74f3bc8d-d4def3ab-4d7d3656-2b2607e5_0
2025-09-30T14:54:49.950892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b47d686f-b92ce9e2-4ee5924d-2b11586a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|74f3bc8d-d4def3ab-4d7d3656-2b2607e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:49.953486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74f3bc8d-d4def3ab-4d7d3656-2b2607e5_0] Write session: try to update token
2025-09-30T14:54:49.953503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74f3bc8d-d4def3ab-4d7d3656-2b2607e5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:49.962162Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:49.962182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:49.962193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895829863655625:9687]
2025-09-30T14:54:49.962241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:49.962246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:49.962434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:49.962616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:49.962780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:49.962953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:49.963183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:49.963234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:49.967117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1661 sessionId: src_id|74f3bc8d-d4def3ab-4d7d3656-2b2607e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:49.969879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:49.970076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:49.970095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:49.970132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:49.970219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:49.973106Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:49.973121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:49.973124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:49.973126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:49.973136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895829863655625:9687]
2025-09-30T14:54:49.973140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895829863655625:9687]
2025-09-30T14:54:49.973145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895829863655625:9687]
2025-09-30T14:54:49.973186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:49.973186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:49.973191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:49.973196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:49.973197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:49.973200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:49.973358Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:50.019013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895834248385332:9749]
2025-09-30T14:54:50.019321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1660, pipe: [1:7555895834248385332:9749]
2025-09-30T14:54:50.078505Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:50.085410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:50.085437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:50.085617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:50.085685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:50.085759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:50.085820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:50.086122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:50.086134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:50.086196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:50.086252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:50.086309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:50.086370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:50.086411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:50.086419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:50.086479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:50.086545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:50.086660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:50.086731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:50.086778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:50.086787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:50.086886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:50.086946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:50.087002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:50.087058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:50.087098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:50.087104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:50.087164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:50.087233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:50.087302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:50.087390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:50.087429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:50.087435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:50.087511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:50.087568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:50.087627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:50.087714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:50.087755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:50.087761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:50.087830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:50.087917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:50.087991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:50.088083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:50.088138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:50.088145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:50.088217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:50.088273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:50.088327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:50.088384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:50.088426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:50.088428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:50.088483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:50.088535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:50.088607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:50.088707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:50.088777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:50.088789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:50.088922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:50.089043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:50.089169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:50.089262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:50.089407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:50.089417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:50.089485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895834248385332:9749], now have 1 active actors on pipe
2025-09-30T14:54:50.089743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:50.089747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895834248385332:9749]
2025-09-30T14:54:50.089756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:50.089765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:50.089788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1661 reason: error at write: Disconnected sessionId: src_id|74f3bc8d-d4def3ab-4d7d3656-2b2607e5_0
2025-09-30T14:54:50.089957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1661 sessionId: src_id|74f3bc8d-d4def3ab-4d7d3656-2b2607e5_0 is DEAD
2025-09-30T14:54:50.090133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74f3bc8d-d4def3ab-4d7d3656-2b2607e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:50.090143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74f3bc8d-d4def3ab-4d7d3656-2b2607e5_0] Write session will restart in 0.007529s
2025-09-30T14:54:50.090169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74f3bc8d-d4def3ab-4d7d3656-2b2607e5_0] Write session: Do CDS request
2025-09-30T14:54:50.090175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74f3bc8d-d4def3ab-4d7d3656-2b2607e5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:50.090217Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:50.098745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74f3bc8d-d4def3ab-4d7d3656-2b2607e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:50.098823Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:50.098838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1662
2025-09-30T14:54:50.098973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1662 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:50.099007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1662 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:50.099017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1662 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:50.099022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:50.099445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1662 sessionId:  describe result for acl check
2025-09-30T14:54:50.099493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:50.099498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:50.099500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:50.099506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895834248385422:10096] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:50.099932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895834248385422:10096] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:50.102733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895834248385422:10096] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:50.105817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895834248385422:10096] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:50.105827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895834248385422:10096] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:50.105829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895834248385422:10096] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:50.105834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1662 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:50.108744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:50.111118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:50.111327Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:50.111336Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:50.111346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:50.111403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:50.111443Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895834158623208:9701]
2025-09-30T14:54:50.112113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:50.112384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:50.112422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:50.112736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:50.112790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:50.112796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:50.112797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:50.112798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:50.112799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:50.112800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:50.112802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:50.112803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:50.112804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:50.112805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:50.112806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.112807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.112808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.112809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:50.112811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:50.112815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:50.112826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:50.112830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:50.112834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:50.112838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:50.112842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:50.112846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:50.112850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:50.112854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:50.112865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:50.112869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.112873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.112877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.112881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:50.112885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:50.112892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:50.112900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:50.112910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:50.112916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:50.112921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:50.112926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:50.112930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:50.112935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:50.112944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:50.112949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:50.112959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:50.112968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:50.112977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:50.112986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:50.112991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:50.112996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:50.113004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:50.113014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:50.113022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:50.113030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:50.113038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.113043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.113048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.113053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.113061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.113066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.113073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:50.113078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:50.113086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:50.113091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:50.113138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:50.118551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:50.119463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:50.119474Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:50.119476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:50.119478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:50.119483Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1661 [2:7555895834158623208:9701]
2025-09-30T14:54:50.119495Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:50.119505Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:50.119507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:50.119509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:50.119510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:50.119523Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:50.119527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:50.119532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:50.119573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.119579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.119581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.119583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:50.119585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:50.119635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:50.119640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.119648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.119654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.119668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:50.119681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895834248385623:10096], now have 1 active actors on pipe
2025-09-30T14:54:50.119686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895834158623203:9701]
2025-09-30T14:54:50.119688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895834158623203:9701]
2025-09-30T14:54:50.119690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895834158623203:9701]
2025-09-30T14:54:50.119699Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:50.119707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895834248385333:2454], now have 1 active actors on pipe
2025-09-30T14:54:50.119712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:50.119720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:50.119720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:50.119722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:50.119724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:50.119726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:50.119744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895834158623203:9701]
2025-09-30T14:54:50.119746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:50.119750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:50.119869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1661
2025-09-30T14:54:50.119915Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1661
2025-09-30T14:54:50.119991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:50.120006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:50.120037Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e729d500-9dd44368-30329070-cb577de0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:50.120050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:50.120059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:50.120062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:50.120073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:50.120089Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:50.120108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:50.120381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:50.120390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:50.120408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:50.120506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1662 partition: 0 MaxSeqNo: 42 sessionId: src_id|e729d500-9dd44368-30329070-cb577de0_0
2025-09-30T14:54:50.120866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74f3bc8d-d4def3ab-4d7d3656-2b2607e5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e729d500-9dd44368-30329070-cb577de0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:50.123560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e729d500-9dd44368-30329070-cb577de0_0] Write session: try to update token
2025-09-30T14:54:50.123585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e729d500-9dd44368-30329070-cb577de0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:50.131901Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:50.131918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:50.131920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:50.131922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:50.131931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895834158623203:9701]
2025-09-30T14:54:50.131936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895834158623203:9701]
2025-09-30T14:54:50.131940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895834158623203:9701]
2025-09-30T14:54:50.131978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:50.131972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:50.131984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.131987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:50.131987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:50.131990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:50.132131Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:50.137835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1662 sessionId: src_id|e729d500-9dd44368-30329070-cb577de0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:50.140358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:50.190014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895834248385673:9749]
2025-09-30T14:54:50.190326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1661, pipe: [1:7555895834248385673:9749]
2025-09-30T14:54:50.234433Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:50.234731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:50.234747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:50.234780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895834248385673:9749], now have 1 active actors on pipe
2025-09-30T14:54:50.234984Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:50.235098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:50.235106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895834248385673:9749]
2025-09-30T14:54:50.235114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:50.235128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:50.235189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1662 reason: error at write: Disconnected sessionId: src_id|e729d500-9dd44368-30329070-cb577de0_0
2025-09-30T14:54:50.235363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1662 sessionId: src_id|e729d500-9dd44368-30329070-cb577de0_0 is DEAD
2025-09-30T14:54:50.235493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e729d500-9dd44368-30329070-cb577de0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:50.235504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e729d500-9dd44368-30329070-cb577de0_0] Write session will restart in 0.005175s
2025-09-30T14:54:50.235521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e729d500-9dd44368-30329070-cb577de0_0] Write session: Do CDS request
2025-09-30T14:54:50.235525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e729d500-9dd44368-30329070-cb577de0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:50.241658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e729d500-9dd44368-30329070-cb577de0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:50.241771Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:50.241784Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1663
2025-09-30T14:54:50.241879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1663 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:50.241909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1663 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:50.241919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1663 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:50.241922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:50.242346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1663 sessionId:  describe result for acl check
2025-09-30T14:54:50.242381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:50.242388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:50.242389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:50.242395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895834248385717:10100] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:50.242918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895834248385717:10100] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:50.245097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895834248385717:10100] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:50.247997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895834248385717:10100] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:50.248013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895834248385717:10100] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:50.248016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895834248385717:10100] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:50.248023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1663 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:50.250501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:50.252302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:50.252474Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:50.252481Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:50.252489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:50.252535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:50.252572Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895834158623455:9703]
2025-09-30T14:54:50.253190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:50.253406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:50.253442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:50.253759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:50.253818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:50.253824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:50.253825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:50.253826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:50.253827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:50.253829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:50.253830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:50.253832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:50.253833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:50.253834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:50.253836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.253837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.253838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.253839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:50.253840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:50.253845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:50.253856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:50.253860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:50.253864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:50.253868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:50.253872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:50.253876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:50.253880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:50.253885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:50.253889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:50.253893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.253902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.253906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.253914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:50.253918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:50.253924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:50.253934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:50.253944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:50.253954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:50.253963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:50.253972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:50.253977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:50.253986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:50.253991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:50.253996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:50.254005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:50.254010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:50.254019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:50.254024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:50.254033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:50.254038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:50.254043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:50.254048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:50.254053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:50.254063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:50.254071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.254081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.254089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.254098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.254103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.254107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.254116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:50.254125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:50.254133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:50.254138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:50.254186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:50.259584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:50.260453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:50.260469Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:50.260472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:50.260475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:50.260481Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1662 [2:7555895834158623455:9703]
2025-09-30T14:54:50.260496Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:50.260510Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:50.260512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:50.260515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:50.260517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:50.260533Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:50.260545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:50.260555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:50.260615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.260623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.260625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.260629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:50.260631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:50.260693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:50.260700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.260713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.260729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.260752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:50.260772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895834248385961:10100], now have 1 active actors on pipe
2025-09-30T14:54:50.260780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895834248385674:2454], now have 1 active actors on pipe
2025-09-30T14:54:50.260786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895834158623450:9703]
2025-09-30T14:54:50.260793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895834158623450:9703]
2025-09-30T14:54:50.260795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895834158623450:9703]
2025-09-30T14:54:50.260805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:50.260819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:50.260822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:50.260825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:50.260831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:50.260833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:50.260834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:50.260852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895834158623450:9703]
2025-09-30T14:54:50.260858Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:50.260873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:50.260882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:50.260845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1662
2025-09-30T14:54:50.260886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:50.260858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1662
2025-09-30T14:54:50.260908Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87d74586-1fdf0cca-9628a8ab-6be735fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:50.260917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:50.260921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:50.260926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:50.260933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:50.260944Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:50.260960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:50.261133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:50.261143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:50.261154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:50.261260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1663 partition: 0 MaxSeqNo: 42 sessionId: src_id|87d74586-1fdf0cca-9628a8ab-6be735fe_0
2025-09-30T14:54:50.261581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e729d500-9dd44368-30329070-cb577de0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|87d74586-1fdf0cca-9628a8ab-6be735fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:50.264230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87d74586-1fdf0cca-9628a8ab-6be735fe_0] Write session: try to update token
2025-09-30T14:54:50.264249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87d74586-1fdf0cca-9628a8ab-6be735fe_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:50.278148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1663 sessionId: src_id|87d74586-1fdf0cca-9628a8ab-6be735fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:50.279807Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:50.279826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:50.279836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895834158623450:9703]
2025-09-30T14:54:50.279889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:50.279892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:50.280077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:50.280229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:50.280377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:50.280518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:50.280736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:50.280779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:50.280818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:50.281026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:50.281040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:50.281065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:50.281153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:50.284265Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:50.284282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:50.284284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:50.284286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:50.284295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895834158623450:9703]
2025-09-30T14:54:50.284299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895834158623450:9703]
2025-09-30T14:54:50.284302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895834158623450:9703]
2025-09-30T14:54:50.284336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:50.284343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.284345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:50.284344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:50.284350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:50.284353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:50.284473Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:50.335432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895834248386006:9749]
2025-09-30T14:54:50.335740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1662, pipe: [1:7555895834248386006:9749]
2025-09-30T14:54:50.394285Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:50.402188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:50.402208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:50.402365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:50.402426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:50.402490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:50.402566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:50.402614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:50.402622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:50.402685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:50.402738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:50.402805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:50.402871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:50.402917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:50.402924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:50.402985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:50.403047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:50.403111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:50.403169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:50.403211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:50.403217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:50.403301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:50.403356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:50.403420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:50.403485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:50.403527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:50.403534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:50.403602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:50.403667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:50.403766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:50.403833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:50.403881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:50.403884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:50.403952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:50.404016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:50.404077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:50.404139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:50.404180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:50.404186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:50.404246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:50.404308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:50.404372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:50.404439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:50.404482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:50.404491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:50.404560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:50.404620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:50.404679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:50.404736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:50.404776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:50.404782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:50.404847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:50.404904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:50.404963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:50.405021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:50.405068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:50.405075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:50.405138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:50.405192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:50.405248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:50.405304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:50.405356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:50.405362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:50.405415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895834248386006:9749], now have 1 active actors on pipe
2025-09-30T14:54:50.405691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895834248386006:9749]
2025-09-30T14:54:50.405724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:50.405728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:50.405747Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:50.405771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1663 reason: error at write: Disconnected sessionId: src_id|87d74586-1fdf0cca-9628a8ab-6be735fe_0
2025-09-30T14:54:50.406007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1663 sessionId: src_id|87d74586-1fdf0cca-9628a8ab-6be735fe_0 is DEAD
2025-09-30T14:54:50.406134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d74586-1fdf0cca-9628a8ab-6be735fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:50.406145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d74586-1fdf0cca-9628a8ab-6be735fe_0] Write session will restart in 0.008320s
2025-09-30T14:54:50.406169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d74586-1fdf0cca-9628a8ab-6be735fe_0] Write session: Do CDS request
2025-09-30T14:54:50.406174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d74586-1fdf0cca-9628a8ab-6be735fe_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:50.406396Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:50.415678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87d74586-1fdf0cca-9628a8ab-6be735fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:50.415808Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:50.415825Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1664
2025-09-30T14:54:50.415946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1664 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:50.415977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1664 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:50.415986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1664 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:50.415990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:50.416396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1664 sessionId:  describe result for acl check
2025-09-30T14:54:50.416428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:50.416433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:50.416435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:50.416439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895834248386155:10104] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:50.416913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895834248386155:10104] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:50.419085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895834248386155:10104] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:50.422121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895834248386155:10104] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:50.422138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895834248386155:10104] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:50.422142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895834248386155:10104] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:50.422150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1664 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:50.424024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:50.426070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:50.426226Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:50.426236Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:50.426246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:50.426288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:50.426340Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895834158623705:9706]
2025-09-30T14:54:50.426910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:50.427202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:50.427260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:50.427561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:50.427609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:50.427616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:50.427616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:50.427617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:50.427618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:50.427619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:50.427620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:50.427621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:50.427622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:50.427622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:50.427623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.427624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.427625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.427625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:50.427626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:50.427629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:50.427636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:50.427639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:50.427641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:50.427644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:50.427646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:50.427648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:50.427651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:50.427653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:50.427656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:50.427658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.427661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.427663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.427667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:50.427671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:50.427678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:50.427684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:50.427690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:50.427695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:50.427700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:50.427704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:50.427709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:50.427714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:50.427719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:50.427725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:50.427729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:50.427735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:50.427741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:50.427747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:50.427752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:50.427757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:50.427761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:50.427766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:50.427771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:50.427777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:50.427783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.427789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.427793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.427799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.427803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.427808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.427812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:50.427817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:50.427819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:50.427822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:50.427846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:50.433071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:50.433853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:50.433865Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:50.433867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:50.433870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:50.433875Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1663 [2:7555895834158623705:9706]
2025-09-30T14:54:50.433887Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:50.433899Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:50.433905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:50.433907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:50.433909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:50.433921Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:50.433927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:50.433935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:50.433979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.433985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.433986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.433989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:50.433991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:50.434046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:50.434051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.434059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.434066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.434083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:50.434097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895834248386326:10104], now have 1 active actors on pipe
2025-09-30T14:54:50.434100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895834248386007:2454], now have 1 active actors on pipe
2025-09-30T14:54:50.434105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895834158623700:9706]
2025-09-30T14:54:50.434107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895834158623700:9706]
2025-09-30T14:54:50.434108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895834158623700:9706]
2025-09-30T14:54:50.434118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:50.434128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:50.434130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:50.434132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:50.434134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:50.434137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:50.434139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:50.434164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895834158623700:9706]
2025-09-30T14:54:50.434173Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:50.434180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:50.434192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1663
2025-09-30T14:54:50.434207Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1663
2025-09-30T14:54:50.434278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:50.434293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:50.434327Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1aace40-55dac98-3d6a8d47-c045eb6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:50.434340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:50.434361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:50.434367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:50.434377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:50.434393Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:50.434414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:50.434552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:50.434559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:50.434579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:50.434670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1664 partition: 0 MaxSeqNo: 42 sessionId: src_id|c1aace40-55dac98-3d6a8d47-c045eb6_0
2025-09-30T14:54:50.435020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d74586-1fdf0cca-9628a8ab-6be735fe_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c1aace40-55dac98-3d6a8d47-c045eb6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:50.437644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1aace40-55dac98-3d6a8d47-c045eb6_0] Write session: try to update token
2025-09-30T14:54:50.437661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1aace40-55dac98-3d6a8d47-c045eb6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:50.446343Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:50.446365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:50.446376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895834158623700:9706]
2025-09-30T14:54:50.446426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:50.446433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:50.446648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:50.446813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:50.446975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:50.447124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:50.447374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:50.447424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:50.451985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1664 sessionId: src_id|c1aace40-55dac98-3d6a8d47-c045eb6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:50.454592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:50.455099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:50.455120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:50.455151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:50.455279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:50.456419Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:50.456434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:50.456436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:50.456437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:50.456445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895834158623700:9706]
2025-09-30T14:54:50.456448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895834158623700:9706]
2025-09-30T14:54:50.456452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895834158623700:9706]
2025-09-30T14:54:50.456486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:50.456491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:50.456496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:50.456499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.456502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:50.456503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:50.456623Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:50.505948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895834248386341:9749]
2025-09-30T14:54:50.506273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1663, pipe: [1:7555895834248386341:9749]
2025-09-30T14:54:50.569076Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:50.577283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:50.577315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:50.577478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:50.577551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:50.577621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:50.577690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:50.577748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:50.577757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:50.577834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:50.577924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:50.577990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:50.578064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:50.578108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:50.578114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:50.578181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:50.578238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:50.578299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:50.578509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:50.578561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:50.578569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:50.578635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:50.578702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:50.578762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:50.578821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:50.578875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:50.578883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:50.578950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:50.579007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:50.579107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:50.579173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:50.579216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:50.579222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:50.579329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:50.579390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:50.579453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:50.579513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:50.579557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:50.579566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:50.579643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:50.579702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:50.579773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:50.579835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:50.579891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:50.579894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:50.579965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:50.580029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:50.580095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:50.580172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:50.580217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:50.580225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:50.580295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:50.580362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:50.580428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:50.580495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:50.580540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:50.580548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:50.580613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:50.580675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:50.580738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:50.580815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:50.580864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:50.580871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:50.580941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895834248386341:9749], now have 1 active actors on pipe
2025-09-30T14:54:50.581369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:50.581433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895834248386341:9749]
2025-09-30T14:54:50.581465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:50.581468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:50.581497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1664 reason: error at write: Disconnected sessionId: src_id|c1aace40-55dac98-3d6a8d47-c045eb6_0
2025-09-30T14:54:50.581692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1664 sessionId: src_id|c1aace40-55dac98-3d6a8d47-c045eb6_0 is DEAD
2025-09-30T14:54:50.581851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1aace40-55dac98-3d6a8d47-c045eb6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:50.581862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1aace40-55dac98-3d6a8d47-c045eb6_0] Write session will restart in 0.006127s
2025-09-30T14:54:50.581887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1aace40-55dac98-3d6a8d47-c045eb6_0] Write session: Do CDS request
2025-09-30T14:54:50.581892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1aace40-55dac98-3d6a8d47-c045eb6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:50.582230Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:50.588835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1aace40-55dac98-3d6a8d47-c045eb6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:50.588956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:50.588974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1665
2025-09-30T14:54:50.589109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1665 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:50.589144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1665 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:50.589153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1665 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:50.589158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:50.589631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1665 sessionId:  describe result for acl check
2025-09-30T14:54:50.589665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:50.589671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:50.589673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:50.589678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895834248386388:10109] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:50.590235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895834248386388:10109] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:50.593021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895834248386388:10109] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:50.596008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895834248386388:10109] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:50.596030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895834248386388:10109] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:50.596033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895834248386388:10109] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:50.596042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1665 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:50.601377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:50.603701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:50.603996Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:50.604017Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:50.604029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:50.604088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:50.604128Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895834158623966:9709]
2025-09-30T14:54:50.604799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:50.605123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:50.605172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:50.605506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:50.605574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:50.605582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:50.605583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:50.605584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:50.605585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:50.605586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:50.605587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:50.605589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:50.605590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:50.605591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:50.605592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.605593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.605594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.605595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:50.605596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:50.605601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:50.605612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:50.605616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:50.605621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:50.605625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:50.605629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:50.605633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:50.605637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:50.605641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:50.605645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:50.605649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.605654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.605658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.605661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:50.605665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:50.605673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:50.605681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:50.605687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:50.605693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:50.605697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:50.605703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:50.605707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:50.605725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:50.605738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:50.605744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:50.605749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:50.605755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:50.605760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:50.605766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:50.605770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:50.605776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:50.605781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:50.605786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:50.605791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:50.605796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:50.605801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.605806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.605812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.605817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.605822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.605827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.605831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:50.605837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:50.605844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:50.605854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:50.605902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:50.611755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:50.613063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:50.613078Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:50.613079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:50.613082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:50.613087Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1664 [2:7555895834158623966:9709]
2025-09-30T14:54:50.613100Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:50.613113Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:50.613115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:50.613117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:50.613118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:50.613131Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:50.613136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:50.613141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:50.613187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.613193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.613195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.613199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:50.613201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:50.613271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:50.613283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.613294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.613308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.613328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:50.613350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895834158623961:9709]
2025-09-30T14:54:50.613355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895834158623961:9709]
2025-09-30T14:54:50.613357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895834158623961:9709]
2025-09-30T14:54:50.613364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:50.613376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:50.613376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:50.613379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:50.613382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:50.613509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1664
2025-09-30T14:54:50.613610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1664
2025-09-30T14:54:50.613391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:50.613399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:50.613411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895834248386354:2454], now have 1 active actors on pipe
2025-09-30T14:54:50.613415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895834248386574:10109], now have 1 active actors on pipe
2025-09-30T14:54:50.613446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895834158623961:9709]
2025-09-30T14:54:50.613452Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:50.613507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:50.613623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:50.613628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:50.613651Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9886facb-2c570098-7abc45a4-132becc8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:50.613657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:50.613660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:50.613661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:50.613669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:50.613678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:50.613688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:50.613878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:50.613888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:50.613902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:50.614000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1665 partition: 0 MaxSeqNo: 42 sessionId: src_id|9886facb-2c570098-7abc45a4-132becc8_0
2025-09-30T14:54:50.614375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1aace40-55dac98-3d6a8d47-c045eb6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9886facb-2c570098-7abc45a4-132becc8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:50.617354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9886facb-2c570098-7abc45a4-132becc8_0] Write session: try to update token
2025-09-30T14:54:50.617376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9886facb-2c570098-7abc45a4-132becc8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:50.626496Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:50.626524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:50.626527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:50.626529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:50.626542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895834158623961:9709]
2025-09-30T14:54:50.626548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895834158623961:9709]
2025-09-30T14:54:50.626554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895834158623961:9709]
2025-09-30T14:54:50.626608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:50.626608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:50.626617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:50.626617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.626621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:50.626621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:50.626807Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:50.634733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1665 sessionId: src_id|9886facb-2c570098-7abc45a4-132becc8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:50.637424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:50.681581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895834248386691:9749]
2025-09-30T14:54:50.681983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1664, pipe: [1:7555895834248386691:9749]
2025-09-30T14:54:50.753704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:50.753771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895834248386691:9749]
2025-09-30T14:54:50.753792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:50.753862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1665 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9886facb-2c570098-7abc45a4-132becc8_0
2025-09-30T14:54:50.754059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1665 sessionId: src_id|9886facb-2c570098-7abc45a4-132becc8_0 is DEAD
2025-09-30T14:54:50.754453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9886facb-2c570098-7abc45a4-132becc8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:50.754466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9886facb-2c570098-7abc45a4-132becc8_0] Write session will restart in 0.007218s
2025-09-30T14:54:50.754492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9886facb-2c570098-7abc45a4-132becc8_0] Write session: Do CDS request
2025-09-30T14:54:50.754498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9886facb-2c570098-7abc45a4-132becc8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:50.752991Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:50.753349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:50.753358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:50.753379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895834248386691:9749], now have 1 active actors on pipe
2025-09-30T14:54:50.753625Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:50.764264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9886facb-2c570098-7abc45a4-132becc8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:50.764535Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:50.764560Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1666
2025-09-30T14:54:50.767520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1666 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:50.767571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1666 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:50.767578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1666 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:50.767582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:50.768414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1666 sessionId:  describe result for acl check
2025-09-30T14:54:50.768452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:50.768455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:50.768456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:50.768462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895834248386787:10114] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:50.769039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895834248386787:10114] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:50.774500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895834248386787:10114] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:50.781128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895834248386787:10114] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:50.781147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895834248386787:10114] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:50.781150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895834248386787:10114] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:50.781161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1666 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:50.789303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:50.792378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:50.792629Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:50.792639Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:50.792652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:50.792717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:50.792765Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895834158624218:9711]
2025-09-30T14:54:50.793466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:50.793925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:50.793987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:50.794352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:50.794431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:50.794437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:50.794439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:50.794440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:50.794442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:50.794443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:50.794444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:50.794446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:50.794447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:50.794449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:50.794449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.794451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.794452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.794453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:50.794454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:50.794460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:50.794471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:50.794476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:50.794479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:50.794483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:50.794486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:50.794491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:50.794495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:50.794499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:50.794503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:50.794507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.794510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.794513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.794517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:50.794520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:50.794530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:50.794537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:50.794543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:50.794549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:50.794553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:50.794560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:50.794564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:50.794569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:50.794575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:50.794580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:50.794584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:50.794592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:50.794597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:50.794604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:50.794615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:50.794620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:50.794631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:50.794637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:50.794644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:50.794650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:50.794655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.794665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.794670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.794681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.794686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.794691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.794701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:50.794706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:50.794712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:50.794735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:50.794782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:50.803026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1665
2025-09-30T14:54:50.803071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1665
2025-09-30T14:54:50.800846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:50.802207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:50.802214Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:50.802217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:50.802221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:50.802228Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1665 [2:7555895834158624218:9711]
2025-09-30T14:54:50.802244Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:50.802260Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:50.802263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:50.802266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:50.802268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:50.802283Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:50.802291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:50.802298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:50.802355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.802357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.802361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.802364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:50.802366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:50.802429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:50.802432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.802447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.802460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.802478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:50.802495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895834158624213:9711]
2025-09-30T14:54:50.802498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895834158624213:9711]
2025-09-30T14:54:50.802500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895834158624213:9711]
2025-09-30T14:54:50.802514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:50.802527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:50.802541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:50.802544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:50.802574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:50.802578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895834158624213:9711]
2025-09-30T14:54:50.802578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:50.802581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:50.802581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:50.802587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:50.802732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895834248386957:10114], now have 1 active actors on pipe
2025-09-30T14:54:50.802738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895834248386692:2454], now have 1 active actors on pipe
2025-09-30T14:54:50.803163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:50.803169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:50.803206Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3158eecb-b13c4a19-a6b8f2f5-931f44e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:50.803215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:50.803220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:50.803223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:50.803233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:50.803258Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:50.803274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:50.803617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:50.803621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:50.803639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:50.804258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9886facb-2c570098-7abc45a4-132becc8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3158eecb-b13c4a19-a6b8f2f5-931f44e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:50.803776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1666 partition: 0 MaxSeqNo: 42 sessionId: src_id|3158eecb-b13c4a19-a6b8f2f5-931f44e7_0
2025-09-30T14:54:50.808456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3158eecb-b13c4a19-a6b8f2f5-931f44e7_0] Write session: try to update token
2025-09-30T14:54:50.808488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3158eecb-b13c4a19-a6b8f2f5-931f44e7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:50.824707Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:50.824733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:50.824746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895834158624213:9711]
2025-09-30T14:54:50.824799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:50.825046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:50.825129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:50.825317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:50.825474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:50.825627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:50.825863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:50.825911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:50.835138Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:50.835156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:50.835159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:50.835161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:50.835171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895834158624213:9711]
2025-09-30T14:54:50.835176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895834158624213:9711]
2025-09-30T14:54:50.835181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895834158624213:9711]
2025-09-30T14:54:50.835226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:50.835232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.835234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:50.835352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:50.835359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:50.835364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:50.835401Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:50.835945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1666 sessionId: src_id|3158eecb-b13c4a19-a6b8f2f5-931f44e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:50.838901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:50.853591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895834248387028:9749]
2025-09-30T14:54:50.854068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1665, pipe: [1:7555895834248387028:9749]
2025-09-30T14:54:50.951100Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:50.951493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:50.951508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:50.951540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895834248387028:9749], now have 1 active actors on pipe
2025-09-30T14:54:50.952000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895834248387028:9749]
2025-09-30T14:54:50.952037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:50.952040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:50.952108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1666 reason: error at write: Disconnected sessionId: src_id|3158eecb-b13c4a19-a6b8f2f5-931f44e7_0
2025-09-30T14:54:50.952303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1666 sessionId: src_id|3158eecb-b13c4a19-a6b8f2f5-931f44e7_0 is DEAD
2025-09-30T14:54:50.952439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:50.951954Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:50.952797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3158eecb-b13c4a19-a6b8f2f5-931f44e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:50.952807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3158eecb-b13c4a19-a6b8f2f5-931f44e7_0] Write session will restart in 0.009604s
2025-09-30T14:54:50.952832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3158eecb-b13c4a19-a6b8f2f5-931f44e7_0] Write session: Do CDS request
2025-09-30T14:54:50.952840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3158eecb-b13c4a19-a6b8f2f5-931f44e7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:50.971785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3158eecb-b13c4a19-a6b8f2f5-931f44e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:50.975646Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:50.975667Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1667
2025-09-30T14:54:50.975845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1667 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:50.975877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1667 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:50.975883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1667 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:50.975888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:50.976709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1667 sessionId:  describe result for acl check
2025-09-30T14:54:50.976742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:50.976744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:50.976746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:50.976753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895834248387159:10118] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:50.977367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895834248387159:10118] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:50.979568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895834248387159:10118] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:50.987877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895834248387159:10118] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:50.987896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895834248387159:10118] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:50.987900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895834248387159:10118] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:50.987909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1667 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:50.994842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:50.996731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:50.996950Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:50.996954Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:50.996967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:50.997032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:50.997070Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895834158624472:9714]
2025-09-30T14:54:50.997748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:50.998114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:50.998171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:50.998515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:50.998587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:50.998589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:50.998590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:50.998592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:50.998593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:50.998595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:50.998596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:50.998598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:50.998599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:50.998600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:50.998602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.998603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.998604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.998605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:50.998607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:50.998613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:50.998625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:50.998629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:50.998634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:50.998639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:50.998643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:50.998647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:50.998652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:50.998656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:50.998663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:50.998667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.998670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.998674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.998678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:50.998682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:50.998692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:50.998702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:50.998708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:50.998714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:50.998720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:50.998726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:50.998731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:50.998736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:50.998742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:50.998747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:50.998752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:50.998758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:50.998763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:50.998769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:50.998775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:50.998781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:50.998787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:50.998794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:50.998798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:50.998804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:50.998810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.998815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:50.998820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.998826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:50.998831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.998836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:50.998840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:50.998846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:50.998852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:50.998858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:50.998907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:51.005631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:51.006537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:51.006544Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:51.006548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:51.006553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:51.006562Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1666 [2:7555895834158624472:9714]
2025-09-30T14:54:51.006582Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:51.006599Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:51.006603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:51.006608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:51.006610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:51.006630Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:51.006637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:51.006644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:51.006905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.006909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:51.006911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:51.006915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:51.006919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:51.007000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:51.007004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.007020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:51.007034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:51.007054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:51.007073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895834158624467:9714]
2025-09-30T14:54:51.007075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895834158624467:9714]
2025-09-30T14:54:51.007077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895834158624467:9714]
2025-09-30T14:54:51.007095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:51.007110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895834248387308:10118], now have 1 active actors on pipe
2025-09-30T14:54:51.007114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895834248387034:2454], now have 1 active actors on pipe
2025-09-30T14:54:51.007124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:51.007141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:51.007144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:51.007180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895834158624467:9714]
2025-09-30T14:54:51.007183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:51.007282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:51.007286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:51.007288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:51.007298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:51.008601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:51.008630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:51.008659Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7621ffd-1e9141b0-fb72a5ae-e8d8f692_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:51.008675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:51.008679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:51.008682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:51.008692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:51.008706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:51.008728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:51.008894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:51.008905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:51.008922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:51.009414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3158eecb-b13c4a19-a6b8f2f5-931f44e7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b7621ffd-1e9141b0-fb72a5ae-e8d8f692_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:51.008332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1666
2025-09-30T14:54:51.008384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1666
2025-09-30T14:54:51.009014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1667 partition: 0 MaxSeqNo: 42 sessionId: src_id|b7621ffd-1e9141b0-fb72a5ae-e8d8f692_0
2025-09-30T14:54:51.012521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7621ffd-1e9141b0-fb72a5ae-e8d8f692_0] Write session: try to update token
2025-09-30T14:54:51.012542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7621ffd-1e9141b0-fb72a5ae-e8d8f692_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:51.027005Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:51.027027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:51.027029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:51.027032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:51.027044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895834158624467:9714]
2025-09-30T14:54:51.027048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895834158624467:9714]
2025-09-30T14:54:51.027053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895834158624467:9714]
2025-09-30T14:54:51.027097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:51.027104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.027108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:51.027116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:51.027124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:51.027128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:51.027283Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:51.040581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1667 sessionId: src_id|b7621ffd-1e9141b0-fb72a5ae-e8d8f692_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:51.043529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:51.051681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895838543354680:9749]
2025-09-30T14:54:51.052097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1666, pipe: [1:7555895838543354680:9749]
2025-09-30T14:54:51.148725Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:51.149154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:51.149173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:51.149227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895838543354680:9749], now have 1 active actors on pipe
2025-09-30T14:54:51.149461Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:51.150116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7621ffd-1e9141b0-fb72a5ae-e8d8f692_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:51.150136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7621ffd-1e9141b0-fb72a5ae-e8d8f692_0] Write session will restart in 0.007823s
2025-09-30T14:54:51.149518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895838543354680:9749]
2025-09-30T14:54:51.150181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7621ffd-1e9141b0-fb72a5ae-e8d8f692_0] Write session: Do CDS request
2025-09-30T14:54:51.149571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:51.149645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1667 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b7621ffd-1e9141b0-fb72a5ae-e8d8f692_0
2025-09-30T14:54:51.149883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1667 sessionId: src_id|b7621ffd-1e9141b0-fb72a5ae-e8d8f692_0 is DEAD
2025-09-30T14:54:51.150190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7621ffd-1e9141b0-fb72a5ae-e8d8f692_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:51.150101Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:51.158974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7621ffd-1e9141b0-fb72a5ae-e8d8f692_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:51.159042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:51.159061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1668
2025-09-30T14:54:51.159213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1668 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:51.159268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1668 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:51.159280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1668 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:51.159284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:51.160461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1668 sessionId:  describe result for acl check
2025-09-30T14:54:51.160498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:51.160502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:51.160504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:51.160509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895838543354716:10130] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:51.161090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895838543354716:10130] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:51.163455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895838543354716:10130] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:51.174174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895838543354716:10130] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:51.174196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895838543354716:10130] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:51.174201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895838543354716:10130] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:51.174210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1668 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:51.183509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:51.186365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:51.186654Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:51.186668Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:51.186683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:51.186752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:51.186811Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895838453592057:9728]
2025-09-30T14:54:51.187733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:51.188205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:51.188275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:51.188932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:51.189042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:51.189044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:51.189046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:51.189047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:51.189049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:51.189050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:51.189052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:51.189054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:51.189055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:51.189057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:51.189059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.189060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:51.189061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:51.189063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:51.189064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:51.189071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:51.189083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:51.189088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:51.189092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:51.189097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:51.189101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:51.189105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:51.189109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:51.189113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:51.189497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:51.189513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.189517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:51.189522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:51.189526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:51.189532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:51.189546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:51.189556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:51.189564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:51.189569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:51.189575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:51.189580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:51.189585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:51.189591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:51.189598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:51.189605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:51.189611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:51.189634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:51.189642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:51.189649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:51.189655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:51.189662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:51.189669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:51.189675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:51.189680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:51.189686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:51.189696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.189701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.189706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:51.189712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:51.189719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:51.189725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:51.189743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:51.189750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:51.189761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:51.190125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:51.190185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:51.197848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:51.198915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:51.198938Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:51.198942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:51.198947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:51.198956Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1667 [2:7555895838453592057:9728]
2025-09-30T14:54:51.198978Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:51.199000Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:51.199004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:51.199008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:51.199011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:51.199034Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:51.199049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:51.199062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:51.199145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.199154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:51.199157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:51.199162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:51.199166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:51.199521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1667
2025-09-30T14:54:51.199521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1667
2025-09-30T14:54:51.199282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:51.199292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.199310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:51.199323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:51.199340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:51.199363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895838453592052:9728]
2025-09-30T14:54:51.199366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895838453592052:9728]
2025-09-30T14:54:51.199368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895838453592052:9728]
2025-09-30T14:54:51.199379Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:51.199399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:51.199399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:51.199405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:51.199407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:51.199417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:51.199421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:51.199435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895838543354700:2454], now have 1 active actors on pipe
2025-09-30T14:54:51.199440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895838543354887:10130], now have 1 active actors on pipe
2025-09-30T14:54:51.199486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895838453592052:9728]
2025-09-30T14:54:51.199499Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:51.199510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:51.199959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:51.199972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:51.200010Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|504c488b-38a7bc66-c7d35c98-7959445c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:51.200027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:51.200032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:51.200034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:51.200049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:51.200064Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:51.200083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:51.200359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:51.200369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:51.200391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:51.200518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1668 partition: 0 MaxSeqNo: 42 sessionId: src_id|504c488b-38a7bc66-c7d35c98-7959445c_0
2025-09-30T14:54:51.201031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7621ffd-1e9141b0-fb72a5ae-e8d8f692_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|504c488b-38a7bc66-c7d35c98-7959445c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:51.204554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|504c488b-38a7bc66-c7d35c98-7959445c_0] Write session: try to update token
2025-09-30T14:54:51.204578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|504c488b-38a7bc66-c7d35c98-7959445c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:51.217179Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:51.217205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:51.217209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:51.217213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:51.217226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895838453592052:9728]
2025-09-30T14:54:51.217232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895838453592052:9728]
2025-09-30T14:54:51.217237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895838453592052:9728]
2025-09-30T14:54:51.217291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:51.217292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:51.217301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.217301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:51.217304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:51.217306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:51.217492Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:51.226843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1668 sessionId: src_id|504c488b-38a7bc66-c7d35c98-7959445c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:51.230082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:51.249877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895838543355040:9749]
2025-09-30T14:54:51.250217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1667, pipe: [1:7555895838543355040:9749]
2025-09-30T14:54:51.333700Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:51.334561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:51.334586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:51.334617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895838543355040:9749], now have 1 active actors on pipe
2025-09-30T14:54:51.334833Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:51.334861Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:51.334894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895838543355040:9749]
2025-09-30T14:54:51.334922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:51.335000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1668 reason: status is not ok: tablet will be restarted right now sessionId: src_id|504c488b-38a7bc66-c7d35c98-7959445c_0
2025-09-30T14:54:51.335254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1668 sessionId: src_id|504c488b-38a7bc66-c7d35c98-7959445c_0 is DEAD
2025-09-30T14:54:51.335446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|504c488b-38a7bc66-c7d35c98-7959445c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:51.335457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|504c488b-38a7bc66-c7d35c98-7959445c_0] Write session will restart in 0.008308s
2025-09-30T14:54:51.335488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|504c488b-38a7bc66-c7d35c98-7959445c_0] Write session: Do CDS request
2025-09-30T14:54:51.335495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|504c488b-38a7bc66-c7d35c98-7959445c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:51.345111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|504c488b-38a7bc66-c7d35c98-7959445c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:51.345210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:51.345230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1669
2025-09-30T14:54:51.345480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1669 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:51.345528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1669 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:51.345539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1669 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:51.345544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:51.346065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1669 sessionId:  describe result for acl check
2025-09-30T14:54:51.346132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:51.346140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:51.346142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:51.346149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895838543355058:10134] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:51.346747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895838543355058:10134] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:51.349154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895838543355058:10134] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:51.352458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895838543355058:10134] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:51.352475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895838543355058:10134] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:51.352479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895838543355058:10134] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:51.352488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1669 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:51.362619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:51.365926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:51.366161Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:51.366174Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:51.366186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:51.366246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:51.366291Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895838453592312:9731]
2025-09-30T14:54:51.366976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:51.367303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:51.367351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:51.367683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:51.367755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:51.367764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:51.367766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:51.367767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:51.367768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:51.367770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:51.367771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:51.367773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:51.367774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:51.367776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:51.367777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.367779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:51.367780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:51.367782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:51.367783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:51.367789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:51.367801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:51.367805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:51.367810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:51.367814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:51.367819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:51.367823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:51.367828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:51.367832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:51.367837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:51.367841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.367845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:51.367850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:51.367855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:51.367859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:51.367868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:51.367877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:51.367883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:51.367889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:51.367894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:51.367900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:51.367906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:51.367912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:51.367918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:51.367924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:51.367928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:51.367941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:51.367947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:51.367959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:51.367964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:51.367970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:51.367981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:51.367986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:51.367992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:51.367998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:51.368008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.368014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.368019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:51.368025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:51.368036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:51.368042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:51.368046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:51.368054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:51.368063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:51.368069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:51.368120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:51.374180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:51.375069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:51.375089Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:51.375092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:51.375096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:51.375104Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1668 [2:7555895838453592312:9731]
2025-09-30T14:54:51.375126Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:51.375144Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:51.375147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:51.375151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:51.375154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:51.375168Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:51.375176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:51.375183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:51.375257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.375271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:51.375273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:51.375277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:51.375279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:51.375355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:51.375365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.375379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:51.375389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:51.375405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:51.375434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895838543355169:10134], now have 1 active actors on pipe
2025-09-30T14:54:51.375439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895838543355043:2454], now have 1 active actors on pipe
2025-09-30T14:54:51.375446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895838453592307:9731]
2025-09-30T14:54:51.375448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895838453592307:9731]
2025-09-30T14:54:51.375451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895838453592307:9731]
2025-09-30T14:54:51.375466Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:51.375485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:51.375490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:51.375491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:51.375492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:51.375505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:51.375508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:51.375541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895838453592307:9731]
2025-09-30T14:54:51.375559Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:51.375530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1668
2025-09-30T14:54:51.375534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1668
2025-09-30T14:54:51.375608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:51.375700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:51.375712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:51.375740Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41ea736b-43bf380e-89ab9c9c-28ac146d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:51.375751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:51.375756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:51.375759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:51.375771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:51.375786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:51.375805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:51.376029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:51.376039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:51.376055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:51.376157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1669 partition: 0 MaxSeqNo: 42 sessionId: src_id|41ea736b-43bf380e-89ab9c9c-28ac146d_0
2025-09-30T14:54:51.376647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|504c488b-38a7bc66-c7d35c98-7959445c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|41ea736b-43bf380e-89ab9c9c-28ac146d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:51.379882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41ea736b-43bf380e-89ab9c9c-28ac146d_0] Write session: try to update token
2025-09-30T14:54:51.379905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41ea736b-43bf380e-89ab9c9c-28ac146d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:51.389250Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:51.389275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:51.389280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:51.389282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:51.389296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895838453592307:9731]
2025-09-30T14:54:51.389304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895838453592307:9731]
2025-09-30T14:54:51.389311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895838453592307:9731]
2025-09-30T14:54:51.389358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:51.389363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:51.389365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:51.389371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.389370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:51.389373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:51.389578Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:51.395699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1669 sessionId: src_id|41ea736b-43bf380e-89ab9c9c-28ac146d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:51.398500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:51.435187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895838543355381:9749]
2025-09-30T14:54:51.435478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1668, pipe: [1:7555895838543355381:9749]
2025-09-30T14:54:51.498006Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:51.498667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:51.498680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:51.498711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895838543355381:9749], now have 1 active actors on pipe
2025-09-30T14:54:51.498874Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:51.498961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:51.498976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:51.499029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1669 reason: error at write: Disconnected sessionId: src_id|41ea736b-43bf380e-89ab9c9c-28ac146d_0
2025-09-30T14:54:51.499205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895838543355381:9749]
2025-09-30T14:54:51.499235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1669 sessionId: src_id|41ea736b-43bf380e-89ab9c9c-28ac146d_0 is DEAD
2025-09-30T14:54:51.499237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:51.499390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41ea736b-43bf380e-89ab9c9c-28ac146d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:51.499400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41ea736b-43bf380e-89ab9c9c-28ac146d_0] Write session will restart in 0.009659s
2025-09-30T14:54:51.499418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41ea736b-43bf380e-89ab9c9c-28ac146d_0] Write session: Do CDS request
2025-09-30T14:54:51.499423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41ea736b-43bf380e-89ab9c9c-28ac146d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:51.509805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41ea736b-43bf380e-89ab9c9c-28ac146d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:51.509858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:51.509875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1670
2025-09-30T14:54:51.510067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1670 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:51.510095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1670 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:51.510103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1670 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:51.510107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:51.510575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1670 sessionId:  describe result for acl check
2025-09-30T14:54:51.510619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:51.510627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:51.510629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:51.510635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895838543355492:10138] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:51.511211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895838543355492:10138] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:51.514298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895838543355492:10138] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:51.517507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895838543355492:10138] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:51.517525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895838543355492:10138] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:51.517528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895838543355492:10138] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:51.517537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1670 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:51.520070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:51.522737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:51.522971Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:51.522979Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:51.522990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:51.523040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:51.523083Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895838453592578:9734]
2025-09-30T14:54:51.523798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:51.524118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:51.524164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:51.524482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:51.524556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:51.524563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:51.524564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:51.524565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:51.524566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:51.524568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:51.524569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:51.524570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:51.524572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:51.524573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:51.524574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.524575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:51.524576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:51.524577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:51.524578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:51.524585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:51.524596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:51.524600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:51.524603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:51.524607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:51.524611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:51.524615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:51.524618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:51.524622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:51.524628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:51.524631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.524634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:51.524638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:51.524641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:51.524644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:51.524652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:51.524659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:51.524665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:51.524671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:51.524676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:51.524682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:51.524686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:51.524692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:51.524697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:51.524703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:51.524708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:51.524715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:51.524720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:51.524725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:51.524730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:51.524736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:51.524741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:51.524745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:51.524750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:51.524755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:51.524760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.524765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.524776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:51.524781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:51.524791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:51.524796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:51.524800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:51.524805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:51.524814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:51.524819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:51.524863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:51.531024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:51.531950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:51.531971Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:51.531974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:51.531977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:51.531984Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1669 [2:7555895838453592578:9734]
2025-09-30T14:54:51.532000Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:51.532015Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:51.532018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:51.532020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:51.532023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:51.532039Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:51.532061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:51.532068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:51.532135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.532143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:51.532146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:51.532149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:51.532152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:51.532232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:51.532246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.532258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:51.532289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:51.532322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:51.532357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895838543355676:10138], now have 1 active actors on pipe
2025-09-30T14:54:51.532365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895838543355383:2454], now have 1 active actors on pipe
2025-09-30T14:54:51.532371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895838453592573:9734]
2025-09-30T14:54:51.532375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895838453592573:9734]
2025-09-30T14:54:51.532378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895838453592573:9734]
2025-09-30T14:54:51.532398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:51.532422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:51.532433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:51.532399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1669
2025-09-30T14:54:51.532435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:51.532436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:51.532451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:51.532455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:51.532505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:51.532519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:51.532525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1669
2025-09-30T14:54:51.532533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895838453592573:9734]
2025-09-30T14:54:51.532547Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:51.532554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:51.532576Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9ffc98e-99c9ffea-20650ad8-e3598e9d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:51.532589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:51.532593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:51.532601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:51.532611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:51.532623Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:51.532657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:51.532822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:51.532830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:51.532844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:51.532943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1670 partition: 0 MaxSeqNo: 42 sessionId: src_id|d9ffc98e-99c9ffea-20650ad8-e3598e9d_0
2025-09-30T14:54:51.533361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41ea736b-43bf380e-89ab9c9c-28ac146d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d9ffc98e-99c9ffea-20650ad8-e3598e9d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:51.536110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9ffc98e-99c9ffea-20650ad8-e3598e9d_0] Write session: try to update token
2025-09-30T14:54:51.536127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9ffc98e-99c9ffea-20650ad8-e3598e9d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:51.545696Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:51.545711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:51.545714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:51.545717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:51.545739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895838453592573:9734]
2025-09-30T14:54:51.545744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895838453592573:9734]
2025-09-30T14:54:51.545749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895838453592573:9734]
2025-09-30T14:54:51.545788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:51.545795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.545798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:51.545801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:51.545807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:51.545814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:51.545941Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:51.550248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1670 sessionId: src_id|d9ffc98e-99c9ffea-20650ad8-e3598e9d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:51.553556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:51.599532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895838543355735:9749]
2025-09-30T14:54:51.599818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1669, pipe: [1:7555895838543355735:9749]
2025-09-30T14:54:51.662888Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:51.663788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:51.663805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:51.663842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895838543355735:9749], now have 1 active actors on pipe
2025-09-30T14:54:51.664042Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:51.664071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:51.664076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895838543355735:9749]
2025-09-30T14:54:51.664097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:51.664099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:51.664159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1670 reason: error at write: Disconnected sessionId: src_id|d9ffc98e-99c9ffea-20650ad8-e3598e9d_0
2025-09-30T14:54:51.664364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1670 sessionId: src_id|d9ffc98e-99c9ffea-20650ad8-e3598e9d_0 is DEAD
2025-09-30T14:54:51.664574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9ffc98e-99c9ffea-20650ad8-e3598e9d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:51.664587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9ffc98e-99c9ffea-20650ad8-e3598e9d_0] Write session will restart in 0.006748s
2025-09-30T14:54:51.664612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9ffc98e-99c9ffea-20650ad8-e3598e9d_0] Write session: Do CDS request
2025-09-30T14:54:51.664621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9ffc98e-99c9ffea-20650ad8-e3598e9d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:51.672773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9ffc98e-99c9ffea-20650ad8-e3598e9d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:51.672908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:51.672926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1671
2025-09-30T14:54:51.673058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1671 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:51.673092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1671 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:51.673103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1671 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:51.673107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:51.673513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1671 sessionId:  describe result for acl check
2025-09-30T14:54:51.673546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:51.673552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:51.673554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:51.673560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895838543355811:10144] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:51.674106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895838543355811:10144] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:51.676656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895838543355811:10144] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:51.679214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895838543355811:10144] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:51.679231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895838543355811:10144] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:51.679233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895838543355811:10144] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:51.679240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1671 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:51.682335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:51.684112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:51.684303Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:51.684314Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:51.684324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:51.684378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:51.684416Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895838453592833:9736]
2025-09-30T14:54:51.685077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:51.685407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:51.685452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:51.685798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:51.685865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:51.685872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:51.685873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:51.685874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:51.685876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:51.685877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:51.685878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:51.685879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:51.685880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:51.685881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:51.685882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.685883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:51.685884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:51.685885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:51.685886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:51.685891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:51.685902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:51.685907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:51.685912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:51.685917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:51.685921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:51.685926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:51.685930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:51.685935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:51.685945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:51.685953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.685962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:51.685970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:51.685974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:51.685983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:51.685991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:51.686004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:51.686011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:51.686025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:51.686031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:51.686037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:51.686041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:51.686047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:51.686052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:51.686057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:51.686062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:51.686068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:51.686073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:51.686079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:51.686088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:51.686098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:51.686108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:51.686115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:51.686124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:51.686133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:51.686143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.686148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.686153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:51.686162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:51.686171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:51.686180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:51.686188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:51.686195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:51.686203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:51.686213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:51.686266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:51.691538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:51.692483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:51.692499Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:51.692502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:51.692506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:51.692512Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1670 [2:7555895838453592833:9736]
2025-09-30T14:54:51.692529Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:51.692547Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:51.692550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:51.692553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:51.692556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:51.692571Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:51.692582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:51.692589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:51.692644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.692651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:51.692654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:51.692657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:51.692660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:51.692731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:51.692739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.692752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:51.692770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:51.692798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:51.692818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895838543355737:2454], now have 1 active actors on pipe
2025-09-30T14:54:51.692830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895838543356016:10144], now have 1 active actors on pipe
2025-09-30T14:54:51.692836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895838453592828:9736]
2025-09-30T14:54:51.692839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895838453592828:9736]
2025-09-30T14:54:51.692841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895838453592828:9736]
2025-09-30T14:54:51.692855Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:51.692869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:51.692873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:51.692876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:51.692877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:51.692890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:51.692893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:51.692858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1670
2025-09-30T14:54:51.692871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1670
2025-09-30T14:54:51.692937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:51.692947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:51.692959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895838453592828:9736]
2025-09-30T14:54:51.692968Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:51.692986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:51.693001Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|127962c3-87094211-72a9ee66-da2dc5a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:51.693007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:51.693015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:51.693017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:51.693027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:51.693040Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:51.693068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:51.693224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:51.693235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:51.693255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:51.693324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1671 partition: 0 MaxSeqNo: 42 sessionId: src_id|127962c3-87094211-72a9ee66-da2dc5a4_0
2025-09-30T14:54:51.693648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9ffc98e-99c9ffea-20650ad8-e3598e9d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|127962c3-87094211-72a9ee66-da2dc5a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:51.696290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|127962c3-87094211-72a9ee66-da2dc5a4_0] Write session: try to update token
2025-09-30T14:54:51.696310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|127962c3-87094211-72a9ee66-da2dc5a4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:51.704870Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:51.704892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:51.704895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:51.704897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:51.704907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895838453592828:9736]
2025-09-30T14:54:51.704912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895838453592828:9736]
2025-09-30T14:54:51.704917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895838453592828:9736]
2025-09-30T14:54:51.704958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:51.704963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:51.704965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.704969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:51.704971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:51.704975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:51.705102Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:51.711016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1671 sessionId: src_id|127962c3-87094211-72a9ee66-da2dc5a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:51.713851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:51.764398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895838543356076:9749]
2025-09-30T14:54:51.764652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1670, pipe: [1:7555895838543356076:9749]
2025-09-30T14:54:51.815513Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:51.816146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:51.816164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:51.816202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895838543356076:9749], now have 1 active actors on pipe
2025-09-30T14:54:51.816390Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:51.816394Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:51.816413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895838543356076:9749]
2025-09-30T14:54:51.816439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:51.816442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:51.816499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1671 reason: error at write: Disconnected sessionId: src_id|127962c3-87094211-72a9ee66-da2dc5a4_0
2025-09-30T14:54:51.816653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1671 sessionId: src_id|127962c3-87094211-72a9ee66-da2dc5a4_0 is DEAD
2025-09-30T14:54:51.816792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|127962c3-87094211-72a9ee66-da2dc5a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:51.816801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|127962c3-87094211-72a9ee66-da2dc5a4_0] Write session will restart in 0.006156s
2025-09-30T14:54:51.816817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|127962c3-87094211-72a9ee66-da2dc5a4_0] Write session: Do CDS request
2025-09-30T14:54:51.816821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|127962c3-87094211-72a9ee66-da2dc5a4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:51.823885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|127962c3-87094211-72a9ee66-da2dc5a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:51.823995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:51.824011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1672
2025-09-30T14:54:51.824189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1672 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:51.824231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1672 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:51.824242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1672 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:51.824246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:51.824723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1672 sessionId:  describe result for acl check
2025-09-30T14:54:51.824758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:51.824765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:51.824767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:51.824773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895838543356111:10148] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:51.825235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895838543356111:10148] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:51.827093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895838543356111:10148] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:51.829895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895838543356111:10148] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:51.829911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895838543356111:10148] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:51.829915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895838543356111:10148] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:51.829922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1672 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:51.835071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:51.837047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:51.837242Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:51.837256Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:51.837267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:51.837326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:51.837367Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895838453593091:9739]
2025-09-30T14:54:51.838038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:51.838361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:51.838412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:51.838742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:51.838819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:51.838826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:51.838827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:51.838828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:51.838830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:51.838831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:51.838832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:51.838834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:51.838835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:51.838836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:51.838838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.838839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:51.838840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:51.838842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:51.838843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:51.838849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:51.838859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:51.838863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:51.838867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:51.838871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:51.838875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:51.838879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:51.838883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:51.838888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:51.838893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:51.838897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.838901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:51.838905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:51.838910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:51.838913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:51.838922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:51.838930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:51.838937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:51.838943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:51.838948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:51.838953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:51.838958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:51.838970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:51.838975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:51.838981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:51.838986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:51.838991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:51.838995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:51.839005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:51.839010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:51.839021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:51.839026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:51.839031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:51.839040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:51.839046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:51.839053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.839058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.839063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:51.839068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:51.839073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:51.839083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:51.839088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:51.839098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:51.839102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:51.839112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:51.839172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:51.844547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:51.845960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:51.845976Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:51.845979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:51.845983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:51.845990Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1671 [2:7555895838453593091:9739]
2025-09-30T14:54:51.846005Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:51.846020Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:51.846029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:51.846032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:51.846034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:51.846050Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:51.846061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:51.846068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:51.846133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.846142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:51.846145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:51.846148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:51.846150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:51.846218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:51.846227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.846243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:51.846262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:51.846286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:51.846311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895838543356301:10148], now have 1 active actors on pipe
2025-09-30T14:54:51.846319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895838543356077:2454], now have 1 active actors on pipe
2025-09-30T14:54:51.846325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895838453593086:9739]
2025-09-30T14:54:51.846327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895838453593086:9739]
2025-09-30T14:54:51.846329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895838453593086:9739]
2025-09-30T14:54:51.846343Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:51.846356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:51.846360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:51.846366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:51.846368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:51.846375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:51.846379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:51.846379Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1671
2025-09-30T14:54:51.846408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895838453593086:9739]
2025-09-30T14:54:51.846380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1671
2025-09-30T14:54:51.846417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:51.846420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:51.846442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:51.846452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:51.846486Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1525ac7-3aabbdc4-f05fcc1-e13c4118_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:51.846501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:51.846505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:51.846507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:51.846518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:51.846527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:51.846553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:51.846695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:51.846704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:51.846719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:51.846823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1672 partition: 0 MaxSeqNo: 42 sessionId: src_id|1525ac7-3aabbdc4-f05fcc1-e13c4118_0
2025-09-30T14:54:51.847250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|127962c3-87094211-72a9ee66-da2dc5a4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1525ac7-3aabbdc4-f05fcc1-e13c4118_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:51.850536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1525ac7-3aabbdc4-f05fcc1-e13c4118_0] Write session: try to update token
2025-09-30T14:54:51.850557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1525ac7-3aabbdc4-f05fcc1-e13c4118_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:51.858270Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:51.858289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:51.858292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:51.858294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:51.858304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895838453593086:9739]
2025-09-30T14:54:51.858309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895838453593086:9739]
2025-09-30T14:54:51.858314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895838453593086:9739]
2025-09-30T14:54:51.858360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:51.858363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:51.858367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:51.858371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:51.858371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:51.858375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:51.858522Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:51.867703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1672 sessionId: src_id|1525ac7-3aabbdc4-f05fcc1-e13c4118_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:51.870880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:51.916490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895838543356418:9749]
2025-09-30T14:54:51.916789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1671, pipe: [1:7555895838543356418:9749]
2025-09-30T14:54:51.975367Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:51.975652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:51.975665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:51.975684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895838543356418:9749], now have 1 active actors on pipe
2025-09-30T14:54:51.975840Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:51.975846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895838543356418:9749]
2025-09-30T14:54:51.975855Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:51.975883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:51.975958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1672 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1525ac7-3aabbdc4-f05fcc1-e13c4118_0
2025-09-30T14:54:51.976144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1672 sessionId: src_id|1525ac7-3aabbdc4-f05fcc1-e13c4118_0 is DEAD
2025-09-30T14:54:51.976311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1525ac7-3aabbdc4-f05fcc1-e13c4118_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:51.976322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1525ac7-3aabbdc4-f05fcc1-e13c4118_0] Write session will restart in 0.006735s
2025-09-30T14:54:51.976345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1525ac7-3aabbdc4-f05fcc1-e13c4118_0] Write session: Do CDS request
2025-09-30T14:54:51.976351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1525ac7-3aabbdc4-f05fcc1-e13c4118_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:51.984987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1525ac7-3aabbdc4-f05fcc1-e13c4118_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:51.985078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:51.985095Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1673
2025-09-30T14:54:51.985300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1673 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:51.985332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1673 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:51.985341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1673 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:51.985345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:51.985707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1673 sessionId:  describe result for acl check
2025-09-30T14:54:51.985744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:51.985747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:51.985749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:51.985754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895838543356515:10152] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:51.986211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895838543356515:10152] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:51.988026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895838543356515:10152] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:51.990672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895838543356515:10152] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:51.990688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895838543356515:10152] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:51.990691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895838543356515:10152] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:51.990699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1673 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:51.995976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:51.998291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:51.998465Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:51.998476Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:51.998486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:51.998533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:51.998572Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895838453593348:9741]
2025-09-30T14:54:51.999294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:51.999592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:51.999638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:51.999970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:52.000041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:52.000048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:52.000049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:52.000050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:52.000052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:52.000053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:52.000054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:52.000055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:52.000056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:52.000057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:52.000058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.000059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.000060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.000061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:52.000062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:52.000067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:52.000079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:52.000083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:52.000087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:52.000091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:52.000095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:52.000099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:52.000104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:52.000108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:52.000113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:52.000117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.000121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.000125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.000129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:52.000133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:52.000141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:52.000148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:52.000154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:52.000160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:52.000164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:52.000170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:52.000174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:52.000179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:52.000183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:52.000189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:52.000194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:52.000199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:52.000205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:52.000210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:52.000215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:52.000220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:52.000225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:52.000230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:52.000235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:52.000240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:52.000246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.000251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.000261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.000267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.000272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.000277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.000286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:52.000291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:52.000303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:52.000327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:52.000372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:52.006067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:52.006940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:52.006955Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:52.006958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:52.006963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:52.006970Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1672 [2:7555895838453593348:9741]
2025-09-30T14:54:52.006987Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:52.007007Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:52.007015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:52.007018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:52.007021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:52.007036Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:52.007047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:52.007058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:52.007115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.007123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.007126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.007129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:52.007132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:52.007198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:52.007206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.007219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.007237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.007281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:52.007305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895838543356642:10152], now have 1 active actors on pipe
2025-09-30T14:54:52.007314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895838543356422:2454], now have 1 active actors on pipe
2025-09-30T14:54:52.007321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895838453593343:9741]
2025-09-30T14:54:52.007329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895838453593343:9741]
2025-09-30T14:54:52.007331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895838453593343:9741]
2025-09-30T14:54:52.007344Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:52.007358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:52.007362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:52.007338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1672
2025-09-30T14:54:52.007366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:52.007346Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1672
2025-09-30T14:54:52.007368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:52.007377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:52.007381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:52.007420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:52.007430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:52.007445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895838453593343:9741]
2025-09-30T14:54:52.007458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:52.007480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:52.007497Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c013d9a5-846c714b-a5183875-bb976781_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:52.007508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:52.007516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:52.007519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:52.007528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:52.007542Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:52.007573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:52.007723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:52.007731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:52.007745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:52.007831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1673 partition: 0 MaxSeqNo: 42 sessionId: src_id|c013d9a5-846c714b-a5183875-bb976781_0
2025-09-30T14:54:52.008188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1525ac7-3aabbdc4-f05fcc1-e13c4118_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c013d9a5-846c714b-a5183875-bb976781_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:52.011026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c013d9a5-846c714b-a5183875-bb976781_0] Write session: try to update token
2025-09-30T14:54:52.011046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c013d9a5-846c714b-a5183875-bb976781_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:52.020236Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:52.020256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:52.020259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:52.020260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:52.020270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895838453593343:9741]
2025-09-30T14:54:52.020274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895838453593343:9741]
2025-09-30T14:54:52.020279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895838453593343:9741]
2025-09-30T14:54:52.020336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:52.020348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.020346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:52.020351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:52.020356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:52.020361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:52.020491Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:52.025303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1673 sessionId: src_id|c013d9a5-846c714b-a5183875-bb976781_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:52.028015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:52.076205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895842838324057:9749]
2025-09-30T14:54:52.076437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1672, pipe: [1:7555895842838324057:9749]
2025-09-30T14:54:52.138739Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:52.139041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:52.139058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:52.139101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895842838324057:9749], now have 1 active actors on pipe
2025-09-30T14:54:52.139316Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:52.139306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895842838324057:9749]
2025-09-30T14:54:52.139334Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:52.139334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:52.139338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:52.139405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1673 reason: error at write: Disconnected sessionId: src_id|c013d9a5-846c714b-a5183875-bb976781_0
2025-09-30T14:54:52.139616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1673 sessionId: src_id|c013d9a5-846c714b-a5183875-bb976781_0 is DEAD
2025-09-30T14:54:52.139755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c013d9a5-846c714b-a5183875-bb976781_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:52.139767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c013d9a5-846c714b-a5183875-bb976781_0] Write session will restart in 0.005332s
2025-09-30T14:54:52.139804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c013d9a5-846c714b-a5183875-bb976781_0] Write session: Do CDS request
2025-09-30T14:54:52.139812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c013d9a5-846c714b-a5183875-bb976781_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:52.146734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c013d9a5-846c714b-a5183875-bb976781_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:52.146837Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:52.146852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1674
2025-09-30T14:54:52.147366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1674 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:52.147399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1674 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:52.147409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1674 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:52.147412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:52.147892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1674 sessionId:  describe result for acl check
2025-09-30T14:54:52.147941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:52.147948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:52.147950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:52.147957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895842838324124:10164] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:52.148643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895842838324124:10164] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:52.150828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895842838324124:10164] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:52.154646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895842838324124:10164] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:52.154665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895842838324124:10164] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:52.154668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895842838324124:10164] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:52.154682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1674 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:52.159422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:52.161869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:52.162236Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:52.162247Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:52.162260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:52.162322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:52.162365Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895842748560938:9755]
2025-09-30T14:54:52.163037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:52.163358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:52.163408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:52.163744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:52.163810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:52.163817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:52.163818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:52.163819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:52.163821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:52.163822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:52.163823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:52.163825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:52.163826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:52.163827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:52.163829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.163830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.163831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.163832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:52.163834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:52.163839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:52.163851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:52.163855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:52.163859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:52.163863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:52.163867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:52.163871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:52.163876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:52.163880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:52.163885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:52.163889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.163893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.163897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.163901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:52.163905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:52.163915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:52.163923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:52.163929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:52.163935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:52.163940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:52.163945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:52.163950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:52.163955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:52.163960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:52.163966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:52.163973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:52.163984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:52.163989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:52.163994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:52.164004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:52.164009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:52.164014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:52.164024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:52.164028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:52.164039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:52.164044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.164054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.164059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.164068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.164073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.164078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.164083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:52.164092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:52.164099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:52.164104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:52.164148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:52.169756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:52.170978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:52.170994Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:52.170996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:52.170999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:52.171003Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1673 [2:7555895842748560938:9755]
2025-09-30T14:54:52.171017Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:52.171029Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:52.171031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:52.171033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:52.171035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:52.171047Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:52.171056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:52.171062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:52.171118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.171126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.171128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.171131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:52.171132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:52.171187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:52.171194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.171203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.171209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.171219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:52.171231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895842748560933:9755]
2025-09-30T14:54:52.171233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895842748560933:9755]
2025-09-30T14:54:52.171234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895842748560933:9755]
2025-09-30T14:54:52.171259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:52.171273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:52.171273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:52.171276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:52.171278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:52.171287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:52.171294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:52.171302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895842838324089:2454], now have 1 active actors on pipe
2025-09-30T14:54:52.171309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895842838324331:10164], now have 1 active actors on pipe
2025-09-30T14:54:52.171336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895842748560933:9755]
2025-09-30T14:54:52.171345Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:52.171356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:52.171382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1673
2025-09-30T14:54:52.171381Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1673
2025-09-30T14:54:52.171442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:52.171449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:52.171470Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a77a60ba-f388bd84-1bc59ab3-b38bb413_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:52.171480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:52.171482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:52.171484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:52.171491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:52.171498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:52.171513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:52.171662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:52.171669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:52.171679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:52.171766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1674 partition: 0 MaxSeqNo: 42 sessionId: src_id|a77a60ba-f388bd84-1bc59ab3-b38bb413_0
2025-09-30T14:54:52.172139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c013d9a5-846c714b-a5183875-bb976781_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a77a60ba-f388bd84-1bc59ab3-b38bb413_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:52.174890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a77a60ba-f388bd84-1bc59ab3-b38bb413_0] Write session: try to update token
2025-09-30T14:54:52.174908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a77a60ba-f388bd84-1bc59ab3-b38bb413_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:52.183145Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:52.183166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:52.183168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:52.183170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:52.183184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895842748560933:9755]
2025-09-30T14:54:52.183189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895842748560933:9755]
2025-09-30T14:54:52.183193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895842748560933:9755]
2025-09-30T14:54:52.183233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:52.183257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.183260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:52.183268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:52.183278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:52.183282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:52.183395Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:52.189946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1674 sessionId: src_id|a77a60ba-f388bd84-1bc59ab3-b38bb413_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:52.192664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:52.239543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895842838324432:9749]
2025-09-30T14:54:52.239767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1673, pipe: [1:7555895842838324432:9749]
2025-09-30T14:54:52.290201Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:52.290593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:52.290603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:52.290640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895842838324432:9749], now have 1 active actors on pipe
2025-09-30T14:54:52.290844Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:52.290864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895842838324432:9749]
2025-09-30T14:54:52.290871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:52.290874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:52.290904Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:52.290934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1674 reason: error at write: Disconnected sessionId: src_id|a77a60ba-f388bd84-1bc59ab3-b38bb413_0
2025-09-30T14:54:52.291111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1674 sessionId: src_id|a77a60ba-f388bd84-1bc59ab3-b38bb413_0 is DEAD
2025-09-30T14:54:52.291290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a77a60ba-f388bd84-1bc59ab3-b38bb413_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:52.291308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a77a60ba-f388bd84-1bc59ab3-b38bb413_0] Write session will restart in 0.007412s
2025-09-30T14:54:52.291328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a77a60ba-f388bd84-1bc59ab3-b38bb413_0] Write session: Do CDS request
2025-09-30T14:54:52.291335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a77a60ba-f388bd84-1bc59ab3-b38bb413_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:52.299675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a77a60ba-f388bd84-1bc59ab3-b38bb413_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:52.299749Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:52.299762Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1675
2025-09-30T14:54:52.299864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1675 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:52.299889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1675 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:52.299896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1675 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:52.299899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:52.300284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1675 sessionId:  describe result for acl check
2025-09-30T14:54:52.300317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:52.300324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:52.300325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:52.300330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895842838324553:10168] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:52.300813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895842838324553:10168] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:52.303661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895842838324553:10168] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:52.306872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895842838324553:10168] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:52.306886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895842838324553:10168] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:52.306890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895842838324553:10168] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:52.306898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1675 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:52.310784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:52.311425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:52.311653Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:52.311670Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:52.311682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:52.311755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:52.311819Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895842748561199:9757]
2025-09-30T14:54:52.312619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:52.312927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:52.312965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:52.313262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:52.313316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:52.313320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:52.313321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:52.313322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:52.313323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:52.313324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:52.313325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:52.313326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:52.313326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:52.313327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:52.313328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.313329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.313330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.313330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:52.313331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:52.313335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:52.313341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:52.313344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:52.313347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:52.313349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:52.313351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:52.313354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:52.313356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:52.313359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:52.313361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:52.313363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.313365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.313368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.313370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:52.313372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:52.313378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:52.313384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:52.313388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:52.313391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:52.313395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:52.313398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:52.313401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:52.313404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:52.313407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:52.313411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:52.313414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:52.313417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:52.313420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:52.313423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:52.313425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:52.313428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:52.313431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:52.313435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:52.313437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:52.313441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:52.313443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.313448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.313451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.313454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.313457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.313460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.313462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:52.313465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:52.313469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:52.313472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:52.313509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:52.318680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:52.319701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:52.319715Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:52.319717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:52.319720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:52.319725Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1674 [2:7555895842748561199:9757]
2025-09-30T14:54:52.319737Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:52.319750Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:52.319752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:52.319754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:52.319756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:52.319767Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:52.319772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:52.319778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:52.319820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.319827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.319828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.319831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:52.319832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:52.319881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:52.319887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.319895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.319901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.319911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:52.319926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895842748561194:9757]
2025-09-30T14:54:52.319931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895842748561194:9757]
2025-09-30T14:54:52.319933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895842748561194:9757]
2025-09-30T14:54:52.319939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:52.319947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:52.319950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895842838324433:2454], now have 1 active actors on pipe
2025-09-30T14:54:52.319956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:52.319956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:52.319958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:52.319965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:52.319967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:52.319971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895842838324763:10168], now have 1 active actors on pipe
2025-09-30T14:54:52.319992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895842748561194:9757]
2025-09-30T14:54:52.319998Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:52.320009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:52.320035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1674
2025-09-30T14:54:52.320034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1674
2025-09-30T14:54:52.320127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:52.320134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:52.320155Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eda75b6c-35262a2c-e528f21b-eee3219d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:52.320164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:52.320170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:52.320172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:52.320182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:52.320191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:52.320207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:52.320359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:52.320367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:52.320380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:52.320455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1675 partition: 0 MaxSeqNo: 42 sessionId: src_id|eda75b6c-35262a2c-e528f21b-eee3219d_0
2025-09-30T14:54:52.320818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a77a60ba-f388bd84-1bc59ab3-b38bb413_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|eda75b6c-35262a2c-e528f21b-eee3219d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:52.323623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eda75b6c-35262a2c-e528f21b-eee3219d_0] Write session: try to update token
2025-09-30T14:54:52.323642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eda75b6c-35262a2c-e528f21b-eee3219d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:52.331899Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:52.331926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:52.331929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:52.331932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:52.331949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895842748561194:9757]
2025-09-30T14:54:52.331954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895842748561194:9757]
2025-09-30T14:54:52.331958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895842748561194:9757]
2025-09-30T14:54:52.332005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:52.332015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:52.332022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.332023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:52.332025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:52.332027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:52.332239Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:52.338554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1675 sessionId: src_id|eda75b6c-35262a2c-e528f21b-eee3219d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:52.341296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:52.391117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895842838324778:9749]
2025-09-30T14:54:52.391485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1674, pipe: [1:7555895842838324778:9749]
2025-09-30T14:54:52.437305Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:52.437641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:52.437655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:52.437671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895842838324778:9749], now have 1 active actors on pipe
2025-09-30T14:54:52.437952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:52.437957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895842838324778:9749]
2025-09-30T14:54:52.437967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:52.437979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:52.438027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1675 reason: error at write: Disconnected sessionId: src_id|eda75b6c-35262a2c-e528f21b-eee3219d_0
2025-09-30T14:54:52.438200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1675 sessionId: src_id|eda75b6c-35262a2c-e528f21b-eee3219d_0 is DEAD
2025-09-30T14:54:52.438315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eda75b6c-35262a2c-e528f21b-eee3219d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:52.438325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eda75b6c-35262a2c-e528f21b-eee3219d_0] Write session will restart in 0.006818s
2025-09-30T14:54:52.438346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eda75b6c-35262a2c-e528f21b-eee3219d_0] Write session: Do CDS request
2025-09-30T14:54:52.438351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eda75b6c-35262a2c-e528f21b-eee3219d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:52.439086Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:52.446770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eda75b6c-35262a2c-e528f21b-eee3219d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:52.446877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:52.446893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1676
2025-09-30T14:54:52.447028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1676 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:52.447061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1676 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:52.447072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1676 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:52.447076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:52.447515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1676 sessionId:  describe result for acl check
2025-09-30T14:54:52.447550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:52.447558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:52.447560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:52.447565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895842838324912:10172] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:52.448118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895842838324912:10172] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:52.450782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895842838324912:10172] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:52.453663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895842838324912:10172] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:52.453677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895842838324912:10172] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:52.453679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895842838324912:10172] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:52.453686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1676 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:52.454194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:52.456264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:52.456417Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:52.456425Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:52.456433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:52.456468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:52.456499Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895842748561457:9760]
2025-09-30T14:54:52.456939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:52.457166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:52.457197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:52.457414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:52.457454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:52.457458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:52.457459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:52.457460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:52.457461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:52.457462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:52.457462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:52.457463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:52.457464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:52.457465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:52.457466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.457466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.457467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.457467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:52.457468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:52.457472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:52.457478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:52.457481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:52.457483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:52.457485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:52.457488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:52.457490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:52.457493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:52.457495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:52.457498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:52.457500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.457503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.457505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.457507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:52.457510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:52.457515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:52.457522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:52.457526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:52.457529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:52.457532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:52.457535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:52.457537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:52.457541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:52.457543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:52.457547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:52.457549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:52.457552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:52.457555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:52.457558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:52.457561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:52.457564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:52.457566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:52.457570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:52.457572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:52.457575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:52.457578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.457582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.457585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.457588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.457591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.457594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.457596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:52.457599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:52.457601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:52.457605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:52.457629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:52.462850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:52.463861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:52.463874Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:52.463875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:52.463879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:52.463886Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1675 [2:7555895842748561457:9760]
2025-09-30T14:54:52.463902Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:52.463917Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:52.463920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:52.463923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:52.463925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:52.463939Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:52.463946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:52.463953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:52.464007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.464016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.464018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.464021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:52.464023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:52.464091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:52.464098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.464106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.464112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.464122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:52.464134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895842748561452:9760]
2025-09-30T14:54:52.464136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895842748561452:9760]
2025-09-30T14:54:52.464139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895842748561452:9760]
2025-09-30T14:54:52.464149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:52.464156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:52.464159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:52.464161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:52.464163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895842838325111:10172], now have 1 active actors on pipe
2025-09-30T14:54:52.464166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895842838324779:2454], now have 1 active actors on pipe
2025-09-30T14:54:52.464172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:52.464181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:52.464183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:52.464208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895842748561452:9760]
2025-09-30T14:54:52.464220Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:52.464250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:52.464254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1675
2025-09-30T14:54:52.464254Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1675
2025-09-30T14:54:52.464319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:52.464327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:52.464350Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|effefe-3897639e-e6031c36-8562cf64_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:52.464358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:52.464360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:52.464362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:52.464369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:52.464381Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:52.464391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:52.464519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:52.464524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:52.464534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:52.464615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1676 partition: 0 MaxSeqNo: 42 sessionId: src_id|effefe-3897639e-e6031c36-8562cf64_0
2025-09-30T14:54:52.465022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eda75b6c-35262a2c-e528f21b-eee3219d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|effefe-3897639e-e6031c36-8562cf64_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:52.467881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|effefe-3897639e-e6031c36-8562cf64_0] Write session: try to update token
2025-09-30T14:54:52.467903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|effefe-3897639e-e6031c36-8562cf64_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:52.475893Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:52.475913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:52.475916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:52.475918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:52.475930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895842748561452:9760]
2025-09-30T14:54:52.475935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895842748561452:9760]
2025-09-30T14:54:52.475939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895842748561452:9760]
2025-09-30T14:54:52.475980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:52.475985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.475986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:52.475988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:52.475993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:52.475997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:52.476128Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:52.482864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1676 sessionId: src_id|effefe-3897639e-e6031c36-8562cf64_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:52.485624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:52.538052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895842838325124:9749]
2025-09-30T14:54:52.538294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1675, pipe: [1:7555895842838325124:9749]
2025-09-30T14:54:52.581946Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:52.582567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:52.582582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:52.582599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895842838325124:9749], now have 1 active actors on pipe
2025-09-30T14:54:52.582789Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:52.582877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:52.582880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895842838325124:9749]
2025-09-30T14:54:52.582901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:52.582985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1676 reason: status is not ok: tablet will be restarted right now sessionId: src_id|effefe-3897639e-e6031c36-8562cf64_0
2025-09-30T14:54:52.583175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1676 sessionId: src_id|effefe-3897639e-e6031c36-8562cf64_0 is DEAD
2025-09-30T14:54:52.583378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|effefe-3897639e-e6031c36-8562cf64_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:52.583396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|effefe-3897639e-e6031c36-8562cf64_0] Write session will restart in 0.006037s
2025-09-30T14:54:52.583427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|effefe-3897639e-e6031c36-8562cf64_0] Write session: Do CDS request
2025-09-30T14:54:52.583437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|effefe-3897639e-e6031c36-8562cf64_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:52.590809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|effefe-3897639e-e6031c36-8562cf64_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:52.590892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:52.590905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1677
2025-09-30T14:54:52.591044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1677 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:52.591069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1677 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:52.591073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1677 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:52.591077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:52.591526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1677 sessionId:  describe result for acl check
2025-09-30T14:54:52.591568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:52.591576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:52.591579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:52.591586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895842838325204:10177] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:52.592152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895842838325204:10177] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:52.594621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895842838325204:10177] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:52.597439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895842838325204:10177] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:52.597457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895842838325204:10177] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:52.597461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895842838325204:10177] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:52.597469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1677 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:52.601088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:52.603265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:52.603471Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:52.603489Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:52.603500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:52.603555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:52.603601Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895842748561730:9763]
2025-09-30T14:54:52.604279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:52.604534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:52.604576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:52.604898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:52.604955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:52.604961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:52.604962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:52.604963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:52.604964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:52.604965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:52.604967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:52.604968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:52.604969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:52.604970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:52.604971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.604973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.604974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.604975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:52.604977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:52.604981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:52.604992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:52.604996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:52.605001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:52.605005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:52.605009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:52.605013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:52.605017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:52.605021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:52.605025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:52.605029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.605033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.605037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.605040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:52.605045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:52.605053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:52.605063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:52.605068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:52.605074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:52.605079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:52.605084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:52.605093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:52.605102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:52.605107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:52.605117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:52.605121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:52.605126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:52.605131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:52.605137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:52.605142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:52.605147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:52.605152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:52.605158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:52.605162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:52.605168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:52.605173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.605179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.605183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.605189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.605194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.605199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.605203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:52.605209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:52.605218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:52.605223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:52.605280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:52.610660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:52.611677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:52.611690Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:52.611692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:52.611695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:52.611700Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1676 [2:7555895842748561730:9763]
2025-09-30T14:54:52.611714Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:52.611728Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:52.611731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:52.611733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:52.611735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:52.611749Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:52.611754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:52.611761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:52.611810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.611816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.611818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.611821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:52.611822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:52.611877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:52.611884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.611893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.611901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.611924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:52.611942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895842748561725:9763]
2025-09-30T14:54:52.611947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895842748561725:9763]
2025-09-30T14:54:52.611949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895842748561725:9763]
2025-09-30T14:54:52.611956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:52.611966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895842838325401:10177], now have 1 active actors on pipe
2025-09-30T14:54:52.611966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:52.611970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:52.611971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:52.611973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895842838325137:2454], now have 1 active actors on pipe
2025-09-30T14:54:52.611979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:52.611988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:52.611990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:52.612021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895842748561725:9763]
2025-09-30T14:54:52.612032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:52.612051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:52.612060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1676
2025-09-30T14:54:52.612061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1676
2025-09-30T14:54:52.612171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:52.612179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:52.612199Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7cf9017-b228d0d3-770554cb-4afc858_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:52.612208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:52.612211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:52.612216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:52.612223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:52.612233Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:52.612250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:52.612433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:52.612447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:52.612468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:52.612570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1677 partition: 0 MaxSeqNo: 42 sessionId: src_id|7cf9017-b228d0d3-770554cb-4afc858_0
2025-09-30T14:54:52.612949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|effefe-3897639e-e6031c36-8562cf64_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7cf9017-b228d0d3-770554cb-4afc858_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:52.615763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cf9017-b228d0d3-770554cb-4afc858_0] Write session: try to update token
2025-09-30T14:54:52.615780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cf9017-b228d0d3-770554cb-4afc858_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:52.624597Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:52.624617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:52.624629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895842748561725:9763]
2025-09-30T14:54:52.624672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:52.624673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:52.624838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:52.624968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:52.625099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:52.625225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:52.625416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:52.625454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:52.630027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1677 sessionId: src_id|7cf9017-b228d0d3-770554cb-4afc858_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:52.632682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:52.633175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:52.633195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:52.634389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:52.634422Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:52.634425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:52.634427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:52.634429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:52.634439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895842748561725:9763]
2025-09-30T14:54:52.634442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895842748561725:9763]
2025-09-30T14:54:52.634446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895842748561725:9763]
2025-09-30T14:54:52.634472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:52.634476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:52.634482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.634485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:52.634485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:52.634488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:52.634498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:52.634632Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:52.682922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895842838325485:9749]
2025-09-30T14:54:52.683135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1676, pipe: [1:7555895842838325485:9749]
2025-09-30T14:54:52.744259Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:52.751362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:52.751388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:52.751546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:52.751607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:52.751664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:52.751720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:52.751762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:52.751770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:52.751834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:52.751892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:52.751949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:52.752009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:52.752050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:52.752058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:52.752158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:52.752212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:52.752269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:52.752326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:52.752372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:52.752380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:52.752441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:52.752497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:52.752555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:52.752613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:52.752656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:52.752662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:52.752723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:52.752777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:52.752833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:52.752901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:52.752947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:52.752952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:52.753012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:52.753067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:52.753125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:52.753186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:52.753224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:52.753229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:52.753286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:52.753338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:52.753406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:52.753465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:52.753507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:52.753512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:52.753571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:52.753632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:52.753693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:52.753761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:52.753801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:52.753806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:52.753864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:52.753927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:52.753986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:52.754044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:52.754084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:52.754089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:52.754156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:52.754212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:52.754269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:52.754323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:52.754364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:52.754369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:52.754417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895842838325485:9749], now have 1 active actors on pipe
2025-09-30T14:54:52.754700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895842838325485:9749]
2025-09-30T14:54:52.754700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:52.754706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:52.754730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:52.754736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1677 reason: error at write: Disconnected sessionId: src_id|7cf9017-b228d0d3-770554cb-4afc858_0
2025-09-30T14:54:52.754968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1677 sessionId: src_id|7cf9017-b228d0d3-770554cb-4afc858_0 is DEAD
2025-09-30T14:54:52.755111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cf9017-b228d0d3-770554cb-4afc858_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:52.755121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cf9017-b228d0d3-770554cb-4afc858_0] Write session will restart in 0.008097s
2025-09-30T14:54:52.755144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cf9017-b228d0d3-770554cb-4afc858_0] Write session: Do CDS request
2025-09-30T14:54:52.755149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cf9017-b228d0d3-770554cb-4afc858_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:52.755368Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:52.764756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cf9017-b228d0d3-770554cb-4afc858_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:52.764816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:52.764830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1678
2025-09-30T14:54:52.765230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1678 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:52.765255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1678 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:52.765264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1678 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:52.765267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:52.765687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1678 sessionId:  describe result for acl check
2025-09-30T14:54:52.765732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:52.765734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:52.765736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:52.765742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895842838325637:10182] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:52.766261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895842838325637:10182] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:52.769049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895842838325637:10182] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:52.771713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895842838325637:10182] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:52.771726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895842838325637:10182] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:52.771730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895842838325637:10182] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:52.771737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1678 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:52.771964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:52.774092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:52.774231Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:52.774239Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:52.774247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:52.774281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:52.774311Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895842748561992:9765]
2025-09-30T14:54:52.774801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:52.775087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:52.775145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:52.775558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:52.775647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:52.775654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:52.775655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:52.775656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:52.775657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:52.775658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:52.775660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:52.775661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:52.775662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:52.775663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:52.775664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.775665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.775666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.775667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:52.775668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:52.775673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:52.775683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:52.775687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:52.775691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:52.775694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:52.775697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:52.775701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:52.775705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:52.775710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:52.775714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:52.775719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.775723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.775727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.775731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:52.775735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:52.775742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:52.775750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:52.775755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:52.775760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:52.775764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:52.775769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:52.775774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:52.775779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:52.775785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:52.775790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:52.775796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:52.775802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:52.775807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:52.775813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:52.775817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:52.775826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:52.775834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:52.775843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:52.775848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:52.775853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:52.775858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.775866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.775870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.775881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.775901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.775913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.775917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:52.775922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:52.775927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:52.775934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:52.775977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:52.781039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:52.782053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:52.782066Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:52.782068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:52.782071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:52.782076Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1677 [2:7555895842748561992:9765]
2025-09-30T14:54:52.782087Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:52.782099Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:52.782101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:52.782103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:52.782105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:52.782116Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:52.782123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:52.782128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:52.782174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.782180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.782181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.782184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:52.782186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:52.782238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:52.782244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.782253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.782259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.782268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:52.782283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895842748561987:9765]
2025-09-30T14:54:52.782286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895842748561987:9765]
2025-09-30T14:54:52.782288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895842748561987:9765]
2025-09-30T14:54:52.782294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:52.782305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895842838325821:10182], now have 1 active actors on pipe
2025-09-30T14:54:52.782305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:52.782308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:52.782309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:52.782310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:52.782320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:52.782322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:52.782325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895842838325486:2454], now have 1 active actors on pipe
2025-09-30T14:54:52.782346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895842748561987:9765]
2025-09-30T14:54:52.782355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:52.782377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:52.782378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1677
2025-09-30T14:54:52.782412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1677
2025-09-30T14:54:52.782430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:52.782437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:52.782456Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8fba7f43-fbdd3e07-10d2a253-a01f9189_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:52.782462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:52.782468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:52.782470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:52.782477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:52.782483Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:52.782495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:52.782640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:52.782657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:52.782667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:52.782777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1678 partition: 0 MaxSeqNo: 42 sessionId: src_id|8fba7f43-fbdd3e07-10d2a253-a01f9189_0
2025-09-30T14:54:52.783091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cf9017-b228d0d3-770554cb-4afc858_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8fba7f43-fbdd3e07-10d2a253-a01f9189_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:52.785554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fba7f43-fbdd3e07-10d2a253-a01f9189_0] Write session: try to update token
2025-09-30T14:54:52.785569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fba7f43-fbdd3e07-10d2a253-a01f9189_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:52.793676Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:52.793694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:52.793703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895842748561987:9765]
2025-09-30T14:54:52.793755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:52.793761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:52.793942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:52.794112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:52.794262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:52.794408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:52.794612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:52.794663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:52.798061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1678 sessionId: src_id|8fba7f43-fbdd3e07-10d2a253-a01f9189_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:52.800638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:52.800844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:52.800870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:52.800917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:52.801024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:52.804312Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:52.804327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:52.804330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:52.804332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:52.804341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895842748561987:9765]
2025-09-30T14:54:52.804346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895842748561987:9765]
2025-09-30T14:54:52.804351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895842748561987:9765]
2025-09-30T14:54:52.804392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:52.804399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.804407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:52.804407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:52.804416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:52.804420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:52.804558Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:52.855003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895842838325834:9749]
2025-09-30T14:54:52.855282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1677, pipe: [1:7555895842838325834:9749]
2025-09-30T14:54:52.917472Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:52.925986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:52.926018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:52.926192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:52.926260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:52.926328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:52.926392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:52.926437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:52.926447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:52.926516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:52.926582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:52.926647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:52.926713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:52.926767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:52.926775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:52.926844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:52.926910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:52.926980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:52.927051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:52.927095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:52.927103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:52.927167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:52.927231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:52.927315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:52.927381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:52.927424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:52.927436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:52.927506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:52.927569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:52.927632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:52.927694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:52.927741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:52.927749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:52.927814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:52.927875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:52.927937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:52.928000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:52.928044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:52.928052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:52.928118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:52.928177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:52.928243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:52.928307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:52.928352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:52.928360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:52.928430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:52.928495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:52.928558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:52.928624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:52.928671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:52.928679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:52.928747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:52.928823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:52.928889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:52.928952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:52.928997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:52.929005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:52.929111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:52.929170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:52.929234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:52.929337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:52.929398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:52.929405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:52.929473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895842838325834:9749], now have 1 active actors on pipe
2025-09-30T14:54:52.929738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:52.929764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:52.929765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895842838325834:9749]
2025-09-30T14:54:52.929791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:52.929795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1678 reason: error at write: Disconnected sessionId: src_id|8fba7f43-fbdd3e07-10d2a253-a01f9189_0
2025-09-30T14:54:52.929975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1678 sessionId: src_id|8fba7f43-fbdd3e07-10d2a253-a01f9189_0 is DEAD
2025-09-30T14:54:52.930121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fba7f43-fbdd3e07-10d2a253-a01f9189_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:52.930129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fba7f43-fbdd3e07-10d2a253-a01f9189_0] Write session will restart in 0.005139s
2025-09-30T14:54:52.930156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fba7f43-fbdd3e07-10d2a253-a01f9189_0] Write session: Do CDS request
2025-09-30T14:54:52.930160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fba7f43-fbdd3e07-10d2a253-a01f9189_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:52.930703Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:52.936794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fba7f43-fbdd3e07-10d2a253-a01f9189_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:52.936868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:52.936896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1679
2025-09-30T14:54:52.937063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1679 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:52.937124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1679 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:52.937134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1679 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:52.937139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:52.937597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1679 sessionId:  describe result for acl check
2025-09-30T14:54:52.937636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:52.937644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:52.937647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:52.937653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895842838325869:10186] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:52.938218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895842838325869:10186] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:52.941041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895842838325869:10186] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:52.945230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895842838325869:10186] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:52.945251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895842838325869:10186] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:52.945255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895842838325869:10186] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:52.945265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1679 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:52.950814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:52.953443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:52.953810Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:52.953834Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:52.953853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:52.953958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:52.954023Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895842748562257:9768]
2025-09-30T14:54:52.954654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:52.954999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:52.955049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:52.955404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:52.955469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:52.955475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:52.955476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:52.955478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:52.955479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:52.955480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:52.955481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:52.955482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:52.955483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:52.955485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:52.955486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.955488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.955489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.955490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:52.955492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:52.955497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:52.955506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:52.955510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:52.955514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:52.955518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:52.955522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:52.955526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:52.955530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:52.955535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:52.955539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:52.955543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.955547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.955551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.955555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:52.955558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:52.955568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:52.955575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:52.955581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:52.955587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:52.955593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:52.955598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:52.955603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:52.955609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:52.955619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:52.955624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:52.955628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:52.955637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:52.955642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:52.955646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:52.955650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:52.955655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:52.955664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:52.955669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:52.955673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:52.955682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:52.955689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.955698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.955703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.955707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.955711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.955717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.955721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:52.955726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:52.955731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:52.955736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:52.955781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:52.961602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:52.962956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:52.962974Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:52.962976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:52.962980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:52.962987Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1678 [2:7555895842748562257:9768]
2025-09-30T14:54:52.963003Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:52.963018Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:52.963021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:52.963024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:52.963027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:52.963044Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:52.963051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:52.963059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:52.963120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.963130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.963132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.963136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:52.963140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:52.963214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:52.963221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.963235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:52.963274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:52.963296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:52.963320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895842838325835:2454], now have 1 active actors on pipe
2025-09-30T14:54:52.963329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895842838326094:10186], now have 1 active actors on pipe
2025-09-30T14:54:52.963385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1678
2025-09-30T14:54:52.963335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895842748562252:9768]
2025-09-30T14:54:52.963421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1678
2025-09-30T14:54:52.963343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895842748562252:9768]
2025-09-30T14:54:52.963345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895842748562252:9768]
2025-09-30T14:54:52.963359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:52.963374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:52.963374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:52.963377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:52.963379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:52.963388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:52.963392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:52.963430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895842748562252:9768]
2025-09-30T14:54:52.963433Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:52.963435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:52.963452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:52.963457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:52.963510Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fdf9e0da-cdf8d534-85e893ca-e8cf76cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:52.963517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:52.963521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:52.963525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:52.963536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:52.963549Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:52.963568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:52.963759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:52.963769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:52.963783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:52.963888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1679 partition: 0 MaxSeqNo: 42 sessionId: src_id|fdf9e0da-cdf8d534-85e893ca-e8cf76cf_0
2025-09-30T14:54:52.964262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fba7f43-fbdd3e07-10d2a253-a01f9189_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fdf9e0da-cdf8d534-85e893ca-e8cf76cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:52.967123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdf9e0da-cdf8d534-85e893ca-e8cf76cf_0] Write session: try to update token
2025-09-30T14:54:52.967140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdf9e0da-cdf8d534-85e893ca-e8cf76cf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:52.975727Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:52.975746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:52.975749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:52.975751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:52.975762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895842748562252:9768]
2025-09-30T14:54:52.975766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895842748562252:9768]
2025-09-30T14:54:52.975771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895842748562252:9768]
2025-09-30T14:54:52.975814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:52.975815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:52.975821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:52.975821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:52.975824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:52.975845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:52.975973Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:52.982669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1679 sessionId: src_id|fdf9e0da-cdf8d534-85e893ca-e8cf76cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:52.985788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:53.029577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895847133293480:9749]
2025-09-30T14:54:53.029894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1678, pipe: [1:7555895847133293480:9749]
2025-09-30T14:54:53.087447Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:53.088014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:53.088031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:53.088050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895847133293480:9749], now have 1 active actors on pipe
2025-09-30T14:54:53.088308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895847133293480:9749]
2025-09-30T14:54:53.088328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:53.088333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:53.088350Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:53.088296Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:53.088404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1679 reason: error at write: Disconnected sessionId: src_id|fdf9e0da-cdf8d534-85e893ca-e8cf76cf_0
2025-09-30T14:54:53.088572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1679 sessionId: src_id|fdf9e0da-cdf8d534-85e893ca-e8cf76cf_0 is DEAD
2025-09-30T14:54:53.088728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdf9e0da-cdf8d534-85e893ca-e8cf76cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:53.088741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdf9e0da-cdf8d534-85e893ca-e8cf76cf_0] Write session will restart in 0.008367s
2025-09-30T14:54:53.088765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdf9e0da-cdf8d534-85e893ca-e8cf76cf_0] Write session: Do CDS request
2025-09-30T14:54:53.088775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdf9e0da-cdf8d534-85e893ca-e8cf76cf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:53.098779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdf9e0da-cdf8d534-85e893ca-e8cf76cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:53.098901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:53.098920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1680
2025-09-30T14:54:53.099058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1680 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:53.099091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1680 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:53.099098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1680 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:53.099102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:53.099590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1680 sessionId:  describe result for acl check
2025-09-30T14:54:53.099633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:53.099642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:53.099645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:53.099652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895847133293501:10193] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:53.100296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895847133293501:10193] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:53.102235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895847133293501:10193] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:53.106285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895847133293501:10193] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:53.106305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895847133293501:10193] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:53.106309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895847133293501:10193] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:53.106317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1680 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:53.116145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:53.119127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:53.119357Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:53.119369Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:53.119380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:53.119434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:53.119476Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895847043529817:9770]
2025-09-30T14:54:53.120123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:53.120451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:53.120496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:53.120850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:53.120921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:53.120928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:53.120929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:53.120930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:53.120931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:53.120933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:53.120934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:53.120935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:53.120936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:53.120938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:53.120939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:53.120940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:53.120942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:53.120943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:53.120944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:53.120949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:53.120961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:53.120965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:53.120969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:53.120973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:53.120978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:53.120982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:53.120986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:53.120990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:53.120996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:53.121000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:53.121004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:53.121008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:53.121011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:53.121015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:53.121025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:53.121033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:53.121038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:53.121044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:53.121047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:53.121052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:53.121056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:53.121061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:53.121066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:53.121071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:53.121075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:53.121085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:53.121091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:53.121102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:53.121107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:53.121115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:53.121120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:53.121131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:53.121137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:53.121147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:53.121152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:53.121163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:53.121168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:53.121173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:53.121179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:53.121185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:53.121189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:53.121196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:53.121207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:53.121213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:53.121260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:53.126833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:53.127774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:53.127791Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:53.127794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:53.127799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:53.127805Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1679 [2:7555895847043529817:9770]
2025-09-30T14:54:53.127823Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:53.127841Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:53.127851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:53.127854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:53.127857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:53.127872Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:53.127884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:53.127891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:53.127961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:53.127969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:53.127971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:53.127975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:53.127977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:53.128045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:53.128053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:53.128066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:53.128078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:53.128100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:53.128123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895847133293647:10193], now have 1 active actors on pipe
2025-09-30T14:54:53.128132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895847133293484:2454], now have 1 active actors on pipe
2025-09-30T14:54:53.128138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895847043529812:9770]
2025-09-30T14:54:53.128145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895847043529812:9770]
2025-09-30T14:54:53.128148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895847043529812:9770]
2025-09-30T14:54:53.128163Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:53.128180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:53.128190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:53.128194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:53.128196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:53.128199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:53.128202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:53.128234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895847043529812:9770]
2025-09-30T14:54:53.128242Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:53.128211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1679
2025-09-30T14:54:53.128217Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1679
2025-09-30T14:54:53.128262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:53.128277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:53.128288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:53.128319Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|76885e8e-c5ca3090-7e473981-76879c48_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:53.128333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:53.128337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:53.128339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:53.128349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:53.128358Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:53.128372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:53.128530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:53.128538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:53.128551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:53.128647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1680 partition: 0 MaxSeqNo: 42 sessionId: src_id|76885e8e-c5ca3090-7e473981-76879c48_0
2025-09-30T14:54:53.129040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdf9e0da-cdf8d534-85e893ca-e8cf76cf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|76885e8e-c5ca3090-7e473981-76879c48_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:53.132023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76885e8e-c5ca3090-7e473981-76879c48_0] Write session: try to update token
2025-09-30T14:54:53.132043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76885e8e-c5ca3090-7e473981-76879c48_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:53.146598Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:53.146620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:53.146628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895847043529812:9770]
2025-09-30T14:54:53.146674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:53.146688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:53.146844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:53.146986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:53.147120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:53.147196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1680 sessionId: src_id|76885e8e-c5ca3090-7e473981-76879c48_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:53.147268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:53.147632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:53.147684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:53.150018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:53.150168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:53.150187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:53.150229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:53.151703Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:53.151719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:53.151721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:53.151723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:53.151732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895847043529812:9770]
2025-09-30T14:54:53.151735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895847043529812:9770]
2025-09-30T14:54:53.151739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895847043529812:9770]
2025-09-30T14:54:53.151774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:53.151782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:53.151784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:53.151794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:53.151809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:53.151814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:53.151930Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:53.150317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:53.188276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895847133293863:9749]
2025-09-30T14:54:53.188541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1679, pipe: [1:7555895847133293863:9749]
2025-09-30T14:54:53.268502Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:53.277192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:53.277227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:53.277431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:53.277506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:53.277571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:53.277636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:53.278049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:53.278053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:53.278121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:53.278179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:53.278237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:53.278299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:53.278474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:53.278478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:53.278553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:53.278619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:53.278689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:53.278766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:53.278808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:53.278811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:53.278889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:53.278958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:53.279020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:53.279087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:53.279131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:53.279134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:53.279212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:53.279299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:53.279367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:53.279434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:53.279509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:53.279520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:53.279591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:53.279660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:53.281891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:53.281943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:53.281946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:53.281971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1680 reason: error at write: Disconnected sessionId: src_id|76885e8e-c5ca3090-7e473981-76879c48_0
2025-09-30T14:54:53.279734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:53.279811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:53.279940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:53.279943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:53.280024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:53.280083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:53.280153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:53.280218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:53.280264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:53.280268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:53.280335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:53.280393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:53.280448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:53.280505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:53.280548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:53.280555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:53.280622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:53.280690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:53.280761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:53.280831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:53.280869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:53.280870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:53.280938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:53.280997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:53.281058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:53.281118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:53.281242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:53.281245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:53.281312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895847133293863:9749], now have 1 active actors on pipe
2025-09-30T14:54:53.281686Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:53.282152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1680 sessionId: src_id|76885e8e-c5ca3090-7e473981-76879c48_0 is DEAD
2025-09-30T14:54:53.282231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895847133293863:9749]
2025-09-30T14:54:53.282760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76885e8e-c5ca3090-7e473981-76879c48_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:53.282769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76885e8e-c5ca3090-7e473981-76879c48_0] Write session will restart in 0.008282s
2025-09-30T14:54:53.282793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76885e8e-c5ca3090-7e473981-76879c48_0] Write session: Do CDS request
2025-09-30T14:54:53.282799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76885e8e-c5ca3090-7e473981-76879c48_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:53.294721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76885e8e-c5ca3090-7e473981-76879c48_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:53.295015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:53.295031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1681
2025-09-30T14:54:53.295377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1681 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:53.295414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1681 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:53.295420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1681 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:53.295424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:53.295932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1681 sessionId:  describe result for acl check
2025-09-30T14:54:53.295966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:53.295969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:53.295971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:53.295978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895847133293923:10204] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:53.296681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895847133293923:10204] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:53.302176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895847133293923:10204] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:53.308073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895847133293923:10204] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:53.308095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895847133293923:10204] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:53.308099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895847133293923:10204] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:53.308110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1681 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:53.336443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:53.339747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:53.340118Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:53.340123Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:53.340136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:53.340201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:53.340238Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895847043530120:9784]
2025-09-30T14:54:53.340951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:53.341488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:53.341542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:53.341918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:53.341976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:53.341978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:53.341979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:53.341981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:53.341982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:53.341984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:53.341986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:53.341987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:53.341989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:53.341990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:53.341992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:53.341994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:53.341995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:53.341997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:53.341998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:53.342004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:53.342016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:53.342021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:53.342026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:53.342030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:53.342035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:53.342040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:53.342045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:53.342048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:53.342055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:53.342060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:53.342064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:53.342069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:53.342073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:53.342078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:53.342087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:53.342096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:53.342102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:53.342109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:53.342114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:53.342119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:53.342124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:53.342130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:53.342136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:53.342142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:53.342147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:53.342168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:53.342174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:53.342181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:53.342188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:53.342194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:53.342199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:53.342205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:53.342209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:53.342216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:53.342221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:53.342226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:53.342232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:53.342238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:53.342243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:53.342249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:53.342255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:53.342261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:53.342267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:53.342272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:53.342320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:53.349817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:53.350721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:53.350728Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:53.350731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:53.350736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:53.350745Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1680 [2:7555895847043530120:9784]
2025-09-30T14:54:53.350764Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:53.350782Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:53.350785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:53.350789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:53.350792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:53.350810Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:53.350820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:53.350828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:53.350896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:53.350898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:53.350901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:53.350904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:53.350907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:53.350982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:53.350985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:53.350999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:53.351013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:53.351033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:53.351052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895847043530115:9784]
2025-09-30T14:54:53.351056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895847043530115:9784]
2025-09-30T14:54:53.351058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895847043530115:9784]
2025-09-30T14:54:53.351071Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:53.351086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:53.351100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:53.351103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:53.351142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895847043530115:9784]
2025-09-30T14:54:53.351145Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:53.351407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:53.351415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:53.351418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:53.351423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:53.352206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1680
2025-09-30T14:54:53.352245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1680
2025-09-30T14:54:53.355812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895847133294008:10204], now have 1 active actors on pipe
2025-09-30T14:54:53.355842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895847133293865:2454], now have 1 active actors on pipe
2025-09-30T14:54:53.355871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:53.355879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:53.355925Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50e32ed6-3495be1e-f531aaef-b6a8756b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:53.355939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:53.355951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:53.355955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:53.355971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:53.355993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:53.356026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:53.356701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:53.356713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:53.356735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:53.356930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1681 partition: 0 MaxSeqNo: 42 sessionId: src_id|50e32ed6-3495be1e-f531aaef-b6a8756b_0
2025-09-30T14:54:53.359746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76885e8e-c5ca3090-7e473981-76879c48_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|50e32ed6-3495be1e-f531aaef-b6a8756b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:53.363208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50e32ed6-3495be1e-f531aaef-b6a8756b_0] Write session: try to update token
2025-09-30T14:54:53.363237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50e32ed6-3495be1e-f531aaef-b6a8756b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:53.369066Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:53.369088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:53.369090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:53.369092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:53.369101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895847043530115:9784]
2025-09-30T14:54:53.369106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895847043530115:9784]
2025-09-30T14:54:53.369109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895847043530115:9784]
2025-09-30T14:54:53.369146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:53.369152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:53.369154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:53.369300Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:53.371944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:53.371959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:53.371964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:53.382316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895847133294215:9749]
2025-09-30T14:54:53.382861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1680, pipe: [1:7555895847133294215:9749]
2025-09-30T14:54:53.411019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1681 sessionId: src_id|50e32ed6-3495be1e-f531aaef-b6a8756b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:53.414049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:53.502744Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:53.503813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895847133294215:9749], now have 1 active actors on pipe
2025-09-30T14:54:53.503865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:53.503886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:53.504364Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:53.507555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895847133294215:9749]
2025-09-30T14:54:53.507586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:53.507652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1681 reason: status is not ok: tablet will be restarted right now sessionId: src_id|50e32ed6-3495be1e-f531aaef-b6a8756b_0
2025-09-30T14:54:53.507819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1681 sessionId: src_id|50e32ed6-3495be1e-f531aaef-b6a8756b_0 is DEAD
2025-09-30T14:54:53.507937Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:53.508606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50e32ed6-3495be1e-f531aaef-b6a8756b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:53.508617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50e32ed6-3495be1e-f531aaef-b6a8756b_0] Write session will restart in 0.008468s
2025-09-30T14:54:53.508642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50e32ed6-3495be1e-f531aaef-b6a8756b_0] Write session: Do CDS request
2025-09-30T14:54:53.508649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50e32ed6-3495be1e-f531aaef-b6a8756b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:53.518792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50e32ed6-3495be1e-f531aaef-b6a8756b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:53.518950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:53.518969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1682
2025-09-30T14:54:53.519181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1682 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:53.519213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1682 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:53.519219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1682 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:53.519223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:53.520266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1682 sessionId:  describe result for acl check
2025-09-30T14:54:53.520293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:53.520296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:53.520298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:53.520304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895847133294225:10208] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:53.520854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895847133294225:10208] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:53.529351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895847133294225:10208] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:53.537265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895847133294225:10208] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:53.537292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895847133294225:10208] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:53.537296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895847133294225:10208] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:53.537311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1682 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:53.598949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:53.603152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:53.603433Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:53.603439Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:53.603451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:53.603541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:53.603582Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895847043530397:9788]
2025-09-30T14:54:53.604275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:53.605201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:53.605258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:53.605623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:53.605689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:53.605690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:53.605692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:53.605694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:53.605696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:53.605697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:53.605699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:53.605700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:53.605702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:53.605703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:53.605705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:53.605707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:53.605708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:53.605710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:53.605711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:53.605733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:53.605745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:53.605750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:53.605755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:53.605759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:53.605764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:53.605768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:53.605773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:53.605778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:53.605783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:53.605787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:53.605791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:53.605795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:53.605798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:53.605801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:53.605811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:53.605821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:53.605827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:53.605834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:53.605839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:53.605846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:53.605851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:53.605858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:53.605864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:53.605870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:53.605875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:53.605880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:53.605890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:53.605896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:53.605902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:53.605908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:53.605913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:53.605919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:53.605924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:53.605930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:53.605936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:53.605942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:53.605947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:53.605953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:53.605960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:53.605966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:53.605971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:53.605977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:53.605982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:53.605988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:53.606036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:53.604494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895847133294572:9749]
2025-09-30T14:54:53.613966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:53.615074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:53.615081Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:53.615084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:53.615088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:53.615097Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1681 [2:7555895847043530397:9788]
2025-09-30T14:54:53.615114Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:53.615130Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:53.615134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:53.615137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:53.615140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:53.615157Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:53.615166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:53.615173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:53.615233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:53.615236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:53.615238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:53.615265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:53.615268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:53.615342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:53.615345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:53.615358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:53.615369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:53.615386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:53.615405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895847043530392:9788]
2025-09-30T14:54:53.615409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895847043530392:9788]
2025-09-30T14:54:53.615411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895847043530392:9788]
2025-09-30T14:54:53.615421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:53.615435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:53.615450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:53.615453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:53.615493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895847043530392:9788]
2025-09-30T14:54:53.615496Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:53.615670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:53.615674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:53.615677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:53.615684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:53.616307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895847133294303:10208], now have 1 active actors on pipe
2025-09-30T14:54:53.616321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895847133294572:9749], now have 1 active actors on pipe
2025-09-30T14:54:53.616325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895847133294218:2454], now have 1 active actors on pipe
2025-09-30T14:54:53.617322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:53.617330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:53.617359Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9959d00-e3e89b77-9ffd6c5a-59704bfd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:53.617370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:53.617375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:53.617377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:53.617389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:53.617404Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:53.617423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:53.617993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:53.618002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:53.618019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:53.617086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1681
2025-09-30T14:54:53.617123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1681, pipe: [1:7555895847133294572:9749]
2025-09-30T14:54:53.617144Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1681
2025-09-30T14:54:53.618162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1682 partition: 0 MaxSeqNo: 42 sessionId: src_id|f9959d00-e3e89b77-9ffd6c5a-59704bfd_0
2025-09-30T14:54:53.619558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50e32ed6-3495be1e-f531aaef-b6a8756b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f9959d00-e3e89b77-9ffd6c5a-59704bfd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:53.622531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9959d00-e3e89b77-9ffd6c5a-59704bfd_0] Write session: try to update token
2025-09-30T14:54:53.622550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9959d00-e3e89b77-9ffd6c5a-59704bfd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:53.650717Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:53.650749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:53.650752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:53.650754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:53.650765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895847043530392:9788]
2025-09-30T14:54:53.650770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895847043530392:9788]
2025-09-30T14:54:53.650774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895847043530392:9788]
2025-09-30T14:54:53.650820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:53.650831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:53.650835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:53.650986Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:53.651470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:53.651485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:53.651490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:53.660505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1682 sessionId: src_id|f9959d00-e3e89b77-9ffd6c5a-59704bfd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:53.663510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:53.770762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:53.770781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:53.770837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1682 reason: error at write: Disconnected sessionId: src_id|f9959d00-e3e89b77-9ffd6c5a-59704bfd_0
2025-09-30T14:54:53.769680Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:53.769969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:53.769978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:53.770534Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:53.771015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1682 sessionId: src_id|f9959d00-e3e89b77-9ffd6c5a-59704bfd_0 is DEAD
2025-09-30T14:54:53.771074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895847133294572:9749]
2025-09-30T14:54:53.771101Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:53.771536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9959d00-e3e89b77-9ffd6c5a-59704bfd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:53.771548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9959d00-e3e89b77-9ffd6c5a-59704bfd_0] Write session will restart in 0.008406s
2025-09-30T14:54:53.771574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9959d00-e3e89b77-9ffd6c5a-59704bfd_0] Write session: Do CDS request
2025-09-30T14:54:53.771581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9959d00-e3e89b77-9ffd6c5a-59704bfd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:53.783694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9959d00-e3e89b77-9ffd6c5a-59704bfd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:53.787415Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:53.787434Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1683
2025-09-30T14:54:53.787621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1683 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:53.787651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1683 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:53.787657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1683 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:53.787663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:53.791725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1683 sessionId:  describe result for acl check
2025-09-30T14:54:53.791779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:53.791782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:53.791784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:53.791793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895847133294779:10214] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:53.792431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895847133294779:10214] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:53.800316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:53.805186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:53.805419Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:53.805424Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:53.805434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:53.805489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:53.805532Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895847043530664:9790]
2025-09-30T14:54:53.806308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:53.806688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:53.806738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:53.807012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:53.807080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:53.807088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:53.807090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:53.807091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:53.807092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:53.807094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:53.807095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:53.807096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:53.807098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:53.807099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:53.807100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:53.807102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:53.807103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:53.807104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:53.807106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:53.807111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:53.807124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:53.807128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:53.807133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:53.807135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:53.807138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:53.807141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:53.807143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:53.807146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:53.807149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:53.807152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:53.807155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:53.807157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:53.807160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:53.807162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:53.807169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:53.807174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:53.807178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:53.807183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:53.807187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:53.807190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:53.807194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:53.807200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:53.807205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:53.807213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:53.807218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:53.807224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:53.807229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:53.807234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:53.807239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:53.807272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:53.807278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:53.807284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:53.807289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:53.807294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:53.807299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:53.807305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:53.807311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:53.807316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:53.807321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:53.807327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:53.807331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:53.807338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:53.807348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:53.807354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:53.807403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:53.808699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895847133294779:10214] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:53.814498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895847133294779:10214] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:53.814519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895847133294779:10214] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:53.814523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895847133294779:10214] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:53.814534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1683 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:53.814350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:53.815413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:53.815427Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:53.815430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:53.815445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:53.815451Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1682 [2:7555895847043530664:9790]
2025-09-30T14:54:53.815469Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:53.815485Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:53.815489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:53.815492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:53.815495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:53.815513Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:53.815520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:53.815527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:53.815584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:53.815586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:53.815589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:53.815592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:53.815595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:53.815660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:53.815663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:53.815678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:53.815691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:53.815710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:53.815726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895847043530658:9790]
2025-09-30T14:54:53.815729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895847043530658:9790]
2025-09-30T14:54:53.815732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895847043530658:9790]
2025-09-30T14:54:53.815740Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:53.815750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:53.815754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:53.815755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:53.815756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:53.815770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:53.815774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:53.815784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895847133294928:10214], now have 1 active actors on pipe
2025-09-30T14:54:53.815787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895847133294585:2454], now have 1 active actors on pipe
2025-09-30T14:54:53.815818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895847043530658:9790]
2025-09-30T14:54:53.815827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:53.816040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:53.816270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:53.816281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:53.816312Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62bf1ba6-74203e8f-bc1a92ae-2bbbc847_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:53.816320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:53.816324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:53.816327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:53.816339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:53.816362Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:53.816378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:53.816733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:53.816742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:53.816756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:53.818755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9959d00-e3e89b77-9ffd6c5a-59704bfd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|62bf1ba6-74203e8f-bc1a92ae-2bbbc847_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:53.815825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1682
2025-09-30T14:54:53.815853Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1682
2025-09-30T14:54:53.816891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1683 partition: 0 MaxSeqNo: 42 sessionId: src_id|62bf1ba6-74203e8f-bc1a92ae-2bbbc847_0
2025-09-30T14:54:53.821998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62bf1ba6-74203e8f-bc1a92ae-2bbbc847_0] Write session: try to update token
2025-09-30T14:54:53.822021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62bf1ba6-74203e8f-bc1a92ae-2bbbc847_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:53.833568Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:53.833591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:53.833593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:53.833596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:53.833605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895847043530658:9790]
2025-09-30T14:54:53.833610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895847043530658:9790]
2025-09-30T14:54:53.833614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895847043530658:9790]
2025-09-30T14:54:53.833653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:53.833661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:53.833664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:53.833837Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:53.835449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:53.835463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:53.835468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:53.843583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1683 sessionId: src_id|62bf1ba6-74203e8f-bc1a92ae-2bbbc847_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:53.846503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:53.875357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895847133294937:9749]
2025-09-30T14:54:53.875785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1682, pipe: [1:7555895847133294937:9749]
2025-09-30T14:54:53.949361Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:53.950104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:53.950114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:53.950160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895847133294937:9749], now have 1 active actors on pipe
2025-09-30T14:54:53.951437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:53.951462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:53.951544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1683 reason: error at write: Disconnected sessionId: src_id|62bf1ba6-74203e8f-bc1a92ae-2bbbc847_0
2025-09-30T14:54:53.951720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1683 sessionId: src_id|62bf1ba6-74203e8f-bc1a92ae-2bbbc847_0 is DEAD
2025-09-30T14:54:53.951859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:53.951892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895847133294937:9749]
2025-09-30T14:54:53.951361Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:53.952782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62bf1ba6-74203e8f-bc1a92ae-2bbbc847_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:53.952794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62bf1ba6-74203e8f-bc1a92ae-2bbbc847_0] Write session will restart in 0.006413s
2025-09-30T14:54:53.952818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62bf1ba6-74203e8f-bc1a92ae-2bbbc847_0] Write session: Do CDS request
2025-09-30T14:54:53.952826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62bf1ba6-74203e8f-bc1a92ae-2bbbc847_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:53.960793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62bf1ba6-74203e8f-bc1a92ae-2bbbc847_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:53.961153Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:53.961171Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1684
2025-09-30T14:54:53.961396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1684 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:53.961427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1684 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:53.961434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1684 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:53.961438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:53.961858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1684 sessionId:  describe result for acl check
2025-09-30T14:54:53.961898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:53.961900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:53.961901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:53.961909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895847133294954:10218] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:53.962458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895847133294954:10218] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:53.968816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895847133294954:10218] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:53.972473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895847133294954:10218] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:53.972493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895847133294954:10218] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:53.972496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895847133294954:10218] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:53.972506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1684 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:54.003279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:54.005713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:54.006015Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:54.006019Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:54.006032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:54.006090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:54.006133Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895851338498229:9793]
2025-09-30T14:54:54.006870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:54.007291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:54.007339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:54.007687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:54.007761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:54.007762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:54.007764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:54.007765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:54.007766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:54.007768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:54.007769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:54.007770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:54.007771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:54.007773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:54.007774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.007776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.007777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.007778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:54.007780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:54.007785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:54.007795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:54.007799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:54.007803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:54.007806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:54.007811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:54.007815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:54.007818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:54.007822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:54.007827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:54.007830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.007834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.007837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.007841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:54.007844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:54.007852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:54.007860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:54.007867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:54.007872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:54.007876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:54.007882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:54.007886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:54.007891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:54.007897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:54.007902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:54.007906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:54.007911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:54.007916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:54.007921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:54.007925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:54.007929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:54.007934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:54.007939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:54.007945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:54.007951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:54.007955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.007960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.007965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.007969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.007974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.007979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.007982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:54.007987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:54.007992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:54.007997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:54.008039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:54.015501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:54.016805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:54.016819Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:54.016821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:54.016824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:54.016830Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1683 [2:7555895851338498229:9793]
2025-09-30T14:54:54.016843Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:54.016857Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:54.016860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:54.016862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:54.016863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:54.016876Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:54.016884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:54.016892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:54.016946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.016954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.016957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.016960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:54.016964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:54.017032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:54.017040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.017052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.017063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.017079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:54.017096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895847133294939:2454], now have 1 active actors on pipe
2025-09-30T14:54:54.017099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895847133295057:10218], now have 1 active actors on pipe
2025-09-30T14:54:54.017106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895851338498223:9793]
2025-09-30T14:54:54.017114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895851338498223:9793]
2025-09-30T14:54:54.017116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895851338498223:9793]
2025-09-30T14:54:54.017130Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:54.017150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:54.017167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:54.017170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:54.017169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:54.017174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:54.017177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:54.017206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895851338498223:9793]
2025-09-30T14:54:54.017218Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:54.017225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:54.017374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:54.017379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:54.017402Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7dda7003-7978e0f7-807fa0c0-8ef2e609_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:54.017410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:54.017413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:54.017415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:54.017426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:54.017436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:54.017203Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1683
2025-09-30T14:54:54.017228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1683
2025-09-30T14:54:54.017457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:54.017695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:54.017706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:54.017737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:54.017855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1684 partition: 0 MaxSeqNo: 42 sessionId: src_id|7dda7003-7978e0f7-807fa0c0-8ef2e609_0
2025-09-30T14:54:54.018284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62bf1ba6-74203e8f-bc1a92ae-2bbbc847_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7dda7003-7978e0f7-807fa0c0-8ef2e609_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:54.021283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dda7003-7978e0f7-807fa0c0-8ef2e609_0] Write session: try to update token
2025-09-30T14:54:54.021303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dda7003-7978e0f7-807fa0c0-8ef2e609_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:54.033989Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:54.034009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:54.034013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:54.034015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:54.034025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895851338498223:9793]
2025-09-30T14:54:54.034030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895851338498223:9793]
2025-09-30T14:54:54.034035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895851338498223:9793]
2025-09-30T14:54:54.034079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:54.034086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.034089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:54.034261Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:54.039011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1684 sessionId: src_id|7dda7003-7978e0f7-807fa0c0-8ef2e609_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:54.039311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:54.039336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:54.039340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:54.041965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:54.052027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895851428262587:9749]
2025-09-30T14:54:54.052349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1683, pipe: [1:7555895851428262587:9749]
2025-09-30T14:54:54.153033Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:54.153651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:54.153671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:54.153712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895851428262587:9749], now have 1 active actors on pipe
2025-09-30T14:54:54.153961Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:54.153951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895851428262587:9749]
2025-09-30T14:54:54.153984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:54.153986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:54.153990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:54.154056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1684 reason: error at write: Disconnected sessionId: src_id|7dda7003-7978e0f7-807fa0c0-8ef2e609_0
2025-09-30T14:54:54.154244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1684 sessionId: src_id|7dda7003-7978e0f7-807fa0c0-8ef2e609_0 is DEAD
2025-09-30T14:54:54.154418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dda7003-7978e0f7-807fa0c0-8ef2e609_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:54.154431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dda7003-7978e0f7-807fa0c0-8ef2e609_0] Write session will restart in 0.007570s
2025-09-30T14:54:54.154456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dda7003-7978e0f7-807fa0c0-8ef2e609_0] Write session: Do CDS request
2025-09-30T14:54:54.154471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dda7003-7978e0f7-807fa0c0-8ef2e609_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:54.162783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dda7003-7978e0f7-807fa0c0-8ef2e609_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:54.162893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:54.162918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1685
2025-09-30T14:54:54.163043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1685 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:54.163078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1685 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:54.163096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1685 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:54.163105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:54.163557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1685 sessionId:  describe result for acl check
2025-09-30T14:54:54.163596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:54.163604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:54.163606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:54.163612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895851428262651:10223] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:54.164183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895851428262651:10223] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:54.167084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895851428262651:10223] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:54.170755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895851428262651:10223] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:54.170776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895851428262651:10223] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:54.170780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895851428262651:10223] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:54.170789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1685 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:54.176186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:54.179048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:54.179278Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:54.179289Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:54.179300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:54.179356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:54.179401Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895851338498497:9795]
2025-09-30T14:54:54.180117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:54.180453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:54.180501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:54.180869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:54.180935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:54.180941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:54.180943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:54.180944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:54.180945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:54.180947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:54.180948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:54.180950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:54.180951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:54.180953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:54.180954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.180955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.180957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.180958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:54.180959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:54.180966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:54.180977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:54.180982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:54.180987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:54.180992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:54.180996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:54.181001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:54.181005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:54.181009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:54.181015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:54.181019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.181023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.181026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.181030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:54.181033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:54.181041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:54.181049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:54.181056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:54.181062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:54.181067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:54.181085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:54.181096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:54.181102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:54.181112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:54.181119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:54.181124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:54.181130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:54.181136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:54.181142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:54.181152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:54.181158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:54.181168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:54.181175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:54.181185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:54.181192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:54.181202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.181207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.181216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.181222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.181230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.181236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.181241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:54.181256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:54.181260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:54.181266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:54.181311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:54.187084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:54.188042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:54.188055Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:54.188058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:54.188062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:54.188068Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1684 [2:7555895851338498497:9795]
2025-09-30T14:54:54.188084Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:54.188102Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:54.188105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:54.188108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:54.188111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:54.188127Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:54.188141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:54.188154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:54.188218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.188226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.188228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.188232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:54.188235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:54.188310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:54.188323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.188336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.188350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.188368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:54.188388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895851428262854:10223], now have 1 active actors on pipe
2025-09-30T14:54:54.188392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895851428262594:2454], now have 1 active actors on pipe
2025-09-30T14:54:54.188399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895851338498492:9795]
2025-09-30T14:54:54.188401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895851338498492:9795]
2025-09-30T14:54:54.188404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895851338498492:9795]
2025-09-30T14:54:54.188417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:54.188431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:54.188440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:54.188444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:54.188446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:54.188447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:54.188465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:54.188502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895851338498492:9795]
2025-09-30T14:54:54.188509Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:54.188543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:54.188749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:54.188758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:54.188786Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9916f278-b006520e-8944882b-5221c1b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:54.188794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:54.188805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:54.188808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:54.188820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:54.188831Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:54.188847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:54.189019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:54.189034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:54.189058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:54.189597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dda7003-7978e0f7-807fa0c0-8ef2e609_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9916f278-b006520e-8944882b-5221c1b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:54.188542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1684
2025-09-30T14:54:54.188589Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1684
2025-09-30T14:54:54.189187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1685 partition: 0 MaxSeqNo: 42 sessionId: src_id|9916f278-b006520e-8944882b-5221c1b4_0
2025-09-30T14:54:54.192457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9916f278-b006520e-8944882b-5221c1b4_0] Write session: try to update token
2025-09-30T14:54:54.192477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9916f278-b006520e-8944882b-5221c1b4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:54.208691Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:54.208718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:54.208728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895851338498492:9795]
2025-09-30T14:54:54.208789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:54.208807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:54.208993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:54.209155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:54.209312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:54.209469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:54.209850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:54.209916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1685 sessionId: src_id|9916f278-b006520e-8944882b-5221c1b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:54.209900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:54.212700Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:54.212719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:54.212721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:54.212724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:54.212733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895851338498492:9795]
2025-09-30T14:54:54.212737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895851338498492:9795]
2025-09-30T14:54:54.212741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895851338498492:9795]
2025-09-30T14:54:54.212779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:54.212782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:54.212788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:54.212789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.212791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:54.212796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:54.212940Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:54.213166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:54.254271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895851428262973:9749]
2025-09-30T14:54:54.254565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1684, pipe: [1:7555895851428262973:9749]
2025-09-30T14:54:54.330626Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:54.331066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:54.331083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:54.331107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895851428262973:9749], now have 1 active actors on pipe
2025-09-30T14:54:54.331435Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:54.331502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:54.331509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:54.331513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:54.331569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895851428262973:9749]
2025-09-30T14:54:54.331591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1685 reason: error at write: Disconnected sessionId: src_id|9916f278-b006520e-8944882b-5221c1b4_0
2025-09-30T14:54:54.331831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1685 sessionId: src_id|9916f278-b006520e-8944882b-5221c1b4_0 is DEAD
2025-09-30T14:54:54.332199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9916f278-b006520e-8944882b-5221c1b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:54.332243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9916f278-b006520e-8944882b-5221c1b4_0] Write session will restart in 0.006949s
2025-09-30T14:54:54.332283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9916f278-b006520e-8944882b-5221c1b4_0] Write session: Do CDS request
2025-09-30T14:54:54.332293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9916f278-b006520e-8944882b-5221c1b4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:54.341136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9916f278-b006520e-8944882b-5221c1b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:54.342823Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:54.342845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1686
2025-09-30T14:54:54.343140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1686 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:54.343175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1686 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:54.343185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1686 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:54.343190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:54.343722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1686 sessionId:  describe result for acl check
2025-09-30T14:54:54.343762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:54.343767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:54.343769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:54.343777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895851428263009:10234] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:54.344382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895851428263009:10234] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:54.346954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895851428263009:10234] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:54.353413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895851428263009:10234] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:54.353434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895851428263009:10234] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:54.353438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895851428263009:10234] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:54.353447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1686 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:54.372535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:54.378069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:54.378387Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:54.378400Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:54.378414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:54.378491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:54.378537Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895851338498805:9810]
2025-09-30T14:54:54.379283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:54.379715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:54.379795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:54.380193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:54.380255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:54.380262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:54.380263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:54.380264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:54.380267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:54.380278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:54.380279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:54.380281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:54.380283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:54.380284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:54.380286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.380287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.380288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.380289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:54.380291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:54.380297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:54.380309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:54.380314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:54.380318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:54.380323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:54.380328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:54.380333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:54.380338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:54.380343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:54.380348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:54.380352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.380356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.380361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.380365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:54.380369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:54.380379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:54.380388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:54.380395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:54.380402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:54.380408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:54.380414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:54.380419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:54.380425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:54.380432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:54.380437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:54.380443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:54.380449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:54.380454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:54.380460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:54.380465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:54.380472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:54.380477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:54.380483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:54.380490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:54.380496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:54.380502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.380508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.380513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.380518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.380523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.380529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.380534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:54.380539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:54.380545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:54.380550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:54.380599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:54.394072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:54.395291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:54.395300Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:54.395302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:54.395308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:54.395316Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1685 [2:7555895851338498805:9810]
2025-09-30T14:54:54.395336Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:54.395356Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:54.395361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:54.395364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:54.395366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:54.395383Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:54.395390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:54.395397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:54.395465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.395467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.395469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.395473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:54.395476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:54.395580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:54.395583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.395599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.395612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.395629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:54.395646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895851428263210:10234], now have 1 active actors on pipe
2025-09-30T14:54:54.395649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895851428262974:2454], now have 1 active actors on pipe
2025-09-30T14:54:54.395653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895851338498800:9810]
2025-09-30T14:54:54.395655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895851338498800:9810]
2025-09-30T14:54:54.395658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895851338498800:9810]
2025-09-30T14:54:54.395668Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:54.395681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:54.395686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:54.395690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:54.395692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:54.395700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:54.395703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:54.395737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895851338498800:9810]
2025-09-30T14:54:54.395746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:54.395742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1685
2025-09-30T14:54:54.395751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1685
2025-09-30T14:54:54.395989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:54.396196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:54.396210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:54.396240Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cbc4e20c-1d8b5deb-db3a30c6-c3bfc8ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:54.396249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:54.396253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:54.396255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:54.396265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:54.396276Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:54.396292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:54.396502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:54.396526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:54.396555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:54.396673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1686 partition: 0 MaxSeqNo: 42 sessionId: src_id|cbc4e20c-1d8b5deb-db3a30c6-c3bfc8ca_0
2025-09-30T14:54:54.397042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9916f278-b006520e-8944882b-5221c1b4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cbc4e20c-1d8b5deb-db3a30c6-c3bfc8ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:54.400038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc4e20c-1d8b5deb-db3a30c6-c3bfc8ca_0] Write session: try to update token
2025-09-30T14:54:54.400060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc4e20c-1d8b5deb-db3a30c6-c3bfc8ca_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:54.414023Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:54.414048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:54.414051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:54.414054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:54.414067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895851338498800:9810]
2025-09-30T14:54:54.414074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895851338498800:9810]
2025-09-30T14:54:54.414082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895851338498800:9810]
2025-09-30T14:54:54.414133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:54.414134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:54.414141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:54.414146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:54.414154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.414158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:54.414375Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:54.419824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1686 sessionId: src_id|cbc4e20c-1d8b5deb-db3a30c6-c3bfc8ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:54.422750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:54.431450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895851428263330:9749]
2025-09-30T14:54:54.431795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1685, pipe: [1:7555895851428263330:9749]
2025-09-30T14:54:54.529282Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:54.529659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:54.529667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:54.529702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895851428263330:9749], now have 1 active actors on pipe
2025-09-30T14:54:54.530004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895851428263330:9749]
2025-09-30T14:54:54.530019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:54.530024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:54.530039Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:54.530090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1686 reason: error at write: Disconnected sessionId: src_id|cbc4e20c-1d8b5deb-db3a30c6-c3bfc8ca_0
2025-09-30T14:54:54.530271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1686 sessionId: src_id|cbc4e20c-1d8b5deb-db3a30c6-c3bfc8ca_0 is DEAD
2025-09-30T14:54:54.530427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc4e20c-1d8b5deb-db3a30c6-c3bfc8ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:54.530441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc4e20c-1d8b5deb-db3a30c6-c3bfc8ca_0] Write session will restart in 0.009622s
2025-09-30T14:54:54.530478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc4e20c-1d8b5deb-db3a30c6-c3bfc8ca_0] Write session: Do CDS request
2025-09-30T14:54:54.530486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc4e20c-1d8b5deb-db3a30c6-c3bfc8ca_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:54.530020Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:54.542256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc4e20c-1d8b5deb-db3a30c6-c3bfc8ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:54.542485Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:54.542506Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1687
2025-09-30T14:54:54.542640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1687 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:54.542678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1687 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:54.542689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1687 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:54.542693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:54.544654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1687 sessionId:  describe result for acl check
2025-09-30T14:54:54.544700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:54.544702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:54.544704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:54.544712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895851428263363:10238] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:54.545318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895851428263363:10238] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:54.547973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895851428263363:10238] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:54.550528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895851428263363:10238] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:54.550545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895851428263363:10238] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:54.550549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895851428263363:10238] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:54.550559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1687 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:54.560345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:54.563159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:54.563385Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:54.563398Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:54.563410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:54.563475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:54.563521Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895851338499088:9813]
2025-09-30T14:54:54.564115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:54.564437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:54.564483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:54.564737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:54.564789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:54.564794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:54.564795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:54.564796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:54.564797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:54.564798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:54.564799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:54.564800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:54.564801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:54.564801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:54.564802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.564804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.564804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.564805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:54.564806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:54.564810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:54.564817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:54.564820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:54.564822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:54.564825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:54.564827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:54.564830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:54.564832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:54.564835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:54.564839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:54.564842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.564844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.564847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.564849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:54.564851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:54.564857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:54.564862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:54.564867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:54.564871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:54.564873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:54.564877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:54.564880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:54.564883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:54.564887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:54.564893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:54.564898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:54.564903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:54.564908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:54.564913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:54.564917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:54.564923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:54.564928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:54.564933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:54.564935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:54.564938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:54.564942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.564945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.564947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.564950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.564953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.564956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.564958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:54.564961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:54.564963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:54.564966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:54.564993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:54.574291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:54.575180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:54.575186Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:54.575189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:54.575193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:54.575200Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1686 [2:7555895851338499088:9813]
2025-09-30T14:54:54.575220Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:54.575238Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:54.575262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:54.575265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:54.575268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:54.575286Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:54.575293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:54.575300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:54.575364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.575367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.575369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.575373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:54.575376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:54.575451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:54.575454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.575468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.575481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.575501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:54.575521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895851428263536:10238], now have 1 active actors on pipe
2025-09-30T14:54:54.575537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895851428263333:2454], now have 1 active actors on pipe
2025-09-30T14:54:54.575544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895851338499083:9813]
2025-09-30T14:54:54.575548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895851338499083:9813]
2025-09-30T14:54:54.575550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895851338499083:9813]
2025-09-30T14:54:54.575565Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:54.575579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:54.575567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1686
2025-09-30T14:54:54.575594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:54.575582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1686
2025-09-30T14:54:54.575605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:54.575623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:54.575627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:54.575630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:54.575652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:54.575662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:54.575679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895851338499083:9813]
2025-09-30T14:54:54.575690Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:54.575707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:54.575727Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13f20164-211dbc4f-42c5b815-f0dc1285_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:54.575739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:54.575743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:54.575748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:54.575758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:54.575773Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:54.576011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:54.576206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:54.576215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:54.576229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:54.576366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1687 partition: 0 MaxSeqNo: 42 sessionId: src_id|13f20164-211dbc4f-42c5b815-f0dc1285_0
2025-09-30T14:54:54.579437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc4e20c-1d8b5deb-db3a30c6-c3bfc8ca_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|13f20164-211dbc4f-42c5b815-f0dc1285_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:54.582377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13f20164-211dbc4f-42c5b815-f0dc1285_0] Write session: try to update token
2025-09-30T14:54:54.582400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13f20164-211dbc4f-42c5b815-f0dc1285_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:54.588580Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:54.588604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:54.588607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:54.588610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:54.588621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895851338499083:9813]
2025-09-30T14:54:54.588626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895851338499083:9813]
2025-09-30T14:54:54.588631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895851338499083:9813]
2025-09-30T14:54:54.588672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:54.588679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.588683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:54.588799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:54.588816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:54.588820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:54.588850Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:54.600740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1687 sessionId: src_id|13f20164-211dbc4f-42c5b815-f0dc1285_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:54.603838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:54.631366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895851428263702:9749]
2025-09-30T14:54:54.631725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1686, pipe: [1:7555895851428263702:9749]
2025-09-30T14:54:54.709192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895851428263702:9749]
2025-09-30T14:54:54.709235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:54.709238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:54.709299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1687 reason: error at write: Disconnected sessionId: src_id|13f20164-211dbc4f-42c5b815-f0dc1285_0
2025-09-30T14:54:54.709487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1687 sessionId: src_id|13f20164-211dbc4f-42c5b815-f0dc1285_0 is DEAD
2025-09-30T14:54:54.709489Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:54.709680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13f20164-211dbc4f-42c5b815-f0dc1285_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:54.709693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13f20164-211dbc4f-42c5b815-f0dc1285_0] Write session will restart in 0.006130s
2025-09-30T14:54:54.709733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13f20164-211dbc4f-42c5b815-f0dc1285_0] Write session: Do CDS request
2025-09-30T14:54:54.709740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13f20164-211dbc4f-42c5b815-f0dc1285_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:54.708045Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:54.708859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:54.708872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:54.708899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895851428263702:9749], now have 1 active actors on pipe
2025-09-30T14:54:54.710307Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:54.716838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13f20164-211dbc4f-42c5b815-f0dc1285_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:54.716943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:54.716961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1688
2025-09-30T14:54:54.717105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1688 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:54.717141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1688 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:54.717153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1688 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:54.717158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:54.717599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1688 sessionId:  describe result for acl check
2025-09-30T14:54:54.717642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:54.717659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:54.717661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:54.717668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895851428263738:8097] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:54.718234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895851428263738:8097] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:54.720685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895851428263738:8097] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:54.723680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895851428263738:8097] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:54.723697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895851428263738:8097] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:54.723700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895851428263738:8097] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:54.723711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1688 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:54.732348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:54.735279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:54.735569Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:54.735583Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:54.735595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:54.735656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:54.735716Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895851338499360:9815]
2025-09-30T14:54:54.736415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:54.736854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:54.736933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:54.737327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:54.737428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:54.737437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:54.737439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:54.737440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:54.737442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:54.737443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:54.737444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:54.737446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:54.737447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:54.737449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:54.737450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.737451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.737453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.737454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:54.737456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:54.737462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:54.737472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:54.737477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:54.737482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:54.737486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:54.737490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:54.737494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:54.737498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:54.737502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:54.737507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:54.737511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.737516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.737520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.737525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:54.737529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:54.737539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:54.737547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:54.737555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:54.737562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:54.737566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:54.737572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:54.737577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:54.737583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:54.737588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:54.737594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:54.737604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:54.737610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:54.737620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:54.737625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:54.737630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:54.737634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:54.737640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:54.737646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:54.737651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:54.737657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:54.737665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.737676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.737681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.737692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.737702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.737707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.737726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:54.737737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:54.737742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:54.737753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:54.737800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:54.743891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:54.744864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:54.744885Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:54.744889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:54.744893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:54.744902Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1687 [2:7555895851338499360:9815]
2025-09-30T14:54:54.744920Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:54.744936Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:54.744944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:54.744948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:54.744951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:54.744972Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:54.744990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:54.744997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:54.745069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.745081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.745084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.745087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:54.745090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:54.745168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:54.745176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.745189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.745201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.745219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:54.745245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895851428263913:8097], now have 1 active actors on pipe
2025-09-30T14:54:54.745254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895851428263704:2454], now have 1 active actors on pipe
2025-09-30T14:54:54.745262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895851338499355:9815]
2025-09-30T14:54:54.745269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895851338499355:9815]
2025-09-30T14:54:54.745272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895851338499355:9815]
2025-09-30T14:54:54.745287Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:54.745303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:54.745323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:54.745335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:54.745355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:54.745360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:54.745363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:54.745382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895851338499355:9815]
2025-09-30T14:54:54.745339Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1687
2025-09-30T14:54:54.745385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:54.745341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1687
2025-09-30T14:54:54.745408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:54.745449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:54.745458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:54.745485Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd6207ab-45004d34-f7a4edcd-5bf15067_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:54.745495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:54.745499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:54.745501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:54.745512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:54.745521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:54.745536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:54.745737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:54.745783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:54.745822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:54.745917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1688 partition: 0 MaxSeqNo: 42 sessionId: src_id|fd6207ab-45004d34-f7a4edcd-5bf15067_0
2025-09-30T14:54:54.746301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13f20164-211dbc4f-42c5b815-f0dc1285_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fd6207ab-45004d34-f7a4edcd-5bf15067_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:54.749260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd6207ab-45004d34-f7a4edcd-5bf15067_0] Write session: try to update token
2025-09-30T14:54:54.749286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd6207ab-45004d34-f7a4edcd-5bf15067_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:54.758415Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:54.758442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:54.758445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:54.758447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:54.758458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895851338499355:9815]
2025-09-30T14:54:54.758463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895851338499355:9815]
2025-09-30T14:54:54.758467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895851338499355:9815]
2025-09-30T14:54:54.758511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:54.758516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:54.758519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.758521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:54.758522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:54.758526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:54.758695Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:54.769336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1688 sessionId: src_id|fd6207ab-45004d34-f7a4edcd-5bf15067_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:54.772524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:54.809302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895851428264061:9749]
2025-09-30T14:54:54.809566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1687, pipe: [1:7555895851428264061:9749]
2025-09-30T14:54:54.880618Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:54.881411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:54.881432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:54.881452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895851428264061:9749], now have 1 active actors on pipe
2025-09-30T14:54:54.881684Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:54.881809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:54.881822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895851428264061:9749]
2025-09-30T14:54:54.881848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:54.881936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1688 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fd6207ab-45004d34-f7a4edcd-5bf15067_0
2025-09-30T14:54:54.882118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1688 sessionId: src_id|fd6207ab-45004d34-f7a4edcd-5bf15067_0 is DEAD
2025-09-30T14:54:54.882273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd6207ab-45004d34-f7a4edcd-5bf15067_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:54.882284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd6207ab-45004d34-f7a4edcd-5bf15067_0] Write session will restart in 0.005555s
2025-09-30T14:54:54.882308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd6207ab-45004d34-f7a4edcd-5bf15067_0] Write session: Do CDS request
2025-09-30T14:54:54.882316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd6207ab-45004d34-f7a4edcd-5bf15067_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:54.890183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd6207ab-45004d34-f7a4edcd-5bf15067_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:54.890238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:54.890259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1689
2025-09-30T14:54:54.890412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1689 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:54.890441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1689 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:54.890447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1689 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:54.890451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:54.890930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1689 sessionId:  describe result for acl check
2025-09-30T14:54:54.890959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:54.890961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:54.890963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:54.890970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895851428264080:8093] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:54.891581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895851428264080:8093] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:54.894695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895851428264080:8093] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:54.899514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895851428264080:8093] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:54.899535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895851428264080:8093] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:54.899542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895851428264080:8093] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:54.899552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1689 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:54.908319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:54.910710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:54.910955Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:54.910964Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:54.910975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:54.911028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:54.911078Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895851338499636:9818]
2025-09-30T14:54:54.911782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:54.912171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:54.912245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:54.912640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:54.912748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:54.912757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:54.912758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:54.912759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:54.912760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:54.912761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:54.912762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:54.912764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:54.912766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:54.912767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:54.912768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.912770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.912771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.912772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:54.912773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:54.912780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:54.912792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:54.912797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:54.912801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:54.912806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:54.912810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:54.912814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:54.912818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:54.912822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:54.912827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:54.912830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.912835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.912839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.912843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:54.912846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:54.912856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:54.912864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:54.912871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:54.912878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:54.912883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:54.912889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:54.912894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:54.912898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:54.912907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:54.912912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:54.912916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:54.912922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:54.912927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:54.912932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:54.912936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:54.912942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:54.912954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:54.912959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:54.912969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:54.912974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:54.912986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.912992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.912996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.913002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.913007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.913018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.913022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:54.913033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:54.913038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:54.913049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:54.913093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:54.918964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:54.920107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:54.920135Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:54.920138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:54.920142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:54.920149Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1688 [2:7555895851338499636:9818]
2025-09-30T14:54:54.920166Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:54.920184Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:54.920186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:54.920190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:54.920192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:54.920209Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:54.920216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:54.920225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:54.920293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.920303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.920305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.920310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:54.920313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:54.920383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:54.920394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.920411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:54.920423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:54.920441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:54.920460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895851428264264:8093], now have 1 active actors on pipe
2025-09-30T14:54:54.920464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895851428264063:2454], now have 1 active actors on pipe
2025-09-30T14:54:54.920471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895851338499631:9818]
2025-09-30T14:54:54.920473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895851338499631:9818]
2025-09-30T14:54:54.920476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895851338499631:9818]
2025-09-30T14:54:54.920490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:54.920506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:54.920506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:54.920510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:54.920513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:54.920522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:54.920526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:54.920566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895851338499631:9818]
2025-09-30T14:54:54.920575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:54.920577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:54.920542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1688
2025-09-30T14:54:54.920606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:54.920595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1688
2025-09-30T14:54:54.920615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:54.920652Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59694d74-b00e9563-a492aef-3b0fe1f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:54.920665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:54.920669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:54.920675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:54.920686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:54.920699Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:54.920726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:54.920889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:54.920899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:54.920915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:54.921042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1689 partition: 0 MaxSeqNo: 42 sessionId: src_id|59694d74-b00e9563-a492aef-3b0fe1f9_0
2025-09-30T14:54:54.921465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd6207ab-45004d34-f7a4edcd-5bf15067_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|59694d74-b00e9563-a492aef-3b0fe1f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:54.924634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59694d74-b00e9563-a492aef-3b0fe1f9_0] Write session: try to update token
2025-09-30T14:54:54.924657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59694d74-b00e9563-a492aef-3b0fe1f9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:54.933394Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:54.933437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:54.933440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:54.933442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:54.933452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895851338499631:9818]
2025-09-30T14:54:54.933457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895851338499631:9818]
2025-09-30T14:54:54.933462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895851338499631:9818]
2025-09-30T14:54:54.933506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:54.933509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:54.933513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:54.933516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:54.933526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:54.933706Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:54.934295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:54.947277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1689 sessionId: src_id|59694d74-b00e9563-a492aef-3b0fe1f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:54.950344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:54.981848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895851428264421:9749]
2025-09-30T14:54:54.982172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1688, pipe: [1:7555895851428264421:9749]
2025-09-30T14:54:55.053526Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:55.054788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:55.054807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:55.054829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895851428264421:9749], now have 1 active actors on pipe
2025-09-30T14:54:55.055128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895851428264421:9749]
2025-09-30T14:54:55.055170Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:55.055127Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:55.055175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:55.055178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:55.055291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1689 reason: error at write: Disconnected sessionId: src_id|59694d74-b00e9563-a492aef-3b0fe1f9_0
2025-09-30T14:54:55.055532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1689 sessionId: src_id|59694d74-b00e9563-a492aef-3b0fe1f9_0 is DEAD
2025-09-30T14:54:55.059496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59694d74-b00e9563-a492aef-3b0fe1f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:55.059509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59694d74-b00e9563-a492aef-3b0fe1f9_0] Write session will restart in 0.008263s
2025-09-30T14:54:55.059540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59694d74-b00e9563-a492aef-3b0fe1f9_0] Write session: Do CDS request
2025-09-30T14:54:55.059551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59694d74-b00e9563-a492aef-3b0fe1f9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:55.068786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59694d74-b00e9563-a492aef-3b0fe1f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:55.071606Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:55.071626Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1690
2025-09-30T14:54:55.071797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1690 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:55.071872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1690 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:55.071884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1690 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:55.071890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:55.072394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1690 sessionId:  describe result for acl check
2025-09-30T14:54:55.072439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:55.072441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:55.072443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:55.072449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895855723231802:8088] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:55.073071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895855723231802:8088] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:55.076080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895855723231802:8088] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:55.080707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895855723231802:8088] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:55.080726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895855723231802:8088] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:55.080729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895855723231802:8088] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:55.080737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1690 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:55.092951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:55.093567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:55.093822Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:55.093826Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:55.093838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:55.093894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:55.093937Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895855633467206:9820]
2025-09-30T14:54:55.094416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:55.094712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:55.094746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:55.095011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:55.095062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:55.095063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:55.095064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:55.095065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:55.095066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:55.095067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:55.095068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:55.095069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:55.095069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:55.095070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:55.095071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.095072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.095073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.095073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:55.095074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:55.095078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:55.095085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:55.095088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:55.095091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:55.095093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:55.095095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:55.095098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:55.095100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:55.095103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:55.095105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:55.095107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.095110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.095112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.095114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:55.095117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:55.095123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:55.095127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:55.095132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:55.095135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:55.095138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:55.095141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:55.095144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:55.095147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:55.095150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:55.095154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:55.095156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:55.095159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:55.095162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:55.095165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:55.095167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:55.095170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:55.095173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:55.095176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:55.095179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:55.095184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:55.095188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.095190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.095193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.095196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.095198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.095201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.095204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:55.095206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:55.095209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:55.095212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:55.095238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:55.101957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:55.103666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1689
2025-09-30T14:54:55.103284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:55.103301Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:55.103302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:55.103306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:55.103312Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1689 [2:7555895855633467206:9820]
2025-09-30T14:54:55.103326Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:55.103340Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:55.103342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:55.103346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:55.103348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:55.103366Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:55.103373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:55.103381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:55.103451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.103454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.103457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.103460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:55.103463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:55.103520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:55.103522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.103532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.103539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.103548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:55.103562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895855633467201:9820]
2025-09-30T14:54:55.103565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895855633467201:9820]
2025-09-30T14:54:55.103566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895855633467201:9820]
2025-09-30T14:54:55.103574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:55.103586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895855723231719:2454], now have 1 active actors on pipe
2025-09-30T14:54:55.103592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:55.103602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:55.103605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:55.103631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:55.103635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:55.103638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:55.103640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895855633467201:9820]
2025-09-30T14:54:55.103643Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:55.103644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:55.103673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895855723231890:8088], now have 1 active actors on pipe
2025-09-30T14:54:55.104269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1689
2025-09-30T14:54:55.104817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:55.104835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:55.104867Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|669dbfe5-3f80eccc-533797a8-d5042a37_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:55.104877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:55.104881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:55.104883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:55.104894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:55.104907Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:55.104923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:55.105170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:55.105174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:55.105190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:55.105303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1690 partition: 0 MaxSeqNo: 42 sessionId: src_id|669dbfe5-3f80eccc-533797a8-d5042a37_0
2025-09-30T14:54:55.105730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59694d74-b00e9563-a492aef-3b0fe1f9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|669dbfe5-3f80eccc-533797a8-d5042a37_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:55.111452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|669dbfe5-3f80eccc-533797a8-d5042a37_0] Write session: try to update token
2025-09-30T14:54:55.111472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|669dbfe5-3f80eccc-533797a8-d5042a37_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:55.122194Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:55.122222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:55.122224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:55.122226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:55.122238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895855633467201:9820]
2025-09-30T14:54:55.122243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895855633467201:9820]
2025-09-30T14:54:55.122247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895855633467201:9820]
2025-09-30T14:54:55.122289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:55.122295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.122297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:55.122317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:55.122325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:55.122329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:55.122633Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:55.130466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1690 sessionId: src_id|669dbfe5-3f80eccc-533797a8-d5042a37_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:55.133581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:55.155405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895855723232083:9749]
2025-09-30T14:54:55.155862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1689, pipe: [1:7555895855723232083:9749]
2025-09-30T14:54:55.238372Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:55.238744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:55.238771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:55.238791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895855723232083:9749], now have 1 active actors on pipe
2025-09-30T14:54:55.238990Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:55.238998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895855723232083:9749]
2025-09-30T14:54:55.239046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:55.239050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:55.239117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1690 reason: error at write: Disconnected sessionId: src_id|669dbfe5-3f80eccc-533797a8-d5042a37_0
2025-09-30T14:54:55.239347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1690 sessionId: src_id|669dbfe5-3f80eccc-533797a8-d5042a37_0 is DEAD
2025-09-30T14:54:55.239527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|669dbfe5-3f80eccc-533797a8-d5042a37_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:55.239538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|669dbfe5-3f80eccc-533797a8-d5042a37_0] Write session will restart in 0.008528s
2025-09-30T14:54:55.239562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|669dbfe5-3f80eccc-533797a8-d5042a37_0] Write session: Do CDS request
2025-09-30T14:54:55.239568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|669dbfe5-3f80eccc-533797a8-d5042a37_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:55.239651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:55.249827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|669dbfe5-3f80eccc-533797a8-d5042a37_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:55.251498Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:55.251518Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1691
2025-09-30T14:54:55.251661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1691 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:55.251694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1691 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:55.251704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1691 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:55.251709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:55.252166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1691 sessionId:  describe result for acl check
2025-09-30T14:54:55.252211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:55.252219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:55.252223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:55.252230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895855723232234:8074] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:55.252802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895855723232234:8074] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:55.255827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895855723232234:8074] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:55.259213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895855723232234:8074] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:55.259233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895855723232234:8074] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:55.259236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895855723232234:8074] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:55.259262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1691 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:55.262284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:55.264466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:55.264715Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:55.264729Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:55.264741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:55.264797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:55.264843Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895855633467494:9824]
2025-09-30T14:54:55.265475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:55.266044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:55.266090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:55.266422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:55.266481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:55.266487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:55.266488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:55.266489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:55.266490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:55.266491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:55.266493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:55.266494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:55.266495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:55.266496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:55.266497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.266498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.266500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.266501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:55.266502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:55.266507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:55.266517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:55.266520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:55.266524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:55.266527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:55.266531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:55.266535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:55.266538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:55.266541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:55.266545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:55.266549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.266552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.266556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.266559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:55.266562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:55.266569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:55.266577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:55.266583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:55.266588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:55.266593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:55.266598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:55.266602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:55.266606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:55.266611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:55.266615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:55.266619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:55.266624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:55.266629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:55.266633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:55.266638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:55.266643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:55.266648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:55.266652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:55.266656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:55.266660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:55.266666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.266671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.266675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.266679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.266683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.266687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.266690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:55.266695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:55.266699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:55.266704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:55.266750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:55.272960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:55.274267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:55.274287Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:55.274289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:55.274293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:55.274300Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1690 [2:7555895855633467494:9824]
2025-09-30T14:54:55.274318Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:55.274336Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:55.274339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:55.274342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:55.274344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:55.274363Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:55.274371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:55.274378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:55.274457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.274466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.274468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.274471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:55.274474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:55.274548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:55.274556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.274570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.274588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.274612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:55.274636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895855723232424:8074], now have 1 active actors on pipe
2025-09-30T14:54:55.274644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895855723232090:2454], now have 1 active actors on pipe
2025-09-30T14:54:55.274651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895855633467489:9824]
2025-09-30T14:54:55.274654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895855633467489:9824]
2025-09-30T14:54:55.274656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895855633467489:9824]
2025-09-30T14:54:55.274670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:55.274688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:55.274694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:55.274699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:55.274702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:55.274708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:55.274711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:55.274755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895855633467489:9824]
2025-09-30T14:54:55.274772Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:55.274768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1690
2025-09-30T14:54:55.274811Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1690
2025-09-30T14:54:55.274846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:55.275217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:55.275230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:55.275281Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d726a39f-b6006ac5-70ddf2e5-b6ed8ce5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:55.275300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:55.275304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:55.275306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:55.275316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:55.275327Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:55.275343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:55.275566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:55.275576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:55.275591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:55.275697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1691 partition: 0 MaxSeqNo: 42 sessionId: src_id|d726a39f-b6006ac5-70ddf2e5-b6ed8ce5_0
2025-09-30T14:54:55.276084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|669dbfe5-3f80eccc-533797a8-d5042a37_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d726a39f-b6006ac5-70ddf2e5-b6ed8ce5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:55.279061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d726a39f-b6006ac5-70ddf2e5-b6ed8ce5_0] Write session: try to update token
2025-09-30T14:54:55.279081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d726a39f-b6006ac5-70ddf2e5-b6ed8ce5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:55.287947Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:55.287971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:55.287973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:55.287975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:55.287984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895855633467489:9824]
2025-09-30T14:54:55.287988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895855633467489:9824]
2025-09-30T14:54:55.287991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895855633467489:9824]
2025-09-30T14:54:55.288051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:55.288058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.288069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:55.288238Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:55.288326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:55.288344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:55.288348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:55.298795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1691 sessionId: src_id|d726a39f-b6006ac5-70ddf2e5-b6ed8ce5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:55.301890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:55.339181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895855723232470:9749]
2025-09-30T14:54:55.339505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1690, pipe: [1:7555895855723232470:9749]
2025-09-30T14:54:55.413306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:55.413363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:55.413366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:55.413446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1691 reason: error at write: Disconnected sessionId: src_id|d726a39f-b6006ac5-70ddf2e5-b6ed8ce5_0
2025-09-30T14:54:55.413650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1691 sessionId: src_id|d726a39f-b6006ac5-70ddf2e5-b6ed8ce5_0 is DEAD
2025-09-30T14:54:55.413968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895855723232470:9749]
2025-09-30T14:54:55.411977Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:55.412876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:55.412888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:55.412912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895855723232470:9749], now have 1 active actors on pipe
2025-09-30T14:54:55.413301Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:55.415471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d726a39f-b6006ac5-70ddf2e5-b6ed8ce5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:55.415485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d726a39f-b6006ac5-70ddf2e5-b6ed8ce5_0] Write session will restart in 0.009528s
2025-09-30T14:54:55.415512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d726a39f-b6006ac5-70ddf2e5-b6ed8ce5_0] Write session: Do CDS request
2025-09-30T14:54:55.415521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d726a39f-b6006ac5-70ddf2e5-b6ed8ce5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:55.425851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d726a39f-b6006ac5-70ddf2e5-b6ed8ce5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:55.425957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:55.425979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1692
2025-09-30T14:54:55.426170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1692 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:55.426219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1692 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:55.426228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1692 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:55.426233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:55.426723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1692 sessionId:  describe result for acl check
2025-09-30T14:54:55.426760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:55.426767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:55.426769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:55.426775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895855723232505:8067] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:55.427341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895855723232505:8067] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:55.433352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895855723232505:8067] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:55.437535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895855723232505:8067] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:55.437555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895855723232505:8067] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:55.437559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895855723232505:8067] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:55.437567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1692 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:55.443463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:55.446312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:55.446550Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:55.446554Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:55.446565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:55.446618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:55.446659Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895855633467795:9837]
2025-09-30T14:54:55.447382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:55.448131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:55.448200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:55.448571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:55.448643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:55.448650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:55.448651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:55.448652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:55.448654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:55.448655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:55.448656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:55.448658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:55.448660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:55.448661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:55.448662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.448663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.448664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.448665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:55.448666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:55.448672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:55.448684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:55.448688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:55.448692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:55.448696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:55.448701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:55.448705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:55.448709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:55.448714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:55.448718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:55.448723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.448727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.448731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.448735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:55.448739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:55.448748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:55.448757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:55.448764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:55.448770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:55.448775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:55.448785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:55.448790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:55.448796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:55.448804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:55.448809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:55.448819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:55.448823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:55.448828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:55.448839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:55.448843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:55.448848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:55.448857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:55.448862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:55.448868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:55.448874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:55.448886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.448892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.448899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.448904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.448913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.448918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.448922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:55.448927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:55.448938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:55.448943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:55.448988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:55.458581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:55.460121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:55.460141Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:55.460143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:55.460148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:55.460156Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1691 [2:7555895855633467795:9837]
2025-09-30T14:54:55.460176Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:55.460195Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:55.460203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:55.460207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:55.460210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:55.460228Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:55.460244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:55.460251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:55.460325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.460332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.460335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.460339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:55.460342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:55.460730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1691
2025-09-30T14:54:55.460770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1691
2025-09-30T14:54:55.460423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:55.460431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.460445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.460457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.460473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:55.460494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895855723232739:8067], now have 1 active actors on pipe
2025-09-30T14:54:55.460497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895855723232471:2454], now have 1 active actors on pipe
2025-09-30T14:54:55.460504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895855633467790:9837]
2025-09-30T14:54:55.460506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895855633467790:9837]
2025-09-30T14:54:55.460508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895855633467790:9837]
2025-09-30T14:54:55.460523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:55.460538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:55.460554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:55.460556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:55.460559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:55.460559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:55.460562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:55.460602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895855633467790:9837]
2025-09-30T14:54:55.460611Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:55.460618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:55.462588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:55.462626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:55.462681Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68918926-4032f279-85b521d0-73c54faa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:55.462701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:55.462706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:55.462710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:55.462735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:55.462756Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:55.462784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:55.463142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:55.463155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:55.463175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:55.463337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1692 partition: 0 MaxSeqNo: 42 sessionId: src_id|68918926-4032f279-85b521d0-73c54faa_0
2025-09-30T14:54:55.463749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d726a39f-b6006ac5-70ddf2e5-b6ed8ce5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|68918926-4032f279-85b521d0-73c54faa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:55.466913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68918926-4032f279-85b521d0-73c54faa_0] Write session: try to update token
2025-09-30T14:54:55.466937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68918926-4032f279-85b521d0-73c54faa_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:55.484134Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:55.484160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:55.484170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895855633467790:9837]
2025-09-30T14:54:55.484221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:55.484228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:55.484432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:55.484598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:55.484760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:55.484916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:55.485133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:55.485196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:55.487769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1692 sessionId: src_id|68918926-4032f279-85b521d0-73c54faa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:55.489393Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:55.489414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:55.489416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:55.489418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:55.489429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895855633467790:9837]
2025-09-30T14:54:55.489433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895855633467790:9837]
2025-09-30T14:54:55.489438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895855633467790:9837]
2025-09-30T14:54:55.489485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:55.489493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.489496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:55.489499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:55.489506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:55.489510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:55.489647Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:55.490749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:55.515422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895855723232832:9749]
2025-09-30T14:54:55.515761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1691, pipe: [1:7555895855723232832:9749]
2025-09-30T14:54:55.607009Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:55.607717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:55.607736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:55.607758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895855723232832:9749], now have 1 active actors on pipe
2025-09-30T14:54:55.607987Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:55.608003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895855723232832:9749]
2025-09-30T14:54:55.608038Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:55.608076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:55.608170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1692 reason: status is not ok: tablet will be restarted right now sessionId: src_id|68918926-4032f279-85b521d0-73c54faa_0
2025-09-30T14:54:55.608372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1692 sessionId: src_id|68918926-4032f279-85b521d0-73c54faa_0 is DEAD
2025-09-30T14:54:55.608542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68918926-4032f279-85b521d0-73c54faa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:55.608551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68918926-4032f279-85b521d0-73c54faa_0] Write session will restart in 0.005573s
2025-09-30T14:54:55.608575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68918926-4032f279-85b521d0-73c54faa_0] Write session: Do CDS request
2025-09-30T14:54:55.608582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68918926-4032f279-85b521d0-73c54faa_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:55.615818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68918926-4032f279-85b521d0-73c54faa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:55.615895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:55.615911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1693
2025-09-30T14:54:55.616191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1693 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:55.616227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1693 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:55.616238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1693 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:55.616243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:55.616794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1693 sessionId:  describe result for acl check
2025-09-30T14:54:55.616834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:55.616841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:55.616843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:55.616850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895855723232870:8057] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:55.617436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895855723232870:8057] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:55.620786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895855723232870:8057] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:55.624691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895855723232870:8057] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:55.624709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895855723232870:8057] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:55.624716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895855723232870:8057] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:55.624731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1693 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:55.641370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:55.642146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:55.642339Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:55.642344Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:55.642355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:55.642407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:55.642447Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895855633468084:9840]
2025-09-30T14:54:55.643185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:55.643632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:55.643685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:55.644053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:55.644119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:55.644120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:55.644122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:55.644123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:55.644125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:55.644126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:55.644128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:55.644129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:55.644131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:55.644132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:55.644134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.644136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.644137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.644138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:55.644140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:55.644146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:55.644158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:55.644163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:55.644167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:55.644172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:55.644189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:55.644193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:55.644198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:55.644202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:55.644206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:55.644211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.644215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.644219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.644224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:55.644229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:55.644238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:55.644247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:55.644253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:55.644260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:55.644266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:55.644273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:55.644278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:55.644285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:55.644290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:55.644295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:55.644303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:55.644310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:55.644316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:55.644322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:55.644328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:55.644334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:55.644339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:55.644348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:55.644354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:55.644360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:55.644365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.644371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.644376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.644382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.644387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.644392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.644397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:55.644402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:55.644406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:55.644413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:55.644463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:55.651469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:55.652591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:55.652611Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:55.652614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:55.652619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:55.652625Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1692 [2:7555895855633468084:9840]
2025-09-30T14:54:55.652645Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:55.652663Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:55.652666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:55.652669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:55.652671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:55.652688Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:55.652696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:55.652703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:55.652768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.652771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.652773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.652777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:55.652780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:55.653179Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1692
2025-09-30T14:54:55.653186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1692
2025-09-30T14:54:55.653270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:55.653282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.653297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.653316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.653342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:55.653367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895855723232848:2454], now have 1 active actors on pipe
2025-09-30T14:54:55.653375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895855723233038:8057], now have 1 active actors on pipe
2025-09-30T14:54:55.653397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:55.653407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:55.653439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895855633468079:9840]
2025-09-30T14:54:55.653445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895855633468079:9840]
2025-09-30T14:54:55.653448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895855633468079:9840]
2025-09-30T14:54:55.653462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:55.653476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:55.653476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:55.653481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:55.653482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:55.653495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:55.653498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:55.653515Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1f6addb-6a938c9b-b3fc83c5-839dd519_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:55.653527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:55.653531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:55.653533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:55.653543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:55.653558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:55.653599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895855633468079:9840]
2025-09-30T14:54:55.653611Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:55.653618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:55.653629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:55.653830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:55.653838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:55.653855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:55.653934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1693 partition: 0 MaxSeqNo: 42 sessionId: src_id|f1f6addb-6a938c9b-b3fc83c5-839dd519_0
2025-09-30T14:54:55.654344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68918926-4032f279-85b521d0-73c54faa_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f1f6addb-6a938c9b-b3fc83c5-839dd519_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:55.657472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1f6addb-6a938c9b-b3fc83c5-839dd519_0] Write session: try to update token
2025-09-30T14:54:55.657492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1f6addb-6a938c9b-b3fc83c5-839dd519_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:55.670763Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:55.670786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:55.670789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:55.670791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:55.670801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895855633468079:9840]
2025-09-30T14:54:55.670806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895855633468079:9840]
2025-09-30T14:54:55.670810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895855633468079:9840]
2025-09-30T14:54:55.670854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:55.670860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:55.670862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.670865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:55.670867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:55.670871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:55.671013Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:55.684331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1693 sessionId: src_id|f1f6addb-6a938c9b-b3fc83c5-839dd519_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:55.687176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:55.708381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895855723233210:9749]
2025-09-30T14:54:55.708730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1692, pipe: [1:7555895855723233210:9749]
2025-09-30T14:54:55.788860Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:55.789235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:55.789251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:55.789272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895855723233210:9749], now have 1 active actors on pipe
2025-09-30T14:54:55.789506Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:55.789525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:55.789597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895855723233210:9749]
2025-09-30T14:54:55.789603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:55.789607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:55.789686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1693 reason: error at write: Disconnected sessionId: src_id|f1f6addb-6a938c9b-b3fc83c5-839dd519_0
2025-09-30T14:54:55.789894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1693 sessionId: src_id|f1f6addb-6a938c9b-b3fc83c5-839dd519_0 is DEAD
2025-09-30T14:54:55.791526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1f6addb-6a938c9b-b3fc83c5-839dd519_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:55.791539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1f6addb-6a938c9b-b3fc83c5-839dd519_0] Write session will restart in 0.008963s
2025-09-30T14:54:55.791565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1f6addb-6a938c9b-b3fc83c5-839dd519_0] Write session: Do CDS request
2025-09-30T14:54:55.791575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1f6addb-6a938c9b-b3fc83c5-839dd519_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:55.801887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1f6addb-6a938c9b-b3fc83c5-839dd519_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:55.801989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:55.802016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1694
2025-09-30T14:54:55.803458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1694 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:55.803521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1694 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:55.803532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1694 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:55.803536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:55.804103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1694 sessionId:  describe result for acl check
2025-09-30T14:54:55.804145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:55.804147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:55.804149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:55.804155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895855723233386:8052] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:55.804725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895855723233386:8052] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:55.807929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895855723233386:8052] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:55.811706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895855723233386:8052] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:55.811724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895855723233386:8052] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:55.811728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895855723233386:8052] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:55.811745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1694 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:55.813470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:55.815899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:55.816108Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:55.816119Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:55.816130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:55.816185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:55.816232Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895855633468364:9843]
2025-09-30T14:54:55.816925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:55.817264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:55.817306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:55.817626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:55.817707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:55.817728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:55.817730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:55.817731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:55.817733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:55.817734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:55.817735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:55.817736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:55.817738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:55.817739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:55.817741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.817742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.817743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.817744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:55.817745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:55.817751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:55.817763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:55.817767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:55.817772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:55.817775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:55.817779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:55.817783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:55.817787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:55.817792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:55.817797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:55.817801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.817805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.817809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.817813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:55.817817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:55.817826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:55.817833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:55.817840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:55.817846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:55.817852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:55.817857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:55.817861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:55.817865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:55.817870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:55.817875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:55.817880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:55.817885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:55.817889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:55.817894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:55.817898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:55.817904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:55.817909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:55.817915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:55.817920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:55.817934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:55.817941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.817952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.817957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.817967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.817972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.817982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.817988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:55.817999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:55.818004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:55.818010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:55.818063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:55.824138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:55.825251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:55.825273Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:55.825276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:55.825280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:55.825289Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1693 [2:7555895855633468364:9843]
2025-09-30T14:54:55.825307Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:55.825322Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:55.825330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:55.825334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:55.825336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:55.825354Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:55.825366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:55.825373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:55.825442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.825449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.825452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.825455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:55.825458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:55.825703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1693
2025-09-30T14:54:55.825767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1693
2025-09-30T14:54:55.825531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:55.825542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.825554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.825565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.825580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:55.825601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895855723233212:2454], now have 1 active actors on pipe
2025-09-30T14:54:55.825605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895855723233560:8052], now have 1 active actors on pipe
2025-09-30T14:54:55.825612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895855633468359:9843]
2025-09-30T14:54:55.825614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895855633468359:9843]
2025-09-30T14:54:55.825617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895855633468359:9843]
2025-09-30T14:54:55.825631Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:55.825646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:55.825662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:55.825665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:55.825720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895855633468359:9843]
2025-09-30T14:54:55.825723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:55.825772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:55.825777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:55.825779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:55.825787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:55.826012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:55.826025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:55.826054Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50b7a765-538677a-61c1a64a-5c9c5739_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:55.826067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:55.826070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:55.826073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:55.826084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:55.826100Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:55.826122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:55.826416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:55.826427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:55.826445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:55.826595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1694 partition: 0 MaxSeqNo: 42 sessionId: src_id|50b7a765-538677a-61c1a64a-5c9c5739_0
2025-09-30T14:54:55.827013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1f6addb-6a938c9b-b3fc83c5-839dd519_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|50b7a765-538677a-61c1a64a-5c9c5739_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:55.829952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50b7a765-538677a-61c1a64a-5c9c5739_0] Write session: try to update token
2025-09-30T14:54:55.829973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50b7a765-538677a-61c1a64a-5c9c5739_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:55.838585Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:55.838613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:55.838616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:55.838618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:55.838628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895855633468359:9843]
2025-09-30T14:54:55.838633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895855633468359:9843]
2025-09-30T14:54:55.838637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895855633468359:9843]
2025-09-30T14:54:55.838677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:55.838686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.838689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:55.838692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:55.838709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:55.838723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:55.838837Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:55.846176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1694 sessionId: src_id|50b7a765-538677a-61c1a64a-5c9c5739_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:55.849170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:55.889628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895855723233575:9749]
2025-09-30T14:54:55.889980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1693, pipe: [1:7555895855723233575:9749]
2025-09-30T14:54:55.953679Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:55.954528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:55.954539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:55.954580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895855723233575:9749], now have 1 active actors on pipe
2025-09-30T14:54:55.954962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895855723233575:9749]
2025-09-30T14:54:55.954989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:55.954990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:55.954993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:55.955048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1694 reason: error at write: Disconnected sessionId: src_id|50b7a765-538677a-61c1a64a-5c9c5739_0
2025-09-30T14:54:55.955227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1694 sessionId: src_id|50b7a765-538677a-61c1a64a-5c9c5739_0 is DEAD
2025-09-30T14:54:55.955611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50b7a765-538677a-61c1a64a-5c9c5739_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:55.955624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50b7a765-538677a-61c1a64a-5c9c5739_0] Write session will restart in 0.008262s
2025-09-30T14:54:55.955654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50b7a765-538677a-61c1a64a-5c9c5739_0] Write session: Do CDS request
2025-09-30T14:54:55.955661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50b7a765-538677a-61c1a64a-5c9c5739_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:55.955216Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:55.964841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50b7a765-538677a-61c1a64a-5c9c5739_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:55.964896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:55.964915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1695
2025-09-30T14:54:55.965083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1695 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:55.965127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1695 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:55.965133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1695 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:55.965138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:55.965610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1695 sessionId:  describe result for acl check
2025-09-30T14:54:55.965648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:55.965650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:55.965652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:55.965659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895855723233594:8048] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:55.966254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895855723233594:8048] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:55.969232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895855723233594:8048] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:55.974069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895855723233594:8048] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:55.974088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895855723233594:8048] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:55.974092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895855723233594:8048] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:55.974103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1695 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:55.984012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:55.986823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:55.987054Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:55.987064Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:55.987074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:55.987115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:55.987157Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895855633468643:9845]
2025-09-30T14:54:55.987806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:55.988121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:55.988174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:55.988519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:55.988583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:55.988590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:55.988591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:55.988593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:55.988594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:55.988595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:55.988597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:55.988598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:55.988599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:55.988601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:55.988603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.988604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.988605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.988606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:55.988608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:55.988614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:55.988625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:55.988629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:55.988634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:55.988638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:55.988642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:55.988647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:55.988651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:55.988655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:55.988659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:55.988663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.988667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.988671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.988676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:55.988680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:55.988688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:55.988695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:55.988702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:55.988706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:55.988712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:55.988717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:55.988722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:55.988728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:55.988732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:55.988749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:55.988756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:55.988761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:55.988766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:55.988771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:55.988774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:55.988786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:55.988791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:55.988796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:55.988816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:55.988825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:55.988833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.988837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.988842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.988852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.988855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.988860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.988864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:55.988875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:55.988879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:55.988884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:55.988934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:55.996319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:55.997785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:55.997802Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:55.997805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:55.997809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:55.997816Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1694 [2:7555895855633468643:9845]
2025-09-30T14:54:55.997832Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:55.997850Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:55.997853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:55.997857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:55.997859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:55.997877Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:55.997887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:55.997902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:55.997985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.997993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.997995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.997998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:55.998001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:55.998066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:55.998076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:55.998090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:55.998103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:55.998120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:55.998143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895855633468638:9845]
2025-09-30T14:54:55.998150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895855633468638:9845]
2025-09-30T14:54:55.998152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895855633468638:9845]
2025-09-30T14:54:55.998162Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:55.998181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:55.998186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:55.998190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:55.998192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:55.998201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:55.998204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:55.998214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895855723233734:8048], now have 1 active actors on pipe
2025-09-30T14:54:55.998255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895855723233579:2454], now have 1 active actors on pipe
2025-09-30T14:54:55.998263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895855633468638:9845]
2025-09-30T14:54:55.998270Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:55.998278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:55.998313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1694
2025-09-30T14:54:55.998321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1694
2025-09-30T14:54:55.998414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:55.998425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:55.998450Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c7a5b963-aacb7177-fa19bde0-548d7063_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:55.998462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:55.998466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:55.998468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:55.998477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:55.998487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:55.998506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:55.998662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:55.998670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:55.998684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:55.998763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1695 partition: 0 MaxSeqNo: 42 sessionId: src_id|c7a5b963-aacb7177-fa19bde0-548d7063_0
2025-09-30T14:54:55.999307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50b7a765-538677a-61c1a64a-5c9c5739_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c7a5b963-aacb7177-fa19bde0-548d7063_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:56.002233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7a5b963-aacb7177-fa19bde0-548d7063_0] Write session: try to update token
2025-09-30T14:54:56.002254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7a5b963-aacb7177-fa19bde0-548d7063_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:56.011214Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:56.011237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:56.011267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895855633468638:9845]
2025-09-30T14:54:56.011311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:56.011536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:56.011696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:56.011847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:56.011995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:56.012204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:56.012247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:56.012339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:56.022368Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:56.022390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:56.022394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:56.022396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:56.022407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895855633468638:9845]
2025-09-30T14:54:56.022411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895855633468638:9845]
2025-09-30T14:54:56.022417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895855633468638:9845]
2025-09-30T14:54:56.022457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:56.022465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.022468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:56.022502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:56.022537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:56.022542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:56.024696Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:56.025399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1695 sessionId: src_id|c7a5b963-aacb7177-fa19bde0-548d7063_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:56.028537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:56.054516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895860018201238:9749]
2025-09-30T14:54:56.054887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1694, pipe: [1:7555895860018201238:9749]
2025-09-30T14:54:56.141037Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:56.141495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:56.141512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:56.141535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895860018201238:9749], now have 1 active actors on pipe
2025-09-30T14:54:56.141984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895860018201238:9749]
2025-09-30T14:54:56.142022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:56.142025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:56.142084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1695 reason: error at write: Disconnected sessionId: src_id|c7a5b963-aacb7177-fa19bde0-548d7063_0
2025-09-30T14:54:56.142258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1695 sessionId: src_id|c7a5b963-aacb7177-fa19bde0-548d7063_0 is DEAD
2025-09-30T14:54:56.142623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7a5b963-aacb7177-fa19bde0-548d7063_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:56.142632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7a5b963-aacb7177-fa19bde0-548d7063_0] Write session will restart in 0.008036s
2025-09-30T14:54:56.141993Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:56.142659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7a5b963-aacb7177-fa19bde0-548d7063_0] Write session: Do CDS request
2025-09-30T14:54:56.142665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7a5b963-aacb7177-fa19bde0-548d7063_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:56.142282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:56.151921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7a5b963-aacb7177-fa19bde0-548d7063_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:56.152022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:56.152042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1696
2025-09-30T14:54:56.152205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1696 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:56.152246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1696 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:56.152251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1696 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:56.152257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:56.152767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1696 sessionId:  describe result for acl check
2025-09-30T14:54:56.152797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:56.152799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:56.152802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:56.152808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895860018201264:8027] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:56.153421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895860018201264:8027] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:56.155957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895860018201264:8027] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:56.161960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895860018201264:8027] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:56.161980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895860018201264:8027] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:56.161984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895860018201264:8027] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:56.161993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1696 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:56.182396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:56.185287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:56.185507Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:56.185518Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:56.185530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:56.185586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:56.185622Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895859928436221:9847]
2025-09-30T14:54:56.186328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:56.186754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:56.186802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:56.187162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:56.187234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:56.187240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:56.187257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:56.187258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:56.187260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:56.187261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:56.187262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:56.187264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:56.187265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:56.187266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:56.187267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.187268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:56.187270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:56.187271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:56.187273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:56.187278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:56.187289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:56.187292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:56.187296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:56.187300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:56.187304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:56.187308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:56.187311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:56.187316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:56.187321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:56.187326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.187329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:56.187333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:56.187337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:56.187341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:56.187350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:56.187358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:56.187364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:56.187370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:56.187376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:56.187382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:56.187386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:56.187392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:56.187397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:56.187404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:56.187409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:56.187415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:56.187420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:56.187428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:56.187432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:56.187438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:56.187451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:56.187456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:56.187461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:56.187467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:56.187472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.187477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.187482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:56.187489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:56.187494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:56.187499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:56.187503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:56.187507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:56.187511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:56.187516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:56.187559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:56.193660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:56.195014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:56.195031Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:56.195033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:56.195037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:56.195044Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1695 [2:7555895859928436221:9847]
2025-09-30T14:54:56.195062Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:56.195079Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:56.195082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:56.195085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:56.195088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:56.195106Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:56.195113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:56.195129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:56.195192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.195199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:56.195201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:56.195206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:56.195208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:56.195298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:56.195307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.195320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:56.195332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:56.195351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:56.195375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895859928436215:9847]
2025-09-30T14:54:56.195382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895859928436215:9847]
2025-09-30T14:54:56.195384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895859928436215:9847]
2025-09-30T14:54:56.195394Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:56.195415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:56.195434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:56.195441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:56.195478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895859928436215:9847]
2025-09-30T14:54:56.195488Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:56.195576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:56.195590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:56.195592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:56.195599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:56.195756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895860018201245:2454], now have 1 active actors on pipe
2025-09-30T14:54:56.195772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895860018201392:8027], now have 1 active actors on pipe
2025-09-30T14:54:56.196193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:56.196208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:56.196238Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|954159c5-ba999965-e202bfd1-aa1cb7fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:56.196254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:56.196258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:56.196261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:56.196275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:56.196286Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:56.196306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:56.196793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:56.196808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:56.196828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:56.197318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7a5b963-aacb7177-fa19bde0-548d7063_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|954159c5-ba999965-e202bfd1-aa1cb7fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:56.195920Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1695
2025-09-30T14:54:56.195981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1695
2025-09-30T14:54:56.196948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1696 partition: 0 MaxSeqNo: 42 sessionId: src_id|954159c5-ba999965-e202bfd1-aa1cb7fc_0
2025-09-30T14:54:56.200311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|954159c5-ba999965-e202bfd1-aa1cb7fc_0] Write session: try to update token
2025-09-30T14:54:56.200328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|954159c5-ba999965-e202bfd1-aa1cb7fc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:56.208888Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:56.208911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:56.208915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:56.208917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:56.208938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895859928436215:9847]
2025-09-30T14:54:56.208943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895859928436215:9847]
2025-09-30T14:54:56.208947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895859928436215:9847]
2025-09-30T14:54:56.208999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:56.209006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.209010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:56.209185Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:56.211314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:56.211337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:56.211342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:56.227815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1696 sessionId: src_id|954159c5-ba999965-e202bfd1-aa1cb7fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:56.230777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:56.238791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895860018201613:9749]
2025-09-30T14:54:56.239095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1695, pipe: [1:7555895860018201613:9749]
2025-09-30T14:54:56.324871Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:56.325520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:56.325540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:56.325558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895860018201613:9749], now have 1 active actors on pipe
2025-09-30T14:54:56.325843Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:56.326296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|954159c5-ba999965-e202bfd1-aa1cb7fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:56.326305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|954159c5-ba999965-e202bfd1-aa1cb7fc_0] Write session will restart in 0.009185s
2025-09-30T14:54:56.326340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|954159c5-ba999965-e202bfd1-aa1cb7fc_0] Write session: Do CDS request
2025-09-30T14:54:56.326348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|954159c5-ba999965-e202bfd1-aa1cb7fc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:56.325840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:56.325857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:56.325939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1696 reason: error at write: Disconnected sessionId: src_id|954159c5-ba999965-e202bfd1-aa1cb7fc_0
2025-09-30T14:54:56.326124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1696 sessionId: src_id|954159c5-ba999965-e202bfd1-aa1cb7fc_0 is DEAD
2025-09-30T14:54:56.326285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895860018201613:9749]
2025-09-30T14:54:56.326300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:56.336793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|954159c5-ba999965-e202bfd1-aa1cb7fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:56.336904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:56.336935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1697
2025-09-30T14:54:56.337066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1697 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:56.337109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1697 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:56.337122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1697 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:56.337126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:56.337782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1697 sessionId:  describe result for acl check
2025-09-30T14:54:56.337820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:56.337822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:56.337824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:56.337830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895860018201698:8024] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:56.338383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895860018201698:8024] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:56.341290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895860018201698:8024] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:56.344912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895860018201698:8024] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:56.344934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895860018201698:8024] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:56.344938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895860018201698:8024] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:56.344947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1697 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:56.354066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:56.357075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:56.357313Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:56.357318Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:56.357329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:56.357389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:56.357427Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895859928436540:9856]
2025-09-30T14:54:56.358126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:56.358461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:56.358510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:56.358873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:56.358964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:56.358971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:56.358972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:56.358973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:56.358974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:56.358976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:56.358977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:56.358978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:56.358979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:56.358980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:56.358981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.358983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:56.358984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:56.358986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:56.358987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:56.358993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:56.359003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:56.359006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:56.359010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:56.359014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:56.359018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:56.359022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:56.359026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:56.359030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:56.359037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:56.359041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.359045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:56.359049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:56.359053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:56.359057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:56.359066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:56.359077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:56.359083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:56.359089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:56.359094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:56.359098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:56.359103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:56.359108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:56.359112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:56.359117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:56.359121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:56.359126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:56.359135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:56.359140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:56.359147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:56.359152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:56.359156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:56.359161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:56.359165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:56.359169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:56.359173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.359179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.359182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:56.359188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:56.359192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:56.359197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:56.359201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:56.359206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:56.359210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:56.359215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:56.359305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:56.365436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:56.366962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:56.366987Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:56.366989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:56.366994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:56.367000Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1696 [2:7555895859928436540:9856]
2025-09-30T14:54:56.367017Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:56.367035Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:56.367038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:56.367041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:56.367043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:56.367061Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:56.367068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:56.367076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:56.367141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.367150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:56.367153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:56.367157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:56.367159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:56.367231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:56.367240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.367292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:56.367311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:56.367332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:56.367353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895860018201628:2454], now have 1 active actors on pipe
2025-09-30T14:54:56.367364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895860018201858:8024], now have 1 active actors on pipe
2025-09-30T14:54:56.367370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895859928436534:9856]
2025-09-30T14:54:56.367378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895859928436534:9856]
2025-09-30T14:54:56.367381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895859928436534:9856]
2025-09-30T14:54:56.367397Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:56.367418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:56.367437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:56.367444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:56.367490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895859928436534:9856]
2025-09-30T14:54:56.367499Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:56.367651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1696
2025-09-30T14:54:56.367691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:56.367704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:56.367707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:56.367713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:56.367785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:56.367802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:56.367837Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfa22d4d-1cccfe89-c233b0c5-14d762b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:56.367851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:56.367858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:56.367861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:56.367855Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1696
2025-09-30T14:54:56.367885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:56.367903Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:56.367931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:56.368092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:56.368104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:56.368126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:56.368211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1697 partition: 0 MaxSeqNo: 42 sessionId: src_id|cfa22d4d-1cccfe89-c233b0c5-14d762b7_0
2025-09-30T14:54:56.368667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|954159c5-ba999965-e202bfd1-aa1cb7fc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cfa22d4d-1cccfe89-c233b0c5-14d762b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:56.371658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa22d4d-1cccfe89-c233b0c5-14d762b7_0] Write session: try to update token
2025-09-30T14:54:56.371686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa22d4d-1cccfe89-c233b0c5-14d762b7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:56.381812Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:56.381834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:56.381844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895859928436534:9856]
2025-09-30T14:54:56.381890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:56.381895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:56.382091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:56.382258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:56.382409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:56.382564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:56.382780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:56.382822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:56.388751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1697 sessionId: src_id|cfa22d4d-1cccfe89-c233b0c5-14d762b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:56.391869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:56.392549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:56.392577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:56.393939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:56.393976Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:56.393979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:56.393982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:56.393984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:56.393996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895859928436534:9856]
2025-09-30T14:54:56.393999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895859928436534:9856]
2025-09-30T14:54:56.394003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895859928436534:9856]
2025-09-30T14:54:56.394034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:56.394040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:56.394041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:56.394044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:56.394048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.394050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:56.394215Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:56.394186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:56.426714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895860018202004:9749]
2025-09-30T14:54:56.426969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1696, pipe: [1:7555895860018202004:9749]
2025-09-30T14:54:56.510048Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:56.519916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:56.519951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:56.520139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:56.520205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:56.520274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:56.520353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:56.520641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:56.520647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:56.520725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:56.520788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:56.520857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:56.520928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:56.520975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:56.520978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:56.521061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:56.521136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:56.521259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:56.521377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:56.521420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:56.521424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:56.521541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:56.521613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:56.521683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:56.521769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:56.521814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:56.521818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:56.521901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:56.521978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:56.522048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:56.522130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:56.522181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:56.522184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:56.522280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:56.522349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:56.522426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:56.522494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:56.522538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:56.522544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:56.522620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:56.522683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:56.522755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:56.522825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:56.522876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:56.522880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:56.522957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:56.523020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:56.523089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:56.523158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:56.523551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:56.523564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:56.523661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:56.523723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:56.523791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:56.523891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:56.523937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:56.523941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:56.524017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:56.524080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:56.524146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:56.524213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:56.524379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:56.524383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:56.524455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895860018202004:9749], now have 1 active actors on pipe
2025-09-30T14:54:56.526201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa22d4d-1cccfe89-c233b0c5-14d762b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:56.526213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa22d4d-1cccfe89-c233b0c5-14d762b7_0] Write session will restart in 0.005987s
2025-09-30T14:54:56.526232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa22d4d-1cccfe89-c233b0c5-14d762b7_0] Write session: Do CDS request
2025-09-30T14:54:56.526236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa22d4d-1cccfe89-c233b0c5-14d762b7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:56.525843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895860018202004:9749]
2025-09-30T14:54:56.525844Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:56.525876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:56.525886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:56.525910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1697 reason: error at write: Disconnected sessionId: src_id|cfa22d4d-1cccfe89-c233b0c5-14d762b7_0
2025-09-30T14:54:56.526058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1697 sessionId: src_id|cfa22d4d-1cccfe89-c233b0c5-14d762b7_0 is DEAD
2025-09-30T14:54:56.525955Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:56.533725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa22d4d-1cccfe89-c233b0c5-14d762b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:56.534085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:56.534105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1698
2025-09-30T14:54:56.534312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1698 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:56.534359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1698 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:56.534374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1698 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:56.534384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:56.535525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1698 sessionId:  describe result for acl check
2025-09-30T14:54:56.535578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:56.535580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:56.535582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:56.535589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895860018202023:8016] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:56.536184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895860018202023:8016] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:56.539357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895860018202023:8016] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:56.548574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895860018202023:8016] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:56.548595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895860018202023:8016] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:56.548598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895860018202023:8016] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:56.548607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1698 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:56.580146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:56.583647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:56.583890Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:56.583895Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:56.583907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:56.583973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:56.584017Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895859928436838:9865]
2025-09-30T14:54:56.584670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:56.585205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:56.585271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:56.585647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:56.585751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:56.585753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:56.585754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:56.585756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:56.585757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:56.585758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:56.585759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:56.585761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:56.585762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:56.585763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:56.585764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.585765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:56.585767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:56.585768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:56.585770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:56.585776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:56.585787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:56.585791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:56.585796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:56.585800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:56.585804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:56.585809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:56.585813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:56.585817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:56.585822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:56.585826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.585830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:56.585834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:56.585838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:56.585841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:56.585850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:56.585859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:56.585866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:56.585873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:56.585878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:56.585884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:56.585888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:56.585894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:56.585900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:56.585905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:56.585909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:56.585915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:56.585920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:56.585927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:56.585931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:56.585937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:56.585946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:56.585951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:56.585956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:56.585961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:56.585966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.585972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.585977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:56.585983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:56.585987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:56.585993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:56.585999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:56.586005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:56.586010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:56.586015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:56.586061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:56.605535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:56.607057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:56.607081Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:56.607083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:56.607088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:56.607097Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1697 [2:7555895859928436838:9865]
2025-09-30T14:54:56.607115Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:56.607132Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:56.607135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:56.607138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:56.607140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:56.607157Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:56.607164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:56.607172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:56.607271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.607280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:56.607281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:56.607285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:56.607288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:56.607366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:56.607376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.607392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:56.607404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:56.607422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:56.607441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895859928436833:9865]
2025-09-30T14:54:56.607443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895859928436833:9865]
2025-09-30T14:54:56.607446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895859928436833:9865]
2025-09-30T14:54:56.607457Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:56.607471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:56.607488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:56.607493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:56.607515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:56.607518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:56.607523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:56.607534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895859928436833:9865]
2025-09-30T14:54:56.607537Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:56.607540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:56.607559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895860018202086:8016], now have 1 active actors on pipe
2025-09-30T14:54:56.607564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895860018202008:2454], now have 1 active actors on pipe
2025-09-30T14:54:56.607940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1697
2025-09-30T14:54:56.607976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1697
2025-09-30T14:54:56.608861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:56.608884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:56.608918Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8e4179e-dfe35f4e-6f3c5067-5312df8d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:56.608930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:56.608934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:56.608937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:56.608951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:56.608968Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:56.608996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:56.609676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:56.609693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:56.609740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:56.609947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1698 partition: 0 MaxSeqNo: 42 sessionId: src_id|e8e4179e-dfe35f4e-6f3c5067-5312df8d_0
2025-09-30T14:54:56.610397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa22d4d-1cccfe89-c233b0c5-14d762b7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e8e4179e-dfe35f4e-6f3c5067-5312df8d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:56.613295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8e4179e-dfe35f4e-6f3c5067-5312df8d_0] Write session: try to update token
2025-09-30T14:54:56.613310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8e4179e-dfe35f4e-6f3c5067-5312df8d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:56.622235Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:56.622258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:56.622262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:56.622264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:56.622275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895859928436833:9865]
2025-09-30T14:54:56.622280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895859928436833:9865]
2025-09-30T14:54:56.622284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895859928436833:9865]
2025-09-30T14:54:56.622328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:56.622336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.622338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:56.622347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:56.622354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:56.622366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:56.622508Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:56.625848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895860018202392:9749]
2025-09-30T14:54:56.626292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1697, pipe: [1:7555895860018202392:9749]
2025-09-30T14:54:56.632693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1698 sessionId: src_id|e8e4179e-dfe35f4e-6f3c5067-5312df8d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:56.635727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:56.739600Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:56.740313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895860018202392:9749], now have 1 active actors on pipe
2025-09-30T14:54:56.740399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:56.740414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:56.740686Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:56.740677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:56.740678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895860018202392:9749]
2025-09-30T14:54:56.740693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:56.740711Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:56.740760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1698 reason: error at write: Disconnected sessionId: src_id|e8e4179e-dfe35f4e-6f3c5067-5312df8d_0
2025-09-30T14:54:56.740979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1698 sessionId: src_id|e8e4179e-dfe35f4e-6f3c5067-5312df8d_0 is DEAD
2025-09-30T14:54:56.741336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8e4179e-dfe35f4e-6f3c5067-5312df8d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:56.741348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8e4179e-dfe35f4e-6f3c5067-5312df8d_0] Write session will restart in 0.008711s
2025-09-30T14:54:56.741387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8e4179e-dfe35f4e-6f3c5067-5312df8d_0] Write session: Do CDS request
2025-09-30T14:54:56.741397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8e4179e-dfe35f4e-6f3c5067-5312df8d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:56.751808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8e4179e-dfe35f4e-6f3c5067-5312df8d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:56.755127Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:56.755148Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1699
2025-09-30T14:54:56.755304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1699 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:56.755339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1699 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:56.755344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1699 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:56.755349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:56.755763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1699 sessionId:  describe result for acl check
2025-09-30T14:54:56.755812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:56.755819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:56.755821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:56.755827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895860018202537:8007] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:56.756400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895860018202537:8007] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:56.761065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895860018202537:8007] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:56.764156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895860018202537:8007] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:56.764171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895860018202537:8007] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:56.764175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895860018202537:8007] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:56.764184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1699 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:56.767779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:56.770359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:56.770580Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:56.770585Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:56.770597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:56.770656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:56.770707Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895859928437121:9867]
2025-09-30T14:54:56.771426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:56.771767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:56.771823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:56.772219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:56.772286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:56.772294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:56.772296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:56.772297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:56.772298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:56.772300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:56.772301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:56.772303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:56.772305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:56.772306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:56.772307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.772309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:56.772310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:56.772311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:56.772312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:56.772318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:56.772329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:56.772334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:56.772338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:56.772342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:56.772347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:56.772352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:56.772356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:56.772360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:56.772365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:56.772369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.772374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:56.772378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:56.772383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:56.772387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:56.772395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:56.772404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:56.772411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:56.772417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:56.772424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:56.772430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:56.772434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:56.772440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:56.772446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:56.772451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:56.772457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:56.772463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:56.772469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:56.772474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:56.772480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:56.772486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:56.772491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:56.772496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:56.772502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:56.772508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:56.772513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.772521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.772526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:56.772532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:56.772538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:56.772544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:56.772558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:56.772563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:56.772568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:56.772574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:56.772617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:56.778595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:56.779753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:56.779773Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:56.779777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:56.779781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:56.779789Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1698 [2:7555895859928437121:9867]
2025-09-30T14:54:56.779807Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:56.779826Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:56.779830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:56.779833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:56.779835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:56.779854Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:56.779867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:56.779874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:56.779940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.779950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:56.779953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:56.779957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:56.779960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:56.780032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:56.780039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.780053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:56.780064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:56.780089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:56.780111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895859928437116:9867]
2025-09-30T14:54:56.780119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895859928437116:9867]
2025-09-30T14:54:56.780121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895859928437116:9867]
2025-09-30T14:54:56.780131Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:56.780141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:56.780145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:56.780147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:56.780150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:56.780167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:56.780176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:56.780187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895860018202726:8007], now have 1 active actors on pipe
2025-09-30T14:54:56.780196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895860018202395:2454], now have 1 active actors on pipe
2025-09-30T14:54:56.780236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895859928437116:9867]
2025-09-30T14:54:56.780244Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:56.780221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1698
2025-09-30T14:54:56.780251Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1698
2025-09-30T14:54:56.780347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:56.780427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:56.780438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:56.780463Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fcfc7f77-9aa6beaa-3cb277e1-7fec48b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:56.780476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:56.780482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:56.780489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:56.780501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:56.780515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:56.780538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:56.780707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:56.780714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:56.780728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:56.780830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1699 partition: 0 MaxSeqNo: 42 sessionId: src_id|fcfc7f77-9aa6beaa-3cb277e1-7fec48b1_0
2025-09-30T14:54:56.781282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8e4179e-dfe35f4e-6f3c5067-5312df8d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fcfc7f77-9aa6beaa-3cb277e1-7fec48b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:56.784370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfc7f77-9aa6beaa-3cb277e1-7fec48b1_0] Write session: try to update token
2025-09-30T14:54:56.784396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfc7f77-9aa6beaa-3cb277e1-7fec48b1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:56.794565Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:56.794596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:56.794599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:56.794601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:56.794611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895859928437116:9867]
2025-09-30T14:54:56.794616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895859928437116:9867]
2025-09-30T14:54:56.794621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895859928437116:9867]
2025-09-30T14:54:56.794667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:56.794674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.794676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:56.794678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:56.794683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:56.794687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:56.794828Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:56.804767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1699 sessionId: src_id|fcfc7f77-9aa6beaa-3cb277e1-7fec48b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:56.807778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:56.842379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895860018202763:9749]
2025-09-30T14:54:56.842740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1698, pipe: [1:7555895860018202763:9749]
2025-09-30T14:54:56.913340Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:56.914027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:56.914043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:56.914063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895860018202763:9749], now have 1 active actors on pipe
2025-09-30T14:54:56.914238Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:56.914340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:56.914354Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:56.914356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:56.914420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895860018202763:9749]
2025-09-30T14:54:56.914430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1699 reason: error at write: Disconnected sessionId: src_id|fcfc7f77-9aa6beaa-3cb277e1-7fec48b1_0
2025-09-30T14:54:56.914625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1699 sessionId: src_id|fcfc7f77-9aa6beaa-3cb277e1-7fec48b1_0 is DEAD
2025-09-30T14:54:56.914783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfc7f77-9aa6beaa-3cb277e1-7fec48b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:56.914792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfc7f77-9aa6beaa-3cb277e1-7fec48b1_0] Write session will restart in 0.006642s
2025-09-30T14:54:56.914817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfc7f77-9aa6beaa-3cb277e1-7fec48b1_0] Write session: Do CDS request
2025-09-30T14:54:56.914834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfc7f77-9aa6beaa-3cb277e1-7fec48b1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:56.922750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfc7f77-9aa6beaa-3cb277e1-7fec48b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:56.922851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:56.922865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1700
2025-09-30T14:54:56.922986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1700 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:56.923017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1700 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:56.923025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1700 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:56.923028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:56.923542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1700 sessionId:  describe result for acl check
2025-09-30T14:54:56.923585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:56.923593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:56.923595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:56.923603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895860018202815:8002] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:56.924133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895860018202815:8002] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:56.926859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895860018202815:8002] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:56.930784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895860018202815:8002] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:56.930801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895860018202815:8002] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:56.930804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895860018202815:8002] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:56.930814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1700 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:56.937858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:56.940661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:56.941265Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:56.941278Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:56.941294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:56.941374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:56.941436Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895859928437407:9870]
2025-09-30T14:54:56.941990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:56.942346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:56.942408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:56.942799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:56.942870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:56.942876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:56.942878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:56.942879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:56.942881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:56.942882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:56.942883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:56.942884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:56.942885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:56.942887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:56.942888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.942889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:56.942891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:56.942892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:56.942893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:56.942899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:56.942909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:56.942913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:56.942919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:56.942923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:56.942928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:56.942933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:56.942937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:56.942941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:56.942946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:56.942951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.942956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:56.942959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:56.942963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:56.942968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:56.942977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:56.942987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:56.942993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:56.942999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:56.943005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:56.943011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:56.943020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:56.943026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:56.943036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:56.943042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:56.943051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:56.943057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:56.943070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:56.943079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:56.943089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:56.943095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:56.943103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:56.943108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:56.943115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:56.943121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:56.943127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.943137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.943142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:56.943148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:56.943157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:56.943165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:56.943174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:56.943180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:56.943188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:56.943194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:56.943261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:56.949197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:56.951137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1699
2025-09-30T14:54:56.951150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1699
2025-09-30T14:54:56.950701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:56.950726Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:56.950728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:56.950733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:56.950741Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1699 [2:7555895859928437407:9870]
2025-09-30T14:54:56.950759Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:56.950778Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:56.950781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:56.950785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:56.950787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:56.950810Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:56.950817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:56.950825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:56.950900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.950903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:56.950905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:56.950909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:56.950912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:56.950988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:56.950991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.951005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:56.951016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:56.951032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:56.951053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895860018202764:2454], now have 1 active actors on pipe
2025-09-30T14:54:56.951057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895860018203011:8002], now have 1 active actors on pipe
2025-09-30T14:54:56.951064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895859928437402:9870]
2025-09-30T14:54:56.951066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895859928437402:9870]
2025-09-30T14:54:56.951068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895859928437402:9870]
2025-09-30T14:54:56.951080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:56.951095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:56.951112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:56.951115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:56.951131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:56.951134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:56.951137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:56.951156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895859928437402:9870]
2025-09-30T14:54:56.951159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:56.951161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:56.952434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:56.952455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:56.952488Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6c4fa82-b03e338b-8d86740b-7170a4f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:56.952498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:56.952502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:56.952504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:56.952517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:56.952532Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:56.952548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:56.953021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:56.953041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:56.953064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:56.953208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1700 partition: 0 MaxSeqNo: 42 sessionId: src_id|d6c4fa82-b03e338b-8d86740b-7170a4f1_0
2025-09-30T14:54:56.953641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfc7f77-9aa6beaa-3cb277e1-7fec48b1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d6c4fa82-b03e338b-8d86740b-7170a4f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:56.956557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c4fa82-b03e338b-8d86740b-7170a4f1_0] Write session: try to update token
2025-09-30T14:54:56.956579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c4fa82-b03e338b-8d86740b-7170a4f1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:56.964308Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:56.964328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:56.964331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:56.964333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:56.964343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895859928437402:9870]
2025-09-30T14:54:56.964347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895859928437402:9870]
2025-09-30T14:54:56.964352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895859928437402:9870]
2025-09-30T14:54:56.964395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:56.964403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:56.964406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:56.964412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:56.964419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:56.964423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:56.964614Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:56.979380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1700 sessionId: src_id|d6c4fa82-b03e338b-8d86740b-7170a4f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:56.982753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:57.015597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895864313170430:9749]
2025-09-30T14:54:57.016225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1699, pipe: [1:7555895864313170430:9749]
2025-09-30T14:54:57.083364Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:57.083874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:57.083893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:57.083914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895864313170430:9749], now have 1 active actors on pipe
2025-09-30T14:54:57.084208Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:57.084166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895864313170430:9749]
2025-09-30T14:54:57.084646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c4fa82-b03e338b-8d86740b-7170a4f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:57.084664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c4fa82-b03e338b-8d86740b-7170a4f1_0] Write session will restart in 0.007790s
2025-09-30T14:54:57.084164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:57.084218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:57.084220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:57.084287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1700 reason: error at write: Disconnected sessionId: src_id|d6c4fa82-b03e338b-8d86740b-7170a4f1_0
2025-09-30T14:54:57.084703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c4fa82-b03e338b-8d86740b-7170a4f1_0] Write session: Do CDS request
2025-09-30T14:54:57.084465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1700 sessionId: src_id|d6c4fa82-b03e338b-8d86740b-7170a4f1_0 is DEAD
2025-09-30T14:54:57.084710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c4fa82-b03e338b-8d86740b-7170a4f1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:57.094128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c4fa82-b03e338b-8d86740b-7170a4f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:57.094251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:57.094270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1701
2025-09-30T14:54:57.094399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1701 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:57.094427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1701 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:57.094432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1701 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:57.094437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:57.095222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1701 sessionId:  describe result for acl check
2025-09-30T14:54:57.095487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:57.095501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:57.095503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:57.095509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895864313170485:7997] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:57.096081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895864313170485:7997] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:57.098891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895864313170485:7997] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:57.102126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895864313170485:7997] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:57.102147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895864313170485:7997] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:57.102150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895864313170485:7997] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:57.102160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1701 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:57.115239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:57.117557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:57.117828Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:57.117842Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:57.117855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:57.117944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:57.117995Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895864223404988:9872]
2025-09-30T14:54:57.118680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:57.119086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:57.119152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:57.119529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:57.119603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:57.119609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:57.119610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:57.119611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:57.119612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:57.119613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:57.119614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:57.119616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:57.119617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:57.119618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:57.119619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.119621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:57.119622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:57.119623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:57.119625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:57.119631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:57.119641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:57.119645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:57.119648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:57.119652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:57.119656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:57.119660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:57.119663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:57.119666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:57.119671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:57.119674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.119677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:57.119681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:57.119684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:57.119687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:57.119696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:57.119704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:57.119710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:57.119715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:57.119720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:57.119724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:57.119728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:57.119733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:57.119738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:57.119743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:57.119747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:57.119752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:57.119757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:57.119761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:57.119766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:57.119771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:57.119775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:57.119780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:57.119784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:57.119790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:57.119794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.119799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.119803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:57.119808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:57.119813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:57.119817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:57.119821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:57.119825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:57.119831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:57.119836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:57.119875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:57.125776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:57.127581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:57.127608Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:57.127611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:57.127615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:57.127623Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1700 [2:7555895864223404988:9872]
2025-09-30T14:54:57.127641Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:57.127660Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:57.127664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:57.127667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:57.127669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:57.127688Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:57.127696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:57.127706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:57.127777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.127785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:57.127787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:57.127791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:57.127793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:57.127867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:57.127876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.127889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:57.127899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:57.127913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:57.128229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1700
2025-09-30T14:54:57.128238Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1700
2025-09-30T14:54:57.127931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895864223404983:9872]
2025-09-30T14:54:57.127940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895864223404983:9872]
2025-09-30T14:54:57.127942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895864223404983:9872]
2025-09-30T14:54:57.127957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:57.127972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895864313170644:7997], now have 1 active actors on pipe
2025-09-30T14:54:57.127974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:57.127977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:57.127979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895864313170431:2454], now have 1 active actors on pipe
2025-09-30T14:54:57.127979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:57.127984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:57.127997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:57.128001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:57.128038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895864223404983:9872]
2025-09-30T14:54:57.128047Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:57.128068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:57.128575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:57.128589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:57.128622Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8cc1bacc-1b11765b-7a49bfee-870f16f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:57.128636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:57.128644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:57.128646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:57.128659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:57.128669Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:57.128694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:57.128944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:57.128955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:57.128972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:57.129093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1701 partition: 0 MaxSeqNo: 42 sessionId: src_id|8cc1bacc-1b11765b-7a49bfee-870f16f6_0
2025-09-30T14:54:57.129499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c4fa82-b03e338b-8d86740b-7170a4f1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8cc1bacc-1b11765b-7a49bfee-870f16f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:57.132994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc1bacc-1b11765b-7a49bfee-870f16f6_0] Write session: try to update token
2025-09-30T14:54:57.133022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc1bacc-1b11765b-7a49bfee-870f16f6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:57.141241Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:57.141261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:57.141271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895864223404983:9872]
2025-09-30T14:54:57.141319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:57.141323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:57.141506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:57.141667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:57.141863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:57.142019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:57.142280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:57.142330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:57.151891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1701 sessionId: src_id|8cc1bacc-1b11765b-7a49bfee-870f16f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:57.152740Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:57.152764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:57.152767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:57.152769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:57.152780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895864223404983:9872]
2025-09-30T14:54:57.152785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895864223404983:9872]
2025-09-30T14:54:57.152790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895864223404983:9872]
2025-09-30T14:54:57.152844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:57.152857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.152860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:57.153011Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:57.153091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:57.153106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:57.153114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:57.154805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:57.185003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895864313170814:9749]
2025-09-30T14:54:57.185341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1700, pipe: [1:7555895864313170814:9749]
2025-09-30T14:54:57.267530Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:57.268045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:57.268065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:57.268089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895864313170814:9749], now have 1 active actors on pipe
2025-09-30T14:54:57.268343Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:57.268750Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:57.268804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895864313170814:9749]
2025-09-30T14:54:57.268817Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:54:57.269024Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 17 consumer shared/user session shared/user_1_17_7543637519477031915_v1 is DEAD
2025-09-30T14:54:57.269159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:57.269230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1701 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8cc1bacc-1b11765b-7a49bfee-870f16f6_0
2025-09-30T14:54:57.269305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1701 sessionId: src_id|8cc1bacc-1b11765b-7a49bfee-870f16f6_0 is DEAD
2025-09-30T14:54:57.269602Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895791298693869:9746] disconnected; active server actors: 1
2025-09-30T14:54:57.269608Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895791298693869:9746] client user disconnected session shared/user_1_17_7543637519477031915_v1
2025-09-30T14:54:57.270248Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:54:57.270387Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:54:57.270393Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:54:57.270401Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.005742s
2025-09-30T14:54:57.270642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc1bacc-1b11765b-7a49bfee-870f16f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:57.270649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc1bacc-1b11765b-7a49bfee-870f16f6_0] Write session will restart in 0.005878s
2025-09-30T14:54:57.270674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc1bacc-1b11765b-7a49bfee-870f16f6_0] Write session: Do CDS request
2025-09-30T14:54:57.270680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc1bacc-1b11765b-7a49bfee-870f16f6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:57.276691Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:54:57.276952Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:54:57.276970Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 18
2025-09-30T14:54:57.277174Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 18 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:54:57.277236Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:54:57.277331Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 auth for : user
2025-09-30T14:54:57.277519Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 Handle describe topics response
2025-09-30T14:54:57.277557Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 auth is DEAD
2025-09-30T14:54:57.277573Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:54:57.277698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc1bacc-1b11765b-7a49bfee-870f16f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:57.277758Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:57.277770Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1702
2025-09-30T14:54:57.277927Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:54:57.277941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1702 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:57.277968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1702 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:57.277979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1702 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:57.277983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:57.278026Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_18_18254351790732249821_v1
2025-09-30T14:54:57.278039Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895864313170829:7991] connected; active server actors: 1
2025-09-30T14:54:57.278058Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555895864313170829:7991] session shared/user_1_18_18254351790732249821_v1
2025-09-30T14:54:57.278068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:54:57.278078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:54:57.278089Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_18_18254351790732249821_v1" (Sender=[1:7555895864313170822:7991], Pipe=[1:7555895864313170829:7991], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:54:57.278098Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:54:57.278120Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:54:57.278133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_18_18254351790732249821_v1" (Sender=[1:7555895864313170822:7991], Pipe=[1:7555895864313170829:7991], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:54:57.278148Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_18_18254351790732249821_v1" sender [1:7555895864313170822:7991] lock partition 0 for ReadingSession "shared/user_1_18_18254351790732249821_v1" (Sender=[1:7555895864313170822:7991], Pipe=[1:7555895864313170829:7991], Partitions=[], ActiveFamilyCount=1) generation 1 step 18
2025-09-30T14:54:57.278161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:54:57.278166Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000039s
2025-09-30T14:54:57.278297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1702 sessionId:  describe result for acl check
2025-09-30T14:54:57.278324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:57.278326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:57.278328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:57.278333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895864313170833:7986] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:57.278392Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 18 Session: "shared/user_1_18_18254351790732249821_v1" ClientId: "user" PipeClient { RawX1: 7555895864313170829 RawX2: 4503603922345783 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:54:57.278412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:54:57.278886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895864313170833:7986] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:57.281180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895864313170833:7986] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:57.291264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895864313170833:7986] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:57.291286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895864313170833:7986] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:57.291290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895864313170833:7986] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:57.291300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1702 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:57.296905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:57.299712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:57.299983Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:57.299987Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:57.300002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:57.300056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:57.300094Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895864223405275:9874]
2025-09-30T14:54:57.300689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:57.300994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:57.301050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:57.301386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:57.301471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:57.301478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:57.301479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:57.301480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:57.301482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:57.301483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:57.301484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:57.301486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:57.301487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:57.301488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:57.301489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.301491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:57.301492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:57.301493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:57.301494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:57.301499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:57.301510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:57.301515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:57.301519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:57.301523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:57.301526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:57.301531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:57.301535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:57.301539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:57.301545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:57.301549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.301554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:57.301558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:57.301562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:57.301566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:57.301574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:57.301582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:57.301588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:57.301594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:57.301599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:57.301605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:57.301611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:57.301616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:57.301621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:57.301626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:57.301630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:57.301636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:57.301641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:57.301646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:57.301651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:57.301656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:57.301660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:57.301669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:57.301674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:57.301680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:57.301685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.301690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.301695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:57.301700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:57.301714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:57.301719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:57.301724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:57.301727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:57.301731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:57.301742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:57.301790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:57.309810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:57.311367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:57.311387Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:57.311389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:57.311393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:57.311401Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1701 [2:7555895864223405275:9874]
2025-09-30T14:54:57.311419Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:57.311434Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:57.311441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:57.311443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:57.311444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:57.311460Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:57.311466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:57.311472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:57.311535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.311540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:57.311541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:57.311546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:57.311548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:57.311607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:57.311613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.311623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:57.311636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:57.311653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:57.311671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895864223405270:9874]
2025-09-30T14:54:57.311676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895864223405270:9874]
2025-09-30T14:54:57.311677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895864223405270:9874]
2025-09-30T14:54:57.311683Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:57.311696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:57.311700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:57.311703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:57.311706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:57.311713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:57.311716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:57.311726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895864313171074:7986], now have 1 active actors on pipe
2025-09-30T14:54:57.311734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895864313170816:2454], now have 1 active actors on pipe
2025-09-30T14:54:57.311737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895864313170835:7977], now have 1 active actors on pipe
2025-09-30T14:54:57.311775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895864223405270:9874]
2025-09-30T14:54:57.311787Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:57.311797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:57.311861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1701
2025-09-30T14:54:57.311864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1701
2025-09-30T14:54:57.311914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1701, pipe: [1:7555895864313170835:7977]
2025-09-30T14:54:57.311958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:57.311967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:57.311980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:57.311982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:57.311987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_18_18254351790732249821_v1 on pipe: [1:7555895864313170835:7977]
2025-09-30T14:54:57.312017Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65643435-c3c0d75b-9b64dd71-a1b8b3e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:57.312026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:57.312027Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_18_18254351790732249821_v1:1 with generation 1701
2025-09-30T14:54:57.312031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:57.312032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:57.312040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:57.312048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:57.312057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:57.312060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:57.312061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:57.312071Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_18_18254351790732249821_v1
2025-09-30T14:54:57.312077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:57.312100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:57.312115Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:54:57.312275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:57.312283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:57.312297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:57.312385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1702 partition: 0 MaxSeqNo: 42 sessionId: src_id|65643435-c3c0d75b-9b64dd71-a1b8b3e7_0
2025-09-30T14:54:57.312767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc1bacc-1b11765b-7a49bfee-870f16f6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|65643435-c3c0d75b-9b64dd71-a1b8b3e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:57.315800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65643435-c3c0d75b-9b64dd71-a1b8b3e7_0] Write session: try to update token
2025-09-30T14:54:57.315824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65643435-c3c0d75b-9b64dd71-a1b8b3e7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:57.317797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:54:57.317852Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:54:57.317862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:57.317865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:57.317867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:57.317878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:54:57.317893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:54:57.318109Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759244097311 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:54:57.318136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:54:57.318174Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 sending to client partition status
2025-09-30T14:54:57.326030Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:57.326052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:57.326070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895864223405270:9874]
2025-09-30T14:54:57.326117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:57.326228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:57.326312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:57.326471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:57.326645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:57.326810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:57.327015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:57.327065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:57.333899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1702 sessionId: src_id|65643435-c3c0d75b-9b64dd71-a1b8b3e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:57.336861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:57.337114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:57.337143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:57.337191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:57.337272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:57.338901Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:57.338922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:57.338925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:57.338927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:57.338937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895864223405270:9874]
2025-09-30T14:54:57.338942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895864223405270:9874]
2025-09-30T14:54:57.338946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895864223405270:9874]
2025-09-30T14:54:57.338986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:57.338992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:57.338997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.338998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:57.339000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:57.339002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:57.339155Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:57.456872Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:57.466551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:57.466585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:57.466770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:57.466844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:57.466909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:57.466972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:57.467013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:57.467022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:57.467094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:57.467157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:57.467222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:57.467322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:57.467375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:57.467389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:57.467468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:57.467539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:57.467614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:57.467695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:57.467746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:57.467754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:57.467831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:57.467938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:57.468007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:57.468076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:57.468126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:57.468136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:57.468220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:57.468295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:57.468377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:57.468467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:57.468516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:57.468529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:57.468598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:57.468664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:57.468740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:57.468820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:57.468868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:57.468872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:57.468954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:57.469020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:57.469095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:57.469161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:57.469206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:57.469210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:57.469285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:57.469348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:57.469416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:57.469483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:57.469541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:57.469549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:57.469621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:57.469690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:57.469776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:57.469846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:57.469887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:57.469891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:57.469968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:57.470030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:57.470098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:57.470183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:57.470230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:57.470233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:57.470506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:57.470566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895864313170835:7977]
2025-09-30T14:54:57.470596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:57.470604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:57.470634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1702 reason: error at write: Disconnected sessionId: src_id|65643435-c3c0d75b-9b64dd71-a1b8b3e7_0
2025-09-30T14:54:57.470838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1702 sessionId: src_id|65643435-c3c0d75b-9b64dd71-a1b8b3e7_0 is DEAD
2025-09-30T14:54:57.471105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65643435-c3c0d75b-9b64dd71-a1b8b3e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:57.471129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65643435-c3c0d75b-9b64dd71-a1b8b3e7_0] Write session will restart in 0.005317s
2025-09-30T14:54:57.471155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65643435-c3c0d75b-9b64dd71-a1b8b3e7_0] Write session: Do CDS request
2025-09-30T14:54:57.471162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65643435-c3c0d75b-9b64dd71-a1b8b3e7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:57.471629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_18_18254351790732249821_v1
2025-09-30T14:54:57.471646Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:57.471673Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_18_18254351790732249821_v1
2025-09-30T14:54:57.482734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65643435-c3c0d75b-9b64dd71-a1b8b3e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:57.482903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:57.482929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1703
2025-09-30T14:54:57.483485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1703 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:57.483530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1703 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:57.483535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1703 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:57.483542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:57.484125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1703 sessionId:  describe result for acl check
2025-09-30T14:54:57.484162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:57.484164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:57.484165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:57.484172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895864313171288:7969] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:57.484780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895864313171288:7969] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:57.489191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895864313171288:7969] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:57.492754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895864313171288:7969] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:57.492771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895864313171288:7969] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:57.492775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895864313171288:7969] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:57.492921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1703 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:57.505309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:57.508443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:57.508695Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:57.508700Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:57.508712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:57.508771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:57.508822Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895864223405603:9889]
2025-09-30T14:54:57.509530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:57.509897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:57.509959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:57.510414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:57.510510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:57.510518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:57.510519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:57.510520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:57.510522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:57.510523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:57.510525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:57.510526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:57.510527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:57.510529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:57.510530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.510531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:57.510533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:57.510534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:57.510535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:57.510541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:57.510553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:57.510557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:57.510562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:57.510566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:57.510571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:57.510575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:57.510579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:57.510584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:57.510588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:57.510593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.510597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:57.510601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:57.510605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:57.510609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:57.510618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:57.510626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:57.510638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:57.510649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:57.510660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:57.510672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:57.510676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:57.510681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:57.510691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:57.510698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:57.510708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:57.510718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:57.510728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:57.510735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:57.510744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:57.510750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:57.510759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:57.510765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:57.510769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:57.510779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:57.510785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.510792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.510801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:57.510806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:57.510815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:57.510821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:57.510826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:57.510831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:57.510840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:57.510846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:57.510895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:57.516942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:57.517931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:57.517953Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:57.517956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:57.517961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:57.517969Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1702 [2:7555895864223405603:9889]
2025-09-30T14:54:57.517985Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:57.518002Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:57.518005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:57.518008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:57.518011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:57.518027Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:57.518034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:57.518041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:57.518109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.518119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:57.518122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:57.518125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:57.518128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:57.518188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:57.518196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.518210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:57.518223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:57.518245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:57.518273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895864313171221:2454], now have 1 active actors on pipe
2025-09-30T14:54:57.518277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895864313171404:7969], now have 1 active actors on pipe
2025-09-30T14:54:57.518284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895864223405598:9889]
2025-09-30T14:54:57.518287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895864223405598:9889]
2025-09-30T14:54:57.518289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895864223405598:9889]
2025-09-30T14:54:57.518303Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:57.518317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:57.518320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:57.518320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:57.518323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:57.518335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:57.518338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:57.518330Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1702
2025-09-30T14:54:57.518380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1702
2025-09-30T14:54:57.518376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895864223405598:9889]
2025-09-30T14:54:57.518389Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:57.518395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:57.518557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:57.518571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:57.518599Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|acc82e08-99ef92dd-e8759754-faf4b46c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:57.518613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:57.518622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:57.518624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:57.518639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:57.518658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:57.518679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:57.518949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:57.518973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:57.519005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:57.519131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1703 partition: 0 MaxSeqNo: 42 sessionId: src_id|acc82e08-99ef92dd-e8759754-faf4b46c_0
2025-09-30T14:54:57.519755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65643435-c3c0d75b-9b64dd71-a1b8b3e7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|acc82e08-99ef92dd-e8759754-faf4b46c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:57.523537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acc82e08-99ef92dd-e8759754-faf4b46c_0] Write session: try to update token
2025-09-30T14:54:57.523562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acc82e08-99ef92dd-e8759754-faf4b46c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:57.531536Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:57.531561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:57.531572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895864223405598:9889]
2025-09-30T14:54:57.531621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:57.531631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:57.531814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:57.531977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:57.532135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:57.532289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:57.532501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:57.532549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:57.545483Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:57.545512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:57.545514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:57.545516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:57.545528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895864223405598:9889]
2025-09-30T14:54:57.545533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895864223405598:9889]
2025-09-30T14:54:57.545544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895864223405598:9889]
2025-09-30T14:54:57.545594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:57.545602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.545605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:57.545605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:57.545614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:57.545619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:57.545786Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:57.552154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1703 sessionId: src_id|acc82e08-99ef92dd-e8759754-faf4b46c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:57.555802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:57.571048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895864313171591:7977]
2025-09-30T14:54:57.571442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1702, pipe: [1:7555895864313171591:7977]
2025-09-30T14:54:57.663858Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:57.664599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:57.664620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:57.664642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895864313171591:7977], now have 1 active actors on pipe
2025-09-30T14:54:57.664872Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:57.664941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895864313171591:7977]
2025-09-30T14:54:57.664946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:57.664979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:57.665052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1703 reason: status is not ok: tablet will be restarted right now sessionId: src_id|acc82e08-99ef92dd-e8759754-faf4b46c_0
2025-09-30T14:54:57.665217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1703 sessionId: src_id|acc82e08-99ef92dd-e8759754-faf4b46c_0 is DEAD
2025-09-30T14:54:57.665366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acc82e08-99ef92dd-e8759754-faf4b46c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:57.665377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acc82e08-99ef92dd-e8759754-faf4b46c_0] Write session will restart in 0.007405s
2025-09-30T14:54:57.665412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acc82e08-99ef92dd-e8759754-faf4b46c_0] Write session: Do CDS request
2025-09-30T14:54:57.665418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acc82e08-99ef92dd-e8759754-faf4b46c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:57.673827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acc82e08-99ef92dd-e8759754-faf4b46c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:57.673937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:57.673962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1704
2025-09-30T14:54:57.674152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1704 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:57.674190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1704 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:57.674196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1704 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:57.674202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:57.674707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1704 sessionId:  describe result for acl check
2025-09-30T14:54:57.674747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:57.674750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:57.674752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:57.674759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895864313171630:7958] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:57.675355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895864313171630:7958] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:57.677802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895864313171630:7958] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:57.686785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895864313171630:7958] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:57.686805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895864313171630:7958] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:57.686809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895864313171630:7958] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:57.686816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1704 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:57.698762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:57.701990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:57.702238Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:57.702249Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:57.702261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:57.702325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:57.702378Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895864223405903:9892]
2025-09-30T14:54:57.703120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:57.703498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:57.703567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:57.703898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:57.703959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:57.703960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:57.703961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:57.703963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:57.703964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:57.703965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:57.703966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:57.703967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:57.703969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:57.703970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:57.703971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.703972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:57.703973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:57.703974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:57.703976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:57.703996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:57.704007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:57.704011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:57.704016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:57.704020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:57.704025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:57.704029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:57.704033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:57.704038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:57.704042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:57.704046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.704050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:57.704054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:57.704058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:57.704062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:57.704072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:57.704081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:57.704088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:57.704094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:57.704099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:57.704104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:57.704109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:57.704115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:57.704120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:57.704126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:57.704132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:57.704137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:57.704141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:57.704147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:57.704152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:57.704157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:57.704162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:57.704167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:57.704172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:57.704177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:57.704183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.704188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.704193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:57.704199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:57.704204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:57.704209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:57.704214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:57.704221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:57.704226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:57.704231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:57.704274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:57.718771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:57.719695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:57.719714Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:57.719718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:57.719723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:57.719730Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1703 [2:7555895864223405903:9892]
2025-09-30T14:54:57.719749Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:57.719767Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:57.719776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:57.719780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:57.719783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:57.719799Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:57.719811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:57.719818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:57.719886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.719896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:57.719899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:57.719904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:57.719906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:57.719981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:57.719989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.720004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:57.720023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:57.720048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:57.720073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895864313171781:7958], now have 1 active actors on pipe
2025-09-30T14:54:57.720082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895864313171606:2454], now have 1 active actors on pipe
2025-09-30T14:54:57.720089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895864223405897:9892]
2025-09-30T14:54:57.720097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895864223405897:9892]
2025-09-30T14:54:57.720100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895864223405897:9892]
2025-09-30T14:54:57.720113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:57.720190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1703
2025-09-30T14:54:57.720129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:57.720130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:57.720137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:57.720140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:57.720154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:57.720157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:57.720196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895864223405897:9892]
2025-09-30T14:54:57.720205Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:57.720212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:57.720295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1703
2025-09-30T14:54:57.720383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:57.720394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:57.720426Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a2a6c99-cd2e5975-383d8eb3-8b1642d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:57.720433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:57.720437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:57.720440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:57.720451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:57.720462Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:57.720475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:57.720689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:57.720696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:57.720719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:57.720848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1704 partition: 0 MaxSeqNo: 42 sessionId: src_id|5a2a6c99-cd2e5975-383d8eb3-8b1642d1_0
2025-09-30T14:54:57.721327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acc82e08-99ef92dd-e8759754-faf4b46c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5a2a6c99-cd2e5975-383d8eb3-8b1642d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:57.724674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2a6c99-cd2e5975-383d8eb3-8b1642d1_0] Write session: try to update token
2025-09-30T14:54:57.724698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2a6c99-cd2e5975-383d8eb3-8b1642d1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:57.733144Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:57.733173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:57.733184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895864223405897:9892]
2025-09-30T14:54:57.733233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:57.733232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:57.733439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:57.733603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:57.733776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:57.733945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:57.734160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:57.734206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:57.744241Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:57.744267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:57.744270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:57.744273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:57.744284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895864223405897:9892]
2025-09-30T14:54:57.744289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895864223405897:9892]
2025-09-30T14:54:57.744293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895864223405897:9892]
2025-09-30T14:54:57.744339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:57.744347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.744347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:57.744349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:57.744358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:57.744363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:57.744496Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:57.758360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1704 sessionId: src_id|5a2a6c99-cd2e5975-383d8eb3-8b1642d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:57.761979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:57.765072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895864313171979:7977]
2025-09-30T14:54:57.765405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1703, pipe: [1:7555895864313171979:7977]
2025-09-30T14:54:57.864046Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:57.864927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:57.864949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:57.864969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895864313171979:7977], now have 1 active actors on pipe
2025-09-30T14:54:57.865191Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:57.865716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2a6c99-cd2e5975-383d8eb3-8b1642d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:57.865731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2a6c99-cd2e5975-383d8eb3-8b1642d1_0] Write session will restart in 0.008333s
2025-09-30T14:54:57.865763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2a6c99-cd2e5975-383d8eb3-8b1642d1_0] Write session: Do CDS request
2025-09-30T14:54:57.865770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2a6c99-cd2e5975-383d8eb3-8b1642d1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:57.865204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895864313171979:7977]
2025-09-30T14:54:57.865210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:57.865214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:57.865247Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:57.865278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1704 reason: error at write: Disconnected sessionId: src_id|5a2a6c99-cd2e5975-383d8eb3-8b1642d1_0
2025-09-30T14:54:57.865473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1704 sessionId: src_id|5a2a6c99-cd2e5975-383d8eb3-8b1642d1_0 is DEAD
2025-09-30T14:54:57.875724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2a6c99-cd2e5975-383d8eb3-8b1642d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:57.875965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:57.875993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1705
2025-09-30T14:54:57.876188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1705 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:57.876231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1705 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:57.876247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1705 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:57.876253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:57.876789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1705 sessionId:  describe result for acl check
2025-09-30T14:54:57.876833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:57.876836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:57.876838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:57.876845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895864313171997:7956] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:57.877548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895864313171997:7956] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:57.886277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895864313171997:7956] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:57.890539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895864313171997:7956] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:57.890570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895864313171997:7956] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:57.890575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895864313171997:7956] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:57.890591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1705 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:57.911119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:57.915668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:57.915992Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:57.915998Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:57.916012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:57.916081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:57.916134Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895864223406195:9895]
2025-09-30T14:54:57.916960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:57.922906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:57.923041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:57.923647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:57.923865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:57.923880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:57.923881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:57.923883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:57.923885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:57.923887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:57.923889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:57.923890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:57.923893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:57.923894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:57.923895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.923897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:57.923902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:57.923903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:57.923904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:57.923912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:57.923924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:57.923929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:57.923934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:57.923939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:57.923953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:57.923958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:57.923963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:57.923968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:57.923972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:57.923977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.923981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:57.923986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:57.923990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:57.923994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:57.924005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:57.924015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:57.924022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:57.924029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:57.924034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:57.924041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:57.924046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:57.924053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:57.924061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:57.924068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:57.924072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:57.924078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:57.924083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:57.924089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:57.924098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:57.924104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:57.924110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:57.924116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:57.924122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:57.924128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:57.924135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.924142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.924148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:57.924154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:57.924158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:57.924164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:57.924170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:57.924176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:57.924185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:57.924191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:57.924244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:57.936157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:57.937318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:57.937346Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:57.937350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:57.937356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:57.937366Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1704 [2:7555895864223406195:9895]
2025-09-30T14:54:57.937390Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:57.937416Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:57.937420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:57.937425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:57.937428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:57.937451Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:57.937461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:57.937471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:57.937571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.937585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:57.937588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:57.937594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:57.937597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:57.937697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:57.937724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.937749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:57.937761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:57.937777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:57.937804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895864223406190:9895]
2025-09-30T14:54:57.937807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895864223406190:9895]
2025-09-30T14:54:57.937810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895864223406190:9895]
2025-09-30T14:54:57.937825Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:57.937844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895864313172129:7956], now have 1 active actors on pipe
2025-09-30T14:54:57.937847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895864313171982:2454], now have 1 active actors on pipe
2025-09-30T14:54:57.937857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:57.937873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:57.937878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:57.937932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895864223406190:9895]
2025-09-30T14:54:57.937935Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:57.938017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:57.938020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:57.938022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:57.938029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:57.938984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1704
2025-09-30T14:54:57.939027Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1704
2025-09-30T14:54:57.941830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:57.941864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:57.941909Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aae8a746-b5cba214-f450bb9d-f2cf337a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:57.941927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:57.941939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:57.941943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:57.941961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:57.941990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:57.942026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:57.942477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:57.942493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:57.942517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:57.942701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1705 partition: 0 MaxSeqNo: 42 sessionId: src_id|aae8a746-b5cba214-f450bb9d-f2cf337a_0
2025-09-30T14:54:57.943225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2a6c99-cd2e5975-383d8eb3-8b1642d1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|aae8a746-b5cba214-f450bb9d-f2cf337a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:57.946444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aae8a746-b5cba214-f450bb9d-f2cf337a_0] Write session: try to update token
2025-09-30T14:54:57.946473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aae8a746-b5cba214-f450bb9d-f2cf337a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:57.954760Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:57.954790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:57.954794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:57.954798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:57.954810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895864223406190:9895]
2025-09-30T14:54:57.954815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895864223406190:9895]
2025-09-30T14:54:57.954822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895864223406190:9895]
2025-09-30T14:54:57.954874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:57.954883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:57.954886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:57.954890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:57.954898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:57.954904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:57.955081Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:57.965280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895864313172355:7977]
2025-09-30T14:54:57.965731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1704, pipe: [1:7555895864313172355:7977]
2025-09-30T14:54:57.967510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1705 sessionId: src_id|aae8a746-b5cba214-f450bb9d-f2cf337a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:57.970428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:58.081307Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:58.082297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895864313172355:7977], now have 1 active actors on pipe
2025-09-30T14:54:58.082371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:58.082380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:58.082946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:58.082965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:58.083016Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:58.083050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1705 reason: error at write: Disconnected sessionId: src_id|aae8a746-b5cba214-f450bb9d-f2cf337a_0
2025-09-30T14:54:58.083200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1705 sessionId: src_id|aae8a746-b5cba214-f450bb9d-f2cf337a_0 is DEAD
2025-09-30T14:54:58.083414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aae8a746-b5cba214-f450bb9d-f2cf337a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:58.083426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aae8a746-b5cba214-f450bb9d-f2cf337a_0] Write session will restart in 0.009552s
2025-09-30T14:54:58.083332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:58.083451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aae8a746-b5cba214-f450bb9d-f2cf337a_0] Write session: Do CDS request
2025-09-30T14:54:58.083458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aae8a746-b5cba214-f450bb9d-f2cf337a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:58.083407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895864313172355:7977]
2025-09-30T14:54:58.097333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aae8a746-b5cba214-f450bb9d-f2cf337a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:58.099444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:58.099469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1706
2025-09-30T14:54:58.099744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1706 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:58.099801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1706 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:58.099808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1706 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:58.099821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:58.100397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1706 sessionId:  describe result for acl check
2025-09-30T14:54:58.100449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:58.100452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:58.100454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:58.100461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895868608139675:7942] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:58.101139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895868608139675:7942] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:58.110756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895868608139675:7942] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:58.121489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895868608139675:7942] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:58.121514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895868608139675:7942] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:58.121519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895868608139675:7942] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:58.121529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1706 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:58.140644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:58.148078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:58.148440Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:58.148455Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:58.148471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:58.148563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:58.148618Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895868518373781:9897]
2025-09-30T14:54:58.149455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:58.150492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:58.150591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:58.151029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:58.151119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:58.151127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:58.151128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:58.151129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:58.151131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:58.151132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:58.151134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:58.151135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:58.151136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:58.151138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:58.151139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:58.151141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:58.151143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:58.151144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:58.151146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:58.151154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:58.151166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:58.151172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:58.151179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:58.151184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:58.151189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:58.151194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:58.151199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:58.151203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:58.151209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:58.151214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:58.151218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:58.151223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:58.151228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:58.151233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:58.151263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:58.151272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:58.151280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:58.151286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:58.151292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:58.151298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:58.151303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:58.151310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:58.151317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:58.151325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:58.151331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:58.151337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:58.151343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:58.151350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:58.151355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:58.151361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:58.151375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:58.151381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:58.151386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:58.151393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:58.151399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:58.151405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:58.151410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:58.151416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:58.151421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:58.151428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:58.151434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:58.151440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:58.151445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:58.151452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:58.151511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:58.159404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:58.160782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:58.160804Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:58.160807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:58.160811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:58.160818Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1705 [2:7555895868518373781:9897]
2025-09-30T14:54:58.160840Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:58.160859Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:58.160862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:58.160865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:58.160868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:58.160886Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:58.160894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:58.160902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:58.160978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:58.160989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:58.160991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:58.160994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:58.160997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:58.161076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:58.161085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:58.161100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:58.161111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:58.161128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:58.161152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895868518373775:9897]
2025-09-30T14:54:58.161160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895868518373775:9897]
2025-09-30T14:54:58.161162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895868518373775:9897]
2025-09-30T14:54:58.161183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:58.161203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:58.161224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:58.161233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:58.161271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895868518373775:9897]
2025-09-30T14:54:58.161273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:58.161278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:58.161280Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:58.161280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:58.161289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:58.161596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895868608139861:7942], now have 1 active actors on pipe
2025-09-30T14:54:58.161610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895868608139657:2454], now have 1 active actors on pipe
2025-09-30T14:54:58.161734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1705
2025-09-30T14:54:58.161783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1705
2025-09-30T14:54:58.161922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:58.161937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:58.161972Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24116aa1-7dabe4b3-70312134-12897e57_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:58.161988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:58.161992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:58.161995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:58.162007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:58.162026Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:58.162047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:58.162427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:58.162438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:58.162454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:58.162626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1706 partition: 0 MaxSeqNo: 42 sessionId: src_id|24116aa1-7dabe4b3-70312134-12897e57_0
2025-09-30T14:54:58.163165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aae8a746-b5cba214-f450bb9d-f2cf337a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|24116aa1-7dabe4b3-70312134-12897e57_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:58.166340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24116aa1-7dabe4b3-70312134-12897e57_0] Write session: try to update token
2025-09-30T14:54:58.166373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24116aa1-7dabe4b3-70312134-12897e57_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:58.181186Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:58.181210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:58.181220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895868518373775:9897]
2025-09-30T14:54:58.181268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:58.181275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:58.181462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:58.181626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:58.181795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:58.181951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:58.182278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:58.182328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:58.183335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895868608140040:7977]
2025-09-30T14:54:58.183745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895868608140040:7977], now have 1 active actors on pipe
2025-09-30T14:54:58.183803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1705, pipe: [1:7555895868608140040:7977]
2025-09-30T14:54:58.195465Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:58.195492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:58.195495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:58.195498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:58.195511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895868518373775:9897]
2025-09-30T14:54:58.195517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895868518373775:9897]
2025-09-30T14:54:58.195524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895868518373775:9897]
2025-09-30T14:54:58.195572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:58.195580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:58.195583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:58.195588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:58.195596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:58.195602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:58.195752Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:58.197948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1706 sessionId: src_id|24116aa1-7dabe4b3-70312134-12897e57_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:58.201386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:58.357032Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:58.357717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:58.357739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:58.358051Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:58.358044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:58.358064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:58.358064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:58.358118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895868608140040:7977]
2025-09-30T14:54:58.358151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1706 reason: error at write: Disconnected sessionId: src_id|24116aa1-7dabe4b3-70312134-12897e57_0
2025-09-30T14:54:58.358344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1706 sessionId: src_id|24116aa1-7dabe4b3-70312134-12897e57_0 is DEAD
2025-09-30T14:54:58.359359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24116aa1-7dabe4b3-70312134-12897e57_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:58.359371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24116aa1-7dabe4b3-70312134-12897e57_0] Write session will restart in 0.008751s
2025-09-30T14:54:58.359398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24116aa1-7dabe4b3-70312134-12897e57_0] Write session: Do CDS request
2025-09-30T14:54:58.359405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24116aa1-7dabe4b3-70312134-12897e57_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:58.371699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24116aa1-7dabe4b3-70312134-12897e57_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:58.371934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:58.371962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1707
2025-09-30T14:54:58.372154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1707 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:58.372205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1707 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:58.372212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1707 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:58.372220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:58.372907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1707 sessionId:  describe result for acl check
2025-09-30T14:54:58.372943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:58.372945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:58.372947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:58.372956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895868608140075:7938] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:58.373542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895868608140075:7938] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:58.380191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895868608140075:7938] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:58.397529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895868608140075:7938] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:58.397557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895868608140075:7938] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:58.397561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895868608140075:7938] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:58.397572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1707 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:58.423866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:58.428904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:58.429242Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:58.429247Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:58.429263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:58.429327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:58.429369Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895868518374089:9900]
2025-09-30T14:54:58.430158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:58.430740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:58.430807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:58.431215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:58.431318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:58.431320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:58.431321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:58.431322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:58.431323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:58.431325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:58.431326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:58.431328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:58.431329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:58.431330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:58.431332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:58.431333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:58.431335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:58.431336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:58.431338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:58.431346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:58.431357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:58.431360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:58.431364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:58.431367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:58.431373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:58.431377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:58.431381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:58.431385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:58.431390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:58.431394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:58.431397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:58.431401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:58.431405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:58.431409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:58.431418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:58.431427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:58.431433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:58.431440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:58.431446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:58.431452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:58.431457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:58.431462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:58.431467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:58.431473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:58.431478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:58.431484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:58.431491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:58.431497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:58.431502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:58.431508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:58.431515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:58.431520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:58.431526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:58.431530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:58.431535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:58.431540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:58.431545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:58.431551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:58.431555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:58.431561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:58.431566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:58.431572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:58.431579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:58.431584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:58.431627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:58.439591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:58.442774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1706
2025-09-30T14:54:58.442826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1706
2025-09-30T14:54:58.441053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:58.441075Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:58.441079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:58.441083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:58.441092Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1706 [2:7555895868518374089:9900]
2025-09-30T14:54:58.441111Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:58.441130Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:58.441135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:58.441139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:58.441142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:58.441164Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:58.441174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:58.441182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:58.441262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:58.441264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:58.441267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:58.441272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:58.441275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:58.441364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:58.441368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:58.441385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:58.441398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:58.441416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:58.441441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895868518374084:9900]
2025-09-30T14:54:58.441443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895868518374084:9900]
2025-09-30T14:54:58.441446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895868518374084:9900]
2025-09-30T14:54:58.441463Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:58.441480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:58.441500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:58.441504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:58.441551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895868518374084:9900]
2025-09-30T14:54:58.441553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:58.441805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:58.441808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:58.441811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:58.441818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:58.449600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895868608140043:2454], now have 1 active actors on pipe
2025-09-30T14:54:58.449633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895868608140269:7938], now have 1 active actors on pipe
2025-09-30T14:54:58.449681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:58.449692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:58.449753Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f6ea1c4-83cbaa45-371ae888-5dd8f884_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:58.449778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:58.449786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:58.449790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:58.449814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:58.449839Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:58.449874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:58.450321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:58.450348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:58.450389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:58.450522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1707 partition: 0 MaxSeqNo: 42 sessionId: src_id|2f6ea1c4-83cbaa45-371ae888-5dd8f884_0
2025-09-30T14:54:58.451465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24116aa1-7dabe4b3-70312134-12897e57_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2f6ea1c4-83cbaa45-371ae888-5dd8f884_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:58.454473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f6ea1c4-83cbaa45-371ae888-5dd8f884_0] Write session: try to update token
2025-09-30T14:54:58.454497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f6ea1c4-83cbaa45-371ae888-5dd8f884_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:58.458320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895868608140431:7977]
2025-09-30T14:54:58.458561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1706, pipe: [1:7555895868608140431:7977]
2025-09-30T14:54:58.458822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895868608140431:7977], now have 1 active actors on pipe
2025-09-30T14:54:58.460231Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:58.460237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:58.460240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:58.460241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:58.460250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895868518374084:9900]
2025-09-30T14:54:58.460257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895868518374084:9900]
2025-09-30T14:54:58.460262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895868518374084:9900]
2025-09-30T14:54:58.460311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:58.460318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:58.460321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:58.460322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:58.460330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:58.460337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:58.460482Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:58.493478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1707 sessionId: src_id|2f6ea1c4-83cbaa45-371ae888-5dd8f884_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:58.496781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:58.582543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895868608140431:7977]
2025-09-30T14:54:58.582578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:58.582580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:58.582642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1707 reason: error at write: Disconnected sessionId: src_id|2f6ea1c4-83cbaa45-371ae888-5dd8f884_0
2025-09-30T14:54:58.581740Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:58.582130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:58.582139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:58.582323Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:58.582947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f6ea1c4-83cbaa45-371ae888-5dd8f884_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:58.582959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f6ea1c4-83cbaa45-371ae888-5dd8f884_0] Write session will restart in 0.008787s
2025-09-30T14:54:58.582983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f6ea1c4-83cbaa45-371ae888-5dd8f884_0] Write session: Do CDS request
2025-09-30T14:54:58.582989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f6ea1c4-83cbaa45-371ae888-5dd8f884_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:58.582805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1707 sessionId: src_id|2f6ea1c4-83cbaa45-371ae888-5dd8f884_0 is DEAD
2025-09-30T14:54:58.582938Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:58.592787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f6ea1c4-83cbaa45-371ae888-5dd8f884_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:58.592944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:58.592964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1708
2025-09-30T14:54:58.593083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1708 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:58.593106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1708 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:58.593110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1708 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:58.593114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:58.593632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1708 sessionId:  describe result for acl check
2025-09-30T14:54:58.593677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:58.593679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:58.593682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:58.593688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895868608140462:7927] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:58.594321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895868608140462:7927] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:58.596995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895868608140462:7927] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:58.600053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895868608140462:7927] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:58.600073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895868608140462:7927] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:58.600077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895868608140462:7927] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:58.600086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1708 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:58.659032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:58.667567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:58.667851Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:58.667863Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:58.667874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:58.667944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:58.667985Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895868518374416:9915]
2025-09-30T14:54:58.668535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:58.669241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:58.669347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:58.669844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:58.669943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:58.669954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:58.669955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:58.669957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:58.669959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:58.669961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:58.669962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:58.669965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:58.669967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:58.669968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:58.669970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:58.669972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:58.669975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:58.669977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:58.669979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:58.669988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:58.670001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:58.670005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:58.670010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:58.670015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:58.670020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:58.670024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:58.670029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:58.670033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:58.670038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:58.670043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:58.670047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:58.670051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:58.670055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:58.670059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:58.670072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:58.670085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:58.670093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:58.670101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:58.670108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:58.670115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:58.670121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:58.670128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:58.670135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:58.670141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:58.670147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:58.670153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:58.670161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:58.670167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:58.670172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:58.670179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:58.670185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:58.670191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:58.670196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:58.670202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:58.670209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:58.670215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:58.670221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:58.670227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:58.670234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:58.670240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:58.670246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:58.670262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:58.670269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:58.670275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:58.670330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:58.680605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:58.682548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895868608140828:7977]
2025-09-30T14:54:58.683392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1707, pipe: [1:7555895868608140828:7977]
2025-09-30T14:54:58.683446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1707
2025-09-30T14:54:58.683472Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1707
2025-09-30T14:54:58.682698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:58.682731Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:58.682734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:58.682740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:58.682751Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1707 [2:7555895868518374416:9915]
2025-09-30T14:54:58.682776Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:58.682798Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:58.682803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:58.682807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:58.682810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:58.682836Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:58.682848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:58.682858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:58.682968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:58.682972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:58.682975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:58.682983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:58.682986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:58.683814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:58.683822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:58.683843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:58.683857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:58.683878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:58.683915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895868608140828:7977], now have 1 active actors on pipe
2025-09-30T14:54:58.683922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895868608140507:7927], now have 1 active actors on pipe
2025-09-30T14:54:58.683926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895868608140455:2454], now have 1 active actors on pipe
2025-09-30T14:54:58.683951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:58.683959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:58.683990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895868518374410:9915]
2025-09-30T14:54:58.683993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895868518374410:9915]
2025-09-30T14:54:58.683996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895868518374410:9915]
2025-09-30T14:54:58.684019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:58.684038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:58.684042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:58.684043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:58.684046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:58.684061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:58.684066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:58.684090Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d58062c-44931232-ab0c0a59-ed9666ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:58.684101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:58.684107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:58.684110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:58.684126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:58.684142Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:58.684219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895868518374410:9915]
2025-09-30T14:54:58.684234Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:58.684258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:58.684323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:58.684941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:58.684947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:58.684973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:58.690976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1708 partition: 0 MaxSeqNo: 42 sessionId: src_id|5d58062c-44931232-ab0c0a59-ed9666ab_0
2025-09-30T14:54:58.691435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f6ea1c4-83cbaa45-371ae888-5dd8f884_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5d58062c-44931232-ab0c0a59-ed9666ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:58.694435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d58062c-44931232-ab0c0a59-ed9666ab_0] Write session: try to update token
2025-09-30T14:54:58.694459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d58062c-44931232-ab0c0a59-ed9666ab_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:58.703172Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:58.703195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:58.703206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895868518374410:9915]
2025-09-30T14:54:58.703268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:58.703456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:58.703616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:58.703767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:58.703954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:58.704164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:58.704206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:58.705146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:58.715617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1708 sessionId: src_id|5d58062c-44931232-ab0c0a59-ed9666ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:58.718669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:58.719383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:58.719411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:58.719464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:58.719940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:58.721500Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:58.721523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:58.721526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:58.721528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:58.721538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895868518374410:9915]
2025-09-30T14:54:58.721543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895868518374410:9915]
2025-09-30T14:54:58.721547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895868518374410:9915]
2025-09-30T14:54:58.721592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:58.721604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:58.721610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:58.721610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:58.721638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:58.721650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:58.721780Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:58.840940Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:58.849911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:58.849945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:58.850143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:58.850219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:58.850293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:58.850367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:58.850423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:58.850436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:58.850516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:58.850584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:58.850657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:58.850745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:58.850799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:58.850810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:58.850890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:58.850964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:58.851034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:58.851116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:58.851167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:58.851175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:58.851288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:58.851366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:58.851437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:58.851507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:58.851558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:58.851567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:58.851644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:58.851709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:58.851774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:58.851843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:58.851890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:58.851897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:58.854428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895868608140828:7977]
2025-09-30T14:54:58.854466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:58.854469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:58.854498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1708 reason: error at write: Disconnected sessionId: src_id|5d58062c-44931232-ab0c0a59-ed9666ab_0
2025-09-30T14:54:58.854726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1708 sessionId: src_id|5d58062c-44931232-ab0c0a59-ed9666ab_0 is DEAD
2025-09-30T14:54:58.851977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:58.852044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:58.852103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:58.852164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:58.852321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:58.852324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:58.852397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:58.852840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:58.852940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:58.853009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:58.853061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:58.853065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:58.853137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:58.853201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:58.853266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:58.853331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:58.853380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:58.853383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:58.853457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:58.853520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:58.853588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:58.853654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:58.853719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:58.854883Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:58.853722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:58.853795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:58.853862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:58.853928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:58.853992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:58.854037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:58.854040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:58.855120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d58062c-44931232-ab0c0a59-ed9666ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:58.855132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d58062c-44931232-ab0c0a59-ed9666ab_0] Write session will restart in 0.006656s
2025-09-30T14:54:58.855159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d58062c-44931232-ab0c0a59-ed9666ab_0] Write session: Do CDS request
2025-09-30T14:54:58.855165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d58062c-44931232-ab0c0a59-ed9666ab_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:58.855182Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:58.862878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d58062c-44931232-ab0c0a59-ed9666ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:58.862984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:58.863005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1709
2025-09-30T14:54:58.863141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1709 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:58.863184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1709 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:58.863194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1709 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:58.863199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:58.863746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1709 sessionId:  describe result for acl check
2025-09-30T14:54:58.863786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:58.863788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:58.863790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:58.863796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895868608140844:7923] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:58.864384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895868608140844:7923] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:58.867203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895868608140844:7923] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:58.870446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895868608140844:7923] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:58.870462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895868608140844:7923] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:58.870465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895868608140844:7923] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:58.870484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1709 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:58.888842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:58.892124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:58.892370Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:58.892385Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:58.892398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:58.892466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:58.892518Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895868518374712:9918]
2025-09-30T14:54:58.893185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:58.893545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:58.893604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:58.893976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:58.894067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:58.894074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:58.894076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:58.894077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:58.894078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:58.894079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:58.894080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:58.894081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:58.894083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:58.894084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:58.894085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:58.894087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:58.894088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:58.894090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:58.894091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:58.894097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:58.894107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:58.894111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:58.894115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:58.894118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:58.894122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:58.894126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:58.894130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:58.894134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:58.894138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:58.894142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:58.894146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:58.894149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:58.894152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:58.894156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:58.894164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:58.894172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:58.894178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:58.894184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:58.894188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:58.894193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:58.894197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:58.894202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:58.894206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:58.894211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:58.894216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:58.894221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:58.894226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:58.894231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:58.894235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:58.894247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:58.894258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:58.894267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:58.894276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:58.894282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:58.894286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:58.894292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:58.894297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:58.894302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:58.894306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:58.894311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:58.894322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:58.894328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:58.894337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:58.894343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:58.894389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:58.900382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:58.901633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:58.901651Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:58.901654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:58.901659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:58.901666Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1708 [2:7555895868518374712:9918]
2025-09-30T14:54:58.901684Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:58.901713Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:58.901717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:58.901720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:58.901724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:58.901741Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:58.901749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:58.901758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:58.901830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:58.901842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:58.901844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:58.901848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:58.901852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:58.901927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:58.901935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:58.901950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:58.901969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:58.901987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:58.902015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895868608140837:2454], now have 1 active actors on pipe
2025-09-30T14:54:58.902018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895868608140905:7923], now have 1 active actors on pipe
2025-09-30T14:54:58.902026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895868518374707:9918]
2025-09-30T14:54:58.902028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895868518374707:9918]
2025-09-30T14:54:58.902031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895868518374707:9918]
2025-09-30T14:54:58.902044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:58.902059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:58.902060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:58.902063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:58.902065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:58.902073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:58.902077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:58.902070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1708
2025-09-30T14:54:58.902112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895868518374707:9918]
2025-09-30T14:54:58.902129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:58.902147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:58.902152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:58.902161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:58.902198Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6c6cee6-67ad16cb-43ba474-83eec069_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:58.902212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:58.902216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:58.902218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:58.902229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:58.902239Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:58.902256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:58.902447Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1708
2025-09-30T14:54:58.902505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:58.902531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:58.902564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:58.902673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1709 partition: 0 MaxSeqNo: 42 sessionId: src_id|a6c6cee6-67ad16cb-43ba474-83eec069_0
2025-09-30T14:54:58.903045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d58062c-44931232-ab0c0a59-ed9666ab_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a6c6cee6-67ad16cb-43ba474-83eec069_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:58.905948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6c6cee6-67ad16cb-43ba474-83eec069_0] Write session: try to update token
2025-09-30T14:54:58.905971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6c6cee6-67ad16cb-43ba474-83eec069_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:58.915603Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:58.915627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:58.915630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:58.915632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:58.915644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895868518374707:9918]
2025-09-30T14:54:58.915648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895868518374707:9918]
2025-09-30T14:54:58.915654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895868518374707:9918]
2025-09-30T14:54:58.915687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:58.915694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:58.915694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:58.915698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:58.915701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:58.915703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:58.915854Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:58.943724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1709 sessionId: src_id|a6c6cee6-67ad16cb-43ba474-83eec069_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:58.947031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:58.954470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895868608141214:7977]
2025-09-30T14:54:58.954843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1708, pipe: [1:7555895868608141214:7977]
2025-09-30T14:54:59.033211Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:59.034009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:59.034033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:59.034054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895868608141214:7977], now have 1 active actors on pipe
2025-09-30T14:54:59.034297Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:59.034327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895868608141214:7977]
2025-09-30T14:54:59.034342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:59.034347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:59.034362Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:59.034424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1709 reason: error at write: Disconnected sessionId: src_id|a6c6cee6-67ad16cb-43ba474-83eec069_0
2025-09-30T14:54:59.034621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1709 sessionId: src_id|a6c6cee6-67ad16cb-43ba474-83eec069_0 is DEAD
2025-09-30T14:54:59.039440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6c6cee6-67ad16cb-43ba474-83eec069_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:59.039458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6c6cee6-67ad16cb-43ba474-83eec069_0] Write session will restart in 0.007699s
2025-09-30T14:54:59.039496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6c6cee6-67ad16cb-43ba474-83eec069_0] Write session: Do CDS request
2025-09-30T14:54:59.039508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6c6cee6-67ad16cb-43ba474-83eec069_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:59.048812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6c6cee6-67ad16cb-43ba474-83eec069_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:59.048891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:59.048911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1710
2025-09-30T14:54:59.051570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1710 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:59.051635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1710 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:59.051645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1710 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:59.051650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:59.052225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1710 sessionId:  describe result for acl check
2025-09-30T14:54:59.052267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:59.052270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:59.052272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:59.052279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895872903108709:7910] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:59.052930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895872903108709:7910] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:59.063043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:59.060968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895872903108709:7910] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:59.067199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895872903108709:7910] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:59.067221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895872903108709:7910] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:59.067225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895872903108709:7910] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:59.067235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1710 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:59.067907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:59.068149Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:59.068161Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:59.068173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:59.068239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:59.068291Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895872813342302:9920]
2025-09-30T14:54:59.069049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:59.069454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:59.069504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:59.069843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:59.069908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:59.069915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:59.069917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:59.069919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:59.069920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:59.069921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:59.069923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:59.069924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:59.069925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:59.069927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:59.069928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.069930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:59.069931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:59.069933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:59.069934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:59.069940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:59.069951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:59.069955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:59.069959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:59.069963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:59.069968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:59.069972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:59.069976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:59.069980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:59.069984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:59.069988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.069991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:59.069994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:59.069998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:59.070002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:59.070012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:59.070020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:59.070027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:59.070033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:59.070039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:59.070046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:59.070051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:59.070057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:59.070068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:59.070075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:59.070083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:59.070093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:59.070099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:59.070109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:59.070114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:59.070124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:59.070129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:59.070140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:59.070145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:59.070155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:59.070160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.070172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.070177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:59.070186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:59.070192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:59.070197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:59.070202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:59.070208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:59.070220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:59.070227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:59.070273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:59.076994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:59.078082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:59.078098Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:59.078101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:59.078105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:59.078113Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1709 [2:7555895872813342302:9920]
2025-09-30T14:54:59.078131Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:59.078148Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:59.078157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:59.078161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:59.078163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:59.078179Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:59.078192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:59.078199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:59.078275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.078284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:59.078286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:59.078290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:59.078292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:59.078368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:59.078376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.078389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:59.078400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:59.078417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:59.078441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895872813342296:9920]
2025-09-30T14:54:59.078448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895872813342296:9920]
2025-09-30T14:54:59.078451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895872813342296:9920]
2025-09-30T14:54:59.078460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:59.078473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:59.078479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:59.078482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:59.078484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:59.078495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:59.078497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:59.078508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895872903108880:7910], now have 1 active actors on pipe
2025-09-30T14:54:59.078512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895872903108513:2454], now have 1 active actors on pipe
2025-09-30T14:54:59.078546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895872813342296:9920]
2025-09-30T14:54:59.078560Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:59.078569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:59.078834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:59.078853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:59.078899Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62cebaf3-890a9788-6869f545-52edd724_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:59.078915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:59.078920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:59.078922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:59.078939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:59.078954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:59.078973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:59.079189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:59.079200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:59.079220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:59.079774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6c6cee6-67ad16cb-43ba474-83eec069_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|62cebaf3-890a9788-6869f545-52edd724_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:59.078591Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1709
2025-09-30T14:54:59.078592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1709
2025-09-30T14:54:59.079357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1710 partition: 0 MaxSeqNo: 42 sessionId: src_id|62cebaf3-890a9788-6869f545-52edd724_0
2025-09-30T14:54:59.082933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62cebaf3-890a9788-6869f545-52edd724_0] Write session: try to update token
2025-09-30T14:54:59.082956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62cebaf3-890a9788-6869f545-52edd724_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:59.095075Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:59.095103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:59.095106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:59.095109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:59.095119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895872813342296:9920]
2025-09-30T14:54:59.095123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895872813342296:9920]
2025-09-30T14:54:59.095126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895872813342296:9920]
2025-09-30T14:54:59.095175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:59.095180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.095183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:59.095183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:59.095190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:59.095195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:59.095372Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:59.105332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1710 sessionId: src_id|62cebaf3-890a9788-6869f545-52edd724_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:59.108480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:59.133642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895872903108896:7977]
2025-09-30T14:54:59.133945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1709, pipe: [1:7555895872903108896:7977]
2025-09-30T14:54:59.212822Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:59.213189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:59.213225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:59.213249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895872903108896:7977], now have 1 active actors on pipe
2025-09-30T14:54:59.213555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895872903108896:7977]
2025-09-30T14:54:59.213593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:59.213670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1710 reason: status is not ok: tablet will be restarted right now sessionId: src_id|62cebaf3-890a9788-6869f545-52edd724_0
2025-09-30T14:54:59.213865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1710 sessionId: src_id|62cebaf3-890a9788-6869f545-52edd724_0 is DEAD
2025-09-30T14:54:59.213978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:59.213533Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:59.214676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62cebaf3-890a9788-6869f545-52edd724_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:59.214690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62cebaf3-890a9788-6869f545-52edd724_0] Write session will restart in 0.009153s
2025-09-30T14:54:59.214722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62cebaf3-890a9788-6869f545-52edd724_0] Write session: Do CDS request
2025-09-30T14:54:59.214729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62cebaf3-890a9788-6869f545-52edd724_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:59.224806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62cebaf3-890a9788-6869f545-52edd724_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:59.227582Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:59.227603Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1711
2025-09-30T14:54:59.227788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1711 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:59.227828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1711 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:59.227842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1711 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:59.227847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:59.228375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1711 sessionId:  describe result for acl check
2025-09-30T14:54:59.228412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:59.228415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:59.228417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:59.228427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895872903108941:7908] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:59.229011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895872903108941:7908] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:59.231834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895872903108941:7908] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:59.235363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895872903108941:7908] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:59.235380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895872903108941:7908] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:59.235383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895872903108941:7908] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:59.235392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1711 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:59.241911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:59.244739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:59.244983Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:59.244994Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:59.245004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:59.245061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:59.245099Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895872813342597:9922]
2025-09-30T14:54:59.245766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:59.246066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:59.246107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:59.246421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:59.246485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:59.246492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:59.246493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:59.246495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:59.246496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:59.246497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:59.246498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:59.246499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:59.246500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:59.246501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:59.246502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.246503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:59.246504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:59.246505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:59.246507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:59.246512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:59.246522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:59.246525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:59.246529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:59.246532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:59.246535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:59.246539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:59.246543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:59.246546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:59.246553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:59.246556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.246560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:59.246563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:59.246567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:59.246570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:59.246580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:59.246588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:59.246594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:59.246599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:59.246604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:59.246609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:59.246613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:59.246618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:59.246623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:59.246628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:59.246632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:59.246637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:59.246642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:59.246646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:59.246656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:59.246661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:59.246666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:59.246671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:59.246680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:59.246685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:59.246695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.246700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.246704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:59.246715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:59.246720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:59.246730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:59.246734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:59.246739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:59.246749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:59.246754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:59.246797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:59.252533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:59.253633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:59.253653Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:59.253656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:59.253660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:59.253668Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1710 [2:7555895872813342597:9922]
2025-09-30T14:54:59.253684Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:59.253712Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:59.253716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:59.253719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:59.253722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:59.253740Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:59.253747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:59.253755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:59.253821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.253830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:59.253832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:59.253836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:59.253838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:59.253911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:59.253921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.253933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:59.253944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:59.253963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:59.253984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895872903109130:7908], now have 1 active actors on pipe
2025-09-30T14:54:59.253992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895872903108901:2454], now have 1 active actors on pipe
2025-09-30T14:54:59.254000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895872813342592:9922]
2025-09-30T14:54:59.254003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895872813342592:9922]
2025-09-30T14:54:59.254005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895872813342592:9922]
2025-09-30T14:54:59.254019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:59.254033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:59.254037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:59.254038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:59.254039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:59.254051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:59.254060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:59.254094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895872813342592:9922]
2025-09-30T14:54:59.254106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:59.254112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:59.254353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1710
2025-09-30T14:54:59.254394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1710
2025-09-30T14:54:59.254430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:59.254441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:59.254474Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|844373cb-4edd5b93-f5036d9e-60f1f37e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:59.254485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:59.254489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:59.254492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:59.254503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:59.254515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:59.254531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:59.254679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:59.254688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:59.254703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:59.254895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1711 partition: 0 MaxSeqNo: 42 sessionId: src_id|844373cb-4edd5b93-f5036d9e-60f1f37e_0
2025-09-30T14:54:59.255351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62cebaf3-890a9788-6869f545-52edd724_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|844373cb-4edd5b93-f5036d9e-60f1f37e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:59.258405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|844373cb-4edd5b93-f5036d9e-60f1f37e_0] Write session: try to update token
2025-09-30T14:54:59.258423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|844373cb-4edd5b93-f5036d9e-60f1f37e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:59.267445Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:59.267470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:59.267482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895872813342592:9922]
2025-09-30T14:54:59.267532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:59.267728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:59.267888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:59.268045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:59.268188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:59.268238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:59.268455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:59.268494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:59.274561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1711 sessionId: src_id|844373cb-4edd5b93-f5036d9e-60f1f37e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:59.277644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:59.277914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:59.277947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:59.277984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:54:59.278077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:59.279415Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:59.279435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:59.279438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:59.279440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:59.279451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895872813342592:9922]
2025-09-30T14:54:59.279455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895872813342592:9922]
2025-09-30T14:54:59.279458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895872813342592:9922]
2025-09-30T14:54:59.279498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:59.279506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.279508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:59.279529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:59.279541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:59.279545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:59.279658Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:59.313879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895872903109281:7977]
2025-09-30T14:54:59.314228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1710, pipe: [1:7555895872903109281:7977]
2025-09-30T14:54:59.395916Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:59.405514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:59.405549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:59.405758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:59.405832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:59.405914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:59.405991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:59.406044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:59.406053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:59.406132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:59.406201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:59.406277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:59.406359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:59.406410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:59.406418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:59.406498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:59.406571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:59.406644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:59.406719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:59.406769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:59.406776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:59.406855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:59.406941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:59.407019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:59.407097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:59.407152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:59.407156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:59.407235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:59.407359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:59.407439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:59.407513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:59.407566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:59.407575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:59.407649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:59.407723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:59.407801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:59.407870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:59.407918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:59.407923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:59.407999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:59.408065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:59.408136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:59.408206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:59.408251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:59.408255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:59.408332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:59.408397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:59.408467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:59.408533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:59.408580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:59.408583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:59.408663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:59.408729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:59.408802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:59.408871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:59.408919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:59.408921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:59.408999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:54:59.409064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:54:59.409130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:54:59.409200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:54:59.409247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:54:59.409251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:54:59.409326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895872903109281:7977], now have 1 active actors on pipe
2025-09-30T14:54:59.411363Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:59.411386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:59.411401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:59.411433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1711 reason: error at write: Disconnected sessionId: src_id|844373cb-4edd5b93-f5036d9e-60f1f37e_0
2025-09-30T14:54:59.411624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1711 sessionId: src_id|844373cb-4edd5b93-f5036d9e-60f1f37e_0 is DEAD
2025-09-30T14:54:59.411712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:59.411766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895872903109281:7977]
2025-09-30T14:54:59.414904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|844373cb-4edd5b93-f5036d9e-60f1f37e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:59.414914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|844373cb-4edd5b93-f5036d9e-60f1f37e_0] Write session will restart in 0.009264s
2025-09-30T14:54:59.414934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|844373cb-4edd5b93-f5036d9e-60f1f37e_0] Write session: Do CDS request
2025-09-30T14:54:59.414938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|844373cb-4edd5b93-f5036d9e-60f1f37e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:59.425925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|844373cb-4edd5b93-f5036d9e-60f1f37e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:59.427705Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:59.427730Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1712
2025-09-30T14:54:59.427922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1712 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:59.427966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1712 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:59.427980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1712 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:59.427986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:59.431779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1712 sessionId:  describe result for acl check
2025-09-30T14:54:59.431839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:59.431842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:59.431844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:59.431854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895872903109369:7904] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:59.432532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895872903109369:7904] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:59.447618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895872903109369:7904] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:59.458585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895872903109369:7904] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:59.458607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895872903109369:7904] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:59.458612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895872903109369:7904] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:59.458623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1712 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:59.474911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:59.479553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:59.479841Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:59.479853Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:59.479864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:59.479926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:59.479969Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895872813342896:9925]
2025-09-30T14:54:59.480648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:59.480993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:59.481035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:59.481358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:59.481414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:59.481420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:59.481421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:59.481422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:59.481424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:59.481426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:59.481427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:59.481428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:59.481429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:59.481430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:59.481431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.481432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:59.481433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:59.481435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:59.481435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:59.481440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:59.481450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:59.481454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:59.481458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:59.481461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:59.481464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:59.481468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:59.481471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:59.481474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:59.481480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:59.481484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.481487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:59.481490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:59.481493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:59.481496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:59.481505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:59.481512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:59.481518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:59.481523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:59.481527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:59.481532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:59.481535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:59.481539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:59.481543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:59.481548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:59.481552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:59.481556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:59.481560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:59.481571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:59.481576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:59.481580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:59.481585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:59.481589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:59.481593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:59.481598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:59.481603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.481608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.481612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:59.481617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:59.481623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:59.481627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:59.481631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:59.481636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:59.481640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:59.481644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:59.481685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:59.492154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:59.493268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:59.493293Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:59.493298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:59.493304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:59.493313Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1711 [2:7555895872813342896:9925]
2025-09-30T14:54:59.493335Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:59.493356Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:59.493361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:59.493374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:59.493377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:59.493398Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:59.493415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:59.493425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:59.493516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.493530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:59.493533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:59.493537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:59.493541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:59.493648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:59.493659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.493676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:59.493690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:59.493734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:59.493766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895872813342891:9925]
2025-09-30T14:54:59.493778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895872813342891:9925]
2025-09-30T14:54:59.493781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895872813342891:9925]
2025-09-30T14:54:59.493799Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:59.493826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:59.493850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:59.493860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:59.493910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895872813342891:9925]
2025-09-30T14:54:59.493920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:59.498713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:59.498738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:59.498741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:59.498751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:59.499017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1711
2025-09-30T14:54:59.499063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1711
2025-09-30T14:54:59.499182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895872903109596:7904], now have 1 active actors on pipe
2025-09-30T14:54:59.499200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895872903109284:2454], now have 1 active actors on pipe
2025-09-30T14:54:59.499259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:59.499268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:59.499309Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d32290-6fc18596-f86f25df-94054227_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:59.499323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:59.499329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:59.499333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:59.499350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:59.499369Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:59.499392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:59.500183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:59.500198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:59.500220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:59.500378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1712 partition: 0 MaxSeqNo: 42 sessionId: src_id|1d32290-6fc18596-f86f25df-94054227_0
2025-09-30T14:54:59.501040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|844373cb-4edd5b93-f5036d9e-60f1f37e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1d32290-6fc18596-f86f25df-94054227_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:59.504013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d32290-6fc18596-f86f25df-94054227_0] Write session: try to update token
2025-09-30T14:54:59.504034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d32290-6fc18596-f86f25df-94054227_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:59.515312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895872903109676:7977]
2025-09-30T14:54:59.516058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1711, pipe: [1:7555895872903109676:7977]
2025-09-30T14:54:59.514373Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:59.514402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:59.514406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:59.514408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:59.514420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895872813342891:9925]
2025-09-30T14:54:59.514426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895872813342891:9925]
2025-09-30T14:54:59.514430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895872813342891:9925]
2025-09-30T14:54:59.514479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:59.514488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.514491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:59.514667Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:59.515850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:59.515857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:59.515862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:59.548112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1712 sessionId: src_id|1d32290-6fc18596-f86f25df-94054227_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:59.551514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:59.660688Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:59.661236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895872903109676:7977], now have 1 active actors on pipe
2025-09-30T14:54:59.661301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:59.661308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:59.661601Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:59.662249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d32290-6fc18596-f86f25df-94054227_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:54:59.662262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d32290-6fc18596-f86f25df-94054227_0] Write session will restart in 0.007630s
2025-09-30T14:54:59.662296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d32290-6fc18596-f86f25df-94054227_0] Write session: Do CDS request
2025-09-30T14:54:59.662304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d32290-6fc18596-f86f25df-94054227_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:59.661584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:54:59.661601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:54:59.661613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895872903109676:7977]
2025-09-30T14:54:59.661634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:59.661670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1712 reason: error at write: Disconnected sessionId: src_id|1d32290-6fc18596-f86f25df-94054227_0
2025-09-30T14:54:59.661865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1712 sessionId: src_id|1d32290-6fc18596-f86f25df-94054227_0 is DEAD
2025-09-30T14:54:59.670930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d32290-6fc18596-f86f25df-94054227_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:59.671362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:59.671382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1713
2025-09-30T14:54:59.671712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1713 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:59.671750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1713 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:59.671756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1713 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:59.671761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:59.672330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1713 sessionId:  describe result for acl check
2025-09-30T14:54:59.672365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:59.672370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:59.672372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:59.672380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895872903109719:7883] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:59.673040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895872903109719:7883] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:59.678916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895872903109719:7883] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:59.686605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895872903109719:7883] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:59.686631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895872903109719:7883] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:59.686635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895872903109719:7883] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:59.686647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1713 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:59.699298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:59.702606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:59.702857Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:59.702869Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:59.702882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:59.702944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:59.702987Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895872813343240:9940]
2025-09-30T14:54:59.703575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:59.703943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:59.703995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:59.704330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:59.704401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:59.704412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:59.704413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:59.704414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:59.704416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:59.704417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:59.704418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:59.704420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:59.704421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:59.704422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:59.704424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.704425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:59.704426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:59.704428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:59.704429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:59.704435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:59.704446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:59.704450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:59.704455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:59.704459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:59.704463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:59.704468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:59.704473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:59.704477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:59.704482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:59.704486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.704489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:59.704492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:59.704496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:59.704500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:59.704508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:59.704516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:59.704523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:59.704529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:59.704534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:59.704540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:59.704545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:59.704550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:59.704556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:59.704561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:59.704566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:59.704572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:59.704577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:59.704582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:59.704588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:59.704594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:59.704599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:59.704604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:59.704610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:59.704615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:59.704620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.704625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.704630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:59.704635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:59.704641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:59.704646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:59.704658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:59.704663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:59.704673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:59.704678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:59.704737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:59.710480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:59.711430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:59.711448Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:59.711452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:59.711456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:59.711463Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1712 [2:7555895872813343240:9940]
2025-09-30T14:54:59.711480Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:59.711497Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:59.711500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:59.711503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:59.711506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:59.711522Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:59.711537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:59.711544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:59.711612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.711619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:59.711621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:59.711625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:59.711627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:59.711698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:59.711706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.711720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:59.711730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:59.711746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:59.711764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895872813343235:9940]
2025-09-30T14:54:59.711766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895872813343235:9940]
2025-09-30T14:54:59.711768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895872813343235:9940]
2025-09-30T14:54:59.711782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:59.711796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:59.711819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:59.711823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:59.711858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895872813343235:9940]
2025-09-30T14:54:59.711868Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:59.712022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:59.712032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:59.712034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:59.712039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:59.712047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895872903109704:2454], now have 1 active actors on pipe
2025-09-30T14:54:59.712055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895872903109863:7883], now have 1 active actors on pipe
2025-09-30T14:54:59.712172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1712
2025-09-30T14:54:59.712219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1712
2025-09-30T14:54:59.712437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:59.712452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:59.712489Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38da1f72-9aa47681-d3e9110e-195e897d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:59.712499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:59.712504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:59.712507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:59.712518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:59.712531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:59.712549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:59.712776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:59.712782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:59.712803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:59.714381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1713 partition: 0 MaxSeqNo: 42 sessionId: src_id|38da1f72-9aa47681-d3e9110e-195e897d_0
2025-09-30T14:54:59.714828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d32290-6fc18596-f86f25df-94054227_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|38da1f72-9aa47681-d3e9110e-195e897d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:59.720299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38da1f72-9aa47681-d3e9110e-195e897d_0] Write session: try to update token
2025-09-30T14:54:59.720335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38da1f72-9aa47681-d3e9110e-195e897d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:59.725371Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:59.725396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:59.725399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:59.725401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:59.725411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895872813343235:9940]
2025-09-30T14:54:59.725416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895872813343235:9940]
2025-09-30T14:54:59.725421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895872813343235:9940]
2025-09-30T14:54:59.725465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:59.725473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.725474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:59.725477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:59.725480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:59.725488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:59.725631Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:59.750284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1713 sessionId: src_id|38da1f72-9aa47681-d3e9110e-195e897d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:59.753299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:59.761359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895872903110084:7977]
2025-09-30T14:54:59.763419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1712, pipe: [1:7555895872903110084:7977]
2025-09-30T14:54:59.842830Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:54:59.843887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:59.843907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:59.843927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895872903110084:7977], now have 1 active actors on pipe
2025-09-30T14:54:59.844189Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:54:59.845355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38da1f72-9aa47681-d3e9110e-195e897d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:54:59.845378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38da1f72-9aa47681-d3e9110e-195e897d_0] Write session will restart in 0.008349s
2025-09-30T14:54:59.845411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38da1f72-9aa47681-d3e9110e-195e897d_0] Write session: Do CDS request
2025-09-30T14:54:59.845418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38da1f72-9aa47681-d3e9110e-195e897d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:54:59.844761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:54:59.844819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895872903110084:7977]
2025-09-30T14:54:59.844841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:54:59.844905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1713 reason: status is not ok: tablet will be restarted right now sessionId: src_id|38da1f72-9aa47681-d3e9110e-195e897d_0
2025-09-30T14:54:59.845092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1713 sessionId: src_id|38da1f72-9aa47681-d3e9110e-195e897d_0 is DEAD
2025-09-30T14:54:59.854980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38da1f72-9aa47681-d3e9110e-195e897d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:59.859495Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:54:59.859520Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1714
2025-09-30T14:54:59.863566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1714 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:54:59.863653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1714 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:54:59.863670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1714 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:54:59.863679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:54:59.865067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1714 sessionId:  describe result for acl check
2025-09-30T14:54:59.865107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:54:59.865110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:54:59.865112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:54:59.865118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895872903110301:7878] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:54:59.865687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895872903110301:7878] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:54:59.869229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895872903110301:7878] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:54:59.872315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895872903110301:7878] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:54:59.872339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895872903110301:7878] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:54:59.872343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895872903110301:7878] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:54:59.872352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1714 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:54:59.879650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:54:59.883153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:54:59.883399Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:54:59.883410Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:54:59.883422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:54:59.883477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:54:59.883522Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895872813343539:9943]
2025-09-30T14:54:59.884172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:54:59.884525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:54:59.884578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:54:59.884907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:54:59.884990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:59.884997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:59.884998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:59.884999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:59.885000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:59.885002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:59.885003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:59.885004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:59.885006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:59.885007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:59.885008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.885009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:59.885010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:59.885012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:59.885013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:59.885019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:59.885030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:59.885034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:59.885038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:59.885042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:59.885046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:59.885050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:59.885055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:59.885059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:59.885063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:59.885068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.885072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:59.885076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:59.885079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:59.885084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:59.885092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:59.885100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:54:59.885107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:59.885113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:54:59.885118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:59.885123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:54:59.885127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:59.885133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:54:59.885138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:59.885150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:54:59.885155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:59.885165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:54:59.885171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:59.885181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:54:59.885186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:59.885196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:54:59.885202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:59.885212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:54:59.885217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:59.885223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:54:59.885233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.885239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.885249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:59.885254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:59.885264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:59.885271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:59.885279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:59.885285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:54:59.885295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:59.885301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:54:59.885349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:54:59.891261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:54:59.892680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:54:59.892700Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:54:59.892703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:54:59.892707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:54:59.892714Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1713 [2:7555895872813343539:9943]
2025-09-30T14:54:59.892731Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:54:59.892747Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:54:59.892751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:59.892754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:59.892757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:59.892773Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:54:59.892785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:54:59.892796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:54:59.892860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.892867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:59.892869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:59.892873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:54:59.892876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:54:59.892940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:54:59.892950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.892964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:54:59.892978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:54:59.892995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:54:59.893021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895872903110085:2454], now have 1 active actors on pipe
2025-09-30T14:54:59.893029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895872813343533:9943]
2025-09-30T14:54:59.893031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895872813343533:9943]
2025-09-30T14:54:59.893034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895872813343533:9943]
2025-09-30T14:54:59.893046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:54:59.893060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895872903110452:7878], now have 1 active actors on pipe
2025-09-30T14:54:59.893060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:54:59.893064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:54:59.893066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:54:59.893068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:54:59.893081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:54:59.893084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:54:59.893123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895872813343533:9943]
2025-09-30T14:54:59.893138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:54:59.893160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:54:59.893167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1713
2025-09-30T14:54:59.893229Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1713
2025-09-30T14:54:59.893225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:59.893237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:59.893259Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c08809fe-50ca356d-7ab2374d-a0ea971_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:54:59.893265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:54:59.893269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:54:59.893271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:54:59.893285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:54:59.893294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:54:59.893310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:59.893497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:54:59.893512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:54:59.893547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:54:59.894088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38da1f72-9aa47681-d3e9110e-195e897d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c08809fe-50ca356d-7ab2374d-a0ea971_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:54:59.897579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c08809fe-50ca356d-7ab2374d-a0ea971_0] Write session: try to update token
2025-09-30T14:54:59.897602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c08809fe-50ca356d-7ab2374d-a0ea971_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:54:59.893638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1714 partition: 0 MaxSeqNo: 42 sessionId: src_id|c08809fe-50ca356d-7ab2374d-a0ea971_0
2025-09-30T14:54:59.905554Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:54:59.905577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:59.905586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895872813343533:9943]
2025-09-30T14:54:59.905630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:54:59.905633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:54:59.905827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:54:59.905977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:59.906122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:59.906283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:54:59.906490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:54:59.906543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:54:59.916945Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:54:59.916969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:54:59.916972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:54:59.916974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:54:59.916985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895872813343533:9943]
2025-09-30T14:54:59.916989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895872813343533:9943]
2025-09-30T14:54:59.916995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895872813343533:9943]
2025-09-30T14:54:59.917038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:54:59.917046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:54:59.917045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:54:59.917049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:54:59.917052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:54:59.917058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:54:59.917200Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:54:59.919102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1714 sessionId: src_id|c08809fe-50ca356d-7ab2374d-a0ea971_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:54:59.921906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:54:59.945160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895872903110467:7977]
2025-09-30T14:54:59.945516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1713, pipe: [1:7555895872903110467:7977]
2025-09-30T14:55:00.039299Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:00.040149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:00.040171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:00.040192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895872903110467:7977], now have 1 active actors on pipe
2025-09-30T14:55:00.040636Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:00.040611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895872903110467:7977]
2025-09-30T14:55:00.040644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:00.040649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:00.040653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:00.040711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1714 reason: error at write: Disconnected sessionId: src_id|c08809fe-50ca356d-7ab2374d-a0ea971_0
2025-09-30T14:55:00.040910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1714 sessionId: src_id|c08809fe-50ca356d-7ab2374d-a0ea971_0 is DEAD
2025-09-30T14:55:00.047400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c08809fe-50ca356d-7ab2374d-a0ea971_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:00.047416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c08809fe-50ca356d-7ab2374d-a0ea971_0] Write session will restart in 0.008635s
2025-09-30T14:55:00.047451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c08809fe-50ca356d-7ab2374d-a0ea971_0] Write session: Do CDS request
2025-09-30T14:55:00.047464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c08809fe-50ca356d-7ab2374d-a0ea971_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:00.058002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c08809fe-50ca356d-7ab2374d-a0ea971_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:00.059900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:00.059916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1715
2025-09-30T14:55:00.060153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1715 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:00.060212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1715 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:00.060219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1715 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:00.060224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:00.061110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1715 sessionId:  describe result for acl check
2025-09-30T14:55:00.061154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:00.061156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:00.061158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:00.061164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895877198077871:7871] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:00.061764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895877198077871:7871] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:00.064963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895877198077871:7871] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:00.077738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895877198077871:7871] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:00.077756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895877198077871:7871] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:00.077760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895877198077871:7871] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:00.077770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1715 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:00.092347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:00.095855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:00.096120Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:00.096124Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:00.096136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:00.096207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:00.096248Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895877108311134:9945]
2025-09-30T14:55:00.096929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:00.097647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:00.097711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:00.098097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:00.098166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:00.098168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:00.098169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:00.098170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:00.098172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:00.098173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:00.098174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:00.098176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:00.098178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:00.098180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:00.098181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.098183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:00.098184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:00.098185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:00.098186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:00.098193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:00.098204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:00.098207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:00.098211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:00.098215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:00.098218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:00.098222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:00.098225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:00.098230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:00.098234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:00.098237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.098240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:00.098244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:00.098248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:00.098251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:00.098260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:00.098269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:00.098275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:00.098280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:00.098285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:00.098290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:00.098294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:00.098299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:00.098305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:00.098310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:00.098314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:00.098319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:00.098324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:00.098329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:00.098333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:00.098338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:00.098342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:00.098346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:00.098350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:00.098358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:00.098362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.098366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.098370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:00.098375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:00.098380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:00.098385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:00.098389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:00.098395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:00.098402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:00.098407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:00.098450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:00.106880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:00.108259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:00.108284Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:00.108287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:00.108292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:00.108299Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1714 [2:7555895877108311134:9945]
2025-09-30T14:55:00.108317Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:00.108337Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:00.108341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:00.108345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:00.108347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:00.108364Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:00.108372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:00.108381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:00.108447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.108450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:00.108453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:00.108456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:00.108459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:00.108543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:00.108546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.108563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:00.108577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:00.108598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:00.108619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895877108311129:9945]
2025-09-30T14:55:00.108622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895877108311129:9945]
2025-09-30T14:55:00.108625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895877108311129:9945]
2025-09-30T14:55:00.108644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:00.108659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895877198077766:2454], now have 1 active actors on pipe
2025-09-30T14:55:00.108664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895877198078050:7871], now have 1 active actors on pipe
2025-09-30T14:55:00.108665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:00.108669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:00.108671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:00.108674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:00.108689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:00.108692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:00.108741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895877108311129:9945]
2025-09-30T14:55:00.108749Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:00.108988Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1714
2025-09-30T14:55:00.109026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1714
2025-09-30T14:55:00.109094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:00.109862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:00.109876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:00.109900Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d3a977d-8b6839b0-f824746d-38688345_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:00.109911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:00.109916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:00.109919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:00.109932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:00.109952Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:00.109978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:00.112113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c08809fe-50ca356d-7ab2374d-a0ea971_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6d3a977d-8b6839b0-f824746d-38688345_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:00.111583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1715 partition: 0 MaxSeqNo: 42 sessionId: src_id|6d3a977d-8b6839b0-f824746d-38688345_0
2025-09-30T14:55:00.111340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:00.111366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:00.111398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:00.115894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d3a977d-8b6839b0-f824746d-38688345_0] Write session: try to update token
2025-09-30T14:55:00.115925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d3a977d-8b6839b0-f824746d-38688345_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:00.125712Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:00.125742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:00.125754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895877108311129:9945]
2025-09-30T14:55:00.125807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:00.126023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:00.126186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:00.126347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:00.126509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:00.126732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:00.126777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:00.127037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:00.137415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1715 sessionId: src_id|6d3a977d-8b6839b0-f824746d-38688345_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:00.140410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:00.138713Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:00.138736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:00.138739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:00.138741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:00.138752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895877108311129:9945]
2025-09-30T14:55:00.138757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895877108311129:9945]
2025-09-30T14:55:00.138762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895877108311129:9945]
2025-09-30T14:55:00.138809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:00.138817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.138819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:00.138986Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:00.140661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:00.140669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:00.140673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:00.141074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895877198078153:7977]
2025-09-30T14:55:00.141376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1714, pipe: [1:7555895877198078153:7977]
2025-09-30T14:55:00.262106Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:00.263106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:00.263130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:00.263154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895877198078153:7977], now have 1 active actors on pipe
2025-09-30T14:55:00.263440Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:00.263439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:00.263448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:00.263458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:00.263517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895877198078153:7977]
2025-09-30T14:55:00.263526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1715 reason: error at write: Disconnected sessionId: src_id|6d3a977d-8b6839b0-f824746d-38688345_0
2025-09-30T14:55:00.263950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d3a977d-8b6839b0-f824746d-38688345_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:00.263967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d3a977d-8b6839b0-f824746d-38688345_0] Write session will restart in 0.005794s
2025-09-30T14:55:00.263718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1715 sessionId: src_id|6d3a977d-8b6839b0-f824746d-38688345_0 is DEAD
2025-09-30T14:55:00.264095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d3a977d-8b6839b0-f824746d-38688345_0] Write session: Do CDS request
2025-09-30T14:55:00.264115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d3a977d-8b6839b0-f824746d-38688345_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:00.271897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d3a977d-8b6839b0-f824746d-38688345_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:00.272377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:00.272400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1716
2025-09-30T14:55:00.272630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1716 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:00.272667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1716 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:00.272686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1716 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:00.272691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:00.273330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1716 sessionId:  describe result for acl check
2025-09-30T14:55:00.273375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:00.273383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:00.273385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:00.273392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895877198078174:7865] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:00.273996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895877198078174:7865] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:00.276376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895877198078174:7865] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:00.283437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895877198078174:7865] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:00.283458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895877198078174:7865] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:00.283462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895877198078174:7865] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:00.283472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1716 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:00.296493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:00.299757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:00.300038Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:00.300051Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:00.300064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:00.300140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:00.300184Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895877108311433:9947]
2025-09-30T14:55:00.300872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:00.301287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:00.301338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:00.301717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:00.301790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:00.301795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:00.301797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:00.301798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:00.301799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:00.301801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:00.301803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:00.301804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:00.301806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:00.301807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:00.301809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.301810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:00.301812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:00.301813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:00.301814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:00.301821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:00.301832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:00.301837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:00.301842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:00.301846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:00.301851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:00.301855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:00.301859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:00.301864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:00.301869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:00.301874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.301879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:00.301888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:00.301893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:00.301898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:00.301906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:00.301914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:00.301926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:00.301937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:00.301942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:00.301951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:00.301958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:00.301965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:00.301974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:00.301981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:00.301989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:00.302010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:00.302018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:00.302025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:00.302033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:00.302043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:00.302050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:00.302059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:00.302068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:00.302074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:00.302080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.302088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.302094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:00.302102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:00.302108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:00.302117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:00.302122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:00.302128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:00.302134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:00.302143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:00.302193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:00.308567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:00.309780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:00.309802Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:00.309805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:00.309810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:00.309819Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1715 [2:7555895877108311433:9947]
2025-09-30T14:55:00.309841Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:00.309866Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:00.309870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:00.309873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:00.309877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:00.309896Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:00.309910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:00.309919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:00.310019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.310028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:00.310032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:00.310036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:00.310038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:00.310121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:00.310133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.310151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:00.310166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:00.310186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:00.310210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895877198078310:7865], now have 1 active actors on pipe
2025-09-30T14:55:00.310215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895877198078159:2454], now have 1 active actors on pipe
2025-09-30T14:55:00.310224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895877108311428:9947]
2025-09-30T14:55:00.310227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895877108311428:9947]
2025-09-30T14:55:00.310229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895877108311428:9947]
2025-09-30T14:55:00.310245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:00.310267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:00.310267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:00.310270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:00.310272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:00.310292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:00.310297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:00.310343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895877108311428:9947]
2025-09-30T14:55:00.310357Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:00.310363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:00.310357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1715
2025-09-30T14:55:00.310410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1715
2025-09-30T14:55:00.310671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:00.310687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:00.310721Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a90ac668-f505bd0f-955da6da-917425af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:00.310737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:00.310748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:00.310751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:00.310765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:00.310783Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:00.310803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:00.311035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:00.311051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:00.311070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:00.311171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1716 partition: 0 MaxSeqNo: 42 sessionId: src_id|a90ac668-f505bd0f-955da6da-917425af_0
2025-09-30T14:55:00.311721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d3a977d-8b6839b0-f824746d-38688345_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a90ac668-f505bd0f-955da6da-917425af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:00.315760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a90ac668-f505bd0f-955da6da-917425af_0] Write session: try to update token
2025-09-30T14:55:00.315788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a90ac668-f505bd0f-955da6da-917425af_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:00.330293Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:00.330312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:00.330325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895877108311428:9947]
2025-09-30T14:55:00.330378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:00.330390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:00.330584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:00.330764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:00.330921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:00.331086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:00.331331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:00.331374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:00.339566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1716 sessionId: src_id|a90ac668-f505bd0f-955da6da-917425af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:00.343011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:00.342029Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:00.342056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:00.342058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:00.342061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:00.342073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895877108311428:9947]
2025-09-30T14:55:00.342078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895877108311428:9947]
2025-09-30T14:55:00.342082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895877108311428:9947]
2025-09-30T14:55:00.342133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:00.342142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.342139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:00.342145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:00.342147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:00.342157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:00.342317Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:00.363503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895877198078544:7977]
2025-09-30T14:55:00.363811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1715, pipe: [1:7555895877198078544:7977]
2025-09-30T14:55:00.472941Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:00.473472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:00.473492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:00.473516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895877198078544:7977], now have 1 active actors on pipe
2025-09-30T14:55:00.473811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:00.473828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:00.473906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1716 reason: error at write: Disconnected sessionId: src_id|a90ac668-f505bd0f-955da6da-917425af_0
2025-09-30T14:55:00.474119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1716 sessionId: src_id|a90ac668-f505bd0f-955da6da-917425af_0 is DEAD
2025-09-30T14:55:00.473905Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:00.474367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895877198078544:7977]
2025-09-30T14:55:00.474396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:00.474756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a90ac668-f505bd0f-955da6da-917425af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:00.474773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a90ac668-f505bd0f-955da6da-917425af_0] Write session will restart in 0.009328s
2025-09-30T14:55:00.474819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a90ac668-f505bd0f-955da6da-917425af_0] Write session: Do CDS request
2025-09-30T14:55:00.474833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a90ac668-f505bd0f-955da6da-917425af_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:00.486004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a90ac668-f505bd0f-955da6da-917425af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:00.486090Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:00.486109Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1717
2025-09-30T14:55:00.486299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1717 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:00.486339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1717 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:00.486352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1717 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:00.486357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:00.486835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1717 sessionId:  describe result for acl check
2025-09-30T14:55:00.486868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:00.486875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:00.486877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:00.486884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895877198078560:7861] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:00.487448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895877198078560:7861] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:00.490041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895877198078560:7861] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:00.492864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895877198078560:7861] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:00.492882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895877198078560:7861] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:00.492886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895877198078560:7861] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:00.492894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1717 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:00.514879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:00.518397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:00.518688Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:00.518701Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:00.518714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:00.518795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:00.519004Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895877108311735:9950]
2025-09-30T14:55:00.519618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:00.519984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:00.520038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:00.520399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:00.520474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:00.520482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:00.520483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:00.520485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:00.520486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:00.520488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:00.520489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:00.520490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:00.520492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:00.520494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:00.520495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.520496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:00.520498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:00.520499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:00.520501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:00.520507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:00.520519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:00.520524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:00.520528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:00.520533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:00.520537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:00.520541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:00.520546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:00.520550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:00.520553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:00.520558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.520562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:00.520566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:00.520570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:00.520574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:00.520582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:00.520591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:00.520597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:00.520603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:00.520611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:00.520617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:00.520622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:00.520628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:00.520633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:00.520639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:00.520644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:00.520648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:00.520655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:00.520660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:00.520665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:00.520671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:00.520676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:00.520681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:00.520687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:00.520693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:00.520699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.520705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.520710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:00.520716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:00.520722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:00.520728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:00.520734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:00.520740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:00.520745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:00.520751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:00.520800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:00.526973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:00.528507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:00.528521Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:00.528523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:00.528527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:00.528535Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1716 [2:7555895877108311735:9950]
2025-09-30T14:55:00.528552Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:00.528568Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:00.528573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:00.528575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:00.528578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:00.528606Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:00.528618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:00.528626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:00.528699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.528707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:00.528709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:00.528712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:00.528715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:00.528795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:00.528803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.528818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:00.528834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:00.528857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:00.528882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895877198078613:7861], now have 1 active actors on pipe
2025-09-30T14:55:00.528890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895877198078546:2454], now have 1 active actors on pipe
2025-09-30T14:55:00.528898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895877108311729:9950]
2025-09-30T14:55:00.528901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895877108311729:9950]
2025-09-30T14:55:00.528903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895877108311729:9950]
2025-09-30T14:55:00.528918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:00.528937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:00.528940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:00.528948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:00.528950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:00.528956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:00.528960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:00.528956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1716
2025-09-30T14:55:00.528998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895877108311729:9950]
2025-09-30T14:55:00.529006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:00.528966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1716
2025-09-30T14:55:00.529009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:00.529023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:00.529028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:00.529082Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dffbdc4f-c892295e-4b0a8906-23174fd4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:00.529094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:00.529103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:00.529106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:00.529118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:00.529132Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:00.529161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:00.529357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:00.529368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:00.529387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:00.529492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1717 partition: 0 MaxSeqNo: 42 sessionId: src_id|dffbdc4f-c892295e-4b0a8906-23174fd4_0
2025-09-30T14:55:00.529946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a90ac668-f505bd0f-955da6da-917425af_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dffbdc4f-c892295e-4b0a8906-23174fd4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:00.533294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dffbdc4f-c892295e-4b0a8906-23174fd4_0] Write session: try to update token
2025-09-30T14:55:00.533322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dffbdc4f-c892295e-4b0a8906-23174fd4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:00.543673Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:00.543694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:00.543697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:00.543700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:00.543710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895877108311729:9950]
2025-09-30T14:55:00.543715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895877108311729:9950]
2025-09-30T14:55:00.543719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895877108311729:9950]
2025-09-30T14:55:00.543762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:00.543768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:00.543771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.543774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:00.543774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:00.543778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:00.543929Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:00.555770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1717 sessionId: src_id|dffbdc4f-c892295e-4b0a8906-23174fd4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:00.559357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:00.574411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895877198078932:7977]
2025-09-30T14:55:00.574750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1716, pipe: [1:7555895877198078932:7977]
2025-09-30T14:55:00.667647Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:00.668239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:00.668256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:00.668280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895877198078932:7977], now have 1 active actors on pipe
2025-09-30T14:55:00.668530Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:00.668611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895877198078932:7977]
2025-09-30T14:55:00.668665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:00.668669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:00.669127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dffbdc4f-c892295e-4b0a8906-23174fd4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:00.669143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dffbdc4f-c892295e-4b0a8906-23174fd4_0] Write session will restart in 0.005908s
2025-09-30T14:55:00.669172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dffbdc4f-c892295e-4b0a8906-23174fd4_0] Write session: Do CDS request
2025-09-30T14:55:00.669181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dffbdc4f-c892295e-4b0a8906-23174fd4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:00.668766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1717 reason: error at write: Disconnected sessionId: src_id|dffbdc4f-c892295e-4b0a8906-23174fd4_0
2025-09-30T14:55:00.668971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1717 sessionId: src_id|dffbdc4f-c892295e-4b0a8906-23174fd4_0 is DEAD
2025-09-30T14:55:00.669170Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:00.677078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dffbdc4f-c892295e-4b0a8906-23174fd4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:00.677176Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:00.677195Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1718
2025-09-30T14:55:00.677468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1718 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:00.677525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1718 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:00.677537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1718 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:00.677542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:00.678065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1718 sessionId:  describe result for acl check
2025-09-30T14:55:00.678108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:00.678111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:00.678113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:00.678123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895877198078987:7843] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:00.678731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895877198078987:7843] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:00.681997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895877198078987:7843] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:00.685105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895877198078987:7843] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:00.685123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895877198078987:7843] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:00.685126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895877198078987:7843] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:00.685146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1718 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:00.700486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:00.703557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:00.704049Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:00.704069Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:00.704084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:00.704156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:00.704205Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895877108312085:9965]
2025-09-30T14:55:00.704938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:00.705406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:00.705451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:00.705814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:00.705892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:00.705899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:00.705900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:00.705902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:00.705903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:00.705905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:00.705906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:00.705908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:00.705909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:00.705911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:00.705912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.705914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:00.705915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:00.705917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:00.705918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:00.705924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:00.705936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:00.705941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:00.705946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:00.705951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:00.705956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:00.705960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:00.705964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:00.705968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:00.705973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:00.705977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.705981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:00.705985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:00.705990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:00.705994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:00.706002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:00.706012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:00.706019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:00.706026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:00.706034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:00.706040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:00.706045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:00.706052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:00.706059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:00.706065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:00.706069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:00.706075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:00.706080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:00.706087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:00.706092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:00.706098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:00.706109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:00.706115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:00.706121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:00.706132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:00.706137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.706143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.706148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:00.706160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:00.706168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:00.706179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:00.706184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:00.706195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:00.706200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:00.706206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:00.706259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:00.712415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:00.713947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:00.713963Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:00.713966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:00.713970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:00.713981Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1717 [2:7555895877108312085:9965]
2025-09-30T14:55:00.713999Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:00.714019Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:00.714023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:00.714028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:00.714030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:00.714049Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:00.714062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:00.714070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:00.714139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.714147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:00.714149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:00.714153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:00.714156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:00.714227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:00.714234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.714250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:00.714266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:00.714443Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1717
2025-09-30T14:55:00.714285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:00.714317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895877198079090:7843], now have 1 active actors on pipe
2025-09-30T14:55:00.714325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895877108312080:9965]
2025-09-30T14:55:00.714327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895877108312080:9965]
2025-09-30T14:55:00.714330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895877108312080:9965]
2025-09-30T14:55:00.714343Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:00.714353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895877198078972:2454], now have 1 active actors on pipe
2025-09-30T14:55:00.714361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:00.714362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:00.714366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:00.714369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:00.714375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:00.714378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:00.714421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895877108312080:9965]
2025-09-30T14:55:00.714429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:00.714437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:00.714721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1717
2025-09-30T14:55:00.714789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:00.714800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:00.714825Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bee11bd1-6d490e42-1eda8c3e-a15263d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:00.714838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:00.714842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:00.714844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:00.714857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:00.714874Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:00.714895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:00.715051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:00.715062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:00.715076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:00.715174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1718 partition: 0 MaxSeqNo: 42 sessionId: src_id|bee11bd1-6d490e42-1eda8c3e-a15263d1_0
2025-09-30T14:55:00.715676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dffbdc4f-c892295e-4b0a8906-23174fd4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bee11bd1-6d490e42-1eda8c3e-a15263d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:00.719017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bee11bd1-6d490e42-1eda8c3e-a15263d1_0] Write session: try to update token
2025-09-30T14:55:00.719041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bee11bd1-6d490e42-1eda8c3e-a15263d1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:00.728018Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:00.728038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:00.728050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895877108312080:9965]
2025-09-30T14:55:00.728105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:00.728109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:00.728323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:00.728501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:00.728669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:00.728839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:00.729088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:00.729133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:00.739072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1718 sessionId: src_id|bee11bd1-6d490e42-1eda8c3e-a15263d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:00.740094Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:00.740116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:00.740119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:00.740121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:00.740132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895877108312080:9965]
2025-09-30T14:55:00.740138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895877108312080:9965]
2025-09-30T14:55:00.740142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895877108312080:9965]
2025-09-30T14:55:00.740185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:00.740192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.740196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:00.740204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:00.740211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:00.740216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:00.740359Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:00.743142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:00.769002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895877198079356:7977]
2025-09-30T14:55:00.769385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1717, pipe: [1:7555895877198079356:7977]
2025-09-30T14:55:00.864206Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:00.864882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:00.864904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:00.864926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895877198079356:7977], now have 1 active actors on pipe
2025-09-30T14:55:00.865191Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:00.865715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bee11bd1-6d490e42-1eda8c3e-a15263d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:00.865728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bee11bd1-6d490e42-1eda8c3e-a15263d1_0] Write session will restart in 0.008547s
2025-09-30T14:55:00.865762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bee11bd1-6d490e42-1eda8c3e-a15263d1_0] Write session: Do CDS request
2025-09-30T14:55:00.865768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bee11bd1-6d490e42-1eda8c3e-a15263d1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:00.865239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:00.865245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895877198079356:7977]
2025-09-30T14:55:00.865259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:00.865268Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:00.865331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1718 reason: error at write: Disconnected sessionId: src_id|bee11bd1-6d490e42-1eda8c3e-a15263d1_0
2025-09-30T14:55:00.865517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1718 sessionId: src_id|bee11bd1-6d490e42-1eda8c3e-a15263d1_0 is DEAD
2025-09-30T14:55:00.875878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bee11bd1-6d490e42-1eda8c3e-a15263d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:00.876474Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:00.876492Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1719
2025-09-30T14:55:00.876675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1719 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:00.876709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1719 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:00.876721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1719 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:00.876725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:00.877289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1719 sessionId:  describe result for acl check
2025-09-30T14:55:00.877332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:00.877339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:00.877341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:00.877348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895877198079418:7835] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:00.877968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895877198079418:7835] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:00.880592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895877198079418:7835] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:00.884937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895877198079418:7835] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:00.884956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895877198079418:7835] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:00.884960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895877198079418:7835] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:00.884970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1719 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:00.892878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:00.896376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:00.896607Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:00.896619Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:00.896630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:00.896695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:00.896739Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895877108312390:9968]
2025-09-30T14:55:00.897453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:00.897901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:00.897972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:00.898381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:00.898478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:00.898486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:00.898487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:00.898488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:00.898489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:00.898491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:00.898492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:00.898494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:00.898496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:00.898498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:00.898499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.898501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:00.898502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:00.898504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:00.898506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:00.898512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:00.898524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:00.898529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:00.898533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:00.898538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:00.898542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:00.898546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:00.898551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:00.898555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:00.898560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:00.898565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.898570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:00.898574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:00.898578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:00.898582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:00.898591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:00.898601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:00.898608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:00.898614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:00.898620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:00.898627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:00.898632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:00.898638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:00.898644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:00.898650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:00.898656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:00.898662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:00.898668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:00.898675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:00.898680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:00.898687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:00.898694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:00.898700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:00.898705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:00.898712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:00.898718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.898724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.898732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:00.898739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:00.898751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:00.898757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:00.898767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:00.898773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:00.898780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:00.898789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:00.898840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:00.904798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:00.906247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:00.906267Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:00.906270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:00.906275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:00.906282Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1718 [2:7555895877108312390:9968]
2025-09-30T14:55:00.906301Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:00.906318Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:00.906323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:00.906326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:00.906328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:00.906347Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:00.906355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:00.906374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:00.906446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.906448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:00.906451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:00.906455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:00.906458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:00.906538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:00.906547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.906563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:00.906576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:00.906602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:00.906628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895877198079359:2454], now have 1 active actors on pipe
2025-09-30T14:55:00.906641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895877108312385:9968]
2025-09-30T14:55:00.906648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895877108312385:9968]
2025-09-30T14:55:00.906651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895877108312385:9968]
2025-09-30T14:55:00.906665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:00.906685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:00.906686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:00.906690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:00.906693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:00.906709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:00.906720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:00.906727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895877198079604:7835], now have 1 active actors on pipe
2025-09-30T14:55:00.906766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895877108312385:9968]
2025-09-30T14:55:00.906781Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:00.906750Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1718
2025-09-30T14:55:00.906775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1718
2025-09-30T14:55:00.906853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:00.906911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:00.906921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:00.906949Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42a4717e-a0b2770c-3b5fdba4-7bd00eec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:00.906962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:00.906966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:00.906968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:00.906989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:00.907005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:00.907021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:00.907280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:00.907297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:00.907324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:00.907463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1719 partition: 0 MaxSeqNo: 42 sessionId: src_id|42a4717e-a0b2770c-3b5fdba4-7bd00eec_0
2025-09-30T14:55:00.911660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bee11bd1-6d490e42-1eda8c3e-a15263d1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|42a4717e-a0b2770c-3b5fdba4-7bd00eec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:00.915634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42a4717e-a0b2770c-3b5fdba4-7bd00eec_0] Write session: try to update token
2025-09-30T14:55:00.915667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42a4717e-a0b2770c-3b5fdba4-7bd00eec_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:00.920548Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:00.920573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:00.920575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:00.920578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:00.920589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895877108312385:9968]
2025-09-30T14:55:00.920595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895877108312385:9968]
2025-09-30T14:55:00.920599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895877108312385:9968]
2025-09-30T14:55:00.920647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:00.920655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:00.920658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:00.920659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:00.920668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:00.920672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:00.920820Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:00.941282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1719 sessionId: src_id|42a4717e-a0b2770c-3b5fdba4-7bd00eec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:00.945314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:00.965535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895877198079748:7977]
2025-09-30T14:55:00.965908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1718, pipe: [1:7555895877198079748:7977]
2025-09-30T14:55:01.042828Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:01.043424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:01.043442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:01.043463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895877198079748:7977], now have 1 active actors on pipe
2025-09-30T14:55:01.043677Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:01.043766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:01.043795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895877198079748:7977]
2025-09-30T14:55:01.043840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:01.043953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1719 reason: status is not ok: tablet will be restarted right now sessionId: src_id|42a4717e-a0b2770c-3b5fdba4-7bd00eec_0
2025-09-30T14:55:01.044203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1719 sessionId: src_id|42a4717e-a0b2770c-3b5fdba4-7bd00eec_0 is DEAD
2025-09-30T14:55:01.044397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42a4717e-a0b2770c-3b5fdba4-7bd00eec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:01.044410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42a4717e-a0b2770c-3b5fdba4-7bd00eec_0] Write session will restart in 0.005633s
2025-09-30T14:55:01.044442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42a4717e-a0b2770c-3b5fdba4-7bd00eec_0] Write session: Do CDS request
2025-09-30T14:55:01.044451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42a4717e-a0b2770c-3b5fdba4-7bd00eec_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:01.051954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42a4717e-a0b2770c-3b5fdba4-7bd00eec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:01.052175Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:01.052208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1720
2025-09-30T14:55:01.052394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1720 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:01.052439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1720 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:01.052451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1720 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:01.052457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:01.052997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1720 sessionId:  describe result for acl check
2025-09-30T14:55:01.053044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:01.053056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:01.053058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:01.053066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895881493047073:7823] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:01.053749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895881493047073:7823] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:01.057367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895881493047073:7823] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:01.062627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895881493047073:7823] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:01.062655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895881493047073:7823] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:01.062659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895881493047073:7823] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:01.062671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1720 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:01.080857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:01.085823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:01.086326Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:01.086339Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:01.086353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:01.086442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:01.086486Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895881403279991:9970]
2025-09-30T14:55:01.087171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:01.087808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:01.087886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:01.088280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:01.088377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:01.088385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:01.088386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:01.088388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:01.088389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:01.088391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:01.088393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:01.088394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:01.088396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:01.088397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:01.088398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.088400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.088401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.088402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:01.088404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:01.088411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:01.088423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:01.088428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:01.088432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:01.088436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:01.088441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:01.088445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:01.088450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:01.088454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:01.088459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:01.088463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.088467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.088471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.088475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:01.088479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:01.088488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:01.088497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:01.088503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:01.088510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:01.088518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:01.088524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:01.088529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:01.088534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:01.088540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:01.088545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:01.088551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:01.088558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:01.088563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:01.088577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:01.088582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:01.088587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:01.088597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:01.088604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:01.088614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:01.088620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:01.088625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.088640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.088645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.088651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.088655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.088660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.088669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:01.088674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:01.088679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:01.088684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:01.088731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:01.095960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:01.096951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:01.096971Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:01.096974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:01.096979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:01.096987Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1719 [2:7555895881403279991:9970]
2025-09-30T14:55:01.097005Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:01.097023Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:01.097027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:01.097031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:01.097033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:01.097051Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:01.097059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:01.097067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:01.097135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.097145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.097148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.097152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:01.097156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:01.097232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:01.097240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.097255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.097272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.097291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:01.097314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895881403279986:9970]
2025-09-30T14:55:01.097321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895881403279986:9970]
2025-09-30T14:55:01.097324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895881403279986:9970]
2025-09-30T14:55:01.097334Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:01.097352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:01.097356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:01.097362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:01.097365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:01.097373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:01.097377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:01.097388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895881493047048:2454], now have 1 active actors on pipe
2025-09-30T14:55:01.097397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895881493047218:7823], now have 1 active actors on pipe
2025-09-30T14:55:01.097437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895881403279986:9970]
2025-09-30T14:55:01.097454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:01.097483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:01.097455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1719
2025-09-30T14:55:01.097465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1719
2025-09-30T14:55:01.097998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:01.098013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:01.098048Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|168da818-c882ac09-eb32ed5-b15eb0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:01.098060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:01.098064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:01.098066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:01.098079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:01.098092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:01.098157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:01.098376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:01.098384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:01.098400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:01.098557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1720 partition: 0 MaxSeqNo: 42 sessionId: src_id|168da818-c882ac09-eb32ed5-b15eb0e_0
2025-09-30T14:55:01.099068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42a4717e-a0b2770c-3b5fdba4-7bd00eec_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|168da818-c882ac09-eb32ed5-b15eb0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:01.102493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|168da818-c882ac09-eb32ed5-b15eb0e_0] Write session: try to update token
2025-09-30T14:55:01.102523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|168da818-c882ac09-eb32ed5-b15eb0e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:01.114067Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:01.114089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:01.114093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:01.114095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:01.114108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895881403279986:9970]
2025-09-30T14:55:01.114113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895881403279986:9970]
2025-09-30T14:55:01.114117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895881403279986:9970]
2025-09-30T14:55:01.114163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:01.114171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.114174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:01.114333Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:01.115066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:01.115081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:01.115086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:01.126396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1720 sessionId: src_id|168da818-c882ac09-eb32ed5-b15eb0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:01.130278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:01.143786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895881493047443:7977]
2025-09-30T14:55:01.144233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1719, pipe: [1:7555895881493047443:7977]
2025-09-30T14:55:01.238336Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:01.238989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:01.238999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:01.239044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895881493047443:7977], now have 1 active actors on pipe
2025-09-30T14:55:01.239482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:01.239509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:01.239576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1720 reason: error at write: Disconnected sessionId: src_id|168da818-c882ac09-eb32ed5-b15eb0e_0
2025-09-30T14:55:01.239771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1720 sessionId: src_id|168da818-c882ac09-eb32ed5-b15eb0e_0 is DEAD
2025-09-30T14:55:01.239859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:01.239915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895881493047443:7977]
2025-09-30T14:55:01.240166Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:01.242708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|168da818-c882ac09-eb32ed5-b15eb0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:01.242725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|168da818-c882ac09-eb32ed5-b15eb0e_0] Write session will restart in 0.006245s
2025-09-30T14:55:01.242754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|168da818-c882ac09-eb32ed5-b15eb0e_0] Write session: Do CDS request
2025-09-30T14:55:01.242767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|168da818-c882ac09-eb32ed5-b15eb0e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:01.250288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|168da818-c882ac09-eb32ed5-b15eb0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:01.250557Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:01.250589Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1721
2025-09-30T14:55:01.250776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1721 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:01.250818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1721 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:01.250833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1721 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:01.250838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:01.251434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1721 sessionId:  describe result for acl check
2025-09-30T14:55:01.251486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:01.251495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:01.251497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:01.251505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895881493047464:7821] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:01.252040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895881493047464:7821] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:01.258345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895881493047464:7821] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:01.263837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895881493047464:7821] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:01.263862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895881493047464:7821] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:01.263866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895881493047464:7821] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:01.263890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1721 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:01.282809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:01.287820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:01.288563Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:01.288569Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:01.288580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:01.288660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:01.288697Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895881403280306:9972]
2025-09-30T14:55:01.289322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:01.289878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:01.289954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:01.290359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:01.290437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:01.290443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:01.290444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:01.290446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:01.290447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:01.290449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:01.290451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:01.290452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:01.290453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:01.290455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:01.290457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.290458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.290460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.290461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:01.290462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:01.290470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:01.290482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:01.290487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:01.290492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:01.290496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:01.290501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:01.290505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:01.290510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:01.290515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:01.290519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:01.290523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.290527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.290532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.290536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:01.290540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:01.290550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:01.290559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:01.290564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:01.290570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:01.290576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:01.290582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:01.290591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:01.290597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:01.290603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:01.290614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:01.290619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:01.290631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:01.290637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:01.290647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:01.290652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:01.290658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:01.290669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:01.290680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:01.290685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:01.290696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:01.290702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.290709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.290715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.290725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.290740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.290751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.290756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:01.290766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:01.290776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:01.290786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:01.290834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:01.297397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:01.299045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:01.299065Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:01.299067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:01.299072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:01.299079Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1720 [2:7555895881403280306:9972]
2025-09-30T14:55:01.299100Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:01.299117Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:01.299120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:01.299123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:01.299126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:01.299145Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:01.299157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:01.299165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:01.299296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.299305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.299307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.299311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:01.299314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:01.299390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:01.299410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.299426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.299439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.299466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:01.299484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895881403280297:9972]
2025-09-30T14:55:01.299491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895881403280297:9972]
2025-09-30T14:55:01.299494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895881403280297:9972]
2025-09-30T14:55:01.299504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:01.299515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:01.299520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:01.299522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:01.299526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895881493047449:2454], now have 1 active actors on pipe
2025-09-30T14:55:01.299535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:01.299551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:01.299560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:01.299566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895881493047625:7821], now have 1 active actors on pipe
2025-09-30T14:55:01.299603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895881403280297:9972]
2025-09-30T14:55:01.299614Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:01.299622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:01.300217Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1720
2025-09-30T14:55:01.300272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1720
2025-09-30T14:55:01.300446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:01.300460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:01.300495Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7865dc74-60811823-9d8b4f49-4595bd99_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:01.300510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:01.300519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:01.300521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:01.300535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:01.300554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:01.300577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:01.300790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:01.300802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:01.300822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:01.300935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1721 partition: 0 MaxSeqNo: 42 sessionId: src_id|7865dc74-60811823-9d8b4f49-4595bd99_0
2025-09-30T14:55:01.301302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|168da818-c882ac09-eb32ed5-b15eb0e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7865dc74-60811823-9d8b4f49-4595bd99_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:01.304519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7865dc74-60811823-9d8b4f49-4595bd99_0] Write session: try to update token
2025-09-30T14:55:01.304549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7865dc74-60811823-9d8b4f49-4595bd99_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:01.313816Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:01.313841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:01.313856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895881403280297:9972]
2025-09-30T14:55:01.313914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:01.313923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:01.314169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:01.314369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:01.314549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:01.314735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:01.315007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:01.315074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:01.323821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1721 sessionId: src_id|7865dc74-60811823-9d8b4f49-4595bd99_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:01.326267Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:01.326290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:01.326294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:01.326297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:01.326311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895881403280297:9972]
2025-09-30T14:55:01.326318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895881403280297:9972]
2025-09-30T14:55:01.326323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895881403280297:9972]
2025-09-30T14:55:01.326381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:01.326399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.326401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:01.326403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:01.326409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:01.326415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:01.326601Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:01.326950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:01.340370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895881493047840:7977]
2025-09-30T14:55:01.340816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1720, pipe: [1:7555895881493047840:7977]
2025-09-30T14:55:01.453095Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:01.454025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:01.454049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:01.454078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895881493047840:7977], now have 1 active actors on pipe
2025-09-30T14:55:01.454411Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:01.454399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:01.454401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:01.454406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:01.454468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895881493047840:7977]
2025-09-30T14:55:01.454503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1721 reason: error at write: Disconnected sessionId: src_id|7865dc74-60811823-9d8b4f49-4595bd99_0
2025-09-30T14:55:01.454708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1721 sessionId: src_id|7865dc74-60811823-9d8b4f49-4595bd99_0 is DEAD
2025-09-30T14:55:01.454929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7865dc74-60811823-9d8b4f49-4595bd99_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:01.454945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7865dc74-60811823-9d8b4f49-4595bd99_0] Write session will restart in 0.006612s
2025-09-30T14:55:01.454980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7865dc74-60811823-9d8b4f49-4595bd99_0] Write session: Do CDS request
2025-09-30T14:55:01.454990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7865dc74-60811823-9d8b4f49-4595bd99_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:01.466451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:01.467766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7865dc74-60811823-9d8b4f49-4595bd99_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:01.467881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:01.467900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1722
2025-09-30T14:55:01.468125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1722 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:01.468183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1722 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:01.468203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1722 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:01.468213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:01.468726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:01.468858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1722 sessionId:  describe result for acl check
2025-09-30T14:55:01.468917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:01.468924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:01.468927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:01.468935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895881493047864:7814] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:01.469157Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:01.469176Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:01.469210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:01.469386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:01.469455Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895881403280366:9975]
2025-09-30T14:55:01.469724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895881493047864:7814] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:01.470196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:01.470655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:01.470729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:01.471110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:01.471178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:01.471187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:01.471189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:01.471191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:01.471192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:01.471193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:01.471195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:01.471201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:01.471202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:01.471203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:01.471205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.471206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.471207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.471208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:01.471209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:01.471216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:01.471228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:01.471231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:01.471234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:01.471238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:01.471262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:01.471266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:01.471270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:01.471274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:01.471279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:01.471284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.471288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.471293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.471298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:01.471302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:01.471311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:01.471320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:01.471326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:01.471332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:01.471337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:01.471344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:01.471350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:01.471356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:01.471362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:01.471368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:01.471373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:01.471379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:01.471385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:01.471402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:01.471407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:01.471412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:01.471417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:01.471422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:01.471425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:01.471430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:01.471435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.471440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.471444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.471449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.471453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.471458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.471462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:01.471468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:01.471472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:01.471477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:01.471521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:01.472204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895881493047864:7814] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:01.477260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895881493047864:7814] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:01.477285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895881493047864:7814] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:01.477290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895881493047864:7814] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:01.477302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1722 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:01.477726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:01.478861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:01.478884Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:01.478887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:01.478892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:01.478901Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1721 [2:7555895881403280366:9975]
2025-09-30T14:55:01.478924Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:01.478944Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:01.478951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:01.478958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:01.478971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:01.478993Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:01.479002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:01.479010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:01.479128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.479138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.479141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.479145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:01.479149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:01.479262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:01.479274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.479291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.479303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.479319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:01.479355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895881493047843:2454], now have 1 active actors on pipe
2025-09-30T14:55:01.479366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895881493047902:7814], now have 1 active actors on pipe
2025-09-30T14:55:01.479375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895881403280360:9975]
2025-09-30T14:55:01.479381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895881403280360:9975]
2025-09-30T14:55:01.479383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895881403280360:9975]
2025-09-30T14:55:01.479400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:01.479419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:01.479437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:01.479437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:01.479442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:01.479443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:01.479447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:01.479442Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1721
2025-09-30T14:55:01.479447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1721
2025-09-30T14:55:01.479495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895881403280360:9975]
2025-09-30T14:55:01.479507Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:01.479508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:01.479548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:01.479553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:01.479602Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5447e52b-f5632e8a-45905f3a-d9ab3ccc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:01.479618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:01.479623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:01.479625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:01.479639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:01.479652Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:01.479675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:01.479852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:01.479863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:01.479880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:01.480099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1722 partition: 0 MaxSeqNo: 42 sessionId: src_id|5447e52b-f5632e8a-45905f3a-d9ab3ccc_0
2025-09-30T14:55:01.480593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7865dc74-60811823-9d8b4f49-4595bd99_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5447e52b-f5632e8a-45905f3a-d9ab3ccc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:01.484259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5447e52b-f5632e8a-45905f3a-d9ab3ccc_0] Write session: try to update token
2025-09-30T14:55:01.484286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5447e52b-f5632e8a-45905f3a-d9ab3ccc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:01.494015Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:01.494043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:01.494048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:01.494050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:01.494064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895881403280360:9975]
2025-09-30T14:55:01.494075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895881403280360:9975]
2025-09-30T14:55:01.494082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895881403280360:9975]
2025-09-30T14:55:01.494141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:01.494145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:01.494151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.494155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:01.494165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:01.494171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:01.494343Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:01.507110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1722 sessionId: src_id|5447e52b-f5632e8a-45905f3a-d9ab3ccc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:01.511462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:01.554920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895881493047914:7977]
2025-09-30T14:55:01.555420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1721, pipe: [1:7555895881493047914:7977]
2025-09-30T14:55:01.626362Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:01.626961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:01.626973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:01.627000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895881493047914:7977], now have 1 active actors on pipe
2025-09-30T14:55:01.627456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895881493047914:7977]
2025-09-30T14:55:01.627498Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:01.627538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:01.627541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:01.627616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1722 reason: error at write: Disconnected sessionId: src_id|5447e52b-f5632e8a-45905f3a-d9ab3ccc_0
2025-09-30T14:55:01.627421Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:01.627849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1722 sessionId: src_id|5447e52b-f5632e8a-45905f3a-d9ab3ccc_0 is DEAD
2025-09-30T14:55:01.631576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5447e52b-f5632e8a-45905f3a-d9ab3ccc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:01.631595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5447e52b-f5632e8a-45905f3a-d9ab3ccc_0] Write session will restart in 0.009983s
2025-09-30T14:55:01.631628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5447e52b-f5632e8a-45905f3a-d9ab3ccc_0] Write session: Do CDS request
2025-09-30T14:55:01.631636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5447e52b-f5632e8a-45905f3a-d9ab3ccc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:01.643072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5447e52b-f5632e8a-45905f3a-d9ab3ccc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:01.640375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:01.642728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:01.642963Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:01.642967Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:01.642978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:01.643030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:01.643077Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895881403280449:9984]
2025-09-30T14:55:01.643192Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:01.643212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1723
2025-09-30T14:55:01.643642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1723 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:01.643695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1723 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:01.643702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1723 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:01.643708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:01.644436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1723 sessionId:  describe result for acl check
2025-09-30T14:55:01.644476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:01.644479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:01.644481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:01.644489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895881493047958:7798] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:01.645223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895881493047958:7798] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:01.643779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:01.644128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:01.644169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:01.644547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:01.644602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:01.644607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:01.644608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:01.644610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:01.644611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:01.644612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:01.644614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:01.644615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:01.644616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:01.644617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:01.644618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.644619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.644620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.644621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:01.644622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:01.644628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:01.644637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:01.644642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:01.644645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:01.644649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:01.644655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:01.644659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:01.644663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:01.644666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:01.644671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:01.644675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.644678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.644682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.644685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:01.644689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:01.644699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:01.644707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:01.644716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:01.644721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:01.644726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:01.644731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:01.644735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:01.644739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:01.644744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:01.644749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:01.644756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:01.644762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:01.644766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:01.644771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:01.644775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:01.644780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:01.644785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:01.644789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:01.644793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:01.644798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:01.644805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.644810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.644815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.644820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.644824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.644828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.644832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:01.644837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:01.644842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:01.644846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:01.644891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:01.647888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895881493047958:7798] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:01.651387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:01.651436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895881493047958:7798] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:01.651456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895881493047958:7798] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:01.651463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895881493047958:7798] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:01.651472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1723 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:01.652403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:01.652422Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:01.652425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:01.652434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:01.652439Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1722 [2:7555895881403280449:9984]
2025-09-30T14:55:01.652455Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:01.652470Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:01.652472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:01.652475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:01.652477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:01.652494Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:01.652507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:01.652514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:01.652577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.652585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.652587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.652591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:01.652594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:01.652674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:01.652683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.652695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.652713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.652733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:01.652763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895881493047929:2454], now have 1 active actors on pipe
2025-09-30T14:55:01.652776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895881403280443:9984]
2025-09-30T14:55:01.652778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895881403280443:9984]
2025-09-30T14:55:01.652780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895881403280443:9984]
2025-09-30T14:55:01.652796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:01.652815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:01.652811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:01.652825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:01.652828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:01.652833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:01.652836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:01.652875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895881403280443:9984]
2025-09-30T14:55:01.652889Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:01.652914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:01.655724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1722
2025-09-30T14:55:01.656029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895881493048002:7798], now have 1 active actors on pipe
2025-09-30T14:55:01.656144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1722
2025-09-30T14:55:01.656695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:01.656714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:01.656763Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83d1fe5f-8369c4ee-cad12918-e83f7680_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:01.656791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:01.656805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:01.656817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:01.656839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:01.656867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:01.656898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:01.657193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:01.657203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:01.657222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:01.657356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1723 partition: 0 MaxSeqNo: 42 sessionId: src_id|83d1fe5f-8369c4ee-cad12918-e83f7680_0
2025-09-30T14:55:01.657930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5447e52b-f5632e8a-45905f3a-d9ab3ccc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|83d1fe5f-8369c4ee-cad12918-e83f7680_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:01.661841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83d1fe5f-8369c4ee-cad12918-e83f7680_0] Write session: try to update token
2025-09-30T14:55:01.661867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83d1fe5f-8369c4ee-cad12918-e83f7680_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:01.671278Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:01.671300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:01.671303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:01.671305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:01.671316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895881403280443:9984]
2025-09-30T14:55:01.671322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895881403280443:9984]
2025-09-30T14:55:01.671327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895881403280443:9984]
2025-09-30T14:55:01.671379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:01.671389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.671392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:01.671588Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:01.675419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:01.675460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:01.675472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:01.696876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1723 sessionId: src_id|83d1fe5f-8369c4ee-cad12918-e83f7680_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:01.699784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:01.726940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895881493048020:7977]
2025-09-30T14:55:01.727264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1722, pipe: [1:7555895881493048020:7977]
2025-09-30T14:55:01.815882Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:01.816920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:01.816941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:01.816963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895881493048020:7977], now have 1 active actors on pipe
2025-09-30T14:55:01.817253Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:01.817302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:01.817335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:01.817371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895881493048020:7977]
2025-09-30T14:55:01.817411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1723 reason: status is not ok: tablet will be restarted right now sessionId: src_id|83d1fe5f-8369c4ee-cad12918-e83f7680_0
2025-09-30T14:55:01.817615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1723 sessionId: src_id|83d1fe5f-8369c4ee-cad12918-e83f7680_0 is DEAD
2025-09-30T14:55:01.817875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83d1fe5f-8369c4ee-cad12918-e83f7680_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:01.817893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83d1fe5f-8369c4ee-cad12918-e83f7680_0] Write session will restart in 0.008097s
2025-09-30T14:55:01.817918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83d1fe5f-8369c4ee-cad12918-e83f7680_0] Write session: Do CDS request
2025-09-30T14:55:01.817924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83d1fe5f-8369c4ee-cad12918-e83f7680_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:01.826924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83d1fe5f-8369c4ee-cad12918-e83f7680_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:01.827045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:01.827109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:01.827076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1724
2025-09-30T14:55:01.827292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1724 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:01.827380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1724 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:01.827393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1724 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:01.827401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:01.827955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1724 sessionId:  describe result for acl check
2025-09-30T14:55:01.828019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:01.828027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:01.828029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:01.828037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895881493048047:7785] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:01.828695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895881493048047:7785] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:01.829275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:01.829553Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:01.829567Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:01.829581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:01.829670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:01.829724Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895881403280532:9993]
2025-09-30T14:55:01.830418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:01.830769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:01.830824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:01.831232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:01.831333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:01.831334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:01.831336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:01.831337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:01.831339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:01.831340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:01.831342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:01.831343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:01.831344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:01.831346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:01.831348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.831349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.831350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.831352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:01.831353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:01.831360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:01.831372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:01.831380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:01.831384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:01.831389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:01.831394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:01.831398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:01.831402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:01.831407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:01.831412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:01.831417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.831421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.831425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.831429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:01.831433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:01.831441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:01.831450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:01.831456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:01.831462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:01.831234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895881493048047:7785] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:01.831468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:01.831475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:01.831480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:01.831486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:01.831492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:01.831498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:01.831504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:01.831510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:01.831516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:01.831523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:01.831527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:01.831533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:01.831539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:01.831545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:01.831554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:01.831560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:01.831567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.831573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.831577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.831584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.831590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.831596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.831602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:01.831609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:01.831614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:01.831620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:01.831670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:01.838554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:01.839611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:01.839632Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:01.839635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:01.839639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:01.839646Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1723 [2:7555895881403280532:9993]
2025-09-30T14:55:01.839663Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:01.839680Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:01.839684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:01.839687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:01.839690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:01.839706Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:01.839713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:01.839722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:01.839793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.839801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.839803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.839807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:01.839810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:01.839995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:01.840005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.840019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.840035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.840065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:01.840085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895881493048086:7785], now have 1 active actors on pipe
2025-09-30T14:55:01.840089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895881493048026:2454], now have 1 active actors on pipe
2025-09-30T14:55:01.840095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895881403280527:9993]
2025-09-30T14:55:01.840098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895881403280527:9993]
2025-09-30T14:55:01.840100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895881403280527:9993]
2025-09-30T14:55:01.840109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:01.840123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:01.840139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:01.838842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895881493048047:7785] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:01.838865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895881493048047:7785] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:01.838869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895881493048047:7785] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:01.840138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:01.838879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1724 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:01.840142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:01.840143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:01.840145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:01.840192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:01.840197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:01.840209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895881403280527:9993]
2025-09-30T14:55:01.840217Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:01.840225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:01.840253Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfef3c54-caff225f-7642427e-83dfac0d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:01.840261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:01.840265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:01.840267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:01.840278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:01.840289Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:01.840063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1723
2025-09-30T14:55:01.840087Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1723
2025-09-30T14:55:01.840312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:01.840900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:01.840917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:01.840966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:01.841081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1724 partition: 0 MaxSeqNo: 42 sessionId: src_id|bfef3c54-caff225f-7642427e-83dfac0d_0
2025-09-30T14:55:01.841516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83d1fe5f-8369c4ee-cad12918-e83f7680_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bfef3c54-caff225f-7642427e-83dfac0d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:01.845053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfef3c54-caff225f-7642427e-83dfac0d_0] Write session: try to update token
2025-09-30T14:55:01.845080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfef3c54-caff225f-7642427e-83dfac0d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:01.853585Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:01.853610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:01.853613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:01.853615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:01.853626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895881403280527:9993]
2025-09-30T14:55:01.853631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895881403280527:9993]
2025-09-30T14:55:01.853635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895881403280527:9993]
2025-09-30T14:55:01.853678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:01.853701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.853704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:01.853707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:01.853716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:01.853720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:01.853857Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:01.871953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1724 sessionId: src_id|bfef3c54-caff225f-7642427e-83dfac0d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:01.875875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:01.917409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895881493048093:7977]
2025-09-30T14:55:01.918845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1723, pipe: [1:7555895881493048093:7977]
2025-09-30T14:55:01.976424Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:01.976770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:01.976779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:01.976799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895881493048093:7977], now have 1 active actors on pipe
2025-09-30T14:55:01.977070Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:01.977539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895881493048093:7977]
2025-09-30T14:55:01.977592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:01.977662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1724 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bfef3c54-caff225f-7642427e-83dfac0d_0
2025-09-30T14:55:01.977863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1724 sessionId: src_id|bfef3c54-caff225f-7642427e-83dfac0d_0 is DEAD
2025-09-30T14:55:01.977993Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:01.978040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfef3c54-caff225f-7642427e-83dfac0d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:01.978053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfef3c54-caff225f-7642427e-83dfac0d_0] Write session will restart in 0.009583s
2025-09-30T14:55:01.978078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfef3c54-caff225f-7642427e-83dfac0d_0] Write session: Do CDS request
2025-09-30T14:55:01.978085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfef3c54-caff225f-7642427e-83dfac0d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:01.988434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:01.990997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:01.991321Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:01.991329Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:01.991342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:01.991410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:01.991461Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895881403280594:9995]
2025-09-30T14:55:01.991812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfef3c54-caff225f-7642427e-83dfac0d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:01.992156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:01.992537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:01.992590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:01.992963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:01.993022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:01.993024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:01.993026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:01.993027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:01.993033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:01.993034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:01.993036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:01.993037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:01.993039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:01.993040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:01.993041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.993042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.993043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.993044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:01.993046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:01.993051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:01.993062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:01.993066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:01.993070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:01.993074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:01.993078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:01.993083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:01.993087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:01.993091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:01.993095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:01.993099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.993103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.993106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.993110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:01.993114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:01.993122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:01.993132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:01.993137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:01.993143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:01.993148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:01.993157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:01.993162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:01.993167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:01.993172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:01.993178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:01.993182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:01.993187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:01.993192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:01.993197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:01.993202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:01.993207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:01.993212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:01.993219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:01.993223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:01.993227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:01.993234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.993239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:01.993243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.993248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:01.993252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.993257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:01.993261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:01.993266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:01.993271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:01.993276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:01.993338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:01.994869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:01.994900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1725
2025-09-30T14:55:01.995423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1725 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:01.995480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1725 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:01.995486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1725 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:01.995491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:01.996100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1725 sessionId:  describe result for acl check
2025-09-30T14:55:01.996141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:01.996143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:01.996145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:01.996152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895881493048124:7779] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:01.996747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895881493048124:7779] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:02.000914Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1724
2025-09-30T14:55:01.999565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:02.000555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:02.000561Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:02.000564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:02.000569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:02.000576Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1724 [2:7555895881403280594:9995]
2025-09-30T14:55:02.000596Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:02.000619Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:02.000622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:02.000625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:02.000628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:02.000644Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:02.000652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:02.000659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:02.000726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.000729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.000731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.000734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:02.000737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:02.000812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:02.000814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.000829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.000843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.000862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:02.000881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895881493048098:2454], now have 1 active actors on pipe
2025-09-30T14:55:02.000889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895881403280588:9995]
2025-09-30T14:55:02.000894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895881403280588:9995]
2025-09-30T14:55:02.000897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895881403280588:9995]
2025-09-30T14:55:02.000913Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:02.000928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:02.000939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:02.000944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:02.000945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:02.000946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:02.000952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:02.000996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895881403280588:9995]
2025-09-30T14:55:02.001008Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:02.001043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:02.001196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895881493048124:7779] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:02.011148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895881493048124:7779] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:02.011167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895881493048124:7779] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:02.011171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895881493048124:7779] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:02.011181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1725 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:02.011750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895885788015454:7779], now have 1 active actors on pipe
2025-09-30T14:55:02.011821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1724
2025-09-30T14:55:02.011947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:02.011961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:02.011996Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8e7cadf-5f4bfc5d-5f22411d-f2c2c09c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:02.012013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:02.012023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:02.012026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:02.012042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:02.012078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:02.012106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:02.012867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:02.012884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:02.012912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:02.013047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1725 partition: 0 MaxSeqNo: 42 sessionId: src_id|b8e7cadf-5f4bfc5d-5f22411d-f2c2c09c_0
2025-09-30T14:55:02.013541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfef3c54-caff225f-7642427e-83dfac0d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b8e7cadf-5f4bfc5d-5f22411d-f2c2c09c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:02.016076Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:02.016106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:02.016116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895881403280588:9995]
2025-09-30T14:55:02.016160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:02.016168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:02.016366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:02.016940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e7cadf-5f4bfc5d-5f22411d-f2c2c09c_0] Write session: try to update token
2025-09-30T14:55:02.016961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e7cadf-5f4bfc5d-5f22411d-f2c2c09c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:02.016548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:02.016748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:02.016912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:02.017140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:02.017187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:02.031823Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:02.031849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:02.031852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:02.031854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:02.031868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895881403280588:9995]
2025-09-30T14:55:02.031873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895881403280588:9995]
2025-09-30T14:55:02.031878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895881403280588:9995]
2025-09-30T14:55:02.031925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:02.031935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.031937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:02.031943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:02.031944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:02.031948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:02.032112Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:02.045275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1725 sessionId: src_id|b8e7cadf-5f4bfc5d-5f22411d-f2c2c09c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:02.048926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:02.077650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895885788015458:7977]
2025-09-30T14:55:02.077968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1724, pipe: [1:7555895885788015458:7977]
2025-09-30T14:55:02.150133Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:02.150609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:02.150626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:02.150649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895885788015458:7977], now have 1 active actors on pipe
2025-09-30T14:55:02.150943Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:02.150927Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:02.151050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:02.151058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:02.151068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895885788015458:7977]
2025-09-30T14:55:02.151141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1725 reason: error at write: Disconnected sessionId: src_id|b8e7cadf-5f4bfc5d-5f22411d-f2c2c09c_0
2025-09-30T14:55:02.151382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1725 sessionId: src_id|b8e7cadf-5f4bfc5d-5f22411d-f2c2c09c_0 is DEAD
2025-09-30T14:55:02.151671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e7cadf-5f4bfc5d-5f22411d-f2c2c09c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:02.151689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e7cadf-5f4bfc5d-5f22411d-f2c2c09c_0] Write session will restart in 0.006169s
2025-09-30T14:55:02.151736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e7cadf-5f4bfc5d-5f22411d-f2c2c09c_0] Write session: Do CDS request
2025-09-30T14:55:02.151745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e7cadf-5f4bfc5d-5f22411d-f2c2c09c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:02.158951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e7cadf-5f4bfc5d-5f22411d-f2c2c09c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:02.159193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:02.159213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1726
2025-09-30T14:55:02.159397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1726 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:02.159439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1726 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:02.159444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1726 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:02.159449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:02.159423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:02.159876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1726 sessionId:  describe result for acl check
2025-09-30T14:55:02.159913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:02.159919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:02.159921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:02.159928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895885788015489:7773] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:02.160465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895885788015489:7773] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:02.161232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:02.161450Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:02.161458Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:02.161469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:02.161521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:02.161566Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895885698247950:9997]
2025-09-30T14:55:02.162253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:02.162558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:02.162605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:02.162839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895885788015489:7773] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:02.162946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:02.163008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:02.163014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:02.163015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:02.163017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:02.163018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:02.163019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:02.163021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:02.163022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:02.163024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:02.163025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:02.163026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.163028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.163029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.163030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:02.163031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:02.163037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:02.163047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:02.163052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:02.163056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:02.163061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:02.163065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:02.163069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:02.163073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:02.163078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:02.163085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:02.163089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.163093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.163097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.163101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:02.163104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:02.163111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:02.163119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:02.163125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:02.163131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:02.163136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:02.163141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:02.163147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:02.163153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:02.163157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:02.163163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:02.163168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:02.163174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:02.163180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:02.163185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:02.163190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:02.163196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:02.163208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:02.163213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:02.163217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:02.163223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:02.163233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.163238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.163261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.163267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.163272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.163279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.163284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:02.163294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:02.163299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:02.163304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:02.163352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:02.169025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895885788015489:7773] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:02.169050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895885788015489:7773] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:02.169054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895885788015489:7773] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:02.169063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1726 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:02.169331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:02.170293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:02.170310Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:02.170312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:02.170317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:02.170325Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1725 [2:7555895885698247950:9997]
2025-09-30T14:55:02.170342Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:02.170360Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:02.170363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:02.170367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:02.170369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:02.170389Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:02.170399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:02.170405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:02.170470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.170480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.170482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.170489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:02.170492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:02.170560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:02.170569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.170582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.170598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.170618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:02.170641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895885788015528:7773], now have 1 active actors on pipe
2025-09-30T14:55:02.170649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895885788015466:2454], now have 1 active actors on pipe
2025-09-30T14:55:02.170656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895885698247945:9997]
2025-09-30T14:55:02.170659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895885698247945:9997]
2025-09-30T14:55:02.170661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895885698247945:9997]
2025-09-30T14:55:02.170672Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:02.170687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:02.170689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:02.170694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:02.170697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:02.170702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:02.170705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:02.170743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895885698247945:9997]
2025-09-30T14:55:02.170756Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:02.170787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:02.170770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1725
2025-09-30T14:55:02.170786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1725
2025-09-30T14:55:02.170839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:02.170850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:02.170879Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9bb7c94-7b727fb6-4e554924-1513c809_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:02.170891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:02.170899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:02.170901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:02.170911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:02.170928Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:02.170943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:02.171145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:02.171160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:02.171184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:02.171341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1726 partition: 0 MaxSeqNo: 42 sessionId: src_id|a9bb7c94-7b727fb6-4e554924-1513c809_0
2025-09-30T14:55:02.171827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e7cadf-5f4bfc5d-5f22411d-f2c2c09c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a9bb7c94-7b727fb6-4e554924-1513c809_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:02.175560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9bb7c94-7b727fb6-4e554924-1513c809_0] Write session: try to update token
2025-09-30T14:55:02.175589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9bb7c94-7b727fb6-4e554924-1513c809_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:02.190992Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:02.191018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:02.191037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895885698247945:9997]
2025-09-30T14:55:02.191097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:02.191121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:02.191351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:02.191554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:02.191748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:02.191940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:02.192470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:02.192550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:02.195015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1726 sessionId: src_id|a9bb7c94-7b727fb6-4e554924-1513c809_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:02.195617Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:02.195645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:02.195648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:02.195651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:02.195660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895885698247945:9997]
2025-09-30T14:55:02.195664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895885698247945:9997]
2025-09-30T14:55:02.195670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895885698247945:9997]
2025-09-30T14:55:02.195712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:02.195718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.195721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:02.195881Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:02.195946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:02.195963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:02.195968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:02.198196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:02.251224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895885788015538:7977]
2025-09-30T14:55:02.251521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1725, pipe: [1:7555895885788015538:7977]
2025-09-30T14:55:02.314170Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:02.314569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:02.314586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:02.314610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895885788015538:7977], now have 1 active actors on pipe
2025-09-30T14:55:02.314888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:02.314942Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:02.314909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:02.314914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:02.314951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895885788015538:7977]
2025-09-30T14:55:02.314995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1726 reason: error at write: Disconnected sessionId: src_id|a9bb7c94-7b727fb6-4e554924-1513c809_0
2025-09-30T14:55:02.315261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1726 sessionId: src_id|a9bb7c94-7b727fb6-4e554924-1513c809_0 is DEAD
2025-09-30T14:55:02.315596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9bb7c94-7b727fb6-4e554924-1513c809_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:02.315630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9bb7c94-7b727fb6-4e554924-1513c809_0] Write session will restart in 0.006511s
2025-09-30T14:55:02.315684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9bb7c94-7b727fb6-4e554924-1513c809_0] Write session: Do CDS request
2025-09-30T14:55:02.315697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9bb7c94-7b727fb6-4e554924-1513c809_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:02.323975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9bb7c94-7b727fb6-4e554924-1513c809_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:02.324089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:02.324109Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1727
2025-09-30T14:55:02.324354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1727 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:02.324396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1727 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:02.324402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1727 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:02.324406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:02.324801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:02.324908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1727 sessionId:  describe result for acl check
2025-09-30T14:55:02.324948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:02.324962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:02.324964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:02.324971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895885788015563:7766] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:02.325580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895885788015563:7766] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:02.326787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:02.327018Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:02.327030Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:02.327042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:02.327112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:02.327157Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895885698248012:9999]
2025-09-30T14:55:02.327885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:02.327950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895885788015563:7766] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:02.328318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:02.328386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:02.328769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:02.328877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:02.328884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:02.328885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:02.328886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:02.328887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:02.328889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:02.328891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:02.328892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:02.328893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:02.328894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:02.328896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.328916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.328917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.328919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:02.328920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:02.328926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:02.328936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:02.328940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:02.328945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:02.328948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:02.328952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:02.328958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:02.328961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:02.328964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:02.328971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:02.328975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.328979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.328982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.328986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:02.328991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:02.329001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:02.329009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:02.329015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:02.329021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:02.329027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:02.329032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:02.329036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:02.329041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:02.329047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:02.329056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:02.329062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:02.329067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:02.329071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:02.329076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:02.329079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:02.329084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:02.329090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:02.329096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:02.329101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:02.329106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:02.329112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.329117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.329123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.329133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.329137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.329146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.329151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:02.329156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:02.329162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:02.329167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:02.329215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:02.334929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895885788015563:7766] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:02.334954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895885788015563:7766] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:02.334958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895885788015563:7766] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:02.334968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1727 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:02.335276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:02.336245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:02.336265Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:02.336269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:02.336274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:02.336282Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1726 [2:7555895885698248012:9999]
2025-09-30T14:55:02.336300Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:02.336319Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:02.336323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:02.336327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:02.336332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:02.336350Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:02.336357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:02.336365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:02.336442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.336452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.336454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.336458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:02.336460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:02.336541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:02.336549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.336566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.336583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.336609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:02.336634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895885698248007:9999]
2025-09-30T14:55:02.336641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895885698248007:9999]
2025-09-30T14:55:02.336643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895885698248007:9999]
2025-09-30T14:55:02.336657Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:02.336676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:02.336698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:02.336705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:02.336722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:02.336733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:02.336735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:02.336747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895885698248007:9999]
2025-09-30T14:55:02.336758Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:02.336849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:02.337066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895885788015540:2454], now have 1 active actors on pipe
2025-09-30T14:55:02.337077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895885788015602:7766], now have 1 active actors on pipe
2025-09-30T14:55:02.337099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1726
2025-09-30T14:55:02.337113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1726
2025-09-30T14:55:02.337202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:02.337220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:02.337253Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7295cd2d-a9e15c22-e8b73965-e698dfed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:02.337268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:02.337272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:02.337275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:02.337299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:02.337313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:02.337334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:02.337507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:02.337525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:02.337569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:02.337702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1727 partition: 0 MaxSeqNo: 42 sessionId: src_id|7295cd2d-a9e15c22-e8b73965-e698dfed_0
2025-09-30T14:55:02.338252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9bb7c94-7b727fb6-4e554924-1513c809_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7295cd2d-a9e15c22-e8b73965-e698dfed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:02.341986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7295cd2d-a9e15c22-e8b73965-e698dfed_0] Write session: try to update token
2025-09-30T14:55:02.342015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7295cd2d-a9e15c22-e8b73965-e698dfed_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:02.350450Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:02.350479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:02.350482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:02.350484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:02.350496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895885698248007:9999]
2025-09-30T14:55:02.350501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895885698248007:9999]
2025-09-30T14:55:02.350507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895885698248007:9999]
2025-09-30T14:55:02.350557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:02.350565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.350574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:02.350573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:02.350582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:02.350588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:02.350738Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:02.366149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1727 sessionId: src_id|7295cd2d-a9e15c22-e8b73965-e698dfed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:02.369657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:02.415086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895885788015610:7977]
2025-09-30T14:55:02.415494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1726, pipe: [1:7555895885788015610:7977]
2025-09-30T14:55:02.469380Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:02.469842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:02.469860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:02.469878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895885788015610:7977], now have 1 active actors on pipe
2025-09-30T14:55:02.470142Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:02.470222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:02.470226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895885788015610:7977]
2025-09-30T14:55:02.470253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:02.470341Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:02.470360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1727 reason: error at write: Disconnected sessionId: src_id|7295cd2d-a9e15c22-e8b73965-e698dfed_0
2025-09-30T14:55:02.470593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1727 sessionId: src_id|7295cd2d-a9e15c22-e8b73965-e698dfed_0 is DEAD
2025-09-30T14:55:02.470784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7295cd2d-a9e15c22-e8b73965-e698dfed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:02.470799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7295cd2d-a9e15c22-e8b73965-e698dfed_0] Write session will restart in 0.005074s
2025-09-30T14:55:02.470830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7295cd2d-a9e15c22-e8b73965-e698dfed_0] Write session: Do CDS request
2025-09-30T14:55:02.470840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7295cd2d-a9e15c22-e8b73965-e698dfed_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:02.476975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7295cd2d-a9e15c22-e8b73965-e698dfed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:02.477036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:02.477059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1728
2025-09-30T14:55:02.477252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1728 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:02.477301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1728 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:02.477308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1728 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:02.477313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:02.477921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1728 sessionId:  describe result for acl check
2025-09-30T14:55:02.477978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:02.477987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:02.477989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:02.477997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895885788015631:7753] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:02.478723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895885788015631:7753] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:02.479844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:02.481717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895885788015631:7753] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:02.482100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:02.482361Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:02.482373Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:02.482386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:02.482459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:02.482508Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895885698248078:10002]
2025-09-30T14:55:02.483207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:02.483593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:02.483660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:02.484012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:02.484102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:02.484104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:02.484105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:02.484107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:02.484108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:02.484109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:02.484110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:02.484112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:02.484113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:02.484118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:02.484119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.484120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.484121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.484122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:02.484123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:02.484130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:02.484140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:02.484145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:02.484149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:02.484153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:02.484157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:02.484161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:02.484165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:02.484170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:02.484175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:02.484180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.484184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.484188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.484191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:02.484195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:02.484203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:02.484211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:02.484217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:02.484222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:02.484227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:02.484232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:02.484237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:02.484242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:02.484249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:02.484254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:02.484265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:02.484270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:02.484275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:02.484281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:02.484286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:02.484294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:02.484299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:02.484304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:02.484308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:02.484314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:02.484318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.484321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.484325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.484329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.484333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.484337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.484342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:02.484349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:02.484354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:02.484373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:02.484419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:02.485110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895885788015631:7753] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:02.485131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895885788015631:7753] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:02.485137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895885788015631:7753] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:02.485146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1728 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:02.490493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:02.491702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:02.491720Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:02.491723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:02.491731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:02.491740Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1727 [2:7555895885698248078:10002]
2025-09-30T14:55:02.491760Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:02.491782Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:02.491786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:02.491790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:02.491793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:02.491811Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:02.491817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:02.491825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:02.491892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.491904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.491906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.491910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:02.491912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:02.491987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:02.491996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.492010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.492022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.492038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:02.492057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895885788015675:7753], now have 1 active actors on pipe
2025-09-30T14:55:02.492065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895885788015611:2454], now have 1 active actors on pipe
2025-09-30T14:55:02.492072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895885698248072:10002]
2025-09-30T14:55:02.492074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895885698248072:10002]
2025-09-30T14:55:02.492076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895885698248072:10002]
2025-09-30T14:55:02.492089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:02.492101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:02.492104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:02.492105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:02.492106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:02.492120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:02.492126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:02.492167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895885698248072:10002]
2025-09-30T14:55:02.492180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:02.492203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:02.492166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1727
2025-09-30T14:55:02.492206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1727
2025-09-30T14:55:02.492383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:02.492400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:02.492435Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8de10902-b33c5f6-78b56d7b-5e3bfc87_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:02.492452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:02.492461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:02.492463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:02.492476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:02.492494Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:02.492512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:02.492760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:02.492770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:02.492785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:02.492922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1728 partition: 0 MaxSeqNo: 42 sessionId: src_id|8de10902-b33c5f6-78b56d7b-5e3bfc87_0
2025-09-30T14:55:02.493476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7295cd2d-a9e15c22-e8b73965-e698dfed_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8de10902-b33c5f6-78b56d7b-5e3bfc87_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:02.497095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8de10902-b33c5f6-78b56d7b-5e3bfc87_0] Write session: try to update token
2025-09-30T14:55:02.497123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8de10902-b33c5f6-78b56d7b-5e3bfc87_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:02.504664Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:02.504687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:02.504699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895885698248072:10002]
2025-09-30T14:55:02.504754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:02.504754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:02.504956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:02.505218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:02.505409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:02.505570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:02.505816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:02.505887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:02.516158Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:02.516180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:02.516183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:02.516185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:02.516201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895885698248072:10002]
2025-09-30T14:55:02.516206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895885698248072:10002]
2025-09-30T14:55:02.516211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895885698248072:10002]
2025-09-30T14:55:02.516254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:02.516262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.516267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:02.516266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:02.516274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:02.516292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:02.516418Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:02.520877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1728 sessionId: src_id|8de10902-b33c5f6-78b56d7b-5e3bfc87_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:02.523936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:02.570182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895885788015683:7977]
2025-09-30T14:55:02.570548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1727, pipe: [1:7555895885788015683:7977]
2025-09-30T14:55:02.632348Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:02.632802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:02.632821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:02.632843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895885788015683:7977], now have 1 active actors on pipe
2025-09-30T14:55:02.633085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:02.633093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895885788015683:7977]
2025-09-30T14:55:02.633105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:02.633117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:02.633148Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:02.633174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1728 reason: error at write: Disconnected sessionId: src_id|8de10902-b33c5f6-78b56d7b-5e3bfc87_0
2025-09-30T14:55:02.633377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1728 sessionId: src_id|8de10902-b33c5f6-78b56d7b-5e3bfc87_0 is DEAD
2025-09-30T14:55:02.633513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8de10902-b33c5f6-78b56d7b-5e3bfc87_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:02.633525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8de10902-b33c5f6-78b56d7b-5e3bfc87_0] Write session will restart in 0.006839s
2025-09-30T14:55:02.633548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8de10902-b33c5f6-78b56d7b-5e3bfc87_0] Write session: Do CDS request
2025-09-30T14:55:02.633554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8de10902-b33c5f6-78b56d7b-5e3bfc87_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:02.641533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:02.641892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8de10902-b33c5f6-78b56d7b-5e3bfc87_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:02.641977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:02.641998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1729
2025-09-30T14:55:02.642122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1729 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:02.642157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1729 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:02.642167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1729 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:02.642172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:02.642663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1729 sessionId:  describe result for acl check
2025-09-30T14:55:02.642703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:02.642711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:02.642713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:02.642720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895885788015725:7752] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:02.643338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895885788015725:7752] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:02.643500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:02.643774Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:02.643785Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:02.643797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:02.643858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:02.643902Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895885698248153:10005]
2025-09-30T14:55:02.644544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:02.644900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:02.644953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:02.645303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:02.645380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:02.645386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:02.645388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:02.645389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:02.645390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:02.645391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:02.645393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:02.645394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:02.645395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:02.645396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:02.645397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.645398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.645399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.645400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:02.645401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:02.645407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:02.645417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:02.645421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:02.645427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:02.645430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:02.645434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:02.645438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:02.645442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:02.645447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:02.645453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:02.645457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.645461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.645467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895885788015725:7752] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:02.645466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.645471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:02.645475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:02.645482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:02.645493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:02.645500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:02.645506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:02.645511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:02.645516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:02.645521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:02.645527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:02.645532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:02.645538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:02.645543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:02.645549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:02.645554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:02.645562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:02.645571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:02.645578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:02.645588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:02.645593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:02.645600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:02.645606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:02.645611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.645616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.645623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.645634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.645639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.645647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.645651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:02.645656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:02.645660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:02.645665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:02.645720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:02.651232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895885788015725:7752] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:02.651272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895885788015725:7752] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:02.651276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895885788015725:7752] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:02.651287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1729 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:02.651692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:02.652764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:02.652786Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:02.652791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:02.652795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:02.652803Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1728 [2:7555895885698248153:10005]
2025-09-30T14:55:02.652815Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:02.652827Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:02.652831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:02.652833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:02.652834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:02.652846Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:02.652852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:02.652859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:02.652925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.652936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.652938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.652943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:02.652945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:02.653004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:02.653009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.653020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.653032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.653056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:02.653077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895885788015698:2454], now have 1 active actors on pipe
2025-09-30T14:55:02.653080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895885788015764:7752], now have 1 active actors on pipe
2025-09-30T14:55:02.653085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895885698248148:10005]
2025-09-30T14:55:02.653086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895885698248148:10005]
2025-09-30T14:55:02.653090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895885698248148:10005]
2025-09-30T14:55:02.653101Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:02.653111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:02.653119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:02.653121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:02.653123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:02.653123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:02.653125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:02.653152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895885698248148:10005]
2025-09-30T14:55:02.653159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:02.653167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:02.653208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1728
2025-09-30T14:55:02.653221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1728
2025-09-30T14:55:02.653308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:02.653319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:02.653347Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|751d7ea4-2838eb03-65cc0e9a-cff05d55_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:02.653354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:02.653363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:02.653365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:02.653376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:02.653389Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:02.653407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:02.653564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:02.653573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:02.653586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:02.653659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1729 partition: 0 MaxSeqNo: 42 sessionId: src_id|751d7ea4-2838eb03-65cc0e9a-cff05d55_0
2025-09-30T14:55:02.654111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8de10902-b33c5f6-78b56d7b-5e3bfc87_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|751d7ea4-2838eb03-65cc0e9a-cff05d55_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:02.657413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|751d7ea4-2838eb03-65cc0e9a-cff05d55_0] Write session: try to update token
2025-09-30T14:55:02.657435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|751d7ea4-2838eb03-65cc0e9a-cff05d55_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:02.666164Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:02.666181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:02.666183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:02.666184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:02.666194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895885698248148:10005]
2025-09-30T14:55:02.666202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895885698248148:10005]
2025-09-30T14:55:02.666210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895885698248148:10005]
2025-09-30T14:55:02.666259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:02.666271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:02.666274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.666276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:02.666278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:02.666283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:02.666425Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:02.673914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1729 sessionId: src_id|751d7ea4-2838eb03-65cc0e9a-cff05d55_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:02.676854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:02.733495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895885788015784:7977]
2025-09-30T14:55:02.733706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1728, pipe: [1:7555895885788015784:7977]
2025-09-30T14:55:02.786770Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:02.787259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:02.787275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:02.787295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895885788015784:7977], now have 1 active actors on pipe
2025-09-30T14:55:02.787562Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:02.787570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895885788015784:7977]
2025-09-30T14:55:02.787614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:02.787616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:02.787709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1729 reason: error at write: Disconnected sessionId: src_id|751d7ea4-2838eb03-65cc0e9a-cff05d55_0
2025-09-30T14:55:02.787811Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:02.787894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1729 sessionId: src_id|751d7ea4-2838eb03-65cc0e9a-cff05d55_0 is DEAD
2025-09-30T14:55:02.788213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|751d7ea4-2838eb03-65cc0e9a-cff05d55_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:02.788224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|751d7ea4-2838eb03-65cc0e9a-cff05d55_0] Write session will restart in 0.009432s
2025-09-30T14:55:02.788248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|751d7ea4-2838eb03-65cc0e9a-cff05d55_0] Write session: Do CDS request
2025-09-30T14:55:02.788257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|751d7ea4-2838eb03-65cc0e9a-cff05d55_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:02.796265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:02.798130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:02.798365Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:02.798377Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:02.798388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:02.798460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:02.798508Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895885698248256:10020]
2025-09-30T14:55:02.798869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|751d7ea4-2838eb03-65cc0e9a-cff05d55_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:02.798948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:02.798967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1730
2025-09-30T14:55:02.799123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1730 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:02.799156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1730 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:02.799166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1730 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:02.799171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:02.799239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:02.799600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:02.799663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:02.799629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1730 sessionId:  describe result for acl check
2025-09-30T14:55:02.799667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:02.799670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:02.799671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:02.799677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895885788015824:7732] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:02.800012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:02.800085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:02.800091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:02.800093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:02.800096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:02.800098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:02.800099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:02.800100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:02.800101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:02.800103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:02.800104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:02.800105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.800106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.800107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.800108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:02.800109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:02.800116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:02.800127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:02.800132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:02.800136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:02.800141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:02.800146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:02.800150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:02.800155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:02.800159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:02.800164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:02.800169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.800174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.800179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.800183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:02.800188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:02.800196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:02.800204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:02.800211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:02.800218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:02.800224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:02.800230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:02.800234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:02.800240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:02.800245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:02.800251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:02.800256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:02.800262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:02.800268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:02.800275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:02.800279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:02.800285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:02.800290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:02.800305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:02.800266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895885788015824:7732] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:02.800310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:02.800317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:02.800322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.800327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.800333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.800339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.800350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.800355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.800360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:02.800365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:02.800371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:02.800376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:02.800429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:02.802512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895885788015824:7732] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:02.805841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895885788015824:7732] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:02.805858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895885788015824:7732] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:02.805863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895885788015824:7732] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:02.805872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1730 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:02.806343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:02.807500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:02.807521Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:02.807524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:02.807531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:02.807538Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1729 [2:7555895885698248256:10020]
2025-09-30T14:55:02.807555Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:02.807572Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:02.807576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:02.807579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:02.807582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:02.807599Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:02.807612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:02.807619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:02.807682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.807690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.807692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.807696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:02.807699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:02.807769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:02.807778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.807793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.807807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.807833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:02.807855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895885698248251:10020]
2025-09-30T14:55:02.807863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895885698248251:10020]
2025-09-30T14:55:02.807865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895885698248251:10020]
2025-09-30T14:55:02.807876Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:02.807886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:02.807892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895885788015794:2454], now have 1 active actors on pipe
2025-09-30T14:55:02.807898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:02.807899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:02.807901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:02.807916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:02.807918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:02.807924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895885788015859:7732], now have 1 active actors on pipe
2025-09-30T14:55:02.807958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895885698248251:10020]
2025-09-30T14:55:02.807973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:02.807974Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1729
2025-09-30T14:55:02.808000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:02.808003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1729
2025-09-30T14:55:02.808041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:02.808053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:02.808082Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96388b9b-55b89f3e-c1bd5338-20214768_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:02.808096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:02.808100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:02.808102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:02.808112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:02.808121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:02.808136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:02.808306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:02.808321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:02.808343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:02.808451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1730 partition: 0 MaxSeqNo: 42 sessionId: src_id|96388b9b-55b89f3e-c1bd5338-20214768_0
2025-09-30T14:55:02.808863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|751d7ea4-2838eb03-65cc0e9a-cff05d55_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|96388b9b-55b89f3e-c1bd5338-20214768_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:02.811980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96388b9b-55b89f3e-c1bd5338-20214768_0] Write session: try to update token
2025-09-30T14:55:02.812000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96388b9b-55b89f3e-c1bd5338-20214768_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:02.820698Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:02.820719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:02.820729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895885698248251:10020]
2025-09-30T14:55:02.820772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:02.820795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:02.820964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:02.821118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:02.821283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:02.821452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:02.821703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:02.821766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:02.827968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1730 sessionId: src_id|96388b9b-55b89f3e-c1bd5338-20214768_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:02.830893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:02.832140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:02.832168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:02.832188Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:02.832191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:02.832194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:02.832197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:02.832206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895885698248251:10020]
2025-09-30T14:55:02.832210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895885698248251:10020]
2025-09-30T14:55:02.832215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895885698248251:10020]
2025-09-30T14:55:02.832267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:02.832271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:02.832279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:02.832280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.832282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:02.832283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:02.832423Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:02.887618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895885788015868:7977]
2025-09-30T14:55:02.887924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1729, pipe: [1:7555895885788015868:7977]
2025-09-30T14:55:02.947266Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:02.947630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:02.947673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895885788015868:7977], now have 1 active actors on pipe
2025-09-30T14:55:02.947793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:02.947873Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:02.947929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895885788015868:7977]
2025-09-30T14:55:02.947945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:02.947952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:02.947970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1730 reason: error at write: Disconnected sessionId: src_id|96388b9b-55b89f3e-c1bd5338-20214768_0
2025-09-30T14:55:02.948113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1730 sessionId: src_id|96388b9b-55b89f3e-c1bd5338-20214768_0 is DEAD
2025-09-30T14:55:02.948258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96388b9b-55b89f3e-c1bd5338-20214768_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:02.948269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96388b9b-55b89f3e-c1bd5338-20214768_0] Write session will restart in 0.007718s
2025-09-30T14:55:02.948293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96388b9b-55b89f3e-c1bd5338-20214768_0] Write session: Do CDS request
2025-09-30T14:55:02.948299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96388b9b-55b89f3e-c1bd5338-20214768_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:02.956768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:02.956855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96388b9b-55b89f3e-c1bd5338-20214768_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:02.956876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:02.956891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1731
2025-09-30T14:55:02.957094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1731 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:02.957120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1731 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:02.957130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1731 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:02.957134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:02.957467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1731 sessionId:  describe result for acl check
2025-09-30T14:55:02.957493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:02.957496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:02.957497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:02.957502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895885788015900:7727] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:02.957977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895885788015900:7727] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:02.958430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:02.958622Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:02.958631Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:02.958641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:02.958697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:02.958738Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895885698248322:10022]
2025-09-30T14:55:02.959337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:02.959635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:02.959698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:02.960060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:02.960054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895885788015900:7727] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:02.960131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:02.960138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:02.960139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:02.960140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:02.960142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:02.960143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:02.960145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:02.960146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:02.960148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:02.960149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:02.960150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.960151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.960154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.960155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:02.960156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:02.960163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:02.960174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:02.960192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:02.960196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:02.960200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:02.960205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:02.960209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:02.960215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:02.960219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:02.960223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:02.960227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.960231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.960234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.960238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:02.960242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:02.960249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:02.960258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:02.960263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:02.960268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:02.960273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:02.960279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:02.960283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:02.960288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:02.960293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:02.960298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:02.960304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:02.960309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:02.960319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:02.960324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:02.960329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:02.960338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:02.960344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:02.960349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:02.960355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:02.960360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:02.960366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.960374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.960379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.960386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.960391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.960401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.960405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:02.960410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:02.960414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:02.960418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:02.960463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:02.965697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895885788015900:7727] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:02.965720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895885788015900:7727] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:02.965724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895885788015900:7727] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:02.965735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1731 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:02.965990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:02.966929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:02.966945Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:02.966947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:02.966950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:02.966956Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1730 [2:7555895885698248322:10022]
2025-09-30T14:55:02.966971Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:02.966984Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:02.966986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:02.966988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:02.966993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:02.967009Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:02.967018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:02.967024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:02.967174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.967185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.967187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.967191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:02.967194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:02.967297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:02.967304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.967320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:02.967332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:02.967352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:02.967392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895885788015869:2454], now have 1 active actors on pipe
2025-09-30T14:55:02.967397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895885788015936:7727], now have 1 active actors on pipe
2025-09-30T14:55:02.967404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895885698248317:10022]
2025-09-30T14:55:02.967406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895885698248317:10022]
2025-09-30T14:55:02.967408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895885698248317:10022]
2025-09-30T14:55:02.967423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:02.967440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:02.967462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:02.967470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:02.967458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1730
2025-09-30T14:55:02.967487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:02.967500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:02.967503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:02.967481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1730
2025-09-30T14:55:02.967506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895885698248317:10022]
2025-09-30T14:55:02.967508Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:02.967511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:02.967555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:02.967564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:02.967592Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56551cd2-ee412e89-65d4363-6242ecc7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:02.967603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:02.967610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:02.967616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:02.967627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:02.967641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:02.967660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:02.967834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:02.967851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:02.967877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:02.967995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1731 partition: 0 MaxSeqNo: 42 sessionId: src_id|56551cd2-ee412e89-65d4363-6242ecc7_0
2025-09-30T14:55:02.968295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96388b9b-55b89f3e-c1bd5338-20214768_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|56551cd2-ee412e89-65d4363-6242ecc7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:02.971417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56551cd2-ee412e89-65d4363-6242ecc7_0] Write session: try to update token
2025-09-30T14:55:02.971441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56551cd2-ee412e89-65d4363-6242ecc7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:02.979840Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:02.979862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:02.979873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895885698248317:10022]
2025-09-30T14:55:02.979923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:02.979929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:02.980111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:02.980267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:02.980429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:02.980596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:02.980815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:02.980864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:02.988073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1731 sessionId: src_id|56551cd2-ee412e89-65d4363-6242ecc7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:02.991060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:02.991060Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:02.991082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:02.991085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:02.991087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:02.991098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895885698248317:10022]
2025-09-30T14:55:02.991103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895885698248317:10022]
2025-09-30T14:55:02.991110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895885698248317:10022]
2025-09-30T14:55:02.991152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:02.991156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:02.991158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:02.991161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:02.991161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:02.991164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:02.991343Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:03.047890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895890082983240:7977]
2025-09-30T14:55:03.048187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1730, pipe: [1:7555895890082983240:7977]
2025-09-30T14:55:03.106695Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:03.107120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:03.107140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:03.107175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895890082983240:7977], now have 1 active actors on pipe
2025-09-30T14:55:03.107410Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:03.107474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895890082983240:7977]
2025-09-30T14:55:03.107481Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:03.107512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:03.107597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1731 reason: status is not ok: tablet will be restarted right now sessionId: src_id|56551cd2-ee412e89-65d4363-6242ecc7_0
2025-09-30T14:55:03.107805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1731 sessionId: src_id|56551cd2-ee412e89-65d4363-6242ecc7_0 is DEAD
2025-09-30T14:55:03.107935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56551cd2-ee412e89-65d4363-6242ecc7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:03.107947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56551cd2-ee412e89-65d4363-6242ecc7_0] Write session will restart in 0.005308s
2025-09-30T14:55:03.107971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56551cd2-ee412e89-65d4363-6242ecc7_0] Write session: Do CDS request
2025-09-30T14:55:03.107977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56551cd2-ee412e89-65d4363-6242ecc7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:03.114816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56551cd2-ee412e89-65d4363-6242ecc7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:03.114887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:03.114903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1732
2025-09-30T14:55:03.114906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:03.115069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1732 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:03.115094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1732 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:03.115101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1732 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:03.115105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:03.115486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1732 sessionId:  describe result for acl check
2025-09-30T14:55:03.115520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:03.115525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:03.115526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:03.115532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895890082983280:7706] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:03.116039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895890082983280:7706] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:03.116622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:03.116851Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:03.116860Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:03.116870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:03.116929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:03.116977Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895889993215685:10024]
2025-09-30T14:55:03.117593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:03.117854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895890082983280:7706] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:03.117909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:03.117955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:03.118217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:03.118282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:03.118287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:03.118288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:03.118288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:03.118289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:03.118290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:03.118291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:03.118292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:03.118293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:03.118293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:03.118294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.118295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.118296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.118296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:03.118297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:03.118301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:03.118308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:03.118311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:03.118314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:03.118316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:03.118318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:03.118321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:03.118323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:03.118328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:03.118331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:03.118333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.118335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.118339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.118342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:03.118346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:03.118352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:03.118361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:03.118366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:03.118371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:03.118376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:03.118382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:03.118386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:03.118393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:03.118398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:03.118404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:03.118409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:03.118416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:03.118420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:03.118425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:03.118430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:03.118434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:03.118440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:03.118444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:03.118447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:03.118452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:03.118456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.118460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.118464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.118468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.118473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.118477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.118481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:03.118486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:03.118490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:03.118495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:03.118536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:03.123925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895890082983280:7706] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:03.123944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895890082983280:7706] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:03.123947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895890082983280:7706] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:03.123956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1732 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:03.124283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:03.125253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:03.125272Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:03.125276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:03.125280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:03.125287Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1731 [2:7555895889993215685:10024]
2025-09-30T14:55:03.125309Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:03.125331Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:03.125339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:03.125343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:03.125345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:03.125364Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:03.125376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:03.125384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:03.125449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.125457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.125461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.125465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:03.125467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:03.125538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:03.125545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.125674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1731
2025-09-30T14:55:03.125700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1731
2025-09-30T14:55:03.125560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.125579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.125598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:03.125616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895890082983320:7706], now have 1 active actors on pipe
2025-09-30T14:55:03.125620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895890082983248:2454], now have 1 active actors on pipe
2025-09-30T14:55:03.125626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895889993215679:10024]
2025-09-30T14:55:03.125629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895889993215679:10024]
2025-09-30T14:55:03.125631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895889993215679:10024]
2025-09-30T14:55:03.125645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:03.125661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:03.125677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:03.125693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:03.125693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:03.125696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:03.125696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:03.125733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895889993215679:10024]
2025-09-30T14:55:03.125736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:03.125744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:03.125764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:03.125769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:03.125804Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cbc80892-28e4e7ba-368d16c4-febf833e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:03.125811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:03.125815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:03.125817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:03.125827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:03.125837Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:03.125937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:03.126100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:03.126105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:03.126123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:03.126205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1732 partition: 0 MaxSeqNo: 42 sessionId: src_id|cbc80892-28e4e7ba-368d16c4-febf833e_0
2025-09-30T14:55:03.126593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56551cd2-ee412e89-65d4363-6242ecc7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cbc80892-28e4e7ba-368d16c4-febf833e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:03.129449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc80892-28e4e7ba-368d16c4-febf833e_0] Write session: try to update token
2025-09-30T14:55:03.129466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc80892-28e4e7ba-368d16c4-febf833e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:03.138856Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:03.138881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:03.138889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:03.138891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:03.138901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895889993215679:10024]
2025-09-30T14:55:03.138909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895889993215679:10024]
2025-09-30T14:55:03.138913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895889993215679:10024]
2025-09-30T14:55:03.138955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:03.138964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.138967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:03.138973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:03.138973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:03.138979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:03.139138Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:03.149753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1732 sessionId: src_id|cbc80892-28e4e7ba-368d16c4-febf833e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:03.152648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:03.207627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895890082983332:7977]
2025-09-30T14:55:03.207954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1731, pipe: [1:7555895890082983332:7977]
2025-09-30T14:55:03.258821Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:03.259230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:03.259266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:03.259287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895890082983332:7977], now have 1 active actors on pipe
2025-09-30T14:55:03.259539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895890082983332:7977]
2025-09-30T14:55:03.259545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:03.259549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:03.259558Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:03.259570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:03.259613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1732 reason: error at write: Disconnected sessionId: src_id|cbc80892-28e4e7ba-368d16c4-febf833e_0
2025-09-30T14:55:03.259817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1732 sessionId: src_id|cbc80892-28e4e7ba-368d16c4-febf833e_0 is DEAD
2025-09-30T14:55:03.259956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc80892-28e4e7ba-368d16c4-febf833e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:03.259967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc80892-28e4e7ba-368d16c4-febf833e_0] Write session will restart in 0.005278s
2025-09-30T14:55:03.259992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc80892-28e4e7ba-368d16c4-febf833e_0] Write session: Do CDS request
2025-09-30T14:55:03.259998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc80892-28e4e7ba-368d16c4-febf833e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:03.267599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:03.268105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc80892-28e4e7ba-368d16c4-febf833e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:03.268213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:03.268232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1733
2025-09-30T14:55:03.268382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1733 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:03.268417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1733 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:03.268427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1733 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:03.268432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:03.268923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1733 sessionId:  describe result for acl check
2025-09-30T14:55:03.268965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:03.268970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:03.268972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:03.268978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895890082983362:7702] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:03.269566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895890082983362:7702] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:03.269784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:03.270028Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:03.270033Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:03.270043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:03.270104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:03.270148Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895889993215752:10026]
2025-09-30T14:55:03.270851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:03.271123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:03.271203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:03.271641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895890082983362:7702] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:03.271687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:03.271770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:03.271779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:03.271780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:03.271782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:03.271783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:03.271785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:03.271790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:03.271792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:03.271793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:03.271795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:03.271796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.271797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.271799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.271800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:03.271802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:03.271809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:03.271819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:03.271823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:03.271828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:03.271831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:03.271835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:03.271838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:03.271842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:03.271846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:03.271851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:03.271854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.271858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.271861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.271866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:03.271870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:03.271879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:03.271887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:03.271892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:03.271897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:03.271901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:03.271906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:03.271910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:03.271917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:03.271922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:03.271927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:03.271931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:03.271936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:03.271942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:03.271946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:03.271950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:03.271955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:03.271959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:03.271964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:03.271968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:03.271974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:03.271979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.271983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.271990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.271995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.271999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.272004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.272008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:03.272013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:03.272017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:03.272022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:03.272081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:03.277590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895890082983362:7702] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:03.277613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895890082983362:7702] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:03.277617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895890082983362:7702] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:03.277627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1733 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:03.277989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:03.278982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:03.279001Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:03.279004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:03.279008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:03.279034Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1732 [2:7555895889993215752:10026]
2025-09-30T14:55:03.279053Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:03.279069Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:03.279075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:03.279078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:03.279081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:03.279099Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:03.279107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:03.279116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:03.279184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.279195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.279197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.279200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:03.279203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:03.279291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:03.279299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.279313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.279327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.279347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:03.279370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895890082983400:7702], now have 1 active actors on pipe
2025-09-30T14:55:03.279380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895890082983333:2454], now have 1 active actors on pipe
2025-09-30T14:55:03.279387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895889993215747:10026]
2025-09-30T14:55:03.279389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895889993215747:10026]
2025-09-30T14:55:03.279390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895889993215747:10026]
2025-09-30T14:55:03.279403Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:03.279417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:03.279420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:03.279424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:03.279426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:03.279438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:03.279441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:03.279476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895889993215747:10026]
2025-09-30T14:55:03.279464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1732
2025-09-30T14:55:03.279491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:03.279471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1732
2025-09-30T14:55:03.279508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:03.279623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:03.279636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:03.279666Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25401290-2aaa8776-b1f97be2-dcdd7bee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:03.279678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:03.279681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:03.279683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:03.279693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:03.279706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:03.279722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:03.279942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:03.279952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:03.279968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:03.280095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1733 partition: 0 MaxSeqNo: 42 sessionId: src_id|25401290-2aaa8776-b1f97be2-dcdd7bee_0
2025-09-30T14:55:03.280510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc80892-28e4e7ba-368d16c4-febf833e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|25401290-2aaa8776-b1f97be2-dcdd7bee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:03.283807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25401290-2aaa8776-b1f97be2-dcdd7bee_0] Write session: try to update token
2025-09-30T14:55:03.283829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25401290-2aaa8776-b1f97be2-dcdd7bee_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:03.292559Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:03.292582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:03.292585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:03.292587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:03.292597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895889993215747:10026]
2025-09-30T14:55:03.292605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895889993215747:10026]
2025-09-30T14:55:03.292609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895889993215747:10026]
2025-09-30T14:55:03.292658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:03.292670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.292673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:03.292681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:03.292689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:03.292694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:03.292831Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:03.300585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1733 sessionId: src_id|25401290-2aaa8776-b1f97be2-dcdd7bee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:03.303678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:03.359709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895890082983409:7977]
2025-09-30T14:55:03.360031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1732, pipe: [1:7555895890082983409:7977]
2025-09-30T14:55:03.405616Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:03.405976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:03.405990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:03.406008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895890082983409:7977], now have 1 active actors on pipe
2025-09-30T14:55:03.406200Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:03.406286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:03.406311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:03.406331Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:03.406375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1733 reason: error at write: Disconnected sessionId: src_id|25401290-2aaa8776-b1f97be2-dcdd7bee_0
2025-09-30T14:55:03.406377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895890082983409:7977]
2025-09-30T14:55:03.406549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1733 sessionId: src_id|25401290-2aaa8776-b1f97be2-dcdd7bee_0 is DEAD
2025-09-30T14:55:03.406705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25401290-2aaa8776-b1f97be2-dcdd7bee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:03.406717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25401290-2aaa8776-b1f97be2-dcdd7bee_0] Write session will restart in 0.005018s
2025-09-30T14:55:03.406740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25401290-2aaa8776-b1f97be2-dcdd7bee_0] Write session: Do CDS request
2025-09-30T14:55:03.406752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25401290-2aaa8776-b1f97be2-dcdd7bee_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:03.412799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25401290-2aaa8776-b1f97be2-dcdd7bee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:03.412879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:03.412896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1734
2025-09-30T14:55:03.413027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1734 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:03.413058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1734 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:03.413069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1734 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:03.413073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:03.413512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1734 sessionId:  describe result for acl check
2025-09-30T14:55:03.413546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:03.413549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:03.413558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:03.413550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:03.413556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895890082983440:7701] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:03.414125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895890082983440:7701] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:03.415208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:03.415416Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:03.415427Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:03.415438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:03.415493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:03.415533Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895889993215823:10029]
2025-09-30T14:55:03.416178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:03.416275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895890082983440:7701] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:03.416518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:03.416563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:03.416901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:03.416957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:03.416963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:03.416964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:03.416965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:03.416966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:03.416968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:03.416969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:03.416970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:03.416971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:03.416972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:03.416973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.416974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.416975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.416976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:03.416977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:03.416982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:03.416993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:03.416997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:03.417002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:03.417009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:03.417014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:03.417018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:03.417023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:03.417027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:03.417032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:03.417036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.417039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.417043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.417048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:03.417052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:03.417061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:03.417069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:03.417075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:03.417081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:03.417091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:03.417099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:03.417103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:03.417109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:03.417114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:03.417120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:03.417125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:03.417130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:03.417141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:03.417147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:03.417156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:03.417162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:03.417171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:03.417177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:03.417186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:03.417192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:03.417200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.417205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.417214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.417220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.417229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.417235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.417243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:03.417249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:03.417258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:03.417264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:03.417328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:03.422601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895890082983440:7701] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:03.422622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895890082983440:7701] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:03.422626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895890082983440:7701] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:03.422636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1734 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:03.422772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:03.423773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:03.423789Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:03.423792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:03.423796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:03.423802Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1733 [2:7555895889993215823:10029]
2025-09-30T14:55:03.423818Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:03.423832Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:03.423836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:03.423839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:03.423841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:03.423858Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:03.423864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:03.423872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:03.423928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.423935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.423937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.423940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:03.423942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:03.424010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:03.424018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.424030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.424045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.424066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:03.424087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895890082983480:7701], now have 1 active actors on pipe
2025-09-30T14:55:03.424096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895890082983410:2454], now have 1 active actors on pipe
2025-09-30T14:55:03.424102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895889993215818:10029]
2025-09-30T14:55:03.424108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895889993215818:10029]
2025-09-30T14:55:03.424110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895889993215818:10029]
2025-09-30T14:55:03.424122Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:03.424142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:03.424145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:03.424149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:03.424151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:03.424159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:03.424162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:03.424140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1733
2025-09-30T14:55:03.424149Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1733
2025-09-30T14:55:03.424192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895889993215818:10029]
2025-09-30T14:55:03.424202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:03.424209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:03.424257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:03.424267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:03.424293Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ba3a3c1-9f7b984d-7c2eb1de-e4ba456d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:03.424305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:03.424312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:03.424314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:03.424324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:03.424339Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:03.424355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:03.424509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:03.424518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:03.424533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:03.424619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1734 partition: 0 MaxSeqNo: 42 sessionId: src_id|9ba3a3c1-9f7b984d-7c2eb1de-e4ba456d_0
2025-09-30T14:55:03.424945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25401290-2aaa8776-b1f97be2-dcdd7bee_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9ba3a3c1-9f7b984d-7c2eb1de-e4ba456d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:03.427854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ba3a3c1-9f7b984d-7c2eb1de-e4ba456d_0] Write session: try to update token
2025-09-30T14:55:03.427877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ba3a3c1-9f7b984d-7c2eb1de-e4ba456d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:03.436360Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:03.436379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:03.436389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895889993215818:10029]
2025-09-30T14:55:03.436434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:03.436435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:03.436829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:03.436998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:03.437168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:03.437327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:03.437538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:03.437586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:03.443689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1734 sessionId: src_id|9ba3a3c1-9f7b984d-7c2eb1de-e4ba456d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:03.446623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:03.447155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:03.447178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:03.447196Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:03.447199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:03.447201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:03.447202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:03.447210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895889993215818:10029]
2025-09-30T14:55:03.447218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895889993215818:10029]
2025-09-30T14:55:03.447220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895889993215818:10029]
2025-09-30T14:55:03.447268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:03.447278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:03.447282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:03.447283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:03.447289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.447290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:03.447417Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:03.506630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895890082983488:7977]
2025-09-30T14:55:03.506996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1733, pipe: [1:7555895890082983488:7977]
2025-09-30T14:55:03.555167Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:03.555471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:03.555504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895890082983488:7977], now have 1 active actors on pipe
2025-09-30T14:55:03.555634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:03.555678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:03.555741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895890082983488:7977]
2025-09-30T14:55:03.555751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:03.555755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:03.555826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1734 reason: error at write: Disconnected sessionId: src_id|9ba3a3c1-9f7b984d-7c2eb1de-e4ba456d_0
2025-09-30T14:55:03.555965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1734 sessionId: src_id|9ba3a3c1-9f7b984d-7c2eb1de-e4ba456d_0 is DEAD
2025-09-30T14:55:03.556124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ba3a3c1-9f7b984d-7c2eb1de-e4ba456d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:03.556136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ba3a3c1-9f7b984d-7c2eb1de-e4ba456d_0] Write session will restart in 0.006157s
2025-09-30T14:55:03.556162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ba3a3c1-9f7b984d-7c2eb1de-e4ba456d_0] Write session: Do CDS request
2025-09-30T14:55:03.556169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ba3a3c1-9f7b984d-7c2eb1de-e4ba456d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:03.563767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ba3a3c1-9f7b984d-7c2eb1de-e4ba456d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:03.563854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:03.563880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1735
2025-09-30T14:55:03.564003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1735 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:03.564038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1735 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:03.564050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1735 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:03.564055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:03.564123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:03.564527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1735 sessionId:  describe result for acl check
2025-09-30T14:55:03.564576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:03.564584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:03.564587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:03.564593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895890082983521:7696] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:03.565199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895890082983521:7696] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:03.565689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:03.565857Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:03.565867Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:03.565877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:03.565927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:03.565982Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895889993215905:10032]
2025-09-30T14:55:03.566628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:03.566948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:03.566996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:03.567301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895890082983521:7696] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:03.567390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:03.567458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:03.567467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:03.567468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:03.567469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:03.567471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:03.567472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:03.567473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:03.567474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:03.567475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:03.567476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:03.567477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.567478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.567479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.567480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:03.567481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:03.567486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:03.567497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:03.567501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:03.567505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:03.567508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:03.567512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:03.567516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:03.567520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:03.567524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:03.567529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:03.567534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.567538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.567542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.567546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:03.567551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:03.567559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:03.567569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:03.567574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:03.567580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:03.567585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:03.567591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:03.567595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:03.567601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:03.567606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:03.567611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:03.567616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:03.567627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:03.567632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:03.567641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:03.567645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:03.567649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:03.567657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:03.567665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:03.567669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:03.567674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:03.567682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.567688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.567696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.567701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.567706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.567716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.567720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:03.567729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:03.567733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:03.567738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:03.567788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:03.572787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895890082983521:7696] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:03.572808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895890082983521:7696] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:03.572812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895890082983521:7696] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:03.572822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1735 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:03.573130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:03.574043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:03.574062Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:03.574069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:03.574073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:03.574081Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1734 [2:7555895889993215905:10032]
2025-09-30T14:55:03.574099Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:03.574114Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:03.574117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:03.574120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:03.574122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:03.574138Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:03.574149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:03.574158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:03.574216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.574224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.574226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.574229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:03.574232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:03.574303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:03.574310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.574320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.574332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.574349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:03.574370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895890082983560:7696], now have 1 active actors on pipe
2025-09-30T14:55:03.574376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895890082983489:2454], now have 1 active actors on pipe
2025-09-30T14:55:03.574381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895889993215900:10032]
2025-09-30T14:55:03.574382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895889993215900:10032]
2025-09-30T14:55:03.574383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895889993215900:10032]
2025-09-30T14:55:03.574395Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:03.574407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:03.574419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:03.574420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:03.574422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:03.574428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:03.574431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:03.574449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895889993215900:10032]
2025-09-30T14:55:03.574454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:03.574469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:03.574451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1734
2025-09-30T14:55:03.574479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1734
2025-09-30T14:55:03.574563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:03.574573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:03.574606Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|431b7733-fc3774cb-a803ea22-80329131_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:03.574618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:03.574621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:03.574623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:03.574634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:03.574648Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:03.574665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:03.574787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:03.574794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:03.574807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:03.574890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1735 partition: 0 MaxSeqNo: 42 sessionId: src_id|431b7733-fc3774cb-a803ea22-80329131_0
2025-09-30T14:55:03.575233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ba3a3c1-9f7b984d-7c2eb1de-e4ba456d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|431b7733-fc3774cb-a803ea22-80329131_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:03.578293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|431b7733-fc3774cb-a803ea22-80329131_0] Write session: try to update token
2025-09-30T14:55:03.578316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|431b7733-fc3774cb-a803ea22-80329131_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:03.586780Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:03.586799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:03.586806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:03.586808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:03.586819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895889993215900:10032]
2025-09-30T14:55:03.586824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895889993215900:10032]
2025-09-30T14:55:03.586836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895889993215900:10032]
2025-09-30T14:55:03.586878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:03.586885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.586893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:03.586904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:03.586912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:03.586916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:03.587034Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:03.594601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1735 sessionId: src_id|431b7733-fc3774cb-a803ea22-80329131_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:03.597625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:03.656135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895890082983582:7977]
2025-09-30T14:55:03.656410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1734, pipe: [1:7555895890082983582:7977]
2025-09-30T14:55:03.697772Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:03.698155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:03.698169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:03.698185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895890082983582:7977], now have 1 active actors on pipe
2025-09-30T14:55:03.698377Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:03.698457Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:03.698493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895890082983582:7977]
2025-09-30T14:55:03.698515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:03.698591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1735 reason: status is not ok: tablet will be restarted right now sessionId: src_id|431b7733-fc3774cb-a803ea22-80329131_0
2025-09-30T14:55:03.698764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1735 sessionId: src_id|431b7733-fc3774cb-a803ea22-80329131_0 is DEAD
2025-09-30T14:55:03.698910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|431b7733-fc3774cb-a803ea22-80329131_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:03.698920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|431b7733-fc3774cb-a803ea22-80329131_0] Write session will restart in 0.007266s
2025-09-30T14:55:03.698946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|431b7733-fc3774cb-a803ea22-80329131_0] Write session: Do CDS request
2025-09-30T14:55:03.698952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|431b7733-fc3774cb-a803ea22-80329131_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:03.706239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:03.707736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:03.707782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|431b7733-fc3774cb-a803ea22-80329131_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:03.707934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:03.707956Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:03.707952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1736
2025-09-30T14:55:03.707967Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:03.707977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:03.708031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:03.708077Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895889993215976:10034]
2025-09-30T14:55:03.708088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1736 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:03.708121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1736 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:03.708132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1736 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:03.708137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:03.708644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1736 sessionId:  describe result for acl check
2025-09-30T14:55:03.708679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:03.708681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:03.708683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:03.708689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895890082983616:7681] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:03.708693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:03.709064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:03.709138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:03.709248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895890082983616:7681] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:03.709505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:03.709562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:03.709567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:03.709568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:03.709569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:03.709570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:03.709571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:03.709572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:03.709573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:03.709574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:03.709575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:03.709577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.709580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.709581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.709582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:03.709584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:03.709591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:03.709601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:03.709606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:03.709610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:03.709617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:03.709620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:03.709623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:03.709625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:03.709628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:03.709631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:03.709633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.709635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.709638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.709640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:03.709643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:03.709649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:03.709654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:03.709658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:03.709662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:03.709665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:03.709668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:03.709671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:03.709674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:03.709691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:03.709694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:03.709696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:03.709701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:03.709707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:03.709711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:03.709717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:03.709722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:03.709726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:03.709731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:03.709736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:03.709741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:03.709746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.709752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.709756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.709761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.709766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.709770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.709773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:03.709778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:03.709782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:03.709788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:03.709823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:03.711229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895890082983616:7681] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:03.714915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895890082983616:7681] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:03.714942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895890082983616:7681] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:03.714945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895890082983616:7681] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:03.714953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1736 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:03.715378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:03.716446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:03.716464Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:03.716467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:03.716473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:03.716479Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1735 [2:7555895889993215976:10034]
2025-09-30T14:55:03.716496Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:03.716514Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:03.716523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:03.716526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:03.716528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:03.716544Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:03.716551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:03.716565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:03.716630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.716637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.716639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.716642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:03.716645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:03.716710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:03.716719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.716731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.716748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.716771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:03.716795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895890082983583:2454], now have 1 active actors on pipe
2025-09-30T14:55:03.716803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895890082983655:7681], now have 1 active actors on pipe
2025-09-30T14:55:03.716810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895889993215971:10034]
2025-09-30T14:55:03.716812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895889993215971:10034]
2025-09-30T14:55:03.716814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895889993215971:10034]
2025-09-30T14:55:03.716826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:03.716844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:03.716847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:03.716851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:03.716853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:03.716863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:03.716862Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1735
2025-09-30T14:55:03.716866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:03.716901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895889993215971:10034]
2025-09-30T14:55:03.716908Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:03.716919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:03.716906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1735
2025-09-30T14:55:03.716946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:03.716955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:03.716984Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55d46bdc-1d867427-d8fbe0f5-27eb293b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:03.716994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:03.716998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:03.716999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:03.717007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:03.717018Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:03.717032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:03.717188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:03.717195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:03.717207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:03.717297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1736 partition: 0 MaxSeqNo: 42 sessionId: src_id|55d46bdc-1d867427-d8fbe0f5-27eb293b_0
2025-09-30T14:55:03.717655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|431b7733-fc3774cb-a803ea22-80329131_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|55d46bdc-1d867427-d8fbe0f5-27eb293b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:03.720682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55d46bdc-1d867427-d8fbe0f5-27eb293b_0] Write session: try to update token
2025-09-30T14:55:03.720703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55d46bdc-1d867427-d8fbe0f5-27eb293b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:03.729398Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:03.729416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:03.729421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:03.729423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:03.729432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895889993215971:10034]
2025-09-30T14:55:03.729435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895889993215971:10034]
2025-09-30T14:55:03.729438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895889993215971:10034]
2025-09-30T14:55:03.729473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:03.729476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:03.729479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.729482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:03.729482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:03.729485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:03.729618Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:03.736404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1736 sessionId: src_id|55d46bdc-1d867427-d8fbe0f5-27eb293b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:03.739196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:03.798484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895890082983684:7977]
2025-09-30T14:55:03.798787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1735, pipe: [1:7555895890082983684:7977]
2025-09-30T14:55:03.839045Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:03.839373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:03.839386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:03.839402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895890082983684:7977], now have 1 active actors on pipe
2025-09-30T14:55:03.839567Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:03.839667Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:03.839668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895890082983684:7977]
2025-09-30T14:55:03.839706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:03.839797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1736 reason: status is not ok: tablet will be restarted right now sessionId: src_id|55d46bdc-1d867427-d8fbe0f5-27eb293b_0
2025-09-30T14:55:03.840017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1736 sessionId: src_id|55d46bdc-1d867427-d8fbe0f5-27eb293b_0 is DEAD
2025-09-30T14:55:03.840178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55d46bdc-1d867427-d8fbe0f5-27eb293b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:03.840190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55d46bdc-1d867427-d8fbe0f5-27eb293b_0] Write session will restart in 0.006616s
2025-09-30T14:55:03.840215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55d46bdc-1d867427-d8fbe0f5-27eb293b_0] Write session: Do CDS request
2025-09-30T14:55:03.840229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55d46bdc-1d867427-d8fbe0f5-27eb293b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:03.847812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55d46bdc-1d867427-d8fbe0f5-27eb293b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:03.847812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:03.847880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:03.847896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1737
2025-09-30T14:55:03.848052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1737 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:03.848083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1737 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:03.848093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1737 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:03.848097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:03.848512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1737 sessionId:  describe result for acl check
2025-09-30T14:55:03.848552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:03.848559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:03.848562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:03.848569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895890082983720:7664] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:03.849106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895890082983720:7664] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:03.849496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:03.849714Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:03.849739Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:03.849752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:03.849817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:03.849862Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895889993216085:10049]
2025-09-30T14:55:03.850359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:03.850717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:03.850758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:03.850991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:03.851033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:03.851038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:03.851039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:03.851040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:03.851041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:03.851043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:03.851044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:03.851046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:03.851047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:03.851048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:03.851049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.851050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.851051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.851053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:03.851054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:03.851059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:03.851068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:03.851071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:03.851075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:03.851078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:03.851081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:03.851085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:03.851088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:03.851091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:03.851095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:03.851098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895890082983720:7664] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:03.851099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.851103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.851108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.851111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:03.851116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:03.851123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:03.851130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:03.851135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:03.851142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:03.851146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:03.851151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:03.851154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:03.851158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:03.851163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:03.851167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:03.851171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:03.851176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:03.851180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:03.851185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:03.851188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:03.851195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:03.851199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:03.851204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:03.851207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:03.851214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:03.851219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.851224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.851227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.851230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.851234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.851236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.851239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:03.851261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:03.851267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:03.851272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:03.851311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:03.856393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895890082983720:7664] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:03.856418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895890082983720:7664] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:03.856422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895890082983720:7664] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:03.856430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1737 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:03.856777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:03.857661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:03.857694Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:03.857700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:03.857704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:03.857712Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1736 [2:7555895889993216085:10049]
2025-09-30T14:55:03.857730Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:03.857750Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:03.857758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:03.857763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:03.857765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:03.857781Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:03.857791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:03.857797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:03.857862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.857870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.857873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.857876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:03.857879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:03.857950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:03.857959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.857973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:03.857986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:03.858005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:03.858028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895890082983686:2454], now have 1 active actors on pipe
2025-09-30T14:55:03.858037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895890082983759:7664], now have 1 active actors on pipe
2025-09-30T14:55:03.858044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895889993216080:10049]
2025-09-30T14:55:03.858047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895889993216080:10049]
2025-09-30T14:55:03.858049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895889993216080:10049]
2025-09-30T14:55:03.858077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1736
2025-09-30T14:55:03.858083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1736
2025-09-30T14:55:03.858175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:03.858196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:03.858200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:03.858202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:03.858204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:03.858215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:03.858218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:03.858239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:03.858248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:03.858294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895889993216080:10049]
2025-09-30T14:55:03.858314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:03.858332Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|157f996d-dacec01-e1a283c8-3553cc61_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:03.858338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:03.858339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:03.858343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:03.858345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:03.858355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:03.858363Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:03.858402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:03.858572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:03.858581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:03.858596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:03.858681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1737 partition: 0 MaxSeqNo: 42 sessionId: src_id|157f996d-dacec01-e1a283c8-3553cc61_0
2025-09-30T14:55:03.859063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55d46bdc-1d867427-d8fbe0f5-27eb293b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|157f996d-dacec01-e1a283c8-3553cc61_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:03.861944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|157f996d-dacec01-e1a283c8-3553cc61_0] Write session: try to update token
2025-09-30T14:55:03.861965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|157f996d-dacec01-e1a283c8-3553cc61_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:03.870929Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:03.870951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:03.870954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:03.870955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:03.870968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895889993216080:10049]
2025-09-30T14:55:03.870974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895889993216080:10049]
2025-09-30T14:55:03.870979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895889993216080:10049]
2025-09-30T14:55:03.871023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:03.871032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:03.871031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:03.871034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:03.871037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:03.871041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:03.871179Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:03.877291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1737 sessionId: src_id|157f996d-dacec01-e1a283c8-3553cc61_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:03.880113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:03.940462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895890082983766:7977]
2025-09-30T14:55:03.940770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1736, pipe: [1:7555895890082983766:7977]
2025-09-30T14:55:03.989817Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:03.990192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:03.990207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:03.990246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895890082983766:7977], now have 1 active actors on pipe
2025-09-30T14:55:03.990504Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:03.990542Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:03.990560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895890082983766:7977]
2025-09-30T14:55:03.990869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:03.990939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1737 reason: status is not ok: tablet will be restarted right now sessionId: src_id|157f996d-dacec01-e1a283c8-3553cc61_0
2025-09-30T14:55:03.991109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1737 sessionId: src_id|157f996d-dacec01-e1a283c8-3553cc61_0 is DEAD
2025-09-30T14:55:03.991268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|157f996d-dacec01-e1a283c8-3553cc61_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:03.991280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|157f996d-dacec01-e1a283c8-3553cc61_0] Write session will restart in 0.005301s
2025-09-30T14:55:03.991303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|157f996d-dacec01-e1a283c8-3553cc61_0] Write session: Do CDS request
2025-09-30T14:55:03.991308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|157f996d-dacec01-e1a283c8-3553cc61_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:03.997835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|157f996d-dacec01-e1a283c8-3553cc61_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:03.997972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:03.997991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1738
2025-09-30T14:55:03.998122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1738 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:03.998154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1738 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:03.998164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1738 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:03.998168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:03.998571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1738 sessionId:  describe result for acl check
2025-09-30T14:55:03.998612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:03.998618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:03.998620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:03.998626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895890082983802:7658] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:03.998873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:03.999158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895890082983802:7658] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:04.000857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:04.000918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895890082983802:7658] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:04.001028Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:04.001041Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:04.001053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:04.001098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:04.001130Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895894288183453:10051]
2025-09-30T14:55:04.001640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:04.001976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:04.002026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:04.002303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:04.002367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:04.002376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:04.002377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:04.002377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:04.002380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:04.002381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:04.002381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:04.002382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:04.002383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:04.002383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:04.002384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.002385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.002385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.002386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:04.002387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:04.002391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:04.002397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:04.002400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:04.002402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:04.002405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:04.002407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:04.002409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:04.002412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:04.002414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:04.002416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:04.002419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.002421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.002424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.002426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:04.002428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:04.002433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:04.002438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:04.002442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:04.002446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:04.002449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:04.002455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:04.002457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:04.002461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:04.002464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:04.002468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:04.002470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:04.002473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:04.002476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:04.002479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:04.002481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:04.002485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:04.002487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:04.002490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:04.002493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:04.002495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:04.002498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.002501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.002504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.002507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.002511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.002514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.002518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:04.002521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:04.002523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:04.002526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:04.002551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:04.003405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895890082983802:7658] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:04.003422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895890082983802:7658] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:04.003426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895890082983802:7658] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:04.003434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1738 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:04.008123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:04.009017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:04.009040Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:04.009043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:04.009047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:04.009055Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1737 [2:7555895894288183453:10051]
2025-09-30T14:55:04.009073Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:04.009095Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:04.009098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:04.009101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:04.009103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:04.009118Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:04.009131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:04.009139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:04.009210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.009221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.009223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.009227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:04.009229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:04.009297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:04.009307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.009322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.009341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.009360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:04.009383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895890082983768:2454], now have 1 active actors on pipe
2025-09-30T14:55:04.009392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895894377951138:7658], now have 1 active actors on pipe
2025-09-30T14:55:04.009399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895889993216152:10051]
2025-09-30T14:55:04.009401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895889993216152:10051]
2025-09-30T14:55:04.009403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895889993216152:10051]
2025-09-30T14:55:04.009414Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:04.009429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:04.009429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:04.009433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:04.009436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:04.009445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:04.009452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:04.009432Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1737
2025-09-30T14:55:04.009438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1737
2025-09-30T14:55:04.009508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:04.009518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:04.009531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895889993216152:10051]
2025-09-30T14:55:04.009543Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:04.009549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:04.009570Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dbf71b7e-23d254-179d00-127d0628_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:04.009585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:04.009588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:04.009590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:04.009600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:04.009609Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:04.009634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:04.009825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:04.009838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:04.009854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:04.009983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1738 partition: 0 MaxSeqNo: 42 sessionId: src_id|dbf71b7e-23d254-179d00-127d0628_0
2025-09-30T14:55:04.010369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|157f996d-dacec01-e1a283c8-3553cc61_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dbf71b7e-23d254-179d00-127d0628_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:04.013477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbf71b7e-23d254-179d00-127d0628_0] Write session: try to update token
2025-09-30T14:55:04.013501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbf71b7e-23d254-179d00-127d0628_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:04.022091Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:04.022109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:04.022111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:04.022116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:04.022125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895889993216152:10051]
2025-09-30T14:55:04.022128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895889993216152:10051]
2025-09-30T14:55:04.022131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895889993216152:10051]
2025-09-30T14:55:04.022171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:04.022182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.022183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:04.022190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:04.022191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:04.022194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:04.022335Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:04.029209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1738 sessionId: src_id|dbf71b7e-23d254-179d00-127d0628_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:04.032408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:04.090840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895894377951145:7977]
2025-09-30T14:55:04.091153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1737, pipe: [1:7555895894377951145:7977]
2025-09-30T14:55:04.132613Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:04.133052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:04.133067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:04.133087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895894377951145:7977], now have 1 active actors on pipe
2025-09-30T14:55:04.133326Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:04.133385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895894377951145:7977]
2025-09-30T14:55:04.133420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:04.133511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:04.133645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1738 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dbf71b7e-23d254-179d00-127d0628_0
2025-09-30T14:55:04.133977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbf71b7e-23d254-179d00-127d0628_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:04.133987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbf71b7e-23d254-179d00-127d0628_0] Write session will restart in 0.008839s
2025-09-30T14:55:04.134022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbf71b7e-23d254-179d00-127d0628_0] Write session: Do CDS request
2025-09-30T14:55:04.134028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbf71b7e-23d254-179d00-127d0628_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:04.133840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1738 sessionId: src_id|dbf71b7e-23d254-179d00-127d0628_0 is DEAD
2025-09-30T14:55:04.141711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:04.143352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:04.143568Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:04.143577Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:04.143587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:04.143659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:04.143699Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895894288183526:10053]
2025-09-30T14:55:04.143777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbf71b7e-23d254-179d00-127d0628_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:04.143888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:04.143914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1739
2025-09-30T14:55:04.144041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1739 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:04.144079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1739 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:04.144089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1739 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:04.144093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:04.144302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:04.144505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1739 sessionId:  describe result for acl check
2025-09-30T14:55:04.144552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:04.144559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:04.144561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:04.144568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895894377951188:7651] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:04.144863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:04.144936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:04.145134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895894377951188:7651] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:04.145274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:04.145364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:04.145372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:04.145373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:04.145374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:04.145375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:04.145376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:04.145377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:04.145378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:04.145380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:04.145381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:04.145382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.145383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.145384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.145385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:04.145386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:04.145392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:04.145401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:04.145405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:04.145409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:04.145413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:04.145417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:04.145421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:04.145428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:04.145431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:04.145435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:04.145440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.145444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.145448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.145452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:04.145456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:04.145465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:04.145473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:04.145479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:04.145484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:04.145490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:04.145496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:04.145500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:04.145506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:04.145510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:04.145516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:04.145521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:04.145528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:04.145533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:04.145537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:04.145540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:04.145544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:04.145548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:04.145552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:04.145558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:04.145562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:04.145571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.145575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.145579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.145584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.145594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.145599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.145602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:04.145606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:04.145610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:04.145619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:04.145660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:04.147172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895894377951188:7651] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:04.151589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:04.152556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:04.152570Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:04.152573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:04.152581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:04.152588Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1738 [2:7555895894288183526:10053]
2025-09-30T14:55:04.152605Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:04.152621Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:04.152624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:04.152628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:04.152630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:04.152648Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:04.152661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:04.152668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:04.152753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.152762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.152765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.152768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:04.152771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:04.152843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:04.152853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.152866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.152880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.152901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:04.152926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895894288183521:10053]
2025-09-30T14:55:04.152934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895894288183521:10053]
2025-09-30T14:55:04.152937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895894288183521:10053]
2025-09-30T14:55:04.152948Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:04.152966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:04.152975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:04.152980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:04.152984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:04.152988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:04.152991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:04.153001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895894377951227:7651], now have 1 active actors on pipe
2025-09-30T14:55:04.153007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895894377951151:2454], now have 1 active actors on pipe
2025-09-30T14:55:04.153041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895894288183521:10053]
2025-09-30T14:55:04.153055Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:04.153121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:04.153215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:04.153236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:04.153263Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|263c4fd-3a887f5d-5ff8afaa-460d844e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:04.153270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:04.153273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:04.153276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:04.153285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:04.153294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:04.153309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:04.151111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895894377951188:7651] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:04.151134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895894377951188:7651] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:04.151138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895894377951188:7651] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:04.151149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1739 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:04.153082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1738
2025-09-30T14:55:04.153093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1738
2025-09-30T14:55:04.153585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:04.153597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:04.153612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:04.153717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1739 partition: 0 MaxSeqNo: 42 sessionId: src_id|263c4fd-3a887f5d-5ff8afaa-460d844e_0
2025-09-30T14:55:04.154196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbf71b7e-23d254-179d00-127d0628_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|263c4fd-3a887f5d-5ff8afaa-460d844e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:04.157121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|263c4fd-3a887f5d-5ff8afaa-460d844e_0] Write session: try to update token
2025-09-30T14:55:04.157148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|263c4fd-3a887f5d-5ff8afaa-460d844e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:04.165554Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:04.165583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:04.165593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895894288183521:10053]
2025-09-30T14:55:04.165641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:04.165644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:04.165934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:04.166102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:04.166266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:04.166419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:04.166620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:04.166669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:04.173847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1739 sessionId: src_id|263c4fd-3a887f5d-5ff8afaa-460d844e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:04.176636Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:04.176667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:04.176670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:04.176672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:04.176684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895894288183521:10053]
2025-09-30T14:55:04.176689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895894288183521:10053]
2025-09-30T14:55:04.176694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895894288183521:10053]
2025-09-30T14:55:04.176739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:04.176741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:04.176748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:04.176752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.176753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:04.176756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:04.176905Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:04.177383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:04.233686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895894377951237:7977]
2025-09-30T14:55:04.234037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1738, pipe: [1:7555895894377951237:7977]
2025-09-30T14:55:04.295900Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:04.296299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:04.296315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:04.296334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895894377951237:7977], now have 1 active actors on pipe
2025-09-30T14:55:04.296649Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:04.296621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:04.296636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:04.296696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895894377951237:7977]
2025-09-30T14:55:04.296705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1739 reason: error at write: Disconnected sessionId: src_id|263c4fd-3a887f5d-5ff8afaa-460d844e_0
2025-09-30T14:55:04.296758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:04.296931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1739 sessionId: src_id|263c4fd-3a887f5d-5ff8afaa-460d844e_0 is DEAD
2025-09-30T14:55:04.297121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|263c4fd-3a887f5d-5ff8afaa-460d844e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:04.297138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|263c4fd-3a887f5d-5ff8afaa-460d844e_0] Write session will restart in 0.005395s
2025-09-30T14:55:04.297170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|263c4fd-3a887f5d-5ff8afaa-460d844e_0] Write session: Do CDS request
2025-09-30T14:55:04.297178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|263c4fd-3a887f5d-5ff8afaa-460d844e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:04.303977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|263c4fd-3a887f5d-5ff8afaa-460d844e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:04.304206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:04.304225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1740
2025-09-30T14:55:04.304378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1740 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:04.304421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1740 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:04.304433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1740 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:04.304438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:04.304934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1740 sessionId:  describe result for acl check
2025-09-30T14:55:04.304971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:04.304982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:04.304984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:04.304990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895894377951272:7645] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:04.305604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895894377951272:7645] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:04.306437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:04.307940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895894377951272:7645] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:04.308418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:04.308632Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:04.308643Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:04.308655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:04.308711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:04.308757Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895894288183601:10055]
2025-09-30T14:55:04.309420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:04.310816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895894377951272:7645] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:04.310835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895894377951272:7645] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:04.310848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895894377951272:7645] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:04.310858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1740 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:04.309773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:04.309832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:04.310207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:04.310294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:04.310295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:04.310297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:04.310298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:04.310299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:04.310300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:04.310302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:04.310306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:04.310308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:04.310309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:04.310311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.310312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.310313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.310314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:04.310316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:04.310323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:04.310334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:04.310339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:04.310343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:04.310347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:04.310352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:04.310356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:04.310360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:04.310364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:04.310369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:04.310373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.310378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.310381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.310386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:04.310389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:04.310400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:04.310409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:04.310416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:04.310422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:04.310427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:04.310432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:04.310437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:04.310442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:04.310450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:04.310455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:04.310459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:04.310465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:04.310470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:04.310476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:04.310481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:04.310487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:04.310492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:04.310498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:04.310504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:04.310510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:04.310515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.310521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.310525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.310531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.310536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.310540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.310545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:04.310551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:04.310556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:04.310561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:04.310604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:04.317001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:04.318146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:04.318164Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:04.318168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:04.318172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:04.318181Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1739 [2:7555895894288183601:10055]
2025-09-30T14:55:04.318201Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:04.318222Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:04.318226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:04.318234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:04.318237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:04.318257Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:04.318273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:04.318280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:04.318353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.318360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.318362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.318365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:04.318368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:04.318446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:04.318455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.318471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.318482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.318500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:04.318518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895894288183595:10055]
2025-09-30T14:55:04.318520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895894288183595:10055]
2025-09-30T14:55:04.318522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895894288183595:10055]
2025-09-30T14:55:04.318531Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:04.318545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:04.318553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:04.318559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:04.318559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:04.318562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:04.318562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:04.318572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895894377951238:2454], now have 1 active actors on pipe
2025-09-30T14:55:04.318576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895894377951313:7645], now have 1 active actors on pipe
2025-09-30T14:55:04.318615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895894288183595:10055]
2025-09-30T14:55:04.318625Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:04.318641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:04.318691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1739
2025-09-30T14:55:04.318699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1739
2025-09-30T14:55:04.318901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:04.318928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:04.318955Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64294714-cb925e33-f6c9792a-6d5c5583_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:04.318964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:04.318984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:04.318991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:04.319003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:04.319016Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:04.319039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:04.319230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:04.319239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:04.319266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:04.319484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1740 partition: 0 MaxSeqNo: 42 sessionId: src_id|64294714-cb925e33-f6c9792a-6d5c5583_0
2025-09-30T14:55:04.319978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|263c4fd-3a887f5d-5ff8afaa-460d844e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|64294714-cb925e33-f6c9792a-6d5c5583_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:04.323711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64294714-cb925e33-f6c9792a-6d5c5583_0] Write session: try to update token
2025-09-30T14:55:04.323740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64294714-cb925e33-f6c9792a-6d5c5583_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:04.331504Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:04.331525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:04.331535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895894288183595:10055]
2025-09-30T14:55:04.331583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:04.331590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:04.331778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:04.331943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:04.332135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:04.332319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:04.332538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:04.332590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:04.341963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1740 sessionId: src_id|64294714-cb925e33-f6c9792a-6d5c5583_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:04.343077Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:04.343097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:04.343100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:04.343103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:04.343113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895894288183595:10055]
2025-09-30T14:55:04.343124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895894288183595:10055]
2025-09-30T14:55:04.343127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895894288183595:10055]
2025-09-30T14:55:04.343171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:04.343179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.343184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:04.343198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:04.343216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:04.343221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:04.343438Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:04.344950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:04.397023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895894377951322:7977]
2025-09-30T14:55:04.397373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1739, pipe: [1:7555895894377951322:7977]
2025-09-30T14:55:04.460382Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:04.460778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:04.460794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:04.460816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895894377951322:7977], now have 1 active actors on pipe
2025-09-30T14:55:04.461045Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:04.461040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895894377951322:7977]
2025-09-30T14:55:04.461043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:04.461081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:04.461084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:04.461151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1740 reason: error at write: Disconnected sessionId: src_id|64294714-cb925e33-f6c9792a-6d5c5583_0
2025-09-30T14:55:04.461363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1740 sessionId: src_id|64294714-cb925e33-f6c9792a-6d5c5583_0 is DEAD
2025-09-30T14:55:04.461595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64294714-cb925e33-f6c9792a-6d5c5583_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:04.461613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64294714-cb925e33-f6c9792a-6d5c5583_0] Write session will restart in 0.005208s
2025-09-30T14:55:04.461648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64294714-cb925e33-f6c9792a-6d5c5583_0] Write session: Do CDS request
2025-09-30T14:55:04.461658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64294714-cb925e33-f6c9792a-6d5c5583_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:04.468020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64294714-cb925e33-f6c9792a-6d5c5583_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:04.468076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:04.468094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1741
2025-09-30T14:55:04.468331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1741 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:04.468364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1741 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:04.468375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1741 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:04.468380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:04.468814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1741 sessionId:  describe result for acl check
2025-09-30T14:55:04.468850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:04.468852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:04.468854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:04.468860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895894377951343:7636] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:04.469433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895894377951343:7636] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:04.471775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895894377951343:7636] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:04.471863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:04.473789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:04.473996Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:04.474007Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:04.474019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:04.474071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:04.474116Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895894288183678:10058]
2025-09-30T14:55:04.474807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:04.475216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:04.475315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:04.475728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:04.475824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:04.475834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:04.475836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:04.475837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:04.475838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:04.475839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:04.475841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:04.475842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:04.475844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:04.475845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:04.475846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.475848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.475849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.475850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:04.475852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:04.475859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:04.475871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:04.475876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:04.475880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:04.475884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:04.475888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:04.475893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:04.475897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:04.475901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:04.475906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:04.475913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.475918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.475922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.475927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:04.475931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:04.475941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:04.475949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:04.475956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:04.475962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:04.475967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:04.475981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:04.475987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:04.475993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:04.476000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:04.476005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:04.476012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:04.476018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:04.476023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:04.476028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:04.476032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:04.476037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:04.476042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:04.476047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:04.476052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:04.476057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:04.476065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.476076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.476081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.476107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.476113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.476118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.476128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:04.476134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:04.476143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:04.476149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:04.476201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:04.476212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895894377951343:7636] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:04.476230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895894377951343:7636] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:04.476235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895894377951343:7636] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:04.476243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1741 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:04.482835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:04.484010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:04.484029Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:04.484032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:04.484039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:04.484046Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1740 [2:7555895894288183678:10058]
2025-09-30T14:55:04.484065Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:04.484085Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:04.484093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:04.484097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:04.484100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:04.484117Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:04.484127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:04.484134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:04.484204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.484211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.484215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.484218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:04.484219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:04.484287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:04.484295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.484308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.484318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.484333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:04.484357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895894377951398:7636], now have 1 active actors on pipe
2025-09-30T14:55:04.484366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895894377951323:2454], now have 1 active actors on pipe
2025-09-30T14:55:04.484372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895894288183672:10058]
2025-09-30T14:55:04.484374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895894288183672:10058]
2025-09-30T14:55:04.484376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895894288183672:10058]
2025-09-30T14:55:04.484391Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:04.484403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:04.484419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:04.484422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:04.484424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:04.484426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:04.484427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:04.484463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895894288183672:10058]
2025-09-30T14:55:04.484476Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:04.484449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1740
2025-09-30T14:55:04.484489Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1740
2025-09-30T14:55:04.484503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:04.484643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:04.484657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:04.484691Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b611c296-a45a842c-a337799f-17e0024f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:04.484704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:04.484713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:04.484715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:04.484729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:04.484745Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:04.484767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:04.484943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:04.484952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:04.484972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:04.485057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1741 partition: 0 MaxSeqNo: 42 sessionId: src_id|b611c296-a45a842c-a337799f-17e0024f_0
2025-09-30T14:55:04.485691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64294714-cb925e33-f6c9792a-6d5c5583_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b611c296-a45a842c-a337799f-17e0024f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:04.488762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b611c296-a45a842c-a337799f-17e0024f_0] Write session: try to update token
2025-09-30T14:55:04.488784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b611c296-a45a842c-a337799f-17e0024f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:04.498307Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:04.498329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:04.498340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895894288183672:10058]
2025-09-30T14:55:04.498389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:04.498417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:04.498599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:04.498761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:04.498919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:04.499074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:04.499308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:04.499358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:04.507414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1741 sessionId: src_id|b611c296-a45a842c-a337799f-17e0024f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:04.510379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:04.510636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:04.510660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:04.510708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:04.510804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:04.512487Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:04.512506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:04.512509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:04.512511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:04.512524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895894288183672:10058]
2025-09-30T14:55:04.512530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895894288183672:10058]
2025-09-30T14:55:04.512538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895894288183672:10058]
2025-09-30T14:55:04.512588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:04.512596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:04.512603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:04.512608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.512611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:04.512611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:04.512806Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:04.561369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895894377951408:7977]
2025-09-30T14:55:04.561779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1740, pipe: [1:7555895894377951408:7977]
2025-09-30T14:55:04.633760Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:04.642789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:04.642819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:04.642982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:04.643048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:04.643121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:04.643184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:04.643516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:04.643530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:04.643605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:04.643680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:04.643752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:04.643825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:04.643877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:04.643885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:04.643955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:04.644018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:04.644088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:04.644161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:04.644205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:04.644212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:04.644281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:04.644346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:04.644414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:04.644480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:04.644523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:04.644531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:04.644606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:04.644668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:04.644731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:04.644797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:04.644849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:04.644861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:04.644933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:04.644995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:04.645059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:04.645128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:04.645176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:04.645184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:04.645254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:04.645319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:04.645389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:04.645457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:04.645506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:04.645517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:04.645583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:04.645645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:04.645726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:04.645796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:04.645841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:04.645849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:04.645917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:04.645985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:04.646053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:04.646123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:04.646171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:04.646178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:04.646244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:04.646317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:04.646378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:04.646453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:04.646497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:04.646505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:04.646578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895894377951408:7977], now have 1 active actors on pipe
2025-09-30T14:55:04.646847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895894377951408:7977]
2025-09-30T14:55:04.646880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:04.646884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:04.646884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:04.646913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1741 reason: error at write: Disconnected sessionId: src_id|b611c296-a45a842c-a337799f-17e0024f_0
2025-09-30T14:55:04.647114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1741 sessionId: src_id|b611c296-a45a842c-a337799f-17e0024f_0 is DEAD
2025-09-30T14:55:04.647282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b611c296-a45a842c-a337799f-17e0024f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:04.647295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b611c296-a45a842c-a337799f-17e0024f_0] Write session will restart in 0.005239s
2025-09-30T14:55:04.647320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b611c296-a45a842c-a337799f-17e0024f_0] Write session: Do CDS request
2025-09-30T14:55:04.647326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b611c296-a45a842c-a337799f-17e0024f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:04.647287Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:04.653768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b611c296-a45a842c-a337799f-17e0024f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:04.654144Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:04.654163Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1742
2025-09-30T14:55:04.654402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1742 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:04.654451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1742 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:04.654464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1742 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:04.654469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:04.654956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1742 sessionId:  describe result for acl check
2025-09-30T14:55:04.654997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:04.655003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:04.655006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:04.655012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895894377951449:7631] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:04.655713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895894377951449:7631] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:04.660253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:04.661369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895894377951449:7631] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:04.660907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:04.661127Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:04.661132Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:04.661146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:04.661213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:04.661247Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895894288183766:10061]
2025-09-30T14:55:04.661929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:04.662663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:04.662726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:04.663037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:04.663091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:04.663096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:04.663097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:04.663098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:04.663099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:04.663100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:04.663101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:04.663102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:04.663102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:04.663103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:04.663106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.663106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.663107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.663108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:04.663108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:04.663113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:04.663119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:04.663122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:04.663125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:04.663127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:04.663129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:04.663131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:04.663133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:04.663136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:04.663138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:04.663140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.663143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.663145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.663147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:04.663149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:04.663157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:04.663166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:04.663172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:04.663177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:04.663186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:04.663192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:04.663196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:04.663201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:04.663204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:04.663207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:04.663210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:04.663214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:04.663217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:04.663220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:04.663223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:04.663226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:04.663228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:04.663232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:04.663234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:04.663238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:04.663259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.663264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.663268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.663273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.663277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.663282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.663288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:04.663294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:04.663298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:04.663303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:04.663343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:04.668986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895894377951449:7631] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:04.669005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895894377951449:7631] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:04.669009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895894377951449:7631] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:04.669019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1742 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:04.669242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:04.670172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:04.670188Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:04.670191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:04.670195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:04.670203Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1741 [2:7555895894288183766:10061]
2025-09-30T14:55:04.670221Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:04.670237Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:04.670240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:04.670244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:04.670246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:04.670266Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:04.670272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:04.670279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:04.670337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.670349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.670351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.670354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:04.670357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:04.670424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:04.670435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.670449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.670462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.670486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:04.670512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895894377951502:7631], now have 1 active actors on pipe
2025-09-30T14:55:04.670521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895894377951425:2454], now have 1 active actors on pipe
2025-09-30T14:55:04.670527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895894288183761:10061]
2025-09-30T14:55:04.670529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895894288183761:10061]
2025-09-30T14:55:04.670531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895894288183761:10061]
2025-09-30T14:55:04.670543Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:04.670557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:04.670564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:04.670569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:04.670571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:04.670573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:04.670576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:04.670611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895894288183761:10061]
2025-09-30T14:55:04.670614Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:04.670588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1741
2025-09-30T14:55:04.670607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1741
2025-09-30T14:55:04.670630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:04.670649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:04.670660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:04.670773Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|382281d0-4af540b5-9d5f63f0-9f30155b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:04.670791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:04.670800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:04.670802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:04.670812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:04.670823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:04.670843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:04.671017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:04.671034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:04.671069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:04.671226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1742 partition: 0 MaxSeqNo: 42 sessionId: src_id|382281d0-4af540b5-9d5f63f0-9f30155b_0
2025-09-30T14:55:04.671656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b611c296-a45a842c-a337799f-17e0024f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|382281d0-4af540b5-9d5f63f0-9f30155b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:04.674619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|382281d0-4af540b5-9d5f63f0-9f30155b_0] Write session: try to update token
2025-09-30T14:55:04.674640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|382281d0-4af540b5-9d5f63f0-9f30155b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:04.688136Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:04.688156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:04.688159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:04.688161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:04.688170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895894288183761:10061]
2025-09-30T14:55:04.688175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895894288183761:10061]
2025-09-30T14:55:04.688180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895894288183761:10061]
2025-09-30T14:55:04.688218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:04.688228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.688232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:04.688232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:04.688253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:04.688258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:04.688378Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:04.694241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1742 sessionId: src_id|382281d0-4af540b5-9d5f63f0-9f30155b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:04.697130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:04.747207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895894377951510:7977]
2025-09-30T14:55:04.747576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1741, pipe: [1:7555895894377951510:7977]
2025-09-30T14:55:04.808070Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:04.808480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:04.808488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:04.808526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895894377951510:7977], now have 1 active actors on pipe
2025-09-30T14:55:04.808783Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:04.808798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:04.808813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:04.808878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1742 reason: error at write: Disconnected sessionId: src_id|382281d0-4af540b5-9d5f63f0-9f30155b_0
2025-09-30T14:55:04.809071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1742 sessionId: src_id|382281d0-4af540b5-9d5f63f0-9f30155b_0 is DEAD
2025-09-30T14:55:04.809226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|382281d0-4af540b5-9d5f63f0-9f30155b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:04.809233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|382281d0-4af540b5-9d5f63f0-9f30155b_0] Write session will restart in 0.009129s
2025-09-30T14:55:04.809260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|382281d0-4af540b5-9d5f63f0-9f30155b_0] Write session: Do CDS request
2025-09-30T14:55:04.809266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|382281d0-4af540b5-9d5f63f0-9f30155b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:04.809256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895894377951510:7977]
2025-09-30T14:55:04.809276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:04.817903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:04.819789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|382281d0-4af540b5-9d5f63f0-9f30155b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:04.819749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:04.819833Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:04.819850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1743
2025-09-30T14:55:04.819963Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:04.819976Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:04.819988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:04.820061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:04.820105Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895894288183857:10070]
2025-09-30T14:55:04.820127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1743 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:04.820171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1743 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:04.820180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1743 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:04.820185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:04.820579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1743 sessionId:  describe result for acl check
2025-09-30T14:55:04.820611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:04.820612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:04.820615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:04.820621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895894377951565:7615] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:04.820782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:04.821048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:04.821093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:04.821176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895894377951565:7615] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:04.821423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:04.821490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:04.821496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:04.821497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:04.821498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:04.821499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:04.821500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:04.821501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:04.821502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:04.821503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:04.821505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:04.821506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.821507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.821508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.821509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:04.821510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:04.821517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:04.821526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:04.821530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:04.821535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:04.821539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:04.821544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:04.821548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:04.821552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:04.821556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:04.821560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:04.821564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.821567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.821571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.821574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:04.821578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:04.821585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:04.821592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:04.821599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:04.821604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:04.821608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:04.821612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:04.821617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:04.821622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:04.821626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:04.821633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:04.821637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:04.821649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:04.821654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:04.821665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:04.821669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:04.821689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:04.821695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:04.821699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:04.821708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:04.821714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:04.821718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.821728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.821733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.821738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.821743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.821752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.821757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:04.821762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:04.821766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:04.821771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:04.821822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:04.823154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895894377951565:7615] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:04.827353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895894377951565:7615] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:04.827373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895894377951565:7615] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:04.827377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895894377951565:7615] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:04.827385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1743 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:04.828223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:04.829211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:04.829232Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:04.829235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:04.829239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:04.829247Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1742 [2:7555895894288183857:10070]
2025-09-30T14:55:04.829264Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:04.829279Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:04.829282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:04.829286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:04.829288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:04.829305Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:04.829312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:04.829322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:04.829388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.829395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.829397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.829400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:04.829403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:04.829468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:04.829476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.829488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.829503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.829524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:04.829548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895894377951603:7615], now have 1 active actors on pipe
2025-09-30T14:55:04.829557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895894377951524:2454], now have 1 active actors on pipe
2025-09-30T14:55:04.829565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895894288183852:10070]
2025-09-30T14:55:04.829571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895894288183852:10070]
2025-09-30T14:55:04.829573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895894288183852:10070]
2025-09-30T14:55:04.829588Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:04.829607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:04.829626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:04.829634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:04.829663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:04.829669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895894288183852:10070]
2025-09-30T14:55:04.829683Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:04.829637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1742
2025-09-30T14:55:04.829684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:04.829698Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1742
2025-09-30T14:55:04.829687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:04.829693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:04.829958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:04.829971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:04.830000Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a04f76f-b67537ab-fca9b749-cf24cea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:04.830008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:04.830015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:04.830017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:04.830028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:04.830039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:04.830055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:04.830317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:04.830328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:04.830348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:04.830457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1743 partition: 0 MaxSeqNo: 42 sessionId: src_id|5a04f76f-b67537ab-fca9b749-cf24cea_0
2025-09-30T14:55:04.830870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|382281d0-4af540b5-9d5f63f0-9f30155b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5a04f76f-b67537ab-fca9b749-cf24cea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:04.833957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a04f76f-b67537ab-fca9b749-cf24cea_0] Write session: try to update token
2025-09-30T14:55:04.833977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a04f76f-b67537ab-fca9b749-cf24cea_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:04.842547Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:04.842571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:04.842574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:04.842576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:04.842587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895894288183852:10070]
2025-09-30T14:55:04.842592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895894288183852:10070]
2025-09-30T14:55:04.842597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895894288183852:10070]
2025-09-30T14:55:04.842636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:04.842644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.842642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:04.842647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:04.842649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:04.842653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:04.842797Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:04.853907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1743 sessionId: src_id|5a04f76f-b67537ab-fca9b749-cf24cea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:04.857438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:04.909536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895894377951620:7977]
2025-09-30T14:55:04.909881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1742, pipe: [1:7555895894377951620:7977]
2025-09-30T14:55:04.951044Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:11802 } ]
2025-09-30T14:55:04.956278Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:04.956708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:04.956725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:04.956744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895894377951620:7977], now have 1 active actors on pipe
2025-09-30T14:55:04.956963Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:04.956975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:04.956988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895894377951620:7977]
2025-09-30T14:55:04.956992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:04.957454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a04f76f-b67537ab-fca9b749-cf24cea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:04.957471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a04f76f-b67537ab-fca9b749-cf24cea_0] Write session will restart in 0.007032s
2025-09-30T14:55:04.957010Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:04.957060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1743 reason: error at write: Disconnected sessionId: src_id|5a04f76f-b67537ab-fca9b749-cf24cea_0
2025-09-30T14:55:04.957495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a04f76f-b67537ab-fca9b749-cf24cea_0] Write session: Do CDS request
2025-09-30T14:55:04.957247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1743 sessionId: src_id|5a04f76f-b67537ab-fca9b749-cf24cea_0 is DEAD
2025-09-30T14:55:04.957501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a04f76f-b67537ab-fca9b749-cf24cea_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:04.965803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a04f76f-b67537ab-fca9b749-cf24cea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:04.965974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:04.965901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:04.965918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1744
2025-09-30T14:55:04.966089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1744 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:04.966148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1744 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:04.966167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1744 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:04.966173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:04.966634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1744 sessionId:  describe result for acl check
2025-09-30T14:55:04.966681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:04.966683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:04.966685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:04.966692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895894377951664:7599] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:04.967236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895894377951664:7599] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:04.967878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:04.968089Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:04.968098Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:04.968109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:04.968167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:04.968227Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895894288183959:10078]
2025-09-30T14:55:04.968818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:04.969078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:04.969118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:04.969396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:04.969457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:04.969463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:04.969465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:04.969466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:04.969467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:04.969468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:04.969469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:04.969470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:04.969472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:04.969473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:04.969474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.969475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.969476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.969477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:04.969478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:04.969484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:04.969494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:04.969498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:04.969503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:04.969507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:04.969512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:04.969516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:04.969519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:04.969523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:04.969528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:04.969532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.969537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.969542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.969546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:04.969550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:04.969557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:04.969565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:04.969571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:04.969576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:04.969587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:04.969593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:04.969603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:04.969612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:04.969627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:04.969636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:04.969641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:04.969646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:04.969655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:04.969660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:04.969666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:04.969684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:04.969688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:04.969694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:04.969698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:04.969704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:04.969712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.969718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.969727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.969701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895894377951664:7599] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:04.969733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.969738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.969743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.969750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:04.969756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:04.969761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:04.969771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:04.969817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:04.975101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895894377951664:7599] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:04.975124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895894377951664:7599] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:04.975132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895894377951664:7599] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:04.975145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1744 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:04.975443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:04.976409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:04.976427Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:04.976430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:04.976434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:04.976440Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1743 [2:7555895894288183959:10078]
2025-09-30T14:55:04.976454Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:04.976467Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:04.976473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:04.976475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:04.976477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:04.976490Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:04.976495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:04.976500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:04.976549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.976557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.976558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.976562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:04.976564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:04.976616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:04.976623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.976631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:04.976637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:04.976651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:04.976663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895894288183954:10078]
2025-09-30T14:55:04.976664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895894288183954:10078]
2025-09-30T14:55:04.976665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895894288183954:10078]
2025-09-30T14:55:04.976671Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:04.976682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:04.976686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:04.976690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:04.976690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:04.976692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:04.976692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:04.976699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895894377951624:2454], now have 1 active actors on pipe
2025-09-30T14:55:04.976701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895894377951701:7599], now have 1 active actors on pipe
2025-09-30T14:55:04.976726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895894288183954:10078]
2025-09-30T14:55:04.976737Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:04.976770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:04.976796Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1743
2025-09-30T14:55:04.976806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1743
2025-09-30T14:55:04.976947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:04.976958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:04.976986Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65fd6b9f-7fdcc47a-9a7fa642-2ec47bca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:04.976997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:04.977000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:04.977002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:04.977011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:04.977025Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:04.977043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:04.977232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:04.977243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:04.977257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:04.977347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1744 partition: 0 MaxSeqNo: 42 sessionId: src_id|65fd6b9f-7fdcc47a-9a7fa642-2ec47bca_0
2025-09-30T14:55:04.977734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a04f76f-b67537ab-fca9b749-cf24cea_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|65fd6b9f-7fdcc47a-9a7fa642-2ec47bca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:04.980699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65fd6b9f-7fdcc47a-9a7fa642-2ec47bca_0] Write session: try to update token
2025-09-30T14:55:04.980725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65fd6b9f-7fdcc47a-9a7fa642-2ec47bca_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:04.989522Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:04.989541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:04.989543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:04.989546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:04.989559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895894288183954:10078]
2025-09-30T14:55:04.989563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895894288183954:10078]
2025-09-30T14:55:04.989567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895894288183954:10078]
2025-09-30T14:55:04.989607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:04.989614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:04.989617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:04.989639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:04.989656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:04.989660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:04.989795Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:04.996519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1744 sessionId: src_id|65fd6b9f-7fdcc47a-9a7fa642-2ec47bca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:04.999604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:05.056997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895898672919005:7977]
2025-09-30T14:55:05.057341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1743, pipe: [1:7555895898672919005:7977]
2025-09-30T14:55:05.105292Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:05.105715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:05.105728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:05.105774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895898672919005:7977], now have 1 active actors on pipe
2025-09-30T14:55:05.106107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:05.106155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895898672919005:7977]
2025-09-30T14:55:05.106163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:05.106174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:05.106233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1744 reason: error at write: Disconnected sessionId: src_id|65fd6b9f-7fdcc47a-9a7fa642-2ec47bca_0
2025-09-30T14:55:05.106422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1744 sessionId: src_id|65fd6b9f-7fdcc47a-9a7fa642-2ec47bca_0 is DEAD
2025-09-30T14:55:05.106312Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:05.107583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65fd6b9f-7fdcc47a-9a7fa642-2ec47bca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:05.107598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65fd6b9f-7fdcc47a-9a7fa642-2ec47bca_0] Write session will restart in 0.005549s
2025-09-30T14:55:05.107625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65fd6b9f-7fdcc47a-9a7fa642-2ec47bca_0] Write session: Do CDS request
2025-09-30T14:55:05.107631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65fd6b9f-7fdcc47a-9a7fa642-2ec47bca_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:05.115263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65fd6b9f-7fdcc47a-9a7fa642-2ec47bca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:05.115424Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:05.115457Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1745
2025-09-30T14:55:05.115717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1745 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:05.115782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1745 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:05.115788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1745 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:05.115796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:05.116359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1745 sessionId:  describe result for acl check
2025-09-30T14:55:05.116401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:05.116422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:05.116429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:05.116436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895898672919019:7598] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:05.117060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895898672919019:7598] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:05.119332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895898672919019:7598] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:05.124221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895898672919019:7598] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:05.124239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895898672919019:7598] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:05.124242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895898672919019:7598] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:05.124252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1745 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:05.127517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:05.129546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:05.129804Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:05.129816Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:05.129828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:05.129897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:05.130032Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895898583151337:10080]
2025-09-30T14:55:05.130687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:05.131109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:05.131187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:05.131608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:05.131698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:05.131709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:05.131710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:05.131711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:05.131713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:05.131715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:05.131716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:05.131717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:05.131719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:05.131720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:05.131722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.131723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.131724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.131726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:05.131727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:05.131734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:05.131746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:05.131751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:05.131755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:05.131759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:05.131763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:05.131767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:05.131771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:05.131775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:05.131779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:05.131784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.131789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.131794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.131799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:05.131805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:05.131813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:05.131821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:05.131827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:05.131832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:05.131836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:05.131841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:05.131846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:05.131852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:05.131856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:05.131862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:05.131866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:05.131872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:05.131877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:05.131883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:05.131887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:05.131893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:05.131898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:05.131904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:05.131909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:05.131914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:05.131920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.131933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.131938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.131945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.131951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.131962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.131967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:05.131973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:05.131985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:05.131995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:05.132041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:05.138042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:05.139147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:05.139166Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:05.139170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:05.139175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:05.139185Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1744 [2:7555895898583151337:10080]
2025-09-30T14:55:05.139204Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:05.139225Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:05.139233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:05.139236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:05.139239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:05.139280Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:05.139292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:05.139300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:05.139369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.139377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.139379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.139382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:05.139384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:05.139460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:05.139472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.139497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.139510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.139530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:05.139556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895898672919006:2454], now have 1 active actors on pipe
2025-09-30T14:55:05.139565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895898672919062:7598], now have 1 active actors on pipe
2025-09-30T14:55:05.139571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895898583151332:10080]
2025-09-30T14:55:05.139573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895898583151332:10080]
2025-09-30T14:55:05.139575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895898583151332:10080]
2025-09-30T14:55:05.139591Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:05.139609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:05.139619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:05.139623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:05.139625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:05.139627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:05.139632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:05.139671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895898583151332:10080]
2025-09-30T14:55:05.139679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:05.139685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:05.139863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1744
2025-09-30T14:55:05.139909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1744
2025-09-30T14:55:05.140127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:05.140143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:05.140173Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfa8069f-fdc6f286-485660a-2f06c7bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:05.140188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:05.140197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:05.140200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:05.140211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:05.140228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:05.140245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:05.140493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:05.140506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:05.140525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:05.140632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1745 partition: 0 MaxSeqNo: 42 sessionId: src_id|cfa8069f-fdc6f286-485660a-2f06c7bc_0
2025-09-30T14:55:05.141123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65fd6b9f-7fdcc47a-9a7fa642-2ec47bca_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cfa8069f-fdc6f286-485660a-2f06c7bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:05.144749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa8069f-fdc6f286-485660a-2f06c7bc_0] Write session: try to update token
2025-09-30T14:55:05.144777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa8069f-fdc6f286-485660a-2f06c7bc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:05.155274Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:05.155294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:05.155297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:05.155300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:05.155311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895898583151332:10080]
2025-09-30T14:55:05.155317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895898583151332:10080]
2025-09-30T14:55:05.155322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895898583151332:10080]
2025-09-30T14:55:05.155373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:05.155382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.155385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:05.155387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:05.155397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:05.155403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:05.155539Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:05.167658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1745 sessionId: src_id|cfa8069f-fdc6f286-485660a-2f06c7bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:05.170911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:05.206481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895898672919104:7977]
2025-09-30T14:55:05.206793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1744, pipe: [1:7555895898672919104:7977]
2025-09-30T14:55:05.273557Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:05.274390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:05.274399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:05.274421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895898672919104:7977], now have 1 active actors on pipe
2025-09-30T14:55:05.274641Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:05.274901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:05.274958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:05.274963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895898672919104:7977]
2025-09-30T14:55:05.275038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1745 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cfa8069f-fdc6f286-485660a-2f06c7bc_0
2025-09-30T14:55:05.275381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa8069f-fdc6f286-485660a-2f06c7bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:05.275392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa8069f-fdc6f286-485660a-2f06c7bc_0] Write session will restart in 0.007438s
2025-09-30T14:55:05.275416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa8069f-fdc6f286-485660a-2f06c7bc_0] Write session: Do CDS request
2025-09-30T14:55:05.275422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa8069f-fdc6f286-485660a-2f06c7bc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:05.275223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1745 sessionId: src_id|cfa8069f-fdc6f286-485660a-2f06c7bc_0 is DEAD
2025-09-30T14:55:05.284304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa8069f-fdc6f286-485660a-2f06c7bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:05.284351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:05.284368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1746
2025-09-30T14:55:05.284650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1746 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:05.284686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1746 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:05.284696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1746 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:05.284701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:05.285097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1746 sessionId:  describe result for acl check
2025-09-30T14:55:05.285131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:05.285134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:05.285136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:05.285141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895898672919146:7594] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:05.285693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895898672919146:7594] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:05.287139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:05.287772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895898672919146:7594] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:05.288421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:05.288733Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:05.288749Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:05.288768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:05.288856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:05.288922Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895898583151417:10082]
2025-09-30T14:55:05.289697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:05.290146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:05.290211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:05.290579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:05.290649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:05.290657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:05.290658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:05.290659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:05.290660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:05.290662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:05.290663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:05.290664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:05.290666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:05.290667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:05.290668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.290670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.290671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.290672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:05.290674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:05.290680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:05.290692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:05.290696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:05.290701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:05.290706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:05.290710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:05.290715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:05.290720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:05.290725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:05.290729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:05.290734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.290739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.290743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.290748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:05.290752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:05.290760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:05.290768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:05.290775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:05.290781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:05.290764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895898672919146:7594] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:05.290787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:05.290793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:05.290798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:05.290781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895898672919146:7594] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:05.290804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:05.290784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895898672919146:7594] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:05.290809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:05.290792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1746 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:05.290815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:05.290819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:05.290825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:05.290829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:05.290834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:05.290839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:05.290845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:05.290851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:05.290857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:05.290863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:05.290868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:05.290873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.290879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.290885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.290890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.290902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.290908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.290917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:05.290922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:05.290932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:05.290938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:05.290987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:05.297874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:05.298887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:05.298902Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:05.298903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:05.298907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:05.298913Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1745 [2:7555895898583151417:10082]
2025-09-30T14:55:05.298930Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:05.298947Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:05.298949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:05.298952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:05.298953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:05.298968Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:05.298973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:05.298978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:05.299045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.299055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.299057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.299061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:05.299064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:05.299136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:05.299142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.299153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.299160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.299171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:05.299189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895898672919186:7594], now have 1 active actors on pipe
2025-09-30T14:55:05.299198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895898583151412:10082]
2025-09-30T14:55:05.299200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895898583151412:10082]
2025-09-30T14:55:05.299203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895898583151412:10082]
2025-09-30T14:55:05.299214Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:05.299225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895898672919105:2454], now have 1 active actors on pipe
2025-09-30T14:55:05.299231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:05.299238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:05.299257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:05.299259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:05.299260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:05.299262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:05.299309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895898583151412:10082]
2025-09-30T14:55:05.299320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:05.299311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1745
2025-09-30T14:55:05.299329Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1745
2025-09-30T14:55:05.299343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:05.299363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:05.299368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:05.299399Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|156b3a64-55e30f64-44e0216a-abe6d0cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:05.299411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:05.299421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:05.299423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:05.299432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:05.299442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:05.299462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:05.299613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:05.299623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:05.299639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:05.299747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1746 partition: 0 MaxSeqNo: 42 sessionId: src_id|156b3a64-55e30f64-44e0216a-abe6d0cb_0
2025-09-30T14:55:05.300120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa8069f-fdc6f286-485660a-2f06c7bc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|156b3a64-55e30f64-44e0216a-abe6d0cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:05.303420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|156b3a64-55e30f64-44e0216a-abe6d0cb_0] Write session: try to update token
2025-09-30T14:55:05.303442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|156b3a64-55e30f64-44e0216a-abe6d0cb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:05.316653Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:05.316673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:05.316682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895898583151412:10082]
2025-09-30T14:55:05.316722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:05.316749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:05.316928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:05.317097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:05.317260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:05.317437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:05.317760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:05.317821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:05.324202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1746 sessionId: src_id|156b3a64-55e30f64-44e0216a-abe6d0cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:05.327325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:05.327534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:05.327554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:05.327583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:05.327651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:05.329944Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:05.329967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:05.329970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:05.329972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:05.329985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895898583151412:10082]
2025-09-30T14:55:05.329989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895898583151412:10082]
2025-09-30T14:55:05.329993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895898583151412:10082]
2025-09-30T14:55:05.330037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:05.330048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.330051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:05.330065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:05.330072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:05.330080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:05.330195Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:05.375434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895898672919196:7977]
2025-09-30T14:55:05.376087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1745, pipe: [1:7555895898672919196:7977]
2025-09-30T14:55:05.445234Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:05.453110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:05.453140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:05.453302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:05.453376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:05.453445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:05.453526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:05.454052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:05.454068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:05.454146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:05.454219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:05.454282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:05.454350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:05.454397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:05.454405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:05.454481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:05.454549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:05.454615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:05.454682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:05.454726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:05.454732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:05.454802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:05.454878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:05.454955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:05.455028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:05.455072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:05.455075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:05.455147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:05.455208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:05.455301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:05.455377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:05.455431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:05.455439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:05.455510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:05.455583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:05.455659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:05.455726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:05.455779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:05.455786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:05.455858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:05.455926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:05.455994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:05.456061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:05.456104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:05.456110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:05.456184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:05.456250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:05.456321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:05.456390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:05.456439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:05.456446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:05.456518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:05.456588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:05.456651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:05.456726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:05.456793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:05.456800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:05.456875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:05.456941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:05.457006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:05.457073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:05.457116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:05.457126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:05.457200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895898672919196:7977], now have 1 active actors on pipe
2025-09-30T14:55:05.457469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:05.457486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:05.457517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1746 reason: error at write: Disconnected sessionId: src_id|156b3a64-55e30f64-44e0216a-abe6d0cb_0
2025-09-30T14:55:05.457744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1746 sessionId: src_id|156b3a64-55e30f64-44e0216a-abe6d0cb_0 is DEAD
2025-09-30T14:55:05.457832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895898672919196:7977]
2025-09-30T14:55:05.457871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:05.458053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|156b3a64-55e30f64-44e0216a-abe6d0cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:05.458064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|156b3a64-55e30f64-44e0216a-abe6d0cb_0] Write session will restart in 0.009362s
2025-09-30T14:55:05.458088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|156b3a64-55e30f64-44e0216a-abe6d0cb_0] Write session: Do CDS request
2025-09-30T14:55:05.458093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|156b3a64-55e30f64-44e0216a-abe6d0cb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:05.457892Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:05.467044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:05.468667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:05.468762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|156b3a64-55e30f64-44e0216a-abe6d0cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:05.468824Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:05.468843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1747
2025-09-30T14:55:05.468859Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:05.468870Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:05.468881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:05.468933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:05.468978Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895898583151500:10085]
2025-09-30T14:55:05.468982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1747 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:05.469015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1747 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:05.469025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1747 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:05.469031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:05.469438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1747 sessionId:  describe result for acl check
2025-09-30T14:55:05.469483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:05.469492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:05.469494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:05.469500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895898672919242:7588] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:05.469657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:05.469966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:05.470011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:05.470042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895898672919242:7588] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:05.470345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:05.470401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:05.470405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:05.470406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:05.470408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:05.470409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:05.470410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:05.470411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:05.470412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:05.470414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:05.470415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:05.470416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.470417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.470419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.470420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:05.470421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:05.470427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:05.470436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:05.470440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:05.470444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:05.470447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:05.470450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:05.470454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:05.470457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:05.470461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:05.470465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:05.470470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.470474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.470478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.470482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:05.470486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:05.470493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:05.470501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:05.470507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:05.470513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:05.470518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:05.470523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:05.470527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:05.470533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:05.470538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:05.470544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:05.470548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:05.470553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:05.470558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:05.470563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:05.470568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:05.470573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:05.470578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:05.470584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:05.470588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:05.470594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:05.470598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.470604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.470609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.470614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.470619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.470624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.470629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:05.470636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:05.470645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:05.470651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:05.470695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:05.472368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895898672919242:7588] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:05.475851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895898672919242:7588] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:05.475870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895898672919242:7588] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:05.475875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895898672919242:7588] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:05.475885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1747 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:05.476232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:05.477148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:05.477169Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:05.477172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:05.477176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:05.477183Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1746 [2:7555895898583151500:10085]
2025-09-30T14:55:05.477200Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:05.477219Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:05.477222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:05.477224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:05.477227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:05.477244Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:05.477254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:05.477260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:05.477320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.477328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.477330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.477334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:05.477338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:05.477406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:05.477413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.477424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.477433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.477452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:05.477476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895898672919280:7588], now have 1 active actors on pipe
2025-09-30T14:55:05.477479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895898672919198:2454], now have 1 active actors on pipe
2025-09-30T14:55:05.477485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895898583151495:10085]
2025-09-30T14:55:05.477487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895898583151495:10085]
2025-09-30T14:55:05.477489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895898583151495:10085]
2025-09-30T14:55:05.477503Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:05.477520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:05.477537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:05.477538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:05.477541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:05.477541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:05.477543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:05.477574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895898583151495:10085]
2025-09-30T14:55:05.477581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:05.477589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:05.477606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:05.477612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:05.477515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1746
2025-09-30T14:55:05.477648Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56dec702-b452fbca-848f07e7-7a9af4a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:05.477536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1746
2025-09-30T14:55:05.477659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:05.477663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:05.477666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:05.477691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:05.477700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:05.477722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:05.477864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:05.477871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:05.477884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:05.478008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1747 partition: 0 MaxSeqNo: 42 sessionId: src_id|56dec702-b452fbca-848f07e7-7a9af4a6_0
2025-09-30T14:55:05.478382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|156b3a64-55e30f64-44e0216a-abe6d0cb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|56dec702-b452fbca-848f07e7-7a9af4a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:05.481333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56dec702-b452fbca-848f07e7-7a9af4a6_0] Write session: try to update token
2025-09-30T14:55:05.481352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56dec702-b452fbca-848f07e7-7a9af4a6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:05.491223Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:05.491263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:05.491266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:05.491269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:05.491282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895898583151495:10085]
2025-09-30T14:55:05.491287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895898583151495:10085]
2025-09-30T14:55:05.491291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895898583151495:10085]
2025-09-30T14:55:05.491334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:05.491343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.491346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:05.491349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:05.491357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:05.491364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:05.492014Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:05.498761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1747 sessionId: src_id|56dec702-b452fbca-848f07e7-7a9af4a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:05.501686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:05.558305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895898672919289:7977]
2025-09-30T14:55:05.558612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1746, pipe: [1:7555895898672919289:7977]
2025-09-30T14:55:05.608131Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:05.608507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:05.608523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:05.608541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895898672919289:7977], now have 1 active actors on pipe
2025-09-30T14:55:05.608768Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:05.608806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:05.608824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:05.608824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:05.608867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895898672919289:7977]
2025-09-30T14:55:05.609074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1747 reason: error at write: Disconnected sessionId: src_id|56dec702-b452fbca-848f07e7-7a9af4a6_0
2025-09-30T14:55:05.609235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1747 sessionId: src_id|56dec702-b452fbca-848f07e7-7a9af4a6_0 is DEAD
2025-09-30T14:55:05.609377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56dec702-b452fbca-848f07e7-7a9af4a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:05.609384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56dec702-b452fbca-848f07e7-7a9af4a6_0] Write session will restart in 0.009595s
2025-09-30T14:55:05.609401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56dec702-b452fbca-848f07e7-7a9af4a6_0] Write session: Do CDS request
2025-09-30T14:55:05.609405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56dec702-b452fbca-848f07e7-7a9af4a6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:05.618204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:05.619843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56dec702-b452fbca-848f07e7-7a9af4a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:05.619874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:05.619892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1748
2025-09-30T14:55:05.619975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:05.620113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1748 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:05.620145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1748 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:05.620157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1748 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:05.620167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:05.620193Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:05.620204Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:05.620214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:05.620256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:05.620293Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895898583151595:10088]
2025-09-30T14:55:05.620655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1748 sessionId:  describe result for acl check
2025-09-30T14:55:05.620689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:05.620696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:05.620698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:05.620704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895898672919337:7580] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:05.620882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:05.621147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:05.621191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:05.621349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895898672919337:7580] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:05.621450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:05.621512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:05.621517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:05.621519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:05.621520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:05.621521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:05.621522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:05.621523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:05.621524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:05.621525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:05.621526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:05.621526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.621527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.621528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.621529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:05.621529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:05.621536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:05.621543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:05.621545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:05.621548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:05.621550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:05.621552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:05.621554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:05.621557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:05.621559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:05.621563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:05.621567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.621571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.621574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.621578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:05.621581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:05.621587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:05.621596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:05.621601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:05.621607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:05.621611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:05.621616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:05.621621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:05.621625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:05.621630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:05.621637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:05.621641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:05.621646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:05.621650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:05.621654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:05.621658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:05.621662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:05.621667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:05.621686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:05.621692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:05.621697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:05.621701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.621706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.621710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.621715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.621719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.621724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.621728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:05.621732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:05.621736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:05.621741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:05.621781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:05.623811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895898672919337:7580] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:05.626820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895898672919337:7580] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:05.626841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895898672919337:7580] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:05.626844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895898672919337:7580] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:05.626853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1748 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:05.627474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:05.628533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:05.628549Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:05.628555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:05.628559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:05.628566Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1747 [2:7555895898583151595:10088]
2025-09-30T14:55:05.628582Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:05.628597Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:05.628601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:05.628605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:05.628606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:05.628621Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:05.628632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:05.628639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:05.628699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.628710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.628711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.628715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:05.628717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:05.628783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:05.628791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.628804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.628817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.628835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:05.628858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895898672919292:2454], now have 1 active actors on pipe
2025-09-30T14:55:05.628866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895898672919388:7580], now have 1 active actors on pipe
2025-09-30T14:55:05.628873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895898583151589:10088]
2025-09-30T14:55:05.628875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895898583151589:10088]
2025-09-30T14:55:05.628877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895898583151589:10088]
2025-09-30T14:55:05.628890Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:05.628907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:05.628906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:05.628910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:05.628912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:05.628926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:05.628929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:05.628946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1747
2025-09-30T14:55:05.628965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895898583151589:10088]
2025-09-30T14:55:05.628998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1747
2025-09-30T14:55:05.628977Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:05.628980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:05.629048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:05.629057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:05.629081Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ed0a1ef-73a7b1ba-47f24877-983a5ba2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:05.629097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:05.629100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:05.629103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:05.629113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:05.629127Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:05.629146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:05.629294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:05.629302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:05.629317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:05.629418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1748 partition: 0 MaxSeqNo: 42 sessionId: src_id|5ed0a1ef-73a7b1ba-47f24877-983a5ba2_0
2025-09-30T14:55:05.629835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56dec702-b452fbca-848f07e7-7a9af4a6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5ed0a1ef-73a7b1ba-47f24877-983a5ba2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:05.632699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed0a1ef-73a7b1ba-47f24877-983a5ba2_0] Write session: try to update token
2025-09-30T14:55:05.632724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed0a1ef-73a7b1ba-47f24877-983a5ba2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:05.649558Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:05.649585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:05.649596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895898583151589:10088]
2025-09-30T14:55:05.649656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:05.649657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:05.649862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:05.650031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:05.650062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1748 sessionId: src_id|5ed0a1ef-73a7b1ba-47f24877-983a5ba2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:05.650203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:05.650374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:05.650607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:05.650658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:05.653161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:05.654069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:05.654099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:05.654120Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:05.654123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:05.654126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:05.654129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:05.654142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895898583151589:10088]
2025-09-30T14:55:05.654148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895898583151589:10088]
2025-09-30T14:55:05.654152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895898583151589:10088]
2025-09-30T14:55:05.654198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:05.654199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:05.654207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.654209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:05.654211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:05.654215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:05.654358Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:05.709291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895898672919396:7977]
2025-09-30T14:55:05.709825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1747, pipe: [1:7555895898672919396:7977]
2025-09-30T14:55:05.766645Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:05.766971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:05.767014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895898672919396:7977], now have 1 active actors on pipe
2025-09-30T14:55:05.767806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed0a1ef-73a7b1ba-47f24877-983a5ba2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:05.767819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed0a1ef-73a7b1ba-47f24877-983a5ba2_0] Write session will restart in 0.007231s
2025-09-30T14:55:05.767842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed0a1ef-73a7b1ba-47f24877-983a5ba2_0] Write session: Do CDS request
2025-09-30T14:55:05.767848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed0a1ef-73a7b1ba-47f24877-983a5ba2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:05.767320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:05.767347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:05.767395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895898672919396:7977]
2025-09-30T14:55:05.767421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:05.767425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:05.767503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1748 reason: error at write: Disconnected sessionId: src_id|5ed0a1ef-73a7b1ba-47f24877-983a5ba2_0
2025-09-30T14:55:05.767649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1748 sessionId: src_id|5ed0a1ef-73a7b1ba-47f24877-983a5ba2_0 is DEAD
2025-09-30T14:55:05.776082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed0a1ef-73a7b1ba-47f24877-983a5ba2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:05.776193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:05.776213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1749
2025-09-30T14:55:05.776341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1749 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:05.776367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1749 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:05.776372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1749 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:05.776377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:05.776866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1749 sessionId:  describe result for acl check
2025-09-30T14:55:05.776903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:05.776906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:05.776908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:05.776914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895898672919441:7575] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:05.777469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895898672919441:7575] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:05.777549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:05.779491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:05.779691Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:05.779703Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:05.779715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:05.779782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:05.779826Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895898583151679:10090]
2025-09-30T14:55:05.779863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895898672919441:7575] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:05.780472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:05.780834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:05.780884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:05.781210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:05.781273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:05.781279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:05.781280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:05.781282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:05.781283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:05.781284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:05.781285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:05.781286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:05.781288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:05.781289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:05.781290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.781291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.781293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.781294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:05.781295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:05.781301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:05.781311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:05.781315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:05.781320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:05.781324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:05.781328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:05.781333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:05.781337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:05.781341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:05.781346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:05.781350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.781354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.781358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.781362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:05.781366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:05.781375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:05.781383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:05.781388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:05.781394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:05.781399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:05.781404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:05.781409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:05.781413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:05.781416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:05.781419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:05.781422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:05.781425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:05.781428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:05.781431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:05.781434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:05.781437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:05.781442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:05.781447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:05.781451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:05.781457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:05.781466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.781472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.781476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.781479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.781482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.781485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.781487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:05.781490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:05.781495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:05.781503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:05.781528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:05.787128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895898672919441:7575] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:05.787151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895898672919441:7575] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:05.787155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895898672919441:7575] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:05.787165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1749 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:05.787504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:05.788508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:05.788531Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:05.788534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:05.788537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:05.788544Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1748 [2:7555895898583151679:10090]
2025-09-30T14:55:05.788561Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:05.788577Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:05.788581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:05.788585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:05.788588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:05.788606Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:05.788619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:05.788626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:05.788690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.788697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.788701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.788705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:05.788707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:05.788777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:05.788783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.788796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.788813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.788833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:05.788856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895898672919397:2454], now have 1 active actors on pipe
2025-09-30T14:55:05.788864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895898672919482:7575], now have 1 active actors on pipe
2025-09-30T14:55:05.788871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895898583151673:10090]
2025-09-30T14:55:05.788877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895898583151673:10090]
2025-09-30T14:55:05.788880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895898583151673:10090]
2025-09-30T14:55:05.788891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:05.788905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:05.788916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:05.788922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:05.788924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:05.788939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:05.788945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:05.788924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1748
2025-09-30T14:55:05.788958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895898583151673:10090]
2025-09-30T14:55:05.788965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:05.788971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:05.788959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1748
2025-09-30T14:55:05.789000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:05.789008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:05.789042Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78e10425-a53e9184-8f58dc46-c070b48e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:05.789053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:05.789056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:05.789058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:05.789068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:05.789081Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:05.789100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:05.789279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:05.789302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:05.789330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:05.789477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1749 partition: 0 MaxSeqNo: 42 sessionId: src_id|78e10425-a53e9184-8f58dc46-c070b48e_0
2025-09-30T14:55:05.789873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed0a1ef-73a7b1ba-47f24877-983a5ba2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|78e10425-a53e9184-8f58dc46-c070b48e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:05.792822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78e10425-a53e9184-8f58dc46-c070b48e_0] Write session: try to update token
2025-09-30T14:55:05.792844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78e10425-a53e9184-8f58dc46-c070b48e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:05.803546Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:05.803567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:05.803571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:05.803573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:05.803585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895898583151673:10090]
2025-09-30T14:55:05.803590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895898583151673:10090]
2025-09-30T14:55:05.803594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895898583151673:10090]
2025-09-30T14:55:05.803637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:05.803645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.803649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:05.803695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:05.803715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:05.803720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:05.803798Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:05.811552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1749 sessionId: src_id|78e10425-a53e9184-8f58dc46-c070b48e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:05.814616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:05.867458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895898672919503:7977]
2025-09-30T14:55:05.867742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1748, pipe: [1:7555895898672919503:7977]
2025-09-30T14:55:05.921123Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:05.921578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:05.921589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:05.921632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895898672919503:7977], now have 1 active actors on pipe
2025-09-30T14:55:05.921925Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:05.921952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:05.922017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:05.922020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:05.922084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1749 reason: error at write: Disconnected sessionId: src_id|78e10425-a53e9184-8f58dc46-c070b48e_0
2025-09-30T14:55:05.922301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1749 sessionId: src_id|78e10425-a53e9184-8f58dc46-c070b48e_0 is DEAD
2025-09-30T14:55:05.922477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78e10425-a53e9184-8f58dc46-c070b48e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:05.922492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78e10425-a53e9184-8f58dc46-c070b48e_0] Write session will restart in 0.008819s
2025-09-30T14:55:05.922527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78e10425-a53e9184-8f58dc46-c070b48e_0] Write session: Do CDS request
2025-09-30T14:55:05.922511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895898672919503:7977]
2025-09-30T14:55:05.922533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78e10425-a53e9184-8f58dc46-c070b48e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:05.932824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78e10425-a53e9184-8f58dc46-c070b48e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:05.932933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:05.932953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1750
2025-09-30T14:55:05.933122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1750 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:05.933164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1750 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:05.933174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1750 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:05.933189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:05.933716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1750 sessionId:  describe result for acl check
2025-09-30T14:55:05.933761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:05.933770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:05.933772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:05.933778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895898672919562:7555] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:05.934398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895898672919562:7555] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:05.936278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:05.937227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:05.937437Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:05.937447Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:05.937457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:05.937517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:05.937557Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895898583151802:10105]
2025-09-30T14:55:05.937753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895898672919562:7555] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:05.938207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:05.938609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:05.938661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:05.939001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:05.939070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:05.939077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:05.939078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:05.939079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:05.939080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:05.939082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:05.939084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:05.939085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:05.939086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:05.939087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:05.939088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.939090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.939091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.939092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:05.939093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:05.939099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:05.939108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:05.939112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:05.939116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:05.939119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:05.939122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:05.939126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:05.939129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:05.939132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:05.939137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:05.939141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.939145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.939148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.939152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:05.939156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:05.939167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:05.939175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:05.939182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:05.939187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:05.939193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:05.939197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:05.939201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:05.939206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:05.939210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:05.939214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:05.939218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:05.939223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:05.939227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:05.939232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:05.939237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:05.939259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:05.939263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:05.939268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:05.939273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:05.939278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:05.939282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.939287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.939292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.939306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.939311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.939317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.939321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:05.939327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:05.939332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:05.939338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:05.939383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:05.946743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895898672919562:7555] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:05.946764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895898672919562:7555] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:05.946769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895898672919562:7555] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:05.946778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1750 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:05.949302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:05.950395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:05.950421Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:05.950424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:05.950429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:05.950437Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1749 [2:7555895898583151802:10105]
2025-09-30T14:55:05.950456Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:05.950476Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:05.950479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:05.950483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:05.950490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:05.950517Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:05.950524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:05.950532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:05.950608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.950611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.950613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.950617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:05.950620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:05.950700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:05.950703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.950721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:05.950733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:05.950753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:05.950772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895898583151797:10105]
2025-09-30T14:55:05.950775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895898583151797:10105]
2025-09-30T14:55:05.950776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895898583151797:10105]
2025-09-30T14:55:05.950786Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:05.950801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:05.950802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:05.950806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:05.950809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:05.950820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:05.950823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:05.950872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895898672919598:7555], now have 1 active actors on pipe
2025-09-30T14:55:05.950877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895898672919516:2454], now have 1 active actors on pipe
2025-09-30T14:55:05.950879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895898583151797:10105]
2025-09-30T14:55:05.950891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:05.950925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:05.951796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1749
2025-09-30T14:55:05.951830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1749
2025-09-30T14:55:05.951996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:05.952014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:05.952050Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|461230bd-11c7e34f-65e94cf9-5ced76e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:05.952061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:05.952069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:05.952079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:05.952091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:05.952110Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:05.952134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:05.952712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:05.952733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:05.952755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:05.952874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1750 partition: 0 MaxSeqNo: 42 sessionId: src_id|461230bd-11c7e34f-65e94cf9-5ced76e8_0
2025-09-30T14:55:05.953282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78e10425-a53e9184-8f58dc46-c070b48e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|461230bd-11c7e34f-65e94cf9-5ced76e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:05.956378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|461230bd-11c7e34f-65e94cf9-5ced76e8_0] Write session: try to update token
2025-09-30T14:55:05.956401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|461230bd-11c7e34f-65e94cf9-5ced76e8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:05.967931Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:05.967957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:05.967959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:05.967961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:05.967971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895898583151797:10105]
2025-09-30T14:55:05.967976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895898583151797:10105]
2025-09-30T14:55:05.967984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895898583151797:10105]
2025-09-30T14:55:05.968028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:05.968035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:05.968038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:05.968199Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:05.971580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:05.971619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:05.971624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:05.975326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1750 sessionId: src_id|461230bd-11c7e34f-65e94cf9-5ced76e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:05.978209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:06.022747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895902967886903:7977]
2025-09-30T14:55:06.023234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1749, pipe: [1:7555895902967886903:7977]
2025-09-30T14:55:06.089428Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:06.089787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:06.089804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:06.089845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895902967886903:7977], now have 1 active actors on pipe
2025-09-30T14:55:06.090688Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:06.091719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:06.091786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895902967886903:7977]
2025-09-30T14:55:06.091809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:06.091886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1750 reason: status is not ok: tablet will be restarted right now sessionId: src_id|461230bd-11c7e34f-65e94cf9-5ced76e8_0
2025-09-30T14:55:06.092070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1750 sessionId: src_id|461230bd-11c7e34f-65e94cf9-5ced76e8_0 is DEAD
2025-09-30T14:55:06.092531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|461230bd-11c7e34f-65e94cf9-5ced76e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:06.092542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|461230bd-11c7e34f-65e94cf9-5ced76e8_0] Write session will restart in 0.009604s
2025-09-30T14:55:06.092568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|461230bd-11c7e34f-65e94cf9-5ced76e8_0] Write session: Do CDS request
2025-09-30T14:55:06.092575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|461230bd-11c7e34f-65e94cf9-5ced76e8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:06.103790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|461230bd-11c7e34f-65e94cf9-5ced76e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:06.104169Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:06.104189Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1751
2025-09-30T14:55:06.104367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1751 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:06.104412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1751 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:06.104423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1751 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:06.104428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:06.104931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1751 sessionId:  describe result for acl check
2025-09-30T14:55:06.104981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:06.104983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:06.104985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:06.104992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895902967886913:7551] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:06.105572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895902967886913:7551] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:06.114558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895902967886913:7551] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:06.117824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895902967886913:7551] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:06.117844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895902967886913:7551] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:06.117847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895902967886913:7551] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:06.117857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1751 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:06.118184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:06.120531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:06.120793Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:06.120801Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:06.120813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:06.120878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:06.120923Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895902878119186:10107]
2025-09-30T14:55:06.121611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:06.122193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:06.122261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:06.122537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:06.122584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:06.122585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:06.122586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:06.122587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:06.122588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:06.122588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:06.122590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:06.122591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:06.122591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:06.122595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:06.122596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.122597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.122598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.122598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:06.122599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:06.122604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:06.122611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:06.122614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:06.122616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:06.122619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:06.122621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:06.122624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:06.122626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:06.122628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:06.122631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:06.122636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.122640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.122644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.122648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:06.122651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:06.122658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:06.122666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:06.122673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:06.122679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:06.122682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:06.122686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:06.122689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:06.122692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:06.122695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:06.122698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:06.122703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:06.122706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:06.122709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:06.122712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:06.122714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:06.122717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:06.122720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:06.122723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:06.122726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:06.122729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:06.122732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.122735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.122740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.122743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.122748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.122751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.122754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:06.122756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:06.122761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:06.122764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:06.122790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:06.132278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:06.133397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:06.133419Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:06.133423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:06.133428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:06.133436Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1750 [2:7555895902878119186:10107]
2025-09-30T14:55:06.133456Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:06.133478Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:06.133481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:06.133485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:06.133488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:06.133509Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:06.133526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:06.133538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:06.133599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.133606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.133609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.133612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:06.133615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:06.133711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:06.133721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.133735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.133746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.133762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:06.133780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895902878119180:10107]
2025-09-30T14:55:06.133789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895902878119180:10107]
2025-09-30T14:55:06.133791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895902878119180:10107]
2025-09-30T14:55:06.133806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:06.133819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:06.133833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:06.133837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:06.133877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895902878119180:10107]
2025-09-30T14:55:06.133885Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:06.134071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:06.134077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:06.134079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:06.134083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:06.134426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1750
2025-09-30T14:55:06.134442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1750
2025-09-30T14:55:06.135326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895902967886992:7551], now have 1 active actors on pipe
2025-09-30T14:55:06.135343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895902967886905:2454], now have 1 active actors on pipe
2025-09-30T14:55:06.135365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:06.135373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:06.135407Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3eb4e612-1898ab0f-6b4e80a5-96fce390_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:06.135424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:06.135428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:06.135431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:06.135445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:06.135460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:06.135479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:06.135728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:06.135745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:06.135777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:06.135909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1751 partition: 0 MaxSeqNo: 42 sessionId: src_id|3eb4e612-1898ab0f-6b4e80a5-96fce390_0
2025-09-30T14:55:06.136280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|461230bd-11c7e34f-65e94cf9-5ced76e8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3eb4e612-1898ab0f-6b4e80a5-96fce390_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:06.139465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb4e612-1898ab0f-6b4e80a5-96fce390_0] Write session: try to update token
2025-09-30T14:55:06.139487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb4e612-1898ab0f-6b4e80a5-96fce390_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:06.151511Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:06.151533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:06.151536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:06.151539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:06.151549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895902878119180:10107]
2025-09-30T14:55:06.151555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895902878119180:10107]
2025-09-30T14:55:06.151561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895902878119180:10107]
2025-09-30T14:55:06.151605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:06.151612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.151618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:06.151772Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:06.154792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:06.154801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:06.154807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:06.168274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1751 sessionId: src_id|3eb4e612-1898ab0f-6b4e80a5-96fce390_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:06.171194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:06.195345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895902967887008:7977]
2025-09-30T14:55:06.198703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1750, pipe: [1:7555895902967887008:7977]
2025-09-30T14:55:06.271193Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:06.271609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:06.271630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:06.271653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895902967887008:7977], now have 1 active actors on pipe
2025-09-30T14:55:06.271927Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:06.271950Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:06.271964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:06.271969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:06.272027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895902967887008:7977]
2025-09-30T14:55:06.272039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1751 reason: error at write: Disconnected sessionId: src_id|3eb4e612-1898ab0f-6b4e80a5-96fce390_0
2025-09-30T14:55:06.272387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb4e612-1898ab0f-6b4e80a5-96fce390_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:06.272399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb4e612-1898ab0f-6b4e80a5-96fce390_0] Write session will restart in 0.009081s
2025-09-30T14:55:06.272424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb4e612-1898ab0f-6b4e80a5-96fce390_0] Write session: Do CDS request
2025-09-30T14:55:06.272430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb4e612-1898ab0f-6b4e80a5-96fce390_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:06.272227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1751 sessionId: src_id|3eb4e612-1898ab0f-6b4e80a5-96fce390_0 is DEAD
2025-09-30T14:55:06.282807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb4e612-1898ab0f-6b4e80a5-96fce390_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:06.282934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:06.282963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1752
2025-09-30T14:55:06.283084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1752 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:06.283119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1752 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:06.283126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1752 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:06.283130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:06.283138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:06.283726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1752 sessionId:  describe result for acl check
2025-09-30T14:55:06.283789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:06.283791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:06.283793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:06.283799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895902967887059:7546] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:06.284470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895902967887059:7546] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:06.285524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:06.285801Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:06.285815Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:06.285827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:06.285891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:06.285940Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895902878119272:10109]
2025-09-30T14:55:06.286673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:06.287005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:06.287064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:06.287188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895902967887059:7546] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:06.287434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:06.287508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:06.287518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:06.287520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:06.287521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:06.287522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:06.287523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:06.287525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:06.287526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:06.287527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:06.287529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:06.287530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.287531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.287533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.287534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:06.287535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:06.287541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:06.287553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:06.287558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:06.287562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:06.287566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:06.287571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:06.287575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:06.287579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:06.287582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:06.287587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:06.287591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.287595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.287599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.287603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:06.287607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:06.287614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:06.287622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:06.287630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:06.287635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:06.287640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:06.287645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:06.287652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:06.287657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:06.287662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:06.287674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:06.287679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:06.287685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:06.287691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:06.287701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:06.287706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:06.287716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:06.287722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:06.287728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:06.287733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:06.287738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:06.287743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.287754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.287759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.287769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.287779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.287789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.287795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:06.287805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:06.287809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:06.287819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:06.287868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:06.293457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895902967887059:7546] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:06.293480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895902967887059:7546] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:06.293485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895902967887059:7546] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:06.293496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1752 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:06.293851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:06.294889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:06.294911Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:06.294915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:06.294924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:06.294932Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1751 [2:7555895902878119272:10109]
2025-09-30T14:55:06.294952Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:06.294971Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:06.294974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:06.294977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:06.294980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:06.295453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1751
2025-09-30T14:55:06.295482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1751
2025-09-30T14:55:06.294998Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:06.295015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:06.295023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:06.295094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.295096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.295099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.295103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:06.295105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:06.295183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:06.295186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.295201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.295213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.295232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:06.295271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895902878119266:10109]
2025-09-30T14:55:06.295274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895902878119266:10109]
2025-09-30T14:55:06.295276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895902878119266:10109]
2025-09-30T14:55:06.295292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:06.295311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895902967887009:2454], now have 1 active actors on pipe
2025-09-30T14:55:06.295318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:06.295319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:06.295325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:06.295327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:06.295334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:06.295338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:06.295347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895902967887098:7546], now have 1 active actors on pipe
2025-09-30T14:55:06.295388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895902878119266:10109]
2025-09-30T14:55:06.295398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:06.295574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:06.295750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:06.295762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:06.295792Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|980ba8ce-a9265d15-bd665eb2-524292e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:06.295807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:06.295817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:06.295819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:06.295832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:06.295844Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:06.295860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:06.296105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:06.296121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:06.296150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:06.296347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1752 partition: 0 MaxSeqNo: 42 sessionId: src_id|980ba8ce-a9265d15-bd665eb2-524292e8_0
2025-09-30T14:55:06.296782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb4e612-1898ab0f-6b4e80a5-96fce390_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|980ba8ce-a9265d15-bd665eb2-524292e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:06.300071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|980ba8ce-a9265d15-bd665eb2-524292e8_0] Write session: try to update token
2025-09-30T14:55:06.300095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|980ba8ce-a9265d15-bd665eb2-524292e8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:06.315581Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:06.315606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:06.315609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:06.315614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:06.315624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895902878119266:10109]
2025-09-30T14:55:06.315629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895902878119266:10109]
2025-09-30T14:55:06.315633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895902878119266:10109]
2025-09-30T14:55:06.315683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:06.315696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.315700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:06.315873Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:06.317526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:06.317550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:06.317554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:06.320844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1752 sessionId: src_id|980ba8ce-a9265d15-bd665eb2-524292e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:06.324164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:06.375379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895902967887106:7977]
2025-09-30T14:55:06.375863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1751, pipe: [1:7555895902967887106:7977]
2025-09-30T14:55:06.436769Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:06.437287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:06.437299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:06.437343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895902967887106:7977], now have 1 active actors on pipe
2025-09-30T14:55:06.438339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|980ba8ce-a9265d15-bd665eb2-524292e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:06.438351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|980ba8ce-a9265d15-bd665eb2-524292e8_0] Write session will restart in 0.006427s
2025-09-30T14:55:06.438376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|980ba8ce-a9265d15-bd665eb2-524292e8_0] Write session: Do CDS request
2025-09-30T14:55:06.438382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|980ba8ce-a9265d15-bd665eb2-524292e8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:06.437840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895902967887106:7977]
2025-09-30T14:55:06.437872Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:06.437907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:06.437909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:06.437970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1752 reason: error at write: Disconnected sessionId: src_id|980ba8ce-a9265d15-bd665eb2-524292e8_0
2025-09-30T14:55:06.438161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1752 sessionId: src_id|980ba8ce-a9265d15-bd665eb2-524292e8_0 is DEAD
2025-09-30T14:55:06.438768Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:06.446714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|980ba8ce-a9265d15-bd665eb2-524292e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:06.447632Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:06.447647Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1753
2025-09-30T14:55:06.447959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1753 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:06.448008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1753 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:06.448018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1753 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:06.448028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:06.448428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1753 sessionId:  describe result for acl check
2025-09-30T14:55:06.448458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:06.448464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:06.448465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:06.448470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895902967887155:7537] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:06.448892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895902967887155:7537] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:06.451951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:06.454792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:06.454992Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:06.455000Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:06.455009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:06.455050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:06.455087Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895902878119362:10112]
2025-09-30T14:55:06.455636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:06.456358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895902967887155:7537] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:06.456125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:06.456182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:06.456537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:06.456611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:06.456612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:06.456613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:06.456615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:06.456616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:06.456617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:06.456619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:06.456620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:06.456621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:06.456623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:06.456624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.456625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.456626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.456628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:06.456629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:06.456636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:06.456647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:06.456651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:06.456655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:06.456659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:06.456664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:06.456669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:06.456673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:06.456678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:06.456683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:06.456686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.456690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.456693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.456696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:06.456700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:06.456708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:06.456718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:06.456725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:06.456730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:06.456735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:06.456740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:06.456745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:06.456750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:06.456757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:06.456762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:06.456766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:06.456770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:06.456775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:06.456780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:06.456784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:06.456789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:06.456794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:06.456799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:06.456803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:06.456808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:06.456813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.456818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.456822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.456827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.456832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.456838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.456842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:06.456847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:06.456851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:06.456857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:06.456900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:06.465073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:06.466052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:06.466058Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:06.466064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:06.466068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:06.466074Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1752 [2:7555895902878119362:10112]
2025-09-30T14:55:06.466088Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:06.466105Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:06.466108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:06.466111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:06.466112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:06.466130Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:06.466138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:06.466145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:06.466203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.466204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.466205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.466208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:06.466210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:06.466286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:06.466288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.466305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.466319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.466334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:06.466353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895902878119357:10112]
2025-09-30T14:55:06.466355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895902878119357:10112]
2025-09-30T14:55:06.466357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895902878119357:10112]
2025-09-30T14:55:06.466371Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:06.466385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:06.466387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:06.466387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:06.466390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:06.466401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:06.466404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:06.466415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895902967887108:2454], now have 1 active actors on pipe
2025-09-30T14:55:06.466451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895902878119357:10112]
2025-09-30T14:55:06.466466Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:06.466747Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1752
2025-09-30T14:55:06.466694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:06.472455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895902967887155:7537] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:06.472475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895902967887155:7537] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:06.472482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895902967887155:7537] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:06.472493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1753 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:06.474156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1752
2025-09-30T14:55:06.474086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895902967887199:7537], now have 1 active actors on pipe
2025-09-30T14:55:06.474301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:06.474308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:06.474334Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e569ff3-9ca9163e-9814a8e2-91f7b711_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:06.474344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:06.474348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:06.474350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:06.474365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:06.474380Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:06.474396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:06.474659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:06.474667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:06.474691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:06.474824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1753 partition: 0 MaxSeqNo: 42 sessionId: src_id|e569ff3-9ca9163e-9814a8e2-91f7b711_0
2025-09-30T14:55:06.475220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|980ba8ce-a9265d15-bd665eb2-524292e8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e569ff3-9ca9163e-9814a8e2-91f7b711_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:06.478557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e569ff3-9ca9163e-9814a8e2-91f7b711_0] Write session: try to update token
2025-09-30T14:55:06.478586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e569ff3-9ca9163e-9814a8e2-91f7b711_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:06.482482Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:06.482505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:06.482508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:06.482510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:06.482522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895902878119357:10112]
2025-09-30T14:55:06.482527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895902878119357:10112]
2025-09-30T14:55:06.482531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895902878119357:10112]
2025-09-30T14:55:06.482575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:06.482585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.482587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:06.482746Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:06.487388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:06.487410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:06.487415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:06.505920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1753 sessionId: src_id|e569ff3-9ca9163e-9814a8e2-91f7b711_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:06.509064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:06.539329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895902967887204:7977]
2025-09-30T14:55:06.539774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1752, pipe: [1:7555895902967887204:7977]
2025-09-30T14:55:06.607186Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:06.607669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:06.607685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:06.607708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895902967887204:7977], now have 1 active actors on pipe
2025-09-30T14:55:06.608054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:06.608120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895902967887204:7977]
2025-09-30T14:55:06.608138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:06.608140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:06.608198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1753 reason: error at write: Disconnected sessionId: src_id|e569ff3-9ca9163e-9814a8e2-91f7b711_0
2025-09-30T14:55:06.608409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1753 sessionId: src_id|e569ff3-9ca9163e-9814a8e2-91f7b711_0 is DEAD
2025-09-30T14:55:06.608072Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:06.619508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e569ff3-9ca9163e-9814a8e2-91f7b711_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:06.619525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e569ff3-9ca9163e-9814a8e2-91f7b711_0] Write session will restart in 0.009291s
2025-09-30T14:55:06.619552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e569ff3-9ca9163e-9814a8e2-91f7b711_0] Write session: Do CDS request
2025-09-30T14:55:06.619562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e569ff3-9ca9163e-9814a8e2-91f7b711_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:06.624118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:06.626061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:06.626296Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:06.626300Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:06.626312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:06.626385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:06.626430Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895902878119464:10115]
2025-09-30T14:55:06.627111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:06.627526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:06.627584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:06.627947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:06.628032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:06.628034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:06.628035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:06.628036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:06.628038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:06.628039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:06.628041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:06.628042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:06.628043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:06.628044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:06.628045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.628046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.628048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.628049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:06.628051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:06.628057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:06.628070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:06.628075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:06.628080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:06.628085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:06.628089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:06.628092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:06.628096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:06.628100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:06.628105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:06.628109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.628114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.628118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.628122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:06.628126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:06.628135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:06.628143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:06.628150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:06.628157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:06.628162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:06.628168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:06.628173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:06.628179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:06.628185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:06.628192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:06.628198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:06.628204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:06.628209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:06.628215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:06.628221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:06.628227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:06.628232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:06.628240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:06.628246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:06.628251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:06.628257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.628263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.628268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.628275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.628279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.628284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.628289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:06.628294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:06.628300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:06.628305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:06.628355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:06.629717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e569ff3-9ca9163e-9814a8e2-91f7b711_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:06.633412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:06.633436Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1754
2025-09-30T14:55:06.635424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1754 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:06.635489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1754 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:06.635496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1754 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:06.635502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:06.635940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1754 sessionId:  describe result for acl check
2025-09-30T14:55:06.635979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:06.635990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:06.635993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:06.635999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895902967887276:7524] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:06.636380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:06.636617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895902967887276:7524] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:06.637610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:06.637629Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:06.637632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:06.637636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:06.637643Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1753 [2:7555895902878119464:10115]
2025-09-30T14:55:06.637662Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:06.637693Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:06.637697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:06.637703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:06.637705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:06.637723Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:06.637732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:06.637739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:06.637806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.637815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.637817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.637820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:06.637823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:06.637897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:06.637905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.637920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.637936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.637956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:06.637976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895902878119459:10115]
2025-09-30T14:55:06.637984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895902878119459:10115]
2025-09-30T14:55:06.637986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895902878119459:10115]
2025-09-30T14:55:06.637994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:06.638011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:06.638031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:06.638037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:06.638080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895902878119459:10115]
2025-09-30T14:55:06.638088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:06.638160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:06.638170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:06.638173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:06.638180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:06.638297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895902967887207:2454], now have 1 active actors on pipe
2025-09-30T14:55:06.638345Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1753
2025-09-30T14:55:06.639277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895902967887276:7524] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:06.647007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895902967887276:7524] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:06.647032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895902967887276:7524] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:06.647037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895902967887276:7524] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:06.647047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1754 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:06.647411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895902967887313:7524], now have 1 active actors on pipe
2025-09-30T14:55:06.647544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1753
2025-09-30T14:55:06.647714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:06.647733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:06.647766Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45be93d-3d3a1cee-fc9acf90-82646be1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:06.647778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:06.647784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:06.647787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:06.647801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:06.647817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:06.647836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:06.648149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:06.648164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:06.648193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:06.648283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1754 partition: 0 MaxSeqNo: 42 sessionId: src_id|45be93d-3d3a1cee-fc9acf90-82646be1_0
2025-09-30T14:55:06.651105Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:06.651124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:06.651128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:06.651130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:06.651140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895902878119459:10115]
2025-09-30T14:55:06.651145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895902878119459:10115]
2025-09-30T14:55:06.651150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895902878119459:10115]
2025-09-30T14:55:06.651190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:06.651198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:06.651205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:06.651208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.651210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:06.651211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:06.651361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e569ff3-9ca9163e-9814a8e2-91f7b711_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|45be93d-3d3a1cee-fc9acf90-82646be1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:06.651382Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:06.654300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45be93d-3d3a1cee-fc9acf90-82646be1_0] Write session: try to update token
2025-09-30T14:55:06.654321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45be93d-3d3a1cee-fc9acf90-82646be1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:06.680808Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1754 sessionId: src_id|45be93d-3d3a1cee-fc9acf90-82646be1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:06.684241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:06.708177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895902967887318:7977]
2025-09-30T14:55:06.708495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1753, pipe: [1:7555895902967887318:7977]
2025-09-30T14:55:06.778702Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:06.779092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:06.779108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:06.779128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895902967887318:7977], now have 1 active actors on pipe
2025-09-30T14:55:06.779503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:06.779508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895902967887318:7977]
2025-09-30T14:55:06.779522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:06.779530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:06.779591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1754 reason: error at write: Disconnected sessionId: src_id|45be93d-3d3a1cee-fc9acf90-82646be1_0
2025-09-30T14:55:06.779687Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:06.779776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1754 sessionId: src_id|45be93d-3d3a1cee-fc9acf90-82646be1_0 is DEAD
2025-09-30T14:55:06.779962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45be93d-3d3a1cee-fc9acf90-82646be1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:06.779972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45be93d-3d3a1cee-fc9acf90-82646be1_0] Write session will restart in 0.009093s
2025-09-30T14:55:06.780006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45be93d-3d3a1cee-fc9acf90-82646be1_0] Write session: Do CDS request
2025-09-30T14:55:06.780013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45be93d-3d3a1cee-fc9acf90-82646be1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:06.790546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:06.790879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45be93d-3d3a1cee-fc9acf90-82646be1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:06.790968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:06.790985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1755
2025-09-30T14:55:06.791507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1755 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:06.791550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1755 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:06.791559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1755 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:06.791565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:06.791995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1755 sessionId:  describe result for acl check
2025-09-30T14:55:06.792029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:06.792031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:06.792033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:06.792040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895902967887372:7515] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:06.792611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895902967887372:7515] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:06.793066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:06.793288Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:06.793301Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:06.793312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:06.793366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:06.793407Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895902878119556:10117]
2025-09-30T14:55:06.794058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:06.794370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:06.794421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:06.794753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:06.794828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:06.794834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:06.794835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:06.794836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:06.794837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:06.794838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:06.794839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:06.794841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:06.794842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:06.794843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:06.794844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.794846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.794847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.794848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:06.794849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:06.794855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:06.794865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:06.794870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:06.794875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:06.794879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:06.794882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:06.794887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:06.794891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:06.794894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:06.794898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:06.794902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.794905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.794908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.794911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:06.794914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:06.794923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:06.794933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:06.794939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:06.794945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:06.794949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:06.794954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:06.794958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:06.794965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:06.794971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:06.794975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:06.794980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:06.794985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:06.794989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:06.794994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:06.794998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:06.795002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:06.795007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:06.795012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:06.795016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:06.795021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:06.795025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.795031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.795035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.795040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.795045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.795051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.795055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:06.795060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:06.795065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:06.795069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:06.795112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:06.795020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895902967887372:7515] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:06.801241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895902967887372:7515] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:06.801262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895902967887372:7515] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:06.801266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895902967887372:7515] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:06.801276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1755 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:06.801635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:06.802902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:06.802929Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:06.802932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:06.802935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:06.802942Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1754 [2:7555895902878119556:10117]
2025-09-30T14:55:06.802959Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:06.802976Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:06.802980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:06.802983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:06.802986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:06.803005Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:06.803011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:06.803025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:06.803093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.803101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.803103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.803106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:06.803108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:06.803174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:06.803182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.803197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.803207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.803222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:06.803262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895902878119547:10117]
2025-09-30T14:55:06.803269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895902878119547:10117]
2025-09-30T14:55:06.803274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895902878119547:10117]
2025-09-30T14:55:06.803288Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:06.803304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:06.803308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:06.803310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895902967887410:7515], now have 1 active actors on pipe
2025-09-30T14:55:06.803310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:06.803313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895902967887319:2454], now have 1 active actors on pipe
2025-09-30T14:55:06.803321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:06.803336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:06.803338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:06.803361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1754
2025-09-30T14:55:06.803379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895902878119547:10117]
2025-09-30T14:55:06.803416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1754
2025-09-30T14:55:06.803405Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:06.803435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:06.803514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:06.803535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:06.803574Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8bc0e2d-4106b0d9-86b539bd-ccf63d7f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:06.803592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:06.803599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:06.803602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:06.803613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:06.803625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:06.803642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:06.803861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:06.803872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:06.803895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:06.804005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1755 partition: 0 MaxSeqNo: 42 sessionId: src_id|b8bc0e2d-4106b0d9-86b539bd-ccf63d7f_0
2025-09-30T14:55:06.804407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45be93d-3d3a1cee-fc9acf90-82646be1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b8bc0e2d-4106b0d9-86b539bd-ccf63d7f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:06.807401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8bc0e2d-4106b0d9-86b539bd-ccf63d7f_0] Write session: try to update token
2025-09-30T14:55:06.807424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8bc0e2d-4106b0d9-86b539bd-ccf63d7f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:06.816593Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:06.816619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:06.816629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895902878119547:10117]
2025-09-30T14:55:06.816677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:06.816697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:06.816882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:06.817043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:06.817198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:06.817353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:06.817563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:06.817611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:06.829158Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:06.829181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:06.829183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:06.829185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:06.829195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895902878119547:10117]
2025-09-30T14:55:06.829199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895902878119547:10117]
2025-09-30T14:55:06.829202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895902878119547:10117]
2025-09-30T14:55:06.829258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:06.829266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.829264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:06.829272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:06.829276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:06.829277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:06.829441Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:06.828322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1755 sessionId: src_id|b8bc0e2d-4106b0d9-86b539bd-ccf63d7f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:06.831134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:06.879709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895902967887418:7977]
2025-09-30T14:55:06.880221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1754, pipe: [1:7555895902967887418:7977]
2025-09-30T14:55:06.948606Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:06.948946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:06.948968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:06.948992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895902967887418:7977], now have 1 active actors on pipe
2025-09-30T14:55:06.949200Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:06.949277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:06.949286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:06.949325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895902967887418:7977]
2025-09-30T14:55:06.949378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1755 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b8bc0e2d-4106b0d9-86b539bd-ccf63d7f_0
2025-09-30T14:55:06.949578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1755 sessionId: src_id|b8bc0e2d-4106b0d9-86b539bd-ccf63d7f_0 is DEAD
2025-09-30T14:55:06.949759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8bc0e2d-4106b0d9-86b539bd-ccf63d7f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:06.949772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8bc0e2d-4106b0d9-86b539bd-ccf63d7f_0] Write session will restart in 0.007648s
2025-09-30T14:55:06.949797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8bc0e2d-4106b0d9-86b539bd-ccf63d7f_0] Write session: Do CDS request
2025-09-30T14:55:06.949803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8bc0e2d-4106b0d9-86b539bd-ccf63d7f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:06.958924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8bc0e2d-4106b0d9-86b539bd-ccf63d7f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:06.959023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:06.959042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1756
2025-09-30T14:55:06.959584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1756 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:06.959621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1756 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:06.959633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1756 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:06.959637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:06.960123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1756 sessionId:  describe result for acl check
2025-09-30T14:55:06.960168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:06.960176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:06.960178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:06.960184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895902967887494:7502] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:06.960800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895902967887494:7502] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:06.960833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:06.962759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:06.962992Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:06.963004Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:06.963017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:06.963077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:06.963122Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895902878119683:10132]
2025-09-30T14:55:06.963497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895902967887494:7502] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:06.963824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:06.964147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:06.964193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:06.964563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:06.964640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:06.964649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:06.964650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:06.964652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:06.964653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:06.964654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:06.964655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:06.964657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:06.964658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:06.964659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:06.964661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.964662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.964665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.964666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:06.964667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:06.964673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:06.964683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:06.964687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:06.964690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:06.964695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:06.964699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:06.964702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:06.964706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:06.964709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:06.964715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:06.964718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.964721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.964725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.964729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:06.964732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:06.964741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:06.964749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:06.964754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:06.964760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:06.964765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:06.964771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:06.964776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:06.964781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:06.964785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:06.964790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:06.964795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:06.964800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:06.964804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:06.964812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:06.964817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:06.964823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:06.964827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:06.964832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:06.964836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:06.964841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:06.964846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.964850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.964855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.964860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.964864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.964869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.964873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:06.964878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:06.964883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:06.964889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:06.964943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:06.970649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895902967887494:7502] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:06.970671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895902967887494:7502] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:06.970675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895902967887494:7502] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:06.970685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1756 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:06.970873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:06.972086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:06.972104Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:06.972107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:06.972112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:06.972119Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1755 [2:7555895902878119683:10132]
2025-09-30T14:55:06.972137Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:06.972154Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:06.972164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:06.972167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:06.972169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:06.972190Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:06.972205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:06.972212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:06.972278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.972287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.972289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.972294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:06.972296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:06.972371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:06.972384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.972397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:06.972410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:06.972433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:06.972462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895902967887531:7502], now have 1 active actors on pipe
2025-09-30T14:55:06.972466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895902967887432:2454], now have 1 active actors on pipe
2025-09-30T14:55:06.972473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895902878119677:10132]
2025-09-30T14:55:06.972475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895902878119677:10132]
2025-09-30T14:55:06.972477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895902878119677:10132]
2025-09-30T14:55:06.972490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:06.972504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:06.972505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:06.972509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:06.972511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:06.972521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:06.972524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:06.972565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895902878119677:10132]
2025-09-30T14:55:06.972541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1755
2025-09-30T14:55:06.972546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1755
2025-09-30T14:55:06.972576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:06.972579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:06.972608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:06.972614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:06.972657Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|830aa333-f8dfa4b7-e5da93fe-16665234_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:06.972671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:06.972675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:06.972683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:06.972694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:06.972724Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:06.972750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:06.972949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:06.972963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:06.972989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:06.973101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1756 partition: 0 MaxSeqNo: 42 sessionId: src_id|830aa333-f8dfa4b7-e5da93fe-16665234_0
2025-09-30T14:55:06.973518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8bc0e2d-4106b0d9-86b539bd-ccf63d7f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|830aa333-f8dfa4b7-e5da93fe-16665234_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:06.976617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|830aa333-f8dfa4b7-e5da93fe-16665234_0] Write session: try to update token
2025-09-30T14:55:06.976640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|830aa333-f8dfa4b7-e5da93fe-16665234_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:06.986070Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:06.986095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:06.986098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:06.986101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:06.986113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895902878119677:10132]
2025-09-30T14:55:06.986118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895902878119677:10132]
2025-09-30T14:55:06.986125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895902878119677:10132]
2025-09-30T14:55:06.986172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:06.986189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:06.986189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:06.986196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:06.986200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:06.986202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:06.986391Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:06.993319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1756 sessionId: src_id|830aa333-f8dfa4b7-e5da93fe-16665234_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:06.996231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:07.049733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895907262854836:7977]
2025-09-30T14:55:07.050308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1755, pipe: [1:7555895907262854836:7977]
2025-09-30T14:55:07.106851Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:07.107286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:07.107307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:07.107329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895907262854836:7977], now have 1 active actors on pipe
2025-09-30T14:55:07.107582Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:07.107628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:07.107659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895907262854836:7977]
2025-09-30T14:55:07.107684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:07.107777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1756 reason: status is not ok: tablet will be restarted right now sessionId: src_id|830aa333-f8dfa4b7-e5da93fe-16665234_0
2025-09-30T14:55:07.107982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1756 sessionId: src_id|830aa333-f8dfa4b7-e5da93fe-16665234_0 is DEAD
2025-09-30T14:55:07.108150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|830aa333-f8dfa4b7-e5da93fe-16665234_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:07.108162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|830aa333-f8dfa4b7-e5da93fe-16665234_0] Write session will restart in 0.005343s
2025-09-30T14:55:07.108197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|830aa333-f8dfa4b7-e5da93fe-16665234_0] Write session: Do CDS request
2025-09-30T14:55:07.108204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|830aa333-f8dfa4b7-e5da93fe-16665234_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:07.114833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|830aa333-f8dfa4b7-e5da93fe-16665234_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:07.114918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:07.114937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1757
2025-09-30T14:55:07.115090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1757 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:07.115140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1757 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:07.115147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1757 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:07.115151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:07.115645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1757 sessionId:  describe result for acl check
2025-09-30T14:55:07.115686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:07.115689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:07.115691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:07.115697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895907262854863:7496] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:07.116285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895907262854863:7496] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:07.118394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895907262854863:7496] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:07.119120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:07.121749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895907262854863:7496] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:07.121770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895907262854863:7496] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:07.121773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895907262854863:7496] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:07.121784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1757 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:07.121423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:07.121694Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:07.121699Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:07.121712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:07.121791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:07.121835Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895907173087070:10134]
2025-09-30T14:55:07.122417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:07.122975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:07.123053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:07.123478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:07.123574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:07.123581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:07.123582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:07.123583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:07.123585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:07.123586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:07.123588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:07.123590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:07.123591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:07.123592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:07.123594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.123596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.123597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.123598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:07.123600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:07.123606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:07.123618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:07.123623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:07.123627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:07.123630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:07.123636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:07.123640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:07.123643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:07.123647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:07.123652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:07.123657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.123660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.123663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.123669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:07.123673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:07.123684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:07.123693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:07.123698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:07.123705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:07.123710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:07.123716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:07.123721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:07.123726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:07.123733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:07.123745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:07.123750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:07.123755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:07.123771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:07.123780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:07.123785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:07.123790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:07.123795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:07.123806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:07.123810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:07.123815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:07.123821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.123831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.123835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.123841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.123846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.123852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.123856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:07.123861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:07.123866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:07.123872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:07.123922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:07.130098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:07.131164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:07.131188Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:07.131206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:07.131211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:07.131219Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1756 [2:7555895907173087070:10134]
2025-09-30T14:55:07.131237Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:07.131281Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:07.131289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:07.131293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:07.131296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:07.131314Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:07.131321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:07.131329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:07.131399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.131407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.131410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.131414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:07.131417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:07.131496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:07.131506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.131519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.131531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.131550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:07.131570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895907262854837:2454], now have 1 active actors on pipe
2025-09-30T14:55:07.131580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895907262854930:7496], now have 1 active actors on pipe
2025-09-30T14:55:07.131586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895907173087064:10134]
2025-09-30T14:55:07.131594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895907173087064:10134]
2025-09-30T14:55:07.131596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895907173087064:10134]
2025-09-30T14:55:07.131608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:07.131628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:07.131650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:07.131657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:07.131659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:07.131683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:07.131696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:07.131701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895907173087064:10134]
2025-09-30T14:55:07.131704Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:07.131706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:07.131868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1756
2025-09-30T14:55:07.131912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1756
2025-09-30T14:55:07.132104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:07.132119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:07.132150Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6bbee1a-d0d6bf3d-2b62a785-f9832c99_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:07.132166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:07.132185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:07.132188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:07.132199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:07.132214Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:07.132233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:07.132493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:07.132503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:07.132523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:07.132660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1757 partition: 0 MaxSeqNo: 42 sessionId: src_id|e6bbee1a-d0d6bf3d-2b62a785-f9832c99_0
2025-09-30T14:55:07.133141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|830aa333-f8dfa4b7-e5da93fe-16665234_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e6bbee1a-d0d6bf3d-2b62a785-f9832c99_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:07.136285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6bbee1a-d0d6bf3d-2b62a785-f9832c99_0] Write session: try to update token
2025-09-30T14:55:07.136309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6bbee1a-d0d6bf3d-2b62a785-f9832c99_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:07.145347Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:07.145369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:07.145371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:07.145374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:07.145388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895907173087064:10134]
2025-09-30T14:55:07.145396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895907173087064:10134]
2025-09-30T14:55:07.145403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895907173087064:10134]
2025-09-30T14:55:07.145450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:07.145458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:07.145464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.145464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:07.145467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:07.145469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:07.145621Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:07.156488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1757 sessionId: src_id|e6bbee1a-d0d6bf3d-2b62a785-f9832c99_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:07.159492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:07.207893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895907262854946:7977]
2025-09-30T14:55:07.208253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1756, pipe: [1:7555895907262854946:7977]
2025-09-30T14:55:07.264204Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:07.264725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:07.264748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:07.264770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895907262854946:7977], now have 1 active actors on pipe
2025-09-30T14:55:07.265015Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:07.265129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:07.265200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:07.265302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1757 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e6bbee1a-d0d6bf3d-2b62a785-f9832c99_0
2025-09-30T14:55:07.265479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1757 sessionId: src_id|e6bbee1a-d0d6bf3d-2b62a785-f9832c99_0 is DEAD
2025-09-30T14:55:07.265633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895907262854946:7977]
2025-09-30T14:55:07.267517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6bbee1a-d0d6bf3d-2b62a785-f9832c99_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:07.267529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6bbee1a-d0d6bf3d-2b62a785-f9832c99_0] Write session will restart in 0.006099s
2025-09-30T14:55:07.267555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6bbee1a-d0d6bf3d-2b62a785-f9832c99_0] Write session: Do CDS request
2025-09-30T14:55:07.267561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6bbee1a-d0d6bf3d-2b62a785-f9832c99_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:07.275003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6bbee1a-d0d6bf3d-2b62a785-f9832c99_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:07.275101Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:07.275125Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1758
2025-09-30T14:55:07.275305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1758 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:07.275342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1758 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:07.275366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1758 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:07.275370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:07.275870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1758 sessionId:  describe result for acl check
2025-09-30T14:55:07.275908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:07.275910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:07.275912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:07.275921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895907262854962:7488] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:07.276513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895907262854962:7488] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:07.279703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:07.280312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895907262854962:7488] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:07.282070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:07.282325Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:07.282336Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:07.282347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:07.282417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:07.282466Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895907173087163:10136]
2025-09-30T14:55:07.282998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895907262854962:7488] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:07.283018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895907262854962:7488] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:07.283024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895907262854962:7488] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:07.283033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1758 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:07.283149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:07.283507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:07.283579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:07.283969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:07.284045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:07.284051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:07.284052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:07.284053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:07.284055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:07.284056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:07.284057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:07.284058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:07.284062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:07.284063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:07.284065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.284066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.284067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.284068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:07.284069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:07.284075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:07.284085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:07.284089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:07.284094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:07.284098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:07.284102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:07.284105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:07.284109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:07.284113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:07.284118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:07.284122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.284126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.284130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.284134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:07.284138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:07.284145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:07.284153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:07.284159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:07.284164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:07.284169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:07.284174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:07.284178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:07.284183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:07.284188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:07.284205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:07.284214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:07.284219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:07.284223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:07.284228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:07.284237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:07.284242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:07.284246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:07.284251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:07.284255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:07.284261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:07.284268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.284272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.284276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.284284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.284289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.284294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.284303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:07.284309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:07.284316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:07.284326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:07.284366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:07.291201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:07.292188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:07.292207Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:07.292210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:07.292215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:07.292223Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1757 [2:7555895907173087163:10136]
2025-09-30T14:55:07.292240Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:07.292261Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:07.292268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:07.292272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:07.292276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:07.292295Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:07.292307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:07.292314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:07.292386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.292391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.292394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.292397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:07.292399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:07.292477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:07.292486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.292500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.292513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.292532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:07.292549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895907173087158:10136]
2025-09-30T14:55:07.292558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895907173087158:10136]
2025-09-30T14:55:07.292560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895907173087158:10136]
2025-09-30T14:55:07.292575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:07.292594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:07.292614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:07.292621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:07.292666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895907173087158:10136]
2025-09-30T14:55:07.292673Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:07.292811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:07.292820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:07.292822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:07.292828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:07.293083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895907262855040:7488], now have 1 active actors on pipe
2025-09-30T14:55:07.293099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895907262854947:2454], now have 1 active actors on pipe
2025-09-30T14:55:07.293162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1757
2025-09-30T14:55:07.293209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1757
2025-09-30T14:55:07.293342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:07.293355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:07.293383Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac414589-8012ec93-e0483d8-68a23074_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:07.293408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:07.293419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:07.293422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:07.293434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:07.293446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:07.293462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:07.293798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:07.293822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:07.293843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:07.293950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1758 partition: 0 MaxSeqNo: 42 sessionId: src_id|ac414589-8012ec93-e0483d8-68a23074_0
2025-09-30T14:55:07.294356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6bbee1a-d0d6bf3d-2b62a785-f9832c99_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ac414589-8012ec93-e0483d8-68a23074_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:07.297410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac414589-8012ec93-e0483d8-68a23074_0] Write session: try to update token
2025-09-30T14:55:07.297433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac414589-8012ec93-e0483d8-68a23074_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:07.308443Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:07.308470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:07.308473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:07.308475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:07.308489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895907173087158:10136]
2025-09-30T14:55:07.308495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895907173087158:10136]
2025-09-30T14:55:07.308499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895907173087158:10136]
2025-09-30T14:55:07.308549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:07.308561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.308565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:07.308738Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:07.311187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:07.311210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:07.311214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:07.326369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1758 sessionId: src_id|ac414589-8012ec93-e0483d8-68a23074_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:07.329509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:07.363553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895907262855052:7977]
2025-09-30T14:55:07.363905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1757, pipe: [1:7555895907262855052:7977]
2025-09-30T14:55:07.446185Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:07.446661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:07.446686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:07.446710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895907262855052:7977], now have 1 active actors on pipe
2025-09-30T14:55:07.446971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895907262855052:7977]
2025-09-30T14:55:07.447012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:07.447019Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:07.447048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:07.447058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:07.447129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1758 reason: error at write: Disconnected sessionId: src_id|ac414589-8012ec93-e0483d8-68a23074_0
2025-09-30T14:55:07.447366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1758 sessionId: src_id|ac414589-8012ec93-e0483d8-68a23074_0 is DEAD
2025-09-30T14:55:07.447494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac414589-8012ec93-e0483d8-68a23074_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:07.447505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac414589-8012ec93-e0483d8-68a23074_0] Write session will restart in 0.005337s
2025-09-30T14:55:07.447528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac414589-8012ec93-e0483d8-68a23074_0] Write session: Do CDS request
2025-09-30T14:55:07.447537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac414589-8012ec93-e0483d8-68a23074_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:07.453799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac414589-8012ec93-e0483d8-68a23074_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:07.453869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:07.453889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1759
2025-09-30T14:55:07.454134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1759 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:07.454177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1759 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:07.454187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1759 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:07.454191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:07.454675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1759 sessionId:  describe result for acl check
2025-09-30T14:55:07.454714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:07.454716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:07.454718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:07.454723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895907262855075:7485] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:07.455280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895907262855075:7485] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:07.457514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895907262855075:7485] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:07.457567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:07.459639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:07.459852Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:07.459865Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:07.459875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:07.459928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:07.459968Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895907173087260:10139]
2025-09-30T14:55:07.460452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895907262855075:7485] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:07.460466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895907262855075:7485] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:07.460470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895907262855075:7485] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:07.460478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1759 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:07.460610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:07.460911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:07.460944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:07.461259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:07.461323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:07.461329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:07.461330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:07.461331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:07.461332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:07.461334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:07.461335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:07.461336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:07.461337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:07.461339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:07.461340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.461341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.461342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.461343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:07.461344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:07.461351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:07.461360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:07.461363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:07.461367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:07.461370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:07.461374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:07.461377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:07.461380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:07.461384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:07.461389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:07.461392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.461395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.461398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.461402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:07.461405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:07.461412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:07.461420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:07.461425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:07.461430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:07.461436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:07.461441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:07.461450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:07.461455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:07.461462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:07.461478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:07.461487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:07.461492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:07.461496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:07.461501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:07.461504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:07.461509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:07.461514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:07.461524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:07.461528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:07.461538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:07.461542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.461548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.461551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.461556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.461562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.461567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.461572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:07.461576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:07.461580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:07.461585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:07.461627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:07.468228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:07.469127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:07.469146Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:07.469149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:07.469152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:07.469159Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1758 [2:7555895907173087260:10139]
2025-09-30T14:55:07.469173Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:07.469187Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:07.469189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:07.469192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:07.469194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:07.469214Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:07.469220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:07.469227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:07.469429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.469433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.469435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.469439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:07.469441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:07.469523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:07.469526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.469540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.469551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.469568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:07.469588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895907173087253:10139]
2025-09-30T14:55:07.469590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895907173087253:10139]
2025-09-30T14:55:07.469594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895907173087253:10139]
2025-09-30T14:55:07.469603Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:07.469621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:07.469628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:07.469632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:07.469635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:07.469635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:07.469637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:07.469648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895907262855147:7485], now have 1 active actors on pipe
2025-09-30T14:55:07.469705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895907262855054:2454], now have 1 active actors on pipe
2025-09-30T14:55:07.469785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1758
2025-09-30T14:55:07.469821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1758
2025-09-30T14:55:07.469710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895907173087253:10139]
2025-09-30T14:55:07.469719Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:07.469727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:07.470357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:07.470377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:07.470410Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44c4e053-61773188-fa49ddf1-fb5a743_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:07.470420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:07.470424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:07.470429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:07.470440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:07.470453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:07.470476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:07.470883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:07.470896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:07.470917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:07.471076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1759 partition: 0 MaxSeqNo: 42 sessionId: src_id|44c4e053-61773188-fa49ddf1-fb5a743_0
2025-09-30T14:55:07.471521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac414589-8012ec93-e0483d8-68a23074_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|44c4e053-61773188-fa49ddf1-fb5a743_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:07.474423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44c4e053-61773188-fa49ddf1-fb5a743_0] Write session: try to update token
2025-09-30T14:55:07.474444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44c4e053-61773188-fa49ddf1-fb5a743_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:07.484324Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:07.484348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:07.484351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:07.484354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:07.484373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895907173087253:10139]
2025-09-30T14:55:07.484377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895907173087253:10139]
2025-09-30T14:55:07.484382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895907173087253:10139]
2025-09-30T14:55:07.484431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:07.484438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.484441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:07.484452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:07.484459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:07.484465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:07.484603Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:07.490736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1759 sessionId: src_id|44c4e053-61773188-fa49ddf1-fb5a743_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:07.493744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:07.547353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895907262855158:7977]
2025-09-30T14:55:07.547683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1758, pipe: [1:7555895907262855158:7977]
2025-09-30T14:55:07.609692Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:07.610026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:07.610042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:07.610084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895907262855158:7977], now have 1 active actors on pipe
2025-09-30T14:55:07.610387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:07.610320Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:07.610404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:07.610421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895907262855158:7977]
2025-09-30T14:55:07.610442Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:07.610862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44c4e053-61773188-fa49ddf1-fb5a743_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:07.610874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44c4e053-61773188-fa49ddf1-fb5a743_0] Write session will restart in 0.008412s
2025-09-30T14:55:07.610908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44c4e053-61773188-fa49ddf1-fb5a743_0] Write session: Do CDS request
2025-09-30T14:55:07.610484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1759 reason: error at write: Disconnected sessionId: src_id|44c4e053-61773188-fa49ddf1-fb5a743_0
2025-09-30T14:55:07.610913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44c4e053-61773188-fa49ddf1-fb5a743_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:07.610687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1759 sessionId: src_id|44c4e053-61773188-fa49ddf1-fb5a743_0 is DEAD
2025-09-30T14:55:07.620793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44c4e053-61773188-fa49ddf1-fb5a743_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:07.621162Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:07.621181Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1760
2025-09-30T14:55:07.622023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1760 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:07.622088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1760 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:07.622098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1760 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:07.622103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:07.622786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1760 sessionId:  describe result for acl check
2025-09-30T14:55:07.622824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:07.622831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:07.622834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:07.622841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895907262855205:7472] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:07.623487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895907262855205:7472] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:07.625346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:07.625422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895907262855205:7472] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:07.627214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:07.627460Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:07.627473Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:07.627484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:07.627537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:07.627580Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895907173087367:10142]
2025-09-30T14:55:07.627936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895907262855205:7472] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:07.627955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895907262855205:7472] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:07.627959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895907262855205:7472] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:07.627967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1760 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:07.628281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:07.628581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:07.628631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:07.628994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:07.629053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:07.629060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:07.629061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:07.629062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:07.629064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:07.629066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:07.629067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:07.629068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:07.629070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:07.629071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:07.629072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.629074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.629075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.629076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:07.629077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:07.629084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:07.629095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:07.629100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:07.629105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:07.629109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:07.629114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:07.629118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:07.629123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:07.629127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:07.629132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:07.629136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.629140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.629145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.629149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:07.629153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:07.629160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:07.629171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:07.629183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:07.629192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:07.629202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:07.629208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:07.629218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:07.629224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:07.629235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:07.629240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:07.629245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:07.629256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:07.629262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:07.629272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:07.629278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:07.629289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:07.629296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:07.629306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:07.629311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:07.629317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:07.629322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.629330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.629334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.629340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.629345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.629352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.629361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:07.629367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:07.629372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:07.629383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:07.629435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:07.635434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:07.636393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:07.636412Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:07.636414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:07.636420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:07.636569Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1759 [2:7555895907173087367:10142]
2025-09-30T14:55:07.636586Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:07.636604Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:07.636607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:07.636611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:07.636614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:07.636630Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:07.636636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:07.636642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:07.636703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.636705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.636707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.636711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:07.636715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:07.636784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:07.636788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.636803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.636817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.636833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:07.636851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895907173087361:10142]
2025-09-30T14:55:07.636854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895907173087361:10142]
2025-09-30T14:55:07.636856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895907173087361:10142]
2025-09-30T14:55:07.636875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:07.636893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895907262855161:2454], now have 1 active actors on pipe
2025-09-30T14:55:07.636896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895907262855255:7472], now have 1 active actors on pipe
2025-09-30T14:55:07.636901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:07.636905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:07.636905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:07.636909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:07.636919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:07.636922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:07.636961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895907173087361:10142]
2025-09-30T14:55:07.636967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:07.636986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:07.637124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:07.637132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:07.637159Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5f84f9f-7803fac1-aad8daf8-aac950dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:07.637170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:07.637174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:07.637176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:07.636983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1759
2025-09-30T14:55:07.637188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:07.637040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1759
2025-09-30T14:55:07.637210Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:07.637233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:07.637414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:07.637424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:07.637439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:07.637542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1760 partition: 0 MaxSeqNo: 42 sessionId: src_id|c5f84f9f-7803fac1-aad8daf8-aac950dc_0
2025-09-30T14:55:07.637962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44c4e053-61773188-fa49ddf1-fb5a743_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c5f84f9f-7803fac1-aad8daf8-aac950dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:07.640972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5f84f9f-7803fac1-aad8daf8-aac950dc_0] Write session: try to update token
2025-09-30T14:55:07.640995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5f84f9f-7803fac1-aad8daf8-aac950dc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:07.652231Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:07.652270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:07.652272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:07.652274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:07.652284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895907173087361:10142]
2025-09-30T14:55:07.652288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895907173087361:10142]
2025-09-30T14:55:07.652298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895907173087361:10142]
2025-09-30T14:55:07.652345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:07.652353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:07.652359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.652362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:07.652370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:07.652375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:07.652538Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:07.657048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1760 sessionId: src_id|c5f84f9f-7803fac1-aad8daf8-aac950dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:07.659906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:07.710668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895907262855278:7977]
2025-09-30T14:55:07.710979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1759, pipe: [1:7555895907262855278:7977]
2025-09-30T14:55:07.769001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:07.769064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895907262855278:7977]
2025-09-30T14:55:07.769066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:07.769070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:07.769178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1760 reason: error at write: Disconnected sessionId: src_id|c5f84f9f-7803fac1-aad8daf8-aac950dc_0
2025-09-30T14:55:07.769415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1760 sessionId: src_id|c5f84f9f-7803fac1-aad8daf8-aac950dc_0 is DEAD
2025-09-30T14:55:07.769638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5f84f9f-7803fac1-aad8daf8-aac950dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:07.769649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5f84f9f-7803fac1-aad8daf8-aac950dc_0] Write session will restart in 0.009234s
2025-09-30T14:55:07.769686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5f84f9f-7803fac1-aad8daf8-aac950dc_0] Write session: Do CDS request
2025-09-30T14:55:07.769693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5f84f9f-7803fac1-aad8daf8-aac950dc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:07.768318Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:07.768705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:07.768716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:07.768766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895907262855278:7977], now have 1 active actors on pipe
2025-09-30T14:55:07.769049Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:07.779627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:07.779802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5f84f9f-7803fac1-aad8daf8-aac950dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:07.779930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:07.779948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1761
2025-09-30T14:55:07.780105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1761 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:07.780138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1761 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:07.780148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1761 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:07.780152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:07.780603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1761 sessionId:  describe result for acl check
2025-09-30T14:55:07.780650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:07.780656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:07.780659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:07.780666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895907262855337:7470] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:07.781273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895907262855337:7470] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:07.781877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:07.782159Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:07.782170Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:07.782182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:07.782254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:07.782297Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895907173087462:10144]
2025-09-30T14:55:07.782997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:07.783301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:07.783357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:07.783669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895907262855337:7470] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:07.783710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:07.783789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:07.783796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:07.783797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:07.783799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:07.783800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:07.783802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:07.783804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:07.783805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:07.783807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:07.783808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:07.783810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.783811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.783813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.783814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:07.783815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:07.783821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:07.783832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:07.783836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:07.783841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:07.783845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:07.783849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:07.783854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:07.783858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:07.783864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:07.783869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:07.783873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.783877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.783881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.783885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:07.783889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:07.783897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:07.783905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:07.783912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:07.783918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:07.783925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:07.783930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:07.783935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:07.783940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:07.783946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:07.783951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:07.783957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:07.783963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:07.783968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:07.783980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:07.783985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:07.783995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:07.784000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:07.784006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:07.784010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:07.784014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:07.784019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.784025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.784029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.784041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.784047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.784057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.784061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:07.784066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:07.784076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:07.784081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:07.784133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:07.789880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895907262855337:7470] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:07.789905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895907262855337:7470] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:07.789909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895907262855337:7470] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:07.789919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1761 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:07.790093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:07.791108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:07.791133Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:07.791137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:07.791141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:07.791149Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1760 [2:7555895907173087462:10144]
2025-09-30T14:55:07.791168Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:07.791183Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:07.791187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:07.791195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:07.791197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:07.791213Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:07.791222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:07.791230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:07.791315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.791325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.791330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.791333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:07.791336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:07.791411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:07.791421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.791437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.791457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.791473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:07.791501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895907262855377:7470], now have 1 active actors on pipe
2025-09-30T14:55:07.791510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895907262855279:2454], now have 1 active actors on pipe
2025-09-30T14:55:07.791517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895907173087456:10144]
2025-09-30T14:55:07.791520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895907173087456:10144]
2025-09-30T14:55:07.791522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895907173087456:10144]
2025-09-30T14:55:07.791537Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:07.791553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:07.791560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:07.791565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:07.791568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:07.791569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:07.791572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:07.791580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1760
2025-09-30T14:55:07.791611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895907173087456:10144]
2025-09-30T14:55:07.791622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1760
2025-09-30T14:55:07.791624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:07.791652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:07.791802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:07.791812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:07.791842Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6300956d-9a85d2eb-52f3181d-d9fa8baf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:07.791855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:07.791866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:07.791868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:07.791881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:07.791896Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:07.791916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:07.792076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:07.792085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:07.792097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:07.792179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1761 partition: 0 MaxSeqNo: 42 sessionId: src_id|6300956d-9a85d2eb-52f3181d-d9fa8baf_0
2025-09-30T14:55:07.792578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5f84f9f-7803fac1-aad8daf8-aac950dc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6300956d-9a85d2eb-52f3181d-d9fa8baf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:07.795706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6300956d-9a85d2eb-52f3181d-d9fa8baf_0] Write session: try to update token
2025-09-30T14:55:07.795729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6300956d-9a85d2eb-52f3181d-d9fa8baf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:07.804669Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:07.804695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:07.804698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:07.804700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:07.804708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895907173087456:10144]
2025-09-30T14:55:07.804712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895907173087456:10144]
2025-09-30T14:55:07.804715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895907173087456:10144]
2025-09-30T14:55:07.804750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:07.804756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.804758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:07.804763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:07.804771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:07.804775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:07.804890Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:07.811596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1761 sessionId: src_id|6300956d-9a85d2eb-52f3181d-d9fa8baf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:07.814669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:07.869395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895907262855384:7977]
2025-09-30T14:55:07.869697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1760, pipe: [1:7555895907262855384:7977]
2025-09-30T14:55:07.919477Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:07.919838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:07.919854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:07.919875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895907262855384:7977], now have 1 active actors on pipe
2025-09-30T14:55:07.920150Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:07.920151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:07.920169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:07.920236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1761 reason: error at write: Disconnected sessionId: src_id|6300956d-9a85d2eb-52f3181d-d9fa8baf_0
2025-09-30T14:55:07.920401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1761 sessionId: src_id|6300956d-9a85d2eb-52f3181d-d9fa8baf_0 is DEAD
2025-09-30T14:55:07.920500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895907262855384:7977]
2025-09-30T14:55:07.920519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:07.920788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6300956d-9a85d2eb-52f3181d-d9fa8baf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:07.920797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6300956d-9a85d2eb-52f3181d-d9fa8baf_0] Write session will restart in 0.007052s
2025-09-30T14:55:07.920819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6300956d-9a85d2eb-52f3181d-d9fa8baf_0] Write session: Do CDS request
2025-09-30T14:55:07.920828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6300956d-9a85d2eb-52f3181d-d9fa8baf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:07.928871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6300956d-9a85d2eb-52f3181d-d9fa8baf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:07.928952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:07.928973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1762
2025-09-30T14:55:07.929074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1762 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:07.929108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1762 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:07.929119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1762 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:07.929123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:07.929608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1762 sessionId:  describe result for acl check
2025-09-30T14:55:07.929652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:07.929672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:07.929674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:07.929682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895907262855442:7466] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:07.930272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895907262855442:7466] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:07.930345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:07.932353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895907262855442:7466] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:07.932276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:07.932515Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:07.932520Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:07.932532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:07.932599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:07.932636Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895907173087560:10147]
2025-09-30T14:55:07.933496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:07.933834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:07.933884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:07.934285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:07.934357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:07.934364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:07.934365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:07.934367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:07.934369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:07.934370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:07.934372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:07.934373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:07.934374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:07.934376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:07.934377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.934378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.934379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.934381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:07.934382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:07.934388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:07.934399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:07.934404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:07.934408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:07.934413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:07.934418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:07.934422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:07.934427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:07.934432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:07.934439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:07.934443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.934449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.934453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.934457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:07.934462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:07.934470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:07.934479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:07.934487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:07.934493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:07.934500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:07.934512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:07.934518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:07.934529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:07.934535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:07.934541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:07.934547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:07.934553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:07.934558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:07.934564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:07.934568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:07.934579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:07.934589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:07.934594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:07.934605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:07.934613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:07.934625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.934645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.934655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.934661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.934666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.934672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.934677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:07.934683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:07.934688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:07.934694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:07.934745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:07.935338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895907262855442:7466] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:07.935356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895907262855442:7466] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:07.935359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895907262855442:7466] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:07.935368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1762 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:07.940645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:07.941790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:07.941809Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:07.941813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:07.941821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:07.941828Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1761 [2:7555895907173087560:10147]
2025-09-30T14:55:07.941854Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:07.941876Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:07.941884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:07.941888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:07.941890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:07.941909Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:07.941921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:07.941933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:07.942005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.942012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.942015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.942019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:07.942022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:07.942096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:07.942104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.942121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:07.942139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:07.942160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:07.942184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895907173087555:10147]
2025-09-30T14:55:07.942191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895907173087555:10147]
2025-09-30T14:55:07.942194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895907173087555:10147]
2025-09-30T14:55:07.942205Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:07.942218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:07.942227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:07.942234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:07.942244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:07.942249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:07.942251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:07.942262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895907262855385:2454], now have 1 active actors on pipe
2025-09-30T14:55:07.942271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895907262855483:7466], now have 1 active actors on pipe
2025-09-30T14:55:07.942306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895907173087555:10147]
2025-09-30T14:55:07.942320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:07.942337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1761
2025-09-30T14:55:07.942341Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1761
2025-09-30T14:55:07.942347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:07.942457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:07.942476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:07.942514Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d2d0908f-3c88e29-4300343e-96e458e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:07.942540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:07.942543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:07.942546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:07.942561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:07.942576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:07.942605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:07.942799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:07.942819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:07.942839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:07.942963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1762 partition: 0 MaxSeqNo: 42 sessionId: src_id|d2d0908f-3c88e29-4300343e-96e458e4_0
2025-09-30T14:55:07.943408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6300956d-9a85d2eb-52f3181d-d9fa8baf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d2d0908f-3c88e29-4300343e-96e458e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:07.946448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2d0908f-3c88e29-4300343e-96e458e4_0] Write session: try to update token
2025-09-30T14:55:07.946473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2d0908f-3c88e29-4300343e-96e458e4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:07.956744Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:07.956769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:07.956772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:07.956774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:07.956787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895907173087555:10147]
2025-09-30T14:55:07.956791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895907173087555:10147]
2025-09-30T14:55:07.956794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895907173087555:10147]
2025-09-30T14:55:07.956843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:07.956850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:07.956853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:07.956903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:07.956918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:07.956923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:07.957022Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:07.964064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1762 sessionId: src_id|d2d0908f-3c88e29-4300343e-96e458e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:07.967033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:08.022689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895911557822808:7977]
2025-09-30T14:55:08.027442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1761, pipe: [1:7555895911557822808:7977]
2025-09-30T14:55:08.078751Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:08.079217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:08.079236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:08.079320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895911557822808:7977], now have 1 active actors on pipe
2025-09-30T14:55:08.079753Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:08.081112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2d0908f-3c88e29-4300343e-96e458e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:08.081121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2d0908f-3c88e29-4300343e-96e458e4_0] Write session will restart in 0.005502s
2025-09-30T14:55:08.081147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2d0908f-3c88e29-4300343e-96e458e4_0] Write session: Do CDS request
2025-09-30T14:55:08.081153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2d0908f-3c88e29-4300343e-96e458e4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:08.080276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:08.080348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895911557822808:7977]
2025-09-30T14:55:08.080373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:08.080456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1762 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d2d0908f-3c88e29-4300343e-96e458e4_0
2025-09-30T14:55:08.080712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1762 sessionId: src_id|d2d0908f-3c88e29-4300343e-96e458e4_0 is DEAD
2025-09-30T14:55:08.090285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2d0908f-3c88e29-4300343e-96e458e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:08.090348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:08.090368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1763
2025-09-30T14:55:08.090672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1763 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:08.090700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1763 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:08.090707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1763 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:08.090711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:08.091141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1763 sessionId:  describe result for acl check
2025-09-30T14:55:08.091170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:08.091172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:08.091175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:08.091181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895911557822820:7446] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:08.091865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895911557822820:7446] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:08.096169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895911557822820:7446] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:08.100380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895911557822820:7446] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:08.100400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895911557822820:7446] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:08.100404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895911557822820:7446] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:08.100413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1763 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:08.107329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:08.109325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:08.109585Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:08.109598Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:08.109610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:08.109684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:08.109731Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895911468054992:10161]
2025-09-30T14:55:08.110423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:08.110823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:08.110897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:08.111283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:08.111353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:08.111354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:08.111355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:08.111357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:08.111358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:08.111359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:08.111361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:08.111362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:08.111364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:08.111366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:08.111367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.111368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.111369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.111370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:08.111371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:08.111377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:08.111388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:08.111392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:08.111395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:08.111399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:08.111404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:08.111409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:08.111413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:08.111418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:08.111423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:08.111428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.111432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.111437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.111441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:08.111446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:08.111454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:08.111464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:08.111470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:08.111478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:08.111484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:08.111490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:08.111496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:08.111502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:08.111508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:08.111513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:08.111519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:08.111525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:08.111531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:08.111537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:08.111544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:08.111550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:08.111555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:08.111562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:08.111567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:08.111572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:08.111578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.111598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.111605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.111611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.111618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.111625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.111630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:08.111636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:08.111645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:08.111651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:08.111704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:08.117916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:08.119045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:08.119063Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:08.119066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:08.119070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:08.119080Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1762 [2:7555895911468054992:10161]
2025-09-30T14:55:08.119100Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:08.119117Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:08.119120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:08.119123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:08.119125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:08.119143Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:08.119151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:08.119159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:08.119226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.119234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.119236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.119239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:08.119261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:08.119334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:08.119342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.119355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.119372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.119390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:08.119412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895911468054987:10161]
2025-09-30T14:55:08.119418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895911468054987:10161]
2025-09-30T14:55:08.119422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895911468054987:10161]
2025-09-30T14:55:08.119440Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:08.119459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:08.119478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:08.119481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:08.119522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895911468054987:10161]
2025-09-30T14:55:08.119531Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:08.120286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:08.120298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:08.120300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:08.120307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:08.120308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895911557822862:7446], now have 1 active actors on pipe
2025-09-30T14:55:08.120372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1762
2025-09-30T14:55:08.120702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:08.120734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:08.120726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1762
2025-09-30T14:55:08.120758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895911557822813:2454], now have 1 active actors on pipe
2025-09-30T14:55:08.120784Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|deb7f561-7275fc5d-c0350c3f-6f8813b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:08.120794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:08.120801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:08.120804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:08.120817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:08.120846Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:08.120874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:08.121104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:08.121116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:08.121145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:08.121318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1763 partition: 0 MaxSeqNo: 42 sessionId: src_id|deb7f561-7275fc5d-c0350c3f-6f8813b1_0
2025-09-30T14:55:08.121671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2d0908f-3c88e29-4300343e-96e458e4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|deb7f561-7275fc5d-c0350c3f-6f8813b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:08.124761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|deb7f561-7275fc5d-c0350c3f-6f8813b1_0] Write session: try to update token
2025-09-30T14:55:08.124784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|deb7f561-7275fc5d-c0350c3f-6f8813b1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:08.134304Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:08.134326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:08.134329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:08.134332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:08.134342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895911468054987:10161]
2025-09-30T14:55:08.134346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895911468054987:10161]
2025-09-30T14:55:08.134355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895911468054987:10161]
2025-09-30T14:55:08.134403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:08.134404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:08.134411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:08.134413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.134416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:08.134416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:08.134584Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:08.146417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1763 sessionId: src_id|deb7f561-7275fc5d-c0350c3f-6f8813b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:08.149698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:08.179649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895911557822925:7977]
2025-09-30T14:55:08.179987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1762, pipe: [1:7555895911557822925:7977]
2025-09-30T14:55:08.254627Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:08.255049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:08.255066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:08.255088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895911557822925:7977], now have 1 active actors on pipe
2025-09-30T14:55:08.255549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:08.255579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895911557822925:7977]
2025-09-30T14:55:08.255604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:08.255608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:08.255677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1763 reason: error at write: Disconnected sessionId: src_id|deb7f561-7275fc5d-c0350c3f-6f8813b1_0
2025-09-30T14:55:08.255878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1763 sessionId: src_id|deb7f561-7275fc5d-c0350c3f-6f8813b1_0 is DEAD
2025-09-30T14:55:08.256126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deb7f561-7275fc5d-c0350c3f-6f8813b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:08.256137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deb7f561-7275fc5d-c0350c3f-6f8813b1_0] Write session will restart in 0.005140s
2025-09-30T14:55:08.256161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deb7f561-7275fc5d-c0350c3f-6f8813b1_0] Write session: Do CDS request
2025-09-30T14:55:08.256167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deb7f561-7275fc5d-c0350c3f-6f8813b1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:08.256211Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:08.262818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|deb7f561-7275fc5d-c0350c3f-6f8813b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:08.262901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:08.262928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1764
2025-09-30T14:55:08.263065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1764 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:08.263101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1764 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:08.263111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1764 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:08.263116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:08.263658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1764 sessionId:  describe result for acl check
2025-09-30T14:55:08.263707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:08.263714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:08.263717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:08.263723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895911557822942:7438] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:08.264360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895911557822942:7438] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:08.268349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895911557822942:7438] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:08.270010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:08.272006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:08.272227Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:08.272241Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:08.272253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:08.272311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:08.272355Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895911468055091:10163]
2025-09-30T14:55:08.272544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895911557822942:7438] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:08.272569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895911557822942:7438] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:08.272573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895911557822942:7438] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:08.272583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1764 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:08.273076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:08.273416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:08.273470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:08.273840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:08.273907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:08.273914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:08.273915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:08.273916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:08.273918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:08.273919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:08.273921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:08.273922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:08.273924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:08.273925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:08.273927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.273928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.273929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.273931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:08.273932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:08.273938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:08.273949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:08.273954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:08.273959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:08.273964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:08.273969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:08.273973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:08.273978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:08.273983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:08.273988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:08.273993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.273997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.274002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.274006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:08.274011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:08.274020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:08.274029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:08.274036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:08.274042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:08.274048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:08.274054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:08.274059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:08.274065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:08.274071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:08.274076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:08.274080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:08.274085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:08.274089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:08.274094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:08.274099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:08.274105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:08.274110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:08.274116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:08.274121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:08.274127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:08.274134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.274147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.274152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.274162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.274168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.274178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.274182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:08.274188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:08.274194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:08.274199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:08.274245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:08.280154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:08.281158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:08.281179Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:08.281182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:08.281186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:08.281194Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1763 [2:7555895911468055091:10163]
2025-09-30T14:55:08.281215Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:08.281232Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:08.281236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:08.281240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:08.281242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:08.281259Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:08.281273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:08.281281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:08.281346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.281355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.281358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.281362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:08.281365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:08.281438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:08.281445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.281462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.281479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.281502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:08.281527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895911557822929:2454], now have 1 active actors on pipe
2025-09-30T14:55:08.281535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895911557823025:7438], now have 1 active actors on pipe
2025-09-30T14:55:08.281542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895911468055086:10163]
2025-09-30T14:55:08.281544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895911468055086:10163]
2025-09-30T14:55:08.281546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895911468055086:10163]
2025-09-30T14:55:08.281561Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:08.281576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:08.281580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:08.281583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:08.281584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:08.281600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:08.281603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:08.281642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895911468055086:10163]
2025-09-30T14:55:08.281651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:08.281622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1763
2025-09-30T14:55:08.281673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:08.281624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1763
2025-09-30T14:55:08.281843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:08.281856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:08.281891Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22df0b89-53478aba-2df38dc7-4f32ac89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:08.281903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:08.281909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:08.281915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:08.281927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:08.281944Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:08.281964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:08.282163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:08.282187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:08.282222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:08.282334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1764 partition: 0 MaxSeqNo: 42 sessionId: src_id|22df0b89-53478aba-2df38dc7-4f32ac89_0
2025-09-30T14:55:08.282732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deb7f561-7275fc5d-c0350c3f-6f8813b1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|22df0b89-53478aba-2df38dc7-4f32ac89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:08.285735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22df0b89-53478aba-2df38dc7-4f32ac89_0] Write session: try to update token
2025-09-30T14:55:08.285756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22df0b89-53478aba-2df38dc7-4f32ac89_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:08.295552Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:08.295575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:08.295581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:08.295583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:08.295596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895911468055086:10163]
2025-09-30T14:55:08.295600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895911468055086:10163]
2025-09-30T14:55:08.295604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895911468055086:10163]
2025-09-30T14:55:08.295658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:08.295668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.295671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:08.295678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:08.295679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:08.295684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:08.295851Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:08.302369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1764 sessionId: src_id|22df0b89-53478aba-2df38dc7-4f32ac89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:08.305452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:08.355829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895911557823037:7977]
2025-09-30T14:55:08.356171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1763, pipe: [1:7555895911557823037:7977]
2025-09-30T14:55:08.413278Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:08.413651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:08.413698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:08.413752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895911557823037:7977], now have 1 active actors on pipe
2025-09-30T14:55:08.414045Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:08.414133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895911557823037:7977]
2025-09-30T14:55:08.414161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:08.414168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:08.414232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1764 reason: error at write: Disconnected sessionId: src_id|22df0b89-53478aba-2df38dc7-4f32ac89_0
2025-09-30T14:55:08.414020Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:08.414427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1764 sessionId: src_id|22df0b89-53478aba-2df38dc7-4f32ac89_0 is DEAD
2025-09-30T14:55:08.414965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22df0b89-53478aba-2df38dc7-4f32ac89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:08.414977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22df0b89-53478aba-2df38dc7-4f32ac89_0] Write session will restart in 0.007727s
2025-09-30T14:55:08.415002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22df0b89-53478aba-2df38dc7-4f32ac89_0] Write session: Do CDS request
2025-09-30T14:55:08.415008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22df0b89-53478aba-2df38dc7-4f32ac89_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:08.423853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22df0b89-53478aba-2df38dc7-4f32ac89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:08.423993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:08.424012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1765
2025-09-30T14:55:08.424163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1765 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:08.424196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1765 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:08.424212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1765 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:08.424216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:08.424687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1765 sessionId:  describe result for acl check
2025-09-30T14:55:08.424725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:08.424732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:08.424734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:08.424740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895911557823098:7428] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:08.425397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:08.425307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895911557823098:7428] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:08.427702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895911557823098:7428] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:08.427793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:08.428028Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:08.428043Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:08.428055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:08.428119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:08.428164Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895911468055193:10166]
2025-09-30T14:55:08.428803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:08.429171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:08.429243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:08.429625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:08.429726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:08.429733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:08.429735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:08.429736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:08.429737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:08.429739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:08.429740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:08.429742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:08.429743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:08.429744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:08.429745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.429747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.429748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.429749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:08.429751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:08.429757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:08.429768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:08.429773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:08.429777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:08.429782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:08.429787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:08.429791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:08.429796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:08.429800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:08.429804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:08.429808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.429812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.429817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.429821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:08.429825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:08.429833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:08.429841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:08.429847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:08.429853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:08.429858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:08.429863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:08.429868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:08.429874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:08.429882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:08.429890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:08.429894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:08.429899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:08.429904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:08.429908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:08.429910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:08.429913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:08.429916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:08.429919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:08.429921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:08.429925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:08.429927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.429930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.429933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.429936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.429939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.429942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.429945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:08.429950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:08.429954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:08.429960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:08.430006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:08.430225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895911557823098:7428] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:08.430243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895911557823098:7428] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:08.430246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895911557823098:7428] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:08.430254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1765 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:08.435878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:08.436892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:08.436918Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:08.436923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:08.436928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:08.436937Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1764 [2:7555895911468055193:10166]
2025-09-30T14:55:08.436956Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:08.436975Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:08.436984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:08.436988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:08.436990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:08.437010Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:08.437022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:08.437032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:08.437114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.437121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.437124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.437127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:08.437130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:08.437215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:08.437223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.437240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.437258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.437276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:08.437295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895911468055187:10166]
2025-09-30T14:55:08.437304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895911468055187:10166]
2025-09-30T14:55:08.437306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895911468055187:10166]
2025-09-30T14:55:08.437321Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:08.437343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:08.437350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:08.437358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:08.437359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:08.437363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:08.437378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:08.437403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895911468055187:10166]
2025-09-30T14:55:08.437414Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:08.437523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:08.437610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895911557823139:7428], now have 1 active actors on pipe
2025-09-30T14:55:08.437618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895911557823038:2454], now have 1 active actors on pipe
2025-09-30T14:55:08.437757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1764
2025-09-30T14:55:08.437806Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1764
2025-09-30T14:55:08.437846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:08.437859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:08.437887Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e7aa9a9-74897750-cd65a4c0-84594ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:08.437905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:08.437910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:08.437912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:08.437924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:08.437937Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:08.437957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:08.438198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:08.438203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:08.438213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:08.438365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1765 partition: 0 MaxSeqNo: 42 sessionId: src_id|3e7aa9a9-74897750-cd65a4c0-84594ad_0
2025-09-30T14:55:08.439631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22df0b89-53478aba-2df38dc7-4f32ac89_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3e7aa9a9-74897750-cd65a4c0-84594ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:08.442696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e7aa9a9-74897750-cd65a4c0-84594ad_0] Write session: try to update token
2025-09-30T14:55:08.442719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e7aa9a9-74897750-cd65a4c0-84594ad_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:08.451202Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:08.451224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:08.451226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:08.451229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:08.451238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895911468055187:10166]
2025-09-30T14:55:08.451280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895911468055187:10166]
2025-09-30T14:55:08.451287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895911468055187:10166]
2025-09-30T14:55:08.451332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:08.451356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.451365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:08.451521Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:08.454404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:08.454432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:08.454439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:08.462002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1765 sessionId: src_id|3e7aa9a9-74897750-cd65a4c0-84594ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:08.465406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:08.514501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895911557823147:7977]
2025-09-30T14:55:08.514907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1764, pipe: [1:7555895911557823147:7977]
2025-09-30T14:55:08.583401Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:08.583836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:08.583850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:08.583891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895911557823147:7977], now have 1 active actors on pipe
2025-09-30T14:55:08.584120Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:08.584157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895911557823147:7977]
2025-09-30T14:55:08.584181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:08.584186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:08.584204Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:08.584253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1765 reason: error at write: Disconnected sessionId: src_id|3e7aa9a9-74897750-cd65a4c0-84594ad_0
2025-09-30T14:55:08.584581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e7aa9a9-74897750-cd65a4c0-84594ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:08.584595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e7aa9a9-74897750-cd65a4c0-84594ad_0] Write session will restart in 0.005591s
2025-09-30T14:55:08.584612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e7aa9a9-74897750-cd65a4c0-84594ad_0] Write session: Do CDS request
2025-09-30T14:55:08.584616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e7aa9a9-74897750-cd65a4c0-84594ad_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:08.584463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1765 sessionId: src_id|3e7aa9a9-74897750-cd65a4c0-84594ad_0 is DEAD
2025-09-30T14:55:08.591814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e7aa9a9-74897750-cd65a4c0-84594ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:08.591904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:08.591924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1766
2025-09-30T14:55:08.592130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1766 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:08.592182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1766 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:08.592202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1766 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:08.592218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:08.592717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1766 sessionId:  describe result for acl check
2025-09-30T14:55:08.592756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:08.592759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:08.592760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:08.592767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895911557823208:7424] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:08.593330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895911557823208:7424] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:08.594130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:08.595202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895911557823208:7424] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:08.596243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:08.596459Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:08.596471Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:08.596484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:08.596540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:08.596588Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895911468055306:10169]
2025-09-30T14:55:08.597241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:08.597735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:08.597787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:08.598142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:08.598238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:08.598245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:08.598246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:08.598247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:08.598248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:08.598250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:08.598251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:08.598252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:08.598254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:08.598255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:08.598256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.598257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.598258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.598259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:08.598261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:08.598266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:08.598276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:08.598280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:08.598284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:08.598287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:08.598292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:08.598295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:08.598299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:08.598303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:08.598320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:08.598324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.598327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.598331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.598334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:08.598337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:08.598347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:08.598355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:08.598361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:08.598365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:08.598369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:08.598375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:08.598379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:08.598384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:08.598389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:08.598394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:08.598398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:08.598402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:08.598407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:08.598411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:08.598417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:08.598432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:08.598443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:08.598448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:08.598454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:08.598458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:08.598463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.598468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.598474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.598479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.598484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.598489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.598495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:08.598499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:08.598503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:08.598508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:08.598556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:08.598891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895911557823208:7424] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:08.598910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895911557823208:7424] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:08.598914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895911557823208:7424] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:08.598922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1766 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:08.604648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:08.605627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:08.605671Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:08.605675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:08.605680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:08.605687Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1765 [2:7555895911468055306:10169]
2025-09-30T14:55:08.605706Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:08.605725Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:08.605728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:08.605732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:08.605735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:08.605752Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:08.605761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:08.605775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:08.605852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.605862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.605864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.605872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:08.605874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:08.605946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:08.605955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.605970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.605982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.606004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:08.606027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895911557823251:7424], now have 1 active actors on pipe
2025-09-30T14:55:08.606036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895911557823148:2454], now have 1 active actors on pipe
2025-09-30T14:55:08.606043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895911468055300:10169]
2025-09-30T14:55:08.606046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895911468055300:10169]
2025-09-30T14:55:08.606050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895911468055300:10169]
2025-09-30T14:55:08.606062Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:08.606077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:08.606083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:08.606087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:08.606090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:08.606092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:08.606096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:08.606137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1765
2025-09-30T14:55:08.606180Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1765
2025-09-30T14:55:08.606287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895911468055300:10169]
2025-09-30T14:55:08.606305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:08.606311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:08.606341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:08.606355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:08.606403Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d9f31ce-415b8e9c-af62b259-4ce257fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:08.606418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:08.606427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:08.606430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:08.606441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:08.606457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:08.606484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:08.606638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:08.606649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:08.606667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:08.606773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1766 partition: 0 MaxSeqNo: 42 sessionId: src_id|5d9f31ce-415b8e9c-af62b259-4ce257fb_0
2025-09-30T14:55:08.607231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e7aa9a9-74897750-cd65a4c0-84594ad_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5d9f31ce-415b8e9c-af62b259-4ce257fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:08.610255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d9f31ce-415b8e9c-af62b259-4ce257fb_0] Write session: try to update token
2025-09-30T14:55:08.610277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d9f31ce-415b8e9c-af62b259-4ce257fb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:08.620609Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:08.620628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:08.620634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:08.620640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:08.620650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895911468055300:10169]
2025-09-30T14:55:08.620658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895911468055300:10169]
2025-09-30T14:55:08.620661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895911468055300:10169]
2025-09-30T14:55:08.620700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:08.620706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.620708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:08.620848Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:08.623338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:08.623359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:08.623363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:08.634686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1766 sessionId: src_id|5d9f31ce-415b8e9c-af62b259-4ce257fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:08.637722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:08.684482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895911557823273:7977]
2025-09-30T14:55:08.685011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1765, pipe: [1:7555895911557823273:7977]
2025-09-30T14:55:08.735838Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:08.736220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:08.736236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:08.736257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895911557823273:7977], now have 1 active actors on pipe
2025-09-30T14:55:08.736509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895911557823273:7977]
2025-09-30T14:55:08.736537Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:08.736514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:08.736518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:08.736559Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:08.736577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1766 reason: error at write: Disconnected sessionId: src_id|5d9f31ce-415b8e9c-af62b259-4ce257fb_0
2025-09-30T14:55:08.736748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1766 sessionId: src_id|5d9f31ce-415b8e9c-af62b259-4ce257fb_0 is DEAD
2025-09-30T14:55:08.736905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d9f31ce-415b8e9c-af62b259-4ce257fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:08.736917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d9f31ce-415b8e9c-af62b259-4ce257fb_0] Write session will restart in 0.009563s
2025-09-30T14:55:08.736953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d9f31ce-415b8e9c-af62b259-4ce257fb_0] Write session: Do CDS request
2025-09-30T14:55:08.736964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d9f31ce-415b8e9c-af62b259-4ce257fb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:08.749314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:08.751063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:08.751267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d9f31ce-415b8e9c-af62b259-4ce257fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:08.751350Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:08.751365Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:08.751380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:08.751343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:08.751359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1767
2025-09-30T14:55:08.751481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1767 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:08.751510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1767 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:08.751522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1767 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:08.751527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:08.751459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:08.751543Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895911468055408:10171]
2025-09-30T14:55:08.751951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1767 sessionId:  describe result for acl check
2025-09-30T14:55:08.751984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:08.751991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:08.751993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:08.751999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895911557823339:7421] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:08.752217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:08.752562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895911557823339:7421] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:08.752572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:08.752653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:08.753010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:08.753081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:08.753087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:08.753089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:08.753091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:08.753092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:08.753094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:08.753095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:08.753096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:08.753097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:08.753099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:08.753100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.753101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.753102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.753103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:08.753104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:08.753110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:08.753120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:08.753125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:08.753129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:08.753133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:08.753138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:08.753142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:08.753146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:08.753150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:08.753155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:08.753159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.753163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.753167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.753171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:08.753176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:08.753184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:08.753193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:08.753200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:08.753206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:08.753211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:08.753218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:08.753223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:08.753229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:08.753233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:08.753238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:08.753243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:08.753248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:08.753253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:08.753259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:08.753263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:08.753283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:08.753294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:08.753300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:08.753305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:08.753312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:08.753317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.753328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.753333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.753342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.753349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.753359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.753363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:08.753368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:08.753377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:08.753383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:08.753433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:08.754990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895911557823339:7421] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:08.758962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895911557823339:7421] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:08.758982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895911557823339:7421] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:08.758999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895911557823339:7421] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:08.759009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1767 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:08.759431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:08.760414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:08.760434Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:08.760436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:08.760440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:08.760448Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1766 [2:7555895911468055408:10171]
2025-09-30T14:55:08.760467Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:08.760491Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:08.760494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:08.760497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:08.760500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:08.760517Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:08.760523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:08.760530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:08.760594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.760604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.760606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.760610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:08.760613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:08.760683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:08.760692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.760706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.760724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.760740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:08.760764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895911557823274:2454], now have 1 active actors on pipe
2025-09-30T14:55:08.760772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895911557823377:7421], now have 1 active actors on pipe
2025-09-30T14:55:08.760780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895911468055403:10171]
2025-09-30T14:55:08.760787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895911468055403:10171]
2025-09-30T14:55:08.760789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895911468055403:10171]
2025-09-30T14:55:08.760816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:08.760814Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1766
2025-09-30T14:55:08.760837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:08.760843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:08.760836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1766
2025-09-30T14:55:08.760857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:08.760858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:08.760862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:08.760863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:08.760902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895911468055403:10171]
2025-09-30T14:55:08.760914Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:08.760931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:08.760941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:08.760946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:08.760996Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87d541f0-43bdbd1b-8925cc6d-c6b0d809_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:08.761011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:08.761015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:08.761018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:08.761029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:08.761039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:08.761061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:08.761221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:08.761236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:08.761259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:08.761353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1767 partition: 0 MaxSeqNo: 42 sessionId: src_id|87d541f0-43bdbd1b-8925cc6d-c6b0d809_0
2025-09-30T14:55:08.761771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d9f31ce-415b8e9c-af62b259-4ce257fb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|87d541f0-43bdbd1b-8925cc6d-c6b0d809_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:08.764824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87d541f0-43bdbd1b-8925cc6d-c6b0d809_0] Write session: try to update token
2025-09-30T14:55:08.764848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87d541f0-43bdbd1b-8925cc6d-c6b0d809_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:08.773896Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:08.773922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:08.773925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:08.773928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:08.773939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895911468055403:10171]
2025-09-30T14:55:08.773944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895911468055403:10171]
2025-09-30T14:55:08.773947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895911468055403:10171]
2025-09-30T14:55:08.773995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:08.774006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.774019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:08.774018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:08.774027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:08.774033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:08.774204Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:08.783911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1767 sessionId: src_id|87d541f0-43bdbd1b-8925cc6d-c6b0d809_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:08.786794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:08.837863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895911557823385:7977]
2025-09-30T14:55:08.838185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1766, pipe: [1:7555895911557823385:7977]
2025-09-30T14:55:08.892179Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:08.892715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:08.892736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:08.892756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895911557823385:7977], now have 1 active actors on pipe
2025-09-30T14:55:08.895605Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:08.895664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:08.895729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895911557823385:7977]
2025-09-30T14:55:08.895753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:08.896211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d541f0-43bdbd1b-8925cc6d-c6b0d809_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:08.896228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d541f0-43bdbd1b-8925cc6d-c6b0d809_0] Write session will restart in 0.006483s
2025-09-30T14:55:08.896254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d541f0-43bdbd1b-8925cc6d-c6b0d809_0] Write session: Do CDS request
2025-09-30T14:55:08.896261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d541f0-43bdbd1b-8925cc6d-c6b0d809_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:08.895756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:08.895823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1767 reason: error at write: Disconnected sessionId: src_id|87d541f0-43bdbd1b-8925cc6d-c6b0d809_0
2025-09-30T14:55:08.896008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1767 sessionId: src_id|87d541f0-43bdbd1b-8925cc6d-c6b0d809_0 is DEAD
2025-09-30T14:55:08.903789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87d541f0-43bdbd1b-8925cc6d-c6b0d809_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:08.907422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:08.907441Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1768
2025-09-30T14:55:08.907628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1768 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:08.907659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1768 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:08.907665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1768 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:08.907670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:08.908247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1768 sessionId:  describe result for acl check
2025-09-30T14:55:08.908290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:08.908298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:08.908300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:08.908307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895911557823434:7416] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:08.908894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895911557823434:7416] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:08.911241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895911557823434:7416] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:08.911476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:08.913236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:08.913490Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:08.913503Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:08.913515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:08.913574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:08.913620Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895911468055513:10174]
2025-09-30T14:55:08.914343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:08.914724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:08.914776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:08.915177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:08.915275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:08.915282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:08.915284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:08.915285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:08.915286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:08.915288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:08.915289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:08.915290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:08.915291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:08.915293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:08.915294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.915296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.915297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.915298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:08.915299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:08.915305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:08.915316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:08.915320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:08.915324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:08.915328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:08.915332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:08.915336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:08.915340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:08.915344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:08.915349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:08.915353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.915357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.915362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.915366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:08.915370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:08.915379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:08.915387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:08.915394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:08.915399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:08.915404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:08.915410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:08.915415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:08.915420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:08.915425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:08.915431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:08.915436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:08.915442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:08.915446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:08.915451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:08.915455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:08.915460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:08.915466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:08.915471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:08.915483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:08.915488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:08.915494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.915499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.915504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.915515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.915521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.915526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.915533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:08.915542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:08.915548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:08.915554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:08.915601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:08.916624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895911557823434:7416] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:08.916650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895911557823434:7416] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:08.916654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895911557823434:7416] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:08.916662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1768 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:08.922064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:08.923270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:08.923287Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:08.923295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:08.923299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:08.923308Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1767 [2:7555895911468055513:10174]
2025-09-30T14:55:08.923324Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:08.923342Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:08.923352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:08.923355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:08.923357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:08.923375Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:08.923388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:08.923399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:08.923470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.923479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.923482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.923485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:08.923488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:08.923559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:08.923567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.923582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:08.923599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:08.923622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:08.923646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895911557823490:7416], now have 1 active actors on pipe
2025-09-30T14:55:08.923658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895911468055508:10174]
2025-09-30T14:55:08.923660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895911468055508:10174]
2025-09-30T14:55:08.923664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895911468055508:10174]
2025-09-30T14:55:08.923679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:08.923690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895911557823386:2454], now have 1 active actors on pipe
2025-09-30T14:55:08.923693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:08.923698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:08.923699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:08.923702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:08.923713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:08.923716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:08.923751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895911468055508:10174]
2025-09-30T14:55:08.923769Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:08.923787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:08.923808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:08.923819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:08.923852Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c829ee1-edf87310-f55ad416-c672e9db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:08.923864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:08.923868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:08.923870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:08.923762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1767
2025-09-30T14:55:08.923817Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1767
2025-09-30T14:55:08.923881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:08.923895Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:08.923915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:08.924090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:08.924101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:08.924118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:08.924242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1768 partition: 0 MaxSeqNo: 42 sessionId: src_id|6c829ee1-edf87310-f55ad416-c672e9db_0
2025-09-30T14:55:08.924641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d541f0-43bdbd1b-8925cc6d-c6b0d809_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6c829ee1-edf87310-f55ad416-c672e9db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:08.927730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c829ee1-edf87310-f55ad416-c672e9db_0] Write session: try to update token
2025-09-30T14:55:08.927757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c829ee1-edf87310-f55ad416-c672e9db_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:08.937487Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:08.937507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:08.937518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895911468055508:10174]
2025-09-30T14:55:08.937564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:08.937566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:08.937771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:08.937923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:08.938081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:08.938239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:08.938458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:08.938508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:08.951334Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:08.951355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:08.951358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:08.951360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:08.951372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895911468055508:10174]
2025-09-30T14:55:08.951377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895911468055508:10174]
2025-09-30T14:55:08.951382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895911468055508:10174]
2025-09-30T14:55:08.951426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:08.951440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:08.951443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:08.951597Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:08.955135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:08.955159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:08.955164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:08.952520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1768 sessionId: src_id|6c829ee1-edf87310-f55ad416-c672e9db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:08.955574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:08.999379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895911557823498:7977]
2025-09-30T14:55:08.999975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1767, pipe: [1:7555895911557823498:7977]
2025-09-30T14:55:09.069871Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:09.070275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:09.070283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:09.070304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895911557823498:7977], now have 1 active actors on pipe
2025-09-30T14:55:09.070565Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:09.070951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895911557823498:7977]
2025-09-30T14:55:09.071007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:09.071086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1768 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6c829ee1-edf87310-f55ad416-c672e9db_0
2025-09-30T14:55:09.071463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c829ee1-edf87310-f55ad416-c672e9db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:09.071475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c829ee1-edf87310-f55ad416-c672e9db_0] Write session will restart in 0.005273s
2025-09-30T14:55:09.071499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c829ee1-edf87310-f55ad416-c672e9db_0] Write session: Do CDS request
2025-09-30T14:55:09.071505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c829ee1-edf87310-f55ad416-c672e9db_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:09.071299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1768 sessionId: src_id|6c829ee1-edf87310-f55ad416-c672e9db_0 is DEAD
2025-09-30T14:55:09.071440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:09.077785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c829ee1-edf87310-f55ad416-c672e9db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:09.078104Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:09.078121Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1769
2025-09-30T14:55:09.078505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1769 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:09.078539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1769 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:09.078544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1769 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:09.078547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:09.079962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1769 sessionId:  describe result for acl check
2025-09-30T14:55:09.080003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:09.080005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:09.080006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:09.080011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895915852790854:7397] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:09.081127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895915852790854:7397] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:09.082702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:09.084887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:09.085164Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:09.085173Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:09.085184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:09.085246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:09.085301Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895915763022949:10186]
2025-09-30T14:55:09.086004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:09.086338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:09.086382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:09.086744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:09.086805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:09.086811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:09.086812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:09.086813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:09.086814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:09.086815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:09.086817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:09.086818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:09.086819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:09.086820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:09.086821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.086823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.086824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.086825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:09.086827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:09.086833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:09.086844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:09.086849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:09.086852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:09.086856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:09.086860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:09.086866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:09.086870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:09.086875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:09.086881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:09.086885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.086889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.086894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.086898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:09.086903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:09.086913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:09.086921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:09.086934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:09.086943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:09.086949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:09.086958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:09.086963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:09.086971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:09.086976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:09.086981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:09.086985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:09.086990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:09.086995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:09.087001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:09.087006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:09.087011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:09.087018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:09.087027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:09.087032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:09.087041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:09.087048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.087056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.087061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.087070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.087075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.087084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.087090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:09.087099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:09.087103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:09.087109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:09.087156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:09.093724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:09.093098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895915852790854:7397] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:09.094822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:09.094840Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:09.094843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:09.094847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:09.094859Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1768 [2:7555895915763022949:10186]
2025-09-30T14:55:09.094877Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:09.094895Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:09.094899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:09.094902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:09.094905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:09.094922Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:09.094936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:09.094947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:09.095016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.095022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.095024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.095028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:09.095030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:09.095099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:09.095104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.095118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.095131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.095152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:09.095173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895915763022944:10186]
2025-09-30T14:55:09.095179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895915763022944:10186]
2025-09-30T14:55:09.095181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895915763022944:10186]
2025-09-30T14:55:09.095201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:09.095223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:09.095238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:09.095241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:09.095266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:09.095270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:09.095272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:09.095293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895915763022944:10186]
2025-09-30T14:55:09.095304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:09.095349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:09.095479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895915852790813:2454], now have 1 active actors on pipe
2025-09-30T14:55:09.095507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1768
2025-09-30T14:55:09.099301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895915852790854:7397] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:09.099322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895915852790854:7397] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:09.099326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895915852790854:7397] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:09.099336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1769 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:09.102716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895915852790925:7397], now have 1 active actors on pipe
2025-09-30T14:55:09.102988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1768
2025-09-30T14:55:09.103158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:09.103170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:09.103203Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|651a130b-2c02a5f6-cca58f44-8ac0379a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:09.103217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:09.103225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:09.103227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:09.103238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:09.103279Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:09.103304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:09.103526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:09.103537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:09.103554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:09.103676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1769 partition: 0 MaxSeqNo: 42 sessionId: src_id|651a130b-2c02a5f6-cca58f44-8ac0379a_0
2025-09-30T14:55:09.104079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c829ee1-edf87310-f55ad416-c672e9db_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|651a130b-2c02a5f6-cca58f44-8ac0379a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:09.107422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|651a130b-2c02a5f6-cca58f44-8ac0379a_0] Write session: try to update token
2025-09-30T14:55:09.107448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|651a130b-2c02a5f6-cca58f44-8ac0379a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:09.118360Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:09.118379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:09.118382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:09.118385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:09.118395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895915763022944:10186]
2025-09-30T14:55:09.118401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895915763022944:10186]
2025-09-30T14:55:09.118405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895915763022944:10186]
2025-09-30T14:55:09.118456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:09.118463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.118471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:09.118664Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:09.119775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:09.119786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:09.119791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:09.126377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1769 sessionId: src_id|651a130b-2c02a5f6-cca58f44-8ac0379a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:09.129303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:09.170910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895915852790941:7977]
2025-09-30T14:55:09.171299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1768, pipe: [1:7555895915852790941:7977]
2025-09-30T14:55:09.236956Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:09.237348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:09.237364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:09.237407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895915852790941:7977], now have 1 active actors on pipe
2025-09-30T14:55:09.237638Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:09.237707Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:09.237770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895915852790941:7977]
2025-09-30T14:55:09.237799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:09.237888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1769 reason: status is not ok: tablet will be restarted right now sessionId: src_id|651a130b-2c02a5f6-cca58f44-8ac0379a_0
2025-09-30T14:55:09.238074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1769 sessionId: src_id|651a130b-2c02a5f6-cca58f44-8ac0379a_0 is DEAD
2025-09-30T14:55:09.238197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|651a130b-2c02a5f6-cca58f44-8ac0379a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:09.238208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|651a130b-2c02a5f6-cca58f44-8ac0379a_0] Write session will restart in 0.008930s
2025-09-30T14:55:09.238231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|651a130b-2c02a5f6-cca58f44-8ac0379a_0] Write session: Do CDS request
2025-09-30T14:55:09.238236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|651a130b-2c02a5f6-cca58f44-8ac0379a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:09.248123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:09.248761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|651a130b-2c02a5f6-cca58f44-8ac0379a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:09.248808Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:09.248827Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1770
2025-09-30T14:55:09.248989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1770 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:09.249026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1770 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:09.249031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1770 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:09.249035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:09.249487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1770 sessionId:  describe result for acl check
2025-09-30T14:55:09.249522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:09.249528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:09.249530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:09.249536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895915852791014:7392] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:09.250076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895915852791014:7392] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:09.250163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:09.250343Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:09.250368Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:09.250377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:09.250425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:09.250472Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895915763023054:10190]
2025-09-30T14:55:09.251058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:09.251321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:09.251365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:09.251703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:09.251772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:09.251782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:09.251783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:09.251784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:09.251785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:09.251787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:09.251788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:09.251789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:09.251790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:09.251792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:09.251793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.251794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.251795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.251796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:09.251797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:09.251802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:09.251811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:09.251814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:09.251818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:09.251821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:09.251825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:09.251828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:09.251832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:09.251836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:09.251840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:09.251843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.251847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.251850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.251853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:09.251857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:09.251863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:09.251870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:09.251876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:09.251880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:09.251884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:09.251888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:09.251892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:09.251896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:09.251901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:09.251905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:09.251909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:09.251913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:09.251918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:09.251923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:09.251927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:09.251931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:09.251935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:09.251940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:09.251943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:09.251947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:09.251952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.251957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.251961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.251965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.251969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.251974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.251978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:09.251983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:09.251987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:09.251991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:09.252031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:09.252428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895915852791014:7392] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:09.257697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:09.257537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895915852791014:7392] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:09.257560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895915852791014:7392] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:09.257564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895915852791014:7392] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:09.257573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1770 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:09.258644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:09.258662Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:09.258667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:09.258671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:09.258678Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1769 [2:7555895915763023054:10190]
2025-09-30T14:55:09.258697Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:09.258714Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:09.258722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:09.258726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:09.258730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:09.258748Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:09.258760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:09.258771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:09.258838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.258851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.258853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.258857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:09.258859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:09.258931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:09.258940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.258955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.258974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.258999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:09.259024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895915852791053:7392], now have 1 active actors on pipe
2025-09-30T14:55:09.259032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895915852790946:2454], now have 1 active actors on pipe
2025-09-30T14:55:09.259039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895915763023048:10190]
2025-09-30T14:55:09.259046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895915763023048:10190]
2025-09-30T14:55:09.259049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895915763023048:10190]
2025-09-30T14:55:09.259064Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:09.259078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:09.259081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:09.259083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:09.259085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:09.259101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:09.259110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:09.259093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1769
2025-09-30T14:55:09.259093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1769
2025-09-30T14:55:09.259144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895915763023048:10190]
2025-09-30T14:55:09.259158Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:09.259174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:09.259183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:09.259189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:09.259238Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|452fc94e-29c238ad-baff9201-d12160af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:09.259295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:09.259299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:09.259301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:09.259312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:09.259327Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:09.259357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:09.259568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:09.259580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:09.259614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:09.259708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1770 partition: 0 MaxSeqNo: 42 sessionId: src_id|452fc94e-29c238ad-baff9201-d12160af_0
2025-09-30T14:55:09.260103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|651a130b-2c02a5f6-cca58f44-8ac0379a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|452fc94e-29c238ad-baff9201-d12160af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:09.263104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|452fc94e-29c238ad-baff9201-d12160af_0] Write session: try to update token
2025-09-30T14:55:09.263127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|452fc94e-29c238ad-baff9201-d12160af_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:09.272456Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:09.272476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:09.272479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:09.272482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:09.272492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895915763023048:10190]
2025-09-30T14:55:09.272498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895915763023048:10190]
2025-09-30T14:55:09.272503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895915763023048:10190]
2025-09-30T14:55:09.272550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:09.272559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.272561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:09.272564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:09.272578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:09.272591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:09.272718Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:09.280729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1770 sessionId: src_id|452fc94e-29c238ad-baff9201-d12160af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:09.283550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:09.337810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895915852791061:7977]
2025-09-30T14:55:09.338150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1769, pipe: [1:7555895915852791061:7977]
2025-09-30T14:55:09.401005Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:09.401454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:09.401469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:09.401489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895915852791061:7977], now have 1 active actors on pipe
2025-09-30T14:55:09.401750Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:09.402169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|452fc94e-29c238ad-baff9201-d12160af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:09.402179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|452fc94e-29c238ad-baff9201-d12160af_0] Write session will restart in 0.008816s
2025-09-30T14:55:09.402196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|452fc94e-29c238ad-baff9201-d12160af_0] Write session: Do CDS request
2025-09-30T14:55:09.402200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|452fc94e-29c238ad-baff9201-d12160af_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:09.401797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895915852791061:7977]
2025-09-30T14:55:09.401816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:09.401822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:09.401832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:09.401890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1770 reason: error at write: Disconnected sessionId: src_id|452fc94e-29c238ad-baff9201-d12160af_0
2025-09-30T14:55:09.402089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1770 sessionId: src_id|452fc94e-29c238ad-baff9201-d12160af_0 is DEAD
2025-09-30T14:55:09.411776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|452fc94e-29c238ad-baff9201-d12160af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:09.411869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:09.411890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1771
2025-09-30T14:55:09.412062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1771 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:09.412117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1771 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:09.412128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1771 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:09.412133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:09.412559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1771 sessionId:  describe result for acl check
2025-09-30T14:55:09.412595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:09.412602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:09.412604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:09.412611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895915852791127:7382] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:09.413204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895915852791127:7382] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:09.413961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:09.415342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895915852791127:7382] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:09.415792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:09.416030Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:09.416041Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:09.416053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:09.416109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:09.416150Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895915763023162:10193]
2025-09-30T14:55:09.416826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:09.417147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:09.417209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:09.417342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895915852791127:7382] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:09.417366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895915852791127:7382] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:09.417370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895915852791127:7382] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:09.417379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1771 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:09.417580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:09.417642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:09.417649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:09.417650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:09.417651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:09.417665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:09.417666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:09.417667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:09.417669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:09.417670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:09.417671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:09.417673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.417674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.417675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.417677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:09.417679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:09.417685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:09.417697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:09.417701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:09.417705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:09.417708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:09.417713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:09.417717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:09.417721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:09.417725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:09.417730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:09.417734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.417738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.417742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.417747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:09.417751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:09.417758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:09.417766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:09.417772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:09.417778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:09.417783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:09.417789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:09.417793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:09.417799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:09.417804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:09.417810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:09.417815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:09.417820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:09.417825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:09.417830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:09.417835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:09.417840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:09.417850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:09.417856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:09.417862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:09.417867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:09.417874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.417883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.417888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.417898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.417903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.417912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.417917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:09.417926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:09.417932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:09.417942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:09.417989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:09.423759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:09.424896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:09.424920Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:09.424923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:09.424927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:09.424934Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1770 [2:7555895915763023162:10193]
2025-09-30T14:55:09.424954Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:09.424972Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:09.424975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:09.424978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:09.424981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:09.424998Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:09.425005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:09.425012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:09.425076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.425084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.425086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.425089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:09.425092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:09.425167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:09.425175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.425189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.425202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.425223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:09.425246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895915852791062:2454], now have 1 active actors on pipe
2025-09-30T14:55:09.425251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895915852791167:7382], now have 1 active actors on pipe
2025-09-30T14:55:09.425258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895915763023157:10193]
2025-09-30T14:55:09.425260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895915763023157:10193]
2025-09-30T14:55:09.425264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895915763023157:10193]
2025-09-30T14:55:09.425278Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:09.425291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:09.425303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:09.425312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:09.425314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:09.425315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:09.425316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:09.425350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895915763023157:10193]
2025-09-30T14:55:09.425357Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:09.425361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:09.425332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1770
2025-09-30T14:55:09.425387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1770
2025-09-30T14:55:09.425574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:09.425588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:09.425618Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc01494c-108d1b4b-a3388e3e-d7b18ed6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:09.425633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:09.425638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:09.425640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:09.425651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:09.425680Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:09.425695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:09.425876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:09.425887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:09.425903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:09.426007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1771 partition: 0 MaxSeqNo: 42 sessionId: src_id|dc01494c-108d1b4b-a3388e3e-d7b18ed6_0
2025-09-30T14:55:09.426368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|452fc94e-29c238ad-baff9201-d12160af_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dc01494c-108d1b4b-a3388e3e-d7b18ed6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:09.429356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc01494c-108d1b4b-a3388e3e-d7b18ed6_0] Write session: try to update token
2025-09-30T14:55:09.429381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc01494c-108d1b4b-a3388e3e-d7b18ed6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:09.439306Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:09.439331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:09.439335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:09.439337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:09.439349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895915763023157:10193]
2025-09-30T14:55:09.439355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895915763023157:10193]
2025-09-30T14:55:09.439360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895915763023157:10193]
2025-09-30T14:55:09.439406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:09.439413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:09.439421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:09.439421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.439424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:09.439425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:09.439651Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:09.448605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1771 sessionId: src_id|dc01494c-108d1b4b-a3388e3e-d7b18ed6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:09.452002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:09.502128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895915852791177:7977]
2025-09-30T14:55:09.502500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1770, pipe: [1:7555895915852791177:7977]
2025-09-30T14:55:09.555763Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:09.556083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:09.556096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:09.556115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895915852791177:7977], now have 1 active actors on pipe
2025-09-30T14:55:09.556356Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:09.556991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc01494c-108d1b4b-a3388e3e-d7b18ed6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:09.557004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc01494c-108d1b4b-a3388e3e-d7b18ed6_0] Write session will restart in 0.007461s
2025-09-30T14:55:09.557029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc01494c-108d1b4b-a3388e3e-d7b18ed6_0] Write session: Do CDS request
2025-09-30T14:55:09.557043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc01494c-108d1b4b-a3388e3e-d7b18ed6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:09.556513Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:09.556565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:09.556661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1771 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dc01494c-108d1b4b-a3388e3e-d7b18ed6_0
2025-09-30T14:55:09.556849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1771 sessionId: src_id|dc01494c-108d1b4b-a3388e3e-d7b18ed6_0 is DEAD
2025-09-30T14:55:09.556977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895915852791177:7977]
2025-09-30T14:55:09.565790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc01494c-108d1b4b-a3388e3e-d7b18ed6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:09.565927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:09.565946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1772
2025-09-30T14:55:09.566058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1772 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:09.566092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1772 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:09.566103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1772 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:09.566107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:09.566512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1772 sessionId:  describe result for acl check
2025-09-30T14:55:09.566544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:09.566552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:09.566554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:09.566561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895915852791244:7376] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:09.567108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895915852791244:7376] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:09.568063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:09.569186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895915852791244:7376] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:09.570088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:09.570355Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:09.570366Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:09.570379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:09.570441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:09.570485Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895915763023281:10195]
2025-09-30T14:55:09.571169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:09.571505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:09.571566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:09.571929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:09.571991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895915852791244:7376] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:09.572014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:09.572005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895915852791244:7376] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:09.572020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:09.572021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:09.572009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895915852791244:7376] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:09.572022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:09.572017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1772 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:09.572023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:09.572025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:09.572026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:09.572027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:09.572029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:09.572031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:09.572032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.572033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.572034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.572036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:09.572037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:09.572042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:09.572053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:09.572058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:09.572061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:09.572064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:09.572068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:09.572071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:09.572074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:09.572077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:09.572082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:09.572086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.572090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.572094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.572098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:09.572102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:09.572111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:09.572119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:09.572125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:09.572131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:09.572136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:09.572141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:09.572147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:09.572152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:09.572157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:09.572163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:09.572168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:09.572173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:09.572180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:09.572186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:09.572191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:09.572196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:09.572203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:09.572208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:09.572213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:09.572219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:09.572224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.572230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.572243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.572249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.572259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.572265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.572270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:09.572280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:09.572285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:09.572295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:09.572338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:09.578126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:09.579074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:09.579093Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:09.579097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:09.579101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:09.579108Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1771 [2:7555895915763023281:10195]
2025-09-30T14:55:09.579126Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:09.579144Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:09.579148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:09.579151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:09.579154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:09.579172Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:09.579186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:09.579193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:09.579436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.579458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.579461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.579464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:09.579467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:09.579547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:09.579559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.579573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.579586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.579606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:09.579626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895915763023275:10195]
2025-09-30T14:55:09.579628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895915763023275:10195]
2025-09-30T14:55:09.579631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895915763023275:10195]
2025-09-30T14:55:09.579639Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:09.579649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:09.579653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:09.579655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:09.579658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895915852791284:7376], now have 1 active actors on pipe
2025-09-30T14:55:09.579664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:09.579680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:09.579689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:09.579695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895915852791178:2454], now have 1 active actors on pipe
2025-09-30T14:55:09.579731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895915763023275:10195]
2025-09-30T14:55:09.579745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:09.579750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:09.579763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1771
2025-09-30T14:55:09.579804Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1771
2025-09-30T14:55:09.580189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:09.580206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:09.580242Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2cde6f8c-99e5576e-f041c849-5eb4eb35_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:09.580260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:09.580265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:09.580271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:09.580283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:09.580301Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:09.580324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:09.580653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:09.580667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:09.580701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:09.580823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1772 partition: 0 MaxSeqNo: 42 sessionId: src_id|2cde6f8c-99e5576e-f041c849-5eb4eb35_0
2025-09-30T14:55:09.581225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc01494c-108d1b4b-a3388e3e-d7b18ed6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2cde6f8c-99e5576e-f041c849-5eb4eb35_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:09.584286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cde6f8c-99e5576e-f041c849-5eb4eb35_0] Write session: try to update token
2025-09-30T14:55:09.584332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cde6f8c-99e5576e-f041c849-5eb4eb35_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:09.595959Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:09.595983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:09.595986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:09.595988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:09.595999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895915763023275:10195]
2025-09-30T14:55:09.596007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895915763023275:10195]
2025-09-30T14:55:09.596012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895915763023275:10195]
2025-09-30T14:55:09.596055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:09.596062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.596065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:09.596065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:09.596072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:09.596077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:09.596611Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:09.601263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1772 sessionId: src_id|2cde6f8c-99e5576e-f041c849-5eb4eb35_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:09.604220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:09.657320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895915852791308:7977]
2025-09-30T14:55:09.657681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1771, pipe: [1:7555895915852791308:7977]
2025-09-30T14:55:09.708384Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:09.708794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:09.708813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:09.708854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895915852791308:7977], now have 1 active actors on pipe
2025-09-30T14:55:09.709349Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:09.709728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cde6f8c-99e5576e-f041c849-5eb4eb35_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:09.709739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cde6f8c-99e5576e-f041c849-5eb4eb35_0] Write session will restart in 0.007975s
2025-09-30T14:55:09.709249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895915852791308:7977]
2025-09-30T14:55:09.709774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cde6f8c-99e5576e-f041c849-5eb4eb35_0] Write session: Do CDS request
2025-09-30T14:55:09.709301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:09.709305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:09.709791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cde6f8c-99e5576e-f041c849-5eb4eb35_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:09.709373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1772 reason: error at write: Disconnected sessionId: src_id|2cde6f8c-99e5576e-f041c849-5eb4eb35_0
2025-09-30T14:55:09.709553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1772 sessionId: src_id|2cde6f8c-99e5576e-f041c849-5eb4eb35_0 is DEAD
2025-09-30T14:55:09.709566Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:09.718773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cde6f8c-99e5576e-f041c849-5eb4eb35_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:09.719189Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:09.719218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1773
2025-09-30T14:55:09.719399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1773 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:09.719430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1773 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:09.719435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1773 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:09.719440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:09.719981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1773 sessionId:  describe result for acl check
2025-09-30T14:55:09.720026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:09.720033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:09.720035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:09.720043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895915852791360:7366] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:09.720580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895915852791360:7366] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:09.725618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895915852791360:7366] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:09.728302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:09.735717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:09.735925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895915852791360:7366] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:09.735944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895915852791360:7366] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:09.735948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895915852791360:7366] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:09.735958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1773 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:09.735973Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:09.735988Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:09.736002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:09.736071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:09.736117Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895915763023389:10198]
2025-09-30T14:55:09.736784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:09.737249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:09.737312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:09.737712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:09.737795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:09.737803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:09.737805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:09.737806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:09.737808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:09.737810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:09.737812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:09.737814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:09.737815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:09.737816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:09.737818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.737819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.737821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.737822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:09.737823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:09.737830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:09.737842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:09.737848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:09.737852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:09.737855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:09.737860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:09.737864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:09.737869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:09.737873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:09.737878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:09.737883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.737887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.737892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.737896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:09.737901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:09.737909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:09.737918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:09.737924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:09.737931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:09.737937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:09.737941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:09.737945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:09.737952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:09.737957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:09.737963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:09.737968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:09.737973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:09.737981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:09.737987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:09.737991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:09.737997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:09.738003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:09.738009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:09.738014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:09.738020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:09.738025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.738046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.738052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.738059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.738065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.738070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.738073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:09.738079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:09.738083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:09.738089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:09.738138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:09.745904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1772
2025-09-30T14:55:09.745942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1772
2025-09-30T14:55:09.744333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:09.745333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:09.745339Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:09.745342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:09.745347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:09.745354Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1772 [2:7555895915763023389:10198]
2025-09-30T14:55:09.745371Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:09.745388Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:09.745392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:09.745396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:09.745399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:09.745415Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:09.745422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:09.745430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:09.745504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.745511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.745514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.745518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:09.745521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:09.745608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:09.745611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.745625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.745638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.745670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:09.745690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895915763023383:10198]
2025-09-30T14:55:09.745694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895915763023383:10198]
2025-09-30T14:55:09.745697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895915763023383:10198]
2025-09-30T14:55:09.745706Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:09.745722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:09.745722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:09.745726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:09.745728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:09.745740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:09.745744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:09.745754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895915852791413:7366], now have 1 active actors on pipe
2025-09-30T14:55:09.745758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895915852791309:2454], now have 1 active actors on pipe
2025-09-30T14:55:09.745796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895915763023383:10198]
2025-09-30T14:55:09.745811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:09.746002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:09.746238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:09.746257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:09.746290Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43887efe-1588a7e-c751bb96-451a763f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:09.746299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:09.746303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:09.746306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:09.746318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:09.746330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:09.746347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:09.746731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:09.746746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:09.746774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:09.747012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1773 partition: 0 MaxSeqNo: 42 sessionId: src_id|43887efe-1588a7e-c751bb96-451a763f_0
2025-09-30T14:55:09.747392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cde6f8c-99e5576e-f041c849-5eb4eb35_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|43887efe-1588a7e-c751bb96-451a763f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:09.750248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43887efe-1588a7e-c751bb96-451a763f_0] Write session: try to update token
2025-09-30T14:55:09.750271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43887efe-1588a7e-c751bb96-451a763f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:09.758998Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:09.759020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:09.759023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:09.759025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:09.759040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895915763023383:10198]
2025-09-30T14:55:09.759043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895915763023383:10198]
2025-09-30T14:55:09.759047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895915763023383:10198]
2025-09-30T14:55:09.759092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:09.759098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.759101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:09.759107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:09.759114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:09.759118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:09.759264Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:09.783536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1773 sessionId: src_id|43887efe-1588a7e-c751bb96-451a763f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:09.786514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:09.809450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895915852791425:7977]
2025-09-30T14:55:09.810007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1772, pipe: [1:7555895915852791425:7977]
2025-09-30T14:55:09.884065Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:09.884519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:09.884535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:09.884558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895915852791425:7977], now have 1 active actors on pipe
2025-09-30T14:55:09.884944Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:09.885876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43887efe-1588a7e-c751bb96-451a763f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:09.885888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43887efe-1588a7e-c751bb96-451a763f_0] Write session will restart in 0.006556s
2025-09-30T14:55:09.885915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43887efe-1588a7e-c751bb96-451a763f_0] Write session: Do CDS request
2025-09-30T14:55:09.885922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43887efe-1588a7e-c751bb96-451a763f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:09.885411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:09.885501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1773 reason: status is not ok: tablet will be restarted right now sessionId: src_id|43887efe-1588a7e-c751bb96-451a763f_0
2025-09-30T14:55:09.885694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1773 sessionId: src_id|43887efe-1588a7e-c751bb96-451a763f_0 is DEAD
2025-09-30T14:55:09.885827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:09.885861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895915852791425:7977]
2025-09-30T14:55:09.894660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43887efe-1588a7e-c751bb96-451a763f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:09.896503Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:09.896524Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1774
2025-09-30T14:55:09.896817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1774 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:09.896854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1774 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:09.896859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1774 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:09.896863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:09.897706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1774 sessionId:  describe result for acl check
2025-09-30T14:55:09.897749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:09.897751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:09.897754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:09.897760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895915852791479:7361] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:09.898339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895915852791479:7361] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:09.902426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895915852791479:7361] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:09.903109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:09.905458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895915852791479:7361] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:09.905477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895915852791479:7361] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:09.905480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895915852791479:7361] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:09.905489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1774 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:09.907873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:09.908062Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:09.908071Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:09.908079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:09.908125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:09.908159Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895915763023501:10201]
2025-09-30T14:55:09.908615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:09.909805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:09.909847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:09.910087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:09.910130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:09.910136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:09.910136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:09.910137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:09.910138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:09.910139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:09.910140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:09.910141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:09.910142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:09.910143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:09.910143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.910144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.910145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.910146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:09.910147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:09.910151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:09.910158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:09.910160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:09.910163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:09.910165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:09.910168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:09.910170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:09.910173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:09.910175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:09.910177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:09.910180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.910182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.910184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.910187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:09.910189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:09.910195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:09.910200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:09.910204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:09.910208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:09.910213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:09.910217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:09.910220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:09.910223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:09.910226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:09.910230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:09.910233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:09.910236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:09.910240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:09.910243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:09.910246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:09.910250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:09.910253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:09.910257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:09.910259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:09.910262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:09.910265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.910268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.910270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.910273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.910276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.910279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.910282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:09.910285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:09.910288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:09.910301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:09.910330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:09.915962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:09.917056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:09.917075Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:09.917078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:09.917082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:09.917089Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1773 [2:7555895915763023501:10201]
2025-09-30T14:55:09.917105Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:09.917122Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:09.917125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:09.917130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:09.917132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:09.917148Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:09.917155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:09.917162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:09.917221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.917224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.917225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.917228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:09.917231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:09.917300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:09.917303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.917316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:09.917329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:09.917346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:09.917368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895915763023495:10201]
2025-09-30T14:55:09.917375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895915763023495:10201]
2025-09-30T14:55:09.917377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895915763023495:10201]
2025-09-30T14:55:09.917385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:09.917397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:09.917402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:09.917407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:09.917410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:09.917418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:09.917422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:09.917432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895915852791532:7361], now have 1 active actors on pipe
2025-09-30T14:55:09.917441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895915852791426:2454], now have 1 active actors on pipe
2025-09-30T14:55:09.917470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895915763023495:10201]
2025-09-30T14:55:09.917484Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:09.917541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1773
2025-09-30T14:55:09.917577Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1773
2025-09-30T14:55:09.918326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:09.918355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:09.918365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:09.918403Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e465add-7c02a269-594cdb0f-1474e47a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:09.918421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:09.918425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:09.918427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:09.918439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:09.918451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:09.918470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:09.918702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:09.918712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:09.918728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:09.923744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1774 partition: 0 MaxSeqNo: 42 sessionId: src_id|7e465add-7c02a269-594cdb0f-1474e47a_0
2025-09-30T14:55:09.924132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43887efe-1588a7e-c751bb96-451a763f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7e465add-7c02a269-594cdb0f-1474e47a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:09.927024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e465add-7c02a269-594cdb0f-1474e47a_0] Write session: try to update token
2025-09-30T14:55:09.927044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e465add-7c02a269-594cdb0f-1474e47a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:09.938395Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:09.938416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:09.938419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:09.938421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:09.938431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895915763023495:10201]
2025-09-30T14:55:09.938438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895915763023495:10201]
2025-09-30T14:55:09.938442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895915763023495:10201]
2025-09-30T14:55:09.938482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:09.938489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:09.938491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:09.938490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:09.938497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:09.938501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:09.938626Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:09.950394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1774 sessionId: src_id|7e465add-7c02a269-594cdb0f-1474e47a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:09.954136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:09.983948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895915852791545:7977]
2025-09-30T14:55:09.984267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1773, pipe: [1:7555895915852791545:7977]
2025-09-30T14:55:10.055116Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:10.055506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:10.055524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:10.055545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895915852791545:7977], now have 1 active actors on pipe
2025-09-30T14:55:10.056033Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:10.056645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e465add-7c02a269-594cdb0f-1474e47a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:10.056656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e465add-7c02a269-594cdb0f-1474e47a_0] Write session will restart in 0.008254s
2025-09-30T14:55:10.056680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e465add-7c02a269-594cdb0f-1474e47a_0] Write session: Do CDS request
2025-09-30T14:55:10.056686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e465add-7c02a269-594cdb0f-1474e47a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:10.056018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:10.056031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:10.056086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1774 reason: error at write: Disconnected sessionId: src_id|7e465add-7c02a269-594cdb0f-1474e47a_0
2025-09-30T14:55:10.056239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1774 sessionId: src_id|7e465add-7c02a269-594cdb0f-1474e47a_0 is DEAD
2025-09-30T14:55:10.056375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:10.056411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895915852791545:7977]
2025-09-30T14:55:10.066460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e465add-7c02a269-594cdb0f-1474e47a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:10.067416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:10.067434Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1775
2025-09-30T14:55:10.067573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1775 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:10.067598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1775 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:10.067603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1775 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:10.067608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:10.068094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1775 sessionId:  describe result for acl check
2025-09-30T14:55:10.068128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:10.068132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:10.068135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:10.068142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895920147758912:7350] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:10.068721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895920147758912:7350] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:10.070947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895920147758912:7350] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:10.072428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:10.077358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895920147758912:7350] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:10.077382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895920147758912:7350] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:10.077385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895920147758912:7350] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:10.077394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1775 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:10.077475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:10.077748Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:10.077762Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:10.077777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:10.077847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:10.077888Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895920057990919:10203]
2025-09-30T14:55:10.078575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:10.078919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:10.078975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:10.079444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:10.079537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:10.079545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:10.079546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:10.079547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:10.079549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:10.079550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:10.079552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:10.079553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:10.079555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:10.079556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:10.079558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.079559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.079560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.079562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:10.079563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:10.079571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:10.079583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:10.079587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:10.079591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:10.079595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:10.079599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:10.079602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:10.079606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:10.079611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:10.079616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:10.079620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.079624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.079627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.079630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:10.079634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:10.079642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:10.079650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:10.079656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:10.079662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:10.079670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:10.079676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:10.079681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:10.079688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:10.079693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:10.079699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:10.079704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:10.079713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:10.079719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:10.079725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:10.079728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:10.079734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:10.079740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:10.079744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:10.079748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:10.079752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:10.079756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.079761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.079764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.079769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.079773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.079779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.079783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:10.079789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:10.079794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:10.079799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:10.079840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:10.087145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:10.088127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:10.088146Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:10.088150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:10.088153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:10.088160Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1774 [2:7555895920057990919:10203]
2025-09-30T14:55:10.088176Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:10.088191Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:10.088194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:10.088197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:10.088199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:10.088214Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:10.088220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:10.088227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:10.088287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.088291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.088293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.088296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:10.088299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:10.088369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:10.088371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.088385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.088398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.088417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:10.088448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895920057990907:10203]
2025-09-30T14:55:10.088451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895920057990907:10203]
2025-09-30T14:55:10.088455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895920057990907:10203]
2025-09-30T14:55:10.088473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:10.088486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:10.088502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:10.088504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:10.088523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:10.088527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:10.088530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:10.088537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895920057990907:10203]
2025-09-30T14:55:10.088540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:10.088621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:10.088674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895920147758950:7350], now have 1 active actors on pipe
2025-09-30T14:55:10.088685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895920147758842:2454], now have 1 active actors on pipe
2025-09-30T14:55:10.089332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1774
2025-09-30T14:55:10.089368Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1774
2025-09-30T14:55:10.089464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:10.089474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:10.089504Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|466f4884-117bc5c-f5b8381c-8cb72c71_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:10.089512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:10.089516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:10.089521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:10.089532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:10.089544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:10.089560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:10.089789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:10.089799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:10.089820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:10.089935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1775 partition: 0 MaxSeqNo: 42 sessionId: src_id|466f4884-117bc5c-f5b8381c-8cb72c71_0
2025-09-30T14:55:10.090338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e465add-7c02a269-594cdb0f-1474e47a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|466f4884-117bc5c-f5b8381c-8cb72c71_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:10.093444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|466f4884-117bc5c-f5b8381c-8cb72c71_0] Write session: try to update token
2025-09-30T14:55:10.093464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|466f4884-117bc5c-f5b8381c-8cb72c71_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:10.114815Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:10.114834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:10.114844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895920057990907:10203]
2025-09-30T14:55:10.114895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:10.114917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:10.115093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:10.115238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:10.115900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:10.116065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:10.116281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:10.116351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:10.122112Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:10.122129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:10.122132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:10.122134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:10.122144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895920057990907:10203]
2025-09-30T14:55:10.122147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895920057990907:10203]
2025-09-30T14:55:10.122151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895920057990907:10203]
2025-09-30T14:55:10.122192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:10.122203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.122206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:10.122350Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:10.123621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:10.123638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:10.123642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:10.128148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1775 sessionId: src_id|466f4884-117bc5c-f5b8381c-8cb72c71_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:10.131001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:10.156773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895920147758989:7977]
2025-09-30T14:55:10.157270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1774, pipe: [1:7555895920147758989:7977]
2025-09-30T14:55:10.253898Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:10.254553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:10.254568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:10.254587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895920147758989:7977], now have 1 active actors on pipe
2025-09-30T14:55:10.254823Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:10.255368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895920147758989:7977]
2025-09-30T14:55:10.255399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:10.255439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:10.255529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1775 reason: status is not ok: tablet will be restarted right now sessionId: src_id|466f4884-117bc5c-f5b8381c-8cb72c71_0
2025-09-30T14:55:10.255717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1775 sessionId: src_id|466f4884-117bc5c-f5b8381c-8cb72c71_0 is DEAD
2025-09-30T14:55:10.259492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|466f4884-117bc5c-f5b8381c-8cb72c71_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:10.259506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|466f4884-117bc5c-f5b8381c-8cb72c71_0] Write session will restart in 0.008169s
2025-09-30T14:55:10.259533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|466f4884-117bc5c-f5b8381c-8cb72c71_0] Write session: Do CDS request
2025-09-30T14:55:10.259539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|466f4884-117bc5c-f5b8381c-8cb72c71_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:10.268968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|466f4884-117bc5c-f5b8381c-8cb72c71_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:10.271632Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:10.271649Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1776
2025-09-30T14:55:10.271813Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1776 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:10.271855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1776 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:10.271865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1776 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:10.271870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:10.272311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1776 sessionId:  describe result for acl check
2025-09-30T14:55:10.272347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:10.272349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:10.272351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:10.272357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895920147759066:7338] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:10.273356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895920147759066:7338] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:10.274439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:10.277482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:10.277729Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:10.277734Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:10.277761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:10.277834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:10.277878Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895920057991053:10217]
2025-09-30T14:55:10.278342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895920147759066:7338] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:10.278505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:10.278917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:10.278993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:10.279372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:10.279455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:10.279456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:10.279457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:10.279458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:10.279460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:10.279461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:10.279462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:10.279463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:10.279465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:10.279466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:10.279468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.279468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.279470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.279471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:10.279472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:10.279479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:10.279488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:10.279492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:10.279496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:10.279500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:10.279504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:10.279508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:10.279512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:10.279516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:10.279523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:10.279526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.279530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.279533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.279537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:10.279541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:10.279549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:10.279555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:10.279561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:10.279567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:10.279571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:10.279577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:10.279581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:10.279586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:10.279590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:10.279595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:10.279599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:10.279604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:10.279609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:10.279614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:10.279618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:10.279623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:10.279627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:10.279632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:10.279636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:10.279641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:10.279645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.279650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.279656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.279660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.279665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.279670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.279674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:10.279679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:10.279683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:10.279688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:10.279727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:10.283860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895920147759066:7338] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:10.283889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895920147759066:7338] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:10.283892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895920147759066:7338] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:10.283901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1776 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:10.286698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:10.287716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:10.287736Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:10.287739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:10.287743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:10.287751Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1775 [2:7555895920057991053:10217]
2025-09-30T14:55:10.287767Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:10.287783Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:10.287786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:10.287789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:10.287792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:10.287808Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:10.287816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:10.287823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:10.287887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.287893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.287895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.287898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:10.287901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:10.287979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:10.287988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.288002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.288014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.288036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:10.288057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895920057991047:10217]
2025-09-30T14:55:10.288060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895920057991047:10217]
2025-09-30T14:55:10.288062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895920057991047:10217]
2025-09-30T14:55:10.288075Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:10.288095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:10.288115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:10.288122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:10.288159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895920057991047:10217]
2025-09-30T14:55:10.288165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:10.288343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:10.288351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:10.288353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:10.288358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:10.288449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1775
2025-09-30T14:55:10.288666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1775
2025-09-30T14:55:10.288945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895920147758994:2454], now have 1 active actors on pipe
2025-09-30T14:55:10.288956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895920147759105:7338], now have 1 active actors on pipe
2025-09-30T14:55:10.288977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:10.288983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:10.289021Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72e1ba4f-f79f8a3b-dcae0f95-af24851_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:10.289029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:10.289035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:10.289038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:10.289048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:10.289061Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:10.289076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:10.289286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:10.289305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:10.289330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:10.289437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1776 partition: 0 MaxSeqNo: 42 sessionId: src_id|72e1ba4f-f79f8a3b-dcae0f95-af24851_0
2025-09-30T14:55:10.291528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|466f4884-117bc5c-f5b8381c-8cb72c71_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|72e1ba4f-f79f8a3b-dcae0f95-af24851_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:10.294487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72e1ba4f-f79f8a3b-dcae0f95-af24851_0] Write session: try to update token
2025-09-30T14:55:10.294513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72e1ba4f-f79f8a3b-dcae0f95-af24851_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:10.308941Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:10.308962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:10.308965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:10.308968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:10.308977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895920057991047:10217]
2025-09-30T14:55:10.308986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895920057991047:10217]
2025-09-30T14:55:10.308990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895920057991047:10217]
2025-09-30T14:55:10.309033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:10.309040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.309039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:10.309043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:10.309046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:10.309050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:10.309204Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:10.314518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1776 sessionId: src_id|72e1ba4f-f79f8a3b-dcae0f95-af24851_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:10.318048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:10.355640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895920147759114:7977]
2025-09-30T14:55:10.356083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1775, pipe: [1:7555895920147759114:7977]
2025-09-30T14:55:10.431162Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:10.431537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:10.431555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:10.431599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895920147759114:7977], now have 1 active actors on pipe
2025-09-30T14:55:10.431862Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:10.431858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:10.431869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895920147759114:7977]
2025-09-30T14:55:10.431896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:10.431899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:10.431961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1776 reason: error at write: Disconnected sessionId: src_id|72e1ba4f-f79f8a3b-dcae0f95-af24851_0
2025-09-30T14:55:10.432162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1776 sessionId: src_id|72e1ba4f-f79f8a3b-dcae0f95-af24851_0 is DEAD
2025-09-30T14:55:10.432311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72e1ba4f-f79f8a3b-dcae0f95-af24851_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:10.432319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72e1ba4f-f79f8a3b-dcae0f95-af24851_0] Write session will restart in 0.005597s
2025-09-30T14:55:10.432336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72e1ba4f-f79f8a3b-dcae0f95-af24851_0] Write session: Do CDS request
2025-09-30T14:55:10.432343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72e1ba4f-f79f8a3b-dcae0f95-af24851_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:10.438829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72e1ba4f-f79f8a3b-dcae0f95-af24851_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:10.438911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:10.438933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1777
2025-09-30T14:55:10.439070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1777 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:10.439109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1777 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:10.439120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1777 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:10.439124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:10.439637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1777 sessionId:  describe result for acl check
2025-09-30T14:55:10.439679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:10.439687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:10.439689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:10.439695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895920147759138:7324] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:10.440300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895920147759138:7324] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:10.442455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895920147759138:7324] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:10.442581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:10.444634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:10.444853Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:10.444865Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:10.444877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:10.444938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:10.444990Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895920057991167:10220]
2025-09-30T14:55:10.445055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895920147759138:7324] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:10.445081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895920147759138:7324] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:10.445084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895920147759138:7324] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:10.445093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1777 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:10.445617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:10.445982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:10.446042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:10.446399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:10.446493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:10.446500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:10.446501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:10.446502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:10.446504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:10.446505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:10.446506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:10.446508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:10.446509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:10.446511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:10.446512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.446513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.446515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.446516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:10.446517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:10.446523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:10.446535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:10.446540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:10.446545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:10.446549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:10.446553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:10.446558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:10.446562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:10.446567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:10.446571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:10.446575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.446580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.446599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.446603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:10.446607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:10.446618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:10.446627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:10.446633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:10.446640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:10.446645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:10.446651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:10.446656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:10.446662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:10.446667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:10.446672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:10.446678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:10.446683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:10.446690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:10.446696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:10.446700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:10.446706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:10.446711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:10.446716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:10.446720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:10.446726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:10.446731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.446738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.446743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.446750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.446755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.446761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.446767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:10.446773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:10.446778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:10.446783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:10.446829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:10.452664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:10.453625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:10.453662Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:10.453665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:10.453670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:10.453678Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1776 [2:7555895920057991167:10220]
2025-09-30T14:55:10.453703Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:10.453720Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:10.453732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:10.453735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:10.453738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:10.453757Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:10.453770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:10.453787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:10.453864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.453875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.453877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.453881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:10.453884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:10.453958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:10.453970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.453984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.453997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.454020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:10.454040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895920147759224:7324], now have 1 active actors on pipe
2025-09-30T14:55:10.454044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895920147759115:2454], now have 1 active actors on pipe
2025-09-30T14:55:10.454053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895920057991161:10220]
2025-09-30T14:55:10.454074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895920057991161:10220]
2025-09-30T14:55:10.454082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895920057991161:10220]
2025-09-30T14:55:10.454097Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:10.454113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:10.454116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:10.454123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:10.454126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:10.454133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:10.454137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:10.454176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895920057991161:10220]
2025-09-30T14:55:10.454188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:10.454135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1776
2025-09-30T14:55:10.454167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1776
2025-09-30T14:55:10.454218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:10.454359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:10.454371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:10.454401Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c211f819-91012a28-a5fc90c3-25a6c6ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:10.454414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:10.454423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:10.454426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:10.454438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:10.454452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:10.454472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:10.454636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:10.454646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:10.454661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:10.454791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1777 partition: 0 MaxSeqNo: 42 sessionId: src_id|c211f819-91012a28-a5fc90c3-25a6c6ed_0
2025-09-30T14:55:10.455168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72e1ba4f-f79f8a3b-dcae0f95-af24851_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c211f819-91012a28-a5fc90c3-25a6c6ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:10.458075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c211f819-91012a28-a5fc90c3-25a6c6ed_0] Write session: try to update token
2025-09-30T14:55:10.458096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c211f819-91012a28-a5fc90c3-25a6c6ed_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:10.472943Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:10.472965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:10.472990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895920057991161:10220]
2025-09-30T14:55:10.473045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:10.473053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:10.473232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:10.473399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:10.473585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:10.473758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:10.473987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:10.474039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:10.478725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1777 sessionId: src_id|c211f819-91012a28-a5fc90c3-25a6c6ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:10.480766Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:10.480791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:10.480794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:10.480796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:10.480807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895920057991161:10220]
2025-09-30T14:55:10.480812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895920057991161:10220]
2025-09-30T14:55:10.480816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895920057991161:10220]
2025-09-30T14:55:10.480858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:10.480868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.480872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:10.480876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:10.480883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:10.480888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:10.481018Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:10.481762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:10.532317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895920147759236:7977]
2025-09-30T14:55:10.532579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1776, pipe: [1:7555895920147759236:7977]
2025-09-30T14:55:10.592219Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:10.592632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:10.592651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:10.592675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895920147759236:7977], now have 1 active actors on pipe
2025-09-30T14:55:10.592889Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:10.592937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:10.592944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895920147759236:7977]
2025-09-30T14:55:10.592954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:10.592967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:10.593023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1777 reason: error at write: Disconnected sessionId: src_id|c211f819-91012a28-a5fc90c3-25a6c6ed_0
2025-09-30T14:55:10.593215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1777 sessionId: src_id|c211f819-91012a28-a5fc90c3-25a6c6ed_0 is DEAD
2025-09-30T14:55:10.593574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c211f819-91012a28-a5fc90c3-25a6c6ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:10.593586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c211f819-91012a28-a5fc90c3-25a6c6ed_0] Write session will restart in 0.008580s
2025-09-30T14:55:10.593622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c211f819-91012a28-a5fc90c3-25a6c6ed_0] Write session: Do CDS request
2025-09-30T14:55:10.593632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c211f819-91012a28-a5fc90c3-25a6c6ed_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:10.602784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:10.603783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c211f819-91012a28-a5fc90c3-25a6c6ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:10.603922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:10.603939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1778
2025-09-30T14:55:10.604958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:10.605192Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:10.605203Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:10.605214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:10.605286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:10.605327Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895920057991292:10223]
2025-09-30T14:55:10.606007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:10.606408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:10.606480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:10.606837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:10.606905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:10.606910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:10.606912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:10.606913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:10.606915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:10.606916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:10.606917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:10.606918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:10.606919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:10.606920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:10.606922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.606923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.606925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.606926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:10.606927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:10.606933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:10.606944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:10.606948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:10.606951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:10.606955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:10.606958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:10.606962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:10.606966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:10.606969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:10.606974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:10.606978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.606981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.606985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.606989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:10.606993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:10.607004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:10.607013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:10.607019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:10.607024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:10.607029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:10.607035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:10.607039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:10.607051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:10.607056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:10.607062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:10.607068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:10.607078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:10.607083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:10.607089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:10.607098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:10.607103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:10.607108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:10.607118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:10.607123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:10.607130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:10.607140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.607145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.607150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.607155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.607160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.607166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.607170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:10.607175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:10.607180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:10.607186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:10.607228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:10.607373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1778 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:10.607432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1778 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:10.607442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1778 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:10.607447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:10.607900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1778 sessionId:  describe result for acl check
2025-09-30T14:55:10.607939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:10.607955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:10.607957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:10.607964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895920147759319:7327] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:10.608534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895920147759319:7327] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:10.610440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895920147759319:7327] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:10.613015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:10.613474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895920147759319:7327] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:10.613493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895920147759319:7327] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:10.613497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895920147759319:7327] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:10.613506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1778 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:10.614009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:10.614025Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:10.614027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:10.614031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:10.614039Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1777 [2:7555895920057991292:10223]
2025-09-30T14:55:10.614056Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:10.614070Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:10.614073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:10.614076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:10.614078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:10.614095Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:10.614108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:10.614116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:10.614178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.614187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.614189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.614192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:10.614195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:10.614267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:10.614274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.614287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.614305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.614334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:10.614358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895920147759237:2454], now have 1 active actors on pipe
2025-09-30T14:55:10.614362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895920147759354:7327], now have 1 active actors on pipe
2025-09-30T14:55:10.614368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895920057991286:10223]
2025-09-30T14:55:10.614370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895920057991286:10223]
2025-09-30T14:55:10.614373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895920057991286:10223]
2025-09-30T14:55:10.614388Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:10.614401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:10.614407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:10.614417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:10.614420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:10.614428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:10.614431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:10.614395Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1777
2025-09-30T14:55:10.614438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1777
2025-09-30T14:55:10.614473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895920057991286:10223]
2025-09-30T14:55:10.614489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:10.614493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:10.614514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:10.614522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:10.614552Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14623919-88e17da4-290d3e0e-feb9d0f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:10.614564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:10.614567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:10.614569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:10.614578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:10.614591Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:10.614616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:10.614754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:10.614761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:10.614774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:10.614865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1778 partition: 0 MaxSeqNo: 42 sessionId: src_id|14623919-88e17da4-290d3e0e-feb9d0f6_0
2025-09-30T14:55:10.615256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c211f819-91012a28-a5fc90c3-25a6c6ed_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|14623919-88e17da4-290d3e0e-feb9d0f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:10.618316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14623919-88e17da4-290d3e0e-feb9d0f6_0] Write session: try to update token
2025-09-30T14:55:10.618341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14623919-88e17da4-290d3e0e-feb9d0f6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:10.627726Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:10.627746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:10.627749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:10.627751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:10.627762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895920057991286:10223]
2025-09-30T14:55:10.627767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895920057991286:10223]
2025-09-30T14:55:10.627770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895920057991286:10223]
2025-09-30T14:55:10.627811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:10.627819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.627825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:10.627829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:10.627832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:10.627836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:10.627979Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:10.633982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1778 sessionId: src_id|14623919-88e17da4-290d3e0e-feb9d0f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:10.637085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:10.693044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895920147759374:7977]
2025-09-30T14:55:10.693352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1777, pipe: [1:7555895920147759374:7977]
2025-09-30T14:55:10.741913Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:10.742313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:10.742335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:10.742381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895920147759374:7977], now have 1 active actors on pipe
2025-09-30T14:55:10.742682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:10.742713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:10.742718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:10.742738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895920147759374:7977]
2025-09-30T14:55:10.742795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1778 reason: error at write: Disconnected sessionId: src_id|14623919-88e17da4-290d3e0e-feb9d0f6_0
2025-09-30T14:55:10.742979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1778 sessionId: src_id|14623919-88e17da4-290d3e0e-feb9d0f6_0 is DEAD
2025-09-30T14:55:10.743129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14623919-88e17da4-290d3e0e-feb9d0f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:10.743140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14623919-88e17da4-290d3e0e-feb9d0f6_0] Write session will restart in 0.006047s
2025-09-30T14:55:10.743174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14623919-88e17da4-290d3e0e-feb9d0f6_0] Write session: Do CDS request
2025-09-30T14:55:10.743180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14623919-88e17da4-290d3e0e-feb9d0f6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:10.743597Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:10.750827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14623919-88e17da4-290d3e0e-feb9d0f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:10.751381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:10.751401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1779
2025-09-30T14:55:10.751558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1779 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:10.751596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1779 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:10.751602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1779 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:10.751617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:10.752222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1779 sessionId:  describe result for acl check
2025-09-30T14:55:10.752257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:10.752280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:10.752282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:10.752289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895920147759439:7318] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:10.752875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895920147759439:7318] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:10.754307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:10.755019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895920147759439:7318] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:10.756603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:10.756830Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:10.756840Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:10.756851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:10.756926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:10.756978Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895920057991406:10225]
2025-09-30T14:55:10.757672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:10.757765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895920147759439:7318] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:10.757784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895920147759439:7318] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:10.757788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895920147759439:7318] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:10.757797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1779 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:10.757963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:10.758020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:10.758374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:10.758435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:10.758440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:10.758442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:10.758443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:10.758444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:10.758445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:10.758447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:10.758448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:10.758449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:10.758451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:10.758452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.758453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.758455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.758456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:10.758458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:10.758463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:10.758474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:10.758478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:10.758482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:10.758486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:10.758490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:10.758494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:10.758498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:10.758502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:10.758506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:10.758510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.758514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.758518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.758522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:10.758526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:10.758534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:10.758541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:10.758548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:10.758553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:10.758559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:10.758564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:10.758569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:10.758573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:10.758578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:10.758583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:10.758587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:10.758592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:10.758599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:10.758604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:10.758608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:10.758613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:10.758618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:10.758623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:10.758627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:10.758633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:10.758637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.758642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.758646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.758650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.758654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.758659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.758663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:10.758672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:10.758676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:10.758681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:10.758731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:10.764498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:10.765617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:10.765639Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:10.765642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:10.765660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:10.765670Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1778 [2:7555895920057991406:10225]
2025-09-30T14:55:10.765687Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:10.765703Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:10.765711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:10.765714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:10.765717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:10.765733Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:10.765740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:10.765753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:10.765818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.765825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.765827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.765831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:10.765834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:10.765904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:10.765911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.765925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.765945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.765964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:10.765988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895920147759375:2454], now have 1 active actors on pipe
2025-09-30T14:55:10.765992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895920147759488:7318], now have 1 active actors on pipe
2025-09-30T14:55:10.765998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895920057991400:10225]
2025-09-30T14:55:10.766001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895920057991400:10225]
2025-09-30T14:55:10.766003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895920057991400:10225]
2025-09-30T14:55:10.766019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:10.766033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:10.766047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:10.766037Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1778
2025-09-30T14:55:10.766073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:10.766086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:10.766055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1778
2025-09-30T14:55:10.766089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:10.766097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:10.766139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895920057991400:10225]
2025-09-30T14:55:10.766151Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:10.766158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:10.766174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:10.766181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:10.766232Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fcb8aa76-1845d82d-1573aac7-9bf072e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:10.766243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:10.766247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:10.766250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:10.766259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:10.766269Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:10.766285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:10.766479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:10.766491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:10.766505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:10.766601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1779 partition: 0 MaxSeqNo: 42 sessionId: src_id|fcb8aa76-1845d82d-1573aac7-9bf072e3_0
2025-09-30T14:55:10.766968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14623919-88e17da4-290d3e0e-feb9d0f6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fcb8aa76-1845d82d-1573aac7-9bf072e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:10.770087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcb8aa76-1845d82d-1573aac7-9bf072e3_0] Write session: try to update token
2025-09-30T14:55:10.770111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcb8aa76-1845d82d-1573aac7-9bf072e3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:10.779293Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:10.779314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:10.779324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895920057991400:10225]
2025-09-30T14:55:10.779371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:10.779545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:10.779674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:10.779811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:10.779950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:10.780160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:10.780206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:10.780308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:10.789347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1779 sessionId: src_id|fcb8aa76-1845d82d-1573aac7-9bf072e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:10.791137Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:10.791156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:10.791158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:10.791161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:10.791175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895920057991400:10225]
2025-09-30T14:55:10.791179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895920057991400:10225]
2025-09-30T14:55:10.791184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895920057991400:10225]
2025-09-30T14:55:10.791224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:10.791228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:10.791231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.791234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:10.791235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:10.791239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:10.791446Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:10.792288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:10.843094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895920147759498:7977]
2025-09-30T14:55:10.843439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1778, pipe: [1:7555895920147759498:7977]
2025-09-30T14:55:10.906263Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:10.906600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:10.906619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:10.906649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895920147759498:7977], now have 1 active actors on pipe
2025-09-30T14:55:10.906935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:10.906992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895920147759498:7977]
2025-09-30T14:55:10.907015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:10.907091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1779 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fcb8aa76-1845d82d-1573aac7-9bf072e3_0
2025-09-30T14:55:10.906838Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:10.907283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1779 sessionId: src_id|fcb8aa76-1845d82d-1573aac7-9bf072e3_0 is DEAD
2025-09-30T14:55:10.909075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcb8aa76-1845d82d-1573aac7-9bf072e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:10.909086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcb8aa76-1845d82d-1573aac7-9bf072e3_0] Write session will restart in 0.008900s
2025-09-30T14:55:10.909106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcb8aa76-1845d82d-1573aac7-9bf072e3_0] Write session: Do CDS request
2025-09-30T14:55:10.909111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcb8aa76-1845d82d-1573aac7-9bf072e3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:10.919050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcb8aa76-1845d82d-1573aac7-9bf072e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:10.919414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:10.919431Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1780
2025-09-30T14:55:10.919642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1780 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:10.919678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1780 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:10.919689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1780 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:10.919693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:10.920207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1780 sessionId:  describe result for acl check
2025-09-30T14:55:10.920242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:10.920247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:10.920249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:10.920254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895920147759517:7314] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:10.920791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895920147759517:7314] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:10.924522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895920147759517:7314] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:10.926604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:10.928207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:10.928421Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:10.928431Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:10.928442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:10.928501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:10.928550Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895920057991523:10228]
2025-09-30T14:55:10.928422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895920147759517:7314] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:10.928439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895920147759517:7314] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:10.928443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895920147759517:7314] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:10.928460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1780 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:10.929074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:10.929394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:10.929446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:10.929717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:10.929768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:10.929773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:10.929774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:10.929775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:10.929775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:10.929777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:10.929778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:10.929778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:10.929779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:10.929780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:10.929781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.929781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.929782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.929783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:10.929784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:10.929790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:10.929800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:10.929804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:10.929808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:10.929813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:10.929815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:10.929818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:10.929820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:10.929822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:10.929825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:10.929827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.929829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.929831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.929834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:10.929836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:10.929842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:10.929856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:10.929860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:10.929864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:10.929867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:10.929870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:10.929873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:10.929876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:10.929879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:10.929883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:10.929886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:10.929889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:10.929892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:10.929896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:10.929900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:10.929903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:10.929906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:10.929909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:10.929911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:10.929915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:10.929918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.929921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.929923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.929927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.929931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.929937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.929941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:10.929947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:10.929952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:10.929957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:10.929984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:10.936666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:10.937685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:10.937704Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:10.937708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:10.937713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:10.937722Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1779 [2:7555895920057991523:10228]
2025-09-30T14:55:10.937741Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:10.937759Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:10.937762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:10.937764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:10.937767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:10.937781Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:10.937791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:10.937798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:10.937863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.937871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.937873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.937877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:10.937880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:10.937956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:10.937966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.937979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:10.937990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:10.938006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:10.938028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895920147759499:2454], now have 1 active actors on pipe
2025-09-30T14:55:10.938040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895920057991518:10228]
2025-09-30T14:55:10.938043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895920057991518:10228]
2025-09-30T14:55:10.938045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895920057991518:10228]
2025-09-30T14:55:10.938056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:10.938069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:10.938074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895920147759612:7314], now have 1 active actors on pipe
2025-09-30T14:55:10.938077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:10.938080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:10.938082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:10.938095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:10.938099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:10.938138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895920057991518:10228]
2025-09-30T14:55:10.938149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:10.938155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:10.938215Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1779
2025-09-30T14:55:10.938246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1779
2025-09-30T14:55:10.938321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:10.938334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:10.938367Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8a40129-72082b26-860ae4ad-36044739_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:10.938379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:10.938385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:10.938388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:10.938400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:10.938416Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:10.938436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:10.938636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:10.938648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:10.938671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:10.938770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1780 partition: 0 MaxSeqNo: 42 sessionId: src_id|e8a40129-72082b26-860ae4ad-36044739_0
2025-09-30T14:55:10.939180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcb8aa76-1845d82d-1573aac7-9bf072e3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e8a40129-72082b26-860ae4ad-36044739_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:10.942346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8a40129-72082b26-860ae4ad-36044739_0] Write session: try to update token
2025-09-30T14:55:10.942369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8a40129-72082b26-860ae4ad-36044739_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:10.951825Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:10.951846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:10.951855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895920057991518:10228]
2025-09-30T14:55:10.951904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:10.952084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:10.952093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:10.952225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:10.952365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:10.952506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:10.952806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:10.952848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:10.961984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1780 sessionId: src_id|e8a40129-72082b26-860ae4ad-36044739_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:10.964911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:10.967605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:10.967628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:10.967666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:10.968264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:10.973357Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:10.973372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:10.973374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:10.973378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:10.973388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895920057991518:10228]
2025-09-30T14:55:10.973394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895920057991518:10228]
2025-09-30T14:55:10.973398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895920057991518:10228]
2025-09-30T14:55:10.973440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:10.973450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:10.973453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:10.973454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:10.973463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:10.973468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:10.973596Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:11.006914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895924442726925:7977]
2025-09-30T14:55:11.007502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1779, pipe: [1:7555895924442726925:7977]
2025-09-30T14:55:11.090268Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:11.099192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:11.103342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:11.103360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:11.103393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1780 reason: error at write: Disconnected sessionId: src_id|e8a40129-72082b26-860ae4ad-36044739_0
2025-09-30T14:55:11.103593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1780 sessionId: src_id|e8a40129-72082b26-860ae4ad-36044739_0 is DEAD
2025-09-30T14:55:11.103764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8a40129-72082b26-860ae4ad-36044739_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:11.103753Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:11.103777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8a40129-72082b26-860ae4ad-36044739_0] Write session will restart in 0.008993s
2025-09-30T14:55:11.103804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8a40129-72082b26-860ae4ad-36044739_0] Write session: Do CDS request
2025-09-30T14:55:11.103811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8a40129-72082b26-860ae4ad-36044739_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:11.103804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895924442726925:7977]
2025-09-30T14:55:11.099367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:11.099574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:11.099636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:11.099703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:11.099775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:11.099824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:11.099829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:11.099905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:11.099971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:11.100041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:11.100111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:11.100157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:11.100161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:11.100237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:11.100305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:11.100376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:11.100444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:11.100488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:11.100491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:11.100566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:11.100637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:11.100700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:11.100770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:11.100810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:11.100812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:11.100888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:11.100952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:11.101019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:11.101091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:11.101139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:11.101143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:11.101216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:11.101281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:11.101347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:11.101418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:11.101466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:11.101472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:11.101553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:11.101614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:11.101704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:11.101772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:11.101820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:11.101823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:11.101906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:11.101971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:11.102037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:11.102104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:11.102150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:11.102153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:11.102235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:11.102306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:11.102375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:11.102475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:11.102522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:11.102525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:11.102622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:11.102689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:11.102785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:11.102863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:11.102908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:11.102912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:11.102996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895924442726925:7977], now have 1 active actors on pipe
2025-09-30T14:55:11.103611Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:11.115689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8a40129-72082b26-860ae4ad-36044739_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:11.115946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:11.115967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1781
2025-09-30T14:55:11.119512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1781 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:11.119578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1781 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:11.119588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1781 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:11.119597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:11.121205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1781 sessionId:  describe result for acl check
2025-09-30T14:55:11.121277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:11.121293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:11.121299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:11.121308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895924442727008:7305] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:11.122305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895924442727008:7305] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:11.126036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:11.125997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895924442727008:7305] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:11.128187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:11.128449Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:11.128462Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:11.128478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:11.128548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:11.128607Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895924352958950:10230]
2025-09-30T14:55:11.129342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:11.130202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895924442727008:7305] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:11.130222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895924442727008:7305] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:11.130226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895924442727008:7305] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:11.130235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1781 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:11.129690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:11.129748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:11.130053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:11.130110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:11.130112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:11.130113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:11.130114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:11.130115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:11.130117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:11.130119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:11.130120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:11.130121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:11.130122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:11.130123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.130125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.130126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.130127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:11.130128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:11.130134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:11.130145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:11.130149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:11.130153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:11.130156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:11.130160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:11.130164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:11.130168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:11.130171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:11.130175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:11.130179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.130182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.130185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.130188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:11.130192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:11.130201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:11.130211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:11.130217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:11.130223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:11.130229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:11.130234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:11.130239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:11.130243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:11.130250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:11.130255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:11.130259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:11.130264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:11.130268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:11.130276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:11.130280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:11.130285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:11.130289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:11.130294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:11.130298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:11.130303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:11.130307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.130313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.130317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.130321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.130326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.130330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.130335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:11.130340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:11.130345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:11.130350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:11.130395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:11.136378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:11.137523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:11.137543Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:11.137547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:11.137551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:11.137559Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1780 [2:7555895924352958950:10230]
2025-09-30T14:55:11.137578Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:11.137597Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:11.137601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:11.137605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:11.137609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:11.137629Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:11.137643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:11.137668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:11.137744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.137754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.137756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.137760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:11.137763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:11.137850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:11.137860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.137873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.137885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.137909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:11.137937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895924352958945:10230]
2025-09-30T14:55:11.137945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895924352958945:10230]
2025-09-30T14:55:11.137947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895924352958945:10230]
2025-09-30T14:55:11.137963Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:11.137984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:11.138003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:11.138010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:11.138019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:11.138022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:11.138024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:11.138055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895924352958945:10230]
2025-09-30T14:55:11.138063Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:11.138125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:11.138289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895924442726930:2454], now have 1 active actors on pipe
2025-09-30T14:55:11.138301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895924442727054:7305], now have 1 active actors on pipe
2025-09-30T14:55:11.139329Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1780
2025-09-30T14:55:11.139380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1780
2025-09-30T14:55:11.139539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:11.139553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:11.139583Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|80b77445-51cda618-d8c3febf-8ed57e25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:11.139599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:11.139609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:11.139619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:11.139632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:11.139650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:11.139673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:11.139972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:11.139993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:11.140023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:11.140139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1781 partition: 0 MaxSeqNo: 42 sessionId: src_id|80b77445-51cda618-d8c3febf-8ed57e25_0
2025-09-30T14:55:11.141495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8a40129-72082b26-860ae4ad-36044739_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|80b77445-51cda618-d8c3febf-8ed57e25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:11.144585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80b77445-51cda618-d8c3febf-8ed57e25_0] Write session: try to update token
2025-09-30T14:55:11.144612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80b77445-51cda618-d8c3febf-8ed57e25_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:11.161122Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:11.161147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:11.161150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:11.161152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:11.161163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895924352958945:10230]
2025-09-30T14:55:11.161167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895924352958945:10230]
2025-09-30T14:55:11.161173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895924352958945:10230]
2025-09-30T14:55:11.161223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:11.161231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.161234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:11.161232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:11.161245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:11.161250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:11.161423Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:11.173081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1781 sessionId: src_id|80b77445-51cda618-d8c3febf-8ed57e25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:11.175953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:11.204050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895924442727085:7977]
2025-09-30T14:55:11.204399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1780, pipe: [1:7555895924442727085:7977]
2025-09-30T14:55:11.287950Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:11.288339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:11.288356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:11.288379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895924442727085:7977], now have 1 active actors on pipe
2025-09-30T14:55:11.288588Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:11.288662Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:11.288665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895924442727085:7977]
2025-09-30T14:55:11.288687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:11.288768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1781 reason: status is not ok: tablet will be restarted right now sessionId: src_id|80b77445-51cda618-d8c3febf-8ed57e25_0
2025-09-30T14:55:11.288940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1781 sessionId: src_id|80b77445-51cda618-d8c3febf-8ed57e25_0 is DEAD
2025-09-30T14:55:11.289118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80b77445-51cda618-d8c3febf-8ed57e25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:11.289131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80b77445-51cda618-d8c3febf-8ed57e25_0] Write session will restart in 0.009755s
2025-09-30T14:55:11.289156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80b77445-51cda618-d8c3febf-8ed57e25_0] Write session: Do CDS request
2025-09-30T14:55:11.289163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80b77445-51cda618-d8c3febf-8ed57e25_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:11.299260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:11.299782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80b77445-51cda618-d8c3febf-8ed57e25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:11.300221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:11.300242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1782
2025-09-30T14:55:11.300801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1782 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:11.300841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1782 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:11.300854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1782 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:11.300858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:11.301322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:11.301368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1782 sessionId:  describe result for acl check
2025-09-30T14:55:11.301423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:11.301434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:11.301436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:11.301442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895924442727168:7282] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:11.301672Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:11.301685Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:11.301698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:11.301762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:11.301827Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895924352959090:5767]
2025-09-30T14:55:11.302024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895924442727168:7282] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:11.302331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:11.302617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:11.302656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:11.302970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:11.303048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:11.303057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:11.303059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:11.303059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:11.303061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:11.303062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:11.303063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:11.303064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:11.303066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:11.303067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:11.303068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.303069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.303071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.303072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:11.303073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:11.303078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:11.303088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:11.303092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:11.303095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:11.303098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:11.303103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:11.303107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:11.303110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:11.303114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:11.303119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:11.303122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.303126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.303129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.303133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:11.303136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:11.303144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:11.303152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:11.303159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:11.303164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:11.303169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:11.303174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:11.303178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:11.303183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:11.303188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:11.303192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:11.303196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:11.303201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:11.303205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:11.303209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:11.303214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:11.303218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:11.303223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:11.303228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:11.303232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:11.303236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:11.303241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.303262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.303266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.303272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.303276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.303281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.303285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:11.303290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:11.303294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:11.303298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:11.303342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:11.304412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895924442727168:7282] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:11.308945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895924442727168:7282] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:11.308969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895924442727168:7282] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:11.308973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895924442727168:7282] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:11.308984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1782 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:11.309140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:11.310289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:11.310308Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:11.310311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:11.310314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:11.310322Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1781 [2:7555895924352959090:5767]
2025-09-30T14:55:11.310339Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:11.310355Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:11.310359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:11.310362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:11.310365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:11.310381Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:11.310395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:11.310403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:11.310469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.310478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.310479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.310483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:11.310485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:11.310553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:11.310562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.310576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.310590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.310608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:11.310629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895924442727206:7282], now have 1 active actors on pipe
2025-09-30T14:55:11.310638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895924442727086:2454], now have 1 active actors on pipe
2025-09-30T14:55:11.310644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895924352959084:5767]
2025-09-30T14:55:11.310647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895924352959084:5767]
2025-09-30T14:55:11.310648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895924352959084:5767]
2025-09-30T14:55:11.310663Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:11.310681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:11.310685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:11.310689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:11.310692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:11.310701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:11.310705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:11.310739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895924352959084:5767]
2025-09-30T14:55:11.310747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:11.310759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:11.310725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1781
2025-09-30T14:55:11.310740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1781
2025-09-30T14:55:11.310783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:11.310797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:11.310828Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f516f67-e86870b-8cfed28f-b9a937aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:11.310842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:11.310846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:11.310848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:11.310858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:11.310870Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:11.310891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:11.311217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:11.311226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:11.311258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:11.311384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1782 partition: 0 MaxSeqNo: 42 sessionId: src_id|5f516f67-e86870b-8cfed28f-b9a937aa_0
2025-09-30T14:55:11.311767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80b77445-51cda618-d8c3febf-8ed57e25_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5f516f67-e86870b-8cfed28f-b9a937aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:11.314775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f516f67-e86870b-8cfed28f-b9a937aa_0] Write session: try to update token
2025-09-30T14:55:11.314797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f516f67-e86870b-8cfed28f-b9a937aa_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:11.324950Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:11.324969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:11.324972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:11.324974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:11.324984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895924352959084:5767]
2025-09-30T14:55:11.324993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895924352959084:5767]
2025-09-30T14:55:11.324998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895924352959084:5767]
2025-09-30T14:55:11.325048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:11.325056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:11.325061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.325063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:11.325064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:11.325068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:11.325223Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:11.332897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1782 sessionId: src_id|5f516f67-e86870b-8cfed28f-b9a937aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:11.335969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:11.388871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895924442727213:7977]
2025-09-30T14:55:11.389179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1781, pipe: [1:7555895924442727213:7977]
2025-09-30T14:55:11.444103Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:11.444555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:11.444571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:11.444595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895924442727213:7977], now have 1 active actors on pipe
2025-09-30T14:55:11.444826Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:11.444881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:11.444900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:11.444910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895924442727213:7977]
2025-09-30T14:55:11.444933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:11.444969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1782 reason: error at write: Disconnected sessionId: src_id|5f516f67-e86870b-8cfed28f-b9a937aa_0
2025-09-30T14:55:11.445161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1782 sessionId: src_id|5f516f67-e86870b-8cfed28f-b9a937aa_0 is DEAD
2025-09-30T14:55:11.445317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f516f67-e86870b-8cfed28f-b9a937aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:11.445326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f516f67-e86870b-8cfed28f-b9a937aa_0] Write session will restart in 0.008678s
2025-09-30T14:55:11.445350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f516f67-e86870b-8cfed28f-b9a937aa_0] Write session: Do CDS request
2025-09-30T14:55:11.445359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f516f67-e86870b-8cfed28f-b9a937aa_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:11.454827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f516f67-e86870b-8cfed28f-b9a937aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:11.454896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:11.454923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1783
2025-09-30T14:55:11.455054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1783 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:11.455092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1783 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:11.455097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1783 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:11.455102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:11.455555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1783 sessionId:  describe result for acl check
2025-09-30T14:55:11.455595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:11.455604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:11.455607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:11.455614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895924442727292:7278] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:11.456069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:11.456186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895924442727292:7278] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:11.458406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:11.458603Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:11.458611Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:11.458620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:11.458663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:11.458667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895924442727292:7278] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:11.458702Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895924352959213:5762]
2025-09-30T14:55:11.459399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:11.459782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:11.459867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:11.460276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:11.460345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:11.460351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:11.460353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:11.460354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:11.460355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:11.460356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:11.460358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:11.460359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:11.460360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:11.460362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:11.460363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.460364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.460365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.460366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:11.460368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:11.460374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:11.460386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:11.460390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:11.460395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:11.460399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:11.460404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:11.460408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:11.460412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:11.460416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:11.460421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:11.460425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.460429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.460433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.460438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:11.460441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:11.460464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:11.460472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:11.460484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:11.460490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:11.460500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:11.460505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:11.460515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:11.460521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:11.460532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:11.460549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:11.460558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:11.460564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:11.460569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:11.460575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:11.460579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:11.460584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:11.460591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:11.460600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:11.460605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:11.460610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:11.460619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.460625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.460634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.460639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.460649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.460654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.460663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:11.460669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:11.460677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:11.460683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:11.460730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:11.461399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895924442727292:7278] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:11.461420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895924442727292:7278] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:11.461423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895924442727292:7278] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:11.461444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1783 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:11.466508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:11.467527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:11.467554Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:11.467557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:11.467562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:11.467570Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1782 [2:7555895924352959213:5762]
2025-09-30T14:55:11.467588Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:11.467606Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:11.467610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:11.467613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:11.467615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:11.467632Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:11.467639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:11.467652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:11.467724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.467733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.467736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.467740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:11.467743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:11.467831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:11.467839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.467854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.467871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.467894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:11.467918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895924442727214:2454], now have 1 active actors on pipe
2025-09-30T14:55:11.467926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895924442727333:7278], now have 1 active actors on pipe
2025-09-30T14:55:11.467933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895924352959207:5762]
2025-09-30T14:55:11.467940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895924352959207:5762]
2025-09-30T14:55:11.467942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895924352959207:5762]
2025-09-30T14:55:11.467955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:11.467971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:11.467975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:11.467982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:11.467984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:11.467993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:11.467997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:11.468031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895924352959207:5762]
2025-09-30T14:55:11.467967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1782
2025-09-30T14:55:11.467986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1782
2025-09-30T14:55:11.468046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:11.468072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:11.468081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:11.468110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:11.468148Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|703d9ede-be98a938-4b8a7985-6cc495cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:11.468163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:11.468171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:11.468174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:11.468187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:11.468203Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:11.468227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:11.468517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:11.468529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:11.468549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:11.468664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1783 partition: 0 MaxSeqNo: 42 sessionId: src_id|703d9ede-be98a938-4b8a7985-6cc495cc_0
2025-09-30T14:55:11.469041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f516f67-e86870b-8cfed28f-b9a937aa_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|703d9ede-be98a938-4b8a7985-6cc495cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:11.472025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|703d9ede-be98a938-4b8a7985-6cc495cc_0] Write session: try to update token
2025-09-30T14:55:11.472047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|703d9ede-be98a938-4b8a7985-6cc495cc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:11.481259Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:11.481286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:11.481289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:11.481291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:11.481301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895924352959207:5762]
2025-09-30T14:55:11.481306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895924352959207:5762]
2025-09-30T14:55:11.481310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895924352959207:5762]
2025-09-30T14:55:11.481351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:11.481359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.481362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:11.481367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:11.481376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:11.481381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:11.481514Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:11.488636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1783 sessionId: src_id|703d9ede-be98a938-4b8a7985-6cc495cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:11.491646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:11.545009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895924442727345:7977]
2025-09-30T14:55:11.545275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1782, pipe: [1:7555895924442727345:7977]
2025-09-30T14:55:11.598767Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:11.599056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:11.599072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:11.599095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895924442727345:7977], now have 1 active actors on pipe
2025-09-30T14:55:11.599364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895924442727345:7977]
2025-09-30T14:55:11.599374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:11.599377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:11.599411Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:11.599444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1783 reason: error at write: Disconnected sessionId: src_id|703d9ede-be98a938-4b8a7985-6cc495cc_0
2025-09-30T14:55:11.599547Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:11.599631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1783 sessionId: src_id|703d9ede-be98a938-4b8a7985-6cc495cc_0 is DEAD
2025-09-30T14:55:11.599793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703d9ede-be98a938-4b8a7985-6cc495cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:11.599804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703d9ede-be98a938-4b8a7985-6cc495cc_0] Write session will restart in 0.005381s
2025-09-30T14:55:11.599827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703d9ede-be98a938-4b8a7985-6cc495cc_0] Write session: Do CDS request
2025-09-30T14:55:11.599832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703d9ede-be98a938-4b8a7985-6cc495cc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:11.606757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|703d9ede-be98a938-4b8a7985-6cc495cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:11.606863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:11.606880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1784
2025-09-30T14:55:11.607026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1784 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:11.607054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1784 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:11.607059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1784 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:11.607064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:11.607523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1784 sessionId:  describe result for acl check
2025-09-30T14:55:11.607563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:11.607570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:11.607572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:11.607578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895924442727373:7276] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:11.608143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895924442727373:7276] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:11.610487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895924442727373:7276] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:11.610987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:11.613083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:11.613319Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:11.613331Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:11.613344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:11.613422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:11.613464Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895924352959348:5761]
2025-09-30T14:55:11.613546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895924442727373:7276] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:11.613567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895924442727373:7276] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:11.613571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895924442727373:7276] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:11.613580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1784 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:11.614047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:11.614303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:11.614345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:11.614583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:11.614631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:11.614633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:11.614633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:11.614634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:11.614635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:11.614636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:11.614636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:11.614637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:11.614638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:11.614639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:11.614640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.614641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.614642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.614642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:11.614643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:11.614647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:11.614653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:11.614656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:11.614659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:11.614661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:11.614663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:11.614666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:11.614668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:11.614670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:11.614673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:11.614675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.614678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.614680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.614682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:11.614685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:11.614690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:11.614695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:11.614699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:11.614702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:11.614705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:11.614708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:11.614711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:11.614714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:11.614717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:11.614720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:11.614722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:11.614725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:11.614728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:11.614731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:11.614733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:11.614738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:11.614744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:11.614750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:11.614754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:11.614759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:11.614764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.614769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.614774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.614779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.614784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.614789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.614794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:11.614798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:11.614802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:11.614807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:11.614861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:11.620513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:11.621661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:11.621679Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:11.621683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:11.621688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:11.621695Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1783 [2:7555895924352959348:5761]
2025-09-30T14:55:11.621711Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:11.621727Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:11.621731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:11.621735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:11.621738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:11.621755Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:11.621763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:11.621771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:11.621844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.621854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.621856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.621860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:11.621863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:11.621944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:11.621953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.621968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.621985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.622008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:11.622033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895924442727347:2454], now have 1 active actors on pipe
2025-09-30T14:55:11.622042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895924442727465:7276], now have 1 active actors on pipe
2025-09-30T14:55:11.622050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895924352959342:5761]
2025-09-30T14:55:11.622057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895924352959342:5761]
2025-09-30T14:55:11.622059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895924352959342:5761]
2025-09-30T14:55:11.622073Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:11.622092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:11.622092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:11.622096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:11.622098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:11.622111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:11.622114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:11.622122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1783
2025-09-30T14:55:11.622125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1783
2025-09-30T14:55:11.622155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895924352959342:5761]
2025-09-30T14:55:11.622164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:11.622170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:11.622204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:11.622214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:11.622243Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99e7b681-1fa20075-cd35b751-7fd64556_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:11.622255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:11.622266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:11.622272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:11.622284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:11.622299Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:11.622313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:11.622505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:11.622512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:11.622529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:11.622614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1784 partition: 0 MaxSeqNo: 42 sessionId: src_id|99e7b681-1fa20075-cd35b751-7fd64556_0
2025-09-30T14:55:11.623011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703d9ede-be98a938-4b8a7985-6cc495cc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|99e7b681-1fa20075-cd35b751-7fd64556_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:11.626111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99e7b681-1fa20075-cd35b751-7fd64556_0] Write session: try to update token
2025-09-30T14:55:11.626137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99e7b681-1fa20075-cd35b751-7fd64556_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:11.635087Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:11.635108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:11.635110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:11.635113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:11.635122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895924352959342:5761]
2025-09-30T14:55:11.635127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895924352959342:5761]
2025-09-30T14:55:11.635132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895924352959342:5761]
2025-09-30T14:55:11.635178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:11.635189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.635193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:11.635199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:11.635214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:11.635218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:11.635368Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:11.641892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1784 sessionId: src_id|99e7b681-1fa20075-cd35b751-7fd64556_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:11.644626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:11.699671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895924442727490:7977]
2025-09-30T14:55:11.699914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1783, pipe: [1:7555895924442727490:7977]
2025-09-30T14:55:11.747795Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:11.748215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:11.748237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:11.748259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895924442727490:7977], now have 1 active actors on pipe
2025-09-30T14:55:11.748522Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:11.748666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895924442727490:7977]
2025-09-30T14:55:11.748718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:11.748819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:11.748831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:11.748904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1784 reason: error at write: Disconnected sessionId: src_id|99e7b681-1fa20075-cd35b751-7fd64556_0
2025-09-30T14:55:11.749104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1784 sessionId: src_id|99e7b681-1fa20075-cd35b751-7fd64556_0 is DEAD
2025-09-30T14:55:11.749360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99e7b681-1fa20075-cd35b751-7fd64556_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:11.749371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99e7b681-1fa20075-cd35b751-7fd64556_0] Write session will restart in 0.008164s
2025-09-30T14:55:11.749408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99e7b681-1fa20075-cd35b751-7fd64556_0] Write session: Do CDS request
2025-09-30T14:55:11.749419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99e7b681-1fa20075-cd35b751-7fd64556_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:11.758786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99e7b681-1fa20075-cd35b751-7fd64556_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:11.758960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:11.758981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1785
2025-09-30T14:55:11.759102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1785 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:11.759138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1785 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:11.759149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1785 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:11.759153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:11.759642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1785 sessionId:  describe result for acl check
2025-09-30T14:55:11.759683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:11.759690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:11.759692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:11.759697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895924442727570:7269] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:11.760310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895924442727570:7269] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:11.760969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:11.762624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895924442727570:7269] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:11.762950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:11.763142Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:11.763152Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:11.763162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:11.763212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:11.763299Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895924352959468:5759]
2025-09-30T14:55:11.763943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:11.764297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:11.764345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:11.764696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:11.764775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:11.764781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:11.764783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:11.764784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:11.764785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:11.764786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:11.764787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:11.764789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:11.764790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:11.764791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:11.764793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.764794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.764795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.764796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:11.764797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:11.764803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:11.764813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:11.764818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:11.764822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:11.764826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:11.764830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:11.764834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:11.764838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:11.764841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:11.764845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:11.764849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.764853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.764858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.764862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:11.764865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:11.764873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:11.764881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:11.764887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:11.764893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:11.764898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:11.764903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:11.764908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:11.764913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:11.764918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:11.764924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:11.764929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:11.764933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:11.764938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:11.764944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:11.764948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:11.764954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:11.764959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:11.764965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:11.764969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:11.764979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:11.764986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.764991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.764995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.765001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.765006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.765017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.765022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:11.765027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:11.765038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:11.765043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:11.765089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:11.765540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895924442727570:7269] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:11.765554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895924442727570:7269] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:11.765557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895924442727570:7269] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:11.765574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1785 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:11.770931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:11.771896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:11.771919Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:11.771922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:11.771926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:11.771934Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1784 [2:7555895924352959468:5759]
2025-09-30T14:55:11.771951Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:11.771969Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:11.771973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:11.771976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:11.771979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:11.771998Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:11.772013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:11.772026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:11.772100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.772110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.772113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.772117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:11.772120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:11.772206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:11.772215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.772228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.772243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.772266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:11.772291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895924442727612:7269], now have 1 active actors on pipe
2025-09-30T14:55:11.772300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895924442727491:2454], now have 1 active actors on pipe
2025-09-30T14:55:11.772307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895924352959463:5759]
2025-09-30T14:55:11.772314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895924352959463:5759]
2025-09-30T14:55:11.772317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895924352959463:5759]
2025-09-30T14:55:11.772333Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:11.772352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:11.772362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:11.772366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:11.772369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:11.772374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:11.772377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:11.772352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1784
2025-09-30T14:55:11.772389Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1784
2025-09-30T14:55:11.772414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895924352959463:5759]
2025-09-30T14:55:11.772427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:11.772432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:11.772449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:11.772458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:11.772565Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6ce3e6e-2e509a7b-70dc18a3-85752d22_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:11.772579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:11.772583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:11.772588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:11.772598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:11.772614Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:11.772643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:11.772829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:11.772844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:11.772866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:11.772999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1785 partition: 0 MaxSeqNo: 42 sessionId: src_id|e6ce3e6e-2e509a7b-70dc18a3-85752d22_0
2025-09-30T14:55:11.773459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99e7b681-1fa20075-cd35b751-7fd64556_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e6ce3e6e-2e509a7b-70dc18a3-85752d22_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:11.776594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6ce3e6e-2e509a7b-70dc18a3-85752d22_0] Write session: try to update token
2025-09-30T14:55:11.776616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6ce3e6e-2e509a7b-70dc18a3-85752d22_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:11.785719Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:11.785739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:11.785742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:11.785745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:11.785754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895924352959463:5759]
2025-09-30T14:55:11.785759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895924352959463:5759]
2025-09-30T14:55:11.785764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895924352959463:5759]
2025-09-30T14:55:11.785811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:11.785820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.785822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:11.785829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:11.785835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:11.785839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:11.786071Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:11.793075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1785 sessionId: src_id|e6ce3e6e-2e509a7b-70dc18a3-85752d22_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:11.796483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:11.848659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895924442727620:7977]
2025-09-30T14:55:11.848950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1784, pipe: [1:7555895924442727620:7977]
2025-09-30T14:55:11.902997Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:11.903476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:11.903493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:11.903514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895924442727620:7977], now have 1 active actors on pipe
2025-09-30T14:55:11.907523Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:11.907502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895924442727620:7977]
2025-09-30T14:55:11.907543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:11.907547Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:11.907552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:11.907634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1785 reason: error at write: Disconnected sessionId: src_id|e6ce3e6e-2e509a7b-70dc18a3-85752d22_0
2025-09-30T14:55:11.907967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6ce3e6e-2e509a7b-70dc18a3-85752d22_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:11.907978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6ce3e6e-2e509a7b-70dc18a3-85752d22_0] Write session will restart in 0.005285s
2025-09-30T14:55:11.908001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6ce3e6e-2e509a7b-70dc18a3-85752d22_0] Write session: Do CDS request
2025-09-30T14:55:11.908006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6ce3e6e-2e509a7b-70dc18a3-85752d22_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:11.907813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1785 sessionId: src_id|e6ce3e6e-2e509a7b-70dc18a3-85752d22_0 is DEAD
2025-09-30T14:55:11.914861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6ce3e6e-2e509a7b-70dc18a3-85752d22_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:11.914911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:11.914930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1786
2025-09-30T14:55:11.915097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1786 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:11.915158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1786 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:11.915168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1786 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:11.915172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:11.915719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1786 sessionId:  describe result for acl check
2025-09-30T14:55:11.915755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:11.915757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:11.915759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:11.915765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895924442727628:7266] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:11.916345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895924442727628:7266] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:11.918729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895924442727628:7266] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:11.922494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895924442727628:7266] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:11.922520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895924442727628:7266] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:11.922524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895924442727628:7266] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:11.922532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1786 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:11.926533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:11.928810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:11.929069Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:11.929079Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:11.929091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:11.929148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:11.929196Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895924352959592:5749]
2025-09-30T14:55:11.929910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:11.930255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:11.930301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:11.930636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:11.930705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:11.930712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:11.930713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:11.930714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:11.930715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:11.930717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:11.930718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:11.930720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:11.930721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:11.930722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:11.930724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.930725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.930726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.930727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:11.930729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:11.930735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:11.930746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:11.930751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:11.930755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:11.930759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:11.930763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:11.930768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:11.930771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:11.930776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:11.930782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:11.930786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.930790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.930793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.930798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:11.930802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:11.930811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:11.930820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:11.930826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:11.930833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:11.930838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:11.930843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:11.930848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:11.930853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:11.930860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:11.930866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:11.930871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:11.930876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:11.930881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:11.930886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:11.930890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:11.930896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:11.930902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:11.930907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:11.930912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:11.930917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:11.930931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.930942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.930950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.930955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.930961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.930971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.930975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:11.930980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:11.930985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:11.930990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:11.931037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:11.936742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:11.937625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:11.937639Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:11.937656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:11.937661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:11.937669Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1785 [2:7555895924352959592:5749]
2025-09-30T14:55:11.937686Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:11.937704Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:11.937708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:11.937711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:11.937714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:11.937732Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:11.937740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:11.937752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:11.937804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.937810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.937812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.937815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:11.937817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:11.937888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:11.937897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.937907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:11.937918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:11.937931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:11.937955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895924442727693:7266], now have 1 active actors on pipe
2025-09-30T14:55:11.937968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895924352959587:5749]
2025-09-30T14:55:11.937971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895924352959587:5749]
2025-09-30T14:55:11.937973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895924352959587:5749]
2025-09-30T14:55:11.937986Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:11.938000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895924442727621:2454], now have 1 active actors on pipe
2025-09-30T14:55:11.938010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:11.938016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:11.938020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:11.938022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:11.938022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:11.938025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:11.938067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1785
2025-09-30T14:55:11.938075Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1785
2025-09-30T14:55:11.938062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895924352959587:5749]
2025-09-30T14:55:11.938079Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:11.938107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:11.938141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:11.938146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:11.938171Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81d39ca0-b9273784-422de8b0-e976b2ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:11.938179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:11.938183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:11.938185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:11.938195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:11.938207Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:11.938222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:11.938386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:11.938392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:11.938405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:11.938535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1786 partition: 0 MaxSeqNo: 42 sessionId: src_id|81d39ca0-b9273784-422de8b0-e976b2ff_0
2025-09-30T14:55:11.938931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6ce3e6e-2e509a7b-70dc18a3-85752d22_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|81d39ca0-b9273784-422de8b0-e976b2ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:11.941952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81d39ca0-b9273784-422de8b0-e976b2ff_0] Write session: try to update token
2025-09-30T14:55:11.941972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81d39ca0-b9273784-422de8b0-e976b2ff_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:11.957496Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:11.957519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:11.957528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895924352959587:5749]
2025-09-30T14:55:11.957573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:11.957596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:11.957768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:11.957916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:11.958054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:11.958206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:11.958396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:11.958443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:11.958691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1786 sessionId: src_id|81d39ca0-b9273784-422de8b0-e976b2ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:11.961415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:11.961613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:11.961632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:11.961674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:11.961884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:11.963104Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:11.963118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:11.963121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:11.963123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:11.963131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895924352959587:5749]
2025-09-30T14:55:11.963135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895924352959587:5749]
2025-09-30T14:55:11.963140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895924352959587:5749]
2025-09-30T14:55:11.963174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:11.963174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:11.963182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:11.963186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:11.963187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:11.963189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:11.963348Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:12.011321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895928737695047:7977]
2025-09-30T14:55:12.011655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1785, pipe: [1:7555895928737695047:7977]
2025-09-30T14:55:12.080090Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:12.089135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:12.089178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:12.089379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:12.089459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:12.089535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:12.089614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:12.090172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:12.090187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:12.090267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:12.090334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:12.090412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:12.090494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:12.090543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:12.090552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:12.090626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:12.090701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:12.090773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:12.090843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:12.090888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:12.090899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:12.090975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:12.091052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:12.091127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:12.091202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:12.091276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:12.091288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:12.091372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:12.091446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:12.091516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:12.091583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:12.091760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:12.091770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:12.091845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:12.091919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:12.091990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:12.092058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:12.092103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:12.092106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:12.092179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:12.092240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:12.092314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:12.092381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:12.092424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:12.092427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:12.092502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:12.092563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:12.092623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:12.092687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:12.092733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:12.092735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:12.092811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:12.092867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:12.092927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:12.092994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:12.093039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:12.093043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:12.093120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:12.093186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:12.093254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:12.093324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:12.093370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:12.093374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:12.093451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895928737695047:7977], now have 1 active actors on pipe
2025-09-30T14:55:12.094014Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:12.094008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:12.094037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:12.094039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895928737695047:7977]
2025-09-30T14:55:12.094062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:12.094066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1786 reason: error at write: Disconnected sessionId: src_id|81d39ca0-b9273784-422de8b0-e976b2ff_0
2025-09-30T14:55:12.094296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1786 sessionId: src_id|81d39ca0-b9273784-422de8b0-e976b2ff_0 is DEAD
2025-09-30T14:55:12.099588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81d39ca0-b9273784-422de8b0-e976b2ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:12.099604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81d39ca0-b9273784-422de8b0-e976b2ff_0] Write session will restart in 0.006733s
2025-09-30T14:55:12.099634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81d39ca0-b9273784-422de8b0-e976b2ff_0] Write session: Do CDS request
2025-09-30T14:55:12.099641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81d39ca0-b9273784-422de8b0-e976b2ff_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:12.107496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:12.109964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:12.110228Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:12.110241Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:12.110265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:12.110345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:12.110392Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895928647927009:5747]
2025-09-30T14:55:12.111118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:12.111586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:12.111654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:12.112055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:12.112132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:12.112138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:12.112140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:12.112142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:12.112143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:12.112145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:12.112146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:12.112147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:12.112149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:12.112150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:12.112151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.112152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.112154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.112155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:12.112156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:12.112164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:12.112177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:12.112182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:12.112185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:12.112189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:12.112193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:12.112197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:12.112201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:12.112205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:12.112212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:12.112216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.112220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.112224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.112228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:12.112232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:12.112242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:12.112250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:12.112257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:12.112264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:12.112271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:12.112276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:12.112280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:12.112285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:12.112291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:12.112297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:12.112302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:12.112308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:12.112314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:12.112319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:12.112325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:12.112330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:12.112335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:12.112340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:12.112345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:12.112350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:12.112355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.112361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.112366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.112372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.112381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.112386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.112391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:12.112402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:12.112409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:12.112420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:12.112466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:12.112552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81d39ca0-b9273784-422de8b0-e976b2ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:12.113133Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:12.113152Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1787
2025-09-30T14:55:12.113403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1787 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:12.113442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1787 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:12.113456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1787 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:12.113466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:12.113945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1787 sessionId:  describe result for acl check
2025-09-30T14:55:12.113983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:12.113990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:12.113992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:12.113998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895928737695138:7262] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:12.115052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895928737695138:7262] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:12.118109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895928737695138:7262] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:12.119209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:12.120368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:12.120385Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:12.120389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:12.120393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:12.120399Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1786 [2:7555895928647927009:5747]
2025-09-30T14:55:12.120417Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:12.120430Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:12.120434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:12.120437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:12.120440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:12.120458Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:12.120471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:12.120477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:12.120539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.120547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.120549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.120552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:12.120555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:12.120623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:12.120630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.120643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.120661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.120679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:12.120700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895928647927004:5747]
2025-09-30T14:55:12.120706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895928647927004:5747]
2025-09-30T14:55:12.120708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895928647927004:5747]
2025-09-30T14:55:12.120718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:12.120734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:12.120746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:12.120754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:12.120757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:12.120758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:12.120761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:12.120789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895928647927004:5747]
2025-09-30T14:55:12.120796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:12.120799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:12.120816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895928737695049:2454], now have 1 active actors on pipe
2025-09-30T14:55:12.120888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1786
2025-09-30T14:55:12.121497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895928737695138:7262] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:12.121510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895928737695138:7262] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:12.121517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895928737695138:7262] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:12.121524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1787 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:12.121839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895928737695178:7262], now have 1 active actors on pipe
2025-09-30T14:55:12.121929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1786
2025-09-30T14:55:12.122047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:12.122064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:12.122092Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b3d8024-ce869979-2ec3def8-fd85b75e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:12.122116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:12.122124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:12.122126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:12.122137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:12.122156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:12.122173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:12.122357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:12.122365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:12.122378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:12.122484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1787 partition: 0 MaxSeqNo: 42 sessionId: src_id|1b3d8024-ce869979-2ec3def8-fd85b75e_0
2025-09-30T14:55:12.122882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81d39ca0-b9273784-422de8b0-e976b2ff_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1b3d8024-ce869979-2ec3def8-fd85b75e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:12.125840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b3d8024-ce869979-2ec3def8-fd85b75e_0] Write session: try to update token
2025-09-30T14:55:12.125858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b3d8024-ce869979-2ec3def8-fd85b75e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:12.134420Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:12.134443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:12.134446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:12.134447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:12.134457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895928647927004:5747]
2025-09-30T14:55:12.134462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895928647927004:5747]
2025-09-30T14:55:12.134467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895928647927004:5747]
2025-09-30T14:55:12.134511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:12.134525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.134531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:12.134556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:12.134573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:12.134582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:12.134690Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:12.145205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1787 sessionId: src_id|1b3d8024-ce869979-2ec3def8-fd85b75e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:12.148124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:12.194866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895928737695201:7977]
2025-09-30T14:55:12.197211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1786, pipe: [1:7555895928737695201:7977]
2025-09-30T14:55:12.253056Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:12.253368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:12.253380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:12.253397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895928737695201:7977], now have 1 active actors on pipe
2025-09-30T14:55:12.253578Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:12.253719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895928737695201:7977]
2025-09-30T14:55:12.253755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:12.253802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:12.253889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1787 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1b3d8024-ce869979-2ec3def8-fd85b75e_0
2025-09-30T14:55:12.254080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1787 sessionId: src_id|1b3d8024-ce869979-2ec3def8-fd85b75e_0 is DEAD
2025-09-30T14:55:12.254317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b3d8024-ce869979-2ec3def8-fd85b75e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:12.254335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b3d8024-ce869979-2ec3def8-fd85b75e_0] Write session will restart in 0.008320s
2025-09-30T14:55:12.254366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b3d8024-ce869979-2ec3def8-fd85b75e_0] Write session: Do CDS request
2025-09-30T14:55:12.254373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b3d8024-ce869979-2ec3def8-fd85b75e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:12.263956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b3d8024-ce869979-2ec3def8-fd85b75e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:12.264146Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:12.264166Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1788
2025-09-30T14:55:12.264358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1788 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:12.264407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1788 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:12.264419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1788 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:12.264423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:12.264885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1788 sessionId:  describe result for acl check
2025-09-30T14:55:12.264924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:12.264936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:12.264938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:12.264944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895928737695294:7242] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:12.265487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895928737695294:7242] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:12.265878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:12.268213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:12.268439Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:12.268450Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:12.268461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:12.268512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:12.268550Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895928647927168:5720]
2025-09-30T14:55:12.269223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:12.269415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895928737695294:7242] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:12.269559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:12.269617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:12.269982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:12.270040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:12.270041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:12.270042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:12.270043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:12.270044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:12.270045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:12.270047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:12.270048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:12.270049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:12.270050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:12.270051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.270053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.270054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.270056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:12.270057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:12.270062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:12.270072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:12.270076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:12.270079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:12.270083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:12.270087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:12.270090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:12.270094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:12.270097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:12.270101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:12.270105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.270108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.270111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.270115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:12.270119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:12.270125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:12.270133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:12.270139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:12.270145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:12.270150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:12.270155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:12.270159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:12.270163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:12.270168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:12.270172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:12.270177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:12.270182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:12.270187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:12.270192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:12.270197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:12.270212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:12.270217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:12.270221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:12.270226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:12.270230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:12.270235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.270240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.270244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.270249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.270254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.270259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.270266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:12.270271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:12.270275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:12.270279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:12.270320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:12.276072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:12.276203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895928737695294:7242] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:12.276225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895928737695294:7242] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:12.276229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895928737695294:7242] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:12.276239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1788 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:12.277577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:12.277603Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:12.277606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:12.277611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:12.277619Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1787 [2:7555895928647927168:5720]
2025-09-30T14:55:12.277639Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:12.277674Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:12.277678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:12.277682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:12.277684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:12.277704Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:12.277712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:12.277720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:12.277799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.277818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.277822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.277826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:12.277829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:12.277918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:12.277930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.277944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.277955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.277972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:12.277992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895928737695334:7242], now have 1 active actors on pipe
2025-09-30T14:55:12.277996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895928737695211:2454], now have 1 active actors on pipe
2025-09-30T14:55:12.278003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895928647927163:5720]
2025-09-30T14:55:12.278006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895928647927163:5720]
2025-09-30T14:55:12.278009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895928647927163:5720]
2025-09-30T14:55:12.278024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:12.278044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:12.278049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:12.278053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:12.278056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:12.278063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:12.278066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:12.278084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1787
2025-09-30T14:55:12.278103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895928647927163:5720]
2025-09-30T14:55:12.278112Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:12.278114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:12.278125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1787
2025-09-30T14:55:12.278141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:12.278151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:12.278183Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ffdd0001-a59c2c37-93a9865c-e4efa5c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:12.278199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:12.278204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:12.278206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:12.278216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:12.278227Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:12.278251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:12.278412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:12.278421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:12.278439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:12.278543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1788 partition: 0 MaxSeqNo: 42 sessionId: src_id|ffdd0001-a59c2c37-93a9865c-e4efa5c5_0
2025-09-30T14:55:12.278912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b3d8024-ce869979-2ec3def8-fd85b75e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ffdd0001-a59c2c37-93a9865c-e4efa5c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:12.281862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffdd0001-a59c2c37-93a9865c-e4efa5c5_0] Write session: try to update token
2025-09-30T14:55:12.281884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffdd0001-a59c2c37-93a9865c-e4efa5c5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:12.292091Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:12.292117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:12.292120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:12.292122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:12.292133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895928647927163:5720]
2025-09-30T14:55:12.292138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895928647927163:5720]
2025-09-30T14:55:12.292143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895928647927163:5720]
2025-09-30T14:55:12.292186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:12.292193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.292196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:12.292210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:12.292216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:12.292220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:12.292345Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:12.298708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1788 sessionId: src_id|ffdd0001-a59c2c37-93a9865c-e4efa5c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:12.301674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:12.354005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895928737695343:7977]
2025-09-30T14:55:12.354308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1787, pipe: [1:7555895928737695343:7977]
2025-09-30T14:55:12.408643Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:12.409062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:12.409079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:12.409119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895928737695343:7977], now have 1 active actors on pipe
2025-09-30T14:55:12.409309Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:12.409766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffdd0001-a59c2c37-93a9865c-e4efa5c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:12.409778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffdd0001-a59c2c37-93a9865c-e4efa5c5_0] Write session will restart in 0.008429s
2025-09-30T14:55:12.409802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffdd0001-a59c2c37-93a9865c-e4efa5c5_0] Write session: Do CDS request
2025-09-30T14:55:12.409808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffdd0001-a59c2c37-93a9865c-e4efa5c5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:12.409339Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:12.409342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:12.409346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:12.409400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895928737695343:7977]
2025-09-30T14:55:12.409414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1788 reason: error at write: Disconnected sessionId: src_id|ffdd0001-a59c2c37-93a9865c-e4efa5c5_0
2025-09-30T14:55:12.409585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1788 sessionId: src_id|ffdd0001-a59c2c37-93a9865c-e4efa5c5_0 is DEAD
2025-09-30T14:55:12.419869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffdd0001-a59c2c37-93a9865c-e4efa5c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:12.419983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:12.420004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1789
2025-09-30T14:55:12.420158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1789 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:12.420195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1789 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:12.420201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1789 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:12.420206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:12.420614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1789 sessionId:  describe result for acl check
2025-09-30T14:55:12.420654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:12.420661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:12.420663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:12.420670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895928737695418:7236] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:12.421277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895928737695418:7236] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:12.423687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895928737695418:7236] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:12.424601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:12.426452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895928737695418:7236] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:12.426471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895928737695418:7236] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:12.426475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895928737695418:7236] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:12.426485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1789 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:12.426459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:12.426770Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:12.426777Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:12.426791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:12.426856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:12.426898Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895928647927295:5715]
2025-09-30T14:55:12.427653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:12.428000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:12.428088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:12.428480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:12.428553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:12.428560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:12.428561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:12.428562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:12.428564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:12.428565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:12.428566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:12.428568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:12.428569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:12.428571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:12.428572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.428574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.428575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.428576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:12.428577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:12.428584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:12.428595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:12.428600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:12.428605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:12.428609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:12.428614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:12.428619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:12.428623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:12.428628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:12.428633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:12.428637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.428642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.428645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.428649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:12.428653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:12.428661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:12.428669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:12.428676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:12.428682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:12.428695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:12.428706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:12.428711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:12.428717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:12.428729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:12.428735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:12.428743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:12.428749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:12.428760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:12.428765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:12.428769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:12.428775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:12.428785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:12.428790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:12.428799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:12.428804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:12.428809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.428819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.428823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.428834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.428839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.428845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.428854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:12.428858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:12.428863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:12.428873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:12.428938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:12.434899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:12.436152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:12.436171Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:12.436174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:12.436178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:12.436185Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1788 [2:7555895928647927295:5715]
2025-09-30T14:55:12.436206Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:12.436225Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:12.436229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:12.436233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:12.436235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:12.436258Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:12.436266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:12.436273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:12.436450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.436463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.436465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.436468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:12.436471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:12.436550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:12.436553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.436567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.436579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.436598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:12.436618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895928737695465:7236], now have 1 active actors on pipe
2025-09-30T14:55:12.436622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895928737695344:2454], now have 1 active actors on pipe
2025-09-30T14:55:12.436628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895928647927289:5715]
2025-09-30T14:55:12.436631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895928647927289:5715]
2025-09-30T14:55:12.436792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1788
2025-09-30T14:55:12.436836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1788
2025-09-30T14:55:12.436632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895928647927289:5715]
2025-09-30T14:55:12.436645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:12.436659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:12.436662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:12.436666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:12.436668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:12.436673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:12.436677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:12.436714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895928647927289:5715]
2025-09-30T14:55:12.436722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:12.436729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:12.436899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:12.436905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:12.436935Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24fa8d56-f8c1fe26-dd6b8047-42872797_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:12.436951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:12.436956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:12.436965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:12.436975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:12.436986Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:12.437003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:12.437222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:12.437231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:12.437246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:12.437411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1789 partition: 0 MaxSeqNo: 42 sessionId: src_id|24fa8d56-f8c1fe26-dd6b8047-42872797_0
2025-09-30T14:55:12.437913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffdd0001-a59c2c37-93a9865c-e4efa5c5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|24fa8d56-f8c1fe26-dd6b8047-42872797_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:12.441089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24fa8d56-f8c1fe26-dd6b8047-42872797_0] Write session: try to update token
2025-09-30T14:55:12.441113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24fa8d56-f8c1fe26-dd6b8047-42872797_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:12.451079Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:12.451107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:12.451118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895928647927289:5715]
2025-09-30T14:55:12.451172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:12.451175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:12.451409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:12.451572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:12.451738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:12.451895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:12.452125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:12.452165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:12.457364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1789 sessionId: src_id|24fa8d56-f8c1fe26-dd6b8047-42872797_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:12.460728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:12.461153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:12.461183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:12.461238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:12.461359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:12.462866Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:12.462889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:12.462892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:12.462895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:12.462911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895928647927289:5715]
2025-09-30T14:55:12.462916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895928647927289:5715]
2025-09-30T14:55:12.462919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895928647927289:5715]
2025-09-30T14:55:12.462963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:12.462972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:12.462976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.462979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:12.462979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:12.462984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:12.463129Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:12.509679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895928737695477:7977]
2025-09-30T14:55:12.510186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1788, pipe: [1:7555895928737695477:7977]
2025-09-30T14:55:12.582338Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:12.591657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:12.591693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:12.591884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:12.591955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:12.592027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:12.592107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:12.592317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:12.592331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:12.592407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:12.592494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:12.592569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:12.592640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:12.592687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:12.592696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:12.592767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:12.592839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:12.592913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:12.592990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:12.593035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:12.593046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:12.593124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:12.593196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:12.593266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:12.593340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:12.593389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:12.593397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:12.593468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:12.593546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:12.593620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:12.593708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:12.593756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:12.593759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:12.593831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:12.593902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:12.593964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:12.594035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:12.594078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:12.594081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:12.594159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:12.594221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:12.594294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:12.594372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:12.594429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:12.594432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:12.594519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:12.594591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:12.594664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:12.594731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:12.594775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:12.594778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:12.594862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:12.594930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:12.595004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:12.595071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:12.595117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:12.595120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:12.595204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:12.596105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895928737695477:7977]
2025-09-30T14:55:12.596141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:12.596156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:12.596159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:12.596193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1789 reason: error at write: Disconnected sessionId: src_id|24fa8d56-f8c1fe26-dd6b8047-42872797_0
2025-09-30T14:55:12.596401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1789 sessionId: src_id|24fa8d56-f8c1fe26-dd6b8047-42872797_0 is DEAD
2025-09-30T14:55:12.596565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24fa8d56-f8c1fe26-dd6b8047-42872797_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:12.596582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24fa8d56-f8c1fe26-dd6b8047-42872797_0] Write session will restart in 0.009956s
2025-09-30T14:55:12.596622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24fa8d56-f8c1fe26-dd6b8047-42872797_0] Write session: Do CDS request
2025-09-30T14:55:12.596629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24fa8d56-f8c1fe26-dd6b8047-42872797_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:12.595449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:12.595539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:12.595615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:12.595671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:12.595675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:12.595767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895928737695477:7977], now have 1 active actors on pipe
2025-09-30T14:55:12.597030Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:12.607933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24fa8d56-f8c1fe26-dd6b8047-42872797_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:12.607977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:12.608002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1790
2025-09-30T14:55:12.608201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1790 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:12.608243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1790 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:12.608255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1790 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:12.608261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:12.608855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1790 sessionId:  describe result for acl check
2025-09-30T14:55:12.608897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:12.608905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:12.608907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:12.608914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895928737695565:7229] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:12.609699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895928737695565:7229] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:12.611388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:12.614833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:12.615085Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:12.615090Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:12.615101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:12.615158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:12.615199Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895928647927431:5699]
2025-09-30T14:55:12.615768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:12.616130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:12.616174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:12.616274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895928737695565:7229] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:12.616514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:12.616591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:12.616597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:12.616599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:12.616600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:12.616602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:12.616603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:12.616604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:12.616605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:12.616607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:12.616608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:12.616610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.616611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.616612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.616614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:12.616615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:12.616621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:12.616632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:12.616637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:12.616641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:12.616645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:12.616650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:12.616654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:12.616659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:12.616663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:12.616667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:12.616672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.616676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.616680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.616684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:12.616689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:12.616695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:12.616703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:12.616710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:12.616716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:12.616722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:12.616728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:12.616733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:12.616740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:12.616745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:12.616749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:12.616755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:12.616761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:12.616767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:12.616773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:12.616778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:12.616784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:12.616789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:12.616795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:12.616801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:12.616813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:12.616818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.616824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.616829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.616834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.616839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.616845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.616849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:12.616855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:12.616860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:12.616865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:12.616908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:12.623293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895928737695565:7229] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:12.623330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895928737695565:7229] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:12.623335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895928737695565:7229] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:12.623345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1790 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:12.625942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1789
2025-09-30T14:55:12.625965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1789
2025-09-30T14:55:12.624114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:12.625233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:12.625241Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:12.625245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:12.625252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:12.625262Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1789 [2:7555895928647927431:5699]
2025-09-30T14:55:12.625283Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:12.625305Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:12.625309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:12.625314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:12.625317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:12.625340Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:12.625348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:12.625357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:12.625439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.625442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.625445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.625450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:12.625454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:12.625546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:12.625550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.625567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.625581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.625602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:12.625624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895928647927426:5699]
2025-09-30T14:55:12.625626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895928647927426:5699]
2025-09-30T14:55:12.625629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895928647927426:5699]
2025-09-30T14:55:12.625658Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:12.625680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:12.625682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:12.625689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:12.625691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:12.625699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:12.625704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:12.625718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895928737695607:7229], now have 1 active actors on pipe
2025-09-30T14:55:12.625725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895928737695479:2454], now have 1 active actors on pipe
2025-09-30T14:55:12.625771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895928647927426:5699]
2025-09-30T14:55:12.625784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:12.625799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:12.626036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:12.626045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:12.626083Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ad220b0-4bd52cc8-6a3f60a9-209e881_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:12.626094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:12.626100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:12.626103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:12.626122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:12.626137Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:12.626159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:12.626494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:12.626510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:12.626529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:12.626685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1790 partition: 0 MaxSeqNo: 42 sessionId: src_id|3ad220b0-4bd52cc8-6a3f60a9-209e881_0
2025-09-30T14:55:12.627167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24fa8d56-f8c1fe26-dd6b8047-42872797_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3ad220b0-4bd52cc8-6a3f60a9-209e881_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:12.630089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ad220b0-4bd52cc8-6a3f60a9-209e881_0] Write session: try to update token
2025-09-30T14:55:12.630114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ad220b0-4bd52cc8-6a3f60a9-209e881_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:12.638854Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:12.638885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:12.638888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:12.638891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:12.638904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895928647927426:5699]
2025-09-30T14:55:12.638911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895928647927426:5699]
2025-09-30T14:55:12.638916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895928647927426:5699]
2025-09-30T14:55:12.638972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:12.638986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.638977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:12.638994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:12.639000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:12.639006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:12.639167Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:12.649680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1790 sessionId: src_id|3ad220b0-4bd52cc8-6a3f60a9-209e881_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:12.652766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:12.696550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895928737695627:7977]
2025-09-30T14:55:12.696992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1789, pipe: [1:7555895928737695627:7977]
2025-09-30T14:55:12.761228Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:12.761703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:12.761722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:12.761742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895928737695627:7977], now have 1 active actors on pipe
2025-09-30T14:55:12.761979Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:12.762106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895928737695627:7977]
2025-09-30T14:55:12.762151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:12.762393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:12.762407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:12.762495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1790 reason: error at write: Disconnected sessionId: src_id|3ad220b0-4bd52cc8-6a3f60a9-209e881_0
2025-09-30T14:55:12.762729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1790 sessionId: src_id|3ad220b0-4bd52cc8-6a3f60a9-209e881_0 is DEAD
2025-09-30T14:55:12.762947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ad220b0-4bd52cc8-6a3f60a9-209e881_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:12.762974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ad220b0-4bd52cc8-6a3f60a9-209e881_0] Write session will restart in 0.008760s
2025-09-30T14:55:12.763004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ad220b0-4bd52cc8-6a3f60a9-209e881_0] Write session: Do CDS request
2025-09-30T14:55:12.763014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ad220b0-4bd52cc8-6a3f60a9-209e881_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:12.772880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ad220b0-4bd52cc8-6a3f60a9-209e881_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:12.772962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:12.772983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1791
2025-09-30T14:55:12.773142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1791 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:12.773191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1791 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:12.773205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1791 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:12.773210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:12.773770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1791 sessionId:  describe result for acl check
2025-09-30T14:55:12.773819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:12.773826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:12.773828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:12.773836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895928737695715:7223] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:12.774061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:12.774516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895928737695715:7223] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:12.776138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:12.776349Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:12.776358Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:12.776368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:12.776411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:12.776445Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895928647927557:5703]
2025-09-30T14:55:12.776966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:12.776939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895928737695715:7223] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:12.777293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:12.777369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:12.777709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:12.777783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:12.777791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:12.777793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:12.777794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:12.777795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:12.777796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:12.777797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:12.777798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:12.777799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:12.777801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:12.777802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.777803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.777804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.777805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:12.777806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:12.777812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:12.777822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:12.777826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:12.777830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:12.777833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:12.777837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:12.777841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:12.777845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:12.777848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:12.777853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:12.777857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.777861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.777865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.777869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:12.777873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:12.777880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:12.777889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:12.777895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:12.777901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:12.777906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:12.777912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:12.777917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:12.777923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:12.777928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:12.777933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:12.777937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:12.777942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:12.777948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:12.777953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:12.777958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:12.777964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:12.777969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:12.777973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:12.777978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:12.777984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:12.777989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.777994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.777998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.778004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.778009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.778014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.778020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:12.778025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:12.778029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:12.778040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:12.778090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:12.783462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895928737695715:7223] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:12.783488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895928737695715:7223] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:12.783492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895928737695715:7223] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:12.783504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1791 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:12.783667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:12.784707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:12.784726Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:12.784729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:12.784733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:12.784742Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1790 [2:7555895928647927557:5703]
2025-09-30T14:55:12.784758Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:12.784771Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:12.784773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:12.784776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:12.784778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:12.784792Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:12.784801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:12.784807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:12.784857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.784863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.784864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.784867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:12.784869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:12.784934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:12.784942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.784957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.784972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.784986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:12.785005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895928737695755:7223], now have 1 active actors on pipe
2025-09-30T14:55:12.785012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895928737695628:2454], now have 1 active actors on pipe
2025-09-30T14:55:12.785023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895928647927552:5703]
2025-09-30T14:55:12.785030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895928647927552:5703]
2025-09-30T14:55:12.785032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895928647927552:5703]
2025-09-30T14:55:12.785044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:12.785056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:12.785070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:12.785077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:12.785081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:12.785089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:12.785092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:12.785106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895928647927552:5703]
2025-09-30T14:55:12.785114Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:12.785135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:12.785101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1790
2025-09-30T14:55:12.785106Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1790
2025-09-30T14:55:12.785162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:12.785171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:12.785202Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|135072cd-9d52602e-c67c3403-9d82018a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:12.785211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:12.785214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:12.785216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:12.785224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:12.785231Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:12.785242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:12.785400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:12.785406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:12.785417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:12.785521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1791 partition: 0 MaxSeqNo: 42 sessionId: src_id|135072cd-9d52602e-c67c3403-9d82018a_0
2025-09-30T14:55:12.785981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ad220b0-4bd52cc8-6a3f60a9-209e881_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|135072cd-9d52602e-c67c3403-9d82018a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:12.789280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|135072cd-9d52602e-c67c3403-9d82018a_0] Write session: try to update token
2025-09-30T14:55:12.789304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|135072cd-9d52602e-c67c3403-9d82018a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:12.797924Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:12.797950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:12.797953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:12.797956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:12.797969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895928647927552:5703]
2025-09-30T14:55:12.797973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895928647927552:5703]
2025-09-30T14:55:12.797977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895928647927552:5703]
2025-09-30T14:55:12.798015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:12.798022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.798022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:12.798029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:12.798030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:12.798037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:12.798179Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:12.806667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1791 sessionId: src_id|135072cd-9d52602e-c67c3403-9d82018a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:12.809491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:12.862371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895928737695763:7977]
2025-09-30T14:55:12.862641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1790, pipe: [1:7555895928737695763:7977]
2025-09-30T14:55:12.910702Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:12.910759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895928737695763:7977]
2025-09-30T14:55:12.910762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:12.910765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:12.910831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1791 reason: error at write: Disconnected sessionId: src_id|135072cd-9d52602e-c67c3403-9d82018a_0
2025-09-30T14:55:12.911055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1791 sessionId: src_id|135072cd-9d52602e-c67c3403-9d82018a_0 is DEAD
2025-09-30T14:55:12.910006Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:12.910389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:12.910400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:12.910421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895928737695763:7977], now have 1 active actors on pipe
2025-09-30T14:55:12.910620Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:12.911320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|135072cd-9d52602e-c67c3403-9d82018a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:12.911378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|135072cd-9d52602e-c67c3403-9d82018a_0] Write session will restart in 0.006380s
2025-09-30T14:55:12.911414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|135072cd-9d52602e-c67c3403-9d82018a_0] Write session: Do CDS request
2025-09-30T14:55:12.911422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|135072cd-9d52602e-c67c3403-9d82018a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:12.919844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|135072cd-9d52602e-c67c3403-9d82018a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:12.919957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:12.919979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1792
2025-09-30T14:55:12.920600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1792 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:12.920657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1792 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:12.920662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1792 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:12.920667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:12.921384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1792 sessionId:  describe result for acl check
2025-09-30T14:55:12.921428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:12.921430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:12.921437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:12.921444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895928737695803:7212] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:12.922051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895928737695803:7212] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:12.925540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895928737695803:7212] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:12.926566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:12.928876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:12.929094Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:12.929107Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:12.929118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:12.929176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:12.929218Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895928647927686:5693]
2025-09-30T14:55:12.929280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895928737695803:7212] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:12.929296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895928737695803:7212] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:12.929299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895928737695803:7212] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:12.929309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1792 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:12.929808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:12.930142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:12.930214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:12.930537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:12.930604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:12.930611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:12.930613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:12.930614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:12.930615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:12.930617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:12.930618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:12.930619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:12.930621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:12.930622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:12.930623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.930624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.930625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.930627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:12.930628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:12.930632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:12.930640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:12.930642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:12.930645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:12.930647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:12.930650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:12.930652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:12.930655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:12.930657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:12.930660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:12.930663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.930665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.930667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.930670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:12.930672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:12.930678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:12.930683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:12.930688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:12.930691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:12.930695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:12.930698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:12.930701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:12.930704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:12.930707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:12.930710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:12.930713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:12.930717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:12.930719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:12.930723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:12.930725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:12.930728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:12.930731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:12.930734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:12.930737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:12.930740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:12.930744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.930747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.930750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.930753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.930756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.930760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.930763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:12.930766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:12.930771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:12.930774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:12.930807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:12.936784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:12.937836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:12.937863Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:12.937866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:12.937871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:12.937879Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1791 [2:7555895928647927686:5693]
2025-09-30T14:55:12.937900Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:12.937921Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:12.937925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:12.937928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:12.937931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:12.937950Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:12.937958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:12.937965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:12.938038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.938041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.938043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.938047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:12.938049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:12.938130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:12.938134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.938149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:12.938160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:12.938176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:12.938194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895928647927681:5693]
2025-09-30T14:55:12.938197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895928647927681:5693]
2025-09-30T14:55:12.938200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895928647927681:5693]
2025-09-30T14:55:12.938208Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:12.938223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:12.938238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:12.938241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:12.938276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:12.938281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895928647927681:5693]
2025-09-30T14:55:12.938283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:12.938284Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:12.938286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:12.938297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:12.938497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895928737695888:7212], now have 1 active actors on pipe
2025-09-30T14:55:12.938513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895928737695764:2454], now have 1 active actors on pipe
2025-09-30T14:55:12.938604Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1791
2025-09-30T14:55:12.938605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1791
2025-09-30T14:55:12.938727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:12.938757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:12.938788Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e00f2a43-fdc847a4-f08096a3-c33464e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:12.938803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:12.938815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:12.938818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:12.938841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:12.938858Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:12.938880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:12.939077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:12.939086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:12.939101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:12.939205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1792 partition: 0 MaxSeqNo: 42 sessionId: src_id|e00f2a43-fdc847a4-f08096a3-c33464e9_0
2025-09-30T14:55:12.939745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|135072cd-9d52602e-c67c3403-9d82018a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e00f2a43-fdc847a4-f08096a3-c33464e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:12.943596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e00f2a43-fdc847a4-f08096a3-c33464e9_0] Write session: try to update token
2025-09-30T14:55:12.943636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e00f2a43-fdc847a4-f08096a3-c33464e9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:12.951579Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:12.951605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:12.951608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:12.951610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:12.951619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895928647927681:5693]
2025-09-30T14:55:12.951627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895928647927681:5693]
2025-09-30T14:55:12.951631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895928647927681:5693]
2025-09-30T14:55:12.951677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:12.951684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:12.951688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:12.951847Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:12.952753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:12.952761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:12.952765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:12.965157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1792 sessionId: src_id|e00f2a43-fdc847a4-f08096a3-c33464e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:12.968375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:13.010884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895933032663196:7977]
2025-09-30T14:55:13.011149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1791, pipe: [1:7555895933032663196:7977]
2025-09-30T14:55:13.067359Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:13.067748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:13.067763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:13.067782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895933032663196:7977], now have 1 active actors on pipe
2025-09-30T14:55:13.068035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895933032663196:7977]
2025-09-30T14:55:13.068062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:13.068067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:13.068068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:13.068149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1792 reason: error at write: Disconnected sessionId: src_id|e00f2a43-fdc847a4-f08096a3-c33464e9_0
2025-09-30T14:55:13.068354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1792 sessionId: src_id|e00f2a43-fdc847a4-f08096a3-c33464e9_0 is DEAD
2025-09-30T14:55:13.068005Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:13.068576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e00f2a43-fdc847a4-f08096a3-c33464e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:13.068591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e00f2a43-fdc847a4-f08096a3-c33464e9_0] Write session will restart in 0.005622s
2025-09-30T14:55:13.068623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e00f2a43-fdc847a4-f08096a3-c33464e9_0] Write session: Do CDS request
2025-09-30T14:55:13.068634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e00f2a43-fdc847a4-f08096a3-c33464e9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:13.075984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e00f2a43-fdc847a4-f08096a3-c33464e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:13.076106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:13.076131Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1793
2025-09-30T14:55:13.076314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1793 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:13.076368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1793 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:13.076381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1793 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:13.076386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:13.076976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1793 sessionId:  describe result for acl check
2025-09-30T14:55:13.077026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:13.077034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:13.077036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:13.077043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895933032663245:7204] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:13.077780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895933032663245:7204] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:13.079837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:13.080207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895933032663245:7204] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:13.081738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:13.081966Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:13.081980Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:13.081993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:13.082053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:13.082097Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895932942895110:5689]
2025-09-30T14:55:13.082831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:13.083160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:13.083216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:13.083592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:13.083615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895933032663245:7204] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:13.083633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895933032663245:7204] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:13.083637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895933032663245:7204] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:13.083647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1793 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:13.083667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:13.083674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:13.083675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:13.083676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:13.083677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:13.083679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:13.083680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:13.083681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:13.083682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:13.083683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:13.083684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.083686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.083687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.083688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:13.083689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:13.083696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:13.083706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:13.083711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:13.083716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:13.083720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:13.083724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:13.083728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:13.083732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:13.083736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:13.083742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:13.083746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.083750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.083754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.083758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:13.083761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:13.083771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:13.083780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:13.083786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:13.083798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:13.083807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:13.083818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:13.083827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:13.083838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:13.083848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:13.083854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:13.083864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:13.083883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:13.083893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:13.083901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:13.083910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:13.083920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:13.083931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:13.083941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:13.083950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:13.083956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:13.083965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.083970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.083975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.083984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.083990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.083995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.084004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:13.084011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:13.084017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:13.084027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:13.084076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:13.089743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:13.090634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:13.090649Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:13.090651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:13.090654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:13.090659Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1792 [2:7555895932942895110:5689]
2025-09-30T14:55:13.090671Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:13.090687Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:13.090695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:13.090699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:13.090702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:13.090716Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:13.090720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:13.090730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:13.090775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.090786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.090788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.090790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:13.090792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:13.090862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:13.090869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.090879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.090892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.090914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:13.090939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895933032663327:7204], now have 1 active actors on pipe
2025-09-30T14:55:13.090947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895933032663197:2454], now have 1 active actors on pipe
2025-09-30T14:55:13.090953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895932942895104:5689]
2025-09-30T14:55:13.090955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895932942895104:5689]
2025-09-30T14:55:13.090957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895932942895104:5689]
2025-09-30T14:55:13.090970Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:13.090988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:13.090990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:13.090993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:13.090996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:13.091006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:13.091009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:13.091043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895932942895104:5689]
2025-09-30T14:55:13.091051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:13.091053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:13.091086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:13.091030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1792
2025-09-30T14:55:13.091090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:13.091058Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1792
2025-09-30T14:55:13.091120Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|587ad24d-da8c8f33-17036394-a60032d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:13.091131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:13.091140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:13.091142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:13.091154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:13.091166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:13.091195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:13.091421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:13.091428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:13.091441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:13.091578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1793 partition: 0 MaxSeqNo: 42 sessionId: src_id|587ad24d-da8c8f33-17036394-a60032d3_0
2025-09-30T14:55:13.092034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e00f2a43-fdc847a4-f08096a3-c33464e9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|587ad24d-da8c8f33-17036394-a60032d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:13.095373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|587ad24d-da8c8f33-17036394-a60032d3_0] Write session: try to update token
2025-09-30T14:55:13.095395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|587ad24d-da8c8f33-17036394-a60032d3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:13.103919Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:13.103946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:13.103949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:13.103951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:13.103962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895932942895104:5689]
2025-09-30T14:55:13.103972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895932942895104:5689]
2025-09-30T14:55:13.103978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895932942895104:5689]
2025-09-30T14:55:13.104030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:13.104046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.104051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:13.104058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:13.104080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:13.104103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:13.104227Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:13.113956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1793 sessionId: src_id|587ad24d-da8c8f33-17036394-a60032d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:13.116756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:13.168061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895933032663342:7977]
2025-09-30T14:55:13.168340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1792, pipe: [1:7555895933032663342:7977]
2025-09-30T14:55:13.215235Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:13.215642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:13.215659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:13.215680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895933032663342:7977], now have 1 active actors on pipe
2025-09-30T14:55:13.216008Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:13.216025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:13.216025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895933032663342:7977]
2025-09-30T14:55:13.216053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:13.216056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:13.216121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1793 reason: error at write: Disconnected sessionId: src_id|587ad24d-da8c8f33-17036394-a60032d3_0
2025-09-30T14:55:13.216325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1793 sessionId: src_id|587ad24d-da8c8f33-17036394-a60032d3_0 is DEAD
2025-09-30T14:55:13.216599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|587ad24d-da8c8f33-17036394-a60032d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:13.216616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|587ad24d-da8c8f33-17036394-a60032d3_0] Write session will restart in 0.006889s
2025-09-30T14:55:13.216647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|587ad24d-da8c8f33-17036394-a60032d3_0] Write session: Do CDS request
2025-09-30T14:55:13.216654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|587ad24d-da8c8f33-17036394-a60032d3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:13.224888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|587ad24d-da8c8f33-17036394-a60032d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:13.225028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:13.225047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1794
2025-09-30T14:55:13.225241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1794 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:13.225278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1794 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:13.225291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1794 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:13.225295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:13.225850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1794 sessionId:  describe result for acl check
2025-09-30T14:55:13.225897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:13.225905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:13.225907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:13.225913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895933032663406:7201] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:13.226529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895933032663406:7201] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:13.228227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:13.228374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895933032663406:7201] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:13.230108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:13.230326Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:13.230337Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:13.230348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:13.230415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:13.230455Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895932942895238:5687]
2025-09-30T14:55:13.231122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:13.231452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:13.231509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:13.231858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:13.231927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:13.231934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:13.231936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:13.231937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:13.231939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:13.231940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:13.231941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:13.231943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:13.231944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:13.231945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:13.231947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.231948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.231950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.231951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:13.231952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:13.231957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:13.231967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:13.231971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:13.231976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:13.231980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:13.231985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:13.231989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:13.231993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:13.231997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:13.232002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:13.232006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.232010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.232014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.232018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:13.232022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:13.232030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:13.232038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:13.232043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:13.232049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:13.232059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:13.232065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:13.232069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:13.232075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:13.232081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:13.232086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:13.232091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:13.232096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:13.232102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:13.232107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:13.232119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:13.232124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:13.232129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:13.232135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:13.232139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:13.232145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:13.232149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.232154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.232157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.232163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.232167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.232171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.232175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:13.232180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:13.232184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:13.232189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:13.232228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:13.233019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895933032663406:7201] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:13.233039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895933032663406:7201] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:13.233043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895933032663406:7201] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:13.233051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1794 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:13.238161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:13.239296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:13.239314Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:13.239317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:13.239321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:13.239328Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1793 [2:7555895932942895238:5687]
2025-09-30T14:55:13.239344Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:13.239359Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:13.239363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:13.239368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:13.239371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:13.239389Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:13.239404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:13.239413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:13.239468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.239475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.239477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.239481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:13.239483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:13.239548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:13.239564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.239585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.239597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.239616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:13.239636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895933032663346:2454], now have 1 active actors on pipe
2025-09-30T14:55:13.239645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895933032663476:7201], now have 1 active actors on pipe
2025-09-30T14:55:13.239652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895932942895233:5687]
2025-09-30T14:55:13.239654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895932942895233:5687]
2025-09-30T14:55:13.239657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895932942895233:5687]
2025-09-30T14:55:13.239670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:13.239683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:13.239684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:13.239688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:13.239656Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1793
2025-09-30T14:55:13.239691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:13.239698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:13.239668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1793
2025-09-30T14:55:13.239701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:13.239738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895932942895233:5687]
2025-09-30T14:55:13.239751Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:13.239756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:13.239848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:13.239859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:13.239884Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd8a56c1-1b621e81-16086a8e-28e305f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:13.239896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:13.239899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:13.239901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:13.239911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:13.239926Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:13.239945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:13.240088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:13.240096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:13.240109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:13.240198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1794 partition: 0 MaxSeqNo: 42 sessionId: src_id|fd8a56c1-1b621e81-16086a8e-28e305f2_0
2025-09-30T14:55:13.240599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|587ad24d-da8c8f33-17036394-a60032d3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fd8a56c1-1b621e81-16086a8e-28e305f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:13.244090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd8a56c1-1b621e81-16086a8e-28e305f2_0] Write session: try to update token
2025-09-30T14:55:13.244112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd8a56c1-1b621e81-16086a8e-28e305f2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:13.252042Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:13.252070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:13.252079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895932942895233:5687]
2025-09-30T14:55:13.252117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:13.252125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:13.252310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:13.252481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:13.252639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:13.252795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:13.253033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:13.253085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:13.261132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1794 sessionId: src_id|fd8a56c1-1b621e81-16086a8e-28e305f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:13.263758Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:13.263783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:13.263785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:13.263787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:13.263798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895932942895233:5687]
2025-09-30T14:55:13.263802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895932942895233:5687]
2025-09-30T14:55:13.263806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895932942895233:5687]
2025-09-30T14:55:13.263851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:13.263857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.263861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:13.263862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:13.263873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:13.263877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:13.263932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:13.263996Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:13.316057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895933032663506:7977]
2025-09-30T14:55:13.316430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1793, pipe: [1:7555895933032663506:7977]
2025-09-30T14:55:13.385527Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:13.385947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:13.385966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:13.385988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895933032663506:7977], now have 1 active actors on pipe
2025-09-30T14:55:13.386251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895933032663506:7977]
2025-09-30T14:55:13.386276Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:13.386252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:13.386257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:13.386292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:13.386322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1794 reason: error at write: Disconnected sessionId: src_id|fd8a56c1-1b621e81-16086a8e-28e305f2_0
2025-09-30T14:55:13.386514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1794 sessionId: src_id|fd8a56c1-1b621e81-16086a8e-28e305f2_0 is DEAD
2025-09-30T14:55:13.386666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd8a56c1-1b621e81-16086a8e-28e305f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:13.386676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd8a56c1-1b621e81-16086a8e-28e305f2_0] Write session will restart in 0.008087s
2025-09-30T14:55:13.386700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd8a56c1-1b621e81-16086a8e-28e305f2_0] Write session: Do CDS request
2025-09-30T14:55:13.386718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd8a56c1-1b621e81-16086a8e-28e305f2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:13.395923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd8a56c1-1b621e81-16086a8e-28e305f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:13.396056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:13.396075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1795
2025-09-30T14:55:13.396262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1795 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:13.396297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1795 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:13.396307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1795 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:13.396312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:13.397298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1795 sessionId:  describe result for acl check
2025-09-30T14:55:13.397336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:13.397339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:13.397341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:13.397346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895933032663598:7188] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:13.397755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:13.397882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895933032663598:7188] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:13.399802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895933032663598:7188] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:13.400047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:13.400368Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:13.400383Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:13.400397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:13.400469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:13.400516Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895932942895406:5660]
2025-09-30T14:55:13.401199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:13.401532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:13.401587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:13.401961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:13.402045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:13.402053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:13.402054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:13.402056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:13.402057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:13.402059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:13.402060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:13.402061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:13.402062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:13.402064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:13.402065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.402066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.402067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.402068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:13.402070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:13.402076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:13.402087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:13.402091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:13.402096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:13.402100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:13.402105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:13.402109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:13.402113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:13.402118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:13.402122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:13.402126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.402130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.402135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.402139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:13.402143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:13.402153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:13.402167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:13.402179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:13.402186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:13.402196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:13.402206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:13.402216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:13.402227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:13.402238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:13.402248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:13.402257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:13.402268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:13.402274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:13.402284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:13.402290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:13.402301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:13.402310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:13.402321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:13.402331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:13.402340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:13.402345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.402356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.402363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.402368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.402373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.402379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.402383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:13.402390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:13.402395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:13.402402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:13.402449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:13.402916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895933032663598:7188] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:13.402935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895933032663598:7188] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:13.402939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895933032663598:7188] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:13.402948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1795 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:13.408887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:13.410099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:13.410122Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:13.410126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:13.410130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:13.410137Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1794 [2:7555895932942895406:5660]
2025-09-30T14:55:13.410154Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:13.410170Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:13.410174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:13.410177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:13.410179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:13.410196Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:13.410205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:13.410211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:13.410277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.410289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.410292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.410295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:13.410298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:13.410370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:13.410378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.410392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.410407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.410428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:13.410562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1794
2025-09-30T14:55:13.410564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1794
2025-09-30T14:55:13.410451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895932942895400:5660]
2025-09-30T14:55:13.410462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895932942895400:5660]
2025-09-30T14:55:13.410464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895932942895400:5660]
2025-09-30T14:55:13.410473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:13.410486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:13.410488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:13.410490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:13.410493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:13.410503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:13.410505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:13.410516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895933032663638:7188], now have 1 active actors on pipe
2025-09-30T14:55:13.410519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895933032663507:2454], now have 1 active actors on pipe
2025-09-30T14:55:13.410555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895932942895400:5660]
2025-09-30T14:55:13.410558Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:13.410579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:13.410623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:13.410627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:13.410652Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3da66704-69b72a7c-a0386005-e6c6acde_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:13.410659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:13.410663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:13.410666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:13.410676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:13.410686Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:13.410701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:13.410876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:13.410888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:13.410903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:13.410992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1795 partition: 0 MaxSeqNo: 42 sessionId: src_id|3da66704-69b72a7c-a0386005-e6c6acde_0
2025-09-30T14:55:13.411496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd8a56c1-1b621e81-16086a8e-28e305f2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3da66704-69b72a7c-a0386005-e6c6acde_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:13.414939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3da66704-69b72a7c-a0386005-e6c6acde_0] Write session: try to update token
2025-09-30T14:55:13.414961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3da66704-69b72a7c-a0386005-e6c6acde_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:13.423755Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:13.423775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:13.423778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:13.423780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:13.423791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895932942895400:5660]
2025-09-30T14:55:13.423800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895932942895400:5660]
2025-09-30T14:55:13.423804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895932942895400:5660]
2025-09-30T14:55:13.423851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:13.423857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.423860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:13.423858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:13.423890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:13.423894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:13.424000Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:13.434861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1795 sessionId: src_id|3da66704-69b72a7c-a0386005-e6c6acde_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:13.437848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:13.486558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895933032663647:7977]
2025-09-30T14:55:13.486868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1794, pipe: [1:7555895933032663647:7977]
2025-09-30T14:55:13.543420Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:13.543857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:13.543875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:13.543897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895933032663647:7977], now have 1 active actors on pipe
2025-09-30T14:55:13.544171Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:13.544526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:13.544551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:13.544586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895933032663647:7977]
2025-09-30T14:55:13.544605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:13.544633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1795 reason: error at write: Disconnected sessionId: src_id|3da66704-69b72a7c-a0386005-e6c6acde_0
2025-09-30T14:55:13.544874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1795 sessionId: src_id|3da66704-69b72a7c-a0386005-e6c6acde_0 is DEAD
2025-09-30T14:55:13.545163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3da66704-69b72a7c-a0386005-e6c6acde_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:13.545179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3da66704-69b72a7c-a0386005-e6c6acde_0] Write session will restart in 0.006198s
2025-09-30T14:55:13.545220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3da66704-69b72a7c-a0386005-e6c6acde_0] Write session: Do CDS request
2025-09-30T14:55:13.545227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3da66704-69b72a7c-a0386005-e6c6acde_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:13.553181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3da66704-69b72a7c-a0386005-e6c6acde_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:13.553337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:13.553355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1796
2025-09-30T14:55:13.553548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1796 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:13.553580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1796 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:13.553587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1796 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:13.553592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:13.554131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1796 sessionId:  describe result for acl check
2025-09-30T14:55:13.554174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:13.554181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:13.554183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:13.554190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895933032663674:7180] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:13.554731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895933032663674:7180] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:13.557538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895933032663674:7180] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:13.557998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:13.560327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:13.560548Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:13.560563Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:13.560577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:13.560643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:13.560687Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895932942895537:5655]
2025-09-30T14:55:13.561369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:13.561628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:13.561698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:13.562033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:13.562121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:13.562116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895933032663674:7180] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:13.562131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:13.562137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895933032663674:7180] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:13.562132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:13.562141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895933032663674:7180] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:13.562134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:13.562150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1796 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:13.562135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:13.562136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:13.562137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:13.562139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:13.562140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:13.562141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:13.562142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.562143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.562145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.562146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:13.562147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:13.562154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:13.562164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:13.562168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:13.562171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:13.562175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:13.562179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:13.562183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:13.562186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:13.562190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:13.562195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:13.562200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.562204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.562208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.562211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:13.562215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:13.562225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:13.562234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:13.562241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:13.562247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:13.562252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:13.562258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:13.562262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:13.562267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:13.562272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:13.562276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:13.562280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:13.562286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:13.562294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:13.562299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:13.562304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:13.562308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:13.562313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:13.562318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:13.562323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:13.562328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:13.562332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.562337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.562343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.562348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.562353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.562358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.562362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:13.562367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:13.562371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:13.562385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:13.562424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:13.568337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:13.569623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:13.569658Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:13.569661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:13.569666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:13.569673Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1795 [2:7555895932942895537:5655]
2025-09-30T14:55:13.569691Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:13.569709Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:13.569719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:13.569723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:13.569726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:13.569743Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:13.569756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:13.569764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:13.569837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.569845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.569847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.569851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:13.569853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:13.569924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:13.569934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.569948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.569969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.569987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:13.570003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895932942895532:5655]
2025-09-30T14:55:13.570012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895932942895532:5655]
2025-09-30T14:55:13.570015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895932942895532:5655]
2025-09-30T14:55:13.570027Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:13.570050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:13.570070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:13.570075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:13.570079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:13.570079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:13.570082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:13.570122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895932942895532:5655]
2025-09-30T14:55:13.570137Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:13.570153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895933032663778:7180], now have 1 active actors on pipe
2025-09-30T14:55:13.570157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:13.570162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895933032663648:2454], now have 1 active actors on pipe
2025-09-30T14:55:13.570188Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1795
2025-09-30T14:55:13.570198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1795
2025-09-30T14:55:13.570339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:13.570351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:13.570374Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b40b4be8-2d34f8d7-b48dd5d9-5ba7e675_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:13.570385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:13.570389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:13.570391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:13.570401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:13.570414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:13.570432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:13.570599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:13.570609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:13.570623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:13.570727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1796 partition: 0 MaxSeqNo: 42 sessionId: src_id|b40b4be8-2d34f8d7-b48dd5d9-5ba7e675_0
2025-09-30T14:55:13.571217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3da66704-69b72a7c-a0386005-e6c6acde_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b40b4be8-2d34f8d7-b48dd5d9-5ba7e675_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:13.574704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b40b4be8-2d34f8d7-b48dd5d9-5ba7e675_0] Write session: try to update token
2025-09-30T14:55:13.574731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b40b4be8-2d34f8d7-b48dd5d9-5ba7e675_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:13.582760Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:13.582784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:13.582786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:13.582789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:13.582799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895932942895532:5655]
2025-09-30T14:55:13.582804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895932942895532:5655]
2025-09-30T14:55:13.582808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895932942895532:5655]
2025-09-30T14:55:13.582850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:13.582858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.582860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:13.582867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:13.582874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:13.582878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:13.583024Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:13.593712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1796 sessionId: src_id|b40b4be8-2d34f8d7-b48dd5d9-5ba7e675_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:13.596427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:13.644764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895933032663790:7977]
2025-09-30T14:55:13.645182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1795, pipe: [1:7555895933032663790:7977]
2025-09-30T14:55:13.697386Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:13.697842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:13.697859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:13.697878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895933032663790:7977], now have 1 active actors on pipe
2025-09-30T14:55:13.698130Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:13.698169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895933032663790:7977]
2025-09-30T14:55:13.698280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:13.698290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:13.698308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:13.698359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1796 reason: error at write: Disconnected sessionId: src_id|b40b4be8-2d34f8d7-b48dd5d9-5ba7e675_0
2025-09-30T14:55:13.698535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1796 sessionId: src_id|b40b4be8-2d34f8d7-b48dd5d9-5ba7e675_0 is DEAD
2025-09-30T14:55:13.698714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b40b4be8-2d34f8d7-b48dd5d9-5ba7e675_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:13.698724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b40b4be8-2d34f8d7-b48dd5d9-5ba7e675_0] Write session will restart in 0.005852s
2025-09-30T14:55:13.698747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b40b4be8-2d34f8d7-b48dd5d9-5ba7e675_0] Write session: Do CDS request
2025-09-30T14:55:13.698756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b40b4be8-2d34f8d7-b48dd5d9-5ba7e675_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:13.705941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b40b4be8-2d34f8d7-b48dd5d9-5ba7e675_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:13.706046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:13.706067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1797
2025-09-30T14:55:13.706201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1797 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:13.706237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1797 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:13.706242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1797 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:13.706247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:13.706722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1797 sessionId:  describe result for acl check
2025-09-30T14:55:13.706771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:13.706774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:13.706775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:13.706782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895933032663818:7172] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:13.707359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895933032663818:7172] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:13.710362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895933032663818:7172] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:13.712196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:13.714426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:13.714639Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:13.714650Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:13.714661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:13.714650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895933032663818:7172] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:13.714669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895933032663818:7172] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:13.714673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895933032663818:7172] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:13.714681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1797 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:13.714727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:13.714768Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895932942895681:5645]
2025-09-30T14:55:13.715432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:13.715706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:13.715749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:13.716069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:13.716138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:13.716144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:13.716145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:13.716146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:13.716148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:13.716149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:13.716150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:13.716152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:13.716153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:13.716154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:13.716155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.716157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.716158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.716159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:13.716160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:13.716166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:13.716177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:13.716181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:13.716186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:13.716189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:13.716194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:13.716198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:13.716202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:13.716207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:13.716212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:13.716216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.716220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.716224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.716228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:13.716232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:13.716240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:13.716248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:13.716255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:13.716261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:13.716267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:13.716272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:13.716287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:13.716296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:13.716301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:13.716307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:13.716315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:13.716321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:13.716326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:13.716332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:13.716336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:13.716342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:13.716347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:13.716357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:13.716363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:13.716373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:13.716378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.716389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.716393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.716404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.716409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.716420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.716426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:13.716435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:13.716441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:13.716446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:13.716496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:13.722181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:13.723269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:13.723286Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:13.723288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:13.723292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:13.723299Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1796 [2:7555895932942895681:5645]
2025-09-30T14:55:13.723316Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:13.723331Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:13.723341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:13.723344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:13.723347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:13.723364Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:13.723376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:13.723383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:13.723444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.723455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.723457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.723461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:13.723463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:13.723529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:13.723537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.723550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.723562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.723585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:13.723609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895933032663932:7172], now have 1 active actors on pipe
2025-09-30T14:55:13.723618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895933032663803:2454], now have 1 active actors on pipe
2025-09-30T14:55:13.723625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895932942895676:5645]
2025-09-30T14:55:13.723627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895932942895676:5645]
2025-09-30T14:55:13.723630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895932942895676:5645]
2025-09-30T14:55:13.723642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:13.723660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:13.723669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:13.723673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:13.723676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:13.723681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:13.723684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:13.723709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895932942895676:5645]
2025-09-30T14:55:13.723717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:13.723720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:13.723692Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1796
2025-09-30T14:55:13.723756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1796
2025-09-30T14:55:13.723768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:13.723780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:13.723803Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8c8622-e86f58bd-b0cb8aa8-6720c0f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:13.723816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:13.723824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:13.723826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:13.723837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:13.723850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:13.723866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:13.724008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:13.724016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:13.724030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:13.724130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1797 partition: 0 MaxSeqNo: 42 sessionId: src_id|d8c8622-e86f58bd-b0cb8aa8-6720c0f6_0
2025-09-30T14:55:13.724477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b40b4be8-2d34f8d7-b48dd5d9-5ba7e675_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d8c8622-e86f58bd-b0cb8aa8-6720c0f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:13.727522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8c8622-e86f58bd-b0cb8aa8-6720c0f6_0] Write session: try to update token
2025-09-30T14:55:13.727543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8c8622-e86f58bd-b0cb8aa8-6720c0f6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:13.736135Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:13.736163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:13.736174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895932942895676:5645]
2025-09-30T14:55:13.736223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:13.736247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:13.736404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:13.736552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:13.736695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:13.736849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:13.737064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:13.737113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:13.746097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1797 sessionId: src_id|d8c8622-e86f58bd-b0cb8aa8-6720c0f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:13.747400Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:13.747420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:13.747423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:13.747426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:13.747437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895932942895676:5645]
2025-09-30T14:55:13.747440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895932942895676:5645]
2025-09-30T14:55:13.747444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895932942895676:5645]
2025-09-30T14:55:13.747483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:13.747491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:13.747494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.747497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:13.747498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:13.747504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:13.747632Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:13.749001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:13.798343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895933032663943:7977]
2025-09-30T14:55:13.798683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1796, pipe: [1:7555895933032663943:7977]
2025-09-30T14:55:13.868911Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:13.869278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:13.869297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:13.869321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895933032663943:7977], now have 1 active actors on pipe
2025-09-30T14:55:13.869589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:13.869610Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:13.869606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:13.869630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:13.869684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1797 reason: error at write: Disconnected sessionId: src_id|d8c8622-e86f58bd-b0cb8aa8-6720c0f6_0
2025-09-30T14:55:13.869691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895933032663943:7977]
2025-09-30T14:55:13.869876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1797 sessionId: src_id|d8c8622-e86f58bd-b0cb8aa8-6720c0f6_0 is DEAD
2025-09-30T14:55:13.870137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8c8622-e86f58bd-b0cb8aa8-6720c0f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:13.870154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8c8622-e86f58bd-b0cb8aa8-6720c0f6_0] Write session will restart in 0.005781s
2025-09-30T14:55:13.870188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8c8622-e86f58bd-b0cb8aa8-6720c0f6_0] Write session: Do CDS request
2025-09-30T14:55:13.870195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8c8622-e86f58bd-b0cb8aa8-6720c0f6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:13.876952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8c8622-e86f58bd-b0cb8aa8-6720c0f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:13.877021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:13.877040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1798
2025-09-30T14:55:13.877275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1798 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:13.877325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1798 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:13.877349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1798 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:13.877354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:13.878019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1798 sessionId:  describe result for acl check
2025-09-30T14:55:13.878059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:13.878066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:13.878068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:13.878075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895933032663991:7166] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:13.878628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895933032663991:7166] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:13.880740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895933032663991:7166] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:13.881599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:13.883733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:13.883964Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:13.883974Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:13.883986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:13.884043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:13.884231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895933032663991:7166] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:13.884252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895933032663991:7166] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:13.884255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895933032663991:7166] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:13.884264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1798 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:13.884103Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895932942895816:5638]
2025-09-30T14:55:13.884756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:13.885072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:13.885119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:13.885446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:13.885527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:13.885535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:13.885536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:13.885537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:13.885538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:13.885540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:13.885541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:13.885542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:13.885544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:13.885545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:13.885547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.885548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.885549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.885550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:13.885551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:13.885557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:13.885568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:13.885573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:13.885578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:13.885582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:13.885586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:13.885590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:13.885594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:13.885598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:13.885605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:13.885610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.885614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.885618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.885622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:13.885626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:13.885645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:13.885654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:13.885660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:13.885666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:13.885671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:13.885677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:13.885681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:13.885688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:13.885693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:13.885698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:13.885703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:13.885708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:13.885717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:13.885723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:13.885733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:13.885738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:13.885747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:13.885753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:13.885763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:13.885768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:13.885773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.885783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.885789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.885799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.885804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.885814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.885819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:13.885823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:13.885829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:13.885834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:13.885882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:13.891700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:13.892825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:13.892850Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:13.892853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:13.892857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:13.892864Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1797 [2:7555895932942895816:5638]
2025-09-30T14:55:13.892880Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:13.892898Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:13.892901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:13.892904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:13.892907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:13.892923Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:13.892931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:13.892938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:13.893004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.893015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.893017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.893021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:13.893024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:13.893097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:13.893110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.893125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:13.893144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:13.893166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:13.893189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895933032663945:2454], now have 1 active actors on pipe
2025-09-30T14:55:13.893199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895933032664076:7166], now have 1 active actors on pipe
2025-09-30T14:55:13.893205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895932942895811:5638]
2025-09-30T14:55:13.893207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895932942895811:5638]
2025-09-30T14:55:13.893208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895932942895811:5638]
2025-09-30T14:55:13.893222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:13.893235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:13.893235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:13.893239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:13.893241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:13.893251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:13.893254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:13.893289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895932942895811:5638]
2025-09-30T14:55:13.893304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:13.893268Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1797
2025-09-30T14:55:13.893296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1797
2025-09-30T14:55:13.893329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:13.893381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:13.893391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:13.893419Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dbc13b4f-32722c58-a402049e-436b97ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:13.893427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:13.893431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:13.893433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:13.893442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:13.893451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:13.893465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:13.893605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:13.893613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:13.893626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:13.893708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1798 partition: 0 MaxSeqNo: 42 sessionId: src_id|dbc13b4f-32722c58-a402049e-436b97ff_0
2025-09-30T14:55:13.894175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8c8622-e86f58bd-b0cb8aa8-6720c0f6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dbc13b4f-32722c58-a402049e-436b97ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:13.897653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc13b4f-32722c58-a402049e-436b97ff_0] Write session: try to update token
2025-09-30T14:55:13.897684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc13b4f-32722c58-a402049e-436b97ff_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:13.905620Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:13.905660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:13.905670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895932942895811:5638]
2025-09-30T14:55:13.905716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:13.905725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:13.905897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:13.906068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:13.906221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:13.906369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:13.906575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:13.906624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:13.916702Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:13.916724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:13.916727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:13.916729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:13.916739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895932942895811:5638]
2025-09-30T14:55:13.916744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895932942895811:5638]
2025-09-30T14:55:13.916749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895932942895811:5638]
2025-09-30T14:55:13.916782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:13.916792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:13.916794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:13.916798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:13.916805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:13.916809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:13.916918Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:13.918080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1798 sessionId: src_id|dbc13b4f-32722c58-a402049e-436b97ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:13.921020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:13.969876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895933032664088:7977]
2025-09-30T14:55:13.970226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1797, pipe: [1:7555895933032664088:7977]
2025-09-30T14:55:14.034351Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:14.034829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:14.034845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:14.034865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895933032664088:7977], now have 1 active actors on pipe
2025-09-30T14:55:14.035076Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:14.035121Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:14.035197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895933032664088:7977]
2025-09-30T14:55:14.035224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:14.035316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1798 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dbc13b4f-32722c58-a402049e-436b97ff_0
2025-09-30T14:55:14.035507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1798 sessionId: src_id|dbc13b4f-32722c58-a402049e-436b97ff_0 is DEAD
2025-09-30T14:55:14.035968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc13b4f-32722c58-a402049e-436b97ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:14.036001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc13b4f-32722c58-a402049e-436b97ff_0] Write session will restart in 0.005614s
2025-09-30T14:55:14.036033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc13b4f-32722c58-a402049e-436b97ff_0] Write session: Do CDS request
2025-09-30T14:55:14.036041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc13b4f-32722c58-a402049e-436b97ff_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:14.042869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc13b4f-32722c58-a402049e-436b97ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:14.043636Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:14.043666Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1799
2025-09-30T14:55:14.043831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1799 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:14.043864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1799 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:14.043875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1799 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:14.043879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:14.044351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1799 sessionId:  describe result for acl check
2025-09-30T14:55:14.044392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:14.044399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:14.044401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:14.044406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895937327631444:7159] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:14.044940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895937327631444:7159] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:14.046994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895937327631444:7159] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:14.047354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:14.049068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:14.049301Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:14.049313Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:14.049332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895937327631444:7159] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:14.049348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895937327631444:7159] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:14.049351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895937327631444:7159] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:14.049324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:14.049360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1799 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:14.049377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:14.049414Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895937237863246:5643]
2025-09-30T14:55:14.050094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:14.050858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:14.050915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:14.051276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:14.051337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:14.051342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:14.051343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:14.051344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:14.051345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:14.051346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:14.051347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:14.051348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:14.051349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:14.051350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:14.051352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.051354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.051355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.051356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:14.051357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:14.051363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:14.051383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:14.051387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:14.051391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:14.051394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:14.051398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:14.051401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:14.051405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:14.051409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:14.051413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:14.051417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.051420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.051424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.051427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:14.051430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:14.051439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:14.051447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:14.051462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:14.051468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:14.051473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:14.051478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:14.051482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:14.051487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:14.051491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:14.051496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:14.051500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:14.051505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:14.051510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:14.051516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:14.051520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:14.051525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:14.051530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:14.051534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:14.051545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:14.051550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:14.051559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.051564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.051573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.051578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.051583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.051587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.051596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:14.051600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:14.051604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:14.051609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:14.051656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:14.057506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:14.058398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:14.058418Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:14.058421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:14.058425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:14.058432Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1798 [2:7555895937237863246:5643]
2025-09-30T14:55:14.058447Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:14.058464Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:14.058467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:14.058470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:14.058473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:14.058489Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:14.058502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:14.058510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:14.058605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.058611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.058612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.058615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:14.058618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:14.058680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:14.058688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.058702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.058719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.058743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:14.058766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895937327631516:7159], now have 1 active actors on pipe
2025-09-30T14:55:14.058774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895937327631385:2454], now have 1 active actors on pipe
2025-09-30T14:55:14.058782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895937237863241:5643]
2025-09-30T14:55:14.058786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895937237863241:5643]
2025-09-30T14:55:14.058789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895937237863241:5643]
2025-09-30T14:55:14.058806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:14.058824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:14.058839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:14.058844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:14.058847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:14.058851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:14.058853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:14.058882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895937237863241:5643]
2025-09-30T14:55:14.058856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1798
2025-09-30T14:55:14.058896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:14.058860Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1798
2025-09-30T14:55:14.058917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:14.059085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:14.059098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:14.059125Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9db0d113-82bf1eb0-dd434371-4c4fb8af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:14.059139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:14.059147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:14.059149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:14.059161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:14.059176Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:14.059196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:14.059408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:14.059422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:14.059454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:14.059576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1799 partition: 0 MaxSeqNo: 42 sessionId: src_id|9db0d113-82bf1eb0-dd434371-4c4fb8af_0
2025-09-30T14:55:14.059931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc13b4f-32722c58-a402049e-436b97ff_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9db0d113-82bf1eb0-dd434371-4c4fb8af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:14.063408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9db0d113-82bf1eb0-dd434371-4c4fb8af_0] Write session: try to update token
2025-09-30T14:55:14.063430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9db0d113-82bf1eb0-dd434371-4c4fb8af_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:14.071906Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:14.071929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:14.071939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895937237863241:5643]
2025-09-30T14:55:14.071988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:14.072029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:14.072170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:14.072327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:14.072484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:14.072639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:14.072849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:14.072897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:14.083280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:14.083309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:14.084522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:14.084559Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:14.084562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:14.084564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:14.084567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:14.084576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895937237863241:5643]
2025-09-30T14:55:14.084582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895937237863241:5643]
2025-09-30T14:55:14.084586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895937237863241:5643]
2025-09-30T14:55:14.079808Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1799 sessionId: src_id|9db0d113-82bf1eb0-dd434371-4c4fb8af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:14.082618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:14.084641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:14.084621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:14.084622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:14.084629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:14.084633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:14.084636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.084639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:14.084781Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:14.135387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895937327631533:7977]
2025-09-30T14:55:14.139531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1798, pipe: [1:7555895937327631533:7977]
2025-09-30T14:55:14.207365Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:14.216561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:14.216602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:14.216809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:14.216878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:14.216948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:14.217023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:14.217554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:14.217561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:14.217662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:14.217728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:14.217795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:14.218130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:14.218173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:14.218176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:14.218255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:14.218324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:14.218389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:14.218456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:14.218497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:14.218500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:14.218574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:14.218645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:14.218712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:14.218781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:14.218832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:14.218835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:14.218907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:14.218972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:14.219043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:14.219111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:14.219156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:14.219159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:14.219233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:14.219530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:14.219615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:14.219685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:14.219730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:14.219733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:14.219815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:14.219882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:14.219961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:14.220031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:14.220080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:14.220084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:14.220157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:14.220223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:14.220289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:14.220358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:14.220404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:14.220407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:14.220482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:14.220546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:14.220617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:14.220683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:14.220728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:14.220731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:14.220811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:14.220879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:14.220944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:14.221012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:14.221056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:14.221059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:14.221150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895937327631533:7977], now have 1 active actors on pipe
2025-09-30T14:55:14.222023Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:14.221898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895937327631533:7977]
2025-09-30T14:55:14.221899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:14.221904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:14.221936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1799 reason: error at write: Disconnected sessionId: src_id|9db0d113-82bf1eb0-dd434371-4c4fb8af_0
2025-09-30T14:55:14.221941Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:14.222201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1799 sessionId: src_id|9db0d113-82bf1eb0-dd434371-4c4fb8af_0 is DEAD
2025-09-30T14:55:14.223466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9db0d113-82bf1eb0-dd434371-4c4fb8af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:14.223481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9db0d113-82bf1eb0-dd434371-4c4fb8af_0] Write session will restart in 0.009207s
2025-09-30T14:55:14.223515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9db0d113-82bf1eb0-dd434371-4c4fb8af_0] Write session: Do CDS request
2025-09-30T14:55:14.223521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9db0d113-82bf1eb0-dd434371-4c4fb8af_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:14.233957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9db0d113-82bf1eb0-dd434371-4c4fb8af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:14.233999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:14.234018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1800
2025-09-30T14:55:14.234220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1800 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:14.234262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1800 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:14.234278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1800 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:14.234284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:14.234709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1800 sessionId:  describe result for acl check
2025-09-30T14:55:14.234742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:14.234744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:14.234746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:14.234752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895937327631604:6569] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:14.235327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895937327631604:6569] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:14.238190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:14.239722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895937327631604:6569] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:14.240446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:14.240783Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:14.240800Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:14.240815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:14.240896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:14.240956Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895937237863381:5642]
2025-09-30T14:55:14.241734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:14.242188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:14.242252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:14.242642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:14.242713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:14.242715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:14.242716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:14.242717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:14.242719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:14.242720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:14.242722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:14.242723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:14.242724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:14.242725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:14.242727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.242729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.242730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.242732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:14.242733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:14.242740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:14.242751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:14.242755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:14.242759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:14.242763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:14.242769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:14.242773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:14.242778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:14.242782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:14.242787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:14.242790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.242795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.242799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.242804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:14.242807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:14.242815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:14.242824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:14.242831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:14.242838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:14.242843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:14.242849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:14.242854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:14.242860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:14.242865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:14.242871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:14.242876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:14.242882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:14.242887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:14.242893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:14.242898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:14.242903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:14.242909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:14.242915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:14.242920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:14.242529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895937327631604:6569] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:14.242549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895937327631604:6569] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:14.242926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:14.242931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.242937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.242942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.242948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.242954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.242960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.242967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:14.242973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:14.242979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:14.242984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:14.242553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895937327631604:6569] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:14.242563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1800 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:14.243032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:14.249042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:14.250164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:14.250181Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:14.250184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:14.250188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:14.250195Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1799 [2:7555895937237863381:5642]
2025-09-30T14:55:14.250212Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:14.250228Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:14.250232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:14.250235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:14.250238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:14.250256Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:14.250264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:14.250271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:14.250337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.250344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.250346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.250350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:14.250354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:14.250428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:14.250439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.250452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.250465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.250481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:14.250499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895937327631538:2454], now have 1 active actors on pipe
2025-09-30T14:55:14.250509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895937327631671:6569], now have 1 active actors on pipe
2025-09-30T14:55:14.250516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895937237863376:5642]
2025-09-30T14:55:14.250519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895937237863376:5642]
2025-09-30T14:55:14.250521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895937237863376:5642]
2025-09-30T14:55:14.250533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:14.250544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:14.250550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:14.250564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:14.250565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:14.250568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:14.250571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:14.250604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895937237863376:5642]
2025-09-30T14:55:14.250616Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:14.250637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:14.250689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:14.250698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:14.250722Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1d1b460-f751720-e6c2e378-6c3f16bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:14.250733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:14.250737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:14.250739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:14.250752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:14.250765Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:14.250784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:14.250609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1799
2025-09-30T14:55:14.250662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1799
2025-09-30T14:55:14.250905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:14.250914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:14.250930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:14.251015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1800 partition: 0 MaxSeqNo: 42 sessionId: src_id|b1d1b460-f751720-e6c2e378-6c3f16bd_0
2025-09-30T14:55:14.251420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9db0d113-82bf1eb0-dd434371-4c4fb8af_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b1d1b460-f751720-e6c2e378-6c3f16bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:14.254182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1d1b460-f751720-e6c2e378-6c3f16bd_0] Write session: try to update token
2025-09-30T14:55:14.254198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1d1b460-f751720-e6c2e378-6c3f16bd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:14.264214Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:14.264234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:14.264237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:14.264239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:14.264252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895937237863376:5642]
2025-09-30T14:55:14.264257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895937237863376:5642]
2025-09-30T14:55:14.264262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895937237863376:5642]
2025-09-30T14:55:14.264302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:14.264309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.264312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:14.264332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:14.264341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:14.264346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:14.264454Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:14.274291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1800 sessionId: src_id|b1d1b460-f751720-e6c2e378-6c3f16bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:14.277068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:14.322081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895937327631696:7977]
2025-09-30T14:55:14.322376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1799, pipe: [1:7555895937327631696:7977]
2025-09-30T14:55:14.384901Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:14.385336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:14.385347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:14.385368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895937327631696:7977], now have 1 active actors on pipe
2025-09-30T14:55:14.385723Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:14.386256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1d1b460-f751720-e6c2e378-6c3f16bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:14.386274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1d1b460-f751720-e6c2e378-6c3f16bd_0] Write session will restart in 0.007805s
2025-09-30T14:55:14.385681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:14.386305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1d1b460-f751720-e6c2e378-6c3f16bd_0] Write session: Do CDS request
2025-09-30T14:55:14.385699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:14.385777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1800 reason: error at write: Disconnected sessionId: src_id|b1d1b460-f751720-e6c2e378-6c3f16bd_0
2025-09-30T14:55:14.385966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1800 sessionId: src_id|b1d1b460-f751720-e6c2e378-6c3f16bd_0 is DEAD
2025-09-30T14:55:14.386208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895937327631696:7977]
2025-09-30T14:55:14.386314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1d1b460-f751720-e6c2e378-6c3f16bd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:14.386225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:14.395976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1d1b460-f751720-e6c2e378-6c3f16bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:14.396069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:14.396098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1801
2025-09-30T14:55:14.397445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:14.399467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:14.399560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1801 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:14.399612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1801 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:14.399621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1801 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:14.399636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:14.399667Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:14.399677Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:14.399687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:14.399737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:14.399781Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895937237863555:5617]
2025-09-30T14:55:14.400472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:14.400582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1801 sessionId:  describe result for acl check
2025-09-30T14:55:14.400617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:14.400624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:14.400626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:14.400632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895937327631806:7132] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:14.400774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:14.400841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:14.401146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895937327631806:7132] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:14.401235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:14.401300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:14.401306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:14.401308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:14.401309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:14.401310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:14.401311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:14.401313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:14.401314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:14.401316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:14.401317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:14.401318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.401320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.401321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.401322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:14.401323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:14.401329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:14.401340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:14.401344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:14.401348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:14.401352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:14.401357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:14.401361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:14.401365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:14.401369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:14.401374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:14.401378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.401382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.401386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.401390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:14.401394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:14.401400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:14.401419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:14.401425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:14.401431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:14.401436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:14.401442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:14.401447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:14.401452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:14.401459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:14.401462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:14.401465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:14.401468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:14.401470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:14.401474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:14.401476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:14.401479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:14.401482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:14.401485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:14.401487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:14.401490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:14.401493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.401496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.401498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.401502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.401505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.401508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.401517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:14.401523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:14.401527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:14.401531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:14.401557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:14.403284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895937327631806:7132] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:14.407134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:14.407184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895937327631806:7132] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:14.407203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895937327631806:7132] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:14.407206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895937327631806:7132] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:14.407215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1801 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:14.408031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:14.408046Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:14.408049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:14.408053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:14.408060Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1800 [2:7555895937237863555:5617]
2025-09-30T14:55:14.408075Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:14.408089Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:14.408097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:14.408101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:14.408103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:14.408119Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:14.408131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:14.408139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:14.408209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.408216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.408220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.408223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:14.408226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:14.408299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:14.408306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.408319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.408339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.408357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:14.408376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895937327631842:7132], now have 1 active actors on pipe
2025-09-30T14:55:14.408385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895937327631706:2454], now have 1 active actors on pipe
2025-09-30T14:55:14.408391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895937237863549:5617]
2025-09-30T14:55:14.408398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895937237863549:5617]
2025-09-30T14:55:14.408400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895937237863549:5617]
2025-09-30T14:55:14.408413Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:14.408427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:14.408430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:14.408436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:14.408439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:14.408446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:14.408450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:14.408441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1800
2025-09-30T14:55:14.408481Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1800
2025-09-30T14:55:14.408484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895937237863549:5617]
2025-09-30T14:55:14.408496Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:14.408520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:14.408526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:14.408529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:14.408561Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac01ac81-44d83e1e-3e40a161-db0ac34b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:14.408572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:14.408576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:14.408578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:14.408587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:14.408600Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:14.408626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:14.408765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:14.408772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:14.408785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:14.408865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1801 partition: 0 MaxSeqNo: 42 sessionId: src_id|ac01ac81-44d83e1e-3e40a161-db0ac34b_0
2025-09-30T14:55:14.409262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1d1b460-f751720-e6c2e378-6c3f16bd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ac01ac81-44d83e1e-3e40a161-db0ac34b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:14.412855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac01ac81-44d83e1e-3e40a161-db0ac34b_0] Write session: try to update token
2025-09-30T14:55:14.412880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac01ac81-44d83e1e-3e40a161-db0ac34b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:14.421390Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:14.421408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:14.421411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:14.421413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:14.421423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895937237863549:5617]
2025-09-30T14:55:14.421428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895937237863549:5617]
2025-09-30T14:55:14.421434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895937237863549:5617]
2025-09-30T14:55:14.421475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:14.421488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.421491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:14.421508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:14.421521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:14.421527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:14.421652Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:14.437278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1801 sessionId: src_id|ac01ac81-44d83e1e-3e40a161-db0ac34b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:14.441067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:14.486505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895937327631851:7977]
2025-09-30T14:55:14.486886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1800, pipe: [1:7555895937327631851:7977]
2025-09-30T14:55:14.538412Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:14.538887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:14.538903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:14.538926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895937327631851:7977], now have 1 active actors on pipe
2025-09-30T14:55:14.539231Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:14.539826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac01ac81-44d83e1e-3e40a161-db0ac34b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:14.539842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac01ac81-44d83e1e-3e40a161-db0ac34b_0] Write session will restart in 0.009179s
2025-09-30T14:55:14.539873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac01ac81-44d83e1e-3e40a161-db0ac34b_0] Write session: Do CDS request
2025-09-30T14:55:14.539879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac01ac81-44d83e1e-3e40a161-db0ac34b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:14.539316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:14.539341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:14.539370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895937327631851:7977]
2025-09-30T14:55:14.539401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1801 reason: error at write: Disconnected sessionId: src_id|ac01ac81-44d83e1e-3e40a161-db0ac34b_0
2025-09-30T14:55:14.539406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:14.539459Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:55:14.539565Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 18 consumer shared/user session shared/user_1_18_18254351790732249821_v1 is DEAD
2025-09-30T14:55:14.539625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1801 sessionId: src_id|ac01ac81-44d83e1e-3e40a161-db0ac34b_0 is DEAD
2025-09-30T14:55:14.539751Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895864313170829:7991] disconnected; active server actors: 1
2025-09-30T14:55:14.539755Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895864313170829:7991] client user disconnected session shared/user_1_18_18254351790732249821_v1
2025-09-30T14:55:14.543570Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:55:14.543780Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:55:14.543787Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:55:14.543798Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.009005s
2025-09-30T14:55:14.550904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac01ac81-44d83e1e-3e40a161-db0ac34b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:14.551023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:14.551062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1802
2025-09-30T14:55:14.551260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1802 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:14.551308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1802 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:14.551315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1802 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:14.551321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:14.551916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1802 sessionId:  describe result for acl check
2025-09-30T14:55:14.551969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:14.551972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:14.551979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:14.551987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895937327631861:7128] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:14.553045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895937327631861:7128] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:14.553852Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:55:14.554085Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:55:14.554104Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 19
2025-09-30T14:55:14.554268Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 19 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:55:14.554337Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:55:14.554442Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 auth for : user
2025-09-30T14:55:14.554579Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 Handle describe topics response
2025-09-30T14:55:14.554604Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 auth is DEAD
2025-09-30T14:55:14.554623Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:55:14.554886Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:55:14.554967Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895937327631886:7125] connected; active server actors: 1
2025-09-30T14:55:14.554981Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555895937327631886:7125] session shared/user_1_19_7249590220442558625_v1
2025-09-30T14:55:14.554991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:55:14.555003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:55:14.555016Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_19_7249590220442558625_v1" (Sender=[1:7555895937327631876:7125], Pipe=[1:7555895937327631886:7125], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:55:14.555021Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:55:14.555032Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:55:14.555046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_19_7249590220442558625_v1" (Sender=[1:7555895937327631876:7125], Pipe=[1:7555895937327631886:7125], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:55:14.555066Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_19_7249590220442558625_v1
2025-09-30T14:55:14.555062Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_19_7249590220442558625_v1" sender [1:7555895937327631876:7125] lock partition 0 for ReadingSession "shared/user_1_19_7249590220442558625_v1" (Sender=[1:7555895937327631876:7125], Pipe=[1:7555895937327631886:7125], Partitions=[], ActiveFamilyCount=1) generation 1 step 19
2025-09-30T14:55:14.555075Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:55:14.555080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000041s
2025-09-30T14:55:14.555313Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 19 Session: "shared/user_1_19_7249590220442558625_v1" ClientId: "user" PipeClient { RawX1: 7555895937327631886 RawX2: 4503603922344917 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:55:14.555336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895937327631861:7128] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:14.555430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:55:14.558653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895937327631861:7128] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:14.558681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895937327631861:7128] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:14.558685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895937327631861:7128] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:14.558695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1802 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:14.564114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:14.566292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:14.566549Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:14.566561Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:14.566575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:14.566648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:14.566707Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895937237863694:5614]
2025-09-30T14:55:14.567515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:14.568198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:14.568295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:14.568644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:14.568701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:14.568709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:14.568710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:14.568712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:14.568713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:14.568714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:14.568716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:14.568717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:14.568718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:14.568720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:14.568721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.568723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.568724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.568726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:14.568727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:14.568734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:14.568745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:14.568748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:14.568751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:14.568753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:14.568756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:14.568758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:14.568761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:14.568763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:14.568766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:14.568768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.568771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.568773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.568778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:14.568782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:14.568792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:14.568802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:14.568809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:14.568817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:14.568821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:14.568824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:14.568828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:14.568831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:14.568835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:14.568838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:14.568841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:14.568845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:14.568848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:14.568851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:14.568854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:14.568857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:14.568861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:14.568864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:14.568869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:14.568874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:14.568880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.568883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.568887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.568890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.568893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.568896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.568898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:14.568901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:14.568904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:14.568907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:14.568937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:14.575136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:14.576333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:14.576351Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:14.576356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:14.576361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:14.576371Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1801 [2:7555895937237863694:5614]
2025-09-30T14:55:14.576394Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:14.576418Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:14.576422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:14.576427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:14.576430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:14.576454Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:14.576464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:14.576473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:14.576564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.576575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.576579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.576596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:14.576600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:14.576697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:14.576708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.576723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.576740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.576759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:14.576786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895937237863689:5614]
2025-09-30T14:55:14.576792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895937237863689:5614]
2025-09-30T14:55:14.576795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895937237863689:5614]
2025-09-30T14:55:14.576808Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:14.576825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:14.576845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:14.576849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:14.576850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:14.576854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:14.576857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:14.576864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895937327631852:2454], now have 1 active actors on pipe
2025-09-30T14:55:14.576868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895937327631891:7118], now have 1 active actors on pipe
2025-09-30T14:55:14.576871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895937327631923:7128], now have 1 active actors on pipe
2025-09-30T14:55:14.576918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895937237863689:5614]
2025-09-30T14:55:14.576930Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:14.577031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1801
2025-09-30T14:55:14.577100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1801, pipe: [1:7555895937327631891:7118]
2025-09-30T14:55:14.577131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1801
2025-09-30T14:55:14.577517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:14.577784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:14.577798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:14.577815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_19_7249590220442558625_v1 on pipe: [1:7555895937327631891:7118]
2025-09-30T14:55:14.577845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:14.577852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:14.577861Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_19_7249590220442558625_v1:1 with generation 1801
2025-09-30T14:55:14.577871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:14.577879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:14.577885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:14.577909Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_19_7249590220442558625_v1
2025-09-30T14:55:14.577917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:14.577961Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4498cca5-bc07ac65-b1b31ed5-f16d148e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:14.577974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:55:14.577980Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:55:14.581646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:55:14.581689Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:55:14.581700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:14.581706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:14.581709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:14.581724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:14.581741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:14.581750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:55:14.581767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:55:14.581792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:14.581959Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759244114576 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:55:14.581987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:55:14.582031Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 sending to client partition status
2025-09-30T14:55:14.582042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:14.582056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:14.582078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:14.582233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1802 partition: 0 MaxSeqNo: 42 sessionId: src_id|4498cca5-bc07ac65-b1b31ed5-f16d148e_0
2025-09-30T14:55:14.582572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac01ac81-44d83e1e-3e40a161-db0ac34b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4498cca5-bc07ac65-b1b31ed5-f16d148e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:14.586176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4498cca5-bc07ac65-b1b31ed5-f16d148e_0] Write session: try to update token
2025-09-30T14:55:14.586204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4498cca5-bc07ac65-b1b31ed5-f16d148e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:14.591164Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:14.591184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:14.591187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:14.591190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:14.591201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895937237863689:5614]
2025-09-30T14:55:14.591206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895937237863689:5614]
2025-09-30T14:55:14.591211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895937237863689:5614]
2025-09-30T14:55:14.591272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:14.591277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:14.591279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.591282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:14.591284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:14.591289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:14.591425Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:14.606175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1802 sessionId: src_id|4498cca5-bc07ac65-b1b31ed5-f16d148e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:14.609505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:14.713261Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:14.713798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:14.713828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:14.714131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_19_7249590220442558625_v1
2025-09-30T14:55:14.714156Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:14.714181Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_19_7249590220442558625_v1
2025-09-30T14:55:14.714191Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:14.714216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895937327631891:7118]
2025-09-30T14:55:14.714257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:14.714379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1802 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4498cca5-bc07ac65-b1b31ed5-f16d148e_0
2025-09-30T14:55:14.714626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1802 sessionId: src_id|4498cca5-bc07ac65-b1b31ed5-f16d148e_0 is DEAD
2025-09-30T14:55:14.714833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4498cca5-bc07ac65-b1b31ed5-f16d148e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:14.714847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4498cca5-bc07ac65-b1b31ed5-f16d148e_0] Write session will restart in 0.007849s
2025-09-30T14:55:14.714876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4498cca5-bc07ac65-b1b31ed5-f16d148e_0] Write session: Do CDS request
2025-09-30T14:55:14.714885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4498cca5-bc07ac65-b1b31ed5-f16d148e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:14.723976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4498cca5-bc07ac65-b1b31ed5-f16d148e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:14.724078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:14.724099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1803
2025-09-30T14:55:14.724260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1803 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:14.724296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1803 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:14.724302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1803 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:14.724306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:14.724851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1803 sessionId:  describe result for acl check
2025-09-30T14:55:14.724891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:14.724893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:14.724895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:14.724901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895937327632108:7116] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:14.725471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895937327632108:7116] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:14.727034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:14.727544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895937327632108:7116] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:14.729335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:14.729575Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:14.729585Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:14.729597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:14.729668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:14.729729Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895937237863845:5607]
2025-09-30T14:55:14.730389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:14.730708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:14.730708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895937327632108:7116] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:14.730726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895937327632108:7116] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:14.730729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895937327632108:7116] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:14.730738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1803 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:14.730756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:14.731091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:14.731157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:14.731163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:14.731164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:14.731166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:14.731167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:14.731169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:14.731170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:14.731171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:14.731173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:14.731174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:14.731176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.731177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.731178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.731180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:14.731181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:14.731187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:14.731197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:14.731201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:14.731206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:14.731211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:14.731215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:14.731219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:14.731223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:14.731227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:14.731231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:14.731235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.731240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.731260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.731264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:14.731269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:14.731277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:14.731286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:14.731293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:14.731299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:14.731304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:14.731309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:14.731314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:14.731320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:14.731325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:14.731330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:14.731334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:14.731340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:14.731345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:14.731350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:14.731355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:14.731361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:14.731367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:14.731372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:14.731377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:14.731384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:14.731389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.731396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.731400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.731405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.731410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.731422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.731426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:14.731433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:14.731443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:14.731448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:14.731495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:14.737164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:14.738102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:14.738116Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:14.738120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:14.738124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:14.738132Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1802 [2:7555895937237863845:5607]
2025-09-30T14:55:14.738149Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:14.738171Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:14.738174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:14.738178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:14.738181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:14.738198Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:14.738206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:14.738214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:14.738274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.738281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.738284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.738288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:14.738291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:14.738362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:14.738375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.738389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.738402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.738421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:14.738440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895937327632158:7116], now have 1 active actors on pipe
2025-09-30T14:55:14.738444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895937327632020:2454], now have 1 active actors on pipe
2025-09-30T14:55:14.738451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895937237863840:5607]
2025-09-30T14:55:14.738454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895937237863840:5607]
2025-09-30T14:55:14.738456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895937237863840:5607]
2025-09-30T14:55:14.738469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:14.738485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:14.738488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:14.738490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:14.738491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:14.738506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:14.738515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:14.738549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895937237863840:5607]
2025-09-30T14:55:14.738565Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:14.738543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1802
2025-09-30T14:55:14.738545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1802
2025-09-30T14:55:14.738597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:14.738657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:14.738671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:14.738714Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f27eb45-f9d984a6-adb95012-bd8b713f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:14.738727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:14.738732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:14.738736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:14.738746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:14.738762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:14.738783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:14.738950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:14.738964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:14.738987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:14.739080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1803 partition: 0 MaxSeqNo: 42 sessionId: src_id|f27eb45-f9d984a6-adb95012-bd8b713f_0
2025-09-30T14:55:14.739521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4498cca5-bc07ac65-b1b31ed5-f16d148e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f27eb45-f9d984a6-adb95012-bd8b713f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:14.743157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f27eb45-f9d984a6-adb95012-bd8b713f_0] Write session: try to update token
2025-09-30T14:55:14.743188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f27eb45-f9d984a6-adb95012-bd8b713f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:14.751601Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:14.751621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:14.751624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:14.751626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:14.751640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895937237863840:5607]
2025-09-30T14:55:14.751645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895937237863840:5607]
2025-09-30T14:55:14.751650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895937237863840:5607]
2025-09-30T14:55:14.751692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:14.751701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.751706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:14.751713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:14.751727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:14.751732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:14.751852Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:14.770739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1803 sessionId: src_id|f27eb45-f9d984a6-adb95012-bd8b713f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:14.774147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:14.814164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895937327632168:7118]
2025-09-30T14:55:14.814548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1802, pipe: [1:7555895937327632168:7118]
2025-09-30T14:55:14.872458Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:14.873044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:14.873060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:14.873083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895937327632168:7118], now have 1 active actors on pipe
2025-09-30T14:55:14.873387Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:14.873476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:14.873501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895937327632168:7118]
2025-09-30T14:55:14.873537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:14.873677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1803 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f27eb45-f9d984a6-adb95012-bd8b713f_0
2025-09-30T14:55:14.874106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f27eb45-f9d984a6-adb95012-bd8b713f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:14.874130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f27eb45-f9d984a6-adb95012-bd8b713f_0] Write session will restart in 0.005020s
2025-09-30T14:55:14.874164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f27eb45-f9d984a6-adb95012-bd8b713f_0] Write session: Do CDS request
2025-09-30T14:55:14.874172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f27eb45-f9d984a6-adb95012-bd8b713f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:14.873933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1803 sessionId: src_id|f27eb45-f9d984a6-adb95012-bd8b713f_0 is DEAD
2025-09-30T14:55:14.880887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f27eb45-f9d984a6-adb95012-bd8b713f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:14.880950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:14.880971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1804
2025-09-30T14:55:14.881193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1804 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:14.881262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1804 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:14.881276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1804 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:14.881282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:14.881968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1804 sessionId:  describe result for acl check
2025-09-30T14:55:14.882012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:14.882024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:14.882027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:14.882034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895937327632214:7110] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:14.882715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895937327632214:7110] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:14.885010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895937327632214:7110] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:14.885217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:14.887304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:14.887499Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:14.887509Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:14.887521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:14.887574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:14.887613Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895937237863986:5599]
2025-09-30T14:55:14.888113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895937327632214:7110] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:14.888131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895937327632214:7110] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:14.888135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895937327632214:7110] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:14.888145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1804 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:14.888297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:14.888635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:14.888684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:14.889012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:14.889090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:14.889099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:14.889100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:14.889101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:14.889103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:14.889104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:14.889105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:14.889106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:14.889108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:14.889109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:14.889110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.889111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.889113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.889114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:14.889115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:14.889121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:14.889132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:14.889137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:14.889141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:14.889146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:14.889150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:14.889154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:14.889158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:14.889162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:14.889166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:14.889170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.889174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.889178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.889183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:14.889187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:14.889197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:14.889205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:14.889211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:14.889217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:14.889221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:14.889227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:14.889231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:14.889237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:14.889241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:14.889247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:14.889254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:14.889260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:14.889271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:14.889277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:14.889281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:14.889286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:14.889290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:14.889296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:14.889301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:14.889308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:14.889315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.889320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.889330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.889335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.889340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.889346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.889351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:14.889356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:14.889362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:14.889367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:14.889415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:14.895279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:14.896532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:14.896550Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:14.896552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:14.896556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:14.896563Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1803 [2:7555895937237863986:5599]
2025-09-30T14:55:14.896581Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:14.896597Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:14.896601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:14.896605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:14.896607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:14.896625Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:14.896633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:14.896641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:14.896711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.896722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.896725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.896728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:14.896731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:14.896803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:14.896813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.896829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:14.896843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:14.896869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:14.896887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895937237863980:5599]
2025-09-30T14:55:14.896890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895937237863980:5599]
2025-09-30T14:55:14.897019Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1803
2025-09-30T14:55:14.897090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1803
2025-09-30T14:55:14.896892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895937237863980:5599]
2025-09-30T14:55:14.896902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:14.896917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895937327632169:2454], now have 1 active actors on pipe
2025-09-30T14:55:14.896921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895937327632305:7110], now have 1 active actors on pipe
2025-09-30T14:55:14.896925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:14.896928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:14.896929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:14.896931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:14.896943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:14.896947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:14.896982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895937237863980:5599]
2025-09-30T14:55:14.896991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:14.897023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:14.897188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:14.897199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:14.897227Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd383b9c-afc96586-59371e8-d9296771_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:14.897239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:14.897242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:14.897245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:14.897255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:14.897269Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:14.897290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:14.897500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:14.897512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:14.897536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:14.897655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1804 partition: 0 MaxSeqNo: 42 sessionId: src_id|dd383b9c-afc96586-59371e8-d9296771_0
2025-09-30T14:55:14.898064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f27eb45-f9d984a6-adb95012-bd8b713f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dd383b9c-afc96586-59371e8-d9296771_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:14.901205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd383b9c-afc96586-59371e8-d9296771_0] Write session: try to update token
2025-09-30T14:55:14.901227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd383b9c-afc96586-59371e8-d9296771_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:14.909762Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:14.909784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:14.909787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:14.909789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:14.909799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895937237863980:5599]
2025-09-30T14:55:14.909804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895937237863980:5599]
2025-09-30T14:55:14.909808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895937237863980:5599]
2025-09-30T14:55:14.909849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:14.909852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:14.909856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:14.909857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:14.909860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:14.909861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:14.910007Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:14.924998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1804 sessionId: src_id|dd383b9c-afc96586-59371e8-d9296771_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:14.928306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:14.973912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895937327632317:7118]
2025-09-30T14:55:14.974219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1803, pipe: [1:7555895937327632317:7118]
2025-09-30T14:55:15.031531Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:15.031902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:15.031918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:15.031940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895937327632317:7118], now have 1 active actors on pipe
2025-09-30T14:55:15.032258Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:15.032260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:15.032280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:15.032336Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:15.032368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1804 reason: error at write: Disconnected sessionId: src_id|dd383b9c-afc96586-59371e8-d9296771_0
2025-09-30T14:55:15.032430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895937327632317:7118]
2025-09-30T14:55:15.032555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1804 sessionId: src_id|dd383b9c-afc96586-59371e8-d9296771_0 is DEAD
2025-09-30T14:55:15.032779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd383b9c-afc96586-59371e8-d9296771_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:15.032805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd383b9c-afc96586-59371e8-d9296771_0] Write session will restart in 0.006919s
2025-09-30T14:55:15.032839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd383b9c-afc96586-59371e8-d9296771_0] Write session: Do CDS request
2025-09-30T14:55:15.032851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd383b9c-afc96586-59371e8-d9296771_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:15.041001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd383b9c-afc96586-59371e8-d9296771_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:15.041108Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:15.041130Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1805
2025-09-30T14:55:15.041338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1805 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:15.041374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1805 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:15.041386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1805 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:15.041390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:15.042017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1805 sessionId:  describe result for acl check
2025-09-30T14:55:15.042061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:15.042070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:15.042072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:15.042078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895941622599689:7103] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:15.042642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895941622599689:7103] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:15.044461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:15.045004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895941622599689:7103] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:15.046781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:15.046999Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:15.047010Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:15.047021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:15.047075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:15.047123Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895941532831422:5597]
2025-09-30T14:55:15.047856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895941622599689:7103] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:15.047876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895941622599689:7103] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:15.047871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:15.047880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895941622599689:7103] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:15.047889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1805 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:15.048245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:15.048298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:15.048640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:15.048707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:15.048713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:15.048715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:15.048716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:15.048717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:15.048719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:15.048720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:15.048722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:15.048723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:15.048725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:15.048726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.048728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.048729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.048730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:15.048732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:15.048737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:15.048750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:15.048755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:15.048760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:15.048764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:15.048769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:15.048774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:15.048779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:15.048784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:15.048789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:15.048794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.048799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.048803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.048808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:15.048813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:15.048821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:15.048830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:15.048836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:15.048850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:15.048856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:15.048863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:15.048868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:15.048874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:15.048879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:15.048885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:15.048890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:15.048897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:15.048902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:15.048908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:15.048913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:15.048919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:15.048924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:15.048930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:15.048935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:15.048942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:15.048947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.048954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.048959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.048965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.048971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.048979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.048984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:15.048989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:15.048995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:15.049000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:15.049051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:15.058313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:15.059236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:15.059270Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:15.059275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:15.059279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:15.059288Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1804 [2:7555895941532831422:5597]
2025-09-30T14:55:15.059308Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:15.059327Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:15.059331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:15.059335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:15.059339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:15.059358Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:15.059366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:15.059374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:15.059440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.059443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.059446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.059451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:15.059454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:15.059536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:15.059539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.059555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.059569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.059589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:15.059607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895941532831417:5597]
2025-09-30T14:55:15.059616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895941532831417:5597]
2025-09-30T14:55:15.059619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895941532831417:5597]
2025-09-30T14:55:15.059632Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:15.059640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:15.059643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:15.059645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:15.059645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:15.059662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:15.059666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:15.059678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895941622599614:2454], now have 1 active actors on pipe
2025-09-30T14:55:15.059689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895941622599751:7103], now have 1 active actors on pipe
2025-09-30T14:55:15.059727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1804
2025-09-30T14:55:15.059738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1804
2025-09-30T14:55:15.059726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895941532831417:5597]
2025-09-30T14:55:15.059740Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:15.059746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:15.059947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:15.059952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:15.059979Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|639113ec-156b33c5-ca29cc5b-e64606fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:15.059987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:15.059992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:15.059994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:15.060006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:15.060016Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:15.060030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:15.060393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1805 partition: 0 MaxSeqNo: 42 sessionId: src_id|639113ec-156b33c5-ca29cc5b-e64606fa_0
2025-09-30T14:55:15.060265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:15.060274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:15.060288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:15.060924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd383b9c-afc96586-59371e8-d9296771_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|639113ec-156b33c5-ca29cc5b-e64606fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:15.064581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|639113ec-156b33c5-ca29cc5b-e64606fa_0] Write session: try to update token
2025-09-30T14:55:15.064612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|639113ec-156b33c5-ca29cc5b-e64606fa_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:15.071958Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:15.071976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:15.071979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:15.071981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:15.071994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895941532831417:5597]
2025-09-30T14:55:15.071999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895941532831417:5597]
2025-09-30T14:55:15.072003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895941532831417:5597]
2025-09-30T14:55:15.072043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:15.072051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.072055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:15.072064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:15.072077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:15.072081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:15.072194Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:15.092318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1805 sessionId: src_id|639113ec-156b33c5-ca29cc5b-e64606fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:15.095816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:15.132568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895941622599769:7118]
2025-09-30T14:55:15.132908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1804, pipe: [1:7555895941622599769:7118]
2025-09-30T14:55:15.187171Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:15.187705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:15.187718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:15.187737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895941622599769:7118], now have 1 active actors on pipe
2025-09-30T14:55:15.187954Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:15.188006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895941622599769:7118]
2025-09-30T14:55:15.188021Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:15.188047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:15.188139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1805 reason: status is not ok: tablet will be restarted right now sessionId: src_id|639113ec-156b33c5-ca29cc5b-e64606fa_0
2025-09-30T14:55:15.188348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1805 sessionId: src_id|639113ec-156b33c5-ca29cc5b-e64606fa_0 is DEAD
2025-09-30T14:55:15.188605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|639113ec-156b33c5-ca29cc5b-e64606fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:15.188619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|639113ec-156b33c5-ca29cc5b-e64606fa_0] Write session will restart in 0.008192s
2025-09-30T14:55:15.188646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|639113ec-156b33c5-ca29cc5b-e64606fa_0] Write session: Do CDS request
2025-09-30T14:55:15.188653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|639113ec-156b33c5-ca29cc5b-e64606fa_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:15.197843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|639113ec-156b33c5-ca29cc5b-e64606fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:15.198030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:15.198065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1806
2025-09-30T14:55:15.198358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1806 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:15.198401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1806 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:15.198407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1806 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:15.198411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:15.199020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1806 sessionId:  describe result for acl check
2025-09-30T14:55:15.199073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:15.199081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:15.199084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:15.199092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895941622599788:7099] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:15.199850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895941622599788:7099] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:15.202530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895941622599788:7099] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:15.212759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895941622599788:7099] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:15.212792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895941622599788:7099] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:15.212798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895941622599788:7099] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:15.212809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1806 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:15.214368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:15.218341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:15.218643Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:15.218648Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:15.218664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:15.218731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:15.218840Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895941532831564:5580]
2025-09-30T14:55:15.219709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:15.221029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:15.221098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:15.221560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:15.221650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:15.221652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:15.221653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:15.221655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:15.221657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:15.221658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:15.221660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:15.221662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:15.221665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:15.221666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:15.221668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.221670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.221672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.221674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:15.221676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:15.221685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:15.221699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:15.221704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:15.221709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:15.221714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:15.221720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:15.221725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:15.221730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:15.221736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:15.221744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:15.221748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.221754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.221758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.221763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:15.221768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:15.221780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:15.221790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:15.221798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:15.221804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:15.221814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:15.221820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:15.221826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:15.221833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:15.221840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:15.221847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:15.221853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:15.221859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:15.221866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:15.221873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:15.221879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:15.221886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:15.221892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:15.221899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:15.221906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:15.221913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:15.221920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.221926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.221932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.221938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.221944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.221951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.221957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:15.221963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:15.221969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:15.221976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:15.222037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:15.230915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:15.232369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:15.232391Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:15.232394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:15.232400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:15.232410Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1805 [2:7555895941532831564:5580]
2025-09-30T14:55:15.232435Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:15.232458Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:15.232462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:15.232466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:15.232469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:15.232493Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:15.232510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:15.232524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:15.232628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.232642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.232645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.232649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:15.232652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:15.232758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:15.232771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.232788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.232801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.232821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:15.232845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895941532831558:5580]
2025-09-30T14:55:15.232849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895941532831558:5580]
2025-09-30T14:55:15.232851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895941532831558:5580]
2025-09-30T14:55:15.232869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:15.232888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:15.232888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:15.232892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:15.232894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:15.232906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:15.232910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:15.232924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895941622599773:2454], now have 1 active actors on pipe
2025-09-30T14:55:15.232929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895941622599913:7099], now have 1 active actors on pipe
2025-09-30T14:55:15.232977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895941532831558:5580]
2025-09-30T14:55:15.232996Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:15.233022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:15.233098Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1805
2025-09-30T14:55:15.233131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1805
2025-09-30T14:55:15.233278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:15.233294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:15.233329Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf01e9e7-354ab677-502fa181-5fdb164b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:15.233345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:15.233355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:15.233358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:15.233375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:15.233391Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:15.233419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:15.233699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:15.233704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:15.233731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:15.233834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1806 partition: 0 MaxSeqNo: 42 sessionId: src_id|cf01e9e7-354ab677-502fa181-5fdb164b_0
2025-09-30T14:55:15.234348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|639113ec-156b33c5-ca29cc5b-e64606fa_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cf01e9e7-354ab677-502fa181-5fdb164b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:15.237993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf01e9e7-354ab677-502fa181-5fdb164b_0] Write session: try to update token
2025-09-30T14:55:15.238018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf01e9e7-354ab677-502fa181-5fdb164b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:15.254915Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:15.254937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:15.254940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:15.254943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:15.254955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895941532831558:5580]
2025-09-30T14:55:15.254962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895941532831558:5580]
2025-09-30T14:55:15.254967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895941532831558:5580]
2025-09-30T14:55:15.255016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:15.255020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:15.255028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.255029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:15.255036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:15.255038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:15.255227Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:15.266703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1806 sessionId: src_id|cf01e9e7-354ab677-502fa181-5fdb164b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:15.270358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:15.288281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895941622599925:7118]
2025-09-30T14:55:15.288595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1805, pipe: [1:7555895941622599925:7118]
2025-09-30T14:55:15.380124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:15.380194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:15.380197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:15.380265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1806 reason: error at write: Disconnected sessionId: src_id|cf01e9e7-354ab677-502fa181-5fdb164b_0
2025-09-30T14:55:15.379307Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:15.379754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:15.379764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:15.379803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895941622599925:7118], now have 1 active actors on pipe
2025-09-30T14:55:15.380047Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:15.380493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1806 sessionId: src_id|cf01e9e7-354ab677-502fa181-5fdb164b_0 is DEAD
2025-09-30T14:55:15.380693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf01e9e7-354ab677-502fa181-5fdb164b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:15.380705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf01e9e7-354ab677-502fa181-5fdb164b_0] Write session will restart in 0.005686s
2025-09-30T14:55:15.380685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895941622599925:7118]
2025-09-30T14:55:15.380737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf01e9e7-354ab677-502fa181-5fdb164b_0] Write session: Do CDS request
2025-09-30T14:55:15.380759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf01e9e7-354ab677-502fa181-5fdb164b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:15.389012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf01e9e7-354ab677-502fa181-5fdb164b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:15.389432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:15.389460Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1807
2025-09-30T14:55:15.389708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1807 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:15.389771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1807 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:15.389801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1807 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:15.389813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:15.390496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1807 sessionId:  describe result for acl check
2025-09-30T14:55:15.390538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:15.390546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:15.390548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:15.390555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895941622600014:7083] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:15.391407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895941622600014:7083] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:15.394182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:15.395384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895941622600014:7083] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:15.396418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:15.396632Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:15.396642Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:15.396653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:15.396719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:15.396766Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895941532831743:5582]
2025-09-30T14:55:15.397463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:15.397775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:15.397836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:15.398179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:15.398284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:15.398291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:15.398293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:15.398294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:15.398295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:15.398296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:15.398297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:15.398298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:15.398300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:15.398301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:15.398302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.398303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.398304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.398305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:15.398307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:15.398313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:15.398324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:15.398328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:15.398332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:15.398337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:15.398341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:15.398345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:15.398349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:15.398353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:15.398358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:15.398361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.398365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.398369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.398374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:15.398378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:15.398385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:15.398393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:15.398401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:15.398406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:15.398412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:15.398417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:15.398421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:15.398426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:15.398430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:15.398436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:15.398440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:15.398445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:15.398451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:15.398456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:15.398461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:15.398465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:15.398470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:15.398476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:15.398481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:15.398486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:15.398492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.398498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.398502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.398508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.398512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.398518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.398533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:15.398538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:15.398543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:15.398548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:15.398594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:15.398709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895941622600014:7083] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:15.398730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895941622600014:7083] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:15.398734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895941622600014:7083] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:15.398743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1807 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:15.404582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:15.405705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:15.405718Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:15.405722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:15.405726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:15.405733Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1806 [2:7555895941532831743:5582]
2025-09-30T14:55:15.405750Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:15.405765Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:15.405768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:15.405771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:15.405773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:15.405789Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:15.405796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:15.405802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:15.405865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.405875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.405877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.405880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:15.405883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:15.405966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:15.405974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.405989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.406006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.406027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:15.406054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895941622599941:2454], now have 1 active actors on pipe
2025-09-30T14:55:15.406062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895941622600091:7083], now have 1 active actors on pipe
2025-09-30T14:55:15.406069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895941532831738:5582]
2025-09-30T14:55:15.406071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895941532831738:5582]
2025-09-30T14:55:15.406073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895941532831738:5582]
2025-09-30T14:55:15.406088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:15.406102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:15.406108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:15.406111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:15.406114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:15.406120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:15.406124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:15.406159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895941532831738:5582]
2025-09-30T14:55:15.406170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:15.406120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1806
2025-09-30T14:55:15.406121Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1806
2025-09-30T14:55:15.406185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:15.406191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:15.406195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:15.406246Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83e98bd8-473a21a0-c7904ceb-773d1848_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:15.406259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:15.406262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:15.406266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:15.406276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:15.406291Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:15.406316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:15.406554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:15.406566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:15.406589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:15.406725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1807 partition: 0 MaxSeqNo: 42 sessionId: src_id|83e98bd8-473a21a0-c7904ceb-773d1848_0
2025-09-30T14:55:15.407180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf01e9e7-354ab677-502fa181-5fdb164b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|83e98bd8-473a21a0-c7904ceb-773d1848_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:15.410664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83e98bd8-473a21a0-c7904ceb-773d1848_0] Write session: try to update token
2025-09-30T14:55:15.410690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83e98bd8-473a21a0-c7904ceb-773d1848_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:15.419463Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:15.419481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:15.419483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:15.419485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:15.419496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895941532831738:5582]
2025-09-30T14:55:15.419501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895941532831738:5582]
2025-09-30T14:55:15.419508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895941532831738:5582]
2025-09-30T14:55:15.419551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:15.419560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.419563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:15.419709Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:15.419831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:15.419838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:15.419842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:15.431389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1807 sessionId: src_id|83e98bd8-473a21a0-c7904ceb-773d1848_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:15.434281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:15.481212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895941622600101:7118]
2025-09-30T14:55:15.481548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1806, pipe: [1:7555895941622600101:7118]
2025-09-30T14:55:15.535137Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:15.535545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:15.535564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:15.535587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895941622600101:7118], now have 1 active actors on pipe
2025-09-30T14:55:15.535810Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:15.535840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:15.535845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:15.535824Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:15.535889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895941622600101:7118]
2025-09-30T14:55:15.535916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1807 reason: error at write: Disconnected sessionId: src_id|83e98bd8-473a21a0-c7904ceb-773d1848_0
2025-09-30T14:55:15.536113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1807 sessionId: src_id|83e98bd8-473a21a0-c7904ceb-773d1848_0 is DEAD
2025-09-30T14:55:15.536363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83e98bd8-473a21a0-c7904ceb-773d1848_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:15.536381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83e98bd8-473a21a0-c7904ceb-773d1848_0] Write session will restart in 0.006503s
2025-09-30T14:55:15.536432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83e98bd8-473a21a0-c7904ceb-773d1848_0] Write session: Do CDS request
2025-09-30T14:55:15.536443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83e98bd8-473a21a0-c7904ceb-773d1848_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:15.543958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83e98bd8-473a21a0-c7904ceb-773d1848_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:15.544074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:15.544100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1808
2025-09-30T14:55:15.544256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1808 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:15.544300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1808 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:15.544315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1808 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:15.544321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:15.544884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1808 sessionId:  describe result for acl check
2025-09-30T14:55:15.544937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:15.544946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:15.544948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:15.544957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895941622600157:7076] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:15.545648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895941622600157:7076] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:15.547907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895941622600157:7076] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:15.551914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:15.552057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895941622600157:7076] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:15.552083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895941622600157:7076] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:15.552088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895941622600157:7076] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:15.552099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1808 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:15.554902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:15.555146Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:15.555155Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:15.555169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:15.555230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:15.555292Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895941532831887:5572]
2025-09-30T14:55:15.556002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:15.556405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:15.556465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:15.556794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:15.556853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:15.556860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:15.556860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:15.556861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:15.556862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:15.556863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:15.556864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:15.556865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:15.556865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:15.556866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:15.556867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.556868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.556869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.556870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:15.556871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:15.556877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:15.556886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:15.556890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:15.556894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:15.556897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:15.556901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:15.556905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:15.556909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:15.556913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:15.556917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:15.556921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.556925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.556928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.556932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:15.556936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:15.556947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:15.556955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:15.556959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:15.556963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:15.556966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:15.556970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:15.556972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:15.556976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:15.556982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:15.556988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:15.556993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:15.556999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:15.557004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:15.557010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:15.557014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:15.557020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:15.557025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:15.557028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:15.557030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:15.557033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:15.557037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.557040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.557043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.557047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.557049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.557052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.557055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:15.557059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:15.557062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:15.557067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:15.557092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:15.563441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:15.564414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:15.564431Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:15.564434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:15.564438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:15.564446Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1807 [2:7555895941532831887:5572]
2025-09-30T14:55:15.564468Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:15.564485Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:15.564488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:15.564492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:15.564495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:15.564514Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:15.564525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:15.564537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:15.564603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.564615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.564617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.564621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:15.564625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:15.564730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:15.564739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.564753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.564764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.564783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:15.564808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895941532831881:5572]
2025-09-30T14:55:15.564815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895941532831881:5572]
2025-09-30T14:55:15.564818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895941532831881:5572]
2025-09-30T14:55:15.564834Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:15.564844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:15.564851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895941622600102:2454], now have 1 active actors on pipe
2025-09-30T14:55:15.564854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:15.564855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895941622600241:7076], now have 1 active actors on pipe
2025-09-30T14:55:15.564857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:15.564864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:15.564881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:15.564890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:15.564930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895941532831881:5572]
2025-09-30T14:55:15.564941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:15.564947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:15.564976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1807
2025-09-30T14:55:15.565031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1807
2025-09-30T14:55:15.565191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:15.565201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:15.565232Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c7bbbe7-5f0c0e48-1257853d-97dd437d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:15.565245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:15.565253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:15.565255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:15.565268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:15.565280Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:15.565300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:15.565489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:15.565499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:15.565514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:15.565714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1808 partition: 0 MaxSeqNo: 42 sessionId: src_id|6c7bbbe7-5f0c0e48-1257853d-97dd437d_0
2025-09-30T14:55:15.566197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83e98bd8-473a21a0-c7904ceb-773d1848_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6c7bbbe7-5f0c0e48-1257853d-97dd437d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:15.570001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c7bbbe7-5f0c0e48-1257853d-97dd437d_0] Write session: try to update token
2025-09-30T14:55:15.570030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c7bbbe7-5f0c0e48-1257853d-97dd437d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:15.585053Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:15.585078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:15.585089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895941532831881:5572]
2025-09-30T14:55:15.585138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:15.585151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:15.585448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:15.585625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:15.585803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:15.585972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:15.586233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:15.586284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:15.591439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1808 sessionId: src_id|6c7bbbe7-5f0c0e48-1257853d-97dd437d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:15.594871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:15.594603Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:15.594626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:15.594629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:15.594631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:15.594642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895941532831881:5572]
2025-09-30T14:55:15.594646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895941532831881:5572]
2025-09-30T14:55:15.594651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895941532831881:5572]
2025-09-30T14:55:15.594697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:15.594706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.594710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:15.594724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:15.594734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:15.594740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:15.594871Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:15.635895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895941622600256:7118]
2025-09-30T14:55:15.636224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1807, pipe: [1:7555895941622600256:7118]
2025-09-30T14:55:15.720038Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:15.720475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:15.720487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:15.720508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895941622600256:7118], now have 1 active actors on pipe
2025-09-30T14:55:15.721133Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:15.721605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c7bbbe7-5f0c0e48-1257853d-97dd437d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:15.721621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c7bbbe7-5f0c0e48-1257853d-97dd437d_0] Write session will restart in 0.009919s
2025-09-30T14:55:15.721669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c7bbbe7-5f0c0e48-1257853d-97dd437d_0] Write session: Do CDS request
2025-09-30T14:55:15.721677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c7bbbe7-5f0c0e48-1257853d-97dd437d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:15.721062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:15.721077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:15.721094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:15.721160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1808 reason: error at write: Disconnected sessionId: src_id|6c7bbbe7-5f0c0e48-1257853d-97dd437d_0
2025-09-30T14:55:15.721162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895941622600256:7118]
2025-09-30T14:55:15.721356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1808 sessionId: src_id|6c7bbbe7-5f0c0e48-1257853d-97dd437d_0 is DEAD
2025-09-30T14:55:15.733952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c7bbbe7-5f0c0e48-1257853d-97dd437d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:15.734078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:15.734107Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1809
2025-09-30T14:55:15.734333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1809 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:15.734369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1809 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:15.734378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1809 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:15.734381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:15.735048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1809 sessionId:  describe result for acl check
2025-09-30T14:55:15.735087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:15.735097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:15.735099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:15.735108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895941622600314:7071] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:15.735690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895941622600314:7071] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:15.740171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895941622600314:7071] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:15.746557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895941622600314:7071] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:15.746579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895941622600314:7071] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:15.746582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895941622600314:7071] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:15.746591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1809 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:15.747513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:15.748719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:15.748906Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:15.748910Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:15.748920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:15.748973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:15.749012Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895941532832043:5568]
2025-09-30T14:55:15.749706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:15.750261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:15.750311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:15.750718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:15.750787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:15.750789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:15.750790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:15.750792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:15.750794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:15.750795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:15.750797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:15.750798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:15.750799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:15.750801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:15.750802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.750804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.750805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.750806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:15.750808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:15.750813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:15.750825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:15.750829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:15.750833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:15.750838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:15.750842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:15.750847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:15.750851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:15.750855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:15.750859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:15.750863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.750868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.750871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.750875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:15.750880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:15.750889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:15.750897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:15.750903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:15.750909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:15.750915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:15.750922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:15.750927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:15.750932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:15.750937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:15.750942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:15.750947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:15.750953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:15.750959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:15.750964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:15.750969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:15.750973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:15.750978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:15.750984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:15.750987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:15.750992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:15.750997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.751002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.751008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.751015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.751020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.751025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.751029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:15.751035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:15.751040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:15.751045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:15.751089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:15.759828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:15.760719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:15.760734Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:15.760738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:15.760742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:15.760751Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1808 [2:7555895941532832043:5568]
2025-09-30T14:55:15.760769Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:15.760786Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:15.760790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:15.760793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:15.760796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:15.760814Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:15.760821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:15.760828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:15.760892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.760895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.760897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.760901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:15.760904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:15.762672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1808
2025-09-30T14:55:15.760978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:15.762713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1808
2025-09-30T14:55:15.760984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.760997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.761010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.761030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:15.761047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895941532832037:5568]
2025-09-30T14:55:15.761050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895941532832037:5568]
2025-09-30T14:55:15.761052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895941532832037:5568]
2025-09-30T14:55:15.761065Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:15.761078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:15.761095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:15.761098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:15.761132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895941532832037:5568]
2025-09-30T14:55:15.761135Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:15.762310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:15.762314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:15.762317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:15.762324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:15.762588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895941622600409:7071], now have 1 active actors on pipe
2025-09-30T14:55:15.762594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895941622600270:2454], now have 1 active actors on pipe
2025-09-30T14:55:15.762860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:15.762875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:15.762907Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da89bac8-45114bdb-264ca041-d844d1ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:15.762918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:15.762923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:15.762926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:15.762938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:15.762952Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:15.762970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:15.763418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:15.763430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:15.763454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:15.763958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1809 partition: 0 MaxSeqNo: 42 sessionId: src_id|da89bac8-45114bdb-264ca041-d844d1ea_0
2025-09-30T14:55:15.764697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c7bbbe7-5f0c0e48-1257853d-97dd437d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|da89bac8-45114bdb-264ca041-d844d1ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:15.768273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da89bac8-45114bdb-264ca041-d844d1ea_0] Write session: try to update token
2025-09-30T14:55:15.768298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da89bac8-45114bdb-264ca041-d844d1ea_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:15.776500Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:15.776518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:15.776521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:15.776524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:15.776534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895941532832037:5568]
2025-09-30T14:55:15.776539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895941532832037:5568]
2025-09-30T14:55:15.776543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895941532832037:5568]
2025-09-30T14:55:15.776585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:15.776593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.776593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:15.776596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:15.776600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:15.776614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:15.776735Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:15.796791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1809 sessionId: src_id|da89bac8-45114bdb-264ca041-d844d1ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:15.799548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:15.819719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895941622600423:7118]
2025-09-30T14:55:15.820070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1808, pipe: [1:7555895941622600423:7118]
2025-09-30T14:55:15.890796Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:15.891349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:15.891366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:15.891382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895941622600423:7118], now have 1 active actors on pipe
2025-09-30T14:55:15.891562Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:15.891606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:15.891619Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:15.891625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:15.891675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895941622600423:7118]
2025-09-30T14:55:15.891695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1809 reason: error at write: Disconnected sessionId: src_id|da89bac8-45114bdb-264ca041-d844d1ea_0
2025-09-30T14:55:15.891892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1809 sessionId: src_id|da89bac8-45114bdb-264ca041-d844d1ea_0 is DEAD
2025-09-30T14:55:15.892118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da89bac8-45114bdb-264ca041-d844d1ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:15.892134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da89bac8-45114bdb-264ca041-d844d1ea_0] Write session will restart in 0.007061s
2025-09-30T14:55:15.892165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da89bac8-45114bdb-264ca041-d844d1ea_0] Write session: Do CDS request
2025-09-30T14:55:15.892175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da89bac8-45114bdb-264ca041-d844d1ea_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:15.900903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da89bac8-45114bdb-264ca041-d844d1ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:15.900965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:15.900982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1810
2025-09-30T14:55:15.901212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1810 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:15.901250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1810 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:15.901255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1810 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:15.901259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:15.901676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1810 sessionId:  describe result for acl check
2025-09-30T14:55:15.901711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:15.901718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:15.901720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:15.901726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895941622600528:7067] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:15.902242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895941622600528:7067] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:15.903411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:15.904441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895941622600528:7067] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:15.905380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:15.905594Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:15.905605Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:15.905616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:15.905683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:15.905723Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895941532832189:5550]
2025-09-30T14:55:15.906399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:15.906679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:15.906728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:15.907085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:15.907137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:15.907142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:15.907143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:15.907143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:15.907144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:15.907145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:15.907146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:15.907147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:15.907148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:15.907149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:15.907154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895941622600528:7067] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:15.907150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.907182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895941622600528:7067] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:15.907150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.907187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895941622600528:7067] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:15.907151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.907199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1810 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:15.907152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:15.907153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:15.907157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:15.907167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:15.907172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:15.907176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:15.907179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:15.907183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:15.907187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:15.907192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:15.907196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:15.907200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:15.907202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.907206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.907210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.907214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:15.907217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:15.907225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:15.907232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:15.907238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:15.907257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:15.907262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:15.907267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:15.907271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:15.907276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:15.907280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:15.907285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:15.907289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:15.907295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:15.907300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:15.907306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:15.907310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:15.907314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:15.907317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:15.907319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:15.907322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:15.907325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:15.907328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.907331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.907336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.907341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.907347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.907353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.907357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:15.907362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:15.907367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:15.907371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:15.907412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:15.913163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:15.914373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:15.914391Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:15.914394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:15.914398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:15.914405Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1809 [2:7555895941532832189:5550]
2025-09-30T14:55:15.914424Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:15.914440Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:15.914444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:15.914447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:15.914450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:15.914467Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:15.914482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:15.914489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:15.914549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.914556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.914559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.914562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:15.914565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:15.914644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:15.914655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.914668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:15.914681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:15.914700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:15.914717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895941622600424:2454], now have 1 active actors on pipe
2025-09-30T14:55:15.914721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895941622600568:7067], now have 1 active actors on pipe
2025-09-30T14:55:15.914727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895941532832183:5550]
2025-09-30T14:55:15.914730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895941532832183:5550]
2025-09-30T14:55:15.914732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895941532832183:5550]
2025-09-30T14:55:15.914745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:15.914758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:15.914759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:15.914761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:15.914763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:15.914773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:15.914776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:15.914783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1809
2025-09-30T14:55:15.914812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895941532832183:5550]
2025-09-30T14:55:15.914794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1809
2025-09-30T14:55:15.914820Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:15.914828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:15.914849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:15.914855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:15.914885Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e635b42-3e4352a8-f84f913-d04da5c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:15.914898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:15.914902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:15.914904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:15.914914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:15.914928Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:15.914952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:15.915072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:15.915080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:15.915093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:15.915178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1810 partition: 0 MaxSeqNo: 42 sessionId: src_id|5e635b42-3e4352a8-f84f913-d04da5c4_0
2025-09-30T14:55:15.915590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da89bac8-45114bdb-264ca041-d844d1ea_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5e635b42-3e4352a8-f84f913-d04da5c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:15.918986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e635b42-3e4352a8-f84f913-d04da5c4_0] Write session: try to update token
2025-09-30T14:55:15.919008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e635b42-3e4352a8-f84f913-d04da5c4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:15.927406Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:15.927423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:15.927426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:15.927428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:15.927440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895941532832183:5550]
2025-09-30T14:55:15.927444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895941532832183:5550]
2025-09-30T14:55:15.927450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895941532832183:5550]
2025-09-30T14:55:15.927491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:15.927497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:15.927501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:15.927504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:15.927510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:15.927514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:15.927728Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:15.940091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1810 sessionId: src_id|5e635b42-3e4352a8-f84f913-d04da5c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:15.943676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:15.991765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895941622600578:7118]
2025-09-30T14:55:15.992137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1809, pipe: [1:7555895941622600578:7118]
2025-09-30T14:55:16.044040Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:16.044442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:16.044458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:16.044479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895941622600578:7118], now have 1 active actors on pipe
2025-09-30T14:55:16.044730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:16.044735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895941622600578:7118]
2025-09-30T14:55:16.044749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:16.044765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:16.044876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1810 reason: error at write: Disconnected sessionId: src_id|5e635b42-3e4352a8-f84f913-d04da5c4_0
2025-09-30T14:55:16.045201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e635b42-3e4352a8-f84f913-d04da5c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:16.045210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e635b42-3e4352a8-f84f913-d04da5c4_0] Write session will restart in 0.009915s
2025-09-30T14:55:16.045251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e635b42-3e4352a8-f84f913-d04da5c4_0] Write session: Do CDS request
2025-09-30T14:55:16.045258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e635b42-3e4352a8-f84f913-d04da5c4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:16.045072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1810 sessionId: src_id|5e635b42-3e4352a8-f84f913-d04da5c4_0 is DEAD
2025-09-30T14:55:16.044943Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:16.056853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e635b42-3e4352a8-f84f913-d04da5c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:16.056924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:16.056943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1811
2025-09-30T14:55:16.057064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1811 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:16.057092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1811 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:16.057097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1811 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:16.057102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:16.057506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1811 sessionId:  describe result for acl check
2025-09-30T14:55:16.057532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:16.057534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:16.057536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:16.057542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895945917567983:7063] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:16.058103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895945917567983:7063] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:16.060000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:16.060356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895945917567983:7063] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:16.062481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:16.062710Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:16.062719Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:16.062731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:16.062784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:16.062828Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895945827799631:5563]
2025-09-30T14:55:16.063169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895945917567983:7063] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:16.063187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895945917567983:7063] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:16.063191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895945917567983:7063] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:16.063200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1811 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:16.063508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:16.063794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:16.063835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:16.064155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:16.064230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:16.064236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:16.064237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:16.064238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:16.064239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:16.064240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:16.064242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:16.064243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:16.064244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:16.064245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:16.064246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.064248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.064249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.064251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:16.064252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:16.064258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:16.064268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:16.064273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:16.064278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:16.064283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:16.064287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:16.064291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:16.064295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:16.064299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:16.064303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:16.064307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.064311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.064315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.064318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:16.064321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:16.064329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:16.064338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:16.064344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:16.064349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:16.064353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:16.064361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:16.064365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:16.064370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:16.064375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:16.064380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:16.064385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:16.064390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:16.064394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:16.064399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:16.064404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:16.064408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:16.064414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:16.064419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:16.064424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:16.064429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:16.064436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.064447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.064451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.064458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.064467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.064471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.064475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:16.064486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:16.064493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:16.064503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:16.064545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:16.070376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:16.071367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:16.071386Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:16.071390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:16.071395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:16.071402Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1810 [2:7555895945827799631:5563]
2025-09-30T14:55:16.071422Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:16.071442Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:16.071445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:16.071448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:16.071451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:16.071470Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:16.071485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:16.071492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:16.071571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.071581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.071584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.071588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:16.071590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:16.071739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:16.071751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.071766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.071779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.071796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:16.071819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895945917567875:2454], now have 1 active actors on pipe
2025-09-30T14:55:16.071828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895945917568018:7063], now have 1 active actors on pipe
2025-09-30T14:55:16.071835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895945827799626:5563]
2025-09-30T14:55:16.071838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895945827799626:5563]
2025-09-30T14:55:16.071841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895945827799626:5563]
2025-09-30T14:55:16.071854Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:16.071869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:16.071828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1810
2025-09-30T14:55:16.071871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:16.071875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:16.071838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1810
2025-09-30T14:55:16.071878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:16.071890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:16.071894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:16.071947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:16.071960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:16.071973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895945827799626:5563]
2025-09-30T14:55:16.071989Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:16.072018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:16.072023Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b060c01-54fcd5ee-bb112b2d-1e370052_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:16.072031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:16.072035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:16.072038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:16.072049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:16.072060Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:16.072089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:16.072580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:16.072594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:16.072619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:16.072701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1811 partition: 0 MaxSeqNo: 42 sessionId: src_id|9b060c01-54fcd5ee-bb112b2d-1e370052_0
2025-09-30T14:55:16.073104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e635b42-3e4352a8-f84f913-d04da5c4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9b060c01-54fcd5ee-bb112b2d-1e370052_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:16.076545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b060c01-54fcd5ee-bb112b2d-1e370052_0] Write session: try to update token
2025-09-30T14:55:16.076571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b060c01-54fcd5ee-bb112b2d-1e370052_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:16.085304Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:16.085325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:16.085328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:16.085330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:16.085342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895945827799626:5563]
2025-09-30T14:55:16.085346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895945827799626:5563]
2025-09-30T14:55:16.085351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895945827799626:5563]
2025-09-30T14:55:16.085392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:16.085399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:16.085401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.085405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:16.085406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:16.085411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:16.085571Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:16.092784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1811 sessionId: src_id|9b060c01-54fcd5ee-bb112b2d-1e370052_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:16.096212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:16.144828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895945917568035:7118]
2025-09-30T14:55:16.145308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1810, pipe: [1:7555895945917568035:7118]
2025-09-30T14:55:16.205541Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:16.206144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:16.206161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:16.206180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895945917568035:7118], now have 1 active actors on pipe
2025-09-30T14:55:16.206432Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:16.206450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895945917568035:7118]
2025-09-30T14:55:16.206488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:16.206491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:16.206559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1811 reason: error at write: Disconnected sessionId: src_id|9b060c01-54fcd5ee-bb112b2d-1e370052_0
2025-09-30T14:55:16.206767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1811 sessionId: src_id|9b060c01-54fcd5ee-bb112b2d-1e370052_0 is DEAD
2025-09-30T14:55:16.206918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b060c01-54fcd5ee-bb112b2d-1e370052_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:16.206930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b060c01-54fcd5ee-bb112b2d-1e370052_0] Write session will restart in 0.006254s
2025-09-30T14:55:16.206974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b060c01-54fcd5ee-bb112b2d-1e370052_0] Write session: Do CDS request
2025-09-30T14:55:16.206980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b060c01-54fcd5ee-bb112b2d-1e370052_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:16.207464Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:16.214845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b060c01-54fcd5ee-bb112b2d-1e370052_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:16.214857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:16.214887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1812
2025-09-30T14:55:16.215105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1812 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:16.215147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1812 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:16.215158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1812 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:16.215163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:16.215674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1812 sessionId:  describe result for acl check
2025-09-30T14:55:16.215711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:16.215719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:16.215721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:16.215729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895945917568052:7052] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:16.216298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895945917568052:7052] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:16.219824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895945917568052:7052] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:16.223476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895945917568052:7052] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:16.223493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895945917568052:7052] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:16.223496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895945917568052:7052] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:16.223503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1812 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:16.226830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:16.227267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:16.227483Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:16.227494Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:16.227506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:16.227569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:16.227603Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895945827799779:5561]
2025-09-30T14:55:16.228260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:16.229302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:16.229375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:16.229753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:16.229840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:16.229847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:16.229848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:16.229850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:16.229851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:16.229852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:16.229853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:16.229854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:16.229855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:16.229856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:16.229857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.229858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.229859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.229860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:16.229862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:16.229868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:16.229878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:16.229881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:16.229885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:16.229888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:16.229892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:16.229895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:16.229899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:16.229902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:16.229906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:16.229910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.229914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.229918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.229921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:16.229926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:16.229936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:16.229950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:16.229960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:16.229965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:16.229973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:16.229979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:16.229987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:16.229991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:16.230001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:16.230010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:16.230014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:16.230024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:16.230034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:16.230039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:16.230045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:16.230054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:16.230059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:16.230065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:16.230074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:16.230079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:16.230083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.230088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.230097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.230102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.230112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.230121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.230130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:16.230137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:16.230147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:16.230152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:16.230202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:16.236404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:16.237589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:16.237604Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:16.237606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:16.237609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:16.237616Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1811 [2:7555895945827799779:5561]
2025-09-30T14:55:16.237646Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:16.237660Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:16.237662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:16.237664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:16.237666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:16.237679Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:16.237685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:16.237691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:16.237748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.237756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.237759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.237763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:16.237765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:16.237842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:16.237851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.237865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.237880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.237901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:16.237923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895945827799773:5561]
2025-09-30T14:55:16.237930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895945827799773:5561]
2025-09-30T14:55:16.237932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895945827799773:5561]
2025-09-30T14:55:16.237947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:16.237966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:16.237982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:16.237986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:16.238019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:16.238022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895945827799773:5561]
2025-09-30T14:55:16.238025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:16.238029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:16.238031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:16.238038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:16.238280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1811
2025-09-30T14:55:16.238292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1811
2025-09-30T14:55:16.238165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895945917568169:7052], now have 1 active actors on pipe
2025-09-30T14:55:16.238180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895945917568039:2454], now have 1 active actors on pipe
2025-09-30T14:55:16.238445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:16.238464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:16.238502Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|21f4677b-fecc6d91-93b96de6-2583fff0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:16.238513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:16.238518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:16.238530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:16.238542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:16.238554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:16.238571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:16.243496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:16.243507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:16.243542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:16.243808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1812 partition: 0 MaxSeqNo: 42 sessionId: src_id|21f4677b-fecc6d91-93b96de6-2583fff0_0
2025-09-30T14:55:16.244226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b060c01-54fcd5ee-bb112b2d-1e370052_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|21f4677b-fecc6d91-93b96de6-2583fff0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:16.247141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21f4677b-fecc6d91-93b96de6-2583fff0_0] Write session: try to update token
2025-09-30T14:55:16.247162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21f4677b-fecc6d91-93b96de6-2583fff0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:16.251482Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:16.251503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:16.251514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895945827799773:5561]
2025-09-30T14:55:16.251559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:16.251563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:16.251737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:16.251894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:16.252031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:16.252185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:16.252377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:16.252421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:16.262601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1812 sessionId: src_id|21f4677b-fecc6d91-93b96de6-2583fff0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:16.262872Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:16.262894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:16.262897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:16.262899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:16.262909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895945827799773:5561]
2025-09-30T14:55:16.262913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895945827799773:5561]
2025-09-30T14:55:16.262917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895945827799773:5561]
2025-09-30T14:55:16.262960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:16.262967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.262970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:16.262972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:16.262980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:16.262984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:16.263107Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:16.265337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:16.306603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895945917568195:7118]
2025-09-30T14:55:16.306849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1811, pipe: [1:7555895945917568195:7118]
2025-09-30T14:55:16.380738Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:16.381181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:16.381200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:16.381223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895945917568195:7118], now have 1 active actors on pipe
2025-09-30T14:55:16.381477Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:16.381541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:16.381545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:16.381550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895945917568195:7118]
2025-09-30T14:55:16.381611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1812 reason: error at write: Disconnected sessionId: src_id|21f4677b-fecc6d91-93b96de6-2583fff0_0
2025-09-30T14:55:16.381435Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:16.381817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1812 sessionId: src_id|21f4677b-fecc6d91-93b96de6-2583fff0_0 is DEAD
2025-09-30T14:55:16.382550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21f4677b-fecc6d91-93b96de6-2583fff0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:16.382561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21f4677b-fecc6d91-93b96de6-2583fff0_0] Write session will restart in 0.008875s
2025-09-30T14:55:16.382585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21f4677b-fecc6d91-93b96de6-2583fff0_0] Write session: Do CDS request
2025-09-30T14:55:16.382592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21f4677b-fecc6d91-93b96de6-2583fff0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:16.392882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21f4677b-fecc6d91-93b96de6-2583fff0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:16.392954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:16.392974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1813
2025-09-30T14:55:16.393763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1813 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:16.393812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1813 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:16.393818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1813 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:16.393823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:16.394262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1813 sessionId:  describe result for acl check
2025-09-30T14:55:16.394295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:16.394299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:16.394302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:16.394308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895945917568249:7049] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:16.394890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895945917568249:7049] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:16.397540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895945917568249:7049] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:16.398750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:16.401261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:16.401565Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:16.401579Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:16.401594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:16.401688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:16.401734Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895945827799942:5558]
2025-09-30T14:55:16.402435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:16.402969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:16.403041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:16.403442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:16.403507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:16.403514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:16.403516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:16.403517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:16.403518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:16.403520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:16.403521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:16.403523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:16.403524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:16.403525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:16.403527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.403532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.403533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.403534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:16.403535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:16.403542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:16.403552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:16.403557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:16.403562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:16.403567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:16.403571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:16.403575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:16.403580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:16.403584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:16.403589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:16.403594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.403598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.403603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.403607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:16.403611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:16.403618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:16.403627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:16.403634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:16.403640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:16.403645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:16.403651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:16.403656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:16.403662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:16.403667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:16.403673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:16.403678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:16.403684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:16.403690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:16.403703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:16.403708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:16.403714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:16.403719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:16.403725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:16.403729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:16.403735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:16.403740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.403747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.403751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.403757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.403762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.403767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.403772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:16.403778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:16.403791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:16.403797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:16.403842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:16.403852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895945917568249:7049] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:16.403872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895945917568249:7049] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:16.403875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895945917568249:7049] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:16.403886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1813 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:16.410884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:16.411926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:16.411946Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:16.411949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:16.411953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:16.411960Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1812 [2:7555895945827799942:5558]
2025-09-30T14:55:16.411977Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:16.411992Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:16.411995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:16.411998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:16.412001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:16.412019Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:16.412030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:16.412037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:16.412097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.412106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.412109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.412113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:16.412116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:16.412192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:16.412204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.412218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.412232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.412251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:16.412354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1812
2025-09-30T14:55:16.412410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1812
2025-09-30T14:55:16.412274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895945827799937:5558]
2025-09-30T14:55:16.412281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895945827799937:5558]
2025-09-30T14:55:16.412283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895945827799937:5558]
2025-09-30T14:55:16.412292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:16.412302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:16.412305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:16.412307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:16.412308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895945917568196:2454], now have 1 active actors on pipe
2025-09-30T14:55:16.412312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895945917568356:7049], now have 1 active actors on pipe
2025-09-30T14:55:16.412320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:16.412335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:16.412338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:16.412375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895945827799937:5558]
2025-09-30T14:55:16.412378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:16.412391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:16.412415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:16.412420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:16.412511Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51407e0-9cdfd01c-d868efe6-51ed91a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:16.412519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:16.412522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:16.412524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:16.412534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:16.412543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:16.412558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:16.412789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:16.412807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:16.412832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:16.412962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1813 partition: 0 MaxSeqNo: 42 sessionId: src_id|51407e0-9cdfd01c-d868efe6-51ed91a4_0
2025-09-30T14:55:16.413351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21f4677b-fecc6d91-93b96de6-2583fff0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|51407e0-9cdfd01c-d868efe6-51ed91a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:16.416306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51407e0-9cdfd01c-d868efe6-51ed91a4_0] Write session: try to update token
2025-09-30T14:55:16.416327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51407e0-9cdfd01c-d868efe6-51ed91a4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:16.427507Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:16.427525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:16.427528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:16.427529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:16.427539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895945827799937:5558]
2025-09-30T14:55:16.427543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895945827799937:5558]
2025-09-30T14:55:16.427546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895945827799937:5558]
2025-09-30T14:55:16.427589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:16.427597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.427600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:16.427762Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:16.430609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:16.430627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:16.430631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:16.437478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1813 sessionId: src_id|51407e0-9cdfd01c-d868efe6-51ed91a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:16.440504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:16.481206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895945917568376:7118]
2025-09-30T14:55:16.481551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1812, pipe: [1:7555895945917568376:7118]
2025-09-30T14:55:16.543196Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:16.543665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:16.543683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:16.543704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895945917568376:7118], now have 1 active actors on pipe
2025-09-30T14:55:16.543968Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:16.544012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:16.543998Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:16.544016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:16.544027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895945917568376:7118]
2025-09-30T14:55:16.544095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1813 reason: error at write: Disconnected sessionId: src_id|51407e0-9cdfd01c-d868efe6-51ed91a4_0
2025-09-30T14:55:16.544296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1813 sessionId: src_id|51407e0-9cdfd01c-d868efe6-51ed91a4_0 is DEAD
2025-09-30T14:55:16.544448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51407e0-9cdfd01c-d868efe6-51ed91a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:16.544461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51407e0-9cdfd01c-d868efe6-51ed91a4_0] Write session will restart in 0.008333s
2025-09-30T14:55:16.544487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51407e0-9cdfd01c-d868efe6-51ed91a4_0] Write session: Do CDS request
2025-09-30T14:55:16.544493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51407e0-9cdfd01c-d868efe6-51ed91a4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:16.553805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51407e0-9cdfd01c-d868efe6-51ed91a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:16.553889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:16.553909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1814
2025-09-30T14:55:16.554050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1814 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:16.554094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1814 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:16.554100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1814 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:16.554104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:16.554624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1814 sessionId:  describe result for acl check
2025-09-30T14:55:16.554666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:16.554674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:16.554677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:16.554684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895945917568476:7033] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:16.555478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895945917568476:7033] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:16.556615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:16.557699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895945917568476:7033] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:16.558955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:16.559193Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:16.559203Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:16.559215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:16.559307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:16.559357Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895945827800114:5537]
2025-09-30T14:55:16.560042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:16.560331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:16.560375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:16.560717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:16.560780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:16.560791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:16.560792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:16.560793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:16.560795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:16.560796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:16.560797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:16.560799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:16.560800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:16.560802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:16.560803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.560804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.560805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.560806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:16.560807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:16.560813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:16.560824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:16.560830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:16.560834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:16.560838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:16.560842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:16.560846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:16.560851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:16.560855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:16.560860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:16.560864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.560868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.560872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.560877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:16.560881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:16.560888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:16.560897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:16.560904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:16.560910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:16.560916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:16.560921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:16.560925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:16.560931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:16.560937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:16.560942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:16.560947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:16.560952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:16.560957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:16.560963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:16.560967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:16.560973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:16.560983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:16.560988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:16.560993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:16.560999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:16.560979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895945917568476:7033] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:16.561004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.560999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895945917568476:7033] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:16.561010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.561003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895945917568476:7033] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:16.561014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.561011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1814 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:16.561020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.561024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.561030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.561034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:16.561040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:16.561045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:16.561050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:16.561099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:16.566997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:16.568043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:16.568062Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:16.568065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:16.568070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:16.568078Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1813 [2:7555895945827800114:5537]
2025-09-30T14:55:16.568097Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:16.568114Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:16.568123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:16.568126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:16.568129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:16.568144Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:16.568157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:16.568169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:16.568236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.568247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.568250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.568253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:16.568256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:16.568329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:16.568332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.568347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.568361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.568381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:16.568401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895945917568525:7033], now have 1 active actors on pipe
2025-09-30T14:55:16.568409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895945827800109:5537]
2025-09-30T14:55:16.568412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895945827800109:5537]
2025-09-30T14:55:16.568414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895945827800109:5537]
2025-09-30T14:55:16.568423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:16.568437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895945917568377:2454], now have 1 active actors on pipe
2025-09-30T14:55:16.568436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:16.568440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:16.568443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:16.568446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:16.568524Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1813
2025-09-30T14:55:16.568524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1813
2025-09-30T14:55:16.568461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:16.568465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:16.568498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895945827800109:5537]
2025-09-30T14:55:16.568507Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:16.568515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:16.568770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:16.568783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:16.568811Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a2e2a43-1e44d302-8e7ad5b1-e8445df4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:16.568824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:16.568833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:16.568836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:16.568847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:16.568859Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:16.568879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:16.569095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:16.569110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:16.569126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:16.569258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1814 partition: 0 MaxSeqNo: 42 sessionId: src_id|3a2e2a43-1e44d302-8e7ad5b1-e8445df4_0
2025-09-30T14:55:16.569655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51407e0-9cdfd01c-d868efe6-51ed91a4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3a2e2a43-1e44d302-8e7ad5b1-e8445df4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:16.572559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a2e2a43-1e44d302-8e7ad5b1-e8445df4_0] Write session: try to update token
2025-09-30T14:55:16.572580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a2e2a43-1e44d302-8e7ad5b1-e8445df4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:16.589099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1814 sessionId: src_id|3a2e2a43-1e44d302-8e7ad5b1-e8445df4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:16.589189Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:16.589208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:16.589218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895945827800109:5537]
2025-09-30T14:55:16.589261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:16.589268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:16.589462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:16.589611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:16.589774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:16.589917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:16.590123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:16.590162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:16.591988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:16.592188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:16.592218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:16.592252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:16.592330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:16.595482Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:16.595502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:16.595505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:16.595508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:16.595517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895945827800109:5537]
2025-09-30T14:55:16.595522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895945827800109:5537]
2025-09-30T14:55:16.595526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895945827800109:5537]
2025-09-30T14:55:16.595567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:16.595574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.595574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:16.595576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:16.595582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:16.595587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:16.595713Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:16.644022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895945917568537:7118]
2025-09-30T14:55:16.644378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1813, pipe: [1:7555895945917568537:7118]
2025-09-30T14:55:16.717516Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:16.726611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:16.726647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:16.726855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:16.726933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:16.727009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:16.727092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:16.727365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:16.727380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:16.727458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:16.727527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:16.727599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:16.727674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:16.727722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:16.727731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:16.727806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:16.727878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:16.727949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:16.728018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:16.728067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:16.728076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:16.728150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:16.728232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:16.728303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:16.728374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:16.728425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:16.728435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:16.728512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:16.728578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:16.728650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:16.728722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:16.728841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:16.728850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:16.728928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:16.728994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:16.729064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:16.729135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:16.729182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:16.729192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:16.729266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:16.729335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:16.729406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:16.729474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:16.729526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:16.729534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:16.729611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:16.729692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:16.729760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:16.729832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:16.729882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:16.729889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:16.729962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:16.730030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:16.730113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:16.730182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:16.730226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:16.730229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:16.730307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:16.730369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:16.730432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:16.730942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:16.730978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:16.730983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:16.731011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895945917568537:7118]
2025-09-30T14:55:16.731016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1814 reason: error at write: Disconnected sessionId: src_id|3a2e2a43-1e44d302-8e7ad5b1-e8445df4_0
2025-09-30T14:55:16.731210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1814 sessionId: src_id|3a2e2a43-1e44d302-8e7ad5b1-e8445df4_0 is DEAD
2025-09-30T14:55:16.731407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a2e2a43-1e44d302-8e7ad5b1-e8445df4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:16.731419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a2e2a43-1e44d302-8e7ad5b1-e8445df4_0] Write session will restart in 0.007023s
2025-09-30T14:55:16.731445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a2e2a43-1e44d302-8e7ad5b1-e8445df4_0] Write session: Do CDS request
2025-09-30T14:55:16.731451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a2e2a43-1e44d302-8e7ad5b1-e8445df4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:16.730499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:16.730544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:16.730548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:16.730632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895945917568537:7118], now have 1 active actors on pipe
2025-09-30T14:55:16.731946Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:16.739877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a2e2a43-1e44d302-8e7ad5b1-e8445df4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:16.739931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:16.739949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1815
2025-09-30T14:55:16.740165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1815 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:16.740200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1815 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:16.740209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1815 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:16.740213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:16.740659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1815 sessionId:  describe result for acl check
2025-09-30T14:55:16.740694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:16.740697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:16.740699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:16.740705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895945917568558:7026] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:16.741233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895945917568558:7026] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:16.743620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895945917568558:7026] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:16.746693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895945917568558:7026] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:16.746709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895945917568558:7026] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:16.746712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895945917568558:7026] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:16.746722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1815 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:16.756028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:16.758492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:16.758801Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:16.758806Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:16.758819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:16.758878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:16.758917Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895945827800278:5534]
2025-09-30T14:55:16.759636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:16.760029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:16.760079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:16.760428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:16.760496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:16.760502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:16.760503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:16.760505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:16.760506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:16.760507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:16.760509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:16.760511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:16.760512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:16.760514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:16.760515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.760516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.760518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.760519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:16.760520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:16.760526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:16.760539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:16.760543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:16.760548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:16.760552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:16.760556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:16.760560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:16.760563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:16.760566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:16.760571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:16.760574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.760578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.760581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.760584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:16.760588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:16.760597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:16.760606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:16.760614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:16.760620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:16.760625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:16.760632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:16.760644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:16.760650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:16.760655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:16.760660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:16.760664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:16.760670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:16.760675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:16.760681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:16.760685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:16.760689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:16.760696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:16.760701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:16.760705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:16.760709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:16.760713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.760718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.760722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.760727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.760732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.760737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.760742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:16.760756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:16.760760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:16.760766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:16.760811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:16.767331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:16.768390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:16.768406Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:16.768408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:16.768415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:16.768422Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1814 [2:7555895945827800278:5534]
2025-09-30T14:55:16.768439Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:16.768457Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:16.768460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:16.768463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:16.768466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:16.768483Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:16.768490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:16.768497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:16.768559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.768562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.768564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.768568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:16.768571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:16.768641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:16.768644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.768658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.768671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.768689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:16.768708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895945917568602:7026], now have 1 active actors on pipe
2025-09-30T14:55:16.768712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895945917568551:2454], now have 1 active actors on pipe
2025-09-30T14:55:16.768718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895945827800273:5534]
2025-09-30T14:55:16.768720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895945827800273:5534]
2025-09-30T14:55:16.768722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895945827800273:5534]
2025-09-30T14:55:16.768734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:16.768745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:16.768747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:16.768748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:16.768751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:16.768765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:16.768769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:16.768807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895945827800273:5534]
2025-09-30T14:55:16.768816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:16.768823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:16.769200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1814
2025-09-30T14:55:16.769200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1814
2025-09-30T14:55:16.769667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:16.769680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:16.769709Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d905f1ab-440b21a9-bb9f018b-47ff1e97_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:16.769720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:16.769724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:16.769727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:16.769739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:16.769751Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:16.769768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:16.770417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:16.770427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:16.770449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:16.772586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1815 partition: 0 MaxSeqNo: 42 sessionId: src_id|d905f1ab-440b21a9-bb9f018b-47ff1e97_0
2025-09-30T14:55:16.773004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a2e2a43-1e44d302-8e7ad5b1-e8445df4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d905f1ab-440b21a9-bb9f018b-47ff1e97_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:16.776015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d905f1ab-440b21a9-bb9f018b-47ff1e97_0] Write session: try to update token
2025-09-30T14:55:16.776038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d905f1ab-440b21a9-bb9f018b-47ff1e97_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:16.785277Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:16.785304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:16.785307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:16.785310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:16.785320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895945827800273:5534]
2025-09-30T14:55:16.785325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895945827800273:5534]
2025-09-30T14:55:16.785329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895945827800273:5534]
2025-09-30T14:55:16.785366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:16.785385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:16.785386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:16.785389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:16.785393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.785397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:16.785542Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:16.792534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1815 sessionId: src_id|d905f1ab-440b21a9-bb9f018b-47ff1e97_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:16.795332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:16.818610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-09-30T14:55:16.818642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 10
2025-09-30T14:55:16.830918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895945917568712:7118]
2025-09-30T14:55:16.831211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1814, pipe: [1:7555895945917568712:7118]
2025-09-30T14:55:16.906987Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:16.907419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:16.907435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:16.907498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895945917568712:7118], now have 1 active actors on pipe
2025-09-30T14:55:16.907739Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:16.907760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895945917568712:7118]
2025-09-30T14:55:16.907762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:16.907767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:16.907802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:16.907815Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 10
2025-09-30T14:55:16.907846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1815 reason: error at write: Disconnected sessionId: src_id|d905f1ab-440b21a9-bb9f018b-47ff1e97_0
2025-09-30T14:55:16.908025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1815 sessionId: src_id|d905f1ab-440b21a9-bb9f018b-47ff1e97_0 is DEAD
2025-09-30T14:55:16.908881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d905f1ab-440b21a9-bb9f018b-47ff1e97_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:16.908891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d905f1ab-440b21a9-bb9f018b-47ff1e97_0] Write session will restart in 0.008339s
2025-09-30T14:55:16.908912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d905f1ab-440b21a9-bb9f018b-47ff1e97_0] Write session: Do CDS request
2025-09-30T14:55:16.908917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d905f1ab-440b21a9-bb9f018b-47ff1e97_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:16.918820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d905f1ab-440b21a9-bb9f018b-47ff1e97_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:16.919042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:16.919062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1816
2025-09-30T14:55:16.919211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1816 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:16.919262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1816 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:16.919272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1816 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:16.919276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:16.919762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1816 sessionId:  describe result for acl check
2025-09-30T14:55:16.919816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:16.919824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:16.919826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:16.919834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895945917568825:7015] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:16.920437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895945917568825:7015] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:16.921456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:16.922408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895945917568825:7015] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:16.923379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:16.923588Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:16.923598Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:16.923607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:16.923660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:16.923696Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895945827800431:5530]
2025-09-30T14:55:16.924359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:16.924697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:16.924742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:16.924735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895945917568825:7015] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:16.924749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895945917568825:7015] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:16.924753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895945917568825:7015] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:16.924761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1816 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:16.925079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:16.925136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:16.925142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:16.925143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:16.925144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:16.925145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:16.925147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:16.925148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:16.925150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:16.925151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:16.925153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:16.925154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.925155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.925156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.925157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:16.925159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:16.925164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:16.925174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:16.925179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:16.925183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:16.925187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:16.925192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:16.925196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:16.925199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:16.925204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:16.925208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:16.925212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.925216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.925219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.925224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:16.925228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:16.925234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:16.925242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:16.925248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:16.925254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:16.925260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:16.925265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:16.925270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:16.925282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:16.925287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:16.925293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:16.925301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:16.925307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:16.925316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:16.925321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:16.925330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:16.925335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:16.925340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:16.925350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:16.925355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:16.925364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:16.925369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.925375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.925384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.925390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.925398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.925404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.925412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:16.925417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:16.925422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:16.925428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:16.925477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:16.931033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:16.932188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:16.932209Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:16.932212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:16.932216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:16.932223Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1815 [2:7555895945827800431:5530]
2025-09-30T14:55:16.932242Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:16.932258Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:16.932261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:16.932264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:16.932267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:16.932282Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:16.932289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:16.932296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:16.932356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.932365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.932368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.932371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:16.932374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:16.932448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:16.932457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.932471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:16.932485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:16.932510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:16.932532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895945917568714:2454], now have 1 active actors on pipe
2025-09-30T14:55:16.932541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895945917568865:7015], now have 1 active actors on pipe
2025-09-30T14:55:16.932548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895945827800426:5530]
2025-09-30T14:55:16.932551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895945827800426:5530]
2025-09-30T14:55:16.932553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895945827800426:5530]
2025-09-30T14:55:16.932564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:16.932579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:16.932595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:16.932599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:16.932634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895945827800426:5530]
2025-09-30T14:55:16.932638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:16.932641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:16.932642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:16.932657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:16.932663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:16.932636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1815
2025-09-30T14:55:16.932649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1815
2025-09-30T14:55:16.932746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:16.932756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:16.932808Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 85826639 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:55:16.932846Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b86a261c-b7aca56-b17dc058-4cea2824_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:16.932857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:16.932861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:16.932864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:16.932874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:16.932887Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:16.932904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:16.933017Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 12 DataSize: 85826639 UsedReserveSize: 0
2025-09-30T14:55:16.933061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:55:16.933074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:16.933085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:16.933099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:16.933185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1816 partition: 0 MaxSeqNo: 42 sessionId: src_id|b86a261c-b7aca56-b17dc058-4cea2824_0
2025-09-30T14:55:16.933561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d905f1ab-440b21a9-bb9f018b-47ff1e97_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b86a261c-b7aca56-b17dc058-4cea2824_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:16.936560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b86a261c-b7aca56-b17dc058-4cea2824_0] Write session: try to update token
2025-09-30T14:55:16.936578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b86a261c-b7aca56-b17dc058-4cea2824_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:16.944942Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:16.944964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:16.944974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895945827800426:5530]
2025-09-30T14:55:16.945019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:16.945021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:16.945195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:16.945340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:16.945482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:16.945648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:16.945838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:16.945880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:16.953179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1816 sessionId: src_id|b86a261c-b7aca56-b17dc058-4cea2824_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:16.956185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:16.956776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:16.956802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:16.956821Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:16.956827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:16.956830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:16.956833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:16.956842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895945827800426:5530]
2025-09-30T14:55:16.956846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895945827800426:5530]
2025-09-30T14:55:16.956849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895945827800426:5530]
2025-09-30T14:55:16.956881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:16.956887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:16.956890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:16.956896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:16.956908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:16.956911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:16.957052Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:17.008058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895950212536174:7118]
2025-09-30T14:55:17.008379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1815, pipe: [1:7555895950212536174:7118]
2025-09-30T14:55:17.077875Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:17.078253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:17.078289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895950212536174:7118], now have 1 active actors on pipe
2025-09-30T14:55:17.078562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:17.078587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895950212536174:7118]
2025-09-30T14:55:17.078611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:17.078656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:17.078664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:17.078732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1816 reason: error at write: Disconnected sessionId: src_id|b86a261c-b7aca56-b17dc058-4cea2824_0
2025-09-30T14:55:17.078890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1816 sessionId: src_id|b86a261c-b7aca56-b17dc058-4cea2824_0 is DEAD
2025-09-30T14:55:17.079041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b86a261c-b7aca56-b17dc058-4cea2824_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:17.079052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b86a261c-b7aca56-b17dc058-4cea2824_0] Write session will restart in 0.005083s
2025-09-30T14:55:17.079077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b86a261c-b7aca56-b17dc058-4cea2824_0] Write session: Do CDS request
2025-09-30T14:55:17.079083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b86a261c-b7aca56-b17dc058-4cea2824_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:17.085877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b86a261c-b7aca56-b17dc058-4cea2824_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:17.085999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:17.086016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1817
2025-09-30T14:55:17.086137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1817 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:17.086172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1817 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:17.086183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1817 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:17.086188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:17.086654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1817 sessionId:  describe result for acl check
2025-09-30T14:55:17.086687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:17.086696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:17.086698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:17.086704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895950212536193:7014] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:17.087310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895950212536193:7014] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:17.089852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895950212536193:7014] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:17.092041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:17.094347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:17.094579Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:17.094594Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:17.094608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:17.094670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895950212536193:7014] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:17.094690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895950212536193:7014] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:17.094694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895950212536193:7014] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:17.094703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1817 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:17.094693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:17.094739Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895950122767880:5527]
2025-09-30T14:55:17.095409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:17.095935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:17.095989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:17.096508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:17.096594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:17.096603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:17.096604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:17.096605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:17.096607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:17.096608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:17.096610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:17.096611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:17.096612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:17.096613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:17.096614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.096615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.096617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.096618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:17.096619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:17.096625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:17.096635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:17.096639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:17.096643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:17.096647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:17.096651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:17.096655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:17.096659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:17.096664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:17.096669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:17.096674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.096678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.096682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.096687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:17.096691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:17.096702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:17.096711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:17.096717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:17.096723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:17.096731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:17.096737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:17.096743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:17.096749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:17.096755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:17.096761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:17.096766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:17.096772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:17.096777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:17.096783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:17.096788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:17.096794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:17.096799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:17.096805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:17.096811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:17.096816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:17.096833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.096838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.096843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.096848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.096853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.096858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.096863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:17.096869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:17.096874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:17.096878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:17.096923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:17.102896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:17.103801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:17.103821Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:17.103824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:17.103828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:17.103835Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1816 [2:7555895950122767880:5527]
2025-09-30T14:55:17.103852Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:17.103872Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:17.103875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:17.103879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:17.103881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:17.103899Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:17.103906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:17.103915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:17.103983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.103993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.103995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.103999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:17.104002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:17.104070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:17.104079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.104091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.104104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.104136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:17.104160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895950212536326:7014], now have 1 active actors on pipe
2025-09-30T14:55:17.104165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895950212536178:2454], now have 1 active actors on pipe
2025-09-30T14:55:17.104171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895950122767875:5527]
2025-09-30T14:55:17.104175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895950122767875:5527]
2025-09-30T14:55:17.104177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895950122767875:5527]
2025-09-30T14:55:17.104191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:17.104207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:17.104212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:17.104217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:17.104220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:17.104227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:17.104230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:17.104273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895950122767875:5527]
2025-09-30T14:55:17.104284Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:17.104287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:17.104245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1816
2025-09-30T14:55:17.104313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1816
2025-09-30T14:55:17.104374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:17.104386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:17.104413Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|393aab69-70a5de0e-a6eae9bf-9ea312eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:17.104426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:17.104433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:17.104435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:17.104447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:17.104461Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:17.104475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:17.104725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:17.104735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:17.104753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:17.104887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1817 partition: 0 MaxSeqNo: 42 sessionId: src_id|393aab69-70a5de0e-a6eae9bf-9ea312eb_0
2025-09-30T14:55:17.105235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b86a261c-b7aca56-b17dc058-4cea2824_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|393aab69-70a5de0e-a6eae9bf-9ea312eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:17.108345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|393aab69-70a5de0e-a6eae9bf-9ea312eb_0] Write session: try to update token
2025-09-30T14:55:17.108363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|393aab69-70a5de0e-a6eae9bf-9ea312eb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:17.120408Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:17.120427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:17.120441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895950122767875:5527]
2025-09-30T14:55:17.120489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:17.120492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:17.120673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:17.120833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:17.120973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:17.121121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:17.121329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:17.121379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:17.128158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1817 sessionId: src_id|393aab69-70a5de0e-a6eae9bf-9ea312eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:17.130901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:17.131872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:17.131900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:17.131921Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:17.131925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:17.131928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:17.131930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:17.131939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895950122767875:5527]
2025-09-30T14:55:17.131946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895950122767875:5527]
2025-09-30T14:55:17.131951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895950122767875:5527]
2025-09-30T14:55:17.131992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:17.132003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:17.132003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:17.132011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.132012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:17.132013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:17.132154Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:17.178524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895950212536344:7118]
2025-09-30T14:55:17.178785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1816, pipe: [1:7555895950212536344:7118]
2025-09-30T14:55:17.246311Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:17.246656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:17.246713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895950212536344:7118], now have 1 active actors on pipe
2025-09-30T14:55:17.246833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:17.246887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:17.246933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:17.246941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895950212536344:7118]
2025-09-30T14:55:17.246941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:17.247011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1817 reason: error at write: Disconnected sessionId: src_id|393aab69-70a5de0e-a6eae9bf-9ea312eb_0
2025-09-30T14:55:17.247168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1817 sessionId: src_id|393aab69-70a5de0e-a6eae9bf-9ea312eb_0 is DEAD
2025-09-30T14:55:17.247355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|393aab69-70a5de0e-a6eae9bf-9ea312eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:17.247366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|393aab69-70a5de0e-a6eae9bf-9ea312eb_0] Write session will restart in 0.009952s
2025-09-30T14:55:17.247390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|393aab69-70a5de0e-a6eae9bf-9ea312eb_0] Write session: Do CDS request
2025-09-30T14:55:17.247396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|393aab69-70a5de0e-a6eae9bf-9ea312eb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:17.258157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:17.258764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|393aab69-70a5de0e-a6eae9bf-9ea312eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:17.258826Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:17.258843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1818
2025-09-30T14:55:17.259005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1818 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:17.259046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1818 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:17.259055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1818 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:17.259059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:17.259533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1818 sessionId:  describe result for acl check
2025-09-30T14:55:17.259583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:17.259591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:17.259593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:17.259598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895950212536465:7002] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:17.260198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895950212536465:7002] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:17.260237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:17.260465Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:17.260475Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:17.260486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:17.260538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:17.260579Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895950122768033:5525]
2025-09-30T14:55:17.261232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:17.261481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:17.261527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:17.261884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:17.261952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:17.261959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:17.261960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:17.261961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:17.261963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:17.261964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:17.261965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:17.261966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:17.261967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:17.261969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:17.261970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.261971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.261973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.261974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:17.261975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:17.261981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:17.261992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:17.261997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:17.262001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:17.262006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:17.262010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:17.262015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:17.262019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:17.262024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:17.262029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:17.262032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.262037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.262041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.262048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:17.262052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:17.262059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:17.262067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:17.262074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:17.262081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:17.262086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:17.262091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:17.262096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:17.262102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:17.262108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:17.262114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:17.262123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:17.262132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:17.262138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:17.262148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:17.262154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:17.262164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:17.262170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:17.262180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:17.262185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:17.262196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:17.262202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.262212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.262216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.262226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.262232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.262242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.262246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:17.262256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:17.262262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:17.262272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:17.262321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:17.262575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895950212536465:7002] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:17.267536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895950212536465:7002] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:17.267558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895950212536465:7002] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:17.267562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895950212536465:7002] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:17.267572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1818 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:17.267890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:17.268765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:17.268780Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:17.268782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:17.268786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:17.268791Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1817 [2:7555895950122768033:5525]
2025-09-30T14:55:17.268803Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:17.268816Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:17.268818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:17.268821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:17.268822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:17.268835Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:17.268841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:17.268849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:17.268905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.268912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.268913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.268916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:17.268918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:17.268973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:17.268980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.268992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.269009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.269031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:17.269052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895950122768027:5525]
2025-09-30T14:55:17.269063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895950122768027:5525]
2025-09-30T14:55:17.269065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895950122768027:5525]
2025-09-30T14:55:17.269077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:17.269092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:17.269095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895950212536348:2454], now have 1 active actors on pipe
2025-09-30T14:55:17.269100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895950212536503:7002], now have 1 active actors on pipe
2025-09-30T14:55:17.269103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:17.269105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:17.269107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:17.269116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:17.269118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:17.269146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895950122768027:5525]
2025-09-30T14:55:17.269155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:17.269162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:17.269176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1817
2025-09-30T14:55:17.269181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1817
2025-09-30T14:55:17.269237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:17.269245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:17.269265Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|316d05d0-eed8c575-d70dfa6b-f757c571_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:17.269273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:17.269277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:17.269278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:17.269286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:17.269298Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:17.269312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:17.269491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:17.269508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:17.269534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:17.269704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1818 partition: 0 MaxSeqNo: 42 sessionId: src_id|316d05d0-eed8c575-d70dfa6b-f757c571_0
2025-09-30T14:55:17.270061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|393aab69-70a5de0e-a6eae9bf-9ea312eb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|316d05d0-eed8c575-d70dfa6b-f757c571_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:17.273014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|316d05d0-eed8c575-d70dfa6b-f757c571_0] Write session: try to update token
2025-09-30T14:55:17.273039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|316d05d0-eed8c575-d70dfa6b-f757c571_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:17.281585Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:17.281610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:17.281613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:17.281615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:17.281641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895950122768027:5525]
2025-09-30T14:55:17.281647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895950122768027:5525]
2025-09-30T14:55:17.281651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895950122768027:5525]
2025-09-30T14:55:17.281698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:17.281706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.281712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:17.281714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:17.281719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:17.281724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:17.281870Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:17.288870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1818 sessionId: src_id|316d05d0-eed8c575-d70dfa6b-f757c571_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:17.292073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:17.347026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895950212536511:7118]
2025-09-30T14:55:17.347429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1817, pipe: [1:7555895950212536511:7118]
2025-09-30T14:55:17.399396Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:17.399971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:17.399989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:17.400011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895950212536511:7118], now have 1 active actors on pipe
2025-09-30T14:55:17.400273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:17.400280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895950212536511:7118]
2025-09-30T14:55:17.400293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:17.400304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:17.400361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1818 reason: error at write: Disconnected sessionId: src_id|316d05d0-eed8c575-d70dfa6b-f757c571_0
2025-09-30T14:55:17.400350Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:17.400555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1818 sessionId: src_id|316d05d0-eed8c575-d70dfa6b-f757c571_0 is DEAD
2025-09-30T14:55:17.400984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|316d05d0-eed8c575-d70dfa6b-f757c571_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:17.400995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|316d05d0-eed8c575-d70dfa6b-f757c571_0] Write session will restart in 0.008096s
2025-09-30T14:55:17.401021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|316d05d0-eed8c575-d70dfa6b-f757c571_0] Write session: Do CDS request
2025-09-30T14:55:17.401030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|316d05d0-eed8c575-d70dfa6b-f757c571_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:17.411335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|316d05d0-eed8c575-d70dfa6b-f757c571_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:17.411407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:17.411428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1819
2025-09-30T14:55:17.411606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1819 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:17.411654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1819 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:17.411665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1819 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:17.411671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:17.412169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1819 sessionId:  describe result for acl check
2025-09-30T14:55:17.412214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:17.412217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:17.412219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:17.412225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895950212536608:6998] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:17.412813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895950212536608:6998] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:17.414716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:17.415279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895950212536608:6998] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:17.416745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:17.416983Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:17.416995Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:17.417006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:17.417061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:17.417103Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895950122768188:5519]
2025-09-30T14:55:17.417778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:17.417834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895950212536608:6998] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:17.417851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895950212536608:6998] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:17.417854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895950212536608:6998] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:17.417863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1819 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:17.418098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:17.418148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:17.418508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:17.418572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:17.418578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:17.418580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:17.418581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:17.418583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:17.418584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:17.418585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:17.418587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:17.418588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:17.418589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:17.418590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.418592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.418593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.418594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:17.418595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:17.418600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:17.418611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:17.418616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:17.418620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:17.418624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:17.418629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:17.418633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:17.418637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:17.418641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:17.418645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:17.418650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.418654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.418658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.418662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:17.418666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:17.418675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:17.418683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:17.418691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:17.418697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:17.418702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:17.418709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:17.418713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:17.418719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:17.418724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:17.418729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:17.418734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:17.418740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:17.418752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:17.418757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:17.418762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:17.418767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:17.418778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:17.418784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:17.418790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:17.418801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:17.418805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.418816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.418820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.418830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.418839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.418849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.418854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:17.418864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:17.418869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:17.418876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:17.418925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:17.424977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:17.426182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:17.426198Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:17.426201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:17.426209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:17.426217Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1818 [2:7555895950122768188:5519]
2025-09-30T14:55:17.426235Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:17.426253Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:17.426256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:17.426260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:17.426262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:17.426279Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:17.426296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:17.426302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:17.426369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.426378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.426380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.426384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:17.426387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:17.426459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:17.426467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.426481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.426499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.426522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:17.426547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895950122768183:5519]
2025-09-30T14:55:17.426550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895950122768183:5519]
2025-09-30T14:55:17.426552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895950122768183:5519]
2025-09-30T14:55:17.426562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:17.426577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:17.426580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:17.426585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:17.426587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:17.426593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:17.426596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:17.426637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895950122768183:5519]
2025-09-30T14:55:17.426652Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:17.426662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895950212536512:2454], now have 1 active actors on pipe
2025-09-30T14:55:17.426666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895950212536665:6998], now have 1 active actors on pipe
2025-09-30T14:55:17.426677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:17.426700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1818
2025-09-30T14:55:17.426739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:17.426709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1818
2025-09-30T14:55:17.426750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:17.426776Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|150e45eb-119a54b2-c8da6d75-ec74a9c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:17.426788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:17.426793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:17.426801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:17.426814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:17.426828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:17.426852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:17.427028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:17.427036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:17.427053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:17.427284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1819 partition: 0 MaxSeqNo: 42 sessionId: src_id|150e45eb-119a54b2-c8da6d75-ec74a9c8_0
2025-09-30T14:55:17.427763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|316d05d0-eed8c575-d70dfa6b-f757c571_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|150e45eb-119a54b2-c8da6d75-ec74a9c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:17.430887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|150e45eb-119a54b2-c8da6d75-ec74a9c8_0] Write session: try to update token
2025-09-30T14:55:17.430910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|150e45eb-119a54b2-c8da6d75-ec74a9c8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:17.439382Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:17.439402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:17.439412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895950122768183:5519]
2025-09-30T14:55:17.439462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:17.439645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:17.439792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:17.439941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:17.440106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:17.440417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:17.440460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:17.440557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:17.452671Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:17.452692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:17.452695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:17.452698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:17.452707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895950122768183:5519]
2025-09-30T14:55:17.452712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895950122768183:5519]
2025-09-30T14:55:17.452716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895950122768183:5519]
2025-09-30T14:55:17.452753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:17.452756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:17.452762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:17.452762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.452764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:17.452765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:17.452913Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:17.464643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1819 sessionId: src_id|150e45eb-119a54b2-c8da6d75-ec74a9c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:17.467609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:17.500620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895950212536696:7118]
2025-09-30T14:55:17.500792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1818, pipe: [1:7555895950212536696:7118]
2025-09-30T14:55:17.572230Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:17.572619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:17.572642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:17.572666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895950212536696:7118], now have 1 active actors on pipe
2025-09-30T14:55:17.572936Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:17.573261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895950212536696:7118]
2025-09-30T14:55:17.573290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:17.573321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:17.573395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1819 reason: status is not ok: tablet will be restarted right now sessionId: src_id|150e45eb-119a54b2-c8da6d75-ec74a9c8_0
2025-09-30T14:55:17.573565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1819 sessionId: src_id|150e45eb-119a54b2-c8da6d75-ec74a9c8_0 is DEAD
2025-09-30T14:55:17.576887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150e45eb-119a54b2-c8da6d75-ec74a9c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:17.576901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150e45eb-119a54b2-c8da6d75-ec74a9c8_0] Write session will restart in 0.006255s
2025-09-30T14:55:17.576924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150e45eb-119a54b2-c8da6d75-ec74a9c8_0] Write session: Do CDS request
2025-09-30T14:55:17.576929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150e45eb-119a54b2-c8da6d75-ec74a9c8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:17.584847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|150e45eb-119a54b2-c8da6d75-ec74a9c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:17.584942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:17.584960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1820
2025-09-30T14:55:17.585115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1820 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:17.585163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1820 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:17.585173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1820 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:17.585178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:17.585692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1820 sessionId:  describe result for acl check
2025-09-30T14:55:17.585731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:17.585737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:17.585739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:17.585746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895950212536814:6986] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:17.586336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895950212536814:6986] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:17.586431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:17.589162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895950212536814:6986] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:17.589294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:17.589551Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:17.589562Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:17.589575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:17.589652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:17.589698Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895950122768380:5502]
2025-09-30T14:55:17.590409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:17.590800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:17.590872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:17.591227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:17.591333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:17.591340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:17.591341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:17.591342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:17.591344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:17.591346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:17.591347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:17.591348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:17.591350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:17.591351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:17.591353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.591354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.591355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.591357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:17.591358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:17.591364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:17.591373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:17.591377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:17.591382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:17.591385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:17.591389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:17.591392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:17.591399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:17.591402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:17.591406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:17.591419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.591422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.591426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.591431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:17.591435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:17.591444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:17.591451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:17.591456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:17.591459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:17.591462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:17.591466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:17.591468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:17.591474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:17.591478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:17.591481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:17.591484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:17.591487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:17.591490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:17.591493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:17.591496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:17.591519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:17.591524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:17.591530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:17.591536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:17.591542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:17.591548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.591554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.591557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.591560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.591563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.591566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.591571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:17.591576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:17.591586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:17.591591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:17.591635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:17.598108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895950212536814:6986] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:17.598133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895950212536814:6986] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:17.598137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895950212536814:6986] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:17.598148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1820 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:17.598406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:17.599506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:17.599527Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:17.599530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:17.599534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:17.599541Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1819 [2:7555895950122768380:5502]
2025-09-30T14:55:17.599559Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:17.599577Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:17.599580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:17.599583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:17.599585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:17.599602Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:17.599609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:17.599616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:17.599682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.599693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.599696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.599700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:17.599702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:17.599779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:17.599788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.599803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.599818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.599838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:17.599862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895950122768374:5502]
2025-09-30T14:55:17.599870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895950122768374:5502]
2025-09-30T14:55:17.599872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895950122768374:5502]
2025-09-30T14:55:17.599887Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:17.599901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:17.599916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:17.599925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:17.599956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:17.599965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895950122768374:5502]
2025-09-30T14:55:17.599967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:17.599967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:17.599970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:17.599977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:17.600651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895950212536699:2454], now have 1 active actors on pipe
2025-09-30T14:55:17.600667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895950212536853:6986], now have 1 active actors on pipe
2025-09-30T14:55:17.600690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:17.600696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:17.600722Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88e0ad03-30b01940-b86dc71c-45be4739_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:17.600731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:17.600735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:17.600738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:17.600749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:17.600762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:17.600779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:17.600285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1819
2025-09-30T14:55:17.600325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1819
2025-09-30T14:55:17.601311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1820 partition: 0 MaxSeqNo: 42 sessionId: src_id|88e0ad03-30b01940-b86dc71c-45be4739_0
2025-09-30T14:55:17.601076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:17.601092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:17.601130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:17.601717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150e45eb-119a54b2-c8da6d75-ec74a9c8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|88e0ad03-30b01940-b86dc71c-45be4739_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:17.604765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88e0ad03-30b01940-b86dc71c-45be4739_0] Write session: try to update token
2025-09-30T14:55:17.604796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88e0ad03-30b01940-b86dc71c-45be4739_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:17.618387Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:17.618405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:17.618408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:17.618410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:17.618421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895950122768374:5502]
2025-09-30T14:55:17.618426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895950122768374:5502]
2025-09-30T14:55:17.618431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895950122768374:5502]
2025-09-30T14:55:17.618474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:17.618482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.618485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:17.618630Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:17.621909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:17.621929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:17.621934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:17.628918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1820 sessionId: src_id|88e0ad03-30b01940-b86dc71c-45be4739_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:17.631951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:17.673658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895950212536876:7118]
2025-09-30T14:55:17.674087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1819, pipe: [1:7555895950212536876:7118]
2025-09-30T14:55:17.730394Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:17.730978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:17.730991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:17.731007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895950212536876:7118], now have 1 active actors on pipe
2025-09-30T14:55:17.731271Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:17.731309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:17.731355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895950212536876:7118]
2025-09-30T14:55:17.731359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:17.731434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1820 reason: status is not ok: tablet will be restarted right now sessionId: src_id|88e0ad03-30b01940-b86dc71c-45be4739_0
2025-09-30T14:55:17.731625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1820 sessionId: src_id|88e0ad03-30b01940-b86dc71c-45be4739_0 is DEAD
2025-09-30T14:55:17.731778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88e0ad03-30b01940-b86dc71c-45be4739_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:17.731787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88e0ad03-30b01940-b86dc71c-45be4739_0] Write session will restart in 0.005296s
2025-09-30T14:55:17.731817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88e0ad03-30b01940-b86dc71c-45be4739_0] Write session: Do CDS request
2025-09-30T14:55:17.731824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88e0ad03-30b01940-b86dc71c-45be4739_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:17.738782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88e0ad03-30b01940-b86dc71c-45be4739_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:17.738851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:17.738868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1821
2025-09-30T14:55:17.739042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1821 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:17.739103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1821 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:17.739114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1821 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:17.739118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:17.739582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1821 sessionId:  describe result for acl check
2025-09-30T14:55:17.739616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:17.739624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:17.739626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:17.739632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895950212536898:6974] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:17.740204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895950212536898:6974] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:17.743127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895950212536898:6974] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:17.744986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:17.747240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:17.747487Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:17.747477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895950212536898:6974] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:17.747498Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:17.747509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:17.747495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895950212536898:6974] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:17.747499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895950212536898:6974] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:17.747508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1821 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:17.747569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:17.747609Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895950122768547:5500]
2025-09-30T14:55:17.748275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:17.748527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:17.748570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:17.748886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:17.748947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:17.748956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:17.748958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:17.748959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:17.748960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:17.748961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:17.748962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:17.748963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:17.748965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:17.748966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:17.748967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.748968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.748970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.748971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:17.748972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:17.748978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:17.748989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:17.748993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:17.748997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:17.749001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:17.749006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:17.749010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:17.749014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:17.749018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:17.749023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:17.749027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.749031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.749035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.749039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:17.749043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:17.749050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:17.749058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:17.749064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:17.749070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:17.749075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:17.749080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:17.749085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:17.749091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:17.749095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:17.749100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:17.749103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:17.749108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:17.749114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:17.749119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:17.749125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:17.749131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:17.749138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:17.749143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:17.749147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:17.749153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:17.749158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.749163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.749168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.749173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.749178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.749183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.749188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:17.749193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:17.749207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:17.749213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:17.749260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:17.754725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:17.755912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:17.755931Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:17.755934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:17.755939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:17.755946Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1820 [2:7555895950122768547:5500]
2025-09-30T14:55:17.755963Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:17.755978Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:17.755981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:17.755984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:17.755986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:17.756003Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:17.756009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:17.756016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:17.756077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.756080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.756082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.756086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:17.756089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:17.756160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:17.756163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.756176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.756193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.756210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:17.756293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1820
2025-09-30T14:55:17.756235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895950212537030:6974], now have 1 active actors on pipe
2025-09-30T14:55:17.756314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1820
2025-09-30T14:55:17.756243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895950212536877:2454], now have 1 active actors on pipe
2025-09-30T14:55:17.756251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895950122768542:5500]
2025-09-30T14:55:17.756254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895950122768542:5500]
2025-09-30T14:55:17.756256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895950122768542:5500]
2025-09-30T14:55:17.756270Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:17.756285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:17.756300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:17.756299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:17.756304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:17.756304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:17.756307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:17.756340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895950122768542:5500]
2025-09-30T14:55:17.756348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:17.756354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:17.756502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:17.756512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:17.756539Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9b006d0-27144a6f-e7b52794-ea6e913c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:17.756553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:17.756561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:17.756563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:17.756575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:17.756588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:17.756606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:17.756989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:17.757008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:17.757033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:17.757105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1821 partition: 0 MaxSeqNo: 42 sessionId: src_id|f9b006d0-27144a6f-e7b52794-ea6e913c_0
2025-09-30T14:55:17.757483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88e0ad03-30b01940-b86dc71c-45be4739_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f9b006d0-27144a6f-e7b52794-ea6e913c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:17.760263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b006d0-27144a6f-e7b52794-ea6e913c_0] Write session: try to update token
2025-09-30T14:55:17.760283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b006d0-27144a6f-e7b52794-ea6e913c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:17.768987Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:17.769021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:17.769023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:17.769026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:17.769036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895950122768542:5500]
2025-09-30T14:55:17.769041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895950122768542:5500]
2025-09-30T14:55:17.769045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895950122768542:5500]
2025-09-30T14:55:17.769088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:17.769094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.769095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:17.769097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:17.769101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:17.769108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:17.769260Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:17.776825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1821 sessionId: src_id|f9b006d0-27144a6f-e7b52794-ea6e913c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:17.779851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:17.831337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895950212537051:7118]
2025-09-30T14:55:17.831642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1820, pipe: [1:7555895950212537051:7118]
2025-09-30T14:55:17.883889Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:17.884404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:17.884421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:17.884442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895950212537051:7118], now have 1 active actors on pipe
2025-09-30T14:55:17.884688Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:17.884672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:17.884693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:17.884699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:17.884752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895950212537051:7118]
2025-09-30T14:55:17.884760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1821 reason: error at write: Disconnected sessionId: src_id|f9b006d0-27144a6f-e7b52794-ea6e913c_0
2025-09-30T14:55:17.884952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1821 sessionId: src_id|f9b006d0-27144a6f-e7b52794-ea6e913c_0 is DEAD
2025-09-30T14:55:17.885116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b006d0-27144a6f-e7b52794-ea6e913c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:17.885123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b006d0-27144a6f-e7b52794-ea6e913c_0] Write session will restart in 0.006134s
2025-09-30T14:55:17.885156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b006d0-27144a6f-e7b52794-ea6e913c_0] Write session: Do CDS request
2025-09-30T14:55:17.885161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b006d0-27144a6f-e7b52794-ea6e913c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:17.892818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b006d0-27144a6f-e7b52794-ea6e913c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:17.892846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:17.892863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1822
2025-09-30T14:55:17.893001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1822 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:17.893034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1822 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:17.893040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1822 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:17.893044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:17.893520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1822 sessionId:  describe result for acl check
2025-09-30T14:55:17.893547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:17.893549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:17.893550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:17.893557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895950212537094:6970] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:17.894105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895950212537094:6970] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:17.897285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895950212537094:6970] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:17.900739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895950212537094:6970] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:17.900759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895950212537094:6970] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:17.900764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895950212537094:6970] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:17.900772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1822 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:17.901870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:17.904389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:17.904622Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:17.904633Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:17.904644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:17.904700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:17.904743Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895950122768707:5498]
2025-09-30T14:55:17.905437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:17.905813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:17.905862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:17.906214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:17.906277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:17.906283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:17.906285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:17.906287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:17.906288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:17.906289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:17.906291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:17.906292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:17.906294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:17.906295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:17.906296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.906298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.906299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.906301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:17.906302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:17.906308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:17.906320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:17.906324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:17.906329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:17.906334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:17.906338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:17.906342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:17.906347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:17.906351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:17.906356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:17.906360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.906365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.906369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.906373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:17.906377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:17.906385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:17.906394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:17.906400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:17.906406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:17.906410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:17.906416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:17.906422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:17.906427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:17.906433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:17.906439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:17.906444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:17.906450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:17.906456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:17.906461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:17.906466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:17.906472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:17.906480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:17.906485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:17.906491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:17.906497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:17.906502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.906509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.906514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.906521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.906536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.906542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.906547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:17.906553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:17.906558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:17.906564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:17.906613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:17.913173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:17.914043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:17.914059Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:17.914063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:17.914067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:17.914075Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1821 [2:7555895950122768707:5498]
2025-09-30T14:55:17.914092Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:17.914107Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:17.914111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:17.914114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:17.914117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:17.914133Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:17.914141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:17.914149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:17.914216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.914218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.914221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.914224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:17.914227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:17.914293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:17.914296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.914309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:17.914321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:17.914341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:17.914357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895950122768702:5498]
2025-09-30T14:55:17.914360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895950122768702:5498]
2025-09-30T14:55:17.914363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895950122768702:5498]
2025-09-30T14:55:17.914377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:17.914391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:17.914417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:17.914426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:17.914460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895950122768702:5498]
2025-09-30T14:55:17.914468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:17.914551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:17.914559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:17.914562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:17.914567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:17.915124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1821
2025-09-30T14:55:17.915135Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1821
2025-09-30T14:55:17.915297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895950212537204:6970], now have 1 active actors on pipe
2025-09-30T14:55:17.915310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895950212537052:2454], now have 1 active actors on pipe
2025-09-30T14:55:17.915323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:17.915329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:17.915357Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba285c03-9b806034-1cb9848b-a936caf0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:17.915365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:17.915370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:17.915372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:17.915386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:17.915402Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:17.915424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:17.915723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:17.915727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:17.915740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:17.915840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1822 partition: 0 MaxSeqNo: 42 sessionId: src_id|ba285c03-9b806034-1cb9848b-a936caf0_0
2025-09-30T14:55:17.916724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b006d0-27144a6f-e7b52794-ea6e913c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ba285c03-9b806034-1cb9848b-a936caf0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:17.919523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba285c03-9b806034-1cb9848b-a936caf0_0] Write session: try to update token
2025-09-30T14:55:17.919544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba285c03-9b806034-1cb9848b-a936caf0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:17.927569Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:17.927588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:17.927591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:17.927593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:17.927606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895950122768702:5498]
2025-09-30T14:55:17.927618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895950122768702:5498]
2025-09-30T14:55:17.927623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895950122768702:5498]
2025-09-30T14:55:17.927665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:17.927672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:17.927674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:17.927673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:17.927680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:17.927685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:17.927818Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:17.948637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1822 sessionId: src_id|ba285c03-9b806034-1cb9848b-a936caf0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:17.951681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:17.984970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895950212537218:7118]
2025-09-30T14:55:17.985603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1821, pipe: [1:7555895950212537218:7118]
2025-09-30T14:55:18.052365Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:18.052729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:18.052747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:18.052766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895950212537218:7118], now have 1 active actors on pipe
2025-09-30T14:55:18.053145Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:18.053162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:18.053168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:18.053232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895950212537218:7118]
2025-09-30T14:55:18.053287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1822 reason: error at write: Disconnected sessionId: src_id|ba285c03-9b806034-1cb9848b-a936caf0_0
2025-09-30T14:55:18.053149Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:18.053530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1822 sessionId: src_id|ba285c03-9b806034-1cb9848b-a936caf0_0 is DEAD
2025-09-30T14:55:18.053735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba285c03-9b806034-1cb9848b-a936caf0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:18.053750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba285c03-9b806034-1cb9848b-a936caf0_0] Write session will restart in 0.008309s
2025-09-30T14:55:18.053785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba285c03-9b806034-1cb9848b-a936caf0_0] Write session: Do CDS request
2025-09-30T14:55:18.053796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba285c03-9b806034-1cb9848b-a936caf0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:18.063949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba285c03-9b806034-1cb9848b-a936caf0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:18.064220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:18.064245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1823
2025-09-30T14:55:18.064409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1823 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:18.064454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1823 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:18.064466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1823 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:18.064471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:18.065098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1823 sessionId:  describe result for acl check
2025-09-30T14:55:18.065146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:18.065157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:18.065159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:18.065167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895954507504586:6953] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:18.065911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895954507504586:6953] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:18.070176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895954507504586:6953] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:18.071353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:18.073789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:18.074000Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:18.074012Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:18.074023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:18.074077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:18.074121Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895954417736160:5495]
2025-09-30T14:55:18.074219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895954507504586:6953] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:18.074250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895954507504586:6953] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:18.074254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895954507504586:6953] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:18.074262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1823 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:18.074746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:18.075056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:18.075102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:18.075425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:18.075494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:18.075497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:18.075498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:18.075500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:18.075501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:18.075502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:18.075503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:18.075504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:18.075506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:18.075507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:18.075508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.075509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.075510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.075511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:18.075512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:18.075517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:18.075527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:18.075531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:18.075534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:18.075537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:18.075540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:18.075544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:18.075547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:18.075551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:18.075555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:18.075559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.075562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.075566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.075569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:18.075572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:18.075579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:18.075586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:18.075591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:18.075597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:18.075601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:18.075606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:18.075611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:18.075616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:18.075621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:18.075625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:18.075629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:18.075634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:18.075639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:18.075643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:18.075647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:18.075651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:18.075656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:18.075662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:18.075666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:18.075673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:18.075677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.075682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.075686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.075691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.075702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.075706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.075711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:18.075715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:18.075719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:18.075725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:18.075769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:18.081526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:18.082495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:18.082517Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:18.082520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:18.082524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:18.082531Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1822 [2:7555895954417736160:5495]
2025-09-30T14:55:18.082548Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:18.082565Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:18.082573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:18.082577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:18.082579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:18.082597Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:18.082610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:18.082617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:18.082684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.082693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.082696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.082700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:18.082703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:18.082774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:18.082781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.082794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.082809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.082828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:18.082849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895954417736155:5495]
2025-09-30T14:55:18.082857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895954417736155:5495]
2025-09-30T14:55:18.082859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895954417736155:5495]
2025-09-30T14:55:18.082872Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:18.082887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895954507504524:2454], now have 1 active actors on pipe
2025-09-30T14:55:18.082890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895954507504679:6953], now have 1 active actors on pipe
2025-09-30T14:55:18.082898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:18.082899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:18.082904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:18.082908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:18.082912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:18.082915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:18.082955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895954417736155:5495]
2025-09-30T14:55:18.082970Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:18.082971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:18.082949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1822
2025-09-30T14:55:18.083042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1822
2025-09-30T14:55:18.083422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:18.083436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:18.083460Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5628362-c86660b1-537d3991-79215a32_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:18.083468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:18.083471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:18.083473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:18.083484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:18.083495Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:18.083510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:18.083709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:18.083717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:18.083730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:18.083817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1823 partition: 0 MaxSeqNo: 42 sessionId: src_id|e5628362-c86660b1-537d3991-79215a32_0
2025-09-30T14:55:18.084261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba285c03-9b806034-1cb9848b-a936caf0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e5628362-c86660b1-537d3991-79215a32_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:18.087867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5628362-c86660b1-537d3991-79215a32_0] Write session: try to update token
2025-09-30T14:55:18.087893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5628362-c86660b1-537d3991-79215a32_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:18.096072Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:18.096095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:18.096098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:18.096100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:18.096112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895954417736155:5495]
2025-09-30T14:55:18.096118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895954417736155:5495]
2025-09-30T14:55:18.096122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895954417736155:5495]
2025-09-30T14:55:18.096173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:18.096182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.096185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:18.096193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:18.096200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:18.096208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:18.096350Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:18.108521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1823 sessionId: src_id|e5628362-c86660b1-537d3991-79215a32_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:18.111667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:18.153395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895954507504700:7118]
2025-09-30T14:55:18.153831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1822, pipe: [1:7555895954507504700:7118]
2025-09-30T14:55:18.214906Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:18.215321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:18.215349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:18.215373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895954507504700:7118], now have 1 active actors on pipe
2025-09-30T14:55:18.215814Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:18.217043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:18.217057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:18.217105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895954507504700:7118]
2025-09-30T14:55:18.217152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1823 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e5628362-c86660b1-537d3991-79215a32_0
2025-09-30T14:55:18.217343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1823 sessionId: src_id|e5628362-c86660b1-537d3991-79215a32_0 is DEAD
2025-09-30T14:55:18.217576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5628362-c86660b1-537d3991-79215a32_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 133 BytesWritten: 94617674 MessagesWritten: 42 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 13516812 MessagesInflight: 10 }
2025-09-30T14:55:18.217639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5628362-c86660b1-537d3991-79215a32_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:18.217650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5628362-c86660b1-537d3991-79215a32_0] Write session will restart in 0.008765s
2025-09-30T14:55:18.217683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5628362-c86660b1-537d3991-79215a32_0] Write session: Do CDS request
2025-09-30T14:55:18.217691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5628362-c86660b1-537d3991-79215a32_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:18.228592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5628362-c86660b1-537d3991-79215a32_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:18.228541Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:18.228559Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1824
2025-09-30T14:55:18.228939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1824 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:18.229020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1824 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:18.229032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1824 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:18.229037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:18.229900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1824 sessionId:  describe result for acl check
2025-09-30T14:55:18.229953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:18.229965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:18.229967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:18.229974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895954507504738:6949] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:18.230595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895954507504738:6949] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:18.233481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895954507504738:6949] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:18.235200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:18.238148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:18.238405Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:18.238416Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:18.238428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:18.238490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:18.238536Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895954417736319:5487]
2025-09-30T14:55:18.238766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895954507504738:6949] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:18.238788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895954507504738:6949] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:18.238793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895954507504738:6949] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:18.238803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1824 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:18.239207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:18.239604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:18.239690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:18.240081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:18.240143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:18.240150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:18.240152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:18.240153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:18.240154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:18.240156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:18.240157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:18.240158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:18.240160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:18.240161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:18.240162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.240164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.240165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.240166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:18.240167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:18.240173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:18.240184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:18.240188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:18.240192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:18.240197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:18.240202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:18.240206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:18.240211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:18.240215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:18.240219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:18.240223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.240227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.240232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.240236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:18.240240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:18.240248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:18.240256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:18.240264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:18.240270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:18.240275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:18.240281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:18.240286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:18.240292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:18.240297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:18.240303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:18.240322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:18.240335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:18.240341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:18.240348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:18.240352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:18.240357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:18.240361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:18.240366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:18.240370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:18.240377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:18.240381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.240386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.240390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.240395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.240400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.240406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.240413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:18.240418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:18.240431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:18.240435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:18.240480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:18.246297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:18.247266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:18.247282Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:18.247286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:18.247290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:18.247297Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1823 [2:7555895954417736319:5487]
2025-09-30T14:55:18.247316Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:18.247336Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:18.247346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:18.247350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:18.247353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:18.247369Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:18.247382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:18.247394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:18.247465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.247473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.247475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.247479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:18.247483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:18.247566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:18.247579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.247596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.247612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.247636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:18.247678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895954507504860:6949], now have 1 active actors on pipe
2025-09-30T14:55:18.247683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895954507504704:2454], now have 1 active actors on pipe
2025-09-30T14:55:18.247691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895954417736314:5487]
2025-09-30T14:55:18.247749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1823
2025-09-30T14:55:18.247711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895954417736314:5487]
2025-09-30T14:55:18.247752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1823
2025-09-30T14:55:18.247714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895954417736314:5487]
2025-09-30T14:55:18.247730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:18.247749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:18.247750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:18.247753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:18.247755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:18.247770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:18.247776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:18.247824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895954417736314:5487]
2025-09-30T14:55:18.247838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:18.247842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:18.247873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:18.247889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:18.247959Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f923cee9-d0f41b7b-c2054f22-982f8596_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:18.247977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:18.247982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:18.247985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:18.247998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:18.248011Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:18.248037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:18.248199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:18.248211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:18.248234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:18.248336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1824 partition: 0 MaxSeqNo: 42 sessionId: src_id|f923cee9-d0f41b7b-c2054f22-982f8596_0
2025-09-30T14:55:18.250581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5628362-c86660b1-537d3991-79215a32_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f923cee9-d0f41b7b-c2054f22-982f8596_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:18.254129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f923cee9-d0f41b7b-c2054f22-982f8596_0] Write session: try to update token
2025-09-30T14:55:18.254165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f923cee9-d0f41b7b-c2054f22-982f8596_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:18.263215Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:18.263264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:18.263267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:18.263269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:18.263279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895954417736314:5487]
2025-09-30T14:55:18.263285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895954417736314:5487]
2025-09-30T14:55:18.263289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895954417736314:5487]
2025-09-30T14:55:18.263335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:18.263352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.263352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:18.263355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:18.263359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:18.263363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:18.263505Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:18.282569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1824 sessionId: src_id|f923cee9-d0f41b7b-c2054f22-982f8596_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:18.286237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:18.317297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895954507504872:7118]
2025-09-30T14:55:18.317766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1823, pipe: [1:7555895954507504872:7118]
2025-09-30T14:55:18.382708Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:18.383407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:18.383430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:18.383454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895954507504872:7118], now have 1 active actors on pipe
2025-09-30T14:55:18.383696Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:18.384639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f923cee9-d0f41b7b-c2054f22-982f8596_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:18.384658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f923cee9-d0f41b7b-c2054f22-982f8596_0] Write session will restart in 0.006619s
2025-09-30T14:55:18.384690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f923cee9-d0f41b7b-c2054f22-982f8596_0] Write session: Do CDS request
2025-09-30T14:55:18.384698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f923cee9-d0f41b7b-c2054f22-982f8596_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:18.384064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895954507504872:7118]
2025-09-30T14:55:18.384098Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:18.384134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:18.384137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:18.384200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1824 reason: error at write: Disconnected sessionId: src_id|f923cee9-d0f41b7b-c2054f22-982f8596_0
2025-09-30T14:55:18.384402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1824 sessionId: src_id|f923cee9-d0f41b7b-c2054f22-982f8596_0 is DEAD
2025-09-30T14:55:18.393042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f923cee9-d0f41b7b-c2054f22-982f8596_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:18.393567Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:18.393588Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1825
2025-09-30T14:55:18.393869Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1825 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:18.393919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1825 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:18.393925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1825 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:18.393931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:18.394456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1825 sessionId:  describe result for acl check
2025-09-30T14:55:18.394507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:18.394514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:18.394516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:18.394523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895954507504886:6946] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:18.395110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895954507504886:6946] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:18.397168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895954507504886:6946] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:18.400667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895954507504886:6946] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:18.400688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895954507504886:6946] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:18.400692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895954507504886:6946] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:18.400711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1825 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:18.406693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:18.409397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:18.409692Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:18.409704Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:18.409717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:18.409784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:18.409836Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895954417736482:5483]
2025-09-30T14:55:18.410585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:18.411007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:18.411073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:18.411629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:18.411732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:18.411741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:18.411742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:18.411744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:18.411745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:18.411747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:18.411748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:18.411749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:18.411751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:18.411752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:18.411753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.411755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.411756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.411757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:18.411759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:18.411767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:18.411779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:18.411783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:18.411788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:18.411794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:18.411799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:18.411803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:18.411807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:18.411812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:18.411817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:18.411821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.411825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.411830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.411834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:18.411838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:18.411848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:18.411858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:18.411865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:18.411870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:18.411875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:18.411882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:18.411887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:18.411898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:18.411903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:18.411909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:18.411914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:18.411920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:18.411931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:18.411937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:18.411948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:18.411953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:18.411964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:18.411969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:18.411979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:18.411984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:18.411994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.412000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.412009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.412015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.412025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.412030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.412039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:18.412044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:18.412054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:18.412060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:18.412110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:18.420085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:18.421091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:18.421114Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:18.421117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:18.421122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:18.421129Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1824 [2:7555895954417736482:5483]
2025-09-30T14:55:18.421152Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:18.421172Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:18.421180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:18.421184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:18.421187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:18.421204Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:18.421211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:18.421229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:18.421306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.421313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.421316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.421319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:18.421322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:18.421398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:18.421406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.421421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.421433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.421454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:18.421475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895954417736477:5483]
2025-09-30T14:55:18.421482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895954417736477:5483]
2025-09-30T14:55:18.421485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895954417736477:5483]
2025-09-30T14:55:18.421494Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:18.421504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:18.421516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895954507504972:6946], now have 1 active actors on pipe
2025-09-30T14:55:18.421523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895954507504873:2454], now have 1 active actors on pipe
2025-09-30T14:55:18.421524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:18.421528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:18.421534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:18.421551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:18.421559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:18.421601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895954417736477:5483]
2025-09-30T14:55:18.421614Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:18.421640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:18.421751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1824
2025-09-30T14:55:18.421792Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1824
2025-09-30T14:55:18.421972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:18.421986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:18.422018Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e62e8ab-f0f4aeb7-8f0826e-404f922f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:18.422037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:18.422042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:18.422045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:18.422061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:18.422073Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:18.422092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:18.422359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:18.422371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:18.422391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:18.422566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1825 partition: 0 MaxSeqNo: 42 sessionId: src_id|9e62e8ab-f0f4aeb7-8f0826e-404f922f_0
2025-09-30T14:55:18.423096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f923cee9-d0f41b7b-c2054f22-982f8596_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9e62e8ab-f0f4aeb7-8f0826e-404f922f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:18.426485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e62e8ab-f0f4aeb7-8f0826e-404f922f_0] Write session: try to update token
2025-09-30T14:55:18.426507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e62e8ab-f0f4aeb7-8f0826e-404f922f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:18.437817Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:18.437840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:18.437843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:18.437845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:18.437855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895954417736477:5483]
2025-09-30T14:55:18.437860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895954417736477:5483]
2025-09-30T14:55:18.437864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895954417736477:5483]
2025-09-30T14:55:18.437912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:18.437912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:18.437917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:18.437920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:18.437921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.437924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:18.438067Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:18.445140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1825 sessionId: src_id|9e62e8ab-f0f4aeb7-8f0826e-404f922f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:18.448319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:18.484129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895954507505042:7118]
2025-09-30T14:55:18.484504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1824, pipe: [1:7555895954507505042:7118]
2025-09-30T14:55:18.552619Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:18.553007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:18.553022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:18.553040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895954507505042:7118], now have 1 active actors on pipe
2025-09-30T14:55:18.553223Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:18.553249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:18.553266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:18.553286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895954507505042:7118]
2025-09-30T14:55:18.553302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:18.553317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1825 reason: error at write: Disconnected sessionId: src_id|9e62e8ab-f0f4aeb7-8f0826e-404f922f_0
2025-09-30T14:55:18.553498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1825 sessionId: src_id|9e62e8ab-f0f4aeb7-8f0826e-404f922f_0 is DEAD
2025-09-30T14:55:18.553872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e62e8ab-f0f4aeb7-8f0826e-404f922f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:18.553884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e62e8ab-f0f4aeb7-8f0826e-404f922f_0] Write session will restart in 0.005512s
2025-09-30T14:55:18.553907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e62e8ab-f0f4aeb7-8f0826e-404f922f_0] Write session: Do CDS request
2025-09-30T14:55:18.553918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e62e8ab-f0f4aeb7-8f0826e-404f922f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:18.561133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e62e8ab-f0f4aeb7-8f0826e-404f922f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:18.562671Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:18.562693Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1826
2025-09-30T14:55:18.562847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1826 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:18.562882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1826 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:18.562893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1826 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:18.562897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:18.563312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1826 sessionId:  describe result for acl check
2025-09-30T14:55:18.563345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:18.563354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:18.563356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:18.563362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895954507505104:6926] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:18.563905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895954507505104:6926] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:18.566198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895954507505104:6926] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:18.568810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:18.571460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:18.571694Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:18.571514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895954507505104:6926] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:18.571543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895954507505104:6926] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:18.571707Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:18.571547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895954507505104:6926] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:18.571556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1826 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:18.571719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:18.571778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:18.571817Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895954417736677:5447]
2025-09-30T14:55:18.572485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:18.572908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:18.572971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:18.573333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:18.573402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:18.573403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:18.573404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:18.573405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:18.573406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:18.573408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:18.573409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:18.573410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:18.573411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:18.573412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:18.573413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.573414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.573415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.573416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:18.573417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:18.573423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:18.573433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:18.573436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:18.573440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:18.573445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:18.573449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:18.573453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:18.573457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:18.573461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:18.573465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:18.573468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.573472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.573475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.573479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:18.573482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:18.573491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:18.573498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:18.573505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:18.573511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:18.573517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:18.573522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:18.573526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:18.573531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:18.573536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:18.573540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:18.573545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:18.573550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:18.573555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:18.573560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:18.573564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:18.573569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:18.573574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:18.573579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:18.573585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:18.573590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:18.573594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.573599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.573604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.573608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.573613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.573636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.573641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:18.573646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:18.573654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:18.573658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:18.573699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:18.579944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:18.581304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:18.581328Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:18.581330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:18.581334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:18.581342Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1825 [2:7555895954417736677:5447]
2025-09-30T14:55:18.581366Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:18.581382Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:18.581385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:18.581389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:18.581392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:18.581409Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:18.581422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:18.581429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:18.581494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.581501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.581502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.581506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:18.581507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:18.581563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:18.581569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.581581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.581591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.581601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:18.581626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895954417736671:5447]
2025-09-30T14:55:18.581632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895954417736671:5447]
2025-09-30T14:55:18.581634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895954417736671:5447]
2025-09-30T14:55:18.581641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:18.581651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:18.581665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:18.581664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:18.581668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:18.581671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:18.581672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:18.581707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895954507505068:2454], now have 1 active actors on pipe
2025-09-30T14:55:18.581713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895954507505223:6926], now have 1 active actors on pipe
2025-09-30T14:55:18.581716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895954417736671:5447]
2025-09-30T14:55:18.581721Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:18.581733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:18.581807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1825
2025-09-30T14:55:18.581808Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1825
2025-09-30T14:55:18.582085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:18.582098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:18.582126Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|427ef78b-e9baf10c-343ff507-2f1979e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:18.582141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:18.582152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:18.582155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:18.582166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:18.582181Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:18.582198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:18.582407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:18.582418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:18.582432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:18.582567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1826 partition: 0 MaxSeqNo: 42 sessionId: src_id|427ef78b-e9baf10c-343ff507-2f1979e3_0
2025-09-30T14:55:18.582999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e62e8ab-f0f4aeb7-8f0826e-404f922f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|427ef78b-e9baf10c-343ff507-2f1979e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:18.586594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|427ef78b-e9baf10c-343ff507-2f1979e3_0] Write session: try to update token
2025-09-30T14:55:18.586624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|427ef78b-e9baf10c-343ff507-2f1979e3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:18.593635Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:18.593654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:18.593664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895954417736671:5447]
2025-09-30T14:55:18.593706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:18.593708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:18.593898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:18.594073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:18.594237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:18.594392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:18.594825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:18.594883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:18.605312Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:18.605344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:18.605348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:18.605350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:18.605362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895954417736671:5447]
2025-09-30T14:55:18.605367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895954417736671:5447]
2025-09-30T14:55:18.605372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895954417736671:5447]
2025-09-30T14:55:18.605420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:18.605428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.605432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:18.605450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:18.605457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:18.605471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:18.605602Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:18.606257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1826 sessionId: src_id|427ef78b-e9baf10c-343ff507-2f1979e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:18.609586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:18.653685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895954507505237:7118]
2025-09-30T14:55:18.659095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1825, pipe: [1:7555895954507505237:7118]
2025-09-30T14:55:18.719990Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:18.720452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:18.720472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:18.720495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895954507505237:7118], now have 1 active actors on pipe
2025-09-30T14:55:18.720774Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:18.723315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:18.723367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895954507505237:7118]
2025-09-30T14:55:18.723373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:18.723449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1826 reason: status is not ok: tablet will be restarted right now sessionId: src_id|427ef78b-e9baf10c-343ff507-2f1979e3_0
2025-09-30T14:55:18.723702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1826 sessionId: src_id|427ef78b-e9baf10c-343ff507-2f1979e3_0 is DEAD
2025-09-30T14:55:18.723963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|427ef78b-e9baf10c-343ff507-2f1979e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:18.723982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|427ef78b-e9baf10c-343ff507-2f1979e3_0] Write session will restart in 0.005234s
2025-09-30T14:55:18.724015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|427ef78b-e9baf10c-343ff507-2f1979e3_0] Write session: Do CDS request
2025-09-30T14:55:18.724035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|427ef78b-e9baf10c-343ff507-2f1979e3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:18.730984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|427ef78b-e9baf10c-343ff507-2f1979e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:18.731095Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:18.731120Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1827
2025-09-30T14:55:18.731319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1827 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:18.731397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1827 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:18.731410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1827 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:18.731416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:18.732180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1827 sessionId:  describe result for acl check
2025-09-30T14:55:18.732243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:18.732255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:18.732258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:18.732270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895954507505308:6921] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:18.733036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895954507505308:6921] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:18.736495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895954507505308:6921] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:18.736978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:18.739592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:18.739831Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:18.739844Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:18.739855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:18.739924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:18.739968Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895954417736850:5442]
2025-09-30T14:55:18.740195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895954507505308:6921] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:18.740218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895954507505308:6921] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:18.740222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895954507505308:6921] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:18.740231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1827 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:18.740679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:18.740995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:18.741052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:18.741418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:18.741482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:18.741489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:18.741490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:18.741492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:18.741493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:18.741495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:18.741496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:18.741498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:18.741499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:18.741501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:18.741503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.741504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.741506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.741507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:18.741508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:18.741514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:18.741526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:18.741531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:18.741536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:18.741541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:18.741545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:18.741551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:18.741555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:18.741560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:18.741565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:18.741569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.741574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.741578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.741594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:18.741598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:18.741605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:18.741625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:18.741632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:18.741637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:18.741642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:18.741649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:18.741653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:18.741659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:18.741673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:18.741679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:18.741683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:18.741688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:18.741693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:18.741698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:18.741712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:18.741722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:18.741727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:18.741732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:18.741738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:18.741743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:18.741748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.741755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.741760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.741766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.741771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.741781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.741785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:18.741791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:18.741798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:18.741803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:18.741851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:18.748882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:18.749967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:18.749982Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:18.749988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:18.749992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:18.750000Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1826 [2:7555895954417736850:5442]
2025-09-30T14:55:18.750018Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:18.750036Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:18.750043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:18.750047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:18.750049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:18.750066Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:18.750077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:18.750084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:18.750150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.750157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.750160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.750164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:18.750167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:18.750232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:18.750243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.750255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.750268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.750285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:18.750301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895954417736845:5442]
2025-09-30T14:55:18.750304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895954417736845:5442]
2025-09-30T14:55:18.750306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895954417736845:5442]
2025-09-30T14:55:18.750314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:18.750328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:18.750330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:18.750334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:18.750336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:18.750343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:18.750347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:18.750355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895954507505253:2454], now have 1 active actors on pipe
2025-09-30T14:55:18.750359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895954507505408:6921], now have 1 active actors on pipe
2025-09-30T14:55:18.750395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895954417736845:5442]
2025-09-30T14:55:18.750403Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:18.750425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:18.750859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1826
2025-09-30T14:55:18.750887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1826
2025-09-30T14:55:18.751048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:18.751063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:18.751089Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f7517a8-8c7fe779-ecb3907a-664630e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:18.751099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:18.751111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:18.751114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:18.751126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:18.751138Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:18.751159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:18.751403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:18.751415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:18.751455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:18.751543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1827 partition: 0 MaxSeqNo: 42 sessionId: src_id|8f7517a8-8c7fe779-ecb3907a-664630e7_0
2025-09-30T14:55:18.751968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|427ef78b-e9baf10c-343ff507-2f1979e3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8f7517a8-8c7fe779-ecb3907a-664630e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:18.755439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f7517a8-8c7fe779-ecb3907a-664630e7_0] Write session: try to update token
2025-09-30T14:55:18.755462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f7517a8-8c7fe779-ecb3907a-664630e7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:18.764573Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:18.764593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:18.764604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895954417736845:5442]
2025-09-30T14:55:18.764653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:18.764654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:18.764848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:18.764997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:18.765152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:18.765305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:18.765527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:18.765575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:18.774682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1827 sessionId: src_id|8f7517a8-8c7fe779-ecb3907a-664630e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:18.775828Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:18.775845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:18.775847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:18.775849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:18.775857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895954417736845:5442]
2025-09-30T14:55:18.775861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895954417736845:5442]
2025-09-30T14:55:18.775866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895954417736845:5442]
2025-09-30T14:55:18.775899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:18.775906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.775908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:18.775917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:18.775925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:18.775929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:18.776039Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:18.778090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:18.823620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895954507505420:7118]
2025-09-30T14:55:18.823963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1826, pipe: [1:7555895954507505420:7118]
2025-09-30T14:55:18.890176Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:18.890621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:18.890641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:18.890663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895954507505420:7118], now have 1 active actors on pipe
2025-09-30T14:55:18.890895Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:18.890913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:18.890928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895954507505420:7118]
2025-09-30T14:55:18.890952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:18.891035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1827 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8f7517a8-8c7fe779-ecb3907a-664630e7_0
2025-09-30T14:55:18.891218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1827 sessionId: src_id|8f7517a8-8c7fe779-ecb3907a-664630e7_0 is DEAD
2025-09-30T14:55:18.891441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f7517a8-8c7fe779-ecb3907a-664630e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:18.891461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f7517a8-8c7fe779-ecb3907a-664630e7_0] Write session will restart in 0.005713s
2025-09-30T14:55:18.891502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f7517a8-8c7fe779-ecb3907a-664630e7_0] Write session: Do CDS request
2025-09-30T14:55:18.891509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f7517a8-8c7fe779-ecb3907a-664630e7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:18.898913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f7517a8-8c7fe779-ecb3907a-664630e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:18.899027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:18.899045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1828
2025-09-30T14:55:18.899255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1828 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:18.899294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1828 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:18.899304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1828 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:18.899309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:18.899898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1828 sessionId:  describe result for acl check
2025-09-30T14:55:18.899935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:18.899943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:18.899944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:18.899951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895954507505484:6917] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:18.900506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895954507505484:6917] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:18.902947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895954507505484:6917] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:18.903762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:18.906014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:18.906171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895954507505484:6917] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:18.906187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895954507505484:6917] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:18.906191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895954507505484:6917] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:18.906200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1828 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:18.906210Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:18.906222Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:18.906244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:18.906296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:18.906340Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895954417737014:5433]
2025-09-30T14:55:18.907028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:18.907325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:18.907368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:18.907688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:18.907752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:18.907759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:18.907760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:18.907761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:18.907762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:18.907764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:18.907765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:18.907767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:18.907768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:18.907769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:18.907771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.907772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.907773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.907775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:18.907776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:18.907782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:18.907792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:18.907797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:18.907802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:18.907806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:18.907811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:18.907816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:18.907820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:18.907825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:18.907830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:18.907835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.907839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.907844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.907848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:18.907852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:18.907860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:18.907869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:18.907876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:18.907882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:18.907888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:18.907895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:18.907900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:18.907906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:18.907911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:18.907917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:18.907928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:18.907934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:18.907940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:18.907952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:18.907957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:18.907967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:18.907972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:18.907982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:18.907988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:18.907998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:18.908004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.908014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.908020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.908031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.908036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.908042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.908062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:18.908073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:18.908078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:18.908088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:18.908136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:18.914172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:18.915314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:18.915329Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:18.915332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:18.915336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:18.915343Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1827 [2:7555895954417737014:5433]
2025-09-30T14:55:18.915362Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:18.915379Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:18.915387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:18.915391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:18.915393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:18.915408Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:18.915419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:18.915425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:18.915480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.915487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.915489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.915493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:18.915496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:18.915558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:18.915565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.915578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:18.915597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:18.915620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:18.915642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895954507505582:6917], now have 1 active actors on pipe
2025-09-30T14:55:18.915650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895954507505421:2454], now have 1 active actors on pipe
2025-09-30T14:55:18.915657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895954417737009:5433]
2025-09-30T14:55:18.915661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895954417737009:5433]
2025-09-30T14:55:18.915668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895954417737009:5433]
2025-09-30T14:55:18.915681Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:18.915698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:18.915707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:18.915710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:18.915713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:18.915717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:18.915720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:18.915752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895954417737009:5433]
2025-09-30T14:55:18.915767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:18.915756Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1827
2025-09-30T14:55:18.915794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:18.915806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:18.915759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1827
2025-09-30T14:55:18.915810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:18.915840Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b14d8b0-2da35013-6c55d02b-61e9adfb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:18.915852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:18.915856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:18.915863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:18.915872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:18.915885Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:18.915903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:18.916062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:18.916069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:18.916082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:18.916176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1828 partition: 0 MaxSeqNo: 42 sessionId: src_id|6b14d8b0-2da35013-6c55d02b-61e9adfb_0
2025-09-30T14:55:18.916607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f7517a8-8c7fe779-ecb3907a-664630e7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6b14d8b0-2da35013-6c55d02b-61e9adfb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:18.920026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b14d8b0-2da35013-6c55d02b-61e9adfb_0] Write session: try to update token
2025-09-30T14:55:18.920050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b14d8b0-2da35013-6c55d02b-61e9adfb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:18.928388Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:18.928409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:18.928419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895954417737009:5433]
2025-09-30T14:55:18.928466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:18.928472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:18.928642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:18.928794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:18.928929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:18.929072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:18.929273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:18.929315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:18.939593Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:18.939622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:18.939626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:18.939628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:18.939640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895954417737009:5433]
2025-09-30T14:55:18.939644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895954417737009:5433]
2025-09-30T14:55:18.939648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895954417737009:5433]
2025-09-30T14:55:18.939687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:18.939696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:18.939702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:18.939709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:18.939710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:18.939713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:18.939860Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:18.941292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1828 sessionId: src_id|6b14d8b0-2da35013-6c55d02b-61e9adfb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:18.944261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:18.991063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895954507505594:7118]
2025-09-30T14:55:18.991446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1827, pipe: [1:7555895954507505594:7118]
2025-09-30T14:55:19.052544Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:19.052976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:19.052997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:19.053023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895954507505594:7118], now have 1 active actors on pipe
2025-09-30T14:55:19.053249Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:19.053264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895954507505594:7118]
2025-09-30T14:55:19.053300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:19.053306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:19.053311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:19.053379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1828 reason: error at write: Disconnected sessionId: src_id|6b14d8b0-2da35013-6c55d02b-61e9adfb_0
2025-09-30T14:55:19.053565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1828 sessionId: src_id|6b14d8b0-2da35013-6c55d02b-61e9adfb_0 is DEAD
2025-09-30T14:55:19.053729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b14d8b0-2da35013-6c55d02b-61e9adfb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:19.053741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b14d8b0-2da35013-6c55d02b-61e9adfb_0] Write session will restart in 0.007107s
2025-09-30T14:55:19.053766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b14d8b0-2da35013-6c55d02b-61e9adfb_0] Write session: Do CDS request
2025-09-30T14:55:19.053776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b14d8b0-2da35013-6c55d02b-61e9adfb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:19.061829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b14d8b0-2da35013-6c55d02b-61e9adfb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:19.062027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:19.062056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1829
2025-09-30T14:55:19.062173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1829 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:19.062203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1829 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:19.062213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1829 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:19.062218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:19.062740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1829 sessionId:  describe result for acl check
2025-09-30T14:55:19.062780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:19.062789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:19.062791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:19.062797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895958802472965:6913] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:19.063377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895958802472965:6913] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:19.065488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:19.065564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895958802472965:6913] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:19.067663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:19.067953Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:19.067966Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:19.067981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:19.068018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895958802472965:6913] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:19.068033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895958802472965:6913] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:19.068045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:19.068037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895958802472965:6913] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:19.068046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1829 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:19.068089Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895958712704473:5431]
2025-09-30T14:55:19.068703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:19.068976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:19.069017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:19.069350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:19.069417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:19.069423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:19.069424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:19.069426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:19.069427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:19.069428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:19.069429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:19.069430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:19.069432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:19.069433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:19.069434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.069436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.069437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.069438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:19.069439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:19.069444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:19.069455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:19.069459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:19.069463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:19.069468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:19.069472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:19.069477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:19.069481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:19.069485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:19.069490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:19.069494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.069498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.069502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.069506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:19.069510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:19.069518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:19.069526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:19.069531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:19.069537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:19.069541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:19.069546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:19.069551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:19.069556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:19.069560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:19.069566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:19.069571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:19.069576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:19.069581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:19.069587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:19.069591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:19.069596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:19.069604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:19.069609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:19.069627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:19.069633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:19.069640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.069643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.069646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.069649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.069651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.069654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.069657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:19.069660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:19.069662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:19.069665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:19.069691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:19.075356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:19.076321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:19.076336Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:19.076340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:19.076344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:19.076350Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1828 [2:7555895958712704473:5431]
2025-09-30T14:55:19.076367Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:19.076384Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:19.076387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:19.076390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:19.076393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:19.076410Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:19.076422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:19.076428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:19.076493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.076500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.076503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.076507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:19.076510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:19.076578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:19.076586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.076599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.076616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.076639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:19.076661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895958802473052:6913], now have 1 active actors on pipe
2025-09-30T14:55:19.076669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895958802472891:2454], now have 1 active actors on pipe
2025-09-30T14:55:19.076675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895958712704468:5431]
2025-09-30T14:55:19.076677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895958712704468:5431]
2025-09-30T14:55:19.076680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895958712704468:5431]
2025-09-30T14:55:19.076690Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:19.076703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:19.076705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:19.076714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:19.076715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:19.076716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:19.076717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:19.076745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895958712704468:5431]
2025-09-30T14:55:19.076756Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:19.076762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:19.076768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1828
2025-09-30T14:55:19.076776Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1828
2025-09-30T14:55:19.076822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:19.076831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:19.076852Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68c81eb2-f0c55881-84630964-6e018afb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:19.076857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:19.076860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:19.076862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:19.076870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:19.076882Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:19.076898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:19.077025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:19.077032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:19.077045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:19.077141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1829 partition: 0 MaxSeqNo: 42 sessionId: src_id|68c81eb2-f0c55881-84630964-6e018afb_0
2025-09-30T14:55:19.077481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b14d8b0-2da35013-6c55d02b-61e9adfb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|68c81eb2-f0c55881-84630964-6e018afb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:19.080628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68c81eb2-f0c55881-84630964-6e018afb_0] Write session: try to update token
2025-09-30T14:55:19.080651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68c81eb2-f0c55881-84630964-6e018afb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:19.089669Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:19.089694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:19.089705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895958712704468:5431]
2025-09-30T14:55:19.089751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:19.089764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:19.089945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:19.090097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:19.090246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:19.090410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:19.090622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:19.090666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:19.097919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1829 sessionId: src_id|68c81eb2-f0c55881-84630964-6e018afb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:19.100934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:19.101491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:19.101520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:19.101541Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:19.101544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:19.101547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:19.101550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:19.101559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895958712704468:5431]
2025-09-30T14:55:19.101566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895958712704468:5431]
2025-09-30T14:55:19.101571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895958712704468:5431]
2025-09-30T14:55:19.101635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:19.101641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:19.101648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.101651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:19.101652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:19.101661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:19.101814Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:19.154427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895958802473069:7118]
2025-09-30T14:55:19.154757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1828, pipe: [1:7555895958802473069:7118]
2025-09-30T14:55:19.218456Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:19.218798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:19.218828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895958802473069:7118], now have 1 active actors on pipe
2025-09-30T14:55:19.218967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:19.219010Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:19.219070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895958802473069:7118]
2025-09-30T14:55:19.219077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:19.219080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:19.219165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1829 reason: error at write: Disconnected sessionId: src_id|68c81eb2-f0c55881-84630964-6e018afb_0
2025-09-30T14:55:19.219346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1829 sessionId: src_id|68c81eb2-f0c55881-84630964-6e018afb_0 is DEAD
2025-09-30T14:55:19.219522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68c81eb2-f0c55881-84630964-6e018afb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:19.219535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68c81eb2-f0c55881-84630964-6e018afb_0] Write session will restart in 0.008171s
2025-09-30T14:55:19.219557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68c81eb2-f0c55881-84630964-6e018afb_0] Write session: Do CDS request
2025-09-30T14:55:19.219563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68c81eb2-f0c55881-84630964-6e018afb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:19.231590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68c81eb2-f0c55881-84630964-6e018afb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:19.231728Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:19.231752Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1830
2025-09-30T14:55:19.231917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1830 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:19.231958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1830 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:19.231969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1830 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:19.231975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:19.232462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1830 sessionId:  describe result for acl check
2025-09-30T14:55:19.232506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:19.232514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:19.232517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:19.232523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895958802473187:6907] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:19.233093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895958802473187:6907] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:19.234493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:19.235034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895958802473187:6907] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:19.236865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:19.237063Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:19.237076Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:19.237088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:19.237155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:19.237207Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895958712704637:5426]
2025-09-30T14:55:19.237853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:19.238147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:19.238193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:19.238179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895958802473187:6907] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:19.238195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895958802473187:6907] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:19.238200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895958802473187:6907] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:19.238222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1830 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:19.238503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:19.238577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:19.238583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:19.238584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:19.238586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:19.238587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:19.238588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:19.238590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:19.238591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:19.238593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:19.238594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:19.238595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.238596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.238598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.238599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:19.238601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:19.238606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:19.238616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:19.238620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:19.238624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:19.238627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:19.238631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:19.238635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:19.238639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:19.238644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:19.238649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:19.238653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.238657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.238661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.238665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:19.238669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:19.238676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:19.238685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:19.238691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:19.238697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:19.238702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:19.238708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:19.238713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:19.238718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:19.238723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:19.238729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:19.238733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:19.238738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:19.238744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:19.238749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:19.238753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:19.238759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:19.238764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:19.238769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:19.238774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:19.238779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:19.238784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.238789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.238793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.238799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.238808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.238813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.238817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:19.238827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:19.238832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:19.238837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:19.238887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:19.244723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:19.245719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:19.245744Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:19.245747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:19.245752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:19.245760Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1829 [2:7555895958712704637:5426]
2025-09-30T14:55:19.245778Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:19.245797Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:19.245806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:19.245809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:19.245812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:19.245831Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:19.245845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:19.245853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:19.245923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.245934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.245937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.245940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:19.245944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:19.246311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:19.246329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.246342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.246353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.246371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:19.246395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895958802473073:2454], now have 1 active actors on pipe
2025-09-30T14:55:19.246405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895958802473236:6907], now have 1 active actors on pipe
2025-09-30T14:55:19.246411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895958712704632:5426]
2025-09-30T14:55:19.246337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1829
2025-09-30T14:55:19.246416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895958712704632:5426]
2025-09-30T14:55:19.246385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1829
2025-09-30T14:55:19.246418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895958712704632:5426]
2025-09-30T14:55:19.246435Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:19.246450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:19.246469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:19.246473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:19.246479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:19.246485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:19.246492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:19.246519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895958712704632:5426]
2025-09-30T14:55:19.246529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:19.246541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:19.246568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:19.246579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:19.246612Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ecfde699-f975bf18-d5408773-340b2cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:19.246626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:19.246631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:19.246633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:19.246645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:19.246656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:19.246673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:19.246879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:19.246889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:19.246905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:19.247055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1830 partition: 0 MaxSeqNo: 42 sessionId: src_id|ecfde699-f975bf18-d5408773-340b2cd_0
2025-09-30T14:55:19.247513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68c81eb2-f0c55881-84630964-6e018afb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ecfde699-f975bf18-d5408773-340b2cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:19.250546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecfde699-f975bf18-d5408773-340b2cd_0] Write session: try to update token
2025-09-30T14:55:19.250569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecfde699-f975bf18-d5408773-340b2cd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:19.259686Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:19.259711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:19.259713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:19.259716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:19.259725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895958712704632:5426]
2025-09-30T14:55:19.259730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895958712704632:5426]
2025-09-30T14:55:19.259734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895958712704632:5426]
2025-09-30T14:55:19.259774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:19.259782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.259783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:19.259784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:19.259798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:19.259802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:19.259944Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:19.266436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1830 sessionId: src_id|ecfde699-f975bf18-d5408773-340b2cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:19.269420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:19.319275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895958802473247:7118]
2025-09-30T14:55:19.321070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1829, pipe: [1:7555895958802473247:7118]
2025-09-30T14:55:19.330413Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] Counters: { Errors: 18 CurrentSessionLifetimeMs: 301374 BytesRead: 38297624 MessagesRead: 17 BytesReadCompressed: 38297624 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 2252802 BytesInflightTotal: 4505604 MessagesInflight: 2 }
2025-09-30T14:55:19.376183Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:19.376564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:19.376581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:19.376603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895958802473247:7118], now have 1 active actors on pipe
2025-09-30T14:55:19.376800Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:19.376858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:19.376879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895958802473247:7118]
2025-09-30T14:55:19.376910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:19.376996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1830 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ecfde699-f975bf18-d5408773-340b2cd_0
2025-09-30T14:55:19.377273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1830 sessionId: src_id|ecfde699-f975bf18-d5408773-340b2cd_0 is DEAD
2025-09-30T14:55:19.377419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecfde699-f975bf18-d5408773-340b2cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:19.377431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecfde699-f975bf18-d5408773-340b2cd_0] Write session will restart in 0.008798s
2025-09-30T14:55:19.377461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecfde699-f975bf18-d5408773-340b2cd_0] Write session: Do CDS request
2025-09-30T14:55:19.377467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecfde699-f975bf18-d5408773-340b2cd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:19.387705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecfde699-f975bf18-d5408773-340b2cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:19.387780Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:19.387797Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1831
2025-09-30T14:55:19.387937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1831 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:19.387968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1831 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:19.387978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1831 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:19.387983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:19.388457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1831 sessionId:  describe result for acl check
2025-09-30T14:55:19.388498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:19.388505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:19.388507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:19.388514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895958802473359:6904] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:19.388971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895958802473359:6904] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:19.390573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:19.390795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895958802473359:6904] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:19.392753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:19.392999Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:19.393012Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:19.393024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:19.393078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:19.393113Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895958712704804:5423]
2025-09-30T14:55:19.393097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895958802473359:6904] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:19.393113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895958802473359:6904] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:19.393116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895958802473359:6904] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:19.393124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1831 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:19.393794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:19.394138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:19.394186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:19.394533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:19.394596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:19.394601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:19.394603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:19.394604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:19.394605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:19.394607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:19.394608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:19.394609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:19.394610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:19.394612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:19.394613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.394614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.394616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.394617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:19.394618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:19.394623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:19.394635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:19.394639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:19.394643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:19.394647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:19.394651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:19.394653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:19.394656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:19.394658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:19.394661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:19.394663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.394665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.394667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.394670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:19.394673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:19.394680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:19.394689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:19.394695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:19.394701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:19.394705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:19.394712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:19.394714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:19.394717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:19.394721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:19.394724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:19.394726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:19.394730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:19.394732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:19.394735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:19.394738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:19.394741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:19.394744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:19.394746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:19.394749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:19.394753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:19.394759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.394762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.394764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.394767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.394770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.394773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.394775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:19.394778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:19.394780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:19.394786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:19.394826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:19.400744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:19.401738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:19.401756Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:19.401760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:19.401764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:19.401771Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1830 [2:7555895958712704804:5423]
2025-09-30T14:55:19.401790Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:19.401808Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:19.401816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:19.401820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:19.401823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:19.401842Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:19.401852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:19.401863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:19.401913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.401920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.401923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.401926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:19.401929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:19.401995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:19.402001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.402014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.402025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.402043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:19.402063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895958802473248:2454], now have 1 active actors on pipe
2025-09-30T14:55:19.402077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895958712704799:5423]
2025-09-30T14:55:19.402083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895958712704799:5423]
2025-09-30T14:55:19.402086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895958712704799:5423]
2025-09-30T14:55:19.402098Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:19.402111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895958802473411:6904], now have 1 active actors on pipe
2025-09-30T14:55:19.402121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:19.402139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:19.402147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:19.402162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:19.402173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:19.402176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:19.402182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895958712704799:5423]
2025-09-30T14:55:19.402186Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:19.402188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:19.402194Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1830
2025-09-30T14:55:19.402243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1830
2025-09-30T14:55:19.402358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:19.402373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:19.402401Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4df50d3c-6ddb6933-fd2db4cf-f9a7e38a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:19.402410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:19.402414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:19.402416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:19.402429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:19.402440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:19.402456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:19.402651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:19.402662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:19.402677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:19.402785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1831 partition: 0 MaxSeqNo: 42 sessionId: src_id|4df50d3c-6ddb6933-fd2db4cf-f9a7e38a_0
2025-09-30T14:55:19.403180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecfde699-f975bf18-d5408773-340b2cd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4df50d3c-6ddb6933-fd2db4cf-f9a7e38a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:19.406140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4df50d3c-6ddb6933-fd2db4cf-f9a7e38a_0] Write session: try to update token
2025-09-30T14:55:19.406165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4df50d3c-6ddb6933-fd2db4cf-f9a7e38a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:19.414789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:19.414868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:19.414871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:19.414874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:19.414887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895958712704799:5423]
2025-09-30T14:55:19.414893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895958712704799:5423]
2025-09-30T14:55:19.414900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895958712704799:5423]
2025-09-30T14:55:19.414953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:19.414969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.414979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:19.415168Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:19.419313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:19.419350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:19.419355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:19.421884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1831 sessionId: src_id|4df50d3c-6ddb6933-fd2db4cf-f9a7e38a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:19.424963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:19.476942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895958802473422:7118]
2025-09-30T14:55:19.477189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1830, pipe: [1:7555895958802473422:7118]
2025-09-30T14:55:19.528458Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:19.529077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:19.529110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:19.529133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895958802473422:7118], now have 1 active actors on pipe
2025-09-30T14:55:19.529350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895958802473422:7118]
2025-09-30T14:55:19.529383Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:19.529399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:19.529402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:19.529460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1831 reason: error at write: Disconnected sessionId: src_id|4df50d3c-6ddb6933-fd2db4cf-f9a7e38a_0
2025-09-30T14:55:19.529677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1831 sessionId: src_id|4df50d3c-6ddb6933-fd2db4cf-f9a7e38a_0 is DEAD
2025-09-30T14:55:19.529373Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:19.529839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4df50d3c-6ddb6933-fd2db4cf-f9a7e38a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:19.529852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4df50d3c-6ddb6933-fd2db4cf-f9a7e38a_0] Write session will restart in 0.009690s
2025-09-30T14:55:19.529876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4df50d3c-6ddb6933-fd2db4cf-f9a7e38a_0] Write session: Do CDS request
2025-09-30T14:55:19.529882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4df50d3c-6ddb6933-fd2db4cf-f9a7e38a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:19.540808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4df50d3c-6ddb6933-fd2db4cf-f9a7e38a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:19.540922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:19.540958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1832
2025-09-30T14:55:19.541113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1832 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:19.541150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1832 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:19.541156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1832 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:19.541162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:19.541647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1832 sessionId:  describe result for acl check
2025-09-30T14:55:19.541704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:19.541711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:19.541713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:19.541720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895958802473502:6893] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:19.542377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895958802473502:6893] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:19.544805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895958802473502:6893] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:19.546001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:19.548274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:19.548528Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:19.548540Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:19.548554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:19.548622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:19.548716Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895958712704970:5410]
2025-09-30T14:55:19.548752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895958802473502:6893] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:19.548774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895958802473502:6893] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:19.548801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895958802473502:6893] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:19.548816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1832 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:19.549336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:19.549715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:19.549796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:19.550219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:19.550299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:19.550307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:19.550309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:19.550310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:19.550312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:19.550313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:19.550314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:19.550316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:19.550317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:19.550319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:19.550321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.550322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.550324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.550326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:19.550328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:19.550335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:19.550346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:19.550350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:19.550355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:19.550360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:19.550364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:19.550369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:19.550374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:19.550378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:19.550383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:19.550388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.550392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.550396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.550400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:19.550404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:19.550414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:19.550422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:19.550430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:19.550436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:19.550441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:19.550446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:19.550451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:19.550458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:19.550463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:19.550470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:19.550475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:19.550480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:19.550485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:19.550492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:19.550499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:19.550505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:19.550511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:19.550517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:19.550531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:19.550536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:19.550542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.550548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.550552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.550557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.550571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.550577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.550581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:19.550587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:19.550591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:19.550597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:19.550645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:19.558578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:19.559554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:19.559573Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:19.559576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:19.559580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:19.559588Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1831 [2:7555895958712704970:5410]
2025-09-30T14:55:19.559605Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:19.559619Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:19.559623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:19.559626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:19.559631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:19.559649Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:19.559657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:19.559664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:19.559731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.559738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.559740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.559744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:19.559747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:19.559815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:19.559823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.559836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.559848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.559865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:19.559888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895958802473588:6893], now have 1 active actors on pipe
2025-09-30T14:55:19.559897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895958802473424:2454], now have 1 active actors on pipe
2025-09-30T14:55:19.559903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895958712704965:5410]
2025-09-30T14:55:19.559907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895958712704965:5410]
2025-09-30T14:55:19.559910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895958712704965:5410]
2025-09-30T14:55:19.559921Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:19.559936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:19.559936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:19.559939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:19.559941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:19.559955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:19.559958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:19.559949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1831
2025-09-30T14:55:19.559993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895958712704965:5410]
2025-09-30T14:55:19.559987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1831
2025-09-30T14:55:19.560001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:19.560018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:19.560018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:19.560027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:19.560073Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f1864c7-e61fb29e-92a11a18-b50913db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:19.560084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:19.560088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:19.560090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:19.560099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:19.560111Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:19.560139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:19.560392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:19.560402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:19.560418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:19.560530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1832 partition: 0 MaxSeqNo: 42 sessionId: src_id|2f1864c7-e61fb29e-92a11a18-b50913db_0
2025-09-30T14:55:19.560918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4df50d3c-6ddb6933-fd2db4cf-f9a7e38a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2f1864c7-e61fb29e-92a11a18-b50913db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:19.563984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1864c7-e61fb29e-92a11a18-b50913db_0] Write session: try to update token
2025-09-30T14:55:19.564004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1864c7-e61fb29e-92a11a18-b50913db_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:19.574745Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:19.574763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:19.574766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:19.574768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:19.574778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895958712704965:5410]
2025-09-30T14:55:19.574783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895958712704965:5410]
2025-09-30T14:55:19.574787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895958712704965:5410]
2025-09-30T14:55:19.574829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:19.574833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:19.574838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:19.574839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.574842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:19.574846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:19.574991Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:19.580867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1832 sessionId: src_id|2f1864c7-e61fb29e-92a11a18-b50913db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:19.583813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:19.629584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895958802473623:7118]
2025-09-30T14:55:19.629994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1831, pipe: [1:7555895958802473623:7118]
2025-09-30T14:55:19.699924Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:19.700244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:19.700260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:19.700303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895958802473623:7118], now have 1 active actors on pipe
2025-09-30T14:55:19.700640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:19.700646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:19.700651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:19.700713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895958802473623:7118]
2025-09-30T14:55:19.700780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1832 reason: error at write: Disconnected sessionId: src_id|2f1864c7-e61fb29e-92a11a18-b50913db_0
2025-09-30T14:55:19.700575Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:19.700991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1832 sessionId: src_id|2f1864c7-e61fb29e-92a11a18-b50913db_0 is DEAD
2025-09-30T14:55:19.701186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1864c7-e61fb29e-92a11a18-b50913db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:19.701196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1864c7-e61fb29e-92a11a18-b50913db_0] Write session will restart in 0.007224s
2025-09-30T14:55:19.701220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1864c7-e61fb29e-92a11a18-b50913db_0] Write session: Do CDS request
2025-09-30T14:55:19.701230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1864c7-e61fb29e-92a11a18-b50913db_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:19.709823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1864c7-e61fb29e-92a11a18-b50913db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:19.709901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:19.709920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1833
2025-09-30T14:55:19.710050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1833 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:19.710082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1833 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:19.710093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1833 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:19.710097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:19.710574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1833 sessionId:  describe result for acl check
2025-09-30T14:55:19.710623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:19.710625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:19.710627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:19.710633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895958802473661:6873] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:19.711201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895958802473661:6873] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:19.713749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895958802473661:6873] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:19.715943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:19.716086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895958802473661:6873] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:19.716101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895958802473661:6873] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:19.716113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895958802473661:6873] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:19.716121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1833 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:19.718481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:19.718700Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:19.718712Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:19.718724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:19.718781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:19.718831Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895958712705187:5399]
2025-09-30T14:55:19.719478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:19.719804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:19.719860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:19.720188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:19.720265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:19.720272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:19.720273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:19.720275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:19.720276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:19.720277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:19.720278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:19.720279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:19.720280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:19.720281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:19.720282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.720283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.720284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.720285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:19.720286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:19.720291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:19.720301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:19.720304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:19.720308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:19.720312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:19.720315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:19.720319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:19.720322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:19.720325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:19.720330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:19.720333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.720336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.720340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.720343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:19.720347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:19.720355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:19.720362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:19.720368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:19.720373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:19.720377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:19.720382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:19.720386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:19.720392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:19.720396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:19.720401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:19.720405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:19.720410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:19.720415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:19.720420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:19.720424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:19.720429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:19.720434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:19.720438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:19.720442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:19.720447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:19.720451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.720455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.720459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.720464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.720468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.720473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.720477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:19.720483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:19.720488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:19.720492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:19.720538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:19.726320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:19.727445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:19.727461Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:19.727465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:19.727468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:19.727476Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1832 [2:7555895958712705187:5399]
2025-09-30T14:55:19.727493Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:19.727512Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:19.727516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:19.727519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:19.727521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:19.727538Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:19.727545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:19.727558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:19.727627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.727635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.727637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.727641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:19.727643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:19.727716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:19.727727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.727741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.727757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.727779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:19.727803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895958712705181:5399]
2025-09-30T14:55:19.727805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895958712705181:5399]
2025-09-30T14:55:19.727807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895958712705181:5399]
2025-09-30T14:55:19.727816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:19.727831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:19.727845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:19.727849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:19.727851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:19.727855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:19.727857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:19.727885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895958712705181:5399]
2025-09-30T14:55:19.727895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:19.727905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895958802473803:6873], now have 1 active actors on pipe
2025-09-30T14:55:19.727905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:19.727909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895958802473637:2454], now have 1 active actors on pipe
2025-09-30T14:55:19.728262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1832
2025-09-30T14:55:19.728267Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1832
2025-09-30T14:55:19.728499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:19.728514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:19.728543Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e866c16a-9a7c3de7-92be6c7f-26dc592d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:19.728552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:19.728557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:19.728579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:19.728592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:19.728604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:19.728621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:19.728853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:19.728861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:19.728876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:19.728994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1833 partition: 0 MaxSeqNo: 42 sessionId: src_id|e866c16a-9a7c3de7-92be6c7f-26dc592d_0
2025-09-30T14:55:19.729362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1864c7-e61fb29e-92a11a18-b50913db_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e866c16a-9a7c3de7-92be6c7f-26dc592d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:19.732327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e866c16a-9a7c3de7-92be6c7f-26dc592d_0] Write session: try to update token
2025-09-30T14:55:19.732345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e866c16a-9a7c3de7-92be6c7f-26dc592d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:19.746672Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:19.746699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:19.746711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895958712705181:5399]
2025-09-30T14:55:19.746765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:19.746767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:19.746960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:19.747132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:19.747326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:19.747472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:19.747661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:19.747698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:19.748120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1833 sessionId: src_id|e866c16a-9a7c3de7-92be6c7f-26dc592d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:19.750997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:19.752216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:19.752240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:19.752262Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:19.752266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:19.752269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:19.752271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:19.752279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895958712705181:5399]
2025-09-30T14:55:19.752289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895958712705181:5399]
2025-09-30T14:55:19.752293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895958712705181:5399]
2025-09-30T14:55:19.752343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:19.752356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.752359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:19.752377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:19.752392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:19.752400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:19.752500Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:19.801042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895958802473814:7118]
2025-09-30T14:55:19.801332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1832, pipe: [1:7555895958802473814:7118]
2025-09-30T14:55:19.869409Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:19.870052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:19.870096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895958802473814:7118], now have 1 active actors on pipe
2025-09-30T14:55:19.870216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:19.870274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895958802473814:7118]
2025-09-30T14:55:19.870303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:19.870314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:19.870322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:19.870393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1833 reason: error at write: Disconnected sessionId: src_id|e866c16a-9a7c3de7-92be6c7f-26dc592d_0
2025-09-30T14:55:19.870533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1833 sessionId: src_id|e866c16a-9a7c3de7-92be6c7f-26dc592d_0 is DEAD
2025-09-30T14:55:19.870746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e866c16a-9a7c3de7-92be6c7f-26dc592d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:19.870758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e866c16a-9a7c3de7-92be6c7f-26dc592d_0] Write session will restart in 0.006904s
2025-09-30T14:55:19.870781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e866c16a-9a7c3de7-92be6c7f-26dc592d_0] Write session: Do CDS request
2025-09-30T14:55:19.870787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e866c16a-9a7c3de7-92be6c7f-26dc592d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:19.878829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e866c16a-9a7c3de7-92be6c7f-26dc592d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:19.878934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:19.878954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1834
2025-09-30T14:55:19.879087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1834 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:19.879122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1834 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:19.879132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1834 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:19.879137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:19.879695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1834 sessionId:  describe result for acl check
2025-09-30T14:55:19.879732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:19.879742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:19.879744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:19.879750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895958802473868:6869] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:19.880302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895958802473868:6869] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:19.882866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895958802473868:6869] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:19.884628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:19.886948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:19.887171Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:19.887186Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:19.887197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:19.887278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:19.887343Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895958712705357:5397]
2025-09-30T14:55:19.887646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895958802473868:6869] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:19.887666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895958802473868:6869] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:19.887670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895958802473868:6869] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:19.887679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1834 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:19.888025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:19.888378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:19.888461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:19.888846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:19.888930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:19.888931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:19.888933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:19.888934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:19.888935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:19.888936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:19.888938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:19.888939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:19.888940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:19.888942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:19.888943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.888944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.888946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.888947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:19.888948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:19.888969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:19.888981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:19.888985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:19.888990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:19.888994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:19.888998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:19.889003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:19.889007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:19.889011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:19.889016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:19.889020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.889025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.889029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.889033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:19.889049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:19.889057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:19.889065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:19.889073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:19.889078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:19.889083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:19.889089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:19.889094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:19.889099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:19.889106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:19.889111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:19.889115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:19.889119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:19.889124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:19.889129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:19.889133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:19.889138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:19.889142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:19.889146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:19.889150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:19.889154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:19.889158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.889174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.889179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.889184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.889189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.889194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.889198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:19.889203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:19.889208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:19.889226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:19.889270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:19.895139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:19.896088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:19.896105Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:19.896108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:19.896112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:19.896120Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1833 [2:7555895958712705357:5397]
2025-09-30T14:55:19.896139Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:19.896155Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:19.896158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:19.896163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:19.896165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:19.896178Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:19.896182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:19.896189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:19.896251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.896259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.896262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.896266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:19.896268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:19.896352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:19.896360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.896378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:19.896395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:19.896417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:19.896501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1833
2025-09-30T14:55:19.896531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1833
2025-09-30T14:55:19.896441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895958802473816:2454], now have 1 active actors on pipe
2025-09-30T14:55:19.896450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895958802473983:6869], now have 1 active actors on pipe
2025-09-30T14:55:19.896456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895958712705352:5397]
2025-09-30T14:55:19.896459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895958712705352:5397]
2025-09-30T14:55:19.896461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895958712705352:5397]
2025-09-30T14:55:19.896477Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:19.896491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:19.896495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:19.896499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:19.896502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:19.896507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:19.896511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:19.896546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895958712705352:5397]
2025-09-30T14:55:19.896549Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:19.896552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:19.896566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:19.896571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:19.896879Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5589bc93-11eaa5bf-77620677-ea3b4d7b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:19.896900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:19.896904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:19.896906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:19.896917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:19.896930Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:19.896954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:19.897211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:19.897238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:19.897262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:19.897352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1834 partition: 0 MaxSeqNo: 42 sessionId: src_id|5589bc93-11eaa5bf-77620677-ea3b4d7b_0
2025-09-30T14:55:19.897739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e866c16a-9a7c3de7-92be6c7f-26dc592d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5589bc93-11eaa5bf-77620677-ea3b4d7b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:19.900773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5589bc93-11eaa5bf-77620677-ea3b4d7b_0] Write session: try to update token
2025-09-30T14:55:19.900790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5589bc93-11eaa5bf-77620677-ea3b4d7b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:19.910265Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:19.910285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:19.910288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:19.910290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:19.910301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895958712705352:5397]
2025-09-30T14:55:19.910306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895958712705352:5397]
2025-09-30T14:55:19.910310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895958712705352:5397]
2025-09-30T14:55:19.910351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:19.910358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:19.910357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:19.910362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:19.910365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:19.910369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:19.910525Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:19.917549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1834 sessionId: src_id|5589bc93-11eaa5bf-77620677-ea3b4d7b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:19.920434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:19.971316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895958802473994:7118]
2025-09-30T14:55:19.971609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1833, pipe: [1:7555895958802473994:7118]
2025-09-30T14:55:20.024666Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:20.025185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:20.025205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:20.025238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895958802473994:7118], now have 1 active actors on pipe
2025-09-30T14:55:20.025500Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:20.026094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5589bc93-11eaa5bf-77620677-ea3b4d7b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:20.026104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5589bc93-11eaa5bf-77620677-ea3b4d7b_0] Write session will restart in 0.006834s
2025-09-30T14:55:20.026122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5589bc93-11eaa5bf-77620677-ea3b4d7b_0] Write session: Do CDS request
2025-09-30T14:55:20.026135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5589bc93-11eaa5bf-77620677-ea3b4d7b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:20.025521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:20.025598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895958802473994:7118]
2025-09-30T14:55:20.025643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:20.025736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1834 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5589bc93-11eaa5bf-77620677-ea3b4d7b_0
2025-09-30T14:55:20.025928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1834 sessionId: src_id|5589bc93-11eaa5bf-77620677-ea3b4d7b_0 is DEAD
2025-09-30T14:55:20.034292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5589bc93-11eaa5bf-77620677-ea3b4d7b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:20.034368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:20.034389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1835
2025-09-30T14:55:20.034514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1835 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:20.034559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1835 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:20.034569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1835 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:20.034574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:20.035094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1835 sessionId:  describe result for acl check
2025-09-30T14:55:20.035135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:20.035145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:20.035148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:20.035154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895963097441321:6857] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:20.035763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895963097441321:6857] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:20.039360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895963097441321:6857] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:20.044405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:20.044717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895963097441321:6857] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:20.044740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895963097441321:6857] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:20.044743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895963097441321:6857] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:20.044751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1835 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:20.046737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:20.046979Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:20.046983Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:20.046994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:20.047055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:20.047093Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895963007672824:5387]
2025-09-30T14:55:20.047775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:20.048124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:20.048172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:20.048537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:20.048616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:20.048618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:20.048619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:20.048621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:20.048622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:20.048624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:20.048625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:20.048626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:20.048628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:20.048629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:20.048631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.048632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.048634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.048635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:20.048636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:20.048643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:20.048654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:20.048658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:20.048663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:20.048667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:20.048671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:20.048676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:20.048680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:20.048684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:20.048689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:20.048693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.048698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.048702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.048706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:20.048710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:20.048721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:20.048730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:20.048736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:20.048742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:20.048747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:20.048753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:20.048759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:20.048764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:20.048769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:20.048775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:20.048779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:20.048785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:20.048789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:20.048795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:20.048799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:20.048804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:20.048809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:20.048829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:20.048834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:20.048839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:20.048844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.048850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.048855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.048860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.048865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.048871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.048876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:20.048881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:20.048887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:20.048891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:20.048934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:20.055567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:20.056454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:20.056475Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:20.056478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:20.056482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:20.056489Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1834 [2:7555895963007672824:5387]
2025-09-30T14:55:20.056509Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:20.056525Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:20.056537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:20.056540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:20.056543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:20.056560Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:20.056567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:20.056574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:20.056638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.056646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.056649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.056652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:20.056655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:20.056728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:20.056736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.056749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.056764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.056786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:20.056813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895963097441458:6857], now have 1 active actors on pipe
2025-09-30T14:55:20.056821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895963097441292:2454], now have 1 active actors on pipe
2025-09-30T14:55:20.056828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895963007672818:5387]
2025-09-30T14:55:20.056835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895963007672818:5387]
2025-09-30T14:55:20.056838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895963007672818:5387]
2025-09-30T14:55:20.056850Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:20.056868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:20.056868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:20.056872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:20.056874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:20.056887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:20.056891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:20.056897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1834
2025-09-30T14:55:20.056903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1834
2025-09-30T14:55:20.056928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895963007672818:5387]
2025-09-30T14:55:20.056942Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:20.056948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:20.057232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:20.057249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:20.057283Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30417fc-ca77cbb-4cf45c6f-b874c92a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:20.057297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:20.057301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:20.057303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:20.057315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:20.057326Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:20.057349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:20.057548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:20.057560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:20.057583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:20.057719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1835 partition: 0 MaxSeqNo: 42 sessionId: src_id|30417fc-ca77cbb-4cf45c6f-b874c92a_0
2025-09-30T14:55:20.058111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5589bc93-11eaa5bf-77620677-ea3b4d7b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|30417fc-ca77cbb-4cf45c6f-b874c92a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:20.061044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30417fc-ca77cbb-4cf45c6f-b874c92a_0] Write session: try to update token
2025-09-30T14:55:20.061062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30417fc-ca77cbb-4cf45c6f-b874c92a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:20.071107Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:20.071129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:20.071131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:20.071133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:20.071144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895963007672818:5387]
2025-09-30T14:55:20.071150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895963007672818:5387]
2025-09-30T14:55:20.071154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895963007672818:5387]
2025-09-30T14:55:20.071196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:20.071199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:20.071201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:20.071205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:20.071206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.071210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:20.071381Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:20.077711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1835 sessionId: src_id|30417fc-ca77cbb-4cf45c6f-b874c92a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:20.080554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:20.125659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895963097441472:7118]
2025-09-30T14:55:20.125957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1834, pipe: [1:7555895963097441472:7118]
2025-09-30T14:55:20.185368Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:20.185979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:20.185999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:20.186042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895963097441472:7118], now have 1 active actors on pipe
2025-09-30T14:55:20.186411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:20.186426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:20.186479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1835 reason: error at write: Disconnected sessionId: src_id|30417fc-ca77cbb-4cf45c6f-b874c92a_0
2025-09-30T14:55:20.186620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1835 sessionId: src_id|30417fc-ca77cbb-4cf45c6f-b874c92a_0 is DEAD
2025-09-30T14:55:20.186775Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:20.186748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895963097441472:7118]
2025-09-30T14:55:20.186759Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:20.187031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30417fc-ca77cbb-4cf45c6f-b874c92a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:20.187043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30417fc-ca77cbb-4cf45c6f-b874c92a_0] Write session will restart in 0.007951s
2025-09-30T14:55:20.187068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30417fc-ca77cbb-4cf45c6f-b874c92a_0] Write session: Do CDS request
2025-09-30T14:55:20.187077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30417fc-ca77cbb-4cf45c6f-b874c92a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:20.199714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30417fc-ca77cbb-4cf45c6f-b874c92a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:20.199791Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:20.199809Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1836
2025-09-30T14:55:20.199985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1836 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:20.200021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1836 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:20.200027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1836 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:20.200032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:20.200455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1836 sessionId:  describe result for acl check
2025-09-30T14:55:20.200491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:20.200493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:20.200496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:20.200502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895963097441613:6850] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:20.201032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895963097441613:6850] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:20.202116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:20.203346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895963097441613:6850] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:20.204816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:20.205204Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:20.205220Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:20.205233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:20.205312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:20.205360Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895963007672994:5379]
2025-09-30T14:55:20.205875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:20.206198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:20.206256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:20.206397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895963097441613:6850] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:20.206417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895963097441613:6850] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:20.206420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895963097441613:6850] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:20.206429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1836 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:20.206618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:20.206693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:20.206701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:20.206703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:20.206704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:20.206706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:20.206707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:20.206709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:20.206710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:20.206711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:20.206713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:20.206714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.206715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.206717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.206718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:20.206720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:20.206726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:20.206738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:20.206742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:20.206747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:20.206751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:20.206755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:20.206760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:20.206764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:20.206768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:20.206772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:20.206777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.206780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.206785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.206789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:20.206794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:20.206801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:20.206811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:20.206818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:20.206824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:20.206829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:20.206835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:20.206841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:20.206846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:20.206852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:20.206864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:20.206871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:20.206883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:20.206889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:20.206899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:20.206904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:20.206914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:20.206919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:20.206930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:20.206936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:20.206947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:20.206952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.206960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.206970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.206976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.206981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.206991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.206996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:20.207008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:20.207013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:20.207020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:20.207067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:20.220716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:20.221690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:20.221711Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:20.221714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:20.221718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:20.221726Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1835 [2:7555895963007672994:5379]
2025-09-30T14:55:20.221745Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:20.221762Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:20.221767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:20.221770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:20.221773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:20.221791Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:20.221799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:20.221818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:20.221888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.221898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.221901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.221905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:20.221908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:20.221992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:20.222004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.222019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.222031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.222050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:20.222081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895963097441649:6850], now have 1 active actors on pipe
2025-09-30T14:55:20.222090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895963097441477:2454], now have 1 active actors on pipe
2025-09-30T14:55:20.222097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895963007672988:5379]
2025-09-30T14:55:20.222100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895963007672988:5379]
2025-09-30T14:55:20.222102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895963007672988:5379]
2025-09-30T14:55:20.222116Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:20.222130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:20.222134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:20.222142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:20.222144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:20.222152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:20.222157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:20.222199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895963007672988:5379]
2025-09-30T14:55:20.222214Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:20.222234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:20.222182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1835
2025-09-30T14:55:20.222239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1835
2025-09-30T14:55:20.222410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:20.222424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:20.222458Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad3ca62a-b3f05299-d1870ad0-ba1a4ddc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:20.222471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:20.222476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:20.222484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:20.222496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:20.222512Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:20.222536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:20.222703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:20.222713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:20.222728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:20.222818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1836 partition: 0 MaxSeqNo: 42 sessionId: src_id|ad3ca62a-b3f05299-d1870ad0-ba1a4ddc_0
2025-09-30T14:55:20.223308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30417fc-ca77cbb-4cf45c6f-b874c92a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ad3ca62a-b3f05299-d1870ad0-ba1a4ddc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:20.226700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad3ca62a-b3f05299-d1870ad0-ba1a4ddc_0] Write session: try to update token
2025-09-30T14:55:20.226726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad3ca62a-b3f05299-d1870ad0-ba1a4ddc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:20.242557Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:20.242583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:20.242596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895963007672988:5379]
2025-09-30T14:55:20.242641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:20.242661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:20.242822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:20.242976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:20.243126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:20.243299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:20.243506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:20.243553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:20.254207Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:20.254231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:20.254234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:20.254235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:20.254248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895963007672988:5379]
2025-09-30T14:55:20.254253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895963007672988:5379]
2025-09-30T14:55:20.254258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895963007672988:5379]
2025-09-30T14:55:20.254295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:20.254302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.254305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:20.254309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:20.254317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:20.254340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:20.254461Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:20.257189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1836 sessionId: src_id|ad3ca62a-b3f05299-d1870ad0-ba1a4ddc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:20.260160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:20.286937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895963097441659:7118]
2025-09-30T14:55:20.287457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1835, pipe: [1:7555895963097441659:7118]
2025-09-30T14:55:20.371873Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:20.372361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:20.372378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:20.372406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895963097441659:7118], now have 1 active actors on pipe
2025-09-30T14:55:20.372793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:20.372804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895963097441659:7118]
2025-09-30T14:55:20.372813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:20.372834Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:20.372893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1836 reason: error at write: Disconnected sessionId: src_id|ad3ca62a-b3f05299-d1870ad0-ba1a4ddc_0
2025-09-30T14:55:20.373084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1836 sessionId: src_id|ad3ca62a-b3f05299-d1870ad0-ba1a4ddc_0 is DEAD
2025-09-30T14:55:20.372719Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:20.375580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad3ca62a-b3f05299-d1870ad0-ba1a4ddc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:20.375593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad3ca62a-b3f05299-d1870ad0-ba1a4ddc_0] Write session will restart in 0.008449s
2025-09-30T14:55:20.375634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad3ca62a-b3f05299-d1870ad0-ba1a4ddc_0] Write session: Do CDS request
2025-09-30T14:55:20.375644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad3ca62a-b3f05299-d1870ad0-ba1a4ddc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:20.385889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad3ca62a-b3f05299-d1870ad0-ba1a4ddc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:20.386062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:20.386089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1837
2025-09-30T14:55:20.386290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1837 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:20.386332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1837 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:20.386344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1837 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:20.386350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:20.386923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1837 sessionId:  describe result for acl check
2025-09-30T14:55:20.386973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:20.386981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:20.386983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:20.386991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895963097441707:6842] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:20.387686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895963097441707:6842] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:20.391681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895963097441707:6842] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:20.394369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:20.395096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895963097441707:6842] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:20.395116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895963097441707:6842] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:20.395119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895963097441707:6842] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:20.395136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1837 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:20.396608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:20.396854Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:20.396869Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:20.396880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:20.396947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:20.396995Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895963007673169:5377]
2025-09-30T14:55:20.397694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:20.398107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:20.398168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:20.398553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:20.398652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:20.398663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:20.398665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:20.398666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:20.398667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:20.398669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:20.398670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:20.398671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:20.398673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:20.398674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:20.398676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.398678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.398679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.398681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:20.398698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:20.398706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:20.398718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:20.398723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:20.398728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:20.398733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:20.398739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:20.398743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:20.398748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:20.398753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:20.398758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:20.398763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.398767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.398772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.398776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:20.398781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:20.398794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:20.398803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:20.398811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:20.398818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:20.398824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:20.398831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:20.398837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:20.398843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:20.398849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:20.398856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:20.398861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:20.398867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:20.398873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:20.398878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:20.398883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:20.398889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:20.398896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:20.398902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:20.398908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:20.398916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:20.398924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.398930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.398935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.398942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.398947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.398953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.398959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:20.398965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:20.398971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:20.398977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:20.399032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:20.405356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:20.406364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:20.406381Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:20.406383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:20.406387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:20.406392Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1836 [2:7555895963007673169:5377]
2025-09-30T14:55:20.406407Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:20.406422Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:20.406424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:20.406427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:20.406429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:20.406444Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:20.406450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:20.406457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:20.406515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.406522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.406524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.406526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:20.406528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:20.406584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:20.406592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.406602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.406609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.406619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:20.406632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895963007673163:5377]
2025-09-30T14:55:20.406634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895963007673163:5377]
2025-09-30T14:55:20.406636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895963007673163:5377]
2025-09-30T14:55:20.406642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:20.406654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:20.406664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:20.406666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:20.406684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:20.406696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:20.406698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:20.406700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895963007673163:5377]
2025-09-30T14:55:20.406702Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:20.406705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:20.406718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895963097441831:6842], now have 1 active actors on pipe
2025-09-30T14:55:20.406732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895963097441662:2454], now have 1 active actors on pipe
2025-09-30T14:55:20.406812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1836
2025-09-30T14:55:20.406859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:20.406873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:20.406895Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2d1ad6b-dbfb3ebc-e006c856-fd08d891_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:20.406900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:20.406903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:20.406818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1836
2025-09-30T14:55:20.406905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:20.406914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:20.406921Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:20.406937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:20.407111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:20.407122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:20.407137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:20.407266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1837 partition: 0 MaxSeqNo: 42 sessionId: src_id|a2d1ad6b-dbfb3ebc-e006c856-fd08d891_0
2025-09-30T14:55:20.407676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad3ca62a-b3f05299-d1870ad0-ba1a4ddc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a2d1ad6b-dbfb3ebc-e006c856-fd08d891_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:20.410747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2d1ad6b-dbfb3ebc-e006c856-fd08d891_0] Write session: try to update token
2025-09-30T14:55:20.410772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2d1ad6b-dbfb3ebc-e006c856-fd08d891_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:20.419628Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:20.419649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:20.419660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895963007673163:5377]
2025-09-30T14:55:20.419713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:20.419723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:20.419916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:20.420086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:20.420234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:20.420398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:20.420702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:20.420757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:20.428333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1837 sessionId: src_id|a2d1ad6b-dbfb3ebc-e006c856-fd08d891_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:20.431238Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:20.431277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:20.431280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:20.431282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:20.431295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895963007673163:5377]
2025-09-30T14:55:20.431300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895963007673163:5377]
2025-09-30T14:55:20.431305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895963007673163:5377]
2025-09-30T14:55:20.431351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:20.431364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.431364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:20.431370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:20.431372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:20.431376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:20.431540Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:20.431646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:20.472989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895963097441842:7118]
2025-09-30T14:55:20.473364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1836, pipe: [1:7555895963097441842:7118]
2025-09-30T14:55:20.548535Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:20.548975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:20.548991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:20.549012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895963097441842:7118], now have 1 active actors on pipe
2025-09-30T14:55:20.549273Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:20.549278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895963097441842:7118]
2025-09-30T14:55:20.549294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:20.549302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:20.549329Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:20.549412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1837 reason: error at write: Disconnected sessionId: src_id|a2d1ad6b-dbfb3ebc-e006c856-fd08d891_0
2025-09-30T14:55:20.549740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1837 sessionId: src_id|a2d1ad6b-dbfb3ebc-e006c856-fd08d891_0 is DEAD
2025-09-30T14:55:20.549854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2d1ad6b-dbfb3ebc-e006c856-fd08d891_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:20.549865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2d1ad6b-dbfb3ebc-e006c856-fd08d891_0] Write session will restart in 0.006942s
2025-09-30T14:55:20.549904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2d1ad6b-dbfb3ebc-e006c856-fd08d891_0] Write session: Do CDS request
2025-09-30T14:55:20.549910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2d1ad6b-dbfb3ebc-e006c856-fd08d891_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:20.557861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2d1ad6b-dbfb3ebc-e006c856-fd08d891_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:20.559742Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:20.559767Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1838
2025-09-30T14:55:20.560121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1838 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:20.560183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1838 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:20.560196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1838 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:20.560203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:20.560827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1838 sessionId:  describe result for acl check
2025-09-30T14:55:20.560877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:20.560886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:20.560890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:20.560912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895963097441907:6838] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:20.561631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895963097441907:6838] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:20.564590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895963097441907:6838] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:20.571195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895963097441907:6838] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:20.571222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895963097441907:6838] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:20.571226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895963097441907:6838] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:20.571281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1838 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:20.571519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:20.580143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:20.580393Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:20.580398Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:20.580411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:20.580491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:20.580531Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895963007673342:5373]
2025-09-30T14:55:20.581290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:20.583200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:20.583323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:20.583740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:20.583799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:20.583801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:20.583803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:20.583804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:20.583806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:20.583808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:20.583810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:20.583811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:20.583813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:20.583814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:20.583816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.583818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.583819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.583821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:20.583822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:20.583830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:20.583842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:20.583848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:20.583852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:20.583857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:20.583862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:20.583867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:20.583872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:20.583876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:20.583881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:20.583885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.583890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.583894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.583899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:20.583904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:20.583914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:20.583923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:20.583930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:20.583937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:20.583944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:20.583951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:20.583956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:20.583962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:20.583967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:20.583973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:20.583979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:20.583985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:20.583990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:20.584012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:20.584018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:20.584024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:20.584030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:20.584036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:20.584041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:20.584053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:20.584064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.584074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.584081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.584092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.584101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.584106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.584111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:20.584117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:20.584125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:20.584131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:20.584180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:20.608844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:20.610212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:20.610233Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:20.610238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:20.610243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:20.610250Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1837 [2:7555895963007673342:5373]
2025-09-30T14:55:20.610268Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:20.610285Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:20.610288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:20.610292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:20.610294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:20.610311Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:20.610329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:20.610336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:20.610403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.610412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.610415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.610418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:20.610424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:20.610501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:20.610509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.610521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.610530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.610549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:20.610571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895963007673335:5373]
2025-09-30T14:55:20.610578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895963007673335:5373]
2025-09-30T14:55:20.610581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895963007673335:5373]
2025-09-30T14:55:20.610590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:20.610605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:20.610607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:20.610618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:20.610620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:20.610621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:20.610623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:20.610633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895963097442022:6838], now have 1 active actors on pipe
2025-09-30T14:55:20.610637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895963097441844:2454], now have 1 active actors on pipe
2025-09-30T14:55:20.610671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895963007673335:5373]
2025-09-30T14:55:20.610680Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:20.610779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:20.611010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1837
2025-09-30T14:55:20.611049Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1837
2025-09-30T14:55:20.612229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:20.612249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:20.612287Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e16222b7-1fa45da-ccd13804-776d9feb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:20.612298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:20.612312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:20.612315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:20.612327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:20.612342Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:20.612364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:20.615605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:20.615628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:20.615662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:20.617655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1838 partition: 0 MaxSeqNo: 42 sessionId: src_id|e16222b7-1fa45da-ccd13804-776d9feb_0
2025-09-30T14:55:20.618193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2d1ad6b-dbfb3ebc-e006c856-fd08d891_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e16222b7-1fa45da-ccd13804-776d9feb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:20.621999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e16222b7-1fa45da-ccd13804-776d9feb_0] Write session: try to update token
2025-09-30T14:55:20.622029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e16222b7-1fa45da-ccd13804-776d9feb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:20.628201Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:20.628223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:20.628226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:20.628228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:20.628237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895963007673335:5373]
2025-09-30T14:55:20.628242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895963007673335:5373]
2025-09-30T14:55:20.628246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895963007673335:5373]
2025-09-30T14:55:20.628289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:20.628290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:20.628295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:20.628297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.628300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:20.628313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:20.628448Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:20.647439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1838 sessionId: src_id|e16222b7-1fa45da-ccd13804-776d9feb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:20.650817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:20.650952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895963097442060:7118]
2025-09-30T14:55:20.651544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1837, pipe: [1:7555895963097442060:7118]
2025-09-30T14:55:20.745441Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:20.746146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:20.746164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:20.746184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895963097442060:7118], now have 1 active actors on pipe
2025-09-30T14:55:20.746394Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:20.746441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895963097442060:7118]
2025-09-30T14:55:20.746483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:20.746575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1838 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e16222b7-1fa45da-ccd13804-776d9feb_0
2025-09-30T14:55:20.746750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1838 sessionId: src_id|e16222b7-1fa45da-ccd13804-776d9feb_0 is DEAD
2025-09-30T14:55:20.746927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e16222b7-1fa45da-ccd13804-776d9feb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:20.746938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e16222b7-1fa45da-ccd13804-776d9feb_0] Write session will restart in 0.005468s
2025-09-30T14:55:20.746962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e16222b7-1fa45da-ccd13804-776d9feb_0] Write session: Do CDS request
2025-09-30T14:55:20.746968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e16222b7-1fa45da-ccd13804-776d9feb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:20.746945Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:20.754091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e16222b7-1fa45da-ccd13804-776d9feb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:20.754262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:20.754298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1839
2025-09-30T14:55:20.754496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1839 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:20.754538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1839 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:20.754544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1839 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:20.754549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:20.755052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1839 sessionId:  describe result for acl check
2025-09-30T14:55:20.755084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:20.755086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:20.755088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:20.755095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895963097442097:6822] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:20.755737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895963097442097:6822] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:20.758385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895963097442097:6822] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:20.761392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895963097442097:6822] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:20.761411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895963097442097:6822] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:20.761415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895963097442097:6822] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:20.761423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1839 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:20.772409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:20.775318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:20.775617Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:20.775631Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:20.775644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:20.775717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:20.775767Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895963007673566:5326]
2025-09-30T14:55:20.776475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:20.776845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:20.776901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:20.777273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:20.777350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:20.777356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:20.777357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:20.777359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:20.777360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:20.777362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:20.777363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:20.777365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:20.777366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:20.777367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:20.777369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.777370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.777371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.777372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:20.777374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:20.777380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:20.777390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:20.777394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:20.777399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:20.777403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:20.777407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:20.777411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:20.777414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:20.777418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:20.777422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:20.777426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.777431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.777435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.777439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:20.777444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:20.777452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:20.777461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:20.777467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:20.777473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:20.777479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:20.777486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:20.777501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:20.777507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:20.777512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:20.777529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:20.777540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:20.777546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:20.777556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:20.777562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:20.777568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:20.777578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:20.777584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:20.777594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:20.777620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:20.777630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:20.777636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.777643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.777649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.777652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.777659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.777663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.777667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:20.777671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:20.777673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:20.777676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:20.777715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:20.783621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:20.784519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:20.784539Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:20.784543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:20.784548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:20.784556Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1838 [2:7555895963007673566:5326]
2025-09-30T14:55:20.784574Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:20.784594Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:20.784597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:20.784601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:20.784603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:20.784622Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:20.784630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:20.784639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:20.784714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.784724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.784727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.784731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:20.784737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:20.784809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:20.784818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.784831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.784847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.784868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:20.784892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895963097442084:2454], now have 1 active actors on pipe
2025-09-30T14:55:20.784901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895963097442152:6822], now have 1 active actors on pipe
2025-09-30T14:55:20.784909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895963007673561:5326]
2025-09-30T14:55:20.784912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895963007673561:5326]
2025-09-30T14:55:20.784915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895963007673561:5326]
2025-09-30T14:55:20.784926Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:20.784947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:20.784968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:20.784977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:20.784983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:20.784986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:20.784988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:20.785018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895963007673561:5326]
2025-09-30T14:55:20.785028Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:20.785029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:20.785015Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1838
2025-09-30T14:55:20.785072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1838
2025-09-30T14:55:20.785215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:20.785226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:20.785251Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d231e267-6c6e005f-9713538e-f7f3011a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:20.785263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:20.785269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:20.785276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:20.785289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:20.785312Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:20.785332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:20.785514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:20.785525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:20.785544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:20.785693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1839 partition: 0 MaxSeqNo: 42 sessionId: src_id|d231e267-6c6e005f-9713538e-f7f3011a_0
2025-09-30T14:55:20.787411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e16222b7-1fa45da-ccd13804-776d9feb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d231e267-6c6e005f-9713538e-f7f3011a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:20.791133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d231e267-6c6e005f-9713538e-f7f3011a_0] Write session: try to update token
2025-09-30T14:55:20.791167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d231e267-6c6e005f-9713538e-f7f3011a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:20.804218Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:20.804244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:20.804255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895963007673561:5326]
2025-09-30T14:55:20.804311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:20.804314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:20.804502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:20.804675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:20.804843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:20.804998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:20.805209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:20.805255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:20.808839Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:20.808862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:20.808865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:20.808867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:20.808877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895963007673561:5326]
2025-09-30T14:55:20.808882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895963007673561:5326]
2025-09-30T14:55:20.808887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895963007673561:5326]
2025-09-30T14:55:20.808925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:20.808932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.808936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:20.808949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:20.808957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:20.808962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:20.809077Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:20.827185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1839 sessionId: src_id|d231e267-6c6e005f-9713538e-f7f3011a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:20.829935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:20.846530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895963097442267:7118]
2025-09-30T14:55:20.846967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1838, pipe: [1:7555895963097442267:7118]
2025-09-30T14:55:20.921460Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:20.922191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:20.922211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:20.922232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895963097442267:7118], now have 1 active actors on pipe
2025-09-30T14:55:20.922570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895963097442267:7118]
2025-09-30T14:55:20.922606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:20.922651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:20.922659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:20.922724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1839 reason: error at write: Disconnected sessionId: src_id|d231e267-6c6e005f-9713538e-f7f3011a_0
2025-09-30T14:55:20.922903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1839 sessionId: src_id|d231e267-6c6e005f-9713538e-f7f3011a_0 is DEAD
2025-09-30T14:55:20.923123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d231e267-6c6e005f-9713538e-f7f3011a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:20.923141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d231e267-6c6e005f-9713538e-f7f3011a_0] Write session will restart in 0.009110s
2025-09-30T14:55:20.923165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d231e267-6c6e005f-9713538e-f7f3011a_0] Write session: Do CDS request
2025-09-30T14:55:20.923172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d231e267-6c6e005f-9713538e-f7f3011a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:20.922597Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:20.933984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d231e267-6c6e005f-9713538e-f7f3011a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:20.934123Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:20.934144Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1840
2025-09-30T14:55:20.934323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1840 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:20.934365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1840 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:20.934376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1840 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:20.934380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:20.934862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1840 sessionId:  describe result for acl check
2025-09-30T14:55:20.934905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:20.934912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:20.934914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:20.934921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895963097442284:6815] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:20.935556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895963097442284:6815] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:20.937483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895963097442284:6815] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:20.941224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895963097442284:6815] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:20.941243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895963097442284:6815] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:20.941247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895963097442284:6815] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:20.941257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1840 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:20.944272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:20.946835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:20.947057Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:20.947072Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:20.947083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:20.947137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:20.947178Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895963007673743:5337]
2025-09-30T14:55:20.947840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:20.948164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:20.948212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:20.948539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:20.948603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:20.948609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:20.948610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:20.948611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:20.948613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:20.948614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:20.948615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:20.948617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:20.948618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:20.948619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:20.948621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.948622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.948623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.948624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:20.948625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:20.948631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:20.948641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:20.948645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:20.948648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:20.948652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:20.948656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:20.948659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:20.948662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:20.948666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:20.948670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:20.948674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.948677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.948680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.948683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:20.948687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:20.948695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:20.948702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:20.948708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:20.948713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:20.948734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:20.948738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:20.948743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:20.948753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:20.948758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:20.948764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:20.948770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:20.948775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:20.948785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:20.948789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:20.948794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:20.948803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:20.948808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:20.948814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:20.948823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:20.948828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:20.948833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.948844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.948849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.948858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.948863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.948867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.948871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:20.948877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:20.948881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:20.948886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:20.948929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:20.956102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:20.957349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:20.957372Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:20.957377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:20.957382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:20.957389Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1839 [2:7555895963007673743:5337]
2025-09-30T14:55:20.957410Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:20.957429Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:20.957438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:20.957441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:20.957444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:20.957463Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:20.957471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:20.957479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:20.957553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.957556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.957559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.957563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:20.957566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:20.957664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:20.957677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.957693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:20.957705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:20.957726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:20.957754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895963097442406:6815], now have 1 active actors on pipe
2025-09-30T14:55:20.957763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895963097442269:2454], now have 1 active actors on pipe
2025-09-30T14:55:20.957771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895963007673738:5337]
2025-09-30T14:55:20.957779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895963007673738:5337]
2025-09-30T14:55:20.957781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895963007673738:5337]
2025-09-30T14:55:20.957795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:20.957809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:20.957819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:20.957821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:20.957824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:20.957835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:20.957843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:20.957845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1839
2025-09-30T14:55:20.957853Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1839
2025-09-30T14:55:20.957887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895963007673738:5337]
2025-09-30T14:55:20.957899Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:20.957902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:20.957929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:20.957938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:20.957979Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d11e91-38a99b4b-4e36d55-fe5535ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:20.957995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:20.958006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:20.958009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:20.958020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:20.958036Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:20.958059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:20.958235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:20.958245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:20.958261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:20.958355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1840 partition: 0 MaxSeqNo: 42 sessionId: src_id|7d11e91-38a99b4b-4e36d55-fe5535ea_0
2025-09-30T14:55:20.958829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d231e267-6c6e005f-9713538e-f7f3011a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7d11e91-38a99b4b-4e36d55-fe5535ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:20.962297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d11e91-38a99b4b-4e36d55-fe5535ea_0] Write session: try to update token
2025-09-30T14:55:20.962322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d11e91-38a99b4b-4e36d55-fe5535ea_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:20.971958Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:20.971979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:20.971982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:20.971984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:20.971996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895963007673738:5337]
2025-09-30T14:55:20.972001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895963007673738:5337]
2025-09-30T14:55:20.972017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895963007673738:5337]
2025-09-30T14:55:20.972063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:20.972071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:20.972074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:20.972086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:20.972097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:20.972102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:20.972234Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:20.994690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1840 sessionId: src_id|7d11e91-38a99b4b-4e36d55-fe5535ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:20.997424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:21.022646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895967392409753:7118]
2025-09-30T14:55:21.023002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1839, pipe: [1:7555895967392409753:7118]
2025-09-30T14:55:21.091362Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:21.091702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:21.091715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:21.091735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895967392409753:7118], now have 1 active actors on pipe
2025-09-30T14:55:21.092005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:21.092023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:21.092160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1840 reason: error at write: Disconnected sessionId: src_id|7d11e91-38a99b4b-4e36d55-fe5535ea_0
2025-09-30T14:55:21.092217Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:21.092356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1840 sessionId: src_id|7d11e91-38a99b4b-4e36d55-fe5535ea_0 is DEAD
2025-09-30T14:55:21.092516Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:21.092549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895967392409753:7118]
2025-09-30T14:55:21.095564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d11e91-38a99b4b-4e36d55-fe5535ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:21.095577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d11e91-38a99b4b-4e36d55-fe5535ea_0] Write session will restart in 0.006963s
2025-09-30T14:55:21.095615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d11e91-38a99b4b-4e36d55-fe5535ea_0] Write session: Do CDS request
2025-09-30T14:55:21.095625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d11e91-38a99b4b-4e36d55-fe5535ea_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:21.103801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d11e91-38a99b4b-4e36d55-fe5535ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:21.104147Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:21.104168Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1841
2025-09-30T14:55:21.104334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1841 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:21.104374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1841 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:21.104390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1841 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:21.104398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:21.104871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1841 sessionId:  describe result for acl check
2025-09-30T14:55:21.104905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:21.104916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:21.104918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:21.104924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895967392409828:6810] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:21.105461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895967392409828:6810] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:21.108449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895967392409828:6810] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:21.111201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:21.113498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:21.113719Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:21.113723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895967392409828:6810] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:21.113732Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:21.113744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:21.113742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895967392409828:6810] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:21.113747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895967392409828:6810] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:21.113756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1841 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:21.113796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:21.113833Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895967302641215:5335]
2025-09-30T14:55:21.114394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:21.114663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:21.114696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:21.114920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:21.114964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:21.114968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:21.114969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:21.114970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:21.114971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:21.114972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:21.114972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:21.114973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:21.114974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:21.114975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:21.114976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.114976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.114977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.114978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:21.114979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:21.114982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:21.114989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:21.114992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:21.114994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:21.114997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:21.115000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:21.115002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:21.115004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:21.115006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:21.115009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:21.115011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.115014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.115016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.115018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:21.115021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:21.115026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:21.115030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:21.115034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:21.115038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:21.115041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:21.115044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:21.115048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:21.115051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:21.115054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:21.115057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:21.115060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:21.115063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:21.115066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:21.115069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:21.115071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:21.115074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:21.115078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:21.115081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:21.115084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:21.115086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:21.115089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.115092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.115095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.115098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.115101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.115104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.115107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:21.115109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:21.115113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:21.115116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:21.115146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:21.121317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:21.122352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:21.122378Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:21.122382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:21.122386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:21.122394Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1840 [2:7555895967302641215:5335]
2025-09-30T14:55:21.122412Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:21.122430Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:21.122433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:21.122436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:21.122439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:21.122452Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:21.122463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:21.122468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:21.122517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.122524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.122525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.122530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:21.122532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:21.122584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:21.122590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.122599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.122607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.122622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:21.122638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895967302641210:5335]
2025-09-30T14:55:21.122649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895967302641210:5335]
2025-09-30T14:55:21.122651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895967302641210:5335]
2025-09-30T14:55:21.122661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:21.122669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:21.122672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:21.122675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:21.122676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:21.122692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:21.122695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:21.122706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895967392409931:6810], now have 1 active actors on pipe
2025-09-30T14:55:21.122710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895967392409755:2454], now have 1 active actors on pipe
2025-09-30T14:55:21.122740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895967302641210:5335]
2025-09-30T14:55:21.122751Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:21.122771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:21.122774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1840
2025-09-30T14:55:21.122961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:21.122842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1840
2025-09-30T14:55:21.122977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:21.123018Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f7e8ebe-bfd9c07a-bd46c754-fa93ebf6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:21.123031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:21.123041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:21.123043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:21.123058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:21.123082Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:21.123105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:21.123308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:21.123334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:21.123362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:21.123473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1841 partition: 0 MaxSeqNo: 42 sessionId: src_id|2f7e8ebe-bfd9c07a-bd46c754-fa93ebf6_0
2025-09-30T14:55:21.123867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d11e91-38a99b4b-4e36d55-fe5535ea_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2f7e8ebe-bfd9c07a-bd46c754-fa93ebf6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:21.127041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f7e8ebe-bfd9c07a-bd46c754-fa93ebf6_0] Write session: try to update token
2025-09-30T14:55:21.127062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f7e8ebe-bfd9c07a-bd46c754-fa93ebf6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:21.135591Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:21.135614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:21.135624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895967302641210:5335]
2025-09-30T14:55:21.135673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:21.135837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:21.135865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:21.136029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:21.136168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:21.136314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:21.136540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:21.136575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:21.144654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1841 sessionId: src_id|2f7e8ebe-bfd9c07a-bd46c754-fa93ebf6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:21.147582Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:21.147607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:21.147610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:21.147613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:21.147624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895967302641210:5335]
2025-09-30T14:55:21.147629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895967302641210:5335]
2025-09-30T14:55:21.147634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895967302641210:5335]
2025-09-30T14:55:21.147677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:21.147681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:21.147686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:21.147686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.147689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:21.147692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:21.147785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:21.147837Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:21.192586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895967392409950:7118]
2025-09-30T14:55:21.192939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1840, pipe: [1:7555895967392409950:7118]
2025-09-30T14:55:21.264987Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:21.265318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:21.265333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:21.265353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895967392409950:7118], now have 1 active actors on pipe
2025-09-30T14:55:21.265622Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:21.265644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:21.265660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:21.265677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895967392409950:7118]
2025-09-30T14:55:21.265699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:21.265731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1841 reason: error at write: Disconnected sessionId: src_id|2f7e8ebe-bfd9c07a-bd46c754-fa93ebf6_0
2025-09-30T14:55:21.266073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f7e8ebe-bfd9c07a-bd46c754-fa93ebf6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:21.266084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f7e8ebe-bfd9c07a-bd46c754-fa93ebf6_0] Write session will restart in 0.005376s
2025-09-30T14:55:21.266106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f7e8ebe-bfd9c07a-bd46c754-fa93ebf6_0] Write session: Do CDS request
2025-09-30T14:55:21.266111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f7e8ebe-bfd9c07a-bd46c754-fa93ebf6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:21.266007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1841 sessionId: src_id|2f7e8ebe-bfd9c07a-bd46c754-fa93ebf6_0 is DEAD
2025-09-30T14:55:21.272798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f7e8ebe-bfd9c07a-bd46c754-fa93ebf6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:21.272904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:21.272922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1842
2025-09-30T14:55:21.273044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1842 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:21.273090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1842 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:21.273099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1842 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:21.273104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:21.273583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1842 sessionId:  describe result for acl check
2025-09-30T14:55:21.273636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:21.273644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:21.273648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:21.273655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895967392409970:6804] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:21.274225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895967392409970:6804] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:21.278283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895967392409970:6804] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:21.281588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895967392409970:6804] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:21.281629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895967392409970:6804] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:21.281633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895967392409970:6804] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:21.281641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1842 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:21.284214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:21.287209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:21.287491Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:21.287500Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:21.287510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:21.287573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:21.287614Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895967302641393:5333]
2025-09-30T14:55:21.288294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:21.288694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:21.288776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:21.289063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:21.289116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:21.289122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:21.289123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:21.289124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:21.289125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:21.289126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:21.289127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:21.289128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:21.289129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:21.289130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:21.289131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.289132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.289133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.289133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:21.289134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:21.289138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:21.289145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:21.289148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:21.289151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:21.289157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:21.289159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:21.289162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:21.289164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:21.289167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:21.289171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:21.289174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.289176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.289178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.289181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:21.289183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:21.289190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:21.289196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:21.289200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:21.289204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:21.289208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:21.289214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:21.289216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:21.289220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:21.289223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:21.289226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:21.289229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:21.289232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:21.289235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:21.289238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:21.289241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:21.289244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:21.289247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:21.289251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:21.289254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:21.289257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:21.289261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.289264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.289267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.289271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.289276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.289279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.289282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:21.289285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:21.289288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:21.289291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:21.289318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:21.294903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:21.295777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:21.295797Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:21.295801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:21.295805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:21.295813Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1841 [2:7555895967302641393:5333]
2025-09-30T14:55:21.295829Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:21.295845Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:21.295849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:21.295852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:21.295854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:21.295871Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:21.295878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:21.295886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:21.295946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.295956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.295961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.295965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:21.295968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:21.296037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:21.296046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.296059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.296072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.296101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:21.296120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895967392409954:2454], now have 1 active actors on pipe
2025-09-30T14:55:21.296124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895967392410127:6804], now have 1 active actors on pipe
2025-09-30T14:55:21.296129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895967302641387:5333]
2025-09-30T14:55:21.296132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895967302641387:5333]
2025-09-30T14:55:21.296135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895967302641387:5333]
2025-09-30T14:55:21.296147Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:21.296160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:21.296175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:21.296178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:21.296213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895967302641387:5333]
2025-09-30T14:55:21.296216Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:21.296238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:21.296242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:21.296244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:21.296250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:21.296213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1841
2025-09-30T14:55:21.296233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1841
2025-09-30T14:55:21.296659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:21.296672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:21.296700Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ebb05cef-861d2ce1-fea9bfe5-1eea33d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:21.296713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:21.296723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:21.296726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:21.296737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:21.296753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:21.296773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:21.298232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:21.298247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:21.298277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:21.298382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1842 partition: 0 MaxSeqNo: 42 sessionId: src_id|ebb05cef-861d2ce1-fea9bfe5-1eea33d_0
2025-09-30T14:55:21.298778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f7e8ebe-bfd9c07a-bd46c754-fa93ebf6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ebb05cef-861d2ce1-fea9bfe5-1eea33d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:21.301723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb05cef-861d2ce1-fea9bfe5-1eea33d_0] Write session: try to update token
2025-09-30T14:55:21.301743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb05cef-861d2ce1-fea9bfe5-1eea33d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:21.310463Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:21.310487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:21.310489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:21.310491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:21.310502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895967302641387:5333]
2025-09-30T14:55:21.310507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895967302641387:5333]
2025-09-30T14:55:21.310512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895967302641387:5333]
2025-09-30T14:55:21.310555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:21.310563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.310566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:21.310715Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:21.315582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:21.315611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:21.315617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:21.331320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1842 sessionId: src_id|ebb05cef-861d2ce1-fea9bfe5-1eea33d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:21.334198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:21.365699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895967392410141:7118]
2025-09-30T14:55:21.366039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1841, pipe: [1:7555895967392410141:7118]
2025-09-30T14:55:21.428365Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:21.428871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:21.428886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:21.428907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895967392410141:7118], now have 1 active actors on pipe
2025-09-30T14:55:21.429157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:21.429214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895967392410141:7118]
2025-09-30T14:55:21.429218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:21.429224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:21.429254Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:21.429453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1842 reason: error at write: Disconnected sessionId: src_id|ebb05cef-861d2ce1-fea9bfe5-1eea33d_0
2025-09-30T14:55:21.429673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1842 sessionId: src_id|ebb05cef-861d2ce1-fea9bfe5-1eea33d_0 is DEAD
2025-09-30T14:55:21.429879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb05cef-861d2ce1-fea9bfe5-1eea33d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:21.429898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb05cef-861d2ce1-fea9bfe5-1eea33d_0] Write session will restart in 0.005245s
2025-09-30T14:55:21.429931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb05cef-861d2ce1-fea9bfe5-1eea33d_0] Write session: Do CDS request
2025-09-30T14:55:21.429942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb05cef-861d2ce1-fea9bfe5-1eea33d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:21.436872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb05cef-861d2ce1-fea9bfe5-1eea33d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:21.436992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:21.437011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1843
2025-09-30T14:55:21.437183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1843 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:21.437211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1843 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:21.437215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1843 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:21.437218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:21.437729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1843 sessionId:  describe result for acl check
2025-09-30T14:55:21.437777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:21.437785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:21.437787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:21.437793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895967392410165:6800] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:21.438370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895967392410165:6800] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:21.441028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895967392410165:6800] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:21.443960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895967392410165:6800] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:21.443979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895967392410165:6800] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:21.443982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895967392410165:6800] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:21.443992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1843 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:21.445091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:21.447390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:21.447635Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:21.447648Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:21.447661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:21.447727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:21.447774Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895967302641574:5332]
2025-09-30T14:55:21.448440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:21.448798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:21.448854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:21.449227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:21.449311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:21.449319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:21.449320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:21.449322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:21.449323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:21.449324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:21.449326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:21.449328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:21.449330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:21.449331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:21.449332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.449334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.449336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.449338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:21.449339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:21.449345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:21.449356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:21.449360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:21.449364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:21.449369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:21.449373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:21.449377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:21.449380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:21.449384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:21.449388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:21.449392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.449396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.449402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.449407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:21.449411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:21.449418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:21.449427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:21.449434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:21.449439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:21.449443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:21.449447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:21.449452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:21.449457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:21.449468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:21.449474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:21.449483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:21.449489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:21.449494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:21.449504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:21.449511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:21.449517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:21.449523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:21.449528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:21.449532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:21.449537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:21.449541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.449546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.449550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.449555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.449559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.449564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.449568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:21.449574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:21.449583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:21.449588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:21.449655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:21.455465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:21.456447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:21.456472Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:21.456476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:21.456481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:21.456488Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1842 [2:7555895967302641574:5332]
2025-09-30T14:55:21.456506Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:21.456524Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:21.456532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:21.456536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:21.456539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:21.456558Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:21.456571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:21.456579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:21.456661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.456673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.456676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.456681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:21.456684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:21.456752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:21.456761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.456774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.456787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.456805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:21.456829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895967392410313:6800], now have 1 active actors on pipe
2025-09-30T14:55:21.456842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895967392410142:2454], now have 1 active actors on pipe
2025-09-30T14:55:21.456848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895967302641569:5332]
2025-09-30T14:55:21.456851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895967302641569:5332]
2025-09-30T14:55:21.456856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895967302641569:5332]
2025-09-30T14:55:21.456873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:21.456891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:21.456904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:21.456908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:21.456910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:21.456912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:21.456896Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1842
2025-09-30T14:55:21.456916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:21.456911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1842
2025-09-30T14:55:21.456953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895967302641569:5332]
2025-09-30T14:55:21.456961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:21.456973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:21.456995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:21.456999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:21.457145Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42bac5fa-773a5fb7-b0654ba5-2eea2312_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:21.457161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:21.457165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:21.457167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:21.457178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:21.457192Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:21.457219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:21.457412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:21.457431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:21.457450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:21.457556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1843 partition: 0 MaxSeqNo: 42 sessionId: src_id|42bac5fa-773a5fb7-b0654ba5-2eea2312_0
2025-09-30T14:55:21.458134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb05cef-861d2ce1-fea9bfe5-1eea33d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|42bac5fa-773a5fb7-b0654ba5-2eea2312_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:21.463344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42bac5fa-773a5fb7-b0654ba5-2eea2312_0] Write session: try to update token
2025-09-30T14:55:21.463373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42bac5fa-773a5fb7-b0654ba5-2eea2312_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:21.469551Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:21.469579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:21.469581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:21.469584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:21.469593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895967302641569:5332]
2025-09-30T14:55:21.469598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895967302641569:5332]
2025-09-30T14:55:21.469619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895967302641569:5332]
2025-09-30T14:55:21.469661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:21.469667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.469670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:21.469675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:21.469682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:21.469687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:21.469810Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:21.482999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1843 sessionId: src_id|42bac5fa-773a5fb7-b0654ba5-2eea2312_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:21.486323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:21.529566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895967392410329:7118]
2025-09-30T14:55:21.529885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1842, pipe: [1:7555895967392410329:7118]
2025-09-30T14:55:21.585617Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:21.586191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:21.586209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:21.586230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895967392410329:7118], now have 1 active actors on pipe
2025-09-30T14:55:21.586419Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:21.586475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895967392410329:7118]
2025-09-30T14:55:21.586532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:21.586601Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:21.586611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1843 reason: status is not ok: tablet will be restarted right now sessionId: src_id|42bac5fa-773a5fb7-b0654ba5-2eea2312_0
2025-09-30T14:55:21.586782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1843 sessionId: src_id|42bac5fa-773a5fb7-b0654ba5-2eea2312_0 is DEAD
2025-09-30T14:55:21.586959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42bac5fa-773a5fb7-b0654ba5-2eea2312_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:21.586972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42bac5fa-773a5fb7-b0654ba5-2eea2312_0] Write session will restart in 0.008396s
2025-09-30T14:55:21.586996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42bac5fa-773a5fb7-b0654ba5-2eea2312_0] Write session: Do CDS request
2025-09-30T14:55:21.587013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42bac5fa-773a5fb7-b0654ba5-2eea2312_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:21.599770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42bac5fa-773a5fb7-b0654ba5-2eea2312_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:21.599913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:21.599930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1844
2025-09-30T14:55:21.600058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1844 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:21.600089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1844 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:21.600099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1844 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:21.600104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:21.600593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1844 sessionId:  describe result for acl check
2025-09-30T14:55:21.600628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:21.600630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:21.600632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:21.600638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895967392410470:6795] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:21.601193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895967392410470:6795] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:21.601407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:21.603229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895967392410470:6795] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:21.604383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:21.604599Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:21.604614Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:21.604627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:21.604688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:21.604732Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895967302641751:5329]
2025-09-30T14:55:21.605418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:21.605737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:21.605789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:21.606079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895967392410470:6795] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:21.606094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895967392410470:6795] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:21.606108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895967392410470:6795] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:21.606107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:21.606117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1844 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:21.606188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:21.606195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:21.606196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:21.606198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:21.606199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:21.606201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:21.606203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:21.606204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:21.606206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:21.606208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:21.606209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.606210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.606212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.606213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:21.606214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:21.606220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:21.606231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:21.606237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:21.606240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:21.606244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:21.606248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:21.606252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:21.606256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:21.606260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:21.606266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:21.606270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.606274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.606277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.606281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:21.606285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:21.606293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:21.606301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:21.606308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:21.606314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:21.606320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:21.606331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:21.606336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:21.606347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:21.606352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:21.606362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:21.606367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:21.606373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:21.606383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:21.606389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:21.606399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:21.606404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:21.606415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:21.606420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:21.606427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:21.606432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:21.606441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.606446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.606449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.606454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.606463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.606467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.606471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:21.606480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:21.606486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:21.606495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:21.606534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:21.612977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:21.613946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:21.613964Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:21.613967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:21.613970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:21.613975Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1843 [2:7555895967302641751:5329]
2025-09-30T14:55:21.613990Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:21.614003Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:21.614005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:21.614008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:21.614010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:21.614027Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:21.614034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:21.614048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:21.614129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.614138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.614141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.614145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:21.614148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:21.614201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:21.614207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.614218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.614233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.614253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:21.614276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895967302641745:5329]
2025-09-30T14:55:21.614296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895967302641745:5329]
2025-09-30T14:55:21.614298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895967302641745:5329]
2025-09-30T14:55:21.614312Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:21.614324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895967392410330:2454], now have 1 active actors on pipe
2025-09-30T14:55:21.614327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:21.614330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:21.614333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:21.614335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895967392410508:6795], now have 1 active actors on pipe
2025-09-30T14:55:21.614352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:21.614369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:21.614378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:21.614415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895967302641745:5329]
2025-09-30T14:55:21.614428Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:21.614440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:21.614412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1843
2025-09-30T14:55:21.614413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1843
2025-09-30T14:55:21.614468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:21.614479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:21.614510Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|321c22f9-6ca60834-983d9d77-f3fe2204_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:21.614523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:21.614526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:21.614529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:21.614540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:21.614549Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:21.614570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:21.614719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:21.614729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:21.614742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:21.614827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1844 partition: 0 MaxSeqNo: 42 sessionId: src_id|321c22f9-6ca60834-983d9d77-f3fe2204_0
2025-09-30T14:55:21.615200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42bac5fa-773a5fb7-b0654ba5-2eea2312_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|321c22f9-6ca60834-983d9d77-f3fe2204_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:21.618397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|321c22f9-6ca60834-983d9d77-f3fe2204_0] Write session: try to update token
2025-09-30T14:55:21.618419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|321c22f9-6ca60834-983d9d77-f3fe2204_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:21.631106Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:21.631127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:21.631135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895967302641745:5329]
2025-09-30T14:55:21.631173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:21.631185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:21.631413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:21.631576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:21.631732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:21.631882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:21.632078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:21.632120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:21.633886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1844 sessionId: src_id|321c22f9-6ca60834-983d9d77-f3fe2204_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:21.636565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:21.636741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:21.636764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:21.636795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:21.636891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:21.638509Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:21.638523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:21.638524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:21.638525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:21.638534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895967302641745:5329]
2025-09-30T14:55:21.638537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895967302641745:5329]
2025-09-30T14:55:21.638541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895967302641745:5329]
2025-09-30T14:55:21.638569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:21.638575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.638576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:21.638594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:21.638605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:21.638609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:21.638703Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:21.686716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895967392410544:7118]
2025-09-30T14:55:21.687111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1843, pipe: [1:7555895967392410544:7118]
2025-09-30T14:55:21.751232Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:21.760107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:21.760148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:21.760349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:21.760423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:21.760492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:21.760566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:21.760617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:21.760628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:21.760711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:21.760779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:21.760858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:21.760937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:21.760992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:21.761000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:21.761080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:21.761154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:21.761231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:21.761301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:21.761427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:21.761439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:21.761518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:21.761594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:21.761679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:21.761750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:21.761802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:21.761805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:21.761880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:21.761947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:21.762014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:21.762081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:21.762128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:21.762135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:21.762205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:21.762268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:21.762333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:21.762397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:21.762446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:21.762452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:21.762521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:21.762600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:21.762678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:21.762740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:21.762783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:21.762786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:21.762859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:21.762929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:21.763004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:21.763076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:21.763125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:21.763133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:21.763206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:21.763289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:21.763363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:21.763437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:21.763486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:21.763493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:21.763565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:21.763635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:21.763701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:21.763781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:21.763828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:21.763835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:21.763901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895967392410544:7118], now have 1 active actors on pipe
2025-09-30T14:55:21.764202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895967392410544:7118]
2025-09-30T14:55:21.764206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:21.764243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:21.764246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:21.764273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1844 reason: error at write: Disconnected sessionId: src_id|321c22f9-6ca60834-983d9d77-f3fe2204_0
2025-09-30T14:55:21.764527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1844 sessionId: src_id|321c22f9-6ca60834-983d9d77-f3fe2204_0 is DEAD
2025-09-30T14:55:21.765154Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:21.767359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|321c22f9-6ca60834-983d9d77-f3fe2204_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:21.767372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|321c22f9-6ca60834-983d9d77-f3fe2204_0] Write session will restart in 0.009760s
2025-09-30T14:55:21.767397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|321c22f9-6ca60834-983d9d77-f3fe2204_0] Write session: Do CDS request
2025-09-30T14:55:21.767404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|321c22f9-6ca60834-983d9d77-f3fe2204_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:21.778851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|321c22f9-6ca60834-983d9d77-f3fe2204_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:21.778917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:21.778937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1845
2025-09-30T14:55:21.779105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1845 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:21.779152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1845 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:21.779163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1845 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:21.779167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:21.779594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1845 sessionId:  describe result for acl check
2025-09-30T14:55:21.779639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:21.779646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:21.779648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:21.779655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895967392410698:6772] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:21.779630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:21.780229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895967392410698:6772] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:21.782377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895967392410698:6772] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:21.782392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:21.782721Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:21.782733Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:21.782743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:21.782790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:21.782839Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895967302641980:5302]
2025-09-30T14:55:21.783394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:21.783732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:21.783775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:21.784073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:21.784146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:21.784153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:21.784154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:21.784155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:21.784156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:21.784158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:21.784159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:21.784161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:21.784162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:21.784164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:21.784165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.784166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.784167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.784169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:21.784170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:21.784177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:21.784186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:21.784190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:21.784194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:21.784198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:21.784203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:21.784207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:21.784211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:21.784215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:21.784219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:21.784223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.784228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.784232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.784236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:21.784241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:21.784250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:21.784258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:21.784264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:21.784270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:21.784276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:21.784281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:21.784286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:21.784292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:21.784297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:21.784303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:21.784308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:21.784313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:21.784319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:21.784325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:21.784330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:21.784335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:21.784340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:21.784346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:21.784351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:21.784357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:21.784367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.784371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.784374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.784377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.784382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.784388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.784398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:21.784405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:21.784414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:21.784420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:21.784466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:21.785571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895967392410698:6772] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:21.785587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895967392410698:6772] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:21.785592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895967392410698:6772] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:21.785600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1845 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:21.791468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:21.792354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:21.792372Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:21.792374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:21.792378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:21.792385Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1844 [2:7555895967302641980:5302]
2025-09-30T14:55:21.792399Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:21.792415Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:21.792421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:21.792424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:21.792426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:21.792440Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:21.792446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:21.792452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:21.792504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.792512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.792514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.792517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:21.792519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:21.792576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:21.792585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.792597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.792613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.792632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:21.792654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895967302641974:5302]
2025-09-30T14:55:21.792657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895967302641974:5302]
2025-09-30T14:55:21.792660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895967302641974:5302]
2025-09-30T14:55:21.792669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:21.792685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895967392410737:6772], now have 1 active actors on pipe
2025-09-30T14:55:21.792689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895967392410555:2454], now have 1 active actors on pipe
2025-09-30T14:55:21.792697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:21.792703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:21.792707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:21.792709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:21.792710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:21.792713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:21.792749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895967302641974:5302]
2025-09-30T14:55:21.792755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:21.792784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:21.793060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1844
2025-09-30T14:55:21.793063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1844
2025-09-30T14:55:21.793492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:21.793503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:21.793530Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|213cd579-7bc84731-9125f423-a87c0b8b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:21.793543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:21.793548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:21.793550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:21.793561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:21.793572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:21.793584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:21.793803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:21.793811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:21.793826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:21.793924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1845 partition: 0 MaxSeqNo: 42 sessionId: src_id|213cd579-7bc84731-9125f423-a87c0b8b_0
2025-09-30T14:55:21.794241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|321c22f9-6ca60834-983d9d77-f3fe2204_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|213cd579-7bc84731-9125f423-a87c0b8b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:21.797056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|213cd579-7bc84731-9125f423-a87c0b8b_0] Write session: try to update token
2025-09-30T14:55:21.797075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|213cd579-7bc84731-9125f423-a87c0b8b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:21.806078Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:21.806099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:21.806101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:21.806103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:21.806112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895967302641974:5302]
2025-09-30T14:55:21.806116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895967302641974:5302]
2025-09-30T14:55:21.806120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895967302641974:5302]
2025-09-30T14:55:21.806160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:21.806167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:21.806172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.806174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:21.806175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:21.806178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:21.806312Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:21.816409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1845 sessionId: src_id|213cd579-7bc84731-9125f423-a87c0b8b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:21.819239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:21.864394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895967392410745:7118]
2025-09-30T14:55:21.864753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1844, pipe: [1:7555895967392410745:7118]
2025-09-30T14:55:21.924726Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:21.925454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:21.925472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:21.925491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895967392410745:7118], now have 1 active actors on pipe
2025-09-30T14:55:21.925856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:21.925860Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:21.925876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:21.925908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895967392410745:7118]
2025-09-30T14:55:21.925948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1845 reason: error at write: Disconnected sessionId: src_id|213cd579-7bc84731-9125f423-a87c0b8b_0
2025-09-30T14:55:21.926124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1845 sessionId: src_id|213cd579-7bc84731-9125f423-a87c0b8b_0 is DEAD
2025-09-30T14:55:21.926273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|213cd579-7bc84731-9125f423-a87c0b8b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:21.926285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|213cd579-7bc84731-9125f423-a87c0b8b_0] Write session will restart in 0.007125s
2025-09-30T14:55:21.926308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|213cd579-7bc84731-9125f423-a87c0b8b_0] Write session: Do CDS request
2025-09-30T14:55:21.926315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|213cd579-7bc84731-9125f423-a87c0b8b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:21.926069Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:21.934886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|213cd579-7bc84731-9125f423-a87c0b8b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:21.935180Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:21.935205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1846
2025-09-30T14:55:21.935335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1846 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:21.935381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1846 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:21.935391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1846 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:21.935395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:21.935835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1846 sessionId:  describe result for acl check
2025-09-30T14:55:21.935871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:21.935878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:21.935880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:21.935886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895967392410759:6767] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:21.936443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895967392410759:6767] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:21.940297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895967392410759:6767] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:21.944284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895967392410759:6767] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:21.944304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895967392410759:6767] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:21.944308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895967392410759:6767] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:21.944317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1846 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:21.945658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:21.948265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:21.948583Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:21.948604Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:21.948624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:21.948716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:21.948770Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895967302642164:5301]
2025-09-30T14:55:21.949512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:21.949948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:21.950031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:21.950452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:21.950542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:21.950543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:21.950544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:21.950546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:21.950547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:21.950548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:21.950549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:21.950550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:21.950552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:21.950553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:21.950555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.950556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.950557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.950559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:21.950560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:21.950567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:21.950577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:21.950582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:21.950586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:21.950589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:21.950607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:21.950611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:21.950615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:21.950620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:21.950625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:21.950630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.950634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.950639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.950643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:21.950648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:21.950658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:21.950668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:21.950675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:21.950681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:21.950686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:21.950703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:21.950707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:21.950713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:21.950718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:21.950726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:21.950731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:21.950738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:21.950744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:21.950750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:21.950755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:21.950761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:21.950768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:21.950774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:21.950779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:21.950785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:21.950791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.950796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.950802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.950808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.950813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.950819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.950824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:21.950830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:21.950835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:21.950841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:21.950889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:21.957340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:21.959001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1845
2025-09-30T14:55:21.959069Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1845
2025-09-30T14:55:21.958474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:21.958500Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:21.958503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:21.958508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:21.958516Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1845 [2:7555895967302642164:5301]
2025-09-30T14:55:21.958535Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:21.958554Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:21.958557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:21.958560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:21.958563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:21.958580Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:21.958587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:21.958595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:21.958666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.958668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.958671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.958674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:21.958677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:21.958763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:21.958766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.958784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:21.958796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:21.958813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:21.958831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895967392410747:2454], now have 1 active actors on pipe
2025-09-30T14:55:21.958838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895967302642159:5301]
2025-09-30T14:55:21.958841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895967302642159:5301]
2025-09-30T14:55:21.958844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895967302642159:5301]
2025-09-30T14:55:21.958861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:21.958872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895967392410922:6767], now have 1 active actors on pipe
2025-09-30T14:55:21.958877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:21.958880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:21.958880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:21.958883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:21.958894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:21.958897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:21.958935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895967302642159:5301]
2025-09-30T14:55:21.958943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:21.958949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:21.959116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:21.959128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:21.959174Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96ab9315-6612a8c-71ff0a7-f82e1425_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:21.959182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:21.959186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:21.959189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:21.959200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:21.959212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:21.959228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:21.959481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:21.959492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:21.959507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:21.959619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1846 partition: 0 MaxSeqNo: 42 sessionId: src_id|96ab9315-6612a8c-71ff0a7-f82e1425_0
2025-09-30T14:55:21.959975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|213cd579-7bc84731-9125f423-a87c0b8b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|96ab9315-6612a8c-71ff0a7-f82e1425_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:21.962931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96ab9315-6612a8c-71ff0a7-f82e1425_0] Write session: try to update token
2025-09-30T14:55:21.962951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96ab9315-6612a8c-71ff0a7-f82e1425_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:21.980890Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:21.980912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:21.980923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895967302642159:5301]
2025-09-30T14:55:21.980975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:21.981191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:21.981347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:21.981502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:21.981677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:21.981883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:21.981923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:21.983301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:21.986911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1846 sessionId: src_id|96ab9315-6612a8c-71ff0a7-f82e1425_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:21.989903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:21.986886Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:21.986908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:21.986910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:21.986911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:21.986921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895967302642159:5301]
2025-09-30T14:55:21.986925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895967302642159:5301]
2025-09-30T14:55:21.986929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895967302642159:5301]
2025-09-30T14:55:21.986971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:21.986978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:21.986980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:21.987000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:21.987007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:21.987011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:21.987124Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:22.026151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895971687378233:7118]
2025-09-30T14:55:22.026467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1845, pipe: [1:7555895971687378233:7118]
2025-09-30T14:55:22.104136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895971687378233:7118]
2025-09-30T14:55:22.104168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:22.104199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:22.104201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:22.104261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1846 reason: error at write: Disconnected sessionId: src_id|96ab9315-6612a8c-71ff0a7-f82e1425_0
2025-09-30T14:55:22.104457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1846 sessionId: src_id|96ab9315-6612a8c-71ff0a7-f82e1425_0 is DEAD
2025-09-30T14:55:22.104650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96ab9315-6612a8c-71ff0a7-f82e1425_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:22.104669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96ab9315-6612a8c-71ff0a7-f82e1425_0] Write session will restart in 0.009332s
2025-09-30T14:55:22.104693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96ab9315-6612a8c-71ff0a7-f82e1425_0] Write session: Do CDS request
2025-09-30T14:55:22.104700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96ab9315-6612a8c-71ff0a7-f82e1425_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:22.103450Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:22.103810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:22.103827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:22.103850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895971687378233:7118], now have 1 active actors on pipe
2025-09-30T14:55:22.104075Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:22.114994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96ab9315-6612a8c-71ff0a7-f82e1425_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:22.115058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:22.115078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1847
2025-09-30T14:55:22.115320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1847 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:22.115354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1847 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:22.115359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1847 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:22.115365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:22.115869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1847 sessionId:  describe result for acl check
2025-09-30T14:55:22.115900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:22.115906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:22.115908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:22.115914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895971687378325:6760] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:22.116441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895971687378325:6760] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:22.118704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895971687378325:6760] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:22.119523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:22.121672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:22.121872Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:22.121882Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:22.121893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:22.121937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:22.122052Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895971597609641:5294]
2025-09-30T14:55:22.122053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895971687378325:6760] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:22.122067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895971687378325:6760] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:22.122070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895971687378325:6760] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:22.122076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1847 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:22.122691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:22.122988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:22.123032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:22.123358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:22.123427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:22.123433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:22.123434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:22.123435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:22.123436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:22.123437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:22.123438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:22.123440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:22.123441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:22.123442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:22.123443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.123444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:22.123445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:22.123446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:22.123447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:22.123452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:22.123463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:22.123467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:22.123471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:22.123475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:22.123479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:22.123483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:22.123486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:22.123490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:22.123494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:22.123498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.123502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:22.123505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:22.123508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:22.123511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:22.123518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:22.123525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:22.123530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:22.123535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:22.123539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:22.123543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:22.123547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:22.123552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:22.123556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:22.123560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:22.123564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:22.123569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:22.123573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:22.123577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:22.123581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:22.123585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:22.123589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:22.123594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:22.123597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:22.123602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:22.123607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.123611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.123615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:22.123619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:22.123623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:22.123627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:22.123631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:22.123635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:22.123640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:22.123644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:22.123679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:22.129551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:22.130452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:22.130471Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:22.130474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:22.130478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:22.130485Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1846 [2:7555895971597609641:5294]
2025-09-30T14:55:22.130501Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:22.130517Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:22.130521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:22.130524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:22.130526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:22.130542Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:22.130549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:22.130556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:22.130619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.130628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:22.130631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:22.130634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:22.130637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:22.130714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:22.130721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.130732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:22.130742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:22.130761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:22.130782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895971687378416:6760], now have 1 active actors on pipe
2025-09-30T14:55:22.130791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895971687378234:2454], now have 1 active actors on pipe
2025-09-30T14:55:22.130797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895971597609636:5294]
2025-09-30T14:55:22.130800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895971597609636:5294]
2025-09-30T14:55:22.130803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895971597609636:5294]
2025-09-30T14:55:22.130816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:22.130830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:22.130834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:22.130839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:22.130841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:22.130844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:22.130847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:22.130840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1846
2025-09-30T14:55:22.130882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895971597609636:5294]
2025-09-30T14:55:22.130891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:22.130892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:22.130916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1846
2025-09-30T14:55:22.131048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:22.131061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:22.131086Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2d81f3-e53b0270-7a3dae93-88c2da6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:22.131100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:22.131104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:22.131107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:22.131116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:22.131127Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:22.131146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:22.131321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:22.131330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:22.131343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:22.131435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1847 partition: 0 MaxSeqNo: 42 sessionId: src_id|e2d81f3-e53b0270-7a3dae93-88c2da6b_0
2025-09-30T14:55:22.131838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96ab9315-6612a8c-71ff0a7-f82e1425_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e2d81f3-e53b0270-7a3dae93-88c2da6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:22.134758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2d81f3-e53b0270-7a3dae93-88c2da6b_0] Write session: try to update token
2025-09-30T14:55:22.134779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2d81f3-e53b0270-7a3dae93-88c2da6b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:22.144506Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:22.144528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:22.144537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895971597609636:5294]
2025-09-30T14:55:22.144584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:22.144617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:22.144780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:22.144948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:22.145112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:22.145259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:22.145480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:22.145535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:22.150348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1847 sessionId: src_id|e2d81f3-e53b0270-7a3dae93-88c2da6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:22.153072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:22.153401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:22.153439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:22.153480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:22.153618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:22.155290Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:22.155308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:22.155310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:22.155312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:22.155325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895971597609636:5294]
2025-09-30T14:55:22.155329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895971597609636:5294]
2025-09-30T14:55:22.155333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895971597609636:5294]
2025-09-30T14:55:22.155376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:22.155387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.155390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:22.155394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:22.155397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:22.155401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:22.155529Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:22.204392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895971687378434:7118]
2025-09-30T14:55:22.204727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1846, pipe: [1:7555895971687378434:7118]
2025-09-30T14:55:22.271189Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:22.280129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:22.280167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:22.280367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:22.280453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:22.280533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:22.280613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:22.280670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:22.280684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:22.280766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:22.280840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:22.280916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:22.280993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:22.281047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:22.281055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:22.281141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:22.281218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:22.281302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:22.281380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:22.281431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:22.281444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:22.281523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:22.281620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:22.281702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:22.281772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:22.281819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:22.281823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:22.281903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:22.282092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:22.282172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:22.282243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:22.282317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:22.282320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:22.282400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:22.282466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:22.282537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:22.282606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:22.282682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:22.282685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:22.282762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:22.282822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:22.282883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:22.282947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:22.282993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:22.282996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:22.283062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:22.283115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:22.283186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:22.283274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:22.283338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:22.283342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:22.283417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:22.283478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:22.283552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:22.283624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:22.283674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:22.283681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:22.283753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:22.283819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:22.283886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:22.283955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:22.284004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:22.284012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:22.284077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895971687378434:7118], now have 1 active actors on pipe
2025-09-30T14:55:22.284443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895971687378434:7118]
2025-09-30T14:55:22.284445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:22.284452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:22.284478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:22.284483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1847 reason: error at write: Disconnected sessionId: src_id|e2d81f3-e53b0270-7a3dae93-88c2da6b_0
2025-09-30T14:55:22.284700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1847 sessionId: src_id|e2d81f3-e53b0270-7a3dae93-88c2da6b_0 is DEAD
2025-09-30T14:55:22.285247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2d81f3-e53b0270-7a3dae93-88c2da6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:22.285258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2d81f3-e53b0270-7a3dae93-88c2da6b_0] Write session will restart in 0.005147s
2025-09-30T14:55:22.285292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2d81f3-e53b0270-7a3dae93-88c2da6b_0] Write session: Do CDS request
2025-09-30T14:55:22.285299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2d81f3-e53b0270-7a3dae93-88c2da6b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:22.285275Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:22.291911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2d81f3-e53b0270-7a3dae93-88c2da6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:22.292040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:22.292058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1848
2025-09-30T14:55:22.292194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1848 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:22.292239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1848 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:22.292249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1848 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:22.292254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:22.292764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1848 sessionId:  describe result for acl check
2025-09-30T14:55:22.292810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:22.292817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:22.292819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:22.292825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895971687378463:6755] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:22.293416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895971687378463:6755] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:22.296910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895971687378463:6755] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:22.298952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:22.301232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:22.301379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895971687378463:6755] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:22.301399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895971687378463:6755] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:22.301402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895971687378463:6755] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:22.301411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1848 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:22.301447Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:22.301456Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:22.301466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:22.301527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:22.301571Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895971597609824:5289]
2025-09-30T14:55:22.302305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:22.302567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:22.302626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:22.302983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:22.303053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:22.303060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:22.303061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:22.303063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:22.303064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:22.303066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:22.303067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:22.303069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:22.303070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:22.303071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:22.303073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.303075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:22.303076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:22.303078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:22.303079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:22.303085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:22.303098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:22.303103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:22.303108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:22.303113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:22.303117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:22.303122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:22.303126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:22.303130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:22.303134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:22.303138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.303143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:22.303147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:22.303152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:22.303157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:22.303164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:22.303172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:22.303185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:22.303197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:22.303202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:22.303212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:22.303217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:22.303228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:22.303234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:22.303240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:22.303267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:22.303274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:22.303283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:22.303290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:22.303299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:22.303305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:22.303316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:22.303322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:22.303331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:22.303337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:22.303342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.303347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.303352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:22.303357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:22.303362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:22.303368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:22.303373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:22.303379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:22.303388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:22.303394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:22.303460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:22.308883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:22.310048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:22.310070Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:22.310074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:22.310078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:22.310085Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1847 [2:7555895971597609824:5289]
2025-09-30T14:55:22.310102Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:22.310121Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:22.310129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:22.310132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:22.310136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:22.310152Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:22.310159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:22.310166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:22.310228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.310237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:22.310239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:22.310243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:22.310245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:22.310315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:22.310322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.310337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:22.310349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:22.310376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:22.310401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895971687378435:2454], now have 1 active actors on pipe
2025-09-30T14:55:22.310411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895971687378616:6755], now have 1 active actors on pipe
2025-09-30T14:55:22.310418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895971597609819:5289]
2025-09-30T14:55:22.310421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895971597609819:5289]
2025-09-30T14:55:22.310423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895971597609819:5289]
2025-09-30T14:55:22.310438Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:22.310453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:22.310466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:22.310468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:22.310472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:22.310472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:22.310475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:22.310467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1847
2025-09-30T14:55:22.310508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895971597609819:5289]
2025-09-30T14:55:22.310517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:22.310519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:22.310523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1847
2025-09-30T14:55:22.310569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:22.310579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:22.310603Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4445b0c8-88db38c5-a4940dee-22db8f82_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:22.310615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:22.310619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:22.310621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:22.310631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:22.310639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:22.310653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:22.310803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:22.310813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:22.310826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:22.310966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1848 partition: 0 MaxSeqNo: 42 sessionId: src_id|4445b0c8-88db38c5-a4940dee-22db8f82_0
2025-09-30T14:55:22.311383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2d81f3-e53b0270-7a3dae93-88c2da6b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4445b0c8-88db38c5-a4940dee-22db8f82_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:22.314256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4445b0c8-88db38c5-a4940dee-22db8f82_0] Write session: try to update token
2025-09-30T14:55:22.314279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4445b0c8-88db38c5-a4940dee-22db8f82_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:22.323544Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:22.323571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:22.323582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895971597609819:5289]
2025-09-30T14:55:22.323631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:22.323646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:22.323812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:22.323990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:22.324146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:22.324297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:22.324514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:22.324568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:22.331211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1848 sessionId: src_id|4445b0c8-88db38c5-a4940dee-22db8f82_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:22.334045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:22.334438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:22.334463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:22.334509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:22.334601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:22.341115Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:22.341142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:22.341145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:22.341147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:22.341158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895971597609819:5289]
2025-09-30T14:55:22.341163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895971597609819:5289]
2025-09-30T14:55:22.341168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895971597609819:5289]
2025-09-30T14:55:22.341210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:22.341216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:22.341222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:22.341222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.341225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:22.341226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:22.341368Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:22.384567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895971687378628:7118]
2025-09-30T14:55:22.384830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1847, pipe: [1:7555895971687378628:7118]
2025-09-30T14:55:22.457660Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:22.466540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:22.466578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:22.466773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:22.466839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:22.466912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:22.466979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:22.467027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:22.467032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:22.467112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:22.467177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:22.467264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:22.467340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:22.467383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:22.467387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:22.467462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:22.467537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:22.467608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:22.467674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:22.467727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:22.467738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:22.467814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:22.467878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:22.467968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:22.468044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:22.468089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:22.468097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:22.468175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:22.468242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:22.468309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:22.468378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:22.468424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:22.468431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:22.468499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:22.468562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:22.468628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:22.468693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:22.468737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:22.468745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:22.468814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:22.468880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:22.468947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:22.469008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:22.469053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:22.469062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:22.469130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:22.469195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:22.469260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:22.469327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:22.469380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:22.469387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:22.469462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:22.469531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:22.469611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:22.469679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:22.469730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:22.469738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:22.469816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:22.469882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:22.469956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:22.470027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:22.470077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:22.470085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:22.470161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895971687378628:7118], now have 1 active actors on pipe
2025-09-30T14:55:22.470523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:22.470586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895971687378628:7118]
2025-09-30T14:55:22.470609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:22.470619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:22.470648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1848 reason: error at write: Disconnected sessionId: src_id|4445b0c8-88db38c5-a4940dee-22db8f82_0
2025-09-30T14:55:22.470847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1848 sessionId: src_id|4445b0c8-88db38c5-a4940dee-22db8f82_0 is DEAD
2025-09-30T14:55:22.470989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4445b0c8-88db38c5-a4940dee-22db8f82_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:22.470999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4445b0c8-88db38c5-a4940dee-22db8f82_0] Write session will restart in 0.008076s
2025-09-30T14:55:22.471023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4445b0c8-88db38c5-a4940dee-22db8f82_0] Write session: Do CDS request
2025-09-30T14:55:22.471029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4445b0c8-88db38c5-a4940dee-22db8f82_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:22.471521Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:22.480838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4445b0c8-88db38c5-a4940dee-22db8f82_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:22.480884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:22.480903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1849
2025-09-30T14:55:22.481091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1849 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:22.481124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1849 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:22.481129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1849 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:22.481134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:22.481655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1849 sessionId:  describe result for acl check
2025-09-30T14:55:22.481697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:22.481705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:22.481706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:22.481713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895971687378650:6751] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:22.482293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895971687378650:6751] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:22.485255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895971687378650:6751] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:22.488893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895971687378650:6751] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:22.488912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895971687378650:6751] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:22.488915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895971687378650:6751] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:22.488923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1849 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:22.489277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:22.491944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:22.492186Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:22.492199Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:22.492212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:22.492271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:22.492315Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895971597610011:5287]
2025-09-30T14:55:22.493004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:22.493555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:22.493636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:22.494019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:22.494088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:22.494098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:22.494099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:22.494100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:22.494102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:22.494103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:22.494105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:22.494106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:22.494107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:22.494109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:22.494110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.494111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:22.494113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:22.494114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:22.494115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:22.494123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:22.494133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:22.494138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:22.494143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:22.494148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:22.494153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:22.494158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:22.494162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:22.494167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:22.494173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:22.494177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.494182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:22.494186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:22.494190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:22.494196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:22.494204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:22.494213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:22.494219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:22.494225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:22.494230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:22.494236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:22.494243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:22.494250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:22.494256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:22.494262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:22.494273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:22.494280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:22.494290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:22.494296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:22.494301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:22.494307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:22.494312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:22.494319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:22.494323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:22.494330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:22.494342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.494352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.494357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:22.494361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:22.494366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:22.494376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:22.494380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:22.494390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:22.494395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:22.494404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:22.494453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:22.500407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:22.501275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:22.501297Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:22.501301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:22.501305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:22.501313Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1848 [2:7555895971597610011:5287]
2025-09-30T14:55:22.501332Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:22.501348Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:22.501361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:22.501365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:22.501368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:22.501386Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:22.501400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:22.501407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:22.501474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.501482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:22.501485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:22.501489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:22.501491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:22.501565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:22.501573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.501586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:22.501597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:22.501626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:22.501648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895971687378630:2454], now have 1 active actors on pipe
2025-09-30T14:55:22.501651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895971687378810:6751], now have 1 active actors on pipe
2025-09-30T14:55:22.501658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895971597610005:5287]
2025-09-30T14:55:22.501660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895971597610005:5287]
2025-09-30T14:55:22.501663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895971597610005:5287]
2025-09-30T14:55:22.501675Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:22.501689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:22.501705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:22.501714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:22.501755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895971597610005:5287]
2025-09-30T14:55:22.501763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:22.501808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:22.501821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:22.501824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:22.501799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1848
2025-09-30T14:55:22.501832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:22.501816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1848
2025-09-30T14:55:22.501994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:22.502006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:22.502030Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d518b968-cd4762a3-756d2b80-7a2877ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:22.502042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:22.502049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:22.502052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:22.502062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:22.502078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:22.502092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:22.502371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:22.502385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:22.502411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:22.502571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1849 partition: 0 MaxSeqNo: 42 sessionId: src_id|d518b968-cd4762a3-756d2b80-7a2877ae_0
2025-09-30T14:55:22.502965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4445b0c8-88db38c5-a4940dee-22db8f82_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d518b968-cd4762a3-756d2b80-7a2877ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:22.505941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d518b968-cd4762a3-756d2b80-7a2877ae_0] Write session: try to update token
2025-09-30T14:55:22.505960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d518b968-cd4762a3-756d2b80-7a2877ae_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:22.516347Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:22.516375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:22.516378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:22.516380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:22.516391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895971597610005:5287]
2025-09-30T14:55:22.516399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895971597610005:5287]
2025-09-30T14:55:22.516407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895971597610005:5287]
2025-09-30T14:55:22.516464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:22.516469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:22.516473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.516477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:22.516477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:22.516482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:22.516701Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:22.522666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1849 sessionId: src_id|d518b968-cd4762a3-756d2b80-7a2877ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:22.525734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:22.566874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895971687378823:7118]
2025-09-30T14:55:22.567224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1848, pipe: [1:7555895971687378823:7118]
2025-09-30T14:55:22.631740Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:22.632287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:22.632307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:22.632348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895971687378823:7118], now have 1 active actors on pipe
2025-09-30T14:55:22.632608Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:22.633103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d518b968-cd4762a3-756d2b80-7a2877ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:22.633114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d518b968-cd4762a3-756d2b80-7a2877ae_0] Write session will restart in 0.009502s
2025-09-30T14:55:22.633138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d518b968-cd4762a3-756d2b80-7a2877ae_0] Write session: Do CDS request
2025-09-30T14:55:22.633143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d518b968-cd4762a3-756d2b80-7a2877ae_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:22.632655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:22.632656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895971687378823:7118]
2025-09-30T14:55:22.632680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:22.632680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:22.632745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1849 reason: error at write: Disconnected sessionId: src_id|d518b968-cd4762a3-756d2b80-7a2877ae_0
2025-09-30T14:55:22.632921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1849 sessionId: src_id|d518b968-cd4762a3-756d2b80-7a2877ae_0 is DEAD
2025-09-30T14:55:22.643872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d518b968-cd4762a3-756d2b80-7a2877ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:22.647406Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:22.647425Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1850
2025-09-30T14:55:22.647606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1850 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:22.647640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1850 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:22.647651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1850 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:22.647655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:22.648190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1850 sessionId:  describe result for acl check
2025-09-30T14:55:22.648233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:22.648240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:22.648243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:22.648249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895971687378900:6746] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:22.648902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895971687378900:6746] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:22.651647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895971687378900:6746] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:22.654563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895971687378900:6746] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:22.654580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895971687378900:6746] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:22.654584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895971687378900:6746] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:22.654601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1850 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:22.657957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:22.661115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:22.661419Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:22.661434Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:22.661447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:22.661516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:22.661577Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895971597610208:5282]
2025-09-30T14:55:22.662584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:22.662960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:22.663025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:22.663494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:22.663592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:22.663601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:22.663602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:22.663606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:22.663609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:22.663610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:22.663614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:22.663616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:22.663617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:22.663619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:22.663620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.663622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:22.663623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:22.663624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:22.663625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:22.663632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:22.663645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:22.663649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:22.663655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:22.663659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:22.663664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:22.663667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:22.663671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:22.663677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:22.663681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:22.663685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.663690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:22.663694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:22.663698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:22.663702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:22.663713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:22.663722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:22.663728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:22.663734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:22.663739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:22.663745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:22.663749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:22.663754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:22.663759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:22.663765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:22.663770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:22.663775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:22.663783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:22.663791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:22.663796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:22.663801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:22.663807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:22.663814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:22.663819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:22.663826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:22.663832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.663838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.663843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:22.663850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:22.663867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:22.663882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:22.663886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:22.663891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:22.663899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:22.663905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:22.663953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:22.674076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:22.675088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:22.675109Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:22.675113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:22.675120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:22.675127Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1849 [2:7555895971597610208:5282]
2025-09-30T14:55:22.675148Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:22.675169Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:22.675174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:22.675178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:22.675181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:22.675198Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:22.675205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:22.675215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:22.675315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.675318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:22.675323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:22.675329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:22.675334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:22.675433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:22.675436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.675450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:22.675464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:22.675481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:22.675500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895971597610203:5282]
2025-09-30T14:55:22.675503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895971597610203:5282]
2025-09-30T14:55:22.675508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895971597610203:5282]
2025-09-30T14:55:22.675527Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:22.675558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:22.675574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:22.675578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:22.675617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895971597610203:5282]
2025-09-30T14:55:22.675622Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:22.675632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895971687378826:2454], now have 1 active actors on pipe
2025-09-30T14:55:22.675631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:22.675636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:22.675637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895971687379005:6746], now have 1 active actors on pipe
2025-09-30T14:55:22.675639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:22.675646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:22.676035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:22.676045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:22.676082Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|416b1ae6-3ea4cc69-a7aec1e7-6bdc4af3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:22.676100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:22.676118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:22.676123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:22.676178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:22.676197Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:22.676659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:22.676920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:22.676929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:22.676948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:22.677760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d518b968-cd4762a3-756d2b80-7a2877ae_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|416b1ae6-3ea4cc69-a7aec1e7-6bdc4af3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:22.675754Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1849
2025-09-30T14:55:22.675807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1849
2025-09-30T14:55:22.677286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1850 partition: 0 MaxSeqNo: 42 sessionId: src_id|416b1ae6-3ea4cc69-a7aec1e7-6bdc4af3_0
2025-09-30T14:55:22.686385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|416b1ae6-3ea4cc69-a7aec1e7-6bdc4af3_0] Write session: try to update token
2025-09-30T14:55:22.686415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|416b1ae6-3ea4cc69-a7aec1e7-6bdc4af3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:22.689166Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:22.689195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:22.689208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895971597610203:5282]
2025-09-30T14:55:22.689267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:22.689447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:22.689586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:22.689754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:22.689929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:22.690130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:22.690176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:22.690364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:22.702495Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:22.702523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:22.702526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:22.702528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:22.702538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895971597610203:5282]
2025-09-30T14:55:22.702544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895971597610203:5282]
2025-09-30T14:55:22.702551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895971597610203:5282]
2025-09-30T14:55:22.702592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:22.702605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.702605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:22.702616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:22.702624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:22.702630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:22.702767Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:22.705925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1850 sessionId: src_id|416b1ae6-3ea4cc69-a7aec1e7-6bdc4af3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:22.708700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:22.734270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895971687379045:7118]
2025-09-30T14:55:22.734685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1849, pipe: [1:7555895971687379045:7118]
2025-09-30T14:55:22.820097Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:22.820442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:22.820455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:22.820477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895971687379045:7118], now have 1 active actors on pipe
2025-09-30T14:55:22.820746Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:22.823334Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:22.823344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895971687379045:7118]
2025-09-30T14:55:22.823377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:22.823455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1850 reason: status is not ok: tablet will be restarted right now sessionId: src_id|416b1ae6-3ea4cc69-a7aec1e7-6bdc4af3_0
2025-09-30T14:55:22.823958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|416b1ae6-3ea4cc69-a7aec1e7-6bdc4af3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:22.823969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|416b1ae6-3ea4cc69-a7aec1e7-6bdc4af3_0] Write session will restart in 0.009119s
2025-09-30T14:55:22.823994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|416b1ae6-3ea4cc69-a7aec1e7-6bdc4af3_0] Write session: Do CDS request
2025-09-30T14:55:22.823999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|416b1ae6-3ea4cc69-a7aec1e7-6bdc4af3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:22.823638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1850 sessionId: src_id|416b1ae6-3ea4cc69-a7aec1e7-6bdc4af3_0 is DEAD
2025-09-30T14:55:22.836419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|416b1ae6-3ea4cc69-a7aec1e7-6bdc4af3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:22.836520Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:22.836538Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1851
2025-09-30T14:55:22.836634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1851 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:22.836662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1851 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:22.836668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1851 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:22.836673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:22.837523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1851 sessionId:  describe result for acl check
2025-09-30T14:55:22.837564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:22.837569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:22.837571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:22.837579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895971687379112:6728] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:22.838164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895971687379112:6728] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:22.842366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895971687379112:6728] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:22.845359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:22.845799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895971687379112:6728] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:22.845817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895971687379112:6728] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:22.845820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895971687379112:6728] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:22.845828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1851 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:22.847817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:22.848067Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:22.848077Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:22.848088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:22.848146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:22.848196Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895971597610432:5262]
2025-09-30T14:55:22.848863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:22.849143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:22.849184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:22.849502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:22.849568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:22.849574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:22.849575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:22.849577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:22.849578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:22.849579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:22.849581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:22.849582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:22.849583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:22.849585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:22.849586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.849587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:22.849589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:22.849590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:22.849591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:22.849608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:22.849619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:22.849623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:22.849628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:22.849632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:22.849637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:22.849640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:22.849644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:22.849648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:22.849651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:22.849653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.849655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:22.849658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:22.849660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:22.849663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:22.849669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:22.849674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:22.849678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:22.849683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:22.849685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:22.849689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:22.849691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:22.849695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:22.849698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:22.849701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:22.849704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:22.849707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:22.849710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:22.849713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:22.849717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:22.849719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:22.849722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:22.849725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:22.849728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:22.849730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:22.849733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.849736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.849740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:22.849743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:22.849745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:22.849749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:22.849751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:22.849754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:22.849757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:22.849759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:22.849783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:22.855612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:22.856679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:22.856700Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:22.856703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:22.856707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:22.856715Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1850 [2:7555895971597610432:5262]
2025-09-30T14:55:22.856734Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:22.856750Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:22.856753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:22.856756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:22.856759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:22.856775Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:22.856787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:22.856799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:22.856860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.856867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:22.856870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:22.856874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:22.856876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:22.856945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:22.856953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.856965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:22.856981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:22.856998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:22.857017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895971687379056:2454], now have 1 active actors on pipe
2025-09-30T14:55:22.857027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895971687379240:6728], now have 1 active actors on pipe
2025-09-30T14:55:22.857033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895971597610426:5262]
2025-09-30T14:55:22.857036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895971597610426:5262]
2025-09-30T14:55:22.857040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895971597610426:5262]
2025-09-30T14:55:22.857052Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:22.857062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:22.857065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:22.857065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:22.857067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:22.857080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:22.857083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:22.857117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895971597610426:5262]
2025-09-30T14:55:22.857135Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:22.857155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:22.857146Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1850
2025-09-30T14:55:22.857172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1850
2025-09-30T14:55:22.857443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:22.857451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:22.857470Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c45ff69-b4cc515c-ff523dca-d3f6f67a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:22.857477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:22.857481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:22.857483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:22.857491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:22.857498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:22.857515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:22.857693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:22.857702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:22.857716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:22.857813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1851 partition: 0 MaxSeqNo: 42 sessionId: src_id|1c45ff69-b4cc515c-ff523dca-d3f6f67a_0
2025-09-30T14:55:22.858156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|416b1ae6-3ea4cc69-a7aec1e7-6bdc4af3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1c45ff69-b4cc515c-ff523dca-d3f6f67a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:22.861145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c45ff69-b4cc515c-ff523dca-d3f6f67a_0] Write session: try to update token
2025-09-30T14:55:22.861163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c45ff69-b4cc515c-ff523dca-d3f6f67a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:22.870711Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:22.870734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:22.870736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:22.870739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:22.870749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895971597610426:5262]
2025-09-30T14:55:22.870754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895971597610426:5262]
2025-09-30T14:55:22.870758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895971597610426:5262]
2025-09-30T14:55:22.870797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:22.870805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:22.870809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:22.870812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:22.870819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:22.870828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:22.870954Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:22.877029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1851 sessionId: src_id|1c45ff69-b4cc515c-ff523dca-d3f6f67a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:22.879813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:22.921694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895971687379251:7118]
2025-09-30T14:55:22.922021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1850, pipe: [1:7555895971687379251:7118]
2025-09-30T14:55:22.982968Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:22.983321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:22.983338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:22.983379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895971687379251:7118], now have 1 active actors on pipe
2025-09-30T14:55:22.983617Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:22.983752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895971687379251:7118]
2025-09-30T14:55:22.983795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:22.984301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c45ff69-b4cc515c-ff523dca-d3f6f67a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:22.984331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c45ff69-b4cc515c-ff523dca-d3f6f67a_0] Write session will restart in 0.005254s
2025-09-30T14:55:22.984366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c45ff69-b4cc515c-ff523dca-d3f6f67a_0] Write session: Do CDS request
2025-09-30T14:55:22.984375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c45ff69-b4cc515c-ff523dca-d3f6f67a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:22.983884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1851 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1c45ff69-b4cc515c-ff523dca-d3f6f67a_0
2025-09-30T14:55:22.984070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1851 sessionId: src_id|1c45ff69-b4cc515c-ff523dca-d3f6f67a_0 is DEAD
2025-09-30T14:55:22.984110Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:22.990968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c45ff69-b4cc515c-ff523dca-d3f6f67a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:22.990962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:22.990981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1852
2025-09-30T14:55:22.991287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1852 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:22.991337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1852 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:22.991348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1852 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:22.991353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:22.991861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1852 sessionId:  describe result for acl check
2025-09-30T14:55:22.991902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:22.991908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:22.991911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:22.991917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895971687379267:6716] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:22.992527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895971687379267:6716] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:22.995000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895971687379267:6716] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:23.003494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895971687379267:6716] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:23.003517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895971687379267:6716] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:23.003521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895971687379267:6716] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:23.003530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1852 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:23.004153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:23.007061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:23.007324Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:23.007335Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:23.007348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:23.007407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:23.007467Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895975892577915:5259]
2025-09-30T14:55:23.008173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:23.009437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:23.009509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:23.009892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:23.009966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:23.009983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:23.009984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:23.009986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:23.009987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:23.009989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:23.009990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:23.009991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:23.009993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:23.009994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:23.009995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.009997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.009998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.009999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:23.010001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:23.010007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:23.010020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:23.010025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:23.010029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:23.010032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:23.010037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:23.010040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:23.010044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:23.010049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:23.010053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:23.010058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.010063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.010068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.010072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:23.010076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:23.010088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:23.010097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:23.010104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:23.010112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:23.010118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:23.010123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:23.010129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:23.010135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:23.010141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:23.010147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:23.010153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:23.010159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:23.010165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:23.010171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:23.010176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:23.010182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:23.010193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:23.010199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:23.010204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:23.010216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:23.010221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.010226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.010230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.010241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.010246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.010252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.010261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:23.010267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:23.010277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:23.010282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:23.010334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:23.016604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:23.017489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:23.017507Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:23.017511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:23.017515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:23.017522Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1851 [2:7555895975892577915:5259]
2025-09-30T14:55:23.017540Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:23.017557Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:23.017561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:23.017564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:23.017567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:23.017584Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:23.017591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:23.017611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:23.017676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.017687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.017690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.017694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:23.017697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:23.017768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:23.017776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.017789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.017808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.017830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:23.017852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895975892577910:5259]
2025-09-30T14:55:23.017860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895975892577910:5259]
2025-09-30T14:55:23.017863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895975892577910:5259]
2025-09-30T14:55:23.017881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:23.017902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895975982346732:6716], now have 1 active actors on pipe
2025-09-30T14:55:23.017906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:23.017910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895971687379252:2454], now have 1 active actors on pipe
2025-09-30T14:55:23.017911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:23.017916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:23.017919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:23.017935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:23.017938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:23.017973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895975892577910:5259]
2025-09-30T14:55:23.017986Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:23.018005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:23.017973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1851
2025-09-30T14:55:23.017973Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1851
2025-09-30T14:55:23.018055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:23.018064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:23.018087Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d4da8f9-d979469e-41ab4ce4-b01db1a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:23.018101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:23.018105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:23.018110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:23.018120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:23.018137Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:23.018152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:23.018295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:23.018305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:23.018320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:23.018420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1852 partition: 0 MaxSeqNo: 42 sessionId: src_id|6d4da8f9-d979469e-41ab4ce4-b01db1a4_0
2025-09-30T14:55:23.018799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c45ff69-b4cc515c-ff523dca-d3f6f67a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6d4da8f9-d979469e-41ab4ce4-b01db1a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:23.021784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4da8f9-d979469e-41ab4ce4-b01db1a4_0] Write session: try to update token
2025-09-30T14:55:23.021803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4da8f9-d979469e-41ab4ce4-b01db1a4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:23.032155Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:23.032175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:23.032186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895975892577910:5259]
2025-09-30T14:55:23.032231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:23.032231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:23.032405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:23.032564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:23.032724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:23.032885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:23.033117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:23.033165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:23.039323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1852 sessionId: src_id|6d4da8f9-d979469e-41ab4ce4-b01db1a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:23.042080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:23.046341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:23.046364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:23.047543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:23.047572Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:23.047575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:23.047576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:23.047578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:23.047585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895975892577910:5259]
2025-09-30T14:55:23.047589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895975892577910:5259]
2025-09-30T14:55:23.047592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895975892577910:5259]
2025-09-30T14:55:23.047616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:23.047622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.047623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:23.047751Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:23.047766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:23.047772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:23.047776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:23.047842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:23.083973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895975982346747:7118]
2025-09-30T14:55:23.084312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1851, pipe: [1:7555895975982346747:7118]
2025-09-30T14:55:23.172918Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:23.182314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:23.182344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:23.182546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:23.182625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:23.182701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:23.182783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:23.182838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:23.182848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:23.182931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:23.183002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:23.183079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:23.183160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:23.183210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:23.183218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:23.183317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:23.183396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:23.183468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:23.183543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:23.183600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:23.183610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:23.183690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:23.183773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:23.183852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:23.183934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:23.183989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:23.184002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:23.184117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:23.184178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:23.184238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:23.184305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:23.184345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:23.184349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:23.184425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:23.184489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:23.184559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:23.184623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:23.184667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:23.184669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:23.184737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:23.184803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:23.185375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:23.185442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:23.185485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:23.185490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:23.185565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:23.185644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:23.185711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:23.185773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:23.186897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:23.185820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:23.185823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:23.186917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:23.185899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:23.185958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:23.186025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:23.186092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:23.186963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1852 reason: error at write: Disconnected sessionId: src_id|6d4da8f9-d979469e-41ab4ce4-b01db1a4_0
2025-09-30T14:55:23.186138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:23.187147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1852 sessionId: src_id|6d4da8f9-d979469e-41ab4ce4-b01db1a4_0 is DEAD
2025-09-30T14:55:23.186142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:23.187268Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:23.187335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895975982346747:7118]
2025-09-30T14:55:23.186218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:23.186278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:23.186349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:23.186413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:23.186539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:23.186542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:23.186622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895975982346747:7118], now have 1 active actors on pipe
2025-09-30T14:55:23.187476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4da8f9-d979469e-41ab4ce4-b01db1a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:23.187486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4da8f9-d979469e-41ab4ce4-b01db1a4_0] Write session will restart in 0.007405s
2025-09-30T14:55:23.187505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4da8f9-d979469e-41ab4ce4-b01db1a4_0] Write session: Do CDS request
2025-09-30T14:55:23.187509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4da8f9-d979469e-41ab4ce4-b01db1a4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:23.187621Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:23.199740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4da8f9-d979469e-41ab4ce4-b01db1a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:23.203652Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:23.203672Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1853
2025-09-30T14:55:23.204025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1853 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:23.204061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1853 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:23.204080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1853 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:23.204084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:23.204571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1853 sessionId:  describe result for acl check
2025-09-30T14:55:23.204615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:23.204617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:23.204619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:23.204639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895975982346906:6713] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:23.205215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895975982346906:6713] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:23.207461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:23.210140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895975982346906:6713] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:23.210477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:23.210678Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:23.210682Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:23.210693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:23.210739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:23.210776Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895975892578102:5242]
2025-09-30T14:55:23.211512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:23.211797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:23.211834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:23.212165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:23.212215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:23.212216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:23.212217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:23.212219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:23.212220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:23.212221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:23.212222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:23.212223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:23.212224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:23.212225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:23.212226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.212228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.212229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.212230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:23.212232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:23.212237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:23.212246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:23.212250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:23.212253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:23.212257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:23.212261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:23.212265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:23.212268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:23.212272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:23.212276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:23.212280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.212284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.212288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.212292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:23.212296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:23.212306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:23.212314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:23.212320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:23.212327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:23.212332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:23.212338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:23.212343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:23.212349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:23.212354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:23.212359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:23.212363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:23.212368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:23.212373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:23.212378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:23.212382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:23.212387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:23.212392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:23.212397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:23.212400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:23.212406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:23.212410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.212414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.212418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.212423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.212427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.212433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.212437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:23.212442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:23.212448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:23.212453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:23.212501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:23.213385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895975982346906:6713] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:23.213403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895975982346906:6713] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:23.213407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895975982346906:6713] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:23.213415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1853 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:23.220097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:23.220962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:23.220981Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:23.220985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:23.220990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:23.220997Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1852 [2:7555895975892578102:5242]
2025-09-30T14:55:23.221014Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:23.221034Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:23.221044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:23.221047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:23.221051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:23.221068Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:23.221076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:23.221084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:23.221152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.221162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.221165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.221168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:23.221171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:23.221240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:23.221249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.221263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.221282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.221307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:23.221325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895975892578096:5242]
2025-09-30T14:55:23.221333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895975892578096:5242]
2025-09-30T14:55:23.221336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895975892578096:5242]
2025-09-30T14:55:23.221351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:23.221370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:23.221388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:23.221391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:23.221392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:23.221397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:23.221400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:23.221428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895975892578096:5242]
2025-09-30T14:55:23.221437Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:23.221522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:23.221630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895975982346755:2454], now have 1 active actors on pipe
2025-09-30T14:55:23.221641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895975982346946:6713], now have 1 active actors on pipe
2025-09-30T14:55:23.221830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1852
2025-09-30T14:55:23.221831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1852
2025-09-30T14:55:23.221990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:23.222001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:23.222037Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26125368-d3893048-d1eae067-36888efe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:23.222051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:23.222056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:23.222059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:23.222085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:23.222099Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:23.222116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:23.222421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:23.222440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:23.222458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:23.222566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1853 partition: 0 MaxSeqNo: 42 sessionId: src_id|26125368-d3893048-d1eae067-36888efe_0
2025-09-30T14:55:23.223541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4da8f9-d979469e-41ab4ce4-b01db1a4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|26125368-d3893048-d1eae067-36888efe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:23.226671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26125368-d3893048-d1eae067-36888efe_0] Write session: try to update token
2025-09-30T14:55:23.226692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26125368-d3893048-d1eae067-36888efe_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:23.236403Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:23.236422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:23.236425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:23.236427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:23.236437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895975892578096:5242]
2025-09-30T14:55:23.236441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895975892578096:5242]
2025-09-30T14:55:23.236446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895975892578096:5242]
2025-09-30T14:55:23.236489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:23.236496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.236499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:23.236499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:23.236503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:23.236507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:23.236650Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:23.267715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1853 sessionId: src_id|26125368-d3893048-d1eae067-36888efe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:23.270593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:23.287200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895975982346954:7118]
2025-09-30T14:55:23.287559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1852, pipe: [1:7555895975982346954:7118]
2025-09-30T14:55:23.355935Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:23.356592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:23.356608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:23.356629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895975982346954:7118], now have 1 active actors on pipe
2025-09-30T14:55:23.356873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895975982346954:7118]
2025-09-30T14:55:23.356908Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:23.356881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:23.356923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:23.356926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:23.356992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1853 reason: error at write: Disconnected sessionId: src_id|26125368-d3893048-d1eae067-36888efe_0
2025-09-30T14:55:23.357177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1853 sessionId: src_id|26125368-d3893048-d1eae067-36888efe_0 is DEAD
2025-09-30T14:55:23.357525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26125368-d3893048-d1eae067-36888efe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:23.357536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26125368-d3893048-d1eae067-36888efe_0] Write session will restart in 0.007911s
2025-09-30T14:55:23.357564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26125368-d3893048-d1eae067-36888efe_0] Write session: Do CDS request
2025-09-30T14:55:23.357575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26125368-d3893048-d1eae067-36888efe_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:23.366868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26125368-d3893048-d1eae067-36888efe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:23.366973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:23.367005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1854
2025-09-30T14:55:23.367147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1854 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:23.367184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1854 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:23.367191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1854 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:23.367195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:23.367769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1854 sessionId:  describe result for acl check
2025-09-30T14:55:23.367820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:23.367827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:23.367829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:23.367835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895975982347039:6706] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:23.368449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895975982347039:6706] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:23.370948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895975982347039:6706] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:23.371813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:23.374330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:23.374580Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:23.374594Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:23.374607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:23.374669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:23.374715Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895975892578291:5254]
2025-09-30T14:55:23.374833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895975982347039:6706] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:23.374859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895975982347039:6706] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:23.374866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895975982347039:6706] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:23.374877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1854 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:23.375399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:23.375709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:23.375746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:23.375997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:23.376047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:23.376052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:23.376053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:23.376054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:23.376055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:23.376056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:23.376057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:23.376058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:23.376059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:23.376060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:23.376060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.376061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.376062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.376062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:23.376063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:23.376067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:23.376074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:23.376077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:23.376080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:23.376082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:23.376085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:23.376087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:23.376090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:23.376092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:23.376095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:23.376097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.376100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.376102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.376105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:23.376107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:23.376113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:23.376126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:23.376130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:23.376134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:23.376137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:23.376141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:23.376144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:23.376148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:23.376151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:23.376154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:23.376157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:23.376160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:23.376164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:23.376167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:23.376170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:23.376173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:23.376176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:23.376179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:23.376182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:23.376185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:23.376188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.376192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.376196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.376200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.376203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.376206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.376209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:23.376213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:23.376216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:23.376219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:23.376244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:23.382508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:23.383425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:23.383440Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:23.383444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:23.383448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:23.383456Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1853 [2:7555895975892578291:5254]
2025-09-30T14:55:23.383474Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:23.383493Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:23.383496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:23.383501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:23.383503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:23.383522Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:23.383534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:23.383546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:23.383619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.383625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.383628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.383632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:23.383635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:23.383711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:23.383719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.383732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.383744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.383760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:23.383778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895975982347142:6706], now have 1 active actors on pipe
2025-09-30T14:55:23.383782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895975982346956:2454], now have 1 active actors on pipe
2025-09-30T14:55:23.383789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895975892578286:5254]
2025-09-30T14:55:23.383797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895975892578286:5254]
2025-09-30T14:55:23.383800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895975892578286:5254]
2025-09-30T14:55:23.383814Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:23.383894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1853
2025-09-30T14:55:23.383937Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1853
2025-09-30T14:55:23.383831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:23.383839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:23.383844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:23.383852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:23.383855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:23.383859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:23.383894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895975892578286:5254]
2025-09-30T14:55:23.383904Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:23.383934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:23.383976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:23.383982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:23.384009Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb45a2f7-2de66ff2-b6aa8b25-2fcfe50_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:23.384017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:23.384021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:23.384023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:23.384033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:23.384045Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:23.384067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:23.384388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1854 partition: 0 MaxSeqNo: 42 sessionId: src_id|bb45a2f7-2de66ff2-b6aa8b25-2fcfe50_0
2025-09-30T14:55:23.384222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:23.384231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:23.384260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:23.387553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26125368-d3893048-d1eae067-36888efe_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bb45a2f7-2de66ff2-b6aa8b25-2fcfe50_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:23.390517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb45a2f7-2de66ff2-b6aa8b25-2fcfe50_0] Write session: try to update token
2025-09-30T14:55:23.390538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb45a2f7-2de66ff2-b6aa8b25-2fcfe50_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:23.398762Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:23.398779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:23.398790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895975892578286:5254]
2025-09-30T14:55:23.398834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:23.398837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:23.399012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:23.399166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:23.399339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:23.399484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:23.399698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:23.399740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:23.407295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1854 sessionId: src_id|bb45a2f7-2de66ff2-b6aa8b25-2fcfe50_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:23.410119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:23.410804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:23.410832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:23.410853Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:23.410857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:23.410860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:23.410862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:23.410871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895975892578286:5254]
2025-09-30T14:55:23.410875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895975892578286:5254]
2025-09-30T14:55:23.410879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895975892578286:5254]
2025-09-30T14:55:23.410923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:23.410929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:23.410932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:23.410935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.410938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:23.410940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:23.411080Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:23.457246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895975982347153:7118]
2025-09-30T14:55:23.457578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1853, pipe: [1:7555895975982347153:7118]
2025-09-30T14:55:23.524200Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:23.524937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:23.524982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895975982347153:7118], now have 1 active actors on pipe
2025-09-30T14:55:23.525282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895975982347153:7118]
2025-09-30T14:55:23.525323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:23.525405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:23.525414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:23.525505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1854 reason: error at write: Disconnected sessionId: src_id|bb45a2f7-2de66ff2-b6aa8b25-2fcfe50_0
2025-09-30T14:55:23.525592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:23.525674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1854 sessionId: src_id|bb45a2f7-2de66ff2-b6aa8b25-2fcfe50_0 is DEAD
2025-09-30T14:55:23.525885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb45a2f7-2de66ff2-b6aa8b25-2fcfe50_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:23.525902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb45a2f7-2de66ff2-b6aa8b25-2fcfe50_0] Write session will restart in 0.009810s
2025-09-30T14:55:23.525936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb45a2f7-2de66ff2-b6aa8b25-2fcfe50_0] Write session: Do CDS request
2025-09-30T14:55:23.525945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb45a2f7-2de66ff2-b6aa8b25-2fcfe50_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:23.536905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb45a2f7-2de66ff2-b6aa8b25-2fcfe50_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:23.538960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:23.538982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1855
2025-09-30T14:55:23.539176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1855 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:23.539210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1855 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:23.539215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1855 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:23.539219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:23.542740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1855 sessionId:  describe result for acl check
2025-09-30T14:55:23.542780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:23.542781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:23.542783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:23.542788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895975982347208:6695] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:23.543230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895975982347208:6695] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:23.547182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895975982347208:6695] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:23.553351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895975982347208:6695] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:23.553371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895975982347208:6695] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:23.553375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895975982347208:6695] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:23.553383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1855 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:23.560063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:23.562842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:23.563100Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:23.563110Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:23.563121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:23.563176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:23.563225Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895975892578484:5252]
2025-09-30T14:55:23.563980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:23.564304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:23.564354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:23.564720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:23.564792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:23.564793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:23.564795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:23.564796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:23.564798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:23.564799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:23.564801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:23.564802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:23.564804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:23.564805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:23.564806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.564808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.564809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.564810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:23.564811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:23.564817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:23.564829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:23.564834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:23.564839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:23.564844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:23.564849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:23.564853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:23.564858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:23.564863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:23.564868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:23.564873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.564877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.564882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.564886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:23.564891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:23.564899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:23.564908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:23.564915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:23.564921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:23.564927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:23.564934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:23.564940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:23.564949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:23.564955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:23.564961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:23.564966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:23.564972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:23.564978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:23.564984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:23.564989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:23.564995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:23.565000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:23.565006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:23.565011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:23.565017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:23.565023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.565029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.565034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.565039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.565045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.565050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.565056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:23.565062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:23.565067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:23.565073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:23.565123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:23.573199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:23.574340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:23.574361Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:23.574364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:23.574368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:23.574376Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1854 [2:7555895975892578484:5252]
2025-09-30T14:55:23.574395Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:23.574416Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:23.574420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:23.574423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:23.574425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:23.574444Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:23.574452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:23.574460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:23.574535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.574544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.574546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.574550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:23.574552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:23.574635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:23.574647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.574663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.574681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.574701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:23.574723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895975892578479:5252]
2025-09-30T14:55:23.574730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895975892578479:5252]
2025-09-30T14:55:23.574732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895975892578479:5252]
2025-09-30T14:55:23.574748Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:23.574767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:23.574788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:23.574793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:23.574840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895975892578479:5252]
2025-09-30T14:55:23.574847Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:23.574991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:23.575003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:23.575008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:23.575016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:23.575563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1854
2025-09-30T14:55:23.575601Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1854
2025-09-30T14:55:23.576314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1855 partition: 0 MaxSeqNo: 42 sessionId: src_id|f67286a4-fe9f469e-a96ff64c-fcb0894f_0
2025-09-30T14:55:23.576784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb45a2f7-2de66ff2-b6aa8b25-2fcfe50_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f67286a4-fe9f469e-a96ff64c-fcb0894f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:23.575908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895975982347293:6695], now have 1 active actors on pipe
2025-09-30T14:55:23.575919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895975982347155:2454], now have 1 active actors on pipe
2025-09-30T14:55:23.575942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:23.575949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:23.575979Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f67286a4-fe9f469e-a96ff64c-fcb0894f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:23.575988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:23.575993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:23.575996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:23.576011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:23.576025Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:23.576041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:23.576217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:23.576221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:23.576237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:23.581205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f67286a4-fe9f469e-a96ff64c-fcb0894f_0] Write session: try to update token
2025-09-30T14:55:23.581235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f67286a4-fe9f469e-a96ff64c-fcb0894f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:23.593015Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:23.593035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:23.593038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:23.593040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:23.593049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895975892578479:5252]
2025-09-30T14:55:23.593053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895975892578479:5252]
2025-09-30T14:55:23.593058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895975892578479:5252]
2025-09-30T14:55:23.593109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:23.593119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.593122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:23.593310Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:23.595446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:23.595464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:23.595470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:23.611300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1855 sessionId: src_id|f67286a4-fe9f469e-a96ff64c-fcb0894f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:23.614345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:23.623348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895975982347356:7118]
2025-09-30T14:55:23.623961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1854, pipe: [1:7555895975982347356:7118]
2025-09-30T14:55:23.716915Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:23.717429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:23.717446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:23.717466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895975982347356:7118], now have 1 active actors on pipe
2025-09-30T14:55:23.717724Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:23.718272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f67286a4-fe9f469e-a96ff64c-fcb0894f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:23.718290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f67286a4-fe9f469e-a96ff64c-fcb0894f_0] Write session will restart in 0.005108s
2025-09-30T14:55:23.718325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f67286a4-fe9f469e-a96ff64c-fcb0894f_0] Write session: Do CDS request
2025-09-30T14:55:23.718332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f67286a4-fe9f469e-a96ff64c-fcb0894f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:23.717762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:23.717762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:23.717791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:23.717824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895975982347356:7118]
2025-09-30T14:55:23.717866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1855 reason: error at write: Disconnected sessionId: src_id|f67286a4-fe9f469e-a96ff64c-fcb0894f_0
2025-09-30T14:55:23.718058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1855 sessionId: src_id|f67286a4-fe9f469e-a96ff64c-fcb0894f_0 is DEAD
2025-09-30T14:55:23.725096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f67286a4-fe9f469e-a96ff64c-fcb0894f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:23.725106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:23.725127Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1856
2025-09-30T14:55:23.725482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1856 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:23.725518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1856 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:23.725528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1856 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:23.725532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:23.725996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1856 sessionId:  describe result for acl check
2025-09-30T14:55:23.726027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:23.726034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:23.726036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:23.726041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895975982347385:6688] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:23.726582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895975982347385:6688] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:23.728192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895975982347385:6688] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:23.732177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895975982347385:6688] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:23.732196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895975982347385:6688] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:23.732200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895975982347385:6688] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:23.732208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1856 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:23.735159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:23.738321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:23.738721Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:23.738732Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:23.738744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:23.738810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:23.738856Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895975892578687:5249]
2025-09-30T14:55:23.739582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:23.739896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:23.739945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:23.740275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:23.740353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:23.740359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:23.740360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:23.740362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:23.740363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:23.740364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:23.740366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:23.740367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:23.740368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:23.740370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:23.740371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.740373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.740374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.740375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:23.740377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:23.740382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:23.740393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:23.740398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:23.740402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:23.740406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:23.740411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:23.740415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:23.740419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:23.740423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:23.740428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:23.740432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.740437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.740441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.740445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:23.740449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:23.740457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:23.740466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:23.740471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:23.740477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:23.740482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:23.740492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:23.740498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:23.740509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:23.740515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:23.740522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:23.740532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:23.740536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:23.740542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:23.740547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:23.740552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:23.740557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:23.740563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:23.740584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:23.740594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:23.740600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:23.740610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.740615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.740621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.740631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.740637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.740643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.740649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:23.740654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:23.740660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:23.740670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:23.740722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:23.747156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:23.748139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:23.748158Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:23.748162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:23.748166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:23.748176Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1855 [2:7555895975892578687:5249]
2025-09-30T14:55:23.748193Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:23.748216Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:23.748225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:23.748229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:23.748232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:23.748249Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:23.748263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:23.748275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:23.748349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.748358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.748360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.748363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:23.748367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:23.748557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1855
2025-09-30T14:55:23.748564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1855
2025-09-30T14:55:23.748707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:23.748716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.748731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.748747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.748771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:23.748797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895975982347546:6688], now have 1 active actors on pipe
2025-09-30T14:55:23.748806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895975982347359:2454], now have 1 active actors on pipe
2025-09-30T14:55:23.748821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:23.748826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:23.748847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895975892578682:5249]
2025-09-30T14:55:23.748854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895975892578682:5249]
2025-09-30T14:55:23.748857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895975892578682:5249]
2025-09-30T14:55:23.748870Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:23.748889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:23.748896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:23.748899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:23.748900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:23.748910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:23.748913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:23.748931Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57c8dc39-9c362125-143cf5fd-bb12f3b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:23.748942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:23.748946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:23.748948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:23.748958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:23.748974Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:23.749022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895975892578682:5249]
2025-09-30T14:55:23.749034Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:23.749041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:23.749048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:23.749228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:23.749236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:23.749249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:23.749347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1856 partition: 0 MaxSeqNo: 42 sessionId: src_id|57c8dc39-9c362125-143cf5fd-bb12f3b1_0
2025-09-30T14:55:23.749815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f67286a4-fe9f469e-a96ff64c-fcb0894f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|57c8dc39-9c362125-143cf5fd-bb12f3b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:23.753149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57c8dc39-9c362125-143cf5fd-bb12f3b1_0] Write session: try to update token
2025-09-30T14:55:23.753174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57c8dc39-9c362125-143cf5fd-bb12f3b1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:23.762946Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:23.762969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:23.762971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:23.762973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:23.762986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895975892578682:5249]
2025-09-30T14:55:23.762993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895975892578682:5249]
2025-09-30T14:55:23.762999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895975892578682:5249]
2025-09-30T14:55:23.763047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:23.763055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.763058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:23.763062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:23.763071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:23.763076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:23.763214Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:23.779593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1856 sessionId: src_id|57c8dc39-9c362125-143cf5fd-bb12f3b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:23.782478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:23.818175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895975982347583:7118]
2025-09-30T14:55:23.818498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1855, pipe: [1:7555895975982347583:7118]
2025-09-30T14:55:23.878338Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:23.878838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:23.878851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:23.878871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895975982347583:7118], now have 1 active actors on pipe
2025-09-30T14:55:23.879117Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:23.879607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57c8dc39-9c362125-143cf5fd-bb12f3b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:23.879616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57c8dc39-9c362125-143cf5fd-bb12f3b1_0] Write session will restart in 0.009338s
2025-09-30T14:55:23.879634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57c8dc39-9c362125-143cf5fd-bb12f3b1_0] Write session: Do CDS request
2025-09-30T14:55:23.879639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57c8dc39-9c362125-143cf5fd-bb12f3b1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:23.879119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:23.879127Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:23.879151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:23.879187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895975982347583:7118]
2025-09-30T14:55:23.879229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1856 reason: error at write: Disconnected sessionId: src_id|57c8dc39-9c362125-143cf5fd-bb12f3b1_0
2025-09-30T14:55:23.879423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1856 sessionId: src_id|57c8dc39-9c362125-143cf5fd-bb12f3b1_0 is DEAD
2025-09-30T14:55:23.892309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57c8dc39-9c362125-143cf5fd-bb12f3b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:23.892387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:23.892416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1857
2025-09-30T14:55:23.892539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1857 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:23.892572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1857 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:23.892583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1857 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:23.892587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:23.893079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1857 sessionId:  describe result for acl check
2025-09-30T14:55:23.893113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:23.893120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:23.893122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:23.893128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895975982347733:6678] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:23.893747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895975982347733:6678] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:23.895325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:23.895864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895975982347733:6678] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:23.897913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:23.898299Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:23.898319Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:23.898334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:23.898257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895975982347733:6678] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:23.898273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895975982347733:6678] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:23.898277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895975982347733:6678] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:23.898286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1857 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:23.898400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:23.898446Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895975892578915:5225]
2025-09-30T14:55:23.899102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:23.899451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:23.899497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:23.899833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:23.899902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:23.899909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:23.899910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:23.899912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:23.899913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:23.899914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:23.899916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:23.899917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:23.899919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:23.899920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:23.899921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.899922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.899924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.899925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:23.899926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:23.899932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:23.899943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:23.899947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:23.899950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:23.899954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:23.899957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:23.899960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:23.899964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:23.899968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:23.899971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:23.899975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.899978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.899982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.899986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:23.899989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:23.899999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:23.900006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:23.900013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:23.900019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:23.900024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:23.900030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:23.900035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:23.900041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:23.900046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:23.900051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:23.900056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:23.900061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:23.900066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:23.900072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:23.900079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:23.900084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:23.900089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:23.900095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:23.900099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:23.900105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:23.900110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.900116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.900120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.900125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.900128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.900134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.900138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:23.900143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:23.900149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:23.900155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:23.900200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:23.906098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:23.907239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:23.907284Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:23.907287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:23.907291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:23.907298Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1856 [2:7555895975892578915:5225]
2025-09-30T14:55:23.907317Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:23.907335Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:23.907339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:23.907343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:23.907345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:23.907362Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:23.907375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:23.907383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:23.907457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.907464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.907466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.907469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:23.907472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:23.907542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:23.907551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.907566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:23.907579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:23.907596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:23.907619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895975892578910:5225]
2025-09-30T14:55:23.907626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895975892578910:5225]
2025-09-30T14:55:23.907628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895975892578910:5225]
2025-09-30T14:55:23.907642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:23.907657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:23.907661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895975982347594:2454], now have 1 active actors on pipe
2025-09-30T14:55:23.907667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:23.907669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:23.907670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895975982347784:6678], now have 1 active actors on pipe
2025-09-30T14:55:23.907675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:23.907689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:23.907693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:23.907729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895975892578910:5225]
2025-09-30T14:55:23.907746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:23.907748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:23.907730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1856
2025-09-30T14:55:23.907791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1856
2025-09-30T14:55:23.907913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:23.907929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:23.907957Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|513fa92-fcd14729-6ce5703e-33cefba0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:23.907971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:23.907980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:23.907983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:23.907995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:23.908012Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:23.908033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:23.908196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:23.908205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:23.908219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:23.908323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1857 partition: 0 MaxSeqNo: 42 sessionId: src_id|513fa92-fcd14729-6ce5703e-33cefba0_0
2025-09-30T14:55:23.908782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57c8dc39-9c362125-143cf5fd-bb12f3b1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|513fa92-fcd14729-6ce5703e-33cefba0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:23.912130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|513fa92-fcd14729-6ce5703e-33cefba0_0] Write session: try to update token
2025-09-30T14:55:23.912151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|513fa92-fcd14729-6ce5703e-33cefba0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:23.924693Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:23.924716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:23.924719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:23.924722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:23.924733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895975892578910:5225]
2025-09-30T14:55:23.924738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895975892578910:5225]
2025-09-30T14:55:23.924743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895975892578910:5225]
2025-09-30T14:55:23.924786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:23.924799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:23.924803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:23.924809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:23.924821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:23.924825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:23.924961Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:23.928407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1857 sessionId: src_id|513fa92-fcd14729-6ce5703e-33cefba0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:23.931847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:23.979475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895975982347795:7118]
2025-09-30T14:55:23.979862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1856, pipe: [1:7555895975982347795:7118]
2025-09-30T14:55:24.052536Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:24.052997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:24.053018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:24.053066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895975982347795:7118], now have 1 active actors on pipe
2025-09-30T14:55:24.053326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:24.053337Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:24.053353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:24.053390Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:24.053398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895975982347795:7118]
2025-09-30T14:55:24.053411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1857 reason: error at write: Disconnected sessionId: src_id|513fa92-fcd14729-6ce5703e-33cefba0_0
2025-09-30T14:55:24.053853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|513fa92-fcd14729-6ce5703e-33cefba0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:24.053885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|513fa92-fcd14729-6ce5703e-33cefba0_0] Write session will restart in 0.005401s
2025-09-30T14:55:24.053607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1857 sessionId: src_id|513fa92-fcd14729-6ce5703e-33cefba0_0 is DEAD
2025-09-30T14:55:24.053928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|513fa92-fcd14729-6ce5703e-33cefba0_0] Write session: Do CDS request
2025-09-30T14:55:24.053937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|513fa92-fcd14729-6ce5703e-33cefba0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:24.060972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|513fa92-fcd14729-6ce5703e-33cefba0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:24.061083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:24.061116Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1858
2025-09-30T14:55:24.061292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1858 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:24.061344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1858 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:24.061355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1858 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:24.061359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:24.061820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1858 sessionId:  describe result for acl check
2025-09-30T14:55:24.061856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:24.061858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:24.061863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:24.061870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895980277315108:6672] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:24.062440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895980277315108:6672] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:24.066425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895980277315108:6672] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:24.069572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895980277315108:6672] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:24.069590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895980277315108:6672] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:24.069606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895980277315108:6672] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:24.069615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1858 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:24.071628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:24.074033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:24.074390Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:24.074401Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:24.074413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:24.074488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:24.074535Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895980187546404:5214]
2025-09-30T14:55:24.075223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:24.075520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:24.075565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:24.075903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:24.075974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:24.075980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:24.075981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:24.075983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:24.075984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:24.075986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:24.075988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:24.075989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:24.075990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:24.075992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:24.075993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.075995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.075996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.075997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:24.075999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:24.076005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:24.076015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:24.076019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:24.076024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:24.076028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:24.076032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:24.076036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:24.076040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:24.076044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:24.076047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:24.076052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.076055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.076058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.076064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:24.076067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:24.076075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:24.076083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:24.076090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:24.076095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:24.076100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:24.076106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:24.076110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:24.076115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:24.076120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:24.076125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:24.076130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:24.076136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:24.076140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:24.076146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:24.076156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:24.076161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:24.076165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:24.076175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:24.076179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:24.076188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:24.076194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.076204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.076210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.076219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.076224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.076233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.076238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:24.076243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:24.076250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:24.076260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:24.076304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:24.082406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:24.083737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:24.083754Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:24.083757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:24.083761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:24.083769Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1857 [2:7555895980187546404:5214]
2025-09-30T14:55:24.083786Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:24.083801Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:24.083804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:24.083807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:24.083810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:24.083827Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:24.083834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:24.083843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:24.083904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.083907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.083909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.083913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:24.083915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:24.083984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:24.083986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.084000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.084013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.084030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:24.084049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895980277315281:6672], now have 1 active actors on pipe
2025-09-30T14:55:24.084058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895980277315093:2454], now have 1 active actors on pipe
2025-09-30T14:55:24.084062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895980187546399:5214]
2025-09-30T14:55:24.084064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895980187546399:5214]
2025-09-30T14:55:24.084065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895980187546399:5214]
2025-09-30T14:55:24.084076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:24.084093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:24.084096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:24.084103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:24.084105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:24.084106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:24.084107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:24.084140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895980187546399:5214]
2025-09-30T14:55:24.084152Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:24.084158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:24.084177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1857
2025-09-30T14:55:24.084247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:24.084256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:24.084187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1857
2025-09-30T14:55:24.084285Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd1584d0-3fb9486-219a27ba-752ffd8c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:24.084297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:24.084304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:24.084310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:24.084321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:24.084334Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:24.084351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:24.084655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:24.084665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:24.084682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:24.084796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1858 partition: 0 MaxSeqNo: 42 sessionId: src_id|dd1584d0-3fb9486-219a27ba-752ffd8c_0
2025-09-30T14:55:24.085225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|513fa92-fcd14729-6ce5703e-33cefba0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dd1584d0-3fb9486-219a27ba-752ffd8c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:24.088774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1584d0-3fb9486-219a27ba-752ffd8c_0] Write session: try to update token
2025-09-30T14:55:24.088805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1584d0-3fb9486-219a27ba-752ffd8c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:24.097415Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:24.097443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:24.097446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:24.097449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:24.097459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895980187546399:5214]
2025-09-30T14:55:24.097464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895980187546399:5214]
2025-09-30T14:55:24.097470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895980187546399:5214]
2025-09-30T14:55:24.097526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:24.097535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.097546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:24.097750Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:24.099315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:24.099331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:24.099335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:24.108908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1858 sessionId: src_id|dd1584d0-3fb9486-219a27ba-752ffd8c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:24.111683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:24.153535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895980277315300:7118]
2025-09-30T14:55:24.153823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1857, pipe: [1:7555895980277315300:7118]
2025-09-30T14:55:24.210745Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:24.211074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:24.211087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:24.211104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895980277315300:7118], now have 1 active actors on pipe
2025-09-30T14:55:24.211376Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:24.211436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895980277315300:7118]
2025-09-30T14:55:24.211479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:24.211554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1858 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dd1584d0-3fb9486-219a27ba-752ffd8c_0
2025-09-30T14:55:24.211590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:24.211789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1858 sessionId: src_id|dd1584d0-3fb9486-219a27ba-752ffd8c_0 is DEAD
2025-09-30T14:55:24.211921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1584d0-3fb9486-219a27ba-752ffd8c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:24.211932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1584d0-3fb9486-219a27ba-752ffd8c_0] Write session will restart in 0.006621s
2025-09-30T14:55:24.211955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1584d0-3fb9486-219a27ba-752ffd8c_0] Write session: Do CDS request
2025-09-30T14:55:24.211961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1584d0-3fb9486-219a27ba-752ffd8c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:24.219827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1584d0-3fb9486-219a27ba-752ffd8c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:24.219858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:24.219876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1859
2025-09-30T14:55:24.220072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1859 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:24.220108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1859 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:24.220113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1859 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:24.220118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:24.220631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1859 sessionId:  describe result for acl check
2025-09-30T14:55:24.220682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:24.220690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:24.220692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:24.220699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895980277315338:6665] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:24.221365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895980277315338:6665] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:24.224176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895980277315338:6665] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:24.227028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895980277315338:6665] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:24.227048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895980277315338:6665] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:24.227051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895980277315338:6665] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:24.227061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1859 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:24.227998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:24.230512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:24.230748Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:24.230759Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:24.230770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:24.230823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:24.230873Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895980187546597:5223]
2025-09-30T14:55:24.231606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:24.231958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:24.232008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:24.232352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:24.232444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:24.232452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:24.232453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:24.232454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:24.232456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:24.232457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:24.232458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:24.232460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:24.232461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:24.232462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:24.232464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.232465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.232467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.232468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:24.232469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:24.232478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:24.232488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:24.232493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:24.232496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:24.232499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:24.232503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:24.232506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:24.232510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:24.232514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:24.232518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:24.232521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.232525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.232529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.232532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:24.232536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:24.232547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:24.232555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:24.232561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:24.232566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:24.232571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:24.232576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:24.232581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:24.232588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:24.232593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:24.232598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:24.232602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:24.232607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:24.232612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:24.232618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:24.232622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:24.232627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:24.232632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:24.232638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:24.232646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:24.232651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:24.232656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.232663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.232668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.232674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.232678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.232683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.232688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:24.232692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:24.232697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:24.232703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:24.232747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:24.238807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:24.240334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:24.240369Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:24.240372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:24.240376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:24.240384Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1858 [2:7555895980187546597:5223]
2025-09-30T14:55:24.240404Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:24.240422Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:24.240425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:24.240429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:24.240431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:24.240450Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:24.240458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:24.240465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:24.240534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.240545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.240548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.240552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:24.240555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:24.240629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:24.240639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.240655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.240669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.240690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:24.240721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895980277315305:2454], now have 1 active actors on pipe
2025-09-30T14:55:24.240731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895980277315494:6665], now have 1 active actors on pipe
2025-09-30T14:55:24.240737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895980187546592:5223]
2025-09-30T14:55:24.240739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895980187546592:5223]
2025-09-30T14:55:24.240742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895980187546592:5223]
2025-09-30T14:55:24.240756Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:24.240771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:24.240782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:24.240785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:24.240787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:24.240796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:24.240800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:24.240837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895980187546592:5223]
2025-09-30T14:55:24.240851Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:24.240857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:24.241217Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1858
2025-09-30T14:55:24.241261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1858
2025-09-30T14:55:24.241317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:24.241329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:24.241366Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8eb610ec-2d5cf15f-9932ad62-60c1c3fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:24.241380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:24.241385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:24.241387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:24.241398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:24.241409Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:24.241425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:24.241655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:24.241664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:24.241677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:24.241815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1859 partition: 0 MaxSeqNo: 42 sessionId: src_id|8eb610ec-2d5cf15f-9932ad62-60c1c3fe_0
2025-09-30T14:55:24.242159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1584d0-3fb9486-219a27ba-752ffd8c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8eb610ec-2d5cf15f-9932ad62-60c1c3fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:24.245397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8eb610ec-2d5cf15f-9932ad62-60c1c3fe_0] Write session: try to update token
2025-09-30T14:55:24.245417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8eb610ec-2d5cf15f-9932ad62-60c1c3fe_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:24.254660Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:24.254683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:24.254694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895980187546592:5223]
2025-09-30T14:55:24.254739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:24.254745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:24.254927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:24.255087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:24.255241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:24.255433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:24.255639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:24.255687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:24.266051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1859 sessionId: src_id|8eb610ec-2d5cf15f-9932ad62-60c1c3fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:24.266632Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:24.266650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:24.266652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:24.266654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:24.266662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895980187546592:5223]
2025-09-30T14:55:24.266666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895980187546592:5223]
2025-09-30T14:55:24.266670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895980187546592:5223]
2025-09-30T14:55:24.266704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:24.266710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.266712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:24.266732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:24.266739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:24.266753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:24.266840Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:24.268994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:24.311771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895980277315507:7118]
2025-09-30T14:55:24.312116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1858, pipe: [1:7555895980277315507:7118]
2025-09-30T14:55:24.383100Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:24.383473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:24.383493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:24.383514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895980277315507:7118], now have 1 active actors on pipe
2025-09-30T14:55:24.383797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895980277315507:7118]
2025-09-30T14:55:24.383816Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:24.383836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:24.383839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:24.383899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1859 reason: error at write: Disconnected sessionId: src_id|8eb610ec-2d5cf15f-9932ad62-60c1c3fe_0
2025-09-30T14:55:24.384082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1859 sessionId: src_id|8eb610ec-2d5cf15f-9932ad62-60c1c3fe_0 is DEAD
2025-09-30T14:55:24.384248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8eb610ec-2d5cf15f-9932ad62-60c1c3fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:24.384257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8eb610ec-2d5cf15f-9932ad62-60c1c3fe_0] Write session will restart in 0.009771s
2025-09-30T14:55:24.384284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8eb610ec-2d5cf15f-9932ad62-60c1c3fe_0] Write session: Do CDS request
2025-09-30T14:55:24.384290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8eb610ec-2d5cf15f-9932ad62-60c1c3fe_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:24.383793Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:24.399313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8eb610ec-2d5cf15f-9932ad62-60c1c3fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:24.399786Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:24.399812Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1860
2025-09-30T14:55:24.400069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1860 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:24.400114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1860 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:24.400129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1860 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:24.400135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:24.400151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:24.400675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1860 sessionId:  describe result for acl check
2025-09-30T14:55:24.400718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:24.400730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:24.400733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:24.400741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895980277315667:6660] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:24.401423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895980277315667:6660] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:24.403189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:24.403443Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:24.403456Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:24.403467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:24.403526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:24.403570Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895980187546792:5215]
2025-09-30T14:55:24.403938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895980277315667:6660] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:24.404130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:24.404461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:24.404534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:24.404877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:24.404970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:24.404977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:24.404978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:24.404979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:24.404980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:24.404982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:24.404983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:24.404984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:24.404986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:24.404987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:24.404988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.404989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.404990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.404991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:24.404992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:24.404999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:24.405008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:24.405012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:24.405016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:24.405021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:24.405025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:24.405029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:24.405034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:24.405038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:24.405042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:24.405047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.405051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.405055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.405059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:24.405063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:24.405073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:24.405082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:24.405089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:24.405094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:24.405099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:24.405105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:24.405109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:24.405114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:24.405119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:24.405125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:24.405130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:24.405136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:24.405141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:24.405147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:24.405158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:24.405164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:24.405174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:24.405180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:24.405189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:24.405196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:24.405206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.405212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.405221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.405228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.405238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.405243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.405246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:24.405251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:24.405259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:24.405265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:24.405309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:24.412603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895980277315667:6660] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:24.412629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895980277315667:6660] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:24.412634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895980277315667:6660] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:24.412644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1860 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:24.412922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:24.413913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:24.413931Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:24.413934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:24.413939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:24.413946Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1859 [2:7555895980187546792:5215]
2025-09-30T14:55:24.413963Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:24.413979Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:24.413983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:24.413986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:24.413989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:24.414005Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:24.414013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:24.414020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:24.414084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.414087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.414089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.414093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:24.414095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:24.414169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:24.414173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.414185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.414195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.414210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:24.414227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895980187546787:5215]
2025-09-30T14:55:24.414230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895980187546787:5215]
2025-09-30T14:55:24.414232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895980187546787:5215]
2025-09-30T14:55:24.414243Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:24.414254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:24.414257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:24.414258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:24.414261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:24.414271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:24.414274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:24.414285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895980277315706:6660], now have 1 active actors on pipe
2025-09-30T14:55:24.414347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1859
2025-09-30T14:55:24.414289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895980277315509:2454], now have 1 active actors on pipe
2025-09-30T14:55:24.414337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895980187546787:5215]
2025-09-30T14:55:24.414349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1859
2025-09-30T14:55:24.414346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:24.414366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:24.414515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:24.414527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:24.414556Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e650fe0-bea1a95e-83db3026-398aecd7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:24.414564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:24.414568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:24.414570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:24.414581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:24.414592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:24.414607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:24.414808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:24.414814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:24.414827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:24.414925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1860 partition: 0 MaxSeqNo: 42 sessionId: src_id|5e650fe0-bea1a95e-83db3026-398aecd7_0
2025-09-30T14:55:24.415461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8eb610ec-2d5cf15f-9932ad62-60c1c3fe_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5e650fe0-bea1a95e-83db3026-398aecd7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:24.418945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e650fe0-bea1a95e-83db3026-398aecd7_0] Write session: try to update token
2025-09-30T14:55:24.418971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e650fe0-bea1a95e-83db3026-398aecd7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:24.427411Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:24.427446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:24.427457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895980187546787:5215]
2025-09-30T14:55:24.427503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:24.427507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:24.427712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:24.427880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:24.428064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:24.428275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:24.428582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:24.428632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:24.439462Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:24.439480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:24.439483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:24.439485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:24.439497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895980187546787:5215]
2025-09-30T14:55:24.439503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895980187546787:5215]
2025-09-30T14:55:24.439507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895980187546787:5215]
2025-09-30T14:55:24.439550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:24.439553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:24.439558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.439559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:24.439561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:24.439562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:24.439716Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:24.448920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1860 sessionId: src_id|5e650fe0-bea1a95e-83db3026-398aecd7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:24.451784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:24.483810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895980277315713:7118]
2025-09-30T14:55:24.484252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1859, pipe: [1:7555895980277315713:7118]
2025-09-30T14:55:24.556781Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:24.557263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:24.557286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:24.557310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895980277315713:7118], now have 1 active actors on pipe
2025-09-30T14:55:24.557556Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:24.557548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:24.557603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895980277315713:7118]
2025-09-30T14:55:24.557626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:24.557634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:24.557692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1860 reason: error at write: Disconnected sessionId: src_id|5e650fe0-bea1a95e-83db3026-398aecd7_0
2025-09-30T14:55:24.557866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1860 sessionId: src_id|5e650fe0-bea1a95e-83db3026-398aecd7_0 is DEAD
2025-09-30T14:55:24.558128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e650fe0-bea1a95e-83db3026-398aecd7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:24.558145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e650fe0-bea1a95e-83db3026-398aecd7_0] Write session will restart in 0.007995s
2025-09-30T14:55:24.558178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e650fe0-bea1a95e-83db3026-398aecd7_0] Write session: Do CDS request
2025-09-30T14:55:24.558185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e650fe0-bea1a95e-83db3026-398aecd7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:24.568068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e650fe0-bea1a95e-83db3026-398aecd7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:24.568186Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:24.568205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1861
2025-09-30T14:55:24.568344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1861 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:24.568381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1861 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:24.568392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1861 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:24.568398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:24.568931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1861 sessionId:  describe result for acl check
2025-09-30T14:55:24.568970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:24.568972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:24.568974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:24.568979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895980277315807:6651] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:24.569616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895980277315807:6651] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:24.572850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:24.573108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895980277315807:6651] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:24.575789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:24.576044Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:24.576054Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:24.576065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:24.576106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895980277315807:6651] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:24.576123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895980277315807:6651] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:24.576121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:24.576127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895980277315807:6651] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:24.576136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1861 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:24.576172Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895980187546987:5219]
2025-09-30T14:55:24.576850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:24.577161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:24.577205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:24.577551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:24.577638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:24.577644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:24.577645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:24.577646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:24.577647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:24.577649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:24.577650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:24.577652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:24.577653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:24.577655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:24.577656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.577657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.577658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.577660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:24.577661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:24.577666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:24.577677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:24.577682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:24.577686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:24.577690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:24.577695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:24.577699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:24.577703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:24.577707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:24.577711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:24.577716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.577720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.577724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.577729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:24.577733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:24.577741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:24.577750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:24.577756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:24.577763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:24.577768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:24.577773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:24.577777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:24.577781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:24.577786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:24.577790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:24.577794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:24.577801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:24.577805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:24.577811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:24.577815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:24.577819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:24.577825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:24.577830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:24.577837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:24.577849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:24.577855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.577865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.577869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.577876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.577886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.577892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.577896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:24.577902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:24.577907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:24.577912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:24.577957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:24.583736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:24.585096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:24.585110Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:24.585113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:24.585117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:24.585125Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1860 [2:7555895980187546987:5219]
2025-09-30T14:55:24.585143Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:24.585160Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:24.585163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:24.585167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:24.585169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:24.585186Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:24.585195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:24.585209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:24.585274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.585282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.585284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.585287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:24.585290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:24.585362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:24.585370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.585384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.585400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.585420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:24.585441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895980277315909:6651], now have 1 active actors on pipe
2025-09-30T14:55:24.585453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895980277315715:2454], now have 1 active actors on pipe
2025-09-30T14:55:24.585459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895980187546982:5219]
2025-09-30T14:55:24.585461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895980187546982:5219]
2025-09-30T14:55:24.585463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895980187546982:5219]
2025-09-30T14:55:24.585478Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:24.585496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:24.585516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:24.585525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:24.585565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895980187546982:5219]
2025-09-30T14:55:24.585573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:24.585629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:24.585572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1860
2025-09-30T14:55:24.585637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:24.585639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:24.585645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:24.585765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:24.585752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1860
2025-09-30T14:55:24.585777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:24.585802Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4f1f5cf-70c31838-39c8fdc9-3969f165_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:24.585814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:24.585818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:24.585825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:24.585839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:24.585854Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:24.585877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:24.586504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:24.586517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:24.586540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:24.586638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1861 partition: 0 MaxSeqNo: 42 sessionId: src_id|c4f1f5cf-70c31838-39c8fdc9-3969f165_0
2025-09-30T14:55:24.587101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e650fe0-bea1a95e-83db3026-398aecd7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c4f1f5cf-70c31838-39c8fdc9-3969f165_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:24.590582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4f1f5cf-70c31838-39c8fdc9-3969f165_0] Write session: try to update token
2025-09-30T14:55:24.590610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4f1f5cf-70c31838-39c8fdc9-3969f165_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:24.600154Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:24.600177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:24.600190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895980187546982:5219]
2025-09-30T14:55:24.600241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:24.600249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:24.600437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:24.600588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:24.600754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:24.600983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:24.601336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:24.601424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:24.612299Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:24.612318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:24.612321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:24.612324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:24.612333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895980187546982:5219]
2025-09-30T14:55:24.612337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895980187546982:5219]
2025-09-30T14:55:24.612341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895980187546982:5219]
2025-09-30T14:55:24.612388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:24.612394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:24.612395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:24.612398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:24.612402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.612404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:24.612550Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:24.615368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1861 sessionId: src_id|c4f1f5cf-70c31838-39c8fdc9-3969f165_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:24.618216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:24.657338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895980277315922:7118]
2025-09-30T14:55:24.657655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1860, pipe: [1:7555895980277315922:7118]
2025-09-30T14:55:24.725788Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:24.726251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:24.726272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:24.726295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895980277315922:7118], now have 1 active actors on pipe
2025-09-30T14:55:24.726853Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:24.727162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4f1f5cf-70c31838-39c8fdc9-3969f165_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:24.727173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4f1f5cf-70c31838-39c8fdc9-3969f165_0] Write session will restart in 0.009797s
2025-09-30T14:55:24.727198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4f1f5cf-70c31838-39c8fdc9-3969f165_0] Write session: Do CDS request
2025-09-30T14:55:24.727204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4f1f5cf-70c31838-39c8fdc9-3969f165_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:24.726659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:24.726727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:24.726732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:24.726816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1861 reason: error at write: Disconnected sessionId: src_id|c4f1f5cf-70c31838-39c8fdc9-3969f165_0
2025-09-30T14:55:24.726860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895980277315922:7118]
2025-09-30T14:55:24.726988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1861 sessionId: src_id|c4f1f5cf-70c31838-39c8fdc9-3969f165_0 is DEAD
2025-09-30T14:55:24.737951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4f1f5cf-70c31838-39c8fdc9-3969f165_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:24.739440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:24.739460Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1862
2025-09-30T14:55:24.739822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1862 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:24.739870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1862 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:24.739875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1862 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:24.739882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:24.740448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1862 sessionId:  describe result for acl check
2025-09-30T14:55:24.740482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:24.740484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:24.740486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:24.740491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895980277315985:6647] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:24.741043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895980277315985:6647] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:24.747568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895980277315985:6647] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:24.750223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:24.753303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:24.753520Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:24.753531Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:24.753542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:24.753610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:24.753654Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895980187547195:5211]
2025-09-30T14:55:24.753424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895980277315985:6647] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:24.753445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895980277315985:6647] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:24.753449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895980277315985:6647] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:24.753458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1862 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:24.754361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:24.757713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:24.757790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:24.758214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:24.758291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:24.758298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:24.758300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:24.758301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:24.758303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:24.758304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:24.758306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:24.758308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:24.758309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:24.758310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:24.758312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.758313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.758315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.758316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:24.758318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:24.758325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:24.758337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:24.758342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:24.758347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:24.758352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:24.758357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:24.758362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:24.758367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:24.758371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:24.758376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:24.758380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.758385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.758389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.758393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:24.758398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:24.758407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:24.758416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:24.758424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:24.758431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:24.758436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:24.758443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:24.758448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:24.758455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:24.758461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:24.758468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:24.758477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:24.758483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:24.758489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:24.758495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:24.758500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:24.758507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:24.758512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:24.758519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:24.758527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:24.758533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:24.758539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.758545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.758551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.758557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.758563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.758569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.758574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:24.758579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:24.758585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:24.758591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:24.758638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:24.764671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:24.766049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:24.766067Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:24.766070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:24.766074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:24.766080Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1861 [2:7555895980187547195:5211]
2025-09-30T14:55:24.766098Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:24.766116Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:24.766119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:24.766122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:24.766125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:24.766143Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:24.766151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:24.766159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:24.766226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.766235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.766238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.766242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:24.766245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:24.766315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:24.766324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.766339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.766360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.766384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:24.766408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895980277316131:6647], now have 1 active actors on pipe
2025-09-30T14:55:24.766416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895980277315924:2454], now have 1 active actors on pipe
2025-09-30T14:55:24.766423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895980187547190:5211]
2025-09-30T14:55:24.766426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895980187547190:5211]
2025-09-30T14:55:24.766428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895980187547190:5211]
2025-09-30T14:55:24.766446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:24.766464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:24.766472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:24.766476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:24.766478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:24.766485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:24.766488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:24.766474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1861
2025-09-30T14:55:24.766477Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1861
2025-09-30T14:55:24.766523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895980187547190:5211]
2025-09-30T14:55:24.766534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:24.766541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:24.766556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:24.766566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:24.766615Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a1c653-88a11793-4ce22f11-55ef9326_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:24.766627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:24.766631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:24.766636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:24.766647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:24.766662Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:24.766694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:24.766961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:24.766973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:24.766989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:24.767108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1862 partition: 0 MaxSeqNo: 42 sessionId: src_id|7a1c653-88a11793-4ce22f11-55ef9326_0
2025-09-30T14:55:24.768265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4f1f5cf-70c31838-39c8fdc9-3969f165_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7a1c653-88a11793-4ce22f11-55ef9326_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:24.771405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1c653-88a11793-4ce22f11-55ef9326_0] Write session: try to update token
2025-09-30T14:55:24.771428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1c653-88a11793-4ce22f11-55ef9326_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:24.779566Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:24.779588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:24.779591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:24.779593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:24.779604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895980187547190:5211]
2025-09-30T14:55:24.779608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895980187547190:5211]
2025-09-30T14:55:24.779613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895980187547190:5211]
2025-09-30T14:55:24.779660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:24.779668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.779671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:24.779867Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:24.783316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:24.783336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:24.783342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:24.791805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1862 sessionId: src_id|7a1c653-88a11793-4ce22f11-55ef9326_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:24.794700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:24.826796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895980277316146:7118]
2025-09-30T14:55:24.827148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1861, pipe: [1:7555895980277316146:7118]
2025-09-30T14:55:24.897089Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:24.897643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:24.897658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:24.897679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895980277316146:7118], now have 1 active actors on pipe
2025-09-30T14:55:24.897859Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:24.897917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:24.897921Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:24.897934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:24.897974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895980277316146:7118]
2025-09-30T14:55:24.898001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1862 reason: error at write: Disconnected sessionId: src_id|7a1c653-88a11793-4ce22f11-55ef9326_0
2025-09-30T14:55:24.898179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1862 sessionId: src_id|7a1c653-88a11793-4ce22f11-55ef9326_0 is DEAD
2025-09-30T14:55:24.898366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1c653-88a11793-4ce22f11-55ef9326_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:24.898373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1c653-88a11793-4ce22f11-55ef9326_0] Write session will restart in 0.007707s
2025-09-30T14:55:24.898397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1c653-88a11793-4ce22f11-55ef9326_0] Write session: Do CDS request
2025-09-30T14:55:24.898404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1c653-88a11793-4ce22f11-55ef9326_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:24.907904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1c653-88a11793-4ce22f11-55ef9326_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:24.908045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:24.908063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1863
2025-09-30T14:55:24.908231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1863 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:24.908278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1863 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:24.908291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1863 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:24.908296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:24.908671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1863 sessionId:  describe result for acl check
2025-09-30T14:55:24.908699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:24.908709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:24.908711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:24.908717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895980277316217:6635] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:24.909271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895980277316217:6635] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:24.912558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895980277316217:6635] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:24.915903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895980277316217:6635] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:24.915922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895980277316217:6635] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:24.915926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895980277316217:6635] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:24.915935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1863 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:24.916142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:24.918757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:24.918986Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:24.918996Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:24.919007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:24.919066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:24.919109Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895980187547432:5172]
2025-09-30T14:55:24.919802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:24.920120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:24.920169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:24.920517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:24.920576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:24.920582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:24.920584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:24.920585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:24.920586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:24.920587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:24.920589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:24.920590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:24.920591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:24.920593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:24.920594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.920596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.920597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.920599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:24.920600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:24.920604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:24.920616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:24.920621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:24.920625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:24.920630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:24.920634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:24.920639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:24.920642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:24.920647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:24.920653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:24.920657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.920661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.920665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.920669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:24.920673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:24.920681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:24.920690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:24.920696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:24.920702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:24.920706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:24.920712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:24.920717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:24.920723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:24.920728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:24.920734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:24.920738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:24.920743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:24.920748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:24.920754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:24.920758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:24.920764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:24.920774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:24.920780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:24.920784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:24.920789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:24.920794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.920799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.920809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.920814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.920819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.920830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.920834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:24.920839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:24.920845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:24.920856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:24.920904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:24.926635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:24.927784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:24.927800Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:24.927804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:24.927811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:24.927819Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1862 [2:7555895980187547432:5172]
2025-09-30T14:55:24.927835Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:24.927856Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:24.927859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:24.927862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:24.927865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:24.927879Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:24.927890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:24.927897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:24.927961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.927968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.927970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.927973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:24.927976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:24.928046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:24.928064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.928081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:24.928098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:24.928120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:24.928143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895980277316169:2454], now have 1 active actors on pipe
2025-09-30T14:55:24.928151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895980277316359:6635], now have 1 active actors on pipe
2025-09-30T14:55:24.928157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895980187547426:5172]
2025-09-30T14:55:24.928159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895980187547426:5172]
2025-09-30T14:55:24.928161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895980187547426:5172]
2025-09-30T14:55:24.928176Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:24.928188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:24.928191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:24.928193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:24.928194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:24.928207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:24.928210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:24.928250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895980187547426:5172]
2025-09-30T14:55:24.928258Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:24.928260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:24.928232Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1862
2025-09-30T14:55:24.928292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1862
2025-09-30T14:55:24.928392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:24.928402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:24.928428Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5fd9e0c9-773e92b7-30eb2198-3c6314a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:24.928439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:24.928442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:24.928444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:24.928453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:24.928467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:24.928485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:24.928723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:24.928738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:24.928762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:24.928845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1863 partition: 0 MaxSeqNo: 42 sessionId: src_id|5fd9e0c9-773e92b7-30eb2198-3c6314a3_0
2025-09-30T14:55:24.929230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1c653-88a11793-4ce22f11-55ef9326_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5fd9e0c9-773e92b7-30eb2198-3c6314a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:24.932700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fd9e0c9-773e92b7-30eb2198-3c6314a3_0] Write session: try to update token
2025-09-30T14:55:24.932724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fd9e0c9-773e92b7-30eb2198-3c6314a3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:24.940802Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:24.940825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:24.940828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:24.940830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:24.940840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895980187547426:5172]
2025-09-30T14:55:24.940845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895980187547426:5172]
2025-09-30T14:55:24.940850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895980187547426:5172]
2025-09-30T14:55:24.940898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:24.940900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:24.940906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:24.940906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:24.940909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:24.940913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:24.941071Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:24.951604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1863 sessionId: src_id|5fd9e0c9-773e92b7-30eb2198-3c6314a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:24.954417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:24.999426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895980277316372:7118]
2025-09-30T14:55:25.000489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1862, pipe: [1:7555895980277316372:7118]
2025-09-30T14:55:25.057839Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:25.058334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:25.058352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:25.058373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895980277316372:7118], now have 1 active actors on pipe
2025-09-30T14:55:25.058587Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:25.058603Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:25.058645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:25.058654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895980277316372:7118]
2025-09-30T14:55:25.058655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:25.058738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1863 reason: error at write: Disconnected sessionId: src_id|5fd9e0c9-773e92b7-30eb2198-3c6314a3_0
2025-09-30T14:55:25.058919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1863 sessionId: src_id|5fd9e0c9-773e92b7-30eb2198-3c6314a3_0 is DEAD
2025-09-30T14:55:25.059152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fd9e0c9-773e92b7-30eb2198-3c6314a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:25.059169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fd9e0c9-773e92b7-30eb2198-3c6314a3_0] Write session will restart in 0.008001s
2025-09-30T14:55:25.059213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fd9e0c9-773e92b7-30eb2198-3c6314a3_0] Write session: Do CDS request
2025-09-30T14:55:25.059221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fd9e0c9-773e92b7-30eb2198-3c6314a3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:25.068923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fd9e0c9-773e92b7-30eb2198-3c6314a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:25.069109Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:25.069130Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1864
2025-09-30T14:55:25.069275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1864 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:25.069312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1864 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:25.069317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1864 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:25.069324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:25.069793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1864 sessionId:  describe result for acl check
2025-09-30T14:55:25.069833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:25.069842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:25.069844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:25.069850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895984572283717:6631] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:25.070418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895984572283717:6631] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:25.072991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895984572283717:6631] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:25.075670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:25.075684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895984572283717:6631] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:25.075700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895984572283717:6631] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:25.075703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895984572283717:6631] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:25.075720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1864 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:25.078069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:25.078267Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:25.078276Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:25.078288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:25.078342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:25.078381Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895984482514927:5169]
2025-09-30T14:55:25.078959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:25.079277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:25.079357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:25.079813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:25.079901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:25.079907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:25.079908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:25.079909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:25.079910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:25.079910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:25.079911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:25.079912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:25.079913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:25.079914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:25.079915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.079915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.079916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.079917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:25.079917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:25.079922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:25.079929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:25.079931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:25.079934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:25.079936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:25.079939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:25.079941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:25.079943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:25.079946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:25.079948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:25.079951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.079953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.079955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.079974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:25.079978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:25.079986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:25.079995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:25.080001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:25.080007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:25.080014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:25.080020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:25.080025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:25.080030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:25.080035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:25.080040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:25.080045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:25.080051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:25.080056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:25.080061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:25.080066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:25.080069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:25.080072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:25.080074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:25.080077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:25.080080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:25.080083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.080086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.080089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.080092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.080094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.080097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.080100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:25.080102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:25.080105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:25.080108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:25.080143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:25.085855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:25.087055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:25.087075Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:25.087078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:25.087082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:25.087089Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1863 [2:7555895984482514927:5169]
2025-09-30T14:55:25.087106Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:25.087122Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:25.087126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:25.087129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:25.087132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:25.087147Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:25.087154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:25.087160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:25.087220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.087229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.087231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.087235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:25.087238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:25.087336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:25.087347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.087360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.087376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.087394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:25.087412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895984572283866:6631], now have 1 active actors on pipe
2025-09-30T14:55:25.087422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895984572283671:2454], now have 1 active actors on pipe
2025-09-30T14:55:25.087429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895984482514921:5169]
2025-09-30T14:55:25.087431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895984482514921:5169]
2025-09-30T14:55:25.087434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895984482514921:5169]
2025-09-30T14:55:25.087446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:25.087465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:25.087466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:25.087469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:25.087471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:25.087486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:25.087490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:25.087525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895984482514921:5169]
2025-09-30T14:55:25.087540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:25.087557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:25.087526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1863
2025-09-30T14:55:25.087531Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1863
2025-09-30T14:55:25.087603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:25.087614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:25.087639Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6769842f-203afd74-cdee5a0-4bd930f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:25.087650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:25.087654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:25.087662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:25.087672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:25.087681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:25.087694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:25.087886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:25.087913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:25.087947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:25.088051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1864 partition: 0 MaxSeqNo: 42 sessionId: src_id|6769842f-203afd74-cdee5a0-4bd930f1_0
2025-09-30T14:55:25.088422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fd9e0c9-773e92b7-30eb2198-3c6314a3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6769842f-203afd74-cdee5a0-4bd930f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:25.091577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6769842f-203afd74-cdee5a0-4bd930f1_0] Write session: try to update token
2025-09-30T14:55:25.091600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6769842f-203afd74-cdee5a0-4bd930f1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:25.100386Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:25.100412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:25.100422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895984482514921:5169]
2025-09-30T14:55:25.100475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:25.100490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:25.100667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:25.100874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:25.101029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:25.101184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:25.101406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:25.101458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:25.111993Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:25.112013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:25.112015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:25.112017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:25.112029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895984482514921:5169]
2025-09-30T14:55:25.112035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895984482514921:5169]
2025-09-30T14:55:25.112039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895984482514921:5169]
2025-09-30T14:55:25.112081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:25.112086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:25.112088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.112091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:25.112093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:25.112097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:25.112255Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:25.114608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1864 sessionId: src_id|6769842f-203afd74-cdee5a0-4bd930f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:25.117478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:25.158584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895984572283883:7118]
2025-09-30T14:55:25.158863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1863, pipe: [1:7555895984572283883:7118]
2025-09-30T14:55:25.225478Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:25.225958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:25.225976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:25.225998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895984572283883:7118], now have 1 active actors on pipe
2025-09-30T14:55:25.226229Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:25.226290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895984572283883:7118]
2025-09-30T14:55:25.226289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:25.226295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:25.226333Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:25.226379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1864 reason: error at write: Disconnected sessionId: src_id|6769842f-203afd74-cdee5a0-4bd930f1_0
2025-09-30T14:55:25.226610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1864 sessionId: src_id|6769842f-203afd74-cdee5a0-4bd930f1_0 is DEAD
2025-09-30T14:55:25.229226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6769842f-203afd74-cdee5a0-4bd930f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:25.229243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6769842f-203afd74-cdee5a0-4bd930f1_0] Write session will restart in 0.007098s
2025-09-30T14:55:25.229272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6769842f-203afd74-cdee5a0-4bd930f1_0] Write session: Do CDS request
2025-09-30T14:55:25.229280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6769842f-203afd74-cdee5a0-4bd930f1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:25.239976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6769842f-203afd74-cdee5a0-4bd930f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:25.240220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:25.240240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1865
2025-09-30T14:55:25.240463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1865 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:25.240517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1865 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:25.240528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1865 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:25.240532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:25.240951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1865 sessionId:  describe result for acl check
2025-09-30T14:55:25.240988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:25.240996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:25.240998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:25.241004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895984572283905:6621] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:25.241552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895984572283905:6621] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:25.244220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895984572283905:6621] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:25.247225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895984572283905:6621] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:25.247269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895984572283905:6621] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:25.247274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895984572283905:6621] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:25.247303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1865 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:25.250685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:25.253242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:25.253442Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:25.253453Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:25.253464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:25.253515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:25.253557Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895984482515127:5158]
2025-09-30T14:55:25.254282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:25.255260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:25.255318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:25.255697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:25.255771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:25.255773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:25.255774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:25.255775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:25.255777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:25.255778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:25.255780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:25.255781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:25.255783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:25.255784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:25.255785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.255786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.255787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.255789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:25.255791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:25.255797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:25.255807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:25.255812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:25.255816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:25.255819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:25.255824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:25.255829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:25.255833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:25.255838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:25.255844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:25.255849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.255853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.255857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.255862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:25.255867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:25.255876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:25.255885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:25.255892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:25.255899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:25.255904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:25.255911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:25.255916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:25.255923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:25.255928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:25.255934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:25.255939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:25.255944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:25.255950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:25.255956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:25.255961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:25.255967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:25.255973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:25.255979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:25.255984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:25.255991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:25.255996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.256002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.256008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.256014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.256021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.256027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.256033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:25.256039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:25.256044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:25.256049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:25.256101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:25.261702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:25.262707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:25.262726Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:25.262730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:25.262734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:25.262741Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1864 [2:7555895984482515127:5158]
2025-09-30T14:55:25.262758Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:25.262775Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:25.262783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:25.262786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:25.262788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:25.262805Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:25.262813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:25.262825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:25.263203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.263213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.263215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.263219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:25.263222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:25.263361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:25.263371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.263388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.263402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.263423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:25.263448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895984572283888:2454], now have 1 active actors on pipe
2025-09-30T14:55:25.263457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895984572284050:6621], now have 1 active actors on pipe
2025-09-30T14:55:25.263464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895984482515122:5158]
2025-09-30T14:55:25.263476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895984482515122:5158]
2025-09-30T14:55:25.263479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895984482515122:5158]
2025-09-30T14:55:25.263495Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:25.263510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:25.263526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:25.263529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:25.263516Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1864
2025-09-30T14:55:25.263539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:25.263549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:25.263551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:25.263526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1864
2025-09-30T14:55:25.263565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895984482515122:5158]
2025-09-30T14:55:25.263568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:25.263584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:25.263625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:25.263635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:25.263663Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|acb2f2d3-bfb55960-283c995d-9a4b1d94_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:25.263675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:25.263684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:25.263686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:25.263697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:25.263711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:25.263732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:25.264512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:25.264531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:25.264560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:25.264661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1865 partition: 0 MaxSeqNo: 42 sessionId: src_id|acb2f2d3-bfb55960-283c995d-9a4b1d94_0
2025-09-30T14:55:25.265051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6769842f-203afd74-cdee5a0-4bd930f1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|acb2f2d3-bfb55960-283c995d-9a4b1d94_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:25.267934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acb2f2d3-bfb55960-283c995d-9a4b1d94_0] Write session: try to update token
2025-09-30T14:55:25.267952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acb2f2d3-bfb55960-283c995d-9a4b1d94_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:25.280688Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:25.280712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:25.280715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:25.280717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:25.280727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895984482515122:5158]
2025-09-30T14:55:25.280732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895984482515122:5158]
2025-09-30T14:55:25.280736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895984482515122:5158]
2025-09-30T14:55:25.280774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:25.280782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.280786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:25.280802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:25.280809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:25.280820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:25.280934Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:25.283859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1865 sessionId: src_id|acb2f2d3-bfb55960-283c995d-9a4b1d94_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:25.286833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:25.326557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895984572284097:7118]
2025-09-30T14:55:25.326898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1864, pipe: [1:7555895984572284097:7118]
2025-09-30T14:55:25.397423Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:25.397887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:25.397896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:25.397936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895984572284097:7118], now have 1 active actors on pipe
2025-09-30T14:55:25.398245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:25.398309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895984572284097:7118]
2025-09-30T14:55:25.398339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:25.398425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1865 reason: status is not ok: tablet will be restarted right now sessionId: src_id|acb2f2d3-bfb55960-283c995d-9a4b1d94_0
2025-09-30T14:55:25.398199Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:25.398616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1865 sessionId: src_id|acb2f2d3-bfb55960-283c995d-9a4b1d94_0 is DEAD
2025-09-30T14:55:25.398858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb2f2d3-bfb55960-283c995d-9a4b1d94_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:25.398878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb2f2d3-bfb55960-283c995d-9a4b1d94_0] Write session will restart in 0.009147s
2025-09-30T14:55:25.398911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb2f2d3-bfb55960-283c995d-9a4b1d94_0] Write session: Do CDS request
2025-09-30T14:55:25.398919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb2f2d3-bfb55960-283c995d-9a4b1d94_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:25.409958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acb2f2d3-bfb55960-283c995d-9a4b1d94_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:25.410076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:25.410096Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1866
2025-09-30T14:55:25.410336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1866 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:25.410372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1866 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:25.410378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1866 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:25.410383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:25.411711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1866 sessionId:  describe result for acl check
2025-09-30T14:55:25.411759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:25.411762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:25.411764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:25.411772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895984572284159:6613] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:25.412408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895984572284159:6613] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:25.415878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895984572284159:6613] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:25.424096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:25.424131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895984572284159:6613] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:25.424153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895984572284159:6613] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:25.424157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895984572284159:6613] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:25.424165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1866 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:25.430031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:25.430273Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:25.430289Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:25.430302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:25.430365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:25.430410Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895984482515330:5165]
2025-09-30T14:55:25.431050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:25.431449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:25.431514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:25.431882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:25.431953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:25.431959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:25.431960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:25.431961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:25.431963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:25.431964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:25.431966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:25.431967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:25.431968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:25.431970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:25.431971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.431973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.431975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.431976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:25.431977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:25.431984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:25.431995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:25.431999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:25.432004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:25.432009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:25.432013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:25.432017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:25.432022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:25.432027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:25.432032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:25.432037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.432041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.432045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.432055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:25.432059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:25.432071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:25.432084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:25.432090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:25.432096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:25.432108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:25.432118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:25.432125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:25.432131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:25.432141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:25.432148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:25.432157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:25.432163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:25.432181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:25.432188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:25.432196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:25.432202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:25.432212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:25.432220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:25.432228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:25.432235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:25.432243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.432249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.432253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.432259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.432265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.432272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.432280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:25.432287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:25.432307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:25.432317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:25.432364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:25.438122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:25.438957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:25.438975Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:25.438977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:25.438981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:25.438988Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1865 [2:7555895984482515330:5165]
2025-09-30T14:55:25.439005Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:25.439023Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:25.439025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:25.439029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:25.439032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:25.439049Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:25.439058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:25.439065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:25.439121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.439128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.439131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.439134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:25.439137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:25.439206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:25.439216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.439229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.439258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.439277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:25.439303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895984572284099:2454], now have 1 active actors on pipe
2025-09-30T14:55:25.439307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895984572284296:6613], now have 1 active actors on pipe
2025-09-30T14:55:25.439313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895984482515324:5165]
2025-09-30T14:55:25.439315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895984482515324:5165]
2025-09-30T14:55:25.439317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895984482515324:5165]
2025-09-30T14:55:25.439330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:25.439344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:25.439352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:25.439355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:25.439357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:25.439363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:25.439367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:25.439352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1865
2025-09-30T14:55:25.439403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895984482515324:5165]
2025-09-30T14:55:25.439415Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:25.439421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:25.439436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:25.439440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:25.439362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1865
2025-09-30T14:55:25.439509Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9099745-2892c212-237899a0-10695a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:25.439521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:25.439524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:25.439527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:25.439537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:25.439551Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:25.439569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:25.440042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:25.440054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:25.440068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:25.440194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1866 partition: 0 MaxSeqNo: 42 sessionId: src_id|d9099745-2892c212-237899a0-10695a_0
2025-09-30T14:55:25.440696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb2f2d3-bfb55960-283c995d-9a4b1d94_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d9099745-2892c212-237899a0-10695a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:25.444079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9099745-2892c212-237899a0-10695a_0] Write session: try to update token
2025-09-30T14:55:25.444106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9099745-2892c212-237899a0-10695a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:25.452418Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:25.452439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:25.452442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:25.452444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:25.452453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895984482515324:5165]
2025-09-30T14:55:25.452458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895984482515324:5165]
2025-09-30T14:55:25.452462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895984482515324:5165]
2025-09-30T14:55:25.452506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:25.452516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.452519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:25.452521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:25.452530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:25.452534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:25.452653Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:25.466911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1866 sessionId: src_id|d9099745-2892c212-237899a0-10695a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:25.469770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:25.498567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895984572284309:7118]
2025-09-30T14:55:25.498858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1865, pipe: [1:7555895984572284309:7118]
2025-09-30T14:55:25.566526Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:25.566887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:25.566896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:25.566917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895984572284309:7118], now have 1 active actors on pipe
2025-09-30T14:55:25.567201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:25.567213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895984572284309:7118]
2025-09-30T14:55:25.567221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:25.567239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:25.567295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1866 reason: error at write: Disconnected sessionId: src_id|d9099745-2892c212-237899a0-10695a_0
2025-09-30T14:55:25.567469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1866 sessionId: src_id|d9099745-2892c212-237899a0-10695a_0 is DEAD
2025-09-30T14:55:25.567180Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:25.567779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9099745-2892c212-237899a0-10695a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:25.567796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9099745-2892c212-237899a0-10695a_0] Write session will restart in 0.005178s
2025-09-30T14:55:25.567830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9099745-2892c212-237899a0-10695a_0] Write session: Do CDS request
2025-09-30T14:55:25.567841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9099745-2892c212-237899a0-10695a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:25.574986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9099745-2892c212-237899a0-10695a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:25.575180Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:25.575199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1867
2025-09-30T14:55:25.575514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1867 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:25.575573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1867 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:25.575578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1867 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:25.575583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:25.576143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1867 sessionId:  describe result for acl check
2025-09-30T14:55:25.576191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:25.576198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:25.576200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:25.576207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895984572284327:6607] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:25.576843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895984572284327:6607] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:25.581659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895984572284327:6607] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:25.586388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895984572284327:6607] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:25.586409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895984572284327:6607] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:25.586413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895984572284327:6607] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:25.586435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1867 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:25.587795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:25.591407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:25.591683Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:25.591695Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:25.591706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:25.591766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:25.591810Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895984482515532:5159]
2025-09-30T14:55:25.592519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:25.592879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:25.592947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:25.593313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:25.593381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:25.593387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:25.593389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:25.593390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:25.593392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:25.593394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:25.593395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:25.593396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:25.593398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:25.593400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:25.593401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.593403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.593404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.593406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:25.593407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:25.593413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:25.593423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:25.593427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:25.593432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:25.593437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:25.593441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:25.593445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:25.593450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:25.593454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:25.593459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:25.593463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.593467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.593470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.593473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:25.593477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:25.593490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:25.593498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:25.593504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:25.593511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:25.593516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:25.593523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:25.593527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:25.593532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:25.593538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:25.593544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:25.593549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:25.593554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:25.593561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:25.593567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:25.593579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:25.593601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:25.593611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:25.593617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:25.593621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:25.593628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:25.593632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.593637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.593648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.593654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.593660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.593666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.593671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:25.593677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:25.593686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:25.593697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:25.593780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:25.599880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:25.601230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:25.601249Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:25.601253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:25.601257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:25.601263Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1866 [2:7555895984482515532:5159]
2025-09-30T14:55:25.601282Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:25.601300Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:25.601305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:25.601308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:25.601311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:25.601328Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:25.601344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:25.601352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:25.601419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.601421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.601425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.601429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:25.601432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:25.601504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:25.601507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.601520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.601531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.601547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:25.601568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895984572284507:6607], now have 1 active actors on pipe
2025-09-30T14:55:25.601571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895984572284311:2454], now have 1 active actors on pipe
2025-09-30T14:55:25.601578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895984482515527:5159]
2025-09-30T14:55:25.601580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895984482515527:5159]
2025-09-30T14:55:25.601583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895984482515527:5159]
2025-09-30T14:55:25.601617Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:25.601632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:25.601640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:25.601645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:25.601647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:25.601648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:25.601651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:25.601692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895984482515527:5159]
2025-09-30T14:55:25.601702Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:25.601716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:25.603922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:25.603940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:25.603970Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eeff37da-770baa01-dfdabe46-c0d1105_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:25.603980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:25.603989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:25.603992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:25.604007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:25.604027Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:25.604050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:25.603722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1866
2025-09-30T14:55:25.603724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1866
2025-09-30T14:55:25.609128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:25.609154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:25.609193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:25.609447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1867 partition: 0 MaxSeqNo: 42 sessionId: src_id|eeff37da-770baa01-dfdabe46-c0d1105_0
2025-09-30T14:55:25.610001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9099745-2892c212-237899a0-10695a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|eeff37da-770baa01-dfdabe46-c0d1105_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:25.614352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eeff37da-770baa01-dfdabe46-c0d1105_0] Write session: try to update token
2025-09-30T14:55:25.614383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eeff37da-770baa01-dfdabe46-c0d1105_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:25.618911Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:25.618937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:25.618947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895984482515527:5159]
2025-09-30T14:55:25.618997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:25.619197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:25.619378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:25.619522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:25.619669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:25.619880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:25.619917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:25.620069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:25.632564Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:25.632594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:25.632597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:25.632599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:25.632609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895984482515527:5159]
2025-09-30T14:55:25.632614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895984482515527:5159]
2025-09-30T14:55:25.632619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895984482515527:5159]
2025-09-30T14:55:25.632671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:25.632674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:25.632681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:25.632682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.632685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:25.632686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:25.632901Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:25.644453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1867 sessionId: src_id|eeff37da-770baa01-dfdabe46-c0d1105_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:25.647584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:25.667524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895984572284527:7118]
2025-09-30T14:55:25.667802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1866, pipe: [1:7555895984572284527:7118]
2025-09-30T14:55:25.748332Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:25.748698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:25.748707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:25.748731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895984572284527:7118], now have 1 active actors on pipe
2025-09-30T14:55:25.749012Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:25.749720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895984572284527:7118]
2025-09-30T14:55:25.749762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:25.749848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1867 reason: status is not ok: tablet will be restarted right now sessionId: src_id|eeff37da-770baa01-dfdabe46-c0d1105_0
2025-09-30T14:55:25.750035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1867 sessionId: src_id|eeff37da-770baa01-dfdabe46-c0d1105_0 is DEAD
2025-09-30T14:55:25.750192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:25.750297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eeff37da-770baa01-dfdabe46-c0d1105_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:25.750322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eeff37da-770baa01-dfdabe46-c0d1105_0] Write session will restart in 0.008733s
2025-09-30T14:55:25.750357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eeff37da-770baa01-dfdabe46-c0d1105_0] Write session: Do CDS request
2025-09-30T14:55:25.750366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eeff37da-770baa01-dfdabe46-c0d1105_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:25.760969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eeff37da-770baa01-dfdabe46-c0d1105_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:25.763444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:25.763464Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1868
2025-09-30T14:55:25.763668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1868 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:25.763706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1868 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:25.763712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1868 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:25.763716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:25.764192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1868 sessionId:  describe result for acl check
2025-09-30T14:55:25.764230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:25.764233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:25.764234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:25.764240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895984572284577:6602] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:25.764812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895984572284577:6602] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:25.768038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895984572284577:6602] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:25.772249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895984572284577:6602] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:25.772269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895984572284577:6602] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:25.772285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895984572284577:6602] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:25.772295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1868 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:25.775837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:25.778216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:25.778411Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:25.778415Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:25.778426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:25.778497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:25.778534Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895984482515747:5160]
2025-09-30T14:55:25.779088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:25.779424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:25.779493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:25.779825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:25.779893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:25.779900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:25.779901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:25.779902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:25.779904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:25.779906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:25.779907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:25.779908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:25.779910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:25.779911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:25.779913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.779914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.779915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.779916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:25.779918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:25.779923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:25.779934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:25.779938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:25.779943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:25.779947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:25.779951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:25.779955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:25.779959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:25.779964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:25.779968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:25.779973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.779977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.779981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.779984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:25.779988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:25.779997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:25.780004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:25.780010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:25.780015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:25.780020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:25.780028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:25.780031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:25.780036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:25.780040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:25.780045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:25.780049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:25.780054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:25.780059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:25.780064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:25.780068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:25.780072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:25.780077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:25.780082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:25.780087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:25.780092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:25.780104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.780109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.780118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.780124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.780129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.780139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.780143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:25.780149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:25.780159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:25.780164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:25.780209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:25.786766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:25.788439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:25.788463Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:25.788466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:25.788472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:25.788480Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1867 [2:7555895984482515747:5160]
2025-09-30T14:55:25.788501Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:25.788519Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:25.788523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:25.788526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:25.788530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:25.788555Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:25.788565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:25.788575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:25.788653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.788666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.788669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.788673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:25.788676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:25.788763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:25.788772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.788789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.788802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.788821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:25.789229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1867
2025-09-30T14:55:25.789237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1867
2025-09-30T14:55:25.788841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895984482515742:5160]
2025-09-30T14:55:25.788849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895984482515742:5160]
2025-09-30T14:55:25.788852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895984482515742:5160]
2025-09-30T14:55:25.788873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:25.788890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:25.788909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:25.788913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:25.788957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895984482515742:5160]
2025-09-30T14:55:25.788960Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:25.788973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:25.788978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:25.788980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:25.788985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:25.789136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895984572284714:6602], now have 1 active actors on pipe
2025-09-30T14:55:25.789143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895984572284542:2454], now have 1 active actors on pipe
2025-09-30T14:55:25.789485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:25.789491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:25.789523Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8625fbb4-f8b2f18d-a9e0832b-7a1d8af3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:25.789530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:25.789534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:25.789535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:25.789545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:25.789554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:25.789568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:25.789772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:25.789782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:25.789798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:25.790357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eeff37da-770baa01-dfdabe46-c0d1105_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8625fbb4-f8b2f18d-a9e0832b-7a1d8af3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:25.793598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8625fbb4-f8b2f18d-a9e0832b-7a1d8af3_0] Write session: try to update token
2025-09-30T14:55:25.793622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8625fbb4-f8b2f18d-a9e0832b-7a1d8af3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:25.789885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1868 partition: 0 MaxSeqNo: 42 sessionId: src_id|8625fbb4-f8b2f18d-a9e0832b-7a1d8af3_0
2025-09-30T14:55:25.803685Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:25.803707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:25.803709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:25.803712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:25.803722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895984482515742:5160]
2025-09-30T14:55:25.803727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895984482515742:5160]
2025-09-30T14:55:25.803731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895984482515742:5160]
2025-09-30T14:55:25.803774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:25.803781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.803784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:25.803930Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:25.803987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:25.804007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:25.804012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:25.814942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1868 sessionId: src_id|8625fbb4-f8b2f18d-a9e0832b-7a1d8af3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:25.817854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:25.849775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895984572284755:7118]
2025-09-30T14:55:25.850085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1867, pipe: [1:7555895984572284755:7118]
2025-09-30T14:55:25.924211Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:25.924591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:25.924609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:25.924627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895984572284755:7118], now have 1 active actors on pipe
2025-09-30T14:55:25.924784Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:25.925084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:25.925095Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:25.925101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:25.925132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895984572284755:7118]
2025-09-30T14:55:25.925159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1868 reason: error at write: Disconnected sessionId: src_id|8625fbb4-f8b2f18d-a9e0832b-7a1d8af3_0
2025-09-30T14:55:25.925325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1868 sessionId: src_id|8625fbb4-f8b2f18d-a9e0832b-7a1d8af3_0 is DEAD
2025-09-30T14:55:25.925505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8625fbb4-f8b2f18d-a9e0832b-7a1d8af3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:25.925517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8625fbb4-f8b2f18d-a9e0832b-7a1d8af3_0] Write session will restart in 0.007444s
2025-09-30T14:55:25.925540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8625fbb4-f8b2f18d-a9e0832b-7a1d8af3_0] Write session: Do CDS request
2025-09-30T14:55:25.925549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8625fbb4-f8b2f18d-a9e0832b-7a1d8af3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:25.934062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8625fbb4-f8b2f18d-a9e0832b-7a1d8af3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:25.934151Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:25.934178Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1869
2025-09-30T14:55:25.934355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1869 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:25.934391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1869 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:25.934402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1869 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:25.934406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:25.934895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1869 sessionId:  describe result for acl check
2025-09-30T14:55:25.934932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:25.934940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:25.934942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:25.934949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895984572284811:6582] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:25.935536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895984572284811:6582] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:25.938081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895984572284811:6582] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:25.942171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895984572284811:6582] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:25.942187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895984572284811:6582] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:25.942190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895984572284811:6582] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:25.942196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1869 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:25.943751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:25.946198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:25.946549Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:25.946553Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:25.946566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:25.946631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:25.946667Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895984482515989:5133]
2025-09-30T14:55:25.947384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:25.947678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:25.947728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:25.948073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:25.948134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:25.948141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:25.948142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:25.948144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:25.948145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:25.948146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:25.948148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:25.948149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:25.948151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:25.948152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:25.948153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.948155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.948156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.948157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:25.948158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:25.948164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:25.948176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:25.948181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:25.948185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:25.948190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:25.948194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:25.948199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:25.948202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:25.948206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:25.948211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:25.948216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.948220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.948225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.948229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:25.948233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:25.948241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:25.948250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:25.948256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:25.948262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:25.948271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:25.948281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:25.948286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:25.948296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:25.948301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:25.948306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:25.948311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:25.948316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:25.948322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:25.948327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:25.948331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:25.948336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:25.948342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:25.948352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:25.948358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:25.948369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:25.948374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.948385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.948390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.948400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.948405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.948415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.948421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:25.948426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:25.948432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:25.948443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:25.948492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:25.956082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:25.957312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:25.957332Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:25.957334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:25.957339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:25.957349Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1868 [2:7555895984482515989:5133]
2025-09-30T14:55:25.957368Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:25.957386Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:25.957396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:25.957400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:25.957402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:25.957421Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:25.957428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:25.957436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:25.957509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.957519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.957522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.957526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:25.957528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:25.957621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:25.957629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.957645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:25.957658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:25.957687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:25.957712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895984572284781:2454], now have 1 active actors on pipe
2025-09-30T14:55:25.957721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895984572284976:6582], now have 1 active actors on pipe
2025-09-30T14:55:25.957728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895984482515984:5133]
2025-09-30T14:55:25.957731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895984482515984:5133]
2025-09-30T14:55:25.957734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895984482515984:5133]
2025-09-30T14:55:25.957750Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:25.957768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:25.957771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:25.957780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:25.957783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:25.957788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:25.957791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:25.957782Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1868
2025-09-30T14:55:25.957831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895984482515984:5133]
2025-09-30T14:55:25.957845Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:25.957785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1868
2025-09-30T14:55:25.957861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:25.958019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:25.958031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:25.958059Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81fa780b-251efab3-f65ee05b-577468da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:25.958073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:25.958077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:25.958080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:25.958091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:25.958111Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:25.958135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:25.958347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:25.958354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:25.958369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:25.958720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1869 partition: 0 MaxSeqNo: 42 sessionId: src_id|81fa780b-251efab3-f65ee05b-577468da_0
2025-09-30T14:55:25.959204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8625fbb4-f8b2f18d-a9e0832b-7a1d8af3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|81fa780b-251efab3-f65ee05b-577468da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:25.963023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81fa780b-251efab3-f65ee05b-577468da_0] Write session: try to update token
2025-09-30T14:55:25.963049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81fa780b-251efab3-f65ee05b-577468da_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:25.973146Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:25.973171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:25.973181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895984482515984:5133]
2025-09-30T14:55:25.973230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:25.973414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:25.973557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:25.973711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:25.973852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:25.974048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:25.974086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:25.974168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:25.984903Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:25.984924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:25.984927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:25.984930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:25.984941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895984482515984:5133]
2025-09-30T14:55:25.984946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895984482515984:5133]
2025-09-30T14:55:25.984951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895984482515984:5133]
2025-09-30T14:55:25.984994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:25.985005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:25.985005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:25.985008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:25.985012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:25.985020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:25.985200Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:25.990679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1869 sessionId: src_id|81fa780b-251efab3-f65ee05b-577468da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:25.993483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:26.025416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895988867252287:7118]
2025-09-30T14:55:26.025746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1868, pipe: [1:7555895988867252287:7118]
2025-09-30T14:55:26.099896Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:26.100329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:26.100345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:26.100365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895988867252287:7118], now have 1 active actors on pipe
2025-09-30T14:55:26.100599Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:26.100635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:26.100644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895988867252287:7118]
2025-09-30T14:55:26.100671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:26.100749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1869 reason: status is not ok: tablet will be restarted right now sessionId: src_id|81fa780b-251efab3-f65ee05b-577468da_0
2025-09-30T14:55:26.100952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1869 sessionId: src_id|81fa780b-251efab3-f65ee05b-577468da_0 is DEAD
2025-09-30T14:55:26.101127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81fa780b-251efab3-f65ee05b-577468da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:26.101139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81fa780b-251efab3-f65ee05b-577468da_0] Write session will restart in 0.006526s
2025-09-30T14:55:26.101163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81fa780b-251efab3-f65ee05b-577468da_0] Write session: Do CDS request
2025-09-30T14:55:26.101169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81fa780b-251efab3-f65ee05b-577468da_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:26.108931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81fa780b-251efab3-f65ee05b-577468da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:26.109111Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:26.109139Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1870
2025-09-30T14:55:26.109303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1870 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:26.109347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1870 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:26.109363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1870 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:26.109369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:26.109980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1870 sessionId:  describe result for acl check
2025-09-30T14:55:26.110031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:26.110040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:26.110042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:26.110050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895988867252315:6576] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:26.110769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895988867252315:6576] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:26.114688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895988867252315:6576] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:26.117908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895988867252315:6576] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:26.117931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895988867252315:6576] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:26.117935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895988867252315:6576] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:26.117944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1870 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:26.118796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:26.121475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:26.121811Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:26.121823Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:26.121836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:26.121902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:26.121950Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895988777483490:5131]
2025-09-30T14:55:26.122644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:26.122930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:26.122972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:26.123443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:26.123515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:26.123520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:26.123521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:26.123522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:26.123523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:26.123523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:26.123524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:26.123525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:26.123525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:26.123526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:26.123527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.123528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.123529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.123530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:26.123531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:26.123535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:26.123543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:26.123545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:26.123548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:26.123551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:26.123553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:26.123555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:26.123558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:26.123560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:26.123563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:26.123566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.123569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.123571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.123574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:26.123576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:26.123582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:26.123587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:26.123592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:26.123596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:26.123599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:26.123602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:26.123605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:26.123608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:26.123611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:26.123615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:26.123617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:26.123620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:26.123623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:26.123626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:26.123628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:26.123632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:26.123635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:26.123638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:26.123641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:26.123644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:26.123647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.123650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.123653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.123656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.123659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.123662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.123666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:26.123672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:26.123678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:26.123683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:26.123716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:26.129315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:26.130262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:26.130279Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:26.130282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:26.130287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:26.130294Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1869 [2:7555895988777483490:5131]
2025-09-30T14:55:26.130310Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:26.130327Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:26.130335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:26.130339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:26.130342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:26.130359Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:26.130370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:26.130377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:26.130448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.130455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.130457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.130461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:26.130464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:26.130534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:26.130543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.130556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.130572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.130590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:26.130617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895988867252490:6576], now have 1 active actors on pipe
2025-09-30T14:55:26.130622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895988867252291:2454], now have 1 active actors on pipe
2025-09-30T14:55:26.130629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895988777483485:5131]
2025-09-30T14:55:26.130632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895988777483485:5131]
2025-09-30T14:55:26.130634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895988777483485:5131]
2025-09-30T14:55:26.130643Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:26.130654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:26.130657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:26.130659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:26.130660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:26.130672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:26.130676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:26.130712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895988777483485:5131]
2025-09-30T14:55:26.130714Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:26.130723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:26.130701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1869
2025-09-30T14:55:26.130706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1869
2025-09-30T14:55:26.130774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:26.130788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:26.130816Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3287e99-59ede794-293a6f42-fc8de628_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:26.130830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:26.130838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:26.130841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:26.130853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:26.130867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:26.130883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:26.131011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:26.131020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:26.131034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:26.131106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1870 partition: 0 MaxSeqNo: 42 sessionId: src_id|b3287e99-59ede794-293a6f42-fc8de628_0
2025-09-30T14:55:26.131483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81fa780b-251efab3-f65ee05b-577468da_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b3287e99-59ede794-293a6f42-fc8de628_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:26.134782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3287e99-59ede794-293a6f42-fc8de628_0] Write session: try to update token
2025-09-30T14:55:26.134804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3287e99-59ede794-293a6f42-fc8de628_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:26.143561Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:26.143577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:26.143580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:26.143581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:26.143594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895988777483485:5131]
2025-09-30T14:55:26.143602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895988777483485:5131]
2025-09-30T14:55:26.143608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895988777483485:5131]
2025-09-30T14:55:26.143669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:26.143669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:26.143676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:26.143683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:26.143689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.143693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:26.143936Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:26.152630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1870 sessionId: src_id|b3287e99-59ede794-293a6f42-fc8de628_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:26.155561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:26.201818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895988867252510:7118]
2025-09-30T14:55:26.202143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1869, pipe: [1:7555895988867252510:7118]
2025-09-30T14:55:26.260560Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:26.260958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:26.260977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:26.260996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895988867252510:7118], now have 1 active actors on pipe
2025-09-30T14:55:26.261235Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:26.261266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895988867252510:7118]
2025-09-30T14:55:26.261292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:26.261296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:26.261300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:26.261377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1870 reason: error at write: Disconnected sessionId: src_id|b3287e99-59ede794-293a6f42-fc8de628_0
2025-09-30T14:55:26.261600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1870 sessionId: src_id|b3287e99-59ede794-293a6f42-fc8de628_0 is DEAD
2025-09-30T14:55:26.262997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3287e99-59ede794-293a6f42-fc8de628_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:26.263015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3287e99-59ede794-293a6f42-fc8de628_0] Write session will restart in 0.009007s
2025-09-30T14:55:26.263051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3287e99-59ede794-293a6f42-fc8de628_0] Write session: Do CDS request
2025-09-30T14:55:26.263063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3287e99-59ede794-293a6f42-fc8de628_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:26.273973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3287e99-59ede794-293a6f42-fc8de628_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:26.273949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:26.273968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1871
2025-09-30T14:55:26.274293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1871 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:26.274345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1871 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:26.274351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1871 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:26.274356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:26.274931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1871 sessionId:  describe result for acl check
2025-09-30T14:55:26.274969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:26.274976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:26.274978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:26.274984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895988867252630:6562] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:26.275573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895988867252630:6562] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:26.278029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895988867252630:6562] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:26.279103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:26.281706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:26.281957Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:26.281972Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:26.281985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:26.282058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:26.282103Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895988777483695:5126]
2025-09-30T14:55:26.282317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895988867252630:6562] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:26.282341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895988867252630:6562] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:26.282345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895988867252630:6562] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:26.282355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1871 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:26.282765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:26.283890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:26.283963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:26.284359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:26.284442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:26.284451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:26.284453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:26.284454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:26.284455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:26.284457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:26.284459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:26.284460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:26.284462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:26.284463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:26.284465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.284466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.284467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.284468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:26.284470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:26.284477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:26.284488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:26.284493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:26.284497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:26.284501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:26.284506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:26.284510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:26.284514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:26.284518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:26.284523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:26.284527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.284531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.284535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.284539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:26.284543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:26.284551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:26.284559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:26.284565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:26.284571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:26.284576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:26.284582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:26.284588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:26.284595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:26.284599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:26.284606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:26.284611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:26.284616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:26.284621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:26.284626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:26.284630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:26.284635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:26.284638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:26.284641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:26.284643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:26.284646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:26.284649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.284652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.284654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.284657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.284660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.284662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.284665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:26.284669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:26.284671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:26.284674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:26.284702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:26.291221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:26.292411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:26.292429Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:26.292435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:26.292439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:26.292447Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1870 [2:7555895988777483695:5126]
2025-09-30T14:55:26.292463Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:26.292480Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:26.292484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:26.292487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:26.292490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:26.292506Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:26.292514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:26.292521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:26.292581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.292592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.292594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.292597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:26.292600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:26.292678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:26.292685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.292699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.292713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.292733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:26.292754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895988777483690:5126]
2025-09-30T14:55:26.292761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895988777483690:5126]
2025-09-30T14:55:26.292763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895988777483690:5126]
2025-09-30T14:55:26.292779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:26.292799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:26.292819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:26.292826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:26.292827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:26.292830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:26.292832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:26.292864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895988777483690:5126]
2025-09-30T14:55:26.292871Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:26.292900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:26.293040Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1870
2025-09-30T14:55:26.293064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1870
2025-09-30T14:55:26.293122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895988867252514:2454], now have 1 active actors on pipe
2025-09-30T14:55:26.293129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895988867252716:6562], now have 1 active actors on pipe
2025-09-30T14:55:26.293139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:26.293144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:26.293167Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d797560a-d6a88a61-f40d1334-d9cb3157_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:26.293176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:26.293180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:26.293182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:26.293190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:26.293201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:26.293213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:26.293496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:26.293509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:26.293530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:26.293696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1871 partition: 0 MaxSeqNo: 42 sessionId: src_id|d797560a-d6a88a61-f40d1334-d9cb3157_0
2025-09-30T14:55:26.294061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3287e99-59ede794-293a6f42-fc8de628_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d797560a-d6a88a61-f40d1334-d9cb3157_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:26.297022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d797560a-d6a88a61-f40d1334-d9cb3157_0] Write session: try to update token
2025-09-30T14:55:26.297043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d797560a-d6a88a61-f40d1334-d9cb3157_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:26.306671Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:26.306695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:26.306698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:26.306700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:26.306710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895988777483690:5126]
2025-09-30T14:55:26.306714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895988777483690:5126]
2025-09-30T14:55:26.306718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895988777483690:5126]
2025-09-30T14:55:26.306757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:26.306763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.306763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:26.306765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:26.306770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:26.306774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:26.306904Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:26.315135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1871 sessionId: src_id|d797560a-d6a88a61-f40d1334-d9cb3157_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:26.318174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:26.363393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895988867252729:7118]
2025-09-30T14:55:26.363743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1870, pipe: [1:7555895988867252729:7118]
2025-09-30T14:55:26.443633Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:26.444022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:26.444051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:26.444107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895988867252729:7118], now have 1 active actors on pipe
2025-09-30T14:55:26.444394Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:26.444380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:26.444399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:26.444484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1871 reason: error at write: Disconnected sessionId: src_id|d797560a-d6a88a61-f40d1334-d9cb3157_0
2025-09-30T14:55:26.444652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1871 sessionId: src_id|d797560a-d6a88a61-f40d1334-d9cb3157_0 is DEAD
2025-09-30T14:55:26.444709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895988867252729:7118]
2025-09-30T14:55:26.444737Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:26.445036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d797560a-d6a88a61-f40d1334-d9cb3157_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:26.445044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d797560a-d6a88a61-f40d1334-d9cb3157_0] Write session will restart in 0.007873s
2025-09-30T14:55:26.445070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d797560a-d6a88a61-f40d1334-d9cb3157_0] Write session: Do CDS request
2025-09-30T14:55:26.445080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d797560a-d6a88a61-f40d1334-d9cb3157_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:26.455719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d797560a-d6a88a61-f40d1334-d9cb3157_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:26.455836Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:26.455855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1872
2025-09-30T14:55:26.456078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1872 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:26.456111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1872 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:26.456117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1872 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:26.456121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:26.456618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1872 sessionId:  describe result for acl check
2025-09-30T14:55:26.456646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:26.456648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:26.456650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:26.456656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895988867252755:6556] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:26.457232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895988867252755:6556] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:26.462033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895988867252755:6556] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:26.465962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:26.468685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:26.468928Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:26.468938Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:26.468950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:26.468942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895988867252755:6556] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:26.468962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895988867252755:6556] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:26.468966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895988867252755:6556] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:26.468975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1872 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:26.469007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:26.469047Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895988777483904:5120]
2025-09-30T14:55:26.469719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:26.470047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:26.470108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:26.470479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:26.470558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:26.470564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:26.470566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:26.470567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:26.470568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:26.470570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:26.470571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:26.470573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:26.470575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:26.470576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:26.470577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.470579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.470580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.470581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:26.470582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:26.470589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:26.470601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:26.470605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:26.470610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:26.470614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:26.470618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:26.470622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:26.470626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:26.470631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:26.470637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:26.470641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.470645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.470649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.470653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:26.470656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:26.470664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:26.470673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:26.470679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:26.470685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:26.470690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:26.470696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:26.470700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:26.470706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:26.470711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:26.470717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:26.470730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:26.470735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:26.470740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:26.470745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:26.470749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:26.470755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:26.470760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:26.470766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:26.470776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:26.470782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:26.470787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.470792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.470802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.470807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.470813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.470823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.470827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:26.470832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:26.470839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:26.470844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:26.470893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:26.479810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:26.481180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:26.481201Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:26.481205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:26.481209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:26.481216Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1871 [2:7555895988777483904:5120]
2025-09-30T14:55:26.481235Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:26.481252Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:26.481256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:26.481259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:26.481261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:26.481279Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:26.481286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:26.481293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:26.481360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.481367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.481370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.481373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:26.481376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:26.481447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:26.481456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.481470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.481485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.481507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:26.481524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895988777483899:5120]
2025-09-30T14:55:26.481532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895988777483899:5120]
2025-09-30T14:55:26.481536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895988777483899:5120]
2025-09-30T14:55:26.481545Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:26.481561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:26.481578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:26.481592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:26.481596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:26.481601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:26.481604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:26.481609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895988867252731:2454], now have 1 active actors on pipe
2025-09-30T14:55:26.481613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895988867252934:6556], now have 1 active actors on pipe
2025-09-30T14:55:26.481653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895988777483899:5120]
2025-09-30T14:55:26.481666Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:26.481706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:26.481988Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1871
2025-09-30T14:55:26.482037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1871
2025-09-30T14:55:26.482292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:26.482308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:26.482340Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e015d97-4ebd5e50-3c2af33f-98540e86_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:26.482356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:26.482360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:26.482363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:26.482376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:26.482389Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:26.482420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:26.482777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1872 partition: 0 MaxSeqNo: 42 sessionId: src_id|4e015d97-4ebd5e50-3c2af33f-98540e86_0
2025-09-30T14:55:26.482616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:26.482626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:26.482643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:26.483182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d797560a-d6a88a61-f40d1334-d9cb3157_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4e015d97-4ebd5e50-3c2af33f-98540e86_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:26.486071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e015d97-4ebd5e50-3c2af33f-98540e86_0] Write session: try to update token
2025-09-30T14:55:26.486095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e015d97-4ebd5e50-3c2af33f-98540e86_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:26.494760Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:26.494782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:26.494784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:26.494786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:26.494796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895988777483899:5120]
2025-09-30T14:55:26.494801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895988777483899:5120]
2025-09-30T14:55:26.494805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895988777483899:5120]
2025-09-30T14:55:26.494849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:26.494857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.494858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:26.494860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:26.494869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:26.494873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:26.495004Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:26.502751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1872 sessionId: src_id|4e015d97-4ebd5e50-3c2af33f-98540e86_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:26.505511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:26.545328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895988867252951:7118]
2025-09-30T14:55:26.545674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1871, pipe: [1:7555895988867252951:7118]
2025-09-30T14:55:26.610020Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:26.610648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:26.610674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:26.610722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895988867252951:7118], now have 1 active actors on pipe
2025-09-30T14:55:26.610951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:26.610971Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:26.610974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:26.610974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895988867252951:7118]
2025-09-30T14:55:26.611003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:26.611053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1872 reason: error at write: Disconnected sessionId: src_id|4e015d97-4ebd5e50-3c2af33f-98540e86_0
2025-09-30T14:55:26.611278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1872 sessionId: src_id|4e015d97-4ebd5e50-3c2af33f-98540e86_0 is DEAD
2025-09-30T14:55:26.611456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e015d97-4ebd5e50-3c2af33f-98540e86_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:26.611467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e015d97-4ebd5e50-3c2af33f-98540e86_0] Write session will restart in 0.005538s
2025-09-30T14:55:26.611492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e015d97-4ebd5e50-3c2af33f-98540e86_0] Write session: Do CDS request
2025-09-30T14:55:26.611498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e015d97-4ebd5e50-3c2af33f-98540e86_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:26.617795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e015d97-4ebd5e50-3c2af33f-98540e86_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:26.617883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:26.617906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1873
2025-09-30T14:55:26.618066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1873 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:26.618100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1873 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:26.618109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1873 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:26.618114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:26.618567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1873 sessionId:  describe result for acl check
2025-09-30T14:55:26.618599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:26.618603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:26.618605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:26.618610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895988867252968:6557] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:26.619187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895988867252968:6557] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:26.622020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895988867252968:6557] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:26.625241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895988867252968:6557] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:26.625261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895988867252968:6557] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:26.625264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895988867252968:6557] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:26.625273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1873 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:26.628504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:26.631069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:26.631324Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:26.631335Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:26.631349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:26.631411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:26.631461Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895988777484129:5115]
2025-09-30T14:55:26.632137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:26.632504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:26.632554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:26.632908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:26.632982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:26.632988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:26.632989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:26.632991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:26.632992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:26.632994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:26.632996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:26.632998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:26.632999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:26.633000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:26.633001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.633003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.633004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.633005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:26.633007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:26.633013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:26.633024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:26.633029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:26.633034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:26.633038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:26.633042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:26.633046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:26.633049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:26.633054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:26.633060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:26.633065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.633069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.633073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.633078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:26.633082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:26.633092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:26.633101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:26.633108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:26.633128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:26.633137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:26.633143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:26.633151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:26.633158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:26.633164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:26.633170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:26.633179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:26.633188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:26.633200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:26.633208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:26.633217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:26.633223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:26.633227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:26.633234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:26.633237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:26.633244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:26.633249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.633255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.633264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.633271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.633279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.633285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.633291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:26.633298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:26.633308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:26.633317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:26.633364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:26.639393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:26.640485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:26.640502Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:26.640505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:26.640509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:26.640517Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1872 [2:7555895988777484129:5115]
2025-09-30T14:55:26.640537Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:26.640553Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:26.640556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:26.640558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:26.640560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:26.640575Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:26.640582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:26.640588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:26.640638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.640650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.640652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.640655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:26.640657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:26.640714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:26.640720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.640730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.640741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.640750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:26.640773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895988777484112:5115]
2025-09-30T14:55:26.640782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895988777484112:5115]
2025-09-30T14:55:26.640784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895988777484112:5115]
2025-09-30T14:55:26.640794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:26.640802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:26.640805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:26.640808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:26.640809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:26.640824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:26.640828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:26.640839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895988867253114:6557], now have 1 active actors on pipe
2025-09-30T14:55:26.640843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895988867252953:2454], now have 1 active actors on pipe
2025-09-30T14:55:26.640873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895988777484112:5115]
2025-09-30T14:55:26.640884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:26.640909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:26.640905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1872
2025-09-30T14:55:26.640907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1872
2025-09-30T14:55:26.640994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:26.641002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:26.641029Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9dca7eec-d95f2276-f030ff8f-ebb66c5f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:26.641041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:26.641045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:26.641054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:26.641064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:26.641077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:26.641091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:26.641287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:26.641300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:26.641316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:26.641417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1873 partition: 0 MaxSeqNo: 42 sessionId: src_id|9dca7eec-d95f2276-f030ff8f-ebb66c5f_0
2025-09-30T14:55:26.641804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e015d97-4ebd5e50-3c2af33f-98540e86_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9dca7eec-d95f2276-f030ff8f-ebb66c5f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:26.644826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dca7eec-d95f2276-f030ff8f-ebb66c5f_0] Write session: try to update token
2025-09-30T14:55:26.644848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dca7eec-d95f2276-f030ff8f-ebb66c5f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:26.654296Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:26.654319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:26.654322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:26.654323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:26.654338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895988777484112:5115]
2025-09-30T14:55:26.654342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895988777484112:5115]
2025-09-30T14:55:26.654348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895988777484112:5115]
2025-09-30T14:55:26.654389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:26.654399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.654402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:26.654401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:26.654409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:26.654413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:26.654543Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:26.665609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1873 sessionId: src_id|9dca7eec-d95f2276-f030ff8f-ebb66c5f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:26.668457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:26.710989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895988867253172:7118]
2025-09-30T14:55:26.715977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1872, pipe: [1:7555895988867253172:7118]
2025-09-30T14:55:26.768935Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:26.769443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:26.769462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:26.769485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895988867253172:7118], now have 1 active actors on pipe
2025-09-30T14:55:26.769797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895988867253172:7118]
2025-09-30T14:55:26.769836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:26.769839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:26.769915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1873 reason: error at write: Disconnected sessionId: src_id|9dca7eec-d95f2276-f030ff8f-ebb66c5f_0
2025-09-30T14:55:26.770055Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:26.770102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1873 sessionId: src_id|9dca7eec-d95f2276-f030ff8f-ebb66c5f_0 is DEAD
2025-09-30T14:55:26.769791Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:26.771348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dca7eec-d95f2276-f030ff8f-ebb66c5f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:26.771363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dca7eec-d95f2276-f030ff8f-ebb66c5f_0] Write session will restart in 0.009849s
2025-09-30T14:55:26.771388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dca7eec-d95f2276-f030ff8f-ebb66c5f_0] Write session: Do CDS request
2025-09-30T14:55:26.771397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dca7eec-d95f2276-f030ff8f-ebb66c5f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:26.782856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dca7eec-d95f2276-f030ff8f-ebb66c5f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:26.782923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:26.782943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1874
2025-09-30T14:55:26.783077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1874 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:26.783106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1874 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:26.783112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1874 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:26.783115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:26.783604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1874 sessionId:  describe result for acl check
2025-09-30T14:55:26.783651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:26.783654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:26.783656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:26.783663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895988867253202:6538] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:26.784282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895988867253202:6538] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:26.788372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895988867253202:6538] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:26.797665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:26.795795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895988867253202:6538] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:26.795824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895988867253202:6538] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:26.795827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895988867253202:6538] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:26.795837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1874 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:26.800377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:26.800769Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:26.800781Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:26.800794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:26.800863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:26.800920Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895988777484338:5113]
2025-09-30T14:55:26.801671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:26.802039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:26.802091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:26.802453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:26.802526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:26.802533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:26.802534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:26.802536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:26.802537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:26.802538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:26.802539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:26.802541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:26.802542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:26.802544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:26.802545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.802546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.802547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.802549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:26.802550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:26.802555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:26.802567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:26.802571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:26.802576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:26.802580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:26.802584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:26.802588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:26.802592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:26.802596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:26.802603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:26.802607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.802611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.802615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.802619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:26.802623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:26.802631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:26.802639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:26.802648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:26.802654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:26.802659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:26.802665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:26.802669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:26.802675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:26.802680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:26.802685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:26.802689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:26.802695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:26.802699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:26.802705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:26.802710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:26.802716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:26.802721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:26.802726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:26.802731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:26.802736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:26.802741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.802746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.802750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.802755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.802760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.802765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.802769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:26.802775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:26.802781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:26.802795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:26.802844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:26.809046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:26.810350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:26.810370Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:26.810373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:26.810377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:26.810384Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1873 [2:7555895988777484338:5113]
2025-09-30T14:55:26.810400Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:26.810417Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:26.810419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:26.810422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:26.810424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:26.810442Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:26.810451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:26.810459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:26.810533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.810541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.810544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.810548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:26.810551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:26.810626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:26.810634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.810650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.810663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.810687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:26.810709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895988777484333:5113]
2025-09-30T14:55:26.810716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895988777484333:5113]
2025-09-30T14:55:26.810718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895988777484333:5113]
2025-09-30T14:55:26.810731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:26.810744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:26.810762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:26.810770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:26.810807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895988777484333:5113]
2025-09-30T14:55:26.810815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:26.810919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:26.810928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:26.810932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:26.810937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:26.811480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1873
2025-09-30T14:55:26.811519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1873
2025-09-30T14:55:26.811757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895988867253389:6538], now have 1 active actors on pipe
2025-09-30T14:55:26.811771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895988867253186:2454], now have 1 active actors on pipe
2025-09-30T14:55:26.811784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:26.811790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:26.811828Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e3b7bc9-9cc400b3-967a5508-6e01c933_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:26.811841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:26.811850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:26.811853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:26.811865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:26.811882Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:26.811907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:26.812231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:26.812244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:26.812266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:26.812652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1874 partition: 0 MaxSeqNo: 42 sessionId: src_id|3e3b7bc9-9cc400b3-967a5508-6e01c933_0
2025-09-30T14:55:26.813018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dca7eec-d95f2276-f030ff8f-ebb66c5f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3e3b7bc9-9cc400b3-967a5508-6e01c933_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:26.815975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e3b7bc9-9cc400b3-967a5508-6e01c933_0] Write session: try to update token
2025-09-30T14:55:26.815995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e3b7bc9-9cc400b3-967a5508-6e01c933_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:26.823907Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:26.823932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:26.823935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:26.823937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:26.823946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895988777484333:5113]
2025-09-30T14:55:26.823954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895988777484333:5113]
2025-09-30T14:55:26.823959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895988777484333:5113]
2025-09-30T14:55:26.824000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:26.824007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.824010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:26.824157Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:26.827430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:26.827453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:26.827458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:26.835047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1874 sessionId: src_id|3e3b7bc9-9cc400b3-967a5508-6e01c933_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:26.837904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:26.870340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895988867253404:7118]
2025-09-30T14:55:26.870883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1873, pipe: [1:7555895988867253404:7118]
2025-09-30T14:55:26.941014Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:26.941305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:26.941321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:26.941341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895988867253404:7118], now have 1 active actors on pipe
2025-09-30T14:55:26.941541Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:26.941618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:26.941676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895988867253404:7118]
2025-09-30T14:55:26.942143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e3b7bc9-9cc400b3-967a5508-6e01c933_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:26.942159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e3b7bc9-9cc400b3-967a5508-6e01c933_0] Write session will restart in 0.009210s
2025-09-30T14:55:26.941695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:26.942182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e3b7bc9-9cc400b3-967a5508-6e01c933_0] Write session: Do CDS request
2025-09-30T14:55:26.942189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e3b7bc9-9cc400b3-967a5508-6e01c933_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:26.941781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1874 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3e3b7bc9-9cc400b3-967a5508-6e01c933_0
2025-09-30T14:55:26.941945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1874 sessionId: src_id|3e3b7bc9-9cc400b3-967a5508-6e01c933_0 is DEAD
2025-09-30T14:55:26.952746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e3b7bc9-9cc400b3-967a5508-6e01c933_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:26.953131Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:26.953151Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1875
2025-09-30T14:55:26.953268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1875 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:26.953303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1875 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:26.953322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1875 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:26.953327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:26.954035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1875 sessionId:  describe result for acl check
2025-09-30T14:55:26.954073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:26.954076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:26.954078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:26.954083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895988867253432:6537] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:26.954658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895988867253432:6537] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:26.957983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895988867253432:6537] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:26.968064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895988867253432:6537] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:26.968096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895988867253432:6537] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:26.968100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895988867253432:6537] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:26.968109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1875 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:26.980608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:26.984001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:26.984232Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:26.984236Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:26.984247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:26.984302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:26.984333Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895988777484586:5093]
2025-09-30T14:55:26.985010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:26.985349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:26.985410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:26.985809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:26.985878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:26.985885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:26.985887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:26.985888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:26.985889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:26.985890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:26.985892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:26.985893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:26.985895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:26.985896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:26.985897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.985898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.985900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.985901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:26.985902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:26.985908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:26.985918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:26.985922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:26.985927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:26.985931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:26.985935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:26.985939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:26.985943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:26.985947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:26.985954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:26.985958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.985962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.985966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.985969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:26.985974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:26.985983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:26.985991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:26.985997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:26.986003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:26.986008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:26.986013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:26.986018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:26.986026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:26.986032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:26.986038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:26.986042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:26.986047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:26.986053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:26.986058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:26.986069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:26.986075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:26.986084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:26.986090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:26.986100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:26.986105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:26.986110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.986116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.986120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.986126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.986131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.986141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.986145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:26.986155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:26.986161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:26.986166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:26.986218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:26.995098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:26.996141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:26.996159Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:26.996163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:26.996168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:26.996175Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1874 [2:7555895988777484586:5093]
2025-09-30T14:55:26.996192Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:26.996209Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:26.996220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:26.996224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:26.996226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:26.996242Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:26.996254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:26.996262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:26.996333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.996341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.996343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.996347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:26.996350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:26.996417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:26.996429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:26.996442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:26.996453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:26.996469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:26.996487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895988867253508:6537], now have 1 active actors on pipe
2025-09-30T14:55:26.996491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895988867253418:2454], now have 1 active actors on pipe
2025-09-30T14:55:26.996498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895988777484580:5093]
2025-09-30T14:55:26.996501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895988777484580:5093]
2025-09-30T14:55:26.996503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895988777484580:5093]
2025-09-30T14:55:26.996515Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:26.996526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:26.996529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:26.996529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:26.996531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:26.996543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:26.996546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:26.996584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895988777484580:5093]
2025-09-30T14:55:26.996599Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:26.996605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:26.996735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1874
2025-09-30T14:55:26.996753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1874
2025-09-30T14:55:26.996844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:26.996862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:26.996894Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17b4b032-1e1de375-69fa2938-4bf6cf05_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:26.996909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:26.996917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:26.996920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:26.996931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:26.996946Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:26.996967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:26.997194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:26.997203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:26.997217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:26.997331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1875 partition: 0 MaxSeqNo: 42 sessionId: src_id|17b4b032-1e1de375-69fa2938-4bf6cf05_0
2025-09-30T14:55:26.997711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e3b7bc9-9cc400b3-967a5508-6e01c933_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|17b4b032-1e1de375-69fa2938-4bf6cf05_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:27.000613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17b4b032-1e1de375-69fa2938-4bf6cf05_0] Write session: try to update token
2025-09-30T14:55:27.000629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17b4b032-1e1de375-69fa2938-4bf6cf05_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:27.010548Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:27.010570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:27.010578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895988777484580:5093]
2025-09-30T14:55:27.010616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:27.010634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:27.010785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:27.010924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:27.011052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:27.011176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:27.011383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:27.011428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:27.020939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1875 sessionId: src_id|17b4b032-1e1de375-69fa2938-4bf6cf05_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:27.023744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:27.024228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:27.024258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:27.024279Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:27.024282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:27.024284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:27.024286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:27.024516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895988777484580:5093]
2025-09-30T14:55:27.024527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895988777484580:5093]
2025-09-30T14:55:27.024533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895988777484580:5093]
2025-09-30T14:55:27.024580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:27.024584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:27.024590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.024593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:27.024601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:27.024605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:27.024737Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:27.041762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895993162220942:7118]
2025-09-30T14:55:27.043314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1874, pipe: [1:7555895993162220942:7118]
2025-09-30T14:55:27.144971Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:27.145419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:27.145469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895993162220942:7118], now have 1 active actors on pipe
2025-09-30T14:55:27.145595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:27.145920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895993162220942:7118]
2025-09-30T14:55:27.145947Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:27.157073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:27.157090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:27.157115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1875 reason: error at write: Disconnected sessionId: src_id|17b4b032-1e1de375-69fa2938-4bf6cf05_0
2025-09-30T14:55:27.157256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1875 sessionId: src_id|17b4b032-1e1de375-69fa2938-4bf6cf05_0 is DEAD
2025-09-30T14:55:27.157408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17b4b032-1e1de375-69fa2938-4bf6cf05_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:27.157419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17b4b032-1e1de375-69fa2938-4bf6cf05_0] Write session will restart in 0.009584s
2025-09-30T14:55:27.157443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17b4b032-1e1de375-69fa2938-4bf6cf05_0] Write session: Do CDS request
2025-09-30T14:55:27.157449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17b4b032-1e1de375-69fa2938-4bf6cf05_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:27.167780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17b4b032-1e1de375-69fa2938-4bf6cf05_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:27.168238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:27.168268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1876
2025-09-30T14:55:27.168426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1876 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:27.168471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1876 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:27.168478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1876 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:27.168482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:27.169045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1876 sessionId:  describe result for acl check
2025-09-30T14:55:27.169078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:27.169081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:27.169083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:27.169090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895993162221097:6530] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:27.169723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895993162221097:6530] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:27.172840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895993162221097:6530] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:27.173063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:27.176051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:27.176275Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:27.176286Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:27.176298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:27.176095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895993162221097:6530] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:27.176126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895993162221097:6530] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:27.176130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895993162221097:6530] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:27.176151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1876 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:27.176358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:27.176404Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895993072452093:5079]
2025-09-30T14:55:27.177087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:27.177497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:27.177574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:27.177990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:27.178081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:27.178089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:27.178091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:27.178092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:27.178093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:27.178094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:27.178098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:27.178099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:27.178100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:27.178101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:27.178103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.178104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:27.178105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:27.178106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:27.178108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:27.178114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:27.178125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:27.178130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:27.178134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:27.178138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:27.178143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:27.178147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:27.178152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:27.178156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:27.178161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:27.178165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.178169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:27.178173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:27.178177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:27.178181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:27.178190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:27.178199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:27.178212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:27.178218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:27.178228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:27.178234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:27.178243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:27.178250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:27.178260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:27.178265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:27.178270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:27.178281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:27.178286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:27.178309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:27.178320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:27.178326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:27.178331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:27.178336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:27.178342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:27.178347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:27.178352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.178357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.178362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:27.178368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:27.178374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:27.178380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:27.178385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:27.178396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:27.178404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:27.178414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:27.178462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:27.184785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:27.185920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:27.185944Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:27.185947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:27.185951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:27.185958Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1875 [2:7555895993072452093:5079]
2025-09-30T14:55:27.185978Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:27.185997Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:27.186004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:27.186007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:27.186009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:27.186028Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:27.186035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:27.186042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:27.186104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.186111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:27.186113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:27.186115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:27.186117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:27.186176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:27.186185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.186199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:27.186217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:27.186365Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1875
2025-09-30T14:55:27.186367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1875
2025-09-30T14:55:27.186239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:27.186269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895993162221162:6530], now have 1 active actors on pipe
2025-09-30T14:55:27.186273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895993162220953:2454], now have 1 active actors on pipe
2025-09-30T14:55:27.186280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895993072452088:5079]
2025-09-30T14:55:27.186282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895993072452088:5079]
2025-09-30T14:55:27.186287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895993072452088:5079]
2025-09-30T14:55:27.186298Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:27.186312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:27.186314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:27.186318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:27.186321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:27.186327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:27.186330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:27.186370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895993072452088:5079]
2025-09-30T14:55:27.186378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:27.186412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:27.186412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:27.186417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:27.186449Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9766848-b513a85d-b7e7b624-55d8c81a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:27.186456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:27.186460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:27.186462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:27.186472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:27.186481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:27.186498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:27.186662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:27.186672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:27.186686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:27.186768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1876 partition: 0 MaxSeqNo: 42 sessionId: src_id|9766848-b513a85d-b7e7b624-55d8c81a_0
2025-09-30T14:55:27.187138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17b4b032-1e1de375-69fa2938-4bf6cf05_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9766848-b513a85d-b7e7b624-55d8c81a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:27.190168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9766848-b513a85d-b7e7b624-55d8c81a_0] Write session: try to update token
2025-09-30T14:55:27.190189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9766848-b513a85d-b7e7b624-55d8c81a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:27.199473Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:27.199494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:27.199498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:27.199500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:27.199510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895993072452088:5079]
2025-09-30T14:55:27.199515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895993072452088:5079]
2025-09-30T14:55:27.199519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895993072452088:5079]
2025-09-30T14:55:27.199561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:27.199562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:27.199569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.199572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:27.199579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:27.199585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:27.199709Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:27.206604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1876 sessionId: src_id|9766848-b513a85d-b7e7b624-55d8c81a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:27.209567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:27.246005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895993162221176:7118]
2025-09-30T14:55:27.246283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1875, pipe: [1:7555895993162221176:7118]
2025-09-30T14:55:27.316348Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:27.316732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:27.316751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:27.316790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895993162221176:7118], now have 1 active actors on pipe
2025-09-30T14:55:27.317047Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:27.317186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:27.317216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:27.317744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9766848-b513a85d-b7e7b624-55d8c81a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:27.317754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9766848-b513a85d-b7e7b624-55d8c81a_0] Write session will restart in 0.008638s
2025-09-30T14:55:27.317779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9766848-b513a85d-b7e7b624-55d8c81a_0] Write session: Do CDS request
2025-09-30T14:55:27.317784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9766848-b513a85d-b7e7b624-55d8c81a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:27.317415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1876 reason: error at write: Disconnected sessionId: src_id|9766848-b513a85d-b7e7b624-55d8c81a_0
2025-09-30T14:55:27.317601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1876 sessionId: src_id|9766848-b513a85d-b7e7b624-55d8c81a_0 is DEAD
2025-09-30T14:55:27.317639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895993162221176:7118]
2025-09-30T14:55:27.317667Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:27.327727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9766848-b513a85d-b7e7b624-55d8c81a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:27.327799Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:27.327817Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1877
2025-09-30T14:55:27.327988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1877 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:27.328025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1877 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:27.328030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1877 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:27.328035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:27.328565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1877 sessionId:  describe result for acl check
2025-09-30T14:55:27.328601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:27.328611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:27.328612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:27.328619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895993162221214:6526] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:27.329233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895993162221214:6526] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:27.332492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895993162221214:6526] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:27.337310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895993162221214:6526] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:27.337332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895993162221214:6526] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:27.337337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895993162221214:6526] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:27.337346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1877 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:27.337616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:27.340300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:27.340641Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:27.340654Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:27.340668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:27.340749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:27.340791Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895993072452306:5076]
2025-09-30T14:55:27.341436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:27.341839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:27.341913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:27.342340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:27.342475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:27.342487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:27.342488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:27.342489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:27.342491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:27.342492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:27.342494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:27.342495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:27.342496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:27.342498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:27.342499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.342501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:27.342502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:27.342503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:27.342504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:27.342512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:27.342523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:27.342528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:27.342532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:27.342537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:27.342540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:27.342544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:27.342547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:27.342551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:27.342555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:27.342559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.342562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:27.342566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:27.342570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:27.342574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:27.342586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:27.342595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:27.342601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:27.342608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:27.342614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:27.342620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:27.342625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:27.342631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:27.342636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:27.342642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:27.342647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:27.342653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:27.342659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:27.342664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:27.342668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:27.342674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:27.342683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:27.342689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:27.342694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:27.342699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:27.342704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.342709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.342714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:27.342719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:27.342724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:27.342743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:27.342757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:27.342762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:27.342775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:27.342780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:27.342848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:27.349037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:27.350284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:27.350304Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:27.350307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:27.350311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:27.350318Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1876 [2:7555895993072452306:5076]
2025-09-30T14:55:27.350334Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:27.350349Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:27.350352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:27.350355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:27.350358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:27.350374Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:27.350381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:27.350388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:27.350457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.350466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:27.350468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:27.350473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:27.350476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:27.350552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:27.350560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.350573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:27.350583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:27.350604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:27.350621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895993072452300:5076]
2025-09-30T14:55:27.350628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895993072452300:5076]
2025-09-30T14:55:27.350631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895993072452300:5076]
2025-09-30T14:55:27.350639Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:27.350650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:27.350653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895993162221386:6526], now have 1 active actors on pipe
2025-09-30T14:55:27.350659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895993162221177:2454], now have 1 active actors on pipe
2025-09-30T14:55:27.350663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:27.350664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:27.350666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:27.350680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:27.350683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:27.350722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895993072452300:5076]
2025-09-30T14:55:27.350734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:27.350743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:27.350765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1876
2025-09-30T14:55:27.350814Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1876
2025-09-30T14:55:27.350950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:27.350965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:27.350993Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dbd00569-2762cf1f-678efe62-2b5966b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:27.351000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:27.351004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:27.351006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:27.351017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:27.351032Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:27.351052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:27.351264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:27.351280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:27.351310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:27.351487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1877 partition: 0 MaxSeqNo: 42 sessionId: src_id|dbd00569-2762cf1f-678efe62-2b5966b_0
2025-09-30T14:55:27.351926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9766848-b513a85d-b7e7b624-55d8c81a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dbd00569-2762cf1f-678efe62-2b5966b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:27.355021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbd00569-2762cf1f-678efe62-2b5966b_0] Write session: try to update token
2025-09-30T14:55:27.355046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbd00569-2762cf1f-678efe62-2b5966b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:27.370520Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:27.370544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:27.370547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:27.370549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:27.370558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895993072452300:5076]
2025-09-30T14:55:27.370563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895993072452300:5076]
2025-09-30T14:55:27.370568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895993072452300:5076]
2025-09-30T14:55:27.370609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:27.370623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.370622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:27.370626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:27.370629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:27.370633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:27.370782Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:27.375694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1877 sessionId: src_id|dbd00569-2762cf1f-678efe62-2b5966b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:27.378506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:27.417546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895993162221398:7118]
2025-09-30T14:55:27.417971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1876, pipe: [1:7555895993162221398:7118]
2025-09-30T14:55:27.486715Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:27.487117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:27.487135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:27.487179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895993162221398:7118], now have 1 active actors on pipe
2025-09-30T14:55:27.487461Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:27.487544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:27.487565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:27.488124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbd00569-2762cf1f-678efe62-2b5966b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:27.488135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbd00569-2762cf1f-678efe62-2b5966b_0] Write session will restart in 0.007202s
2025-09-30T14:55:27.487628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1877 reason: error at write: Disconnected sessionId: src_id|dbd00569-2762cf1f-678efe62-2b5966b_0
2025-09-30T14:55:27.487755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895993162221398:7118]
2025-09-30T14:55:27.487774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:27.488158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbd00569-2762cf1f-678efe62-2b5966b_0] Write session: Do CDS request
2025-09-30T14:55:27.487816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1877 sessionId: src_id|dbd00569-2762cf1f-678efe62-2b5966b_0 is DEAD
2025-09-30T14:55:27.488167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbd00569-2762cf1f-678efe62-2b5966b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:27.496805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbd00569-2762cf1f-678efe62-2b5966b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:27.496867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:27.496897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1878
2025-09-30T14:55:27.497095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1878 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:27.497131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1878 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:27.497141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1878 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:27.497146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:27.497592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1878 sessionId:  describe result for acl check
2025-09-30T14:55:27.497633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:27.497644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:27.497646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:27.497651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895993162221412:6514] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:27.498189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895993162221412:6514] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:27.500221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895993162221412:6514] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:27.504595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895993162221412:6514] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:27.504615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895993162221412:6514] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:27.504618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895993162221412:6514] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:27.504627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1878 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:27.510204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:27.512820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:27.513128Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:27.513137Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:27.513151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:27.513213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:27.513251Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895993072452521:5070]
2025-09-30T14:55:27.513942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:27.514265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:27.514306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:27.514642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:27.514704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:27.514710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:27.514712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:27.514713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:27.514714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:27.514715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:27.514717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:27.514718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:27.514720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:27.514721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:27.514722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.514723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:27.514725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:27.514725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:27.514727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:27.514733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:27.514743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:27.514748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:27.514752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:27.514755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:27.514760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:27.514764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:27.514768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:27.514772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:27.514777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:27.514781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.514785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:27.514789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:27.514793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:27.514797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:27.514807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:27.514814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:27.514819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:27.514825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:27.514829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:27.514833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:27.514838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:27.514843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:27.514848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:27.514854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:27.514859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:27.514864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:27.514869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:27.514875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:27.514879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:27.514885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:27.514891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:27.514896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:27.514900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:27.514905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:27.514909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.514915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.514919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:27.514924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:27.514927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:27.514932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:27.514937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:27.514944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:27.514953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:27.514967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:27.515005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:27.523884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:27.525095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:27.525115Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:27.525119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:27.525126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:27.525133Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1877 [2:7555895993072452521:5070]
2025-09-30T14:55:27.525150Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:27.525166Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:27.525169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:27.525172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:27.525175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:27.525192Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:27.525205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:27.525212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:27.525276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.525281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:27.525283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:27.525286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:27.525289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:27.525359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:27.525368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.525382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:27.525399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:27.525421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:27.525440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895993072452516:5070]
2025-09-30T14:55:27.525446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895993072452516:5070]
2025-09-30T14:55:27.525449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895993072452516:5070]
2025-09-30T14:55:27.525466Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:27.525480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:27.525503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:27.525510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:27.525533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:27.525545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895993072452516:5070]
2025-09-30T14:55:27.525546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:27.525547Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:27.525549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:27.525555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:27.525749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895993162221399:2454], now have 1 active actors on pipe
2025-09-30T14:55:27.525769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895993162221521:6514], now have 1 active actors on pipe
2025-09-30T14:55:27.525833Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1877
2025-09-30T14:55:27.525883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1877
2025-09-30T14:55:27.525993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:27.526007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:27.526034Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af0acc35-77fef702-c0107513-3f529cff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:27.526048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:27.526052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:27.526054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:27.526067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:27.526079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:27.526096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:27.531356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:27.531382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:27.531432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:27.532476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1878 partition: 0 MaxSeqNo: 42 sessionId: src_id|af0acc35-77fef702-c0107513-3f529cff_0
2025-09-30T14:55:27.532869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbd00569-2762cf1f-678efe62-2b5966b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|af0acc35-77fef702-c0107513-3f529cff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:27.535877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af0acc35-77fef702-c0107513-3f529cff_0] Write session: try to update token
2025-09-30T14:55:27.535899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af0acc35-77fef702-c0107513-3f529cff_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:27.538744Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:27.538763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:27.538765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:27.538767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:27.538776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895993072452516:5070]
2025-09-30T14:55:27.538781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895993072452516:5070]
2025-09-30T14:55:27.538785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895993072452516:5070]
2025-09-30T14:55:27.538831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:27.538839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.538841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:27.538841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:27.538848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:27.538853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:27.538985Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:27.556196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1878 sessionId: src_id|af0acc35-77fef702-c0107513-3f529cff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:27.559117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:27.588025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895993162221622:7118]
2025-09-30T14:55:27.588368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1877, pipe: [1:7555895993162221622:7118]
2025-09-30T14:55:27.657917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:27.658004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:27.658007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:27.658064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1878 reason: error at write: Disconnected sessionId: src_id|af0acc35-77fef702-c0107513-3f529cff_0
2025-09-30T14:55:27.658230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1878 sessionId: src_id|af0acc35-77fef702-c0107513-3f529cff_0 is DEAD
2025-09-30T14:55:27.658395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af0acc35-77fef702-c0107513-3f529cff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:27.658406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af0acc35-77fef702-c0107513-3f529cff_0] Write session will restart in 0.009726s
2025-09-30T14:55:27.658428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af0acc35-77fef702-c0107513-3f529cff_0] Write session: Do CDS request
2025-09-30T14:55:27.658417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895993162221622:7118]
2025-09-30T14:55:27.658434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af0acc35-77fef702-c0107513-3f529cff_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:27.657065Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:27.657654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:27.657664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:27.657685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895993162221622:7118], now have 1 active actors on pipe
2025-09-30T14:55:27.657940Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:27.669950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af0acc35-77fef702-c0107513-3f529cff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:27.670005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:27.670024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1879
2025-09-30T14:55:27.670343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1879 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:27.670387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1879 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:27.670392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1879 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:27.670396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:27.670799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1879 sessionId:  describe result for acl check
2025-09-30T14:55:27.670825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:27.670827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:27.670829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:27.670836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895993162221686:6515] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:27.671395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895993162221686:6515] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:27.674787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895993162221686:6515] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:27.679085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895993162221686:6515] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:27.679105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895993162221686:6515] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:27.679109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895993162221686:6515] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:27.679117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1879 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:27.681599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:27.684907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:27.685141Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:27.685151Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:27.685162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:27.685223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:27.685261Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895993072452747:5062]
2025-09-30T14:55:27.685938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:27.686241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:27.686298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:27.686640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:27.686836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:27.686844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:27.686845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:27.686847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:27.686848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:27.686850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:27.686851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:27.686852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:27.686853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:27.686855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:27.686856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.686858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:27.686859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:27.686860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:27.686861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:27.686867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:27.686879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:27.686883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:27.686888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:27.686892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:27.686896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:27.686899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:27.686903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:27.686907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:27.686911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:27.686915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.686920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:27.686923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:27.686927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:27.686930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:27.686937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:27.686944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:27.686950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:27.686956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:27.686961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:27.686966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:27.686971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:27.686976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:27.686980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:27.686985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:27.686990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:27.686995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:27.687000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:27.687005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:27.687010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:27.687017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:27.687022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:27.687027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:27.687032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:27.687037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:27.687041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.687047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.687051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:27.687057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:27.687072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:27.687083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:27.687088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:27.687094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:27.687099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:27.687109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:27.687156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:27.693329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:27.694667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:27.694689Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:27.694692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:27.694695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:27.694703Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1878 [2:7555895993072452747:5062]
2025-09-30T14:55:27.694720Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:27.694737Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:27.694740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:27.694743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:27.694746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:27.694762Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:27.694770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:27.694776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:27.694842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.694850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:27.694852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:27.694855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:27.694858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:27.694935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:27.694945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.694959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:27.694976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:27.694998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:27.695021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895993162221835:6515], now have 1 active actors on pipe
2025-09-30T14:55:27.695029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895993162221625:2454], now have 1 active actors on pipe
2025-09-30T14:55:27.695035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895993072452741:5062]
2025-09-30T14:55:27.695041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895993072452741:5062]
2025-09-30T14:55:27.695043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895993072452741:5062]
2025-09-30T14:55:27.695057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:27.695075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:27.695084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:27.695094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:27.695097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:27.695097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:27.695100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:27.695138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895993072452741:5062]
2025-09-30T14:55:27.695150Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:27.695156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:27.695346Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1878
2025-09-30T14:55:27.695349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1878
2025-09-30T14:55:27.695507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:27.695522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:27.695552Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5aa952d7-70067fd-8500e1c5-5be2beda_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:27.695565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:27.695571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:27.695578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:27.695589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:27.695605Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:27.695625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:27.695811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:27.695827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:27.695854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:27.696040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1879 partition: 0 MaxSeqNo: 42 sessionId: src_id|5aa952d7-70067fd-8500e1c5-5be2beda_0
2025-09-30T14:55:27.696425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af0acc35-77fef702-c0107513-3f529cff_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5aa952d7-70067fd-8500e1c5-5be2beda_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:27.699398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5aa952d7-70067fd-8500e1c5-5be2beda_0] Write session: try to update token
2025-09-30T14:55:27.699420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5aa952d7-70067fd-8500e1c5-5be2beda_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:27.714936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1879 sessionId: src_id|5aa952d7-70067fd-8500e1c5-5be2beda_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:27.716143Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:27.716167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:27.716178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895993072452741:5062]
2025-09-30T14:55:27.716231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:27.716243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:27.716477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:27.716675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:27.716853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:27.717062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:27.717311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:27.717359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:27.717639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:27.718318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:27.718341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:27.718374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:27.718500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:27.721535Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:27.721555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:27.721558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:27.721560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:27.721569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895993072452741:5062]
2025-09-30T14:55:27.721574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895993072452741:5062]
2025-09-30T14:55:27.721597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895993072452741:5062]
2025-09-30T14:55:27.721636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:27.721643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.721646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:27.721795Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:27.724462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:27.724485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:27.724489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:27.763436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895993162221861:7118]
2025-09-30T14:55:27.767450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1878, pipe: [1:7555895993162221861:7118]
2025-09-30T14:55:27.839085Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:27.848058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:27.848093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:27.848281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:27.848351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:27.848423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:27.848493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:27.848542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:27.848552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:27.848630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:27.848695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:27.848765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:27.849045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:27.849096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:27.849108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:27.849186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:27.849254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:27.849328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:27.849401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:27.849447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:27.849455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:27.849528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:27.849608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:27.849676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:27.849755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:27.849801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:27.849804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:27.849887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:27.849953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:27.850020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:27.850086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:27.850152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:27.850156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:27.850229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:27.850289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:27.850353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:27.850421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:27.850468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:27.850471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:27.850547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:27.850615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:27.850687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:27.850756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:27.850807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:27.850812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:27.850881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:27.850948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:27.851018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:27.851084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:27.851143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:27.851147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:27.851221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:27.851441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:27.851527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:27.851597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:27.851648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:27.851657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:27.851737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:27.851806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:27.851881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:27.851950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:27.852005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:27.852013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:27.852091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895993162221861:7118], now have 1 active actors on pipe
2025-09-30T14:55:27.852326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:27.852343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:27.852348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:27.852384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1879 reason: error at write: Disconnected sessionId: src_id|5aa952d7-70067fd-8500e1c5-5be2beda_0
2025-09-30T14:55:27.852418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895993162221861:7118]
2025-09-30T14:55:27.852836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1879 sessionId: src_id|5aa952d7-70067fd-8500e1c5-5be2beda_0 is DEAD
2025-09-30T14:55:27.852973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aa952d7-70067fd-8500e1c5-5be2beda_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:27.852983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aa952d7-70067fd-8500e1c5-5be2beda_0] Write session will restart in 0.005097s
2025-09-30T14:55:27.853007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aa952d7-70067fd-8500e1c5-5be2beda_0] Write session: Do CDS request
2025-09-30T14:55:27.853012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aa952d7-70067fd-8500e1c5-5be2beda_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:27.853183Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:27.859806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5aa952d7-70067fd-8500e1c5-5be2beda_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:27.859873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:27.859894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1880
2025-09-30T14:55:27.860076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1880 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:27.860112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1880 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:27.860118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1880 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:27.860122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:27.860614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1880 sessionId:  describe result for acl check
2025-09-30T14:55:27.860647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:27.860651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:27.860654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:27.860661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895993162221885:6512] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:27.861253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895993162221885:6512] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:27.863922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895993162221885:6512] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:27.868844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895993162221885:6512] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:27.868864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895993162221885:6512] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:27.868868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895993162221885:6512] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:27.868877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1880 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:27.872587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:27.875272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:27.875490Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:27.875500Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:27.875510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:27.875562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:27.875602Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895993072452964:5057]
2025-09-30T14:55:27.876291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:27.876586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:27.876631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:27.876970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:27.877029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:27.877037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:27.877038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:27.877039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:27.877040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:27.877041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:27.877042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:27.877043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:27.877045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:27.877046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:27.877047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.877048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:27.877050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:27.877051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:27.877052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:27.877057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:27.877067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:27.877072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:27.877076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:27.877080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:27.877084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:27.877089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:27.877092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:27.877097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:27.877101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:27.877105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.877109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:27.877112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:27.877117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:27.877121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:27.877127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:27.877135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:27.877142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:27.877148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:27.877152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:27.877158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:27.877162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:27.877168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:27.877172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:27.877178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:27.877182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:27.877187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:27.877192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:27.877197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:27.877202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:27.877207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:27.877212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:27.877217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:27.877221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:27.877226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:27.877230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.877237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.877241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:27.877247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:27.877252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:27.877258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:27.877270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:27.877275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:27.877284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:27.877289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:27.877339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:27.882854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:27.884004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:27.884023Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:27.884026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:27.884030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:27.884037Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1879 [2:7555895993072452964:5057]
2025-09-30T14:55:27.884054Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:27.884069Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:27.884072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:27.884075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:27.884077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:27.884092Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:27.884097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:27.884103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:27.884149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.884155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:27.884157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:27.884159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:27.884161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:27.884216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:27.884223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.884234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:27.884245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:27.884262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:27.884284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895993072452959:5057]
2025-09-30T14:55:27.884295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895993072452959:5057]
2025-09-30T14:55:27.884298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895993072452959:5057]
2025-09-30T14:55:27.884309Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:27.884320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:27.884320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:27.884324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:27.884326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:27.884329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:27.884331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:27.884339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895993162221864:2454], now have 1 active actors on pipe
2025-09-30T14:55:27.884341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895993162222045:6512], now have 1 active actors on pipe
2025-09-30T14:55:27.884375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895993072452959:5057]
2025-09-30T14:55:27.884382Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:27.884391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:27.884408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1879
2025-09-30T14:55:27.884455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1879
2025-09-30T14:55:27.884585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:27.884603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:27.884635Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8502bb33-f7fb2e49-f24ca898-976f2b0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:27.884650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:27.884654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:27.884657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:27.884669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:27.884681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:27.884703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:27.884863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:27.884875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:27.884897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:27.884990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1880 partition: 0 MaxSeqNo: 42 sessionId: src_id|8502bb33-f7fb2e49-f24ca898-976f2b0c_0
2025-09-30T14:55:27.885374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aa952d7-70067fd-8500e1c5-5be2beda_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8502bb33-f7fb2e49-f24ca898-976f2b0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:27.888230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8502bb33-f7fb2e49-f24ca898-976f2b0c_0] Write session: try to update token
2025-09-30T14:55:27.888250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8502bb33-f7fb2e49-f24ca898-976f2b0c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:27.896880Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:27.896905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:27.896908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:27.896910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:27.896922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895993072452959:5057]
2025-09-30T14:55:27.896929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895993072452959:5057]
2025-09-30T14:55:27.896934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895993072452959:5057]
2025-09-30T14:55:27.896971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:27.896973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:27.896976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:27.896980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:27.896983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:27.896992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:27.897122Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:27.903690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1880 sessionId: src_id|8502bb33-f7fb2e49-f24ca898-976f2b0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:27.906834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:27.952580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895993162222087:7118]
2025-09-30T14:55:27.952820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1879, pipe: [1:7555895993162222087:7118]
2025-09-30T14:55:28.012392Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:28.012843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:28.012858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:28.012894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895993162222087:7118], now have 1 active actors on pipe
2025-09-30T14:55:28.013102Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:28.013742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8502bb33-f7fb2e49-f24ca898-976f2b0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:28.013754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8502bb33-f7fb2e49-f24ca898-976f2b0c_0] Write session will restart in 0.006376s
2025-09-30T14:55:28.013778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8502bb33-f7fb2e49-f24ca898-976f2b0c_0] Write session: Do CDS request
2025-09-30T14:55:28.013144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895993162222087:7118]
2025-09-30T14:55:28.013179Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:28.013216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:28.013797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8502bb33-f7fb2e49-f24ca898-976f2b0c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:28.013301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1880 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8502bb33-f7fb2e49-f24ca898-976f2b0c_0
2025-09-30T14:55:28.013487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1880 sessionId: src_id|8502bb33-f7fb2e49-f24ca898-976f2b0c_0 is DEAD
2025-09-30T14:55:28.021790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8502bb33-f7fb2e49-f24ca898-976f2b0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:28.021922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:28.021940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1881
2025-09-30T14:55:28.022054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1881 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:28.022085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1881 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:28.022094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1881 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:28.022098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:28.022501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1881 sessionId:  describe result for acl check
2025-09-30T14:55:28.022534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:28.022541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:28.022543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:28.022548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895997457189440:6490] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:28.023058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895997457189440:6490] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:28.025620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895997457189440:6490] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:28.028853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895997457189440:6490] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:28.028871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895997457189440:6490] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:28.028884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895997457189440:6490] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:28.028893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1881 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:28.030485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:28.033129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:28.033343Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:28.033355Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:28.033366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:28.033415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:28.033462Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895997367420511:5050]
2025-09-30T14:55:28.034197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:28.034540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:28.034591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:28.034965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:28.035029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:28.035037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:28.035039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:28.035040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:28.035041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:28.035042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:28.035044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:28.035045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:28.035046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:28.035048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:28.035050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.035051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.035052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.035053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:28.035055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:28.035060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:28.035070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:28.035074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:28.035079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:28.035083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:28.035087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:28.035091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:28.035095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:28.035099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:28.035104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:28.035108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.035112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.035116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.035120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:28.035124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:28.035133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:28.035141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:28.035148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:28.035153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:28.035158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:28.035164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:28.035169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:28.035174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:28.035179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:28.035185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:28.035189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:28.035194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:28.035199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:28.035204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:28.035209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:28.035214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:28.035219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:28.035224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:28.035228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:28.035233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:28.035238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.035264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.035269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.035274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.035285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.035290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.035299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:28.035304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:28.035309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:28.035315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:28.035368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:28.041064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:28.041983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:28.042006Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:28.042009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:28.042013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:28.042021Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1880 [2:7555895997367420511:5050]
2025-09-30T14:55:28.042039Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:28.042055Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:28.042058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:28.042062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:28.042064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:28.042083Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:28.042090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:28.042098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:28.042309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.042319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.042322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.042326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:28.042329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:28.042399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:28.042407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.042419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.042431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.042453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:28.042477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895997457189617:6490], now have 1 active actors on pipe
2025-09-30T14:55:28.042486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895997457189398:2454], now have 1 active actors on pipe
2025-09-30T14:55:28.042493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895997367420506:5050]
2025-09-30T14:55:28.042499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895997367420506:5050]
2025-09-30T14:55:28.042503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895997367420506:5050]
2025-09-30T14:55:28.042517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:28.042530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:28.042539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:28.042540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:28.042543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:28.042554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:28.042558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:28.042599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895997367420506:5050]
2025-09-30T14:55:28.042608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:28.042613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:28.042587Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1880
2025-09-30T14:55:28.042648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1880
2025-09-30T14:55:28.042729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:28.042748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:28.042786Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fcd585c3-8280c57a-a2fd8943-6c6ed27d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:28.042800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:28.042809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:28.042812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:28.042824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:28.042841Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:28.042857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:28.043032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:28.043042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:28.043064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:28.043176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1881 partition: 0 MaxSeqNo: 42 sessionId: src_id|fcd585c3-8280c57a-a2fd8943-6c6ed27d_0
2025-09-30T14:55:28.043569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8502bb33-f7fb2e49-f24ca898-976f2b0c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fcd585c3-8280c57a-a2fd8943-6c6ed27d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:28.046566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcd585c3-8280c57a-a2fd8943-6c6ed27d_0] Write session: try to update token
2025-09-30T14:55:28.046588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcd585c3-8280c57a-a2fd8943-6c6ed27d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:28.055426Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:28.055449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:28.055458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895997367420506:5050]
2025-09-30T14:55:28.055501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:28.055506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:28.055730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:28.055892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:28.056105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:28.056314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:28.056642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:28.056713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:28.063333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1881 sessionId: src_id|fcd585c3-8280c57a-a2fd8943-6c6ed27d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:28.066201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:28.066476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:28.066507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:28.066526Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:28.066530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:28.066532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:28.066535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:28.066543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895997367420506:5050]
2025-09-30T14:55:28.066548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895997367420506:5050]
2025-09-30T14:55:28.066553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895997367420506:5050]
2025-09-30T14:55:28.066605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:28.066617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.066620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:28.066731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:28.066746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:28.066749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:28.066758Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:28.113366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895997457189634:7118]
2025-09-30T14:55:28.113702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1880, pipe: [1:7555895997457189634:7118]
2025-09-30T14:55:28.190741Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:28.191527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:28.191576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895997457189634:7118], now have 1 active actors on pipe
2025-09-30T14:55:28.192140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:28.192237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:28.192245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:28.192314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1881 reason: error at write: Disconnected sessionId: src_id|fcd585c3-8280c57a-a2fd8943-6c6ed27d_0
2025-09-30T14:55:28.192456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1881 sessionId: src_id|fcd585c3-8280c57a-a2fd8943-6c6ed27d_0 is DEAD
2025-09-30T14:55:28.192597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcd585c3-8280c57a-a2fd8943-6c6ed27d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:28.192609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcd585c3-8280c57a-a2fd8943-6c6ed27d_0] Write session will restart in 0.005284s
2025-09-30T14:55:28.192634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcd585c3-8280c57a-a2fd8943-6c6ed27d_0] Write session: Do CDS request
2025-09-30T14:55:28.192641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcd585c3-8280c57a-a2fd8943-6c6ed27d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:28.192724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895997457189634:7118]
2025-09-30T14:55:28.192745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:28.199108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcd585c3-8280c57a-a2fd8943-6c6ed27d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:28.199370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:28.199403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1882
2025-09-30T14:55:28.199532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1882 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:28.199581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1882 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:28.199593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1882 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:28.199599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:28.200123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1882 sessionId:  describe result for acl check
2025-09-30T14:55:28.200162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:28.200166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:28.200168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:28.200174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895997457189649:6487] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:28.200789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895997457189649:6487] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:28.205534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895997457189649:6487] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:28.208358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895997457189649:6487] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:28.208381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895997457189649:6487] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:28.208384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895997457189649:6487] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:28.208393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1882 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:28.223731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:28.226355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:28.226587Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:28.226591Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:28.226603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:28.226662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:28.226707Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895997367420727:5037]
2025-09-30T14:55:28.227454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:28.227803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:28.227852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:28.228183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:28.228243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:28.228244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:28.228245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:28.228246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:28.228248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:28.228250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:28.228251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:28.228252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:28.228254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:28.228255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:28.228256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.228258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.228259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.228260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:28.228262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:28.228267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:28.228278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:28.228282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:28.228287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:28.228290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:28.228294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:28.228298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:28.228303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:28.228307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:28.228312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:28.228316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.228319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.228323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.228327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:28.228330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:28.228340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:28.228349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:28.228356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:28.228362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:28.228366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:28.228372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:28.228377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:28.228384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:28.228390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:28.228395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:28.228400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:28.228406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:28.228412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:28.228418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:28.228423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:28.228428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:28.228435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:28.228441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:28.228445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:28.228452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:28.228457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.228464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.228469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.228475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.228480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.228486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.228491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:28.228497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:28.228502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:28.228508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:28.228559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:28.234640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:28.235737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:28.235759Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:28.235762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:28.235766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:28.235774Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1881 [2:7555895997367420727:5037]
2025-09-30T14:55:28.235794Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:28.235812Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:28.235815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:28.235818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:28.235821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:28.235837Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:28.235843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:28.235850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:28.235911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.235921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.235923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.235926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:28.235929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:28.236006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:28.236018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.236032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.236044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.236061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:28.236085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895997367420722:5037]
2025-09-30T14:55:28.236092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895997367420722:5037]
2025-09-30T14:55:28.236094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895997367420722:5037]
2025-09-30T14:55:28.236109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:28.236128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:28.236150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:28.236153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:28.236166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:28.236170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:28.236173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:28.236191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895997367420722:5037]
2025-09-30T14:55:28.236199Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:28.236264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:28.236360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895997457189695:6487], now have 1 active actors on pipe
2025-09-30T14:55:28.236379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895997457189642:2454], now have 1 active actors on pipe
2025-09-30T14:55:28.236419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1881
2025-09-30T14:55:28.236456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1881
2025-09-30T14:55:28.236677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:28.236690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:28.236721Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d764172-846d96d5-de40f7f8-8b551b3d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:28.236737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:28.236742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:28.236744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:28.236758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:28.236770Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:28.236785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:28.237000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:28.237014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:28.237038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:28.237184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1882 partition: 0 MaxSeqNo: 42 sessionId: src_id|5d764172-846d96d5-de40f7f8-8b551b3d_0
2025-09-30T14:55:28.237544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcd585c3-8280c57a-a2fd8943-6c6ed27d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5d764172-846d96d5-de40f7f8-8b551b3d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:28.240558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d764172-846d96d5-de40f7f8-8b551b3d_0] Write session: try to update token
2025-09-30T14:55:28.240583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d764172-846d96d5-de40f7f8-8b551b3d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:28.249690Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:28.249721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:28.249724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:28.249727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:28.249737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895997367420722:5037]
2025-09-30T14:55:28.249742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895997367420722:5037]
2025-09-30T14:55:28.249747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895997367420722:5037]
2025-09-30T14:55:28.249792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:28.249800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.249804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:28.249804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:28.249822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:28.249826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:28.249959Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:28.258759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1882 sessionId: src_id|5d764172-846d96d5-de40f7f8-8b551b3d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:28.261754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:28.291522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895997457189870:7118]
2025-09-30T14:55:28.291852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1881, pipe: [1:7555895997457189870:7118]
2025-09-30T14:55:28.362435Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:28.363163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:28.363182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:28.363202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895997457189870:7118], now have 1 active actors on pipe
2025-09-30T14:55:28.363480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:28.363500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:28.363503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:28.363467Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:28.363551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895997457189870:7118]
2025-09-30T14:55:28.363576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1882 reason: error at write: Disconnected sessionId: src_id|5d764172-846d96d5-de40f7f8-8b551b3d_0
2025-09-30T14:55:28.363748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1882 sessionId: src_id|5d764172-846d96d5-de40f7f8-8b551b3d_0 is DEAD
2025-09-30T14:55:28.363951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d764172-846d96d5-de40f7f8-8b551b3d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:28.363960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d764172-846d96d5-de40f7f8-8b551b3d_0] Write session will restart in 0.009069s
2025-09-30T14:55:28.363996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d764172-846d96d5-de40f7f8-8b551b3d_0] Write session: Do CDS request
2025-09-30T14:55:28.364001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d764172-846d96d5-de40f7f8-8b551b3d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:28.374823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d764172-846d96d5-de40f7f8-8b551b3d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:28.375706Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:28.375728Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1883
2025-09-30T14:55:28.375887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1883 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:28.375921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1883 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:28.375933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1883 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:28.375937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:28.376722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1883 sessionId:  describe result for acl check
2025-09-30T14:55:28.376765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:28.376770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:28.376773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:28.376780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895997457189897:6482] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:28.377412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895997457189897:6482] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:28.386730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895997457189897:6482] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:28.395301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895997457189897:6482] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:28.395323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895997457189897:6482] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:28.395327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895997457189897:6482] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:28.395337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1883 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:28.397360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:28.400433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:28.400685Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:28.400698Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:28.400709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:28.400773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:28.400817Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895997367420946:5035]
2025-09-30T14:55:28.401497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:28.402944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:28.403018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:28.403459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:28.403535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:28.403536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:28.403537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:28.403539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:28.403540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:28.403542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:28.403543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:28.403545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:28.403547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:28.403549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:28.403550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.403551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.403553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.403554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:28.403555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:28.403562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:28.403572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:28.403577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:28.403581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:28.403586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:28.403590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:28.403595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:28.403599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:28.403604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:28.403609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:28.403613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.403617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.403621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.403626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:28.403630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:28.403639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:28.403648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:28.403655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:28.403661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:28.403666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:28.403672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:28.403677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:28.403683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:28.403699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:28.403705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:28.403711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:28.403717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:28.403722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:28.403728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:28.403734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:28.403739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:28.403744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:28.403750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:28.403755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:28.403761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:28.403767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.403773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.403778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.403784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.403790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.403796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.403800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:28.403808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:28.403815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:28.403821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:28.403868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:28.416080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:28.416964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:28.416984Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:28.416987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:28.416992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:28.416999Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1882 [2:7555895997367420946:5035]
2025-09-30T14:55:28.417018Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:28.417034Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:28.417043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:28.417046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:28.417049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:28.417064Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:28.417076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:28.417083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:28.417153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.417162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.417165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.417168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:28.417171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:28.417241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:28.417249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.417263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.417282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.417304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:28.417322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895997367420941:5035]
2025-09-30T14:55:28.417329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895997367420941:5035]
2025-09-30T14:55:28.417332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895997367420941:5035]
2025-09-30T14:55:28.417346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:28.417365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895997457189872:2454], now have 1 active actors on pipe
2025-09-30T14:55:28.417370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:28.417374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895997457190085:6482], now have 1 active actors on pipe
2025-09-30T14:55:28.417375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:28.417377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:28.417382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:28.417398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:28.417401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:28.417437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895997367420941:5035]
2025-09-30T14:55:28.417453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:28.417458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:28.419511Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1882
2025-09-30T14:55:28.419565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1882
2025-09-30T14:55:28.419721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:28.419743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:28.419788Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97cf24a-130235e4-ecc035b0-8f5beeca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:28.419801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:28.419806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:28.419809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:28.419821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:28.419836Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:28.419859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:28.420102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:28.420124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:28.420138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:28.420260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1883 partition: 0 MaxSeqNo: 42 sessionId: src_id|97cf24a-130235e4-ecc035b0-8f5beeca_0
2025-09-30T14:55:28.420651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d764172-846d96d5-de40f7f8-8b551b3d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|97cf24a-130235e4-ecc035b0-8f5beeca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:28.423756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97cf24a-130235e4-ecc035b0-8f5beeca_0] Write session: try to update token
2025-09-30T14:55:28.423779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97cf24a-130235e4-ecc035b0-8f5beeca_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:28.432493Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:28.432523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:28.432532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555895997367420941:5035]
2025-09-30T14:55:28.432580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:28.432578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:28.432776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:28.432930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:28.433079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:28.433223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:28.433432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:28.433472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:28.443362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1883 sessionId: src_id|97cf24a-130235e4-ecc035b0-8f5beeca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:28.443708Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:28.443733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:28.443736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:28.443738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:28.443748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895997367420941:5035]
2025-09-30T14:55:28.443752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895997367420941:5035]
2025-09-30T14:55:28.443757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895997367420941:5035]
2025-09-30T14:55:28.443800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:28.443807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:28.443813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.443813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:28.443816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:28.443818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:28.443962Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:28.446120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:28.463575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895997457190099:7118]
2025-09-30T14:55:28.463906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1882, pipe: [1:7555895997457190099:7118]
2025-09-30T14:55:28.560001Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:28.560693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:28.560706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:28.560728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895997457190099:7118], now have 1 active actors on pipe
2025-09-30T14:55:28.561132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895997457190099:7118]
2025-09-30T14:55:28.561170Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:28.561118Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:28.561207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:28.561217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:28.561295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1883 reason: error at write: Disconnected sessionId: src_id|97cf24a-130235e4-ecc035b0-8f5beeca_0
2025-09-30T14:55:28.561480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1883 sessionId: src_id|97cf24a-130235e4-ecc035b0-8f5beeca_0 is DEAD
2025-09-30T14:55:28.563469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97cf24a-130235e4-ecc035b0-8f5beeca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:28.563481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97cf24a-130235e4-ecc035b0-8f5beeca_0] Write session will restart in 0.006869s
2025-09-30T14:55:28.563511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97cf24a-130235e4-ecc035b0-8f5beeca_0] Write session: Do CDS request
2025-09-30T14:55:28.563520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97cf24a-130235e4-ecc035b0-8f5beeca_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:28.571823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97cf24a-130235e4-ecc035b0-8f5beeca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:28.571907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:28.571928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1884
2025-09-30T14:55:28.572197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1884 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:28.572234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1884 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:28.572239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1884 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:28.572244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:28.572818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1884 sessionId:  describe result for acl check
2025-09-30T14:55:28.572868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:28.572870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:28.572872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:28.572890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895997457190117:6478] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:28.573518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895997457190117:6478] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:28.575526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895997457190117:6478] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:28.579027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895997457190117:6478] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:28.579047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895997457190117:6478] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:28.579053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895997457190117:6478] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:28.579070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1884 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:28.591946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:28.595368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:28.595714Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:28.595719Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:28.595730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:28.595793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:28.595833Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895997367421165:5028]
2025-09-30T14:55:28.596535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:28.599805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:28.599907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:28.600330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:28.600428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:28.600435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:28.600437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:28.600438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:28.600440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:28.600441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:28.600443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:28.600444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:28.600446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:28.600447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:28.600449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.600450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.600451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.600453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:28.600454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:28.600461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:28.600473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:28.600478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:28.600483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:28.600488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:28.600493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:28.600497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:28.600501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:28.600506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:28.600511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:28.600516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.600520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.600524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.600529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:28.600533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:28.600543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:28.600553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:28.600560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:28.600569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:28.600575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:28.600581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:28.600587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:28.600593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:28.600599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:28.600604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:28.600617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:28.600623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:28.600634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:28.600641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:28.600650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:28.600656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:28.600660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:28.600666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:28.600671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:28.600677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:28.600683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.600696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.600701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.600707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.600717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.600723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.600729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:28.600734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:28.600739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:28.600745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:28.600793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:28.619781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:28.621089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:28.621096Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:28.621099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:28.621103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:28.621112Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1883 [2:7555895997367421165:5028]
2025-09-30T14:55:28.621131Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:28.621149Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:28.621153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:28.621157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:28.621159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:28.621178Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:28.621185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:28.621194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:28.621271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.621273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.621275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.621279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:28.621282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:28.621364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:28.621367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.621382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.621392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.621408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:28.621426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895997367421159:5028]
2025-09-30T14:55:28.621428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895997367421159:5028]
2025-09-30T14:55:28.621430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895997367421159:5028]
2025-09-30T14:55:28.621439Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:28.621448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:28.621450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:28.621453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:28.621453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:28.621466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:28.621469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:28.621479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895997457190162:6478], now have 1 active actors on pipe
2025-09-30T14:55:28.621483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895997457190102:2454], now have 1 active actors on pipe
2025-09-30T14:55:28.621520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895997367421159:5028]
2025-09-30T14:55:28.621531Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:28.621556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:28.621812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:28.621827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:28.621857Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16d5a03b-c668df32-2c26bd4c-b19ce22d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:28.621866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:28.621870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:28.621873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:28.621884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:28.621896Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:28.621917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:28.622179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:28.622187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:28.622202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:28.622706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97cf24a-130235e4-ecc035b0-8f5beeca_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|16d5a03b-c668df32-2c26bd4c-b19ce22d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:28.621608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1883
2025-09-30T14:55:28.621662Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1883
2025-09-30T14:55:28.622326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1884 partition: 0 MaxSeqNo: 42 sessionId: src_id|16d5a03b-c668df32-2c26bd4c-b19ce22d_0
2025-09-30T14:55:28.625529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16d5a03b-c668df32-2c26bd4c-b19ce22d_0] Write session: try to update token
2025-09-30T14:55:28.625548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16d5a03b-c668df32-2c26bd4c-b19ce22d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:28.636864Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:28.636890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:28.636893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:28.636897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:28.636906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895997367421159:5028]
2025-09-30T14:55:28.636910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895997367421159:5028]
2025-09-30T14:55:28.636915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895997367421159:5028]
2025-09-30T14:55:28.636950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:28.636958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.636961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:28.637100Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:28.639420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:28.639441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:28.639446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:28.650652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1884 sessionId: src_id|16d5a03b-c668df32-2c26bd4c-b19ce22d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:28.653649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:28.661177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895997457190331:7118]
2025-09-30T14:55:28.661419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1883, pipe: [1:7555895997457190331:7118]
2025-09-30T14:55:28.755184Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:28.756098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:28.756116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:28.756150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895997457190331:7118], now have 1 active actors on pipe
2025-09-30T14:55:28.756637Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:28.756919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16d5a03b-c668df32-2c26bd4c-b19ce22d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:28.756932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16d5a03b-c668df32-2c26bd4c-b19ce22d_0] Write session will restart in 0.009453s
2025-09-30T14:55:28.756958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16d5a03b-c668df32-2c26bd4c-b19ce22d_0] Write session: Do CDS request
2025-09-30T14:55:28.756964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16d5a03b-c668df32-2c26bd4c-b19ce22d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:28.756483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:28.756498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:28.756558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1884 reason: error at write: Disconnected sessionId: src_id|16d5a03b-c668df32-2c26bd4c-b19ce22d_0
2025-09-30T14:55:28.756755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1884 sessionId: src_id|16d5a03b-c668df32-2c26bd4c-b19ce22d_0 is DEAD
2025-09-30T14:55:28.756931Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:28.756974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895997457190331:7118]
2025-09-30T14:55:28.767746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16d5a03b-c668df32-2c26bd4c-b19ce22d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:28.767884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:28.767904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1885
2025-09-30T14:55:28.768116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1885 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:28.768154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1885 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:28.768164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1885 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:28.768169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:28.768633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1885 sessionId:  describe result for acl check
2025-09-30T14:55:28.768671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:28.768673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:28.768675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:28.768681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895997457190370:6467] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:28.769293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895997457190370:6467] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:28.771800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895997457190370:6467] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:28.778508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895997457190370:6467] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:28.778531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895997457190370:6467] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:28.778535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895997457190370:6467] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:28.778544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1885 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:28.784699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:28.787476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:28.787745Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:28.787766Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:28.787777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:28.787844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:28.787883Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895997367421396:5025]
2025-09-30T14:55:28.788544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:28.789926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:28.789990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:28.790379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:28.790444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:28.790451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:28.790452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:28.790454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:28.790455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:28.790456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:28.790458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:28.790460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:28.790461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:28.790462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:28.790463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.790464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.790465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.790467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:28.790468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:28.790475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:28.790487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:28.790492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:28.790497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:28.790501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:28.790506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:28.790511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:28.790515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:28.790520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:28.790525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:28.790529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.790534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.790538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.790542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:28.790547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:28.790557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:28.790566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:28.790573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:28.790579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:28.790584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:28.790590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:28.790595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:28.790600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:28.790604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:28.790610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:28.790614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:28.790626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:28.790632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:28.790638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:28.790643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:28.790649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:28.790662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:28.790668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:28.790673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:28.790678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:28.790683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.790689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.790693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.790699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.790704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.790710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.790715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:28.790720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:28.790726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:28.790731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:28.790780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:28.796552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:28.797886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:28.797903Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:28.797906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:28.797910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:28.797916Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1884 [2:7555895997367421396:5025]
2025-09-30T14:55:28.797934Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:28.797951Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:28.797958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:28.797961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:28.797964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:28.797980Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:28.797990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:28.798001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:28.798066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.798072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.798074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.798078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:28.798081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:28.798155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:28.798162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.798176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.798190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.798213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:28.798237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895997457190346:2454], now have 1 active actors on pipe
2025-09-30T14:55:28.798245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895997457190508:6467], now have 1 active actors on pipe
2025-09-30T14:55:28.798252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895997367421390:5025]
2025-09-30T14:55:28.798258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895997367421390:5025]
2025-09-30T14:55:28.798261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895997367421390:5025]
2025-09-30T14:55:28.798274Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:28.798292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:28.798294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:28.798305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:28.798308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:28.798309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:28.798312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:28.798348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895997367421390:5025]
2025-09-30T14:55:28.798356Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:28.798359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:28.798317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1884
2025-09-30T14:55:28.798383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:28.798392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:28.798425Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a50023b9-8fc17e01-4fdb8c8a-e8596b10_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:28.798436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:28.798444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:28.798447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:28.798430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1884
2025-09-30T14:55:28.798459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:28.798471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:28.798502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:28.798690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:28.798701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:28.798714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:28.798797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1885 partition: 0 MaxSeqNo: 42 sessionId: src_id|a50023b9-8fc17e01-4fdb8c8a-e8596b10_0
2025-09-30T14:55:28.799152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16d5a03b-c668df32-2c26bd4c-b19ce22d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a50023b9-8fc17e01-4fdb8c8a-e8596b10_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:28.802065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a50023b9-8fc17e01-4fdb8c8a-e8596b10_0] Write session: try to update token
2025-09-30T14:55:28.802087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a50023b9-8fc17e01-4fdb8c8a-e8596b10_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:28.811346Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:28.811372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:28.811375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:28.811377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:28.811387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895997367421390:5025]
2025-09-30T14:55:28.811392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895997367421390:5025]
2025-09-30T14:55:28.811398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895997367421390:5025]
2025-09-30T14:55:28.811441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:28.811449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.811448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:28.811452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:28.811455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:28.811460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:28.811590Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:28.818472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1885 sessionId: src_id|a50023b9-8fc17e01-4fdb8c8a-e8596b10_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:28.821467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:28.856768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555895997457190575:7118]
2025-09-30T14:55:28.863332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1884, pipe: [1:7555895997457190575:7118]
2025-09-30T14:55:28.934775Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:28.935342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:28.935358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:28.935399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895997457190575:7118], now have 1 active actors on pipe
2025-09-30T14:55:28.935624Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:28.935675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555895997457190575:7118]
2025-09-30T14:55:28.935717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:28.935720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:28.935786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1885 reason: error at write: Disconnected sessionId: src_id|a50023b9-8fc17e01-4fdb8c8a-e8596b10_0
2025-09-30T14:55:28.935937Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:28.935986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1885 sessionId: src_id|a50023b9-8fc17e01-4fdb8c8a-e8596b10_0 is DEAD
2025-09-30T14:55:28.936106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a50023b9-8fc17e01-4fdb8c8a-e8596b10_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:28.936117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a50023b9-8fc17e01-4fdb8c8a-e8596b10_0] Write session will restart in 0.007206s
2025-09-30T14:55:28.936142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a50023b9-8fc17e01-4fdb8c8a-e8596b10_0] Write session: Do CDS request
2025-09-30T14:55:28.936149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a50023b9-8fc17e01-4fdb8c8a-e8596b10_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:28.944804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a50023b9-8fc17e01-4fdb8c8a-e8596b10_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:28.944918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:28.944939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1886
2025-09-30T14:55:28.945117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1886 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:28.945152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1886 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:28.945162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1886 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:28.945166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:28.945649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1886 sessionId:  describe result for acl check
2025-09-30T14:55:28.945693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:28.945700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:28.945703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:28.945709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555895997457190612:6461] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:28.946304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555895997457190612:6461] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:28.949608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555895997457190612:6461] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:28.953875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555895997457190612:6461] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:28.953895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555895997457190612:6461] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:28.953898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555895997457190612:6461] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:28.953907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1886 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:28.955497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:28.958388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:28.958657Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:28.958671Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:28.958684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:28.958745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:28.958794Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555895997367421618:5023]
2025-09-30T14:55:28.959512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:28.959852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:28.959906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:28.960280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:28.960364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:28.960372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:28.960374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:28.960375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:28.960377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:28.960379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:28.960380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:28.960382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:28.960383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:28.960385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:28.960386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.960387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.960388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.960390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:28.960391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:28.960397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:28.960408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:28.960413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:28.960417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:28.960421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:28.960426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:28.960430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:28.960434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:28.960437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:28.960442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:28.960446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.960450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.960454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.960458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:28.960462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:28.960471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:28.960479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:28.960485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:28.960491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:28.960496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:28.960502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:28.960507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:28.960514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:28.960519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:28.960524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:28.960532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:28.960538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:28.960544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:28.960549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:28.960554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:28.960560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:28.960565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:28.960569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:28.960573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:28.960579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:28.960584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.960590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.960595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.960602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.960607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.960620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.960625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:28.960631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:28.960636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:28.960642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:28.960696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:28.966789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:28.967879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:28.967895Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:28.967897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:28.967901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:28.967907Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1885 [2:7555895997367421618:5023]
2025-09-30T14:55:28.967922Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:28.967936Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:28.967938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:28.967940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:28.967941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:28.967955Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:28.967961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:28.967967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:28.968024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.968031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.968033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.968036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:28.968038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:28.968113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:28.968122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.968135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:28.968147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:28.968167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:28.968193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895997457190576:2454], now have 1 active actors on pipe
2025-09-30T14:55:28.968202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555895997457190792:6461], now have 1 active actors on pipe
2025-09-30T14:55:28.968209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555895997367421613:5023]
2025-09-30T14:55:28.968212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555895997367421613:5023]
2025-09-30T14:55:28.968214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555895997367421613:5023]
2025-09-30T14:55:28.968230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:28.968248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:28.968266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:28.968266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:28.968271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:28.968273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:28.968274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:28.968315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555895997367421613:5023]
2025-09-30T14:55:28.968325Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:28.968329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:28.968295Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1885
2025-09-30T14:55:28.968389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1885
2025-09-30T14:55:28.968516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:28.968528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:28.968550Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|789899bd-6e49c7d2-f2e20097-d6835f2e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:28.968559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:28.968563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:28.968566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:28.968577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:28.968592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:28.968916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:28.969092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:28.969101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:28.969115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:28.969192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1886 partition: 0 MaxSeqNo: 42 sessionId: src_id|789899bd-6e49c7d2-f2e20097-d6835f2e_0
2025-09-30T14:55:28.969563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a50023b9-8fc17e01-4fdb8c8a-e8596b10_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|789899bd-6e49c7d2-f2e20097-d6835f2e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:28.972602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|789899bd-6e49c7d2-f2e20097-d6835f2e_0] Write session: try to update token
2025-09-30T14:55:28.972625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|789899bd-6e49c7d2-f2e20097-d6835f2e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:28.981055Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:28.981081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:28.981084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:28.981086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:28.981096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555895997367421613:5023]
2025-09-30T14:55:28.981106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555895997367421613:5023]
2025-09-30T14:55:28.981111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555895997367421613:5023]
2025-09-30T14:55:28.981154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:28.981160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:28.981162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:28.981166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:28.981168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:28.981171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:28.981318Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:28.988217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1886 sessionId: src_id|789899bd-6e49c7d2-f2e20097-d6835f2e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:28.991087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:29.035949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896001752158116:7118]
2025-09-30T14:55:29.036195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1885, pipe: [1:7555896001752158116:7118]
2025-09-30T14:55:29.095852Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:29.096377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:29.096397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:29.096435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896001752158116:7118], now have 1 active actors on pipe
2025-09-30T14:55:29.096737Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:29.097187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|789899bd-6e49c7d2-f2e20097-d6835f2e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:29.097196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|789899bd-6e49c7d2-f2e20097-d6835f2e_0] Write session will restart in 0.007367s
2025-09-30T14:55:29.097220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|789899bd-6e49c7d2-f2e20097-d6835f2e_0] Write session: Do CDS request
2025-09-30T14:55:29.097236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|789899bd-6e49c7d2-f2e20097-d6835f2e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:29.096752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896001752158116:7118]
2025-09-30T14:55:29.096787Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:29.096791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:29.096868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1886 reason: status is not ok: tablet will be restarted right now sessionId: src_id|789899bd-6e49c7d2-f2e20097-d6835f2e_0
2025-09-30T14:55:29.097031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1886 sessionId: src_id|789899bd-6e49c7d2-f2e20097-d6835f2e_0 is DEAD
2025-09-30T14:55:29.105798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|789899bd-6e49c7d2-f2e20097-d6835f2e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:29.105940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:29.105972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1887
2025-09-30T14:55:29.106153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1887 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:29.106192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1887 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:29.106204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1887 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:29.106209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:29.106980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1887 sessionId:  describe result for acl check
2025-09-30T14:55:29.107020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:29.107028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:29.107030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:29.107037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896001752158179:6449] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:29.107670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896001752158179:6449] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:29.111736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896001752158179:6449] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:29.115876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:29.116043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896001752158179:6449] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:29.116063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896001752158179:6449] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:29.116066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896001752158179:6449] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:29.116075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1887 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:29.118851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:29.119079Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:29.119092Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:29.119105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:29.119171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:29.119216Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896001662389172:5001]
2025-09-30T14:55:29.119911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:29.120253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:29.120320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:29.120672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:29.120741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:29.120747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:29.120748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:29.120750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:29.120751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:29.120752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:29.120753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:29.120755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:29.120756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:29.120758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:29.120759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.120760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:29.120761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:29.120763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:29.120764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:29.120769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:29.120781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:29.120785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:29.120790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:29.120794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:29.120798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:29.120802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:29.120806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:29.120810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:29.120815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:29.120819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.120823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:29.120827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:29.120831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:29.120835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:29.120843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:29.120852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:29.120858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:29.120863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:29.120869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:29.120874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:29.120880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:29.120885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:29.120891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:29.120896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:29.120900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:29.120906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:29.120911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:29.120917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:29.120922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:29.120927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:29.120932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:29.120942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:29.120946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:29.120956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:29.120962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.120967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.120971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:29.120975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:29.120980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:29.120984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:29.120988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:29.120993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:29.120998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:29.121003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:29.121042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:29.127052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:29.128187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:29.128208Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:29.128211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:29.128215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:29.128222Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1886 [2:7555896001662389172:5001]
2025-09-30T14:55:29.128241Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:29.128260Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:29.128268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:29.128271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:29.128274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:29.128292Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:29.128300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:29.128308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:29.128375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.128384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:29.128386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:29.128390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:29.128393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:29.128462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:29.128470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.128484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:29.128500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:29.128515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:29.128534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896001752158343:6449], now have 1 active actors on pipe
2025-09-30T14:55:29.128544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896001752158129:2454], now have 1 active actors on pipe
2025-09-30T14:55:29.128551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896001662389166:5001]
2025-09-30T14:55:29.128553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896001662389166:5001]
2025-09-30T14:55:29.128556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896001662389166:5001]
2025-09-30T14:55:29.128570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:29.128584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:29.128591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:29.128595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:29.128597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:29.128599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:29.128602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:29.128641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896001662389166:5001]
2025-09-30T14:55:29.128650Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:29.128690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:29.128820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:29.128833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:29.128862Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1a6166f-f19719a0-156a8994-c9d49823_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:29.128876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:29.128887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:29.128889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:29.128903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:29.128918Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:29.128941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:29.129342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:29.129354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:29.129374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:29.130031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|789899bd-6e49c7d2-f2e20097-d6835f2e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a1a6166f-f19719a0-156a8994-c9d49823_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:29.128684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1886
2025-09-30T14:55:29.128725Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1886
2025-09-30T14:55:29.129562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1887 partition: 0 MaxSeqNo: 42 sessionId: src_id|a1a6166f-f19719a0-156a8994-c9d49823_0
2025-09-30T14:55:29.133145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1a6166f-f19719a0-156a8994-c9d49823_0] Write session: try to update token
2025-09-30T14:55:29.133167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1a6166f-f19719a0-156a8994-c9d49823_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:29.142247Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:29.142273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:29.142283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896001662389166:5001]
2025-09-30T14:55:29.142328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:29.142332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:29.142506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:29.142659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:29.142814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:29.142965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:29.143176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:29.143221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:29.149886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1887 sessionId: src_id|a1a6166f-f19719a0-156a8994-c9d49823_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:29.152713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:29.153914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:29.153942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:29.153962Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:29.153965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:29.153967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:29.153969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:29.153978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896001662389166:5001]
2025-09-30T14:55:29.153981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896001662389166:5001]
2025-09-30T14:55:29.153986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896001662389166:5001]
2025-09-30T14:55:29.154033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:29.154033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:29.154038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:29.154045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.154045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:29.154048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:29.154189Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:29.196716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896001752158362:7118]
2025-09-30T14:55:29.196985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1886, pipe: [1:7555896001752158362:7118]
2025-09-30T14:55:29.270797Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:29.271158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:29.271194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896001752158362:7118], now have 1 active actors on pipe
2025-09-30T14:55:29.271324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:29.271431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:29.271485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896001752158362:7118]
2025-09-30T14:55:29.284113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:29.284130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:29.284160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1887 reason: error at write: Disconnected sessionId: src_id|a1a6166f-f19719a0-156a8994-c9d49823_0
2025-09-30T14:55:29.284307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1887 sessionId: src_id|a1a6166f-f19719a0-156a8994-c9d49823_0 is DEAD
2025-09-30T14:55:29.284483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1a6166f-f19719a0-156a8994-c9d49823_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:29.284496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1a6166f-f19719a0-156a8994-c9d49823_0] Write session will restart in 0.005738s
2025-09-30T14:55:29.284521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1a6166f-f19719a0-156a8994-c9d49823_0] Write session: Do CDS request
2025-09-30T14:55:29.284527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1a6166f-f19719a0-156a8994-c9d49823_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:29.291833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1a6166f-f19719a0-156a8994-c9d49823_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:29.291980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:29.292292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1888
2025-09-30T14:55:29.292433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1888 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:29.292469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1888 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:29.292474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1888 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:29.292479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:29.293037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1888 sessionId:  describe result for acl check
2025-09-30T14:55:29.293084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:29.293092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:29.293094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:29.293099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896001752158383:6441] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:29.293696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896001752158383:6441] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:29.297018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896001752158383:6441] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:29.301815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896001752158383:6441] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:29.301835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896001752158383:6441] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:29.301838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896001752158383:6441] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:29.301848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1888 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:29.304854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:29.307829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:29.308337Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:29.308352Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:29.308378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:29.308465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:29.308513Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896001662389395:4998]
2025-09-30T14:55:29.309212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:29.310436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:29.310520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:29.310886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:29.310953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:29.310963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:29.310965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:29.310966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:29.310967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:29.310969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:29.310970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:29.310972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:29.310973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:29.310974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:29.310976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.310977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:29.310978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:29.310979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:29.310980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:29.310986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:29.310996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:29.311001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:29.311005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:29.311009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:29.311013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:29.311017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:29.311021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:29.311025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:29.311029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:29.311033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.311036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:29.311040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:29.311044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:29.311048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:29.311055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:29.311063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:29.311070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:29.311076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:29.311081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:29.311087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:29.311094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:29.311099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:29.311104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:29.311109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:29.311113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:29.311119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:29.311124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:29.311130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:29.311134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:29.311139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:29.311143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:29.311148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:29.311153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:29.311158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:29.311163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.311168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.311172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:29.311177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:29.311187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:29.311192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:29.311196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:29.311201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:29.311206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:29.311211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:29.311281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:29.319363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:29.320266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:29.320282Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:29.320285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:29.320290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:29.320296Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1887 [2:7555896001662389395:4998]
2025-09-30T14:55:29.320314Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:29.320332Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:29.320335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:29.320339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:29.320341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:29.320357Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:29.320364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:29.320370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:29.320433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.320444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:29.320446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:29.320450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:29.320453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:29.320526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:29.320534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.320546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:29.320561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:29.320578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:29.320598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896001752158566:6441], now have 1 active actors on pipe
2025-09-30T14:55:29.320606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896001752158367:2454], now have 1 active actors on pipe
2025-09-30T14:55:29.320613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896001662389390:4998]
2025-09-30T14:55:29.320617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896001662389390:4998]
2025-09-30T14:55:29.320620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896001662389390:4998]
2025-09-30T14:55:29.320633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:29.320647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:29.320649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:29.320653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:29.320657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:29.320661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:29.320664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:29.320701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896001662389390:4998]
2025-09-30T14:55:29.320711Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:29.320719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:29.320694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1887
2025-09-30T14:55:29.320740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1887
2025-09-30T14:55:29.320906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:29.320917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:29.320944Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|790627c3-b7c709f3-6b7d97d4-7053f7f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:29.320957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:29.320961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:29.320964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:29.320974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:29.320985Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:29.321003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:29.321188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:29.321199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:29.321212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:29.321341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1888 partition: 0 MaxSeqNo: 42 sessionId: src_id|790627c3-b7c709f3-6b7d97d4-7053f7f4_0
2025-09-30T14:55:29.321763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1a6166f-f19719a0-156a8994-c9d49823_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|790627c3-b7c709f3-6b7d97d4-7053f7f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:29.324669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|790627c3-b7c709f3-6b7d97d4-7053f7f4_0] Write session: try to update token
2025-09-30T14:55:29.324697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|790627c3-b7c709f3-6b7d97d4-7053f7f4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:29.333788Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:29.333807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:29.333817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896001662389390:4998]
2025-09-30T14:55:29.333862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:29.333865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:29.334041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:29.334178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:29.334318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:29.334457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:29.334638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:29.334664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:29.347036Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:29.347057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:29.347059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:29.347062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:29.347072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896001662389390:4998]
2025-09-30T14:55:29.347076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896001662389390:4998]
2025-09-30T14:55:29.347080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896001662389390:4998]
2025-09-30T14:55:29.347121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:29.347129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.347132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:29.347142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:29.347150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:29.347154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:29.347290Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:29.361619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1888 sessionId: src_id|790627c3-b7c709f3-6b7d97d4-7053f7f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:29.364563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:29.371870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896001752158599:7118]
2025-09-30T14:55:29.372704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1887, pipe: [1:7555896001752158599:7118]
2025-09-30T14:55:29.467708Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:29.468264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:29.468273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:29.468293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896001752158599:7118], now have 1 active actors on pipe
2025-09-30T14:55:29.468559Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:29.468596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896001752158599:7118]
2025-09-30T14:55:29.468633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:29.468633Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:29.468635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:29.468709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1888 reason: error at write: Disconnected sessionId: src_id|790627c3-b7c709f3-6b7d97d4-7053f7f4_0
2025-09-30T14:55:29.468872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1888 sessionId: src_id|790627c3-b7c709f3-6b7d97d4-7053f7f4_0 is DEAD
2025-09-30T14:55:29.471339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|790627c3-b7c709f3-6b7d97d4-7053f7f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:29.471352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|790627c3-b7c709f3-6b7d97d4-7053f7f4_0] Write session will restart in 0.007756s
2025-09-30T14:55:29.471377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|790627c3-b7c709f3-6b7d97d4-7053f7f4_0] Write session: Do CDS request
2025-09-30T14:55:29.471386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|790627c3-b7c709f3-6b7d97d4-7053f7f4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:29.480875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|790627c3-b7c709f3-6b7d97d4-7053f7f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:29.480938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:29.480957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1889
2025-09-30T14:55:29.481106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1889 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:29.481149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1889 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:29.481159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1889 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:29.481164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:29.481601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1889 sessionId:  describe result for acl check
2025-09-30T14:55:29.481638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:29.481646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:29.481648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:29.481653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896001752158693:6435] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:29.482208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896001752158693:6435] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:29.484658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896001752158693:6435] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:29.487240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:29.487770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896001752158693:6435] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:29.487786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896001752158693:6435] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:29.487789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896001752158693:6435] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:29.487798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1889 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:29.490197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:29.490525Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:29.490538Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:29.490549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:29.490617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:29.490665Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896001662389621:4995]
2025-09-30T14:55:29.491312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:29.491620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:29.491670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:29.491964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:29.492019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:29.492020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:29.492020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:29.492021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:29.492022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:29.492023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:29.492024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:29.492025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:29.492026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:29.492027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:29.492028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.492029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:29.492030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:29.492032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:29.492033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:29.492038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:29.492048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:29.492052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:29.492056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:29.492060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:29.492064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:29.492069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:29.492073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:29.492077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:29.492084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:29.492087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.492091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:29.492096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:29.492100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:29.492104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:29.492111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:29.492119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:29.492126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:29.492132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:29.492138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:29.492144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:29.492150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:29.492155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:29.492161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:29.492167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:29.492172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:29.492177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:29.492182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:29.492188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:29.492193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:29.492198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:29.492204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:29.492210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:29.492215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:29.492220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:29.492225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.492230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.492235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:29.492240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:29.492246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:29.492252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:29.492257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:29.492262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:29.492276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:29.492282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:29.492329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:29.498472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:29.499691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:29.499708Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:29.499711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:29.499715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:29.499725Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1888 [2:7555896001662389621:4995]
2025-09-30T14:55:29.499742Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:29.499760Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:29.499764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:29.499768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:29.499770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:29.499786Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:29.499791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:29.499797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:29.499849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.499857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:29.499859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:29.499863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:29.499866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:29.499935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:29.499942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.499955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:29.499965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:29.499985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:29.500007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896001752158822:6435], now have 1 active actors on pipe
2025-09-30T14:55:29.500018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896001662389615:4995]
2025-09-30T14:55:29.500026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896001662389615:4995]
2025-09-30T14:55:29.500029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896001662389615:4995]
2025-09-30T14:55:29.500042Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:29.500058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896001752158601:2454], now have 1 active actors on pipe
2025-09-30T14:55:29.500062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:29.500067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:29.500069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:29.500070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:29.500083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:29.500092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:29.500126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896001662389615:4995]
2025-09-30T14:55:29.500137Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:29.500144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:29.500120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1888
2025-09-30T14:55:29.500166Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1888
2025-09-30T14:55:29.500324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:29.500335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:29.500365Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44e88cae-29d1420a-d4f391b1-806cea66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:29.500378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:29.500384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:29.500386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:29.500396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:29.500413Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:29.500428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:29.500672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:29.500683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:29.500700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:29.500811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1889 partition: 0 MaxSeqNo: 42 sessionId: src_id|44e88cae-29d1420a-d4f391b1-806cea66_0
2025-09-30T14:55:29.501347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|790627c3-b7c709f3-6b7d97d4-7053f7f4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|44e88cae-29d1420a-d4f391b1-806cea66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:29.504101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44e88cae-29d1420a-d4f391b1-806cea66_0] Write session: try to update token
2025-09-30T14:55:29.504124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44e88cae-29d1420a-d4f391b1-806cea66_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:29.512981Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:29.513006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:29.513009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:29.513011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:29.513022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896001662389615:4995]
2025-09-30T14:55:29.513029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896001662389615:4995]
2025-09-30T14:55:29.513035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896001662389615:4995]
2025-09-30T14:55:29.513084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:29.513086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:29.513094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.513099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:29.513100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:29.513103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:29.513260Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:29.518235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1889 sessionId: src_id|44e88cae-29d1420a-d4f391b1-806cea66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:29.520938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:29.568989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896001752158834:7118]
2025-09-30T14:55:29.572578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1888, pipe: [1:7555896001752158834:7118]
2025-09-30T14:55:29.632305Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:29.632596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:29.632614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:29.632655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896001752158834:7118], now have 1 active actors on pipe
2025-09-30T14:55:29.632894Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:29.632912Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:29.632921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896001752158834:7118]
2025-09-30T14:55:29.632943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:29.632946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:29.633012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1889 reason: error at write: Disconnected sessionId: src_id|44e88cae-29d1420a-d4f391b1-806cea66_0
2025-09-30T14:55:29.633194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1889 sessionId: src_id|44e88cae-29d1420a-d4f391b1-806cea66_0 is DEAD
2025-09-30T14:55:29.633318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44e88cae-29d1420a-d4f391b1-806cea66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:29.633329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44e88cae-29d1420a-d4f391b1-806cea66_0] Write session will restart in 0.006243s
2025-09-30T14:55:29.633353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44e88cae-29d1420a-d4f391b1-806cea66_0] Write session: Do CDS request
2025-09-30T14:55:29.633361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44e88cae-29d1420a-d4f391b1-806cea66_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:29.640787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44e88cae-29d1420a-d4f391b1-806cea66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:29.640862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:29.640882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1890
2025-09-30T14:55:29.641028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1890 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:29.641070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1890 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:29.641089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1890 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:29.641095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:29.641508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1890 sessionId:  describe result for acl check
2025-09-30T14:55:29.641541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:29.641549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:29.641552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:29.641557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896001752158852:6427] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:29.642103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896001752158852:6427] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:29.644932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896001752158852:6427] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:29.648337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896001752158852:6427] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:29.648356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896001752158852:6427] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:29.648360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896001752158852:6427] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:29.648369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1890 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:29.655413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:29.658558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:29.658861Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:29.658885Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:29.658898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:29.658963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:29.659008Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896001662389858:4993]
2025-09-30T14:55:29.659631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:29.659998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:29.660049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:29.660380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:29.660448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:29.660455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:29.660456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:29.660457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:29.660459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:29.660460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:29.660462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:29.660463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:29.660464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:29.660466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:29.660467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.660468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:29.660469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:29.660471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:29.660472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:29.660478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:29.660490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:29.660494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:29.660499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:29.660503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:29.660507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:29.660512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:29.660516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:29.660521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:29.660526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:29.660530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.660534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:29.660541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:29.660545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:29.660549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:29.660557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:29.660565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:29.660571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:29.660577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:29.660581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:29.660586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:29.660591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:29.660597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:29.660602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:29.660608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:29.660614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:29.660621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:29.660626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:29.660632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:29.660637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:29.660643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:29.660649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:29.660655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:29.660666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:29.660672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:29.660679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.660685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.660690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:29.660695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:29.660701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:29.660711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:29.660716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:29.660721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:29.660725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:29.660731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:29.660781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:29.666608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:29.667829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:29.667845Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:29.667848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:29.667852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:29.667859Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1889 [2:7555896001662389858:4993]
2025-09-30T14:55:29.667876Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:29.667893Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:29.667896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:29.667899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:29.667901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:29.667918Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:29.667925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:29.667933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:29.667994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.668003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:29.668005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:29.668009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:29.668011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:29.668088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:29.668098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.668110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:29.668122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:29.668137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:29.668158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896001752158971:6427], now have 1 active actors on pipe
2025-09-30T14:55:29.668162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896001752158837:2454], now have 1 active actors on pipe
2025-09-30T14:55:29.668168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896001662389853:4993]
2025-09-30T14:55:29.668171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896001662389853:4993]
2025-09-30T14:55:29.668173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896001662389853:4993]
2025-09-30T14:55:29.668185Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:29.668201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:29.668217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:29.668229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:29.668261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:29.668264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:29.668267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:29.668273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896001662389853:4993]
2025-09-30T14:55:29.668277Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:29.668298Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1889
2025-09-30T14:55:29.668279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:29.668353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1889
2025-09-30T14:55:29.668446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:29.668460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:29.668490Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b775ea96-77335608-97ee4ee3-70f1fab7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:29.668503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:29.668511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:29.668514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:29.668525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:29.668543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:29.668563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:29.668767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:29.668775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:29.668788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:29.668882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1890 partition: 0 MaxSeqNo: 42 sessionId: src_id|b775ea96-77335608-97ee4ee3-70f1fab7_0
2025-09-30T14:55:29.669269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44e88cae-29d1420a-d4f391b1-806cea66_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b775ea96-77335608-97ee4ee3-70f1fab7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:29.673155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b775ea96-77335608-97ee4ee3-70f1fab7_0] Write session: try to update token
2025-09-30T14:55:29.673180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b775ea96-77335608-97ee4ee3-70f1fab7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:29.680963Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:29.680988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:29.680998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896001662389853:4993]
2025-09-30T14:55:29.681052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:29.681069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:29.681243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:29.681406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:29.681564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:29.681729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:29.681939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:29.681984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:29.691257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1890 sessionId: src_id|b775ea96-77335608-97ee4ee3-70f1fab7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:29.692628Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:29.692653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:29.692656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:29.692659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:29.692670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896001662389853:4993]
2025-09-30T14:55:29.692675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896001662389853:4993]
2025-09-30T14:55:29.692679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896001662389853:4993]
2025-09-30T14:55:29.692728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:29.692729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:29.692736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:29.692737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.692740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:29.692740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:29.692897Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:29.694247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:29.731803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896001752159071:7118]
2025-09-30T14:55:29.732111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1889, pipe: [1:7555896001752159071:7118]
2025-09-30T14:55:29.810652Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:29.811226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:29.811260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:29.811296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896001752159071:7118], now have 1 active actors on pipe
2025-09-30T14:55:29.811541Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:29.811602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:29.811659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:29.811741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1890 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b775ea96-77335608-97ee4ee3-70f1fab7_0
2025-09-30T14:55:29.812112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b775ea96-77335608-97ee4ee3-70f1fab7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:29.812121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b775ea96-77335608-97ee4ee3-70f1fab7_0] Write session will restart in 0.006255s
2025-09-30T14:55:29.812146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b775ea96-77335608-97ee4ee3-70f1fab7_0] Write session: Do CDS request
2025-09-30T14:55:29.812153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b775ea96-77335608-97ee4ee3-70f1fab7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:29.811948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1890 sessionId: src_id|b775ea96-77335608-97ee4ee3-70f1fab7_0 is DEAD
2025-09-30T14:55:29.812145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896001752159071:7118]
2025-09-30T14:55:29.819765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b775ea96-77335608-97ee4ee3-70f1fab7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:29.819893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:29.819912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1891
2025-09-30T14:55:29.820023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1891 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:29.820058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1891 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:29.820069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1891 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:29.820072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:29.820501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1891 sessionId:  describe result for acl check
2025-09-30T14:55:29.820534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:29.820536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:29.820538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:29.820543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896001752159100:6418] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:29.821108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896001752159100:6418] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:29.825043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896001752159100:6418] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:29.829008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896001752159100:6418] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:29.829027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896001752159100:6418] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:29.829030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896001752159100:6418] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:29.829039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1891 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:29.833423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:29.836095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:29.836342Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:29.836355Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:29.836368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:29.836448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:29.836586Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896001662390087:4986]
2025-09-30T14:55:29.837196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:29.837549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:29.837611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:29.837959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:29.838033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:29.838040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:29.838041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:29.838042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:29.838044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:29.838045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:29.838046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:29.838048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:29.838049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:29.838051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:29.838052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.838053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:29.838054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:29.838056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:29.838057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:29.838063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:29.838075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:29.838079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:29.838084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:29.838088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:29.838092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:29.838097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:29.838101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:29.838105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:29.838110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:29.838114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.838119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:29.838123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:29.838141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:29.838145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:29.838153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:29.838168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:29.838173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:29.838179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:29.838183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:29.838188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:29.838193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:29.838198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:29.838203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:29.838209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:29.838213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:29.838218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:29.838233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:29.838239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:29.838243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:29.838248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:29.838254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:29.838260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:29.838265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:29.838271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:29.838277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.838284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.838288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:29.838294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:29.838304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:29.838309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:29.838315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:29.838321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:29.838330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:29.838340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:29.838383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:29.844141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:29.845470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:29.845485Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:29.845489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:29.845493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:29.845502Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1890 [2:7555896001662390087:4986]
2025-09-30T14:55:29.845520Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:29.845537Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:29.845540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:29.845544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:29.845547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:29.845564Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:29.845586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:29.845600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:29.845668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.845676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:29.845679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:29.845683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:29.845686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:29.845757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:29.845770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.845785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:29.845799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:29.845819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:29.845838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896001752159248:6418], now have 1 active actors on pipe
2025-09-30T14:55:29.845850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896001752159085:2454], now have 1 active actors on pipe
2025-09-30T14:55:29.845857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896001662390081:4986]
2025-09-30T14:55:29.845859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896001662390081:4986]
2025-09-30T14:55:29.845862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896001662390081:4986]
2025-09-30T14:55:29.845875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:29.845890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:29.845897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:29.845901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:29.845903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:29.845907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:29.845910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:29.845945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896001662390081:4986]
2025-09-30T14:55:29.845954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:29.845964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:29.846101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1890
2025-09-30T14:55:29.846140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1890
2025-09-30T14:55:29.846179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:29.846190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:29.846219Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52cf1b7-7fb38faa-7d0cc3ba-d73c731_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:29.846231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:29.846236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:29.846244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:29.846255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:29.846270Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:29.846292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:29.846538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:29.846561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:29.846586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:29.846682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1891 partition: 0 MaxSeqNo: 42 sessionId: src_id|52cf1b7-7fb38faa-7d0cc3ba-d73c731_0
2025-09-30T14:55:29.847057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b775ea96-77335608-97ee4ee3-70f1fab7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|52cf1b7-7fb38faa-7d0cc3ba-d73c731_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:29.849970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52cf1b7-7fb38faa-7d0cc3ba-d73c731_0] Write session: try to update token
2025-09-30T14:55:29.849991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52cf1b7-7fb38faa-7d0cc3ba-d73c731_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:29.858879Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:29.858903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:29.858905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:29.858907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:29.858919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896001662390081:4986]
2025-09-30T14:55:29.858924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896001662390081:4986]
2025-09-30T14:55:29.858928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896001662390081:4986]
2025-09-30T14:55:29.858968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:29.858974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:29.858977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:29.858978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:29.858986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:29.858990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:29.859123Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:29.873735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1891 sessionId: src_id|52cf1b7-7fb38faa-7d0cc3ba-d73c731_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:29.876804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:29.912003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896001752159319:7118]
2025-09-30T14:55:29.912274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1890, pipe: [1:7555896001752159319:7118]
2025-09-30T14:55:29.981050Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:29.981657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:29.981674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:29.981695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896001752159319:7118], now have 1 active actors on pipe
2025-09-30T14:55:29.982009Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:29.983322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:29.983382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896001752159319:7118]
2025-09-30T14:55:29.983413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1891 reason: status is not ok: tablet will be restarted right now sessionId: src_id|52cf1b7-7fb38faa-7d0cc3ba-d73c731_0
2025-09-30T14:55:29.983418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:29.983576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1891 sessionId: src_id|52cf1b7-7fb38faa-7d0cc3ba-d73c731_0 is DEAD
2025-09-30T14:55:29.983746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52cf1b7-7fb38faa-7d0cc3ba-d73c731_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:29.983764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52cf1b7-7fb38faa-7d0cc3ba-d73c731_0] Write session will restart in 0.009534s
2025-09-30T14:55:29.983787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52cf1b7-7fb38faa-7d0cc3ba-d73c731_0] Write session: Do CDS request
2025-09-30T14:55:29.983793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52cf1b7-7fb38faa-7d0cc3ba-d73c731_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:29.994790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52cf1b7-7fb38faa-7d0cc3ba-d73c731_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:29.995319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:29.995340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1892
2025-09-30T14:55:29.995489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1892 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:29.995523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1892 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:29.995529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1892 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:29.995534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:29.996120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1892 sessionId:  describe result for acl check
2025-09-30T14:55:29.996161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:29.996169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:29.996172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:29.996179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896001752159385:6415] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:29.996755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896001752159385:6415] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:30.009378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896001752159385:6415] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:30.012735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:30.017043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:30.017277Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:30.017290Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:30.017302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:30.017361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:30.017403Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896005957357609:4987]
2025-09-30T14:55:30.018125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:30.018413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896001752159385:6415] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:30.018438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896001752159385:6415] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:30.018442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896001752159385:6415] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:30.018451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1892 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:30.019132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:30.019199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:30.019612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:30.019681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:30.019687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:30.019689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:30.019690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:30.019692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:30.019693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:30.019695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:30.019696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:30.019698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:30.019699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:30.019700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.019702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.019704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.019705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:30.019706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:30.019712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:30.019723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:30.019728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:30.019733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:30.019737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:30.019742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:30.019746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:30.019751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:30.019755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:30.019760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:30.019764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.019768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.019772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.019776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:30.019781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:30.019790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:30.019799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:30.019806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:30.019813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:30.019818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:30.019829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:30.019834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:30.019843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:30.019849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:30.019855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:30.019860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:30.019867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:30.019872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:30.019883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:30.019889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:30.019897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:30.019904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:30.019911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:30.019917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:30.019923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:30.019932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.019939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.019945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.019952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.019958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.019969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.019974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:30.019980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:30.019991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:30.019997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:30.020047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:30.025720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:30.027052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:30.027068Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:30.027071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:30.027075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:30.027082Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1891 [2:7555896005957357609:4987]
2025-09-30T14:55:30.027100Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:30.027114Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:30.027117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:30.027120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:30.027123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:30.027139Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:30.027152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:30.027159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:30.027221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.027228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.027230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.027234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:30.027237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:30.027320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:30.027329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.027344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.027358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.027383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:30.027404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896005957357603:4987]
2025-09-30T14:55:30.027412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896005957357603:4987]
2025-09-30T14:55:30.027414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896005957357603:4987]
2025-09-30T14:55:30.027428Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:30.027442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:30.027447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896006047126839:6415], now have 1 active actors on pipe
2025-09-30T14:55:30.027451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896001752159325:2454], now have 1 active actors on pipe
2025-09-30T14:55:30.027452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:30.027455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:30.027459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:30.027475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:30.027478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:30.027511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896005957357603:4987]
2025-09-30T14:55:30.027526Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:30.027568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:30.027553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1891
2025-09-30T14:55:30.027586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1891
2025-09-30T14:55:30.027753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:30.027767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:30.027810Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27c65ba4-7487d8a3-100af18f-3a2c0708_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:30.027827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:30.027837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:30.027840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:30.027851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:30.027868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:30.027892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:30.028105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:30.028115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:30.028135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:30.028280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1892 partition: 0 MaxSeqNo: 42 sessionId: src_id|27c65ba4-7487d8a3-100af18f-3a2c0708_0
2025-09-30T14:55:30.028681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52cf1b7-7fb38faa-7d0cc3ba-d73c731_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|27c65ba4-7487d8a3-100af18f-3a2c0708_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:30.031944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27c65ba4-7487d8a3-100af18f-3a2c0708_0] Write session: try to update token
2025-09-30T14:55:30.031989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27c65ba4-7487d8a3-100af18f-3a2c0708_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:30.040638Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:30.040659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:30.040668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896005957357603:4987]
2025-09-30T14:55:30.040715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:30.040724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:30.040891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:30.041039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:30.041193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:30.041343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:30.041547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:30.041614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:30.048731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1892 sessionId: src_id|27c65ba4-7487d8a3-100af18f-3a2c0708_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:30.051448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:30.051695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:30.051719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:30.051758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:30.051869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:30.054095Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:30.054111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:30.054115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:30.054117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:30.054128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896005957357603:4987]
2025-09-30T14:55:30.054133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896005957357603:4987]
2025-09-30T14:55:30.054137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896005957357603:4987]
2025-09-30T14:55:30.054178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:30.054191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.054189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:30.054198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:30.054198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:30.054203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:30.054347Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:30.083540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896006047126864:7118]
2025-09-30T14:55:30.083826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1891, pipe: [1:7555896006047126864:7118]
2025-09-30T14:55:30.170431Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:30.170881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896006047126864:7118], now have 1 active actors on pipe
2025-09-30T14:55:30.178953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:30.178981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:30.179163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:30.179235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:30.183397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:30.183478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:30.183719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:30.183735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:30.183825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:30.183890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:30.183956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:30.184676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:30.184726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:30.184730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:30.184815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:30.184887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:30.184960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:30.185075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:30.185128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:30.185131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:30.185215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:30.185287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:30.185358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:30.185430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:30.185622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:30.185625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:30.185701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:30.185762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:30.185826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:30.185893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:30.185940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:30.185943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:30.186015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:30.186079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:30.186147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:30.186211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:30.186258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:30.186261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:30.186333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:30.186399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:30.186466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:30.186536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:30.186583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:30.186586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:30.186954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:30.187025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:30.187090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:30.187155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:30.187203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:30.187206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:30.187306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:30.187369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:30.187435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:30.187507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:30.187556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:30.187559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:30.187633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:30.187699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:30.187764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:30.187831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:30.187877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:30.187880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:30.189539Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:30.190021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:30.190044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:30.190082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1892 reason: error at write: Disconnected sessionId: src_id|27c65ba4-7487d8a3-100af18f-3a2c0708_0
2025-09-30T14:55:30.190312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1892 sessionId: src_id|27c65ba4-7487d8a3-100af18f-3a2c0708_0 is DEAD
2025-09-30T14:55:30.190513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27c65ba4-7487d8a3-100af18f-3a2c0708_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:30.190525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27c65ba4-7487d8a3-100af18f-3a2c0708_0] Write session will restart in 0.009005s
2025-09-30T14:55:30.190551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27c65ba4-7487d8a3-100af18f-3a2c0708_0] Write session: Do CDS request
2025-09-30T14:55:30.190558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27c65ba4-7487d8a3-100af18f-3a2c0708_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:30.190543Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:30.190584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896006047126864:7118]
2025-09-30T14:55:30.203778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27c65ba4-7487d8a3-100af18f-3a2c0708_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:30.204222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:30.204243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1893
2025-09-30T14:55:30.204675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1893 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:30.204712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1893 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:30.204718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1893 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:30.204728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:30.205176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1893 sessionId:  describe result for acl check
2025-09-30T14:55:30.205215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:30.205222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:30.205223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:30.205229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896006047126903:6393] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:30.205831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896006047126903:6393] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:30.209238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896006047126903:6393] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:30.213249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896006047126903:6393] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:30.213270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896006047126903:6393] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:30.213274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896006047126903:6393] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:30.213283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1893 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:30.234517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:30.239312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:30.239659Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:30.239664Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:30.239679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:30.239762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:30.239816Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896005957357874:4966]
2025-09-30T14:55:30.240644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:30.241536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:30.241643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:30.242083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:30.242163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:30.242165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:30.242167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:30.242169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:30.242170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:30.242173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:30.242174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:30.242177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:30.242178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:30.242181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:30.242182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.242184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.242185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.242188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:30.242190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:30.242199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:30.242213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:30.242218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:30.242224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:30.242229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:30.242234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:30.242239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:30.242244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:30.242248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:30.242253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:30.242258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.242263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.242268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.242273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:30.242278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:30.242289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:30.242299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:30.242307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:30.242314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:30.242322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:30.242329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:30.242335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:30.242343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:30.242350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:30.242356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:30.242363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:30.242369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:30.242376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:30.242383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:30.242388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:30.242395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:30.242402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:30.242409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:30.242417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:30.242424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:30.242430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.242437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.242441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.242448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.242454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.242460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.242465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:30.242471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:30.242479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:30.242486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:30.242546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:30.257757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:30.259372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:30.259385Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:30.259387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:30.259391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:30.259399Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1892 [2:7555896005957357874:4966]
2025-09-30T14:55:30.259415Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:30.259441Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:30.259444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:30.259448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:30.259451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:30.259477Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:30.259486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:30.259495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:30.259588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.259591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.259594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.259598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:30.259601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:30.259719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:30.259723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.259741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.259753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.259770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:30.259793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896005957357869:4966]
2025-09-30T14:55:30.259797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896005957357869:4966]
2025-09-30T14:55:30.259800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896005957357869:4966]
2025-09-30T14:55:30.259821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:30.259841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:30.259857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:30.259862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:30.259916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896005957357869:4966]
2025-09-30T14:55:30.259919Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:30.259925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:30.259928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:30.259931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:30.259935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896006047126956:6393], now have 1 active actors on pipe
2025-09-30T14:55:30.259937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:30.261166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896006047126884:2454], now have 1 active actors on pipe
2025-09-30T14:55:30.262125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1892
2025-09-30T14:55:30.262164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1892
2025-09-30T14:55:30.263164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:30.263188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:30.263229Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f223e9d-8318ba97-4f8e0c5d-bdc689d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:30.263241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:30.263262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:30.263266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:30.263281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:30.263315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:30.263337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:30.268502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:30.268540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:30.268587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:30.269615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1893 partition: 0 MaxSeqNo: 42 sessionId: src_id|9f223e9d-8318ba97-4f8e0c5d-bdc689d5_0
2025-09-30T14:55:30.271698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27c65ba4-7487d8a3-100af18f-3a2c0708_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9f223e9d-8318ba97-4f8e0c5d-bdc689d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:30.274676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f223e9d-8318ba97-4f8e0c5d-bdc689d5_0] Write session: try to update token
2025-09-30T14:55:30.274698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f223e9d-8318ba97-4f8e0c5d-bdc689d5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:30.276490Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:30.276514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:30.276517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:30.276520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:30.276532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896005957357869:4966]
2025-09-30T14:55:30.276537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896005957357869:4966]
2025-09-30T14:55:30.276542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896005957357869:4966]
2025-09-30T14:55:30.276593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:30.276602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.276605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:30.276764Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:30.278531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:30.278550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:30.278556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:30.289877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896006047127120:7118]
2025-09-30T14:55:30.290370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1892, pipe: [1:7555896006047127120:7118]
2025-09-30T14:55:30.293408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1893 sessionId: src_id|9f223e9d-8318ba97-4f8e0c5d-bdc689d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:30.296478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:30.391049Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:30.391650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896006047127120:7118], now have 1 active actors on pipe
2025-09-30T14:55:30.391686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:30.391693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:30.391900Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:30.391982Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:30.392010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:30.392032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896006047127120:7118]
2025-09-30T14:55:30.392101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1893 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9f223e9d-8318ba97-4f8e0c5d-bdc689d5_0
2025-09-30T14:55:30.392297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1893 sessionId: src_id|9f223e9d-8318ba97-4f8e0c5d-bdc689d5_0 is DEAD
2025-09-30T14:55:30.392433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f223e9d-8318ba97-4f8e0c5d-bdc689d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:30.392445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f223e9d-8318ba97-4f8e0c5d-bdc689d5_0] Write session will restart in 0.005504s
2025-09-30T14:55:30.392478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f223e9d-8318ba97-4f8e0c5d-bdc689d5_0] Write session: Do CDS request
2025-09-30T14:55:30.392484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f223e9d-8318ba97-4f8e0c5d-bdc689d5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:30.398777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f223e9d-8318ba97-4f8e0c5d-bdc689d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:30.398901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:30.398925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1894
2025-09-30T14:55:30.399076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1894 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:30.399115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1894 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:30.399126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1894 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:30.399130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:30.399576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1894 sessionId:  describe result for acl check
2025-09-30T14:55:30.399613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:30.399621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:30.399623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:30.399629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896006047127138:6387] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:30.400079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896006047127138:6387] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:30.403516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896006047127138:6387] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:30.413203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896006047127138:6387] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:30.413230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896006047127138:6387] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:30.413235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896006047127138:6387] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:30.413250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1894 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:30.418237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:30.423201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:30.423477Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:30.423490Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:30.423502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:30.423582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:30.423633Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896005957358106:4959]
2025-09-30T14:55:30.424363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:30.424889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:30.424948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:30.425346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:30.425415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:30.425422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:30.425424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:30.425425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:30.425427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:30.425428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:30.425430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:30.425432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:30.425434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:30.425435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:30.425437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.425439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.425440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.425441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:30.425443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:30.425449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:30.425461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:30.425466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:30.425472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:30.425476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:30.425481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:30.425485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:30.425490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:30.425495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:30.425513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:30.425518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.425521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.425525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.425528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:30.425532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:30.425540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:30.425548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:30.425554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:30.425560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:30.425586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:30.425593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:30.425602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:30.425608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:30.425615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:30.425621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:30.425626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:30.425631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:30.425637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:30.425642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:30.425647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:30.425652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:30.425657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:30.425663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:30.425669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:30.425675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:30.425681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.425688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.425693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.425698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.425703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.425710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.425718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:30.425724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:30.425736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:30.425742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:30.425794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:30.432140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:30.433203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:30.433219Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:30.433223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:30.433228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:30.433235Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1893 [2:7555896005957358106:4959]
2025-09-30T14:55:30.433253Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:30.433271Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:30.433282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:30.433286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:30.433288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:30.433308Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:30.433315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:30.433328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:30.433398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.433408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.433411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.433414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:30.433417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:30.433742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:30.433751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.433765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.433771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1893
2025-09-30T14:55:30.433776Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1893
2025-09-30T14:55:30.433780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.433805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:30.433821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896006047127346:6387], now have 1 active actors on pipe
2025-09-30T14:55:30.433825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896006047127123:2454], now have 1 active actors on pipe
2025-09-30T14:55:30.433831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896005957358101:4959]
2025-09-30T14:55:30.433833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896005957358101:4959]
2025-09-30T14:55:30.433835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896005957358101:4959]
2025-09-30T14:55:30.433843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:30.433860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:30.433863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:30.433868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:30.433871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:30.433874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:30.433878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:30.433901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:30.433906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:30.433966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896005957358101:4959]
2025-09-30T14:55:30.433978Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:30.433989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:30.433997Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4657d78a-fb12d2d6-c265494e-3ffbbfc9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:30.434004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:30.434010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:30.434012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:30.434024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:30.434034Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:30.434077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:30.434469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:30.434480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:30.434498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:30.435011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1894 partition: 0 MaxSeqNo: 42 sessionId: src_id|4657d78a-fb12d2d6-c265494e-3ffbbfc9_0
2025-09-30T14:55:30.435500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f223e9d-8318ba97-4f8e0c5d-bdc689d5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4657d78a-fb12d2d6-c265494e-3ffbbfc9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:30.438721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4657d78a-fb12d2d6-c265494e-3ffbbfc9_0] Write session: try to update token
2025-09-30T14:55:30.438749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4657d78a-fb12d2d6-c265494e-3ffbbfc9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:30.448033Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:30.448061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:30.448065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:30.448068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:30.448082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896005957358101:4959]
2025-09-30T14:55:30.448088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896005957358101:4959]
2025-09-30T14:55:30.448095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896005957358101:4959]
2025-09-30T14:55:30.448151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:30.448161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.448164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:30.448166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:30.448175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:30.448179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:30.448368Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:30.458856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1894 sessionId: src_id|4657d78a-fb12d2d6-c265494e-3ffbbfc9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:30.462454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:30.492125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896006047127360:7118]
2025-09-30T14:55:30.492513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1893, pipe: [1:7555896006047127360:7118]
2025-09-30T14:55:30.574917Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:30.575801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:30.575820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:30.575847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896006047127360:7118], now have 1 active actors on pipe
2025-09-30T14:55:30.576244Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:30.576294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:30.576311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:30.576317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:30.576381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896006047127360:7118]
2025-09-30T14:55:30.576419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1894 reason: error at write: Disconnected sessionId: src_id|4657d78a-fb12d2d6-c265494e-3ffbbfc9_0
2025-09-30T14:55:30.576650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1894 sessionId: src_id|4657d78a-fb12d2d6-c265494e-3ffbbfc9_0 is DEAD
2025-09-30T14:55:30.576861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4657d78a-fb12d2d6-c265494e-3ffbbfc9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:30.576872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4657d78a-fb12d2d6-c265494e-3ffbbfc9_0] Write session will restart in 0.007952s
2025-09-30T14:55:30.576904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4657d78a-fb12d2d6-c265494e-3ffbbfc9_0] Write session: Do CDS request
2025-09-30T14:55:30.576913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4657d78a-fb12d2d6-c265494e-3ffbbfc9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:30.585971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4657d78a-fb12d2d6-c265494e-3ffbbfc9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:30.586084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:30.586109Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1895
2025-09-30T14:55:30.586300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1895 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:30.586350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1895 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:30.586360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1895 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:30.586365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:30.586942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1895 sessionId:  describe result for acl check
2025-09-30T14:55:30.586989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:30.586998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:30.587001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:30.587012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896006047127378:6384] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:30.587775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896006047127378:6384] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:30.590112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896006047127378:6384] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:30.593483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896006047127378:6384] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:30.593503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896006047127378:6384] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:30.593508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896006047127378:6384] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:30.593518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1895 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:30.606957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:30.610290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:30.610688Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:30.610698Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:30.610711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:30.610795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:30.610842Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896005957358336:4960]
2025-09-30T14:55:30.611556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:30.612021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:30.612114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:30.612552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:30.612671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:30.612673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:30.612675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:30.612676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:30.612678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:30.612679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:30.612681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:30.612682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:30.612684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:30.612685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:30.612687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.612688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.612690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.612691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:30.612693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:30.612700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:30.612712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:30.612737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:30.612742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:30.612746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:30.612751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:30.612756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:30.612760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:30.612765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:30.612772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:30.612776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.612781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.612785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.612790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:30.612794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:30.612807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:30.612817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:30.612825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:30.612832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:30.612838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:30.612844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:30.612850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:30.612855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:30.612865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:30.612890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:30.612897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:30.612903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:30.612910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:30.612918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:30.612924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:30.612930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:30.612936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:30.612942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:30.612947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:30.612953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:30.612960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.612967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.612974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.612981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.612987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.612994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.613001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:30.613008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:30.613014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:30.613022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:30.613073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:30.619558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:30.620874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:30.620890Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:30.620894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:30.620899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:30.620906Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1894 [2:7555896005957358336:4960]
2025-09-30T14:55:30.620928Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:30.620948Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:30.620952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:30.620956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:30.620958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:30.620977Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:30.620990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:30.620998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:30.621078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.621085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.621087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.621090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:30.621093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:30.621169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:30.621177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.621191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.621201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.621217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:30.621238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896006047127413:6384], now have 1 active actors on pipe
2025-09-30T14:55:30.621241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896006047127363:2454], now have 1 active actors on pipe
2025-09-30T14:55:30.621248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896005957358331:4960]
2025-09-30T14:55:30.621251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896005957358331:4960]
2025-09-30T14:55:30.621253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896005957358331:4960]
2025-09-30T14:55:30.621266Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:30.621280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:30.621284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:30.621287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:30.621289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:30.621298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:30.621301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:30.621345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896005957358331:4960]
2025-09-30T14:55:30.621417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1894
2025-09-30T14:55:30.621422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1894
2025-09-30T14:55:30.621355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:30.621359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:30.621601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:30.621606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:30.621636Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|992cbea1-728ece8e-b7480db3-8dd90e3a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:30.621645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:30.621656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:30.621659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:30.621670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:30.621680Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:30.621702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:30.621922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:30.621928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:30.621944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:30.622057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1895 partition: 0 MaxSeqNo: 42 sessionId: src_id|992cbea1-728ece8e-b7480db3-8dd90e3a_0
2025-09-30T14:55:30.622610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4657d78a-fb12d2d6-c265494e-3ffbbfc9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|992cbea1-728ece8e-b7480db3-8dd90e3a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:30.626541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|992cbea1-728ece8e-b7480db3-8dd90e3a_0] Write session: try to update token
2025-09-30T14:55:30.626570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|992cbea1-728ece8e-b7480db3-8dd90e3a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:30.640189Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:30.640211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:30.640214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:30.640216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:30.640227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896005957358331:4960]
2025-09-30T14:55:30.640232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896005957358331:4960]
2025-09-30T14:55:30.640236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896005957358331:4960]
2025-09-30T14:55:30.640280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:30.640287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.640291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:30.640296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:30.640303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:30.640308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:30.640439Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:30.648115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1895 sessionId: src_id|992cbea1-728ece8e-b7480db3-8dd90e3a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:30.650925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:30.676418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896006047127603:7118]
2025-09-30T14:55:30.676714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1894, pipe: [1:7555896006047127603:7118]
2025-09-30T14:55:30.751820Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:30.752384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:30.752401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:30.752446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896006047127603:7118], now have 1 active actors on pipe
2025-09-30T14:55:30.752741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:30.752761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:30.752786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896006047127603:7118]
2025-09-30T14:55:30.752813Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:30.752851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1895 reason: error at write: Disconnected sessionId: src_id|992cbea1-728ece8e-b7480db3-8dd90e3a_0
2025-09-30T14:55:30.752715Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:30.753199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|992cbea1-728ece8e-b7480db3-8dd90e3a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:30.753211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|992cbea1-728ece8e-b7480db3-8dd90e3a_0] Write session will restart in 0.009965s
2025-09-30T14:55:30.753237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|992cbea1-728ece8e-b7480db3-8dd90e3a_0] Write session: Do CDS request
2025-09-30T14:55:30.753242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|992cbea1-728ece8e-b7480db3-8dd90e3a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:30.753039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1895 sessionId: src_id|992cbea1-728ece8e-b7480db3-8dd90e3a_0 is DEAD
2025-09-30T14:55:30.764887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|992cbea1-728ece8e-b7480db3-8dd90e3a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:30.764861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:30.764883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1896
2025-09-30T14:55:30.765210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1896 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:30.765252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1896 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:30.765263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1896 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:30.765267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:30.765769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1896 sessionId:  describe result for acl check
2025-09-30T14:55:30.765808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:30.765815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:30.765817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:30.765823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896006047127718:6370] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:30.766369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896006047127718:6370] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:30.769081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896006047127718:6370] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:30.771518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:30.771915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896006047127718:6370] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:30.771931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896006047127718:6370] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:30.771935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896006047127718:6370] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:30.771943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1896 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:30.774533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:30.774876Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:30.774890Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:30.774904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:30.774968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:30.775012Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896005957358579:4949]
2025-09-30T14:55:30.775743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:30.776090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:30.776155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:30.776489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:30.776570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:30.776577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:30.776578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:30.776579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:30.776581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:30.776582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:30.776584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:30.776585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:30.776587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:30.776588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:30.776590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.776591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.776592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.776594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:30.776595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:30.776602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:30.776611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:30.776614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:30.776617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:30.776619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:30.776622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:30.776624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:30.776627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:30.776629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:30.776632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:30.776635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.776637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.776640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.776642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:30.776644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:30.776653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:30.776658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:30.776662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:30.776665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:30.776669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:30.776673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:30.776676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:30.776680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:30.776683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:30.776686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:30.776692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:30.776698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:30.776703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:30.776709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:30.776714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:30.776720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:30.776725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:30.776731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:30.776738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:30.776744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:30.776749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.776755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.776760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.776766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.776771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.776776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.776781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:30.776787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:30.776791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:30.776797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:30.776847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:30.782702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:30.784087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:30.784101Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:30.784104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:30.784107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:30.784112Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1895 [2:7555896005957358579:4949]
2025-09-30T14:55:30.784127Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:30.784140Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:30.784142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:30.784145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:30.784147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:30.784164Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:30.784177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:30.784184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:30.784251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.784258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.784260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.784264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:30.784266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:30.784335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:30.784343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.784358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.784370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.784386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:30.784408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896005957358573:4949]
2025-09-30T14:55:30.784410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896005957358573:4949]
2025-09-30T14:55:30.784413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896005957358573:4949]
2025-09-30T14:55:30.784421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:30.784434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:30.784435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:30.784438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:30.784441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:30.784448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:30.784451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:30.784462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896006047127845:6370], now have 1 active actors on pipe
2025-09-30T14:55:30.784466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896006047127605:2454], now have 1 active actors on pipe
2025-09-30T14:55:30.784495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896005957358573:4949]
2025-09-30T14:55:30.784504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:30.784509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:30.784541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1895
2025-09-30T14:55:30.784574Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1895
2025-09-30T14:55:30.784586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:30.784596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:30.784620Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfa131c9-7626992a-392a8c11-b730c873_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:30.784626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:30.784631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:30.784633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:30.784643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:30.784653Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:30.784671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:30.784851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:30.784861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:30.784877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:30.784958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1896 partition: 0 MaxSeqNo: 42 sessionId: src_id|bfa131c9-7626992a-392a8c11-b730c873_0
2025-09-30T14:55:30.785408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|992cbea1-728ece8e-b7480db3-8dd90e3a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bfa131c9-7626992a-392a8c11-b730c873_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:30.788906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa131c9-7626992a-392a8c11-b730c873_0] Write session: try to update token
2025-09-30T14:55:30.788936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa131c9-7626992a-392a8c11-b730c873_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:30.798547Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:30.798567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:30.798575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896005957358573:4949]
2025-09-30T14:55:30.798618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:30.798621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:30.798789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:30.798920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:30.799049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:30.799179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:30.799398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:30.799445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:30.808899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1896 sessionId: src_id|bfa131c9-7626992a-392a8c11-b730c873_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:30.811163Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:30.811186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:30.811189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:30.811191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:30.811202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896005957358573:4949]
2025-09-30T14:55:30.811210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896005957358573:4949]
2025-09-30T14:55:30.811215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896005957358573:4949]
2025-09-30T14:55:30.811277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:30.811282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:30.811291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:30.811291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.811294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:30.811296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:30.811436Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:30.811692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:30.853105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896006047127858:7118]
2025-09-30T14:55:30.853460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1895, pipe: [1:7555896006047127858:7118]
2025-09-30T14:55:30.924693Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:30.925048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:30.925058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:30.925081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896006047127858:7118], now have 1 active actors on pipe
2025-09-30T14:55:30.925414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:30.925445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:30.925455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896006047127858:7118]
2025-09-30T14:55:30.925490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:30.925460Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:30.925533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1896 reason: error at write: Disconnected sessionId: src_id|bfa131c9-7626992a-392a8c11-b730c873_0
2025-09-30T14:55:30.925748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1896 sessionId: src_id|bfa131c9-7626992a-392a8c11-b730c873_0 is DEAD
2025-09-30T14:55:30.925954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa131c9-7626992a-392a8c11-b730c873_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:30.925970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa131c9-7626992a-392a8c11-b730c873_0] Write session will restart in 0.009884s
2025-09-30T14:55:30.926001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa131c9-7626992a-392a8c11-b730c873_0] Write session: Do CDS request
2025-09-30T14:55:30.926008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa131c9-7626992a-392a8c11-b730c873_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:30.936910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa131c9-7626992a-392a8c11-b730c873_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:30.937507Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:30.937530Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1897
2025-09-30T14:55:30.937680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1897 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:30.937722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1897 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:30.937736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1897 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:30.937741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:30.938285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1897 sessionId:  describe result for acl check
2025-09-30T14:55:30.938333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:30.938342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:30.938344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:30.938352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896006047127902:6365] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:30.939023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896006047127902:6365] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:30.942746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896006047127902:6365] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:30.947047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896006047127902:6365] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:30.947073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896006047127902:6365] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:30.947077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896006047127902:6365] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:30.947089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1897 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:30.950249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:30.955874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:30.956463Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:30.956481Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:30.956500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:30.956596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:30.956650Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896005957358814:4943]
2025-09-30T14:55:30.957445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:30.957865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:30.957939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:30.958381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:30.958466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:30.958475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:30.958477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:30.958479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:30.958480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:30.958482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:30.958484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:30.958486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:30.958487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:30.958488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:30.958489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.958490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.958491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.958492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:30.958493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:30.958498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:30.958506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:30.958509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:30.958512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:30.958514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:30.958517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:30.958520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:30.958523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:30.958525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:30.958529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:30.958533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.958538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.958541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.958545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:30.958550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:30.958558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:30.958567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:30.958573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:30.958579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:30.958585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:30.958591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:30.958597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:30.958603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:30.958609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:30.958615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:30.958621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:30.958627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:30.958634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:30.958639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:30.958645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:30.958653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:30.958659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:30.958666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:30.958671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:30.958677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:30.958683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.958689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.958695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.958698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.958702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.958706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.958710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:30.958717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:30.958723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:30.958729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:30.958780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:30.965018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:30.966100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:30.966118Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:30.966122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:30.966128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:30.966137Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1896 [2:7555896005957358814:4943]
2025-09-30T14:55:30.966159Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:30.966187Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:30.966197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:30.966201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:30.966204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:30.966225Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:30.966239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:30.966250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:30.966345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.966354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.966358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.966362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:30.966366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:30.966625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1896
2025-09-30T14:55:30.966631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1896
2025-09-30T14:55:30.966907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:30.966918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.966932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:30.966946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:30.966967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:30.966998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896006047128086:6365], now have 1 active actors on pipe
2025-09-30T14:55:30.967006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896006047127860:2454], now have 1 active actors on pipe
2025-09-30T14:55:30.967027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:30.967038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:30.967058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896005957358809:4943]
2025-09-30T14:55:30.967066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896005957358809:4943]
2025-09-30T14:55:30.967069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896005957358809:4943]
2025-09-30T14:55:30.967085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:30.967106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:30.967105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:30.967108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:30.967110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:30.967127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:30.967131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:30.967153Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|482dca7-696c0ab-43a31dc3-e16101af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:30.967165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:30.967169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:30.967172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:30.967185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:30.967201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:30.967265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896005957358809:4943]
2025-09-30T14:55:30.967277Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:30.967286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:30.967292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:30.967471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:30.967484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:30.967513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:30.967616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1897 partition: 0 MaxSeqNo: 42 sessionId: src_id|482dca7-696c0ab-43a31dc3-e16101af_0
2025-09-30T14:55:30.968085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa131c9-7626992a-392a8c11-b730c873_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|482dca7-696c0ab-43a31dc3-e16101af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:30.971564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|482dca7-696c0ab-43a31dc3-e16101af_0] Write session: try to update token
2025-09-30T14:55:30.971584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|482dca7-696c0ab-43a31dc3-e16101af_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:30.981600Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:30.981623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:30.981636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896005957358809:4943]
2025-09-30T14:55:30.981696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:30.981725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:30.981918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:30.982122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:30.982303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:30.982515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:30.982912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:30.982995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:30.992231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1897 sessionId: src_id|482dca7-696c0ab-43a31dc3-e16101af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:30.995114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:30.995493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:30.995524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:30.997229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:30.997271Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:30.997275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:30.997278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:30.997281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:30.997293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896005957358809:4943]
2025-09-30T14:55:30.997299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896005957358809:4943]
2025-09-30T14:55:30.997305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896005957358809:4943]
2025-09-30T14:55:30.997352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:30.997368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:30.997377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:31.002066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:30.997552Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:31.001988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:31.002000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:31.002006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:31.025626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896010342095401:7118]
2025-09-30T14:55:31.025877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1896, pipe: [1:7555896010342095401:7118]
2025-09-30T14:55:31.134146Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:31.134886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896010342095401:7118], now have 1 active actors on pipe
2025-09-30T14:55:31.146991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:31.147028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:31.147352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:31.147437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:31.147515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:31.147597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:31.147656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:31.147662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:31.147762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:31.147836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:31.147914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:31.147996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:31.148057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:31.148062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:31.148149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:31.148223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:31.148302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:31.148384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:31.148444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:31.148447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:31.148537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:31.148615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:31.148696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:31.148776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:31.148831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:31.148834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:31.148922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:31.148997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:31.149071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:31.149147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:31.151440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:31.151483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:31.151579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:31.151657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:31.151724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:31.151794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:31.151856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:31.151859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:31.151942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:31.152008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:31.152641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:31.152735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:31.152777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:31.152780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:31.152862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:31.152924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:31.152994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:31.153060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:31.153107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:31.153110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:31.153186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:31.153251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:31.153317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:31.153383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:31.153435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:31.153438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:31.153513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:31.153619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:31.153698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:31.153775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:31.153821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:31.153824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:31.155033Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:31.155093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:31.155096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:31.155093Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:31.155126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1897 reason: error at write: Disconnected sessionId: src_id|482dca7-696c0ab-43a31dc3-e16101af_0
2025-09-30T14:55:31.155349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1897 sessionId: src_id|482dca7-696c0ab-43a31dc3-e16101af_0 is DEAD
2025-09-30T14:55:31.155746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896010342095401:7118]
2025-09-30T14:55:31.159495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|482dca7-696c0ab-43a31dc3-e16101af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:31.159508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|482dca7-696c0ab-43a31dc3-e16101af_0] Write session will restart in 0.007652s
2025-09-30T14:55:31.159544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|482dca7-696c0ab-43a31dc3-e16101af_0] Write session: Do CDS request
2025-09-30T14:55:31.159550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|482dca7-696c0ab-43a31dc3-e16101af_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:31.171899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|482dca7-696c0ab-43a31dc3-e16101af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:31.172332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:31.172362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1898
2025-09-30T14:55:31.172561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1898 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:31.172602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1898 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:31.172623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1898 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:31.172634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:31.173116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1898 sessionId:  describe result for acl check
2025-09-30T14:55:31.173156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:31.173163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:31.173167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:31.173173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896010342095438:6346] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:31.173734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896010342095438:6346] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:31.178021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896010342095438:6346] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:31.182519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896010342095438:6346] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:31.182545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896010342095438:6346] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:31.182549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896010342095438:6346] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:31.182558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1898 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:31.188138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:31.192421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:31.192670Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:31.192681Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:31.192693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:31.192747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:31.192789Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896010252326380:4930]
2025-09-30T14:55:31.193532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:31.193947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:31.193997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:31.194373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:31.194447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:31.194448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:31.194449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:31.194451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:31.194453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:31.194455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:31.194457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:31.194459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:31.194460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:31.194462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:31.194464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.194465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:31.194467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:31.194468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:31.194470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:31.194475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:31.194486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:31.194490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:31.194493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:31.194497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:31.194501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:31.194505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:31.194509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:31.194513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:31.194517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:31.194520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.194524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:31.194529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:31.194533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:31.194537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:31.194546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:31.194555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:31.194561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:31.194568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:31.194573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:31.194580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:31.194586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:31.194593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:31.194599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:31.194606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:31.194612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:31.194618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:31.194629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:31.194636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:31.194642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:31.194648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:31.194653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:31.194659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:31.194664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:31.194670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:31.194676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.194683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.194689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:31.194695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:31.194701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:31.194708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:31.194713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:31.194719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:31.194725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:31.194731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:31.194781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:31.201351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:31.202863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:31.202883Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:31.202886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:31.202890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:31.202897Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1897 [2:7555896010252326380:4930]
2025-09-30T14:55:31.202916Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:31.202933Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:31.202936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:31.202939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:31.202942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:31.202959Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:31.202967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:31.202976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:31.203044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.203055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:31.203057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:31.203061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:31.203064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:31.203142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:31.203144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.203160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:31.203173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:31.203189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:31.203208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896010252326375:4930]
2025-09-30T14:55:31.203212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896010252326375:4930]
2025-09-30T14:55:31.203214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896010252326375:4930]
2025-09-30T14:55:31.203223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:31.203259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896010342095580:6346], now have 1 active actors on pipe
2025-09-30T14:55:31.203267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:31.203265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:31.203271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:31.203274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:31.203281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:31.203284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:31.203290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896010342095422:2454], now have 1 active actors on pipe
2025-09-30T14:55:31.203335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896010252326375:4930]
2025-09-30T14:55:31.203368Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1897
2025-09-30T14:55:31.203346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:31.203370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1897
2025-09-30T14:55:31.203425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:31.203728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:31.203743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:31.203778Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a641415-2e8cfcc3-8bfbe86b-8b8c4571_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:31.203793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:31.203798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:31.203801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:31.203816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:31.203833Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:31.203850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:31.204146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:31.204164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:31.204186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:31.204375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1898 partition: 0 MaxSeqNo: 42 sessionId: src_id|1a641415-2e8cfcc3-8bfbe86b-8b8c4571_0
2025-09-30T14:55:31.204828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|482dca7-696c0ab-43a31dc3-e16101af_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1a641415-2e8cfcc3-8bfbe86b-8b8c4571_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:31.208111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a641415-2e8cfcc3-8bfbe86b-8b8c4571_0] Write session: try to update token
2025-09-30T14:55:31.208138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a641415-2e8cfcc3-8bfbe86b-8b8c4571_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:31.217444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:31.217467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:31.217471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:31.217474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:31.217486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896010252326375:4930]
2025-09-30T14:55:31.217491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896010252326375:4930]
2025-09-30T14:55:31.217495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896010252326375:4930]
2025-09-30T14:55:31.217547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:31.217550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:31.217555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:31.217557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.217559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:31.217574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:31.217750Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:31.228913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1898 sessionId: src_id|1a641415-2e8cfcc3-8bfbe86b-8b8c4571_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:31.232296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:31.256082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896010342095677:7118]
2025-09-30T14:55:31.256462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1897, pipe: [1:7555896010342095677:7118]
2025-09-30T14:55:31.346350Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:31.347152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:31.347164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:31.347185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896010342095677:7118], now have 1 active actors on pipe
2025-09-30T14:55:31.347527Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:31.348487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:31.348613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1898 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1a641415-2e8cfcc3-8bfbe86b-8b8c4571_0
2025-09-30T14:55:31.348843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1898 sessionId: src_id|1a641415-2e8cfcc3-8bfbe86b-8b8c4571_0 is DEAD
2025-09-30T14:55:31.349068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896010342095677:7118]
2025-09-30T14:55:31.349089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:31.349819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a641415-2e8cfcc3-8bfbe86b-8b8c4571_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:31.349833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a641415-2e8cfcc3-8bfbe86b-8b8c4571_0] Write session will restart in 0.006014s
2025-09-30T14:55:31.349866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a641415-2e8cfcc3-8bfbe86b-8b8c4571_0] Write session: Do CDS request
2025-09-30T14:55:31.349875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a641415-2e8cfcc3-8bfbe86b-8b8c4571_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:31.356830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a641415-2e8cfcc3-8bfbe86b-8b8c4571_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:31.356955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:31.356977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1899
2025-09-30T14:55:31.357184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1899 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:31.357224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1899 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:31.357230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1899 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:31.357234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:31.357774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1899 sessionId:  describe result for acl check
2025-09-30T14:55:31.357811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:31.357814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:31.357816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:31.357823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896010342095692:6342] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:31.358469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896010342095692:6342] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:31.362047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896010342095692:6342] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:31.368591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896010342095692:6342] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:31.368616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896010342095692:6342] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:31.368620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896010342095692:6342] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:31.368630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1899 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:31.387178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:31.391523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:31.391834Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:31.391839Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:31.391854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:31.391922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:31.391967Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896010252326616:4918]
2025-09-30T14:55:31.392639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:31.393059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:31.393096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:31.393415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:31.393498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:31.393499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:31.393501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:31.393502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:31.393503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:31.393505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:31.393506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:31.393508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:31.393509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:31.393511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:31.393512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.393514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:31.393515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:31.393517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:31.393519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:31.393526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:31.393537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:31.393541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:31.393545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:31.393549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:31.393553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:31.393557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:31.393574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:31.393578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:31.393582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:31.393586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.393590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:31.393594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:31.393598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:31.393602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:31.393612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:31.393620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:31.393626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:31.393631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:31.393637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:31.393643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:31.393648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:31.393657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:31.393663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:31.393667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:31.393670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:31.393673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:31.393676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:31.393679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:31.393683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:31.393686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:31.393689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:31.393692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:31.393695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:31.393698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:31.393701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.393704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.393708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:31.393711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:31.393714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:31.393717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:31.393724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:31.393727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:31.393730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:31.393733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:31.393777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:31.402993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:31.404607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:31.404623Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:31.404626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:31.404630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:31.404638Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1898 [2:7555896010252326616:4918]
2025-09-30T14:55:31.404656Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:31.404673Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:31.404676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:31.404679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:31.404681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:31.404699Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:31.404706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:31.404714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:31.404779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.404782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:31.404784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:31.404787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:31.404789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:31.404882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:31.404889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.404901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:31.404909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:31.404921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:31.404938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896010252326609:4918]
2025-09-30T14:55:31.404941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896010252326609:4918]
2025-09-30T14:55:31.404943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896010252326609:4918]
2025-09-30T14:55:31.404954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:31.404968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:31.404978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:31.404981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:31.405024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896010252326609:4918]
2025-09-30T14:55:31.405026Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:31.405249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:31.405251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:31.405254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:31.405259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:31.405691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1898
2025-09-30T14:55:31.405768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1898
2025-09-30T14:55:31.405840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896010342095738:6342], now have 1 active actors on pipe
2025-09-30T14:55:31.405851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896010342095682:2454], now have 1 active actors on pipe
2025-09-30T14:55:31.406146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:31.406157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:31.406186Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a8f0d70-cd12d828-7adb9697-a7d1f8d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:31.406194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:31.406198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:31.406200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:31.406210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:31.406224Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:31.406240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:31.406663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:31.406671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:31.406690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:31.406845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1899 partition: 0 MaxSeqNo: 42 sessionId: src_id|6a8f0d70-cd12d828-7adb9697-a7d1f8d0_0
2025-09-30T14:55:31.407331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a641415-2e8cfcc3-8bfbe86b-8b8c4571_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6a8f0d70-cd12d828-7adb9697-a7d1f8d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:31.410529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a8f0d70-cd12d828-7adb9697-a7d1f8d0_0] Write session: try to update token
2025-09-30T14:55:31.410557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a8f0d70-cd12d828-7adb9697-a7d1f8d0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:31.425142Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:31.425166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:31.425168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:31.425171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:31.425183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896010252326609:4918]
2025-09-30T14:55:31.425188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896010252326609:4918]
2025-09-30T14:55:31.425194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896010252326609:4918]
2025-09-30T14:55:31.425243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:31.425251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.425254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:31.425403Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:31.426125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:31.426137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:31.426142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:31.449034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896010342095922:7118]
2025-09-30T14:55:31.449667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1898, pipe: [1:7555896010342095922:7118]
2025-09-30T14:55:31.451627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1899 sessionId: src_id|6a8f0d70-cd12d828-7adb9697-a7d1f8d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:31.454468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:31.551289Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:31.551998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896010342095922:7118], now have 1 active actors on pipe
2025-09-30T14:55:31.552020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:31.552026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:31.552268Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:31.552751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a8f0d70-cd12d828-7adb9697-a7d1f8d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:31.552760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a8f0d70-cd12d828-7adb9697-a7d1f8d0_0] Write session will restart in 0.007692s
2025-09-30T14:55:31.552778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a8f0d70-cd12d828-7adb9697-a7d1f8d0_0] Write session: Do CDS request
2025-09-30T14:55:31.552782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a8f0d70-cd12d828-7adb9697-a7d1f8d0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:31.552370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:31.552389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:31.552454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1899 reason: error at write: Disconnected sessionId: src_id|6a8f0d70-cd12d828-7adb9697-a7d1f8d0_0
2025-09-30T14:55:31.552656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1899 sessionId: src_id|6a8f0d70-cd12d828-7adb9697-a7d1f8d0_0 is DEAD
2025-09-30T14:55:31.552800Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:31.552842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896010342095922:7118]
2025-09-30T14:55:31.561954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a8f0d70-cd12d828-7adb9697-a7d1f8d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:31.562106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:31.562124Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1900
2025-09-30T14:55:31.562330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1900 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:31.562409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1900 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:31.562422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1900 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:31.562432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:31.562986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1900 sessionId:  describe result for acl check
2025-09-30T14:55:31.563026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:31.563029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:31.563030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:31.563036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896010342095959:6335] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:31.563634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896010342095959:6335] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:31.567942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896010342095959:6335] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:31.572303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896010342095959:6335] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:31.572323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896010342095959:6335] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:31.572327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896010342095959:6335] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:31.572335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1900 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:31.575590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:31.578608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:31.578847Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:31.578859Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:31.578872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:31.578929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:31.578975Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896010252326851:4914]
2025-09-30T14:55:31.579718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:31.580190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:31.580247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:31.580631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:31.580702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:31.580709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:31.580710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:31.580711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:31.580713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:31.580714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:31.580716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:31.580717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:31.580719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:31.580720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:31.580722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.580723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:31.580724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:31.580726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:31.580727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:31.580733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:31.580742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:31.580746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:31.580750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:31.580754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:31.580758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:31.580762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:31.580767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:31.580771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:31.580775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:31.580779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.580784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:31.580788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:31.580793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:31.580797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:31.580810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:31.580819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:31.580831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:31.580837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:31.580842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:31.580849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:31.580854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:31.580860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:31.580869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:31.580875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:31.580880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:31.580887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:31.580892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:31.580904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:31.580910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:31.580924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:31.580934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:31.580940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:31.580949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:31.580955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:31.580965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.580972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.580982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:31.580989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:31.580999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:31.581006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:31.581014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:31.581020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:31.581025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:31.581036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:31.581085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:31.587478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:31.588453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:31.588469Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:31.588473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:31.588477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:31.588485Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1899 [2:7555896010252326851:4914]
2025-09-30T14:55:31.588503Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:31.588521Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:31.588525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:31.588528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:31.588531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:31.588549Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:31.588557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:31.588565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:31.588633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.588640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:31.588642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:31.588646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:31.588649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:31.588725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:31.588735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.588750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:31.588768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:31.588787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:31.588810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896010252326846:4914]
2025-09-30T14:55:31.588817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896010252326846:4914]
2025-09-30T14:55:31.588820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896010252326846:4914]
2025-09-30T14:55:31.588837Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:31.588857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:31.588876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:31.588879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:31.588915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896010252326846:4914]
2025-09-30T14:55:31.588917Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:31.588928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896010342096140:6335], now have 1 active actors on pipe
2025-09-30T14:55:31.588929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:31.588935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:31.588937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:31.588942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896010342095925:2454], now have 1 active actors on pipe
2025-09-30T14:55:31.588943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:31.589026Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1899
2025-09-30T14:55:31.589030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1899
2025-09-30T14:55:31.590523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:31.590541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:31.590577Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3957fd2e-76b4af0-a3c26d80-901bd1c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:31.590589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:31.590595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:31.590597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:31.590610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:31.590625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:31.590643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:31.591324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:31.591338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:31.591371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:31.591508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1900 partition: 0 MaxSeqNo: 42 sessionId: src_id|3957fd2e-76b4af0-a3c26d80-901bd1c5_0
2025-09-30T14:55:31.591993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a8f0d70-cd12d828-7adb9697-a7d1f8d0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3957fd2e-76b4af0-a3c26d80-901bd1c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:31.594927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3957fd2e-76b4af0-a3c26d80-901bd1c5_0] Write session: try to update token
2025-09-30T14:55:31.594947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3957fd2e-76b4af0-a3c26d80-901bd1c5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:31.603052Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:31.603075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:31.603079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:31.603081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:31.603092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896010252326846:4914]
2025-09-30T14:55:31.603099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896010252326846:4914]
2025-09-30T14:55:31.603104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896010252326846:4914]
2025-09-30T14:55:31.603160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:31.603172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:31.603179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:31.603179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.603183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:31.603183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:31.603391Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:31.612282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1900 sessionId: src_id|3957fd2e-76b4af0-a3c26d80-901bd1c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:31.615278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:31.652350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896010342096170:7118]
2025-09-30T14:55:31.652682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1899, pipe: [1:7555896010342096170:7118]
2025-09-30T14:55:31.722476Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:31.722852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:31.722872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:31.722894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896010342096170:7118], now have 1 active actors on pipe
2025-09-30T14:55:31.723197Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:31.723169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:31.723190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:31.723271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1900 reason: error at write: Disconnected sessionId: src_id|3957fd2e-76b4af0-a3c26d80-901bd1c5_0
2025-09-30T14:55:31.723296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:31.723354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896010342096170:7118]
2025-09-30T14:55:31.723453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1900 sessionId: src_id|3957fd2e-76b4af0-a3c26d80-901bd1c5_0 is DEAD
2025-09-30T14:55:31.727408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3957fd2e-76b4af0-a3c26d80-901bd1c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:31.727426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3957fd2e-76b4af0-a3c26d80-901bd1c5_0] Write session will restart in 0.009974s
2025-09-30T14:55:31.727457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3957fd2e-76b4af0-a3c26d80-901bd1c5_0] Write session: Do CDS request
2025-09-30T14:55:31.727469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3957fd2e-76b4af0-a3c26d80-901bd1c5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:31.738977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3957fd2e-76b4af0-a3c26d80-901bd1c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:31.739448Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:31.739472Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1901
2025-09-30T14:55:31.743456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1901 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:31.743544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1901 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:31.743559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1901 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:31.743567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:31.744749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:31.746708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1901 sessionId:  describe result for acl check
2025-09-30T14:55:31.746780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:31.746791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:31.746795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:31.746802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896010342096372:6317] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:31.747525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896010342096372:6317] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:31.748795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:31.749053Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:31.749065Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:31.749077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:31.749155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:31.749197Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896010252327099:4910]
2025-09-30T14:55:31.749898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:31.750228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896010342096372:6317] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:31.750305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:31.750385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:31.750777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:31.750850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:31.750856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:31.750857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:31.750858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:31.750860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:31.750861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:31.750862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:31.750863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:31.750864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:31.750866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:31.750867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.750868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:31.750869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:31.750870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:31.750871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:31.750877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:31.750887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:31.750892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:31.750896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:31.750900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:31.750905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:31.750909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:31.750913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:31.750917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:31.750921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:31.750925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.750928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:31.750932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:31.750936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:31.750942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:31.750950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:31.750959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:31.750966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:31.750972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:31.750978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:31.750984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:31.750988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:31.750994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:31.750999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:31.751005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:31.751010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:31.751015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:31.751019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:31.751024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:31.751029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:31.751035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:31.751041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:31.751046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:31.751050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:31.751057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:31.751062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.751068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.751074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:31.751092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:31.751097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:31.751102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:31.751106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:31.751110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:31.751114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:31.751120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:31.751169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:31.758583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896010342096372:6317] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:31.758612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896010342096372:6317] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:31.758616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896010342096372:6317] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:31.758627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1901 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:31.758922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:31.760228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1900
2025-09-30T14:55:31.760272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1900
2025-09-30T14:55:31.759814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:31.759827Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:31.759829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:31.759832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:31.759839Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1900 [2:7555896010252327099:4910]
2025-09-30T14:55:31.759852Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:31.759866Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:31.759869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:31.759871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:31.759873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:31.759890Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:31.759898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:31.759904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:31.759972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.759975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:31.759977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:31.759981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:31.759984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:31.760041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:31.760043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.760056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:31.760068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:31.760083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:31.760101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896010252327093:4910]
2025-09-30T14:55:31.760104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896010252327093:4910]
2025-09-30T14:55:31.760107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896010252327093:4910]
2025-09-30T14:55:31.760115Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:31.760130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:31.760130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:31.760134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:31.760141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:31.760148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:31.760152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:31.760163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896010342096172:2454], now have 1 active actors on pipe
2025-09-30T14:55:31.760167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896010342096410:6317], now have 1 active actors on pipe
2025-09-30T14:55:31.760207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896010252327093:4910]
2025-09-30T14:55:31.760213Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:31.760220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:31.760456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:31.760461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:31.760486Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7c3f776-94503bf9-356773fe-413af28a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:31.760493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:31.760497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:31.760499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:31.760511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:31.760521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:31.760534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:31.760895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:31.760907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:31.760924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:31.761054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1901 partition: 0 MaxSeqNo: 42 sessionId: src_id|f7c3f776-94503bf9-356773fe-413af28a_0
2025-09-30T14:55:31.763631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3957fd2e-76b4af0-a3c26d80-901bd1c5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f7c3f776-94503bf9-356773fe-413af28a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:31.767076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7c3f776-94503bf9-356773fe-413af28a_0] Write session: try to update token
2025-09-30T14:55:31.767098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7c3f776-94503bf9-356773fe-413af28a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:31.774935Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:31.774961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:31.774964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:31.774967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:31.774979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896010252327093:4910]
2025-09-30T14:55:31.774985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896010252327093:4910]
2025-09-30T14:55:31.774991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896010252327093:4910]
2025-09-30T14:55:31.775041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:31.775051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.775055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:31.775109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:31.775139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:31.775144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:31.775234Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:31.795701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1901 sessionId: src_id|f7c3f776-94503bf9-356773fe-413af28a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:31.799505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:31.823336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896010342096432:7118]
2025-09-30T14:55:31.823657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1900, pipe: [1:7555896010342096432:7118]
2025-09-30T14:55:31.901634Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:31.902354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:31.902370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:31.902392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896010342096432:7118], now have 1 active actors on pipe
2025-09-30T14:55:31.902627Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:31.902665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896010342096432:7118]
2025-09-30T14:55:31.902704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:31.902740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:31.902743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:31.902802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1901 reason: error at write: Disconnected sessionId: src_id|f7c3f776-94503bf9-356773fe-413af28a_0
2025-09-30T14:55:31.902973Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:55:31.902984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1901 sessionId: src_id|f7c3f776-94503bf9-356773fe-413af28a_0 is DEAD
2025-09-30T14:55:31.903108Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 19 consumer shared/user session shared/user_1_19_7249590220442558625_v1 is DEAD
2025-09-30T14:55:31.903164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7c3f776-94503bf9-356773fe-413af28a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:31.903181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7c3f776-94503bf9-356773fe-413af28a_0] Write session will restart in 0.008608s
2025-09-30T14:55:31.903216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7c3f776-94503bf9-356773fe-413af28a_0] Write session: Do CDS request
2025-09-30T14:55:31.903223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7c3f776-94503bf9-356773fe-413af28a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:31.903230Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895937327631886:7125] disconnected; active server actors: 1
2025-09-30T14:55:31.903240Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555895937327631886:7125] client user disconnected session shared/user_1_19_7249590220442558625_v1
2025-09-30T14:55:31.903284Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:55:31.903338Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:55:31.903343Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:55:31.903351Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.005490s
2025-09-30T14:55:31.915723Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:55:31.915917Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:55:31.915920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:31.915963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7c3f776-94503bf9-356773fe-413af28a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:31.915926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1902
2025-09-30T14:55:31.915933Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 20
2025-09-30T14:55:31.916093Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 20 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:55:31.916151Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:55:31.916230Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 auth for : user
2025-09-30T14:55:31.916413Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 Handle describe topics response
2025-09-30T14:55:31.916461Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 auth is DEAD
2025-09-30T14:55:31.916466Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:55:31.916658Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:55:31.916809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1902 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:31.916841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1902 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:31.916850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1902 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:31.916855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:31.916881Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896010342096568:6320] connected; active server actors: 1
2025-09-30T14:55:31.916897Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555896010342096568:6320] session shared/user_1_20_14284323138001262305_v1
2025-09-30T14:55:31.916909Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:55:31.916920Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:55:31.916918Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_20_14284323138001262305_v1
2025-09-30T14:55:31.916926Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_20_14284323138001262305_v1" (Sender=[1:7555896010342096550:6320], Pipe=[1:7555896010342096568:6320], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:55:31.916937Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:55:31.916949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:55:31.916959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_20_14284323138001262305_v1" (Sender=[1:7555896010342096550:6320], Pipe=[1:7555896010342096568:6320], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:55:31.916969Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_20_14284323138001262305_v1" sender [1:7555896010342096550:6320] lock partition 0 for ReadingSession "shared/user_1_20_14284323138001262305_v1" (Sender=[1:7555896010342096550:6320], Pipe=[1:7555896010342096568:6320], Partitions=[], ActiveFamilyCount=1) generation 1 step 20
2025-09-30T14:55:31.916977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:55:31.916981Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000028s
2025-09-30T14:55:31.917187Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 20 Session: "shared/user_1_20_14284323138001262305_v1" ClientId: "user" PipeClient { RawX1: 7555896010342096568 RawX2: 4503603922344112 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:55:31.917191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1902 sessionId:  describe result for acl check
2025-09-30T14:55:31.917210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:55:31.917211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:31.917213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:31.917214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:31.917219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896010342096586:6319] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:31.917809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896010342096586:6319] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:31.920270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896010342096586:6319] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:31.921156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:31.924413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:31.924806Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:31.924819Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:31.924833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:31.924903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:31.924954Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896010252327340:4908]
2025-09-30T14:55:31.925595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:31.925949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:31.925997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:31.926360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:31.926442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:31.926449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:31.926450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:31.926452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:31.926454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:31.926455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:31.926457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:31.926458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:31.926460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:31.926461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:31.926463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.926464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:31.926465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:31.926467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:31.926468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:31.926474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:31.926486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:31.926491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:31.926496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:31.926501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:31.926507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:31.926511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:31.926516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:31.926521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:31.926526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:31.926530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.926535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:31.926539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:31.926544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:31.926549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:31.926558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:31.926566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:31.926574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:31.926586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:31.926597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:31.926604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:31.926612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:31.926622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:31.926629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:31.926640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:31.926650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:31.926657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:31.926666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:31.926673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:31.926682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:31.926688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:31.926694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:31.926700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:31.926706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:31.926712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:31.926724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.926734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.926738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:31.926749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:31.926759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:31.926766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:31.926776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:31.926782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:31.926791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:31.926798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:31.926855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:31.927602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896010342096586:6319] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:31.927624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896010342096586:6319] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:31.927628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896010342096586:6319] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:31.927636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1902 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:31.932610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:31.933920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:31.933936Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:31.933939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:31.933943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:31.933950Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1901 [2:7555896010252327340:4908]
2025-09-30T14:55:31.933968Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:31.933984Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:31.933988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:31.933991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:31.933994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:31.934012Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:31.934019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:31.934032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:31.934091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.934099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:31.934102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:31.934106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:31.934109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:31.934186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:31.934197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.934212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:31.934226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:31.934246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:31.934270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896010342096433:2454], now have 1 active actors on pipe
2025-09-30T14:55:31.934279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896010342096679:6319], now have 1 active actors on pipe
2025-09-30T14:55:31.934282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896010342096587:6314], now have 1 active actors on pipe
2025-09-30T14:55:31.934289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896010252327335:4908]
2025-09-30T14:55:31.934301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896010252327335:4908]
2025-09-30T14:55:31.934303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896010252327335:4908]
2025-09-30T14:55:31.934318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:31.934332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:31.934333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:31.934339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:31.934341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:31.934349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:31.934352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:31.934397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:31.934311Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1901
2025-09-30T14:55:31.934407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:31.934420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896010252327335:4908]
2025-09-30T14:55:31.934344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1901
2025-09-30T14:55:31.934429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:31.934450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:31.934457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:31.934382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1901, pipe: [1:7555896010342096587:6314]
2025-09-30T14:55:31.934462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:31.934469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_20_14284323138001262305_v1 on pipe: [1:7555896010342096587:6314]
2025-09-30T14:55:31.934502Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ed6bed4-6411a76c-93c06df5-2b2708cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:31.934510Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_20_14284323138001262305_v1:1 with generation 1901
2025-09-30T14:55:31.934514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:31.934518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:31.934521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:31.934530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:31.934540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:31.934566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:31.934576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:31.934578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:31.934592Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_20_14284323138001262305_v1
2025-09-30T14:55:31.934599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:31.934625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:31.934650Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:55:31.934784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:31.934793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:31.934808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:31.934907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1902 partition: 0 MaxSeqNo: 42 sessionId: src_id|7ed6bed4-6411a76c-93c06df5-2b2708cb_0
2025-09-30T14:55:31.935282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7c3f776-94503bf9-356773fe-413af28a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7ed6bed4-6411a76c-93c06df5-2b2708cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:31.938240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ed6bed4-6411a76c-93c06df5-2b2708cb_0] Write session: try to update token
2025-09-30T14:55:31.938257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ed6bed4-6411a76c-93c06df5-2b2708cb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:31.939362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:55:31.939412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:55:31.939427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:31.939430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:31.939432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:31.939441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:55:31.939456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:55:31.939606Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759244131934 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:55:31.939635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:55:31.939673Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 sending to client partition status
2025-09-30T14:55:31.946869Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:31.946890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:31.946893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:31.946895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:31.946909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896010252327335:4908]
2025-09-30T14:55:31.946914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896010252327335:4908]
2025-09-30T14:55:31.946917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896010252327335:4908]
2025-09-30T14:55:31.946958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:31.946958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:31.946965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:31.946969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:31.946970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:31.946973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:31.947120Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:31.956340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1902 sessionId: src_id|7ed6bed4-6411a76c-93c06df5-2b2708cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:31.959217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:32.064677Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:32.065122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:32.065137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:32.065406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_20_14284323138001262305_v1
2025-09-30T14:55:32.065428Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:32.065454Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_20_14284323138001262305_v1
2025-09-30T14:55:32.067418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896010342096587:6314]
2025-09-30T14:55:32.067449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:32.067455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:32.067530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1902 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7ed6bed4-6411a76c-93c06df5-2b2708cb_0
2025-09-30T14:55:32.067745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1902 sessionId: src_id|7ed6bed4-6411a76c-93c06df5-2b2708cb_0 is DEAD
2025-09-30T14:55:32.071367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ed6bed4-6411a76c-93c06df5-2b2708cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:32.071384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ed6bed4-6411a76c-93c06df5-2b2708cb_0] Write session will restart in 0.008788s
2025-09-30T14:55:32.071414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ed6bed4-6411a76c-93c06df5-2b2708cb_0] Write session: Do CDS request
2025-09-30T14:55:32.071424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ed6bed4-6411a76c-93c06df5-2b2708cb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:32.081827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ed6bed4-6411a76c-93c06df5-2b2708cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:32.081874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:32.081896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1903
2025-09-30T14:55:32.082043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1903 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:32.082082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1903 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:32.082088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1903 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:32.082093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:32.082942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1903 sessionId:  describe result for acl check
2025-09-30T14:55:32.082972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:32.082975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:32.082977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:32.082983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896014637064058:6312] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:32.083595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896014637064058:6312] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:32.086496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896014637064058:6312] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:32.089851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:32.090071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896014637064058:6312] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:32.090091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896014637064058:6312] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:32.090095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896014637064058:6312] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:32.090104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1903 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:32.092898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:32.093137Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:32.093147Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:32.093158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:32.093211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:32.093255Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896014547294877:4906]
2025-09-30T14:55:32.093988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:32.094314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:32.094357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:32.094687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:32.094753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:32.094760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:32.094761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:32.094762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:32.094764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:32.094765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:32.094767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:32.094769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:32.094770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:32.094771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:32.094773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.094774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.094775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.094776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:32.094778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:32.094784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:32.094796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:32.094801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:32.094805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:32.094810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:32.094814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:32.094818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:32.094822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:32.094826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:32.094831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:32.094835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.094840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.094844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.094849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:32.094854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:32.094862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:32.094876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:32.094883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:32.094890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:32.094895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:32.094901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:32.094909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:32.094915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:32.094924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:32.094930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:32.094935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:32.094945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:32.094952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:32.094962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:32.094967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:32.094977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:32.094985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:32.094995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:32.095000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:32.095011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:32.095016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.095026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.095031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.095041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.095046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.095057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.095061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:32.095070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:32.095076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:32.095082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:32.095132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:32.101841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:32.103720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1902
2025-09-30T14:55:32.103780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1902
2025-09-30T14:55:32.104230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1903 partition: 0 MaxSeqNo: 42 sessionId: src_id|ca71711e-acce5490-b2428b4-66c21186_0
2025-09-30T14:55:32.104622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ed6bed4-6411a76c-93c06df5-2b2708cb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ca71711e-acce5490-b2428b4-66c21186_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:32.103302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:32.103321Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:32.103325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:32.103329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:32.103337Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1902 [2:7555896014547294877:4906]
2025-09-30T14:55:32.103358Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:32.103377Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:32.103381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:32.103384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:32.103386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:32.103404Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:32.103410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:32.103415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:32.103469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.103470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.103471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.103474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:32.103476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:32.103538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:32.103541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.103556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.103569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.103584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:32.103598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896014547294871:4906]
2025-09-30T14:55:32.103600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896014547294871:4906]
2025-09-30T14:55:32.103603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896014547294871:4906]
2025-09-30T14:55:32.103611Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:32.103622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:32.103623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896014637063984:2454], now have 1 active actors on pipe
2025-09-30T14:55:32.103626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:32.103628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:32.103629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:32.103637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:32.103639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:32.103643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896014637064219:6312], now have 1 active actors on pipe
2025-09-30T14:55:32.103672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896014547294871:4906]
2025-09-30T14:55:32.103681Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:32.103709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:32.103859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:32.103863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:32.103887Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca71711e-acce5490-b2428b4-66c21186_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:32.107573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca71711e-acce5490-b2428b4-66c21186_0] Write session: try to update token
2025-09-30T14:55:32.103896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:32.107607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca71711e-acce5490-b2428b4-66c21186_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:32.103900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:32.103902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:32.103913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:32.103922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:32.103938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:32.104112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:32.104115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:32.104131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:32.117082Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:32.117101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:32.117103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:32.117106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:32.117116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896014547294871:4906]
2025-09-30T14:55:32.117121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896014547294871:4906]
2025-09-30T14:55:32.117126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896014547294871:4906]
2025-09-30T14:55:32.117169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:32.117177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.117180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:32.117182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:32.117189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:32.117194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:32.117329Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:32.126286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1903 sessionId: src_id|ca71711e-acce5490-b2428b4-66c21186_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:32.129244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:32.167345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896014637064236:6314]
2025-09-30T14:55:32.167653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1902, pipe: [1:7555896014637064236:6314]
2025-09-30T14:55:32.230998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca71711e-acce5490-b2428b4-66c21186_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:32.231012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca71711e-acce5490-b2428b4-66c21186_0] Write session will restart in 0.007400s
2025-09-30T14:55:32.231037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca71711e-acce5490-b2428b4-66c21186_0] Write session: Do CDS request
2025-09-30T14:55:32.231044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca71711e-acce5490-b2428b4-66c21186_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:32.230499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:32.230563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896014637064236:6314]
2025-09-30T14:55:32.230582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:32.230659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1903 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ca71711e-acce5490-b2428b4-66c21186_0
2025-09-30T14:55:32.230850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1903 sessionId: src_id|ca71711e-acce5490-b2428b4-66c21186_0 is DEAD
2025-09-30T14:55:32.229787Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:32.230244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:32.230254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:32.230276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896014637064236:6314], now have 1 active actors on pipe
2025-09-30T14:55:32.230486Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:32.239822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca71711e-acce5490-b2428b4-66c21186_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:32.240247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:32.240270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1904
2025-09-30T14:55:32.240419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1904 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:32.240452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1904 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:32.240463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1904 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:32.240467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:32.240832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1904 sessionId:  describe result for acl check
2025-09-30T14:55:32.240859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:32.240861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:32.240862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:32.240866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896014637064277:6295] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:32.241271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896014637064277:6295] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:32.242871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896014637064277:6295] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:32.245825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896014637064277:6295] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:32.245844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896014637064277:6295] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:32.245847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896014637064277:6295] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:32.245855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1904 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:32.259526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:32.262554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:32.262719Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:32.262722Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:32.262729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:32.262763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:32.262792Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896014547295152:4884]
2025-09-30T14:55:32.263259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:32.263630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:32.263678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:32.263919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:32.263974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:32.263980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:32.263985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:32.263986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:32.263987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:32.263988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:32.263990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:32.263991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:32.263992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:32.263993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:32.263995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.263997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.263998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.263999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:32.264000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:32.264006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:32.264016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:32.264034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:32.264039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:32.264043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:32.264047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:32.264053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:32.264061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:32.264065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:32.264070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:32.264074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.264080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.264084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.264088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:32.264093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:32.264103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:32.264114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:32.264120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:32.264125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:32.264130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:32.264135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:32.264140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:32.264148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:32.264152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:32.264157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:32.264160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:32.264163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:32.264165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:32.264168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:32.264171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:32.264174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:32.264176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:32.264179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:32.264182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:32.264184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:32.264187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.264190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.264192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.264195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.264197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.264200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.264202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:32.264205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:32.264208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:32.264211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:32.264237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:32.272147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:32.273176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:32.273181Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:32.273182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:32.273186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:32.273191Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1903 [2:7555896014547295152:4884]
2025-09-30T14:55:32.273206Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:32.273220Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:32.273223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:32.273226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:32.273229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:32.273247Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:32.273256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:32.273264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:32.273587Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1903
2025-09-30T14:55:32.273310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.273312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.273647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1903
2025-09-30T14:55:32.273313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.273316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:32.273318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:32.273393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:32.273399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.273411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.273422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.273439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:32.273456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896014637064253:2454], now have 1 active actors on pipe
2025-09-30T14:55:32.273459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896014637064321:6295], now have 1 active actors on pipe
2025-09-30T14:55:32.273466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896014547295147:4884]
2025-09-30T14:55:32.273468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896014547295147:4884]
2025-09-30T14:55:32.273471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896014547295147:4884]
2025-09-30T14:55:32.273487Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:32.273500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:32.273501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:32.273502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:32.273504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:32.273514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:32.273517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:32.273551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896014547295147:4884]
2025-09-30T14:55:32.273571Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:32.273575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:32.273874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:32.273883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:32.273903Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|128b6fba-db998c9d-d6acb5d1-c99d1ecf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:32.273909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:32.273913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:32.273914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:32.273923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:32.273932Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:32.273947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:32.274115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:32.274122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:32.274135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:32.274218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1904 partition: 0 MaxSeqNo: 42 sessionId: src_id|128b6fba-db998c9d-d6acb5d1-c99d1ecf_0
2025-09-30T14:55:32.274621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca71711e-acce5490-b2428b4-66c21186_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|128b6fba-db998c9d-d6acb5d1-c99d1ecf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:32.277541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|128b6fba-db998c9d-d6acb5d1-c99d1ecf_0] Write session: try to update token
2025-09-30T14:55:32.277584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|128b6fba-db998c9d-d6acb5d1-c99d1ecf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:32.288712Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:32.288733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:32.288736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:32.288738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:32.288748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896014547295147:4884]
2025-09-30T14:55:32.288753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896014547295147:4884]
2025-09-30T14:55:32.288758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896014547295147:4884]
2025-09-30T14:55:32.288799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:32.288806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.288805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:32.288809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:32.288811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:32.288815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:32.288948Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:32.295305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1904 sessionId: src_id|128b6fba-db998c9d-d6acb5d1-c99d1ecf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:32.298191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:32.330729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896014637064510:6314]
2025-09-30T14:55:32.331039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1903, pipe: [1:7555896014637064510:6314]
2025-09-30T14:55:32.403740Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:32.404331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:32.404350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:32.404390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896014637064510:6314], now have 1 active actors on pipe
2025-09-30T14:55:32.404636Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:32.405817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|128b6fba-db998c9d-d6acb5d1-c99d1ecf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:32.405831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|128b6fba-db998c9d-d6acb5d1-c99d1ecf_0] Write session will restart in 0.007086s
2025-09-30T14:55:32.405857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|128b6fba-db998c9d-d6acb5d1-c99d1ecf_0] Write session: Do CDS request
2025-09-30T14:55:32.405863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|128b6fba-db998c9d-d6acb5d1-c99d1ecf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:32.405243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896014637064510:6314]
2025-09-30T14:55:32.405297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:32.405372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1904 reason: status is not ok: tablet will be restarted right now sessionId: src_id|128b6fba-db998c9d-d6acb5d1-c99d1ecf_0
2025-09-30T14:55:32.405573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1904 sessionId: src_id|128b6fba-db998c9d-d6acb5d1-c99d1ecf_0 is DEAD
2025-09-30T14:55:32.405732Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:32.413847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|128b6fba-db998c9d-d6acb5d1-c99d1ecf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:32.413987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:32.414010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1905
2025-09-30T14:55:32.414149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1905 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:32.414180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1905 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:32.414186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1905 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:32.414191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:32.414637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1905 sessionId:  describe result for acl check
2025-09-30T14:55:32.414679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:32.414687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:32.414692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:32.414698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896014637064524:6292] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:32.415288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896014637064524:6292] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:32.417747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896014637064524:6292] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:32.422141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896014637064524:6292] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:32.422162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896014637064524:6292] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:32.422166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896014637064524:6292] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:32.422176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1905 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:32.432117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:32.435308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:32.435548Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:32.435568Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:32.435580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:32.435639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:32.435691Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896014547295394:4862]
2025-09-30T14:55:32.436250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:32.436577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:32.436635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:32.437000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:32.437063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:32.437069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:32.437071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:32.437072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:32.437074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:32.437076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:32.437077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:32.437079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:32.437080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:32.437082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:32.437083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.437084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.437086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.437088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:32.437089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:32.437094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:32.437105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:32.437109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:32.437114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:32.437118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:32.437122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:32.437127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:32.437131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:32.437135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:32.437139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:32.437143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.437148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.437152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.437156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:32.437160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:32.437168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:32.437176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:32.437181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:32.437187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:32.437192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:32.437197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:32.437204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:32.437209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:32.437213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:32.437216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:32.437218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:32.437221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:32.437224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:32.437227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:32.437229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:32.437232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:32.437235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:32.437237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:32.437240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:32.437243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:32.437248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.437251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.437253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.437257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.437262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.437265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.437268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:32.437271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:32.437273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:32.437276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:32.437302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:32.443527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:32.444417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:32.444433Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:32.444437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:32.444441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:32.444449Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1904 [2:7555896014547295394:4862]
2025-09-30T14:55:32.444469Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:32.444488Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:32.444496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:32.444499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:32.444501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:32.444519Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:32.444531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:32.444543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:32.444606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.444613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.444616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.444622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:32.444625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:32.444702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:32.444710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.444723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.444739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.444757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:32.444780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896014637064512:2454], now have 1 active actors on pipe
2025-09-30T14:55:32.444789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896014637064605:6292], now have 1 active actors on pipe
2025-09-30T14:55:32.444795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896014547295389:4862]
2025-09-30T14:55:32.444797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896014547295389:4862]
2025-09-30T14:55:32.444799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896014547295389:4862]
2025-09-30T14:55:32.444814Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:32.444831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:32.444843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:32.444848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:32.444850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:32.444851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:32.444853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:32.444892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896014547295389:4862]
2025-09-30T14:55:32.444901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:32.444906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:32.444915Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1904
2025-09-30T14:55:32.444969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1904
2025-09-30T14:55:32.445099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:32.445116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:32.445147Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb61381a-76aae399-8c6bf93e-b11a72ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:32.445162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:32.445172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:32.445174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:32.445186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:32.445203Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:32.445226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:32.445429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:32.445443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:32.445466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:32.445578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1905 partition: 0 MaxSeqNo: 42 sessionId: src_id|eb61381a-76aae399-8c6bf93e-b11a72ff_0
2025-09-30T14:55:32.445979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|128b6fba-db998c9d-d6acb5d1-c99d1ecf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|eb61381a-76aae399-8c6bf93e-b11a72ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:32.448923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb61381a-76aae399-8c6bf93e-b11a72ff_0] Write session: try to update token
2025-09-30T14:55:32.448941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb61381a-76aae399-8c6bf93e-b11a72ff_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:32.457980Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:32.458001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:32.458013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896014547295389:4862]
2025-09-30T14:55:32.458065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:32.458074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:32.458264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:32.458433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:32.458595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:32.458762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:32.458972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:32.459014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:32.470696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1905 sessionId: src_id|eb61381a-76aae399-8c6bf93e-b11a72ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:32.472492Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:32.472517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:32.472520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:32.472522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:32.472533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896014547295389:4862]
2025-09-30T14:55:32.472537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896014547295389:4862]
2025-09-30T14:55:32.472541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896014547295389:4862]
2025-09-30T14:55:32.472585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:32.472588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:32.472592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.472595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:32.472595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:32.472599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:32.473789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:32.472751Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:32.505299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896014637064761:6314]
2025-09-30T14:55:32.505615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1904, pipe: [1:7555896014637064761:6314]
2025-09-30T14:55:32.588179Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:32.589022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:32.589042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:32.589069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896014637064761:6314], now have 1 active actors on pipe
2025-09-30T14:55:32.589297Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:32.589350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:32.589359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896014637064761:6314]
2025-09-30T14:55:32.589377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:32.589379Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:32.589453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1905 reason: error at write: Disconnected sessionId: src_id|eb61381a-76aae399-8c6bf93e-b11a72ff_0
2025-09-30T14:55:32.589658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1905 sessionId: src_id|eb61381a-76aae399-8c6bf93e-b11a72ff_0 is DEAD
2025-09-30T14:55:32.589887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb61381a-76aae399-8c6bf93e-b11a72ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:32.589904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb61381a-76aae399-8c6bf93e-b11a72ff_0] Write session will restart in 0.005904s
2025-09-30T14:55:32.589953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb61381a-76aae399-8c6bf93e-b11a72ff_0] Write session: Do CDS request
2025-09-30T14:55:32.589964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb61381a-76aae399-8c6bf93e-b11a72ff_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:32.596946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb61381a-76aae399-8c6bf93e-b11a72ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:32.597108Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:32.597137Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1906
2025-09-30T14:55:32.597341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1906 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:32.597417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1906 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:32.597430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1906 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:32.597437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:32.598043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1906 sessionId:  describe result for acl check
2025-09-30T14:55:32.598097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:32.598105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:32.598107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:32.598113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896014637064781:6283] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:32.598734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896014637064781:6283] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:32.602356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896014637064781:6283] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:32.606499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896014637064781:6283] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:32.606521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896014637064781:6283] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:32.606524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896014637064781:6283] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:32.606533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1906 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:32.616161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:32.620124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:32.620403Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:32.620414Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:32.620427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:32.620485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:32.620524Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896014547295635:4860]
2025-09-30T14:55:32.621219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:32.621753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:32.621811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:32.622173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:32.622256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:32.622264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:32.622265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:32.622266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:32.622268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:32.622269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:32.622270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:32.622272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:32.622273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:32.622275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:32.622276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.622278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.622280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.622281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:32.622282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:32.622288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:32.622299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:32.622303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:32.622307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:32.622311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:32.622315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:32.622319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:32.622323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:32.622328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:32.622332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:32.622337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.622342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.622346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.622350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:32.622354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:32.622365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:32.622374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:32.622381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:32.622387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:32.622393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:32.622398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:32.622404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:32.622409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:32.622415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:32.622421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:32.622426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:32.622433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:32.622438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:32.622443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:32.622449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:32.622454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:32.622459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:32.622463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:32.622467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:32.622472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:32.622477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.622483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.622487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.622493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.622498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.622504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.622509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:32.622515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:32.622520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:32.622525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:32.622576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:32.629983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:32.631046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:32.631063Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:32.631067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:32.631072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:32.631079Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1905 [2:7555896014547295635:4860]
2025-09-30T14:55:32.631096Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:32.631114Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:32.631117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:32.631120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:32.631122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:32.631139Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:32.631152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:32.631162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:32.631236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.631263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.631265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.631269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:32.631271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:32.631347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:32.631355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.631369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.631388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.631411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:32.631430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896014637064763:2454], now have 1 active actors on pipe
2025-09-30T14:55:32.631435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896014637064914:6283], now have 1 active actors on pipe
2025-09-30T14:55:32.631441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896014547295630:4860]
2025-09-30T14:55:32.631444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896014547295630:4860]
2025-09-30T14:55:32.631448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896014547295630:4860]
2025-09-30T14:55:32.631462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:32.631481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:32.631499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:32.631502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:32.631530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:32.631534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:32.631536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:32.631543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896014547295630:4860]
2025-09-30T14:55:32.631546Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:32.631501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1905
2025-09-30T14:55:32.631524Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1905
2025-09-30T14:55:32.631562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:32.631596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:32.631606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:32.631636Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a90af874-3b1a66c-9ee5e387-af265ca4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:32.631649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:32.631653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:32.631656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:32.631666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:32.631675Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:32.631691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:32.631869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:32.631878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:32.631891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:32.632031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1906 partition: 0 MaxSeqNo: 42 sessionId: src_id|a90af874-3b1a66c-9ee5e387-af265ca4_0
2025-09-30T14:55:32.632464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb61381a-76aae399-8c6bf93e-b11a72ff_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a90af874-3b1a66c-9ee5e387-af265ca4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:32.635957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a90af874-3b1a66c-9ee5e387-af265ca4_0] Write session: try to update token
2025-09-30T14:55:32.635983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a90af874-3b1a66c-9ee5e387-af265ca4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:32.644873Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:32.644896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:32.644899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:32.644902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:32.644911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896014547295630:4860]
2025-09-30T14:55:32.644916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896014547295630:4860]
2025-09-30T14:55:32.644921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896014547295630:4860]
2025-09-30T14:55:32.644966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:32.644973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.644977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:32.645096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:32.645113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:32.645118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:32.645135Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:32.657552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1906 sessionId: src_id|a90af874-3b1a66c-9ee5e387-af265ca4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:32.660946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:32.689716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896014637065015:6314]
2025-09-30T14:55:32.690155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1905, pipe: [1:7555896014637065015:6314]
2025-09-30T14:55:32.758377Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:32.759118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:32.759136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:32.759156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896014637065015:6314], now have 1 active actors on pipe
2025-09-30T14:55:32.759406Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:32.759393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:32.759414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:32.759421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896014637065015:6314]
2025-09-30T14:55:32.759442Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:32.759485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1906 reason: error at write: Disconnected sessionId: src_id|a90af874-3b1a66c-9ee5e387-af265ca4_0
2025-09-30T14:55:32.759669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1906 sessionId: src_id|a90af874-3b1a66c-9ee5e387-af265ca4_0 is DEAD
2025-09-30T14:55:32.759863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a90af874-3b1a66c-9ee5e387-af265ca4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:32.759878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a90af874-3b1a66c-9ee5e387-af265ca4_0] Write session will restart in 0.008966s
2025-09-30T14:55:32.759914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a90af874-3b1a66c-9ee5e387-af265ca4_0] Write session: Do CDS request
2025-09-30T14:55:32.759922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a90af874-3b1a66c-9ee5e387-af265ca4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:32.769987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a90af874-3b1a66c-9ee5e387-af265ca4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:32.770128Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:32.770163Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1907
2025-09-30T14:55:32.770349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1907 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:32.770398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1907 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:32.770411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1907 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:32.770416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:32.771003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1907 sessionId:  describe result for acl check
2025-09-30T14:55:32.771037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:32.771039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:32.771041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:32.771048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896014637065085:6276] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:32.771605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896014637065085:6276] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:32.774807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896014637065085:6276] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:32.777985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896014637065085:6276] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:32.778017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896014637065085:6276] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:32.778021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896014637065085:6276] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:32.778030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1907 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:32.779016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:32.785247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:32.785511Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:32.785522Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:32.785535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:32.785639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:32.785698Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896014547295889:4838]
2025-09-30T14:55:32.786344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:32.786717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:32.786769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:32.787080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:32.787137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:32.787142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:32.787143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:32.787143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:32.787145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:32.787145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:32.787146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:32.787147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:32.787148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:32.787149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:32.787150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.787150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.787151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.787152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:32.787153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:32.787158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:32.787169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:32.787173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:32.787177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:32.787180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:32.787184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:32.787188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:32.787192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:32.787197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:32.787201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:32.787205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.787210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.787213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.787217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:32.787221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:32.787229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:32.787236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:32.787261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:32.787268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:32.787273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:32.787279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:32.787285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:32.787289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:32.787293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:32.787296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:32.787299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:32.787303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:32.787306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:32.787309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:32.787311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:32.787315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:32.787318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:32.787321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:32.787326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:32.787332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:32.787340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.787345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.787349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.787353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.787359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.787363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.787368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:32.787373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:32.787378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:32.787383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:32.787429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:32.793292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:32.794205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:32.794228Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:32.794232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:32.794236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:32.794244Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1906 [2:7555896014547295889:4838]
2025-09-30T14:55:32.794261Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:32.794279Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:32.794282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:32.794285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:32.794288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:32.794307Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:32.794321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:32.794329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:32.794413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.794421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.794423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.794428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:32.794430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:32.794505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:32.794514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.794528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.794541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.794560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:32.794583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896014637065266:6276], now have 1 active actors on pipe
2025-09-30T14:55:32.794591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896014637065016:2454], now have 1 active actors on pipe
2025-09-30T14:55:32.794598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896014547295884:4838]
2025-09-30T14:55:32.794605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896014547295884:4838]
2025-09-30T14:55:32.794607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896014547295884:4838]
2025-09-30T14:55:32.794621Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:32.794642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:32.794648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:32.794653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:32.794655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:32.794661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:32.794665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:32.794700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896014547295884:4838]
2025-09-30T14:55:32.794711Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:32.794719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:32.794838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1906
2025-09-30T14:55:32.794894Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1906
2025-09-30T14:55:32.794929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:32.794943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:32.794974Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af9d71b8-138956a-bb38d89e-804a8373_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:32.794986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:32.794990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:32.794995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:32.795004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:32.795019Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:32.795038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:32.795160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:32.795167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:32.795179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:32.795282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1907 partition: 0 MaxSeqNo: 42 sessionId: src_id|af9d71b8-138956a-bb38d89e-804a8373_0
2025-09-30T14:55:32.795685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a90af874-3b1a66c-9ee5e387-af265ca4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|af9d71b8-138956a-bb38d89e-804a8373_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:32.798788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af9d71b8-138956a-bb38d89e-804a8373_0] Write session: try to update token
2025-09-30T14:55:32.798809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af9d71b8-138956a-bb38d89e-804a8373_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:32.807796Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:32.807825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:32.807835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896014547295884:4838]
2025-09-30T14:55:32.807892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:32.807892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:32.808186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:32.808416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:32.808579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:32.808734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:32.809051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:32.809109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:32.819396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1907 sessionId: src_id|af9d71b8-138956a-bb38d89e-804a8373_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:32.821167Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:32.821186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:32.821189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:32.821191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:32.821204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896014547295884:4838]
2025-09-30T14:55:32.821210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896014547295884:4838]
2025-09-30T14:55:32.821215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896014547295884:4838]
2025-09-30T14:55:32.821258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:32.821266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.821270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:32.821273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:32.821281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:32.821286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:32.821420Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:32.822293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:32.859614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896014637065280:6314]
2025-09-30T14:55:32.859970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1906, pipe: [1:7555896014637065280:6314]
2025-09-30T14:55:32.936348Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:32.937081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:32.937100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:32.937123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896014637065280:6314], now have 1 active actors on pipe
2025-09-30T14:55:32.937359Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:32.937398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896014637065280:6314]
2025-09-30T14:55:32.937417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:32.937421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:32.937433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:32.937504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1907 reason: error at write: Disconnected sessionId: src_id|af9d71b8-138956a-bb38d89e-804a8373_0
2025-09-30T14:55:32.937696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1907 sessionId: src_id|af9d71b8-138956a-bb38d89e-804a8373_0 is DEAD
2025-09-30T14:55:32.937841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af9d71b8-138956a-bb38d89e-804a8373_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:32.937858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af9d71b8-138956a-bb38d89e-804a8373_0] Write session will restart in 0.006180s
2025-09-30T14:55:32.937882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af9d71b8-138956a-bb38d89e-804a8373_0] Write session: Do CDS request
2025-09-30T14:55:32.937894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af9d71b8-138956a-bb38d89e-804a8373_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:32.944948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af9d71b8-138956a-bb38d89e-804a8373_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:32.945028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:32.945048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1908
2025-09-30T14:55:32.945212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1908 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:32.945249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1908 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:32.945254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1908 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:32.945258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:32.945732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1908 sessionId:  describe result for acl check
2025-09-30T14:55:32.945780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:32.945787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:32.945789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:32.945796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896014637065299:6272] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:32.946453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896014637065299:6272] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:32.949214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896014637065299:6272] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:32.953298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896014637065299:6272] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:32.953319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896014637065299:6272] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:32.953323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896014637065299:6272] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:32.953333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1908 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:32.957933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:32.961146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:32.961392Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:32.961408Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:32.961420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:32.961487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:32.961534Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896014547296134:4839]
2025-09-30T14:55:32.962240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:32.962615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:32.962676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:32.963056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:32.963127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:32.963133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:32.963135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:32.963136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:32.963137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:32.963138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:32.963139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:32.963140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:32.963142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:32.963143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:32.963144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.963145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.963146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.963148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:32.963149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:32.963155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:32.963165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:32.963169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:32.963174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:32.963178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:32.963183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:32.963187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:32.963191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:32.963195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:32.963200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:32.963204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.963208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.963213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.963216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:32.963221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:32.963229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:32.963237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:32.963259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:32.963266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:32.963272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:32.963278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:32.963283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:32.963289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:32.963295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:32.963302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:32.963314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:32.963319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:32.963328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:32.963333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:32.963338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:32.963344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:32.963354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:32.963361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:32.963371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:32.963377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:32.963382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.963387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.963393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.963398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.963404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.963409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.963413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:32.963418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:32.963423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:32.963429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:32.963475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:32.969262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:32.970794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:32.970814Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:32.970818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:32.970822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:32.970829Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1907 [2:7555896014547296134:4839]
2025-09-30T14:55:32.970847Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:32.970866Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:32.970869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:32.970873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:32.970876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:32.970895Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:32.970911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:32.970918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:32.970989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.970996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.970998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.971002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:32.971004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:32.971077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:32.971086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.971102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:32.971119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:32.971140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:32.971160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896014547296129:4839]
2025-09-30T14:55:32.971166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896014547296129:4839]
2025-09-30T14:55:32.971168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896014547296129:4839]
2025-09-30T14:55:32.971186Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:32.971205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:32.971225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:32.971232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:32.971289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896014547296129:4839]
2025-09-30T14:55:32.971297Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:32.973868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:32.973886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:32.973889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:32.973898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:32.974113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896014637065446:6272], now have 1 active actors on pipe
2025-09-30T14:55:32.974131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896014637065281:2454], now have 1 active actors on pipe
2025-09-30T14:55:32.974226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1907
2025-09-30T14:55:32.974275Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1907
2025-09-30T14:55:32.974679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:32.974694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:32.974731Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8bf837f8-5d72b206-1560573-3a21be9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:32.974746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:32.974751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:32.974755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:32.974768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:32.974789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:32.974825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:32.975019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:32.975028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:32.975045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:32.975147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1908 partition: 0 MaxSeqNo: 42 sessionId: src_id|8bf837f8-5d72b206-1560573-3a21be9_0
2025-09-30T14:55:32.975477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af9d71b8-138956a-bb38d89e-804a8373_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8bf837f8-5d72b206-1560573-3a21be9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:32.978328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf837f8-5d72b206-1560573-3a21be9_0] Write session: try to update token
2025-09-30T14:55:32.978349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf837f8-5d72b206-1560573-3a21be9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:32.988532Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:32.988553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:32.988555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:32.988556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:32.988565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896014547296129:4839]
2025-09-30T14:55:32.988568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896014547296129:4839]
2025-09-30T14:55:32.988571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896014547296129:4839]
2025-09-30T14:55:32.988605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:32.988612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:32.988614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:32.988755Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:32.989281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:32.989288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:32.989296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:33.000221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1908 sessionId: src_id|8bf837f8-5d72b206-1560573-3a21be9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:33.003104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:33.037783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896018932032830:6314]
2025-09-30T14:55:33.038122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1907, pipe: [1:7555896018932032830:6314]
2025-09-30T14:55:33.104000Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:33.104487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:33.104503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:33.104545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896018932032830:6314], now have 1 active actors on pipe
2025-09-30T14:55:33.104794Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:33.104813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:33.104819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896018932032830:6314]
2025-09-30T14:55:33.104841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:33.104843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:33.104906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1908 reason: error at write: Disconnected sessionId: src_id|8bf837f8-5d72b206-1560573-3a21be9_0
2025-09-30T14:55:33.105102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1908 sessionId: src_id|8bf837f8-5d72b206-1560573-3a21be9_0 is DEAD
2025-09-30T14:55:33.105258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf837f8-5d72b206-1560573-3a21be9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:33.105267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf837f8-5d72b206-1560573-3a21be9_0] Write session will restart in 0.006891s
2025-09-30T14:55:33.105300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf837f8-5d72b206-1560573-3a21be9_0] Write session: Do CDS request
2025-09-30T14:55:33.105309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf837f8-5d72b206-1560573-3a21be9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:33.113967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf837f8-5d72b206-1560573-3a21be9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:33.114398Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:33.114416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1909
2025-09-30T14:55:33.114703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1909 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:33.114753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1909 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:33.114759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1909 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:33.114763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:33.115272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1909 sessionId:  describe result for acl check
2025-09-30T14:55:33.115311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:33.115318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:33.115320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:33.115325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896018932032868:6266] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:33.115913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896018932032868:6266] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:33.121691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896018932032868:6266] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:33.125430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896018932032868:6266] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:33.125452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896018932032868:6266] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:33.125457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896018932032868:6266] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:33.125466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1909 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:33.125961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:33.129124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:33.129370Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:33.129380Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:33.129392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:33.129451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:33.129498Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896018842263674:4848]
2025-09-30T14:55:33.130223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:33.130519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:33.130567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:33.130899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:33.130966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:33.130972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:33.130973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:33.130975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:33.130976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:33.130977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:33.130979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:33.130980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:33.130982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:33.130983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:33.130984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.130985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:33.130987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:33.130988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:33.130989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:33.130996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:33.131008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:33.131012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:33.131017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:33.131022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:33.131027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:33.131032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:33.131037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:33.131041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:33.131046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:33.131050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.131055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:33.131060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:33.131065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:33.131070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:33.131078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:33.131086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:33.131093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:33.131101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:33.131111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:33.131118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:33.131128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:33.131134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:33.131144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:33.131151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:33.131156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:33.131162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:33.131172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:33.131178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:33.131191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:33.131201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:33.131207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:33.131217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:33.131222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:33.131233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:33.131259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.131267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.131275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:33.131279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:33.131284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:33.131290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:33.131299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:33.131305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:33.131310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:33.131320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:33.131371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:33.137113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:33.138178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:33.138194Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:33.138197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:33.138201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:33.138208Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1908 [2:7555896018842263674:4848]
2025-09-30T14:55:33.138224Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:33.138240Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:33.138248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:33.138251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:33.138254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:33.138269Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:33.138276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:33.138288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:33.138349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.138358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:33.138359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:33.138363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:33.138365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:33.138428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:33.138436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.138448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:33.138460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:33.138478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:33.138510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896018932033077:6266], now have 1 active actors on pipe
2025-09-30T14:55:33.138519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896018932032834:2454], now have 1 active actors on pipe
2025-09-30T14:55:33.138525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896018842263669:4848]
2025-09-30T14:55:33.138528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896018842263669:4848]
2025-09-30T14:55:33.138530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896018842263669:4848]
2025-09-30T14:55:33.138542Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:33.138557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:33.138541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1908
2025-09-30T14:55:33.138573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:33.138576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:33.138579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:33.138585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:33.138553Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1908
2025-09-30T14:55:33.138587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:33.138623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:33.138632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:33.138643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896018842263669:4848]
2025-09-30T14:55:33.138653Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:33.138661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:33.138681Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|758cb247-6a067384-9d315ebe-399b80fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:33.138692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:33.138696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:33.138698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:33.138708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:33.138718Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:33.138746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:33.138848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:33.138856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:33.138869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:33.138942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1909 partition: 0 MaxSeqNo: 42 sessionId: src_id|758cb247-6a067384-9d315ebe-399b80fe_0
2025-09-30T14:55:33.139297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf837f8-5d72b206-1560573-3a21be9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|758cb247-6a067384-9d315ebe-399b80fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:33.142119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|758cb247-6a067384-9d315ebe-399b80fe_0] Write session: try to update token
2025-09-30T14:55:33.142138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|758cb247-6a067384-9d315ebe-399b80fe_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:33.151008Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:33.151030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:33.151033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:33.151035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:33.151049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896018842263669:4848]
2025-09-30T14:55:33.151054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896018842263669:4848]
2025-09-30T14:55:33.151058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896018842263669:4848]
2025-09-30T14:55:33.151096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:33.151104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.151105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:33.151107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:33.151111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:33.151117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:33.151277Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:33.164606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1909 sessionId: src_id|758cb247-6a067384-9d315ebe-399b80fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:33.167754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:33.205144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896018932033097:6314]
2025-09-30T14:55:33.207539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1908, pipe: [1:7555896018932033097:6314]
2025-09-30T14:55:33.284885Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:33.285522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:33.285539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:33.285571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896018932033097:6314], now have 1 active actors on pipe
2025-09-30T14:55:33.286475Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:33.286021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:33.286039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:33.287475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|758cb247-6a067384-9d315ebe-399b80fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:33.287490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|758cb247-6a067384-9d315ebe-399b80fe_0] Write session will restart in 0.007558s
2025-09-30T14:55:33.286113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1909 reason: error at write: Disconnected sessionId: src_id|758cb247-6a067384-9d315ebe-399b80fe_0
2025-09-30T14:55:33.286282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1909 sessionId: src_id|758cb247-6a067384-9d315ebe-399b80fe_0 is DEAD
2025-09-30T14:55:33.287507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|758cb247-6a067384-9d315ebe-399b80fe_0] Write session: Do CDS request
2025-09-30T14:55:33.286607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:33.287512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|758cb247-6a067384-9d315ebe-399b80fe_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:33.286652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896018932033097:6314]
2025-09-30T14:55:33.299276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|758cb247-6a067384-9d315ebe-399b80fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:33.299403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:33.299434Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1910
2025-09-30T14:55:33.299742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1910 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:33.299786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1910 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:33.299804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1910 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:33.299811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:33.300224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1910 sessionId:  describe result for acl check
2025-09-30T14:55:33.300265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:33.300275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:33.300277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:33.300283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896018932033150:6241] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:33.300844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896018932033150:6241] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:33.303046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896018932033150:6241] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:33.308016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896018932033150:6241] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:33.308038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896018932033150:6241] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:33.308041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896018932033150:6241] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:33.308050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1910 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:33.323695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:33.326781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:33.327327Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:33.327343Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:33.327355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:33.327433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:33.327478Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896018842263955:4827]
2025-09-30T14:55:33.328171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:33.329133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:33.329222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:33.329643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:33.329744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:33.329753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:33.329755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:33.329756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:33.329758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:33.329759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:33.329761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:33.329762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:33.329764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:33.329765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:33.329767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.329768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:33.329770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:33.329771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:33.329772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:33.329780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:33.329791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:33.329795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:33.329798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:33.329803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:33.329807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:33.329811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:33.329815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:33.329819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:33.329823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:33.329826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.329829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:33.329832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:33.329836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:33.329839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:33.329850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:33.329858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:33.329863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:33.329869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:33.329874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:33.329879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:33.329883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:33.329888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:33.329895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:33.329900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:33.329904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:33.329909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:33.329914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:33.329919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:33.329924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:33.329929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:33.329935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:33.329940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:33.329946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:33.329951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:33.329956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.329961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.329966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:33.329971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:33.329976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:33.329981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:33.329986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:33.329991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:33.329996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:33.330001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:33.330045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:33.336019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:33.336906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:33.336925Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:33.336928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:33.336932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:33.336940Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1909 [2:7555896018842263955:4827]
2025-09-30T14:55:33.336957Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:33.336975Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:33.336978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:33.336981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:33.336984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:33.337000Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:33.337008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:33.337015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:33.337079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.337090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:33.337092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:33.337096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:33.337098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:33.337172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:33.337182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.337199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:33.337212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:33.337230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:33.337250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896018932033224:6241], now have 1 active actors on pipe
2025-09-30T14:55:33.337260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896018932033120:2454], now have 1 active actors on pipe
2025-09-30T14:55:33.337267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896018842263950:4827]
2025-09-30T14:55:33.337270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896018842263950:4827]
2025-09-30T14:55:33.337272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896018842263950:4827]
2025-09-30T14:55:33.337285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:33.337301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:33.337308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:33.337312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:33.337315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:33.337323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:33.337327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:33.337318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1909
2025-09-30T14:55:33.337362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896018842263950:4827]
2025-09-30T14:55:33.337379Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:33.337334Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1909
2025-09-30T14:55:33.337403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:33.337412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:33.337413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:33.337456Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aaf06426-45d3704d-bbddb3d-fed4ef24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:33.337467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:33.337471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:33.337473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:33.337485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:33.337494Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:33.337511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:33.337787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:33.337799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:33.337815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:33.337920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1910 partition: 0 MaxSeqNo: 42 sessionId: src_id|aaf06426-45d3704d-bbddb3d-fed4ef24_0
2025-09-30T14:55:33.338364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|758cb247-6a067384-9d315ebe-399b80fe_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|aaf06426-45d3704d-bbddb3d-fed4ef24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:33.341891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaf06426-45d3704d-bbddb3d-fed4ef24_0] Write session: try to update token
2025-09-30T14:55:33.341915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaf06426-45d3704d-bbddb3d-fed4ef24_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:33.350566Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:33.350587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:33.350590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:33.350593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:33.350602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896018842263950:4827]
2025-09-30T14:55:33.350608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896018842263950:4827]
2025-09-30T14:55:33.350613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896018842263950:4827]
2025-09-30T14:55:33.350652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:33.350658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:33.350661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.350663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:33.350664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:33.350668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:33.350819Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:33.362144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1910 sessionId: src_id|aaf06426-45d3704d-bbddb3d-fed4ef24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:33.365639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:33.386976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896018932033387:6314]
2025-09-30T14:55:33.387358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1909, pipe: [1:7555896018932033387:6314]
2025-09-30T14:55:33.468133Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:33.468685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:33.468702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:33.468722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896018932033387:6314], now have 1 active actors on pipe
2025-09-30T14:55:33.468957Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:33.468988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:33.469006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:33.469031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896018932033387:6314]
2025-09-30T14:55:33.469073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:33.469077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1910 reason: error at write: Disconnected sessionId: src_id|aaf06426-45d3704d-bbddb3d-fed4ef24_0
2025-09-30T14:55:33.469245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1910 sessionId: src_id|aaf06426-45d3704d-bbddb3d-fed4ef24_0 is DEAD
2025-09-30T14:55:33.469489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaf06426-45d3704d-bbddb3d-fed4ef24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:33.469513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaf06426-45d3704d-bbddb3d-fed4ef24_0] Write session will restart in 0.007413s
2025-09-30T14:55:33.469545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaf06426-45d3704d-bbddb3d-fed4ef24_0] Write session: Do CDS request
2025-09-30T14:55:33.469564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaf06426-45d3704d-bbddb3d-fed4ef24_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:33.477950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaf06426-45d3704d-bbddb3d-fed4ef24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:33.478703Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:33.478726Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1911
2025-09-30T14:55:33.483451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1911 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:33.483531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1911 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:33.483554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1911 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:33.483559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:33.484124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1911 sessionId:  describe result for acl check
2025-09-30T14:55:33.484165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:33.484173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:33.484176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:33.484185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896018932033540:6238] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:33.484839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896018932033540:6238] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:33.487711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896018932033540:6238] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:33.488007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:33.491146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:33.491524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896018932033540:6238] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:33.491543Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:33.491544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896018932033540:6238] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:33.491557Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:33.491573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:33.491551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896018932033540:6238] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:33.491559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1911 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:33.491649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:33.491735Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896018842264201:4809]
2025-09-30T14:55:33.492505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:33.492857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:33.492929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:33.493333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:33.493411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:33.493419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:33.493420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:33.493422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:33.493424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:33.493426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:33.493428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:33.493429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:33.493431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:33.493433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:33.493435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.493436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:33.493438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:33.493439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:33.493441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:33.493447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:33.493460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:33.493465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:33.493469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:33.493474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:33.493478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:33.493483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:33.493488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:33.493492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:33.493497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:33.493501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.493506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:33.493510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:33.493515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:33.493519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:33.493543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:33.493563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:33.493571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:33.493578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:33.493584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:33.493590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:33.493596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:33.493609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:33.493615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:33.493622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:33.493627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:33.493633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:33.493647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:33.493653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:33.493658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:33.493664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:33.493671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:33.493678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:33.493684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:33.493690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:33.493695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.493704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.493709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:33.493715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:33.493720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:33.493726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:33.493739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:33.493745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:33.493750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:33.493756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:33.493818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:33.499761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:33.500798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:33.500820Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:33.500824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:33.500829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:33.500838Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1910 [2:7555896018842264201:4809]
2025-09-30T14:55:33.500859Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:33.500881Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:33.500885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:33.500890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:33.500893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:33.500916Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:33.500932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:33.500941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:33.501021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.501032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:33.501036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:33.501041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:33.501044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:33.501133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:33.501144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.501156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:33.501169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:33.501190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:33.501222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896018932033633:6238], now have 1 active actors on pipe
2025-09-30T14:55:33.501232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896018932033389:2454], now have 1 active actors on pipe
2025-09-30T14:55:33.501240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896018842264196:4809]
2025-09-30T14:55:33.501244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896018842264196:4809]
2025-09-30T14:55:33.501247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896018842264196:4809]
2025-09-30T14:55:33.501262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:33.501272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:33.501274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:33.501277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:33.501286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:33.501304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:33.501315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:33.501279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1910
2025-09-30T14:55:33.501280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1910
2025-09-30T14:55:33.501380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:33.501392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:33.501409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896018842264196:4809]
2025-09-30T14:55:33.501422Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:33.501429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:33.501457Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a56cdd27-712cdba3-a3ec2ac6-15821a3f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:33.501474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:33.501479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:33.501488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:33.501501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:33.501519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:33.501567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:33.501798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:33.501810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:33.501827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:33.501953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1911 partition: 0 MaxSeqNo: 42 sessionId: src_id|a56cdd27-712cdba3-a3ec2ac6-15821a3f_0
2025-09-30T14:55:33.502381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaf06426-45d3704d-bbddb3d-fed4ef24_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a56cdd27-712cdba3-a3ec2ac6-15821a3f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:33.505709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a56cdd27-712cdba3-a3ec2ac6-15821a3f_0] Write session: try to update token
2025-09-30T14:55:33.505733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a56cdd27-712cdba3-a3ec2ac6-15821a3f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:33.514628Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:33.514657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:33.514660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:33.514663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:33.514679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896018842264196:4809]
2025-09-30T14:55:33.514686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896018842264196:4809]
2025-09-30T14:55:33.514691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896018842264196:4809]
2025-09-30T14:55:33.514746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:33.514745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:33.514761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.514761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:33.514765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:33.514767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:33.514941Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:33.527424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1911 sessionId: src_id|a56cdd27-712cdba3-a3ec2ac6-15821a3f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:33.530495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:33.569235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896018932033644:6314]
2025-09-30T14:55:33.569523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1910, pipe: [1:7555896018932033644:6314]
2025-09-30T14:55:33.639208Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:33.640582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:33.640602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:33.640628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896018932033644:6314], now have 1 active actors on pipe
2025-09-30T14:55:33.640899Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:33.641128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:33.641160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:33.641164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:33.641198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896018932033644:6314]
2025-09-30T14:55:33.641257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1911 reason: error at write: Disconnected sessionId: src_id|a56cdd27-712cdba3-a3ec2ac6-15821a3f_0
2025-09-30T14:55:33.641678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a56cdd27-712cdba3-a3ec2ac6-15821a3f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:33.641688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a56cdd27-712cdba3-a3ec2ac6-15821a3f_0] Write session will restart in 0.006019s
2025-09-30T14:55:33.641718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a56cdd27-712cdba3-a3ec2ac6-15821a3f_0] Write session: Do CDS request
2025-09-30T14:55:33.641726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a56cdd27-712cdba3-a3ec2ac6-15821a3f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:33.641757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1911 sessionId: src_id|a56cdd27-712cdba3-a3ec2ac6-15821a3f_0 is DEAD
2025-09-30T14:55:33.648931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a56cdd27-712cdba3-a3ec2ac6-15821a3f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:33.649354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:33.649382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1912
2025-09-30T14:55:33.649649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1912 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:33.649688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1912 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:33.649694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1912 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:33.649697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:33.650116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1912 sessionId:  describe result for acl check
2025-09-30T14:55:33.650151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:33.650154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:33.650156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:33.650162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896018932033668:6229] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:33.650687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896018932033668:6229] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:33.653379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896018932033668:6229] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:33.658092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896018932033668:6229] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:33.658112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896018932033668:6229] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:33.658115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896018932033668:6229] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:33.658123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1912 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:33.661108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:33.663872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:33.664124Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:33.664134Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:33.664146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:33.664208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:33.664251Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896018842264460:4819]
2025-09-30T14:55:33.664947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:33.665259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:33.665319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:33.665675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:33.665754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:33.665763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:33.665764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:33.665766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:33.665767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:33.665769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:33.665771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:33.665772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:33.665773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:33.665775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:33.665776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.665777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:33.665779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:33.665781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:33.665782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:33.665788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:33.665808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:33.665812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:33.665817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:33.665821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:33.665826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:33.665830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:33.665834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:33.665839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:33.665843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:33.665848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.665852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:33.665856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:33.665861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:33.665865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:33.665873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:33.665881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:33.665887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:33.665892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:33.665898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:33.665903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:33.665907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:33.665913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:33.665920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:33.665926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:33.665932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:33.665938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:33.665944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:33.665949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:33.665954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:33.665960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:33.665966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:33.665972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:33.665976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:33.665982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:33.665989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.665995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.665999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:33.666005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:33.666008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:33.666011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:33.666014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:33.666018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:33.666021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:33.666024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:33.666051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:33.671569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:33.672436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:33.672454Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:33.672456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:33.672460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:33.672465Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1911 [2:7555896018842264460:4819]
2025-09-30T14:55:33.672480Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:33.672495Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:33.672497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:33.672500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:33.672502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:33.672515Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:33.672520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:33.672526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:33.672577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.672579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:33.672581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:33.672584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:33.672586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:33.672645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:33.672652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.672661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:33.672668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:33.672678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:33.672698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896018842264455:4819]
2025-09-30T14:55:33.672705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896018842264455:4819]
2025-09-30T14:55:33.672707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896018842264455:4819]
2025-09-30T14:55:33.672714Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:33.672727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:33.672730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896018932033647:2454], now have 1 active actors on pipe
2025-09-30T14:55:33.672733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896018932033877:6229], now have 1 active actors on pipe
2025-09-30T14:55:33.672741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:33.672746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:33.672749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:33.672756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:33.672760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:33.672796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896018842264455:4819]
2025-09-30T14:55:33.672810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:33.672813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:33.672801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1911
2025-09-30T14:55:33.672852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:33.672828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1911
2025-09-30T14:55:33.672865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:33.672895Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1b0e39d-664c522a-f4f1ca53-c336d9ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:33.672901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:33.672905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:33.672906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:33.672914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:33.672922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:33.672932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:33.673135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:33.673151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:33.673172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:33.673295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1912 partition: 0 MaxSeqNo: 42 sessionId: src_id|c1b0e39d-664c522a-f4f1ca53-c336d9ac_0
2025-09-30T14:55:33.673699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a56cdd27-712cdba3-a3ec2ac6-15821a3f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c1b0e39d-664c522a-f4f1ca53-c336d9ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:33.676810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1b0e39d-664c522a-f4f1ca53-c336d9ac_0] Write session: try to update token
2025-09-30T14:55:33.676831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1b0e39d-664c522a-f4f1ca53-c336d9ac_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:33.689932Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:33.689957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:33.689970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896018842264455:4819]
2025-09-30T14:55:33.690019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:33.690029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:33.690214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:33.690372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:33.690530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:33.690686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:33.690889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:33.690938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:33.697269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1912 sessionId: src_id|c1b0e39d-664c522a-f4f1ca53-c336d9ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:33.696413Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:33.696433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:33.696436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:33.696438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:33.696449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896018842264455:4819]
2025-09-30T14:55:33.696455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896018842264455:4819]
2025-09-30T14:55:33.696459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896018842264455:4819]
2025-09-30T14:55:33.696497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:33.696505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.696507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:33.696519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:33.696527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:33.696531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:33.696666Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:33.700019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:33.741326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896018932033903:6314]
2025-09-30T14:55:33.743653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1911, pipe: [1:7555896018932033903:6314]
2025-09-30T14:55:33.812122Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:33.812734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:33.812749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:33.812767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896018932033903:6314], now have 1 active actors on pipe
2025-09-30T14:55:33.813081Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:33.813053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:33.813074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:33.813141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1912 reason: error at write: Disconnected sessionId: src_id|c1b0e39d-664c522a-f4f1ca53-c336d9ac_0
2025-09-30T14:55:33.813164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896018932033903:6314]
2025-09-30T14:55:33.813193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:33.813516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1b0e39d-664c522a-f4f1ca53-c336d9ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:33.813528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1b0e39d-664c522a-f4f1ca53-c336d9ac_0] Write session will restart in 0.005118s
2025-09-30T14:55:33.813563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1b0e39d-664c522a-f4f1ca53-c336d9ac_0] Write session: Do CDS request
2025-09-30T14:55:33.813333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1912 sessionId: src_id|c1b0e39d-664c522a-f4f1ca53-c336d9ac_0 is DEAD
2025-09-30T14:55:33.813570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1b0e39d-664c522a-f4f1ca53-c336d9ac_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:33.819856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1b0e39d-664c522a-f4f1ca53-c336d9ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:33.819952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:33.819973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1913
2025-09-30T14:55:33.820081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1913 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:33.820113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1913 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:33.820124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1913 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:33.820128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:33.820591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1913 sessionId:  describe result for acl check
2025-09-30T14:55:33.820630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:33.820640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:33.820643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:33.820649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896018932033933:6223] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:33.821197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896018932033933:6223] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:33.823497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896018932033933:6223] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:33.827423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896018932033933:6223] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:33.827441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896018932033933:6223] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:33.827445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896018932033933:6223] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:33.827467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1913 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:33.833919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:33.837111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:33.837341Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:33.837356Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:33.837367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:33.837435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:33.837480Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896018842264709:4816]
2025-09-30T14:55:33.838152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:33.838493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:33.838539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:33.838877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:33.838945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:33.838946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:33.838948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:33.838949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:33.838950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:33.838952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:33.838953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:33.838955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:33.838956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:33.838957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:33.838959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.838960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:33.838961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:33.838962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:33.838964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:33.838969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:33.838980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:33.838985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:33.838989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:33.838993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:33.838998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:33.839002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:33.839006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:33.839009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:33.839014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:33.839018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.839022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:33.839026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:33.839030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:33.839034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:33.839041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:33.839049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:33.839055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:33.839062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:33.839066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:33.839073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:33.839077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:33.839083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:33.839088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:33.839093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:33.839098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:33.839103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:33.839109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:33.839114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:33.839119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:33.839124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:33.839129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:33.839134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:33.839138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:33.839145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:33.839151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.839156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.839161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:33.839167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:33.839173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:33.839178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:33.839183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:33.839188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:33.839193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:33.839198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:33.839260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:33.844936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:33.845833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:33.845849Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:33.845853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:33.845857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:33.845864Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1912 [2:7555896018842264709:4816]
2025-09-30T14:55:33.845882Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:33.845915Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:33.845924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:33.845928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:33.845930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:33.845947Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:33.845955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:33.845963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:33.846034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.846042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:33.846045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:33.846049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:33.846051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:33.846124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:33.846132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.846145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:33.846161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:33.846178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:33.846205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896018932034046:6223], now have 1 active actors on pipe
2025-09-30T14:55:33.846209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896018932033916:2454], now have 1 active actors on pipe
2025-09-30T14:55:33.846216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896018842264704:4816]
2025-09-30T14:55:33.846219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896018842264704:4816]
2025-09-30T14:55:33.846221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896018842264704:4816]
2025-09-30T14:55:33.846234Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:33.846248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:33.846256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:33.846262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:33.846265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:33.846267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:33.846279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:33.846299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896018842264704:4816]
2025-09-30T14:55:33.846307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:33.846315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:33.846282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1912
2025-09-30T14:55:33.846306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1912
2025-09-30T14:55:33.846350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:33.846359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:33.846389Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf79aa32-a1e3c03c-9f2ac50d-c06c603c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:33.846401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:33.846405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:33.846407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:33.846417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:33.846431Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:33.846447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:33.846659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:33.846673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:33.846697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:33.846809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1913 partition: 0 MaxSeqNo: 42 sessionId: src_id|cf79aa32-a1e3c03c-9f2ac50d-c06c603c_0
2025-09-30T14:55:33.847262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1b0e39d-664c522a-f4f1ca53-c336d9ac_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cf79aa32-a1e3c03c-9f2ac50d-c06c603c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:33.850814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf79aa32-a1e3c03c-9f2ac50d-c06c603c_0] Write session: try to update token
2025-09-30T14:55:33.850838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf79aa32-a1e3c03c-9f2ac50d-c06c603c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:33.858736Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:33.858754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:33.858756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:33.858757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:33.858766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896018842264704:4816]
2025-09-30T14:55:33.858770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896018842264704:4816]
2025-09-30T14:55:33.858773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896018842264704:4816]
2025-09-30T14:55:33.858812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:33.858819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:33.858822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:33.858824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:33.858832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:33.858837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:33.858955Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:33.869905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1913 sessionId: src_id|cf79aa32-a1e3c03c-9f2ac50d-c06c603c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:33.873187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:33.913692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896018932034174:6314]
2025-09-30T14:55:33.914212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1912, pipe: [1:7555896018932034174:6314]
2025-09-30T14:55:33.974773Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:33.975814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:33.975831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:33.975852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896018932034174:6314], now have 1 active actors on pipe
2025-09-30T14:55:33.976053Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:33.976787Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:33.976854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896018932034174:6314]
2025-09-30T14:55:33.976873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:33.976942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1913 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cf79aa32-a1e3c03c-9f2ac50d-c06c603c_0
2025-09-30T14:55:33.977357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf79aa32-a1e3c03c-9f2ac50d-c06c603c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:33.977384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf79aa32-a1e3c03c-9f2ac50d-c06c603c_0] Write session will restart in 0.007711s
2025-09-30T14:55:33.977413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf79aa32-a1e3c03c-9f2ac50d-c06c603c_0] Write session: Do CDS request
2025-09-30T14:55:33.977420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf79aa32-a1e3c03c-9f2ac50d-c06c603c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:33.977125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1913 sessionId: src_id|cf79aa32-a1e3c03c-9f2ac50d-c06c603c_0 is DEAD
2025-09-30T14:55:33.989712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf79aa32-a1e3c03c-9f2ac50d-c06c603c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:33.990115Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:33.990143Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1914
2025-09-30T14:55:33.990301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1914 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:33.990351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1914 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:33.990357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1914 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:33.990368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:33.991046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1914 sessionId:  describe result for acl check
2025-09-30T14:55:33.991099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:33.991103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:33.991105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:33.991113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896018932034321:6218] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:33.991733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896018932034321:6218] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:33.994339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896018932034321:6218] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:33.996597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:33.996960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896018932034321:6218] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:33.996976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896018932034321:6218] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:33.996980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896018932034321:6218] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:33.996988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1914 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:33.997655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:33.997847Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:33.997857Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:33.997869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:33.997921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:33.997976Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896018842264957:4815]
2025-09-30T14:55:33.998642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:33.999858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:33.999916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:34.000310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:34.000380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:34.000389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:34.000390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:34.000392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:34.000393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:34.000394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:34.000395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:34.000396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:34.000398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:34.000400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:34.000401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.000402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.000403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.000404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:34.000406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:34.000412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:34.000422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:34.000427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:34.000431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:34.000436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:34.000440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:34.000444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:34.000448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:34.000453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:34.000457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:34.000461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.000466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.000470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.000474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:34.000478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:34.000486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:34.000494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:34.000500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:34.000506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:34.000511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:34.000517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:34.000521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:34.000527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:34.000532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:34.000537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:34.000542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:34.000547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:34.000552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:34.000558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:34.000562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:34.000567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:34.000573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:34.000579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:34.000586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:34.000593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:34.000598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.000604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.000609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.000615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.000625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.000631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.000635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:34.000645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:34.000650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:34.000656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:34.000720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:34.006456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:34.007419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:34.007433Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:34.007435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:34.007439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:34.007445Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1913 [2:7555896018842264957:4815]
2025-09-30T14:55:34.007470Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:34.007488Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:34.007497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:34.007500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:34.007503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:34.007520Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:34.007527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:34.007535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:34.007595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.007604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.007607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.007611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:34.007614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:34.007699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:34.007708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.007721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.007733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.007754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:34.007778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896018932034179:2454], now have 1 active actors on pipe
2025-09-30T14:55:34.007786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896018932034420:6218], now have 1 active actors on pipe
2025-09-30T14:55:34.007794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896018842264950:4815]
2025-09-30T14:55:34.007801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896018842264950:4815]
2025-09-30T14:55:34.007804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896018842264950:4815]
2025-09-30T14:55:34.007817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:34.007828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:34.007830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:34.007831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:34.007833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:34.007845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:34.007815Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1913
2025-09-30T14:55:34.007848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:34.007865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1913
2025-09-30T14:55:34.007889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896018842264950:4815]
2025-09-30T14:55:34.007902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:34.007918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:34.008042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:34.008052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:34.008074Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ea25e2-162d53-b451db7-af4858d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:34.008085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:34.008089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:34.008096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:34.008107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:34.008121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:34.008137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:34.008377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:34.008384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:34.008397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:34.008483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1914 partition: 0 MaxSeqNo: 42 sessionId: src_id|3ea25e2-162d53-b451db7-af4858d3_0
2025-09-30T14:55:34.009016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf79aa32-a1e3c03c-9f2ac50d-c06c603c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3ea25e2-162d53-b451db7-af4858d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:34.012712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea25e2-162d53-b451db7-af4858d3_0] Write session: try to update token
2025-09-30T14:55:34.012740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea25e2-162d53-b451db7-af4858d3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:34.021686Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:34.021704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:34.021719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896018842264950:4815]
2025-09-30T14:55:34.021778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:34.021969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:34.022134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:34.022293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:34.022456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:34.022680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:34.022726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:34.022826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:34.033546Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:34.033576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:34.033578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:34.033580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:34.033590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896018842264950:4815]
2025-09-30T14:55:34.033593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896018842264950:4815]
2025-09-30T14:55:34.033596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896018842264950:4815]
2025-09-30T14:55:34.033632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:34.033639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.033641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:34.033665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:34.033672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:34.033676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:34.033775Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:34.035854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1914 sessionId: src_id|3ea25e2-162d53-b451db7-af4858d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:34.039228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:34.077138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896023227001728:6314]
2025-09-30T14:55:34.077685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1913, pipe: [1:7555896023227001728:6314]
2025-09-30T14:55:34.151209Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:34.151916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:34.151940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:34.151962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896023227001728:6314], now have 1 active actors on pipe
2025-09-30T14:55:34.152269Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:34.152332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:34.152409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:34.152410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896023227001728:6314]
2025-09-30T14:55:34.152412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:34.152488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1914 reason: error at write: Disconnected sessionId: src_id|3ea25e2-162d53-b451db7-af4858d3_0
2025-09-30T14:55:34.152684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1914 sessionId: src_id|3ea25e2-162d53-b451db7-af4858d3_0 is DEAD
2025-09-30T14:55:34.155253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea25e2-162d53-b451db7-af4858d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:34.155273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea25e2-162d53-b451db7-af4858d3_0] Write session will restart in 0.009737s
2025-09-30T14:55:34.155318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea25e2-162d53-b451db7-af4858d3_0] Write session: Do CDS request
2025-09-30T14:55:34.155327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea25e2-162d53-b451db7-af4858d3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:34.166969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea25e2-162d53-b451db7-af4858d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:34.167408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:34.167428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1915
2025-09-30T14:55:34.167648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1915 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:34.167717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1915 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:34.167723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1915 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:34.167729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:34.168322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1915 sessionId:  describe result for acl check
2025-09-30T14:55:34.168372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:34.168374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:34.168377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:34.168384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896023227001747:6206] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:34.169093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896023227001747:6206] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:34.177923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896023227001747:6206] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:34.185248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896023227001747:6206] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:34.185268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896023227001747:6206] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:34.185271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896023227001747:6206] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:34.185280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1915 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:34.202843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:34.207045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:34.207378Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:34.207401Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:34.207423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:34.207513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:34.207582Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896023137232502:4813]
2025-09-30T14:55:34.208310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:34.209148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:34.209209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:34.209627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:34.209768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:34.209769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:34.209771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:34.209773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:34.209774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:34.209776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:34.209777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:34.209779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:34.209780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:34.209782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:34.209783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.209784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.209786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.209787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:34.209788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:34.209797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:34.209811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:34.209816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:34.209821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:34.209826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:34.209830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:34.209835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:34.209839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:34.209843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:34.209849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:34.209853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.209858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.209862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.209867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:34.209871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:34.209884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:34.209895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:34.209905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:34.209912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:34.209920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:34.209927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:34.209933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:34.209940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:34.209949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:34.209957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:34.209964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:34.209971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:34.209980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:34.209989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:34.209997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:34.210005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:34.210012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:34.210019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:34.210023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:34.210031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:34.210037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.210043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.210051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.210056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.210062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.210068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.210091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:34.210098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:34.210104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:34.210110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:34.210157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:34.222018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:34.223070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:34.223091Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:34.223095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:34.223099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:34.223107Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1914 [2:7555896023137232502:4813]
2025-09-30T14:55:34.223126Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:34.223144Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:34.223147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:34.223151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:34.223153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:34.223172Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:34.223179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:34.223187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:34.223280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.223282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.223285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.223290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:34.223293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:34.223765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:34.223769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.223784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.223798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.223815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:34.223835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896023137232496:4813]
2025-09-30T14:55:34.223838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896023137232496:4813]
2025-09-30T14:55:34.223840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896023137232496:4813]
2025-09-30T14:55:34.223860Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:34.223878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:34.223894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:34.223897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:34.223937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:34.223939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896023137232496:4813]
2025-09-30T14:55:34.223942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:34.223942Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:34.223944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:34.223951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:34.224361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896023227001856:6206], now have 1 active actors on pipe
2025-09-30T14:55:34.224372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896023227001736:2454], now have 1 active actors on pipe
2025-09-30T14:55:34.224547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1914
2025-09-30T14:55:34.224599Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1914
2025-09-30T14:55:34.224684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:34.224697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:34.224726Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|585d58f5-fe4f341f-d7f1f358-ef3c851e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:34.224735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:34.224739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:34.224742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:34.224756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:34.224768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:34.224790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:34.225077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:34.225086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:34.225104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:34.225307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1915 partition: 0 MaxSeqNo: 42 sessionId: src_id|585d58f5-fe4f341f-d7f1f358-ef3c851e_0
2025-09-30T14:55:34.225806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea25e2-162d53-b451db7-af4858d3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|585d58f5-fe4f341f-d7f1f358-ef3c851e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:34.229104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|585d58f5-fe4f341f-d7f1f358-ef3c851e_0] Write session: try to update token
2025-09-30T14:55:34.229127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|585d58f5-fe4f341f-d7f1f358-ef3c851e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:34.242828Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:34.242852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:34.242855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:34.242857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:34.242868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896023137232496:4813]
2025-09-30T14:55:34.242873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896023137232496:4813]
2025-09-30T14:55:34.242878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896023137232496:4813]
2025-09-30T14:55:34.242925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:34.242933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.242936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:34.242987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:34.242999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:34.243007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:34.243087Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:34.251760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1915 sessionId: src_id|585d58f5-fe4f341f-d7f1f358-ef3c851e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:34.252199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896023227001997:6314]
2025-09-30T14:55:34.254803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:34.254894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1914, pipe: [1:7555896023227001997:6314]
2025-09-30T14:55:34.367495Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:34.367818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896023227001997:6314], now have 1 active actors on pipe
2025-09-30T14:55:34.367878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:34.367885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:34.368179Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:34.369686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|585d58f5-fe4f341f-d7f1f358-ef3c851e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:34.369703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|585d58f5-fe4f341f-d7f1f358-ef3c851e_0] Write session will restart in 0.007524s
2025-09-30T14:55:34.369736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|585d58f5-fe4f341f-d7f1f358-ef3c851e_0] Write session: Do CDS request
2025-09-30T14:55:34.369744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|585d58f5-fe4f341f-d7f1f358-ef3c851e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:34.368678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896023227001997:6314]
2025-09-30T14:55:34.368689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:34.368720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:34.368807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1915 reason: status is not ok: tablet will be restarted right now sessionId: src_id|585d58f5-fe4f341f-d7f1f358-ef3c851e_0
2025-09-30T14:55:34.369020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1915 sessionId: src_id|585d58f5-fe4f341f-d7f1f358-ef3c851e_0 is DEAD
2025-09-30T14:55:34.379177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|585d58f5-fe4f341f-d7f1f358-ef3c851e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:34.379418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:34.379441Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1916
2025-09-30T14:55:34.379631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1916 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:34.379670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1916 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:34.379680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1916 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:34.379686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:34.380334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1916 sessionId:  describe result for acl check
2025-09-30T14:55:34.380385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:34.380388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:34.380390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:34.380398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896023227002045:6187] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:34.381059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896023227002045:6187] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:34.389638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896023227002045:6187] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:34.396677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896023227002045:6187] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:34.396701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896023227002045:6187] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:34.396705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896023227002045:6187] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:34.396715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1916 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:34.399837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:34.404434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:34.404719Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:34.404731Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:34.404745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:34.404806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:34.404855Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896023137232791:4789]
2025-09-30T14:55:34.405637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:34.406000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:34.406055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:34.406451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:34.406526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:34.406532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:34.406533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:34.406534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:34.406536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:34.406538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:34.406539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:34.406541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:34.406542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:34.406543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:34.406545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.406547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.406548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.406550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:34.406551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:34.406557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:34.406569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:34.406574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:34.406578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:34.406583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:34.406587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:34.406592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:34.406596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:34.406600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:34.406605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:34.406609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.406613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.406617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.406621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:34.406626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:34.406635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:34.406644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:34.406651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:34.406655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:34.406659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:34.406662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:34.406666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:34.406670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:34.406673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:34.406677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:34.406680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:34.406684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:34.406690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:34.406696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:34.406701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:34.406707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:34.406713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:34.406724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:34.406732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:34.406743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:34.406748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.406754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.406758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.406763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.406768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.406773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.406778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:34.406784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:34.406791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:34.406796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:34.406852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:34.413800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:34.414858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:34.414880Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:34.414884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:34.414889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:34.414899Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1915 [2:7555896023137232791:4789]
2025-09-30T14:55:34.414922Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:34.414943Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:34.414953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:34.414957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:34.414960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:34.414981Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:34.414995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:34.415010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:34.415099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.415108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.415111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.415115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:34.415118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:34.415210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:34.415218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.415233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.415268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.415284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:34.415316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896023227002025:2454], now have 1 active actors on pipe
2025-09-30T14:55:34.415329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896023137232786:4789]
2025-09-30T14:55:34.415332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896023137232786:4789]
2025-09-30T14:55:34.415335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896023137232786:4789]
2025-09-30T14:55:34.415350Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:34.415369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896023227002256:6187], now have 1 active actors on pipe
2025-09-30T14:55:34.415372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:34.415377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:34.415380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:34.415384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:34.415399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:34.415410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:34.415459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896023137232786:4789]
2025-09-30T14:55:34.415474Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:34.415489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1915
2025-09-30T14:55:34.415525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:34.415490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1915
2025-09-30T14:55:34.415766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:34.415790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:34.415826Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f8dc76c-8890f7c2-a13f5e81-4f4f0fc7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:34.415844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:34.415856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:34.415859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:34.415872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:34.415897Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:34.415918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:34.416130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:34.416147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:34.416193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:34.416369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1916 partition: 0 MaxSeqNo: 42 sessionId: src_id|8f8dc76c-8890f7c2-a13f5e81-4f4f0fc7_0
2025-09-30T14:55:34.416820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|585d58f5-fe4f341f-d7f1f358-ef3c851e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8f8dc76c-8890f7c2-a13f5e81-4f4f0fc7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:34.420350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f8dc76c-8890f7c2-a13f5e81-4f4f0fc7_0] Write session: try to update token
2025-09-30T14:55:34.420375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f8dc76c-8890f7c2-a13f5e81-4f4f0fc7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:34.430186Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:34.430219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:34.430222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:34.430225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:34.430236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896023137232786:4789]
2025-09-30T14:55:34.430241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896023137232786:4789]
2025-09-30T14:55:34.430246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896023137232786:4789]
2025-09-30T14:55:34.430290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:34.430297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.430300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:34.430304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:34.430312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:34.430317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:34.430442Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:34.442301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1916 sessionId: src_id|8f8dc76c-8890f7c2-a13f5e81-4f4f0fc7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:34.445250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:34.468921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896023227002281:6314]
2025-09-30T14:55:34.469233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1915, pipe: [1:7555896023227002281:6314]
2025-09-30T14:55:34.545418Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:34.546376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:34.546403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:34.546443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896023227002281:6314], now have 1 active actors on pipe
2025-09-30T14:55:34.546691Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:34.546857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:34.546921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896023227002281:6314]
2025-09-30T14:55:34.546952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:34.546955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:34.547020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1916 reason: error at write: Disconnected sessionId: src_id|8f8dc76c-8890f7c2-a13f5e81-4f4f0fc7_0
2025-09-30T14:55:34.547220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1916 sessionId: src_id|8f8dc76c-8890f7c2-a13f5e81-4f4f0fc7_0 is DEAD
2025-09-30T14:55:34.547497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f8dc76c-8890f7c2-a13f5e81-4f4f0fc7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:34.547513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f8dc76c-8890f7c2-a13f5e81-4f4f0fc7_0] Write session will restart in 0.007145s
2025-09-30T14:55:34.547547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f8dc76c-8890f7c2-a13f5e81-4f4f0fc7_0] Write session: Do CDS request
2025-09-30T14:55:34.547559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f8dc76c-8890f7c2-a13f5e81-4f4f0fc7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:34.555861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f8dc76c-8890f7c2-a13f5e81-4f4f0fc7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:34.556265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:34.556285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1917
2025-09-30T14:55:34.556739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1917 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:34.556806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1917 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:34.556813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1917 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:34.556820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:34.557442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1917 sessionId:  describe result for acl check
2025-09-30T14:55:34.557490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:34.557503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:34.557505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:34.557512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896023227002296:6185] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:34.558145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896023227002296:6185] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:34.561171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896023227002296:6185] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:34.566208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896023227002296:6185] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:34.566231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896023227002296:6185] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:34.566236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896023227002296:6185] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:34.566246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1917 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:34.582980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:34.583741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:34.583950Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:34.583962Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:34.583976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:34.584025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:34.584067Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896023137233043:4782]
2025-09-30T14:55:34.584756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:34.587629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:34.587710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:34.588118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:34.588193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:34.588200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:34.588202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:34.588203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:34.588205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:34.588206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:34.588207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:34.588209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:34.588210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:34.588212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:34.588213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.588214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.588216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.588218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:34.588219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:34.588227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:34.588238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:34.588243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:34.588247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:34.588252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:34.588254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:34.588257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:34.588260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:34.588263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:34.588266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:34.588268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.588270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.588273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.588276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:34.588278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:34.588286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:34.588292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:34.588297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:34.588300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:34.588304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:34.588308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:34.588311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:34.588314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:34.588318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:34.588321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:34.588324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:34.588327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:34.588330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:34.588334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:34.588337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:34.588341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:34.588346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:34.588349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:34.588354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:34.588357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:34.588361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.588364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.588367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.588370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.588373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.588376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.588378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:34.588381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:34.588384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:34.588388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:34.588430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:34.598226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1916
2025-09-30T14:55:34.598231Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1916
2025-09-30T14:55:34.595580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:34.597640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:34.597652Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:34.597655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:34.597660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:34.597671Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1916 [2:7555896023137233043:4782]
2025-09-30T14:55:34.597695Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:34.597721Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:34.597726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:34.597731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:34.597733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:34.597757Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:34.597768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:34.597777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:34.597876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.597879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.597882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.597886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:34.597890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:34.597998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:34.598002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.598022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.598034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.598052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:34.598078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896023227002336:6185], now have 1 active actors on pipe
2025-09-30T14:55:34.598083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896023227002284:2454], now have 1 active actors on pipe
2025-09-30T14:55:34.598093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896023137233038:4782]
2025-09-30T14:55:34.598096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896023137233038:4782]
2025-09-30T14:55:34.598099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896023137233038:4782]
2025-09-30T14:55:34.598117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:34.598135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:34.598140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:34.598140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:34.598143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:34.598162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:34.598166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:34.598217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896023137233038:4782]
2025-09-30T14:55:34.598227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:34.598235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:34.598319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:34.598326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:34.598358Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44e36bd5-112a6ef7-a2a1d0ec-ec00b013_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:34.598368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:34.598373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:34.598376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:34.598392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:34.598405Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:34.598425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:34.598972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:34.599003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:34.599044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:34.599309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1917 partition: 0 MaxSeqNo: 42 sessionId: src_id|44e36bd5-112a6ef7-a2a1d0ec-ec00b013_0
2025-09-30T14:55:34.603462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f8dc76c-8890f7c2-a13f5e81-4f4f0fc7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|44e36bd5-112a6ef7-a2a1d0ec-ec00b013_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:34.607026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44e36bd5-112a6ef7-a2a1d0ec-ec00b013_0] Write session: try to update token
2025-09-30T14:55:34.607052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44e36bd5-112a6ef7-a2a1d0ec-ec00b013_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:34.624215Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:34.624241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:34.624254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896023137233038:4782]
2025-09-30T14:55:34.624321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:34.624329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:34.624554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:34.624754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:34.625027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:34.625216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:34.625481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:34.625541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:34.636773Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:34.636800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:34.636802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:34.636805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:34.636816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896023137233038:4782]
2025-09-30T14:55:34.636821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896023137233038:4782]
2025-09-30T14:55:34.636826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896023137233038:4782]
2025-09-30T14:55:34.636870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:34.636879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.636884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:34.636888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:34.636894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:34.636903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:34.637036Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:34.645200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1917 sessionId: src_id|44e36bd5-112a6ef7-a2a1d0ec-ec00b013_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:34.648938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:34.649982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896023227002546:6314]
2025-09-30T14:55:34.650338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1916, pipe: [1:7555896023227002546:6314]
2025-09-30T14:55:34.752293Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:34.753018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896023227002546:6314], now have 1 active actors on pipe
2025-09-30T14:55:34.753056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:34.753068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:34.753313Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:34.753435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:34.753506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896023227002546:6314]
2025-09-30T14:55:34.753564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:34.753602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1917 reason: status is not ok: tablet will be restarted right now sessionId: src_id|44e36bd5-112a6ef7-a2a1d0ec-ec00b013_0
2025-09-30T14:55:34.753813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1917 sessionId: src_id|44e36bd5-112a6ef7-a2a1d0ec-ec00b013_0 is DEAD
2025-09-30T14:55:34.755392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44e36bd5-112a6ef7-a2a1d0ec-ec00b013_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:34.755409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44e36bd5-112a6ef7-a2a1d0ec-ec00b013_0] Write session will restart in 0.008895s
2025-09-30T14:55:34.755439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44e36bd5-112a6ef7-a2a1d0ec-ec00b013_0] Write session: Do CDS request
2025-09-30T14:55:34.755446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44e36bd5-112a6ef7-a2a1d0ec-ec00b013_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:34.767659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44e36bd5-112a6ef7-a2a1d0ec-ec00b013_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:34.768099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:34.768125Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1918
2025-09-30T14:55:34.771544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1918 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:34.771611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1918 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:34.771617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1918 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:34.771635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:34.772252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1918 sessionId:  describe result for acl check
2025-09-30T14:55:34.772292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:34.772297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:34.772299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:34.772304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896023227002586:6181] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:34.772777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896023227002586:6181] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:34.776306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896023227002586:6181] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:34.785317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896023227002586:6181] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:34.785350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896023227002586:6181] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:34.785355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896023227002586:6181] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:34.785368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1918 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:34.796675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:34.800380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:34.800696Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:34.800710Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:34.800724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:34.800809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:34.800861Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896023137233308:4783]
2025-09-30T14:55:34.801638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:34.802971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:34.803046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:34.803438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:34.803524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:34.803526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:34.803528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:34.803529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:34.803531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:34.803532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:34.803534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:34.803535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:34.803536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:34.803538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:34.803539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.803541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.803542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.803544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:34.803545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:34.803553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:34.803565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:34.803569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:34.803572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:34.803576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:34.803580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:34.803584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:34.803588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:34.803592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:34.803596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:34.803600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.803604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.803608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.803611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:34.803615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:34.803627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:34.803639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:34.803649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:34.803655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:34.803661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:34.803666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:34.803671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:34.803676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:34.803682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:34.803688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:34.803693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:34.803699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:34.803705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:34.803711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:34.803717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:34.803722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:34.803726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:34.803730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:34.803735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:34.803742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:34.803748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.803754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.803759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.803766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.803771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.803777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.803780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:34.803783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:34.803787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:34.803791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:34.803822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:34.811091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:34.812594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:34.812602Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:34.812606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:34.812611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:34.812621Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1917 [2:7555896023137233308:4783]
2025-09-30T14:55:34.812642Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:34.812665Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:34.812671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:34.813211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1917
2025-09-30T14:55:34.812675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:34.812678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:34.812700Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:34.813276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1917
2025-09-30T14:55:34.812710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:34.812723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:34.812810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.812813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.812816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.812820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:34.812824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:34.812925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:34.812928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.812945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.812955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.812971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:34.812994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896023137233303:4783]
2025-09-30T14:55:34.812997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896023137233303:4783]
2025-09-30T14:55:34.813000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896023137233303:4783]
2025-09-30T14:55:34.813013Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:34.813030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:34.813048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:34.813048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:34.813051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:34.813052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:34.813055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:34.813103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896023137233303:4783]
2025-09-30T14:55:34.813118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:34.813133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896023227002549:2454], now have 1 active actors on pipe
2025-09-30T14:55:34.813137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896023227002723:6181], now have 1 active actors on pipe
2025-09-30T14:55:34.813367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:34.813725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:34.813746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:34.813789Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1450c867-10395970-a27a0a31-e08730c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:34.813801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:34.813807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:34.813810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:34.813825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:34.813842Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:34.813866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:34.814093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:34.814101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:34.814121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:34.814231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1918 partition: 0 MaxSeqNo: 42 sessionId: src_id|1450c867-10395970-a27a0a31-e08730c5_0
2025-09-30T14:55:34.817499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44e36bd5-112a6ef7-a2a1d0ec-ec00b013_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1450c867-10395970-a27a0a31-e08730c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:34.821123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1450c867-10395970-a27a0a31-e08730c5_0] Write session: try to update token
2025-09-30T14:55:34.821152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1450c867-10395970-a27a0a31-e08730c5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:34.828809Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:34.828835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:34.828838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:34.828841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:34.828853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896023137233303:4783]
2025-09-30T14:55:34.828859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896023137233303:4783]
2025-09-30T14:55:34.828865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896023137233303:4783]
2025-09-30T14:55:34.828917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:34.828926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.828930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:34.828973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:34.828981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:34.828987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:34.829115Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:34.844255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1918 sessionId: src_id|1450c867-10395970-a27a0a31-e08730c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:34.847153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:34.853846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896023227002823:6314]
2025-09-30T14:55:34.854296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1917, pipe: [1:7555896023227002823:6314]
2025-09-30T14:55:34.961071Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:34.961852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:34.961875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:34.961903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896023227002823:6314], now have 1 active actors on pipe
2025-09-30T14:55:34.962210Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:34.962211Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:34.962278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:34.962301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896023227002823:6314]
2025-09-30T14:55:34.962305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:34.962389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1918 reason: error at write: Disconnected sessionId: src_id|1450c867-10395970-a27a0a31-e08730c5_0
2025-09-30T14:55:34.962609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1918 sessionId: src_id|1450c867-10395970-a27a0a31-e08730c5_0 is DEAD
2025-09-30T14:55:34.962794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1450c867-10395970-a27a0a31-e08730c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:34.962807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1450c867-10395970-a27a0a31-e08730c5_0] Write session will restart in 0.005232s
2025-09-30T14:55:34.962837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1450c867-10395970-a27a0a31-e08730c5_0] Write session: Do CDS request
2025-09-30T14:55:34.962848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1450c867-10395970-a27a0a31-e08730c5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:34.969904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1450c867-10395970-a27a0a31-e08730c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:34.969977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:34.970009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1919
2025-09-30T14:55:34.970164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1919 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:34.970222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1919 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:34.970236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1919 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:34.970242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:34.970796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1919 sessionId:  describe result for acl check
2025-09-30T14:55:34.970842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:34.970854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:34.970856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:34.970862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896023227002843:6169] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:34.971569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896023227002843:6169] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:34.974235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896023227002843:6169] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:34.978769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896023227002843:6169] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:34.978794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896023227002843:6169] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:34.978799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896023227002843:6169] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:34.978810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1919 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:34.986721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:34.991348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:34.991707Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:34.991731Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:34.991747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:34.991831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:34.991907Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896023137233564:4775]
2025-09-30T14:55:34.992676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:34.994429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:34.994517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:34.995000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:34.995117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:34.995126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:34.995128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:34.995130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:34.995132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:34.995134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:34.995135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:34.995137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:34.995139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:34.995141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:34.995142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.995144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.995145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.995147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:34.995149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:34.995157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:34.995171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:34.995176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:34.995181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:34.995186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:34.995190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:34.995195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:34.995199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:34.995205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:34.995212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:34.995217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.995221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.995226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.995230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:34.995234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:34.995264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:34.995274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:34.995283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:34.995290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:34.995297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:34.995304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:34.995312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:34.995329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:34.995340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:34.995347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:34.995354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:34.995361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:34.995367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:34.995373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:34.995380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:34.995387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:34.995391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:34.995400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:34.995405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:34.995411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:34.995421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.995433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:34.995439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.995449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:34.995458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.995464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:34.995475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:34.995480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:34.995487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:34.995499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:34.995550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:35.002637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:35.003757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:35.003776Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:35.003781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:35.003786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:35.003796Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1918 [2:7555896023137233564:4775]
2025-09-30T14:55:35.003820Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:35.003840Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:35.003844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:35.003848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:35.003852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:35.003875Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:35.003891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:35.003902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:35.003991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.004002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:35.004005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:35.004010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:35.004014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:35.004105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:35.004115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.004132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:35.004145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:35.004164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:35.004191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896023137233559:4775]
2025-09-30T14:55:35.004201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896023137233559:4775]
2025-09-30T14:55:35.004204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896023137233559:4775]
2025-09-30T14:55:35.004221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:35.004245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:35.004265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:35.004273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:35.004282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:35.004287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:35.004290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:35.004328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896023137233559:4775]
2025-09-30T14:55:35.004337Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:35.004400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:35.004505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896023227002828:2454], now have 1 active actors on pipe
2025-09-30T14:55:35.004522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896023227002959:6169], now have 1 active actors on pipe
2025-09-30T14:55:35.007384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1918
2025-09-30T14:55:35.007448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1918
2025-09-30T14:55:35.007844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:35.007869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:35.007914Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47e8fecc-a2bbfaeb-b6665d6a-cc8ba4bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:35.007929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:35.007934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:35.007938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:35.007954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:35.007976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:35.008001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:35.008469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:35.008480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:35.008499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:35.008662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1919 partition: 0 MaxSeqNo: 42 sessionId: src_id|47e8fecc-a2bbfaeb-b6665d6a-cc8ba4bc_0
2025-09-30T14:55:35.009152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1450c867-10395970-a27a0a31-e08730c5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|47e8fecc-a2bbfaeb-b6665d6a-cc8ba4bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:35.012858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47e8fecc-a2bbfaeb-b6665d6a-cc8ba4bc_0] Write session: try to update token
2025-09-30T14:55:35.012884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47e8fecc-a2bbfaeb-b6665d6a-cc8ba4bc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:35.022532Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:35.022555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:35.022559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:35.022562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:35.022574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896023137233559:4775]
2025-09-30T14:55:35.022580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896023137233559:4775]
2025-09-30T14:55:35.022586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896023137233559:4775]
2025-09-30T14:55:35.022633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:35.022642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.022645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:35.022819Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:35.027445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:35.027467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:35.027474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:35.049640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1919 sessionId: src_id|47e8fecc-a2bbfaeb-b6665d6a-cc8ba4bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:35.052575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:35.065297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896027521970384:6314]
2025-09-30T14:55:35.065869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1918, pipe: [1:7555896027521970384:6314]
2025-09-30T14:55:35.163099Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:35.164650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:35.164672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:35.164699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896027521970384:6314], now have 1 active actors on pipe
2025-09-30T14:55:35.165115Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:35.165134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896027521970384:6314]
2025-09-30T14:55:35.165176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:35.165230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:35.165244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:35.165315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1919 reason: error at write: Disconnected sessionId: src_id|47e8fecc-a2bbfaeb-b6665d6a-cc8ba4bc_0
2025-09-30T14:55:35.165506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1919 sessionId: src_id|47e8fecc-a2bbfaeb-b6665d6a-cc8ba4bc_0 is DEAD
2025-09-30T14:55:35.167526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47e8fecc-a2bbfaeb-b6665d6a-cc8ba4bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:35.167543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47e8fecc-a2bbfaeb-b6665d6a-cc8ba4bc_0] Write session will restart in 0.009732s
2025-09-30T14:55:35.167577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47e8fecc-a2bbfaeb-b6665d6a-cc8ba4bc_0] Write session: Do CDS request
2025-09-30T14:55:35.167589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47e8fecc-a2bbfaeb-b6665d6a-cc8ba4bc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:35.183842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47e8fecc-a2bbfaeb-b6665d6a-cc8ba4bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:35.184958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:35.184978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1920
2025-09-30T14:55:35.185186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1920 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:35.185229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1920 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:35.185234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1920 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:35.185238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:35.185704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1920 sessionId:  describe result for acl check
2025-09-30T14:55:35.185748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:35.185754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:35.185756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:35.185762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896027521970505:6162] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:35.186350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896027521970505:6162] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:35.190065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896027521970505:6162] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:35.192628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:35.192934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896027521970505:6162] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:35.192957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896027521970505:6162] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:35.192961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896027521970505:6162] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:35.192969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1920 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:35.196005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:35.196256Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:35.196269Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:35.196280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:35.196349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:35.196392Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896027432201117:4773]
2025-09-30T14:55:35.197058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:35.197411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:35.197478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:35.197841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:35.197909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:35.197916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:35.197917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:35.197918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:35.197919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:35.197921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:35.197922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:35.197924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:35.197925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:35.197927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:35.197928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.197929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:35.197931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:35.197932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:35.197933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:35.197939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:35.197949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:35.197953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:35.197958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:35.197962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:35.197966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:35.197971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:35.197974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:35.197979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:35.197984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:35.197988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.197992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:35.197996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:35.198000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:35.198004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:35.198014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:35.198022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:35.198028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:35.198034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:35.198039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:35.198044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:35.198049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:35.198054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:35.198060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:35.198065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:35.198069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:35.198087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:35.198098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:35.198103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:35.198107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:35.198117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:35.198123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:35.198133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:35.198138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:35.198147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:35.198153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.198173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.198178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:35.198183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:35.198188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:35.198194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:35.198198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:35.198203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:35.198207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:35.198212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:35.198258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:35.207391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:35.208261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:35.208280Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:35.208284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:35.208289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:35.208296Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1919 [2:7555896027432201117:4773]
2025-09-30T14:55:35.208314Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:35.208331Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:35.208335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:35.208339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:35.208342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:35.208359Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:35.208372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:35.208378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:35.208441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.208450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:35.208452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:35.208457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:35.208460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:35.208651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:35.208662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.208677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:35.208692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:35.208713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:35.208733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896027521970392:2454], now have 1 active actors on pipe
2025-09-30T14:55:35.208738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896027521970643:6162], now have 1 active actors on pipe
2025-09-30T14:55:35.208744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896027432201111:4773]
2025-09-30T14:55:35.208747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896027432201111:4773]
2025-09-30T14:55:35.208749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896027432201111:4773]
2025-09-30T14:55:35.208763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:35.208778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:35.208779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:35.208783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:35.208785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:35.208797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:35.208800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:35.208839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896027432201111:4773]
2025-09-30T14:55:35.208854Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:35.208828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1919
2025-09-30T14:55:35.208880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1919
2025-09-30T14:55:35.208883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:35.209100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:35.209113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:35.209142Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1aaff0f0-a2c725e1-2d2aed3d-ec06d0ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:35.209156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:35.209163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:35.209167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:35.209181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:35.209194Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:35.209220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:35.209444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:35.209455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:35.209477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:35.209632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1920 partition: 0 MaxSeqNo: 42 sessionId: src_id|1aaff0f0-a2c725e1-2d2aed3d-ec06d0ee_0
2025-09-30T14:55:35.211404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47e8fecc-a2bbfaeb-b6665d6a-cc8ba4bc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1aaff0f0-a2c725e1-2d2aed3d-ec06d0ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:35.215014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1aaff0f0-a2c725e1-2d2aed3d-ec06d0ee_0] Write session: try to update token
2025-09-30T14:55:35.215045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1aaff0f0-a2c725e1-2d2aed3d-ec06d0ee_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:35.237348Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:35.237375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:35.237378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:35.237380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:35.237390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896027432201111:4773]
2025-09-30T14:55:35.237397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896027432201111:4773]
2025-09-30T14:55:35.237404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896027432201111:4773]
2025-09-30T14:55:35.237450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:35.237458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:35.237461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.237464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:35.237465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:35.237469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:35.237643Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:35.256218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1920 sessionId: src_id|1aaff0f0-a2c725e1-2d2aed3d-ec06d0ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:35.259021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:35.265534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896027521970658:6314]
2025-09-30T14:55:35.265982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1919, pipe: [1:7555896027521970658:6314]
2025-09-30T14:55:35.352995Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:35.353600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:35.353619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:35.353640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896027521970658:6314], now have 1 active actors on pipe
2025-09-30T14:55:35.354226Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:35.355331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:35.355438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1920 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1aaff0f0-a2c725e1-2d2aed3d-ec06d0ee_0
2025-09-30T14:55:35.355645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1920 sessionId: src_id|1aaff0f0-a2c725e1-2d2aed3d-ec06d0ee_0 is DEAD
2025-09-30T14:55:35.355736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:35.355788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896027521970658:6314]
2025-09-30T14:55:35.356127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1aaff0f0-a2c725e1-2d2aed3d-ec06d0ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:35.356139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1aaff0f0-a2c725e1-2d2aed3d-ec06d0ee_0] Write session will restart in 0.008477s
2025-09-30T14:55:35.356167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1aaff0f0-a2c725e1-2d2aed3d-ec06d0ee_0] Write session: Do CDS request
2025-09-30T14:55:35.356174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1aaff0f0-a2c725e1-2d2aed3d-ec06d0ee_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:35.365829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1aaff0f0-a2c725e1-2d2aed3d-ec06d0ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:35.366182Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:35.366203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1921
2025-09-30T14:55:35.366352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1921 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:35.366389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1921 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:35.366398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1921 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:35.366403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:35.367269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1921 sessionId:  describe result for acl check
2025-09-30T14:55:35.367312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:35.367319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:35.367323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:35.367331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896027521970684:6146] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:35.367881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896027521970684:6146] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:35.369771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896027521970684:6146] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:35.376595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896027521970684:6146] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:35.376619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896027521970684:6146] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:35.376623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896027521970684:6146] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:35.376632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1921 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:35.399939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:35.402521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:35.403139Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:35.403155Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:35.403171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:35.403276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:35.403325Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896027432201411:4762]
2025-09-30T14:55:35.403982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:35.404316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:35.404373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:35.404693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:35.404776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:35.404785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:35.404787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:35.404788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:35.404789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:35.404790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:35.404791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:35.404792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:35.404793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:35.404794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:35.404795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.404796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:35.404797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:35.404799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:35.404800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:35.404805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:35.404817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:35.404822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:35.404827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:35.404831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:35.404836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:35.404841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:35.404845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:35.404849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:35.404854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:35.404859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.404863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:35.404867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:35.404872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:35.404875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:35.404883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:35.404891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:35.404897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:35.404902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:35.404906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:35.404911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:35.404915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:35.404920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:35.404925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:35.404930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:35.404934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:35.404940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:35.404945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:35.404950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:35.404955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:35.404961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:35.404966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:35.404976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:35.404980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:35.404992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:35.404997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.405004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.405009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:35.405016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:35.405020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:35.405027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:35.405032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:35.405039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:35.405044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:35.405050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:35.405114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:35.412062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:35.413651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:35.413668Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:35.413671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:35.413675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:35.413682Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1920 [2:7555896027432201411:4762]
2025-09-30T14:55:35.413699Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:35.413716Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:35.413719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:35.413722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:35.413724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:35.413969Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:35.413977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:35.413984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:35.414054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.414063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:35.414065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:35.414070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:35.414072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:35.414141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:35.414148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.414179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:35.414197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:35.414220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:35.414244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896027521970669:2454], now have 1 active actors on pipe
2025-09-30T14:55:35.414257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896027521970732:6146], now have 1 active actors on pipe
2025-09-30T14:55:35.414264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896027432201387:4762]
2025-09-30T14:55:35.414267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896027432201387:4762]
2025-09-30T14:55:35.414270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896027432201387:4762]
2025-09-30T14:55:35.414284Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:35.414299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:35.414302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:35.414306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:35.414308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:35.414316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:35.414325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:35.414363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896027432201387:4762]
2025-09-30T14:55:35.414372Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:35.414379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:35.414337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1920
2025-09-30T14:55:35.414350Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1920
2025-09-30T14:55:35.414405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:35.414416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:35.414453Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d09cbea8-4c02729f-bce7fde0-65b46318_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:35.414466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:35.414475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:35.414477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:35.414488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:35.414502Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:35.414527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:35.414810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:35.414824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:35.414859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:35.414964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1921 partition: 0 MaxSeqNo: 42 sessionId: src_id|d09cbea8-4c02729f-bce7fde0-65b46318_0
2025-09-30T14:55:35.415342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1aaff0f0-a2c725e1-2d2aed3d-ec06d0ee_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d09cbea8-4c02729f-bce7fde0-65b46318_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:35.418372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d09cbea8-4c02729f-bce7fde0-65b46318_0] Write session: try to update token
2025-09-30T14:55:35.418394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d09cbea8-4c02729f-bce7fde0-65b46318_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:35.429818Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:35.429846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:35.429849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:35.429851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:35.429865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896027432201387:4762]
2025-09-30T14:55:35.429870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896027432201387:4762]
2025-09-30T14:55:35.429875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896027432201387:4762]
2025-09-30T14:55:35.429921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:35.429934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.429937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:35.429939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:35.429945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:35.429958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:35.430083Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:35.442091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1921 sessionId: src_id|d09cbea8-4c02729f-bce7fde0-65b46318_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:35.445061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:35.459182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896027521970947:6314]
2025-09-30T14:55:35.459674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1920, pipe: [1:7555896027521970947:6314]
2025-09-30T14:55:35.551339Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:35.552027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:35.552050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:35.552071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896027521970947:6314], now have 1 active actors on pipe
2025-09-30T14:55:35.552342Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:35.552385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:35.552440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:35.552527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1921 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d09cbea8-4c02729f-bce7fde0-65b46318_0
2025-09-30T14:55:35.552700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1921 sessionId: src_id|d09cbea8-4c02729f-bce7fde0-65b46318_0 is DEAD
2025-09-30T14:55:35.552732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896027521970947:6314]
2025-09-30T14:55:35.552950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d09cbea8-4c02729f-bce7fde0-65b46318_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:35.552968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d09cbea8-4c02729f-bce7fde0-65b46318_0] Write session will restart in 0.005495s
2025-09-30T14:55:35.553002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d09cbea8-4c02729f-bce7fde0-65b46318_0] Write session: Do CDS request
2025-09-30T14:55:35.553009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d09cbea8-4c02729f-bce7fde0-65b46318_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:35.560254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d09cbea8-4c02729f-bce7fde0-65b46318_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:35.560750Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:35.560769Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1922
2025-09-30T14:55:35.560940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1922 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:35.560975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1922 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:35.560985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1922 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:35.560990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:35.561401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1922 sessionId:  describe result for acl check
2025-09-30T14:55:35.561434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:35.561436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:35.561438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:35.561444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896027521970965:6141] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:35.562003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896027521970965:6141] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:35.565530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896027521970965:6141] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:35.569397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896027521970965:6141] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:35.569417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896027521970965:6141] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:35.569422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896027521970965:6141] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:35.569433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1922 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:35.574329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:35.577652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:35.577891Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:35.577902Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:35.577913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:35.577967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:35.578019Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896027432201668:4749]
2025-09-30T14:55:35.578680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:35.579017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:35.579059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:35.579398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:35.579460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:35.579470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:35.579471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:35.579472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:35.579474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:35.579475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:35.579476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:35.579477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:35.579479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:35.579480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:35.579481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.579482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:35.579484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:35.579485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:35.579486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:35.579491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:35.579502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:35.579506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:35.579511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:35.579515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:35.579519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:35.579524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:35.579528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:35.579532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:35.579538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:35.579542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.579546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:35.579551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:35.579555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:35.579559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:35.579567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:35.579576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:35.579582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:35.579588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:35.579593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:35.579599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:35.579603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:35.579609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:35.579614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:35.579619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:35.579624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:35.579630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:35.579635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:35.579640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:35.579645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:35.579649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:35.579658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:35.579662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:35.579670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:35.579675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:35.579680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.579685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.579690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:35.579695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:35.579701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:35.579713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:35.579718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:35.579725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:35.579734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:35.579739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:35.579783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:35.587073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:35.588484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:35.588500Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:35.588501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:35.588505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:35.588510Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1921 [2:7555896027432201668:4749]
2025-09-30T14:55:35.588523Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:35.588537Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:35.588543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:35.588545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:35.588547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:35.588562Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:35.588569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:35.588577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:35.588634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.588640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:35.588642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:35.588645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:35.588646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:35.588705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:35.588711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.588720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:35.588730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:35.588743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:35.588756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896027432201663:4749]
2025-09-30T14:55:35.588762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896027432201663:4749]
2025-09-30T14:55:35.588764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896027432201663:4749]
2025-09-30T14:55:35.588770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:35.588782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:35.588782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:35.588786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:35.588788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:35.588792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:35.588794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:35.588802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896027521970950:2454], now have 1 active actors on pipe
2025-09-30T14:55:35.588805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896027521971112:6141], now have 1 active actors on pipe
2025-09-30T14:55:35.588852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896027432201663:4749]
2025-09-30T14:55:35.588863Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:35.588876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:35.588899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1921
2025-09-30T14:55:35.588908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1921
2025-09-30T14:55:35.588986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:35.589003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:35.589044Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a66f68cb-e2c2f0c3-fd4be702-40915693_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:35.589057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:35.589065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:35.589068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:35.589081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:35.589097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:35.589114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:35.589285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:35.589293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:35.589305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:35.589402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1922 partition: 0 MaxSeqNo: 42 sessionId: src_id|a66f68cb-e2c2f0c3-fd4be702-40915693_0
2025-09-30T14:55:35.589795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d09cbea8-4c02729f-bce7fde0-65b46318_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a66f68cb-e2c2f0c3-fd4be702-40915693_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:35.592654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a66f68cb-e2c2f0c3-fd4be702-40915693_0] Write session: try to update token
2025-09-30T14:55:35.592672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a66f68cb-e2c2f0c3-fd4be702-40915693_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:35.604551Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:35.604573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:35.604576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:35.604578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:35.604589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896027432201663:4749]
2025-09-30T14:55:35.604595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896027432201663:4749]
2025-09-30T14:55:35.604599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896027432201663:4749]
2025-09-30T14:55:35.604638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:35.604645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.604644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:35.604648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:35.604652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:35.604656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:35.604790Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:35.609707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1922 sessionId: src_id|a66f68cb-e2c2f0c3-fd4be702-40915693_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:35.612920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:35.652540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896027521971217:6314]
2025-09-30T14:55:35.652852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1921, pipe: [1:7555896027521971217:6314]
2025-09-30T14:55:35.718576Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:35.718934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:35.718950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:35.718991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896027521971217:6314], now have 1 active actors on pipe
2025-09-30T14:55:35.719260Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:35.719397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:35.719404Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:35.719418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:35.719488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896027521971217:6314]
2025-09-30T14:55:35.719492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1922 reason: error at write: Disconnected sessionId: src_id|a66f68cb-e2c2f0c3-fd4be702-40915693_0
2025-09-30T14:55:35.719707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1922 sessionId: src_id|a66f68cb-e2c2f0c3-fd4be702-40915693_0 is DEAD
2025-09-30T14:55:35.719927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a66f68cb-e2c2f0c3-fd4be702-40915693_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:35.719954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a66f68cb-e2c2f0c3-fd4be702-40915693_0] Write session will restart in 0.005149s
2025-09-30T14:55:35.719979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a66f68cb-e2c2f0c3-fd4be702-40915693_0] Write session: Do CDS request
2025-09-30T14:55:35.719988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a66f68cb-e2c2f0c3-fd4be702-40915693_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:35.726833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a66f68cb-e2c2f0c3-fd4be702-40915693_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:35.727058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:35.727079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1923
2025-09-30T14:55:35.727286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1923 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:35.727330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1923 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:35.727344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1923 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:35.727349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:35.727835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1923 sessionId:  describe result for acl check
2025-09-30T14:55:35.727870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:35.727873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:35.727875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:35.727882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896027521971234:6130] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:35.728504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896027521971234:6130] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:35.733482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896027521971234:6130] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:35.740316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896027521971234:6130] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:35.740338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896027521971234:6130] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:35.740342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896027521971234:6130] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:35.740351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1923 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:35.748743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:35.749528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:35.749761Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:35.749771Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:35.749782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:35.749836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:35.749881Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896027432201938:4742]
2025-09-30T14:55:35.750597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:35.752437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:35.752511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:35.752896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:35.752957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:35.752958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:35.752960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:35.752961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:35.752963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:35.752964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:35.752966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:35.752967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:35.752969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:35.752970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:35.752971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.752973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:35.752974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:35.752975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:35.752976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:35.752982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:35.752992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:35.752996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:35.753000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:35.753003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:35.753007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:35.753011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:35.753015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:35.753019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:35.753025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:35.753029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.753032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:35.753035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:35.753039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:35.753043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:35.753054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:35.753062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:35.753068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:35.753074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:35.753078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:35.753083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:35.753088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:35.753093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:35.753097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:35.753102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:35.753106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:35.753111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:35.753119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:35.753124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:35.753128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:35.753133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:35.753137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:35.753142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:35.753146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:35.753151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:35.753156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.753161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.753165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:35.753169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:35.753174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:35.753178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:35.753182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:35.753186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:35.753191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:35.753195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:35.753236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:35.762319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:35.763798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:35.763818Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:35.763822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:35.763827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:35.763834Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1922 [2:7555896027432201938:4742]
2025-09-30T14:55:35.763850Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:35.763865Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:35.763870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:35.763874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:35.763876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:35.763894Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:35.763907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:35.763917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:35.763991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.763999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:35.764001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:35.764004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:35.764007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:35.764085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:35.764090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.764105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:35.764123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:35.764144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:35.764170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896027521971368:6130], now have 1 active actors on pipe
2025-09-30T14:55:35.764179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896027521971219:2454], now have 1 active actors on pipe
2025-09-30T14:55:35.764184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896027432201932:4742]
2025-09-30T14:55:35.764186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896027432201932:4742]
2025-09-30T14:55:35.764189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896027432201932:4742]
2025-09-30T14:55:35.764204Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:35.764216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:35.764221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:35.764225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:35.764228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:35.764236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:35.764239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:35.764282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896027432201932:4742]
2025-09-30T14:55:35.764296Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:35.764312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:35.764323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:35.764328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:35.764377Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92cc8f25-e99f3f84-94127d62-d460cea0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:35.764391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:35.764394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:35.764397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:35.764407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:35.764417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:35.764438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:35.764614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:35.764628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:35.764651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:35.765137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a66f68cb-e2c2f0c3-fd4be702-40915693_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|92cc8f25-e99f3f84-94127d62-d460cea0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:35.764232Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1922
2025-09-30T14:55:35.764235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1922
2025-09-30T14:55:35.764767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1923 partition: 0 MaxSeqNo: 42 sessionId: src_id|92cc8f25-e99f3f84-94127d62-d460cea0_0
2025-09-30T14:55:35.767964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92cc8f25-e99f3f84-94127d62-d460cea0_0] Write session: try to update token
2025-09-30T14:55:35.767981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92cc8f25-e99f3f84-94127d62-d460cea0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:35.779758Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:35.779777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:35.779779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:35.779782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:35.779792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896027432201932:4742]
2025-09-30T14:55:35.779797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896027432201932:4742]
2025-09-30T14:55:35.779802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896027432201932:4742]
2025-09-30T14:55:35.779842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:35.779847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:35.779851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.779854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:35.779854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:35.779858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:35.779996Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:35.788918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1923 sessionId: src_id|92cc8f25-e99f3f84-94127d62-d460cea0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:35.791667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:35.819521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896027521971498:6314]
2025-09-30T14:55:35.820104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1922, pipe: [1:7555896027521971498:6314]
2025-09-30T14:55:35.899286Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:35.899844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:35.899861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:35.899901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896027521971498:6314], now have 1 active actors on pipe
2025-09-30T14:55:35.900150Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:35.900178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:35.900595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92cc8f25-e99f3f84-94127d62-d460cea0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:35.900190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:35.900614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92cc8f25-e99f3f84-94127d62-d460cea0_0] Write session will restart in 0.008822s
2025-09-30T14:55:35.900198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:35.900245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896027521971498:6314]
2025-09-30T14:55:35.900254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1923 reason: error at write: Disconnected sessionId: src_id|92cc8f25-e99f3f84-94127d62-d460cea0_0
2025-09-30T14:55:35.900419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1923 sessionId: src_id|92cc8f25-e99f3f84-94127d62-d460cea0_0 is DEAD
2025-09-30T14:55:35.900653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92cc8f25-e99f3f84-94127d62-d460cea0_0] Write session: Do CDS request
2025-09-30T14:55:35.900663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92cc8f25-e99f3f84-94127d62-d460cea0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:35.910849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92cc8f25-e99f3f84-94127d62-d460cea0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:35.910956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:35.910981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1924
2025-09-30T14:55:35.911117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1924 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:35.911163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1924 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:35.911176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1924 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:35.911191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:35.911980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1924 sessionId:  describe result for acl check
2025-09-30T14:55:35.912018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:35.912025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:35.912027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:35.912033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896027521971545:6118] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:35.912607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896027521971545:6118] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:35.915691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896027521971545:6118] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:35.918744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896027521971545:6118] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:35.918766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896027521971545:6118] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:35.918769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896027521971545:6118] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:35.918779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1924 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:35.922912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:35.926020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:35.926230Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:35.926241Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:35.926251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:35.926307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:35.926352Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896027432202199:4737]
2025-09-30T14:55:35.927001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:35.927382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:35.927439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:35.927924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:35.928039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:35.928045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:35.928047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:35.928048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:35.928049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:35.928051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:35.928052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:35.928054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:35.928055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:35.928057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:35.928058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.928060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:35.928061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:35.928062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:35.928063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:35.928070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:35.928081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:35.928085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:35.928089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:35.928092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:35.928096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:35.928100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:35.928104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:35.928108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:35.928113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:35.928117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.928120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:35.928124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:35.928128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:35.928132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:35.928142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:35.928150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:35.928156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:35.928162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:35.928167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:35.928173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:35.928177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:35.928182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:35.928187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:35.928193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:35.928197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:35.928203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:35.928209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:35.928214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:35.928219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:35.928224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:35.928231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:35.928237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:35.928243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:35.928248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:35.928253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.928264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.928269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:35.928275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:35.928279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:35.928284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:35.928289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:35.928295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:35.928300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:35.928305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:35.928355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:35.935172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:35.936516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:35.936536Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:35.936539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:35.936543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:35.936550Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1923 [2:7555896027432202199:4737]
2025-09-30T14:55:35.936568Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:35.936585Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:35.936588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:35.936591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:35.936594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:35.936611Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:35.936618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:35.936625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:35.936690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.936701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:35.936703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:35.936707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:35.936710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:35.936775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:35.936785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.936797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:35.936808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:35.936824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:35.936847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896027521971501:2454], now have 1 active actors on pipe
2025-09-30T14:55:35.936857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896027521971700:6118], now have 1 active actors on pipe
2025-09-30T14:55:35.936864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896027432202194:4737]
2025-09-30T14:55:35.936866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896027432202194:4737]
2025-09-30T14:55:35.936868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896027432202194:4737]
2025-09-30T14:55:35.936881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:35.936894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:35.936895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:35.936897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:35.936899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:35.936911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:35.936914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:35.936950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896027432202194:4737]
2025-09-30T14:55:35.936962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:35.936963Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:35.936946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1923
2025-09-30T14:55:35.936997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:35.937005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:35.937008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1923
2025-09-30T14:55:35.937037Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8840e5eb-70112c3a-cd67e0c9-60f72845_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:35.937052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:35.937055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:35.937058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:35.937068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:35.937078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:35.937101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:35.937239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:35.937252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:35.937277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:35.937359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1924 partition: 0 MaxSeqNo: 42 sessionId: src_id|8840e5eb-70112c3a-cd67e0c9-60f72845_0
2025-09-30T14:55:35.937750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92cc8f25-e99f3f84-94127d62-d460cea0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8840e5eb-70112c3a-cd67e0c9-60f72845_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:35.940644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8840e5eb-70112c3a-cd67e0c9-60f72845_0] Write session: try to update token
2025-09-30T14:55:35.940664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8840e5eb-70112c3a-cd67e0c9-60f72845_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:35.952529Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:35.952553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:35.952563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896027432202194:4737]
2025-09-30T14:55:35.952610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:35.952617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:35.952800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:35.952949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:35.953094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:35.953241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:35.953455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:35.953497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:35.957447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1924 sessionId: src_id|8840e5eb-70112c3a-cd67e0c9-60f72845_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:35.960378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:35.961382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:35.961407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:35.961457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:35.961557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:35.967866Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:35.967891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:35.967894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:35.967895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:35.967906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896027432202194:4737]
2025-09-30T14:55:35.967911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896027432202194:4737]
2025-09-30T14:55:35.967915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896027432202194:4737]
2025-09-30T14:55:35.967958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:35.967967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:35.967970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:35.968095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:35.968110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:35.968114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:35.968124Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:36.000213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896031816939065:6314]
2025-09-30T14:55:36.000529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1923, pipe: [1:7555896031816939065:6314]
2025-09-30T14:55:36.084817Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:36.093570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:36.093606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:36.093790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:36.093851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:36.093921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:36.093983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:36.094025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:36.094030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:36.094104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:36.094167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:36.094230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:36.094297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:36.094347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:36.094350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:36.094426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:36.094486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:36.094547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:36.094616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:36.094656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:36.094659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:36.094731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:36.094795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:36.094861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:36.094926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:36.094968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:36.094971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:36.095043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:36.095107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:36.095171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:36.095235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:36.097685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896031816939065:6314]
2025-09-30T14:55:36.097724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:36.097766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:36.097774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:36.097810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1924 reason: error at write: Disconnected sessionId: src_id|8840e5eb-70112c3a-cd67e0c9-60f72845_0
2025-09-30T14:55:36.098137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8840e5eb-70112c3a-cd67e0c9-60f72845_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:36.098149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8840e5eb-70112c3a-cd67e0c9-60f72845_0] Write session will restart in 0.005432s
2025-09-30T14:55:36.098174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8840e5eb-70112c3a-cd67e0c9-60f72845_0] Write session: Do CDS request
2025-09-30T14:55:36.098181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8840e5eb-70112c3a-cd67e0c9-60f72845_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:36.098027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1924 sessionId: src_id|8840e5eb-70112c3a-cd67e0c9-60f72845_0 is DEAD
2025-09-30T14:55:36.095474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:36.095485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:36.095566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:36.095671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:36.095739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:36.095804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:36.095906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:36.095909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:36.095980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:36.096041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:36.096106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:36.096175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:36.096223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:36.096226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:36.096305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:36.096409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:36.096514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:36.096624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:36.096682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:36.096687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:36.096759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:36.096825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:36.096891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:36.096980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:36.097025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:36.097028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:36.097108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:36.097174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:36.097238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:36.097303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:36.097350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:36.097353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:36.097429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896031816939065:6314], now have 1 active actors on pipe
2025-09-30T14:55:36.098750Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:36.104869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8840e5eb-70112c3a-cd67e0c9-60f72845_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:36.104914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:36.104933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1925
2025-09-30T14:55:36.105310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1925 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:36.105343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1925 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:36.105353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1925 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:36.105360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:36.105801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1925 sessionId:  describe result for acl check
2025-09-30T14:55:36.105860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:36.105866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:36.105868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:36.105874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896031816939082:6121] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:36.106450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896031816939082:6121] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:36.110601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896031816939082:6121] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:36.114657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896031816939082:6121] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:36.114677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896031816939082:6121] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:36.114681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896031816939082:6121] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:36.114691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1925 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:36.122699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:36.126384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:36.126634Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:36.126643Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:36.126654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:36.126706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:36.126748Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896031727169755:4726]
2025-09-30T14:55:36.127466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:36.127922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:36.127988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:36.128368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:36.128445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:36.128452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:36.128453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:36.128454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:36.128456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:36.128457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:36.128458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:36.128460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:36.128461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:36.128462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:36.128464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.128465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:36.128466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:36.128467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:36.128469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:36.128475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:36.128485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:36.128489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:36.128493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:36.128497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:36.128499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:36.128502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:36.128504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:36.128507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:36.128510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:36.128512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.128515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:36.128520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:36.128524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:36.128528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:36.128537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:36.128544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:36.128551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:36.128557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:36.128563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:36.128569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:36.128574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:36.128580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:36.128585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:36.128590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:36.128595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:36.128601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:36.128606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:36.128612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:36.128617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:36.128623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:36.128628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:36.128634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:36.128638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:36.128644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:36.128651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.128660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.128664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:36.128669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:36.128674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:36.128685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:36.128689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:36.128695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:36.128705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:36.128710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:36.128757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:36.135947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:36.137468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:36.137486Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:36.137489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:36.137493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:36.137500Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1924 [2:7555896031727169755:4726]
2025-09-30T14:55:36.137518Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:36.137533Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:36.137536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:36.137540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:36.137555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:36.137571Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:36.137584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:36.137596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:36.137653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.137659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:36.137661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:36.137665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:36.137667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:36.137731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:36.137739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.137753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:36.137764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:36.137779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:36.137796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896031816939219:6121], now have 1 active actors on pipe
2025-09-30T14:55:36.137799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896031816939067:2454], now have 1 active actors on pipe
2025-09-30T14:55:36.137805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896031727169750:4726]
2025-09-30T14:55:36.137807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896031727169750:4726]
2025-09-30T14:55:36.137809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896031727169750:4726]
2025-09-30T14:55:36.137820Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:36.137833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:36.137837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:36.137840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:36.137842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:36.137851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:36.137854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:36.137895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896031727169750:4726]
2025-09-30T14:55:36.137906Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:36.137912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:36.137910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1924
2025-09-30T14:55:36.137953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:36.137962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:36.137951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1924
2025-09-30T14:55:36.137987Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|afda72f9-a760a434-80e3045e-368a2396_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:36.137999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:36.138003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:36.138005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:36.138015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:36.138023Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:36.138042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:36.138182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:36.138190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:36.138203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:36.138266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1925 partition: 0 MaxSeqNo: 42 sessionId: src_id|afda72f9-a760a434-80e3045e-368a2396_0
2025-09-30T14:55:36.138602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8840e5eb-70112c3a-cd67e0c9-60f72845_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|afda72f9-a760a434-80e3045e-368a2396_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:36.141514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afda72f9-a760a434-80e3045e-368a2396_0] Write session: try to update token
2025-09-30T14:55:36.141534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afda72f9-a760a434-80e3045e-368a2396_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:36.151988Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:36.152014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:36.152017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:36.152019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:36.152030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896031727169750:4726]
2025-09-30T14:55:36.152036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896031727169750:4726]
2025-09-30T14:55:36.152040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896031727169750:4726]
2025-09-30T14:55:36.152086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:36.152096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.152107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:36.152131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:36.152137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:36.152146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:36.152253Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:36.160756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1925 sessionId: src_id|afda72f9-a760a434-80e3045e-368a2396_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:36.163786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:36.199373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896031816939341:6314]
2025-09-30T14:55:36.199851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1924, pipe: [1:7555896031816939341:6314]
2025-09-30T14:55:36.277349Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:36.277683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:36.277692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:36.277731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896031816939341:6314], now have 1 active actors on pipe
2025-09-30T14:55:36.278012Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:36.278225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:36.278231Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:36.278242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:36.278285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896031816939341:6314]
2025-09-30T14:55:36.278305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1925 reason: error at write: Disconnected sessionId: src_id|afda72f9-a760a434-80e3045e-368a2396_0
2025-09-30T14:55:36.278475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1925 sessionId: src_id|afda72f9-a760a434-80e3045e-368a2396_0 is DEAD
2025-09-30T14:55:36.279348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afda72f9-a760a434-80e3045e-368a2396_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:36.279361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afda72f9-a760a434-80e3045e-368a2396_0] Write session will restart in 0.007514s
2025-09-30T14:55:36.279383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afda72f9-a760a434-80e3045e-368a2396_0] Write session: Do CDS request
2025-09-30T14:55:36.279392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afda72f9-a760a434-80e3045e-368a2396_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:36.287965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afda72f9-a760a434-80e3045e-368a2396_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:36.288087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:36.288108Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1926
2025-09-30T14:55:36.288219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1926 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:36.288252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1926 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:36.288257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1926 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:36.288262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:36.288795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1926 sessionId:  describe result for acl check
2025-09-30T14:55:36.288838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:36.288846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:36.288849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:36.288855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896031816939361:6114] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:36.289434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896031816939361:6114] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:36.291824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896031816939361:6114] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:36.295192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896031816939361:6114] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:36.295208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896031816939361:6114] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:36.295212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896031816939361:6114] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:36.295220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1926 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:36.305022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:36.308337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:36.308573Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:36.308591Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:36.308602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:36.308655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:36.308701Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896031727170016:4719]
2025-09-30T14:55:36.309418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:36.309905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:36.309971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:36.310310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:36.310383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:36.310391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:36.310393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:36.310394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:36.310395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:36.310396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:36.310397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:36.310398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:36.310400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:36.310401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:36.310403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.310404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:36.310405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:36.310405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:36.310407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:36.310412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:36.310421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:36.310425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:36.310429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:36.310433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:36.310437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:36.310440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:36.310443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:36.310447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:36.310453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:36.310456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.310460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:36.310464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:36.310467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:36.310471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:36.310482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:36.310490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:36.310495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:36.310501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:36.310506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:36.310512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:36.310516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:36.310522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:36.310528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:36.310534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:36.310538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:36.310543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:36.310549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:36.310555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:36.310560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:36.310565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:36.310570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:36.310575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:36.310581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:36.310586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:36.310591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.310597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.310601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:36.310606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:36.310611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:36.310616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:36.310621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:36.310626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:36.310633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:36.310639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:36.310681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:36.317378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:36.318325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:36.318341Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:36.318345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:36.318352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:36.318359Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1925 [2:7555896031727170016:4719]
2025-09-30T14:55:36.318377Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:36.318396Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:36.318405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:36.318409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:36.318412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:36.318430Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:36.318437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:36.318445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:36.318510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.318518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:36.318521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:36.318524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:36.318527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:36.318601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:36.318610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.318625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:36.318639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:36.318661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:36.318688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896031816939346:2454], now have 1 active actors on pipe
2025-09-30T14:55:36.318697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896031816939468:6114], now have 1 active actors on pipe
2025-09-30T14:55:36.318704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896031727170011:4719]
2025-09-30T14:55:36.318709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896031727170011:4719]
2025-09-30T14:55:36.318711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896031727170011:4719]
2025-09-30T14:55:36.318728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:36.318747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:36.318756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:36.318762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:36.318764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:36.318769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:36.318774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:36.318815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896031727170011:4719]
2025-09-30T14:55:36.318828Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:36.318795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1925
2025-09-30T14:55:36.318834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:36.318808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1925
2025-09-30T14:55:36.318871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:36.318882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:36.318909Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|657500d-e078019c-83a3fad9-e8c5acbe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:36.318920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:36.318924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:36.318927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:36.318937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:36.318951Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:36.318971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:36.319163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:36.319174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:36.319190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:36.319370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1926 partition: 0 MaxSeqNo: 42 sessionId: src_id|657500d-e078019c-83a3fad9-e8c5acbe_0
2025-09-30T14:55:36.319733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afda72f9-a760a434-80e3045e-368a2396_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|657500d-e078019c-83a3fad9-e8c5acbe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:36.322712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|657500d-e078019c-83a3fad9-e8c5acbe_0] Write session: try to update token
2025-09-30T14:55:36.322734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|657500d-e078019c-83a3fad9-e8c5acbe_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:36.340359Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:36.340382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:36.340392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896031727170011:4719]
2025-09-30T14:55:36.340444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:36.340500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:36.340624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:36.340779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:36.340938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:36.341095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:36.341302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:36.341348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:36.342374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1926 sessionId: src_id|657500d-e078019c-83a3fad9-e8c5acbe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:36.345389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:36.346311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:36.346337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:36.346378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:36.346529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:36.354954Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:36.354980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:36.354984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:36.354986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:36.354997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896031727170011:4719]
2025-09-30T14:55:36.355002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896031727170011:4719]
2025-09-30T14:55:36.355006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896031727170011:4719]
2025-09-30T14:55:36.355052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:36.355059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.355062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:36.355203Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:36.355351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:36.355372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:36.355376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:36.378579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896031816939616:6314]
2025-09-30T14:55:36.379040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1925, pipe: [1:7555896031816939616:6314]
2025-09-30T14:55:36.482362Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:36.492023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:36.492057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:36.492251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:36.492319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:36.492403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:36.492471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:36.492963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:36.492977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:36.493048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:36.493118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:36.493187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:36.493257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:36.493304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:36.493315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:36.493389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:36.493449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:36.493511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:36.493598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:36.493645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:36.493657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:36.493724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:36.493792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:36.493859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:36.493929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:36.493976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:36.493984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:36.494056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:36.494124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:36.494188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:36.494254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:36.494295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:36.494305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:36.494376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:36.494442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:36.494512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:36.494579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:36.494624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:36.494631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:36.494704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:36.494767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:36.494833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:36.494895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:36.494944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:36.494953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:36.495023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:36.495090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:36.495151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:36.495215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:36.495340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:36.495350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:36.495422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:36.495486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:36.495551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:36.495619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:36.495671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:36.495681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:36.495747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:36.495809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:36.495876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:36.495942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:36.495990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:36.495996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:36.496069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896031816939616:6314], now have 1 active actors on pipe
2025-09-30T14:55:36.496304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:36.496358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:36.496363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:36.496375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896031816939616:6314]
2025-09-30T14:55:36.496393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1926 reason: error at write: Disconnected sessionId: src_id|657500d-e078019c-83a3fad9-e8c5acbe_0
2025-09-30T14:55:36.496586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1926 sessionId: src_id|657500d-e078019c-83a3fad9-e8c5acbe_0 is DEAD
2025-09-30T14:55:36.496768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|657500d-e078019c-83a3fad9-e8c5acbe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:36.496778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|657500d-e078019c-83a3fad9-e8c5acbe_0] Write session will restart in 0.006134s
2025-09-30T14:55:36.496802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|657500d-e078019c-83a3fad9-e8c5acbe_0] Write session: Do CDS request
2025-09-30T14:55:36.496807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|657500d-e078019c-83a3fad9-e8c5acbe_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:36.497116Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:36.503868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|657500d-e078019c-83a3fad9-e8c5acbe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:36.503952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:36.503973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1927
2025-09-30T14:55:36.504097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1927 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:36.504134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1927 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:36.504139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1927 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:36.504143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:36.504594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1927 sessionId:  describe result for acl check
2025-09-30T14:55:36.504630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:36.504632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:36.504634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:36.504640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896031816939658:6101] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:36.505199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896031816939658:6101] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:36.507932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896031816939658:6101] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:36.514897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896031816939658:6101] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:36.514926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896031816939658:6101] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:36.514930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896031816939658:6101] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:36.514939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1927 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:36.520886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:36.523784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:36.524275Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:36.524281Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:36.524295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:36.524371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:36.524404Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896031727170319:4700]
2025-09-30T14:55:36.525031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:36.525427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:36.525494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:36.525871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:36.525953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:36.525954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:36.525955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:36.525957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:36.525958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:36.525959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:36.525961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:36.525962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:36.525963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:36.525965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:36.525966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.525968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:36.525969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:36.525970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:36.525971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:36.525978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:36.525989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:36.525993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:36.525997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:36.526001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:36.526005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:36.526009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:36.526013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:36.526017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:36.526020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:36.526024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.526028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:36.526032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:36.526036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:36.526039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:36.526048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:36.526057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:36.526063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:36.526088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:36.526093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:36.526100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:36.526106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:36.526112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:36.526118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:36.526123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:36.526128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:36.526134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:36.526139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:36.526144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:36.526149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:36.526161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:36.526166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:36.526171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:36.526178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:36.526183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:36.526188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.526194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.526198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:36.526203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:36.526208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:36.526212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:36.526217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:36.526222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:36.526227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:36.526232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:36.526273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:36.533681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:36.535274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1926
2025-09-30T14:55:36.534575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:36.535325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1926
2025-09-30T14:55:36.534594Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:36.534598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:36.534603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:36.534610Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1926 [2:7555896031727170319:4700]
2025-09-30T14:55:36.534628Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:36.534648Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:36.534651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:36.534655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:36.534658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:36.534676Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:36.534684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:36.534691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:36.534761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.534764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:36.534767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:36.534771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:36.534774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:36.534851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:36.534855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.534884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:36.534899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:36.534918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:36.534939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896031816939793:6101], now have 1 active actors on pipe
2025-09-30T14:55:36.534947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896031727170313:4700]
2025-09-30T14:55:36.534949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896031727170313:4700]
2025-09-30T14:55:36.534952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896031727170313:4700]
2025-09-30T14:55:36.534968Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:36.534981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896031816939643:2454], now have 1 active actors on pipe
2025-09-30T14:55:36.534986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:36.534991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:36.534991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:36.534994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:36.535007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:36.535011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:36.535048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896031727170313:4700]
2025-09-30T14:55:36.535057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:36.535067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:36.536180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1927 partition: 0 MaxSeqNo: 42 sessionId: src_id|ea3b8e7c-8d9142b3-700feea-263b83f7_0
2025-09-30T14:55:36.537947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|657500d-e078019c-83a3fad9-e8c5acbe_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ea3b8e7c-8d9142b3-700feea-263b83f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:36.535682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:36.535700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:36.535732Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea3b8e7c-8d9142b3-700feea-263b83f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:36.535741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:36.535745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:36.535748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:36.535761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:36.535773Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:36.535790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:36.536025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:36.536033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:36.536057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:36.546795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea3b8e7c-8d9142b3-700feea-263b83f7_0] Write session: try to update token
2025-09-30T14:55:36.546821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea3b8e7c-8d9142b3-700feea-263b83f7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:36.548336Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:36.548360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:36.548371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896031727170313:4700]
2025-09-30T14:55:36.548418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:36.548420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:36.548618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:36.548785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:36.548951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:36.549112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:36.549339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:36.549389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:36.566684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1927 sessionId: src_id|ea3b8e7c-8d9142b3-700feea-263b83f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:36.568662Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:36.568689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:36.568692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:36.568694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:36.568704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896031727170313:4700]
2025-09-30T14:55:36.568709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896031727170313:4700]
2025-09-30T14:55:36.568713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896031727170313:4700]
2025-09-30T14:55:36.568757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:36.568765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.568768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:36.568846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:36.568864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:36.568868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:36.568914Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:36.575668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:36.596689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896031816939910:6314]
2025-09-30T14:55:36.597130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1926, pipe: [1:7555896031816939910:6314]
2025-09-30T14:55:36.684888Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:36.685311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:36.685326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:36.685346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896031816939910:6314], now have 1 active actors on pipe
2025-09-30T14:55:36.685595Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:36.686526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea3b8e7c-8d9142b3-700feea-263b83f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:36.686538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea3b8e7c-8d9142b3-700feea-263b83f7_0] Write session will restart in 0.007582s
2025-09-30T14:55:36.686562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea3b8e7c-8d9142b3-700feea-263b83f7_0] Write session: Do CDS request
2025-09-30T14:55:36.686568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea3b8e7c-8d9142b3-700feea-263b83f7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:36.686069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896031816939910:6314]
2025-09-30T14:55:36.686111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:36.686189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1927 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ea3b8e7c-8d9142b3-700feea-263b83f7_0
2025-09-30T14:55:36.686359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:36.686367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1927 sessionId: src_id|ea3b8e7c-8d9142b3-700feea-263b83f7_0 is DEAD
2025-09-30T14:55:36.695792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea3b8e7c-8d9142b3-700feea-263b83f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:36.695879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:36.695897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1928
2025-09-30T14:55:36.696057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1928 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:36.696088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1928 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:36.696093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1928 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:36.696101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:36.696560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1928 sessionId:  describe result for acl check
2025-09-30T14:55:36.696599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:36.696608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:36.696611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:36.696617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896031816939965:6090] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:36.697260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896031816939965:6090] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:36.700323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896031816939965:6090] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:36.703792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896031816939965:6090] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:36.703809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896031816939965:6090] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:36.703812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896031816939965:6090] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:36.703819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1928 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:36.706746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:36.709637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:36.709979Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:36.709992Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:36.710004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:36.710080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:36.710129Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896031727170594:4696]
2025-09-30T14:55:36.710829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:36.711152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:36.711212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:36.711568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:36.711639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:36.711647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:36.711649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:36.711650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:36.711652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:36.711653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:36.711654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:36.711655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:36.711657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:36.711658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:36.711659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.711661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:36.711662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:36.711663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:36.711665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:36.711670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:36.711681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:36.711685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:36.711689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:36.711693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:36.711697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:36.711701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:36.711706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:36.711710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:36.711714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:36.711718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.711722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:36.711726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:36.711731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:36.711735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:36.711743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:36.711751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:36.711757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:36.711763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:36.711768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:36.711774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:36.711779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:36.711785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:36.711790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:36.711796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:36.711801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:36.711806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:36.711811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:36.711817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:36.711821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:36.711827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:36.711832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:36.711837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:36.711843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:36.711848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:36.711860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.711865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.711874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:36.711879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:36.711887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:36.711897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:36.711902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:36.711908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:36.711917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:36.711922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:36.711967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:36.717604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:36.718737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:36.718754Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:36.718756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:36.718760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:36.718768Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1927 [2:7555896031727170594:4696]
2025-09-30T14:55:36.718783Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:36.718796Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:36.718798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:36.718801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:36.718803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:36.718815Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:36.718819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:36.718825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:36.718873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.718879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:36.718881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:36.718884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:36.718885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:36.718938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:36.718945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.718954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:36.718960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:36.718970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:36.718984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896031727170589:4696]
2025-09-30T14:55:36.718991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896031727170589:4696]
2025-09-30T14:55:36.718993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896031727170589:4696]
2025-09-30T14:55:36.719002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:36.719011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:36.719016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:36.719023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:36.719026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:36.719031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:36.719033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:36.719044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896031816939916:2454], now have 1 active actors on pipe
2025-09-30T14:55:36.719049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896031816940160:6090], now have 1 active actors on pipe
2025-09-30T14:55:36.719083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896031727170589:4696]
2025-09-30T14:55:36.719096Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:36.719102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:36.719105Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1927
2025-09-30T14:55:36.719123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1927
2025-09-30T14:55:36.719152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:36.719162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:36.719185Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|edc59cb0-6afe2c3b-928b8444-3b9f0c21_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:36.719194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:36.719197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:36.719198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:36.719206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:36.719215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:36.719225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:36.719429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:36.719439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:36.719450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:36.719536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1928 partition: 0 MaxSeqNo: 42 sessionId: src_id|edc59cb0-6afe2c3b-928b8444-3b9f0c21_0
2025-09-30T14:55:36.719924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea3b8e7c-8d9142b3-700feea-263b83f7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|edc59cb0-6afe2c3b-928b8444-3b9f0c21_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:36.722892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edc59cb0-6afe2c3b-928b8444-3b9f0c21_0] Write session: try to update token
2025-09-30T14:55:36.722916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edc59cb0-6afe2c3b-928b8444-3b9f0c21_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:36.732117Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:36.732139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:36.732142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:36.732143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:36.732153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896031727170589:4696]
2025-09-30T14:55:36.732157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896031727170589:4696]
2025-09-30T14:55:36.732162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896031727170589:4696]
2025-09-30T14:55:36.732207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:36.732215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:36.732219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.732222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:36.732222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:36.732226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:36.732365Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:36.738651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1928 sessionId: src_id|edc59cb0-6afe2c3b-928b8444-3b9f0c21_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:36.742156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:36.787639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896031816940198:6314]
2025-09-30T14:55:36.788083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1927, pipe: [1:7555896031816940198:6314]
2025-09-30T14:55:36.850645Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:36.851107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:36.851123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:36.851165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896031816940198:6314], now have 1 active actors on pipe
2025-09-30T14:55:36.851476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896031816940198:6314]
2025-09-30T14:55:36.851504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:36.851513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:36.851516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:36.852165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edc59cb0-6afe2c3b-928b8444-3b9f0c21_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:36.852178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edc59cb0-6afe2c3b-928b8444-3b9f0c21_0] Write session will restart in 0.007101s
2025-09-30T14:55:36.852202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edc59cb0-6afe2c3b-928b8444-3b9f0c21_0] Write session: Do CDS request
2025-09-30T14:55:36.852209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edc59cb0-6afe2c3b-928b8444-3b9f0c21_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:36.851583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1928 reason: error at write: Disconnected sessionId: src_id|edc59cb0-6afe2c3b-928b8444-3b9f0c21_0
2025-09-30T14:55:36.851778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1928 sessionId: src_id|edc59cb0-6afe2c3b-928b8444-3b9f0c21_0 is DEAD
2025-09-30T14:55:36.851514Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:36.862881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edc59cb0-6afe2c3b-928b8444-3b9f0c21_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:36.863552Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:36.863570Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1929
2025-09-30T14:55:36.867384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1929 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:36.867442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1929 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:36.867454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1929 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:36.867465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:36.867928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1929 sessionId:  describe result for acl check
2025-09-30T14:55:36.867963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:36.867965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:36.867966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:36.867971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896031816940262:6084] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:36.868447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896031816940262:6084] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:36.871360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896031816940262:6084] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:36.875644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896031816940262:6084] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:36.875664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896031816940262:6084] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:36.875670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896031816940262:6084] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:36.875679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1929 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:36.882681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:36.889103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:36.889340Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:36.889351Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:36.889362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:36.889425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:36.889471Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896031727170860:4687]
2025-09-30T14:55:36.890171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:36.890543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:36.890587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:36.890934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:36.890991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:36.890998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:36.890999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:36.891001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:36.891002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:36.891003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:36.891004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:36.891006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:36.891007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:36.891008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:36.891009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.891010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:36.891011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:36.891012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:36.891014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:36.891019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:36.891028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:36.891033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:36.891036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:36.891040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:36.891043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:36.891047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:36.891051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:36.891055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:36.891059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:36.891063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.891067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:36.891071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:36.891074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:36.891078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:36.891086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:36.891093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:36.891099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:36.891104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:36.891109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:36.891114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:36.891119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:36.891124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:36.891130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:36.891135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:36.891139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:36.891144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:36.891149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:36.891154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:36.891158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:36.891163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:36.891170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:36.891175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:36.891180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:36.891189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:36.891195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.891200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.891204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:36.891209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:36.891214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:36.891219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:36.891223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:36.891228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:36.891232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:36.891237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:36.891305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:36.901622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:36.903024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:36.903039Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:36.903042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:36.903046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:36.903053Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1928 [2:7555896031727170860:4687]
2025-09-30T14:55:36.903071Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:36.903089Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:36.903092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:36.903096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:36.903098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:36.903113Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:36.903120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:36.903126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:36.903191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.903200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:36.903203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:36.903206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:36.903208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:36.903308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:36.903318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.903333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:36.903345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:36.903362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:36.903385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896031816940200:2454], now have 1 active actors on pipe
2025-09-30T14:55:36.903393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896031816940365:6084], now have 1 active actors on pipe
2025-09-30T14:55:36.903400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896031727170855:4687]
2025-09-30T14:55:36.903403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896031727170855:4687]
2025-09-30T14:55:36.903405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896031727170855:4687]
2025-09-30T14:55:36.903418Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:36.903435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:36.903442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:36.903445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:36.903447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:36.903456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:36.903459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:36.903492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1928
2025-09-30T14:55:36.903497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896031727170855:4687]
2025-09-30T14:55:36.903554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1928
2025-09-30T14:55:36.903506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:36.903522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:36.903684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:36.903710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:36.903736Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc35fb43-7dad0ad4-b231a8b9-7c4944b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:36.903750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:36.903759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:36.903762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:36.903772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:36.903788Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:36.903808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:36.904038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:36.904050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:36.904072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:36.904325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1929 partition: 0 MaxSeqNo: 42 sessionId: src_id|bc35fb43-7dad0ad4-b231a8b9-7c4944b7_0
2025-09-30T14:55:36.907528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edc59cb0-6afe2c3b-928b8444-3b9f0c21_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bc35fb43-7dad0ad4-b231a8b9-7c4944b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:36.910334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc35fb43-7dad0ad4-b231a8b9-7c4944b7_0] Write session: try to update token
2025-09-30T14:55:36.910352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc35fb43-7dad0ad4-b231a8b9-7c4944b7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:36.916875Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:36.916894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:36.916896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:36.916899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:36.916908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896031727170855:4687]
2025-09-30T14:55:36.916913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896031727170855:4687]
2025-09-30T14:55:36.916917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896031727170855:4687]
2025-09-30T14:55:36.916957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:36.916965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:36.916967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:36.916974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:36.916983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:36.916989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:36.917111Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:36.928024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1929 sessionId: src_id|bc35fb43-7dad0ad4-b231a8b9-7c4944b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:36.930754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:36.951510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896031816940473:6314]
2025-09-30T14:55:36.951859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1928, pipe: [1:7555896031816940473:6314]
2025-09-30T14:55:37.033183Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:37.033499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:37.033514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:37.033531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896031816940473:6314], now have 1 active actors on pipe
2025-09-30T14:55:37.033748Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:37.034310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc35fb43-7dad0ad4-b231a8b9-7c4944b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:37.034321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc35fb43-7dad0ad4-b231a8b9-7c4944b7_0] Write session will restart in 0.009657s
2025-09-30T14:55:37.033899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:37.033994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1929 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bc35fb43-7dad0ad4-b231a8b9-7c4944b7_0
2025-09-30T14:55:37.034345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc35fb43-7dad0ad4-b231a8b9-7c4944b7_0] Write session: Do CDS request
2025-09-30T14:55:37.034172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1929 sessionId: src_id|bc35fb43-7dad0ad4-b231a8b9-7c4944b7_0 is DEAD
2025-09-30T14:55:37.034231Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:37.034352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc35fb43-7dad0ad4-b231a8b9-7c4944b7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:37.034262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896031816940473:6314]
2025-09-30T14:55:37.044795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc35fb43-7dad0ad4-b231a8b9-7c4944b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:37.044919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:37.044953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1930
2025-09-30T14:55:37.045080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1930 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:37.045115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1930 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:37.045125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1930 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:37.045130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:37.045666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1930 sessionId:  describe result for acl check
2025-09-30T14:55:37.045714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:37.045721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:37.045724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:37.045730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896036111907847:6079] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:37.046295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896036111907847:6079] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:37.048781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896036111907847:6079] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:37.052593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896036111907847:6079] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:37.052610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896036111907847:6079] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:37.052614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896036111907847:6079] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:37.052623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1930 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:37.054268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:37.057273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:37.057485Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:37.057496Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:37.057507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:37.057572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:37.057628Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896036022138421:4684]
2025-09-30T14:55:37.058299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:37.058785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:37.058840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:37.059208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:37.059297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:37.059304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:37.059305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:37.059307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:37.059308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:37.059310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:37.059311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:37.059312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:37.059314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:37.059315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:37.059316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.059317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.059319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.059320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:37.059321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:37.059327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:37.059338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:37.059342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:37.059346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:37.059350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:37.059354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:37.059358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:37.059362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:37.059365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:37.059372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:37.059375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.059379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.059383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.059387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:37.059391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:37.059399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:37.059407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:37.059414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:37.059419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:37.059424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:37.059428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:37.059433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:37.059439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:37.059450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:37.059456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:37.059460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:37.059466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:37.059470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:37.059476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:37.059481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:37.059486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:37.059491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:37.059498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:37.059503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:37.059508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:37.059514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.059519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.059523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.059528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.059532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.059537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.059541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:37.059546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:37.059550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:37.059555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:37.059599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:37.069689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:37.070908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:37.070927Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:37.070930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:37.070934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:37.070942Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1929 [2:7555896036022138421:4684]
2025-09-30T14:55:37.070960Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:37.070978Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:37.070982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:37.070985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:37.070987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:37.071004Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:37.071011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:37.071024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:37.071093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.071100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.071103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.071107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:37.071110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:37.071184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:37.071193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.071206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.071218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.071234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:37.071271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896036111908031:6079], now have 1 active actors on pipe
2025-09-30T14:55:37.071285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896036022138416:4684]
2025-09-30T14:55:37.071288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896036022138416:4684]
2025-09-30T14:55:37.071291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896036022138416:4684]
2025-09-30T14:55:37.071304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:37.071409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1929
2025-09-30T14:55:37.071467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1929
2025-09-30T14:55:37.071319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896036111907771:2454], now have 1 active actors on pipe
2025-09-30T14:55:37.071332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:37.071333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:37.071337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:37.071342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:37.071349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:37.071353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:37.071391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896036022138416:4684]
2025-09-30T14:55:37.071399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:37.071406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:37.071444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:37.071449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:37.071472Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a641bca7-b05a3de8-63734e83-e22f56cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:37.071480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:37.071484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:37.071487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:37.071498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:37.071508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:37.071523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:37.071945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:37.071958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:37.071977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:37.072153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1930 partition: 0 MaxSeqNo: 42 sessionId: src_id|a641bca7-b05a3de8-63734e83-e22f56cb_0
2025-09-30T14:55:37.072590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc35fb43-7dad0ad4-b231a8b9-7c4944b7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a641bca7-b05a3de8-63734e83-e22f56cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:37.075669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a641bca7-b05a3de8-63734e83-e22f56cb_0] Write session: try to update token
2025-09-30T14:55:37.075692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a641bca7-b05a3de8-63734e83-e22f56cb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:37.084173Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:37.084195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:37.084205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896036022138416:4684]
2025-09-30T14:55:37.084251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:37.084256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:37.084426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:37.084587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:37.084744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:37.084904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:37.085125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:37.085169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:37.095733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1930 sessionId: src_id|a641bca7-b05a3de8-63734e83-e22f56cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:37.099858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:37.100119Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:37.100141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:37.100144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:37.100146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:37.100156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896036022138416:4684]
2025-09-30T14:55:37.100161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896036022138416:4684]
2025-09-30T14:55:37.100165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896036022138416:4684]
2025-09-30T14:55:37.100195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:37.100211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:37.100213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:37.100217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:37.100220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:37.100238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:37.100251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.100254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:37.100409Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:37.134282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896036111908047:6314]
2025-09-30T14:55:37.134604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1929, pipe: [1:7555896036111908047:6314]
2025-09-30T14:55:37.217657Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:37.218101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896036111908047:6314], now have 1 active actors on pipe
2025-09-30T14:55:37.218406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:37.218425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:37.218492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1930 reason: error at write: Disconnected sessionId: src_id|a641bca7-b05a3de8-63734e83-e22f56cb_0
2025-09-30T14:55:37.218675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1930 sessionId: src_id|a641bca7-b05a3de8-63734e83-e22f56cb_0 is DEAD
2025-09-30T14:55:37.218692Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:37.218723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896036111908047:6314]
2025-09-30T14:55:37.218892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a641bca7-b05a3de8-63734e83-e22f56cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:37.218902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a641bca7-b05a3de8-63734e83-e22f56cb_0] Write session will restart in 0.007096s
2025-09-30T14:55:37.218931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a641bca7-b05a3de8-63734e83-e22f56cb_0] Write session: Do CDS request
2025-09-30T14:55:37.218937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a641bca7-b05a3de8-63734e83-e22f56cb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:37.219101Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:37.227470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a641bca7-b05a3de8-63734e83-e22f56cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:37.231462Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:37.231483Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1931
2025-09-30T14:55:37.232605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1931 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:37.232664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1931 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:37.232674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1931 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:37.232679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:37.234661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1931 sessionId:  describe result for acl check
2025-09-30T14:55:37.234703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:37.234710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:37.234713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:37.234720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896036111908181:6070] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:37.235322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896036111908181:6070] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:37.240406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896036111908181:6070] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:37.244544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:37.244595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896036111908181:6070] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:37.244615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896036111908181:6070] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:37.244619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896036111908181:6070] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:37.244628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1931 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:37.247327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:37.247577Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:37.247581Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:37.247592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:37.247666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:37.247706Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896036022138687:4682]
2025-09-30T14:55:37.248437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:37.248796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:37.248848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:37.249199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:37.249291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:37.249293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:37.249294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:37.249295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:37.249297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:37.249298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:37.249300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:37.249302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:37.249303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:37.249305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:37.249306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.249307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.249309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.249310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:37.249311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:37.249318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:37.249330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:37.249335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:37.249340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:37.249345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:37.249350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:37.249354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:37.249358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:37.249363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:37.249367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:37.249372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.249377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.249381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.249385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:37.249390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:37.249400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:37.249409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:37.249416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:37.249422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:37.249427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:37.249433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:37.249438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:37.249445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:37.249451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:37.249457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:37.249462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:37.249468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:37.249473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:37.249479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:37.249484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:37.249490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:37.249496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:37.249503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:37.249508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:37.249514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:37.249519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.249525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.249530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.249552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.249558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.249564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.249569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:37.249575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:37.249581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:37.249589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:37.249638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:37.257328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1930
2025-09-30T14:55:37.257333Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1930
2025-09-30T14:55:37.255700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:37.256807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:37.256813Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:37.256816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:37.256820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:37.256827Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1930 [2:7555896036022138687:4682]
2025-09-30T14:55:37.256844Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:37.256860Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:37.256864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:37.256868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:37.256870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:37.256887Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:37.256894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:37.256901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:37.256965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.256968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.256970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.256974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:37.256976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:37.257052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:37.257055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.257068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.257083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.257102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:37.257120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896036022138681:4682]
2025-09-30T14:55:37.257123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896036022138681:4682]
2025-09-30T14:55:37.257126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896036022138681:4682]
2025-09-30T14:55:37.257135Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:37.257149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:37.257151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896036111908318:6070], now have 1 active actors on pipe
2025-09-30T14:55:37.257153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:37.257155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:37.257155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896036111908056:2454], now have 1 active actors on pipe
2025-09-30T14:55:37.257163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:37.257180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:37.257184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:37.257218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896036022138681:4682]
2025-09-30T14:55:37.257230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:37.257266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:37.257630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:37.257648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:37.257674Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2d3f88f-c059aa4a-82ab8435-4a349815_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:37.257682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:37.257686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:37.257688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:37.257699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:37.257715Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:37.257735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:37.258024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:37.258034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:37.258049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:37.258158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1931 partition: 0 MaxSeqNo: 42 sessionId: src_id|a2d3f88f-c059aa4a-82ab8435-4a349815_0
2025-09-30T14:55:37.258548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a641bca7-b05a3de8-63734e83-e22f56cb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a2d3f88f-c059aa4a-82ab8435-4a349815_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:37.261672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2d3f88f-c059aa4a-82ab8435-4a349815_0] Write session: try to update token
2025-09-30T14:55:37.261694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2d3f88f-c059aa4a-82ab8435-4a349815_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:37.282183Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:37.282210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:37.282221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896036022138681:4682]
2025-09-30T14:55:37.282273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:37.282459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:37.282621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:37.282774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:37.282937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:37.283146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:37.283212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:37.280060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1931 sessionId: src_id|a2d3f88f-c059aa4a-82ab8435-4a349815_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:37.283144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:37.283327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:37.287625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:37.287649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:37.287686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:37.287863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:37.298073Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:37.298102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:37.298106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:37.298108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:37.298120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896036022138681:4682]
2025-09-30T14:55:37.298125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896036022138681:4682]
2025-09-30T14:55:37.298130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896036022138681:4682]
2025-09-30T14:55:37.298182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:37.298183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:37.298190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:37.298194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:37.298198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.298201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:37.298415Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:37.319111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896036111908330:6314]
2025-09-30T14:55:37.319456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1930, pipe: [1:7555896036111908330:6314]
2025-09-30T14:55:37.413096Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:37.428289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:37.428328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:37.428508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:37.428581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:37.428660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:37.428737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:37.428786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:37.428796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:37.428876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:37.428970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:37.429045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:37.429134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:37.429185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:37.429194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:37.429269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:37.429571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:37.429816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:37.429894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:37.429942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:37.429956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:37.430031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:37.430127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:37.430197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:37.430261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:37.430303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:37.430306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:37.430376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:37.430438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:37.430500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:37.430568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:37.430615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:37.430619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:37.430695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:37.430755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:37.430819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:37.430925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:37.430973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:37.430979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:37.431096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:37.431156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:37.431226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:37.431633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:37.431697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:37.431706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:37.431975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:37.432239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:37.432506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:37.432581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:37.432727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:37.432738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:37.432814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:37.432885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:37.432950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:37.433019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:37.433066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:37.433074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:37.433153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:37.433225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:37.433297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:37.433374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:37.433421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:37.433436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:37.433513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896036111908330:6314], now have 1 active actors on pipe
2025-09-30T14:55:37.433806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:37.433830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:37.433881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1931 reason: error at write: Disconnected sessionId: src_id|a2d3f88f-c059aa4a-82ab8435-4a349815_0
2025-09-30T14:55:37.434132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1931 sessionId: src_id|a2d3f88f-c059aa4a-82ab8435-4a349815_0 is DEAD
2025-09-30T14:55:37.434134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896036111908330:6314]
2025-09-30T14:55:37.434158Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:37.434307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2d3f88f-c059aa4a-82ab8435-4a349815_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:37.434316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2d3f88f-c059aa4a-82ab8435-4a349815_0] Write session will restart in 0.009571s
2025-09-30T14:55:37.434340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2d3f88f-c059aa4a-82ab8435-4a349815_0] Write session: Do CDS request
2025-09-30T14:55:37.434346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2d3f88f-c059aa4a-82ab8435-4a349815_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:37.434942Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:37.444794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2d3f88f-c059aa4a-82ab8435-4a349815_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:37.444865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:37.444883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1932
2025-09-30T14:55:37.445070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1932 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:37.445116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1932 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:37.445129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1932 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:37.445144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:37.445763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1932 sessionId:  describe result for acl check
2025-09-30T14:55:37.445793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:37.445800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:37.445802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:37.445807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896036111908366:6069] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:37.446397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896036111908366:6069] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:37.450171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896036111908366:6069] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:37.455610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896036111908366:6069] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:37.455643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896036111908366:6069] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:37.455647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896036111908366:6069] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:37.455656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1932 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:37.459662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:37.466131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:37.466576Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:37.466586Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:37.466600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:37.466670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:37.466711Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896036022138969:4674]
2025-09-30T14:55:37.467403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:37.467830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:37.467914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:37.468298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:37.468384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:37.468394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:37.468395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:37.468396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:37.468397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:37.468398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:37.468399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:37.468400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:37.468405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:37.468406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:37.468408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.468409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.468410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.468411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:37.468412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:37.468419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:37.468428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:37.468432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:37.468436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:37.468440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:37.468445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:37.468449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:37.468453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:37.468458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:37.468462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:37.468478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.468483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.468487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.468491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:37.468495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:37.468503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:37.468512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:37.468518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:37.468525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:37.468530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:37.468535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:37.468547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:37.468554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:37.468573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:37.468583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:37.468588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:37.468594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:37.468601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:37.468606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:37.468616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:37.468623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:37.468632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:37.468637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:37.468641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:37.468647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:37.468652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.468662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.468667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.468677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.468682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.468687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.468692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:37.468697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:37.468702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:37.468713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:37.468771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:37.474602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:37.475627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:37.475651Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:37.475654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:37.475657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:37.475664Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1931 [2:7555896036022138969:4674]
2025-09-30T14:55:37.475681Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:37.475696Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:37.475699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:37.475703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:37.475708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:37.475729Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:37.475740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:37.475752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:37.475824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.475832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.475834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.475838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:37.475840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:37.475926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:37.475938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.475951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.475966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.475984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:37.476008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896036111908557:6069], now have 1 active actors on pipe
2025-09-30T14:55:37.476018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896036111908333:2454], now have 1 active actors on pipe
2025-09-30T14:55:37.476026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896036022138955:4674]
2025-09-30T14:55:37.476028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896036022138955:4674]
2025-09-30T14:55:37.476030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896036022138955:4674]
2025-09-30T14:55:37.476046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:37.476059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:37.476077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:37.476080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:37.476081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:37.476082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:37.476086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:37.476070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1931
2025-09-30T14:55:37.476120Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1931
2025-09-30T14:55:37.476121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896036022138955:4674]
2025-09-30T14:55:37.476130Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:37.476131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:37.476156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:37.476166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:37.476223Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ed55c4c-b5c8e696-34bb0acd-234a672_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:37.476232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:37.476236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:37.476238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:37.476248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:37.476257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:37.476283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:37.476446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:37.476456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:37.476469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:37.476552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1932 partition: 0 MaxSeqNo: 42 sessionId: src_id|8ed55c4c-b5c8e696-34bb0acd-234a672_0
2025-09-30T14:55:37.476943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2d3f88f-c059aa4a-82ab8435-4a349815_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8ed55c4c-b5c8e696-34bb0acd-234a672_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:37.479751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed55c4c-b5c8e696-34bb0acd-234a672_0] Write session: try to update token
2025-09-30T14:55:37.479768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed55c4c-b5c8e696-34bb0acd-234a672_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:37.490418Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:37.490442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:37.490445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:37.490447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:37.490455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896036022138955:4674]
2025-09-30T14:55:37.490459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896036022138955:4674]
2025-09-30T14:55:37.490462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896036022138955:4674]
2025-09-30T14:55:37.490500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:37.490506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.490508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:37.490518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:37.490525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:37.490528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:37.490666Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:37.498094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1932 sessionId: src_id|8ed55c4c-b5c8e696-34bb0acd-234a672_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:37.501391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:37.534142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896036111908630:6314]
2025-09-30T14:55:37.534547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1931, pipe: [1:7555896036111908630:6314]
2025-09-30T14:55:37.609736Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:37.610147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:37.610167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:37.610210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896036111908630:6314], now have 1 active actors on pipe
2025-09-30T14:55:37.610493Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:37.610480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:37.610483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:37.610501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:37.610542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896036111908630:6314]
2025-09-30T14:55:37.610579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1932 reason: error at write: Disconnected sessionId: src_id|8ed55c4c-b5c8e696-34bb0acd-234a672_0
2025-09-30T14:55:37.610767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1932 sessionId: src_id|8ed55c4c-b5c8e696-34bb0acd-234a672_0 is DEAD
2025-09-30T14:55:37.610913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed55c4c-b5c8e696-34bb0acd-234a672_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:37.610921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed55c4c-b5c8e696-34bb0acd-234a672_0] Write session will restart in 0.009418s
2025-09-30T14:55:37.610940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed55c4c-b5c8e696-34bb0acd-234a672_0] Write session: Do CDS request
2025-09-30T14:55:37.610947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed55c4c-b5c8e696-34bb0acd-234a672_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:37.621854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed55c4c-b5c8e696-34bb0acd-234a672_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:37.621964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:37.621995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1933
2025-09-30T14:55:37.622128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1933 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:37.622162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1933 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:37.622167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1933 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:37.622171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:37.623154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1933 sessionId:  describe result for acl check
2025-09-30T14:55:37.623201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:37.623208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:37.623210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:37.623217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896036111908717:6053] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:37.623781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896036111908717:6053] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:37.626815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896036111908717:6053] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:37.630714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896036111908717:6053] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:37.630732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896036111908717:6053] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:37.630737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896036111908717:6053] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:37.630745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1933 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:37.632144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:37.635255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:37.635477Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:37.635489Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:37.635499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:37.635550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:37.635594Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896036022139260:4650]
2025-09-30T14:55:37.636286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:37.636610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:37.636671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:37.637196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:37.637309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:37.637316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:37.637318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:37.637319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:37.637320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:37.637322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:37.637323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:37.637324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:37.637325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:37.637326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:37.637328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.637329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.637330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.637331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:37.637332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:37.637338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:37.637348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:37.637352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:37.637357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:37.637360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:37.637364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:37.637367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:37.637371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:37.637375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:37.637379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:37.637383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.637386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.637390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.637393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:37.637397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:37.637405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:37.637412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:37.637418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:37.637424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:37.637428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:37.637434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:37.637439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:37.637455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:37.637460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:37.637465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:37.637469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:37.637476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:37.637481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:37.637486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:37.637491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:37.637495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:37.637499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:37.637504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:37.637508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:37.637512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:37.637517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.637521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.637526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.637530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.637546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.637551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.637556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:37.637561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:37.637565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:37.637578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:37.637620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:37.643197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:37.644173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:37.644190Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:37.644192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:37.644197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:37.644205Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1932 [2:7555896036022139260:4650]
2025-09-30T14:55:37.644221Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:37.644236Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:37.644245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:37.644248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:37.644251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:37.644268Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:37.644276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:37.644282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:37.644343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.644353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.644355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.644359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:37.644362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:37.644439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:37.644448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.644461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.644474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.644489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:37.644514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896036111908631:2454], now have 1 active actors on pipe
2025-09-30T14:55:37.644531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896036111908894:6053], now have 1 active actors on pipe
2025-09-30T14:55:37.644537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896036022139255:4650]
2025-09-30T14:55:37.644540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896036022139255:4650]
2025-09-30T14:55:37.644542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896036022139255:4650]
2025-09-30T14:55:37.644557Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:37.644573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:37.644588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:37.644596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:37.644632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896036022139255:4650]
2025-09-30T14:55:37.644639Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:37.644678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:37.644690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:37.644692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:37.644698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:37.644807Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1932
2025-09-30T14:55:37.644852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1932
2025-09-30T14:55:37.645057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:37.645068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:37.645094Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae5b3bc8-ddbf3acf-bd1e6f8a-7db4f2d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:37.645101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:37.645105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:37.645107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:37.645117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:37.645127Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:37.645141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:37.645334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:37.645349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:37.645387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:37.645499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1933 partition: 0 MaxSeqNo: 42 sessionId: src_id|ae5b3bc8-ddbf3acf-bd1e6f8a-7db4f2d8_0
2025-09-30T14:55:37.645870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed55c4c-b5c8e696-34bb0acd-234a672_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ae5b3bc8-ddbf3acf-bd1e6f8a-7db4f2d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:37.648745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae5b3bc8-ddbf3acf-bd1e6f8a-7db4f2d8_0] Write session: try to update token
2025-09-30T14:55:37.648766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae5b3bc8-ddbf3acf-bd1e6f8a-7db4f2d8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:37.657494Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:37.657518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:37.657520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:37.657522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:37.657532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896036022139255:4650]
2025-09-30T14:55:37.657547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896036022139255:4650]
2025-09-30T14:55:37.657551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896036022139255:4650]
2025-09-30T14:55:37.657658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:37.657671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:37.657675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:37.657676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:37.657683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.657686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:37.658056Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:37.664166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1933 sessionId: src_id|ae5b3bc8-ddbf3acf-bd1e6f8a-7db4f2d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:37.667046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:37.710301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896036111908911:6314]
2025-09-30T14:55:37.710649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1932, pipe: [1:7555896036111908911:6314]
2025-09-30T14:55:37.775144Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:37.775692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:37.775709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:37.775747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896036111908911:6314], now have 1 active actors on pipe
2025-09-30T14:55:37.776010Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:37.779380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:37.779399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:37.779467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1933 reason: error at write: Disconnected sessionId: src_id|ae5b3bc8-ddbf3acf-bd1e6f8a-7db4f2d8_0
2025-09-30T14:55:37.779653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1933 sessionId: src_id|ae5b3bc8-ddbf3acf-bd1e6f8a-7db4f2d8_0 is DEAD
2025-09-30T14:55:37.779781Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:37.779827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896036111908911:6314]
2025-09-30T14:55:37.783339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae5b3bc8-ddbf3acf-bd1e6f8a-7db4f2d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:37.783352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae5b3bc8-ddbf3acf-bd1e6f8a-7db4f2d8_0] Write session will restart in 0.006461s
2025-09-30T14:55:37.783378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae5b3bc8-ddbf3acf-bd1e6f8a-7db4f2d8_0] Write session: Do CDS request
2025-09-30T14:55:37.783384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae5b3bc8-ddbf3acf-bd1e6f8a-7db4f2d8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:37.791684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae5b3bc8-ddbf3acf-bd1e6f8a-7db4f2d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:37.791764Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:37.791784Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1934
2025-09-30T14:55:37.791926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1934 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:37.791977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1934 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:37.791987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1934 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:37.791991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:37.792458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1934 sessionId:  describe result for acl check
2025-09-30T14:55:37.792501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:37.792503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:37.792505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:37.792511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896036111909006:6041] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:37.793027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896036111909006:6041] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:37.795088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896036111909006:6041] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:37.799022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896036111909006:6041] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:37.799042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896036111909006:6041] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:37.799045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896036111909006:6041] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:37.799054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1934 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:37.801097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:37.804144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:37.804482Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:37.804494Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:37.804507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:37.804571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:37.804611Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896036022139541:4644]
2025-09-30T14:55:37.805323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:37.805988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:37.806054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:37.806438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:37.806508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:37.806518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:37.806520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:37.806521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:37.806522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:37.806523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:37.806525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:37.806526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:37.806528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:37.806529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:37.806530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.806531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.806532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.806534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:37.806535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:37.806541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:37.806552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:37.806557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:37.806561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:37.806566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:37.806570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:37.806575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:37.806579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:37.806584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:37.806588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:37.806592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.806596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.806600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.806604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:37.806608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:37.806616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:37.806626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:37.806634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:37.806640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:37.806646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:37.806652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:37.806657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:37.806663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:37.806668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:37.806673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:37.806679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:37.806685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:37.806691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:37.806697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:37.806702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:37.806708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:37.806714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:37.806720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:37.806725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:37.806731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:37.806736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.806742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.806748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.806754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.806759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.806765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.806770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:37.806775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:37.806780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:37.806785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:37.806836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:37.817497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:37.818474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:37.818494Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:37.818498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:37.818504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:37.818529Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1933 [2:7555896036022139541:4644]
2025-09-30T14:55:37.818556Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:37.818575Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:37.818578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:37.818581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:37.818584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:37.818603Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:37.818611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:37.818622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:37.818702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.818709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.818712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.818715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:37.818718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:37.818792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:37.818800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.818813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.818828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.818848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:37.818873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896036111909188:6041], now have 1 active actors on pipe
2025-09-30T14:55:37.818880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896036111908912:2454], now have 1 active actors on pipe
2025-09-30T14:55:37.818887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896036022139536:4644]
2025-09-30T14:55:37.818890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896036022139536:4644]
2025-09-30T14:55:37.818893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896036022139536:4644]
2025-09-30T14:55:37.818906Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:37.818919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:37.818926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:37.818937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:37.818941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:37.818944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:37.818946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:37.818985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896036022139536:4644]
2025-09-30T14:55:37.818998Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:37.819011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:37.819215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:37.819228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:37.819273Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da189092-cdacd606-c6cfcbfd-1075d7c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:37.819287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:37.819296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:37.819299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:37.819311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:37.819325Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:37.819341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:37.819555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:37.819570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:37.819594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:37.818995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1933
2025-09-30T14:55:37.819041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1933
2025-09-30T14:55:37.819705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1934 partition: 0 MaxSeqNo: 42 sessionId: src_id|da189092-cdacd606-c6cfcbfd-1075d7c7_0
2025-09-30T14:55:37.827942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae5b3bc8-ddbf3acf-bd1e6f8a-7db4f2d8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|da189092-cdacd606-c6cfcbfd-1075d7c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:37.830816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da189092-cdacd606-c6cfcbfd-1075d7c7_0] Write session: try to update token
2025-09-30T14:55:37.830838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da189092-cdacd606-c6cfcbfd-1075d7c7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:37.832999Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:37.833028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:37.833031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:37.833033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:37.833043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896036022139536:4644]
2025-09-30T14:55:37.833049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896036022139536:4644]
2025-09-30T14:55:37.833053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896036022139536:4644]
2025-09-30T14:55:37.833092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:37.833100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.833099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:37.833103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:37.833105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:37.833109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:37.833242Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:37.858095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1934 sessionId: src_id|da189092-cdacd606-c6cfcbfd-1075d7c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:37.860810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:37.879743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896036111909203:6314]
2025-09-30T14:55:37.880051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1933, pipe: [1:7555896036111909203:6314]
2025-09-30T14:55:37.946676Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:37.947647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:37.947672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:37.947692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896036111909203:6314], now have 1 active actors on pipe
2025-09-30T14:55:37.947899Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:37.947946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896036111909203:6314]
2025-09-30T14:55:37.947994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:37.948057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1934 reason: status is not ok: tablet will be restarted right now sessionId: src_id|da189092-cdacd606-c6cfcbfd-1075d7c7_0
2025-09-30T14:55:37.948241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1934 sessionId: src_id|da189092-cdacd606-c6cfcbfd-1075d7c7_0 is DEAD
2025-09-30T14:55:37.948399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da189092-cdacd606-c6cfcbfd-1075d7c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:37.948410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da189092-cdacd606-c6cfcbfd-1075d7c7_0] Write session will restart in 0.005808s
2025-09-30T14:55:37.948432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da189092-cdacd606-c6cfcbfd-1075d7c7_0] Write session: Do CDS request
2025-09-30T14:55:37.948398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:37.948438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da189092-cdacd606-c6cfcbfd-1075d7c7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:37.955804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da189092-cdacd606-c6cfcbfd-1075d7c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:37.955876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:37.955899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1935
2025-09-30T14:55:37.956046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1935 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:37.956090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1935 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:37.956101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1935 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:37.956105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:37.956561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1935 sessionId:  describe result for acl check
2025-09-30T14:55:37.956597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:37.956604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:37.956606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:37.956611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896036111909226:6037] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:37.957186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896036111909226:6037] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:37.961958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896036111909226:6037] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:37.965217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896036111909226:6037] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:37.965236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896036111909226:6037] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:37.965240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896036111909226:6037] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:37.965248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1935 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:37.969522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:37.972564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:37.972791Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:37.972802Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:37.972813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:37.972873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:37.972916Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896036022139814:4641]
2025-09-30T14:55:37.973579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:37.973885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:37.973939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:37.974276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:37.974350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:37.974358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:37.974359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:37.974360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:37.974361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:37.974362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:37.974364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:37.974365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:37.974366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:37.974367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:37.974368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.974370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.974370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.974372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:37.974373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:37.974378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:37.974388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:37.974392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:37.974397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:37.974400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:37.974404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:37.974407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:37.974411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:37.974415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:37.974419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:37.974423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.974427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.974430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.974434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:37.974438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:37.974446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:37.974454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:37.974459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:37.974465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:37.974469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:37.974474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:37.974479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:37.974484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:37.974489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:37.974493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:37.974497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:37.974505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:37.974509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:37.974514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:37.974527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:37.974533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:37.974538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:37.974543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:37.974548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:37.974553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:37.974558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.974563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.974568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.974573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.974578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.974584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.974588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:37.974593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:37.974598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:37.974603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:37.974646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:37.980398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:37.981523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:37.981549Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:37.981551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:37.981555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:37.981561Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1934 [2:7555896036022139814:4641]
2025-09-30T14:55:37.981578Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:37.981594Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:37.981596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:37.981599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:37.981602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:37.981618Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:37.981625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:37.981633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:37.981698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.981710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.981712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.981715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:37.981719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:37.981786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:37.981793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.981805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:37.981823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:37.981846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:37.981870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896036111909204:2454], now have 1 active actors on pipe
2025-09-30T14:55:37.981882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896036111909401:6037], now have 1 active actors on pipe
2025-09-30T14:55:37.981889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896036022139808:4641]
2025-09-30T14:55:37.981891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896036022139808:4641]
2025-09-30T14:55:37.981893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896036022139808:4641]
2025-09-30T14:55:37.981906Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:37.981919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:37.981934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:37.981934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:37.981937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:37.981938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:37.981940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:37.981923Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1934
2025-09-30T14:55:37.981935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1934
2025-09-30T14:55:37.981968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896036022139808:4641]
2025-09-30T14:55:37.981977Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:37.981979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:37.982019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:37.982028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:37.982063Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c41f6ee-2314a692-597e39e1-4a22553c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:37.982076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:37.982079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:37.982081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:37.982092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:37.982102Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:37.982121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:37.982292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:37.982308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:37.982333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:37.982421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1935 partition: 0 MaxSeqNo: 42 sessionId: src_id|3c41f6ee-2314a692-597e39e1-4a22553c_0
2025-09-30T14:55:37.982784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da189092-cdacd606-c6cfcbfd-1075d7c7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3c41f6ee-2314a692-597e39e1-4a22553c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:37.985569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c41f6ee-2314a692-597e39e1-4a22553c_0] Write session: try to update token
2025-09-30T14:55:37.985585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c41f6ee-2314a692-597e39e1-4a22553c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:37.994669Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:37.994691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:37.994694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:37.994696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:37.994706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896036022139808:4641]
2025-09-30T14:55:37.994711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896036022139808:4641]
2025-09-30T14:55:37.994714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896036022139808:4641]
2025-09-30T14:55:37.994752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:37.994759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:37.994757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:37.994762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:37.994764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:37.994772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:37.994912Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:38.000325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1935 sessionId: src_id|3c41f6ee-2314a692-597e39e1-4a22553c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:38.003107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:38.048218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896040406876777:6314]
2025-09-30T14:55:38.048553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1934, pipe: [1:7555896040406876777:6314]
2025-09-30T14:55:38.106436Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:38.107128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:38.107153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:38.107194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896040406876777:6314], now have 1 active actors on pipe
2025-09-30T14:55:38.107487Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:38.107570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896040406876777:6314]
2025-09-30T14:55:38.107453Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:38.107595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:38.107683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1935 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3c41f6ee-2314a692-597e39e1-4a22553c_0
2025-09-30T14:55:38.108060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c41f6ee-2314a692-597e39e1-4a22553c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:38.108073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c41f6ee-2314a692-597e39e1-4a22553c_0] Write session will restart in 0.009505s
2025-09-30T14:55:38.108106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c41f6ee-2314a692-597e39e1-4a22553c_0] Write session: Do CDS request
2025-09-30T14:55:38.108112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c41f6ee-2314a692-597e39e1-4a22553c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:38.108351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1935 sessionId: src_id|3c41f6ee-2314a692-597e39e1-4a22553c_0 is DEAD
2025-09-30T14:55:38.118788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c41f6ee-2314a692-597e39e1-4a22553c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:38.118949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:38.118973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1936
2025-09-30T14:55:38.119202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1936 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:38.119235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1936 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:38.119240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1936 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:38.119262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:38.119931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1936 sessionId:  describe result for acl check
2025-09-30T14:55:38.119963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:38.119965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:38.119967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:38.119973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896040406876803:6026] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:38.120522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896040406876803:6026] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:38.124934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896040406876803:6026] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:38.130053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896040406876803:6026] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:38.130080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896040406876803:6026] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:38.130084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896040406876803:6026] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:38.130093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1936 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:38.136717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:38.139945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:38.140215Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:38.140226Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:38.140237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:38.140298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:38.140345Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896040317107381:4636]
2025-09-30T14:55:38.141022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:38.141371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:38.141426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:38.141828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:38.141904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:38.141910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:38.141912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:38.141913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:38.141914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:38.141916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:38.141917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:38.141919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:38.141920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:38.141921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:38.141923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.141924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:38.141925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:38.141927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:38.141928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:38.141934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:38.141945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:38.141949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:38.141954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:38.141959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:38.141963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:38.141968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:38.141972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:38.141976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:38.141981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:38.141985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.141990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:38.141994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:38.141998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:38.142003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:38.142011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:38.142021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:38.142027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:38.142034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:38.142039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:38.142046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:38.142051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:38.142057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:38.142063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:38.142069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:38.142080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:38.142086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:38.142096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:38.142101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:38.142107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:38.142113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:38.142119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:38.142124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:38.142129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:38.142135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:38.142141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.142146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.142150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:38.142155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:38.142161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:38.142167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:38.142178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:38.142183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:38.142188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:38.142192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:38.142235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:38.148835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:38.150395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:38.150405Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:38.150408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:38.150413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:38.150420Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1935 [2:7555896040317107381:4636]
2025-09-30T14:55:38.150440Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:38.150456Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:38.150460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:38.150463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:38.150465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:38.150482Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:38.150490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:38.150497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:38.150570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.150573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:38.150575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:38.150579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:38.150581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:38.150661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:38.150663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.150678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:38.150691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:38.150709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:38.150725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896040317107376:4636]
2025-09-30T14:55:38.150728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896040317107376:4636]
2025-09-30T14:55:38.150732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896040317107376:4636]
2025-09-30T14:55:38.150742Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:38.150755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:38.150770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:38.150773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:38.150781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:38.150786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:38.150789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:38.150810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896040317107376:4636]
2025-09-30T14:55:38.150813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:38.150817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:38.150823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896040406876781:2454], now have 1 active actors on pipe
2025-09-30T14:55:38.150827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896040406876954:6026], now have 1 active actors on pipe
2025-09-30T14:55:38.151706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:38.151727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:38.151757Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|630af8ce-e0d0a7a9-e444d6e1-e97281eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:38.151768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:38.151781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:38.151784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:38.151798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:38.151814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:38.151832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:38.153410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:38.153426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:38.153452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:38.154097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c41f6ee-2314a692-597e39e1-4a22553c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|630af8ce-e0d0a7a9-e444d6e1-e97281eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:38.151141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1935
2025-09-30T14:55:38.151202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1935
2025-09-30T14:55:38.153649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1936 partition: 0 MaxSeqNo: 42 sessionId: src_id|630af8ce-e0d0a7a9-e444d6e1-e97281eb_0
2025-09-30T14:55:38.157213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|630af8ce-e0d0a7a9-e444d6e1-e97281eb_0] Write session: try to update token
2025-09-30T14:55:38.157237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|630af8ce-e0d0a7a9-e444d6e1-e97281eb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:38.164478Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:38.164502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:38.164505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:38.164507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:38.164517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896040317107376:4636]
2025-09-30T14:55:38.164521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896040317107376:4636]
2025-09-30T14:55:38.164525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896040317107376:4636]
2025-09-30T14:55:38.164563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:38.164570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.164573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:38.164717Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:38.165450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:38.165463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:38.165468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:38.197281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1936 sessionId: src_id|630af8ce-e0d0a7a9-e444d6e1-e97281eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:38.200104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:38.209955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896040406877066:6314]
2025-09-30T14:55:38.211491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1935, pipe: [1:7555896040406877066:6314]
2025-09-30T14:55:38.282318Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:38.282708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:38.282720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:38.282741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896040406877066:6314], now have 1 active actors on pipe
2025-09-30T14:55:38.283009Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:38.283602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896040406877066:6314]
2025-09-30T14:55:38.283634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:38.283665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:38.283740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1936 reason: status is not ok: tablet will be restarted right now sessionId: src_id|630af8ce-e0d0a7a9-e444d6e1-e97281eb_0
2025-09-30T14:55:38.283930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1936 sessionId: src_id|630af8ce-e0d0a7a9-e444d6e1-e97281eb_0 is DEAD
2025-09-30T14:55:38.284250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|630af8ce-e0d0a7a9-e444d6e1-e97281eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:38.284256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|630af8ce-e0d0a7a9-e444d6e1-e97281eb_0] Write session will restart in 0.008252s
2025-09-30T14:55:38.284275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|630af8ce-e0d0a7a9-e444d6e1-e97281eb_0] Write session: Do CDS request
2025-09-30T14:55:38.284279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|630af8ce-e0d0a7a9-e444d6e1-e97281eb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:38.295693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|630af8ce-e0d0a7a9-e444d6e1-e97281eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:38.296046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:38.296067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1937
2025-09-30T14:55:38.296193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1937 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:38.296228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1937 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:38.296239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1937 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:38.296247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:38.296875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1937 sessionId:  describe result for acl check
2025-09-30T14:55:38.296919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:38.296925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:38.296927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:38.296933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896040406877116:6024] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:38.297472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896040406877116:6024] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:38.301941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896040406877116:6024] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:38.308411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896040406877116:6024] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:38.308443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896040406877116:6024] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:38.308447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896040406877116:6024] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:38.308456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1937 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:38.314173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:38.317856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:38.318125Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:38.318137Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:38.318148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:38.318210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:38.318258Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896040317107653:4635]
2025-09-30T14:55:38.318965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:38.319407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:38.319471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:38.319840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:38.319903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:38.319904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:38.319906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:38.319907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:38.319909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:38.319911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:38.319913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:38.319914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:38.319916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:38.319917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:38.319919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.319920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:38.319922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:38.319923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:38.319925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:38.319931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:38.319943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:38.319948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:38.319952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:38.319957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:38.319961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:38.319966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:38.319970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:38.319975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:38.319980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:38.319985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.319991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:38.319995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:38.319999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:38.320003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:38.320011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:38.320020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:38.320028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:38.320035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:38.320040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:38.320046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:38.320052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:38.320058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:38.320065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:38.320071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:38.320076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:38.320082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:38.320089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:38.320094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:38.320100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:38.320121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:38.320127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:38.320134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:38.320139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:38.320145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:38.320152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.320159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.320165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:38.320171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:38.320177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:38.320183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:38.320189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:38.320195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:38.320203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:38.320210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:38.320259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:38.326376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:38.327642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:38.327661Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:38.327665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:38.327669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:38.327676Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1936 [2:7555896040317107653:4635]
2025-09-30T14:55:38.327696Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:38.327715Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:38.327718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:38.327722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:38.327725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:38.327746Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:38.327759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:38.327767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:38.327834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.327843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:38.327846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:38.327850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:38.327853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:38.327944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:38.327956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.327968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:38.327978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:38.327993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:38.328023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896040406877070:2454], now have 1 active actors on pipe
2025-09-30T14:55:38.328027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896040406877269:6024], now have 1 active actors on pipe
2025-09-30T14:55:38.328034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896040317107648:4635]
2025-09-30T14:55:38.328036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896040317107648:4635]
2025-09-30T14:55:38.328039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896040317107648:4635]
2025-09-30T14:55:38.328051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:38.328066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:38.328085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:38.328090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:38.328093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:38.328096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:38.328099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:38.328131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896040317107648:4635]
2025-09-30T14:55:38.328143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:38.328155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:38.328145Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1936
2025-09-30T14:55:38.328198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1936
2025-09-30T14:55:38.328317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:38.328334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:38.328364Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff5a52a0-262e17f7-acfad2f2-15f7c6ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:38.328378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:38.328388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:38.328391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:38.328403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:38.328421Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:38.328444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:38.328642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:38.328656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:38.328683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:38.329288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1937 partition: 0 MaxSeqNo: 42 sessionId: src_id|ff5a52a0-262e17f7-acfad2f2-15f7c6ef_0
2025-09-30T14:55:38.329763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|630af8ce-e0d0a7a9-e444d6e1-e97281eb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ff5a52a0-262e17f7-acfad2f2-15f7c6ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:38.332830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff5a52a0-262e17f7-acfad2f2-15f7c6ef_0] Write session: try to update token
2025-09-30T14:55:38.332851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff5a52a0-262e17f7-acfad2f2-15f7c6ef_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:38.341295Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:38.341321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:38.341332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896040317107648:4635]
2025-09-30T14:55:38.341380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:38.341627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:38.341795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:38.341993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:38.342158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:38.342384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:38.342434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:38.343235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:38.353059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1937 sessionId: src_id|ff5a52a0-262e17f7-acfad2f2-15f7c6ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:38.356001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:38.356349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:38.356383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:38.356420Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:38.356429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:38.356431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:38.356441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:38.356450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896040317107648:4635]
2025-09-30T14:55:38.356455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896040317107648:4635]
2025-09-30T14:55:38.356459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896040317107648:4635]
2025-09-30T14:55:38.356497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:38.356510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:38.356518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.356521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:38.356525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:38.356529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:38.356651Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:38.383561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896040406877352:6314]
2025-09-30T14:55:38.383886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1936, pipe: [1:7555896040406877352:6314]
2025-09-30T14:55:38.474642Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:38.475377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:38.475409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896040406877352:6314], now have 1 active actors on pipe
2025-09-30T14:55:38.475542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:38.475648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:38.475658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:38.475737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1937 reason: error at write: Disconnected sessionId: src_id|ff5a52a0-262e17f7-acfad2f2-15f7c6ef_0
2025-09-30T14:55:38.475882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1937 sessionId: src_id|ff5a52a0-262e17f7-acfad2f2-15f7c6ef_0 is DEAD
2025-09-30T14:55:38.476014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff5a52a0-262e17f7-acfad2f2-15f7c6ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:38.476025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff5a52a0-262e17f7-acfad2f2-15f7c6ef_0] Write session will restart in 0.007428s
2025-09-30T14:55:38.476057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff5a52a0-262e17f7-acfad2f2-15f7c6ef_0] Write session: Do CDS request
2025-09-30T14:55:38.476063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff5a52a0-262e17f7-acfad2f2-15f7c6ef_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:38.476059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:38.476103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896040406877352:6314]
2025-09-30T14:55:38.484818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff5a52a0-262e17f7-acfad2f2-15f7c6ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:38.484966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:38.484987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1938
2025-09-30T14:55:38.485136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1938 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:38.485171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1938 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:38.485182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1938 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:38.485186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:38.486082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1938 sessionId:  describe result for acl check
2025-09-30T14:55:38.486134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:38.486142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:38.486144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:38.486151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896040406877378:6016] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:38.486724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896040406877378:6016] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:38.490016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896040406877378:6016] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:38.493885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896040406877378:6016] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:38.493904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896040406877378:6016] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:38.493908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896040406877378:6016] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:38.493916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1938 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:38.498285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:38.501458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:38.501671Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:38.501683Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:38.501706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:38.501767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:38.501807Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896040317107928:4628]
2025-09-30T14:55:38.502512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:38.503549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:38.503626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:38.504199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:38.504282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:38.504289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:38.504290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:38.504291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:38.504293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:38.504294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:38.504296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:38.504296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:38.504298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:38.504299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:38.504300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.504302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:38.504303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:38.504304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:38.504305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:38.504312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:38.504322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:38.504327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:38.504332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:38.504336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:38.504340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:38.504345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:38.504349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:38.504353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:38.504358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:38.504363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.504367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:38.504372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:38.504376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:38.504381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:38.504390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:38.504400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:38.504406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:38.504413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:38.504418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:38.504423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:38.504428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:38.504433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:38.504439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:38.504444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:38.504449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:38.504455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:38.504461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:38.504467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:38.504479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:38.504485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:38.504490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:38.504501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:38.504506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:38.504519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:38.504525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.504531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.504541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:38.504546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:38.504558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:38.504568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:38.504573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:38.504585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:38.504590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:38.504600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:38.504661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:38.510362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:38.511634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:38.511655Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:38.511658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:38.511662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:38.511668Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1937 [2:7555896040317107928:4628]
2025-09-30T14:55:38.511684Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:38.511699Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:38.511703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:38.511705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:38.511707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:38.511724Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:38.511731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:38.511744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:38.511805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.511813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:38.511815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:38.511818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:38.511821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:38.511886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:38.511894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.511908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:38.511926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:38.511945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:38.511969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896040406877354:2454], now have 1 active actors on pipe
2025-09-30T14:55:38.511978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896040406877539:6016], now have 1 active actors on pipe
2025-09-30T14:55:38.511984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896040317107923:4628]
2025-09-30T14:55:38.511987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896040317107923:4628]
2025-09-30T14:55:38.511989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896040317107923:4628]
2025-09-30T14:55:38.512001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:38.512016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:38.512019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:38.512028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:38.512030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:38.512035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:38.512038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:38.512061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1937
2025-09-30T14:55:38.512076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896040317107923:4628]
2025-09-30T14:55:38.512114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1937
2025-09-30T14:55:38.512085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:38.512099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:38.512238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:38.512254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:38.512279Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97ac9368-416946d3-169016e-66da0165_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:38.512305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:38.512309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:38.512312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:38.512323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:38.512335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:38.512351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:38.512553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:38.512566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:38.512590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:38.512690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1938 partition: 0 MaxSeqNo: 42 sessionId: src_id|97ac9368-416946d3-169016e-66da0165_0
2025-09-30T14:55:38.513088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff5a52a0-262e17f7-acfad2f2-15f7c6ef_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|97ac9368-416946d3-169016e-66da0165_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:38.516313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97ac9368-416946d3-169016e-66da0165_0] Write session: try to update token
2025-09-30T14:55:38.516338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97ac9368-416946d3-169016e-66da0165_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:38.527872Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:38.527895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:38.527898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:38.527899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:38.527908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896040317107923:4628]
2025-09-30T14:55:38.527913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896040317107923:4628]
2025-09-30T14:55:38.527916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896040317107923:4628]
2025-09-30T14:55:38.527956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:38.527962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.527965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:38.528003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:38.528017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:38.528021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:38.528098Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:38.540930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1938 sessionId: src_id|97ac9368-416946d3-169016e-66da0165_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:38.543615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:38.576117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896040406877658:6314]
2025-09-30T14:55:38.576788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1937, pipe: [1:7555896040406877658:6314]
2025-09-30T14:55:38.650940Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:38.651701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:38.651722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:38.651742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896040406877658:6314], now have 1 active actors on pipe
2025-09-30T14:55:38.652016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896040406877658:6314]
2025-09-30T14:55:38.652025Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:38.652041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:38.652056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:38.652059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:38.652135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1938 reason: error at write: Disconnected sessionId: src_id|97ac9368-416946d3-169016e-66da0165_0
2025-09-30T14:55:38.652312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1938 sessionId: src_id|97ac9368-416946d3-169016e-66da0165_0 is DEAD
2025-09-30T14:55:38.655452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97ac9368-416946d3-169016e-66da0165_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:38.655463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97ac9368-416946d3-169016e-66da0165_0] Write session will restart in 0.007428s
2025-09-30T14:55:38.655498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97ac9368-416946d3-169016e-66da0165_0] Write session: Do CDS request
2025-09-30T14:55:38.655507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97ac9368-416946d3-169016e-66da0165_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:38.663834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97ac9368-416946d3-169016e-66da0165_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:38.663927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:38.663958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1939
2025-09-30T14:55:38.664061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1939 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:38.664103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1939 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:38.664110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1939 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:38.664113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:38.664605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1939 sessionId:  describe result for acl check
2025-09-30T14:55:38.664643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:38.664651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:38.664653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:38.664659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896040406877723:6001] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:38.665167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896040406877723:6001] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:38.667733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896040406877723:6001] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:38.670832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896040406877723:6001] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:38.670849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896040406877723:6001] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:38.670853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896040406877723:6001] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:38.670861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1939 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:38.674894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:38.677996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:38.678256Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:38.678268Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:38.678280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:38.678336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:38.678378Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896040317108249:4609]
2025-09-30T14:55:38.679045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:38.679428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:38.679490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:38.679838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:38.679903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:38.679909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:38.679910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:38.679912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:38.679913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:38.679914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:38.679915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:38.679917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:38.679918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:38.679919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:38.679920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.679921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:38.679923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:38.679924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:38.679925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:38.679931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:38.679943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:38.679947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:38.679952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:38.679956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:38.679961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:38.679965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:38.679969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:38.679973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:38.679978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:38.679982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.679986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:38.679990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:38.679994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:38.679999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:38.680006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:38.680016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:38.680023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:38.680035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:38.680042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:38.680048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:38.680057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:38.680063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:38.680071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:38.680077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:38.680082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:38.680087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:38.680097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:38.680103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:38.680112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:38.680117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:38.680122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:38.680127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:38.680132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:38.680138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:38.680142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.680153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.680157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:38.680167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:38.680172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:38.680182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:38.680187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:38.680197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:38.680201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:38.680207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:38.680247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:38.686302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:38.687754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:38.687774Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:38.687777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:38.687781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:38.687788Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1938 [2:7555896040317108249:4609]
2025-09-30T14:55:38.687806Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:38.687824Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:38.687827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:38.687831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:38.687833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:38.687850Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:38.687858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:38.687866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:38.687939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.687949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:38.687951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:38.687955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:38.687958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:38.688033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:38.688041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.688055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:38.688069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:38.688092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:38.688114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896040317108244:4609]
2025-09-30T14:55:38.688121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896040317108244:4609]
2025-09-30T14:55:38.688123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896040317108244:4609]
2025-09-30T14:55:38.688140Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:38.688160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:38.688180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:38.688188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:38.688200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:38.688204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:38.688206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:38.688227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896040317108244:4609]
2025-09-30T14:55:38.688231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:38.688294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:38.688360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896040406877884:6001], now have 1 active actors on pipe
2025-09-30T14:55:38.688377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896040406877661:2454], now have 1 active actors on pipe
2025-09-30T14:55:38.688750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1938
2025-09-30T14:55:38.688792Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1938
2025-09-30T14:55:38.688825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:38.688841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:38.688886Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82e6302a-7d3b932d-753631f7-82c9f0be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:38.688901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:38.688910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:38.688913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:38.688925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:38.688941Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:38.688980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:38.689205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:38.689215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:38.689239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:38.689322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1939 partition: 0 MaxSeqNo: 42 sessionId: src_id|82e6302a-7d3b932d-753631f7-82c9f0be_0
2025-09-30T14:55:38.689757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97ac9368-416946d3-169016e-66da0165_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|82e6302a-7d3b932d-753631f7-82c9f0be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:38.692658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82e6302a-7d3b932d-753631f7-82c9f0be_0] Write session: try to update token
2025-09-30T14:55:38.692679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82e6302a-7d3b932d-753631f7-82c9f0be_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:38.702206Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:38.702232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:38.702242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896040317108244:4609]
2025-09-30T14:55:38.702289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:38.702293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:38.702476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:38.702631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:38.702780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:38.702929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:38.703136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:38.703182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:38.709120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1939 sessionId: src_id|82e6302a-7d3b932d-753631f7-82c9f0be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:38.712217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:38.712574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:38.712605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:38.712643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:38.712727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:38.713900Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:38.713921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:38.713923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:38.713925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:38.713935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896040317108244:4609]
2025-09-30T14:55:38.713939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896040317108244:4609]
2025-09-30T14:55:38.713943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896040317108244:4609]
2025-09-30T14:55:38.713980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:38.713993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.713996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:38.714007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:38.714024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:38.714028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:38.714140Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:38.752181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896040406877945:6314]
2025-09-30T14:55:38.752548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1938, pipe: [1:7555896040406877945:6314]
2025-09-30T14:55:38.830768Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:38.839591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:38.839625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:38.839817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:38.839899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:38.839973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:38.840052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:38.840103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:38.840113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:38.840194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:38.840265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:38.840342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:38.840461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:38.840512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:38.840525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:38.840600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:38.840673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:38.840778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:38.840850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:38.840903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:38.840912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:38.840996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:38.841074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:38.841148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:38.841219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:38.841283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:38.841297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:38.841376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:38.841446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:38.841515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:38.841596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:38.841644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:38.841653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:38.841725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:38.841789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:38.841895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:38.842006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:38.842057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:38.842066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:38.842140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:38.842214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:38.842293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:38.842375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:38.842428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:38.842440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:38.842517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:38.842572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:38.842632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:38.842694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:38.842736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:38.842739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:38.842816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:38.842876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:38.842934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:38.842993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:38.843037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:38.843040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:38.843107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:38.843166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:38.843231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:38.843405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:38.843455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:38.843466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:38.843535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896040406877945:6314], now have 1 active actors on pipe
2025-09-30T14:55:38.843999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:38.844008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896040406877945:6314]
2025-09-30T14:55:38.844021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:38.844037Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:38.844051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1939 reason: error at write: Disconnected sessionId: src_id|82e6302a-7d3b932d-753631f7-82c9f0be_0
2025-09-30T14:55:38.844259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1939 sessionId: src_id|82e6302a-7d3b932d-753631f7-82c9f0be_0 is DEAD
2025-09-30T14:55:38.844444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e6302a-7d3b932d-753631f7-82c9f0be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:38.844457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e6302a-7d3b932d-753631f7-82c9f0be_0] Write session will restart in 0.007012s
2025-09-30T14:55:38.844484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e6302a-7d3b932d-753631f7-82c9f0be_0] Write session: Do CDS request
2025-09-30T14:55:38.844490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e6302a-7d3b932d-753631f7-82c9f0be_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:38.844882Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:38.852830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82e6302a-7d3b932d-753631f7-82c9f0be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:38.852904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:38.852924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1940
2025-09-30T14:55:38.853062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1940 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:38.853096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1940 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:38.853101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1940 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:38.853105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:38.853618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1940 sessionId:  describe result for acl check
2025-09-30T14:55:38.853659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:38.853667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:38.853671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:38.853677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896040406877982:5995] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:38.854300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896040406877982:5995] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:38.857413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896040406877982:5995] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:38.863404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896040406877982:5995] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:38.863439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896040406877982:5995] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:38.863443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896040406877982:5995] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:38.863453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1940 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:38.867960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:38.871914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:38.872187Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:38.872202Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:38.872215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:38.872281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:38.872335Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896040317108526:4607]
2025-09-30T14:55:38.873035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:38.874633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:38.874698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:38.875145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:38.875239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:38.875263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:38.875265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:38.875266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:38.875267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:38.875269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:38.875270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:38.875271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:38.875272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:38.875274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:38.875275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.875276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:38.875277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:38.875278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:38.875279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:38.875287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:38.875299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:38.875303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:38.875308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:38.875313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:38.875316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:38.875321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:38.875325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:38.875329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:38.875334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:38.875339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.875344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:38.875348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:38.875352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:38.875357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:38.875367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:38.875376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:38.875384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:38.875390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:38.875396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:38.875402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:38.875407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:38.875413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:38.875419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:38.875424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:38.875428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:38.875434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:38.875439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:38.875445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:38.875450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:38.875456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:38.875461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:38.875467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:38.875472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:38.875478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:38.875484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.875490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.875495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:38.875500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:38.875506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:38.875513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:38.875518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:38.875524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:38.875530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:38.875536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:38.875581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:38.882270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:38.883498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:38.883513Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:38.883516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:38.883520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:38.883527Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1939 [2:7555896040317108526:4607]
2025-09-30T14:55:38.883544Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:38.883559Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:38.883563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:38.883566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:38.883569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:38.883586Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:38.883599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:38.883609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:38.883675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.883686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:38.883688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:38.883692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:38.883695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:38.883762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:38.883770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.883945Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1939
2025-09-30T14:55:38.883784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:38.883998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1939
2025-09-30T14:55:38.883806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:38.883827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:38.883847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896040406877960:2454], now have 1 active actors on pipe
2025-09-30T14:55:38.883851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896040406878175:5995], now have 1 active actors on pipe
2025-09-30T14:55:38.883857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896040317108520:4607]
2025-09-30T14:55:38.883860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896040317108520:4607]
2025-09-30T14:55:38.883862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896040317108520:4607]
2025-09-30T14:55:38.883877Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:38.883890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:38.883894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:38.883897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:38.883900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:38.883906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:38.883909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:38.883943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896040317108520:4607]
2025-09-30T14:55:38.883951Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:38.883977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:38.884176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:38.884201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:38.884234Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99c5c578-2de072f9-9a4b33ab-571702e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:38.884248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:38.884256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:38.884260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:38.884273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:38.884291Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:38.884311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:38.884741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:38.884751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:38.884767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:38.884950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1940 partition: 0 MaxSeqNo: 42 sessionId: src_id|99c5c578-2de072f9-9a4b33ab-571702e6_0
2025-09-30T14:55:38.891391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e6302a-7d3b932d-753631f7-82c9f0be_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|99c5c578-2de072f9-9a4b33ab-571702e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:38.894536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99c5c578-2de072f9-9a4b33ab-571702e6_0] Write session: try to update token
2025-09-30T14:55:38.894561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99c5c578-2de072f9-9a4b33ab-571702e6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:38.896576Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:38.896599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:38.896601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:38.896603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:38.896614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896040317108520:4607]
2025-09-30T14:55:38.896618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896040317108520:4607]
2025-09-30T14:55:38.896623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896040317108520:4607]
2025-09-30T14:55:38.896662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:38.896669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:38.896672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:38.896680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:38.896686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:38.896690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:38.896821Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:38.911139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1940 sessionId: src_id|99c5c578-2de072f9-9a4b33ab-571702e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:38.913973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:38.944187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896040406878243:6314]
2025-09-30T14:55:38.944481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1939, pipe: [1:7555896040406878243:6314]
2025-09-30T14:55:39.017998Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:39.018566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:39.018581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:39.018601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896040406878243:6314], now have 1 active actors on pipe
2025-09-30T14:55:39.018824Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:39.019305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c5c578-2de072f9-9a4b33ab-571702e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:39.019316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c5c578-2de072f9-9a4b33ab-571702e6_0] Write session will restart in 0.005617s
2025-09-30T14:55:39.019341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c5c578-2de072f9-9a4b33ab-571702e6_0] Write session: Do CDS request
2025-09-30T14:55:39.019347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c5c578-2de072f9-9a4b33ab-571702e6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:39.018841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896040406878243:6314]
2025-09-30T14:55:39.018874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:39.018882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:39.018885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:39.018949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1940 reason: error at write: Disconnected sessionId: src_id|99c5c578-2de072f9-9a4b33ab-571702e6_0
2025-09-30T14:55:39.019120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1940 sessionId: src_id|99c5c578-2de072f9-9a4b33ab-571702e6_0 is DEAD
2025-09-30T14:55:39.025830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99c5c578-2de072f9-9a4b33ab-571702e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:39.027317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:39.027338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1941
2025-09-30T14:55:39.027504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1941 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:39.027543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1941 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:39.027548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1941 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:39.027552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:39.028036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1941 sessionId:  describe result for acl check
2025-09-30T14:55:39.028073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:39.028074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:39.028076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:39.028081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896044701845557:5988] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:39.028603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896044701845557:5988] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:39.035271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896044701845557:5988] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:39.039476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896044701845557:5988] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:39.039498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896044701845557:5988] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:39.039502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896044701845557:5988] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:39.039511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1941 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:39.048176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:39.051126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:39.051398Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:39.051411Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:39.051423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:39.051487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:39.051545Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896044612076097:4604]
2025-09-30T14:55:39.052265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:39.052584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:39.052647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:39.053020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:39.053091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:39.053103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:39.053104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:39.053106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:39.053107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:39.053109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:39.053110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:39.053112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:39.053113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:39.053114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:39.053116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.053117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.053119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.053120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:39.053121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:39.053127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:39.053140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:39.053145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:39.053150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:39.053155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:39.053160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:39.053164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:39.053169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:39.053173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:39.053178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:39.053182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.053187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.053191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.053196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:39.053200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:39.053208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:39.053217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:39.053224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:39.053230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:39.053239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:39.053246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:39.053251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:39.053258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:39.053263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:39.053270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:39.053275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:39.053281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:39.053292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:39.053299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:39.053308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:39.053314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:39.053325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:39.053330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:39.053340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:39.053346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:39.053356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.053361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.053369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.053375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.053385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.053391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.053400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:39.053405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:39.053410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:39.053420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:39.053466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:39.059687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:39.061166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:39.061185Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:39.061188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:39.061192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:39.061199Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1940 [2:7555896044612076097:4604]
2025-09-30T14:55:39.061215Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:39.061238Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:39.061241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:39.061244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:39.061246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:39.061261Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:39.061267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:39.061275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:39.061339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.061341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.061344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.061347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:39.061349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:39.061845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1940
2025-09-30T14:55:39.061887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1940
2025-09-30T14:55:39.061423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:39.061432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.061447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.061459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.061476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:39.061492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896044612076092:4604]
2025-09-30T14:55:39.061494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896044612076092:4604]
2025-09-30T14:55:39.061496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896044612076092:4604]
2025-09-30T14:55:39.061513Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:39.061527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:39.061555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:39.061558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:39.061574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:39.061577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:39.061580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:39.061596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896044612076092:4604]
2025-09-30T14:55:39.061599Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:39.061669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:39.061937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896044701845769:5988], now have 1 active actors on pipe
2025-09-30T14:55:39.061941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896044701845541:2454], now have 1 active actors on pipe
2025-09-30T14:55:39.061956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:39.061962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:39.061997Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87188ef7-4f224975-11b4bded-d755f35e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:39.062006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:39.062010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:39.062013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:39.062024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:39.062036Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:39.062051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:39.062275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:39.062281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:39.062301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:39.062519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1941 partition: 0 MaxSeqNo: 42 sessionId: src_id|87188ef7-4f224975-11b4bded-d755f35e_0
2025-09-30T14:55:39.062889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c5c578-2de072f9-9a4b33ab-571702e6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|87188ef7-4f224975-11b4bded-d755f35e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:39.065763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87188ef7-4f224975-11b4bded-d755f35e_0] Write session: try to update token
2025-09-30T14:55:39.065781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87188ef7-4f224975-11b4bded-d755f35e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:39.077523Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:39.077557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:39.077559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:39.077561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:39.077573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896044612076092:4604]
2025-09-30T14:55:39.077577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896044612076092:4604]
2025-09-30T14:55:39.077581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896044612076092:4604]
2025-09-30T14:55:39.077621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:39.077629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.077632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:39.077716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:39.077726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:39.077732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:39.077815Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:39.089004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1941 sessionId: src_id|87188ef7-4f224975-11b4bded-d755f35e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:39.092000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:39.118798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896044701845826:6314]
2025-09-30T14:55:39.119321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1940, pipe: [1:7555896044701845826:6314]
2025-09-30T14:55:39.195553Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:39.196399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:39.196412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:39.196432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896044701845826:6314], now have 1 active actors on pipe
2025-09-30T14:55:39.196791Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:39.196800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:39.196816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896044701845826:6314]
2025-09-30T14:55:39.196820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:39.196833Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:39.196899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1941 reason: error at write: Disconnected sessionId: src_id|87188ef7-4f224975-11b4bded-d755f35e_0
2025-09-30T14:55:39.197075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1941 sessionId: src_id|87188ef7-4f224975-11b4bded-d755f35e_0 is DEAD
2025-09-30T14:55:39.197646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87188ef7-4f224975-11b4bded-d755f35e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:39.197658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87188ef7-4f224975-11b4bded-d755f35e_0] Write session will restart in 0.007816s
2025-09-30T14:55:39.197682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87188ef7-4f224975-11b4bded-d755f35e_0] Write session: Do CDS request
2025-09-30T14:55:39.197691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87188ef7-4f224975-11b4bded-d755f35e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:39.206896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87188ef7-4f224975-11b4bded-d755f35e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:39.207092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:39.207118Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1942
2025-09-30T14:55:39.207273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1942 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:39.207312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1942 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:39.207318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1942 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:39.207321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:39.207757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1942 sessionId:  describe result for acl check
2025-09-30T14:55:39.207798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:39.207805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:39.207806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:39.207812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896044701845851:5984] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:39.208439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896044701845851:5984] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:39.210886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896044701845851:5984] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:39.214441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896044701845851:5984] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:39.214467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896044701845851:5984] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:39.214471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896044701845851:5984] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:39.214480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1942 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:39.237664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:39.240539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:39.240787Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:39.240805Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:39.240817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:39.240879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:39.240923Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896044612076373:4597]
2025-09-30T14:55:39.241570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:39.241906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:39.241963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:39.242323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:39.242408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:39.242415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:39.242416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:39.242417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:39.242418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:39.242419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:39.242421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:39.242422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:39.242424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:39.242425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:39.242426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.242427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.242428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.242430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:39.242431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:39.242437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:39.242448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:39.242452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:39.242457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:39.242461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:39.242465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:39.242468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:39.242472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:39.242476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:39.242481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:39.242485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.242488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.242492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.242496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:39.242500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:39.242509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:39.242519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:39.242525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:39.242531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:39.242536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:39.242541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:39.242546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:39.242551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:39.242556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:39.242561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:39.242566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:39.242571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:39.242576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:39.242581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:39.242587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:39.242593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:39.242598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:39.242602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:39.242607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:39.242613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:39.242617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.242623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.242627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.242632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.242644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.242650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.242659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:39.242664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:39.242669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:39.242679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:39.242726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:39.248698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:39.249869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:39.249887Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:39.249890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:39.249895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:39.249902Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1941 [2:7555896044612076373:4597]
2025-09-30T14:55:39.249920Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:39.249936Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:39.249944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:39.249947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:39.249950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:39.249966Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:39.249974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:39.249982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:39.250050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.250059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.250061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.250066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:39.250068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:39.250141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:39.250149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.250163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.250175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.250190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:39.250214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896044701845887:5984], now have 1 active actors on pipe
2025-09-30T14:55:39.250221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896044612076368:4597]
2025-09-30T14:55:39.250224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896044612076368:4597]
2025-09-30T14:55:39.250226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896044612076368:4597]
2025-09-30T14:55:39.250238Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:39.250248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896044701845837:2454], now have 1 active actors on pipe
2025-09-30T14:55:39.250253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:39.250257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:39.250259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:39.250261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:39.250274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:39.250278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:39.250312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896044612076368:4597]
2025-09-30T14:55:39.250319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:39.250304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1941
2025-09-30T14:55:39.250329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:39.250325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1941
2025-09-30T14:55:39.250357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:39.250367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:39.250399Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c114f84-761e385f-1ecf8886-ca25dc6d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:39.250410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:39.250414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:39.250416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:39.250426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:39.250440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:39.250460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:39.250620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:39.250628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:39.250641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:39.250765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1942 partition: 0 MaxSeqNo: 42 sessionId: src_id|1c114f84-761e385f-1ecf8886-ca25dc6d_0
2025-09-30T14:55:39.251259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87188ef7-4f224975-11b4bded-d755f35e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1c114f84-761e385f-1ecf8886-ca25dc6d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:39.254194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c114f84-761e385f-1ecf8886-ca25dc6d_0] Write session: try to update token
2025-09-30T14:55:39.254215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c114f84-761e385f-1ecf8886-ca25dc6d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:39.263521Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:39.263546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:39.263550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:39.263552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:39.263564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896044612076368:4597]
2025-09-30T14:55:39.263569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896044612076368:4597]
2025-09-30T14:55:39.263573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896044612076368:4597]
2025-09-30T14:55:39.263620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:39.263623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:39.263627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.263631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:39.263643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:39.263648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:39.263779Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:39.280635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1942 sessionId: src_id|1c114f84-761e385f-1ecf8886-ca25dc6d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:39.283495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:39.296955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896044701846126:6314]
2025-09-30T14:55:39.297250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1941, pipe: [1:7555896044701846126:6314]
2025-09-30T14:55:39.380444Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:39.381948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c114f84-761e385f-1ecf8886-ca25dc6d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:39.381962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c114f84-761e385f-1ecf8886-ca25dc6d_0] Write session will restart in 0.006025s
2025-09-30T14:55:39.381989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c114f84-761e385f-1ecf8886-ca25dc6d_0] Write session: Do CDS request
2025-09-30T14:55:39.381995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c114f84-761e385f-1ecf8886-ca25dc6d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:39.381444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896044701846126:6314]
2025-09-30T14:55:39.381498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:39.381501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:39.381585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1942 reason: error at write: Disconnected sessionId: src_id|1c114f84-761e385f-1ecf8886-ca25dc6d_0
2025-09-30T14:55:39.381698Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:39.381779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1942 sessionId: src_id|1c114f84-761e385f-1ecf8886-ca25dc6d_0 is DEAD
2025-09-30T14:55:39.380823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:39.380840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:39.380861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896044701846126:6314], now have 1 active actors on pipe
2025-09-30T14:55:39.381154Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:39.388859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c114f84-761e385f-1ecf8886-ca25dc6d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:39.390025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:39.390047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1943
2025-09-30T14:55:39.390239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1943 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:39.390283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1943 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:39.390294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1943 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:39.390299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:39.390728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1943 sessionId:  describe result for acl check
2025-09-30T14:55:39.390761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:39.390768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:39.390771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:39.390777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896044701846144:5977] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:39.391336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896044701846144:5977] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:39.399343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896044701846144:5977] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:39.403212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896044701846144:5977] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:39.403235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896044701846144:5977] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:39.403239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896044701846144:5977] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:39.403262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1943 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:39.412544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:39.416124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:39.416367Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:39.416380Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:39.416391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:39.416449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:39.416502Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896044612076652:4595]
2025-09-30T14:55:39.417196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:39.417592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:39.417640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:39.418027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:39.418101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:39.418110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:39.418112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:39.418114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:39.418115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:39.418116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:39.418118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:39.418119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:39.418121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:39.418122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:39.418124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.418125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.418127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.418128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:39.418130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:39.418137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:39.418148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:39.418152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:39.418157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:39.418162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:39.418167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:39.418171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:39.418176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:39.418180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:39.418184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:39.418189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.418194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.418199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.418204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:39.418208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:39.418218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:39.418227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:39.418234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:39.418241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:39.418246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:39.418253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:39.418258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:39.418264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:39.418271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:39.418277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:39.418282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:39.418289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:39.418298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:39.418304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:39.418310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:39.418316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:39.418322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:39.418329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:39.418335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:39.418341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:39.418348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.418356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.418361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.418367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.418372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.418378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.418383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:39.418389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:39.418398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:39.418404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:39.418467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:39.424734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:39.425709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:39.425732Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:39.425735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:39.425740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:39.425749Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1942 [2:7555896044612076652:4595]
2025-09-30T14:55:39.425769Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:39.425786Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:39.425789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:39.425793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:39.425796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:39.425814Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:39.425828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:39.425839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:39.425916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.425926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.425929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.425934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:39.425937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:39.426033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:39.426043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.426059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.426079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.426099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:39.426132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896044701846129:2454], now have 1 active actors on pipe
2025-09-30T14:55:39.426141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896044701846268:5977], now have 1 active actors on pipe
2025-09-30T14:55:39.426149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896044612076647:4595]
2025-09-30T14:55:39.426157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896044612076647:4595]
2025-09-30T14:55:39.426160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896044612076647:4595]
2025-09-30T14:55:39.426176Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:39.426191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:39.426197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:39.426202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:39.426204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:39.426213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:39.426222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:39.426261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896044612076647:4595]
2025-09-30T14:55:39.426273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:39.426281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:39.426610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:39.426626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:39.426431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1942
2025-09-30T14:55:39.426484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1942
2025-09-30T14:55:39.426656Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70dd9fc3-be0da2c0-35a4b95e-83b8f4a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:39.426674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:39.426678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:39.426680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:39.426701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:39.426714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:39.426734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:39.427045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:39.427059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:39.427083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:39.427259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1943 partition: 0 MaxSeqNo: 42 sessionId: src_id|70dd9fc3-be0da2c0-35a4b95e-83b8f4a8_0
2025-09-30T14:55:39.427638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c114f84-761e385f-1ecf8886-ca25dc6d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|70dd9fc3-be0da2c0-35a4b95e-83b8f4a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:39.430665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70dd9fc3-be0da2c0-35a4b95e-83b8f4a8_0] Write session: try to update token
2025-09-30T14:55:39.430686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70dd9fc3-be0da2c0-35a4b95e-83b8f4a8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:39.440816Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:39.440843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:39.440846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:39.440849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:39.440863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896044612076647:4595]
2025-09-30T14:55:39.440868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896044612076647:4595]
2025-09-30T14:55:39.440873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896044612076647:4595]
2025-09-30T14:55:39.440918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:39.440927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.440935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:39.440945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:39.440953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:39.440961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:39.441081Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:39.447234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1943 sessionId: src_id|70dd9fc3-be0da2c0-35a4b95e-83b8f4a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:39.450338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:39.481821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896044701846415:6314]
2025-09-30T14:55:39.482154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1942, pipe: [1:7555896044701846415:6314]
2025-09-30T14:55:39.563905Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:39.564624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:39.564645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:39.564684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896044701846415:6314], now have 1 active actors on pipe
2025-09-30T14:55:39.564891Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:39.564968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:39.564987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:39.565063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1943 reason: error at write: Disconnected sessionId: src_id|70dd9fc3-be0da2c0-35a4b95e-83b8f4a8_0
2025-09-30T14:55:39.565251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1943 sessionId: src_id|70dd9fc3-be0da2c0-35a4b95e-83b8f4a8_0 is DEAD
2025-09-30T14:55:39.565436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896044701846415:6314]
2025-09-30T14:55:39.565463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:39.565687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70dd9fc3-be0da2c0-35a4b95e-83b8f4a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:39.565698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70dd9fc3-be0da2c0-35a4b95e-83b8f4a8_0] Write session will restart in 0.005278s
2025-09-30T14:55:39.565720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70dd9fc3-be0da2c0-35a4b95e-83b8f4a8_0] Write session: Do CDS request
2025-09-30T14:55:39.565729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70dd9fc3-be0da2c0-35a4b95e-83b8f4a8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:39.571841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70dd9fc3-be0da2c0-35a4b95e-83b8f4a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:39.571901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:39.571924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1944
2025-09-30T14:55:39.572079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1944 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:39.572125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1944 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:39.572137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1944 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:39.572141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:39.572544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1944 sessionId:  describe result for acl check
2025-09-30T14:55:39.572581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:39.572589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:39.572591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:39.572598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896044701846446:5961] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:39.573166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896044701846446:5961] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:39.575867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896044701846446:5961] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:39.580002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896044701846446:5961] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:39.580040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896044701846446:5961] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:39.580044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896044701846446:5961] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:39.580052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1944 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:39.588713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:39.591616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:39.591947Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:39.591962Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:39.591975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:39.592043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:39.592080Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896044612076943:4578]
2025-09-30T14:55:39.592704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:39.593007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:39.593056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:39.593402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:39.593475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:39.593481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:39.593483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:39.593484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:39.593485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:39.593486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:39.593487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:39.593488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:39.593489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:39.593490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:39.593491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.593492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.593493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.593493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:39.593494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:39.593499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:39.593508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:39.593511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:39.593514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:39.593519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:39.593522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:39.593525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:39.593541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:39.593544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:39.593548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:39.593552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.593555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.593559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.593562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:39.593566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:39.593573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:39.593580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:39.593586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:39.593593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:39.593598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:39.593604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:39.593615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:39.593622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:39.593627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:39.593632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:39.593641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:39.593646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:39.593650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:39.593654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:39.593659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:39.593663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:39.593668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:39.593673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:39.593677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:39.593682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:39.593687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.593692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.593696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.593701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.593705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.593710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.593719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:39.593724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:39.593728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:39.593733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:39.593776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:39.599531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:39.600618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:39.600638Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:39.600640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:39.600645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:39.600651Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1943 [2:7555896044612076943:4578]
2025-09-30T14:55:39.600668Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:39.600684Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:39.600687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:39.600690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:39.600693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:39.600708Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:39.600721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:39.600727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:39.600798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.600806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.600808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.600811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:39.600813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:39.600884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:39.600892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.600905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.600916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.600936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:39.600960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896044701846560:5961], now have 1 active actors on pipe
2025-09-30T14:55:39.600969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896044701846422:2454], now have 1 active actors on pipe
2025-09-30T14:55:39.600975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896044612076938:4578]
2025-09-30T14:55:39.600977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896044612076938:4578]
2025-09-30T14:55:39.600979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896044612076938:4578]
2025-09-30T14:55:39.600994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:39.601007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:39.601012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:39.601016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:39.601017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:39.601026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:39.601029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:39.601064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896044612076938:4578]
2025-09-30T14:55:39.601078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:39.601083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:39.601180Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1943
2025-09-30T14:55:39.601267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:39.601274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:39.601246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1943
2025-09-30T14:55:39.601297Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba803f64-cb22b8c8-e271f2a9-acce512b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:39.601309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:39.601314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:39.601322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:39.601331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:39.601345Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:39.601363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:39.601557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:39.601566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:39.601584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:39.601695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1944 partition: 0 MaxSeqNo: 42 sessionId: src_id|ba803f64-cb22b8c8-e271f2a9-acce512b_0
2025-09-30T14:55:39.602094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70dd9fc3-be0da2c0-35a4b95e-83b8f4a8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ba803f64-cb22b8c8-e271f2a9-acce512b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:39.604990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba803f64-cb22b8c8-e271f2a9-acce512b_0] Write session: try to update token
2025-09-30T14:55:39.605010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba803f64-cb22b8c8-e271f2a9-acce512b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:39.620311Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:39.620339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:39.620350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896044612076938:4578]
2025-09-30T14:55:39.620401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:39.620599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:39.620757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:39.620918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:39.621067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:39.621445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:39.621488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:39.621771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1944 sessionId: src_id|ba803f64-cb22b8c8-e271f2a9-acce512b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:39.621785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:39.624606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:39.625765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:39.625795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:39.625815Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:39.625819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:39.625822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:39.625823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:39.625832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896044612076938:4578]
2025-09-30T14:55:39.625835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896044612076938:4578]
2025-09-30T14:55:39.625839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896044612076938:4578]
2025-09-30T14:55:39.625875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:39.625887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:39.625888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:39.625892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:39.625894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.625897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:39.626062Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:39.665606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896044701846730:6314]
2025-09-30T14:55:39.665872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1943, pipe: [1:7555896044701846730:6314]
2025-09-30T14:55:39.741487Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:39.742546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:39.742587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896044701846730:6314], now have 1 active actors on pipe
2025-09-30T14:55:39.742699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:39.742729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:39.742774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896044701846730:6314]
2025-09-30T14:55:39.742801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:39.742809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:39.742889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1944 reason: error at write: Disconnected sessionId: src_id|ba803f64-cb22b8c8-e271f2a9-acce512b_0
2025-09-30T14:55:39.743058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1944 sessionId: src_id|ba803f64-cb22b8c8-e271f2a9-acce512b_0 is DEAD
2025-09-30T14:55:39.743263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba803f64-cb22b8c8-e271f2a9-acce512b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:39.743275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba803f64-cb22b8c8-e271f2a9-acce512b_0] Write session will restart in 0.007552s
2025-09-30T14:55:39.743298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba803f64-cb22b8c8-e271f2a9-acce512b_0] Write session: Do CDS request
2025-09-30T14:55:39.743304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba803f64-cb22b8c8-e271f2a9-acce512b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:39.751776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba803f64-cb22b8c8-e271f2a9-acce512b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:39.751894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:39.751915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1945
2025-09-30T14:55:39.752067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1945 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:39.752115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1945 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:39.752139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1945 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:39.752148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:39.752629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1945 sessionId:  describe result for acl check
2025-09-30T14:55:39.752671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:39.752673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:39.752675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:39.752682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896044701846740:5954] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:39.753249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896044701846740:5954] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:39.755915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896044701846740:5954] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:39.759287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896044701846740:5954] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:39.759305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896044701846740:5954] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:39.759309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896044701846740:5954] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:39.759318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1945 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:39.778405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:39.781960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:39.782224Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:39.782238Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:39.782250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:39.782324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:39.782370Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896044612077259:4566]
2025-09-30T14:55:39.783101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:39.783576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:39.783633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:39.783990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:39.784058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:39.784060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:39.784061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:39.784063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:39.784064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:39.784066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:39.784067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:39.784069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:39.784070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:39.784071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:39.784073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.784074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.784076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.784077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:39.784078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:39.784084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:39.784095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:39.784100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:39.784105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:39.784110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:39.784115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:39.784119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:39.784123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:39.784128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:39.784135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:39.784139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.784143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.784148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.784152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:39.784156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:39.784165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:39.784174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:39.784181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:39.784187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:39.784193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:39.784198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:39.784204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:39.784209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:39.784214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:39.784219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:39.784223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:39.784228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:39.784236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:39.784242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:39.784247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:39.784252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:39.784259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:39.784273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:39.784279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:39.784284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:39.784291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.784297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.784301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.784307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.784312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.784317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.784322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:39.784328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:39.784332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:39.784338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:39.784385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:39.790803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:39.791859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:39.791880Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:39.791882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:39.791886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:39.791893Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1944 [2:7555896044612077259:4566]
2025-09-30T14:55:39.791909Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:39.791924Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:39.791931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:39.791944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:39.791950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:39.791967Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:39.791983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:39.791991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:39.792054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.792062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.792064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.792067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:39.792069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:39.792136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:39.792146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.792157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.792172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.792192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:39.792214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896044701846732:2454], now have 1 active actors on pipe
2025-09-30T14:55:39.792222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896044701846782:5954], now have 1 active actors on pipe
2025-09-30T14:55:39.792229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896044612077254:4566]
2025-09-30T14:55:39.792231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896044612077254:4566]
2025-09-30T14:55:39.792233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896044612077254:4566]
2025-09-30T14:55:39.792246Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:39.792267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:39.792280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:39.792283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:39.792252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1944
2025-09-30T14:55:39.792310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1944
2025-09-30T14:55:39.792306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:39.792317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896044612077254:4566]
2025-09-30T14:55:39.792319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:39.792319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:39.792322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:39.792331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:39.792527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:39.792542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:39.792569Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e34af38-5734f133-bddd6a86-1a99e8cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:39.792578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:39.792581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:39.792584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:39.792603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:39.792615Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:39.792629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:39.792944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:39.792963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:39.792987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:39.793086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1945 partition: 0 MaxSeqNo: 42 sessionId: src_id|6e34af38-5734f133-bddd6a86-1a99e8cf_0
2025-09-30T14:55:39.799368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba803f64-cb22b8c8-e271f2a9-acce512b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6e34af38-5734f133-bddd6a86-1a99e8cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:39.802382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e34af38-5734f133-bddd6a86-1a99e8cf_0] Write session: try to update token
2025-09-30T14:55:39.802409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e34af38-5734f133-bddd6a86-1a99e8cf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:39.806551Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:39.806577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:39.806580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:39.806583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:39.806593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896044612077254:4566]
2025-09-30T14:55:39.806599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896044612077254:4566]
2025-09-30T14:55:39.806603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896044612077254:4566]
2025-09-30T14:55:39.806647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:39.806654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.806657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:39.806656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:39.806662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:39.806670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:39.806805Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:39.825240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1945 sessionId: src_id|6e34af38-5734f133-bddd6a86-1a99e8cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:39.828341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:39.842749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896044701847033:6314]
2025-09-30T14:55:39.843155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1944, pipe: [1:7555896044701847033:6314]
2025-09-30T14:55:39.928875Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:39.929553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:39.929578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:39.929609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896044701847033:6314], now have 1 active actors on pipe
2025-09-30T14:55:39.929853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896044701847033:6314]
2025-09-30T14:55:39.929897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:39.929900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:39.929961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1945 reason: error at write: Disconnected sessionId: src_id|6e34af38-5734f133-bddd6a86-1a99e8cf_0
2025-09-30T14:55:39.930144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1945 sessionId: src_id|6e34af38-5734f133-bddd6a86-1a99e8cf_0 is DEAD
2025-09-30T14:55:39.930254Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:39.929858Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:39.931486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e34af38-5734f133-bddd6a86-1a99e8cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:39.931500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e34af38-5734f133-bddd6a86-1a99e8cf_0] Write session will restart in 0.005095s
2025-09-30T14:55:39.931525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e34af38-5734f133-bddd6a86-1a99e8cf_0] Write session: Do CDS request
2025-09-30T14:55:39.931535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e34af38-5734f133-bddd6a86-1a99e8cf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:39.937771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e34af38-5734f133-bddd6a86-1a99e8cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:39.937839Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:39.937867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1946
2025-09-30T14:55:39.937999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1946 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:39.938033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1946 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:39.938042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1946 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:39.938046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:39.938468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1946 sessionId:  describe result for acl check
2025-09-30T14:55:39.938501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:39.938503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:39.938505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:39.938511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896044701847050:5947] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:39.939059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896044701847050:5947] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:39.941228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896044701847050:5947] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:39.945326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896044701847050:5947] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:39.945344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896044701847050:5947] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:39.945348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896044701847050:5947] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:39.945356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1946 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:39.954992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:39.958138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:39.958628Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:39.958642Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:39.958656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:39.958723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:39.958769Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896044612077542:4561]
2025-09-30T14:55:39.959780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:39.960147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:39.960209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:39.960582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:39.960656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:39.960662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:39.960663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:39.960665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:39.960666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:39.960667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:39.960669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:39.960670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:39.960671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:39.960672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:39.960674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.960675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.960676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.960677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:39.960678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:39.960684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:39.960695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:39.960699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:39.960703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:39.960707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:39.960711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:39.960714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:39.960718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:39.960721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:39.960725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:39.960729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.960732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.960736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.960740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:39.960744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:39.960752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:39.960760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:39.960765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:39.960770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:39.960778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:39.960783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:39.960788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:39.960793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:39.960798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:39.960803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:39.960807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:39.960813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:39.960817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:39.960822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:39.960826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:39.960832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:39.960836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:39.960842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:39.960847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:39.960852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:39.960857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.960862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.960866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.960871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.960876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.960881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.960886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:39.960891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:39.960896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:39.960901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:39.960946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:39.967121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:39.968256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:39.968272Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:39.968274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:39.968278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:39.968286Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1945 [2:7555896044612077542:4561]
2025-09-30T14:55:39.968298Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:39.968312Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:39.968319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:39.968322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:39.968324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:39.968337Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:39.968342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:39.968347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:39.968394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.968400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.968402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.968404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:39.968406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:39.968461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:39.968466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.968474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:39.968481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:39.968491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:39.968503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896044612077537:4561]
2025-09-30T14:55:39.968505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896044612077537:4561]
2025-09-30T14:55:39.968506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896044612077537:4561]
2025-09-30T14:55:39.968513Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:39.968523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:39.968532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:39.968533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:39.968535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:39.968536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:39.968538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:39.968542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896044701847167:5947], now have 1 active actors on pipe
2025-09-30T14:55:39.968545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896044701847035:2454], now have 1 active actors on pipe
2025-09-30T14:55:39.968575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896044612077537:4561]
2025-09-30T14:55:39.968580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:39.968602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:39.968655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1945
2025-09-30T14:55:39.968693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1945
2025-09-30T14:55:39.968849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:39.968857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:39.968879Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bbe6e957-335141a7-56e16c33-9eb55d28_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:39.968890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:39.968897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:39.968898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:39.968907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:39.968918Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:39.968935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:39.969223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:39.969232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:39.969252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:39.969412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1946 partition: 0 MaxSeqNo: 42 sessionId: src_id|bbe6e957-335141a7-56e16c33-9eb55d28_0
2025-09-30T14:55:39.969818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e34af38-5734f133-bddd6a86-1a99e8cf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bbe6e957-335141a7-56e16c33-9eb55d28_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:39.972833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe6e957-335141a7-56e16c33-9eb55d28_0] Write session: try to update token
2025-09-30T14:55:39.972854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe6e957-335141a7-56e16c33-9eb55d28_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:39.982619Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:39.982645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:39.982648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:39.982650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:39.982660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896044612077537:4561]
2025-09-30T14:55:39.982665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896044612077537:4561]
2025-09-30T14:55:39.982670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896044612077537:4561]
2025-09-30T14:55:39.982710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:39.982718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:39.982721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:39.982725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:39.982732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:39.982737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:39.982869Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:39.988344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1946 sessionId: src_id|bbe6e957-335141a7-56e16c33-9eb55d28_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:39.991106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:40.024528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896048996814621:6314]
2025-09-30T14:55:40.024854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1945, pipe: [1:7555896048996814621:6314]
2025-09-30T14:55:40.096095Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:40.096566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:40.096579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:40.096620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896048996814621:6314], now have 1 active actors on pipe
2025-09-30T14:55:40.096923Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:40.097225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:40.097307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1946 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bbe6e957-335141a7-56e16c33-9eb55d28_0
2025-09-30T14:55:40.097473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1946 sessionId: src_id|bbe6e957-335141a7-56e16c33-9eb55d28_0 is DEAD
2025-09-30T14:55:40.097633Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:40.097678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896048996814621:6314]
2025-09-30T14:55:40.099488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe6e957-335141a7-56e16c33-9eb55d28_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:40.099502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe6e957-335141a7-56e16c33-9eb55d28_0] Write session will restart in 0.005526s
2025-09-30T14:55:40.099527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe6e957-335141a7-56e16c33-9eb55d28_0] Write session: Do CDS request
2025-09-30T14:55:40.099533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe6e957-335141a7-56e16c33-9eb55d28_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:40.105810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe6e957-335141a7-56e16c33-9eb55d28_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:40.105929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:40.105949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1947
2025-09-30T14:55:40.106092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1947 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:40.106127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1947 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:40.106133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1947 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:40.106136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:40.106618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1947 sessionId:  describe result for acl check
2025-09-30T14:55:40.106660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:40.106665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:40.106667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:40.106673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896048996814641:5929] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:40.107260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896048996814641:5929] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:40.110152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896048996814641:5929] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:40.113357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896048996814641:5929] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:40.113375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896048996814641:5929] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:40.113379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896048996814641:5929] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:40.113389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1947 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:40.123946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:40.128076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:40.128350Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:40.128367Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:40.128382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:40.128453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:40.128502Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896048907045120:4541]
2025-09-30T14:55:40.129313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:40.129684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:40.129736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:40.130116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:40.130199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:40.130206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:40.130208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:40.130209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:40.130211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:40.130212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:40.130213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:40.130215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:40.130216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:40.130218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:40.130219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.130221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:40.130223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:40.130224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:40.130226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:40.130233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:40.130244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:40.130248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:40.130253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:40.130257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:40.130261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:40.130265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:40.130269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:40.130273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:40.130277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:40.130281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.130285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:40.130289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:40.130294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:40.130297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:40.130306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:40.130315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:40.130321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:40.130327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:40.130332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:40.130338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:40.130342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:40.130347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:40.130354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:40.130359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:40.130364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:40.130374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:40.130384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:40.130397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:40.130408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:40.130414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:40.130419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:40.130425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:40.130429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:40.130435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:40.130441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.130447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.130451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:40.130457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:40.130463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:40.130468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:40.130472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:40.130476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:40.130487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:40.130492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:40.130532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:40.136448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:40.137828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:40.137847Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:40.137850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:40.137854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:40.137860Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1946 [2:7555896048907045120:4541]
2025-09-30T14:55:40.137883Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:40.137903Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:40.137910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:40.137914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:40.137916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:40.137933Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:40.137944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:40.137952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:40.138016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.138023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:40.138026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:40.138031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:40.138034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:40.138099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:40.138107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.138119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:40.138131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:40.138151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:40.138172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896048907045115:4541]
2025-09-30T14:55:40.138179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896048907045115:4541]
2025-09-30T14:55:40.138181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896048907045115:4541]
2025-09-30T14:55:40.138189Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:40.138199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:40.138201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:40.138203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:40.138203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:40.138218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:40.138221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:40.138231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896048996814778:5929], now have 1 active actors on pipe
2025-09-30T14:55:40.138236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896048996814622:2454], now have 1 active actors on pipe
2025-09-30T14:55:40.138268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896048907045115:4541]
2025-09-30T14:55:40.138283Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:40.138299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:40.138338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1946
2025-09-30T14:55:40.138357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1946
2025-09-30T14:55:40.138481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:40.138493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:40.138518Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8313f871-348484fa-917279e7-24d09a4c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:40.138532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:40.138541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:40.138543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:40.138567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:40.138582Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:40.138602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:40.138757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:40.138774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:40.138797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:40.138906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1947 partition: 0 MaxSeqNo: 42 sessionId: src_id|8313f871-348484fa-917279e7-24d09a4c_0
2025-09-30T14:55:40.139274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe6e957-335141a7-56e16c33-9eb55d28_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8313f871-348484fa-917279e7-24d09a4c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:40.142060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8313f871-348484fa-917279e7-24d09a4c_0] Write session: try to update token
2025-09-30T14:55:40.142081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8313f871-348484fa-917279e7-24d09a4c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:40.151196Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:40.151224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:40.151227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:40.151230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:40.151257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896048907045115:4541]
2025-09-30T14:55:40.151265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896048907045115:4541]
2025-09-30T14:55:40.151271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896048907045115:4541]
2025-09-30T14:55:40.151316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:40.151319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:40.151327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.151331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:40.151331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:40.151336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:40.151545Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:40.159407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1947 sessionId: src_id|8313f871-348484fa-917279e7-24d09a4c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:40.162240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:40.198037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896048996814919:6314]
2025-09-30T14:55:40.198739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1946, pipe: [1:7555896048996814919:6314]
2025-09-30T14:55:40.269076Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:40.269851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:40.269863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:40.269885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896048996814919:6314], now have 1 active actors on pipe
2025-09-30T14:55:40.270166Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:40.271065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8313f871-348484fa-917279e7-24d09a4c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:40.271079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8313f871-348484fa-917279e7-24d09a4c_0] Write session will restart in 0.005095s
2025-09-30T14:55:40.271101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8313f871-348484fa-917279e7-24d09a4c_0] Write session: Do CDS request
2025-09-30T14:55:40.271107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8313f871-348484fa-917279e7-24d09a4c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:40.270132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:40.270146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896048996814919:6314]
2025-09-30T14:55:40.270160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:40.270167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:40.270231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1947 reason: error at write: Disconnected sessionId: src_id|8313f871-348484fa-917279e7-24d09a4c_0
2025-09-30T14:55:40.270404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1947 sessionId: src_id|8313f871-348484fa-917279e7-24d09a4c_0 is DEAD
2025-09-30T14:55:40.277790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8313f871-348484fa-917279e7-24d09a4c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:40.278146Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:40.278173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1948
2025-09-30T14:55:40.278525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1948 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:40.278566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1948 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:40.278571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1948 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:40.278575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:40.279163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1948 sessionId:  describe result for acl check
2025-09-30T14:55:40.279191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:40.279194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:40.279199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:40.279204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896048996814933:5933] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:40.279824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896048996814933:5933] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:40.282955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896048996814933:5933] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:40.286678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896048996814933:5933] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:40.286699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896048996814933:5933] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:40.286702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896048996814933:5933] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:40.286709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1948 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:40.301969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:40.305476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:40.305755Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:40.305759Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:40.305771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:40.305827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:40.305866Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896048907045403:4552]
2025-09-30T14:55:40.306560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:40.306926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:40.306973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:40.307398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:40.307472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:40.307473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:40.307474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:40.307475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:40.307477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:40.307478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:40.307480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:40.307481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:40.307482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:40.307483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:40.307485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.307486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:40.307487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:40.307488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:40.307489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:40.307495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:40.307506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:40.307522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:40.307526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:40.307530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:40.307534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:40.307538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:40.307543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:40.307547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:40.307552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:40.307555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.307559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:40.307564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:40.307568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:40.307572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:40.307580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:40.307588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:40.307595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:40.307601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:40.307606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:40.307612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:40.307617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:40.307623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:40.307628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:40.307634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:40.307638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:40.307644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:40.307649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:40.307655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:40.307660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:40.307665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:40.307670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:40.307688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:40.307695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:40.307701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:40.307706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.307712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.307716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:40.307721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:40.307726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:40.307730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:40.307734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:40.307739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:40.307751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:40.307757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:40.307802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:40.315736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:40.317048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:40.317065Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:40.317068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:40.317072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:40.317080Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1947 [2:7555896048907045403:4552]
2025-09-30T14:55:40.317099Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:40.317114Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:40.317117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:40.317121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:40.317123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:40.317138Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:40.317151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:40.317162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:40.317223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.317234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:40.317236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:40.317240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:40.317242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:40.317309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:40.317319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.317334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:40.317347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:40.317364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:40.317381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896048907045398:4552]
2025-09-30T14:55:40.317388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896048907045398:4552]
2025-09-30T14:55:40.317390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896048907045398:4552]
2025-09-30T14:55:40.317399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:40.317412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:40.317427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:40.317428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:40.317430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:40.317432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:40.317434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:40.317471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896048996814923:2454], now have 1 active actors on pipe
2025-09-30T14:55:40.317476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896048996815005:5933], now have 1 active actors on pipe
2025-09-30T14:55:40.317479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896048907045398:4552]
2025-09-30T14:55:40.317488Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:40.317509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:40.320599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1947
2025-09-30T14:55:40.320599Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1947
2025-09-30T14:55:40.323342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:40.323365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:40.323393Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1fa6344-3f8dd6e2-15acfc09-d14bdd1f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:40.323402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:40.323410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:40.323413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:40.323423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:40.323442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:40.323465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:40.323972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:40.323988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:40.324011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:40.327601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1948 partition: 0 MaxSeqNo: 42 sessionId: src_id|a1fa6344-3f8dd6e2-15acfc09-d14bdd1f_0
2025-09-30T14:55:40.331484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8313f871-348484fa-917279e7-24d09a4c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a1fa6344-3f8dd6e2-15acfc09-d14bdd1f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:40.334356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1fa6344-3f8dd6e2-15acfc09-d14bdd1f_0] Write session: try to update token
2025-09-30T14:55:40.334379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1fa6344-3f8dd6e2-15acfc09-d14bdd1f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:40.341902Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:40.341926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:40.341929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:40.341932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:40.341942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896048907045398:4552]
2025-09-30T14:55:40.341947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896048907045398:4552]
2025-09-30T14:55:40.341955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896048907045398:4552]
2025-09-30T14:55:40.341998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:40.342012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.342015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:40.342021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:40.342030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:40.342036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:40.342192Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:40.356712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1948 sessionId: src_id|a1fa6344-3f8dd6e2-15acfc09-d14bdd1f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:40.359650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:40.370109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896048996815216:6314]
2025-09-30T14:55:40.370384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1947, pipe: [1:7555896048996815216:6314]
2025-09-30T14:55:40.456442Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:40.457029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:40.457046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:40.457065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896048996815216:6314], now have 1 active actors on pipe
2025-09-30T14:55:40.457313Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:40.458073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1fa6344-3f8dd6e2-15acfc09-d14bdd1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:40.458090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1fa6344-3f8dd6e2-15acfc09-d14bdd1f_0] Write session will restart in 0.005659s
2025-09-30T14:55:40.458129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1fa6344-3f8dd6e2-15acfc09-d14bdd1f_0] Write session: Do CDS request
2025-09-30T14:55:40.458136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1fa6344-3f8dd6e2-15acfc09-d14bdd1f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:40.457339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896048996815216:6314]
2025-09-30T14:55:40.457350Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:40.457387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:40.457468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1948 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a1fa6344-3f8dd6e2-15acfc09-d14bdd1f_0
2025-09-30T14:55:40.457702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1948 sessionId: src_id|a1fa6344-3f8dd6e2-15acfc09-d14bdd1f_0 is DEAD
2025-09-30T14:55:40.464902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1fa6344-3f8dd6e2-15acfc09-d14bdd1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:40.464992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:40.465022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1949
2025-09-30T14:55:40.465497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1949 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:40.465548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1949 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:40.465553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1949 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:40.465557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:40.466163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1949 sessionId:  describe result for acl check
2025-09-30T14:55:40.466209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:40.466211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:40.466213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:40.466219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896048996815228:5927] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:40.467082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896048996815228:5927] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:40.470004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896048996815228:5927] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:40.473884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896048996815228:5927] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:40.473905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896048996815228:5927] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:40.473909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896048996815228:5927] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:40.473918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1949 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:40.490759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:40.494417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:40.494812Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:40.494817Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:40.494828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:40.494892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:40.494931Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896048907045689:4550]
2025-09-30T14:55:40.495696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:40.496080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:40.496138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:40.496493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:40.496556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:40.496558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:40.496559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:40.496560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:40.496562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:40.496563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:40.496564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:40.496565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:40.496567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:40.496568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:40.496569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.496571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:40.496572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:40.496573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:40.496574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:40.496580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:40.496592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:40.496596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:40.496600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:40.496605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:40.496609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:40.496613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:40.496617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:40.496621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:40.496625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:40.496630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.496633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:40.496637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:40.496641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:40.496645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:40.496652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:40.496661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:40.496667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:40.496673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:40.496678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:40.496683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:40.496688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:40.496693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:40.496699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:40.496704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:40.496709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:40.496714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:40.496719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:40.496724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:40.496729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:40.496737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:40.496742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:40.496749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:40.496754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:40.496760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:40.496766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.496772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.496778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:40.496784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:40.496789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:40.496795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:40.496800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:40.496805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:40.496813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:40.496817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:40.496862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:40.503448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:40.504431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:40.504453Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:40.504456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:40.504460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:40.504468Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1948 [2:7555896048907045689:4550]
2025-09-30T14:55:40.504486Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:40.504502Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:40.504505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:40.504508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:40.504512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:40.504530Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:40.504538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:40.504545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:40.504990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.505003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:40.505006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:40.505010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:40.505013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:40.505089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:40.505098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.505113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:40.505126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:40.505146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:40.505173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896048996815218:2454], now have 1 active actors on pipe
2025-09-30T14:55:40.505184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896048996815277:5927], now have 1 active actors on pipe
2025-09-30T14:55:40.505191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896048907045684:4550]
2025-09-30T14:55:40.505194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896048907045684:4550]
2025-09-30T14:55:40.505196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896048907045684:4550]
2025-09-30T14:55:40.505210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:40.505226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:40.505246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:40.505251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:40.505255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:40.505256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:40.505258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:40.505291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896048907045684:4550]
2025-09-30T14:55:40.505301Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:40.505304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:40.505255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1948
2025-09-30T14:55:40.505277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1948
2025-09-30T14:55:40.505616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:40.505631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:40.505656Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37dd4647-8fd37d32-dc60e6ea-3e05c050_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:40.505671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:40.505676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:40.505678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:40.505689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:40.505699Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:40.505713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:40.506130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:40.506140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:40.506154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:40.506240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1949 partition: 0 MaxSeqNo: 42 sessionId: src_id|37dd4647-8fd37d32-dc60e6ea-3e05c050_0
2025-09-30T14:55:40.506577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1fa6344-3f8dd6e2-15acfc09-d14bdd1f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|37dd4647-8fd37d32-dc60e6ea-3e05c050_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:40.509377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37dd4647-8fd37d32-dc60e6ea-3e05c050_0] Write session: try to update token
2025-09-30T14:55:40.509394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37dd4647-8fd37d32-dc60e6ea-3e05c050_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:40.519932Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:40.519979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:40.519982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:40.519984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:40.519994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896048907045684:4550]
2025-09-30T14:55:40.519999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896048907045684:4550]
2025-09-30T14:55:40.520003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896048907045684:4550]
2025-09-30T14:55:40.520048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:40.520055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.520054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:40.520058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:40.520061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:40.520065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:40.520207Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:40.524986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1949 sessionId: src_id|37dd4647-8fd37d32-dc60e6ea-3e05c050_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:40.527861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:40.557475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896048996815511:6314]
2025-09-30T14:55:40.558114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1948, pipe: [1:7555896048996815511:6314]
2025-09-30T14:55:40.646270Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:40.646761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:40.646783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:40.646822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896048996815511:6314], now have 1 active actors on pipe
2025-09-30T14:55:40.647216Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:40.647668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896048996815511:6314]
2025-09-30T14:55:40.647696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:40.647722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:40.647784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1949 reason: status is not ok: tablet will be restarted right now sessionId: src_id|37dd4647-8fd37d32-dc60e6ea-3e05c050_0
2025-09-30T14:55:40.647948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1949 sessionId: src_id|37dd4647-8fd37d32-dc60e6ea-3e05c050_0 is DEAD
2025-09-30T14:55:40.648276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37dd4647-8fd37d32-dc60e6ea-3e05c050_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:40.648287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37dd4647-8fd37d32-dc60e6ea-3e05c050_0] Write session will restart in 0.005125s
2025-09-30T14:55:40.648323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37dd4647-8fd37d32-dc60e6ea-3e05c050_0] Write session: Do CDS request
2025-09-30T14:55:40.648329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37dd4647-8fd37d32-dc60e6ea-3e05c050_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:40.655737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37dd4647-8fd37d32-dc60e6ea-3e05c050_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:40.656489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:40.656509Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1950
2025-09-30T14:55:40.656610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1950 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:40.656640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1950 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:40.656650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1950 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:40.656654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:40.658666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1950 sessionId:  describe result for acl check
2025-09-30T14:55:40.658706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:40.658714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:40.658716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:40.658721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896048996815543:5910] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:40.659285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896048996815543:5910] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:40.666342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896048996815543:5910] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:40.670570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896048996815543:5910] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:40.670590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896048996815543:5910] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:40.670593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896048996815543:5910] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:40.670600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1950 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:40.677241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:40.680393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:40.680589Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:40.680593Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:40.680601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:40.680640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:40.680676Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896048907046022:4539]
2025-09-30T14:55:40.681187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:40.681541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:40.681591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:40.681915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:40.681977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:40.681979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:40.681980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:40.681981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:40.681982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:40.681983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:40.681984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:40.681985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:40.681986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:40.681987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:40.681989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.681990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:40.681991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:40.681992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:40.681993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:40.681998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:40.682008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:40.682011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:40.682015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:40.682019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:40.682022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:40.682026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:40.682029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:40.682032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:40.682035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:40.682038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.682041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:40.682044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:40.682047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:40.682051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:40.682058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:40.682066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:40.682071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:40.682076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:40.682080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:40.682084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:40.682087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:40.682091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:40.682095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:40.682100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:40.682103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:40.682107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:40.682111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:40.682115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:40.682119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:40.682123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:40.682127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:40.682131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:40.682135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:40.682140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:40.682148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.682152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.682156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:40.682160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:40.682164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:40.682168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:40.682172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:40.682176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:40.682180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:40.682184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:40.682220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:40.691155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1949
2025-09-30T14:55:40.691199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1949
2025-09-30T14:55:40.688966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:40.689971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:40.689977Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:40.689980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:40.689985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:40.689994Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1949 [2:7555896048907046022:4539]
2025-09-30T14:55:40.690010Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:40.690030Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:40.690034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:40.690037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:40.690040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:40.690056Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:40.690063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:40.690070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:40.690125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.690127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:40.690130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:40.690134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:40.690136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:40.690208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:40.690211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.690223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:40.690236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:40.690254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:40.690270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896048907046017:4539]
2025-09-30T14:55:40.690273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896048907046017:4539]
2025-09-30T14:55:40.690275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896048907046017:4539]
2025-09-30T14:55:40.690285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:40.690298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:40.690313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:40.690316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:40.690358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896048907046017:4539]
2025-09-30T14:55:40.690361Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:40.690448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:40.690453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:40.690456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:40.690461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:40.690706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896048996815691:5910], now have 1 active actors on pipe
2025-09-30T14:55:40.690715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896048996815528:2454], now have 1 active actors on pipe
2025-09-30T14:55:40.691285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:40.691292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:40.691320Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b429fc9-94627534-316c79e-82b5daec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:40.691328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:40.691332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:40.691335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:40.691345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:40.691355Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:40.691376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:40.691694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1950 partition: 0 MaxSeqNo: 42 sessionId: src_id|4b429fc9-94627534-316c79e-82b5daec_0
2025-09-30T14:55:40.692096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37dd4647-8fd37d32-dc60e6ea-3e05c050_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4b429fc9-94627534-316c79e-82b5daec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:40.694936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b429fc9-94627534-316c79e-82b5daec_0] Write session: try to update token
2025-09-30T14:55:40.694953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b429fc9-94627534-316c79e-82b5daec_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:40.691548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:40.691562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:40.691578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:40.705704Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:40.705730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:40.705733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:40.705735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:40.705745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896048907046017:4539]
2025-09-30T14:55:40.705749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896048907046017:4539]
2025-09-30T14:55:40.705752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896048907046017:4539]
2025-09-30T14:55:40.705794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:40.705802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.705804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:40.705813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:40.705820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:40.705824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:40.705955Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:40.714065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1950 sessionId: src_id|4b429fc9-94627534-316c79e-82b5daec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:40.716812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:40.747983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896048996815831:6314]
2025-09-30T14:55:40.748314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1949, pipe: [1:7555896048996815831:6314]
2025-09-30T14:55:40.817591Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:40.818233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:40.818245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:40.818263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896048996815831:6314], now have 1 active actors on pipe
2025-09-30T14:55:40.818530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:40.818550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:40.818556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896048996815831:6314]
2025-09-30T14:55:40.818584Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:40.818612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1950 reason: error at write: Disconnected sessionId: src_id|4b429fc9-94627534-316c79e-82b5daec_0
2025-09-30T14:55:40.818788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1950 sessionId: src_id|4b429fc9-94627534-316c79e-82b5daec_0 is DEAD
2025-09-30T14:55:40.818802Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:40.818948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b429fc9-94627534-316c79e-82b5daec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:40.818960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b429fc9-94627534-316c79e-82b5daec_0] Write session will restart in 0.008183s
2025-09-30T14:55:40.818984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b429fc9-94627534-316c79e-82b5daec_0] Write session: Do CDS request
2025-09-30T14:55:40.818991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b429fc9-94627534-316c79e-82b5daec_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:40.828780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b429fc9-94627534-316c79e-82b5daec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:40.828906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:40.828926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1951
2025-09-30T14:55:40.829050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1951 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:40.829083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1951 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:40.829092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1951 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:40.829096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:40.829677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1951 sessionId:  describe result for acl check
2025-09-30T14:55:40.829719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:40.829726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:40.829728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:40.829734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896048996815898:5902] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:40.830280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896048996815898:5902] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:40.833172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896048996815898:5902] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:40.836912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896048996815898:5902] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:40.836931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896048996815898:5902] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:40.836934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896048996815898:5902] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:40.836943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1951 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:40.840425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:40.843330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:40.843655Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:40.843669Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:40.843685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:40.843765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:40.843814Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896048907046310:4510]
2025-09-30T14:55:40.844492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:40.844859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:40.844911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:40.845260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:40.845349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:40.845350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:40.845351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:40.845352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:40.845354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:40.845355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:40.845356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:40.845358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:40.845360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:40.845361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:40.845362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.845363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:40.845364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:40.845365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:40.845366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:40.845373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:40.845384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:40.845388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:40.845392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:40.845396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:40.845400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:40.845404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:40.845408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:40.845411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:40.845416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:40.845420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.845425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:40.845429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:40.845433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:40.845437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:40.845445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:40.845454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:40.845460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:40.845467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:40.845472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:40.845478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:40.845483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:40.845489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:40.845494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:40.845500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:40.845505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:40.845511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:40.845516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:40.845537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:40.845543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:40.845548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:40.845554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:40.845560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:40.845565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:40.845571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:40.845576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.845582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.845587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:40.845592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:40.845598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:40.845604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:40.845609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:40.845615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:40.845621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:40.845627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:40.845696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:40.851576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:40.852957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:40.852973Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:40.852975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:40.852979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:40.852986Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1950 [2:7555896048907046310:4510]
2025-09-30T14:55:40.853000Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:40.853013Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:40.853017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:40.853020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:40.853022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:40.853037Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:40.853043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:40.853048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:40.853103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.853109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:40.853110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:40.853113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:40.853115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:40.853177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:40.853183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.853192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:40.853199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:40.853209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:40.853221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896048907046305:4510]
2025-09-30T14:55:40.853223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896048907046305:4510]
2025-09-30T14:55:40.853224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896048907046305:4510]
2025-09-30T14:55:40.853232Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:40.853243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:40.853252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:40.853254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:40.853258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:40.853262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:40.853263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896048996815844:2454], now have 1 active actors on pipe
2025-09-30T14:55:40.853264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:40.853267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896048996816082:5902], now have 1 active actors on pipe
2025-09-30T14:55:40.853300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896048907046305:4510]
2025-09-30T14:55:40.853316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:40.853317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1950
2025-09-30T14:55:40.853344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:40.853372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1950
2025-09-30T14:55:40.853425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:40.853442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:40.853486Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b82a7920-4874b6fc-7e0ea8aa-5449c440_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:40.853500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:40.853507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:40.853510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:40.853541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:40.853557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:40.853575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:40.853743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:40.853751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:40.853765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:40.853899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1951 partition: 0 MaxSeqNo: 42 sessionId: src_id|b82a7920-4874b6fc-7e0ea8aa-5449c440_0
2025-09-30T14:55:40.854337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b429fc9-94627534-316c79e-82b5daec_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b82a7920-4874b6fc-7e0ea8aa-5449c440_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:40.857261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b82a7920-4874b6fc-7e0ea8aa-5449c440_0] Write session: try to update token
2025-09-30T14:55:40.857284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b82a7920-4874b6fc-7e0ea8aa-5449c440_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:40.866155Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:40.866180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:40.866183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:40.866185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:40.866194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896048907046305:4510]
2025-09-30T14:55:40.866199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896048907046305:4510]
2025-09-30T14:55:40.866203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896048907046305:4510]
2025-09-30T14:55:40.866242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:40.866250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:40.866253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:40.866262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:40.866270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:40.866274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:40.866431Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:40.879383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1951 sessionId: src_id|b82a7920-4874b6fc-7e0ea8aa-5449c440_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:40.882187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:40.918964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896048996816141:6314]
2025-09-30T14:55:40.919452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1950, pipe: [1:7555896048996816141:6314]
2025-09-30T14:55:40.986603Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:40.986957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:40.986975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:40.986994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896048996816141:6314], now have 1 active actors on pipe
2025-09-30T14:55:40.987225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:40.987271Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:40.987274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896048996816141:6314]
2025-09-30T14:55:40.987295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:40.987313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:40.987379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1951 reason: error at write: Disconnected sessionId: src_id|b82a7920-4874b6fc-7e0ea8aa-5449c440_0
2025-09-30T14:55:40.987575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1951 sessionId: src_id|b82a7920-4874b6fc-7e0ea8aa-5449c440_0 is DEAD
2025-09-30T14:55:40.987777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b82a7920-4874b6fc-7e0ea8aa-5449c440_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:40.987788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b82a7920-4874b6fc-7e0ea8aa-5449c440_0] Write session will restart in 0.009012s
2025-09-30T14:55:40.987813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b82a7920-4874b6fc-7e0ea8aa-5449c440_0] Write session: Do CDS request
2025-09-30T14:55:40.987819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b82a7920-4874b6fc-7e0ea8aa-5449c440_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:40.999211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b82a7920-4874b6fc-7e0ea8aa-5449c440_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:40.999298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:40.999312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1952
2025-09-30T14:55:40.999647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1952 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:40.999682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1952 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:40.999691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1952 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:40.999705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:41.000434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1952 sessionId:  describe result for acl check
2025-09-30T14:55:41.000465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:41.000473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:41.000476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:41.000481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896053291783493:5891] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:41.000927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896053291783493:5891] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:41.004692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896053291783493:5891] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:41.008730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896053291783493:5891] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:41.008744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896053291783493:5891] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:41.008747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896053291783493:5891] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:41.008755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1952 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:41.012234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:41.016082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:41.016272Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:41.016276Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:41.016286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:41.016337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:41.016371Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896053202013894:4506]
2025-09-30T14:55:41.016906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:41.017154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:41.017194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:41.017472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:41.017543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:41.017544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:41.017545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:41.017546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:41.017546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:41.017547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:41.017548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:41.017548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:41.017549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:41.017550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:41.017550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.017551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.017552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.017553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:41.017554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:41.017557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:41.017564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:41.017566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:41.017569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:41.017573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:41.017577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:41.017582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:41.017585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:41.017588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:41.017592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:41.017596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.017599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.017603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.017606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:41.017610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:41.017619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:41.017627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:41.017633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:41.017639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:41.017644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:41.017650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:41.017654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:41.017660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:41.017665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:41.017669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:41.017672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:41.017675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:41.017678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:41.017681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:41.017685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:41.017688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:41.017691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:41.017694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:41.017696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:41.017699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:41.017701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.017704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.017706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.017709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.017712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.017715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.017717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:41.017719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:41.017723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:41.017725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:41.017748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:41.023975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:41.024969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:41.024974Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:41.024977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:41.024981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:41.024988Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1951 [2:7555896053202013894:4506]
2025-09-30T14:55:41.025007Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:41.025023Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:41.025027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:41.025031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:41.025033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:41.025051Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:41.025058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:41.025065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:41.025123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.025125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.025127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.025130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:41.025132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:41.025203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:41.025206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.025219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.025229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.025243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:41.025261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896053202013889:4506]
2025-09-30T14:55:41.025263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896053202013889:4506]
2025-09-30T14:55:41.025265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896053202013889:4506]
2025-09-30T14:55:41.025280Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:41.025297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:41.025313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:41.025316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:41.025356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896053202013889:4506]
2025-09-30T14:55:41.025358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:41.025693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1951
2025-09-30T14:55:41.025698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1951
2025-09-30T14:55:41.025421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:41.025431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:41.025433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:41.025439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:41.025875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896053291783668:5891], now have 1 active actors on pipe
2025-09-30T14:55:41.025880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896048996816143:2454], now have 1 active actors on pipe
2025-09-30T14:55:41.026037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:41.026042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:41.026063Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e35d8928-863ae984-492ca6d8-869ede66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:41.026069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:41.026072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:41.026074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:41.026083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:41.026093Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:41.026104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:41.027555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:41.027569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:41.027592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:41.027758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1952 partition: 0 MaxSeqNo: 42 sessionId: src_id|e35d8928-863ae984-492ca6d8-869ede66_0
2025-09-30T14:55:41.028135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b82a7920-4874b6fc-7e0ea8aa-5449c440_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e35d8928-863ae984-492ca6d8-869ede66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:41.030950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e35d8928-863ae984-492ca6d8-869ede66_0] Write session: try to update token
2025-09-30T14:55:41.030968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e35d8928-863ae984-492ca6d8-869ede66_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:41.040625Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:41.040644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:41.040646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:41.040648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:41.040655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896053202013889:4506]
2025-09-30T14:55:41.040658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896053202013889:4506]
2025-09-30T14:55:41.040661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896053202013889:4506]
2025-09-30T14:55:41.040692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:41.040697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.040699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:41.040761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:41.040773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:41.040777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:41.040889Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:41.051206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1952 sessionId: src_id|e35d8928-863ae984-492ca6d8-869ede66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:41.054162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:41.087430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896053291783741:6314]
2025-09-30T14:55:41.091335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1951, pipe: [1:7555896053291783741:6314]
2025-09-30T14:55:41.157313Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:41.158521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:41.158534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:41.158538Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:41.158583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896053291783741:6314]
2025-09-30T14:55:41.158601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1952 reason: error at write: Disconnected sessionId: src_id|e35d8928-863ae984-492ca6d8-869ede66_0
2025-09-30T14:55:41.158184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:41.158201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:41.158221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896053291783741:6314], now have 1 active actors on pipe
2025-09-30T14:55:41.158423Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:41.159023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e35d8928-863ae984-492ca6d8-869ede66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:41.159035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e35d8928-863ae984-492ca6d8-869ede66_0] Write session will restart in 0.005893s
2025-09-30T14:55:41.159060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e35d8928-863ae984-492ca6d8-869ede66_0] Write session: Do CDS request
2025-09-30T14:55:41.159065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e35d8928-863ae984-492ca6d8-869ede66_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:41.158760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1952 sessionId: src_id|e35d8928-863ae984-492ca6d8-869ede66_0 is DEAD
2025-09-30T14:55:41.165805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e35d8928-863ae984-492ca6d8-869ede66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:41.165898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:41.165911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1953
2025-09-30T14:55:41.166072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1953 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:41.166104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1953 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:41.166112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1953 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:41.166116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:41.166564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1953 sessionId:  describe result for acl check
2025-09-30T14:55:41.166615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:41.166622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:41.166624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:41.166632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896053291783759:5883] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:41.167185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896053291783759:5883] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:41.169636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896053291783759:5883] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:41.172667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896053291783759:5883] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:41.172682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896053291783759:5883] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:41.172686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896053291783759:5883] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:41.172694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1953 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:41.190163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:41.193379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:41.193654Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:41.193669Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:41.193682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:41.193748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:41.193791Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896053202014182:4500]
2025-09-30T14:55:41.194428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:41.194735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:41.194795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:41.195161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:41.195275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:41.195285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:41.195286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:41.195287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:41.195289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:41.195290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:41.195291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:41.195293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:41.195294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:41.195296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:41.195297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.195298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.195300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.195301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:41.195302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:41.195309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:41.195320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:41.195323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:41.195327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:41.195330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:41.195334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:41.195338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:41.195342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:41.195345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:41.195349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:41.195352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.195356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.195360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.195364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:41.195368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:41.195378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:41.195387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:41.195393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:41.195399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:41.195410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:41.195419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:41.195423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:41.195435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:41.195443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:41.195449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:41.195456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:41.195460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:41.195471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:41.195477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:41.195482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:41.195487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:41.195492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:41.195497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:41.195502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:41.195508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:41.195513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.195517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.195522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.195527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.195532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.195538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.195543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:41.195551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:41.195560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:41.195581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:41.195624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:41.201314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:41.202600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:41.202614Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:41.202616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:41.202619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:41.202625Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1952 [2:7555896053202014182:4500]
2025-09-30T14:55:41.202637Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:41.202650Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:41.202651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:41.202654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:41.202656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:41.202668Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:41.202674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:41.202679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:41.202732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.202737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.202739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.202742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:41.202744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:41.202794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:41.202796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.202805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.202811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.202820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:41.202832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896053202014177:4500]
2025-09-30T14:55:41.202834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896053202014177:4500]
2025-09-30T14:55:41.202835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896053202014177:4500]
2025-09-30T14:55:41.202840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:41.202850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:41.202854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:41.202857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:41.202859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:41.202859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:41.202861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:41.202868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896053291783797:5883], now have 1 active actors on pipe
2025-09-30T14:55:41.202871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896053291783747:2454], now have 1 active actors on pipe
2025-09-30T14:55:41.202899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896053202014177:4500]
2025-09-30T14:55:41.202909Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:41.202920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:41.203082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:41.203102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:41.203126Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c175d35-2a2809ad-c2dd5c0a-ae3cc90f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:41.203135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:41.203138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:41.203139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:41.203148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:41.203158Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:41.203170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:41.203381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:41.203393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:41.203418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:41.203939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e35d8928-863ae984-492ca6d8-869ede66_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7c175d35-2a2809ad-c2dd5c0a-ae3cc90f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:41.203014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1952
2025-09-30T14:55:41.203051Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1952
2025-09-30T14:55:41.203613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1953 partition: 0 MaxSeqNo: 42 sessionId: src_id|7c175d35-2a2809ad-c2dd5c0a-ae3cc90f_0
2025-09-30T14:55:41.206806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c175d35-2a2809ad-c2dd5c0a-ae3cc90f_0] Write session: try to update token
2025-09-30T14:55:41.206826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c175d35-2a2809ad-c2dd5c0a-ae3cc90f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:41.215985Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:41.216011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:41.216014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:41.216016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:41.216026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896053202014177:4500]
2025-09-30T14:55:41.216031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896053202014177:4500]
2025-09-30T14:55:41.216035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896053202014177:4500]
2025-09-30T14:55:41.216087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:41.216095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.216098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:41.216279Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:41.219351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:41.219375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:41.219379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:41.222841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1953 sessionId: src_id|7c175d35-2a2809ad-c2dd5c0a-ae3cc90f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:41.226190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:41.258954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896053291784047:6314]
2025-09-30T14:55:41.266571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1952, pipe: [1:7555896053291784047:6314]
2025-09-30T14:55:41.335875Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:41.336210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:41.336230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:41.336268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896053291784047:6314], now have 1 active actors on pipe
2025-09-30T14:55:41.336503Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:41.337033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:41.337122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1953 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7c175d35-2a2809ad-c2dd5c0a-ae3cc90f_0
2025-09-30T14:55:41.337464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c175d35-2a2809ad-c2dd5c0a-ae3cc90f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:41.337474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c175d35-2a2809ad-c2dd5c0a-ae3cc90f_0] Write session will restart in 0.005720s
2025-09-30T14:55:41.337499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c175d35-2a2809ad-c2dd5c0a-ae3cc90f_0] Write session: Do CDS request
2025-09-30T14:55:41.337515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c175d35-2a2809ad-c2dd5c0a-ae3cc90f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:41.337308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1953 sessionId: src_id|7c175d35-2a2809ad-c2dd5c0a-ae3cc90f_0 is DEAD
2025-09-30T14:55:41.337542Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:41.337589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896053291784047:6314]
2025-09-30T14:55:41.344835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c175d35-2a2809ad-c2dd5c0a-ae3cc90f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:41.345003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:41.345018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1954
2025-09-30T14:55:41.345130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1954 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:41.345159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1954 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:41.345164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1954 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:41.345168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:41.345724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1954 sessionId:  describe result for acl check
2025-09-30T14:55:41.345764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:41.345766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:41.345769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:41.345774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896053291784063:5880] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:41.346366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896053291784063:5880] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:41.348229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896053291784063:5880] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:41.357133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896053291784063:5880] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:41.357151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896053291784063:5880] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:41.357155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896053291784063:5880] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:41.357166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1954 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:41.362900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:41.366616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:41.366870Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:41.366881Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:41.366894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:41.366951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:41.367000Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896053202014471:4495]
2025-09-30T14:55:41.367690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:41.368206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:41.368265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:41.368631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:41.368699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:41.368706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:41.368707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:41.368709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:41.368710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:41.368712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:41.368713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:41.368715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:41.368716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:41.368718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:41.368719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.368724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.368726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.368727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:41.368728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:41.368734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:41.368745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:41.368750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:41.368754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:41.368759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:41.368764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:41.368768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:41.368773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:41.368777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:41.368782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:41.368787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.368791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.368795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.368799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:41.368802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:41.368811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:41.368818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:41.368822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:41.368826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:41.368833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:41.368836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:41.368839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:41.368842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:41.368844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:41.368847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:41.368850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:41.368853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:41.368856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:41.368860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:41.368863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:41.368865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:41.368868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:41.368871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:41.368874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:41.368877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:41.368882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.368885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.368888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.368890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.368893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.368897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.368900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:41.368903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:41.368905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:41.368909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:41.368947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:41.377557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:41.378735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:41.378753Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:41.378757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:41.378761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:41.378768Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1953 [2:7555896053202014471:4495]
2025-09-30T14:55:41.378785Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:41.378800Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:41.378803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:41.378807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:41.378809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:41.378827Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:41.378835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:41.378848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:41.378909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.378917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.378919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.378923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:41.378926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:41.378997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:41.379005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.379019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.379033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.379050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:41.379072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896053291784231:5880], now have 1 active actors on pipe
2025-09-30T14:55:41.379076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896053291784050:2454], now have 1 active actors on pipe
2025-09-30T14:55:41.379083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896053202014466:4495]
2025-09-30T14:55:41.379086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896053202014466:4495]
2025-09-30T14:55:41.379088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896053202014466:4495]
2025-09-30T14:55:41.379102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:41.379115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:41.379119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:41.379122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:41.379125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:41.379130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:41.379134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:41.379170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896053202014466:4495]
2025-09-30T14:55:41.379177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:41.379183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:41.379211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1953
2025-09-30T14:55:41.379261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1953
2025-09-30T14:55:41.379403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:41.379415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:41.379446Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7adc360d-3b365da1-1bbe1c2b-9052185b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:41.379454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:41.379458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:41.379460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:41.379470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:41.379479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:41.379497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:41.379859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:41.379866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:41.379879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:41.379984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1954 partition: 0 MaxSeqNo: 42 sessionId: src_id|7adc360d-3b365da1-1bbe1c2b-9052185b_0
2025-09-30T14:55:41.380381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c175d35-2a2809ad-c2dd5c0a-ae3cc90f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7adc360d-3b365da1-1bbe1c2b-9052185b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:41.383402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7adc360d-3b365da1-1bbe1c2b-9052185b_0] Write session: try to update token
2025-09-30T14:55:41.383424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7adc360d-3b365da1-1bbe1c2b-9052185b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:41.394914Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:41.394976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:41.394979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:41.394982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:41.394991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896053202014466:4495]
2025-09-30T14:55:41.395003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896053202014466:4495]
2025-09-30T14:55:41.395007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896053202014466:4495]
2025-09-30T14:55:41.395046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:41.395059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.395063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:41.395204Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:41.395284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:41.395304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:41.395309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:41.405938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1954 sessionId: src_id|7adc360d-3b365da1-1bbe1c2b-9052185b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:41.408576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:41.435596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896053291784348:6314]
2025-09-30T14:55:41.435928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1953, pipe: [1:7555896053291784348:6314]
2025-09-30T14:55:41.512659Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:41.513424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:41.513447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:41.513481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896053291784348:6314], now have 1 active actors on pipe
2025-09-30T14:55:41.513710Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:41.513767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896053291784348:6314]
2025-09-30T14:55:41.513770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:41.513774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:41.513797Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:41.513833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1954 reason: error at write: Disconnected sessionId: src_id|7adc360d-3b365da1-1bbe1c2b-9052185b_0
2025-09-30T14:55:41.514158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7adc360d-3b365da1-1bbe1c2b-9052185b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:41.514170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7adc360d-3b365da1-1bbe1c2b-9052185b_0] Write session will restart in 0.009586s
2025-09-30T14:55:41.514195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7adc360d-3b365da1-1bbe1c2b-9052185b_0] Write session: Do CDS request
2025-09-30T14:55:41.514200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7adc360d-3b365da1-1bbe1c2b-9052185b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:41.513994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1954 sessionId: src_id|7adc360d-3b365da1-1bbe1c2b-9052185b_0 is DEAD
2025-09-30T14:55:41.526546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7adc360d-3b365da1-1bbe1c2b-9052185b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:41.526538Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:41.526555Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1955
2025-09-30T14:55:41.526818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1955 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:41.526861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1955 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:41.526867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1955 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:41.526873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:41.527336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1955 sessionId:  describe result for acl check
2025-09-30T14:55:41.527374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:41.527377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:41.527378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:41.527384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896053291784420:5872] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:41.527991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896053291784420:5872] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:41.532937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896053291784420:5872] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:41.537090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896053291784420:5872] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:41.537103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896053291784420:5872] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:41.537106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896053291784420:5872] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:41.537113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1955 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:41.540706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:41.543881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:41.544125Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:41.544141Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:41.544154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:41.544223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:41.544273Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896053202014765:4493]
2025-09-30T14:55:41.544950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:41.545294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:41.545352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:41.545715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:41.545808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:41.545816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:41.545818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:41.545819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:41.545821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:41.545822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:41.545823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:41.545825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:41.545826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:41.545827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:41.545829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.545830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.545831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.545832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:41.545833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:41.545839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:41.545849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:41.545854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:41.545858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:41.545862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:41.545866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:41.545869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:41.545873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:41.545876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:41.545881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:41.545885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.545889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.545893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.545897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:41.545902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:41.545911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:41.545921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:41.545929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:41.545935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:41.545939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:41.545945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:41.545949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:41.545955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:41.545960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:41.545966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:41.545971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:41.545976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:41.545982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:41.545987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:41.545992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:41.545999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:41.546004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:41.546009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:41.546020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:41.546025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:41.546032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.546043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.546048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.546058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.546064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.546074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.546078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:41.546093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:41.546098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:41.546103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:41.546148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:41.551958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:41.553388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:41.553406Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:41.553409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:41.553414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:41.553420Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1954 [2:7555896053202014765:4493]
2025-09-30T14:55:41.553438Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:41.553453Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:41.553457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:41.553460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:41.553463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:41.553478Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:41.553494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:41.553501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:41.553576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.553584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.553586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.553589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:41.553592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:41.553836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1954
2025-09-30T14:55:41.553885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1954
2025-09-30T14:55:41.553662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:41.553675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.553688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.553703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.553724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:41.553744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896053291784350:2454], now have 1 active actors on pipe
2025-09-30T14:55:41.553747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896053291784609:5872], now have 1 active actors on pipe
2025-09-30T14:55:41.553754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896053202014760:4493]
2025-09-30T14:55:41.553756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896053202014760:4493]
2025-09-30T14:55:41.553758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896053202014760:4493]
2025-09-30T14:55:41.553769Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:41.553783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:41.553794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:41.553798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:41.553800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:41.553800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:41.553803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:41.553839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896053202014760:4493]
2025-09-30T14:55:41.553842Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:41.553849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:41.554047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:41.554057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:41.554088Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|982a8dc-513d448b-aa451d89-d718cf96_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:41.554095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:41.554099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:41.554101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:41.554112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:41.554122Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:41.554137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:41.554282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:41.554293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:41.554306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:41.554758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7adc360d-3b365da1-1bbe1c2b-9052185b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|982a8dc-513d448b-aa451d89-d718cf96_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:41.554385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1955 partition: 0 MaxSeqNo: 42 sessionId: src_id|982a8dc-513d448b-aa451d89-d718cf96_0
2025-09-30T14:55:41.557805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|982a8dc-513d448b-aa451d89-d718cf96_0] Write session: try to update token
2025-09-30T14:55:41.557825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|982a8dc-513d448b-aa451d89-d718cf96_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:41.568796Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:41.568819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:41.568822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:41.568824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:41.568834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896053202014760:4493]
2025-09-30T14:55:41.568840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896053202014760:4493]
2025-09-30T14:55:41.568845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896053202014760:4493]
2025-09-30T14:55:41.568886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:41.568893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.568896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:41.568908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:41.568916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:41.568921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:41.569043Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:41.575912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1955 sessionId: src_id|982a8dc-513d448b-aa451d89-d718cf96_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:41.578747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:41.613799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896053291784649:6314]
2025-09-30T14:55:41.614178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1954, pipe: [1:7555896053291784649:6314]
2025-09-30T14:55:41.695883Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:41.696540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:41.696564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:41.696604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896053291784649:6314], now have 1 active actors on pipe
2025-09-30T14:55:41.696811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:41.696824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:41.696851Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:41.696889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1955 reason: error at write: Disconnected sessionId: src_id|982a8dc-513d448b-aa451d89-d718cf96_0
2025-09-30T14:55:41.697084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1955 sessionId: src_id|982a8dc-513d448b-aa451d89-d718cf96_0 is DEAD
2025-09-30T14:55:41.697210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|982a8dc-513d448b-aa451d89-d718cf96_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:41.697220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|982a8dc-513d448b-aa451d89-d718cf96_0] Write session will restart in 0.005819s
2025-09-30T14:55:41.697243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|982a8dc-513d448b-aa451d89-d718cf96_0] Write session: Do CDS request
2025-09-30T14:55:41.697248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|982a8dc-513d448b-aa451d89-d718cf96_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:41.697274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896053291784649:6314]
2025-09-30T14:55:41.697294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:41.703788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|982a8dc-513d448b-aa451d89-d718cf96_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:41.703832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:41.703848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1956
2025-09-30T14:55:41.704054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1956 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:41.704100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1956 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:41.704113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1956 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:41.704122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:41.704561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1956 sessionId:  describe result for acl check
2025-09-30T14:55:41.704590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:41.704592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:41.704594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:41.704599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896053291784682:5863] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:41.705141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896053291784682:5863] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:41.707855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896053291784682:5863] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:41.714545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896053291784682:5863] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:41.714561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896053291784682:5863] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:41.714565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896053291784682:5863] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:41.714573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1956 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:41.722991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:41.726784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:41.727005Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:41.727020Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:41.727030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:41.727083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:41.727129Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896053202015104:4487]
2025-09-30T14:55:41.727825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:41.728187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:41.728235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:41.728569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:41.728628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:41.728634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:41.728635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:41.728636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:41.728638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:41.728639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:41.728641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:41.728642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:41.728644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:41.728645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:41.728647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.728648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.728649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.728650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:41.728651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:41.728656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:41.728667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:41.728672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:41.728676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:41.728680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:41.728685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:41.728690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:41.728694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:41.728698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:41.728703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:41.728707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.728711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.728715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.728719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:41.728723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:41.728731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:41.728739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:41.728745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:41.728751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:41.728756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:41.728761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:41.728766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:41.728772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:41.728778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:41.728784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:41.728788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:41.728794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:41.728799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:41.728805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:41.728810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:41.728816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:41.728820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:41.728826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:41.728830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:41.728836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:41.728848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.728856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.728861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.728872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.728877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.728885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.728890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:41.728900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:41.728905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:41.728911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:41.728961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:41.734811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:41.736078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:41.736096Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:41.736099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:41.736104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:41.736110Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1955 [2:7555896053202015104:4487]
2025-09-30T14:55:41.736127Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:41.736144Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:41.736148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:41.736151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:41.736153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:41.736170Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:41.736181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:41.736188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:41.736244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.736259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.736261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.736265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:41.736267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:41.736333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:41.736341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.736352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.736367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.736388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:41.736410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896053291784816:5863], now have 1 active actors on pipe
2025-09-30T14:55:41.736414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896053291784666:2454], now have 1 active actors on pipe
2025-09-30T14:55:41.736420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896053202015099:4487]
2025-09-30T14:55:41.736427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896053202015099:4487]
2025-09-30T14:55:41.736429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896053202015099:4487]
2025-09-30T14:55:41.736442Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:41.736461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:41.736480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:41.736481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:41.736485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:41.736488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:41.736490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:41.736522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896053202015099:4487]
2025-09-30T14:55:41.736534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:41.736541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:41.736910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1955
2025-09-30T14:55:41.736952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1955
2025-09-30T14:55:41.737064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:41.737084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:41.737113Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8115724a-d0a4510e-638d443a-91f3515a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:41.737129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:41.737134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:41.737136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:41.737151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:41.737164Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:41.737184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:41.737904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:41.737916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:41.737934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:41.738115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1956 partition: 0 MaxSeqNo: 42 sessionId: src_id|8115724a-d0a4510e-638d443a-91f3515a_0
2025-09-30T14:55:41.738496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|982a8dc-513d448b-aa451d89-d718cf96_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8115724a-d0a4510e-638d443a-91f3515a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:41.741237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8115724a-d0a4510e-638d443a-91f3515a_0] Write session: try to update token
2025-09-30T14:55:41.741255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8115724a-d0a4510e-638d443a-91f3515a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:41.749450Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:41.749476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:41.749486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896053202015099:4487]
2025-09-30T14:55:41.749555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:41.749558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:41.749785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:41.749952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:41.750116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:41.750283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:41.750499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:41.750548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:41.756428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1956 sessionId: src_id|8115724a-d0a4510e-638d443a-91f3515a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:41.759153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:41.759659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:41.759687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:41.759740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:41.759832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:41.761282Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:41.761306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:41.761308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:41.761310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:41.761318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896053202015099:4487]
2025-09-30T14:55:41.761322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896053202015099:4487]
2025-09-30T14:55:41.761325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896053202015099:4487]
2025-09-30T14:55:41.761364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:41.761371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.761379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:41.761378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:41.761385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:41.761389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:41.761539Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:41.797132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896053291784986:6314]
2025-09-30T14:55:41.797573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1955, pipe: [1:7555896053291784986:6314]
2025-09-30T14:55:41.877482Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:41.885855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:41.885885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:41.886072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:41.886149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:41.886219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:41.886288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:41.886339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:41.886349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:41.886428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:41.886501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:41.886580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:41.886660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:41.886712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:41.886724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:41.886804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:41.886875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:41.886988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:41.887073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:41.887199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:41.887202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:41.887331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:41.887421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:41.887492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:41.887569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:41.887615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:41.887625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:41.887702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:41.887809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:41.887910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:41.887970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:41.890007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:41.890020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:41.890044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896053291784986:6314]
2025-09-30T14:55:41.890049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1956 reason: error at write: Disconnected sessionId: src_id|8115724a-d0a4510e-638d443a-91f3515a_0
2025-09-30T14:55:41.890071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:41.890249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1956 sessionId: src_id|8115724a-d0a4510e-638d443a-91f3515a_0 is DEAD
2025-09-30T14:55:41.890394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8115724a-d0a4510e-638d443a-91f3515a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:41.890407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8115724a-d0a4510e-638d443a-91f3515a_0] Write session will restart in 0.005895s
2025-09-30T14:55:41.890431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8115724a-d0a4510e-638d443a-91f3515a_0] Write session: Do CDS request
2025-09-30T14:55:41.890437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8115724a-d0a4510e-638d443a-91f3515a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:41.888019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:41.888031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:41.888098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:41.888150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:41.888206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:41.888261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:41.888303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:41.888309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:41.888383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:41.888440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:41.888499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:41.888558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:41.888667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:41.888670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:41.888737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:41.888792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:41.888852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:41.888915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:41.888998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:41.889000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:41.889070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:41.889126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:41.889185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:41.889245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:41.889357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:41.889359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:41.889432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:41.889491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:41.889566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:41.889623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:41.889682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:41.889684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:41.889751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896053291784986:6314], now have 1 active actors on pipe
2025-09-30T14:55:41.891001Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:41.897780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8115724a-d0a4510e-638d443a-91f3515a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:41.897822Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:41.897836Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1957
2025-09-30T14:55:41.898011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1957 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:41.898045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1957 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:41.898055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1957 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:41.898059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:41.898528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1957 sessionId:  describe result for acl check
2025-09-30T14:55:41.898570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:41.898576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:41.898578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:41.898584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896053291785008:5853] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:41.899109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896053291785008:5853] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:41.901378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896053291785008:5853] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:41.904587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896053291785008:5853] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:41.904602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896053291785008:5853] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:41.904604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896053291785008:5853] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:41.904612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1957 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:41.915884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:41.919007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:41.919365Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:41.919380Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:41.919393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:41.919454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:41.919499Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896053202015398:4466]
2025-09-30T14:55:41.920175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:41.920514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:41.920566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:41.920901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:41.920965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:41.920971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:41.920972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:41.920974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:41.920975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:41.920976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:41.920977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:41.920979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:41.920980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:41.920982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:41.920983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.920984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.920985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.920986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:41.920986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:41.920991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:41.921002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:41.921007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:41.921011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:41.921015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:41.921020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:41.921025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:41.921029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:41.921033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:41.921037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:41.921041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.921045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.921048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.921052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:41.921055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:41.921063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:41.921071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:41.921078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:41.921084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:41.921089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:41.921094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:41.921099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:41.921104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:41.921110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:41.921118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:41.921122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:41.921127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:41.921132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:41.921138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:41.921142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:41.921147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:41.921152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:41.921157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:41.921162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:41.921167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:41.921172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.921179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.921183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.921189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.921194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.921208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.921213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:41.921218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:41.921223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:41.921228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:41.921273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:41.926751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:41.928128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:41.928148Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:41.928151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:41.928154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:41.928160Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1956 [2:7555896053202015398:4466]
2025-09-30T14:55:41.928175Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:41.928191Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:41.928194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:41.928196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:41.928199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:41.928215Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:41.928221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:41.928227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:41.928286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.928296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.928299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.928302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:41.928305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:41.928380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:41.928389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.928402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:41.928416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:41.928433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:41.928456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896053291784990:2454], now have 1 active actors on pipe
2025-09-30T14:55:41.928467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896053291785090:5853], now have 1 active actors on pipe
2025-09-30T14:55:41.928474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896053202015393:4466]
2025-09-30T14:55:41.928477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896053202015393:4466]
2025-09-30T14:55:41.928479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896053202015393:4466]
2025-09-30T14:55:41.928495Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:41.928508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:41.928512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:41.928514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:41.928515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:41.928528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:41.928531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:41.928561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896053202015393:4466]
2025-09-30T14:55:41.928571Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:41.928572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:41.928600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:41.928612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:41.928648Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f0424f1-4cd7b18d-61f3155c-774ce2b6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:41.928661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:41.928665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:41.928667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:41.928677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:41.928686Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:41.928708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:41.928861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:41.928877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:41.928899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:41.929350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8115724a-d0a4510e-638d443a-91f3515a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6f0424f1-4cd7b18d-61f3155c-774ce2b6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:41.928534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1956
2025-09-30T14:55:41.928553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1956
2025-09-30T14:55:41.928988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1957 partition: 0 MaxSeqNo: 42 sessionId: src_id|6f0424f1-4cd7b18d-61f3155c-774ce2b6_0
2025-09-30T14:55:41.932135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f0424f1-4cd7b18d-61f3155c-774ce2b6_0] Write session: try to update token
2025-09-30T14:55:41.932153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f0424f1-4cd7b18d-61f3155c-774ce2b6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:41.941092Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:41.941123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:41.941125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:41.941127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:41.941139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896053202015393:4466]
2025-09-30T14:55:41.941145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896053202015393:4466]
2025-09-30T14:55:41.941149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896053202015393:4466]
2025-09-30T14:55:41.941188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:41.941195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:41.941196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:41.941198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:41.941214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:41.941218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:41.941329Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:41.949889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1957 sessionId: src_id|6f0424f1-4cd7b18d-61f3155c-774ce2b6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:41.952672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:41.990108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896053291785290:6314]
2025-09-30T14:55:41.990436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1956, pipe: [1:7555896053291785290:6314]
2025-09-30T14:55:42.062313Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:42.062890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:42.062908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:42.062931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896053291785290:6314], now have 1 active actors on pipe
2025-09-30T14:55:42.063141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:42.063155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:42.063161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:42.063173Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:42.063219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896053291785290:6314]
2025-09-30T14:55:42.063234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1957 reason: error at write: Disconnected sessionId: src_id|6f0424f1-4cd7b18d-61f3155c-774ce2b6_0
2025-09-30T14:55:42.063445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1957 sessionId: src_id|6f0424f1-4cd7b18d-61f3155c-774ce2b6_0 is DEAD
2025-09-30T14:55:42.063636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f0424f1-4cd7b18d-61f3155c-774ce2b6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:42.063644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f0424f1-4cd7b18d-61f3155c-774ce2b6_0] Write session will restart in 0.005053s
2025-09-30T14:55:42.063669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f0424f1-4cd7b18d-61f3155c-774ce2b6_0] Write session: Do CDS request
2025-09-30T14:55:42.063677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f0424f1-4cd7b18d-61f3155c-774ce2b6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:42.070923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f0424f1-4cd7b18d-61f3155c-774ce2b6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:42.070979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:42.070996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1958
2025-09-30T14:55:42.071144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1958 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:42.071182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1958 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:42.071193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1958 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:42.071198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:42.071615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1958 sessionId:  describe result for acl check
2025-09-30T14:55:42.071653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:42.071659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:42.071661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:42.071666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896057586752604:5849] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:42.072215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896057586752604:5849] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:42.076697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896057586752604:5849] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:42.084996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896057586752604:5849] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:42.085013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896057586752604:5849] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:42.085017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896057586752604:5849] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:42.085027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1958 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:42.089184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:42.092261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:42.092450Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:42.092463Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:42.092473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:42.092518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:42.092557Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896057496982987:4457]
2025-09-30T14:55:42.093215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:42.093551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:42.093627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:42.093991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:42.094069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:42.094075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:42.094076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:42.094078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:42.094079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:42.094080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:42.094082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:42.094083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:42.094084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:42.094085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:42.094086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.094088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.094089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.094090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:42.094091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:42.094098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:42.094110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:42.094114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:42.094119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:42.094123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:42.094127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:42.094132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:42.094136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:42.094139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:42.094144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:42.094148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.094152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.094156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.094160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:42.094165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:42.094173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:42.094181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:42.094187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:42.094202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:42.094212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:42.094217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:42.094222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:42.094227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:42.094233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:42.094238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:42.094243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:42.094248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:42.094253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:42.094259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:42.094264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:42.094270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:42.094275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:42.094280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:42.094284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:42.094289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:42.094297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.094303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.094308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.094313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.094318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.094323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.094328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:42.094334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:42.094339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:42.094344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:42.094399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:42.100059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:42.101065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:42.101083Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:42.101086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:42.101089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:42.101096Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1957 [2:7555896057496982987:4457]
2025-09-30T14:55:42.101113Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:42.101127Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:42.101131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:42.101133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:42.101136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:42.101154Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:42.101165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:42.101172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:42.101241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.101253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.101255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.101259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:42.101262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:42.101328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:42.101336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.101348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.101365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.101384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:42.101404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896057586752588:2454], now have 1 active actors on pipe
2025-09-30T14:55:42.101408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896057586752806:5849], now have 1 active actors on pipe
2025-09-30T14:55:42.101414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896057496982982:4457]
2025-09-30T14:55:42.101416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896057496982982:4457]
2025-09-30T14:55:42.101419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896057496982982:4457]
2025-09-30T14:55:42.101432Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:42.101444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:42.101446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:42.101449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:42.101451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:42.101458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:42.101462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:42.101497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896057496982982:4457]
2025-09-30T14:55:42.101490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1957
2025-09-30T14:55:42.101507Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:42.101492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1957
2025-09-30T14:55:42.101535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:42.101562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:42.101573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:42.101600Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77a5b5c8-7fed81cb-35a28389-72fa7613_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:42.101614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:42.101617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:42.101620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:42.101630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:42.101641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:42.101663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:42.101802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:42.101817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:42.101838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:42.101932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1958 partition: 0 MaxSeqNo: 42 sessionId: src_id|77a5b5c8-7fed81cb-35a28389-72fa7613_0
2025-09-30T14:55:42.102276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f0424f1-4cd7b18d-61f3155c-774ce2b6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|77a5b5c8-7fed81cb-35a28389-72fa7613_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:42.105070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77a5b5c8-7fed81cb-35a28389-72fa7613_0] Write session: try to update token
2025-09-30T14:55:42.105087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77a5b5c8-7fed81cb-35a28389-72fa7613_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:42.113902Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:42.113924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:42.113935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896057496982982:4457]
2025-09-30T14:55:42.113979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:42.113998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:42.114159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:42.114311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:42.114480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:42.114633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:42.114841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:42.114881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:42.121416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1958 sessionId: src_id|77a5b5c8-7fed81cb-35a28389-72fa7613_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:42.124473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:42.125216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:42.125245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:42.125264Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:42.125267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:42.125269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:42.125272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:42.125286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896057496982982:4457]
2025-09-30T14:55:42.125290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896057496982982:4457]
2025-09-30T14:55:42.125294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896057496982982:4457]
2025-09-30T14:55:42.125331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:42.125338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:42.125344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.125346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:42.125347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:42.125349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:42.125481Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:42.163106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896057586752895:6314]
2025-09-30T14:55:42.163438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1957, pipe: [1:7555896057586752895:6314]
2025-09-30T14:55:42.240125Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:42.240952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:42.240992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896057586752895:6314], now have 1 active actors on pipe
2025-09-30T14:55:42.241127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:42.241169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:42.241217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896057586752895:6314]
2025-09-30T14:55:42.241231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:42.241234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:42.241322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1958 reason: error at write: Disconnected sessionId: src_id|77a5b5c8-7fed81cb-35a28389-72fa7613_0
2025-09-30T14:55:42.241472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1958 sessionId: src_id|77a5b5c8-7fed81cb-35a28389-72fa7613_0 is DEAD
2025-09-30T14:55:42.241950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77a5b5c8-7fed81cb-35a28389-72fa7613_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:42.241963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77a5b5c8-7fed81cb-35a28389-72fa7613_0] Write session will restart in 0.009770s
2025-09-30T14:55:42.241998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77a5b5c8-7fed81cb-35a28389-72fa7613_0] Write session: Do CDS request
2025-09-30T14:55:42.242004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77a5b5c8-7fed81cb-35a28389-72fa7613_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:42.252819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77a5b5c8-7fed81cb-35a28389-72fa7613_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:42.252887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:42.252903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1959
2025-09-30T14:55:42.253068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1959 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:42.253103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1959 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:42.253108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1959 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:42.253112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:42.253537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1959 sessionId:  describe result for acl check
2025-09-30T14:55:42.253574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:42.253581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:42.253583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:42.253589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896057586752915:5843] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:42.254141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896057586752915:5843] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:42.256812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896057586752915:5843] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:42.260231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896057586752915:5843] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:42.260244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896057586752915:5843] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:42.260249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896057586752915:5843] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:42.260258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1959 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:42.271597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:42.275089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:42.275531Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:42.275536Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:42.275553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:42.275632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:42.275671Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896057496983281:4450]
2025-09-30T14:55:42.276323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:42.276746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:42.276818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:42.277165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:42.277251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:42.277258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:42.277259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:42.277260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:42.277261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:42.277263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:42.277264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:42.277265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:42.277266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:42.277268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:42.277269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.277270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.277272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.277273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:42.277274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:42.277280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:42.277289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:42.277293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:42.277297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:42.277300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:42.277304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:42.277307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:42.277311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:42.277315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:42.277319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:42.277323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.277326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.277330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.277334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:42.277337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:42.277346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:42.277355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:42.277361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:42.277367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:42.277372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:42.277378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:42.277382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:42.277388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:42.277393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:42.277399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:42.277404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:42.277409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:42.277414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:42.277419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:42.277425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:42.277430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:42.277435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:42.277440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:42.277444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:42.277449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:42.277458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.277464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.277468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.277473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.277478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.277482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.277489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:42.277501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:42.277507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:42.277531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:42.277578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:42.283359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:42.284700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:42.284707Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:42.284710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:42.284715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:42.284722Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1958 [2:7555896057496983281:4450]
2025-09-30T14:55:42.284738Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:42.284753Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:42.284757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:42.284760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:42.284763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:42.284779Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:42.284786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:42.284793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:42.284861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.284863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.284866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.284870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:42.285370Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1958
2025-09-30T14:55:42.285377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1958
2025-09-30T14:55:42.284872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:42.284957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:42.284960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.284976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.284992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.285014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:42.285034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896057496983276:4450]
2025-09-30T14:55:42.285036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896057496983276:4450]
2025-09-30T14:55:42.285039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896057496983276:4450]
2025-09-30T14:55:42.285048Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:42.285064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:42.285084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:42.285087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:42.285121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:42.285123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896057496983276:4450]
2025-09-30T14:55:42.285126Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:42.285126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:42.285128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:42.285135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:42.285155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896057586753007:5843], now have 1 active actors on pipe
2025-09-30T14:55:42.285159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896057586752900:2454], now have 1 active actors on pipe
2025-09-30T14:55:42.285467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:42.285472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:42.285495Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ff09f7a-e467a22-8c69f9f7-6f498a40_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:42.285503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:42.285506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:42.285509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:42.285537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:42.285549Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:42.285568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:42.288001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:42.288026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:42.288055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:42.288265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1959 partition: 0 MaxSeqNo: 42 sessionId: src_id|2ff09f7a-e467a22-8c69f9f7-6f498a40_0
2025-09-30T14:55:42.290546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77a5b5c8-7fed81cb-35a28389-72fa7613_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2ff09f7a-e467a22-8c69f9f7-6f498a40_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:42.293289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ff09f7a-e467a22-8c69f9f7-6f498a40_0] Write session: try to update token
2025-09-30T14:55:42.293310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ff09f7a-e467a22-8c69f9f7-6f498a40_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:42.298647Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:42.298676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:42.298686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896057496983276:4450]
2025-09-30T14:55:42.298731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:42.298743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:42.298948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:42.299096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:42.299239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:42.299411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:42.299643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:42.299679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:42.309064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1959 sessionId: src_id|2ff09f7a-e467a22-8c69f9f7-6f498a40_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:42.312021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:42.312189Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:42.312211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:42.312214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:42.312216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:42.312226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896057496983276:4450]
2025-09-30T14:55:42.312230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896057496983276:4450]
2025-09-30T14:55:42.312234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896057496983276:4450]
2025-09-30T14:55:42.312276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:42.312281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:42.312287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:42.312290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:42.312291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:42.312309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:42.312321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.312324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:42.312461Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:42.339772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896057586753204:6314]
2025-09-30T14:55:42.340119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1958, pipe: [1:7555896057586753204:6314]
2025-09-30T14:55:42.423636Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:11802 } ]
2025-09-30T14:55:42.430157Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:42.430685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896057586753204:6314], now have 1 active actors on pipe
2025-09-30T14:55:42.430929Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:42.430956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:42.430956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896057586753204:6314]
2025-09-30T14:55:42.430971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:42.430989Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:42.431063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1959 reason: error at write: Disconnected sessionId: src_id|2ff09f7a-e467a22-8c69f9f7-6f498a40_0
2025-09-30T14:55:42.431237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1959 sessionId: src_id|2ff09f7a-e467a22-8c69f9f7-6f498a40_0 is DEAD
2025-09-30T14:55:42.431502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ff09f7a-e467a22-8c69f9f7-6f498a40_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:42.431520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ff09f7a-e467a22-8c69f9f7-6f498a40_0] Write session will restart in 0.005768s
2025-09-30T14:55:42.431568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ff09f7a-e467a22-8c69f9f7-6f498a40_0] Write session: Do CDS request
2025-09-30T14:55:42.431575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ff09f7a-e467a22-8c69f9f7-6f498a40_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:42.438830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ff09f7a-e467a22-8c69f9f7-6f498a40_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:42.438958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:42.438973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1960
2025-09-30T14:55:42.439074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1960 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:42.439106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1960 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:42.439113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1960 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:42.439126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:42.439626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1960 sessionId:  describe result for acl check
2025-09-30T14:55:42.439665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:42.439673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:42.439675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:42.439681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896057586753225:5835] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:42.440280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896057586753225:5835] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:42.443472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896057586753225:5835] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:42.447410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896057586753225:5835] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:42.447438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896057586753225:5835] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:42.447444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896057586753225:5835] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:42.447454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1960 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:42.453955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:42.457189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:42.457388Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:42.457399Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:42.457410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:42.457456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:42.457496Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896057496983579:4445]
2025-09-30T14:55:42.458183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:42.458499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:42.458541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:42.458864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:42.458919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:42.458926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:42.458927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:42.458928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:42.458929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:42.458931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:42.458932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:42.458933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:42.458935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:42.458936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:42.458937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.458938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.458939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.458940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:42.458942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:42.458947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:42.458957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:42.458960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:42.458964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:42.458968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:42.458972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:42.458976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:42.458980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:42.458984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:42.458988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:42.458991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.458995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.458999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.459003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:42.459007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:42.459015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:42.459022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:42.459028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:42.459033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:42.459037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:42.459042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:42.459046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:42.459051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:42.459055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:42.459060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:42.459064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:42.459070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:42.459075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:42.459080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:42.459085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:42.459090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:42.459094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:42.459103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:42.459106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:42.459111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:42.459115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.459120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.459125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.459129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.459135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.459141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.459145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:42.459151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:42.459155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:42.459161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:42.459201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:42.465010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:42.466071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:42.466089Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:42.466091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:42.466096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:42.466103Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1959 [2:7555896057496983579:4445]
2025-09-30T14:55:42.466118Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:42.466135Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:42.466138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:42.466141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:42.466143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:42.466159Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:42.466171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:42.466177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:42.466238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.466248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.466251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.466254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:42.466256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:42.466322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:42.466329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.466340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.466355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.466374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:42.466392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896057586753206:2454], now have 1 active actors on pipe
2025-09-30T14:55:42.466402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896057586753356:5835], now have 1 active actors on pipe
2025-09-30T14:55:42.466411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896057496983574:4445]
2025-09-30T14:55:42.466414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896057496983574:4445]
2025-09-30T14:55:42.466416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896057496983574:4445]
2025-09-30T14:55:42.466431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:42.466450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:42.466453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:42.466457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:42.466459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:42.466468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:42.466472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:42.466505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896057496983574:4445]
2025-09-30T14:55:42.466514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:42.466520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:42.466490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1959
2025-09-30T14:55:42.466501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1959
2025-09-30T14:55:42.466549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:42.466560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:42.466988Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2aad4e5d-40ece77a-cd8148e7-71907b5b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:42.467007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:42.467011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:42.467013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:42.467023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:42.467035Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:42.467066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:42.467263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:42.467275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:42.467293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:42.467377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1960 partition: 0 MaxSeqNo: 42 sessionId: src_id|2aad4e5d-40ece77a-cd8148e7-71907b5b_0
2025-09-30T14:55:42.467766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ff09f7a-e467a22-8c69f9f7-6f498a40_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2aad4e5d-40ece77a-cd8148e7-71907b5b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:42.470595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2aad4e5d-40ece77a-cd8148e7-71907b5b_0] Write session: try to update token
2025-09-30T14:55:42.470618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2aad4e5d-40ece77a-cd8148e7-71907b5b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:42.478980Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:42.479006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:42.479009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:42.479011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:42.479022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896057496983574:4445]
2025-09-30T14:55:42.479027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896057496983574:4445]
2025-09-30T14:55:42.479031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896057496983574:4445]
2025-09-30T14:55:42.479069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:42.479079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.479082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:42.479082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:42.479089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:42.479094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:42.479227Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:42.486125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1960 sessionId: src_id|2aad4e5d-40ece77a-cd8148e7-71907b5b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:42.488868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:42.531295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896057586753510:6314]
2025-09-30T14:55:42.531627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1959, pipe: [1:7555896057586753510:6314]
2025-09-30T14:55:42.594684Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:42.595088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:42.595113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:42.595164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896057586753510:6314], now have 1 active actors on pipe
2025-09-30T14:55:42.595456Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:42.595467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:42.595521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896057586753510:6314]
2025-09-30T14:55:42.595948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aad4e5d-40ece77a-cd8148e7-71907b5b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:42.595957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aad4e5d-40ece77a-cd8148e7-71907b5b_0] Write session will restart in 0.007049s
2025-09-30T14:55:42.595993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aad4e5d-40ece77a-cd8148e7-71907b5b_0] Write session: Do CDS request
2025-09-30T14:55:42.595999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aad4e5d-40ece77a-cd8148e7-71907b5b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:42.595557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:42.595563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:42.595624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1960 reason: error at write: Disconnected sessionId: src_id|2aad4e5d-40ece77a-cd8148e7-71907b5b_0
2025-09-30T14:55:42.595813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1960 sessionId: src_id|2aad4e5d-40ece77a-cd8148e7-71907b5b_0 is DEAD
2025-09-30T14:55:42.603828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2aad4e5d-40ece77a-cd8148e7-71907b5b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:42.603905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:42.603921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1961
2025-09-30T14:55:42.604088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1961 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:42.604133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1961 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:42.604139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1961 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:42.604144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:42.604660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1961 sessionId:  describe result for acl check
2025-09-30T14:55:42.604703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:42.604710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:42.604713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:42.604719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896057586753526:5831] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:42.605324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896057586753526:5831] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:42.607902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896057586753526:5831] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:42.619680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896057586753526:5831] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:42.619697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896057586753526:5831] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:42.619701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896057586753526:5831] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:42.619716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1961 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:42.624447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:42.627810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:42.628081Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:42.628094Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:42.628106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:42.628167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:42.628211Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896057496983875:4439]
2025-09-30T14:55:42.628881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:42.629254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:42.629324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:42.629712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:42.629798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:42.629806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:42.629807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:42.629808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:42.629809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:42.629810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:42.629812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:42.629813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:42.629814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:42.629815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:42.629817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.629818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.629820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.629821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:42.629822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:42.629828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:42.629839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:42.629843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:42.629848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:42.629852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:42.629856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:42.629860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:42.629864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:42.629868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:42.629872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:42.629877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.629880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.629884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.629888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:42.629892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:42.629900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:42.629908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:42.629914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:42.629919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:42.629924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:42.629930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:42.629934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:42.629940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:42.629947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:42.629952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:42.629957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:42.629962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:42.629970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:42.629975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:42.629979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:42.629985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:42.629990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:42.629996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:42.630000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:42.630005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:42.630010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.630017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.630022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.630027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.630032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.630049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.630060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:42.630065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:42.630070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:42.630080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:42.630119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:42.635946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:42.637127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:42.637148Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:42.637151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:42.637154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:42.637161Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1960 [2:7555896057496983875:4439]
2025-09-30T14:55:42.637177Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:42.637194Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:42.637197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:42.637201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:42.637203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:42.637220Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:42.637227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:42.637234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:42.637299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.637309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.637311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.637315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:42.637318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:42.637390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:42.637398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.637412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.637430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.637452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:42.637473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896057496983870:4439]
2025-09-30T14:55:42.637482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896057496983870:4439]
2025-09-30T14:55:42.637485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896057496983870:4439]
2025-09-30T14:55:42.637502Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:42.637537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:42.637558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:42.637561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:42.637572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:42.637587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:42.637590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:42.637602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896057496983870:4439]
2025-09-30T14:55:42.637612Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:42.637632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:42.637644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896057586753511:2454], now have 1 active actors on pipe
2025-09-30T14:55:42.637648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896057586753759:5831], now have 1 active actors on pipe
2025-09-30T14:55:42.637922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:42.637935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:42.637962Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|277f3eae-5020c63b-32025bf8-1f0dcbb5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:42.637971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:42.637975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:42.637977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:42.637989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:42.638000Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:42.638015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:42.638291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:42.638303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:42.638323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:42.638863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aad4e5d-40ece77a-cd8148e7-71907b5b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|277f3eae-5020c63b-32025bf8-1f0dcbb5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:42.637772Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1960
2025-09-30T14:55:42.637789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1960
2025-09-30T14:55:42.638428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1961 partition: 0 MaxSeqNo: 42 sessionId: src_id|277f3eae-5020c63b-32025bf8-1f0dcbb5_0
2025-09-30T14:55:42.641816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|277f3eae-5020c63b-32025bf8-1f0dcbb5_0] Write session: try to update token
2025-09-30T14:55:42.641835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|277f3eae-5020c63b-32025bf8-1f0dcbb5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:42.650917Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:42.650940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:42.650954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896057496983870:4439]
2025-09-30T14:55:42.651001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:42.651012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:42.651235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:42.651415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:42.651569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:42.651713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:42.651913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:42.651950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:42.661425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1961 sessionId: src_id|277f3eae-5020c63b-32025bf8-1f0dcbb5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:42.663234Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:42.663282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:42.663284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:42.663287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:42.663297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896057496983870:4439]
2025-09-30T14:55:42.663302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896057496983870:4439]
2025-09-30T14:55:42.663306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896057496983870:4439]
2025-09-30T14:55:42.663351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:42.663361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:42.663363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.663367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:42.663369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:42.663373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:42.663526Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:42.664239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:42.695649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896057586753818:6314]
2025-09-30T14:55:42.695963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1960, pipe: [1:7555896057586753818:6314]
2025-09-30T14:55:42.778706Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:42.779178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:42.779196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:42.779219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896057586753818:6314], now have 1 active actors on pipe
2025-09-30T14:55:42.779491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896057586753818:6314]
2025-09-30T14:55:42.779534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:42.779619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1961 reason: status is not ok: tablet will be restarted right now sessionId: src_id|277f3eae-5020c63b-32025bf8-1f0dcbb5_0
2025-09-30T14:55:42.779816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1961 sessionId: src_id|277f3eae-5020c63b-32025bf8-1f0dcbb5_0 is DEAD
2025-09-30T14:55:42.779887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:42.779987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|277f3eae-5020c63b-32025bf8-1f0dcbb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:42.779999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|277f3eae-5020c63b-32025bf8-1f0dcbb5_0] Write session will restart in 0.005874s
2025-09-30T14:55:42.780023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|277f3eae-5020c63b-32025bf8-1f0dcbb5_0] Write session: Do CDS request
2025-09-30T14:55:42.780029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|277f3eae-5020c63b-32025bf8-1f0dcbb5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:42.779456Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:42.786805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|277f3eae-5020c63b-32025bf8-1f0dcbb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:42.786883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:42.786898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1962
2025-09-30T14:55:42.787072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1962 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:42.787107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1962 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:42.787113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1962 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:42.787117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:42.787581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1962 sessionId:  describe result for acl check
2025-09-30T14:55:42.787634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:42.787642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:42.787644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:42.787650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896057586753859:5816] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:42.788595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896057586753859:5816] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:42.793416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896057586753859:5816] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:42.798487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896057586753859:5816] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:42.798506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896057586753859:5816] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:42.798510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896057586753859:5816] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:42.798519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1962 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:42.804881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:42.808826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:42.809087Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:42.809101Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:42.809113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:42.809178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:42.809222Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896057496984220:4421]
2025-09-30T14:55:42.809920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:42.810302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:42.810351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:42.810679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:42.810753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:42.810760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:42.810762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:42.810763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:42.810764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:42.810766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:42.810767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:42.810769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:42.810770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:42.810771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:42.810772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.810773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.810775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.810776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:42.810778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:42.810783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:42.810794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:42.810798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:42.810802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:42.810806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:42.810810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:42.810814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:42.810818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:42.810821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:42.810827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:42.810831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.810836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.810840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.810845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:42.810849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:42.810859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:42.810868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:42.810874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:42.810879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:42.810883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:42.810888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:42.810892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:42.810897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:42.810902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:42.810906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:42.810911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:42.810916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:42.810921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:42.810928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:42.810932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:42.810939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:42.810943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:42.810948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:42.810951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:42.810956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:42.810962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.810966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.810971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.810976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.810981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.810987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.810992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:42.810997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:42.811002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:42.811007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:42.811053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:42.816960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:42.818276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:42.818295Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:42.818299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:42.818303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:42.818311Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1961 [2:7555896057496984220:4421]
2025-09-30T14:55:42.818328Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:42.818345Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:42.818349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:42.818352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:42.818354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:42.818371Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:42.818377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:42.818385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:42.818453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.818455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.818457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.818461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:42.818463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:42.818534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:42.818547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.818560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.818571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.818586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:42.818611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896057586754028:5816], now have 1 active actors on pipe
2025-09-30T14:55:42.818619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896057586753844:2454], now have 1 active actors on pipe
2025-09-30T14:55:42.818626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896057496984215:4421]
2025-09-30T14:55:42.818628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896057496984215:4421]
2025-09-30T14:55:42.818630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896057496984215:4421]
2025-09-30T14:55:42.818643Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:42.818712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1961
2025-09-30T14:55:42.818715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1961
2025-09-30T14:55:42.818657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:42.818666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:42.818670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:42.818672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:42.818675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:42.818678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:42.818713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896057496984215:4421]
2025-09-30T14:55:42.818723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:42.818761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:42.818763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:42.818765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:42.818791Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93d48afa-38d7dc99-46cbd061-8748c306_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:42.818797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:42.818801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:42.818803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:42.818813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:42.818822Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:42.818836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:42.819001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:42.819017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:42.819041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:42.819147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1962 partition: 0 MaxSeqNo: 42 sessionId: src_id|93d48afa-38d7dc99-46cbd061-8748c306_0
2025-09-30T14:55:42.819541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|277f3eae-5020c63b-32025bf8-1f0dcbb5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|93d48afa-38d7dc99-46cbd061-8748c306_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:42.822510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93d48afa-38d7dc99-46cbd061-8748c306_0] Write session: try to update token
2025-09-30T14:55:42.822537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93d48afa-38d7dc99-46cbd061-8748c306_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:42.831911Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:42.831941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:42.831944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:42.831946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:42.831957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896057496984215:4421]
2025-09-30T14:55:42.831961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896057496984215:4421]
2025-09-30T14:55:42.831966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896057496984215:4421]
2025-09-30T14:55:42.832014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:42.832022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.832024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:42.832036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:42.832043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:42.832047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:42.832177Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:42.839453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1962 sessionId: src_id|93d48afa-38d7dc99-46cbd061-8748c306_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:42.842429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:42.879462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896057586754159:6314]
2025-09-30T14:55:42.879809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1961, pipe: [1:7555896057586754159:6314]
2025-09-30T14:55:42.951825Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:42.952441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:42.952451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:42.952472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896057586754159:6314], now have 1 active actors on pipe
2025-09-30T14:55:42.953045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896057586754159:6314]
2025-09-30T14:55:42.953085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:42.952723Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:42.953166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1962 reason: status is not ok: tablet will be restarted right now sessionId: src_id|93d48afa-38d7dc99-46cbd061-8748c306_0
2025-09-30T14:55:42.953428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1962 sessionId: src_id|93d48afa-38d7dc99-46cbd061-8748c306_0 is DEAD
2025-09-30T14:55:42.953463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:42.953589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93d48afa-38d7dc99-46cbd061-8748c306_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:42.953600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93d48afa-38d7dc99-46cbd061-8748c306_0] Write session will restart in 0.009596s
2025-09-30T14:55:42.953625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93d48afa-38d7dc99-46cbd061-8748c306_0] Write session: Do CDS request
2025-09-30T14:55:42.953632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93d48afa-38d7dc99-46cbd061-8748c306_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:42.964907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93d48afa-38d7dc99-46cbd061-8748c306_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:42.964999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:42.965030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1963
2025-09-30T14:55:42.965176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1963 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:42.965220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1963 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:42.965230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1963 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:42.965235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:42.965702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1963 sessionId:  describe result for acl check
2025-09-30T14:55:42.965741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:42.965747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:42.965749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:42.965755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896057586754188:5808] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:42.966334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896057586754188:5808] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:42.969537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896057586754188:5808] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:42.979305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896057586754188:5808] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:42.979324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896057586754188:5808] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:42.979330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896057586754188:5808] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:42.979340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1963 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:42.983983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:42.987827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:42.988058Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:42.988069Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:42.988081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:42.988135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:42.988181Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896057496984520:4413]
2025-09-30T14:55:42.988939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:42.989385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:42.989486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:42.990228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:42.990349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:42.990351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:42.990352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:42.990353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:42.990354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:42.990356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:42.990357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:42.990358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:42.990360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:42.990361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:42.990363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.990364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.990366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.990367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:42.990368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:42.990376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:42.990386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:42.990389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:42.990393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:42.990397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:42.990402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:42.990408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:42.990412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:42.990419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:42.990425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:42.990430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.990436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.990441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.990447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:42.990451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:42.990465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:42.990478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:42.990488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:42.990496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:42.990504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:42.990512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:42.990519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:42.990528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:42.990568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:42.990576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:42.990584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:42.990592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:42.990601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:42.990609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:42.990620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:42.990627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:42.990636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:42.990644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:42.990651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:42.990659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:42.990669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.990677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.990684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.990693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.990701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.990708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.990714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:42.990721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:42.990730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:42.990737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:42.990801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:42.997075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:42.998076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:42.998099Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:42.998103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:42.998108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:42.998115Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1962 [2:7555896057496984520:4413]
2025-09-30T14:55:42.998134Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:42.998152Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:42.998161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:42.998165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:42.998169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:42.998187Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:42.998201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:42.998212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:42.998754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.998771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.998774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.998778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:42.998782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:42.998867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:42.998877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:42.998892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:42.998908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:42.998935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:42.998957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896057496984515:4413]
2025-09-30T14:55:42.998967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896057496984515:4413]
2025-09-30T14:55:42.998969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896057496984515:4413]
2025-09-30T14:55:42.998980Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:42.998988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:42.998992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:42.998994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:42.998998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:42.999013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:42.999015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:42.999027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896057586754161:2454], now have 1 active actors on pipe
2025-09-30T14:55:42.999031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896057586754438:5808], now have 1 active actors on pipe
2025-09-30T14:55:42.999068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896057496984515:4413]
2025-09-30T14:55:42.999081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:42.999140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1962
2025-09-30T14:55:42.999186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1962
2025-09-30T14:55:42.999120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:42.999338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:42.999353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:42.999379Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af6ef58b-b400b834-c5b494a6-2f8c2cc1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:42.999387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:42.999391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:42.999394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:42.999404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:42.999416Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:42.999431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:42.999675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:42.999690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:42.999708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:42.999789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1963 partition: 0 MaxSeqNo: 42 sessionId: src_id|af6ef58b-b400b834-c5b494a6-2f8c2cc1_0
2025-09-30T14:55:43.000205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93d48afa-38d7dc99-46cbd061-8748c306_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|af6ef58b-b400b834-c5b494a6-2f8c2cc1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:43.003192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af6ef58b-b400b834-c5b494a6-2f8c2cc1_0] Write session: try to update token
2025-09-30T14:55:43.003214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af6ef58b-b400b834-c5b494a6-2f8c2cc1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:43.012683Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:43.012713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:43.012717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:43.012719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:43.012729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896057496984515:4413]
2025-09-30T14:55:43.012734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896057496984515:4413]
2025-09-30T14:55:43.012738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896057496984515:4413]
2025-09-30T14:55:43.012783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:43.012790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.012800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:43.012950Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:43.014500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:43.014522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:43.014531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:43.029132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1963 sessionId: src_id|af6ef58b-b400b834-c5b494a6-2f8c2cc1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:43.032031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:43.050535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896061881721763:6314]
2025-09-30T14:55:43.050849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1962, pipe: [1:7555896061881721763:6314]
2025-09-30T14:55:43.138909Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:43.139537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:43.139567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:43.139591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896061881721763:6314], now have 1 active actors on pipe
2025-09-30T14:55:43.139875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896061881721763:6314]
2025-09-30T14:55:43.139904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:43.139906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:43.140007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1963 reason: status is not ok: tablet will be restarted right now sessionId: src_id|af6ef58b-b400b834-c5b494a6-2f8c2cc1_0
2025-09-30T14:55:43.140202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1963 sessionId: src_id|af6ef58b-b400b834-c5b494a6-2f8c2cc1_0 is DEAD
2025-09-30T14:55:43.139811Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:43.140317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af6ef58b-b400b834-c5b494a6-2f8c2cc1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:43.140328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af6ef58b-b400b834-c5b494a6-2f8c2cc1_0] Write session will restart in 0.008737s
2025-09-30T14:55:43.140353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af6ef58b-b400b834-c5b494a6-2f8c2cc1_0] Write session: Do CDS request
2025-09-30T14:55:43.140359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af6ef58b-b400b834-c5b494a6-2f8c2cc1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:43.150832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af6ef58b-b400b834-c5b494a6-2f8c2cc1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:43.150896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:43.150911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1964
2025-09-30T14:55:43.151065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1964 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:43.151103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1964 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:43.151109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1964 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:43.151115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:43.151601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1964 sessionId:  describe result for acl check
2025-09-30T14:55:43.151645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:43.151652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:43.151654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:43.151661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896061881721806:5799] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:43.152258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896061881721806:5799] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:43.155344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896061881721806:5799] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:43.159838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896061881721806:5799] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:43.159854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896061881721806:5799] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:43.159858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896061881721806:5799] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:43.159868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1964 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:43.164892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:43.171030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:43.171359Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:43.171374Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:43.171389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:43.171458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:43.171508Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896061791952115:4411]
2025-09-30T14:55:43.172169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:43.172513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:43.172574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:43.172872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:43.172930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:43.172935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:43.172936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:43.172937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:43.172938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:43.172939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:43.172940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:43.172941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:43.172942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:43.172943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:43.172944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.172945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:43.172946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:43.172947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:43.172947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:43.172951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:43.172959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:43.172962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:43.172964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:43.172967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:43.172970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:43.172973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:43.172975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:43.172977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:43.173003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:43.173006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.173008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:43.173011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:43.173013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:43.173016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:43.173028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:43.173033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:43.173038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:43.173042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:43.173049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:43.173052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:43.173055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:43.173059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:43.173062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:43.173065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:43.173068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:43.173072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:43.173075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:43.173078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:43.173082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:43.173086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:43.173089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:43.173094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:43.173099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:43.173104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:43.173109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.173114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.173119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:43.173125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:43.173130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:43.173135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:43.173147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:43.173152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:43.173157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:43.173161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:43.173204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:43.179229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:43.180831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:43.180856Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:43.180859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:43.180864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:43.180872Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1963 [2:7555896061791952115:4411]
2025-09-30T14:55:43.180891Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:43.180910Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:43.180919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:43.180923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:43.180925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:43.180944Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:43.180958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:43.180973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:43.181038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.181047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:43.181049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:43.181052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:43.181054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:43.181135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:43.181147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.181164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:43.181175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:43.181191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:43.181212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896061881721770:2454], now have 1 active actors on pipe
2025-09-30T14:55:43.181264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896061881721989:5799], now have 1 active actors on pipe
2025-09-30T14:55:43.181275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896061791952110:4411]
2025-09-30T14:55:43.181277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896061791952110:4411]
2025-09-30T14:55:43.181279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896061791952110:4411]
2025-09-30T14:55:43.181295Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:43.181314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:43.181336Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1963
2025-09-30T14:55:43.181336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1963
2025-09-30T14:55:43.181336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:43.181343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:43.181352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:43.181355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:43.181357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:43.181384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896061791952110:4411]
2025-09-30T14:55:43.181388Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:43.181399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:43.181409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:43.181414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:43.181474Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2fc31c81-b2e16b8f-fa46aa97-7726e50b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:43.181486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:43.181489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:43.181492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:43.181502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:43.181533Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:43.181562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:43.181715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:43.181725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:43.181742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:43.181904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1964 partition: 0 MaxSeqNo: 42 sessionId: src_id|2fc31c81-b2e16b8f-fa46aa97-7726e50b_0
2025-09-30T14:55:43.182436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af6ef58b-b400b834-c5b494a6-2f8c2cc1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2fc31c81-b2e16b8f-fa46aa97-7726e50b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:43.185231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fc31c81-b2e16b8f-fa46aa97-7726e50b_0] Write session: try to update token
2025-09-30T14:55:43.185249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fc31c81-b2e16b8f-fa46aa97-7726e50b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:43.194192Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:43.194216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:43.194218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:43.194221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:43.194231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896061791952110:4411]
2025-09-30T14:55:43.194237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896061791952110:4411]
2025-09-30T14:55:43.194241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896061791952110:4411]
2025-09-30T14:55:43.194283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:43.194291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.194294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:43.194298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:43.194304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:43.194309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:43.194425Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:43.201567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1964 sessionId: src_id|2fc31c81-b2e16b8f-fa46aa97-7726e50b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:43.204421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:43.239893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896061881722084:6314]
2025-09-30T14:55:43.240240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1963, pipe: [1:7555896061881722084:6314]
2025-09-30T14:55:43.306783Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:43.307089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:43.307108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:43.307152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896061881722084:6314], now have 1 active actors on pipe
2025-09-30T14:55:43.307390Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:43.308306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fc31c81-b2e16b8f-fa46aa97-7726e50b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:43.308317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fc31c81-b2e16b8f-fa46aa97-7726e50b_0] Write session will restart in 0.006332s
2025-09-30T14:55:43.308340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fc31c81-b2e16b8f-fa46aa97-7726e50b_0] Write session: Do CDS request
2025-09-30T14:55:43.308346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fc31c81-b2e16b8f-fa46aa97-7726e50b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:43.307808Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:43.307861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:43.307960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1964 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2fc31c81-b2e16b8f-fa46aa97-7726e50b_0
2025-09-30T14:55:43.308143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1964 sessionId: src_id|2fc31c81-b2e16b8f-fa46aa97-7726e50b_0 is DEAD
2025-09-30T14:55:43.308350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896061881722084:6314]
2025-09-30T14:55:43.315763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fc31c81-b2e16b8f-fa46aa97-7726e50b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:43.315887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:43.315906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1965
2025-09-30T14:55:43.316050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1965 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:43.316081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1965 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:43.316091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1965 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:43.316095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:43.316531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1965 sessionId:  describe result for acl check
2025-09-30T14:55:43.316565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:43.316571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:43.316573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:43.316580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896061881722103:5793] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:43.317163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896061881722103:5793] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:43.320150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896061881722103:5793] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:43.324441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896061881722103:5793] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:43.324456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896061881722103:5793] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:43.324460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896061881722103:5793] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:43.324477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1965 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:43.331370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:43.335079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:43.335345Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:43.335356Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:43.335368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:43.335432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:43.335475Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896061791952415:4407]
2025-09-30T14:55:43.336152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:43.339599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:43.339677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:43.340067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:43.340144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:43.340150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:43.340152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:43.340153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:43.340155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:43.340156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:43.340158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:43.340159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:43.340161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:43.340162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:43.340163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.340165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:43.340166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:43.340167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:43.340169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:43.340176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:43.340186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:43.340191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:43.340195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:43.340200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:43.340205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:43.340209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:43.340214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:43.340218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:43.340223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:43.340227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.340231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:43.340235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:43.340240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:43.340244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:43.340253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:43.340262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:43.340269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:43.340275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:43.340281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:43.340287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:43.340293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:43.340299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:43.340305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:43.340310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:43.340320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:43.340324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:43.340329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:43.340334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:43.340344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:43.340351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:43.340361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:43.340366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:43.340376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:43.340380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:43.340385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.340390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.340400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:43.340405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:43.340415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:43.340420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:43.340427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:43.340437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:43.340441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:43.340446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:43.340493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:43.345966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:43.347004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:43.347010Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:43.347013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:43.347016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:43.347022Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1964 [2:7555896061791952415:4407]
2025-09-30T14:55:43.347042Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:43.347054Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:43.347457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1964
2025-09-30T14:55:43.347497Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1964
2025-09-30T14:55:43.347056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:43.347058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:43.347060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:43.347073Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:43.347078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:43.347083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:43.347134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.347136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:43.347137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:43.347139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:43.347141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:43.347206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:43.347209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.347223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:43.347230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:43.347241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:43.347284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896061791952410:4407]
2025-09-30T14:55:43.347286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896061791952410:4407]
2025-09-30T14:55:43.347288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896061791952410:4407]
2025-09-30T14:55:43.347297Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:43.347311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896061881722251:5793], now have 1 active actors on pipe
2025-09-30T14:55:43.347310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:43.347314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896061881722085:2454], now have 1 active actors on pipe
2025-09-30T14:55:43.347315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:43.347318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:43.347322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:43.347336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:43.347339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:43.347371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896061791952410:4407]
2025-09-30T14:55:43.347381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:43.347545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:43.347644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:43.347655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:43.347676Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84078896-7baac93-afbf57ea-7263c8ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:43.347682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:43.347685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:43.347687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:43.347696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:43.347703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:43.347715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:43.348110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:43.348117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:43.348128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:43.348238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1965 partition: 0 MaxSeqNo: 42 sessionId: src_id|84078896-7baac93-afbf57ea-7263c8ec_0
2025-09-30T14:55:43.350542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fc31c81-b2e16b8f-fa46aa97-7726e50b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|84078896-7baac93-afbf57ea-7263c8ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:43.353219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84078896-7baac93-afbf57ea-7263c8ec_0] Write session: try to update token
2025-09-30T14:55:43.353240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84078896-7baac93-afbf57ea-7263c8ec_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:43.361976Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:43.362004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:43.362008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:43.362010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:43.362020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896061791952410:4407]
2025-09-30T14:55:43.362026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896061791952410:4407]
2025-09-30T14:55:43.362030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896061791952410:4407]
2025-09-30T14:55:43.362073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:43.362087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.362087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:43.362092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:43.362094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:43.362098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:43.362264Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:43.368686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1965 sessionId: src_id|84078896-7baac93-afbf57ea-7263c8ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:43.371560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:43.408341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896061881722394:6314]
2025-09-30T14:55:43.408611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1964, pipe: [1:7555896061881722394:6314]
2025-09-30T14:55:43.476724Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:43.477005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:43.477014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:43.477049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896061881722394:6314], now have 1 active actors on pipe
2025-09-30T14:55:43.477317Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:43.477299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896061881722394:6314]
2025-09-30T14:55:43.477308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:43.477313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:43.477346Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:43.477399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1965 reason: error at write: Disconnected sessionId: src_id|84078896-7baac93-afbf57ea-7263c8ec_0
2025-09-30T14:55:43.477599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1965 sessionId: src_id|84078896-7baac93-afbf57ea-7263c8ec_0 is DEAD
2025-09-30T14:55:43.477737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84078896-7baac93-afbf57ea-7263c8ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:43.477748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84078896-7baac93-afbf57ea-7263c8ec_0] Write session will restart in 0.008184s
2025-09-30T14:55:43.477769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84078896-7baac93-afbf57ea-7263c8ec_0] Write session: Do CDS request
2025-09-30T14:55:43.477778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84078896-7baac93-afbf57ea-7263c8ec_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:43.486809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84078896-7baac93-afbf57ea-7263c8ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:43.486888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:43.486903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1966
2025-09-30T14:55:43.487052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1966 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:43.487083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1966 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:43.487089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1966 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:43.487094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:43.487579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1966 sessionId:  describe result for acl check
2025-09-30T14:55:43.487627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:43.487634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:43.487636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:43.487641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896061881722420:5789] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:43.488183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896061881722420:5789] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:43.491528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896061881722420:5789] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:43.495030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896061881722420:5789] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:43.495046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896061881722420:5789] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:43.495050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896061881722420:5789] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:43.495062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1966 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:43.501737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:43.504857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:43.505086Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:43.505102Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:43.505115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:43.505178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:43.505219Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896061791952718:4404]
2025-09-30T14:55:43.505982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:43.506295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:43.506348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:43.506700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:43.506768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:43.506774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:43.506775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:43.506777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:43.506778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:43.506779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:43.506781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:43.506782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:43.506783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:43.506785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:43.506786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.506788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:43.506789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:43.506790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:43.506792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:43.506797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:43.506809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:43.506814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:43.506819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:43.506824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:43.506828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:43.506832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:43.506836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:43.506841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:43.506846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:43.506851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.506856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:43.506860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:43.506865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:43.506869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:43.506877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:43.506885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:43.506892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:43.506898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:43.506909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:43.506915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:43.506925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:43.506931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:43.506941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:43.506946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:43.506952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:43.506962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:43.506968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:43.506979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:43.506983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:43.506992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:43.506997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:43.507002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:43.507012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:43.507016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:43.507021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.507026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.507031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:43.507038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:43.507043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:43.507048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:43.507053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:43.507059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:43.507066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:43.507072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:43.507121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:43.512575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:43.513739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:43.513754Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:43.513757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:43.513761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:43.513770Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1965 [2:7555896061791952718:4404]
2025-09-30T14:55:43.513787Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:43.513803Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:43.513814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:43.513817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:43.513820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:43.513835Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:43.513842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:43.513852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:43.513917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.513923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:43.513926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:43.513930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:43.513933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:43.513998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:43.514009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.514023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:43.514036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:43.514054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:43.514076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896061881722395:2454], now have 1 active actors on pipe
2025-09-30T14:55:43.514084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896061881722577:5789], now have 1 active actors on pipe
2025-09-30T14:55:43.514091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896061791952713:4404]
2025-09-30T14:55:43.514093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896061791952713:4404]
2025-09-30T14:55:43.514096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896061791952713:4404]
2025-09-30T14:55:43.514111Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:43.514125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:43.514136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:43.514140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:43.514143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:43.514149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:43.514152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:43.514176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896061791952713:4404]
2025-09-30T14:55:43.514183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:43.514171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1965
2025-09-30T14:55:43.514222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1965
2025-09-30T14:55:43.514185Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:43.514397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:43.514409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:43.514432Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6428275-b9fab4be-ae4c570b-4c77c41f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:43.514444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:43.514453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:43.514455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:43.514465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:43.514479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:43.514496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:43.514686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:43.514702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:43.514727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:43.514854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1966 partition: 0 MaxSeqNo: 42 sessionId: src_id|f6428275-b9fab4be-ae4c570b-4c77c41f_0
2025-09-30T14:55:43.515200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84078896-7baac93-afbf57ea-7263c8ec_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f6428275-b9fab4be-ae4c570b-4c77c41f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:43.518073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6428275-b9fab4be-ae4c570b-4c77c41f_0] Write session: try to update token
2025-09-30T14:55:43.518090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6428275-b9fab4be-ae4c570b-4c77c41f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:43.526736Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:43.526753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:43.526756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:43.526758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:43.526767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896061791952713:4404]
2025-09-30T14:55:43.526772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896061791952713:4404]
2025-09-30T14:55:43.526777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896061791952713:4404]
2025-09-30T14:55:43.526819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:43.526826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.526829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:43.526836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:43.526843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:43.526858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:43.526968Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:43.535013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1966 sessionId: src_id|f6428275-b9fab4be-ae4c570b-4c77c41f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:43.537831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:43.577293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896061881722706:6314]
2025-09-30T14:55:43.577606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1965, pipe: [1:7555896061881722706:6314]
2025-09-30T14:55:43.641963Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:43.642252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:43.642267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:43.642287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896061881722706:6314], now have 1 active actors on pipe
2025-09-30T14:55:43.642486Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:43.642471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:43.642475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896061881722706:6314]
2025-09-30T14:55:43.642487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:43.642496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:43.642555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1966 reason: error at write: Disconnected sessionId: src_id|f6428275-b9fab4be-ae4c570b-4c77c41f_0
2025-09-30T14:55:43.642760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1966 sessionId: src_id|f6428275-b9fab4be-ae4c570b-4c77c41f_0 is DEAD
2025-09-30T14:55:43.642952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6428275-b9fab4be-ae4c570b-4c77c41f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:43.642963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6428275-b9fab4be-ae4c570b-4c77c41f_0] Write session will restart in 0.005137s
2025-09-30T14:55:43.642985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6428275-b9fab4be-ae4c570b-4c77c41f_0] Write session: Do CDS request
2025-09-30T14:55:43.642991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6428275-b9fab4be-ae4c570b-4c77c41f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:43.649785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6428275-b9fab4be-ae4c570b-4c77c41f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:43.649859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:43.649873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1967
2025-09-30T14:55:43.650210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1967 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:43.650245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1967 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:43.650249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1967 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:43.650254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:43.650682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1967 sessionId:  describe result for acl check
2025-09-30T14:55:43.650711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:43.650717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:43.650719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:43.650725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896061881722726:5783] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:43.651311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896061881722726:5783] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:43.654897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896061881722726:5783] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:43.658853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896061881722726:5783] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:43.658870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896061881722726:5783] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:43.658874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896061881722726:5783] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:43.658892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1967 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:43.664575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:43.667887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:43.668092Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:43.668105Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:43.668116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:43.668175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:43.668217Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896061791953020:4396]
2025-09-30T14:55:43.668879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:43.669168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:43.669218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:43.669584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:43.669670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:43.669682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:43.669683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:43.669684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:43.669686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:43.669687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:43.669688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:43.669690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:43.669691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:43.669692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:43.669694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.669695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:43.669696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:43.669698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:43.669699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:43.669704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:43.669716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:43.669720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:43.669725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:43.669729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:43.669734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:43.669738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:43.669742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:43.669747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:43.669751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:43.669756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.669759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:43.669764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:43.669768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:43.669772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:43.669781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:43.669789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:43.669795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:43.669800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:43.669805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:43.669812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:43.669816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:43.669822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:43.669827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:43.669833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:43.669837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:43.669842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:43.669848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:43.669854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:43.669859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:43.669865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:43.669878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:43.669883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:43.669888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:43.669895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:43.669902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.669907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.669912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:43.669918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:43.669926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:43.669931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:43.669936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:43.669948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:43.669955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:43.669961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:43.670013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:43.675545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:43.676590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:43.676612Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:43.676614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:43.676618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:43.676625Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1966 [2:7555896061791953020:4396]
2025-09-30T14:55:43.676644Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:43.676665Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:43.676668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:43.676672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:43.676674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:43.676689Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:43.676696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:43.676703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:43.676759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.676768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:43.676770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:43.676774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:43.676777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:43.676843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:43.676850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.676864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:43.676882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:43.676906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:43.676929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896061881722896:5783], now have 1 active actors on pipe
2025-09-30T14:55:43.676940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896061881722709:2454], now have 1 active actors on pipe
2025-09-30T14:55:43.676946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896061791953015:4396]
2025-09-30T14:55:43.676948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896061791953015:4396]
2025-09-30T14:55:43.676951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896061791953015:4396]
2025-09-30T14:55:43.676966Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:43.676980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:43.676980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:43.676983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:43.676985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:43.677002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:43.677010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:43.677031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1966
2025-09-30T14:55:43.677037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1966
2025-09-30T14:55:43.677041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896061791953015:4396]
2025-09-30T14:55:43.677055Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:43.677066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:43.677096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:43.677100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:43.677124Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c9ef3d0-f30eb29-92257444-e190c1a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:43.677131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:43.677135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:43.677137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:43.677147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:43.677156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:43.677168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:43.677354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:43.677368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:43.677391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:43.677562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1967 partition: 0 MaxSeqNo: 42 sessionId: src_id|1c9ef3d0-f30eb29-92257444-e190c1a4_0
2025-09-30T14:55:43.677988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6428275-b9fab4be-ae4c570b-4c77c41f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1c9ef3d0-f30eb29-92257444-e190c1a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:43.680890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c9ef3d0-f30eb29-92257444-e190c1a4_0] Write session: try to update token
2025-09-30T14:55:43.680912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c9ef3d0-f30eb29-92257444-e190c1a4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:43.691530Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:43.691550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:43.691558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896061791953015:4396]
2025-09-30T14:55:43.691604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:43.691607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:43.691767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:43.691906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:43.692034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:43.692179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:43.692699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:43.692745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:43.695876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1967 sessionId: src_id|1c9ef3d0-f30eb29-92257444-e190c1a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:43.698738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:43.698976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:43.698999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:43.699050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:43.699143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:43.703507Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:43.703525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:43.703528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:43.703530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:43.703540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896061791953015:4396]
2025-09-30T14:55:43.703545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896061791953015:4396]
2025-09-30T14:55:43.703549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896061791953015:4396]
2025-09-30T14:55:43.703587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:43.703595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.703598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:43.703604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:43.703611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:43.703614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:43.703725Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:43.742683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896061881723020:6314]
2025-09-30T14:55:43.742953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1966, pipe: [1:7555896061881723020:6314]
2025-09-30T14:55:43.823983Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:43.832412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:43.832441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:43.832621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:43.832685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:43.832750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:43.832817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:43.832865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:43.832871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:43.832943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:43.833012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:43.833084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:43.833159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:43.833210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:43.833218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:43.833289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:43.833358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:43.833429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:43.833555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:43.833608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:43.833616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:43.833692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:43.833763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:43.833839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:43.833907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:43.833954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:43.833961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:43.834035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:43.834108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:43.834184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:43.834256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:43.834304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:43.834315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:43.834390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:43.834463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:43.834535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:43.834613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:43.834683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:43.834691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:43.834766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:43.834834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:43.834909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:43.834982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:43.835049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:43.835057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:43.835132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:43.835199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:43.835284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:43.835359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:43.835410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:43.835418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:43.835490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:43.835557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:43.835629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:43.835699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:43.835749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:43.835757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:43.835826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:43.835892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:43.835963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:43.836038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:43.836085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:43.836092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:43.836156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896061881723020:6314], now have 1 active actors on pipe
2025-09-30T14:55:43.836856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c9ef3d0-f30eb29-92257444-e190c1a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:43.836871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c9ef3d0-f30eb29-92257444-e190c1a4_0] Write session will restart in 0.009900s
2025-09-30T14:55:43.836894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c9ef3d0-f30eb29-92257444-e190c1a4_0] Write session: Do CDS request
2025-09-30T14:55:43.836900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c9ef3d0-f30eb29-92257444-e190c1a4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:43.836363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896061881723020:6314]
2025-09-30T14:55:43.836369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:43.836418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:43.836421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:43.836451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1967 reason: error at write: Disconnected sessionId: src_id|1c9ef3d0-f30eb29-92257444-e190c1a4_0
2025-09-30T14:55:43.836651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1967 sessionId: src_id|1c9ef3d0-f30eb29-92257444-e190c1a4_0 is DEAD
2025-09-30T14:55:43.837417Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:43.849743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c9ef3d0-f30eb29-92257444-e190c1a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:43.849845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:43.849859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1968
2025-09-30T14:55:43.850054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1968 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:43.850100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1968 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:43.850110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1968 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:43.850114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:43.850575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1968 sessionId:  describe result for acl check
2025-09-30T14:55:43.850605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:43.850612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:43.850613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:43.850619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896061881723089:5765] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:43.851161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896061881723089:5765] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:43.854617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896061881723089:5765] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:43.859882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896061881723089:5765] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:43.859898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896061881723089:5765] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:43.859901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896061881723089:5765] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:43.859917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1968 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:43.868056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:43.871748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:43.871988Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:43.872002Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:43.872015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:43.872096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:43.872142Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896061791953372:4377]
2025-09-30T14:55:43.872808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:43.873186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:43.873234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:43.873612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:43.873677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:43.873684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:43.873685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:43.873686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:43.873688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:43.873689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:43.873691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:43.873692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:43.873693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:43.873694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:43.873696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.873697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:43.873698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:43.873699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:43.873701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:43.873706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:43.873716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:43.873720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:43.873724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:43.873728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:43.873732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:43.873736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:43.873740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:43.873743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:43.873748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:43.873752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.873756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:43.873760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:43.873764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:43.873769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:43.873778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:43.873786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:43.873792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:43.873798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:43.873803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:43.873808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:43.873813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:43.873818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:43.873823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:43.873829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:43.873833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:43.873838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:43.873843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:43.873848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:43.873871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:43.873884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:43.873888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:43.873896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:43.873900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:43.873906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:43.873911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.873917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.873921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:43.873926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:43.873931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:43.873946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:43.873950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:43.873956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:43.873961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:43.873966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:43.874009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:43.879862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:43.880859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:43.880874Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:43.880876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:43.880880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:43.880885Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1967 [2:7555896061791953372:4377]
2025-09-30T14:55:43.880898Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:43.880911Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:43.880913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:43.880916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:43.880918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:43.880933Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:43.880940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:43.880948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:43.880996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.881002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:43.881004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:43.881007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:43.881009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:43.881066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:43.881072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.881080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:43.881087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:43.881096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:43.881108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896061791953367:4377]
2025-09-30T14:55:43.881110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896061791953367:4377]
2025-09-30T14:55:43.881111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896061791953367:4377]
2025-09-30T14:55:43.881117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:43.881129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896061881723058:2454], now have 1 active actors on pipe
2025-09-30T14:55:43.881130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:43.881133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:43.881134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:43.881136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:43.881145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:43.881147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:43.881152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896061881723223:5765], now have 1 active actors on pipe
2025-09-30T14:55:43.881181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896061791953367:4377]
2025-09-30T14:55:43.881191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:43.881317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1967
2025-09-30T14:55:43.881361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1967
2025-09-30T14:55:43.881269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:43.881842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:43.881851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:43.881873Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c7ba7f57-b6ea2a87-4cc7d7e8-69763f05_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:43.881879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:43.881881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:43.881883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:43.881893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:43.881904Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:43.881919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:43.882105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:43.882114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:43.882127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:43.883182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1968 partition: 0 MaxSeqNo: 42 sessionId: src_id|c7ba7f57-b6ea2a87-4cc7d7e8-69763f05_0
2025-09-30T14:55:43.883571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c9ef3d0-f30eb29-92257444-e190c1a4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c7ba7f57-b6ea2a87-4cc7d7e8-69763f05_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:43.886584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ba7f57-b6ea2a87-4cc7d7e8-69763f05_0] Write session: try to update token
2025-09-30T14:55:43.886606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ba7f57-b6ea2a87-4cc7d7e8-69763f05_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:43.898135Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:43.898156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:43.898159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:43.898161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:43.898171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896061791953367:4377]
2025-09-30T14:55:43.898177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896061791953367:4377]
2025-09-30T14:55:43.898181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896061791953367:4377]
2025-09-30T14:55:43.898222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:43.898230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:43.898230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:43.898233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:43.898237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:43.898242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:43.898369Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:43.909938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1968 sessionId: src_id|c7ba7f57-b6ea2a87-4cc7d7e8-69763f05_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:43.912802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:43.939356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896061881723367:6314]
2025-09-30T14:55:43.940780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1967, pipe: [1:7555896061881723367:6314]
2025-09-30T14:55:44.021462Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:44.022262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:44.022274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:44.022314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896061881723367:6314], now have 1 active actors on pipe
2025-09-30T14:55:44.022682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896061881723367:6314]
2025-09-30T14:55:44.022682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:44.022704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:44.022714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:44.022777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1968 reason: error at write: Disconnected sessionId: src_id|c7ba7f57-b6ea2a87-4cc7d7e8-69763f05_0
2025-09-30T14:55:44.022966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1968 sessionId: src_id|c7ba7f57-b6ea2a87-4cc7d7e8-69763f05_0 is DEAD
2025-09-30T14:55:44.023137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ba7f57-b6ea2a87-4cc7d7e8-69763f05_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:44.023148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ba7f57-b6ea2a87-4cc7d7e8-69763f05_0] Write session will restart in 0.007134s
2025-09-30T14:55:44.023185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ba7f57-b6ea2a87-4cc7d7e8-69763f05_0] Write session: Do CDS request
2025-09-30T14:55:44.023192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ba7f57-b6ea2a87-4cc7d7e8-69763f05_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:44.023045Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:44.031768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ba7f57-b6ea2a87-4cc7d7e8-69763f05_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:44.031851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:44.031875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1969
2025-09-30T14:55:44.032014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1969 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:44.032054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1969 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:44.032059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1969 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:44.032063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:44.032938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1969 sessionId:  describe result for acl check
2025-09-30T14:55:44.032982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:44.032992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:44.032994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:44.033001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896066176690692:5760] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:44.033598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896066176690692:5760] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:44.036614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896066176690692:5760] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:44.040747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896066176690692:5760] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:44.040762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896066176690692:5760] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:44.040765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896066176690692:5760] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:44.040774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1969 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:44.047345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:44.051152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:44.051408Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:44.051421Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:44.051433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:44.051496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:44.051540Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896066086920972:4375]
2025-09-30T14:55:44.052237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:44.053105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:44.053164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:44.053506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:44.053582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:44.053588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:44.053589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:44.053591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:44.053592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:44.053593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:44.053594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:44.053595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:44.053596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:44.053597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:44.053599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.053600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.053601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.053602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:44.053603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:44.053608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:44.053618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:44.053622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:44.053626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:44.053629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:44.053633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:44.053637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:44.053641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:44.053644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:44.053648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:44.053651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.053655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.053658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.053662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:44.053666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:44.053673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:44.053681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:44.053687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:44.053692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:44.053696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:44.053701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:44.053706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:44.053710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:44.053715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:44.053721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:44.053726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:44.053731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:44.053736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:44.053741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:44.053746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:44.053750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:44.053756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:44.053760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:44.053766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:44.053771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:44.053776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.053782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.053787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.053792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.053797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.053808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.053812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:44.053816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:44.053821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:44.053825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:44.053869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:44.059722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:44.060618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:44.060636Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:44.060639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:44.060643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:44.060651Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1968 [2:7555896066086920972:4375]
2025-09-30T14:55:44.060666Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:44.060682Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:44.060685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:44.060688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:44.060691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:44.060707Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:44.060713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:44.060729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:44.060787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.060795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.060797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.060801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:44.060805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:44.060875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:44.060883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.060894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.060905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.060925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:44.060946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896066086920967:4375]
2025-09-30T14:55:44.060954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896066086920967:4375]
2025-09-30T14:55:44.060956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896066086920967:4375]
2025-09-30T14:55:44.060973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:44.060991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:44.061010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:44.061017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:44.061050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896066086920967:4375]
2025-09-30T14:55:44.061057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:44.061170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:44.061176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:44.061178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:44.061183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:44.061302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1968
2025-09-30T14:55:44.061414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896066176690851:5760], now have 1 active actors on pipe
2025-09-30T14:55:44.061437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:44.061442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:44.061455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896066176690668:2454], now have 1 active actors on pipe
2025-09-30T14:55:44.061468Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6f7dd6a-31931541-d3cd5824-38f197f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:44.061475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:44.061479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:44.061482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:44.061491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:44.061502Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:44.061529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:44.061774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1968
2025-09-30T14:55:44.063758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:44.063775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:44.063804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:44.063966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1969 partition: 0 MaxSeqNo: 42 sessionId: src_id|d6f7dd6a-31931541-d3cd5824-38f197f6_0
2025-09-30T14:55:44.064373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ba7f57-b6ea2a87-4cc7d7e8-69763f05_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d6f7dd6a-31931541-d3cd5824-38f197f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:44.067283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f7dd6a-31931541-d3cd5824-38f197f6_0] Write session: try to update token
2025-09-30T14:55:44.067302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f7dd6a-31931541-d3cd5824-38f197f6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:44.082828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1969 sessionId: src_id|d6f7dd6a-31931541-d3cd5824-38f197f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:44.085524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:44.086232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:44.086256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:44.086292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:44.086495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:44.089389Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:44.089413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:44.089416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:44.089418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:44.089430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896066086920967:4375]
2025-09-30T14:55:44.089434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896066086920967:4375]
2025-09-30T14:55:44.089438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896066086920967:4375]
2025-09-30T14:55:44.089481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:44.089488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:44.089494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:44.089498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.089501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:44.089502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:44.089662Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:44.123096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896066176690978:6314]
2025-09-30T14:55:44.123459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1968, pipe: [1:7555896066176690978:6314]
2025-09-30T14:55:44.215118Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:44.224960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:44.224996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:44.225184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:44.225259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:44.225333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:44.225414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:44.225474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:44.225478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:44.225572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:44.225632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:44.225699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:44.225770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:44.225814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:44.225818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:44.225900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:44.225966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:44.226028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:44.226091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:44.226137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:44.226140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:44.226215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:44.226285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:44.226352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:44.226425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:44.226468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:44.226472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:44.226550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:44.226612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:44.226707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:44.226784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:44.226845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:44.226849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:44.226926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:44.226988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:44.227057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:44.227124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:44.227171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:44.227174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:44.227453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:44.227532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:44.227605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:44.227683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:44.227728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:44.227731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:44.227809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:44.227905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:44.227973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:44.228042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:44.228105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:44.228109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:44.228190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:44.228251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:44.228319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:44.228387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:44.228431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:44.228434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:44.228508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:44.228569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:44.228638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:44.228709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:44.228774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:44.228778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:44.228855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896066176690978:6314], now have 1 active actors on pipe
2025-09-30T14:55:44.229097Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:44.229114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896066176690978:6314]
2025-09-30T14:55:44.229189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:44.229197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:44.229231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1969 reason: error at write: Disconnected sessionId: src_id|d6f7dd6a-31931541-d3cd5824-38f197f6_0
2025-09-30T14:55:44.229447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1969 sessionId: src_id|d6f7dd6a-31931541-d3cd5824-38f197f6_0 is DEAD
2025-09-30T14:55:44.229653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f7dd6a-31931541-d3cd5824-38f197f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:44.229665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f7dd6a-31931541-d3cd5824-38f197f6_0] Write session will restart in 0.005286s
2025-09-30T14:55:44.229691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f7dd6a-31931541-d3cd5824-38f197f6_0] Write session: Do CDS request
2025-09-30T14:55:44.229698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f7dd6a-31931541-d3cd5824-38f197f6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:44.230407Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:44.235809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f7dd6a-31931541-d3cd5824-38f197f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:44.236192Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:44.236207Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1970
2025-09-30T14:55:44.236333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1970 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:44.236362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1970 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:44.236368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1970 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:44.236372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:44.236898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1970 sessionId:  describe result for acl check
2025-09-30T14:55:44.236936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:44.236941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:44.236944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:44.236952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896066176690998:5751] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:44.237529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896066176690998:5751] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:44.251443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896066176690998:5751] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:44.255867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896066176690998:5751] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:44.255888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896066176690998:5751] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:44.255892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896066176690998:5751] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:44.255901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1970 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:44.263145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:44.266755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:44.266990Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:44.267001Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:44.267043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:44.267117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:44.267158Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896066086921285:4369]
2025-09-30T14:55:44.267842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:44.268117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:44.268159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:44.268486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:44.268547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:44.268555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:44.268556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:44.268557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:44.268559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:44.268560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:44.268561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:44.268562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:44.268564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:44.268565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:44.268566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.268567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.268568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.268569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:44.268571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:44.268576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:44.268586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:44.268590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:44.268594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:44.268599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:44.268603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:44.268607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:44.268611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:44.268614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:44.268619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:44.268623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.268628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.268632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.268636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:44.268640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:44.268648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:44.268656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:44.268662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:44.268667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:44.268672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:44.268678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:44.268683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:44.268689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:44.268694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:44.268699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:44.268704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:44.268709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:44.268715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:44.268720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:44.268725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:44.268735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:44.268743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:44.268752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:44.268757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:44.268763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:44.268772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.268777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.268783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.268793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.268804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.268814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.268818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:44.268824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:44.268829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:44.268834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:44.268874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:44.274580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:44.275465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:44.275479Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:44.275482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:44.275486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:44.275493Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1969 [2:7555896066086921285:4369]
2025-09-30T14:55:44.275511Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:44.275527Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:44.275530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:44.275534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:44.275536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:44.275551Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:44.275558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:44.275565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:44.275626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.275634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.275636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.275640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:44.275643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:44.275706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:44.275713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.275726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.275744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.275763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:44.275782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896066176690990:2454], now have 1 active actors on pipe
2025-09-30T14:55:44.275791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896066176691196:5751], now have 1 active actors on pipe
2025-09-30T14:55:44.275797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896066086921276:4369]
2025-09-30T14:55:44.275800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896066086921276:4369]
2025-09-30T14:55:44.275802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896066086921276:4369]
2025-09-30T14:55:44.275816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:44.275830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:44.275831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:44.275835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:44.275838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:44.275844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:44.275847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:44.275885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896066086921276:4369]
2025-09-30T14:55:44.275896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:44.275938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:44.275938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:44.275883Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1969
2025-09-30T14:55:44.275899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1969
2025-09-30T14:55:44.275950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:44.275977Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59f88790-9c7fc164-1aa08b36-ba1c257c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:44.275990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:44.275994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:44.275996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:44.276008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:44.276019Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:44.276034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:44.276216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:44.276230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:44.276246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:44.276383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1970 partition: 0 MaxSeqNo: 42 sessionId: src_id|59f88790-9c7fc164-1aa08b36-ba1c257c_0
2025-09-30T14:55:44.276765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f7dd6a-31931541-d3cd5824-38f197f6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|59f88790-9c7fc164-1aa08b36-ba1c257c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:44.279784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59f88790-9c7fc164-1aa08b36-ba1c257c_0] Write session: try to update token
2025-09-30T14:55:44.279807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59f88790-9c7fc164-1aa08b36-ba1c257c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:44.289200Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:44.289224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:44.289235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896066086921276:4369]
2025-09-30T14:55:44.289286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:44.289288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:44.289483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:44.289658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:44.289811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:44.289956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:44.290147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:44.290184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:44.298778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1970 sessionId: src_id|59f88790-9c7fc164-1aa08b36-ba1c257c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:44.301771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:44.302089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:44.302117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:44.302136Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:44.302139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:44.302142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:44.302144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:44.302154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896066086921276:4369]
2025-09-30T14:55:44.302158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896066086921276:4369]
2025-09-30T14:55:44.302162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896066086921276:4369]
2025-09-30T14:55:44.302212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:44.302213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:44.302220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:44.302224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:44.302228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.302231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:44.302361Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:44.329406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896066176691317:6314]
2025-09-30T14:55:44.329820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1969, pipe: [1:7555896066176691317:6314]
2025-09-30T14:55:44.417467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:44.417524Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:44.417576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896066176691317:6314]
2025-09-30T14:55:44.417592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:44.417596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:44.417684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1970 reason: error at write: Disconnected sessionId: src_id|59f88790-9c7fc164-1aa08b36-ba1c257c_0
2025-09-30T14:55:44.417820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1970 sessionId: src_id|59f88790-9c7fc164-1aa08b36-ba1c257c_0 is DEAD
2025-09-30T14:55:44.418251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f88790-9c7fc164-1aa08b36-ba1c257c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:44.418262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f88790-9c7fc164-1aa08b36-ba1c257c_0] Write session will restart in 0.005987s
2025-09-30T14:55:44.418286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f88790-9c7fc164-1aa08b36-ba1c257c_0] Write session: Do CDS request
2025-09-30T14:55:44.418292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f88790-9c7fc164-1aa08b36-ba1c257c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:44.416679Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:44.417297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:44.417336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896066176691317:6314], now have 1 active actors on pipe
2025-09-30T14:55:44.426695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59f88790-9c7fc164-1aa08b36-ba1c257c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:44.426776Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:44.426792Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1971
2025-09-30T14:55:44.426936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1971 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:44.426979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1971 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:44.426985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1971 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:44.426994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:44.427539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1971 sessionId:  describe result for acl check
2025-09-30T14:55:44.427579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:44.427582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:44.427583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:44.427589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896066176691339:5747] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:44.428148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896066176691339:5747] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:44.429655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:44.430224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:44.430442Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:44.430452Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:44.430463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:44.430532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:44.430572Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896066086921344:4370]
2025-09-30T14:55:44.431039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896066176691339:5747] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:44.431281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:44.431594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:44.431666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:44.432051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:44.432152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:44.432161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:44.432163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:44.432164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:44.432165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:44.432166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:44.432168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:44.432169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:44.432171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:44.432172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:44.432173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.432175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.432176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.432177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:44.432179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:44.432185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:44.432195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:44.432200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:44.432203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:44.432207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:44.432211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:44.432214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:44.432218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:44.432222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:44.432226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:44.432230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.432234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.432237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.432241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:44.432245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:44.432254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:44.432263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:44.432270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:44.432276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:44.432281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:44.432287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:44.432292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:44.432297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:44.432302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:44.432308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:44.432313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:44.432318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:44.432323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:44.432328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:44.432332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:44.432339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:44.432345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:44.432350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:44.432355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:44.432360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:44.432365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.432372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.432377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.432390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.432396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.432406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.432411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:44.432421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:44.432426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:44.432433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:44.432482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:44.436611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896066176691339:5747] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:44.436627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896066176691339:5747] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:44.436632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896066176691339:5747] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:44.436640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1971 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:44.438051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:44.438981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:44.438996Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:44.438999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:44.439003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:44.439009Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1970 [2:7555896066086921344:4370]
2025-09-30T14:55:44.439026Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:44.439043Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:44.439052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:44.439055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:44.439057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:44.439073Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:44.439085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:44.439097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:44.439162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.439171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.439173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.439177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:44.439179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:44.439269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:44.439280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.439293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.439304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.439320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:44.439339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896066176691380:5747], now have 1 active actors on pipe
2025-09-30T14:55:44.439348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896066176691320:2454], now have 1 active actors on pipe
2025-09-30T14:55:44.439355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896066086921339:4370]
2025-09-30T14:55:44.439357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896066086921339:4370]
2025-09-30T14:55:44.439360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896066086921339:4370]
2025-09-30T14:55:44.439372Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:44.439387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:44.439391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:44.439398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1970
2025-09-30T14:55:44.439411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1970
2025-09-30T14:55:44.439393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:44.439398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:44.439413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:44.439417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:44.439452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896066086921339:4370]
2025-09-30T14:55:44.439461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:44.439467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:44.439479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:44.439483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:44.439537Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ce0c97a-53532a18-70e184d8-e52f0dd1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:44.439550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:44.439554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:44.439556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:44.439566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:44.439575Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:44.439598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:44.439769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:44.439778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:44.439792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:44.439870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1971 partition: 0 MaxSeqNo: 42 sessionId: src_id|8ce0c97a-53532a18-70e184d8-e52f0dd1_0
2025-09-30T14:55:44.440312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f88790-9c7fc164-1aa08b36-ba1c257c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8ce0c97a-53532a18-70e184d8-e52f0dd1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:44.443186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ce0c97a-53532a18-70e184d8-e52f0dd1_0] Write session: try to update token
2025-09-30T14:55:44.443207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ce0c97a-53532a18-70e184d8-e52f0dd1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:44.455227Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:44.455270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:44.455272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:44.455274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:44.455283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896066086921339:4370]
2025-09-30T14:55:44.455291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896066086921339:4370]
2025-09-30T14:55:44.455295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896066086921339:4370]
2025-09-30T14:55:44.455335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:44.455341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.455344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:44.455346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:44.455352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:44.455356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:44.455515Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:44.465000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1971 sessionId: src_id|8ce0c97a-53532a18-70e184d8-e52f0dd1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:44.468068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:44.519540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896066176691388:6314]
2025-09-30T14:55:44.520368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1970, pipe: [1:7555896066176691388:6314]
2025-09-30T14:55:44.582097Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:44.582596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:44.582611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:44.582633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896066176691388:6314], now have 1 active actors on pipe
2025-09-30T14:55:44.582885Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:44.582926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:44.582946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:44.583008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1971 reason: error at write: Disconnected sessionId: src_id|8ce0c97a-53532a18-70e184d8-e52f0dd1_0
2025-09-30T14:55:44.583179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1971 sessionId: src_id|8ce0c97a-53532a18-70e184d8-e52f0dd1_0 is DEAD
2025-09-30T14:55:44.583278Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:44.583319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896066176691388:6314]
2025-09-30T14:55:44.583556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ce0c97a-53532a18-70e184d8-e52f0dd1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:44.583567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ce0c97a-53532a18-70e184d8-e52f0dd1_0] Write session will restart in 0.009535s
2025-09-30T14:55:44.583590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ce0c97a-53532a18-70e184d8-e52f0dd1_0] Write session: Do CDS request
2025-09-30T14:55:44.583595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ce0c97a-53532a18-70e184d8-e52f0dd1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:44.595195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:44.595667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ce0c97a-53532a18-70e184d8-e52f0dd1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:44.595841Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:44.595865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1972
2025-09-30T14:55:44.596105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1972 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:44.596148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1972 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:44.596157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1972 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:44.596162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:44.596652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1972 sessionId:  describe result for acl check
2025-09-30T14:55:44.596685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:44.596687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:44.596689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:44.596695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896066176691409:5736] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:44.596804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:44.596995Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:44.597018Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:44.597029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:44.597091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:44.597149Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896066086921400:4364]
2025-09-30T14:55:44.597265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896066176691409:5736] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:44.597828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:44.598101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:44.598156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:44.598492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:44.598557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:44.598563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:44.598565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:44.598566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:44.598567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:44.598569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:44.598570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:44.598572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:44.598573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:44.598574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:44.598576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.598577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.598578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.598580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:44.598581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:44.598586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:44.598597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:44.598602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:44.598607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:44.598611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:44.598615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:44.598619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:44.598623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:44.598627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:44.598632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:44.598636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.598640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.598644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.598649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:44.598653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:44.598660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:44.598667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:44.598675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:44.598680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:44.598685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:44.598689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:44.598692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:44.598696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:44.598701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:44.598706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:44.598712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:44.598717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:44.598726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:44.598731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:44.598735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:44.598744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:44.598750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:44.598760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:44.598764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:44.598770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:44.598779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.598784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.598788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.598793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.598801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.598811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.598816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:44.598826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:44.598830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:44.598836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:44.598885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:44.598949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896066176691409:5736] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:44.604335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896066176691409:5736] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:44.604352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896066176691409:5736] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:44.604356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896066176691409:5736] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:44.604366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1972 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:44.604679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:44.605617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:44.605636Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:44.605639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:44.605644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:44.605650Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1971 [2:7555896066086921400:4364]
2025-09-30T14:55:44.605667Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:44.605685Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:44.605687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:44.605691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:44.605693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:44.605710Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:44.605722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:44.605732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:44.605800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.605807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.605810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.605813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:44.605816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:44.605884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:44.605891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.605904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.605921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.605939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:44.605964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896066176691448:5736], now have 1 active actors on pipe
2025-09-30T14:55:44.605973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896066176691389:2454], now have 1 active actors on pipe
2025-09-30T14:55:44.605979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896066086921395:4364]
2025-09-30T14:55:44.605987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896066086921395:4364]
2025-09-30T14:55:44.605990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896066086921395:4364]
2025-09-30T14:55:44.606003Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:44.606021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:44.606023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:44.606024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:44.606027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:44.606038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:44.606041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:44.606078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896066086921395:4364]
2025-09-30T14:55:44.606091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:44.606063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1971
2025-09-30T14:55:44.606090Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1971
2025-09-30T14:55:44.606240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:44.606307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:44.606322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:44.606346Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|828d3a28-32d793ce-98fe56e-5ee5c62c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:44.606358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:44.606376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:44.606383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:44.606394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:44.606409Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:44.606442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:44.606594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:44.606601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:44.606615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:44.606719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1972 partition: 0 MaxSeqNo: 42 sessionId: src_id|828d3a28-32d793ce-98fe56e-5ee5c62c_0
2025-09-30T14:55:44.607133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ce0c97a-53532a18-70e184d8-e52f0dd1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|828d3a28-32d793ce-98fe56e-5ee5c62c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:44.610078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|828d3a28-32d793ce-98fe56e-5ee5c62c_0] Write session: try to update token
2025-09-30T14:55:44.610101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|828d3a28-32d793ce-98fe56e-5ee5c62c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:44.621151Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:44.621173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:44.621176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:44.621179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:44.621189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896066086921395:4364]
2025-09-30T14:55:44.621193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896066086921395:4364]
2025-09-30T14:55:44.621202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896066086921395:4364]
2025-09-30T14:55:44.621247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:44.621254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.621257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:44.621260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:44.621268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:44.621273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:44.621417Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:44.636275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1972 sessionId: src_id|828d3a28-32d793ce-98fe56e-5ee5c62c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:44.639047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:44.685251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896066176691459:6314]
2025-09-30T14:55:44.685483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1971, pipe: [1:7555896066176691459:6314]
2025-09-30T14:55:44.742510Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:44.742878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:44.742893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:44.742916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896066176691459:6314], now have 1 active actors on pipe
2025-09-30T14:55:44.743182Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:44.743226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:44.743240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:44.743311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896066176691459:6314]
2025-09-30T14:55:44.743323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1972 reason: error at write: Disconnected sessionId: src_id|828d3a28-32d793ce-98fe56e-5ee5c62c_0
2025-09-30T14:55:44.743330Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:44.743502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1972 sessionId: src_id|828d3a28-32d793ce-98fe56e-5ee5c62c_0 is DEAD
2025-09-30T14:55:44.744070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|828d3a28-32d793ce-98fe56e-5ee5c62c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:44.744083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|828d3a28-32d793ce-98fe56e-5ee5c62c_0] Write session will restart in 0.006026s
2025-09-30T14:55:44.744109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|828d3a28-32d793ce-98fe56e-5ee5c62c_0] Write session: Do CDS request
2025-09-30T14:55:44.744127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|828d3a28-32d793ce-98fe56e-5ee5c62c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:44.751782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|828d3a28-32d793ce-98fe56e-5ee5c62c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:44.751832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:44.751846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1973
2025-09-30T14:55:44.752003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1973 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:44.752047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1973 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:44.752053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1973 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:44.752065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:44.752308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:44.752490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1973 sessionId:  describe result for acl check
2025-09-30T14:55:44.752526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:44.752534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:44.752536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:44.752542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896066176691480:5734] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:44.753091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896066176691480:5734] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:44.753949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:44.754167Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:44.754178Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:44.754188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:44.754257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:44.754295Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896066086921470:4362]
2025-09-30T14:55:44.754949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:44.755268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896066176691480:5734] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:44.755294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:44.755358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:44.755691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:44.755770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:44.755777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:44.755779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:44.755780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:44.755781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:44.755782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:44.755784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:44.755785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:44.755788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:44.755790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:44.755791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.755792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.755793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.755794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:44.755795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:44.755801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:44.755811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:44.755814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:44.755818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:44.755822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:44.755826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:44.755829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:44.755835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:44.755839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:44.755843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:44.755847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.755850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.755854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.755858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:44.755861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:44.755869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:44.755892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:44.755898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:44.755903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:44.755907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:44.755913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:44.755917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:44.755922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:44.755929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:44.755934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:44.755939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:44.755944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:44.755949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:44.755954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:44.755958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:44.755964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:44.755969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:44.755973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:44.755978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:44.755983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:44.755987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.755999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.756004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.756009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.756019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.756024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.756032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:44.756037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:44.756044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:44.756048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:44.756088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:44.762199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896066176691480:5734] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:44.762220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896066176691480:5734] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:44.762230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896066176691480:5734] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:44.762243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1973 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:44.762348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:44.763238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:44.763268Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:44.763270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:44.763274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:44.763279Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1972 [2:7555896066086921470:4362]
2025-09-30T14:55:44.763291Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:44.763309Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:44.763312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:44.763315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:44.763318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:44.763334Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:44.763341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:44.763350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:44.763403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.763412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.763414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.763417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:44.763419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:44.763480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:44.763488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.763496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.763502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.763511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:44.763524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896066086921465:4362]
2025-09-30T14:55:44.763526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896066086921465:4362]
2025-09-30T14:55:44.763529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896066086921465:4362]
2025-09-30T14:55:44.763535Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:44.763544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896066176691528:5734], now have 1 active actors on pipe
2025-09-30T14:55:44.763547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896066176691460:2454], now have 1 active actors on pipe
2025-09-30T14:55:44.763553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:44.763554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:44.763558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:44.763560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:44.763563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:44.763565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:44.763593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896066086921465:4362]
2025-09-30T14:55:44.763598Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:44.763613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:44.764060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1972
2025-09-30T14:55:44.764089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1972
2025-09-30T14:55:44.764145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:44.764169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:44.764198Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e03047d-e77c4dfc-7c0b5356-4e3e21b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:44.764210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:44.764214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:44.764217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:44.764226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:44.764241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:44.764257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:44.764489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:44.764503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:44.764526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:44.764641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1973 partition: 0 MaxSeqNo: 42 sessionId: src_id|8e03047d-e77c4dfc-7c0b5356-4e3e21b0_0
2025-09-30T14:55:44.764989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|828d3a28-32d793ce-98fe56e-5ee5c62c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8e03047d-e77c4dfc-7c0b5356-4e3e21b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:44.767796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e03047d-e77c4dfc-7c0b5356-4e3e21b0_0] Write session: try to update token
2025-09-30T14:55:44.767815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e03047d-e77c4dfc-7c0b5356-4e3e21b0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:44.776414Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:44.776435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:44.776438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:44.776440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:44.776454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896066086921465:4362]
2025-09-30T14:55:44.776458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896066086921465:4362]
2025-09-30T14:55:44.776463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896066086921465:4362]
2025-09-30T14:55:44.776508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:44.776519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.776522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:44.776665Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:44.779323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:44.779343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:44.779360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:44.786529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1973 sessionId: src_id|8e03047d-e77c4dfc-7c0b5356-4e3e21b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:44.789350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:44.843465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896066176691561:6314]
2025-09-30T14:55:44.843792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1972, pipe: [1:7555896066176691561:6314]
2025-09-30T14:55:44.894369Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:44.894848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:44.894866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:44.894907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896066176691561:6314], now have 1 active actors on pipe
2025-09-30T14:55:44.895186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:44.895200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:44.895281Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:44.895297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:44.895306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1973 reason: error at write: Disconnected sessionId: src_id|8e03047d-e77c4dfc-7c0b5356-4e3e21b0_0
2025-09-30T14:55:44.895349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896066176691561:6314]
2025-09-30T14:55:44.895496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1973 sessionId: src_id|8e03047d-e77c4dfc-7c0b5356-4e3e21b0_0 is DEAD
2025-09-30T14:55:44.895675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e03047d-e77c4dfc-7c0b5356-4e3e21b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:44.895686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e03047d-e77c4dfc-7c0b5356-4e3e21b0_0] Write session will restart in 0.006085s
2025-09-30T14:55:44.895715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e03047d-e77c4dfc-7c0b5356-4e3e21b0_0] Write session: Do CDS request
2025-09-30T14:55:44.895721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e03047d-e77c4dfc-7c0b5356-4e3e21b0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:44.902847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e03047d-e77c4dfc-7c0b5356-4e3e21b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:44.902918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:44.902932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1974
2025-09-30T14:55:44.903098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1974 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:44.903141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1974 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:44.903151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1974 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:44.903156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:44.903589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1974 sessionId:  describe result for acl check
2025-09-30T14:55:44.903631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:44.903632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:44.903634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:44.903641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896066176691591:5716] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:44.904093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:44.904212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896066176691591:5716] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:44.905731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:44.906009Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:44.906018Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:44.906029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:44.906099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:44.906141Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896066086921568:4342]
2025-09-30T14:55:44.906539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896066176691591:5716] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:44.906752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:44.907171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:44.907233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:44.907622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:44.907686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:44.907694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:44.907695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:44.907696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:44.907698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:44.907699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:44.907700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:44.907702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:44.907703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:44.907705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:44.907706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.907708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.907711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.907712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:44.907713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:44.907719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:44.907730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:44.907736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:44.907740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:44.907745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:44.907750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:44.907755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:44.907760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:44.907764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:44.907769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:44.907774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.907778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.907784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.907787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:44.907790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:44.907797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:44.907805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:44.907812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:44.907818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:44.907823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:44.907829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:44.907835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:44.907841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:44.907847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:44.907853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:44.907858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:44.907864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:44.907871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:44.907882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:44.907889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:44.907900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:44.907905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:44.907911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:44.907916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:44.907922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:44.907927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.907933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.907938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.907944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.907948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.907960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.907965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:44.907975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:44.907980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:44.907990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:44.908041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:44.913527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896066176691591:5716] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:44.913545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896066176691591:5716] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:44.913549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896066176691591:5716] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:44.913557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1974 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:44.913819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:44.915462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:44.915489Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:44.915495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:44.915499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:44.915507Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1973 [2:7555896066086921568:4342]
2025-09-30T14:55:44.915527Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:44.915543Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:44.915547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:44.915551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:44.915553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:44.915570Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:44.915586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:44.915597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:44.915667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.915677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.915679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.915686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:44.915688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:44.915757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:44.915765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.915780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:44.915798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:44.915818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:44.915841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896066176691571:2454], now have 1 active actors on pipe
2025-09-30T14:55:44.915849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896066176691632:5716], now have 1 active actors on pipe
2025-09-30T14:55:44.915855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896066086921563:4342]
2025-09-30T14:55:44.915858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896066086921563:4342]
2025-09-30T14:55:44.915860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896066086921563:4342]
2025-09-30T14:55:44.915873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:44.915890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:44.915891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:44.915895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:44.915898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:44.915910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:44.915913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:44.915933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1973
2025-09-30T14:55:44.915947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896066086921563:4342]
2025-09-30T14:55:44.915946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1973
2025-09-30T14:55:44.915953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:44.915969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:44.915991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:44.915995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:44.916015Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|474c2d0c-c2db077-5c88d826-937e5b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:44.916024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:44.916029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:44.916033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:44.916041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:44.916056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:44.916073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:44.916393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1974 partition: 0 MaxSeqNo: 42 sessionId: src_id|474c2d0c-c2db077-5c88d826-937e5b3_0
2025-09-30T14:55:44.916228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:44.916235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:44.916248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:44.916790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e03047d-e77c4dfc-7c0b5356-4e3e21b0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|474c2d0c-c2db077-5c88d826-937e5b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:44.923011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|474c2d0c-c2db077-5c88d826-937e5b3_0] Write session: try to update token
2025-09-30T14:55:44.923035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|474c2d0c-c2db077-5c88d826-937e5b3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:44.928817Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:44.928837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:44.928846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896066086921563:4342]
2025-09-30T14:55:44.928893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:44.928907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:44.929428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:44.929595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:44.929745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:44.929894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:44.930102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:44.930152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:44.939504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1974 sessionId: src_id|474c2d0c-c2db077-5c88d826-937e5b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:44.940307Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:44.940333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:44.940335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:44.940338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:44.940346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896066086921563:4342]
2025-09-30T14:55:44.940350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896066086921563:4342]
2025-09-30T14:55:44.940354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896066086921563:4342]
2025-09-30T14:55:44.940399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:44.940410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:44.940412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:44.940582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:44.940596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:44.940597Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:44.940600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:44.942159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:44.995502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896066176691640:6314]
2025-09-30T14:55:44.995807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1973, pipe: [1:7555896066176691640:6314]
2025-09-30T14:55:45.056626Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:45.057033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:45.057048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:45.057065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896066176691640:6314], now have 1 active actors on pipe
2025-09-30T14:55:45.057251Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:45.057272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:45.057326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896066176691640:6314]
2025-09-30T14:55:45.057338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:45.057434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1974 reason: status is not ok: tablet will be restarted right now sessionId: src_id|474c2d0c-c2db077-5c88d826-937e5b3_0
2025-09-30T14:55:45.057635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1974 sessionId: src_id|474c2d0c-c2db077-5c88d826-937e5b3_0 is DEAD
2025-09-30T14:55:45.057754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|474c2d0c-c2db077-5c88d826-937e5b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:45.057765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|474c2d0c-c2db077-5c88d826-937e5b3_0] Write session will restart in 0.008926s
2025-09-30T14:55:45.057791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|474c2d0c-c2db077-5c88d826-937e5b3_0] Write session: Do CDS request
2025-09-30T14:55:45.057795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|474c2d0c-c2db077-5c88d826-937e5b3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:45.065304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:45.066892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:45.067126Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:45.067137Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:45.067148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:45.067208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:45.067270Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896070381888925:4338]
2025-09-30T14:55:45.067764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|474c2d0c-c2db077-5c88d826-937e5b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:45.067865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:45.067882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1975
2025-09-30T14:55:45.067910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:45.068006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1975 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:45.068043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1975 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:45.068049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1975 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:45.068052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:45.068312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:45.068364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:45.068517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1975 sessionId:  describe result for acl check
2025-09-30T14:55:45.068553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:45.068560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:45.068564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:45.068570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896070471658962:5710] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:45.068739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:45.068802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:45.068808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:45.068810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:45.068811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:45.068812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:45.068814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:45.068815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:45.068817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:45.068820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:45.068821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:45.068823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.068824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.068825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.068826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:45.068827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:45.068833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:45.068843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:45.068847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:45.068851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:45.068855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:45.068859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:45.068863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:45.068867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:45.068872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:45.068878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:45.068882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.068886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.068890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.068894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:45.068898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:45.068904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:45.068912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:45.068918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:45.068924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:45.068928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:45.068938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:45.068959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:45.068969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:45.068974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:45.068980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:45.068985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:45.068991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:45.068995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:45.069001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:45.069009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:45.069014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:45.069019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:45.069029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:45.069034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:45.069043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:45.069048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.069056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.069060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.069065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.069074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.069079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.069083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:45.069089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:45.069094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:45.069099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:45.069124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896070471658962:5710] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:45.069147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:45.071258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896070471658962:5710] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:45.074497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896070471658962:5710] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:45.074513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896070471658962:5710] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:45.074517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896070471658962:5710] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:45.074526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1975 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:45.074945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:45.075942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:45.075958Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:45.075961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:45.075966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:45.075973Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1974 [2:7555896070381888925:4338]
2025-09-30T14:55:45.075989Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:45.076006Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:45.076013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:45.076016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:45.076020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:45.076035Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:45.076046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:45.076053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:45.076117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.076124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.076126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.076130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:45.076133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:45.076205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:45.076214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.076225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.076237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.076255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:45.076277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896070471658999:5710], now have 1 active actors on pipe
2025-09-30T14:55:45.076284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896070471658937:2454], now have 1 active actors on pipe
2025-09-30T14:55:45.076291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896070381888920:4338]
2025-09-30T14:55:45.076296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896070381888920:4338]
2025-09-30T14:55:45.076298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896070381888920:4338]
2025-09-30T14:55:45.076309Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:45.076327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:45.076335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:45.076338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:45.076341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:45.076346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:45.076349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:45.076336Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1974
2025-09-30T14:55:45.076338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1974
2025-09-30T14:55:45.076379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896070381888920:4338]
2025-09-30T14:55:45.076386Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:45.076389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:45.076404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:45.076413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:45.076459Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8104cac-790edc61-362c15d4-46ab9993_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:45.076472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:45.076476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:45.076480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:45.076489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:45.076503Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:45.076526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:45.076701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:45.076709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:45.076722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:45.076786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1975 partition: 0 MaxSeqNo: 42 sessionId: src_id|b8104cac-790edc61-362c15d4-46ab9993_0
2025-09-30T14:55:45.077180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|474c2d0c-c2db077-5c88d826-937e5b3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b8104cac-790edc61-362c15d4-46ab9993_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:45.080122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8104cac-790edc61-362c15d4-46ab9993_0] Write session: try to update token
2025-09-30T14:55:45.080142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8104cac-790edc61-362c15d4-46ab9993_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:45.089192Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:45.089210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:45.089212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:45.089213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:45.089221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896070381888920:4338]
2025-09-30T14:55:45.089225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896070381888920:4338]
2025-09-30T14:55:45.089228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896070381888920:4338]
2025-09-30T14:55:45.089266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:45.089273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.089276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:45.089276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:45.089282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:45.089295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:45.089424Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:45.095975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1975 sessionId: src_id|b8104cac-790edc61-362c15d4-46ab9993_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:45.098838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:45.157304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896070471659014:6314]
2025-09-30T14:55:45.157605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1974, pipe: [1:7555896070471659014:6314]
2025-09-30T14:55:45.206396Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:45.206745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:45.206760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:45.206802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896070471659014:6314], now have 1 active actors on pipe
2025-09-30T14:55:45.207032Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:45.207051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896070471659014:6314]
2025-09-30T14:55:45.207088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:45.207091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:45.207165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1975 reason: error at write: Disconnected sessionId: src_id|b8104cac-790edc61-362c15d4-46ab9993_0
2025-09-30T14:55:45.207357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:45.207366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1975 sessionId: src_id|b8104cac-790edc61-362c15d4-46ab9993_0 is DEAD
2025-09-30T14:55:45.207690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8104cac-790edc61-362c15d4-46ab9993_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:45.207701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8104cac-790edc61-362c15d4-46ab9993_0] Write session will restart in 0.006982s
2025-09-30T14:55:45.207725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8104cac-790edc61-362c15d4-46ab9993_0] Write session: Do CDS request
2025-09-30T14:55:45.207730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8104cac-790edc61-362c15d4-46ab9993_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:45.215730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8104cac-790edc61-362c15d4-46ab9993_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:45.215898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:45.215915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1976
2025-09-30T14:55:45.216060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1976 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:45.216104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1976 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:45.216115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1976 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:45.216122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:45.216405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:45.216594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1976 sessionId:  describe result for acl check
2025-09-30T14:55:45.216631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:45.216638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:45.216640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:45.216646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896070471659039:5706] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:45.217246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896070471659039:5706] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:45.218963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:45.219202Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:45.219212Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:45.219224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:45.219304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:45.219356Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896070381888987:4332]
2025-09-30T14:55:45.219446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896070471659039:5706] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:45.220048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:45.220356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:45.220425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:45.220847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:45.220921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:45.220923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:45.220924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:45.220925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:45.220925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:45.220927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:45.220928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:45.220929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:45.220930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:45.220931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:45.220932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.220933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.220934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.220935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:45.220936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:45.220942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:45.220953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:45.220958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:45.220966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:45.220970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:45.220975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:45.220979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:45.220984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:45.220988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:45.220993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:45.220998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.221003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.221007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.221014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:45.221017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:45.221027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:45.221035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:45.221042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:45.221048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:45.221053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:45.221059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:45.221064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:45.221070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:45.221076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:45.221082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:45.221087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:45.221092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:45.221097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:45.221105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:45.221109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:45.221115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:45.221121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:45.221126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:45.221131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:45.221136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:45.221144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.221150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.221154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.221160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.221166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.221171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.221176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:45.221181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:45.221187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:45.221194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:45.221246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:45.224049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896070471659039:5706] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:45.224066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896070471659039:5706] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:45.224069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896070471659039:5706] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:45.224079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1976 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:45.227425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:45.228361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:45.228384Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:45.228386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:45.228390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:45.228398Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1975 [2:7555896070381888987:4332]
2025-09-30T14:55:45.228416Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:45.228438Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:45.228447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:45.228450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:45.228453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:45.228471Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:45.228480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:45.228487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:45.228551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.228560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.228562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.228565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:45.228567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:45.228641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:45.228651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.228663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.228672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.228688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:45.228708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896070471659078:5706], now have 1 active actors on pipe
2025-09-30T14:55:45.228717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896070471659015:2454], now have 1 active actors on pipe
2025-09-30T14:55:45.228723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896070381888982:4332]
2025-09-30T14:55:45.228725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896070381888982:4332]
2025-09-30T14:55:45.228726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896070381888982:4332]
2025-09-30T14:55:45.228739Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:45.228753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:45.228772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:45.228776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:45.228780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:45.228780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:45.228783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:45.228814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896070381888982:4332]
2025-09-30T14:55:45.228820Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:45.228828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:45.228927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1975
2025-09-30T14:55:45.228964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1975
2025-09-30T14:55:45.229034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:45.229047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:45.229444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1976 partition: 0 MaxSeqNo: 42 sessionId: src_id|5ba9d5-930fd87d-2a68f103-b0bcc471_0
2025-09-30T14:55:45.229079Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ba9d5-930fd87d-2a68f103-b0bcc471_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:45.229093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:45.229100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:45.229102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:45.229114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:45.229125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:45.229143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:45.229294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:45.229299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:45.229318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:45.231360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8104cac-790edc61-362c15d4-46ab9993_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5ba9d5-930fd87d-2a68f103-b0bcc471_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:45.234322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ba9d5-930fd87d-2a68f103-b0bcc471_0] Write session: try to update token
2025-09-30T14:55:45.234346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ba9d5-930fd87d-2a68f103-b0bcc471_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:45.241982Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:45.242001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:45.242003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:45.242005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:45.242016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896070381888982:4332]
2025-09-30T14:55:45.242021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896070381888982:4332]
2025-09-30T14:55:45.242031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896070381888982:4332]
2025-09-30T14:55:45.242077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:45.242086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.242089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:45.242100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:45.242108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:45.242115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:45.242234Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:45.255397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1976 sessionId: src_id|5ba9d5-930fd87d-2a68f103-b0bcc471_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:45.258421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:45.307358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896070471659089:6314]
2025-09-30T14:55:45.307637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1975, pipe: [1:7555896070471659089:6314]
2025-09-30T14:55:45.360825Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:45.361352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:45.361368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:45.361388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896070471659089:6314], now have 1 active actors on pipe
2025-09-30T14:55:45.361648Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:45.361650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:45.361662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:45.361689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896070471659089:6314]
2025-09-30T14:55:45.361714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:45.361741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1976 reason: error at write: Disconnected sessionId: src_id|5ba9d5-930fd87d-2a68f103-b0bcc471_0
2025-09-30T14:55:45.361921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1976 sessionId: src_id|5ba9d5-930fd87d-2a68f103-b0bcc471_0 is DEAD
2025-09-30T14:55:45.362091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ba9d5-930fd87d-2a68f103-b0bcc471_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:45.362103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ba9d5-930fd87d-2a68f103-b0bcc471_0] Write session will restart in 0.009921s
2025-09-30T14:55:45.362124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ba9d5-930fd87d-2a68f103-b0bcc471_0] Write session: Do CDS request
2025-09-30T14:55:45.362132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ba9d5-930fd87d-2a68f103-b0bcc471_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:45.370644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:45.372226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:45.372384Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:45.372393Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:45.372403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:45.372457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:45.372502Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896070381889049:4327]
2025-09-30T14:55:45.372800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ba9d5-930fd87d-2a68f103-b0bcc471_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:45.372865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:45.372890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1977
2025-09-30T14:55:45.373041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:45.373049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1977 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:45.373083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1977 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:45.373089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1977 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:45.373094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:45.373396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:45.373457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1977 sessionId:  describe result for acl check
2025-09-30T14:55:45.373482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:45.373487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:45.373488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:45.373489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:45.373494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896070471659118:5700] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:45.373872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:45.373941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:45.373949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:45.373950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:45.373951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:45.373953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:45.373954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:45.373957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:45.373958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:45.373959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:45.373961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:45.373962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.373963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.373964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.373967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:45.373968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:45.373974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:45.374028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896070471659118:5700] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:45.373985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:45.373989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:45.373993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:45.373998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:45.374002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:45.374007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:45.374011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:45.374015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:45.374019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:45.374023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.374028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.374031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.374036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:45.374040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:45.374048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:45.374056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:45.374062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:45.374067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:45.374072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:45.374077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:45.374082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:45.374091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:45.374096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:45.374102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:45.374106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:45.374112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:45.374117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:45.374122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:45.374127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:45.374133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:45.374139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:45.374145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:45.374149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:45.374155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:45.374160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.374165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.374176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.374182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.374192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.374197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.374206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:45.374211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:45.374217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:45.374227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:45.374278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:45.376225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896070471659118:5700] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:45.379614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896070471659118:5700] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:45.379629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896070471659118:5700] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:45.379632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896070471659118:5700] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:45.379643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1977 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:45.380318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:45.381750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:45.381774Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:45.381778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:45.381783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:45.381791Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1976 [2:7555896070381889049:4327]
2025-09-30T14:55:45.381810Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:45.381829Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:45.381837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:45.381841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:45.381844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:45.381866Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:45.381883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:45.381896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:45.381991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.382001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.382006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.382009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:45.382013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:45.382093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:45.382103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.382117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.382134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.382155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:45.382183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896070471659153:5700], now have 1 active actors on pipe
2025-09-30T14:55:45.382192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896070471659090:2454], now have 1 active actors on pipe
2025-09-30T14:55:45.382199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896070381889044:4327]
2025-09-30T14:55:45.382208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896070381889044:4327]
2025-09-30T14:55:45.382210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896070381889044:4327]
2025-09-30T14:55:45.382230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:45.382243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:45.382253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:45.382223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1976
2025-09-30T14:55:45.382234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1976
2025-09-30T14:55:45.382261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:45.382270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:45.382272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:45.382273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:45.382336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:45.382348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:45.382365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896070381889044:4327]
2025-09-30T14:55:45.382381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:45.382387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:45.382420Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d65fc8c-9121eeb-e745db-5a47d267_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:45.382433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:45.382442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:45.382444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:45.382456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:45.382473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:45.382506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:45.382688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:45.382698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:45.382714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:45.382818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1977 partition: 0 MaxSeqNo: 42 sessionId: src_id|6d65fc8c-9121eeb-e745db-5a47d267_0
2025-09-30T14:55:45.383163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ba9d5-930fd87d-2a68f103-b0bcc471_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6d65fc8c-9121eeb-e745db-5a47d267_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:45.386029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d65fc8c-9121eeb-e745db-5a47d267_0] Write session: try to update token
2025-09-30T14:55:45.386051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d65fc8c-9121eeb-e745db-5a47d267_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:45.395114Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:45.395135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:45.395138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:45.395140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:45.395151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896070381889044:4327]
2025-09-30T14:55:45.395159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896070381889044:4327]
2025-09-30T14:55:45.395164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896070381889044:4327]
2025-09-30T14:55:45.395205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:45.395217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.395221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:45.395211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:45.395227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:45.395230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:45.395406Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:45.400849Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1977 sessionId: src_id|6d65fc8c-9121eeb-e745db-5a47d267_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:45.403634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:45.461956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896070471659162:6314]
2025-09-30T14:55:45.462260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1976, pipe: [1:7555896070471659162:6314]
2025-09-30T14:55:45.507800Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:45.508208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:45.508225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:45.508262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896070471659162:6314], now have 1 active actors on pipe
2025-09-30T14:55:45.508482Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:45.508507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896070471659162:6314]
2025-09-30T14:55:45.508522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:45.508526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:45.508539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:45.508611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1977 reason: error at write: Disconnected sessionId: src_id|6d65fc8c-9121eeb-e745db-5a47d267_0
2025-09-30T14:55:45.508790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1977 sessionId: src_id|6d65fc8c-9121eeb-e745db-5a47d267_0 is DEAD
2025-09-30T14:55:45.508943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d65fc8c-9121eeb-e745db-5a47d267_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:45.508954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d65fc8c-9121eeb-e745db-5a47d267_0] Write session will restart in 0.008511s
2025-09-30T14:55:45.508979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d65fc8c-9121eeb-e745db-5a47d267_0] Write session: Do CDS request
2025-09-30T14:55:45.508984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d65fc8c-9121eeb-e745db-5a47d267_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:45.517087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:45.518855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d65fc8c-9121eeb-e745db-5a47d267_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:45.518956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:45.518974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:45.518988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1978
2025-09-30T14:55:45.519139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1978 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:45.519173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1978 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:45.519176Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:45.519185Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:45.519184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1978 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:45.519196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:45.519189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:45.519268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:45.519331Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896070381889114:4323]
2025-09-30T14:55:45.519717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1978 sessionId:  describe result for acl check
2025-09-30T14:55:45.519775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:45.519785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:45.519787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:45.519798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896070471659189:5693] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:45.520065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:45.520378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896070471659189:5693] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:45.520397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:45.520464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:45.520874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:45.520961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:45.520966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:45.520967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:45.520969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:45.520970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:45.520972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:45.520973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:45.520974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:45.520976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:45.520978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:45.520979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.520981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.520982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.520984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:45.520986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:45.520993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:45.521002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:45.521007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:45.521012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:45.521017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:45.521021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:45.521026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:45.521030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:45.521034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:45.521042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:45.521047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.521051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.521055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.521061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:45.521065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:45.521073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:45.521081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:45.521089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:45.521096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:45.521101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:45.521107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:45.521111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:45.521117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:45.521121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:45.521127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:45.521132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:45.521137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:45.521142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:45.521147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:45.521152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:45.521158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:45.521162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:45.521169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:45.521173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:45.521180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:45.521185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.521191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.521196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.521202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.521207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.521218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.521222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:45.521228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:45.521238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:45.521243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:45.521293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:45.522307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896070471659189:5693] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:45.526420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896070471659189:5693] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:45.526432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896070471659189:5693] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:45.526435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896070471659189:5693] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:45.526441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1978 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:45.526837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:45.527852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:45.527872Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:45.527875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:45.527879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:45.527886Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1977 [2:7555896070381889114:4323]
2025-09-30T14:55:45.527901Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:45.527916Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:45.527920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:45.527925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:45.527927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:45.527941Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:45.527952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:45.527959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:45.528017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.528024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.528026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.528033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:45.528035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:45.528104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:45.528113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.528125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.528135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.528154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:45.528177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896070471659227:5693], now have 1 active actors on pipe
2025-09-30T14:55:45.528185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896070471659163:2454], now have 1 active actors on pipe
2025-09-30T14:55:45.528192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896070381889109:4323]
2025-09-30T14:55:45.528194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896070381889109:4323]
2025-09-30T14:55:45.528196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896070381889109:4323]
2025-09-30T14:55:45.528207Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:45.528222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:45.528225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:45.528230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:45.528233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:45.528240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:45.528243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:45.528251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1977
2025-09-30T14:55:45.528258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1977
2025-09-30T14:55:45.528278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896070381889109:4323]
2025-09-30T14:55:45.528285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:45.528289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:45.528322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:45.528331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:45.528367Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f527fb2b-76f2e245-8e85a226-9f0e8131_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:45.528378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:45.528382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:45.528389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:45.528399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:45.528414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:45.528436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:45.528575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:45.528583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:45.528594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:45.528672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1978 partition: 0 MaxSeqNo: 42 sessionId: src_id|f527fb2b-76f2e245-8e85a226-9f0e8131_0
2025-09-30T14:55:45.529059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d65fc8c-9121eeb-e745db-5a47d267_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f527fb2b-76f2e245-8e85a226-9f0e8131_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:45.531904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f527fb2b-76f2e245-8e85a226-9f0e8131_0] Write session: try to update token
2025-09-30T14:55:45.531926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f527fb2b-76f2e245-8e85a226-9f0e8131_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:45.541625Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:45.541669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:45.541672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:45.541680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:45.541689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896070381889109:4323]
2025-09-30T14:55:45.541694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896070381889109:4323]
2025-09-30T14:55:45.541702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896070381889109:4323]
2025-09-30T14:55:45.541750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:45.541758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.541761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:45.541771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:45.541778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:45.541782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:45.541958Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:45.547831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1978 sessionId: src_id|f527fb2b-76f2e245-8e85a226-9f0e8131_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:45.550775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:45.608908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896070471659236:6314]
2025-09-30T14:55:45.609195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1977, pipe: [1:7555896070471659236:6314]
2025-09-30T14:55:45.656870Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:45.657297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:45.657318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:45.657358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896070471659236:6314], now have 1 active actors on pipe
2025-09-30T14:55:45.657596Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:45.657630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:45.657644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:45.657652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896070471659236:6314]
2025-09-30T14:55:45.657703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:45.657711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1978 reason: error at write: Disconnected sessionId: src_id|f527fb2b-76f2e245-8e85a226-9f0e8131_0
2025-09-30T14:55:45.658128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f527fb2b-76f2e245-8e85a226-9f0e8131_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:45.658140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f527fb2b-76f2e245-8e85a226-9f0e8131_0] Write session will restart in 0.009547s
2025-09-30T14:55:45.658163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f527fb2b-76f2e245-8e85a226-9f0e8131_0] Write session: Do CDS request
2025-09-30T14:55:45.658169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f527fb2b-76f2e245-8e85a226-9f0e8131_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:45.657896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1978 sessionId: src_id|f527fb2b-76f2e245-8e85a226-9f0e8131_0 is DEAD
2025-09-30T14:55:45.668488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:45.668759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f527fb2b-76f2e245-8e85a226-9f0e8131_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:45.669139Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:45.669153Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1979
2025-09-30T14:55:45.669281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1979 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:45.669321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1979 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:45.669330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1979 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:45.669334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:45.669763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1979 sessionId:  describe result for acl check
2025-09-30T14:55:45.669791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:45.669798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:45.669800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:45.669807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896070471659267:5685] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:45.670315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896070471659267:5685] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:45.670320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:45.670554Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:45.670567Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:45.670579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:45.670645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:45.670689Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896070381889180:4312]
2025-09-30T14:55:45.671381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:45.671848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:45.671911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:45.672290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:45.672374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896070471659267:5685] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:45.672378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:45.672393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:45.672395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:45.672396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:45.672398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:45.672399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:45.672400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:45.672402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:45.672403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:45.672405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:45.672406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.672408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.672409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.672410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:45.672412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:45.672418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:45.672430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:45.672435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:45.672439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:45.672444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:45.672449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:45.672453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:45.672457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:45.672461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:45.672466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:45.672470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.672474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.672478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.672482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:45.672487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:45.672495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:45.672504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:45.672511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:45.672516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:45.672521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:45.672526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:45.672531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:45.672536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:45.672541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:45.672553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:45.672558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:45.672563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:45.672573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:45.672579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:45.672584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:45.672589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:45.672594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:45.672604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:45.672610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:45.672615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:45.672626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.672631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.672641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.672647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.672657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.672662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.672672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:45.672678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:45.672683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:45.672689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:45.672742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:45.678126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896070471659267:5685] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:45.678142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896070471659267:5685] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:45.678146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896070471659267:5685] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:45.678163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1979 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:45.678555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:45.679883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:45.679907Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:45.679910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:45.679914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:45.679925Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1978 [2:7555896070381889180:4312]
2025-09-30T14:55:45.679942Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:45.679961Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:45.679970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:45.679974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:45.679976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:45.679991Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:45.680003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:45.680009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:45.680075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.680085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.680087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.680092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:45.680094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:45.680158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:45.680165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.680179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.680195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.680214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:45.680235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896070471659239:2454], now have 1 active actors on pipe
2025-09-30T14:55:45.680242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896070471659305:5685], now have 1 active actors on pipe
2025-09-30T14:55:45.680248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896070381889174:4312]
2025-09-30T14:55:45.680250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896070381889174:4312]
2025-09-30T14:55:45.680252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896070381889174:4312]
2025-09-30T14:55:45.680269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:45.680288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:45.680301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:45.680304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:45.680315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:45.680319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:45.680322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:45.680338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896070381889174:4312]
2025-09-30T14:55:45.680348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:45.680363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:45.680390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:45.680396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:45.680419Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50002d5e-ad3dc351-5755d71a-c11b1dff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:45.680425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:45.680431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:45.680434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:45.680444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:45.680453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:45.680465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:45.680341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1978
2025-09-30T14:55:45.680348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1978
2025-09-30T14:55:45.680743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:45.680753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:45.680769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:45.680865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1979 partition: 0 MaxSeqNo: 42 sessionId: src_id|50002d5e-ad3dc351-5755d71a-c11b1dff_0
2025-09-30T14:55:45.681233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f527fb2b-76f2e245-8e85a226-9f0e8131_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|50002d5e-ad3dc351-5755d71a-c11b1dff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:45.684190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50002d5e-ad3dc351-5755d71a-c11b1dff_0] Write session: try to update token
2025-09-30T14:55:45.684210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50002d5e-ad3dc351-5755d71a-c11b1dff_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:45.694338Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:45.694360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:45.694363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:45.694365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:45.694375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896070381889174:4312]
2025-09-30T14:55:45.694382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896070381889174:4312]
2025-09-30T14:55:45.694387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896070381889174:4312]
2025-09-30T14:55:45.694428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:45.694438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:45.694441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.694444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:45.694445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:45.694449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:45.694578Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:45.701533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1979 sessionId: src_id|50002d5e-ad3dc351-5755d71a-c11b1dff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:45.704301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:45.757918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896070471659312:6314]
2025-09-30T14:55:45.758315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1978, pipe: [1:7555896070471659312:6314]
2025-09-30T14:55:45.815386Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:45.815869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:45.815880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:45.815920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896070471659312:6314], now have 1 active actors on pipe
2025-09-30T14:55:45.816671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50002d5e-ad3dc351-5755d71a-c11b1dff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:45.816683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50002d5e-ad3dc351-5755d71a-c11b1dff_0] Write session will restart in 0.006876s
2025-09-30T14:55:45.816221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:45.816256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896070471659312:6314]
2025-09-30T14:55:45.816709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50002d5e-ad3dc351-5755d71a-c11b1dff_0] Write session: Do CDS request
2025-09-30T14:55:45.816725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50002d5e-ad3dc351-5755d71a-c11b1dff_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:45.816268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:45.816271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:45.816343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1979 reason: error at write: Disconnected sessionId: src_id|50002d5e-ad3dc351-5755d71a-c11b1dff_0
2025-09-30T14:55:45.816526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1979 sessionId: src_id|50002d5e-ad3dc351-5755d71a-c11b1dff_0 is DEAD
2025-09-30T14:55:45.816212Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:45.825973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50002d5e-ad3dc351-5755d71a-c11b1dff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:45.827530Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:45.827544Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1980
2025-09-30T14:55:45.827734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1980 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:45.827777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1980 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:45.827781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1980 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:45.827785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:45.828216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1980 sessionId:  describe result for acl check
2025-09-30T14:55:45.828252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:45.828254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:45.828256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:45.828263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896070471659353:5675] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:45.828528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:45.828773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896070471659353:5675] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:45.830368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:45.830586Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:45.830598Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:45.830610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:45.830672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:45.830715Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896070381889258:4319]
2025-09-30T14:55:45.831002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896070471659353:5675] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:45.831357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:45.831720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:45.831773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:45.832117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:45.832206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:45.832213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:45.832215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:45.832216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:45.832217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:45.832218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:45.832219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:45.832220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:45.832221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:45.832223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:45.832224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.832225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.832226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.832227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:45.832228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:45.832234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:45.832244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:45.832248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:45.832252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:45.832256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:45.832260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:45.832266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:45.832270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:45.832276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:45.832280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:45.832284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.832287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.832291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.832295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:45.832299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:45.832307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:45.832315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:45.832322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:45.832327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:45.832333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:45.832338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:45.832342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:45.832347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:45.832357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:45.832363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:45.832367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:45.832372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:45.832377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:45.832382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:45.832391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:45.832395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:45.832400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:45.832405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:45.832413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:45.832418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:45.832423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.832428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.832435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.832444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.832448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.832453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.832473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:45.832477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:45.832481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:45.832486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:45.832534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:45.837999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896070471659353:5675] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:45.838017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896070471659353:5675] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:45.838020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896070471659353:5675] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:45.838031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1980 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:45.838404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:45.839348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:45.839364Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:45.839369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:45.839373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:45.839381Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1979 [2:7555896070381889258:4319]
2025-09-30T14:55:45.839397Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:45.839414Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:45.839425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:45.839429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:45.839431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:45.839446Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:45.839458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:45.839464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:45.839533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.839541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.839543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.839546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:45.839549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:45.839613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:45.839623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.839635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:45.839645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:45.839662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:45.839684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896070381889252:4319]
2025-09-30T14:55:45.839686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896070381889252:4319]
2025-09-30T14:55:45.839689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896070381889252:4319]
2025-09-30T14:55:45.839698Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:45.839711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:45.839716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:45.839723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:45.839726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:45.839731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:45.839733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:45.839743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896070471659393:5675], now have 1 active actors on pipe
2025-09-30T14:55:45.839777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896070471659314:2454], now have 1 active actors on pipe
2025-09-30T14:55:45.839787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896070381889252:4319]
2025-09-30T14:55:45.839794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:45.839804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:45.839807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1979
2025-09-30T14:55:45.839825Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1979
2025-09-30T14:55:45.839904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:45.839919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:45.839949Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7730613-71b46065-75a9f34d-dd281250_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:45.839962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:45.839975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:45.839982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:45.839992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:45.840007Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:45.840029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:45.840212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:45.840224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:45.840243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:45.840378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1980 partition: 0 MaxSeqNo: 42 sessionId: src_id|b7730613-71b46065-75a9f34d-dd281250_0
2025-09-30T14:55:45.840757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50002d5e-ad3dc351-5755d71a-c11b1dff_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b7730613-71b46065-75a9f34d-dd281250_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:45.843650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7730613-71b46065-75a9f34d-dd281250_0] Write session: try to update token
2025-09-30T14:55:45.843668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7730613-71b46065-75a9f34d-dd281250_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:45.859653Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:45.859675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:45.859685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896070381889252:4319]
2025-09-30T14:55:45.859736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:45.859746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:45.859959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:45.860144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:45.860294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:45.860436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:45.860638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:45.860685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:45.859720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1980 sessionId: src_id|b7730613-71b46065-75a9f34d-dd281250_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:45.862467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:45.862659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:45.862687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:45.862720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:45.862824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:45.864211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:45.864228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:45.864233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:45.864235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:45.864244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896070381889252:4319]
2025-09-30T14:55:45.864248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896070381889252:4319]
2025-09-30T14:55:45.864254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896070381889252:4319]
2025-09-30T14:55:45.864288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:45.864296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:45.864299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:45.864303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:45.864310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:45.864331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:45.864432Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:45.916586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896070471659421:6314]
2025-09-30T14:55:45.916736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1979, pipe: [1:7555896070471659421:6314]
2025-09-30T14:55:45.984228Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:45.992999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:45.993040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:45.993241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:45.993323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:45.993400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:45.993478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:45.993548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:45.993562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:45.993642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:45.993711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:45.993780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:45.993851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:45.993900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:45.993908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:45.993985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:45.994058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:45.994130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:45.994208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:45.994258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:45.994266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:45.994348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:45.994458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:45.994571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:45.994641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:45.994687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:45.994695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:45.994766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:45.994868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:45.994978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:45.995080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:45.995132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:45.995140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:45.995211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:45.995299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:45.995367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:45.995441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:45.995497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:45.995506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:45.995577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:45.995650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:45.995720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:45.997230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:45.997245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:45.997277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1980 reason: error at write: Disconnected sessionId: src_id|b7730613-71b46065-75a9f34d-dd281250_0
2025-09-30T14:55:45.997302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896070471659421:6314]
2025-09-30T14:55:45.997333Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:45.997447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1980 sessionId: src_id|b7730613-71b46065-75a9f34d-dd281250_0 is DEAD
2025-09-30T14:55:45.995792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:45.995858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:45.995862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:45.995934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:45.995992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:45.996082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:45.996153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:45.996201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:45.996206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:45.996279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:45.996339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:45.996402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:45.996471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:45.996513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:45.996516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:45.996587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:45.996646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:45.996712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:45.996779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:45.996842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:45.996846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:45.996928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896070471659421:6314], now have 1 active actors on pipe
2025-09-30T14:55:45.998287Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:45.999340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7730613-71b46065-75a9f34d-dd281250_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:45.999352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7730613-71b46065-75a9f34d-dd281250_0] Write session will restart in 0.009897s
2025-09-30T14:55:45.999376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7730613-71b46065-75a9f34d-dd281250_0] Write session: Do CDS request
2025-09-30T14:55:45.999381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7730613-71b46065-75a9f34d-dd281250_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:46.006990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:46.008432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:46.008633Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:46.008649Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:46.008660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:46.008721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:46.008763Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896074676856658:4294]
2025-09-30T14:55:46.009436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:46.009765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:46.009818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:46.010158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:46.010241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:46.010249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:46.010250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:46.010251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:46.010252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:46.010254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:46.010255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:46.010256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:46.010257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:46.010259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:46.010260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.010261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.010263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.010265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:46.010266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:46.010272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:46.010282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:46.010287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:46.010292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:46.010296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:46.010300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:46.010304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:46.010308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:46.010313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:46.010317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:46.010321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.010325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.010329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.010333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:46.010336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:46.010348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:46.010356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:46.010361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:46.010367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:46.010371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:46.010375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:46.010379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:46.010384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:46.010390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:46.010395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:46.010406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:46.010412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:46.010421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:46.010427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:46.010437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:46.010442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:46.010453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:46.010465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:46.010474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:46.010479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:46.010489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.010495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.010503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.010510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.010515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.010524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.010528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:46.010533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:46.010543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:46.010548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:46.010598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:46.010779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7730613-71b46065-75a9f34d-dd281250_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:46.010840Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:46.010855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1981
2025-09-30T14:55:46.010981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1981 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:46.011012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1981 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:46.011022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1981 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:46.011026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:46.011484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1981 sessionId:  describe result for acl check
2025-09-30T14:55:46.011529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:46.011538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:46.011540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:46.011546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896074766626755:5663] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:46.012217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896074766626755:5663] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:46.014762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896074766626755:5663] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:46.016044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:46.016926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:46.016942Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:46.016947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:46.016952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:46.016958Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1980 [2:7555896074676856658:4294]
2025-09-30T14:55:46.016976Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:46.016991Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:46.017000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:46.017003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:46.017006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:46.017023Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:46.017030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:46.017036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:46.017089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.017097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.017099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.017102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:46.017104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:46.017169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:46.017177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.017189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.017205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.017223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:46.017285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1980
2025-09-30T14:55:46.017246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896070471659425:2454], now have 1 active actors on pipe
2025-09-30T14:55:46.017257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896074676856653:4294]
2025-09-30T14:55:46.017259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896074676856653:4294]
2025-09-30T14:55:46.017261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896074676856653:4294]
2025-09-30T14:55:46.017276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:46.017288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:46.017298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:46.017301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:46.017302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:46.017303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:46.017305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:46.017334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896074676856653:4294]
2025-09-30T14:55:46.017337Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:46.017340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:46.017872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896074766626755:5663] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:46.017883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896074766626755:5663] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:46.017887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896074766626755:5663] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:46.017895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1981 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:46.018145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1980
2025-09-30T14:55:46.018134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896074766626792:5663], now have 1 active actors on pipe
2025-09-30T14:55:46.018222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:46.018237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:46.018265Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aacbfb3d-9c985e6e-fa601eaa-143f94b6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:46.018278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:46.018287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:46.018294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:46.018303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:46.018314Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:46.018329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:46.018495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:46.018502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:46.018514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:46.018599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1981 partition: 0 MaxSeqNo: 42 sessionId: src_id|aacbfb3d-9c985e6e-fa601eaa-143f94b6_0
2025-09-30T14:55:46.018931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7730613-71b46065-75a9f34d-dd281250_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|aacbfb3d-9c985e6e-fa601eaa-143f94b6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:46.021968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aacbfb3d-9c985e6e-fa601eaa-143f94b6_0] Write session: try to update token
2025-09-30T14:55:46.021986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aacbfb3d-9c985e6e-fa601eaa-143f94b6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:46.030472Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:46.030506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:46.030510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:46.030512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:46.030526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896074676856653:4294]
2025-09-30T14:55:46.030533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896074676856653:4294]
2025-09-30T14:55:46.030542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896074676856653:4294]
2025-09-30T14:55:46.030608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:46.030619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:46.030624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:46.030629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:46.030629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.030631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:46.030849Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:46.038494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1981 sessionId: src_id|aacbfb3d-9c985e6e-fa601eaa-143f94b6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:46.041338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:46.097872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896074766626796:6314]
2025-09-30T14:55:46.098194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1980, pipe: [1:7555896074766626796:6314]
2025-09-30T14:55:46.152547Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:46.153082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aacbfb3d-9c985e6e-fa601eaa-143f94b6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:46.152614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896074766626796:6314]
2025-09-30T14:55:46.153098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aacbfb3d-9c985e6e-fa601eaa-143f94b6_0] Write session will restart in 0.006724s
2025-09-30T14:55:46.152634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:46.152637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:46.152708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1981 reason: error at write: Disconnected sessionId: src_id|aacbfb3d-9c985e6e-fa601eaa-143f94b6_0
2025-09-30T14:55:46.152902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1981 sessionId: src_id|aacbfb3d-9c985e6e-fa601eaa-143f94b6_0 is DEAD
2025-09-30T14:55:46.153124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aacbfb3d-9c985e6e-fa601eaa-143f94b6_0] Write session: Do CDS request
2025-09-30T14:55:46.153130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aacbfb3d-9c985e6e-fa601eaa-143f94b6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:46.151578Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:46.152127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:46.152136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:46.152154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896074766626796:6314], now have 1 active actors on pipe
2025-09-30T14:55:46.152504Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:46.160906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aacbfb3d-9c985e6e-fa601eaa-143f94b6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:46.161436Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:46.161452Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1982
2025-09-30T14:55:46.163326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:46.163761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1982 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:46.163810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1982 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:46.163832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1982 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:46.163836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:46.163901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:46.164070Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:46.164080Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:46.164090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:46.164140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:46.164194Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896074676856726:4286]
2025-09-30T14:55:46.164283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1982 sessionId:  describe result for acl check
2025-09-30T14:55:46.164314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:46.164321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:46.164323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:46.164329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896074766626833:5654] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:46.164697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:46.164904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896074766626833:5654] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:46.164981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:46.165026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:46.165382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:46.165437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:46.165439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:46.165442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:46.165443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:46.165444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:46.165446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:46.165447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:46.165449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:46.165450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:46.165452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:46.165453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.165454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.165455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.165456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:46.165458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:46.165463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:46.165473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:46.165477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:46.165480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:46.165483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:46.165486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:46.165489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:46.165493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:46.165496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:46.165510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:46.165513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.165517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.165520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.165523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:46.165527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:46.165535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:46.165544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:46.165550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:46.165558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:46.165562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:46.165567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:46.165571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:46.165576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:46.165582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:46.165587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:46.165590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:46.165595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:46.165600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:46.165605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:46.165608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:46.165613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:46.165618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:46.165622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:46.165626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:46.165630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:46.165634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.165639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.165644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.165649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.165655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.165660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.165664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:46.165669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:46.165673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:46.165677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:46.165720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:46.167155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896074766626833:5654] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:46.171190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896074766626833:5654] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:46.171205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896074766626833:5654] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:46.171209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896074766626833:5654] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:46.171217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1982 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:46.176120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:46.177229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:46.177253Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:46.177256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:46.177772Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1981
2025-09-30T14:55:46.177260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:46.177268Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1981 [2:7555896074676856726:4286]
2025-09-30T14:55:46.177283Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:46.177299Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:46.177302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:46.177305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:46.177825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1981
2025-09-30T14:55:46.177308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:46.177323Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:46.177330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:46.177340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:46.177402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.177404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.177406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.177409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:46.177412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:46.177490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:46.177493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.177520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.177532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.177549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:46.177567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896074676856721:4286]
2025-09-30T14:55:46.177569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896074676856721:4286]
2025-09-30T14:55:46.177571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896074676856721:4286]
2025-09-30T14:55:46.177581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:46.177590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:46.177594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:46.177595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:46.177597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:46.177608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:46.177611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:46.177652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896074766626803:2454], now have 1 active actors on pipe
2025-09-30T14:55:46.177668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896074766626871:5654], now have 1 active actors on pipe
2025-09-30T14:55:46.177671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896074676856721:4286]
2025-09-30T14:55:46.177682Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:46.177709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:46.177935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:46.177952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:46.177979Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31c5c9a3-bd000218-4c2064cc-21c77e96_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:46.177988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:46.177992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:46.177996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:46.178018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:46.178035Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:46.178051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:46.178207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:46.178216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:46.178230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:46.178332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1982 partition: 0 MaxSeqNo: 42 sessionId: src_id|31c5c9a3-bd000218-4c2064cc-21c77e96_0
2025-09-30T14:55:46.178703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aacbfb3d-9c985e6e-fa601eaa-143f94b6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|31c5c9a3-bd000218-4c2064cc-21c77e96_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:46.181479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31c5c9a3-bd000218-4c2064cc-21c77e96_0] Write session: try to update token
2025-09-30T14:55:46.181512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31c5c9a3-bd000218-4c2064cc-21c77e96_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:46.191845Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:46.191865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:46.191867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:46.191869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:46.191880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896074676856721:4286]
2025-09-30T14:55:46.191886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896074676856721:4286]
2025-09-30T14:55:46.191894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896074676856721:4286]
2025-09-30T14:55:46.191936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:46.191946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.191948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:46.191955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:46.191956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:46.191960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:46.192131Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:46.199817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1982 sessionId: src_id|31c5c9a3-bd000218-4c2064cc-21c77e96_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:46.204074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:46.252996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896074766626882:6314]
2025-09-30T14:55:46.253274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1981, pipe: [1:7555896074766626882:6314]
2025-09-30T14:55:46.309514Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:46.309862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:46.309883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:46.309929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896074766626882:6314], now have 1 active actors on pipe
2025-09-30T14:55:46.310178Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:46.310184Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:46.310190Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896074766626882:6314]
2025-09-30T14:55:46.310221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:46.310236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:46.310301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1982 reason: error at write: Disconnected sessionId: src_id|31c5c9a3-bd000218-4c2064cc-21c77e96_0
2025-09-30T14:55:46.310503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1982 sessionId: src_id|31c5c9a3-bd000218-4c2064cc-21c77e96_0 is DEAD
2025-09-30T14:55:46.310662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31c5c9a3-bd000218-4c2064cc-21c77e96_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:46.310674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31c5c9a3-bd000218-4c2064cc-21c77e96_0] Write session will restart in 0.009050s
2025-09-30T14:55:46.310698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31c5c9a3-bd000218-4c2064cc-21c77e96_0] Write session: Do CDS request
2025-09-30T14:55:46.310704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31c5c9a3-bd000218-4c2064cc-21c77e96_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:46.319579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:46.320791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31c5c9a3-bd000218-4c2064cc-21c77e96_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:46.320877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:46.320892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1983
2025-09-30T14:55:46.321074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1983 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:46.321121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1983 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:46.321131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1983 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:46.321136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:46.321242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:46.321452Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:46.321463Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:46.321474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:46.321556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:46.321556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1983 sessionId:  describe result for acl check
2025-09-30T14:55:46.321591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:46.321594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:46.321600Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896074676856795:4284]
2025-09-30T14:55:46.321595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:46.321601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896074766626915:5648] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:46.322147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896074766626915:5648] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:46.322316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:46.322630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:46.322678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:46.323041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:46.323106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:46.323112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:46.323114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:46.323115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:46.323116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:46.323117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:46.323119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:46.323120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:46.323121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:46.323124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:46.323125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.323127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.323128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.323130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:46.323131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:46.323137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:46.323147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:46.323151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:46.323155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:46.323159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:46.323163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:46.323166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:46.323170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:46.323174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:46.323178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:46.323182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.323186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.323189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.323195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:46.323199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:46.323206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:46.323214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:46.323220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:46.323226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:46.323231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:46.323237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:46.323259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:46.323266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:46.323277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:46.323282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:46.323287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:46.323297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:46.323302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:46.323314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:46.323318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:46.323329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:46.323334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:46.323344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:46.323348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:46.323359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:46.323364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.323374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.323379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.323388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.323395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.323404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.323408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:46.323419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:46.323425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:46.323436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:46.323488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:46.324065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896074766626915:5648] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:46.328824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896074766626915:5648] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:46.328840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896074766626915:5648] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:46.328844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896074766626915:5648] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:46.328853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1983 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:46.329401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:46.330333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:46.330355Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:46.330358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:46.330363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:46.330371Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1982 [2:7555896074676856795:4284]
2025-09-30T14:55:46.330388Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:46.330405Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:46.330411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:46.330415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:46.330417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:46.330434Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:46.330447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:46.330453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:46.330521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.330529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.330531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.330535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:46.330538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:46.330605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:46.330613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.330626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.330643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.330668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:46.330690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896074766626954:5648], now have 1 active actors on pipe
2025-09-30T14:55:46.330702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896074766626884:2454], now have 1 active actors on pipe
2025-09-30T14:55:46.330708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896074676856790:4284]
2025-09-30T14:55:46.330711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896074676856790:4284]
2025-09-30T14:55:46.330713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896074676856790:4284]
2025-09-30T14:55:46.330725Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:46.330739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:46.330750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:46.330753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:46.330754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:46.330757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:46.330757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:46.330794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896074676856790:4284]
2025-09-30T14:55:46.330806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:46.330813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:46.330831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:46.330840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:46.330887Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|21a17cf9-a569480c-f091d750-c231dc20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:46.330899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:46.330902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:46.330904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:46.330916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:46.330929Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:46.330959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:46.331151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:46.331158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:46.331171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:46.331655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31c5c9a3-bd000218-4c2064cc-21c77e96_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|21a17cf9-a569480c-f091d750-c231dc20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:46.330743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1982
2025-09-30T14:55:46.330746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1982
2025-09-30T14:55:46.331264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1983 partition: 0 MaxSeqNo: 42 sessionId: src_id|21a17cf9-a569480c-f091d750-c231dc20_0
2025-09-30T14:55:46.334726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21a17cf9-a569480c-f091d750-c231dc20_0] Write session: try to update token
2025-09-30T14:55:46.334748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21a17cf9-a569480c-f091d750-c231dc20_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:46.343593Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:46.343615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:46.343617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:46.343619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:46.343630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896074676856790:4284]
2025-09-30T14:55:46.343641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896074676856790:4284]
2025-09-30T14:55:46.343643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896074676856790:4284]
2025-09-30T14:55:46.343685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:46.343695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.343697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:46.343868Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:46.347343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:46.347360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:46.347364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:46.350620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1983 sessionId: src_id|21a17cf9-a569480c-f091d750-c231dc20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:46.353455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:46.410258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896074766626961:6314]
2025-09-30T14:55:46.410607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1982, pipe: [1:7555896074766626961:6314]
2025-09-30T14:55:46.464009Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:46.464433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:46.464451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:46.464491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896074766626961:6314], now have 1 active actors on pipe
2025-09-30T14:55:46.464732Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:46.465117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:46.465131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:46.465214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1983 reason: error at write: Disconnected sessionId: src_id|21a17cf9-a569480c-f091d750-c231dc20_0
2025-09-30T14:55:46.465405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1983 sessionId: src_id|21a17cf9-a569480c-f091d750-c231dc20_0 is DEAD
2025-09-30T14:55:46.465410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896074766626961:6314]
2025-09-30T14:55:46.465431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:46.465649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21a17cf9-a569480c-f091d750-c231dc20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:46.465660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21a17cf9-a569480c-f091d750-c231dc20_0] Write session will restart in 0.007320s
2025-09-30T14:55:46.465685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21a17cf9-a569480c-f091d750-c231dc20_0] Write session: Do CDS request
2025-09-30T14:55:46.465693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21a17cf9-a569480c-f091d750-c231dc20_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:46.473730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21a17cf9-a569480c-f091d750-c231dc20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:46.473846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:46.473871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1984
2025-09-30T14:55:46.473986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1984 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:46.474020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1984 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:46.474030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1984 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:46.474034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:46.474451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1984 sessionId:  describe result for acl check
2025-09-30T14:55:46.474484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:46.474485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:46.474487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:46.474493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896074766626994:5642] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:46.474663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:46.475025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896074766626994:5642] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:46.476668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:46.476879Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:46.476899Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:46.476909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:46.476959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:46.477012Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896074676856867:4279]
2025-09-30T14:55:46.477653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:46.477959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:46.478004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:46.477538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896074766626994:5642] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:46.478358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:46.478427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:46.478431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:46.478432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:46.478433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:46.478435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:46.478436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:46.478437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:46.478438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:46.478440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:46.478441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:46.478442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.478443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.478444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.478445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:46.478447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:46.478452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:46.478461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:46.478465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:46.478469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:46.478472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:46.478476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:46.478479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:46.478483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:46.478487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:46.478490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:46.478493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.478497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.478501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.478504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:46.478510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:46.478518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:46.478527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:46.478531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:46.478536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:46.478540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:46.478544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:46.478548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:46.478552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:46.478556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:46.478561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:46.478564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:46.478569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:46.478573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:46.478577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:46.478581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:46.478585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:46.478589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:46.478593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:46.478597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:46.478602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:46.478608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.478612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.478623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.478628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.478632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.478637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.478640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:46.478644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:46.478648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:46.478653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:46.478691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:46.484098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896074766626994:5642] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:46.484114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896074766626994:5642] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:46.484117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896074766626994:5642] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:46.484127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1984 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:46.484402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:46.485440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:46.485459Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:46.485463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:46.485467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:46.485474Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1983 [2:7555896074676856867:4279]
2025-09-30T14:55:46.485490Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:46.485520Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:46.485525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:46.485528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:46.485530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:46.485547Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:46.485558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:46.485565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:46.485622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.485631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.485632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.485635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:46.485637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:46.485701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:46.485709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.485720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.485730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.485743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:46.485764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896074766626963:2454], now have 1 active actors on pipe
2025-09-30T14:55:46.485772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896074766627033:5642], now have 1 active actors on pipe
2025-09-30T14:55:46.485778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896074676856862:4279]
2025-09-30T14:55:46.485779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896074676856862:4279]
2025-09-30T14:55:46.485781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896074676856862:4279]
2025-09-30T14:55:46.485795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:46.485812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:46.485823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:46.485830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:46.485832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:46.485835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:46.485837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:46.485864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896074676856862:4279]
2025-09-30T14:55:46.485871Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:46.485877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:46.485860Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1983
2025-09-30T14:55:46.485894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1983
2025-09-30T14:55:46.486081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:46.486093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:46.486120Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1ed660c-cdcc6623-7bef7451-e5f18b6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:46.486133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:46.486143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:46.486145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:46.486155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:46.486171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:46.486199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:46.486382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:46.486390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:46.486404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:46.486479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1984 partition: 0 MaxSeqNo: 42 sessionId: src_id|f1ed660c-cdcc6623-7bef7451-e5f18b6_0
2025-09-30T14:55:46.486832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21a17cf9-a569480c-f091d750-c231dc20_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f1ed660c-cdcc6623-7bef7451-e5f18b6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:46.489673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1ed660c-cdcc6623-7bef7451-e5f18b6_0] Write session: try to update token
2025-09-30T14:55:46.489691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1ed660c-cdcc6623-7bef7451-e5f18b6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:46.498523Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:46.498546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:46.498555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896074676856862:4279]
2025-09-30T14:55:46.498600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:46.498602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:46.498774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:46.498929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:46.499068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:46.499212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:46.499465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:46.499512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:46.509794Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:46.509817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:46.509819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:46.509821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:46.509836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896074676856862:4279]
2025-09-30T14:55:46.509841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896074676856862:4279]
2025-09-30T14:55:46.509845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896074676856862:4279]
2025-09-30T14:55:46.509891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:46.509897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.509899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:46.509902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:46.509909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:46.509913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:46.510048Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:46.514110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1984 sessionId: src_id|f1ed660c-cdcc6623-7bef7451-e5f18b6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:46.516869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:46.565794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896074766627041:6314]
2025-09-30T14:55:46.566092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1983, pipe: [1:7555896074766627041:6314]
2025-09-30T14:55:46.623855Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:46.624183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:46.624199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:46.624220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896074766627041:6314], now have 1 active actors on pipe
2025-09-30T14:55:46.624502Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:46.626630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:46.626644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:46.626668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896074766627041:6314]
2025-09-30T14:55:46.626690Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:46.626743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1984 reason: error at write: Disconnected sessionId: src_id|f1ed660c-cdcc6623-7bef7451-e5f18b6_0
2025-09-30T14:55:46.626919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1984 sessionId: src_id|f1ed660c-cdcc6623-7bef7451-e5f18b6_0 is DEAD
2025-09-30T14:55:46.627147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1ed660c-cdcc6623-7bef7451-e5f18b6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:46.627158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1ed660c-cdcc6623-7bef7451-e5f18b6_0] Write session will restart in 0.006759s
2025-09-30T14:55:46.627181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1ed660c-cdcc6623-7bef7451-e5f18b6_0] Write session: Do CDS request
2025-09-30T14:55:46.627188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1ed660c-cdcc6623-7bef7451-e5f18b6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:46.634768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1ed660c-cdcc6623-7bef7451-e5f18b6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:46.634914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:46.634928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1985
2025-09-30T14:55:46.635141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1985 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:46.635185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1985 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:46.635196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1985 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:46.635200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:46.635731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1985 sessionId:  describe result for acl check
2025-09-30T14:55:46.635765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:46.635767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:46.635769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:46.635775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896074766627074:5639] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:46.636183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:46.636312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896074766627074:5639] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:46.639028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:46.639236Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:46.639260Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:46.639270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:46.639323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:46.639357Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896074676856938:4273]
2025-09-30T14:55:46.639448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896074766627074:5639] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:46.640033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:46.640359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:46.640402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:46.640735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:46.640798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:46.640804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:46.640805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:46.640807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:46.640808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:46.640811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:46.640813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:46.640814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:46.640815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:46.640816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:46.640818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.640819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.640820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.640821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:46.640822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:46.640827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:46.640837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:46.640841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:46.640846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:46.640849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:46.640854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:46.640857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:46.640861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:46.640865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:46.640868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:46.640871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.640875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.640879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.640882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:46.640886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:46.640894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:46.640918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:46.640923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:46.640929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:46.640934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:46.640938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:46.640943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:46.640948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:46.640952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:46.640957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:46.640962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:46.640966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:46.640971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:46.640977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:46.640982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:46.640986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:46.640990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:46.640995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:46.640999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:46.641005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:46.641009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.641014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.641026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.641031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.641037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.641047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.641051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:46.641056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:46.641065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:46.641069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:46.641111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:46.646394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896074766627074:5639] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:46.646413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896074766627074:5639] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:46.646416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896074766627074:5639] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:46.646426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1985 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:46.646672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:46.647573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:46.647592Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:46.647594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:46.647598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:46.647605Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1984 [2:7555896074676856938:4273]
2025-09-30T14:55:46.647622Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:46.647644Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:46.647652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:46.647656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:46.647665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:46.647680Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:46.647686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:46.647693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:46.647749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.647756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.647758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.647762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:46.647764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:46.647830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:46.647837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.647849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.647865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.647881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:46.647899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896074766627117:5639], now have 1 active actors on pipe
2025-09-30T14:55:46.647902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896074766627043:2454], now have 1 active actors on pipe
2025-09-30T14:55:46.647908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896074676856933:4273]
2025-09-30T14:55:46.647916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896074676856933:4273]
2025-09-30T14:55:46.647918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896074676856933:4273]
2025-09-30T14:55:46.647964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1984
2025-09-30T14:55:46.647968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1984
2025-09-30T14:55:46.647998Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:46.648015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:46.648033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:46.648040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:46.648042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:46.648046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:46.648048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:46.648086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:46.648095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:46.648111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896074676856933:4273]
2025-09-30T14:55:46.648122Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:46.648138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:46.648153Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d83b6d7-102b1c0b-78e7ff3-81af561_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:46.648165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:46.648170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:46.648176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:46.648186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:46.648199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:46.648218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:46.648375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:46.648385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:46.648399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:46.648495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1985 partition: 0 MaxSeqNo: 42 sessionId: src_id|3d83b6d7-102b1c0b-78e7ff3-81af561_0
2025-09-30T14:55:46.648846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1ed660c-cdcc6623-7bef7451-e5f18b6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3d83b6d7-102b1c0b-78e7ff3-81af561_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:46.651656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d83b6d7-102b1c0b-78e7ff3-81af561_0] Write session: try to update token
2025-09-30T14:55:46.651675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d83b6d7-102b1c0b-78e7ff3-81af561_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:46.660961Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:46.660984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:46.660987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:46.660989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:46.660999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896074676856933:4273]
2025-09-30T14:55:46.661004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896074676856933:4273]
2025-09-30T14:55:46.661009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896074676856933:4273]
2025-09-30T14:55:46.661049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:46.661057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.661066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:46.661065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:46.661088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:46.661092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:46.661212Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:46.666157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1985 sessionId: src_id|3d83b6d7-102b1c0b-78e7ff3-81af561_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:46.669043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:46.726599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896074766627124:6314]
2025-09-30T14:55:46.726970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1984, pipe: [1:7555896074766627124:6314]
2025-09-30T14:55:46.774986Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:46.775338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:46.775353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:46.775393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896074766627124:6314], now have 1 active actors on pipe
2025-09-30T14:55:46.775626Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:46.776181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d83b6d7-102b1c0b-78e7ff3-81af561_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:46.776194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d83b6d7-102b1c0b-78e7ff3-81af561_0] Write session will restart in 0.005894s
2025-09-30T14:55:46.776219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d83b6d7-102b1c0b-78e7ff3-81af561_0] Write session: Do CDS request
2025-09-30T14:55:46.776225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d83b6d7-102b1c0b-78e7ff3-81af561_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:46.775730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:46.775753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896074766627124:6314]
2025-09-30T14:55:46.775759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:46.775776Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:46.775837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1985 reason: error at write: Disconnected sessionId: src_id|3d83b6d7-102b1c0b-78e7ff3-81af561_0
2025-09-30T14:55:46.776012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1985 sessionId: src_id|3d83b6d7-102b1c0b-78e7ff3-81af561_0 is DEAD
2025-09-30T14:55:46.784106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d83b6d7-102b1c0b-78e7ff3-81af561_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:46.784225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:46.784240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1986
2025-09-30T14:55:46.784371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1986 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:46.784413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1986 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:46.784423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1986 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:46.784428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:46.784878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1986 sessionId:  describe result for acl check
2025-09-30T14:55:46.784914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:46.784922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:46.784924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:46.784930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896074766627159:5630] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:46.785489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896074766627159:5630] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:46.785991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:46.787419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896074766627159:5630] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:46.788058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:46.788289Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:46.788299Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:46.788309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:46.788369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:46.788409Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896074676857023:4269]
2025-09-30T14:55:46.789065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:46.789396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:46.789487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:46.790046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:46.790200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:46.790213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:46.790215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:46.790217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:46.790219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:46.790220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:46.790223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:46.790225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:46.790227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:46.790228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:46.790230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.790231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.790233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.790234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:46.790235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:46.790249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:46.790262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:46.790268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:46.790274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:46.790279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:46.790284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:46.790289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:46.790296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:46.790302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:46.790307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:46.790311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.790315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.790318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.790322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:46.790327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:46.790339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:46.790350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:46.790359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:46.790366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:46.790375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:46.790382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:46.790389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:46.790396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:46.790403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:46.790410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:46.790416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:46.790439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:46.790458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:46.790471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:46.790479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:46.790485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:46.790494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:46.790509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:46.790526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:46.790533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:46.790541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.790549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.790555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.790562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.790580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.790587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.790594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:46.790601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:46.790610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:46.790624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:46.790695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:46.790347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896074766627159:5630] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:46.790363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896074766627159:5630] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:46.790367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896074766627159:5630] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:46.790377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1986 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:46.797888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:46.799661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1985
2025-09-30T14:55:46.799706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1985
2025-09-30T14:55:46.799126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:46.799145Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:46.799149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:46.799153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:46.799160Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1985 [2:7555896074676857023:4269]
2025-09-30T14:55:46.799179Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:46.799196Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:46.799200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:46.799203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:46.799206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:46.799223Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:46.799230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:46.799237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:46.799341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.799344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.799347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.799351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:46.799355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:46.799435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:46.799438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.799450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.799461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.799478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:46.799494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896074676857017:4269]
2025-09-30T14:55:46.799497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896074676857017:4269]
2025-09-30T14:55:46.799498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896074676857017:4269]
2025-09-30T14:55:46.799506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:46.799521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:46.799525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:46.799529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:46.799531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:46.799538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:46.799541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:46.799551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896074766627127:2454], now have 1 active actors on pipe
2025-09-30T14:55:46.799555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896074766627196:5630], now have 1 active actors on pipe
2025-09-30T14:55:46.799588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896074676857017:4269]
2025-09-30T14:55:46.799597Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:46.799803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:46.799914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:46.799920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:46.799944Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f97ff14d-8741864-4caaccb2-4f98198f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:46.799952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:46.799956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:46.799957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:46.799973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:46.799982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:46.800007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:46.800514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:46.800520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:46.800542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:46.803668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1986 partition: 0 MaxSeqNo: 42 sessionId: src_id|f97ff14d-8741864-4caaccb2-4f98198f_0
2025-09-30T14:55:46.807559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d83b6d7-102b1c0b-78e7ff3-81af561_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f97ff14d-8741864-4caaccb2-4f98198f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:46.810368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f97ff14d-8741864-4caaccb2-4f98198f_0] Write session: try to update token
2025-09-30T14:55:46.810387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f97ff14d-8741864-4caaccb2-4f98198f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:46.813220Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:46.813242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:46.813245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:46.813247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:46.813256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896074676857017:4269]
2025-09-30T14:55:46.813262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896074676857017:4269]
2025-09-30T14:55:46.813269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896074676857017:4269]
2025-09-30T14:55:46.813312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:46.813320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.813324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:46.813459Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:46.815380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:46.815398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:46.815403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:46.818736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-09-30T14:55:46.818766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 11
2025-09-30T14:55:46.829880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1986 sessionId: src_id|f97ff14d-8741864-4caaccb2-4f98198f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:46.832675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:46.875586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896074766627221:6314]
2025-09-30T14:55:46.875856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1985, pipe: [1:7555896074766627221:6314]
2025-09-30T14:55:46.936233Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:46.936722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:46.936740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:46.936758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896074766627221:6314], now have 1 active actors on pipe
2025-09-30T14:55:46.936990Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:46.936967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:46.937476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f97ff14d-8741864-4caaccb2-4f98198f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:46.936990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 11
2025-09-30T14:55:46.937487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f97ff14d-8741864-4caaccb2-4f98198f_0] Write session will restart in 0.007428s
2025-09-30T14:55:46.937025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896074766627221:6314]
2025-09-30T14:55:46.937052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:46.937055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:46.937118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1986 reason: error at write: Disconnected sessionId: src_id|f97ff14d-8741864-4caaccb2-4f98198f_0
2025-09-30T14:55:46.937521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f97ff14d-8741864-4caaccb2-4f98198f_0] Write session: Do CDS request
2025-09-30T14:55:46.937292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1986 sessionId: src_id|f97ff14d-8741864-4caaccb2-4f98198f_0 is DEAD
2025-09-30T14:55:46.937527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f97ff14d-8741864-4caaccb2-4f98198f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:46.945792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f97ff14d-8741864-4caaccb2-4f98198f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:46.946166Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:46.946181Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1987
2025-09-30T14:55:46.946353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1987 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:46.946389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1987 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:46.946400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1987 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:46.946405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:46.946846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1987 sessionId:  describe result for acl check
2025-09-30T14:55:46.946878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:46.946880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:46.946882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:46.946888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896074766627242:5613] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:46.947445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896074766627242:5613] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:46.950361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896074766627242:5613] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:46.956834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896074766627242:5613] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:46.956854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896074766627242:5613] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:46.956858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896074766627242:5613] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:46.956867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1987 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:46.960938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:46.962178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:46.962403Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:46.962407Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:46.962417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:46.962470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:46.962519Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896074676857113:4250]
2025-09-30T14:55:46.963195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:46.963730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:46.963798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:46.964152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:46.964212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:46.964218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:46.964219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:46.964221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:46.964222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:46.964223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:46.964224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:46.964225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:46.964226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:46.964228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:46.964229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.964230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.964231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.964232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:46.964233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:46.964239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:46.964249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:46.964254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:46.964258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:46.964262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:46.964266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:46.964273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:46.964277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:46.964281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:46.964285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:46.964287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.964289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.964291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.964294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:46.964296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:46.964302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:46.964307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:46.964311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:46.964314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:46.964318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:46.964321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:46.964324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:46.964327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:46.964329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:46.964332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:46.964336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:46.964338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:46.964341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:46.964347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:46.964351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:46.964357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:46.964361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:46.964366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:46.964377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:46.964380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:46.964383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.964386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.964388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.964391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.964393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.964397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.964399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:46.964402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:46.964407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:46.964409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:46.964433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:46.972338Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1986
2025-09-30T14:55:46.972376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1986
2025-09-30T14:55:46.970274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:46.971323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:46.971330Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:46.971333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:46.971336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:46.971343Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1986 [2:7555896074676857113:4250]
2025-09-30T14:55:46.971359Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:46.971374Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:46.971377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:46.971381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:46.971385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:46.971402Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:46.971410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:46.971416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:46.971474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.971476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.971478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.971481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:46.971483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:46.971602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:46.971605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.971618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:46.971631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:46.971650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:46.971666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896074676857108:4250]
2025-09-30T14:55:46.971669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896074676857108:4250]
2025-09-30T14:55:46.971670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896074676857108:4250]
2025-09-30T14:55:46.971682Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:46.971694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:46.971712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:46.971715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:46.971748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896074676857108:4250]
2025-09-30T14:55:46.971751Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:46.971934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:46.971937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:46.971939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:46.971945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:46.972696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896074766627235:2454], now have 1 active actors on pipe
2025-09-30T14:55:46.972704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896074766627282:5613], now have 1 active actors on pipe
2025-09-30T14:55:46.972739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:46.972744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:46.972809Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 85826639 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:55:46.972838Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15bfb92-5a70b34a-f5754059-7c6c4ba0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:46.972845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:46.972850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:46.972852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:46.972877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:46.972888Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:46.972901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:46.974269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 13 DataSize: 85826639 UsedReserveSize: 0
2025-09-30T14:55:46.974300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:55:46.974736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1987 partition: 0 MaxSeqNo: 42 sessionId: src_id|15bfb92-5a70b34a-f5754059-7c6c4ba0_0
2025-09-30T14:55:46.976552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f97ff14d-8741864-4caaccb2-4f98198f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|15bfb92-5a70b34a-f5754059-7c6c4ba0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:46.974624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:46.974642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:46.974666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:46.979654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15bfb92-5a70b34a-f5754059-7c6c4ba0_0] Write session: try to update token
2025-09-30T14:55:46.979672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15bfb92-5a70b34a-f5754059-7c6c4ba0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:46.984988Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:46.985010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:46.985012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:46.985014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:46.985023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896074676857108:4250]
2025-09-30T14:55:46.985027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896074676857108:4250]
2025-09-30T14:55:46.985031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896074676857108:4250]
2025-09-30T14:55:46.985067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:46.985073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:46.985075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:46.985214Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:46.987433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:46.987441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:46.987445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:47.007299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1987 sessionId: src_id|15bfb92-5a70b34a-f5754059-7c6c4ba0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:47.009999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:47.035338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896079061594625:6314]
2025-09-30T14:55:47.035757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1986, pipe: [1:7555896079061594625:6314]
2025-09-30T14:55:47.106967Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:47.107517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:47.107532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:47.107560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896079061594625:6314], now have 1 active actors on pipe
2025-09-30T14:55:47.107745Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:47.107842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:47.107930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1987 reason: status is not ok: tablet will be restarted right now sessionId: src_id|15bfb92-5a70b34a-f5754059-7c6c4ba0_0
2025-09-30T14:55:47.108103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1987 sessionId: src_id|15bfb92-5a70b34a-f5754059-7c6c4ba0_0 is DEAD
2025-09-30T14:55:47.108219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:47.108249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896079061594625:6314]
2025-09-30T14:55:47.108576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15bfb92-5a70b34a-f5754059-7c6c4ba0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:47.108584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15bfb92-5a70b34a-f5754059-7c6c4ba0_0] Write session will restart in 0.008680s
2025-09-30T14:55:47.108607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15bfb92-5a70b34a-f5754059-7c6c4ba0_0] Write session: Do CDS request
2025-09-30T14:55:47.108613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15bfb92-5a70b34a-f5754059-7c6c4ba0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:47.118800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15bfb92-5a70b34a-f5754059-7c6c4ba0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:47.118894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:47.118909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1988
2025-09-30T14:55:47.119211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1988 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:47.119324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1988 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:47.119330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1988 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:47.119333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:47.119878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1988 sessionId:  describe result for acl check
2025-09-30T14:55:47.119908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:47.119911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:47.119912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:47.119918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896079061594674:5607] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:47.120464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896079061594674:5607] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:47.122877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:47.124648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896079061594674:5607] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:47.125397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:47.125627Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:47.125638Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:47.125649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:47.125705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:47.125767Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896078971824506:4237]
2025-09-30T14:55:47.126447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:47.126781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:47.126837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:47.127200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:47.127294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:47.127298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:47.127299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:47.127300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:47.127302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:47.127303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:47.127304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:47.127305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:47.127307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:47.127308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:47.127309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.127310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.127312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.127313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:47.127314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:47.127320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:47.127331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:47.127336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:47.127340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:47.127344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:47.127348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:47.127352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:47.127357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:47.127361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:47.127365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:47.127370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.127374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.127380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.127384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:47.127389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:47.127397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:47.127406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:47.127413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:47.127418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:47.127423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:47.127431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:47.127441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:47.127446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:47.127452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:47.127457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:47.127461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:47.127466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:47.127472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:47.127477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:47.127482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:47.127487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:47.127491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:47.127497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:47.127503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:47.127517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:47.127521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.127526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.127530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.127537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.127542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.127547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.127557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:47.127562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:47.127572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:47.127578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:47.127629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:47.128327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896079061594674:5607] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:47.128345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896079061594674:5607] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:47.128348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896079061594674:5607] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:47.128358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1988 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:47.135617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:47.136888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:47.136911Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:47.136915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:47.136919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:47.136926Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1987 [2:7555896078971824506:4237]
2025-09-30T14:55:47.136943Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:47.136960Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:47.136968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:47.136971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:47.136973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:47.136990Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:47.137004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:47.137015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:47.137074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.137083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.137085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.137089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:47.137092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:47.137164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:47.137174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.137187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.137198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.137216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:47.137235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896078971824501:4237]
2025-09-30T14:55:47.137237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896078971824501:4237]
2025-09-30T14:55:47.137239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896078971824501:4237]
2025-09-30T14:55:47.137248Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:47.137258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:47.137262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:47.137264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:47.137264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:47.137281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:47.137284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:47.137294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896079061594714:5607], now have 1 active actors on pipe
2025-09-30T14:55:47.137298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896079061594630:2454], now have 1 active actors on pipe
2025-09-30T14:55:47.137333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896078971824501:4237]
2025-09-30T14:55:47.137347Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:47.137381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1987
2025-09-30T14:55:47.137390Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1987
2025-09-30T14:55:47.137367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:47.137441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:47.137449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:47.137474Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6a0a8ce-e572174c-e896636a-cc3e28cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:47.137483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:47.137487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:47.137488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:47.137507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:47.137517Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:47.137529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:47.137740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:47.137742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:47.137752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:47.137831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1988 partition: 0 MaxSeqNo: 42 sessionId: src_id|c6a0a8ce-e572174c-e896636a-cc3e28cc_0
2025-09-30T14:55:47.138215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15bfb92-5a70b34a-f5754059-7c6c4ba0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c6a0a8ce-e572174c-e896636a-cc3e28cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:47.141344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6a0a8ce-e572174c-e896636a-cc3e28cc_0] Write session: try to update token
2025-09-30T14:55:47.141363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6a0a8ce-e572174c-e896636a-cc3e28cc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:47.151938Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:47.151962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:47.151964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:47.151967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:47.151976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896078971824501:4237]
2025-09-30T14:55:47.151980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896078971824501:4237]
2025-09-30T14:55:47.151983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896078971824501:4237]
2025-09-30T14:55:47.152026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:47.152034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.152037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:47.152189Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:47.155307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:47.155330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:47.155337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:47.163216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1988 sessionId: src_id|c6a0a8ce-e572174c-e896636a-cc3e28cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:47.166031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:47.207899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896079061594727:6314]
2025-09-30T14:55:47.208240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1987, pipe: [1:7555896079061594727:6314]
2025-09-30T14:55:47.265399Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:47.265751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:47.265770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:47.265789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896079061594727:6314], now have 1 active actors on pipe
2025-09-30T14:55:47.266008Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:47.266084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:47.266106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896079061594727:6314]
2025-09-30T14:55:47.266126Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:47.266171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1988 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c6a0a8ce-e572174c-e896636a-cc3e28cc_0
2025-09-30T14:55:47.266414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1988 sessionId: src_id|c6a0a8ce-e572174c-e896636a-cc3e28cc_0 is DEAD
2025-09-30T14:55:47.266558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6a0a8ce-e572174c-e896636a-cc3e28cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:47.266566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6a0a8ce-e572174c-e896636a-cc3e28cc_0] Write session will restart in 0.006693s
2025-09-30T14:55:47.266599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6a0a8ce-e572174c-e896636a-cc3e28cc_0] Write session: Do CDS request
2025-09-30T14:55:47.266605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6a0a8ce-e572174c-e896636a-cc3e28cc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:47.275728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6a0a8ce-e572174c-e896636a-cc3e28cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:47.276290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:47.275849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:47.275863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1989
2025-09-30T14:55:47.276038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1989 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:47.276082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1989 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:47.276090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1989 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:47.276094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:47.276551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1989 sessionId:  describe result for acl check
2025-09-30T14:55:47.276580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:47.276582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:47.276583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:47.276599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896079061594767:5601] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:47.277176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896079061594767:5601] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:47.279884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896079061594767:5601] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:47.280637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:47.280885Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:47.280896Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:47.280907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:47.280978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:47.281016Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896078971824581:4236]
2025-09-30T14:55:47.281632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:47.282240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896079061594767:5601] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:47.282256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896079061594767:5601] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:47.282260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896079061594767:5601] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:47.282328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1989 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:47.282685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:47.282746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:47.283123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:47.283190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:47.283197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:47.283200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:47.283202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:47.283203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:47.283205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:47.283206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:47.283208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:47.283210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:47.283212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:47.283213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.283215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.283216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.283218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:47.283219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:47.283228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:47.283239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:47.283259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:47.283262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:47.283266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:47.283272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:47.283276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:47.283280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:47.283285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:47.283290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:47.283300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.283305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.283309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.283314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:47.283318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:47.283326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:47.283335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:47.283341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:47.283347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:47.283353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:47.283358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:47.283363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:47.283369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:47.283381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:47.283387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:47.283391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:47.283396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:47.283401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:47.283408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:47.283418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:47.283424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:47.283434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:47.283439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:47.283443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:47.283455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:47.283459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.283469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.283477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.283487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.283497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.283507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.283515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:47.283525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:47.283535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:47.283545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:47.283592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:47.291838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:47.292923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:47.292944Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:47.292947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:47.292952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:47.292963Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1988 [2:7555896078971824581:4236]
2025-09-30T14:55:47.292982Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:47.293002Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:47.293005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:47.293008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:47.293011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:47.293028Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:47.293040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:47.293053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:47.293111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.293120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.293123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.293126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:47.293129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:47.293200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:47.293208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.293222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.293236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.293261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:47.293401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1988
2025-09-30T14:55:47.293285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896079061594731:2454], now have 1 active actors on pipe
2025-09-30T14:55:47.293438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1988
2025-09-30T14:55:47.293300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896079061594805:5601], now have 1 active actors on pipe
2025-09-30T14:55:47.293306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896078971824575:4236]
2025-09-30T14:55:47.293308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896078971824575:4236]
2025-09-30T14:55:47.293311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896078971824575:4236]
2025-09-30T14:55:47.293327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:47.293341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:47.293358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:47.293363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:47.293400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896078971824575:4236]
2025-09-30T14:55:47.293402Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:47.293542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:47.293551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:47.293554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:47.293560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:47.293747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:47.293762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:47.293789Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|544b7096-a0f32764-466bb629-45c87717_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:47.293807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:47.293812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:47.293814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:47.293825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:47.293840Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:47.293859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:47.294756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:47.294769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:47.294788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:47.294899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1989 partition: 0 MaxSeqNo: 42 sessionId: src_id|544b7096-a0f32764-466bb629-45c87717_0
2025-09-30T14:55:47.295302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6a0a8ce-e572174c-e896636a-cc3e28cc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|544b7096-a0f32764-466bb629-45c87717_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:47.298265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|544b7096-a0f32764-466bb629-45c87717_0] Write session: try to update token
2025-09-30T14:55:47.298286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|544b7096-a0f32764-466bb629-45c87717_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:47.310211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:47.310234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:47.310237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:47.310244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:47.310255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896078971824575:4236]
2025-09-30T14:55:47.310261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896078971824575:4236]
2025-09-30T14:55:47.310264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896078971824575:4236]
2025-09-30T14:55:47.310309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:47.310322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.310325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:47.310498Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:47.312357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:47.312375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:47.312379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:47.315356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1989 sessionId: src_id|544b7096-a0f32764-466bb629-45c87717_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:47.318302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:47.367319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896079061594815:6314]
2025-09-30T14:55:47.375308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1988, pipe: [1:7555896079061594815:6314]
2025-09-30T14:55:47.434983Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:47.435303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:47.435317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:47.435353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896079061594815:6314], now have 1 active actors on pipe
2025-09-30T14:55:47.435513Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:47.435557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:47.435573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:47.435640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1989 reason: error at write: Disconnected sessionId: src_id|544b7096-a0f32764-466bb629-45c87717_0
2025-09-30T14:55:47.435695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:47.435742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896079061594815:6314]
2025-09-30T14:55:47.435820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1989 sessionId: src_id|544b7096-a0f32764-466bb629-45c87717_0 is DEAD
2025-09-30T14:55:47.435989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|544b7096-a0f32764-466bb629-45c87717_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:47.436001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|544b7096-a0f32764-466bb629-45c87717_0] Write session will restart in 0.005738s
2025-09-30T14:55:47.436026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|544b7096-a0f32764-466bb629-45c87717_0] Write session: Do CDS request
2025-09-30T14:55:47.436034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|544b7096-a0f32764-466bb629-45c87717_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:47.442831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|544b7096-a0f32764-466bb629-45c87717_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:47.442927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:47.442943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1990
2025-09-30T14:55:47.443094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1990 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:47.443130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1990 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:47.443135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1990 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:47.443139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:47.443657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1990 sessionId:  describe result for acl check
2025-09-30T14:55:47.443694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:47.443704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:47.443708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:47.443714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896079061594851:5597] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:47.444275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896079061594851:5597] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:47.445036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:47.446347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896079061594851:5597] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:47.446899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:47.447129Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:47.447139Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:47.447150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:47.447201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:47.447261Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896078971824658:4229]
2025-09-30T14:55:47.447916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:47.448222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:47.448263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:47.448624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:47.448686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:47.448695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:47.448696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:47.448697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:47.448698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:47.448700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:47.448701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:47.448703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:47.448704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:47.448705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:47.448708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.448709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.448710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.448711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:47.448713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:47.448719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:47.448730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:47.448735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:47.448740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:47.448744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:47.448749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:47.448753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:47.448757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:47.448761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:47.448765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:47.448768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.448772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.448776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.448780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:47.448784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:47.448791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:47.448799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:47.448805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:47.448812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:47.448817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:47.448822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:47.448827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:47.448833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:47.448838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:47.448847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:47.448852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:47.448859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:47.448865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:47.448870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:47.448875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:47.448879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:47.448884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:47.448889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:47.448893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:47.448899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:47.448905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.448918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.448922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.448928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.448934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.448940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.448943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:47.448949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:47.448958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:47.448963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:47.449011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:47.449200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896079061594851:5597] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:47.449216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896079061594851:5597] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:47.449219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896079061594851:5597] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:47.449237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1990 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:47.454737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:47.455784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:47.455802Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:47.455809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:47.455813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:47.455820Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1989 [2:7555896078971824658:4229]
2025-09-30T14:55:47.455839Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:47.455854Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:47.455858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:47.455861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:47.455865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:47.455881Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:47.455894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:47.455901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:47.455973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.455981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.455983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.455988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:47.455991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:47.456062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:47.456069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.456082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.456116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.456139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:47.456161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896079061594893:5597], now have 1 active actors on pipe
2025-09-30T14:55:47.456171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896079061594816:2454], now have 1 active actors on pipe
2025-09-30T14:55:47.456178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896078971824653:4229]
2025-09-30T14:55:47.456181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896078971824653:4229]
2025-09-30T14:55:47.456184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896078971824653:4229]
2025-09-30T14:55:47.456193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:47.456207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:47.456222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:47.456223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:47.456225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:47.456228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:47.456231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:47.456232Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1989
2025-09-30T14:55:47.456261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896078971824653:4229]
2025-09-30T14:55:47.456233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1989
2025-09-30T14:55:47.456269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:47.456284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:47.456306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:47.456315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:47.456349Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|716a0ef9-b7cbd50-a0d69077-ec7b23e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:47.456361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:47.456365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:47.456367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:47.456376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:47.456390Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:47.456410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:47.456565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:47.456580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:47.456612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:47.456717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1990 partition: 0 MaxSeqNo: 42 sessionId: src_id|716a0ef9-b7cbd50-a0d69077-ec7b23e0_0
2025-09-30T14:55:47.457086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|544b7096-a0f32764-466bb629-45c87717_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|716a0ef9-b7cbd50-a0d69077-ec7b23e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:47.459976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|716a0ef9-b7cbd50-a0d69077-ec7b23e0_0] Write session: try to update token
2025-09-30T14:55:47.459996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|716a0ef9-b7cbd50-a0d69077-ec7b23e0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:47.468690Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:47.468714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:47.468716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:47.468720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:47.468728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896078971824653:4229]
2025-09-30T14:55:47.468732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896078971824653:4229]
2025-09-30T14:55:47.468739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896078971824653:4229]
2025-09-30T14:55:47.468777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:47.468781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:47.468784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.468787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:47.468787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:47.468800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:47.468920Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:47.476807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1990 sessionId: src_id|716a0ef9-b7cbd50-a0d69077-ec7b23e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:47.479845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:47.536061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896079061594901:6314]
2025-09-30T14:55:47.536366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1989, pipe: [1:7555896079061594901:6314]
2025-09-30T14:55:47.579656Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:47.580062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:47.580076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:47.580096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896079061594901:6314], now have 1 active actors on pipe
2025-09-30T14:55:47.580304Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:47.580351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896079061594901:6314]
2025-09-30T14:55:47.580353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:47.580358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:47.580378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:47.580433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1990 reason: error at write: Disconnected sessionId: src_id|716a0ef9-b7cbd50-a0d69077-ec7b23e0_0
2025-09-30T14:55:47.580623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1990 sessionId: src_id|716a0ef9-b7cbd50-a0d69077-ec7b23e0_0 is DEAD
2025-09-30T14:55:47.580764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|716a0ef9-b7cbd50-a0d69077-ec7b23e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:47.580775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|716a0ef9-b7cbd50-a0d69077-ec7b23e0_0] Write session will restart in 0.007414s
2025-09-30T14:55:47.580807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|716a0ef9-b7cbd50-a0d69077-ec7b23e0_0] Write session: Do CDS request
2025-09-30T14:55:47.580812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|716a0ef9-b7cbd50-a0d69077-ec7b23e0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:47.590098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:47.591838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|716a0ef9-b7cbd50-a0d69077-ec7b23e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:47.592059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:47.592087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1991
2025-09-30T14:55:47.592099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:47.592243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1991 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:47.592292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1991 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:47.592303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1991 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:47.592301Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:47.592308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:47.592311Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:47.592322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:47.592374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:47.592415Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896078971824736:4227]
2025-09-30T14:55:47.592882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1991 sessionId:  describe result for acl check
2025-09-30T14:55:47.592933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:47.592940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:47.592943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:47.592950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896079061594942:5593] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:47.593018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:47.593313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:47.593359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:47.593531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896079061594942:5593] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:47.593687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:47.593772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:47.593778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:47.593779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:47.593780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:47.593782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:47.593782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:47.593784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:47.593785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:47.593786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:47.593787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:47.593788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.593789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.593790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.593791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:47.593792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:47.593798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:47.593808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:47.593812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:47.593816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:47.593819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:47.593823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:47.593827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:47.593830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:47.593837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:47.593841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:47.593844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.593848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.593852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.593855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:47.593858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:47.593866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:47.593872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:47.593878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:47.593883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:47.593895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:47.593900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:47.593909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:47.593915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:47.593928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:47.593934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:47.593940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:47.593950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:47.593970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:47.593979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:47.593983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:47.593988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:47.593995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:47.594000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:47.594008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:47.594012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:47.594019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.594024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.594031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.594036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.594046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.594051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.594058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:47.594063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:47.594067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:47.594073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:47.594117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:47.596054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896079061594942:5593] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:47.599788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896079061594942:5593] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:47.599805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896079061594942:5593] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:47.599809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896079061594942:5593] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:47.599818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1991 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:47.600015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:47.600919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:47.600942Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:47.600945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:47.600949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:47.600957Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1990 [2:7555896078971824736:4227]
2025-09-30T14:55:47.600974Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:47.600989Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:47.600992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:47.600995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:47.600997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:47.601013Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:47.601021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:47.601027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:47.601093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.601101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.601106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.601109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:47.601111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:47.601185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:47.601193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.601206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.601223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.601247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:47.601270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896079061594902:2454], now have 1 active actors on pipe
2025-09-30T14:55:47.601278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896079061594980:5593], now have 1 active actors on pipe
2025-09-30T14:55:47.601285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896078971824730:4227]
2025-09-30T14:55:47.601287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896078971824730:4227]
2025-09-30T14:55:47.601289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896078971824730:4227]
2025-09-30T14:55:47.601304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:47.601324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:47.601345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:47.601353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:47.601356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:47.601359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:47.601361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:47.601386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896078971824730:4227]
2025-09-30T14:55:47.601397Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:47.601432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:47.601402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1990
2025-09-30T14:55:47.601461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1990
2025-09-30T14:55:47.601510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:47.601520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:47.601543Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9c664fb-a19e8c90-ca69a7f6-65c0ac1f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:47.601550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:47.601553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:47.601555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:47.601565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:47.601575Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:47.601594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:47.601770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:47.601779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:47.601794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:47.601867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1991 partition: 0 MaxSeqNo: 42 sessionId: src_id|f9c664fb-a19e8c90-ca69a7f6-65c0ac1f_0
2025-09-30T14:55:47.602234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|716a0ef9-b7cbd50-a0d69077-ec7b23e0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f9c664fb-a19e8c90-ca69a7f6-65c0ac1f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:47.605037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c664fb-a19e8c90-ca69a7f6-65c0ac1f_0] Write session: try to update token
2025-09-30T14:55:47.605062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c664fb-a19e8c90-ca69a7f6-65c0ac1f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:47.621291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1991 sessionId: src_id|f9c664fb-a19e8c90-ca69a7f6-65c0ac1f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:47.620281Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:47.620318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:47.620333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896078971824730:4227]
2025-09-30T14:55:47.620415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:47.620790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:47.620962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:47.621110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:47.621242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:47.621453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:47.621511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:47.621793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:47.624252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:47.624449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:47.624484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:47.624519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:47.624608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:47.635604Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:47.635627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:47.635630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:47.635632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:47.635642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896078971824730:4227]
2025-09-30T14:55:47.635647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896078971824730:4227]
2025-09-30T14:55:47.635652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896078971824730:4227]
2025-09-30T14:55:47.635695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:47.635701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.635706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:47.635848Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:47.635943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:47.635949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:47.635952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:47.680450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896079061594990:6314]
2025-09-30T14:55:47.680743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1990, pipe: [1:7555896079061594990:6314]
2025-09-30T14:55:47.758088Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:47.766850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:47.766894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:47.767097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:47.767178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:47.767283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:47.767362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:47.767424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:47.767435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:47.767515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:47.767595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:47.767661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:47.767741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:47.767789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:47.767800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:47.767882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:47.767958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:47.768032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:47.768106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:47.768158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:47.768166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:47.768265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:47.768664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:47.768737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:47.768820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:47.768874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:47.768882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:47.768964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:47.769035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:47.769107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:47.769182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:47.769235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:47.769242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:47.769319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:47.769391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:47.769466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:47.769551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:47.769601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:47.769611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:47.769689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:47.769759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:47.769827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:47.769899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:47.769951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:47.769962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:47.770040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:47.770112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:47.770184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:47.770255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:47.770317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:47.770326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:47.770400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:47.770473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:47.770544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:47.770617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:47.770666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:47.770674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:47.770744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:47.770810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:47.770885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:47.770955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:47.771005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:47.771015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:47.771086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896079061594990:6314], now have 1 active actors on pipe
2025-09-30T14:55:47.771321Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:47.771332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896079061594990:6314]
2025-09-30T14:55:47.771359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:47.771362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:47.771405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1991 reason: error at write: Disconnected sessionId: src_id|f9c664fb-a19e8c90-ca69a7f6-65c0ac1f_0
2025-09-30T14:55:47.771576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1991 sessionId: src_id|f9c664fb-a19e8c90-ca69a7f6-65c0ac1f_0 is DEAD
2025-09-30T14:55:47.771695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c664fb-a19e8c90-ca69a7f6-65c0ac1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:47.771705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c664fb-a19e8c90-ca69a7f6-65c0ac1f_0] Write session will restart in 0.007046s
2025-09-30T14:55:47.771727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c664fb-a19e8c90-ca69a7f6-65c0ac1f_0] Write session: Do CDS request
2025-09-30T14:55:47.771732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c664fb-a19e8c90-ca69a7f6-65c0ac1f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:47.772073Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:47.779757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c664fb-a19e8c90-ca69a7f6-65c0ac1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:47.780169Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:47.780184Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1992
2025-09-30T14:55:47.780309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1992 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:47.780357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1992 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:47.780368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1992 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:47.780373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:47.780800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1992 sessionId:  describe result for acl check
2025-09-30T14:55:47.780834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:47.780836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:47.780838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:47.780843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896079061595029:5587] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:47.781437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896079061595029:5587] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:47.782031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:47.783602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896079061595029:5587] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:47.783894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:47.784102Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:47.784111Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:47.784121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:47.784171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:47.784206Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896078971824826:4218]
2025-09-30T14:55:47.784843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:47.785256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:47.785300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:47.785627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:47.785683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:47.785689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:47.785690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:47.785691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:47.785692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:47.785694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:47.785695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:47.785696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:47.785697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:47.785698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:47.785699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.785700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.785701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.785702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:47.785703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:47.785707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:47.785719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:47.785723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:47.785726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:47.785731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:47.785735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:47.785739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:47.785742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:47.785746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:47.785750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:47.785754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.785758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.785761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.785764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:47.785768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:47.785774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:47.785782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:47.785788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:47.785792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:47.785797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:47.785802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:47.785806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:47.785811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:47.785815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:47.785820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:47.785825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:47.785830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:47.785835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:47.785839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:47.785843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:47.785849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:47.785852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:47.785858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:47.785863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:47.785867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:47.785871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.785875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.785879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.785883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.785886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.785891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.785894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:47.785899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:47.785907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:47.785912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:47.785953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:47.786127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896079061595029:5587] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:47.786139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896079061595029:5587] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:47.786143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896079061595029:5587] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:47.786151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1992 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:47.791614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:47.792535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:47.792555Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:47.792558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:47.792562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:47.792570Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1991 [2:7555896078971824826:4218]
2025-09-30T14:55:47.792589Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:47.792605Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:47.792608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:47.792612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:47.792614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:47.792631Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:47.792644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:47.792654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:47.792730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.792738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.792740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.792744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:47.792747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:47.792821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:47.792829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.792844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.792862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.792886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:47.792910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896079061594992:2454], now have 1 active actors on pipe
2025-09-30T14:55:47.792925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896078971824820:4218]
2025-09-30T14:55:47.792928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896078971824820:4218]
2025-09-30T14:55:47.792930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896078971824820:4218]
2025-09-30T14:55:47.792939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:47.792950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:47.792954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:47.792956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:47.792957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:47.792972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:47.792990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:47.793004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896079061595070:5587], now have 1 active actors on pipe
2025-09-30T14:55:47.793001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1991
2025-09-30T14:55:47.793009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1991
2025-09-30T14:55:47.793038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896078971824820:4218]
2025-09-30T14:55:47.793046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:47.793048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:47.793063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:47.793067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:47.793119Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4050c77-8099dc12-f6bea3fb-3f9f1fad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:47.793131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:47.793135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:47.793142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:47.793156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:47.793171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:47.793195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:47.793331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:47.793343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:47.793357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:47.793451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1992 partition: 0 MaxSeqNo: 42 sessionId: src_id|f4050c77-8099dc12-f6bea3fb-3f9f1fad_0
2025-09-30T14:55:47.793863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c664fb-a19e8c90-ca69a7f6-65c0ac1f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f4050c77-8099dc12-f6bea3fb-3f9f1fad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:47.796814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4050c77-8099dc12-f6bea3fb-3f9f1fad_0] Write session: try to update token
2025-09-30T14:55:47.796837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4050c77-8099dc12-f6bea3fb-3f9f1fad_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:47.806062Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:47.806081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:47.806085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:47.806087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:47.806096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896078971824820:4218]
2025-09-30T14:55:47.806101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896078971824820:4218]
2025-09-30T14:55:47.806106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896078971824820:4218]
2025-09-30T14:55:47.806149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:47.806157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.806167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:47.806171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:47.806178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:47.806183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:47.806321Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:47.813390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1992 sessionId: src_id|f4050c77-8099dc12-f6bea3fb-3f9f1fad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:47.816477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:47.871431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896079061595091:6314]
2025-09-30T14:55:47.871762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1991, pipe: [1:7555896079061595091:6314]
2025-09-30T14:55:47.920786Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:47.921128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:47.921144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:47.921165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896079061595091:6314], now have 1 active actors on pipe
2025-09-30T14:55:47.921437Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:47.921898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4050c77-8099dc12-f6bea3fb-3f9f1fad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:47.921909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4050c77-8099dc12-f6bea3fb-3f9f1fad_0] Write session will restart in 0.009027s
2025-09-30T14:55:47.921935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4050c77-8099dc12-f6bea3fb-3f9f1fad_0] Write session: Do CDS request
2025-09-30T14:55:47.921941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4050c77-8099dc12-f6bea3fb-3f9f1fad_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:47.921419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:47.921434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:47.921515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1992 reason: error at write: Disconnected sessionId: src_id|f4050c77-8099dc12-f6bea3fb-3f9f1fad_0
2025-09-30T14:55:47.921711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1992 sessionId: src_id|f4050c77-8099dc12-f6bea3fb-3f9f1fad_0 is DEAD
2025-09-30T14:55:47.921873Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:47.921908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896079061595091:6314]
2025-09-30T14:55:47.931972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4050c77-8099dc12-f6bea3fb-3f9f1fad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:47.932701Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:47.932715Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1993
2025-09-30T14:55:47.932891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1993 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:47.932936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1993 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:47.932941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1993 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:47.932945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:47.933412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1993 sessionId:  describe result for acl check
2025-09-30T14:55:47.933450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:47.933457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:47.933459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:47.933464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896079061595130:5579] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:47.934053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896079061595130:5579] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:47.935719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:47.935854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896079061595130:5579] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:47.937507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:47.937691Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:47.937702Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:47.937712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:47.937778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:47.937816Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896078971824907:4211]
2025-09-30T14:55:47.938145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896079061595130:5579] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:47.938158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896079061595130:5579] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:47.938161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896079061595130:5579] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:47.938170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1993 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:47.938484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:47.938791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:47.938847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:47.939208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:47.939286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:47.939293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:47.939295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:47.939296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:47.939297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:47.939299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:47.939300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:47.939301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:47.939303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:47.939304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:47.939305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.939306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.939309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.939310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:47.939311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:47.939318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:47.939327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:47.939331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:47.939335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:47.939340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:47.939344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:47.939348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:47.939351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:47.939355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:47.939359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:47.939362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.939365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.939369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.939374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:47.939377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:47.939386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:47.939393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:47.939399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:47.939406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:47.939410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:47.939416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:47.939420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:47.939425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:47.939431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:47.939436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:47.939440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:47.939446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:47.939451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:47.939457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:47.939462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:47.939467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:47.939471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:47.939475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:47.939480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:47.939484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:47.939489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.939493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.939497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.939502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.939506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.939511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.939516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:47.939521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:47.939526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:47.939531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:47.939576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:47.945250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:47.946217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:47.946232Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:47.946236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:47.946240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:47.946247Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1992 [2:7555896078971824907:4211]
2025-09-30T14:55:47.946265Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:47.946281Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:47.946284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:47.946288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:47.946292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:47.946308Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:47.946320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:47.946326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:47.946388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.946399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.946401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.946405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:47.946407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:47.946479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:47.946486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.946499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:47.946511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:47.946530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:47.946553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896079061595166:5579], now have 1 active actors on pipe
2025-09-30T14:55:47.946561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896079061595092:2454], now have 1 active actors on pipe
2025-09-30T14:55:47.946568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896078971824902:4211]
2025-09-30T14:55:47.946571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896078971824902:4211]
2025-09-30T14:55:47.946573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896078971824902:4211]
2025-09-30T14:55:47.946585Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:47.946597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:47.946609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:47.946613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:47.946616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:47.946616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:47.946620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:47.946616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1992
2025-09-30T14:55:47.946650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896078971824902:4211]
2025-09-30T14:55:47.946644Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1992
2025-09-30T14:55:47.946659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:47.946661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:47.946675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:47.946680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:47.946727Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|466e78d9-15c17c2a-fa02698a-2ddc59e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:47.946739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:47.946742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:47.946744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:47.946753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:47.946762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:47.946791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:47.946933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:47.946941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:47.946954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:47.947047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1993 partition: 0 MaxSeqNo: 42 sessionId: src_id|466e78d9-15c17c2a-fa02698a-2ddc59e_0
2025-09-30T14:55:47.947425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4050c77-8099dc12-f6bea3fb-3f9f1fad_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|466e78d9-15c17c2a-fa02698a-2ddc59e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:47.950324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|466e78d9-15c17c2a-fa02698a-2ddc59e_0] Write session: try to update token
2025-09-30T14:55:47.950347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|466e78d9-15c17c2a-fa02698a-2ddc59e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:47.959561Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:47.959583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:47.959585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:47.959588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:47.959598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896078971824902:4211]
2025-09-30T14:55:47.959603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896078971824902:4211]
2025-09-30T14:55:47.959607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896078971824902:4211]
2025-09-30T14:55:47.959645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:47.959650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:47.959652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:47.959654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:47.959659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:47.959661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:47.959814Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:47.965974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1993 sessionId: src_id|466e78d9-15c17c2a-fa02698a-2ddc59e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:47.969041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:48.021960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896083356562488:6314]
2025-09-30T14:55:48.022331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1992, pipe: [1:7555896083356562488:6314]
2025-09-30T14:55:48.076196Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:48.076522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:48.076537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:48.076578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896083356562488:6314], now have 1 active actors on pipe
2025-09-30T14:55:48.076827Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:48.077822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|466e78d9-15c17c2a-fa02698a-2ddc59e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:48.077834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|466e78d9-15c17c2a-fa02698a-2ddc59e_0] Write session will restart in 0.009256s
2025-09-30T14:55:48.077860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|466e78d9-15c17c2a-fa02698a-2ddc59e_0] Write session: Do CDS request
2025-09-30T14:55:48.077865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|466e78d9-15c17c2a-fa02698a-2ddc59e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:48.077279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:48.077327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896083356562488:6314]
2025-09-30T14:55:48.077344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:48.077414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1993 reason: status is not ok: tablet will be restarted right now sessionId: src_id|466e78d9-15c17c2a-fa02698a-2ddc59e_0
2025-09-30T14:55:48.077589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1993 sessionId: src_id|466e78d9-15c17c2a-fa02698a-2ddc59e_0 is DEAD
2025-09-30T14:55:48.088957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|466e78d9-15c17c2a-fa02698a-2ddc59e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:48.089230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:48.089245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1994
2025-09-30T14:55:48.089435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1994 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:48.089460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1994 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:48.089465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1994 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:48.089469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:48.090365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1994 sessionId:  describe result for acl check
2025-09-30T14:55:48.090391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:48.090393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:48.090395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:48.090402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896083356562543:5558] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:48.090947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896083356562543:5558] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:48.093899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:48.094859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:48.095065Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:48.095076Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:48.095086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:48.095143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:48.095192Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896083266792319:4186]
2025-09-30T14:55:48.095826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:48.097141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:48.097203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:48.097615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:48.097677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:48.097678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:48.097680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:48.097681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:48.097682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:48.097684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:48.097685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:48.097686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:48.097688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:48.097692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:48.097694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.097695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.097696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.097698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:48.097699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:48.097706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:48.097716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:48.097721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:48.097726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:48.097730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:48.097735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:48.097738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:48.097743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:48.097748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:48.097752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:48.097757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.097761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.097765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.097769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:48.097773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:48.097782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:48.097791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:48.097798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:48.097805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:48.097810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:48.097817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:48.097822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:48.097828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:48.097833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:48.097840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:48.097848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:48.097854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:48.097861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:48.097867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:48.097872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:48.097879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:48.097884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:48.097889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:48.097894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:48.097900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:48.097905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.097910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.097915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.097921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.097926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.097932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.097937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:48.097943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:48.097949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:48.097955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:48.098001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:48.096185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896083356562543:5558] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:48.106108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:48.105979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896083356562543:5558] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:48.106001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896083356562543:5558] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:48.106009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896083356562543:5558] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:48.106019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1994 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:48.107078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:48.107095Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:48.107101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:48.107106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:48.107114Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1993 [2:7555896083266792319:4186]
2025-09-30T14:55:48.107131Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:48.107151Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:48.107154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:48.107157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:48.107160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:48.107179Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:48.107186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:48.107192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:48.107277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.107279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.107281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.107284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:48.107286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:48.107359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:48.107362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.107375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.107388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.107405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:48.107422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896083266792314:4186]
2025-09-30T14:55:48.107424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896083266792314:4186]
2025-09-30T14:55:48.107427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896083266792314:4186]
2025-09-30T14:55:48.107439Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:48.107453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:48.107459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:48.107464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:48.107467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:48.107471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:48.107474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:48.107484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896083356562498:2454], now have 1 active actors on pipe
2025-09-30T14:55:48.107518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896083266792314:4186]
2025-09-30T14:55:48.107526Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:48.107532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896083356562581:5558], now have 1 active actors on pipe
2025-09-30T14:55:48.107919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:48.108147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:48.108155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:48.108177Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|913b9683-eba9b5ac-5ad0bf0a-11906a17_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:48.108184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:48.108186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:48.108188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:48.108196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:48.108204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:48.108219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:48.108509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:48.108514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:48.108524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:48.108966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|466e78d9-15c17c2a-fa02698a-2ddc59e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|913b9683-eba9b5ac-5ad0bf0a-11906a17_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:48.107813Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1993
2025-09-30T14:55:48.107846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1993
2025-09-30T14:55:48.108634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1994 partition: 0 MaxSeqNo: 42 sessionId: src_id|913b9683-eba9b5ac-5ad0bf0a-11906a17_0
2025-09-30T14:55:48.111673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|913b9683-eba9b5ac-5ad0bf0a-11906a17_0] Write session: try to update token
2025-09-30T14:55:48.111693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|913b9683-eba9b5ac-5ad0bf0a-11906a17_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:48.132312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1994 sessionId: src_id|913b9683-eba9b5ac-5ad0bf0a-11906a17_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:48.135118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:48.136100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:48.136127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:48.136146Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:48.136149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:48.136155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896083266792314:4186]
2025-09-30T14:55:48.136212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:48.136240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:48.136425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:48.136590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:48.136757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:48.136912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:48.137197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:48.137246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:48.137271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:48.137483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:48.149864Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:48.149887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:48.149890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:48.149892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:48.149901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896083266792314:4186]
2025-09-30T14:55:48.149910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896083266792314:4186]
2025-09-30T14:55:48.149915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896083266792314:4186]
2025-09-30T14:55:48.149960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:48.149973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.149976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:48.150115Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:48.154741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:48.154763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:48.154767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:48.177095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896083356562595:6314]
2025-09-30T14:55:48.177366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1993, pipe: [1:7555896083356562595:6314]
2025-09-30T14:55:48.265453Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:48.274867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:48.274900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:48.275086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:48.275160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:48.275231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:48.275322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:48.275371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:48.275382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:48.275457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:48.275528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:48.275601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:48.275680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:48.275728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:48.275736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:48.275808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:48.275881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:48.275956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:48.276032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:48.276081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:48.276090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:48.276165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:48.276239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:48.276309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:48.276381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:48.276427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:48.276442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:48.276518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:48.276587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:48.276665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:48.276745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:48.276797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:48.276805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:48.276882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:48.276952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:48.277026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:48.277103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:48.277152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:48.277160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:48.277235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:48.277302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:48.277372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:48.277449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:48.277521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:48.277530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:48.277601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:48.277666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:48.277735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:48.277807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:48.277877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:48.277887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:48.277969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:48.278038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:48.278111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:48.278186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:48.278236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:48.278243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:48.278319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:48.278389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:48.278466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:48.278538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:48.278654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:48.278664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:48.278738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896083356562595:6314], now have 1 active actors on pipe
2025-09-30T14:55:48.279014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896083356562595:6314]
2025-09-30T14:55:48.279021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:48.279025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:48.279054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:48.279067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1994 reason: error at write: Disconnected sessionId: src_id|913b9683-eba9b5ac-5ad0bf0a-11906a17_0
2025-09-30T14:55:48.279262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1994 sessionId: src_id|913b9683-eba9b5ac-5ad0bf0a-11906a17_0 is DEAD
2025-09-30T14:55:48.279403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|913b9683-eba9b5ac-5ad0bf0a-11906a17_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:48.279422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|913b9683-eba9b5ac-5ad0bf0a-11906a17_0] Write session will restart in 0.008175s
2025-09-30T14:55:48.279448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|913b9683-eba9b5ac-5ad0bf0a-11906a17_0] Write session: Do CDS request
2025-09-30T14:55:48.279454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|913b9683-eba9b5ac-5ad0bf0a-11906a17_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:48.280113Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:48.289197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|913b9683-eba9b5ac-5ad0bf0a-11906a17_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:48.289248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:48.289263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1995
2025-09-30T14:55:48.289420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1995 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:48.289451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1995 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:48.289473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1995 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:48.289477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:48.289922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1995 sessionId:  describe result for acl check
2025-09-30T14:55:48.289958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:48.289966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:48.289968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:48.289975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896083356562642:5557] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:48.290286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:48.290510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896083356562642:5557] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:48.292235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:48.292455Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:48.292469Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:48.292480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:48.292537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:48.292582Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896083266792400:4181]
2025-09-30T14:55:48.293254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:48.293584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896083356562642:5557] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:48.293620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:48.293690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:48.294073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:48.294171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:48.294179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:48.294180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:48.294181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:48.294182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:48.294183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:48.294185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:48.294186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:48.294187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:48.294188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:48.294189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.294190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.294191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.294192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:48.294193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:48.294199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:48.294209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:48.294213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:48.294216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:48.294220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:48.294224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:48.294227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:48.294233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:48.294236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:48.294240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:48.294243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.294247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.294251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.294254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:48.294258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:48.294267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:48.294276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:48.294281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:48.294287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:48.294291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:48.294296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:48.294301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:48.294306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:48.294310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:48.294315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:48.294319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:48.294323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:48.294328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:48.294333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:48.294337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:48.294341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:48.294345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:48.294350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:48.294353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:48.294358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:48.294363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.294368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.294372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.294377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.294384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.294388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.294392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:48.294397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:48.294401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:48.294406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:48.294446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:48.300184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896083356562642:5557] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:48.300201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896083356562642:5557] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:48.300204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896083356562642:5557] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:48.300213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1995 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:48.300281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:48.301216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:48.301235Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:48.301238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:48.301242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:48.301250Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1994 [2:7555896083266792400:4181]
2025-09-30T14:55:48.301268Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:48.301287Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:48.301295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:48.301298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:48.301301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:48.301317Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:48.301329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:48.301336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:48.301405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.301414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.301416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.301419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:48.301423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:48.301507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:48.301516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.301530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.301547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.301566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:48.301592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896083356562682:5557], now have 1 active actors on pipe
2025-09-30T14:55:48.301600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896083356562600:2454], now have 1 active actors on pipe
2025-09-30T14:55:48.301607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896083266792394:4181]
2025-09-30T14:55:48.301614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896083266792394:4181]
2025-09-30T14:55:48.301615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896083266792394:4181]
2025-09-30T14:55:48.301633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:48.301648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:48.301653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:48.301657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:48.301659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:48.301668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:48.301671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:48.301669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1994
2025-09-30T14:55:48.301711Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1994
2025-09-30T14:55:48.301709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896083266792394:4181]
2025-09-30T14:55:48.301720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:48.301723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:48.301751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:48.301758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:48.301790Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28c0c1f5-7ec60eba-11e60b7-750a15c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:48.301803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:48.301808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:48.301810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:48.301820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:48.301830Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:48.301851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:48.302044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:48.302053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:48.302067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:48.302157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1995 partition: 0 MaxSeqNo: 42 sessionId: src_id|28c0c1f5-7ec60eba-11e60b7-750a15c5_0
2025-09-30T14:55:48.302552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|913b9683-eba9b5ac-5ad0bf0a-11906a17_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|28c0c1f5-7ec60eba-11e60b7-750a15c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:48.305632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28c0c1f5-7ec60eba-11e60b7-750a15c5_0] Write session: try to update token
2025-09-30T14:55:48.305653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28c0c1f5-7ec60eba-11e60b7-750a15c5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:48.314540Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:48.314567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:48.314570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:48.314572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:48.314582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896083266792394:4181]
2025-09-30T14:55:48.314588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896083266792394:4181]
2025-09-30T14:55:48.314593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896083266792394:4181]
2025-09-30T14:55:48.314635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:48.314645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.314648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:48.314655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:48.314662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:48.314667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:48.314799Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:48.325271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1995 sessionId: src_id|28c0c1f5-7ec60eba-11e60b7-750a15c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:48.328266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:48.379298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896083356562690:6314]
2025-09-30T14:55:48.379758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1994, pipe: [1:7555896083356562690:6314]
2025-09-30T14:55:48.431875Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:48.432341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:48.432363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:48.432384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896083356562690:6314], now have 1 active actors on pipe
2025-09-30T14:55:48.432616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896083356562690:6314]
2025-09-30T14:55:48.432625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:48.432628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:48.432648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:48.432745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1995 reason: error at write: Disconnected sessionId: src_id|28c0c1f5-7ec60eba-11e60b7-750a15c5_0
2025-09-30T14:55:48.433070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28c0c1f5-7ec60eba-11e60b7-750a15c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:48.433082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28c0c1f5-7ec60eba-11e60b7-750a15c5_0] Write session will restart in 0.006701s
2025-09-30T14:55:48.433071Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:48.433107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28c0c1f5-7ec60eba-11e60b7-750a15c5_0] Write session: Do CDS request
2025-09-30T14:55:48.433113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28c0c1f5-7ec60eba-11e60b7-750a15c5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:48.432923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1995 sessionId: src_id|28c0c1f5-7ec60eba-11e60b7-750a15c5_0 is DEAD
2025-09-30T14:55:48.440766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28c0c1f5-7ec60eba-11e60b7-750a15c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:48.440888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:48.440905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1996
2025-09-30T14:55:48.441038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1996 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:48.441071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1996 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:48.441083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1996 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:48.441088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:48.441575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1996 sessionId:  describe result for acl check
2025-09-30T14:55:48.441615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:48.441622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:48.441624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:48.441630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896083356562732:5552] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:48.442189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896083356562732:5552] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:48.442901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:48.444406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896083356562732:5552] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:48.444897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:48.445108Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:48.445119Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:48.445129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:48.445191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:48.445233Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896083266792484:4179]
2025-09-30T14:55:48.445964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:48.446265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:48.446312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:48.446659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:48.446731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:48.446740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:48.446741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:48.446742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:48.446744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:48.446745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:48.446746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:48.446747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:48.446748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:48.446749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:48.446750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.446751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.446752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.446753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:48.446754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:48.446759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:48.446769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:48.446774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:48.446779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:48.446783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:48.446787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:48.446792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:48.446798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:48.446803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:48.446809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:48.446814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.446819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.446823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.446827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:48.446832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:48.446840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:48.446848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:48.446854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:48.446859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:48.446865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:48.446870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:48.446875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:48.446881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:48.446887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:48.446892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:48.446898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:48.446904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:48.446909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:48.446914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:48.446919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:48.446925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:48.446930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:48.446937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:48.446944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:48.446955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:48.446961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.446971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.446976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.446987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.446992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.447003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.447009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:48.447019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:48.447024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:48.447034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:48.447085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:48.447141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896083356562732:5552] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:48.447155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896083356562732:5552] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:48.447159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896083356562732:5552] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:48.447167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1996 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:48.452930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:48.453855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:48.453874Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:48.453877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:48.453882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:48.453890Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1995 [2:7555896083266792484:4179]
2025-09-30T14:55:48.453907Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:48.453924Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:48.453927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:48.453931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:48.453935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:48.453955Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:48.453961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:48.453967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:48.454037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.454042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.454045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.454048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:48.454050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:48.454120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:48.454123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.454136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.454148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.454166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:48.454182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896083266792478:4179]
2025-09-30T14:55:48.454185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896083266792478:4179]
2025-09-30T14:55:48.454187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896083266792478:4179]
2025-09-30T14:55:48.454196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:48.454207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:48.454209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:48.454211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:48.454214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:48.454225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:48.454227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:48.454237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896083356562772:5552], now have 1 active actors on pipe
2025-09-30T14:55:48.454241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896083356562691:2454], now have 1 active actors on pipe
2025-09-30T14:55:48.454277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896083266792478:4179]
2025-09-30T14:55:48.454292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:48.454343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1995
2025-09-30T14:55:48.454360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:48.454383Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1995
2025-09-30T14:55:48.454621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:48.454631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:48.454662Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db4c9ff0-6628e3a1-5ee02afa-d742d99d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:48.454673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:48.454677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:48.454679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:48.454688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:48.454703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:48.454718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:48.454863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:48.454871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:48.454882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:48.455002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1996 partition: 0 MaxSeqNo: 42 sessionId: src_id|db4c9ff0-6628e3a1-5ee02afa-d742d99d_0
2025-09-30T14:55:48.455425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28c0c1f5-7ec60eba-11e60b7-750a15c5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|db4c9ff0-6628e3a1-5ee02afa-d742d99d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:48.458420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db4c9ff0-6628e3a1-5ee02afa-d742d99d_0] Write session: try to update token
2025-09-30T14:55:48.458442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db4c9ff0-6628e3a1-5ee02afa-d742d99d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:48.467037Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:48.467057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:48.467060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:48.467063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:48.467073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896083266792478:4179]
2025-09-30T14:55:48.467077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896083266792478:4179]
2025-09-30T14:55:48.467081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896083266792478:4179]
2025-09-30T14:55:48.467125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:48.467129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:48.467132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.467135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:48.467136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:48.467139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:48.467284Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:48.474414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1996 sessionId: src_id|db4c9ff0-6628e3a1-5ee02afa-d742d99d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:48.477472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:48.532993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896083356562782:6314]
2025-09-30T14:55:48.533365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1995, pipe: [1:7555896083356562782:6314]
2025-09-30T14:55:48.577862Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:48.578329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:48.578347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:48.578367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896083356562782:6314], now have 1 active actors on pipe
2025-09-30T14:55:48.578655Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:48.578648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896083356562782:6314]
2025-09-30T14:55:48.578656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:48.578660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:48.578680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:48.578725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1996 reason: error at write: Disconnected sessionId: src_id|db4c9ff0-6628e3a1-5ee02afa-d742d99d_0
2025-09-30T14:55:48.579059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db4c9ff0-6628e3a1-5ee02afa-d742d99d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:48.579068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db4c9ff0-6628e3a1-5ee02afa-d742d99d_0] Write session will restart in 0.007908s
2025-09-30T14:55:48.579093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db4c9ff0-6628e3a1-5ee02afa-d742d99d_0] Write session: Do CDS request
2025-09-30T14:55:48.579098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db4c9ff0-6628e3a1-5ee02afa-d742d99d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:48.578949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1996 sessionId: src_id|db4c9ff0-6628e3a1-5ee02afa-d742d99d_0 is DEAD
2025-09-30T14:55:48.587766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db4c9ff0-6628e3a1-5ee02afa-d742d99d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:48.587749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:48.587917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:48.587934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1997
2025-09-30T14:55:48.588068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1997 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:48.588099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1997 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:48.588109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1997 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:48.588113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:48.588539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1997 sessionId:  describe result for acl check
2025-09-30T14:55:48.588580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:48.588584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:48.588586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:48.588592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896083356562828:5543] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:48.589104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896083356562828:5543] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:48.589605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:48.589812Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:48.589823Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:48.589834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:48.589884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:48.589926Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896083266792566:4166]
2025-09-30T14:55:48.590451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:48.590770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:48.590833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:48.591048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896083356562828:5543] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:48.591223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:48.591307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:48.591319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:48.591320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:48.591321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:48.591323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:48.591324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:48.591325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:48.591327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:48.591328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:48.591329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:48.591331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.591332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.591334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.591335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:48.591338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:48.591345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:48.591356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:48.591361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:48.591366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:48.591371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:48.591375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:48.591380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:48.591385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:48.591390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:48.591395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:48.591399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.591404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.591409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.591414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:48.591419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:48.591426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:48.591435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:48.591448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:48.591454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:48.591459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:48.591465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:48.591471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:48.591477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:48.591483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:48.591492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:48.591499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:48.591510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:48.591516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:48.591527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:48.591531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:48.591543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:48.591548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:48.591555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:48.591560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:48.591568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:48.591574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.591583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.591588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.591594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.591601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.591607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.591612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:48.591620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:48.591625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:48.591631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:48.591700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:48.596951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896083356562828:5543] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:48.596971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896083356562828:5543] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:48.596975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896083356562828:5543] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:48.596984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1997 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:48.597191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:48.598079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:48.598091Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:48.598095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:48.598099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:48.598107Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1996 [2:7555896083266792566:4166]
2025-09-30T14:55:48.598126Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:48.598142Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:48.598150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:48.598154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:48.598156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:48.598181Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:48.598188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:48.598196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:48.598260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.598268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.598270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.598273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:48.598275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:48.598341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:48.598350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.598365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.598383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.598404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:48.598426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896083356562867:5543], now have 1 active actors on pipe
2025-09-30T14:55:48.598434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896083356562783:2454], now have 1 active actors on pipe
2025-09-30T14:55:48.598440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896083266792560:4166]
2025-09-30T14:55:48.598443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896083266792560:4166]
2025-09-30T14:55:48.598444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896083266792560:4166]
2025-09-30T14:55:48.598456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:48.598473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:48.598475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:48.598478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:48.598490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:48.598492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:48.598495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:48.598523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1996
2025-09-30T14:55:48.598528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896083266792560:4166]
2025-09-30T14:55:48.598523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1996
2025-09-30T14:55:48.598542Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:48.598566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:48.598595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:48.598600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:48.598626Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f22f9bc-59c82239-8ffc73d0-3788b619_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:48.598639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:48.598642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:48.598645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:48.598654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:48.598662Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:48.598676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:48.598818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:48.598828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:48.598841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:48.598936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1997 partition: 0 MaxSeqNo: 42 sessionId: src_id|6f22f9bc-59c82239-8ffc73d0-3788b619_0
2025-09-30T14:55:48.599296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db4c9ff0-6628e3a1-5ee02afa-d742d99d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6f22f9bc-59c82239-8ffc73d0-3788b619_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:48.602337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f22f9bc-59c82239-8ffc73d0-3788b619_0] Write session: try to update token
2025-09-30T14:55:48.602362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f22f9bc-59c82239-8ffc73d0-3788b619_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:48.611948Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:48.611977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:48.611989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896083266792560:4166]
2025-09-30T14:55:48.612047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:48.612046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:48.612290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:48.612482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:48.612655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:48.612841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:48.613098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:48.613159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:48.618901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1997 sessionId: src_id|6f22f9bc-59c82239-8ffc73d0-3788b619_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:48.621904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:48.622142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:48.622171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:48.622212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:48.622271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:48.623695Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:48.623715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:48.623718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:48.623720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:48.623731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896083266792560:4166]
2025-09-30T14:55:48.623742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896083266792560:4166]
2025-09-30T14:55:48.623745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896083266792560:4166]
2025-09-30T14:55:48.623794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:48.623809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:48.623814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:48.623890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:48.623902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.623905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:48.624055Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:48.678848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896083356562877:6314]
2025-09-30T14:55:48.679201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1996, pipe: [1:7555896083356562877:6314]
2025-09-30T14:55:48.739659Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:48.748361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:48.748400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:48.748593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:48.748669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:48.748748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:48.748831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:48.748891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:48.748906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:48.748993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:48.749066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:48.749139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:48.749220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:48.749289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:48.749298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:48.749375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:48.749452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:48.749543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:48.749628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:48.749673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:48.749680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:48.749761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:48.749825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:48.749895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:48.749969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:48.750016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:48.750020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:48.750122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:48.750199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:48.750271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:48.750339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:48.750387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:48.750391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:48.750471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:48.750538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:48.750601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:48.750669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:48.750718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:48.750721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:48.750800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:48.750870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:48.750963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:48.751032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:48.751076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:48.751079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:48.751155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:48.751221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:48.751460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:48.751540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:48.751587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:48.751590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:48.751669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:48.751736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:48.751802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:48.751868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:48.751912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:48.751915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:48.751990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:48.752059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:48.752129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:48.752199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:48.752244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:48.752248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:48.752334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896083356562877:6314], now have 1 active actors on pipe
2025-09-30T14:55:48.754045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896083356562877:6314]
2025-09-30T14:55:48.754079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:48.754082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:48.754116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1997 reason: error at write: Disconnected sessionId: src_id|6f22f9bc-59c82239-8ffc73d0-3788b619_0
2025-09-30T14:55:48.754320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1997 sessionId: src_id|6f22f9bc-59c82239-8ffc73d0-3788b619_0 is DEAD
2025-09-30T14:55:48.754566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f22f9bc-59c82239-8ffc73d0-3788b619_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:48.754577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f22f9bc-59c82239-8ffc73d0-3788b619_0] Write session will restart in 0.006485s
2025-09-30T14:55:48.754603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f22f9bc-59c82239-8ffc73d0-3788b619_0] Write session: Do CDS request
2025-09-30T14:55:48.754609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f22f9bc-59c82239-8ffc73d0-3788b619_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:48.754750Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:48.754005Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:48.764029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f22f9bc-59c82239-8ffc73d0-3788b619_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:48.764136Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:48.764153Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1998
2025-09-30T14:55:48.764342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1998 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:48.764380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1998 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:48.764386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1998 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:48.764392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:48.764954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1998 sessionId:  describe result for acl check
2025-09-30T14:55:48.764991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:48.764994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:48.764995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:48.765003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896083356562924:5537] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:48.764999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:48.765566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896083356562924:5537] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:48.767292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:48.767571Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:48.767583Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:48.767593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:48.767653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:48.767701Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896083266792663:4167]
2025-09-30T14:55:48.768294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:48.768752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896083356562924:5537] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:48.769891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:48.769963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:48.770351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:48.770429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:48.770435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:48.770437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:48.770438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:48.770439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:48.770440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:48.770441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:48.770443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:48.770444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:48.770445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:48.770446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.770448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.770449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.770450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:48.770451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:48.770459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:48.770469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:48.770473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:48.770477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:48.770481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:48.770486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:48.770491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:48.770496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:48.770500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:48.770504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:48.770507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.770510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.770513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.770516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:48.770519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:48.770528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:48.770537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:48.770544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:48.770549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:48.770554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:48.770561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:48.770565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:48.770571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:48.770576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:48.770581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:48.770586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:48.770592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:48.770596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:48.770602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:48.770608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:48.770613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:48.770618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:48.770624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:48.770634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:48.770640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:48.770649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.770655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.770664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.770669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.770676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.770685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.770690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:48.770700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:48.770705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:48.770715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:48.770762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:48.771980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896083356562924:5537] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:48.771993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896083356562924:5537] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:48.771997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896083356562924:5537] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:48.772004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1998 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:48.776932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:48.777812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:48.777830Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:48.777834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:48.777837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:48.777844Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1997 [2:7555896083266792663:4167]
2025-09-30T14:55:48.777860Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:48.777876Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:48.777880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:48.777883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:48.777886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:48.777901Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:48.777908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:48.777915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:48.777978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.777988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.777990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.777993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:48.777995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:48.778061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:48.778084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.778101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.778118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.778140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:48.778164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896083356562963:5537], now have 1 active actors on pipe
2025-09-30T14:55:48.778173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896083356562880:2454], now have 1 active actors on pipe
2025-09-30T14:55:48.778183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896083266792658:4167]
2025-09-30T14:55:48.778189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896083266792658:4167]
2025-09-30T14:55:48.778194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896083266792658:4167]
2025-09-30T14:55:48.778209Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:48.778228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:48.778247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:48.778255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:48.778264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1997
2025-09-30T14:55:48.778290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896083266792658:4167]
2025-09-30T14:55:48.778297Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:48.778314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1997
2025-09-30T14:55:48.778416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:48.778430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:48.778433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:48.778440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:48.778586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:48.778599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:48.778627Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a63d2248-4fff191f-557599-9171e0ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:48.778639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:48.778643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:48.778650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:48.778670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:48.778686Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:48.778700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:48.779215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:48.779230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:48.779273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:48.779412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1998 partition: 0 MaxSeqNo: 42 sessionId: src_id|a63d2248-4fff191f-557599-9171e0ec_0
2025-09-30T14:55:48.783677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f22f9bc-59c82239-8ffc73d0-3788b619_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a63d2248-4fff191f-557599-9171e0ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:48.786487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a63d2248-4fff191f-557599-9171e0ec_0] Write session: try to update token
2025-09-30T14:55:48.786506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a63d2248-4fff191f-557599-9171e0ec_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:48.792500Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:48.792521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:48.792524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:48.792527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:48.792540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896083266792658:4167]
2025-09-30T14:55:48.792545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896083266792658:4167]
2025-09-30T14:55:48.792550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896083266792658:4167]
2025-09-30T14:55:48.792594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:48.792598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:48.792604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.792606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:48.792607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:48.792610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:48.792741Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:48.801814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1998 sessionId: src_id|a63d2248-4fff191f-557599-9171e0ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:48.804872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:48.855329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896083356562983:6314]
2025-09-30T14:55:48.855623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1997, pipe: [1:7555896083356562983:6314]
2025-09-30T14:55:48.907735Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:48.908258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:48.908281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:48.908303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896083356562983:6314], now have 1 active actors on pipe
2025-09-30T14:55:48.908692Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:48.911320Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:48.911388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896083356562983:6314]
2025-09-30T14:55:48.911416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:48.911494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1998 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a63d2248-4fff191f-557599-9171e0ec_0
2025-09-30T14:55:48.911660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1998 sessionId: src_id|a63d2248-4fff191f-557599-9171e0ec_0 is DEAD
2025-09-30T14:55:48.911787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a63d2248-4fff191f-557599-9171e0ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:48.911798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a63d2248-4fff191f-557599-9171e0ec_0] Write session will restart in 0.007998s
2025-09-30T14:55:48.911819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a63d2248-4fff191f-557599-9171e0ec_0] Write session: Do CDS request
2025-09-30T14:55:48.911824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a63d2248-4fff191f-557599-9171e0ec_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:48.920799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a63d2248-4fff191f-557599-9171e0ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:48.920881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:48.920898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1999
2025-09-30T14:55:48.921104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1999 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:48.921148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1999 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:48.921158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1999 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:48.921163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:48.921653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1999 sessionId:  describe result for acl check
2025-09-30T14:55:48.921687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:48.921695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:48.921697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:48.921703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896083356562997:5530] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:48.922224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896083356562997:5530] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:48.925038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896083356562997:5530] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:48.926090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:48.928384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:48.928614Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:48.928633Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:48.928644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:48.928714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:48.928754Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896083266792750:4170]
2025-09-30T14:55:48.928716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896083356562997:5530] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:48.928729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896083356562997:5530] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:48.928732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896083356562997:5530] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:48.928744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1999 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:48.929416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:48.929794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:48.929847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:48.930200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:48.930286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:48.930303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:48.930304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:48.930308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:48.930309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:48.930310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:48.930311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:48.930312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:48.930313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:48.930314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:48.930315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.930317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.930318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.930319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:48.930320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:48.930325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:48.930335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:48.930339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:48.930343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:48.930347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:48.930351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:48.930355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:48.930360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:48.930364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:48.930369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:48.930373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.930377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.930381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.930385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:48.930389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:48.930398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:48.930405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:48.930411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:48.930417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:48.930422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:48.930427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:48.930437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:48.930442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:48.930448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:48.930458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:48.930462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:48.930466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:48.930471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:48.930481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:48.930485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:48.930489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:48.930494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:48.930499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:48.930503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:48.930508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:48.930512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.930517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.930521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.930525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.930529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.930534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.930538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:48.930543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:48.930548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:48.930553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:48.930597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:48.936435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:48.937363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:48.937381Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:48.937385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:48.937389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:48.937396Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1998 [2:7555896083266792750:4170]
2025-09-30T14:55:48.937418Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:48.937435Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:48.937439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:48.937442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:48.937444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:48.937462Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:48.937475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:48.937482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:48.937560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.937568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.937570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.937574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:48.937576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:48.937669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:48.937677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.937691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:48.937706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:48.937729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:48.937751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896083356562986:2454], now have 1 active actors on pipe
2025-09-30T14:55:48.937759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896083356563066:5530], now have 1 active actors on pipe
2025-09-30T14:55:48.937765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896083266792745:4170]
2025-09-30T14:55:48.937767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896083266792745:4170]
2025-09-30T14:55:48.937769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896083266792745:4170]
2025-09-30T14:55:48.937789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:48.937795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:48.937801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:48.937803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:48.937813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:48.937827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:48.937830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:48.937863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896083266792745:4170]
2025-09-30T14:55:48.937875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:48.937881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:48.938054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:48.938068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:48.937992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1998
2025-09-30T14:55:48.938039Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1998
2025-09-30T14:55:48.938096Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|753a63a9-587cb14a-2abcc4c1-8a6e4317_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:48.938108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:48.938112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:48.938114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:48.938124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:48.938133Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:48.938153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:48.938341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:48.938363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:48.938388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:48.938513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1999 partition: 0 MaxSeqNo: 42 sessionId: src_id|753a63a9-587cb14a-2abcc4c1-8a6e4317_0
2025-09-30T14:55:48.938914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a63d2248-4fff191f-557599-9171e0ec_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|753a63a9-587cb14a-2abcc4c1-8a6e4317_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:48.941834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|753a63a9-587cb14a-2abcc4c1-8a6e4317_0] Write session: try to update token
2025-09-30T14:55:48.941855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|753a63a9-587cb14a-2abcc4c1-8a6e4317_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:48.953693Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:48.953714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:48.953724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896083266792745:4170]
2025-09-30T14:55:48.953770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:48.953770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:48.953968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:48.954132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:48.954284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:48.954440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:48.954667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:48.954718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:48.967066Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:48.967091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:48.967094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:48.967102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:48.967113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896083266792745:4170]
2025-09-30T14:55:48.967117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896083266792745:4170]
2025-09-30T14:55:48.967122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896083266792745:4170]
2025-09-30T14:55:48.967169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:48.967178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:48.967177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:48.967182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:48.967184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:48.967189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:48.967361Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:48.970205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1999 sessionId: src_id|753a63a9-587cb14a-2abcc4c1-8a6e4317_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:48.972867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:49.011668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896087651530374:6314]
2025-09-30T14:55:49.012013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1998, pipe: [1:7555896087651530374:6314]
2025-09-30T14:55:49.090048Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:49.090451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:49.090471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:49.090494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896087651530374:6314], now have 1 active actors on pipe
2025-09-30T14:55:49.090693Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:49.090726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:49.090792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896087651530374:6314]
2025-09-30T14:55:49.090827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:49.090936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1999 reason: status is not ok: tablet will be restarted right now sessionId: src_id|753a63a9-587cb14a-2abcc4c1-8a6e4317_0
2025-09-30T14:55:49.091141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1999 sessionId: src_id|753a63a9-587cb14a-2abcc4c1-8a6e4317_0 is DEAD
2025-09-30T14:55:49.091357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|753a63a9-587cb14a-2abcc4c1-8a6e4317_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:49.091368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|753a63a9-587cb14a-2abcc4c1-8a6e4317_0] Write session will restart in 0.007604s
2025-09-30T14:55:49.091391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|753a63a9-587cb14a-2abcc4c1-8a6e4317_0] Write session: Do CDS request
2025-09-30T14:55:49.091397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|753a63a9-587cb14a-2abcc4c1-8a6e4317_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:49.099902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|753a63a9-587cb14a-2abcc4c1-8a6e4317_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:49.100268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:49.100284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2000
2025-09-30T14:55:49.100487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2000 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:49.100523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2000 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:49.100530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2000 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:49.100535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:49.100971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2000 sessionId:  describe result for acl check
2025-09-30T14:55:49.101004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:49.101010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:49.101013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:49.101018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896087651530424:5514] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:49.101793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896087651530424:5514] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:49.105766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:49.106631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896087651530424:5514] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:49.109293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:49.109540Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:49.109545Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:49.109556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:49.109646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:49.109686Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896087561760167:4145]
2025-09-30T14:55:49.110373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:49.110732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:49.110786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:49.111151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:49.111216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:49.111218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:49.111220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:49.111221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:49.111222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:49.111223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:49.111224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:49.111226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:49.111228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:49.111229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:49.111231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.111232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.111234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.111236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:49.111237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:49.111258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:49.111269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:49.111273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:49.111277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:49.111283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:49.111288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:49.111292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:49.111297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:49.111302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:49.111307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:49.111311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.111316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.111320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.111325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:49.111329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:49.111338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:49.111346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:49.111352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:49.111359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:49.111365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:49.111370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:49.111375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:49.111382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:49.111388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:49.111394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:49.111399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:49.111403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:49.111409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:49.111415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:49.111419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:49.111424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:49.111429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:49.111435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:49.111443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:49.111449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:49.111453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.111459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.111464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.111470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.111476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.111482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.111486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:49.111492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:49.111497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:49.111503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:49.111563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:49.116179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896087651530424:5514] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:49.116197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896087651530424:5514] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:49.116201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896087651530424:5514] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:49.116211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2000 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:49.119673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:49.120648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:49.120668Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:49.120671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:49.120675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:49.120682Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1999 [2:7555896087561760167:4145]
2025-09-30T14:55:49.120700Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:49.120717Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:49.120721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:49.120724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:49.120730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:49.120748Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:49.120761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:49.120767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:49.120833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.120841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.120844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.120847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:49.120850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:49.120918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:49.120929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.120942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.120953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.120969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:49.120986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896087651530484:5514], now have 1 active actors on pipe
2025-09-30T14:55:49.120999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896087651530400:2454], now have 1 active actors on pipe
2025-09-30T14:55:49.121006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896087561760162:4145]
2025-09-30T14:55:49.121008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896087561760162:4145]
2025-09-30T14:55:49.121010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896087561760162:4145]
2025-09-30T14:55:49.121021Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:49.121040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:49.121055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:49.121063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:49.121074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1999
2025-09-30T14:55:49.121101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896087561760162:4145]
2025-09-30T14:55:49.121120Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1999
2025-09-30T14:55:49.121105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:49.121108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:49.121109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:49.121111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:49.121118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:49.121204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:49.121222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:49.121270Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74bd9b30-91d73c2-b781d69f-5800988c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:49.121283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:49.121294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:49.121296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:49.121308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:49.121320Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:49.121340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:49.121584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:49.121598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:49.121624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:49.121782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2000 partition: 0 MaxSeqNo: 42 sessionId: src_id|74bd9b30-91d73c2-b781d69f-5800988c_0
2025-09-30T14:55:49.122171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|753a63a9-587cb14a-2abcc4c1-8a6e4317_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|74bd9b30-91d73c2-b781d69f-5800988c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:49.125154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74bd9b30-91d73c2-b781d69f-5800988c_0] Write session: try to update token
2025-09-30T14:55:49.125173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74bd9b30-91d73c2-b781d69f-5800988c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:49.143296Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:49.143325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:49.143339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896087561760162:4145]
2025-09-30T14:55:49.143400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:49.143404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:49.143633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:49.143830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:49.144011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:49.144192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:49.144835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:49.144926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:49.148603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2000 sessionId: src_id|74bd9b30-91d73c2-b781d69f-5800988c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:49.149625Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:49.149645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:49.149648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:49.149651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:49.149661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896087561760162:4145]
2025-09-30T14:55:49.149670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896087561760162:4145]
2025-09-30T14:55:49.149674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896087561760162:4145]
2025-09-30T14:55:49.149723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:49.149738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.149741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:49.149783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:49.149803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:49.149821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:49.149910Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:49.151432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:49.190868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896087651530497:6314]
2025-09-30T14:55:49.191276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1999, pipe: [1:7555896087651530497:6314]
2025-09-30T14:55:49.284493Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:49.285000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:49.285026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:49.285058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896087651530497:6314], now have 1 active actors on pipe
2025-09-30T14:55:49.285397Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:49.285437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:49.285439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:49.285443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:49.285509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896087651530497:6314]
2025-09-30T14:55:49.285534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2000 reason: error at write: Disconnected sessionId: src_id|74bd9b30-91d73c2-b781d69f-5800988c_0
2025-09-30T14:55:49.285720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2000 sessionId: src_id|74bd9b30-91d73c2-b781d69f-5800988c_0 is DEAD
2025-09-30T14:55:49.285879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74bd9b30-91d73c2-b781d69f-5800988c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:49.285893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74bd9b30-91d73c2-b781d69f-5800988c_0] Write session will restart in 0.006841s
2025-09-30T14:55:49.285918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74bd9b30-91d73c2-b781d69f-5800988c_0] Write session: Do CDS request
2025-09-30T14:55:49.285927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74bd9b30-91d73c2-b781d69f-5800988c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:49.293849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74bd9b30-91d73c2-b781d69f-5800988c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:49.293917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:49.293931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2001
2025-09-30T14:55:49.294138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2001 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:49.294181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2001 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:49.294197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2001 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:49.294206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:49.294675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2001 sessionId:  describe result for acl check
2025-09-30T14:55:49.294707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:49.294709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:49.294711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:49.294716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896087651530522:5509] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:49.295221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896087651530522:5509] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:49.297450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896087651530522:5509] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:49.298078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:49.300450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:49.300783Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:49.300784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896087651530522:5509] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:49.300807Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:49.300830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:49.300796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896087651530522:5509] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:49.300799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896087651530522:5509] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:49.300806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2001 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:49.300952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:49.301002Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896087561760253:4139]
2025-09-30T14:55:49.301502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:49.301889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:49.301937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:49.302218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:49.302284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:49.302291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:49.302292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:49.302293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:49.302295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:49.302297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:49.302298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:49.302300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:49.302301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:49.302302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:49.302304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.302305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.302306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.302308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:49.302309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:49.302316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:49.302327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:49.302331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:49.302336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:49.302339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:49.302344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:49.302346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:49.302348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:49.302350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:49.302353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:49.302355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.302357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.302360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.302362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:49.302364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:49.302370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:49.302378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:49.302382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:49.302386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:49.302389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:49.302393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:49.302395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:49.302398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:49.302401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:49.302405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:49.302408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:49.302411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:49.302414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:49.302417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:49.302422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:49.302424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:49.302427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:49.302431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:49.302433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:49.302436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:49.302439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.302445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.302448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.302451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.302454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.302457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.302460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:49.302464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:49.302467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:49.302471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:49.302507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:49.308539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:49.309521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:49.309537Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:49.309539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:49.309543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:49.309548Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2000 [2:7555896087561760253:4139]
2025-09-30T14:55:49.309560Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:49.309577Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:49.309579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:49.309582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:49.309583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:49.309598Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:49.309604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:49.309610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:49.309670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.309676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.309678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.309680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:49.309682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:49.309736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:49.309744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.309756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.309773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.309791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:49.309811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896087561760248:4139]
2025-09-30T14:55:49.309818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896087561760248:4139]
2025-09-30T14:55:49.309820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896087561760248:4139]
2025-09-30T14:55:49.309831Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:49.309843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:49.309849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:49.309855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:49.309857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:49.309863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:49.309866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:49.309874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896087651530585:5509], now have 1 active actors on pipe
2025-09-30T14:55:49.309879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896087651530502:2454], now have 1 active actors on pipe
2025-09-30T14:55:49.309912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896087561760248:4139]
2025-09-30T14:55:49.309925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:49.309933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:49.309998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2000
2025-09-30T14:55:49.310014Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2000
2025-09-30T14:55:49.310143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:49.310153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:49.310177Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94655705-2f1651ef-706da9c8-e7840ad7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:49.310188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:49.310194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:49.310195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:49.310202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:49.310213Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:49.310223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:49.310448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:49.310453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:49.310465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:49.310594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2001 partition: 0 MaxSeqNo: 42 sessionId: src_id|94655705-2f1651ef-706da9c8-e7840ad7_0
2025-09-30T14:55:49.311165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74bd9b30-91d73c2-b781d69f-5800988c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|94655705-2f1651ef-706da9c8-e7840ad7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:49.313932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94655705-2f1651ef-706da9c8-e7840ad7_0] Write session: try to update token
2025-09-30T14:55:49.313952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94655705-2f1651ef-706da9c8-e7840ad7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:49.324052Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:49.324072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:49.324082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896087561760248:4139]
2025-09-30T14:55:49.324132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:49.324131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:49.324317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:49.324475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:49.324623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:49.324765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:49.324967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:49.325009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:49.334523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2001 sessionId: src_id|94655705-2f1651ef-706da9c8-e7840ad7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:49.337783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:49.335230Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:49.335275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:49.335278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:49.335281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:49.335293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896087561760248:4139]
2025-09-30T14:55:49.335298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896087561760248:4139]
2025-09-30T14:55:49.335307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896087561760248:4139]
2025-09-30T14:55:49.335351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:49.335362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.335364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:49.335520Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:49.336039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:49.336046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:49.336050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:49.385931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896087651530598:6314]
2025-09-30T14:55:49.386546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2000, pipe: [1:7555896087651530598:6314]
2025-09-30T14:55:49.456695Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:49.457048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:49.457066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:49.457088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896087651530598:6314], now have 1 active actors on pipe
2025-09-30T14:55:49.457458Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:49.458884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:49.458900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:49.458974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2001 reason: error at write: Disconnected sessionId: src_id|94655705-2f1651ef-706da9c8-e7840ad7_0
2025-09-30T14:55:49.459185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2001 sessionId: src_id|94655705-2f1651ef-706da9c8-e7840ad7_0 is DEAD
2025-09-30T14:55:49.459459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896087651530598:6314]
2025-09-30T14:55:49.459476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:49.459506Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:55:49.459636Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 20 consumer shared/user session shared/user_1_20_14284323138001262305_v1 is DEAD
2025-09-30T14:55:49.459774Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896010342096568:6320] disconnected; active server actors: 1
2025-09-30T14:55:49.459778Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896010342096568:6320] client user disconnected session shared/user_1_20_14284323138001262305_v1
2025-09-30T14:55:49.460165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94655705-2f1651ef-706da9c8-e7840ad7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:49.460174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94655705-2f1651ef-706da9c8-e7840ad7_0] Write session will restart in 0.009460s
2025-09-30T14:55:49.460198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94655705-2f1651ef-706da9c8-e7840ad7_0] Write session: Do CDS request
2025-09-30T14:55:49.460204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94655705-2f1651ef-706da9c8-e7840ad7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:49.460449Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:55:49.460545Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:55:49.460552Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:55:49.460561Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.007938s
2025-09-30T14:55:49.470718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94655705-2f1651ef-706da9c8-e7840ad7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:49.470760Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:49.470773Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2002
2025-09-30T14:55:49.471000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2002 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:49.471033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2002 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:49.471041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2002 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:49.471045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:49.471642Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:55:49.471839Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:55:49.471855Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 21
2025-09-30T14:55:49.471983Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 21 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:55:49.472036Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:55:49.472120Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 auth for : user
2025-09-30T14:55:49.472226Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 Handle describe topics response
2025-09-30T14:55:49.472624Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_21_3187655180107370934_v1
2025-09-30T14:55:49.472243Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 auth is DEAD
2025-09-30T14:55:49.472255Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:55:49.472526Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:55:49.472641Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896087651530653:5501] connected; active server actors: 1
2025-09-30T14:55:49.472651Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555896087651530653:5501] session shared/user_1_21_3187655180107370934_v1
2025-09-30T14:55:49.472660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:55:49.472671Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:55:49.472678Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_21_3187655180107370934_v1" (Sender=[1:7555896087651530650:5501], Pipe=[1:7555896087651530653:5501], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:55:49.472682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:55:49.472692Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:55:49.472704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_21_3187655180107370934_v1" (Sender=[1:7555896087651530650:5501], Pipe=[1:7555896087651530653:5501], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:55:49.472724Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_21_3187655180107370934_v1" sender [1:7555896087651530650:5501] lock partition 0 for ReadingSession "shared/user_1_21_3187655180107370934_v1" (Sender=[1:7555896087651530650:5501], Pipe=[1:7555896087651530653:5501], Partitions=[], ActiveFamilyCount=1) generation 1 step 21
2025-09-30T14:55:49.472737Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:55:49.472740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000045s
2025-09-30T14:55:49.472946Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 21 Session: "shared/user_1_21_3187655180107370934_v1" ClientId: "user" PipeClient { RawX1: 7555896087651530653 RawX2: 4503603922343293 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:55:49.472977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:55:49.473722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:49.475721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2002 sessionId:  describe result for acl check
2025-09-30T14:55:49.475781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:49.475788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:49.475790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:49.475796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896087651530658:5505] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:49.476125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:49.476330Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:49.476339Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:49.476349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:49.476397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:49.476447Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896087561760343:4140]
2025-09-30T14:55:49.476362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896087651530658:5505] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:49.477167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:49.477501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:49.477552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:49.477906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:49.477969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:49.477976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:49.477977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:49.477978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:49.477979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:49.477980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:49.477981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:49.477982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:49.477984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:49.477985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:49.477986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.477987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.477988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.477990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:49.477991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:49.477996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:49.478006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:49.478010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:49.478014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:49.478018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:49.478023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:49.478027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:49.478030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:49.478035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:49.478041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:49.478045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.478049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.478053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.478057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:49.478060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:49.478077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:49.478086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:49.478091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:49.478096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:49.478101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:49.478107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:49.478111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:49.478117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:49.478122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:49.478127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:49.478131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:49.478137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:49.478141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:49.478147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:49.478151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:49.478157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:49.478162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:49.478167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:49.478172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:49.478178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:49.478183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.478188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.478193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.478205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.478210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.478217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.478221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:49.478226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:49.478231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:49.478236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:49.478280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:49.479881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896087651530658:5505] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:49.483914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:49.484130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896087651530658:5505] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:49.484145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896087651530658:5505] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:49.484149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896087651530658:5505] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:49.484158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2002 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:49.484837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:49.484854Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:49.484856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:49.484860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:49.484867Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2001 [2:7555896087561760343:4140]
2025-09-30T14:55:49.484885Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:49.484901Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:49.484904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:49.484907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:49.484910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:49.484926Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:49.484933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:49.484940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:49.484998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.485007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.485009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.485014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:49.485017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:49.485175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:49.485185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.485198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.485210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.485234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:49.485258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896087651530697:5505], now have 1 active actors on pipe
2025-09-30T14:55:49.485269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896087651530656:5488], now have 1 active actors on pipe
2025-09-30T14:55:49.485272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896087651530599:2454], now have 1 active actors on pipe
2025-09-30T14:55:49.485229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2001
2025-09-30T14:55:49.485279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896087561760338:4140]
2025-09-30T14:55:49.485249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2001, pipe: [1:7555896087651530656:5488]
2025-09-30T14:55:49.485282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896087561760338:4140]
2025-09-30T14:55:49.485258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2001
2025-09-30T14:55:49.485283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896087561760338:4140]
2025-09-30T14:55:49.485291Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:49.485302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:49.485306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:49.485306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:49.485308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:49.485320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:49.485322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:49.485337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:49.485347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:49.485363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:49.485369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:49.485374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_21_3187655180107370934_v1 on pipe: [1:7555896087651530656:5488]
2025-09-30T14:55:49.485415Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_21_3187655180107370934_v1:1 with generation 2001
2025-09-30T14:55:49.485430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896087561760338:4140]
2025-09-30T14:55:49.485439Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:49.485446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:49.485460Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a76cf2cd-4fdbfe2e-8a8573ab-c50191bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:49.485470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:49.485474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:49.485481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:49.485500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:49.485515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:49.485530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:49.485533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:49.485536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:49.485552Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_21_3187655180107370934_v1
2025-09-30T14:55:49.485558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:49.485606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:49.485622Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:55:49.485799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:49.485811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:49.485826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:49.485912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2002 partition: 0 MaxSeqNo: 42 sessionId: src_id|a76cf2cd-4fdbfe2e-8a8573ab-c50191bf_0
2025-09-30T14:55:49.486307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94655705-2f1651ef-706da9c8-e7840ad7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a76cf2cd-4fdbfe2e-8a8573ab-c50191bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:49.486717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:55:49.486748Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:55:49.486761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:49.486763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:49.486765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:49.486772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:55:49.486780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:55:49.486899Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759244149485 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:55:49.486915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:55:49.486954Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 sending to client partition status
2025-09-30T14:55:49.489292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a76cf2cd-4fdbfe2e-8a8573ab-c50191bf_0] Write session: try to update token
2025-09-30T14:55:49.489311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a76cf2cd-4fdbfe2e-8a8573ab-c50191bf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:49.498913Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:49.498936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:49.498938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:49.498945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:49.498955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896087561760338:4140]
2025-09-30T14:55:49.498960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896087561760338:4140]
2025-09-30T14:55:49.498965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896087561760338:4140]
2025-09-30T14:55:49.499010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:49.499017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.499018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:49.499020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:49.499025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:49.499030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:49.499169Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:49.507393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2002 sessionId: src_id|a76cf2cd-4fdbfe2e-8a8573ab-c50191bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:49.510270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:49.612670Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:49.613074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:49.613093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:49.613418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_21_3187655180107370934_v1
2025-09-30T14:55:49.613427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:49.613451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:49.613443Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:49.613540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2002 reason: error at write: Disconnected sessionId: src_id|a76cf2cd-4fdbfe2e-8a8573ab-c50191bf_0
2025-09-30T14:55:49.613701Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_21_3187655180107370934_v1
2025-09-30T14:55:49.613773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2002 sessionId: src_id|a76cf2cd-4fdbfe2e-8a8573ab-c50191bf_0 is DEAD
2025-09-30T14:55:49.613796Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:49.613838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896087651530656:5488]
2025-09-30T14:55:49.613889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a76cf2cd-4fdbfe2e-8a8573ab-c50191bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:49.613901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a76cf2cd-4fdbfe2e-8a8573ab-c50191bf_0] Write session will restart in 0.008041s
2025-09-30T14:55:49.613926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a76cf2cd-4fdbfe2e-8a8573ab-c50191bf_0] Write session: Do CDS request
2025-09-30T14:55:49.613931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a76cf2cd-4fdbfe2e-8a8573ab-c50191bf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:49.624788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:49.625576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a76cf2cd-4fdbfe2e-8a8573ab-c50191bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:49.625906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:49.625922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2003
2025-09-30T14:55:49.626061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2003 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:49.626094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2003 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:49.626104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2003 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:49.626107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:49.626563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2003 sessionId:  describe result for acl check
2025-09-30T14:55:49.626608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:49.626614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:49.626616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:49.626622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896087651530757:5496] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:49.627226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896087651530757:5496] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:49.628436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:49.628652Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:49.628660Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:49.628669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:49.628714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:49.628742Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896087561760433:4135]
2025-09-30T14:55:49.629277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:49.629389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896087651530757:5496] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:49.629619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:49.629677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:49.629969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:49.630021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:49.630026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:49.630026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:49.630027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:49.630028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:49.630029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:49.630030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:49.630030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:49.630031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:49.630032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:49.630032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.630033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.630034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.630034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:49.630035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:49.630039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:49.630045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:49.630047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:49.630050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:49.630052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:49.630055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:49.630057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:49.630060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:49.630062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:49.630065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:49.630067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.630069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.630072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.630076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:49.630078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:49.630092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:49.630097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:49.630101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:49.630104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:49.630107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:49.630110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:49.630112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:49.630115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:49.630118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:49.630121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:49.630124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:49.630126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:49.630132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:49.630138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:49.630143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:49.630148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:49.630153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:49.630159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:49.630163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:49.630169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:49.630174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.630179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.630184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.630189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.630197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.630203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.630208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:49.630214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:49.630231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:49.630237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:49.630278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:49.635826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896087651530757:5496] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:49.635844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896087651530757:5496] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:49.635847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896087651530757:5496] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:49.635930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2003 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:49.636279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:49.637231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:49.637249Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:49.637251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:49.637256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:49.637263Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2002 [2:7555896087561760433:4135]
2025-09-30T14:55:49.637279Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:49.637296Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:49.637305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:49.637309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:49.637311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:49.637328Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:49.637342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:49.637354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:49.637521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.637533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.637535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.637539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:49.637544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:49.637618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:49.637626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.637640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.637654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.637679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:49.637700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896087651530705:2454], now have 1 active actors on pipe
2025-09-30T14:55:49.637708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896087651530795:5496], now have 1 active actors on pipe
2025-09-30T14:55:49.637716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896087561760427:4135]
2025-09-30T14:55:49.637722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896087561760427:4135]
2025-09-30T14:55:49.637725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896087561760427:4135]
2025-09-30T14:55:49.637737Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:49.637751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:49.637762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:49.637764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:49.637766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:49.637776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:49.637752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2002
2025-09-30T14:55:49.637779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:49.637753Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2002
2025-09-30T14:55:49.637811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896087561760427:4135]
2025-09-30T14:55:49.637821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:49.637824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:49.637838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:49.637846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:49.637892Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4193a12-1aed6250-239f9b26-75b30245_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:49.637902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:49.637909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:49.637911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:49.637920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:49.637930Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:49.637954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:49.638110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:49.638119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:49.638136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:49.638246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2003 partition: 0 MaxSeqNo: 42 sessionId: src_id|d4193a12-1aed6250-239f9b26-75b30245_0
2025-09-30T14:55:49.638596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a76cf2cd-4fdbfe2e-8a8573ab-c50191bf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d4193a12-1aed6250-239f9b26-75b30245_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:49.641531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4193a12-1aed6250-239f9b26-75b30245_0] Write session: try to update token
2025-09-30T14:55:49.641549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4193a12-1aed6250-239f9b26-75b30245_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:49.653053Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:49.653074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:49.653077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:49.653079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:49.653092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896087561760427:4135]
2025-09-30T14:55:49.653097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896087561760427:4135]
2025-09-30T14:55:49.653102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896087561760427:4135]
2025-09-30T14:55:49.653142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:49.653143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:49.653148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.653149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:49.653151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:49.653153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:49.653300Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:49.660814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2003 sessionId: src_id|d4193a12-1aed6250-239f9b26-75b30245_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:49.663447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:49.713619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896087651530805:5488]
2025-09-30T14:55:49.716157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2002, pipe: [1:7555896087651530805:5488]
2025-09-30T14:55:49.772697Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:49.773049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:49.773070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:49.773114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896087651530805:5488], now have 1 active actors on pipe
2025-09-30T14:55:49.773330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:49.773343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:49.773357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:49.773361Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:49.773404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2003 reason: error at write: Disconnected sessionId: src_id|d4193a12-1aed6250-239f9b26-75b30245_0
2025-09-30T14:55:49.773411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896087651530805:5488]
2025-09-30T14:55:49.773595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2003 sessionId: src_id|d4193a12-1aed6250-239f9b26-75b30245_0 is DEAD
2025-09-30T14:55:49.773728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4193a12-1aed6250-239f9b26-75b30245_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:49.773738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4193a12-1aed6250-239f9b26-75b30245_0] Write session will restart in 0.009851s
2025-09-30T14:55:49.773761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4193a12-1aed6250-239f9b26-75b30245_0] Write session: Do CDS request
2025-09-30T14:55:49.773770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4193a12-1aed6250-239f9b26-75b30245_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:49.783529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:49.784779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4193a12-1aed6250-239f9b26-75b30245_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:49.784880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:49.784896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2004
2025-09-30T14:55:49.785034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2004 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:49.785067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2004 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:49.785078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2004 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:49.785082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:49.785445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:49.785515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2004 sessionId:  describe result for acl check
2025-09-30T14:55:49.785550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:49.785556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:49.785559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:49.785564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896087651530859:5484] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:49.785631Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:49.785643Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:49.785653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:49.785703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:49.785743Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896087561760534:4130]
2025-09-30T14:55:49.786094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896087651530859:5484] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:49.786436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:49.786718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:49.786764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:49.787120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:49.787181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:49.787187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:49.787189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:49.787190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:49.787191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:49.787192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:49.787193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:49.787195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:49.787196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:49.787197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:49.787198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.787200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.787201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.787202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:49.787203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:49.787211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:49.787220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:49.787225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:49.787229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:49.787233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:49.787237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:49.787260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:49.787265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:49.787268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:49.787273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:49.787277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.787281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.787285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.787289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:49.787293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:49.787300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:49.787309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:49.787314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:49.787322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:49.787327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:49.787337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:49.787342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:49.787347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:49.787357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:49.787362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:49.787372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:49.787377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:49.787389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:49.787395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:49.787403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:49.787409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:49.787414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:49.787425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:49.787429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:49.787439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:49.787444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.787454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.787459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.787468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.787472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.787478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.787487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:49.787492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:49.787497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:49.787506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:49.787566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:49.788031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896087651530859:5484] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:49.792597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896087651530859:5484] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:49.792610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896087651530859:5484] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:49.792614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896087651530859:5484] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:49.792622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2004 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:49.792933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:49.793951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:49.793968Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:49.793973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:49.793976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:49.793983Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2003 [2:7555896087561760534:4130]
2025-09-30T14:55:49.793997Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:49.794011Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:49.794014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:49.794017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:49.794020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:49.794035Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:49.794045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:49.794052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:49.794106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.794115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.794117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.794120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:49.794122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:49.794186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:49.794195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.794204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.794219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.794238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:49.794259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896087651530897:5484], now have 1 active actors on pipe
2025-09-30T14:55:49.794268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896087651530806:2454], now have 1 active actors on pipe
2025-09-30T14:55:49.794273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896087561760528:4130]
2025-09-30T14:55:49.794275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896087561760528:4130]
2025-09-30T14:55:49.794277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896087561760528:4130]
2025-09-30T14:55:49.794289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:49.794302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:49.794308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:49.794312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:49.794314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:49.794317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:49.794320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:49.794347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896087561760528:4130]
2025-09-30T14:55:49.794354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:49.794335Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2003
2025-09-30T14:55:49.794362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:49.794336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2003
2025-09-30T14:55:49.794381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:49.794385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:49.794417Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68605498-79ca089e-6f8f8110-1f1ba1a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:49.794423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:49.794427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:49.794429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:49.794438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:49.794449Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:49.794470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:49.794656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:49.794666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:49.794680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:49.794761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2004 partition: 0 MaxSeqNo: 42 sessionId: src_id|68605498-79ca089e-6f8f8110-1f1ba1a7_0
2025-09-30T14:55:49.795090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4193a12-1aed6250-239f9b26-75b30245_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|68605498-79ca089e-6f8f8110-1f1ba1a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:49.797837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68605498-79ca089e-6f8f8110-1f1ba1a7_0] Write session: try to update token
2025-09-30T14:55:49.797854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68605498-79ca089e-6f8f8110-1f1ba1a7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:49.806705Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:49.806731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:49.806733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:49.806735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:49.806743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896087561760528:4130]
2025-09-30T14:55:49.806747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896087561760528:4130]
2025-09-30T14:55:49.806751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896087561760528:4130]
2025-09-30T14:55:49.806792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:49.806805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.806807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:49.806814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:49.806822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:49.806827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:49.806949Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:49.812983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2004 sessionId: src_id|68605498-79ca089e-6f8f8110-1f1ba1a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:49.815884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:49.873346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896087651530917:5488]
2025-09-30T14:55:49.873623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2003, pipe: [1:7555896087651530917:5488]
2025-09-30T14:55:49.946260Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:49.946591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:49.946607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:49.946646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896087651530917:5488], now have 1 active actors on pipe
2025-09-30T14:55:49.946877Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:49.946897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:49.946910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:49.946977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896087651530917:5488]
2025-09-30T14:55:49.946987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2004 reason: error at write: Disconnected sessionId: src_id|68605498-79ca089e-6f8f8110-1f1ba1a7_0
2025-09-30T14:55:49.947013Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:49.947185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2004 sessionId: src_id|68605498-79ca089e-6f8f8110-1f1ba1a7_0 is DEAD
2025-09-30T14:55:49.947415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68605498-79ca089e-6f8f8110-1f1ba1a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:49.947427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68605498-79ca089e-6f8f8110-1f1ba1a7_0] Write session will restart in 0.005723s
2025-09-30T14:55:49.947452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68605498-79ca089e-6f8f8110-1f1ba1a7_0] Write session: Do CDS request
2025-09-30T14:55:49.947462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68605498-79ca089e-6f8f8110-1f1ba1a7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:49.954776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68605498-79ca089e-6f8f8110-1f1ba1a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:49.954963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:49.954978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2005
2025-09-30T14:55:49.955145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2005 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:49.955207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2005 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:49.955215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2005 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:49.955221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:49.955688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2005 sessionId:  describe result for acl check
2025-09-30T14:55:49.955722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:49.955729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:49.955731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:49.955737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896087651530936:5483] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:49.956291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896087651530936:5483] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:49.958260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896087651530936:5483] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:49.960207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896087651530936:5483] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:49.960239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896087651530936:5483] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:49.960244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896087651530936:5483] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:49.960253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2005 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:49.963399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:49.965431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:49.965683Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:49.965695Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:49.965706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:49.965760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:49.965806Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896087561760627:4126]
2025-09-30T14:55:49.966513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:49.966818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:49.966868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:49.967210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:49.967294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:49.967305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:49.967306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:49.967307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:49.967308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:49.967310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:49.967311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:49.967312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:49.967313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:49.967314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:49.967315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.967316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.967318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.967319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:49.967320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:49.967326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:49.967336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:49.967341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:49.967346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:49.967350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:49.967355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:49.967359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:49.967363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:49.967368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:49.967373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:49.967378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.967382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.967386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.967391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:49.967395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:49.967404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:49.967414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:49.967420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:49.967425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:49.967431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:49.967437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:49.967441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:49.967447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:49.967452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:49.967458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:49.967463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:49.967468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:49.967473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:49.967479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:49.967484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:49.967490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:49.967495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:49.967501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:49.967506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:49.967512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:49.967516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.967522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.967527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.967533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.967538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.967553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.967558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:49.967564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:49.967569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:49.967574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:49.967618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:49.973515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:49.974716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:49.974736Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:49.974744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:49.974749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:49.974758Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2004 [2:7555896087561760627:4126]
2025-09-30T14:55:49.974775Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:49.974792Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:49.974806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:49.974810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:49.974812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:49.974829Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:49.974837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:49.974844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:49.974909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.974920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.974923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.974926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:49.974932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:49.975031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:49.975046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.975062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:49.975075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:49.975099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:49.975126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896087651530967:5483], now have 1 active actors on pipe
2025-09-30T14:55:49.975136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896087651530918:2454], now have 1 active actors on pipe
2025-09-30T14:55:49.975143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896087561760622:4126]
2025-09-30T14:55:49.975151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896087561760622:4126]
2025-09-30T14:55:49.975153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896087561760622:4126]
2025-09-30T14:55:49.975174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:49.975194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:49.975214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:49.975219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:49.975223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:49.975223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:49.975226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:49.975281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896087561760622:4126]
2025-09-30T14:55:49.975290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:49.975293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:49.975260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2004
2025-09-30T14:55:49.975301Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2004
2025-09-30T14:55:49.975322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:49.975332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:49.975374Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|244a46af-32014944-74fe5818-577e4623_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:49.975385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:49.975390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:49.975396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:49.975408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:49.975417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:49.975442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:49.975621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:49.975630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:49.975643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:49.975735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2005 partition: 0 MaxSeqNo: 42 sessionId: src_id|244a46af-32014944-74fe5818-577e4623_0
2025-09-30T14:55:49.976086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68605498-79ca089e-6f8f8110-1f1ba1a7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|244a46af-32014944-74fe5818-577e4623_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:49.979013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|244a46af-32014944-74fe5818-577e4623_0] Write session: try to update token
2025-09-30T14:55:49.979033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|244a46af-32014944-74fe5818-577e4623_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:49.992150Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:49.992179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:49.992182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:49.992185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:49.992194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896087561760622:4126]
2025-09-30T14:55:49.992200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896087561760622:4126]
2025-09-30T14:55:49.992204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896087561760622:4126]
2025-09-30T14:55:49.992247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:49.992258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:49.992263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:49.992338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:49.992347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:49.992352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:49.992396Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:50.001359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2005 sessionId: src_id|244a46af-32014944-74fe5818-577e4623_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:50.004058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:50.046927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896091946498314:5488]
2025-09-30T14:55:50.047409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2004, pipe: [1:7555896091946498314:5488]
2025-09-30T14:55:50.113118Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:50.113643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:50.113664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:50.113683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896091946498314:5488], now have 1 active actors on pipe
2025-09-30T14:55:50.113841Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:50.114341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|244a46af-32014944-74fe5818-577e4623_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:50.114351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|244a46af-32014944-74fe5818-577e4623_0] Write session will restart in 0.007582s
2025-09-30T14:55:50.114374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|244a46af-32014944-74fe5818-577e4623_0] Write session: Do CDS request
2025-09-30T14:55:50.114380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|244a46af-32014944-74fe5818-577e4623_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:50.113913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:50.113999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2005 reason: status is not ok: tablet will be restarted right now sessionId: src_id|244a46af-32014944-74fe5818-577e4623_0
2025-09-30T14:55:50.114187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2005 sessionId: src_id|244a46af-32014944-74fe5818-577e4623_0 is DEAD
2025-09-30T14:55:50.114351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:50.114381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896091946498314:5488]
2025-09-30T14:55:50.122797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|244a46af-32014944-74fe5818-577e4623_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:50.122899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:50.122915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2006
2025-09-30T14:55:50.123589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2006 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:50.123646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2006 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:50.123656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2006 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:50.123660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:50.124047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2006 sessionId:  describe result for acl check
2025-09-30T14:55:50.124083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:50.124085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:50.124086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:50.124091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896091946498392:5466] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:50.124465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:50.124602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896091946498392:5466] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:50.126504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:50.126712Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:50.126723Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:50.126735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:50.126790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:50.126849Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896091856728050:4113]
2025-09-30T14:55:50.126933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896091946498392:5466] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:50.127518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:50.127866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:50.127918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:50.128247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:50.128320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:50.128329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:50.128332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:50.128333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:50.128334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:50.128335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:50.128336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:50.128337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:50.128338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:50.128339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:50.128340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.128341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.128341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.128342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:50.128344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:50.128349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:50.128358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:50.128362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:50.128365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:50.128369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:50.128374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:50.128378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:50.128382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:50.128386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:50.128390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:50.128394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.128398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.128402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.128406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:50.128410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:50.128418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:50.128426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:50.128432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:50.128439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:50.128444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:50.128449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:50.128453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:50.128458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:50.128463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:50.128468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:50.128472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:50.128477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:50.128482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:50.128487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:50.128491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:50.128497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:50.128502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:50.128507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:50.128511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:50.128517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:50.128522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.128527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.128532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.128538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.128543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.128557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.128561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:50.128566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:50.128571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:50.128577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:50.128623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:50.129633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896091946498392:5466] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:50.129656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896091946498392:5466] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:50.129659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896091946498392:5466] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:50.129668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2006 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:50.134154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:50.135038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:50.135052Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:50.135055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:50.135058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:50.135065Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2005 [2:7555896091856728050:4113]
2025-09-30T14:55:50.135077Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:50.135090Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:50.135092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:50.135094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:50.135095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:50.135108Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:50.135113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:50.135118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:50.135162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.135168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.135170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.135173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:50.135174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:50.135361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:50.135383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.135394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.135407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.135428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:50.135405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2005
2025-09-30T14:55:50.135407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2005
2025-09-30T14:55:50.135454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896091946498328:2454], now have 1 active actors on pipe
2025-09-30T14:55:50.135463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896091946498432:5466], now have 1 active actors on pipe
2025-09-30T14:55:50.135470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896091856728044:4113]
2025-09-30T14:55:50.135473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896091856728044:4113]
2025-09-30T14:55:50.135475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896091856728044:4113]
2025-09-30T14:55:50.135492Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:50.135512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:50.135511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:50.135515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:50.135517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:50.135535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:50.135538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:50.135560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:50.135564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:50.135597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896091856728044:4113]
2025-09-30T14:55:50.135606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:50.135614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:50.135621Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ea74ed5-ed536ca5-49315e5b-e64b59d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:50.135627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:50.135629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:50.135630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:50.135638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:50.135644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:50.135676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:50.135855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:50.135869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:50.135892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:50.136008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2006 partition: 0 MaxSeqNo: 42 sessionId: src_id|2ea74ed5-ed536ca5-49315e5b-e64b59d7_0
2025-09-30T14:55:50.136386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|244a46af-32014944-74fe5818-577e4623_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2ea74ed5-ed536ca5-49315e5b-e64b59d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:50.139201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea74ed5-ed536ca5-49315e5b-e64b59d7_0] Write session: try to update token
2025-09-30T14:55:50.139220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea74ed5-ed536ca5-49315e5b-e64b59d7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:50.148165Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:50.148192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:50.148203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896091856728044:4113]
2025-09-30T14:55:50.148255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:50.148259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:50.148460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:50.148694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:50.148907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:50.149145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:50.149532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:50.149601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:50.154690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2006 sessionId: src_id|2ea74ed5-ed536ca5-49315e5b-e64b59d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:50.157554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:50.157819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:50.157858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:50.157906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:50.158004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:50.159866Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:50.159889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:50.159891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:50.159893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:50.159903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896091856728044:4113]
2025-09-30T14:55:50.159908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896091856728044:4113]
2025-09-30T14:55:50.159913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896091856728044:4113]
2025-09-30T14:55:50.159955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:50.159967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.159973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:50.159979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:50.159981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:50.159987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:50.160127Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:50.214463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896091946498445:5488]
2025-09-30T14:55:50.214894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2005, pipe: [1:7555896091946498445:5488]
2025-09-30T14:55:50.277624Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:50.286723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:50.286763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:50.286957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:50.287025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:50.287091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:50.287157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:50.287203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:50.287209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:50.287396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:50.287474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:50.287540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:50.287607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:50.287649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:50.287653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:50.287728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:50.287791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:50.287857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:50.287927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:50.287970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:50.287973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:50.288050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:50.288131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:50.288198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:50.288269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:50.288313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:50.288316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:50.288399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:50.288466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:50.288535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:50.288602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:50.288647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:50.288651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:50.288726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:50.288792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:50.288859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:50.288925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:50.290661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896091946498445:5488]
2025-09-30T14:55:50.290691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:50.290738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:50.288971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:50.288974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:50.289048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:50.289112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:50.289187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:50.289258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:50.289301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:50.289304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:50.290746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:50.290777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2006 reason: error at write: Disconnected sessionId: src_id|2ea74ed5-ed536ca5-49315e5b-e64b59d7_0
2025-09-30T14:55:50.290963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2006 sessionId: src_id|2ea74ed5-ed536ca5-49315e5b-e64b59d7_0 is DEAD
2025-09-30T14:55:50.289384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:50.289446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:50.289531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:50.289597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:50.289640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:50.289643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:50.289718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:50.289782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:50.289849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:50.289918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:50.289963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:50.289966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:50.290043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:50.290114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:50.290180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:50.290252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:50.290296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:50.290300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:50.290378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896091946498445:5488], now have 1 active actors on pipe
2025-09-30T14:55:50.292046Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:50.292686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea74ed5-ed536ca5-49315e5b-e64b59d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:50.292694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea74ed5-ed536ca5-49315e5b-e64b59d7_0] Write session will restart in 0.009420s
2025-09-30T14:55:50.292719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea74ed5-ed536ca5-49315e5b-e64b59d7_0] Write session: Do CDS request
2025-09-30T14:55:50.292726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea74ed5-ed536ca5-49315e5b-e64b59d7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:50.303801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea74ed5-ed536ca5-49315e5b-e64b59d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:50.304199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:50.304215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2007
2025-09-30T14:55:50.304373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2007 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:50.304414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2007 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:50.304420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2007 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:50.304424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:50.304916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2007 sessionId:  describe result for acl check
2025-09-30T14:55:50.304958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:50.304961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:50.304963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:50.304970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896091946498475:5460] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:50.305552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896091946498475:5460] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:50.307958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:50.311132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896091946498475:5460] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:50.310444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:50.310660Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:50.310664Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:50.310675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:50.310729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:50.310766Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896091856728143:4106]
2025-09-30T14:55:50.311485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:50.312065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:50.312120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:50.312470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:50.312528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:50.312530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:50.312531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:50.312533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:50.312534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:50.312536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:50.312537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:50.312539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:50.312540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:50.312541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:50.312543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.312544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.312545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.312547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:50.312550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:50.312555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:50.312566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:50.312571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:50.312576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:50.312580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:50.312585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:50.312589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:50.312594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:50.312598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:50.312603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:50.312607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.312611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.312615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.312619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:50.312623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:50.312629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:50.312637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:50.312643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:50.312649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:50.312654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:50.312659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:50.312663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:50.312669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:50.312675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:50.312680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:50.312687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:50.312693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:50.312698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:50.312704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:50.312709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:50.312716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:50.312722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:50.312727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:50.312732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:50.312738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:50.312744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.312750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.312755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.312761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.312767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.312772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.312777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:50.312785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:50.312790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:50.312796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:50.312845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:50.317983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896091946498475:5460] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:50.318000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896091946498475:5460] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:50.318004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896091946498475:5460] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:50.318014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2007 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:50.318977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:50.319957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:50.319980Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:50.319983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:50.319988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:50.319996Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2006 [2:7555896091856728143:4106]
2025-09-30T14:55:50.320015Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:50.320036Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:50.320049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:50.320053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:50.320055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:50.320074Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:50.320088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:50.320096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:50.320168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.320170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.320171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.320175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:50.320178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:50.320373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:50.320376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.320392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.320404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.320420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:50.320441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896091946498450:2454], now have 1 active actors on pipe
2025-09-30T14:55:50.320447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896091946498543:5460], now have 1 active actors on pipe
2025-09-30T14:55:50.320454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896091856728138:4106]
2025-09-30T14:55:50.320457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896091856728138:4106]
2025-09-30T14:55:50.320459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896091856728138:4106]
2025-09-30T14:55:50.320473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:50.320489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:50.320489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:50.320493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:50.320499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:50.320504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:50.320508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:50.320549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896091856728138:4106]
2025-09-30T14:55:50.320557Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:50.320575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:50.320612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2006
2025-09-30T14:55:50.320649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2006
2025-09-30T14:55:50.320716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:50.320734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:50.320758Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52eaca5-d204d5ce-6098f161-d841242e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:50.320766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:50.320770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:50.320774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:50.320787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:50.320798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:50.320813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:50.321122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:50.321133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:50.321149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:50.321378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2007 partition: 0 MaxSeqNo: 42 sessionId: src_id|52eaca5-d204d5ce-6098f161-d841242e_0
2025-09-30T14:55:50.321761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea74ed5-ed536ca5-49315e5b-e64b59d7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|52eaca5-d204d5ce-6098f161-d841242e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:50.324722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52eaca5-d204d5ce-6098f161-d841242e_0] Write session: try to update token
2025-09-30T14:55:50.324744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52eaca5-d204d5ce-6098f161-d841242e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:50.333896Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:50.333919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:50.333922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:50.333925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:50.333935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896091856728138:4106]
2025-09-30T14:55:50.333939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896091856728138:4106]
2025-09-30T14:55:50.333944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896091856728138:4106]
2025-09-30T14:55:50.333991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:50.333994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:50.333998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.334001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:50.334001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:50.334004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:50.334149Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:50.341396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2007 sessionId: src_id|52eaca5-d204d5ce-6098f161-d841242e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:50.344443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:50.390999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896091946498552:5488]
2025-09-30T14:55:50.391458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2006, pipe: [1:7555896091946498552:5488]
2025-09-30T14:55:50.455818Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:50.456245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:50.456282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:50.456326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896091946498552:5488], now have 1 active actors on pipe
2025-09-30T14:55:50.456547Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:50.456525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:50.456539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896091946498552:5488]
2025-09-30T14:55:50.456565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:50.456568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:50.456640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2007 reason: error at write: Disconnected sessionId: src_id|52eaca5-d204d5ce-6098f161-d841242e_0
2025-09-30T14:55:50.456818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2007 sessionId: src_id|52eaca5-d204d5ce-6098f161-d841242e_0 is DEAD
2025-09-30T14:55:50.456975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52eaca5-d204d5ce-6098f161-d841242e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:50.456986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52eaca5-d204d5ce-6098f161-d841242e_0] Write session will restart in 0.005007s
2025-09-30T14:55:50.457008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52eaca5-d204d5ce-6098f161-d841242e_0] Write session: Do CDS request
2025-09-30T14:55:50.457023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52eaca5-d204d5ce-6098f161-d841242e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:50.462784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52eaca5-d204d5ce-6098f161-d841242e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:50.462859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:50.462875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2008
2025-09-30T14:55:50.463018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2008 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:50.463048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2008 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:50.463057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2008 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:50.463061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:50.463513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2008 sessionId:  describe result for acl check
2025-09-30T14:55:50.463549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:50.463556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:50.463557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:50.463563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896091946498567:5451] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:50.464101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896091946498567:5451] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:50.466419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896091946498567:5451] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:50.469305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896091946498567:5451] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:50.469325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896091946498567:5451] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:50.469328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896091946498567:5451] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:50.469335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2008 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:50.469327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:50.471472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:50.471649Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:50.471658Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:50.471666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:50.471715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:50.471757Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896091856728240:4101]
2025-09-30T14:55:50.472289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:50.472587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:50.472632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:50.472965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:50.473042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:50.473052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:50.473053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:50.473055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:50.473056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:50.473057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:50.473058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:50.473060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:50.473061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:50.473062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:50.473063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.473065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.473066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.473067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:50.473068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:50.473074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:50.473084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:50.473088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:50.473093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:50.473097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:50.473101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:50.473105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:50.473109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:50.473113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:50.473117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:50.473121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.473125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.473129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.473133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:50.473138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:50.473146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:50.473156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:50.473161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:50.473165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:50.473168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:50.473171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:50.473174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:50.473177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:50.473181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:50.473184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:50.473188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:50.473190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:50.473193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:50.473196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:50.473199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:50.473202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:50.473204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:50.473209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:50.473214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:50.473219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:50.473224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.473228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.473232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.473237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.473242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.473247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.473252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:50.473256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:50.473259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:50.473262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:50.473287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:50.479042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:50.479902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:50.479919Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:50.479924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:50.479927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:50.479933Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2007 [2:7555896091856728240:4101]
2025-09-30T14:55:50.479946Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:50.479958Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:50.479960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:50.479962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:50.479964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:50.479976Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:50.479983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:50.479995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:50.480046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.480053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.480054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.480057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:50.480059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:50.480125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:50.480130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.480140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.480147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.480157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:50.480180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896091856728234:4101]
2025-09-30T14:55:50.480182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896091856728234:4101]
2025-09-30T14:55:50.480184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896091856728234:4101]
2025-09-30T14:55:50.480200Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:50.480215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896091946498553:2454], now have 1 active actors on pipe
2025-09-30T14:55:50.480219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896091946498642:5451], now have 1 active actors on pipe
2025-09-30T14:55:50.480223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:50.480226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:50.480227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:50.480229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:50.480240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:50.480243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:50.480280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896091856728234:4101]
2025-09-30T14:55:50.480287Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:50.480294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:50.480298Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2007
2025-09-30T14:55:50.480301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2007
2025-09-30T14:55:50.480353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:50.480363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:50.480391Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d5450a1-b400f78f-3f12459e-1ae9186a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:50.480402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:50.480406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:50.480414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:50.480423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:50.480436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:50.480452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:50.480745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:50.480758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:50.480776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:50.480887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2008 partition: 0 MaxSeqNo: 42 sessionId: src_id|9d5450a1-b400f78f-3f12459e-1ae9186a_0
2025-09-30T14:55:50.481281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52eaca5-d204d5ce-6098f161-d841242e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9d5450a1-b400f78f-3f12459e-1ae9186a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:50.484018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d5450a1-b400f78f-3f12459e-1ae9186a_0] Write session: try to update token
2025-09-30T14:55:50.484040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d5450a1-b400f78f-3f12459e-1ae9186a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:50.493065Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:50.493091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:50.493103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896091856728234:4101]
2025-09-30T14:55:50.493151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:50.493160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:50.493362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:50.493556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:50.493723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:50.493887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:50.494240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:50.494306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:50.498698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2008 sessionId: src_id|9d5450a1-b400f78f-3f12459e-1ae9186a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:50.501473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:50.501792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:50.501834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:50.501872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:50.501986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:50.505190Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:50.505211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:50.505213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:50.505215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:50.505226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896091856728234:4101]
2025-09-30T14:55:50.505231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896091856728234:4101]
2025-09-30T14:55:50.505235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896091856728234:4101]
2025-09-30T14:55:50.505277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:50.505282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:50.505285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.505289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:50.505299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:50.505323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:50.505427Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:50.556892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896091946498656:5488]
2025-09-30T14:55:50.557175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2007, pipe: [1:7555896091946498656:5488]
2025-09-30T14:55:50.621265Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:50.631008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:50.631042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:50.631238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:50.631335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:50.631427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:50.631499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:50.631916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:50.631932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:50.632011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:50.632078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:50.632140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:50.632216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:50.632261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:50.632269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:50.632346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:50.632414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:50.632488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:50.632559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:50.632611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:50.632620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:50.632695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:50.632773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:50.632849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:50.632933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:50.632984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:50.632992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:50.633073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:50.633142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:50.633207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:50.633274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:50.633316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:50.633320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:50.633397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:50.633459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:50.633538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:50.633602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:50.633655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:50.633658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:50.633736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:50.633799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:50.633870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:50.633934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:50.634425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:50.634429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:50.634502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:50.634561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:50.634621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:50.634682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:50.634724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:50.634726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:50.634808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:50.634868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:50.634933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:50.635000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:50.635057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:50.635063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:50.635129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:50.635187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:50.635402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:50.635473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:50.635523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:50.635531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:50.635585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896091946498656:5488], now have 1 active actors on pipe
2025-09-30T14:55:50.635838Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:50.635845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896091946498656:5488]
2025-09-30T14:55:50.635884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:50.635889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:50.636278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2008 reason: error at write: Disconnected sessionId: src_id|9d5450a1-b400f78f-3f12459e-1ae9186a_0
2025-09-30T14:55:50.636467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2008 sessionId: src_id|9d5450a1-b400f78f-3f12459e-1ae9186a_0 is DEAD
2025-09-30T14:55:50.636261Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:50.636657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d5450a1-b400f78f-3f12459e-1ae9186a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:50.636666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d5450a1-b400f78f-3f12459e-1ae9186a_0] Write session will restart in 0.006126s
2025-09-30T14:55:50.636691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d5450a1-b400f78f-3f12459e-1ae9186a_0] Write session: Do CDS request
2025-09-30T14:55:50.636698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d5450a1-b400f78f-3f12459e-1ae9186a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:50.643850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d5450a1-b400f78f-3f12459e-1ae9186a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:50.644536Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:50.644554Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2009
2025-09-30T14:55:50.644679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2009 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:50.644710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2009 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:50.644716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2009 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:50.644720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:50.645153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2009 sessionId:  describe result for acl check
2025-09-30T14:55:50.645191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:50.645193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:50.645195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:50.645201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896091946498684:5448] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:50.645799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896091946498684:5448] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:50.648042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:50.648464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896091946498684:5448] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:50.650161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:50.650376Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:50.650387Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:50.650397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:50.650450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:50.650487Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896091856728334:4098]
2025-09-30T14:55:50.651090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:50.651434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:50.651460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896091946498684:5448] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:50.651477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896091946498684:5448] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:50.651480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896091946498684:5448] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:50.651489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2009 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:50.651501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:50.651851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:50.651939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:50.651947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:50.651948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:50.651949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:50.651950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:50.651952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:50.651953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:50.651954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:50.651955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:50.651956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:50.651958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.651958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.651960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.651961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:50.651962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:50.651968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:50.651978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:50.651982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:50.651989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:50.651993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:50.651997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:50.652001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:50.652005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:50.652008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:50.652012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:50.652016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.652020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.652023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.652027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:50.652030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:50.652040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:50.652048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:50.652054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:50.652060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:50.652065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:50.652077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:50.652083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:50.652093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:50.652099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:50.652109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:50.652114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:50.652124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:50.652135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:50.652140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:50.652145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:50.652151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:50.652156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:50.652162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:50.652167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:50.652174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:50.652180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.652191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.652199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.652205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.652212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.652218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.652223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:50.652234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:50.652246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:50.652256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:50.652310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:50.658784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:50.659770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:50.659788Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:50.659791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:50.659795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:50.659805Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2008 [2:7555896091856728334:4098]
2025-09-30T14:55:50.659822Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:50.659839Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:50.659843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:50.659846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:50.659848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:50.659866Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:50.659874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:50.659882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:50.659952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.659959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.659961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.659964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:50.659966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:50.660042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:50.660051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.660063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.660073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.660089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:50.660107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896091856728329:4098]
2025-09-30T14:55:50.660109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896091856728329:4098]
2025-09-30T14:55:50.660111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896091856728329:4098]
2025-09-30T14:55:50.660125Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:50.660140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896091946498658:2454], now have 1 active actors on pipe
2025-09-30T14:55:50.660142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:50.660147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:50.660149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896091946498753:5448], now have 1 active actors on pipe
2025-09-30T14:55:50.660149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:50.660156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:50.660169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:50.660172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:50.660175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2008
2025-09-30T14:55:50.660193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2008
2025-09-30T14:55:50.660206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896091856728329:4098]
2025-09-30T14:55:50.660223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:50.660270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:50.660453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:50.660473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:50.660512Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|351cbc30-6c217e5f-93f10c55-9f27d3a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:50.660528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:50.660532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:50.660534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:50.660545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:50.660560Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:50.660593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:50.660750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:50.660758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:50.660771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:50.660876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2009 partition: 0 MaxSeqNo: 42 sessionId: src_id|351cbc30-6c217e5f-93f10c55-9f27d3a_0
2025-09-30T14:55:50.661251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d5450a1-b400f78f-3f12459e-1ae9186a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|351cbc30-6c217e5f-93f10c55-9f27d3a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:50.664083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|351cbc30-6c217e5f-93f10c55-9f27d3a_0] Write session: try to update token
2025-09-30T14:55:50.664106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|351cbc30-6c217e5f-93f10c55-9f27d3a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:50.673961Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:50.673998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:50.674002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:50.674005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:50.674016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896091856728329:4098]
2025-09-30T14:55:50.674022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896091856728329:4098]
2025-09-30T14:55:50.674028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896091856728329:4098]
2025-09-30T14:55:50.674078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:50.674082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:50.674089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:50.674093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:50.674096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.674100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:50.674300Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:50.682933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2009 sessionId: src_id|351cbc30-6c217e5f-93f10c55-9f27d3a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:50.685753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:50.736077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896091946498764:5488]
2025-09-30T14:55:50.736365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2008, pipe: [1:7555896091946498764:5488]
2025-09-30T14:55:50.791988Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:50.792343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:50.792358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:50.792381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896091946498764:5488], now have 1 active actors on pipe
2025-09-30T14:55:50.792624Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:50.793050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|351cbc30-6c217e5f-93f10c55-9f27d3a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:50.793060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|351cbc30-6c217e5f-93f10c55-9f27d3a_0] Write session will restart in 0.008229s
2025-09-30T14:55:50.792617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:50.792631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:50.793084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|351cbc30-6c217e5f-93f10c55-9f27d3a_0] Write session: Do CDS request
2025-09-30T14:55:50.793090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|351cbc30-6c217e5f-93f10c55-9f27d3a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:50.792661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:50.792708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2009 reason: error at write: Disconnected sessionId: src_id|351cbc30-6c217e5f-93f10c55-9f27d3a_0
2025-09-30T14:55:50.792722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896091946498764:5488]
2025-09-30T14:55:50.792893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2009 sessionId: src_id|351cbc30-6c217e5f-93f10c55-9f27d3a_0 is DEAD
2025-09-30T14:55:50.802819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|351cbc30-6c217e5f-93f10c55-9f27d3a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:50.802834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:50.802851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2010
2025-09-30T14:55:50.803066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2010 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:50.803100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2010 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:50.803111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2010 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:50.803115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:50.803546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2010 sessionId:  describe result for acl check
2025-09-30T14:55:50.803580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:50.803582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:50.803584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:50.803589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896091946498822:5442] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:50.804198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896091946498822:5442] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:50.805432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:50.806466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:50.806660Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:50.806668Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:50.806678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:50.806730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:50.806770Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896091856728442:4094]
2025-09-30T14:55:50.807262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896091946498822:5442] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:50.807425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:50.807673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:50.807716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:50.808083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:50.808142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:50.808148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:50.808149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:50.808150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:50.808152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:50.808153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:50.808155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:50.808156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:50.808158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:50.808159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:50.808160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.808162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.808163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.808164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:50.808165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:50.808170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:50.808178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:50.808182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:50.808186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:50.808190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:50.808193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:50.808197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:50.808201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:50.808204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:50.808208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:50.808212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.808215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.808219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.808223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:50.808226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:50.808233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:50.808243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:50.808248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:50.808253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:50.808258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:50.808262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:50.808267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:50.808272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:50.808276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:50.808281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:50.808285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:50.808289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:50.808294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:50.808298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:50.808303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:50.808308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:50.808312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:50.808316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:50.808321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:50.808325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:50.808329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.808334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.808338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.808342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.808347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.808351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.808355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:50.808360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:50.808364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:50.808368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:50.808408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:50.814023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896091946498822:5442] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:50.814040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896091946498822:5442] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:50.814044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896091946498822:5442] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:50.814052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2010 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:50.814188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:50.815241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:50.815282Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:50.815285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:50.815289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:50.815299Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2009 [2:7555896091856728442:4094]
2025-09-30T14:55:50.815316Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:50.815331Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:50.815335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:50.815339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:50.815349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:50.815364Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:50.815378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:50.815385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:50.815447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.815455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.815458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.815462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:50.815464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:50.815535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:50.815544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.815559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.815579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.815603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:50.815631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896091946498862:5442], now have 1 active actors on pipe
2025-09-30T14:55:50.815634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896091946498765:2454], now have 1 active actors on pipe
2025-09-30T14:55:50.815641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896091856728436:4094]
2025-09-30T14:55:50.815643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896091856728436:4094]
2025-09-30T14:55:50.815645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896091856728436:4094]
2025-09-30T14:55:50.815660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:50.815673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:50.815677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:50.815681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:50.815683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:50.815689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:50.815692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:50.815725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896091856728436:4094]
2025-09-30T14:55:50.815743Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:50.815754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:50.815678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2009
2025-09-30T14:55:50.815708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2009
2025-09-30T14:55:50.815926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:50.815945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:50.815985Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14d266b1-ffc59e71-d26eb3e8-4694df52_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:50.816000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:50.816018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:50.816021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:50.816031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:50.816043Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:50.816067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:50.816246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:50.816256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:50.816271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:50.816366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2010 partition: 0 MaxSeqNo: 42 sessionId: src_id|14d266b1-ffc59e71-d26eb3e8-4694df52_0
2025-09-30T14:55:50.816723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|351cbc30-6c217e5f-93f10c55-9f27d3a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|14d266b1-ffc59e71-d26eb3e8-4694df52_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:50.820005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14d266b1-ffc59e71-d26eb3e8-4694df52_0] Write session: try to update token
2025-09-30T14:55:50.820026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14d266b1-ffc59e71-d26eb3e8-4694df52_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:50.828357Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:50.828381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:50.828384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:50.828389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:50.828400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896091856728436:4094]
2025-09-30T14:55:50.828405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896091856728436:4094]
2025-09-30T14:55:50.828410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896091856728436:4094]
2025-09-30T14:55:50.828454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:50.828467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.828469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:50.828476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:50.828482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:50.828487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:50.828621Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:50.836942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2010 sessionId: src_id|14d266b1-ffc59e71-d26eb3e8-4694df52_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:50.839826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:50.892796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896091946498882:5488]
2025-09-30T14:55:50.893137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2009, pipe: [1:7555896091946498882:5488]
2025-09-30T14:55:50.944891Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:50.945238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:50.945260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:50.945283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896091946498882:5488], now have 1 active actors on pipe
2025-09-30T14:55:50.945538Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:50.947338Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:50.947398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896091946498882:5488]
2025-09-30T14:55:50.947423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:50.947499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2010 reason: status is not ok: tablet will be restarted right now sessionId: src_id|14d266b1-ffc59e71-d26eb3e8-4694df52_0
2025-09-30T14:55:50.947683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2010 sessionId: src_id|14d266b1-ffc59e71-d26eb3e8-4694df52_0 is DEAD
2025-09-30T14:55:50.947864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14d266b1-ffc59e71-d26eb3e8-4694df52_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:50.947874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14d266b1-ffc59e71-d26eb3e8-4694df52_0] Write session will restart in 0.008333s
2025-09-30T14:55:50.947898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14d266b1-ffc59e71-d26eb3e8-4694df52_0] Write session: Do CDS request
2025-09-30T14:55:50.947904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14d266b1-ffc59e71-d26eb3e8-4694df52_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:50.957846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14d266b1-ffc59e71-d26eb3e8-4694df52_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:50.957925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:50.957940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2011
2025-09-30T14:55:50.958072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2011 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:50.958115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2011 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:50.958124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2011 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:50.958127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:50.958568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2011 sessionId:  describe result for acl check
2025-09-30T14:55:50.958604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:50.958606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:50.958608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:50.958615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896091946498952:5428] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:50.958796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:50.959166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896091946498952:5428] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:50.961038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:50.961255Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:50.961265Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:50.961275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:50.961299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896091946498952:5428] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:50.961337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:50.961374Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896091856728542:4081]
2025-09-30T14:55:50.961871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:50.962210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:50.962253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:50.962568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:50.962639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:50.962645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:50.962646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:50.962648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:50.962649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:50.962651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:50.962652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:50.962653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:50.962655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:50.962658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:50.962659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.962660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.962662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.962663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:50.962664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:50.962670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:50.962679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:50.962683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:50.962688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:50.962692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:50.962697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:50.962701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:50.962705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:50.962709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:50.962714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:50.962719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.962723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.962727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.962732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:50.962736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:50.962744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:50.962753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:50.962763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:50.962774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:50.962783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:50.962789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:50.962794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:50.962803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:50.962809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:50.962827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:50.962833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:50.962837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:50.962841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:50.962845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:50.962850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:50.962854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:50.962858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:50.962862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:50.962866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:50.962871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:50.962875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.962880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.962884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.962889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.962893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.962900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.962904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:50.962909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:50.962914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:50.962919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:50.962965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:50.968321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896091946498952:5428] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:50.968342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896091946498952:5428] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:50.968345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896091946498952:5428] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:50.968354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2011 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:50.968619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:50.969493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:50.969499Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:50.969503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:50.969507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:50.969515Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2010 [2:7555896091856728542:4081]
2025-09-30T14:55:50.969532Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:50.969547Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:50.969550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:50.969554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:50.969556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:50.969575Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:50.969582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:50.969588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:50.969649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.969652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.969653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.969657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:50.969660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:50.969726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:50.969729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.969743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:50.969756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:50.969774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:50.969790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896091856728537:4081]
2025-09-30T14:55:50.969793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896091856728537:4081]
2025-09-30T14:55:50.969795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896091856728537:4081]
2025-09-30T14:55:50.969809Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:50.969823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:50.969837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:50.970034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2010
2025-09-30T14:55:50.970076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2010
2025-09-30T14:55:50.969840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:50.969845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:50.969848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:50.969850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:50.969875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896091856728537:4081]
2025-09-30T14:55:50.969877Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:50.969897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:50.969918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896091946498886:2454], now have 1 active actors on pipe
2025-09-30T14:55:50.969922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896091946498987:5428], now have 1 active actors on pipe
2025-09-30T14:55:50.970184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:50.970191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:50.970219Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|754b6bbc-517de2c8-6d061eaf-205e6ea3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:50.970234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:50.970239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:50.970242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:50.970265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:50.970282Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:50.970305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:50.972327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:50.972342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:50.972379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:50.974960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2011 partition: 0 MaxSeqNo: 42 sessionId: src_id|754b6bbc-517de2c8-6d061eaf-205e6ea3_0
2025-09-30T14:55:50.975387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14d266b1-ffc59e71-d26eb3e8-4694df52_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|754b6bbc-517de2c8-6d061eaf-205e6ea3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:50.978242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|754b6bbc-517de2c8-6d061eaf-205e6ea3_0] Write session: try to update token
2025-09-30T14:55:50.978262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|754b6bbc-517de2c8-6d061eaf-205e6ea3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:50.984989Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:50.985010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:50.985026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896091856728537:4081]
2025-09-30T14:55:50.985073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:50.985258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:50.985408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:50.985566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:50.985712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:50.986001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:50.986045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:50.987377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:50.997313Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:50.997339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:50.997343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:50.997345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:50.997356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896091856728537:4081]
2025-09-30T14:55:50.997362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896091856728537:4081]
2025-09-30T14:55:50.997370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896091856728537:4081]
2025-09-30T14:55:50.997429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:50.997442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:50.997446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:50.997625Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:50.997987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2011 sessionId: src_id|754b6bbc-517de2c8-6d061eaf-205e6ea3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:50.999324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:50.999346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:50.999351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:51.000679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:51.045810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896096241466296:5488]
2025-09-30T14:55:51.046123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2010, pipe: [1:7555896096241466296:5488]
2025-09-30T14:55:51.119030Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:51.119450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:51.119470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:51.119491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896096241466296:5488], now have 1 active actors on pipe
2025-09-30T14:55:51.119741Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:51.119824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:51.119877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896096241466296:5488]
2025-09-30T14:55:51.119903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:51.119906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:51.119959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2011 reason: error at write: Disconnected sessionId: src_id|754b6bbc-517de2c8-6d061eaf-205e6ea3_0
2025-09-30T14:55:51.120128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2011 sessionId: src_id|754b6bbc-517de2c8-6d061eaf-205e6ea3_0 is DEAD
2025-09-30T14:55:51.120277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|754b6bbc-517de2c8-6d061eaf-205e6ea3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:51.120288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|754b6bbc-517de2c8-6d061eaf-205e6ea3_0] Write session will restart in 0.006854s
2025-09-30T14:55:51.120321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|754b6bbc-517de2c8-6d061eaf-205e6ea3_0] Write session: Do CDS request
2025-09-30T14:55:51.120330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|754b6bbc-517de2c8-6d061eaf-205e6ea3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:51.128739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|754b6bbc-517de2c8-6d061eaf-205e6ea3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:51.128846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:51.128860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2012
2025-09-30T14:55:51.128999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2012 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:51.129053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2012 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:51.129062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2012 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:51.129066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:51.129499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2012 sessionId:  describe result for acl check
2025-09-30T14:55:51.129538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:51.129540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:51.129542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:51.129548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896096241466364:5421] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:51.130064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896096241466364:5421] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:51.131465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:51.132320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896096241466364:5421] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:51.133324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:51.133521Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:51.133531Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:51.133542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:51.133604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:51.133641Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896096151695949:4082]
2025-09-30T14:55:51.134296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:51.134629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:51.134696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:51.135014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:51.135095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:51.135102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:51.135103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:51.135104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:51.135105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:51.135107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:51.135108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:51.135109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:51.135110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:51.135111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:51.135112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.135113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.135114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.135116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:51.135117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:51.135122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:51.135131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:51.135136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:51.135139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:51.135143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:51.135146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:51.135151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:51.135154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:51.135158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:51.135162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:51.135166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.135169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.135174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.135178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:51.135181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:51.135190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:51.135198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:51.135204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:51.135210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:51.135214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:51.135220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:51.135225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:51.135230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:51.135234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:51.135268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:51.135273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:51.135278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:51.135283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:51.135288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:51.135292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:51.135297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:51.135308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:51.135313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:51.135318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:51.135323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:51.135328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.135333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.135340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.135345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.135349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.135359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.135364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:51.135373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:51.135378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:51.135383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:51.135430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:51.138472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896096241466364:5421] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:51.138488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896096241466364:5421] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:51.138491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896096241466364:5421] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:51.138499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2012 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:51.142027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:51.143086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:51.143104Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:51.143106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:51.143111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:51.143117Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2011 [2:7555896096151695949:4082]
2025-09-30T14:55:51.143131Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:51.143146Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:51.143149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:51.143151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:51.143153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:51.143168Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:51.143179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:51.143185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:51.143273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.143281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.143283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.143286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:51.143288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:51.143355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:51.143363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.143378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.143394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.143421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:51.143440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896096241466409:5421], now have 1 active actors on pipe
2025-09-30T14:55:51.143444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896096241466299:2454], now have 1 active actors on pipe
2025-09-30T14:55:51.143451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896096151695944:4082]
2025-09-30T14:55:51.143453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896096151695944:4082]
2025-09-30T14:55:51.143455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896096151695944:4082]
2025-09-30T14:55:51.143467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:51.143480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:51.143491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:51.143495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:51.143497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:51.143501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:51.143506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:51.143545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896096151695944:4082]
2025-09-30T14:55:51.143553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:51.143532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2011
2025-09-30T14:55:51.143567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2011
2025-09-30T14:55:51.143713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:51.143790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:51.143802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:51.143827Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a940e42-3da2f2c6-4b237696-fc261dcd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:51.143841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:51.143849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:51.143852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:51.143862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:51.143877Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:51.143895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:51.144044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:51.144052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:51.144065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:51.144159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2012 partition: 0 MaxSeqNo: 42 sessionId: src_id|a940e42-3da2f2c6-4b237696-fc261dcd_0
2025-09-30T14:55:51.144572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|754b6bbc-517de2c8-6d061eaf-205e6ea3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a940e42-3da2f2c6-4b237696-fc261dcd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:51.147380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a940e42-3da2f2c6-4b237696-fc261dcd_0] Write session: try to update token
2025-09-30T14:55:51.147394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a940e42-3da2f2c6-4b237696-fc261dcd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:51.156506Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:51.156526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:51.156530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:51.156532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:51.156541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896096151695944:4082]
2025-09-30T14:55:51.156545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896096151695944:4082]
2025-09-30T14:55:51.156548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896096151695944:4082]
2025-09-30T14:55:51.156593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:51.156600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.156600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:51.156603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:51.156607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:51.156613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:51.156761Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:51.162779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2012 sessionId: src_id|a940e42-3da2f2c6-4b237696-fc261dcd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:51.165743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:51.219934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896096241466434:5488]
2025-09-30T14:55:51.220393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2011, pipe: [1:7555896096241466434:5488]
2025-09-30T14:55:51.280514Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:51.280866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:51.280891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:51.280941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896096241466434:5488], now have 1 active actors on pipe
2025-09-30T14:55:51.281193Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:51.281693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:51.281720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:51.281767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896096241466434:5488]
2025-09-30T14:55:51.281798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2012 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a940e42-3da2f2c6-4b237696-fc261dcd_0
2025-09-30T14:55:51.282007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2012 sessionId: src_id|a940e42-3da2f2c6-4b237696-fc261dcd_0 is DEAD
2025-09-30T14:55:51.282154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a940e42-3da2f2c6-4b237696-fc261dcd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:51.282167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a940e42-3da2f2c6-4b237696-fc261dcd_0] Write session will restart in 0.005196s
2025-09-30T14:55:51.282202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a940e42-3da2f2c6-4b237696-fc261dcd_0] Write session: Do CDS request
2025-09-30T14:55:51.282208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a940e42-3da2f2c6-4b237696-fc261dcd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:51.288826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a940e42-3da2f2c6-4b237696-fc261dcd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:51.288914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:51.288930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2013
2025-09-30T14:55:51.289081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2013 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:51.289113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2013 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:51.289122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2013 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:51.289127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:51.289860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2013 sessionId:  describe result for acl check
2025-09-30T14:55:51.289901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:51.289910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:51.289912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:51.289919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896096241466462:5400] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:51.290477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896096241466462:5400] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:51.292488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896096241466462:5400] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:51.293114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:51.295442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896096241466462:5400] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:51.295458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896096241466462:5400] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:51.295461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896096241466462:5400] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:51.295469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2013 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:51.295308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:51.295547Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:51.295552Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:51.295563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:51.295617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:51.295654Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896096151696072:4064]
2025-09-30T14:55:51.296340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:51.297458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:51.297556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:51.297935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:51.298024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:51.298033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:51.298035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:51.298036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:51.298037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:51.298038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:51.298040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:51.298041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:51.298043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:51.298044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:51.298045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.298047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.298048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.298049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:51.298050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:51.298058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:51.298069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:51.298074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:51.298080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:51.298084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:51.298088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:51.298094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:51.298098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:51.298102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:51.298107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:51.298111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.298114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.298118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.298122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:51.298126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:51.298135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:51.298144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:51.298151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:51.298157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:51.298163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:51.298168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:51.298176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:51.298188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:51.298194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:51.298199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:51.298204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:51.298211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:51.298216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:51.298222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:51.298226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:51.298231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:51.298236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:51.298242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:51.298247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:51.298254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:51.298259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.298265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.298270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.298276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.298281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.298287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.298292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:51.298298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:51.298304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:51.298311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:51.298375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:51.304252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:51.305544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:51.305565Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:51.305569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:51.305573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:51.305580Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2012 [2:7555896096151696072:4064]
2025-09-30T14:55:51.305599Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:51.305617Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:51.305621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:51.305624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:51.305626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:51.305645Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:51.305653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:51.305660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:51.305730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.305740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.305743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.305746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:51.305749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:51.305827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:51.305829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.305844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.305862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.305883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:51.305911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896096241466438:2454], now have 1 active actors on pipe
2025-09-30T14:55:51.305919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896096241466533:5400], now have 1 active actors on pipe
2025-09-30T14:55:51.305926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896096151696067:4064]
2025-09-30T14:55:51.305929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896096151696067:4064]
2025-09-30T14:55:51.305931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896096151696067:4064]
2025-09-30T14:55:51.305946Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:51.305959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:51.305974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:51.305975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:51.305978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:51.305979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:51.305982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:51.306015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896096151696067:4064]
2025-09-30T14:55:51.306022Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:51.306029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:51.306003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2012
2025-09-30T14:55:51.306047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2012
2025-09-30T14:55:51.306137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:51.306147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:51.306175Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ceb5b05-6140f551-93b5b08d-333b41c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:51.306188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:51.306198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:51.306200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:51.306210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:51.306219Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:51.306234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:51.306427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:51.306436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:51.306449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:51.306538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2013 partition: 0 MaxSeqNo: 42 sessionId: src_id|7ceb5b05-6140f551-93b5b08d-333b41c_0
2025-09-30T14:55:51.306936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a940e42-3da2f2c6-4b237696-fc261dcd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7ceb5b05-6140f551-93b5b08d-333b41c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:51.309832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ceb5b05-6140f551-93b5b08d-333b41c_0] Write session: try to update token
2025-09-30T14:55:51.309854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ceb5b05-6140f551-93b5b08d-333b41c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:51.320650Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:51.320672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:51.320675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:51.320678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:51.320689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896096151696067:4064]
2025-09-30T14:55:51.320694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896096151696067:4064]
2025-09-30T14:55:51.320698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896096151696067:4064]
2025-09-30T14:55:51.320742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:51.320751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.320751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:51.320753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:51.320758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:51.320764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:51.320898Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:51.328143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2013 sessionId: src_id|7ceb5b05-6140f551-93b5b08d-333b41c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:51.331063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:51.381193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896096241466546:5488]
2025-09-30T14:55:51.381603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2012, pipe: [1:7555896096241466546:5488]
2025-09-30T14:55:51.448617Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:51.449018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:51.449035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:51.449075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896096241466546:5488], now have 1 active actors on pipe
2025-09-30T14:55:51.449373Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:51.450117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ceb5b05-6140f551-93b5b08d-333b41c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:51.450127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ceb5b05-6140f551-93b5b08d-333b41c_0] Write session will restart in 0.008183s
2025-09-30T14:55:51.450149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ceb5b05-6140f551-93b5b08d-333b41c_0] Write session: Do CDS request
2025-09-30T14:55:51.450155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ceb5b05-6140f551-93b5b08d-333b41c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:51.449340Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:51.449498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896096241466546:5488]
2025-09-30T14:55:51.449687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:51.449763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2013 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7ceb5b05-6140f551-93b5b08d-333b41c_0
2025-09-30T14:55:51.449949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2013 sessionId: src_id|7ceb5b05-6140f551-93b5b08d-333b41c_0 is DEAD
2025-09-30T14:55:51.459807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ceb5b05-6140f551-93b5b08d-333b41c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:51.463394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:51.463426Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:51.463441Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2014
2025-09-30T14:55:51.463642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2014 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:51.463701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2014 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:51.463707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2014 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:51.463712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:51.467066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:51.464245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2014 sessionId:  describe result for acl check
2025-09-30T14:55:51.464286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:51.464288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:51.464290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:51.464297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896096241466611:5396] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:51.464864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896096241466611:5396] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:51.467109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896096241466611:5396] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:51.467335Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:51.467347Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:51.467360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:51.467425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:51.467465Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896096151696174:4059]
2025-09-30T14:55:51.468152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:51.469520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:51.469606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:51.470002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:51.470080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:51.470087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:51.470089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:51.470090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:51.470092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:51.470093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:51.470094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:51.470096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:51.470097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:51.470099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:51.470100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.470101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.470103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.470104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:51.470105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:51.470112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:51.470122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:51.470126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:51.470131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:51.470136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:51.470141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:51.470146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:51.470151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:51.470156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:51.470161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:51.470165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.470169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.470174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.470179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:51.470183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:51.470191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:51.470200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:51.470207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:51.470213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:51.470221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:51.470228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:51.470233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:51.470240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:51.470245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:51.470250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:51.470254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:51.470261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:51.470268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:51.470274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:51.470279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:51.470286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:51.470300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:51.470307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:51.470312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:51.470319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:51.470324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.470332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.470337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.470342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.470348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.470355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.470360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:51.470367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:51.470372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:51.470377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:51.470429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:51.472040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896096241466611:5396] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:51.472058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896096241466611:5396] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:51.472062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896096241466611:5396] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:51.472071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2014 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:51.479761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:51.480752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:51.480773Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:51.480777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:51.480781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:51.480789Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2013 [2:7555896096151696174:4059]
2025-09-30T14:55:51.480809Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:51.480831Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:51.480839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:51.480842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:51.480845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:51.480864Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:51.480875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:51.480888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:51.480948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.480956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.480959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.480963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:51.480967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:51.481042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:51.481057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.481073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.481088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.481108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:51.481132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896096241466547:2454], now have 1 active actors on pipe
2025-09-30T14:55:51.481141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896096241466648:5396], now have 1 active actors on pipe
2025-09-30T14:55:51.481149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896096151696169:4059]
2025-09-30T14:55:51.481156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896096151696169:4059]
2025-09-30T14:55:51.481159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896096151696169:4059]
2025-09-30T14:55:51.481176Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:51.481199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:51.481205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:51.481209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:51.481212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:51.481215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:51.481219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:51.481260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896096151696169:4059]
2025-09-30T14:55:51.481230Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2013
2025-09-30T14:55:51.481270Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:51.481284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:51.481278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2013
2025-09-30T14:55:51.481363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:51.481375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:51.481400Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9596388-5c8136f9-853d6692-2e4bcd78_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:51.481412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:51.481421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:51.481425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:51.481435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:51.481450Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:51.481472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:51.481759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:51.481774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:51.481814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:51.481919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2014 partition: 0 MaxSeqNo: 42 sessionId: src_id|c9596388-5c8136f9-853d6692-2e4bcd78_0
2025-09-30T14:55:51.482288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ceb5b05-6140f551-93b5b08d-333b41c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c9596388-5c8136f9-853d6692-2e4bcd78_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:51.485064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9596388-5c8136f9-853d6692-2e4bcd78_0] Write session: try to update token
2025-09-30T14:55:51.485085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9596388-5c8136f9-853d6692-2e4bcd78_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:51.494537Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:51.494559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:51.494562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:51.494565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:51.494582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896096151696169:4059]
2025-09-30T14:55:51.494586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896096151696169:4059]
2025-09-30T14:55:51.494590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896096151696169:4059]
2025-09-30T14:55:51.494636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:51.494644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.494646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:51.494651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:51.494658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:51.494662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:51.494794Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:51.500417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2014 sessionId: src_id|c9596388-5c8136f9-853d6692-2e4bcd78_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:51.503493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:51.549600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896096241466657:5488]
2025-09-30T14:55:51.549930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2013, pipe: [1:7555896096241466657:5488]
2025-09-30T14:55:51.609125Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:51.609446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:51.609464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:51.609521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896096241466657:5488], now have 1 active actors on pipe
2025-09-30T14:55:51.609758Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:51.610206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9596388-5c8136f9-853d6692-2e4bcd78_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:51.610217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9596388-5c8136f9-853d6692-2e4bcd78_0] Write session will restart in 0.007541s
2025-09-30T14:55:51.610246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9596388-5c8136f9-853d6692-2e4bcd78_0] Write session: Do CDS request
2025-09-30T14:55:51.610252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9596388-5c8136f9-853d6692-2e4bcd78_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:51.609772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:51.609786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:51.609870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2014 reason: error at write: Disconnected sessionId: src_id|c9596388-5c8136f9-853d6692-2e4bcd78_0
2025-09-30T14:55:51.609895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896096241466657:5488]
2025-09-30T14:55:51.609929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:51.610059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2014 sessionId: src_id|c9596388-5c8136f9-853d6692-2e4bcd78_0 is DEAD
2025-09-30T14:55:51.618760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9596388-5c8136f9-853d6692-2e4bcd78_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:51.618894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:51.618920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2015
2025-09-30T14:55:51.619036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2015 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:51.619067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2015 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:51.619077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2015 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:51.619095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:51.619568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2015 sessionId:  describe result for acl check
2025-09-30T14:55:51.619608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:51.619615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:51.619617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:51.619624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896096241466719:5394] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:51.620123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:51.620178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896096241466719:5394] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:51.622160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896096241466719:5394] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:51.622913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:51.623144Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:51.623153Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:51.623165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:51.623218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:51.623273Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896096151696274:4056]
2025-09-30T14:55:51.623843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:51.624257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:51.624309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:51.624661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:51.624653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896096241466719:5394] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:51.624667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896096241466719:5394] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:51.624670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896096241466719:5394] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:51.624679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2015 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:51.624740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:51.624747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:51.624748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:51.624749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:51.624751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:51.624752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:51.624754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:51.624757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:51.624759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:51.624761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:51.624762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.624763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.624765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.624766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:51.624767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:51.624773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:51.624782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:51.624787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:51.624790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:51.624794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:51.624799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:51.624802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:51.624806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:51.624809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:51.624813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:51.624817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.624821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.624825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.624829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:51.624833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:51.624842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:51.624850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:51.624856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:51.624861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:51.624866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:51.624871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:51.624875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:51.624879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:51.624886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:51.624891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:51.624895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:51.624901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:51.624905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:51.624910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:51.624914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:51.624921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:51.624934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:51.624939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:51.624942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:51.624947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:51.624951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.624956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.624961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.624965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.624970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.624974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.624978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:51.624983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:51.624987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:51.624992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:51.625031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:51.631008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:51.632030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:51.632054Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:51.632058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:51.632062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:51.632069Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2014 [2:7555896096151696274:4056]
2025-09-30T14:55:51.632087Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:51.632106Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:51.632109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:51.632112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:51.632115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:51.632132Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:51.632140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:51.632147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:51.632220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.632234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.632238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.632242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:51.632245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:51.632339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:51.632348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.632362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.632375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.632392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:51.632416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896096241466758:5394], now have 1 active actors on pipe
2025-09-30T14:55:51.632420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896096241466658:2454], now have 1 active actors on pipe
2025-09-30T14:55:51.632427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896096151696268:4056]
2025-09-30T14:55:51.632429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896096151696268:4056]
2025-09-30T14:55:51.632432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896096151696268:4056]
2025-09-30T14:55:51.632448Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:51.632462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:51.632479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:51.632482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:51.632484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:51.632489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:51.632492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:51.632522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896096151696268:4056]
2025-09-30T14:55:51.632525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:51.632537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:51.632556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:51.632561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:51.632790Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cbfde6db-754f8ad6-40b20ebc-67f80635_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:51.632799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:51.632803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:51.632805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:51.632819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:51.632830Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:51.632866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:51.633019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:51.633027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:51.633049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:51.632486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2014
2025-09-30T14:55:51.632493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2014
2025-09-30T14:55:51.633144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2015 partition: 0 MaxSeqNo: 42 sessionId: src_id|cbfde6db-754f8ad6-40b20ebc-67f80635_0
2025-09-30T14:55:51.633529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9596388-5c8136f9-853d6692-2e4bcd78_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cbfde6db-754f8ad6-40b20ebc-67f80635_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:51.636444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbfde6db-754f8ad6-40b20ebc-67f80635_0] Write session: try to update token
2025-09-30T14:55:51.636463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbfde6db-754f8ad6-40b20ebc-67f80635_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:51.647342Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:51.647359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:51.647361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:51.647363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:51.647374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896096151696268:4056]
2025-09-30T14:55:51.647379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896096151696268:4056]
2025-09-30T14:55:51.647383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896096151696268:4056]
2025-09-30T14:55:51.647426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:51.647435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.647438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:51.647444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:51.647452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:51.647456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:51.647576Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:51.651764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2015 sessionId: src_id|cbfde6db-754f8ad6-40b20ebc-67f80635_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:51.654586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:51.709902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896096241466770:5488]
2025-09-30T14:55:51.710196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2014, pipe: [1:7555896096241466770:5488]
2025-09-30T14:55:51.761180Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:51.761498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:51.761516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:51.761556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896096241466770:5488], now have 1 active actors on pipe
2025-09-30T14:55:51.761818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:51.761832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:51.761850Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:51.761837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896096241466770:5488]
2025-09-30T14:55:51.761858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:51.761903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2015 reason: error at write: Disconnected sessionId: src_id|cbfde6db-754f8ad6-40b20ebc-67f80635_0
2025-09-30T14:55:51.762110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2015 sessionId: src_id|cbfde6db-754f8ad6-40b20ebc-67f80635_0 is DEAD
2025-09-30T14:55:51.762319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbfde6db-754f8ad6-40b20ebc-67f80635_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:51.762328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbfde6db-754f8ad6-40b20ebc-67f80635_0] Write session will restart in 0.008635s
2025-09-30T14:55:51.762352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbfde6db-754f8ad6-40b20ebc-67f80635_0] Write session: Do CDS request
2025-09-30T14:55:51.762358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbfde6db-754f8ad6-40b20ebc-67f80635_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:51.771800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbfde6db-754f8ad6-40b20ebc-67f80635_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:51.772014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:51.772032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2016
2025-09-30T14:55:51.772180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2016 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:51.772223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2016 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:51.772231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2016 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:51.772235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:51.772433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:51.772639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2016 sessionId:  describe result for acl check
2025-09-30T14:55:51.772672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:51.772678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:51.772680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:51.772686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896096241466835:5389] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:51.773233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896096241466835:5389] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:51.774365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:51.774558Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:51.774566Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:51.774588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:51.774644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:51.774679Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896096151696387:4045]
2025-09-30T14:55:51.775202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896096241466835:5389] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:51.775356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:51.775629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:51.775673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:51.775993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:51.776052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:51.776058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:51.776059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:51.776060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:51.776061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:51.776062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:51.776064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:51.776065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:51.776067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:51.776068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:51.776069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.776070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.776071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.776073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:51.776074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:51.776079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:51.776089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:51.776094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:51.776098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:51.776102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:51.776106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:51.776111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:51.776127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:51.776131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:51.776136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:51.776140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.776144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.776149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.776153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:51.776157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:51.776170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:51.776178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:51.776189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:51.776194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:51.776199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:51.776206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:51.776211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:51.776217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:51.776228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:51.776233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:51.776237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:51.776242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:51.776247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:51.776254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:51.776258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:51.776263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:51.776267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:51.776274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:51.776279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:51.776284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:51.776291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.776300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.776304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.776310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.776314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.776320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.776324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:51.776329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:51.776338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:51.776344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:51.776388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:51.779436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896096241466835:5389] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:51.779452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896096241466835:5389] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:51.779456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896096241466835:5389] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:51.779465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2016 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:51.782384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:51.783272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:51.783289Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:51.783293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:51.783300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:51.783308Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2015 [2:7555896096151696387:4045]
2025-09-30T14:55:51.783326Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:51.783342Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:51.783345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:51.783349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:51.783351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:51.783368Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:51.783379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:51.783386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:51.783448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.783459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.783461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.783465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:51.783467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:51.783535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:51.783543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.783558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.783577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.783600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:51.783623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896096241466875:5389], now have 1 active actors on pipe
2025-09-30T14:55:51.783634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896096241466772:2454], now have 1 active actors on pipe
2025-09-30T14:55:51.783640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896096151696381:4045]
2025-09-30T14:55:51.783643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896096151696381:4045]
2025-09-30T14:55:51.783646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896096151696381:4045]
2025-09-30T14:55:51.783655Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:51.783665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:51.783668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:51.783669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:51.783672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:51.783684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:51.783687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:51.783720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896096151696381:4045]
2025-09-30T14:55:51.783731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:51.783738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:51.783785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2015
2025-09-30T14:55:51.783794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2015
2025-09-30T14:55:51.783871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:51.783883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:51.783907Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ff5cf50-3fe93f07-e1956245-a41e775e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:51.783916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:51.783929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:51.783932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:51.783943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:51.783955Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:51.783975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:51.784174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:51.784182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:51.784198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:51.784282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2016 partition: 0 MaxSeqNo: 42 sessionId: src_id|4ff5cf50-3fe93f07-e1956245-a41e775e_0
2025-09-30T14:55:51.784667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbfde6db-754f8ad6-40b20ebc-67f80635_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4ff5cf50-3fe93f07-e1956245-a41e775e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:51.787558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff5cf50-3fe93f07-e1956245-a41e775e_0] Write session: try to update token
2025-09-30T14:55:51.787579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff5cf50-3fe93f07-e1956245-a41e775e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:51.796909Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:51.796930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:51.796933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:51.796935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:51.796945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896096151696381:4045]
2025-09-30T14:55:51.796950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896096151696381:4045]
2025-09-30T14:55:51.796954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896096151696381:4045]
2025-09-30T14:55:51.796995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:51.797007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.797010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:51.797010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:51.797018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:51.797023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:51.797158Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:51.802645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2016 sessionId: src_id|4ff5cf50-3fe93f07-e1956245-a41e775e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:51.805592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:51.861962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896096241466895:5488]
2025-09-30T14:55:51.862302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2015, pipe: [1:7555896096241466895:5488]
2025-09-30T14:55:51.914472Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:51.914988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:51.915004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:51.915044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896096241466895:5488], now have 1 active actors on pipe
2025-09-30T14:55:51.915307Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:51.915801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff5cf50-3fe93f07-e1956245-a41e775e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:51.915810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff5cf50-3fe93f07-e1956245-a41e775e_0] Write session will restart in 0.006143s
2025-09-30T14:55:51.915358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:51.915834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff5cf50-3fe93f07-e1956245-a41e775e_0] Write session: Do CDS request
2025-09-30T14:55:51.915372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:51.915840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff5cf50-3fe93f07-e1956245-a41e775e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:51.915394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896096241466895:5488]
2025-09-30T14:55:51.915433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2016 reason: error at write: Disconnected sessionId: src_id|4ff5cf50-3fe93f07-e1956245-a41e775e_0
2025-09-30T14:55:51.915521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:51.915622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2016 sessionId: src_id|4ff5cf50-3fe93f07-e1956245-a41e775e_0 is DEAD
2025-09-30T14:55:51.922825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff5cf50-3fe93f07-e1956245-a41e775e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:51.922892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:51.922910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2017
2025-09-30T14:55:51.923068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2017 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:51.923114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2017 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:51.923141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2017 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:51.923151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:51.923685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2017 sessionId:  describe result for acl check
2025-09-30T14:55:51.923728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:51.923730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:51.923732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:51.923738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896096241466911:5377] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:51.924302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896096241466911:5377] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:51.926499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896096241466911:5377] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:51.929251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896096241466911:5377] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:51.929267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896096241466911:5377] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:51.929271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896096241466911:5377] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:51.929279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2017 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:51.930208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:51.932497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:51.932720Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:51.932741Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:51.932751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:51.932808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:51.932847Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896096151696493:4041]
2025-09-30T14:55:51.933527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:51.933862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:51.933903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:51.934150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:51.934198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:51.934204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:51.934204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:51.934205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:51.934206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:51.934207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:51.934208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:51.934209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:51.934210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:51.934210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:51.934211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.934212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.934213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.934213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:51.934214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:51.934218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:51.934228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:51.934232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:51.934236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:51.934240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:51.934244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:51.934247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:51.934250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:51.934254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:51.934257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:51.934261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.934265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.934269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.934274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:51.934278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:51.934286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:51.934293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:51.934297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:51.934301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:51.934304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:51.934307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:51.934310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:51.934313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:51.934316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:51.934319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:51.934322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:51.934325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:51.934328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:51.934331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:51.934334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:51.934340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:51.934345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:51.934351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:51.934355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:51.934360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:51.934365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.934370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.934374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.934382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.934388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.934393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.934398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:51.934405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:51.934409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:51.934415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:51.934463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:51.940107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:51.941231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:51.941244Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:51.941247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:51.941250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:51.941256Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2016 [2:7555896096151696493:4041]
2025-09-30T14:55:51.941269Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:51.941284Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:51.941286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:51.941289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:51.941291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:51.941310Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:51.941317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:51.941325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:51.941392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.941401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.941403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.941407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:51.941409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:51.941491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:51.941500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.941514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:51.941528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:51.941551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:51.941575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896096241466993:5377], now have 1 active actors on pipe
2025-09-30T14:55:51.941583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896096241466896:2454], now have 1 active actors on pipe
2025-09-30T14:55:51.941589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896096151696488:4041]
2025-09-30T14:55:51.941593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896096151696488:4041]
2025-09-30T14:55:51.941595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896096151696488:4041]
2025-09-30T14:55:51.941608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:51.941622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:51.941626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:51.941631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:51.941633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:51.941641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:51.941644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:51.941681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896096151696488:4041]
2025-09-30T14:55:51.941691Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:51.941698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:51.941711Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2016
2025-09-30T14:55:51.941712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2016
2025-09-30T14:55:51.941784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:51.941795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:51.941815Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|21aa5e64-497b4a6-696b1797-a0c78e53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:51.941820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:51.941823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:51.941824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:51.941831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:51.941837Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:51.941852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:51.942028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:51.942039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:51.942056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:51.942121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2017 partition: 0 MaxSeqNo: 42 sessionId: src_id|21aa5e64-497b4a6-696b1797-a0c78e53_0
2025-09-30T14:55:51.942473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff5cf50-3fe93f07-e1956245-a41e775e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|21aa5e64-497b4a6-696b1797-a0c78e53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:51.945408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21aa5e64-497b4a6-696b1797-a0c78e53_0] Write session: try to update token
2025-09-30T14:55:51.945429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21aa5e64-497b4a6-696b1797-a0c78e53_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:51.955019Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:51.955036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:51.955047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896096151696488:4041]
2025-09-30T14:55:51.955099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:51.955112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:51.955356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:51.955524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:51.955690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:51.955858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:51.956087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:51.956137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:51.961828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2017 sessionId: src_id|21aa5e64-497b4a6-696b1797-a0c78e53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:51.964972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:51.965260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:51.965285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:51.965334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:51.965431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:51.967709Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:51.967728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:51.967731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:51.967733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:51.967748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896096151696488:4041]
2025-09-30T14:55:51.967754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896096151696488:4041]
2025-09-30T14:55:51.967758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896096151696488:4041]
2025-09-30T14:55:51.967799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:51.967801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:51.967807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:51.967810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:51.967813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:51.967864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:51.967954Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:52.015551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896100536434304:5488]
2025-09-30T14:55:52.016288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2016, pipe: [1:7555896100536434304:5488]
2025-09-30T14:55:52.081439Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:52.088827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:52.088847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:52.088999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:52.089066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:52.089124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:52.089187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:52.089243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:52.089251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:52.089322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:52.089379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:52.089449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:52.089854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:52.089900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:52.089909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:52.089976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:52.090040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:52.090102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:52.090164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:52.090209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:52.090216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:52.090286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:52.090352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:52.090413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:52.090478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:52.090525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:52.090531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:52.090592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:52.090648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:52.090708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:52.090777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:52.090845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:52.090852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:52.090916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:52.090973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:52.091038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:52.091096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:52.091137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:52.091142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:52.091204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:52.091286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:52.092704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:52.092717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:52.092720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:52.092748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2017 reason: error at write: Disconnected sessionId: src_id|21aa5e64-497b4a6-696b1797-a0c78e53_0
2025-09-30T14:55:52.092770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896100536434304:5488]
2025-09-30T14:55:52.092928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2017 sessionId: src_id|21aa5e64-497b4a6-696b1797-a0c78e53_0 is DEAD
2025-09-30T14:55:52.093072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21aa5e64-497b4a6-696b1797-a0c78e53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:52.093082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21aa5e64-497b4a6-696b1797-a0c78e53_0] Write session will restart in 0.007133s
2025-09-30T14:55:52.093121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21aa5e64-497b4a6-696b1797-a0c78e53_0] Write session: Do CDS request
2025-09-30T14:55:52.093127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21aa5e64-497b4a6-696b1797-a0c78e53_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:52.091356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:52.091417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:52.091458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:52.091461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:52.091533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:52.091592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:52.091664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:52.091728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:52.091771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:52.091774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:52.091846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:52.091908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:52.091972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:52.092034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:52.092076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:52.092079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:52.092150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:52.092214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:52.092278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:52.092343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:52.092385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:52.092388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:52.092466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896100536434304:5488], now have 1 active actors on pipe
2025-09-30T14:55:52.093225Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:52.101788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21aa5e64-497b4a6-696b1797-a0c78e53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:52.101888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:52.101904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2018
2025-09-30T14:55:52.102065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2018 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:52.102113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2018 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:52.102126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2018 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:52.102131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:52.102594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2018 sessionId:  describe result for acl check
2025-09-30T14:55:52.102629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:52.102638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:52.102640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:52.102646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896100536434344:5373] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:52.103204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896100536434344:5373] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:52.105588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896100536434344:5373] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:52.106138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:52.108384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:52.108591Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:52.108603Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:52.108614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:52.108667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:52.108712Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896100446663892:4038]
2025-09-30T14:55:52.109331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:52.109151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896100536434344:5373] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:52.109164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896100536434344:5373] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:52.109167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896100536434344:5373] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:52.109174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2018 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:52.109635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:52.109679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:52.109983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:52.110039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:52.110040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:52.110042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:52.110043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:52.110045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:52.110046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:52.110047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:52.110048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:52.110049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:52.110051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:52.110052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.110053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.110054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.110055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:52.110056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:52.110062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:52.110073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:52.110078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:52.110082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:52.110085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:52.110089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:52.110094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:52.110098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:52.110102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:52.110107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:52.110112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.110116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.110120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.110124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:52.110128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:52.110135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:52.110142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:52.110148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:52.110154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:52.110159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:52.110164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:52.110169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:52.110174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:52.110179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:52.110184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:52.110189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:52.110195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:52.110201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:52.110206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:52.110211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:52.110216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:52.110221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:52.110227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:52.110232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:52.110237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:52.110243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.110248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.110252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.110257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.110262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.110267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.110271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:52.110276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:52.110280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:52.110285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:52.110323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:52.115996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:52.116887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:52.116903Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:52.116910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:52.116915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:52.116923Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2017 [2:7555896100446663892:4038]
2025-09-30T14:55:52.116939Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:52.116955Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:52.116963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:52.116966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:52.116968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:52.116984Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:52.116996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:52.117003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:52.117071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.117077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.117080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.117084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:52.117087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:52.117159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:52.117168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.117182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.117200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.117223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:52.117245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896100536434407:5373], now have 1 active actors on pipe
2025-09-30T14:55:52.117254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896100536434306:2454], now have 1 active actors on pipe
2025-09-30T14:55:52.117261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896100446663887:4038]
2025-09-30T14:55:52.117269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896100446663887:4038]
2025-09-30T14:55:52.117272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896100446663887:4038]
2025-09-30T14:55:52.117286Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:52.117301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:52.117305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:52.117311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:52.117314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:52.117336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:52.117344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:52.117342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2017
2025-09-30T14:55:52.117342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2017
2025-09-30T14:55:52.117379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896100446663887:4038]
2025-09-30T14:55:52.117387Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:52.117389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:52.117410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:52.117420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:52.117467Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d311fb24-958525f1-87ce1c74-c7a19ac8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:52.117495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:52.117504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:52.117506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:52.117515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:52.117529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:52.117555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:52.117716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:52.117724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:52.117738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:52.117864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2018 partition: 0 MaxSeqNo: 42 sessionId: src_id|d311fb24-958525f1-87ce1c74-c7a19ac8_0
2025-09-30T14:55:52.118229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21aa5e64-497b4a6-696b1797-a0c78e53_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d311fb24-958525f1-87ce1c74-c7a19ac8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:52.121076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d311fb24-958525f1-87ce1c74-c7a19ac8_0] Write session: try to update token
2025-09-30T14:55:52.121096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d311fb24-958525f1-87ce1c74-c7a19ac8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:52.133540Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:52.133559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:52.133562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:52.133564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:52.133574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896100446663887:4038]
2025-09-30T14:55:52.133579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896100446663887:4038]
2025-09-30T14:55:52.133583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896100446663887:4038]
2025-09-30T14:55:52.133632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:52.133640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.133643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:52.133651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:52.133658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:52.133665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:52.133782Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:52.140958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2018 sessionId: src_id|d311fb24-958525f1-87ce1c74-c7a19ac8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:52.143686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:52.192703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896100536434437:5488]
2025-09-30T14:55:52.193023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2017, pipe: [1:7555896100536434437:5488]
2025-09-30T14:55:52.253449Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:52.253953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:52.253963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:52.253985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896100536434437:5488], now have 1 active actors on pipe
2025-09-30T14:55:52.254375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:52.254397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:52.254461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2018 reason: error at write: Disconnected sessionId: src_id|d311fb24-958525f1-87ce1c74-c7a19ac8_0
2025-09-30T14:55:52.254346Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:52.254629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:52.254651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2018 sessionId: src_id|d311fb24-958525f1-87ce1c74-c7a19ac8_0 is DEAD
2025-09-30T14:55:52.254666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896100536434437:5488]
2025-09-30T14:55:52.255071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d311fb24-958525f1-87ce1c74-c7a19ac8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:52.255079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d311fb24-958525f1-87ce1c74-c7a19ac8_0] Write session will restart in 0.006743s
2025-09-30T14:55:52.255104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d311fb24-958525f1-87ce1c74-c7a19ac8_0] Write session: Do CDS request
2025-09-30T14:55:52.255113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d311fb24-958525f1-87ce1c74-c7a19ac8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:52.263846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d311fb24-958525f1-87ce1c74-c7a19ac8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:52.263950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:52.263966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2019
2025-09-30T14:55:52.264090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2019 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:52.264123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2019 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:52.264129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2019 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:52.264133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:52.264608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2019 sessionId:  describe result for acl check
2025-09-30T14:55:52.264640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:52.264647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:52.264649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:52.264655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896100536434496:5360] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:52.265191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896100536434496:5360] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:52.267289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:52.271137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:52.271387Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:52.271397Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:52.271409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:52.271470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:52.271508Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896100446664033:4020]
2025-09-30T14:55:52.272192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:52.272356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896100536434496:5360] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:52.272707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:52.272789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:52.273160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:52.273247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:52.273255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:52.273256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:52.273258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:52.273259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:52.273260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:52.273262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:52.273263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:52.273264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:52.273266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:52.273267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.273268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.273269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.273271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:52.273272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:52.273278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:52.273289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:52.273293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:52.273298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:52.273301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:52.273306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:52.273309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:52.273313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:52.273317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:52.273322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:52.273326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.273330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.273334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.273338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:52.273342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:52.273350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:52.273359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:52.273366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:52.273374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:52.273380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:52.273386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:52.273390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:52.273395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:52.273400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:52.273406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:52.273410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:52.273416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:52.273421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:52.273426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:52.273431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:52.273436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:52.273441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:52.273447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:52.273451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:52.273456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:52.273461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.273466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.273471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.273494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.273499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.273505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.273509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:52.273514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:52.273520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:52.273525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:52.273574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:52.280437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:52.281555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:52.281572Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:52.281576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:52.281579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:52.281586Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2018 [2:7555896100446664033:4020]
2025-09-30T14:55:52.281603Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:52.281617Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:52.281621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:52.281624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:52.281627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:52.281645Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:52.281652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:52.281659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:52.281717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.281725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.281727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.281731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:52.281733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:52.281800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:52.281807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.281820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.281832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.281855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:52.281876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896100536434555:5360], now have 1 active actors on pipe
2025-09-30T14:55:52.281880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896100536434453:2454], now have 1 active actors on pipe
2025-09-30T14:55:52.281886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896100446664027:4020]
2025-09-30T14:55:52.281889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896100446664027:4020]
2025-09-30T14:55:52.281893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896100446664027:4020]
2025-09-30T14:55:52.281905Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:52.281917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:52.281920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:52.281920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:52.281922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:52.281934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:52.281937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:52.281971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896100446664027:4020]
2025-09-30T14:55:52.281978Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:52.281982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:52.279399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896100536434496:5360] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:52.279416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896100536434496:5360] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:52.279420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896100536434496:5360] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:52.279429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2019 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:52.282411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2018
2025-09-30T14:55:52.282437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2018
2025-09-30T14:55:52.282784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:52.282796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:52.282828Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee94f45e-9d1ec695-2531b9a4-f303fa2a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:52.282840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:52.282848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:52.282851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:52.282863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:52.282882Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:52.282898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:52.283300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:52.283313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:52.283338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:52.283500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2019 partition: 0 MaxSeqNo: 42 sessionId: src_id|ee94f45e-9d1ec695-2531b9a4-f303fa2a_0
2025-09-30T14:55:52.291417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d311fb24-958525f1-87ce1c74-c7a19ac8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ee94f45e-9d1ec695-2531b9a4-f303fa2a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:52.294113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee94f45e-9d1ec695-2531b9a4-f303fa2a_0] Write session: try to update token
2025-09-30T14:55:52.294137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee94f45e-9d1ec695-2531b9a4-f303fa2a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:52.295219Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:52.295240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:52.295269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896100446664027:4020]
2025-09-30T14:55:52.295318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:52.295445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:52.295495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:52.295640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:52.295781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:52.295920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:52.296109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:52.296147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:52.306645Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:52.306663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:52.306665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:52.306672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:52.306683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896100446664027:4020]
2025-09-30T14:55:52.306687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896100446664027:4020]
2025-09-30T14:55:52.306690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896100446664027:4020]
2025-09-30T14:55:52.306730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:52.306736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.306740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:52.306740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:52.306747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:52.306752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:52.306884Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:52.310943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2019 sessionId: src_id|ee94f45e-9d1ec695-2531b9a4-f303fa2a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:52.313746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:52.355028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896100536434564:5488]
2025-09-30T14:55:52.355312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2018, pipe: [1:7555896100536434564:5488]
2025-09-30T14:55:52.421923Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:52.422336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:52.422353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:52.422375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896100536434564:5488], now have 1 active actors on pipe
2025-09-30T14:55:52.422609Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:52.422690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896100536434564:5488]
2025-09-30T14:55:52.422737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:52.422820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2019 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ee94f45e-9d1ec695-2531b9a4-f303fa2a_0
2025-09-30T14:55:52.423009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2019 sessionId: src_id|ee94f45e-9d1ec695-2531b9a4-f303fa2a_0 is DEAD
2025-09-30T14:55:52.423152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee94f45e-9d1ec695-2531b9a4-f303fa2a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:52.423165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee94f45e-9d1ec695-2531b9a4-f303fa2a_0] Write session will restart in 0.005277s
2025-09-30T14:55:52.423190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee94f45e-9d1ec695-2531b9a4-f303fa2a_0] Write session: Do CDS request
2025-09-30T14:55:52.423196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee94f45e-9d1ec695-2531b9a4-f303fa2a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:52.423193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:52.429767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee94f45e-9d1ec695-2531b9a4-f303fa2a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:52.429863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:52.429876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2020
2025-09-30T14:55:52.429990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2020 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:52.430012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2020 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:52.430015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2020 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:52.430019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:52.430430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2020 sessionId:  describe result for acl check
2025-09-30T14:55:52.430467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:52.430475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:52.430476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:52.430485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896100536434581:5356] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:52.430982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896100536434581:5356] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:52.433418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896100536434581:5356] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:52.434849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:52.437045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:52.437221Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:52.437230Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:52.437239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:52.437280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:52.437343Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896100446664141:4016]
2025-09-30T14:55:52.437581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896100536434581:5356] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:52.437599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896100536434581:5356] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:52.437602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896100536434581:5356] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:52.437611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2020 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:52.437979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:52.438263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:52.438301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:52.438602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:52.438655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:52.438661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:52.438662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:52.438663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:52.438664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:52.438665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:52.438666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:52.438667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:52.438668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:52.438669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:52.438671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.438672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.438673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.438674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:52.438675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:52.438680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:52.438689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:52.438693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:52.438696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:52.438700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:52.438704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:52.438708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:52.438711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:52.438714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:52.438720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:52.438723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.438727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.438730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.438734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:52.438738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:52.438743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:52.438751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:52.438757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:52.438762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:52.438767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:52.438772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:52.438776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:52.438782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:52.438792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:52.438796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:52.438800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:52.438809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:52.438813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:52.438821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:52.438825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:52.438830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:52.438839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:52.438843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:52.438848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:52.438858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:52.438862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.438871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.438876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.438880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.438888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.438893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.438896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:52.438906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:52.438910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:52.438915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:52.438953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:52.444352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:52.445329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:52.445349Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:52.445352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:52.445356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:52.445361Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2019 [2:7555896100446664141:4016]
2025-09-30T14:55:52.445376Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:52.445391Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:52.445394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:52.445396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:52.445399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:52.445414Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:52.445425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:52.445431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:52.445500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.445507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.445509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.445512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:52.445515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:52.445577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:52.445588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.445599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.445609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.445623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:52.445640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896100446664135:4016]
2025-09-30T14:55:52.445642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896100446664135:4016]
2025-09-30T14:55:52.445645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896100446664135:4016]
2025-09-30T14:55:52.445652Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:52.445664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896100536434566:2454], now have 1 active actors on pipe
2025-09-30T14:55:52.445667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:52.445670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:52.445673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:52.445675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896100536434669:5356], now have 1 active actors on pipe
2025-09-30T14:55:52.445680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:52.445692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:52.445696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:52.445722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896100446664135:4016]
2025-09-30T14:55:52.445734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:52.445747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:52.445973Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2019
2025-09-30T14:55:52.446011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2019
2025-09-30T14:55:52.446157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:52.446169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:52.446191Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1126ce9-6a76aa9f-69f04a8a-596bf858_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:52.446198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:52.446202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:52.446204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:52.446212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:52.446225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:52.446242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:52.446406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:52.446413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:52.446424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:52.446520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2020 partition: 0 MaxSeqNo: 42 sessionId: src_id|f1126ce9-6a76aa9f-69f04a8a-596bf858_0
2025-09-30T14:55:52.446896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee94f45e-9d1ec695-2531b9a4-f303fa2a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f1126ce9-6a76aa9f-69f04a8a-596bf858_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:52.449688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1126ce9-6a76aa9f-69f04a8a-596bf858_0] Write session: try to update token
2025-09-30T14:55:52.449704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1126ce9-6a76aa9f-69f04a8a-596bf858_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:52.458372Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:52.458392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:52.458401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896100446664135:4016]
2025-09-30T14:55:52.458449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:52.458451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:52.458649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:52.458794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:52.458936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:52.459083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:52.459465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:52.459518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:52.467678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2020 sessionId: src_id|f1126ce9-6a76aa9f-69f04a8a-596bf858_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:52.470407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:52.470637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:52.470661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:52.470710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:52.470839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:52.472181Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:52.472195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:52.472208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:52.472210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:52.472219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896100446664135:4016]
2025-09-30T14:55:52.472223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896100446664135:4016]
2025-09-30T14:55:52.472229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896100446664135:4016]
2025-09-30T14:55:52.472256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:52.472259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:52.472266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.472268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:52.472269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:52.472273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:52.472402Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:52.523342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896100536434681:5488]
2025-09-30T14:55:52.526775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2019, pipe: [1:7555896100536434681:5488]
2025-09-30T14:55:52.587386Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:52.595272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:52.595297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:52.595493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:52.595568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:52.595640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:52.595706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:52.596247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:52.596255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:52.596335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:52.596403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:52.596473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:52.596542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:52.596583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:52.596587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:52.596669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:52.596738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:52.596807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:52.596877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:52.596917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:52.596920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:52.596996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:52.597069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:52.597140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:52.597205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:52.597249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:52.597252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:52.597330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:52.597392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:52.597456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:52.597557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:52.597607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:52.597617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:52.597693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:52.597767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:52.597853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:52.597929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:52.597981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:52.597989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:52.598064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:52.598133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:52.598208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:52.598280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:52.598330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:52.598337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:52.598414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:52.598487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:52.598557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:52.598629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:52.598701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:52.598705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:52.598777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:52.598839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:52.598911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:52.598980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:52.599029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:52.599032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:52.599106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:52.599169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:52.599236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:52.599620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:52.599668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:52.599674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:52.599750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896100536434681:5488], now have 1 active actors on pipe
2025-09-30T14:55:52.600107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:52.600163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896100536434681:5488]
2025-09-30T14:55:52.600186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:52.600196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:52.600472Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:52.600224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2020 reason: error at write: Disconnected sessionId: src_id|f1126ce9-6a76aa9f-69f04a8a-596bf858_0
2025-09-30T14:55:52.600404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2020 sessionId: src_id|f1126ce9-6a76aa9f-69f04a8a-596bf858_0 is DEAD
2025-09-30T14:55:52.600759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1126ce9-6a76aa9f-69f04a8a-596bf858_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:52.600766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1126ce9-6a76aa9f-69f04a8a-596bf858_0] Write session will restart in 0.007630s
2025-09-30T14:55:52.600786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1126ce9-6a76aa9f-69f04a8a-596bf858_0] Write session: Do CDS request
2025-09-30T14:55:52.600790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1126ce9-6a76aa9f-69f04a8a-596bf858_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:52.609845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1126ce9-6a76aa9f-69f04a8a-596bf858_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:52.609946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:52.609962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2021
2025-09-30T14:55:52.610522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2021 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:52.610564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2021 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:52.610569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2021 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:52.610574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:52.612065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2021 sessionId:  describe result for acl check
2025-09-30T14:55:52.612102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:52.612105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:52.612106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:52.612112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896100536434691:5350] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:52.612718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896100536434691:5350] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:52.615096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896100536434691:5350] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:52.617998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896100536434691:5350] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:52.618014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896100536434691:5350] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:52.618017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896100536434691:5350] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:52.618026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2021 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:52.619352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:52.621651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:52.621851Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:52.621859Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:52.621868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:52.621911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:52.621962Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896100446664250:4014]
2025-09-30T14:55:52.622619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:52.622991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:52.623039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:52.623379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:52.623444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:52.623448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:52.623449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:52.623450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:52.623451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:52.623452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:52.623454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:52.623456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:52.623457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:52.623458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:52.623459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.623461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.623462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.623463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:52.623464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:52.623470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:52.623480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:52.623484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:52.623488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:52.623492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:52.623496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:52.623499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:52.623502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:52.623507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:52.623511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:52.623515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.623519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.623522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.623525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:52.623528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:52.623536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:52.623544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:52.623550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:52.623556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:52.623561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:52.623567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:52.623572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:52.623577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:52.623582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:52.623586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:52.623591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:52.623596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:52.623601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:52.623606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:52.623610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:52.623615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:52.623621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:52.623626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:52.623630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:52.623634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:52.623640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.623645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.623649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.623653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.623657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.623662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.623666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:52.623672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:52.623681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:52.623693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:52.623734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:52.632015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:52.632914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:52.632940Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:52.632944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:52.632948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:52.632956Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2020 [2:7555896100446664250:4014]
2025-09-30T14:55:52.632975Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:52.632992Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:52.632996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:52.633001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:52.633003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:52.633020Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:52.633028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:52.633035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:52.633104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.633115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.633117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.633121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:52.633124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:52.633202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:52.633214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.633229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.633243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.633266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:52.633291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896100536434784:5350], now have 1 active actors on pipe
2025-09-30T14:55:52.633300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896100536434682:2454], now have 1 active actors on pipe
2025-09-30T14:55:52.633307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896100446664245:4014]
2025-09-30T14:55:52.633317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896100446664245:4014]
2025-09-30T14:55:52.633319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896100446664245:4014]
2025-09-30T14:55:52.633335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:52.633350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:52.633365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:52.633370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:52.633374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:52.633375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:52.633377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:52.633365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2020
2025-09-30T14:55:52.633414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896100446664245:4014]
2025-09-30T14:55:52.633426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:52.633416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2020
2025-09-30T14:55:52.633432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:52.633451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:52.633457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:52.633525Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8af38915-c7daa04b-cf09afd2-e61d1068_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:52.633537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:52.633541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:52.633544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:52.633554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:52.633564Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:52.633588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:52.633724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:52.633735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:52.633750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:52.633818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2021 partition: 0 MaxSeqNo: 42 sessionId: src_id|8af38915-c7daa04b-cf09afd2-e61d1068_0
2025-09-30T14:55:52.634183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1126ce9-6a76aa9f-69f04a8a-596bf858_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8af38915-c7daa04b-cf09afd2-e61d1068_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:52.637156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8af38915-c7daa04b-cf09afd2-e61d1068_0] Write session: try to update token
2025-09-30T14:55:52.637178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8af38915-c7daa04b-cf09afd2-e61d1068_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:52.647540Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:52.647560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:52.647563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:52.647565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:52.647576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896100446664245:4014]
2025-09-30T14:55:52.647594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896100446664245:4014]
2025-09-30T14:55:52.647604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896100446664245:4014]
2025-09-30T14:55:52.647650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:52.647657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.647660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:52.647818Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:52.651541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:52.651557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:52.651565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:52.654165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2021 sessionId: src_id|8af38915-c7daa04b-cf09afd2-e61d1068_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:52.656965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:52.699093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896100536434801:5488]
2025-09-30T14:55:52.699464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2020, pipe: [1:7555896100536434801:5488]
2025-09-30T14:55:52.762070Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:52.762499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:52.762514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:52.762559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896100536434801:5488], now have 1 active actors on pipe
2025-09-30T14:55:52.762834Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:52.762850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896100536434801:5488]
2025-09-30T14:55:52.762860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:52.762880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:52.762889Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:52.762957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2021 reason: error at write: Disconnected sessionId: src_id|8af38915-c7daa04b-cf09afd2-e61d1068_0
2025-09-30T14:55:52.763120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2021 sessionId: src_id|8af38915-c7daa04b-cf09afd2-e61d1068_0 is DEAD
2025-09-30T14:55:52.763296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8af38915-c7daa04b-cf09afd2-e61d1068_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:52.763308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8af38915-c7daa04b-cf09afd2-e61d1068_0] Write session will restart in 0.007197s
2025-09-30T14:55:52.763332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8af38915-c7daa04b-cf09afd2-e61d1068_0] Write session: Do CDS request
2025-09-30T14:55:52.763341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8af38915-c7daa04b-cf09afd2-e61d1068_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:52.775673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:52.775732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8af38915-c7daa04b-cf09afd2-e61d1068_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:52.776077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:52.776092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2022
2025-09-30T14:55:52.776184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2022 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:52.776211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2022 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:52.776217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2022 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:52.776223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:52.776662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2022 sessionId:  describe result for acl check
2025-09-30T14:55:52.776701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:52.776711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:52.776712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:52.776718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896100536434872:5341] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:52.777295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896100536434872:5341] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:52.777391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:52.777626Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:52.777646Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:52.777663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:52.777724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:52.777760Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896100446664368:4008]
2025-09-30T14:55:52.778435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:52.778805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:52.778881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:52.779307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:52.779330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896100536434872:5341] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:52.779378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:52.779385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:52.779386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:52.779388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:52.779389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:52.779391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:52.779392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:52.779394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:52.779395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:52.779396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:52.779398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.779399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.779401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.779402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:52.779403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:52.779410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:52.779421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:52.779426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:52.779431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:52.779436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:52.779441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:52.779446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:52.779451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:52.779456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:52.779461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:52.779466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.779471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.779476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.779481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:52.779485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:52.779493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:52.779501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:52.779508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:52.779514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:52.779520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:52.779526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:52.779532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:52.779538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:52.779544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:52.779550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:52.779555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:52.779561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:52.779567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:52.779575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:52.779581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:52.779588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:52.779598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:52.779604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:52.779614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:52.779620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:52.779625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.779633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.779642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.779648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.779655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.779664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.779669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:52.779677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:52.779686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:52.779691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:52.779748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:52.785137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896100536434872:5341] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:52.785158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896100536434872:5341] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:52.785162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896100536434872:5341] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:52.785170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2022 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:52.785404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:52.786767Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2021
2025-09-30T14:55:52.786776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2021
2025-09-30T14:55:52.787371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2022 partition: 0 MaxSeqNo: 42 sessionId: src_id|dbfc840e-58512490-d5afe476-2a463f6f_0
2025-09-30T14:55:52.787755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8af38915-c7daa04b-cf09afd2-e61d1068_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dbfc840e-58512490-d5afe476-2a463f6f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:52.790636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbfc840e-58512490-d5afe476-2a463f6f_0] Write session: try to update token
2025-09-30T14:55:52.790659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbfc840e-58512490-d5afe476-2a463f6f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:52.786298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:52.786311Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:52.786314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:52.786319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:52.786325Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2021 [2:7555896100446664368:4008]
2025-09-30T14:55:52.786341Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:52.786357Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:52.786360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:52.786363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:52.786365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:52.786380Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:52.786387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:52.786394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:52.786457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.786459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.786462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.786469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:52.786471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:52.786536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:52.786539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.786551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.786565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.786583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:52.786601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896100536434802:2454], now have 1 active actors on pipe
2025-09-30T14:55:52.786604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896100536434911:5341], now have 1 active actors on pipe
2025-09-30T14:55:52.786610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896100446664363:4008]
2025-09-30T14:55:52.786613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896100446664363:4008]
2025-09-30T14:55:52.786615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896100446664363:4008]
2025-09-30T14:55:52.786626Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:52.786639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:52.786654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:52.786656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:52.786658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:52.786659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:52.786662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:52.786689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896100446664363:4008]
2025-09-30T14:55:52.786695Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:52.786795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:52.786966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:52.786971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:52.786997Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dbfc840e-58512490-d5afe476-2a463f6f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:52.787016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:52.787019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:52.787022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:52.787033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:52.787044Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:52.787061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:52.787208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:52.787213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:52.787238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:52.799952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:52.799971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:52.799974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:52.799976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:52.799992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896100446664363:4008]
2025-09-30T14:55:52.799996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896100446664363:4008]
2025-09-30T14:55:52.800000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896100446664363:4008]
2025-09-30T14:55:52.800045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:52.800052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.800054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:52.800078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:52.800085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:52.800089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:52.800194Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:52.810448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2022 sessionId: src_id|dbfc840e-58512490-d5afe476-2a463f6f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:52.813297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:52.862925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896100536434931:5488]
2025-09-30T14:55:52.863216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2021, pipe: [1:7555896100536434931:5488]
2025-09-30T14:55:52.931483Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:52.931813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:52.931823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:52.931863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896100536434931:5488], now have 1 active actors on pipe
2025-09-30T14:55:52.932121Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:52.932648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:52.932705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896100536434931:5488]
2025-09-30T14:55:52.932716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:52.932804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2022 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dbfc840e-58512490-d5afe476-2a463f6f_0
2025-09-30T14:55:52.933161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbfc840e-58512490-d5afe476-2a463f6f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:52.933173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbfc840e-58512490-d5afe476-2a463f6f_0] Write session will restart in 0.009488s
2025-09-30T14:55:52.933198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbfc840e-58512490-d5afe476-2a463f6f_0] Write session: Do CDS request
2025-09-30T14:55:52.933204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbfc840e-58512490-d5afe476-2a463f6f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:52.932983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2022 sessionId: src_id|dbfc840e-58512490-d5afe476-2a463f6f_0 is DEAD
2025-09-30T14:55:52.943752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbfc840e-58512490-d5afe476-2a463f6f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:52.943928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:52.943946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2023
2025-09-30T14:55:52.944086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2023 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:52.944120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2023 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:52.944132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2023 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:52.944140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:52.944550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2023 sessionId:  describe result for acl check
2025-09-30T14:55:52.944585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:52.944590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:52.944592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:52.944596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896100536435001:5322] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:52.945130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896100536435001:5322] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:52.946010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:52.947713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896100536435001:5322] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:52.948442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:52.948642Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:52.948652Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:52.948664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:52.948720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:52.948760Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896100446664479:4005]
2025-09-30T14:55:52.949200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:52.949462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:52.949521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:52.949813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:52.949876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:52.949883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:52.949884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:52.949885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:52.949886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:52.949887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:52.949889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:52.949890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:52.949892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:52.949893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:52.949894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.949895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.949896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.949898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:52.949900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:52.949905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:52.949914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:52.949918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:52.949922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:52.949926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:52.949929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:52.949933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:52.949936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:52.949940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:52.949944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:52.949947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.949952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.949955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.949958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:52.949962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:52.949970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:52.949977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:52.949982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:52.949988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:52.949993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:52.949998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:52.950002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:52.950007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:52.950012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:52.950016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:52.950022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:52.950027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:52.950031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:52.950035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:52.950039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:52.950044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:52.950049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:52.950053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:52.950057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:52.950061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:52.950066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.950071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.950075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.950081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.950087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.950100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.950104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:52.950108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:52.950111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:52.950117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:52.950137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896100536435001:5322] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:52.950149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896100536435001:5322] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:52.950152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896100536435001:5322] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:52.950160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2023 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:52.950157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:52.957064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:52.957948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:52.957964Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:52.957968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:52.957972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:52.957980Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2022 [2:7555896100446664479:4005]
2025-09-30T14:55:52.957997Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:52.958015Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:52.958018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:52.958022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:52.958024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:52.958042Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:52.958054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:52.958061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:52.958125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.958133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.958135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.958138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:52.958145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:52.958239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:52.958247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.958261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:52.958270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:52.958284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:52.958302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896100536434932:2454], now have 1 active actors on pipe
2025-09-30T14:55:52.958309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896100536435040:5322], now have 1 active actors on pipe
2025-09-30T14:55:52.958316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896100446664474:4005]
2025-09-30T14:55:52.958318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896100446664474:4005]
2025-09-30T14:55:52.958320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896100446664474:4005]
2025-09-30T14:55:52.958337Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:52.958359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:52.958378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:52.958387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:52.958379Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2022
2025-09-30T14:55:52.958420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:52.958425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2022
2025-09-30T14:55:52.958424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896100446664474:4005]
2025-09-30T14:55:52.958427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:52.958430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:52.958433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:52.958440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:52.958671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:52.958681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:52.958702Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|beaeee0c-b34c8921-e791e4d3-1489e764_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:52.958712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:52.958715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:52.958716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:52.958725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:52.958736Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:52.958748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:52.958944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:52.958957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:52.958982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:52.959075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2023 partition: 0 MaxSeqNo: 42 sessionId: src_id|beaeee0c-b34c8921-e791e4d3-1489e764_0
2025-09-30T14:55:52.959452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbfc840e-58512490-d5afe476-2a463f6f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|beaeee0c-b34c8921-e791e4d3-1489e764_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:52.962480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|beaeee0c-b34c8921-e791e4d3-1489e764_0] Write session: try to update token
2025-09-30T14:55:52.962503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|beaeee0c-b34c8921-e791e4d3-1489e764_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:52.972979Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:52.973000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:52.973010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896100446664474:4005]
2025-09-30T14:55:52.973056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:52.973255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:52.973386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:52.973538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:52.973669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:52.973849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:52.973883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:52.974727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:52.979793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2023 sessionId: src_id|beaeee0c-b34c8921-e791e4d3-1489e764_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:52.982429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:52.982697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:52.982716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:52.982747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:52.984502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:52.989624Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:52.989644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:52.989647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:52.989649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:52.989661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896100446664474:4005]
2025-09-30T14:55:52.989665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896100446664474:4005]
2025-09-30T14:55:52.989672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896100446664474:4005]
2025-09-30T14:55:52.989716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:52.989722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:52.989732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:52.989732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:52.989740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:52.989745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:52.989880Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:53.032858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896104831402347:5488]
2025-09-30T14:55:53.033226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2022, pipe: [1:7555896104831402347:5488]
2025-09-30T14:55:53.109658Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:53.119107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:53.119135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:53.119414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:53.119484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:53.119554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:53.119618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:53.119916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:53.119923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:53.120000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:53.120063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:53.120126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:53.120199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:53.120243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:53.120246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:53.120319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:53.120382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:53.120444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:53.120510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:53.120554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:53.120560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:53.120634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:53.120697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:53.120759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:53.120822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:53.120867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:53.120870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:53.120945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:53.121008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:53.121072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:53.121132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:53.121177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:53.121180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:53.121255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:53.121322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:53.121386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:53.121451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:53.121509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:53.121515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:53.121589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:53.121646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:53.121713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:53.121779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:53.121832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:53.121835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:53.121909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:53.121973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:53.122036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:53.122100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:53.122141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:53.122144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:53.122221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:53.122288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:53.122348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:53.122412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:53.122458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:53.122461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:53.122530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:53.122598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:53.122670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:53.122741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:53.122786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:53.122789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:53.122873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896104831402347:5488], now have 1 active actors on pipe
2025-09-30T14:55:53.123826Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:53.123826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:53.123832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:53.123866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2023 reason: error at write: Disconnected sessionId: src_id|beaeee0c-b34c8921-e791e4d3-1489e764_0
2025-09-30T14:55:53.123890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896104831402347:5488]
2025-09-30T14:55:53.123975Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:53.124092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2023 sessionId: src_id|beaeee0c-b34c8921-e791e4d3-1489e764_0 is DEAD
2025-09-30T14:55:53.124198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beaeee0c-b34c8921-e791e4d3-1489e764_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:53.124208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beaeee0c-b34c8921-e791e4d3-1489e764_0] Write session will restart in 0.009908s
2025-09-30T14:55:53.124232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beaeee0c-b34c8921-e791e4d3-1489e764_0] Write session: Do CDS request
2025-09-30T14:55:53.124238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beaeee0c-b34c8921-e791e4d3-1489e764_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:53.135357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:53.135775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|beaeee0c-b34c8921-e791e4d3-1489e764_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:53.135873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:53.135888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2024
2025-09-30T14:55:53.136024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2024 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:53.136056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2024 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:53.136067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2024 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:53.136072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:53.136528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2024 sessionId:  describe result for acl check
2025-09-30T14:55:53.136561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:53.136568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:53.136570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:53.136575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896104831402425:5318] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:53.137101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896104831402425:5318] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:53.137619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:53.137835Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:53.137846Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:53.137855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:53.137905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:53.137958Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896104741631887:4003]
2025-09-30T14:55:53.138561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:53.138879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:53.138944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:53.139334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:53.139407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:53.139414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:53.139415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:53.139417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:53.139418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:53.139419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:53.139421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:53.139422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:53.139424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:53.139425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:53.139426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.139428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:53.139429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:53.139431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:53.139432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:53.139438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:53.139450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:53.139455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:53.139460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:53.139464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:53.139469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:53.139472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:53.139476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:53.139481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:53.139486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:53.139491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.139496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:53.139500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:53.139504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:53.139509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:53.139517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:53.139526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:53.139533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:53.139539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:53.139544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:53.139551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:53.139556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:53.139562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:53.139568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:53.139574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:53.139581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:53.139593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:53.139599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:53.139605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:53.139610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:53.139618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:53.139625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:53.139636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:53.139640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:53.139646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:53.139636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896104831402425:5318] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:53.139659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.139670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.139674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:53.139680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:53.139685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:53.139691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:53.139696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:53.139702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:53.139712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:53.139718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:53.139769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:53.145033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896104831402425:5318] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:53.145052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896104831402425:5318] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:53.145057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896104831402425:5318] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:53.145081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2024 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:53.145725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:53.146610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:53.146627Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:53.146631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:53.146635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:53.146643Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2023 [2:7555896104741631887:4003]
2025-09-30T14:55:53.146659Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:53.146677Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:53.146685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:53.146689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:53.146695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:53.146711Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:53.146722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:53.146731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:53.146791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.146799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:53.146803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:53.146806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:53.146809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:53.146894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:53.146903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.146918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:53.146940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:53.146961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:53.146985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896104831402352:2454], now have 1 active actors on pipe
2025-09-30T14:55:53.146994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896104831402465:5318], now have 1 active actors on pipe
2025-09-30T14:55:53.147000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896104741631881:4003]
2025-09-30T14:55:53.147002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896104741631881:4003]
2025-09-30T14:55:53.147005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896104741631881:4003]
2025-09-30T14:55:53.147018Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:53.147031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:53.147033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:53.147046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:53.147049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:53.147053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:53.147057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:53.147010Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2023
2025-09-30T14:55:53.147066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2023
2025-09-30T14:55:53.147096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896104741631881:4003]
2025-09-30T14:55:53.147110Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:53.147122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:53.147141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:53.147151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:53.147179Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f574f373-80b6aba7-f9dbffd0-af8f317d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:53.147190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:53.147193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:53.147196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:53.147206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:53.147219Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:53.147238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:53.147586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:53.147595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:53.147621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:53.147771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2024 partition: 0 MaxSeqNo: 42 sessionId: src_id|f574f373-80b6aba7-f9dbffd0-af8f317d_0
2025-09-30T14:55:53.151588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beaeee0c-b34c8921-e791e4d3-1489e764_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f574f373-80b6aba7-f9dbffd0-af8f317d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:53.154401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f574f373-80b6aba7-f9dbffd0-af8f317d_0] Write session: try to update token
2025-09-30T14:55:53.154421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f574f373-80b6aba7-f9dbffd0-af8f317d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:53.177844Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:53.177862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:53.177871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896104741631881:4003]
2025-09-30T14:55:53.177916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:53.177918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:53.178099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:53.178236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:53.178372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:53.178509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:53.178708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:53.178740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:53.188150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2024 sessionId: src_id|f574f373-80b6aba7-f9dbffd0-af8f317d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:53.193009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:53.193271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:53.193296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:53.193343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:53.193590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:53.198388Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:53.198415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:53.198418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:53.198421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:53.198432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896104741631881:4003]
2025-09-30T14:55:53.198436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896104741631881:4003]
2025-09-30T14:55:53.198441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896104741631881:4003]
2025-09-30T14:55:53.198483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:53.198491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.198494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:53.198507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:53.198513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:53.198517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:53.198646Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:53.224475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896104831402480:5488]
2025-09-30T14:55:53.228638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2023, pipe: [1:7555896104831402480:5488]
2025-09-30T14:55:53.328086Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:53.337018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:53.337052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:53.337246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:53.337327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:53.337407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:53.337493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:53.337756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:53.337768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:53.337839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:53.337906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:53.337977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:53.338350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:53.338401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:53.338411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:53.338492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:53.338557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:53.338629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:53.338698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:53.338747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:53.338756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:53.338829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:53.338908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:53.338980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:53.339059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:53.339112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:53.339120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:53.339192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:53.339281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:53.339351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:53.339421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:53.339468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:53.339474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:53.339551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:53.339621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:53.339690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:53.339764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:53.339812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:53.339820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:53.339892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:53.339959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:53.340033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:53.340100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:53.340147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:53.340155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:53.340226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:53.340289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:53.340355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:53.340422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:53.340471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:53.340478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:53.340553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:53.340631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:53.340700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:53.340777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:53.340825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:53.340834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:53.340909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:53.340973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:53.341044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:53.341110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:53.341154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:53.341165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:53.341240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896104831402480:5488], now have 1 active actors on pipe
2025-09-30T14:55:53.341555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896104831402480:5488]
2025-09-30T14:55:53.341569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:53.341595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:53.341606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:53.341638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2024 reason: error at write: Disconnected sessionId: src_id|f574f373-80b6aba7-f9dbffd0-af8f317d_0
2025-09-30T14:55:53.341846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2024 sessionId: src_id|f574f373-80b6aba7-f9dbffd0-af8f317d_0 is DEAD
2025-09-30T14:55:53.341906Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:53.341996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f574f373-80b6aba7-f9dbffd0-af8f317d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:53.342004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f574f373-80b6aba7-f9dbffd0-af8f317d_0] Write session will restart in 0.009881s
2025-09-30T14:55:53.342028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f574f373-80b6aba7-f9dbffd0-af8f317d_0] Write session: Do CDS request
2025-09-30T14:55:53.342034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f574f373-80b6aba7-f9dbffd0-af8f317d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:53.352779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f574f373-80b6aba7-f9dbffd0-af8f317d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:53.352752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:53.352989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:53.353007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2025
2025-09-30T14:55:53.353145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2025 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:53.353176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2025 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:53.353185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2025 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:53.353189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:53.354234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2025 sessionId:  describe result for acl check
2025-09-30T14:55:53.354706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:53.354271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:53.354279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:53.354280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:53.354286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896104831402580:5305] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:53.354813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896104831402580:5305] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:53.354913Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:53.354924Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:53.354934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:53.354986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:53.355034Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896104741632034:3980]
2025-09-30T14:55:53.355812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:53.356390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:53.356437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:53.356726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896104831402580:5305] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:53.356776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:53.356835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:53.356841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:53.356842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:53.356843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:53.356845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:53.356846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:53.356847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:53.356849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:53.356850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:53.356851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:53.356852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.356854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:53.356855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:53.356857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:53.356858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:53.356864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:53.356874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:53.356878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:53.356882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:53.356887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:53.356892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:53.356896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:53.356901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:53.356905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:53.356910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:53.356915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.356919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:53.356924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:53.356928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:53.356933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:53.356941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:53.356949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:53.356956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:53.356962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:53.356967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:53.356973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:53.356978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:53.356984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:53.356990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:53.356996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:53.357001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:53.357008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:53.357013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:53.357019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:53.357025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:53.357031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:53.357036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:53.357042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:53.357047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:53.357053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:53.357058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.357064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.357069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:53.357075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:53.357082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:53.357095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:53.357100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:53.357109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:53.357114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:53.357121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:53.357173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:53.362924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896104831402580:5305] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:53.362941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896104831402580:5305] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:53.362946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896104831402580:5305] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:53.362955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2025 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:53.362792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:53.363756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:53.363779Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:53.363782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:53.363786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:53.363794Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2024 [2:7555896104741632034:3980]
2025-09-30T14:55:53.363813Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:53.363829Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:53.363832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:53.363836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:53.363839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:53.363856Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:53.363864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:53.363877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:53.363939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.363947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:53.363950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:53.363953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:53.363956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:53.364030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:53.364038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.364053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:53.364072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:53.364099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:53.364122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896104831402506:2454], now have 1 active actors on pipe
2025-09-30T14:55:53.364134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896104831402615:5305], now have 1 active actors on pipe
2025-09-30T14:55:53.364141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896104741632028:3980]
2025-09-30T14:55:53.364143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896104741632028:3980]
2025-09-30T14:55:53.364145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896104741632028:3980]
2025-09-30T14:55:53.364158Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:53.364176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:53.364182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:53.364186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:53.364155Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2024
2025-09-30T14:55:53.364188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:53.364165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2024
2025-09-30T14:55:53.364192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:53.364195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:53.364238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896104741632028:3980]
2025-09-30T14:55:53.364252Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:53.364266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:53.364274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:53.364278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:53.364325Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51bb8471-7b154a62-17222267-56739101_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:53.364337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:53.364346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:53.364348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:53.364360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:53.364370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:53.364395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:53.364567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:53.364578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:53.364592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:53.364703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2025 partition: 0 MaxSeqNo: 42 sessionId: src_id|51bb8471-7b154a62-17222267-56739101_0
2025-09-30T14:55:53.365081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f574f373-80b6aba7-f9dbffd0-af8f317d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|51bb8471-7b154a62-17222267-56739101_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:53.368066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51bb8471-7b154a62-17222267-56739101_0] Write session: try to update token
2025-09-30T14:55:53.368087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51bb8471-7b154a62-17222267-56739101_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:53.377415Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:53.377438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:53.377441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:53.377443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:53.377455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896104741632028:3980]
2025-09-30T14:55:53.377464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896104741632028:3980]
2025-09-30T14:55:53.377486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896104741632028:3980]
2025-09-30T14:55:53.377533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:53.377537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:53.377543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:53.377546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.377547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:53.377549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:53.377713Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:53.384603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2025 sessionId: src_id|51bb8471-7b154a62-17222267-56739101_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:53.387616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:53.441990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896104831402623:5488]
2025-09-30T14:55:53.442422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2024, pipe: [1:7555896104831402623:5488]
2025-09-30T14:55:53.493519Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:53.493888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:53.493910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:53.493943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896104831402623:5488], now have 1 active actors on pipe
2025-09-30T14:55:53.494206Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:53.494512Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:53.494557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896104831402623:5488]
2025-09-30T14:55:53.494573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:53.494640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2025 reason: status is not ok: tablet will be restarted right now sessionId: src_id|51bb8471-7b154a62-17222267-56739101_0
2025-09-30T14:55:53.494805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2025 sessionId: src_id|51bb8471-7b154a62-17222267-56739101_0 is DEAD
2025-09-30T14:55:53.494924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51bb8471-7b154a62-17222267-56739101_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:53.494935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51bb8471-7b154a62-17222267-56739101_0] Write session will restart in 0.006524s
2025-09-30T14:55:53.494959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51bb8471-7b154a62-17222267-56739101_0] Write session: Do CDS request
2025-09-30T14:55:53.494964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51bb8471-7b154a62-17222267-56739101_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:53.503811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51bb8471-7b154a62-17222267-56739101_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:53.504494Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:53.504510Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2026
2025-09-30T14:55:53.507519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2026 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:53.507570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2026 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:53.507582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2026 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:53.507588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:53.508090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2026 sessionId:  describe result for acl check
2025-09-30T14:55:53.508132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:53.508140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:53.508142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:53.508149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896104831402697:5297] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:53.508962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896104831402697:5297] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:53.509729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:53.512077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:53.512282Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:53.512290Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:53.512300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:53.512348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:53.512390Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896104741632148:3963]
2025-09-30T14:55:53.512966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896104831402697:5297] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:53.513039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:53.513375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:53.513412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:53.513732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:53.513807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:53.513812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:53.513814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:53.513815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:53.513816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:53.513817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:53.513819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:53.513820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:53.513821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:53.513822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:53.513823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.513824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:53.513825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:53.513827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:53.513828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:53.513833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:53.513842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:53.513846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:53.513849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:53.513853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:53.513858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:53.513862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:53.513865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:53.513869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:53.513872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:53.513875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.513879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:53.513882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:53.513885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:53.513889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:53.513896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:53.513903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:53.513908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:53.513913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:53.513917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:53.513922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:53.513926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:53.513932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:53.513936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:53.513941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:53.513945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:53.513950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:53.513954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:53.513959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:53.513963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:53.513967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:53.513971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:53.513976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:53.513980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:53.513984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:53.513988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.513993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.513996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:53.514001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:53.514004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:53.514009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:53.514014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:53.514018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:53.514022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:53.514026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:53.514066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:53.519613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896104831402697:5297] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:53.519634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896104831402697:5297] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:53.519638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896104831402697:5297] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:53.519648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2026 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:53.520140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:53.521048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:53.521067Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:53.521071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:53.521076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:53.521082Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2025 [2:7555896104741632148:3963]
2025-09-30T14:55:53.521100Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:53.521117Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:53.521121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:53.521124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:53.521127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:53.521144Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:53.521152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:53.521161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:53.521235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.521243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:53.521245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:53.521248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:53.521251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:53.521318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:53.521329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.521342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:53.521355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:53.521376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:53.521403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896104831402624:2454], now have 1 active actors on pipe
2025-09-30T14:55:53.521407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896104831402738:5297], now have 1 active actors on pipe
2025-09-30T14:55:53.521413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896104741632143:3963]
2025-09-30T14:55:53.521416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896104741632143:3963]
2025-09-30T14:55:53.521418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896104741632143:3963]
2025-09-30T14:55:53.521434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:53.521449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:53.521466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:53.521484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:53.521483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:53.521488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:53.521456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2025
2025-09-30T14:55:53.521491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:53.521523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896104741632143:3963]
2025-09-30T14:55:53.521526Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:53.521523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2025
2025-09-30T14:55:53.521533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:53.521577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:53.521590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:53.521621Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40cd8c74-dcd0d200-4fec7d48-3c793aba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:53.521634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:53.521637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:53.521640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:53.521651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:53.521662Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:53.521682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:53.521869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:53.521880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:53.521899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:53.522013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2026 partition: 0 MaxSeqNo: 42 sessionId: src_id|40cd8c74-dcd0d200-4fec7d48-3c793aba_0
2025-09-30T14:55:53.522372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51bb8471-7b154a62-17222267-56739101_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|40cd8c74-dcd0d200-4fec7d48-3c793aba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:53.525249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40cd8c74-dcd0d200-4fec7d48-3c793aba_0] Write session: try to update token
2025-09-30T14:55:53.525271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40cd8c74-dcd0d200-4fec7d48-3c793aba_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:53.534752Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:53.534769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:53.534771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:53.534773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:53.534784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896104741632143:3963]
2025-09-30T14:55:53.534789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896104741632143:3963]
2025-09-30T14:55:53.534792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896104741632143:3963]
2025-09-30T14:55:53.534834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:53.534841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.534844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:53.534984Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:53.535912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:53.535930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:53.535935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:53.544766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2026 sessionId: src_id|40cd8c74-dcd0d200-4fec7d48-3c793aba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:53.547838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:53.594577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896104831402745:5488]
2025-09-30T14:55:53.594968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2025, pipe: [1:7555896104831402745:5488]
2025-09-30T14:55:53.649668Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:53.650136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:53.650152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:53.650174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896104831402745:5488], now have 1 active actors on pipe
2025-09-30T14:55:53.650407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:53.650472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896104831402745:5488]
2025-09-30T14:55:53.650541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:53.650553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:53.650597Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:53.650627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2026 reason: error at write: Disconnected sessionId: src_id|40cd8c74-dcd0d200-4fec7d48-3c793aba_0
2025-09-30T14:55:53.650819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2026 sessionId: src_id|40cd8c74-dcd0d200-4fec7d48-3c793aba_0 is DEAD
2025-09-30T14:55:53.650992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40cd8c74-dcd0d200-4fec7d48-3c793aba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:53.651000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40cd8c74-dcd0d200-4fec7d48-3c793aba_0] Write session will restart in 0.007641s
2025-09-30T14:55:53.651023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40cd8c74-dcd0d200-4fec7d48-3c793aba_0] Write session: Do CDS request
2025-09-30T14:55:53.651032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40cd8c74-dcd0d200-4fec7d48-3c793aba_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:53.659744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40cd8c74-dcd0d200-4fec7d48-3c793aba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:53.659829Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:53.659849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2027
2025-09-30T14:55:53.659974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2027 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:53.660010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2027 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:53.660020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2027 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:53.660025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:53.660497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2027 sessionId:  describe result for acl check
2025-09-30T14:55:53.660534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:53.660536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:53.660538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:53.660544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896104831402763:5293] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:53.661033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896104831402763:5293] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:53.663279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896104831402763:5293] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:53.665544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:53.665827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896104831402763:5293] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:53.665841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896104831402763:5293] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:53.665844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896104831402763:5293] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:53.665853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2027 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:53.667321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:53.667538Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:53.667550Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:53.667561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:53.667625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:53.667675Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896104741632262:3976]
2025-09-30T14:55:53.668278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:53.668585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:53.668632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:53.668950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:53.669018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:53.669025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:53.669026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:53.669027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:53.669029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:53.669030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:53.669031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:53.669032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:53.669033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:53.669035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:53.669036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.669037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:53.669038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:53.669040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:53.669041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:53.669047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:53.669058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:53.669061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:53.669065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:53.669068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:53.669072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:53.669076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:53.669079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:53.669083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:53.669089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:53.669093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.669096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:53.669100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:53.669103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:53.669107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:53.669115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:53.669124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:53.669131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:53.669136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:53.669141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:53.669147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:53.669152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:53.669158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:53.669162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:53.669168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:53.669172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:53.669176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:53.669181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:53.669186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:53.669192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:53.669196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:53.669202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:53.669207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:53.669211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:53.669215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:53.669219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.669223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.669227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:53.669231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:53.669246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:53.669251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:53.669255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:53.669260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:53.669264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:53.669270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:53.669328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:53.674995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:53.675922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:53.675937Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:53.675940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:53.675944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:53.675950Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2026 [2:7555896104741632262:3976]
2025-09-30T14:55:53.675969Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:53.675985Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:53.675989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:53.675992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:53.675995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:53.676012Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:53.676029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:53.676037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:53.676101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.676104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:53.676107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:53.676111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:53.676114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:53.676183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:53.676191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.676203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:53.676214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:53.676229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:53.676252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896104831402748:2454], now have 1 active actors on pipe
2025-09-30T14:55:53.676262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896104831402859:5293], now have 1 active actors on pipe
2025-09-30T14:55:53.676270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896104741632256:3976]
2025-09-30T14:55:53.676273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896104741632256:3976]
2025-09-30T14:55:53.676277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896104741632256:3976]
2025-09-30T14:55:53.676289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:53.676307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:53.676310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:53.676313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:53.676318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:53.676333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:53.676336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:53.676331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2026
2025-09-30T14:55:53.676372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896104741632256:3976]
2025-09-30T14:55:53.676384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:53.676385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:53.676382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2026
2025-09-30T14:55:53.676400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:53.676409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:53.676461Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc203ab-d7c93d6-e0f012ab-84818e83_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:53.676473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:53.676477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:53.676479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:53.676489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:53.676502Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:53.676523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:53.676701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:53.676709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:53.676724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:53.676835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2027 partition: 0 MaxSeqNo: 42 sessionId: src_id|bc203ab-d7c93d6-e0f012ab-84818e83_0
2025-09-30T14:55:53.677197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40cd8c74-dcd0d200-4fec7d48-3c793aba_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bc203ab-d7c93d6-e0f012ab-84818e83_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:53.681147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc203ab-d7c93d6-e0f012ab-84818e83_0] Write session: try to update token
2025-09-30T14:55:53.681169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc203ab-d7c93d6-e0f012ab-84818e83_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:53.689550Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:53.689570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:53.689573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:53.689575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:53.689584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896104741632256:3976]
2025-09-30T14:55:53.689589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896104741632256:3976]
2025-09-30T14:55:53.689593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896104741632256:3976]
2025-09-30T14:55:53.689633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:53.689636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:53.689641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.689641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:53.689644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:53.689645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:53.689786Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:53.696445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2027 sessionId: src_id|bc203ab-d7c93d6-e0f012ab-84818e83_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:53.699307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:53.750753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896104831402870:5488]
2025-09-30T14:55:53.751084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2026, pipe: [1:7555896104831402870:5488]
2025-09-30T14:55:53.806954Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:53.807483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:53.807500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:53.807524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896104831402870:5488], now have 1 active actors on pipe
2025-09-30T14:55:53.808340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc203ab-d7c93d6-e0f012ab-84818e83_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:53.808353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc203ab-d7c93d6-e0f012ab-84818e83_0] Write session will restart in 0.007278s
2025-09-30T14:55:53.808378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc203ab-d7c93d6-e0f012ab-84818e83_0] Write session: Do CDS request
2025-09-30T14:55:53.808384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc203ab-d7c93d6-e0f012ab-84818e83_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:53.807784Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:53.807873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896104831402870:5488]
2025-09-30T14:55:53.807914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:53.807917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:53.807989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2027 reason: error at write: Disconnected sessionId: src_id|bc203ab-d7c93d6-e0f012ab-84818e83_0
2025-09-30T14:55:53.808160Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:53.808186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2027 sessionId: src_id|bc203ab-d7c93d6-e0f012ab-84818e83_0 is DEAD
2025-09-30T14:55:53.816773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc203ab-d7c93d6-e0f012ab-84818e83_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:53.818772Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:53.818794Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2028
2025-09-30T14:55:53.819092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2028 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:53.819131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2028 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:53.819136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2028 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:53.819150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:53.819863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2028 sessionId:  describe result for acl check
2025-09-30T14:55:53.819894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:53.819897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:53.819899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:53.819905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896104831402933:5288] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:53.820462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896104831402933:5288] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:53.823063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:53.824001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896104831402933:5288] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:53.825367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:53.825578Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:53.825588Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:53.825599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:53.825658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:53.825714Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896104741632387:3973]
2025-09-30T14:55:53.826322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:53.827649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896104831402933:5288] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:53.827674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896104831402933:5288] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:53.827678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896104831402933:5288] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:53.827687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2028 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:53.831339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:53.831441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:53.831878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:53.831976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:53.831978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:53.831979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:53.831990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:53.831992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:53.831993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:53.831995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:53.831997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:53.831998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:53.832000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:53.832001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.832002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:53.832004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:53.832005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:53.832006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:53.832013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:53.832025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:53.832029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:53.832034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:53.832039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:53.832042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:53.832047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:53.832051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:53.832055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:53.832060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:53.832064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.832068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:53.832072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:53.832076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:53.832080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:53.832090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:53.832099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:53.832105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:53.832110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:53.832115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:53.832121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:53.832128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:53.832134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:53.832140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:53.832145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:53.832150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:53.832156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:53.832160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:53.832166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:53.832171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:53.832177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:53.832183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:53.832188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:53.832194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:53.832199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:53.832207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.832215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.832218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:53.832223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:53.832227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:53.832231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:53.832236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:53.832240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:53.832245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:53.832250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:53.832294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:53.838382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:53.839329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:53.839347Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:53.839350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:53.839355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:53.839364Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2027 [2:7555896104741632387:3973]
2025-09-30T14:55:53.839385Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:53.839407Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:53.839416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:53.839420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:53.839422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:53.839439Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:53.839457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:53.839465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:53.839534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.839543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:53.839546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:53.839550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:53.839554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:53.839636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:53.839644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.839660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:53.839673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:53.839692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:53.839717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896104831402983:5288], now have 1 active actors on pipe
2025-09-30T14:55:53.839728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896104831402871:2454], now have 1 active actors on pipe
2025-09-30T14:55:53.839735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896104741632382:3973]
2025-09-30T14:55:53.839738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896104741632382:3973]
2025-09-30T14:55:53.839741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896104741632382:3973]
2025-09-30T14:55:53.839758Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:53.839775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:53.839787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:53.839790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:53.839793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:53.839795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:53.839798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:53.839843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896104741632382:3973]
2025-09-30T14:55:53.839856Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:53.839863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:53.840028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2027
2025-09-30T14:55:53.840063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2027
2025-09-30T14:55:53.840228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:53.840241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:53.840285Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71472597-925ddb7c-dfcfb366-89344a08_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:53.840294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:53.840298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:53.840301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:53.840312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:53.840323Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:53.840340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:53.843849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:53.843873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:53.843911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:53.844244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2028 partition: 0 MaxSeqNo: 42 sessionId: src_id|71472597-925ddb7c-dfcfb366-89344a08_0
2025-09-30T14:55:53.844709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc203ab-d7c93d6-e0f012ab-84818e83_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|71472597-925ddb7c-dfcfb366-89344a08_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:53.847691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71472597-925ddb7c-dfcfb366-89344a08_0] Write session: try to update token
2025-09-30T14:55:53.847717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71472597-925ddb7c-dfcfb366-89344a08_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:53.864577Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:53.864597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:53.864610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896104741632382:3973]
2025-09-30T14:55:53.864662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:53.864661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:53.864887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:53.865062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:53.865212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:53.865362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:53.865605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:53.865670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:53.867126Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:53.867131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:53.867133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:53.867135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:53.867143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896104741632382:3973]
2025-09-30T14:55:53.867147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896104741632382:3973]
2025-09-30T14:55:53.867153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896104741632382:3973]
2025-09-30T14:55:53.867196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:53.867202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:53.867207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:53.867365Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:53.871417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:53.871424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:53.871431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:53.871274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2028 sessionId: src_id|71472597-925ddb7c-dfcfb366-89344a08_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:53.874155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:53.909311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896104831403006:5488]
2025-09-30T14:55:53.913736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2027, pipe: [1:7555896104831403006:5488]
2025-09-30T14:55:53.987167Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:53.988116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:53.988136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:53.988158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896104831403006:5488], now have 1 active actors on pipe
2025-09-30T14:55:53.988432Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:53.988439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:53.988453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:53.988516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2028 reason: error at write: Disconnected sessionId: src_id|71472597-925ddb7c-dfcfb366-89344a08_0
2025-09-30T14:55:53.988691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2028 sessionId: src_id|71472597-925ddb7c-dfcfb366-89344a08_0 is DEAD
2025-09-30T14:55:53.988828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896104831403006:5488]
2025-09-30T14:55:53.988842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:53.991463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71472597-925ddb7c-dfcfb366-89344a08_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:53.991476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71472597-925ddb7c-dfcfb366-89344a08_0] Write session will restart in 0.005997s
2025-09-30T14:55:53.991510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71472597-925ddb7c-dfcfb366-89344a08_0] Write session: Do CDS request
2025-09-30T14:55:53.991520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71472597-925ddb7c-dfcfb366-89344a08_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:53.998691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71472597-925ddb7c-dfcfb366-89344a08_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:54.002918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:53.999482Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:53.999497Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2029
2025-09-30T14:55:54.003454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2029 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:54.003518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2029 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:54.003524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2029 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:54.003529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:54.003953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2029 sessionId:  describe result for acl check
2025-09-30T14:55:54.003977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:54.003979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:54.003980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:54.003987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896109126370385:5278] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:54.004532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896109126370385:5278] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:54.006568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896109126370385:5278] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:54.009076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:54.009318Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:54.009323Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:54.009335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:54.009389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:54.009426Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896109036599800:3966]
2025-09-30T14:55:54.010129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:54.010660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:54.010712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:54.011062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:54.011121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:54.011123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:54.011125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:54.011126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:54.011127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:54.011129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:54.011131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:54.011132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:54.011133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:54.011134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:54.011136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.011137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.011138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.011139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:54.011140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:54.011145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:54.011157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:54.011161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:54.011165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:54.011170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:54.011175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:54.011180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:54.011184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:54.011188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:54.011194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:54.011198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.011203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.011208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.011212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:54.011217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:54.011226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:54.011235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:54.011263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:54.011271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:54.011280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:54.011286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:54.011292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:54.011298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:54.011303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:54.011308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:54.011312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:54.011318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:54.011323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:54.011328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:54.011333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:54.011340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:54.011345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:54.011350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:54.011355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:54.011361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:54.011369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.011375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.011380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.011386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.011391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.011398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.011403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:54.011409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:54.011416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:54.011422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:54.011471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:54.016383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896109126370385:5278] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:54.016400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896109126370385:5278] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:54.016404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896109126370385:5278] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:54.016414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2029 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:54.020626Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2028
2025-09-30T14:55:54.020665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2028
2025-09-30T14:55:54.018979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:54.020136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:54.020141Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:54.020144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:54.020148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:54.020154Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2028 [2:7555896109036599800:3966]
2025-09-30T14:55:54.020173Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:54.020187Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:54.020190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:54.020193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:54.020195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:54.020211Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:54.020218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:54.020225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:54.020305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.020307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.020309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.020312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:54.020315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:54.020391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:54.020394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.020406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.020418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.020434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:54.020451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896109036599794:3966]
2025-09-30T14:55:54.020453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896109036599794:3966]
2025-09-30T14:55:54.020455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896109036599794:3966]
2025-09-30T14:55:54.020465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:54.020482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:54.020491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:54.020495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:54.020497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:54.020500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:54.020500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:54.020540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896109036599794:3966]
2025-09-30T14:55:54.020550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:54.020560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896104831403010:2454], now have 1 active actors on pipe
2025-09-30T14:55:54.020564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896109126370420:5278], now have 1 active actors on pipe
2025-09-30T14:55:54.020590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:54.021732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:54.021744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:54.021770Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b2327bc-4fa6d2b9-a85e0601-145115e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:54.021778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:54.021782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:54.021784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:54.021795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:54.021807Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:54.021822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:54.022050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:54.022059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:54.022073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:54.022166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2029 partition: 0 MaxSeqNo: 42 sessionId: src_id|6b2327bc-4fa6d2b9-a85e0601-145115e5_0
2025-09-30T14:55:54.022577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71472597-925ddb7c-dfcfb366-89344a08_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6b2327bc-4fa6d2b9-a85e0601-145115e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:54.025557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b2327bc-4fa6d2b9-a85e0601-145115e5_0] Write session: try to update token
2025-09-30T14:55:54.025578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b2327bc-4fa6d2b9-a85e0601-145115e5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:54.037117Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:54.037139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:54.037144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:54.037147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:54.037157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896109036599794:3966]
2025-09-30T14:55:54.037161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896109036599794:3966]
2025-09-30T14:55:54.037165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896109036599794:3966]
2025-09-30T14:55:54.037212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:54.037219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.037225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:54.037228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:54.037233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:54.037237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:54.037367Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:54.040573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2029 sessionId: src_id|6b2327bc-4fa6d2b9-a85e0601-145115e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:54.043469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:54.089143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896109126370427:5488]
2025-09-30T14:55:54.089558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2028, pipe: [1:7555896109126370427:5488]
2025-09-30T14:55:54.156566Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:54.157213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:54.157217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:54.157221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:54.157281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896109126370427:5488]
2025-09-30T14:55:54.157285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2029 reason: error at write: Disconnected sessionId: src_id|6b2327bc-4fa6d2b9-a85e0601-145115e5_0
2025-09-30T14:55:54.157504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2029 sessionId: src_id|6b2327bc-4fa6d2b9-a85e0601-145115e5_0 is DEAD
2025-09-30T14:55:54.157643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b2327bc-4fa6d2b9-a85e0601-145115e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:54.157654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b2327bc-4fa6d2b9-a85e0601-145115e5_0] Write session will restart in 0.005547s
2025-09-30T14:55:54.157680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b2327bc-4fa6d2b9-a85e0601-145115e5_0] Write session: Do CDS request
2025-09-30T14:55:54.157685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b2327bc-4fa6d2b9-a85e0601-145115e5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:54.156871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:54.156886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:54.156926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896109126370427:5488], now have 1 active actors on pipe
2025-09-30T14:55:54.157570Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:54.164783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b2327bc-4fa6d2b9-a85e0601-145115e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:54.167405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:54.167421Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2030
2025-09-30T14:55:54.167606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2030 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:54.167652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2030 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:54.167663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2030 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:54.167667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:54.168120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2030 sessionId:  describe result for acl check
2025-09-30T14:55:54.168157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:54.168163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:54.168165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:54.168171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896109126370468:5272] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:54.168696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896109126370468:5272] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:54.173213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896109126370468:5272] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:54.175569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:54.178331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:54.178557Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:54.178566Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:54.178574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:54.178632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:54.178674Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896109036599916:3970]
2025-09-30T14:55:54.178662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896109126370468:5272] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:54.178684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896109126370468:5272] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:54.178687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896109126370468:5272] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:54.178697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2030 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:54.179354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:54.179745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:54.179804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:54.180156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:54.180251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:54.180258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:54.180259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:54.180261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:54.180262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:54.180263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:54.180264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:54.180266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:54.180267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:54.180268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:54.180270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.180271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.180272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.180273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:54.180275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:54.180281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:54.180291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:54.180294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:54.180299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:54.180303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:54.180307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:54.180311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:54.180314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:54.180318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:54.180322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:54.180326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.180329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.180333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.180336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:54.180340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:54.180349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:54.180357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:54.180363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:54.180369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:54.180374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:54.180379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:54.180385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:54.180390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:54.180395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:54.180400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:54.180404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:54.180409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:54.180423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:54.180428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:54.180432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:54.180437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:54.180442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:54.180447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:54.180451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:54.180456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:54.180462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.180468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.180472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.180477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.180481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.180486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.180490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:54.180495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:54.180500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:54.180505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:54.180552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:54.186314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:54.187409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:54.187428Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:54.187432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:54.187436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:54.187443Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2029 [2:7555896109036599916:3970]
2025-09-30T14:55:54.187460Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:54.187474Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:54.187476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:54.187479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:54.187481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:54.187495Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:54.187500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:54.187509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:54.187559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.187567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.187568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.187571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:54.187573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:54.187626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:54.187634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.187647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.187658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.187677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:54.187695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896109036599911:3970]
2025-09-30T14:55:54.187702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896109036599911:3970]
2025-09-30T14:55:54.187704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896109036599911:3970]
2025-09-30T14:55:54.187716Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:54.187726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:54.187732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:54.187735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:54.187741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:54.187750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:54.187753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:54.187761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896109126370547:5272], now have 1 active actors on pipe
2025-09-30T14:55:54.187764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896109126370434:2454], now have 1 active actors on pipe
2025-09-30T14:55:54.187795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896109036599911:3970]
2025-09-30T14:55:54.187809Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:54.187841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:54.188132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2029
2025-09-30T14:55:54.188164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2029
2025-09-30T14:55:54.188494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:54.188506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:54.188538Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97a185ba-e49c4a1a-7ffe7ea3-459cec92_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:54.188551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:54.188560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:54.188563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:54.188574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:54.188592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:54.188612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:54.188761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:54.188768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:54.188780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:54.188862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2030 partition: 0 MaxSeqNo: 42 sessionId: src_id|97a185ba-e49c4a1a-7ffe7ea3-459cec92_0
2025-09-30T14:55:54.189298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b2327bc-4fa6d2b9-a85e0601-145115e5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|97a185ba-e49c4a1a-7ffe7ea3-459cec92_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:54.192138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97a185ba-e49c4a1a-7ffe7ea3-459cec92_0] Write session: try to update token
2025-09-30T14:55:54.192157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97a185ba-e49c4a1a-7ffe7ea3-459cec92_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:54.203780Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:54.203800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:54.203803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:54.203805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:54.203816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896109036599911:3970]
2025-09-30T14:55:54.203821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896109036599911:3970]
2025-09-30T14:55:54.203827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896109036599911:3970]
2025-09-30T14:55:54.203875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:54.203884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.203892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:54.204044Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:54.207281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2030 sessionId: src_id|97a185ba-e49c4a1a-7ffe7ea3-459cec92_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:54.207353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:54.207376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:54.207382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:54.210083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:54.257629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896109126370562:5488]
2025-09-30T14:55:54.257964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2029, pipe: [1:7555896109126370562:5488]
2025-09-30T14:55:54.321868Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:54.322246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:54.322266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:54.322302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896109126370562:5488], now have 1 active actors on pipe
2025-09-30T14:55:54.322531Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:54.323159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a185ba-e49c4a1a-7ffe7ea3-459cec92_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:54.323171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a185ba-e49c4a1a-7ffe7ea3-459cec92_0] Write session will restart in 0.005458s
2025-09-30T14:55:54.323194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a185ba-e49c4a1a-7ffe7ea3-459cec92_0] Write session: Do CDS request
2025-09-30T14:55:54.323199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a185ba-e49c4a1a-7ffe7ea3-459cec92_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:54.322766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:54.322782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:54.322834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2030 reason: error at write: Disconnected sessionId: src_id|97a185ba-e49c4a1a-7ffe7ea3-459cec92_0
2025-09-30T14:55:54.323006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2030 sessionId: src_id|97a185ba-e49c4a1a-7ffe7ea3-459cec92_0 is DEAD
2025-09-30T14:55:54.323146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896109126370562:5488]
2025-09-30T14:55:54.323159Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:54.329813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97a185ba-e49c4a1a-7ffe7ea3-459cec92_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:54.331408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:54.331426Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2031
2025-09-30T14:55:54.332083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2031 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:54.332123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2031 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:54.332129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2031 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:54.332133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:54.332608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2031 sessionId:  describe result for acl check
2025-09-30T14:55:54.332646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:54.332654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:54.332656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:54.332662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896109126370601:5257] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:54.333232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896109126370601:5257] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:54.335512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896109126370601:5257] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:54.339883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896109126370601:5257] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:54.339900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896109126370601:5257] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:54.339904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896109126370601:5257] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:54.339914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2031 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:54.341055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:54.343734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:54.344131Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:54.344143Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:54.344156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:54.344222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:54.344270Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896109036600069:3929]
2025-09-30T14:55:54.344934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:54.345249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:54.345293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:54.345656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:54.345732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:54.345733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:54.345734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:54.345735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:54.345736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:54.345738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:54.345739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:54.345740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:54.345742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:54.345743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:54.345749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.345750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.345751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.345752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:54.345753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:54.345759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:54.345769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:54.345773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:54.345777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:54.345781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:54.345784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:54.345788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:54.345792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:54.345796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:54.345801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:54.345805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.345809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.345813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.345817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:54.345821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:54.345829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:54.345838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:54.345844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:54.345850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:54.345855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:54.345861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:54.345866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:54.345871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:54.345876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:54.345881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:54.345889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:54.345896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:54.345903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:54.345907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:54.345910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:54.345915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:54.345920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:54.345925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:54.345930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:54.345934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:54.345940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.345946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.345950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.345955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.345960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.345966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.345970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:54.345975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:54.345980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:54.345985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:54.346032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:54.355005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:54.356186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:54.356200Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:54.356203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:54.356207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:54.356214Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2030 [2:7555896109036600069:3929]
2025-09-30T14:55:54.356232Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:54.356251Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:54.356254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:54.356257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:54.356260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:54.356277Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:54.356283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:54.356290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:54.356349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.356351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.356355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.356359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:54.356362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:54.356431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:54.356433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.356444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.356454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.356468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:54.356485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896109036600063:3929]
2025-09-30T14:55:54.356487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896109036600063:3929]
2025-09-30T14:55:54.356489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896109036600063:3929]
2025-09-30T14:55:54.356497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:54.356510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:54.356522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:54.356523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:54.356527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:54.356528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:54.356529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:54.356567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896109036600063:3929]
2025-09-30T14:55:54.356576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:54.356585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896109126370583:2454], now have 1 active actors on pipe
2025-09-30T14:55:54.356589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896109126370696:5257], now have 1 active actors on pipe
2025-09-30T14:55:54.356684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:54.359160Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2030
2025-09-30T14:55:54.359206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2030
2025-09-30T14:55:54.359323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:54.359337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:54.359363Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9fca9afc-e367e27d-d133ed3e-f539a9ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:54.359373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:54.359377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:54.359383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:54.359394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:54.359408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:54.359426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:54.360261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:54.360273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:54.360291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:54.360401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2031 partition: 0 MaxSeqNo: 42 sessionId: src_id|9fca9afc-e367e27d-d133ed3e-f539a9ff_0
2025-09-30T14:55:54.360785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a185ba-e49c4a1a-7ffe7ea3-459cec92_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9fca9afc-e367e27d-d133ed3e-f539a9ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:54.363685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fca9afc-e367e27d-d133ed3e-f539a9ff_0] Write session: try to update token
2025-09-30T14:55:54.363708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fca9afc-e367e27d-d133ed3e-f539a9ff_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:54.375305Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:54.375324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:54.375328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:54.375330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:54.375341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896109036600063:3929]
2025-09-30T14:55:54.375347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896109036600063:3929]
2025-09-30T14:55:54.375351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896109036600063:3929]
2025-09-30T14:55:54.375400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:54.375408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.375410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:54.375575Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:54.376981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:54.376987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:54.376992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
E0930 14:55:54.389938322 2221336 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:11802: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 2500ms
2025-09-30T14:55:54.390127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2031 sessionId: src_id|9fca9afc-e367e27d-d133ed3e-f539a9ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:54.391143Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:11802 } ]
2025-09-30T14:55:54.392962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:54.423479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896109126370711:5488]
2025-09-30T14:55:54.423940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2030, pipe: [1:7555896109126370711:5488]
2025-09-30T14:55:54.485380Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:54.485733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:54.485746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:54.485765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896109126370711:5488], now have 1 active actors on pipe
2025-09-30T14:55:54.486013Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:54.486064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:54.486114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:54.486117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:54.486173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2031 reason: error at write: Disconnected sessionId: src_id|9fca9afc-e367e27d-d133ed3e-f539a9ff_0
2025-09-30T14:55:54.486349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2031 sessionId: src_id|9fca9afc-e367e27d-d133ed3e-f539a9ff_0 is DEAD
2025-09-30T14:55:54.486520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fca9afc-e367e27d-d133ed3e-f539a9ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:54.486543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fca9afc-e367e27d-d133ed3e-f539a9ff_0] Write session will restart in 0.008416s
2025-09-30T14:55:54.486568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fca9afc-e367e27d-d133ed3e-f539a9ff_0] Write session: Do CDS request
2025-09-30T14:55:54.486576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fca9afc-e367e27d-d133ed3e-f539a9ff_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:54.486530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896109126370711:5488]
2025-09-30T14:55:54.495817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fca9afc-e367e27d-d133ed3e-f539a9ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:54.495926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:54.495944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2032
2025-09-30T14:55:54.496123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2032 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:54.496163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2032 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:54.496169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2032 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:54.496173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:54.497245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2032 sessionId:  describe result for acl check
2025-09-30T14:55:54.497281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:54.497286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:54.497287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:54.497292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896109126370737:5254] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:54.497819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896109126370737:5254] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:54.503985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896109126370737:5254] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:54.504884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:54.507602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:54.507857Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:54.507869Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:54.507881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:54.507946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:54.507998Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896109036600187:3922]
2025-09-30T14:55:54.508129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896109126370737:5254] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:54.508159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896109126370737:5254] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:54.508163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896109126370737:5254] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:54.508171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2032 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:54.508673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:54.509050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:54.509123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:54.509510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:54.509575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:54.509576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:54.509578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:54.509580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:54.509581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:54.509583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:54.509584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:54.509585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:54.509587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:54.509588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:54.509589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.509591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.509592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.509594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:54.509595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:54.509602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:54.509615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:54.509620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:54.509626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:54.509631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:54.509636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:54.509642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:54.509647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:54.509652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:54.509657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:54.509662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.509666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.509671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.509675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:54.509680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:54.509688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:54.509697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:54.509704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:54.509711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:54.509719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:54.509725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:54.509733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:54.509739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:54.509745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:54.509766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:54.509771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:54.509777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:54.509783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:54.509789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:54.509795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:54.509801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:54.509807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:54.509814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:54.509821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:54.509827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:54.509832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.509839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.509844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.509850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.509856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.509862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.509867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:54.509873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:54.509878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:54.509884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:54.509930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:54.515586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:54.516759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:54.516779Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:54.516782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:54.516786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:54.516794Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2031 [2:7555896109036600187:3922]
2025-09-30T14:55:54.516810Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:54.516826Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:54.516835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:54.516838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:54.516840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:54.516858Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:54.516870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:54.516877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:54.516942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.516950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.516952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.516956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:54.516958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:54.517025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:54.517033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.517048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.517065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.517087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:54.517110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896109126370712:2454], now have 1 active actors on pipe
2025-09-30T14:55:54.517124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896109126370829:5254], now have 1 active actors on pipe
2025-09-30T14:55:54.517130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896109036600182:3922]
2025-09-30T14:55:54.517133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896109036600182:3922]
2025-09-30T14:55:54.517135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896109036600182:3922]
2025-09-30T14:55:54.517148Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:54.517160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:54.517163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:54.517163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:54.517165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:54.517179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:54.517182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:54.517154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2031
2025-09-30T14:55:54.517169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2031
2025-09-30T14:55:54.517234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:54.517243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:54.517255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896109036600182:3922]
2025-09-30T14:55:54.517269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:54.517295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:54.517308Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10b0d37a-64091855-1f860f19-ea03ca47_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:54.517315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:54.517319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:54.517322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:54.517332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:54.517342Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:54.517369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:54.517576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:54.517587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:54.517605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:54.517711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2032 partition: 0 MaxSeqNo: 42 sessionId: src_id|10b0d37a-64091855-1f860f19-ea03ca47_0
2025-09-30T14:55:54.518091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fca9afc-e367e27d-d133ed3e-f539a9ff_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|10b0d37a-64091855-1f860f19-ea03ca47_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:54.521014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10b0d37a-64091855-1f860f19-ea03ca47_0] Write session: try to update token
2025-09-30T14:55:54.521033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10b0d37a-64091855-1f860f19-ea03ca47_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:54.532497Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:54.532521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:54.532525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:54.532527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:54.532539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896109036600182:3922]
2025-09-30T14:55:54.532551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896109036600182:3922]
2025-09-30T14:55:54.532555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896109036600182:3922]
2025-09-30T14:55:54.532602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:54.532614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.532618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:54.532619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:54.532629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:54.532634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:54.532765Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:54.541563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2032 sessionId: src_id|10b0d37a-64091855-1f860f19-ea03ca47_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:54.544288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:54.586849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896109126370840:5488]
2025-09-30T14:55:54.587185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2031, pipe: [1:7555896109126370840:5488]
2025-09-30T14:55:54.649585Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:54.649962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:54.649979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:54.649999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896109126370840:5488], now have 1 active actors on pipe
2025-09-30T14:55:54.650217Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:54.652540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:54.652557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:54.652561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:54.652605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896109126370840:5488]
2025-09-30T14:55:54.652623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2032 reason: error at write: Disconnected sessionId: src_id|10b0d37a-64091855-1f860f19-ea03ca47_0
2025-09-30T14:55:54.652807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2032 sessionId: src_id|10b0d37a-64091855-1f860f19-ea03ca47_0 is DEAD
2025-09-30T14:55:54.652957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b0d37a-64091855-1f860f19-ea03ca47_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:54.652965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b0d37a-64091855-1f860f19-ea03ca47_0] Write session will restart in 0.009215s
2025-09-30T14:55:54.652990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b0d37a-64091855-1f860f19-ea03ca47_0] Write session: Do CDS request
2025-09-30T14:55:54.652996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b0d37a-64091855-1f860f19-ea03ca47_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:54.663764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10b0d37a-64091855-1f860f19-ea03ca47_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:54.664124Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:54.664143Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2033
2025-09-30T14:55:54.664280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2033 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:54.664322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2033 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:54.664333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2033 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:54.664338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:54.664457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:54.664759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2033 sessionId:  describe result for acl check
2025-09-30T14:55:54.664795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:54.664802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:54.664804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:54.664812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896109126370924:5246] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:54.665345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896109126370924:5246] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:54.666875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:54.667069Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:54.667079Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:54.667090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:54.667145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:54.667181Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896109036600305:3920]
2025-09-30T14:55:54.667535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896109126370924:5246] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:54.667823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:54.668132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:54.668180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:54.668515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:54.668583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:54.668589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:54.668590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:54.668592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:54.668593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:54.668594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:54.668595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:54.668597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:54.668598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:54.668599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:54.668601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.668602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.668603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.668604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:54.668605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:54.668611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:54.668621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:54.668626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:54.668630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:54.668633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:54.668638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:54.668642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:54.668646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:54.668651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:54.668656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:54.668660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.668664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.668668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.668672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:54.668676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:54.668683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:54.668691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:54.668697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:54.668702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:54.668706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:54.668711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:54.668715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:54.668721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:54.668726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:54.668731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:54.668737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:54.668742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:54.668747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:54.668752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:54.668756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:54.668762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:54.668767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:54.668772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:54.668776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:54.668781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:54.668792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.668800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.668805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.668810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.668815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.668820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.668825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:54.668830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:54.668840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:54.668846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:54.668891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:54.671690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896109126370924:5246] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:54.671707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896109126370924:5246] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:54.671711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896109126370924:5246] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:54.671719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2033 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:54.674300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:54.675361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:54.675376Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:54.675379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:54.675383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:54.675389Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2032 [2:7555896109036600305:3920]
2025-09-30T14:55:54.675407Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:54.675423Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:54.675427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:54.675430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:54.675432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:54.675447Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:54.675454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:54.675465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:54.675520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.675528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.675530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.675533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:54.675536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:54.675601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:54.675609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.675623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.675638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.675657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:54.675678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896109036600300:3920]
2025-09-30T14:55:54.675684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896109036600300:3920]
2025-09-30T14:55:54.675686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896109036600300:3920]
2025-09-30T14:55:54.675698Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:54.675711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:54.675715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:54.675717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:54.675717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:54.675731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:54.675743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:54.675753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896109126370964:5246], now have 1 active actors on pipe
2025-09-30T14:55:54.675756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896109126370843:2454], now have 1 active actors on pipe
2025-09-30T14:55:54.675787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896109036600300:3920]
2025-09-30T14:55:54.675795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:54.675798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2032
2025-09-30T14:55:54.675828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2032
2025-09-30T14:55:54.675801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:54.675949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:54.675963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:54.675995Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77e63640-3c0fde08-520c33dd-6e68488e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:54.676004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:54.676008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:54.676012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:54.676024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:54.676039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:54.676060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:54.676233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:54.676247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:54.676270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:54.676455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2033 partition: 0 MaxSeqNo: 42 sessionId: src_id|77e63640-3c0fde08-520c33dd-6e68488e_0
2025-09-30T14:55:54.676851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b0d37a-64091855-1f860f19-ea03ca47_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|77e63640-3c0fde08-520c33dd-6e68488e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:54.679781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77e63640-3c0fde08-520c33dd-6e68488e_0] Write session: try to update token
2025-09-30T14:55:54.679799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77e63640-3c0fde08-520c33dd-6e68488e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:54.689323Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:54.689346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:54.689348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:54.689351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:54.689360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896109036600300:3920]
2025-09-30T14:55:54.689364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896109036600300:3920]
2025-09-30T14:55:54.689368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896109036600300:3920]
2025-09-30T14:55:54.689406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:54.689412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.689414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:54.689418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:54.689425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:54.689429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:54.689580Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:54.695932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2033 sessionId: src_id|77e63640-3c0fde08-520c33dd-6e68488e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:54.698778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:54.753309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896109126370971:5488]
2025-09-30T14:55:54.753619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2032, pipe: [1:7555896109126370971:5488]
2025-09-30T14:55:54.801371Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:54.801775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:54.801793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:54.801836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896109126370971:5488], now have 1 active actors on pipe
2025-09-30T14:55:54.802067Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:54.802443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77e63640-3c0fde08-520c33dd-6e68488e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:54.802454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77e63640-3c0fde08-520c33dd-6e68488e_0] Write session will restart in 0.008274s
2025-09-30T14:55:54.802071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:54.802476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77e63640-3c0fde08-520c33dd-6e68488e_0] Write session: Do CDS request
2025-09-30T14:55:54.802483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77e63640-3c0fde08-520c33dd-6e68488e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:54.802075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896109126370971:5488]
2025-09-30T14:55:54.802084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:54.802096Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:54.802151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2033 reason: error at write: Disconnected sessionId: src_id|77e63640-3c0fde08-520c33dd-6e68488e_0
2025-09-30T14:55:54.802323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2033 sessionId: src_id|77e63640-3c0fde08-520c33dd-6e68488e_0 is DEAD
2025-09-30T14:55:54.811766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77e63640-3c0fde08-520c33dd-6e68488e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:54.811860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:54.811879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2034
2025-09-30T14:55:54.812052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2034 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:54.812084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2034 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:54.812096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2034 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:54.812100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:54.812588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2034 sessionId:  describe result for acl check
2025-09-30T14:55:54.812631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:54.812638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:54.812641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:54.812647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896109126371051:5236] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:54.813261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896109126371051:5236] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:54.814160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:54.815800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896109126371051:5236] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:54.816553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:54.816873Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:54.816883Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:54.816895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:54.816963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:54.817006Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896109036600435:3918]
2025-09-30T14:55:54.817701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:54.818008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:54.818169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:54.818508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896109126371051:5236] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:54.818527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:54.818521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896109126371051:5236] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:54.818523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896109126371051:5236] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:54.818530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2034 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:54.818597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:54.818603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:54.818604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:54.818605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:54.818607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:54.818608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:54.818610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:54.818611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:54.818612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:54.818614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:54.818615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.818616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.818618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.818619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:54.818620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:54.818626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:54.818636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:54.818641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:54.818645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:54.818649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:54.818654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:54.818658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:54.818662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:54.818666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:54.818670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:54.818674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.818677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.818680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.818683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:54.818687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:54.818694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:54.818713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:54.818719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:54.818730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:54.818735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:54.818742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:54.818750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:54.818756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:54.818763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:54.818768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:54.818772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:54.818776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:54.818780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:54.818785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:54.818792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:54.818798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:54.818808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:54.818813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:54.818818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:54.818824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:54.818828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.818836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.818841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.818846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.818863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.818872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.818876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:54.818881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:54.818885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:54.818895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:54.818941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:54.824565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:54.825571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:54.825588Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:54.825592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:54.825596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:54.825603Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2033 [2:7555896109036600435:3918]
2025-09-30T14:55:54.825621Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:54.825639Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:54.825642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:54.825646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:54.825649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:54.825666Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:54.825674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:54.825681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:54.825748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.825758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.825760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.825764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:54.825768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:54.825837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:54.825846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.825859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.825875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.825897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:54.825920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896109126370972:2454], now have 1 active actors on pipe
2025-09-30T14:55:54.825928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896109126371091:5236], now have 1 active actors on pipe
2025-09-30T14:55:54.825935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896109036600430:3918]
2025-09-30T14:55:54.825941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896109036600430:3918]
2025-09-30T14:55:54.825943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896109036600430:3918]
2025-09-30T14:55:54.825958Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:54.825976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:54.825969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2033
2025-09-30T14:55:54.825979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:54.825995Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2033
2025-09-30T14:55:54.825983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:54.825985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:54.825998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:54.826001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:54.826048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:54.826052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:54.826068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896109036600430:3918]
2025-09-30T14:55:54.826077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:54.826106Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bed566c1-4012077-cf3d97ba-48d18944_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:54.826109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:54.826115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:54.826160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:54.826166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:54.826174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:54.826181Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:54.826200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:54.826399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:54.826411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:54.826427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:54.826541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2034 partition: 0 MaxSeqNo: 42 sessionId: src_id|bed566c1-4012077-cf3d97ba-48d18944_0
2025-09-30T14:55:54.826896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77e63640-3c0fde08-520c33dd-6e68488e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bed566c1-4012077-cf3d97ba-48d18944_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:54.829678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bed566c1-4012077-cf3d97ba-48d18944_0] Write session: try to update token
2025-09-30T14:55:54.829698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bed566c1-4012077-cf3d97ba-48d18944_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:54.842058Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:54.842077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:54.842079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:54.842081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:54.842091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896109036600430:3918]
2025-09-30T14:55:54.842096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896109036600430:3918]
2025-09-30T14:55:54.842101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896109036600430:3918]
2025-09-30T14:55:54.842142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:54.842156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.842158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:54.842163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:54.842165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:54.842170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:54.842307Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:54.844416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2034 sessionId: src_id|bed566c1-4012077-cf3d97ba-48d18944_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:54.847231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:54.902202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896109126371113:5488]
2025-09-30T14:55:54.902446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2033, pipe: [1:7555896109126371113:5488]
2025-09-30T14:55:54.967040Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:54.967391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:54.967408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:54.967446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896109126371113:5488], now have 1 active actors on pipe
2025-09-30T14:55:54.967681Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:54.967698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896109126371113:5488]
2025-09-30T14:55:54.967700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:54.967733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:54.967828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2034 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bed566c1-4012077-cf3d97ba-48d18944_0
2025-09-30T14:55:54.968007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2034 sessionId: src_id|bed566c1-4012077-cf3d97ba-48d18944_0 is DEAD
2025-09-30T14:55:54.968185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bed566c1-4012077-cf3d97ba-48d18944_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:54.968195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bed566c1-4012077-cf3d97ba-48d18944_0] Write session will restart in 0.007721s
2025-09-30T14:55:54.968219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bed566c1-4012077-cf3d97ba-48d18944_0] Write session: Do CDS request
2025-09-30T14:55:54.968224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bed566c1-4012077-cf3d97ba-48d18944_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:54.976780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bed566c1-4012077-cf3d97ba-48d18944_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:54.976874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:54.976890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2035
2025-09-30T14:55:54.977031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2035 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:54.977070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2035 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:54.977075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2035 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:54.977081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:54.977511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2035 sessionId:  describe result for acl check
2025-09-30T14:55:54.977553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:54.977555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:54.977557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:54.977564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896109126371186:5232] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:54.978125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896109126371186:5232] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:54.979597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:54.980500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896109126371186:5232] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:54.981602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:54.981926Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:54.981936Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:54.981948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:54.982012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:54.982050Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896109036600557:3915]
2025-09-30T14:55:54.982701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:54.983002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:54.983083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:54.983303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896109126371186:5232] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:54.983320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896109126371186:5232] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:54.983324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896109126371186:5232] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:54.983333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2035 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:54.983470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:54.983554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:54.983563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:54.983564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:54.983566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:54.983567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:54.983568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:54.983570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:54.983571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:54.983572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:54.983574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:54.983575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.983576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.983578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.983579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:54.983580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:54.983588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:54.983598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:54.983602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:54.983606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:54.983610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:54.983614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:54.983620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:54.983624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:54.983629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:54.983633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:54.983637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.983641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.983645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.983648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:54.983652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:54.983659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:54.983667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:54.983674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:54.983680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:54.983684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:54.983690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:54.983695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:54.983700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:54.983706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:54.983711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:54.983715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:54.983720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:54.983725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:54.983730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:54.983734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:54.983739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:54.983746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:54.983764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:54.983773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:54.983778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:54.983782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.983787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.983791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.983795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.983800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.983804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.983808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:54.983813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:54.983817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:54.983822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:54.983865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:54.989517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:54.990548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:54.990567Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:54.990570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:54.990574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:54.990581Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2034 [2:7555896109036600557:3915]
2025-09-30T14:55:54.990598Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:54.990616Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:54.990620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:54.990624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:54.990626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:54.990643Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:54.990658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:54.990665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:54.990728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.990736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.990739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.990742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:54.990745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:54.990820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:54.990826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:54.990840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:54.990855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:54.990870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:54.990895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896109126371117:2454], now have 1 active actors on pipe
2025-09-30T14:55:54.990904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896109126371234:5232], now have 1 active actors on pipe
2025-09-30T14:55:54.990910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896109036600551:3915]
2025-09-30T14:55:54.990912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896109036600551:3915]
2025-09-30T14:55:54.990915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896109036600551:3915]
2025-09-30T14:55:54.990931Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:54.990975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2034
2025-09-30T14:55:54.990952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:54.990982Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2034
2025-09-30T14:55:54.990967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:54.990970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:54.990999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:54.991003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:54.991005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:54.991009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896109036600551:3915]
2025-09-30T14:55:54.991013Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:54.991028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:54.991052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:54.991057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:54.991096Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93f305c1-90eae12-134abfbf-76cb3275_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:54.991109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:54.991112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:54.991116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:54.991129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:54.991143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:54.991162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:54.991354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:54.991363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:54.991380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:54.991480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2035 partition: 0 MaxSeqNo: 42 sessionId: src_id|93f305c1-90eae12-134abfbf-76cb3275_0
2025-09-30T14:55:54.991888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bed566c1-4012077-cf3d97ba-48d18944_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|93f305c1-90eae12-134abfbf-76cb3275_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:54.994831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93f305c1-90eae12-134abfbf-76cb3275_0] Write session: try to update token
2025-09-30T14:55:54.994853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93f305c1-90eae12-134abfbf-76cb3275_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:55.005788Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:55.005814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:55.005817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:55.005819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:55.005829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896109036600551:3915]
2025-09-30T14:55:55.005834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896109036600551:3915]
2025-09-30T14:55:55.005839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896109036600551:3915]
2025-09-30T14:55:55.005883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:55.005890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.005891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:55.005894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:55.005899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:55.005904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:55.006057Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:55.011238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2035 sessionId: src_id|93f305c1-90eae12-134abfbf-76cb3275_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:55.014257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:55.068136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896113421338540:5488]
2025-09-30T14:55:55.069561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2034, pipe: [1:7555896113421338540:5488]
2025-09-30T14:55:55.126619Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:55.127010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:55.127029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:55.127068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896113421338540:5488], now have 1 active actors on pipe
2025-09-30T14:55:55.127539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896113421338540:5488]
2025-09-30T14:55:55.127550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:55.127575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:55.127668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2035 reason: status is not ok: tablet will be restarted right now sessionId: src_id|93f305c1-90eae12-134abfbf-76cb3275_0
2025-09-30T14:55:55.127890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2035 sessionId: src_id|93f305c1-90eae12-134abfbf-76cb3275_0 is DEAD
2025-09-30T14:55:55.128476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93f305c1-90eae12-134abfbf-76cb3275_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:55.128486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93f305c1-90eae12-134abfbf-76cb3275_0] Write session will restart in 0.009052s
2025-09-30T14:55:55.128513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93f305c1-90eae12-134abfbf-76cb3275_0] Write session: Do CDS request
2025-09-30T14:55:55.128519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93f305c1-90eae12-134abfbf-76cb3275_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:55.127307Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:55.138838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93f305c1-90eae12-134abfbf-76cb3275_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:55.138892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:55.138909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2036
2025-09-30T14:55:55.139099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2036 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:55.139134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2036 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:55.139143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2036 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:55.139147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:55.139577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2036 sessionId:  describe result for acl check
2025-09-30T14:55:55.139620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:55.139622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:55.139624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:55.139630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896113421338624:5223] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:55.140171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896113421338624:5223] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:55.140238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:55.142236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896113421338624:5223] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:55.142319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:55.142522Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:55.142533Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:55.142543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:55.142598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:55.142639Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896113331567974:3909]
2025-09-30T14:55:55.143345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:55.143662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:55.143715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:55.144066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:55.144135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:55.144143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:55.144144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:55.144145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:55.144147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:55.144148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:55.144149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:55.144151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:55.144152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:55.144153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:55.144155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.144156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:55.144157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:55.144158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:55.144159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:55.144165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:55.144177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:55.144182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:55.144187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:55.144191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:55.144195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:55.144200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:55.144204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:55.144208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:55.144212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:55.144216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.144220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:55.144225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:55.144229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:55.144234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:55.144242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:55.144256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:55.144268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:55.144274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:55.144280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:55.144287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:55.144291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:55.144297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:55.144306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:55.144313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:55.144323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:55.144328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:55.144337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:55.144342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:55.144355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:55.144360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:55.144366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:55.144372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:55.144376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:55.144382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:55.144388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.144394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.144404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:55.144410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:55.144420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:55.144425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:55.144435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:55.144440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:55.144449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:55.144455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:55.144508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:55.145123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896113421338624:5223] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:55.145136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896113421338624:5223] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:55.145140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896113421338624:5223] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:55.145148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2036 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:55.149943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:55.150923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:55.150942Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:55.150946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:55.150952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:55.150959Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2035 [2:7555896113331567974:3909]
2025-09-30T14:55:55.150977Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:55.150992Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:55.150995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:55.150999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:55.151001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:55.151016Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:55.151032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:55.151039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:55.151108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.151120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:55.151122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:55.151126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:55.151129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:55.151195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:55.151202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.151216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:55.151236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:55.151277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:55.151303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896113421338667:5223], now have 1 active actors on pipe
2025-09-30T14:55:55.151311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896113421338542:2454], now have 1 active actors on pipe
2025-09-30T14:55:55.151317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896113331567969:3909]
2025-09-30T14:55:55.151324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896113331567969:3909]
2025-09-30T14:55:55.151327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896113331567969:3909]
2025-09-30T14:55:55.151343Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:55.151358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:55.151360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:55.151369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:55.151371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:55.151376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:55.151379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:55.151360Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2035
2025-09-30T14:55:55.151377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2035
2025-09-30T14:55:55.151412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896113331567969:3909]
2025-09-30T14:55:55.151423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:55.151425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:55.151443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:55.151452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:55.151493Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad956f91-529d0682-6cbc85e4-f2c80620_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:55.151504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:55.151507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:55.151509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:55.151521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:55.151534Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:55.151552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:55.151730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:55.151737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:55.151750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:55.151901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2036 partition: 0 MaxSeqNo: 42 sessionId: src_id|ad956f91-529d0682-6cbc85e4-f2c80620_0
2025-09-30T14:55:55.152264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93f305c1-90eae12-134abfbf-76cb3275_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ad956f91-529d0682-6cbc85e4-f2c80620_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:55.155153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad956f91-529d0682-6cbc85e4-f2c80620_0] Write session: try to update token
2025-09-30T14:55:55.155172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad956f91-529d0682-6cbc85e4-f2c80620_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:55.164421Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:55.164446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:55.164449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:55.164451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:55.164461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896113331567969:3909]
2025-09-30T14:55:55.164466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896113331567969:3909]
2025-09-30T14:55:55.164473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896113331567969:3909]
2025-09-30T14:55:55.164516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:55.164522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.164526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:55.164528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:55.164536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:55.164540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:55.164678Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:55.176037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2036 sessionId: src_id|ad956f91-529d0682-6cbc85e4-f2c80620_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:55.178965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:55.227843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896113421338678:5488]
2025-09-30T14:55:55.228099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2035, pipe: [1:7555896113421338678:5488]
2025-09-30T14:55:55.277939Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:55.278385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:55.278409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:55.278432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896113421338678:5488], now have 1 active actors on pipe
2025-09-30T14:55:55.278736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:55.278754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:55.278772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896113421338678:5488]
2025-09-30T14:55:55.278801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:55.278823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2036 reason: error at write: Disconnected sessionId: src_id|ad956f91-529d0682-6cbc85e4-f2c80620_0
2025-09-30T14:55:55.279160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad956f91-529d0682-6cbc85e4-f2c80620_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:55.279174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad956f91-529d0682-6cbc85e4-f2c80620_0] Write session will restart in 0.005109s
2025-09-30T14:55:55.279198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad956f91-529d0682-6cbc85e4-f2c80620_0] Write session: Do CDS request
2025-09-30T14:55:55.279205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad956f91-529d0682-6cbc85e4-f2c80620_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:55.278709Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:55.279013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2036 sessionId: src_id|ad956f91-529d0682-6cbc85e4-f2c80620_0 is DEAD
2025-09-30T14:55:55.285882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad956f91-529d0682-6cbc85e4-f2c80620_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:55.287702Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:55.287722Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2037
2025-09-30T14:55:55.291492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2037 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:55.291548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2037 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:55.291553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2037 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:55.291558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:55.295689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2037 sessionId:  describe result for acl check
2025-09-30T14:55:55.295741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:55.295744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:55.295746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:55.295755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896113421338718:5222] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:55.296312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896113421338718:5222] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:55.301256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896113421338718:5222] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:55.304857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:55.306596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896113421338718:5222] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:55.306612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896113421338718:5222] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:55.306616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896113421338718:5222] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:55.306625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2037 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:55.308868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:55.309156Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:55.309167Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:55.309179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:55.309242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:55.309285Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896113331568097:3913]
2025-09-30T14:55:55.309964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:55.310299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:55.310351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:55.310710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:55.310781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:55.310783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:55.310785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:55.310786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:55.310788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:55.310790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:55.310791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:55.310792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:55.310794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:55.310795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:55.310796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.310797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:55.310798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:55.310800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:55.310801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:55.310807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:55.310818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:55.310823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:55.310827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:55.310832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:55.310836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:55.310840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:55.310844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:55.310848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:55.310853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:55.310857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.310861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:55.310865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:55.310869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:55.310873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:55.310882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:55.310891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:55.310897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:55.310904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:55.310909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:55.310917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:55.310921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:55.310927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:55.310932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:55.310938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:55.310943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:55.310948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:55.310954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:55.310959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:55.310964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:55.310970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:55.310975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:55.310980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:55.310984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:55.310990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:55.310995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.311001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.311030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:55.311036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:55.311042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:55.311047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:55.311052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:55.311058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:55.311063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:55.311068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:55.311116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:55.318402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:55.319358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:55.319365Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:55.319369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:55.319373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:55.319380Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2036 [2:7555896113331568097:3913]
2025-09-30T14:55:55.319399Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:55.319416Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:55.319420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:55.319424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:55.319426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:55.319442Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:55.319449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:55.319457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:55.319520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.319523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:55.319525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:55.319528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:55.319531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:55.319609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:55.319612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.319628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:55.319641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:55.319657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:55.319676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896113331568090:3913]
2025-09-30T14:55:55.319679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896113331568090:3913]
2025-09-30T14:55:55.319682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896113331568090:3913]
2025-09-30T14:55:55.319690Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:55.319702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:55.319706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:55.319708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:55.319708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:55.319724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:55.319727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:55.319738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896113421338801:5222], now have 1 active actors on pipe
2025-09-30T14:55:55.319743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896113421338682:2454], now have 1 active actors on pipe
2025-09-30T14:55:55.319778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896113331568090:3913]
2025-09-30T14:55:55.319790Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:55.320034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2036
2025-09-30T14:55:55.320089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2036
2025-09-30T14:55:55.320208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:55.320736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:55.320746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:55.320772Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5402c0ec-4b8a755c-7eb97ac1-c0eb410e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:55.320781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:55.320784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:55.320787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:55.320799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:55.320823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:55.320841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:55.321247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:55.321260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:55.321281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:55.321452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2037 partition: 0 MaxSeqNo: 42 sessionId: src_id|5402c0ec-4b8a755c-7eb97ac1-c0eb410e_0
2025-09-30T14:55:55.321938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad956f91-529d0682-6cbc85e4-f2c80620_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5402c0ec-4b8a755c-7eb97ac1-c0eb410e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:55.324876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5402c0ec-4b8a755c-7eb97ac1-c0eb410e_0] Write session: try to update token
2025-09-30T14:55:55.324896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5402c0ec-4b8a755c-7eb97ac1-c0eb410e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:55.337700Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:55.337724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:55.337727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:55.337735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:55.337744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896113331568090:3913]
2025-09-30T14:55:55.337748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896113331568090:3913]
2025-09-30T14:55:55.337752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896113331568090:3913]
2025-09-30T14:55:55.337793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:55.337800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.337803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:55.337947Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:55.340555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:55.340570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:55.340574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:55.352796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2037 sessionId: src_id|5402c0ec-4b8a755c-7eb97ac1-c0eb410e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:55.355612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:55.378828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896113421338827:5488]
2025-09-30T14:55:55.379122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2036, pipe: [1:7555896113421338827:5488]
2025-09-30T14:55:55.468170Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:55.468591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:55.468606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:55.468627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896113421338827:5488], now have 1 active actors on pipe
2025-09-30T14:55:55.468871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896113421338827:5488]
2025-09-30T14:55:55.468885Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:55.468875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:55.468882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:55.468903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:55.468945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2037 reason: error at write: Disconnected sessionId: src_id|5402c0ec-4b8a755c-7eb97ac1-c0eb410e_0
2025-09-30T14:55:55.469138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2037 sessionId: src_id|5402c0ec-4b8a755c-7eb97ac1-c0eb410e_0 is DEAD
2025-09-30T14:55:55.469503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5402c0ec-4b8a755c-7eb97ac1-c0eb410e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:55.469514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5402c0ec-4b8a755c-7eb97ac1-c0eb410e_0] Write session will restart in 0.009426s
2025-09-30T14:55:55.469539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5402c0ec-4b8a755c-7eb97ac1-c0eb410e_0] Write session: Do CDS request
2025-09-30T14:55:55.469547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5402c0ec-4b8a755c-7eb97ac1-c0eb410e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:55.479785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5402c0ec-4b8a755c-7eb97ac1-c0eb410e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:55.479962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:55.479982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2038
2025-09-30T14:55:55.480126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2038 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:55.480163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2038 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:55.480174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2038 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:55.480178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:55.480414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:55.480581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2038 sessionId:  describe result for acl check
2025-09-30T14:55:55.480618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:55.480624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:55.480626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:55.480632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896113421338923:5205] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:55.481266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896113421338923:5205] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:55.482575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:55.482772Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:55.482783Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:55.482795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:55.482849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:55.482889Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896113331568258:3888]
2025-09-30T14:55:55.483478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:55.483734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896113421338923:5205] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:55.483765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:55.483822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:55.484155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:55.484220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:55.484226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:55.484227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:55.484228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:55.484230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:55.484231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:55.484232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:55.484233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:55.484234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:55.484235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:55.484236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.484238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:55.484239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:55.484240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:55.484241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:55.484246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:55.484257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:55.484262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:55.484266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:55.484270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:55.484274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:55.484278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:55.484282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:55.484286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:55.484290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:55.484294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.484299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:55.484303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:55.484307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:55.484311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:55.484319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:55.484327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:55.484333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:55.484339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:55.484344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:55.484349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:55.484353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:55.484359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:55.484364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:55.484370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:55.484374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:55.484380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:55.484387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:55.484392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:55.484397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:55.484402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:55.484406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:55.484412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:55.484417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:55.484422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:55.484427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.484431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.484434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:55.484437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:55.484439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:55.484442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:55.484445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:55.484448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:55.484450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:55.484453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:55.484479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:55.489821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:55.489896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896113421338923:5205] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:55.489912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896113421338923:5205] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:55.489915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896113421338923:5205] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:55.489922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2038 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:55.491167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:55.491192Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:55.491198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:55.491202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:55.491209Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2037 [2:7555896113331568258:3888]
2025-09-30T14:55:55.491225Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:55.491267Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:55.491270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:55.491274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:55.491276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:55.491292Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:55.491298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:55.491305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:55.491401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.491414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:55.491417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:55.491421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:55.491424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:55.491501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:55.491510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.491523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:55.491534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:55.491549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:55.491567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896113421338963:5205], now have 1 active actors on pipe
2025-09-30T14:55:55.491575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896113421338838:2454], now have 1 active actors on pipe
2025-09-30T14:55:55.491583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896113331568252:3888]
2025-09-30T14:55:55.491593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896113331568252:3888]
2025-09-30T14:55:55.491596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896113331568252:3888]
2025-09-30T14:55:55.491619Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:55.491639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:55.491650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:55.491650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:55.491653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:55.491670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:55.491684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:55.491644Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2037
2025-09-30T14:55:55.491646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2037
2025-09-30T14:55:55.491748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:55.491763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:55.491779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896113331568252:3888]
2025-09-30T14:55:55.491792Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:55.491797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:55.491842Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45f4a993-ccc6fed5-d421c29a-fa0aef6f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:55.491854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:55.491863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:55.491866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:55.491876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:55.491891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:55.491922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:55.492144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:55.492161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:55.492194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:55.492278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2038 partition: 0 MaxSeqNo: 42 sessionId: src_id|45f4a993-ccc6fed5-d421c29a-fa0aef6f_0
2025-09-30T14:55:55.492671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5402c0ec-4b8a755c-7eb97ac1-c0eb410e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|45f4a993-ccc6fed5-d421c29a-fa0aef6f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:55.495539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45f4a993-ccc6fed5-d421c29a-fa0aef6f_0] Write session: try to update token
2025-09-30T14:55:55.495556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45f4a993-ccc6fed5-d421c29a-fa0aef6f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:55.504563Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:55.504585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:55.504588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:55.504590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:55.504603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896113331568252:3888]
2025-09-30T14:55:55.504608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896113331568252:3888]
2025-09-30T14:55:55.504613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896113331568252:3888]
2025-09-30T14:55:55.504654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:55.504661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.504660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:55.504663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:55.504666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:55.504669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:55.504801Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:55.513048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2038 sessionId: src_id|45f4a993-ccc6fed5-d421c29a-fa0aef6f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:55.516034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:55.568835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896113421338971:5488]
2025-09-30T14:55:55.569082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2037, pipe: [1:7555896113421338971:5488]
2025-09-30T14:55:55.621044Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:55.621554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:55.621571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:55.621592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896113421338971:5488], now have 1 active actors on pipe
2025-09-30T14:55:55.621856Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:55.621836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:55.621861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:55.621866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:55.621907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896113421338971:5488]
2025-09-30T14:55:55.621940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2038 reason: error at write: Disconnected sessionId: src_id|45f4a993-ccc6fed5-d421c29a-fa0aef6f_0
2025-09-30T14:55:55.622169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2038 sessionId: src_id|45f4a993-ccc6fed5-d421c29a-fa0aef6f_0 is DEAD
2025-09-30T14:55:55.622356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45f4a993-ccc6fed5-d421c29a-fa0aef6f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:55.622365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45f4a993-ccc6fed5-d421c29a-fa0aef6f_0] Write session will restart in 0.006259s
2025-09-30T14:55:55.622389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45f4a993-ccc6fed5-d421c29a-fa0aef6f_0] Write session: Do CDS request
2025-09-30T14:55:55.622397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45f4a993-ccc6fed5-d421c29a-fa0aef6f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:55.629784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45f4a993-ccc6fed5-d421c29a-fa0aef6f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:55.629903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:55.629921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2039
2025-09-30T14:55:55.630095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2039 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:55.630144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2039 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:55.630155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2039 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:55.630160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:55.630714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2039 sessionId:  describe result for acl check
2025-09-30T14:55:55.630752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:55.630761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:55.630763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:55.630769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896113421338999:5198] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:55.631321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896113421338999:5198] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:55.633875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896113421338999:5198] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:55.634378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:55.636350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:55.636548Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:55.636562Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:55.636572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:55.636626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:55.636663Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896113331568383:3886]
2025-09-30T14:55:55.636732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896113421338999:5198] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:55.636749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896113421338999:5198] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:55.636752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896113421338999:5198] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:55.636761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2039 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:55.637302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:55.637652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:55.637709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:55.638044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:55.638127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:55.638135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:55.638136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:55.638137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:55.638138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:55.638140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:55.638141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:55.638142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:55.638144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:55.638145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:55.638146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.638148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:55.638149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:55.638150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:55.638151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:55.638158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:55.638170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:55.638174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:55.638178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:55.638182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:55.638186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:55.638190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:55.638194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:55.638198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:55.638202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:55.638207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.638210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:55.638214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:55.638218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:55.638223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:55.638231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:55.638241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:55.638247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:55.638254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:55.638259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:55.638265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:55.638275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:55.638282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:55.638286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:55.638292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:55.638297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:55.638302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:55.638308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:55.638314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:55.638318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:55.638323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:55.638334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:55.638340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:55.638350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:55.638355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:55.638365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.638371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.638376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:55.638382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:55.638387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:55.638392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:55.638396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:55.638403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:55.638408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:55.638414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:55.638466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:55.644109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:55.645196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:55.645214Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:55.645216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:55.645220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:55.645227Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2038 [2:7555896113331568383:3886]
2025-09-30T14:55:55.645247Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:55.645265Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:55.645278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:55.645281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:55.645284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:55.645300Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:55.645306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:55.645313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:55.645376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.645379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:55.645382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:55.645385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:55.645389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:55.645454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:55.645475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.645489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:55.645514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:55.645537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:55.645558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896113421338972:2454], now have 1 active actors on pipe
2025-09-30T14:55:55.645566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896113421339094:5198], now have 1 active actors on pipe
2025-09-30T14:55:55.645573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896113331568378:3886]
2025-09-30T14:55:55.645575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896113331568378:3886]
2025-09-30T14:55:55.645577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896113331568378:3886]
2025-09-30T14:55:55.645588Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:55.645598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:55.645600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:55.645602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:55.645605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:55.645619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:55.645622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:55.645657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896113331568378:3886]
2025-09-30T14:55:55.645670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:55.645699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:55.645670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2038
2025-09-30T14:55:55.645682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2038
2025-09-30T14:55:55.645732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:55.645742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:55.645766Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71521426-bd5fdcba-7ce203e6-c8d06df6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:55.645777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:55.645781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:55.645787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:55.645797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:55.645810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:55.645824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:55.645954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:55.645964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:55.645978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:55.646073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2039 partition: 0 MaxSeqNo: 42 sessionId: src_id|71521426-bd5fdcba-7ce203e6-c8d06df6_0
2025-09-30T14:55:55.646477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45f4a993-ccc6fed5-d421c29a-fa0aef6f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|71521426-bd5fdcba-7ce203e6-c8d06df6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:55.649313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71521426-bd5fdcba-7ce203e6-c8d06df6_0] Write session: try to update token
2025-09-30T14:55:55.649344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71521426-bd5fdcba-7ce203e6-c8d06df6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:55.659215Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:55.659237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:55.659265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896113331568378:3886]
2025-09-30T14:55:55.659323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:55.659331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:55.659588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:55.659776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:55.659991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:55.660181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:55.660459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:55.660508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:55.665638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2039 sessionId: src_id|71521426-bd5fdcba-7ce203e6-c8d06df6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:55.668483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:55.668774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:55.668801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:55.668850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:55.668927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:55.670169Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:55.670186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:55.670189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:55.670191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:55.670201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896113331568378:3886]
2025-09-30T14:55:55.670205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896113331568378:3886]
2025-09-30T14:55:55.670210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896113331568378:3886]
2025-09-30T14:55:55.670247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:55.670249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:55.670254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.670256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:55.670257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:55.670260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:55.670392Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:55.721938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896113421339108:5488]
2025-09-30T14:55:55.722342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2038, pipe: [1:7555896113421339108:5488]
2025-09-30T14:55:55.784263Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:55.792876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:55.792911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:55.793096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:55.793168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:55.793242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:55.793341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:55.793394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:55.793404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:55.793493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:55.793565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:55.793641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:55.793717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:55.793765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:55.793774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:55.793846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:55.793916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:55.793986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:55.794056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:55.794103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:55.794113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:55.794186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:55.794263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:55.794338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:55.794408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:55.794456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:55.794459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:55.794532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:55.794603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:55.794671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:55.794747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:55.794796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:55.794804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:55.794876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:55.794944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:55.795007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:55.795083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:55.795132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:55.795142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:55.795214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:55.795302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:55.795371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:55.795448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:55.795496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:55.795506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:55.795580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:55.795649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:55.795723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:55.795791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:55.795840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:55.795843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:55.795918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:55.795984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:55.796053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:55.796122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:55.796243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:55.796254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:55.796330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:55.796401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:55.796470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:55.796537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:55.796583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:55.796593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:55.796667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896113421339108:5488], now have 1 active actors on pipe
2025-09-30T14:55:55.797050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896113421339108:5488]
2025-09-30T14:55:55.797056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:55.797090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:55.797092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:55.797123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2039 reason: error at write: Disconnected sessionId: src_id|71521426-bd5fdcba-7ce203e6-c8d06df6_0
2025-09-30T14:55:55.797299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2039 sessionId: src_id|71521426-bd5fdcba-7ce203e6-c8d06df6_0 is DEAD
2025-09-30T14:55:55.797455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71521426-bd5fdcba-7ce203e6-c8d06df6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:55.797495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71521426-bd5fdcba-7ce203e6-c8d06df6_0] Write session will restart in 0.008905s
2025-09-30T14:55:55.797520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71521426-bd5fdcba-7ce203e6-c8d06df6_0] Write session: Do CDS request
2025-09-30T14:55:55.797526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71521426-bd5fdcba-7ce203e6-c8d06df6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:55.797954Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:55.807841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71521426-bd5fdcba-7ce203e6-c8d06df6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:55.807972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:55.807992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2040
2025-09-30T14:55:55.808140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2040 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:55.808186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2040 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:55.808198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2040 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:55.808203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:55.808649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2040 sessionId:  describe result for acl check
2025-09-30T14:55:55.808686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:55.808693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:55.808695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:55.808702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896113421339197:5190] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:55.808899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:55.809263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896113421339197:5190] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:55.811223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:55.811454Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:55.811467Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:55.811480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:55.811568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:55.811610Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896113331568521:3884]
2025-09-30T14:55:55.812109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896113421339197:5190] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:55.812232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:55.812558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:55.812601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:55.812909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:55.812988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:55.812993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:55.812994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:55.812995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:55.812996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:55.812997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:55.812997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:55.812998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:55.812999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:55.813000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:55.813001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.813002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:55.813002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:55.813003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:55.813004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:55.813008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:55.813014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:55.813016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:55.813019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:55.813021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:55.813024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:55.813026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:55.813029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:55.813031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:55.813034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:55.813036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.813039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:55.813041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:55.813043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:55.813046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:55.813051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:55.813057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:55.813061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:55.813065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:55.813068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:55.813071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:55.813074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:55.813077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:55.813080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:55.813083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:55.813088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:55.813091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:55.813094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:55.813097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:55.813100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:55.813103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:55.813106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:55.813109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:55.813112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:55.813115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:55.813118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.813126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.813129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:55.813131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:55.813134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:55.813141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:55.813144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:55.813147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:55.813149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:55.813154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:55.813183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:55.818424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896113421339197:5190] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:55.818445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896113421339197:5190] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:55.818449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896113421339197:5190] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:55.818458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2040 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:55.818701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:55.819686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:55.819703Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:55.819706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:55.819710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:55.819717Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2039 [2:7555896113331568521:3884]
2025-09-30T14:55:55.819736Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:55.819754Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:55.819757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:55.819761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:55.819764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:55.819780Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:55.819787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:55.819793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:55.819858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.819864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:55.819866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:55.819871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:55.819874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:55.819943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:55.819952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.819965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:55.819975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:55.819993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:55.820009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896113331568515:3884]
2025-09-30T14:55:55.820012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896113331568515:3884]
2025-09-30T14:55:55.820014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896113331568515:3884]
2025-09-30T14:55:55.820027Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:55.820049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:55.820063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:55.820067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:55.820081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:55.820085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:55.820087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:55.820098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896113331568515:3884]
2025-09-30T14:55:55.820102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:55.820148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:55.820191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896113421339237:5190], now have 1 active actors on pipe
2025-09-30T14:55:55.820200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896113421339109:2454], now have 1 active actors on pipe
2025-09-30T14:55:55.820500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:55.820512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:55.820536Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f59040c0-772e1f00-1e366c45-f2968cb3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:55.820552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:55.820560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:55.820563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:55.820574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:55.820590Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:55.820293Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2039
2025-09-30T14:55:55.820608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:55.820377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2039
2025-09-30T14:55:55.820806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:55.820816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:55.820834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:55.820955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2040 partition: 0 MaxSeqNo: 42 sessionId: src_id|f59040c0-772e1f00-1e366c45-f2968cb3_0
2025-09-30T14:55:55.821336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71521426-bd5fdcba-7ce203e6-c8d06df6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f59040c0-772e1f00-1e366c45-f2968cb3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:55.824250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f59040c0-772e1f00-1e366c45-f2968cb3_0] Write session: try to update token
2025-09-30T14:55:55.824275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f59040c0-772e1f00-1e366c45-f2968cb3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:55.833788Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:55.833808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:55.833825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896113331568515:3884]
2025-09-30T14:55:55.833874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:55.833882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:55.834091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:55.834242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:55.834387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:55.834540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:55.834742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:55.834792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:55.841672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2040 sessionId: src_id|f59040c0-772e1f00-1e366c45-f2968cb3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:55.844864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:55.845112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:55.845143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:55.845182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:55.845265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:55.849969Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:55.849992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:55.849995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:55.849997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:55.850008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896113331568515:3884]
2025-09-30T14:55:55.850013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896113331568515:3884]
2025-09-30T14:55:55.850021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896113331568515:3884]
2025-09-30T14:55:55.850064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:55.850072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:55.850079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:55.850079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:55.850082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:55.850083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:55.850222Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:55.897028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896113421339257:5488]
2025-09-30T14:55:55.897333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2039, pipe: [1:7555896113421339257:5488]
2025-09-30T14:55:55.979148Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:55.988208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:55.988237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:55.988416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:55.988486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:55.988550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:55.988617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:55.988821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:55.988827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:55.988907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:55.988971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:55.989033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:55.989094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:55.989139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:55.989142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:55.989215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:55.989277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:55.989341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:55.989407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:55.989453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:55.989475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:55.989557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:55.989620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:55.989685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:55.989752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:55.990237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:55.990243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:55.990345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:55.990409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:55.990476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:55.990540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:55.990586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:55.990590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:55.990665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:55.990729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:55.990793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:55.990857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:55.990904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:55.990907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:55.990983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:55.991042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:55.991108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:55.991175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:55.991218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:55.991225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:55.991535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:55.991614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:55.991694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:55.991769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:55.992958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896113421339257:5488]
2025-09-30T14:55:55.993001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:55.993004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:55.993032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2040 reason: error at write: Disconnected sessionId: src_id|f59040c0-772e1f00-1e366c45-f2968cb3_0
2025-09-30T14:55:55.993388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f59040c0-772e1f00-1e366c45-f2968cb3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:55.993408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f59040c0-772e1f00-1e366c45-f2968cb3_0] Write session will restart in 0.005054s
2025-09-30T14:55:55.993431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f59040c0-772e1f00-1e366c45-f2968cb3_0] Write session: Do CDS request
2025-09-30T14:55:55.993437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f59040c0-772e1f00-1e366c45-f2968cb3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:55.993276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2040 sessionId: src_id|f59040c0-772e1f00-1e366c45-f2968cb3_0 is DEAD
2025-09-30T14:55:55.993334Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:55.991894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:55.991907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:55.991984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:55.992049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:55.992116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:55.992186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:55.992232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:55.992235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:55.992310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:55.992374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:55.992442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:55.992512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:55.992561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:55.992565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:55.992646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896113421339257:5488], now have 1 active actors on pipe
2025-09-30T14:55:55.993396Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:55.999745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f59040c0-772e1f00-1e366c45-f2968cb3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:55.999909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:55.999924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2041
2025-09-30T14:55:56.000134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2041 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:56.000165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2041 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:56.000175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2041 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:56.000179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:56.000623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2041 sessionId:  describe result for acl check
2025-09-30T14:55:56.000661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:56.000670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:56.000672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:56.000677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896117716306571:8884] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:56.001193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896117716306571:8884] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:56.004095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896117716306571:8884] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:56.005681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:56.006224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:56.006378Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:56.006388Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:56.006399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:56.006440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:56.006475Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896117626535947:3882]
2025-09-30T14:55:56.007115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:56.007838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:56.007881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:56.008229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:56.008287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:56.008292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:56.008294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:56.008295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:56.008296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:56.008297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:56.008299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:56.008300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:56.008301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:56.008302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:56.008303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.008304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.008305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.008305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:56.008306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:56.008311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:56.008321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:56.008324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:56.008328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:56.008331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:56.008335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:56.008339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:56.008342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:56.008345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:56.008349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:56.008352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.008355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.008359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.008362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:56.008365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:56.008373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:56.008380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:56.008385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:56.008391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:56.008395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:56.008400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:56.008403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:56.008408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:56.008412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:56.008416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:56.008421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:56.008425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:56.008429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:56.008434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:56.008438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:56.008445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:56.008453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:56.008458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:56.008462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:56.008467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:56.008471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.008475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.008482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.008486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.008490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.008495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.008499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:56.008503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:56.008508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:56.008512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:56.008552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:56.011638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896117716306571:8884] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:56.011656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896117716306571:8884] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:56.011660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896117716306571:8884] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:56.011669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2041 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:56.014373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:56.015325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:56.015341Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:56.015344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:56.015348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:56.015355Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2040 [2:7555896117626535947:3882]
2025-09-30T14:55:56.015373Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:56.015393Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:56.015401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:56.015404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:56.015408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:56.015425Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:56.015432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:56.015444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:56.015992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2040
2025-09-30T14:55:56.016029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2040
2025-09-30T14:55:56.015511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.015523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.015525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.015529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:56.015532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:56.015607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:56.015610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.015624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.015638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.015657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:56.015674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896117626535942:3882]
2025-09-30T14:55:56.015677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896117626535942:3882]
2025-09-30T14:55:56.015679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896117626535942:3882]
2025-09-30T14:55:56.015695Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:56.015712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:56.015730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:56.015735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:56.015752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:56.015757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:56.015759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:56.015772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896117626535942:3882]
2025-09-30T14:55:56.015776Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:56.015842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:56.016241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896113421339261:2454], now have 1 active actors on pipe
2025-09-30T14:55:56.016250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896117716306682:8884], now have 1 active actors on pipe
2025-09-30T14:55:56.016265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:56.016270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:56.016299Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be5c0bb9-cc9a02e2-ea36fdf6-40fc11f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:56.016307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:56.016311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:56.016314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:56.016326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:56.016338Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:56.016354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:56.016860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:56.016867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:56.016884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:56.017015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2041 partition: 0 MaxSeqNo: 42 sessionId: src_id|be5c0bb9-cc9a02e2-ea36fdf6-40fc11f4_0
2025-09-30T14:55:56.017433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f59040c0-772e1f00-1e366c45-f2968cb3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|be5c0bb9-cc9a02e2-ea36fdf6-40fc11f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:56.020388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be5c0bb9-cc9a02e2-ea36fdf6-40fc11f4_0] Write session: try to update token
2025-09-30T14:55:56.020413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be5c0bb9-cc9a02e2-ea36fdf6-40fc11f4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:56.031466Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:56.031487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:56.031498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896117626535942:3882]
2025-09-30T14:55:56.031551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:56.031733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:56.031890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:56.032028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:56.032176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:56.032374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:56.032418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:56.032680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:56.040047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2041 sessionId: src_id|be5c0bb9-cc9a02e2-ea36fdf6-40fc11f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:56.042904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:56.043428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:56.043448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:56.044757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:56.044557Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:56.044562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:56.044564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:56.044566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:56.044576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896117626535942:3882]
2025-09-30T14:55:56.044581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896117626535942:3882]
2025-09-30T14:55:56.044585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896117626535942:3882]
2025-09-30T14:55:56.044623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:56.044639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:56.044637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:56.044644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:56.044644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.044646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:56.044647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:56.044773Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:56.093132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896117716306692:5488]
2025-09-30T14:55:56.093498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2040, pipe: [1:7555896117716306692:5488]
2025-09-30T14:55:56.174538Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:56.182283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:56.182315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:56.182494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:56.182564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:56.182629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:56.182692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:56.182742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:56.182753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:56.182820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:56.182886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:56.182944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:56.183270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:56.183319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:56.183330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:56.183398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:56.183454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:56.183512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:56.183577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:56.183863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:56.183873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:56.183939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:56.184000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:56.184062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:56.184130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:56.184174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:56.184180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:56.184251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:56.184311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:56.184379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:56.184451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:56.184500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:56.184508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:56.184582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:56.184649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:56.184718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:56.184786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:56.184839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:56.184848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:56.184921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:56.184984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:56.185048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:56.185108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:56.185154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:56.185162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:56.185230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:56.185293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:56.185355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:56.185422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:56.185485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:56.185492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:56.185555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:56.185617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:56.185686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:56.185753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:56.185802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:56.185811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:56.185878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:56.185945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:56.186018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:56.186092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:56.186141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:56.186151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:56.186225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896117716306692:5488], now have 1 active actors on pipe
2025-09-30T14:55:56.186824Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:56.186955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be5c0bb9-cc9a02e2-ea36fdf6-40fc11f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:56.186967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be5c0bb9-cc9a02e2-ea36fdf6-40fc11f4_0] Write session will restart in 0.008149s
2025-09-30T14:55:56.186993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be5c0bb9-cc9a02e2-ea36fdf6-40fc11f4_0] Write session: Do CDS request
2025-09-30T14:55:56.186998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be5c0bb9-cc9a02e2-ea36fdf6-40fc11f4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:56.186509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896117716306692:5488]
2025-09-30T14:55:56.186531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:56.186536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:56.186546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:56.186568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2041 reason: error at write: Disconnected sessionId: src_id|be5c0bb9-cc9a02e2-ea36fdf6-40fc11f4_0
2025-09-30T14:55:56.187379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2041 sessionId: src_id|be5c0bb9-cc9a02e2-ea36fdf6-40fc11f4_0 is DEAD
2025-09-30T14:55:56.196800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be5c0bb9-cc9a02e2-ea36fdf6-40fc11f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:56.197272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:56.197296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2042
2025-09-30T14:55:56.197474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2042 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:56.197525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2042 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:56.197532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2042 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:56.197538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:56.198043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2042 sessionId:  describe result for acl check
2025-09-30T14:55:56.198093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:56.198103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:56.198105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:56.198111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896117716306789:8886] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:56.198775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896117716306789:8886] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:56.201090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896117716306789:8886] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:56.203976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:56.204319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896117716306789:8886] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:56.204339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896117716306789:8886] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:56.204343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896117716306789:8886] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:56.204352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2042 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:56.206618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:56.206862Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:56.206877Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:56.206889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:56.206946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:56.207003Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896117626536076:3873]
2025-09-30T14:55:56.207755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:56.208114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:56.208172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:56.208531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:56.208597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:56.208604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:56.208606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:56.208607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:56.208609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:56.208610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:56.208612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:56.208613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:56.208614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:56.208616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:56.208618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.208619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.208620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.208622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:56.208624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:56.208630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:56.208643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:56.208649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:56.208654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:56.208659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:56.208664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:56.208669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:56.208674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:56.208679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:56.208685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:56.208689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.208694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.208700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.208705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:56.208709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:56.208719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:56.208728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:56.208740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:56.208747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:56.208758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:56.208764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:56.208769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:56.208776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:56.208782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:56.208792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:56.208797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:56.208808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:56.208829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:56.208840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:56.208845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:56.208852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:56.208862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:56.208868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:56.208879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:56.208885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:56.208894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.208905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.208910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.208917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.208928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.208935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.208945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:56.208952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:56.208962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:56.208968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:56.209029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:56.215162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:56.216148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:56.216168Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:56.216172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:56.216176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:56.216184Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2041 [2:7555896117626536076:3873]
2025-09-30T14:55:56.216204Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:56.216224Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:56.216227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:56.216231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:56.216234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:56.216251Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:56.216267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:56.216279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:56.216351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.216362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.216364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.216368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:56.216371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:56.216454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:56.216464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.216481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.216499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.216521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:56.216551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896117716306826:8886], now have 1 active actors on pipe
2025-09-30T14:55:56.216555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896117716306702:2454], now have 1 active actors on pipe
2025-09-30T14:55:56.216562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896117626536070:3873]
2025-09-30T14:55:56.216564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896117626536070:3873]
2025-09-30T14:55:56.216566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896117626536070:3873]
2025-09-30T14:55:56.216582Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:56.216601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:56.216616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:56.216622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:56.216654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896117626536070:3873]
2025-09-30T14:55:56.216655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2041
2025-09-30T14:55:56.216656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:56.216691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2041
2025-09-30T14:55:56.216672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:56.216676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:56.216679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:56.216686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:56.216968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:56.216979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:56.217007Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14129e0d-bdeff42a-b5682a64-9ddd9cf7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:56.217018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:56.217022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:56.217024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:56.217032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:56.217046Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:56.217411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2042 partition: 0 MaxSeqNo: 42 sessionId: src_id|14129e0d-bdeff42a-b5682a64-9ddd9cf7_0
2025-09-30T14:55:56.217866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be5c0bb9-cc9a02e2-ea36fdf6-40fc11f4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|14129e0d-bdeff42a-b5682a64-9ddd9cf7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:56.217066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:56.217290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:56.217295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:56.217310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:56.220823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14129e0d-bdeff42a-b5682a64-9ddd9cf7_0] Write session: try to update token
2025-09-30T14:55:56.220848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14129e0d-bdeff42a-b5682a64-9ddd9cf7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:56.238127Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:56.238151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:56.238154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:56.238156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:56.238166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896117626536070:3873]
2025-09-30T14:55:56.238171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896117626536070:3873]
2025-09-30T14:55:56.238176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896117626536070:3873]
2025-09-30T14:55:56.238221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:56.238228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.238231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:56.238231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:56.238248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:56.238261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:56.238370Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:56.238646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2042 sessionId: src_id|14129e0d-bdeff42a-b5682a64-9ddd9cf7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:56.241597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:56.286644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896117716306841:5488]
2025-09-30T14:55:56.286949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2041, pipe: [1:7555896117716306841:5488]
2025-09-30T14:55:56.359537Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:56.360065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:56.360085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:56.360128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896117716306841:5488], now have 1 active actors on pipe
2025-09-30T14:55:56.360395Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:56.360468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:56.360481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:56.360488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896117716306841:5488]
2025-09-30T14:55:56.360509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:56.360549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2042 reason: error at write: Disconnected sessionId: src_id|14129e0d-bdeff42a-b5682a64-9ddd9cf7_0
2025-09-30T14:55:56.360737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2042 sessionId: src_id|14129e0d-bdeff42a-b5682a64-9ddd9cf7_0 is DEAD
2025-09-30T14:55:56.360890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14129e0d-bdeff42a-b5682a64-9ddd9cf7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:56.360902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14129e0d-bdeff42a-b5682a64-9ddd9cf7_0] Write session will restart in 0.008310s
2025-09-30T14:55:56.360927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14129e0d-bdeff42a-b5682a64-9ddd9cf7_0] Write session: Do CDS request
2025-09-30T14:55:56.360936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14129e0d-bdeff42a-b5682a64-9ddd9cf7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:56.370812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14129e0d-bdeff42a-b5682a64-9ddd9cf7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:56.370890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:56.370908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2043
2025-09-30T14:55:56.371186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2043 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:56.371226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2043 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:56.371236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2043 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:56.371258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:56.371762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2043 sessionId:  describe result for acl check
2025-09-30T14:55:56.371803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:56.371811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:56.371814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:56.371823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896117716306932:8883] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:56.372447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896117716306932:8883] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:56.372648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:56.374694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896117716306932:8883] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:56.375196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:56.375446Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:56.375457Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:56.375467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:56.375520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:56.375565Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896117626536205:3868]
2025-09-30T14:55:56.376300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:56.376687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:56.376759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:56.377182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:56.377317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:56.377329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:56.377331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:56.377332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:56.377333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:56.377335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:56.377336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:56.377338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:56.377340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:56.377342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:56.377343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.377345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.377346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.377348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:56.377349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:56.377356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:56.377367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:56.377372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:56.377377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:56.377381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:56.377386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:56.377390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:56.377395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:56.377399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:56.377404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:56.377409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.377412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.377416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.377420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:56.377424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:56.377433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:56.377441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:56.377448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:56.377454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:56.377470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:56.377476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:56.377482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:56.377487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:56.377493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:56.377499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:56.377504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:56.377516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:56.377522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:56.377527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:56.377538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:56.377543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:56.377553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:56.377558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:56.377564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:56.377570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:56.377575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.377581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.377586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.377597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.377603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.377586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896117716306932:8883] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:56.377610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.377600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896117716306932:8883] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:56.377604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896117716306932:8883] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:56.377612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2043 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:56.377619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:56.377624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:56.377629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:56.377635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:56.377686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:56.383305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:56.384389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:56.384408Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:56.384411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:56.384416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:56.384422Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2042 [2:7555896117626536205:3868]
2025-09-30T14:55:56.384439Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:56.384454Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:56.384460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:56.384469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:56.384472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:56.384488Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:56.384494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:56.384501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:56.384570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.384577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.384579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.384582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:56.384587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:56.384657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:56.384663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.384677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.384691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.384718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:56.384735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896117626536199:3868]
2025-09-30T14:55:56.384743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896117626536199:3868]
2025-09-30T14:55:56.384745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896117626536199:3868]
2025-09-30T14:55:56.384763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:56.384782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:56.384799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:56.384802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:56.384840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896117626536199:3868]
2025-09-30T14:55:56.384848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:56.385148Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2042
2025-09-30T14:55:56.385217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2042
2025-09-30T14:55:56.385038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:56.385046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:56.385049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:56.385048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896117716306843:2454], now have 1 active actors on pipe
2025-09-30T14:55:56.385055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896117716306972:8883], now have 1 active actors on pipe
2025-09-30T14:55:56.385055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:56.385332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:56.385341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:56.385369Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dfd83803-f4b76a23-1cbbf13c-b245a3c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:56.385377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:56.385380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:56.385382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:56.385395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:56.385408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:56.385422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:56.385656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:56.385669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:56.385701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:56.385824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2043 partition: 0 MaxSeqNo: 42 sessionId: src_id|dfd83803-f4b76a23-1cbbf13c-b245a3c6_0
2025-09-30T14:55:56.386232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14129e0d-bdeff42a-b5682a64-9ddd9cf7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dfd83803-f4b76a23-1cbbf13c-b245a3c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:56.389197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfd83803-f4b76a23-1cbbf13c-b245a3c6_0] Write session: try to update token
2025-09-30T14:55:56.389222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfd83803-f4b76a23-1cbbf13c-b245a3c6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:56.399592Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:56.399613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:56.399615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:56.399617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:56.399626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896117626536199:3868]
2025-09-30T14:55:56.399630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896117626536199:3868]
2025-09-30T14:55:56.399638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896117626536199:3868]
2025-09-30T14:55:56.399677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:56.399684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.399686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:56.399709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:56.399725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:56.399730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:56.399828Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:56.408291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2043 sessionId: src_id|dfd83803-f4b76a23-1cbbf13c-b245a3c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:56.411157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:56.460742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896117716307003:5488]
2025-09-30T14:55:56.461051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2042, pipe: [1:7555896117716307003:5488]
2025-09-30T14:55:56.520113Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:56.520633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:56.520651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:56.520673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896117716307003:5488], now have 1 active actors on pipe
2025-09-30T14:55:56.520916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896117716307003:5488]
2025-09-30T14:55:56.520941Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:56.520925Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:56.520954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:56.520956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:56.521017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2043 reason: error at write: Disconnected sessionId: src_id|dfd83803-f4b76a23-1cbbf13c-b245a3c6_0
2025-09-30T14:55:56.521178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2043 sessionId: src_id|dfd83803-f4b76a23-1cbbf13c-b245a3c6_0 is DEAD
2025-09-30T14:55:56.521338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfd83803-f4b76a23-1cbbf13c-b245a3c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:56.521350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfd83803-f4b76a23-1cbbf13c-b245a3c6_0] Write session will restart in 0.006046s
2025-09-30T14:55:56.521373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfd83803-f4b76a23-1cbbf13c-b245a3c6_0] Write session: Do CDS request
2025-09-30T14:55:56.521378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfd83803-f4b76a23-1cbbf13c-b245a3c6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:56.528803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfd83803-f4b76a23-1cbbf13c-b245a3c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:56.528952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:56.528970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2044
2025-09-30T14:55:56.529090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2044 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:56.529133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2044 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:56.529138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2044 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:56.529142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:56.529598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2044 sessionId:  describe result for acl check
2025-09-30T14:55:56.529632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:56.529640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:56.529642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:56.529647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896117716307020:8865] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:56.530194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896117716307020:8865] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:56.533075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896117716307020:8865] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:56.535591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:56.537761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:56.538033Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:56.538049Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:56.538063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:56.538134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:56.538143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896117716307020:8865] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:56.538183Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896117626536373:3854]
2025-09-30T14:55:56.538160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896117716307020:8865] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:56.538164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896117716307020:8865] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:56.538174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2044 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:56.538845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:56.539297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:56.539357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:56.539813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:56.539902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:56.539911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:56.539912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:56.539914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:56.539915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:56.539916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:56.539918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:56.539919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:56.539921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:56.539922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:56.539923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.539925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.539926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.539927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:56.539928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:56.539935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:56.539945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:56.539949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:56.539953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:56.539957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:56.539962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:56.539967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:56.539971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:56.539974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:56.539979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:56.539984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.539988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.539992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.539997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:56.540001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:56.540010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:56.540019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:56.540025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:56.540031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:56.540037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:56.540043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:56.540048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:56.540053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:56.540059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:56.540065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:56.540070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:56.540076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:56.540082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:56.540088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:56.540092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:56.540097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:56.540105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:56.540110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:56.540115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:56.540128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:56.540133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.540139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.540149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.540155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.540163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.540174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.540178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:56.540184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:56.540194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:56.540200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:56.540250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:56.546591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:56.547731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:56.547753Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:56.547757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:56.547761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:56.547767Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2043 [2:7555896117626536373:3854]
2025-09-30T14:55:56.547785Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:56.547802Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:56.547805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:56.547808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:56.547810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:56.547828Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:56.547842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:56.547848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:56.547915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.547923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.547926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.547929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:56.547932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:56.548003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:56.548013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.548027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.548046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.548069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:56.548093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896117716307005:2454], now have 1 active actors on pipe
2025-09-30T14:55:56.548099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896117716307132:8865], now have 1 active actors on pipe
2025-09-30T14:55:56.548106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896117626536368:3854]
2025-09-30T14:55:56.548108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896117626536368:3854]
2025-09-30T14:55:56.548112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896117626536368:3854]
2025-09-30T14:55:56.548126Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:56.548140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:56.548144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:56.548151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:56.548162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:56.548165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:56.548166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:56.548205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896117626536368:3854]
2025-09-30T14:55:56.548222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:56.548243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:56.548208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2043
2025-09-30T14:55:56.548212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2043
2025-09-30T14:55:56.548273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:56.548284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:56.548312Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8589c94e-c803593e-75ef5244-d4412050_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:56.548324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:56.548328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:56.548330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:56.548339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:56.548348Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:56.548368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:56.548593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:56.548609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:56.548632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:56.548761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2044 partition: 0 MaxSeqNo: 42 sessionId: src_id|8589c94e-c803593e-75ef5244-d4412050_0
2025-09-30T14:55:56.549124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfd83803-f4b76a23-1cbbf13c-b245a3c6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8589c94e-c803593e-75ef5244-d4412050_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:56.552197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8589c94e-c803593e-75ef5244-d4412050_0] Write session: try to update token
2025-09-30T14:55:56.552217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8589c94e-c803593e-75ef5244-d4412050_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:56.567899Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:56.567922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:56.567934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896117626536368:3854]
2025-09-30T14:55:56.567987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:56.568007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:56.568176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:56.568336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:56.568487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:56.568633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:56.568835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:56.568882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:56.571579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2044 sessionId: src_id|8589c94e-c803593e-75ef5244-d4412050_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:56.574564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:56.573410Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:56.573428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:56.573432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:56.573434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:56.573444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896117626536368:3854]
2025-09-30T14:55:56.573449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896117626536368:3854]
2025-09-30T14:55:56.573454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896117626536368:3854]
2025-09-30T14:55:56.573527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:56.573534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.573534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:56.573537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:56.573542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:56.573547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:56.573683Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:56.620999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896117716307143:5488]
2025-09-30T14:55:56.621371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2043, pipe: [1:7555896117716307143:5488]
2025-09-30T14:55:56.689410Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:56.689890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:56.689933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:56.689959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896117716307143:5488], now have 1 active actors on pipe
2025-09-30T14:55:56.690228Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:56.690252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:56.690313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896117716307143:5488]
2025-09-30T14:55:56.690334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:56.690340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:56.690415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2044 reason: error at write: Disconnected sessionId: src_id|8589c94e-c803593e-75ef5244-d4412050_0
2025-09-30T14:55:56.690614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2044 sessionId: src_id|8589c94e-c803593e-75ef5244-d4412050_0 is DEAD
2025-09-30T14:55:56.690831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8589c94e-c803593e-75ef5244-d4412050_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:56.690842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8589c94e-c803593e-75ef5244-d4412050_0] Write session will restart in 0.009109s
2025-09-30T14:55:56.690867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8589c94e-c803593e-75ef5244-d4412050_0] Write session: Do CDS request
2025-09-30T14:55:56.690885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8589c94e-c803593e-75ef5244-d4412050_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:56.700778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8589c94e-c803593e-75ef5244-d4412050_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:56.700871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:56.700889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2045
2025-09-30T14:55:56.701040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2045 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:56.701072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2045 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:56.701082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2045 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:56.701086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:56.701546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2045 sessionId:  describe result for acl check
2025-09-30T14:55:56.701582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:56.701589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:56.701591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:56.701597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896117716307240:8858] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:56.701826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:56.702148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896117716307240:8858] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:56.703652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:56.703930Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:56.703946Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:56.703960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:56.704035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:56.704086Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896117626536504:3853]
2025-09-30T14:55:56.704250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896117716307240:8858] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:56.704811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:56.705131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:56.705194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:56.705591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:56.705692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:56.705702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:56.705704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:56.705706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:56.705708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:56.705709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:56.705712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:56.705713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:56.705714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:56.705716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:56.705717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.705718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.705720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.705721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:56.705723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:56.705730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:56.705742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:56.705747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:56.705752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:56.705757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:56.705762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:56.705767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:56.705771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:56.705775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:56.705780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:56.705785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.705788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.705793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.705797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:56.705800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:56.705808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:56.705826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:56.705833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:56.705839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:56.705851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:56.705857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:56.705868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:56.705875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:56.705886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:56.705892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:56.705898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:56.705910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:56.705917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:56.705929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:56.705935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:56.705945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:56.705952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:56.705964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:56.705969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:56.705978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:56.705984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.705990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.706001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.706007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.706016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.706022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.706027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:56.706033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:56.706039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:56.706045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:56.706094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:56.706691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896117716307240:8858] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:56.706704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896117716307240:8858] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:56.706707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896117716307240:8858] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:56.706716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2045 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:56.711674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:56.712577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:56.712594Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:56.712597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:56.712602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:56.712609Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2044 [2:7555896117626536504:3853]
2025-09-30T14:55:56.712627Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:56.712645Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:56.712655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:56.712659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:56.712662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:56.712679Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:56.712686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:56.712694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:56.712765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.712775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.712778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.712782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:56.712785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:56.712855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:56.712864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.712878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.712892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.712919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:56.712944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896117716307280:8858], now have 1 active actors on pipe
2025-09-30T14:55:56.712948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896117716307147:2454], now have 1 active actors on pipe
2025-09-30T14:55:56.712954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896117626536498:3853]
2025-09-30T14:55:56.712957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896117626536498:3853]
2025-09-30T14:55:56.712959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896117626536498:3853]
2025-09-30T14:55:56.712973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:56.712987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:56.712996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:56.713005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:56.713007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:56.713009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:56.713010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:56.713046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896117626536498:3853]
2025-09-30T14:55:56.713054Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:56.713030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2044
2025-09-30T14:55:56.713067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:56.713033Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2044
2025-09-30T14:55:56.713087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:56.713097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:56.713129Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a99747ba-590941c0-8abd05bc-69b3d33a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:56.713142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:56.713146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:56.713149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:56.713159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:56.713172Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:56.713192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:56.713327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:56.713336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:56.713349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:56.713417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2045 partition: 0 MaxSeqNo: 42 sessionId: src_id|a99747ba-590941c0-8abd05bc-69b3d33a_0
2025-09-30T14:55:56.713784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8589c94e-c803593e-75ef5244-d4412050_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a99747ba-590941c0-8abd05bc-69b3d33a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:56.716568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a99747ba-590941c0-8abd05bc-69b3d33a_0] Write session: try to update token
2025-09-30T14:55:56.716585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a99747ba-590941c0-8abd05bc-69b3d33a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:56.726019Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:56.726042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:56.726045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:56.726046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:56.726056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896117626536498:3853]
2025-09-30T14:55:56.726062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896117626536498:3853]
2025-09-30T14:55:56.726066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896117626536498:3853]
2025-09-30T14:55:56.726111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:56.726118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.726120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:56.726122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:56.726130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:56.726135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:56.726288Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:56.731574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2045 sessionId: src_id|a99747ba-590941c0-8abd05bc-69b3d33a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:56.734256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:56.790483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896117716307287:5488]
2025-09-30T14:55:56.790848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2044, pipe: [1:7555896117716307287:5488]
2025-09-30T14:55:56.839915Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:56.840305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:56.840315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:56.840354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896117716307287:5488], now have 1 active actors on pipe
2025-09-30T14:55:56.840643Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:56.841165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896117716307287:5488]
2025-09-30T14:55:56.841176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:56.841197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:56.841246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2045 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a99747ba-590941c0-8abd05bc-69b3d33a_0
2025-09-30T14:55:56.841427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2045 sessionId: src_id|a99747ba-590941c0-8abd05bc-69b3d33a_0 is DEAD
2025-09-30T14:55:56.841621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a99747ba-590941c0-8abd05bc-69b3d33a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:56.841631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a99747ba-590941c0-8abd05bc-69b3d33a_0] Write session will restart in 0.005077s
2025-09-30T14:55:56.841655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a99747ba-590941c0-8abd05bc-69b3d33a_0] Write session: Do CDS request
2025-09-30T14:55:56.841662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a99747ba-590941c0-8abd05bc-69b3d33a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:56.847759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a99747ba-590941c0-8abd05bc-69b3d33a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:56.849646Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:56.849665Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2046
2025-09-30T14:55:56.849814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2046 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:56.849849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2046 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:56.849860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2046 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:56.849865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:56.850375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2046 sessionId:  describe result for acl check
2025-09-30T14:55:56.850413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:56.850421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:56.850423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:56.850429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896117716307310:8854] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:56.850991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896117716307310:8854] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:56.853947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896117716307310:8854] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:56.855862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:56.858422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896117716307310:8854] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:56.858439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896117716307310:8854] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:56.858443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896117716307310:8854] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:56.858470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2046 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:56.858214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:56.858442Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:56.858447Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:56.858457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:56.858514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:56.858556Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896117626536648:3845]
2025-09-30T14:55:56.859229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:56.859535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:56.859572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:56.859939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:56.859999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:56.860000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:56.860001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:56.860002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:56.860004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:56.860005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:56.860006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:56.860008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:56.860009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:56.860010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:56.860012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.860013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.860014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.860015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:56.860017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:56.860022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:56.860034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:56.860038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:56.860042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:56.860047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:56.860052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:56.860056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:56.860060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:56.860064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:56.860067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:56.860071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.860076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.860080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.860084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:56.860088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:56.860097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:56.860105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:56.860111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:56.860116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:56.860121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:56.860127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:56.860132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:56.860138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:56.860144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:56.860150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:56.860155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:56.860160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:56.860165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:56.860170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:56.860175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:56.860181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:56.860187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:56.860193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:56.860197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:56.860202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:56.860208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.860214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.860219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.860225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.860231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.860237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.860242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:56.860247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:56.860252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:56.860257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:56.860305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:56.865934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:56.866922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:56.866938Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:56.866941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:56.866945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:56.866953Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2045 [2:7555896117626536648:3845]
2025-09-30T14:55:56.866970Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:56.866986Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:56.866989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:56.866992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:56.866994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:56.867009Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:56.867024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:56.867031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:56.867095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.867105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.867106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.867110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:56.867113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:56.867182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:56.867190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.867202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:56.867219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:56.867356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2045
2025-09-30T14:55:56.867403Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2045
2025-09-30T14:55:56.867263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:56.867288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896117716307419:8854], now have 1 active actors on pipe
2025-09-30T14:55:56.867292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896117716307289:2454], now have 1 active actors on pipe
2025-09-30T14:55:56.867298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896117626536643:3845]
2025-09-30T14:55:56.867300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896117626536643:3845]
2025-09-30T14:55:56.867302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896117626536643:3845]
2025-09-30T14:55:56.867317Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:56.867331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:56.867341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:56.867346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:56.867347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:56.867350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:56.867350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:56.867385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896117626536643:3845]
2025-09-30T14:55:56.867394Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:56.867428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:56.867547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:56.867561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:56.867592Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe9ab8cd-497b7cb6-65dd5af7-ebc82abc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:56.867606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:56.867614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:56.867617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:56.867626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:56.867641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:56.867660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:56.867852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:56.867863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:56.867884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:56.868002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2046 partition: 0 MaxSeqNo: 42 sessionId: src_id|fe9ab8cd-497b7cb6-65dd5af7-ebc82abc_0
2025-09-30T14:55:56.868379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a99747ba-590941c0-8abd05bc-69b3d33a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fe9ab8cd-497b7cb6-65dd5af7-ebc82abc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:56.871289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe9ab8cd-497b7cb6-65dd5af7-ebc82abc_0] Write session: try to update token
2025-09-30T14:55:56.871309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe9ab8cd-497b7cb6-65dd5af7-ebc82abc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:56.880564Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:56.880597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:56.880601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:56.880605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:56.880620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896117626536643:3845]
2025-09-30T14:55:56.880626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896117626536643:3845]
2025-09-30T14:55:56.880631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896117626536643:3845]
2025-09-30T14:55:56.880685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:56.880699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:56.880703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:56.880702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:56.880709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:56.880713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:56.880847Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:56.886468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2046 sessionId: src_id|fe9ab8cd-497b7cb6-65dd5af7-ebc82abc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:56.889433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:56.938947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896117716307442:5488]
2025-09-30T14:55:56.939278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2045, pipe: [1:7555896117716307442:5488]
2025-09-30T14:55:56.992839Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:56.993306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:56.993321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:56.993360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896117716307442:5488], now have 1 active actors on pipe
2025-09-30T14:55:56.993623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896117716307442:5488]
2025-09-30T14:55:56.993704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:56.993786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2046 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fe9ab8cd-497b7cb6-65dd5af7-ebc82abc_0
2025-09-30T14:55:56.993593Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:56.993900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:56.993973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2046 sessionId: src_id|fe9ab8cd-497b7cb6-65dd5af7-ebc82abc_0 is DEAD
2025-09-30T14:55:56.994249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe9ab8cd-497b7cb6-65dd5af7-ebc82abc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:56.994257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe9ab8cd-497b7cb6-65dd5af7-ebc82abc_0] Write session will restart in 0.005863s
2025-09-30T14:55:56.994281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe9ab8cd-497b7cb6-65dd5af7-ebc82abc_0] Write session: Do CDS request
2025-09-30T14:55:56.994287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe9ab8cd-497b7cb6-65dd5af7-ebc82abc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:57.001805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe9ab8cd-497b7cb6-65dd5af7-ebc82abc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:57.001922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:57.001949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2047
2025-09-30T14:55:57.002053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2047 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:57.002086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2047 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:57.002100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2047 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:57.002104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:57.002602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2047 sessionId:  describe result for acl check
2025-09-30T14:55:57.002641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:57.002650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:57.002653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:57.002659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896122011274754:8846] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:57.003222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896122011274754:8846] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:57.007578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896122011274754:8846] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:57.009632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:57.012280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:57.012361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896122011274754:8846] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:57.012381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896122011274754:8846] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:57.012385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896122011274754:8846] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:57.012393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2047 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:57.012535Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:57.012550Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:57.012561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:57.012622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:57.012661Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896121921504079:3840]
2025-09-30T14:55:57.013320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:57.013693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:57.013759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:57.014117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:57.014180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:57.014186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:57.014188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:57.014189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:57.014191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:57.014192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:57.014194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:57.014195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:57.014197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:57.014198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:57.014199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.014201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.014202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.014203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:57.014204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:57.014211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:57.014222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:57.014226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:57.014231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:57.014235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:57.014239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:57.014244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:57.014248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:57.014252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:57.014256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:57.014261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.014265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.014269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.014273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:57.014277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:57.014287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:57.014295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:57.014306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:57.014311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:57.014321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:57.014327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:57.014335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:57.014339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:57.014344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:57.014354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:57.014359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:57.014368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:57.014372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:57.014378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:57.014386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:57.014391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:57.014399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:57.014405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:57.014415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:57.014421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:57.014430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.014436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.014444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.014450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.014454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.014464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.014469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:57.014474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:57.014483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:57.014492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:57.014540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:57.020261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:57.021213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:57.021232Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:57.021235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:57.021240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:57.021247Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2046 [2:7555896121921504079:3840]
2025-09-30T14:55:57.021265Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:57.021282Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:57.021287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:57.021291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:57.021293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:57.021312Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:57.021324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:57.021332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:57.021400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.021409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.021412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.021416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:57.021418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:57.021501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:57.021510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.021523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.021539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.021559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:57.021582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896122011274870:8846], now have 1 active actors on pipe
2025-09-30T14:55:57.021591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896117716307443:2454], now have 1 active actors on pipe
2025-09-30T14:55:57.021598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896121921504074:3840]
2025-09-30T14:55:57.021602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896121921504074:3840]
2025-09-30T14:55:57.021604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896121921504074:3840]
2025-09-30T14:55:57.021615Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:57.021625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:57.021628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:57.021631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:57.021632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:57.021647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:57.021650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:57.021685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896121921504074:3840]
2025-09-30T14:55:57.021699Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:57.021709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:57.021692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2046
2025-09-30T14:55:57.021731Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2046
2025-09-30T14:55:57.021730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:57.021741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:57.021768Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d909d04-dfebdc93-68236cc8-93d38562_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:57.021783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:57.021789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:57.021791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:57.021805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:57.021816Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:57.021839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:57.021995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:57.022002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:57.022016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:57.022154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2047 partition: 0 MaxSeqNo: 42 sessionId: src_id|9d909d04-dfebdc93-68236cc8-93d38562_0
2025-09-30T14:55:57.022540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe9ab8cd-497b7cb6-65dd5af7-ebc82abc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9d909d04-dfebdc93-68236cc8-93d38562_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:57.025362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d909d04-dfebdc93-68236cc8-93d38562_0] Write session: try to update token
2025-09-30T14:55:57.025387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d909d04-dfebdc93-68236cc8-93d38562_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:57.036102Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:57.036128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:57.036130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:57.036132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:57.036141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896121921504074:3840]
2025-09-30T14:55:57.036146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896121921504074:3840]
2025-09-30T14:55:57.036149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896121921504074:3840]
2025-09-30T14:55:57.036190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:57.036197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.036200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:57.036206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:57.036214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:57.036218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:57.036344Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:57.042193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2047 sessionId: src_id|9d909d04-dfebdc93-68236cc8-93d38562_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:57.044911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:57.093586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896122011274881:5488]
2025-09-30T14:55:57.094006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2046, pipe: [1:7555896122011274881:5488]
2025-09-30T14:55:57.153401Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:57.153862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:57.153877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:57.153912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896122011274881:5488], now have 1 active actors on pipe
2025-09-30T14:55:57.154136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896122011274881:5488]
2025-09-30T14:55:57.154165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:57.154169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:57.154265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:57.154273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2047 reason: error at write: Disconnected sessionId: src_id|9d909d04-dfebdc93-68236cc8-93d38562_0
2025-09-30T14:55:57.154478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2047 sessionId: src_id|9d909d04-dfebdc93-68236cc8-93d38562_0 is DEAD
2025-09-30T14:55:57.154630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d909d04-dfebdc93-68236cc8-93d38562_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:57.154637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d909d04-dfebdc93-68236cc8-93d38562_0] Write session will restart in 0.007227s
2025-09-30T14:55:57.154677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d909d04-dfebdc93-68236cc8-93d38562_0] Write session: Do CDS request
2025-09-30T14:55:57.154683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d909d04-dfebdc93-68236cc8-93d38562_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:57.154663Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:57.162765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d909d04-dfebdc93-68236cc8-93d38562_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:57.163333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:57.163351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2048
2025-09-30T14:55:57.163522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2048 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:57.163571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2048 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:57.163582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2048 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:57.163587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:57.164033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2048 sessionId:  describe result for acl check
2025-09-30T14:55:57.164066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:57.164073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:57.164075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:57.164081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896122011274974:8840] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:57.164666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896122011274974:8840] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:57.166222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:57.166739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896122011274974:8840] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:57.168241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:57.168472Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:57.168489Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:57.168508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:57.168596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:57.168646Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896121921504213:3836]
2025-09-30T14:55:57.168907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896122011274974:8840] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:57.168921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896122011274974:8840] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:57.168925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896122011274974:8840] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:57.168933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2048 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:57.169375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:57.169715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:57.169789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:57.170156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:57.170235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:57.170243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:57.170244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:57.170246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:57.170247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:57.170248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:57.170250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:57.170251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:57.170253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:57.170254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:57.170256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.170257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.170258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.170260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:57.170261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:57.170266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:57.170277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:57.170281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:57.170285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:57.170289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:57.170294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:57.170298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:57.170302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:57.170306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:57.170311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:57.170315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.170319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.170323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.170327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:57.170330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:57.170338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:57.170346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:57.170353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:57.170359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:57.170364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:57.170370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:57.170374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:57.170380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:57.170385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:57.170390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:57.170395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:57.170400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:57.170405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:57.170415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:57.170425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:57.170431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:57.170441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:57.170446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:57.170451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:57.170456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:57.170461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.170467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.170472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.170477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.170482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.170494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.170498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:57.170503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:57.170510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:57.170515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:57.170560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:57.176328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:57.177111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:57.177129Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:57.177132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:57.177136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:57.177142Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2047 [2:7555896121921504213:3836]
2025-09-30T14:55:57.177156Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:57.177170Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:57.177172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:57.177175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:57.177176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:57.177188Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:57.177194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:57.177199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:57.177249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.177257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.177260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.177262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:57.177265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:57.177343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:57.177352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.177365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.177378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.177394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:57.177413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896122011274889:2454], now have 1 active actors on pipe
2025-09-30T14:55:57.177420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896122011275020:8840], now have 1 active actors on pipe
2025-09-30T14:55:57.177426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896121921504208:3836]
2025-09-30T14:55:57.177429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896121921504208:3836]
2025-09-30T14:55:57.177431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896121921504208:3836]
2025-09-30T14:55:57.177444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:57.177464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:57.177473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:57.177474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:57.177476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:57.177489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:57.177498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:57.177474Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2047
2025-09-30T14:55:57.177491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2047
2025-09-30T14:55:57.177538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896121921504208:3836]
2025-09-30T14:55:57.177550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:57.177556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:57.177663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:57.177672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:57.177696Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d2da35a3-9fd25da8-abcfc0b8-48df5c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:57.177707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:57.177711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:57.177713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:57.177722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:57.177731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:57.177749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:57.177882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:57.177891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:57.177903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:57.177969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2048 partition: 0 MaxSeqNo: 42 sessionId: src_id|d2da35a3-9fd25da8-abcfc0b8-48df5c9_0
2025-09-30T14:55:57.178332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d909d04-dfebdc93-68236cc8-93d38562_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d2da35a3-9fd25da8-abcfc0b8-48df5c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:57.181231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2da35a3-9fd25da8-abcfc0b8-48df5c9_0] Write session: try to update token
2025-09-30T14:55:57.181255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2da35a3-9fd25da8-abcfc0b8-48df5c9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:57.190667Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:57.190689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:57.190692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:57.190694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:57.190704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896121921504208:3836]
2025-09-30T14:55:57.190708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896121921504208:3836]
2025-09-30T14:55:57.190713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896121921504208:3836]
2025-09-30T14:55:57.190754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:57.190765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.190773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:57.190771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:57.190778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:57.190782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:57.190922Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:57.198779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2048 sessionId: src_id|d2da35a3-9fd25da8-abcfc0b8-48df5c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:57.201583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:57.254372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896122011275035:5488]
2025-09-30T14:55:57.254706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2047, pipe: [1:7555896122011275035:5488]
2025-09-30T14:55:57.304422Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:57.304980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:57.304996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:57.305016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896122011275035:5488], now have 1 active actors on pipe
2025-09-30T14:55:57.305236Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:57.305315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:57.305316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896122011275035:5488]
2025-09-30T14:55:57.305338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:57.305418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2048 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d2da35a3-9fd25da8-abcfc0b8-48df5c9_0
2025-09-30T14:55:57.305627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2048 sessionId: src_id|d2da35a3-9fd25da8-abcfc0b8-48df5c9_0 is DEAD
2025-09-30T14:55:57.305784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2da35a3-9fd25da8-abcfc0b8-48df5c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:57.305794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2da35a3-9fd25da8-abcfc0b8-48df5c9_0] Write session will restart in 0.009541s
2025-09-30T14:55:57.305828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2da35a3-9fd25da8-abcfc0b8-48df5c9_0] Write session: Do CDS request
2025-09-30T14:55:57.305834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2da35a3-9fd25da8-abcfc0b8-48df5c9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:57.316792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2da35a3-9fd25da8-abcfc0b8-48df5c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:57.316968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:57.316987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2049
2025-09-30T14:55:57.317114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2049 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:57.317147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2049 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:57.317153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2049 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:57.317162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:57.317329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:57.317587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2049 sessionId:  describe result for acl check
2025-09-30T14:55:57.317617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:57.317624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:57.317626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:57.317632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896122011275134:8830] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:57.318184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896122011275134:8830] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:57.319428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:57.319626Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:57.319635Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:57.319645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:57.319699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:57.319738Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896121921504347:3821]
2025-09-30T14:55:57.320385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:57.320370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896122011275134:8830] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:57.320724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:57.320773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:57.321109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:57.321183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:57.321189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:57.321190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:57.321192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:57.321193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:57.321194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:57.321195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:57.321196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:57.321197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:57.321199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:57.321200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.321201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.321202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.321203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:57.321205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:57.321210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:57.321220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:57.321223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:57.321227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:57.321232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:57.321236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:57.321241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:57.321246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:57.321249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:57.321253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:57.321257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.321260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.321265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.321270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:57.321273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:57.321281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:57.321290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:57.321309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:57.321315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:57.321321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:57.321326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:57.321330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:57.321335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:57.321340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:57.321345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:57.321351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:57.321357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:57.321362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:57.321368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:57.321373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:57.321378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:57.321388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:57.321393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:57.321399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:57.321405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:57.321410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.321416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.321425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.321430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.321436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.321442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.321447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:57.321465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:57.321474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:57.321480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:57.321531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:57.326909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896122011275134:8830] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:57.326941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896122011275134:8830] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:57.326946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896122011275134:8830] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:57.326959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2049 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:57.327158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:57.328164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:57.328183Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:57.328186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:57.328190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:57.328198Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2048 [2:7555896121921504347:3821]
2025-09-30T14:55:57.328214Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:57.328230Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:57.328232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:57.328235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:57.328236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:57.328251Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:57.328258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:57.328267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:57.328328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.328336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.328339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.328343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:57.328344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:57.328401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:57.328410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.328424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.328438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.328460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:57.328485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896122011275036:2454], now have 1 active actors on pipe
2025-09-30T14:55:57.328494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896122011275172:8830], now have 1 active actors on pipe
2025-09-30T14:55:57.328501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896121921504342:3821]
2025-09-30T14:55:57.328503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896121921504342:3821]
2025-09-30T14:55:57.328506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896121921504342:3821]
2025-09-30T14:55:57.328520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:57.328535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:57.328554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:57.328552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:57.328557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:57.328559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:57.328561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:57.328571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2048
2025-09-30T14:55:57.328597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896121921504342:3821]
2025-09-30T14:55:57.328571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2048
2025-09-30T14:55:57.328601Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:57.328604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:57.328627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:57.328632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:57.328677Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0f2be3c-dfd83a87-9dea10ae-61fa343d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:57.328688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:57.328692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:57.328694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:57.328705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:57.328720Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:57.328745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:57.328907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:57.328916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:57.328929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:57.329011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2049 partition: 0 MaxSeqNo: 42 sessionId: src_id|c0f2be3c-dfd83a87-9dea10ae-61fa343d_0
2025-09-30T14:55:57.329392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2da35a3-9fd25da8-abcfc0b8-48df5c9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c0f2be3c-dfd83a87-9dea10ae-61fa343d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:57.332375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0f2be3c-dfd83a87-9dea10ae-61fa343d_0] Write session: try to update token
2025-09-30T14:55:57.332396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0f2be3c-dfd83a87-9dea10ae-61fa343d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:57.341396Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:57.341419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:57.341422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:57.341424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:57.341433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896121921504342:3821]
2025-09-30T14:55:57.341439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896121921504342:3821]
2025-09-30T14:55:57.341443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896121921504342:3821]
2025-09-30T14:55:57.341498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:57.341505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.341508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:57.341515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:57.341521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:57.341526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:57.341658Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:57.347935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2049 sessionId: src_id|c0f2be3c-dfd83a87-9dea10ae-61fa343d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:57.350796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:57.405420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896122011275180:5488]
2025-09-30T14:55:57.405710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2048, pipe: [1:7555896122011275180:5488]
2025-09-30T14:55:57.454821Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:57.455062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:57.455074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:57.455106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896122011275180:5488], now have 1 active actors on pipe
2025-09-30T14:55:57.455341Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:57.455390Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:57.455443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896122011275180:5488]
2025-09-30T14:55:57.455461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:57.455530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2049 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c0f2be3c-dfd83a87-9dea10ae-61fa343d_0
2025-09-30T14:55:57.455706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2049 sessionId: src_id|c0f2be3c-dfd83a87-9dea10ae-61fa343d_0 is DEAD
2025-09-30T14:55:57.455850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0f2be3c-dfd83a87-9dea10ae-61fa343d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:57.455862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0f2be3c-dfd83a87-9dea10ae-61fa343d_0] Write session will restart in 0.008655s
2025-09-30T14:55:57.455897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0f2be3c-dfd83a87-9dea10ae-61fa343d_0] Write session: Do CDS request
2025-09-30T14:55:57.455903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0f2be3c-dfd83a87-9dea10ae-61fa343d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:57.465742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0f2be3c-dfd83a87-9dea10ae-61fa343d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:57.465844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:57.465872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2050
2025-09-30T14:55:57.465993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2050 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:57.466026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2050 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:57.466035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2050 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:57.466042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:57.466441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2050 sessionId:  describe result for acl check
2025-09-30T14:55:57.466477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:57.466487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:57.466490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:57.466495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896122011275291:8820] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:57.466635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:57.467036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896122011275291:8820] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:57.468542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:57.468731Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:57.468740Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:57.468749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:57.468800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:57.468839Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896121921504498:3818]
2025-09-30T14:55:57.469125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896122011275291:8820] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:57.469488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:57.469762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:57.469805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:57.470120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:57.470178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:57.470183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:57.470184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:57.470185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:57.470187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:57.470188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:57.470189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:57.470200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:57.470201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:57.470202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:57.470206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.470208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.470209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.470210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:57.470212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:57.470217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:57.470228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:57.470233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:57.470238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:57.470242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:57.470247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:57.470251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:57.470255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:57.470259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:57.470265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:57.470271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.470277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.470284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.470289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:57.470293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:57.470301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:57.470312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:57.470321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:57.470331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:57.470336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:57.470340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:57.470345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:57.470351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:57.470360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:57.470366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:57.470374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:57.470380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:57.470388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:57.470393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:57.470397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:57.470403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:57.470408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:57.470413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:57.470422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:57.470427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:57.470436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.470442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.470450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.470456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.470464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.470471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.470479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:57.470484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:57.470489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:57.470495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:57.470540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:57.475809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896122011275291:8820] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:57.475828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896122011275291:8820] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:57.475832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896122011275291:8820] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:57.475841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2050 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:57.476083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:57.477000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:57.477019Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:57.477023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:57.477027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:57.477034Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2049 [2:7555896121921504498:3818]
2025-09-30T14:55:57.477050Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:57.477066Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:57.477074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:57.477077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:57.477079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:57.477096Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:57.477107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:57.477115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:57.477171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.477181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.477183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.477187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:57.477190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:57.477269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:57.477277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.477288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.477298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.477314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:57.477334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896122011275330:8820], now have 1 active actors on pipe
2025-09-30T14:55:57.477343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896122011275181:2454], now have 1 active actors on pipe
2025-09-30T14:55:57.477406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2049
2025-09-30T14:55:57.477463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2049
2025-09-30T14:55:57.477350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896121921504492:3818]
2025-09-30T14:55:57.477357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896121921504492:3818]
2025-09-30T14:55:57.477359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896121921504492:3818]
2025-09-30T14:55:57.477372Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:57.477386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:57.477390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:57.477394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:57.477397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:57.477401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:57.477404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:57.477437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896121921504492:3818]
2025-09-30T14:55:57.477440Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:57.477464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:57.477485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:57.477490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:57.477524Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5990807c-1836102f-9689ac66-171ccd56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:57.477537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:57.477541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:57.477543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:57.477553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:57.477566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:57.477588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:57.477760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:57.477775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:57.477796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:57.477868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2050 partition: 0 MaxSeqNo: 42 sessionId: src_id|5990807c-1836102f-9689ac66-171ccd56_0
2025-09-30T14:55:57.478245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0f2be3c-dfd83a87-9dea10ae-61fa343d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5990807c-1836102f-9689ac66-171ccd56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:57.481291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5990807c-1836102f-9689ac66-171ccd56_0] Write session: try to update token
2025-09-30T14:55:57.481309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5990807c-1836102f-9689ac66-171ccd56_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:57.489827Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:57.489851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:57.489854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:57.489856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:57.489865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896121921504492:3818]
2025-09-30T14:55:57.489870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896121921504492:3818]
2025-09-30T14:55:57.489874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896121921504492:3818]
2025-09-30T14:55:57.489917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:57.489925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.489928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:57.489943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:57.489961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:57.489965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:57.490091Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:57.498480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2050 sessionId: src_id|5990807c-1836102f-9689ac66-171ccd56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:57.501347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:57.555411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896122011275348:5488]
2025-09-30T14:55:57.555718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2049, pipe: [1:7555896122011275348:5488]
2025-09-30T14:55:57.605535Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:57.605849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:57.605871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:57.605892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896122011275348:5488], now have 1 active actors on pipe
2025-09-30T14:55:57.606132Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:57.606155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:57.606173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:57.606249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2050 reason: error at write: Disconnected sessionId: src_id|5990807c-1836102f-9689ac66-171ccd56_0
2025-09-30T14:55:57.606303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:57.606350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896122011275348:5488]
2025-09-30T14:55:57.606430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2050 sessionId: src_id|5990807c-1836102f-9689ac66-171ccd56_0 is DEAD
2025-09-30T14:55:57.606580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5990807c-1836102f-9689ac66-171ccd56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:57.606592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5990807c-1836102f-9689ac66-171ccd56_0] Write session will restart in 0.009853s
2025-09-30T14:55:57.606633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5990807c-1836102f-9689ac66-171ccd56_0] Write session: Do CDS request
2025-09-30T14:55:57.606639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5990807c-1836102f-9689ac66-171ccd56_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:57.618937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:57.619830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5990807c-1836102f-9689ac66-171ccd56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:57.619873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:57.619888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2051
2025-09-30T14:55:57.620052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2051 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:57.620091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2051 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:57.620101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2051 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:57.620106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:57.620562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2051 sessionId:  describe result for acl check
2025-09-30T14:55:57.620609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:57.620616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:57.620618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:57.620624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896122011275449:8817] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:57.621338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:57.621183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896122011275449:8817] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:57.621671Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:57.621686Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:57.621702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:57.621785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:57.621849Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896121921504658:3789]
2025-09-30T14:55:57.622587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:57.622998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:57.623071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:57.623508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:57.623601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:57.623611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:57.623612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:57.623613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:57.623614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:57.623615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:57.623617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:57.623618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:57.623620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:57.623621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:57.623622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.623623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.623625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.623626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:57.623628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:57.623633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:57.623644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:57.623648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:57.623652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:57.623656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:57.623660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:57.623664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:57.623669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:57.623672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:57.623676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:57.623680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.623683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.623686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.623690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:57.623694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:57.623705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:57.623714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:57.623720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:57.623726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:57.623731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:57.623749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:57.623754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:57.623760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:57.623769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:57.623774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:57.623780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:57.623785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:57.623790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:57.623796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:57.623801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:57.623808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:57.623824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:57.623835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:57.623840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:57.623851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:57.623860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.623866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.623874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.623879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.623885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.623891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.623897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:57.623907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:57.623916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:57.623922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:57.623976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:57.623942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896122011275449:8817] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:57.629358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896122011275449:8817] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:57.629379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896122011275449:8817] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:57.629382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896122011275449:8817] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:57.629391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2051 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:57.629682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:57.630838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:57.630859Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:57.630862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:57.630866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:57.630876Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2050 [2:7555896121921504658:3789]
2025-09-30T14:55:57.630894Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:57.630911Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:57.630914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:57.630917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:57.630920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:57.630937Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:57.630944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:57.630950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:57.631014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.631023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.631025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.631028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:57.631030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:57.631098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:57.631109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.631123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.631136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.631155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:57.631173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896122011275349:2454], now have 1 active actors on pipe
2025-09-30T14:55:57.631177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896122011275487:8817], now have 1 active actors on pipe
2025-09-30T14:55:57.631183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896121921504653:3789]
2025-09-30T14:55:57.631186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896121921504653:3789]
2025-09-30T14:55:57.631189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896121921504653:3789]
2025-09-30T14:55:57.631202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:57.631215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:57.631215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:57.631219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:57.631221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:57.631235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:57.631239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:57.631296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896121921504653:3789]
2025-09-30T14:55:57.631308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:57.631317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:57.631299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2050
2025-09-30T14:55:57.631389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:57.631398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:57.631422Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfd99928-6615c674-93586709-d62e6c25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:57.631434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:57.631439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:57.631441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:57.631442Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2050
2025-09-30T14:55:57.631451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:57.631465Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:57.631485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:57.632149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:57.632165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:57.632188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:57.632305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2051 partition: 0 MaxSeqNo: 42 sessionId: src_id|bfd99928-6615c674-93586709-d62e6c25_0
2025-09-30T14:55:57.632651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5990807c-1836102f-9689ac66-171ccd56_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bfd99928-6615c674-93586709-d62e6c25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:57.635612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd99928-6615c674-93586709-d62e6c25_0] Write session: try to update token
2025-09-30T14:55:57.635635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd99928-6615c674-93586709-d62e6c25_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:57.649855Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:57.649878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:57.649888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896121921504653:3789]
2025-09-30T14:55:57.649936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:57.649957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:57.650121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:57.650278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:57.650438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:57.650593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:57.650802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:57.650847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:57.653665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2051 sessionId: src_id|bfd99928-6615c674-93586709-d62e6c25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:57.655220Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:57.655278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:57.655281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:57.655283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:57.655292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896121921504653:3789]
2025-09-30T14:55:57.655296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896121921504653:3789]
2025-09-30T14:55:57.655301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896121921504653:3789]
2025-09-30T14:55:57.655340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:57.655351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.655359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:57.655364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:57.655371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:57.655375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:57.655499Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:57.656825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:57.706445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896122011275497:5488]
2025-09-30T14:55:57.706830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2050, pipe: [1:7555896122011275497:5488]
2025-09-30T14:55:57.768205Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:57.768651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:57.768668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:57.768689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896122011275497:5488], now have 1 active actors on pipe
2025-09-30T14:55:57.768915Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:57.768936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896122011275497:5488]
2025-09-30T14:55:57.768963Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:57.768972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:57.768975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:57.769036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2051 reason: error at write: Disconnected sessionId: src_id|bfd99928-6615c674-93586709-d62e6c25_0
2025-09-30T14:55:57.769213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2051 sessionId: src_id|bfd99928-6615c674-93586709-d62e6c25_0 is DEAD
2025-09-30T14:55:57.769329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd99928-6615c674-93586709-d62e6c25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:57.769339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd99928-6615c674-93586709-d62e6c25_0] Write session will restart in 0.005555s
2025-09-30T14:55:57.769362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd99928-6615c674-93586709-d62e6c25_0] Write session: Do CDS request
2025-09-30T14:55:57.769371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd99928-6615c674-93586709-d62e6c25_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:57.775730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd99928-6615c674-93586709-d62e6c25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:57.775854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:57.775870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2052
2025-09-30T14:55:57.775985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2052 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:57.776017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2052 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:57.776027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2052 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:57.776033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:57.776491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2052 sessionId:  describe result for acl check
2025-09-30T14:55:57.776527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:57.776534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:57.776536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:57.776542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896122011275515:8810] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:57.777163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896122011275515:8810] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:57.779771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896122011275515:8810] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:57.781757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:57.783976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:57.784245Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:57.784257Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:57.784269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:57.784347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:57.784390Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896121921504808:3784]
2025-09-30T14:55:57.784432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896122011275515:8810] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:57.784452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896122011275515:8810] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:57.784467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896122011275515:8810] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:57.784476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2052 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:57.785056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:57.785385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:57.785477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:57.785848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:57.785918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:57.785926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:57.785928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:57.785929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:57.785931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:57.785932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:57.785934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:57.785935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:57.785936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:57.785937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:57.785939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.785941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.785942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.785944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:57.785945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:57.785952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:57.785964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:57.785969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:57.785974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:57.785979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:57.785983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:57.785988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:57.785993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:57.785998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:57.786003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:57.786008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.786012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.786016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.786020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:57.786024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:57.786032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:57.786053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:57.786065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:57.786071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:57.786081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:57.786087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:57.786097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:57.786104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:57.786109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:57.786116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:57.786121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:57.786126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:57.786133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:57.786138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:57.786150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:57.786156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:57.786165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:57.786171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:57.786181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:57.786187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:57.786197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.786203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.786213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.786219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.786229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.786235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.786245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:57.786252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:57.786261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:57.786267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:57.786318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:57.791976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:57.792861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:57.792881Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:57.792884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:57.792889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:57.792897Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2051 [2:7555896121921504808:3784]
2025-09-30T14:55:57.792915Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:57.792932Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:57.792935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:57.792938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:57.792941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:57.792958Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:57.792969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:57.792980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:57.793040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.793048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.793050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.793054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:57.793056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:57.793144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:57.793151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.793166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.793184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.793207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:57.793231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896122011275498:2454], now have 1 active actors on pipe
2025-09-30T14:55:57.793241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896121921504803:3784]
2025-09-30T14:55:57.793247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896121921504803:3784]
2025-09-30T14:55:57.793250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896121921504803:3784]
2025-09-30T14:55:57.793260Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:57.793280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:57.793288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:57.793302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:57.793304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:57.793305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:57.793306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:57.793311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896122011275633:8810], now have 1 active actors on pipe
2025-09-30T14:55:57.793347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896121921504803:3784]
2025-09-30T14:55:57.793360Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:57.793380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:57.793371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2051
2025-09-30T14:55:57.793434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2051
2025-09-30T14:55:57.793536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:57.793544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:57.793568Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f01f53c3-9c014270-9770c1c9-661b65f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:57.793579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:57.793587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:57.793590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:57.793606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:57.793620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:57.793639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:57.793810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:57.793819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:57.793833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:57.793913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2052 partition: 0 MaxSeqNo: 42 sessionId: src_id|f01f53c3-9c014270-9770c1c9-661b65f1_0
2025-09-30T14:55:57.794253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd99928-6615c674-93586709-d62e6c25_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f01f53c3-9c014270-9770c1c9-661b65f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:57.797006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f01f53c3-9c014270-9770c1c9-661b65f1_0] Write session: try to update token
2025-09-30T14:55:57.797024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f01f53c3-9c014270-9770c1c9-661b65f1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:57.806310Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:57.806331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:57.806334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:57.806336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:57.806346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896121921504803:3784]
2025-09-30T14:55:57.806352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896121921504803:3784]
2025-09-30T14:55:57.806356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896121921504803:3784]
2025-09-30T14:55:57.806398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:57.806403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:57.806405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.806408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:57.806409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:57.806414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:57.806566Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:57.815159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2052 sessionId: src_id|f01f53c3-9c014270-9770c1c9-661b65f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:57.817916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:57.869588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896122011275647:5488]
2025-09-30T14:55:57.870221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2051, pipe: [1:7555896122011275647:5488]
2025-09-30T14:55:57.922645Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:57.923005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:57.923021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:57.923041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896122011275647:5488], now have 1 active actors on pipe
2025-09-30T14:55:57.923324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:57.923341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:57.923410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2052 reason: error at write: Disconnected sessionId: src_id|f01f53c3-9c014270-9770c1c9-661b65f1_0
2025-09-30T14:55:57.923758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f01f53c3-9c014270-9770c1c9-661b65f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:57.923770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f01f53c3-9c014270-9770c1c9-661b65f1_0] Write session will restart in 0.006883s
2025-09-30T14:55:57.923794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f01f53c3-9c014270-9770c1c9-661b65f1_0] Write session: Do CDS request
2025-09-30T14:55:57.923799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f01f53c3-9c014270-9770c1c9-661b65f1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:57.923602Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:57.923731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2052 sessionId: src_id|f01f53c3-9c014270-9770c1c9-661b65f1_0 is DEAD
2025-09-30T14:55:57.923782Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:57.923826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896122011275647:5488]
2025-09-30T14:55:57.931871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f01f53c3-9c014270-9770c1c9-661b65f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:57.935586Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:57.935603Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2053
2025-09-30T14:55:57.935762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2053 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:57.935797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2053 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:57.935811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2053 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:57.935815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:57.936327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2053 sessionId:  describe result for acl check
2025-09-30T14:55:57.936367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:57.936376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:57.936389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:57.936395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896122011275671:8805] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:57.936970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896122011275671:8805] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:57.939372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896122011275671:8805] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:57.942748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896122011275671:8805] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:57.942765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896122011275671:8805] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:57.942769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896122011275671:8805] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:57.942787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2053 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:57.945315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:57.947441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:57.947681Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:57.947686Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:57.947698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:57.947760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:57.947815Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896121921504950:3764]
2025-09-30T14:55:57.948498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:57.948857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:57.948901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:57.949237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:57.949309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:57.949310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:57.949311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:57.949312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:57.949313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:57.949314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:57.949315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:57.949317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:57.949318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:57.949319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:57.949320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.949321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.949322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.949324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:57.949325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:57.949330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:57.949341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:57.949345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:57.949349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:57.949352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:57.949356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:57.949360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:57.949364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:57.949368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:57.949373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:57.949376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.949380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.949383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.949386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:57.949390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:57.949401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:57.949410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:57.949415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:57.949421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:57.949425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:57.949430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:57.949434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:57.949440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:57.949447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:57.949467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:57.949472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:57.949476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:57.949481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:57.949486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:57.949490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:57.949495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:57.949499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:57.949504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:57.949508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:57.949513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:57.949518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.949523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.949527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.949532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.949536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.949541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.949545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:57.949550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:57.949555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:57.949560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:57.949604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:57.955617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:57.956719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:57.956740Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:57.956743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:57.956748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:57.956754Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2052 [2:7555896121921504950:3764]
2025-09-30T14:55:57.956772Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:57.956791Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:57.956794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:57.956798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:57.956800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:57.956818Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:57.956826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:57.956834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:57.956904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.956907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.956909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.956912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:57.956915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:57.956985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:57.956987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.957004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:57.957017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:57.957036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:57.957057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896122011275783:8805], now have 1 active actors on pipe
2025-09-30T14:55:57.957061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896122011275658:2454], now have 1 active actors on pipe
2025-09-30T14:55:57.957067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896121921504945:3764]
2025-09-30T14:55:57.957070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896121921504945:3764]
2025-09-30T14:55:57.957072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896121921504945:3764]
2025-09-30T14:55:57.957089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:57.957103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:57.957119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:57.957122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:57.957120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:57.957125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:57.957128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:57.957158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896121921504945:3764]
2025-09-30T14:55:57.957166Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:57.957182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:57.957611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2052
2025-09-30T14:55:57.957631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2052
2025-09-30T14:55:57.957774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:57.957789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:57.957815Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|faec5340-58313a3-71187440-dcb6602a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:57.957828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:57.957833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:57.957840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:57.957853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:57.957870Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:57.957899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:57.958076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:57.958083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:57.958098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:57.958209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2053 partition: 0 MaxSeqNo: 42 sessionId: src_id|faec5340-58313a3-71187440-dcb6602a_0
2025-09-30T14:55:57.958614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f01f53c3-9c014270-9770c1c9-661b65f1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|faec5340-58313a3-71187440-dcb6602a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:57.961899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|faec5340-58313a3-71187440-dcb6602a_0] Write session: try to update token
2025-09-30T14:55:57.961920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|faec5340-58313a3-71187440-dcb6602a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:57.971471Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:57.971493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:57.971503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896121921504945:3764]
2025-09-30T14:55:57.971552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:57.971557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:57.971747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:57.971907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:57.972157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:57.972322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:57.972562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:57.972609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:57.983862Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:57.983883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:57.983886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:57.983887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:57.983901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896121921504945:3764]
2025-09-30T14:55:57.983904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896121921504945:3764]
2025-09-30T14:55:57.983908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896121921504945:3764]
2025-09-30T14:55:57.983948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:57.983955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:57.983957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:57.983972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:57.983979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:57.983984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:57.984104Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:57.992670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2053 sessionId: src_id|faec5340-58313a3-71187440-dcb6602a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:57.995590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:58.023856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896126306243105:5488]
2025-09-30T14:55:58.024192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2052, pipe: [1:7555896126306243105:5488]
2025-09-30T14:55:58.102174Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:58.102667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:58.102677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:58.102699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896126306243105:5488], now have 1 active actors on pipe
2025-09-30T14:55:58.102947Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:58.102971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896126306243105:5488]
2025-09-30T14:55:58.103009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:58.103012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:58.103078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2053 reason: error at write: Disconnected sessionId: src_id|faec5340-58313a3-71187440-dcb6602a_0
2025-09-30T14:55:58.103305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2053 sessionId: src_id|faec5340-58313a3-71187440-dcb6602a_0 is DEAD
2025-09-30T14:55:58.103571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faec5340-58313a3-71187440-dcb6602a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:58.103584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faec5340-58313a3-71187440-dcb6602a_0] Write session will restart in 0.009921s
2025-09-30T14:55:58.103609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faec5340-58313a3-71187440-dcb6602a_0] Write session: Do CDS request
2025-09-30T14:55:58.103615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faec5340-58313a3-71187440-dcb6602a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:58.103387Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:58.114741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|faec5340-58313a3-71187440-dcb6602a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:58.114857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:58.114881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2054
2025-09-30T14:55:58.115474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2054 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:58.115512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2054 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:58.115518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2054 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:58.115522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:58.117542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2054 sessionId:  describe result for acl check
2025-09-30T14:55:58.117585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:58.117587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:58.117589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:58.117595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896126306243120:8793] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:58.118171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896126306243120:8793] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:58.121231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896126306243120:8793] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:58.124581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896126306243120:8793] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:58.124596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896126306243120:8793] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:58.124599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896126306243120:8793] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:58.124608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2054 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:58.131781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:58.134351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:58.134608Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:58.134612Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:58.134626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:58.134714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:58.134758Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896126216472386:3775]
2025-09-30T14:55:58.135416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:58.135816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:58.135875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:58.136207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:58.136278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:58.136279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:58.136281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:58.136282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:58.136283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:58.136285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:58.136286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:58.136287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:58.136288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:58.136290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:58.136291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.136292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.136293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.136295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:58.136296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:58.136302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:58.136313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:58.136318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:58.136322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:58.136326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:58.136330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:58.136334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:58.136337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:58.136341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:58.136345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:58.136349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.136353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.136357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.136361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:58.136365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:58.136375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:58.136383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:58.136389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:58.136395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:58.136400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:58.136405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:58.136409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:58.136415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:58.136422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:58.136427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:58.136432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:58.136437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:58.136441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:58.136447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:58.136452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:58.136456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:58.136461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:58.136466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:58.136471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:58.136476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:58.136481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.136487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.136492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.136497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.136503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.136509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.136514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:58.136520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:58.136525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:58.136530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:58.136580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:58.143097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:58.143997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:58.144022Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:58.144025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:58.144030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:58.144038Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2053 [2:7555896126216472386:3775]
2025-09-30T14:55:58.144056Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:58.144074Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:58.144083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:58.144086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:58.144089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:58.144104Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:58.144111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:58.144118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:58.144186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.144195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.144199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.144203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:58.144206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:58.144273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:58.144276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.144289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.144298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.144320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:58.144338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896126216472381:3775]
2025-09-30T14:55:58.144340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896126216472381:3775]
2025-09-30T14:55:58.144342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896126216472381:3775]
2025-09-30T14:55:58.144360Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:58.144375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:58.144389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:58.144398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:58.144436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896126216472381:3775]
2025-09-30T14:55:58.144444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:58.144445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:58.144448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:58.144450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:58.144456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:58.144479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896126306243109:2454], now have 1 active actors on pipe
2025-09-30T14:55:58.144489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896126306243162:8793], now have 1 active actors on pipe
2025-09-30T14:55:58.144705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2053
2025-09-30T14:55:58.144747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2053
2025-09-30T14:55:58.147784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faec5340-58313a3-71187440-dcb6602a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bdf43658-c4996b6a-cbc600c8-79b77b60_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:58.150537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdf43658-c4996b6a-cbc600c8-79b77b60_0] Write session: try to update token
2025-09-30T14:55:58.150561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdf43658-c4996b6a-cbc600c8-79b77b60_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:58.147232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2054 partition: 0 MaxSeqNo: 42 sessionId: src_id|bdf43658-c4996b6a-cbc600c8-79b77b60_0
2025-09-30T14:55:58.145175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:58.145191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:58.145221Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bdf43658-c4996b6a-cbc600c8-79b77b60_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:58.145228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:58.145232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:58.145234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:58.145243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:58.145253Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:58.145265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:58.147091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:58.147097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:58.147118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:58.168380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2054 sessionId: src_id|bdf43658-c4996b6a-cbc600c8-79b77b60_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:58.171201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:58.169329Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:58.169357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:58.169359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:58.169361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:58.169372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896126216472381:3775]
2025-09-30T14:55:58.169377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896126216472381:3775]
2025-09-30T14:55:58.169381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896126216472381:3775]
2025-09-30T14:55:58.169427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:58.169430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:58.169436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.169436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:58.169439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:58.169440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:58.169629Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:58.199525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896126306243265:5488]
2025-09-30T14:55:58.200010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2053, pipe: [1:7555896126306243265:5488]
2025-09-30T14:55:58.286730Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:58.287394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:58.287414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:58.287456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896126306243265:5488], now have 1 active actors on pipe
2025-09-30T14:55:58.287712Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:58.287693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:58.287733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896126306243265:5488]
2025-09-30T14:55:58.287746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:58.287749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:58.287823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2054 reason: error at write: Disconnected sessionId: src_id|bdf43658-c4996b6a-cbc600c8-79b77b60_0
2025-09-30T14:55:58.287999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2054 sessionId: src_id|bdf43658-c4996b6a-cbc600c8-79b77b60_0 is DEAD
2025-09-30T14:55:58.288426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdf43658-c4996b6a-cbc600c8-79b77b60_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:58.288437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdf43658-c4996b6a-cbc600c8-79b77b60_0] Write session will restart in 0.005740s
2025-09-30T14:55:58.288469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdf43658-c4996b6a-cbc600c8-79b77b60_0] Write session: Do CDS request
2025-09-30T14:55:58.288478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdf43658-c4996b6a-cbc600c8-79b77b60_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:58.295784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdf43658-c4996b6a-cbc600c8-79b77b60_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:58.296731Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:58.296748Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2055
2025-09-30T14:55:58.296909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2055 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:58.296966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2055 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:58.296972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2055 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:58.296977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:58.297402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2055 sessionId:  describe result for acl check
2025-09-30T14:55:58.297439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:58.297446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:58.297459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:58.297471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896126306243283:8786] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:58.298049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896126306243283:8786] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:58.300227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896126306243283:8786] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:58.303224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896126306243283:8786] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:58.303256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896126306243283:8786] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:58.303260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896126306243283:8786] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:58.303269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2055 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:58.308198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:58.311037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:58.311296Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:58.311306Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:58.311320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:58.311378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:58.311605Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896126216472527:3774]
2025-09-30T14:55:58.312273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:58.312656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:58.312719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:58.313082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:58.313181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:58.313191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:58.313192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:58.313194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:58.313195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:58.313197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:58.313198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:58.313200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:58.313201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:58.313202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:58.313204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.313205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.313207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.313209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:58.313210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:58.313216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:58.313227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:58.313232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:58.313237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:58.313242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:58.313246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:58.313251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:58.313256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:58.313260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:58.313265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:58.313269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.313274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.313278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.313282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:58.313286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:58.313312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:58.313327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:58.313333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:58.313339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:58.313344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:58.313349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:58.313355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:58.313361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:58.313367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:58.313373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:58.313384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:58.313389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:58.313395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:58.313418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:58.313429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:58.313435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:58.313447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:58.313470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:58.313475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:58.313485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:58.313491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.313501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.313505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.313511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.313516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.313521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.313527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:58.313533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:58.313537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:58.313544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:58.313593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:58.319801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:58.320854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:58.320875Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:58.320878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:58.320883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:58.320891Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2054 [2:7555896126216472527:3774]
2025-09-30T14:55:58.320908Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:58.320928Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:58.320937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:58.320941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:58.320943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:58.320961Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:58.320973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:58.320979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:58.321046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.321053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.321055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.321059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:58.321061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:58.321135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:58.321147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.321160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.321173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.321191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:58.321208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896126306243320:8786], now have 1 active actors on pipe
2025-09-30T14:55:58.321216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896126216472521:3774]
2025-09-30T14:55:58.321225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896126216472521:3774]
2025-09-30T14:55:58.321227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896126216472521:3774]
2025-09-30T14:55:58.321241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:58.321256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:58.321256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:58.321259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:58.321262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:58.321270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:58.321274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:58.321280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896126306243271:2454], now have 1 active actors on pipe
2025-09-30T14:55:58.321317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896126216472521:3774]
2025-09-30T14:55:58.321330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:58.321328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2054
2025-09-30T14:55:58.321371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2054
2025-09-30T14:55:58.321364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:58.321417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:58.321428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:58.321463Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53758263-96e5b072-69d430d2-c1a979a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:58.321478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:58.321486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:58.321489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:58.321498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:58.321512Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:58.321531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:58.321772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:58.321783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:58.321798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:58.321900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2055 partition: 0 MaxSeqNo: 42 sessionId: src_id|53758263-96e5b072-69d430d2-c1a979a3_0
2025-09-30T14:55:58.322260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdf43658-c4996b6a-cbc600c8-79b77b60_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|53758263-96e5b072-69d430d2-c1a979a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:58.325258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53758263-96e5b072-69d430d2-c1a979a3_0] Write session: try to update token
2025-09-30T14:55:58.325280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53758263-96e5b072-69d430d2-c1a979a3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:58.337404Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:58.337431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:58.337434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:58.337436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:58.337458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896126216472521:3774]
2025-09-30T14:55:58.337462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896126216472521:3774]
2025-09-30T14:55:58.337471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896126216472521:3774]
2025-09-30T14:55:58.337517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:58.337525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.337528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:58.337677Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:58.338852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:58.338870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:58.338879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:58.358160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2055 sessionId: src_id|53758263-96e5b072-69d430d2-c1a979a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:58.361142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:58.387950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896126306243420:5488]
2025-09-30T14:55:58.388362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2054, pipe: [1:7555896126306243420:5488]
2025-09-30T14:55:58.458618Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:58.458985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:58.459000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:58.459022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896126306243420:5488], now have 1 active actors on pipe
2025-09-30T14:55:58.459287Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:58.459316Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:58.459299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896126306243420:5488]
2025-09-30T14:55:58.459324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:58.459327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:58.459405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2055 reason: error at write: Disconnected sessionId: src_id|53758263-96e5b072-69d430d2-c1a979a3_0
2025-09-30T14:55:58.459591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2055 sessionId: src_id|53758263-96e5b072-69d430d2-c1a979a3_0 is DEAD
2025-09-30T14:55:58.459727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53758263-96e5b072-69d430d2-c1a979a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:58.459739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53758263-96e5b072-69d430d2-c1a979a3_0] Write session will restart in 0.006588s
2025-09-30T14:55:58.459772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53758263-96e5b072-69d430d2-c1a979a3_0] Write session: Do CDS request
2025-09-30T14:55:58.459778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53758263-96e5b072-69d430d2-c1a979a3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:58.467789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53758263-96e5b072-69d430d2-c1a979a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:58.467881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:58.467897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2056
2025-09-30T14:55:58.468026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2056 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:58.468058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2056 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:58.468067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2056 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:58.468071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:58.468601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2056 sessionId:  describe result for acl check
2025-09-30T14:55:58.468635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:58.468641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:58.468644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:58.468650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896126306243488:8791] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:58.469217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896126306243488:8791] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:58.471195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896126306243488:8791] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:58.471558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:58.473572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:58.473841Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:58.473856Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:58.473869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:58.473936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:58.473982Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896126216472670:3771]
2025-09-30T14:55:58.473953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896126306243488:8791] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:58.473971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896126306243488:8791] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:58.473975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896126306243488:8791] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:58.473982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2056 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:58.474657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:58.474971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:58.475023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:58.475390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:58.475480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:58.475492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:58.475493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:58.475494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:58.475496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:58.475497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:58.475498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:58.475499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:58.475503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:58.475504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:58.475505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.475506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.475507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.475508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:58.475509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:58.475516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:58.475526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:58.475531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:58.475535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:58.475539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:58.475543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:58.475546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:58.475550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:58.475554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:58.475559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:58.475563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.475566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.475569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.475572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:58.475575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:58.475584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:58.475592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:58.475598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:58.475604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:58.475609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:58.475615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:58.475620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:58.475625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:58.475630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:58.475637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:58.475642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:58.475647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:58.475651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:58.475657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:58.475661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:58.475667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:58.475673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:58.475679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:58.475683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:58.475688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:58.475694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.475699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.475702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.475707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.475712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.475717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.475726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:58.475731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:58.475741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:58.475747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:58.475795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:58.481561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:58.482648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:58.482668Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:58.482671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:58.482675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:58.482682Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2055 [2:7555896126216472670:3771]
2025-09-30T14:55:58.482699Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:58.482716Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:58.482725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:58.482728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:58.482734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:58.482751Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:58.482763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:58.482770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:58.482835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.482843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.482846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.482849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:58.482852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:58.482921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:58.482931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.482945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.482959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.482984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:58.483007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896126306243422:2454], now have 1 active actors on pipe
2025-09-30T14:55:58.483017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896126306243562:8791], now have 1 active actors on pipe
2025-09-30T14:55:58.483024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896126216472665:3771]
2025-09-30T14:55:58.483027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896126216472665:3771]
2025-09-30T14:55:58.483030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896126216472665:3771]
2025-09-30T14:55:58.483044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:58.483080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2055
2025-09-30T14:55:58.483087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2055
2025-09-30T14:55:58.483057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:58.483063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:58.483068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:58.483070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:58.483079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:58.483083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:58.483116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896126216472665:3771]
2025-09-30T14:55:58.483119Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:58.483122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:58.483139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:58.483144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:58.483203Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bde7f2e8-82835f22-d8971f2-b8aa0b68_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:58.483216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:58.483220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:58.483222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:58.483232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:58.483241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:58.483283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:58.483476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:58.483490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:58.483507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:58.483598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2056 partition: 0 MaxSeqNo: 42 sessionId: src_id|bde7f2e8-82835f22-d8971f2-b8aa0b68_0
2025-09-30T14:55:58.484024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53758263-96e5b072-69d430d2-c1a979a3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bde7f2e8-82835f22-d8971f2-b8aa0b68_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:58.486846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bde7f2e8-82835f22-d8971f2-b8aa0b68_0] Write session: try to update token
2025-09-30T14:55:58.486865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bde7f2e8-82835f22-d8971f2-b8aa0b68_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:58.496290Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:58.496314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:58.496316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:58.496318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:58.496328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896126216472665:3771]
2025-09-30T14:55:58.496333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896126216472665:3771]
2025-09-30T14:55:58.496338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896126216472665:3771]
2025-09-30T14:55:58.496376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:58.496380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:58.496384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.496386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:58.496386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:58.496390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:58.496553Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:58.503206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2056 sessionId: src_id|bde7f2e8-82835f22-d8971f2-b8aa0b68_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:58.505953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:58.559436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896126306243595:5488]
2025-09-30T14:55:58.559823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2055, pipe: [1:7555896126306243595:5488]
2025-09-30T14:55:58.617411Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:58.617901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:58.617920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:58.617961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896126306243595:5488], now have 1 active actors on pipe
2025-09-30T14:55:58.618312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:58.618337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:58.618407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2056 reason: error at write: Disconnected sessionId: src_id|bde7f2e8-82835f22-d8971f2-b8aa0b68_0
2025-09-30T14:55:58.618226Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:58.618584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2056 sessionId: src_id|bde7f2e8-82835f22-d8971f2-b8aa0b68_0 is DEAD
2025-09-30T14:55:58.618594Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:58.618645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896126306243595:5488]
2025-09-30T14:55:58.618773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde7f2e8-82835f22-d8971f2-b8aa0b68_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:58.618781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde7f2e8-82835f22-d8971f2-b8aa0b68_0] Write session will restart in 0.009522s
2025-09-30T14:55:58.618803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde7f2e8-82835f22-d8971f2-b8aa0b68_0] Write session: Do CDS request
2025-09-30T14:55:58.618812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde7f2e8-82835f22-d8971f2-b8aa0b68_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:58.629816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bde7f2e8-82835f22-d8971f2-b8aa0b68_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:58.629927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:58.629946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2057
2025-09-30T14:55:58.630078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2057 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:58.630114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2057 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:58.630120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2057 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:58.630125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:58.630666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2057 sessionId:  describe result for acl check
2025-09-30T14:55:58.630701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:58.630703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:58.630705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:58.630726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896126306243655:8775] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:58.631314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896126306243655:8775] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:58.634453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896126306243655:8775] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:58.635291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:58.637513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:58.637630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896126306243655:8775] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:58.637645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896126306243655:8775] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:58.637651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896126306243655:8775] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:58.637660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2057 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:58.637878Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:58.637892Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:58.637904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:58.637970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:58.638014Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896126216472849:3747]
2025-09-30T14:55:58.638669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:58.638990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:58.639064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:58.639452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:58.639530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:58.639539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:58.639540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:58.639542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:58.639543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:58.639544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:58.639545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:58.639546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:58.639549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:58.639551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:58.639552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.639553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.639555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.639556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:58.639557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:58.639563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:58.639573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:58.639578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:58.639582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:58.639587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:58.639590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:58.639594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:58.639599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:58.639602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:58.639607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:58.639611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.639616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.639619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.639623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:58.639627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:58.639635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:58.639643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:58.639649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:58.639655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:58.639660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:58.639665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:58.639669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:58.639674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:58.639681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:58.639687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:58.639691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:58.639697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:58.639702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:58.639706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:58.639711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:58.639716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:58.639721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:58.639726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:58.639730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:58.639735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:58.639740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.639746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.639750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.639756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.639760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.639765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.639769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:58.639775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:58.639780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:58.639795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:58.639841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:58.645624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:58.646718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:58.646736Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:58.646739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:58.646744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:58.646751Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2056 [2:7555896126216472849:3747]
2025-09-30T14:55:58.646769Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:58.646785Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:58.646788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:58.646791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:58.646797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:58.646814Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:58.646822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:58.646829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:58.646893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.646896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.646898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.646902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:58.646904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:58.646978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:58.646997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.647012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.647025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.647051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:58.647070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896126216472844:3747]
2025-09-30T14:55:58.647073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896126216472844:3747]
2025-09-30T14:55:58.647075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896126216472844:3747]
2025-09-30T14:55:58.647084Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:58.647098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:58.647103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:58.647107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:58.647109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:58.647120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:58.647124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:58.647135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896126306243736:8775], now have 1 active actors on pipe
2025-09-30T14:55:58.647139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896126306243597:2454], now have 1 active actors on pipe
2025-09-30T14:55:58.647171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896126216472844:3747]
2025-09-30T14:55:58.647189Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:58.647205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:58.647514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:58.647530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:58.647560Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54b2dfdb-4fd0f005-4a2f87c8-5f36d69a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:58.647571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:58.647575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:58.647577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:58.647587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:58.647598Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:58.647614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:58.647873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:58.647883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:58.647897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:58.649506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde7f2e8-82835f22-d8971f2-b8aa0b68_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|54b2dfdb-4fd0f005-4a2f87c8-5f36d69a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:58.647300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2056
2025-09-30T14:55:58.647341Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2056
2025-09-30T14:55:58.649088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2057 partition: 0 MaxSeqNo: 42 sessionId: src_id|54b2dfdb-4fd0f005-4a2f87c8-5f36d69a_0
2025-09-30T14:55:58.652264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54b2dfdb-4fd0f005-4a2f87c8-5f36d69a_0] Write session: try to update token
2025-09-30T14:55:58.652284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54b2dfdb-4fd0f005-4a2f87c8-5f36d69a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:58.668590Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:58.668612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:58.668621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896126216472844:3747]
2025-09-30T14:55:58.668671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:58.668687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:58.668852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:58.669015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:58.669190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:58.669348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:58.669574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:58.669623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:58.675502Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:58.675522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:58.675528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:58.675530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:58.675540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896126216472844:3747]
2025-09-30T14:55:58.675544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896126216472844:3747]
2025-09-30T14:55:58.675553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896126216472844:3747]
2025-09-30T14:55:58.675595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:58.675602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.675605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:58.675612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:58.675618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:58.675622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:58.675757Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:58.676591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2057 sessionId: src_id|54b2dfdb-4fd0f005-4a2f87c8-5f36d69a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:58.679548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:58.718663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896126306243750:5488]
2025-09-30T14:55:58.718955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2056, pipe: [1:7555896126306243750:5488]
2025-09-30T14:55:58.792407Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:58.792827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:58.792842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:58.792865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896126306243750:5488], now have 1 active actors on pipe
2025-09-30T14:55:58.793557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b2dfdb-4fd0f005-4a2f87c8-5f36d69a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:58.793569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b2dfdb-4fd0f005-4a2f87c8-5f36d69a_0] Write session will restart in 0.008070s
2025-09-30T14:55:58.793594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b2dfdb-4fd0f005-4a2f87c8-5f36d69a_0] Write session: Do CDS request
2025-09-30T14:55:58.793601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b2dfdb-4fd0f005-4a2f87c8-5f36d69a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:58.793127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:58.793143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:58.793207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2057 reason: error at write: Disconnected sessionId: src_id|54b2dfdb-4fd0f005-4a2f87c8-5f36d69a_0
2025-09-30T14:55:58.793400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2057 sessionId: src_id|54b2dfdb-4fd0f005-4a2f87c8-5f36d69a_0 is DEAD
2025-09-30T14:55:58.793584Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:58.793594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896126306243750:5488]
2025-09-30T14:55:58.793138Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:58.802773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54b2dfdb-4fd0f005-4a2f87c8-5f36d69a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:58.803544Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:58.803561Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2058
2025-09-30T14:55:58.803740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2058 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:58.803772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2058 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:58.803777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2058 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:58.803782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:58.805498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2058 sessionId:  describe result for acl check
2025-09-30T14:55:58.805538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:58.805542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:58.805543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:58.805549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896126306243857:8763] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:58.806037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896126306243857:8763] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:58.806589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:58.808888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:58.809133Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:58.809137Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:58.809148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:58.809207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:58.809241Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896126216473005:3745]
2025-09-30T14:55:58.809938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:58.810540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:58.810599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:58.810956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:58.811039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:58.811046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:58.811047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:58.811048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:58.811050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:58.811051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:58.811052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:58.811053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:58.811055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:58.811056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:58.811057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.811059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.811060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.811061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:58.811063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:58.811069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:58.811081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:58.811086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:58.811090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:58.811095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:58.811100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:58.811104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:58.811109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:58.811113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:58.811117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:58.811121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.811126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.811130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.811134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:58.811138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:58.811144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:58.811153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:58.811159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:58.811165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:58.811170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:58.811175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:58.811180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:58.811186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:58.811191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:58.811206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:58.811210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:58.811215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:58.811219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:58.811225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:58.811229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:58.811234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:58.811239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:58.811261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:58.811266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:58.811271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:58.811276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.811281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.811286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.811291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.811296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.811301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.811306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:58.811310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:58.811315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:58.811320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:58.811371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:58.811562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896126306243857:8763] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:58.820164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:58.820153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896126306243857:8763] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:58.820175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896126306243857:8763] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:58.820179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896126306243857:8763] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:58.820189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2058 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:58.821355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:58.821873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2057
2025-09-30T14:55:58.821876Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2057
2025-09-30T14:55:58.822809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2058 partition: 0 MaxSeqNo: 42 sessionId: src_id|43339e8d-64c8b6ec-10378fb0-fc29cb26_0
2025-09-30T14:55:58.823442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b2dfdb-4fd0f005-4a2f87c8-5f36d69a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|43339e8d-64c8b6ec-10378fb0-fc29cb26_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:58.821378Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:58.821389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:58.821393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:58.821401Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2057 [2:7555896126216473005:3745]
2025-09-30T14:55:58.821419Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:58.821439Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:58.821443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:58.821466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:58.821469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:58.821486Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:58.821494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:58.821502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:58.821564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.821566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.821570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.821573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:58.821576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:58.821652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:58.821655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.821668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.821678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.821694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:58.821711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896126216473000:3745]
2025-09-30T14:55:58.821714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896126216473000:3745]
2025-09-30T14:55:58.821716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896126216473000:3745]
2025-09-30T14:55:58.821724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:58.821738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896126306243897:8763], now have 1 active actors on pipe
2025-09-30T14:55:58.821744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896126306243752:2454], now have 1 active actors on pipe
2025-09-30T14:55:58.821747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:58.821749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:58.821751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:58.821753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:58.821764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:58.821768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:58.821803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896126216473000:3745]
2025-09-30T14:55:58.821813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:58.822028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:58.822270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:58.822278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:58.822316Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43339e8d-64c8b6ec-10378fb0-fc29cb26_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:58.822326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:58.822330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:58.822333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:58.822346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:58.822359Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:58.822377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:58.822680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:58.822686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:58.822706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:58.826378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43339e8d-64c8b6ec-10378fb0-fc29cb26_0] Write session: try to update token
2025-09-30T14:55:58.826400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43339e8d-64c8b6ec-10378fb0-fc29cb26_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:58.835875Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:58.835898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:58.835900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:58.835902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:58.835910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896126216473000:3745]
2025-09-30T14:55:58.835913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896126216473000:3745]
2025-09-30T14:55:58.835917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896126216473000:3745]
2025-09-30T14:55:58.835953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:58.835959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.835961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:58.835970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:58.835978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:58.835991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:58.836112Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:58.846711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2058 sessionId: src_id|43339e8d-64c8b6ec-10378fb0-fc29cb26_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:58.849606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:58.893873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896126306243917:5488]
2025-09-30T14:55:58.894167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2057, pipe: [1:7555896126306243917:5488]
2025-09-30T14:55:58.951021Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:58.951798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:58.951823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:58.951845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896126306243917:5488], now have 1 active actors on pipe
2025-09-30T14:55:58.954952Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:58.954957Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:58.955013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896126306243917:5488]
2025-09-30T14:55:58.955225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:58.955335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2058 reason: status is not ok: tablet will be restarted right now sessionId: src_id|43339e8d-64c8b6ec-10378fb0-fc29cb26_0
2025-09-30T14:55:58.955504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2058 sessionId: src_id|43339e8d-64c8b6ec-10378fb0-fc29cb26_0 is DEAD
2025-09-30T14:55:58.955731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43339e8d-64c8b6ec-10378fb0-fc29cb26_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:58.955744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43339e8d-64c8b6ec-10378fb0-fc29cb26_0] Write session will restart in 0.006263s
2025-09-30T14:55:58.955768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43339e8d-64c8b6ec-10378fb0-fc29cb26_0] Write session: Do CDS request
2025-09-30T14:55:58.955775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43339e8d-64c8b6ec-10378fb0-fc29cb26_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:58.962822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43339e8d-64c8b6ec-10378fb0-fc29cb26_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:58.962902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:58.962920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2059
2025-09-30T14:55:58.963086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2059 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:58.963125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2059 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:58.963130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2059 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:58.963135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:58.963675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2059 sessionId:  describe result for acl check
2025-09-30T14:55:58.963715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:58.963725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:58.963727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:58.963734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896126306243951:8762] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:58.964278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896126306243951:8762] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:58.967380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896126306243951:8762] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:58.969056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:58.972302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896126306243951:8762] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:58.972320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896126306243951:8762] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:58.972324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896126306243951:8762] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:58.972333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2059 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:58.975682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:58.975924Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:58.975935Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:58.975947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:58.976006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:58.976050Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896126216473153:3742]
2025-09-30T14:55:58.976585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:58.976976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:58.977059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:58.977431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:58.977539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:58.977548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:58.977550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:58.977551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:58.977552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:58.977554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:58.977555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:58.977556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:58.977558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:58.977559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:58.977560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.977562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.977564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.977565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:58.977566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:58.977573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:58.977584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:58.977589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:58.977593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:58.977597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:58.977602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:58.977606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:58.977610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:58.977615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:58.977620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:58.977624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.977628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.977633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.977638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:58.977642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:58.977653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:58.977661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:58.977667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:58.977674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:58.977679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:58.977685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:58.977695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:58.977702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:58.977713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:58.977721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:58.977732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:58.977738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:58.977749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:58.977755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:58.977764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:58.977770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:58.977780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:58.977786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:58.977790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:58.977796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:58.977806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.977812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.977821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.977827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.977839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.977850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.977855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:58.977862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:58.977873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:58.977879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:58.977938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:58.983941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:58.984993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:58.985017Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:58.985021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:58.985026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:58.985034Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2058 [2:7555896126216473153:3742]
2025-09-30T14:55:58.985054Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:58.985080Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:58.985088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:58.985092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:58.985095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:58.985128Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:58.985141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:58.985148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:58.985225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.985233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.985236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.985240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:58.985243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:58.985328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:58.985341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:58.985357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:58.985369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:58.985386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:58.985405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896126306244061:8762], now have 1 active actors on pipe
2025-09-30T14:55:58.985409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896126306243922:2454], now have 1 active actors on pipe
2025-09-30T14:55:58.985416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896126216473147:3742]
2025-09-30T14:55:58.985419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896126216473147:3742]
2025-09-30T14:55:58.985422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896126216473147:3742]
2025-09-30T14:55:58.985437Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:58.985471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:58.985467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2058
2025-09-30T14:55:58.985476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:58.985473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2058
2025-09-30T14:55:58.985481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:58.985483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:58.985489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:58.985494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:58.985534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896126216473147:3742]
2025-09-30T14:55:58.985546Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:58.985554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:58.985573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:58.985582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:58.985850Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|229e9799-91e70ca9-ee26304c-83963a87_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:58.985864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:58.985868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:58.985870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:58.985881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:58.985891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:58.985918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:58.986086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:58.986095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:58.986109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:58.986232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2059 partition: 0 MaxSeqNo: 42 sessionId: src_id|229e9799-91e70ca9-ee26304c-83963a87_0
2025-09-30T14:55:58.986602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43339e8d-64c8b6ec-10378fb0-fc29cb26_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|229e9799-91e70ca9-ee26304c-83963a87_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:58.989583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|229e9799-91e70ca9-ee26304c-83963a87_0] Write session: try to update token
2025-09-30T14:55:58.989605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|229e9799-91e70ca9-ee26304c-83963a87_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:59.000767Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:59.000786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:59.000788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:59.000790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:59.000801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896126216473147:3742]
2025-09-30T14:55:59.000806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896126216473147:3742]
2025-09-30T14:55:59.000811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896126216473147:3742]
2025-09-30T14:55:59.000853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:59.000860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.000863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:59.000862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:59.000868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:59.000876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:59.001011Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:59.009995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2059 sessionId: src_id|229e9799-91e70ca9-ee26304c-83963a87_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:59.012912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:59.050954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896130601211368:5488]
2025-09-30T14:55:59.051325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2058, pipe: [1:7555896130601211368:5488]
2025-09-30T14:55:59.116961Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:59.117378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:59.117397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:59.117452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896130601211368:5488], now have 1 active actors on pipe
2025-09-30T14:55:59.117751Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:59.117781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896130601211368:5488]
2025-09-30T14:55:59.117813Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:59.117832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:59.117843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:59.118232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|229e9799-91e70ca9-ee26304c-83963a87_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:59.118245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|229e9799-91e70ca9-ee26304c-83963a87_0] Write session will restart in 0.007458s
2025-09-30T14:55:59.118268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|229e9799-91e70ca9-ee26304c-83963a87_0] Write session: Do CDS request
2025-09-30T14:55:59.118273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|229e9799-91e70ca9-ee26304c-83963a87_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:59.117902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2059 reason: error at write: Disconnected sessionId: src_id|229e9799-91e70ca9-ee26304c-83963a87_0
2025-09-30T14:55:59.118083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2059 sessionId: src_id|229e9799-91e70ca9-ee26304c-83963a87_0 is DEAD
2025-09-30T14:55:59.127766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|229e9799-91e70ca9-ee26304c-83963a87_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:59.127906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:59.127922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2060
2025-09-30T14:55:59.128047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2060 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:59.128083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2060 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:59.128093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2060 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:59.128097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:59.128512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2060 sessionId:  describe result for acl check
2025-09-30T14:55:59.128543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:59.128553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:59.128555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:59.128561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896130601211435:8755] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:59.129134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896130601211435:8755] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:59.131530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896130601211435:8755] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:59.132888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:59.135382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:59.135586Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:59.135600Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:59.135612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:59.135664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:59.135703Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896130511440594:3740]
2025-09-30T14:55:59.135790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896130601211435:8755] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:59.135805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896130601211435:8755] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:59.135809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896130601211435:8755] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:59.135817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2060 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:59.136383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:59.136694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:59.136740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:59.137056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:59.137124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:59.137131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:59.137132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:59.137133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:59.137135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:59.137136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:59.137137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:59.137138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:59.137139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:59.137140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:59.137141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.137142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.137144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.137145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:59.137146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:59.137152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:59.137162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:59.137167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:59.137171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:59.137175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:59.137180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:59.137185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:59.137189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:59.137193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:59.137198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:59.137202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.137206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.137209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.137214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:59.137218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:59.137224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:59.137232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:59.137238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:59.137244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:59.137248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:59.137254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:59.137258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:59.137264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:59.137269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:59.137274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:59.137278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:59.137284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:59.137289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:59.137294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:59.137299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:59.137304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:59.137309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:59.137314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:59.137319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:59.137324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:59.137329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.137340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.137345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.137350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.137360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.137365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.137375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:59.137380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:59.137385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:59.137395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:59.137437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:59.143314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:59.144572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:59.144587Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:59.144591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:59.144595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:59.144609Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2059 [2:7555896130511440594:3740]
2025-09-30T14:55:59.144629Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:59.144648Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:59.144659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:59.144662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:59.144664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:59.144681Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:59.144688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:59.144695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:59.144758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.144765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.144767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.144771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:59.144774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:59.144844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:59.144852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.144865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.144879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.144898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:59.144914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896130511440589:3740]
2025-09-30T14:55:59.144917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896130511440589:3740]
2025-09-30T14:55:59.144919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896130511440589:3740]
2025-09-30T14:55:59.144930Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:59.144939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:59.144948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:59.144956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:59.144958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:59.144963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:59.144966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:59.144976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896130601211370:2454], now have 1 active actors on pipe
2025-09-30T14:55:59.144987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896130601211514:8755], now have 1 active actors on pipe
2025-09-30T14:55:59.145028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896130511440589:3740]
2025-09-30T14:55:59.145042Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:59.145088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:59.145294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2059
2025-09-30T14:55:59.145337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2059
2025-09-30T14:55:59.145415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:59.145425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:59.145461Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4dfe7c3d-3856f9d3-6b3e0d57-6950a2e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:59.145470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:59.145477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:59.145480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:59.145493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:59.145510Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:59.145541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:59.145875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:59.145883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:59.145903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:59.146014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2060 partition: 0 MaxSeqNo: 42 sessionId: src_id|4dfe7c3d-3856f9d3-6b3e0d57-6950a2e9_0
2025-09-30T14:55:59.146375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|229e9799-91e70ca9-ee26304c-83963a87_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4dfe7c3d-3856f9d3-6b3e0d57-6950a2e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:59.149490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dfe7c3d-3856f9d3-6b3e0d57-6950a2e9_0] Write session: try to update token
2025-09-30T14:55:59.149512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dfe7c3d-3856f9d3-6b3e0d57-6950a2e9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:59.160025Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:59.160047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:59.160051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:59.160055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:59.160069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896130511440589:3740]
2025-09-30T14:55:59.160077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896130511440589:3740]
2025-09-30T14:55:59.160083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896130511440589:3740]
2025-09-30T14:55:59.160143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:59.160146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:59.160156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:59.160160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:59.160163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.160166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:59.160380Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:59.167177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2060 sessionId: src_id|4dfe7c3d-3856f9d3-6b3e0d57-6950a2e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:59.170007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:59.217868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896130601211530:5488]
2025-09-30T14:55:59.218148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2059, pipe: [1:7555896130601211530:5488]
2025-09-30T14:55:59.275519Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:59.275812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:59.275824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:59.275841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896130601211530:5488], now have 1 active actors on pipe
2025-09-30T14:55:59.276021Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:59.276149Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:59.276151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:59.276156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:59.276209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896130601211530:5488]
2025-09-30T14:55:59.276560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dfe7c3d-3856f9d3-6b3e0d57-6950a2e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:59.276575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dfe7c3d-3856f9d3-6b3e0d57-6950a2e9_0] Write session will restart in 0.005098s
2025-09-30T14:55:59.276599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dfe7c3d-3856f9d3-6b3e0d57-6950a2e9_0] Write session: Do CDS request
2025-09-30T14:55:59.276606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dfe7c3d-3856f9d3-6b3e0d57-6950a2e9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:59.276224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2060 reason: error at write: Disconnected sessionId: src_id|4dfe7c3d-3856f9d3-6b3e0d57-6950a2e9_0
2025-09-30T14:55:59.276420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2060 sessionId: src_id|4dfe7c3d-3856f9d3-6b3e0d57-6950a2e9_0 is DEAD
2025-09-30T14:55:59.282807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dfe7c3d-3856f9d3-6b3e0d57-6950a2e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:59.282880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:59.282897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2061
2025-09-30T14:55:59.283072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2061 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:59.283111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2061 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:59.283116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2061 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:59.283121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:59.283610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2061 sessionId:  describe result for acl check
2025-09-30T14:55:59.283646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:59.283652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:59.283655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:59.283661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896130601211550:8738] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:59.284224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896130601211550:8738] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:59.287775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896130601211550:8738] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:59.290625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:59.293236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:59.293434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896130601211550:8738] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:59.293462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896130601211550:8738] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:59.293466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896130601211550:8738] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:59.293474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2061 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:59.293625Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:59.293644Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:59.293663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:59.293760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:59.293834Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896130511440741:3739]
2025-09-30T14:55:59.294533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:59.294890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:59.294934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:59.295276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:59.295341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:59.295352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:59.295354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:59.295355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:59.295356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:59.295358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:59.295359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:59.295360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:59.295362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:59.295363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:59.295364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.295365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.295367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.295368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:59.295369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:59.295375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:59.295384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:59.295388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:59.295392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:59.295396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:59.295401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:59.295406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:59.295410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:59.295414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:59.295419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:59.295423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.295427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.295432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.295436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:59.295440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:59.295447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:59.295455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:59.295461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:59.295467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:59.295472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:59.295478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:59.295482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:59.295488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:59.295493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:59.295499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:59.295504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:59.295509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:59.295514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:59.295520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:59.295525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:59.295531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:59.295537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:59.295542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:59.295547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:59.295553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:59.295558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.295563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.295568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.295572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.295579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.295585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.295596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:59.295602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:59.295607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:59.295612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:59.295662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:59.301166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:59.302134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:59.302151Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:59.302154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:59.302158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:59.302164Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2060 [2:7555896130511440741:3739]
2025-09-30T14:55:59.302181Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:59.302198Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:59.302206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:59.302209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:59.302211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:59.302227Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:59.302242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:59.302253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:59.302318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.302325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.302328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.302332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:59.302335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:59.302404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:59.302412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.302425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.302438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.302462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:59.302487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896130601211534:2454], now have 1 active actors on pipe
2025-09-30T14:55:59.302496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896130601211678:8738], now have 1 active actors on pipe
2025-09-30T14:55:59.302502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896130511440736:3739]
2025-09-30T14:55:59.302510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896130511440736:3739]
2025-09-30T14:55:59.302515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896130511440736:3739]
2025-09-30T14:55:59.302528Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:59.302547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:59.302546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:59.302550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:59.302552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:59.302566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:59.302569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:59.302602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896130511440736:3739]
2025-09-30T14:55:59.302610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:59.302613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:59.302578Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2060
2025-09-30T14:55:59.302588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2060
2025-09-30T14:55:59.302641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:59.302651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:59.302684Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9be4c14f-d8a7fb63-235a40cf-4fd7080e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:59.302699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:59.302707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:59.302709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:59.302722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:59.302735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:59.302756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:59.302891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:59.302900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:59.302916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:59.303006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2061 partition: 0 MaxSeqNo: 42 sessionId: src_id|9be4c14f-d8a7fb63-235a40cf-4fd7080e_0
2025-09-30T14:55:59.303372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dfe7c3d-3856f9d3-6b3e0d57-6950a2e9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9be4c14f-d8a7fb63-235a40cf-4fd7080e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:59.306071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be4c14f-d8a7fb63-235a40cf-4fd7080e_0] Write session: try to update token
2025-09-30T14:55:59.306089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be4c14f-d8a7fb63-235a40cf-4fd7080e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:59.315141Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:59.315164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:59.315166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:59.315168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:59.315178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896130511440736:3739]
2025-09-30T14:55:59.315184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896130511440736:3739]
2025-09-30T14:55:59.315188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896130511440736:3739]
2025-09-30T14:55:59.315235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:59.315259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.315262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:59.315268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:59.315275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:59.315279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:59.315402Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:59.321165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2061 sessionId: src_id|9be4c14f-d8a7fb63-235a40cf-4fd7080e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:59.324131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:59.379329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896130601211690:5488]
2025-09-30T14:55:59.383334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2060, pipe: [1:7555896130601211690:5488]
2025-09-30T14:55:59.437647Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:59.437992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:59.438007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:59.438047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896130601211690:5488], now have 1 active actors on pipe
2025-09-30T14:55:59.438296Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:59.438332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:59.438342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896130601211690:5488]
2025-09-30T14:55:59.438381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:59.438610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2061 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9be4c14f-d8a7fb63-235a40cf-4fd7080e_0
2025-09-30T14:55:59.438795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2061 sessionId: src_id|9be4c14f-d8a7fb63-235a40cf-4fd7080e_0 is DEAD
2025-09-30T14:55:59.438929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9be4c14f-d8a7fb63-235a40cf-4fd7080e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:59.438949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9be4c14f-d8a7fb63-235a40cf-4fd7080e_0] Write session will restart in 0.006805s
2025-09-30T14:55:59.438973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9be4c14f-d8a7fb63-235a40cf-4fd7080e_0] Write session: Do CDS request
2025-09-30T14:55:59.438980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9be4c14f-d8a7fb63-235a40cf-4fd7080e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:59.446788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be4c14f-d8a7fb63-235a40cf-4fd7080e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:59.446901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:59.446918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2062
2025-09-30T14:55:59.447110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2062 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:59.447164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2062 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:59.447177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2062 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:59.447181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:59.447775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2062 sessionId:  describe result for acl check
2025-09-30T14:55:59.447812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:59.447820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:59.447822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:59.447828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896130601211732:8737] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:59.448396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896130601211732:8737] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:59.451186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896130601211732:8737] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:59.452231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:59.454748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:59.454995Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:59.455005Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:59.455017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:59.455072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:59.455121Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896130511440891:3733]
2025-09-30T14:55:59.455130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896130601211732:8737] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:59.455148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896130601211732:8737] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:59.455153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896130601211732:8737] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:59.455162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2062 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:59.455794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:59.456155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:59.456204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:59.456571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:59.456634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:59.456640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:59.456642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:59.456644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:59.456645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:59.456646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:59.456647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:59.456648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:59.456650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:59.456651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:59.456653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.456654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.456655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.456656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:59.456658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:59.456664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:59.456675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:59.456679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:59.456684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:59.456688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:59.456692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:59.456696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:59.456701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:59.456705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:59.456710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:59.456714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.456718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.456722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.456726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:59.456730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:59.456738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:59.456745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:59.456751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:59.456758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:59.456764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:59.456769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:59.456774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:59.456780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:59.456785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:59.456791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:59.456796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:59.456802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:59.456807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:59.456812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:59.456817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:59.456822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:59.456830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:59.456835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:59.456839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:59.456845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:59.456850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.456855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.456859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.456864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.456869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.456875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.456879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:59.456884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:59.456889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:59.456894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:59.456942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:59.463454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:59.464690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:59.464706Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:59.464709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:59.464713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:59.464721Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2061 [2:7555896130511440891:3733]
2025-09-30T14:55:59.464742Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:59.464758Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:59.464762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:59.464765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:59.464768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:59.464784Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:59.464796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:59.464804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:59.464867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.464873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.464876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.464879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:59.464882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:59.464954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:59.464961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.464976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.464992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.465012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:59.465035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896130601211691:2454], now have 1 active actors on pipe
2025-09-30T14:55:59.465045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896130601211836:8737], now have 1 active actors on pipe
2025-09-30T14:55:59.465051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896130511440886:3733]
2025-09-30T14:55:59.465053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896130511440886:3733]
2025-09-30T14:55:59.465056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896130511440886:3733]
2025-09-30T14:55:59.465070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:59.465085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:59.465092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:59.465096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:59.465098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:59.465104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:59.465108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:59.465146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896130511440886:3733]
2025-09-30T14:55:59.465158Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:59.465164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:59.465187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2061
2025-09-30T14:55:59.465238Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2061
2025-09-30T14:55:59.465287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:59.465297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:59.465323Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3bab7fe-e3423d7c-a54d9262-e3fda7f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:59.465335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:59.465339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:59.465342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:59.465355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:59.465365Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:59.465385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:59.465774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:59.465805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:59.465834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:59.465985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2062 partition: 0 MaxSeqNo: 42 sessionId: src_id|3bab7fe-e3423d7c-a54d9262-e3fda7f2_0
2025-09-30T14:55:59.466397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9be4c14f-d8a7fb63-235a40cf-4fd7080e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3bab7fe-e3423d7c-a54d9262-e3fda7f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:59.469330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bab7fe-e3423d7c-a54d9262-e3fda7f2_0] Write session: try to update token
2025-09-30T14:55:59.469350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bab7fe-e3423d7c-a54d9262-e3fda7f2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:59.478512Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:59.478535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:59.478546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896130511440886:3733]
2025-09-30T14:55:59.478598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:59.478607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:59.478836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:59.479080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:59.479343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:59.479519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:59.479732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:59.479778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:59.484419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2062 sessionId: src_id|3bab7fe-e3423d7c-a54d9262-e3fda7f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:59.487114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:59.487565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:59.487596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:59.487634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:59.487712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:59.489246Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:59.489266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:59.489268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:59.489271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:59.489280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896130511440886:3733]
2025-09-30T14:55:59.489284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896130511440886:3733]
2025-09-30T14:55:59.489290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896130511440886:3733]
2025-09-30T14:55:59.489329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:59.489338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:59.489344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.489347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:59.489347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:59.489351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:59.489513Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:59.538396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896130601211848:5488]
2025-09-30T14:55:59.538735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2061, pipe: [1:7555896130601211848:5488]
2025-09-30T14:55:59.615784Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:59.624914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:59.624946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:59.625143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:59.625215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:59.625287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:59.625359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:59.625676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:59.625690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:59.625772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:59.625840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:59.625920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:59.626002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:59.626055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:59.626065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:59.626141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:59.626209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:59.626281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:59.626360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:59.626402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:59.626416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:59.626490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:59.626565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:59.626634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:59.626702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:59.626749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:59.626759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:59.626836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:59.626903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:59.626974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:59.627048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:59.627096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:59.627104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:59.627180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:59.627300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:59.627366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:59.627432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:59.627481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:59.627491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:59.627563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:59.627629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:59.627703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:59.627775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:59.627827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:59.627835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:59.627910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:59.627975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:59.628043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:59.628111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:59.628157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:59.628164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:59.628237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:59.628304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:59.628372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:59.628449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:59.628496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:59.628503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:59.628574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:59.628642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:59.628712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:59.628781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:59.628830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:59.628838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:59.628912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896130601211848:5488], now have 1 active actors on pipe
2025-09-30T14:55:59.629203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896130601211848:5488]
2025-09-30T14:55:59.629203Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:59.629259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:59.629262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:59.629292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2062 reason: error at write: Disconnected sessionId: src_id|3bab7fe-e3423d7c-a54d9262-e3fda7f2_0
2025-09-30T14:55:59.629692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bab7fe-e3423d7c-a54d9262-e3fda7f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:59.629703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bab7fe-e3423d7c-a54d9262-e3fda7f2_0] Write session will restart in 0.007816s
2025-09-30T14:55:59.629728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bab7fe-e3423d7c-a54d9262-e3fda7f2_0] Write session: Do CDS request
2025-09-30T14:55:59.629734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bab7fe-e3423d7c-a54d9262-e3fda7f2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:59.629524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2062 sessionId: src_id|3bab7fe-e3423d7c-a54d9262-e3fda7f2_0 is DEAD
2025-09-30T14:55:59.629998Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:59.638800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bab7fe-e3423d7c-a54d9262-e3fda7f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:59.638939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:59.638956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2063
2025-09-30T14:55:59.639578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2063 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:59.639619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2063 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:59.639625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2063 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:59.639629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:59.640174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2063 sessionId:  describe result for acl check
2025-09-30T14:55:59.640216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:59.640222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:59.640224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:59.640230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896130601211961:8720] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:59.640820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896130601211961:8720] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:59.643201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:59.643379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896130601211961:8720] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:59.645544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:59.645755Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:59.645769Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:59.645779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:59.645832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:59.645872Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896130511441075:3708]
2025-09-30T14:55:59.646133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896130601211961:8720] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:59.646145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896130601211961:8720] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:59.646148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896130601211961:8720] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:59.646157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2063 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:59.646536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:59.646834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:59.646892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:59.647241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:59.647319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:59.647329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:59.647330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:59.647331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:59.647333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:59.647334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:59.647336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:59.647337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:59.647338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:59.647339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:59.647340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.647342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.647343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.647344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:59.647345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:59.647351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:59.647361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:59.647365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:59.647370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:59.647373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:59.647377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:59.647381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:59.647386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:59.647390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:59.647395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:59.647398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.647402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.647406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.647410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:59.647415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:59.647422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:59.647430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:59.647437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:59.647443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:59.647448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:59.647453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:59.647458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:59.647463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:59.647468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:59.647473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:59.647478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:59.647484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:59.647489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:59.647494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:59.647499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:59.647505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:59.647510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:59.647516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:59.647520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:59.647525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:59.647530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.647537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.647541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.647545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.647549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.647553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.647558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:59.647562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:59.647567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:59.647572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:59.647614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:59.653728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:59.654715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:59.654729Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:59.654731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:59.654735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:59.654741Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2062 [2:7555896130511441075:3708]
2025-09-30T14:55:59.654758Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:59.654777Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:59.654780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:59.654783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:59.654785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:59.654800Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:59.654807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:59.654817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:59.654877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.654887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.654890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.654893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:59.654896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:59.654984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:59.654993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.655005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.655016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.655030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:59.655047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896130511441070:3708]
2025-09-30T14:55:59.655049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896130511441070:3708]
2025-09-30T14:55:59.655051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896130511441070:3708]
2025-09-30T14:55:59.655065Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:59.655081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:59.655095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:59.655098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:59.655129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:59.655134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896130511441070:3708]
2025-09-30T14:55:59.655136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:59.655142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:59.655144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:59.655151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:59.655310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896130601212018:8720], now have 1 active actors on pipe
2025-09-30T14:55:59.655319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896130601211875:2454], now have 1 active actors on pipe
2025-09-30T14:55:59.655409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2062
2025-09-30T14:55:59.655409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2062
2025-09-30T14:55:59.655462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:59.655472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:59.655504Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e191a0f1-f25325df-2ef7dc5-2c2f75cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:59.655517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:59.655526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:59.655529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:59.655543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:59.655559Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:59.655577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:59.655741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:59.655751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:59.655768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:59.655886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2063 partition: 0 MaxSeqNo: 42 sessionId: src_id|e191a0f1-f25325df-2ef7dc5-2c2f75cb_0
2025-09-30T14:55:59.656266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bab7fe-e3423d7c-a54d9262-e3fda7f2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e191a0f1-f25325df-2ef7dc5-2c2f75cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:59.659237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e191a0f1-f25325df-2ef7dc5-2c2f75cb_0] Write session: try to update token
2025-09-30T14:55:59.659793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e191a0f1-f25325df-2ef7dc5-2c2f75cb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:59.668771Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:59.668793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:59.668795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:59.668798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:59.668812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896130511441070:3708]
2025-09-30T14:55:59.668816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896130511441070:3708]
2025-09-30T14:55:59.668820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896130511441070:3708]
2025-09-30T14:55:59.668863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:59.668869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.668871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:59.668873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:59.668877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:59.668882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:59.669022Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:59.678221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2063 sessionId: src_id|e191a0f1-f25325df-2ef7dc5-2c2f75cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:59.680908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:59.729357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896130601212031:5488]
2025-09-30T14:55:59.729649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2062, pipe: [1:7555896130601212031:5488]
2025-09-30T14:55:59.786783Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:59.787068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:59.787080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:59.787098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896130601212031:5488], now have 1 active actors on pipe
2025-09-30T14:55:59.787325Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:59.787416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896130601212031:5488]
2025-09-30T14:55:59.787556Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:59.787559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:59.787630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2063 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e191a0f1-f25325df-2ef7dc5-2c2f75cb_0
2025-09-30T14:55:59.787805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2063 sessionId: src_id|e191a0f1-f25325df-2ef7dc5-2c2f75cb_0 is DEAD
2025-09-30T14:55:59.788025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e191a0f1-f25325df-2ef7dc5-2c2f75cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:55:59.788041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e191a0f1-f25325df-2ef7dc5-2c2f75cb_0] Write session will restart in 0.008430s
2025-09-30T14:55:59.788070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e191a0f1-f25325df-2ef7dc5-2c2f75cb_0] Write session: Do CDS request
2025-09-30T14:55:59.788077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e191a0f1-f25325df-2ef7dc5-2c2f75cb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:59.797778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e191a0f1-f25325df-2ef7dc5-2c2f75cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:59.797957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:59.797977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2064
2025-09-30T14:55:59.798147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2064 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:59.798181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2064 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:59.798191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2064 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:59.798195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:59.798685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2064 sessionId:  describe result for acl check
2025-09-30T14:55:59.798723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:59.798725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:59.798727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:59.798733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896130601212063:8713] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:59.799299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896130601212063:8713] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:59.804084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896130601212063:8713] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:59.805588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:59.808250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:59.808463Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:59.808476Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:59.808487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:59.808556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:59.808604Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896130511441236:3709]
2025-09-30T14:55:59.808724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896130601212063:8713] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:59.808741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896130601212063:8713] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:59.808745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896130601212063:8713] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:59.808753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2064 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:59.809298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:59.809618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:59.809668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:59.810028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:59.810092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:59.810099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:59.810100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:59.810101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:59.810102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:59.810104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:59.810106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:59.810107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:59.810108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:59.810110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:59.810111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.810113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.810114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.810115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:59.810116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:59.810122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:59.810134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:59.810139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:59.810144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:59.810149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:59.810153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:59.810158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:59.810162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:59.810166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:59.810171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:59.810175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.810179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.810183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.810188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:59.810191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:59.810199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:59.810208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:59.810215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:59.810221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:59.810242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:59.810253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:59.810258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:59.810264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:59.810275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:59.810280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:59.810287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:59.810305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:59.810317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:59.810323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:59.810328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:59.810334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:59.810340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:59.810345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:59.810350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:59.810356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:59.810362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.810368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.810373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.810379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.810384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.810390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.810403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:59.810410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:59.810419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:59.810424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:59.810476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:55:59.816195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:55:59.817139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:55:59.817156Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:55:59.817159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:55:59.817163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:55:59.817171Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2063 [2:7555896130511441236:3709]
2025-09-30T14:55:59.817187Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:55:59.817205Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:55:59.817208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:59.817212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:59.817214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:59.817230Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:55:59.817237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:55:59.817245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:55:59.817313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.817326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.817329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.817333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:55:59.817335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:55:59.817407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:55:59.817418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.817432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.817457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.817476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:55:59.817496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896130511441231:3709]
2025-09-30T14:55:59.817499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896130511441231:3709]
2025-09-30T14:55:59.817501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896130511441231:3709]
2025-09-30T14:55:59.817517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:55:59.817535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:55:59.817559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:55:59.817562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:55:59.817569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:55:59.817579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:55:59.817583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:55:59.817599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896130511441231:3709]
2025-09-30T14:55:59.817602Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:55:59.817634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:55:59.817656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896130601212180:8713], now have 1 active actors on pipe
2025-09-30T14:55:59.817666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896130601212034:2454], now have 1 active actors on pipe
2025-09-30T14:55:59.817757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2063
2025-09-30T14:55:59.817793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2063
2025-09-30T14:55:59.817952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:59.817963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:59.817992Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6db9fe9f-e304aa51-e913fddc-df42b0d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:55:59.818001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:55:59.818005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:55:59.818007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:55:59.818017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:55:59.818028Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:55:59.818042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:59.818751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:59.818759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:59.818777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:55:59.819166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2064 partition: 0 MaxSeqNo: 42 sessionId: src_id|6db9fe9f-e304aa51-e913fddc-df42b0d1_0
2025-09-30T14:55:59.819614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e191a0f1-f25325df-2ef7dc5-2c2f75cb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6db9fe9f-e304aa51-e913fddc-df42b0d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:55:59.822542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6db9fe9f-e304aa51-e913fddc-df42b0d1_0] Write session: try to update token
2025-09-30T14:55:59.822562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6db9fe9f-e304aa51-e913fddc-df42b0d1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:55:59.832679Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:55:59.832697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:59.832706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896130511441231:3709]
2025-09-30T14:55:59.832749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:55:59.832761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:55:59.832930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:55:59.833070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:59.833215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:59.833352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:55:59.833560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:55:59.833593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:55:59.839530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2064 sessionId: src_id|6db9fe9f-e304aa51-e913fddc-df42b0d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:55:59.842643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:55:59.843028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:59.843050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:59.843099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:55:59.843218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:55:59.849003Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:55:59.849025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:55:59.849028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:55:59.849030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:55:59.849040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896130511441231:3709]
2025-09-30T14:55:59.849044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896130511441231:3709]
2025-09-30T14:55:59.849048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896130511441231:3709]
2025-09-30T14:55:59.849090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:55:59.849099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.849102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:55:59.849262Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:55:59.850068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:55:59.850078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:55:59.850082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:55:59.887559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896130601212204:5488]
2025-09-30T14:55:59.887853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2063, pipe: [1:7555896130601212204:5488]
2025-09-30T14:55:59.961795Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:55:59.962058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896130601212204:5488], now have 1 active actors on pipe
2025-09-30T14:55:59.971072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:55:59.971106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:55:59.974722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896130601212204:5488]
2025-09-30T14:55:59.974754Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:55:59.971386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:59.971458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:59.971521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:59.971588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:59.971634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:59.971639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:59.971717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:59.971775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:59.971833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:59.971890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:59.971929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:59.971936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:59.972001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:59.972065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:59.972121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:59.972179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:59.972215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:59.972218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:59.972281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:59.972335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:59.972393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:59.972450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:59.972488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:59.972490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:59.972563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:59.972623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:59.972698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:59.972754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:59.972792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:59.972794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:59.972858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:59.972908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:59.972964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:59.973023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:59.973061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:59.973063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:59.973126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:59.973179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:59.973245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:59.973307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:59.973351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:59.973353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:59.973419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:59.973491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:59.973557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:59.973629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:59.973666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:59.973668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:59.973732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:59.973785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:59.973837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:59.973890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:59.973929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:59.973931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:59.974007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:55:59.974065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:55:59.974125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:55:59.974195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:55:59.974236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:55:59.974238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:55:59.975585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:55:59.975596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:55:59.975622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2064 reason: error at write: Disconnected sessionId: src_id|6db9fe9f-e304aa51-e913fddc-df42b0d1_0
2025-09-30T14:55:59.975807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2064 sessionId: src_id|6db9fe9f-e304aa51-e913fddc-df42b0d1_0 is DEAD
2025-09-30T14:55:59.976040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6db9fe9f-e304aa51-e913fddc-df42b0d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:55:59.976051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6db9fe9f-e304aa51-e913fddc-df42b0d1_0] Write session will restart in 0.006944s
2025-09-30T14:55:59.976074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6db9fe9f-e304aa51-e913fddc-df42b0d1_0] Write session: Do CDS request
2025-09-30T14:55:59.976079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6db9fe9f-e304aa51-e913fddc-df42b0d1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:55:59.976071Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:55:59.984024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6db9fe9f-e304aa51-e913fddc-df42b0d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:59.984133Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:55:59.984148Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2065
2025-09-30T14:55:59.984323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2065 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:55:59.984364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2065 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:55:59.984370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2065 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:55:59.984375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:55:59.984886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2065 sessionId:  describe result for acl check
2025-09-30T14:55:59.984924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:55:59.984931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:55:59.984933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:55:59.984940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896130601212224:8707] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:55:59.985506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896130601212224:8707] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:55:59.988550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896130601212224:8707] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:55:59.992380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896130601212224:8707] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:55:59.992396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896130601212224:8707] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:55:59.992400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896130601212224:8707] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:55:59.992408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2065 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:55:59.994556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:55:59.995548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:55:59.995739Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:55:59.995743Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:55:59.995754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:55:59.995803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:55:59.995843Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896130511441389:3700]
2025-09-30T14:55:59.996525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:55:59.997904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:55:59.997952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:55:59.998340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:55:59.998418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:59.998424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:59.998426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:59.998427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:59.998428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:59.998430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:59.998431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:59.998433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:59.998434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:59.998436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:59.998437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.998438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.998440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.998441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:59.998443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:59.998449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:59.998459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:59.998463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:59.998467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:59.998472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:59.998477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:59.998481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:59.998486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:59.998490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:59.998495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:59.998499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.998503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.998507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.998512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:59.998517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:59.998526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:59.998542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:55:59.998549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:59.998555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:55:59.998560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:59.998572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:55:59.998577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:59.998587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:55:59.998594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:59.998604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:55:59.998611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:59.998621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:55:59.998626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:59.998638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:55:59.998645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:59.998650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:55:59.998660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:59.998666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:55:59.998675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:59.998681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:55:59.998692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.998699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:55:59.998709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.998714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:55:59.998724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.998730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:55:59.998739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:59.998745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:55:59.998754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:59.998760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:55:59.998812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:00.006249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2064
2025-09-30T14:56:00.006287Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2064
2025-09-30T14:56:00.006842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2065 partition: 0 MaxSeqNo: 42 sessionId: src_id|89697625-f402f68b-b1a7511e-e4e757ab_0
2025-09-30T14:56:00.007293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6db9fe9f-e304aa51-e913fddc-df42b0d1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|89697625-f402f68b-b1a7511e-e4e757ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:00.004791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:00.005825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:00.005833Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:00.005836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:00.005840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:00.005847Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2064 [2:7555896130511441389:3700]
2025-09-30T14:56:00.005865Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:00.005883Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:00.005887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:00.005891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:00.005893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:00.005911Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:00.005918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:00.005926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:00.005989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.005991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:00.005994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:00.005998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:00.006001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:00.006080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:00.006084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.006099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:00.006113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:00.006130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:00.006151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896130601212349:8707], now have 1 active actors on pipe
2025-09-30T14:56:00.006155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896130601212209:2454], now have 1 active actors on pipe
2025-09-30T14:56:00.006161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896130511441384:3700]
2025-09-30T14:56:00.006164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896130511441384:3700]
2025-09-30T14:56:00.006167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896130511441384:3700]
2025-09-30T14:56:00.006182Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:00.006194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:00.006198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:00.006200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:00.006214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:00.006230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:00.006234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:00.006268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896130511441384:3700]
2025-09-30T14:56:00.006278Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:00.006282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:00.006453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:00.006459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:00.006492Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89697625-f402f68b-b1a7511e-e4e757ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:00.006499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:00.006504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:00.006506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:00.006519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:00.006529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:00.006545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:00.006727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:00.006731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:00.006745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:00.010168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89697625-f402f68b-b1a7511e-e4e757ab_0] Write session: try to update token
2025-09-30T14:56:00.010189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89697625-f402f68b-b1a7511e-e4e757ab_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:00.020271Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:00.020289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:00.020300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896130511441384:3700]
2025-09-30T14:56:00.020349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:00.020355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:00.020538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:00.020685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:00.020848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:00.020995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:00.021190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:00.021227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:00.034508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2065 sessionId: src_id|89697625-f402f68b-b1a7511e-e4e757ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:00.037368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:00.038972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:00.038995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:00.039015Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:00.039018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:00.039021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:00.039024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:00.039033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896130511441384:3700]
2025-09-30T14:56:00.039037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896130511441384:3700]
2025-09-30T14:56:00.039042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896130511441384:3700]
2025-09-30T14:56:00.039096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:00.039106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.039109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:00.039260Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:00.039292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:00.039298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:00.039303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:00.074949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896134896179661:5488]
2025-09-30T14:56:00.075270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2064, pipe: [1:7555896134896179661:5488]
2025-09-30T14:56:00.149634Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:00.150250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:00.150290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896134896179661:5488], now have 1 active actors on pipe
2025-09-30T14:56:00.150410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:00.150469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:00.150524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:00.150526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896134896179661:5488]
2025-09-30T14:56:00.150534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:00.150620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2065 reason: error at write: Disconnected sessionId: src_id|89697625-f402f68b-b1a7511e-e4e757ab_0
2025-09-30T14:56:00.150851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2065 sessionId: src_id|89697625-f402f68b-b1a7511e-e4e757ab_0 is DEAD
2025-09-30T14:56:00.150953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89697625-f402f68b-b1a7511e-e4e757ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:00.150964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89697625-f402f68b-b1a7511e-e4e757ab_0] Write session will restart in 0.006734s
2025-09-30T14:56:00.150987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89697625-f402f68b-b1a7511e-e4e757ab_0] Write session: Do CDS request
2025-09-30T14:56:00.150993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89697625-f402f68b-b1a7511e-e4e757ab_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:00.158745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89697625-f402f68b-b1a7511e-e4e757ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:00.158846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:00.158862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2066
2025-09-30T14:56:00.159428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2066 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:00.159481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2066 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:00.159492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2066 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:00.159497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:00.160028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2066 sessionId:  describe result for acl check
2025-09-30T14:56:00.160064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:00.160074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:00.160076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:00.160082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896134896179677:8690] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:00.160674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896134896179677:8690] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:00.163120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896134896179677:8690] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:00.165977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896134896179677:8690] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:00.165996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896134896179677:8690] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:00.165999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896134896179677:8690] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:00.166008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2066 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:00.170791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:00.173155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:00.173418Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:00.173430Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:00.173453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:00.173509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:00.173565Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896134806408837:3698]
2025-09-30T14:56:00.174254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:00.174541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:00.174587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:00.174923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:00.175005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:00.175011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:00.175012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:00.175014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:00.175015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:00.175017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:00.175019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:00.175020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:00.175022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:00.175023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:00.175025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.175026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:00.175027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:00.175028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:00.175030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:00.175035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:00.175046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:00.175051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:00.175055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:00.175059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:00.175064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:00.175068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:00.175073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:00.175077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:00.175086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:00.175091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.175100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:00.175104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:00.175112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:00.175115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:00.175124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:00.175133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:00.175139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:00.175144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:00.175149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:00.175155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:00.175162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:00.175172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:00.175177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:00.175187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:00.175192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:00.175201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:00.175212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:00.175222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:00.175230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:00.175236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:00.175259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:00.175269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:00.175274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:00.175280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:00.175289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.175295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.175305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:00.175310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:00.175317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:00.175326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:00.175335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:00.175345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:00.175354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:00.175360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:00.175412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:00.181182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:00.182201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:00.182217Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:00.182221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:00.182226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:00.182234Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2065 [2:7555896134806408837:3698]
2025-09-30T14:56:00.182255Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:00.182272Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:00.182276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:00.182280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:00.182282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:00.182301Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:00.182309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:00.182316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:00.182384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.182393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:00.182395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:00.182401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:00.182404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:00.182478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:00.182485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.182500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:00.182517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:00.182539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:00.182562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896134806408832:3698]
2025-09-30T14:56:00.182569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896134806408832:3698]
2025-09-30T14:56:00.182572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896134806408832:3698]
2025-09-30T14:56:00.182586Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:00.182605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896134896179738:8690], now have 1 active actors on pipe
2025-09-30T14:56:00.182604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:00.182608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:00.182611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:00.182613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896134896179666:2454], now have 1 active actors on pipe
2025-09-30T14:56:00.182622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:00.182638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:00.182646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:00.182685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896134806408832:3698]
2025-09-30T14:56:00.182694Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:00.182668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2065
2025-09-30T14:56:00.182731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2065
2025-09-30T14:56:00.182725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:00.182848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:00.182858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:00.182883Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87249e1b-4f38dfb-2d0bf82d-a01da66f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:00.182894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:00.182903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:00.182905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:00.182916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:00.182929Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:00.182950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:00.183177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:00.183188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:00.183206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:00.183342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2066 partition: 0 MaxSeqNo: 42 sessionId: src_id|87249e1b-4f38dfb-2d0bf82d-a01da66f_0
2025-09-30T14:56:00.183764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89697625-f402f68b-b1a7511e-e4e757ab_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|87249e1b-4f38dfb-2d0bf82d-a01da66f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:00.186730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87249e1b-4f38dfb-2d0bf82d-a01da66f_0] Write session: try to update token
2025-09-30T14:56:00.186749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87249e1b-4f38dfb-2d0bf82d-a01da66f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:00.195452Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:00.195475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:00.195486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896134806408832:3698]
2025-09-30T14:56:00.195535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:00.195540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:00.195755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:00.195909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:00.196070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:00.196224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:00.196449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:00.196495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:00.206710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2066 sessionId: src_id|87249e1b-4f38dfb-2d0bf82d-a01da66f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:00.207043Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:00.207062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:00.207065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:00.207068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:00.207079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896134806408832:3698]
2025-09-30T14:56:00.207084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896134806408832:3698]
2025-09-30T14:56:00.207090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896134806408832:3698]
2025-09-30T14:56:00.207134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:00.207143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.207152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:00.207153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:00.207160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:00.207164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:00.207324Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:00.209676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:00.250574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896134896179832:5488]
2025-09-30T14:56:00.250946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2065, pipe: [1:7555896134896179832:5488]
2025-09-30T14:56:00.323909Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:00.324322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:00.324344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:00.324381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896134896179832:5488], now have 1 active actors on pipe
2025-09-30T14:56:00.324634Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:00.324665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896134896179832:5488]
2025-09-30T14:56:00.324667Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:00.324713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:00.324793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2066 reason: status is not ok: tablet will be restarted right now sessionId: src_id|87249e1b-4f38dfb-2d0bf82d-a01da66f_0
2025-09-30T14:56:00.324994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2066 sessionId: src_id|87249e1b-4f38dfb-2d0bf82d-a01da66f_0 is DEAD
2025-09-30T14:56:00.325168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87249e1b-4f38dfb-2d0bf82d-a01da66f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:00.325177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87249e1b-4f38dfb-2d0bf82d-a01da66f_0] Write session will restart in 0.008542s
2025-09-30T14:56:00.325204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87249e1b-4f38dfb-2d0bf82d-a01da66f_0] Write session: Do CDS request
2025-09-30T14:56:00.325214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87249e1b-4f38dfb-2d0bf82d-a01da66f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:00.334853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87249e1b-4f38dfb-2d0bf82d-a01da66f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:00.334976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:00.334995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2067
2025-09-30T14:56:00.335133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2067 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:00.335178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2067 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:00.335190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2067 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:00.335194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:00.335779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2067 sessionId:  describe result for acl check
2025-09-30T14:56:00.335822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:00.335827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:00.335833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:00.335840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896134896179862:8691] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:00.336493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896134896179862:8691] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:00.339806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896134896179862:8691] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:00.342415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:00.342605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896134896179862:8691] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:00.342624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896134896179862:8691] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:00.342628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896134896179862:8691] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:00.342637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2067 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:00.345073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:00.345332Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:00.345344Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:00.345356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:00.345417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:00.345479Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896134806408989:3696]
2025-09-30T14:56:00.346152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:00.346475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:00.346523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:00.346902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:00.346979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:00.346989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:00.346990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:00.346992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:00.346993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:00.346995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:00.346996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:00.346997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:00.346998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:00.347000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:00.347001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.347002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:00.347003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:00.347005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:00.347006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:00.347013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:00.347023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:00.347028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:00.347032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:00.347036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:00.347040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:00.347044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:00.347048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:00.347052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:00.347059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:00.347062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.347066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:00.347070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:00.347075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:00.347079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:00.347088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:00.347097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:00.347104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:00.347110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:00.347115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:00.347122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:00.347127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:00.347133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:00.347139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:00.347144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:00.347150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:00.347156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:00.347175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:00.347181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:00.347191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:00.347198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:00.347209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:00.347214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:00.347218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:00.347223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:00.347233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.347239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.347264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:00.347269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:00.347274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:00.347279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:00.347284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:00.347289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:00.347294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:00.347299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:00.347345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:00.353376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:00.354600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:00.354621Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:00.354624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:00.354629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:00.354636Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2066 [2:7555896134806408989:3696]
2025-09-30T14:56:00.354655Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:00.354673Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:00.354676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:00.354680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:00.354682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:00.354701Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:00.354709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:00.354717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:00.354790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.354800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:00.354802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:00.354806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:00.354809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:00.354886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:00.354894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.354908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:00.354918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:00.354939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:00.354963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896134806408983:3696]
2025-09-30T14:56:00.354965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896134806408983:3696]
2025-09-30T14:56:00.354967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896134806408983:3696]
2025-09-30T14:56:00.354975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:00.354992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:00.354997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:00.355001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:00.355004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:00.355012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:00.355014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:00.355025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896134896179984:8691], now have 1 active actors on pipe
2025-09-30T14:56:00.355029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896134896179834:2454], now have 1 active actors on pipe
2025-09-30T14:56:00.355064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896134806408983:3696]
2025-09-30T14:56:00.355081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:00.355122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:00.355171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2066
2025-09-30T14:56:00.355189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2066
2025-09-30T14:56:00.355309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:00.355342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:00.355378Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ab133a5-5bad19d9-cae7afef-74ac45d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:00.355393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:00.355397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:00.355400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:00.355412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:00.355431Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:00.355458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:00.355754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:00.355763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:00.355794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:00.355927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2067 partition: 0 MaxSeqNo: 42 sessionId: src_id|1ab133a5-5bad19d9-cae7afef-74ac45d3_0
2025-09-30T14:56:00.356340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87249e1b-4f38dfb-2d0bf82d-a01da66f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1ab133a5-5bad19d9-cae7afef-74ac45d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:00.359661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ab133a5-5bad19d9-cae7afef-74ac45d3_0] Write session: try to update token
2025-09-30T14:56:00.359687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ab133a5-5bad19d9-cae7afef-74ac45d3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:00.370636Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:00.370661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:00.370673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896134806408983:3696]
2025-09-30T14:56:00.370731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:00.370932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:00.371104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:00.371317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:00.371480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:00.371708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:00.371763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:00.372409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:00.377593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2067 sessionId: src_id|1ab133a5-5bad19d9-cae7afef-74ac45d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:00.380858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:00.382058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:00.382085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:00.382125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:00.382275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:00.383866Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:00.383886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:00.383888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:00.383893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:00.383905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896134806408983:3696]
2025-09-30T14:56:00.383909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896134806408983:3696]
2025-09-30T14:56:00.383913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896134806408983:3696]
2025-09-30T14:56:00.383957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:00.383966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.383968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:00.383973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:00.383981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:00.383986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:00.384136Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:00.424697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896134896179996:5488]
2025-09-30T14:56:00.425273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2066, pipe: [1:7555896134896179996:5488]
2025-09-30T14:56:00.511330Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:00.520187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:00.520220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:00.520412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:00.520482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:00.520550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:00.520624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:00.521259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:00.521273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:00.521375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:00.521455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:00.521523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:00.521597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:00.521643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:00.521651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:00.521724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:00.521797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:00.521873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:00.521946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:00.521992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:00.522000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:00.522074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:00.522145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:00.522215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:00.522285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:00.522333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:00.522342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:00.522413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:00.522483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:00.522555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:00.522626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:00.522778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:00.522789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:00.522868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:00.522935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:00.523003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:00.523073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:00.523215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:00.523223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:00.523311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:00.523375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:00.523452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:00.523525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:00.523571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:00.523578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:00.523650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:00.523713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:00.523785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:00.523851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:00.523905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:00.523912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:00.523986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:00.524052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:00.524123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:00.524193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:00.524240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:00.524247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:00.524322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:00.524393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:00.524459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:00.524534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:00.524586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:00.524599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:00.524686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896134896179996:5488], now have 1 active actors on pipe
2025-09-30T14:56:00.524988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896134896179996:5488]
2025-09-30T14:56:00.524996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:00.525027Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:00.525059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2067 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1ab133a5-5bad19d9-cae7afef-74ac45d3_0
2025-09-30T14:56:00.525297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2067 sessionId: src_id|1ab133a5-5bad19d9-cae7afef-74ac45d3_0 is DEAD
2025-09-30T14:56:00.524926Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:00.525566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ab133a5-5bad19d9-cae7afef-74ac45d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:00.525584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ab133a5-5bad19d9-cae7afef-74ac45d3_0] Write session will restart in 0.008149s
2025-09-30T14:56:00.525618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ab133a5-5bad19d9-cae7afef-74ac45d3_0] Write session: Do CDS request
2025-09-30T14:56:00.525625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ab133a5-5bad19d9-cae7afef-74ac45d3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:00.534913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ab133a5-5bad19d9-cae7afef-74ac45d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:00.535143Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:00.535161Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2068
2025-09-30T14:56:00.535318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2068 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:00.535378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2068 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:00.535392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2068 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:00.535397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:00.536089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2068 sessionId:  describe result for acl check
2025-09-30T14:56:00.536134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:00.536145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:00.536147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:00.536154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896134896180040:8686] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:00.536770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896134896180040:8686] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:00.539997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896134896180040:8686] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:00.542126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:00.545374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896134896180040:8686] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:00.545392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896134896180040:8686] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:00.545396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896134896180040:8686] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:00.545406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2068 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:00.547534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:00.547931Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:00.547947Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:00.547961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:00.548033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:00.548092Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896134806409144:3678]
2025-09-30T14:56:00.548814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:00.549260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:00.549329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:00.549727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:00.549812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:00.549821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:00.549822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:00.549824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:00.549826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:00.549827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:00.549829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:00.549831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:00.549832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:00.549834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:00.549835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.549837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:00.549839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:00.549840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:00.549842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:00.549849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:00.549862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:00.549867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:00.549873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:00.549878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:00.549882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:00.549887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:00.549891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:00.549896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:00.549901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:00.549906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.549910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:00.549914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:00.549918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:00.549923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:00.549932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:00.549941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:00.549948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:00.549955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:00.549963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:00.549974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:00.549980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:00.549987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:00.550011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:00.550017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:00.550023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:00.550029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:00.550035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:00.550041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:00.550047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:00.550053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:00.550059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:00.550066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:00.550071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:00.550094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:00.550104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.550110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.550116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:00.550122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:00.550128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:00.550134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:00.550146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:00.550153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:00.550165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:00.550177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:00.550229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:00.556376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:00.557556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:00.557575Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:00.557578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:00.557583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:00.557590Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2067 [2:7555896134806409144:3678]
2025-09-30T14:56:00.557609Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:00.557627Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:00.557631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:00.557635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:00.557637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:00.557657Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:00.557671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:00.557678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:00.557746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.557754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:00.557756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:00.557760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:00.557762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:00.557838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:00.557850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.557866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:00.557880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:00.557898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:00.557918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896134896180150:8686], now have 1 active actors on pipe
2025-09-30T14:56:00.557922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896134896179999:2454], now have 1 active actors on pipe
2025-09-30T14:56:00.557928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896134806409138:3678]
2025-09-30T14:56:00.557931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896134806409138:3678]
2025-09-30T14:56:00.557933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896134806409138:3678]
2025-09-30T14:56:00.557945Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:00.557961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:00.557961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:00.557965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:00.557968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:00.557977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:00.557981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:00.558021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896134806409138:3678]
2025-09-30T14:56:00.558033Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:00.558039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:00.558059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2067
2025-09-30T14:56:00.558068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2067
2025-09-30T14:56:00.558145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:00.558162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:00.558198Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64066a1b-1ff30ad3-4983c3e-7cca2c0f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:00.558214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:00.558219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:00.558222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:00.558239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:00.558257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:00.558277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:00.558465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:00.558477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:00.558500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:00.559131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2068 partition: 0 MaxSeqNo: 42 sessionId: src_id|64066a1b-1ff30ad3-4983c3e-7cca2c0f_0
2025-09-30T14:56:00.559573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ab133a5-5bad19d9-cae7afef-74ac45d3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|64066a1b-1ff30ad3-4983c3e-7cca2c0f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:00.562783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64066a1b-1ff30ad3-4983c3e-7cca2c0f_0] Write session: try to update token
2025-09-30T14:56:00.562809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64066a1b-1ff30ad3-4983c3e-7cca2c0f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:00.571765Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:00.571786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:00.571789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:00.571792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:00.571803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896134806409138:3678]
2025-09-30T14:56:00.571809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896134806409138:3678]
2025-09-30T14:56:00.571815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896134806409138:3678]
2025-09-30T14:56:00.571858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:00.571867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.571870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:00.571868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:00.571874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:00.571879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:00.572027Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:00.581047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2068 sessionId: src_id|64066a1b-1ff30ad3-4983c3e-7cca2c0f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:00.584105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:00.625420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896134896180175:5488]
2025-09-30T14:56:00.625742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2067, pipe: [1:7555896134896180175:5488]
2025-09-30T14:56:00.693666Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:00.694170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:00.694191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:00.694595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:00.694606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:00.694612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:00.694670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896134896180175:5488]
2025-09-30T14:56:00.694690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2068 reason: error at write: Disconnected sessionId: src_id|64066a1b-1ff30ad3-4983c3e-7cca2c0f_0
2025-09-30T14:56:00.694216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896134896180175:5488], now have 1 active actors on pipe
2025-09-30T14:56:00.694945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2068 sessionId: src_id|64066a1b-1ff30ad3-4983c3e-7cca2c0f_0 is DEAD
2025-09-30T14:56:00.694537Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:00.695577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64066a1b-1ff30ad3-4983c3e-7cca2c0f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:00.695595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64066a1b-1ff30ad3-4983c3e-7cca2c0f_0] Write session will restart in 0.005610s
2025-09-30T14:56:00.695628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64066a1b-1ff30ad3-4983c3e-7cca2c0f_0] Write session: Do CDS request
2025-09-30T14:56:00.695641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64066a1b-1ff30ad3-4983c3e-7cca2c0f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:00.703408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64066a1b-1ff30ad3-4983c3e-7cca2c0f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:00.703548Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:00.703567Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2069
2025-09-30T14:56:00.703791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2069 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:00.703845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2069 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:00.703875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2069 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:00.703880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:00.704312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2069 sessionId:  describe result for acl check
2025-09-30T14:56:00.704348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:00.704356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:00.704359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:00.704365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896134896180217:8672] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:00.704978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896134896180217:8672] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:00.707988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896134896180217:8672] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:00.710078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:00.712105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:00.712451Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:00.712463Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:00.712475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:00.712540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:00.712585Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896134806409334:3671]
2025-09-30T14:56:00.712877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896134896180217:8672] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:00.712897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896134896180217:8672] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:00.712901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896134896180217:8672] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:00.712910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2069 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:00.713279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:00.713595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:00.713645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:00.713993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:00.714259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:00.714271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:00.714272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:00.714274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:00.714275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:00.714276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:00.714278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:00.714280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:00.714281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:00.714282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:00.714284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.714286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:00.714287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:00.714288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:00.714289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:00.714296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:00.714307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:00.714312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:00.714316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:00.714321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:00.714325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:00.714329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:00.714333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:00.714338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:00.714343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:00.714347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.714352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:00.714356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:00.714361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:00.714365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:00.714374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:00.714382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:00.714389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:00.714394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:00.714399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:00.714405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:00.714410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:00.714416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:00.714421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:00.714427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:00.714433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:00.714440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:00.714445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:00.714450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:00.714457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:00.714462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:00.714466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:00.714471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:00.714476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:00.714482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:00.714486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.714491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.714496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:00.714501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:00.714506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:00.714512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:00.714518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:00.714524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:00.714528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:00.714533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:00.714580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:00.722374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:00.723460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:00.723484Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:00.723487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:00.723492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:00.723500Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2068 [2:7555896134806409334:3671]
2025-09-30T14:56:00.723520Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:00.723536Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:00.723546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:00.723549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:00.723552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:00.723571Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:00.723578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:00.723591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:00.723661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.723675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:00.723677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:00.723680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:00.723683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:00.723888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:00.723900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.723916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:00.723931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:00.723921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2068
2025-09-30T14:56:00.723953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:00.723924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2068
2025-09-30T14:56:00.723980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896134896180340:8672], now have 1 active actors on pipe
2025-09-30T14:56:00.723985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896134896180187:2454], now have 1 active actors on pipe
2025-09-30T14:56:00.723993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896134806409329:3671]
2025-09-30T14:56:00.723995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896134806409329:3671]
2025-09-30T14:56:00.723997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896134806409329:3671]
2025-09-30T14:56:00.724013Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:00.724028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:00.724038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:00.724041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:00.724043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:00.724043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:00.724057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:00.724072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:00.724076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:00.724131Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e55d21eb-b9df118d-101247af-9c379c11_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:00.724146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:00.724153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:00.724156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:00.724167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:00.724177Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:00.724194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896134806409329:3671]
2025-09-30T14:56:00.724203Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:00.724210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:00.724232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:00.724389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:00.724402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:00.724423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:00.724544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2069 partition: 0 MaxSeqNo: 42 sessionId: src_id|e55d21eb-b9df118d-101247af-9c379c11_0
2025-09-30T14:56:00.725097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64066a1b-1ff30ad3-4983c3e-7cca2c0f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e55d21eb-b9df118d-101247af-9c379c11_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:00.728853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e55d21eb-b9df118d-101247af-9c379c11_0] Write session: try to update token
2025-09-30T14:56:00.728881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e55d21eb-b9df118d-101247af-9c379c11_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:00.737068Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:00.737093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:00.737096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:00.737098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:00.737109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896134806409329:3671]
2025-09-30T14:56:00.737114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896134806409329:3671]
2025-09-30T14:56:00.737118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896134806409329:3671]
2025-09-30T14:56:00.737162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:00.737170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.737173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:00.737333Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:00.739875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:00.739893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:00.739897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:00.753424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2069 sessionId: src_id|e55d21eb-b9df118d-101247af-9c379c11_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:00.756551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:00.794833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896134896180352:5488]
2025-09-30T14:56:00.795405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2068, pipe: [1:7555896134896180352:5488]
2025-09-30T14:56:00.854906Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:00.855338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:00.855353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:00.855375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896134896180352:5488], now have 1 active actors on pipe
2025-09-30T14:56:00.855661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:00.855699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:00.855705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:00.855763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896134896180352:5488]
2025-09-30T14:56:00.855780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2069 reason: error at write: Disconnected sessionId: src_id|e55d21eb-b9df118d-101247af-9c379c11_0
2025-09-30T14:56:00.856093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e55d21eb-b9df118d-101247af-9c379c11_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:00.856102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e55d21eb-b9df118d-101247af-9c379c11_0] Write session will restart in 0.007926s
2025-09-30T14:56:00.856125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e55d21eb-b9df118d-101247af-9c379c11_0] Write session: Do CDS request
2025-09-30T14:56:00.856131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e55d21eb-b9df118d-101247af-9c379c11_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:00.856186Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:00.855964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2069 sessionId: src_id|e55d21eb-b9df118d-101247af-9c379c11_0 is DEAD
2025-09-30T14:56:00.864800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e55d21eb-b9df118d-101247af-9c379c11_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:00.864961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:00.864976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2070
2025-09-30T14:56:00.865099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2070 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:00.865134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2070 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:00.865144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2070 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:00.865149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:00.865643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2070 sessionId:  describe result for acl check
2025-09-30T14:56:00.865694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:00.865697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:00.865700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:00.865707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896134896180379:8666] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:00.866306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896134896180379:8666] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:00.871196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:00.873530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896134896180379:8666] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:00.873508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:00.873751Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:00.873757Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:00.873769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:00.873836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:00.873874Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896134806409502:3666]
2025-09-30T14:56:00.874509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:00.874978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:00.875055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:00.875418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:00.875486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:00.875493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:00.875494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:00.875495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:00.875496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:00.875498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:00.875499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:00.875500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:00.875501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:00.875502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:00.875504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.875505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:00.875506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:00.875508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:00.875509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:00.875514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:00.875523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:00.875527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:00.875531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:00.875535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:00.875539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:00.875543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:00.875547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:00.875551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:00.875555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:00.875560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.875564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:00.875568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:00.875572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:00.875576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:00.875584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:00.875592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:00.875598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:00.875603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:00.875610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:00.875614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:00.875619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:00.875624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:00.875628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:00.875633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:00.875638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:00.875643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:00.875648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:00.875655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:00.875660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:00.875666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:00.875673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:00.875679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:00.875689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:00.875695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:00.875702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.875712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.875717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:00.875722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:00.875728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:00.875745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:00.875749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:00.875755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:00.875759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:00.875764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:00.875805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:00.876616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896134896180379:8666] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:00.876636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896134896180379:8666] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:00.876640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896134896180379:8666] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:00.876648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2070 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:00.881586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:00.882809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:00.882833Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:00.882836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:00.882839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:00.882847Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2069 [2:7555896134806409502:3666]
2025-09-30T14:56:00.882864Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:00.882880Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:00.882884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:00.882887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:00.882890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:00.882906Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:00.882913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:00.882921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:00.882996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.883004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:00.883006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:00.883009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:00.883012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:00.883082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:00.883091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.883103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:00.883116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:00.883134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:00.883155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896134896180509:8666], now have 1 active actors on pipe
2025-09-30T14:56:00.883165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896134896180353:2454], now have 1 active actors on pipe
2025-09-30T14:56:00.883173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896134806409496:3666]
2025-09-30T14:56:00.883177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896134806409496:3666]
2025-09-30T14:56:00.883180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896134806409496:3666]
2025-09-30T14:56:00.883193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:00.883211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:00.883222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:00.883227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:00.883230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:00.883232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:00.883234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:00.883297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896134806409496:3666]
2025-09-30T14:56:00.883307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2069
2025-09-30T14:56:00.883316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:00.883344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:00.883364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2069
2025-09-30T14:56:00.883500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:00.883513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:00.883550Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e44e90d1-d8b29278-aa652460-b89062c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:00.883563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:00.883569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:00.883572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:00.883585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:00.883600Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:00.883621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:00.883801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:00.883809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:00.883822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:00.883948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2070 partition: 0 MaxSeqNo: 42 sessionId: src_id|e44e90d1-d8b29278-aa652460-b89062c6_0
2025-09-30T14:56:00.884398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e55d21eb-b9df118d-101247af-9c379c11_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e44e90d1-d8b29278-aa652460-b89062c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:00.887856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e44e90d1-d8b29278-aa652460-b89062c6_0] Write session: try to update token
2025-09-30T14:56:00.887875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e44e90d1-d8b29278-aa652460-b89062c6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:00.897834Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:00.897860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:00.897863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:00.897865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:00.897875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896134806409496:3666]
2025-09-30T14:56:00.897881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896134806409496:3666]
2025-09-30T14:56:00.897886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896134806409496:3666]
2025-09-30T14:56:00.897932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:00.897940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:00.897943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:00.897948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:00.897955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:00.897959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:00.898098Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:00.911332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2070 sessionId: src_id|e44e90d1-d8b29278-aa652460-b89062c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:00.914459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:00.956111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896134896180531:5488]
2025-09-30T14:56:00.956377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2069, pipe: [1:7555896134896180531:5488]
2025-09-30T14:56:01.015914Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:01.016376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:01.016389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:01.016424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896134896180531:5488], now have 1 active actors on pipe
2025-09-30T14:56:01.016793Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:01.016786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896134896180531:5488]
2025-09-30T14:56:01.016828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:01.016831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:01.016897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2070 reason: error at write: Disconnected sessionId: src_id|e44e90d1-d8b29278-aa652460-b89062c6_0
2025-09-30T14:56:01.017104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2070 sessionId: src_id|e44e90d1-d8b29278-aa652460-b89062c6_0 is DEAD
2025-09-30T14:56:01.017349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e44e90d1-d8b29278-aa652460-b89062c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:01.017282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:01.017361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e44e90d1-d8b29278-aa652460-b89062c6_0] Write session will restart in 0.005479s
2025-09-30T14:56:01.017389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e44e90d1-d8b29278-aa652460-b89062c6_0] Write session: Do CDS request
2025-09-30T14:56:01.017394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e44e90d1-d8b29278-aa652460-b89062c6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:01.024750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e44e90d1-d8b29278-aa652460-b89062c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:01.024821Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:01.024840Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2071
2025-09-30T14:56:01.025268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2071 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:01.025318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2071 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:01.025329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2071 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:01.025334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:01.025861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2071 sessionId:  describe result for acl check
2025-09-30T14:56:01.025899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:01.025909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:01.025911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:01.025917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896139191147846:8654] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:01.026460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896139191147846:8654] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:01.029015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896139191147846:8654] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:01.034219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896139191147846:8654] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:01.034236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896139191147846:8654] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:01.034240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896139191147846:8654] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:01.034258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2071 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:01.035866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:01.038348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:01.038535Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:01.038544Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:01.038552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:01.038589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:01.038621Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896139101376959:3650]
2025-09-30T14:56:01.039174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:01.039541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:01.039617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:01.039973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:01.040040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:01.040048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:01.040049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:01.040050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:01.040051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:01.040053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:01.040054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:01.040055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:01.040057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:01.040058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:01.040059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.040060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.040061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.040063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:01.040064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:01.040069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:01.040080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:01.040083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:01.040087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:01.040091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:01.040095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:01.040098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:01.040102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:01.040105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:01.040110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:01.040114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.040117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.040121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.040125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:01.040128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:01.040136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:01.040144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:01.040150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:01.040155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:01.040162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:01.040167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:01.040171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:01.040176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:01.040181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:01.040187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:01.040191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:01.040196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:01.040202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:01.040206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:01.040210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:01.040215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:01.040220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:01.040225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:01.040229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:01.040233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:01.040240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.040244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.040249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.040253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.040257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.040262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.040266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:01.040271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:01.040275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:01.040280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:01.040322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:01.046575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:01.047833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:01.047854Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:01.047858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:01.047863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:01.047871Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2070 [2:7555896139101376959:3650]
2025-09-30T14:56:01.047894Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:01.047911Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:01.047914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:01.047918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:01.047921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:01.047939Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:01.047947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:01.047959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:01.048038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.048040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.048042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.048046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:01.048048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:01.048128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:01.048131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.048147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.048160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.048190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:01.048214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896139101376954:3650]
2025-09-30T14:56:01.048216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896139101376954:3650]
2025-09-30T14:56:01.048219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896139101376954:3650]
2025-09-30T14:56:01.048229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:01.048240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:01.048243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:01.048244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:01.048246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:01.048260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:01.048263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:01.048273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896139191147981:8654], now have 1 active actors on pipe
2025-09-30T14:56:01.048278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896139191147831:2454], now have 1 active actors on pipe
2025-09-30T14:56:01.048367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2070
2025-09-30T14:56:01.048408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2070
2025-09-30T14:56:01.048314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896139101376954:3650]
2025-09-30T14:56:01.048330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:01.048365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:01.048481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:01.048491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:01.048523Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99dab1ce-89a17141-fdbbd84d-66a7913b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:01.048540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:01.048550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:01.048553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:01.048564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:01.048580Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:01.048609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:01.049080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:01.049094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:01.049115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:01.049223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2071 partition: 0 MaxSeqNo: 42 sessionId: src_id|99dab1ce-89a17141-fdbbd84d-66a7913b_0
2025-09-30T14:56:01.049693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e44e90d1-d8b29278-aa652460-b89062c6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|99dab1ce-89a17141-fdbbd84d-66a7913b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:01.053391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99dab1ce-89a17141-fdbbd84d-66a7913b_0] Write session: try to update token
2025-09-30T14:56:01.053419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99dab1ce-89a17141-fdbbd84d-66a7913b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:01.062397Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:01.062424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:01.062427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:01.062429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:01.062439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896139101376954:3650]
2025-09-30T14:56:01.062444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896139101376954:3650]
2025-09-30T14:56:01.062448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896139101376954:3650]
2025-09-30T14:56:01.062491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:01.062498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:01.062505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:01.062506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.062508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:01.062509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:01.062654Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:01.075806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2071 sessionId: src_id|99dab1ce-89a17141-fdbbd84d-66a7913b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:01.078655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:01.116883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896139191147997:5488]
2025-09-30T14:56:01.117179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2070, pipe: [1:7555896139191147997:5488]
2025-09-30T14:56:01.180341Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:01.180805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:01.180824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:01.180845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896139191147997:5488], now have 1 active actors on pipe
2025-09-30T14:56:01.181097Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:01.181070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:01.181085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:01.181089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:01.181131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896139191147997:5488]
2025-09-30T14:56:01.181173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2071 reason: error at write: Disconnected sessionId: src_id|99dab1ce-89a17141-fdbbd84d-66a7913b_0
2025-09-30T14:56:01.181378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2071 sessionId: src_id|99dab1ce-89a17141-fdbbd84d-66a7913b_0 is DEAD
2025-09-30T14:56:01.181627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99dab1ce-89a17141-fdbbd84d-66a7913b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:01.181643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99dab1ce-89a17141-fdbbd84d-66a7913b_0] Write session will restart in 0.006877s
2025-09-30T14:56:01.181691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99dab1ce-89a17141-fdbbd84d-66a7913b_0] Write session: Do CDS request
2025-09-30T14:56:01.181701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99dab1ce-89a17141-fdbbd84d-66a7913b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:01.190042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99dab1ce-89a17141-fdbbd84d-66a7913b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:01.190173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:01.190191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2072
2025-09-30T14:56:01.190379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2072 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:01.190426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2072 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:01.190440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2072 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:01.190444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:01.190916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2072 sessionId:  describe result for acl check
2025-09-30T14:56:01.190957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:01.190961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:01.190963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:01.190969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896139191148056:8652] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:01.191552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896139191148056:8652] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:01.194017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896139191148056:8652] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:01.195011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:01.197497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:01.197770Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:01.197785Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:01.197801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:01.197864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:01.197907Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896139101377116:3661]
2025-09-30T14:56:01.197889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896139191148056:8652] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:01.197908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896139191148056:8652] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:01.197912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896139191148056:8652] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:01.197921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2072 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:01.198531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:01.198888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:01.198944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:01.199307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:01.199402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:01.199409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:01.199411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:01.199412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:01.199414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:01.199415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:01.199416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:01.199418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:01.199419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:01.199420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:01.199421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.199423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.199424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.199426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:01.199427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:01.199433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:01.199445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:01.199449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:01.199452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:01.199456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:01.199461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:01.199464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:01.199468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:01.199471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:01.199475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:01.199479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.199483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.199487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.199490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:01.199493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:01.199502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:01.199510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:01.199517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:01.199524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:01.199530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:01.199536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:01.199542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:01.199548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:01.199554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:01.199559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:01.199564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:01.199568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:01.199574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:01.199578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:01.199582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:01.199587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:01.199593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:01.199598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:01.199602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:01.199607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:01.199612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.199616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.199622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.199627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.199631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.199636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.199641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:01.199646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:01.199650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:01.199655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:01.199701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:01.205802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:01.207122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:01.207143Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:01.207146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:01.207150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:01.207158Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2071 [2:7555896139101377116:3661]
2025-09-30T14:56:01.207176Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:01.207192Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:01.207196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:01.207200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:01.207203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:01.207220Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:01.207234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:01.207261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:01.207329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.207340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.207342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.207346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:01.207348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:01.207423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:01.207435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.207449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.207460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.207476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:01.207496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896139101377111:3661]
2025-09-30T14:56:01.207506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896139101377111:3661]
2025-09-30T14:56:01.207509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896139101377111:3661]
2025-09-30T14:56:01.207519Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:01.207532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:01.207536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:01.207538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896139191148003:2454], now have 1 active actors on pipe
2025-09-30T14:56:01.207539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:01.207543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896139191148158:8652], now have 1 active actors on pipe
2025-09-30T14:56:01.207549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:01.207563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:01.207572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:01.207615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896139101377111:3661]
2025-09-30T14:56:01.207628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:01.207642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:01.207653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2071
2025-09-30T14:56:01.207653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2071
2025-09-30T14:56:01.207702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:01.207713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:01.207741Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|538ae284-c3e4884d-f2907636-81255adf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:01.207749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:01.207752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:01.207755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:01.207769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:01.207779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:01.207795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:01.207991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:01.208001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:01.208015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:01.208144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2072 partition: 0 MaxSeqNo: 42 sessionId: src_id|538ae284-c3e4884d-f2907636-81255adf_0
2025-09-30T14:56:01.208654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99dab1ce-89a17141-fdbbd84d-66a7913b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|538ae284-c3e4884d-f2907636-81255adf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:01.212379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|538ae284-c3e4884d-f2907636-81255adf_0] Write session: try to update token
2025-09-30T14:56:01.212416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|538ae284-c3e4884d-f2907636-81255adf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:01.220607Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:01.220628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:01.220638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896139101377111:3661]
2025-09-30T14:56:01.220687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:01.220698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:01.220867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:01.221022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:01.221173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:01.221319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:01.221542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:01.221586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:01.232148Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:01.232170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:01.232173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:01.232175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:01.232187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896139101377111:3661]
2025-09-30T14:56:01.232192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896139101377111:3661]
2025-09-30T14:56:01.232197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896139101377111:3661]
2025-09-30T14:56:01.232236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:01.232241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:01.232241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:01.232245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:01.232249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.232252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:01.232398Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:01.233897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2072 sessionId: src_id|538ae284-c3e4884d-f2907636-81255adf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:01.236973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:01.281192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896139191148173:5488]
2025-09-30T14:56:01.281460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2071, pipe: [1:7555896139191148173:5488]
2025-09-30T14:56:01.347912Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:01.348320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:01.348338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:01.348360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896139191148173:5488], now have 1 active actors on pipe
2025-09-30T14:56:01.348629Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:01.348615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:01.348636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896139191148173:5488]
2025-09-30T14:56:01.348675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:01.348678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:01.348742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2072 reason: error at write: Disconnected sessionId: src_id|538ae284-c3e4884d-f2907636-81255adf_0
2025-09-30T14:56:01.348939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2072 sessionId: src_id|538ae284-c3e4884d-f2907636-81255adf_0 is DEAD
2025-09-30T14:56:01.349093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|538ae284-c3e4884d-f2907636-81255adf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:01.349103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|538ae284-c3e4884d-f2907636-81255adf_0] Write session will restart in 0.007887s
2025-09-30T14:56:01.349120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|538ae284-c3e4884d-f2907636-81255adf_0] Write session: Do CDS request
2025-09-30T14:56:01.349125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|538ae284-c3e4884d-f2907636-81255adf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:01.357967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|538ae284-c3e4884d-f2907636-81255adf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:01.358412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:01.358430Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2073
2025-09-30T14:56:01.358618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2073 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:01.358654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2073 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:01.358659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2073 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:01.358663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:01.359152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2073 sessionId:  describe result for acl check
2025-09-30T14:56:01.359192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:01.359195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:01.359197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:01.359203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896139191148226:8641] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:01.359785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896139191148226:8641] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:01.362373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896139191148226:8641] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:01.363222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:01.365750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:01.366018Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:01.366030Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:01.366042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:01.366088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896139191148226:8641] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:01.366106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896139191148226:8641] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:01.366110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896139191148226:8641] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:01.366119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2073 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:01.366124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:01.366174Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896139101377276:3658]
2025-09-30T14:56:01.366883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:01.367214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:01.367289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:01.367638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:01.367723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:01.367733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:01.367734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:01.367736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:01.367737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:01.367739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:01.367741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:01.367742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:01.367744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:01.367745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:01.367747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.367748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.367750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.367751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:01.367753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:01.367760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:01.367772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:01.367777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:01.367782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:01.367787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:01.367792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:01.367797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:01.367801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:01.367806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:01.367812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:01.367816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.367821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.367825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.367830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:01.367834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:01.367843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:01.367852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:01.367859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:01.367864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:01.367876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:01.367884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:01.367894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:01.367902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:01.367908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:01.367914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:01.367920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:01.367926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:01.367939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:01.367951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:01.367957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:01.367963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:01.367973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:01.367979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:01.367988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:01.367994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:01.367999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.368011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.368016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.368025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.368030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.368035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.368044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:01.368050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:01.368055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:01.368064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:01.368113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:01.374224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:01.375195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:01.375217Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:01.375222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:01.375226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:01.375235Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2072 [2:7555896139101377276:3658]
2025-09-30T14:56:01.375272Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:01.375292Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:01.375295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:01.375299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:01.375302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:01.375323Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:01.375331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:01.375339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:01.375414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.375417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.375419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.375422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:01.375425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:01.375510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:01.375516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.375529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.375540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.375559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:01.375578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896139101377270:3658]
2025-09-30T14:56:01.375580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896139101377270:3658]
2025-09-30T14:56:01.375582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896139101377270:3658]
2025-09-30T14:56:01.375601Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:01.375618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:01.375634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:01.375637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:01.375666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:01.375671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:01.375673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:01.375679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896139101377270:3658]
2025-09-30T14:56:01.375683Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:01.375776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:01.375867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896139191148330:8641], now have 1 active actors on pipe
2025-09-30T14:56:01.375876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896139191148174:2454], now have 1 active actors on pipe
2025-09-30T14:56:01.376109Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2072
2025-09-30T14:56:01.376111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2072
2025-09-30T14:56:01.377478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:01.377496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:01.377544Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7838f23f-e18ad0da-166c8851-c1083170_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:01.377556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:01.377562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:01.377565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:01.377581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:01.377597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:01.377628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:01.377986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:01.377999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:01.378021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:01.378176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2073 partition: 0 MaxSeqNo: 42 sessionId: src_id|7838f23f-e18ad0da-166c8851-c1083170_0
2025-09-30T14:56:01.378704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|538ae284-c3e4884d-f2907636-81255adf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7838f23f-e18ad0da-166c8851-c1083170_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:01.382493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7838f23f-e18ad0da-166c8851-c1083170_0] Write session: try to update token
2025-09-30T14:56:01.382535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7838f23f-e18ad0da-166c8851-c1083170_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:01.389160Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:01.389185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:01.389188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:01.389191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:01.389202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896139101377270:3658]
2025-09-30T14:56:01.389207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896139101377270:3658]
2025-09-30T14:56:01.389211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896139101377270:3658]
2025-09-30T14:56:01.389259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:01.389260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:01.389265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.389268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:01.389268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:01.389281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:01.389416Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:01.404183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2073 sessionId: src_id|7838f23f-e18ad0da-166c8851-c1083170_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:01.407185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:01.448635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896139191148342:5488]
2025-09-30T14:56:01.448992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2072, pipe: [1:7555896139191148342:5488]
2025-09-30T14:56:01.511378Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:01.512134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:01.512156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:01.512177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896139191148342:5488], now have 1 active actors on pipe
2025-09-30T14:56:01.512477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:01.512503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:01.512521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:01.512570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2073 reason: error at write: Disconnected sessionId: src_id|7838f23f-e18ad0da-166c8851-c1083170_0
2025-09-30T14:56:01.512587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896139191148342:5488]
2025-09-30T14:56:01.512770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2073 sessionId: src_id|7838f23f-e18ad0da-166c8851-c1083170_0 is DEAD
2025-09-30T14:56:01.512437Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:01.512919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7838f23f-e18ad0da-166c8851-c1083170_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:01.512939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7838f23f-e18ad0da-166c8851-c1083170_0] Write session will restart in 0.008961s
2025-09-30T14:56:01.512961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7838f23f-e18ad0da-166c8851-c1083170_0] Write session: Do CDS request
2025-09-30T14:56:01.512969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7838f23f-e18ad0da-166c8851-c1083170_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:01.522814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7838f23f-e18ad0da-166c8851-c1083170_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:01.523015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:01.523037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2074
2025-09-30T14:56:01.523258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2074 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:01.523306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2074 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:01.523314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2074 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:01.523320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:01.523943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2074 sessionId:  describe result for acl check
2025-09-30T14:56:01.523990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:01.523997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:01.524000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:01.524007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896139191148406:8640] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:01.524712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896139191148406:8640] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:01.527176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896139191148406:8640] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:01.527207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:01.529917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:01.530168Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:01.530180Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:01.530195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:01.530197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896139191148406:8640] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:01.530218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896139191148406:8640] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:01.530222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896139191148406:8640] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:01.530230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2074 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:01.530271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:01.530314Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896139101377438:3656]
2025-09-30T14:56:01.530849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:01.531175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:01.531266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:01.531616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:01.531683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:01.531684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:01.531686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:01.531687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:01.531688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:01.531690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:01.531691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:01.531692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:01.531694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:01.531695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:01.531697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.531698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.531699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.531701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:01.531702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:01.531708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:01.531718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:01.531722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:01.531727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:01.531731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:01.531736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:01.531740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:01.531744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:01.531748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:01.531753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:01.531757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.531761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.531765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.531769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:01.531773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:01.531782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:01.531790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:01.531797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:01.531802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:01.531808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:01.531814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:01.531819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:01.531824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:01.531829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:01.531834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:01.531838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:01.531843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:01.531847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:01.531852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:01.531857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:01.531862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:01.531867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:01.531872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:01.531877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:01.531882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:01.531887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.531898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.531907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.531924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.531933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.531938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.531947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:01.531952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:01.531962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:01.531972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:01.532024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:01.537931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:01.539158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:01.539176Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:01.539179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:01.539183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:01.539191Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2073 [2:7555896139101377438:3656]
2025-09-30T14:56:01.539208Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:01.539227Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:01.539231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:01.539234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:01.539236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:01.539270Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:01.539278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:01.539284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:01.539337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.539346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.539347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.539350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:01.539352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:01.539407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:01.539415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.539425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.539431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.539441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:01.539457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896139101377433:3656]
2025-09-30T14:56:01.539460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896139101377433:3656]
2025-09-30T14:56:01.539463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896139101377433:3656]
2025-09-30T14:56:01.539471Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:01.539488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:01.539504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:01.539506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:01.539510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:01.539510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:01.539513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:01.539547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896139101377433:3656]
2025-09-30T14:56:01.539557Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:01.539560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:01.539580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896139191148501:8640], now have 1 active actors on pipe
2025-09-30T14:56:01.539590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896139191148344:2454], now have 1 active actors on pipe
2025-09-30T14:56:01.539723Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2073
2025-09-30T14:56:01.539735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2073
2025-09-30T14:56:01.539805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:01.539817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:01.539856Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6826c220-e88d38d5-31d3dc6f-371dec02_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:01.539867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:01.539871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:01.539875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:01.539886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:01.539901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:01.539924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:01.540163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:01.540189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:01.540216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:01.540333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2074 partition: 0 MaxSeqNo: 42 sessionId: src_id|6826c220-e88d38d5-31d3dc6f-371dec02_0
2025-09-30T14:56:01.540709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7838f23f-e18ad0da-166c8851-c1083170_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6826c220-e88d38d5-31d3dc6f-371dec02_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:01.544169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6826c220-e88d38d5-31d3dc6f-371dec02_0] Write session: try to update token
2025-09-30T14:56:01.544194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6826c220-e88d38d5-31d3dc6f-371dec02_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:01.558934Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:01.558957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:01.558967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896139101377433:3656]
2025-09-30T14:56:01.559019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:01.559026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:01.559205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:01.559404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:01.559588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:01.559752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:01.559947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:01.559991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:01.560196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2074 sessionId: src_id|6826c220-e88d38d5-31d3dc6f-371dec02_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:01.563144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:01.564395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:01.564416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:01.564437Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:01.564439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:01.564442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:01.564444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:01.564452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896139101377433:3656]
2025-09-30T14:56:01.564459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896139101377433:3656]
2025-09-30T14:56:01.564463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896139101377433:3656]
2025-09-30T14:56:01.564500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:01.564510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:01.564515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:01.564517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.564520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:01.564530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:01.564652Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:01.613007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896139191148512:5488]
2025-09-30T14:56:01.613386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2073, pipe: [1:7555896139191148512:5488]
2025-09-30T14:56:01.678781Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:01.679194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:01.679216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896139191148512:5488], now have 1 active actors on pipe
2025-09-30T14:56:01.680269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6826c220-e88d38d5-31d3dc6f-371dec02_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:01.680281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6826c220-e88d38d5-31d3dc6f-371dec02_0] Write session will restart in 0.008012s
2025-09-30T14:56:01.680304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6826c220-e88d38d5-31d3dc6f-371dec02_0] Write session: Do CDS request
2025-09-30T14:56:01.680310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6826c220-e88d38d5-31d3dc6f-371dec02_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:01.679753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:01.679835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:01.679838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:01.679905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2074 reason: error at write: Disconnected sessionId: src_id|6826c220-e88d38d5-31d3dc6f-371dec02_0
2025-09-30T14:56:01.680052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2074 sessionId: src_id|6826c220-e88d38d5-31d3dc6f-371dec02_0 is DEAD
2025-09-30T14:56:01.680187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896139191148512:5488]
2025-09-30T14:56:01.680201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:01.689875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6826c220-e88d38d5-31d3dc6f-371dec02_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:01.691500Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:01.691522Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2075
2025-09-30T14:56:01.691867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2075 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:01.691904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2075 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:01.691908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2075 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:01.691912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:01.692571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2075 sessionId:  describe result for acl check
2025-09-30T14:56:01.692607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:01.692610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:01.692611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:01.692617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896139191148536:8620] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:01.693146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896139191148536:8620] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:01.696385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896139191148536:8620] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:01.699912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896139191148536:8620] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:01.699927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896139191148536:8620] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:01.699931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896139191148536:8620] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:01.699939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2075 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:01.713241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:01.716177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:01.716389Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:01.716399Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:01.716408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:01.716473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:01.716516Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896139101377621:3645]
2025-09-30T14:56:01.717200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:01.717595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:01.717641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:01.717959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:01.718014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:01.718019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:01.718021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:01.718022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:01.718023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:01.718024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:01.718025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:01.718026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:01.718027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:01.718028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:01.718029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.718031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.718032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.718033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:01.718034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:01.718039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:01.718048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:01.718052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:01.718055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:01.718059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:01.718062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:01.718065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:01.718069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:01.718073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:01.718076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:01.718080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.718084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.718087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.718091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:01.718094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:01.718100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:01.718108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:01.718112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:01.718117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:01.718122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:01.718126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:01.718131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:01.718136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:01.718141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:01.718145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:01.718151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:01.718155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:01.718159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:01.718164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:01.718168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:01.718173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:01.718178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:01.718183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:01.718187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:01.718191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:01.718196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.718200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.718204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.718208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.718213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.718217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.718221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:01.718226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:01.718230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:01.718234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:01.718273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:01.724157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:01.725260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:01.725283Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:01.725286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:01.725290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:01.725297Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2074 [2:7555896139101377621:3645]
2025-09-30T14:56:01.725312Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:01.725330Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:01.725339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:01.725342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:01.725344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:01.725360Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:01.725372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:01.725380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:01.725464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.725477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.725479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.725483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:01.725485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:01.725555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:01.725563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.725578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.725590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.725612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:01.725634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896139191148529:2454], now have 1 active actors on pipe
2025-09-30T14:56:01.725642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896139191148573:8620], now have 1 active actors on pipe
2025-09-30T14:56:01.725648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896139101377616:3645]
2025-09-30T14:56:01.725650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896139101377616:3645]
2025-09-30T14:56:01.725652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896139101377616:3645]
2025-09-30T14:56:01.725665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:01.725680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:01.725694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:01.725695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:01.725698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:01.725699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:01.725702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:01.725736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896139101377616:3645]
2025-09-30T14:56:01.725745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:01.725748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:01.725777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:01.725788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:01.725821Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d392ef84-74e93426-8a5cf960-5f553975_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:01.725833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:01.725836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:01.725838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:01.725850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:01.725864Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:01.725891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:01.726372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:01.726386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:01.726408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:01.726914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6826c220-e88d38d5-31d3dc6f-371dec02_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d392ef84-74e93426-8a5cf960-5f553975_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:01.725688Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2074
2025-09-30T14:56:01.725725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2074
2025-09-30T14:56:01.726519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2075 partition: 0 MaxSeqNo: 42 sessionId: src_id|d392ef84-74e93426-8a5cf960-5f553975_0
2025-09-30T14:56:01.729891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d392ef84-74e93426-8a5cf960-5f553975_0] Write session: try to update token
2025-09-30T14:56:01.729912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d392ef84-74e93426-8a5cf960-5f553975_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:01.738846Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:01.738868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:01.738871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:01.738873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:01.738883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896139101377616:3645]
2025-09-30T14:56:01.738888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896139101377616:3645]
2025-09-30T14:56:01.738893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896139101377616:3645]
2025-09-30T14:56:01.738937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:01.738945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.738948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:01.738946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:01.738953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:01.738965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:01.739106Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:01.753385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2075 sessionId: src_id|d392ef84-74e93426-8a5cf960-5f553975_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:01.756316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:01.778890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896139191148708:5488]
2025-09-30T14:56:01.779228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2074, pipe: [1:7555896139191148708:5488]
2025-09-30T14:56:01.852063Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:01.852458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:01.852475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:01.852494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896139191148708:5488], now have 1 active actors on pipe
2025-09-30T14:56:01.852772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896139191148708:5488]
2025-09-30T14:56:01.852809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:01.852813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:01.852873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2075 reason: error at write: Disconnected sessionId: src_id|d392ef84-74e93426-8a5cf960-5f553975_0
2025-09-30T14:56:01.853076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2075 sessionId: src_id|d392ef84-74e93426-8a5cf960-5f553975_0 is DEAD
2025-09-30T14:56:01.853218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d392ef84-74e93426-8a5cf960-5f553975_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:01.853229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d392ef84-74e93426-8a5cf960-5f553975_0] Write session will restart in 0.008337s
2025-09-30T14:56:01.853252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d392ef84-74e93426-8a5cf960-5f553975_0] Write session: Do CDS request
2025-09-30T14:56:01.853258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d392ef84-74e93426-8a5cf960-5f553975_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:01.853280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:01.853450Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:01.862761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d392ef84-74e93426-8a5cf960-5f553975_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:01.862864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:01.862883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2076
2025-09-30T14:56:01.862993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2076 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:01.863024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2076 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:01.863034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2076 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:01.863039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:01.863645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2076 sessionId:  describe result for acl check
2025-09-30T14:56:01.863685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:01.863688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:01.863692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:01.863699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896139191148791:8613] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:01.864235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896139191148791:8613] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:01.866395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896139191148791:8613] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:01.869899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:01.870253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896139191148791:8613] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:01.870270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896139191148791:8613] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:01.870274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896139191148791:8613] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:01.870291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2076 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:01.870396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:01.870683Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:01.870693Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:01.870703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:01.870753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:01.870791Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896139101377810:3591]
2025-09-30T14:56:01.871488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:01.871795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:01.871840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:01.872169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:01.872231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:01.872238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:01.872239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:01.872240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:01.872241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:01.872242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:01.872243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:01.872244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:01.872246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:01.872247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:01.872248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.872249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.872251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.872252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:01.872253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:01.872258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:01.872268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:01.872272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:01.872276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:01.872280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:01.872283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:01.872287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:01.872291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:01.872295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:01.872300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:01.872303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.872306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.872309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.872313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:01.872317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:01.872323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:01.872330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:01.872336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:01.872341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:01.872347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:01.872351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:01.872354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:01.872359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:01.872363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:01.872368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:01.872372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:01.872377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:01.872381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:01.872386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:01.872390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:01.872395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:01.872399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:01.872404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:01.872408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:01.872413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:01.872418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.872423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.872427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.872431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.872436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.872441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.872445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:01.872449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:01.872454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:01.872460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:01.872506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:01.878113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:01.879269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:01.879283Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:01.879286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:01.879290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:01.879298Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2075 [2:7555896139101377810:3591]
2025-09-30T14:56:01.879316Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:01.879332Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:01.879336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:01.879341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:01.879344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:01.879360Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:01.879373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:01.879380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:01.879447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.879454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.879456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.879460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:01.879463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:01.879530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:01.879537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.879551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:01.879570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:01.879596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:01.879618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896139191148872:8613], now have 1 active actors on pipe
2025-09-30T14:56:01.879627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896139191148713:2454], now have 1 active actors on pipe
2025-09-30T14:56:01.879634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896139101377805:3591]
2025-09-30T14:56:01.879641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896139101377805:3591]
2025-09-30T14:56:01.879643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896139101377805:3591]
2025-09-30T14:56:01.879659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:01.879676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:01.879676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:01.879679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:01.879681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:01.879692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:01.879695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:01.879666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2075
2025-09-30T14:56:01.879695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2075
2025-09-30T14:56:01.879742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:01.879751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:01.879767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896139101377805:3591]
2025-09-30T14:56:01.879779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:01.879790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:01.879814Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4533cbf2-7540923d-eeed639a-b82c781a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:01.879824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:01.879828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:01.879831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:01.879841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:01.879850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:01.879877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:01.880017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:01.880027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:01.880042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:01.880141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2076 partition: 0 MaxSeqNo: 42 sessionId: src_id|4533cbf2-7540923d-eeed639a-b82c781a_0
2025-09-30T14:56:01.880514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d392ef84-74e93426-8a5cf960-5f553975_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4533cbf2-7540923d-eeed639a-b82c781a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:01.883441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4533cbf2-7540923d-eeed639a-b82c781a_0] Write session: try to update token
2025-09-30T14:56:01.883466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4533cbf2-7540923d-eeed639a-b82c781a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:01.892315Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:01.892341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:01.892344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:01.892346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:01.892357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896139101377805:3591]
2025-09-30T14:56:01.892362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896139101377805:3591]
2025-09-30T14:56:01.892366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896139101377805:3591]
2025-09-30T14:56:01.892409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:01.892417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:01.892420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:01.892434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:01.892442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:01.892447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:01.892580Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:01.899608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2076 sessionId: src_id|4533cbf2-7540923d-eeed639a-b82c781a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:01.902658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:01.953001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896139191148896:5488]
2025-09-30T14:56:01.953305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2075, pipe: [1:7555896139191148896:5488]
2025-09-30T14:56:02.012762Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:02.013246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:02.013265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:02.013287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896139191148896:5488], now have 1 active actors on pipe
2025-09-30T14:56:02.013498Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:02.014100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4533cbf2-7540923d-eeed639a-b82c781a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:02.014113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4533cbf2-7540923d-eeed639a-b82c781a_0] Write session will restart in 0.006158s
2025-09-30T14:56:02.014140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4533cbf2-7540923d-eeed639a-b82c781a_0] Write session: Do CDS request
2025-09-30T14:56:02.014146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4533cbf2-7540923d-eeed639a-b82c781a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:02.013629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:02.013734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2076 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4533cbf2-7540923d-eeed639a-b82c781a_0
2025-09-30T14:56:02.013915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2076 sessionId: src_id|4533cbf2-7540923d-eeed639a-b82c781a_0 is DEAD
2025-09-30T14:56:02.013990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:02.014043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896139191148896:5488]
2025-09-30T14:56:02.021858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4533cbf2-7540923d-eeed639a-b82c781a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:02.021915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:02.021936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2077
2025-09-30T14:56:02.022101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2077 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:02.022139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2077 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:02.022150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2077 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:02.022154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:02.022688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2077 sessionId:  describe result for acl check
2025-09-30T14:56:02.022728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:02.022735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:02.022738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:02.022744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896143486116209:8601] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:02.023321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896143486116209:8601] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:02.029566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896143486116209:8601] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:02.034099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896143486116209:8601] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:02.034122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896143486116209:8601] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:02.034115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:02.034126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896143486116209:8601] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:02.034136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2077 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:02.037838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:02.038045Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:02.038049Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:02.038060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:02.038111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:02.038152Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896143396345272:3602]
2025-09-30T14:56:02.038807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:02.039145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:02.039197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:02.039575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:02.039641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:02.039647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:02.039648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:02.039648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:02.039649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:02.039650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:02.039651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:02.039652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:02.039653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:02.039653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:02.039654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.039655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.039656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.039657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:02.039657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:02.039662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:02.039669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:02.039672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:02.039674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:02.039677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:02.039680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:02.039682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:02.039684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:02.039687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:02.039689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:02.039691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.039694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.039696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.039698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:02.039700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:02.039706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:02.039713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:02.039718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:02.039722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:02.039725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:02.039728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:02.039731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:02.039735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:02.039737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:02.039741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:02.039744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:02.039747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:02.039750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:02.039753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:02.039755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:02.039759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:02.039761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:02.039764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:02.039769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:02.039772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:02.039774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.039777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.039780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.039783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.039787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.039789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.039792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:02.039795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:02.039800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:02.039803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:02.039828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:02.045692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:02.046873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:02.046890Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:02.046893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:02.046897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:02.046904Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2076 [2:7555896143396345272:3602]
2025-09-30T14:56:02.046920Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:02.046939Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:02.046943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:02.046946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:02.046948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:02.046965Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:02.046972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:02.046986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:02.047051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.047059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.047061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.047065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:02.047068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:02.047139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:02.047147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.047162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.047180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.047202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:02.047222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896143486116358:8601], now have 1 active actors on pipe
2025-09-30T14:56:02.047226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896143486116194:2454], now have 1 active actors on pipe
2025-09-30T14:56:02.047232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896143396345266:3602]
2025-09-30T14:56:02.047234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896143396345266:3602]
2025-09-30T14:56:02.047236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896143396345266:3602]
2025-09-30T14:56:02.047266Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:02.047280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:02.047296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:02.047299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:02.047335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896143396345266:3602]
2025-09-30T14:56:02.047345Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:02.047374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:02.047388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:02.047391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:02.047348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2076
2025-09-30T14:56:02.047397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:02.047392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2076
2025-09-30T14:56:02.047513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:02.047525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:02.047550Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e167ff3c-a51354fa-7fc5021b-e503199e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:02.047562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:02.047567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:02.047569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:02.047579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:02.047595Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:02.047617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:02.047917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:02.047927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:02.047942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:02.048079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2077 partition: 0 MaxSeqNo: 42 sessionId: src_id|e167ff3c-a51354fa-7fc5021b-e503199e_0
2025-09-30T14:56:02.048490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4533cbf2-7540923d-eeed639a-b82c781a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e167ff3c-a51354fa-7fc5021b-e503199e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:02.051548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e167ff3c-a51354fa-7fc5021b-e503199e_0] Write session: try to update token
2025-09-30T14:56:02.051570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e167ff3c-a51354fa-7fc5021b-e503199e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:02.060502Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:02.060524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:02.060533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896143396345266:3602]
2025-09-30T14:56:02.060572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:02.060682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:02.060732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:02.060873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:02.061020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:02.061155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:02.061357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:02.061406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:02.066614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2077 sessionId: src_id|e167ff3c-a51354fa-7fc5021b-e503199e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:02.069536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:02.069780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:02.069807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:02.069844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:02.070014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:02.071974Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:02.071993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:02.071996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:02.071998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:02.072009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896143396345266:3602]
2025-09-30T14:56:02.072015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896143396345266:3602]
2025-09-30T14:56:02.072020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896143396345266:3602]
2025-09-30T14:56:02.072061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:02.072064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:02.072067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:02.072072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.072076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:02.072080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:02.072279Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:02.114263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896143486116374:5488]
2025-09-30T14:56:02.114611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2076, pipe: [1:7555896143486116374:5488]
2025-09-30T14:56:02.186752Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:02.195640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:02.195673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:02.195873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:02.195962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:02.196033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:02.196105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:02.196533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:02.196541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:02.196628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:02.196696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:02.196797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:02.196894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:02.196950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:02.196954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:02.197058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:02.197162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:02.197264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:02.197368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:02.197426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:02.197445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:02.197560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:02.197669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:02.197764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:02.197860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:02.197917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:02.197921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:02.198036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:02.198148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:02.198251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:02.198329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:02.198378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:02.198381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:02.198459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:02.198545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:02.198635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:02.198735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:02.198789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:02.198793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:02.198897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:02.198989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:02.199096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:02.199186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:02.199483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:02.199499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:02.199598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:02.199699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:02.199808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:02.199914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:02.199979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:02.199989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:02.200087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:02.200186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:02.200296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:02.200401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:02.200466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:02.200478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:02.200571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:02.200678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:02.200762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:02.200886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:02.200967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:02.200976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:02.201065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896143486116374:5488], now have 1 active actors on pipe
2025-09-30T14:56:02.201954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e167ff3c-a51354fa-7fc5021b-e503199e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:02.201972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e167ff3c-a51354fa-7fc5021b-e503199e_0] Write session will restart in 0.008586s
2025-09-30T14:56:02.201996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e167ff3c-a51354fa-7fc5021b-e503199e_0] Write session: Do CDS request
2025-09-30T14:56:02.202001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e167ff3c-a51354fa-7fc5021b-e503199e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:02.201509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:02.201526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:02.201512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896143486116374:5488]
2025-09-30T14:56:02.201550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:02.201571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2077 reason: error at write: Disconnected sessionId: src_id|e167ff3c-a51354fa-7fc5021b-e503199e_0
2025-09-30T14:56:02.201785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2077 sessionId: src_id|e167ff3c-a51354fa-7fc5021b-e503199e_0 is DEAD
2025-09-30T14:56:02.202065Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:02.211843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e167ff3c-a51354fa-7fc5021b-e503199e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:02.212126Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:02.212144Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2078
2025-09-30T14:56:02.212279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2078 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:02.212318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2078 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:02.212331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2078 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:02.212335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:02.212873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2078 sessionId:  describe result for acl check
2025-09-30T14:56:02.212912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:02.212921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:02.212923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:02.212930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896143486116437:8596] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:02.213577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896143486116437:8596] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:02.219766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896143486116437:8596] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:02.220943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:02.223918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:02.224165Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:02.224175Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:02.224187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:02.224256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:02.224293Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896143396345435:3600]
2025-09-30T14:56:02.224328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896143486116437:8596] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:02.224349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896143486116437:8596] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:02.224352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896143486116437:8596] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:02.224362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2078 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:02.224996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:02.225396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:02.225473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:02.225852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:02.225929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:02.225936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:02.225938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:02.225939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:02.225941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:02.225943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:02.225944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:02.225945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:02.225947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:02.225948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:02.225949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.225951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.225952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.225953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:02.225955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:02.225961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:02.225972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:02.225977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:02.225981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:02.225986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:02.225990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:02.225994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:02.225998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:02.226002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:02.226007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:02.226011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.226016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.226020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.226024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:02.226028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:02.226037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:02.226046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:02.226052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:02.226058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:02.226063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:02.226069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:02.226074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:02.226079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:02.226084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:02.226088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:02.226092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:02.226098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:02.226104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:02.226111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:02.226116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:02.226122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:02.226134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:02.226139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:02.226145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:02.226151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:02.226157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.226163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.226168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.226174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.226178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.226184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.226189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:02.226194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:02.226199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:02.226205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:02.226325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:02.232408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:02.233392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:02.233410Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:02.233414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:02.233418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:02.233427Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2077 [2:7555896143396345435:3600]
2025-09-30T14:56:02.233458Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:02.233481Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:02.233487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:02.233490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:02.233493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:02.233514Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:02.233522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:02.233531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:02.233877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.233888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.233890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.233894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:02.233897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:02.233977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:02.233986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.234000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.234010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.234027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:02.234048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896143486116544:8596], now have 1 active actors on pipe
2025-09-30T14:56:02.234058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896143486116383:2454], now have 1 active actors on pipe
2025-09-30T14:56:02.234066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896143396345430:3600]
2025-09-30T14:56:02.234068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896143396345430:3600]
2025-09-30T14:56:02.234070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896143396345430:3600]
2025-09-30T14:56:02.234088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:02.234110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:02.234131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:02.234135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:02.234174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896143396345430:3600]
2025-09-30T14:56:02.234182Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:02.234189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2077
2025-09-30T14:56:02.234200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2077
2025-09-30T14:56:02.234311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:02.234318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:02.234320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:02.234326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:02.234607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:02.234620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:02.234657Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f42b9fcc-b69236c8-c05c6bd7-d88b04e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:02.234668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:02.234673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:02.234676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:02.234689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:02.234703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:02.234722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:02.235105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:02.235115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:02.235134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:02.235388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2078 partition: 0 MaxSeqNo: 42 sessionId: src_id|f42b9fcc-b69236c8-c05c6bd7-d88b04e5_0
2025-09-30T14:56:02.239371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e167ff3c-a51354fa-7fc5021b-e503199e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f42b9fcc-b69236c8-c05c6bd7-d88b04e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:02.242429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f42b9fcc-b69236c8-c05c6bd7-d88b04e5_0] Write session: try to update token
2025-09-30T14:56:02.242452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f42b9fcc-b69236c8-c05c6bd7-d88b04e5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:02.248820Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:02.248843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:02.248846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:02.248848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:02.248859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896143396345430:3600]
2025-09-30T14:56:02.248865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896143396345430:3600]
2025-09-30T14:56:02.248870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896143396345430:3600]
2025-09-30T14:56:02.248916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:02.248925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.248938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:02.248944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:02.248952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:02.248957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:02.249101Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:02.274506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2078 sessionId: src_id|f42b9fcc-b69236c8-c05c6bd7-d88b04e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:02.277381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:02.302157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896143486116559:5488]
2025-09-30T14:56:02.302419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2077, pipe: [1:7555896143486116559:5488]
2025-09-30T14:56:02.366652Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:02.367221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:02.367239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:02.367272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896143486116559:5488], now have 1 active actors on pipe
2025-09-30T14:56:02.367520Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:02.368343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896143486116559:5488]
2025-09-30T14:56:02.368374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:02.368431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2078 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f42b9fcc-b69236c8-c05c6bd7-d88b04e5_0
2025-09-30T14:56:02.368584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2078 sessionId: src_id|f42b9fcc-b69236c8-c05c6bd7-d88b04e5_0 is DEAD
2025-09-30T14:56:02.368689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:02.368913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f42b9fcc-b69236c8-c05c6bd7-d88b04e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:02.368925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f42b9fcc-b69236c8-c05c6bd7-d88b04e5_0] Write session will restart in 0.009521s
2025-09-30T14:56:02.368951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f42b9fcc-b69236c8-c05c6bd7-d88b04e5_0] Write session: Do CDS request
2025-09-30T14:56:02.368956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f42b9fcc-b69236c8-c05c6bd7-d88b04e5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:02.380118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f42b9fcc-b69236c8-c05c6bd7-d88b04e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:02.383601Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:02.383618Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2079
2025-09-30T14:56:02.383775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2079 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:02.383801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2079 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:02.383808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2079 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:02.383812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:02.385235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2079 sessionId:  describe result for acl check
2025-09-30T14:56:02.385278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:02.385285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:02.385287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:02.385294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896143486116624:8592] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:02.385752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896143486116624:8592] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:02.391315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896143486116624:8592] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:02.394732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896143486116624:8592] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:02.394749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896143486116624:8592] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:02.394754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896143486116624:8592] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:02.394762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2079 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:02.395258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:02.397713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:02.397913Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:02.397916Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:02.397925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:02.397965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:02.397994Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896143396345601:3598]
2025-09-30T14:56:02.398491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:02.398807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:02.398853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:02.399106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:02.399148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:02.399150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:02.399151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:02.399152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:02.399153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:02.399154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:02.399154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:02.399155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:02.399156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:02.399157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:02.399158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.399159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.399160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.399160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:02.399162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:02.399165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:02.399173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:02.399175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:02.399178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:02.399181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:02.399183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:02.399186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:02.399188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:02.399190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:02.399193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:02.399196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.399198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.399200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.399203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:02.399206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:02.399212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:02.399217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:02.399221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:02.399225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:02.399228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:02.399231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:02.399234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:02.399237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:02.399240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:02.399262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:02.399265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:02.399269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:02.399272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:02.399276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:02.399278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:02.399282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:02.399285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:02.399288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:02.399292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:02.399295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:02.399298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.399302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.399305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.399308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.399311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.399317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.399321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:02.399327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:02.399333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:02.399341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:02.399368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:02.405301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:02.406205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:02.406211Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:02.406213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:02.406217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:02.406223Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2078 [2:7555896143396345601:3598]
2025-09-30T14:56:02.406237Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:02.406250Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:02.406253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:02.406256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:02.406258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:02.406271Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:02.406277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:02.406284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:02.406349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.406351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.406353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.406356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:02.406359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:02.406419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:02.406421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.406431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.406438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.406448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:02.406462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896143396345594:3598]
2025-09-30T14:56:02.406464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896143396345594:3598]
2025-09-30T14:56:02.406467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896143396345594:3598]
2025-09-30T14:56:02.406483Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:02.406504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:02.406517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:02.406520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:02.406541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:02.406546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:02.406548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:02.406561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896143396345594:3598]
2025-09-30T14:56:02.406564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:02.406631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:02.406948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2078
2025-09-30T14:56:02.406999Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2078
2025-09-30T14:56:02.407113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896143486116723:8592], now have 1 active actors on pipe
2025-09-30T14:56:02.407125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896143486116560:2454], now have 1 active actors on pipe
2025-09-30T14:56:02.407436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:02.407447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:02.407478Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b324cf25-d7a72745-9218a13b-efdb4fef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:02.407488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:02.407492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:02.407494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:02.407517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:02.407529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:02.407550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:02.407844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:02.407862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:02.407898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:02.408003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2079 partition: 0 MaxSeqNo: 42 sessionId: src_id|b324cf25-d7a72745-9218a13b-efdb4fef_0
2025-09-30T14:56:02.408415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f42b9fcc-b69236c8-c05c6bd7-d88b04e5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b324cf25-d7a72745-9218a13b-efdb4fef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:02.411412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b324cf25-d7a72745-9218a13b-efdb4fef_0] Write session: try to update token
2025-09-30T14:56:02.411431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b324cf25-d7a72745-9218a13b-efdb4fef_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:02.419624Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:02.419648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:02.419651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:02.419654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:02.419665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896143396345594:3598]
2025-09-30T14:56:02.419670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896143396345594:3598]
2025-09-30T14:56:02.419675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896143396345594:3598]
2025-09-30T14:56:02.419725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:02.419739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.419747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:02.419901Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:02.423348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:02.423372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:02.423381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:02.431908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2079 sessionId: src_id|b324cf25-d7a72745-9218a13b-efdb4fef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:02.435070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:02.468569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896143486116735:5488]
2025-09-30T14:56:02.468923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2078, pipe: [1:7555896143486116735:5488]
2025-09-30T14:56:02.540647Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:02.541241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:02.541257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:02.541280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896143486116735:5488], now have 1 active actors on pipe
2025-09-30T14:56:02.541540Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:02.541980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b324cf25-d7a72745-9218a13b-efdb4fef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:02.541992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b324cf25-d7a72745-9218a13b-efdb4fef_0] Write session will restart in 0.007069s
2025-09-30T14:56:02.542016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b324cf25-d7a72745-9218a13b-efdb4fef_0] Write session: Do CDS request
2025-09-30T14:56:02.542021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b324cf25-d7a72745-9218a13b-efdb4fef_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:02.541553Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:02.541558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:02.541564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:02.541616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896143486116735:5488]
2025-09-30T14:56:02.541643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2079 reason: error at write: Disconnected sessionId: src_id|b324cf25-d7a72745-9218a13b-efdb4fef_0
2025-09-30T14:56:02.541820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2079 sessionId: src_id|b324cf25-d7a72745-9218a13b-efdb4fef_0 is DEAD
2025-09-30T14:56:02.550833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b324cf25-d7a72745-9218a13b-efdb4fef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:02.551033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:02.551059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2080
2025-09-30T14:56:02.551196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2080 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:02.551231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2080 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:02.551241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2080 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:02.551295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:02.551792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2080 sessionId:  describe result for acl check
2025-09-30T14:56:02.551829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:02.551834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:02.551836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:02.551842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896143486116770:8584] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:02.552385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896143486116770:8584] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:02.555701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896143486116770:8584] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:02.557970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:02.558253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896143486116770:8584] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:02.558270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896143486116770:8584] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:02.558274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896143486116770:8584] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:02.558282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2080 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:02.560492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:02.560749Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:02.560760Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:02.560772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:02.560827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:02.560875Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896143396345769:3596]
2025-09-30T14:56:02.561593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:02.561881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:02.561924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:02.562273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:02.562337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:02.562343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:02.562345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:02.562346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:02.562348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:02.562349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:02.562351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:02.562352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:02.562354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:02.562355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:02.562357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.562359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.562360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.562362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:02.562363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:02.562369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:02.562380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:02.562385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:02.562390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:02.562395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:02.562399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:02.562404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:02.562409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:02.562414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:02.562419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:02.562423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.562428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.562432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.562437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:02.562442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:02.562449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:02.562458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:02.562464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:02.562470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:02.562475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:02.562482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:02.562493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:02.562499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:02.562504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:02.562516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:02.562526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:02.562532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:02.562538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:02.562543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:02.562550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:02.562557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:02.562566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:02.562572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:02.562582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:02.562588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:02.562598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.562604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.562613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.562620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.562630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.562636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.562645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:02.562650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:02.562656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:02.562668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:02.562722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:02.568284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:02.569308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:02.569325Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:02.569329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:02.569333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:02.569341Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2079 [2:7555896143396345769:3596]
2025-09-30T14:56:02.569361Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:02.569381Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:02.569390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:02.569394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:02.569402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:02.569417Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:02.569443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:02.569451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:02.569514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.569523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.569525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.569529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:02.569532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:02.569783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2079
2025-09-30T14:56:02.569795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2079
2025-09-30T14:56:02.570213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2080 partition: 0 MaxSeqNo: 42 sessionId: src_id|9d01cd31-c6037599-f28c8ed5-9c396313_0
2025-09-30T14:56:02.569608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:02.569618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.569634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.569647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.569664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:02.569684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896143486116737:2454], now have 1 active actors on pipe
2025-09-30T14:56:02.569688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896143486116900:8584], now have 1 active actors on pipe
2025-09-30T14:56:02.569695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896143396345763:3596]
2025-09-30T14:56:02.569697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896143396345763:3596]
2025-09-30T14:56:02.569699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896143396345763:3596]
2025-09-30T14:56:02.569713Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:02.569727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:02.569729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:02.569734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:02.569736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:02.569743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:02.569747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:02.569778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896143396345763:3596]
2025-09-30T14:56:02.569785Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:02.569792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:02.569848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:02.569874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:02.569902Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d01cd31-c6037599-f28c8ed5-9c396313_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:02.569910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:02.569914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:02.569917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:02.569927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:02.569937Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:02.569952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:02.570088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:02.570090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:02.570103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:02.570621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b324cf25-d7a72745-9218a13b-efdb4fef_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9d01cd31-c6037599-f28c8ed5-9c396313_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:02.573640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d01cd31-c6037599-f28c8ed5-9c396313_0] Write session: try to update token
2025-09-30T14:56:02.573667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d01cd31-c6037599-f28c8ed5-9c396313_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:02.582584Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:02.582607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:02.582617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896143396345763:3596]
2025-09-30T14:56:02.582670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:02.582677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:02.582869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:02.583035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:02.583193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:02.583395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:02.583624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:02.583675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:02.589524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2080 sessionId: src_id|9d01cd31-c6037599-f28c8ed5-9c396313_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:02.592528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:02.593065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:02.593093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:02.594419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:02.594463Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:02.594466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:02.594468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:02.594471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:02.594480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896143396345763:3596]
2025-09-30T14:56:02.594485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896143396345763:3596]
2025-09-30T14:56:02.594489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896143396345763:3596]
2025-09-30T14:56:02.594523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:02.594527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:02.594535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.594538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:02.594539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:02.594544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:02.594574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:02.594691Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:02.641619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896143486116911:5488]
2025-09-30T14:56:02.641918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2079, pipe: [1:7555896143486116911:5488]
2025-09-30T14:56:02.711532Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:02.721384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:02.721420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:02.721620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:02.721692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:02.721770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:02.721857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:02.721909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:02.721918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:02.722009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:02.722083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:02.722157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:02.722235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:02.722280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:02.722284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:02.722369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:02.722441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:02.722521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:02.722600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:02.722652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:02.722655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:02.722741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:02.722819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:02.722899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:02.722981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:02.723030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:02.723033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:02.723120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:02.723216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:02.723474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:02.723562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:02.723619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:02.723622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:02.723716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:02.723782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:02.723859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:02.723937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:02.723989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:02.723991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:02.724077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:02.724154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:02.724237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:02.724317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:02.724369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:02.724372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:02.724457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:02.724534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:02.724616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:02.724695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:02.724746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:02.724749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:02.724836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:02.724907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:02.724979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:02.725056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:02.725104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:02.725107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:02.725189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:02.725260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:02.725337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:02.725412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:02.725475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:02.725478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:02.725556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896143486116911:5488], now have 1 active actors on pipe
2025-09-30T14:56:02.727682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:02.727746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896143486116911:5488]
2025-09-30T14:56:02.727770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:02.727778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:02.727803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2080 reason: error at write: Disconnected sessionId: src_id|9d01cd31-c6037599-f28c8ed5-9c396313_0
2025-09-30T14:56:02.727998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2080 sessionId: src_id|9d01cd31-c6037599-f28c8ed5-9c396313_0 is DEAD
2025-09-30T14:56:02.728385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d01cd31-c6037599-f28c8ed5-9c396313_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:02.728397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d01cd31-c6037599-f28c8ed5-9c396313_0] Write session will restart in 0.007873s
2025-09-30T14:56:02.728421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d01cd31-c6037599-f28c8ed5-9c396313_0] Write session: Do CDS request
2025-09-30T14:56:02.728427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d01cd31-c6037599-f28c8ed5-9c396313_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:02.737786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d01cd31-c6037599-f28c8ed5-9c396313_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:02.737888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:02.737905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2081
2025-09-30T14:56:02.738053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2081 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:02.738094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2081 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:02.738104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2081 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:02.738108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:02.738495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2081 sessionId:  describe result for acl check
2025-09-30T14:56:02.738529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:02.738531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:02.738536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:02.735343Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:02.738542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896143486116944:8565] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:02.739060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896143486116944:8565] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:02.741654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896143486116944:8565] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:02.749838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:02.752487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896143486116944:8565] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:02.752517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896143486116944:8565] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:02.752522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896143486116944:8565] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:02.752533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2081 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:02.752583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:02.752851Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:02.752865Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:02.752878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:02.752954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:02.753001Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896143396345960:3581]
2025-09-30T14:56:02.753738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:02.754206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:02.754257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:02.754644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:02.754727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:02.754729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:02.754730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:02.754731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:02.754733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:02.754734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:02.754735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:02.754736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:02.754737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:02.754739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:02.754740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.754741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.754742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.754743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:02.754744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:02.754752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:02.754765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:02.754769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:02.754774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:02.754778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:02.754782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:02.754787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:02.754791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:02.754795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:02.754799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:02.754803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.754807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.754811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.754815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:02.754819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:02.754829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:02.754838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:02.754844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:02.754850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:02.754855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:02.754862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:02.754867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:02.754872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:02.754878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:02.754885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:02.754891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:02.754896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:02.754903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:02.754909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:02.754914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:02.754921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:02.754928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:02.754935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:02.754941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:02.754947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:02.754953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.754959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.754965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.754971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.754977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.754984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.754989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:02.754995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:02.755001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:02.755007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:02.755060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:02.761304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:02.762520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:02.762527Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:02.762530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:02.762534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:02.762541Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2080 [2:7555896143396345960:3581]
2025-09-30T14:56:02.762558Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:02.762574Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:02.762577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:02.762580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:02.762582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:02.762599Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:02.762606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:02.762615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:02.762687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.762689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.762691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.762695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:02.762698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:02.762775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:02.762778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.762795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.762808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.762828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:02.762848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896143486117091:8565], now have 1 active actors on pipe
2025-09-30T14:56:02.762852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896143486116931:2454], now have 1 active actors on pipe
2025-09-30T14:56:02.762858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896143396345955:3581]
2025-09-30T14:56:02.762861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896143396345955:3581]
2025-09-30T14:56:02.762863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896143396345955:3581]
2025-09-30T14:56:02.762880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:02.762893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:02.762909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:02.762913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:02.762913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:02.762917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:02.762919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:02.762950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896143396345955:3581]
2025-09-30T14:56:02.762958Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:02.762964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:02.763989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2080
2025-09-30T14:56:02.764043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2080
2025-09-30T14:56:02.764309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:02.764329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:02.764366Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d6619f5-b33238e6-f1e58366-2942ba0d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:02.764392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:02.764405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:02.764407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:02.764419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:02.764437Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:02.764475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:02.764861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:02.764874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:02.764902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:02.765121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2081 partition: 0 MaxSeqNo: 42 sessionId: src_id|3d6619f5-b33238e6-f1e58366-2942ba0d_0
2025-09-30T14:56:02.765575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d01cd31-c6037599-f28c8ed5-9c396313_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3d6619f5-b33238e6-f1e58366-2942ba0d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:02.768732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d6619f5-b33238e6-f1e58366-2942ba0d_0] Write session: try to update token
2025-09-30T14:56:02.768752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d6619f5-b33238e6-f1e58366-2942ba0d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:02.779396Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:02.779418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:02.779420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:02.779422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:02.779434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896143396345955:3581]
2025-09-30T14:56:02.779439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896143396345955:3581]
2025-09-30T14:56:02.779443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896143396345955:3581]
2025-09-30T14:56:02.779492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:02.779501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.779501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:02.779504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:02.779508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:02.779513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:02.779662Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:02.798415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2081 sessionId: src_id|3d6619f5-b33238e6-f1e58366-2942ba0d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:02.801266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:02.827979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896143486117112:5488]
2025-09-30T14:56:02.828220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2080, pipe: [1:7555896143486117112:5488]
2025-09-30T14:56:02.905137Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:02.905558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:02.905585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:02.905608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896143486117112:5488], now have 1 active actors on pipe
2025-09-30T14:56:02.905895Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:02.906186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:02.906202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:02.906264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2081 reason: error at write: Disconnected sessionId: src_id|3d6619f5-b33238e6-f1e58366-2942ba0d_0
2025-09-30T14:56:02.906434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2081 sessionId: src_id|3d6619f5-b33238e6-f1e58366-2942ba0d_0 is DEAD
2025-09-30T14:56:02.906563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:02.906596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896143486117112:5488]
2025-09-30T14:56:02.907666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d6619f5-b33238e6-f1e58366-2942ba0d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:02.907679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d6619f5-b33238e6-f1e58366-2942ba0d_0] Write session will restart in 0.005540s
2025-09-30T14:56:02.907705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d6619f5-b33238e6-f1e58366-2942ba0d_0] Write session: Do CDS request
2025-09-30T14:56:02.907713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d6619f5-b33238e6-f1e58366-2942ba0d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:02.914824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d6619f5-b33238e6-f1e58366-2942ba0d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:02.914979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:02.915001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2082
2025-09-30T14:56:02.915454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2082 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:02.915503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2082 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:02.915509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2082 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:02.915514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:02.916270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2082 sessionId:  describe result for acl check
2025-09-30T14:56:02.916325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:02.916335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:02.916338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:02.916346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896143486117135:8552] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:02.917112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896143486117135:8552] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:02.925389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896143486117135:8552] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:02.932707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896143486117135:8552] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:02.932738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896143486117135:8552] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:02.932742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896143486117135:8552] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:02.932755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2082 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:02.939715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:02.943925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:02.944174Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:02.944178Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:02.944189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:02.944236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:02.944273Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896143396346154:3570]
2025-09-30T14:56:02.944836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:02.945237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:02.945276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:02.945607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:02.945679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:02.945680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:02.945682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:02.945683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:02.945684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:02.945685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:02.945687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:02.945688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:02.945689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:02.945690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:02.945691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.945692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.945693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.945695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:02.945696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:02.945701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:02.945709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:02.945712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:02.945714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:02.945717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:02.945720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:02.945723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:02.945726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:02.945728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:02.945731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:02.945734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.945737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.945740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.945742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:02.945745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:02.945752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:02.945758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:02.945763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:02.945767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:02.945771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:02.945775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:02.945778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:02.945782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:02.945785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:02.945789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:02.945793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:02.945797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:02.945801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:02.945805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:02.945808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:02.945812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:02.945816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:02.945820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:02.945823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:02.945826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:02.945831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.945835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.945838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.945842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.945850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.945857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.945861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:02.945867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:02.945872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:02.945878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:02.945921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:02.953047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:02.953997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:02.954022Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:02.954026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:02.954030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:02.954039Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2081 [2:7555896143396346154:3570]
2025-09-30T14:56:02.954058Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:02.954075Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:02.954079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:02.954082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:02.954085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:02.954103Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:02.954110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:02.954118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:02.954185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.954196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.954198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.954202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:02.954206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:02.954285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:02.954293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.954308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:02.954328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:02.954351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:02.954377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896143486117233:8552], now have 1 active actors on pipe
2025-09-30T14:56:02.954383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896143486117126:2454], now have 1 active actors on pipe
2025-09-30T14:56:02.954391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896143396346149:3570]
2025-09-30T14:56:02.954394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896143396346149:3570]
2025-09-30T14:56:02.954396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896143396346149:3570]
2025-09-30T14:56:02.954406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:02.954426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:02.954432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:02.954440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:02.954443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:02.954449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:02.954454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:02.954495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896143396346149:3570]
2025-09-30T14:56:02.954514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:02.954541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:02.954859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:02.954871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:02.954902Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|899f9833-cedbd111-d9faad1f-1134c3e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:02.954919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:02.954923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:02.954925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:02.954937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:02.954947Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:02.954963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:02.954490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2081
2025-09-30T14:56:02.954496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2081
2025-09-30T14:56:02.955260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:02.955278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:02.955306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:02.959508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2082 partition: 0 MaxSeqNo: 42 sessionId: src_id|899f9833-cedbd111-d9faad1f-1134c3e3_0
2025-09-30T14:56:02.960003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d6619f5-b33238e6-f1e58366-2942ba0d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|899f9833-cedbd111-d9faad1f-1134c3e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:02.963005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|899f9833-cedbd111-d9faad1f-1134c3e3_0] Write session: try to update token
2025-09-30T14:56:02.963031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|899f9833-cedbd111-d9faad1f-1134c3e3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:02.970905Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:02.970928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:02.970930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:02.970931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:02.970941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896143396346149:3570]
2025-09-30T14:56:02.970945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896143396346149:3570]
2025-09-30T14:56:02.970953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896143396346149:3570]
2025-09-30T14:56:02.970990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:02.970996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:02.970997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:02.971023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:02.971033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:02.971044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:02.971163Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:02.986010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2082 sessionId: src_id|899f9833-cedbd111-d9faad1f-1134c3e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:02.989107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:03.006675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896147781084599:5488]
2025-09-30T14:56:03.007069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2081, pipe: [1:7555896147781084599:5488]
2025-09-30T14:56:03.089673Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:03.089970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:03.089984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:03.090003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896147781084599:5488], now have 1 active actors on pipe
2025-09-30T14:56:03.090220Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:03.090329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:03.090346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:03.090351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896147781084599:5488]
2025-09-30T14:56:03.090388Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:03.090435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2082 reason: error at write: Disconnected sessionId: src_id|899f9833-cedbd111-d9faad1f-1134c3e3_0
2025-09-30T14:56:03.090823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|899f9833-cedbd111-d9faad1f-1134c3e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:03.090836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|899f9833-cedbd111-d9faad1f-1134c3e3_0] Write session will restart in 0.009872s
2025-09-30T14:56:03.090862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|899f9833-cedbd111-d9faad1f-1134c3e3_0] Write session: Do CDS request
2025-09-30T14:56:03.090618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2082 sessionId: src_id|899f9833-cedbd111-d9faad1f-1134c3e3_0 is DEAD
2025-09-30T14:56:03.090868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|899f9833-cedbd111-d9faad1f-1134c3e3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:03.101820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|899f9833-cedbd111-d9faad1f-1134c3e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:03.101877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:03.101900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2083
2025-09-30T14:56:03.102062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2083 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:03.102108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2083 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:03.102118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2083 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:03.102122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:03.102598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2083 sessionId:  describe result for acl check
2025-09-30T14:56:03.102635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:03.102644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:03.102646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:03.102653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896147781084621:8543] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:03.103223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896147781084621:8543] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:03.107147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896147781084621:8543] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:03.110739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896147781084621:8543] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:03.110758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896147781084621:8543] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:03.110762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896147781084621:8543] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:03.110772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2083 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:03.111838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:03.115036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:03.115336Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:03.115345Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:03.115357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:03.115430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:03.115474Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896147691313619:3563]
2025-09-30T14:56:03.116176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:03.116672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:03.116726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:03.117061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:03.117149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:03.117157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:03.117159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:03.117160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:03.117161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:03.117162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:03.117163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:03.117165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:03.117167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:03.117168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:03.117169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.117171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.117172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.117173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:03.117174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:03.117180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:03.117192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:03.117197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:03.117201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:03.117205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:03.117210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:03.117213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:03.117217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:03.117220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:03.117225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:03.117228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.117232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.117235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.117239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:03.117242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:03.117250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:03.117259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:03.117265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:03.117271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:03.117276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:03.117282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:03.117286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:03.117292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:03.117297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:03.117302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:03.117307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:03.117312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:03.117318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:03.117323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:03.117328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:03.117333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:03.117338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:03.117343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:03.117348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:03.117353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:03.117358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.117363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.117367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.117371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.117378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.117382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.117386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:03.117390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:03.117395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:03.117400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:03.117457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:03.123938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:03.124929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:03.124949Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:03.124953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:03.124958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:03.124965Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2082 [2:7555896147691313619:3563]
2025-09-30T14:56:03.124991Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:03.125013Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:03.125023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:03.125027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:03.125030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:03.125051Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:03.125065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:03.125079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:03.125153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.125162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.125164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.125169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:03.125172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:03.125261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:03.125272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.125286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.125300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.125320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:03.125340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896147781084769:8543], now have 1 active actors on pipe
2025-09-30T14:56:03.125350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896147781084602:2454], now have 1 active actors on pipe
2025-09-30T14:56:03.125358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896147691313614:3563]
2025-09-30T14:56:03.125365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896147691313614:3563]
2025-09-30T14:56:03.125368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896147691313614:3563]
2025-09-30T14:56:03.125390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:03.125411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:03.125441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:03.125444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:03.125488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896147691313614:3563]
2025-09-30T14:56:03.125496Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:03.125536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2082
2025-09-30T14:56:03.125564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2082
2025-09-30T14:56:03.125573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:03.125594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:03.125620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:03.125632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:03.125749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:03.125779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:03.125830Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3efb3292-5fee3221-5c7bf472-b6cba719_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:03.125845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:03.125854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:03.125857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:03.125872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:03.125890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:03.125913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:03.126096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:03.126104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:03.126118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:03.126214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2083 partition: 0 MaxSeqNo: 42 sessionId: src_id|3efb3292-5fee3221-5c7bf472-b6cba719_0
2025-09-30T14:56:03.126600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|899f9833-cedbd111-d9faad1f-1134c3e3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3efb3292-5fee3221-5c7bf472-b6cba719_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:03.129666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3efb3292-5fee3221-5c7bf472-b6cba719_0] Write session: try to update token
2025-09-30T14:56:03.129692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3efb3292-5fee3221-5c7bf472-b6cba719_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:03.138939Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:03.138963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:03.138966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:03.138968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:03.138977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896147691313614:3563]
2025-09-30T14:56:03.138982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896147691313614:3563]
2025-09-30T14:56:03.138987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896147691313614:3563]
2025-09-30T14:56:03.139029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:03.139037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:03.139039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.139042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:03.139054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:03.139059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:03.139194Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:03.147040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2083 sessionId: src_id|3efb3292-5fee3221-5c7bf472-b6cba719_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:03.151072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:03.190474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896147781084789:5488]
2025-09-30T14:56:03.190762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2082, pipe: [1:7555896147781084789:5488]
2025-09-30T14:56:03.261070Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:03.261772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:03.261792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:03.261836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896147781084789:5488], now have 1 active actors on pipe
2025-09-30T14:56:03.262110Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:03.262172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:03.262174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896147781084789:5488]
2025-09-30T14:56:03.262266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2083 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3efb3292-5fee3221-5c7bf472-b6cba719_0
2025-09-30T14:56:03.262106Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:03.262476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2083 sessionId: src_id|3efb3292-5fee3221-5c7bf472-b6cba719_0 is DEAD
2025-09-30T14:56:03.262667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3efb3292-5fee3221-5c7bf472-b6cba719_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:03.262677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3efb3292-5fee3221-5c7bf472-b6cba719_0] Write session will restart in 0.009710s
2025-09-30T14:56:03.262703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3efb3292-5fee3221-5c7bf472-b6cba719_0] Write session: Do CDS request
2025-09-30T14:56:03.262709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3efb3292-5fee3221-5c7bf472-b6cba719_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:03.273852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3efb3292-5fee3221-5c7bf472-b6cba719_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:03.273958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:03.273993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2084
2025-09-30T14:56:03.274145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2084 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:03.274184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2084 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:03.274190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2084 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:03.274198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:03.274685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2084 sessionId:  describe result for acl check
2025-09-30T14:56:03.274728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:03.274735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:03.274737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:03.274743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896147781084867:8531] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:03.275427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896147781084867:8531] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:03.277882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896147781084867:8531] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:03.279445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:03.282161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:03.282412Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:03.282424Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:03.282437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:03.282493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:03.282548Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896147691313788:3564]
2025-09-30T14:56:03.282663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896147781084867:8531] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:03.282683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896147781084867:8531] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:03.282686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896147781084867:8531] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:03.282695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2084 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:03.283220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:03.283639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:03.283716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:03.284124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:03.284198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:03.284206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:03.284207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:03.284209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:03.284210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:03.284212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:03.284213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:03.284214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:03.284216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:03.284217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:03.284219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.284220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.284221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.284223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:03.284224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:03.284231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:03.284243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:03.284248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:03.284253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:03.284270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:03.284274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:03.284279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:03.284284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:03.284289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:03.284294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:03.284298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.284303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.284307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.284311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:03.284316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:03.284325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:03.284333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:03.284341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:03.284348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:03.284354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:03.284363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:03.284368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:03.284374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:03.284380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:03.284391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:03.284396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:03.284402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:03.284411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:03.284422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:03.284427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:03.284435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:03.284440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:03.284445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:03.284450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:03.284461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:03.284467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.284471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.284476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.284480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.284485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.284489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.284493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:03.284498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:03.284502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:03.284508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:03.284553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:03.293188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:03.294596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:03.294623Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:03.294626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:03.294630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:03.294637Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2083 [2:7555896147691313788:3564]
2025-09-30T14:56:03.294656Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:03.294677Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:03.294680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:03.294683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:03.294685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:03.294704Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:03.294711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:03.294722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:03.294796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.294807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.294809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.294813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:03.294816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:03.294893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:03.294896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.294912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.294933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.294950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:03.294976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896147781084962:8531], now have 1 active actors on pipe
2025-09-30T14:56:03.294985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896147781084794:2454], now have 1 active actors on pipe
2025-09-30T14:56:03.294992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896147691313783:3564]
2025-09-30T14:56:03.294994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896147691313783:3564]
2025-09-30T14:56:03.294996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896147691313783:3564]
2025-09-30T14:56:03.295080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2083
2025-09-30T14:56:03.295009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:03.295025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:03.295084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2083
2025-09-30T14:56:03.295028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:03.295028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:03.295031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:03.295043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:03.295045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:03.295093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896147691313783:3564]
2025-09-30T14:56:03.295103Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:03.295124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:03.295158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:03.295162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:03.295189Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c7f9828-9e9d9f8b-9f4c171-fb85a558_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:03.295196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:03.295204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:03.295206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:03.295220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:03.295235Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:03.295271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:03.295545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:03.295560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:03.295582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:03.295672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2084 partition: 0 MaxSeqNo: 42 sessionId: src_id|8c7f9828-9e9d9f8b-9f4c171-fb85a558_0
2025-09-30T14:56:03.296118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3efb3292-5fee3221-5c7bf472-b6cba719_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8c7f9828-9e9d9f8b-9f4c171-fb85a558_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:03.299233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c7f9828-9e9d9f8b-9f4c171-fb85a558_0] Write session: try to update token
2025-09-30T14:56:03.299323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c7f9828-9e9d9f8b-9f4c171-fb85a558_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:03.308565Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:03.308585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:03.308595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896147691313783:3564]
2025-09-30T14:56:03.308643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:03.308662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:03.308835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:03.309002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:03.309164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:03.309327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:03.309568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:03.309627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:03.316787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2084 sessionId: src_id|8c7f9828-9e9d9f8b-9f4c171-fb85a558_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:03.319928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:03.320162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:03.320192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:03.320233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:03.320313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:03.324022Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:03.324045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:03.324048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:03.324050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:03.324062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896147691313783:3564]
2025-09-30T14:56:03.324067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896147691313783:3564]
2025-09-30T14:56:03.324077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896147691313783:3564]
2025-09-30T14:56:03.324120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:03.324123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:03.324130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:03.324132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.324134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:03.324135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:03.324290Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:03.362532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896147781084973:5488]
2025-09-30T14:56:03.362880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2083, pipe: [1:7555896147781084973:5488]
2025-09-30T14:56:03.441789Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:03.451853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:03.451891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:03.452097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:03.452174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:03.452248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:03.452324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:03.453142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:03.453162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:03.453247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:03.453315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:03.453387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:03.453478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:03.453532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:03.453543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:03.453626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:03.453700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:03.453779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:03.453855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:03.453913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:03.453925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:03.454006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:03.454081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:03.454154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:03.454229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:03.454281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:03.454292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:03.454369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:03.454448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:03.454527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:03.454601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:03.454655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:03.454664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:03.454747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:03.454819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:03.454894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:03.454970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:03.455020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:03.455029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:03.455103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:03.455173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:03.455417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:03.455494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:03.455547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:03.455556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:03.455636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:03.455706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:03.455779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:03.455857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:03.455909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:03.455917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:03.455991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:03.456059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:03.456136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:03.456211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:03.456264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:03.456272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:03.456345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:03.456417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:03.456493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:03.456566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:03.456627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:03.456634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:03.456711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896147781084973:5488], now have 1 active actors on pipe
2025-09-30T14:56:03.456955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:03.457021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:03.457038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:03.457040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896147781084973:5488]
2025-09-30T14:56:03.457070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2084 reason: error at write: Disconnected sessionId: src_id|8c7f9828-9e9d9f8b-9f4c171-fb85a558_0
2025-09-30T14:56:03.457252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2084 sessionId: src_id|8c7f9828-9e9d9f8b-9f4c171-fb85a558_0 is DEAD
2025-09-30T14:56:03.457413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c7f9828-9e9d9f8b-9f4c171-fb85a558_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:03.457424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c7f9828-9e9d9f8b-9f4c171-fb85a558_0] Write session will restart in 0.007893s
2025-09-30T14:56:03.457459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c7f9828-9e9d9f8b-9f4c171-fb85a558_0] Write session: Do CDS request
2025-09-30T14:56:03.457464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c7f9828-9e9d9f8b-9f4c171-fb85a558_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:03.457528Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:03.466816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c7f9828-9e9d9f8b-9f4c171-fb85a558_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:03.466877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:03.466899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2085
2025-09-30T14:56:03.467078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2085 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:03.467125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2085 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:03.467130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2085 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:03.467135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:03.467644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2085 sessionId:  describe result for acl check
2025-09-30T14:56:03.467684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:03.467696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:03.467701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:03.467707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896147781085006:8532] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:03.468241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896147781085006:8532] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:03.471434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896147781085006:8532] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:03.473446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:03.475695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:03.475896Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:03.475905Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:03.475915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:03.475920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896147781085006:8532] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:03.475938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896147781085006:8532] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:03.475944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896147781085006:8532] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:03.475964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:03.475953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2085 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:03.476002Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896147691313961:3560]
2025-09-30T14:56:03.476648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:03.476947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:03.476984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:03.477299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:03.477350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:03.477352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:03.477353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:03.477354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:03.477356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:03.477357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:03.477358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:03.477359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:03.477361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:03.477362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:03.477363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.477364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.477366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.477367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:03.477368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:03.477374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:03.477384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:03.477389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:03.477393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:03.477396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:03.477400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:03.477404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:03.477408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:03.477411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:03.477415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:03.477419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.477423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.477437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.477441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:03.477444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:03.477452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:03.477459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:03.477466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:03.477471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:03.477476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:03.477481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:03.477485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:03.477490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:03.477494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:03.477499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:03.477504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:03.477509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:03.477516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:03.477520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:03.477526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:03.477530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:03.477535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:03.477540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:03.477545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:03.477550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:03.477561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.477566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.477571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.477580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.477584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.477589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.477598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:03.477602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:03.477606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:03.477611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:03.477656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:03.483543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:03.484874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:03.484892Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:03.484895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:03.484899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:03.484906Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2084 [2:7555896147691313961:3560]
2025-09-30T14:56:03.484921Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:03.484938Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:03.484942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:03.484945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:03.484947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:03.484964Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:03.484977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:03.484984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:03.485043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.485053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.485055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.485059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:03.485062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:03.485125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:03.485134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.485151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.485168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.485191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:03.485215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896147781085144:8532], now have 1 active actors on pipe
2025-09-30T14:56:03.485224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896147781084976:2454], now have 1 active actors on pipe
2025-09-30T14:56:03.485230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896147691313956:3560]
2025-09-30T14:56:03.485233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896147691313956:3560]
2025-09-30T14:56:03.485235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896147691313956:3560]
2025-09-30T14:56:03.485249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:03.485258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:03.485261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:03.485263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:03.485266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:03.485281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:03.485289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:03.485295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2084
2025-09-30T14:56:03.485297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2084
2025-09-30T14:56:03.485330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896147691313956:3560]
2025-09-30T14:56:03.485338Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:03.485348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:03.485369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:03.485379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:03.485409Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4db4f1e-d8d1710c-27684765-8baa4eda_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:03.485422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:03.485438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:03.485440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:03.485450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:03.485458Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:03.485474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:03.485661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:03.485677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:03.485703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:03.485782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2085 partition: 0 MaxSeqNo: 42 sessionId: src_id|e4db4f1e-d8d1710c-27684765-8baa4eda_0
2025-09-30T14:56:03.486142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c7f9828-9e9d9f8b-9f4c171-fb85a558_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e4db4f1e-d8d1710c-27684765-8baa4eda_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:03.489271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4db4f1e-d8d1710c-27684765-8baa4eda_0] Write session: try to update token
2025-09-30T14:56:03.489295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4db4f1e-d8d1710c-27684765-8baa4eda_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:03.498222Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:03.498249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:03.498252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:03.498255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:03.498266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896147691313956:3560]
2025-09-30T14:56:03.498271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896147691313956:3560]
2025-09-30T14:56:03.498275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896147691313956:3560]
2025-09-30T14:56:03.498321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:03.498334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.498326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:03.498344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:03.498344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:03.498352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:03.498529Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:03.505784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2085 sessionId: src_id|e4db4f1e-d8d1710c-27684765-8baa4eda_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:03.508745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:03.557078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896147781085156:5488]
2025-09-30T14:56:03.557423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2084, pipe: [1:7555896147781085156:5488]
2025-09-30T14:56:03.612805Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:03.613246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:03.613266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:03.613290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896147781085156:5488], now have 1 active actors on pipe
2025-09-30T14:56:03.613551Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:03.613724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896147781085156:5488]
2025-09-30T14:56:03.613723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:03.613730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:03.613772Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:03.613799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2085 reason: error at write: Disconnected sessionId: src_id|e4db4f1e-d8d1710c-27684765-8baa4eda_0
2025-09-30T14:56:03.613998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2085 sessionId: src_id|e4db4f1e-d8d1710c-27684765-8baa4eda_0 is DEAD
2025-09-30T14:56:03.614180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4db4f1e-d8d1710c-27684765-8baa4eda_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:03.614191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4db4f1e-d8d1710c-27684765-8baa4eda_0] Write session will restart in 0.006943s
2025-09-30T14:56:03.614226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4db4f1e-d8d1710c-27684765-8baa4eda_0] Write session: Do CDS request
2025-09-30T14:56:03.614232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4db4f1e-d8d1710c-27684765-8baa4eda_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:03.622861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4db4f1e-d8d1710c-27684765-8baa4eda_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:03.622950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:03.622980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2086
2025-09-30T14:56:03.623142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2086 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:03.623178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2086 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:03.623189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2086 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:03.623193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:03.623682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2086 sessionId:  describe result for acl check
2025-09-30T14:56:03.623716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:03.623723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:03.623725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:03.623732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896147781085197:8522] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:03.624285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896147781085197:8522] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:03.626959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896147781085197:8522] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:03.628961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:03.629564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896147781085197:8522] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:03.629579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896147781085197:8522] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:03.629583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896147781085197:8522] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:03.629593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2086 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:03.631673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:03.632029Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:03.632045Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:03.632059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:03.632139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:03.632184Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896147691314134:3554]
2025-09-30T14:56:03.632873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:03.633227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:03.633272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:03.633580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:03.633630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:03.633637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:03.633638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:03.633639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:03.633641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:03.633642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:03.633644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:03.633645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:03.633647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:03.633648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:03.633649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.633651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.633652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.633653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:03.633654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:03.633660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:03.633672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:03.633677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:03.633681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:03.633684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:03.633687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:03.633691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:03.633695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:03.633699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:03.633702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:03.633707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.633711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.633715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.633720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:03.633724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:03.633732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:03.633738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:03.633742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:03.633746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:03.633750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:03.633754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:03.633756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:03.633760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:03.633763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:03.633766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:03.633769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:03.633772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:03.633776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:03.633779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:03.633782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:03.633785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:03.633788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:03.633791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:03.633794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:03.633797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:03.633800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.633803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.633806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.633809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.633813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.633816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.633819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:03.633822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:03.633825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:03.633828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:03.633854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:03.639479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:03.640702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:03.640719Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:03.640722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:03.640726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:03.640733Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2085 [2:7555896147691314134:3554]
2025-09-30T14:56:03.640748Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:03.640765Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:03.640769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:03.640772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:03.640775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:03.640792Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:03.640805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:03.640812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:03.640877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.640885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.640887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.640891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:03.640893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:03.640964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:03.640973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.640986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.641006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.641025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:03.641045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896147781085157:2454], now have 1 active actors on pipe
2025-09-30T14:56:03.641049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896147781085326:8522], now have 1 active actors on pipe
2025-09-30T14:56:03.641056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896147691314128:3554]
2025-09-30T14:56:03.641058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896147691314128:3554]
2025-09-30T14:56:03.641060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896147691314128:3554]
2025-09-30T14:56:03.641075Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:03.641094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:03.641095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:03.641099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:03.641101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:03.641115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:03.641118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:03.641110Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2085
2025-09-30T14:56:03.641118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2085
2025-09-30T14:56:03.641155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896147691314128:3554]
2025-09-30T14:56:03.641167Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:03.641173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:03.641189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:03.641199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:03.641249Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72fdc0df-9fc49039-c7bfd525-7324022c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:03.641261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:03.641265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:03.641267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:03.641277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:03.641286Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:03.641309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:03.641479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:03.641485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:03.641498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:03.641610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2086 partition: 0 MaxSeqNo: 42 sessionId: src_id|72fdc0df-9fc49039-c7bfd525-7324022c_0
2025-09-30T14:56:03.641991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4db4f1e-d8d1710c-27684765-8baa4eda_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|72fdc0df-9fc49039-c7bfd525-7324022c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:03.644912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72fdc0df-9fc49039-c7bfd525-7324022c_0] Write session: try to update token
2025-09-30T14:56:03.644931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72fdc0df-9fc49039-c7bfd525-7324022c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:03.653861Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:03.653882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:03.653884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:03.653887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:03.653896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896147691314128:3554]
2025-09-30T14:56:03.653901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896147691314128:3554]
2025-09-30T14:56:03.653905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896147691314128:3554]
2025-09-30T14:56:03.653943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:03.653952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.653956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:03.653963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:03.653970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:03.653974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:03.654108Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:03.662037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2086 sessionId: src_id|72fdc0df-9fc49039-c7bfd525-7324022c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:03.665031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:03.713242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896147781085340:5488]
2025-09-30T14:56:03.713596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2085, pipe: [1:7555896147781085340:5488]
2025-09-30T14:56:03.768698Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:03.769221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:03.769237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:03.769259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896147781085340:5488], now have 1 active actors on pipe
2025-09-30T14:56:03.769580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:03.769589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896147781085340:5488]
2025-09-30T14:56:03.769597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:03.769614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:03.769803Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:03.770170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2086 reason: error at write: Disconnected sessionId: src_id|72fdc0df-9fc49039-c7bfd525-7324022c_0
2025-09-30T14:56:03.770359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2086 sessionId: src_id|72fdc0df-9fc49039-c7bfd525-7324022c_0 is DEAD
2025-09-30T14:56:03.770563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72fdc0df-9fc49039-c7bfd525-7324022c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:03.770576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72fdc0df-9fc49039-c7bfd525-7324022c_0] Write session will restart in 0.007337s
2025-09-30T14:56:03.770601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72fdc0df-9fc49039-c7bfd525-7324022c_0] Write session: Do CDS request
2025-09-30T14:56:03.770611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72fdc0df-9fc49039-c7bfd525-7324022c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:03.778770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72fdc0df-9fc49039-c7bfd525-7324022c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:03.779409Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:03.779430Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2087
2025-09-30T14:56:03.779566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2087 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:03.779618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2087 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:03.779623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2087 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:03.779627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:03.780118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2087 sessionId:  describe result for acl check
2025-09-30T14:56:03.780152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:03.780155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:03.780157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:03.780162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896147781085398:8519] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:03.780629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896147781085398:8519] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:03.783352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896147781085398:8519] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:03.785904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:03.786286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896147781085398:8519] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:03.786301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896147781085398:8519] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:03.786304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896147781085398:8519] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:03.786312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2087 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:03.788620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:03.788920Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:03.788931Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:03.788946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:03.789009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:03.789059Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896147691314332:3550]
2025-09-30T14:56:03.789737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:03.790059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:03.790109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:03.790487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:03.790564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:03.790571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:03.790572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:03.790573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:03.790577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:03.790578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:03.790580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:03.790581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:03.790583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:03.790584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:03.790586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.790587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.790588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.790589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:03.790590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:03.790596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:03.790607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:03.790611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:03.790615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:03.790619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:03.790623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:03.790627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:03.790631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:03.790635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:03.790639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:03.790643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.790646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.790650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.790654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:03.790658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:03.790665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:03.790673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:03.790679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:03.790685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:03.790689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:03.790696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:03.790700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:03.790706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:03.790710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:03.790722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:03.790727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:03.790733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:03.790738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:03.790748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:03.790752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:03.790758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:03.790762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:03.790772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:03.790776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:03.790781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:03.790790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.790795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.790801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.790806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.790809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.790813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.790817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:03.790822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:03.790826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:03.790831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:03.790879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:03.797309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:03.798550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:03.798575Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:03.798577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:03.798582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:03.798589Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2086 [2:7555896147691314332:3550]
2025-09-30T14:56:03.798606Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:03.798626Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:03.798629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:03.798632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:03.798634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:03.798662Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:03.798677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:03.798689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:03.798766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.798774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.798776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.798781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:03.798784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:03.798858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:03.798868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.798883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.798895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.798912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:03.798936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896147691314326:3550]
2025-09-30T14:56:03.798939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896147691314326:3550]
2025-09-30T14:56:03.798941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896147691314326:3550]
2025-09-30T14:56:03.798954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:03.798968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896147781085341:2454], now have 1 active actors on pipe
2025-09-30T14:56:03.798969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:03.798973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896147781085523:8519], now have 1 active actors on pipe
2025-09-30T14:56:03.798973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:03.798975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:03.798982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:03.798999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:03.799005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:03.799045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896147691314326:3550]
2025-09-30T14:56:03.799054Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:03.799060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:03.799056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2086
2025-09-30T14:56:03.799125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2086
2025-09-30T14:56:03.799200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:03.799216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:03.799268Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b60a384-b5e4111c-aebe75a1-9eb143ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:03.799285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:03.799288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:03.799290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:03.799301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:03.799312Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:03.799327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:03.799511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:03.799523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:03.799544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:03.799681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2087 partition: 0 MaxSeqNo: 42 sessionId: src_id|2b60a384-b5e4111c-aebe75a1-9eb143ee_0
2025-09-30T14:56:03.800044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72fdc0df-9fc49039-c7bfd525-7324022c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2b60a384-b5e4111c-aebe75a1-9eb143ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:03.803231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b60a384-b5e4111c-aebe75a1-9eb143ee_0] Write session: try to update token
2025-09-30T14:56:03.803276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b60a384-b5e4111c-aebe75a1-9eb143ee_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:03.811944Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:03.811966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:03.811969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:03.811971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:03.811979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896147691314326:3550]
2025-09-30T14:56:03.811984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896147691314326:3550]
2025-09-30T14:56:03.811987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896147691314326:3550]
2025-09-30T14:56:03.812032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:03.812040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.812043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:03.812049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:03.812065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:03.812068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:03.812203Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:03.820288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2087 sessionId: src_id|2b60a384-b5e4111c-aebe75a1-9eb143ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:03.823605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:03.869893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896147781085544:5488]
2025-09-30T14:56:03.870211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2086, pipe: [1:7555896147781085544:5488]
2025-09-30T14:56:03.929292Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:03.929798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:03.929815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:03.929835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896147781085544:5488], now have 1 active actors on pipe
2025-09-30T14:56:03.930143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896147781085544:5488]
2025-09-30T14:56:03.930168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:03.930173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:03.930178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:03.930249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2087 reason: error at write: Disconnected sessionId: src_id|2b60a384-b5e4111c-aebe75a1-9eb143ee_0
2025-09-30T14:56:03.930146Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:03.930444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2087 sessionId: src_id|2b60a384-b5e4111c-aebe75a1-9eb143ee_0 is DEAD
2025-09-30T14:56:03.930644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b60a384-b5e4111c-aebe75a1-9eb143ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:03.930657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b60a384-b5e4111c-aebe75a1-9eb143ee_0] Write session will restart in 0.009840s
2025-09-30T14:56:03.930680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b60a384-b5e4111c-aebe75a1-9eb143ee_0] Write session: Do CDS request
2025-09-30T14:56:03.930686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b60a384-b5e4111c-aebe75a1-9eb143ee_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:03.941847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b60a384-b5e4111c-aebe75a1-9eb143ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:03.943474Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:03.943493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2088
2025-09-30T14:56:03.946798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2088 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:03.946863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2088 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:03.946869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2088 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:03.946874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:03.947071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:03.947351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2088 sessionId:  describe result for acl check
2025-09-30T14:56:03.947400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:03.947407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:03.947409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:03.947416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896147781085695:8503] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:03.947984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896147781085695:8503] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:03.949774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:03.950126Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:03.950137Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:03.950151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:03.950800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896147781085695:8503] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:03.950211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:03.950258Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896147691314530:3507]
2025-09-30T14:56:03.950872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:03.952026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:03.952091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:03.952499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:03.952559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:03.952560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:03.952561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:03.952563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:03.952564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:03.952565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:03.952567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:03.952568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:03.952569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:03.952571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:03.952572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.952574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.952576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.952577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:03.952579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:03.952585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:03.952596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:03.952601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:03.952606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:03.952610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:03.952615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:03.952620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:03.952624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:03.952628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:03.952633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:03.952637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.952642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.952646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.952650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:03.952655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:03.952663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:03.952673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:03.952680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:03.952685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:03.952692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:03.952698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:03.952702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:03.952709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:03.952714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:03.952720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:03.952726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:03.952732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:03.952737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:03.952743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:03.952748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:03.952754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:03.952759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:03.952765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:03.952770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:03.952775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:03.952781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.952787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.952792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.952797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.952803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.952809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.952814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:03.952819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:03.952825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:03.952831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:03.952880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:03.958654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:03.958305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896147781085695:8503] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:03.958324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896147781085695:8503] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:03.958328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896147781085695:8503] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:03.958337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2088 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:03.959641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:03.959661Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:03.959664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:03.959669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:03.959676Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2087 [2:7555896147691314530:3507]
2025-09-30T14:56:03.959693Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:03.959709Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:03.959712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:03.959715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:03.959717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:03.959735Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:03.959750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:03.959764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:03.959837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.959846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.959848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.959851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:03.959853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:03.959926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:03.959934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.959947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:03.959965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:03.959986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:03.960010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896147781085558:2454], now have 1 active actors on pipe
2025-09-30T14:56:03.960018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896147781085734:8503], now have 1 active actors on pipe
2025-09-30T14:56:03.960025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896147691314525:3507]
2025-09-30T14:56:03.960028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896147691314525:3507]
2025-09-30T14:56:03.960030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896147691314525:3507]
2025-09-30T14:56:03.960044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:03.960059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:03.960058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:03.960071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:03.960074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:03.960079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:03.960083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:03.960095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2087
2025-09-30T14:56:03.960100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2087
2025-09-30T14:56:03.960121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896147691314525:3507]
2025-09-30T14:56:03.960134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:03.960137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:03.960169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:03.960179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:03.960212Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb465b1-8633d852-59762904-25c0dcd1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:03.960224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:03.960234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:03.960236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:03.960245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:03.960259Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:03.960284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:03.960490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:03.960498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:03.960513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:03.960603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2088 partition: 0 MaxSeqNo: 42 sessionId: src_id|cb465b1-8633d852-59762904-25c0dcd1_0
2025-09-30T14:56:03.960987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b60a384-b5e4111c-aebe75a1-9eb143ee_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cb465b1-8633d852-59762904-25c0dcd1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:03.964091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb465b1-8633d852-59762904-25c0dcd1_0] Write session: try to update token
2025-09-30T14:56:03.964115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb465b1-8633d852-59762904-25c0dcd1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:03.973234Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:03.973255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:03.973256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:03.973258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:03.973267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896147691314525:3507]
2025-09-30T14:56:03.973270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896147691314525:3507]
2025-09-30T14:56:03.973273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896147691314525:3507]
2025-09-30T14:56:03.973310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:03.973317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:03.973320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:03.973325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:03.973332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:03.973336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:03.973484Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:03.982240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2088 sessionId: src_id|cb465b1-8633d852-59762904-25c0dcd1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:03.985676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:04.030183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896152076053037:5488]
2025-09-30T14:56:04.030630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2087, pipe: [1:7555896152076053037:5488]
2025-09-30T14:56:04.091556Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:04.092053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:04.092070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:04.092089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896152076053037:5488], now have 1 active actors on pipe
2025-09-30T14:56:04.092307Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:04.092698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:04.092713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:04.092748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896152076053037:5488]
2025-09-30T14:56:04.093118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb465b1-8633d852-59762904-25c0dcd1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:04.093135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb465b1-8633d852-59762904-25c0dcd1_0] Write session will restart in 0.006566s
2025-09-30T14:56:04.092763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2088 reason: error at write: Disconnected sessionId: src_id|cb465b1-8633d852-59762904-25c0dcd1_0
2025-09-30T14:56:04.092770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:04.093160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb465b1-8633d852-59762904-25c0dcd1_0] Write session: Do CDS request
2025-09-30T14:56:04.093166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb465b1-8633d852-59762904-25c0dcd1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:04.092929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2088 sessionId: src_id|cb465b1-8633d852-59762904-25c0dcd1_0 is DEAD
2025-09-30T14:56:04.100814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb465b1-8633d852-59762904-25c0dcd1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:04.100879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:04.100897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2089
2025-09-30T14:56:04.101074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2089 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:04.101117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2089 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:04.101125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2089 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:04.101129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:04.102162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2089 sessionId:  describe result for acl check
2025-09-30T14:56:04.102202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:04.102209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:04.102211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:04.102216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896152076053065:8498] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:04.102797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896152076053065:8498] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:04.105300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896152076053065:8498] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:04.107999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:04.108955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896152076053065:8498] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:04.108975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896152076053065:8498] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:04.108978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896152076053065:8498] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:04.108987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2089 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:04.115984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:04.116485Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:04.116500Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:04.116514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:04.116603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:04.116651Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896151986282002:3504]
2025-09-30T14:56:04.117365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:04.117802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:04.117869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:04.118242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:04.118311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:04.118318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:04.118320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:04.118322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:04.118323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:04.118325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:04.118326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:04.118328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:04.118329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:04.118330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:04.118332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.118333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.118335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.118336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:04.118338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:04.118344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:04.118355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:04.118359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:04.118363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:04.118367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:04.118371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:04.118375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:04.118379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:04.118383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:04.118387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:04.118391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.118395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.118399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.118403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:04.118408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:04.118419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:04.118427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:04.118434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:04.118441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:04.118447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:04.118453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:04.118458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:04.118465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:04.118472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:04.118478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:04.118484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:04.118494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:04.118500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:04.118511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:04.118519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:04.118530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:04.118536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:04.118547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:04.118551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:04.118557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:04.118564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.118571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.118581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.118588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.118598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.118605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.118614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:04.118619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:04.118623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:04.118629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:04.118685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:04.125695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:04.126633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:04.126641Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:04.126645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:04.126649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:04.126658Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2088 [2:7555896151986282002:3504]
2025-09-30T14:56:04.126678Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:04.126696Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:04.126701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:04.126704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:04.126712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:04.126730Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:04.126737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:04.126744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:04.126805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.126807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.126810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.126813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:04.126816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:04.126894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:04.126897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.126913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.126928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.126949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:04.126966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896151986281996:3504]
2025-09-30T14:56:04.126969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896151986281996:3504]
2025-09-30T14:56:04.126972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896151986281996:3504]
2025-09-30T14:56:04.126991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:04.127006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:04.127025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:04.127028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:04.127059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:04.127065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896151986281996:3504]
2025-09-30T14:56:04.127064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:04.127067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:04.127067Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:04.127077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:04.127574Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2088
2025-09-30T14:56:04.127624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2088
2025-09-30T14:56:04.127743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896152076053039:2454], now have 1 active actors on pipe
2025-09-30T14:56:04.127758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896152076053210:8498], now have 1 active actors on pipe
2025-09-30T14:56:04.127775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:04.127780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:04.127808Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50765aba-b83d7e02-b6317121-f818069b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:04.127823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:04.127827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:04.127830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:04.127844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:04.127862Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:04.127886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:04.128135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:04.128150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:04.128171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:04.128296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2089 partition: 0 MaxSeqNo: 42 sessionId: src_id|50765aba-b83d7e02-b6317121-f818069b_0
2025-09-30T14:56:04.131405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb465b1-8633d852-59762904-25c0dcd1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|50765aba-b83d7e02-b6317121-f818069b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:04.134537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50765aba-b83d7e02-b6317121-f818069b_0] Write session: try to update token
2025-09-30T14:56:04.134561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50765aba-b83d7e02-b6317121-f818069b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:04.145240Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:04.145270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:04.145272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:04.145275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:04.145288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896151986281996:3504]
2025-09-30T14:56:04.145294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896151986281996:3504]
2025-09-30T14:56:04.145299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896151986281996:3504]
2025-09-30T14:56:04.145351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:04.145364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:04.145368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.145370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:04.145371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:04.145378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:04.145571Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:04.152074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2089 sessionId: src_id|50765aba-b83d7e02-b6317121-f818069b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:04.154992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:04.192938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896152076053227:5488]
2025-09-30T14:56:04.193240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2088, pipe: [1:7555896152076053227:5488]
2025-09-30T14:56:04.265469Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:04.265923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:04.265940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:04.265979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896152076053227:5488], now have 1 active actors on pipe
2025-09-30T14:56:04.266215Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:04.266258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:04.266274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896152076053227:5488]
2025-09-30T14:56:04.266283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:04.266346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2089 reason: error at write: Disconnected sessionId: src_id|50765aba-b83d7e02-b6317121-f818069b_0
2025-09-30T14:56:04.266534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2089 sessionId: src_id|50765aba-b83d7e02-b6317121-f818069b_0 is DEAD
2025-09-30T14:56:04.266211Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:04.266686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50765aba-b83d7e02-b6317121-f818069b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:04.266698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50765aba-b83d7e02-b6317121-f818069b_0] Write session will restart in 0.005301s
2025-09-30T14:56:04.266721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50765aba-b83d7e02-b6317121-f818069b_0] Write session: Do CDS request
2025-09-30T14:56:04.266730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50765aba-b83d7e02-b6317121-f818069b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:04.272792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50765aba-b83d7e02-b6317121-f818069b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:04.272877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:04.272894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2090
2025-09-30T14:56:04.273044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2090 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:04.273090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2090 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:04.273101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2090 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:04.273105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:04.273557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2090 sessionId:  describe result for acl check
2025-09-30T14:56:04.273591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:04.273593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:04.273598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:04.273604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896152076053247:8493] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:04.274189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896152076053247:8493] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:04.278180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896152076053247:8493] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:04.281301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896152076053247:8493] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:04.281319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896152076053247:8493] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:04.281322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896152076053247:8493] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:04.281331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2090 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:04.282275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:04.284990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:04.285275Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:04.285288Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:04.285300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:04.285363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:04.285409Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896151986282178:3498]
2025-09-30T14:56:04.286140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:04.286545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:04.286616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:04.287028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:04.287116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:04.287124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:04.287125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:04.287127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:04.287128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:04.287129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:04.287130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:04.287132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:04.287133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:04.287134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:04.287136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.287137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.287138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.287140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:04.287141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:04.287148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:04.287159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:04.287163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:04.287167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:04.287172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:04.287176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:04.287180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:04.287184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:04.287188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:04.287195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:04.287200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.287204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.287208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.287212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:04.287216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:04.287226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:04.287235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:04.287263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:04.287274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:04.287279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:04.287285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:04.287289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:04.287295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:04.287301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:04.287306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:04.287311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:04.287316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:04.287322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:04.287327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:04.287332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:04.287338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:04.287344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:04.287355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:04.287359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:04.287370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:04.287377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.287387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.287392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.287403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.287409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.287418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.287425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:04.287436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:04.287441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:04.287447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:04.287502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:04.293476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:04.294659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:04.294675Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:04.294678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:04.294682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:04.294690Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2089 [2:7555896151986282178:3498]
2025-09-30T14:56:04.294707Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:04.294723Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:04.294733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:04.294736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:04.294738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:04.294753Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:04.294765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:04.294775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:04.294854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.294864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.294866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.294870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:04.294873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:04.295103Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2089
2025-09-30T14:56:04.294950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:04.294957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.294970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.294979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.294994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:04.295015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896152076053404:8493], now have 1 active actors on pipe
2025-09-30T14:56:04.295018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896152076053232:2454], now have 1 active actors on pipe
2025-09-30T14:56:04.295025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896151986282173:3498]
2025-09-30T14:56:04.295027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896151986282173:3498]
2025-09-30T14:56:04.295029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896151986282173:3498]
2025-09-30T14:56:04.295040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:04.295055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:04.295061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:04.295064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:04.295066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:04.295189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2089
2025-09-30T14:56:04.295069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:04.295073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:04.295110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896151986282173:3498]
2025-09-30T14:56:04.295116Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:04.295136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:04.295208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:04.295212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:04.295237Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|adc4ac9a-1da45751-e5fa123c-1177a417_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:04.295265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:04.295274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:04.295276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:04.295286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:04.295309Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:04.295330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:04.295526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:04.295539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:04.295553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:04.295646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2090 partition: 0 MaxSeqNo: 42 sessionId: src_id|adc4ac9a-1da45751-e5fa123c-1177a417_0
2025-09-30T14:56:04.296054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50765aba-b83d7e02-b6317121-f818069b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|adc4ac9a-1da45751-e5fa123c-1177a417_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:04.299937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adc4ac9a-1da45751-e5fa123c-1177a417_0] Write session: try to update token
2025-09-30T14:56:04.299961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adc4ac9a-1da45751-e5fa123c-1177a417_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:04.308647Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:04.308669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:04.308671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:04.308673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:04.308684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896151986282173:3498]
2025-09-30T14:56:04.308689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896151986282173:3498]
2025-09-30T14:56:04.308693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896151986282173:3498]
2025-09-30T14:56:04.308735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:04.308742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.308745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:04.308745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:04.308751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:04.308755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:04.308892Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:04.317016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2090 sessionId: src_id|adc4ac9a-1da45751-e5fa123c-1177a417_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:04.320140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:04.366539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896152076053417:5488]
2025-09-30T14:56:04.366869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2089, pipe: [1:7555896152076053417:5488]
2025-09-30T14:56:04.421943Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:04.422357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:04.422377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:04.422401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896152076053417:5488], now have 1 active actors on pipe
2025-09-30T14:56:04.423033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896152076053417:5488]
2025-09-30T14:56:04.423038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:04.423042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:04.423046Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:04.423074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:04.423126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2090 reason: error at write: Disconnected sessionId: src_id|adc4ac9a-1da45751-e5fa123c-1177a417_0
2025-09-30T14:56:04.423352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2090 sessionId: src_id|adc4ac9a-1da45751-e5fa123c-1177a417_0 is DEAD
2025-09-30T14:56:04.423518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adc4ac9a-1da45751-e5fa123c-1177a417_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:04.423527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adc4ac9a-1da45751-e5fa123c-1177a417_0] Write session will restart in 0.008619s
2025-09-30T14:56:04.423552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adc4ac9a-1da45751-e5fa123c-1177a417_0] Write session: Do CDS request
2025-09-30T14:56:04.423558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adc4ac9a-1da45751-e5fa123c-1177a417_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:04.433800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adc4ac9a-1da45751-e5fa123c-1177a417_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:04.439545Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:04.439563Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2091
2025-09-30T14:56:04.439860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2091 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:04.439913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2091 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:04.439924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2091 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:04.439934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:04.440421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2091 sessionId:  describe result for acl check
2025-09-30T14:56:04.440462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:04.440464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:04.440466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:04.440472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896152076053489:8487] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:04.441072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896152076053489:8487] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:04.445916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896152076053489:8487] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:04.449597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:04.449692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896152076053489:8487] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:04.449712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896152076053489:8487] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:04.449716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896152076053489:8487] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:04.449725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2091 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:04.459293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:04.459847Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:04.459861Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:04.459875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:04.459955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:04.460004Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896151986282357:3494]
2025-09-30T14:56:04.460680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:04.463849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:04.463953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:04.464413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:04.464518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:04.464520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:04.464522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:04.464523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:04.464525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:04.464527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:04.464529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:04.464531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:04.464533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:04.464535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:04.464536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.464538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.464539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.464541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:04.464542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:04.464550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:04.464563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:04.464568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:04.464573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:04.464578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:04.464584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:04.464589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:04.464595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:04.464600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:04.464606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:04.464611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.464616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.464621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.464625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:04.464630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:04.464641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:04.464651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:04.464659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:04.464666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:04.464675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:04.464682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:04.464687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:04.464693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:04.464698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:04.464705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:04.464711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:04.464717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:04.464722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:04.464728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:04.464733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:04.464740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:04.464747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:04.464753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:04.464758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:04.464764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:04.464771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.464777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.464782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.464789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.464815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.464822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.464828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:04.464832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:04.464837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:04.464841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:04.464895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:04.473194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:04.474318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:04.474340Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:04.474343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:04.474348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:04.474355Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2090 [2:7555896151986282357:3494]
2025-09-30T14:56:04.474376Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:04.474393Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:04.474397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:04.474400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:04.474403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:04.474423Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:04.474431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:04.474438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:04.474509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.474515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.474517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.474521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:04.474524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:04.474606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:04.474609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.474623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.474638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.474658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:04.474677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896151986282350:3494]
2025-09-30T14:56:04.474680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896151986282350:3494]
2025-09-30T14:56:04.474683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896151986282350:3494]
2025-09-30T14:56:04.474692Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:04.474704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:04.474707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:04.474708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:04.474710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:04.474724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:04.474729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:04.474774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896152076053593:8487], now have 1 active actors on pipe
2025-09-30T14:56:04.474786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896152076053419:2454], now have 1 active actors on pipe
2025-09-30T14:56:04.474790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896151986282350:3494]
2025-09-30T14:56:04.474799Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:04.474863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2090
2025-09-30T14:56:04.474876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2090
2025-09-30T14:56:04.474834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:04.475103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:04.475115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:04.475142Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0735ea3-b426bba8-aef3863-cdd58b03_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:04.475155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:04.475159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:04.475161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:04.475171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:04.475182Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:04.475196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:04.475737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:04.475747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:04.475764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:04.475878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2091 partition: 0 MaxSeqNo: 42 sessionId: src_id|d0735ea3-b426bba8-aef3863-cdd58b03_0
2025-09-30T14:56:04.476260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adc4ac9a-1da45751-e5fa123c-1177a417_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d0735ea3-b426bba8-aef3863-cdd58b03_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:04.479727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0735ea3-b426bba8-aef3863-cdd58b03_0] Write session: try to update token
2025-09-30T14:56:04.479758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0735ea3-b426bba8-aef3863-cdd58b03_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:04.488865Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:04.488890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:04.488900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896151986282350:3494]
2025-09-30T14:56:04.488951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:04.488971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:04.489138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:04.489314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:04.489485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:04.489641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:04.489849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:04.489894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:04.501489Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:04.501514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:04.501517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:04.501520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:04.501533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896151986282350:3494]
2025-09-30T14:56:04.501538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896151986282350:3494]
2025-09-30T14:56:04.501544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896151986282350:3494]
2025-09-30T14:56:04.501589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:04.501598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.501601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:04.501613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:04.501620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:04.501625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:04.501758Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:04.499484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2091 sessionId: src_id|d0735ea3-b426bba8-aef3863-cdd58b03_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:04.502544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:04.523229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896152076053605:5488]
2025-09-30T14:56:04.523602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2090, pipe: [1:7555896152076053605:5488]
2025-09-30T14:56:04.621623Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:04.622250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:04.622269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:04.622291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896152076053605:5488], now have 1 active actors on pipe
2025-09-30T14:56:04.622613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:04.622631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:04.622666Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:04.622690Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:04.622736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2091 reason: error at write: Disconnected sessionId: src_id|d0735ea3-b426bba8-aef3863-cdd58b03_0
2025-09-30T14:56:04.622740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896152076053605:5488]
2025-09-30T14:56:04.623118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0735ea3-b426bba8-aef3863-cdd58b03_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:04.623128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0735ea3-b426bba8-aef3863-cdd58b03_0] Write session will restart in 0.005451s
2025-09-30T14:56:04.623154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0735ea3-b426bba8-aef3863-cdd58b03_0] Write session: Do CDS request
2025-09-30T14:56:04.623160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0735ea3-b426bba8-aef3863-cdd58b03_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:04.622953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2091 sessionId: src_id|d0735ea3-b426bba8-aef3863-cdd58b03_0 is DEAD
2025-09-30T14:56:04.629898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0735ea3-b426bba8-aef3863-cdd58b03_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:04.629956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:04.629974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2092
2025-09-30T14:56:04.630150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2092 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:04.630187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2092 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:04.630198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2092 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:04.630202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:04.630709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2092 sessionId:  describe result for acl check
2025-09-30T14:56:04.630746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:04.630754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:04.630756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:04.630762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896152076053623:8485] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:04.631415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896152076053623:8485] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:04.634607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896152076053623:8485] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:04.638040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896152076053623:8485] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:04.638060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896152076053623:8485] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:04.638067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896152076053623:8485] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:04.638076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2092 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:04.645446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:04.648796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:04.649066Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:04.649077Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:04.649089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:04.649149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:04.649198Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896151986282535:3484]
2025-09-30T14:56:04.649900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:04.650307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:04.650371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:04.650739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:04.650817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:04.650819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:04.650821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:04.650822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:04.650823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:04.650825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:04.650827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:04.650828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:04.650830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:04.650831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:04.650832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.650834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.650835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.650836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:04.650838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:04.650844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:04.650855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:04.650860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:04.650865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:04.650870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:04.650875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:04.650879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:04.650884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:04.650888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:04.650892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:04.650897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.650902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.650905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.650909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:04.650913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:04.650923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:04.650933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:04.650940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:04.650947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:04.650952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:04.650959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:04.650965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:04.650971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:04.650976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:04.650981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:04.650987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:04.650992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:04.650997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:04.651003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:04.651011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:04.651022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:04.651027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:04.651034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:04.651039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:04.651045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:04.651052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.651057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.651063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.651068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.651092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.651098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.651103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:04.651108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:04.651113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:04.651119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:04.651167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:04.657505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:04.658662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:04.658678Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:04.658680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:04.658684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:04.658690Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2091 [2:7555896151986282535:3484]
2025-09-30T14:56:04.658704Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:04.658721Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:04.658723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:04.658726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:04.658728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:04.658777Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:04.658786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:04.658792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:04.658848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.658855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.658857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.658859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:04.658861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:04.658927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:04.658934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.658943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.658950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.658959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:04.658974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896151986282530:3484]
2025-09-30T14:56:04.658980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896151986282530:3484]
2025-09-30T14:56:04.658982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896151986282530:3484]
2025-09-30T14:56:04.658990Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:04.659004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:04.659008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:04.659011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:04.659015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:04.659025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:04.659028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:04.659038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896152076053608:2454], now have 1 active actors on pipe
2025-09-30T14:56:04.659075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896152076053780:8485], now have 1 active actors on pipe
2025-09-30T14:56:04.659081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896151986282530:3484]
2025-09-30T14:56:04.659088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:04.659106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:04.659119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2091
2025-09-30T14:56:04.659157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2091
2025-09-30T14:56:04.659687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:04.659699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:04.659725Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4de71ca2-24c77d57-3ca7ae9-904341dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:04.659731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:04.659738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:04.659739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:04.659749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:04.659759Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:04.659775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:04.659953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:04.659960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:04.659973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:04.660085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2092 partition: 0 MaxSeqNo: 42 sessionId: src_id|4de71ca2-24c77d57-3ca7ae9-904341dd_0
2025-09-30T14:56:04.660488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0735ea3-b426bba8-aef3863-cdd58b03_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4de71ca2-24c77d57-3ca7ae9-904341dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:04.663523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4de71ca2-24c77d57-3ca7ae9-904341dd_0] Write session: try to update token
2025-09-30T14:56:04.663542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4de71ca2-24c77d57-3ca7ae9-904341dd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:04.673101Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:04.673122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:04.673124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:04.673126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:04.673134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896151986282530:3484]
2025-09-30T14:56:04.673137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896151986282530:3484]
2025-09-30T14:56:04.673141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896151986282530:3484]
2025-09-30T14:56:04.673182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:04.673191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.673194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:04.673197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:04.673205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:04.673209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:04.673347Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:04.695766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2092 sessionId: src_id|4de71ca2-24c77d57-3ca7ae9-904341dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:04.698624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:04.722902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896152076053797:5488]
2025-09-30T14:56:04.723206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2091, pipe: [1:7555896152076053797:5488]
2025-09-30T14:56:04.789226Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:04.789747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:04.789762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:04.789783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896152076053797:5488], now have 1 active actors on pipe
2025-09-30T14:56:04.789982Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:04.790062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:04.790087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:04.790134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896152076053797:5488]
2025-09-30T14:56:04.790165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2092 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4de71ca2-24c77d57-3ca7ae9-904341dd_0
2025-09-30T14:56:04.790345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2092 sessionId: src_id|4de71ca2-24c77d57-3ca7ae9-904341dd_0 is DEAD
2025-09-30T14:56:04.790540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4de71ca2-24c77d57-3ca7ae9-904341dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:04.790549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4de71ca2-24c77d57-3ca7ae9-904341dd_0] Write session will restart in 0.005929s
2025-09-30T14:56:04.790573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4de71ca2-24c77d57-3ca7ae9-904341dd_0] Write session: Do CDS request
2025-09-30T14:56:04.790580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4de71ca2-24c77d57-3ca7ae9-904341dd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:04.797789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4de71ca2-24c77d57-3ca7ae9-904341dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:04.797927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:04.797945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2093
2025-09-30T14:56:04.798108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2093 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:04.798152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2093 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:04.798162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2093 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:04.798166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:04.798613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2093 sessionId:  describe result for acl check
2025-09-30T14:56:04.798648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:04.798659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:04.798661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:04.798666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896152076053813:8478] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:04.799228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896152076053813:8478] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:04.803798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896152076053813:8478] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:04.807845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896152076053813:8478] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:04.807864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896152076053813:8478] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:04.807868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896152076053813:8478] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:04.807885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2093 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:04.811392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:04.813820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:04.814080Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:04.814090Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:04.814101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:04.814169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:04.814223Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896151986282726:3474]
2025-09-30T14:56:04.814904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:04.815265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:04.815309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:04.815644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:04.815721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:04.815729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:04.815730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:04.815732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:04.815733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:04.815734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:04.815735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:04.815736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:04.815738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:04.815739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:04.815740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.815742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.815743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.815744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:04.815745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:04.815751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:04.815763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:04.815767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:04.815771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:04.815774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:04.815779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:04.815782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:04.815785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:04.815788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:04.815792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:04.815796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.815799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.815803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.815806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:04.815810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:04.815819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:04.815827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:04.815834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:04.815840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:04.815845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:04.815851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:04.815855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:04.815862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:04.815867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:04.815873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:04.815877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:04.815883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:04.815889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:04.815895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:04.815900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:04.815904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:04.815909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:04.815916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:04.815931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:04.815937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:04.815942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.815948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.815953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.815959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.815965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.815970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.815975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:04.815980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:04.815988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:04.815993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:04.816038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:04.821876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:04.823071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:04.823086Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:04.823089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:04.823093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:04.823101Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2092 [2:7555896151986282726:3474]
2025-09-30T14:56:04.823117Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:04.823135Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:04.823139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:04.823142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:04.823145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:04.823161Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:04.823169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:04.823181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:04.823267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.823276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.823279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.823282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:04.823285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:04.823361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:04.823371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.823384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.823401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.823426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:04.823448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896152076053798:2454], now have 1 active actors on pipe
2025-09-30T14:56:04.823459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896152076053965:8478], now have 1 active actors on pipe
2025-09-30T14:56:04.823465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896151986282720:3474]
2025-09-30T14:56:04.823468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896151986282720:3474]
2025-09-30T14:56:04.823470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896151986282720:3474]
2025-09-30T14:56:04.823485Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:04.823497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:04.823499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:04.823502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:04.823504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:04.823516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:04.823527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:04.823534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2092
2025-09-30T14:56:04.823535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2092
2025-09-30T14:56:04.823561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896151986282720:3474]
2025-09-30T14:56:04.823569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:04.823608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:04.823620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:04.823624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:04.823648Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b2f0f4a-f9c91369-9ab8e21-c0944eb2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:04.823655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:04.823665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:04.823667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:04.823679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:04.823691Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:04.823707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:04.823857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:04.823865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:04.823878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:04.823975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2093 partition: 0 MaxSeqNo: 42 sessionId: src_id|1b2f0f4a-f9c91369-9ab8e21-c0944eb2_0
2025-09-30T14:56:04.824366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4de71ca2-24c77d57-3ca7ae9-904341dd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1b2f0f4a-f9c91369-9ab8e21-c0944eb2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:04.827039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b2f0f4a-f9c91369-9ab8e21-c0944eb2_0] Write session: try to update token
2025-09-30T14:56:04.827055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b2f0f4a-f9c91369-9ab8e21-c0944eb2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:04.836689Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:04.836725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:04.836728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:04.836731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:04.836743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896151986282720:3474]
2025-09-30T14:56:04.836748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896151986282720:3474]
2025-09-30T14:56:04.836752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896151986282720:3474]
2025-09-30T14:56:04.836788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:04.836795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:04.836798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:04.836805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:04.836824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.836829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:04.837069Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:04.842564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2093 sessionId: src_id|1b2f0f4a-f9c91369-9ab8e21-c0944eb2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:04.845442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:04.890302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896152076054009:5488]
2025-09-30T14:56:04.890628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2092, pipe: [1:7555896152076054009:5488]
2025-09-30T14:56:04.949781Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:04.950199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:04.950218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:04.950263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896152076054009:5488], now have 1 active actors on pipe
2025-09-30T14:56:04.950794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:04.950853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896152076054009:5488]
2025-09-30T14:56:04.950873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:04.950876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:04.950771Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:04.951426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b2f0f4a-f9c91369-9ab8e21-c0944eb2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:04.951440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b2f0f4a-f9c91369-9ab8e21-c0944eb2_0] Write session will restart in 0.008849s
2025-09-30T14:56:04.951462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b2f0f4a-f9c91369-9ab8e21-c0944eb2_0] Write session: Do CDS request
2025-09-30T14:56:04.951467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b2f0f4a-f9c91369-9ab8e21-c0944eb2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:04.950938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2093 reason: error at write: Disconnected sessionId: src_id|1b2f0f4a-f9c91369-9ab8e21-c0944eb2_0
2025-09-30T14:56:04.951166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2093 sessionId: src_id|1b2f0f4a-f9c91369-9ab8e21-c0944eb2_0 is DEAD
2025-09-30T14:56:04.961844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b2f0f4a-f9c91369-9ab8e21-c0944eb2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:04.961935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:04.961958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2094
2025-09-30T14:56:04.962102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2094 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:04.962137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2094 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:04.962143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2094 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:04.962148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:04.962599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2094 sessionId:  describe result for acl check
2025-09-30T14:56:04.962641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:04.962649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:04.962651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:04.962661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896152076054107:8464] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:04.963235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896152076054107:8464] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:04.965898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896152076054107:8464] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:04.966322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:04.968930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:04.969169Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:04.969179Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:04.969191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:04.969254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:04.969258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896152076054107:8464] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:04.969276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896152076054107:8464] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:04.969280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896152076054107:8464] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:04.969291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2094 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:04.969306Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896151986282943:3454]
2025-09-30T14:56:04.970017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:04.970371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:04.970445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:04.970878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:04.970950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:04.970966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:04.970972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:04.970973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:04.970975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:04.970976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:04.970978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:04.970979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:04.970981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:04.970982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:04.970983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.970984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.970985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.970987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:04.970988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:04.970995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:04.971006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:04.971011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:04.971017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:04.971021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:04.971026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:04.971029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:04.971033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:04.971037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:04.971041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:04.971045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.971049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.971053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.971058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:04.971062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:04.971071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:04.971080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:04.971086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:04.971091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:04.971100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:04.971105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:04.971111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:04.971117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:04.971122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:04.971128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:04.971133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:04.971139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:04.971145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:04.971152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:04.971157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:04.971163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:04.971176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:04.971182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:04.971188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:04.971195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:04.971200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.971207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.971212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.971218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.971234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.971240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.971258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:04.971264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:04.971270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:04.971275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:04.971321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:04.977355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:04.978768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:04.978790Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:04.978793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:04.978797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:04.978804Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2093 [2:7555896151986282943:3454]
2025-09-30T14:56:04.978825Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:04.978842Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:04.978846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:04.978849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:04.978854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:04.978872Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:04.978879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:04.978887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:04.978944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.978945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.978947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.978949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:04.978951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:04.979026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:04.979034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.979048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:04.979064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:04.979087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:04.979111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896152076054198:8464], now have 1 active actors on pipe
2025-09-30T14:56:04.979115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896152076054024:2454], now have 1 active actors on pipe
2025-09-30T14:56:04.979121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896151986282938:3454]
2025-09-30T14:56:04.979124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896151986282938:3454]
2025-09-30T14:56:04.979127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896151986282938:3454]
2025-09-30T14:56:04.979141Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:04.979154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:04.979158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:04.979162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:04.979168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:04.979172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:04.979177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:04.979211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896151986282938:3454]
2025-09-30T14:56:04.979227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:04.979219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2093
2025-09-30T14:56:04.979240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2093
2025-09-30T14:56:04.979263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:04.979399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:04.979412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:04.979440Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|309d5de8-a4038e26-b56d5845-9ab87b12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:04.979447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:04.979450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:04.979452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:04.979462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:04.979472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:04.979492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:04.979690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:04.979705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:04.979729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:04.979853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2094 partition: 0 MaxSeqNo: 42 sessionId: src_id|309d5de8-a4038e26-b56d5845-9ab87b12_0
2025-09-30T14:56:04.980286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b2f0f4a-f9c91369-9ab8e21-c0944eb2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|309d5de8-a4038e26-b56d5845-9ab87b12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:04.983367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|309d5de8-a4038e26-b56d5845-9ab87b12_0] Write session: try to update token
2025-09-30T14:56:04.983388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|309d5de8-a4038e26-b56d5845-9ab87b12_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:04.992863Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:04.992891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:04.992895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:04.992897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:04.992907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896151986282938:3454]
2025-09-30T14:56:04.992913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896151986282938:3454]
2025-09-30T14:56:04.992917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896151986282938:3454]
2025-09-30T14:56:04.992964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:04.992971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:04.992969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:04.992974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:04.992975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:04.992980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:04.993121Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:04.999648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2094 sessionId: src_id|309d5de8-a4038e26-b56d5845-9ab87b12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:05.002581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:05.050565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896156371021507:5488]
2025-09-30T14:56:05.050871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2093, pipe: [1:7555896156371021507:5488]
2025-09-30T14:56:05.107355Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:05.107706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:05.107721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:05.107764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896156371021507:5488], now have 1 active actors on pipe
2025-09-30T14:56:05.108084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:05.108149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896156371021507:5488]
2025-09-30T14:56:05.108170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:05.108179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:05.108228Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:05.108611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|309d5de8-a4038e26-b56d5845-9ab87b12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:05.108634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|309d5de8-a4038e26-b56d5845-9ab87b12_0] Write session will restart in 0.006133s
2025-09-30T14:56:05.108658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|309d5de8-a4038e26-b56d5845-9ab87b12_0] Write session: Do CDS request
2025-09-30T14:56:05.108663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|309d5de8-a4038e26-b56d5845-9ab87b12_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:05.108257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2094 reason: error at write: Disconnected sessionId: src_id|309d5de8-a4038e26-b56d5845-9ab87b12_0
2025-09-30T14:56:05.108476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2094 sessionId: src_id|309d5de8-a4038e26-b56d5845-9ab87b12_0 is DEAD
2025-09-30T14:56:05.115872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|309d5de8-a4038e26-b56d5845-9ab87b12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:05.116044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:05.116062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2095
2025-09-30T14:56:05.116193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2095 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:05.116225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2095 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:05.116230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2095 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:05.116236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:05.116710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2095 sessionId:  describe result for acl check
2025-09-30T14:56:05.116751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:05.116759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:05.116761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:05.116768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896156371021523:8459] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:05.117395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896156371021523:8459] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:05.121019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896156371021523:8459] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:05.124401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896156371021523:8459] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:05.124430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896156371021523:8459] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:05.124434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896156371021523:8459] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:05.124444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2095 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:05.125500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:05.128339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:05.128679Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:05.128690Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:05.128702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:05.128759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:05.128803Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896156281250421:3453]
2025-09-30T14:56:05.129334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:05.129680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:05.129726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:05.130019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:05.130081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:05.130087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:05.130088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:05.130090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:05.130091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:05.130093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:05.130094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:05.130095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:05.130096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:05.130097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:05.130099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.130100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.130101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.130102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:05.130104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:05.130109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:05.130122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:05.130125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:05.130129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:05.130133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:05.130138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:05.130142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:05.130146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:05.130151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:05.130155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:05.130160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.130165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.130169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.130174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:05.130178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:05.130189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:05.130203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:05.130213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:05.130223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:05.130232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:05.130242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:05.130247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:05.130257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:05.130267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:05.130277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:05.130284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:05.130291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:05.130300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:05.130306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:05.130311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:05.130318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:05.130326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:05.130333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:05.130343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:05.130350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:05.130356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.130361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.130365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.130371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.130377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.130386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.130392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:05.130401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:05.130406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:05.130412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:05.130462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:05.136288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:05.137549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:05.137569Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:05.137573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:05.137578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:05.137585Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2094 [2:7555896156281250421:3453]
2025-09-30T14:56:05.137604Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:05.137621Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:05.137624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:05.137627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:05.137630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:05.137647Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:05.137662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:05.137670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:05.137738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.137748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.137750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.137754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:05.137757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:05.137847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:05.137857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.137872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.137885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.137910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:05.137935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896156371021508:2454], now have 1 active actors on pipe
2025-09-30T14:56:05.137944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896156371021684:8459], now have 1 active actors on pipe
2025-09-30T14:56:05.137951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896156281250416:3453]
2025-09-30T14:56:05.137954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896156281250416:3453]
2025-09-30T14:56:05.137956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896156281250416:3453]
2025-09-30T14:56:05.137972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:05.137989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:05.137992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:05.138000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:05.138003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:05.138011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:05.138014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:05.138041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2094
2025-09-30T14:56:05.138054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896156281250416:3453]
2025-09-30T14:56:05.138066Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:05.138083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:05.138106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:05.138111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:05.138148Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c04b7969-6ed517a-63a706a6-38997ebd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:05.138147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2094
2025-09-30T14:56:05.138160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:05.138164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:05.138167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:05.138177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:05.138187Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:05.138210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:05.138414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:05.138423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:05.138438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:05.138525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2095 partition: 0 MaxSeqNo: 42 sessionId: src_id|c04b7969-6ed517a-63a706a6-38997ebd_0
2025-09-30T14:56:05.138886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|309d5de8-a4038e26-b56d5845-9ab87b12_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c04b7969-6ed517a-63a706a6-38997ebd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:05.141846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c04b7969-6ed517a-63a706a6-38997ebd_0] Write session: try to update token
2025-09-30T14:56:05.141869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c04b7969-6ed517a-63a706a6-38997ebd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:05.151097Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:05.151121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:05.151123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:05.151125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:05.151134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896156281250416:3453]
2025-09-30T14:56:05.151139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896156281250416:3453]
2025-09-30T14:56:05.151143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896156281250416:3453]
2025-09-30T14:56:05.151191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:05.151204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.151206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:05.151205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:05.151213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:05.151218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:05.151380Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:05.158485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2095 sessionId: src_id|c04b7969-6ed517a-63a706a6-38997ebd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:05.161548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:05.208237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896156371021704:5488]
2025-09-30T14:56:05.208472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2094, pipe: [1:7555896156371021704:5488]
2025-09-30T14:56:05.264423Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:05.264835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:05.264853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:05.264897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896156371021704:5488], now have 1 active actors on pipe
2025-09-30T14:56:05.265139Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:05.265166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896156371021704:5488]
2025-09-30T14:56:05.265165Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:05.265192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:05.265195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:05.265264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2095 reason: error at write: Disconnected sessionId: src_id|c04b7969-6ed517a-63a706a6-38997ebd_0
2025-09-30T14:56:05.265457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2095 sessionId: src_id|c04b7969-6ed517a-63a706a6-38997ebd_0 is DEAD
2025-09-30T14:56:05.265610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c04b7969-6ed517a-63a706a6-38997ebd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:05.265620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c04b7969-6ed517a-63a706a6-38997ebd_0] Write session will restart in 0.006263s
2025-09-30T14:56:05.265643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c04b7969-6ed517a-63a706a6-38997ebd_0] Write session: Do CDS request
2025-09-30T14:56:05.265652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c04b7969-6ed517a-63a706a6-38997ebd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:05.272754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c04b7969-6ed517a-63a706a6-38997ebd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:05.272857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:05.272877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2096
2025-09-30T14:56:05.273020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2096 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:05.273060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2096 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:05.273071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2096 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:05.273075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:05.273538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2096 sessionId:  describe result for acl check
2025-09-30T14:56:05.273571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:05.273574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:05.273575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:05.273582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896156371021726:8456] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:05.274142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896156371021726:8456] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:05.276854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896156371021726:8456] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:05.279742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896156371021726:8456] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:05.279760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896156371021726:8456] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:05.279763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896156371021726:8456] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:05.279772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2096 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:05.280172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:05.282641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:05.282974Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:05.282985Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:05.282998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:05.283066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:05.283108Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896156281250603:3451]
2025-09-30T14:56:05.283792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:05.284176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:05.284256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:05.284610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:05.284688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:05.284695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:05.284696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:05.284697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:05.284698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:05.284700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:05.284702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:05.284703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:05.284705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:05.284706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:05.284707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.284709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.284710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.284712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:05.284712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:05.284717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:05.284724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:05.284726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:05.284729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:05.284731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:05.284734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:05.284736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:05.284738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:05.284740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:05.284743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:05.284745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.284747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.284750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.284752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:05.284755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:05.284761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:05.284766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:05.284771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:05.284775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:05.284779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:05.284782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:05.284784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:05.284787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:05.284790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:05.284793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:05.284796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:05.284800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:05.284803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:05.284807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:05.284810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:05.284813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:05.284815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:05.284820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:05.284823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:05.284826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:05.284829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.284832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.284834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.284837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.284839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.284842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.284845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:05.284848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:05.284851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:05.284854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:05.284895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:05.290645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:05.291991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:05.292009Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:05.292012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:05.292016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:05.292023Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2095 [2:7555896156281250603:3451]
2025-09-30T14:56:05.292040Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:05.292059Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:05.292068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:05.292071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:05.292073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:05.292091Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:05.292104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:05.292110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:05.292175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.292185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.292187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.292190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:05.292193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:05.292268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:05.292277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.292291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.292306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.292322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:05.292346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896156371021886:8456], now have 1 active actors on pipe
2025-09-30T14:56:05.292355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896156371021708:2454], now have 1 active actors on pipe
2025-09-30T14:56:05.292361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896156281250598:3451]
2025-09-30T14:56:05.292364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896156281250598:3451]
2025-09-30T14:56:05.292366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896156281250598:3451]
2025-09-30T14:56:05.292377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:05.292388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:05.292390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:05.292390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:05.292404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:05.292405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:05.292407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:05.292404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2095
2025-09-30T14:56:05.292408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2095
2025-09-30T14:56:05.292446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896156281250598:3451]
2025-09-30T14:56:05.292454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:05.292456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:05.292483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:05.292493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:05.292530Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|21d1b3f6-544a1f65-646d5933-689dd3cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:05.292542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:05.292547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:05.292549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:05.292559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:05.292568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:05.292586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:05.292754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:05.292764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:05.292778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:05.292869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2096 partition: 0 MaxSeqNo: 42 sessionId: src_id|21d1b3f6-544a1f65-646d5933-689dd3cf_0
2025-09-30T14:56:05.293284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c04b7969-6ed517a-63a706a6-38997ebd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|21d1b3f6-544a1f65-646d5933-689dd3cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:05.296199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21d1b3f6-544a1f65-646d5933-689dd3cf_0] Write session: try to update token
2025-09-30T14:56:05.296218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21d1b3f6-544a1f65-646d5933-689dd3cf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:05.305529Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:05.305557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:05.305562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:05.305566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:05.305576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896156281250598:3451]
2025-09-30T14:56:05.305584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896156281250598:3451]
2025-09-30T14:56:05.305592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896156281250598:3451]
2025-09-30T14:56:05.305643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:05.305652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:05.305660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:05.305663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.305665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:05.305666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:05.305893Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:05.311642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2096 sessionId: src_id|21d1b3f6-544a1f65-646d5933-689dd3cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:05.314614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:05.366491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896156371021898:5488]
2025-09-30T14:56:05.366856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2095, pipe: [1:7555896156371021898:5488]
2025-09-30T14:56:05.419825Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:05.420331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:05.420352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:05.420398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896156371021898:5488], now have 1 active actors on pipe
2025-09-30T14:56:05.420680Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:05.420682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:05.420702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:05.420730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896156371021898:5488]
2025-09-30T14:56:05.420752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:05.420781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2096 reason: error at write: Disconnected sessionId: src_id|21d1b3f6-544a1f65-646d5933-689dd3cf_0
2025-09-30T14:56:05.420974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2096 sessionId: src_id|21d1b3f6-544a1f65-646d5933-689dd3cf_0 is DEAD
2025-09-30T14:56:05.421162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21d1b3f6-544a1f65-646d5933-689dd3cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:05.421169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21d1b3f6-544a1f65-646d5933-689dd3cf_0] Write session will restart in 0.007526s
2025-09-30T14:56:05.421195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21d1b3f6-544a1f65-646d5933-689dd3cf_0] Write session: Do CDS request
2025-09-30T14:56:05.421205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21d1b3f6-544a1f65-646d5933-689dd3cf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:05.429865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21d1b3f6-544a1f65-646d5933-689dd3cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:05.429967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:05.429984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2097
2025-09-30T14:56:05.430110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2097 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:05.430144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2097 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:05.430155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2097 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:05.430159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:05.430628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2097 sessionId:  describe result for acl check
2025-09-30T14:56:05.430672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:05.430674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:05.430676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:05.430683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896156371021917:8452] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:05.431281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896156371021917:8452] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:05.434408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896156371021917:8452] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:05.437493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896156371021917:8452] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:05.437508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896156371021917:8452] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:05.437512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896156371021917:8452] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:05.437520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2097 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:05.438103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:05.440707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:05.441020Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:05.441031Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:05.441043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:05.441114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:05.441162Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896156281250786:3445]
2025-09-30T14:56:05.441833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:05.442165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:05.442219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:05.442562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:05.442650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:05.442657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:05.442658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:05.442659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:05.442661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:05.442662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:05.442663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:05.442664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:05.442666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:05.442667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:05.442668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.442670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.442671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.442673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:05.442674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:05.442681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:05.442690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:05.442695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:05.442700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:05.442704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:05.442709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:05.442713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:05.442716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:05.442719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:05.442725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:05.442729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.442733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.442737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.442742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:05.442746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:05.442756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:05.442765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:05.442771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:05.442777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:05.442781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:05.442786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:05.442791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:05.442796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:05.442802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:05.442808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:05.442812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:05.442818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:05.442832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:05.442837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:05.442842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:05.442848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:05.442854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:05.442859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:05.442863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:05.442869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:05.442874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.442879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.442884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.442890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.442895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.442907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.442912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:05.442918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:05.442923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:05.442929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:05.442978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:05.448830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:05.450693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2096
2025-09-30T14:56:05.450759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2096
2025-09-30T14:56:05.450004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:05.450026Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:05.450029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:05.450033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:05.450041Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2096 [2:7555896156281250786:3445]
2025-09-30T14:56:05.450059Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:05.450077Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:05.450081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:05.450085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:05.450087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:05.450104Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:05.450114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:05.450121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:05.450186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.450188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.450190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.450194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:05.450196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:05.450274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:05.450276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.450292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.450306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.450325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:05.450345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896156371021900:2454], now have 1 active actors on pipe
2025-09-30T14:56:05.450354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896156281250781:3445]
2025-09-30T14:56:05.450357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896156281250781:3445]
2025-09-30T14:56:05.450359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896156281250781:3445]
2025-09-30T14:56:05.450376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:05.450386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896156371022079:8452], now have 1 active actors on pipe
2025-09-30T14:56:05.450395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:05.450410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:05.450413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:05.450453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896156281250781:3445]
2025-09-30T14:56:05.450455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:05.450496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:05.450503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:05.450505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:05.450522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:05.451008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:05.451018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:05.451071Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb50d502-a7d9bebd-d6e07f0f-6020c41a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:05.451079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:05.451084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:05.451087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:05.451099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:05.451113Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:05.451131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:05.451460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:05.451467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:05.451500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:05.451622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2097 partition: 0 MaxSeqNo: 42 sessionId: src_id|eb50d502-a7d9bebd-d6e07f0f-6020c41a_0
2025-09-30T14:56:05.452167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21d1b3f6-544a1f65-646d5933-689dd3cf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|eb50d502-a7d9bebd-d6e07f0f-6020c41a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:05.455272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb50d502-a7d9bebd-d6e07f0f-6020c41a_0] Write session: try to update token
2025-09-30T14:56:05.455289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb50d502-a7d9bebd-d6e07f0f-6020c41a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:05.464118Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:05.464142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:05.464154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896156281250781:3445]
2025-09-30T14:56:05.464202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:05.464203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:05.464400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:05.464556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:05.464719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:05.464887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:05.465363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:05.465412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:05.473759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2097 sessionId: src_id|eb50d502-a7d9bebd-d6e07f0f-6020c41a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:05.476578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:05.477523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:05.477548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:05.477570Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:05.477573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:05.477575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:05.477578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:05.477588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896156281250781:3445]
2025-09-30T14:56:05.477592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896156281250781:3445]
2025-09-30T14:56:05.477597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896156281250781:3445]
2025-09-30T14:56:05.477645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:05.477650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:05.477657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.477660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:05.477663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:05.477667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:05.477789Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:05.521106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896156371022091:5488]
2025-09-30T14:56:05.521435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2096, pipe: [1:7555896156371022091:5488]
2025-09-30T14:56:05.596929Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:05.597259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:05.597299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896156371022091:5488], now have 1 active actors on pipe
2025-09-30T14:56:05.597439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:05.597502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:05.597557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896156371022091:5488]
2025-09-30T14:56:05.597577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:05.597586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:05.597656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2097 reason: error at write: Disconnected sessionId: src_id|eb50d502-a7d9bebd-d6e07f0f-6020c41a_0
2025-09-30T14:56:05.597811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2097 sessionId: src_id|eb50d502-a7d9bebd-d6e07f0f-6020c41a_0 is DEAD
2025-09-30T14:56:05.598001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb50d502-a7d9bebd-d6e07f0f-6020c41a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:05.598021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb50d502-a7d9bebd-d6e07f0f-6020c41a_0] Write session will restart in 0.005071s
2025-09-30T14:56:05.598044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb50d502-a7d9bebd-d6e07f0f-6020c41a_0] Write session: Do CDS request
2025-09-30T14:56:05.598050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb50d502-a7d9bebd-d6e07f0f-6020c41a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:05.604888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb50d502-a7d9bebd-d6e07f0f-6020c41a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:05.604903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:05.604924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2098
2025-09-30T14:56:05.605133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2098 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:05.605167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2098 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:05.605178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2098 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:05.605181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:05.605694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2098 sessionId:  describe result for acl check
2025-09-30T14:56:05.605774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:05.605781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:05.605783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:05.605789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896156371022109:8446] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:05.606370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896156371022109:8446] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:05.609085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896156371022109:8446] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:05.612483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896156371022109:8446] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:05.612501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896156371022109:8446] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:05.612505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896156371022109:8446] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:05.612513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2098 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:05.614370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:05.617338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:05.617635Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:05.617649Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:05.617670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:05.617737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:05.617785Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896156281250972:3446]
2025-09-30T14:56:05.618506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:05.618878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:05.618930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:05.619309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:05.619388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:05.619393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:05.619395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:05.619397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:05.619398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:05.619400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:05.619402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:05.619403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:05.619405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:05.619406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:05.619408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.619409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.619410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.619412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:05.619413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:05.619420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:05.619431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:05.619436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:05.619440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:05.619444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:05.619449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:05.619453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:05.619457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:05.619461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:05.619465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:05.619470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.619474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.619479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.619483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:05.619487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:05.619497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:05.619506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:05.619512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:05.619518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:05.619523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:05.619529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:05.619534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:05.619540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:05.619548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:05.619553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:05.619558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:05.619564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:05.619592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:05.619607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:05.619613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:05.619618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:05.619623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:05.619628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:05.619635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:05.619639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:05.619644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.619648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.619652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.619657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.619670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.619675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.619679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:05.619685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:05.619690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:05.619696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:05.619747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:05.625888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:05.626854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:05.626875Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:05.626879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:05.626883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:05.626891Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2097 [2:7555896156281250972:3446]
2025-09-30T14:56:05.626910Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:05.626928Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:05.626931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:05.626935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:05.626939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:05.626957Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:05.626970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:05.626977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:05.627045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.627052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.627054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.627059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:05.627062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:05.627133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:05.627141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.627155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.627168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.627186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:05.627204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896156281250967:3446]
2025-09-30T14:56:05.627206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896156281250967:3446]
2025-09-30T14:56:05.627209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896156281250967:3446]
2025-09-30T14:56:05.627218Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:05.627229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:05.627232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896156371022093:2454], now have 1 active actors on pipe
2025-09-30T14:56:05.627233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:05.627235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:05.627238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896156371022272:8446], now have 1 active actors on pipe
2025-09-30T14:56:05.627265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:05.627278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:05.627281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:05.627319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896156281250967:3446]
2025-09-30T14:56:05.627328Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:05.627363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:05.627341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2097
2025-09-30T14:56:05.627352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2097
2025-09-30T14:56:05.627440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:05.627452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:05.627479Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aafd4e55-db7d2dda-2eaba161-8f4ba614_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:05.627492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:05.627502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:05.627505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:05.627515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:05.627530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:05.627548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:05.627850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:05.627859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:05.627875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:05.627992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2098 partition: 0 MaxSeqNo: 42 sessionId: src_id|aafd4e55-db7d2dda-2eaba161-8f4ba614_0
2025-09-30T14:56:05.628395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb50d502-a7d9bebd-d6e07f0f-6020c41a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|aafd4e55-db7d2dda-2eaba161-8f4ba614_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:05.631629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aafd4e55-db7d2dda-2eaba161-8f4ba614_0] Write session: try to update token
2025-09-30T14:56:05.631652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aafd4e55-db7d2dda-2eaba161-8f4ba614_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:05.647649Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:05.647671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:05.647681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896156281250967:3446]
2025-09-30T14:56:05.647735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:05.647742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:05.647901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2098 sessionId: src_id|aafd4e55-db7d2dda-2eaba161-8f4ba614_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:05.647928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:05.648134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:05.648351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:05.648556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:05.648881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:05.648944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:05.651322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:05.651493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:05.651512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:05.651545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:05.651711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:05.652852Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:05.652868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:05.652870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:05.652872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:05.652882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896156281250967:3446]
2025-09-30T14:56:05.652886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896156281250967:3446]
2025-09-30T14:56:05.652890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896156281250967:3446]
2025-09-30T14:56:05.652926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:05.652936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:05.652938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.652941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:05.652952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:05.652956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:05.653081Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:05.697753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896156371022288:5488]
2025-09-30T14:56:05.698033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2097, pipe: [1:7555896156371022288:5488]
2025-09-30T14:56:05.765622Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:05.775283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:05.775320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:05.775515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:05.775585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:05.775662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:05.775740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:05.776445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:05.776463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:05.776550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:05.776621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:05.776701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:05.776782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:05.776834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:05.776842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:05.776923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:05.776996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:05.777063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:05.777128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:05.777359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:05.777365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:05.777447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:05.777527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:05.777597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:05.777675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:05.777726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:05.777733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:05.777809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:05.777879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:05.777950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:05.778022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:05.778079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:05.778087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:05.778168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:05.778245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:05.778322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:05.778397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:05.778453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:05.778459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:05.778531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:05.778592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:05.778668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:05.778732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:05.778778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:05.778785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:05.778853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:05.778916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:05.779002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:05.779077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:05.779130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:05.779138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:05.779215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:05.779297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:05.779373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:05.779437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:05.779486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:05.779494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:05.779572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:05.779645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:05.779709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:05.779783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:05.779834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:05.779842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:05.779927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896156371022288:5488], now have 1 active actors on pipe
2025-09-30T14:56:05.780183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:05.780214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896156371022288:5488]
2025-09-30T14:56:05.780242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:05.780244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:05.780274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2098 reason: error at write: Disconnected sessionId: src_id|aafd4e55-db7d2dda-2eaba161-8f4ba614_0
2025-09-30T14:56:05.780473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2098 sessionId: src_id|aafd4e55-db7d2dda-2eaba161-8f4ba614_0 is DEAD
2025-09-30T14:56:05.780367Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:05.780897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aafd4e55-db7d2dda-2eaba161-8f4ba614_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:05.780906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aafd4e55-db7d2dda-2eaba161-8f4ba614_0] Write session will restart in 0.008024s
2025-09-30T14:56:05.780931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aafd4e55-db7d2dda-2eaba161-8f4ba614_0] Write session: Do CDS request
2025-09-30T14:56:05.780937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aafd4e55-db7d2dda-2eaba161-8f4ba614_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:05.789871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aafd4e55-db7d2dda-2eaba161-8f4ba614_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:05.789937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:05.789954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2099
2025-09-30T14:56:05.790176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2099 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:05.790226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2099 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:05.790232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2099 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:05.790237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:05.790686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2099 sessionId:  describe result for acl check
2025-09-30T14:56:05.790715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:05.790725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:05.790728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:05.790734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896156371022329:8437] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:05.791806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896156371022329:8437] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:05.794488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896156371022329:8437] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:05.797267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896156371022329:8437] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:05.797284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896156371022329:8437] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:05.797288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896156371022329:8437] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:05.797296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2099 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:05.797294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:05.800195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:05.800440Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:05.800451Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:05.800463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:05.800517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:05.800557Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896156281251169:3438]
2025-09-30T14:56:05.801257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:05.801644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:05.801690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:05.802015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:05.802080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:05.802087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:05.802089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:05.802090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:05.802091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:05.802093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:05.802094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:05.802095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:05.802096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:05.802098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:05.802099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.802100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.802102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.802103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:05.802104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:05.802110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:05.802122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:05.802126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:05.802130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:05.802135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:05.802139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:05.802143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:05.802148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:05.802152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:05.802157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:05.802161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.802166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.802171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.802175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:05.802197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:05.802206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:05.802214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:05.802226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:05.802233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:05.802243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:05.802249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:05.802254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:05.802260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:05.802270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:05.802276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:05.802286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:05.802291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:05.802297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:05.802308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:05.802313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:05.802319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:05.802324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:05.802330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:05.802340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:05.802346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:05.802357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.802363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.802372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.802378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.802387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.802393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.802402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:05.802409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:05.802418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:05.802424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:05.802478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:05.808474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:05.809764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:05.809786Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:05.809790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:05.809794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:05.809802Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2098 [2:7555896156281251169:3438]
2025-09-30T14:56:05.809820Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:05.809839Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:05.809842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:05.809846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:05.809849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:05.809867Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:05.809875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:05.809882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:05.809962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.809970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.809972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.809976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:05.809979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:05.810058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:05.810066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.810080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.810096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.810117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:05.810142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896156371022291:2454], now have 1 active actors on pipe
2025-09-30T14:56:05.810147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896156371022472:8437], now have 1 active actors on pipe
2025-09-30T14:56:05.810154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896156281251163:3438]
2025-09-30T14:56:05.810157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896156281251163:3438]
2025-09-30T14:56:05.810159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896156281251163:3438]
2025-09-30T14:56:05.810172Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:05.810194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:05.810196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:05.810201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:05.810204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:05.810210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:05.810213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:05.810251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896156281251163:3438]
2025-09-30T14:56:05.810264Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:05.810269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:05.810313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2098
2025-09-30T14:56:05.810334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2098
2025-09-30T14:56:05.810449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:05.810462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:05.810490Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|741ae1a6-e57d9909-b615cf92-6399d7af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:05.810503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:05.810506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:05.810508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:05.810520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:05.810530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:05.810550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:05.810763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:05.810771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:05.810784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:05.810920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2099 partition: 0 MaxSeqNo: 42 sessionId: src_id|741ae1a6-e57d9909-b615cf92-6399d7af_0
2025-09-30T14:56:05.811341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aafd4e55-db7d2dda-2eaba161-8f4ba614_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|741ae1a6-e57d9909-b615cf92-6399d7af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:05.814518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|741ae1a6-e57d9909-b615cf92-6399d7af_0] Write session: try to update token
2025-09-30T14:56:05.814542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|741ae1a6-e57d9909-b615cf92-6399d7af_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:05.824368Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:05.824397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:05.824400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:05.824403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:05.824415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896156281251163:3438]
2025-09-30T14:56:05.824421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896156281251163:3438]
2025-09-30T14:56:05.824427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896156281251163:3438]
2025-09-30T14:56:05.824482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:05.824483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:05.824490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.824491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:05.824493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:05.824496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:05.824659Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:05.831518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2099 sessionId: src_id|741ae1a6-e57d9909-b615cf92-6399d7af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:05.834428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:05.880499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896156371022489:5488]
2025-09-30T14:56:05.880777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2098, pipe: [1:7555896156371022489:5488]
2025-09-30T14:56:05.938974Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:05.940659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:05.940687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:05.940730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896156371022489:5488], now have 1 active actors on pipe
2025-09-30T14:56:05.940993Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:05.941109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:05.941115Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:05.941125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:05.941163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896156371022489:5488]
2025-09-30T14:56:05.941204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2099 reason: error at write: Disconnected sessionId: src_id|741ae1a6-e57d9909-b615cf92-6399d7af_0
2025-09-30T14:56:05.941602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|741ae1a6-e57d9909-b615cf92-6399d7af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:05.941615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|741ae1a6-e57d9909-b615cf92-6399d7af_0] Write session will restart in 0.005414s
2025-09-30T14:56:05.941641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|741ae1a6-e57d9909-b615cf92-6399d7af_0] Write session: Do CDS request
2025-09-30T14:56:05.941648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|741ae1a6-e57d9909-b615cf92-6399d7af_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:05.941438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2099 sessionId: src_id|741ae1a6-e57d9909-b615cf92-6399d7af_0 is DEAD
2025-09-30T14:56:05.947822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|741ae1a6-e57d9909-b615cf92-6399d7af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:05.947944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:05.947964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2100
2025-09-30T14:56:05.948091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2100 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:05.948133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2100 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:05.948143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2100 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:05.948147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:05.948639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2100 sessionId:  describe result for acl check
2025-09-30T14:56:05.948678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:05.948685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:05.948688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:05.948694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896156371022536:8417] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:05.949236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896156371022536:8417] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:05.952898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896156371022536:8417] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:05.956603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896156371022536:8417] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:05.956624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896156371022536:8417] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:05.956628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896156371022536:8417] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:05.956636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2100 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:05.959419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:05.962248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:05.962606Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:05.962622Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:05.962638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:05.962716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:05.962761Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896156281251393:3420]
2025-09-30T14:56:05.963482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:05.963879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:05.963937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:05.964325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:05.964405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:05.964414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:05.964416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:05.964417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:05.964419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:05.964420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:05.964422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:05.964423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:05.964424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:05.964426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:05.964427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.964429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.964430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.964431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:05.964433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:05.964439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:05.964451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:05.964456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:05.964460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:05.964464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:05.964469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:05.964473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:05.964478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:05.964482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:05.964486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:05.964491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.964495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.964499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.964503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:05.964508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:05.964516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:05.964524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:05.964530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:05.964534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:05.964538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:05.964541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:05.964543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:05.964547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:05.964549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:05.964553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:05.964555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:05.964559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:05.964562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:05.964565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:05.964568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:05.964573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:05.964576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:05.964578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:05.964581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:05.964584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:05.964587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.964590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.964593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.964595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.964599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.964602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.964606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:05.964608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:05.964612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:05.964614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:05.964641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:05.970773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:05.972130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:05.972153Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:05.972155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:05.972160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:05.972169Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2099 [2:7555896156281251393:3420]
2025-09-30T14:56:05.972189Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:05.972209Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:05.972215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:05.972219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:05.972221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:05.972241Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:05.972254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:05.972265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:05.972341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.972352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.972354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.972358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:05.972361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:05.972438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:05.972447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.972463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:05.972474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:05.972490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:05.972515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896156371022673:8417], now have 1 active actors on pipe
2025-09-30T14:56:05.972524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896156371022523:2454], now have 1 active actors on pipe
2025-09-30T14:56:05.972532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896156281251388:3420]
2025-09-30T14:56:05.972539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896156281251388:3420]
2025-09-30T14:56:05.972541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896156281251388:3420]
2025-09-30T14:56:05.972556Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:05.972573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:05.972578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:05.972584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:05.972586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:05.972591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:05.972595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:05.972639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896156281251388:3420]
2025-09-30T14:56:05.972655Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:05.972652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2099
2025-09-30T14:56:05.972664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2099
2025-09-30T14:56:05.972695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:05.972759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:05.972770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:05.972796Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e98d09b-c11b48df-d056176-9f153f6a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:05.972812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:05.972821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:05.972823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:05.972835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:05.972848Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:05.972874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:05.973053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:05.973063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:05.973077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:05.973174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2100 partition: 0 MaxSeqNo: 42 sessionId: src_id|1e98d09b-c11b48df-d056176-9f153f6a_0
2025-09-30T14:56:05.973601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|741ae1a6-e57d9909-b615cf92-6399d7af_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1e98d09b-c11b48df-d056176-9f153f6a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:05.977051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e98d09b-c11b48df-d056176-9f153f6a_0] Write session: try to update token
2025-09-30T14:56:05.977081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e98d09b-c11b48df-d056176-9f153f6a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:05.985948Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:05.985973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:05.985976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:05.985979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:05.985989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896156281251388:3420]
2025-09-30T14:56:05.985995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896156281251388:3420]
2025-09-30T14:56:05.986000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896156281251388:3420]
2025-09-30T14:56:05.986046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:05.986054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:05.986055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:05.986057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:05.986061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:05.986065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:05.986217Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:05.996762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2100 sessionId: src_id|1e98d09b-c11b48df-d056176-9f153f6a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:05.999888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:06.041286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896160665990010:5488]
2025-09-30T14:56:06.041616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2099, pipe: [1:7555896160665990010:5488]
2025-09-30T14:56:06.099987Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:06.100396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:06.100411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:06.100454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896160665990010:5488], now have 1 active actors on pipe
2025-09-30T14:56:06.100680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:06.100701Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:06.100681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896160665990010:5488]
2025-09-30T14:56:06.100702Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:06.100707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:06.100779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2100 reason: error at write: Disconnected sessionId: src_id|1e98d09b-c11b48df-d056176-9f153f6a_0
2025-09-30T14:56:06.101140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e98d09b-c11b48df-d056176-9f153f6a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:06.101151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e98d09b-c11b48df-d056176-9f153f6a_0] Write session will restart in 0.008766s
2025-09-30T14:56:06.101176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e98d09b-c11b48df-d056176-9f153f6a_0] Write session: Do CDS request
2025-09-30T14:56:06.100976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2100 sessionId: src_id|1e98d09b-c11b48df-d056176-9f153f6a_0 is DEAD
2025-09-30T14:56:06.101182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e98d09b-c11b48df-d056176-9f153f6a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:06.110848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e98d09b-c11b48df-d056176-9f153f6a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:06.110930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:06.110948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2101
2025-09-30T14:56:06.111095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2101 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:06.111127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2101 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:06.111137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2101 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:06.111142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:06.111660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2101 sessionId:  describe result for acl check
2025-09-30T14:56:06.111701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:06.111704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:06.111705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:06.111712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896160665990058:8422] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:06.112329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896160665990058:8422] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:06.115218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896160665990058:8422] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:06.118855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896160665990058:8422] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:06.118877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896160665990058:8422] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:06.118881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896160665990058:8422] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:06.118890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2101 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:06.119024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:06.122282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:06.122672Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:06.122684Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:06.122697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:06.122767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:06.122819Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896160576218877:3417]
2025-09-30T14:56:06.123490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:06.123986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:06.124072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:06.124493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:06.124571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:06.124579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:06.124580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:06.124582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:06.124583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:06.124585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:06.124586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:06.124588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:06.124590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:06.124591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:06.124593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.124595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:06.124596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:06.124598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:06.124599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:06.124606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:06.124618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:06.124623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:06.124629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:06.124633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:06.124638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:06.124643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:06.124647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:06.124652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:06.124657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:06.124661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.124666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:06.124670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:06.124675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:06.124679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:06.124689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:06.124698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:06.124706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:06.124713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:06.124720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:06.124732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:06.124738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:06.124750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:06.124757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:06.124763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:06.124770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:06.124782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:06.124788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:06.124800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:06.124805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:06.124811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:06.124819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:06.124829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:06.124835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:06.124840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:06.124850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.124855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.124864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:06.124869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:06.124879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:06.124888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:06.124893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:06.124899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:06.124905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:06.124915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:06.124963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:06.131115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:06.132393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:06.132414Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:06.132417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:06.132422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:06.132429Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2100 [2:7555896160576218877:3417]
2025-09-30T14:56:06.132447Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:06.132465Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:06.132468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:06.132472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:06.132475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:06.132491Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:06.132499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:06.132507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:06.132571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.132581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:06.132583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:06.132586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:06.132588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:06.132661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:06.132674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.132689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:06.132703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:06.132722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:06.132744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896160665990195:8422], now have 1 active actors on pipe
2025-09-30T14:56:06.132751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896160665990013:2454], now have 1 active actors on pipe
2025-09-30T14:56:06.132766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896160576218870:3417]
2025-09-30T14:56:06.132768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896160576218870:3417]
2025-09-30T14:56:06.132771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896160576218870:3417]
2025-09-30T14:56:06.132784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:06.132800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:06.132807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:06.132810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:06.132813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:06.132821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:06.132827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:06.132869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896160576218870:3417]
2025-09-30T14:56:06.132883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:06.132904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:06.133083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2100
2025-09-30T14:56:06.133124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2100
2025-09-30T14:56:06.133443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:06.133457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:06.133490Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db56643e-a724fd28-fc7425db-b0130656_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:06.133505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:06.133516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:06.133518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:06.133530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:06.133542Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:06.133560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:06.133953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:06.133962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:06.133978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:06.134085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2101 partition: 0 MaxSeqNo: 42 sessionId: src_id|db56643e-a724fd28-fc7425db-b0130656_0
2025-09-30T14:56:06.134511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e98d09b-c11b48df-d056176-9f153f6a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|db56643e-a724fd28-fc7425db-b0130656_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:06.137628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db56643e-a724fd28-fc7425db-b0130656_0] Write session: try to update token
2025-09-30T14:56:06.137648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db56643e-a724fd28-fc7425db-b0130656_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:06.148505Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:06.148531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:06.148541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896160576218870:3417]
2025-09-30T14:56:06.148586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:06.148589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:06.148774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:06.148947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:06.149106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:06.149261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:06.149491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:06.149539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:06.155274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2101 sessionId: src_id|db56643e-a724fd28-fc7425db-b0130656_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:06.158275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:06.158550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:06.158580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:06.158626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:06.158766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:06.160778Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:06.160802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:06.160805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:06.160807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:06.160817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896160576218870:3417]
2025-09-30T14:56:06.160822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896160576218870:3417]
2025-09-30T14:56:06.160826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896160576218870:3417]
2025-09-30T14:56:06.160867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:06.160874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.160878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:06.160891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:06.160899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:06.160904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:06.161027Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:06.201257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896160665990213:5488]
2025-09-30T14:56:06.202324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2100, pipe: [1:7555896160665990213:5488]
2025-09-30T14:56:06.284155Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:06.293937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:06.293975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:06.294213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:06.294325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:06.294417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:06.294524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:06.295144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:06.295163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:06.295271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:06.295344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:06.295427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:06.295505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:06.295554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:06.295566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:06.295646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:06.295718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:06.295790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:06.295861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:06.295907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:06.295910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:06.295995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:06.296071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:06.296146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:06.296224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:06.296275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:06.296278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:06.296375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:06.296446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:06.296516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:06.296588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:06.296635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:06.296639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:06.296718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:06.296785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:06.296858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:06.296931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:06.296979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:06.296983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:06.297064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:06.297129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:06.297204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:06.297273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:06.297321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:06.297324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:06.297399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:06.297482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:06.297553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:06.297624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:06.297671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:06.297679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:06.297760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:06.297823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:06.297893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:06.297965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:06.298011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:06.298014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:06.298087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:06.298154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:06.298228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:06.298300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:06.298346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:06.298350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:06.298526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896160665990213:5488], now have 1 active actors on pipe
2025-09-30T14:56:06.298829Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:06.298853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:06.298858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:06.298895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896160665990213:5488]
2025-09-30T14:56:06.298902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2101 reason: error at write: Disconnected sessionId: src_id|db56643e-a724fd28-fc7425db-b0130656_0
2025-09-30T14:56:06.298909Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:56:06.298902Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:06.298996Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 21 consumer shared/user session shared/user_1_21_3187655180107370934_v1 is DEAD
2025-09-30T14:56:06.299008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2101 sessionId: src_id|db56643e-a724fd28-fc7425db-b0130656_0 is DEAD
2025-09-30T14:56:06.299267Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896087651530653:5501] disconnected; active server actors: 1
2025-09-30T14:56:06.299309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db56643e-a724fd28-fc7425db-b0130656_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:06.299278Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896087651530653:5501] client user disconnected session shared/user_1_21_3187655180107370934_v1
2025-09-30T14:56:06.299321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db56643e-a724fd28-fc7425db-b0130656_0] Write session will restart in 0.007046s
2025-09-30T14:56:06.299297Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:56:06.299347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db56643e-a724fd28-fc7425db-b0130656_0] Write session: Do CDS request
2025-09-30T14:56:06.299353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db56643e-a724fd28-fc7425db-b0130656_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:06.299439Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:56:06.299447Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:56:06.299454Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.007337s
2025-09-30T14:56:06.307804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db56643e-a724fd28-fc7425db-b0130656_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:06.307836Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:56:06.308090Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:06.308092Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:56:06.308096Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 22
2025-09-30T14:56:06.308115Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2102
2025-09-30T14:56:06.308255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2102 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:06.308293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2102 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:06.308303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2102 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:06.308307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:06.308330Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 22 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:56:06.308389Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:56:06.308497Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 auth for : user
2025-09-30T14:56:06.308781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2102 sessionId:  describe result for acl check
2025-09-30T14:56:06.308814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:06.308821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:06.308822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:06.308828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896160665990236:8410] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:06.309392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896160665990236:8410] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:06.309632Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 Handle describe topics response
2025-09-30T14:56:06.309659Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 auth is DEAD
2025-09-30T14:56:06.309672Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:56:06.309963Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:56:06.310675Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896160665990249:8412] connected; active server actors: 1
2025-09-30T14:56:06.311074Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555896160665990249:8412] session shared/user_1_22_12843825378848088645_v1
2025-09-30T14:56:06.311099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:56:06.311109Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:56:06.311121Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_22_12843825378848088645_v1" (Sender=[1:7555896160665990232:8412], Pipe=[1:7555896160665990249:8412], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:56:06.311126Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:56:06.311139Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:56:06.311148Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_22_12843825378848088645_v1" (Sender=[1:7555896160665990232:8412], Pipe=[1:7555896160665990249:8412], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:56:06.311158Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_22_12843825378848088645_v1" sender [1:7555896160665990232:8412] lock partition 0 for ReadingSession "shared/user_1_22_12843825378848088645_v1" (Sender=[1:7555896160665990232:8412], Pipe=[1:7555896160665990249:8412], Partitions=[], ActiveFamilyCount=1) generation 1 step 22
2025-09-30T14:56:06.311172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:56:06.311187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000044s
2025-09-30T14:56:06.311454Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 22 Session: "shared/user_1_22_12843825378848088645_v1" ClientId: "user" PipeClient { RawX1: 7555896160665990249 RawX2: 4503603922346204 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:56:06.311476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:56:06.313474Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_22_12843825378848088645_v1
2025-09-30T14:56:06.319800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896160665990236:8410] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:06.320779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:06.323704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:06.323947Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:06.323960Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:06.323973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:06.324034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:06.324080Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896160576219065:3412]
2025-09-30T14:56:06.324805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:06.325168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:06.325220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:06.325607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:06.325681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:06.325693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:06.325694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:06.325696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:06.325698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:06.325700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:06.325701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:06.325703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:06.325705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:06.325706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:06.325708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.325709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:06.325710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:06.325712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:06.325713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:06.325719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:06.325731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:06.325735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:06.325740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:06.325745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:06.325750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:06.325755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:06.325760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:06.325765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:06.325771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:06.325775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.325779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:06.325784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:06.325789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:06.325794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:06.325804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:06.325814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:06.325821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:06.325828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:06.325833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:06.325839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:06.325844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:06.325851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:06.325857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:06.325864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:06.325868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:06.325875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:06.325888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:06.325893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:06.325898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:06.325903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:06.325909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:06.325915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:06.325920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:06.325927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:06.325933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.325940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.325972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:06.325984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:06.325989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:06.325994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:06.326000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:06.326011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:06.326021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:06.326027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:06.326077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:06.334112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896160665990236:8410] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:06.334134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896160665990236:8410] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:06.334138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896160665990236:8410] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:06.334148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2102 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:06.334364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:06.335633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:06.335658Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:06.335661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:06.335666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:06.335674Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2101 [2:7555896160576219065:3412]
2025-09-30T14:56:06.335695Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:06.335722Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:06.335732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:06.335735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:06.335739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:06.335760Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:06.335769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:06.335786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:06.335886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.335903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:06.335907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:06.335912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:06.335916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:06.336016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:06.336029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.336048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:06.336063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:06.336090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:06.336127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896160665990415:8410], now have 1 active actors on pipe
2025-09-30T14:56:06.336139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896160665990267:8402], now have 1 active actors on pipe
2025-09-30T14:56:06.336143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896160665990219:2454], now have 1 active actors on pipe
2025-09-30T14:56:06.336151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896160576219060:3412]
2025-09-30T14:56:06.336154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896160576219060:3412]
2025-09-30T14:56:06.336157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896160576219060:3412]
2025-09-30T14:56:06.336179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:06.336234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2101
2025-09-30T14:56:06.336244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2101, pipe: [1:7555896160665990267:8402]
2025-09-30T14:56:06.336282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2101
2025-09-30T14:56:06.336197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:06.336208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:06.336210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:06.336213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:06.336228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:06.336234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:06.336281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896160576219060:3412]
2025-09-30T14:56:06.336294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:06.336441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:06.336454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:06.336462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:06.336500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:06.336507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:06.336516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_22_12843825378848088645_v1 on pipe: [1:7555896160665990267:8402]
2025-09-30T14:56:06.336549Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_22_12843825378848088645_v1:1 with generation 2101
2025-09-30T14:56:06.336550Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3147d3a-7459db52-6670891c-3371d94a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:06.336562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:06.336566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:06.336569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:06.336585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:06.336598Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:06.336615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:06.336620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:06.336632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:06.336649Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_22_12843825378848088645_v1
2025-09-30T14:56:06.336657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:06.336692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:06.336714Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:56:06.336937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:06.336950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:06.336968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:06.337072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2102 partition: 0 MaxSeqNo: 42 sessionId: src_id|e3147d3a-7459db52-6670891c-3371d94a_0
2025-09-30T14:56:06.337498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db56643e-a724fd28-fc7425db-b0130656_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e3147d3a-7459db52-6670891c-3371d94a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:06.341513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3147d3a-7459db52-6670891c-3371d94a_0] Write session: try to update token
2025-09-30T14:56:06.341537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3147d3a-7459db52-6670891c-3371d94a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:06.342272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:56:06.342320Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:56:06.342345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:06.342354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:06.342356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:06.342368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:56:06.342382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:56:06.342594Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759244166336 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:56:06.342632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:56:06.342672Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 sending to client partition status
2025-09-30T14:56:06.349515Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:06.349539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:06.349552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896160576219060:3412]
2025-09-30T14:56:06.349601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:06.349608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:06.349807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:06.349970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:06.350145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:06.350314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:06.350649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:06.350693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:06.358864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2102 sessionId: src_id|e3147d3a-7459db52-6670891c-3371d94a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:06.361626Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:06.361653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:06.361656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:06.361659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:06.361672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896160576219060:3412]
2025-09-30T14:56:06.361677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896160576219060:3412]
2025-09-30T14:56:06.361683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896160576219060:3412]
2025-09-30T14:56:06.361732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:06.361741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.361744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:06.361758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:06.361778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:06.361783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:06.361928Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:06.362113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:06.477320Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:06.477796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:06.477810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:06.478076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_22_12843825378848088645_v1
2025-09-30T14:56:06.478094Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:06.478118Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_22_12843825378848088645_v1
2025-09-30T14:56:06.478563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3147d3a-7459db52-6670891c-3371d94a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:06.478576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3147d3a-7459db52-6670891c-3371d94a_0] Write session will restart in 0.008519s
2025-09-30T14:56:06.478612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3147d3a-7459db52-6670891c-3371d94a_0] Write session: Do CDS request
2025-09-30T14:56:06.478617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3147d3a-7459db52-6670891c-3371d94a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:06.478120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:06.478139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:06.478154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896160665990267:8402]
2025-09-30T14:56:06.478178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:06.478210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2102 reason: error at write: Disconnected sessionId: src_id|e3147d3a-7459db52-6670891c-3371d94a_0
2025-09-30T14:56:06.478424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2102 sessionId: src_id|e3147d3a-7459db52-6670891c-3371d94a_0 is DEAD
2025-09-30T14:56:06.488675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3147d3a-7459db52-6670891c-3371d94a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:06.488853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:06.488871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2103
2025-09-30T14:56:06.489002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2103 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:06.489036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2103 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:06.489046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2103 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:06.489050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:06.489605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2103 sessionId:  describe result for acl check
2025-09-30T14:56:06.489644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:06.489646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:06.489648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:06.489655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896160665990510:8403] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:06.490258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896160665990510:8403] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:06.492449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896160665990510:8403] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:06.493539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:06.495855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:06.496030Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:06.496040Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:06.496050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:06.496112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:06.496152Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896160576219258:3404]
2025-09-30T14:56:06.496232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896160665990510:8403] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:06.496248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896160665990510:8403] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:06.496251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896160665990510:8403] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:06.496259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2103 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:06.496704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:06.497017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:06.497080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:06.497459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:06.497524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:06.497531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:06.497532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:06.497533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:06.497535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:06.497536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:06.497537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:06.497538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:06.497540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:06.497541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:06.497542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.497543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:06.497545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:06.497546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:06.497547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:06.497553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:06.497564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:06.497568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:06.497573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:06.497577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:06.497581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:06.497585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:06.497589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:06.497593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:06.497597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:06.497601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.497605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:06.497609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:06.497614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:06.497618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:06.497626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:06.497634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:06.497640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:06.497652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:06.497662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:06.497672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:06.497682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:06.497692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:06.497697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:06.497702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:06.497712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:06.497722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:06.497732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:06.497742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:06.497750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:06.497755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:06.497765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:06.497770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:06.497779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:06.497784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:06.497793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.497799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.497822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:06.497831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:06.497836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:06.497842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:06.497847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:06.497852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:06.497857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:06.497867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:06.497926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:06.503422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:06.504691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:06.504708Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:06.504711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:06.504716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:06.504722Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2102 [2:7555896160576219258:3404]
2025-09-30T14:56:06.504740Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:06.504756Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:06.504760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:06.504764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:06.504767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:06.504785Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:06.504791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:06.504803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:06.504870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.504878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:06.504882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:06.504886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:06.504888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:06.504957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:06.504968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.504980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:06.504992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:06.505011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:06.505030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896160665990610:8403], now have 1 active actors on pipe
2025-09-30T14:56:06.505034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896160665990424:2454], now have 1 active actors on pipe
2025-09-30T14:56:06.505041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896160576219253:3404]
2025-09-30T14:56:06.505043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896160576219253:3404]
2025-09-30T14:56:06.505045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896160576219253:3404]
2025-09-30T14:56:06.505059Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:06.505073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:06.505085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:06.505091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:06.505094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:06.505094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:06.505097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:06.505138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896160576219253:3404]
2025-09-30T14:56:06.505149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:06.505156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:06.505147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2102
2025-09-30T14:56:06.505151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2102
2025-09-30T14:56:06.505291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:06.505321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:06.505348Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9cd140e2-6ab8d375-4cab9584-8ce4f40_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:06.505363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:06.505367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:06.505369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:06.505381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:06.505394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:06.505410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:06.505677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:06.505688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:06.505704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:06.505811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2103 partition: 0 MaxSeqNo: 42 sessionId: src_id|9cd140e2-6ab8d375-4cab9584-8ce4f40_0
2025-09-30T14:56:06.506243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3147d3a-7459db52-6670891c-3371d94a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9cd140e2-6ab8d375-4cab9584-8ce4f40_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:06.509309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd140e2-6ab8d375-4cab9584-8ce4f40_0] Write session: try to update token
2025-09-30T14:56:06.509333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd140e2-6ab8d375-4cab9584-8ce4f40_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:06.517820Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:06.517847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:06.517859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896160576219253:3404]
2025-09-30T14:56:06.517911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:06.517913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:06.518099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:06.518257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:06.518415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:06.518578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:06.518831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:06.518876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:06.525921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2103 sessionId: src_id|9cd140e2-6ab8d375-4cab9584-8ce4f40_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:06.529006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:06.529239Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:06.529267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:06.529270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:06.529272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:06.529283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896160576219253:3404]
2025-09-30T14:56:06.529288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896160576219253:3404]
2025-09-30T14:56:06.529292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896160576219253:3404]
2025-09-30T14:56:06.529339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:06.529347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.529350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:06.529353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:06.529361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:06.529366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:06.529515Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:06.578399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896160665990623:8402]
2025-09-30T14:56:06.578791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2102, pipe: [1:7555896160665990623:8402]
2025-09-30T14:56:06.645797Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:06.646209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:06.646220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:06.646242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896160665990623:8402], now have 1 active actors on pipe
2025-09-30T14:56:06.646525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:06.646558Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:06.646534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896160665990623:8402]
2025-09-30T14:56:06.646540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:06.646558Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:06.646626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2103 reason: error at write: Disconnected sessionId: src_id|9cd140e2-6ab8d375-4cab9584-8ce4f40_0
2025-09-30T14:56:06.646818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2103 sessionId: src_id|9cd140e2-6ab8d375-4cab9584-8ce4f40_0 is DEAD
2025-09-30T14:56:06.647021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd140e2-6ab8d375-4cab9584-8ce4f40_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:06.647033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd140e2-6ab8d375-4cab9584-8ce4f40_0] Write session will restart in 0.006906s
2025-09-30T14:56:06.647060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd140e2-6ab8d375-4cab9584-8ce4f40_0] Write session: Do CDS request
2025-09-30T14:56:06.647068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd140e2-6ab8d375-4cab9584-8ce4f40_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:06.654851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd140e2-6ab8d375-4cab9584-8ce4f40_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:06.654904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:06.654924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2104
2025-09-30T14:56:06.655192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2104 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:06.655237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2104 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:06.655291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2104 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:06.655295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:06.655732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2104 sessionId:  describe result for acl check
2025-09-30T14:56:06.655767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:06.655774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:06.655776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:06.655782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896160665990641:8396] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:06.656347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896160665990641:8396] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:06.659912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896160665990641:8396] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:06.663193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896160665990641:8396] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:06.663212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896160665990641:8396] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:06.663216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896160665990641:8396] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:06.663226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2104 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:06.664844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:06.667715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:06.668019Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:06.668035Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:06.668047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:06.668109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:06.668154Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896160576219450:3402]
2025-09-30T14:56:06.668903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:06.669255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:06.669301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:06.669662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:06.669728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:06.669735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:06.669736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:06.669738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:06.669739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:06.669741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:06.669742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:06.669744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:06.669745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:06.669746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:06.669748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.669749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:06.669751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:06.669752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:06.669753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:06.669759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:06.669771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:06.669776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:06.669781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:06.669786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:06.669791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:06.669796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:06.669801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:06.669806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:06.669811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:06.669816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.669820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:06.669825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:06.669830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:06.669835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:06.669844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:06.669854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:06.669866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:06.669872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:06.669884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:06.669890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:06.669900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:06.669905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:06.669916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:06.669923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:06.669929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:06.669934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:06.669940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:06.669946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:06.669951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:06.669957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:06.669962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:06.669969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:06.669978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:06.669983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:06.669992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.669998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.670006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:06.670011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:06.670015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:06.670024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:06.670028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:06.670033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:06.670038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:06.670042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:06.670092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:06.676561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:06.677768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:06.677788Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:06.677792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:06.677797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:06.677805Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2103 [2:7555896160576219450:3402]
2025-09-30T14:56:06.677823Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:06.677841Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:06.677844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:06.677848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:06.677850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:06.677868Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:06.677875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:06.677885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:06.677955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.677964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:06.677965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:06.677969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:06.677972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:06.678044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:06.678053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.678069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:06.678088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:06.678110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:06.678139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896160665990811:8396], now have 1 active actors on pipe
2025-09-30T14:56:06.678148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896160665990624:2454], now have 1 active actors on pipe
2025-09-30T14:56:06.678155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896160576219444:3402]
2025-09-30T14:56:06.678166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896160576219444:3402]
2025-09-30T14:56:06.678168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896160576219444:3402]
2025-09-30T14:56:06.678181Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:06.678197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:06.678201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:06.678209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:06.678212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:06.678219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:06.678222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:06.678259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896160576219444:3402]
2025-09-30T14:56:06.678268Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:06.678293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:06.678403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:06.678421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:06.678264Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2103
2025-09-30T14:56:06.678264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2103
2025-09-30T14:56:06.678463Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ab8ca68-4aaef8a1-13713b84-c9e92496_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:06.678480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:06.678489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:06.678497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:06.678510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:06.678537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:06.678563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:06.678752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:06.678766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:06.678785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:06.678917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2104 partition: 0 MaxSeqNo: 42 sessionId: src_id|8ab8ca68-4aaef8a1-13713b84-c9e92496_0
2025-09-30T14:56:06.679406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd140e2-6ab8d375-4cab9584-8ce4f40_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8ab8ca68-4aaef8a1-13713b84-c9e92496_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:06.682434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab8ca68-4aaef8a1-13713b84-c9e92496_0] Write session: try to update token
2025-09-30T14:56:06.682456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab8ca68-4aaef8a1-13713b84-c9e92496_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:06.691405Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:06.691427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:06.691439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896160576219444:3402]
2025-09-30T14:56:06.691487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:06.691497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:06.691689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:06.691849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:06.692007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:06.692158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:06.692387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:06.692438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:06.702327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2104 sessionId: src_id|8ab8ca68-4aaef8a1-13713b84-c9e92496_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:06.703034Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:06.703058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:06.703060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:06.703061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:06.703069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896160576219444:3402]
2025-09-30T14:56:06.703072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896160576219444:3402]
2025-09-30T14:56:06.703075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896160576219444:3402]
2025-09-30T14:56:06.703111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:06.703122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.703125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:06.703148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:06.703164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:06.703169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:06.703312Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:06.705161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:06.746828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896160665990827:8402]
2025-09-30T14:56:06.747182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2103, pipe: [1:7555896160665990827:8402]
2025-09-30T14:56:06.820229Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:06.820642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:06.820660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:06.820683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896160665990827:8402], now have 1 active actors on pipe
2025-09-30T14:56:06.820933Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:06.820948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896160665990827:8402]
2025-09-30T14:56:06.820960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:06.820965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:06.820985Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:06.821038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2104 reason: error at write: Disconnected sessionId: src_id|8ab8ca68-4aaef8a1-13713b84-c9e92496_0
2025-09-30T14:56:06.821235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2104 sessionId: src_id|8ab8ca68-4aaef8a1-13713b84-c9e92496_0 is DEAD
2025-09-30T14:56:06.821432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab8ca68-4aaef8a1-13713b84-c9e92496_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:06.821444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab8ca68-4aaef8a1-13713b84-c9e92496_0] Write session will restart in 0.009169s
2025-09-30T14:56:06.821469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab8ca68-4aaef8a1-13713b84-c9e92496_0] Write session: Do CDS request
2025-09-30T14:56:06.821478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab8ca68-4aaef8a1-13713b84-c9e92496_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:06.835577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab8ca68-4aaef8a1-13713b84-c9e92496_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:06.835683Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:06.835702Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2105
2025-09-30T14:56:06.835879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2105 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:06.835927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2105 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:06.835938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2105 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:06.835942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:06.836695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2105 sessionId:  describe result for acl check
2025-09-30T14:56:06.836744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:06.836753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:06.836755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:06.836762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896160665990933:8392] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:06.837358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896160665990933:8392] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:06.839606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896160665990933:8392] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:06.841550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:06.844315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:06.844590Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:06.844601Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:06.844617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:06.844579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896160665990933:8392] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:06.844599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896160665990933:8392] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:06.844602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896160665990933:8392] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:06.844615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2105 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:06.844680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:06.844734Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896160576219652:3397]
2025-09-30T14:56:06.845453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:06.845813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:06.845863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:06.846228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:06.846306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:06.846314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:06.846316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:06.846317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:06.846319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:06.846321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:06.846322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:06.846324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:06.846325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:06.846326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:06.846328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.846329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:06.846330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:06.846332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:06.846333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:06.846339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:06.846350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:06.846354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:06.846358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:06.846362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:06.846365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:06.846369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:06.846372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:06.846376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:06.846379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:06.846382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.846386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:06.846389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:06.846392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:06.846396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:06.846406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:06.846415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:06.846422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:06.846429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:06.846434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:06.846440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:06.846444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:06.846450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:06.846455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:06.846461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:06.846465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:06.846473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:06.846478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:06.846484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:06.846489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:06.846494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:06.846499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:06.846504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:06.846509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:06.846515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:06.846520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.846532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.846536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:06.846541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:06.846546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:06.846552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:06.846562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:06.846568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:06.846575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:06.846586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:06.846631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:06.852705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:06.853974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:06.854001Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:06.854004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:06.854008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:06.854015Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2104 [2:7555896160576219652:3397]
2025-09-30T14:56:06.854031Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:06.854049Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:06.854053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:06.854057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:06.854059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:06.854078Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:06.854092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:06.854099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:06.854164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.854174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:06.854176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:06.854180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:06.854185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:06.854261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:06.854271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.854284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:06.854295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:06.854311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:06.854329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896160576219647:3397]
2025-09-30T14:56:06.854331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896160576219647:3397]
2025-09-30T14:56:06.854333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896160576219647:3397]
2025-09-30T14:56:06.854341Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:06.854352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:06.854360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896160665990828:2454], now have 1 active actors on pipe
2025-09-30T14:56:06.854365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:06.854366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:06.854368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:06.854381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:06.854384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:06.854389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896160665991016:8392], now have 1 active actors on pipe
2025-09-30T14:56:06.854425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896160576219647:3397]
2025-09-30T14:56:06.854440Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:06.854459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:06.854482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2104
2025-09-30T14:56:06.854476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2104
2025-09-30T14:56:06.854533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:06.854544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:06.854570Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|76560a91-8f721bef-8341470-e57417c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:06.854583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:06.854587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:06.854589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:06.854600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:06.854610Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:06.854628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:06.854886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:06.854916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:06.854945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:06.855049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2105 partition: 0 MaxSeqNo: 42 sessionId: src_id|76560a91-8f721bef-8341470-e57417c2_0
2025-09-30T14:56:06.855497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab8ca68-4aaef8a1-13713b84-c9e92496_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|76560a91-8f721bef-8341470-e57417c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:06.858576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76560a91-8f721bef-8341470-e57417c2_0] Write session: try to update token
2025-09-30T14:56:06.858600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76560a91-8f721bef-8341470-e57417c2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:06.867436Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:06.867461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:06.867471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896160576219647:3397]
2025-09-30T14:56:06.867525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:06.867557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:06.867711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:06.867869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:06.868029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:06.868172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:06.868387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:06.868425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:06.879120Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:06.879148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:06.879150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:06.879153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:06.879163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896160576219647:3397]
2025-09-30T14:56:06.879168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896160576219647:3397]
2025-09-30T14:56:06.879172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896160576219647:3397]
2025-09-30T14:56:06.879215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:06.879220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:06.879228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:06.879230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:06.879231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:06.879234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:06.879392Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:06.881092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2105 sessionId: src_id|76560a91-8f721bef-8341470-e57417c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:06.884435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:06.920911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896160665991029:8402]
2025-09-30T14:56:06.921260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2104, pipe: [1:7555896160665991029:8402]
2025-09-30T14:56:07.003215Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:07.003662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:07.003679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:07.003701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896160665991029:8402], now have 1 active actors on pipe
2025-09-30T14:56:07.003956Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:07.003987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:07.003991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896160665991029:8402]
2025-09-30T14:56:07.004026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:07.004029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:07.004096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2105 reason: error at write: Disconnected sessionId: src_id|76560a91-8f721bef-8341470-e57417c2_0
2025-09-30T14:56:07.004304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2105 sessionId: src_id|76560a91-8f721bef-8341470-e57417c2_0 is DEAD
2025-09-30T14:56:07.004463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76560a91-8f721bef-8341470-e57417c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:07.004474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76560a91-8f721bef-8341470-e57417c2_0] Write session will restart in 0.007632s
2025-09-30T14:56:07.004498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76560a91-8f721bef-8341470-e57417c2_0] Write session: Do CDS request
2025-09-30T14:56:07.004504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76560a91-8f721bef-8341470-e57417c2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:07.013816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76560a91-8f721bef-8341470-e57417c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:07.015755Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:07.015774Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2106
2025-09-30T14:56:07.015953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2106 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:07.015984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2106 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:07.015995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2106 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:07.016000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:07.016430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2106 sessionId:  describe result for acl check
2025-09-30T14:56:07.016464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:07.016466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:07.016470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:07.016477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896164960958424:8370] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:07.017030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896164960958424:8370] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:07.020357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896164960958424:8370] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:07.023510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:07.026397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:07.026640Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:07.026652Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:07.026664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:07.026723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:07.026767Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896164871187179:3362]
2025-09-30T14:56:07.024070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896164960958424:8370] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:07.024090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896164960958424:8370] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:07.024094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896164960958424:8370] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:07.024125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2106 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:07.027449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:07.027797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:07.027846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:07.028176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:07.028233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:07.028234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:07.028236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:07.028237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:07.028238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:07.028240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:07.028241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:07.028242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:07.028244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:07.028245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:07.028246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.028248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.028249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.028250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:07.028251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:07.028257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:07.028268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:07.028272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:07.028276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:07.028280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:07.028284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:07.028288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:07.028292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:07.028296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:07.028300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:07.028304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.028308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.028312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.028316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:07.028320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:07.028330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:07.028337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:07.028343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:07.028349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:07.028354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:07.028359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:07.028364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:07.028369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:07.028374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:07.028379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:07.028384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:07.028389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:07.028394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:07.028399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:07.028403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:07.028409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:07.028414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:07.028418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:07.028422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:07.028427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:07.028432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.028437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.028443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.028447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.028451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.028455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.028459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:07.028465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:07.028470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:07.028475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:07.028521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:07.034904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:07.036062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:07.036068Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:07.036069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:07.036073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:07.036078Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2105 [2:7555896164871187179:3362]
2025-09-30T14:56:07.036091Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:07.036104Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:07.036110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:07.036112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:07.036113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:07.036127Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:07.036132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:07.036139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:07.036185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.036186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.036188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.036190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:07.036192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:07.036249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:07.036251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.036260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.036266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.036276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:07.036288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896164871187173:3362]
2025-09-30T14:56:07.036290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896164871187173:3362]
2025-09-30T14:56:07.036292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896164871187173:3362]
2025-09-30T14:56:07.036298Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:07.036308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:07.036317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:07.036319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:07.036354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896164871187173:3362]
2025-09-30T14:56:07.036360Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:07.036390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:07.036395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:07.036398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:07.036422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:07.036602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896164960958363:2454], now have 1 active actors on pipe
2025-09-30T14:56:07.036623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896164960958549:8370], now have 1 active actors on pipe
2025-09-30T14:56:07.036698Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2105
2025-09-30T14:56:07.036745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2105
2025-09-30T14:56:07.036877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:07.036889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:07.036917Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8a7b683-ab7df5ae-fb4d76cf-862c87f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:07.036925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:07.036932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:07.036934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:07.036944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:07.036956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:07.036971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:07.041296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:07.041321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:07.041358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:07.041822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2106 partition: 0 MaxSeqNo: 42 sessionId: src_id|b8a7b683-ab7df5ae-fb4d76cf-862c87f8_0
2025-09-30T14:56:07.047431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76560a91-8f721bef-8341470-e57417c2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b8a7b683-ab7df5ae-fb4d76cf-862c87f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:07.049173Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:07.049197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:07.049205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896164871187173:3362]
2025-09-30T14:56:07.049240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:07.049400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:07.049549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:07.049675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:07.050361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a7b683-ab7df5ae-fb4d76cf-862c87f8_0] Write session: try to update token
2025-09-30T14:56:07.050379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a7b683-ab7df5ae-fb4d76cf-862c87f8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:07.049801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:07.050006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:07.050046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:07.050284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:07.063212Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:07.063260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:07.063263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:07.063265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:07.063276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896164871187173:3362]
2025-09-30T14:56:07.063281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896164871187173:3362]
2025-09-30T14:56:07.063286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896164871187173:3362]
2025-09-30T14:56:07.063324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:07.063335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.063337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:07.063396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:07.063412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:07.063416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:07.063493Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:07.074160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2106 sessionId: src_id|b8a7b683-ab7df5ae-fb4d76cf-862c87f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:07.077256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:07.104209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896164960958561:8402]
2025-09-30T14:56:07.104761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2105, pipe: [1:7555896164960958561:8402]
2025-09-30T14:56:07.177607Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:07.178152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:07.178176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:07.178209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896164960958561:8402], now have 1 active actors on pipe
2025-09-30T14:56:07.178449Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:07.178545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:07.178601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:07.178604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:07.178696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2106 reason: error at write: Disconnected sessionId: src_id|b8a7b683-ab7df5ae-fb4d76cf-862c87f8_0
2025-09-30T14:56:07.179126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a7b683-ab7df5ae-fb4d76cf-862c87f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:07.178896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2106 sessionId: src_id|b8a7b683-ab7df5ae-fb4d76cf-862c87f8_0 is DEAD
2025-09-30T14:56:07.179136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a7b683-ab7df5ae-fb4d76cf-862c87f8_0] Write session will restart in 0.008526s
2025-09-30T14:56:07.178929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896164960958561:8402]
2025-09-30T14:56:07.179162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a7b683-ab7df5ae-fb4d76cf-862c87f8_0] Write session: Do CDS request
2025-09-30T14:56:07.179171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a7b683-ab7df5ae-fb4d76cf-862c87f8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:07.188853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a7b683-ab7df5ae-fb4d76cf-862c87f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:07.188941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:07.188958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2107
2025-09-30T14:56:07.189189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2107 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:07.189224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2107 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:07.189233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2107 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:07.189238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:07.189679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2107 sessionId:  describe result for acl check
2025-09-30T14:56:07.189711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:07.189717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:07.189719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:07.189725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896164960958580:8366] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:07.190274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896164960958580:8366] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:07.192808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896164960958580:8366] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:07.197478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896164960958580:8366] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:07.197501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896164960958580:8366] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:07.197505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896164960958580:8366] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:07.197515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2107 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:07.206795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:07.210370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:07.210770Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:07.210776Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:07.210790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:07.210859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:07.210905Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896164871187372:3356]
2025-09-30T14:56:07.211607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:07.212054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:07.212110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:07.212404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:07.212461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:07.212466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:07.212467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:07.212468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:07.212469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:07.212470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:07.212471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:07.212472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:07.212473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:07.212474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:07.212474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.212475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.212476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.212477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:07.212478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:07.212483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:07.212490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:07.212493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:07.212496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:07.212498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:07.212500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:07.212503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:07.212505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:07.212507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:07.212510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:07.212513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.212515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.212517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.212520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:07.212522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:07.212528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:07.212538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:07.212544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:07.212549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:07.212553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:07.212558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:07.212562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:07.212567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:07.212572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:07.212577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:07.212582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:07.212587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:07.212592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:07.212597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:07.212601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:07.212605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:07.212610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:07.212616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:07.212620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:07.212626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:07.212631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.212636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.212642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.212656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.212661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.212667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.212673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:07.212679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:07.212683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:07.212689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:07.212719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:07.218836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:07.220358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:07.220380Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:07.220382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:07.220385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:07.220391Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2106 [2:7555896164871187372:3356]
2025-09-30T14:56:07.220411Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:07.220433Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:07.220442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:07.220446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:07.220452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:07.220471Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:07.220483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:07.220493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:07.220564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.220574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.220576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.220580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:07.220582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:07.220657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:07.220663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.220676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.220682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.220696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:07.220712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896164871187367:3356]
2025-09-30T14:56:07.220714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896164871187367:3356]
2025-09-30T14:56:07.220715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896164871187367:3356]
2025-09-30T14:56:07.220722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:07.220734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:07.220751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:07.220753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:07.220756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:07.220759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:07.220765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:07.220788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896164871187367:3356]
2025-09-30T14:56:07.220790Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:07.220794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:07.220798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896164960958645:8366], now have 1 active actors on pipe
2025-09-30T14:56:07.220801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896164960958568:2454], now have 1 active actors on pipe
2025-09-30T14:56:07.220905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2106
2025-09-30T14:56:07.220928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2106
2025-09-30T14:56:07.221131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:07.221140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:07.221170Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e43277ef-cd8f8bed-a584d1e3-35b6c815_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:07.221178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:07.221183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:07.221185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:07.221194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:07.221202Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:07.221215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:07.221546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:07.221553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:07.221568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:07.221697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2107 partition: 0 MaxSeqNo: 42 sessionId: src_id|e43277ef-cd8f8bed-a584d1e3-35b6c815_0
2025-09-30T14:56:07.222274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a7b683-ab7df5ae-fb4d76cf-862c87f8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e43277ef-cd8f8bed-a584d1e3-35b6c815_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:07.225382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e43277ef-cd8f8bed-a584d1e3-35b6c815_0] Write session: try to update token
2025-09-30T14:56:07.225405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e43277ef-cd8f8bed-a584d1e3-35b6c815_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:07.237428Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:07.237454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:07.237457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:07.237464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:07.237474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896164871187367:3356]
2025-09-30T14:56:07.237479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896164871187367:3356]
2025-09-30T14:56:07.237483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896164871187367:3356]
2025-09-30T14:56:07.237528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:07.237535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.237538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:07.237543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:07.237551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:07.237556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:07.237697Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:07.247398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2107 sessionId: src_id|e43277ef-cd8f8bed-a584d1e3-35b6c815_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:07.250480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:07.279340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896164960958773:8402]
2025-09-30T14:56:07.279665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2106, pipe: [1:7555896164960958773:8402]
2025-09-30T14:56:07.355682Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:07.356112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:07.356130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:07.356152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896164960958773:8402], now have 1 active actors on pipe
2025-09-30T14:56:07.356405Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:07.356415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:07.356436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896164960958773:8402]
2025-09-30T14:56:07.356460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:07.356462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:07.356562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2107 reason: error at write: Disconnected sessionId: src_id|e43277ef-cd8f8bed-a584d1e3-35b6c815_0
2025-09-30T14:56:07.356742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2107 sessionId: src_id|e43277ef-cd8f8bed-a584d1e3-35b6c815_0 is DEAD
2025-09-30T14:56:07.356920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e43277ef-cd8f8bed-a584d1e3-35b6c815_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:07.356929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e43277ef-cd8f8bed-a584d1e3-35b6c815_0] Write session will restart in 0.007893s
2025-09-30T14:56:07.356968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e43277ef-cd8f8bed-a584d1e3-35b6c815_0] Write session: Do CDS request
2025-09-30T14:56:07.356979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e43277ef-cd8f8bed-a584d1e3-35b6c815_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:07.365880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e43277ef-cd8f8bed-a584d1e3-35b6c815_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:07.365983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:07.366004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2108
2025-09-30T14:56:07.366193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2108 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:07.366227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2108 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:07.366237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2108 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:07.366242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:07.366682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2108 sessionId:  describe result for acl check
2025-09-30T14:56:07.366714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:07.366724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:07.366727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:07.366733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896164960958792:8361] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:07.367384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896164960958792:8361] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:07.370267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896164960958792:8361] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:07.373565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896164960958792:8361] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:07.373584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896164960958792:8361] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:07.373588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896164960958792:8361] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:07.373598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2108 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:07.374894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:07.377850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:07.378294Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:07.378308Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:07.378323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:07.378392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:07.378453Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896164871187566:3348]
2025-09-30T14:56:07.379166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:07.379481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:07.379557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:07.379934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:07.380010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:07.380018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:07.380020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:07.380022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:07.380023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:07.380025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:07.380026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:07.380028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:07.380030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:07.380032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:07.380033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.380034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.380036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.380037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:07.380038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:07.380045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:07.380056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:07.380060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:07.380064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:07.380069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:07.380073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:07.380077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:07.380081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:07.380086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:07.380091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:07.380095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.380101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.380105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.380109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:07.380114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:07.380122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:07.380131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:07.380138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:07.380144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:07.380151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:07.380157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:07.380161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:07.380167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:07.380173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:07.380178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:07.380182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:07.380188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:07.380194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:07.380199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:07.380204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:07.380210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:07.380215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:07.380220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:07.380225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:07.380231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:07.380236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.380242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.380247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.380253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.380258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.380263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.380268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:07.380274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:07.380282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:07.380288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:07.380336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:07.386572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:07.387851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:07.387870Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:07.387873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:07.387878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:07.387885Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2107 [2:7555896164871187566:3348]
2025-09-30T14:56:07.387903Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:07.387921Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:07.387924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:07.387927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:07.387929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:07.387947Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:07.387960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:07.387968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:07.388029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.388037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.388040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.388043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:07.388046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:07.388131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:07.388139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.388154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.388166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.388183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:07.388207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896164960958963:8361], now have 1 active actors on pipe
2025-09-30T14:56:07.388222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896164871187560:3348]
2025-09-30T14:56:07.388224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896164871187560:3348]
2025-09-30T14:56:07.388227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896164871187560:3348]
2025-09-30T14:56:07.388240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:07.388249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896164960958774:2454], now have 1 active actors on pipe
2025-09-30T14:56:07.388257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:07.388256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:07.388260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:07.388263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:07.388271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:07.388274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:07.388312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896164871187560:3348]
2025-09-30T14:56:07.388326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:07.388334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:07.388733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2107
2025-09-30T14:56:07.388771Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2107
2025-09-30T14:56:07.388813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:07.388826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:07.388857Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cbb88e31-346bf43a-87c6c60e-e5cd2bd3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:07.388871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:07.388883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:07.388885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:07.388896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:07.388908Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:07.388930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:07.389138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:07.389146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:07.389170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:07.389270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2108 partition: 0 MaxSeqNo: 42 sessionId: src_id|cbb88e31-346bf43a-87c6c60e-e5cd2bd3_0
2025-09-30T14:56:07.389689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e43277ef-cd8f8bed-a584d1e3-35b6c815_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cbb88e31-346bf43a-87c6c60e-e5cd2bd3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:07.392909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbb88e31-346bf43a-87c6c60e-e5cd2bd3_0] Write session: try to update token
2025-09-30T14:56:07.392932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbb88e31-346bf43a-87c6c60e-e5cd2bd3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:07.401928Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:07.401959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:07.401969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896164871187560:3348]
2025-09-30T14:56:07.402016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:07.402018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:07.402212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:07.402379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:07.402540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:07.402712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:07.402929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:07.402981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:07.413812Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:07.413847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:07.413850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:07.413852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:07.413863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896164871187560:3348]
2025-09-30T14:56:07.413867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896164871187560:3348]
2025-09-30T14:56:07.413875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896164871187560:3348]
2025-09-30T14:56:07.413919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:07.413928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.413933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:07.413937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:07.413940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:07.413946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:07.414094Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:07.415605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2108 sessionId: src_id|cbb88e31-346bf43a-87c6c60e-e5cd2bd3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:07.418446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:07.456480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896164960958978:8402]
2025-09-30T14:56:07.456798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2107, pipe: [1:7555896164960958978:8402]
2025-09-30T14:56:07.541160Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:07.542198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:07.542220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:07.542242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896164960958978:8402], now have 1 active actors on pipe
2025-09-30T14:56:07.542570Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:07.543202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbb88e31-346bf43a-87c6c60e-e5cd2bd3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:07.542599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:07.542617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:07.543214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbb88e31-346bf43a-87c6c60e-e5cd2bd3_0] Write session will restart in 0.008015s
2025-09-30T14:56:07.542639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896164960958978:8402]
2025-09-30T14:56:07.542676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:07.542717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2108 reason: error at write: Disconnected sessionId: src_id|cbb88e31-346bf43a-87c6c60e-e5cd2bd3_0
2025-09-30T14:56:07.543283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbb88e31-346bf43a-87c6c60e-e5cd2bd3_0] Write session: Do CDS request
2025-09-30T14:56:07.542947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2108 sessionId: src_id|cbb88e31-346bf43a-87c6c60e-e5cd2bd3_0 is DEAD
2025-09-30T14:56:07.543292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbb88e31-346bf43a-87c6c60e-e5cd2bd3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:07.552898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbb88e31-346bf43a-87c6c60e-e5cd2bd3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:07.552931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:07.552951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2109
2025-09-30T14:56:07.553155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2109 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:07.553213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2109 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:07.553227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2109 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:07.553247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:07.554070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2109 sessionId:  describe result for acl check
2025-09-30T14:56:07.554116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:07.554124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:07.554127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:07.554134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896164960959005:8360] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:07.554693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896164960959005:8360] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:07.559363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896164960959005:8360] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:07.568262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:07.568304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896164960959005:8360] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:07.568321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896164960959005:8360] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:07.568324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896164960959005:8360] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:07.568336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2109 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:07.571394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:07.571682Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:07.571696Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:07.571708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:07.571778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:07.571826Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896164871187764:3343]
2025-09-30T14:56:07.572630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:07.573016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:07.573082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:07.573500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:07.573584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:07.573585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:07.573587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:07.573588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:07.573590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:07.573591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:07.573593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:07.573594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:07.573596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:07.573598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:07.573599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.573600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.573602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.573603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:07.573604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:07.573611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:07.573623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:07.573628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:07.573632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:07.573636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:07.573641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:07.573646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:07.573650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:07.573655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:07.573662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:07.573666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.573671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.573675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.573679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:07.573684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:07.573693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:07.573703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:07.573709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:07.573714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:07.573720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:07.573726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:07.573733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:07.573738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:07.573744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:07.573749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:07.573754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:07.573759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:07.573764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:07.573770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:07.573776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:07.573782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:07.573787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:07.573793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:07.573797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:07.573803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:07.573808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.573814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.573819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.573824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.573829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.573834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.573840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:07.573846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:07.573851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:07.573857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:07.573906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:07.580302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:07.582080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:07.582099Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:07.582102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:07.582106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:07.582113Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2108 [2:7555896164871187764:3343]
2025-09-30T14:56:07.582131Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:07.582148Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:07.582152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:07.582156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:07.582158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:07.582175Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:07.582187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:07.582199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:07.582267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.582274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.582276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.582280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:07.582282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:07.582354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:07.582360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.582374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.582389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.582544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2108
2025-09-30T14:56:07.582600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2108
2025-09-30T14:56:07.582409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:07.582431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896164871187758:3343]
2025-09-30T14:56:07.582434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896164871187758:3343]
2025-09-30T14:56:07.582435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896164871187758:3343]
2025-09-30T14:56:07.582448Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:07.582461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896164960958980:2454], now have 1 active actors on pipe
2025-09-30T14:56:07.582465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896164960959172:8360], now have 1 active actors on pipe
2025-09-30T14:56:07.582464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:07.582468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:07.582471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:07.582473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:07.582486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:07.582490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:07.582527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896164871187758:3343]
2025-09-30T14:56:07.582536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:07.582545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:07.582678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:07.582683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:07.582708Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6ff8d9d2-3e99750b-46ed0705-ed56f2de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:07.582715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:07.582720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:07.582722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:07.582736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:07.582749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:07.582763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:07.582990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:07.583002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:07.583017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:07.583097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2109 partition: 0 MaxSeqNo: 42 sessionId: src_id|6ff8d9d2-3e99750b-46ed0705-ed56f2de_0
2025-09-30T14:56:07.583523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbb88e31-346bf43a-87c6c60e-e5cd2bd3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6ff8d9d2-3e99750b-46ed0705-ed56f2de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:07.591910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ff8d9d2-3e99750b-46ed0705-ed56f2de_0] Write session: try to update token
2025-09-30T14:56:07.591939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ff8d9d2-3e99750b-46ed0705-ed56f2de_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:07.597447Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:07.597474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:07.597484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896164871187758:3343]
2025-09-30T14:56:07.597535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:07.597537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:07.597735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:07.597908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:07.598074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:07.598240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:07.598467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:07.598514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:07.611641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2109 sessionId: src_id|6ff8d9d2-3e99750b-46ed0705-ed56f2de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:07.611873Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:07.611904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:07.611907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:07.611910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:07.611923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896164871187758:3343]
2025-09-30T14:56:07.611928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896164871187758:3343]
2025-09-30T14:56:07.611933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896164871187758:3343]
2025-09-30T14:56:07.611983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:07.611988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:07.611992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.611996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:07.612017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:07.612023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:07.612185Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:07.615075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:07.642843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896164960959184:8402]
2025-09-30T14:56:07.643172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2108, pipe: [1:7555896164960959184:8402]
2025-09-30T14:56:07.734593Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:07.734956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:07.734971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:07.734994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896164960959184:8402], now have 1 active actors on pipe
2025-09-30T14:56:07.735262Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:07.735362Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:07.735373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896164960959184:8402]
2025-09-30T14:56:07.735405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:07.735485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2109 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6ff8d9d2-3e99750b-46ed0705-ed56f2de_0
2025-09-30T14:56:07.735678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2109 sessionId: src_id|6ff8d9d2-3e99750b-46ed0705-ed56f2de_0 is DEAD
2025-09-30T14:56:07.735858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ff8d9d2-3e99750b-46ed0705-ed56f2de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:07.735874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ff8d9d2-3e99750b-46ed0705-ed56f2de_0] Write session will restart in 0.009890s
2025-09-30T14:56:07.735899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ff8d9d2-3e99750b-46ed0705-ed56f2de_0] Write session: Do CDS request
2025-09-30T14:56:07.735905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ff8d9d2-3e99750b-46ed0705-ed56f2de_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:07.746889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ff8d9d2-3e99750b-46ed0705-ed56f2de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:07.746879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:07.746897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2110
2025-09-30T14:56:07.747119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2110 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:07.747161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2110 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:07.747181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2110 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:07.747186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:07.747830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2110 sessionId:  describe result for acl check
2025-09-30T14:56:07.747867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:07.747874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:07.747879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:07.747895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896164960959228:8351] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:07.748498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896164960959228:8351] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:07.751543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896164960959228:8351] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:07.754819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896164960959228:8351] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:07.754842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896164960959228:8351] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:07.754845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896164960959228:8351] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:07.754855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2110 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:07.755909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:07.758622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:07.759010Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:07.759023Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:07.759036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:07.759102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:07.759146Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896164871187972:3341]
2025-09-30T14:56:07.759832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:07.760150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:07.760198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:07.760553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:07.760620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:07.760627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:07.760628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:07.760630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:07.760631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:07.760632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:07.760634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:07.760635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:07.760636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:07.760637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:07.760639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.760640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.760642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.760643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:07.760644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:07.760650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:07.760662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:07.760666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:07.760670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:07.760673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:07.760677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:07.760681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:07.760685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:07.760689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:07.760694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:07.760698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.760702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.760706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.760709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:07.760714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:07.760721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:07.760729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:07.760736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:07.760742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:07.760747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:07.760753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:07.760758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:07.760764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:07.760769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:07.760775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:07.760780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:07.760785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:07.760790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:07.760795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:07.760805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:07.760811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:07.760821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:07.760832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:07.760842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:07.760852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:07.760862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.760869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.760878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.760888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.760898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.760908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.760912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:07.760917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:07.760923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:07.760930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:07.760977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:07.766851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:07.768197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:07.768220Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:07.768223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:07.768227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:07.768234Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2109 [2:7555896164871187972:3341]
2025-09-30T14:56:07.768250Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:07.768277Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:07.768280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:07.768284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:07.768287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:07.768318Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:07.768331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:07.768343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:07.768411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.768419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.768422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.768426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:07.768429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:07.768502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:07.768511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.768526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.768542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.768565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:07.768589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896164960959379:8351], now have 1 active actors on pipe
2025-09-30T14:56:07.768601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896164960959189:2454], now have 1 active actors on pipe
2025-09-30T14:56:07.768608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896164871187967:3341]
2025-09-30T14:56:07.768610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896164871187967:3341]
2025-09-30T14:56:07.768612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896164871187967:3341]
2025-09-30T14:56:07.768624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:07.768638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:07.768642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:07.768646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:07.768648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:07.768655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:07.768658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:07.768695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896164871187967:3341]
2025-09-30T14:56:07.768712Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:07.768719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:07.768770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2109
2025-09-30T14:56:07.768828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2109
2025-09-30T14:56:07.768871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:07.768883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:07.768913Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4b4379e-2bd6318e-e22209f-f058bc49_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:07.768925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:07.768929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:07.768931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:07.768942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:07.768956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:07.768974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:07.769159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:07.769176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:07.769211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:07.769325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2110 partition: 0 MaxSeqNo: 42 sessionId: src_id|c4b4379e-2bd6318e-e22209f-f058bc49_0
2025-09-30T14:56:07.769727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ff8d9d2-3e99750b-46ed0705-ed56f2de_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c4b4379e-2bd6318e-e22209f-f058bc49_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:07.772759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b4379e-2bd6318e-e22209f-f058bc49_0] Write session: try to update token
2025-09-30T14:56:07.772780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b4379e-2bd6318e-e22209f-f058bc49_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:07.782635Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:07.782664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:07.782666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:07.782669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:07.782679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896164871187967:3341]
2025-09-30T14:56:07.782687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896164871187967:3341]
2025-09-30T14:56:07.782692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896164871187967:3341]
2025-09-30T14:56:07.782735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:07.782739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:07.782742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.782745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:07.782746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:07.782750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:07.782889Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:07.790691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2110 sessionId: src_id|c4b4379e-2bd6318e-e22209f-f058bc49_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:07.793776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:07.835340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896164960959393:8402]
2025-09-30T14:56:07.835589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2109, pipe: [1:7555896164960959393:8402]
2025-09-30T14:56:07.906161Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:07.906696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:07.906719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:07.906742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896164960959393:8402], now have 1 active actors on pipe
2025-09-30T14:56:07.907003Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:07.907047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:07.907065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:07.907148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2110 reason: error at write: Disconnected sessionId: src_id|c4b4379e-2bd6318e-e22209f-f058bc49_0
2025-09-30T14:56:07.907201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896164960959393:8402]
2025-09-30T14:56:07.907227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:07.907366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2110 sessionId: src_id|c4b4379e-2bd6318e-e22209f-f058bc49_0 is DEAD
2025-09-30T14:56:07.907546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b4379e-2bd6318e-e22209f-f058bc49_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:07.907557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b4379e-2bd6318e-e22209f-f058bc49_0] Write session will restart in 0.009730s
2025-09-30T14:56:07.907591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b4379e-2bd6318e-e22209f-f058bc49_0] Write session: Do CDS request
2025-09-30T14:56:07.907597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b4379e-2bd6318e-e22209f-f058bc49_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:07.918854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b4379e-2bd6318e-e22209f-f058bc49_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:07.918905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:07.918928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2111
2025-09-30T14:56:07.919081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2111 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:07.919122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2111 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:07.919131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2111 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:07.919137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:07.919608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2111 sessionId:  describe result for acl check
2025-09-30T14:56:07.919647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:07.919662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:07.919664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:07.919671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896164960959481:8346] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:07.920255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896164960959481:8346] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:07.923531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896164960959481:8346] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:07.924233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:07.926627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:07.926865Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:07.926879Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:07.926891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:07.926947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:07.926990Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896164871188170:3338]
2025-09-30T14:56:07.927027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896164960959481:8346] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:07.927049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896164960959481:8346] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:07.927053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896164960959481:8346] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:07.927064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2111 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:07.927644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:07.927949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:07.928031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:07.928434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:07.928521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:07.928528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:07.928529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:07.928531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:07.928533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:07.928534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:07.928535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:07.928537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:07.928538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:07.928539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:07.928540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.928541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.928542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.928544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:07.928545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:07.928550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:07.928561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:07.928564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:07.928568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:07.928571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:07.928575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:07.928579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:07.928583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:07.928588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:07.928592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:07.928597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.928601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.928606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.928610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:07.928614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:07.928622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:07.928630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:07.928635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:07.928640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:07.928645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:07.928650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:07.928655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:07.928659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:07.928664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:07.928669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:07.928672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:07.928677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:07.928682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:07.928686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:07.928690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:07.928695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:07.928699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:07.928716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:07.928726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:07.928731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:07.928735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.928743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.928747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.928754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.928758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.928762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.928766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:07.928770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:07.928774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:07.928779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:07.928822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:07.935045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:07.936294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:07.936313Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:07.936316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:07.936320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:07.936327Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2110 [2:7555896164871188170:3338]
2025-09-30T14:56:07.936348Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:07.936365Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:07.936369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:07.936371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:07.936374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:07.936391Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:07.936405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:07.936413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:07.936481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.936488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.936490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.936493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:07.936496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:07.936569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:07.936577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.936592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:07.936610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:07.936633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:07.936659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896164960959592:8346], now have 1 active actors on pipe
2025-09-30T14:56:07.936667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896164960959395:2454], now have 1 active actors on pipe
2025-09-30T14:56:07.936673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896164871188165:3338]
2025-09-30T14:56:07.936675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896164871188165:3338]
2025-09-30T14:56:07.936677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896164871188165:3338]
2025-09-30T14:56:07.936689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:07.936703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:07.936705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:07.936709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:07.936711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:07.936722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:07.936725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:07.936767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896164871188165:3338]
2025-09-30T14:56:07.936741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2110
2025-09-30T14:56:07.936779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:07.936791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2110
2025-09-30T14:56:07.936780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:07.936808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:07.936813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:07.936851Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|437a26e9-cc9c9899-2b783a4d-89d9731e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:07.936859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:07.936863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:07.936865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:07.936874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:07.936883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:07.936900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:07.937029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:07.937037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:07.937051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:07.937153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2111 partition: 0 MaxSeqNo: 42 sessionId: src_id|437a26e9-cc9c9899-2b783a4d-89d9731e_0
2025-09-30T14:56:07.937560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b4379e-2bd6318e-e22209f-f058bc49_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|437a26e9-cc9c9899-2b783a4d-89d9731e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:07.940642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|437a26e9-cc9c9899-2b783a4d-89d9731e_0] Write session: try to update token
2025-09-30T14:56:07.940664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|437a26e9-cc9c9899-2b783a4d-89d9731e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:07.951076Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:07.951099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:07.951101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:07.951104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:07.951115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896164871188165:3338]
2025-09-30T14:56:07.951119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896164871188165:3338]
2025-09-30T14:56:07.951124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896164871188165:3338]
2025-09-30T14:56:07.951170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:07.951178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:07.951182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:07.951342Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:07.953673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:07.953690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:07.953696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:07.960839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2111 sessionId: src_id|437a26e9-cc9c9899-2b783a4d-89d9731e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:07.963900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:08.007373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896169255926922:8402]
2025-09-30T14:56:08.007676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2110, pipe: [1:7555896169255926922:8402]
2025-09-30T14:56:08.074305Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:08.074808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:08.074823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:08.074844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896169255926922:8402], now have 1 active actors on pipe
2025-09-30T14:56:08.075077Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:08.075080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896169255926922:8402]
2025-09-30T14:56:08.075090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:08.075095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:08.075116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:08.075182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2111 reason: error at write: Disconnected sessionId: src_id|437a26e9-cc9c9899-2b783a4d-89d9731e_0
2025-09-30T14:56:08.075396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2111 sessionId: src_id|437a26e9-cc9c9899-2b783a4d-89d9731e_0 is DEAD
2025-09-30T14:56:08.075619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|437a26e9-cc9c9899-2b783a4d-89d9731e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:08.075630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|437a26e9-cc9c9899-2b783a4d-89d9731e_0] Write session will restart in 0.007808s
2025-09-30T14:56:08.075654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|437a26e9-cc9c9899-2b783a4d-89d9731e_0] Write session: Do CDS request
2025-09-30T14:56:08.075663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|437a26e9-cc9c9899-2b783a4d-89d9731e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:08.084789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|437a26e9-cc9c9899-2b783a4d-89d9731e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:08.084995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:08.085014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2112
2025-09-30T14:56:08.085143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2112 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:08.085175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2112 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:08.085185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2112 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:08.085189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:08.085688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2112 sessionId:  describe result for acl check
2025-09-30T14:56:08.085722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:08.085727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:08.085729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:08.085733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896169255926982:8328] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:08.086239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896169255926982:8328] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:08.088447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896169255926982:8328] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:08.091033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896169255926982:8328] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:08.091050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896169255926982:8328] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:08.091053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896169255926982:8328] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:08.091032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:08.091071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2112 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:08.093725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:08.093954Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:08.093975Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:08.093985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:08.094047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:08.094086Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896169166155700:3301]
2025-09-30T14:56:08.094735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:08.095064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:08.095107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:08.095443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:08.095522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:08.095530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:08.095531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:08.095532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:08.095533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:08.095535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:08.095536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:08.095537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:08.095539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:08.095540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:08.095541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.095543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.095544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.095545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:08.095546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:08.095552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:08.095563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:08.095568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:08.095572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:08.095576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:08.095581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:08.095585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:08.095589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:08.095593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:08.095598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:08.095602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.095606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.095610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.095614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:08.095619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:08.095628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:08.095637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:08.095643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:08.095648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:08.095652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:08.095657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:08.095661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:08.095667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:08.095672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:08.095678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:08.095683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:08.095688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:08.095693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:08.095699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:08.095703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:08.095708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:08.095711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:08.095715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:08.095723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:08.095728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:08.095732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.095736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.095741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.095746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.095751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.095756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.095761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:08.095766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:08.095770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:08.095775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:08.095821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:08.101918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:08.103172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:08.103192Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:08.103194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:08.103198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:08.103205Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2111 [2:7555896169166155700:3301]
2025-09-30T14:56:08.103221Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:08.103236Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:08.103239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:08.103259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:08.103261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:08.103277Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:08.103288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:08.103296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:08.103359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.103368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.103371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.103375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:08.103377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:08.103450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:08.103457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.103470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.103488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.103509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:08.103622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2111
2025-09-30T14:56:08.103533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896169255927127:8328], now have 1 active actors on pipe
2025-09-30T14:56:08.103542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896169255926933:2454], now have 1 active actors on pipe
2025-09-30T14:56:08.103548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896169166155694:3301]
2025-09-30T14:56:08.103551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896169166155694:3301]
2025-09-30T14:56:08.103553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896169166155694:3301]
2025-09-30T14:56:08.103568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:08.103580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:08.103587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:08.103591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:08.103594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:08.103596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:08.103600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:08.103638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896169166155694:3301]
2025-09-30T14:56:08.103640Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:08.103646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:08.103671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:08.103675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:08.103708Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9fe3ef15-db88a931-48c486e0-186ead2b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:08.103715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:08.103719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:08.103721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:08.103733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:08.103741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:08.103706Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2111
2025-09-30T14:56:08.103765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:08.104572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:08.104582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:08.104609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:08.104879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2112 partition: 0 MaxSeqNo: 42 sessionId: src_id|9fe3ef15-db88a931-48c486e0-186ead2b_0
2025-09-30T14:56:08.105232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|437a26e9-cc9c9899-2b783a4d-89d9731e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9fe3ef15-db88a931-48c486e0-186ead2b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:08.108091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe3ef15-db88a931-48c486e0-186ead2b_0] Write session: try to update token
2025-09-30T14:56:08.108111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe3ef15-db88a931-48c486e0-186ead2b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:08.117711Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:08.117730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:08.117733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:08.117735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:08.117746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896169166155694:3301]
2025-09-30T14:56:08.117753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896169166155694:3301]
2025-09-30T14:56:08.117759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896169166155694:3301]
2025-09-30T14:56:08.117805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:08.117814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.117817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:08.117816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:08.117823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:08.117828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:08.117954Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:08.124930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2112 sessionId: src_id|9fe3ef15-db88a931-48c486e0-186ead2b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:08.127820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:08.175327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896169255927149:8402]
2025-09-30T14:56:08.175579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2111, pipe: [1:7555896169255927149:8402]
2025-09-30T14:56:08.226005Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:08.226259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:08.226273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:08.226294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896169255927149:8402], now have 1 active actors on pipe
2025-09-30T14:56:08.226534Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:08.226554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896169255927149:8402]
2025-09-30T14:56:08.226557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:08.226561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:08.226601Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:08.226631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2112 reason: error at write: Disconnected sessionId: src_id|9fe3ef15-db88a931-48c486e0-186ead2b_0
2025-09-30T14:56:08.226833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2112 sessionId: src_id|9fe3ef15-db88a931-48c486e0-186ead2b_0 is DEAD
2025-09-30T14:56:08.226997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe3ef15-db88a931-48c486e0-186ead2b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:08.227010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe3ef15-db88a931-48c486e0-186ead2b_0] Write session will restart in 0.006137s
2025-09-30T14:56:08.227034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe3ef15-db88a931-48c486e0-186ead2b_0] Write session: Do CDS request
2025-09-30T14:56:08.227040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe3ef15-db88a931-48c486e0-186ead2b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:08.234827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe3ef15-db88a931-48c486e0-186ead2b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:08.234909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:08.234926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2113
2025-09-30T14:56:08.235077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2113 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:08.235119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2113 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:08.235130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2113 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:08.235135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:08.235598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2113 sessionId:  describe result for acl check
2025-09-30T14:56:08.235647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:08.235654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:08.235658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:08.235665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896169255927175:8317] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:08.236204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896169255927175:8317] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:08.238881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896169255927175:8317] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:08.241521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896169255927175:8317] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:08.241539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896169255927175:8317] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:08.241542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896169255927175:8317] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:08.241550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2113 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:08.242484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:08.244990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:08.245201Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:08.245211Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:08.245236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:08.245290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:08.245328Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896169166155898:3314]
2025-09-30T14:56:08.245951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:08.246271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:08.246308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:08.246606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:08.246682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:08.246688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:08.246689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:08.246690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:08.246692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:08.246693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:08.246695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:08.246697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:08.246698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:08.246699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:08.246700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.246702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.246702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.246704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:08.246705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:08.246711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:08.246722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:08.246726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:08.246730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:08.246735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:08.246740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:08.246744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:08.246748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:08.246752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:08.246757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:08.246761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.246765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.246769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.246772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:08.246774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:08.246783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:08.246788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:08.246793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:08.246796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:08.246799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:08.246803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:08.246806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:08.246809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:08.246813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:08.246816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:08.246819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:08.246823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:08.246826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:08.246830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:08.246832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:08.246836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:08.246838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:08.246842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:08.246844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:08.246847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:08.246850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.246855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.246858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.246861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.246864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.246867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.246870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:08.246873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:08.246876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:08.246879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:08.246920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:08.252723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:08.254015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:08.254030Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:08.254032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:08.254036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:08.254041Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2112 [2:7555896169166155898:3314]
2025-09-30T14:56:08.254053Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:08.254067Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:08.254069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:08.254071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:08.254073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:08.254086Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:08.254092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:08.254097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:08.254149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.254155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.254156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.254159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:08.254161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:08.254226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:08.254234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.254249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.254266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.254279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:08.254297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896169255927347:8317], now have 1 active actors on pipe
2025-09-30T14:56:08.254303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896169255927151:2454], now have 1 active actors on pipe
2025-09-30T14:56:08.254309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896169166155893:3314]
2025-09-30T14:56:08.254310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896169166155893:3314]
2025-09-30T14:56:08.254312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896169166155893:3314]
2025-09-30T14:56:08.254323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:08.254336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:08.254340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:08.254343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:08.254346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:08.254353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:08.254357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:08.254395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896169166155893:3314]
2025-09-30T14:56:08.254408Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:08.254395Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2112
2025-09-30T14:56:08.254439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:08.254399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2112
2025-09-30T14:56:08.254476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:08.254484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:08.254506Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5c1cd29-1f73e652-14929455-ee347f6a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:08.254519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:08.254527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:08.254530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:08.254542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:08.254556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:08.254576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:08.254717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:08.254725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:08.254738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:08.254859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2113 partition: 0 MaxSeqNo: 42 sessionId: src_id|e5c1cd29-1f73e652-14929455-ee347f6a_0
2025-09-30T14:56:08.255266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe3ef15-db88a931-48c486e0-186ead2b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e5c1cd29-1f73e652-14929455-ee347f6a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:08.258063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5c1cd29-1f73e652-14929455-ee347f6a_0] Write session: try to update token
2025-09-30T14:56:08.258086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5c1cd29-1f73e652-14929455-ee347f6a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:08.273253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2113 sessionId: src_id|e5c1cd29-1f73e652-14929455-ee347f6a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:08.273762Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:08.273784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:08.273795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896169166155893:3314]
2025-09-30T14:56:08.273845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:08.273860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:08.274039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:08.274204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:08.274367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:08.274535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:08.274763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:08.274806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:08.276158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:08.276348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:08.276366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:08.276398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:08.276489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:08.279009Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:08.279023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:08.279026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:08.279028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:08.279035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896169166155893:3314]
2025-09-30T14:56:08.279039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896169166155893:3314]
2025-09-30T14:56:08.279042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896169166155893:3314]
2025-09-30T14:56:08.279071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:08.279080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.279082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:08.279090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:08.279103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:08.279108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:08.279229Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:08.326890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896169255927361:8402]
2025-09-30T14:56:08.327333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2112, pipe: [1:7555896169255927361:8402]
2025-09-30T14:56:08.391811Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:08.400954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:08.400995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:08.401212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:08.401296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:08.401379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:08.401465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:08.401517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:08.401527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:08.401610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:08.401693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:08.401771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:08.401852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:08.401904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:08.401911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:08.401993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:08.402067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:08.402147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:08.402228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:08.402280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:08.402288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:08.402372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:08.402452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:08.402525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:08.402598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:08.402656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:08.402664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:08.402747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:08.402823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:08.402896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:08.402971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:08.403043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:08.403050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:08.403127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:08.403197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:08.403352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:08.403471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:08.403533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:08.403543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:08.403664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:08.403739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:08.403813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:08.403892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:08.403946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:08.403954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:08.404034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:08.404106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:08.404181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:08.404261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:08.404314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:08.404321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:08.404401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:08.404474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:08.404549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:08.404626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:08.404683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:08.404691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:08.404770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:08.404843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:08.404917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:08.404994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:08.405046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:08.405053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:08.405127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896169255927361:8402], now have 1 active actors on pipe
2025-09-30T14:56:08.405394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:08.405425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896169255927361:8402]
2025-09-30T14:56:08.405455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:08.405458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:08.405498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2113 reason: error at write: Disconnected sessionId: src_id|e5c1cd29-1f73e652-14929455-ee347f6a_0
2025-09-30T14:56:08.405700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2113 sessionId: src_id|e5c1cd29-1f73e652-14929455-ee347f6a_0 is DEAD
2025-09-30T14:56:08.405874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5c1cd29-1f73e652-14929455-ee347f6a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:08.405886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5c1cd29-1f73e652-14929455-ee347f6a_0] Write session will restart in 0.005603s
2025-09-30T14:56:08.405911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5c1cd29-1f73e652-14929455-ee347f6a_0] Write session: Do CDS request
2025-09-30T14:56:08.405917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5c1cd29-1f73e652-14929455-ee347f6a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:08.406480Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:08.412757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5c1cd29-1f73e652-14929455-ee347f6a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:08.412886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:08.412903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2114
2025-09-30T14:56:08.413031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2114 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:08.413064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2114 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:08.413074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2114 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:08.413078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:08.413525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2114 sessionId:  describe result for acl check
2025-09-30T14:56:08.413566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:08.413574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:08.413576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:08.413583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896169255927381:8306] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:08.414132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896169255927381:8306] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:08.416863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896169255927381:8306] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:08.420374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896169255927381:8306] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:08.420390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896169255927381:8306] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:08.420393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896169255927381:8306] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:08.420401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2114 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:08.421853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:08.424288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:08.424530Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:08.424541Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:08.424553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:08.424610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:08.424653Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896169166156097:3312]
2025-09-30T14:56:08.425316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:08.425643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:08.425689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:08.426038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:08.426118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:08.426124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:08.426125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:08.426126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:08.426128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:08.426129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:08.426131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:08.426132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:08.426133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:08.426135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:08.426136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.426137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.426138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.426139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:08.426141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:08.426146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:08.426157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:08.426162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:08.426166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:08.426170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:08.426175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:08.426179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:08.426183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:08.426187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:08.426191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:08.426196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.426200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.426204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.426208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:08.426212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:08.426220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:08.426228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:08.426235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:08.426246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:08.426251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:08.426261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:08.426266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:08.426276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:08.426281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:08.426287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:08.426292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:08.426297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:08.426302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:08.426312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:08.426317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:08.426327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:08.426332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:08.426342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:08.426346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:08.426352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:08.426361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.426368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.426375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.426384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.426389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.426399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.426404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:08.426413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:08.426418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:08.426428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:08.426474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:08.432296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:08.433607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:08.433623Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:08.433626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:08.433629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:08.433634Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2113 [2:7555896169166156097:3312]
2025-09-30T14:56:08.433647Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:08.433661Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:08.433664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:08.433666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:08.433668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:08.433681Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:08.433686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:08.433691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:08.433740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.433745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.433747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.433749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:08.433751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:08.433807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:08.433813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.433823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.433834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.433844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:08.433863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896169166156092:3312]
2025-09-30T14:56:08.433871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896169166156092:3312]
2025-09-30T14:56:08.433872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896169166156092:3312]
2025-09-30T14:56:08.433888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:08.433908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896169255927364:2454], now have 1 active actors on pipe
2025-09-30T14:56:08.433919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896169255927557:8306], now have 1 active actors on pipe
2025-09-30T14:56:08.433924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:08.433925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:08.433929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:08.433936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:08.433941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:08.433944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:08.433975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896169166156092:3312]
2025-09-30T14:56:08.433984Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:08.433990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:08.434005Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2113
2025-09-30T14:56:08.434006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2113
2025-09-30T14:56:08.434121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:08.434135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:08.434170Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b07d4a27-5ebfc96b-12b2b617-78e09b2e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:08.434186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:08.434195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:08.434197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:08.434211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:08.434226Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:08.434248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:08.434380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:08.434389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:08.434401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:08.434520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2114 partition: 0 MaxSeqNo: 42 sessionId: src_id|b07d4a27-5ebfc96b-12b2b617-78e09b2e_0
2025-09-30T14:56:08.434872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5c1cd29-1f73e652-14929455-ee347f6a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b07d4a27-5ebfc96b-12b2b617-78e09b2e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:08.437769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b07d4a27-5ebfc96b-12b2b617-78e09b2e_0] Write session: try to update token
2025-09-30T14:56:08.437789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b07d4a27-5ebfc96b-12b2b617-78e09b2e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:08.447469Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:08.447493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:08.447496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:08.447498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:08.447510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896169166156092:3312]
2025-09-30T14:56:08.447535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896169166156092:3312]
2025-09-30T14:56:08.447542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896169166156092:3312]
2025-09-30T14:56:08.447597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:08.447598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:08.447606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:08.447608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:08.447613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.447617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:08.447849Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:08.453016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2114 sessionId: src_id|b07d4a27-5ebfc96b-12b2b617-78e09b2e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:08.456016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:08.505550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896169255927572:8402]
2025-09-30T14:56:08.505856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2113, pipe: [1:7555896169255927572:8402]
2025-09-30T14:56:08.560597Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:08.560930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:08.560948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:08.560988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896169255927572:8402], now have 1 active actors on pipe
2025-09-30T14:56:08.561236Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:08.561227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:08.561263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:08.561267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:08.561301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896169255927572:8402]
2025-09-30T14:56:08.561415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2114 reason: error at write: Disconnected sessionId: src_id|b07d4a27-5ebfc96b-12b2b617-78e09b2e_0
2025-09-30T14:56:08.561607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2114 sessionId: src_id|b07d4a27-5ebfc96b-12b2b617-78e09b2e_0 is DEAD
2025-09-30T14:56:08.561816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b07d4a27-5ebfc96b-12b2b617-78e09b2e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:08.561828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b07d4a27-5ebfc96b-12b2b617-78e09b2e_0] Write session will restart in 0.007181s
2025-09-30T14:56:08.561853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b07d4a27-5ebfc96b-12b2b617-78e09b2e_0] Write session: Do CDS request
2025-09-30T14:56:08.561862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b07d4a27-5ebfc96b-12b2b617-78e09b2e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:08.569829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b07d4a27-5ebfc96b-12b2b617-78e09b2e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:08.570009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:08.570027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2115
2025-09-30T14:56:08.570159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2115 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:08.570192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2115 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:08.570203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2115 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:08.570207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:08.570689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2115 sessionId:  describe result for acl check
2025-09-30T14:56:08.570729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:08.570737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:08.570738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:08.570745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896169255927598:8303] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:08.571307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896169255927598:8303] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:08.573720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896169255927598:8303] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:08.576412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896169255927598:8303] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:08.576427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896169255927598:8303] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:08.576430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896169255927598:8303] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:08.576440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2115 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:08.577489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:08.579916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:08.580144Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:08.580154Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:08.580166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:08.580218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:08.580263Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896169166156299:3309]
2025-09-30T14:56:08.580933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:08.581270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:08.581316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:08.581664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:08.581734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:08.581740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:08.581742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:08.581743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:08.581744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:08.581746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:08.581747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:08.581748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:08.581750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:08.581752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:08.581753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.581754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.581755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.581757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:08.581758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:08.581764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:08.581774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:08.581779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:08.581783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:08.581787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:08.581791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:08.581795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:08.581800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:08.581805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:08.581809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:08.581813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.581817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.581821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.581825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:08.581830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:08.581837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:08.581845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:08.581852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:08.581857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:08.581862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:08.581868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:08.581873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:08.581879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:08.581884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:08.581890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:08.581900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:08.581905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:08.581915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:08.581921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:08.581930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:08.581936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:08.581950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:08.581956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:08.581961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:08.581966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:08.581971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.581977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.581982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.581988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.581992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.581999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.582004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:08.582009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:08.582015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:08.582020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:08.582067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:08.587718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:08.588651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:08.588669Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:08.588672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:08.588679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:08.588687Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2114 [2:7555896169166156299:3309]
2025-09-30T14:56:08.588706Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:08.588725Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:08.588733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:08.588736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:08.588739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:08.588755Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:08.588762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:08.588774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:08.588843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.588852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.588854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.588858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:08.588861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:08.588939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:08.588947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.588961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.588973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.588995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:08.589018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896169255927574:2454], now have 1 active actors on pipe
2025-09-30T14:56:08.589026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896169255927770:8303], now have 1 active actors on pipe
2025-09-30T14:56:08.589034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896169166156294:3309]
2025-09-30T14:56:08.589041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896169166156294:3309]
2025-09-30T14:56:08.589044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896169166156294:3309]
2025-09-30T14:56:08.589058Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:08.589073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:08.589077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:08.589077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:08.589079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:08.589093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:08.589104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:08.589142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896169166156294:3309]
2025-09-30T14:56:08.589155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:08.589148Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2114
2025-09-30T14:56:08.589193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2114
2025-09-30T14:56:08.589262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:08.589366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:08.589375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:08.589400Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39a0347a-cb79d8c4-f473b76a-ff9a7c2e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:08.589423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:08.589426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:08.589429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:08.589439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:08.589449Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:08.589469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:08.589663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:08.589672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:08.589686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:08.589809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2115 partition: 0 MaxSeqNo: 42 sessionId: src_id|39a0347a-cb79d8c4-f473b76a-ff9a7c2e_0
2025-09-30T14:56:08.590199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b07d4a27-5ebfc96b-12b2b617-78e09b2e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|39a0347a-cb79d8c4-f473b76a-ff9a7c2e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:08.593080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39a0347a-cb79d8c4-f473b76a-ff9a7c2e_0] Write session: try to update token
2025-09-30T14:56:08.593102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39a0347a-cb79d8c4-f473b76a-ff9a7c2e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:08.602250Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:08.602275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:08.602278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:08.602281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:08.602291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896169166156294:3309]
2025-09-30T14:56:08.602295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896169166156294:3309]
2025-09-30T14:56:08.602299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896169166156294:3309]
2025-09-30T14:56:08.602345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:08.602354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.602355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:08.602357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:08.602361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:08.602367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:08.602518Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:08.608814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2115 sessionId: src_id|39a0347a-cb79d8c4-f473b76a-ff9a7c2e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:08.611971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:08.661729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896169255927785:8402]
2025-09-30T14:56:08.662025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2114, pipe: [1:7555896169255927785:8402]
2025-09-30T14:56:08.718320Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:08.718999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:08.719015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:08.719058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896169255927785:8402], now have 1 active actors on pipe
2025-09-30T14:56:08.719322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:08.719383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:08.719388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:08.719453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896169255927785:8402]
2025-09-30T14:56:08.719459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2115 reason: error at write: Disconnected sessionId: src_id|39a0347a-cb79d8c4-f473b76a-ff9a7c2e_0
2025-09-30T14:56:08.719541Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:08.719643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2115 sessionId: src_id|39a0347a-cb79d8c4-f473b76a-ff9a7c2e_0 is DEAD
2025-09-30T14:56:08.719791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39a0347a-cb79d8c4-f473b76a-ff9a7c2e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:08.719802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39a0347a-cb79d8c4-f473b76a-ff9a7c2e_0] Write session will restart in 0.005024s
2025-09-30T14:56:08.719837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39a0347a-cb79d8c4-f473b76a-ff9a7c2e_0] Write session: Do CDS request
2025-09-30T14:56:08.719843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39a0347a-cb79d8c4-f473b76a-ff9a7c2e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:08.725821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39a0347a-cb79d8c4-f473b76a-ff9a7c2e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:08.725928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:08.725947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2116
2025-09-30T14:56:08.726073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2116 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:08.726106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2116 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:08.726117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2116 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:08.726121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:08.726605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2116 sessionId:  describe result for acl check
2025-09-30T14:56:08.726637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:08.726644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:08.726647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:08.726652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896169255927800:8298] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:08.727185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896169255927800:8298] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:08.729934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896169255927800:8298] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:08.733709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896169255927800:8298] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:08.733730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896169255927800:8298] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:08.733734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896169255927800:8298] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:08.733743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2116 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:08.737224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:08.740054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:08.740274Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:08.740286Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:08.740299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:08.740360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:08.740402Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896169166156500:3303]
2025-09-30T14:56:08.741064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:08.741450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:08.741523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:08.741914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:08.741980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:08.741987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:08.741988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:08.741990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:08.741991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:08.741993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:08.741994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:08.741995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:08.741996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:08.741997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:08.741999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.742000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.742001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.742002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:08.742003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:08.742009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:08.742020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:08.742024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:08.742029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:08.742033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:08.742037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:08.742041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:08.742045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:08.742049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:08.742053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:08.742056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.742059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.742063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.742067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:08.742071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:08.742079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:08.742087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:08.742093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:08.742099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:08.742104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:08.742110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:08.742115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:08.742121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:08.742127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:08.742133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:08.742137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:08.742143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:08.742148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:08.742154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:08.742158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:08.742164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:08.742169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:08.742193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:08.742197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:08.742202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:08.742213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.742219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.742227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.742233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.742238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.742244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.742252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:08.742259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:08.742268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:08.742273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:08.742318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:08.748640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:08.749590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:08.749607Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:08.749611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:08.749616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:08.749624Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2115 [2:7555896169166156500:3303]
2025-09-30T14:56:08.749643Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:08.749662Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:08.749672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:08.749675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:08.749678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:08.749695Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:08.749703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:08.749711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:08.749780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.749789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.749791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.749796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:08.749799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:08.749883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:08.749891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.750035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.750053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.750075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:08.750057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2115
2025-09-30T14:56:08.750062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2115
2025-09-30T14:56:08.750100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896169255927938:8298], now have 1 active actors on pipe
2025-09-30T14:56:08.750109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896169255927787:2454], now have 1 active actors on pipe
2025-09-30T14:56:08.750116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896169166156495:3303]
2025-09-30T14:56:08.750119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896169166156495:3303]
2025-09-30T14:56:08.750122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896169166156495:3303]
2025-09-30T14:56:08.750140Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:08.750158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:08.750168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:08.750170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:08.750170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:08.750175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:08.750195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:08.750217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:08.750226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:08.750280Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c9a7deb-4d58f2f6-e994f268-dad0e333_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:08.750292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:08.750295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:08.750298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:08.750308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:08.750321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:08.750334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896169166156495:3303]
2025-09-30T14:56:08.750343Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:08.750353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:08.750370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:08.750528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:08.750536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:08.750550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:08.750688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2116 partition: 0 MaxSeqNo: 42 sessionId: src_id|7c9a7deb-4d58f2f6-e994f268-dad0e333_0
2025-09-30T14:56:08.751115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39a0347a-cb79d8c4-f473b76a-ff9a7c2e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7c9a7deb-4d58f2f6-e994f268-dad0e333_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:08.754291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c9a7deb-4d58f2f6-e994f268-dad0e333_0] Write session: try to update token
2025-09-30T14:56:08.754314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c9a7deb-4d58f2f6-e994f268-dad0e333_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:08.763811Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:08.763833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:08.763836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:08.763838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:08.763848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896169166156495:3303]
2025-09-30T14:56:08.763853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896169166156495:3303]
2025-09-30T14:56:08.763857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896169166156495:3303]
2025-09-30T14:56:08.763899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:08.763907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.763909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:08.763961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:08.763975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:08.763980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:08.764057Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:08.771980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2116 sessionId: src_id|7c9a7deb-4d58f2f6-e994f268-dad0e333_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:08.774996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:08.819423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896169255927997:8402]
2025-09-30T14:56:08.819751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2115, pipe: [1:7555896169255927997:8402]
2025-09-30T14:56:08.884190Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:08.884648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:08.884664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:08.884684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896169255927997:8402], now have 1 active actors on pipe
2025-09-30T14:56:08.884919Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:08.884976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896169255927997:8402]
2025-09-30T14:56:08.884997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:08.885006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:08.885069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2116 reason: error at write: Disconnected sessionId: src_id|7c9a7deb-4d58f2f6-e994f268-dad0e333_0
2025-09-30T14:56:08.885255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2116 sessionId: src_id|7c9a7deb-4d58f2f6-e994f268-dad0e333_0 is DEAD
2025-09-30T14:56:08.884929Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:08.885423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c9a7deb-4d58f2f6-e994f268-dad0e333_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:08.885435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c9a7deb-4d58f2f6-e994f268-dad0e333_0] Write session will restart in 0.008998s
2025-09-30T14:56:08.885477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c9a7deb-4d58f2f6-e994f268-dad0e333_0] Write session: Do CDS request
2025-09-30T14:56:08.885486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c9a7deb-4d58f2f6-e994f268-dad0e333_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:08.895831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c9a7deb-4d58f2f6-e994f268-dad0e333_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:08.895961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:08.895980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2117
2025-09-30T14:56:08.896131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2117 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:08.896180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2117 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:08.896191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2117 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:08.896199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:08.896748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2117 sessionId:  describe result for acl check
2025-09-30T14:56:08.896790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:08.896793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:08.896795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:08.896802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896169255928061:8286] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:08.897373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896169255928061:8286] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:08.900251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896169255928061:8286] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:08.903542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:08.903870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896169255928061:8286] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:08.903887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896169255928061:8286] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:08.903891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896169255928061:8286] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:08.903900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2117 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:08.906443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:08.906685Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:08.906695Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:08.906705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:08.906760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:08.906830Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896169166156716:3304]
2025-09-30T14:56:08.907531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:08.907998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:08.908064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:08.908672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:08.908760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:08.908768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:08.908770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:08.908771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:08.908773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:08.908774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:08.908775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:08.908777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:08.908778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:08.908779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:08.908781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.908782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.908783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.908784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:08.908786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:08.908793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:08.908804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:08.908808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:08.908813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:08.908818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:08.908823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:08.908828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:08.908832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:08.908837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:08.908842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:08.908846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.908851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.908855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.908859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:08.908863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:08.908871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:08.908880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:08.908887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:08.908894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:08.908899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:08.908906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:08.908910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:08.908917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:08.908923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:08.908930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:08.908935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:08.908941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:08.908949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:08.908961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:08.908966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:08.908977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:08.908984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:08.908990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:08.908995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:08.909002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:08.909013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.909021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.909030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.909036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.909048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.909054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.909064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:08.909070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:08.909076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:08.909086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:08.909140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:08.915417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:08.916636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:08.916653Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:08.916656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:08.916659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:08.916667Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2116 [2:7555896169166156716:3304]
2025-09-30T14:56:08.916686Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:08.916703Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:08.916706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:08.916709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:08.916711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:08.916728Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:08.916735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:08.916742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:08.916818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.916826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.916828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.916832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:08.916834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:08.916908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:08.916916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.916930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:08.916947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:08.916967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:08.916991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896169255927999:2454], now have 1 active actors on pipe
2025-09-30T14:56:08.917000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896169255928200:8286], now have 1 active actors on pipe
2025-09-30T14:56:08.917008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896169166156710:3304]
2025-09-30T14:56:08.917010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896169166156710:3304]
2025-09-30T14:56:08.917013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896169166156710:3304]
2025-09-30T14:56:08.917029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:08.917045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:08.917049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:08.917057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:08.917061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:08.917064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:08.917067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:08.917106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896169166156710:3304]
2025-09-30T14:56:08.917119Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:08.917141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2116
2025-09-30T14:56:08.917142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2116
2025-09-30T14:56:08.917149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:08.917243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:08.917248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:08.917278Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2cb6327-6a3e05f2-6be6f072-8d9ebf55_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:08.917285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:08.917290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:08.917292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:08.917304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:08.917312Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:08.917327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:08.917490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:08.917500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:08.917513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:08.917589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2117 partition: 0 MaxSeqNo: 42 sessionId: src_id|b2cb6327-6a3e05f2-6be6f072-8d9ebf55_0
2025-09-30T14:56:08.918004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c9a7deb-4d58f2f6-e994f268-dad0e333_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b2cb6327-6a3e05f2-6be6f072-8d9ebf55_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:08.921283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2cb6327-6a3e05f2-6be6f072-8d9ebf55_0] Write session: try to update token
2025-09-30T14:56:08.921312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2cb6327-6a3e05f2-6be6f072-8d9ebf55_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:08.931044Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:08.931069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:08.931072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:08.931078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:08.931089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896169166156710:3304]
2025-09-30T14:56:08.931093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896169166156710:3304]
2025-09-30T14:56:08.931097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896169166156710:3304]
2025-09-30T14:56:08.931140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:08.931146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:08.931150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:08.931152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:08.931160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:08.931165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:08.931356Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:08.939717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2117 sessionId: src_id|b2cb6327-6a3e05f2-6be6f072-8d9ebf55_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:08.942816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:08.985294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896169255928223:8402]
2025-09-30T14:56:08.985859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2116, pipe: [1:7555896169255928223:8402]
2025-09-30T14:56:09.053893Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:09.054368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:09.054385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:09.054407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896169255928223:8402], now have 1 active actors on pipe
2025-09-30T14:56:09.054714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896169255928223:8402]
2025-09-30T14:56:09.054752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:09.054794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:09.054798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:09.054866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2117 reason: error at write: Disconnected sessionId: src_id|b2cb6327-6a3e05f2-6be6f072-8d9ebf55_0
2025-09-30T14:56:09.055076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2117 sessionId: src_id|b2cb6327-6a3e05f2-6be6f072-8d9ebf55_0 is DEAD
2025-09-30T14:56:09.055291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2cb6327-6a3e05f2-6be6f072-8d9ebf55_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:09.055305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2cb6327-6a3e05f2-6be6f072-8d9ebf55_0] Write session will restart in 0.009437s
2025-09-30T14:56:09.055349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2cb6327-6a3e05f2-6be6f072-8d9ebf55_0] Write session: Do CDS request
2025-09-30T14:56:09.055356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2cb6327-6a3e05f2-6be6f072-8d9ebf55_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:09.055325Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:09.065875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2cb6327-6a3e05f2-6be6f072-8d9ebf55_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:09.066020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:09.066037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2118
2025-09-30T14:56:09.066158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2118 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:09.066193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2118 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:09.066203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2118 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:09.066207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:09.066809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2118 sessionId:  describe result for acl check
2025-09-30T14:56:09.066848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:09.066857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:09.066860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:09.066876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896173550895594:8273] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:09.067469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896173550895594:8273] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:09.070611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896173550895594:8273] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:09.074120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896173550895594:8273] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:09.074138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896173550895594:8273] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:09.074141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896173550895594:8273] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:09.074149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2118 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:09.074129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:09.077233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:09.077499Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:09.077509Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:09.077523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:09.077603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:09.077645Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896173461124229:3272]
2025-09-30T14:56:09.078350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:09.078767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:09.078829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:09.079200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:09.079283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:09.079289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:09.079290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:09.079292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:09.079293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:09.079294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:09.079295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:09.079297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:09.079298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:09.079299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:09.079300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.079302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.079303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.079304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:09.079305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:09.079310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:09.079320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:09.079323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:09.079327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:09.079330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:09.079334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:09.079337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:09.079341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:09.079345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:09.079350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:09.079354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.079358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.079362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.079366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:09.079369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:09.079377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:09.079384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:09.079390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:09.079396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:09.079401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:09.079407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:09.079411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:09.079417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:09.079421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:09.079427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:09.079431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:09.079437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:09.079442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:09.079447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:09.079451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:09.079456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:09.079465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:09.079482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:09.079487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:09.079508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:09.079513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.079519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.079523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.079529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.079533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.079539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.079543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:09.079548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:09.079556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:09.079561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:09.079604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:09.086046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:09.087276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:09.087295Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:09.087298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:09.087302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:09.087310Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2117 [2:7555896173461124229:3272]
2025-09-30T14:56:09.087329Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:09.087347Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:09.087358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:09.087362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:09.087364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:09.087382Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:09.087389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:09.087396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:09.087459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.087467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.087469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.087472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:09.087474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:09.087546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:09.087553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.087568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.087580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.087598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:09.087623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896173550895534:2454], now have 1 active actors on pipe
2025-09-30T14:56:09.087630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896173550895733:8273], now have 1 active actors on pipe
2025-09-30T14:56:09.087636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896173461124223:3272]
2025-09-30T14:56:09.087638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896173461124223:3272]
2025-09-30T14:56:09.087639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896173461124223:3272]
2025-09-30T14:56:09.087652Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:09.087665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:09.087670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:09.087673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:09.087676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:09.087683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:09.087687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:09.087722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896173461124223:3272]
2025-09-30T14:56:09.087730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:09.087733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:09.087806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:09.087816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:09.087703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2117
2025-09-30T14:56:09.087839Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3cf0f69-2f37828b-9afb0ff8-30f221cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:09.087850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:09.087853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:09.087756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2117
2025-09-30T14:56:09.087855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:09.087866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:09.087880Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:09.087898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:09.088104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2118 partition: 0 MaxSeqNo: 42 sessionId: src_id|b3cf0f69-2f37828b-9afb0ff8-30f221cc_0
2025-09-30T14:56:09.088017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:09.088025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:09.088039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:09.088475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2cb6327-6a3e05f2-6be6f072-8d9ebf55_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b3cf0f69-2f37828b-9afb0ff8-30f221cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:09.091401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3cf0f69-2f37828b-9afb0ff8-30f221cc_0] Write session: try to update token
2025-09-30T14:56:09.091418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3cf0f69-2f37828b-9afb0ff8-30f221cc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:09.105216Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:09.105235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:09.105246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896173461124223:3272]
2025-09-30T14:56:09.105293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:09.105293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:09.105520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:09.105702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:09.105869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:09.106029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:09.106303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:09.106348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:09.109283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2118 sessionId: src_id|b3cf0f69-2f37828b-9afb0ff8-30f221cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:09.112362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:09.112623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:09.112651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:09.112704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:09.112826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:09.116428Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:09.116450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:09.116453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:09.116457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:09.116468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896173461124223:3272]
2025-09-30T14:56:09.116472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896173461124223:3272]
2025-09-30T14:56:09.116479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896173461124223:3272]
2025-09-30T14:56:09.116517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:09.116529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.116532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:09.116542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:09.116549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:09.116554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:09.116694Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:09.155291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896173550895759:8402]
2025-09-30T14:56:09.155526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2117, pipe: [1:7555896173550895759:8402]
2025-09-30T14:56:09.230955Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:09.239717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:09.239747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:09.239945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:09.240024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:09.240094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:09.240173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:09.240683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:09.240694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:09.240759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:09.240834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:09.240909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:09.240984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:09.241034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:09.241043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:09.241117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:09.241187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:09.241264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:09.241378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:09.241438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:09.241447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:09.241522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:09.241595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:09.241669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:09.241747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:09.241800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:09.241808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:09.241889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:09.241966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:09.242043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:09.242121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:09.242181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:09.242188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:09.242269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:09.242347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:09.242429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:09.242502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:09.242549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:09.242555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:09.242624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:09.242693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:09.242783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:09.242856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:09.242906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:09.242908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:09.242979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:09.243050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:09.243114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:09.243178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:09.243221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:09.243224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:09.243382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:09.244897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3cf0f69-2f37828b-9afb0ff8-30f221cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:09.244910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3cf0f69-2f37828b-9afb0ff8-30f221cc_0] Write session will restart in 0.005505s
2025-09-30T14:56:09.244936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3cf0f69-2f37828b-9afb0ff8-30f221cc_0] Write session: Do CDS request
2025-09-30T14:56:09.244373Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:09.244944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3cf0f69-2f37828b-9afb0ff8-30f221cc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:09.244418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896173550895759:8402]
2025-09-30T14:56:09.244447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:09.244450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:09.244485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2118 reason: error at write: Disconnected sessionId: src_id|b3cf0f69-2f37828b-9afb0ff8-30f221cc_0
2025-09-30T14:56:09.244705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2118 sessionId: src_id|b3cf0f69-2f37828b-9afb0ff8-30f221cc_0 is DEAD
2025-09-30T14:56:09.243458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:09.243541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:09.243614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:09.243664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:09.243667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:09.243747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:09.243815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:09.243886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:09.243960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:09.244012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:09.244018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:09.244096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896173550895759:8402], now have 1 active actors on pipe
2025-09-30T14:56:09.244918Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:09.252517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3cf0f69-2f37828b-9afb0ff8-30f221cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:09.252633Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:09.252652Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2119
2025-09-30T14:56:09.252786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2119 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:09.252818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2119 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:09.252825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2119 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:09.252833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:09.253284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2119 sessionId:  describe result for acl check
2025-09-30T14:56:09.253315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:09.253324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:09.253326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:09.253331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896173550895783:8268] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:09.253872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896173550895783:8268] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:09.257855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896173550895783:8268] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:09.262933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896173550895783:8268] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:09.262959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896173550895783:8268] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:09.262963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896173550895783:8268] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:09.262974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2119 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:09.266720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:09.269740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:09.269990Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:09.270003Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:09.270015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:09.270083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:09.270131Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896173461124458:3245]
2025-09-30T14:56:09.270813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:09.271161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:09.271217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:09.271574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:09.271661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:09.271669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:09.271670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:09.271671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:09.271672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:09.271673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:09.271674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:09.271676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:09.271696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:09.271697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:09.271698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.271700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.271700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.271702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:09.271703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:09.271709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:09.271719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:09.271723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:09.271727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:09.271730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:09.271733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:09.271737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:09.271740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:09.271743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:09.271747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:09.271751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.271754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.271757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.271761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:09.271764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:09.271772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:09.271780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:09.271787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:09.271792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:09.271796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:09.271800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:09.271806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:09.271811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:09.271816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:09.271821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:09.271825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:09.271830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:09.271835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:09.271840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:09.271844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:09.271849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:09.271854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:09.271859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:09.271863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:09.271867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:09.271872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.271878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.271882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.271887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.271891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.271896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.271900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:09.271905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:09.271910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:09.271914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:09.271960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:09.278040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:09.279110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:09.279129Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:09.279132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:09.279136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:09.279144Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2118 [2:7555896173461124458:3245]
2025-09-30T14:56:09.279164Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:09.279183Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:09.279191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:09.279195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:09.279197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:09.279215Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:09.279224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:09.279232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:09.279329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.279340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.279343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.279347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:09.279350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:09.279429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:09.279438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.279452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.279469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.279491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:09.279519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896173550895768:2454], now have 1 active actors on pipe
2025-09-30T14:56:09.279523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896173550895935:8268], now have 1 active actors on pipe
2025-09-30T14:56:09.279530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896173461124453:3245]
2025-09-30T14:56:09.279532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896173461124453:3245]
2025-09-30T14:56:09.279534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896173461124453:3245]
2025-09-30T14:56:09.279550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:09.279569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:09.279585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:09.279589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:09.279608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:09.279613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:09.279615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:09.279631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896173461124453:3245]
2025-09-30T14:56:09.279635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:09.279637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:09.280528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2118
2025-09-30T14:56:09.280577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2118
2025-09-30T14:56:09.280644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:09.280659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:09.280687Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ff7b9fc-52b47336-a5ef62d4-fc71c71_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:09.280710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:09.280719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:09.280721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:09.280734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:09.280753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:09.280783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:09.281177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:09.281191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:09.281215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:09.281321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2119 partition: 0 MaxSeqNo: 42 sessionId: src_id|5ff7b9fc-52b47336-a5ef62d4-fc71c71_0
2025-09-30T14:56:09.281763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3cf0f69-2f37828b-9afb0ff8-30f221cc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5ff7b9fc-52b47336-a5ef62d4-fc71c71_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:09.284719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ff7b9fc-52b47336-a5ef62d4-fc71c71_0] Write session: try to update token
2025-09-30T14:56:09.284745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ff7b9fc-52b47336-a5ef62d4-fc71c71_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:09.293421Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:09.293444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:09.293456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896173461124453:3245]
2025-09-30T14:56:09.293508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:09.293523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:09.293803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:09.293973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:09.294134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:09.294331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:09.294539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:09.294593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:09.304669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2119 sessionId: src_id|5ff7b9fc-52b47336-a5ef62d4-fc71c71_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:09.304811Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:09.304832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:09.304835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:09.304837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:09.304847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896173461124453:3245]
2025-09-30T14:56:09.304852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896173461124453:3245]
2025-09-30T14:56:09.304856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896173461124453:3245]
2025-09-30T14:56:09.304902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:09.304910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.304913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:09.305070Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:09.305172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:09.305188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:09.305192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:09.307745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:09.344722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896173550895981:8402]
2025-09-30T14:56:09.345155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2118, pipe: [1:7555896173550895981:8402]
2025-09-30T14:56:09.427936Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:09.428531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:09.428543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:09.428567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896173550895981:8402], now have 1 active actors on pipe
2025-09-30T14:56:09.429495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:09.429563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896173550895981:8402]
2025-09-30T14:56:09.429584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:09.429588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:09.429654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2119 reason: error at write: Disconnected sessionId: src_id|5ff7b9fc-52b47336-a5ef62d4-fc71c71_0
2025-09-30T14:56:09.429842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2119 sessionId: src_id|5ff7b9fc-52b47336-a5ef62d4-fc71c71_0 is DEAD
2025-09-30T14:56:09.430383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ff7b9fc-52b47336-a5ef62d4-fc71c71_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:09.430392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ff7b9fc-52b47336-a5ef62d4-fc71c71_0] Write session will restart in 0.009618s
2025-09-30T14:56:09.429570Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:09.430411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ff7b9fc-52b47336-a5ef62d4-fc71c71_0] Write session: Do CDS request
2025-09-30T14:56:09.430421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ff7b9fc-52b47336-a5ef62d4-fc71c71_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:09.440799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ff7b9fc-52b47336-a5ef62d4-fc71c71_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:09.440936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:09.440955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2120
2025-09-30T14:56:09.441144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2120 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:09.441193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2120 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:09.441220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2120 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:09.441226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:09.441679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2120 sessionId:  describe result for acl check
2025-09-30T14:56:09.441715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:09.441723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:09.441738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:09.441745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896173550896000:8262] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:09.442272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896173550896000:8262] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:09.444522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896173550896000:8262] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:09.449814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896173550896000:8262] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:09.449833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896173550896000:8262] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:09.449837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896173550896000:8262] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:09.449847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2120 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:09.455081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:09.458041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:09.458280Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:09.458290Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:09.458302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:09.458360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:09.458404Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896173461124666:3257]
2025-09-30T14:56:09.459094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:09.459542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:09.459599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:09.459959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:09.460028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:09.460035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:09.460036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:09.460037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:09.460039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:09.460040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:09.460041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:09.460042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:09.460043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:09.460045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:09.460046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.460047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.460048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.460050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:09.460051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:09.460056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:09.460068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:09.460073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:09.460077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:09.460081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:09.460085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:09.460089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:09.460093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:09.460097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:09.460102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:09.460106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.460111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.460114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.460119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:09.460123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:09.460131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:09.460140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:09.460146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:09.460152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:09.460157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:09.460162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:09.460167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:09.460173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:09.460178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:09.460183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:09.460188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:09.460193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:09.460199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:09.460204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:09.460209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:09.460214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:09.460221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:09.460227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:09.460232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:09.460238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:09.460243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.460250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.460288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.460293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.460298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.460304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.460309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:09.460315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:09.460319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:09.460325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:09.460374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:09.467109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:09.468206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:09.468228Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:09.468231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:09.468235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:09.468243Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2119 [2:7555896173461124666:3257]
2025-09-30T14:56:09.468262Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:09.468292Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:09.468301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:09.468305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:09.468307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:09.468325Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:09.468333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:09.468348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:09.468417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.468428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.468430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.468434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:09.468436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:09.468517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:09.468525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.468541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.468558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.468580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:09.468600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896173461124661:3257]
2025-09-30T14:56:09.468607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896173461124661:3257]
2025-09-30T14:56:09.468610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896173461124661:3257]
2025-09-30T14:56:09.468621Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:09.468641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:09.468644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:09.468648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:09.468651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:09.468661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:09.468665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:09.468675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896173550896097:8262], now have 1 active actors on pipe
2025-09-30T14:56:09.468679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896173550895984:2454], now have 1 active actors on pipe
2025-09-30T14:56:09.468719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896173461124661:3257]
2025-09-30T14:56:09.468731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:09.468747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:09.468749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2119
2025-09-30T14:56:09.468799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2119
2025-09-30T14:56:09.469077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:09.469089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:09.469121Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9f83baf-342114e8-4df9fe84-68bf49c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:09.469134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:09.469143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:09.469146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:09.469156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:09.469170Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:09.469191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:09.469564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2120 partition: 0 MaxSeqNo: 42 sessionId: src_id|e9f83baf-342114e8-4df9fe84-68bf49c3_0
2025-09-30T14:56:09.469389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:09.469412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:09.469435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:09.472950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ff7b9fc-52b47336-a5ef62d4-fc71c71_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e9f83baf-342114e8-4df9fe84-68bf49c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:09.475940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9f83baf-342114e8-4df9fe84-68bf49c3_0] Write session: try to update token
2025-09-30T14:56:09.475962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9f83baf-342114e8-4df9fe84-68bf49c3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:09.482902Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:09.482924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:09.482926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:09.482929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:09.482938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896173461124661:3257]
2025-09-30T14:56:09.482943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896173461124661:3257]
2025-09-30T14:56:09.482947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896173461124661:3257]
2025-09-30T14:56:09.482990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:09.482996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.482999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:09.482998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:09.483004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:09.483011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:09.483141Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:09.492375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2120 sessionId: src_id|e9f83baf-342114e8-4df9fe84-68bf49c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:09.495381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:09.529570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896173550896198:8402]
2025-09-30T14:56:09.529907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2119, pipe: [1:7555896173550896198:8402]
2025-09-30T14:56:09.597181Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:09.597728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:09.597742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:09.597763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896173550896198:8402], now have 1 active actors on pipe
2025-09-30T14:56:09.598010Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:09.598098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896173550896198:8402]
2025-09-30T14:56:09.598139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:09.598232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2120 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e9f83baf-342114e8-4df9fe84-68bf49c3_0
2025-09-30T14:56:09.598254Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:09.598410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2120 sessionId: src_id|e9f83baf-342114e8-4df9fe84-68bf49c3_0 is DEAD
2025-09-30T14:56:09.598595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9f83baf-342114e8-4df9fe84-68bf49c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:09.598608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9f83baf-342114e8-4df9fe84-68bf49c3_0] Write session will restart in 0.005060s
2025-09-30T14:56:09.598643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9f83baf-342114e8-4df9fe84-68bf49c3_0] Write session: Do CDS request
2025-09-30T14:56:09.598649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9f83baf-342114e8-4df9fe84-68bf49c3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:09.604795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9f83baf-342114e8-4df9fe84-68bf49c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:09.604924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:09.604943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2121
2025-09-30T14:56:09.605087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2121 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:09.605127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2121 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:09.605137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2121 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:09.605142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:09.605638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2121 sessionId:  describe result for acl check
2025-09-30T14:56:09.605679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:09.605686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:09.605688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:09.605695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896173550896213:8259] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:09.606245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896173550896213:8259] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:09.608413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896173550896213:8259] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:09.612224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896173550896213:8259] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:09.612244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896173550896213:8259] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:09.612248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896173550896213:8259] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:09.612257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2121 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:09.616132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:09.618744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:09.618975Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:09.618986Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:09.618997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:09.619057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:09.619105Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896173461124873:3254]
2025-09-30T14:56:09.619812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:09.620195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:09.620256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:09.620628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:09.620702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:09.620711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:09.620712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:09.620713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:09.620715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:09.620717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:09.620718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:09.620719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:09.620721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:09.620722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:09.620723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.620725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.620726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.620727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:09.620728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:09.620735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:09.620748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:09.620752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:09.620757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:09.620761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:09.620765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:09.620770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:09.620773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:09.620778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:09.620783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:09.620787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.620791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.620796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.620800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:09.620804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:09.620811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:09.620820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:09.620826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:09.620831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:09.620837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:09.620842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:09.620846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:09.620852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:09.620858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:09.620864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:09.620869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:09.620875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:09.620880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:09.620886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:09.620891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:09.620898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:09.620903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:09.620909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:09.620914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:09.620920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:09.620925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.620930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.620935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.620940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.620954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.620960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.620964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:09.620971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:09.620976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:09.620995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:09.621040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:09.627070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:09.628177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:09.628203Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:09.628206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:09.628210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:09.628217Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2120 [2:7555896173461124873:3254]
2025-09-30T14:56:09.628237Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:09.628254Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:09.628258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:09.628261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:09.628263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:09.628280Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:09.628293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:09.628304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:09.628370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.628377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.628379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.628383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:09.628386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:09.628469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:09.628478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.628491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.628501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.628519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:09.628544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896173550896200:2454], now have 1 active actors on pipe
2025-09-30T14:56:09.628553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896173550896348:8259], now have 1 active actors on pipe
2025-09-30T14:56:09.628560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896173461124868:3254]
2025-09-30T14:56:09.628562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896173461124868:3254]
2025-09-30T14:56:09.628564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896173461124868:3254]
2025-09-30T14:56:09.628579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:09.628598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:09.628602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:09.628605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:09.628607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:09.628617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:09.628621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:09.628665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896173461124868:3254]
2025-09-30T14:56:09.628648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2120
2025-09-30T14:56:09.628679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:09.628656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2120
2025-09-30T14:56:09.628687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:09.628727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:09.628737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:09.628773Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5dd7a261-7fce03dc-34965efa-eae995fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:09.628785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:09.628789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:09.628792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:09.628802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:09.628815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:09.628834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:09.629118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:09.629130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:09.629160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:09.629265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2121 partition: 0 MaxSeqNo: 42 sessionId: src_id|5dd7a261-7fce03dc-34965efa-eae995fa_0
2025-09-30T14:56:09.629658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9f83baf-342114e8-4df9fe84-68bf49c3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5dd7a261-7fce03dc-34965efa-eae995fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:09.632837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd7a261-7fce03dc-34965efa-eae995fa_0] Write session: try to update token
2025-09-30T14:56:09.632863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd7a261-7fce03dc-34965efa-eae995fa_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:09.641738Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:09.641756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:09.641759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:09.641761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:09.641772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896173461124868:3254]
2025-09-30T14:56:09.641778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896173461124868:3254]
2025-09-30T14:56:09.641782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896173461124868:3254]
2025-09-30T14:56:09.641825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:09.641834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.641841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:09.641847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:09.641849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:09.641855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:09.641989Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:09.648998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2121 sessionId: src_id|5dd7a261-7fce03dc-34965efa-eae995fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:09.651972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:09.698504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896173550896417:8402]
2025-09-30T14:56:09.698851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2120, pipe: [1:7555896173550896417:8402]
2025-09-30T14:56:09.759047Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:09.759388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:09.759402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:09.759440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896173550896417:8402], now have 1 active actors on pipe
2025-09-30T14:56:09.759681Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:09.759737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896173550896417:8402]
2025-09-30T14:56:09.759785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:09.759795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:09.759879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2121 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5dd7a261-7fce03dc-34965efa-eae995fa_0
2025-09-30T14:56:09.760070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2121 sessionId: src_id|5dd7a261-7fce03dc-34965efa-eae995fa_0 is DEAD
2025-09-30T14:56:09.763345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd7a261-7fce03dc-34965efa-eae995fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:09.763360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd7a261-7fce03dc-34965efa-eae995fa_0] Write session will restart in 0.008464s
2025-09-30T14:56:09.763386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd7a261-7fce03dc-34965efa-eae995fa_0] Write session: Do CDS request
2025-09-30T14:56:09.763391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd7a261-7fce03dc-34965efa-eae995fa_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:09.775682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd7a261-7fce03dc-34965efa-eae995fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:09.779580Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:09.779606Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2122
2025-09-30T14:56:09.779763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2122 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:09.779792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2122 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:09.779797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2122 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:09.779802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:09.780243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2122 sessionId:  describe result for acl check
2025-09-30T14:56:09.780271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:09.780274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:09.780275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:09.780281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896173550896561:8255] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:09.780829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896173550896561:8255] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:09.786386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896173550896561:8255] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:09.784755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:09.788137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:09.788482Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:09.788496Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:09.788510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:09.788580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:09.788633Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896173461125092:3247]
2025-09-30T14:56:09.789433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:09.789809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:09.789866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:09.790267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:09.790345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:09.790352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:09.790353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:09.790355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:09.790357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:09.790358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:09.790360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:09.790362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:09.790364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:09.790365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:09.790367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.790368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.790370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.790371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:09.790372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:09.790380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:09.790392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:09.790396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:09.790400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:09.790408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:09.790412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:09.790416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:09.790420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:09.790423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:09.790427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:09.790431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.790435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.790439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.790442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:09.790446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:09.790456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:09.790466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:09.790473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:09.790480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:09.790485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:09.790491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:09.790497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:09.790503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:09.790508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:09.790513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:09.790518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:09.790523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:09.790528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:09.790536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:09.790541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:09.790547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:09.790554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:09.790559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:09.790565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:09.790571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:09.790577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.790583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.790589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.790594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.790600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.790611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.790616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:09.790622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:09.790629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:09.790635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:09.790688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:09.796334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896173550896561:8255] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:09.796354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896173550896561:8255] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:09.796358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896173550896561:8255] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:09.796368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2122 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:09.796843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:09.798263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:09.798279Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:09.798283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:09.798287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:09.798296Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2121 [2:7555896173461125092:3247]
2025-09-30T14:56:09.798316Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:09.798338Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:09.798348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:09.798351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:09.798354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:09.798375Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:09.798382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:09.798397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:09.798482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.798491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.798494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.798498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:09.798501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:09.798596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:09.798605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.798619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.798630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.798647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:09.798674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896173461125087:3247]
2025-09-30T14:56:09.798681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896173461125087:3247]
2025-09-30T14:56:09.798684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896173461125087:3247]
2025-09-30T14:56:09.798695Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:09.798708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:09.798713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:09.798715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:09.798720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896173550896629:8255], now have 1 active actors on pipe
2025-09-30T14:56:09.798724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896173550896419:2454], now have 1 active actors on pipe
2025-09-30T14:56:09.798734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:09.798750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:09.798758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:09.798768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2121
2025-09-30T14:56:09.798807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896173461125087:3247]
2025-09-30T14:56:09.798815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:09.798780Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2121
2025-09-30T14:56:09.798819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:09.798867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:09.798879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:09.798931Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|acb5034e-7c930258-3b295a2e-a221ada0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:09.798940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:09.798945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:09.798947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:09.798960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:09.798973Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:09.798998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:09.799194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:09.799211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:09.799233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:09.799372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2122 partition: 0 MaxSeqNo: 42 sessionId: src_id|acb5034e-7c930258-3b295a2e-a221ada0_0
2025-09-30T14:56:09.799751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd7a261-7fce03dc-34965efa-eae995fa_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|acb5034e-7c930258-3b295a2e-a221ada0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:09.802682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acb5034e-7c930258-3b295a2e-a221ada0_0] Write session: try to update token
2025-09-30T14:56:09.802702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acb5034e-7c930258-3b295a2e-a221ada0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:09.812639Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:09.812670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:09.812674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:09.812677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:09.812688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896173461125087:3247]
2025-09-30T14:56:09.812694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896173461125087:3247]
2025-09-30T14:56:09.812699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896173461125087:3247]
2025-09-30T14:56:09.812757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:09.812769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.812773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:09.812921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:09.812954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:09.812956Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:09.812960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:09.819239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2122 sessionId: src_id|acb5034e-7c930258-3b295a2e-a221ada0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:09.822592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:09.859852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896173550896636:8402]
2025-09-30T14:56:09.860200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2121, pipe: [1:7555896173550896636:8402]
2025-09-30T14:56:09.938397Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:09.938847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:09.938864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:09.938883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896173550896636:8402], now have 1 active actors on pipe
2025-09-30T14:56:09.939096Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:09.939135Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:09.939206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896173550896636:8402]
2025-09-30T14:56:09.939217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:09.939221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:09.939325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2122 reason: error at write: Disconnected sessionId: src_id|acb5034e-7c930258-3b295a2e-a221ada0_0
2025-09-30T14:56:09.939515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2122 sessionId: src_id|acb5034e-7c930258-3b295a2e-a221ada0_0 is DEAD
2025-09-30T14:56:09.939682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb5034e-7c930258-3b295a2e-a221ada0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:09.939691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb5034e-7c930258-3b295a2e-a221ada0_0] Write session will restart in 0.008739s
2025-09-30T14:56:09.939715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb5034e-7c930258-3b295a2e-a221ada0_0] Write session: Do CDS request
2025-09-30T14:56:09.939732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb5034e-7c930258-3b295a2e-a221ada0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:09.949834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acb5034e-7c930258-3b295a2e-a221ada0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:09.949945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:09.949964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2123
2025-09-30T14:56:09.950116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2123 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:09.950153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2123 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:09.950164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2123 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:09.950168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:09.950597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2123 sessionId:  describe result for acl check
2025-09-30T14:56:09.950633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:09.950635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:09.950637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:09.950643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896173550896674:8246] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:09.951201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896173550896674:8246] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:09.954199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896173550896674:8246] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:09.957862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896173550896674:8246] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:09.957878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896173550896674:8246] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:09.957882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896173550896674:8246] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:09.957890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2123 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:09.960376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:09.963267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:09.963490Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:09.963500Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:09.963511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:09.963589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:09.963635Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896173461125304:3249]
2025-09-30T14:56:09.964322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:09.964696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:09.964745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:09.965098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:09.965179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:09.965187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:09.965189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:09.965190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:09.965191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:09.965192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:09.965193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:09.965195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:09.965196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:09.965198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:09.965199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.965201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.965202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.965203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:09.965204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:09.965211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:09.965222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:09.965227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:09.965231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:09.965236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:09.965240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:09.965244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:09.965248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:09.965252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:09.965256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:09.965260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.965264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.965268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.965272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:09.965276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:09.965285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:09.965293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:09.965300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:09.965305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:09.965311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:09.965316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:09.965324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:09.965330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:09.965336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:09.965340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:09.965345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:09.965350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:09.965355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:09.965361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:09.965365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:09.965370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:09.965375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:09.965380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:09.965384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:09.965392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:09.965397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.965412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.965417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.965422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.965427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.965433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.965437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:09.965442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:09.965448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:09.965459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:09.965508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:09.971548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:09.972637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:09.972655Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:09.972659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:09.972663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:09.972671Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2122 [2:7555896173461125304:3249]
2025-09-30T14:56:09.972691Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:09.972708Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:09.972717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:09.972720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:09.972723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:09.972742Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:09.972753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:09.972761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:09.972834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.972841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.972844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.972848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:09.972850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:09.972933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:09.972940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.972955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:09.972972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:09.972994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:09.973019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896173550896650:2454], now have 1 active actors on pipe
2025-09-30T14:56:09.973027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896173550896841:8246], now have 1 active actors on pipe
2025-09-30T14:56:09.973033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896173461125299:3249]
2025-09-30T14:56:09.973036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896173461125299:3249]
2025-09-30T14:56:09.973038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896173461125299:3249]
2025-09-30T14:56:09.973052Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:09.973065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:09.973077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:09.973079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:09.973084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:09.973101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:09.973109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:09.973112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2122
2025-09-30T14:56:09.973115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2122
2025-09-30T14:56:09.973150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896173461125299:3249]
2025-09-30T14:56:09.973163Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:09.973170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:09.973189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:09.973194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:09.973245Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e03af648-5bb6feaa-90ed6696-f95da6f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:09.973259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:09.973263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:09.973265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:09.973276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:09.973291Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:09.973318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:09.973495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:09.973504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:09.973517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:09.973620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2123 partition: 0 MaxSeqNo: 42 sessionId: src_id|e03af648-5bb6feaa-90ed6696-f95da6f4_0
2025-09-30T14:56:09.974047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb5034e-7c930258-3b295a2e-a221ada0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e03af648-5bb6feaa-90ed6696-f95da6f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:09.976940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e03af648-5bb6feaa-90ed6696-f95da6f4_0] Write session: try to update token
2025-09-30T14:56:09.976963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e03af648-5bb6feaa-90ed6696-f95da6f4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:09.986693Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:09.986716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:09.986719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:09.986721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:09.986731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896173461125299:3249]
2025-09-30T14:56:09.986736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896173461125299:3249]
2025-09-30T14:56:09.986740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896173461125299:3249]
2025-09-30T14:56:09.986781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:09.986788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:09.986792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:09.986805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:09.986819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:09.986824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:09.986933Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:09.994450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2123 sessionId: src_id|e03af648-5bb6feaa-90ed6696-f95da6f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:09.997324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:10.039512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896177845864163:8402]
2025-09-30T14:56:10.039824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2122, pipe: [1:7555896177845864163:8402]
2025-09-30T14:56:10.100162Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:10.100510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:10.100524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:10.100544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896177845864163:8402], now have 1 active actors on pipe
2025-09-30T14:56:10.100779Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:10.100835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896177845864163:8402]
2025-09-30T14:56:10.100852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:10.100866Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:10.100937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2123 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e03af648-5bb6feaa-90ed6696-f95da6f4_0
2025-09-30T14:56:10.101117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2123 sessionId: src_id|e03af648-5bb6feaa-90ed6696-f95da6f4_0 is DEAD
2025-09-30T14:56:10.101296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e03af648-5bb6feaa-90ed6696-f95da6f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:10.101309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e03af648-5bb6feaa-90ed6696-f95da6f4_0] Write session will restart in 0.005687s
2025-09-30T14:56:10.101334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e03af648-5bb6feaa-90ed6696-f95da6f4_0] Write session: Do CDS request
2025-09-30T14:56:10.101340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e03af648-5bb6feaa-90ed6696-f95da6f4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:10.107791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e03af648-5bb6feaa-90ed6696-f95da6f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:10.107855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:10.107873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2124
2025-09-30T14:56:10.108025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2124 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:10.108060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2124 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:10.108070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2124 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:10.108074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:10.108512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2124 sessionId:  describe result for acl check
2025-09-30T14:56:10.108551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:10.108558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:10.108561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:10.108567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896177845864180:8241] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:10.109137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896177845864180:8241] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:10.111701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896177845864180:8241] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:10.115445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896177845864180:8241] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:10.115465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896177845864180:8241] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:10.115469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896177845864180:8241] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:10.115479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2124 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:10.120001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:10.122891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:10.123093Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:10.123105Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:10.123117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:10.123173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:10.123216Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896177756092823:3243]
2025-09-30T14:56:10.123959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:10.124632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:10.124742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:10.125119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:10.125196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:10.125197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:10.125198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:10.125199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:10.125200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:10.125201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:10.125202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:10.125203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:10.125204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:10.125205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:10.125206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.125208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.125209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.125210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:10.125211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:10.125216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:10.125226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:10.125231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:10.125234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:10.125238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:10.125242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:10.125247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:10.125251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:10.125255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:10.125259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:10.125263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.125267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.125271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.125275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:10.125278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:10.125286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:10.125295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:10.125301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:10.125306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:10.125311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:10.125316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:10.125320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:10.125326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:10.125330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:10.125335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:10.125340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:10.125346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:10.125351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:10.125355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:10.125360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:10.125364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:10.125372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:10.125377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:10.125381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:10.125387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:10.125391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.125412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.125418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.125423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.125427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.125432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.125437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:10.125442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:10.125447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:10.125452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:10.125498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:10.131560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:10.132843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:10.132870Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:10.132872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:10.132876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:10.132884Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2123 [2:7555896177756092823:3243]
2025-09-30T14:56:10.132901Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:10.132917Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:10.132920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:10.132926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:10.132930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:10.132963Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:10.132976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:10.132983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:10.133051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.133059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.133062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.133064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:10.133067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:10.133132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:10.133140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.133154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.133171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.133191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:10.133216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896177845864309:8241], now have 1 active actors on pipe
2025-09-30T14:56:10.133226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896177845864165:2454], now have 1 active actors on pipe
2025-09-30T14:56:10.133234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896177756092809:3243]
2025-09-30T14:56:10.133236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896177756092809:3243]
2025-09-30T14:56:10.133238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896177756092809:3243]
2025-09-30T14:56:10.133251Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:10.133265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:10.133279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:10.133280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:10.133283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:10.133289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:10.133292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:10.133321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896177756092809:3243]
2025-09-30T14:56:10.133333Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:10.133340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:10.133634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2123
2025-09-30T14:56:10.133669Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2123
2025-09-30T14:56:10.133838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:10.133853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:10.133885Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2eea3be-46fe0196-b9017ee4-51ee2e4f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:10.133898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:10.133907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:10.133909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:10.133923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:10.133939Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:10.133961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:10.134227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:10.134236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:10.134249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:10.134373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2124 partition: 0 MaxSeqNo: 42 sessionId: src_id|2eea3be-46fe0196-b9017ee4-51ee2e4f_0
2025-09-30T14:56:10.135388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e03af648-5bb6feaa-90ed6696-f95da6f4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2eea3be-46fe0196-b9017ee4-51ee2e4f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:10.138709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2eea3be-46fe0196-b9017ee4-51ee2e4f_0] Write session: try to update token
2025-09-30T14:56:10.138734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2eea3be-46fe0196-b9017ee4-51ee2e4f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:10.146643Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:10.146663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:10.146672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896177756092809:3243]
2025-09-30T14:56:10.146715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:10.146721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:10.146886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:10.147059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:10.147211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:10.147383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:10.147592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:10.147634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:10.159581Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:10.159601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:10.159604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:10.159606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:10.159616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896177756092809:3243]
2025-09-30T14:56:10.159620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896177756092809:3243]
2025-09-30T14:56:10.159624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896177756092809:3243]
2025-09-30T14:56:10.159668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:10.159675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.159677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:10.159774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:10.159788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:10.159791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:10.159822Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:10.166828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2124 sessionId: src_id|2eea3be-46fe0196-b9017ee4-51ee2e4f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:10.169591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:10.200813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896177845864410:8402]
2025-09-30T14:56:10.203510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2123, pipe: [1:7555896177845864410:8402]
2025-09-30T14:56:10.277618Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:10.277961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:10.277982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:10.278007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896177845864410:8402], now have 1 active actors on pipe
2025-09-30T14:56:10.278280Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:10.278800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eea3be-46fe0196-b9017ee4-51ee2e4f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:10.278812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eea3be-46fe0196-b9017ee4-51ee2e4f_0] Write session will restart in 0.006817s
2025-09-30T14:56:10.278315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:10.278835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eea3be-46fe0196-b9017ee4-51ee2e4f_0] Write session: Do CDS request
2025-09-30T14:56:10.278375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896177845864410:8402]
2025-09-30T14:56:10.278436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:10.278438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:10.278841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eea3be-46fe0196-b9017ee4-51ee2e4f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:10.278498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2124 reason: error at write: Disconnected sessionId: src_id|2eea3be-46fe0196-b9017ee4-51ee2e4f_0
2025-09-30T14:56:10.278664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2124 sessionId: src_id|2eea3be-46fe0196-b9017ee4-51ee2e4f_0 is DEAD
2025-09-30T14:56:10.286758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2eea3be-46fe0196-b9017ee4-51ee2e4f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:10.287355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:10.287373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2125
2025-09-30T14:56:10.287533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2125 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:10.287566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2125 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:10.287572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2125 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:10.287576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:10.288014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2125 sessionId:  describe result for acl check
2025-09-30T14:56:10.288050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:10.288052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:10.288054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:10.288061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896177845864431:8224] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:10.288855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896177845864431:8224] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:10.291607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896177845864431:8224] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:10.294863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896177845864431:8224] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:10.294879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896177845864431:8224] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:10.294884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896177845864431:8224] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:10.294893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2125 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:10.303463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:10.306367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:10.306583Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:10.306594Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:10.306603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:10.306652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:10.306777Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896177756093057:3219]
2025-09-30T14:56:10.307374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:10.307706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:10.307749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:10.308058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:10.308121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:10.308127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:10.308128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:10.308129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:10.308131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:10.308132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:10.308133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:10.308134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:10.308136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:10.308137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:10.308138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.308139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.308140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.308142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:10.308142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:10.308147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:10.308157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:10.308161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:10.308177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:10.308180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:10.308184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:10.308187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:10.308191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:10.308194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:10.308199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:10.308202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.308205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.308208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.308212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:10.308215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:10.308223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:10.308230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:10.308235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:10.308240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:10.308243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:10.308248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:10.308253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:10.308258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:10.308261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:10.308266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:10.308270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:10.308274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:10.308278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:10.308283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:10.308288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:10.308293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:10.308297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:10.308302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:10.308306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:10.308310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:10.308314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.308319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.308322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.308327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.308331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.308336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.308345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:10.308350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:10.308354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:10.308358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:10.308397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:10.314118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:10.315298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:10.315315Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:10.315317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:10.315320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:10.315327Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2124 [2:7555896177756093057:3219]
2025-09-30T14:56:10.315343Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:10.315358Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:10.315361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:10.315364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:10.315366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:10.315382Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:10.315394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:10.315401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:10.315477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.315484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.315486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.315490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:10.315493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:10.315564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:10.315572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.315586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.315597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.315612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:10.315635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896177845864525:8224], now have 1 active actors on pipe
2025-09-30T14:56:10.315643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896177845864415:2454], now have 1 active actors on pipe
2025-09-30T14:56:10.315650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896177756093052:3219]
2025-09-30T14:56:10.315652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896177756093052:3219]
2025-09-30T14:56:10.315654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896177756093052:3219]
2025-09-30T14:56:10.315667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:10.315681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:10.315681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:10.315684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:10.315687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:10.315700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:10.315704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:10.315693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2124
2025-09-30T14:56:10.315737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896177756093052:3219]
2025-09-30T14:56:10.315745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:10.315748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:10.315697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2124
2025-09-30T14:56:10.315778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:10.315787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:10.315826Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35b762da-4cd0f470-4e58a629-19d42b64_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:10.315838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:10.315841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:10.315847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:10.315861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:10.315874Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:10.315895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:10.316039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:10.316046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:10.316061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:10.316156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2125 partition: 0 MaxSeqNo: 42 sessionId: src_id|35b762da-4cd0f470-4e58a629-19d42b64_0
2025-09-30T14:56:10.316492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eea3be-46fe0196-b9017ee4-51ee2e4f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|35b762da-4cd0f470-4e58a629-19d42b64_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:10.319216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35b762da-4cd0f470-4e58a629-19d42b64_0] Write session: try to update token
2025-09-30T14:56:10.319238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35b762da-4cd0f470-4e58a629-19d42b64_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:10.328621Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:10.328648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:10.328651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:10.328654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:10.328664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896177756093052:3219]
2025-09-30T14:56:10.328669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896177756093052:3219]
2025-09-30T14:56:10.328674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896177756093052:3219]
2025-09-30T14:56:10.328718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:10.328725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.328728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:10.328882Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:10.331309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:10.331328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:10.331333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:10.336542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2125 sessionId: src_id|35b762da-4cd0f470-4e58a629-19d42b64_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:10.339659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:10.378467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896177845864635:8402]
2025-09-30T14:56:10.379600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2124, pipe: [1:7555896177845864635:8402]
2025-09-30T14:56:10.444045Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:10.444459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:10.444481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:10.444526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896177845864635:8402], now have 1 active actors on pipe
2025-09-30T14:56:10.444796Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:10.446018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35b762da-4cd0f470-4e58a629-19d42b64_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:10.446031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35b762da-4cd0f470-4e58a629-19d42b64_0] Write session will restart in 0.006350s
2025-09-30T14:56:10.445496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:10.446054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35b762da-4cd0f470-4e58a629-19d42b64_0] Write session: Do CDS request
2025-09-30T14:56:10.445550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896177845864635:8402]
2025-09-30T14:56:10.445571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:10.445641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2125 reason: status is not ok: tablet will be restarted right now sessionId: src_id|35b762da-4cd0f470-4e58a629-19d42b64_0
2025-09-30T14:56:10.446074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35b762da-4cd0f470-4e58a629-19d42b64_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:10.445825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2125 sessionId: src_id|35b762da-4cd0f470-4e58a629-19d42b64_0 is DEAD
2025-09-30T14:56:10.453788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35b762da-4cd0f470-4e58a629-19d42b64_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:10.453937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:10.453955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2126
2025-09-30T14:56:10.454098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2126 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:10.454145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2126 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:10.454155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2126 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:10.454162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:10.454680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2126 sessionId:  describe result for acl check
2025-09-30T14:56:10.454717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:10.454721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:10.454723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:10.454729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896177845864658:8220] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:10.455286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896177845864658:8220] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:10.458601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896177845864658:8220] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:10.461632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896177845864658:8220] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:10.461659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896177845864658:8220] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:10.461663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896177845864658:8220] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:10.461671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2126 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:10.463358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:10.466495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:10.466857Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:10.466869Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:10.466885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:10.466962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:10.467012Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896177756093271:3214]
2025-09-30T14:56:10.467666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:10.468051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:10.468110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:10.468452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:10.468544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:10.468553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:10.468554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:10.468555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:10.468556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:10.468557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:10.468559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:10.468560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:10.468561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:10.468563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:10.468564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.468565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.468566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.468567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:10.468569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:10.468574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:10.468586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:10.468589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:10.468593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:10.468596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:10.468600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:10.468604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:10.468608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:10.468612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:10.468617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:10.468620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.468625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.468629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.468633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:10.468637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:10.468645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:10.468653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:10.468660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:10.468666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:10.468671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:10.468677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:10.468681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:10.468687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:10.468692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:10.468696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:10.468700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:10.468705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:10.468711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:10.468718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:10.468728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:10.468733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:10.468737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:10.468742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:10.468753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:10.468758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:10.468763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.468773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.468778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.468788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.468793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.468797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.468806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:10.468811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:10.468815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:10.468820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:10.468861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:10.474641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:10.475856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:10.475873Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:10.475875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:10.475879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:10.475885Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2125 [2:7555896177756093271:3214]
2025-09-30T14:56:10.475903Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:10.475919Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:10.475928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:10.475931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:10.475933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:10.475950Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:10.475961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:10.475967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:10.476035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.476042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.476044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.476047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:10.476050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:10.476119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:10.476126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.476139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.476154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.476169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:10.476185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896177756093266:3214]
2025-09-30T14:56:10.476196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896177756093266:3214]
2025-09-30T14:56:10.476199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896177756093266:3214]
2025-09-30T14:56:10.476208Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:10.476219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:10.476222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:10.476223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:10.476225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:10.476237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:10.476240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:10.476252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896177845864637:2454], now have 1 active actors on pipe
2025-09-30T14:56:10.476257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896177845864843:8220], now have 1 active actors on pipe
2025-09-30T14:56:10.476290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896177756093266:3214]
2025-09-30T14:56:10.476304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:10.476297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2125
2025-09-30T14:56:10.476336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2125
2025-09-30T14:56:10.476330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:10.476374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:10.476383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:10.476407Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c712285-85a0f81d-42a2ab87-d2e52922_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:10.476418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:10.476421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:10.476429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:10.476439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:10.476448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:10.476466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:10.476646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:10.476655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:10.476670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:10.476771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2126 partition: 0 MaxSeqNo: 42 sessionId: src_id|7c712285-85a0f81d-42a2ab87-d2e52922_0
2025-09-30T14:56:10.477174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35b762da-4cd0f470-4e58a629-19d42b64_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7c712285-85a0f81d-42a2ab87-d2e52922_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:10.480158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c712285-85a0f81d-42a2ab87-d2e52922_0] Write session: try to update token
2025-09-30T14:56:10.480182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c712285-85a0f81d-42a2ab87-d2e52922_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:10.489932Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:10.489955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:10.489966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896177756093266:3214]
2025-09-30T14:56:10.490021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:10.490035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:10.490220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:10.490383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:10.490543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:10.490698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:10.490931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:10.490978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:10.501304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2126 sessionId: src_id|7c712285-85a0f81d-42a2ab87-d2e52922_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:10.504022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:10.501489Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:10.501508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:10.501511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:10.501513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:10.501522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896177756093266:3214]
2025-09-30T14:56:10.501526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896177756093266:3214]
2025-09-30T14:56:10.501530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896177756093266:3214]
2025-09-30T14:56:10.501572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:10.501580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.501580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:10.501582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:10.501587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:10.501592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:10.501726Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:10.545380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896177845864857:8402]
2025-09-30T14:56:10.545732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2125, pipe: [1:7555896177845864857:8402]
2025-09-30T14:56:10.615879Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:10.616287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:10.616297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:10.616320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896177845864857:8402], now have 1 active actors on pipe
2025-09-30T14:56:10.616883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:10.616896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:10.616574Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:10.617305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c712285-85a0f81d-42a2ab87-d2e52922_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:10.617316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c712285-85a0f81d-42a2ab87-d2e52922_0] Write session will restart in 0.005510s
2025-09-30T14:56:10.617339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c712285-85a0f81d-42a2ab87-d2e52922_0] Write session: Do CDS request
2025-09-30T14:56:10.617345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c712285-85a0f81d-42a2ab87-d2e52922_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:10.616955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2126 reason: error at write: Disconnected sessionId: src_id|7c712285-85a0f81d-42a2ab87-d2e52922_0
2025-09-30T14:56:10.617131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2126 sessionId: src_id|7c712285-85a0f81d-42a2ab87-d2e52922_0 is DEAD
2025-09-30T14:56:10.617231Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:10.617254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896177845864857:8402]
2025-09-30T14:56:10.623833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c712285-85a0f81d-42a2ab87-d2e52922_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:10.623866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:10.623894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2127
2025-09-30T14:56:10.624102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2127 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:10.624130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2127 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:10.624138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2127 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:10.624141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:10.624557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2127 sessionId:  describe result for acl check
2025-09-30T14:56:10.624590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:10.624597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:10.624599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:10.624605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896177845864874:8209] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:10.625123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896177845864874:8209] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:10.627316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896177845864874:8209] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:10.631025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896177845864874:8209] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:10.631055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896177845864874:8209] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:10.631059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896177845864874:8209] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:10.631068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2127 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:10.634873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:10.638024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:10.638254Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:10.638265Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:10.638276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:10.638331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:10.638375Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896177756093484:3209]
2025-09-30T14:56:10.638962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:10.639336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:10.639394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:10.639770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:10.639845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:10.639852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:10.639854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:10.639855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:10.639856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:10.639858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:10.639859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:10.639860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:10.639861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:10.639863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:10.639864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.639865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.639867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.639868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:10.639869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:10.639875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:10.639885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:10.639889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:10.639893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:10.639896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:10.639899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:10.639902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:10.639906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:10.639909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:10.639913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:10.639916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.639920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.639924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.639927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:10.639930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:10.639940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:10.639948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:10.639954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:10.639959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:10.639964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:10.639968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:10.639973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:10.639978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:10.639983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:10.639988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:10.639992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:10.639998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:10.640003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:10.640008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:10.640012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:10.640017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:10.640022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:10.640027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:10.640031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:10.640036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:10.640041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.640048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.640052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.640057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.640062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.640067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.640071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:10.640075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:10.640079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:10.640084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:10.640126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:10.645852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:10.647075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:10.647083Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:10.647086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:10.647090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:10.647097Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2126 [2:7555896177756093484:3209]
2025-09-30T14:56:10.647116Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:10.647133Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:10.647137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:10.647140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:10.647142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:10.647160Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:10.647167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:10.647174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:10.647271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.647273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.647275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.647279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:10.647281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:10.647354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:10.647357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.647374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.647386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.647403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:10.647423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896177756093479:3209]
2025-09-30T14:56:10.647426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896177756093479:3209]
2025-09-30T14:56:10.647428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896177756093479:3209]
2025-09-30T14:56:10.647446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:10.647461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:10.647476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:10.647479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:10.647501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:10.647505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:10.647507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:10.647512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896177756093479:3209]
2025-09-30T14:56:10.647516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:10.647589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:10.647825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896177845865011:8209], now have 1 active actors on pipe
2025-09-30T14:56:10.647834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896177845864859:2454], now have 1 active actors on pipe
2025-09-30T14:56:10.647852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2126
2025-09-30T14:56:10.647856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2126
2025-09-30T14:56:10.647947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:10.647956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:10.647988Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|21944dda-6a9c89f6-9d03bb2a-8e68b6f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:10.647999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:10.648004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:10.648007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:10.648017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:10.648029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:10.648046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:10.648245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:10.648252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:10.648282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:10.648388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2127 partition: 0 MaxSeqNo: 42 sessionId: src_id|21944dda-6a9c89f6-9d03bb2a-8e68b6f6_0
2025-09-30T14:56:10.648764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c712285-85a0f81d-42a2ab87-d2e52922_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|21944dda-6a9c89f6-9d03bb2a-8e68b6f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:10.651502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21944dda-6a9c89f6-9d03bb2a-8e68b6f6_0] Write session: try to update token
2025-09-30T14:56:10.651521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21944dda-6a9c89f6-9d03bb2a-8e68b6f6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:10.660759Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:10.660780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:10.660783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:10.660785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:10.660795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896177756093479:3209]
2025-09-30T14:56:10.660800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896177756093479:3209]
2025-09-30T14:56:10.660805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896177756093479:3209]
2025-09-30T14:56:10.660850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:10.660858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.660860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:10.660865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:10.660874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:10.660878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:10.661006Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:10.667716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2127 sessionId: src_id|21944dda-6a9c89f6-9d03bb2a-8e68b6f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:10.670688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:10.717391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896177845865083:8402]
2025-09-30T14:56:10.717747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2126, pipe: [1:7555896177845865083:8402]
2025-09-30T14:56:10.775944Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:10.776291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:10.776302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:10.776348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896177845865083:8402], now have 1 active actors on pipe
2025-09-30T14:56:10.776631Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:10.777074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21944dda-6a9c89f6-9d03bb2a-8e68b6f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:10.777087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21944dda-6a9c89f6-9d03bb2a-8e68b6f6_0] Write session will restart in 0.006259s
2025-09-30T14:56:10.777113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21944dda-6a9c89f6-9d03bb2a-8e68b6f6_0] Write session: Do CDS request
2025-09-30T14:56:10.777121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21944dda-6a9c89f6-9d03bb2a-8e68b6f6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:10.776613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:10.776613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896177845865083:8402]
2025-09-30T14:56:10.776630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:10.776637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:10.776692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2127 reason: error at write: Disconnected sessionId: src_id|21944dda-6a9c89f6-9d03bb2a-8e68b6f6_0
2025-09-30T14:56:10.776872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2127 sessionId: src_id|21944dda-6a9c89f6-9d03bb2a-8e68b6f6_0 is DEAD
2025-09-30T14:56:10.784826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21944dda-6a9c89f6-9d03bb2a-8e68b6f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:10.784918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:10.784935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2128
2025-09-30T14:56:10.785065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2128 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:10.785099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2128 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:10.785105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2128 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:10.785110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:10.785582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2128 sessionId:  describe result for acl check
2025-09-30T14:56:10.785621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:10.785630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:10.785634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:10.785640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896177845865100:8204] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:10.786210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896177845865100:8204] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:10.789101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896177845865100:8204] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:10.792391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896177845865100:8204] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:10.792409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896177845865100:8204] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:10.792413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896177845865100:8204] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:10.792421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2128 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:10.795524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:10.798518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:10.798745Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:10.798755Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:10.798766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:10.798834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:10.798880Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896177756093710:3204]
2025-09-30T14:56:10.799552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:10.799880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:10.799927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:10.800264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:10.800346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:10.800352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:10.800354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:10.800356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:10.800357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:10.800359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:10.800360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:10.800361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:10.800363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:10.800364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:10.800365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.800367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.800368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.800369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:10.800370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:10.800377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:10.800386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:10.800388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:10.800391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:10.800393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:10.800396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:10.800398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:10.800401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:10.800403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:10.800406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:10.800408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.800410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.800413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.800415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:10.800417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:10.800424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:10.800429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:10.800434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:10.800437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:10.800440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:10.800444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:10.800447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:10.800450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:10.800453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:10.800456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:10.800461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:10.800464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:10.800467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:10.800470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:10.800473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:10.800476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:10.800478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:10.800481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:10.800484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:10.800488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:10.800493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.800495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.800498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.800501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.800503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.800506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.800509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:10.800512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:10.800515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:10.800518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:10.800544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:10.806305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:10.807194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:10.807209Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:10.807212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:10.807216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:10.807221Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2127 [2:7555896177756093710:3204]
2025-09-30T14:56:10.807236Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:10.807269Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:10.807273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:10.807276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:10.807279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:10.807295Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:10.807302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:10.807310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:10.807373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.807381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.807384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.807388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:10.807391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:10.807465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:10.807468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.807482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.807498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.807517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:10.807542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896177845865085:2454], now have 1 active actors on pipe
2025-09-30T14:56:10.807554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896177756093705:3204]
2025-09-30T14:56:10.807556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896177756093705:3204]
2025-09-30T14:56:10.807558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896177756093705:3204]
2025-09-30T14:56:10.807571Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:10.807588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896177845865261:8204], now have 1 active actors on pipe
2025-09-30T14:56:10.807590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:10.807593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:10.807595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:10.807600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:10.807616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:10.807619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:10.807649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896177756093705:3204]
2025-09-30T14:56:10.807660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:10.807699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:10.807661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2127
2025-09-30T14:56:10.807775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2127
2025-09-30T14:56:10.808023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:10.808035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:10.808063Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d32862b1-7fddd9d-de329103-cf0d96cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:10.808073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:10.808082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:10.808084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:10.808094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:10.808109Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:10.808127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:10.808288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:10.808301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:10.808323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:10.808437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2128 partition: 0 MaxSeqNo: 42 sessionId: src_id|d32862b1-7fddd9d-de329103-cf0d96cc_0
2025-09-30T14:56:10.808791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21944dda-6a9c89f6-9d03bb2a-8e68b6f6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d32862b1-7fddd9d-de329103-cf0d96cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:10.811744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d32862b1-7fddd9d-de329103-cf0d96cc_0] Write session: try to update token
2025-09-30T14:56:10.811766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d32862b1-7fddd9d-de329103-cf0d96cc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:10.820372Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:10.820396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:10.820399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:10.820402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:10.820411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896177756093705:3204]
2025-09-30T14:56:10.820416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896177756093705:3204]
2025-09-30T14:56:10.820419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896177756093705:3204]
2025-09-30T14:56:10.820464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:10.820471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.820471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:10.820473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:10.820478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:10.820483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:10.820619Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:10.828194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2128 sessionId: src_id|d32862b1-7fddd9d-de329103-cf0d96cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:10.830962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:10.876626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896177845865307:8402]
2025-09-30T14:56:10.876951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2127, pipe: [1:7555896177845865307:8402]
2025-09-30T14:56:10.932867Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:10.933199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:10.933214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:10.933233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896177845865307:8402], now have 1 active actors on pipe
2025-09-30T14:56:10.933489Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:10.933476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:10.933533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:10.933534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896177845865307:8402]
2025-09-30T14:56:10.933536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:10.933600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2128 reason: error at write: Disconnected sessionId: src_id|d32862b1-7fddd9d-de329103-cf0d96cc_0
2025-09-30T14:56:10.933792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2128 sessionId: src_id|d32862b1-7fddd9d-de329103-cf0d96cc_0 is DEAD
2025-09-30T14:56:10.933945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d32862b1-7fddd9d-de329103-cf0d96cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:10.933954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d32862b1-7fddd9d-de329103-cf0d96cc_0] Write session will restart in 0.008192s
2025-09-30T14:56:10.933986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d32862b1-7fddd9d-de329103-cf0d96cc_0] Write session: Do CDS request
2025-09-30T14:56:10.933994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d32862b1-7fddd9d-de329103-cf0d96cc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:10.943743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d32862b1-7fddd9d-de329103-cf0d96cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:10.943807Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:10.943826Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2129
2025-09-30T14:56:10.943979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2129 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:10.944016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2129 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:10.944021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2129 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:10.944026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:10.944538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2129 sessionId:  describe result for acl check
2025-09-30T14:56:10.944573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:10.944580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:10.944582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:10.944587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896177845865366:8202] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:10.945151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896177845865366:8202] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:10.947652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896177845865366:8202] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:10.950725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896177845865366:8202] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:10.950745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896177845865366:8202] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:10.950749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896177845865366:8202] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:10.950758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2129 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:10.952249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:10.953101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:10.953333Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:10.953342Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:10.953352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:10.953420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:10.953469Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896177756093928:3201]
2025-09-30T14:56:10.954157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:10.955422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:10.955485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:10.955957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:10.956036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:10.956043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:10.956044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:10.956045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:10.956046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:10.956047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:10.956049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:10.956050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:10.956051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:10.956052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:10.956054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.956055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.956056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.956057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:10.956059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:10.956064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:10.956076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:10.956080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:10.956084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:10.956089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:10.956092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:10.956097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:10.956100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:10.956104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:10.956109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:10.956113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.956117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.956121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.956125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:10.956129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:10.956138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:10.956146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:10.956152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:10.956158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:10.956163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:10.956169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:10.956173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:10.956184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:10.956189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:10.956196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:10.956205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:10.956210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:10.956228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:10.956238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:10.956243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:10.956248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:10.956257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:10.956267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:10.956273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:10.956282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:10.956287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.956297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.956301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.956310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.956315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.956320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.956328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:10.956333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:10.956338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:10.956347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:10.956391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:10.962104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:10.963358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:10.963376Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:10.963380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:10.963384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:10.963391Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2128 [2:7555896177756093928:3201]
2025-09-30T14:56:10.963408Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:10.963423Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:10.963427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:10.963430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:10.963432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:10.963447Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:10.963454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:10.963467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:10.963530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.963537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.963539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.963542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:10.963545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:10.963611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:10.963619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.963631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:10.963647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:10.963666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:10.963690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896177845865310:2454], now have 1 active actors on pipe
2025-09-30T14:56:10.963699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896177845865532:8202], now have 1 active actors on pipe
2025-09-30T14:56:10.963705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896177756093922:3201]
2025-09-30T14:56:10.963712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896177756093922:3201]
2025-09-30T14:56:10.963714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896177756093922:3201]
2025-09-30T14:56:10.963728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:10.963743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:10.963756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:10.963763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:10.963766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:10.963767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:10.963770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:10.963802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896177756093922:3201]
2025-09-30T14:56:10.963817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:10.963808Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2128
2025-09-30T14:56:10.963844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2128
2025-09-30T14:56:10.963835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:10.963980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:10.963993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:10.964020Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|727a8b34-84ad0b50-9137b3b6-7053f36e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:10.964033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:10.964041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:10.964044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:10.964055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:10.964080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:10.964098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:10.964252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:10.964263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:10.964292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:10.964376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2129 partition: 0 MaxSeqNo: 42 sessionId: src_id|727a8b34-84ad0b50-9137b3b6-7053f36e_0
2025-09-30T14:56:10.964773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d32862b1-7fddd9d-de329103-cf0d96cc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|727a8b34-84ad0b50-9137b3b6-7053f36e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:10.967612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|727a8b34-84ad0b50-9137b3b6-7053f36e_0] Write session: try to update token
2025-09-30T14:56:10.967632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|727a8b34-84ad0b50-9137b3b6-7053f36e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:10.976823Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:10.976845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:10.976847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:10.976849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:10.976859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896177756093922:3201]
2025-09-30T14:56:10.976865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896177756093922:3201]
2025-09-30T14:56:10.976869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896177756093922:3201]
2025-09-30T14:56:10.976911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:10.976922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:10.976925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:10.976915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:10.976936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:10.976940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:10.977073Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:10.985051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2129 sessionId: src_id|727a8b34-84ad0b50-9137b3b6-7053f36e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:10.987753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:11.033815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896182140832844:8402]
2025-09-30T14:56:11.034258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2128, pipe: [1:7555896182140832844:8402]
2025-09-30T14:56:11.091080Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:11.091388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:11.091401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:11.091420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896182140832844:8402], now have 1 active actors on pipe
2025-09-30T14:56:11.091640Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:11.091656Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:11.091697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896182140832844:8402]
2025-09-30T14:56:11.091719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:11.091792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2129 reason: status is not ok: tablet will be restarted right now sessionId: src_id|727a8b34-84ad0b50-9137b3b6-7053f36e_0
2025-09-30T14:56:11.091991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2129 sessionId: src_id|727a8b34-84ad0b50-9137b3b6-7053f36e_0 is DEAD
2025-09-30T14:56:11.092144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|727a8b34-84ad0b50-9137b3b6-7053f36e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:11.092155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|727a8b34-84ad0b50-9137b3b6-7053f36e_0] Write session will restart in 0.006574s
2025-09-30T14:56:11.092178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|727a8b34-84ad0b50-9137b3b6-7053f36e_0] Write session: Do CDS request
2025-09-30T14:56:11.092193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|727a8b34-84ad0b50-9137b3b6-7053f36e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:11.099713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|727a8b34-84ad0b50-9137b3b6-7053f36e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:11.099807Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:11.099823Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2130
2025-09-30T14:56:11.099951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2130 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:11.099983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2130 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:11.099992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2130 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:11.099997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:11.100441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2130 sessionId:  describe result for acl check
2025-09-30T14:56:11.100482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:11.100491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:11.100493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:11.100498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896182140832870:8194] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:11.101039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896182140832870:8194] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:11.103530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896182140832870:8194] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:11.106809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896182140832870:8194] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:11.106827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896182140832870:8194] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:11.106830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896182140832870:8194] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:11.106839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2130 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:11.109209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:11.112031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:11.112419Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:11.112434Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:11.112451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:11.112527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:11.112573Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896182051061440:3199]
2025-09-30T14:56:11.113229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:11.113639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:11.113721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:11.114071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:11.114133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:11.114139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:11.114140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:11.114141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:11.114142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:11.114143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:11.114144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:11.114145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:11.114146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:11.114148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:11.114149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.114150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.114151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.114152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:11.114153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:11.114158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:11.114168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:11.114171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:11.114175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:11.114179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:11.114183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:11.114187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:11.114190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:11.114195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:11.114199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:11.114203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.114206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.114210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.114213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:11.114216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:11.114223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:11.114231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:11.114238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:11.114243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:11.114248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:11.114253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:11.114259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:11.114264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:11.114268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:11.114273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:11.114278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:11.114283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:11.114288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:11.114293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:11.114296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:11.114301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:11.114308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:11.114313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:11.114317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:11.114322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:11.114327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.114331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.114335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.114340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.114343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.114347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.114351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:11.114356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:11.114359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:11.114364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:11.114403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:11.121130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:11.122046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:11.122061Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:11.122065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:11.122069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:11.122077Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2129 [2:7555896182051061440:3199]
2025-09-30T14:56:11.122095Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:11.122112Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:11.122115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:11.122119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:11.122121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:11.122136Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:11.122144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:11.122152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:11.122214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.122223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.122225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.122229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:11.122232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:11.122301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:11.122308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.122321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.122338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.122361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:11.122385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896182140833042:8194], now have 1 active actors on pipe
2025-09-30T14:56:11.122393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896182140832849:2454], now have 1 active actors on pipe
2025-09-30T14:56:11.122400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896182051061435:3199]
2025-09-30T14:56:11.122402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896182051061435:3199]
2025-09-30T14:56:11.122404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896182051061435:3199]
2025-09-30T14:56:11.122424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:11.122442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:11.122457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:11.122457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:11.122460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:11.122442Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2129
2025-09-30T14:56:11.122461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:11.122446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2129
2025-09-30T14:56:11.122463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:11.122498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896182051061435:3199]
2025-09-30T14:56:11.122502Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:11.122504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:11.122521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:11.122525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:11.122578Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11cbf3ad-4a195da4-bf5027c7-b8b2afea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:11.122590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:11.122594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:11.122597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:11.122607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:11.122621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:11.122643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:11.122813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:11.122822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:11.122837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:11.122925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2130 partition: 0 MaxSeqNo: 42 sessionId: src_id|11cbf3ad-4a195da4-bf5027c7-b8b2afea_0
2025-09-30T14:56:11.123288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|727a8b34-84ad0b50-9137b3b6-7053f36e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|11cbf3ad-4a195da4-bf5027c7-b8b2afea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:11.126086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11cbf3ad-4a195da4-bf5027c7-b8b2afea_0] Write session: try to update token
2025-09-30T14:56:11.126109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11cbf3ad-4a195da4-bf5027c7-b8b2afea_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:11.134836Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:11.134857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:11.134858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:11.134859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:11.134867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896182051061435:3199]
2025-09-30T14:56:11.134872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896182051061435:3199]
2025-09-30T14:56:11.134877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896182051061435:3199]
2025-09-30T14:56:11.134916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:11.134923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.134926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:11.134932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:11.134938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:11.134943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:11.135056Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:11.141146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2130 sessionId: src_id|11cbf3ad-4a195da4-bf5027c7-b8b2afea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:11.144036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:11.191983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896182140833091:8402]
2025-09-30T14:56:11.192309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2129, pipe: [1:7555896182140833091:8402]
2025-09-30T14:56:11.245478Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:11.245990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:11.246007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:11.246046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896182140833091:8402], now have 1 active actors on pipe
2025-09-30T14:56:11.246283Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:11.246328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:11.246343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:11.246347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896182140833091:8402]
2025-09-30T14:56:11.246367Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:11.246418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2130 reason: error at write: Disconnected sessionId: src_id|11cbf3ad-4a195da4-bf5027c7-b8b2afea_0
2025-09-30T14:56:11.246595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2130 sessionId: src_id|11cbf3ad-4a195da4-bf5027c7-b8b2afea_0 is DEAD
2025-09-30T14:56:11.246745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11cbf3ad-4a195da4-bf5027c7-b8b2afea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:11.246755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11cbf3ad-4a195da4-bf5027c7-b8b2afea_0] Write session will restart in 0.007591s
2025-09-30T14:56:11.246781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11cbf3ad-4a195da4-bf5027c7-b8b2afea_0] Write session: Do CDS request
2025-09-30T14:56:11.246790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11cbf3ad-4a195da4-bf5027c7-b8b2afea_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:11.255831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11cbf3ad-4a195da4-bf5027c7-b8b2afea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:11.255916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:11.255936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2131
2025-09-30T14:56:11.256055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2131 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:11.256092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2131 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:11.256098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2131 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:11.256102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:11.256651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2131 sessionId:  describe result for acl check
2025-09-30T14:56:11.256681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:11.256684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:11.256685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:11.256692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896182140833129:2340] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:11.257214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896182140833129:2340] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:11.260054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896182140833129:2340] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:11.263557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896182140833129:2340] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:11.263572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896182140833129:2340] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:11.263575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896182140833129:2340] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:11.263583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2131 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:11.266756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:11.269732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:11.270054Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:11.270068Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:11.270079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:11.270140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:11.270183Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896182051061693:3177]
2025-09-30T14:56:11.270861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:11.271171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:11.271219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:11.271596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:11.271662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:11.271669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:11.271670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:11.271672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:11.271673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:11.271674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:11.271675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:11.271677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:11.271678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:11.271679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:11.271681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.271682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.271683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.271684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:11.271685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:11.271692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:11.271703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:11.271708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:11.271713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:11.271717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:11.271721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:11.271726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:11.271731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:11.271735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:11.271741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:11.271745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.271750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.271754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.271759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:11.271763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:11.271773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:11.271781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:11.271788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:11.271794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:11.271799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:11.271805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:11.271812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:11.271818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:11.271829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:11.271835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:11.271845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:11.271851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:11.271861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:11.271867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:11.271876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:11.271884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:11.271894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:11.271900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:11.271905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:11.271911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:11.271917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.271922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.271932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.271938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.271948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.271954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.271963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:11.271969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:11.271979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:11.271985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:11.272034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:11.277878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:11.279021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:11.279041Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:11.279043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:11.279050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:11.279056Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2130 [2:7555896182051061693:3177]
2025-09-30T14:56:11.279072Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:11.279088Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:11.279091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:11.279095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:11.279097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:11.279114Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:11.279120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:11.279133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:11.279193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.279204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.279206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.279210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:11.279213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:11.279298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:11.279307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.279321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.279340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.279359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:11.279379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896182140833294:2340], now have 1 active actors on pipe
2025-09-30T14:56:11.279389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896182140833105:2454], now have 1 active actors on pipe
2025-09-30T14:56:11.279395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896182051061688:3177]
2025-09-30T14:56:11.279397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896182051061688:3177]
2025-09-30T14:56:11.279399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896182051061688:3177]
2025-09-30T14:56:11.279418Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:11.279438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:11.279437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:11.279442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:11.279445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:11.279458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:11.279461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:11.279494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896182051061688:3177]
2025-09-30T14:56:11.279503Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:11.279505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:11.279523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:11.279532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:11.279459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2130
2025-09-30T14:56:11.279469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2130
2025-09-30T14:56:11.279580Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1df287fb-35a39243-82736554-44b62090_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:11.279593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:11.279596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:11.279598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:11.279609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:11.279617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:11.279640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:11.279854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:11.279867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:11.279892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:11.279985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2131 partition: 0 MaxSeqNo: 42 sessionId: src_id|1df287fb-35a39243-82736554-44b62090_0
2025-09-30T14:56:11.280346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11cbf3ad-4a195da4-bf5027c7-b8b2afea_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1df287fb-35a39243-82736554-44b62090_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:11.283332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1df287fb-35a39243-82736554-44b62090_0] Write session: try to update token
2025-09-30T14:56:11.283352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1df287fb-35a39243-82736554-44b62090_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:11.291988Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:11.292009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:11.292012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:11.292015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:11.292024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896182051061688:3177]
2025-09-30T14:56:11.292029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896182051061688:3177]
2025-09-30T14:56:11.292034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896182051061688:3177]
2025-09-30T14:56:11.292081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:11.292081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:11.292087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:11.292087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.292090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:11.292091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:11.292241Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:11.301904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2131 sessionId: src_id|1df287fb-35a39243-82736554-44b62090_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:11.304750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:11.346634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896182140833330:8402]
2025-09-30T14:56:11.346925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2130, pipe: [1:7555896182140833330:8402]
2025-09-30T14:56:11.406131Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:11.406645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:11.406660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:11.406681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896182140833330:8402], now have 1 active actors on pipe
2025-09-30T14:56:11.406896Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:11.406948Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:11.406974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:11.406979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:11.407007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896182140833330:8402]
2025-09-30T14:56:11.407047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2131 reason: error at write: Disconnected sessionId: src_id|1df287fb-35a39243-82736554-44b62090_0
2025-09-30T14:56:11.407261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2131 sessionId: src_id|1df287fb-35a39243-82736554-44b62090_0 is DEAD
2025-09-30T14:56:11.407510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1df287fb-35a39243-82736554-44b62090_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:11.407526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1df287fb-35a39243-82736554-44b62090_0] Write session will restart in 0.005006s
2025-09-30T14:56:11.407559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1df287fb-35a39243-82736554-44b62090_0] Write session: Do CDS request
2025-09-30T14:56:11.407567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1df287fb-35a39243-82736554-44b62090_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:11.413792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1df287fb-35a39243-82736554-44b62090_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:11.413820Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:11.413834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2132
2025-09-30T14:56:11.414033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2132 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:11.414071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2132 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:11.414081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2132 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:11.414085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:11.414539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2132 sessionId:  describe result for acl check
2025-09-30T14:56:11.414573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:11.414579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:11.414581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:11.414587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896182140833342:2352] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:11.415126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896182140833342:2352] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:11.417678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896182140833342:2352] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:11.420030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896182140833342:2352] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:11.420046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896182140833342:2352] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:11.420049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896182140833342:2352] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:11.420058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2132 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:11.428972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:11.431863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:11.432080Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:11.432090Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:11.432099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:11.432152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:11.432192Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896182051061916:3166]
2025-09-30T14:56:11.432826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:11.433195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:11.433251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:11.433533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:11.433601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:11.433607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:11.433607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:11.433608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:11.433609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:11.433610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:11.433611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:11.433611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:11.433612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:11.433613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:11.433614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.433615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.433616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.433616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:11.433617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:11.433621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:11.433629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:11.433631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:11.433634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:11.433636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:11.433639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:11.433641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:11.433644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:11.433646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:11.433649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:11.433651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.433654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.433656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.433659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:11.433661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:11.433666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:11.433671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:11.433676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:11.433681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:11.433686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:11.433691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:11.433695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:11.433699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:11.433704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:11.433709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:11.433713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:11.433718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:11.433723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:11.433729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:11.433749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:11.433754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:11.433758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:11.433764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:11.433768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:11.433774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:11.433779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.433784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.433789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.433792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.433795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.433798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.433800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:11.433803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:11.433806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:11.433809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:11.433835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:11.439463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:11.440561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:11.440572Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:11.440576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:11.440580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:11.440586Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2131 [2:7555896182051061916:3166]
2025-09-30T14:56:11.440602Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:11.440619Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:11.440623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:11.440626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:11.440628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:11.440644Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:11.440656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:11.440662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:11.440723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.440730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.440732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.440736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:11.440739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:11.440804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:11.440812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.440825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.440838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.440861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:11.440882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896182051061911:3166]
2025-09-30T14:56:11.440890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896182051061911:3166]
2025-09-30T14:56:11.440892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896182051061911:3166]
2025-09-30T14:56:11.440902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:11.440910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:11.440913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:11.440916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:11.440922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896182140833334:2454], now have 1 active actors on pipe
2025-09-30T14:56:11.440934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:11.440952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:11.440959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:11.440964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896182140833383:2352], now have 1 active actors on pipe
2025-09-30T14:56:11.440994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896182051061911:3166]
2025-09-30T14:56:11.441007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:11.440995Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2131
2025-09-30T14:56:11.441028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:11.441017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2131
2025-09-30T14:56:11.441066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:11.441076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:11.441099Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be4bee7d-f7b21c6d-4f8a41ad-b0d6cde_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:11.441112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:11.441115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:11.441117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:11.441126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:11.441135Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:11.441153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:11.441439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:11.441447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:11.441461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:11.441588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2132 partition: 0 MaxSeqNo: 42 sessionId: src_id|be4bee7d-f7b21c6d-4f8a41ad-b0d6cde_0
2025-09-30T14:56:11.441963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1df287fb-35a39243-82736554-44b62090_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|be4bee7d-f7b21c6d-4f8a41ad-b0d6cde_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:11.444799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be4bee7d-f7b21c6d-4f8a41ad-b0d6cde_0] Write session: try to update token
2025-09-30T14:56:11.444816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be4bee7d-f7b21c6d-4f8a41ad-b0d6cde_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:11.453735Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:11.453762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:11.453773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896182051061911:3166]
2025-09-30T14:56:11.453828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:11.453827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:11.454094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:11.454268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:11.454511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:11.454734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:11.454994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:11.455050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:11.459841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2132 sessionId: src_id|be4bee7d-f7b21c6d-4f8a41ad-b0d6cde_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:11.462550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:11.462776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:11.462800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:11.462839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:11.462929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:11.464861Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:11.464877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:11.464880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:11.464882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:11.464891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896182051061911:3166]
2025-09-30T14:56:11.464896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896182051061911:3166]
2025-09-30T14:56:11.464901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896182051061911:3166]
2025-09-30T14:56:11.464942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:11.464951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.464957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:11.464959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:11.464964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:11.464968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:11.465101Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:11.507410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896182140833561:8402]
2025-09-30T14:56:11.507865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2131, pipe: [1:7555896182140833561:8402]
2025-09-30T14:56:11.577566Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:11.585196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:11.585225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:11.585381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:11.585458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:11.585523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:11.585592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:11.585642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:11.585650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:11.585723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:11.585789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:11.585851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:11.586090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:11.586132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:11.586138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:11.586199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:11.586266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:11.586330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:11.586390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:11.586432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:11.586437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:11.586505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:11.586573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:11.586640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:11.586699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:11.586744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:11.586752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:11.586826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:11.586886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:11.586945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:11.587008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:11.587054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:11.587062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:11.587129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:11.587189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:11.587270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:11.587339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:11.587388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:11.587399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:11.587465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:11.587526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:11.587594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:11.587661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:11.587705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:11.587714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:11.587784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:11.587845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:11.587906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:11.587966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:11.588009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:11.588017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:11.588085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:11.588150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:11.588207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:11.588267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:11.588344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:11.588351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:11.588413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:11.588478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:11.588545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:11.588614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:11.588660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:11.588671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:11.588734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896182140833561:8402], now have 1 active actors on pipe
2025-09-30T14:56:11.588996Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:11.589003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896182140833561:8402]
2025-09-30T14:56:11.589031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:11.589033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:11.589060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2132 reason: error at write: Disconnected sessionId: src_id|be4bee7d-f7b21c6d-4f8a41ad-b0d6cde_0
2025-09-30T14:56:11.589551Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:11.589598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be4bee7d-f7b21c6d-4f8a41ad-b0d6cde_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:11.589611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be4bee7d-f7b21c6d-4f8a41ad-b0d6cde_0] Write session will restart in 0.009413s
2025-09-30T14:56:11.589635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be4bee7d-f7b21c6d-4f8a41ad-b0d6cde_0] Write session: Do CDS request
2025-09-30T14:56:11.589640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be4bee7d-f7b21c6d-4f8a41ad-b0d6cde_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:11.589474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2132 sessionId: src_id|be4bee7d-f7b21c6d-4f8a41ad-b0d6cde_0 is DEAD
2025-09-30T14:56:11.599819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be4bee7d-f7b21c6d-4f8a41ad-b0d6cde_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:11.601128Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:11.601146Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2133
2025-09-30T14:56:11.601288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2133 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:11.601333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2133 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:11.601339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2133 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:11.601343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:11.601849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2133 sessionId:  describe result for acl check
2025-09-30T14:56:11.601899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:11.601901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:11.601903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:11.601908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896182140833651:2364] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:11.602451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896182140833651:2364] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:11.605725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896182140833651:2364] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:11.607129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:11.610063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:11.610255Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:11.610263Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:11.610271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:11.610318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:11.610357Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896182051062137:3161]
2025-09-30T14:56:11.610513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896182140833651:2364] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:11.610530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896182140833651:2364] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:11.610534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896182140833651:2364] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:11.610543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2133 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:11.610807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:11.611047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:11.611075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:11.611349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:11.611531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:11.611537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:11.611538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:11.611539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:11.611539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:11.611540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:11.611541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:11.611542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:11.611543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:11.611543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:11.611544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.611545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.611546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.611546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:11.611547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:11.611552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:11.611559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:11.611561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:11.611564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:11.611566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:11.611569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:11.611571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:11.611573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:11.611576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:11.611580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:11.611582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.611584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.611587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.611589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:11.611592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:11.611599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:11.611604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:11.611608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:11.611611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:11.611614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:11.611617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:11.611620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:11.611624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:11.611627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:11.611629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:11.611632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:11.611635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:11.611638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:11.611641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:11.611646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:11.611651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:11.611656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:11.611661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:11.611667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:11.611671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:11.611674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.611677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.611680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.611683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.611685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.611687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.611690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:11.611693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:11.611695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:11.611698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:11.611722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:11.617204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:11.618049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:11.618066Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:11.618069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:11.618073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:11.618079Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2132 [2:7555896182051062137:3161]
2025-09-30T14:56:11.618098Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:11.618114Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:11.618118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:11.618121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:11.618123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:11.618139Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:11.618146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:11.618152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:11.618214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.618223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.618226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.618229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:11.618232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:11.618306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:11.618314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.618327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.618345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.618368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:11.618389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896182140833783:2364], now have 1 active actors on pipe
2025-09-30T14:56:11.618398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896182140833567:2454], now have 1 active actors on pipe
2025-09-30T14:56:11.618404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896182051062132:3161]
2025-09-30T14:56:11.618407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896182051062132:3161]
2025-09-30T14:56:11.618409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896182051062132:3161]
2025-09-30T14:56:11.618421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:11.618435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:11.618457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:11.618457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:11.618460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:11.618463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:11.618464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:11.618498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896182051062132:3161]
2025-09-30T14:56:11.618506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:11.618469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2132
2025-09-30T14:56:11.618509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:11.618475Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2132
2025-09-30T14:56:11.618531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:11.618540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:11.618575Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3ee0929-12837142-bf19201a-cfc96b2d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:11.618586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:11.618590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:11.618592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:11.618601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:11.618609Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:11.618635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:11.618761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:11.618769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:11.618783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:11.618881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2133 partition: 0 MaxSeqNo: 42 sessionId: src_id|b3ee0929-12837142-bf19201a-cfc96b2d_0
2025-09-30T14:56:11.619270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be4bee7d-f7b21c6d-4f8a41ad-b0d6cde_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b3ee0929-12837142-bf19201a-cfc96b2d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:11.622071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ee0929-12837142-bf19201a-cfc96b2d_0] Write session: try to update token
2025-09-30T14:56:11.622091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ee0929-12837142-bf19201a-cfc96b2d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:11.631396Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:11.631420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:11.631423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:11.631425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:11.631436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896182051062132:3161]
2025-09-30T14:56:11.631447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896182051062132:3161]
2025-09-30T14:56:11.631451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896182051062132:3161]
2025-09-30T14:56:11.631497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:11.631505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.631507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:11.631508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:11.631518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:11.631523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:11.631691Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:11.637933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2133 sessionId: src_id|b3ee0929-12837142-bf19201a-cfc96b2d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:11.640790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:11.689152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896182140833796:8402]
2025-09-30T14:56:11.689536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2132, pipe: [1:7555896182140833796:8402]
2025-09-30T14:56:11.744489Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:11.744856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:11.744867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:11.744901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896182140833796:8402], now have 1 active actors on pipe
2025-09-30T14:56:11.745099Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:11.745194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896182140833796:8402]
2025-09-30T14:56:11.745213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:11.745217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:11.745227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:11.745283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2133 reason: error at write: Disconnected sessionId: src_id|b3ee0929-12837142-bf19201a-cfc96b2d_0
2025-09-30T14:56:11.745510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2133 sessionId: src_id|b3ee0929-12837142-bf19201a-cfc96b2d_0 is DEAD
2025-09-30T14:56:11.745642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ee0929-12837142-bf19201a-cfc96b2d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:11.745649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ee0929-12837142-bf19201a-cfc96b2d_0] Write session will restart in 0.005534s
2025-09-30T14:56:11.745672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ee0929-12837142-bf19201a-cfc96b2d_0] Write session: Do CDS request
2025-09-30T14:56:11.745681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ee0929-12837142-bf19201a-cfc96b2d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:11.752830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ee0929-12837142-bf19201a-cfc96b2d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:11.752875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:11.752894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2134
2025-09-30T14:56:11.753106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2134 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:11.753155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2134 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:11.753167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2134 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:11.753173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:11.753669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2134 sessionId:  describe result for acl check
2025-09-30T14:56:11.753704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:11.753709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:11.753712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:11.753718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896182140833814:2388] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:11.754217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896182140833814:2388] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:11.756574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896182140833814:2388] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:11.759883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896182140833814:2388] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:11.759898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896182140833814:2388] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:11.759905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896182140833814:2388] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:11.759913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2134 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:11.762812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:11.765417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:11.765885Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:11.765908Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:11.765927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:11.766039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:11.766096Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896182051062370:3155]
2025-09-30T14:56:11.766811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:11.767190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:11.767269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:11.767627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:11.767698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:11.767709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:11.767710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:11.767711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:11.767713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:11.767714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:11.767716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:11.767717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:11.767718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:11.767720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:11.767721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.767722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.767724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.767725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:11.767727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:11.767733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:11.767744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:11.767748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:11.767753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:11.767758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:11.767762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:11.767766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:11.767770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:11.767775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:11.767780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:11.767784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.767789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.767794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.767798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:11.767802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:11.767811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:11.767819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:11.767825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:11.767831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:11.767837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:11.767843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:11.767848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:11.767854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:11.767859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:11.767865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:11.767870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:11.767876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:11.767887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:11.767898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:11.767912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:11.767922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:11.767928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:11.767939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:11.767944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:11.767954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:11.767964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.767974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.767983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.767993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.767998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.768009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.768013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:11.768019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:11.768026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:11.768035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:11.768082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:11.773742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:11.774850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:11.774869Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:11.774872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:11.774877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:11.774884Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2133 [2:7555896182051062370:3155]
2025-09-30T14:56:11.774906Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:11.774927Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:11.774937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:11.774941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:11.774943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:11.774960Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:11.774968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:11.774975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:11.775046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.775057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.775059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.775063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:11.775066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:11.775147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:11.775158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.775173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.775186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.775206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:11.775225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896182140833798:2454], now have 1 active actors on pipe
2025-09-30T14:56:11.775230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896182140833974:2388], now have 1 active actors on pipe
2025-09-30T14:56:11.775553Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2133
2025-09-30T14:56:11.775596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2133
2025-09-30T14:56:11.775236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896182051062365:3155]
2025-09-30T14:56:11.775262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896182051062365:3155]
2025-09-30T14:56:11.775264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896182051062365:3155]
2025-09-30T14:56:11.775283Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:11.775298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:11.775314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:11.775317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:11.775356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896182051062365:3155]
2025-09-30T14:56:11.775359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:11.775405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:11.775413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:11.775415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:11.775422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:11.775841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:11.775866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:11.775901Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71e9f61d-717d09a4-9fd8aa42-637ad284_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:11.775916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:11.775938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:11.775946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:11.775959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:11.775971Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:11.775999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:11.776214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:11.776222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:11.776235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:11.776312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2134 partition: 0 MaxSeqNo: 42 sessionId: src_id|71e9f61d-717d09a4-9fd8aa42-637ad284_0
2025-09-30T14:56:11.776712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ee0929-12837142-bf19201a-cfc96b2d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|71e9f61d-717d09a4-9fd8aa42-637ad284_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:11.779477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71e9f61d-717d09a4-9fd8aa42-637ad284_0] Write session: try to update token
2025-09-30T14:56:11.779495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71e9f61d-717d09a4-9fd8aa42-637ad284_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:11.787858Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:11.787875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:11.787877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:11.787879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:11.787888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896182051062365:3155]
2025-09-30T14:56:11.787891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896182051062365:3155]
2025-09-30T14:56:11.787894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896182051062365:3155]
2025-09-30T14:56:11.787927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:11.787932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.787933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:11.787953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:11.787960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:11.787967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:11.788057Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:11.794373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2134 sessionId: src_id|71e9f61d-717d09a4-9fd8aa42-637ad284_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:11.797358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:11.845318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896182140834027:8402]
2025-09-30T14:56:11.845650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2133, pipe: [1:7555896182140834027:8402]
2025-09-30T14:56:11.901756Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:11.902074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:11.902089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:11.902128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896182140834027:8402], now have 1 active actors on pipe
2025-09-30T14:56:11.902385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:11.902400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:11.902425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896182140834027:8402]
2025-09-30T14:56:11.902448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:11.902465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2134 reason: error at write: Disconnected sessionId: src_id|71e9f61d-717d09a4-9fd8aa42-637ad284_0
2025-09-30T14:56:11.902654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2134 sessionId: src_id|71e9f61d-717d09a4-9fd8aa42-637ad284_0 is DEAD
2025-09-30T14:56:11.902816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71e9f61d-717d09a4-9fd8aa42-637ad284_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:11.902828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71e9f61d-717d09a4-9fd8aa42-637ad284_0] Write session will restart in 0.006518s
2025-09-30T14:56:11.902853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71e9f61d-717d09a4-9fd8aa42-637ad284_0] Write session: Do CDS request
2025-09-30T14:56:11.902860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71e9f61d-717d09a4-9fd8aa42-637ad284_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:11.903206Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:11.910799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71e9f61d-717d09a4-9fd8aa42-637ad284_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:11.910869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:11.910897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2135
2025-09-30T14:56:11.911053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2135 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:11.911091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2135 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:11.911112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2135 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:11.911116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:11.911596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2135 sessionId:  describe result for acl check
2025-09-30T14:56:11.911649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:11.911651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:11.911653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:11.911660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896182140834056:2389] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:11.912220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896182140834056:2389] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:11.916109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896182140834056:2389] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:11.919500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896182140834056:2389] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:11.919520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896182140834056:2389] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:11.919524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896182140834056:2389] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:11.919533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2135 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:11.920720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:11.923810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:11.924061Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:11.924074Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:11.924087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:11.924148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:11.924194Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896182051062592:3151]
2025-09-30T14:56:11.924911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:11.925354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:11.925438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:11.925813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:11.925902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:11.925911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:11.925912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:11.925913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:11.925915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:11.925916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:11.925918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:11.925919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:11.925920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:11.925922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:11.925923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.925925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.925926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.925927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:11.925929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:11.925935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:11.925947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:11.925952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:11.925956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:11.925961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:11.925965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:11.925969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:11.925974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:11.925978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:11.925983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:11.925987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.925991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.925995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.926000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:11.926004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:11.926014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:11.926029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:11.926050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:11.926062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:11.926068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:11.926079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:11.926084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:11.926092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:11.926105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:11.926111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:11.926115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:11.926126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:11.926131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:11.926141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:11.926146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:11.926166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:11.926170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:11.926180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:11.926185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:11.926195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:11.926199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.926209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.926213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.926223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.926228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.926233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.926242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:11.926247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:11.926256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:11.926262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:11.926307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:11.931946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:11.932909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:11.932927Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:11.932930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:11.932934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:11.932942Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2134 [2:7555896182051062592:3151]
2025-09-30T14:56:11.932960Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:11.932982Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:11.932991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:11.932994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:11.932997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:11.933015Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:11.933027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:11.933034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:11.933106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.933112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.933115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.933118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:11.933121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:11.933380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2134
2025-09-30T14:56:11.933385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2134
2025-09-30T14:56:11.933588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:11.933598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.933613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:11.933628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:11.933649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:11.933670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896182140834029:2454], now have 1 active actors on pipe
2025-09-30T14:56:11.933680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896182140834244:2389], now have 1 active actors on pipe
2025-09-30T14:56:11.933694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:11.933703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:11.933722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896182051062587:3151]
2025-09-30T14:56:11.933729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896182051062587:3151]
2025-09-30T14:56:11.933733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896182051062587:3151]
2025-09-30T14:56:11.933746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:11.933763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:11.933765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:11.933772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:11.933775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:11.933781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:11.933784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:11.933799Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d465c6ad-3a74de14-c5257c62-651789ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:11.933812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:11.933815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:11.933817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:11.933827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:11.933842Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:11.933883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896182051062587:3151]
2025-09-30T14:56:11.933895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:11.933901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:11.933912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:11.934053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:11.934061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:11.934076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:11.934165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2135 partition: 0 MaxSeqNo: 42 sessionId: src_id|d465c6ad-3a74de14-c5257c62-651789ec_0
2025-09-30T14:56:11.934539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71e9f61d-717d09a4-9fd8aa42-637ad284_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d465c6ad-3a74de14-c5257c62-651789ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:11.937609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d465c6ad-3a74de14-c5257c62-651789ec_0] Write session: try to update token
2025-09-30T14:56:11.937630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d465c6ad-3a74de14-c5257c62-651789ec_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:11.946861Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:11.946884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:11.946895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896182051062587:3151]
2025-09-30T14:56:11.946944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:11.946948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:11.947137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:11.947337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:11.947556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:11.947786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:11.948112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:11.948158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:11.953905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2135 sessionId: src_id|d465c6ad-3a74de14-c5257c62-651789ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:11.956795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:11.958665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:11.957251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:11.957277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:11.958530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:11.958558Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:11.958561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:11.958564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:11.958566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:11.958576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896182051062587:3151]
2025-09-30T14:56:11.958580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896182051062587:3151]
2025-09-30T14:56:11.958584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896182051062587:3151]
2025-09-30T14:56:11.958614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:11.958617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:11.958620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:11.958624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:11.958624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:11.958627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:11.958766Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:12.002529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896186435801566:8402]
2025-09-30T14:56:12.002823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2134, pipe: [1:7555896186435801566:8402]
2025-09-30T14:56:12.070618Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:12.079072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:12.079109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:12.079314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:12.079376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:12.079441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:12.079506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:12.079558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:12.079572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:12.079651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:12.079734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:12.079808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:12.079885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:12.079929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:12.079938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:12.080014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:12.080075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:12.080142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:12.080220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:12.080271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:12.080280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:12.080354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:12.080433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:12.080510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:12.080583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:12.080635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:12.080642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:12.080717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:12.080790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:12.080860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:12.080940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:12.080993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:12.081001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:12.081076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:12.081151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:12.081217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:12.081292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:12.081459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:12.081469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:12.081539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:12.081606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:12.081681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:12.081752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:12.081796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:12.081803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:12.081870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:12.081930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:12.081996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:12.082060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:12.082108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:12.082116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:12.082185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:12.082256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:12.082318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:12.082382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:12.082432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:12.082439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:12.082510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:12.082573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:12.082639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:12.082704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:12.082759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:12.082762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:12.082828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896186435801566:8402], now have 1 active actors on pipe
2025-09-30T14:56:12.083499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:12.083531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896186435801566:8402]
2025-09-30T14:56:12.083645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:12.083657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:12.083690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2135 reason: error at write: Disconnected sessionId: src_id|d465c6ad-3a74de14-c5257c62-651789ec_0
2025-09-30T14:56:12.083882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2135 sessionId: src_id|d465c6ad-3a74de14-c5257c62-651789ec_0 is DEAD
2025-09-30T14:56:12.084042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d465c6ad-3a74de14-c5257c62-651789ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:12.084052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d465c6ad-3a74de14-c5257c62-651789ec_0] Write session will restart in 0.009089s
2025-09-30T14:56:12.084076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d465c6ad-3a74de14-c5257c62-651789ec_0] Write session: Do CDS request
2025-09-30T14:56:12.084081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d465c6ad-3a74de14-c5257c62-651789ec_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:12.084229Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:12.094802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d465c6ad-3a74de14-c5257c62-651789ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:12.094925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:12.094942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2136
2025-09-30T14:56:12.095081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2136 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:12.095115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2136 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:12.095124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2136 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:12.095128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:12.096027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2136 sessionId:  describe result for acl check
2025-09-30T14:56:12.096061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:12.096063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:12.096065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:12.096071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896186435801594:2398] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:12.096616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896186435801594:2398] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:12.100643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896186435801594:2398] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:12.104533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896186435801594:2398] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:12.104552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896186435801594:2398] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:12.104556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896186435801594:2398] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:12.104564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2136 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:12.106050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:12.108926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:12.109142Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:12.109153Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:12.109164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:12.109214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:12.109260Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896186346030112:3145]
2025-09-30T14:56:12.109979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:12.110295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:12.110340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:12.110678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:12.110738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:12.110744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:12.110746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:12.110747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:12.110748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:12.110749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:12.110751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:12.110752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:12.110754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:12.110755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:12.110756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.110757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.110759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.110760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:12.110761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:12.110765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:12.110776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:12.110780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:12.110784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:12.110788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:12.110792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:12.110796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:12.110800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:12.110804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:12.110808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:12.110812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.110816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.110820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.110824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:12.110828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:12.110835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:12.110844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:12.110850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:12.110855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:12.110859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:12.110864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:12.110869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:12.110876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:12.110886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:12.110892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:12.110901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:12.110907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:12.110911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:12.110921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:12.110926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:12.110931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:12.110941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:12.110946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:12.110955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:12.110960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:12.110966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.110976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.110981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.110988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.110997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.111002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.111011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:12.111019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:12.111023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:12.111033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:12.111076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:12.117053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:12.118151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:12.118168Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:12.118171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:12.118175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:12.118182Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2135 [2:7555896186346030112:3145]
2025-09-30T14:56:12.118199Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:12.118215Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:12.118219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:12.118221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:12.118224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:12.118240Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:12.118246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:12.118253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:12.118314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.118321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.118323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.118327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:12.118330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:12.118397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:12.118404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.118417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.118428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.118453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:12.118473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896186435801785:2398], now have 1 active actors on pipe
2025-09-30T14:56:12.118476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896186435801569:2454], now have 1 active actors on pipe
2025-09-30T14:56:12.118606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2135
2025-09-30T14:56:12.118483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896186346030107:3145]
2025-09-30T14:56:12.118485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896186346030107:3145]
2025-09-30T14:56:12.118487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896186346030107:3145]
2025-09-30T14:56:12.118499Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:12.118513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:12.118617Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2135
2025-09-30T14:56:12.118514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:12.118517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:12.118520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:12.118527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:12.118530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:12.118566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896186346030107:3145]
2025-09-30T14:56:12.118572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:12.118578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:12.118694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:12.118705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:12.118742Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa9f34fe-c8f0d548-56318c37-fccbe081_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:12.118760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:12.118768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:12.118771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:12.118783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:12.118801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:12.118825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:12.118963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:12.118972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:12.118986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:12.119092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2136 partition: 0 MaxSeqNo: 42 sessionId: src_id|aa9f34fe-c8f0d548-56318c37-fccbe081_0
2025-09-30T14:56:12.119472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d465c6ad-3a74de14-c5257c62-651789ec_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|aa9f34fe-c8f0d548-56318c37-fccbe081_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:12.122399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa9f34fe-c8f0d548-56318c37-fccbe081_0] Write session: try to update token
2025-09-30T14:56:12.122419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa9f34fe-c8f0d548-56318c37-fccbe081_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:12.131751Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:12.131776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:12.131779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:12.131782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:12.131793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896186346030107:3145]
2025-09-30T14:56:12.131797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896186346030107:3145]
2025-09-30T14:56:12.131801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896186346030107:3145]
2025-09-30T14:56:12.131853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:12.131861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.131861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:12.131863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:12.131868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:12.131877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:12.132016Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:12.138149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2136 sessionId: src_id|aa9f34fe-c8f0d548-56318c37-fccbe081_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:12.141172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:12.183764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896186435801803:8402]
2025-09-30T14:56:12.184132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2135, pipe: [1:7555896186435801803:8402]
2025-09-30T14:56:12.249660Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:12.250543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:12.250561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:12.250602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896186435801803:8402], now have 1 active actors on pipe
2025-09-30T14:56:12.250774Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:12.251020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896186435801803:8402]
2025-09-30T14:56:12.251057Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:12.251089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:12.251154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2136 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aa9f34fe-c8f0d548-56318c37-fccbe081_0
2025-09-30T14:56:12.251361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2136 sessionId: src_id|aa9f34fe-c8f0d548-56318c37-fccbe081_0 is DEAD
2025-09-30T14:56:12.251718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa9f34fe-c8f0d548-56318c37-fccbe081_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:12.251730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa9f34fe-c8f0d548-56318c37-fccbe081_0] Write session will restart in 0.005509s
2025-09-30T14:56:12.251765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa9f34fe-c8f0d548-56318c37-fccbe081_0] Write session: Do CDS request
2025-09-30T14:56:12.251771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa9f34fe-c8f0d548-56318c37-fccbe081_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:12.258770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa9f34fe-c8f0d548-56318c37-fccbe081_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:12.258885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:12.258903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2137
2025-09-30T14:56:12.259154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2137 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:12.259192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2137 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:12.259197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2137 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:12.259201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:12.259621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2137 sessionId:  describe result for acl check
2025-09-30T14:56:12.259654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:12.259656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:12.259658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:12.259663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896186435801836:2431] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:12.260160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896186435801836:2431] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:12.263137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896186435801836:2431] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:12.266708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896186435801836:2431] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:12.266727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896186435801836:2431] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:12.266731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896186435801836:2431] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:12.266742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2137 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:12.270569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:12.272999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:12.273192Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:12.273203Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:12.273214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:12.273263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:12.273302Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896186346030370:3140]
2025-09-30T14:56:12.273995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:12.274286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:12.274331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:12.274659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:12.274719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:12.274728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:12.274729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:12.274731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:12.274732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:12.274734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:12.274735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:12.274736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:12.274737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:12.274738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:12.274739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.274741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.274742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.274743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:12.274745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:12.274750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:12.274760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:12.274764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:12.274768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:12.274773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:12.274777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:12.274782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:12.274787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:12.274791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:12.274796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:12.274800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.274805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.274810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.274814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:12.274819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:12.274827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:12.274835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:12.274841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:12.274847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:12.274853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:12.274858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:12.274863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:12.274870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:12.274875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:12.274880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:12.274885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:12.274891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:12.274897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:12.274906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:12.274910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:12.274916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:12.274921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:12.274927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:12.274931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:12.274937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:12.274947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.274953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.274961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.274967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.274977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.274984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.274993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:12.274999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:12.275004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:12.275014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:12.275062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:12.280693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:12.281701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:12.281719Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:12.281722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:12.281726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:12.281734Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2136 [2:7555896186346030370:3140]
2025-09-30T14:56:12.281750Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:12.281768Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:12.281772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:12.281775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:12.281777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:12.281793Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:12.281806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:12.281814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:12.281872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.281881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.281884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.281887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:12.281890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:12.281960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:12.281969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.281983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.282001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.282023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:12.282046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896186435801821:2454], now have 1 active actors on pipe
2025-09-30T14:56:12.282049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896186435801997:2431], now have 1 active actors on pipe
2025-09-30T14:56:12.282056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896186346030365:3140]
2025-09-30T14:56:12.282059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896186346030365:3140]
2025-09-30T14:56:12.282061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896186346030365:3140]
2025-09-30T14:56:12.282076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:12.282090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:12.282095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:12.282098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:12.282101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:12.282111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:12.282114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:12.282111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2136
2025-09-30T14:56:12.282147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896186346030365:3140]
2025-09-30T14:56:12.282152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2136
2025-09-30T14:56:12.282160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:12.282166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:12.282180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:12.282187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:12.282233Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c13059d9-d0327b23-e1f43ac5-a82aba58_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:12.282248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:12.282252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:12.282254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:12.282263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:12.282271Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:12.282297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:12.282497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:12.282508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:12.282521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:12.282615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2137 partition: 0 MaxSeqNo: 42 sessionId: src_id|c13059d9-d0327b23-e1f43ac5-a82aba58_0
2025-09-30T14:56:12.283031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa9f34fe-c8f0d548-56318c37-fccbe081_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c13059d9-d0327b23-e1f43ac5-a82aba58_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:12.285872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c13059d9-d0327b23-e1f43ac5-a82aba58_0] Write session: try to update token
2025-09-30T14:56:12.285896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c13059d9-d0327b23-e1f43ac5-a82aba58_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:12.297069Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:12.297091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:12.297093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:12.297095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:12.297106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896186346030365:3140]
2025-09-30T14:56:12.297110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896186346030365:3140]
2025-09-30T14:56:12.297115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896186346030365:3140]
2025-09-30T14:56:12.297154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:12.297158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:12.297162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.297164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:12.297165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:12.297167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:12.297316Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:12.304130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2137 sessionId: src_id|c13059d9-d0327b23-e1f43ac5-a82aba58_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:12.306970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:12.351172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896186435802061:8402]
2025-09-30T14:56:12.351526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2136, pipe: [1:7555896186435802061:8402]
2025-09-30T14:56:12.409173Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:12.409812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:12.409832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:12.409874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896186435802061:8402], now have 1 active actors on pipe
2025-09-30T14:56:12.410165Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:12.410190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:12.410211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:12.410287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2137 reason: error at write: Disconnected sessionId: src_id|c13059d9-d0327b23-e1f43ac5-a82aba58_0
2025-09-30T14:56:12.410484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2137 sessionId: src_id|c13059d9-d0327b23-e1f43ac5-a82aba58_0 is DEAD
2025-09-30T14:56:12.410647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c13059d9-d0327b23-e1f43ac5-a82aba58_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:12.410658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c13059d9-d0327b23-e1f43ac5-a82aba58_0] Write session will restart in 0.009980s
2025-09-30T14:56:12.410686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c13059d9-d0327b23-e1f43ac5-a82aba58_0] Write session: Do CDS request
2025-09-30T14:56:12.410691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c13059d9-d0327b23-e1f43ac5-a82aba58_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:12.410672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896186435802061:8402]
2025-09-30T14:56:12.410703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:12.421982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c13059d9-d0327b23-e1f43ac5-a82aba58_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:12.422115Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:12.422134Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2138
2025-09-30T14:56:12.422279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2138 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:12.422316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2138 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:12.422322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2138 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:12.422326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:12.422889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2138 sessionId:  describe result for acl check
2025-09-30T14:56:12.422930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:12.422937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:12.422939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:12.422945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896186435802118:2452] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:12.423648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896186435802118:2452] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:12.425777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896186435802118:2452] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:12.429052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896186435802118:2452] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:12.429070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896186435802118:2452] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:12.429074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896186435802118:2452] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:12.429082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2138 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:12.432963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:12.435636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:12.435840Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:12.435844Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:12.435854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:12.435899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:12.435932Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896186346030593:3126]
2025-09-30T14:56:12.436458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:12.436761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:12.436806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:12.437140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:12.437207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:12.437214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:12.437215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:12.437216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:12.437218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:12.437219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:12.437220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:12.437222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:12.437223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:12.437224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:12.437226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.437227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.437228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.437229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:12.437230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:12.437235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:12.437247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:12.437251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:12.437256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:12.437260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:12.437264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:12.437269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:12.437273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:12.437277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:12.437283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:12.437288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.437292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.437296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.437300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:12.437304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:12.437314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:12.437320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:12.437326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:12.437332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:12.437337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:12.437343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:12.437347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:12.437352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:12.437358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:12.437363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:12.437368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:12.437374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:12.437379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:12.437384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:12.437401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:12.437406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:12.437412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:12.437417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:12.437422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:12.437430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:12.437445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.437450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.437455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.437460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.437464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.437469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.437474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:12.437479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:12.437484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:12.437489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:12.437529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:12.443166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:12.444350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:12.444366Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:12.444368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:12.444373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:12.444379Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2137 [2:7555896186346030593:3126]
2025-09-30T14:56:12.444395Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:12.444414Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:12.444423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:12.444427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:12.444429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:12.444445Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:12.444452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:12.444459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:12.444518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.444525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.444528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.444532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:12.444534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:12.444598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:12.444615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.444634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.444649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.444780Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2137
2025-09-30T14:56:12.444784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2137
2025-09-30T14:56:12.444670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:12.444694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896186435802063:2454], now have 1 active actors on pipe
2025-09-30T14:56:12.444697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896186435802247:2452], now have 1 active actors on pipe
2025-09-30T14:56:12.444704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896186346030588:3126]
2025-09-30T14:56:12.444706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896186346030588:3126]
2025-09-30T14:56:12.444708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896186346030588:3126]
2025-09-30T14:56:12.444721Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:12.444733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:12.444738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:12.444742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:12.444745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:12.444747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:12.444750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:12.444783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896186346030588:3126]
2025-09-30T14:56:12.444790Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:12.444846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:12.445000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:12.445014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:12.445041Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be880113-31ac3839-769f5aaf-961d2453_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:12.445054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:12.445064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:12.445067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:12.445078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:12.445094Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:12.445112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:12.445341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:12.445355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:12.445377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:12.445508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2138 partition: 0 MaxSeqNo: 42 sessionId: src_id|be880113-31ac3839-769f5aaf-961d2453_0
2025-09-30T14:56:12.445892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c13059d9-d0327b23-e1f43ac5-a82aba58_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|be880113-31ac3839-769f5aaf-961d2453_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:12.448676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be880113-31ac3839-769f5aaf-961d2453_0] Write session: try to update token
2025-09-30T14:56:12.448695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be880113-31ac3839-769f5aaf-961d2453_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:12.460259Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:12.460278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:12.460280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:12.460281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:12.460290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896186346030588:3126]
2025-09-30T14:56:12.460294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896186346030588:3126]
2025-09-30T14:56:12.460298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896186346030588:3126]
2025-09-30T14:56:12.460337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:12.460342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.460343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:12.460349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:12.460356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:12.460360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:12.460492Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:12.465788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2138 sessionId: src_id|be880113-31ac3839-769f5aaf-961d2453_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:12.468613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:12.510937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896186435802295:8402]
2025-09-30T14:56:12.511296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2137, pipe: [1:7555896186435802295:8402]
2025-09-30T14:56:12.571660Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:12.572267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:12.572286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:12.572327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896186435802295:8402], now have 1 active actors on pipe
2025-09-30T14:56:12.572563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896186435802295:8402]
2025-09-30T14:56:12.572583Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:12.572577Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:12.572599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:12.572602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:12.572664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2138 reason: error at write: Disconnected sessionId: src_id|be880113-31ac3839-769f5aaf-961d2453_0
2025-09-30T14:56:12.572860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2138 sessionId: src_id|be880113-31ac3839-769f5aaf-961d2453_0 is DEAD
2025-09-30T14:56:12.573012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be880113-31ac3839-769f5aaf-961d2453_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:12.573022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be880113-31ac3839-769f5aaf-961d2453_0] Write session will restart in 0.005883s
2025-09-30T14:56:12.573045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be880113-31ac3839-769f5aaf-961d2453_0] Write session: Do CDS request
2025-09-30T14:56:12.573054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be880113-31ac3839-769f5aaf-961d2453_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:12.579780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be880113-31ac3839-769f5aaf-961d2453_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:12.580023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:12.580040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2139
2025-09-30T14:56:12.580197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2139 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:12.580247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2139 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:12.580253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2139 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:12.580258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:12.580734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2139 sessionId:  describe result for acl check
2025-09-30T14:56:12.580764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:12.580767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:12.580769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:12.580775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896186435802312:2449] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:12.581321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896186435802312:2449] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:12.584686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896186435802312:2449] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:12.588242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896186435802312:2449] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:12.588261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896186435802312:2449] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:12.588265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896186435802312:2449] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:12.588272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2139 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:12.592410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:12.595587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:12.595821Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:12.595834Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:12.595845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:12.595904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:12.595955Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896186346030819:3121]
2025-09-30T14:56:12.596614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:12.597095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:12.597161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:12.597584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:12.597656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:12.597663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:12.597665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:12.597666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:12.597667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:12.597669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:12.597671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:12.597672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:12.597673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:12.597675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:12.597676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.597678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.597679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.597680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:12.597682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:12.597689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:12.597701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:12.597706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:12.597711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:12.597715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:12.597719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:12.597722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:12.597726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:12.597731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:12.597736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:12.597741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.597745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.597749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.597752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:12.597757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:12.597766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:12.597775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:12.597782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:12.597789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:12.597794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:12.597800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:12.597811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:12.597818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:12.597824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:12.597830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:12.597835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:12.597841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:12.597847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:12.597879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:12.597890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:12.597896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:12.597902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:12.597915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:12.597921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:12.597927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:12.597933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.597938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.597943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.597948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.597954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.597959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.597964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:12.597970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:12.597976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:12.597982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:12.598035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:12.604183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:12.605496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:12.605516Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:12.605519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:12.605523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:12.605531Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2138 [2:7555896186346030819:3121]
2025-09-30T14:56:12.605548Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:12.605566Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:12.605575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:12.605579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:12.605582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:12.605598Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:12.605606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:12.605614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:12.605679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.605687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.605689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.605692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:12.605695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:12.605769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:12.605777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.605792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.605808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.605834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:12.605858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896186435802297:2454], now have 1 active actors on pipe
2025-09-30T14:56:12.605870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896186346030814:3121]
2025-09-30T14:56:12.605873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896186346030814:3121]
2025-09-30T14:56:12.605875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896186346030814:3121]
2025-09-30T14:56:12.605889Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:12.605905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896186435802446:2449], now have 1 active actors on pipe
2025-09-30T14:56:12.605914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:12.605912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:12.605918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:12.605921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:12.605929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:12.605932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:12.606021Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2138
2025-09-30T14:56:12.606037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2138
2025-09-30T14:56:12.606112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896186346030814:3121]
2025-09-30T14:56:12.606125Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:12.606157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:12.606164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:12.606168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:12.606210Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5246e53-6a0a2d5d-96cdc8cd-c05d97c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:12.606222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:12.606225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:12.606227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:12.606237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:12.606252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:12.606275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:12.606527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:12.606550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:12.606589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:12.606738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2139 partition: 0 MaxSeqNo: 42 sessionId: src_id|c5246e53-6a0a2d5d-96cdc8cd-c05d97c0_0
2025-09-30T14:56:12.607241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be880113-31ac3839-769f5aaf-961d2453_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c5246e53-6a0a2d5d-96cdc8cd-c05d97c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:12.610323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5246e53-6a0a2d5d-96cdc8cd-c05d97c0_0] Write session: try to update token
2025-09-30T14:56:12.610364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5246e53-6a0a2d5d-96cdc8cd-c05d97c0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:12.619519Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:12.619546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:12.619550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:12.619553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:12.619566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896186346030814:3121]
2025-09-30T14:56:12.619572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896186346030814:3121]
2025-09-30T14:56:12.619577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896186346030814:3121]
2025-09-30T14:56:12.619630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:12.619641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:12.619647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.619650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:12.619651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:12.619656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:12.619833Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:12.631725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2139 sessionId: src_id|c5246e53-6a0a2d5d-96cdc8cd-c05d97c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:12.635168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:12.672741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896186435802532:8402]
2025-09-30T14:56:12.673115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2138, pipe: [1:7555896186435802532:8402]
2025-09-30T14:56:12.743660Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:12.744775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:12.744807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:12.744834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896186435802532:8402], now have 1 active actors on pipe
2025-09-30T14:56:12.745125Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:12.745108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:12.745127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:12.745134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896186435802532:8402]
2025-09-30T14:56:12.745163Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:12.745221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2139 reason: error at write: Disconnected sessionId: src_id|c5246e53-6a0a2d5d-96cdc8cd-c05d97c0_0
2025-09-30T14:56:12.745406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2139 sessionId: src_id|c5246e53-6a0a2d5d-96cdc8cd-c05d97c0_0 is DEAD
2025-09-30T14:56:12.745552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5246e53-6a0a2d5d-96cdc8cd-c05d97c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:12.745562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5246e53-6a0a2d5d-96cdc8cd-c05d97c0_0] Write session will restart in 0.009527s
2025-09-30T14:56:12.745603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5246e53-6a0a2d5d-96cdc8cd-c05d97c0_0] Write session: Do CDS request
2025-09-30T14:56:12.745609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5246e53-6a0a2d5d-96cdc8cd-c05d97c0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:12.756826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5246e53-6a0a2d5d-96cdc8cd-c05d97c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:12.756930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:12.756953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2140
2025-09-30T14:56:12.757147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2140 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:12.757215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2140 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:12.757231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2140 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:12.757237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:12.757928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2140 sessionId:  describe result for acl check
2025-09-30T14:56:12.757978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:12.757986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:12.757988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:12.757997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896186435802614:2457] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:12.758727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896186435802614:2457] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:12.761437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896186435802614:2457] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:12.763302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:12.766160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:12.766379Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:12.766392Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:12.766403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:12.766465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:12.766509Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896186346031055:3110]
2025-09-30T14:56:12.766575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896186435802614:2457] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:12.766597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896186435802614:2457] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:12.766602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896186435802614:2457] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:12.766613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2140 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:12.767188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:12.767648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:12.767715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:12.768090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:12.768182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:12.768196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:12.768198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:12.768199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:12.768200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:12.768202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:12.768203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:12.768204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:12.768206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:12.768207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:12.768208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.768209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.768211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.768212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:12.768213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:12.768219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:12.768230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:12.768234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:12.768239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:12.768243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:12.768247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:12.768251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:12.768255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:12.768259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:12.768263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:12.768267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.768271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.768276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.768280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:12.768283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:12.768292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:12.768299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:12.768304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:12.768310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:12.768315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:12.768320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:12.768325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:12.768330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:12.768335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:12.768341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:12.768346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:12.768352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:12.768357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:12.768363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:12.768368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:12.768374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:12.768380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:12.768385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:12.768390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:12.768396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:12.768401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.768406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.768411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.768417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.768423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.768429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.768433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:12.768438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:12.768443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:12.768449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:12.768495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:12.774469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:12.775617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:12.775635Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:12.775638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:12.775642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:12.775649Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2139 [2:7555896186346031055:3110]
2025-09-30T14:56:12.775668Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:12.775684Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:12.775687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:12.775690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:12.775693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:12.775710Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:12.775719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:12.775725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:12.775792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.775802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.775804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.775807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:12.775810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:12.775876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:12.775884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.775897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.775910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.775926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:12.775951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896186435802758:2457], now have 1 active actors on pipe
2025-09-30T14:56:12.775960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896186435802534:2454], now have 1 active actors on pipe
2025-09-30T14:56:12.775966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896186346031050:3110]
2025-09-30T14:56:12.775968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896186346031050:3110]
2025-09-30T14:56:12.775971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896186346031050:3110]
2025-09-30T14:56:12.775983Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:12.775996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:12.776001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:12.776007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:12.776010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:12.776016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:12.776019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:12.776052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896186346031050:3110]
2025-09-30T14:56:12.776066Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:12.776072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:12.776121Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2139
2025-09-30T14:56:12.776175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2139
2025-09-30T14:56:12.776239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:12.776249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:12.776273Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5bd0fa4-95c174ff-49cc1e48-9ac64dfb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:12.776284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:12.776288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:12.776290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:12.776301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:12.776311Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:12.776324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:12.776583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:12.776596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:12.776634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:12.776728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2140 partition: 0 MaxSeqNo: 42 sessionId: src_id|5bd0fa4-95c174ff-49cc1e48-9ac64dfb_0
2025-09-30T14:56:12.777071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5246e53-6a0a2d5d-96cdc8cd-c05d97c0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5bd0fa4-95c174ff-49cc1e48-9ac64dfb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:12.779999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bd0fa4-95c174ff-49cc1e48-9ac64dfb_0] Write session: try to update token
2025-09-30T14:56:12.780019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bd0fa4-95c174ff-49cc1e48-9ac64dfb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:12.790508Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:12.790533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:12.790536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:12.790539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:12.790550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896186346031050:3110]
2025-09-30T14:56:12.790556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896186346031050:3110]
2025-09-30T14:56:12.790563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896186346031050:3110]
2025-09-30T14:56:12.790624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:12.790631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:12.790641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:12.790642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.790645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:12.790645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:12.790890Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:12.797689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2140 sessionId: src_id|5bd0fa4-95c174ff-49cc1e48-9ac64dfb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:12.801015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:12.845243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896186435802769:8402]
2025-09-30T14:56:12.845946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2139, pipe: [1:7555896186435802769:8402]
2025-09-30T14:56:12.907557Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:12.907903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:12.907925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:12.907978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896186435802769:8402], now have 1 active actors on pipe
2025-09-30T14:56:12.908222Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:12.908285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896186435802769:8402]
2025-09-30T14:56:12.908297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:12.908319Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:12.908377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2140 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5bd0fa4-95c174ff-49cc1e48-9ac64dfb_0
2025-09-30T14:56:12.908545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2140 sessionId: src_id|5bd0fa4-95c174ff-49cc1e48-9ac64dfb_0 is DEAD
2025-09-30T14:56:12.908706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bd0fa4-95c174ff-49cc1e48-9ac64dfb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:12.908717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bd0fa4-95c174ff-49cc1e48-9ac64dfb_0] Write session will restart in 0.007316s
2025-09-30T14:56:12.908742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bd0fa4-95c174ff-49cc1e48-9ac64dfb_0] Write session: Do CDS request
2025-09-30T14:56:12.908747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bd0fa4-95c174ff-49cc1e48-9ac64dfb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:12.916770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bd0fa4-95c174ff-49cc1e48-9ac64dfb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:12.916893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:12.916912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2141
2025-09-30T14:56:12.917081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2141 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:12.917129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2141 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:12.917141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2141 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:12.917145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:12.917721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2141 sessionId:  describe result for acl check
2025-09-30T14:56:12.917762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:12.917769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:12.917771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:12.917778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896186435802787:2463] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:12.918346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896186435802787:2463] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:12.920961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896186435802787:2463] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:12.924331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896186435802787:2463] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:12.924345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896186435802787:2463] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:12.924349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896186435802787:2463] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:12.924356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2141 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:12.932023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:12.934312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:12.934549Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:12.934560Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:12.934570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:12.934627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:12.934683Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896186346031284:3104]
2025-09-30T14:56:12.935401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:12.935751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:12.935810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:12.936155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:12.936211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:12.936219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:12.936220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:12.936221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:12.936222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:12.936223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:12.936224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:12.936225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:12.936227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:12.936228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:12.936230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.936231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.936232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.936233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:12.936234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:12.936240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:12.936250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:12.936254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:12.936259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:12.936263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:12.936267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:12.936270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:12.936273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:12.936275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:12.936278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:12.936280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.936283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.936286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.936288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:12.936290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:12.936299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:12.936304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:12.936309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:12.936312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:12.936315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:12.936319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:12.936322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:12.936325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:12.936329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:12.936333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:12.936337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:12.936342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:12.936347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:12.936352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:12.936357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:12.936362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:12.936366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:12.936373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:12.936378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:12.936384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:12.936389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.936394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.936399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.936405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.936410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.936414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.936417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:12.936419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:12.936423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:12.936426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:12.936451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:12.942310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:12.943378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:12.943395Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:12.943398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:12.943402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:12.943408Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2140 [2:7555896186346031284:3104]
2025-09-30T14:56:12.943428Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:12.943442Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:12.943451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:12.943454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:12.943456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:12.943472Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:12.943483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:12.943489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:12.943544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.943552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.943554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.943558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:12.943561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:12.943628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:12.943635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.943649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:12.943667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:12.943686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:12.943708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896186346031279:3104]
2025-09-30T14:56:12.943714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896186346031279:3104]
2025-09-30T14:56:12.943716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896186346031279:3104]
2025-09-30T14:56:12.943725Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:12.943743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896186435802945:2463], now have 1 active actors on pipe
2025-09-30T14:56:12.943748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:12.943753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:12.943754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:12.943755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:12.943769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:12.943772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:12.943779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896186435802771:2454], now have 1 active actors on pipe
2025-09-30T14:56:12.943811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896186346031279:3104]
2025-09-30T14:56:12.943827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:12.943827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2140
2025-09-30T14:56:12.943831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2140
2025-09-30T14:56:12.943863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:12.944022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:12.944033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:12.944060Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9015b49b-cd883407-e6e2461-f6cc66ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:12.944076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:12.944080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:12.944083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:12.944093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:12.944103Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:12.944118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:12.944330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:12.944342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:12.944362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:12.944477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2141 partition: 0 MaxSeqNo: 42 sessionId: src_id|9015b49b-cd883407-e6e2461-f6cc66ca_0
2025-09-30T14:56:12.946563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bd0fa4-95c174ff-49cc1e48-9ac64dfb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9015b49b-cd883407-e6e2461-f6cc66ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:12.949380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9015b49b-cd883407-e6e2461-f6cc66ca_0] Write session: try to update token
2025-09-30T14:56:12.949415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9015b49b-cd883407-e6e2461-f6cc66ca_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:12.962997Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:12.963023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:12.963034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896186346031279:3104]
2025-09-30T14:56:12.963086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:12.963099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:12.963306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:12.963470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:12.963623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:12.963773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:12.963982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:12.964032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:12.966575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2141 sessionId: src_id|9015b49b-cd883407-e6e2461-f6cc66ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:12.968386Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:12.968404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:12.968406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:12.968408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:12.968416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896186346031279:3104]
2025-09-30T14:56:12.968420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896186346031279:3104]
2025-09-30T14:56:12.968423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896186346031279:3104]
2025-09-30T14:56:12.968459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:12.968467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:12.968470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:12.968479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:12.968485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:12.968489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:12.968608Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:12.969317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:13.008556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896190730770314:8402]
2025-09-30T14:56:13.008890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2140, pipe: [1:7555896190730770314:8402]
2025-09-30T14:56:13.080499Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:13.080970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:13.080987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:13.081010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896190730770314:8402], now have 1 active actors on pipe
2025-09-30T14:56:13.081297Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:13.081291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:13.081296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896190730770314:8402]
2025-09-30T14:56:13.081316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:13.081321Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:13.081409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2141 reason: error at write: Disconnected sessionId: src_id|9015b49b-cd883407-e6e2461-f6cc66ca_0
2025-09-30T14:56:13.081590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2141 sessionId: src_id|9015b49b-cd883407-e6e2461-f6cc66ca_0 is DEAD
2025-09-30T14:56:13.081880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9015b49b-cd883407-e6e2461-f6cc66ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:13.081896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9015b49b-cd883407-e6e2461-f6cc66ca_0] Write session will restart in 0.008980s
2025-09-30T14:56:13.081930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9015b49b-cd883407-e6e2461-f6cc66ca_0] Write session: Do CDS request
2025-09-30T14:56:13.081940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9015b49b-cd883407-e6e2461-f6cc66ca_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:13.091976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9015b49b-cd883407-e6e2461-f6cc66ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:13.092110Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:13.092125Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2142
2025-09-30T14:56:13.092323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2142 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:13.092356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2142 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:13.092366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2142 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:13.092370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:13.092992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2142 sessionId:  describe result for acl check
2025-09-30T14:56:13.093034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:13.093041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:13.093044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:13.093049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896190730770393:2468] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:13.093653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896190730770393:2468] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:13.096598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896190730770393:2468] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:13.099118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:13.099180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896190730770393:2468] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:13.099193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896190730770393:2468] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:13.099199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896190730770393:2468] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:13.099207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2142 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:13.101636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:13.101864Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:13.101875Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:13.101886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:13.101947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:13.101985Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896190640998807:3102]
2025-09-30T14:56:13.102679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:13.102978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:13.103025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:13.103407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:13.103483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:13.103490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:13.103492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:13.103493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:13.103495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:13.103496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:13.103498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:13.103499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:13.103500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:13.103501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:13.103503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.103504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:13.103505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:13.103507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:13.103508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:13.103514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:13.103525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:13.103530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:13.103534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:13.103538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:13.103543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:13.103547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:13.103552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:13.103556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:13.103561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:13.103566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.103570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:13.103575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:13.103579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:13.103584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:13.103594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:13.103604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:13.103611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:13.103622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:13.103628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:13.103634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:13.103639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:13.103646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:13.103651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:13.103656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:13.103666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:13.103672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:13.103677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:13.103683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:13.103689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:13.103700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:13.103705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:13.103715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:13.103721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:13.103731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:13.103737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.103747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.103752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:13.103761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:13.103766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:13.103776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:13.103781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:13.103791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:13.103796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:13.103806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:13.103869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:13.109633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:13.110741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:13.110759Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:13.110762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:13.110766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:13.110773Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2141 [2:7555896190640998807:3102]
2025-09-30T14:56:13.110789Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:13.110805Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:13.110807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:13.110810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:13.110812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:13.110828Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:13.110834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:13.110841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:13.110903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.110913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:13.110915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:13.110918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:13.110921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:13.111001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:13.111009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.111022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:13.111040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:13.111063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:13.111086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896190730770316:2454], now have 1 active actors on pipe
2025-09-30T14:56:13.111095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896190730770544:2468], now have 1 active actors on pipe
2025-09-30T14:56:13.111102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896190640998801:3102]
2025-09-30T14:56:13.111109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896190640998801:3102]
2025-09-30T14:56:13.111112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896190640998801:3102]
2025-09-30T14:56:13.111124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:13.111138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:13.111142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:13.111148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:13.111150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:13.111158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:13.111161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:13.111193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896190640998801:3102]
2025-09-30T14:56:13.111205Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:13.111210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:13.111222Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2141
2025-09-30T14:56:13.111271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2141
2025-09-30T14:56:13.111355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:13.111366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:13.111391Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|afa891c4-f22fbada-11f5c102-147f094e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:13.111398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:13.111407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:13.111409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:13.111419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:13.111429Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:13.111447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:13.111597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:13.111605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:13.111617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:13.111700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2142 partition: 0 MaxSeqNo: 42 sessionId: src_id|afa891c4-f22fbada-11f5c102-147f094e_0
2025-09-30T14:56:13.112126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9015b49b-cd883407-e6e2461-f6cc66ca_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|afa891c4-f22fbada-11f5c102-147f094e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:13.115463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afa891c4-f22fbada-11f5c102-147f094e_0] Write session: try to update token
2025-09-30T14:56:13.115502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afa891c4-f22fbada-11f5c102-147f094e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:13.123925Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:13.123951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:13.123961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896190640998801:3102]
2025-09-30T14:56:13.124009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:13.124008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:13.124190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:13.124342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:13.124484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:13.124630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:13.124828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:13.124876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:13.135623Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:13.135649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:13.135651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:13.135653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:13.135664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896190640998801:3102]
2025-09-30T14:56:13.135668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896190640998801:3102]
2025-09-30T14:56:13.135673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896190640998801:3102]
2025-09-30T14:56:13.135720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:13.135728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:13.135734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.135735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:13.135737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:13.135740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:13.135879Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:13.138116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2142 sessionId: src_id|afa891c4-f22fbada-11f5c102-147f094e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:13.140872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:13.181630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896190730770561:8402]
2025-09-30T14:56:13.182012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2141, pipe: [1:7555896190730770561:8402]
2025-09-30T14:56:13.265510Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:13.265950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:13.265984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:13.266005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896190730770561:8402], now have 1 active actors on pipe
2025-09-30T14:56:13.266238Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:13.266264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896190730770561:8402]
2025-09-30T14:56:13.266281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:13.266312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:13.266398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2142 reason: status is not ok: tablet will be restarted right now sessionId: src_id|afa891c4-f22fbada-11f5c102-147f094e_0
2025-09-30T14:56:13.266586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2142 sessionId: src_id|afa891c4-f22fbada-11f5c102-147f094e_0 is DEAD
2025-09-30T14:56:13.266839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afa891c4-f22fbada-11f5c102-147f094e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:13.266855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afa891c4-f22fbada-11f5c102-147f094e_0] Write session will restart in 0.006071s
2025-09-30T14:56:13.266886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afa891c4-f22fbada-11f5c102-147f094e_0] Write session: Do CDS request
2025-09-30T14:56:13.266894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afa891c4-f22fbada-11f5c102-147f094e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:13.273880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afa891c4-f22fbada-11f5c102-147f094e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:13.274048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:13.274066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2143
2025-09-30T14:56:13.274274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2143 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:13.274307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2143 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:13.274313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2143 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:13.274316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:13.274687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2143 sessionId:  describe result for acl check
2025-09-30T14:56:13.274715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:13.274717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:13.274720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:13.274726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896190730770595:2489] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:13.275262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896190730770595:2489] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:13.282960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896190730770595:2489] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:13.288332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896190730770595:2489] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:13.288352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896190730770595:2489] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:13.288355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896190730770595:2489] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:13.288363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2143 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:13.293587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:13.294295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:13.294543Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:13.294555Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:13.294565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:13.294624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:13.294673Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896190640999048:3096]
2025-09-30T14:56:13.295412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:13.295948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:13.296011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:13.296396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:13.296474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:13.296480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:13.296482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:13.296483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:13.296484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:13.296486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:13.296487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:13.296489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:13.296490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:13.296491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:13.296493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.296494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:13.296495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:13.296497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:13.296498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:13.296504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:13.296515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:13.296519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:13.296524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:13.296528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:13.296532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:13.296536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:13.296541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:13.296545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:13.296551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:13.296555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.296559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:13.296563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:13.296567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:13.296572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:13.296580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:13.296588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:13.296595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:13.296605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:13.296610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:13.296615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:13.296624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:13.296629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:13.296633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:13.296643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:13.296648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:13.296732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:13.296746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:13.296752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:13.296758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:13.296763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:13.296768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:13.296773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:13.296778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:13.296784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:13.296789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.296794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.296800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:13.296806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:13.296811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:13.296816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:13.296821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:13.296826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:13.296831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:13.296836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:13.296884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:13.302771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:13.304277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:13.304294Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:13.304297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:13.304301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:13.304308Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2142 [2:7555896190640999048:3096]
2025-09-30T14:56:13.304323Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:13.304339Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:13.304342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:13.304345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:13.304347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:13.304363Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:13.304370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:13.304377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:13.304449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.304458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:13.304460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:13.304463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:13.304466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:13.304536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:13.304546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.304560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:13.304572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:13.304589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:13.304608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896190730770802:2489], now have 1 active actors on pipe
2025-09-30T14:56:13.304614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896190640999043:3096]
2025-09-30T14:56:13.304616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896190640999043:3096]
2025-09-30T14:56:13.304619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896190640999043:3096]
2025-09-30T14:56:13.304631Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:13.304644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:13.304645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896190730770567:2454], now have 1 active actors on pipe
2025-09-30T14:56:13.304653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:13.304655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:13.304657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:13.304667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:13.304670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:13.304705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896190640999043:3096]
2025-09-30T14:56:13.304717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:13.304742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:13.304849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2142
2025-09-30T14:56:13.304884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2142
2025-09-30T14:56:13.304934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:13.304951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:13.304988Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63cfceaf-1eabdc2e-a89339f8-fff06497_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:13.305002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:13.305011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:13.305013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:13.305024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:13.305040Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:13.305057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:13.305250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:13.305264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:13.305300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:13.305423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2143 partition: 0 MaxSeqNo: 42 sessionId: src_id|63cfceaf-1eabdc2e-a89339f8-fff06497_0
2025-09-30T14:56:13.305879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afa891c4-f22fbada-11f5c102-147f094e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|63cfceaf-1eabdc2e-a89339f8-fff06497_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:13.309782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63cfceaf-1eabdc2e-a89339f8-fff06497_0] Write session: try to update token
2025-09-30T14:56:13.309810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63cfceaf-1eabdc2e-a89339f8-fff06497_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:13.317339Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:13.317359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:13.317368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896190640999043:3096]
2025-09-30T14:56:13.317425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:13.317434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:13.317621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:13.317771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:13.317923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:13.318071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:13.318348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:13.318389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:13.332315Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:13.332343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:13.332345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:13.332347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:13.332359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896190640999043:3096]
2025-09-30T14:56:13.332362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896190640999043:3096]
2025-09-30T14:56:13.332368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896190640999043:3096]
2025-09-30T14:56:13.332406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:13.332410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:13.332412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.332416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:13.332417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:13.332420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:13.332570Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:13.337333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2143 sessionId: src_id|63cfceaf-1eabdc2e-a89339f8-fff06497_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:13.340307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:13.365943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896190730770826:8402]
2025-09-30T14:56:13.366271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2142, pipe: [1:7555896190730770826:8402]
2025-09-30T14:56:13.446878Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:13.447138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:13.447153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:13.447170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896190730770826:8402], now have 1 active actors on pipe
2025-09-30T14:56:13.447382Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:13.447408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:13.447412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896190730770826:8402]
2025-09-30T14:56:13.447422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:13.447431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:13.447479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2143 reason: error at write: Disconnected sessionId: src_id|63cfceaf-1eabdc2e-a89339f8-fff06497_0
2025-09-30T14:56:13.447623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2143 sessionId: src_id|63cfceaf-1eabdc2e-a89339f8-fff06497_0 is DEAD
2025-09-30T14:56:13.447763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63cfceaf-1eabdc2e-a89339f8-fff06497_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:13.447774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63cfceaf-1eabdc2e-a89339f8-fff06497_0] Write session will restart in 0.005902s
2025-09-30T14:56:13.447797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63cfceaf-1eabdc2e-a89339f8-fff06497_0] Write session: Do CDS request
2025-09-30T14:56:13.447806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63cfceaf-1eabdc2e-a89339f8-fff06497_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:13.454918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63cfceaf-1eabdc2e-a89339f8-fff06497_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:13.455080Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:13.455097Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2144
2025-09-30T14:56:13.455267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2144 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:13.455301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2144 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:13.455306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2144 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:13.455312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:13.455798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2144 sessionId:  describe result for acl check
2025-09-30T14:56:13.455838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:13.455845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:13.455847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:13.455854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896190730770844:2518] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:13.456442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896190730770844:2518] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:13.459431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896190730770844:2518] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:13.463318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896190730770844:2518] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:13.463345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896190730770844:2518] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:13.463349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896190730770844:2518] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:13.463358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2144 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:13.466340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:13.468995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:13.469211Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:13.469221Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:13.469232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:13.469289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:13.469337Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896190640999303:3081]
2025-09-30T14:56:13.470017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:13.470343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:13.470394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:13.470751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:13.470837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:13.470844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:13.470845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:13.470846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:13.470847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:13.470848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:13.470850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:13.470851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:13.470852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:13.470853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:13.470854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.470855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:13.470857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:13.470857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:13.470858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:13.470864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:13.470873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:13.470877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:13.470881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:13.470885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:13.470889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:13.470893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:13.470897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:13.470900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:13.470905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:13.470909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.470917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:13.470922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:13.470926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:13.470934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:13.470943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:13.470955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:13.470966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:13.470973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:13.470982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:13.470988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:13.470997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:13.471002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:13.471007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:13.471017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:13.471021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:13.471026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:13.471031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:13.471036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:13.471040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:13.471049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:13.471053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:13.471058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:13.471067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:13.471071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:13.471076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.471081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.471085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:13.471090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:13.471094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:13.471099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:13.471108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:13.471112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:13.471116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:13.471121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:13.471173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:13.476851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:13.478144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:13.478163Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:13.478166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:13.478171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:13.478177Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2143 [2:7555896190640999303:3081]
2025-09-30T14:56:13.478194Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:13.478211Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:13.478219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:13.478221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:13.478224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:13.478241Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:13.478249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:13.478255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:13.478328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.478338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:13.478340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:13.478343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:13.478346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:13.478413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:13.478416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.478429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:13.478442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:13.478460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:13.478478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896190640999298:3081]
2025-09-30T14:56:13.478480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896190640999298:3081]
2025-09-30T14:56:13.478482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896190640999298:3081]
2025-09-30T14:56:13.478494Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:13.478510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896190730770829:2454], now have 1 active actors on pipe
2025-09-30T14:56:13.478513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896190730771023:2518], now have 1 active actors on pipe
2025-09-30T14:56:13.478509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:13.478521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:13.478524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:13.478527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:13.478536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:13.478539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:13.478573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896190640999298:3081]
2025-09-30T14:56:13.478588Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:13.478581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2143
2025-09-30T14:56:13.478589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2143
2025-09-30T14:56:13.478614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:13.478653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:13.478665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:13.478689Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6dd7bbae-57d5732a-5aa84da-c9865795_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:13.478702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:13.478706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:13.478708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:13.478721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:13.478735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:13.478753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:13.478958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:13.478971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:13.478987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:13.479092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2144 partition: 0 MaxSeqNo: 42 sessionId: src_id|6dd7bbae-57d5732a-5aa84da-c9865795_0
2025-09-30T14:56:13.479466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63cfceaf-1eabdc2e-a89339f8-fff06497_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6dd7bbae-57d5732a-5aa84da-c9865795_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:13.482548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6dd7bbae-57d5732a-5aa84da-c9865795_0] Write session: try to update token
2025-09-30T14:56:13.482565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6dd7bbae-57d5732a-5aa84da-c9865795_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:13.491224Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:13.491256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:13.491267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896190640999298:3081]
2025-09-30T14:56:13.491314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:13.491313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:13.491480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:13.491629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:13.491786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:13.491931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:13.492131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:13.492163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:13.500765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2144 sessionId: src_id|6dd7bbae-57d5732a-5aa84da-c9865795_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:13.502828Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:13.502849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:13.502852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:13.502854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:13.502863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896190640999298:3081]
2025-09-30T14:56:13.502868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896190640999298:3081]
2025-09-30T14:56:13.502873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896190640999298:3081]
2025-09-30T14:56:13.502915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:13.502923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:13.502927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.502929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:13.502930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:13.502937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:13.503156Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:13.503771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:13.547741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896190730771067:8402]
2025-09-30T14:56:13.548049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2143, pipe: [1:7555896190730771067:8402]
2025-09-30T14:56:13.619330Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:13.619879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:13.619899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:13.619920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896190730771067:8402], now have 1 active actors on pipe
2025-09-30T14:56:13.620195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:13.620208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:13.620273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2144 reason: error at write: Disconnected sessionId: src_id|6dd7bbae-57d5732a-5aa84da-c9865795_0
2025-09-30T14:56:13.620444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2144 sessionId: src_id|6dd7bbae-57d5732a-5aa84da-c9865795_0 is DEAD
2025-09-30T14:56:13.620635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:13.620635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896190730771067:8402]
2025-09-30T14:56:13.620237Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:13.623497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dd7bbae-57d5732a-5aa84da-c9865795_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:13.623514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dd7bbae-57d5732a-5aa84da-c9865795_0] Write session will restart in 0.007557s
2025-09-30T14:56:13.623537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dd7bbae-57d5732a-5aa84da-c9865795_0] Write session: Do CDS request
2025-09-30T14:56:13.623546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dd7bbae-57d5732a-5aa84da-c9865795_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:13.632794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6dd7bbae-57d5732a-5aa84da-c9865795_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:13.632831Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:13.632845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2145
2025-09-30T14:56:13.633041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2145 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:13.633085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2145 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:13.633097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2145 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:13.633101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:13.633640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2145 sessionId:  describe result for acl check
2025-09-30T14:56:13.633672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:13.633680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:13.633682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:13.633688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896190730771095:2510] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:13.634221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896190730771095:2510] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:13.637132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896190730771095:2510] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:13.641595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896190730771095:2510] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:13.641613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896190730771095:2510] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:13.641617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896190730771095:2510] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:13.641626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2145 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:13.645523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:13.648400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:13.648610Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:13.648615Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:13.648625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:13.648681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:13.648714Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896190640999535:3079]
2025-09-30T14:56:13.649407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:13.649748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:13.649798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:13.650150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:13.650214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:13.650221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:13.650223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:13.650224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:13.650225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:13.650227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:13.650228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:13.650230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:13.650231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:13.650232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:13.650234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.650236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:13.650237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:13.650239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:13.650240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:13.650246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:13.650256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:13.650262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:13.650266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:13.650270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:13.650275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:13.650279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:13.650284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:13.650289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:13.650294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:13.650298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.650303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:13.650308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:13.650312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:13.650317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:13.650327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:13.650336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:13.650342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:13.650349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:13.650354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:13.650360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:13.650365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:13.650371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:13.650376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:13.650383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:13.650388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:13.650394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:13.650399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:13.650405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:13.650410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:13.650416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:13.650421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:13.650429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:13.650433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:13.650440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:13.650445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.650452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.650456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:13.650462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:13.650467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:13.650473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:13.650477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:13.650483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:13.650488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:13.650494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:13.650541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:13.656007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:13.657152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:13.657170Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:13.657174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:13.657177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:13.657185Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2144 [2:7555896190640999535:3079]
2025-09-30T14:56:13.657201Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:13.657217Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:13.657221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:13.657224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:13.657227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:13.657243Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:13.657250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:13.657264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:13.657332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.657341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:13.657343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:13.657348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:13.657350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:13.657432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:13.657444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.657458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:13.657474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:13.657492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:13.657515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896190640999529:3079]
2025-09-30T14:56:13.657523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896190640999529:3079]
2025-09-30T14:56:13.657525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896190640999529:3079]
2025-09-30T14:56:13.657533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:13.657549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:13.657555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:13.657559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:13.657561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:13.657569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:13.657572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:13.657584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896190730771069:2454], now have 1 active actors on pipe
2025-09-30T14:56:13.657593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896190730771245:2510], now have 1 active actors on pipe
2025-09-30T14:56:13.657627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896190640999529:3079]
2025-09-30T14:56:13.657636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:13.657638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:13.657637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2144
2025-09-30T14:56:13.657649Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2144
2025-09-30T14:56:13.657787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:13.657796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:13.657819Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8f1e481-af24659e-2af24483-d1b4bdb4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:13.657830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:13.657834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:13.657841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:13.657850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:13.657859Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:13.657872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:13.658054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:13.658066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:13.658079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:13.658283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2145 partition: 0 MaxSeqNo: 42 sessionId: src_id|d8f1e481-af24659e-2af24483-d1b4bdb4_0
2025-09-30T14:56:13.658673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dd7bbae-57d5732a-5aa84da-c9865795_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d8f1e481-af24659e-2af24483-d1b4bdb4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:13.661772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f1e481-af24659e-2af24483-d1b4bdb4_0] Write session: try to update token
2025-09-30T14:56:13.661791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f1e481-af24659e-2af24483-d1b4bdb4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:13.670697Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:13.670721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:13.670724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:13.670726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:13.670735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896190640999529:3079]
2025-09-30T14:56:13.670740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896190640999529:3079]
2025-09-30T14:56:13.670745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896190640999529:3079]
2025-09-30T14:56:13.670787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:13.670791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:13.670797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:13.670799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.670802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:13.670802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:13.670932Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:13.681204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2145 sessionId: src_id|d8f1e481-af24659e-2af24483-d1b4bdb4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:13.683915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:13.720781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896190730771311:8402]
2025-09-30T14:56:13.721141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2144, pipe: [1:7555896190730771311:8402]
2025-09-30T14:56:13.792201Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:13.792542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:13.792562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:13.792584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896190730771311:8402], now have 1 active actors on pipe
2025-09-30T14:56:13.792829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:13.792846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:13.792862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896190730771311:8402]
2025-09-30T14:56:13.792885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:13.792920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2145 reason: error at write: Disconnected sessionId: src_id|d8f1e481-af24659e-2af24483-d1b4bdb4_0
2025-09-30T14:56:13.792945Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:13.793253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f1e481-af24659e-2af24483-d1b4bdb4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:13.793265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f1e481-af24659e-2af24483-d1b4bdb4_0] Write session will restart in 0.005671s
2025-09-30T14:56:13.793099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2145 sessionId: src_id|d8f1e481-af24659e-2af24483-d1b4bdb4_0 is DEAD
2025-09-30T14:56:13.793288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f1e481-af24659e-2af24483-d1b4bdb4_0] Write session: Do CDS request
2025-09-30T14:56:13.793297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f1e481-af24659e-2af24483-d1b4bdb4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:13.799731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f1e481-af24659e-2af24483-d1b4bdb4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:13.799815Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:13.799832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2146
2025-09-30T14:56:13.799991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2146 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:13.800051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2146 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:13.800061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2146 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:13.800066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:13.800584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2146 sessionId:  describe result for acl check
2025-09-30T14:56:13.800621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:13.800637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:13.800644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:13.800652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896190730771326:2542] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:13.801232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896190730771326:2542] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:13.804046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896190730771326:2542] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:13.808396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896190730771326:2542] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:13.808416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896190730771326:2542] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:13.808419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896190730771326:2542] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:13.808428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2146 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:13.815433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:13.818634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:13.818875Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:13.818902Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:13.818915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:13.818979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:13.819025Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896190640999779:3064]
2025-09-30T14:56:13.819759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:13.820154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:13.820218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:13.820602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:13.820979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:13.820988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:13.820990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:13.820991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:13.820993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:13.820994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:13.820996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:13.820997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:13.820998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:13.821000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:13.821001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.821002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:13.821004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:13.821005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:13.821006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:13.821013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:13.821024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:13.821028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:13.821033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:13.821037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:13.821042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:13.821047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:13.821051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:13.821055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:13.821060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:13.821065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.821069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:13.821073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:13.821078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:13.821082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:13.821091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:13.821099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:13.821107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:13.821113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:13.821118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:13.821123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:13.821128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:13.821133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:13.821138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:13.821143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:13.821147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:13.821153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:13.821162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:13.821175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:13.821180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:13.821185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:13.821190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:13.821196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:13.821201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:13.821207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:13.821211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.821217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.821230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:13.821236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:13.821241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:13.821246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:13.821250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:13.821256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:13.821261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:13.821266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:13.821312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:13.827358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:13.828611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:13.828631Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:13.828634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:13.828639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:13.828646Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2145 [2:7555896190640999779:3064]
2025-09-30T14:56:13.828662Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:13.828681Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:13.828686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:13.828690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:13.828692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:13.828709Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:13.828720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:13.828727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:13.828781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.828787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:13.828789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:13.828793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:13.828795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:13.828867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:13.828875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.828891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:13.828904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:13.828926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:13.828945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896190730771445:2542], now have 1 active actors on pipe
2025-09-30T14:56:13.828949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896190730771313:2454], now have 1 active actors on pipe
2025-09-30T14:56:13.828955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896190640999774:3064]
2025-09-30T14:56:13.828957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896190640999774:3064]
2025-09-30T14:56:13.828959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896190640999774:3064]
2025-09-30T14:56:13.828971Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:13.828985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:13.828998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:13.829005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:13.829009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:13.829009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:13.829011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:13.829049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896190640999774:3064]
2025-09-30T14:56:13.829057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:13.829062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:13.829034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2145
2025-09-30T14:56:13.829037Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2145
2025-09-30T14:56:13.829093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:13.829101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:13.829140Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32dc5c7-844a6fc7-b6f44ecd-47a2eafa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:13.829154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:13.829159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:13.829161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:13.829173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:13.829181Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:13.829194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:13.829542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2146 partition: 0 MaxSeqNo: 42 sessionId: src_id|32dc5c7-844a6fc7-b6f44ecd-47a2eafa_0
2025-09-30T14:56:13.829406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:13.829423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:13.829446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:13.829904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f1e481-af24659e-2af24483-d1b4bdb4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|32dc5c7-844a6fc7-b6f44ecd-47a2eafa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:13.832725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32dc5c7-844a6fc7-b6f44ecd-47a2eafa_0] Write session: try to update token
2025-09-30T14:56:13.832747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32dc5c7-844a6fc7-b6f44ecd-47a2eafa_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:13.842053Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:13.842078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:13.842087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896190640999774:3064]
2025-09-30T14:56:13.842131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:13.842138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:13.842318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:13.842468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:13.842614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:13.842783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:13.843000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:13.843050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:13.849546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2146 sessionId: src_id|32dc5c7-844a6fc7-b6f44ecd-47a2eafa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:13.852346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:13.853326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:13.853366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:13.853397Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:13.853401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:13.853403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:13.853406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:13.853418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896190640999774:3064]
2025-09-30T14:56:13.853426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896190640999774:3064]
2025-09-30T14:56:13.853430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896190640999774:3064]
2025-09-30T14:56:13.853473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:13.853478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:13.853484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:13.853487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:13.853487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:13.853492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:13.853621Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:13.892834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896190730771554:8402]
2025-09-30T14:56:13.893231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2145, pipe: [1:7555896190730771554:8402]
2025-09-30T14:56:13.968808Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:13.969155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:13.969195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896190730771554:8402], now have 1 active actors on pipe
2025-09-30T14:56:13.969707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:13.969799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:13.969808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:13.969874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2146 reason: error at write: Disconnected sessionId: src_id|32dc5c7-844a6fc7-b6f44ecd-47a2eafa_0
2025-09-30T14:56:13.970219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32dc5c7-844a6fc7-b6f44ecd-47a2eafa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:13.970232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32dc5c7-844a6fc7-b6f44ecd-47a2eafa_0] Write session will restart in 0.008579s
2025-09-30T14:56:13.970258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32dc5c7-844a6fc7-b6f44ecd-47a2eafa_0] Write session: Do CDS request
2025-09-30T14:56:13.970265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32dc5c7-844a6fc7-b6f44ecd-47a2eafa_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:13.970049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2146 sessionId: src_id|32dc5c7-844a6fc7-b6f44ecd-47a2eafa_0 is DEAD
2025-09-30T14:56:13.970753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896190730771554:8402]
2025-09-30T14:56:13.970777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:13.979826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32dc5c7-844a6fc7-b6f44ecd-47a2eafa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:13.980152Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:13.980179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2147
2025-09-30T14:56:13.983574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2147 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:13.983633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2147 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:13.983639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2147 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:13.983645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:13.984105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2147 sessionId:  describe result for acl check
2025-09-30T14:56:13.984143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:13.984146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:13.984148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:13.984157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896190730771580:2546] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:13.984738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896190730771580:2546] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:13.987379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896190730771580:2546] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:13.996321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896190730771580:2546] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:13.996343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896190730771580:2546] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:13.996348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896190730771580:2546] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:13.996357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2147 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:14.006130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:14.008963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:14.009216Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:14.009229Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:14.009240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:14.009301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:14.009343Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896194935967310:3054]
2025-09-30T14:56:14.010054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:14.010391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:14.010441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:14.010799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:14.010873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:14.010878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:14.010879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:14.010880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:14.010882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:14.010883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:14.010884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:14.010885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:14.010886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:14.010887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:14.010889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.010890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.010891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.010892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:14.010894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:14.010899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:14.010910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:14.010915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:14.010919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:14.010923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:14.010927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:14.010932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:14.010936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:14.010940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:14.010945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:14.010949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.010953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.010957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.010962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:14.010966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:14.010974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:14.010984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:14.010990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:14.010996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:14.011001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:14.011006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:14.011010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:14.011015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:14.011020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:14.011026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:14.011031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:14.011036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:14.011041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:14.011046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:14.011050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:14.011055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:14.011060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:14.011066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:14.011070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:14.011075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:14.011080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.011084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.011088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.011093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.011098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.011103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.011107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:14.011119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:14.011127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:14.011135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:14.011192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:14.020825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:14.022049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:14.022067Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:14.022070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:14.022074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:14.022081Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2146 [2:7555896194935967310:3054]
2025-09-30T14:56:14.022100Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:14.022116Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:14.022121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:14.022124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:14.022126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:14.022142Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:14.022154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:14.022162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:14.022224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.022234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.022236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.022241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:14.022243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:14.022316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:14.022325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.022339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.022351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.022370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:14.022399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896190730771672:2546], now have 1 active actors on pipe
2025-09-30T14:56:14.022408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896190730771571:2454], now have 1 active actors on pipe
2025-09-30T14:56:14.022415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896194935967305:3054]
2025-09-30T14:56:14.022417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896194935967305:3054]
2025-09-30T14:56:14.022420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896194935967305:3054]
2025-09-30T14:56:14.022439Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:14.022457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:14.022472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:14.022478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:14.022481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:14.022485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:14.022490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:14.022518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896194935967305:3054]
2025-09-30T14:56:14.022529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:14.022536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:14.022524Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2146
2025-09-30T14:56:14.022529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2146
2025-09-30T14:56:14.022641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:14.022654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:14.022689Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc6022f3-89133fdc-4693a404-784d00c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:14.022701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:14.022705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:14.022708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:14.022718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:14.022732Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:14.022760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:14.022950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:14.022961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:14.022977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:14.023061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2147 partition: 0 MaxSeqNo: 42 sessionId: src_id|fc6022f3-89133fdc-4693a404-784d00c5_0
2025-09-30T14:56:14.023460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32dc5c7-844a6fc7-b6f44ecd-47a2eafa_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fc6022f3-89133fdc-4693a404-784d00c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:14.026518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc6022f3-89133fdc-4693a404-784d00c5_0] Write session: try to update token
2025-09-30T14:56:14.026544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc6022f3-89133fdc-4693a404-784d00c5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:14.037790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:14.037814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:14.037825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896194935967305:3054]
2025-09-30T14:56:14.037873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:14.037874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:14.038076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:14.038252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:14.038419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:14.038587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:14.038815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:14.038861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:14.043285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2147 sessionId: src_id|fc6022f3-89133fdc-4693a404-784d00c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:14.046227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:14.046443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:14.046487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:14.046541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:14.046664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:14.049773Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:14.049795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:14.049801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:14.049803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:14.049817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896194935967305:3054]
2025-09-30T14:56:14.049822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896194935967305:3054]
2025-09-30T14:56:14.049826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896194935967305:3054]
2025-09-30T14:56:14.049867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:14.049874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.049869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:14.049881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:14.049884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:14.049889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:14.050039Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:14.070994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896195025739106:8402]
2025-09-30T14:56:14.071300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2146, pipe: [1:7555896195025739106:8402]
2025-09-30T14:56:14.171070Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:14.180087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:14.180123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:14.180315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:14.180379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:14.180449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:14.180513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:14.180846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:14.180869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:14.180945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:14.181013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:14.181080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:14.181401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:14.181446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:14.181454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:14.181524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:14.181589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:14.181661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:14.181723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:14.181772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:14.181782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:14.181850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:14.181914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:14.181983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:14.182055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:14.182096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:14.182099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:14.182174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:14.182235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:14.182296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:14.182358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:14.182398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:14.182402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:14.182471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:14.182534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:14.182595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:14.182665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:14.182708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:14.182711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:14.182786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:14.182851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:14.182920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:14.182984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:14.183023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:14.183026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:14.183098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:14.183158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:14.183217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:14.183429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:14.183486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:14.183498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:14.184468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:14.184473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896195025739106:8402]
2025-09-30T14:56:14.184485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:14.184517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2147 reason: error at write: Disconnected sessionId: src_id|fc6022f3-89133fdc-4693a404-784d00c5_0
2025-09-30T14:56:14.184523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:14.184707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2147 sessionId: src_id|fc6022f3-89133fdc-4693a404-784d00c5_0 is DEAD
2025-09-30T14:56:14.183576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:14.183650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:14.183711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:14.183771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:14.183811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:14.183814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:14.183882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:14.183939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:14.184003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:14.184072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:14.184114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:14.184117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:14.184195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896195025739106:8402], now have 1 active actors on pipe
2025-09-30T14:56:14.184838Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:14.187334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc6022f3-89133fdc-4693a404-784d00c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:14.187347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc6022f3-89133fdc-4693a404-784d00c5_0] Write session will restart in 0.008509s
2025-09-30T14:56:14.187373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc6022f3-89133fdc-4693a404-784d00c5_0] Write session: Do CDS request
2025-09-30T14:56:14.187380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc6022f3-89133fdc-4693a404-784d00c5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:14.199778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc6022f3-89133fdc-4693a404-784d00c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:14.200034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:14.200052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2148
2025-09-30T14:56:14.200183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2148 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:14.200210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2148 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:14.200216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2148 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:14.200221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:14.200975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2148 sessionId:  describe result for acl check
2025-09-30T14:56:14.201006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:14.201009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:14.201010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:14.201018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896195025739204:2558] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:14.201647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896195025739204:2558] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:14.207800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896195025739204:2558] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:14.214984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:14.218776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:14.219024Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:14.219038Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:14.219050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:14.219116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:14.219177Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896194935967544:3057]
2025-09-30T14:56:14.214992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896195025739204:2558] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:14.215011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896195025739204:2558] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:14.215015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896195025739204:2558] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:14.215024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2148 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:14.219925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:14.220330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:14.220404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:14.220771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:14.220836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:14.220843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:14.220844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:14.220845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:14.220846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:14.220847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:14.220849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:14.220850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:14.220852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:14.220853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:14.220854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.220856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.220857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.220858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:14.220859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:14.220865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:14.220875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:14.220880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:14.220883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:14.220887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:14.220891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:14.220895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:14.220898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:14.220902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:14.220907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:14.220910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.220913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.220917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.220921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:14.220925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:14.220935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:14.220942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:14.220948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:14.220953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:14.220957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:14.220963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:14.220968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:14.220975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:14.220981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:14.220986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:14.220990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:14.220995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:14.221000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:14.221010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:14.221015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:14.221020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:14.221029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:14.221035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:14.221039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:14.221044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:14.221048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.221054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.221062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.221067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.221071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.221076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.221085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:14.221090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:14.221095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:14.221104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:14.221148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:14.228249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:14.229422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:14.229437Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:14.229440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:14.229444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:14.229451Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2147 [2:7555896194935967544:3057]
2025-09-30T14:56:14.229468Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:14.229486Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:14.229490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:14.229493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:14.229495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:14.229511Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:14.229517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:14.229524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:14.229596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.229603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.229606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.229609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:14.229612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:14.229679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:14.229689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.229701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.229725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.229748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:14.229765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896195025739344:2558], now have 1 active actors on pipe
2025-09-30T14:56:14.229774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896195025739115:2454], now have 1 active actors on pipe
2025-09-30T14:56:14.229779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896194935967537:3057]
2025-09-30T14:56:14.229782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896194935967537:3057]
2025-09-30T14:56:14.229784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896194935967537:3057]
2025-09-30T14:56:14.229797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:14.229813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:14.229814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:14.229825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:14.229827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:14.229830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:14.229834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:14.229868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896194935967537:3057]
2025-09-30T14:56:14.229881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:14.229888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:14.229842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2147
2025-09-30T14:56:14.229875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2147
2025-09-30T14:56:14.230027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:14.230038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:14.230065Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ebbee1ce-f1bbb2d2-235575b9-efb9c8b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:14.230077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:14.230081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:14.230084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:14.230095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:14.230109Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:14.230129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:14.230389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:14.230406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:14.230439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:14.230583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2148 partition: 0 MaxSeqNo: 42 sessionId: src_id|ebbee1ce-f1bbb2d2-235575b9-efb9c8b3_0
2025-09-30T14:56:14.231013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc6022f3-89133fdc-4693a404-784d00c5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ebbee1ce-f1bbb2d2-235575b9-efb9c8b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:14.233823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebbee1ce-f1bbb2d2-235575b9-efb9c8b3_0] Write session: try to update token
2025-09-30T14:56:14.233843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebbee1ce-f1bbb2d2-235575b9-efb9c8b3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:14.242890Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:14.242916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:14.242927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896194935967537:3057]
2025-09-30T14:56:14.242977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:14.242981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:14.243179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:14.243509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:14.243677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:14.243837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:14.244034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:14.244075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:14.254268Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:14.254293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:14.254295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:14.254297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:14.254307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896194935967537:3057]
2025-09-30T14:56:14.254312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896194935967537:3057]
2025-09-30T14:56:14.254317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896194935967537:3057]
2025-09-30T14:56:14.254362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:14.254369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.254372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:14.254380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:14.254394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:14.254398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:14.255101Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:14.267402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2148 sessionId: src_id|ebbee1ce-f1bbb2d2-235575b9-efb9c8b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:14.270911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:14.284565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896195025739361:8402]
2025-09-30T14:56:14.285001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2147, pipe: [1:7555896195025739361:8402]
2025-09-30T14:56:14.369191Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:14.369875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:14.369902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:14.369925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896195025739361:8402], now have 1 active actors on pipe
2025-09-30T14:56:14.370155Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:14.370421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:14.370495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:14.370602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2148 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ebbee1ce-f1bbb2d2-235575b9-efb9c8b3_0
2025-09-30T14:56:14.370815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2148 sessionId: src_id|ebbee1ce-f1bbb2d2-235575b9-efb9c8b3_0 is DEAD
2025-09-30T14:56:14.371009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebbee1ce-f1bbb2d2-235575b9-efb9c8b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:14.371021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebbee1ce-f1bbb2d2-235575b9-efb9c8b3_0] Write session will restart in 0.007785s
2025-09-30T14:56:14.371057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebbee1ce-f1bbb2d2-235575b9-efb9c8b3_0] Write session: Do CDS request
2025-09-30T14:56:14.371065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebbee1ce-f1bbb2d2-235575b9-efb9c8b3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:14.371327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896195025739361:8402]
2025-09-30T14:56:14.379909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebbee1ce-f1bbb2d2-235575b9-efb9c8b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:14.380083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:14.380100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2149
2025-09-30T14:56:14.380217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2149 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:14.380252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2149 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:14.380261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2149 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:14.380266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:14.380691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2149 sessionId:  describe result for acl check
2025-09-30T14:56:14.380727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:14.380729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:14.380731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:14.380737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896195025739400:2580] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:14.381322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896195025739400:2580] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:14.384933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896195025739400:2580] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:14.388426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896195025739400:2580] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:14.388454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896195025739400:2580] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:14.388458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896195025739400:2580] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:14.388467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2149 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:14.390859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:14.394876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:14.395159Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:14.395169Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:14.395184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:14.395262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:14.395314Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896194935967815:3042]
2025-09-30T14:56:14.396066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:14.396445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:14.396496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:14.396852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:14.396908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:14.396913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:14.396914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:14.396915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:14.396916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:14.396917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:14.396918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:14.396920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:14.396920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:14.396921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:14.396922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.396923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.396924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.396925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:14.396926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:14.396930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:14.396938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:14.396941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:14.396944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:14.396947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:14.396950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:14.396952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:14.396955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:14.396957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:14.396960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:14.396963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.396966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.396968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.396971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:14.396973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:14.396980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:14.396986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:14.396991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:14.396995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:14.396998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:14.397001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:14.397005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:14.397008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:14.397012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:14.397017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:14.397023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:14.397028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:14.397034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:14.397038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:14.397044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:14.397049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:14.397054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:14.397060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:14.397064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:14.397068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:14.397073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.397078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.397083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.397088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.397094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.397100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.397104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:14.397110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:14.397115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:14.397120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:14.397173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:14.403550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:14.405581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:14.405605Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:14.405608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:14.405613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:14.405621Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2148 [2:7555896194935967815:3042]
2025-09-30T14:56:14.405645Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:14.405666Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:14.405671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:14.405675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:14.405677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:14.405700Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:14.405709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:14.405719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:14.405808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.405822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.405824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.405828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:14.405831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:14.405923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:14.405932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.405951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.405963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.405982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:14.406011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896194935967810:3042]
2025-09-30T14:56:14.406020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896194935967810:3042]
2025-09-30T14:56:14.406023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896194935967810:3042]
2025-09-30T14:56:14.406040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:14.406057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:14.406063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896195025739595:2580], now have 1 active actors on pipe
2025-09-30T14:56:14.406067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896195025739375:2454], now have 1 active actors on pipe
2025-09-30T14:56:14.406069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:14.406072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:14.406077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:14.406094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:14.406107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:14.406155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896194935967810:3042]
2025-09-30T14:56:14.406164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:14.406171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:14.406142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2148
2025-09-30T14:56:14.406199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:14.406209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:14.406145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2148
2025-09-30T14:56:14.406257Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|166e7248-47445226-b28b16f5-d99e48bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:14.406271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:14.406276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:14.406278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:14.406292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:14.406309Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:14.406340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:14.406601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:14.406623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:14.406641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:14.406783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2149 partition: 0 MaxSeqNo: 42 sessionId: src_id|166e7248-47445226-b28b16f5-d99e48bb_0
2025-09-30T14:56:14.407273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebbee1ce-f1bbb2d2-235575b9-efb9c8b3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|166e7248-47445226-b28b16f5-d99e48bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:14.410729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|166e7248-47445226-b28b16f5-d99e48bb_0] Write session: try to update token
2025-09-30T14:56:14.410753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|166e7248-47445226-b28b16f5-d99e48bb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:14.419871Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:14.419902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:14.419905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:14.419909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:14.419922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896194935967810:3042]
2025-09-30T14:56:14.419930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896194935967810:3042]
2025-09-30T14:56:14.419936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896194935967810:3042]
2025-09-30T14:56:14.419991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:14.419995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:14.420000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:14.420006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.420010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:14.420016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:14.420209Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:14.431941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2149 sessionId: src_id|166e7248-47445226-b28b16f5-d99e48bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:14.434755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:14.471890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896195025739629:8402]
2025-09-30T14:56:14.472259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2148, pipe: [1:7555896195025739629:8402]
2025-09-30T14:56:14.545086Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:14.545420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:14.545437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:14.545459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896195025739629:8402], now have 1 active actors on pipe
2025-09-30T14:56:14.545699Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:14.545776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:14.545796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:14.545834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896195025739629:8402]
2025-09-30T14:56:14.545858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:14.545876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2149 reason: error at write: Disconnected sessionId: src_id|166e7248-47445226-b28b16f5-d99e48bb_0
2025-09-30T14:56:14.546068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2149 sessionId: src_id|166e7248-47445226-b28b16f5-d99e48bb_0 is DEAD
2025-09-30T14:56:14.546341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|166e7248-47445226-b28b16f5-d99e48bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:14.546357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|166e7248-47445226-b28b16f5-d99e48bb_0] Write session will restart in 0.005289s
2025-09-30T14:56:14.546390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|166e7248-47445226-b28b16f5-d99e48bb_0] Write session: Do CDS request
2025-09-30T14:56:14.546401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|166e7248-47445226-b28b16f5-d99e48bb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:14.552962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|166e7248-47445226-b28b16f5-d99e48bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:14.553075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:14.553093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2150
2025-09-30T14:56:14.553270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2150 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:14.553305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2150 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:14.553313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2150 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:14.553318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:14.553787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2150 sessionId:  describe result for acl check
2025-09-30T14:56:14.553836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:14.553839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:14.553841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:14.553847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896195025739646:2588] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:14.554409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896195025739646:2588] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:14.557513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896195025739646:2588] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:14.561152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896195025739646:2588] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:14.561177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896195025739646:2588] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:14.561182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896195025739646:2588] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:14.561193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2150 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:14.566190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:14.569518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:14.569779Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:14.569793Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:14.569806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:14.569862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:14.569911Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896194935968053:3031]
2025-09-30T14:56:14.570470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:14.570795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:14.570838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:14.571185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:14.571281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:14.571290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:14.571291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:14.571293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:14.571294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:14.571296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:14.571297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:14.571298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:14.571300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:14.571302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:14.571303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.571304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.571305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.571307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:14.571308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:14.571314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:14.571325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:14.571329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:14.571333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:14.571337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:14.571342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:14.571346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:14.571350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:14.571354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:14.571358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:14.571362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.571366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.571370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.571374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:14.571377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:14.571385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:14.571394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:14.571401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:14.571407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:14.571413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:14.571418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:14.571424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:14.571429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:14.571435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:14.571440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:14.571446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:14.571450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:14.571456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:14.571461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:14.571465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:14.571470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:14.571476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:14.571481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:14.571486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:14.571494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:14.571500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.571506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.571512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.571521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.571527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.571532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.571537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:14.571543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:14.571549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:14.571556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:14.571610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:14.577628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:14.578962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:14.578981Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:14.578985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:14.578989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:14.578996Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2149 [2:7555896194935968053:3031]
2025-09-30T14:56:14.579025Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:14.579042Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:14.579046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:14.579049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:14.579051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:14.579069Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:14.579075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:14.579082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:14.579149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.579151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.579153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.579157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:14.579160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:14.579228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:14.579239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.579276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.579293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.579310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:14.579332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896194935968048:3031]
2025-09-30T14:56:14.579341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896194935968048:3031]
2025-09-30T14:56:14.579344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896194935968048:3031]
2025-09-30T14:56:14.579355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:14.579370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896195025739630:2454], now have 1 active actors on pipe
2025-09-30T14:56:14.579379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896195025739769:2588], now have 1 active actors on pipe
2025-09-30T14:56:14.579388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:14.579392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:14.579395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:14.579397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:14.579402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:14.579405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:14.579444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896194935968048:3031]
2025-09-30T14:56:14.579463Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:14.579518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:14.579539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2149
2025-09-30T14:56:14.579765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2149
2025-09-30T14:56:14.579885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:14.579902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:14.579925Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54a67e6f-b2affd95-a6d276ca-ee533928_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:14.579949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:14.579957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:14.579959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:14.579967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:14.579979Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:14.579992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:14.580157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:14.580166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:14.580179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:14.580276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2150 partition: 0 MaxSeqNo: 42 sessionId: src_id|54a67e6f-b2affd95-a6d276ca-ee533928_0
2025-09-30T14:56:14.580715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|166e7248-47445226-b28b16f5-d99e48bb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|54a67e6f-b2affd95-a6d276ca-ee533928_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:14.584190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54a67e6f-b2affd95-a6d276ca-ee533928_0] Write session: try to update token
2025-09-30T14:56:14.584216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54a67e6f-b2affd95-a6d276ca-ee533928_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:14.592478Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:14.592504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:14.592508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:14.592510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:14.592520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896194935968048:3031]
2025-09-30T14:56:14.592524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896194935968048:3031]
2025-09-30T14:56:14.592528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896194935968048:3031]
2025-09-30T14:56:14.592568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:14.592574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:14.592576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.592579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:14.592585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:14.592589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:14.592732Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:14.603985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2150 sessionId: src_id|54a67e6f-b2affd95-a6d276ca-ee533928_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:14.607578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:14.645996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896195025739876:8402]
2025-09-30T14:56:14.646386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2149, pipe: [1:7555896195025739876:8402]
2025-09-30T14:56:14.706937Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:14.707273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:14.707298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:14.707318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896195025739876:8402], now have 1 active actors on pipe
2025-09-30T14:56:14.707507Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:14.707751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896195025739876:8402]
2025-09-30T14:56:14.707786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:14.707864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2150 reason: status is not ok: tablet will be restarted right now sessionId: src_id|54a67e6f-b2affd95-a6d276ca-ee533928_0
2025-09-30T14:56:14.707952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:14.708041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2150 sessionId: src_id|54a67e6f-b2affd95-a6d276ca-ee533928_0 is DEAD
2025-09-30T14:56:14.708254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54a67e6f-b2affd95-a6d276ca-ee533928_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:14.708268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54a67e6f-b2affd95-a6d276ca-ee533928_0] Write session will restart in 0.007830s
2025-09-30T14:56:14.708300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54a67e6f-b2affd95-a6d276ca-ee533928_0] Write session: Do CDS request
2025-09-30T14:56:14.708306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54a67e6f-b2affd95-a6d276ca-ee533928_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:14.717956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54a67e6f-b2affd95-a6d276ca-ee533928_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:14.718126Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:14.718150Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2151
2025-09-30T14:56:14.718480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2151 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:14.718530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2151 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:14.718536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2151 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:14.718540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:14.718960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2151 sessionId:  describe result for acl check
2025-09-30T14:56:14.718992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:14.718995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:14.718997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:14.719002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896195025739930:2599] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:14.719557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896195025739930:2599] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:14.722027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896195025739930:2599] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:14.726108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896195025739930:2599] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:14.726126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896195025739930:2599] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:14.726129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896195025739930:2599] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:14.726137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2151 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:14.726624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:14.729375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:14.729592Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:14.729601Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:14.729609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:14.729653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:14.729700Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896194935968290:3029]
2025-09-30T14:56:14.730248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:14.730522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:14.730558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:14.730898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:14.730942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:14.730949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:14.730950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:14.730951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:14.730953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:14.730954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:14.730955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:14.730956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:14.730957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:14.730959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:14.730960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.730961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.730962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.730964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:14.730965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:14.730971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:14.730980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:14.730983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:14.730985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:14.730988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:14.730991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:14.731001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:14.731004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:14.731006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:14.731009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:14.731011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.731013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.731016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.731018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:14.731021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:14.731027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:14.731032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:14.731036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:14.731040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:14.731043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:14.731046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:14.731048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:14.731051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:14.731054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:14.731057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:14.731059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:14.731062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:14.731064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:14.731067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:14.731070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:14.731073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:14.731076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:14.731078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:14.731083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:14.731086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:14.731092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.731099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.731102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.731105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.731108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.731111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.731113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:14.731116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:14.731119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:14.731122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:14.731144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:14.736897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:14.738154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:14.738170Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:14.738172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:14.738177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:14.738184Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2150 [2:7555896194935968290:3029]
2025-09-30T14:56:14.738200Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:14.738217Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:14.738225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:14.738228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:14.738231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:14.738247Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:14.738254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:14.738265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:14.738331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.738338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.738341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.738345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:14.738348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:14.738413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:14.738421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.738434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.738453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.738471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:14.738496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896195025740111:2599], now have 1 active actors on pipe
2025-09-30T14:56:14.738506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896195025739879:2454], now have 1 active actors on pipe
2025-09-30T14:56:14.738512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896194935968285:3029]
2025-09-30T14:56:14.738515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896194935968285:3029]
2025-09-30T14:56:14.738517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896194935968285:3029]
2025-09-30T14:56:14.738533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:14.738547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:14.738555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:14.738564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:14.738566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:14.738568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:14.738569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:14.738581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2150
2025-09-30T14:56:14.738602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2150
2025-09-30T14:56:14.738608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896194935968285:3029]
2025-09-30T14:56:14.738617Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:14.738619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:14.738641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:14.738646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:14.738680Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2977dc9-3ebdaadf-145535cf-ce4692a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:14.738692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:14.738702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:14.738705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:14.738713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:14.738726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:14.738752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:14.739001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:14.739010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:14.739026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:14.739128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2151 partition: 0 MaxSeqNo: 42 sessionId: src_id|a2977dc9-3ebdaadf-145535cf-ce4692a7_0
2025-09-30T14:56:14.739573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54a67e6f-b2affd95-a6d276ca-ee533928_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a2977dc9-3ebdaadf-145535cf-ce4692a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:14.742948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2977dc9-3ebdaadf-145535cf-ce4692a7_0] Write session: try to update token
2025-09-30T14:56:14.742977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2977dc9-3ebdaadf-145535cf-ce4692a7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:14.750956Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:14.750977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:14.750980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:14.750982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:14.750993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896194935968285:3029]
2025-09-30T14:56:14.750997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896194935968285:3029]
2025-09-30T14:56:14.751001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896194935968285:3029]
2025-09-30T14:56:14.751042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:14.751041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:14.751047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:14.751049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.751051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:14.751052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:14.751189Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:14.764884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2151 sessionId: src_id|a2977dc9-3ebdaadf-145535cf-ce4692a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:14.768373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:14.807773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896195025740124:8402]
2025-09-30T14:56:14.808143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2150, pipe: [1:7555896195025740124:8402]
2025-09-30T14:56:14.863344Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:14.863928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:14.863944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:14.863963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896195025740124:8402], now have 1 active actors on pipe
2025-09-30T14:56:14.864196Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:14.864280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:14.864290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896195025740124:8402]
2025-09-30T14:56:14.864333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:14.864449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2151 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a2977dc9-3ebdaadf-145535cf-ce4692a7_0
2025-09-30T14:56:14.864687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2151 sessionId: src_id|a2977dc9-3ebdaadf-145535cf-ce4692a7_0 is DEAD
2025-09-30T14:56:14.864864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2977dc9-3ebdaadf-145535cf-ce4692a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:14.864882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2977dc9-3ebdaadf-145535cf-ce4692a7_0] Write session will restart in 0.008767s
2025-09-30T14:56:14.864914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2977dc9-3ebdaadf-145535cf-ce4692a7_0] Write session: Do CDS request
2025-09-30T14:56:14.864921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2977dc9-3ebdaadf-145535cf-ce4692a7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:14.874888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2977dc9-3ebdaadf-145535cf-ce4692a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:14.875015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:14.875042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2152
2025-09-30T14:56:14.875212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2152 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:14.875274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2152 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:14.875288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2152 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:14.875294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:14.876046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2152 sessionId:  describe result for acl check
2025-09-30T14:56:14.876088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:14.876097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:14.876099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:14.876106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896195025740218:2605] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:14.876780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896195025740218:2605] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:14.879361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896195025740218:2605] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:14.880975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:14.883438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:14.883639Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:14.883648Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:14.883656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:14.883696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:14.883728Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896194935968539:3027]
2025-09-30T14:56:14.883971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896195025740218:2605] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:14.883989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896195025740218:2605] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:14.883993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896195025740218:2605] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:14.884002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2152 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:14.884407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:14.884696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:14.884731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:14.885000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:14.885043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:14.885048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:14.885049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:14.885050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:14.885050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:14.885051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:14.885052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:14.885052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:14.885054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:14.885054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:14.885055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.885056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.885057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.885057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:14.885058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:14.885062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:14.885068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:14.885071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:14.885074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:14.885076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:14.885079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:14.885081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:14.885083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:14.885086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:14.885090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:14.885092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.885095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.885097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.885099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:14.885102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:14.885108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:14.885112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:14.885116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:14.885120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:14.885123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:14.885126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:14.885128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:14.885131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:14.885134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:14.885138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:14.885140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:14.885143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:14.885146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:14.885150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:14.885153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:14.885156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:14.885160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:14.885163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:14.885166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:14.885169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:14.885173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.885176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.885179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.885182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.885185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.885187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.885189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:14.885192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:14.885195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:14.885199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:14.885222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:14.890650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:14.891618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:14.891633Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:14.891635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:14.891639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:14.891647Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2151 [2:7555896194935968539:3027]
2025-09-30T14:56:14.891662Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:14.891679Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:14.891687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:14.891690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:14.891692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:14.891708Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:14.891713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:14.891718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:14.891767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.891777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.891779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.891783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:14.891785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:14.891856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:14.891864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.891875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:14.891891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:14.891913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:14.891931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896195025740360:2605], now have 1 active actors on pipe
2025-09-30T14:56:14.891934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896195025740125:2454], now have 1 active actors on pipe
2025-09-30T14:56:14.891940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896194935968534:3027]
2025-09-30T14:56:14.891941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896194935968534:3027]
2025-09-30T14:56:14.891943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896194935968534:3027]
2025-09-30T14:56:14.891952Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:14.891963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:14.891967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:14.891970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:14.891973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:14.891976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:14.891978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:14.892007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896194935968534:3027]
2025-09-30T14:56:14.892019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:14.892029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:14.892072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2151
2025-09-30T14:56:14.892080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2151
2025-09-30T14:56:14.892123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:14.892131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:14.892153Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1bd52daf-91f180f8-d61aa5eb-8194c35_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:14.892158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:14.892161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:14.892162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:14.892171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:14.892183Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:14.892196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:14.892366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:14.892374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:14.892388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:14.892493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2152 partition: 0 MaxSeqNo: 42 sessionId: src_id|1bd52daf-91f180f8-d61aa5eb-8194c35_0
2025-09-30T14:56:14.892951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2977dc9-3ebdaadf-145535cf-ce4692a7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1bd52daf-91f180f8-d61aa5eb-8194c35_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:14.896288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd52daf-91f180f8-d61aa5eb-8194c35_0] Write session: try to update token
2025-09-30T14:56:14.896315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd52daf-91f180f8-d61aa5eb-8194c35_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:14.904391Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:14.904416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:14.904419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:14.904421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:14.904431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896194935968534:3027]
2025-09-30T14:56:14.904435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896194935968534:3027]
2025-09-30T14:56:14.904439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896194935968534:3027]
2025-09-30T14:56:14.904473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:14.904480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:14.904479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:14.904481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:14.904485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:14.904488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:14.904613Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:14.915073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2152 sessionId: src_id|1bd52daf-91f180f8-d61aa5eb-8194c35_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:14.918416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:14.964474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896195025740384:8402]
2025-09-30T14:56:14.964872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2151, pipe: [1:7555896195025740384:8402]
2025-09-30T14:56:15.017518Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:15.017790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:15.017804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:15.017821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896195025740384:8402], now have 1 active actors on pipe
2025-09-30T14:56:15.018053Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:15.018120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896195025740384:8402]
2025-09-30T14:56:15.018153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:15.018163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:15.018238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2152 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1bd52daf-91f180f8-d61aa5eb-8194c35_0
2025-09-30T14:56:15.018416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2152 sessionId: src_id|1bd52daf-91f180f8-d61aa5eb-8194c35_0 is DEAD
2025-09-30T14:56:15.018606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd52daf-91f180f8-d61aa5eb-8194c35_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:15.018621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd52daf-91f180f8-d61aa5eb-8194c35_0] Write session will restart in 0.006061s
2025-09-30T14:56:15.018646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd52daf-91f180f8-d61aa5eb-8194c35_0] Write session: Do CDS request
2025-09-30T14:56:15.018652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd52daf-91f180f8-d61aa5eb-8194c35_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:15.025944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd52daf-91f180f8-d61aa5eb-8194c35_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:15.026111Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:15.026135Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2153
2025-09-30T14:56:15.026435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2153 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:15.026492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2153 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:15.026504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2153 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:15.026511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:15.027273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2153 sessionId:  describe result for acl check
2025-09-30T14:56:15.027310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:15.027318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:15.027320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:15.027326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896199320707705:2624] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:15.027887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896199320707705:2624] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:15.030491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896199320707705:2624] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:15.033553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896199320707705:2624] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:15.033570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896199320707705:2624] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:15.033573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896199320707705:2624] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:15.033582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2153 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:15.036787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:15.039371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:15.039560Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:15.039568Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:15.039576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:15.039624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:15.039676Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896199230936077:3023]
2025-09-30T14:56:15.040309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:15.040686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:15.040737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:15.041083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:15.041168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:15.041175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:15.041177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:15.041178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:15.041179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:15.041180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:15.041182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:15.041183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:15.041184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:15.041185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:15.041186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.041187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.041188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.041190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:15.041191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:15.041197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:15.041207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:15.041212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:15.041216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:15.041220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:15.041225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:15.041229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:15.041233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:15.041237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:15.041242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:15.041245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.041249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.041253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.041256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:15.041260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:15.041268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:15.041276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:15.041282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:15.041288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:15.041293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:15.041299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:15.041304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:15.041309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:15.041314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:15.041320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:15.041324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:15.041330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:15.041335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:15.041340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:15.041345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:15.041350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:15.041355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:15.041360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:15.041365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:15.041371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:15.041387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.041395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.041405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.041411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.041416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.041426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.041430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:15.041434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:15.041444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:15.041449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:15.041492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:15.047582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:15.048525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:15.048543Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:15.048545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:15.048549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:15.048554Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2152 [2:7555896199230936077:3023]
2025-09-30T14:56:15.048567Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:15.048579Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:15.048581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:15.048584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:15.048586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:15.048599Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:15.048605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:15.048610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:15.048655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.048661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.048663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.048666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:15.048668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:15.048724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:15.048730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.048738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.048745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.048758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:15.048779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896199230936072:3023]
2025-09-30T14:56:15.048787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896199230936072:3023]
2025-09-30T14:56:15.048789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896199230936072:3023]
2025-09-30T14:56:15.048801Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:15.048813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:15.048815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896199320707874:2624], now have 1 active actors on pipe
2025-09-30T14:56:15.048818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896199320707681:2454], now have 1 active actors on pipe
2025-09-30T14:56:15.048823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:15.048824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:15.048824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:15.048834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:15.048837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:15.048867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896199230936072:3023]
2025-09-30T14:56:15.048875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:15.048879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:15.048884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2152
2025-09-30T14:56:15.048888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2152
2025-09-30T14:56:15.048992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:15.049005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:15.049043Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8bcae70-1bd8565d-ddbbf19e-50e56598_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:15.049055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:15.049063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:15.049065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:15.049076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:15.049089Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:15.049107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:15.049233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:15.049243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:15.049259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:15.049348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2153 partition: 0 MaxSeqNo: 42 sessionId: src_id|d8bcae70-1bd8565d-ddbbf19e-50e56598_0
2025-09-30T14:56:15.049805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd52daf-91f180f8-d61aa5eb-8194c35_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d8bcae70-1bd8565d-ddbbf19e-50e56598_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:15.053236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8bcae70-1bd8565d-ddbbf19e-50e56598_0] Write session: try to update token
2025-09-30T14:56:15.053261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8bcae70-1bd8565d-ddbbf19e-50e56598_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:15.061533Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:15.061553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:15.061555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:15.061558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:15.061570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896199230936072:3023]
2025-09-30T14:56:15.061575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896199230936072:3023]
2025-09-30T14:56:15.061578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896199230936072:3023]
2025-09-30T14:56:15.061617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:15.061624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.061626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:15.061626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:15.061632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:15.061636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:15.061767Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:15.072033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2153 sessionId: src_id|d8bcae70-1bd8565d-ddbbf19e-50e56598_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:15.074905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:15.118577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896199320707929:8402]
2025-09-30T14:56:15.119039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2152, pipe: [1:7555896199320707929:8402]
2025-09-30T14:56:15.178355Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:15.178685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:15.178700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:15.178721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896199320707929:8402], now have 1 active actors on pipe
2025-09-30T14:56:15.178989Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:15.178999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896199320707929:8402]
2025-09-30T14:56:15.179042Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:15.179078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:15.179169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2153 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d8bcae70-1bd8565d-ddbbf19e-50e56598_0
2025-09-30T14:56:15.179358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2153 sessionId: src_id|d8bcae70-1bd8565d-ddbbf19e-50e56598_0 is DEAD
2025-09-30T14:56:15.179521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8bcae70-1bd8565d-ddbbf19e-50e56598_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:15.179533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8bcae70-1bd8565d-ddbbf19e-50e56598_0] Write session will restart in 0.005481s
2025-09-30T14:56:15.179558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8bcae70-1bd8565d-ddbbf19e-50e56598_0] Write session: Do CDS request
2025-09-30T14:56:15.179564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8bcae70-1bd8565d-ddbbf19e-50e56598_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:15.185902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8bcae70-1bd8565d-ddbbf19e-50e56598_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:15.186000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:15.186017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2154
2025-09-30T14:56:15.186167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2154 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:15.186196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2154 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:15.186206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2154 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:15.186210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:15.186621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2154 sessionId:  describe result for acl check
2025-09-30T14:56:15.186659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:15.186666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:15.186668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:15.186686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896199320707961:2622] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:15.187277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896199320707961:2622] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:15.189568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896199320707961:2622] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:15.192888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896199320707961:2622] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:15.192905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896199320707961:2622] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:15.192909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896199320707961:2622] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:15.192918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2154 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:15.198126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:15.201394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:15.201635Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:15.201646Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:15.201656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:15.201707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:15.201748Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896199230936317:3021]
2025-09-30T14:56:15.202445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:15.202802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:15.202881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:15.203279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:15.203350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:15.203357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:15.203358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:15.203359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:15.203361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:15.203362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:15.203364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:15.203365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:15.203367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:15.203368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:15.203370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.203371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.203372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.203373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:15.203375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:15.203381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:15.203392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:15.203396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:15.203401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:15.203405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:15.203409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:15.203413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:15.203417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:15.203421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:15.203424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:15.203428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.203431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.203434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.203439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:15.203442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:15.203450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:15.203459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:15.203465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:15.203471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:15.203476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:15.203481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:15.203491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:15.203497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:15.203502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:15.203512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:15.203517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:15.203526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:15.203532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:15.203542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:15.203546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:15.203552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:15.203558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:15.203563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:15.203568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:15.203572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:15.203577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.203587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.203592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.203598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.203604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.203610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.203616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:15.203621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:15.203625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:15.203630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:15.203674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:15.209522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:15.210928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:15.210950Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:15.210952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:15.210956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:15.210963Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2153 [2:7555896199230936317:3021]
2025-09-30T14:56:15.210978Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:15.210994Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:15.210997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:15.210999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:15.211001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:15.211016Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:15.211022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:15.211028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:15.211092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.211101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.211103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.211107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:15.211109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:15.211180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:15.211192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.211205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.211215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.211229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:15.211267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896199230936312:3021]
2025-09-30T14:56:15.211270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896199230936312:3021]
2025-09-30T14:56:15.211272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896199230936312:3021]
2025-09-30T14:56:15.211281Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:15.211292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:15.211296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:15.211298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:15.211299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896199320708082:2622], now have 1 active actors on pipe
2025-09-30T14:56:15.211304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896199320707937:2454], now have 1 active actors on pipe
2025-09-30T14:56:15.211309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:15.211323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:15.211325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:15.211363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896199230936312:3021]
2025-09-30T14:56:15.211383Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:15.211419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:15.211413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2153
2025-09-30T14:56:15.211446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2153
2025-09-30T14:56:15.211549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:15.211565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:15.211603Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b64e2ff-b445f7f5-e28f0a07-400578f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:15.211616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:15.211621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:15.211629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:15.211642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:15.211667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:15.211690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:15.211921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:15.211934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:15.211956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:15.212081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2154 partition: 0 MaxSeqNo: 42 sessionId: src_id|8b64e2ff-b445f7f5-e28f0a07-400578f9_0
2025-09-30T14:56:15.212489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8bcae70-1bd8565d-ddbbf19e-50e56598_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8b64e2ff-b445f7f5-e28f0a07-400578f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:15.215791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b64e2ff-b445f7f5-e28f0a07-400578f9_0] Write session: try to update token
2025-09-30T14:56:15.215812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b64e2ff-b445f7f5-e28f0a07-400578f9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:15.224178Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:15.224200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:15.224203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:15.224205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:15.224216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896199230936312:3021]
2025-09-30T14:56:15.224221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896199230936312:3021]
2025-09-30T14:56:15.224225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896199230936312:3021]
2025-09-30T14:56:15.224271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:15.224274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:15.224278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.224282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:15.224282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:15.224286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:15.224446Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:15.236511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2154 sessionId: src_id|8b64e2ff-b445f7f5-e28f0a07-400578f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:15.239755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:15.279342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896199320708197:8402]
2025-09-30T14:56:15.279693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2153, pipe: [1:7555896199320708197:8402]
2025-09-30T14:56:15.344858Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:15.345401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:15.345421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:15.345443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896199320708197:8402], now have 1 active actors on pipe
2025-09-30T14:56:15.345702Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:15.345725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:15.345742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:15.345745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:15.345797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896199320708197:8402]
2025-09-30T14:56:15.345864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2154 reason: error at write: Disconnected sessionId: src_id|8b64e2ff-b445f7f5-e28f0a07-400578f9_0
2025-09-30T14:56:15.346052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2154 sessionId: src_id|8b64e2ff-b445f7f5-e28f0a07-400578f9_0 is DEAD
2025-09-30T14:56:15.346303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b64e2ff-b445f7f5-e28f0a07-400578f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:15.346319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b64e2ff-b445f7f5-e28f0a07-400578f9_0] Write session will restart in 0.005531s
2025-09-30T14:56:15.346352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b64e2ff-b445f7f5-e28f0a07-400578f9_0] Write session: Do CDS request
2025-09-30T14:56:15.346372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b64e2ff-b445f7f5-e28f0a07-400578f9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:15.353006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b64e2ff-b445f7f5-e28f0a07-400578f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:15.353020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:15.353038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2155
2025-09-30T14:56:15.353327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2155 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:15.353363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2155 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:15.353373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2155 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:15.353390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:15.353861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2155 sessionId:  describe result for acl check
2025-09-30T14:56:15.353898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:15.353905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:15.353907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:15.353912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896199320708217:2635] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:15.354456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896199320708217:2635] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:15.357354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896199320708217:2635] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:15.361784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896199320708217:2635] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:15.361806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896199320708217:2635] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:15.361810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896199320708217:2635] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:15.361819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2155 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:15.367574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:15.370537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:15.370887Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:15.370901Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:15.370914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:15.370974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:15.371019Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896199230936558:3016]
2025-09-30T14:56:15.371722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:15.372065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:15.372115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:15.372451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:15.372544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:15.372550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:15.372552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:15.372553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:15.372554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:15.372556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:15.372558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:15.372559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:15.372561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:15.372562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:15.372564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.372565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.372566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.372568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:15.372569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:15.372576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:15.372588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:15.372592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:15.372596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:15.372599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:15.372603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:15.372606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:15.372611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:15.372614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:15.372619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:15.372624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.372627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.372632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.372636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:15.372640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:15.372649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:15.372658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:15.372666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:15.372672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:15.372678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:15.372683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:15.372688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:15.372694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:15.372699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:15.372706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:15.372710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:15.372716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:15.372721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:15.372727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:15.372733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:15.372744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:15.372750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:15.372759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:15.372763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:15.372771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:15.372776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.372785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.372789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.372795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.372802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.372808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.372812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:15.372816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:15.372824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:15.372832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:15.372875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:15.378725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:15.380006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:15.380025Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:15.380028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:15.380032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:15.380039Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2154 [2:7555896199230936558:3016]
2025-09-30T14:56:15.380056Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:15.380073Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:15.380076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:15.380080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:15.380083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:15.380099Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:15.380106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:15.380113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:15.380179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.380189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.380191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.380195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:15.380198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:15.380267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:15.380276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.380291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.380303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.380320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:15.380338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896199320708198:2454], now have 1 active actors on pipe
2025-09-30T14:56:15.380342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896199320708333:2635], now have 1 active actors on pipe
2025-09-30T14:56:15.380350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896199230936553:3016]
2025-09-30T14:56:15.380357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896199230936553:3016]
2025-09-30T14:56:15.380360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896199230936553:3016]
2025-09-30T14:56:15.380374Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:15.380390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:15.380393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:15.380401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:15.380404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:15.380407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:15.380411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:15.380447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896199230936553:3016]
2025-09-30T14:56:15.380458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:15.380464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:15.380501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2154
2025-09-30T14:56:15.380518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2154
2025-09-30T14:56:15.380585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:15.380595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:15.380620Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6df75a3e-8f420909-b310fe60-6e1fa2c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:15.380627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:15.380636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:15.380638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:15.380648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:15.380661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:15.380681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:15.380904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:15.380913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:15.380926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:15.381039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2155 partition: 0 MaxSeqNo: 42 sessionId: src_id|6df75a3e-8f420909-b310fe60-6e1fa2c1_0
2025-09-30T14:56:15.381428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b64e2ff-b445f7f5-e28f0a07-400578f9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6df75a3e-8f420909-b310fe60-6e1fa2c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:15.384390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6df75a3e-8f420909-b310fe60-6e1fa2c1_0] Write session: try to update token
2025-09-30T14:56:15.384411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6df75a3e-8f420909-b310fe60-6e1fa2c1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:15.393360Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:15.393399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:15.393401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:15.393404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:15.393415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896199230936553:3016]
2025-09-30T14:56:15.393419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896199230936553:3016]
2025-09-30T14:56:15.393422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896199230936553:3016]
2025-09-30T14:56:15.393463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:15.393470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.393471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:15.393473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:15.393477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:15.393482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:15.393613Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:15.406426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2155 sessionId: src_id|6df75a3e-8f420909-b310fe60-6e1fa2c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:15.409430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:15.445669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896199320708477:8402]
2025-09-30T14:56:15.445921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2154, pipe: [1:7555896199320708477:8402]
2025-09-30T14:56:15.514679Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:15.515110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:15.515126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:15.515148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896199320708477:8402], now have 1 active actors on pipe
2025-09-30T14:56:15.515432Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:15.515464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:15.515481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:15.515558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2155 reason: error at write: Disconnected sessionId: src_id|6df75a3e-8f420909-b310fe60-6e1fa2c1_0
2025-09-30T14:56:15.515740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2155 sessionId: src_id|6df75a3e-8f420909-b310fe60-6e1fa2c1_0 is DEAD
2025-09-30T14:56:15.515967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6df75a3e-8f420909-b310fe60-6e1fa2c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:15.515986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6df75a3e-8f420909-b310fe60-6e1fa2c1_0] Write session will restart in 0.006298s
2025-09-30T14:56:15.515751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896199320708477:8402]
2025-09-30T14:56:15.516015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6df75a3e-8f420909-b310fe60-6e1fa2c1_0] Write session: Do CDS request
2025-09-30T14:56:15.515771Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:15.516022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6df75a3e-8f420909-b310fe60-6e1fa2c1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:15.523809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6df75a3e-8f420909-b310fe60-6e1fa2c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:15.523924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:15.523943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2156
2025-09-30T14:56:15.524108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2156 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:15.524141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2156 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:15.524152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2156 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:15.524157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:15.524626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2156 sessionId:  describe result for acl check
2025-09-30T14:56:15.524676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:15.524684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:15.524687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:15.524693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896199320708494:2660] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:15.525277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896199320708494:2660] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:15.528143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896199320708494:2660] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:15.532081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896199320708494:2660] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:15.532104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896199320708494:2660] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:15.532107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896199320708494:2660] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:15.532117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2156 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:15.535876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:15.539285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:15.539639Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:15.539649Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:15.539663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:15.539729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:15.539775Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896199230936838:2981]
2025-09-30T14:56:15.540486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:15.540913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:15.540962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:15.541328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:15.541404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:15.541412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:15.541414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:15.541415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:15.541416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:15.541418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:15.541420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:15.541421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:15.541423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:15.541424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:15.541425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.541426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.541427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.541429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:15.541430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:15.541437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:15.541449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:15.541454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:15.541458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:15.541462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:15.541467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:15.541472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:15.541476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:15.541481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:15.541485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:15.541489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.541494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.541498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.541502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:15.541507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:15.541515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:15.541523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:15.541530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:15.541536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:15.541541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:15.541547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:15.541553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:15.541564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:15.541574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:15.541585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:15.541593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:15.541600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:15.541610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:15.541618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:15.541623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:15.541629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:15.541634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:15.541640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:15.541645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:15.541654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:15.541661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.541667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.541678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.541687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.541693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.541703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.541708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:15.541718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:15.541727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:15.541733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:15.541784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:15.547825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:15.549014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:15.549033Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:15.549036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:15.549040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:15.549048Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2155 [2:7555896199230936838:2981]
2025-09-30T14:56:15.549064Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:15.549082Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:15.549086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:15.549089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:15.549092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:15.549111Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:15.549124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:15.549135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:15.549205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.549213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.549215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.549219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:15.549221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:15.549294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:15.549303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.549316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.549329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.549349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:15.549373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896199320708478:2454], now have 1 active actors on pipe
2025-09-30T14:56:15.549403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896199230936833:2981]
2025-09-30T14:56:15.549406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896199230936833:2981]
2025-09-30T14:56:15.549408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896199230936833:2981]
2025-09-30T14:56:15.549421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:15.549431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896199320708656:2660], now have 1 active actors on pipe
2025-09-30T14:56:15.549439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:15.549439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:15.549444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:15.549446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:15.549457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:15.549460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:15.549501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896199230936833:2981]
2025-09-30T14:56:15.549513Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:15.549523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:15.549529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2155
2025-09-30T14:56:15.549551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2155
2025-09-30T14:56:15.549705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:15.549716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:15.549744Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec13cad4-69b64ed8-6720dc83-e4fc312e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:15.549757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:15.549766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:15.549768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:15.549778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:15.549788Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:15.549809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:15.549983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:15.549993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:15.550007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:15.550102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2156 partition: 0 MaxSeqNo: 42 sessionId: src_id|ec13cad4-69b64ed8-6720dc83-e4fc312e_0
2025-09-30T14:56:15.550494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6df75a3e-8f420909-b310fe60-6e1fa2c1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ec13cad4-69b64ed8-6720dc83-e4fc312e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:15.553568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec13cad4-69b64ed8-6720dc83-e4fc312e_0] Write session: try to update token
2025-09-30T14:56:15.553589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec13cad4-69b64ed8-6720dc83-e4fc312e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:15.568490Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:15.568511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:15.568520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896199230936833:2981]
2025-09-30T14:56:15.568567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:15.568585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:15.568739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:15.568899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:15.569049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:15.569200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:15.569429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:15.569480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:15.571155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2156 sessionId: src_id|ec13cad4-69b64ed8-6720dc83-e4fc312e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:15.574131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:15.574157Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:15.574178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:15.574181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:15.574183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:15.574192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896199230936833:2981]
2025-09-30T14:56:15.574196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896199230936833:2981]
2025-09-30T14:56:15.574204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896199230936833:2981]
2025-09-30T14:56:15.574240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:15.574246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.574249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:15.574249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:15.574256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:15.574260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:15.574379Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:15.615680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896199320708729:8402]
2025-09-30T14:56:15.616018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2155, pipe: [1:7555896199320708729:8402]
2025-09-30T14:56:15.695734Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:15.696232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:15.696251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:15.696273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896199320708729:8402], now have 1 active actors on pipe
2025-09-30T14:56:15.696516Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:15.696545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896199320708729:8402]
2025-09-30T14:56:15.696577Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:15.696584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:15.696588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:15.696663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2156 reason: error at write: Disconnected sessionId: src_id|ec13cad4-69b64ed8-6720dc83-e4fc312e_0
2025-09-30T14:56:15.696843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2156 sessionId: src_id|ec13cad4-69b64ed8-6720dc83-e4fc312e_0 is DEAD
2025-09-30T14:56:15.697010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec13cad4-69b64ed8-6720dc83-e4fc312e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:15.697022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec13cad4-69b64ed8-6720dc83-e4fc312e_0] Write session will restart in 0.007379s
2025-09-30T14:56:15.697046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec13cad4-69b64ed8-6720dc83-e4fc312e_0] Write session: Do CDS request
2025-09-30T14:56:15.697055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec13cad4-69b64ed8-6720dc83-e4fc312e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:15.705901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec13cad4-69b64ed8-6720dc83-e4fc312e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:15.706075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:15.706093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2157
2025-09-30T14:56:15.706245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2157 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:15.706289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2157 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:15.706300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2157 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:15.706305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:15.706896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2157 sessionId:  describe result for acl check
2025-09-30T14:56:15.706938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:15.706948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:15.706950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:15.706957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896199320708757:2661] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:15.707554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896199320708757:2661] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:15.710826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896199320708757:2661] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:15.714437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896199320708757:2661] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:15.714454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896199320708757:2661] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:15.714458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896199320708757:2661] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:15.714466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2157 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:15.717543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:15.720632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:15.720876Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:15.720887Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:15.720897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:15.720952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:15.720995Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896199230937081:2977]
2025-09-30T14:56:15.721712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:15.722106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:15.722174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:15.722890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:15.723002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:15.723012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:15.723013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:15.723015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:15.723017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:15.723018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:15.723019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:15.723020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:15.723021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:15.723023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:15.723024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.723025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.723027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.723028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:15.723029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:15.723035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:15.723047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:15.723051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:15.723056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:15.723060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:15.723064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:15.723068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:15.723072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:15.723076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:15.723081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:15.723086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.723090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.723094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.723098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:15.723102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:15.723113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:15.723123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:15.723129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:15.723135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:15.723141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:15.723146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:15.723151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:15.723157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:15.723162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:15.723168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:15.723173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:15.723180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:15.723185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:15.723191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:15.723195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:15.723200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:15.723206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:15.723211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:15.723215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:15.723220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:15.723225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.723230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.723234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.723239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.723263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.723269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.723274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:15.723280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:15.723288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:15.723294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:15.723340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:15.729209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:15.730432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:15.730450Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:15.730454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:15.730459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:15.730465Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2156 [2:7555896199230937081:2977]
2025-09-30T14:56:15.730484Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:15.730500Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:15.730509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:15.730512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:15.730514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:15.730530Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:15.730537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:15.730544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:15.730605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.730613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.730615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.730619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:15.730621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:15.730687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:15.730694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.730707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.730718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.730738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:15.730760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896199320708930:2661], now have 1 active actors on pipe
2025-09-30T14:56:15.730770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896199320708733:2454], now have 1 active actors on pipe
2025-09-30T14:56:15.730776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896199230937076:2977]
2025-09-30T14:56:15.730783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896199230937076:2977]
2025-09-30T14:56:15.730786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896199230937076:2977]
2025-09-30T14:56:15.730795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:15.730807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:15.730808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:15.730820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:15.730822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:15.730822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:15.730825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:15.730861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896199230937076:2977]
2025-09-30T14:56:15.730875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:15.730882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:15.730871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2156
2025-09-30T14:56:15.730878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2156
2025-09-30T14:56:15.730922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:15.730932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:15.730961Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ea6cc8-c79c4948-ca6ba676-8742f695_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:15.730972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:15.730975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:15.730977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:15.730986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:15.730998Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:15.731017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:15.731178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:15.731186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:15.731199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:15.731320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2157 partition: 0 MaxSeqNo: 42 sessionId: src_id|7ea6cc8-c79c4948-ca6ba676-8742f695_0
2025-09-30T14:56:15.731683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec13cad4-69b64ed8-6720dc83-e4fc312e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7ea6cc8-c79c4948-ca6ba676-8742f695_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:15.734676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea6cc8-c79c4948-ca6ba676-8742f695_0] Write session: try to update token
2025-09-30T14:56:15.734699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea6cc8-c79c4948-ca6ba676-8742f695_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:15.743852Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:15.743878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:15.743880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:15.743883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:15.743895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896199230937076:2977]
2025-09-30T14:56:15.743899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896199230937076:2977]
2025-09-30T14:56:15.743905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896199230937076:2977]
2025-09-30T14:56:15.743950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:15.743957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.743961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:15.743964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:15.743971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:15.743976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:15.744113Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:15.756894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2157 sessionId: src_id|7ea6cc8-c79c4948-ca6ba676-8742f695_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:15.759903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:15.796415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896199320708985:8402]
2025-09-30T14:56:15.796743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2156, pipe: [1:7555896199320708985:8402]
2025-09-30T14:56:15.865097Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:15.865456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:15.865477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:15.865498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896199320708985:8402], now have 1 active actors on pipe
2025-09-30T14:56:15.865738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:15.865751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896199320708985:8402]
2025-09-30T14:56:15.865755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:15.865775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:15.865839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2157 reason: error at write: Disconnected sessionId: src_id|7ea6cc8-c79c4948-ca6ba676-8742f695_0
2025-09-30T14:56:15.865978Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:15.866016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2157 sessionId: src_id|7ea6cc8-c79c4948-ca6ba676-8742f695_0 is DEAD
2025-09-30T14:56:15.866180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea6cc8-c79c4948-ca6ba676-8742f695_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:15.866191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea6cc8-c79c4948-ca6ba676-8742f695_0] Write session will restart in 0.006658s
2025-09-30T14:56:15.866213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea6cc8-c79c4948-ca6ba676-8742f695_0] Write session: Do CDS request
2025-09-30T14:56:15.866222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea6cc8-c79c4948-ca6ba676-8742f695_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:15.873826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea6cc8-c79c4948-ca6ba676-8742f695_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:15.873897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:15.873921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2158
2025-09-30T14:56:15.874089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2158 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:15.874151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2158 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:15.874162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2158 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:15.874166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:15.874577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2158 sessionId:  describe result for acl check
2025-09-30T14:56:15.874612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:15.874618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:15.874620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:15.874626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896199320709001:2671] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:15.875142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896199320709001:2671] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:15.877385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896199320709001:2671] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:15.880839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896199320709001:2671] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:15.880856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896199320709001:2671] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:15.880859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896199320709001:2671] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:15.880868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2158 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:15.887287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:15.890369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:15.890624Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:15.890643Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:15.890657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:15.890727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:15.890783Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896199230937339:2973]
2025-09-30T14:56:15.891515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:15.891911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:15.891979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:15.892355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:15.892448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:15.892460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:15.892462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:15.892463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:15.892465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:15.892466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:15.892467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:15.892469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:15.892470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:15.892472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:15.892473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.892474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.892475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.892477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:15.892478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:15.892485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:15.892496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:15.892501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:15.892505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:15.892510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:15.892515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:15.892519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:15.892524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:15.892528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:15.892533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:15.892538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.892542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.892549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.892553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:15.892558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:15.892568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:15.892577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:15.892583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:15.892590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:15.892596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:15.892601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:15.892607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:15.892613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:15.892619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:15.892625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:15.892630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:15.892636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:15.892642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:15.892648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:15.892653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:15.892659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:15.892667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:15.892672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:15.892678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:15.892684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:15.892689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.892695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.892701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.892708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.892723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.892735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.892747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:15.892753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:15.892764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:15.892770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:15.892819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:15.898700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:15.900184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:15.900203Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:15.900206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:15.900211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:15.900218Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2157 [2:7555896199230937339:2973]
2025-09-30T14:56:15.900237Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:15.900254Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:15.900263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:15.900266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:15.900268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:15.900284Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:15.900291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:15.900299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:15.900362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.900371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.900374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.900378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:15.900381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:15.900451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:15.900459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.900475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:15.900494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:15.900516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:15.900542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896199320709113:2671], now have 1 active actors on pipe
2025-09-30T14:56:15.900552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896199320708986:2454], now have 1 active actors on pipe
2025-09-30T14:56:15.900560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896199230937334:2973]
2025-09-30T14:56:15.900562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896199230937334:2973]
2025-09-30T14:56:15.900564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896199230937334:2973]
2025-09-30T14:56:15.900580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:15.900599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:15.900610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:15.900619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:15.900622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:15.900633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:15.900640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:15.900658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896199230937334:2973]
2025-09-30T14:56:15.900662Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:15.900665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:15.900624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2157
2025-09-30T14:56:15.900678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:15.900665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2157
2025-09-30T14:56:15.900688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:15.900742Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6248c03b-7ba021d4-b6cb872-846c2cfe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:15.900754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:15.900757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:15.900760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:15.900770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:15.900784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:15.900814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:15.901030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:15.901042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:15.901060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:15.901151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2158 partition: 0 MaxSeqNo: 42 sessionId: src_id|6248c03b-7ba021d4-b6cb872-846c2cfe_0
2025-09-30T14:56:15.901503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea6cc8-c79c4948-ca6ba676-8742f695_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6248c03b-7ba021d4-b6cb872-846c2cfe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:15.904316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6248c03b-7ba021d4-b6cb872-846c2cfe_0] Write session: try to update token
2025-09-30T14:56:15.904337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6248c03b-7ba021d4-b6cb872-846c2cfe_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:15.913810Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:15.913836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:15.913839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:15.913841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:15.913850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896199230937334:2973]
2025-09-30T14:56:15.913856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896199230937334:2973]
2025-09-30T14:56:15.913860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896199230937334:2973]
2025-09-30T14:56:15.913905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:15.913914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:15.913920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:15.913921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:15.913923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:15.913925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:15.914069Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:15.921725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2158 sessionId: src_id|6248c03b-7ba021d4-b6cb872-846c2cfe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:15.924558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:15.965894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896199320709252:8402]
2025-09-30T14:56:15.966207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2157, pipe: [1:7555896199320709252:8402]
2025-09-30T14:56:16.034724Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:16.035318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:16.035347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:16.035370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896199320709252:8402], now have 1 active actors on pipe
2025-09-30T14:56:16.035603Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:16.035613Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:16.035670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:16.035673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:16.035676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896199320709252:8402]
2025-09-30T14:56:16.035735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2158 reason: error at write: Disconnected sessionId: src_id|6248c03b-7ba021d4-b6cb872-846c2cfe_0
2025-09-30T14:56:16.035918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2158 sessionId: src_id|6248c03b-7ba021d4-b6cb872-846c2cfe_0 is DEAD
2025-09-30T14:56:16.036329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6248c03b-7ba021d4-b6cb872-846c2cfe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:16.036342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6248c03b-7ba021d4-b6cb872-846c2cfe_0] Write session will restart in 0.005478s
2025-09-30T14:56:16.036364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6248c03b-7ba021d4-b6cb872-846c2cfe_0] Write session: Do CDS request
2025-09-30T14:56:16.036373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6248c03b-7ba021d4-b6cb872-846c2cfe_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:16.042781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6248c03b-7ba021d4-b6cb872-846c2cfe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:16.047499Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:16.047517Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2159
2025-09-30T14:56:16.047714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2159 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:16.047762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2159 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:16.047768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2159 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:16.047773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:16.048240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2159 sessionId:  describe result for acl check
2025-09-30T14:56:16.048280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:16.048286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:16.048289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:16.048295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896203615676566:2676] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:16.048816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896203615676566:2676] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:16.051179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896203615676566:2676] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:16.058126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896203615676566:2676] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:16.058146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896203615676566:2676] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:16.058149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896203615676566:2676] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:16.058159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2159 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:16.063628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:16.066759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:16.066976Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:16.066988Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:16.066999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:16.067055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:16.067093Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896203525904880:2970]
2025-09-30T14:56:16.067826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:16.068133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:16.068184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:16.068553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:16.068620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:16.068629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:16.068631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:16.068632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:16.068634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:16.068635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:16.068636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:16.068638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:16.068639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:16.068640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:16.068642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.068643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.068644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.068646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:16.068647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:16.068653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:16.068665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:16.068670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:16.068675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:16.068680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:16.068685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:16.068689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:16.068694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:16.068698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:16.068703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:16.068708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.068713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.068718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.068723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:16.068727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:16.068735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:16.068744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:16.068750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:16.068757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:16.068762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:16.068768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:16.068773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:16.068779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:16.068784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:16.068791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:16.068796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:16.068802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:16.068807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:16.068813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:16.068819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:16.068825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:16.068830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:16.068836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:16.068841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:16.068848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:16.068853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.068859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.068863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.068869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.068877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.068889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.068894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:16.068899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:16.068904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:16.068910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:16.068957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:16.074766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:16.076062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:16.076083Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:16.076086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:16.076090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:16.076098Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2158 [2:7555896203525904880:2970]
2025-09-30T14:56:16.076115Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:16.076131Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:16.076134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:16.076137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:16.076139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:16.076157Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:16.076164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:16.076172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:16.076242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.076251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.076254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.076257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:16.076260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:16.076329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:16.076338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.076352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.076363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.076383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:16.076407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896203615676702:2676], now have 1 active actors on pipe
2025-09-30T14:56:16.076421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896203525904875:2970]
2025-09-30T14:56:16.076424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896203525904875:2970]
2025-09-30T14:56:16.076426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896203525904875:2970]
2025-09-30T14:56:16.076440Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:16.076449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896203615676549:2454], now have 1 active actors on pipe
2025-09-30T14:56:16.076453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:16.076456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:16.076457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:16.076459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:16.076470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:16.076478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:16.076514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896203525904875:2970]
2025-09-30T14:56:16.076528Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:16.076562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:16.076566Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2158
2025-09-30T14:56:16.076628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2158
2025-09-30T14:56:16.076698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:16.076707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:16.076730Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea577fb4-da3b430c-737c8cd7-77c5154_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:16.076742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:16.076752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:16.076754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:16.076766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:16.076780Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:16.076798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:16.076969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:16.076985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:16.077010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:16.077110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2159 partition: 0 MaxSeqNo: 42 sessionId: src_id|ea577fb4-da3b430c-737c8cd7-77c5154_0
2025-09-30T14:56:16.077479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6248c03b-7ba021d4-b6cb872-846c2cfe_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ea577fb4-da3b430c-737c8cd7-77c5154_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:16.080451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea577fb4-da3b430c-737c8cd7-77c5154_0] Write session: try to update token
2025-09-30T14:56:16.080473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea577fb4-da3b430c-737c8cd7-77c5154_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:16.089761Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:16.089785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:16.089790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:16.089792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:16.089803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896203525904875:2970]
2025-09-30T14:56:16.089809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896203525904875:2970]
2025-09-30T14:56:16.089814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896203525904875:2970]
2025-09-30T14:56:16.089861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:16.089868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:16.089875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:16.089877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.089878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:16.089880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:16.090057Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:16.096216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2159 sessionId: src_id|ea577fb4-da3b430c-737c8cd7-77c5154_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:16.098807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:16.135879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896203615676804:8402]
2025-09-30T14:56:16.136168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2158, pipe: [1:7555896203615676804:8402]
2025-09-30T14:56:16.203988Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:16.204483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:16.204501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:16.204541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896203615676804:8402], now have 1 active actors on pipe
2025-09-30T14:56:16.204769Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:16.204829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:16.204847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:16.204853Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:16.204902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896203615676804:8402]
2025-09-30T14:56:16.204926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2159 reason: error at write: Disconnected sessionId: src_id|ea577fb4-da3b430c-737c8cd7-77c5154_0
2025-09-30T14:56:16.205121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2159 sessionId: src_id|ea577fb4-da3b430c-737c8cd7-77c5154_0 is DEAD
2025-09-30T14:56:16.205243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea577fb4-da3b430c-737c8cd7-77c5154_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:16.205254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea577fb4-da3b430c-737c8cd7-77c5154_0] Write session will restart in 0.007595s
2025-09-30T14:56:16.205278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea577fb4-da3b430c-737c8cd7-77c5154_0] Write session: Do CDS request
2025-09-30T14:56:16.205284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea577fb4-da3b430c-737c8cd7-77c5154_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:16.213921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea577fb4-da3b430c-737c8cd7-77c5154_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:16.213927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:16.213944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2160
2025-09-30T14:56:16.215484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2160 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:16.215539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2160 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:16.215552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2160 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:16.215558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:16.216058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2160 sessionId:  describe result for acl check
2025-09-30T14:56:16.216096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:16.216106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:16.216108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:16.216115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896203615676844:2686] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:16.216668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896203615676844:2686] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:16.219392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896203615676844:2686] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:16.222583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896203615676844:2686] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:16.222602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896203615676844:2686] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:16.222605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896203615676844:2686] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:16.222614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2160 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:16.225462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:16.228051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:16.228280Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:16.228296Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:16.228307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:16.228381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:16.228439Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896203525905127:2964]
2025-09-30T14:56:16.229096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:16.229488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:16.229554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:16.229938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:16.230004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:16.230011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:16.230012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:16.230013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:16.230015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:16.230016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:16.230018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:16.230019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:16.230021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:16.230022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:16.230024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.230025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.230027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.230028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:16.230029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:16.230035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:16.230047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:16.230051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:16.230056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:16.230060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:16.230064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:16.230068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:16.230073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:16.230077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:16.230082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:16.230086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.230090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.230095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.230099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:16.230104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:16.230112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:16.230121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:16.230127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:16.230133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:16.230139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:16.230145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:16.230150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:16.230156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:16.230167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:16.230173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:16.230183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:16.230188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:16.230200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:16.230205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:16.230214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:16.230220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:16.230227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:16.230233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:16.230242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:16.230248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:16.230253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.230263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.230268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.230278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.230288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.230304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.230313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:16.230319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:16.230324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:16.230330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:16.230400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:16.236084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:16.237437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:16.237454Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:16.237457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:16.237461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:16.237467Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2159 [2:7555896203525905127:2964]
2025-09-30T14:56:16.237485Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:16.237501Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:16.237509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:16.237513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:16.237515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:16.237533Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:16.237545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:16.237551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:16.237620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.237629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.237631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.237635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:16.237638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:16.237706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:16.237714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.237727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.237744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.237763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:16.237787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896203615676810:2454], now have 1 active actors on pipe
2025-09-30T14:56:16.237797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896203525905122:2964]
2025-09-30T14:56:16.237800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896203525905122:2964]
2025-09-30T14:56:16.237802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896203525905122:2964]
2025-09-30T14:56:16.237816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:16.237829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896203615677025:2686], now have 1 active actors on pipe
2025-09-30T14:56:16.237830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:16.237833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:16.237836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:16.237841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:16.237856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:16.237862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:16.237897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896203525905122:2964]
2025-09-30T14:56:16.237909Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:16.237932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:16.237912Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2159
2025-09-30T14:56:16.237920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2159
2025-09-30T14:56:16.238185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:16.238198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:16.238224Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|832d84cd-25566d8f-50a2cc37-baeccca4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:16.238237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:16.238241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:16.238248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:16.238260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:16.238275Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:16.238293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:16.238481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:16.238507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:16.238529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:16.238658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2160 partition: 0 MaxSeqNo: 42 sessionId: src_id|832d84cd-25566d8f-50a2cc37-baeccca4_0
2025-09-30T14:56:16.239048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea577fb4-da3b430c-737c8cd7-77c5154_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|832d84cd-25566d8f-50a2cc37-baeccca4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:16.241904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|832d84cd-25566d8f-50a2cc37-baeccca4_0] Write session: try to update token
2025-09-30T14:56:16.241924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|832d84cd-25566d8f-50a2cc37-baeccca4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:16.250897Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:16.250924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:16.250927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:16.250930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:16.250951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896203525905122:2964]
2025-09-30T14:56:16.250956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896203525905122:2964]
2025-09-30T14:56:16.250961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896203525905122:2964]
2025-09-30T14:56:16.251007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:16.251013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.251015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:16.251019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:16.251037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:16.251041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:16.251182Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:16.257729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2160 sessionId: src_id|832d84cd-25566d8f-50a2cc37-baeccca4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:16.260764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:16.304864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896203615677069:8402]
2025-09-30T14:56:16.305204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2159, pipe: [1:7555896203615677069:8402]
2025-09-30T14:56:16.372283Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:16.372743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:16.372761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:16.372800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896203615677069:8402], now have 1 active actors on pipe
2025-09-30T14:56:16.373015Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:16.373078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:16.373079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896203615677069:8402]
2025-09-30T14:56:16.373105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:16.373179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2160 reason: status is not ok: tablet will be restarted right now sessionId: src_id|832d84cd-25566d8f-50a2cc37-baeccca4_0
2025-09-30T14:56:16.373355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2160 sessionId: src_id|832d84cd-25566d8f-50a2cc37-baeccca4_0 is DEAD
2025-09-30T14:56:16.373525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|832d84cd-25566d8f-50a2cc37-baeccca4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:16.373536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|832d84cd-25566d8f-50a2cc37-baeccca4_0] Write session will restart in 0.008324s
2025-09-30T14:56:16.373559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|832d84cd-25566d8f-50a2cc37-baeccca4_0] Write session: Do CDS request
2025-09-30T14:56:16.373564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|832d84cd-25566d8f-50a2cc37-baeccca4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:16.382860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|832d84cd-25566d8f-50a2cc37-baeccca4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:16.382997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:16.383017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2161
2025-09-30T14:56:16.383168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2161 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:16.383210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2161 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:16.383220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2161 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:16.383224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:16.383665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2161 sessionId:  describe result for acl check
2025-09-30T14:56:16.383709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:16.383715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:16.383718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:16.383725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896203615677086:2690] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:16.384276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896203615677086:2690] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:16.387377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896203615677086:2690] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:16.391186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896203615677086:2690] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:16.391203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896203615677086:2690] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:16.391206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896203615677086:2690] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:16.391214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2161 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:16.396279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:16.399512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:16.399785Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:16.399796Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:16.399805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:16.399864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:16.399922Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896203525905374:2968]
2025-09-30T14:56:16.400604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:16.401014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:16.401094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:16.401513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:16.401592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:16.401599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:16.401600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:16.401602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:16.401603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:16.401605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:16.401606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:16.401608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:16.401609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:16.401610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:16.401611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.401612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.401613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.401614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:16.401615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:16.401620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:16.401631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:16.401635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:16.401640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:16.401644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:16.401649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:16.401654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:16.401658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:16.401662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:16.401665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:16.401668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.401670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.401673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.401676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:16.401679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:16.401688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:16.401694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:16.401702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:16.401706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:16.401709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:16.401713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:16.401716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:16.401723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:16.401726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:16.401729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:16.401732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:16.401735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:16.401738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:16.401742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:16.401745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:16.401749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:16.401752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:16.401756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:16.401759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:16.401762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:16.401765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.401768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.401773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.401776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.401780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.401783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.401786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:16.401790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:16.401797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:16.401801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:16.401837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:16.407857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:16.409213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:16.409235Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:16.409237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:16.409241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:16.409249Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2160 [2:7555896203525905374:2968]
2025-09-30T14:56:16.409267Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:16.409284Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:16.409293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:16.409296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:16.409298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:16.409315Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:16.409325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:16.409337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:16.409426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.409434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.409436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.409440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:16.409443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:16.409509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:16.409517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.409531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.409549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.409572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:16.409597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896203615677231:2690], now have 1 active actors on pipe
2025-09-30T14:56:16.409609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896203525905369:2968]
2025-09-30T14:56:16.409612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896203525905369:2968]
2025-09-30T14:56:16.409614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896203525905369:2968]
2025-09-30T14:56:16.409627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:16.409644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896203615677070:2454], now have 1 active actors on pipe
2025-09-30T14:56:16.409656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:16.409659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:16.409660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:16.409663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:16.409674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:16.409677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:16.409714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896203525905369:2968]
2025-09-30T14:56:16.409732Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:16.409721Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2160
2025-09-30T14:56:16.409758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:16.409730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2160
2025-09-30T14:56:16.409791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:16.409800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:16.409830Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9eac29c-2f93803f-c3ecdac4-84b0cc8c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:16.409843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:16.409848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:16.409851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:16.409861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:16.409871Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:16.409888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:16.410065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:16.410074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:16.410088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:16.410190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2161 partition: 0 MaxSeqNo: 42 sessionId: src_id|f9eac29c-2f93803f-c3ecdac4-84b0cc8c_0
2025-09-30T14:56:16.410559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|832d84cd-25566d8f-50a2cc37-baeccca4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f9eac29c-2f93803f-c3ecdac4-84b0cc8c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:16.413724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9eac29c-2f93803f-c3ecdac4-84b0cc8c_0] Write session: try to update token
2025-09-30T14:56:16.413749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9eac29c-2f93803f-c3ecdac4-84b0cc8c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:16.423369Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:16.423393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:16.423404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896203525905369:2968]
2025-09-30T14:56:16.423460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:16.423469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:16.423656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:16.423827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:16.423999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:16.424172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:16.424393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:16.424442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:16.430763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2161 sessionId: src_id|f9eac29c-2f93803f-c3ecdac4-84b0cc8c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:16.433764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:16.435836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:16.435865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:16.435905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:16.437199Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:16.437221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:16.437224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:16.437226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:16.437238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896203525905369:2968]
2025-09-30T14:56:16.437242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896203525905369:2968]
2025-09-30T14:56:16.437246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896203525905369:2968]
2025-09-30T14:56:16.437287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:16.437294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.437297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:16.437383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:16.437399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:16.437403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:16.437457Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:16.436008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:16.468666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896203615677340:8402]
2025-09-30T14:56:16.468914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2160, pipe: [1:7555896203615677340:8402]
2025-09-30T14:56:16.550966Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:16.558755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:16.558785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:16.558949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:16.559018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:16.559076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:16.559152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:16.559206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:16.559220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:16.559313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:16.559599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:16.559672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:16.559740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:16.559791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:16.559799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:16.559870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:16.559930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:16.559992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:16.560054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:16.560319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:16.560332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:16.560401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:16.560466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:16.560524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:16.560581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:16.560680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:16.560684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:16.560750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:16.560803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:16.560869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:16.560935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:16.560973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:16.560975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:16.561038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:16.561091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:16.561148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:16.561222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:16.561259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:16.561261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:16.561324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:16.561396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:16.561454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:16.561510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:16.561550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:16.561552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:16.561614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:16.561668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:16.561731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:16.561791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:16.561833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:16.561834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:16.561898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:16.561958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:16.562024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:16.562086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:16.562123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:16.562125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:16.562188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:16.562248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:16.562311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:16.562368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:16.562406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:16.562413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:16.562490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896203615677340:8402], now have 1 active actors on pipe
2025-09-30T14:56:16.562725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896203615677340:8402]
2025-09-30T14:56:16.562747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:16.562751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:16.562757Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:16.562780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2161 reason: error at write: Disconnected sessionId: src_id|f9eac29c-2f93803f-c3ecdac4-84b0cc8c_0
2025-09-30T14:56:16.562978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2161 sessionId: src_id|f9eac29c-2f93803f-c3ecdac4-84b0cc8c_0 is DEAD
2025-09-30T14:56:16.563094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9eac29c-2f93803f-c3ecdac4-84b0cc8c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:16.563104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9eac29c-2f93803f-c3ecdac4-84b0cc8c_0] Write session will restart in 0.009921s
2025-09-30T14:56:16.563140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9eac29c-2f93803f-c3ecdac4-84b0cc8c_0] Write session: Do CDS request
2025-09-30T14:56:16.563145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9eac29c-2f93803f-c3ecdac4-84b0cc8c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:16.563260Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:16.574077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9eac29c-2f93803f-c3ecdac4-84b0cc8c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:16.574197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:16.574213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2162
2025-09-30T14:56:16.574341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2162 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:16.574372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2162 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:16.574382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2162 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:16.574386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:16.574943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2162 sessionId:  describe result for acl check
2025-09-30T14:56:16.574978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:16.574981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:16.574982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:16.574989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896203615677424:2706] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:16.575832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896203615677424:2706] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:16.578790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896203615677424:2706] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:16.582296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896203615677424:2706] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:16.582312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896203615677424:2706] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:16.582316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896203615677424:2706] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:16.582324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2162 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:16.582624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:16.585604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:16.585807Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:16.585819Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:16.585831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:16.585883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:16.585926Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896203525905659:2943]
2025-09-30T14:56:16.586644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:16.587017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:16.587090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:16.587481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:16.587567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:16.587575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:16.587576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:16.587577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:16.587578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:16.587580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:16.587581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:16.587582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:16.587583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:16.587585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:16.587586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.587587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.587588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.587590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:16.587591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:16.587597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:16.587608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:16.587613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:16.587617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:16.587621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:16.587625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:16.587629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:16.587634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:16.587637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:16.587643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:16.587647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.587651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.587655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.587659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:16.587663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:16.587672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:16.587680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:16.587685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:16.587690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:16.587694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:16.587699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:16.587703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:16.587708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:16.587712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:16.587717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:16.587727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:16.587733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:16.587738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:16.587744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:16.587754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:16.587760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:16.587772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:16.587778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:16.587783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:16.587789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:16.587799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.587805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.587810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.587816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.587821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.587827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.587832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:16.587843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:16.587848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:16.587859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:16.587910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:16.593703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:16.594871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:16.594896Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:16.594899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:16.594903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:16.594911Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2161 [2:7555896203525905659:2943]
2025-09-30T14:56:16.594930Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:16.594947Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:16.594950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:16.594954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:16.594957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:16.594974Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:16.594987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:16.594995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:16.595070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.595078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.595080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.595084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:16.595087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:16.595166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:16.595176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.595191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.595205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.595224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:16.595266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896203525905654:2943]
2025-09-30T14:56:16.595275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896203525905654:2943]
2025-09-30T14:56:16.595278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896203525905654:2943]
2025-09-30T14:56:16.595291Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:16.595305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:16.595309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:16.595309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896203615677351:2454], now have 1 active actors on pipe
2025-09-30T14:56:16.595311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:16.595313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896203615677596:2706], now have 1 active actors on pipe
2025-09-30T14:56:16.595321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:16.595338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:16.595341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:16.595379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896203525905654:2943]
2025-09-30T14:56:16.595389Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:16.595407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:16.595374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2161
2025-09-30T14:56:16.595382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2161
2025-09-30T14:56:16.595455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:16.595465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:16.595491Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1604dbee-c9d69139-9ef8ad58-3b3af0a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:16.595502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:16.595505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:16.595512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:16.595525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:16.595540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:16.595558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:16.595722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:16.595734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:16.595750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:16.595872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2162 partition: 0 MaxSeqNo: 42 sessionId: src_id|1604dbee-c9d69139-9ef8ad58-3b3af0a9_0
2025-09-30T14:56:16.596248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9eac29c-2f93803f-c3ecdac4-84b0cc8c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1604dbee-c9d69139-9ef8ad58-3b3af0a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:16.599047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1604dbee-c9d69139-9ef8ad58-3b3af0a9_0] Write session: try to update token
2025-09-30T14:56:16.599072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1604dbee-c9d69139-9ef8ad58-3b3af0a9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:16.615405Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:16.615433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:16.615446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896203525905654:2943]
2025-09-30T14:56:16.615499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:16.615505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:16.615702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:16.615861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:16.616015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:16.616173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:16.616503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:16.616561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:16.620713Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:16.620733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:16.620736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:16.620738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:16.620747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896203525905654:2943]
2025-09-30T14:56:16.620752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896203525905654:2943]
2025-09-30T14:56:16.620756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896203525905654:2943]
2025-09-30T14:56:16.620795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:16.620799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:16.620802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.620805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:16.620815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:16.620823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:16.620939Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:16.621856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2162 sessionId: src_id|1604dbee-c9d69139-9ef8ad58-3b3af0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:16.624722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:16.662719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896203615677610:8402]
2025-09-30T14:56:16.663012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2161, pipe: [1:7555896203615677610:8402]
2025-09-30T14:56:16.734164Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:16.734697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:16.734713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:16.734731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896203615677610:8402], now have 1 active actors on pipe
2025-09-30T14:56:16.734956Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:16.734973Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:16.735006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896203615677610:8402]
2025-09-30T14:56:16.735028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:16.735099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2162 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1604dbee-c9d69139-9ef8ad58-3b3af0a9_0
2025-09-30T14:56:16.735325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2162 sessionId: src_id|1604dbee-c9d69139-9ef8ad58-3b3af0a9_0 is DEAD
2025-09-30T14:56:16.735532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1604dbee-c9d69139-9ef8ad58-3b3af0a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:16.735541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1604dbee-c9d69139-9ef8ad58-3b3af0a9_0] Write session will restart in 0.005362s
2025-09-30T14:56:16.735564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1604dbee-c9d69139-9ef8ad58-3b3af0a9_0] Write session: Do CDS request
2025-09-30T14:56:16.735570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1604dbee-c9d69139-9ef8ad58-3b3af0a9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:16.741736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1604dbee-c9d69139-9ef8ad58-3b3af0a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:16.741886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:16.741905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2163
2025-09-30T14:56:16.742051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2163 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:16.742102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2163 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:16.742112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2163 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:16.742116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:16.742598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2163 sessionId:  describe result for acl check
2025-09-30T14:56:16.742639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:16.742646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:16.742648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:16.742654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896203615677627:2718] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:16.743205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896203615677627:2718] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:16.746356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896203615677627:2718] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:16.749812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896203615677627:2718] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:16.749829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896203615677627:2718] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:16.749835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896203615677627:2718] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:16.749843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2163 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:16.755100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:16.758245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:16.758453Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:16.758464Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:16.758476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:16.758549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:16.758594Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896203525905907:2937]
2025-09-30T14:56:16.759108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:16.759405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:16.759441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:16.759674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:16.759715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:16.759720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:16.759720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:16.759721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:16.759722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:16.759723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:16.759723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:16.759724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:16.759725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:16.759726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:16.759726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.759727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.759728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.759728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:16.759729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:16.759733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:16.759739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:16.759742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:16.759744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:16.759747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:16.759749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:16.759751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:16.759754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:16.759756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:16.759759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:16.759761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.759764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.759766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.759768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:16.759771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:16.759778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:16.759783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:16.759787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:16.759790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:16.759793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:16.759796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:16.759799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:16.759803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:16.759806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:16.759809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:16.759812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:16.759815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:16.759817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:16.759820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:16.759823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:16.759826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:16.759829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:16.759834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:16.759836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:16.759839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:16.759842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.759845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.759847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.759850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.759853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.759855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.759858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:16.759861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:16.759864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:16.759867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:16.759892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:16.765305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:16.766559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:16.766581Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:16.766583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:16.766587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:16.766594Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2162 [2:7555896203525905907:2937]
2025-09-30T14:56:16.766614Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:16.766632Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:16.766640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:16.766643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:16.766645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:16.766661Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:16.766676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:16.766683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:16.766742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.766750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.766752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.766756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:16.766758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:16.766830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:16.766838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.766851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.766869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.766889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:16.766912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896203615677612:2454], now have 1 active actors on pipe
2025-09-30T14:56:16.766919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896203615677772:2718], now have 1 active actors on pipe
2025-09-30T14:56:16.766926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896203525905902:2937]
2025-09-30T14:56:16.766928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896203525905902:2937]
2025-09-30T14:56:16.766930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896203525905902:2937]
2025-09-30T14:56:16.766944Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:16.766958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:16.766973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:16.766977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:16.766981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:16.766985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:16.766963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2162
2025-09-30T14:56:16.766987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:16.766974Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2162
2025-09-30T14:56:16.767015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896203525905902:2937]
2025-09-30T14:56:16.767019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:16.767021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:16.767038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:16.767047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:16.767093Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77b1dcb-53b830d8-f64fce36-dac2398a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:16.767106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:16.767109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:16.767111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:16.767122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:16.767131Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:16.767153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:16.767406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:16.767417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:16.767432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:16.767544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2163 partition: 0 MaxSeqNo: 42 sessionId: src_id|77b1dcb-53b830d8-f64fce36-dac2398a_0
2025-09-30T14:56:16.767916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1604dbee-c9d69139-9ef8ad58-3b3af0a9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|77b1dcb-53b830d8-f64fce36-dac2398a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:16.770848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77b1dcb-53b830d8-f64fce36-dac2398a_0] Write session: try to update token
2025-09-30T14:56:16.770867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77b1dcb-53b830d8-f64fce36-dac2398a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:16.779496Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:16.779522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:16.779524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:16.779526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:16.779536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896203525905902:2937]
2025-09-30T14:56:16.779540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896203525905902:2937]
2025-09-30T14:56:16.779544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896203525905902:2937]
2025-09-30T14:56:16.779583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:16.779590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.779594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:16.779599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:16.779607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:16.779612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:16.779731Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:16.789233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2163 sessionId: src_id|77b1dcb-53b830d8-f64fce36-dac2398a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:16.792416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:16.818856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-09-30T14:56:16.818891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 12
2025-09-30T14:56:16.835265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896203615677873:8402]
2025-09-30T14:56:16.835545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2162, pipe: [1:7555896203615677873:8402]
2025-09-30T14:56:16.894234Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:16.894875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:16.894890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:16.894927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896203615677873:8402], now have 1 active actors on pipe
2025-09-30T14:56:16.895136Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:16.895152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896203615677873:8402]
2025-09-30T14:56:16.895158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:16.895162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:16.895185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:16.895196Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 12
2025-09-30T14:56:16.895223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2163 reason: error at write: Disconnected sessionId: src_id|77b1dcb-53b830d8-f64fce36-dac2398a_0
2025-09-30T14:56:16.895410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2163 sessionId: src_id|77b1dcb-53b830d8-f64fce36-dac2398a_0 is DEAD
2025-09-30T14:56:16.895852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77b1dcb-53b830d8-f64fce36-dac2398a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:16.895868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77b1dcb-53b830d8-f64fce36-dac2398a_0] Write session will restart in 0.008706s
2025-09-30T14:56:16.895904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77b1dcb-53b830d8-f64fce36-dac2398a_0] Write session: Do CDS request
2025-09-30T14:56:16.895912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77b1dcb-53b830d8-f64fce36-dac2398a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:16.906038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77b1dcb-53b830d8-f64fce36-dac2398a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:16.906156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:16.906176Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2164
2025-09-30T14:56:16.906397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2164 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:16.906450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2164 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:16.906461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2164 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:16.906467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:16.906944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2164 sessionId:  describe result for acl check
2025-09-30T14:56:16.906992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:16.906994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:16.906996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:16.907002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896203615677922:2729] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:16.907638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896203615677922:2729] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:16.910752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896203615677922:2729] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:16.914045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896203615677922:2729] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:16.914065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896203615677922:2729] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:16.914069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896203615677922:2729] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:16.914078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2164 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:16.916668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:16.919812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:16.920179Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:16.920193Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:16.920207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:16.920278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:16.920323Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896203525906172:2933]
2025-09-30T14:56:16.921004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:16.921331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:16.921393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:16.921752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:16.921838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:16.921845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:16.921847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:16.921849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:16.921850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:16.921851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:16.921852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:16.921854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:16.921855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:16.921856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:16.921858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.921859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.921861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.921862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:16.921863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:16.921870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:16.921882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:16.921886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:16.921890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:16.921894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:16.921899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:16.921904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:16.921908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:16.921912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:16.921918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:16.921922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.921927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.921931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.921936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:16.921940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:16.921949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:16.921957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:16.921964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:16.921970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:16.921975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:16.921981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:16.921985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:16.921991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:16.921997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:16.922003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:16.922014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:16.922020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:16.922025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:16.922030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:16.922035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:16.922041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:16.922051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:16.922057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:16.922062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:16.922068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:16.922078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.922085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.922094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.922100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.922110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.922116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.922126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:16.922134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:16.922144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:16.922149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:16.922200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:16.928107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:16.929410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:16.929431Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:16.929434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:16.929438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:16.929445Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2163 [2:7555896203525906172:2933]
2025-09-30T14:56:16.929462Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:16.929480Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:16.929484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:16.929487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:16.929489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:16.929505Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:16.929517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:16.929525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:16.929588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.929595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.929598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.929601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:16.929604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:16.929671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:16.929678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.929693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:16.929710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:16.929732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:16.929756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896203615677874:2454], now have 1 active actors on pipe
2025-09-30T14:56:16.929768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896203525906166:2933]
2025-09-30T14:56:16.929770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896203525906166:2933]
2025-09-30T14:56:16.929772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896203525906166:2933]
2025-09-30T14:56:16.929784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:16.929794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896203615678114:2729], now have 1 active actors on pipe
2025-09-30T14:56:16.929798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:16.929802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:16.929805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:16.929806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:16.929822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:16.929830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:16.929869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896203525906166:2933]
2025-09-30T14:56:16.929877Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:16.929862Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2163
2025-09-30T14:56:16.929864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2163
2025-09-30T14:56:16.929910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:16.929974Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 85826639 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:56:16.930010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:16.930021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:16.930045Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6bd38b09-2026d8bb-2768f533-f1ba7078_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:16.930052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:16.930063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:16.930065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:16.930075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:16.930084Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:16.930096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:16.930208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 14 DataSize: 85826639 UsedReserveSize: 0
2025-09-30T14:56:16.930259Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:56:16.930318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:16.930333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:16.930357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:16.930466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2164 partition: 0 MaxSeqNo: 42 sessionId: src_id|6bd38b09-2026d8bb-2768f533-f1ba7078_0
2025-09-30T14:56:16.930935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77b1dcb-53b830d8-f64fce36-dac2398a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6bd38b09-2026d8bb-2768f533-f1ba7078_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:16.934475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bd38b09-2026d8bb-2768f533-f1ba7078_0] Write session: try to update token
2025-09-30T14:56:16.934507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bd38b09-2026d8bb-2768f533-f1ba7078_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:16.942860Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:16.942889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:16.942892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:16.942894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:16.942909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896203525906166:2933]
2025-09-30T14:56:16.942913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896203525906166:2933]
2025-09-30T14:56:16.942916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896203525906166:2933]
2025-09-30T14:56:16.942954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:16.942961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:16.942963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:16.942968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:16.942970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:16.942972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:16.943124Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:16.954692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2164 sessionId: src_id|6bd38b09-2026d8bb-2768f533-f1ba7078_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:16.957569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:16.995506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896203615678148:8402]
2025-09-30T14:56:16.995844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2163, pipe: [1:7555896203615678148:8402]
2025-09-30T14:56:17.072810Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:17.073324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:17.073348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:17.073382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896203615678148:8402], now have 1 active actors on pipe
2025-09-30T14:56:17.073620Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:17.074091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bd38b09-2026d8bb-2768f533-f1ba7078_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:17.074101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bd38b09-2026d8bb-2768f533-f1ba7078_0] Write session will restart in 0.006412s
2025-09-30T14:56:17.074119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bd38b09-2026d8bb-2768f533-f1ba7078_0] Write session: Do CDS request
2025-09-30T14:56:17.074124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bd38b09-2026d8bb-2768f533-f1ba7078_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:17.073635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:17.073640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896203615678148:8402]
2025-09-30T14:56:17.073650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:17.073661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:17.073677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 0
2025-09-30T14:56:17.073713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2164 reason: error at write: Disconnected sessionId: src_id|6bd38b09-2026d8bb-2768f533-f1ba7078_0
2025-09-30T14:56:17.073889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2164 sessionId: src_id|6bd38b09-2026d8bb-2768f533-f1ba7078_0 is DEAD
2025-09-30T14:56:17.081899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bd38b09-2026d8bb-2768f533-f1ba7078_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:17.081908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:17.081924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2165
2025-09-30T14:56:17.082189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2165 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:17.082223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2165 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:17.082233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2165 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:17.082237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:17.082837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2165 sessionId:  describe result for acl check
2025-09-30T14:56:17.082880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:17.082882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:17.082885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:17.082891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896207910645473:2739] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:17.083543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896207910645473:2739] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:17.086161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896207910645473:2739] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:17.089804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896207910645473:2739] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:17.089819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896207910645473:2739] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:17.089822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896207910645473:2739] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:17.089831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2165 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:17.093922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:17.096685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:17.096929Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:17.096940Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:17.096950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:17.097003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:17.097041Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896207820873719:2923]
2025-09-30T14:56:17.097529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:17.097866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:17.097903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:17.098201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:17.098247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:17.098253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:17.098254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:17.098255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:17.098256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:17.098257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:17.098258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:17.098258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:17.098259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:17.098260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:17.098261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.098262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.098262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.098263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:17.098264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:17.098268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:17.098275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:17.098277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:17.098280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:17.098282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:17.098285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:17.098288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:17.098290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:17.098293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:17.098295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:17.098298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.098302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.098306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.098310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:17.098314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:17.098322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:17.098329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:17.098335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:17.098341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:17.098345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:17.098351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:17.098355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:17.098361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:17.098365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:17.098372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:17.098377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:17.098382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:17.098387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:17.098392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:17.098398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:17.098404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:17.098409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:17.098414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:17.098418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:17.098424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:17.098428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.098433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.098438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.098443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.098447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.098452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.098457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:17.098463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:17.098467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:17.098473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:17.098517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:17.104086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:17.104960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:17.104978Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:17.104981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:17.104985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:17.104993Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2164 [2:7555896207820873719:2923]
2025-09-30T14:56:17.105009Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:17.105025Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:17.105028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:17.105031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:17.105033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:17.105051Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:17.105057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:17.105064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:17.105121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.105129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.105132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.105136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:17.105138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:17.105203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:17.105213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.105226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.105238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.105261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:17.105284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896207910645627:2739], now have 1 active actors on pipe
2025-09-30T14:56:17.105292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896207910645448:2454], now have 1 active actors on pipe
2025-09-30T14:56:17.105299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896207820873714:2923]
2025-09-30T14:56:17.105301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896207820873714:2923]
2025-09-30T14:56:17.105304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896207820873714:2923]
2025-09-30T14:56:17.105318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:17.105331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:17.105336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:17.105341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:17.105342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:17.105351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:17.105355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:17.105334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2164
2025-09-30T14:56:17.105344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2164
2025-09-30T14:56:17.105398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896207820873714:2923]
2025-09-30T14:56:17.105406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:17.105413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:17.105422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:17.105432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:17.105557Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6100b647-226989a-d12998e5-3b424757_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:17.105568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:17.105572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:17.105575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:17.105584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:17.105593Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:17.105636Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 85826639 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:56:17.105678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:17.105847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:17.105861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:17.105849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 15 DataSize: 85826639 UsedReserveSize: 0
2025-09-30T14:56:17.105881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:56:17.105883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:17.105972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2165 partition: 0 MaxSeqNo: 42 sessionId: src_id|6100b647-226989a-d12998e5-3b424757_0
2025-09-30T14:56:17.106341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bd38b09-2026d8bb-2768f533-f1ba7078_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6100b647-226989a-d12998e5-3b424757_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:17.109270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6100b647-226989a-d12998e5-3b424757_0] Write session: try to update token
2025-09-30T14:56:17.109291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6100b647-226989a-d12998e5-3b424757_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:17.117865Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:17.117888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:17.117891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:17.117893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:17.117902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896207820873714:2923]
2025-09-30T14:56:17.117906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896207820873714:2923]
2025-09-30T14:56:17.117910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896207820873714:2923]
2025-09-30T14:56:17.117967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:17.117971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:17.117978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:17.117979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.117981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:17.117985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:17.118129Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:17.124766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2165 sessionId: src_id|6100b647-226989a-d12998e5-3b424757_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:17.127747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:17.173677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896207910645717:8402]
2025-09-30T14:56:17.173949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2164, pipe: [1:7555896207910645717:8402]
2025-09-30T14:56:17.234600Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:17.234872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:17.234886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:17.234921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896207910645717:8402], now have 1 active actors on pipe
2025-09-30T14:56:17.235147Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:17.235194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896207910645717:8402]
2025-09-30T14:56:17.235202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:17.235215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:17.235223Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:17.235294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2165 reason: error at write: Disconnected sessionId: src_id|6100b647-226989a-d12998e5-3b424757_0
2025-09-30T14:56:17.235490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2165 sessionId: src_id|6100b647-226989a-d12998e5-3b424757_0 is DEAD
2025-09-30T14:56:17.235646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6100b647-226989a-d12998e5-3b424757_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:17.235654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6100b647-226989a-d12998e5-3b424757_0] Write session will restart in 0.007181s
2025-09-30T14:56:17.235677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6100b647-226989a-d12998e5-3b424757_0] Write session: Do CDS request
2025-09-30T14:56:17.235682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6100b647-226989a-d12998e5-3b424757_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:17.243780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6100b647-226989a-d12998e5-3b424757_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:17.243842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:17.243862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2166
2025-09-30T14:56:17.244018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2166 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:17.244056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2166 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:17.244066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2166 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:17.244071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:17.244678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2166 sessionId:  describe result for acl check
2025-09-30T14:56:17.244730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:17.244737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:17.244739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:17.244745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896207910645748:2743] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:17.245349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896207910645748:2743] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:17.247870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896207910645748:2743] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:17.250917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896207910645748:2743] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:17.250934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896207910645748:2743] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:17.250940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896207910645748:2743] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:17.250950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2166 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:17.257080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:17.259736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:17.259981Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:17.259993Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:17.260005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:17.260070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:17.260112Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896207820873971:2919]
2025-09-30T14:56:17.260835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:17.261206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:17.261266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:17.261631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:17.261703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:17.261709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:17.261711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:17.261712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:17.261713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:17.261715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:17.261716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:17.261717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:17.261719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:17.261720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:17.261722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.261723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.261724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.261725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:17.261727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:17.261733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:17.261744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:17.261748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:17.261753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:17.261757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:17.261761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:17.261765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:17.261769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:17.261773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:17.261778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:17.261782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.261786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.261790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.261795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:17.261799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:17.261807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:17.261815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:17.261822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:17.261827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:17.261832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:17.261837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:17.261842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:17.261846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:17.261851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:17.261855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:17.261861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:17.261865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:17.261877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:17.261882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:17.261889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:17.261893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:17.261899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:17.261904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:17.261909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:17.261914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:17.261920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.261928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.261934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.261945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.261950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.261959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.261965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:17.261975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:17.261979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:17.261989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:17.262039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:17.267896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:17.269491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:17.269509Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:17.269512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:17.269516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:17.269523Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2165 [2:7555896207820873971:2919]
2025-09-30T14:56:17.269544Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:17.269560Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:17.269564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:17.269567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:17.269569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:17.269587Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:17.269598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:17.269605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:17.269672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.269680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.269682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.269686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:17.269689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:17.269759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:17.269767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.269781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.269797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.269817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:17.269843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896207910645721:2454], now have 1 active actors on pipe
2025-09-30T14:56:17.269853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896207910645885:2743], now have 1 active actors on pipe
2025-09-30T14:56:17.269860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896207820873966:2919]
2025-09-30T14:56:17.269865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896207820873966:2919]
2025-09-30T14:56:17.269867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896207820873966:2919]
2025-09-30T14:56:17.269881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:17.269895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:17.269899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:17.269903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:17.269906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:17.269914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:17.269917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:17.269956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896207820873966:2919]
2025-09-30T14:56:17.269968Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:17.269956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2165
2025-09-30T14:56:17.269986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:17.270002Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2165
2025-09-30T14:56:17.270005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:17.270010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:17.270043Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|431f47d9-d23ea16c-ba875664-496c9257_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:17.270058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:17.270062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:17.270064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:17.270075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:17.270089Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:17.270109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:17.270269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:17.270278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:17.270292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:17.270376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2166 partition: 0 MaxSeqNo: 42 sessionId: src_id|431f47d9-d23ea16c-ba875664-496c9257_0
2025-09-30T14:56:17.270782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6100b647-226989a-d12998e5-3b424757_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|431f47d9-d23ea16c-ba875664-496c9257_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:17.273723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|431f47d9-d23ea16c-ba875664-496c9257_0] Write session: try to update token
2025-09-30T14:56:17.273747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|431f47d9-d23ea16c-ba875664-496c9257_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:17.288131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2166 sessionId: src_id|431f47d9-d23ea16c-ba875664-496c9257_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:17.288927Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:17.288955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:17.288966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896207820873966:2919]
2025-09-30T14:56:17.289034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:17.289035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:17.289266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:17.289451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:17.289622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:17.289793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:17.290052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:17.290103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:17.291087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:17.291306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:17.291331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:17.291363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:17.291443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:17.293757Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:17.293776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:17.293779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:17.293781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:17.293790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896207820873966:2919]
2025-09-30T14:56:17.293794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896207820873966:2919]
2025-09-30T14:56:17.293798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896207820873966:2919]
2025-09-30T14:56:17.293835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:17.293842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.293845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:17.293854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:17.293870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:17.293875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:17.293990Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:17.335500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896207910645985:8402]
2025-09-30T14:56:17.335826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2165, pipe: [1:7555896207910645985:8402]
2025-09-30T14:56:17.406698Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:17.415382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:17.415413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:17.415576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:17.415638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:17.415698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:17.415772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:17.415829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:17.415839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:17.415906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:17.415968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:17.416029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:17.416093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:17.416137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:17.416143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:17.416216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:17.416283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:17.416343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:17.416403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:17.416451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:17.416459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:17.416535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:17.416609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:17.416693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:17.416764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:17.416806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:17.416814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:17.416878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:17.416937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:17.417003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:17.417085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:17.417131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:17.417133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:17.417196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:17.417252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:17.417325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:17.417407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:17.417450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:17.417456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:17.417526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:17.417598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:17.417664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:17.417731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:17.417781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:17.417787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:17.417851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:17.417908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:17.417969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:17.418038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:17.418082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:17.418087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:17.418150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:17.418210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:17.418272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:17.418343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:17.418393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:17.418399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:17.418463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:17.418521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:17.418595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:17.418662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:17.418705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:17.418711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:17.418774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896207910645985:8402], now have 1 active actors on pipe
2025-09-30T14:56:17.419040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896207910645985:8402]
2025-09-30T14:56:17.419050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:17.419084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:17.419090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:17.419124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2166 reason: error at write: Disconnected sessionId: src_id|431f47d9-d23ea16c-ba875664-496c9257_0
2025-09-30T14:56:17.419347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2166 sessionId: src_id|431f47d9-d23ea16c-ba875664-496c9257_0 is DEAD
2025-09-30T14:56:17.419506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|431f47d9-d23ea16c-ba875664-496c9257_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:17.419517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|431f47d9-d23ea16c-ba875664-496c9257_0] Write session will restart in 0.008520s
2025-09-30T14:56:17.419542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|431f47d9-d23ea16c-ba875664-496c9257_0] Write session: Do CDS request
2025-09-30T14:56:17.419548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|431f47d9-d23ea16c-ba875664-496c9257_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:17.420002Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:17.428808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|431f47d9-d23ea16c-ba875664-496c9257_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:17.428870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:17.428890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2167
2025-09-30T14:56:17.429050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2167 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:17.429085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2167 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:17.429096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2167 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:17.429101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:17.429512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2167 sessionId:  describe result for acl check
2025-09-30T14:56:17.429545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:17.429548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:17.429550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:17.429555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896207910646000:2738] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:17.430103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896207910646000:2738] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:17.432701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896207910646000:2738] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:17.438269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896207910646000:2738] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:17.438301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896207910646000:2738] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:17.438304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896207910646000:2738] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:17.438314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2167 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:17.443029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:17.445929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:17.446154Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:17.446164Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:17.446174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:17.446227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:17.446270Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896207820874224:2916]
2025-09-30T14:56:17.446967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:17.447331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:17.447384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:17.447741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:17.447809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:17.447815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:17.447816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:17.447817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:17.447818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:17.447820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:17.447821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:17.447822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:17.447823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:17.447825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:17.447826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.447828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.447829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.447829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:17.447830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:17.447834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:17.447841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:17.447844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:17.447846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:17.447848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:17.447851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:17.447853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:17.447855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:17.447859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:17.447863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:17.447867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.447871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.447875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.447879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:17.447883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:17.447893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:17.447902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:17.447908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:17.447914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:17.447919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:17.447925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:17.447929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:17.447935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:17.447939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:17.447945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:17.447949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:17.447955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:17.447959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:17.447971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:17.447976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:17.447986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:17.447992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:17.448002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:17.448006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:17.448012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:17.448021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.448029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.448034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.448045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.448050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.448055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.448060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:17.448065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:17.448070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:17.448075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:17.448120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:17.453993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:17.455278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:17.455299Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:17.455301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:17.455305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:17.455313Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2166 [2:7555896207820874224:2916]
2025-09-30T14:56:17.455329Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:17.455345Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:17.455355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:17.455358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:17.455361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:17.455378Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:17.455391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:17.455401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:17.455474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.455482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.455484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.455488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:17.455491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:17.455563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:17.455574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.455590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.455605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.455623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:17.455642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896207910645987:2454], now have 1 active actors on pipe
2025-09-30T14:56:17.455651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896207910646156:2738], now have 1 active actors on pipe
2025-09-30T14:56:17.455657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896207820874218:2916]
2025-09-30T14:56:17.455660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896207820874218:2916]
2025-09-30T14:56:17.455663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896207820874218:2916]
2025-09-30T14:56:17.455676Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:17.455692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:17.455694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:17.455704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:17.455706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:17.455709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:17.455712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:17.455749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896207820874218:2916]
2025-09-30T14:56:17.455760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:17.455776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:17.455725Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2166
2025-09-30T14:56:17.455786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2166
2025-09-30T14:56:17.455925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:17.455936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:17.455959Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d070df9b-4d0b4e7b-cb5e8ff-ec0f014_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:17.455971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:17.455975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:17.455977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:17.455988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:17.455997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:17.456011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:17.456170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:17.456182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:17.456196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:17.456279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2167 partition: 0 MaxSeqNo: 42 sessionId: src_id|d070df9b-4d0b4e7b-cb5e8ff-ec0f014_0
2025-09-30T14:56:17.456696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|431f47d9-d23ea16c-ba875664-496c9257_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d070df9b-4d0b4e7b-cb5e8ff-ec0f014_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:17.459555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d070df9b-4d0b4e7b-cb5e8ff-ec0f014_0] Write session: try to update token
2025-09-30T14:56:17.459587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d070df9b-4d0b4e7b-cb5e8ff-ec0f014_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:17.469061Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:17.469088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:17.469102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896207820874218:2916]
2025-09-30T14:56:17.469152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:17.469337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:17.469512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:17.469655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:17.469815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:17.470022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:17.470071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:17.470195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:17.476123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2167 sessionId: src_id|d070df9b-4d0b4e7b-cb5e8ff-ec0f014_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:17.478908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:17.479125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:17.479154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:17.480356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:17.480390Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:17.480393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:17.480396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:17.480398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:17.480407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896207820874218:2916]
2025-09-30T14:56:17.480412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896207820874218:2916]
2025-09-30T14:56:17.480417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896207820874218:2916]
2025-09-30T14:56:17.480444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:17.480448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:17.480455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.480457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:17.480469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:17.480474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:17.480520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:17.480592Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:17.519337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896207910646262:8402]
2025-09-30T14:56:17.519717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2166, pipe: [1:7555896207910646262:8402]
2025-09-30T14:56:17.599606Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:17.608938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:17.608973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:17.609163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:17.609242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:17.609313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:17.609398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:17.609451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:17.609461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:17.609535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:17.609603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:17.609677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:17.609752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:17.609808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:17.609814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:17.609887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:17.609957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:17.610025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:17.610097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:17.610143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:17.610152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:17.610222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:17.610296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:17.610366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:17.610436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:17.610483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:17.610491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:17.610563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:17.610631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:17.610699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:17.610770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:17.610818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:17.610826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:17.610899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:17.610965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:17.611037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:17.611106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:17.611159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:17.611167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:17.611238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:17.611323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:17.611396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:17.611461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:17.612074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:17.612086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:17.612161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:17.612233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:17.612302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:17.612375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:17.612422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:17.612429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:17.612501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:17.612564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:17.612635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:17.612704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:17.612755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:17.612763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:17.612833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:17.612902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:17.612970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:17.613041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:17.613087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:17.613096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:17.613160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896207910646262:8402], now have 1 active actors on pipe
2025-09-30T14:56:17.613475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:17.613493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:17.613525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2167 reason: error at write: Disconnected sessionId: src_id|d070df9b-4d0b4e7b-cb5e8ff-ec0f014_0
2025-09-30T14:56:17.613900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d070df9b-4d0b4e7b-cb5e8ff-ec0f014_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:17.613928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d070df9b-4d0b4e7b-cb5e8ff-ec0f014_0] Write session will restart in 0.008106s
2025-09-30T14:56:17.613952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d070df9b-4d0b4e7b-cb5e8ff-ec0f014_0] Write session: Do CDS request
2025-09-30T14:56:17.613958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d070df9b-4d0b4e7b-cb5e8ff-ec0f014_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:17.613755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2167 sessionId: src_id|d070df9b-4d0b4e7b-cb5e8ff-ec0f014_0 is DEAD
2025-09-30T14:56:17.613955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896207910646262:8402]
2025-09-30T14:56:17.614189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:17.613946Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:17.622756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d070df9b-4d0b4e7b-cb5e8ff-ec0f014_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:17.622859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:17.622876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2168
2025-09-30T14:56:17.623075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2168 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:17.623105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2168 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:17.623110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2168 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:17.623114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:17.623698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2168 sessionId:  describe result for acl check
2025-09-30T14:56:17.623740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:17.623742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:17.623744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:17.623750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896207910646297:2782] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:17.624303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896207910646297:2782] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:17.629244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896207910646297:2782] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:17.633088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896207910646297:2782] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:17.633107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896207910646297:2782] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:17.633110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896207910646297:2782] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:17.633118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2168 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:17.637216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:17.640495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:17.640715Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:17.640729Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:17.640741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:17.640803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:17.640851Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896207820874516:2890]
2025-09-30T14:56:17.641389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:17.641730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:17.641769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:17.642072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:17.642128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:17.642133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:17.642134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:17.642135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:17.642135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:17.642136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:17.642137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:17.642138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:17.642139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:17.642140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:17.642141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.642142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.642142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.642143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:17.642144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:17.642148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:17.642155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:17.642157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:17.642160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:17.642163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:17.642165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:17.642167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:17.642170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:17.642172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:17.642175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:17.642177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.642179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.642181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.642184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:17.642186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:17.642194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:17.642199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:17.642203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:17.642207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:17.642209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:17.642213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:17.642216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:17.642219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:17.642223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:17.642226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:17.642228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:17.642231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:17.642234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:17.642238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:17.642241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:17.642244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:17.642247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:17.642251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:17.642253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:17.642258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:17.642263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.642266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.642269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.642272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.642275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.642277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.642280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:17.642283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:17.642285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:17.642288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:17.642313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:17.648256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:17.649432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:17.649451Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:17.649454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:17.649458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:17.649466Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2167 [2:7555896207820874516:2890]
2025-09-30T14:56:17.649482Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:17.649502Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:17.649505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:17.649508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:17.649511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:17.649530Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:17.649542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:17.649550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:17.649621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.649628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.649631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.649634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:17.649637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:17.649715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:17.649723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.649738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.649753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.649775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:17.649799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896207910646454:2782], now have 1 active actors on pipe
2025-09-30T14:56:17.649807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896207910646273:2454], now have 1 active actors on pipe
2025-09-30T14:56:17.649814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896207820874511:2890]
2025-09-30T14:56:17.649817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896207820874511:2890]
2025-09-30T14:56:17.649819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896207820874511:2890]
2025-09-30T14:56:17.649834Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:17.649848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:17.649851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:17.649852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:17.649855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:17.649868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:17.649871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:17.649912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896207820874511:2890]
2025-09-30T14:56:17.649924Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:17.649943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:17.649931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2167
2025-09-30T14:56:17.650178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:17.650190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:17.650218Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8bcff37-e7e50b2a-e55f828f-86a77d34_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:17.650219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2167
2025-09-30T14:56:17.650232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:17.650241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:17.650244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:17.650255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:17.650271Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:17.650295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:17.650487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:17.650500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:17.650523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:17.650635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2168 partition: 0 MaxSeqNo: 42 sessionId: src_id|8bcff37-e7e50b2a-e55f828f-86a77d34_0
2025-09-30T14:56:17.651181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d070df9b-4d0b4e7b-cb5e8ff-ec0f014_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8bcff37-e7e50b2a-e55f828f-86a77d34_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:17.654135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bcff37-e7e50b2a-e55f828f-86a77d34_0] Write session: try to update token
2025-09-30T14:56:17.654157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bcff37-e7e50b2a-e55f828f-86a77d34_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:17.663007Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:17.663031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:17.663034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:17.663036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:17.663046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896207820874511:2890]
2025-09-30T14:56:17.663051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896207820874511:2890]
2025-09-30T14:56:17.663054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896207820874511:2890]
2025-09-30T14:56:17.663096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:17.663104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.663106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:17.663110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:17.663118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:17.663122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:17.663271Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:17.672487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2168 sessionId: src_id|8bcff37-e7e50b2a-e55f828f-86a77d34_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:17.675681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:17.713883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896207910646538:8402]
2025-09-30T14:56:17.714182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2167, pipe: [1:7555896207910646538:8402]
2025-09-30T14:56:17.776687Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:17.777283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:17.777300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:17.777321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896207910646538:8402], now have 1 active actors on pipe
2025-09-30T14:56:17.777538Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:17.777588Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:17.777590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:17.777595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:17.777636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896207910646538:8402]
2025-09-30T14:56:17.777669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2168 reason: error at write: Disconnected sessionId: src_id|8bcff37-e7e50b2a-e55f828f-86a77d34_0
2025-09-30T14:56:17.777865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2168 sessionId: src_id|8bcff37-e7e50b2a-e55f828f-86a77d34_0 is DEAD
2025-09-30T14:56:17.777993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bcff37-e7e50b2a-e55f828f-86a77d34_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:17.778004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bcff37-e7e50b2a-e55f828f-86a77d34_0] Write session will restart in 0.005328s
2025-09-30T14:56:17.778027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bcff37-e7e50b2a-e55f828f-86a77d34_0] Write session: Do CDS request
2025-09-30T14:56:17.778036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bcff37-e7e50b2a-e55f828f-86a77d34_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:17.784921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bcff37-e7e50b2a-e55f828f-86a77d34_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:17.784966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:17.784980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2169
2025-09-30T14:56:17.785187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2169 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:17.785220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2169 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:17.785230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2169 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:17.785234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:17.785596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2169 sessionId:  describe result for acl check
2025-09-30T14:56:17.785623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:17.785625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:17.785626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:17.785630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896207910646554:2786] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:17.786061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896207910646554:2786] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:17.788260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896207910646554:2786] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:17.791929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896207910646554:2786] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:17.791944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896207910646554:2786] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:17.791947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896207910646554:2786] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:17.791955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2169 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:17.797119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:17.799842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:17.800049Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:17.800067Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:17.800078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:17.800136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:17.800175Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896207820874783:2887]
2025-09-30T14:56:17.800777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:17.801099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:17.801135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:17.801395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:17.801468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:17.801474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:17.801474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:17.801475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:17.801476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:17.801477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:17.801477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:17.801478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:17.801479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:17.801480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:17.801480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.801481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.801482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.801483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:17.801484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:17.801487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:17.801495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:17.801497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:17.801500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:17.801502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:17.801504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:17.801507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:17.801509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:17.801512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:17.801515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:17.801517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.801519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.801522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.801524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:17.801526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:17.801533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:17.801538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:17.801542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:17.801546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:17.801549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:17.801552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:17.801554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:17.801558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:17.801560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:17.801563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:17.801566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:17.801569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:17.801571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:17.801575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:17.801577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:17.801580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:17.801583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:17.801586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:17.801589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:17.801592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:17.801596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.801600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.801602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.801605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.801608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.801611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.801613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:17.801616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:17.801619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:17.801622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:17.801646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:17.807138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:17.807994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:17.808010Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:17.808013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:17.808017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:17.808023Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2168 [2:7555896207820874783:2887]
2025-09-30T14:56:17.808039Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:17.808058Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:17.808066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:17.808069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:17.808072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:17.808089Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:17.808095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:17.808102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:17.808162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.808169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.808171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.808175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:17.808178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:17.808246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:17.808253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.808264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.808276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.808292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:17.808329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896207910646684:2786], now have 1 active actors on pipe
2025-09-30T14:56:17.808338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896207910646539:2454], now have 1 active actors on pipe
2025-09-30T14:56:17.808345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896207820874778:2887]
2025-09-30T14:56:17.808347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896207820874778:2887]
2025-09-30T14:56:17.808350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896207820874778:2887]
2025-09-30T14:56:17.808363Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:17.808376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:17.808380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:17.808384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:17.808386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:17.808391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:17.808394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:17.808412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2168
2025-09-30T14:56:17.808417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2168
2025-09-30T14:56:17.808425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896207820874778:2887]
2025-09-30T14:56:17.808437Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:17.808439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:17.808465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:17.808469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:17.808507Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|324d8e8f-c37a746e-f400c9ad-5569e0c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:17.808521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:17.808524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:17.808527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:17.808536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:17.808550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:17.808570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:17.808708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:17.808725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:17.808746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:17.808827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2169 partition: 0 MaxSeqNo: 42 sessionId: src_id|324d8e8f-c37a746e-f400c9ad-5569e0c1_0
2025-09-30T14:56:17.809414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bcff37-e7e50b2a-e55f828f-86a77d34_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|324d8e8f-c37a746e-f400c9ad-5569e0c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:17.812830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|324d8e8f-c37a746e-f400c9ad-5569e0c1_0] Write session: try to update token
2025-09-30T14:56:17.812856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|324d8e8f-c37a746e-f400c9ad-5569e0c1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:17.820271Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:17.820293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:17.820295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:17.820297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:17.820304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896207820874778:2887]
2025-09-30T14:56:17.820308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896207820874778:2887]
2025-09-30T14:56:17.820311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896207820874778:2887]
2025-09-30T14:56:17.820343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:17.820349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.820351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:17.820354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:17.820378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:17.820381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:17.820485Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:17.830550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2169 sessionId: src_id|324d8e8f-c37a746e-f400c9ad-5569e0c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:17.833852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:17.877720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896207910646803:8402]
2025-09-30T14:56:17.878006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2168, pipe: [1:7555896207910646803:8402]
2025-09-30T14:56:17.935760Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:17.936613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:17.936633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:17.936655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896207910646803:8402], now have 1 active actors on pipe
2025-09-30T14:56:17.936874Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:17.936936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896207910646803:8402]
2025-09-30T14:56:17.936959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:17.936967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:17.937033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2169 reason: status is not ok: tablet will be restarted right now sessionId: src_id|324d8e8f-c37a746e-f400c9ad-5569e0c1_0
2025-09-30T14:56:17.937213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2169 sessionId: src_id|324d8e8f-c37a746e-f400c9ad-5569e0c1_0 is DEAD
2025-09-30T14:56:17.937474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|324d8e8f-c37a746e-f400c9ad-5569e0c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:17.937492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|324d8e8f-c37a746e-f400c9ad-5569e0c1_0] Write session will restart in 0.008773s
2025-09-30T14:56:17.937536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|324d8e8f-c37a746e-f400c9ad-5569e0c1_0] Write session: Do CDS request
2025-09-30T14:56:17.937545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|324d8e8f-c37a746e-f400c9ad-5569e0c1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:17.951588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|324d8e8f-c37a746e-f400c9ad-5569e0c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:17.951810Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:17.951842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2170
2025-09-30T14:56:17.952024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2170 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:17.952062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2170 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:17.952072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2170 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:17.952076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:17.952736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2170 sessionId:  describe result for acl check
2025-09-30T14:56:17.952771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:17.952779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:17.952781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:17.952788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896207910646892:2790] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:17.953309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896207910646892:2790] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:17.955552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896207910646892:2790] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:17.958338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896207910646892:2790] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:17.958353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896207910646892:2790] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:17.958359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896207910646892:2790] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:17.958367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2170 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:17.959540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:17.962493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:17.962702Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:17.962714Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:17.962725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:17.962782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:17.962826Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896207820875041:2884]
2025-09-30T14:56:17.963534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:17.963898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:17.963970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:17.964343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:17.964409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:17.964415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:17.964416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:17.964417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:17.964419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:17.964420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:17.964421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:17.964423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:17.964424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:17.964426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:17.964427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.964428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.964429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.964431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:17.964432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:17.964438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:17.964448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:17.964453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:17.964457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:17.964461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:17.964466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:17.964470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:17.964474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:17.964478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:17.964482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:17.964487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.964491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.964495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.964499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:17.964503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:17.964512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:17.964519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:17.964529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:17.964535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:17.964541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:17.964547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:17.964556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:17.964562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:17.964568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:17.964573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:17.964583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:17.964589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:17.964601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:17.964606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:17.964615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:17.964621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:17.964626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:17.964637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:17.964642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:17.964652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:17.964658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.964668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.964672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.964682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.964687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.964697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.964701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:17.964706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:17.964715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:17.964721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:17.964772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:17.970392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:17.971299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:17.971316Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:17.971319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:17.971324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:17.971332Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2169 [2:7555896207820875041:2884]
2025-09-30T14:56:17.971348Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:17.971364Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:17.971372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:17.971375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:17.971377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:17.971391Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:17.971396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:17.971402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:17.971467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.971475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.971478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.971482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:17.971485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:17.971554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:17.971561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.971574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:17.971591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:17.971614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:17.971637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896207910646804:2454], now have 1 active actors on pipe
2025-09-30T14:56:17.971646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896207910647067:2790], now have 1 active actors on pipe
2025-09-30T14:56:17.971652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896207820875036:2884]
2025-09-30T14:56:17.971654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896207820875036:2884]
2025-09-30T14:56:17.971657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896207820875036:2884]
2025-09-30T14:56:17.971670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:17.971684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:17.971688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:17.971696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:17.971699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:17.971706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:17.971710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:17.971746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896207820875036:2884]
2025-09-30T14:56:17.971758Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:17.971765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:17.971899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2169
2025-09-30T14:56:17.971948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2169
2025-09-30T14:56:17.971972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:17.971983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:17.972006Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|386e5777-e3bd3301-765cc9c5-1b1e5a31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:17.972018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:17.972027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:17.972029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:17.972040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:17.972054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:17.972076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:17.972249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:17.972258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:17.972271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:17.972432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2170 partition: 0 MaxSeqNo: 42 sessionId: src_id|386e5777-e3bd3301-765cc9c5-1b1e5a31_0
2025-09-30T14:56:17.972807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|324d8e8f-c37a746e-f400c9ad-5569e0c1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|386e5777-e3bd3301-765cc9c5-1b1e5a31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:17.975946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|386e5777-e3bd3301-765cc9c5-1b1e5a31_0] Write session: try to update token
2025-09-30T14:56:17.975969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|386e5777-e3bd3301-765cc9c5-1b1e5a31_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:17.984140Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:17.984167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:17.984170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:17.984171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:17.984182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896207820875036:2884]
2025-09-30T14:56:17.984188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896207820875036:2884]
2025-09-30T14:56:17.984193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896207820875036:2884]
2025-09-30T14:56:17.984228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:17.984235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:17.984238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:17.984398Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:17.986343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:17.986361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:17.986366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:17.993501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2170 sessionId: src_id|386e5777-e3bd3301-765cc9c5-1b1e5a31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:17.996263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:18.036942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896212205614377:8402]
2025-09-30T14:56:18.037248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2169, pipe: [1:7555896212205614377:8402]
2025-09-30T14:56:18.096198Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:18.096656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:18.096672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:18.096691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896212205614377:8402], now have 1 active actors on pipe
2025-09-30T14:56:18.096862Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:18.096960Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:18.096981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:18.097035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896212205614377:8402]
2025-09-30T14:56:18.097094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2170 reason: status is not ok: tablet will be restarted right now sessionId: src_id|386e5777-e3bd3301-765cc9c5-1b1e5a31_0
2025-09-30T14:56:18.097249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2170 sessionId: src_id|386e5777-e3bd3301-765cc9c5-1b1e5a31_0 is DEAD
2025-09-30T14:56:18.097430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|386e5777-e3bd3301-765cc9c5-1b1e5a31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:18.097443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|386e5777-e3bd3301-765cc9c5-1b1e5a31_0] Write session will restart in 0.007796s
2025-09-30T14:56:18.097468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|386e5777-e3bd3301-765cc9c5-1b1e5a31_0] Write session: Do CDS request
2025-09-30T14:56:18.097474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|386e5777-e3bd3301-765cc9c5-1b1e5a31_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:18.106775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|386e5777-e3bd3301-765cc9c5-1b1e5a31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:18.106872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:18.106892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2171
2025-09-30T14:56:18.107084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2171 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:18.107148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2171 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:18.107161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2171 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:18.107167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:18.107818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2171 sessionId:  describe result for acl check
2025-09-30T14:56:18.107863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:18.107870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:18.107872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:18.107879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896212205614420:2808] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:18.108721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896212205614420:2808] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:18.113359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896212205614420:2808] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:18.117152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896212205614420:2808] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:18.117171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896212205614420:2808] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:18.117176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896212205614420:2808] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:18.117186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2171 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:18.121217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:18.125779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:18.126030Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:18.126042Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:18.126055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:18.126130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:18.126177Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896212115842594:2883]
2025-09-30T14:56:18.126875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:18.127287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:18.127345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:18.127702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:18.127767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:18.127773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:18.127775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:18.127776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:18.127778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:18.127779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:18.127781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:18.127782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:18.127783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:18.127785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:18.127787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.127788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:18.127789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:18.127791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:18.127792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:18.127798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:18.127809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:18.127814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:18.127819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:18.127824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:18.127829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:18.127833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:18.127838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:18.127843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:18.127848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:18.127852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.127856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:18.127860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:18.127864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:18.127868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:18.127876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:18.127884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:18.127891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:18.127902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:18.127911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:18.127921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:18.127933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:18.127943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:18.127954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:18.127965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:18.127974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:18.127984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:18.127993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:18.128000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:18.128005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:18.128017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:18.128023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:18.128028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:18.128033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:18.128040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:18.128044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.128049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.128053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:18.128058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:18.128062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:18.128068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:18.128073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:18.128078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:18.128083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:18.128089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:18.128140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:18.133881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:18.134769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:18.134797Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:18.134801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:18.134805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:18.134813Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2170 [2:7555896212115842594:2883]
2025-09-30T14:56:18.134829Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:18.134846Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:18.134855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:18.134858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:18.134861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:18.134882Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:18.134892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:18.134900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:18.134963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.134972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:18.134975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:18.134979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:18.134982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:18.135050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:18.135058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.135071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:18.135084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:18.135101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:18.135124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896212205614390:2454], now have 1 active actors on pipe
2025-09-30T14:56:18.135133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896212205614590:2808], now have 1 active actors on pipe
2025-09-30T14:56:18.135140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896212115842589:2883]
2025-09-30T14:56:18.135143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896212115842589:2883]
2025-09-30T14:56:18.135145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896212115842589:2883]
2025-09-30T14:56:18.135159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:18.135171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:18.135178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:18.135182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:18.135185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:18.135194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:18.135203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:18.135239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896212115842589:2883]
2025-09-30T14:56:18.135299Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:18.135304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:18.135297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2170
2025-09-30T14:56:18.135397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:18.135408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:18.135435Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb44e051-e32a30b8-c90770a4-49105489_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:18.135446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:18.135437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2170
2025-09-30T14:56:18.135454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:18.135457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:18.135468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:18.135477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:18.135503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:18.135715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:18.135729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:18.135754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:18.135840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2171 partition: 0 MaxSeqNo: 42 sessionId: src_id|bb44e051-e32a30b8-c90770a4-49105489_0
2025-09-30T14:56:18.136218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|386e5777-e3bd3301-765cc9c5-1b1e5a31_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bb44e051-e32a30b8-c90770a4-49105489_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:18.139044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb44e051-e32a30b8-c90770a4-49105489_0] Write session: try to update token
2025-09-30T14:56:18.139061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb44e051-e32a30b8-c90770a4-49105489_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:18.154192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2171 sessionId: src_id|bb44e051-e32a30b8-c90770a4-49105489_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:18.157189Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:18.157206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:18.157218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896212115842589:2883]
2025-09-30T14:56:18.157264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:18.157265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:18.157333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:18.157453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:18.157594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:18.157738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:18.157878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:18.158088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:18.158146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:18.158160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:18.158178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:18.158218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:18.158346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:18.162652Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:18.162668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:18.162671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:18.162673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:18.162681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896212115842589:2883]
2025-09-30T14:56:18.162684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896212115842589:2883]
2025-09-30T14:56:18.162688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896212115842589:2883]
2025-09-30T14:56:18.162717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:18.162722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.162724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:18.162761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:18.162773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:18.162844Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:18.162845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:18.197197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896212205614661:8402]
2025-09-30T14:56:18.197485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2170, pipe: [1:7555896212205614661:8402]
2025-09-30T14:56:18.277243Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:18.285970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:18.285998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:18.286189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:18.286265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:18.286332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:18.286409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:18.286460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:18.286471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:18.286545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:18.286611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:18.286679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:18.286753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:18.287004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:18.287015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:18.287088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:18.287156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:18.287238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:18.287326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:18.287374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:18.287383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:18.287456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:18.287525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:18.287594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:18.287661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:18.287709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:18.287719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:18.287789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:18.287861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:18.287929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:18.287997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:18.288050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:18.288063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:18.288136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:18.288203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:18.288274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:18.288345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:18.288393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:18.288401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:18.288474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:18.288540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:18.288610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:18.288681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:18.288729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:18.288738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:18.288808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:18.288872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:18.288939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:18.289009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:18.289057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:18.289064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:18.289136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:18.289202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:18.289268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:18.289346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:18.289406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:18.289414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:18.289484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:18.289549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:18.289617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:18.289689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:18.289738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:18.289746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:18.289816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896212205614661:8402], now have 1 active actors on pipe
2025-09-30T14:56:18.290082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896212205614661:8402]
2025-09-30T14:56:18.290102Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:18.290124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:18.290126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:18.290154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2171 reason: error at write: Disconnected sessionId: src_id|bb44e051-e32a30b8-c90770a4-49105489_0
2025-09-30T14:56:18.290485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb44e051-e32a30b8-c90770a4-49105489_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 154 BytesWritten: 94617674 MessagesWritten: 42 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 13516812 MessagesInflight: 10 }
2025-09-30T14:56:18.290515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb44e051-e32a30b8-c90770a4-49105489_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:18.290523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb44e051-e32a30b8-c90770a4-49105489_0] Write session will restart in 0.005200s
2025-09-30T14:56:18.290548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb44e051-e32a30b8-c90770a4-49105489_0] Write session: Do CDS request
2025-09-30T14:56:18.290566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb44e051-e32a30b8-c90770a4-49105489_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:18.290341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2171 sessionId: src_id|bb44e051-e32a30b8-c90770a4-49105489_0 is DEAD
2025-09-30T14:56:18.291160Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:18.296806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb44e051-e32a30b8-c90770a4-49105489_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:18.296951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:18.296982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2172
2025-09-30T14:56:18.297114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2172 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:18.297147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2172 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:18.297159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2172 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:18.297163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:18.297598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2172 sessionId:  describe result for acl check
2025-09-30T14:56:18.297634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:18.297635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:18.297651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:18.297660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896212205614679:2819] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:18.298204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896212205614679:2819] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:18.301881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896212205614679:2819] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:18.305893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896212205614679:2819] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:18.305912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896212205614679:2819] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:18.305915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896212205614679:2819] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:18.305924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2172 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:18.312598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:18.316280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:18.316552Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:18.316562Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:18.316571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:18.316618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:18.316657Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896212115842852:2879]
2025-09-30T14:56:18.317144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:18.317450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:18.317482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:18.317725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:18.317783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:18.317788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:18.317789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:18.317790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:18.317791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:18.317792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:18.317792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:18.317793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:18.317794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:18.317795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:18.317796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.317796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:18.317797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:18.317798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:18.317798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:18.317802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:18.317809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:18.317812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:18.317814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:18.317817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:18.317819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:18.317821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:18.317824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:18.317826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:18.317828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:18.317831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.317833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:18.317836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:18.317838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:18.317840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:18.317848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:18.317854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:18.317858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:18.317861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:18.317864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:18.317868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:18.317870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:18.317873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:18.317876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:18.317879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:18.317881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:18.317885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:18.317887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:18.317899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:18.317902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:18.317905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:18.317908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:18.317911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:18.317915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:18.317921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:18.317926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.317932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.317936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:18.317941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:18.317944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:18.317947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:18.317949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:18.317951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:18.317954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:18.317957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:18.317980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:18.323649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:18.324517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:18.324538Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:18.324541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:18.324545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:18.324552Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2171 [2:7555896212115842852:2879]
2025-09-30T14:56:18.324568Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:18.324584Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:18.324587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:18.324590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:18.324593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:18.324610Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:18.324617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:18.324625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:18.324686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.324693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:18.324696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:18.324699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:18.324702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:18.324772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:18.324779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.324791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:18.324809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:18.324829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:18.324851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896212205614666:2454], now have 1 active actors on pipe
2025-09-30T14:56:18.324859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896212205614786:2819], now have 1 active actors on pipe
2025-09-30T14:56:18.324865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896212115842847:2879]
2025-09-30T14:56:18.324869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896212115842847:2879]
2025-09-30T14:56:18.324872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896212115842847:2879]
2025-09-30T14:56:18.324883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:18.324901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:18.324902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:18.324911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:18.324913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:18.324916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:18.324918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:18.324947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896212115842847:2879]
2025-09-30T14:56:18.324958Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:18.324960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:18.324951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2171
2025-09-30T14:56:18.324958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2171
2025-09-30T14:56:18.325001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:18.325016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:18.325039Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4638aa44-7d2fff09-ee2a9212-6bc370bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:18.325046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:18.325050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:18.325052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:18.325064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:18.325073Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:18.325083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:18.325230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:18.325236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:18.325249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:18.325382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2172 partition: 0 MaxSeqNo: 42 sessionId: src_id|4638aa44-7d2fff09-ee2a9212-6bc370bf_0
2025-09-30T14:56:18.325802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb44e051-e32a30b8-c90770a4-49105489_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4638aa44-7d2fff09-ee2a9212-6bc370bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:18.328836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4638aa44-7d2fff09-ee2a9212-6bc370bf_0] Write session: try to update token
2025-09-30T14:56:18.328863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4638aa44-7d2fff09-ee2a9212-6bc370bf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:18.339108Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:18.339127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:18.339140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896212115842847:2879]
2025-09-30T14:56:18.339184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:18.339237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:18.339402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:18.339564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:18.339725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:18.339880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:18.340098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:18.340148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:18.345789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2172 sessionId: src_id|4638aa44-7d2fff09-ee2a9212-6bc370bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:18.349411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:18.350577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:18.350598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:18.350619Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:18.350621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:18.350624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:18.350627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:18.350636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896212115842847:2879]
2025-09-30T14:56:18.350640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896212115842847:2879]
2025-09-30T14:56:18.350645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896212115842847:2879]
2025-09-30T14:56:18.350693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:18.350697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:18.350703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:18.350708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:18.350712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.350715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:18.350859Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:18.390236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896212205614933:8402]
2025-09-30T14:56:18.390484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2171, pipe: [1:7555896212205614933:8402]
2025-09-30T14:56:18.461929Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:18.462564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:18.462597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896212205614933:8402], now have 1 active actors on pipe
2025-09-30T14:56:18.463322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4638aa44-7d2fff09-ee2a9212-6bc370bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:18.463336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4638aa44-7d2fff09-ee2a9212-6bc370bf_0] Write session will restart in 0.009076s
2025-09-30T14:56:18.462735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:18.462841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:18.462845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:18.462914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896212205614933:8402]
2025-09-30T14:56:18.463359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4638aa44-7d2fff09-ee2a9212-6bc370bf_0] Write session: Do CDS request
2025-09-30T14:56:18.463390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4638aa44-7d2fff09-ee2a9212-6bc370bf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:18.462933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2172 reason: error at write: Disconnected sessionId: src_id|4638aa44-7d2fff09-ee2a9212-6bc370bf_0
2025-09-30T14:56:18.462934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:18.463103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2172 sessionId: src_id|4638aa44-7d2fff09-ee2a9212-6bc370bf_0 is DEAD
2025-09-30T14:56:18.473856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4638aa44-7d2fff09-ee2a9212-6bc370bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:18.473878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:18.473895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2173
2025-09-30T14:56:18.474132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2173 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:18.474182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2173 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:18.474193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2173 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:18.474198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:18.474795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2173 sessionId:  describe result for acl check
2025-09-30T14:56:18.474828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:18.474830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:18.474832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:18.474839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896212205614975:2837] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:18.475398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896212205614975:2837] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:18.480198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896212205614975:2837] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:18.485312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896212205614975:2837] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:18.485331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896212205614975:2837] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:18.485335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896212205614975:2837] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:18.485345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2173 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:18.491980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:18.494428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:18.494659Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:18.494669Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:18.494680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:18.494736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:18.494781Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896212115843113:2874]
2025-09-30T14:56:18.495475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:18.495832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:18.495880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:18.496244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:18.496313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:18.496319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:18.496321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:18.496322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:18.496323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:18.496325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:18.496326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:18.496328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:18.496330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:18.496331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:18.496332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.496333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:18.496335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:18.496336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:18.496338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:18.496344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:18.496355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:18.496360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:18.496365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:18.496370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:18.496375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:18.496379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:18.496384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:18.496388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:18.496393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:18.496398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.496402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:18.496406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:18.496411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:18.496415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:18.496424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:18.496433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:18.496438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:18.496445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:18.496449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:18.496455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:18.496460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:18.496466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:18.496471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:18.496477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:18.496483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:18.496488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:18.496494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:18.496500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:18.496504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:18.496510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:18.496521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:18.496527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:18.496533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:18.496539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:18.496544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.496555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.496559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:18.496570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:18.496576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:18.496583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:18.496588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:18.496598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:18.496604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:18.496613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:18.496662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:18.502475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:18.503420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:18.503434Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:18.503437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:18.503441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:18.503448Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2172 [2:7555896212115843113:2874]
2025-09-30T14:56:18.503465Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:18.503481Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:18.503489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:18.503492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:18.503495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:18.503510Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:18.503516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:18.503523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:18.503583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.503593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:18.503594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:18.503598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:18.503600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:18.503675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:18.503685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.503696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:18.503706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:18.503721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:18.503743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896212205614934:2454], now have 1 active actors on pipe
2025-09-30T14:56:18.503751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896212205615163:2837], now have 1 active actors on pipe
2025-09-30T14:56:18.503758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896212115843108:2874]
2025-09-30T14:56:18.503761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896212115843108:2874]
2025-09-30T14:56:18.503763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896212115843108:2874]
2025-09-30T14:56:18.503775Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:18.503791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:18.503793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:18.503797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:18.503799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:18.503808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:18.503811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:18.503842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896212115843108:2874]
2025-09-30T14:56:18.503853Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:18.503864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2172
2025-09-30T14:56:18.503877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2172
2025-09-30T14:56:18.503969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:18.504053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:18.504064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:18.504092Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d77843f-d83ec824-6cc53d48-5b3543f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:18.504105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:18.504114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:18.504116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:18.504129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:18.504147Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:18.504167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:18.504459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:18.504468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:18.504485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:18.504623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2173 partition: 0 MaxSeqNo: 42 sessionId: src_id|4d77843f-d83ec824-6cc53d48-5b3543f1_0
2025-09-30T14:56:18.504989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4638aa44-7d2fff09-ee2a9212-6bc370bf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4d77843f-d83ec824-6cc53d48-5b3543f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:18.507841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d77843f-d83ec824-6cc53d48-5b3543f1_0] Write session: try to update token
2025-09-30T14:56:18.507860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d77843f-d83ec824-6cc53d48-5b3543f1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:18.518135Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:18.518158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:18.518168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896212115843108:2874]
2025-09-30T14:56:18.518213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:18.518212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:18.518400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:18.518617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:18.518855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:18.519054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:18.519280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:18.519326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:18.537288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2173 sessionId: src_id|4d77843f-d83ec824-6cc53d48-5b3543f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:18.540153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:18.540402Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:18.540420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:18.540423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:18.540425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:18.540434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896212115843108:2874]
2025-09-30T14:56:18.540439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896212115843108:2874]
2025-09-30T14:56:18.540443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896212115843108:2874]
2025-09-30T14:56:18.540494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:18.540496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:18.540502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:18.540503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:18.540508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:18.540520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:18.540527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.540530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:18.540676Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:18.563268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896212205615216:8402]
2025-09-30T14:56:18.563728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2172, pipe: [1:7555896212205615216:8402]
2025-09-30T14:56:18.654858Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:18.655742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896212205615216:8402], now have 1 active actors on pipe
2025-09-30T14:56:18.656053Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:18.656475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d77843f-d83ec824-6cc53d48-5b3543f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:18.656487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d77843f-d83ec824-6cc53d48-5b3543f1_0] Write session will restart in 0.006457s
2025-09-30T14:56:18.656509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d77843f-d83ec824-6cc53d48-5b3543f1_0] Write session: Do CDS request
2025-09-30T14:56:18.656514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d77843f-d83ec824-6cc53d48-5b3543f1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:18.656017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896212205615216:8402]
2025-09-30T14:56:18.656030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:18.656053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:18.656056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:18.656128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2173 reason: error at write: Disconnected sessionId: src_id|4d77843f-d83ec824-6cc53d48-5b3543f1_0
2025-09-30T14:56:18.656309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2173 sessionId: src_id|4d77843f-d83ec824-6cc53d48-5b3543f1_0 is DEAD
2025-09-30T14:56:18.663777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d77843f-d83ec824-6cc53d48-5b3543f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:18.663878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:18.663894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2174
2025-09-30T14:56:18.664005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2174 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:18.664032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2174 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:18.664037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2174 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:18.664041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:18.664505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2174 sessionId:  describe result for acl check
2025-09-30T14:56:18.664542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:18.664550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:18.664552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:18.664558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896212205615247:2863] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:18.665109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896212205615247:2863] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:18.667352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896212205615247:2863] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:18.671665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896212205615247:2863] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:18.671686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896212205615247:2863] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:18.671689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896212205615247:2863] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:18.671698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2174 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:18.677304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:18.680057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:18.680262Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:18.680270Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:18.680289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:18.680337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:18.680378Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896212115843409:2857]
2025-09-30T14:56:18.681022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:18.681386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:18.681451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:18.681814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:18.681874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:18.681880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:18.681882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:18.681883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:18.681885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:18.681886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:18.681887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:18.681888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:18.681889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:18.681891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:18.681892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.681894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:18.681895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:18.681896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:18.681897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:18.681904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:18.681915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:18.681919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:18.681924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:18.681928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:18.681932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:18.681936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:18.681940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:18.681943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:18.681948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:18.681951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.681955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:18.681959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:18.681963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:18.681967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:18.681976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:18.681985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:18.681991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:18.681996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:18.682001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:18.682006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:18.682011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:18.682016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:18.682021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:18.682027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:18.682031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:18.682037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:18.682042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:18.682048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:18.682052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:18.682057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:18.682064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:18.682069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:18.682078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:18.682084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:18.682089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.682094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.682102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:18.682107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:18.682112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:18.682117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:18.682122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:18.682127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:18.682131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:18.682136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:18.682182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:18.687692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:18.688681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:18.688701Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:18.688704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:18.688708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:18.688715Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2173 [2:7555896212115843409:2857]
2025-09-30T14:56:18.688731Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:18.688746Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:18.688749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:18.688752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:18.688755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:18.688771Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:18.688785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:18.688792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:18.688853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.688861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:18.688864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:18.688868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:18.688871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:18.688941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:18.688949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.688964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:18.688983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:18.689000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:18.689022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896212205615377:2863], now have 1 active actors on pipe
2025-09-30T14:56:18.689035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896212205615230:2454], now have 1 active actors on pipe
2025-09-30T14:56:18.689042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896212115843404:2857]
2025-09-30T14:56:18.689044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896212115843404:2857]
2025-09-30T14:56:18.689046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896212115843404:2857]
2025-09-30T14:56:18.689061Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:18.689075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:18.689085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:18.689091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:18.689094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:18.689067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2173
2025-09-30T14:56:18.689117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:18.689124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:18.689136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896212115843404:2857]
2025-09-30T14:56:18.689146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:18.689149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:18.689252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2173
2025-09-30T14:56:18.689307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:18.689323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:18.689359Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|abb5286c-74484077-a6febebf-4478c9a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:18.689384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:18.689388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:18.689390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:18.689409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:18.689426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:18.689442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:18.689605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:18.689622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:18.689636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:18.689719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2174 partition: 0 MaxSeqNo: 42 sessionId: src_id|abb5286c-74484077-a6febebf-4478c9a9_0
2025-09-30T14:56:18.690069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d77843f-d83ec824-6cc53d48-5b3543f1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|abb5286c-74484077-a6febebf-4478c9a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:18.692818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abb5286c-74484077-a6febebf-4478c9a9_0] Write session: try to update token
2025-09-30T14:56:18.692836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abb5286c-74484077-a6febebf-4478c9a9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:18.701574Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:18.701590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:18.701593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:18.701595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:18.701606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896212115843404:2857]
2025-09-30T14:56:18.701610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896212115843404:2857]
2025-09-30T14:56:18.701615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896212115843404:2857]
2025-09-30T14:56:18.701657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:18.701664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.701667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:18.701675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:18.701694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:18.701704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:18.701812Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:18.708549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2174 sessionId: src_id|abb5286c-74484077-a6febebf-4478c9a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:18.711562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:18.756271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896212205615497:8402]
2025-09-30T14:56:18.756564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2173, pipe: [1:7555896212205615497:8402]
2025-09-30T14:56:18.819349Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:18.819665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:18.819683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:18.819724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896212205615497:8402], now have 1 active actors on pipe
2025-09-30T14:56:18.819988Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:18.819976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:18.820026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896212205615497:8402]
2025-09-30T14:56:18.820033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:18.820036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:18.820109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2174 reason: error at write: Disconnected sessionId: src_id|abb5286c-74484077-a6febebf-4478c9a9_0
2025-09-30T14:56:18.820334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2174 sessionId: src_id|abb5286c-74484077-a6febebf-4478c9a9_0 is DEAD
2025-09-30T14:56:18.820467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abb5286c-74484077-a6febebf-4478c9a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:18.820477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abb5286c-74484077-a6febebf-4478c9a9_0] Write session will restart in 0.005766s
2025-09-30T14:56:18.820501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abb5286c-74484077-a6febebf-4478c9a9_0] Write session: Do CDS request
2025-09-30T14:56:18.820509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abb5286c-74484077-a6febebf-4478c9a9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:18.827782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abb5286c-74484077-a6febebf-4478c9a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:18.827911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:18.827927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2175
2025-09-30T14:56:18.828085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2175 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:18.828143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2175 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:18.828155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2175 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:18.828160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:18.828645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2175 sessionId:  describe result for acl check
2025-09-30T14:56:18.828679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:18.828681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:18.828683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:18.828688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896212205615515:2870] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:18.829217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896212205615515:2870] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:18.831639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896212205615515:2870] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:18.837020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896212205615515:2870] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:18.837037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896212205615515:2870] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:18.837041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896212205615515:2870] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:18.837049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2175 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:18.845428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:18.848305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:18.848551Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:18.848560Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:18.848571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:18.848625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:18.848670Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896212115843682:2848]
2025-09-30T14:56:18.849316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:18.849747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:18.849810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:18.850169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:18.850266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:18.850277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:18.850278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:18.850279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:18.850282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:18.850283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:18.850284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:18.850286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:18.850287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:18.850288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:18.850289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.850290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:18.850291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:18.850293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:18.850294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:18.850301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:18.850323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:18.850327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:18.850331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:18.850335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:18.850339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:18.850343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:18.850347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:18.850351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:18.850355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:18.850359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.850362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:18.850366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:18.850370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:18.850373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:18.850383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:18.850392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:18.850398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:18.850403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:18.850409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:18.850415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:18.850425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:18.850430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:18.850436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:18.850440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:18.850445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:18.850455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:18.850461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:18.850466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:18.850470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:18.850474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:18.850479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:18.850489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:18.850498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:18.850502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:18.850513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.850522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.850527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:18.850536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:18.850545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:18.850551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:18.850558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:18.850563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:18.850572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:18.850582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:18.850630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:18.856543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:18.857693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:18.857711Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:18.857715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:18.857719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:18.857726Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2174 [2:7555896212115843682:2848]
2025-09-30T14:56:18.857743Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:18.857761Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:18.857764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:18.857768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:18.857771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:18.857788Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:18.857795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:18.857803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:18.857871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.857879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:18.857881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:18.857886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:18.857889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:18.857964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:18.857973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.857987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:18.858000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:18.858014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:18.858040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896212205615630:2870], now have 1 active actors on pipe
2025-09-30T14:56:18.858048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896212205615500:2454], now have 1 active actors on pipe
2025-09-30T14:56:18.858055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896212115843677:2848]
2025-09-30T14:56:18.858057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896212115843677:2848]
2025-09-30T14:56:18.858059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896212115843677:2848]
2025-09-30T14:56:18.858073Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:18.858087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:18.858086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:18.858090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:18.858093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:18.858107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:18.858110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:18.858148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896212115843677:2848]
2025-09-30T14:56:18.858160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:18.858167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:18.858146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2174
2025-09-30T14:56:18.858154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2174
2025-09-30T14:56:18.858215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:18.858225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:18.858254Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78be8581-1eff095f-6db7564e-10a14274_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:18.858265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:18.858269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:18.858273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:18.858285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:18.858299Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:18.858319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:18.858473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:18.858482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:18.858497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:18.858586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2175 partition: 0 MaxSeqNo: 42 sessionId: src_id|78be8581-1eff095f-6db7564e-10a14274_0
2025-09-30T14:56:18.858933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abb5286c-74484077-a6febebf-4478c9a9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|78be8581-1eff095f-6db7564e-10a14274_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:18.861736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78be8581-1eff095f-6db7564e-10a14274_0] Write session: try to update token
2025-09-30T14:56:18.861754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78be8581-1eff095f-6db7564e-10a14274_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:18.870727Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:18.870747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:18.870758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896212115843677:2848]
2025-09-30T14:56:18.870805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:18.870814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:18.870998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:18.871183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:18.871359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:18.871520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:18.871746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:18.871792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:18.878235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2175 sessionId: src_id|78be8581-1eff095f-6db7564e-10a14274_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:18.881001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:18.881923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:18.881948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:18.881968Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:18.881971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:18.881974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:18.881976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:18.881984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896212115843677:2848]
2025-09-30T14:56:18.881989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896212115843677:2848]
2025-09-30T14:56:18.881993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896212115843677:2848]
2025-09-30T14:56:18.882041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:18.882045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:18.882047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:18.882050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:18.882052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:18.882055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:18.882208Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:18.920141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896212205615769:8402]
2025-09-30T14:56:18.920469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2174, pipe: [1:7555896212205615769:8402]
2025-09-30T14:56:18.996698Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:18.997358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:18.997419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896212205615769:8402], now have 1 active actors on pipe
2025-09-30T14:56:18.997510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:18.997602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:18.997615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:18.997618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:18.997668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896212205615769:8402]
2025-09-30T14:56:18.997702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2175 reason: error at write: Disconnected sessionId: src_id|78be8581-1eff095f-6db7564e-10a14274_0
2025-09-30T14:56:18.997857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2175 sessionId: src_id|78be8581-1eff095f-6db7564e-10a14274_0 is DEAD
2025-09-30T14:56:18.998033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78be8581-1eff095f-6db7564e-10a14274_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:18.998045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78be8581-1eff095f-6db7564e-10a14274_0] Write session will restart in 0.007368s
2025-09-30T14:56:18.998067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78be8581-1eff095f-6db7564e-10a14274_0] Write session: Do CDS request
2025-09-30T14:56:18.998073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78be8581-1eff095f-6db7564e-10a14274_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:19.006830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78be8581-1eff095f-6db7564e-10a14274_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:19.006954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:19.006974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2176
2025-09-30T14:56:19.007135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2176 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:19.007172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2176 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:19.007177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2176 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:19.007187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:19.007708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2176 sessionId:  describe result for acl check
2025-09-30T14:56:19.007746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:19.007748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:19.007751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:19.007757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896216500583102:2869] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:19.008365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896216500583102:2869] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:19.011072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896216500583102:2869] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:19.014544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896216500583102:2869] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:19.014559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896216500583102:2869] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:19.014563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896216500583102:2869] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:19.014572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2176 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:19.024174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:19.026971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:19.027221Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:19.027230Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:19.027263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:19.027331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:19.027364Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896216410811242:2844]
2025-09-30T14:56:19.027848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:19.028268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:19.028347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:19.028726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:19.028799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:19.028805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:19.028807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:19.028808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:19.028810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:19.028811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:19.028813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:19.028815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:19.028816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:19.028817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:19.028818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.028820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.028821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.028822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:19.028823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:19.028829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:19.028840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:19.028844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:19.028849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:19.028852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:19.028857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:19.028861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:19.028864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:19.028869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:19.028873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:19.028877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.028881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.028886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.028890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:19.028894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:19.028902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:19.028910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:19.028916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:19.028922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:19.028927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:19.028933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:19.028937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:19.028942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:19.028948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:19.028953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:19.028957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:19.028963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:19.028968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:19.028973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:19.028978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:19.028990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:19.028994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:19.029000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:19.029010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:19.029015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:19.029021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.029031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.029035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.029040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.029045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.029050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.029055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:19.029060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:19.029065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:19.029070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:19.029113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:19.034889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:19.035821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:19.035839Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:19.035842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:19.035847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:19.035854Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2175 [2:7555896216410811242:2844]
2025-09-30T14:56:19.035872Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:19.035895Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:19.035903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:19.035906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:19.035909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:19.035925Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:19.035932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:19.035939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:19.036000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.036007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.036010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.036013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:19.036016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:19.036088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:19.036096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.036109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.036123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.036143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:19.036165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896216500583267:2869], now have 1 active actors on pipe
2025-09-30T14:56:19.036174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896212205615786:2454], now have 1 active actors on pipe
2025-09-30T14:56:19.036180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896216410811237:2844]
2025-09-30T14:56:19.036183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896216410811237:2844]
2025-09-30T14:56:19.036186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896216410811237:2844]
2025-09-30T14:56:19.036200Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:19.036213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:19.036217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:19.036221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:19.036224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:19.036232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:19.036235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:19.036271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896216410811237:2844]
2025-09-30T14:56:19.036290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:19.036311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:19.036297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2175
2025-09-30T14:56:19.036325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2175
2025-09-30T14:56:19.036382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:19.036393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:19.036423Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7cee00ff-1ee1cbd4-72422e6b-9204c94c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:19.036434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:19.036442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:19.036445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:19.036454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:19.036464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:19.036479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:19.036630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:19.036638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:19.036653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:19.036761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2176 partition: 0 MaxSeqNo: 42 sessionId: src_id|7cee00ff-1ee1cbd4-72422e6b-9204c94c_0
2025-09-30T14:56:19.037166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78be8581-1eff095f-6db7564e-10a14274_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7cee00ff-1ee1cbd4-72422e6b-9204c94c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:19.040003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cee00ff-1ee1cbd4-72422e6b-9204c94c_0] Write session: try to update token
2025-09-30T14:56:19.040025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cee00ff-1ee1cbd4-72422e6b-9204c94c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:19.048983Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:19.049002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:19.049012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896216410811237:2844]
2025-09-30T14:56:19.049057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:19.049061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:19.049227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:19.049387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:19.049529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:19.049676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:19.049873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:19.049916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:19.055283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2176 sessionId: src_id|7cee00ff-1ee1cbd4-72422e6b-9204c94c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:19.058038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:19.058577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:19.058597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:19.058634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:19.058719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:19.060060Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:19.060074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:19.060077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:19.060079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:19.060089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896216410811237:2844]
2025-09-30T14:56:19.060093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896216410811237:2844]
2025-09-30T14:56:19.060097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896216410811237:2844]
2025-09-30T14:56:19.060136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:19.060137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:19.060143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:19.060147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:19.060148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.060152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:19.060297Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:19.097820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896216500583349:8402]
2025-09-30T14:56:19.098094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2175, pipe: [1:7555896216500583349:8402]
2025-09-30T14:56:19.182490Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:19.194392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:19.194416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:19.194602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:19.194670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:19.194737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:19.194806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:19.194854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:19.194863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:19.194931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:19.194998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:19.195063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:19.195132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:19.195281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:19.195289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:19.195358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:19.195420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:19.195485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:19.195727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:19.196240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:19.196250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:19.196490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:19.196562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:19.196631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:19.196881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:19.196927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:19.196938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:19.197178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:19.197244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:19.197313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:19.197588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:19.197648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:19.197659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:19.197733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:19.197999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:19.198064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:19.198128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:19.198168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:19.198171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:19.198241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:19.198299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:19.198558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:19.198813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:19.198861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:19.198863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:19.198936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:19.199001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:19.199062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:19.199124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:19.199169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:19.199172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:19.199538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:19.199797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:19.199872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:19.200679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:19.200700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:19.200733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2176 reason: error at write: Disconnected sessionId: src_id|7cee00ff-1ee1cbd4-72422e6b-9204c94c_0
2025-09-30T14:56:19.200933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2176 sessionId: src_id|7cee00ff-1ee1cbd4-72422e6b-9204c94c_0 is DEAD
2025-09-30T14:56:19.201112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cee00ff-1ee1cbd4-72422e6b-9204c94c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:19.201123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cee00ff-1ee1cbd4-72422e6b-9204c94c_0] Write session will restart in 0.008867s
2025-09-30T14:56:19.201150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cee00ff-1ee1cbd4-72422e6b-9204c94c_0] Write session: Do CDS request
2025-09-30T14:56:19.201155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cee00ff-1ee1cbd4-72422e6b-9204c94c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:19.201080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:19.201138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896216500583349:8402]
2025-09-30T14:56:19.199943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:19.199997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:19.200001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:19.200073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:19.200133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:19.200198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:19.200260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:19.200305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:19.200308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:19.200389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896216500583349:8402], now have 1 active actors on pipe
2025-09-30T14:56:19.201165Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:19.210912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cee00ff-1ee1cbd4-72422e6b-9204c94c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:19.210918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:19.210939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2177
2025-09-30T14:56:19.211129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2177 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:19.211166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2177 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:19.211174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2177 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:19.211178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:19.211793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2177 sessionId:  describe result for acl check
2025-09-30T14:56:19.211830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:19.211837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:19.211839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:19.211844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896216500583387:2889] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:19.212484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896216500583387:2889] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:19.216209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896216500583387:2889] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:19.219926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896216500583387:2889] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:19.219948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896216500583387:2889] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:19.219951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896216500583387:2889] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:19.219960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2177 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:19.222225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:19.225331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:19.225527Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:19.225536Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:19.225544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:19.225601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:19.225649Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896216410811506:2842]
2025-09-30T14:56:19.226212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:19.226526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:19.226570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:19.226899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:19.226961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:19.226966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:19.226967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:19.226968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:19.226969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:19.226970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:19.226971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:19.226971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:19.226972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:19.226974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:19.226975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.226975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.226976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.226978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:19.226979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:19.226984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:19.226995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:19.226999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:19.227004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:19.227008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:19.227013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:19.227018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:19.227022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:19.227026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:19.227030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:19.227034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.227038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.227043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.227047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:19.227051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:19.227059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:19.227067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:19.227075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:19.227081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:19.227086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:19.227092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:19.227096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:19.227101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:19.227107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:19.227113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:19.227120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:19.227125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:19.227130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:19.227138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:19.227143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:19.227148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:19.227154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:19.227170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:19.227179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:19.227185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:19.227190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.227198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.227202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.227208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.227213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.227221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.227227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:19.227232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:19.227239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:19.227260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:19.227321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:19.233855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:19.234833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:19.234851Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:19.234854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:19.234859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:19.234867Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2176 [2:7555896216410811506:2842]
2025-09-30T14:56:19.234884Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:19.234901Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:19.234909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:19.234912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:19.234915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:19.234932Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:19.234944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:19.234951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:19.235016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.235024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.235026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.235030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:19.235032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:19.235100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:19.235108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.235121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.235135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.235152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:19.235174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896216500583599:2889], now have 1 active actors on pipe
2025-09-30T14:56:19.235184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896216500583357:2454], now have 1 active actors on pipe
2025-09-30T14:56:19.235190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896216410811501:2842]
2025-09-30T14:56:19.235192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896216410811501:2842]
2025-09-30T14:56:19.235195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896216410811501:2842]
2025-09-30T14:56:19.235212Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:19.235229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:19.235233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:19.235234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:19.235236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:19.235287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:19.235292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:19.235286Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2176
2025-09-30T14:56:19.235287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2176
2025-09-30T14:56:19.235331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896216410811501:2842]
2025-09-30T14:56:19.235339Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:19.235349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:19.235381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:19.235392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:19.235426Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|621681f5-b6497d3-1b94b40c-99909b28_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:19.235441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:19.235445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:19.235448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:19.235458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:19.235469Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:19.235482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:19.235642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:19.235651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:19.235667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:19.235769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2177 partition: 0 MaxSeqNo: 42 sessionId: src_id|621681f5-b6497d3-1b94b40c-99909b28_0
2025-09-30T14:56:19.236217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cee00ff-1ee1cbd4-72422e6b-9204c94c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|621681f5-b6497d3-1b94b40c-99909b28_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:19.239125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|621681f5-b6497d3-1b94b40c-99909b28_0] Write session: try to update token
2025-09-30T14:56:19.239143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|621681f5-b6497d3-1b94b40c-99909b28_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:19.250782Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:19.250810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:19.250814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:19.250816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:19.250828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896216410811501:2842]
2025-09-30T14:56:19.250835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896216410811501:2842]
2025-09-30T14:56:19.250840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896216410811501:2842]
2025-09-30T14:56:19.250889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:19.250897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.250900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:19.250906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:19.250914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:19.250918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:19.251096Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:19.259067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2177 sessionId: src_id|621681f5-b6497d3-1b94b40c-99909b28_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:19.261991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:19.301589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896216500583631:8402]
2025-09-30T14:56:19.301854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2176, pipe: [1:7555896216500583631:8402]
2025-09-30T14:56:19.365849Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:19.366761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:19.366780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:19.366822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896216500583631:8402], now have 1 active actors on pipe
2025-09-30T14:56:19.367093Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:19.367082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:19.367101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:19.367107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896216500583631:8402]
2025-09-30T14:56:19.367128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:19.367176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2177 reason: error at write: Disconnected sessionId: src_id|621681f5-b6497d3-1b94b40c-99909b28_0
2025-09-30T14:56:19.367426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2177 sessionId: src_id|621681f5-b6497d3-1b94b40c-99909b28_0 is DEAD
2025-09-30T14:56:19.367562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|621681f5-b6497d3-1b94b40c-99909b28_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:19.367586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|621681f5-b6497d3-1b94b40c-99909b28_0] Write session will restart in 0.009320s
2025-09-30T14:56:19.367612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|621681f5-b6497d3-1b94b40c-99909b28_0] Write session: Do CDS request
2025-09-30T14:56:19.367622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|621681f5-b6497d3-1b94b40c-99909b28_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:19.383214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|621681f5-b6497d3-1b94b40c-99909b28_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:19.383313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:19.383331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2178
2025-09-30T14:56:19.383459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2178 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:19.383494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2178 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:19.383503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2178 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:19.383508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:19.384129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2178 sessionId:  describe result for acl check
2025-09-30T14:56:19.384165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:19.384174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:19.384176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:19.384182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896216500583725:2888] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:19.384750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896216500583725:2888] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:19.390339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896216500583725:2888] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:19.392082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:19.392117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896216500583725:2888] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:19.392136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896216500583725:2888] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:19.392139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896216500583725:2888] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:19.392148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2178 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:19.395722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:19.395971Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:19.395986Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:19.395998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:19.396066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:19.396128Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896216410811770:2828]
2025-09-30T14:56:19.396803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:19.397256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:19.397320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:19.397742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:19.397817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:19.397823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:19.397825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:19.397826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:19.397827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:19.397829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:19.397831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:19.397832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:19.397834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:19.397835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:19.397837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.397839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.397840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.397842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:19.397843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:19.397850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:19.397861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:19.397866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:19.397871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:19.397876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:19.397881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:19.397886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:19.397890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:19.397894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:19.397899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:19.397903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.397907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.397912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.397917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:19.397922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:19.397929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:19.397938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:19.397949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:19.397956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:19.397962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:19.397968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:19.397973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:19.397979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:19.397987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:19.397992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:19.397997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:19.398007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:19.398013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:19.398024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:19.398029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:19.398035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:19.398041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:19.398048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:19.398054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:19.398059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:19.398064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.398076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.398081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.398087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.398097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.398103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.398112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:19.398117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:19.398123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:19.398129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:19.398177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:19.405259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:19.406141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:19.406158Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:19.406162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:19.406166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:19.406175Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2177 [2:7555896216410811770:2828]
2025-09-30T14:56:19.406193Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:19.406210Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:19.406214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:19.406217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:19.406220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:19.406236Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:19.406244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:19.406251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:19.406319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.406333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.406336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.406340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:19.406343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:19.406413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:19.406417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.406434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.406453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.406469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:19.406489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896216500583894:2888], now have 1 active actors on pipe
2025-09-30T14:56:19.406500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896216410811764:2828]
2025-09-30T14:56:19.406503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896216410811764:2828]
2025-09-30T14:56:19.406506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896216410811764:2828]
2025-09-30T14:56:19.406520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:19.406536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896216500583633:2454], now have 1 active actors on pipe
2025-09-30T14:56:19.406545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:19.406549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:19.406549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:19.406552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:19.406564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:19.406569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:19.406608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896216410811764:2828]
2025-09-30T14:56:19.406621Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:19.406611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2177
2025-09-30T14:56:19.406646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2177
2025-09-30T14:56:19.406646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:19.406784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:19.406793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:19.406822Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a41f966-3b08538a-3ca28565-7a00419d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:19.406833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:19.406838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:19.406840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:19.406851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:19.406865Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:19.406883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:19.407212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:19.407220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:19.407237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:19.407411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2178 partition: 0 MaxSeqNo: 42 sessionId: src_id|a41f966-3b08538a-3ca28565-7a00419d_0
2025-09-30T14:56:19.407773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|621681f5-b6497d3-1b94b40c-99909b28_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a41f966-3b08538a-3ca28565-7a00419d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:19.410559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a41f966-3b08538a-3ca28565-7a00419d_0] Write session: try to update token
2025-09-30T14:56:19.410581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a41f966-3b08538a-3ca28565-7a00419d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:19.421662Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:19.421681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:19.421691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896216410811764:2828]
2025-09-30T14:56:19.421736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:19.421739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:19.421914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:19.422059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:19.422218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:19.422360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:19.422412Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] Counters: { Errors: 21 CurrentSessionLifetimeMs: 361466 BytesRead: 38297624 MessagesRead: 17 BytesReadCompressed: 38297624 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 2252802 BytesInflightTotal: 4505604 MessagesInflight: 2 }
2025-09-30T14:56:19.422686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:19.422728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:19.426116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2178 sessionId: src_id|a41f966-3b08538a-3ca28565-7a00419d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:19.428831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:19.429053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:19.429073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:19.429105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:19.429199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:19.434828Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:19.434842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:19.434844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:19.434847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:19.434857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896216410811764:2828]
2025-09-30T14:56:19.434861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896216410811764:2828]
2025-09-30T14:56:19.434865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896216410811764:2828]
2025-09-30T14:56:19.434901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:19.434908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.434911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:19.434912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:19.434919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:19.434924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:19.435075Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:19.471316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896216500583906:8402]
2025-09-30T14:56:19.471753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2177, pipe: [1:7555896216500583906:8402]
2025-09-30T14:56:19.548375Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:19.556759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:19.556787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:19.556966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:19.557033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:19.557101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:19.557167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:19.557213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:19.557222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:19.557300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:19.557381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:19.557449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:19.557528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:19.557574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:19.557583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:19.557652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:19.557722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:19.557788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:19.557857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:19.557903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:19.557910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:19.557988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:19.558053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:19.558121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:19.558189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:19.558235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:19.558241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:19.558311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:19.558374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:19.558442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:19.558507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:19.558572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:19.558580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:19.558688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:19.558772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:19.558838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:19.558907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:19.558955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:19.558962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:19.559033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:19.559106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:19.559185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:19.559274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:19.559320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:19.559330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:19.559399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:19.559462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:19.559530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:19.559600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:19.559649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:19.559659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:19.559730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:19.559795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:19.559861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:19.559928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:19.559973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:19.559986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:19.560053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:19.560119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:19.560187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:19.560263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:19.560313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:19.560321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:19.560394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896216500583906:8402], now have 1 active actors on pipe
2025-09-30T14:56:19.560669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:19.560683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:19.560687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896216500583906:8402]
2025-09-30T14:56:19.560712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2178 reason: error at write: Disconnected sessionId: src_id|a41f966-3b08538a-3ca28565-7a00419d_0
2025-09-30T14:56:19.560720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:19.561081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a41f966-3b08538a-3ca28565-7a00419d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:19.561093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a41f966-3b08538a-3ca28565-7a00419d_0] Write session will restart in 0.009252s
2025-09-30T14:56:19.561117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a41f966-3b08538a-3ca28565-7a00419d_0] Write session: Do CDS request
2025-09-30T14:56:19.561122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a41f966-3b08538a-3ca28565-7a00419d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:19.560896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2178 sessionId: src_id|a41f966-3b08538a-3ca28565-7a00419d_0 is DEAD
2025-09-30T14:56:19.561674Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:19.571806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a41f966-3b08538a-3ca28565-7a00419d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:19.571949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:19.571981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2179
2025-09-30T14:56:19.572126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2179 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:19.572164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2179 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:19.572171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2179 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:19.572175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:19.572749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2179 sessionId:  describe result for acl check
2025-09-30T14:56:19.572796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:19.572803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:19.572805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:19.572812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896216500583960:2901] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:19.573410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896216500583960:2901] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:19.577717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896216500583960:2901] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:19.581649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896216500583960:2901] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:19.581666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896216500583960:2901] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:19.581670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896216500583960:2901] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:19.581687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2179 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:19.584053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:19.587289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:19.587467Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:19.587475Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:19.587483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:19.587526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:19.587572Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896216410812037:2822]
2025-09-30T14:56:19.588081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:19.588446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:19.588517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:19.588785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:19.588837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:19.588841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:19.588842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:19.588843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:19.588844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:19.588845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:19.588846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:19.588846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:19.588847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:19.588848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:19.588849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.588850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.588850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.588851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:19.588852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:19.588857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:19.588864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:19.588867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:19.588870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:19.588872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:19.588875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:19.588877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:19.588880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:19.588882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:19.588885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:19.588887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.588889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.588892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.588894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:19.588896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:19.588902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:19.588908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:19.588913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:19.588917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:19.588919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:19.588923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:19.588926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:19.588929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:19.588932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:19.588935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:19.588938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:19.588942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:19.588944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:19.588948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:19.588952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:19.588956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:19.588959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:19.588962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:19.588964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:19.588968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:19.588972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.588975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.588978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.588983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.588988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.588993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.588997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:19.589003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:19.589008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:19.589014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:19.589038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:19.596462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:19.597571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:19.597587Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:19.597591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:19.597595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:19.597602Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2178 [2:7555896216410812037:2822]
2025-09-30T14:56:19.597621Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:19.597639Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:19.597642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:19.597645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:19.597648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:19.597664Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:19.597672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:19.597679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:19.597741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.597749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.597751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.597755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:19.597758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:19.597829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:19.597837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.597851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.597864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.597887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:19.597910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896216500584159:2901], now have 1 active actors on pipe
2025-09-30T14:56:19.597918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896216500583909:2454], now have 1 active actors on pipe
2025-09-30T14:56:19.597925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896216410812032:2822]
2025-09-30T14:56:19.597928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896216410812032:2822]
2025-09-30T14:56:19.597930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896216410812032:2822]
2025-09-30T14:56:19.597946Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:19.597965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:19.597985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:19.597994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:19.598032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896216410812032:2822]
2025-09-30T14:56:19.598036Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:19.598045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:19.598049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:19.598053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:19.598059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:19.598096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:19.598104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:19.598129Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd983276-dd33bc7f-da8a1158-57abbdce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:19.598140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:19.598148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:19.598151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:19.598161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:19.598174Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:19.598199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:19.598581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:19.598596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:19.598632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:19.598021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2178
2025-09-30T14:56:19.598077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2178
2025-09-30T14:56:19.602858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2179 partition: 0 MaxSeqNo: 42 sessionId: src_id|bd983276-dd33bc7f-da8a1158-57abbdce_0
2025-09-30T14:56:19.603387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a41f966-3b08538a-3ca28565-7a00419d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bd983276-dd33bc7f-da8a1158-57abbdce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:19.606305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd983276-dd33bc7f-da8a1158-57abbdce_0] Write session: try to update token
2025-09-30T14:56:19.606330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd983276-dd33bc7f-da8a1158-57abbdce_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:19.614951Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:19.614972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:19.614981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896216410812032:2822]
2025-09-30T14:56:19.615031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:19.615051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:19.615234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:19.615419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:19.615581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:19.615778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:19.616229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:19.616276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:19.624407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2179 sessionId: src_id|bd983276-dd33bc7f-da8a1158-57abbdce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:19.627306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:19.627570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:19.627592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:19.627640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:19.627726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:19.629349Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:19.629380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:19.629385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:19.629387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:19.629396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896216410812032:2822]
2025-09-30T14:56:19.629400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896216410812032:2822]
2025-09-30T14:56:19.629404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896216410812032:2822]
2025-09-30T14:56:19.629443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:19.629456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.629459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:19.629466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:19.629473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:19.629476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:19.629598Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:19.660980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896216500584207:8402]
2025-09-30T14:56:19.661278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2178, pipe: [1:7555896216500584207:8402]
2025-09-30T14:56:19.750110Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:19.759378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:19.759411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:19.759600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:19.759666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:19.759736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:19.759816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:19.760369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:19.760389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:19.760475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:19.760546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:19.760665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:19.760750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:19.760802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:19.760811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:19.760888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:19.760963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:19.761036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:19.761109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:19.761165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:19.761175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:19.761252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:19.761525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:19.761605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:19.761678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:19.761729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:19.761738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:19.761815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:19.761888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:19.761960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:19.762036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:19.762091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:19.762100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:19.762178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:19.762248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:19.762320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:19.762395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:19.762445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:19.762454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:19.762534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:19.762609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:19.762685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:19.762756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:19.762807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:19.762815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:19.762887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:19.762959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:19.763027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:19.763094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:19.763143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:19.763151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:19.763221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:19.763312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:19.763385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:19.763458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:19.763504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:19.763512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:19.763583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:19.763651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:19.763721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:19.763791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:19.763840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:19.763848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:19.763920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896216500584207:8402], now have 1 active actors on pipe
2025-09-30T14:56:19.764197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:19.764217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:19.764250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2179 reason: error at write: Disconnected sessionId: src_id|bd983276-dd33bc7f-da8a1158-57abbdce_0
2025-09-30T14:56:19.764464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2179 sessionId: src_id|bd983276-dd33bc7f-da8a1158-57abbdce_0 is DEAD
2025-09-30T14:56:19.764489Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:19.764502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:19.764550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896216500584207:8402]
2025-09-30T14:56:19.764563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd983276-dd33bc7f-da8a1158-57abbdce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:19.764574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd983276-dd33bc7f-da8a1158-57abbdce_0] Write session will restart in 0.007577s
2025-09-30T14:56:19.764596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd983276-dd33bc7f-da8a1158-57abbdce_0] Write session: Do CDS request
2025-09-30T14:56:19.764602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd983276-dd33bc7f-da8a1158-57abbdce_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:19.773828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd983276-dd33bc7f-da8a1158-57abbdce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:19.773928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:19.773948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2180
2025-09-30T14:56:19.774244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2180 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:19.774279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2180 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:19.774284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2180 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:19.774289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:19.774782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2180 sessionId:  describe result for acl check
2025-09-30T14:56:19.774822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:19.774829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:19.774831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:19.774838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896216500584224:2917] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:19.775409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896216500584224:2917] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:19.777959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896216500584224:2917] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:19.782284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896216500584224:2917] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:19.782299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896216500584224:2917] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:19.782301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896216500584224:2917] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:19.782307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2180 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:19.787829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:19.790865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:19.791077Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:19.791087Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:19.791098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:19.791149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:19.791189Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896216410812352:2776]
2025-09-30T14:56:19.791854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:19.792263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:19.792317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:19.792657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:19.792732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:19.792739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:19.792740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:19.792741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:19.792742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:19.792743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:19.792745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:19.792746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:19.792747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:19.792748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:19.792749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.792750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.792751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.792753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:19.792754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:19.792760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:19.792770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:19.792775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:19.792779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:19.792783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:19.792788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:19.792791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:19.792796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:19.792800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:19.792804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:19.792808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.792813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.792817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.792821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:19.792826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:19.792833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:19.792842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:19.792848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:19.792854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:19.792860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:19.792866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:19.792870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:19.792875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:19.792882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:19.792887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:19.792891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:19.792897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:19.792903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:19.792909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:19.792915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:19.792921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:19.792932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:19.792937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:19.792943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:19.792948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:19.792953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.792959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.792964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.792975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.792981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.792986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.792990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:19.792996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:19.793001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:19.793006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:19.793052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:19.799835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:19.800765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:19.800781Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:19.800785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:19.800789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:19.800798Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2179 [2:7555896216410812352:2776]
2025-09-30T14:56:19.800816Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:19.800832Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:19.800836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:19.800840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:19.800842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:19.800859Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:19.800871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:19.800879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:19.800955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.800963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.800965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.800968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:19.800971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:19.801173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2179
2025-09-30T14:56:19.801177Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2179
2025-09-30T14:56:19.801384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:19.801397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.801411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.801423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.801442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:19.801468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896216500584373:2917], now have 1 active actors on pipe
2025-09-30T14:56:19.801478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896216500584209:2454], now have 1 active actors on pipe
2025-09-30T14:56:19.801494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:19.801499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:19.801521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896216410812347:2776]
2025-09-30T14:56:19.801529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896216410812347:2776]
2025-09-30T14:56:19.801531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896216410812347:2776]
2025-09-30T14:56:19.801549Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:19.801569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:19.801587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:19.801589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:19.801593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:19.801597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:19.801600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:19.801609Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7046285b-8ae56827-45cfc825-cd0fcc26_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:19.801617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:19.801621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:19.801623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:19.801633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:19.801643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:19.801684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896216410812347:2776]
2025-09-30T14:56:19.801698Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:19.801706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:19.801710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:19.801923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:19.801937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:19.801964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:19.802074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2180 partition: 0 MaxSeqNo: 42 sessionId: src_id|7046285b-8ae56827-45cfc825-cd0fcc26_0
2025-09-30T14:56:19.802434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd983276-dd33bc7f-da8a1158-57abbdce_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7046285b-8ae56827-45cfc825-cd0fcc26_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:19.805322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7046285b-8ae56827-45cfc825-cd0fcc26_0] Write session: try to update token
2025-09-30T14:56:19.805342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7046285b-8ae56827-45cfc825-cd0fcc26_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:19.817427Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:19.817443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:19.817445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:19.817447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:19.817459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896216410812347:2776]
2025-09-30T14:56:19.817463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896216410812347:2776]
2025-09-30T14:56:19.817467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896216410812347:2776]
2025-09-30T14:56:19.817508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:19.817515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.817518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:19.817525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:19.817532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:19.817536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:19.817662Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:19.822009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2180 sessionId: src_id|7046285b-8ae56827-45cfc825-cd0fcc26_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:19.824697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:19.864748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896216500584484:8402]
2025-09-30T14:56:19.865034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2179, pipe: [1:7555896216500584484:8402]
2025-09-30T14:56:19.932881Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:19.933572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:19.933587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:19.933626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896216500584484:8402], now have 1 active actors on pipe
2025-09-30T14:56:19.933903Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:19.933985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896216500584484:8402]
2025-09-30T14:56:19.934013Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:19.934028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:19.934117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2180 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7046285b-8ae56827-45cfc825-cd0fcc26_0
2025-09-30T14:56:19.934315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2180 sessionId: src_id|7046285b-8ae56827-45cfc825-cd0fcc26_0 is DEAD
2025-09-30T14:56:19.934494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7046285b-8ae56827-45cfc825-cd0fcc26_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:19.934507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7046285b-8ae56827-45cfc825-cd0fcc26_0] Write session will restart in 0.005691s
2025-09-30T14:56:19.934532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7046285b-8ae56827-45cfc825-cd0fcc26_0] Write session: Do CDS request
2025-09-30T14:56:19.934538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7046285b-8ae56827-45cfc825-cd0fcc26_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:19.941785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7046285b-8ae56827-45cfc825-cd0fcc26_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:19.941867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:19.941885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2181
2025-09-30T14:56:19.942008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2181 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:19.942056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2181 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:19.942067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2181 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:19.942072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:19.942522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2181 sessionId:  describe result for acl check
2025-09-30T14:56:19.942561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:19.942569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:19.942573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:19.942579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896216500584500:2940] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:19.943131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896216500584500:2940] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:19.944890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896216500584500:2940] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:19.948731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896216500584500:2940] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:19.948749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896216500584500:2940] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:19.948753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896216500584500:2940] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:19.948762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2181 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:19.956522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:19.959552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:19.959755Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:19.959766Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:19.959776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:19.959843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:19.959881Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896216410812621:2773]
2025-09-30T14:56:19.960526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:19.960839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:19.960895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:19.961228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:19.961313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:19.961321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:19.961322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:19.961323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:19.961324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:19.961325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:19.961327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:19.961328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:19.961329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:19.961330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:19.961331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.961333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.961334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.961335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:19.961336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:19.961342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:19.961351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:19.961372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:19.961389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:19.961394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:19.961397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:19.961401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:19.961405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:19.961409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:19.961413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:19.961416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.961420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.961425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.961428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:19.961433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:19.961441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:19.961449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:19.961457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:19.961462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:19.961467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:19.961474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:19.961479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:19.961485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:19.961491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:19.961500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:19.961505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:19.961510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:19.961522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:19.961528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:19.961537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:19.961543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:19.961553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:19.961560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:19.961567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:19.961572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:19.961582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.961588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.961593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.961602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.961608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.961614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.961623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:19.961628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:19.961633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:19.961640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:19.961692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:19.968475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:19.969350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:19.969382Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:19.969385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:19.969389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:19.969397Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2180 [2:7555896216410812621:2773]
2025-09-30T14:56:19.969415Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:19.969433Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:19.969437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:19.969441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:19.969444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:19.969459Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:19.969473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:19.969481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:19.969553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.969559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.969562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.969566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:19.969569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:19.969640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:19.969649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.969665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:19.969684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:19.969707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:19.969732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896216500584620:2940], now have 1 active actors on pipe
2025-09-30T14:56:19.969740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896216500584485:2454], now have 1 active actors on pipe
2025-09-30T14:56:19.969747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896216410812616:2773]
2025-09-30T14:56:19.969755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896216410812616:2773]
2025-09-30T14:56:19.969758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896216410812616:2773]
2025-09-30T14:56:19.969774Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:19.969766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2180
2025-09-30T14:56:19.969787Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2180
2025-09-30T14:56:19.969793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:19.969793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:19.969796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:19.969798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:19.969821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:19.969825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:19.969874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:19.969878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:19.969895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896216410812616:2773]
2025-09-30T14:56:19.969906Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:19.969912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:19.969933Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9dd7b23d-3de39122-6d2677ea-9115c2cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:19.969940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:19.969944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:19.969946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:19.969957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:19.969967Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:19.969993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:19.970216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:19.970231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:19.970255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:19.970356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2181 partition: 0 MaxSeqNo: 42 sessionId: src_id|9dd7b23d-3de39122-6d2677ea-9115c2cd_0
2025-09-30T14:56:19.970788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7046285b-8ae56827-45cfc825-cd0fcc26_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9dd7b23d-3de39122-6d2677ea-9115c2cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:19.973628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dd7b23d-3de39122-6d2677ea-9115c2cd_0] Write session: try to update token
2025-09-30T14:56:19.973653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dd7b23d-3de39122-6d2677ea-9115c2cd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:19.985377Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:19.985399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:19.985401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:19.985404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:19.985413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896216410812616:2773]
2025-09-30T14:56:19.985418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896216410812616:2773]
2025-09-30T14:56:19.985422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896216410812616:2773]
2025-09-30T14:56:19.985459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:19.985467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:19.985471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:19.985471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:19.985479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:19.985483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:19.985611Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:19.989350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2181 sessionId: src_id|9dd7b23d-3de39122-6d2677ea-9115c2cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:19.992344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:20.034256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896220795552070:8402]
2025-09-30T14:56:20.034535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2180, pipe: [1:7555896220795552070:8402]
2025-09-30T14:56:20.106321Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:20.107069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:20.107091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:20.107131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896220795552070:8402], now have 1 active actors on pipe
2025-09-30T14:56:20.107367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896220795552070:8402]
2025-09-30T14:56:20.107378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:20.107383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:20.107409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:20.107442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2181 reason: error at write: Disconnected sessionId: src_id|9dd7b23d-3de39122-6d2677ea-9115c2cd_0
2025-09-30T14:56:20.107540Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:20.107908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2181 sessionId: src_id|9dd7b23d-3de39122-6d2677ea-9115c2cd_0 is DEAD
2025-09-30T14:56:20.108063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dd7b23d-3de39122-6d2677ea-9115c2cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:20.108075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dd7b23d-3de39122-6d2677ea-9115c2cd_0] Write session will restart in 0.007347s
2025-09-30T14:56:20.108099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dd7b23d-3de39122-6d2677ea-9115c2cd_0] Write session: Do CDS request
2025-09-30T14:56:20.108105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dd7b23d-3de39122-6d2677ea-9115c2cd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:20.116809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dd7b23d-3de39122-6d2677ea-9115c2cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:20.116889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:20.116907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2182
2025-09-30T14:56:20.117072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2182 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:20.117117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2182 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:20.117125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2182 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:20.117130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:20.117563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2182 sessionId:  describe result for acl check
2025-09-30T14:56:20.117612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:20.117619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:20.117623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:20.117629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896220795552103:2939] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:20.118157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896220795552103:2939] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:20.120903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896220795552103:2939] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:20.124476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896220795552103:2939] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:20.124494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896220795552103:2939] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:20.124498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896220795552103:2939] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:20.124506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2182 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:20.128749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:20.131794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:20.132026Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:20.132036Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:20.132047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:20.132100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:20.132141Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896220705780185:2772]
2025-09-30T14:56:20.132853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:20.133184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:20.133231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:20.133590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:20.133653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:20.133659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:20.133660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:20.133662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:20.133663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:20.133665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:20.133666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:20.133668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:20.133669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:20.133671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:20.133672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.133673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:20.133675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:20.133676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:20.133677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:20.133682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:20.133694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:20.133699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:20.133704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:20.133708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:20.133713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:20.133718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:20.133722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:20.133726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:20.133731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:20.133736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.133741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:20.133745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:20.133750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:20.133755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:20.133763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:20.133771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:20.133777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:20.133789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:20.133798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:20.133809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:20.133819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:20.133830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:20.133836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:20.133842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:20.133848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:20.133858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:20.133868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:20.133878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:20.133887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:20.133895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:20.133904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:20.133915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:20.133925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:20.133935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:20.133940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.133948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.133957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:20.133967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:20.133976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:20.133986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:20.133991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:20.133997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:20.134002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:20.134008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:20.134059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:20.139959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:20.141279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:20.141297Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:20.141300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:20.141304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:20.141311Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2181 [2:7555896220705780185:2772]
2025-09-30T14:56:20.141329Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:20.141344Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:20.141352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:20.141366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:20.141368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:20.141385Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:20.141396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:20.141403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:20.141466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.141474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:20.141476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:20.141479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:20.141482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:20.141551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:20.141558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.141573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:20.141592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:20.141614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:20.141633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896220705780180:2772]
2025-09-30T14:56:20.141635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896220705780180:2772]
2025-09-30T14:56:20.141637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896220705780180:2772]
2025-09-30T14:56:20.141647Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:20.141657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:20.141660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896220795552071:2454], now have 1 active actors on pipe
2025-09-30T14:56:20.141661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:20.141663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:20.141667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896220795552269:2939], now have 1 active actors on pipe
2025-09-30T14:56:20.141673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:20.141694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:20.141702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:20.141735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896220705780180:2772]
2025-09-30T14:56:20.141747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:20.141776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:20.141765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2181
2025-09-30T14:56:20.141773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2181
2025-09-30T14:56:20.141839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:20.141849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:20.141874Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f5fb60f-c28a4ef9-a0d9686b-e21c63ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:20.141883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:20.141891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:20.141894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:20.141904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:20.141918Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:20.141936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:20.142075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:20.142083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:20.142096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:20.142191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2182 partition: 0 MaxSeqNo: 42 sessionId: src_id|4f5fb60f-c28a4ef9-a0d9686b-e21c63ff_0
2025-09-30T14:56:20.142546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dd7b23d-3de39122-6d2677ea-9115c2cd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4f5fb60f-c28a4ef9-a0d9686b-e21c63ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:20.145318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5fb60f-c28a4ef9-a0d9686b-e21c63ff_0] Write session: try to update token
2025-09-30T14:56:20.145341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5fb60f-c28a4ef9-a0d9686b-e21c63ff_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:20.157096Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:20.157115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:20.157125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896220705780180:2772]
2025-09-30T14:56:20.157165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:20.157172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:20.157394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:20.157559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:20.157708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:20.157852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:20.158051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:20.158096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:20.162130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2182 sessionId: src_id|4f5fb60f-c28a4ef9-a0d9686b-e21c63ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:20.165017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:20.165243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:20.165276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:20.165311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:20.165448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:20.168266Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:20.168289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:20.168291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:20.168294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:20.168303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896220705780180:2772]
2025-09-30T14:56:20.168307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896220705780180:2772]
2025-09-30T14:56:20.168312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896220705780180:2772]
2025-09-30T14:56:20.168352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:20.168358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.168361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:20.168415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:20.168427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:20.168432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:20.168506Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:20.207322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896220795552356:8402]
2025-09-30T14:56:20.207637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2181, pipe: [1:7555896220795552356:8402]
2025-09-30T14:56:20.281320Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:20.288943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:20.288973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:20.289146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:20.289216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:20.289283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:20.289371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:20.289646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:20.289654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:20.289728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:20.289789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:20.289851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:20.290097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:20.290146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:20.290149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:20.290226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:20.290288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:20.290347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:20.290406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:20.290450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:20.290453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:20.290530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:20.290600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:20.290665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:20.290736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:20.290802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:20.290806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:20.290937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:20.291014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:20.291080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:20.291136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:20.291175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:20.291177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:20.291271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:20.291341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:20.291405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:20.291477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:20.291526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:20.291529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:20.291599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:20.291665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:20.291736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:20.291812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:20.291858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:20.291864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:20.291933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:20.291995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:20.292062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:20.292127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:20.292171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:20.292178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:20.292248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:20.292313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:20.292377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:20.292442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:20.292487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:20.292495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:20.292563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:20.292624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:20.292687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:20.292752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:20.292796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:20.292802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:20.292868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896220795552356:8402], now have 1 active actors on pipe
2025-09-30T14:56:20.294035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5fb60f-c28a4ef9-a0d9686b-e21c63ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:20.294050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5fb60f-c28a4ef9-a0d9686b-e21c63ff_0] Write session will restart in 0.005447s
2025-09-30T14:56:20.294075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5fb60f-c28a4ef9-a0d9686b-e21c63ff_0] Write session: Do CDS request
2025-09-30T14:56:20.293141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:20.294080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5fb60f-c28a4ef9-a0d9686b-e21c63ff_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:20.293205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896220795552356:8402]
2025-09-30T14:56:20.293638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:20.293642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:20.293673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2182 reason: error at write: Disconnected sessionId: src_id|4f5fb60f-c28a4ef9-a0d9686b-e21c63ff_0
2025-09-30T14:56:20.293855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2182 sessionId: src_id|4f5fb60f-c28a4ef9-a0d9686b-e21c63ff_0 is DEAD
2025-09-30T14:56:20.293352Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:20.300780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5fb60f-c28a4ef9-a0d9686b-e21c63ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:20.300855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:20.300872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2183
2025-09-30T14:56:20.301028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2183 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:20.301061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2183 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:20.301071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2183 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:20.301075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:20.301499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2183 sessionId:  describe result for acl check
2025-09-30T14:56:20.301532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:20.301534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:20.301536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:20.301541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896220795552376:2964] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:20.302064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896220795552376:2964] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:20.304789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896220795552376:2964] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:20.308728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896220795552376:2964] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:20.308743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896220795552376:2964] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:20.308747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896220795552376:2964] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:20.308755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2183 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:20.315753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:20.316329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:20.316517Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:20.316529Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:20.316541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:20.316594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:20.316633Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896220705780454:2768]
2025-09-30T14:56:20.317250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:20.319123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:20.319177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:20.319535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:20.319600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:20.319607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:20.319608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:20.319609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:20.319610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:20.319611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:20.319612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:20.319614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:20.319615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:20.319616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:20.319617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.319619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:20.319620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:20.319621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:20.319622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:20.319628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:20.319639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:20.319643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:20.319647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:20.319651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:20.319655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:20.319659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:20.319662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:20.319666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:20.319670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:20.319673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.319676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:20.319679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:20.319683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:20.319686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:20.319694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:20.319703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:20.319709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:20.319714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:20.319788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:20.319798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:20.319802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:20.319807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:20.319815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:20.319820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:20.319824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:20.319829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:20.319834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:20.319839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:20.319843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:20.319848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:20.319852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:20.319856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:20.319862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:20.319867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:20.319871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.319876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.319880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:20.319884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:20.319888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:20.319893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:20.319902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:20.319909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:20.319913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:20.319918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:20.319964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:20.325841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:20.326919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:20.326938Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:20.326941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:20.326945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:20.326953Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2182 [2:7555896220705780454:2768]
2025-09-30T14:56:20.326970Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:20.326987Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:20.326990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:20.326994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:20.326997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:20.327014Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:20.327025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:20.327033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:20.327101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.327108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:20.327110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:20.327114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:20.327116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:20.327184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:20.327191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.327206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:20.327219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:20.327260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:20.327284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896220795552498:2964], now have 1 active actors on pipe
2025-09-30T14:56:20.327297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896220705780449:2768]
2025-09-30T14:56:20.327300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896220705780449:2768]
2025-09-30T14:56:20.327301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896220705780449:2768]
2025-09-30T14:56:20.327316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:20.327326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896220795552361:2454], now have 1 active actors on pipe
2025-09-30T14:56:20.327333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:20.327334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:20.327337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:20.327339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:20.327350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:20.327354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:20.327387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896220705780449:2768]
2025-09-30T14:56:20.327393Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:20.327355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2182
2025-09-30T14:56:20.327389Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2182
2025-09-30T14:56:20.327411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:20.327558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:20.327569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:20.327597Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|404bc408-bc848427-f04d7d41-6c75d5b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:20.327609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:20.327613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:20.327615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:20.327625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:20.327636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:20.327657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:20.327868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:20.327888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:20.327911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:20.327996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2183 partition: 0 MaxSeqNo: 42 sessionId: src_id|404bc408-bc848427-f04d7d41-6c75d5b0_0
2025-09-30T14:56:20.328377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5fb60f-c28a4ef9-a0d9686b-e21c63ff_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|404bc408-bc848427-f04d7d41-6c75d5b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:20.331387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|404bc408-bc848427-f04d7d41-6c75d5b0_0] Write session: try to update token
2025-09-30T14:56:20.331411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|404bc408-bc848427-f04d7d41-6c75d5b0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:20.340415Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:20.340433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:20.340442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896220705780449:2768]
2025-09-30T14:56:20.340487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:20.340487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:20.340689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:20.340846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:20.341005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:20.341159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:20.341391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:20.341439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:20.346817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2183 sessionId: src_id|404bc408-bc848427-f04d7d41-6c75d5b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:20.349705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:20.349932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:20.349952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:20.350004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:20.350084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:20.353140Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:20.353155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:20.353158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:20.353160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:20.353171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896220705780449:2768]
2025-09-30T14:56:20.353176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896220705780449:2768]
2025-09-30T14:56:20.353179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896220705780449:2768]
2025-09-30T14:56:20.353219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:20.353222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:20.353228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:20.353231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.353232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:20.353234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:20.353391Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:20.393125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896220795552639:8402]
2025-09-30T14:56:20.393507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2182, pipe: [1:7555896220795552639:8402]
2025-09-30T14:56:20.468350Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:20.477269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:20.477303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:20.477505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:20.477578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:20.477645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:20.477707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:20.477748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:20.477753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:20.477826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:20.477885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:20.477948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:20.478011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:20.478055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:20.478059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:20.478130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:20.478192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:20.478262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:20.478326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:20.478367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:20.478370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:20.478439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:20.478498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:20.478560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:20.478624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:20.478666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:20.478669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:20.478741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:20.478802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:20.478862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:20.478926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:20.478970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:20.478974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:20.479040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:20.479101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:20.479163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:20.479228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:20.479522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:20.479534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:20.479606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:20.479668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:20.479741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:20.479851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:20.479903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:20.479911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:20.480006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:20.480077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:20.480146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:20.480213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:20.480260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:20.480268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:20.480339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:20.480411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:20.480482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:20.480577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:20.480625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:20.480634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:20.480728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:20.481420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:20.481434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896220795552639:8402]
2025-09-30T14:56:20.481469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:20.481472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:20.481515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2183 reason: error at write: Disconnected sessionId: src_id|404bc408-bc848427-f04d7d41-6c75d5b0_0
2025-09-30T14:56:20.481714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2183 sessionId: src_id|404bc408-bc848427-f04d7d41-6c75d5b0_0 is DEAD
2025-09-30T14:56:20.481901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|404bc408-bc848427-f04d7d41-6c75d5b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:20.481917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|404bc408-bc848427-f04d7d41-6c75d5b0_0] Write session will restart in 0.009887s
2025-09-30T14:56:20.481943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|404bc408-bc848427-f04d7d41-6c75d5b0_0] Write session: Do CDS request
2025-09-30T14:56:20.481948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|404bc408-bc848427-f04d7d41-6c75d5b0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:20.480793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:20.480861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:20.480923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:20.480965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:20.480968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:20.481046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896220795552639:8402], now have 1 active actors on pipe
2025-09-30T14:56:20.482307Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:20.492759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|404bc408-bc848427-f04d7d41-6c75d5b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:20.493166Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:20.493184Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2184
2025-09-30T14:56:20.493336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2184 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:20.493413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2184 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:20.493426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2184 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:20.493431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:20.493901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2184 sessionId:  describe result for acl check
2025-09-30T14:56:20.493943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:20.493954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:20.493956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:20.493962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896220795552662:2963] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:20.494521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896220795552662:2963] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:20.499087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896220795552662:2963] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:20.504133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896220795552662:2963] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:20.504155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896220795552662:2963] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:20.504159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896220795552662:2963] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:20.504168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2184 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:20.509916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:20.513112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:20.513459Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:20.513468Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:20.513481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:20.513541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:20.513579Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896220705780726:2761]
2025-09-30T14:56:20.514178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:20.514497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:20.514538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:20.514829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:20.514903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:20.514913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:20.514914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:20.514915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:20.514916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:20.514917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:20.514918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:20.514919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:20.514920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:20.514921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:20.514922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.514923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:20.514924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:20.514925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:20.514935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:20.514940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:20.514950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:20.514953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:20.514957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:20.514960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:20.514964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:20.514967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:20.514971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:20.514974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:20.514977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:20.514980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.514984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:20.514987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:20.514990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:20.514993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:20.515002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:20.515009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:20.515014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:20.515018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:20.515022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:20.515026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:20.515030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:20.515035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:20.515039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:20.515043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:20.515047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:20.515051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:20.515054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:20.515059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:20.515063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:20.515067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:20.515071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:20.515075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:20.515079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:20.515083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:20.515087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.515092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.515096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:20.515100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:20.515104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:20.515108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:20.515112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:20.515116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:20.515120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:20.515125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:20.515167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:20.521391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:20.522293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:20.522312Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:20.522315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:20.522318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:20.522326Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2183 [2:7555896220705780726:2761]
2025-09-30T14:56:20.522343Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:20.522359Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:20.522363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:20.522366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:20.522369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:20.522384Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:20.522391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:20.522397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:20.522474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.522485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:20.522488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:20.522491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:20.522494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:20.522564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:20.522573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.522586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:20.522598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:20.522613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:20.522644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896220795552838:2963], now have 1 active actors on pipe
2025-09-30T14:56:20.522655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896220705780721:2761]
2025-09-30T14:56:20.522658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896220705780721:2761]
2025-09-30T14:56:20.522661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896220705780721:2761]
2025-09-30T14:56:20.522688Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:20.522702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896220795552641:2454], now have 1 active actors on pipe
2025-09-30T14:56:20.522711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:20.522712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:20.522716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:20.522719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:20.522724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:20.522732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:20.522720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2183
2025-09-30T14:56:20.522768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896220705780721:2761]
2025-09-30T14:56:20.522725Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2183
2025-09-30T14:56:20.522781Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:20.522786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:20.522800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:20.522805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:20.522864Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b366a1f-ac2c8c9d-f22314a2-c297b3be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:20.522875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:20.522879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:20.522881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:20.522892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:20.522901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:20.522921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:20.523271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2184 partition: 0 MaxSeqNo: 42 sessionId: src_id|4b366a1f-ac2c8c9d-f22314a2-c297b3be_0
2025-09-30T14:56:20.523623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|404bc408-bc848427-f04d7d41-6c75d5b0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4b366a1f-ac2c8c9d-f22314a2-c297b3be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:20.523124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:20.523132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:20.523148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:20.526472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b366a1f-ac2c8c9d-f22314a2-c297b3be_0] Write session: try to update token
2025-09-30T14:56:20.526494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b366a1f-ac2c8c9d-f22314a2-c297b3be_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:20.536121Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:20.536141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:20.536143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:20.536145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:20.536158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896220705780721:2761]
2025-09-30T14:56:20.536162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896220705780721:2761]
2025-09-30T14:56:20.536166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896220705780721:2761]
2025-09-30T14:56:20.536209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:20.536217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.536220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:20.536230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:20.536244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:20.536251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:20.536384Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:20.545994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2184 sessionId: src_id|4b366a1f-ac2c8c9d-f22314a2-c297b3be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:20.548903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:20.586728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896220795552920:8402]
2025-09-30T14:56:20.587030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2183, pipe: [1:7555896220795552920:8402]
2025-09-30T14:56:20.650544Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:20.651154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:20.651163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:20.651182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896220795552920:8402], now have 1 active actors on pipe
2025-09-30T14:56:20.651435Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:20.651921Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:20.651973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896220795552920:8402]
2025-09-30T14:56:20.651991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:20.652051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2184 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4b366a1f-ac2c8c9d-f22314a2-c297b3be_0
2025-09-30T14:56:20.652229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2184 sessionId: src_id|4b366a1f-ac2c8c9d-f22314a2-c297b3be_0 is DEAD
2025-09-30T14:56:20.654434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b366a1f-ac2c8c9d-f22314a2-c297b3be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:20.654447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b366a1f-ac2c8c9d-f22314a2-c297b3be_0] Write session will restart in 0.005777s
2025-09-30T14:56:20.654480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b366a1f-ac2c8c9d-f22314a2-c297b3be_0] Write session: Do CDS request
2025-09-30T14:56:20.654486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b366a1f-ac2c8c9d-f22314a2-c297b3be_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:20.661823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b366a1f-ac2c8c9d-f22314a2-c297b3be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:20.661900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:20.661918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2185
2025-09-30T14:56:20.667715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2185 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:20.667776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2185 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:20.667782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2185 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:20.667787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:20.668377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2185 sessionId:  describe result for acl check
2025-09-30T14:56:20.668417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:20.668420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:20.668422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:20.668428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896220795552954:2982] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:20.668986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896220795552954:2982] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:20.673525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896220795552954:2982] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:20.684597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896220795552954:2982] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:20.684627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896220795552954:2982] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:20.684631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896220795552954:2982] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:20.684639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2185 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:20.696953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:20.700685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:20.700895Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:20.700905Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:20.700916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:20.700968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:20.701003Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896220705781032:2750]
2025-09-30T14:56:20.701657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:20.701986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:20.702041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:20.702388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:20.702461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:20.702466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:20.702467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:20.702468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:20.702469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:20.702470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:20.702472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:20.702473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:20.702474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:20.702475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:20.702476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.702477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:20.702478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:20.702479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:20.702480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:20.702486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:20.702496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:20.702500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:20.702505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:20.702510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:20.702515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:20.702519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:20.702522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:20.702526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:20.702531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:20.702536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.702540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:20.702543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:20.702547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:20.702552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:20.702560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:20.702569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:20.702576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:20.702582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:20.702587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:20.702593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:20.702598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:20.702604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:20.702608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:20.702614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:20.702619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:20.702625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:20.702630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:20.702635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:20.702640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:20.702646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:20.702655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:20.702660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:20.702670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:20.702676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:20.702684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.702690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.702698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:20.702703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:20.702707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:20.702713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:20.702717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:20.702722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:20.702727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:20.702733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:20.702778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:20.709227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:20.710790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2184
2025-09-30T14:56:20.710830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2184
2025-09-30T14:56:20.710199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:20.710215Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:20.710222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:20.710227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:20.710234Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2184 [2:7555896220705781032:2750]
2025-09-30T14:56:20.710251Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:20.710267Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:20.710270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:20.710273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:20.710276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:20.710295Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:20.710302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:20.710309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:20.710376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.710378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:20.710381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:20.710385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:20.710387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:20.710638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:20.710642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.710656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:20.710669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:20.710687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:20.710710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896220795553087:2982], now have 1 active actors on pipe
2025-09-30T14:56:20.710715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896220795552934:2454], now have 1 active actors on pipe
2025-09-30T14:56:20.710721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896220705781012:2750]
2025-09-30T14:56:20.710724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896220705781012:2750]
2025-09-30T14:56:20.710728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896220705781012:2750]
2025-09-30T14:56:20.710743Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:20.710759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:20.710760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:20.710764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:20.710766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:20.710784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:20.710787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:20.710824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896220705781012:2750]
2025-09-30T14:56:20.710829Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:20.710830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:20.710854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:20.710859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:20.710896Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d4354f7-ddb3f1c4-b9437a00-b11ef241_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:20.710903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:20.710907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:20.710910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:20.710920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:20.710930Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:20.710947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:20.711213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:20.711222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:20.711238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:20.711381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2185 partition: 0 MaxSeqNo: 42 sessionId: src_id|7d4354f7-ddb3f1c4-b9437a00-b11ef241_0
2025-09-30T14:56:20.711762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b366a1f-ac2c8c9d-f22314a2-c297b3be_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7d4354f7-ddb3f1c4-b9437a00-b11ef241_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:20.714583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4354f7-ddb3f1c4-b9437a00-b11ef241_0] Write session: try to update token
2025-09-30T14:56:20.714602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4354f7-ddb3f1c4-b9437a00-b11ef241_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:20.723724Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:20.723746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:20.723748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:20.723751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:20.723761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896220705781012:2750]
2025-09-30T14:56:20.723766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896220705781012:2750]
2025-09-30T14:56:20.723770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896220705781012:2750]
2025-09-30T14:56:20.723813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:20.723820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.723823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:20.723822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:20.723830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:20.723834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:20.723975Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:20.734643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2185 sessionId: src_id|7d4354f7-ddb3f1c4-b9437a00-b11ef241_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:20.737709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:20.752123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896220795553226:8402]
2025-09-30T14:56:20.758940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2184, pipe: [1:7555896220795553226:8402]
2025-09-30T14:56:20.857529Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:20.858246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:20.858262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:20.858302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896220795553226:8402], now have 1 active actors on pipe
2025-09-30T14:56:20.858565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896220795553226:8402]
2025-09-30T14:56:20.858611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:20.858612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:20.858615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:20.858673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2185 reason: error at write: Disconnected sessionId: src_id|7d4354f7-ddb3f1c4-b9437a00-b11ef241_0
2025-09-30T14:56:20.858913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2185 sessionId: src_id|7d4354f7-ddb3f1c4-b9437a00-b11ef241_0 is DEAD
2025-09-30T14:56:20.858544Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:20.859337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4354f7-ddb3f1c4-b9437a00-b11ef241_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:20.859349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4354f7-ddb3f1c4-b9437a00-b11ef241_0] Write session will restart in 0.008032s
2025-09-30T14:56:20.859375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4354f7-ddb3f1c4-b9437a00-b11ef241_0] Write session: Do CDS request
2025-09-30T14:56:20.859400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4354f7-ddb3f1c4-b9437a00-b11ef241_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:20.868836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4354f7-ddb3f1c4-b9437a00-b11ef241_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:20.868941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:20.868958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2186
2025-09-30T14:56:20.869098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2186 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:20.869130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2186 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:20.869141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2186 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:20.869146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:20.869655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2186 sessionId:  describe result for acl check
2025-09-30T14:56:20.869704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:20.869709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:20.869711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:20.869718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896220795553249:2993] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:20.870296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896220795553249:2993] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:20.874880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896220795553249:2993] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:20.878142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896220795553249:2993] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:20.878161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896220795553249:2993] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:20.878164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896220795553249:2993] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:20.878173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2186 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:20.882422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:20.885679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:20.885912Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:20.885921Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:20.885932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:20.885990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:20.886032Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896220705781318:2725]
2025-09-30T14:56:20.886692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:20.887040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:20.887101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:20.887496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:20.887568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:20.887574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:20.887575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:20.887576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:20.887577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:20.887579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:20.887580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:20.887581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:20.887582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:20.887583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:20.887583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.887584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:20.887585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:20.887586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:20.887587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:20.887593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:20.887605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:20.887609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:20.887612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:20.887616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:20.887621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:20.887625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:20.887630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:20.887634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:20.887638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:20.887642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.887647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:20.887651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:20.887654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:20.887658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:20.887667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:20.887676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:20.887682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:20.887688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:20.887692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:20.887697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:20.887703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:20.887709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:20.887714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:20.887720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:20.887724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:20.887731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:20.887743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:20.887748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:20.887753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:20.887758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:20.887763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:20.887768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:20.887772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:20.887777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:20.887787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.887792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.887796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:20.887802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:20.887811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:20.887816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:20.887825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:20.887830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:20.887835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:20.887841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:20.887892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:20.894215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:20.895178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:20.895191Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:20.895194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:20.895197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:20.895206Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2185 [2:7555896220705781318:2725]
2025-09-30T14:56:20.895225Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:20.895258Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:20.895269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:20.895273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:20.895275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:20.895293Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:20.895301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:20.895308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:20.895366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.895375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:20.895377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:20.895381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:20.895384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:20.895466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:20.895475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.895488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:20.895500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:20.895518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:20.895543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896220795553229:2454], now have 1 active actors on pipe
2025-09-30T14:56:20.895549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896220795553435:2993], now have 1 active actors on pipe
2025-09-30T14:56:20.895555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896220705781313:2725]
2025-09-30T14:56:20.895557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896220705781313:2725]
2025-09-30T14:56:20.895559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896220705781313:2725]
2025-09-30T14:56:20.895575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:20.895594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:20.895597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:20.895601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:20.895604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:20.895612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:20.895615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:20.895651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896220705781313:2725]
2025-09-30T14:56:20.895663Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:20.895674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:20.895646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2185
2025-09-30T14:56:20.895691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2185
2025-09-30T14:56:20.895846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:20.895862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:20.895891Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92a6ca95-9a206bfd-55990456-7706ee99_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:20.895905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:20.895914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:20.895917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:20.895929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:20.895946Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:20.895966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:20.896178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:20.896190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:20.896209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:20.896348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2186 partition: 0 MaxSeqNo: 42 sessionId: src_id|92a6ca95-9a206bfd-55990456-7706ee99_0
2025-09-30T14:56:20.896768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4354f7-ddb3f1c4-b9437a00-b11ef241_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|92a6ca95-9a206bfd-55990456-7706ee99_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:20.899721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92a6ca95-9a206bfd-55990456-7706ee99_0] Write session: try to update token
2025-09-30T14:56:20.899742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92a6ca95-9a206bfd-55990456-7706ee99_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:20.909583Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:20.909604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:20.909607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:20.909609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:20.909622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896220705781313:2725]
2025-09-30T14:56:20.909629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896220705781313:2725]
2025-09-30T14:56:20.909637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896220705781313:2725]
2025-09-30T14:56:20.909696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:20.909696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:20.909704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:20.909706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:20.909709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:20.909712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:20.909894Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:20.916462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2186 sessionId: src_id|92a6ca95-9a206bfd-55990456-7706ee99_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:20.919291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:20.958901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896220795553510:8402]
2025-09-30T14:56:20.959194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2185, pipe: [1:7555896220795553510:8402]
2025-09-30T14:56:21.032849Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:21.033550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:21.033562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:21.033602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896220795553510:8402], now have 1 active actors on pipe
2025-09-30T14:56:21.034339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896220795553510:8402]
2025-09-30T14:56:21.034352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:21.034375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:21.034381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:21.034444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2186 reason: error at write: Disconnected sessionId: src_id|92a6ca95-9a206bfd-55990456-7706ee99_0
2025-09-30T14:56:21.034654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2186 sessionId: src_id|92a6ca95-9a206bfd-55990456-7706ee99_0 is DEAD
2025-09-30T14:56:21.034806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92a6ca95-9a206bfd-55990456-7706ee99_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:21.034817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92a6ca95-9a206bfd-55990456-7706ee99_0] Write session will restart in 0.009750s
2025-09-30T14:56:21.034847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92a6ca95-9a206bfd-55990456-7706ee99_0] Write session: Do CDS request
2025-09-30T14:56:21.034851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92a6ca95-9a206bfd-55990456-7706ee99_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:21.034293Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:21.045878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92a6ca95-9a206bfd-55990456-7706ee99_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:21.045932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:21.045960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2187
2025-09-30T14:56:21.046123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2187 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:21.046163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2187 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:21.046168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2187 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:21.046173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:21.046705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2187 sessionId:  describe result for acl check
2025-09-30T14:56:21.046744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:21.046754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:21.046757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:21.046763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896225090520840:2991] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:21.047413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896225090520840:2991] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:21.049576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896225090520840:2991] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:21.053687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896225090520840:2991] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:21.053704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896225090520840:2991] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:21.053708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896225090520840:2991] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:21.053717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2187 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:21.061326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:21.065269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:21.065545Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:21.065559Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:21.065572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:21.065638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:21.065685Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896225000748890:2723]
2025-09-30T14:56:21.066407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:21.066753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:21.066815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:21.067171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:21.067362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:21.067370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:21.067372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:21.067373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:21.067375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:21.067376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:21.067377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:21.067379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:21.067380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:21.067382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:21.067383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.067384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.067386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.067388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:21.067389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:21.067396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:21.067408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:21.067413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:21.067418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:21.067423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:21.067427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:21.067432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:21.067437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:21.067441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:21.067446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:21.067451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.067456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.067460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.067465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:21.067469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:21.067477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:21.067487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:21.067493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:21.067499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:21.067506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:21.067511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:21.067516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:21.067522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:21.067537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:21.067550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:21.067555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:21.067560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:21.067565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:21.067571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:21.067574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:21.067588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:21.067593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:21.067597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:21.067601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:21.067606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:21.067610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.067615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.067619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.067623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.067629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.067636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.067641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:21.067645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:21.067651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:21.067657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:21.067703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:21.073905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:21.075507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:21.075525Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:21.075528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:21.075532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:21.075539Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2186 [2:7555896225000748890:2723]
2025-09-30T14:56:21.075556Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:21.075574Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:21.075578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:21.075581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:21.075583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:21.075600Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:21.075607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:21.075617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:21.075695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.075704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.075706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.075710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:21.075713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:21.075784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:21.075794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.075809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.075821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.075840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:21.075861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896225090520823:2454], now have 1 active actors on pipe
2025-09-30T14:56:21.075871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896225090520950:2991], now have 1 active actors on pipe
2025-09-30T14:56:21.075879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896225000748885:2723]
2025-09-30T14:56:21.075881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896225000748885:2723]
2025-09-30T14:56:21.075884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896225000748885:2723]
2025-09-30T14:56:21.075896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:21.075911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:21.075913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:21.075929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:21.075933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:21.075934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:21.075937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:21.075970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896225000748885:2723]
2025-09-30T14:56:21.075974Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:21.075993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:21.076112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:21.076122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:21.076150Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93e5a59a-7926e9e5-c97871dd-c896d14d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:21.076163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:21.076167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:21.076170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:21.076181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:21.076190Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:21.076205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:21.076403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:21.076411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:21.076425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:21.075956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2186
2025-09-30T14:56:21.075999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2186
2025-09-30T14:56:21.076517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2187 partition: 0 MaxSeqNo: 42 sessionId: src_id|93e5a59a-7926e9e5-c97871dd-c896d14d_0
2025-09-30T14:56:21.076893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92a6ca95-9a206bfd-55990456-7706ee99_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|93e5a59a-7926e9e5-c97871dd-c896d14d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:21.079912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93e5a59a-7926e9e5-c97871dd-c896d14d_0] Write session: try to update token
2025-09-30T14:56:21.079935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93e5a59a-7926e9e5-c97871dd-c896d14d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:21.099102Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:21.099129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:21.099140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896225000748885:2723]
2025-09-30T14:56:21.099191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:21.099203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:21.099456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:21.099625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:21.099782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:21.099933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:21.100264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:21.100330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:21.100632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2187 sessionId: src_id|93e5a59a-7926e9e5-c97871dd-c896d14d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:21.102101Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:21.102123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:21.102126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:21.102128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:21.102137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896225000748885:2723]
2025-09-30T14:56:21.102141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896225000748885:2723]
2025-09-30T14:56:21.102145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896225000748885:2723]
2025-09-30T14:56:21.102185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:21.102192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.102198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:21.102201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:21.102208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:21.102213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:21.103463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:21.102418Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:21.134542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896225090521107:8402]
2025-09-30T14:56:21.134836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2186, pipe: [1:7555896225090521107:8402]
2025-09-30T14:56:21.223137Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:21.223492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:21.223510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:21.223531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896225090521107:8402], now have 1 active actors on pipe
2025-09-30T14:56:21.223843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:21.223882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896225090521107:8402]
2025-09-30T14:56:21.223913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:21.224011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2187 reason: status is not ok: tablet will be restarted right now sessionId: src_id|93e5a59a-7926e9e5-c97871dd-c896d14d_0
2025-09-30T14:56:21.224200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2187 sessionId: src_id|93e5a59a-7926e9e5-c97871dd-c896d14d_0 is DEAD
2025-09-30T14:56:21.224373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93e5a59a-7926e9e5-c97871dd-c896d14d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:21.224385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93e5a59a-7926e9e5-c97871dd-c896d14d_0] Write session will restart in 0.005544s
2025-09-30T14:56:21.224409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93e5a59a-7926e9e5-c97871dd-c896d14d_0] Write session: Do CDS request
2025-09-30T14:56:21.224415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93e5a59a-7926e9e5-c97871dd-c896d14d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:21.223796Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:21.230808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93e5a59a-7926e9e5-c97871dd-c896d14d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:21.230862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:21.230879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2188
2025-09-30T14:56:21.231027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2188 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:21.231058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2188 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:21.231068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2188 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:21.231073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:21.231564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2188 sessionId:  describe result for acl check
2025-09-30T14:56:21.231611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:21.231620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:21.231622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:21.231628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896225090521129:3014] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:21.232211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896225090521129:3014] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:21.234257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896225090521129:3014] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:21.238279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896225090521129:3014] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:21.238298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896225090521129:3014] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:21.238302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896225090521129:3014] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:21.238310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2188 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:21.248016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:21.251165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:21.251404Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:21.251415Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:21.251427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:21.251479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:21.251522Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896225000749165:2721]
2025-09-30T14:56:21.252216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:21.252573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:21.252617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:21.252951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:21.253014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:21.253020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:21.253022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:21.253023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:21.253024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:21.253026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:21.253027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:21.253029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:21.253030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:21.253031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:21.253033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.253034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.253036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.253037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:21.253038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:21.253044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:21.253058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:21.253063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:21.253067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:21.253072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:21.253076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:21.253081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:21.253085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:21.253090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:21.253094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:21.253099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.253103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.253107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.253110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:21.253115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:21.253122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:21.253130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:21.253137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:21.253143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:21.253148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:21.253154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:21.253159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:21.253164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:21.253169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:21.253175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:21.253180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:21.253186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:21.253191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:21.253197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:21.253202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:21.253208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:21.253221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:21.253227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:21.253232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:21.253237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:21.253242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.253252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.253256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.253261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.253268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.253274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.253283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:21.253288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:21.253293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:21.253303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:21.253365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:21.259294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:21.260628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:21.260648Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:21.260651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:21.260655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:21.260661Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2187 [2:7555896225000749165:2721]
2025-09-30T14:56:21.260681Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:21.260697Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:21.260701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:21.260704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:21.260706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:21.260723Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:21.260736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:21.260743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:21.260813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.260820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.260822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.260826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:21.260829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:21.260905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:21.260912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.260926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.260943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.260979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:21.261000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896225090521207:3014], now have 1 active actors on pipe
2025-09-30T14:56:21.261003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896225090521117:2454], now have 1 active actors on pipe
2025-09-30T14:56:21.261010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896225000749160:2721]
2025-09-30T14:56:21.261012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896225000749160:2721]
2025-09-30T14:56:21.261014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896225000749160:2721]
2025-09-30T14:56:21.261026Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:21.261042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:21.261048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:21.261052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:21.261055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:21.261062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:21.261065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:21.261056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2187
2025-09-30T14:56:21.261070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2187
2025-09-30T14:56:21.261097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896225000749160:2721]
2025-09-30T14:56:21.261105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:21.261108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:21.261137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:21.261147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:21.261181Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c82d639-db9e9cf7-62328c8-a55edf69_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:21.261192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:21.261196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:21.261198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:21.261209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:21.261219Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:21.261241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:21.261438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:21.261446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:21.261460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:21.261549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2188 partition: 0 MaxSeqNo: 42 sessionId: src_id|1c82d639-db9e9cf7-62328c8-a55edf69_0
2025-09-30T14:56:21.261957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93e5a59a-7926e9e5-c97871dd-c896d14d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1c82d639-db9e9cf7-62328c8-a55edf69_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:21.264936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c82d639-db9e9cf7-62328c8-a55edf69_0] Write session: try to update token
2025-09-30T14:56:21.264956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c82d639-db9e9cf7-62328c8-a55edf69_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:21.274108Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:21.274131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:21.274134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:21.274135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:21.274147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896225000749160:2721]
2025-09-30T14:56:21.274152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896225000749160:2721]
2025-09-30T14:56:21.274157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896225000749160:2721]
2025-09-30T14:56:21.274197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:21.274205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.274208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:21.274209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:21.274217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:21.274221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:21.274364Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:21.281178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2188 sessionId: src_id|1c82d639-db9e9cf7-62328c8-a55edf69_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:21.284195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:21.323982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896225090521403:8402]
2025-09-30T14:56:21.324384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2187, pipe: [1:7555896225090521403:8402]
2025-09-30T14:56:21.393081Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:21.393426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:21.393438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:21.393481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896225090521403:8402], now have 1 active actors on pipe
2025-09-30T14:56:21.394254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896225090521403:8402]
2025-09-30T14:56:21.393857Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:21.394301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:21.394373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2188 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1c82d639-db9e9cf7-62328c8-a55edf69_0
2025-09-30T14:56:21.394576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2188 sessionId: src_id|1c82d639-db9e9cf7-62328c8-a55edf69_0 is DEAD
2025-09-30T14:56:21.394761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:21.394968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c82d639-db9e9cf7-62328c8-a55edf69_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:21.394980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c82d639-db9e9cf7-62328c8-a55edf69_0] Write session will restart in 0.005329s
2025-09-30T14:56:21.395004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c82d639-db9e9cf7-62328c8-a55edf69_0] Write session: Do CDS request
2025-09-30T14:56:21.395011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c82d639-db9e9cf7-62328c8-a55edf69_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:21.403658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c82d639-db9e9cf7-62328c8-a55edf69_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:21.403766Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:21.403786Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2189
2025-09-30T14:56:21.405276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2189 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:21.405330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2189 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:21.405336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2189 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:21.405340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:21.405803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2189 sessionId:  describe result for acl check
2025-09-30T14:56:21.405837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:21.405839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:21.405841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:21.405846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896225090521414:3021] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:21.406277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896225090521414:3021] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:21.408391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896225090521414:3021] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:21.411946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896225090521414:3021] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:21.411963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896225090521414:3021] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:21.411967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896225090521414:3021] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:21.411976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2189 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:21.429078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:21.432600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:21.432846Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:21.432858Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:21.432870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:21.432930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:21.432979Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896225000749440:2715]
2025-09-30T14:56:21.433679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:21.434115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:21.434177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:21.434593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:21.434762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:21.434769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:21.434770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:21.434772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:21.434773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:21.434773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:21.434775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:21.434776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:21.434777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:21.434778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:21.434779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.434780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.434781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.434782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:21.434783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:21.434790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:21.434800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:21.434804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:21.434809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:21.434813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:21.434817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:21.434821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:21.434826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:21.434830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:21.434836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:21.434840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.434844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.434848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.434851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:21.434856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:21.434875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:21.434882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:21.434889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:21.434895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:21.434900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:21.434906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:21.434913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:21.434919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:21.434940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:21.434946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:21.434950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:21.434955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:21.434960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:21.434966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:21.434970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:21.434976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:21.434981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:21.434986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:21.434990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:21.434996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:21.435003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.435009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.435013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.435017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.435021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.435027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.435032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:21.435037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:21.435043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:21.435049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:21.435097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:21.441397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:21.442880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:21.442908Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:21.442911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:21.442916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:21.442925Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2188 [2:7555896225000749440:2715]
2025-09-30T14:56:21.442943Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:21.442963Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:21.442966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:21.442970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:21.442972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:21.442989Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:21.442996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:21.443004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:21.443068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.443079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.443082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.443088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:21.443091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:21.444246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c82d639-db9e9cf7-62328c8-a55edf69_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9b9fcdd0-b1864e75-dcd634db-80340c66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:21.443356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2188
2025-09-30T14:56:21.443356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2188
2025-09-30T14:56:21.443840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2189 partition: 0 MaxSeqNo: 42 sessionId: src_id|9b9fcdd0-b1864e75-dcd634db-80340c66_0
2025-09-30T14:56:21.443166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:21.443178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.443194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.443208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.443227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:21.443265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896225090521406:2454], now have 1 active actors on pipe
2025-09-30T14:56:21.443269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896225090521453:3021], now have 1 active actors on pipe
2025-09-30T14:56:21.443276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896225000749435:2715]
2025-09-30T14:56:21.443278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896225000749435:2715]
2025-09-30T14:56:21.443281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896225000749435:2715]
2025-09-30T14:56:21.443294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:21.443308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:21.443311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:21.443314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:21.443324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:21.443328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:21.443330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:21.443368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896225000749435:2715]
2025-09-30T14:56:21.443371Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:21.443392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:21.443406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:21.443411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:21.443443Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b9fcdd0-b1864e75-dcd634db-80340c66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:21.443449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:21.443453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:21.443455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:21.443466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:21.443476Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:21.443495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:21.443733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:21.443736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:21.443753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:21.447556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9fcdd0-b1864e75-dcd634db-80340c66_0] Write session: try to update token
2025-09-30T14:56:21.447577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9fcdd0-b1864e75-dcd634db-80340c66_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:21.457224Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:21.457244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:21.457246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:21.457247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:21.457255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896225000749435:2715]
2025-09-30T14:56:21.457259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896225000749435:2715]
2025-09-30T14:56:21.457262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896225000749435:2715]
2025-09-30T14:56:21.457298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:21.457303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.457306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:21.457320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:21.457329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:21.457333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:21.457457Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:21.465608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2189 sessionId: src_id|9b9fcdd0-b1864e75-dcd634db-80340c66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:21.468534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:21.494447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896225090521688:8402]
2025-09-30T14:56:21.494869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2188, pipe: [1:7555896225090521688:8402]
2025-09-30T14:56:21.573666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9fcdd0-b1864e75-dcd634db-80340c66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:21.573679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9fcdd0-b1864e75-dcd634db-80340c66_0] Write session will restart in 0.005857s
2025-09-30T14:56:21.573697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9fcdd0-b1864e75-dcd634db-80340c66_0] Write session: Do CDS request
2025-09-30T14:56:21.573701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9fcdd0-b1864e75-dcd634db-80340c66_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:21.573232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896225090521688:8402]
2025-09-30T14:56:21.573265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:21.573301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:21.573303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:21.573376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2189 reason: error at write: Disconnected sessionId: src_id|9b9fcdd0-b1864e75-dcd634db-80340c66_0
2025-09-30T14:56:21.573552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2189 sessionId: src_id|9b9fcdd0-b1864e75-dcd634db-80340c66_0 is DEAD
2025-09-30T14:56:21.572454Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:21.572903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:21.572912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:21.572948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896225090521688:8402], now have 1 active actors on pipe
2025-09-30T14:56:21.573267Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:21.580854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9fcdd0-b1864e75-dcd634db-80340c66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:21.580902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:21.580921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2190
2025-09-30T14:56:21.581111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2190 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:21.581143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2190 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:21.581149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2190 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:21.581158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:21.581585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2190 sessionId:  describe result for acl check
2025-09-30T14:56:21.581613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:21.581620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:21.581622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:21.581627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896225090521705:3027] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:21.582179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896225090521705:3027] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:21.585106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896225090521705:3027] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:21.589517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896225090521705:3027] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:21.589535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896225090521705:3027] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:21.589539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896225090521705:3027] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:21.589565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2190 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:21.599936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:21.600513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:21.600699Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:21.600710Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:21.600721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:21.600780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:21.600917Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896225000749718:2717]
2025-09-30T14:56:21.601598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:21.603687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:21.603762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:21.604168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:21.604241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:21.604252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:21.604253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:21.604254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:21.604256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:21.604257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:21.604259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:21.604260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:21.604262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:21.604263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:21.604264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.604265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.604267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.604268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:21.604269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:21.604277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:21.604289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:21.604294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:21.604299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:21.604303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:21.604308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:21.604313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:21.604317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:21.604334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:21.604346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:21.604355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.604359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.604364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.604373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:21.604378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:21.604391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:21.604405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:21.604417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:21.604423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:21.604434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:21.604444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:21.604454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:21.604464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:21.604474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:21.604481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:21.604491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:21.604501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:21.604508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:21.604514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:21.604524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:21.604531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:21.604537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:21.604542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:21.604553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:21.604563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:21.604573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.604584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.604593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.604599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.604609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.604619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.604624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:21.604629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:21.604634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:21.604645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:21.604701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:21.610550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:21.611801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:21.611820Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:21.611823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:21.611828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:21.611835Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2189 [2:7555896225000749718:2717]
2025-09-30T14:56:21.611852Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:21.611869Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:21.611873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:21.611876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:21.611878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:21.611894Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:21.611900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:21.611907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:21.611975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.611985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.611987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.611991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:21.611993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:21.612071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:21.612082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.612095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.612105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.612121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:21.612140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896225090521821:3027], now have 1 active actors on pipe
2025-09-30T14:56:21.612148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896225090521689:2454], now have 1 active actors on pipe
2025-09-30T14:56:21.612156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896225000749713:2717]
2025-09-30T14:56:21.612158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896225000749713:2717]
2025-09-30T14:56:21.612160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896225000749713:2717]
2025-09-30T14:56:21.612175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:21.612188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:21.612208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:21.612217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:21.612193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2189
2025-09-30T14:56:21.612237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2189
2025-09-30T14:56:21.612252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896225000749713:2717]
2025-09-30T14:56:21.612261Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:21.612284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:21.612293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:21.612313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:21.612324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:21.612411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:21.612420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:21.612453Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|186c1ef3-8ef478a9-ca042a81-724197a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:21.612465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:21.612470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:21.612472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:21.612484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:21.612498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:21.612522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:21.612643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:21.612650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:21.612665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:21.612747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2190 partition: 0 MaxSeqNo: 42 sessionId: src_id|186c1ef3-8ef478a9-ca042a81-724197a0_0
2025-09-30T14:56:21.613112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9fcdd0-b1864e75-dcd634db-80340c66_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|186c1ef3-8ef478a9-ca042a81-724197a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:21.615981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|186c1ef3-8ef478a9-ca042a81-724197a0_0] Write session: try to update token
2025-09-30T14:56:21.616002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|186c1ef3-8ef478a9-ca042a81-724197a0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:21.625397Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:21.625418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:21.625420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:21.625423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:21.625432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896225000749713:2717]
2025-09-30T14:56:21.625437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896225000749713:2717]
2025-09-30T14:56:21.625441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896225000749713:2717]
2025-09-30T14:56:21.625487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:21.625495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.625497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:21.625657Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:21.627302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:21.627319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:21.627325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:21.632932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2190 sessionId: src_id|186c1ef3-8ef478a9-ca042a81-724197a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:21.636026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:21.673680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896225090521977:8402]
2025-09-30T14:56:21.678391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2189, pipe: [1:7555896225090521977:8402]
2025-09-30T14:56:21.743108Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:21.743499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:21.743516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:21.743535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896225090521977:8402], now have 1 active actors on pipe
2025-09-30T14:56:21.744626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896225090521977:8402]
2025-09-30T14:56:21.744656Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:21.744685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:21.744754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2190 reason: status is not ok: tablet will be restarted right now sessionId: src_id|186c1ef3-8ef478a9-ca042a81-724197a0_0
2025-09-30T14:56:21.745114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|186c1ef3-8ef478a9-ca042a81-724197a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:21.745126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|186c1ef3-8ef478a9-ca042a81-724197a0_0] Write session will restart in 0.007817s
2025-09-30T14:56:21.745144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|186c1ef3-8ef478a9-ca042a81-724197a0_0] Write session: Do CDS request
2025-09-30T14:56:21.744287Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:21.745148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|186c1ef3-8ef478a9-ca042a81-724197a0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:21.744957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2190 sessionId: src_id|186c1ef3-8ef478a9-ca042a81-724197a0_0 is DEAD
2025-09-30T14:56:21.753815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|186c1ef3-8ef478a9-ca042a81-724197a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:21.753895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:21.753913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2191
2025-09-30T14:56:21.754074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2191 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:21.754107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2191 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:21.754117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2191 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:21.754122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:21.754575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2191 sessionId:  describe result for acl check
2025-09-30T14:56:21.754615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:21.754617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:21.754619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:21.754624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896225090522011:3039] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:21.755110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896225090522011:3039] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:21.756859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896225090522011:3039] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:21.759433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896225090522011:3039] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:21.759449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896225090522011:3039] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:21.759453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896225090522011:3039] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:21.759461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2191 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:21.777240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:21.780980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:21.781449Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:21.781463Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:21.781481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:21.781557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:21.781600Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896225000750030:2700]
2025-09-30T14:56:21.782278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:21.782639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:21.782700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:21.783086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:21.783151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:21.783158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:21.783159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:21.783160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:21.783162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:21.783163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:21.783164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:21.783165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:21.783167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:21.783168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:21.783169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.783171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.783172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.783173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:21.783175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:21.783181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:21.783191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:21.783195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:21.783200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:21.783205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:21.783209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:21.783213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:21.783218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:21.783222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:21.783227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:21.783231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.783236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.783240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.783278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:21.783282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:21.783290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:21.783298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:21.783304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:21.783310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:21.783315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:21.783321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:21.783326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:21.783338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:21.783343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:21.783349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:21.783353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:21.783364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:21.783369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:21.783374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:21.783379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:21.783385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:21.783391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:21.783401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:21.783405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:21.783416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:21.783421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.783427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.783431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.783436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.783441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.783446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.783451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:21.783456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:21.783462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:21.783467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:21.783513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:21.791108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2190
2025-09-30T14:56:21.791113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2190
2025-09-30T14:56:21.789434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:21.790641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:21.790647Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:21.790650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:21.790653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:21.790661Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2190 [2:7555896225000750030:2700]
2025-09-30T14:56:21.790677Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:21.790693Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:21.790696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:21.790700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:21.790702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:21.790718Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:21.790726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:21.790734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:21.790802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.790804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.790806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.790810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:21.790813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:21.790881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:21.790884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.790910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.790923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.790941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:21.790962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896225000750025:2700]
2025-09-30T14:56:21.790965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896225000750025:2700]
2025-09-30T14:56:21.790968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896225000750025:2700]
2025-09-30T14:56:21.790977Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:21.790990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:21.790990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:21.790994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:21.790997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:21.791005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:21.791008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:21.791019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896225090521991:2454], now have 1 active actors on pipe
2025-09-30T14:56:21.791023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896225090522049:3039], now have 1 active actors on pipe
2025-09-30T14:56:21.791060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896225000750025:2700]
2025-09-30T14:56:21.791069Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:21.791100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:21.791220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:21.791237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:21.791280Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e98bd25-a3615a71-aa5f01a4-936d8b81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:21.791289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:21.791293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:21.791296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:21.791308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:21.791319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:21.791351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:21.791613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:21.791630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:21.791654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:21.791766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2191 partition: 0 MaxSeqNo: 42 sessionId: src_id|3e98bd25-a3615a71-aa5f01a4-936d8b81_0
2025-09-30T14:56:21.792134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|186c1ef3-8ef478a9-ca042a81-724197a0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3e98bd25-a3615a71-aa5f01a4-936d8b81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:21.794937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e98bd25-a3615a71-aa5f01a4-936d8b81_0] Write session: try to update token
2025-09-30T14:56:21.794956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e98bd25-a3615a71-aa5f01a4-936d8b81_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:21.804217Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:21.804238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:21.804248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896225000750025:2700]
2025-09-30T14:56:21.804289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:21.804295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:21.804507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:21.804663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:21.804820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:21.804970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:21.805528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:21.805574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:21.810259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2191 sessionId: src_id|3e98bd25-a3615a71-aa5f01a4-936d8b81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:21.813141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:21.813387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:21.813412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:21.813450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:21.813557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:21.816284Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:21.816301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:21.816303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:21.816306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:21.816317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896225000750025:2700]
2025-09-30T14:56:21.816321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896225000750025:2700]
2025-09-30T14:56:21.816325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896225000750025:2700]
2025-09-30T14:56:21.816364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:21.816370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.816369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:21.816374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:21.816376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:21.816380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:21.816520Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:21.843104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896225090522286:8402]
2025-09-30T14:56:21.843395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2190, pipe: [1:7555896225090522286:8402]
2025-09-30T14:56:21.933058Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:21.941968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:21.942003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:21.942197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:21.942267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:21.942338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:21.942405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:21.942456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:21.942461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:21.942542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:21.942613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:21.942689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:21.942764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:21.942818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:21.942822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:21.942902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:21.942970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:21.943057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:21.943161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:21.943215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:21.943219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:21.943473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:21.943587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:21.943686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:21.943790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:21.943845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:21.943849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:21.943956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:21.944053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:21.944216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:21.944332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:21.944404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:21.944408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:21.944497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:21.944581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:21.944670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:21.944764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:21.944820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:21.944823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:21.944920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:21.947011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896225090522286:8402]
2025-09-30T14:56:21.947036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:21.947041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:21.947047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:21.947075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2191 reason: error at write: Disconnected sessionId: src_id|3e98bd25-a3615a71-aa5f01a4-936d8b81_0
2025-09-30T14:56:21.945007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:21.945101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:21.945190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:21.945247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:21.945251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:21.945344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:21.945451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:21.945537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:21.945626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:21.945684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:21.945687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:21.945785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:21.945870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:21.945964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:21.946062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:21.946232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:21.946236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:21.946329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:21.946398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:21.946471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:21.946583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:21.946630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:21.946633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:21.946716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896225090522286:8402], now have 1 active actors on pipe
2025-09-30T14:56:21.947282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2191 sessionId: src_id|3e98bd25-a3615a71-aa5f01a4-936d8b81_0 is DEAD
2025-09-30T14:56:21.947465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e98bd25-a3615a71-aa5f01a4-936d8b81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:21.947486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e98bd25-a3615a71-aa5f01a4-936d8b81_0] Write session will restart in 0.007650s
2025-09-30T14:56:21.947510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e98bd25-a3615a71-aa5f01a4-936d8b81_0] Write session: Do CDS request
2025-09-30T14:56:21.947516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e98bd25-a3615a71-aa5f01a4-936d8b81_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:21.948628Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:21.956810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e98bd25-a3615a71-aa5f01a4-936d8b81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:21.956878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:21.956900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2192
2025-09-30T14:56:21.957038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2192 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:21.957070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2192 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:21.957075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2192 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:21.957080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:21.957532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2192 sessionId:  describe result for acl check
2025-09-30T14:56:21.957569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:21.957573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:21.957575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:21.957585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896225090522306:3045] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:21.958087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896225090522306:3045] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:21.961028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896225090522306:3045] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:21.965088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896225090522306:3045] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:21.965110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896225090522306:3045] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:21.965125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896225090522306:3045] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:21.965134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2192 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:21.974518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:21.977965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:21.978167Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:21.978186Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:21.978198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:21.978244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:21.978284Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896225000750322:2691]
2025-09-30T14:56:21.978751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:21.979080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:21.979124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:21.979401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:21.979456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:21.979460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:21.979461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:21.979462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:21.979463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:21.979464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:21.979465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:21.979466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:21.979466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:21.979467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:21.979468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.979469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.979470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.979470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:21.979471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:21.979475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:21.979482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:21.979485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:21.979488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:21.979490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:21.979493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:21.979495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:21.979498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:21.979500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:21.979503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:21.979516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.979520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.979524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.979528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:21.979532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:21.979541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:21.979548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:21.979553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:21.979557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:21.979560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:21.979564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:21.979567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:21.979570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:21.979573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:21.979576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:21.979578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:21.979582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:21.979584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:21.979588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:21.979591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:21.979594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:21.979597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:21.979599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:21.979602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:21.979605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:21.979608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.979611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.979614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.979619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.979621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.979624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.979626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:21.979629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:21.979632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:21.979635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:21.979661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:21.985625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:21.986708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:21.986730Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:21.986734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:21.986738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:21.986745Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2191 [2:7555896225000750322:2691]
2025-09-30T14:56:21.986762Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:21.986780Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:21.986784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:21.986788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:21.986790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:21.986808Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:21.986815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:21.986826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:21.986895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.986903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.986906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.986911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:21.986913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:21.986993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:21.987001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:21.987016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:21.987034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:21.987056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:21.987078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896225000750317:2691]
2025-09-30T14:56:21.987090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896225000750317:2691]
2025-09-30T14:56:21.987093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896225000750317:2691]
2025-09-30T14:56:21.987103Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:21.987118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:21.987120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:21.987122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:21.987128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:21.987136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:21.987140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:21.987151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896225090522429:3045], now have 1 active actors on pipe
2025-09-30T14:56:21.987155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896225090522288:2454], now have 1 active actors on pipe
2025-09-30T14:56:21.987195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896225000750317:2691]
2025-09-30T14:56:21.987210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:21.987225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:21.987222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2191
2025-09-30T14:56:21.987236Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2191
2025-09-30T14:56:21.987327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:21.987341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:21.987376Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b360c51e-6380da71-e70f7ef1-aad4f42a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:21.987389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:21.987393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:21.987400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:21.987410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:21.987425Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:21.987447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:21.987668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:21.987682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:21.987701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:21.987820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2192 partition: 0 MaxSeqNo: 42 sessionId: src_id|b360c51e-6380da71-e70f7ef1-aad4f42a_0
2025-09-30T14:56:21.988196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e98bd25-a3615a71-aa5f01a4-936d8b81_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b360c51e-6380da71-e70f7ef1-aad4f42a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:21.991267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b360c51e-6380da71-e70f7ef1-aad4f42a_0] Write session: try to update token
2025-09-30T14:56:21.991290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b360c51e-6380da71-e70f7ef1-aad4f42a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:22.000149Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:22.000171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:22.000173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:22.000176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:22.000186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896225000750317:2691]
2025-09-30T14:56:22.000191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896225000750317:2691]
2025-09-30T14:56:22.000200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896225000750317:2691]
2025-09-30T14:56:22.000246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:22.000253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.000257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:22.000288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:22.000303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:22.000308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:22.000402Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:22.007402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2192 sessionId: src_id|b360c51e-6380da71-e70f7ef1-aad4f42a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:22.010384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:22.047444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896229385489883:8402]
2025-09-30T14:56:22.047771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2191, pipe: [1:7555896229385489883:8402]
2025-09-30T14:56:22.117738Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:22.118426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:22.118444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:22.118482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896229385489883:8402], now have 1 active actors on pipe
2025-09-30T14:56:22.118739Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:22.118835Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:22.119058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:22.119126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896229385489883:8402]
2025-09-30T14:56:22.119161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2192 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b360c51e-6380da71-e70f7ef1-aad4f42a_0
2025-09-30T14:56:22.119369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2192 sessionId: src_id|b360c51e-6380da71-e70f7ef1-aad4f42a_0 is DEAD
2025-09-30T14:56:22.119510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b360c51e-6380da71-e70f7ef1-aad4f42a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:22.119523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b360c51e-6380da71-e70f7ef1-aad4f42a_0] Write session will restart in 0.005724s
2025-09-30T14:56:22.119548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b360c51e-6380da71-e70f7ef1-aad4f42a_0] Write session: Do CDS request
2025-09-30T14:56:22.119554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b360c51e-6380da71-e70f7ef1-aad4f42a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:22.126852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b360c51e-6380da71-e70f7ef1-aad4f42a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:22.126917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:22.126937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2193
2025-09-30T14:56:22.127106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2193 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:22.127146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2193 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:22.127152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2193 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:22.127159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:22.127628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2193 sessionId:  describe result for acl check
2025-09-30T14:56:22.127677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:22.127684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:22.127686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:22.127692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896229385489897:3058] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:22.128257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896229385489897:3058] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:22.130206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896229385489897:3058] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:22.133442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896229385489897:3058] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:22.133458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896229385489897:3058] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:22.133462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896229385489897:3058] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:22.133470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2193 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:22.146958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:22.150485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:22.150735Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:22.150749Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:22.150763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:22.150831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:22.150880Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896229295717896:2689]
2025-09-30T14:56:22.151587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:22.151970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:22.152025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:22.152389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:22.152477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:22.152485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:22.152486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:22.152487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:22.152488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:22.152490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:22.152491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:22.152492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:22.152493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:22.152495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:22.152496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.152497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:22.152499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:22.152500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:22.152502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:22.152509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:22.152520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:22.152524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:22.152529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:22.152533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:22.152537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:22.152540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:22.152544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:22.152548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:22.152553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:22.152556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.152561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:22.152565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:22.152568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:22.152572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:22.152581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:22.152590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:22.152596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:22.152602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:22.152609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:22.152614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:22.152619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:22.152624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:22.152629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:22.152635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:22.152640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:22.152645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:22.152650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:22.152656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:22.152660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:22.152665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:22.152670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:22.152675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:22.152679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:22.152685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:22.152689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.152717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.152728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:22.152734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:22.152738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:22.152743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:22.152747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:22.152752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:22.152756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:22.152761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:22.152807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:22.158916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:22.160319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:22.160337Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:22.160340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:22.160344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:22.160351Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2192 [2:7555896229295717896:2689]
2025-09-30T14:56:22.160366Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:22.160383Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:22.160386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:22.160389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:22.160391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:22.160406Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:22.160413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:22.160423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:22.160486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.160493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:22.160496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:22.160499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:22.160501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:22.160570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:22.160578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.160593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:22.160607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:22.160631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:22.160653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896229385489943:3058], now have 1 active actors on pipe
2025-09-30T14:56:22.160662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896229385489885:2454], now have 1 active actors on pipe
2025-09-30T14:56:22.160668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896229295717891:2689]
2025-09-30T14:56:22.160670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896229295717891:2689]
2025-09-30T14:56:22.160673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896229295717891:2689]
2025-09-30T14:56:22.160689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:22.160707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:22.160722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:22.160723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:22.160727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:22.160730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:22.160729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:22.160766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896229295717891:2689]
2025-09-30T14:56:22.160774Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:22.160743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2192
2025-09-30T14:56:22.160786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:22.160743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2192
2025-09-30T14:56:22.160805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:22.160815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:22.160846Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a237cac2-48ff79f6-a10ad9d7-e3334de3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:22.160858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:22.160868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:22.160870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:22.160880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:22.160892Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:22.160913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:22.161160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:22.161168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:22.161181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:22.161305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2193 partition: 0 MaxSeqNo: 42 sessionId: src_id|a237cac2-48ff79f6-a10ad9d7-e3334de3_0
2025-09-30T14:56:22.161723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b360c51e-6380da71-e70f7ef1-aad4f42a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a237cac2-48ff79f6-a10ad9d7-e3334de3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:22.164837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a237cac2-48ff79f6-a10ad9d7-e3334de3_0] Write session: try to update token
2025-09-30T14:56:22.164862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a237cac2-48ff79f6-a10ad9d7-e3334de3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:22.174095Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:22.174116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:22.174119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:22.174122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:22.174133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896229295717891:2689]
2025-09-30T14:56:22.174139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896229295717891:2689]
2025-09-30T14:56:22.174143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896229295717891:2689]
2025-09-30T14:56:22.174187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:22.174194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.174197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:22.174208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:22.174216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:22.174220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:22.174347Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:22.182374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2193 sessionId: src_id|a237cac2-48ff79f6-a10ad9d7-e3334de3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:22.185364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:22.219451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896229385490178:8402]
2025-09-30T14:56:22.219847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2192, pipe: [1:7555896229385490178:8402]
2025-09-30T14:56:22.293286Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:22.293648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:22.293670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:22.293729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896229385490178:8402], now have 1 active actors on pipe
2025-09-30T14:56:22.293980Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:22.294630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a237cac2-48ff79f6-a10ad9d7-e3334de3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:22.294637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a237cac2-48ff79f6-a10ad9d7-e3334de3_0] Write session will restart in 0.008058s
2025-09-30T14:56:22.294017Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:22.294656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a237cac2-48ff79f6-a10ad9d7-e3334de3_0] Write session: Do CDS request
2025-09-30T14:56:22.294083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:22.294661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a237cac2-48ff79f6-a10ad9d7-e3334de3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:22.294086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:22.294152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2193 reason: error at write: Disconnected sessionId: src_id|a237cac2-48ff79f6-a10ad9d7-e3334de3_0
2025-09-30T14:56:22.294370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2193 sessionId: src_id|a237cac2-48ff79f6-a10ad9d7-e3334de3_0 is DEAD
2025-09-30T14:56:22.294588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896229385490178:8402]
2025-09-30T14:56:22.303824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a237cac2-48ff79f6-a10ad9d7-e3334de3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:22.303953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:22.303980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2194
2025-09-30T14:56:22.304130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2194 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:22.304178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2194 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:22.304187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2194 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:22.304191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:22.304722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2194 sessionId:  describe result for acl check
2025-09-30T14:56:22.304758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:22.304760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:22.304763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:22.304768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896229385490191:3066] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:22.305318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896229385490191:3066] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:22.307434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896229385490191:3066] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:22.312289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896229385490191:3066] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:22.312309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896229385490191:3066] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:22.312312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896229385490191:3066] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:22.312321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2194 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:22.330957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:22.334522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:22.334889Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:22.334900Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:22.334910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:22.334967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:22.335013Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896229295718175:2684]
2025-09-30T14:56:22.335703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:22.336040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:22.336082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:22.336394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:22.336467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:22.336474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:22.336475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:22.336476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:22.336478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:22.336479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:22.336481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:22.336482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:22.336484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:22.336485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:22.336486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.336487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:22.336489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:22.336491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:22.336492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:22.336498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:22.336510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:22.336514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:22.336518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:22.336522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:22.336527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:22.336531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:22.336535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:22.336539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:22.336543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:22.336546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.336549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:22.336553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:22.336556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:22.336560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:22.336570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:22.336578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:22.336585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:22.336591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:22.336597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:22.336603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:22.336609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:22.336614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:22.336619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:22.336624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:22.336628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:22.336632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:22.336637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:22.336655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:22.336659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:22.336665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:22.336671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:22.336676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:22.336683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:22.336688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:22.336694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.336699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.336704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:22.336709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:22.336714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:22.336720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:22.336725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:22.336729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:22.336734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:22.336739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:22.336800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:22.342925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:22.344380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:22.344400Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:22.344402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:22.344407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:22.344415Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2193 [2:7555896229295718175:2684]
2025-09-30T14:56:22.344432Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:22.344450Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:22.344453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:22.344456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:22.344458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:22.344475Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:22.344482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:22.344489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:22.344562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.344571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:22.344573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:22.344577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:22.344580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:22.344656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:22.344663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.344678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:22.344695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:22.344718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:22.344741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896229385490233:3066], now have 1 active actors on pipe
2025-09-30T14:56:22.344750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896229385490182:2454], now have 1 active actors on pipe
2025-09-30T14:56:22.344756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896229295718170:2684]
2025-09-30T14:56:22.344759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896229295718170:2684]
2025-09-30T14:56:22.344762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896229295718170:2684]
2025-09-30T14:56:22.344776Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:22.344789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:22.344792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:22.344795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:22.344798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:22.344813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:22.344821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:22.344852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2193
2025-09-30T14:56:22.344863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896229295718170:2684]
2025-09-30T14:56:22.344876Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:22.344882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:22.344978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2193
2025-09-30T14:56:22.345094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:22.345109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:22.345148Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c086fca-be3a0a32-e85e5cf4-c4f7c45f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:22.345162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:22.345172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:22.345174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:22.345187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:22.345205Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:22.345234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:22.345397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:22.345405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:22.345420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:22.345558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2194 partition: 0 MaxSeqNo: 42 sessionId: src_id|8c086fca-be3a0a32-e85e5cf4-c4f7c45f_0
2025-09-30T14:56:22.345948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a237cac2-48ff79f6-a10ad9d7-e3334de3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8c086fca-be3a0a32-e85e5cf4-c4f7c45f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:22.349122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c086fca-be3a0a32-e85e5cf4-c4f7c45f_0] Write session: try to update token
2025-09-30T14:56:22.349146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c086fca-be3a0a32-e85e5cf4-c4f7c45f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:22.358137Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:22.358162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:22.358174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896229295718170:2684]
2025-09-30T14:56:22.358224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:22.358236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:22.358418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:22.358575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:22.358735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:22.358897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:22.359126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:22.359177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:22.365987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2194 sessionId: src_id|8c086fca-be3a0a32-e85e5cf4-c4f7c45f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:22.369431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:22.370791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:22.370826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:22.370848Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:22.370850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:22.370853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:22.370855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:22.370865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896229295718170:2684]
2025-09-30T14:56:22.370869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896229295718170:2684]
2025-09-30T14:56:22.370874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896229295718170:2684]
2025-09-30T14:56:22.370926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:22.370936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:22.370938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.370941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:22.370944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:22.370948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:22.371087Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:22.394580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896229385490472:8402]
2025-09-30T14:56:22.394902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2193, pipe: [1:7555896229385490472:8402]
2025-09-30T14:56:22.492756Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:22.493054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:22.493093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896229385490472:8402], now have 1 active actors on pipe
2025-09-30T14:56:22.493182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:22.493285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:22.493374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896229385490472:8402]
2025-09-30T14:56:22.503850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:22.503871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:22.503903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2194 reason: error at write: Disconnected sessionId: src_id|8c086fca-be3a0a32-e85e5cf4-c4f7c45f_0
2025-09-30T14:56:22.504056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2194 sessionId: src_id|8c086fca-be3a0a32-e85e5cf4-c4f7c45f_0 is DEAD
2025-09-30T14:56:22.504227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c086fca-be3a0a32-e85e5cf4-c4f7c45f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:22.504239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c086fca-be3a0a32-e85e5cf4-c4f7c45f_0] Write session will restart in 0.006064s
2025-09-30T14:56:22.504272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c086fca-be3a0a32-e85e5cf4-c4f7c45f_0] Write session: Do CDS request
2025-09-30T14:56:22.504279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c086fca-be3a0a32-e85e5cf4-c4f7c45f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:22.511805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c086fca-be3a0a32-e85e5cf4-c4f7c45f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:22.515792Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:22.515816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2195
2025-09-30T14:56:22.516027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2195 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:22.516092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2195 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:22.516104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2195 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:22.516109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:22.516714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2195 sessionId:  describe result for acl check
2025-09-30T14:56:22.516755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:22.516759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:22.516761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:22.516767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896229385490572:3070] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:22.517305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896229385490572:3070] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:22.520491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896229385490572:3070] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:22.523574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896229385490572:3070] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:22.523593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896229385490572:3070] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:22.523597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896229385490572:3070] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:22.523607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2195 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:22.525515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:22.529386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:22.529643Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:22.529654Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:22.529678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:22.529737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:22.529785Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896229295718457:2679]
2025-09-30T14:56:22.530494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:22.530810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:22.530854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:22.531202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:22.531295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:22.531300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:22.531302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:22.531304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:22.531305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:22.531306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:22.531307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:22.531308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:22.531310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:22.531311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:22.531313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.531314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:22.531315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:22.531317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:22.531318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:22.531325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:22.531338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:22.531342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:22.531346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:22.531351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:22.531356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:22.531359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:22.531364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:22.531369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:22.531374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:22.531379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.531384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:22.531388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:22.531392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:22.531396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:22.531404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:22.531413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:22.531420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:22.531426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:22.531437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:22.531443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:22.531453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:22.531458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:22.531464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:22.531470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:22.531475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:22.531482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:22.531491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:22.531497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:22.531506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:22.531512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:22.531521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:22.531528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:22.531536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:22.531542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:22.531550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.531557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.531568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:22.531574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:22.531582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:22.531589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:22.531597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:22.531603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:22.531611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:22.531616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:22.531662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:22.537870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:22.538851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:22.538867Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:22.538871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:22.538875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:22.538883Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2194 [2:7555896229295718457:2679]
2025-09-30T14:56:22.538902Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:22.538921Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:22.538924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:22.538927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:22.538930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:22.538949Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:22.538961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:22.538973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:22.539040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.539049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:22.539052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:22.539056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:22.539059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:22.539134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:22.539143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.539157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:22.539168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:22.539187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:22.539210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896229385490475:2454], now have 1 active actors on pipe
2025-09-30T14:56:22.539219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896229385490749:3070], now have 1 active actors on pipe
2025-09-30T14:56:22.539226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896229295718452:2679]
2025-09-30T14:56:22.539229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896229295718452:2679]
2025-09-30T14:56:22.539231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896229295718452:2679]
2025-09-30T14:56:22.539262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:22.539282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:22.539296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:22.539303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:22.539339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896229295718452:2679]
2025-09-30T14:56:22.539346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:22.539380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:22.539393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:22.539396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:22.539404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:22.539349Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2194
2025-09-30T14:56:22.539412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2194
2025-09-30T14:56:22.539869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2195 partition: 0 MaxSeqNo: 42 sessionId: src_id|f47a59e4-a4710628-d5fbb8a0-dc072d17_0
2025-09-30T14:56:22.540298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c086fca-be3a0a32-e85e5cf4-c4f7c45f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f47a59e4-a4710628-d5fbb8a0-dc072d17_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:22.539509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:22.539520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:22.539548Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f47a59e4-a4710628-d5fbb8a0-dc072d17_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:22.539555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:22.539559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:22.539561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:22.539573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:22.539586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:22.539601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:22.539759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:22.539763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:22.539779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:22.543571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f47a59e4-a4710628-d5fbb8a0-dc072d17_0] Write session: try to update token
2025-09-30T14:56:22.543591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f47a59e4-a4710628-d5fbb8a0-dc072d17_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:22.553415Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:22.553438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:22.553441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:22.553443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:22.553454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896229295718452:2679]
2025-09-30T14:56:22.553460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896229295718452:2679]
2025-09-30T14:56:22.553464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896229295718452:2679]
2025-09-30T14:56:22.553511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:22.553519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.553521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:22.553598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:22.553612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:22.553616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:22.553708Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:22.565622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2195 sessionId: src_id|f47a59e4-a4710628-d5fbb8a0-dc072d17_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:22.568616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:22.593210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896229385490764:8402]
2025-09-30T14:56:22.593513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2194, pipe: [1:7555896229385490764:8402]
2025-09-30T14:56:22.672166Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:22.673223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:22.673245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:22.673279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896229385490764:8402], now have 1 active actors on pipe
2025-09-30T14:56:22.673584Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:22.674510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f47a59e4-a4710628-d5fbb8a0-dc072d17_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:22.674519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f47a59e4-a4710628-d5fbb8a0-dc072d17_0] Write session will restart in 0.007995s
2025-09-30T14:56:22.674548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f47a59e4-a4710628-d5fbb8a0-dc072d17_0] Write session: Do CDS request
2025-09-30T14:56:22.674554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f47a59e4-a4710628-d5fbb8a0-dc072d17_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:22.674059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:22.674154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2195 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f47a59e4-a4710628-d5fbb8a0-dc072d17_0
2025-09-30T14:56:22.674354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2195 sessionId: src_id|f47a59e4-a4710628-d5fbb8a0-dc072d17_0 is DEAD
2025-09-30T14:56:22.674532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896229385490764:8402]
2025-09-30T14:56:22.674547Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:22.684456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f47a59e4-a4710628-d5fbb8a0-dc072d17_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:22.691435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:22.691455Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2196
2025-09-30T14:56:22.691716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2196 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:22.691767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2196 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:22.691773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2196 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:22.691777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:22.692316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2196 sessionId:  describe result for acl check
2025-09-30T14:56:22.692362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:22.692364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:22.692367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:22.692374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896229385490816:3081] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:22.692971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896229385490816:3081] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:22.696714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896229385490816:3081] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:22.706085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896229385490816:3081] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:22.706110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896229385490816:3081] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:22.706114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896229385490816:3081] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:22.706145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2196 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:22.708612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:22.712239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:22.712533Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:22.712551Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:22.712565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:22.712637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:22.712703Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896229295718738:2674]
2025-09-30T14:56:22.713462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:22.713906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:22.713973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:22.714353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:22.714437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:22.714439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:22.714440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:22.714441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:22.714443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:22.714444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:22.714446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:22.714447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:22.714449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:22.714450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:22.714452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.714453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:22.714454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:22.714456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:22.714457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:22.714466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:22.714477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:22.714482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:22.714486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:22.714491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:22.714495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:22.714500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:22.714505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:22.714508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:22.714516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:22.714521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.714525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:22.714529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:22.714534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:22.714539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:22.714553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:22.714562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:22.714568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:22.714575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:22.714580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:22.714587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:22.714592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:22.714598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:22.714604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:22.714611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:22.714618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:22.714624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:22.714630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:22.714635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:22.714640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:22.714646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:22.714653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:22.714659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:22.714664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:22.714671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:22.714677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.714704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.714710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:22.714717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:22.714721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:22.714727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:22.714733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:22.714739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:22.714744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:22.714751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:22.714805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:22.723516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:22.724970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:22.724989Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:22.724991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:22.724995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:22.725002Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2195 [2:7555896229295718738:2674]
2025-09-30T14:56:22.725017Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:22.725031Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:22.725034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:22.725036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:22.725038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:22.725052Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:22.725058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:22.725064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:22.725117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.725128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:22.725129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:22.725133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:22.725135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:22.725196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:22.725202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.725216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:22.725223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:22.725237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:22.725257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896229295718733:2674]
2025-09-30T14:56:22.725262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896229295718733:2674]
2025-09-30T14:56:22.725264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896229295718733:2674]
2025-09-30T14:56:22.725276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:22.725292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:22.725305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:22.725307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:22.725355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896229295718733:2674]
2025-09-30T14:56:22.725364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:22.725562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:22.725570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:22.725572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:22.725578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:22.725835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896229385491044:3081], now have 1 active actors on pipe
2025-09-30T14:56:22.725847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896229385490768:2454], now have 1 active actors on pipe
2025-09-30T14:56:22.725907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2195
2025-09-30T14:56:22.725958Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2195
2025-09-30T14:56:22.726229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:22.726242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:22.726278Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0421930-966d555e-13929510-71400924_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:22.726289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:22.726294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:22.726297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:22.726309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:22.726322Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:22.726353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:22.727477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:22.727493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:22.727519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:22.727701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2196 partition: 0 MaxSeqNo: 42 sessionId: src_id|b0421930-966d555e-13929510-71400924_0
2025-09-30T14:56:22.734298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f47a59e4-a4710628-d5fbb8a0-dc072d17_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b0421930-966d555e-13929510-71400924_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:22.737299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0421930-966d555e-13929510-71400924_0] Write session: try to update token
2025-09-30T14:56:22.737329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0421930-966d555e-13929510-71400924_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:22.744696Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:22.744720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:22.744722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:22.744725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:22.744735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896229295718733:2674]
2025-09-30T14:56:22.744741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896229295718733:2674]
2025-09-30T14:56:22.744746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896229295718733:2674]
2025-09-30T14:56:22.744790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:22.744796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.744799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:22.744965Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:22.748682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:22.748704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:22.748710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:22.757311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2196 sessionId: src_id|b0421930-966d555e-13929510-71400924_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:22.760409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:22.775308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896229385491071:8402]
2025-09-30T14:56:22.775891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2195, pipe: [1:7555896229385491071:8402]
2025-09-30T14:56:22.879563Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:22.880183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:22.880203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:22.880225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896229385491071:8402], now have 1 active actors on pipe
2025-09-30T14:56:22.880487Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:22.880482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:22.880498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:22.880556Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:22.880568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2196 reason: error at write: Disconnected sessionId: src_id|b0421930-966d555e-13929510-71400924_0
2025-09-30T14:56:22.880965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0421930-966d555e-13929510-71400924_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:22.880977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0421930-966d555e-13929510-71400924_0] Write session will restart in 0.008414s
2025-09-30T14:56:22.881001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0421930-966d555e-13929510-71400924_0] Write session: Do CDS request
2025-09-30T14:56:22.880602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896229385491071:8402]
2025-09-30T14:56:22.880745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2196 sessionId: src_id|b0421930-966d555e-13929510-71400924_0 is DEAD
2025-09-30T14:56:22.881006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0421930-966d555e-13929510-71400924_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:22.890756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0421930-966d555e-13929510-71400924_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:22.891120Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:22.891152Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2197
2025-09-30T14:56:22.891361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2197 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:22.891405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2197 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:22.891415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2197 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:22.891420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:22.891874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2197 sessionId:  describe result for acl check
2025-09-30T14:56:22.891915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:22.891917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:22.891919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:22.891925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896229385491120:3102] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:22.892515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896229385491120:3102] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:22.895449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896229385491120:3102] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:22.902804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896229385491120:3102] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:22.902823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896229385491120:3102] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:22.902827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896229385491120:3102] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:22.902836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2197 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:22.905950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:22.909162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:22.909420Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:22.909430Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:22.909441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:22.909491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:22.909535Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896229295719071:2635]
2025-09-30T14:56:22.910197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:22.910572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:22.910640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:22.911009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:22.911093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:22.911100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:22.911101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:22.911103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:22.911104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:22.911105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:22.911106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:22.911108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:22.911109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:22.911110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:22.911112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.911113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:22.911115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:22.911116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:22.911118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:22.911125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:22.911136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:22.911141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:22.911146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:22.911151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:22.911155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:22.911159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:22.911164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:22.911168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:22.911173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:22.911178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.911182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:22.911186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:22.911191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:22.911195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:22.911204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:22.911217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:22.911227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:22.911234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:22.911240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:22.911264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:22.911268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:22.911274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:22.911286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:22.911292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:22.911301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:22.911308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:22.911318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:22.911325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:22.911330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:22.911336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:22.911341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:22.911348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:22.911353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:22.911358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:22.911364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.911369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.911374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:22.911380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:22.911385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:22.911391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:22.911398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:22.911405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:22.911411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:22.911418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:22.911467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:22.917199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:22.918744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:22.918761Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:22.918763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:22.918767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:22.918773Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2196 [2:7555896229295719071:2635]
2025-09-30T14:56:22.918787Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:22.918803Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:22.918806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:22.918809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:22.918811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:22.918827Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:22.918834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:22.918840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:22.918898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.918906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:22.918908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:22.918913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:22.918915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:22.918976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:22.918984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.918995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:22.919005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:22.919021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:22.919039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896229385491323:3102], now have 1 active actors on pipe
2025-09-30T14:56:22.919047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896229385491083:2454], now have 1 active actors on pipe
2025-09-30T14:56:22.919052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896229295719066:2635]
2025-09-30T14:56:22.919055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896229295719066:2635]
2025-09-30T14:56:22.919057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896229295719066:2635]
2025-09-30T14:56:22.919073Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:22.919087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:22.919098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:22.919102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:22.919105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:22.919105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:22.919108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:22.919142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896229295719066:2635]
2025-09-30T14:56:22.919158Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:22.919150Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2196
2025-09-30T14:56:22.919159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2196
2025-09-30T14:56:22.919189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:22.919230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:22.919264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:22.919287Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52c0185b-ebf0b475-8645408e-9c975d97_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:22.919293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:22.919296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:22.919298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:22.919307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:22.919321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:22.919338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:22.919505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:22.919512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:22.919524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:22.919622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2197 partition: 0 MaxSeqNo: 42 sessionId: src_id|52c0185b-ebf0b475-8645408e-9c975d97_0
2025-09-30T14:56:22.920013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0421930-966d555e-13929510-71400924_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|52c0185b-ebf0b475-8645408e-9c975d97_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:22.922866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52c0185b-ebf0b475-8645408e-9c975d97_0] Write session: try to update token
2025-09-30T14:56:22.922882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52c0185b-ebf0b475-8645408e-9c975d97_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:22.931721Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:22.931743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:22.931753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896229295719066:2635]
2025-09-30T14:56:22.931799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:22.931812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:22.931982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:22.932136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:22.932281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:22.932424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:22.932621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:22.932658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:22.938625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2197 sessionId: src_id|52c0185b-ebf0b475-8645408e-9c975d97_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:22.941484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:22.941708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:22.941732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:22.941767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:22.941870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:22.949371Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:22.949394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:22.949397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:22.949399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:22.949409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896229295719066:2635]
2025-09-30T14:56:22.949414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896229295719066:2635]
2025-09-30T14:56:22.949419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896229295719066:2635]
2025-09-30T14:56:22.949461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:22.949469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:22.949473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:22.949474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:22.949481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:22.949485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:22.949610Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:22.980802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896229385491386:8402]
2025-09-30T14:56:22.981096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2196, pipe: [1:7555896229385491386:8402]
2025-09-30T14:56:23.071808Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:23.080971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:23.081002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:23.081193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:23.081280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:23.081380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:23.081456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:23.081978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:23.081993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:23.082072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:23.082141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:23.082222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:23.082300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:23.082353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:23.082361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:23.082434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:23.082507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:23.082577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:23.082645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:23.082691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:23.082699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:23.082779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:23.082856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:23.082932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:23.083003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:23.083051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:23.083060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:23.083133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:23.083200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:23.083359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:23.083436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:23.083485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:23.083499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:23.083572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:23.083639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:23.083715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:23.083785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:23.083834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:23.083843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:23.083919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:23.083983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:23.084051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:23.084118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:23.084176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:23.084184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:23.084257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:23.084324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:23.084393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:23.084461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:23.084543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:23.084552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:23.084621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:23.084683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:23.084747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:23.084820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:23.084868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:23.084876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:23.084959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:23.085021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:23.085093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:23.085165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:23.085215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:23.085222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:23.085291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896229385491386:8402], now have 1 active actors on pipe
2025-09-30T14:56:23.085547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:23.085564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:23.085565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896229385491386:8402]
2025-09-30T14:56:23.085593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2197 reason: error at write: Disconnected sessionId: src_id|52c0185b-ebf0b475-8645408e-9c975d97_0
2025-09-30T14:56:23.085604Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:23.085778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2197 sessionId: src_id|52c0185b-ebf0b475-8645408e-9c975d97_0 is DEAD
2025-09-30T14:56:23.085873Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:23.085950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52c0185b-ebf0b475-8645408e-9c975d97_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:23.085962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52c0185b-ebf0b475-8645408e-9c975d97_0] Write session will restart in 0.007106s
2025-09-30T14:56:23.085986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52c0185b-ebf0b475-8645408e-9c975d97_0] Write session: Do CDS request
2025-09-30T14:56:23.085992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52c0185b-ebf0b475-8645408e-9c975d97_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:23.094834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52c0185b-ebf0b475-8645408e-9c975d97_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:23.094951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:23.094970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2198
2025-09-30T14:56:23.095124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2198 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:23.095160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2198 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:23.095166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2198 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:23.095182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:23.096013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2198 sessionId:  describe result for acl check
2025-09-30T14:56:23.096069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:23.096076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:23.096078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:23.096085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896233680458712:3114] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:23.096663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896233680458712:3114] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:23.099572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896233680458712:3114] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:23.105601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896233680458712:3114] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:23.105628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896233680458712:3114] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:23.105632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896233680458712:3114] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:23.105641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2198 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:23.114567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:23.118017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:23.118257Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:23.118267Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:23.118277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:23.118329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:23.118374Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896233590686651:2634]
2025-09-30T14:56:23.119103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:23.119525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:23.119615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:23.119980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:23.120075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:23.120084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:23.120086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:23.120087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:23.120089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:23.120090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:23.120091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:23.120092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:23.120094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:23.120095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:23.120097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.120098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:23.120099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:23.120100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:23.120101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:23.120107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:23.120118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:23.120122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:23.120126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:23.120131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:23.120135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:23.120139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:23.120142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:23.120146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:23.120150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:23.120153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.120157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:23.120161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:23.120165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:23.120168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:23.120177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:23.120185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:23.120191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:23.120195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:23.120200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:23.120204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:23.120209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:23.120215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:23.120219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:23.120224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:23.120228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:23.120234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:23.120239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:23.120245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:23.120250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:23.120256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:23.120270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:23.120275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:23.120284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:23.120290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:23.120300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.120305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.120314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:23.120319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:23.120330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:23.120335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:23.120361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:23.120366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:23.120373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:23.120391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:23.120434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:23.126376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:23.127378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:23.127399Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:23.127402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:23.127406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:23.127413Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2197 [2:7555896233590686651:2634]
2025-09-30T14:56:23.127432Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:23.127450Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:23.127459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:23.127462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:23.127464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:23.127481Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:23.127497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:23.127506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:23.127572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.127584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:23.127586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:23.127590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:23.127593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:23.127669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:23.127677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.127691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:23.127710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:23.127733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:23.127757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896233680458839:3114], now have 1 active actors on pipe
2025-09-30T14:56:23.127766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896233680458685:2454], now have 1 active actors on pipe
2025-09-30T14:56:23.127773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896233590686646:2634]
2025-09-30T14:56:23.127776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896233590686646:2634]
2025-09-30T14:56:23.127779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896233590686646:2634]
2025-09-30T14:56:23.127792Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:23.127807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:23.127826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:23.127834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:23.127833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:23.127837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:23.127839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:23.127870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896233590686646:2634]
2025-09-30T14:56:23.127881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:23.127989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2197
2025-09-30T14:56:23.128035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2197
2025-09-30T14:56:23.127888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:23.128053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:23.128059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:23.128090Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a41c1da6-7872a797-e3c4a7c5-e01a5677_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:23.128098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:23.128101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:23.128104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:23.128114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:23.128124Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:23.128142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:23.128284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:23.128294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:23.128309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:23.128420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2198 partition: 0 MaxSeqNo: 42 sessionId: src_id|a41c1da6-7872a797-e3c4a7c5-e01a5677_0
2025-09-30T14:56:23.128842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52c0185b-ebf0b475-8645408e-9c975d97_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a41c1da6-7872a797-e3c4a7c5-e01a5677_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:23.131744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a41c1da6-7872a797-e3c4a7c5-e01a5677_0] Write session: try to update token
2025-09-30T14:56:23.131766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a41c1da6-7872a797-e3c4a7c5-e01a5677_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:23.141972Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:23.141997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:23.142000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:23.142002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:23.142012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896233590686646:2634]
2025-09-30T14:56:23.142017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896233590686646:2634]
2025-09-30T14:56:23.142021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896233590686646:2634]
2025-09-30T14:56:23.142063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:23.142073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.142076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:23.142234Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:23.142587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:23.142595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:23.142598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:23.148548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2198 sessionId: src_id|a41c1da6-7872a797-e3c4a7c5-e01a5677_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:23.151539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:23.185592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896233680458986:8402]
2025-09-30T14:56:23.185868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2197, pipe: [1:7555896233680458986:8402]
2025-09-30T14:56:23.256882Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:23.257189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:23.257204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:23.257247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896233680458986:8402], now have 1 active actors on pipe
2025-09-30T14:56:23.257531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:23.257548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:23.257563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:23.257619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896233680458986:8402]
2025-09-30T14:56:23.257629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2198 reason: error at write: Disconnected sessionId: src_id|a41c1da6-7872a797-e3c4a7c5-e01a5677_0
2025-09-30T14:56:23.257897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2198 sessionId: src_id|a41c1da6-7872a797-e3c4a7c5-e01a5677_0 is DEAD
2025-09-30T14:56:23.258009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a41c1da6-7872a797-e3c4a7c5-e01a5677_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:23.258021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a41c1da6-7872a797-e3c4a7c5-e01a5677_0] Write session will restart in 0.007236s
2025-09-30T14:56:23.258049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a41c1da6-7872a797-e3c4a7c5-e01a5677_0] Write session: Do CDS request
2025-09-30T14:56:23.258055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a41c1da6-7872a797-e3c4a7c5-e01a5677_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:23.257594Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:23.266807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a41c1da6-7872a797-e3c4a7c5-e01a5677_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:23.266975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:23.267007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2199
2025-09-30T14:56:23.267134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2199 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:23.267171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2199 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:23.267177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2199 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:23.267180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:23.267655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2199 sessionId:  describe result for acl check
2025-09-30T14:56:23.267696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:23.267704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:23.267706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:23.267712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896233680459013:3125] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:23.268266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896233680459013:3125] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:23.272612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896233680459013:3125] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:23.276374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896233680459013:3125] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:23.276392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896233680459013:3125] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:23.276396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896233680459013:3125] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:23.276404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2199 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:23.281094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:23.284198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:23.284430Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:23.284447Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:23.284460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:23.284527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:23.284577Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896233590686936:2628]
2025-09-30T14:56:23.285261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:23.285661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:23.285728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:23.286112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:23.286215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:23.286229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:23.286230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:23.286231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:23.286233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:23.286234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:23.286235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:23.286236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:23.286238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:23.286239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:23.286240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.286242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:23.286243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:23.286244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:23.286246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:23.286253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:23.286264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:23.286269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:23.286273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:23.286277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:23.286281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:23.286284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:23.286289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:23.286293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:23.286298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:23.286302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.286306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:23.286311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:23.286315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:23.286320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:23.286328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:23.286337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:23.286343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:23.286349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:23.286354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:23.286359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:23.286367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:23.286373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:23.286377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:23.286383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:23.286388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:23.286393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:23.286398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:23.286403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:23.286407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:23.286412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:23.286418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:23.286423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:23.286427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:23.286434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:23.286440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.286446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.286450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:23.286456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:23.286461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:23.286466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:23.286470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:23.286475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:23.286480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:23.286495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:23.286542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:23.292784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:23.294327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:23.294347Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:23.294351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:23.294355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:23.294362Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2198 [2:7555896233590686936:2628]
2025-09-30T14:56:23.294380Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:23.294396Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:23.294399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:23.294403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:23.294405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:23.294421Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:23.294429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:23.294436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:23.294495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.294500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:23.294502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:23.294505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:23.294507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:23.294562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:23.294567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.294578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:23.294589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:23.294598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:23.294614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896233590686931:2628]
2025-09-30T14:56:23.294620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896233590686931:2628]
2025-09-30T14:56:23.294622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896233590686931:2628]
2025-09-30T14:56:23.294629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:23.294640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:23.294644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:23.294649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:23.294652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:23.294653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:23.294655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:23.294663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896233680459191:3125], now have 1 active actors on pipe
2025-09-30T14:56:23.294665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896233680458990:2454], now have 1 active actors on pipe
2025-09-30T14:56:23.294695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896233590686931:2628]
2025-09-30T14:56:23.294704Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:23.294718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:23.294782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2198
2025-09-30T14:56:23.294783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2198
2025-09-30T14:56:23.294894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:23.294909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:23.294941Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4ef77be-c4b37ed1-a5b7d187-fa99d7f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:23.294959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:23.294963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:23.294965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:23.294976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:23.294998Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:23.295020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:23.295218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:23.295227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:23.295250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:23.295381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2199 partition: 0 MaxSeqNo: 42 sessionId: src_id|f4ef77be-c4b37ed1-a5b7d187-fa99d7f6_0
2025-09-30T14:56:23.295817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a41c1da6-7872a797-e3c4a7c5-e01a5677_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f4ef77be-c4b37ed1-a5b7d187-fa99d7f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:23.298935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4ef77be-c4b37ed1-a5b7d187-fa99d7f6_0] Write session: try to update token
2025-09-30T14:56:23.298959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4ef77be-c4b37ed1-a5b7d187-fa99d7f6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:23.313992Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:23.314016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:23.314028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896233590686931:2628]
2025-09-30T14:56:23.314084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:23.314288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:23.314470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:23.314629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:23.314784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:23.315013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:23.315062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:23.316847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2199 sessionId: src_id|f4ef77be-c4b37ed1-a5b7d187-fa99d7f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:23.318207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:23.319977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:23.320775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:23.320800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:23.320820Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:23.320823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:23.320825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:23.320828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:23.320836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896233590686931:2628]
2025-09-30T14:56:23.320841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896233590686931:2628]
2025-09-30T14:56:23.320845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896233590686931:2628]
2025-09-30T14:56:23.320892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:23.320891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:23.320896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:23.320901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:23.320906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.320909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:23.321044Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:23.357642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896233680459285:8402]
2025-09-30T14:56:23.357990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2198, pipe: [1:7555896233680459285:8402]
2025-09-30T14:56:23.435351Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:23.435714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:23.435746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896233680459285:8402], now have 1 active actors on pipe
2025-09-30T14:56:23.435852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:23.435934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896233680459285:8402]
2025-09-30T14:56:23.435961Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:23.435965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:23.435969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:23.436050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2199 reason: error at write: Disconnected sessionId: src_id|f4ef77be-c4b37ed1-a5b7d187-fa99d7f6_0
2025-09-30T14:56:23.436209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2199 sessionId: src_id|f4ef77be-c4b37ed1-a5b7d187-fa99d7f6_0 is DEAD
2025-09-30T14:56:23.436358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4ef77be-c4b37ed1-a5b7d187-fa99d7f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:23.436366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4ef77be-c4b37ed1-a5b7d187-fa99d7f6_0] Write session will restart in 0.006843s
2025-09-30T14:56:23.436384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4ef77be-c4b37ed1-a5b7d187-fa99d7f6_0] Write session: Do CDS request
2025-09-30T14:56:23.436388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4ef77be-c4b37ed1-a5b7d187-fa99d7f6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:23.444791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4ef77be-c4b37ed1-a5b7d187-fa99d7f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:23.444872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:23.444889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2200
2025-09-30T14:56:23.444999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2200 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:23.445035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2200 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:23.445040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2200 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:23.445044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:23.445562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2200 sessionId:  describe result for acl check
2025-09-30T14:56:23.445595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:23.445601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:23.445607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:23.445612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896233680459302:3130] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:23.446088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896233680459302:3130] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:23.449202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896233680459302:3130] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:23.454340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896233680459302:3130] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:23.454365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896233680459302:3130] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:23.454370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896233680459302:3130] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:23.454379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2200 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:23.465122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:23.468449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:23.468837Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:23.468850Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:23.468875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:23.468951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:23.468996Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896233590687224:2620]
2025-09-30T14:56:23.469714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:23.470147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:23.470197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:23.470515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:23.470599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:23.470606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:23.470608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:23.470609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:23.470610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:23.470612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:23.470613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:23.470614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:23.470616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:23.470617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:23.470618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.470620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:23.470621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:23.470622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:23.470624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:23.470630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:23.470640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:23.470643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:23.470647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:23.470651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:23.470655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:23.470659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:23.470663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:23.470666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:23.470670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:23.470674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.470677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:23.470681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:23.470685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:23.470688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:23.470699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:23.470707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:23.470713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:23.470718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:23.470723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:23.470728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:23.470732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:23.470740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:23.470746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:23.470751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:23.470755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:23.470761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:23.470766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:23.470771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:23.470776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:23.470782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:23.470787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:23.470792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:23.470797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:23.470803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:23.470807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.470813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.470818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:23.470824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:23.470829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:23.470834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:23.470848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:23.470853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:23.470861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:23.470867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:23.470927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:23.476944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:23.477861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:23.477884Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:23.477888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:23.477892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:23.477899Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2199 [2:7555896233590687224:2620]
2025-09-30T14:56:23.477918Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:23.477935Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:23.477950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:23.477954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:23.477956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:23.477972Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:23.477979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:23.477986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:23.478047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.478055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:23.478058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:23.478061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:23.478064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:23.478137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:23.478148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.478162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:23.478174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:23.478191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:23.478218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896233680459286:2454], now have 1 active actors on pipe
2025-09-30T14:56:23.478228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896233680459420:3130], now have 1 active actors on pipe
2025-09-30T14:56:23.478235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896233590687219:2620]
2025-09-30T14:56:23.478237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896233590687219:2620]
2025-09-30T14:56:23.478240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896233590687219:2620]
2025-09-30T14:56:23.478253Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:23.478268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:23.478272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:23.478279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:23.478281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:23.478287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:23.478290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:23.478327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896233590687219:2620]
2025-09-30T14:56:23.478337Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:23.478360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:23.478348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2199
2025-09-30T14:56:23.478359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2199
2025-09-30T14:56:23.478479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:23.478491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:23.478522Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7876489a-1b771805-520ff09e-a78838a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:23.478534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:23.478544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:23.478547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:23.478562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:23.478577Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:23.478598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:23.478793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:23.478804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:23.478821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:23.479156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2200 partition: 0 MaxSeqNo: 42 sessionId: src_id|7876489a-1b771805-520ff09e-a78838a3_0
2025-09-30T14:56:23.479607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4ef77be-c4b37ed1-a5b7d187-fa99d7f6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7876489a-1b771805-520ff09e-a78838a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:23.482475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7876489a-1b771805-520ff09e-a78838a3_0] Write session: try to update token
2025-09-30T14:56:23.482492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7876489a-1b771805-520ff09e-a78838a3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:23.491804Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:23.491831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:23.491842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896233590687219:2620]
2025-09-30T14:56:23.491894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:23.492077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:23.492240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:23.492396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:23.492539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:23.492732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:23.492769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:23.494977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:23.500022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2200 sessionId: src_id|7876489a-1b771805-520ff09e-a78838a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:23.503640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:23.503917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:23.503942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:23.503979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:23.504174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:23.505498Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:23.505516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:23.505519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:23.505521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:23.505530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896233590687219:2620]
2025-09-30T14:56:23.505535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896233590687219:2620]
2025-09-30T14:56:23.505540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896233590687219:2620]
2025-09-30T14:56:23.505575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:23.505582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.505584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:23.505718Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:23.508058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:23.508071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:23.508075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:23.536353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896233680459582:8402]
2025-09-30T14:56:23.536872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2199, pipe: [1:7555896233680459582:8402]
2025-09-30T14:56:23.626221Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:23.636051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:23.636102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:23.636311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:23.636401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:23.636492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:23.636566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:23.636868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:23.636879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:23.636953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:23.637018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:23.637104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:23.637189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:23.637241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:23.637253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:23.637327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:23.637414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:23.637487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:23.637577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:23.637627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:23.637634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:23.637723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:23.637801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:23.637872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:23.637952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:23.638004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:23.638012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:23.638102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:23.638178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:23.638253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:23.638320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:23.638367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:23.638375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:23.638455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:23.638525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:23.638591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:23.638659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:23.638705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:23.638714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:23.638794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:23.638863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:23.638945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:23.639011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:23.639060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:23.639066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:23.639143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:23.639207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:23.639299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:23.639373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:23.639421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:23.639430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:23.639499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:23.639563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:23.639628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:23.639693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:23.639738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:23.639744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:23.639818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:23.639881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:23.639952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:23.640017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:23.640060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:23.640066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:23.640144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896233680459582:8402], now have 1 active actors on pipe
2025-09-30T14:56:23.640506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:23.640522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896233680459582:8402]
2025-09-30T14:56:23.640543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:23.640545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:23.640604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2200 reason: error at write: Disconnected sessionId: src_id|7876489a-1b771805-520ff09e-a78838a3_0
2025-09-30T14:56:23.640875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2200 sessionId: src_id|7876489a-1b771805-520ff09e-a78838a3_0 is DEAD
2025-09-30T14:56:23.640912Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:23.641086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7876489a-1b771805-520ff09e-a78838a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:23.641100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7876489a-1b771805-520ff09e-a78838a3_0] Write session will restart in 0.005683s
2025-09-30T14:56:23.641126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7876489a-1b771805-520ff09e-a78838a3_0] Write session: Do CDS request
2025-09-30T14:56:23.641133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7876489a-1b771805-520ff09e-a78838a3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:23.647832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7876489a-1b771805-520ff09e-a78838a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:23.647905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:23.647935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2201
2025-09-30T14:56:23.648071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2201 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:23.648111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2201 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:23.648117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2201 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:23.648121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:23.648578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2201 sessionId:  describe result for acl check
2025-09-30T14:56:23.648633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:23.648641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:23.648643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:23.648650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896233680459599:3138] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:23.649210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896233680459599:3138] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:23.652775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896233680459599:3138] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:23.656881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896233680459599:3138] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:23.656901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896233680459599:3138] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:23.656904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896233680459599:3138] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:23.656913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2201 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:23.663665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:23.666736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:23.666970Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:23.666982Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:23.666993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:23.667046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:23.667087Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896233590687513:2614]
2025-09-30T14:56:23.667667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:23.668015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:23.668078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:23.668435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:23.668506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:23.668512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:23.668513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:23.668517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:23.668518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:23.668519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:23.668520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:23.668521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:23.668523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:23.668524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:23.668525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.668526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:23.668527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:23.668528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:23.668530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:23.668536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:23.668547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:23.668552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:23.668556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:23.668560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:23.668565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:23.668569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:23.668574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:23.668578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:23.668583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:23.668587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.668591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:23.668595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:23.668599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:23.668603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:23.668611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:23.668619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:23.668626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:23.668632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:23.668637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:23.668642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:23.668648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:23.668654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:23.668659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:23.668665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:23.668670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:23.668681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:23.668686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:23.668692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:23.668701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:23.668707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:23.668717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:23.668723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:23.668731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:23.668737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:23.668742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.668748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.668752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:23.668758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:23.668762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:23.668768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:23.668777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:23.668782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:23.668786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:23.668797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:23.668843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:23.674466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:23.675555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:23.675572Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:23.675575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:23.675579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:23.675585Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2200 [2:7555896233590687513:2614]
2025-09-30T14:56:23.675604Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:23.675629Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:23.675632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:23.675635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:23.675638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:23.675654Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:23.675660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:23.675670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:23.675728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.675736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:23.675737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:23.675741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:23.675744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:23.675822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:23.675831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.675844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:23.675857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:23.675874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:23.675898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896233680459584:2454], now have 1 active actors on pipe
2025-09-30T14:56:23.675909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896233680459750:3138], now have 1 active actors on pipe
2025-09-30T14:56:23.675916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896233590687508:2614]
2025-09-30T14:56:23.675918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896233590687508:2614]
2025-09-30T14:56:23.675920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896233590687508:2614]
2025-09-30T14:56:23.675934Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:23.675948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:23.675964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:23.675967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:23.675970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:23.675975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:23.675978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:23.676018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896233590687508:2614]
2025-09-30T14:56:23.676027Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:23.676052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:23.676010Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2200
2025-09-30T14:56:23.676018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2200
2025-09-30T14:56:23.676075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:23.676085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:23.676112Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ded6603-105d2a65-3dbbba6d-1863b1a2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:23.676124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:23.676127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:23.676134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:23.676144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:23.676154Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:23.676173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:23.676308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:23.676315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:23.676328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:23.676444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2201 partition: 0 MaxSeqNo: 42 sessionId: src_id|1ded6603-105d2a65-3dbbba6d-1863b1a2_0
2025-09-30T14:56:23.676968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7876489a-1b771805-520ff09e-a78838a3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1ded6603-105d2a65-3dbbba6d-1863b1a2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:23.679769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ded6603-105d2a65-3dbbba6d-1863b1a2_0] Write session: try to update token
2025-09-30T14:56:23.679789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ded6603-105d2a65-3dbbba6d-1863b1a2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:23.688670Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:23.688693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:23.688695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:23.688697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:23.688707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896233590687508:2614]
2025-09-30T14:56:23.688712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896233590687508:2614]
2025-09-30T14:56:23.688716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896233590687508:2614]
2025-09-30T14:56:23.688755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:23.688760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:23.688762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.688765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:23.688767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:23.688771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:23.688919Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:23.695589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2201 sessionId: src_id|1ded6603-105d2a65-3dbbba6d-1863b1a2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:23.698539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:23.740633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896233680459882:8402]
2025-09-30T14:56:23.740952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2200, pipe: [1:7555896233680459882:8402]
2025-09-30T14:56:23.804099Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:23.804444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:23.804468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:23.804526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896233680459882:8402], now have 1 active actors on pipe
2025-09-30T14:56:23.804875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:23.804885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:23.804889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:23.804951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896233680459882:8402]
2025-09-30T14:56:23.804970Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:56:23.804971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2201 reason: error at write: Disconnected sessionId: src_id|1ded6603-105d2a65-3dbbba6d-1863b1a2_0
2025-09-30T14:56:23.805081Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 22 consumer shared/user session shared/user_1_22_12843825378848088645_v1 is DEAD
2025-09-30T14:56:23.805085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2201 sessionId: src_id|1ded6603-105d2a65-3dbbba6d-1863b1a2_0 is DEAD
2025-09-30T14:56:23.805226Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896160665990249:8412] disconnected; active server actors: 1
2025-09-30T14:56:23.805237Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896160665990249:8412] client user disconnected session shared/user_1_22_12843825378848088645_v1
2025-09-30T14:56:23.805405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ded6603-105d2a65-3dbbba6d-1863b1a2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:23.805414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ded6603-105d2a65-3dbbba6d-1863b1a2_0] Write session will restart in 0.006385s
2025-09-30T14:56:23.805414Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:56:23.805437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ded6603-105d2a65-3dbbba6d-1863b1a2_0] Write session: Do CDS request
2025-09-30T14:56:23.805443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ded6603-105d2a65-3dbbba6d-1863b1a2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:23.805503Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:56:23.805508Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:56:23.805515Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.007747s
2025-09-30T14:56:23.806006Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:23.812824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ded6603-105d2a65-3dbbba6d-1863b1a2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:23.814593Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:56:23.815360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:23.815384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2202
2025-09-30T14:56:23.815462Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:56:23.815471Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 23
2025-09-30T14:56:23.815556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2202 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:23.815584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2202 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:23.815589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2202 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:23.815593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:23.815630Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 23 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:56:23.815667Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:56:23.815746Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 auth for : user
2025-09-30T14:56:23.816300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2202 sessionId:  describe result for acl check
2025-09-30T14:56:23.816339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:23.816348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:23.816350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:23.816356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896233680459933:3153] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:23.816869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896233680459933:3153] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:23.817029Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 Handle describe topics response
2025-09-30T14:56:23.817071Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 auth is DEAD
2025-09-30T14:56:23.817091Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:56:23.817544Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_23_15562949610973366798_v1
2025-09-30T14:56:23.817398Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:56:23.817521Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896233680459956:3157] connected; active server actors: 1
2025-09-30T14:56:23.817554Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555896233680459956:3157] session shared/user_1_23_15562949610973366798_v1
2025-09-30T14:56:23.817562Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:56:23.817572Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:56:23.817578Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_23_15562949610973366798_v1" (Sender=[1:7555896233680459917:3157], Pipe=[1:7555896233680459956:3157], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:56:23.817590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:56:23.817601Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:56:23.817609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_23_15562949610973366798_v1" (Sender=[1:7555896233680459917:3157], Pipe=[1:7555896233680459956:3157], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:56:23.817622Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_23_15562949610973366798_v1" sender [1:7555896233680459917:3157] lock partition 0 for ReadingSession "shared/user_1_23_15562949610973366798_v1" (Sender=[1:7555896233680459917:3157], Pipe=[1:7555896233680459956:3157], Partitions=[], ActiveFamilyCount=1) generation 1 step 23
2025-09-30T14:56:23.817635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:56:23.817645Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000042s
2025-09-30T14:56:23.817874Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 23 Session: "shared/user_1_23_15562949610973366798_v1" ClientId: "user" PipeClient { RawX1: 7555896233680459956 RawX2: 4503603922340949 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:56:23.817899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:56:23.820394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896233680459933:3153] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:23.823362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896233680459933:3153] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:23.823388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896233680459933:3153] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:23.823391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896233680459933:3153] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:23.823399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2202 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:23.828198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:23.831608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:23.831841Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:23.831851Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:23.831861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:23.831914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:23.831954Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896233590687827:2613]
2025-09-30T14:56:23.832655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:23.832977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:23.833019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:23.833334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:23.833411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:23.833418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:23.833419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:23.833421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:23.833422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:23.833423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:23.833425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:23.833426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:23.833427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:23.833428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:23.833430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.833431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:23.833432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:23.833434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:23.833436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:23.833441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:23.833451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:23.833455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:23.833460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:23.833464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:23.833469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:23.833473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:23.833477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:23.833481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:23.833486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:23.833490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.833494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:23.833498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:23.833503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:23.833507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:23.833514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:23.833522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:23.833528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:23.833535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:23.833550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:23.833556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:23.833561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:23.833566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:23.833571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:23.833577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:23.833582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:23.833588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:23.833593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:23.833599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:23.833604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:23.833609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:23.833614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:23.833620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:23.833626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:23.833632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:23.833637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.833643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.833648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:23.833653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:23.833659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:23.833670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:23.833675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:23.833686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:23.833690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:23.833700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:23.833745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:23.839636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:23.840750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:23.840772Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:23.840774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:23.840779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:23.840785Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2201 [2:7555896233590687827:2613]
2025-09-30T14:56:23.840803Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:23.840819Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:23.840822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:23.840825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:23.840828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:23.840843Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:23.840855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:23.840863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:23.840925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.840934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:23.840936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:23.840939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:23.840942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:23.841013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:23.841022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.841034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:23.841049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:23.841070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:23.841094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896233680459976:3180], now have 1 active actors on pipe
2025-09-30T14:56:23.841103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896233680460115:3153], now have 1 active actors on pipe
2025-09-30T14:56:23.841110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896233590687822:2613]
2025-09-30T14:56:23.841112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896233590687822:2613]
2025-09-30T14:56:23.841114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896233590687822:2613]
2025-09-30T14:56:23.841128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:23.841141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896233680459883:2454], now have 1 active actors on pipe
2025-09-30T14:56:23.841155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:23.841156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:23.841160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:23.841162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:23.841175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:23.841178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:23.841207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896233590687822:2613]
2025-09-30T14:56:23.841218Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:23.841224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:23.841239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2201
2025-09-30T14:56:23.841279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2201
2025-09-30T14:56:23.841279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:23.841290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:23.841315Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb894b2a-eee9f7b2-2d5e8be7-daa3bb14_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:23.841326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:23.841319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2201, pipe: [1:7555896233680459976:3180]
2025-09-30T14:56:23.841329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:23.841331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:23.841354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:23.841364Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:23.841383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:23.841414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:23.841422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:23.841429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_23_15562949610973366798_v1 on pipe: [1:7555896233680459976:3180]
2025-09-30T14:56:23.841439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:23.841448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:23.841450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:23.841463Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_23_15562949610973366798_v1
2025-09-30T14:56:23.841470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:23.841490Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:56:23.841508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:23.841511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:23.841544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:23.841631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2202 partition: 0 MaxSeqNo: 42 sessionId: src_id|bb894b2a-eee9f7b2-2d5e8be7-daa3bb14_0
2025-09-30T14:56:23.841651Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_23_15562949610973366798_v1:1 with generation 2201
2025-09-30T14:56:23.842030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ded6603-105d2a65-3dbbba6d-1863b1a2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bb894b2a-eee9f7b2-2d5e8be7-daa3bb14_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:23.844952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb894b2a-eee9f7b2-2d5e8be7-daa3bb14_0] Write session: try to update token
2025-09-30T14:56:23.844971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb894b2a-eee9f7b2-2d5e8be7-daa3bb14_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:23.846844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:56:23.846885Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:56:23.846896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:23.846909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:23.846912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:23.846923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:56:23.846935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:56:23.847102Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759244183840 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:56:23.847129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:56:23.847159Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 sending to client partition status
2025-09-30T14:56:23.854461Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:23.854488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:23.854501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896233590687822:2613]
2025-09-30T14:56:23.854550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:23.854555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:23.854763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:23.854949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:23.855123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:23.855304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:23.855556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:23.855613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:23.861785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2202 sessionId: src_id|bb894b2a-eee9f7b2-2d5e8be7-daa3bb14_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:23.864847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:23.865800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:23.865830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:23.865848Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:23.865851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:23.865853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:23.865854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:23.865862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896233590687822:2613]
2025-09-30T14:56:23.865866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896233590687822:2613]
2025-09-30T14:56:23.865869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896233590687822:2613]
2025-09-30T14:56:23.865915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:23.865914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:23.865920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:23.865923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:23.865926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:23.865928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:23.866066Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:23.985707Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:23.986015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:23.986169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:23.986213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896233680459976:3180]
2025-09-30T14:56:23.986231Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:23.986278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:23.986287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:23.986370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2202 reason: error at write: Disconnected sessionId: src_id|bb894b2a-eee9f7b2-2d5e8be7-daa3bb14_0
2025-09-30T14:56:23.986518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2202 sessionId: src_id|bb894b2a-eee9f7b2-2d5e8be7-daa3bb14_0 is DEAD
2025-09-30T14:56:23.986621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_23_15562949610973366798_v1
2025-09-30T14:56:23.986694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb894b2a-eee9f7b2-2d5e8be7-daa3bb14_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:23.986705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb894b2a-eee9f7b2-2d5e8be7-daa3bb14_0] Write session will restart in 0.008168s
2025-09-30T14:56:23.986671Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_23_15562949610973366798_v1
2025-09-30T14:56:23.986739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb894b2a-eee9f7b2-2d5e8be7-daa3bb14_0] Write session: Do CDS request
2025-09-30T14:56:23.986748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb894b2a-eee9f7b2-2d5e8be7-daa3bb14_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:23.995837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb894b2a-eee9f7b2-2d5e8be7-daa3bb14_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:23.995920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:23.995938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2203
2025-09-30T14:56:23.996148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2203 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:23.996185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2203 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:23.996190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2203 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:23.996194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:23.996795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2203 sessionId:  describe result for acl check
2025-09-30T14:56:23.996835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:23.996842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:23.996844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:23.996850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896233680460251:3176] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:23.997429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896233680460251:3176] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:24.000761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896233680460251:3176] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:24.004742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896233680460251:3176] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:24.004762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896233680460251:3176] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:24.004766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896233680460251:3176] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:24.004775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2203 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:24.011699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:24.015617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:24.016065Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:24.016080Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:24.016095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:24.016184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:24.016231Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896237885655439:2575]
2025-09-30T14:56:24.016913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:24.017402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:24.017472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:24.017856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:24.017933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:24.017939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:24.017941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:24.017942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:24.017944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:24.017945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:24.017947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:24.017948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:24.017950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:24.017951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:24.017952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.017953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.017954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.017955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:24.017956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:24.017963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:24.017973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:24.017978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:24.017981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:24.017985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:24.017989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:24.017993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:24.017997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:24.018002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:24.018009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:24.018013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.018017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.018021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.018026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:24.018029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:24.018039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:24.018048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:24.018055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:24.018061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:24.018066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:24.018071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:24.018076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:24.018080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:24.018085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:24.018091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:24.018095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:24.018101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:24.018105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:24.018111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:24.018116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:24.018120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:24.018125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:24.018130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:24.018134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:24.018140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:24.018151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.018157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.018167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.018173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.018178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.018185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.018190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:24.018197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:24.018209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:24.018215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:24.018270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:24.024179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:24.025556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:24.025574Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:24.025577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:24.025581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:24.025588Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2202 [2:7555896237885655439:2575]
2025-09-30T14:56:24.025606Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:24.025623Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:24.025627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:24.025630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:24.025633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:24.025650Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:24.025663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:24.025676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:24.025741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.025748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.025751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.025755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:24.025758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:24.025825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:24.025833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.025848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.025867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.025894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:24.025913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896237975427703:3176], now have 1 active actors on pipe
2025-09-30T14:56:24.025923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896233680460226:2454], now have 1 active actors on pipe
2025-09-30T14:56:24.025930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896237885655434:2575]
2025-09-30T14:56:24.025933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896237885655434:2575]
2025-09-30T14:56:24.025936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896237885655434:2575]
2025-09-30T14:56:24.025949Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:24.025963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:24.025969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:24.025974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:24.025976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:24.025980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:24.025983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:24.026019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896237885655434:2575]
2025-09-30T14:56:24.026027Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:24.026034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:24.026024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2202
2025-09-30T14:56:24.026030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2202
2025-09-30T14:56:24.026260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:24.026270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:24.026300Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd35a9f9-9492ac15-442660b5-6b7dcae9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:24.026313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:24.026323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:24.026325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:24.026336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:24.026346Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:24.026361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:24.026572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:24.026584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:24.026600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:24.026783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2203 partition: 0 MaxSeqNo: 42 sessionId: src_id|bd35a9f9-9492ac15-442660b5-6b7dcae9_0
2025-09-30T14:56:24.027174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb894b2a-eee9f7b2-2d5e8be7-daa3bb14_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bd35a9f9-9492ac15-442660b5-6b7dcae9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:24.030108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd35a9f9-9492ac15-442660b5-6b7dcae9_0] Write session: try to update token
2025-09-30T14:56:24.030128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd35a9f9-9492ac15-442660b5-6b7dcae9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:24.039398Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:24.039421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:24.039424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:24.039425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:24.039436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896237885655434:2575]
2025-09-30T14:56:24.039439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896237885655434:2575]
2025-09-30T14:56:24.039445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896237885655434:2575]
2025-09-30T14:56:24.039486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:24.039493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.039495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:24.039648Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:24.043315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:24.043337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:24.043341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:24.046723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2203 sessionId: src_id|bd35a9f9-9492ac15-442660b5-6b7dcae9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:24.049614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:24.086219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896237975427817:3180]
2025-09-30T14:56:24.086524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2202, pipe: [1:7555896237975427817:3180]
2025-09-30T14:56:24.155003Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:24.155571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:24.155588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:24.155627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896237975427817:3180], now have 1 active actors on pipe
2025-09-30T14:56:24.155925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:24.155946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:24.155967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896237975427817:3180]
2025-09-30T14:56:24.155987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:24.156056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2203 reason: error at write: Disconnected sessionId: src_id|bd35a9f9-9492ac15-442660b5-6b7dcae9_0
2025-09-30T14:56:24.156161Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:24.156256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2203 sessionId: src_id|bd35a9f9-9492ac15-442660b5-6b7dcae9_0 is DEAD
2025-09-30T14:56:24.156429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd35a9f9-9492ac15-442660b5-6b7dcae9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:24.156441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd35a9f9-9492ac15-442660b5-6b7dcae9_0] Write session will restart in 0.006720s
2025-09-30T14:56:24.156466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd35a9f9-9492ac15-442660b5-6b7dcae9_0] Write session: Do CDS request
2025-09-30T14:56:24.156483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd35a9f9-9492ac15-442660b5-6b7dcae9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:24.164869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd35a9f9-9492ac15-442660b5-6b7dcae9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:24.164929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:24.164957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2204
2025-09-30T14:56:24.165142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2204 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:24.165195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2204 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:24.165205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2204 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:24.165209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:24.165671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2204 sessionId:  describe result for acl check
2025-09-30T14:56:24.165719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:24.165726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:24.165729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:24.165735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896237975427844:3183] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:24.166310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896237975427844:3183] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:24.169246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896237975427844:3183] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:24.172462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896237975427844:3183] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:24.172479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896237975427844:3183] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:24.172482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896237975427844:3183] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:24.172490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2204 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:24.179618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:24.182673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:24.182883Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:24.182885Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:24.182894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:24.182936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:24.182962Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896237885655729:2585]
2025-09-30T14:56:24.183587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:24.183985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:24.184060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:24.184452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:24.184526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:24.184535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:24.184537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:24.184538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:24.184539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:24.184541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:24.184542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:24.184543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:24.184544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:24.184546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:24.184547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.184548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.184549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.184550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:24.184551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:24.184557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:24.184567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:24.184572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:24.184577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:24.184582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:24.184587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:24.184591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:24.184594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:24.184598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:24.184604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:24.184608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.184612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.184616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.184620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:24.184624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:24.184633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:24.184641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:24.184648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:24.184654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:24.184659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:24.184666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:24.184671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:24.184676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:24.184686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:24.184692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:24.184697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:24.184713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:24.184718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:24.184724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:24.184728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:24.184733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:24.184737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:24.184742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:24.184746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:24.184751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:24.184756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.184761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.184765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.184770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.184775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.184780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.184785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:24.184790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:24.184794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:24.184800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:24.184851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:24.190834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:24.192460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:24.192482Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:24.192486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:24.192490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:24.192497Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2203 [2:7555896237885655729:2585]
2025-09-30T14:56:24.192515Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:24.192538Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:24.192545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:24.192549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:24.192552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:24.192571Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:24.192587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:24.192593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:24.192662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.192670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.192673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.192678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:24.192681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:24.192755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:24.192763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.192778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.192795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.192817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:24.192858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896237975427819:2454], now have 1 active actors on pipe
2025-09-30T14:56:24.192867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896237975427983:3183], now have 1 active actors on pipe
2025-09-30T14:56:24.192874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896237885655724:2585]
2025-09-30T14:56:24.192883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896237885655724:2585]
2025-09-30T14:56:24.192885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896237885655724:2585]
2025-09-30T14:56:24.192902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:24.192923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:24.192924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:24.192927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:24.192929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:24.192942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:24.192946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:24.192932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2203
2025-09-30T14:56:24.192939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2203
2025-09-30T14:56:24.192983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896237885655724:2585]
2025-09-30T14:56:24.192994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:24.193001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:24.193016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:24.193025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:24.193073Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5bb034d8-5b065d1e-c2e98b6c-dae2b8ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:24.193084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:24.193088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:24.193090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:24.193099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:24.193109Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:24.193132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:24.193304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:24.193318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:24.193350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:24.193427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2204 partition: 0 MaxSeqNo: 42 sessionId: src_id|5bb034d8-5b065d1e-c2e98b6c-dae2b8ea_0
2025-09-30T14:56:24.193804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd35a9f9-9492ac15-442660b5-6b7dcae9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5bb034d8-5b065d1e-c2e98b6c-dae2b8ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:24.196746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bb034d8-5b065d1e-c2e98b6c-dae2b8ea_0] Write session: try to update token
2025-09-30T14:56:24.196769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bb034d8-5b065d1e-c2e98b6c-dae2b8ea_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:24.210395Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:24.210419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:24.210421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:24.210424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:24.210433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896237885655724:2585]
2025-09-30T14:56:24.210438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896237885655724:2585]
2025-09-30T14:56:24.210442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896237885655724:2585]
2025-09-30T14:56:24.210485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:24.210492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.210495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:24.210497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:24.210504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:24.210508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:24.210652Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:24.212540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2204 sessionId: src_id|5bb034d8-5b065d1e-c2e98b6c-dae2b8ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:24.215481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:24.256198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896237975428126:3180]
2025-09-30T14:56:24.256578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2203, pipe: [1:7555896237975428126:3180]
2025-09-30T14:56:24.340846Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:24.341514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:24.341535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:24.341577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896237975428126:3180], now have 1 active actors on pipe
2025-09-30T14:56:24.341817Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:24.341955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:24.342012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:24.342016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:24.342088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2204 reason: error at write: Disconnected sessionId: src_id|5bb034d8-5b065d1e-c2e98b6c-dae2b8ea_0
2025-09-30T14:56:24.342287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2204 sessionId: src_id|5bb034d8-5b065d1e-c2e98b6c-dae2b8ea_0 is DEAD
2025-09-30T14:56:24.342387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896237975428126:3180]
2025-09-30T14:56:24.342566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bb034d8-5b065d1e-c2e98b6c-dae2b8ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:24.342583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bb034d8-5b065d1e-c2e98b6c-dae2b8ea_0] Write session will restart in 0.005817s
2025-09-30T14:56:24.342615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bb034d8-5b065d1e-c2e98b6c-dae2b8ea_0] Write session: Do CDS request
2025-09-30T14:56:24.342626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bb034d8-5b065d1e-c2e98b6c-dae2b8ea_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:24.349907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bb034d8-5b065d1e-c2e98b6c-dae2b8ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:24.350010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:24.350042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2205
2025-09-30T14:56:24.350234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2205 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:24.350315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2205 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:24.350321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2205 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:24.350327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:24.351008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2205 sessionId:  describe result for acl check
2025-09-30T14:56:24.351059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:24.351061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:24.351068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:24.351075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896237975428136:3187] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:24.351787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896237975428136:3187] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:24.354923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896237975428136:3187] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:24.358925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896237975428136:3187] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:24.358949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896237975428136:3187] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:24.358953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896237975428136:3187] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:24.358964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2205 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:24.377098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:24.382264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:24.382587Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:24.382616Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:24.382637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:24.382758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:24.382818Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896237885656020:2583]
2025-09-30T14:56:24.383620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:24.384135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:24.384216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:24.384607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:24.384699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:24.384707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:24.384708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:24.384710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:24.384711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:24.384712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:24.384714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:24.384715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:24.384717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:24.384718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:24.384720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.384722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.384723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.384724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:24.384726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:24.384732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:24.384744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:24.384749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:24.384753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:24.384757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:24.384762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:24.384766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:24.384771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:24.384775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:24.384780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:24.384795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.384799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.384804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.384808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:24.384813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:24.384823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:24.384831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:24.384838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:24.384844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:24.384849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:24.384855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:24.384860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:24.384866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:24.384872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:24.384878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:24.384883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:24.384889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:24.384894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:24.384900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:24.384904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:24.384911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:24.384916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:24.384921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:24.384926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:24.384931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:24.384940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.384946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.384951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.384956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.384962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.384967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.384972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:24.384980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:24.384985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:24.384991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:24.385037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:24.391432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:24.393396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:24.393418Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:24.393421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:24.393426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:24.393435Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2204 [2:7555896237885656020:2583]
2025-09-30T14:56:24.393455Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:24.393475Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:24.393484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:24.393488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:24.393491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:24.393512Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:24.393527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:24.393541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:24.393629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.393637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.393639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.393643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:24.393647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:24.393734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:24.393745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.393763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.393776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.393797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:24.393820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896237975428179:3187], now have 1 active actors on pipe
2025-09-30T14:56:24.393828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896237975428129:2454], now have 1 active actors on pipe
2025-09-30T14:56:24.393835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896237885656015:2583]
2025-09-30T14:56:24.393840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896237885656015:2583]
2025-09-30T14:56:24.393843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896237885656015:2583]
2025-09-30T14:56:24.393858Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:24.393881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:24.393903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:24.393903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:24.393907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:24.393907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:24.393914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:24.393954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896237885656015:2583]
2025-09-30T14:56:24.393966Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:24.393976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:24.394006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2204
2025-09-30T14:56:24.394070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2204
2025-09-30T14:56:24.394262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:24.394275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:24.394314Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b3c0b7d-1154623c-7d86d588-8ec8453a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:24.394329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:24.394336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:24.394339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:24.394352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:24.394365Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:24.394385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:24.394617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:24.394628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:24.394644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:24.394749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2205 partition: 0 MaxSeqNo: 42 sessionId: src_id|3b3c0b7d-1154623c-7d86d588-8ec8453a_0
2025-09-30T14:56:24.395214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bb034d8-5b065d1e-c2e98b6c-dae2b8ea_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3b3c0b7d-1154623c-7d86d588-8ec8453a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:24.398746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b3c0b7d-1154623c-7d86d588-8ec8453a_0] Write session: try to update token
2025-09-30T14:56:24.398774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b3c0b7d-1154623c-7d86d588-8ec8453a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:24.409734Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:24.409760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:24.409771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896237885656015:2583]
2025-09-30T14:56:24.409826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:24.409837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:24.410031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:24.410196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:24.410359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:24.410517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:24.410744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:24.410803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:24.421141Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:24.421170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:24.421172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:24.421173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:24.421185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896237885656015:2583]
2025-09-30T14:56:24.421189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896237885656015:2583]
2025-09-30T14:56:24.421194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896237885656015:2583]
2025-09-30T14:56:24.421237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:24.421244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.421247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:24.421269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:24.421281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:24.421287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:24.421399Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:24.431061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2205 sessionId: src_id|3b3c0b7d-1154623c-7d86d588-8ec8453a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:24.434465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:24.442064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896237975428428:3180]
2025-09-30T14:56:24.442505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2204, pipe: [1:7555896237975428428:3180]
2025-09-30T14:56:24.532668Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:24.533313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:24.533322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:24.533356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896237975428428:3180], now have 1 active actors on pipe
2025-09-30T14:56:24.534608Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:24.534964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896237975428428:3180]
2025-09-30T14:56:24.535011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:24.535061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:24.535094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2205 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3b3c0b7d-1154623c-7d86d588-8ec8453a_0
2025-09-30T14:56:24.535533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b3c0b7d-1154623c-7d86d588-8ec8453a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:24.535298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2205 sessionId: src_id|3b3c0b7d-1154623c-7d86d588-8ec8453a_0 is DEAD
2025-09-30T14:56:24.535553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b3c0b7d-1154623c-7d86d588-8ec8453a_0] Write session will restart in 0.007114s
2025-09-30T14:56:24.535600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b3c0b7d-1154623c-7d86d588-8ec8453a_0] Write session: Do CDS request
2025-09-30T14:56:24.535608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b3c0b7d-1154623c-7d86d588-8ec8453a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:24.544025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b3c0b7d-1154623c-7d86d588-8ec8453a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:24.544047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:24.544067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2206
2025-09-30T14:56:24.544354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2206 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:24.544421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2206 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:24.544428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2206 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:24.544434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:24.545055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2206 sessionId:  describe result for acl check
2025-09-30T14:56:24.545097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:24.545099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:24.545102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:24.545108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896237975428446:3208] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:24.545707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896237975428446:3208] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:24.553174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896237975428446:3208] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:24.559859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896237975428446:3208] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:24.559876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896237975428446:3208] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:24.559880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896237975428446:3208] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:24.559889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2206 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:24.575423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:24.578935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:24.579150Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:24.579154Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:24.579164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:24.579217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:24.579268Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896237885656314:2580]
2025-09-30T14:56:24.579953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:24.580317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:24.580366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:24.580700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:24.580755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:24.580756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:24.580757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:24.580759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:24.580760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:24.580761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:24.580762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:24.580764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:24.580765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:24.580766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:24.580768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.580769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.580770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.580771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:24.580773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:24.580778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:24.580790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:24.580794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:24.580798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:24.580803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:24.580807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:24.580811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:24.580815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:24.580820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:24.580824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:24.580828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.580832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.580837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.580841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:24.580845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:24.580852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:24.580861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:24.580867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:24.580873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:24.580879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:24.580885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:24.580890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:24.580896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:24.580901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:24.580908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:24.580912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:24.580918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:24.580923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:24.580928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:24.580932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:24.580938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:24.580943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:24.580948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:24.580953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:24.580958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:24.580963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.580968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.580973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.580978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.580984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.580989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.580994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:24.580999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:24.581005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:24.581010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:24.581055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:24.588515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:24.589641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:24.589663Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:24.589666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:24.589670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:24.589681Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2205 [2:7555896237885656314:2580]
2025-09-30T14:56:24.589699Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:24.589715Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:24.589719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:24.589722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:24.589725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:24.589741Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:24.589748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:24.589755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:24.589822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.589832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.589834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.589838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:24.589841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:24.589910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:24.589918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.589930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.589949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.589971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:24.589992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896237885656309:2580]
2025-09-30T14:56:24.589999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896237885656309:2580]
2025-09-30T14:56:24.590001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896237885656309:2580]
2025-09-30T14:56:24.590011Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:24.590029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:24.590030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:24.590044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:24.590046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:24.590048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:24.590051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:24.590087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896237885656309:2580]
2025-09-30T14:56:24.590095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:24.590111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:24.590133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896237975428562:3208], now have 1 active actors on pipe
2025-09-30T14:56:24.590136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896237975428431:2454], now have 1 active actors on pipe
2025-09-30T14:56:24.590254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2205
2025-09-30T14:56:24.590295Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2205
2025-09-30T14:56:24.590328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:24.590341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:24.590371Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8bdb938-2acde1cf-7fc91a14-50c6fb69_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:24.590378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:24.590383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:24.590386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:24.590395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:24.590406Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:24.590425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:24.590766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:24.590780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:24.590805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:24.595197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2206 partition: 0 MaxSeqNo: 42 sessionId: src_id|c8bdb938-2acde1cf-7fc91a14-50c6fb69_0
2025-09-30T14:56:24.595713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b3c0b7d-1154623c-7d86d588-8ec8453a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c8bdb938-2acde1cf-7fc91a14-50c6fb69_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:24.599389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8bdb938-2acde1cf-7fc91a14-50c6fb69_0] Write session: try to update token
2025-09-30T14:56:24.599419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8bdb938-2acde1cf-7fc91a14-50c6fb69_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:24.604106Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:24.604130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:24.604133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:24.604136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:24.604148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896237885656309:2580]
2025-09-30T14:56:24.604154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896237885656309:2580]
2025-09-30T14:56:24.604158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896237885656309:2580]
2025-09-30T14:56:24.604209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:24.604218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.604217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:24.604220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:24.604225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:24.604230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:24.604380Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:24.619569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2206 sessionId: src_id|c8bdb938-2acde1cf-7fc91a14-50c6fb69_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:24.622869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:24.635109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896237975428731:3180]
2025-09-30T14:56:24.635534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2205, pipe: [1:7555896237975428731:3180]
2025-09-30T14:56:24.735187Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:24.735532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:24.735550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:24.735569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896237975428731:3180], now have 1 active actors on pipe
2025-09-30T14:56:24.735919Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:24.736637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:24.737083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8bdb938-2acde1cf-7fc91a14-50c6fb69_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:24.737095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8bdb938-2acde1cf-7fc91a14-50c6fb69_0] Write session will restart in 0.007650s
2025-09-30T14:56:24.737120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8bdb938-2acde1cf-7fc91a14-50c6fb69_0] Write session: Do CDS request
2025-09-30T14:56:24.737127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8bdb938-2acde1cf-7fc91a14-50c6fb69_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:24.736730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2206 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c8bdb938-2acde1cf-7fc91a14-50c6fb69_0
2025-09-30T14:56:24.736929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2206 sessionId: src_id|c8bdb938-2acde1cf-7fc91a14-50c6fb69_0 is DEAD
2025-09-30T14:56:24.737138Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:24.737171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896237975428731:3180]
2025-09-30T14:56:24.745800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8bdb938-2acde1cf-7fc91a14-50c6fb69_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:24.747492Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:24.747517Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2207
2025-09-30T14:56:24.751426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2207 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:24.751511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2207 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:24.751520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2207 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:24.751527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:24.752375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2207 sessionId:  describe result for acl check
2025-09-30T14:56:24.752429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:24.752437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:24.752440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:24.752451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896237975428779:3210] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:24.753188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896237975428779:3210] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:24.760355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896237975428779:3210] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:24.766092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896237975428779:3210] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:24.766114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896237975428779:3210] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:24.766118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896237975428779:3210] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:24.766128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2207 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:24.772514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:24.777091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:24.777415Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:24.777430Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:24.777444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:24.777516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:24.777572Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896237885656607:2578]
2025-09-30T14:56:24.778362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:24.778825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:24.778886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:24.779311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:24.779403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:24.779414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:24.779416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:24.779418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:24.779419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:24.779421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:24.779422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:24.779424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:24.779435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:24.779436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:24.779438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.779439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.779441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.779442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:24.779443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:24.779451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:24.779466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:24.779471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:24.779476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:24.779481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:24.779486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:24.779491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:24.779496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:24.779501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:24.779507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:24.779512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.779517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.779522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.779526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:24.779531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:24.779542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:24.779553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:24.779561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:24.779569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:24.779588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:24.779596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:24.779602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:24.779609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:24.779615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:24.779622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:24.779627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:24.779634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:24.779640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:24.779646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:24.779652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:24.779658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:24.779664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:24.779670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:24.779675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:24.779681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:24.779688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.779695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.779700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.779707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.779713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.779719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.779725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:24.779731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:24.779737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:24.779742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:24.779796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:24.786472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:24.787461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:24.787490Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:24.787494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:24.787498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:24.787506Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2206 [2:7555896237885656607:2578]
2025-09-30T14:56:24.787525Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:24.787544Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:24.787547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:24.787551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:24.787553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:24.787572Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:24.787580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:24.787587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:24.787661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.787674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.787677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.787680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:24.787683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:24.787762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:24.787772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.787787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.787806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.787826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:24.787853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896237975428946:3210], now have 1 active actors on pipe
2025-09-30T14:56:24.787864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896237975428737:2454], now have 1 active actors on pipe
2025-09-30T14:56:24.787871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896237885656602:2578]
2025-09-30T14:56:24.787875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896237885656602:2578]
2025-09-30T14:56:24.787877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896237885656602:2578]
2025-09-30T14:56:24.787892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:24.787906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:24.787908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:24.787917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:24.787919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:24.787923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:24.787927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:24.787966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896237885656602:2578]
2025-09-30T14:56:24.787979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:24.787983Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:24.787972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2206
2025-09-30T14:56:24.788000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2206
2025-09-30T14:56:24.788038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:24.788049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:24.788078Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5288452a-628ffec2-d4cbfa1-266f4da0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:24.788092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:24.788096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:24.788099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:24.788109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:24.788121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:24.788144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:24.788303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:24.788313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:24.788328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:24.788463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2207 partition: 0 MaxSeqNo: 42 sessionId: src_id|5288452a-628ffec2-d4cbfa1-266f4da0_0
2025-09-30T14:56:24.788956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8bdb938-2acde1cf-7fc91a14-50c6fb69_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5288452a-628ffec2-d4cbfa1-266f4da0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:24.792169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5288452a-628ffec2-d4cbfa1-266f4da0_0] Write session: try to update token
2025-09-30T14:56:24.792193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5288452a-628ffec2-d4cbfa1-266f4da0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:24.813356Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:24.813378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:24.813389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896237885656602:2578]
2025-09-30T14:56:24.813439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:24.813448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:24.813645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:24.813813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:24.813982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:24.814150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:24.814377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:24.814429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:24.815139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2207 sessionId: src_id|5288452a-628ffec2-d4cbfa1-266f4da0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:24.819566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:24.819883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:24.819911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:24.819949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:24.820134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:24.821654Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:24.821672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:24.821675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:24.821677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:24.821688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896237885656602:2578]
2025-09-30T14:56:24.821693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896237885656602:2578]
2025-09-30T14:56:24.821698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896237885656602:2578]
2025-09-30T14:56:24.821738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:24.821744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.821747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:24.821746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:24.821754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:24.821758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:24.821895Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:24.839381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896237975429037:3180]
2025-09-30T14:56:24.847590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2206, pipe: [1:7555896237975429037:3180]
2025-09-30T14:56:24.942320Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:24.942889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896237975429037:3180], now have 1 active actors on pipe
2025-09-30T14:56:24.952248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:24.952286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:24.952473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:24.952549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:24.952623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:24.952698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:24.953160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:24.953179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:24.953254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:24.953321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:24.953415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:24.953494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:24.953545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:24.953557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:24.953637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:24.953706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:24.953773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:24.953846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:24.953900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:24.953912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:24.953985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:24.954055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:24.954130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:24.954200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:24.954253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:24.954263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:24.954336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:24.954410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:24.954487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:24.954562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:24.954617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:24.954625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:24.954699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:24.954771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:24.954842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:24.954914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:24.954973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:24.954981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:24.955053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:24.955124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:24.955205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:24.955303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:24.955356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:24.955364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:24.955444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:24.955515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:24.955586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:24.955659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:24.955712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:24.955721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:24.955795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:24.955864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:24.955934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:24.956009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:24.956137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:24.956148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:24.956221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:24.956286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:24.956357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:24.956431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:24.956478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:24.956492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:24.956787Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:24.956861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:24.956869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:24.956898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2207 reason: error at write: Disconnected sessionId: src_id|5288452a-628ffec2-d4cbfa1-266f4da0_0
2025-09-30T14:56:24.957117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2207 sessionId: src_id|5288452a-628ffec2-d4cbfa1-266f4da0_0 is DEAD
2025-09-30T14:56:24.957238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5288452a-628ffec2-d4cbfa1-266f4da0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:24.957249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5288452a-628ffec2-d4cbfa1-266f4da0_0] Write session will restart in 0.007127s
2025-09-30T14:56:24.957274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5288452a-628ffec2-d4cbfa1-266f4da0_0] Write session: Do CDS request
2025-09-30T14:56:24.957280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5288452a-628ffec2-d4cbfa1-266f4da0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:24.957399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896237975429037:3180]
2025-09-30T14:56:24.957511Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:24.965854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5288452a-628ffec2-d4cbfa1-266f4da0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:24.966031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:24.966049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2208
2025-09-30T14:56:24.966180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2208 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:24.966209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2208 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:24.966213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2208 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:24.966216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:24.966543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2208 sessionId:  describe result for acl check
2025-09-30T14:56:24.966575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:24.966577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:24.966579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:24.966586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896237975429080:3237] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:24.967083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896237975429080:3237] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:24.970128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896237975429080:3237] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:24.974512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896237975429080:3237] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:24.974532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896237975429080:3237] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:24.974536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896237975429080:3237] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:24.974546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2208 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:24.981663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:24.985152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:24.985582Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:24.985595Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:24.985610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:24.985688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:24.985742Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896237885656953:2551]
2025-09-30T14:56:24.986309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:24.986651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:24.986690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:24.986963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:24.987017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:24.987023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:24.987023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:24.987024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:24.987025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:24.987025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:24.987026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:24.987027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:24.987028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:24.987028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:24.987030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.987030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.987031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.987032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:24.987032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:24.987036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:24.987043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:24.987045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:24.987048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:24.987050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:24.987052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:24.987055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:24.987057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:24.987060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:24.987063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:24.987066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.987068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.987070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.987072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:24.987075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:24.987082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:24.987087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:24.987091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:24.987095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:24.987098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:24.987101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:24.987104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:24.987107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:24.987110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:24.987113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:24.987116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:24.987119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:24.987122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:24.987126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:24.987128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:24.987132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:24.987135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:24.987140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:24.987143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:24.987147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:24.987149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.987153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.987155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.987158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.987160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.987163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.987166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:24.987169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:24.987172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:24.987175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:24.987198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:24.992947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:24.994241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:24.994257Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:24.994259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:24.994263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:24.994270Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2207 [2:7555896237885656953:2551]
2025-09-30T14:56:24.994284Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:24.994300Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:24.994303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:24.994307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:24.994309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:24.994324Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:24.994331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:24.994337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:24.994406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.994414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.994416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.994420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:24.994423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:24.994493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:24.994501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:24.994513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:24.994527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:24.994547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:24.994573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896237975429063:2454], now have 1 active actors on pipe
2025-09-30T14:56:24.994576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896237975429236:3237], now have 1 active actors on pipe
2025-09-30T14:56:24.994584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896237885656948:2551]
2025-09-30T14:56:24.994587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896237885656948:2551]
2025-09-30T14:56:24.994589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896237885656948:2551]
2025-09-30T14:56:24.994606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:24.994625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:24.994640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:24.994647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:24.994685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896237885656948:2551]
2025-09-30T14:56:24.994692Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:24.994677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2207
2025-09-30T14:56:24.994718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2207
2025-09-30T14:56:24.994751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:24.994758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:24.994761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:24.994766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:24.995197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2208 partition: 0 MaxSeqNo: 42 sessionId: src_id|61cd1401-67ee5058-4276ebc1-726d1a03_0
2025-09-30T14:56:24.994838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:24.994853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:24.994886Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61cd1401-67ee5058-4276ebc1-726d1a03_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:24.994895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:24.994899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:24.994902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:24.994915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:24.994937Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:24.994956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:24.995075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:24.995080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:24.995096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:24.995612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5288452a-628ffec2-d4cbfa1-266f4da0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|61cd1401-67ee5058-4276ebc1-726d1a03_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:24.999339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61cd1401-67ee5058-4276ebc1-726d1a03_0] Write session: try to update token
2025-09-30T14:56:24.999363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61cd1401-67ee5058-4276ebc1-726d1a03_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:25.007344Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:25.007365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:25.007376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896237885656948:2551]
2025-09-30T14:56:25.007423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:25.007430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:25.007614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:25.007774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:25.007932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:25.008090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:25.008313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:25.008362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:25.016420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2208 sessionId: src_id|61cd1401-67ee5058-4276ebc1-726d1a03_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:25.019179Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:25.019204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:25.019206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:25.019208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:25.019218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896237885656948:2551]
2025-09-30T14:56:25.019222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896237885656948:2551]
2025-09-30T14:56:25.019228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896237885656948:2551]
2025-09-30T14:56:25.019287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:25.019294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.019297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:25.019300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:25.019307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:25.019311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:25.019323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:25.019440Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:25.057497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896242270396671:3180]
2025-09-30T14:56:25.057862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2207, pipe: [1:7555896242270396671:3180]
2025-09-30T14:56:25.132906Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:25.133483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:25.133500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:25.133523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896242270396671:3180], now have 1 active actors on pipe
2025-09-30T14:56:25.133783Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:25.134427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61cd1401-67ee5058-4276ebc1-726d1a03_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:25.134454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61cd1401-67ee5058-4276ebc1-726d1a03_0] Write session will restart in 0.008939s
2025-09-30T14:56:25.134481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61cd1401-67ee5058-4276ebc1-726d1a03_0] Write session: Do CDS request
2025-09-30T14:56:25.134487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61cd1401-67ee5058-4276ebc1-726d1a03_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:25.133813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896242270396671:3180]
2025-09-30T14:56:25.133818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:25.133852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:25.133942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2208 reason: status is not ok: tablet will be restarted right now sessionId: src_id|61cd1401-67ee5058-4276ebc1-726d1a03_0
2025-09-30T14:56:25.134148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2208 sessionId: src_id|61cd1401-67ee5058-4276ebc1-726d1a03_0 is DEAD
2025-09-30T14:56:25.144935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61cd1401-67ee5058-4276ebc1-726d1a03_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:25.145057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:25.145076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2209
2025-09-30T14:56:25.147518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2209 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:25.147571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2209 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:25.147582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2209 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:25.147587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:25.148117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2209 sessionId:  describe result for acl check
2025-09-30T14:56:25.148154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:25.148156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:25.148158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:25.148164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896242270396729:3245] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:25.148709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896242270396729:3245] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:25.151512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896242270396729:3245] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:25.155550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896242270396729:3245] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:25.155569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896242270396729:3245] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:25.155573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896242270396729:3245] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:25.155582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2209 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:25.159408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:25.162986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:25.163231Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:25.163282Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:25.163303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:25.163377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:25.163428Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896242180624544:2542]
2025-09-30T14:56:25.164070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:25.164423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:25.164485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:25.164865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:25.164937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:25.164944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:25.164945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:25.164946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:25.164948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:25.164949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:25.164950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:25.164952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:25.164953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:25.164954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:25.164955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.164956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:25.164958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:25.164959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:25.164960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:25.164965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:25.164976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:25.164981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:25.164985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:25.164989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:25.164994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:25.164998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:25.165002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:25.165005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:25.165009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:25.165014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.165018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:25.165022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:25.165026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:25.165030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:25.165042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:25.165051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:25.165057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:25.165063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:25.165068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:25.165074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:25.165078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:25.165084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:25.165089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:25.165094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:25.165099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:25.165104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:25.165112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:25.165127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:25.165133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:25.165139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:25.165144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:25.165150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:25.165154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:25.165159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:25.165163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.165175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.165179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:25.165184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:25.165188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:25.165194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:25.165204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:25.165210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:25.165219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:25.165224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:25.165269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:25.171073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:25.172575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:25.172601Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:25.172606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:25.172611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:25.172620Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2208 [2:7555896242180624544:2542]
2025-09-30T14:56:25.172639Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:25.172659Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:25.172668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:25.172671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:25.172674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:25.172691Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:25.172697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:25.172704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:25.172770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.172780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:25.172783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:25.172787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:25.172790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:25.172862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:25.172870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.172885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:25.172898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:25.172920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:25.172943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896242270396913:3245], now have 1 active actors on pipe
2025-09-30T14:56:25.172955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896242270396673:2454], now have 1 active actors on pipe
2025-09-30T14:56:25.172961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896242180624539:2542]
2025-09-30T14:56:25.172964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896242180624539:2542]
2025-09-30T14:56:25.172967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896242180624539:2542]
2025-09-30T14:56:25.172982Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:25.172993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:25.172962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2208
2025-09-30T14:56:25.172996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:25.172972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2208
2025-09-30T14:56:25.172996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:25.172998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:25.173010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:25.173013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:25.173067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:25.173075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:25.173091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896242180624539:2542]
2025-09-30T14:56:25.173102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:25.173108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:25.173134Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c456f20-6dbd0600-1fc29dd0-c7f4ab4b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:25.173146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:25.173150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:25.173152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:25.173162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:25.173169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:25.173578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:25.173782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:25.173799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:25.173824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:25.173908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2209 partition: 0 MaxSeqNo: 42 sessionId: src_id|c456f20-6dbd0600-1fc29dd0-c7f4ab4b_0
2025-09-30T14:56:25.174424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61cd1401-67ee5058-4276ebc1-726d1a03_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c456f20-6dbd0600-1fc29dd0-c7f4ab4b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:25.177878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c456f20-6dbd0600-1fc29dd0-c7f4ab4b_0] Write session: try to update token
2025-09-30T14:56:25.177903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c456f20-6dbd0600-1fc29dd0-c7f4ab4b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:25.186063Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:25.186083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:25.186085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:25.186087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:25.186096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896242180624539:2542]
2025-09-30T14:56:25.186101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896242180624539:2542]
2025-09-30T14:56:25.186106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896242180624539:2542]
2025-09-30T14:56:25.186152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:25.186156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:25.186163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:25.186163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.186166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:25.186167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:25.186316Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:25.207515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2209 sessionId: src_id|c456f20-6dbd0600-1fc29dd0-c7f4ab4b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:25.210800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:25.235061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896242270396982:3180]
2025-09-30T14:56:25.235459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2208, pipe: [1:7555896242270396982:3180]
2025-09-30T14:56:25.307428Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:25.307781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:25.307790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:25.307811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896242270396982:3180], now have 1 active actors on pipe
2025-09-30T14:56:25.310196Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:25.311240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c456f20-6dbd0600-1fc29dd0-c7f4ab4b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:25.311273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c456f20-6dbd0600-1fc29dd0-c7f4ab4b_0] Write session will restart in 0.005310s
2025-09-30T14:56:25.311300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c456f20-6dbd0600-1fc29dd0-c7f4ab4b_0] Write session: Do CDS request
2025-09-30T14:56:25.311306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c456f20-6dbd0600-1fc29dd0-c7f4ab4b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:25.310612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:25.310760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2209 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c456f20-6dbd0600-1fc29dd0-c7f4ab4b_0
2025-09-30T14:56:25.310992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2209 sessionId: src_id|c456f20-6dbd0600-1fc29dd0-c7f4ab4b_0 is DEAD
2025-09-30T14:56:25.311230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896242270396982:3180]
2025-09-30T14:56:25.311352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:25.317839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c456f20-6dbd0600-1fc29dd0-c7f4ab4b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:25.318167Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:25.318194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2210
2025-09-30T14:56:25.318432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2210 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:25.318477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2210 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:25.318484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2210 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:25.318490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:25.319040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2210 sessionId:  describe result for acl check
2025-09-30T14:56:25.319075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:25.319078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:25.319080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:25.319087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896242270396994:3261] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:25.319770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896242270396994:3261] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:25.322706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896242270396994:3261] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:25.326171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896242270396994:3261] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:25.326193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896242270396994:3261] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:25.326198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896242270396994:3261] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:25.326208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2210 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:25.350043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:25.354910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:25.355388Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:25.355401Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:25.355415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:25.355492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:25.355539Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896242180624840:2540]
2025-09-30T14:56:25.356273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:25.356827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:25.356883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:25.357262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:25.357347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:25.357354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:25.357355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:25.357357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:25.357358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:25.357360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:25.357361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:25.357363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:25.357365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:25.357366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:25.357367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.357369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:25.357370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:25.357372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:25.357373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:25.357380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:25.357393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:25.357397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:25.357414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:25.357419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:25.357423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:25.357428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:25.357433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:25.357437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:25.357442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:25.357447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.357451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:25.357456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:25.357460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:25.357464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:25.357476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:25.357486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:25.357493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:25.357500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:25.357506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:25.357513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:25.357518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:25.357524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:25.357542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:25.357549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:25.357553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:25.357560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:25.357568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:25.357574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:25.357579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:25.357585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:25.357593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:25.357599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:25.357604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:25.357610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:25.357615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.357625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.357635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:25.357641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:25.357651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:25.357661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:25.357670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:25.357678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:25.357682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:25.357687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:25.357736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:25.367038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:25.368025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:25.368049Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:25.368054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:25.368057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:25.368065Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2209 [2:7555896242180624840:2540]
2025-09-30T14:56:25.368085Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:25.368104Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:25.368107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:25.368111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:25.368113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:25.368131Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:25.368145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:25.368152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:25.368231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.368239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:25.368242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:25.368246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:25.368248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:25.368328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:25.368335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.368348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:25.368363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:25.368384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:25.368401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896242180624835:2540]
2025-09-30T14:56:25.368409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896242180624835:2540]
2025-09-30T14:56:25.368411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896242180624835:2540]
2025-09-30T14:56:25.368421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:25.368441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:25.368443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:25.368450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:25.368453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:25.368459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:25.368462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:25.368473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896242270397037:3261], now have 1 active actors on pipe
2025-09-30T14:56:25.368478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896242270396986:2454], now have 1 active actors on pipe
2025-09-30T14:56:25.368517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896242180624835:2540]
2025-09-30T14:56:25.368530Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:25.368573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:25.369167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2209
2025-09-30T14:56:25.369211Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2209
2025-09-30T14:56:25.369770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:25.369792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:25.369832Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11ead838-c828f054-197c02e1-5e078061_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:25.369849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:25.369859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:25.369863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:25.369877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:25.369894Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:25.369935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:25.370244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:25.370255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:25.370274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:25.370396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2210 partition: 0 MaxSeqNo: 42 sessionId: src_id|11ead838-c828f054-197c02e1-5e078061_0
2025-09-30T14:56:25.370811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c456f20-6dbd0600-1fc29dd0-c7f4ab4b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|11ead838-c828f054-197c02e1-5e078061_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:25.374074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11ead838-c828f054-197c02e1-5e078061_0] Write session: try to update token
2025-09-30T14:56:25.374096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11ead838-c828f054-197c02e1-5e078061_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:25.388986Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:25.389013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:25.389025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896242180624835:2540]
2025-09-30T14:56:25.389080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:25.389283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:25.389458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:25.389614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:25.389764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:25.389979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:25.390025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:25.391336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:25.402136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2210 sessionId: src_id|11ead838-c828f054-197c02e1-5e078061_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:25.405496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:25.406389Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:25.406418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:25.406421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:25.406424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:25.406436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896242180624835:2540]
2025-09-30T14:56:25.406441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896242180624835:2540]
2025-09-30T14:56:25.406445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896242180624835:2540]
2025-09-30T14:56:25.406497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:25.406513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.406516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:25.406692Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:25.408265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:25.408287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:25.408293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:25.411261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896242270397292:3180]
2025-09-30T14:56:25.411619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2209, pipe: [1:7555896242270397292:3180]
2025-09-30T14:56:25.530542Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:25.531163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:25.531182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:25.531205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896242270397292:3180], now have 1 active actors on pipe
2025-09-30T14:56:25.531487Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:25.532046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11ead838-c828f054-197c02e1-5e078061_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:25.532059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11ead838-c828f054-197c02e1-5e078061_0] Write session will restart in 0.008235s
2025-09-30T14:56:25.532084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11ead838-c828f054-197c02e1-5e078061_0] Write session: Do CDS request
2025-09-30T14:56:25.532089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11ead838-c828f054-197c02e1-5e078061_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:25.531522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896242270397292:3180]
2025-09-30T14:56:25.531525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:25.531531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:25.531573Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:25.531626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2210 reason: error at write: Disconnected sessionId: src_id|11ead838-c828f054-197c02e1-5e078061_0
2025-09-30T14:56:25.531843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2210 sessionId: src_id|11ead838-c828f054-197c02e1-5e078061_0 is DEAD
2025-09-30T14:56:25.543542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11ead838-c828f054-197c02e1-5e078061_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:25.544556Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:25.544581Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2211
2025-09-30T14:56:25.544759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2211 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:25.544800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2211 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:25.544808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2211 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:25.544817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:25.545311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2211 sessionId:  describe result for acl check
2025-09-30T14:56:25.545360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:25.545363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:25.545365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:25.545371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896242270397323:3264] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:25.546013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896242270397323:3264] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:25.550049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896242270397323:3264] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:25.556885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896242270397323:3264] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:25.556908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896242270397323:3264] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:25.556912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896242270397323:3264] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:25.556924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2211 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:25.565563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:25.570946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:25.571289Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:25.571303Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:25.571318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:25.571386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:25.571440Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896242180625139:2532]
2025-09-30T14:56:25.572264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:25.572734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:25.572787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:25.573172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:25.573250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:25.573259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:25.573261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:25.573263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:25.573265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:25.573267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:25.573268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:25.573270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:25.573271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:25.573272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:25.573274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.573275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:25.573276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:25.573278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:25.573279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:25.573286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:25.573299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:25.573305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:25.573310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:25.573315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:25.573320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:25.573325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:25.573330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:25.573347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:25.573353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:25.573358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.573363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:25.573368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:25.573373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:25.573377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:25.573388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:25.573397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:25.573405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:25.573412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:25.573418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:25.573425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:25.573431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:25.573438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:25.573446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:25.573453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:25.573459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:25.573466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:25.573472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:25.573478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:25.573484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:25.573490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:25.573496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:25.573501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:25.573509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:25.573515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:25.573521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.573528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.573533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:25.573553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:25.573559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:25.573565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:25.573571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:25.573577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:25.573583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:25.573590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:25.573647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:25.580718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:25.582520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:25.582543Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:25.582546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:25.582550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:25.582558Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2210 [2:7555896242180625139:2532]
2025-09-30T14:56:25.582578Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:25.582599Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:25.582603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:25.582606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:25.582609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:25.582631Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:25.582640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:25.582649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:25.582742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.582750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:25.582753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:25.582756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:25.582760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:25.582850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:25.582865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.583072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2210
2025-09-30T14:56:25.582881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:25.582892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:25.582909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:25.582932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896242180625134:2532]
2025-09-30T14:56:25.582935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896242180625134:2532]
2025-09-30T14:56:25.582937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896242180625134:2532]
2025-09-30T14:56:25.582950Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:25.582969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896242270397478:3264], now have 1 active actors on pipe
2025-09-30T14:56:25.582974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896242270397295:2454], now have 1 active actors on pipe
2025-09-30T14:56:25.582974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:25.582977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:25.582980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:25.582984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:25.583003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:25.583007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:25.583052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896242180625134:2532]
2025-09-30T14:56:25.583063Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:25.583070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:25.583189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:25.583198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:25.583238Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|260fe321-10b855-f96e9ceb-bf6e35cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:25.583266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:25.583271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:25.583274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:25.583293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:25.583315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:25.583342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:25.583348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2210
2025-09-30T14:56:25.583549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:25.583560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:25.583579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:25.583706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2211 partition: 0 MaxSeqNo: 42 sessionId: src_id|260fe321-10b855-f96e9ceb-bf6e35cd_0
2025-09-30T14:56:25.584121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11ead838-c828f054-197c02e1-5e078061_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|260fe321-10b855-f96e9ceb-bf6e35cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:25.587204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|260fe321-10b855-f96e9ceb-bf6e35cd_0] Write session: try to update token
2025-09-30T14:56:25.587233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|260fe321-10b855-f96e9ceb-bf6e35cd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:25.605156Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:25.605185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:25.605188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:25.605190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:25.605206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896242180625134:2532]
2025-09-30T14:56:25.605212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896242180625134:2532]
2025-09-30T14:56:25.605216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896242180625134:2532]
2025-09-30T14:56:25.605260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:25.605268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.605271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:25.605282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:25.605290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:25.605295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:25.605451Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:25.606324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2211 sessionId: src_id|260fe321-10b855-f96e9ceb-bf6e35cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:25.609564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:25.631945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896242270397600:3180]
2025-09-30T14:56:25.632291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2210, pipe: [1:7555896242270397600:3180]
2025-09-30T14:56:25.721467Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:25.721963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:25.721988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:25.722026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896242270397600:3180], now have 1 active actors on pipe
2025-09-30T14:56:25.722277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:25.722294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:25.722296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:25.722352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896242270397600:3180]
2025-09-30T14:56:25.722392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2211 reason: error at write: Disconnected sessionId: src_id|260fe321-10b855-f96e9ceb-bf6e35cd_0
2025-09-30T14:56:25.722481Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:25.722565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2211 sessionId: src_id|260fe321-10b855-f96e9ceb-bf6e35cd_0 is DEAD
2025-09-30T14:56:25.722726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|260fe321-10b855-f96e9ceb-bf6e35cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:25.722736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|260fe321-10b855-f96e9ceb-bf6e35cd_0] Write session will restart in 0.008522s
2025-09-30T14:56:25.722760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|260fe321-10b855-f96e9ceb-bf6e35cd_0] Write session: Do CDS request
2025-09-30T14:56:25.722770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|260fe321-10b855-f96e9ceb-bf6e35cd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:25.734760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|260fe321-10b855-f96e9ceb-bf6e35cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:25.734892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:25.734913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2212
2025-09-30T14:56:25.735049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2212 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:25.735085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2212 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:25.735095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2212 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:25.735099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:25.735666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2212 sessionId:  describe result for acl check
2025-09-30T14:56:25.735713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:25.735722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:25.735724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:25.735731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896242270397660:3276] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:25.736348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896242270397660:3276] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:25.738926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896242270397660:3276] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:25.742371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896242270397660:3276] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:25.742392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896242270397660:3276] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:25.742396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896242270397660:3276] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:25.742405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2212 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:25.746808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:25.750604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:25.750835Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:25.750846Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:25.750858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:25.750918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:25.750962Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896242180625437:2518]
2025-09-30T14:56:25.751712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:25.752044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:25.752095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:25.752448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:25.752514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:25.752523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:25.752524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:25.752526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:25.752527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:25.752528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:25.752530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:25.752532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:25.752533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:25.752535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:25.752536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.752538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:25.752539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:25.752540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:25.752542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:25.752549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:25.752561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:25.752565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:25.752570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:25.752575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:25.752580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:25.752584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:25.752589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:25.752593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:25.752599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:25.752603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.752608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:25.752612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:25.752617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:25.752622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:25.752630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:25.752639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:25.752645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:25.752652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:25.752658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:25.752664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:25.752669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:25.752674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:25.752679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:25.752684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:25.752689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:25.752695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:25.752701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:25.752706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:25.752711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:25.752717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:25.752723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:25.752729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:25.752734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:25.752740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:25.752746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.752758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.752763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:25.752774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:25.752780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:25.752790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:25.752796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:25.752807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:25.752814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:25.752835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:25.752894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:25.758745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:25.759834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:25.759852Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:25.759855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:25.759859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:25.759866Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2211 [2:7555896242180625437:2518]
2025-09-30T14:56:25.759885Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:25.759901Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:25.759910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:25.759913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:25.759916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:25.759932Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:25.759941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:25.759949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:25.760013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.760020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:25.760023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:25.760027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:25.760030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:25.760225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2211
2025-09-30T14:56:25.760279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2211
2025-09-30T14:56:25.760531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:25.760543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.760558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:25.760572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:25.760595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:25.760617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896242270397829:3276], now have 1 active actors on pipe
2025-09-30T14:56:25.760627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896242270397605:2454], now have 1 active actors on pipe
2025-09-30T14:56:25.760643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:25.760655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:25.760675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896242180625432:2518]
2025-09-30T14:56:25.760677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896242180625432:2518]
2025-09-30T14:56:25.760682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896242180625432:2518]
2025-09-30T14:56:25.760694Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:25.760709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:25.760712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:25.760716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:25.760718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:25.760724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:25.760727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:25.760745Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea21441f-4b3ba7b3-13b942d-483631bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:25.760751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:25.760755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:25.760757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:25.760765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:25.760776Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:25.760811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896242180625432:2518]
2025-09-30T14:56:25.760821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:25.760832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:25.760840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:25.761013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:25.761029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:25.761062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:25.761174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2212 partition: 0 MaxSeqNo: 42 sessionId: src_id|ea21441f-4b3ba7b3-13b942d-483631bd_0
2025-09-30T14:56:25.761620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|260fe321-10b855-f96e9ceb-bf6e35cd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ea21441f-4b3ba7b3-13b942d-483631bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:25.764692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea21441f-4b3ba7b3-13b942d-483631bd_0] Write session: try to update token
2025-09-30T14:56:25.764715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea21441f-4b3ba7b3-13b942d-483631bd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:25.776295Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:25.776322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:25.776333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896242180625432:2518]
2025-09-30T14:56:25.776384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:25.776383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:25.776604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:25.776768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:25.776917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:25.777097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:25.777351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:25.777399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:25.780288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2212 sessionId: src_id|ea21441f-4b3ba7b3-13b942d-483631bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:25.783034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:25.784045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:25.784075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:25.784113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:25.784231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:25.787995Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:25.788017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:25.788020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:25.788022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:25.788032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896242180625432:2518]
2025-09-30T14:56:25.788037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896242180625432:2518]
2025-09-30T14:56:25.788042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896242180625432:2518]
2025-09-30T14:56:25.788087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:25.788095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:25.788101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.788101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:25.788104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:25.788105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:25.788268Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:25.822414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896242270397911:3180]
2025-09-30T14:56:25.822753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2211, pipe: [1:7555896242270397911:3180]
2025-09-30T14:56:25.910775Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:25.919639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:25.919670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:25.919857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:25.919938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:25.920015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:25.920089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:25.920141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:25.920152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:25.920228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:25.920302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:25.920376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:25.920454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:25.920740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:25.920752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:25.920830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:25.920901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:25.920973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:25.921044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:25.921095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:25.921103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:25.921174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:25.921249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:25.921322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:25.921408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:25.921458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:25.921466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:25.921538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:25.921608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:25.921705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:25.921781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:25.921830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:25.921838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:25.921912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:25.921982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:25.922053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:25.922123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:25.922173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:25.922182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:25.922256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:25.922324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:25.922405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:25.922484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:25.922533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:25.922542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:25.922617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:25.922686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:25.922761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:25.922835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:25.922886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:25.922896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:25.922970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:25.923040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:25.923112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:25.923184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:25.923234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:25.923236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:25.923326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:25.923404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:25.923478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:25.923551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:25.923601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:25.923611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:25.923665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896242270397911:3180], now have 1 active actors on pipe
2025-09-30T14:56:25.923987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:25.924005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:25.924032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2212 reason: error at write: Disconnected sessionId: src_id|ea21441f-4b3ba7b3-13b942d-483631bd_0
2025-09-30T14:56:25.924284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2212 sessionId: src_id|ea21441f-4b3ba7b3-13b942d-483631bd_0 is DEAD
2025-09-30T14:56:25.924347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea21441f-4b3ba7b3-13b942d-483631bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:25.924357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea21441f-4b3ba7b3-13b942d-483631bd_0] Write session will restart in 0.005217s
2025-09-30T14:56:25.924399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea21441f-4b3ba7b3-13b942d-483631bd_0] Write session: Do CDS request
2025-09-30T14:56:25.924405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea21441f-4b3ba7b3-13b942d-483631bd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:25.924523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:25.924567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896242270397911:3180]
2025-09-30T14:56:25.924549Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:25.930758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea21441f-4b3ba7b3-13b942d-483631bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:25.930827Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:25.930861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2213
2025-09-30T14:56:25.930995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2213 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:25.931031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2213 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:25.931040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2213 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:25.931044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:25.931444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2213 sessionId:  describe result for acl check
2025-09-30T14:56:25.931645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:25.931654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:25.931656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:25.931661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896242270397940:3290] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:25.932173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896242270397940:3290] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:25.935141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896242270397940:3290] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:25.939084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896242270397940:3290] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:25.939104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896242270397940:3290] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:25.939108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896242270397940:3290] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:25.939115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2213 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:25.948574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:25.952349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:25.952607Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:25.952617Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:25.952630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:25.952685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:25.952725Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896242180625763:2520]
2025-09-30T14:56:25.953423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:25.953773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:25.953822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:25.954159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:25.954222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:25.954228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:25.954230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:25.954231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:25.954232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:25.954234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:25.954235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:25.954236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:25.954238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:25.954239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:25.954240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.954242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:25.954243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:25.954244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:25.954245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:25.954251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:25.954262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:25.954267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:25.954271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:25.954276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:25.954280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:25.954285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:25.954289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:25.954293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:25.954298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:25.954303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.954308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:25.954312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:25.954316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:25.954321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:25.954328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:25.954336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:25.954343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:25.954349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:25.954353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:25.954359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:25.954365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:25.954370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:25.954375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:25.954386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:25.954390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:25.954396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:25.954406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:25.954412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:25.954416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:25.954422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:25.954427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:25.954433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:25.954437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:25.954444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:25.954454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.954461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.954466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:25.954475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:25.954481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:25.954491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:25.954495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:25.954500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:25.954510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:25.954516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:25.954585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:25.960268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:25.961484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:25.961502Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:25.961505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:25.961510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:25.961515Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2212 [2:7555896242180625763:2520]
2025-09-30T14:56:25.961532Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:25.961547Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:25.961550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:25.961553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:25.961556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:25.961571Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:25.961579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:25.961591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:25.961662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.961670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:25.961672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:25.961675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:25.961677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:25.961745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:25.961752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.961764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:25.961781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:25.961803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:25.961827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896242270398048:3290], now have 1 active actors on pipe
2025-09-30T14:56:25.961835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896242270397918:2454], now have 1 active actors on pipe
2025-09-30T14:56:25.961842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896242180625758:2520]
2025-09-30T14:56:25.961845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896242180625758:2520]
2025-09-30T14:56:25.961847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896242180625758:2520]
2025-09-30T14:56:25.961861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:25.961875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:25.961889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:25.961891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:25.961899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:25.961905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:25.961907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:25.961925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896242180625758:2520]
2025-09-30T14:56:25.961927Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:25.961931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:25.961973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2212
2025-09-30T14:56:25.962017Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2212
2025-09-30T14:56:25.962132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:25.962151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:25.962187Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|498d5e5-3cb9856-5626e1b6-cb5522a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:25.962202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:25.962211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:25.962214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:25.962226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:25.962244Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:25.962267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:25.962423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:25.962431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:25.962446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:25.962559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2213 partition: 0 MaxSeqNo: 42 sessionId: src_id|498d5e5-3cb9856-5626e1b6-cb5522a1_0
2025-09-30T14:56:25.962914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea21441f-4b3ba7b3-13b942d-483631bd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|498d5e5-3cb9856-5626e1b6-cb5522a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:25.965741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|498d5e5-3cb9856-5626e1b6-cb5522a1_0] Write session: try to update token
2025-09-30T14:56:25.965759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|498d5e5-3cb9856-5626e1b6-cb5522a1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:25.974284Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:25.974306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:25.974312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896242180625758:2520]
2025-09-30T14:56:25.974351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:25.974359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:25.974529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:25.974675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:25.974803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:25.974931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:25.975398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:25.975439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:25.983085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2213 sessionId: src_id|498d5e5-3cb9856-5626e1b6-cb5522a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:25.985758Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:25.985788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:25.985791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:25.985793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:25.985804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896242180625758:2520]
2025-09-30T14:56:25.985812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896242180625758:2520]
2025-09-30T14:56:25.985816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896242180625758:2520]
2025-09-30T14:56:25.985863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:25.985872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:25.985876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:25.985878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:25.985884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:25.985888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:25.986042Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:25.986119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:26.024618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896246565365552:3180]
2025-09-30T14:56:26.024890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2212, pipe: [1:7555896246565365552:3180]
2025-09-30T14:56:26.107585Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:26.108111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:26.108134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:26.108157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896246565365552:3180], now have 1 active actors on pipe
2025-09-30T14:56:26.108444Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:26.108550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:26.108566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:26.108638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2213 reason: error at write: Disconnected sessionId: src_id|498d5e5-3cb9856-5626e1b6-cb5522a1_0
2025-09-30T14:56:26.108816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2213 sessionId: src_id|498d5e5-3cb9856-5626e1b6-cb5522a1_0 is DEAD
2025-09-30T14:56:26.108984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|498d5e5-3cb9856-5626e1b6-cb5522a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:26.108995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|498d5e5-3cb9856-5626e1b6-cb5522a1_0] Write session will restart in 0.009283s
2025-09-30T14:56:26.109013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896246565365552:3180]
2025-09-30T14:56:26.109097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|498d5e5-3cb9856-5626e1b6-cb5522a1_0] Write session: Do CDS request
2025-09-30T14:56:26.109105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|498d5e5-3cb9856-5626e1b6-cb5522a1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:26.109241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:26.119809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|498d5e5-3cb9856-5626e1b6-cb5522a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:26.120903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:26.120926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2214
2025-09-30T14:56:26.121075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2214 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:26.121110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2214 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:26.121122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2214 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:26.121126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:26.121662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2214 sessionId:  describe result for acl check
2025-09-30T14:56:26.121697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:26.121704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:26.121706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:26.121712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896246565365619:3305] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:26.122247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896246565365619:3305] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:26.125040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896246565365619:3305] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:26.131396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896246565365619:3305] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:26.131416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896246565365619:3305] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:26.131420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896246565365619:3305] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:26.131429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2214 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:26.132708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:26.136284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:26.136550Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:26.136560Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:26.136571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:26.136628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:26.136663Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896246475593382:2494]
2025-09-30T14:56:26.137136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:26.137528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:26.137586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:26.137961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:26.138052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:26.138059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:26.138060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:26.138061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:26.138063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:26.138064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:26.138065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:26.138066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:26.138067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:26.138068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:26.138070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.138071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:26.138072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:26.138073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:26.138075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:26.138081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:26.138091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:26.138095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:26.138099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:26.138103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:26.138108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:26.138112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:26.138116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:26.138120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:26.138127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:26.138131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.138135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:26.138139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:26.138143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:26.138145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:26.138152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:26.138158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:26.138164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:26.138170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:26.138175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:26.138179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:26.138183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:26.138188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:26.138193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:26.138198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:26.138202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:26.138208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:26.138212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:26.138219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:26.138223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:26.138229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:26.138234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:26.138239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:26.138244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:26.138249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:26.138253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.138258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.138262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:26.138266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:26.138271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:26.138275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:26.138279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:26.138285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:26.138290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:26.138305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:26.138355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:26.143983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:26.144831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:26.144850Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:26.144854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:26.144858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:26.144865Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2213 [2:7555896246475593382:2494]
2025-09-30T14:56:26.144882Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:26.144897Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:26.144900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:26.144903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:26.144906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:26.144920Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:26.144927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:26.144935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:26.144996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.144999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:26.145001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:26.145004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:26.145007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:26.145079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:26.145082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.145095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:26.145107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:26.145125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:26.145144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896246565365556:2454], now have 1 active actors on pipe
2025-09-30T14:56:26.145148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896246565365850:3305], now have 1 active actors on pipe
2025-09-30T14:56:26.145155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896246475593377:2494]
2025-09-30T14:56:26.145158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896246475593377:2494]
2025-09-30T14:56:26.145160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896246475593377:2494]
2025-09-30T14:56:26.145173Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:26.145186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:26.145200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:26.145202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:26.145205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:26.145205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:26.145211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:26.145237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896246475593377:2494]
2025-09-30T14:56:26.145240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:26.145251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:26.145284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:26.145289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:26.145317Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24038c9a-b2413e15-817506a9-8ff7bdb5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:26.145324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:26.145328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:26.145346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:26.145357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:26.145367Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:26.145383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:26.145528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:26.145535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:26.145556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:26.146032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|498d5e5-3cb9856-5626e1b6-cb5522a1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|24038c9a-b2413e15-817506a9-8ff7bdb5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:26.145217Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2213
2025-09-30T14:56:26.145254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2213
2025-09-30T14:56:26.145655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2214 partition: 0 MaxSeqNo: 42 sessionId: src_id|24038c9a-b2413e15-817506a9-8ff7bdb5_0
2025-09-30T14:56:26.149060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24038c9a-b2413e15-817506a9-8ff7bdb5_0] Write session: try to update token
2025-09-30T14:56:26.149080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24038c9a-b2413e15-817506a9-8ff7bdb5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:26.164738Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:26.164762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:26.164773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896246475593377:2494]
2025-09-30T14:56:26.164830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:26.164843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:26.165021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:26.165191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:26.165374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2214 sessionId: src_id|24038c9a-b2413e15-817506a9-8ff7bdb5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:26.165882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:26.166038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:26.166254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:26.166302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:26.168223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:26.168479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:26.168500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:26.168532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:26.168597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:26.169825Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:26.169841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:26.169844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:26.169846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:26.169855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896246475593377:2494]
2025-09-30T14:56:26.169859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896246475593377:2494]
2025-09-30T14:56:26.169864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896246475593377:2494]
2025-09-30T14:56:26.169898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:26.169904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.169906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:26.169923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:26.169930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:26.169935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:26.170039Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:26.211506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896246565365872:3180]
2025-09-30T14:56:26.211898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2213, pipe: [1:7555896246565365872:3180]
2025-09-30T14:56:26.286447Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:26.295572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:26.295603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:26.295787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:26.299219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:26.299275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896246565365872:3180]
2025-09-30T14:56:26.295863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:26.295934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:26.295998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:26.296043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:26.299306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:26.296048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:26.299309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:26.296126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:26.299340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2214 reason: error at write: Disconnected sessionId: src_id|24038c9a-b2413e15-817506a9-8ff7bdb5_0
2025-09-30T14:56:26.296188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:26.296253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:26.296320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:26.296370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:26.296374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:26.296447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:26.296511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:26.296575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:26.296642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:26.296683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:26.296686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:26.296760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:26.296823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:26.296891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:26.296956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:26.296998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:26.297001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:26.297074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:26.297136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:26.297201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:26.297264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:26.297309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:26.297312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:26.297403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:26.297466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:26.297528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:26.297590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:26.297637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:26.297640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:26.297711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:26.297768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:26.297836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:26.297904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:26.297947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:26.297950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:26.298027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:26.298088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:26.298152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:26.298221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:26.298271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:26.298274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:26.298348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:26.298412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:26.298479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:26.298545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:26.298595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:26.298599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:26.298670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:26.299535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2214 sessionId: src_id|24038c9a-b2413e15-817506a9-8ff7bdb5_0 is DEAD
2025-09-30T14:56:26.298733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:26.298800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:26.298867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:26.298912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:26.298915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:26.298998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896246565365872:3180], now have 1 active actors on pipe
2025-09-30T14:56:26.299720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24038c9a-b2413e15-817506a9-8ff7bdb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:26.299732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24038c9a-b2413e15-817506a9-8ff7bdb5_0] Write session will restart in 0.008365s
2025-09-30T14:56:26.299766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24038c9a-b2413e15-817506a9-8ff7bdb5_0] Write session: Do CDS request
2025-09-30T14:56:26.299772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24038c9a-b2413e15-817506a9-8ff7bdb5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:26.300338Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:26.309847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24038c9a-b2413e15-817506a9-8ff7bdb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:26.309918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:26.309938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2215
2025-09-30T14:56:26.310095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2215 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:26.310129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2215 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:26.310153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2215 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:26.310164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:26.311020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2215 sessionId:  describe result for acl check
2025-09-30T14:56:26.311059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:26.311071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:26.311073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:26.311080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896246565365902:3318] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:26.311675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896246565365902:3318] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:26.314953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896246565365902:3318] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:26.318935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896246565365902:3318] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:26.318953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896246565365902:3318] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:26.318956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896246565365902:3318] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:26.318965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2215 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:26.325249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:26.325906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:26.326096Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:26.326108Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:26.326117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:26.326165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:26.326203Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896246475593685:2492]
2025-09-30T14:56:26.326873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:26.329710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:26.329793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:26.330236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:26.330310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:26.330311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:26.330312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:26.330314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:26.330315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:26.330316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:26.330317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:26.330319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:26.330321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:26.330322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:26.330323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.330325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:26.330326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:26.330327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:26.330329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:26.330336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:26.330348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:26.330354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:26.330359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:26.330364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:26.330369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:26.330374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:26.330378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:26.330384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:26.330389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:26.330394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.330399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:26.330404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:26.330409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:26.330413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:26.330424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:26.330433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:26.330440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:26.330447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:26.330452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:26.330459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:26.330465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:26.330471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:26.330477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:26.330483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:26.330489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:26.330495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:26.330502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:26.330508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:26.330513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:26.330518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:26.330523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:26.330529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:26.330534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:26.330539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:26.330544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.330549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.330554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:26.330559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:26.330564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:26.330569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:26.330577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:26.330583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:26.330588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:26.330594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:26.330647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:26.336761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:26.337714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:26.337734Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:26.337738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:26.337742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:26.337750Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2214 [2:7555896246475593685:2492]
2025-09-30T14:56:26.337769Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:26.337795Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:26.337799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:26.337803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:26.337806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:26.337826Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:26.337839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:26.337852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:26.337922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.337931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:26.337934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:26.337938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:26.337941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:26.338015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:26.338023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.338036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:26.338053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:26.338077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:26.338103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896246565366053:3318], now have 1 active actors on pipe
2025-09-30T14:56:26.338111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896246565365877:2454], now have 1 active actors on pipe
2025-09-30T14:56:26.338118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896246475593680:2492]
2025-09-30T14:56:26.338121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896246475593680:2492]
2025-09-30T14:56:26.338124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896246475593680:2492]
2025-09-30T14:56:26.338138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:26.338149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:26.338158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:26.338151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:26.338167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:26.338179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:26.338188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:26.338178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2214
2025-09-30T14:56:26.338185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2214
2025-09-30T14:56:26.338226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896246475593680:2492]
2025-09-30T14:56:26.338240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:26.338264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:26.338271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:26.338276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:26.338326Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2a8889e-67b2d2a-d6299461-eaf4a585_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:26.338341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:26.338346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:26.338348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:26.338359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:26.338368Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:26.338395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:26.338622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:26.338647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:26.338673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:26.338766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2215 partition: 0 MaxSeqNo: 42 sessionId: src_id|c2a8889e-67b2d2a-d6299461-eaf4a585_0
2025-09-30T14:56:26.339190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24038c9a-b2413e15-817506a9-8ff7bdb5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c2a8889e-67b2d2a-d6299461-eaf4a585_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:26.342257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2a8889e-67b2d2a-d6299461-eaf4a585_0] Write session: try to update token
2025-09-30T14:56:26.342280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2a8889e-67b2d2a-d6299461-eaf4a585_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:26.351798Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:26.351824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:26.351827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:26.351828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:26.351839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896246475593680:2492]
2025-09-30T14:56:26.351843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896246475593680:2492]
2025-09-30T14:56:26.351848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896246475593680:2492]
2025-09-30T14:56:26.351887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:26.351893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.351896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:26.351897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:26.351905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:26.351910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:26.352037Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:26.363300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2215 sessionId: src_id|c2a8889e-67b2d2a-d6299461-eaf4a585_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:26.366299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:26.399445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896246565366187:3180]
2025-09-30T14:56:26.399763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2214, pipe: [1:7555896246565366187:3180]
2025-09-30T14:56:26.469682Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:26.470056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:26.470077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:26.470097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896246565366187:3180], now have 1 active actors on pipe
2025-09-30T14:56:26.470340Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:26.470333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:26.470350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:26.470422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2215 reason: error at write: Disconnected sessionId: src_id|c2a8889e-67b2d2a-d6299461-eaf4a585_0
2025-09-30T14:56:26.470528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:26.470587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896246565366187:3180]
2025-09-30T14:56:26.470598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2215 sessionId: src_id|c2a8889e-67b2d2a-d6299461-eaf4a585_0 is DEAD
2025-09-30T14:56:26.470770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2a8889e-67b2d2a-d6299461-eaf4a585_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:26.470793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2a8889e-67b2d2a-d6299461-eaf4a585_0] Write session will restart in 0.006354s
2025-09-30T14:56:26.470818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2a8889e-67b2d2a-d6299461-eaf4a585_0] Write session: Do CDS request
2025-09-30T14:56:26.470825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2a8889e-67b2d2a-d6299461-eaf4a585_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:26.478777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2a8889e-67b2d2a-d6299461-eaf4a585_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:26.478923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:26.478941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2216
2025-09-30T14:56:26.479053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2216 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:26.479085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2216 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:26.479091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2216 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:26.479095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:26.479575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2216 sessionId:  describe result for acl check
2025-09-30T14:56:26.479614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:26.479616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:26.479619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:26.479625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896246565366203:3322] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:26.480195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896246565366203:3322] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:26.482632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896246565366203:3322] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:26.487017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896246565366203:3322] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:26.487035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896246565366203:3322] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:26.487039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896246565366203:3322] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:26.487049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2216 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:26.496743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:26.500447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:26.500698Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:26.500711Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:26.500722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:26.500785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:26.500830Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896246475593989:2490]
2025-09-30T14:56:26.501559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:26.501927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:26.501986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:26.502317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:26.502371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:26.502376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:26.502377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:26.502378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:26.502379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:26.502380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:26.502380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:26.502381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:26.502382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:26.502383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:26.502384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.502385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:26.502386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:26.502386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:26.502387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:26.502398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:26.502405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:26.502408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:26.502410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:26.502413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:26.502415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:26.502418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:26.502420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:26.502423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:26.502425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:26.502428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.502430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:26.502432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:26.502435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:26.502437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:26.502443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:26.502448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:26.502452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:26.502456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:26.502458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:26.502462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:26.502465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:26.502468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:26.502471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:26.502475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:26.502478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:26.502481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:26.502484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:26.502487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:26.502491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:26.502494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:26.502508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:26.502514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:26.502519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:26.502525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:26.502531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.502536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.502541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:26.502547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:26.502551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:26.502554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:26.502557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:26.502560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:26.502563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:26.502569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:26.502597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:26.508800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:26.509827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:26.509850Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:26.509853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:26.509858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:26.509866Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2215 [2:7555896246475593989:2490]
2025-09-30T14:56:26.509882Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:26.509901Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:26.509905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:26.509908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:26.509911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:26.509928Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:26.509935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:26.509943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:26.510013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.510025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:26.510029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:26.510032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:26.510035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:26.510113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:26.510122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.510136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:26.510152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:26.510170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:26.510193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896246475593984:2490]
2025-09-30T14:56:26.510201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896246475593984:2490]
2025-09-30T14:56:26.510204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896246475593984:2490]
2025-09-30T14:56:26.510222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:26.510241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896246565366188:2454], now have 1 active actors on pipe
2025-09-30T14:56:26.510249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:26.510253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896246565366320:3322], now have 1 active actors on pipe
2025-09-30T14:56:26.510254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:26.510257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:26.510260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:26.510276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:26.510285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:26.510325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896246475593984:2490]
2025-09-30T14:56:26.510340Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:26.510369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:26.510342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2215
2025-09-30T14:56:26.510348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2215
2025-09-30T14:56:26.510492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:26.510510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:26.510556Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bade4423-cdbda7d9-261ac0f9-38bf37bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:26.510570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:26.510593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:26.510596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:26.510608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:26.510624Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:26.510650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:26.511158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:26.511169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:26.511186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:26.511383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2216 partition: 0 MaxSeqNo: 42 sessionId: src_id|bade4423-cdbda7d9-261ac0f9-38bf37bc_0
2025-09-30T14:56:26.511802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2a8889e-67b2d2a-d6299461-eaf4a585_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bade4423-cdbda7d9-261ac0f9-38bf37bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:26.514699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bade4423-cdbda7d9-261ac0f9-38bf37bc_0] Write session: try to update token
2025-09-30T14:56:26.514721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bade4423-cdbda7d9-261ac0f9-38bf37bc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:26.528060Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:26.528084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:26.528088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:26.528092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:26.528102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896246475593984:2490]
2025-09-30T14:56:26.528106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896246475593984:2490]
2025-09-30T14:56:26.528111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896246475593984:2490]
2025-09-30T14:56:26.528153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:26.528160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.528160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:26.528163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:26.528169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:26.528173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:26.528323Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:26.533561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2216 sessionId: src_id|bade4423-cdbda7d9-261ac0f9-38bf37bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:26.536516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:26.570968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896246565366501:3180]
2025-09-30T14:56:26.571323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2215, pipe: [1:7555896246565366501:3180]
2025-09-30T14:56:26.645647Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:26.646667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:26.646688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:26.646727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896246565366501:3180], now have 1 active actors on pipe
2025-09-30T14:56:26.646996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896246565366501:3180]
2025-09-30T14:56:26.647039Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:26.647099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:26.647103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:26.647175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2216 reason: error at write: Disconnected sessionId: src_id|bade4423-cdbda7d9-261ac0f9-38bf37bc_0
2025-09-30T14:56:26.647208Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:26.647390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2216 sessionId: src_id|bade4423-cdbda7d9-261ac0f9-38bf37bc_0 is DEAD
2025-09-30T14:56:26.647533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bade4423-cdbda7d9-261ac0f9-38bf37bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:26.647555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bade4423-cdbda7d9-261ac0f9-38bf37bc_0] Write session will restart in 0.007604s
2025-09-30T14:56:26.647578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bade4423-cdbda7d9-261ac0f9-38bf37bc_0] Write session: Do CDS request
2025-09-30T14:56:26.647586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bade4423-cdbda7d9-261ac0f9-38bf37bc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:26.656825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bade4423-cdbda7d9-261ac0f9-38bf37bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:26.657022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:26.657050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2217
2025-09-30T14:56:26.657246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2217 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:26.657281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2217 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:26.657288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2217 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:26.657294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:26.657785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2217 sessionId:  describe result for acl check
2025-09-30T14:56:26.657826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:26.657827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:26.657830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:26.657836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896246565366519:3324] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:26.658445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896246565366519:3324] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:26.668043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896246565366519:3324] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:26.672946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896246565366519:3324] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:26.672968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896246565366519:3324] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:26.672971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896246565366519:3324] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:26.672980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2217 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:26.685791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:26.690694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:26.690965Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:26.690978Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:26.690991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:26.691053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:26.691121Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896246475594292:2485]
2025-09-30T14:56:26.691801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:26.692180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:26.692233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:26.692577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:26.692670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:26.692689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:26.692695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:26.692697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:26.692698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:26.692699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:26.692701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:26.692702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:26.692703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:26.692704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:26.692706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.692707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:26.692708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:26.692709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:26.692710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:26.692717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:26.692727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:26.692731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:26.692736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:26.692740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:26.692745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:26.692749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:26.692753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:26.692757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:26.692761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:26.692765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.692769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:26.692773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:26.692777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:26.692782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:26.692790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:26.692800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:26.692806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:26.692812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:26.692818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:26.692823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:26.692827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:26.692833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:26.692838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:26.692845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:26.692849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:26.692854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:26.692858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:26.692870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:26.692875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:26.692879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:26.692883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:26.692887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:26.692891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:26.692896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:26.692902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.692907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.692912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:26.692918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:26.692929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:26.692934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:26.692938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:26.692948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:26.692953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:26.692958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:26.693004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:26.698911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:26.700105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:26.700126Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:26.700128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:26.700134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:26.700141Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2216 [2:7555896246475594292:2485]
2025-09-30T14:56:26.700157Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:26.700175Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:26.700190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:26.700193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:26.700195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:26.700212Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:26.700219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:26.700226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:26.700292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.700301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:26.700303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:26.700306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:26.700309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:26.700385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:26.700393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.700411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:26.700429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:26.700450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:26.700473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896246475594287:2485]
2025-09-30T14:56:26.700480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896246475594287:2485]
2025-09-30T14:56:26.700482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896246475594287:2485]
2025-09-30T14:56:26.700491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:26.700503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:26.700515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896246565366665:3324], now have 1 active actors on pipe
2025-09-30T14:56:26.700516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:26.700519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:26.700522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:26.700537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:26.700545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:26.700551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896246565366502:2454], now have 1 active actors on pipe
2025-09-30T14:56:26.700584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896246475594287:2485]
2025-09-30T14:56:26.700596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:26.700608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:26.700603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2216
2025-09-30T14:56:26.700605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2216
2025-09-30T14:56:26.700710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:26.700721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:26.700748Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8993520-c90ed302-e0ae8699-8b5cad5b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:26.700760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:26.700770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:26.700773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:26.700783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:26.700797Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:26.700816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:26.700993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:26.701004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:26.701020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:26.701128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2217 partition: 0 MaxSeqNo: 42 sessionId: src_id|a8993520-c90ed302-e0ae8699-8b5cad5b_0
2025-09-30T14:56:26.701573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bade4423-cdbda7d9-261ac0f9-38bf37bc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a8993520-c90ed302-e0ae8699-8b5cad5b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:26.704638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8993520-c90ed302-e0ae8699-8b5cad5b_0] Write session: try to update token
2025-09-30T14:56:26.704660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8993520-c90ed302-e0ae8699-8b5cad5b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:26.714079Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:26.714103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:26.714106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:26.714108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:26.714119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896246475594287:2485]
2025-09-30T14:56:26.714122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896246475594287:2485]
2025-09-30T14:56:26.714126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896246475594287:2485]
2025-09-30T14:56:26.714172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:26.714180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.714180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:26.714183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:26.714187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:26.714191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:26.714345Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:26.721242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2217 sessionId: src_id|a8993520-c90ed302-e0ae8699-8b5cad5b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:26.724346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:26.747085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896246565366817:3180]
2025-09-30T14:56:26.747451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2216, pipe: [1:7555896246565366817:3180]
2025-09-30T14:56:26.831623Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:26.832331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:26.832348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:26.832389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896246565366817:3180], now have 1 active actors on pipe
2025-09-30T14:56:26.832608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896246565366817:3180]
2025-09-30T14:56:26.832646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:26.832649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:26.832716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2217 reason: error at write: Disconnected sessionId: src_id|a8993520-c90ed302-e0ae8699-8b5cad5b_0
2025-09-30T14:56:26.832943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2217 sessionId: src_id|a8993520-c90ed302-e0ae8699-8b5cad5b_0 is DEAD
2025-09-30T14:56:26.832960Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:26.832690Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:26.833123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8993520-c90ed302-e0ae8699-8b5cad5b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:26.833134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8993520-c90ed302-e0ae8699-8b5cad5b_0] Write session will restart in 0.008908s
2025-09-30T14:56:26.833168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8993520-c90ed302-e0ae8699-8b5cad5b_0] Write session: Do CDS request
2025-09-30T14:56:26.833176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8993520-c90ed302-e0ae8699-8b5cad5b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:26.844833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8993520-c90ed302-e0ae8699-8b5cad5b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:26.844922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:26.844941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2218
2025-09-30T14:56:26.845066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2218 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:26.845106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2218 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:26.845119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2218 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:26.845123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:26.847264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2218 sessionId:  describe result for acl check
2025-09-30T14:56:26.847318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:26.847326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:26.847329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:26.847335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896246565366859:3351] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:26.847892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896246565366859:3351] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:26.852792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896246565366859:3351] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:26.859975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896246565366859:3351] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:26.859994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896246565366859:3351] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:26.859998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896246565366859:3351] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:26.860017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2218 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:26.870494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:26.874707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:26.874976Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:26.874988Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:26.874999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:26.875057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:26.875102Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896246475594613:2479]
2025-09-30T14:56:26.875767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:26.876501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:26.876916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:26.877302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:26.877390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:26.877398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:26.877400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:26.877401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:26.877403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:26.877404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:26.877405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:26.877406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:26.877407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:26.877409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:26.877410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.877411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:26.877413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:26.877414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:26.877415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:26.877421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:26.877430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:26.877435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:26.877439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:26.877443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:26.877446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:26.877451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:26.877454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:26.877458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:26.877462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:26.877465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.877470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:26.877474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:26.877478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:26.877481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:26.877489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:26.877498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:26.877504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:26.877510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:26.877515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:26.877520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:26.877524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:26.877529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:26.877533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:26.877538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:26.877543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:26.877548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:26.877553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:26.877558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:26.877563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:26.877571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:26.877576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:26.877583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:26.877588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:26.877595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:26.877601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.877611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.877615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:26.877622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:26.877626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:26.877636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:26.877641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:26.877651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:26.877660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:26.877670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:26.877710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:26.886851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8993520-c90ed302-e0ae8699-8b5cad5b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|921cef82-e3388ec0-b14d64cc-2df6e247_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:26.883958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:26.885089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:26.885096Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:26.885098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:26.885103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:26.885110Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2217 [2:7555896246475594613:2479]
2025-09-30T14:56:26.885126Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:26.885143Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:26.885147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:26.885149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:26.885152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:26.885169Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:26.885176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:26.885183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:26.885243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.885245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:26.885248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:26.885251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:26.885254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:26.885343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:26.885346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.885359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:26.885371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:26.885388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:26.885405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896246475594602:2479]
2025-09-30T14:56:26.885408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896246475594602:2479]
2025-09-30T14:56:26.885410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896246475594602:2479]
2025-09-30T14:56:26.885425Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:26.885439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:26.885455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:26.885458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:26.885473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:26.885478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:26.885479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:26.885497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896246475594602:2479]
2025-09-30T14:56:26.885501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:26.885541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:26.885650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896246565367009:3351], now have 1 active actors on pipe
2025-09-30T14:56:26.885656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896246565366820:2454], now have 1 active actors on pipe
2025-09-30T14:56:26.886023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:26.886029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:26.886057Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|921cef82-e3388ec0-b14d64cc-2df6e247_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:26.886066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:26.886070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:26.886073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:26.886086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:26.886098Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:26.886114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:26.886315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:26.886319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:26.886338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:26.885767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2217
2025-09-30T14:56:26.885792Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2217
2025-09-30T14:56:26.886440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2218 partition: 0 MaxSeqNo: 42 sessionId: src_id|921cef82-e3388ec0-b14d64cc-2df6e247_0
2025-09-30T14:56:26.889881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|921cef82-e3388ec0-b14d64cc-2df6e247_0] Write session: try to update token
2025-09-30T14:56:26.889897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|921cef82-e3388ec0-b14d64cc-2df6e247_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:26.901483Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:26.901505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:26.901515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896246475594602:2479]
2025-09-30T14:56:26.901560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:26.901658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:26.901744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:26.901891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:26.902042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:26.902198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:26.902405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:26.902452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:26.910133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2218 sessionId: src_id|921cef82-e3388ec0-b14d64cc-2df6e247_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:26.913868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:26.913895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:26.913915Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:26.913918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:26.913920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:26.913923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:26.913930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896246475594602:2479]
2025-09-30T14:56:26.913933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896246475594602:2479]
2025-09-30T14:56:26.913937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896246475594602:2479]
2025-09-30T14:56:26.913979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:26.913985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:26.913987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:26.913990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:26.913993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:26.913996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:26.914136Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:26.912784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:26.935330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896246565367133:3180]
2025-09-30T14:56:26.935902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2217, pipe: [1:7555896246565367133:3180]
2025-09-30T14:56:27.034536Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:27.035127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:27.035171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896246565367133:3180], now have 1 active actors on pipe
2025-09-30T14:56:27.035357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:27.035463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896246565367133:3180]
2025-09-30T14:56:27.035493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:27.035501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:27.035503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:27.035591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2218 reason: error at write: Disconnected sessionId: src_id|921cef82-e3388ec0-b14d64cc-2df6e247_0
2025-09-30T14:56:27.035795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2218 sessionId: src_id|921cef82-e3388ec0-b14d64cc-2df6e247_0 is DEAD
2025-09-30T14:56:27.035913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|921cef82-e3388ec0-b14d64cc-2df6e247_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:27.035925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|921cef82-e3388ec0-b14d64cc-2df6e247_0] Write session will restart in 0.007759s
2025-09-30T14:56:27.035949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|921cef82-e3388ec0-b14d64cc-2df6e247_0] Write session: Do CDS request
2025-09-30T14:56:27.035955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|921cef82-e3388ec0-b14d64cc-2df6e247_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:27.044784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|921cef82-e3388ec0-b14d64cc-2df6e247_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:27.044893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:27.044912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2219
2025-09-30T14:56:27.045023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2219 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:27.045055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2219 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:27.045065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2219 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:27.045070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:27.045538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2219 sessionId:  describe result for acl check
2025-09-30T14:56:27.045578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:27.045586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:27.045588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:27.045594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896250860334487:3364] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:27.045638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:27.046153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896250860334487:3364] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:27.047745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:27.047971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896250860334487:3364] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:27.047985Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:27.047998Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:27.048010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:27.048085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:27.048126Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896250770562008:2464]
2025-09-30T14:56:27.048780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:27.049334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:27.049443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:27.049903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:27.050004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:27.050014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:27.050016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:27.050017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:27.050018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:27.050020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:27.050022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:27.050024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:27.050026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:27.050028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:27.050029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.050031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.050032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.050034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:27.050036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:27.050044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:27.050055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:27.050059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:27.050064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:27.050068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:27.050073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:27.050080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:27.050084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:27.050088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:27.050092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:27.050096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.050099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.050104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.050108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:27.050111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:27.050122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:27.050132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:27.050139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:27.050144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:27.050149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:27.050155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:27.050160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:27.050165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:27.050171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:27.050176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:27.050181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:27.050186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:27.050191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:27.050196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:27.050202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:27.050206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:27.050212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:27.050217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:27.050225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:27.050231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:27.050238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.050243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.050250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.050264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.050271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.050277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.050282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:27.050287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:27.050292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:27.050298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:27.050346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:27.051045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896250860334487:3364] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:27.051064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896250860334487:3364] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:27.051068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896250860334487:3364] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:27.051077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2219 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:27.056507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:27.057519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:27.057526Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:27.057529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:27.057534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:27.057542Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2218 [2:7555896250770562008:2464]
2025-09-30T14:56:27.057561Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:27.057580Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:27.057583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:27.057587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:27.057590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:27.057608Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:27.057615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:27.057623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:27.057696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.057699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.057702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.057705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:27.057708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:27.057786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:27.057790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.057804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.057831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.057850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:27.057868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896250770562002:2464]
2025-09-30T14:56:27.057871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896250770562002:2464]
2025-09-30T14:56:27.057872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896250770562002:2464]
2025-09-30T14:56:27.057886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:27.057900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:27.057918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:27.057922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:27.057959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896250770562002:2464]
2025-09-30T14:56:27.057963Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:27.058182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:27.058185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:27.058187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:27.058192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:27.058589Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2218
2025-09-30T14:56:27.058594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2218
2025-09-30T14:56:27.058614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896250860334468:2454], now have 1 active actors on pipe
2025-09-30T14:56:27.058629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896250860334524:3364], now have 1 active actors on pipe
2025-09-30T14:56:27.058873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:27.058885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:27.058914Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23c5cc33-d469ccf2-ee95de78-26d27130_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:27.058927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:27.058934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:27.058936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:27.058948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:27.058961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:27.058983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:27.059222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:27.059234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:27.059284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:27.059424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2219 partition: 0 MaxSeqNo: 42 sessionId: src_id|23c5cc33-d469ccf2-ee95de78-26d27130_0
2025-09-30T14:56:27.059798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|921cef82-e3388ec0-b14d64cc-2df6e247_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|23c5cc33-d469ccf2-ee95de78-26d27130_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:27.063908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23c5cc33-d469ccf2-ee95de78-26d27130_0] Write session: try to update token
2025-09-30T14:56:27.063929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23c5cc33-d469ccf2-ee95de78-26d27130_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:27.077837Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:27.077862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:27.077865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:27.077867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:27.077884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896250770562002:2464]
2025-09-30T14:56:27.077888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896250770562002:2464]
2025-09-30T14:56:27.077893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896250770562002:2464]
2025-09-30T14:56:27.077937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:27.077944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.077946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:27.077963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:27.077974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:27.077979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:27.078092Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:27.085447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2219 sessionId: src_id|23c5cc33-d469ccf2-ee95de78-26d27130_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:27.088444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:27.135677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896250860334531:3180]
2025-09-30T14:56:27.135998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2218, pipe: [1:7555896250860334531:3180]
2025-09-30T14:56:27.193748Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:27.194157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:27.194179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:27.194238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896250860334531:3180], now have 1 active actors on pipe
2025-09-30T14:56:27.195673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896250860334531:3180]
2025-09-30T14:56:27.195728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:27.195764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:27.195775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:27.195848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2219 reason: error at write: Disconnected sessionId: src_id|23c5cc33-d469ccf2-ee95de78-26d27130_0
2025-09-30T14:56:27.195698Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:27.196024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2219 sessionId: src_id|23c5cc33-d469ccf2-ee95de78-26d27130_0 is DEAD
2025-09-30T14:56:27.196216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23c5cc33-d469ccf2-ee95de78-26d27130_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:27.196239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23c5cc33-d469ccf2-ee95de78-26d27130_0] Write session will restart in 0.007569s
2025-09-30T14:56:27.196273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23c5cc33-d469ccf2-ee95de78-26d27130_0] Write session: Do CDS request
2025-09-30T14:56:27.196279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23c5cc33-d469ccf2-ee95de78-26d27130_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:27.204862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23c5cc33-d469ccf2-ee95de78-26d27130_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:27.205216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:27.205235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2220
2025-09-30T14:56:27.205103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:27.205335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2220 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:27.205368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2220 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:27.205373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2220 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:27.205377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:27.207046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2220 sessionId:  describe result for acl check
2025-09-30T14:56:27.207087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:27.207090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:27.207091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:27.207096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896250860334561:3381] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:27.206826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:27.207053Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:27.207057Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:27.207069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:27.207122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:27.207158Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896250770562064:2456]
2025-09-30T14:56:27.207661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896250860334561:3381] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:27.207862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:27.208174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:27.208227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:27.208570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:27.208640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:27.208647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:27.208648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:27.208651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:27.208652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:27.208654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:27.208655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:27.208656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:27.208658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:27.208659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:27.208661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.208663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.208664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.208667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:27.208668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:27.208674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:27.208684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:27.208689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:27.208693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:27.208697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:27.208701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:27.208705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:27.208709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:27.208713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:27.208718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:27.208722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.208726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.208730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.208734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:27.208738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:27.208746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:27.208754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:27.208761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:27.208767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:27.208771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:27.208777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:27.208783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:27.208788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:27.208793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:27.208798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:27.208803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:27.208808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:27.208815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:27.208820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:27.208825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:27.208830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:27.208835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:27.208840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:27.208844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:27.208849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:27.208853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.208858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.208862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.208873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.208878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.208884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.208893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:27.208898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:27.208903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:27.208908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:27.208955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:27.210212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896250860334561:3381] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:27.214750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896250860334561:3381] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:27.214773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896250860334561:3381] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:27.214776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896250860334561:3381] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:27.214786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2220 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:27.215122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:27.216047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:27.216067Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:27.216070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:27.216077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:27.216084Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2219 [2:7555896250770562064:2456]
2025-09-30T14:56:27.216101Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:27.216121Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:27.216130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:27.216134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:27.216136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:27.216153Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:27.216159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:27.216173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:27.216233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.216244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.216246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.216250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:27.216254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:27.216324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:27.216334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.216345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.216358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.216377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:27.216398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896250860334599:3381], now have 1 active actors on pipe
2025-09-30T14:56:27.216408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896250860334541:2454], now have 1 active actors on pipe
2025-09-30T14:56:27.216415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896250770562059:2456]
2025-09-30T14:56:27.216422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896250770562059:2456]
2025-09-30T14:56:27.216423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896250770562059:2456]
2025-09-30T14:56:27.216436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:27.216451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:27.216456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:27.216462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:27.216465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:27.216472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:27.216475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:27.216453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2219
2025-09-30T14:56:27.216502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2219
2025-09-30T14:56:27.216512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896250770562059:2456]
2025-09-30T14:56:27.216530Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:27.216541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:27.216692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:27.216703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:27.216726Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b13cdac5-212fa373-85e4681e-58bdcab4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:27.216739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:27.216745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:27.216747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:27.216756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:27.216772Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:27.216793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:27.217141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:27.217150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:27.217165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:27.217281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2220 partition: 0 MaxSeqNo: 42 sessionId: src_id|b13cdac5-212fa373-85e4681e-58bdcab4_0
2025-09-30T14:56:27.217717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23c5cc33-d469ccf2-ee95de78-26d27130_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b13cdac5-212fa373-85e4681e-58bdcab4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:27.220721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b13cdac5-212fa373-85e4681e-58bdcab4_0] Write session: try to update token
2025-09-30T14:56:27.220746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b13cdac5-212fa373-85e4681e-58bdcab4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:27.229561Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:27.229589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:27.229600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896250770562059:2456]
2025-09-30T14:56:27.229653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:27.229851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:27.229868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:27.230015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:27.230177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:27.230348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:27.230570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:27.230623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:27.242714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2220 sessionId: src_id|b13cdac5-212fa373-85e4681e-58bdcab4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:27.245021Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:27.245054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:27.245057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:27.245060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:27.245071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896250770562059:2456]
2025-09-30T14:56:27.245082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896250770562059:2456]
2025-09-30T14:56:27.245089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896250770562059:2456]
2025-09-30T14:56:27.245135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:27.245147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.245146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:27.245149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:27.245153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:27.245157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:27.245300Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:27.245840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:27.295954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896250860334610:3180]
2025-09-30T14:56:27.297862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2219, pipe: [1:7555896250860334610:3180]
2025-09-30T14:56:27.385165Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:27.385564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:27.385582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:27.385602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896250860334610:3180], now have 1 active actors on pipe
2025-09-30T14:56:27.385866Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:27.385860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896250860334610:3180]
2025-09-30T14:56:27.385868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:27.385873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:27.385904Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:27.385941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2220 reason: error at write: Disconnected sessionId: src_id|b13cdac5-212fa373-85e4681e-58bdcab4_0
2025-09-30T14:56:27.386129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2220 sessionId: src_id|b13cdac5-212fa373-85e4681e-58bdcab4_0 is DEAD
2025-09-30T14:56:27.386320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b13cdac5-212fa373-85e4681e-58bdcab4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:27.386331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b13cdac5-212fa373-85e4681e-58bdcab4_0] Write session will restart in 0.005823s
2025-09-30T14:56:27.386368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b13cdac5-212fa373-85e4681e-58bdcab4_0] Write session: Do CDS request
2025-09-30T14:56:27.386378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b13cdac5-212fa373-85e4681e-58bdcab4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:27.393802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b13cdac5-212fa373-85e4681e-58bdcab4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:27.393882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:27.393902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2221
2025-09-30T14:56:27.394042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2221 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:27.394075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2221 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:27.394084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2221 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:27.394095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:27.394526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2221 sessionId:  describe result for acl check
2025-09-30T14:56:27.394564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:27.394566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:27.394568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:27.394574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896250860334631:3385] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:27.395133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896250860334631:3385] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:27.396045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:27.397076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896250860334631:3385] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:27.397845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:27.398063Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:27.398074Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:27.398085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:27.398138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:27.398175Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896250770562122:2453]
2025-09-30T14:56:27.398787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:27.399153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:27.399218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:27.399652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:27.399765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:27.399774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:27.399775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:27.399779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:27.399780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:27.399781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:27.399782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:27.399783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:27.399785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:27.399786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:27.399787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.399788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.399789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.399790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:27.399791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:27.399799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:27.399808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:27.399811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:27.399814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:27.399818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:27.399821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:27.399827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:27.399831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:27.399834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:27.399839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:27.399842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.399845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.399848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.399851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:27.399855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:27.399862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:27.399869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:27.399875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:27.399879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:27.399884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:27.399889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:27.399892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:27.399897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:27.399901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:27.399909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:27.399913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:27.399917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:27.399923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:27.399928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:27.399931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:27.399936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:27.399940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:27.399944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:27.399948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:27.399952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:27.399955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.399960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.399964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.399968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.399972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.399976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.399980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:27.399984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:27.399988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:27.399992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:27.400034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:27.400835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896250860334631:3385] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:27.400856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896250860334631:3385] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:27.400859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896250860334631:3385] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:27.400868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2221 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:27.406950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:27.408202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:27.408222Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:27.408228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:27.408232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:27.408239Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2220 [2:7555896250770562122:2453]
2025-09-30T14:56:27.408255Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:27.408273Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:27.408276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:27.408280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:27.408282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:27.408302Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:27.408310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:27.408317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:27.408380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.408391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.408392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.408395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:27.408397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:27.408469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:27.408476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.408488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.408502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.408521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:27.408543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896250770562117:2453]
2025-09-30T14:56:27.408545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896250770562117:2453]
2025-09-30T14:56:27.408547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896250770562117:2453]
2025-09-30T14:56:27.408562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:27.408575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:27.408589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:27.408595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:27.408634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896250770562117:2453]
2025-09-30T14:56:27.408641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:27.408645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:27.408649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:27.408652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:27.408659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:27.408884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896250860334613:2454], now have 1 active actors on pipe
2025-09-30T14:56:27.408893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896250860334672:3385], now have 1 active actors on pipe
2025-09-30T14:56:27.409066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2220
2025-09-30T14:56:27.409118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2220
2025-09-30T14:56:27.409361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:27.409372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:27.409399Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f398a414-c17d3476-93862c5a-2afa252b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:27.409418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:27.409426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:27.409430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:27.409440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:27.409454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:27.409472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:27.409701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:27.409709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:27.409723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:27.409845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2221 partition: 0 MaxSeqNo: 42 sessionId: src_id|f398a414-c17d3476-93862c5a-2afa252b_0
2025-09-30T14:56:27.410288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b13cdac5-212fa373-85e4681e-58bdcab4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f398a414-c17d3476-93862c5a-2afa252b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:27.413373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f398a414-c17d3476-93862c5a-2afa252b_0] Write session: try to update token
2025-09-30T14:56:27.413393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f398a414-c17d3476-93862c5a-2afa252b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:27.423008Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:27.423034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:27.423036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:27.423039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:27.423049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896250770562117:2453]
2025-09-30T14:56:27.423055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896250770562117:2453]
2025-09-30T14:56:27.423059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896250770562117:2453]
2025-09-30T14:56:27.423104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:27.423113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.423115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:27.423120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:27.423127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:27.423131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:27.423292Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:27.434631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2221 sessionId: src_id|f398a414-c17d3476-93862c5a-2afa252b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:27.437783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:27.485897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896250860334680:3180]
2025-09-30T14:56:27.486239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2220, pipe: [1:7555896250860334680:3180]
2025-09-30T14:56:27.536980Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:27.537385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:27.537394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:27.537415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896250860334680:3180], now have 1 active actors on pipe
2025-09-30T14:56:27.537668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:27.537682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:27.537686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:27.537729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896250860334680:3180]
2025-09-30T14:56:27.537749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2221 reason: error at write: Disconnected sessionId: src_id|f398a414-c17d3476-93862c5a-2afa252b_0
2025-09-30T14:56:27.537913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2221 sessionId: src_id|f398a414-c17d3476-93862c5a-2afa252b_0 is DEAD
2025-09-30T14:56:27.537684Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:27.538252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f398a414-c17d3476-93862c5a-2afa252b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:27.538263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f398a414-c17d3476-93862c5a-2afa252b_0] Write session will restart in 0.009849s
2025-09-30T14:56:27.538292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f398a414-c17d3476-93862c5a-2afa252b_0] Write session: Do CDS request
2025-09-30T14:56:27.538304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f398a414-c17d3476-93862c5a-2afa252b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:27.547799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:27.549739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:27.549805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f398a414-c17d3476-93862c5a-2afa252b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:27.549977Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:27.550006Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:27.550021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:27.550106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:27.550154Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896250770562184:2449]
2025-09-30T14:56:27.550778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:27.551136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:27.551189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:27.551543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:27.551578Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:27.551608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:27.551597Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2222
2025-09-30T14:56:27.551615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:27.551619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:27.551621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:27.551622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:27.551623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:27.551625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:27.551626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:27.551627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:27.551628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:27.551629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.551630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.551632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.551632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:27.551633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:27.551640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:27.551650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:27.551654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:27.551658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:27.551663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:27.551667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:27.551671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:27.551676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:27.551680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:27.551684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:27.551688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.551694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.551697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.551701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:27.551704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:27.551712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:27.551720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:27.551725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:27.551732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:27.551736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:27.551742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:27.551746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:27.551751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:27.551755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:27.551761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:27.551768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:27.551774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:27.551779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:27.551771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2222 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:27.551809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2222 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:27.551784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:27.551788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:27.551793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:27.551797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:27.551802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:27.551806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:27.551811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:27.551816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.551821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.551824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.551829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.551834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.551839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.551844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:27.551848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:27.551854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:27.551859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:27.551816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2222 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:27.551840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:27.551909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:27.552232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2222 sessionId:  describe result for acl check
2025-09-30T14:56:27.552269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:27.552278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:27.552280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:27.552285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896250860334708:3389] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:27.552819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896250860334708:3389] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:27.554917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896250860334708:3389] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:27.557849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:27.557988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896250860334708:3389] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:27.558009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896250860334708:3389] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:27.558014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896250860334708:3389] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:27.558023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2222 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:27.558811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:27.558827Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:27.558831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:27.558835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:27.558845Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2221 [2:7555896250770562184:2449]
2025-09-30T14:56:27.558864Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:27.558878Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:27.558887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:27.558890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:27.558893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:27.558908Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:27.558919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:27.558926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:27.558981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.558987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.558990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.558993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:27.558996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:27.559089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:27.559096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.559109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.559125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.559147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:27.559171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896250860334743:3389], now have 1 active actors on pipe
2025-09-30T14:56:27.559179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896250860334682:2454], now have 1 active actors on pipe
2025-09-30T14:56:27.559185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896250770562178:2449]
2025-09-30T14:56:27.559187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896250770562178:2449]
2025-09-30T14:56:27.559189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896250770562178:2449]
2025-09-30T14:56:27.559203Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:27.559220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:27.559232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:27.559257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:27.559260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:27.559263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:27.559266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:27.559227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2221
2025-09-30T14:56:27.559229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2221
2025-09-30T14:56:27.559299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896250770562178:2449]
2025-09-30T14:56:27.559306Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:27.559309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:27.559329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:27.559338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:27.559383Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c4c93ac-29f0440c-f35e2d17-8433d0c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:27.559393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:27.559397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:27.559399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:27.559408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:27.559421Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:27.559444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:27.559694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:27.559706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:27.559725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:27.559835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2222 partition: 0 MaxSeqNo: 42 sessionId: src_id|3c4c93ac-29f0440c-f35e2d17-8433d0c8_0
2025-09-30T14:56:27.560210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f398a414-c17d3476-93862c5a-2afa252b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3c4c93ac-29f0440c-f35e2d17-8433d0c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:27.563364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c4c93ac-29f0440c-f35e2d17-8433d0c8_0] Write session: try to update token
2025-09-30T14:56:27.563386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c4c93ac-29f0440c-f35e2d17-8433d0c8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:27.573462Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:27.573485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:27.573487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:27.573489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:27.573500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896250770562178:2449]
2025-09-30T14:56:27.573504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896250770562178:2449]
2025-09-30T14:56:27.573509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896250770562178:2449]
2025-09-30T14:56:27.573552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:27.573566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.573564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:27.573569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:27.573573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:27.573578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:27.573719Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:27.582389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2222 sessionId: src_id|3c4c93ac-29f0440c-f35e2d17-8433d0c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:27.585417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:27.637975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896250860334750:3180]
2025-09-30T14:56:27.638347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2221, pipe: [1:7555896250860334750:3180]
2025-09-30T14:56:27.690995Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:27.691444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:27.691463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:27.691504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896250860334750:3180], now have 1 active actors on pipe
2025-09-30T14:56:27.691668Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:27.692168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c4c93ac-29f0440c-f35e2d17-8433d0c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:27.692180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c4c93ac-29f0440c-f35e2d17-8433d0c8_0] Write session will restart in 0.006770s
2025-09-30T14:56:27.691747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:27.692203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c4c93ac-29f0440c-f35e2d17-8433d0c8_0] Write session: Do CDS request
2025-09-30T14:56:27.692229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c4c93ac-29f0440c-f35e2d17-8433d0c8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:27.691755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896250860334750:3180]
2025-09-30T14:56:27.691766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:27.691775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:27.691841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2222 reason: error at write: Disconnected sessionId: src_id|3c4c93ac-29f0440c-f35e2d17-8433d0c8_0
2025-09-30T14:56:27.692030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2222 sessionId: src_id|3c4c93ac-29f0440c-f35e2d17-8433d0c8_0 is DEAD
2025-09-30T14:56:27.699814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c4c93ac-29f0440c-f35e2d17-8433d0c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:27.700147Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:27.700166Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2223
2025-09-30T14:56:27.700340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2223 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:27.700382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2223 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:27.700390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2223 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:27.700394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:27.700829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2223 sessionId:  describe result for acl check
2025-09-30T14:56:27.700860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:27.700866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:27.700869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:27.700875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896250860334774:3403] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:27.701443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896250860334774:3403] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:27.701808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:27.703583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896250860334774:3403] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:27.703921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:27.704129Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:27.704140Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:27.704151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:27.704211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:27.704268Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896250770562244:2433]
2025-09-30T14:56:27.704998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:27.705363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:27.705433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:27.705799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:27.705878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:27.705887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:27.705888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:27.705890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:27.705891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:27.705892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:27.705894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:27.705895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:27.705896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:27.705897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:27.705899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.705900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.705901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.705902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:27.705903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:27.705910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:27.705920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:27.705924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:27.705927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:27.705930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:27.705935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:27.705939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:27.705943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:27.705946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:27.705950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:27.705955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.705958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.705961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.705964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:27.705967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:27.705977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:27.705984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:27.705990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:27.705995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:27.705998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:27.706004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:27.706007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:27.706012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:27.706016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:27.706020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:27.706024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:27.706028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:27.706033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:27.706037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:27.706042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:27.706047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:27.706053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:27.706057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:27.706061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:27.706065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:27.706071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.706076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.706080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.706084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.706088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.706100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.706105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:27.706109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:27.706116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:27.706121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:27.706162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:27.706431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896250860334774:3403] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:27.706451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896250860334774:3403] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:27.706455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896250860334774:3403] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:27.706463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2223 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:27.712551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:27.713512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:27.713534Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:27.713538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:27.713542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:27.713550Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2222 [2:7555896250770562244:2433]
2025-09-30T14:56:27.713569Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:27.713586Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:27.713590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:27.713593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:27.713598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:27.713616Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:27.713623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:27.713631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:27.713696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.713705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.713707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.713713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:27.713716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:27.713798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:27.713810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.713824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.713837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.713857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:27.713897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896250860334814:3403], now have 1 active actors on pipe
2025-09-30T14:56:27.713902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896250860334754:2454], now have 1 active actors on pipe
2025-09-30T14:56:27.713909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896250770562238:2433]
2025-09-30T14:56:27.713911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896250770562238:2433]
2025-09-30T14:56:27.713914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896250770562238:2433]
2025-09-30T14:56:27.713926Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:27.713942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:27.713943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:27.713948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:27.714065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2222
2025-09-30T14:56:27.713950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:27.713957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:27.714066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2222
2025-09-30T14:56:27.713960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:27.713995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896250770562238:2433]
2025-09-30T14:56:27.714002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:27.714011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:27.714243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:27.714258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:27.714286Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91d9f19-ce76c81-9edc3a9e-fa5078c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:27.714295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:27.714299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:27.714302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:27.714312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:27.714327Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:27.714345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:27.714564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:27.714574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:27.714589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:27.714702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2223 partition: 0 MaxSeqNo: 42 sessionId: src_id|91d9f19-ce76c81-9edc3a9e-fa5078c4_0
2025-09-30T14:56:27.715085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c4c93ac-29f0440c-f35e2d17-8433d0c8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|91d9f19-ce76c81-9edc3a9e-fa5078c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:27.718257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91d9f19-ce76c81-9edc3a9e-fa5078c4_0] Write session: try to update token
2025-09-30T14:56:27.718280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91d9f19-ce76c81-9edc3a9e-fa5078c4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:27.734460Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:27.734485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:27.734496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896250770562238:2433]
2025-09-30T14:56:27.734552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:27.734564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:27.734769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:27.734925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:27.735082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:27.735228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:27.735460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:27.735507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:27.737311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2223 sessionId: src_id|91d9f19-ce76c81-9edc3a9e-fa5078c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:27.740323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:27.740835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:27.740860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:27.740881Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:27.740883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:27.740885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:27.740888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:27.740894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896250770562238:2433]
2025-09-30T14:56:27.740897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896250770562238:2433]
2025-09-30T14:56:27.740900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896250770562238:2433]
2025-09-30T14:56:27.740938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:27.740943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:27.740948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.740949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:27.740949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:27.740952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:27.741071Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:27.791550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896250860334823:3180]
2025-09-30T14:56:27.792063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2222, pipe: [1:7555896250860334823:3180]
2025-09-30T14:56:27.859279Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:27.859727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:27.859771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896250860334823:3180], now have 1 active actors on pipe
2025-09-30T14:56:27.860815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91d9f19-ce76c81-9edc3a9e-fa5078c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:27.860829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91d9f19-ce76c81-9edc3a9e-fa5078c4_0] Write session will restart in 0.008213s
2025-09-30T14:56:27.860863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91d9f19-ce76c81-9edc3a9e-fa5078c4_0] Write session: Do CDS request
2025-09-30T14:56:27.860869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91d9f19-ce76c81-9edc3a9e-fa5078c4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:27.860303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:27.860407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:27.860410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:27.860480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2223 reason: error at write: Disconnected sessionId: src_id|91d9f19-ce76c81-9edc3a9e-fa5078c4_0
2025-09-30T14:56:27.860680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896250860334823:3180]
2025-09-30T14:56:27.860698Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:27.860718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2223 sessionId: src_id|91d9f19-ce76c81-9edc3a9e-fa5078c4_0 is DEAD
2025-09-30T14:56:27.870852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91d9f19-ce76c81-9edc3a9e-fa5078c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:27.870943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:27.870963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2224
2025-09-30T14:56:27.871590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2224 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:27.871638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2224 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:27.871651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2224 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:27.871655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:27.872160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2224 sessionId:  describe result for acl check
2025-09-30T14:56:27.872199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:27.872202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:27.872204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:27.872210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896250860334841:3409] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:27.872779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896250860334841:3409] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:27.876282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896250860334841:3409] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:27.880483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:27.881507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:27.881622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896250860334841:3409] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:27.881646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896250860334841:3409] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:27.881649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896250860334841:3409] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:27.881658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2224 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:27.881715Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:27.881726Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:27.881737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:27.881789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:27.881843Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896250770562317:2429]
2025-09-30T14:56:27.882562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:27.882873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:27.882934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:27.883285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:27.883359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:27.883369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:27.883370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:27.883371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:27.883372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:27.883374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:27.883375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:27.883377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:27.883378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:27.883379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:27.883380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.883383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.883384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.883385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:27.883386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:27.883391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:27.883401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:27.883405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:27.883410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:27.883413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:27.883417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:27.883422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:27.883426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:27.883430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:27.883434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:27.883438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.883442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.883447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.883451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:27.883455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:27.883462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:27.883470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:27.883477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:27.883482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:27.883488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:27.883493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:27.883497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:27.883503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:27.883508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:27.883514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:27.883519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:27.883524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:27.883528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:27.883534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:27.883552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:27.883562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:27.883569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:27.883580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:27.883584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:27.883595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:27.883600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.883610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.883614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.883629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.883639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.883644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.883648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:27.883653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:27.883658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:27.883663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:27.883707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:27.889857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:27.890816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:27.890836Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:27.890839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:27.890849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:27.890857Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2223 [2:7555896250770562317:2429]
2025-09-30T14:56:27.890873Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:27.890892Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:27.890905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:27.890908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:27.890913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:27.890929Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:27.890941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:27.890947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:27.891014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.891020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.891022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.891026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:27.891028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:27.891118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:27.891126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.891140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:27.891156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:27.891176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:27.891201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896250860334885:3409], now have 1 active actors on pipe
2025-09-30T14:56:27.891210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896250860334825:2454], now have 1 active actors on pipe
2025-09-30T14:56:27.891217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896250770562312:2429]
2025-09-30T14:56:27.891218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896250770562312:2429]
2025-09-30T14:56:27.891220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896250770562312:2429]
2025-09-30T14:56:27.891235Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:27.891261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:27.891267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:27.891274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:27.891276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:27.891281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:27.891284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:27.891321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896250770562312:2429]
2025-09-30T14:56:27.891344Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:27.891351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:27.891368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2223
2025-09-30T14:56:27.891400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2223
2025-09-30T14:56:27.891516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:27.891526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:27.891553Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67a07df7-2872ad5e-bda7b9b9-b73868b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:27.891564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:27.891568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:27.891570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:27.891588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:27.891603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:27.891624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:27.891994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:27.892007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:27.892037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:27.892173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2224 partition: 0 MaxSeqNo: 42 sessionId: src_id|67a07df7-2872ad5e-bda7b9b9-b73868b8_0
2025-09-30T14:56:27.892541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91d9f19-ce76c81-9edc3a9e-fa5078c4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|67a07df7-2872ad5e-bda7b9b9-b73868b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:27.895341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67a07df7-2872ad5e-bda7b9b9-b73868b8_0] Write session: try to update token
2025-09-30T14:56:27.895363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67a07df7-2872ad5e-bda7b9b9-b73868b8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:27.904252Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:27.904271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:27.904274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:27.904276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:27.904288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896250770562312:2429]
2025-09-30T14:56:27.904293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896250770562312:2429]
2025-09-30T14:56:27.904298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896250770562312:2429]
2025-09-30T14:56:27.904345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:27.904348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:27.904355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:27.904358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:27.904362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:27.904366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:27.904514Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:27.915300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2224 sessionId: src_id|67a07df7-2872ad5e-bda7b9b9-b73868b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:27.918073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:27.959482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896250860334896:3180]
2025-09-30T14:56:27.959800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2223, pipe: [1:7555896250860334896:3180]
2025-09-30T14:56:28.016684Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:28.017054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:28.017067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:28.017087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896250860334896:3180], now have 1 active actors on pipe
2025-09-30T14:56:28.017348Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:28.017853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67a07df7-2872ad5e-bda7b9b9-b73868b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:28.017866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67a07df7-2872ad5e-bda7b9b9-b73868b8_0] Write session will restart in 0.006981s
2025-09-30T14:56:28.017891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67a07df7-2872ad5e-bda7b9b9-b73868b8_0] Write session: Do CDS request
2025-09-30T14:56:28.017897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67a07df7-2872ad5e-bda7b9b9-b73868b8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:28.017391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896250860334896:3180]
2025-09-30T14:56:28.017414Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:28.017440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:28.017515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2224 reason: status is not ok: tablet will be restarted right now sessionId: src_id|67a07df7-2872ad5e-bda7b9b9-b73868b8_0
2025-09-30T14:56:28.017705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2224 sessionId: src_id|67a07df7-2872ad5e-bda7b9b9-b73868b8_0 is DEAD
2025-09-30T14:56:28.025781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67a07df7-2872ad5e-bda7b9b9-b73868b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:28.025858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:28.025877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2225
2025-09-30T14:56:28.026027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2225 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:28.026068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2225 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:28.026073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2225 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:28.026077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:28.026519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2225 sessionId:  describe result for acl check
2025-09-30T14:56:28.026562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:28.026562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:28.026601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:28.026609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:28.026616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896255155302230:3420] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:28.027151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896255155302230:3420] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:28.028376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:28.028569Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:28.028577Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:28.028586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:28.028638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:28.028671Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896255065529676:2426]
2025-09-30T14:56:28.028726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896255155302230:3420] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:28.029239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:28.029589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:28.029661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:28.030021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:28.030090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:28.030099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:28.030101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:28.030102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:28.030103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:28.030104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:28.030105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:28.030106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:28.030107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:28.030108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:28.030109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.030111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.030112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.030113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:28.030114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:28.030119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:28.030128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:28.030132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:28.030135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:28.030139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:28.030142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:28.030146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:28.030151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:28.030155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:28.030159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:28.030162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.030166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.030170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.030173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:28.030176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:28.030184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:28.030193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:28.030199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:28.030204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:28.030210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:28.030215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:28.030219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:28.030224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:28.030229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:28.030234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:28.030238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:28.030243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:28.030247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:28.030252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:28.030256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:28.030261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:28.030265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:28.030270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:28.030274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:28.030279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:28.030283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.030289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.030293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.030302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.030306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.030311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.030315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:28.030320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:28.030324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:28.030329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:28.030370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:28.031370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896255155302230:3420] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:28.031384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896255155302230:3420] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:28.031388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896255155302230:3420] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:28.031395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2225 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:28.036151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:28.037217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:28.037233Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:28.037235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:28.037239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:28.037245Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2224 [2:7555896255065529676:2426]
2025-09-30T14:56:28.037263Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:28.037279Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:28.037283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:28.037286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:28.037288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:28.037305Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:28.037318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:28.037344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:28.037414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.037421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.037425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.037429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:28.037431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:28.037579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:28.037588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.037601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.037612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.037632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:28.037658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896255155302194:2454], now have 1 active actors on pipe
2025-09-30T14:56:28.037669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896255155302273:3420], now have 1 active actors on pipe
2025-09-30T14:56:28.037677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896255065529671:2426]
2025-09-30T14:56:28.037683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896255065529671:2426]
2025-09-30T14:56:28.037634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2224
2025-09-30T14:56:28.037686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896255065529671:2426]
2025-09-30T14:56:28.037683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2224
2025-09-30T14:56:28.037700Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:28.037710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:28.037713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:28.037714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:28.037716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:28.037728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:28.037731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:28.037771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896255065529671:2426]
2025-09-30T14:56:28.037785Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:28.037801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:28.037805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:28.037810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:28.037851Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4186361-60930390-7441caaf-db9347c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:28.037867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:28.037874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:28.037877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:28.037886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:28.037896Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:28.037914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:28.038069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:28.038082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:28.038107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:28.038221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2225 partition: 0 MaxSeqNo: 42 sessionId: src_id|d4186361-60930390-7441caaf-db9347c8_0
2025-09-30T14:56:28.038595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67a07df7-2872ad5e-bda7b9b9-b73868b8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d4186361-60930390-7441caaf-db9347c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:28.041444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4186361-60930390-7441caaf-db9347c8_0] Write session: try to update token
2025-09-30T14:56:28.041462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4186361-60930390-7441caaf-db9347c8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:28.050328Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:28.050344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:28.050346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:28.050351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:28.050360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896255065529671:2426]
2025-09-30T14:56:28.050364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896255065529671:2426]
2025-09-30T14:56:28.050368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896255065529671:2426]
2025-09-30T14:56:28.050409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:28.050416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.050419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:28.050419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:28.050426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:28.050430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:28.050569Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:28.058364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2225 sessionId: src_id|d4186361-60930390-7441caaf-db9347c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:28.061522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:28.117185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896255155302302:3180]
2025-09-30T14:56:28.117525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2224, pipe: [1:7555896255155302302:3180]
2025-09-30T14:56:28.171597Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:28.171964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:28.171981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:28.172003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896255155302302:3180], now have 1 active actors on pipe
2025-09-30T14:56:28.172236Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:28.172249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:28.172253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:28.172299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896255155302302:3180]
2025-09-30T14:56:28.172330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2225 reason: error at write: Disconnected sessionId: src_id|d4186361-60930390-7441caaf-db9347c8_0
2025-09-30T14:56:28.172528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2225 sessionId: src_id|d4186361-60930390-7441caaf-db9347c8_0 is DEAD
2025-09-30T14:56:28.172556Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:28.172707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4186361-60930390-7441caaf-db9347c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:28.172719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4186361-60930390-7441caaf-db9347c8_0] Write session will restart in 0.006579s
2025-09-30T14:56:28.172742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4186361-60930390-7441caaf-db9347c8_0] Write session: Do CDS request
2025-09-30T14:56:28.172752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4186361-60930390-7441caaf-db9347c8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:28.180826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4186361-60930390-7441caaf-db9347c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:28.180869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:28.180888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2226
2025-09-30T14:56:28.181121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2226 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:28.181172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2226 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:28.181182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2226 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:28.181187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:28.181641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2226 sessionId:  describe result for acl check
2025-09-30T14:56:28.181684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:28.181687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:28.181689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:28.181694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896255155302321:3444] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:28.182312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896255155302321:3444] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:28.183927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:28.185189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896255155302321:3444] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:28.185961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:28.186174Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:28.186183Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:28.186193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:28.186241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:28.186275Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896255065529776:2392]
2025-09-30T14:56:28.186827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:28.187124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:28.187167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:28.187506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:28.187568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:28.187574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:28.187576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:28.187577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:28.187578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:28.187579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:28.187581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:28.187582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:28.187583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:28.187584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:28.187585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.187589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.187590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.187592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:28.187593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:28.187598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:28.187607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:28.187610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:28.187612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:28.187614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:28.187617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:28.187619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:28.187622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:28.187624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:28.187627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:28.187629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.187631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.187633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.187638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:28.187640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:28.187646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:28.187651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:28.187657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:28.187660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:28.187663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:28.187666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:28.187668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:28.187671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:28.187674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:28.187677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:28.187680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:28.187683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:28.187686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:28.187690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:28.187692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:28.187695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:28.187698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:28.187701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:28.187703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:28.187707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:28.187710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.187713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.187716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.187718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.187721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.187724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.187726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:28.187729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:28.187732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:28.187736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:28.187768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:28.188798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896255155302321:3444] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:28.188815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896255155302321:3444] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:28.188818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896255155302321:3444] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:28.188827Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2226 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:28.193419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:28.194387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:28.194402Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:28.194405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:28.194409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:28.194417Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2225 [2:7555896255065529776:2392]
2025-09-30T14:56:28.194434Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:28.194450Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:28.194453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:28.194455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:28.194460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:28.194477Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:28.194485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:28.194497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:28.194558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.194566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.194568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.194572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:28.194574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:28.194640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:28.194647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.194661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.194678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.194697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:28.194721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896255155302306:2454], now have 1 active actors on pipe
2025-09-30T14:56:28.194729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896255155302371:3444], now have 1 active actors on pipe
2025-09-30T14:56:28.194735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896255065529770:2392]
2025-09-30T14:56:28.194738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896255065529770:2392]
2025-09-30T14:56:28.194740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896255065529770:2392]
2025-09-30T14:56:28.194753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:28.194767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:28.194777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:28.194781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:28.194783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:28.194788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:28.194791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:28.194814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896255065529770:2392]
2025-09-30T14:56:28.194817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:28.194840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:28.194848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:28.194853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:28.194801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2225
2025-09-30T14:56:28.194823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2225
2025-09-30T14:56:28.194886Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a7c4f8d-81be633a-33520bfa-79e46ea4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:28.194899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:28.194902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:28.194905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:28.194919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:28.194928Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:28.194947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:28.195103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:28.195112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:28.195125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:28.195210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2226 partition: 0 MaxSeqNo: 42 sessionId: src_id|4a7c4f8d-81be633a-33520bfa-79e46ea4_0
2025-09-30T14:56:28.195677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4186361-60930390-7441caaf-db9347c8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4a7c4f8d-81be633a-33520bfa-79e46ea4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:28.198512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a7c4f8d-81be633a-33520bfa-79e46ea4_0] Write session: try to update token
2025-09-30T14:56:28.198532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a7c4f8d-81be633a-33520bfa-79e46ea4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:28.208268Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:28.208286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:28.208289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:28.208291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:28.208301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896255065529770:2392]
2025-09-30T14:56:28.208305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896255065529770:2392]
2025-09-30T14:56:28.208309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896255065529770:2392]
2025-09-30T14:56:28.208351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:28.208356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:28.208358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.208361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:28.208363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:28.208367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:28.208504Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:28.215052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2226 sessionId: src_id|4a7c4f8d-81be633a-33520bfa-79e46ea4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:28.218179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:28.272339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896255155302384:3180]
2025-09-30T14:56:28.272668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2225, pipe: [1:7555896255155302384:3180]
2025-09-30T14:56:28.330037Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:28.330453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:28.330474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:28.330531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896255155302384:3180], now have 1 active actors on pipe
2025-09-30T14:56:28.330800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896255155302384:3180]
2025-09-30T14:56:28.330815Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:28.330840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:28.330843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:28.330935Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:28.331265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a7c4f8d-81be633a-33520bfa-79e46ea4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:28.331280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a7c4f8d-81be633a-33520bfa-79e46ea4_0] Write session will restart in 0.006369s
2025-09-30T14:56:28.331304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a7c4f8d-81be633a-33520bfa-79e46ea4_0] Write session: Do CDS request
2025-09-30T14:56:28.331310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a7c4f8d-81be633a-33520bfa-79e46ea4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:28.330908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2226 reason: error at write: Disconnected sessionId: src_id|4a7c4f8d-81be633a-33520bfa-79e46ea4_0
2025-09-30T14:56:28.331100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2226 sessionId: src_id|4a7c4f8d-81be633a-33520bfa-79e46ea4_0 is DEAD
2025-09-30T14:56:28.338840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a7c4f8d-81be633a-33520bfa-79e46ea4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:28.338942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:28.338974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2227
2025-09-30T14:56:28.339139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2227 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:28.339177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2227 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:28.339187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2227 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:28.339192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:28.339686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2227 sessionId:  describe result for acl check
2025-09-30T14:56:28.339734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:28.339742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:28.339744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:28.339749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896255155302395:3455] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:28.340324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896255155302395:3455] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:28.342788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896255155302395:3455] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:28.345202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:28.346815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:28.346966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896255155302395:3455] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:28.346997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896255155302395:3455] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:28.347001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896255155302395:3455] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:28.347010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2227 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:28.347036Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:28.347047Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:28.347059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:28.347131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:28.347172Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896255065529841:2389]
2025-09-30T14:56:28.347863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:28.348182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:28.348249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:28.348626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:28.348713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:28.348720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:28.348722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:28.348723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:28.348724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:28.348726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:28.348727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:28.348729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:28.348730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:28.348731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:28.348732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.348733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.348735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.348738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:28.348740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:28.348746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:28.348757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:28.348761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:28.348765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:28.348769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:28.348773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:28.348777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:28.348781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:28.348785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:28.348789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:28.348793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.348796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.348800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.348804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:28.348808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:28.348818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:28.348826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:28.348833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:28.348839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:28.348843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:28.348848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:28.348852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:28.348858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:28.348863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:28.348869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:28.348873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:28.348878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:28.348883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:28.348888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:28.348893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:28.348898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:28.348905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:28.348910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:28.348914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:28.348919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:28.348924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.348938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.348948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.348953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.348965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.348970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.348980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:28.348985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:28.348990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:28.348999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:28.349047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:28.355059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:28.356063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:28.356080Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:28.356082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:28.356088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:28.356096Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2226 [2:7555896255065529841:2389]
2025-09-30T14:56:28.356113Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:28.356126Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:28.356129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:28.356133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:28.356135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:28.356147Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:28.356158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:28.356163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:28.356211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.356217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.356218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.356221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:28.356223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:28.356281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:28.356289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.356303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.356318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.356332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:28.356354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896255065529836:2389]
2025-09-30T14:56:28.356363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896255065529836:2389]
2025-09-30T14:56:28.356364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896255065529836:2389]
2025-09-30T14:56:28.356378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:28.356390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:28.356395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896255155302448:3455], now have 1 active actors on pipe
2025-09-30T14:56:28.356398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:28.356400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896255155302385:2454], now have 1 active actors on pipe
2025-09-30T14:56:28.356400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:28.356404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:28.356414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:28.356416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:28.356445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896255065529836:2389]
2025-09-30T14:56:28.356454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:28.356461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:28.356457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2226
2025-09-30T14:56:28.356465Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2226
2025-09-30T14:56:28.356512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:28.356525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:28.356550Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34cce5c0-ab35d317-4b367efa-2114e515_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:28.356556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:28.356559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:28.356561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:28.356570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:28.356580Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:28.356592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:28.356758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:28.356767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:28.356780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:28.356863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2227 partition: 0 MaxSeqNo: 42 sessionId: src_id|34cce5c0-ab35d317-4b367efa-2114e515_0
2025-09-30T14:56:28.357348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a7c4f8d-81be633a-33520bfa-79e46ea4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|34cce5c0-ab35d317-4b367efa-2114e515_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:28.360247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34cce5c0-ab35d317-4b367efa-2114e515_0] Write session: try to update token
2025-09-30T14:56:28.360270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34cce5c0-ab35d317-4b367efa-2114e515_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:28.371109Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:28.371134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:28.371137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:28.371139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:28.371150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896255065529836:2389]
2025-09-30T14:56:28.371154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896255065529836:2389]
2025-09-30T14:56:28.371159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896255065529836:2389]
2025-09-30T14:56:28.371206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:28.371214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.371216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:28.371216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:28.371224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:28.371228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:28.371431Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:28.375823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2227 sessionId: src_id|34cce5c0-ab35d317-4b367efa-2114e515_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:28.378709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:28.431061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896255155302459:3180]
2025-09-30T14:56:28.431397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2226, pipe: [1:7555896255155302459:3180]
2025-09-30T14:56:28.485247Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:28.485589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:28.485601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:28.485635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896255155302459:3180], now have 1 active actors on pipe
2025-09-30T14:56:28.485805Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:28.485901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896255155302459:3180]
2025-09-30T14:56:28.485921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:28.485940Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:28.486009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2227 reason: status is not ok: tablet will be restarted right now sessionId: src_id|34cce5c0-ab35d317-4b367efa-2114e515_0
2025-09-30T14:56:28.486185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2227 sessionId: src_id|34cce5c0-ab35d317-4b367efa-2114e515_0 is DEAD
2025-09-30T14:56:28.486361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34cce5c0-ab35d317-4b367efa-2114e515_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:28.486375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34cce5c0-ab35d317-4b367efa-2114e515_0] Write session will restart in 0.005864s
2025-09-30T14:56:28.486404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34cce5c0-ab35d317-4b367efa-2114e515_0] Write session: Do CDS request
2025-09-30T14:56:28.486411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34cce5c0-ab35d317-4b367efa-2114e515_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:28.493769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34cce5c0-ab35d317-4b367efa-2114e515_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:28.493986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:28.494004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2228
2025-09-30T14:56:28.494137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2228 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:28.494197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2228 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:28.494208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2228 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:28.494213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:28.494648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2228 sessionId:  describe result for acl check
2025-09-30T14:56:28.494692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:28.494700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:28.494702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:28.494708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896255155302485:4239] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:28.495294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896255155302485:4239] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:28.495792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:28.497341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:28.497498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896255155302485:4239] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:28.497526Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:28.497533Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:28.497542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:28.497590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:28.497620Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896255065529908:2377]
2025-09-30T14:56:28.498272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:28.498625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:28.498692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:28.499059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:28.499147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:28.499154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:28.499155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:28.499157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:28.499158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:28.499159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:28.499160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:28.499161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:28.499163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:28.499164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:28.499165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.499166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.499168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.499169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:28.499170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:28.499176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:28.499187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:28.499191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:28.499195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:28.499199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:28.499204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:28.499208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:28.499212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:28.499218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:28.499222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:28.499226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.499229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.499233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.499238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:28.499262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:28.499271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:28.499278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:28.499285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:28.499290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:28.499294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:28.499299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:28.499303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:28.499307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:28.499312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:28.499317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:28.499322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:28.499326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:28.499331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:28.499336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:28.499340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:28.499345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:28.499349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:28.499354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:28.499359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:28.499364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:28.499369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.499374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.499378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.499383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.499400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.499405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.499409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:28.499413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:28.499418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:28.499422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:28.499466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:28.499900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896255155302485:4239] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:28.499915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896255155302485:4239] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:28.499918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896255155302485:4239] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:28.499927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2228 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:28.504883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:28.505937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:28.505956Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:28.505959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:28.505963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:28.505971Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2227 [2:7555896255065529908:2377]
2025-09-30T14:56:28.505987Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:28.506003Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:28.506010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:28.506013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:28.506016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:28.506035Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:28.506041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:28.506051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:28.506118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.506123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.506125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.506128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:28.506130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:28.506195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:28.506203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.506216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.506233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.506249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:28.506268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896255155302460:2454], now have 1 active actors on pipe
2025-09-30T14:56:28.506273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896255155302527:4239], now have 1 active actors on pipe
2025-09-30T14:56:28.506282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896255065529903:2377]
2025-09-30T14:56:28.506288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896255065529903:2377]
2025-09-30T14:56:28.506291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896255065529903:2377]
2025-09-30T14:56:28.506304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:28.506320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:28.506334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:28.506339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:28.506342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:28.506343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:28.506344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:28.506333Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2227
2025-09-30T14:56:28.506342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2227
2025-09-30T14:56:28.506376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896255065529903:2377]
2025-09-30T14:56:28.506386Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:28.506403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:28.506408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:28.506414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:28.506459Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35938496-8d109ee9-8a031359-c4a2230f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:28.506473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:28.506487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:28.506489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:28.506498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:28.506506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:28.506527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:28.506686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:28.506699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:28.506718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:28.506813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2228 partition: 0 MaxSeqNo: 42 sessionId: src_id|35938496-8d109ee9-8a031359-c4a2230f_0
2025-09-30T14:56:28.507194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34cce5c0-ab35d317-4b367efa-2114e515_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|35938496-8d109ee9-8a031359-c4a2230f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:28.510003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35938496-8d109ee9-8a031359-c4a2230f_0] Write session: try to update token
2025-09-30T14:56:28.510023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35938496-8d109ee9-8a031359-c4a2230f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:28.519744Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:28.519763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:28.519766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:28.519768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:28.519779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896255065529903:2377]
2025-09-30T14:56:28.519784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896255065529903:2377]
2025-09-30T14:56:28.519789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896255065529903:2377]
2025-09-30T14:56:28.519825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:28.519833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.519838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:28.519861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:28.519880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:28.519892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:28.519990Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:28.525291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2228 sessionId: src_id|35938496-8d109ee9-8a031359-c4a2230f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:28.527859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:28.586178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896255155302535:3180]
2025-09-30T14:56:28.586517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2227, pipe: [1:7555896255155302535:3180]
2025-09-30T14:56:28.634679Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:28.635058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:28.635080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:28.635129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896255155302535:3180], now have 1 active actors on pipe
2025-09-30T14:56:28.635394Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:28.635406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:28.635415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896255155302535:3180]
2025-09-30T14:56:28.635441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:28.635443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:28.635516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2228 reason: error at write: Disconnected sessionId: src_id|35938496-8d109ee9-8a031359-c4a2230f_0
2025-09-30T14:56:28.635705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2228 sessionId: src_id|35938496-8d109ee9-8a031359-c4a2230f_0 is DEAD
2025-09-30T14:56:28.635862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35938496-8d109ee9-8a031359-c4a2230f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:28.635877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35938496-8d109ee9-8a031359-c4a2230f_0] Write session will restart in 0.007420s
2025-09-30T14:56:28.635903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35938496-8d109ee9-8a031359-c4a2230f_0] Write session: Do CDS request
2025-09-30T14:56:28.635908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35938496-8d109ee9-8a031359-c4a2230f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:28.644826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35938496-8d109ee9-8a031359-c4a2230f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:28.644949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:28.644969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2229
2025-09-30T14:56:28.645082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2229 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:28.645118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2229 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:28.645140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2229 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:28.645149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:28.645499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:28.645642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2229 sessionId:  describe result for acl check
2025-09-30T14:56:28.645686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:28.645688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:28.645690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:28.645697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896255155302564:3473] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:28.646292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896255155302564:3473] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:28.647318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:28.647495Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:28.647505Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:28.647517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:28.647581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:28.647625Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896255065529976:2370]
2025-09-30T14:56:28.648284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:28.648375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896255155302564:3473] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:28.648589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:28.648670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:28.648949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:28.649011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:28.649018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:28.649019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:28.649020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:28.649020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:28.649021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:28.649022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:28.649023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:28.649024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:28.649025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:28.649026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.649027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.649028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.649029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:28.649029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:28.649033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:28.649040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:28.649043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:28.649046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:28.649049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:28.649051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:28.649054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:28.649056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:28.649058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:28.649061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:28.649066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.649068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.649071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.649073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:28.649075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:28.649080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:28.649085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:28.649089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:28.649092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:28.649095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:28.649098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:28.649101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:28.649104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:28.649107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:28.649110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:28.649112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:28.649116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:28.649119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:28.649122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:28.649124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:28.649127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:28.649129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:28.649132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:28.649135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:28.649138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:28.649143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.649146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.649149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.649152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.649154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.649157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.649161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:28.649164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:28.649167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:28.649170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:28.649196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:28.654412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896255155302564:3473] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:28.654434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896255155302564:3473] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:28.654437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896255155302564:3473] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:28.654447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2229 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:28.654759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:28.655780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:28.655796Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:28.655799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:28.655803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:28.655811Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2228 [2:7555896255065529976:2370]
2025-09-30T14:56:28.655830Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:28.655850Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:28.655857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:28.655861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:28.655864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:28.655882Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:28.655894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:28.655903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:28.655965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.655973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.655975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.655979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:28.655983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:28.656059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:28.656067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.656082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.656101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.656124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:28.656143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896255155302604:3473], now have 1 active actors on pipe
2025-09-30T14:56:28.656152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896255155302536:2454], now have 1 active actors on pipe
2025-09-30T14:56:28.656158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896255065529970:2370]
2025-09-30T14:56:28.656161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896255065529970:2370]
2025-09-30T14:56:28.656163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896255065529970:2370]
2025-09-30T14:56:28.656175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:28.656191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:28.656193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:28.656201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:28.656204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:28.656211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:28.656214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:28.656214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2228
2025-09-30T14:56:28.656220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2228
2025-09-30T14:56:28.656249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896255065529970:2370]
2025-09-30T14:56:28.656260Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:28.656263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:28.656280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:28.656289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:28.656338Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8acfe565-45db254a-44a8d03f-cd6c2836_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:28.656353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:28.656358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:28.656361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:28.656370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:28.656378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:28.656405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:28.656579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:28.656586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:28.656599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:28.656672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2229 partition: 0 MaxSeqNo: 42 sessionId: src_id|8acfe565-45db254a-44a8d03f-cd6c2836_0
2025-09-30T14:56:28.657069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35938496-8d109ee9-8a031359-c4a2230f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8acfe565-45db254a-44a8d03f-cd6c2836_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:28.660064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8acfe565-45db254a-44a8d03f-cd6c2836_0] Write session: try to update token
2025-09-30T14:56:28.660086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8acfe565-45db254a-44a8d03f-cd6c2836_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:28.669115Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:28.669134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:28.669137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:28.669139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:28.669154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896255065529970:2370]
2025-09-30T14:56:28.669159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896255065529970:2370]
2025-09-30T14:56:28.669163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896255065529970:2370]
2025-09-30T14:56:28.669207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:28.669214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.669217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:28.669222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:28.669224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:28.669230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:28.669461Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:28.675701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2229 sessionId: src_id|8acfe565-45db254a-44a8d03f-cd6c2836_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:28.678908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:28.735700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896255155302614:3180]
2025-09-30T14:56:28.735981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2228, pipe: [1:7555896255155302614:3180]
2025-09-30T14:56:28.781256Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:28.781711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:28.781726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:28.781767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896255155302614:3180], now have 1 active actors on pipe
2025-09-30T14:56:28.781958Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:28.782067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:28.782071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:28.782144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896255155302614:3180]
2025-09-30T14:56:28.782160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2229 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8acfe565-45db254a-44a8d03f-cd6c2836_0
2025-09-30T14:56:28.782359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2229 sessionId: src_id|8acfe565-45db254a-44a8d03f-cd6c2836_0 is DEAD
2025-09-30T14:56:28.782552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8acfe565-45db254a-44a8d03f-cd6c2836_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:28.782564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8acfe565-45db254a-44a8d03f-cd6c2836_0] Write session will restart in 0.008822s
2025-09-30T14:56:28.782587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8acfe565-45db254a-44a8d03f-cd6c2836_0] Write session: Do CDS request
2025-09-30T14:56:28.782594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8acfe565-45db254a-44a8d03f-cd6c2836_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:28.791502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:28.792829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8acfe565-45db254a-44a8d03f-cd6c2836_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:28.792863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:28.792886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2230
2025-09-30T14:56:28.793072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2230 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:28.793108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2230 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:28.793119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2230 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:28.793123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:28.793359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:28.793563Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:28.793560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2230 sessionId:  describe result for acl check
2025-09-30T14:56:28.793574Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:28.793586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:28.793597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:28.793604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:28.793606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:28.793612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896255155302645:3479] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:28.793642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:28.793681Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896255065530043:2368]
2025-09-30T14:56:28.794140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896255155302645:3479] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:28.794314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:28.794600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:28.794665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:28.794994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:28.795062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:28.795068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:28.795069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:28.795070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:28.795071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:28.795073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:28.795074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:28.795075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:28.795077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:28.795078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:28.795079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.795080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.795081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.795083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:28.795084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:28.795090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:28.795099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:28.795103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:28.795108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:28.795111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:28.795115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:28.795118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:28.795121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:28.795125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:28.795128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:28.795132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.795135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.795138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.795142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:28.795145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:28.795151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:28.795159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:28.795165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:28.795170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:28.795175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:28.795181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:28.795185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:28.795190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:28.795196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:28.795201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:28.795206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:28.795210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:28.795215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:28.795220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:28.795225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:28.795230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:28.795240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:28.795263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:28.795272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:28.795278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:28.795283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.795288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.795297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.795302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.795311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.795316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.795326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:28.795332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:28.795341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:28.795346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:28.795395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:28.795834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896255155302645:3479] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:28.800335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896255155302645:3479] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:28.800356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896255155302645:3479] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:28.800360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896255155302645:3479] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:28.800369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2230 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:28.800712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:28.801610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:28.801626Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:28.801631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:28.801635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:28.801640Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2229 [2:7555896255065530043:2368]
2025-09-30T14:56:28.801652Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:28.801664Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:28.801666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:28.801668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:28.801671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:28.801684Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:28.801690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:28.801696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:28.801752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.801761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.801763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.801767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:28.801768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:28.801830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:28.801839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.801852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.801863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.801879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:28.801902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896255155302615:2454], now have 1 active actors on pipe
2025-09-30T14:56:28.801910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896255155302683:3479], now have 1 active actors on pipe
2025-09-30T14:56:28.801917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896255065530038:2368]
2025-09-30T14:56:28.801924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896255065530038:2368]
2025-09-30T14:56:28.801926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896255065530038:2368]
2025-09-30T14:56:28.801941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:28.801957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:28.801961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:28.801965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:28.801967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:28.801972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:28.801975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:28.802004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896255065530038:2368]
2025-09-30T14:56:28.802014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:28.801991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2229
2025-09-30T14:56:28.801995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2229
2025-09-30T14:56:28.802047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:28.802146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:28.802153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:28.802173Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|21aed465-461a793f-5e7274ac-e4e3e47d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:28.802183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:28.802186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:28.802187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:28.802195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:28.802201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:28.802215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:28.802505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:28.802512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:28.802525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:28.802607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2230 partition: 0 MaxSeqNo: 42 sessionId: src_id|21aed465-461a793f-5e7274ac-e4e3e47d_0
2025-09-30T14:56:28.802970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8acfe565-45db254a-44a8d03f-cd6c2836_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|21aed465-461a793f-5e7274ac-e4e3e47d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:28.805893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21aed465-461a793f-5e7274ac-e4e3e47d_0] Write session: try to update token
2025-09-30T14:56:28.805917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21aed465-461a793f-5e7274ac-e4e3e47d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:28.813956Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:28.813976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:28.813978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:28.813980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:28.813988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896255065530038:2368]
2025-09-30T14:56:28.813992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896255065530038:2368]
2025-09-30T14:56:28.813995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896255065530038:2368]
2025-09-30T14:56:28.814030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:28.814036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.814037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:28.814055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:28.814061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:28.814065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:28.814171Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:28.821142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2230 sessionId: src_id|21aed465-461a793f-5e7274ac-e4e3e47d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:28.824019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:28.882112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896255155302692:3180]
2025-09-30T14:56:28.882430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2229, pipe: [1:7555896255155302692:3180]
2025-09-30T14:56:28.923282Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:28.923695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:28.923712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:28.923732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896255155302692:3180], now have 1 active actors on pipe
2025-09-30T14:56:28.923962Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:28.923956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:28.923970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896255155302692:3180]
2025-09-30T14:56:28.924010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:28.924013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:28.924090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2230 reason: error at write: Disconnected sessionId: src_id|21aed465-461a793f-5e7274ac-e4e3e47d_0
2025-09-30T14:56:28.924307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2230 sessionId: src_id|21aed465-461a793f-5e7274ac-e4e3e47d_0 is DEAD
2025-09-30T14:56:28.924461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21aed465-461a793f-5e7274ac-e4e3e47d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:28.924469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21aed465-461a793f-5e7274ac-e4e3e47d_0] Write session will restart in 0.006831s
2025-09-30T14:56:28.924493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21aed465-461a793f-5e7274ac-e4e3e47d_0] Write session: Do CDS request
2025-09-30T14:56:28.924499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21aed465-461a793f-5e7274ac-e4e3e47d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:28.932805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21aed465-461a793f-5e7274ac-e4e3e47d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:28.932877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:28.932897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2231
2025-09-30T14:56:28.933077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2231 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:28.933125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2231 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:28.933132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2231 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:28.933136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:28.933226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:28.933604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2231 sessionId:  describe result for acl check
2025-09-30T14:56:28.933651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:28.933658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:28.933660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:28.933666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896255155302724:3489] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:28.934213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896255155302724:3489] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:28.934770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:28.934988Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:28.934995Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:28.935006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:28.935061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:28.935112Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896255065530126:2349]
2025-09-30T14:56:28.935752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:28.936032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896255155302724:3489] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:28.936122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:28.936169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:28.936493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:28.936576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:28.936585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:28.936586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:28.936587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:28.936589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:28.936589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:28.936590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:28.936592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:28.936593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:28.936594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:28.936596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.936597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.936598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.936599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:28.936600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:28.936605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:28.936616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:28.936619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:28.936623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:28.936627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:28.936631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:28.936635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:28.936638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:28.936642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:28.936645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:28.936649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.936652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.936656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.936660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:28.936664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:28.936671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:28.936680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:28.936687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:28.936692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:28.936696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:28.936701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:28.936706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:28.936711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:28.936716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:28.936722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:28.936726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:28.936732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:28.936742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:28.936747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:28.936753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:28.936762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:28.936768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:28.936772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:28.936780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:28.936785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:28.936790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.936799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.936803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.936808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.936814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.936823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.936828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:28.936833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:28.936842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:28.936847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:28.936889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:28.941981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896255155302724:3489] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:28.942005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896255155302724:3489] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:28.942010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896255155302724:3489] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:28.942030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2231 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:28.942282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:28.943264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:28.943282Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:28.943285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:28.943293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:28.943299Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2230 [2:7555896255065530126:2349]
2025-09-30T14:56:28.943317Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:28.943332Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:28.943335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:28.943338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:28.943340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:28.943357Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:28.943369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:28.943375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:28.943446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.943453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.943457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.943462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:28.943464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:28.943543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:28.943554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.943567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:28.943581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:28.943600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:28.943619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896255155302763:3489], now have 1 active actors on pipe
2025-09-30T14:56:28.943624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896255155302693:2454], now have 1 active actors on pipe
2025-09-30T14:56:28.943630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896255065530121:2349]
2025-09-30T14:56:28.943638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896255065530121:2349]
2025-09-30T14:56:28.943641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896255065530121:2349]
2025-09-30T14:56:28.943655Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:28.943645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2230
2025-09-30T14:56:28.943668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:28.943667Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2230
2025-09-30T14:56:28.943669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:28.943677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:28.943680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:28.943684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:28.943687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:28.943732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:28.943742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:28.943758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896255065530121:2349]
2025-09-30T14:56:28.943769Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:28.943782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:28.943798Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|714bbc26-37125bcd-73273cce-4b34bbe5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:28.943808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:28.943813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:28.943815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:28.943825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:28.943834Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:28.943857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:28.944014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:28.944022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:28.944034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:28.944134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2231 partition: 0 MaxSeqNo: 42 sessionId: src_id|714bbc26-37125bcd-73273cce-4b34bbe5_0
2025-09-30T14:56:28.944475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21aed465-461a793f-5e7274ac-e4e3e47d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|714bbc26-37125bcd-73273cce-4b34bbe5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:28.947400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|714bbc26-37125bcd-73273cce-4b34bbe5_0] Write session: try to update token
2025-09-30T14:56:28.947420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|714bbc26-37125bcd-73273cce-4b34bbe5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:28.956365Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:28.956389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:28.956391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:28.956394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:28.956403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896255065530121:2349]
2025-09-30T14:56:28.956408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896255065530121:2349]
2025-09-30T14:56:28.956413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896255065530121:2349]
2025-09-30T14:56:28.956452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:28.956455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:28.956459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:28.956463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:28.956468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:28.956471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:28.956617Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:28.965679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2231 sessionId: src_id|714bbc26-37125bcd-73273cce-4b34bbe5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:28.968541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:29.023908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896259450270067:3180]
2025-09-30T14:56:29.024250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2230, pipe: [1:7555896259450270067:3180]
2025-09-30T14:56:29.072655Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:29.073088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:29.073104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:29.073126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896259450270067:3180], now have 1 active actors on pipe
2025-09-30T14:56:29.073389Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:29.073451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:29.073458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896259450270067:3180]
2025-09-30T14:56:29.073491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:29.073569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2231 reason: status is not ok: tablet will be restarted right now sessionId: src_id|714bbc26-37125bcd-73273cce-4b34bbe5_0
2025-09-30T14:56:29.073756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2231 sessionId: src_id|714bbc26-37125bcd-73273cce-4b34bbe5_0 is DEAD
2025-09-30T14:56:29.074006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|714bbc26-37125bcd-73273cce-4b34bbe5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:29.074018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|714bbc26-37125bcd-73273cce-4b34bbe5_0] Write session will restart in 0.005788s
2025-09-30T14:56:29.074052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|714bbc26-37125bcd-73273cce-4b34bbe5_0] Write session: Do CDS request
2025-09-30T14:56:29.074059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|714bbc26-37125bcd-73273cce-4b34bbe5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:29.080796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|714bbc26-37125bcd-73273cce-4b34bbe5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:29.083354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:29.083379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2232
2025-09-30T14:56:29.083370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:29.083577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2232 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:29.083632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2232 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:29.083643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2232 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:29.083648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:29.084047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2232 sessionId:  describe result for acl check
2025-09-30T14:56:29.084082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:29.084083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:29.084085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:29.084092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896259450270116:3502] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:29.084565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896259450270116:3502] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:29.085589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:29.085799Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:29.085815Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:29.085828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:29.085891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:29.085932Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896259360497497:2345]
2025-09-30T14:56:29.086566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:29.086711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896259450270116:3502] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:29.086835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:29.086882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:29.087187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:29.087282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:29.087289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:29.087291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:29.087292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:29.087293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:29.087294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:29.087295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:29.087297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:29.087298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:29.087300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:29.087306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.087307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.087308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.087309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:29.087311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:29.087318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:29.087329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:29.087333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:29.087336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:29.087340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:29.087344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:29.087348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:29.087351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:29.087355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:29.087359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:29.087362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.087366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.087369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.087373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:29.087376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:29.087384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:29.087392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:29.087399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:29.087404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:29.087408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:29.087412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:29.087418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:29.087422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:29.087429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:29.087433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:29.087437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:29.087442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:29.087455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:29.087461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:29.087464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:29.087468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:29.087475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:29.087480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:29.087484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:29.087488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:29.087492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.087496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.087500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.087504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.087508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.087513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.087516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:29.087520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:29.087524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:29.087529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:29.087570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:29.093472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896259450270116:3502] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:29.093495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896259450270116:3502] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:29.093503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896259450270116:3502] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:29.093512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2232 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:29.093746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:29.094755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:29.094771Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:29.094774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:29.094778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:29.094785Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2231 [2:7555896259360497497:2345]
2025-09-30T14:56:29.094801Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:29.094820Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:29.094823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:29.094827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:29.094829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:29.094846Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:29.094859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:29.094865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:29.094934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.094941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.094943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.094946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:29.094949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:29.095021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:29.095029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.095043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.095063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.095087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:29.095109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896259360497487:2345]
2025-09-30T14:56:29.095116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896259360497487:2345]
2025-09-30T14:56:29.095119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896259360497487:2345]
2025-09-30T14:56:29.095133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:29.095150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896259450270080:2454], now have 1 active actors on pipe
2025-09-30T14:56:29.095159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896259450270163:3502], now have 1 active actors on pipe
2025-09-30T14:56:29.095161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:29.095166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:29.095168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:29.095169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:29.095185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:29.095189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:29.095187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2231
2025-09-30T14:56:29.095226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2231
2025-09-30T14:56:29.095228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896259360497487:2345]
2025-09-30T14:56:29.095262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:29.095292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:29.095331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:29.095336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:29.095361Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfc96a10-be72df99-838c299b-23eaa236_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:29.095368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:29.095372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:29.095374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:29.095384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:29.095393Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:29.095407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:29.095688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:29.095703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:29.095728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:29.095807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2232 partition: 0 MaxSeqNo: 42 sessionId: src_id|cfc96a10-be72df99-838c299b-23eaa236_0
2025-09-30T14:56:29.096184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|714bbc26-37125bcd-73273cce-4b34bbe5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cfc96a10-be72df99-838c299b-23eaa236_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:29.099217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc96a10-be72df99-838c299b-23eaa236_0] Write session: try to update token
2025-09-30T14:56:29.099236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc96a10-be72df99-838c299b-23eaa236_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:29.109848Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:29.109867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:29.109876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896259360497487:2345]
2025-09-30T14:56:29.109921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:29.109932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:29.110115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:29.110276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:29.110436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:29.110583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:29.110782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:29.110830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:29.122374Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:29.122395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:29.122398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:29.122400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:29.122418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896259360497487:2345]
2025-09-30T14:56:29.122423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896259360497487:2345]
2025-09-30T14:56:29.122429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896259360497487:2345]
2025-09-30T14:56:29.122476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:29.122482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:29.122484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.122486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:29.122487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:29.122494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:29.122666Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:29.129639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2232 sessionId: src_id|cfc96a10-be72df99-838c299b-23eaa236_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:29.132704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:29.175343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896259450270182:3180]
2025-09-30T14:56:29.175904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2231, pipe: [1:7555896259450270182:3180]
2025-09-30T14:56:29.241520Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:29.241865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:29.241879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:29.241900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896259450270182:3180], now have 1 active actors on pipe
2025-09-30T14:56:29.242188Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:29.242167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:29.242234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:29.242238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:29.242329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2232 reason: error at write: Disconnected sessionId: src_id|cfc96a10-be72df99-838c299b-23eaa236_0
2025-09-30T14:56:29.242441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896259450270182:3180]
2025-09-30T14:56:29.242516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2232 sessionId: src_id|cfc96a10-be72df99-838c299b-23eaa236_0 is DEAD
2025-09-30T14:56:29.242670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc96a10-be72df99-838c299b-23eaa236_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:29.242682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc96a10-be72df99-838c299b-23eaa236_0] Write session will restart in 0.008571s
2025-09-30T14:56:29.242710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc96a10-be72df99-838c299b-23eaa236_0] Write session: Do CDS request
2025-09-30T14:56:29.242716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc96a10-be72df99-838c299b-23eaa236_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:29.252550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:29.252843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc96a10-be72df99-838c299b-23eaa236_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:29.252911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:29.252931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2233
2025-09-30T14:56:29.253103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2233 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:29.253140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2233 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:29.253152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2233 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:29.253157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:29.253607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2233 sessionId:  describe result for acl check
2025-09-30T14:56:29.253642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:29.253650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:29.253652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:29.253658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896259450270224:3526] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:29.254482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896259450270224:3526] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:29.254961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:29.255174Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:29.255182Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:29.255192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:29.255262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:29.255309Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896259360497601:2295]
2025-09-30T14:56:29.255928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:29.256324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:29.256387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:29.256755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:29.256815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:29.256821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:29.256823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:29.256824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:29.256825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:29.256826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:29.256827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:29.256829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:29.256830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:29.256831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:29.256832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.256833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.256835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.256836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:29.256837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:29.256844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:29.256854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:29.256858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:29.256863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:29.256867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:29.256871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:29.256875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:29.256879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:29.256884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:29.256889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:29.256894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.256898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.256902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.256906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:29.256911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:29.256920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:29.256928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:29.256935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:29.256941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:29.256945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:29.256951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:29.256956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:29.256962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:29.256967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:29.256973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:29.256978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:29.256983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:29.256988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:29.256994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:29.257004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:29.257010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:29.257014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:29.257023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:29.257027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:29.257042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:29.257052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.257058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.257066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.257072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.257077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.257082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.257086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:29.257095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:29.257099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:29.257104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:29.257149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:29.257198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896259450270224:3526] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:29.262673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896259450270224:3526] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:29.262694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896259450270224:3526] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:29.262698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896259450270224:3526] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:29.262708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2233 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:29.262947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:29.263980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:29.263994Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:29.263997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:29.264001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:29.264008Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2232 [2:7555896259360497601:2295]
2025-09-30T14:56:29.264024Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:29.264039Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:29.264042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:29.264045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:29.264050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:29.264068Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:29.264079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:29.264086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:29.264143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.264150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.264152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.264155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:29.264158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:29.264226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:29.264235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.264248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.264261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.264279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:29.264303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896259450270263:3526], now have 1 active actors on pipe
2025-09-30T14:56:29.264311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896259450270187:2454], now have 1 active actors on pipe
2025-09-30T14:56:29.264316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896259360497595:2295]
2025-09-30T14:56:29.264319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896259360497595:2295]
2025-09-30T14:56:29.264323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896259360497595:2295]
2025-09-30T14:56:29.264336Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:29.264353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:29.264373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:29.264381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:29.264387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2232
2025-09-30T14:56:29.264412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896259360497595:2295]
2025-09-30T14:56:29.264419Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:29.264393Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2232
2025-09-30T14:56:29.264455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:29.264464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:29.264492Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|86fbe953-1d5d2560-1e003f1d-5881063b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:29.264504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:29.264508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:29.264511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:29.264520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:29.264528Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:29.264533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:29.264536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:29.264538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:29.264544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:29.264545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:29.264681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:29.264691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:29.264705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:29.264819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2233 partition: 0 MaxSeqNo: 42 sessionId: src_id|86fbe953-1d5d2560-1e003f1d-5881063b_0
2025-09-30T14:56:29.265233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc96a10-be72df99-838c299b-23eaa236_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|86fbe953-1d5d2560-1e003f1d-5881063b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:29.268311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86fbe953-1d5d2560-1e003f1d-5881063b_0] Write session: try to update token
2025-09-30T14:56:29.268333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86fbe953-1d5d2560-1e003f1d-5881063b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:29.277304Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:29.277339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:29.277341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:29.277344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:29.277353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896259360497595:2295]
2025-09-30T14:56:29.277359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896259360497595:2295]
2025-09-30T14:56:29.277367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896259360497595:2295]
2025-09-30T14:56:29.277420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:29.277421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:29.277426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:29.277429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.277431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:29.277431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:29.277631Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:29.285518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2233 sessionId: src_id|86fbe953-1d5d2560-1e003f1d-5881063b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:29.288459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:29.342432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896259450270270:3180]
2025-09-30T14:56:29.342694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2232, pipe: [1:7555896259450270270:3180]
2025-09-30T14:56:29.393342Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:29.393697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:29.393718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:29.393747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896259450270270:3180], now have 1 active actors on pipe
2025-09-30T14:56:29.394002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896259450270270:3180]
2025-09-30T14:56:29.394020Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:29.394047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:29.394050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:29.394112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2233 reason: error at write: Disconnected sessionId: src_id|86fbe953-1d5d2560-1e003f1d-5881063b_0
2025-09-30T14:56:29.394314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2233 sessionId: src_id|86fbe953-1d5d2560-1e003f1d-5881063b_0 is DEAD
2025-09-30T14:56:29.394063Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:29.394834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86fbe953-1d5d2560-1e003f1d-5881063b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:29.394851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86fbe953-1d5d2560-1e003f1d-5881063b_0] Write session will restart in 0.006944s
2025-09-30T14:56:29.394884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86fbe953-1d5d2560-1e003f1d-5881063b_0] Write session: Do CDS request
2025-09-30T14:56:29.394895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86fbe953-1d5d2560-1e003f1d-5881063b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:29.403067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86fbe953-1d5d2560-1e003f1d-5881063b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:29.403418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:29.403440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2234
2025-09-30T14:56:29.403611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2234 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:29.403661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2234 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:29.403672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2234 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:29.403676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:29.404191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2234 sessionId:  describe result for acl check
2025-09-30T14:56:29.404235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:29.404243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:29.404245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:29.404252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896259450270280:3519] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:29.404826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896259450270280:3519] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:29.407616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896259450270280:3519] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:29.409864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:29.411677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:29.411884Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:29.411895Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:29.411907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:29.411974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:29.412026Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896259360497672:2293]
2025-09-30T14:56:29.411983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896259450270280:3519] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:29.412013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896259450270280:3519] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:29.412017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896259450270280:3519] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:29.412026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2234 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:29.412789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:29.413124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:29.413181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:29.413532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:29.413605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:29.413612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:29.413614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:29.413615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:29.413616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:29.413618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:29.413619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:29.413620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:29.413622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:29.413625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:29.413626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.413628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.413628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.413629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:29.413631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:29.413637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:29.413646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:29.413650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:29.413654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:29.413658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:29.413661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:29.413665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:29.413668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:29.413672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:29.413676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:29.413679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.413682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.413685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.413689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:29.413692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:29.413698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:29.413705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:29.413711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:29.413716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:29.413720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:29.413725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:29.413729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:29.413733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:29.413737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:29.413741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:29.413747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:29.413752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:29.413756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:29.413761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:29.413766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:29.413770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:29.413774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:29.413778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:29.413782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:29.413786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:29.413789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.413795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.413804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.413808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.413812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.413817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.413820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:29.413824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:29.413828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:29.413834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:29.413876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:29.419888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:29.420836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:29.420856Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:29.420859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:29.420863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:29.420870Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2233 [2:7555896259360497672:2293]
2025-09-30T14:56:29.420889Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:29.420906Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:29.420915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:29.420918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:29.420923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:29.420942Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:29.420949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:29.420958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:29.421019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.421026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.421028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.421031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:29.421035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:29.421255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2233
2025-09-30T14:56:29.421333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2233
2025-09-30T14:56:29.421101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:29.421111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.421124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.421135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.421154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:29.421174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896259450270341:3519], now have 1 active actors on pipe
2025-09-30T14:56:29.421179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896259450270272:2454], now have 1 active actors on pipe
2025-09-30T14:56:29.421185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896259360497667:2293]
2025-09-30T14:56:29.421187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896259360497667:2293]
2025-09-30T14:56:29.421191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896259360497667:2293]
2025-09-30T14:56:29.421206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:29.421217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:29.421219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:29.421220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:29.421222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:29.421234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:29.421238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:29.421276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896259360497667:2293]
2025-09-30T14:56:29.421279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:29.421282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:29.427321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:29.427351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:29.427386Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81ee7b9b-4931c0d3-b945a53c-5c7088fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:29.427404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:29.427415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:29.427419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:29.427434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:29.427456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:29.427480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:29.427789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:29.427805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:29.427850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:29.427997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2234 partition: 0 MaxSeqNo: 42 sessionId: src_id|81ee7b9b-4931c0d3-b945a53c-5c7088fc_0
2025-09-30T14:56:29.428489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86fbe953-1d5d2560-1e003f1d-5881063b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|81ee7b9b-4931c0d3-b945a53c-5c7088fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:29.432162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81ee7b9b-4931c0d3-b945a53c-5c7088fc_0] Write session: try to update token
2025-09-30T14:56:29.432192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81ee7b9b-4931c0d3-b945a53c-5c7088fc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:29.440783Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:29.440804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:29.440814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896259360497667:2293]
2025-09-30T14:56:29.440860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:29.440861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:29.441050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:29.441208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:29.441389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:29.441541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:29.441779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:29.441834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:29.449150Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:29.449169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:29.449171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:29.449173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:29.449181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896259360497667:2293]
2025-09-30T14:56:29.449184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896259360497667:2293]
2025-09-30T14:56:29.449193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896259360497667:2293]
2025-09-30T14:56:29.449237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:29.449244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.449248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:29.449251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:29.449258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:29.449263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:29.449411Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:29.451697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2234 sessionId: src_id|81ee7b9b-4931c0d3-b945a53c-5c7088fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:29.454908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:29.493967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896259450270352:3180]
2025-09-30T14:56:29.494322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2233, pipe: [1:7555896259450270352:3180]
2025-09-30T14:56:29.578609Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:29.579056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:29.579075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:29.579102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896259450270352:3180], now have 1 active actors on pipe
2025-09-30T14:56:29.579385Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:29.579396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:29.579422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:29.579427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:29.579464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896259450270352:3180]
2025-09-30T14:56:29.579512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2234 reason: error at write: Disconnected sessionId: src_id|81ee7b9b-4931c0d3-b945a53c-5c7088fc_0
2025-09-30T14:56:29.579715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2234 sessionId: src_id|81ee7b9b-4931c0d3-b945a53c-5c7088fc_0 is DEAD
2025-09-30T14:56:29.580181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81ee7b9b-4931c0d3-b945a53c-5c7088fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:29.580190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81ee7b9b-4931c0d3-b945a53c-5c7088fc_0] Write session will restart in 0.005010s
2025-09-30T14:56:29.580208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81ee7b9b-4931c0d3-b945a53c-5c7088fc_0] Write session: Do CDS request
2025-09-30T14:56:29.580215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81ee7b9b-4931c0d3-b945a53c-5c7088fc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:29.586910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:29.586927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2235
2025-09-30T14:56:29.586985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81ee7b9b-4931c0d3-b945a53c-5c7088fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:29.587269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2235 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:29.587309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2235 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:29.587318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2235 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:29.587322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:29.587798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2235 sessionId:  describe result for acl check
2025-09-30T14:56:29.587835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:29.587842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:29.587844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:29.587851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896259450270370:3534] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:29.588454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896259450270370:3534] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:29.590740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896259450270370:3534] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:29.590918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:29.592805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:29.593034Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:29.593045Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:29.593057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:29.593113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:29.593162Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896259360497748:2282]
2025-09-30T14:56:29.593937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:29.594260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:29.594305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:29.594647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:29.594721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:29.594728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:29.594729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:29.594730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:29.594732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:29.594733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:29.594735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:29.594739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:29.594740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:29.594742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:29.594743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.594744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.594746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.594747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:29.594748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:29.594755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:29.594766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:29.594771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:29.594776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:29.594781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:29.594786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:29.594791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:29.594795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:29.594800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:29.594805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:29.594810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.594814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.594817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.594822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:29.594826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:29.594835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:29.594844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:29.594851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:29.594860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:29.594865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:29.594871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:29.594876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:29.594882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:29.594888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:29.594894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:29.594903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:29.594909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:29.594920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:29.594926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:29.594936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:29.594942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:29.594947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:29.594953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:29.594957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:29.594964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:29.594971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.594980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.594987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.594997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.595004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.595014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.595019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:29.595025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:29.595035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:29.595040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:29.595096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:29.593466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896259450270370:3534] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:29.593487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896259450270370:3534] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:29.593491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896259450270370:3534] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:29.593501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2235 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:29.603101Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2234
2025-09-30T14:56:29.603109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2234
2025-09-30T14:56:29.601612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:29.602623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:29.602630Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:29.602636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:29.602640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:29.602648Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2234 [2:7555896259360497748:2282]
2025-09-30T14:56:29.602668Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:29.602687Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:29.602691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:29.602698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:29.602700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:29.602717Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:29.602726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:29.602733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:29.602802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.602804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.602806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.602809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:29.602812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:29.602905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:29.602908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.602922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.602932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.602947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:29.602966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896259450270424:3534], now have 1 active actors on pipe
2025-09-30T14:56:29.602970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896259450270355:2454], now have 1 active actors on pipe
2025-09-30T14:56:29.602977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896259360497742:2282]
2025-09-30T14:56:29.602980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896259360497742:2282]
2025-09-30T14:56:29.602985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896259360497742:2282]
2025-09-30T14:56:29.603002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:29.603016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:29.603017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:29.603022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:29.603024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:29.603030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:29.603034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:29.603073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896259360497742:2282]
2025-09-30T14:56:29.603083Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:29.603086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:29.603216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:29.603221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:29.603269Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c35e83e-7d89b756-fe3c016a-51d661b6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:29.603276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:29.603279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:29.603282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:29.603292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:29.603303Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:29.603317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:29.603805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:29.603815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:29.603831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:29.604379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81ee7b9b-4931c0d3-b945a53c-5c7088fc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3c35e83e-7d89b756-fe3c016a-51d661b6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:29.607809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c35e83e-7d89b756-fe3c016a-51d661b6_0] Write session: try to update token
2025-09-30T14:56:29.607830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c35e83e-7d89b756-fe3c016a-51d661b6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:29.603981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2235 partition: 0 MaxSeqNo: 42 sessionId: src_id|3c35e83e-7d89b756-fe3c016a-51d661b6_0
2025-09-30T14:56:29.619012Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:29.619034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:29.619037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:29.619040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:29.619051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896259360497742:2282]
2025-09-30T14:56:29.619060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896259360497742:2282]
2025-09-30T14:56:29.619065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896259360497742:2282]
2025-09-30T14:56:29.619109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:29.619118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.619121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:29.619308Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:29.621829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:29.621854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:29.621858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:29.638101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2235 sessionId: src_id|3c35e83e-7d89b756-fe3c016a-51d661b6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:29.641537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:29.679834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896259450270439:3180]
2025-09-30T14:56:29.680271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2234, pipe: [1:7555896259450270439:3180]
2025-09-30T14:56:29.743072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896259450270439:3180]
2025-09-30T14:56:29.743075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:29.743080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:29.743132Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:29.743193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2235 reason: error at write: Disconnected sessionId: src_id|3c35e83e-7d89b756-fe3c016a-51d661b6_0
2025-09-30T14:56:29.742343Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:29.742689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:29.742697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:29.742713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896259450270439:3180], now have 1 active actors on pipe
2025-09-30T14:56:29.743462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2235 sessionId: src_id|3c35e83e-7d89b756-fe3c016a-51d661b6_0 is DEAD
2025-09-30T14:56:29.743602Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:29.743667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c35e83e-7d89b756-fe3c016a-51d661b6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:29.743681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c35e83e-7d89b756-fe3c016a-51d661b6_0] Write session will restart in 0.006112s
2025-09-30T14:56:29.743725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c35e83e-7d89b756-fe3c016a-51d661b6_0] Write session: Do CDS request
2025-09-30T14:56:29.743731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c35e83e-7d89b756-fe3c016a-51d661b6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:29.750809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c35e83e-7d89b756-fe3c016a-51d661b6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:29.751026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:29.751051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2236
2025-09-30T14:56:29.751240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2236 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:29.751299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2236 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:29.751322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2236 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:29.751336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:29.752014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2236 sessionId:  describe result for acl check
2025-09-30T14:56:29.752056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:29.752065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:29.752067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:29.752075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896259450270453:3545] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:29.752763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896259450270453:3545] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:29.755611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896259450270453:3545] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:29.759814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:29.763667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:29.763934Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:29.763944Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:29.763955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:29.764014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:29.764058Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896259360497822:10240]
2025-09-30T14:56:29.764124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896259450270453:3545] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:29.764150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896259450270453:3545] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:29.764155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896259450270453:3545] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:29.764167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2236 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:29.764787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:29.765127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:29.765184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:29.765525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:29.765610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:29.765617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:29.765618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:29.765619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:29.765621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:29.765622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:29.765623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:29.765624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:29.765626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:29.765627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:29.765628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.765630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.765631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.765632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:29.765634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:29.765641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:29.765652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:29.765659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:29.765663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:29.765667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:29.765671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:29.765675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:29.765679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:29.765683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:29.765687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:29.765691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.765694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.765698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.765702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:29.765705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:29.765716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:29.765724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:29.765730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:29.765736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:29.765740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:29.765745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:29.765751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:29.765756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:29.765762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:29.765768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:29.765773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:29.765779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:29.765784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:29.765790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:29.765795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:29.765800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:29.765805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:29.765811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:29.765817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:29.765823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:29.765830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.765835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.765840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.765846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.765850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.765856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.765862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:29.765868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:29.765874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:29.765879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:29.765925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:29.772159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:29.773343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:29.773363Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:29.773367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:29.773372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:29.773380Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2235 [2:7555896259360497822:10240]
2025-09-30T14:56:29.773400Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:29.773418Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:29.773423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:29.773428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:29.773436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:29.773457Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:29.773468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:29.773475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:29.773550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.773556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.773558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.773562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:29.773564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:29.773640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:29.773647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.773664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.773680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.773702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:29.773723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896259360497817:10240]
2025-09-30T14:56:29.773729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896259360497817:10240]
2025-09-30T14:56:29.773731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896259360497817:10240]
2025-09-30T14:56:29.773746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:29.773765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:29.773784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:29.773790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:29.773826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:29.773829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896259360497817:10240]
2025-09-30T14:56:29.773832Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:29.773846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:29.773849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:29.773856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:29.774148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896259450270510:3545], now have 1 active actors on pipe
2025-09-30T14:56:29.774160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896259450270440:2454], now have 1 active actors on pipe
2025-09-30T14:56:29.774284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2235
2025-09-30T14:56:29.774291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2235
2025-09-30T14:56:29.774387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:29.774396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:29.774423Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|804da1f4-ec17ad4e-1c92f68f-20747306_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:29.774435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:29.774439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:29.774441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:29.774452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:29.774462Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:29.774478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:29.774804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:29.774813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:29.774831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:29.775035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2236 partition: 0 MaxSeqNo: 42 sessionId: src_id|804da1f4-ec17ad4e-1c92f68f-20747306_0
2025-09-30T14:56:29.775577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c35e83e-7d89b756-fe3c016a-51d661b6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|804da1f4-ec17ad4e-1c92f68f-20747306_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:29.779192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|804da1f4-ec17ad4e-1c92f68f-20747306_0] Write session: try to update token
2025-09-30T14:56:29.779218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|804da1f4-ec17ad4e-1c92f68f-20747306_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:29.786998Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:29.787020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:29.787022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:29.787024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:29.787034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896259360497817:10240]
2025-09-30T14:56:29.787039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896259360497817:10240]
2025-09-30T14:56:29.787043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896259360497817:10240]
2025-09-30T14:56:29.787086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:29.787093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.787096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:29.787096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:29.787104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:29.787108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:29.787263Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:29.805340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2236 sessionId: src_id|804da1f4-ec17ad4e-1c92f68f-20747306_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:29.808745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:29.843169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896259450270522:3180]
2025-09-30T14:56:29.843620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2235, pipe: [1:7555896259450270522:3180]
2025-09-30T14:56:29.902781Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:29.903186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:29.903197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:29.903218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896259450270522:3180], now have 1 active actors on pipe
2025-09-30T14:56:29.903568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:29.903589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:29.903697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2236 reason: error at write: Disconnected sessionId: src_id|804da1f4-ec17ad4e-1c92f68f-20747306_0
2025-09-30T14:56:29.904235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|804da1f4-ec17ad4e-1c92f68f-20747306_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:29.904248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|804da1f4-ec17ad4e-1c92f68f-20747306_0] Write session will restart in 0.009847s
2025-09-30T14:56:29.904279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|804da1f4-ec17ad4e-1c92f68f-20747306_0] Write session: Do CDS request
2025-09-30T14:56:29.904288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|804da1f4-ec17ad4e-1c92f68f-20747306_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:29.903922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2236 sessionId: src_id|804da1f4-ec17ad4e-1c92f68f-20747306_0 is DEAD
2025-09-30T14:56:29.904309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896259450270522:3180]
2025-09-30T14:56:29.904333Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:29.903752Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:29.915742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|804da1f4-ec17ad4e-1c92f68f-20747306_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:29.917795Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:29.917816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2237
2025-09-30T14:56:29.918061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2237 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:29.918101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2237 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:29.918114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2237 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:29.918122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:29.918529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2237 sessionId:  describe result for acl check
2025-09-30T14:56:29.916113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:29.919018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:29.919317Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:29.919321Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:29.918567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:29.918577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:29.918579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:29.918585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896259450270562:3548] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:29.919138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896259450270562:3548] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:29.921612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896259450270562:3548] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:29.919334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:29.919416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:29.919461Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896259360497909:10243]
2025-09-30T14:56:29.920218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:29.920668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:29.920720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:29.921213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:29.921393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:29.921395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:29.921396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:29.921397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:29.921399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:29.921400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:29.921402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:29.921404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:29.921405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:29.921407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:29.921408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.921409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.921411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.921412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:29.921413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:29.921421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:29.921436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:29.921441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:29.921445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:29.921450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:29.921454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:29.921458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:29.921462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:29.921467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:29.921471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:29.921475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.921479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.921483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.921487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:29.921491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:29.921498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:29.921506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:29.921512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:29.921518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:29.921523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:29.921528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:29.921533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:29.921538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:29.921543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:29.921548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:29.921553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:29.921557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:29.921563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:29.921569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:29.921572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:29.921579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:29.921583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:29.921590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:29.921596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:29.921600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:29.921610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.921615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.921621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.921637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.921643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.921650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.921654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:29.921660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:29.921664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:29.921669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:29.921718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:29.927581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896259450270562:3548] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:29.927602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896259450270562:3548] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:29.927606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896259450270562:3548] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:29.927616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2237 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:29.928047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:29.928962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:29.928969Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:29.928972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:29.928976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:29.928983Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2236 [2:7555896259360497909:10243]
2025-09-30T14:56:29.929001Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:29.929020Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:29.929023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:29.929026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:29.929031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:29.929046Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:29.929052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:29.929057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:29.929108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.929110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.929111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.929115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:29.929116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:29.929179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:29.929181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.929190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:29.929197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:29.929206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:29.929221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896259360497903:10243]
2025-09-30T14:56:29.929222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896259360497903:10243]
2025-09-30T14:56:29.929223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896259360497903:10243]
2025-09-30T14:56:29.929232Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:29.929246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:29.929262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:29.929264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:29.929278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:29.929285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:29.929288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:29.929306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896259450270524:2454], now have 1 active actors on pipe
2025-09-30T14:56:29.929338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896259450270599:3548], now have 1 active actors on pipe
2025-09-30T14:56:29.929340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896259360497903:10243]
2025-09-30T14:56:29.929360Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:29.929397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:29.931327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2236
2025-09-30T14:56:29.931370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2236
2025-09-30T14:56:29.931630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:29.931647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:29.931681Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d411e4e9-3c8dbb65-9b7e3275-a44d8270_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:29.931695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:29.931699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:29.931703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:29.931718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:29.931733Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:29.931752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:29.935633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:29.935651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:29.935684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:29.939430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2237 partition: 0 MaxSeqNo: 42 sessionId: src_id|d411e4e9-3c8dbb65-9b7e3275-a44d8270_0
2025-09-30T14:56:29.939934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|804da1f4-ec17ad4e-1c92f68f-20747306_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d411e4e9-3c8dbb65-9b7e3275-a44d8270_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:29.943109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d411e4e9-3c8dbb65-9b7e3275-a44d8270_0] Write session: try to update token
2025-09-30T14:56:29.943128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d411e4e9-3c8dbb65-9b7e3275-a44d8270_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:29.943496Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:29.943516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:29.943526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896259360497903:10243]
2025-09-30T14:56:29.943573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:29.943586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:29.943763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:29.943917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:29.944070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:29.944222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:29.944428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:29.944475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:29.958388Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:29.958412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:29.958420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:29.958422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:29.958434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896259360497903:10243]
2025-09-30T14:56:29.958438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896259360497903:10243]
2025-09-30T14:56:29.958448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896259360497903:10243]
2025-09-30T14:56:29.958509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:29.958520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:29.958524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:29.958524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:29.958532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:29.958537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:29.958825Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:29.964361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2237 sessionId: src_id|d411e4e9-3c8dbb65-9b7e3275-a44d8270_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:29.967447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:30.005908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896263745237903:3180]
2025-09-30T14:56:30.006360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2236, pipe: [1:7555896263745237903:3180]
2025-09-30T14:56:30.075764Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:30.076121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:30.076138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:30.076160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896263745237903:3180], now have 1 active actors on pipe
2025-09-30T14:56:30.076426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:30.076469Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:30.076451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:30.076456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:30.076492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896263745237903:3180]
2025-09-30T14:56:30.076536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2237 reason: error at write: Disconnected sessionId: src_id|d411e4e9-3c8dbb65-9b7e3275-a44d8270_0
2025-09-30T14:56:30.076732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2237 sessionId: src_id|d411e4e9-3c8dbb65-9b7e3275-a44d8270_0 is DEAD
2025-09-30T14:56:30.076893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d411e4e9-3c8dbb65-9b7e3275-a44d8270_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:30.076905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d411e4e9-3c8dbb65-9b7e3275-a44d8270_0] Write session will restart in 0.006895s
2025-09-30T14:56:30.076930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d411e4e9-3c8dbb65-9b7e3275-a44d8270_0] Write session: Do CDS request
2025-09-30T14:56:30.076936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d411e4e9-3c8dbb65-9b7e3275-a44d8270_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:30.084783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d411e4e9-3c8dbb65-9b7e3275-a44d8270_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:30.084892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:30.084913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2238
2025-09-30T14:56:30.085125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2238 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:30.085157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2238 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:30.085163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2238 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:30.085168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:30.085679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2238 sessionId:  describe result for acl check
2025-09-30T14:56:30.085719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:30.085727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:30.085731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:30.085737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896263745237952:3570] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:30.086297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896263745237952:3570] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:30.087605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:30.090273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896263745237952:3570] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:30.090882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:30.091195Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:30.091209Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:30.091223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:30.091322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:30.091378Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896263655465282:10246]
2025-09-30T14:56:30.092317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:30.096074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:30.096186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:30.096716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:30.096826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:30.096833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:30.096835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:30.096837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:30.096841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:30.096843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:30.096849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:30.096851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:30.096852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:30.096854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:30.096855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.096857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.096858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.096859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:30.096859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:30.096868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:30.096879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:30.096883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:30.096888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:30.096892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:30.096897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:30.096902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:30.096905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:30.096908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:30.096912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:30.096917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.096921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.096926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.096932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:30.096937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:30.096951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:30.096960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:30.096973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:30.096984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:30.096992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:30.097002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:30.097012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:30.097019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:30.097028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:30.097034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:30.097042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:30.097048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:30.097057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:30.097065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:30.097073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:30.097080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:30.097088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:30.097094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:30.097100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:30.097106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:30.097113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.097123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.097132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.097138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.097147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.097153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.097162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:30.097167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:30.097177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:30.097183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:30.097238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:30.100117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896263745237952:3570] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:30.100138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896263745237952:3570] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:30.100152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896263745237952:3570] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:30.100161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2238 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:30.104739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:30.105658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:30.105676Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:30.105680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:30.105687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:30.105696Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2237 [2:7555896263655465282:10246]
2025-09-30T14:56:30.105716Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:30.105741Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:30.105748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:30.105758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:30.105760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:30.105777Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:30.105783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:30.105791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:30.105887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.105898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.105900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.105903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:30.105907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:30.105978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:30.105988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.106002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.106014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.106045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:30.106072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896263745237917:2454], now have 1 active actors on pipe
2025-09-30T14:56:30.106081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896263745237993:3570], now have 1 active actors on pipe
2025-09-30T14:56:30.106087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896263655465277:10246]
2025-09-30T14:56:30.106090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896263655465277:10246]
2025-09-30T14:56:30.106093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896263655465277:10246]
2025-09-30T14:56:30.106104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:30.106118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:30.106131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:30.106136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:30.106138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:30.106139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:30.106142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:30.106183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896263655465277:10246]
2025-09-30T14:56:30.106195Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:30.106200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:30.106172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2237
2025-09-30T14:56:30.106198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2237
2025-09-30T14:56:30.106229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:30.106240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:30.106271Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4618d8e5-307ac03f-32f70108-7845b826_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:30.106284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:30.106290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:30.106292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:30.106302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:30.106311Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:30.106331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:30.106479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:30.106493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:30.106517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:30.106601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2238 partition: 0 MaxSeqNo: 42 sessionId: src_id|4618d8e5-307ac03f-32f70108-7845b826_0
2025-09-30T14:56:30.106974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d411e4e9-3c8dbb65-9b7e3275-a44d8270_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4618d8e5-307ac03f-32f70108-7845b826_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:30.110086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4618d8e5-307ac03f-32f70108-7845b826_0] Write session: try to update token
2025-09-30T14:56:30.110113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4618d8e5-307ac03f-32f70108-7845b826_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:30.119444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:30.119470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:30.119609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:30.119614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:30.119627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896263655465277:10246]
2025-09-30T14:56:30.119633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896263655465277:10246]
2025-09-30T14:56:30.119639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896263655465277:10246]
2025-09-30T14:56:30.119705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:30.119708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:30.119714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.119717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:30.119718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:30.119722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:30.119911Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:30.134219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2238 sessionId: src_id|4618d8e5-307ac03f-32f70108-7845b826_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:30.137944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:30.176456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896263745238016:3180]
2025-09-30T14:56:30.177414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2237, pipe: [1:7555896263745238016:3180]
2025-09-30T14:56:30.241412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896263745238016:3180]
2025-09-30T14:56:30.241451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:30.241454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:30.241533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2238 reason: error at write: Disconnected sessionId: src_id|4618d8e5-307ac03f-32f70108-7845b826_0
2025-09-30T14:56:30.241729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2238 sessionId: src_id|4618d8e5-307ac03f-32f70108-7845b826_0 is DEAD
2025-09-30T14:56:30.241759Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:30.241891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4618d8e5-307ac03f-32f70108-7845b826_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:30.241902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4618d8e5-307ac03f-32f70108-7845b826_0] Write session will restart in 0.006121s
2025-09-30T14:56:30.241927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4618d8e5-307ac03f-32f70108-7845b826_0] Write session: Do CDS request
2025-09-30T14:56:30.241935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4618d8e5-307ac03f-32f70108-7845b826_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:30.240638Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:30.241076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:30.241086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:30.241109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896263745238016:3180], now have 1 active actors on pipe
2025-09-30T14:56:30.241423Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:30.248931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4618d8e5-307ac03f-32f70108-7845b826_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:30.249060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:30.249082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2239
2025-09-30T14:56:30.249244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2239 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:30.249282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2239 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:30.249293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2239 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:30.249297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:30.253428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2239 sessionId:  describe result for acl check
2025-09-30T14:56:30.253501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:30.253505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:30.253508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:30.253516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896263745238040:3600] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:30.254250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896263745238040:3600] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:30.260876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896263745238040:3600] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:30.268332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896263745238040:3600] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:30.268367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896263745238040:3600] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:30.268374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896263745238040:3600] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:30.268384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2239 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:30.271410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:30.273754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:30.273995Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:30.273999Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:30.274020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:30.274084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:30.274131Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896263655465397:10260]
2025-09-30T14:56:30.274878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:30.275314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:30.275385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:30.275741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:30.275816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:30.275820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:30.275821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:30.275822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:30.275823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:30.275825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:30.275826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:30.275827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:30.275828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:30.275830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:30.275831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.275832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.275833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.275834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:30.275836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:30.275842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:30.275852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:30.275856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:30.275860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:30.275863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:30.275867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:30.275873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:30.275878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:30.275882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:30.275886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:30.275890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.275894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.275898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.275902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:30.275906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:30.275916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:30.275924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:30.275933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:30.275938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:30.275943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:30.275947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:30.275952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:30.275957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:30.275962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:30.275967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:30.275972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:30.275977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:30.275982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:30.275986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:30.275990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:30.275994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:30.275999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:30.276005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:30.276009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:30.276014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:30.276019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.276024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.276028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.276033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.276038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.276043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.276048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:30.276055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:30.276059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:30.276064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:30.276106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:30.283097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:30.284266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:30.284287Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:30.284294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:30.284299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:30.284306Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2238 [2:7555896263655465397:10260]
2025-09-30T14:56:30.284326Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:30.284345Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:30.284348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:30.284351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:30.284354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:30.284372Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:30.284383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:30.284389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:30.284455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.284466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.284467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.284471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:30.284474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:30.284544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:30.284551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.284566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.284578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.284595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:30.284612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896263655465392:10260]
2025-09-30T14:56:30.284615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896263655465392:10260]
2025-09-30T14:56:30.284617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896263655465392:10260]
2025-09-30T14:56:30.284629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:30.284639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:30.284642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:30.284644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:30.284644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:30.284658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:30.284661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:30.284671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896263745238083:3600], now have 1 active actors on pipe
2025-09-30T14:56:30.284676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896263745238030:2454], now have 1 active actors on pipe
2025-09-30T14:56:30.284711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896263655465392:10260]
2025-09-30T14:56:30.284717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:30.284773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2238
2025-09-30T14:56:30.284824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2238
2025-09-30T14:56:30.284751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:30.284873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:30.284878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:30.284911Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a975747-7a20457e-85196c49-18d0b749_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:30.284919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:30.284923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:30.284925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:30.284935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:30.284945Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:30.284960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:30.285133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:30.285139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:30.285152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:30.285236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2239 partition: 0 MaxSeqNo: 42 sessionId: src_id|3a975747-7a20457e-85196c49-18d0b749_0
2025-09-30T14:56:30.285680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4618d8e5-307ac03f-32f70108-7845b826_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3a975747-7a20457e-85196c49-18d0b749_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:30.289241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a975747-7a20457e-85196c49-18d0b749_0] Write session: try to update token
2025-09-30T14:56:30.289270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a975747-7a20457e-85196c49-18d0b749_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:30.298089Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:30.298118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:30.298131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896263655465392:10260]
2025-09-30T14:56:30.298190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:30.298195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:30.298418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:30.298592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:30.298763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:30.298984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:30.299236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:30.299341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:30.309447Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:30.309464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:30.309467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:30.309469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:30.309479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896263655465392:10260]
2025-09-30T14:56:30.309484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896263655465392:10260]
2025-09-30T14:56:30.309488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896263655465392:10260]
2025-09-30T14:56:30.309528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:30.309536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.309539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:30.309546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:30.309553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:30.309558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:30.309703Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:30.314304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2239 sessionId: src_id|3a975747-7a20457e-85196c49-18d0b749_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:30.317291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:30.341566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896263745238119:3180]
2025-09-30T14:56:30.341951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2238, pipe: [1:7555896263745238119:3180]
2025-09-30T14:56:30.426585Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:30.427013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:30.427031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:30.427055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896263745238119:3180], now have 1 active actors on pipe
2025-09-30T14:56:30.427368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:30.427387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:30.427450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896263745238119:3180]
2025-09-30T14:56:30.427473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2239 reason: error at write: Disconnected sessionId: src_id|3a975747-7a20457e-85196c49-18d0b749_0
2025-09-30T14:56:30.427495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:30.427649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2239 sessionId: src_id|3a975747-7a20457e-85196c49-18d0b749_0 is DEAD
2025-09-30T14:56:30.427375Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:30.427886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a975747-7a20457e-85196c49-18d0b749_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:30.427894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a975747-7a20457e-85196c49-18d0b749_0] Write session will restart in 0.005108s
2025-09-30T14:56:30.427920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a975747-7a20457e-85196c49-18d0b749_0] Write session: Do CDS request
2025-09-30T14:56:30.427930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a975747-7a20457e-85196c49-18d0b749_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:30.433798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a975747-7a20457e-85196c49-18d0b749_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:30.433887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:30.433911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2240
2025-09-30T14:56:30.434052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2240 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:30.434112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2240 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:30.434122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2240 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:30.434127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:30.434624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2240 sessionId:  describe result for acl check
2025-09-30T14:56:30.434663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:30.434671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:30.434673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:30.434680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896263745238134:3597] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:30.435273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896263745238134:3597] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:30.437804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896263745238134:3597] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:30.438983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:30.440778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:30.440995Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:30.441006Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:30.441018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:30.441081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:30.441147Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896263655465474:10262]
2025-09-30T14:56:30.441199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896263745238134:3597] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:30.441218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896263745238134:3597] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:30.441222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896263745238134:3597] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:30.441232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2240 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:30.441797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:30.442187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:30.442271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:30.442643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:30.442716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:30.442723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:30.442724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:30.442725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:30.442727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:30.442728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:30.442729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:30.442730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:30.442732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:30.442733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:30.442734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.442735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.442736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.442737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:30.442739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:30.442745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:30.442755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:30.442760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:30.442767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:30.442770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:30.442775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:30.442778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:30.442782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:30.442786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:30.442791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:30.442795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.442799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.442803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.442807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:30.442811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:30.442819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:30.442828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:30.442834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:30.442840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:30.442852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:30.442857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:30.442861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:30.442866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:30.442872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:30.442877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:30.442882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:30.442887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:30.442893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:30.442903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:30.442907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:30.442913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:30.442921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:30.442927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:30.442933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:30.442939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:30.442947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.442954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.442962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.442967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.442972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.442982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.442986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:30.442991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:30.442997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:30.443006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:30.443054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:30.449370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:30.450493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:30.450511Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:30.450514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:30.450518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:30.450524Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2239 [2:7555896263655465474:10262]
2025-09-30T14:56:30.450542Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:30.450560Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:30.450564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:30.450567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:30.450572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:30.450587Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:30.450593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:30.450605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:30.450670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.450678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.450679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.450683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:30.450685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:30.450755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:30.450763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.450775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.450786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.450801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:30.450825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896263745238197:3597], now have 1 active actors on pipe
2025-09-30T14:56:30.450837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896263655465468:10262]
2025-09-30T14:56:30.450841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896263655465468:10262]
2025-09-30T14:56:30.450843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896263655465468:10262]
2025-09-30T14:56:30.450854Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:30.450864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896263745238122:2454], now have 1 active actors on pipe
2025-09-30T14:56:30.450869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:30.450874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:30.450876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:30.450879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:30.450892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:30.450895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:30.450934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896263655465468:10262]
2025-09-30T14:56:30.450941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:30.450945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:30.450898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2239
2025-09-30T14:56:30.450964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:30.450974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:30.450916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2239
2025-09-30T14:56:30.451028Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71dd5764-ad06f628-6e41fa9d-d9a66726_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:30.451039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:30.451042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:30.451044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:30.451054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:30.451063Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:30.451085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:30.451217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:30.451225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:30.451239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:30.451423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2240 partition: 0 MaxSeqNo: 42 sessionId: src_id|71dd5764-ad06f628-6e41fa9d-d9a66726_0
2025-09-30T14:56:30.451840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a975747-7a20457e-85196c49-18d0b749_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|71dd5764-ad06f628-6e41fa9d-d9a66726_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:30.454914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71dd5764-ad06f628-6e41fa9d-d9a66726_0] Write session: try to update token
2025-09-30T14:56:30.454939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71dd5764-ad06f628-6e41fa9d-d9a66726_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:30.464743Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:30.464766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:30.464769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:30.464772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:30.464782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896263655465468:10262]
2025-09-30T14:56:30.464789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896263655465468:10262]
2025-09-30T14:56:30.464794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896263655465468:10262]
2025-09-30T14:56:30.464847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:30.464856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.464867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:30.464868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:30.464881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:30.464887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:30.465025Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:30.474193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2240 sessionId: src_id|71dd5764-ad06f628-6e41fa9d-d9a66726_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:30.477124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:30.527854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896263745238209:3180]
2025-09-30T14:56:30.528196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2239, pipe: [1:7555896263745238209:3180]
2025-09-30T14:56:30.587307Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:30.587662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:30.587673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:30.587694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896263745238209:3180], now have 1 active actors on pipe
2025-09-30T14:56:30.588060Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:30.588068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896263745238209:3180]
2025-09-30T14:56:30.588089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:30.588094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:30.588120Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:30.588187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2240 reason: error at write: Disconnected sessionId: src_id|71dd5764-ad06f628-6e41fa9d-d9a66726_0
2025-09-30T14:56:30.588542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71dd5764-ad06f628-6e41fa9d-d9a66726_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:30.588554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71dd5764-ad06f628-6e41fa9d-d9a66726_0] Write session will restart in 0.007447s
2025-09-30T14:56:30.588590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71dd5764-ad06f628-6e41fa9d-d9a66726_0] Write session: Do CDS request
2025-09-30T14:56:30.588595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71dd5764-ad06f628-6e41fa9d-d9a66726_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:30.588369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2240 sessionId: src_id|71dd5764-ad06f628-6e41fa9d-d9a66726_0 is DEAD
2025-09-30T14:56:30.596863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71dd5764-ad06f628-6e41fa9d-d9a66726_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:30.597356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:30.597381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2241
2025-09-30T14:56:30.597590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2241 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:30.597645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2241 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:30.597650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2241 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:30.597656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:30.598210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2241 sessionId:  describe result for acl check
2025-09-30T14:56:30.598260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:30.598264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:30.598266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:30.598272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896263745238248:3608] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:30.598931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896263745238248:3608] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:30.599910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:30.602047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:30.602255Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:30.602269Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:30.602280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:30.602333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:30.602376Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896263655465555:10265]
2025-09-30T14:56:30.603048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:30.603371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896263745238248:3608] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:30.603507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:30.603575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:30.603929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:30.603993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:30.604000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:30.604001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:30.604002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:30.604004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:30.604005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:30.604007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:30.604008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:30.604010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:30.604011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:30.604012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.604013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.604018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.604019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:30.604020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:30.604027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:30.604037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:30.604041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:30.604046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:30.604050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:30.604055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:30.604060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:30.604064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:30.604069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:30.604074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:30.604079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.604083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.604088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.604092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:30.604097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:30.604104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:30.604112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:30.604119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:30.604126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:30.604131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:30.604143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:30.604149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:30.604154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:30.604160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:30.604166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:30.604171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:30.604178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:30.604190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:30.604197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:30.604202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:30.604207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:30.604213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:30.604220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:30.604225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:30.604232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:30.604237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.604242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.604247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.604253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.604258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.604264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.604269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:30.604274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:30.604279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:30.604285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:30.604334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:30.610303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896263745238248:3608] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:30.610334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896263745238248:3608] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:30.610340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896263745238248:3608] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:30.610351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2241 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:30.612534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:30.613572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:30.613593Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:30.613597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:30.613601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:30.613610Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2240 [2:7555896263655465555:10265]
2025-09-30T14:56:30.613631Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:30.613653Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:30.613663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:30.613666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:30.613672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:30.613690Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:30.613702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:30.613714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:30.613783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.613791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.613793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.613796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:30.613799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:30.613973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:30.613982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.613997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.614014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.614039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:30.614062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896263745238210:2454], now have 1 active actors on pipe
2025-09-30T14:56:30.614066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896263745238289:3608], now have 1 active actors on pipe
2025-09-30T14:56:30.614072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896263655465549:10265]
2025-09-30T14:56:30.614076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896263655465549:10265]
2025-09-30T14:56:30.614078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896263655465549:10265]
2025-09-30T14:56:30.614092Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:30.614109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:30.614112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:30.614116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:30.614118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:30.614128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:30.614131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:30.614170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896263655465549:10265]
2025-09-30T14:56:30.614184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:30.614196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:30.614354Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2240
2025-09-30T14:56:30.614408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2240
2025-09-30T14:56:30.614845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:30.614860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:30.614889Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58fe1eda-4db5d8be-4350b0d5-da1d0bc6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:30.614897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:30.614905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:30.614907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:30.614919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:30.614935Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:30.614955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:30.615175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:30.615184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:30.615202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:30.615489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2241 partition: 0 MaxSeqNo: 42 sessionId: src_id|58fe1eda-4db5d8be-4350b0d5-da1d0bc6_0
2025-09-30T14:56:30.616028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71dd5764-ad06f628-6e41fa9d-d9a66726_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|58fe1eda-4db5d8be-4350b0d5-da1d0bc6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:30.619142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58fe1eda-4db5d8be-4350b0d5-da1d0bc6_0] Write session: try to update token
2025-09-30T14:56:30.619166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58fe1eda-4db5d8be-4350b0d5-da1d0bc6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:30.632006Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:30.632030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:30.632041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896263655465549:10265]
2025-09-30T14:56:30.632094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:30.632292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:30.632460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:30.632614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:30.632762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:30.632981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:30.633020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:30.633193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:30.643638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2241 sessionId: src_id|58fe1eda-4db5d8be-4350b0d5-da1d0bc6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:30.646709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:30.647424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:30.647448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:30.647486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:30.649292Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:30.649323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:30.649325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:30.649328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:30.649338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896263655465549:10265]
2025-09-30T14:56:30.649344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896263655465549:10265]
2025-09-30T14:56:30.649352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896263655465549:10265]
2025-09-30T14:56:30.649396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:30.649411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.649414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:30.649569Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:30.649878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:30.651306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:30.651323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:30.651328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:30.688479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896263745238300:3180]
2025-09-30T14:56:30.688838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2240, pipe: [1:7555896263745238300:3180]
2025-09-30T14:56:30.768172Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:30.777040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:30.777081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:30.777277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:30.777360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:30.777431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:30.777502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:30.777554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:30.777567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:30.777640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:30.777708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:30.777782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:30.777861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:30.777913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:30.777922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:30.777997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:30.778069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:30.778139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:30.778213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:30.778267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:30.778275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:30.778354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:30.778425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:30.778497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:30.778575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:30.778623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:30.778630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:30.778707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:30.778778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:30.778854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:30.778927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:30.778981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:30.778988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:30.779066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:30.779135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:30.779206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:30.779297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:30.779345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:30.779354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:30.779432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:30.779507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:30.779579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:30.779652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:30.779701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:30.779708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:30.779783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:30.779858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:30.779936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:30.780007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:30.780060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:30.780067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:30.780142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:30.780208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:30.780276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:30.780347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:30.780392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:30.780399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:30.780480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:30.780557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:30.780628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:30.780699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:30.780747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:30.780754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:30.780817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896263745238300:3180], now have 1 active actors on pipe
2025-09-30T14:56:30.781101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:30.781119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:30.781152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2241 reason: error at write: Disconnected sessionId: src_id|58fe1eda-4db5d8be-4350b0d5-da1d0bc6_0
2025-09-30T14:56:30.781344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2241 sessionId: src_id|58fe1eda-4db5d8be-4350b0d5-da1d0bc6_0 is DEAD
2025-09-30T14:56:30.781353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896263745238300:3180]
2025-09-30T14:56:30.781380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:30.781733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58fe1eda-4db5d8be-4350b0d5-da1d0bc6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:30.781746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58fe1eda-4db5d8be-4350b0d5-da1d0bc6_0] Write session will restart in 0.005785s
2025-09-30T14:56:30.781772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58fe1eda-4db5d8be-4350b0d5-da1d0bc6_0] Write session: Do CDS request
2025-09-30T14:56:30.781778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58fe1eda-4db5d8be-4350b0d5-da1d0bc6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:30.782071Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:30.788817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58fe1eda-4db5d8be-4350b0d5-da1d0bc6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:30.788930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:30.788953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2242
2025-09-30T14:56:30.789554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2242 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:30.789594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2242 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:30.789605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2242 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:30.789610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:30.790183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2242 sessionId:  describe result for acl check
2025-09-30T14:56:30.790223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:30.790225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:30.790227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:30.790233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896263745238317:3614] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:30.790712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896263745238317:3614] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:30.793482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896263745238317:3614] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:30.793851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:30.795835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:30.796053Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:30.796065Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:30.796076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:30.796134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:30.796178Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896263655465635:10267]
2025-09-30T14:56:30.796350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896263745238317:3614] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:30.796375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896263745238317:3614] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:30.796379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896263745238317:3614] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:30.796389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2242 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:30.796856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:30.797174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:30.797222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:30.797527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:30.797585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:30.797591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:30.797592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:30.797593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:30.797594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:30.797596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:30.797597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:30.797599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:30.797600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:30.797601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:30.797603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.797604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.797604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.797605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:30.797608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:30.797612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:30.797618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:30.797621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:30.797623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:30.797626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:30.797628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:30.797631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:30.797633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:30.797635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:30.797637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:30.797640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.797642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.797644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.797647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:30.797649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:30.797655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:30.797660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:30.797664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:30.797667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:30.797672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:30.797675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:30.797677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:30.797681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:30.797683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:30.797686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:30.797688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:30.797691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:30.797694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:30.797698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:30.797702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:30.797707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:30.797711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:30.797716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:30.797722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:30.797727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:30.797731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.797736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.797739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.797745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.797751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.797756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.797759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:30.797762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:30.797765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:30.797767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:30.797795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:30.803761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:30.804767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:30.804785Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:30.804788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:30.804792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:30.804800Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2241 [2:7555896263655465635:10267]
2025-09-30T14:56:30.804820Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:30.804843Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:30.804847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:30.804850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:30.804853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:30.804870Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:30.804882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:30.804888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:30.804944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.804951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.804953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.804956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:30.804957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:30.805030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:30.805038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.805050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.805066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.805083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:30.805104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896263655465630:10267]
2025-09-30T14:56:30.805111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896263655465630:10267]
2025-09-30T14:56:30.805113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896263655465630:10267]
2025-09-30T14:56:30.805122Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:30.805134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:30.805139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:30.805147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:30.805150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:30.805154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:30.805156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:30.805164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896263745238378:3614], now have 1 active actors on pipe
2025-09-30T14:56:30.805168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896263745238302:2454], now have 1 active actors on pipe
2025-09-30T14:56:30.805203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896263655465630:10267]
2025-09-30T14:56:30.805222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:30.805231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:30.805286Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2241
2025-09-30T14:56:30.805293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2241
2025-09-30T14:56:30.805466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:30.805479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:30.805506Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1752ec8f-5dea4ae4-b2beab3b-62edc1df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:30.805514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:30.805519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:30.805524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:30.805538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:30.805550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:30.805566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:30.805917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:30.805935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:30.805960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:30.806076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2242 partition: 0 MaxSeqNo: 42 sessionId: src_id|1752ec8f-5dea4ae4-b2beab3b-62edc1df_0
2025-09-30T14:56:30.806486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58fe1eda-4db5d8be-4350b0d5-da1d0bc6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1752ec8f-5dea4ae4-b2beab3b-62edc1df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:30.809521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1752ec8f-5dea4ae4-b2beab3b-62edc1df_0] Write session: try to update token
2025-09-30T14:56:30.809542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1752ec8f-5dea4ae4-b2beab3b-62edc1df_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:30.819442Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:30.819466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:30.819469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:30.819472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:30.819485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896263655465630:10267]
2025-09-30T14:56:30.819490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896263655465630:10267]
2025-09-30T14:56:30.819495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896263655465630:10267]
2025-09-30T14:56:30.819546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:30.819553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.819556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:30.819711Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:30.822195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:30.822219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:30.822224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:30.842157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2242 sessionId: src_id|1752ec8f-5dea4ae4-b2beab3b-62edc1df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:30.844942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:30.881511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896263745238391:3180]
2025-09-30T14:56:30.881932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2241, pipe: [1:7555896263745238391:3180]
2025-09-30T14:56:30.942340Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:30.942804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:30.942821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:30.942842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896263745238391:3180], now have 1 active actors on pipe
2025-09-30T14:56:30.943153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896263745238391:3180]
2025-09-30T14:56:30.943165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:30.943305Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:30.943170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:30.943209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:30.943260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2242 reason: error at write: Disconnected sessionId: src_id|1752ec8f-5dea4ae4-b2beab3b-62edc1df_0
2025-09-30T14:56:30.943437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2242 sessionId: src_id|1752ec8f-5dea4ae4-b2beab3b-62edc1df_0 is DEAD
2025-09-30T14:56:30.943608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1752ec8f-5dea4ae4-b2beab3b-62edc1df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:30.943619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1752ec8f-5dea4ae4-b2beab3b-62edc1df_0] Write session will restart in 0.005493s
2025-09-30T14:56:30.943646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1752ec8f-5dea4ae4-b2beab3b-62edc1df_0] Write session: Do CDS request
2025-09-30T14:56:30.943654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1752ec8f-5dea4ae4-b2beab3b-62edc1df_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:30.951061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1752ec8f-5dea4ae4-b2beab3b-62edc1df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:30.951528Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:30.951550Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2243
2025-09-30T14:56:30.951712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2243 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:30.951746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2243 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:30.951751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2243 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:30.951756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:30.952216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2243 sessionId:  describe result for acl check
2025-09-30T14:56:30.952256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:30.952259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:30.952261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:30.952267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896263745238406:3624] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:30.952872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896263745238406:3624] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:30.955993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896263745238406:3624] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:30.957603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:30.959765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:30.960073Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:30.960100Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:30.960114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:30.960072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896263745238406:3624] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:30.960094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896263745238406:3624] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:30.960097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896263745238406:3624] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:30.960107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2243 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:30.960179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:30.960239Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896263655465731:10271]
2025-09-30T14:56:30.961029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:30.961485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:30.961549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:30.961981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:30.962069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:30.962079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:30.962081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:30.962082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:30.962084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:30.962086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:30.962088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:30.962090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:30.962092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:30.962093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:30.962095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.962096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.962098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.962099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:30.962101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:30.962108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:30.962122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:30.962127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:30.962136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:30.962141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:30.962146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:30.962151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:30.962156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:30.962160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:30.962166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:30.962170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.962174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.962179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.962183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:30.962187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:30.962196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:30.962207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:30.962214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:30.962221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:30.962228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:30.962235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:30.962240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:30.962246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:30.962253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:30.962259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:30.962265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:30.962271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:30.962278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:30.962284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:30.962290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:30.962296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:30.962305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:30.962312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:30.962317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:30.962326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:30.962335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.962341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.962347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.962354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.962359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.962365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.962372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:30.962377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:30.962383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:30.962388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:30.962434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:30.971396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:30.972713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:30.972737Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:30.972740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:30.972744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:30.972752Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2242 [2:7555896263655465731:10271]
2025-09-30T14:56:30.972776Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:30.972802Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:30.972813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:30.972817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:30.972820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:30.972841Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:30.972849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:30.972862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:30.972962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.972970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.972972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.972975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:30.972977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:30.973065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:30.973075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.973093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:30.973106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:30.973121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:30.973140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896263655465726:10271]
2025-09-30T14:56:30.973142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896263655465726:10271]
2025-09-30T14:56:30.973144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896263655465726:10271]
2025-09-30T14:56:30.973156Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:30.973171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896263745238471:3624], now have 1 active actors on pipe
2025-09-30T14:56:30.973178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896263745238393:2454], now have 1 active actors on pipe
2025-09-30T14:56:30.973184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:30.973200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:30.973210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:30.973225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:30.973231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:30.973234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:30.973253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896263655465726:10271]
2025-09-30T14:56:30.973257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:30.973263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:30.973289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2242
2025-09-30T14:56:30.973355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2242
2025-09-30T14:56:30.973607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:30.973619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:30.973647Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9981ef8-900e4714-63cec87d-4cfc320_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:30.973656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:30.973660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:30.973663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:30.973673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:30.973687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:30.973710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:30.973896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:30.973903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:30.973918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:30.974097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2243 partition: 0 MaxSeqNo: 42 sessionId: src_id|f9981ef8-900e4714-63cec87d-4cfc320_0
2025-09-30T14:56:30.974925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1752ec8f-5dea4ae4-b2beab3b-62edc1df_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f9981ef8-900e4714-63cec87d-4cfc320_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:30.978696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9981ef8-900e4714-63cec87d-4cfc320_0] Write session: try to update token
2025-09-30T14:56:30.978721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9981ef8-900e4714-63cec87d-4cfc320_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:30.988830Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:30.988858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:30.988861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:30.988864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:30.988875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896263655465726:10271]
2025-09-30T14:56:30.988881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896263655465726:10271]
2025-09-30T14:56:30.988887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896263655465726:10271]
2025-09-30T14:56:30.988944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:30.988958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:30.988962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:30.988966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:30.988967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:30.988971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:30.989147Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:31.005494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2243 sessionId: src_id|f9981ef8-900e4714-63cec87d-4cfc320_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:31.008884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:31.043291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896268040205794:3180]
2025-09-30T14:56:31.043645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2242, pipe: [1:7555896268040205794:3180]
2025-09-30T14:56:31.116583Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:31.117096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:31.117114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:31.117144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896268040205794:3180], now have 1 active actors on pipe
2025-09-30T14:56:31.117546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896268040205794:3180]
2025-09-30T14:56:31.117603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:31.117607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:31.117662Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:31.117692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2243 reason: error at write: Disconnected sessionId: src_id|f9981ef8-900e4714-63cec87d-4cfc320_0
2025-09-30T14:56:31.117939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2243 sessionId: src_id|f9981ef8-900e4714-63cec87d-4cfc320_0 is DEAD
2025-09-30T14:56:31.117966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:31.118179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9981ef8-900e4714-63cec87d-4cfc320_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:31.118192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9981ef8-900e4714-63cec87d-4cfc320_0] Write session will restart in 0.009625s
2025-09-30T14:56:31.118224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9981ef8-900e4714-63cec87d-4cfc320_0] Write session: Do CDS request
2025-09-30T14:56:31.118235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9981ef8-900e4714-63cec87d-4cfc320_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:31.129037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9981ef8-900e4714-63cec87d-4cfc320_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:31.129088Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:31.129110Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2244
2025-09-30T14:56:31.129472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2244 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:31.129533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2244 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:31.129555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2244 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:31.129561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:31.130194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2244 sessionId:  describe result for acl check
2025-09-30T14:56:31.130248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:31.130257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:31.130260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:31.130267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896268040205812:3628] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:31.131045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896268040205812:3628] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:31.133443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:31.133300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896268040205812:3628] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:31.135940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:31.136238Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:31.136257Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:31.136273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:31.136347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:31.136417Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896267950433109:10273]
2025-09-30T14:56:31.137208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:31.137646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896268040205812:3628] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:31.137667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896268040205812:3628] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:31.137671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896268040205812:3628] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:31.137681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2244 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:31.137732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:31.137841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:31.138256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:31.138343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:31.138352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:31.138354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:31.138355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:31.138357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:31.138359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:31.138360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:31.138361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:31.138363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:31.138364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:31.138365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.138367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.138369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.138370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:31.138371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:31.138378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:31.138390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:31.138394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:31.138398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:31.138403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:31.138410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:31.138414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:31.138419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:31.138423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:31.138428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:31.138432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.138436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.138440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.138445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:31.138449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:31.138457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:31.138466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:31.138473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:31.138479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:31.138484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:31.138489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:31.138491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:31.138494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:31.138497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:31.138502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:31.138504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:31.138507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:31.138510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:31.138513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:31.138515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:31.138518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:31.138521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:31.138524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:31.138526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:31.138529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:31.138532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.138548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.138551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.138554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.138558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.138561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.138564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:31.138567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:31.138572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:31.138576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:31.138607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:31.145597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:31.146534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:31.146557Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:31.146561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:31.146566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:31.146573Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2243 [2:7555896267950433109:10273]
2025-09-30T14:56:31.146595Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:31.146614Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:31.146618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:31.146622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:31.146625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:31.146646Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:31.146652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:31.146658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:31.146716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.146724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.146726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.146729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:31.146731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:31.146800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:31.146813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.146828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.146836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.146846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:31.146861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896267950433104:10273]
2025-09-30T14:56:31.146863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896267950433104:10273]
2025-09-30T14:56:31.146866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896267950433104:10273]
2025-09-30T14:56:31.146874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:31.146889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:31.146892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:31.146894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:31.146897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:31.146906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:31.146908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:31.146918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896268040205796:2454], now have 1 active actors on pipe
2025-09-30T14:56:31.146922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896268040205877:3628], now have 1 active actors on pipe
2025-09-30T14:56:31.146957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896267950433104:10273]
2025-09-30T14:56:31.146973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:31.146982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:31.147009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2243
2025-09-30T14:56:31.147074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2243
2025-09-30T14:56:31.147258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:31.147277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:31.147308Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4065fd26-213751fc-14faa307-c76561ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:31.147317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:31.147320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:31.147324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:31.147334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:31.147353Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:31.147376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:31.149540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:31.149569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:31.149601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:31.149717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2244 partition: 0 MaxSeqNo: 42 sessionId: src_id|4065fd26-213751fc-14faa307-c76561ab_0
2025-09-30T14:56:31.150139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9981ef8-900e4714-63cec87d-4cfc320_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4065fd26-213751fc-14faa307-c76561ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:31.153354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4065fd26-213751fc-14faa307-c76561ab_0] Write session: try to update token
2025-09-30T14:56:31.153378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4065fd26-213751fc-14faa307-c76561ab_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:31.164078Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:31.164103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:31.164114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896267950433104:10273]
2025-09-30T14:56:31.164164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:31.164167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:31.164357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:31.164533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:31.164703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:31.164864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:31.165100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:31.165154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:31.178260Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:31.178280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:31.178283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:31.178286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:31.178296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896267950433104:10273]
2025-09-30T14:56:31.178300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896267950433104:10273]
2025-09-30T14:56:31.178305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896267950433104:10273]
2025-09-30T14:56:31.178361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:31.178368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.178372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:31.178450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:31.178472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:31.178481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:31.178520Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:31.177497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2244 sessionId: src_id|4065fd26-213751fc-14faa307-c76561ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:31.180658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:31.217843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896268040205906:3180]
2025-09-30T14:56:31.218186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2243, pipe: [1:7555896268040205906:3180]
2025-09-30T14:56:31.296448Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:31.296849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:31.296871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:31.296894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896268040205906:3180], now have 1 active actors on pipe
2025-09-30T14:56:31.297213Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:31.297759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4065fd26-213751fc-14faa307-c76561ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:31.297773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4065fd26-213751fc-14faa307-c76561ab_0] Write session will restart in 0.005968s
2025-09-30T14:56:31.297798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4065fd26-213751fc-14faa307-c76561ab_0] Write session: Do CDS request
2025-09-30T14:56:31.297805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4065fd26-213751fc-14faa307-c76561ab_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:31.297190Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896268040205906:3180]
2025-09-30T14:56:31.297232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:31.297235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:31.297322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2244 reason: error at write: Disconnected sessionId: src_id|4065fd26-213751fc-14faa307-c76561ab_0
2025-09-30T14:56:31.297505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2244 sessionId: src_id|4065fd26-213751fc-14faa307-c76561ab_0 is DEAD
2025-09-30T14:56:31.298142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:31.304779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4065fd26-213751fc-14faa307-c76561ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:31.304961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:31.304999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2245
2025-09-30T14:56:31.305157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2245 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:31.305191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2245 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:31.305213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2245 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:31.305223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:31.305772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2245 sessionId:  describe result for acl check
2025-09-30T14:56:31.305812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:31.305814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:31.305817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:31.305822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896268040205934:3661] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:31.306368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896268040205934:3661] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:31.308362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896268040205934:3661] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:31.312718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896268040205934:3661] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:31.312737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896268040205934:3661] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:31.312741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896268040205934:3661] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:31.312750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2245 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:31.314631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:31.317831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:31.318091Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:31.318106Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:31.318118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:31.318183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:31.318230Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896267950433228:10287]
2025-09-30T14:56:31.318976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:31.319519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:31.319571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:31.319941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:31.320008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:31.320016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:31.320017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:31.320019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:31.320021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:31.320022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:31.320027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:31.320028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:31.320030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:31.320031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:31.320032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.320034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.320035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.320036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:31.320037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:31.320044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:31.320056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:31.320061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:31.320066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:31.320071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:31.320075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:31.320080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:31.320085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:31.320089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:31.320096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:31.320101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.320105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.320109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.320114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:31.320118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:31.320126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:31.320136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:31.320143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:31.320149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:31.320155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:31.320166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:31.320171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:31.320177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:31.320190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:31.320196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:31.320200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:31.320207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:31.320212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:31.320219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:31.320230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:31.320236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:31.320246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:31.320252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:31.320261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:31.320267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:31.320272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.320284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.320289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.320296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.320301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.320312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.320319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:31.320324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:31.320337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:31.320348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:31.320394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:31.326403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:31.327456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:31.327484Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:31.327487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:31.327494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:31.327502Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2244 [2:7555896267950433228:10287]
2025-09-30T14:56:31.327520Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:31.327537Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:31.327548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:31.327559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:31.327561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:31.327578Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:31.327591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:31.327598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:31.327665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.327672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.327677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.327681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:31.327684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:31.327757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:31.327766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.327780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.327798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.327820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:31.327845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896268040205922:2454], now have 1 active actors on pipe
2025-09-30T14:56:31.327853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896268040205995:3661], now have 1 active actors on pipe
2025-09-30T14:56:31.327860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896267950433223:10287]
2025-09-30T14:56:31.327867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896267950433223:10287]
2025-09-30T14:56:31.327870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896267950433223:10287]
2025-09-30T14:56:31.327882Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:31.327900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:31.327901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:31.327911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:31.327914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:31.327915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:31.327918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:31.327953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896267950433223:10287]
2025-09-30T14:56:31.327962Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:31.327967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:31.327950Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2244
2025-09-30T14:56:31.328014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2244
2025-09-30T14:56:31.328157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:31.328167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:31.328192Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2dc172c9-a6697b7f-53661665-8e177267_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:31.328203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:31.328212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:31.328214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:31.328224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:31.328238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:31.328255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:31.328936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:31.328948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:31.328973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:31.329182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2245 partition: 0 MaxSeqNo: 42 sessionId: src_id|2dc172c9-a6697b7f-53661665-8e177267_0
2025-09-30T14:56:31.329623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4065fd26-213751fc-14faa307-c76561ab_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2dc172c9-a6697b7f-53661665-8e177267_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:31.332795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dc172c9-a6697b7f-53661665-8e177267_0] Write session: try to update token
2025-09-30T14:56:31.332818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dc172c9-a6697b7f-53661665-8e177267_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:31.341048Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:31.341073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:31.341076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:31.341078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:31.341087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896267950433223:10287]
2025-09-30T14:56:31.341092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896267950433223:10287]
2025-09-30T14:56:31.341099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896267950433223:10287]
2025-09-30T14:56:31.341142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:31.341151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.341153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:31.341173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:31.341180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:31.341184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:31.341305Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:31.370775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2245 sessionId: src_id|2dc172c9-a6697b7f-53661665-8e177267_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:31.382151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:31.395553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896268040206011:3180]
2025-09-30T14:56:31.395888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2244, pipe: [1:7555896268040206011:3180]
2025-09-30T14:56:31.462611Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:31.463033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:31.463049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:31.463070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896268040206011:3180], now have 1 active actors on pipe
2025-09-30T14:56:31.463323Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:31.463356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:31.463392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896268040206011:3180]
2025-09-30T14:56:31.463427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:31.463513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2245 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2dc172c9-a6697b7f-53661665-8e177267_0
2025-09-30T14:56:31.463726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2245 sessionId: src_id|2dc172c9-a6697b7f-53661665-8e177267_0 is DEAD
2025-09-30T14:56:31.463878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dc172c9-a6697b7f-53661665-8e177267_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:31.463891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dc172c9-a6697b7f-53661665-8e177267_0] Write session will restart in 0.008922s
2025-09-30T14:56:31.463920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dc172c9-a6697b7f-53661665-8e177267_0] Write session: Do CDS request
2025-09-30T14:56:31.463926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dc172c9-a6697b7f-53661665-8e177267_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:31.473859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dc172c9-a6697b7f-53661665-8e177267_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:31.474025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:31.474043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2246
2025-09-30T14:56:31.474198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2246 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:31.474241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2246 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:31.474252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2246 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:31.474257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:31.474763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2246 sessionId:  describe result for acl check
2025-09-30T14:56:31.474804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:31.474810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:31.474812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:31.474819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896268040206058:3668] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:31.475060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:31.475472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896268040206058:3668] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:31.476981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:31.477173Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:31.477187Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:31.477198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:31.477248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:31.477249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896268040206058:3668] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:31.477295Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896267950433312:10290]
2025-09-30T14:56:31.477972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:31.478279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:31.478327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:31.478688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:31.478755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:31.478762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:31.478763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:31.478764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:31.478766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:31.478767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:31.478768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:31.478769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:31.478771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:31.478772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:31.478775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.478777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.478778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.478779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:31.478780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:31.478786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:31.478796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:31.478801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:31.478805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:31.478810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:31.478813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:31.478817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:31.478820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:31.478823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:31.478828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:31.478832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.478837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.478841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.478845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:31.478850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:31.478857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:31.478866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:31.478873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:31.478879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:31.478886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:31.478891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:31.478896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:31.478902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:31.478907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:31.478912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:31.478916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:31.478923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:31.478928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:31.478934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:31.478938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:31.478943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:31.478948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:31.478953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:31.478958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:31.478971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:31.478981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.478986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.478995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.479001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.479010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.479016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.479024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:31.479030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:31.479038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:31.479044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:31.479095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:31.479736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896268040206058:3668] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:31.479752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896268040206058:3668] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:31.479756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896268040206058:3668] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:31.479764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2246 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:31.484740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:31.485675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:31.485694Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:31.485698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:31.485703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:31.485710Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2245 [2:7555896267950433312:10290]
2025-09-30T14:56:31.485727Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:31.485751Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:31.485754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:31.485757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:31.485759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:31.485777Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:31.485788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:31.485798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:31.485859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.485866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.485868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.485872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:31.485874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:31.485943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:31.485952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.485964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.485977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.485995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:31.486013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896268040206098:3668], now have 1 active actors on pipe
2025-09-30T14:56:31.486022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896268040206013:2454], now have 1 active actors on pipe
2025-09-30T14:56:31.486029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896267950433306:10290]
2025-09-30T14:56:31.486031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896267950433306:10290]
2025-09-30T14:56:31.486033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896267950433306:10290]
2025-09-30T14:56:31.486049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:31.486065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:31.486065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:31.486069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:31.486072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:31.486085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:31.486087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:31.486094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2245
2025-09-30T14:56:31.486121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896267950433306:10290]
2025-09-30T14:56:31.486104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2245
2025-09-30T14:56:31.486133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:31.486148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:31.486181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:31.486191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:31.486214Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7421e1e-234582c2-7ff6a000-94d92573_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:31.486226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:31.486230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:31.486232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:31.486241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:31.486254Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:31.486270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:31.486435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:31.486452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:31.486480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:31.486579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2246 partition: 0 MaxSeqNo: 42 sessionId: src_id|7421e1e-234582c2-7ff6a000-94d92573_0
2025-09-30T14:56:31.486963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dc172c9-a6697b7f-53661665-8e177267_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7421e1e-234582c2-7ff6a000-94d92573_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:31.493235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7421e1e-234582c2-7ff6a000-94d92573_0] Write session: try to update token
2025-09-30T14:56:31.493273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7421e1e-234582c2-7ff6a000-94d92573_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:31.499508Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:31.499532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:31.499535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:31.499537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:31.499548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896267950433306:10290]
2025-09-30T14:56:31.499552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896267950433306:10290]
2025-09-30T14:56:31.499556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896267950433306:10290]
2025-09-30T14:56:31.499600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:31.499607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.499607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:31.499609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:31.499614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:31.499618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:31.499751Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:31.515615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2246 sessionId: src_id|7421e1e-234582c2-7ff6a000-94d92573_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:31.518526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:31.563450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896268040206106:3180]
2025-09-30T14:56:31.563772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2245, pipe: [1:7555896268040206106:3180]
2025-09-30T14:56:31.612241Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:31.612690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:31.612708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:31.612727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896268040206106:3180], now have 1 active actors on pipe
2025-09-30T14:56:31.612954Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:31.613019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896268040206106:3180]
2025-09-30T14:56:31.613069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:31.613165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2246 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7421e1e-234582c2-7ff6a000-94d92573_0
2025-09-30T14:56:31.613354Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:31.613375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2246 sessionId: src_id|7421e1e-234582c2-7ff6a000-94d92573_0 is DEAD
2025-09-30T14:56:31.613507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7421e1e-234582c2-7ff6a000-94d92573_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:31.613519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7421e1e-234582c2-7ff6a000-94d92573_0] Write session will restart in 0.006744s
2025-09-30T14:56:31.613544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7421e1e-234582c2-7ff6a000-94d92573_0] Write session: Do CDS request
2025-09-30T14:56:31.613550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7421e1e-234582c2-7ff6a000-94d92573_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:31.621843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7421e1e-234582c2-7ff6a000-94d92573_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:31.622095Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:31.622115Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2247
2025-09-30T14:56:31.622248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2247 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:31.622289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2247 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:31.622299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2247 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:31.622303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:31.622763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2247 sessionId:  describe result for acl check
2025-09-30T14:56:31.622819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:31.622827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:31.622829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:31.622835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896268040206151:3671] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:31.623428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896268040206151:3671] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:31.624961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:31.625831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896268040206151:3671] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:31.626726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:31.626936Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:31.626944Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:31.626956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:31.627008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:31.627048Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896267950433396:10292]
2025-09-30T14:56:31.627707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:31.628086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:31.628166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:31.628190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896268040206151:3671] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:31.628208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896268040206151:3671] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:31.628212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896268040206151:3671] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:31.628221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2247 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:31.628579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:31.628642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:31.628650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:31.628651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:31.628652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:31.628656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:31.628657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:31.628658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:31.628659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:31.628660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:31.628662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:31.628663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.628664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.628665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.628666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:31.628667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:31.628674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:31.628685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:31.628690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:31.628695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:31.628699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:31.628703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:31.628708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:31.628712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:31.628717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:31.628722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:31.628726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.628731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.628735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.628740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:31.628744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:31.628752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:31.628760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:31.628766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:31.628773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:31.628778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:31.628785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:31.628790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:31.628796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:31.628801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:31.628807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:31.628812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:31.628818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:31.628828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:31.628834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:31.628839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:31.628845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:31.628855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:31.628861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:31.628870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:31.628875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:31.628881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.628891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.628896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.628902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.628906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.628912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.628917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:31.628927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:31.628937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:31.628943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:31.628996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:31.634794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:31.635888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:31.635910Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:31.635913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:31.635920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:31.635927Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2246 [2:7555896267950433396:10292]
2025-09-30T14:56:31.635949Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:31.635966Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:31.635968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:31.635970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:31.635973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:31.635987Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:31.635993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:31.636001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:31.636052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.636059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.636061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.636064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:31.636066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:31.636135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:31.636145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.636157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.636170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.636188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:31.636204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896268040206191:3671], now have 1 active actors on pipe
2025-09-30T14:56:31.636213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896268040206107:2454], now have 1 active actors on pipe
2025-09-30T14:56:31.636218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896267950433390:10292]
2025-09-30T14:56:31.636219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896267950433390:10292]
2025-09-30T14:56:31.636220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896267950433390:10292]
2025-09-30T14:56:31.636232Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:31.636241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:31.636250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:31.636249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:31.636253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:31.636253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:31.636257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:31.636322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2246
2025-09-30T14:56:31.636324Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2246
2025-09-30T14:56:31.636284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896267950433390:10292]
2025-09-30T14:56:31.636297Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:31.636317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:31.636620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:31.636631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:31.636662Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|333b2ada-a4b1bae9-76412085-4b5cdda6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:31.636674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:31.636679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:31.636681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:31.636690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:31.636711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:31.636730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:31.636986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:31.636994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:31.637007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:31.637143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2247 partition: 0 MaxSeqNo: 42 sessionId: src_id|333b2ada-a4b1bae9-76412085-4b5cdda6_0
2025-09-30T14:56:31.637657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7421e1e-234582c2-7ff6a000-94d92573_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|333b2ada-a4b1bae9-76412085-4b5cdda6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:31.641145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|333b2ada-a4b1bae9-76412085-4b5cdda6_0] Write session: try to update token
2025-09-30T14:56:31.641179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|333b2ada-a4b1bae9-76412085-4b5cdda6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:31.655487Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:31.655511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:31.655523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896267950433390:10292]
2025-09-30T14:56:31.655578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:31.655590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:31.655776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:31.655930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:31.656091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:31.656249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:31.656467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:31.656525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:31.660709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2247 sessionId: src_id|333b2ada-a4b1bae9-76412085-4b5cdda6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:31.664987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:31.665044Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:31.665063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:31.665065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:31.665067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:31.665075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896267950433390:10292]
2025-09-30T14:56:31.665079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896267950433390:10292]
2025-09-30T14:56:31.665084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896267950433390:10292]
2025-09-30T14:56:31.665117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:31.665123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.665125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:31.665127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:31.665133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:31.665146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:31.665246Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:31.712952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896268040206203:3180]
2025-09-30T14:56:31.713188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2246, pipe: [1:7555896268040206203:3180]
2025-09-30T14:56:31.782246Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:31.782488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:31.782501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:31.782517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896268040206203:3180], now have 1 active actors on pipe
2025-09-30T14:56:31.782730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896268040206203:3180]
2025-09-30T14:56:31.782779Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:31.782747Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:31.782771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:31.782774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:31.782841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2247 reason: error at write: Disconnected sessionId: src_id|333b2ada-a4b1bae9-76412085-4b5cdda6_0
2025-09-30T14:56:31.783032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2247 sessionId: src_id|333b2ada-a4b1bae9-76412085-4b5cdda6_0 is DEAD
2025-09-30T14:56:31.783176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|333b2ada-a4b1bae9-76412085-4b5cdda6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:31.783182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|333b2ada-a4b1bae9-76412085-4b5cdda6_0] Write session will restart in 0.008425s
2025-09-30T14:56:31.783203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|333b2ada-a4b1bae9-76412085-4b5cdda6_0] Write session: Do CDS request
2025-09-30T14:56:31.783209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|333b2ada-a4b1bae9-76412085-4b5cdda6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:31.793346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:31.794613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|333b2ada-a4b1bae9-76412085-4b5cdda6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:31.794666Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:31.794695Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2248
2025-09-30T14:56:31.794861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2248 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:31.794916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2248 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:31.794927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2248 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:31.794932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:31.795070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:31.795278Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:31.795290Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:31.795302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:31.795363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:31.795374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2248 sessionId:  describe result for acl check
2025-09-30T14:56:31.795405Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896267950433482:10294]
2025-09-30T14:56:31.795430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:31.795439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:31.795442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:31.795448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896268040206254:3681] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:31.796017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896268040206254:3681] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:31.796073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:31.796529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:31.796581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:31.796948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:31.797012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:31.797021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:31.797022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:31.797024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:31.797025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:31.797026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:31.797028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:31.797029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:31.797030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:31.797032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:31.797035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.797036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.797037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.797039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:31.797040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:31.797047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:31.797057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:31.797062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:31.797067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:31.797071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:31.797075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:31.797080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:31.797084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:31.797088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:31.797093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:31.797097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.797101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.797106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.797111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:31.797116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:31.797122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:31.797131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:31.797138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:31.797144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:31.797149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:31.797155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:31.797160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:31.797166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:31.797170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:31.797176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:31.797181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:31.797188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:31.797193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:31.797208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:31.797213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:31.797220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:31.797225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:31.797231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:31.797236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:31.797242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:31.797247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.797253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.797257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.797263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.797269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.797274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.797279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:31.797285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:31.797289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:31.797295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:31.797357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:31.798295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896268040206254:3681] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:31.802475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896268040206254:3681] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:31.802494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896268040206254:3681] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:31.802497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896268040206254:3681] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:31.802573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2248 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:31.802911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:31.803994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:31.804016Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:31.804019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:31.804023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:31.804031Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2247 [2:7555896267950433482:10294]
2025-09-30T14:56:31.804045Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:31.804061Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:31.804069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:31.804072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:31.804075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:31.804087Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:31.804096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:31.804102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:31.804158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.804167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.804171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.804174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:31.804177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:31.804245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:31.804254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.804266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.804281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.804297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:31.804321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896268040206292:3681], now have 1 active actors on pipe
2025-09-30T14:56:31.804330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896268040206204:2454], now have 1 active actors on pipe
2025-09-30T14:56:31.804335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896267950433476:10294]
2025-09-30T14:56:31.804343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896267950433476:10294]
2025-09-30T14:56:31.804344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896267950433476:10294]
2025-09-30T14:56:31.804358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:31.804375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:31.804384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:31.804387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:31.804389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:31.804393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:31.804399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:31.804409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2247
2025-09-30T14:56:31.804434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896267950433476:10294]
2025-09-30T14:56:31.804409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2247
2025-09-30T14:56:31.804443Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:31.804446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:31.804467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:31.804476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:31.804509Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f14029b0-7f29b170-ccb060d8-624372e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:31.804523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:31.804531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:31.804533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:31.804542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:31.804561Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:31.804587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:31.804745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:31.804758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:31.804788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:31.804883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2248 partition: 0 MaxSeqNo: 42 sessionId: src_id|f14029b0-7f29b170-ccb060d8-624372e3_0
2025-09-30T14:56:31.805385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|333b2ada-a4b1bae9-76412085-4b5cdda6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f14029b0-7f29b170-ccb060d8-624372e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:31.808497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f14029b0-7f29b170-ccb060d8-624372e3_0] Write session: try to update token
2025-09-30T14:56:31.808517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f14029b0-7f29b170-ccb060d8-624372e3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:31.817620Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:31.817643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:31.817645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:31.817648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:31.817657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896267950433476:10294]
2025-09-30T14:56:31.817662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896267950433476:10294]
2025-09-30T14:56:31.817666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896267950433476:10294]
2025-09-30T14:56:31.817707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:31.817716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.817715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:31.817719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:31.817720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:31.817724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:31.817866Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:31.829266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2248 sessionId: src_id|f14029b0-7f29b170-ccb060d8-624372e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:31.832057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:31.882936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896268040206302:3180]
2025-09-30T14:56:31.883178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2247, pipe: [1:7555896268040206302:3180]
2025-09-30T14:56:31.929554Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:31.929870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:31.929885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:31.929907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896268040206302:3180], now have 1 active actors on pipe
2025-09-30T14:56:31.930146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:31.930147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896268040206302:3180]
2025-09-30T14:56:31.930164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:31.930172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:31.930230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2248 reason: error at write: Disconnected sessionId: src_id|f14029b0-7f29b170-ccb060d8-624372e3_0
2025-09-30T14:56:31.930409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2248 sessionId: src_id|f14029b0-7f29b170-ccb060d8-624372e3_0 is DEAD
2025-09-30T14:56:31.930662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f14029b0-7f29b170-ccb060d8-624372e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:31.930672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f14029b0-7f29b170-ccb060d8-624372e3_0] Write session will restart in 0.008907s
2025-09-30T14:56:31.930697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f14029b0-7f29b170-ccb060d8-624372e3_0] Write session: Do CDS request
2025-09-30T14:56:31.930702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f14029b0-7f29b170-ccb060d8-624372e3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:31.930679Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:31.940821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f14029b0-7f29b170-ccb060d8-624372e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:31.940888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:31.940907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2249
2025-09-30T14:56:31.941094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2249 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:31.941131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2249 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:31.941136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2249 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:31.941141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:31.941628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2249 sessionId:  describe result for acl check
2025-09-30T14:56:31.941672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:31.941678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:31.941680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:31.941687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896268040206352:3698] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:31.941959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:31.942271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896268040206352:3698] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:31.944076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:31.944268Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:31.944279Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:31.944303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:31.944350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:31.944391Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896267950433582:10298]
2025-09-30T14:56:31.944959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:31.945235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:31.945280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:31.945624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:31.945696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:31.945703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:31.945704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:31.945705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:31.945706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:31.945707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:31.945708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:31.945709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:31.945711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:31.945712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:31.945714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.945715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.945716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.945717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:31.945718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:31.945723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:31.945733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:31.945737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:31.945741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:31.945746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:31.945749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:31.945753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:31.945757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:31.945762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:31.945767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:31.945771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.945775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.945779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.945783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:31.945786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:31.945794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:31.945802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:31.945809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:31.945815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:31.945820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:31.945825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:31.945829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:31.945833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:31.945838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:31.945843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:31.945847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:31.945852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:31.945858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:31.945864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:31.945868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:31.945873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:31.945878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:31.945883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:31.945876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896268040206352:3698] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:31.945895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:31.945901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:31.945905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.945910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.945914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.945920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.945925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.945930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.945934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:31.945939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:31.945945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:31.945950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:31.945992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:31.952601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896268040206352:3698] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:31.952623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896268040206352:3698] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:31.952631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896268040206352:3698] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:31.952641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2249 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:31.952939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:31.954024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:31.954048Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:31.954050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:31.954055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:31.954062Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2248 [2:7555896267950433582:10298]
2025-09-30T14:56:31.954078Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:31.954095Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:31.954099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:31.954102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:31.954105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:31.954127Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:31.954142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:31.954154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:31.954219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.954229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.954231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.954234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:31.954238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:31.954305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:31.954313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.954328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:31.954342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:31.954357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:31.954389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896268040206392:3698], now have 1 active actors on pipe
2025-09-30T14:56:31.954398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896268040206304:2454], now have 1 active actors on pipe
2025-09-30T14:56:31.954405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896267950433576:10298]
2025-09-30T14:56:31.954408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896267950433576:10298]
2025-09-30T14:56:31.954410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896267950433576:10298]
2025-09-30T14:56:31.954429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:31.954448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:31.954461Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2248
2025-09-30T14:56:31.954463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2248
2025-09-30T14:56:31.954467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:31.954471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:31.954475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:31.954476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:31.954478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:31.954515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896267950433576:10298]
2025-09-30T14:56:31.954517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:31.954521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:31.954536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:31.954541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:31.954598Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44f48507-ce34d6b3-59ea8cbf-a7965bb6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:31.954612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:31.954616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:31.954618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:31.954630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:31.954641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:31.954668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:31.954843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:31.954854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:31.954870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:31.954987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2249 partition: 0 MaxSeqNo: 42 sessionId: src_id|44f48507-ce34d6b3-59ea8cbf-a7965bb6_0
2025-09-30T14:56:31.955423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f14029b0-7f29b170-ccb060d8-624372e3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|44f48507-ce34d6b3-59ea8cbf-a7965bb6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:31.958330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44f48507-ce34d6b3-59ea8cbf-a7965bb6_0] Write session: try to update token
2025-09-30T14:56:31.958351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44f48507-ce34d6b3-59ea8cbf-a7965bb6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:31.967970Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:31.967998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:31.968000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:31.968003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:31.968014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896267950433576:10298]
2025-09-30T14:56:31.968020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896267950433576:10298]
2025-09-30T14:56:31.968024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896267950433576:10298]
2025-09-30T14:56:31.968067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:31.968078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:31.968080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:31.968083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:31.968105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:31.968116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:31.968232Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:31.975596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2249 sessionId: src_id|44f48507-ce34d6b3-59ea8cbf-a7965bb6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:31.978537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:32.030437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896272335173696:3180]
2025-09-30T14:56:32.030749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2248, pipe: [1:7555896272335173696:3180]
2025-09-30T14:56:32.084275Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:32.084721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:32.084737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:32.084757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896272335173696:3180], now have 1 active actors on pipe
2025-09-30T14:56:32.084997Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:32.085031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896272335173696:3180]
2025-09-30T14:56:32.085039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:32.085043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:32.085069Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:32.085115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2249 reason: error at write: Disconnected sessionId: src_id|44f48507-ce34d6b3-59ea8cbf-a7965bb6_0
2025-09-30T14:56:32.085330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2249 sessionId: src_id|44f48507-ce34d6b3-59ea8cbf-a7965bb6_0 is DEAD
2025-09-30T14:56:32.085477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44f48507-ce34d6b3-59ea8cbf-a7965bb6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:32.085486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44f48507-ce34d6b3-59ea8cbf-a7965bb6_0] Write session will restart in 0.009188s
2025-09-30T14:56:32.085510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44f48507-ce34d6b3-59ea8cbf-a7965bb6_0] Write session: Do CDS request
2025-09-30T14:56:32.085535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44f48507-ce34d6b3-59ea8cbf-a7965bb6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:32.095769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44f48507-ce34d6b3-59ea8cbf-a7965bb6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:32.095861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:32.095879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2250
2025-09-30T14:56:32.097360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:32.099230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:32.099500Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:32.099512Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:32.099523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:32.099526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2250 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:32.099577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:32.099596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2250 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:32.099605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2250 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:32.099610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:32.099620Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896272245400965:10300]
2025-09-30T14:56:32.100100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2250 sessionId:  describe result for acl check
2025-09-30T14:56:32.100143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:32.100150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:32.100152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:32.100158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896272335173760:3711] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:32.100279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:32.100759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:32.100815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:32.100722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896272335173760:3711] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:32.101172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:32.101238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:32.101246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:32.101248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:32.101248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:32.101252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:32.101253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:32.101255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:32.101256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:32.101257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:32.101258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:32.101259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.101260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.101261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.101263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:32.101264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:32.101269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:32.101279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:32.101284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:32.101288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:32.101292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:32.101297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:32.101301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:32.101319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:32.101323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:32.101327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:32.101331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.101335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.101339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.101344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:32.101348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:32.101355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:32.101362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:32.101368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:32.101374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:32.101379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:32.101385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:32.101390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:32.101395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:32.101402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:32.101408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:32.101417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:32.101424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:32.101430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:32.101439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:32.101444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:32.101449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:32.101454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:32.101461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:32.101465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:32.101469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:32.101474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.101485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.101489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.101494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.101503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.101510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.101515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:32.101520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:32.101524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:32.101530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:32.101578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:32.102781Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:11802 } ]
2025-09-30T14:56:32.103450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896272335173760:3711] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:32.106841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896272335173760:3711] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:32.106859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896272335173760:3711] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:32.106863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896272335173760:3711] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:32.106871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2250 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:32.107210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:32.108249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:32.108266Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:32.108269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:32.108274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:32.108282Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2249 [2:7555896272245400965:10300]
2025-09-30T14:56:32.108299Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:32.108317Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:32.108326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:32.108329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:32.108332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:32.108349Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:32.108360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:32.108367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:32.108433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.108441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.108443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.108446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:32.108449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:32.108522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:32.108530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.108543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.108561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.108580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:32.108603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896272335173798:3711], now have 1 active actors on pipe
2025-09-30T14:56:32.108613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896272335173709:2454], now have 1 active actors on pipe
2025-09-30T14:56:32.108620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896272245400960:10300]
2025-09-30T14:56:32.108627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896272245400960:10300]
2025-09-30T14:56:32.108629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896272245400960:10300]
2025-09-30T14:56:32.108642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:32.108660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:32.108667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:32.108671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:32.108674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:32.108680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:32.108684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:32.108695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2249
2025-09-30T14:56:32.108717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896272245400960:10300]
2025-09-30T14:56:32.108737Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2249
2025-09-30T14:56:32.108726Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:32.108729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:32.108743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:32.108748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:32.108853Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab4c684b-d3eea453-998d1f85-bada98d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:32.108867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:32.108870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:32.108872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:32.108882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:32.108894Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:32.108921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:32.109072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:32.109083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:32.109096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:32.109160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2250 partition: 0 MaxSeqNo: 42 sessionId: src_id|ab4c684b-d3eea453-998d1f85-bada98d2_0
2025-09-30T14:56:32.109565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44f48507-ce34d6b3-59ea8cbf-a7965bb6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ab4c684b-d3eea453-998d1f85-bada98d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:32.112518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4c684b-d3eea453-998d1f85-bada98d2_0] Write session: try to update token
2025-09-30T14:56:32.112538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4c684b-d3eea453-998d1f85-bada98d2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:32.125234Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:32.125263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:32.125266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:32.125268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:32.125279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896272245400960:10300]
2025-09-30T14:56:32.125284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896272245400960:10300]
2025-09-30T14:56:32.125288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896272245400960:10300]
2025-09-30T14:56:32.125357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:32.125359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:32.125364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.125365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:32.125367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:32.125369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:32.125524Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:32.139410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2250 sessionId: src_id|ab4c684b-d3eea453-998d1f85-bada98d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:32.142130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:32.185085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896272335173810:3180]
2025-09-30T14:56:32.185396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2249, pipe: [1:7555896272335173810:3180]
2025-09-30T14:56:32.240483Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:32.240969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:32.240985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:32.241003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896272335173810:3180], now have 1 active actors on pipe
2025-09-30T14:56:32.241815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4c684b-d3eea453-998d1f85-bada98d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:32.241827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4c684b-d3eea453-998d1f85-bada98d2_0] Write session will restart in 0.009367s
2025-09-30T14:56:32.241853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4c684b-d3eea453-998d1f85-bada98d2_0] Write session: Do CDS request
2025-09-30T14:56:32.241859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4c684b-d3eea453-998d1f85-bada98d2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:32.241672Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:32.241353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:32.241370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:32.241400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896272335173810:3180]
2025-09-30T14:56:32.241418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:32.241445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2250 reason: error at write: Disconnected sessionId: src_id|ab4c684b-d3eea453-998d1f85-bada98d2_0
2025-09-30T14:56:32.242515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2250 sessionId: src_id|ab4c684b-d3eea453-998d1f85-bada98d2_0 is DEAD
2025-09-30T14:56:32.254712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:32.255738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4c684b-d3eea453-998d1f85-bada98d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:32.255915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:32.255934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2251
2025-09-30T14:56:32.256687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:32.256965Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:32.256977Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:32.256992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:32.257058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:32.257104Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896272245401053:10302]
2025-09-30T14:56:32.257770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:32.258170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:32.258229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:32.259821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2251 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:32.259882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2251 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:32.259890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2251 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:32.259902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:32.260391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2251 sessionId:  describe result for acl check
2025-09-30T14:56:32.260429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:32.260431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:32.260433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:32.260440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896272335173871:3723] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:32.260985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896272335173871:3723] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:32.260616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:32.260715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:32.260719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:32.260720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:32.260721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:32.260723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:32.260724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:32.260726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:32.260727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:32.260728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:32.260730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:32.260731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.260732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.260733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.260734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:32.260735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:32.260742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:32.260752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:32.260757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:32.260760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:32.260765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:32.260769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:32.260773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:32.260776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:32.260780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:32.260785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:32.260789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.260793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.260796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.260800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:32.260803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:32.260812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:32.260820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:32.260829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:32.260835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:32.260840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:32.260844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:32.260851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:32.260855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:32.260861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:32.260866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:32.260870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:32.260875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:32.260879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:32.260884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:32.260888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:32.260894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:32.260900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:32.260906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:32.260910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:32.260914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:32.260919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.260927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.260932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.260937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.260941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.260946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.260950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:32.260956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:32.260961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:32.260965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:32.261008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:32.265689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896272335173871:3723] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:32.267915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:32.268976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:32.268983Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:32.268986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:32.268991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:32.268998Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2250 [2:7555896272245401053:10302]
2025-09-30T14:56:32.269016Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:32.269031Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:32.269036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:32.269040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:32.269042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:32.269058Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:32.269065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:32.269073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:32.269140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.269142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.269144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.269147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:32.269150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:32.269224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:32.269227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.269242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.269256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.269271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:32.269291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896272335173814:2454], now have 1 active actors on pipe
2025-09-30T14:56:32.269299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896272245401048:10302]
2025-09-30T14:56:32.269301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896272245401048:10302]
2025-09-30T14:56:32.269316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896272245401048:10302]
2025-09-30T14:56:32.269328Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:32.269342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:32.269357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:32.269359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:32.269381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:32.269385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:32.269388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:32.269397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896272245401048:10302]
2025-09-30T14:56:32.269400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:32.269402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:32.271474Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2250
2025-09-30T14:56:32.277764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896272335173871:3723] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:32.277787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896272335173871:3723] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:32.277791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896272335173871:3723] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:32.277801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2251 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:32.278394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896272335173923:3723], now have 1 active actors on pipe
2025-09-30T14:56:32.278474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2250
2025-09-30T14:56:32.278569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:32.278590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:32.278641Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|613422c1-d8556f84-1bff6568-3ff903c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:32.278660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:32.278665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:32.278669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:32.278688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:32.278705Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:32.278726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:32.278935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:32.278945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:32.278965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:32.279049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2251 partition: 0 MaxSeqNo: 42 sessionId: src_id|613422c1-d8556f84-1bff6568-3ff903c5_0
2025-09-30T14:56:32.279525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4c684b-d3eea453-998d1f85-bada98d2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|613422c1-d8556f84-1bff6568-3ff903c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:32.282704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|613422c1-d8556f84-1bff6568-3ff903c5_0] Write session: try to update token
2025-09-30T14:56:32.282725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|613422c1-d8556f84-1bff6568-3ff903c5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:32.282216Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:32.282240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:32.282243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:32.282245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:32.282253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896272245401048:10302]
2025-09-30T14:56:32.282258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896272245401048:10302]
2025-09-30T14:56:32.282261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896272245401048:10302]
2025-09-30T14:56:32.282301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:32.282307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:32.282311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.282313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:32.282314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:32.282330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:32.282460Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:32.309048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2251 sessionId: src_id|613422c1-d8556f84-1bff6568-3ff903c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:32.312513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:32.341731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896272335173937:3180]
2025-09-30T14:56:32.342115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2250, pipe: [1:7555896272335173937:3180]
2025-09-30T14:56:32.399920Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:32.400352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:32.400371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:32.400389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896272335173937:3180], now have 1 active actors on pipe
2025-09-30T14:56:32.400680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:32.400698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:32.400703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:32.400747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896272335173937:3180]
2025-09-30T14:56:32.400764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2251 reason: error at write: Disconnected sessionId: src_id|613422c1-d8556f84-1bff6568-3ff903c5_0
2025-09-30T14:56:32.401077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|613422c1-d8556f84-1bff6568-3ff903c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:32.401085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|613422c1-d8556f84-1bff6568-3ff903c5_0] Write session will restart in 0.007179s
2025-09-30T14:56:32.401109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|613422c1-d8556f84-1bff6568-3ff903c5_0] Write session: Do CDS request
2025-09-30T14:56:32.401115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|613422c1-d8556f84-1bff6568-3ff903c5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:32.400638Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:32.400964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2251 sessionId: src_id|613422c1-d8556f84-1bff6568-3ff903c5_0 is DEAD
2025-09-30T14:56:32.409909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|613422c1-d8556f84-1bff6568-3ff903c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:32.410005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:32.410026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2252
2025-09-30T14:56:32.410201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2252 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:32.410239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2252 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:32.410244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2252 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:32.410248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:32.410706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2252 sessionId:  describe result for acl check
2025-09-30T14:56:32.410756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:32.410763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:32.410765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:32.410771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896272335173953:3744] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:32.411331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896272335173953:3744] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:32.414493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896272335173953:3744] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:32.415565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:32.417774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:32.418028Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:32.418038Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:32.418048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:32.418098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:32.418143Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896272245401179:10316]
2025-09-30T14:56:32.418851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:32.421553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:32.421667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:32.421906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896272335173953:3744] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:32.421929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896272335173953:3744] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:32.421933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896272335173953:3744] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:32.421943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2252 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:32.422089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:32.422169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:32.422176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:32.422177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:32.422178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:32.422180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:32.422182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:32.422183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:32.422185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:32.422186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:32.422188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:32.422189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.422191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.422193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.422194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:32.422196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:32.422205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:32.422216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:32.422219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:32.422223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:32.422227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:32.422231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:32.422234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:32.422238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:32.422242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:32.422247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:32.422250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.422254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.422259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.422262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:32.422266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:32.422275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:32.422284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:32.422291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:32.422297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:32.422301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:32.422306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:32.422310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:32.422315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:32.422320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:32.422325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:32.422337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:32.422342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:32.422347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:32.422352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:32.422356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:32.422362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:32.422368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:32.422373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:32.422377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:32.422382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:32.422387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.422397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.422401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.422406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.422411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.422416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.422420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:32.422425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:32.422430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:32.422435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:32.422482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:32.428889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:32.429951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:32.429970Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:32.429972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:32.429976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:32.429982Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2251 [2:7555896272245401179:10316]
2025-09-30T14:56:32.429996Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:32.430010Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:32.430012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:32.430014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:32.430020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:32.430032Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:32.430038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:32.430044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:32.430094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.430100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.430103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.430106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:32.430108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:32.430175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:32.430183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.430201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.430217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.430238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:32.430258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896272245401174:10316]
2025-09-30T14:56:32.430266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896272245401174:10316]
2025-09-30T14:56:32.430268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896272245401174:10316]
2025-09-30T14:56:32.430281Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:32.430294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896272335173938:2454], now have 1 active actors on pipe
2025-09-30T14:56:32.430296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:32.430299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:32.430301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:32.430302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896272335174027:3744], now have 1 active actors on pipe
2025-09-30T14:56:32.430309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:32.430322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:32.430330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:32.430361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2251
2025-09-30T14:56:32.430362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896272245401174:10316]
2025-09-30T14:56:32.430374Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:32.430384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:32.430411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2251
2025-09-30T14:56:32.430574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:32.430587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:32.430615Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28693518-3f9a98ad-d80522fa-38431680_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:32.430623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:32.430631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:32.430633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:32.430646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:32.430660Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:32.430675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:32.430918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:32.430935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:32.430959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:32.431209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2252 partition: 0 MaxSeqNo: 42 sessionId: src_id|28693518-3f9a98ad-d80522fa-38431680_0
2025-09-30T14:56:32.431649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|613422c1-d8556f84-1bff6568-3ff903c5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|28693518-3f9a98ad-d80522fa-38431680_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:32.434657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28693518-3f9a98ad-d80522fa-38431680_0] Write session: try to update token
2025-09-30T14:56:32.434674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28693518-3f9a98ad-d80522fa-38431680_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:32.449912Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:32.449939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:32.449950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896272245401174:10316]
2025-09-30T14:56:32.450001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:32.450010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:32.450233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:32.450419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:32.450587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:32.450758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:32.450981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:32.451030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:32.456078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2252 sessionId: src_id|28693518-3f9a98ad-d80522fa-38431680_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:32.459023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:32.459500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:32.459526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:32.459561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:32.461953Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:32.461975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:32.461978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:32.461980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:32.461994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896272245401174:10316]
2025-09-30T14:56:32.461998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896272245401174:10316]
2025-09-30T14:56:32.462002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896272245401174:10316]
2025-09-30T14:56:32.462044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:32.462051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.462054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:32.462064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:32.462072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:32.462077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:32.462213Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:32.459660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:32.501001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896272335174037:3180]
2025-09-30T14:56:32.501351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2251, pipe: [1:7555896272335174037:3180]
2025-09-30T14:56:32.576739Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:32.585982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:32.586023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:32.586231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:32.586305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:32.586390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:32.586465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:32.586513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:32.586519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:32.586597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:32.586661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:32.586728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:32.586808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:32.586851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:32.586855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:32.586930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:32.586996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:32.587065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:32.587135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:32.587181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:32.587184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:32.587414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:32.587495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:32.587780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:32.587861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:32.587918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:32.587927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:32.588005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:32.588284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:32.588555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:32.588837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:32.588987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:32.588998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:32.589266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:32.589354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:32.589428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:32.589498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:32.589645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:32.589654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:32.589730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:32.589802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:32.589876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:32.589949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:32.590001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:32.590009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:32.590084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:32.590152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:32.590224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:32.590506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:32.590571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:32.590591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:32.590868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:32.590939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:32.591009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:32.591290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:32.591341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:32.591351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:32.591623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:32.591695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:32.591766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:32.591839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:32.591891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:32.591898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:32.591976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896272335174037:3180], now have 1 active actors on pipe
2025-09-30T14:56:32.592294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:32.592322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:32.592327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:32.592361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2252 reason: error at write: Disconnected sessionId: src_id|28693518-3f9a98ad-d80522fa-38431680_0
2025-09-30T14:56:32.592364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896272335174037:3180]
2025-09-30T14:56:32.592583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2252 sessionId: src_id|28693518-3f9a98ad-d80522fa-38431680_0 is DEAD
2025-09-30T14:56:32.592780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28693518-3f9a98ad-d80522fa-38431680_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:32.592796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28693518-3f9a98ad-d80522fa-38431680_0] Write session will restart in 0.006410s
2025-09-30T14:56:32.592844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28693518-3f9a98ad-d80522fa-38431680_0] Write session: Do CDS request
2025-09-30T14:56:32.592850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28693518-3f9a98ad-d80522fa-38431680_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:32.593451Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:32.600837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28693518-3f9a98ad-d80522fa-38431680_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:32.603362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:32.603389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2253
2025-09-30T14:56:32.603647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2253 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:32.603707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2253 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:32.603713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2253 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:32.603718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:32.604307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2253 sessionId:  describe result for acl check
2025-09-30T14:56:32.604352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:32.604359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:32.604362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:32.604369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896272335174048:3757] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:32.605055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896272335174048:3757] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:32.608572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896272335174048:3757] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:32.614605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:32.614789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896272335174048:3757] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:32.614813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896272335174048:3757] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:32.614817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896272335174048:3757] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:32.614827Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2253 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:32.620604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:32.620955Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:32.620969Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:32.620983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:32.621059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:32.621115Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896272245401273:10319]
2025-09-30T14:56:32.621809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:32.622390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:32.622476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:32.622914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:32.623040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:32.623052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:32.623054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:32.623055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:32.623058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:32.623059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:32.623061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:32.623062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:32.623064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:32.623066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:32.623068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.623069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.623071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.623073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:32.623074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:32.623087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:32.623099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:32.623105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:32.623110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:32.623114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:32.623119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:32.623123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:32.623128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:32.623132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:32.623137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:32.623141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.623151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.623155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.623160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:32.623166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:32.623180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:32.623199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:32.623207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:32.623214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:32.623221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:32.623227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:32.623233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:32.623240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:32.623271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:32.623279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:32.623293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:32.623299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:32.623312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:32.623318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:32.623323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:32.623328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:32.623335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:32.623340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:32.623344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:32.623349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:32.623355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.623360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.623367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.623373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.623381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.623387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.623402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:32.623407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:32.623413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:32.623419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:32.623466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:32.630251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:32.631192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:32.631211Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:32.631213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:32.631216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:32.631223Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2252 [2:7555896272245401273:10319]
2025-09-30T14:56:32.631237Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:32.631272Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:32.631275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:32.631279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:32.631282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:32.631297Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:32.631302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:32.631311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:32.631376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.631386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.631388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.631391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:32.631393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:32.631477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:32.631484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.631498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.631514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.631538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:32.631561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896272335174126:3757], now have 1 active actors on pipe
2025-09-30T14:56:32.631569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896272335174039:2454], now have 1 active actors on pipe
2025-09-30T14:56:32.631575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896272245401267:10319]
2025-09-30T14:56:32.631576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896272245401267:10319]
2025-09-30T14:56:32.631578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896272245401267:10319]
2025-09-30T14:56:32.631590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:32.631604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:32.631605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:32.631609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:32.631611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:32.631623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:32.631627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:32.631665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896272245401267:10319]
2025-09-30T14:56:32.631676Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:32.631702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2252
2025-09-30T14:56:32.631752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2252
2025-09-30T14:56:32.631694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:32.631743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:32.631747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:32.631772Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0ee3752-57021b32-7332363c-225b4b06_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:32.631779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:32.631784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:32.631788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:32.631800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:32.631810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:32.631829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:32.631965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:32.631976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:32.631992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:32.632083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2253 partition: 0 MaxSeqNo: 42 sessionId: src_id|a0ee3752-57021b32-7332363c-225b4b06_0
2025-09-30T14:56:32.632493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28693518-3f9a98ad-d80522fa-38431680_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a0ee3752-57021b32-7332363c-225b4b06_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:32.635520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0ee3752-57021b32-7332363c-225b4b06_0] Write session: try to update token
2025-09-30T14:56:32.635540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0ee3752-57021b32-7332363c-225b4b06_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:32.646526Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:32.646552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:32.646555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:32.646558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:32.646568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896272245401267:10319]
2025-09-30T14:56:32.646573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896272245401267:10319]
2025-09-30T14:56:32.646578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896272245401267:10319]
2025-09-30T14:56:32.646628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:32.646638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.646637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:32.646641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:32.646645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:32.646650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:32.647001Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:32.658364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2253 sessionId: src_id|a0ee3752-57021b32-7332363c-225b4b06_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:32.661339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:32.691427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896272335174141:3180]
2025-09-30T14:56:32.691806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2252, pipe: [1:7555896272335174141:3180]
2025-09-30T14:56:32.765473Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:32.765877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:32.765890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:32.765910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896272335174141:3180], now have 1 active actors on pipe
2025-09-30T14:56:32.766178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:32.766198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:32.766229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896272335174141:3180]
2025-09-30T14:56:32.766261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:32.766265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2253 reason: error at write: Disconnected sessionId: src_id|a0ee3752-57021b32-7332363c-225b4b06_0
2025-09-30T14:56:32.766439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2253 sessionId: src_id|a0ee3752-57021b32-7332363c-225b4b06_0 is DEAD
2025-09-30T14:56:32.766137Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:32.767577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0ee3752-57021b32-7332363c-225b4b06_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:32.767593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0ee3752-57021b32-7332363c-225b4b06_0] Write session will restart in 0.005299s
2025-09-30T14:56:32.767626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0ee3752-57021b32-7332363c-225b4b06_0] Write session: Do CDS request
2025-09-30T14:56:32.767636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0ee3752-57021b32-7332363c-225b4b06_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:32.773964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0ee3752-57021b32-7332363c-225b4b06_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:32.774018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:32.774036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2254
2025-09-30T14:56:32.774179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2254 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:32.774210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2254 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:32.774221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2254 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:32.774225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:32.774701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2254 sessionId:  describe result for acl check
2025-09-30T14:56:32.774745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:32.774752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:32.774754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:32.774761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896272335174178:3764] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:32.775342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896272335174178:3764] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:32.777415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:32.779676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:32.779928Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:32.779938Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:32.779949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:32.780034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:32.780088Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896272245401364:10321]
2025-09-30T14:56:32.780265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896272335174178:3764] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:32.780779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:32.781183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:32.781257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:32.781711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:32.781799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:32.781811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:32.781812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:32.781813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:32.781815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:32.781820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:32.781821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:32.781822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:32.781823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:32.781824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:32.781825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.781826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.781828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.781829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:32.781830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:32.781837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:32.781849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:32.781853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:32.781857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:32.781860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:32.781864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:32.781868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:32.781872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:32.781877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:32.781882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:32.781885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.781889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.781893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.781898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:32.781902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:32.781912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:32.781921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:32.781927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:32.781934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:32.781939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:32.781944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:32.781950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:32.781956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:32.781961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:32.781966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:32.781973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:32.781978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:32.781984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:32.781990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:32.781996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:32.782001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:32.782006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:32.782011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:32.782016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:32.782021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:32.782027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.782033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.782038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.782043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.782049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.782064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.782071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:32.782077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:32.782082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:32.782095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:32.782156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:32.783530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896272335174178:3764] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:32.783549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896272335174178:3764] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:32.783553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896272335174178:3764] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:32.783561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2254 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:32.788514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:32.789459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:32.789479Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:32.789482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:32.789486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:32.789493Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2253 [2:7555896272245401364:10321]
2025-09-30T14:56:32.789512Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:32.789534Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:32.789544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:32.789547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:32.789550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:32.789566Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:32.789574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:32.789581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:32.789643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.789652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.789653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.789657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:32.789660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:32.789834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:32.789843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.789856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.789871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.789888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:32.789915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896272335174236:3764], now have 1 active actors on pipe
2025-09-30T14:56:32.789924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896272335174142:2454], now have 1 active actors on pipe
2025-09-30T14:56:32.789931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896272245401358:10321]
2025-09-30T14:56:32.789933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896272245401358:10321]
2025-09-30T14:56:32.789934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896272245401358:10321]
2025-09-30T14:56:32.789948Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:32.789962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:32.789982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:32.789990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:32.790024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896272245401358:10321]
2025-09-30T14:56:32.790031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:32.790082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:32.790096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:32.790098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:32.790106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:32.790346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:32.790363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:32.790403Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3cca4f69-7c109989-d77195cc-85f28d41_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:32.790420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:32.790437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:32.790439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:32.790451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:32.790464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:32.790497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:32.791223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:32.791237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:32.791277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:32.791771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0ee3752-57021b32-7332363c-225b4b06_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3cca4f69-7c109989-d77195cc-85f28d41_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:32.794868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cca4f69-7c109989-d77195cc-85f28d41_0] Write session: try to update token
2025-09-30T14:56:32.794889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cca4f69-7c109989-d77195cc-85f28d41_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:32.790162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2253
2025-09-30T14:56:32.790197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2253
2025-09-30T14:56:32.791398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2254 partition: 0 MaxSeqNo: 42 sessionId: src_id|3cca4f69-7c109989-d77195cc-85f28d41_0
2025-09-30T14:56:32.803087Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:32.803117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:32.803120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:32.803122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:32.803132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896272245401358:10321]
2025-09-30T14:56:32.803136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896272245401358:10321]
2025-09-30T14:56:32.803140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896272245401358:10321]
2025-09-30T14:56:32.803184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:32.803191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.803194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:32.803189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:32.803204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:32.803209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:32.803419Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:32.817093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2254 sessionId: src_id|3cca4f69-7c109989-d77195cc-85f28d41_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:32.820205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:32.866009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896272335174244:3180]
2025-09-30T14:56:32.866347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2253, pipe: [1:7555896272335174244:3180]
2025-09-30T14:56:32.920235Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:32.920618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:32.920633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:32.920653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896272335174244:3180], now have 1 active actors on pipe
2025-09-30T14:56:32.920931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:32.920936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:32.920950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:32.920996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896272335174244:3180]
2025-09-30T14:56:32.920945Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:32.921396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cca4f69-7c109989-d77195cc-85f28d41_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:32.921411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cca4f69-7c109989-d77195cc-85f28d41_0] Write session will restart in 0.009235s
2025-09-30T14:56:32.921435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cca4f69-7c109989-d77195cc-85f28d41_0] Write session: Do CDS request
2025-09-30T14:56:32.921440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cca4f69-7c109989-d77195cc-85f28d41_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:32.921012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2254 reason: error at write: Disconnected sessionId: src_id|3cca4f69-7c109989-d77195cc-85f28d41_0
2025-09-30T14:56:32.921211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2254 sessionId: src_id|3cca4f69-7c109989-d77195cc-85f28d41_0 is DEAD
2025-09-30T14:56:32.931813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cca4f69-7c109989-d77195cc-85f28d41_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:32.931858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:32.931878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2255
2025-09-30T14:56:32.932026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2255 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:32.932071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2255 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:32.932076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2255 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:32.932081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:32.932533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2255 sessionId:  describe result for acl check
2025-09-30T14:56:32.932577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:32.932584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:32.932587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:32.932593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896272335174300:3769] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:32.932674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:32.933134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896272335174300:3769] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:32.934759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:32.934969Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:32.934981Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:32.934992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:32.935047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:32.935084Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896272245401471:10324]
2025-09-30T14:56:32.935756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:32.936106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:32.936181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:32.936550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:32.936617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:32.936623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:32.936624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:32.936626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:32.936627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:32.936628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:32.936629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:32.936631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:32.936632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:32.936633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:32.936634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.936635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.936637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.936638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:32.936639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:32.936645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:32.936656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:32.936660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:32.936664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:32.936669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:32.936673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:32.936677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:32.936681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:32.936685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:32.936690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:32.936694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.936698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.936702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.936709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:32.936713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:32.936719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:32.936727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:32.936733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:32.936739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:32.936743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:32.936748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:32.936755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:32.936760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:32.936765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:32.936770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:32.936774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:32.936779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:32.936784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:32.936790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:32.936794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:32.936799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:32.936810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:32.936816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:32.936824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:32.936830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:32.936839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.936843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.936847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.936856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.936860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.936862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896272335174300:3769] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:32.936865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.936874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:32.936881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:32.936886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:32.936891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:32.936937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:32.943140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896272335174300:3769] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:32.943173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896272335174300:3769] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:32.943177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896272335174300:3769] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:32.943187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2255 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:32.943635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:32.944713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:32.944728Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:32.944731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:32.944736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:32.944745Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2254 [2:7555896272245401471:10324]
2025-09-30T14:56:32.944763Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:32.944780Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:32.944783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:32.944787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:32.944790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:32.944806Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:32.944814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:32.944822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:32.944883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.944897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.944899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.944903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:32.944905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:32.944978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:32.944987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.945001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:32.945014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:32.945034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:32.945053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896272335174339:3769], now have 1 active actors on pipe
2025-09-30T14:56:32.945057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896272335174245:2454], now have 1 active actors on pipe
2025-09-30T14:56:32.945064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896272245401465:10324]
2025-09-30T14:56:32.945068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896272245401465:10324]
2025-09-30T14:56:32.945070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896272245401465:10324]
2025-09-30T14:56:32.945082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:32.945097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:32.945099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:32.945100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:32.945113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:32.945116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:32.945120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:32.945155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896272245401465:10324]
2025-09-30T14:56:32.945166Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:32.945177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:32.945167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2254
2025-09-30T14:56:32.945201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2254
2025-09-30T14:56:32.945401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:32.945417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:32.945450Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eaf746c4-252b52d0-ac6fd666-362b3b6e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:32.945471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:32.945475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:32.945478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:32.945498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:32.945515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:32.945538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:32.945754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:32.945766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:32.945798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:32.945948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2255 partition: 0 MaxSeqNo: 42 sessionId: src_id|eaf746c4-252b52d0-ac6fd666-362b3b6e_0
2025-09-30T14:56:32.946377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cca4f69-7c109989-d77195cc-85f28d41_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|eaf746c4-252b52d0-ac6fd666-362b3b6e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:32.949293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf746c4-252b52d0-ac6fd666-362b3b6e_0] Write session: try to update token
2025-09-30T14:56:32.949332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf746c4-252b52d0-ac6fd666-362b3b6e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:32.968507Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:32.968530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:32.968532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:32.968534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:32.968545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896272245401465:10324]
2025-09-30T14:56:32.968551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896272245401465:10324]
2025-09-30T14:56:32.968555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896272245401465:10324]
2025-09-30T14:56:32.968588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:32.968593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:32.968597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:32.968598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:32.968605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:32.968607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:32.968801Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:32.982781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2255 sessionId: src_id|eaf746c4-252b52d0-ac6fd666-362b3b6e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:32.985943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:33.021459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896276630141643:3180]
2025-09-30T14:56:33.021836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2254, pipe: [1:7555896276630141643:3180]
2025-09-30T14:56:33.087568Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:33.087929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:33.087949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:33.087991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896276630141643:3180], now have 1 active actors on pipe
2025-09-30T14:56:33.088295Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:33.088316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896276630141643:3180]
2025-09-30T14:56:33.088345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:33.088348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:33.088410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2255 reason: error at write: Disconnected sessionId: src_id|eaf746c4-252b52d0-ac6fd666-362b3b6e_0
2025-09-30T14:56:33.088616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2255 sessionId: src_id|eaf746c4-252b52d0-ac6fd666-362b3b6e_0 is DEAD
2025-09-30T14:56:33.088747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf746c4-252b52d0-ac6fd666-362b3b6e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:33.088757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf746c4-252b52d0-ac6fd666-362b3b6e_0] Write session will restart in 0.005695s
2025-09-30T14:56:33.088781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf746c4-252b52d0-ac6fd666-362b3b6e_0] Write session: Do CDS request
2025-09-30T14:56:33.088787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf746c4-252b52d0-ac6fd666-362b3b6e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:33.089990Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:33.095828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf746c4-252b52d0-ac6fd666-362b3b6e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:33.095921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:33.095943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2256
2025-09-30T14:56:33.099530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2256 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:33.099597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2256 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:33.099603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2256 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:33.099608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:33.100278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2256 sessionId:  describe result for acl check
2025-09-30T14:56:33.100314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:33.100316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:33.100318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:33.100323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896276630141668:3775] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:33.100913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896276630141668:3775] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:33.108759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896276630141668:3775] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:33.116183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896276630141668:3775] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:33.116211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896276630141668:3775] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:33.116097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:33.116215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896276630141668:3775] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:33.116225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2256 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:33.119612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:33.119879Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:33.119890Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:33.119902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:33.119961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:33.120013Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896276540368862:10327]
2025-09-30T14:56:33.120770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:33.121167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:33.121216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:33.121615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:33.121690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:33.121697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:33.121698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:33.121700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:33.121701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:33.121703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:33.121705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:33.121706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:33.121707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:33.121709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:33.121710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.121711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.121713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.121714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:33.121715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:33.121722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:33.121734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:33.121738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:33.121744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:33.121748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:33.121752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:33.121757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:33.121761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:33.121765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:33.121770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:33.121773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.121776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.121781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.121785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:33.121789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:33.121798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:33.121807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:33.121813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:33.121820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:33.121826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:33.121832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:33.121839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:33.121845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:33.121851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:33.121857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:33.121862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:33.121877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:33.121884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:33.121889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:33.121896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:33.121902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:33.121913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:33.121919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:33.121924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:33.121930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:33.121935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.121941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.121946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.121951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.121957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.121962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.121967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:33.121973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:33.121981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:33.121992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:33.122042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:33.132220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:33.133099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:33.133118Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:33.133122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:33.133126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:33.133134Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2255 [2:7555896276540368862:10327]
2025-09-30T14:56:33.133152Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:33.133174Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:33.133181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:33.133184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:33.133186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:33.133202Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:33.133216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:33.133222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:33.133287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.133290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.133292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.133296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:33.133313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:33.133385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:33.133388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.133400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.133412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.133429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:33.133447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896276540368856:10327]
2025-09-30T14:56:33.133449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896276540368856:10327]
2025-09-30T14:56:33.133707Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2255
2025-09-30T14:56:33.133755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2255
2025-09-30T14:56:33.133452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896276540368856:10327]
2025-09-30T14:56:33.133466Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:33.133479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:33.133495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:33.133499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:33.133533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896276540368856:10327]
2025-09-30T14:56:33.133538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:33.133555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:33.133558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:33.133561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:33.133568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:33.133660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896276630141656:2454], now have 1 active actors on pipe
2025-09-30T14:56:33.133682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896276630141749:3775], now have 1 active actors on pipe
2025-09-30T14:56:33.133807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:33.133813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:33.133848Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc87bb9d-1a8f3f74-e8f5de52-354fc9fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:33.133866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:33.133876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:33.133879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:33.133890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:33.133906Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:33.133928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:33.134123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:33.134131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:33.134145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:33.134326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2256 partition: 0 MaxSeqNo: 42 sessionId: src_id|fc87bb9d-1a8f3f74-e8f5de52-354fc9fc_0
2025-09-30T14:56:33.134708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf746c4-252b52d0-ac6fd666-362b3b6e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fc87bb9d-1a8f3f74-e8f5de52-354fc9fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:33.137667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc87bb9d-1a8f3f74-e8f5de52-354fc9fc_0] Write session: try to update token
2025-09-30T14:56:33.137688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc87bb9d-1a8f3f74-e8f5de52-354fc9fc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:33.153360Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:33.153382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:33.153393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896276540368856:10327]
2025-09-30T14:56:33.153446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:33.153458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:33.153688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:33.153872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:33.154033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:33.154195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:33.154421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:33.154462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:33.155457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2256 sessionId: src_id|fc87bb9d-1a8f3f74-e8f5de52-354fc9fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:33.158365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:33.159582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:33.159610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:33.159632Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:33.159635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:33.159638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:33.159640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:33.159649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896276540368856:10327]
2025-09-30T14:56:33.159654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896276540368856:10327]
2025-09-30T14:56:33.159659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896276540368856:10327]
2025-09-30T14:56:33.159704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:33.159716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.159719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:33.159724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:33.159734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:33.159738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:33.159858Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:33.188524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896276630141767:3180]
2025-09-30T14:56:33.188849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2255, pipe: [1:7555896276630141767:3180]
2025-09-30T14:56:33.281343Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:33.281705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:33.281744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896276630141767:3180], now have 1 active actors on pipe
2025-09-30T14:56:33.281874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:33.281941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896276630141767:3180]
2025-09-30T14:56:33.281964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:33.281989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:33.281992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:33.282069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2256 reason: error at write: Disconnected sessionId: src_id|fc87bb9d-1a8f3f74-e8f5de52-354fc9fc_0
2025-09-30T14:56:33.282213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2256 sessionId: src_id|fc87bb9d-1a8f3f74-e8f5de52-354fc9fc_0 is DEAD
2025-09-30T14:56:33.282363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc87bb9d-1a8f3f74-e8f5de52-354fc9fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:33.282375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc87bb9d-1a8f3f74-e8f5de52-354fc9fc_0] Write session will restart in 0.006678s
2025-09-30T14:56:33.282398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc87bb9d-1a8f3f74-e8f5de52-354fc9fc_0] Write session: Do CDS request
2025-09-30T14:56:33.282403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc87bb9d-1a8f3f74-e8f5de52-354fc9fc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:33.290807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc87bb9d-1a8f3f74-e8f5de52-354fc9fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:33.290890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:33.290914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2257
2025-09-30T14:56:33.291078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2257 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:33.291114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2257 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:33.291138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2257 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:33.291148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:33.291636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2257 sessionId:  describe result for acl check
2025-09-30T14:56:33.291674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:33.291676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:33.291678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:33.291685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896276630141801:3792] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:33.292265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896276630141801:3792] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:33.293823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:33.294366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896276630141801:3792] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:33.295719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:33.295929Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:33.295933Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:33.295942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:33.295994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:33.296026Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896276540368956:10329]
2025-09-30T14:56:33.296665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:33.296868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896276630141801:3792] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:33.296896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896276630141801:3792] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:33.296900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896276630141801:3792] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:33.296908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2257 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:33.297013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:33.297066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:33.297425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:33.297498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:33.297499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:33.297500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:33.297501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:33.297503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:33.297504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:33.297506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:33.297508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:33.297509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:33.297510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:33.297512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.297513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.297515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.297516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:33.297517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:33.297523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:33.297533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:33.297537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:33.297542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:33.297546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:33.297550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:33.297554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:33.297559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:33.297563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:33.297567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:33.297572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.297575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.297578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.297582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:33.297585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:33.297596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:33.297604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:33.297610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:33.297616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:33.297620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:33.297626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:33.297630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:33.297636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:33.297641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:33.297647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:33.297652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:33.297657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:33.297663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:33.297668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:33.297672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:33.297678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:33.297683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:33.297690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:33.297703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:33.297707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:33.297712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.297716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.297727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.297732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.297739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.297750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.297754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:33.297758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:33.297767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:33.297772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:33.297816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:33.304338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:33.305563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:33.305581Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:33.305585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:33.305590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:33.305597Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2256 [2:7555896276540368956:10329]
2025-09-30T14:56:33.305614Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:33.305630Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:33.305634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:33.305637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:33.305640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:33.305656Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:33.305664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:33.305672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:33.305735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.305742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.305744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.305747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:33.305750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:33.305822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:33.305831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.305846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.305864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.305887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:33.305905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896276540368950:10329]
2025-09-30T14:56:33.305912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896276540368950:10329]
2025-09-30T14:56:33.305916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896276540368950:10329]
2025-09-30T14:56:33.305924Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:33.305937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:33.305941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896276630141869:3792], now have 1 active actors on pipe
2025-09-30T14:56:33.305945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896276630141775:2454], now have 1 active actors on pipe
2025-09-30T14:56:33.305948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:33.305951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:33.305951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:33.305965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:33.305969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:33.306008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896276540368950:10329]
2025-09-30T14:56:33.306019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:33.306028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:33.306545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2256
2025-09-30T14:56:33.306600Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2256
2025-09-30T14:56:33.306799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:33.306810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:33.306837Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4fbcead2-37eeca1e-3d314ceb-9a237858_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:33.306844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:33.306850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:33.306853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:33.306862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:33.306874Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:33.306898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:33.307221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:33.307227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:33.307311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:33.307529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2257 partition: 0 MaxSeqNo: 42 sessionId: src_id|4fbcead2-37eeca1e-3d314ceb-9a237858_0
2025-09-30T14:56:33.307944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc87bb9d-1a8f3f74-e8f5de52-354fc9fc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4fbcead2-37eeca1e-3d314ceb-9a237858_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:33.310877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fbcead2-37eeca1e-3d314ceb-9a237858_0] Write session: try to update token
2025-09-30T14:56:33.310898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fbcead2-37eeca1e-3d314ceb-9a237858_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:33.319989Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:33.320007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:33.320010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:33.320013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:33.320023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896276540368950:10329]
2025-09-30T14:56:33.320032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896276540368950:10329]
2025-09-30T14:56:33.320037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896276540368950:10329]
2025-09-30T14:56:33.320078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:33.320084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.320086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:33.320106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:33.320121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:33.320125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:33.320304Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:33.332573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2257 sessionId: src_id|4fbcead2-37eeca1e-3d314ceb-9a237858_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:33.338307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:33.383368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896276630141901:3180]
2025-09-30T14:56:33.385451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2256, pipe: [1:7555896276630141901:3180]
2025-09-30T14:56:33.440211Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:33.440689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:33.440709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:33.440730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896276630141901:3180], now have 1 active actors on pipe
2025-09-30T14:56:33.441136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:33.441149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896276630141901:3180]
2025-09-30T14:56:33.441153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:33.441175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:33.441224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2257 reason: error at write: Disconnected sessionId: src_id|4fbcead2-37eeca1e-3d314ceb-9a237858_0
2025-09-30T14:56:33.441120Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:33.441422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2257 sessionId: src_id|4fbcead2-37eeca1e-3d314ceb-9a237858_0 is DEAD
2025-09-30T14:56:33.441822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fbcead2-37eeca1e-3d314ceb-9a237858_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:33.441833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fbcead2-37eeca1e-3d314ceb-9a237858_0] Write session will restart in 0.007384s
2025-09-30T14:56:33.441858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fbcead2-37eeca1e-3d314ceb-9a237858_0] Write session: Do CDS request
2025-09-30T14:56:33.441864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fbcead2-37eeca1e-3d314ceb-9a237858_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:33.451301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fbcead2-37eeca1e-3d314ceb-9a237858_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:33.451442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:33.451462Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2258
2025-09-30T14:56:33.454388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:33.455510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2258 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:33.455579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2258 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:33.455589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2258 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:33.455595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:33.456107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2258 sessionId:  describe result for acl check
2025-09-30T14:56:33.456149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:33.456156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:33.456159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:33.456166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896276630141961:3820] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:33.456496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:33.456695Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:33.456708Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:33.456718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:33.456789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:33.456832Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896276540369088:10343]
2025-09-30T14:56:33.456764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896276630141961:3820] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:33.457494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:33.457988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:33.458053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:33.458397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:33.458476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:33.458484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:33.458485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:33.458486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:33.458488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:33.458489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:33.458490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:33.458491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:33.458492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:33.458494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:33.458495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.458894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896276630141961:3820] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:33.458496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.458498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.458500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:33.458504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:33.458510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:33.458520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:33.458524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:33.458527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:33.458531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:33.458535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:33.458538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:33.458541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:33.458545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:33.458549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:33.458553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.458556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.458559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.458562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:33.458565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:33.458572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:33.458579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:33.458585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:33.458590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:33.458593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:33.458597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:33.458601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:33.458606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:33.458610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:33.458615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:33.458619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:33.458643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:33.458647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:33.458651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:33.458654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:33.458661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:33.458667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:33.458672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:33.458676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:33.458680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:33.458683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.458687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.458691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.458695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.458699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.458706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.458710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:33.458714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:33.458730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:33.458735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:33.458778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:33.464235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896276630141961:3820] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:33.464258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896276630141961:3820] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:33.464262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896276630141961:3820] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:33.464271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2258 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:33.464644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:33.465600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:33.465619Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:33.465622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:33.465626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:33.465634Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2257 [2:7555896276540369088:10343]
2025-09-30T14:56:33.465651Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:33.465667Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:33.465680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:33.465684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:33.465687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:33.465703Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:33.465711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:33.465722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:33.465797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.465804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.465806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.465810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:33.465813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:33.465998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:33.466009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.466024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.466037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.466075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:33.466106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2257
2025-09-30T14:56:33.466107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896276630141999:3820], now have 1 active actors on pipe
2025-09-30T14:56:33.466117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896276630141902:2454], now have 1 active actors on pipe
2025-09-30T14:56:33.466125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896276540369083:10343]
2025-09-30T14:56:33.466127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896276540369083:10343]
2025-09-30T14:56:33.466129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896276540369083:10343]
2025-09-30T14:56:33.466145Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:33.466161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:33.466162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:33.466166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:33.466168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:33.466177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:33.466181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:33.466221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896276540369083:10343]
2025-09-30T14:56:33.466235Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:33.466242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:33.466435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:33.466462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:33.466491Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0e154ae-1d615e3d-cc08c56d-c8f7d4bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:33.466505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:33.466517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:33.466519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:33.466530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:33.466546Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:33.466573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:33.466741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:33.466750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:33.466763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:33.466798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2257
2025-09-30T14:56:33.466857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2258 partition: 0 MaxSeqNo: 42 sessionId: src_id|a0e154ae-1d615e3d-cc08c56d-c8f7d4bb_0
2025-09-30T14:56:33.467231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fbcead2-37eeca1e-3d314ceb-9a237858_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a0e154ae-1d615e3d-cc08c56d-c8f7d4bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:33.470316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e154ae-1d615e3d-cc08c56d-c8f7d4bb_0] Write session: try to update token
2025-09-30T14:56:33.470344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e154ae-1d615e3d-cc08c56d-c8f7d4bb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:33.483785Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:33.483810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:33.483820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896276540369083:10343]
2025-09-30T14:56:33.483871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:33.483891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:33.484084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:33.484244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:33.484409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:33.484563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:33.484777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:33.484816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:33.487081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2258 sessionId: src_id|a0e154ae-1d615e3d-cc08c56d-c8f7d4bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:33.489997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:33.490221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:33.490243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:33.490283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:33.490905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:33.495493Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:33.495514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:33.495518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:33.495520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:33.495531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896276540369083:10343]
2025-09-30T14:56:33.495540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896276540369083:10343]
2025-09-30T14:56:33.495544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896276540369083:10343]
2025-09-30T14:56:33.495588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:33.495600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.495603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:33.495617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:33.495625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:33.495631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:33.495759Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:33.541338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896276630142007:3180]
2025-09-30T14:56:33.541664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2257, pipe: [1:7555896276630142007:3180]
2025-09-30T14:56:33.618379Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:33.627849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:33.627874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:33.628071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:33.628144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:33.628216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:33.628287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:33.628625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:33.628637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:33.628715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:33.628784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:33.628852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:33.628926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:33.628976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:33.628983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:33.629054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:33.629126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:33.629196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:33.629327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:33.629377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:33.629385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:33.629457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:33.629526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:33.629594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:33.629662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:33.629720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:33.629727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:33.629798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:33.629862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:33.629931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:33.630003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:33.630049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:33.630056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:33.630131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:33.630194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:33.630266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:33.630344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:33.630412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:33.630418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:33.630492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:33.630557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:33.630629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:33.630695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:33.630760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:33.630766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:33.630834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:33.630897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:33.630967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:33.631035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:33.631081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:33.631087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:33.631193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:33.631278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:33.631343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:33.631414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:33.631462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:33.631474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:33.631549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:33.631616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:33.631690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:33.631768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:33.631816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:33.631822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:33.631879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896276630142007:3180], now have 1 active actors on pipe
2025-09-30T14:56:33.632161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896276630142007:3180]
2025-09-30T14:56:33.632163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:33.632167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:33.632193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:33.632212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2258 reason: error at write: Disconnected sessionId: src_id|a0e154ae-1d615e3d-cc08c56d-c8f7d4bb_0
2025-09-30T14:56:33.632428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2258 sessionId: src_id|a0e154ae-1d615e3d-cc08c56d-c8f7d4bb_0 is DEAD
2025-09-30T14:56:33.632584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e154ae-1d615e3d-cc08c56d-c8f7d4bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:33.632597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e154ae-1d615e3d-cc08c56d-c8f7d4bb_0] Write session will restart in 0.007419s
2025-09-30T14:56:33.632623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e154ae-1d615e3d-cc08c56d-c8f7d4bb_0] Write session: Do CDS request
2025-09-30T14:56:33.632628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e154ae-1d615e3d-cc08c56d-c8f7d4bb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:33.632847Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:33.640878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e154ae-1d615e3d-cc08c56d-c8f7d4bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:33.640930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:33.640954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2259
2025-09-30T14:56:33.641119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2259 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:33.641156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2259 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:33.641166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2259 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:33.641171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:33.641693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2259 sessionId:  describe result for acl check
2025-09-30T14:56:33.641729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:33.641737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:33.641739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:33.641745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896276630142040:3827] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:33.642326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896276630142040:3827] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:33.644908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:33.645737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896276630142040:3827] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:33.647963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:33.648217Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:33.648227Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:33.648238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:33.648294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:33.648338Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896276540369187:10346]
2025-09-30T14:56:33.649022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:33.649349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:33.649399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:33.649773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:33.649848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:33.649857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:33.649858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:33.649859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:33.649860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:33.649862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:33.649863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:33.649865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:33.649866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:33.649868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:33.649869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.649870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.649871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.649872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:33.649873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:33.649879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:33.649888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:33.649892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:33.649896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:33.649900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:33.649904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:33.649908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:33.649912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:33.649916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:33.649920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:33.649924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.649929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.649932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.649937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:33.649940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:33.649949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:33.649958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:33.649963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:33.649969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:33.649975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:33.649979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:33.649984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:33.649989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:33.649994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:33.649999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:33.650003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:33.650008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:33.650016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:33.650021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:33.650026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:33.650030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:33.650034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:33.650039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:33.650044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:33.650049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:33.650054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.650059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.650064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.650069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.650074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.650078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.650083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:33.650089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:33.650095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:33.650100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:33.650141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:33.651538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896276630142040:3827] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:33.651560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896276630142040:3827] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:33.651564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896276630142040:3827] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:33.651574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2259 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:33.656042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:33.657210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:33.657228Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:33.657232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:33.657236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:33.657245Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2258 [2:7555896276540369187:10346]
2025-09-30T14:56:33.657266Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:33.657285Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:33.657289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:33.657294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:33.657308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:33.657329Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:33.657341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:33.657353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:33.657425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.657431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.657433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.657437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:33.657440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:33.657518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:33.657531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.657547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.657560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.657579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:33.657602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896276540369180:10346]
2025-09-30T14:56:33.657608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896276540369180:10346]
2025-09-30T14:56:33.657610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896276540369180:10346]
2025-09-30T14:56:33.657620Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:33.657629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:33.657636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:33.657645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:33.657647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:33.657651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:33.657654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:33.657663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896276630142009:2454], now have 1 active actors on pipe
2025-09-30T14:56:33.657703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896276630142107:3827], now have 1 active actors on pipe
2025-09-30T14:56:33.657710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896276540369180:10346]
2025-09-30T14:56:33.657720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:33.657748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:33.657773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2258
2025-09-30T14:56:33.657794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2258
2025-09-30T14:56:33.657937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:33.657947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:33.657971Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65cdbbb5-6905dfeb-3e78050e-e36dff08_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:33.657983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:33.657987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:33.657989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:33.658000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:33.658010Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:33.658030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:33.658179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:33.658184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:33.658195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:33.658288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2259 partition: 0 MaxSeqNo: 42 sessionId: src_id|65cdbbb5-6905dfeb-3e78050e-e36dff08_0
2025-09-30T14:56:33.658717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e154ae-1d615e3d-cc08c56d-c8f7d4bb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|65cdbbb5-6905dfeb-3e78050e-e36dff08_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:33.661929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65cdbbb5-6905dfeb-3e78050e-e36dff08_0] Write session: try to update token
2025-09-30T14:56:33.661957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65cdbbb5-6905dfeb-3e78050e-e36dff08_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:33.671680Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:33.671698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:33.671708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896276540369180:10346]
2025-09-30T14:56:33.671755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:33.671759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:33.671948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:33.672113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:33.672265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:33.672423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:33.672625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:33.672671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:33.680967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2259 sessionId: src_id|65cdbbb5-6905dfeb-3e78050e-e36dff08_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:33.683340Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:33.683358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:33.683360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:33.683362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:33.683369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896276540369180:10346]
2025-09-30T14:56:33.683372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896276540369180:10346]
2025-09-30T14:56:33.683376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896276540369180:10346]
2025-09-30T14:56:33.683407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:33.683412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:33.683413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.683417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:33.683417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:33.683421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:33.683550Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:33.683725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:33.732235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896276630142117:3180]
2025-09-30T14:56:33.732475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2258, pipe: [1:7555896276630142117:3180]
2025-09-30T14:56:33.799899Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:33.800364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:33.800379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:33.800402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896276630142117:3180], now have 1 active actors on pipe
2025-09-30T14:56:33.800675Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:33.800754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:33.800774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:33.800851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2259 reason: error at write: Disconnected sessionId: src_id|65cdbbb5-6905dfeb-3e78050e-e36dff08_0
2025-09-30T14:56:33.801039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2259 sessionId: src_id|65cdbbb5-6905dfeb-3e78050e-e36dff08_0 is DEAD
2025-09-30T14:56:33.801188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65cdbbb5-6905dfeb-3e78050e-e36dff08_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:33.801196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65cdbbb5-6905dfeb-3e78050e-e36dff08_0] Write session will restart in 0.009488s
2025-09-30T14:56:33.801220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65cdbbb5-6905dfeb-3e78050e-e36dff08_0] Write session: Do CDS request
2025-09-30T14:56:33.801226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65cdbbb5-6905dfeb-3e78050e-e36dff08_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:33.801243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896276630142117:3180]
2025-09-30T14:56:33.801264Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:33.811801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65cdbbb5-6905dfeb-3e78050e-e36dff08_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:33.812049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:33.812070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2260
2025-09-30T14:56:33.812213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2260 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:33.812258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2260 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:33.812271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2260 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:33.812276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:33.812710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2260 sessionId:  describe result for acl check
2025-09-30T14:56:33.812752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:33.812761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:33.812763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:33.812770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896276630142134:3836] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:33.813324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896276630142134:3836] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:33.815972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896276630142134:3836] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:33.820101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:33.820334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896276630142134:3836] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:33.820354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896276630142134:3836] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:33.820357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896276630142134:3836] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:33.820367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2260 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:33.822378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:33.822586Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:33.822590Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:33.822601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:33.822649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:33.822686Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896276540369286:10348]
2025-09-30T14:56:33.823417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:33.823776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:33.823817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:33.824162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:33.824215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:33.824217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:33.824218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:33.824222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:33.824223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:33.824224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:33.824226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:33.824227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:33.824228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:33.824230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:33.824231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.824232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.824233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.824235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:33.824236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:33.824242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:33.824253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:33.824258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:33.824263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:33.824268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:33.824273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:33.824277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:33.824282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:33.824287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:33.824292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:33.824296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.824301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.824306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.824310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:33.824315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:33.824323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:33.824331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:33.824338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:33.824344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:33.824351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:33.824357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:33.824363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:33.824369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:33.824375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:33.824383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:33.824388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:33.824394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:33.824399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:33.824405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:33.824409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:33.824415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:33.824421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:33.824427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:33.824432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:33.824438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:33.824443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.824449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.824454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.824460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.824466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.824472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.824477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:33.824483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:33.824488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:33.824494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:33.824547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:33.830215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:33.831072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:33.831088Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:33.831091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:33.831095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:33.831102Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2259 [2:7555896276540369286:10348]
2025-09-30T14:56:33.831122Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:33.831137Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:33.831142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:33.831145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:33.831148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:33.831163Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:33.831176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:33.831182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:33.831367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.831375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.831377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.831383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:33.831386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:33.831449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:33.831458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.831472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.831485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.831503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:33.831522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896276540369279:10348]
2025-09-30T14:56:33.831524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896276540369279:10348]
2025-09-30T14:56:33.831527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896276540369279:10348]
2025-09-30T14:56:33.831538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:33.831557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:33.831574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:33.831578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:33.831616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896276540369279:10348]
2025-09-30T14:56:33.831618Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:33.831737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:33.831739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:33.831741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:33.831747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:33.832082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896276630142118:2454], now have 1 active actors on pipe
2025-09-30T14:56:33.832087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896276630142213:3836], now have 1 active actors on pipe
2025-09-30T14:56:33.832259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:33.832264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:33.832290Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e96c9e0b-698c4b06-a0dc964b-223a28be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:33.832298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:33.832302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:33.832305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:33.832319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:33.832330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:33.832344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:33.832803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:33.832810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:33.832834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:33.833317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65cdbbb5-6905dfeb-3e78050e-e36dff08_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e96c9e0b-698c4b06-a0dc964b-223a28be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:33.832010Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2259
2025-09-30T14:56:33.832052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2259
2025-09-30T14:56:33.832954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2260 partition: 0 MaxSeqNo: 42 sessionId: src_id|e96c9e0b-698c4b06-a0dc964b-223a28be_0
2025-09-30T14:56:33.836179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e96c9e0b-698c4b06-a0dc964b-223a28be_0] Write session: try to update token
2025-09-30T14:56:33.836203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e96c9e0b-698c4b06-a0dc964b-223a28be_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:33.848424Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:33.848443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:33.848446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:33.848448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:33.848457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896276540369279:10348]
2025-09-30T14:56:33.848462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896276540369279:10348]
2025-09-30T14:56:33.848466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896276540369279:10348]
2025-09-30T14:56:33.848507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:33.848510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:33.848516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:33.848518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.848520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:33.848520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:33.848656Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:33.852743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2260 sessionId: src_id|e96c9e0b-698c4b06-a0dc964b-223a28be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:33.855443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:33.902725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896276630142226:3180]
2025-09-30T14:56:33.903092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2259, pipe: [1:7555896276630142226:3180]
2025-09-30T14:56:33.977386Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:33.977728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:33.977742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:33.977778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896276630142226:3180], now have 1 active actors on pipe
2025-09-30T14:56:33.978044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896276630142226:3180]
2025-09-30T14:56:33.978060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:33.978093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:33.978096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:33.978155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2260 reason: error at write: Disconnected sessionId: src_id|e96c9e0b-698c4b06-a0dc964b-223a28be_0
2025-09-30T14:56:33.978326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2260 sessionId: src_id|e96c9e0b-698c4b06-a0dc964b-223a28be_0 is DEAD
2025-09-30T14:56:33.978498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e96c9e0b-698c4b06-a0dc964b-223a28be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:33.978515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e96c9e0b-698c4b06-a0dc964b-223a28be_0] Write session will restart in 0.008936s
2025-09-30T14:56:33.978542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e96c9e0b-698c4b06-a0dc964b-223a28be_0] Write session: Do CDS request
2025-09-30T14:56:33.978549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e96c9e0b-698c4b06-a0dc964b-223a28be_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:33.978608Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:33.988790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e96c9e0b-698c4b06-a0dc964b-223a28be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:33.988886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:33.988909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2261
2025-09-30T14:56:33.989069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2261 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:33.989105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2261 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:33.989110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2261 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:33.989114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:33.989591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2261 sessionId:  describe result for acl check
2025-09-30T14:56:33.989635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:33.989638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:33.989640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:33.989648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896276630142291:3843] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:33.990206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896276630142291:3843] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:33.991187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:33.992300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896276630142291:3843] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:33.992617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:33.992809Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:33.992817Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:33.992827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:33.992872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:33.992909Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896276540369398:10352]
2025-09-30T14:56:33.993512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:33.993755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:33.993792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:33.994098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:33.994159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:33.994165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:33.994166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:33.994167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:33.994168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:33.994169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:33.994170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:33.994172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:33.994173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:33.994174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:33.994175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.994177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.994178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.994179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:33.994180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:33.994185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:33.994195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:33.994199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:33.994203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:33.994206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:33.994210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:33.994213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:33.994217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:33.994221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:33.994225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:33.994229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.994232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.994236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.994239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:33.994243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:33.994250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:33.994257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:33.994263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:33.994268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:33.994273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:33.994278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:33.994282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:33.994287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:33.994291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:33.994296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:33.994301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:33.994307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:33.994311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:33.994315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:33.994322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:33.994327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:33.994331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:33.994336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:33.994339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:33.994344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:33.994348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.994353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:33.994357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.994363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:33.994374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.994379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:33.994382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:33.994387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:33.994391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:33.994397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:33.994439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:33.994575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896276630142291:3843] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:33.994592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896276630142291:3843] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:33.994596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896276630142291:3843] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:33.994604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2261 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:34.000271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:34.001422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:34.001437Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:34.001441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:34.001446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:34.001453Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2260 [2:7555896276540369398:10352]
2025-09-30T14:56:34.001470Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:34.001491Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:34.001498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:34.001501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:34.001504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:34.001520Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:34.001529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:34.001535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:34.001584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.001589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.001590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.001593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:34.001595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:34.001647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:34.001652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.001663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.001670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.001679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:34.001698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896276540369393:10352]
2025-09-30T14:56:34.001705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896276540369393:10352]
2025-09-30T14:56:34.001707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896276540369393:10352]
2025-09-30T14:56:34.001725Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:34.001733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:34.001736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:34.001738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:34.001744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:34.001756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:34.001766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:34.001776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896276630142230:2454], now have 1 active actors on pipe
2025-09-30T14:56:34.001784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896276630142327:3843], now have 1 active actors on pipe
2025-09-30T14:56:34.001817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896276540369393:10352]
2025-09-30T14:56:34.001826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:34.001840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:34.001835Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2260
2025-09-30T14:56:34.001880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2260
2025-09-30T14:56:34.002069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:34.002086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:34.002114Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7b71a13-67fb7e48-342c9d7d-e919135b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:34.002126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:34.002129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:34.002131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:34.002146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:34.002157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:34.002172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:34.002320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:34.002328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:34.002343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:34.002427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2261 partition: 0 MaxSeqNo: 42 sessionId: src_id|a7b71a13-67fb7e48-342c9d7d-e919135b_0
2025-09-30T14:56:34.002841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e96c9e0b-698c4b06-a0dc964b-223a28be_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a7b71a13-67fb7e48-342c9d7d-e919135b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:34.005770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7b71a13-67fb7e48-342c9d7d-e919135b_0] Write session: try to update token
2025-09-30T14:56:34.005787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7b71a13-67fb7e48-342c9d7d-e919135b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:34.015644Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:34.015665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:34.015670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:34.015672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:34.015683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896276540369393:10352]
2025-09-30T14:56:34.015688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896276540369393:10352]
2025-09-30T14:56:34.015691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896276540369393:10352]
2025-09-30T14:56:34.015736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:34.015743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.015742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:34.015745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:34.015748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:34.015752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:34.015921Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:34.022332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2261 sessionId: src_id|a7b71a13-67fb7e48-342c9d7d-e919135b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:34.025272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:34.078411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896280925109643:3180]
2025-09-30T14:56:34.078711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2260, pipe: [1:7555896280925109643:3180]
2025-09-30T14:56:34.139373Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:34.140016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:34.140035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:34.140079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896280925109643:3180], now have 1 active actors on pipe
2025-09-30T14:56:34.140410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:34.140442Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:34.140439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:34.140445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896280925109643:3180]
2025-09-30T14:56:34.140468Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:34.140512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2261 reason: error at write: Disconnected sessionId: src_id|a7b71a13-67fb7e48-342c9d7d-e919135b_0
2025-09-30T14:56:34.140708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2261 sessionId: src_id|a7b71a13-67fb7e48-342c9d7d-e919135b_0 is DEAD
2025-09-30T14:56:34.140864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7b71a13-67fb7e48-342c9d7d-e919135b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:34.140873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7b71a13-67fb7e48-342c9d7d-e919135b_0] Write session will restart in 0.007645s
2025-09-30T14:56:34.140914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7b71a13-67fb7e48-342c9d7d-e919135b_0] Write session: Do CDS request
2025-09-30T14:56:34.140922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7b71a13-67fb7e48-342c9d7d-e919135b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:34.149803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7b71a13-67fb7e48-342c9d7d-e919135b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:34.149946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:34.149966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2262
2025-09-30T14:56:34.150101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2262 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:34.150138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2262 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:34.150150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2262 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:34.150157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:34.150849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2262 sessionId:  describe result for acl check
2025-09-30T14:56:34.150892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:34.150893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:34.150895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:34.150901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896280925109690:3855] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:34.151491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896280925109690:3855] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:34.153455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896280925109690:3855] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:34.153689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:34.155058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:34.155291Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:34.155301Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:34.155313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:34.155364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:34.155417Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896280835336794:10354]
2025-09-30T14:56:34.155910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896280925109690:3855] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:34.155935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896280925109690:3855] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:34.155938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896280925109690:3855] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:34.155946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2262 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:34.156069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:34.156351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:34.156401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:34.156753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:34.156818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:34.156826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:34.156827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:34.156828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:34.156830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:34.156831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:34.156833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:34.156834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:34.156836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:34.156837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:34.156838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.156839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.156841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.156842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:34.156844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:34.156850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:34.156861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:34.156865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:34.156869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:34.156874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:34.156878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:34.156882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:34.156886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:34.156890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:34.156895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:34.156899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.156903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.156907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.156911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:34.156915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:34.156922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:34.156931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:34.156937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:34.156944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:34.156948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:34.156954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:34.156964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:34.156970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:34.156980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:34.156990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:34.156995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:34.157000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:34.157005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:34.157011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:34.157020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:34.157025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:34.157030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:34.157040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:34.157045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:34.157054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:34.157061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.157066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.157075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.157080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.157090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.157095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.157103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:34.157109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:34.157114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:34.157123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:34.157169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:34.162776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:34.164374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:34.164393Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:34.164396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:34.164400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:34.164407Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2261 [2:7555896280835336794:10354]
2025-09-30T14:56:34.164424Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:34.164441Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:34.164450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:34.164453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:34.164455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:34.164474Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:34.164487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:34.164494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:34.164568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.164575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.164578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.164581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:34.164584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:34.164651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:34.164664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.164678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.164691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.164708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:34.164733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896280925109743:3855], now have 1 active actors on pipe
2025-09-30T14:56:34.164742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896280925109645:2454], now have 1 active actors on pipe
2025-09-30T14:56:34.164750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896280835336789:10354]
2025-09-30T14:56:34.164757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896280835336789:10354]
2025-09-30T14:56:34.164758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896280835336789:10354]
2025-09-30T14:56:34.164772Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:34.164790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:34.164792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:34.164795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:34.164798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:34.164808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:34.164811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:34.164774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2261
2025-09-30T14:56:34.164775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2261
2025-09-30T14:56:34.164890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:34.164900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:34.164913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896280835336789:10354]
2025-09-30T14:56:34.164928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:34.164944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:34.164976Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7306f018-b6ea6d40-6ecfe264-8f2ddcc2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:34.164989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:34.164998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:34.165000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:34.165009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:34.165018Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:34.165047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:34.165193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:34.165204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:34.165225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:34.165344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2262 partition: 0 MaxSeqNo: 42 sessionId: src_id|7306f018-b6ea6d40-6ecfe264-8f2ddcc2_0
2025-09-30T14:56:34.165740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7b71a13-67fb7e48-342c9d7d-e919135b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7306f018-b6ea6d40-6ecfe264-8f2ddcc2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:34.168599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7306f018-b6ea6d40-6ecfe264-8f2ddcc2_0] Write session: try to update token
2025-09-30T14:56:34.168634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7306f018-b6ea6d40-6ecfe264-8f2ddcc2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:34.178360Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:34.178379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:34.178383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:34.178385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:34.178395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896280835336789:10354]
2025-09-30T14:56:34.178400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896280835336789:10354]
2025-09-30T14:56:34.178404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896280835336789:10354]
2025-09-30T14:56:34.178449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:34.178456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.178459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:34.178595Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:34.182290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:34.182308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:34.182315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:34.187239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2262 sessionId: src_id|7306f018-b6ea6d40-6ecfe264-8f2ddcc2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:34.190153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:34.240693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896280925109759:3180]
2025-09-30T14:56:34.240960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2261, pipe: [1:7555896280925109759:3180]
2025-09-30T14:56:34.294192Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:34.294551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:34.294568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:34.294605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896280925109759:3180], now have 1 active actors on pipe
2025-09-30T14:56:34.294823Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:34.294960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896280925109759:3180]
2025-09-30T14:56:34.294965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:34.294999Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:34.295058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2262 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7306f018-b6ea6d40-6ecfe264-8f2ddcc2_0
2025-09-30T14:56:34.295237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2262 sessionId: src_id|7306f018-b6ea6d40-6ecfe264-8f2ddcc2_0 is DEAD
2025-09-30T14:56:34.295605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7306f018-b6ea6d40-6ecfe264-8f2ddcc2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:34.295616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7306f018-b6ea6d40-6ecfe264-8f2ddcc2_0] Write session will restart in 0.007112s
2025-09-30T14:56:34.295640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7306f018-b6ea6d40-6ecfe264-8f2ddcc2_0] Write session: Do CDS request
2025-09-30T14:56:34.295646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7306f018-b6ea6d40-6ecfe264-8f2ddcc2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:34.303743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7306f018-b6ea6d40-6ecfe264-8f2ddcc2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:34.303820Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:34.303843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2263
2025-09-30T14:56:34.303990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2263 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:34.304026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2263 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:34.304038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2263 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:34.304042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:34.304501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2263 sessionId:  describe result for acl check
2025-09-30T14:56:34.304550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:34.304552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:34.304554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:34.304559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896280925109823:3854] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:34.305155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896280925109823:3854] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:34.305602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:34.307061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896280925109823:3854] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:34.307700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:34.307925Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:34.307936Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:34.307948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:34.308003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:34.308040Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896280835336895:10356]
2025-09-30T14:56:34.308734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:34.309138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:34.309182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:34.309541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:34.309569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896280925109823:3854] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:34.309586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896280925109823:3854] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:34.309590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896280925109823:3854] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:34.309597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2263 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:34.309626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:34.309633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:34.309634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:34.309636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:34.309637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:34.309639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:34.309640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:34.309641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:34.309642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:34.309643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:34.309644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.309645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.309647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.309648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:34.309649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:34.309655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:34.309665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:34.309669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:34.309673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:34.309677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:34.309682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:34.309686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:34.309690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:34.309694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:34.309699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:34.309702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.309706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.309710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.309714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:34.309718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:34.309726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:34.309734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:34.309740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:34.309746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:34.309751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:34.309756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:34.309761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:34.309766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:34.309772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:34.309778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:34.309782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:34.309788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:34.309793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:34.309799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:34.309804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:34.309809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:34.309822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:34.309827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:34.309836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:34.309841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:34.309853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.309858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.309867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.309874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.309883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.309888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.309897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:34.309902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:34.309906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:34.309911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:34.309961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:34.315979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:34.317361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:34.317380Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:34.317383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:34.317388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:34.317395Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2262 [2:7555896280835336895:10356]
2025-09-30T14:56:34.317415Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:34.317433Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:34.317440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:34.317443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:34.317447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:34.317465Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:34.317478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:34.317485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:34.317553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.317560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.317561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.317564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:34.317565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:34.317641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:34.317649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.317664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.317677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.317696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:34.317721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896280925109863:3854], now have 1 active actors on pipe
2025-09-30T14:56:34.317739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896280835336889:10356]
2025-09-30T14:56:34.317741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896280835336889:10356]
2025-09-30T14:56:34.317743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896280835336889:10356]
2025-09-30T14:56:34.317751Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:34.317768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:34.317776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:34.317780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:34.317781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:34.317783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:34.317784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:34.317788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896280925109763:2454], now have 1 active actors on pipe
2025-09-30T14:56:34.317825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896280835336889:10356]
2025-09-30T14:56:34.317828Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:34.317848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:34.317813Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2262
2025-09-30T14:56:34.317813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2262
2025-09-30T14:56:34.317865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:34.317877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:34.317911Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0b5bf16-38d5bcbf-4a6af3ab-746db37f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:34.317922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:34.317925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:34.317927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:34.317935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:34.317943Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:34.317962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:34.318144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:34.318151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:34.318164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:34.318250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2263 partition: 0 MaxSeqNo: 42 sessionId: src_id|e0b5bf16-38d5bcbf-4a6af3ab-746db37f_0
2025-09-30T14:56:34.318624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7306f018-b6ea6d40-6ecfe264-8f2ddcc2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e0b5bf16-38d5bcbf-4a6af3ab-746db37f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:34.321433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0b5bf16-38d5bcbf-4a6af3ab-746db37f_0] Write session: try to update token
2025-09-30T14:56:34.321451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0b5bf16-38d5bcbf-4a6af3ab-746db37f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:34.336444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:34.336463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:34.336477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896280835336889:10356]
2025-09-30T14:56:34.336527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:34.336531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:34.336754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:34.336884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2263 sessionId: src_id|e0b5bf16-38d5bcbf-4a6af3ab-746db37f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:34.336941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:34.337086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:34.337233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:34.337461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:34.337504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:34.340057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:34.340270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:34.340290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:34.340335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:34.340397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:34.341698Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:34.341714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:34.341717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:34.341719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:34.341729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896280835336889:10356]
2025-09-30T14:56:34.341739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896280835336889:10356]
2025-09-30T14:56:34.341742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896280835336889:10356]
2025-09-30T14:56:34.341778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:34.341791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.341794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:34.341796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:34.341803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:34.341808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:34.341935Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:34.395337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896280925109886:3180]
2025-09-30T14:56:34.395630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2262, pipe: [1:7555896280925109886:3180]
2025-09-30T14:56:34.459741Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:34.467044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:34.467076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:34.467275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:34.467342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:34.467411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:34.467476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:34.467717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:34.467733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:34.467805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:34.467868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:34.467937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:34.468007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:34.468054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:34.468062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:34.468143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:34.468208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:34.468305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:34.468376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:34.468419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:34.468425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:34.468492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:34.468556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:34.468628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:34.468727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:34.468775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:34.468781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:34.468847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:34.468910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:34.468970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:34.469030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:34.469085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:34.469093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:34.469168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:34.469229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:34.469292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:34.469371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:34.469412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:34.469414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:34.469479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:34.469534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:34.469595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:34.469661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:34.469790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:34.469792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:34.469857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:34.469919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:34.469980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:34.470037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:34.470076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:34.470078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:34.470154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:34.470211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:34.470273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:34.470360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:34.470404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:34.470407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:34.470473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:34.470532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:34.470593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:34.470658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:34.470799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:34.470813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:34.470885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896280925109886:3180], now have 1 active actors on pipe
2025-09-30T14:56:34.471114Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:34.471132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896280925109886:3180]
2025-09-30T14:56:34.471160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:34.471164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:34.471194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2263 reason: error at write: Disconnected sessionId: src_id|e0b5bf16-38d5bcbf-4a6af3ab-746db37f_0
2025-09-30T14:56:34.471421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2263 sessionId: src_id|e0b5bf16-38d5bcbf-4a6af3ab-746db37f_0 is DEAD
2025-09-30T14:56:34.471551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0b5bf16-38d5bcbf-4a6af3ab-746db37f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:34.471562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0b5bf16-38d5bcbf-4a6af3ab-746db37f_0] Write session will restart in 0.008156s
2025-09-30T14:56:34.471586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0b5bf16-38d5bcbf-4a6af3ab-746db37f_0] Write session: Do CDS request
2025-09-30T14:56:34.471591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0b5bf16-38d5bcbf-4a6af3ab-746db37f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:34.471823Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:34.480809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0b5bf16-38d5bcbf-4a6af3ab-746db37f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:34.480889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:34.480909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2264
2025-09-30T14:56:34.481030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2264 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:34.481062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2264 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:34.481074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2264 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:34.481078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:34.481577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2264 sessionId:  describe result for acl check
2025-09-30T14:56:34.481616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:34.481622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:34.481624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:34.481630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896280925109960:3880] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:34.482162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896280925109960:3880] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:34.482933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:34.484438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896280925109960:3880] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:34.484975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:34.485196Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:34.485209Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:34.485220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:34.485309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:34.485351Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896280835337035:10371]
2025-09-30T14:56:34.486008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:34.486351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:34.486412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:34.486752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:34.486820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:34.486826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:34.486827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:34.486828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:34.486830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:34.486831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:34.486832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:34.486834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:34.486835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:34.486836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:34.486838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.486840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.486841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.486842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:34.486844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:34.486849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:34.486860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:34.486864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:34.486868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:34.486872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:34.486877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:34.486881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:34.486886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:34.486890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:34.486894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:34.486898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.486903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.486907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.486911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:34.486915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:34.486924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:34.486932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:34.486937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:34.486943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:34.486948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:34.486953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:34.486958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:34.486966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:34.486976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:34.486982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:34.486990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:34.486994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:34.486999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:34.487009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:34.487013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:34.487022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:34.487027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:34.487032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:34.487036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:34.487040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:34.487050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.487055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.487060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.487065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.487070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.487075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.487079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:34.487085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:34.487094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:34.487100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:34.487148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:34.487159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896280925109960:3880] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:34.487177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896280925109960:3880] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:34.487180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896280925109960:3880] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:34.487188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2264 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:34.492994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:34.493924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:34.493943Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:34.493946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:34.493950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:34.493957Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2263 [2:7555896280835337035:10371]
2025-09-30T14:56:34.493976Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:34.493994Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:34.494000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:34.494003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:34.494006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:34.494021Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:34.494027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:34.494034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:34.494095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.494104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.494106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.494110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:34.494113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:34.494191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:34.494199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.494212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.494224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.494239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:34.494262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896280925109997:3880], now have 1 active actors on pipe
2025-09-30T14:56:34.494271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896280925109899:2454], now have 1 active actors on pipe
2025-09-30T14:56:34.494278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896280835337029:10371]
2025-09-30T14:56:34.494280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896280835337029:10371]
2025-09-30T14:56:34.494283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896280835337029:10371]
2025-09-30T14:56:34.494298Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:34.494318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:34.494326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:34.494331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:34.494333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:34.494335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:34.494338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:34.494340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2263
2025-09-30T14:56:34.494375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896280835337029:10371]
2025-09-30T14:56:34.494349Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2263
2025-09-30T14:56:34.494383Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:34.494386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:34.494414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:34.494424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:34.494459Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|438569ad-4d52d8e1-a3314385-36212086_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:34.494471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:34.494475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:34.494477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:34.494487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:34.494501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:34.494525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:34.494677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:34.494685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:34.494699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:34.494829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2264 partition: 0 MaxSeqNo: 42 sessionId: src_id|438569ad-4d52d8e1-a3314385-36212086_0
2025-09-30T14:56:34.495233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0b5bf16-38d5bcbf-4a6af3ab-746db37f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|438569ad-4d52d8e1-a3314385-36212086_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:34.498104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|438569ad-4d52d8e1-a3314385-36212086_0] Write session: try to update token
2025-09-30T14:56:34.498127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|438569ad-4d52d8e1-a3314385-36212086_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:34.507017Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:34.507032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:34.507035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:34.507037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:34.507048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896280835337029:10371]
2025-09-30T14:56:34.507053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896280835337029:10371]
2025-09-30T14:56:34.507057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896280835337029:10371]
2025-09-30T14:56:34.507101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:34.507109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.507112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:34.507113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:34.507119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:34.507123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:34.507277Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:34.514102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2264 sessionId: src_id|438569ad-4d52d8e1-a3314385-36212086_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:34.517184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:34.571442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896280925110007:3180]
2025-09-30T14:56:34.571779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2263, pipe: [1:7555896280925110007:3180]
2025-09-30T14:56:34.625922Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:34.626401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:34.626419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:34.626458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896280925110007:3180], now have 1 active actors on pipe
2025-09-30T14:56:34.626683Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:34.626775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:34.626775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896280925110007:3180]
2025-09-30T14:56:34.626797Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:34.626864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2264 reason: status is not ok: tablet will be restarted right now sessionId: src_id|438569ad-4d52d8e1-a3314385-36212086_0
2025-09-30T14:56:34.627053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2264 sessionId: src_id|438569ad-4d52d8e1-a3314385-36212086_0 is DEAD
2025-09-30T14:56:34.627201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|438569ad-4d52d8e1-a3314385-36212086_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:34.627214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|438569ad-4d52d8e1-a3314385-36212086_0] Write session will restart in 0.006640s
2025-09-30T14:56:34.627237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|438569ad-4d52d8e1-a3314385-36212086_0] Write session: Do CDS request
2025-09-30T14:56:34.627253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|438569ad-4d52d8e1-a3314385-36212086_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:34.634816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|438569ad-4d52d8e1-a3314385-36212086_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:34.634886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:34.634908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2265
2025-09-30T14:56:34.635063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2265 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:34.635096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2265 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:34.635120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2265 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:34.635125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:34.635596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2265 sessionId:  describe result for acl check
2025-09-30T14:56:34.635650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:34.635660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:34.635663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:34.635669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896280925110024:3883] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:34.636251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896280925110024:3883] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:34.638251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896280925110024:3883] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:34.638611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:34.640643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:34.640841Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:34.640850Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:34.640858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:34.640901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:34.640961Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896280835337138:10373]
2025-09-30T14:56:34.641006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896280925110024:3883] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:34.641025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896280925110024:3883] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:34.641029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896280925110024:3883] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:34.641037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2265 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:34.641639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:34.641946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:34.642001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:34.642360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:34.642423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:34.642424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:34.642425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:34.642426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:34.642428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:34.642429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:34.642430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:34.642431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:34.642433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:34.642434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:34.642435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.642436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.642438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.642439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:34.642440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:34.642446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:34.642455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:34.642459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:34.642464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:34.642468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:34.642472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:34.642476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:34.642480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:34.642485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:34.642490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:34.642494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.642498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.642502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.642506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:34.642510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:34.642517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:34.642525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:34.642531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:34.642537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:34.642545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:34.642550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:34.642555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:34.642560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:34.642565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:34.642572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:34.642578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:34.642583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:34.642587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:34.642592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:34.642596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:34.642601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:34.642605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:34.642610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:34.642613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:34.642617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:34.642622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.642626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.642629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.642635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.642640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.642645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.642649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:34.642654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:34.642659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:34.642664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:34.642709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:34.648475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:34.649393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:34.649407Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:34.649411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:34.649415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:34.649422Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2264 [2:7555896280835337138:10373]
2025-09-30T14:56:34.649443Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:34.649459Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:34.649468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:34.649471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:34.649474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:34.649489Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:34.649500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:34.649507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:34.649572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.649579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.649581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.649585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:34.649587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:34.649654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:34.649663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.649690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.649701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.649720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:34.649744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896280925110009:2454], now have 1 active actors on pipe
2025-09-30T14:56:34.649752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896280925110109:3883], now have 1 active actors on pipe
2025-09-30T14:56:34.649759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896280835337132:10373]
2025-09-30T14:56:34.649763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896280835337132:10373]
2025-09-30T14:56:34.649765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896280835337132:10373]
2025-09-30T14:56:34.649776Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:34.649795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:34.649797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:34.649806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:34.649809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:34.649810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:34.649813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:34.649848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896280835337132:10373]
2025-09-30T14:56:34.649858Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:34.649833Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2264
2025-09-30T14:56:34.649860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:34.649834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2264
2025-09-30T14:56:34.649878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:34.649883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:34.649928Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ea5c883-80ee2c12-cbb2bd94-372e56d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:34.649939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:34.649942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:34.649944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:34.649954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:34.649968Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:34.649989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:34.650153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:34.650161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:34.650176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:34.650251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2265 partition: 0 MaxSeqNo: 42 sessionId: src_id|5ea5c883-80ee2c12-cbb2bd94-372e56d4_0
2025-09-30T14:56:34.650629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|438569ad-4d52d8e1-a3314385-36212086_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5ea5c883-80ee2c12-cbb2bd94-372e56d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:34.653431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ea5c883-80ee2c12-cbb2bd94-372e56d4_0] Write session: try to update token
2025-09-30T14:56:34.653448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ea5c883-80ee2c12-cbb2bd94-372e56d4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:34.662562Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:34.662580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:34.662583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:34.662585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:34.662595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896280835337132:10373]
2025-09-30T14:56:34.662600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896280835337132:10373]
2025-09-30T14:56:34.662605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896280835337132:10373]
2025-09-30T14:56:34.662647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:34.662656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.662655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:34.662663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:34.662665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:34.662669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:34.662796Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:34.668594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2265 sessionId: src_id|5ea5c883-80ee2c12-cbb2bd94-372e56d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:34.671386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:34.727400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896280925110123:3180]
2025-09-30T14:56:34.727708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2264, pipe: [1:7555896280925110123:3180]
2025-09-30T14:56:34.777289Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:34.777613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:34.777626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:34.777661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896280925110123:3180], now have 1 active actors on pipe
2025-09-30T14:56:34.777945Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:34.779641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ea5c883-80ee2c12-cbb2bd94-372e56d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:34.779653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ea5c883-80ee2c12-cbb2bd94-372e56d4_0] Write session will restart in 0.009189s
2025-09-30T14:56:34.779677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ea5c883-80ee2c12-cbb2bd94-372e56d4_0] Write session: Do CDS request
2025-09-30T14:56:34.779683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ea5c883-80ee2c12-cbb2bd94-372e56d4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:34.778361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896280925110123:3180]
2025-09-30T14:56:34.778403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:34.778476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2265 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5ea5c883-80ee2c12-cbb2bd94-372e56d4_0
2025-09-30T14:56:34.778688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2265 sessionId: src_id|5ea5c883-80ee2c12-cbb2bd94-372e56d4_0 is DEAD
2025-09-30T14:56:34.778899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:34.795737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ea5c883-80ee2c12-cbb2bd94-372e56d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:34.796273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:34.797398Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:34.797420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2266
2025-09-30T14:56:34.798130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:34.798326Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:34.798338Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:34.798360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:34.798415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:34.798461Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896280835337242:10375]
2025-09-30T14:56:34.799162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:34.799538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:34.799601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:34.799996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:34.800075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:34.800082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:34.800083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:34.800085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:34.800086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:34.800087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:34.800088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:34.800090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:34.800091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:34.800093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:34.800094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.800096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.800097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.800098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:34.800099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:34.800105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:34.800116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:34.800120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:34.800124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:34.800128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:34.800132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:34.800136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:34.800140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:34.800143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:34.800147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:34.800151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.800155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.800159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.800164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:34.800168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:34.800178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:34.800187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:34.800198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:34.800204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:34.800209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:34.800214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:34.800225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:34.800230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:34.800240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:34.800245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:34.800250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:34.800256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:34.800261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:34.800275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:34.800279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:34.800284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:34.800293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:34.800297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:34.800304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:34.800310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:34.800315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.800320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.800324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.800329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.800334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.800339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.800344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:34.800348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:34.800353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:34.800358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:34.800129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2266 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:34.800186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2266 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:34.800192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2266 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:34.800197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:34.800404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:34.801276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2266 sessionId:  describe result for acl check
2025-09-30T14:56:34.801331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:34.801340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:34.801342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:34.801349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896280925110194:3892] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:34.801981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896280925110194:3892] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:34.805238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896280925110194:3892] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:34.806660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:34.807674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:34.807692Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:34.807695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:34.807698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:34.807705Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2265 [2:7555896280835337242:10375]
2025-09-30T14:56:34.807722Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:34.807737Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:34.807740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:34.807743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:34.807746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:34.807763Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:34.807774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:34.807781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:34.807854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.807856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.807858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.807862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:34.807864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:34.807952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:34.807960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.807974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.807988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.808006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:34.808030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896280925110126:2454], now have 1 active actors on pipe
2025-09-30T14:56:34.808042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896280835337237:10375]
2025-09-30T14:56:34.808044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896280835337237:10375]
2025-09-30T14:56:34.808046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896280835337237:10375]
2025-09-30T14:56:34.808061Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:34.808079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:34.808100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:34.808108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:34.808113Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2265
2025-09-30T14:56:34.808144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896280835337237:10375]
2025-09-30T14:56:34.808152Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:34.808260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:34.808270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:34.808272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:34.808279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:34.809136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896280925110194:3892] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:34.809153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896280925110194:3892] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:34.809157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896280925110194:3892] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:34.809166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2266 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:34.809392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896280925110230:3892], now have 1 active actors on pipe
2025-09-30T14:56:34.809949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:34.809962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:34.809988Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|531db5ca-8aa5b9b6-b06a0129-ba6cfd97_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:34.809998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:34.810002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:34.810005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:34.810017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:34.810036Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:34.810057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:34.809485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2265
2025-09-30T14:56:34.810675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:34.810683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:34.810697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:34.810801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2266 partition: 0 MaxSeqNo: 42 sessionId: src_id|531db5ca-8aa5b9b6-b06a0129-ba6cfd97_0
2025-09-30T14:56:34.811262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ea5c883-80ee2c12-cbb2bd94-372e56d4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|531db5ca-8aa5b9b6-b06a0129-ba6cfd97_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:34.814260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|531db5ca-8aa5b9b6-b06a0129-ba6cfd97_0] Write session: try to update token
2025-09-30T14:56:34.814281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|531db5ca-8aa5b9b6-b06a0129-ba6cfd97_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:34.822402Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:34.822425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:34.822428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:34.822430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:34.822441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896280835337237:10375]
2025-09-30T14:56:34.822447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896280835337237:10375]
2025-09-30T14:56:34.822451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896280835337237:10375]
2025-09-30T14:56:34.822489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:34.822496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.822498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:34.822623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:34.822633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:34.822635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:34.822812Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:34.834187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2266 sessionId: src_id|531db5ca-8aa5b9b6-b06a0129-ba6cfd97_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:34.837019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:34.878694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896280925110236:3180]
2025-09-30T14:56:34.879030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2265, pipe: [1:7555896280925110236:3180]
2025-09-30T14:56:34.937888Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:34.938266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:34.938287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:34.938308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896280925110236:3180], now have 1 active actors on pipe
2025-09-30T14:56:34.938633Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:34.938632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:34.938652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:34.938660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896280925110236:3180]
2025-09-30T14:56:34.938683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:34.938718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2266 reason: error at write: Disconnected sessionId: src_id|531db5ca-8aa5b9b6-b06a0129-ba6cfd97_0
2025-09-30T14:56:34.938922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2266 sessionId: src_id|531db5ca-8aa5b9b6-b06a0129-ba6cfd97_0 is DEAD
2025-09-30T14:56:34.939118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|531db5ca-8aa5b9b6-b06a0129-ba6cfd97_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:34.939130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|531db5ca-8aa5b9b6-b06a0129-ba6cfd97_0] Write session will restart in 0.006114s
2025-09-30T14:56:34.939154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|531db5ca-8aa5b9b6-b06a0129-ba6cfd97_0] Write session: Do CDS request
2025-09-30T14:56:34.939163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|531db5ca-8aa5b9b6-b06a0129-ba6cfd97_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:34.946871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|531db5ca-8aa5b9b6-b06a0129-ba6cfd97_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:34.946965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:34.946998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2267
2025-09-30T14:56:34.947230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2267 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:34.947300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2267 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:34.947311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2267 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:34.947317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:34.947796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2267 sessionId:  describe result for acl check
2025-09-30T14:56:34.947850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:34.947858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:34.947860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:34.947865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896280925110263:3893] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:34.948430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896280925110263:3893] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:34.954432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:34.956002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896280925110263:3893] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:34.957547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:34.957855Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:34.957860Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:34.957872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:34.957938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:34.957977Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896280835337361:10379]
2025-09-30T14:56:34.958688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:34.959041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:34.959090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:34.959433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:34.959511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:34.959513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:34.959514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:34.959515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:34.959517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:34.959519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:34.959520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:34.959522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:34.959524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:34.959525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:34.959527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.959528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.959529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.959531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:34.959532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:34.959538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:34.959550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:34.959554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:34.959558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:34.959563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:34.959567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:34.959572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:34.959576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:34.959581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:34.959586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:34.959590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.959594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.959597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.959601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:34.959606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:34.959614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:34.959622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:34.959629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:34.959634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:34.959640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:34.959645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:34.959652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:34.959658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:34.959663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:34.959670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:34.959674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:34.959680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:34.959686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:34.959692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:34.959696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:34.959701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:34.959706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:34.959711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:34.959715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:34.959719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:34.959725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.959730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.959734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.959738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.959742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.959750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.959755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:34.959761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:34.959769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:34.959774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:34.959821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:34.960434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896280925110263:3893] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:34.960456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896280925110263:3893] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:34.960459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896280925110263:3893] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:34.960468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2267 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:34.965654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:34.966664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:34.966691Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:34.966695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:34.966699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:34.966708Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2266 [2:7555896280835337361:10379]
2025-09-30T14:56:34.966731Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:34.966753Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:34.966756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:34.966761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:34.966764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:34.966785Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:34.966803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:34.966812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:34.966894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.966906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.966908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.966913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:34.966917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:34.967010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:34.967027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.967044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:34.967057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:34.967076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:34.967104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896280925110237:2454], now have 1 active actors on pipe
2025-09-30T14:56:34.967117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896280925110343:3893], now have 1 active actors on pipe
2025-09-30T14:56:34.967126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896280835337356:10379]
2025-09-30T14:56:34.967135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896280835337356:10379]
2025-09-30T14:56:34.967138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896280835337356:10379]
2025-09-30T14:56:34.967161Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:34.967190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:34.967194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:34.967200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:34.967171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2266
2025-09-30T14:56:34.967203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:34.967173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2266
2025-09-30T14:56:34.967216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:34.967226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:34.967312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:34.967327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:34.967349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896280835337356:10379]
2025-09-30T14:56:34.967367Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:34.967380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:34.967407Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20999f51-61ced8da-31cbd73b-c1a289a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:34.967420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:34.967430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:34.967432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:34.967445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:34.967459Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:34.967498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:34.967732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:34.967742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:34.967759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:34.967861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2267 partition: 0 MaxSeqNo: 42 sessionId: src_id|20999f51-61ced8da-31cbd73b-c1a289a3_0
2025-09-30T14:56:34.968266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|531db5ca-8aa5b9b6-b06a0129-ba6cfd97_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|20999f51-61ced8da-31cbd73b-c1a289a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:34.971095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20999f51-61ced8da-31cbd73b-c1a289a3_0] Write session: try to update token
2025-09-30T14:56:34.971114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20999f51-61ced8da-31cbd73b-c1a289a3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:34.980710Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:34.980732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:34.980734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:34.980736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:34.980747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896280835337356:10379]
2025-09-30T14:56:34.980757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896280835337356:10379]
2025-09-30T14:56:34.980762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896280835337356:10379]
2025-09-30T14:56:34.980806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:34.980814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:34.980817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:34.980844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:34.980852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:34.980856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:34.980971Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:34.991849Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2267 sessionId: src_id|20999f51-61ced8da-31cbd73b-c1a289a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:34.994838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:35.038916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896285220077647:3180]
2025-09-30T14:56:35.039209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2266, pipe: [1:7555896285220077647:3180]
2025-09-30T14:56:35.097491Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:35.097945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:35.097962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:35.097984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896285220077647:3180], now have 1 active actors on pipe
2025-09-30T14:56:35.098220Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:35.098296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:35.098366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:35.098466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2267 reason: status is not ok: tablet will be restarted right now sessionId: src_id|20999f51-61ced8da-31cbd73b-c1a289a3_0
2025-09-30T14:56:35.098522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896285220077647:3180]
2025-09-30T14:56:35.098652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2267 sessionId: src_id|20999f51-61ced8da-31cbd73b-c1a289a3_0 is DEAD
2025-09-30T14:56:35.098874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20999f51-61ced8da-31cbd73b-c1a289a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:35.098992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20999f51-61ced8da-31cbd73b-c1a289a3_0] Write session will restart in 0.007170s
2025-09-30T14:56:35.099021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20999f51-61ced8da-31cbd73b-c1a289a3_0] Write session: Do CDS request
2025-09-30T14:56:35.099028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20999f51-61ced8da-31cbd73b-c1a289a3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:35.107809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20999f51-61ced8da-31cbd73b-c1a289a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:35.107975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:35.107995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2268
2025-09-30T14:56:35.108155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2268 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:35.108203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2268 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:35.108213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2268 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:35.108218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:35.108680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2268 sessionId:  describe result for acl check
2025-09-30T14:56:35.108726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:35.108733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:35.108735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:35.108741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896285220077725:3911] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:35.109307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896285220077725:3911] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:35.109726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:35.111604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896285220077725:3911] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:35.111768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:35.111956Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:35.111969Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:35.111990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:35.112039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:35.112080Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896285130304764:10381]
2025-09-30T14:56:35.112727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:35.113111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:35.113181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:35.113580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:35.113648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:35.113657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:35.113658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:35.113659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:35.113660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:35.113661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:35.113663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:35.113664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:35.113665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:35.113666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:35.113667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.113668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.113670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.113671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:35.113672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:35.113678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:35.113698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:35.113702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:35.113707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:35.113712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:35.113737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:35.113741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:35.113745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:35.113749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:35.113754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:35.113757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.113761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.113766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.113770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:35.113774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:35.113781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:35.113789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:35.113802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:35.113808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:35.113818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:35.113823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:35.113829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:35.113838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:35.113846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:35.113850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:35.113855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:35.113859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:35.113865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:35.113870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:35.113874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:35.113884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:35.113888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:35.113893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:35.113898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:35.113907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:35.113911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.113921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.113926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.113931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.113942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.113947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.113955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:35.113960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:35.113966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:35.113975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:35.114020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:35.114493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896285220077725:3911] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:35.114512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896285220077725:3911] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:35.114519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896285220077725:3911] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:35.114528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2268 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:35.121133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:35.122229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:35.122248Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:35.122252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:35.122257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:35.122264Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2267 [2:7555896285130304764:10381]
2025-09-30T14:56:35.122284Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:35.122315Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:35.122319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:35.122323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:35.122325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:35.122345Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:35.122359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:35.122373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:35.122449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.122457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.122460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.122464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:35.122467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:35.122545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:35.122553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.122569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.122586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.122612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:35.122637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896285220077766:3911], now have 1 active actors on pipe
2025-09-30T14:56:35.122646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896285220077660:2454], now have 1 active actors on pipe
2025-09-30T14:56:35.122653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896285130304757:10381]
2025-09-30T14:56:35.122655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896285130304757:10381]
2025-09-30T14:56:35.122657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896285130304757:10381]
2025-09-30T14:56:35.122670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:35.122687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:35.122691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:35.122692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:35.122704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:35.122706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:35.122710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:35.122756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896285130304757:10381]
2025-09-30T14:56:35.122763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:35.122771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:35.123035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2267
2025-09-30T14:56:35.123094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2267
2025-09-30T14:56:35.123101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:35.123114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:35.123140Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae9d81a9-f60804e7-36890dab-5c52f39d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:35.123158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:35.123171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:35.123174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:35.123186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:35.123198Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:35.123220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:35.123461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:35.123473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:35.123493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:35.123627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2268 partition: 0 MaxSeqNo: 42 sessionId: src_id|ae9d81a9-f60804e7-36890dab-5c52f39d_0
2025-09-30T14:56:35.124556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20999f51-61ced8da-31cbd73b-c1a289a3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ae9d81a9-f60804e7-36890dab-5c52f39d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:35.127615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae9d81a9-f60804e7-36890dab-5c52f39d_0] Write session: try to update token
2025-09-30T14:56:35.127636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae9d81a9-f60804e7-36890dab-5c52f39d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:35.136613Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:35.136636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:35.136648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896285130304757:10381]
2025-09-30T14:56:35.136687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:35.136696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:35.136872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:35.137062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:35.137225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:35.137393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:35.137591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:35.137630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:35.146467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2268 sessionId: src_id|ae9d81a9-f60804e7-36890dab-5c52f39d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:35.149308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:35.151592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:35.151615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:35.153155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:35.152903Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:35.152923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:35.152926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:35.152928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:35.152938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896285130304757:10381]
2025-09-30T14:56:35.152942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896285130304757:10381]
2025-09-30T14:56:35.152947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896285130304757:10381]
2025-09-30T14:56:35.152988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:35.153007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:35.153014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.153017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:35.153045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:35.153052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:35.153056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:35.153172Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:35.199327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896285220077779:3180]
2025-09-30T14:56:35.199701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2267, pipe: [1:7555896285220077779:3180]
2025-09-30T14:56:35.289092Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:35.298029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:35.298062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:35.298256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:35.298339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:35.298413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:35.298487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:35.298548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:35.298561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:35.298648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:35.298724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:35.298804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:35.298887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:35.298939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:35.298946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:35.299028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:35.299121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:35.299200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:35.299318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:35.299369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:35.299379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:35.299459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:35.299536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:35.299616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:35.299693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:35.299742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:35.299750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:35.299830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:35.299904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:35.299984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:35.300058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:35.300131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:35.300139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:35.300221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:35.300291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:35.300365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:35.300641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:35.300694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:35.300697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:35.300962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:35.301035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:35.301109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:35.301180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:35.301244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:35.301255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:35.301343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:35.301411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:35.301482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:35.301705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:35.301764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:35.301773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:35.301990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:35.302058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:35.302132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:35.302203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:35.302351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:35.302360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:35.302431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:35.302498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:35.302569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:35.302820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:35.302870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:35.302878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:35.302953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896285220077779:3180], now have 1 active actors on pipe
2025-09-30T14:56:35.303267Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:35.303304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:35.303308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:35.303345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2268 reason: error at write: Disconnected sessionId: src_id|ae9d81a9-f60804e7-36890dab-5c52f39d_0
2025-09-30T14:56:35.303366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896285220077779:3180]
2025-09-30T14:56:35.303523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2268 sessionId: src_id|ae9d81a9-f60804e7-36890dab-5c52f39d_0 is DEAD
2025-09-30T14:56:35.303850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae9d81a9-f60804e7-36890dab-5c52f39d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:35.303861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae9d81a9-f60804e7-36890dab-5c52f39d_0] Write session will restart in 0.009383s
2025-09-30T14:56:35.303894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae9d81a9-f60804e7-36890dab-5c52f39d_0] Write session: Do CDS request
2025-09-30T14:56:35.303899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae9d81a9-f60804e7-36890dab-5c52f39d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:35.304299Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:35.314843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae9d81a9-f60804e7-36890dab-5c52f39d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:35.315406Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:35.315433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2269
2025-09-30T14:56:35.315584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2269 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:35.315615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2269 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:35.315621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2269 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:35.315634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:35.316222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2269 sessionId:  describe result for acl check
2025-09-30T14:56:35.316261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:35.316264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:35.316266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:35.316276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896285220077822:3914] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:35.316879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896285220077822:3914] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:35.320458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:35.320904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896285220077822:3914] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:35.322670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:35.322901Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:35.322914Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:35.322927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:35.323003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:35.323048Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896285130304871:10383]
2025-09-30T14:56:35.323777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:35.324104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:35.324163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:35.324542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:35.324617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:35.324623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:35.324625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:35.324626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:35.324628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:35.324630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:35.324631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:35.324632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:35.324634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:35.324635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:35.324637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.324638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.324639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.324641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:35.324642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:35.324649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:35.324661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:35.324665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:35.324670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:35.324675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:35.324680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:35.324686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:35.324691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:35.324695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:35.324701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:35.324705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.324710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.324714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.324718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:35.324721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:35.324730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:35.324739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:35.324746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:35.324752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:35.324758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:35.324764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:35.324769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:35.324775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:35.324789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:35.324794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:35.324799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:35.324805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:35.324809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:35.324814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:35.324818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:35.324824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:35.324829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:35.324835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:35.324840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:35.324845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:35.324851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.324856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.324861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.324868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.324873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.324878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.324883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:35.324888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:35.324893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:35.324899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:35.324950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:35.325939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896285220077822:3914] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:35.325962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896285220077822:3914] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:35.325968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896285220077822:3914] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:35.325977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2269 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:35.331672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:35.332626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:35.332648Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:35.332651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:35.332655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:35.332663Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2268 [2:7555896285130304871:10383]
2025-09-30T14:56:35.332682Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:35.332708Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:35.332716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:35.332719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:35.332722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:35.332739Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:35.332751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:35.332759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:35.332825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.332834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.332836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.332840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:35.332843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:35.332906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:35.332916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.332930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.332943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.332959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:35.332979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896285220077784:2454], now have 1 active actors on pipe
2025-09-30T14:56:35.332989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896285220077897:3914], now have 1 active actors on pipe
2025-09-30T14:56:35.332996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896285130304866:10383]
2025-09-30T14:56:35.332999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896285130304866:10383]
2025-09-30T14:56:35.333001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896285130304866:10383]
2025-09-30T14:56:35.333015Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:35.333034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:35.333034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:35.333039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:35.333052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:35.333052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:35.333062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:35.333100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896285130304866:10383]
2025-09-30T14:56:35.333109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:35.333042Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2268
2025-09-30T14:56:35.333125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:35.333095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2268
2025-09-30T14:56:35.333159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:35.333169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:35.333194Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97c329c3-e95dd6bc-f6c2581a-44378303_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:35.333208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:35.333211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:35.333214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:35.333224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:35.333233Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:35.333248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:35.333603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:35.333613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:35.333632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:35.333757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2269 partition: 0 MaxSeqNo: 42 sessionId: src_id|97c329c3-e95dd6bc-f6c2581a-44378303_0
2025-09-30T14:56:35.334125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae9d81a9-f60804e7-36890dab-5c52f39d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|97c329c3-e95dd6bc-f6c2581a-44378303_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:35.336964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97c329c3-e95dd6bc-f6c2581a-44378303_0] Write session: try to update token
2025-09-30T14:56:35.336984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97c329c3-e95dd6bc-f6c2581a-44378303_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:35.354805Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:35.354826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:35.354829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:35.354831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:35.354841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896285130304866:10383]
2025-09-30T14:56:35.354845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896285130304866:10383]
2025-09-30T14:56:35.354853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896285130304866:10383]
2025-09-30T14:56:35.354896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:35.354903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.354906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:35.354905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:35.354912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:35.354916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:35.355066Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:35.361651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2269 sessionId: src_id|97c329c3-e95dd6bc-f6c2581a-44378303_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:35.364772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:35.403480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896285220077904:3180]
2025-09-30T14:56:35.403794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2268, pipe: [1:7555896285220077904:3180]
2025-09-30T14:56:35.471543Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:35.472033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:35.472052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:35.472090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896285220077904:3180], now have 1 active actors on pipe
2025-09-30T14:56:35.472314Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:35.472372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:35.472445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896285220077904:3180]
2025-09-30T14:56:35.472468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:35.472543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2269 reason: status is not ok: tablet will be restarted right now sessionId: src_id|97c329c3-e95dd6bc-f6c2581a-44378303_0
2025-09-30T14:56:35.472735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2269 sessionId: src_id|97c329c3-e95dd6bc-f6c2581a-44378303_0 is DEAD
2025-09-30T14:56:35.472910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97c329c3-e95dd6bc-f6c2581a-44378303_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:35.472922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97c329c3-e95dd6bc-f6c2581a-44378303_0] Write session will restart in 0.006032s
2025-09-30T14:56:35.472945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97c329c3-e95dd6bc-f6c2581a-44378303_0] Write session: Do CDS request
2025-09-30T14:56:35.472952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97c329c3-e95dd6bc-f6c2581a-44378303_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:35.480631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97c329c3-e95dd6bc-f6c2581a-44378303_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:35.480831Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:35.480850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2270
2025-09-30T14:56:35.480949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2270 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:35.480986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2270 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:35.480996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2270 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:35.480999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:35.481393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2270 sessionId:  describe result for acl check
2025-09-30T14:56:35.481423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:35.481430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:35.481431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:35.481436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896285220077947:3932] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:35.481927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896285220077947:3932] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:35.483489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896285220077947:3932] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:35.484338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:35.486414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:35.486619Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:35.486639Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:35.486650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:35.486700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:35.486750Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896285130305018:10392]
2025-09-30T14:56:35.486926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896285220077947:3932] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:35.486959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896285220077947:3932] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:35.486962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896285220077947:3932] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:35.486970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2270 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:35.487480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:35.487773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:35.487817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:35.488140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:35.488197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:35.488205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:35.488206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:35.488207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:35.488208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:35.488210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:35.488211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:35.488212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:35.488213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:35.488215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:35.488216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.488217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.488219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.488220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:35.488221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:35.488227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:35.488237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:35.488242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:35.488247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:35.488252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:35.488256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:35.488261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:35.488265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:35.488269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:35.488274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:35.488278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.488282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.488287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.488291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:35.488295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:35.488303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:35.488311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:35.488317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:35.488323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:35.488329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:35.488335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:35.488340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:35.488346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:35.488351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:35.488357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:35.488362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:35.488367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:35.488372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:35.488377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:35.488381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:35.488387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:35.488392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:35.488397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:35.488402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:35.488408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:35.488415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.488421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.488426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.488432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.488443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.488448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.488458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:35.488463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:35.488471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:35.488476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:35.488523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:35.494155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:35.495075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:35.495092Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:35.495096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:35.495100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:35.495109Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2269 [2:7555896285130305018:10392]
2025-09-30T14:56:35.495127Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:35.495149Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:35.495157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:35.495160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:35.495163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:35.495183Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:35.495196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:35.495207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:35.495296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.495307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.495308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.495312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:35.495315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:35.495389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:35.495398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.495411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.495430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.495449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:35.495473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896285220078033:3932], now have 1 active actors on pipe
2025-09-30T14:56:35.495481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896285220077918:2454], now have 1 active actors on pipe
2025-09-30T14:56:35.495488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896285130305012:10392]
2025-09-30T14:56:35.495491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896285130305012:10392]
2025-09-30T14:56:35.495494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896285130305012:10392]
2025-09-30T14:56:35.495506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:35.495524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:35.495527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:35.495532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:35.495535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:35.495545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:35.495549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:35.495551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2269
2025-09-30T14:56:35.495554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2269
2025-09-30T14:56:35.495582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896285130305012:10392]
2025-09-30T14:56:35.495590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:35.495593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:35.495620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:35.495630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:35.495666Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d77c8ef1-39dc947a-84ee6f57-8f04ff76_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:35.495677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:35.495681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:35.495683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:35.495695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:35.495704Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:35.495726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:35.495883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:35.495901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:35.495934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:35.496033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2270 partition: 0 MaxSeqNo: 42 sessionId: src_id|d77c8ef1-39dc947a-84ee6f57-8f04ff76_0
2025-09-30T14:56:35.496430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97c329c3-e95dd6bc-f6c2581a-44378303_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d77c8ef1-39dc947a-84ee6f57-8f04ff76_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:35.499458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d77c8ef1-39dc947a-84ee6f57-8f04ff76_0] Write session: try to update token
2025-09-30T14:56:35.499480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d77c8ef1-39dc947a-84ee6f57-8f04ff76_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:35.508079Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:35.508098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:35.508100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:35.508103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:35.508113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896285130305012:10392]
2025-09-30T14:56:35.508119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896285130305012:10392]
2025-09-30T14:56:35.508123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896285130305012:10392]
2025-09-30T14:56:35.508163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:35.508170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.508173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:35.508191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:35.508204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:35.508208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:35.508319Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:35.515795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2270 sessionId: src_id|d77c8ef1-39dc947a-84ee6f57-8f04ff76_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:35.518676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:35.572416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896285220078045:3180]
2025-09-30T14:56:35.572813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2269, pipe: [1:7555896285220078045:3180]
2025-09-30T14:56:35.631270Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:35.631815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:35.631833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:35.631853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896285220078045:3180], now have 1 active actors on pipe
2025-09-30T14:56:35.632874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d77c8ef1-39dc947a-84ee6f57-8f04ff76_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:35.632887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d77c8ef1-39dc947a-84ee6f57-8f04ff76_0] Write session will restart in 0.009633s
2025-09-30T14:56:35.632926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d77c8ef1-39dc947a-84ee6f57-8f04ff76_0] Write session: Do CDS request
2025-09-30T14:56:35.632932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d77c8ef1-39dc947a-84ee6f57-8f04ff76_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:35.633545Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:35.632156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896285220078045:3180]
2025-09-30T14:56:35.632200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:35.632203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:35.632272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2270 reason: error at write: Disconnected sessionId: src_id|d77c8ef1-39dc947a-84ee6f57-8f04ff76_0
2025-09-30T14:56:35.632455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2270 sessionId: src_id|d77c8ef1-39dc947a-84ee6f57-8f04ff76_0 is DEAD
2025-09-30T14:56:35.632652Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:35.643826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d77c8ef1-39dc947a-84ee6f57-8f04ff76_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:35.643990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:35.644014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2271
2025-09-30T14:56:35.644112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2271 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:35.644147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2271 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:35.644158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2271 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:35.644163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:35.644696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2271 sessionId:  describe result for acl check
2025-09-30T14:56:35.644734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:35.644741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:35.644745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:35.644752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896285220078062:3934] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:35.645339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896285220078062:3934] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:35.649959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896285220078062:3934] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:35.650072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:35.651745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:35.651980Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:35.651993Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:35.652005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:35.652081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:35.652126Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896285130305127:10400]
2025-09-30T14:56:35.652808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:35.653130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896285220078062:3934] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:35.653155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896285220078062:3934] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:35.653159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896285220078062:3934] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:35.653169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2271 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:35.653196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:35.653265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:35.653634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:35.653704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:35.653712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:35.653713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:35.653714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:35.653715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:35.653717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:35.653719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:35.653720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:35.653721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:35.653722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:35.653724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.653725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.653726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.653728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:35.653729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:35.653735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:35.653746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:35.653750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:35.653755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:35.653759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:35.653763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:35.653768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:35.653772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:35.653776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:35.653780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:35.653784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.653787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.653791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.653795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:35.653799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:35.653806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:35.653816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:35.653822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:35.653827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:35.653833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:35.653839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:35.653844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:35.653850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:35.653855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:35.653860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:35.653865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:35.653870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:35.653876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:35.653881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:35.653886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:35.653892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:35.653898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:35.653905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:35.653910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:35.653917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:35.653930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.653936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.653947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.653953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.653959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.653969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.653974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:35.653980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:35.653989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:35.653994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:35.654054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:35.660204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:35.661218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:35.661238Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:35.661242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:35.661246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:35.661255Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2270 [2:7555896285130305127:10400]
2025-09-30T14:56:35.661274Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:35.661310Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:35.661314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:35.661317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:35.661320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:35.661337Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:35.661345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:35.661352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:35.661422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.661433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.661436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.661439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:35.661442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:35.661512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:35.661523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.661537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.661550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.661569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:35.661594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896285220078154:3934], now have 1 active actors on pipe
2025-09-30T14:56:35.661603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896285220078046:2454], now have 1 active actors on pipe
2025-09-30T14:56:35.661610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896285130305122:10400]
2025-09-30T14:56:35.661612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896285130305122:10400]
2025-09-30T14:56:35.661615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896285130305122:10400]
2025-09-30T14:56:35.661631Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:35.661651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:35.661674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:35.661678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:35.661649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2270
2025-09-30T14:56:35.661654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2270
2025-09-30T14:56:35.661701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:35.661717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896285130305122:10400]
2025-09-30T14:56:35.661720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:35.661722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:35.661725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:35.661732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:35.661743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:35.661748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:35.661805Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bbb1e7de-f81a1453-86bd16ee-5d44598d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:35.661819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:35.661824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:35.661831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:35.661842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:35.661854Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:35.661889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:35.667500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:35.667522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:35.667563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:35.667702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2271 partition: 0 MaxSeqNo: 42 sessionId: src_id|bbb1e7de-f81a1453-86bd16ee-5d44598d_0
2025-09-30T14:56:35.668119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d77c8ef1-39dc947a-84ee6f57-8f04ff76_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bbb1e7de-f81a1453-86bd16ee-5d44598d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:35.671013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb1e7de-f81a1453-86bd16ee-5d44598d_0] Write session: try to update token
2025-09-30T14:56:35.671033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb1e7de-f81a1453-86bd16ee-5d44598d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:35.674725Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:35.674747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:35.674750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:35.674752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:35.674763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896285130305122:10400]
2025-09-30T14:56:35.674768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896285130305122:10400]
2025-09-30T14:56:35.674772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896285130305122:10400]
2025-09-30T14:56:35.674822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:35.674831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.674834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:35.674841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:35.674849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:35.674854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:35.675007Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:35.688799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2271 sessionId: src_id|bbb1e7de-f81a1453-86bd16ee-5d44598d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:35.691817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:35.732194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896285220078167:3180]
2025-09-30T14:56:35.732582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2270, pipe: [1:7555896285220078167:3180]
2025-09-30T14:56:35.803026Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:35.803474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:35.803492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:35.803514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896285220078167:3180], now have 1 active actors on pipe
2025-09-30T14:56:35.803774Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:35.803830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:35.803851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:35.803856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:35.803897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896285220078167:3180]
2025-09-30T14:56:35.803933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2271 reason: error at write: Disconnected sessionId: src_id|bbb1e7de-f81a1453-86bd16ee-5d44598d_0
2025-09-30T14:56:35.804121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2271 sessionId: src_id|bbb1e7de-f81a1453-86bd16ee-5d44598d_0 is DEAD
2025-09-30T14:56:35.804358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb1e7de-f81a1453-86bd16ee-5d44598d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:35.804370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb1e7de-f81a1453-86bd16ee-5d44598d_0] Write session will restart in 0.005908s
2025-09-30T14:56:35.804396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb1e7de-f81a1453-86bd16ee-5d44598d_0] Write session: Do CDS request
2025-09-30T14:56:35.804406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb1e7de-f81a1453-86bd16ee-5d44598d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:35.812094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb1e7de-f81a1453-86bd16ee-5d44598d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:35.812194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:35.812219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2272
2025-09-30T14:56:35.812435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2272 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:35.812482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2272 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:35.812488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2272 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:35.812493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:35.813051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2272 sessionId:  describe result for acl check
2025-09-30T14:56:35.813103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:35.813106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:35.813108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:35.813114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896285220078180:3941] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:35.813749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896285220078180:3941] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:35.817181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896285220078180:3941] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:35.822602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896285220078180:3941] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:35.822628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896285220078180:3941] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:35.822631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896285220078180:3941] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:35.822641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2272 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:35.825865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:35.826638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:35.826836Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:35.826846Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:35.826856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:35.826907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:35.826950Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896285130305238:10402]
2025-09-30T14:56:35.827638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:35.828098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:35.828163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:35.828499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:35.828562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:35.828568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:35.828569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:35.828573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:35.828574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:35.828575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:35.828576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:35.828577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:35.828578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:35.828579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:35.828580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.828581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.828582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.828583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:35.828583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:35.828589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:35.828598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:35.828602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:35.828605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:35.828608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:35.828611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:35.828615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:35.828618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:35.828621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:35.828625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:35.828628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.828631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.828634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.828637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:35.828640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:35.828648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:35.828655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:35.828661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:35.828666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:35.828671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:35.828676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:35.828680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:35.828684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:35.828689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:35.828693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:35.828699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:35.828704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:35.828708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:35.828712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:35.828716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:35.828720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:35.828724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:35.828729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:35.828734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:35.828738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:35.828743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.828747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.828752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.828757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.828762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.828767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.828772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:35.828780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:35.828784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:35.828789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:35.828843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:35.834849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:35.835842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:35.835861Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:35.835865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:35.835869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:35.835877Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2271 [2:7555896285130305238:10402]
2025-09-30T14:56:35.835901Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:35.835919Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:35.835923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:35.835927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:35.835929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:35.835946Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:35.835953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:35.835960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:35.836029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.836033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.836035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.836038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:35.836041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:35.836116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:35.836119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.836132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.836143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.836157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:35.836176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896285130305233:10402]
2025-09-30T14:56:35.836179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896285130305233:10402]
2025-09-30T14:56:35.836181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896285130305233:10402]
2025-09-30T14:56:35.836193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:35.836207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:35.836211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:35.836212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896285220078273:3941], now have 1 active actors on pipe
2025-09-30T14:56:35.836213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:35.836215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896285220078168:2454], now have 1 active actors on pipe
2025-09-30T14:56:35.836224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:35.836238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:35.836250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:35.836286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896285130305233:10402]
2025-09-30T14:56:35.836317Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:35.836324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:35.836345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2271
2025-09-30T14:56:35.836388Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2271
2025-09-30T14:56:35.836563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:35.836577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:35.836608Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|278bac56-c507eac6-2bfb8c00-efedab0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:35.836631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:35.836635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:35.836637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:35.836648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:35.836664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:35.836686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:35.836905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:35.836929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:35.836960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:35.837071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2272 partition: 0 MaxSeqNo: 42 sessionId: src_id|278bac56-c507eac6-2bfb8c00-efedab0c_0
2025-09-30T14:56:35.837496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb1e7de-f81a1453-86bd16ee-5d44598d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|278bac56-c507eac6-2bfb8c00-efedab0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:35.840605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|278bac56-c507eac6-2bfb8c00-efedab0c_0] Write session: try to update token
2025-09-30T14:56:35.840629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|278bac56-c507eac6-2bfb8c00-efedab0c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:35.852958Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:35.852979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:35.852982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:35.852984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:35.852996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896285130305233:10402]
2025-09-30T14:56:35.853005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896285130305233:10402]
2025-09-30T14:56:35.853175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896285130305233:10402]
2025-09-30T14:56:35.853225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:35.853240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.853243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:35.853409Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:35.855344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:35.855362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:35.855366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:35.857923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2272 sessionId: src_id|278bac56-c507eac6-2bfb8c00-efedab0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:35.861027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:35.903694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896285220078288:3180]
2025-09-30T14:56:35.903973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2271, pipe: [1:7555896285220078288:3180]
2025-09-30T14:56:35.976605Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:35.976965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:35.976982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:35.977025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896285220078288:3180], now have 1 active actors on pipe
2025-09-30T14:56:35.977278Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:35.977268Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:35.977348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:35.977356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:35.977425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2272 reason: error at write: Disconnected sessionId: src_id|278bac56-c507eac6-2bfb8c00-efedab0c_0
2025-09-30T14:56:35.977597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2272 sessionId: src_id|278bac56-c507eac6-2bfb8c00-efedab0c_0 is DEAD
2025-09-30T14:56:35.977620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896285220078288:3180]
2025-09-30T14:56:35.977747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|278bac56-c507eac6-2bfb8c00-efedab0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:35.977757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|278bac56-c507eac6-2bfb8c00-efedab0c_0] Write session will restart in 0.008328s
2025-09-30T14:56:35.977783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|278bac56-c507eac6-2bfb8c00-efedab0c_0] Write session: Do CDS request
2025-09-30T14:56:35.977792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|278bac56-c507eac6-2bfb8c00-efedab0c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:35.987863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|278bac56-c507eac6-2bfb8c00-efedab0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:35.987909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:35.987941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2273
2025-09-30T14:56:35.988137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2273 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:35.988174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2273 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:35.988185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2273 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:35.988190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:35.988730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2273 sessionId:  describe result for acl check
2025-09-30T14:56:35.988770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:35.988773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:35.988775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:35.988783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896285220078350:3951] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:35.989392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896285220078350:3951] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:35.991235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:35.992090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896285220078350:3951] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:35.994300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:35.994576Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:35.994591Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:35.994605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:35.994667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:35.994712Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896285130305362:10406]
2025-09-30T14:56:35.995450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:35.995768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:35.995829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:35.996142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:35.996234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:35.996238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:35.996240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:35.996240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:35.996242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:35.996243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:35.996244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:35.996245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:35.996247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:35.996248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:35.996249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.996251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.996252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.996253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:35.996254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:35.996259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:35.996269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:35.996273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:35.996277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:35.996280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:35.996284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:35.996287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:35.996291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:35.996295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:35.996299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:35.996302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.996305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.996309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.996312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:35.996316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:35.996324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:35.996332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:35.996337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:35.996342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:35.996347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:35.996352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:35.996357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:35.996362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:35.996366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:35.996371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:35.996375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:35.996380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:35.996385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:35.996389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:35.996394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:35.996399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:35.996403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:35.996407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:35.996411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:35.996416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:35.996420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.996424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:35.996428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.996432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:35.996437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.996442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:35.996446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:35.996451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:35.996455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:35.996468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:35.996510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:35.997338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896285220078350:3951] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:35.997359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896285220078350:3951] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:35.997363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896285220078350:3951] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:35.997373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2273 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:36.002349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:36.003341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:36.003359Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:36.003363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:36.003367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:36.003381Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2272 [2:7555896285130305362:10406]
2025-09-30T14:56:36.003401Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:36.003420Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:36.003423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:36.003427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:36.003430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:36.003448Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:36.003456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:36.003464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:36.003530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.003541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.003543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.003549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:36.003552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:36.003624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:36.003632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.003646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.003665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.003686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:36.003712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896285220078402:3951], now have 1 active actors on pipe
2025-09-30T14:56:36.003720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896285220078292:2454], now have 1 active actors on pipe
2025-09-30T14:56:36.003727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896285130305357:10406]
2025-09-30T14:56:36.003729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896285130305357:10406]
2025-09-30T14:56:36.003732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896285130305357:10406]
2025-09-30T14:56:36.003753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:36.003765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:36.003772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:36.003776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:36.003779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:36.003786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:36.003789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:36.003828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896285130305357:10406]
2025-09-30T14:56:36.003835Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:36.003807Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2272
2025-09-30T14:56:36.003839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:36.003815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2272
2025-09-30T14:56:36.003867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:36.003872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:36.003907Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac1d49fb-23883b47-354fca4f-8f808136_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:36.003918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:36.003922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:36.003924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:36.003934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:36.003948Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:36.003974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:36.004179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:36.004190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:36.004214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:36.004351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2273 partition: 0 MaxSeqNo: 42 sessionId: src_id|ac1d49fb-23883b47-354fca4f-8f808136_0
2025-09-30T14:56:36.004723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|278bac56-c507eac6-2bfb8c00-efedab0c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ac1d49fb-23883b47-354fca4f-8f808136_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:36.007769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1d49fb-23883b47-354fca4f-8f808136_0] Write session: try to update token
2025-09-30T14:56:36.007791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1d49fb-23883b47-354fca4f-8f808136_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:36.018084Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:36.018109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:36.018111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:36.018112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:36.018122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896285130305357:10406]
2025-09-30T14:56:36.018127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896285130305357:10406]
2025-09-30T14:56:36.018132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896285130305357:10406]
2025-09-30T14:56:36.018184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:36.018191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.018194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:36.018344Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:36.018488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:36.018502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:36.018507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:36.026603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2273 sessionId: src_id|ac1d49fb-23883b47-354fca4f-8f808136_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:36.029837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:36.077280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896289515045717:3180]
2025-09-30T14:56:36.077671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2272, pipe: [1:7555896289515045717:3180]
2025-09-30T14:56:36.138968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1d49fb-23883b47-354fca4f-8f808136_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:36.138984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1d49fb-23883b47-354fca4f-8f808136_0] Write session will restart in 0.009265s
2025-09-30T14:56:36.139014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1d49fb-23883b47-354fca4f-8f808136_0] Write session: Do CDS request
2025-09-30T14:56:36.138448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:36.138503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:36.138573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2273 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ac1d49fb-23883b47-354fca4f-8f808136_0
2025-09-30T14:56:36.138786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2273 sessionId: src_id|ac1d49fb-23883b47-354fca4f-8f808136_0 is DEAD
2025-09-30T14:56:36.138917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896289515045717:3180]
2025-09-30T14:56:36.139021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1d49fb-23883b47-354fca4f-8f808136_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:36.137139Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:36.137625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:36.137636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:36.137679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896289515045717:3180], now have 1 active actors on pipe
2025-09-30T14:56:36.137908Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:36.151928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1d49fb-23883b47-354fca4f-8f808136_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:36.152027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:36.152050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2274
2025-09-30T14:56:36.152870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2274 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:36.152934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2274 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:36.152946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2274 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:36.152951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:36.153527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2274 sessionId:  describe result for acl check
2025-09-30T14:56:36.153573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:36.153575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:36.153577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:36.153583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896289515045790:3965] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:36.154175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896289515045790:3965] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:36.155160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:36.157896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896289515045790:3965] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:36.157663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:36.157917Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:36.157923Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:36.157935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:36.158003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:36.158046Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896289425272771:10408]
2025-09-30T14:56:36.158693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:36.159180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:36.159269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:36.159674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:36.159762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:36.159764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:36.159765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:36.159767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:36.159768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:36.159770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:36.159772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:36.159773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:36.159775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:36.159777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:36.159778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.159780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.159781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.159783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:36.159784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:36.159792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:36.159803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:36.159808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:36.159813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:36.159817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:36.159821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:36.159824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:36.159828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:36.159832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:36.159836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:36.159841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.159845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.159849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.159853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:36.159856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:36.159869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:36.159877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:36.159884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:36.159890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:36.159895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:36.159901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:36.159905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:36.159911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:36.159917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:36.159922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:36.159926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:36.159932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:36.159938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:36.159945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:36.159951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:36.159957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:36.159963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:36.159969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:36.159974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:36.159980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:36.159987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.159993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.159998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.160005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.160010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.160016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.160022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:36.160028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:36.160033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:36.160040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:36.160091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:36.165571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896289515045790:3965] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:36.165596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896289515045790:3965] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:36.165601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896289515045790:3965] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:36.165610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2274 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:36.170867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2273
2025-09-30T14:56:36.170918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2273
2025-09-30T14:56:36.169529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:36.170478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:36.170484Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:36.170488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:36.170492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:36.170500Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2273 [2:7555896289425272771:10408]
2025-09-30T14:56:36.170517Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:36.170538Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:36.170542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:36.170545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:36.170548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:36.170565Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:36.170572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:36.170579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:36.170644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.170647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.170649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.170652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:36.170655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:36.170731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:36.170735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.170750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.170764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.170783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:36.170802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896289515045719:2454], now have 1 active actors on pipe
2025-09-30T14:56:36.170805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896289515045835:3965], now have 1 active actors on pipe
2025-09-30T14:56:36.170812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896289425272766:10408]
2025-09-30T14:56:36.170814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896289425272766:10408]
2025-09-30T14:56:36.170817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896289425272766:10408]
2025-09-30T14:56:36.170834Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:36.170850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:36.170866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:36.170870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:36.170910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896289425272766:10408]
2025-09-30T14:56:36.170913Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:36.170950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:36.170954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:36.170956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:36.170963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:36.171187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:36.171193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:36.171222Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1221c57-2e84114d-cd2c3b3-aec2d5d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:36.171230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:36.171233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:36.171236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:36.171261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:36.171272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:36.171288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:36.171485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:36.171500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:36.171524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:36.174946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2274 partition: 0 MaxSeqNo: 42 sessionId: src_id|1221c57-2e84114d-cd2c3b3-aec2d5d0_0
2025-09-30T14:56:36.175518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1d49fb-23883b47-354fca4f-8f808136_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1221c57-2e84114d-cd2c3b3-aec2d5d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:36.178587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1221c57-2e84114d-cd2c3b3-aec2d5d0_0] Write session: try to update token
2025-09-30T14:56:36.178611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1221c57-2e84114d-cd2c3b3-aec2d5d0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:36.184724Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:36.184746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:36.184749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:36.184752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:36.184762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896289425272766:10408]
2025-09-30T14:56:36.184766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896289425272766:10408]
2025-09-30T14:56:36.184771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896289425272766:10408]
2025-09-30T14:56:36.184817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:36.184824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.184827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:36.184826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:36.184834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:36.184838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:36.184971Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:36.202972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2274 sessionId: src_id|1221c57-2e84114d-cd2c3b3-aec2d5d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:36.206029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:36.239384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896289515045845:3180]
2025-09-30T14:56:36.242803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2273, pipe: [1:7555896289515045845:3180]
2025-09-30T14:56:36.307425Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:36.307776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:36.307797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:36.307819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896289515045845:3180], now have 1 active actors on pipe
2025-09-30T14:56:36.308069Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:36.308111Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:36.308107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:36.308112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:36.308140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896289515045845:3180]
2025-09-30T14:56:36.308178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2274 reason: error at write: Disconnected sessionId: src_id|1221c57-2e84114d-cd2c3b3-aec2d5d0_0
2025-09-30T14:56:36.308356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2274 sessionId: src_id|1221c57-2e84114d-cd2c3b3-aec2d5d0_0 is DEAD
2025-09-30T14:56:36.308472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1221c57-2e84114d-cd2c3b3-aec2d5d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:36.308480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1221c57-2e84114d-cd2c3b3-aec2d5d0_0] Write session will restart in 0.007139s
2025-09-30T14:56:36.308497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1221c57-2e84114d-cd2c3b3-aec2d5d0_0] Write session: Do CDS request
2025-09-30T14:56:36.308504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1221c57-2e84114d-cd2c3b3-aec2d5d0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:36.316844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1221c57-2e84114d-cd2c3b3-aec2d5d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:36.316996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:36.317017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2275
2025-09-30T14:56:36.317180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2275 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:36.317235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2275 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:36.317245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2275 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:36.317250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:36.317773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2275 sessionId:  describe result for acl check
2025-09-30T14:56:36.317818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:36.317826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:36.317828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:36.317835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896289515045864:3975] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:36.318451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896289515045864:3975] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:36.321727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896289515045864:3975] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:36.323826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:36.325996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:36.326249Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:36.326253Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:36.326265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:36.326325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:36.326374Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896289425272884:10410]
2025-09-30T14:56:36.326554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896289515045864:3975] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:36.326578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896289515045864:3975] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:36.326582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896289515045864:3975] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:36.326601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2275 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:36.327051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:36.327464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:36.327523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:36.327922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:36.327991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:36.327997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:36.327999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:36.328000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:36.328002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:36.328003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:36.328004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:36.328005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:36.328007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:36.328008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:36.328009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.328010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.328011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.328013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:36.328014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:36.328020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:36.328031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:36.328035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:36.328039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:36.328043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:36.328047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:36.328052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:36.328055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:36.328060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:36.328064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:36.328068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.328072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.328076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.328080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:36.328084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:36.328094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:36.328103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:36.328110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:36.328115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:36.328126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:36.328134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:36.328139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:36.328150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:36.328155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:36.328160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:36.328166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:36.328171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:36.328176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:36.328182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:36.328191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:36.328197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:36.328203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:36.328210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:36.328215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:36.328220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:36.328227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.328232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.328241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.328247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.328252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.328262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.328268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:36.328278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:36.328283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:36.328288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:36.328335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:36.334514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:36.335558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:36.335579Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:36.335582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:36.335587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:36.335596Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2274 [2:7555896289425272884:10410]
2025-09-30T14:56:36.335616Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:36.335632Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:36.335645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:36.335648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:36.335651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:36.335667Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:36.335674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:36.335682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:36.335755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.335765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.335767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.335770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:36.335775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:36.335849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:36.335857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.335872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.335884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.335910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:36.335930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896289515045849:2454], now have 1 active actors on pipe
2025-09-30T14:56:36.335939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896289515045959:3975], now have 1 active actors on pipe
2025-09-30T14:56:36.335945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896289425272879:10410]
2025-09-30T14:56:36.335947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896289425272879:10410]
2025-09-30T14:56:36.335950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896289425272879:10410]
2025-09-30T14:56:36.335962Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:36.335978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:36.335987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:36.335992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:36.335994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:36.335999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:36.336003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:36.336024Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2274
2025-09-30T14:56:36.336043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2274
2025-09-30T14:56:36.336037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896289425272879:10410]
2025-09-30T14:56:36.336047Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:36.336057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:36.336086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:36.336095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:36.336128Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97ab9466-b416711b-1b5d12aa-5cf970f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:36.336140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:36.336144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:36.336152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:36.336161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:36.336172Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:36.336190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:36.336372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:36.336388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:36.336422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:36.336527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2275 partition: 0 MaxSeqNo: 42 sessionId: src_id|97ab9466-b416711b-1b5d12aa-5cf970f3_0
2025-09-30T14:56:36.336938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1221c57-2e84114d-cd2c3b3-aec2d5d0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|97ab9466-b416711b-1b5d12aa-5cf970f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:36.340049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97ab9466-b416711b-1b5d12aa-5cf970f3_0] Write session: try to update token
2025-09-30T14:56:36.340075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97ab9466-b416711b-1b5d12aa-5cf970f3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:36.349896Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:36.349919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:36.349929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896289425272879:10410]
2025-09-30T14:56:36.349974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:36.349994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:36.350207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:36.350374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:36.350528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:36.350678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:36.350896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:36.350945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:36.357156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2275 sessionId: src_id|97ab9466-b416711b-1b5d12aa-5cf970f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:36.360163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:36.361095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:36.361127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:36.361151Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:36.361154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:36.361156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:36.361159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:36.361172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896289425272879:10410]
2025-09-30T14:56:36.361176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896289425272879:10410]
2025-09-30T14:56:36.361179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896289425272879:10410]
2025-09-30T14:56:36.361233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:36.361242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.361245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:36.361323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:36.361337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:36.361341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:36.361416Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:36.408527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896289515045971:3180]
2025-09-30T14:56:36.408834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2274, pipe: [1:7555896289515045971:3180]
2025-09-30T14:56:36.477327Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:36.477672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:36.477713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896289515045971:3180], now have 1 active actors on pipe
2025-09-30T14:56:36.477825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:36.477871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:36.477918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896289515045971:3180]
2025-09-30T14:56:36.477931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:36.477934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:36.478005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2275 reason: error at write: Disconnected sessionId: src_id|97ab9466-b416711b-1b5d12aa-5cf970f3_0
2025-09-30T14:56:36.478143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2275 sessionId: src_id|97ab9466-b416711b-1b5d12aa-5cf970f3_0 is DEAD
2025-09-30T14:56:36.478308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97ab9466-b416711b-1b5d12aa-5cf970f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:36.478318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97ab9466-b416711b-1b5d12aa-5cf970f3_0] Write session will restart in 0.007073s
2025-09-30T14:56:36.478344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97ab9466-b416711b-1b5d12aa-5cf970f3_0] Write session: Do CDS request
2025-09-30T14:56:36.478349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97ab9466-b416711b-1b5d12aa-5cf970f3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:36.486769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97ab9466-b416711b-1b5d12aa-5cf970f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:36.486852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:36.486872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2276
2025-09-30T14:56:36.487031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2276 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:36.487067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2276 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:36.487074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2276 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:36.487080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:36.487493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2276 sessionId:  describe result for acl check
2025-09-30T14:56:36.487539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:36.487541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:36.487543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:36.487549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896289515046030:3993] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:36.488073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896289515046030:3993] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:36.490066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:36.490247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896289515046030:3993] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:36.492294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:36.492493Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:36.492506Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:36.492517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:36.492588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:36.492634Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896289425273013:10413]
2025-09-30T14:56:36.492710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896289515046030:3993] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:36.492729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896289515046030:3993] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:36.492733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896289515046030:3993] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:36.492741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2276 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:36.493360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:36.493691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:36.493750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:36.494055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:36.494112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:36.494118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:36.494119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:36.494120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:36.494121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:36.494122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:36.494124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:36.494125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:36.494126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:36.494127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:36.494129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.494130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.494131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.494132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:36.494133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:36.494139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:36.494149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:36.494152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:36.494154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:36.494157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:36.494159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:36.494161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:36.494164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:36.494166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:36.494169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:36.494171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.494173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.494175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.494178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:36.494180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:36.494186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:36.494191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:36.494195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:36.494198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:36.494201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:36.494205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:36.494207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:36.494211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:36.494213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:36.494216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:36.494219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:36.494222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:36.494225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:36.494229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:36.494232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:36.494235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:36.494238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:36.494241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:36.494244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:36.494248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:36.494251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.494254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.494257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.494260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.494262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.494265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.494268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:36.494271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:36.494276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:36.494280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:36.494325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:36.499980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:36.501102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:36.501122Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:36.501125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:36.501129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:36.501134Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2275 [2:7555896289425273013:10413]
2025-09-30T14:56:36.501153Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:36.501169Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:36.501172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:36.501175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:36.501178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:36.501195Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:36.501208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:36.501219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:36.501300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.501309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.501311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.501315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:36.501318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:36.501399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:36.501407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.501420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.501437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.501461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:36.501487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896289515045972:2454], now have 1 active actors on pipe
2025-09-30T14:56:36.501496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896289515046096:3993], now have 1 active actors on pipe
2025-09-30T14:56:36.501502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896289425273007:10413]
2025-09-30T14:56:36.501505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896289425273007:10413]
2025-09-30T14:56:36.501507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896289425273007:10413]
2025-09-30T14:56:36.501525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:36.501544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:36.501545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:36.501549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:36.501551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:36.501564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:36.501528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2275
2025-09-30T14:56:36.501568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:36.501577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2275
2025-09-30T14:56:36.501601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896289425273007:10413]
2025-09-30T14:56:36.501609Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:36.501611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:36.501632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:36.501641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:36.501688Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de04ab53-eb168ac4-7fc9d5dc-98f09ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:36.501700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:36.501705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:36.501708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:36.501722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:36.501736Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:36.501761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:36.501938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:36.501946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:36.501960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:36.502034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2276 partition: 0 MaxSeqNo: 42 sessionId: src_id|de04ab53-eb168ac4-7fc9d5dc-98f09ba_0
2025-09-30T14:56:36.502388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97ab9466-b416711b-1b5d12aa-5cf970f3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|de04ab53-eb168ac4-7fc9d5dc-98f09ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:36.505058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de04ab53-eb168ac4-7fc9d5dc-98f09ba_0] Write session: try to update token
2025-09-30T14:56:36.505072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de04ab53-eb168ac4-7fc9d5dc-98f09ba_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:36.514400Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:36.514421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:36.514423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:36.514425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:36.514439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896289425273007:10413]
2025-09-30T14:56:36.514444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896289425273007:10413]
2025-09-30T14:56:36.514449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896289425273007:10413]
2025-09-30T14:56:36.514501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:36.514503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:36.514511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.514515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:36.514515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:36.514520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:36.514739Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:36.522082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2276 sessionId: src_id|de04ab53-eb168ac4-7fc9d5dc-98f09ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:36.524979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:36.577985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896289515046118:3180]
2025-09-30T14:56:36.578375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2275, pipe: [1:7555896289515046118:3180]
2025-09-30T14:56:36.630198Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:36.630548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:36.630561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:36.630578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896289515046118:3180], now have 1 active actors on pipe
2025-09-30T14:56:36.630833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896289515046118:3180]
2025-09-30T14:56:36.630854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:36.630859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:36.630868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:36.630931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2276 reason: error at write: Disconnected sessionId: src_id|de04ab53-eb168ac4-7fc9d5dc-98f09ba_0
2025-09-30T14:56:36.630774Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:36.631125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2276 sessionId: src_id|de04ab53-eb168ac4-7fc9d5dc-98f09ba_0 is DEAD
2025-09-30T14:56:36.631277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de04ab53-eb168ac4-7fc9d5dc-98f09ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:36.631288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de04ab53-eb168ac4-7fc9d5dc-98f09ba_0] Write session will restart in 0.007639s
2025-09-30T14:56:36.631318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de04ab53-eb168ac4-7fc9d5dc-98f09ba_0] Write session: Do CDS request
2025-09-30T14:56:36.631324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de04ab53-eb168ac4-7fc9d5dc-98f09ba_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:36.643810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de04ab53-eb168ac4-7fc9d5dc-98f09ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:36.643881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:36.643901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2277
2025-09-30T14:56:36.644027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2277 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:36.644060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2277 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:36.644065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2277 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:36.644074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:36.644531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2277 sessionId:  describe result for acl check
2025-09-30T14:56:36.644563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:36.644565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:36.644566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:36.644572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896289515046196:4006] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:36.644572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:36.645103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896289515046196:4006] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:36.646597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:36.646807Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:36.646819Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:36.646832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:36.646888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:36.646928Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896289425273150:10427]
2025-09-30T14:56:36.647634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:36.648386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:36.648459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:36.648707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896289515046196:4006] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:36.648837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:36.648909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:36.648915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:36.648916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:36.648917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:36.648919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:36.648920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:36.648921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:36.648923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:36.648924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:36.648925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:36.648926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.648928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.648929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.648930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:36.648931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:36.648938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:36.648947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:36.648952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:36.648956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:36.648961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:36.648965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:36.648970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:36.648974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:36.648978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:36.648984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:36.648988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.648992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.648996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.649000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:36.649004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:36.649013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:36.649021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:36.649028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:36.649033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:36.649039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:36.649045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:36.649050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:36.649055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:36.649061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:36.649065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:36.649069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:36.649073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:36.649078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:36.649083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:36.649088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:36.649095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:36.649101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:36.649107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:36.649111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:36.649117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:36.649123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.649127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.649140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.649144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.649148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.649153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.649156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:36.649161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:36.649165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:36.649170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:36.649219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:36.655002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:36.655145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896289515046196:4006] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:36.655172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896289515046196:4006] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:36.655176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896289515046196:4006] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:36.655187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2277 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:36.656001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:36.656019Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:36.656022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:36.656027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:36.656035Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2276 [2:7555896289425273150:10427]
2025-09-30T14:56:36.656054Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:36.656072Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:36.656074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:36.656078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:36.656081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:36.656099Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:36.656112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:36.656119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:36.656184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.656191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.656193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.656197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:36.656200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:36.656279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:36.656286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.656300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.656313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.656331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:36.656352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896289515046235:4006], now have 1 active actors on pipe
2025-09-30T14:56:36.656362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896289515046119:2454], now have 1 active actors on pipe
2025-09-30T14:56:36.656369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896289425273145:10427]
2025-09-30T14:56:36.656371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896289425273145:10427]
2025-09-30T14:56:36.656373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896289425273145:10427]
2025-09-30T14:56:36.656387Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:36.656402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:36.656404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:36.656413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:36.656416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:36.656417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:36.656429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2276
2025-09-30T14:56:36.656420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:36.656439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2276
2025-09-30T14:56:36.656459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896289425273145:10427]
2025-09-30T14:56:36.656462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:36.656465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:36.656491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:36.656502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:36.656538Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|253e0a6d-e1e14692-c127bd0c-3f5e16ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:36.656551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:36.656556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:36.656558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:36.656569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:36.656585Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:36.656603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:36.656777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:36.656790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:36.656814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:36.656903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2277 partition: 0 MaxSeqNo: 42 sessionId: src_id|253e0a6d-e1e14692-c127bd0c-3f5e16ae_0
2025-09-30T14:56:36.657333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de04ab53-eb168ac4-7fc9d5dc-98f09ba_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|253e0a6d-e1e14692-c127bd0c-3f5e16ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:36.660441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|253e0a6d-e1e14692-c127bd0c-3f5e16ae_0] Write session: try to update token
2025-09-30T14:56:36.660461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|253e0a6d-e1e14692-c127bd0c-3f5e16ae_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:36.669809Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:36.669832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:36.669835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:36.669837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:36.669851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896289425273145:10427]
2025-09-30T14:56:36.669856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896289425273145:10427]
2025-09-30T14:56:36.669860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896289425273145:10427]
2025-09-30T14:56:36.669907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:36.669910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:36.669914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.669917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:36.669919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:36.669921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:36.670066Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:36.679941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2277 sessionId: src_id|253e0a6d-e1e14692-c127bd0c-3f5e16ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:36.682818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:36.731060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896289515046245:3180]
2025-09-30T14:56:36.731415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2276, pipe: [1:7555896289515046245:3180]
2025-09-30T14:56:36.791424Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:36.791832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:36.791851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:36.791894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896289515046245:3180], now have 1 active actors on pipe
2025-09-30T14:56:36.792151Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:36.792149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:36.792166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:36.792173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896289515046245:3180]
2025-09-30T14:56:36.792193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:36.792230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2277 reason: error at write: Disconnected sessionId: src_id|253e0a6d-e1e14692-c127bd0c-3f5e16ae_0
2025-09-30T14:56:36.792417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2277 sessionId: src_id|253e0a6d-e1e14692-c127bd0c-3f5e16ae_0 is DEAD
2025-09-30T14:56:36.792568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|253e0a6d-e1e14692-c127bd0c-3f5e16ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:36.792578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|253e0a6d-e1e14692-c127bd0c-3f5e16ae_0] Write session will restart in 0.008149s
2025-09-30T14:56:36.792600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|253e0a6d-e1e14692-c127bd0c-3f5e16ae_0] Write session: Do CDS request
2025-09-30T14:56:36.792609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|253e0a6d-e1e14692-c127bd0c-3f5e16ae_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:36.801847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|253e0a6d-e1e14692-c127bd0c-3f5e16ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:36.801956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:36.801990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2278
2025-09-30T14:56:36.802130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2278 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:36.802165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2278 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:36.802176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2278 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:36.802180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:36.802711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2278 sessionId:  describe result for acl check
2025-09-30T14:56:36.802758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:36.802760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:36.802761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:36.802767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896289515046313:4016] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:36.803375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896289515046313:4016] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:36.805139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896289515046313:4016] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:36.804753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:36.806704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:36.806911Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:36.806915Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:36.806927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:36.806982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:36.807038Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896289425273265:10429]
2025-09-30T14:56:36.807535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896289515046313:4016] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:36.807552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896289515046313:4016] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:36.807556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896289515046313:4016] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:36.807565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2278 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:36.807714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:36.808031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:36.808081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:36.808439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:36.808521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:36.808528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:36.808529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:36.808531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:36.808532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:36.808534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:36.808535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:36.808537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:36.808539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:36.808540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:36.808542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.808543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.808544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.808546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:36.808547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:36.808553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:36.808565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:36.808570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:36.808575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:36.808580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:36.808585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:36.808590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:36.808595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:36.808600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:36.808605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:36.808610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.808615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.808620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.808624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:36.808629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:36.808638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:36.808647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:36.808654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:36.808660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:36.808666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:36.808679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:36.808683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:36.808694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:36.808699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:36.808706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:36.808711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:36.808716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:36.808727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:36.808733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:36.808740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:36.808753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:36.808766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:36.808779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:36.808784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:36.808790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:36.808797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.808803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.808808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.808814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.808819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.808830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.808835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:36.808841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:36.808846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:36.808852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:36.808904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:36.814794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:36.815903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:36.815922Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:36.815924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:36.815929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:36.815937Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2277 [2:7555896289425273265:10429]
2025-09-30T14:56:36.815960Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:36.815977Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:36.815981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:36.815983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:36.815985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:36.816004Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:36.816010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:36.816017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:36.816063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.816064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.816066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.816069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:36.816070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:36.816139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:36.816142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.816157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.816168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.816183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:36.816198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896289425273260:10429]
2025-09-30T14:56:36.816200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896289425273260:10429]
2025-09-30T14:56:36.816202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896289425273260:10429]
2025-09-30T14:56:36.816211Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:36.816223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896289515046359:4016], now have 1 active actors on pipe
2025-09-30T14:56:36.816232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:36.816232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:36.816236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:36.816238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:36.816244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:36.816246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:36.816252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896289515046246:2454], now have 1 active actors on pipe
2025-09-30T14:56:36.816283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896289425273260:10429]
2025-09-30T14:56:36.816294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:36.816331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:36.816542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:36.816557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:36.816398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2277
2025-09-30T14:56:36.816589Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8bb2f6d-2d848930-7dce127e-2be4b3c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:36.816450Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2277
2025-09-30T14:56:36.816600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:36.816605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:36.816607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:36.816617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:36.816631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:36.816650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:36.816992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:36.817021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:36.817045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:36.817167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2278 partition: 0 MaxSeqNo: 42 sessionId: src_id|d8bb2f6d-2d848930-7dce127e-2be4b3c8_0
2025-09-30T14:56:36.817643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|253e0a6d-e1e14692-c127bd0c-3f5e16ae_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d8bb2f6d-2d848930-7dce127e-2be4b3c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:36.820753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8bb2f6d-2d848930-7dce127e-2be4b3c8_0] Write session: try to update token
2025-09-30T14:56:36.820773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8bb2f6d-2d848930-7dce127e-2be4b3c8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:36.831377Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:36.831397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:36.831400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:36.831404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:36.831415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896289425273260:10429]
2025-09-30T14:56:36.831419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896289425273260:10429]
2025-09-30T14:56:36.831425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896289425273260:10429]
2025-09-30T14:56:36.831467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:36.831474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.831477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:36.831489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:36.831507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:36.831511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:36.831614Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:36.841323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2278 sessionId: src_id|d8bb2f6d-2d848930-7dce127e-2be4b3c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:36.844184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:36.895470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896289515046372:3180]
2025-09-30T14:56:36.899359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2277, pipe: [1:7555896289515046372:3180]
2025-09-30T14:56:36.947547Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:36.947896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:36.947910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:36.947931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896289515046372:3180], now have 1 active actors on pipe
2025-09-30T14:56:36.948174Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:36.948186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896289515046372:3180]
2025-09-30T14:56:36.948224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:36.948227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:36.948292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2278 reason: error at write: Disconnected sessionId: src_id|d8bb2f6d-2d848930-7dce127e-2be4b3c8_0
2025-09-30T14:56:36.948503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2278 sessionId: src_id|d8bb2f6d-2d848930-7dce127e-2be4b3c8_0 is DEAD
2025-09-30T14:56:36.948641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:36.951519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8bb2f6d-2d848930-7dce127e-2be4b3c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:36.951535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8bb2f6d-2d848930-7dce127e-2be4b3c8_0] Write session will restart in 0.005538s
2025-09-30T14:56:36.951561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8bb2f6d-2d848930-7dce127e-2be4b3c8_0] Write session: Do CDS request
2025-09-30T14:56:36.951569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8bb2f6d-2d848930-7dce127e-2be4b3c8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:36.958783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8bb2f6d-2d848930-7dce127e-2be4b3c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:36.958901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:36.958922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2279
2025-09-30T14:56:36.959085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2279 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:36.959145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2279 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:36.959157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2279 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:36.959161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:36.959849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2279 sessionId:  describe result for acl check
2025-09-30T14:56:36.959887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:36.959891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:36.959893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:36.959899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896289515046406:4024] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:36.960464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896289515046406:4024] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:36.963161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896289515046406:4024] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:36.964810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:36.967136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:36.967363Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:36.967367Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:36.967377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:36.967431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:36.967467Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896289425273395:10433]
2025-09-30T14:56:36.968156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:36.968355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896289515046406:4024] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:36.968375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896289515046406:4024] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:36.968379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896289515046406:4024] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:36.968397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2279 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:36.968479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:36.968527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:36.968861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:36.968922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:36.968928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:36.968929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:36.968930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:36.968932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:36.968933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:36.968934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:36.968935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:36.968937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:36.968938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:36.968939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.968941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.968942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.968943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:36.968944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:36.968958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:36.968969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:36.968973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:36.968977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:36.968982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:36.968986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:36.968990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:36.968995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:36.968999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:36.969004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:36.969008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.969013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.969017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.969021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:36.969025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:36.969032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:36.969040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:36.969053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:36.969059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:36.969063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:36.969069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:36.969074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:36.969079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:36.969084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:36.969089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:36.969094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:36.969100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:36.969104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:36.969110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:36.969115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:36.969125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:36.969131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:36.969137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:36.969145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:36.969151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:36.969160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.969166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.969170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.969180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.969185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.969191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.969200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:36.969206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:36.969215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:36.969220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:36.969266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:36.974833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:36.975838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:36.975858Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:36.975861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:36.975865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:36.975873Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2278 [2:7555896289425273395:10433]
2025-09-30T14:56:36.975893Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:36.975910Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:36.975919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:36.975923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:36.975926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:36.975946Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:36.975960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:36.975970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:36.976038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.976044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.976047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.976051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:36.976054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:36.976126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:36.976135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.976147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:36.976157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:36.976173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:36.976191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896289515046373:2454], now have 1 active actors on pipe
2025-09-30T14:56:36.976205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896289425273390:10433]
2025-09-30T14:56:36.976208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896289425273390:10433]
2025-09-30T14:56:36.976210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896289425273390:10433]
2025-09-30T14:56:36.976222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:36.976231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:36.976233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:36.976235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:36.976236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896289515046489:4024], now have 1 active actors on pipe
2025-09-30T14:56:36.976244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:36.976258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:36.976267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:36.976301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896289425273390:10433]
2025-09-30T14:56:36.976311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:36.976316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:36.976466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:36.976481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:36.976511Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33420f2b-93c5f85-9c3f6f39-18de5363_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:36.976299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2278
2025-09-30T14:56:36.976310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2278
2025-09-30T14:56:36.976533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:36.976542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:36.976544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:36.976556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:36.976570Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:36.976590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:36.976804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:36.976817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:36.976833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:36.976937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2279 partition: 0 MaxSeqNo: 42 sessionId: src_id|33420f2b-93c5f85-9c3f6f39-18de5363_0
2025-09-30T14:56:36.977344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8bb2f6d-2d848930-7dce127e-2be4b3c8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|33420f2b-93c5f85-9c3f6f39-18de5363_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:36.980338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33420f2b-93c5f85-9c3f6f39-18de5363_0] Write session: try to update token
2025-09-30T14:56:36.980360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33420f2b-93c5f85-9c3f6f39-18de5363_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:36.989614Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:36.989638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:36.989642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:36.989644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:36.989655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896289425273390:10433]
2025-09-30T14:56:36.989660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896289425273390:10433]
2025-09-30T14:56:36.989665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896289425273390:10433]
2025-09-30T14:56:36.989709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:36.989715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:36.989718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:36.989725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:36.989733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:36.989737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:36.989871Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:36.995664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2279 sessionId: src_id|33420f2b-93c5f85-9c3f6f39-18de5363_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:36.998543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:37.048512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896293810013795:3180]
2025-09-30T14:56:37.048787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2278, pipe: [1:7555896293810013795:3180]
2025-09-30T14:56:37.104364Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:37.104775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:37.104788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:37.104825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896293810013795:3180], now have 1 active actors on pipe
2025-09-30T14:56:37.105040Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:37.105081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896293810013795:3180]
2025-09-30T14:56:37.105123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:37.105197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2279 reason: status is not ok: tablet will be restarted right now sessionId: src_id|33420f2b-93c5f85-9c3f6f39-18de5363_0
2025-09-30T14:56:37.105394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2279 sessionId: src_id|33420f2b-93c5f85-9c3f6f39-18de5363_0 is DEAD
2025-09-30T14:56:37.105405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:37.105540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33420f2b-93c5f85-9c3f6f39-18de5363_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:37.105551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33420f2b-93c5f85-9c3f6f39-18de5363_0] Write session will restart in 0.007778s
2025-09-30T14:56:37.105575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33420f2b-93c5f85-9c3f6f39-18de5363_0] Write session: Do CDS request
2025-09-30T14:56:37.105580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33420f2b-93c5f85-9c3f6f39-18de5363_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:37.114822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33420f2b-93c5f85-9c3f6f39-18de5363_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:37.114892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:37.114914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2280
2025-09-30T14:56:37.115078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2280 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:37.115128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2280 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:37.115139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2280 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:37.115143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:37.115602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2280 sessionId:  describe result for acl check
2025-09-30T14:56:37.115644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:37.115653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:37.115656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:37.115662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896293810013885:4036] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:37.116263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896293810013885:4036] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:37.116307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:37.118337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:37.118538Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:37.118549Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:37.118560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:37.118607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:37.118610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896293810013885:4036] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:37.118658Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896293720240808:10435]
2025-09-30T14:56:37.119354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:37.120341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:37.120411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:37.120858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:37.120945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:37.120955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:37.120957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:37.120958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:37.120960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:37.120961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:37.120962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:37.120964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:37.120965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:37.120966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:37.120967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.120968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.120969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.120970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:37.120971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:37.120979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:37.120989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:37.120993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:37.120997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:37.121000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:37.121005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:37.121008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:37.121012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:37.121017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:37.121022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:37.121027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.121031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.121035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.121039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:37.121044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:37.121054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:37.121063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:37.121070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:37.121076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:37.121082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:37.121087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:37.121092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:37.121098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:37.121104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:37.121111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:37.121116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:37.121122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:37.121126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:37.121132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:37.121136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:37.121142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:37.121146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:37.121152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:37.121157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:37.121163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:37.121168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.121173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.121178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.121184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.121188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.121194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.121201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:37.121206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:37.121211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:37.121216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:37.121264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:37.121681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896293810013885:4036] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:37.121699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896293810013885:4036] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:37.121703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896293810013885:4036] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:37.121713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2280 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:37.126982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:37.128069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:37.128090Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:37.128093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:37.128097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:37.128104Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2279 [2:7555896293720240808:10435]
2025-09-30T14:56:37.128122Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:37.128146Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:37.128154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:37.128158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:37.128161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:37.128178Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:37.128186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:37.128194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:37.128260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.128268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.128271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.128274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:37.128277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:37.128350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:37.128358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.128376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.128394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.128419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:37.128443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896293810013927:4036], now have 1 active actors on pipe
2025-09-30T14:56:37.128451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896293810013808:2454], now have 1 active actors on pipe
2025-09-30T14:56:37.128458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896293720240803:10435]
2025-09-30T14:56:37.128461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896293720240803:10435]
2025-09-30T14:56:37.128462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896293720240803:10435]
2025-09-30T14:56:37.128481Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:37.128493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:37.128494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:37.128504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:37.128507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:37.128510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:37.128513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:37.128506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2279
2025-09-30T14:56:37.128517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2279
2025-09-30T14:56:37.128550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896293720240803:10435]
2025-09-30T14:56:37.128559Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:37.128561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:37.128583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:37.128588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:37.128712Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ce6ba82-d0a3c73b-96874f47-dac3b701_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:37.128720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:37.128724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:37.128727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:37.128737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:37.128746Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:37.128779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:37.128935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:37.128943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:37.128957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:37.129441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33420f2b-93c5f85-9c3f6f39-18de5363_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4ce6ba82-d0a3c73b-96874f47-dac3b701_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:37.129036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2280 partition: 0 MaxSeqNo: 42 sessionId: src_id|4ce6ba82-d0a3c73b-96874f47-dac3b701_0
2025-09-30T14:56:37.132260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce6ba82-d0a3c73b-96874f47-dac3b701_0] Write session: try to update token
2025-09-30T14:56:37.132278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce6ba82-d0a3c73b-96874f47-dac3b701_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:37.141668Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:37.141698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:37.141701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:37.141703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:37.141713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896293720240803:10435]
2025-09-30T14:56:37.141718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896293720240803:10435]
2025-09-30T14:56:37.141722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896293720240803:10435]
2025-09-30T14:56:37.141769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:37.141773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:37.141777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.141779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:37.141781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:37.141784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:37.141941Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:37.148349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2280 sessionId: src_id|4ce6ba82-d0a3c73b-96874f47-dac3b701_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:37.151111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:37.205173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896293810013940:3180]
2025-09-30T14:56:37.205523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2279, pipe: [1:7555896293810013940:3180]
2025-09-30T14:56:37.260549Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:37.260894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:37.260913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:37.260955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896293810013940:3180], now have 1 active actors on pipe
2025-09-30T14:56:37.261259Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:37.261559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce6ba82-d0a3c73b-96874f47-dac3b701_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:37.261568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce6ba82-d0a3c73b-96874f47-dac3b701_0] Write session will restart in 0.005335s
2025-09-30T14:56:37.261589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce6ba82-d0a3c73b-96874f47-dac3b701_0] Write session: Do CDS request
2025-09-30T14:56:37.261595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce6ba82-d0a3c73b-96874f47-dac3b701_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:37.261105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:37.261124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:37.261197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2280 reason: error at write: Disconnected sessionId: src_id|4ce6ba82-d0a3c73b-96874f47-dac3b701_0
2025-09-30T14:56:37.261384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2280 sessionId: src_id|4ce6ba82-d0a3c73b-96874f47-dac3b701_0 is DEAD
2025-09-30T14:56:37.261448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896293810013940:3180]
2025-09-30T14:56:37.261466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:37.267731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce6ba82-d0a3c73b-96874f47-dac3b701_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:37.267853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:37.267872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2281
2025-09-30T14:56:37.268039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2281 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:37.268086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2281 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:37.268096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2281 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:37.268101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:37.268538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2281 sessionId:  describe result for acl check
2025-09-30T14:56:37.268576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:37.268579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:37.268580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:37.268591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896293810013956:4041] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:37.269164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896293810013956:4041] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:37.271091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896293810013956:4041] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:37.274433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896293810013956:4041] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:37.274452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896293810013956:4041] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:37.274456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896293810013956:4041] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:37.274464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2281 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:37.275780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:37.277614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:37.277837Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:37.277848Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:37.277858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:37.277918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:37.277960Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896293720240927:10437]
2025-09-30T14:56:37.278630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:37.278984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:37.279062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:37.279461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:37.279565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:37.279573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:37.279574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:37.279576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:37.279577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:37.279578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:37.279580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:37.279581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:37.279582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:37.279583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:37.279585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.279586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.279588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.279589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:37.279590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:37.279596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:37.279607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:37.279611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:37.279614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:37.279618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:37.279622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:37.279626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:37.279629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:37.279633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:37.279639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:37.279642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.279646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.279650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.279654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:37.279657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:37.279667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:37.279676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:37.279683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:37.279689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:37.279694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:37.279701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:37.279706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:37.279711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:37.279716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:37.279722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:37.279727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:37.279732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:37.279737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:37.279742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:37.279754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:37.279759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:37.279776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:37.279787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:37.279791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:37.279797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:37.279801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.279811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.279816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.279821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.279825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.279831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.279835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:37.279840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:37.279846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:37.279852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:37.279896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:37.285732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:37.286713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:37.286732Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:37.286735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:37.286739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:37.286746Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2280 [2:7555896293720240927:10437]
2025-09-30T14:56:37.286764Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:37.286786Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:37.286793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:37.286797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:37.286800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:37.286816Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:37.286828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:37.286836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:37.286897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.286905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.286907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.286911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:37.286913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:37.286983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:37.286991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.287004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.287021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.287041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:37.287064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896293810013941:2454], now have 1 active actors on pipe
2025-09-30T14:56:37.287074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896293810014057:4041], now have 1 active actors on pipe
2025-09-30T14:56:37.287081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896293720240922:10437]
2025-09-30T14:56:37.287084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896293720240922:10437]
2025-09-30T14:56:37.287086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896293720240922:10437]
2025-09-30T14:56:37.287099Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:37.287112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:37.287118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:37.287122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:37.287125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:37.287127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:37.287130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:37.287123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2280
2025-09-30T14:56:37.287165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896293720240922:10437]
2025-09-30T14:56:37.287174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2280
2025-09-30T14:56:37.287177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:37.287190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:37.287219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:37.287228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:37.287297Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4f6d08d-54a6fdf5-1691035c-b52f0034_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:37.287309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:37.287315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:37.287318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:37.287327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:37.287340Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:37.287360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:37.287503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:37.287525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:37.287552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:37.288036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce6ba82-d0a3c73b-96874f47-dac3b701_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d4f6d08d-54a6fdf5-1691035c-b52f0034_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:37.290919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f6d08d-54a6fdf5-1691035c-b52f0034_0] Write session: try to update token
2025-09-30T14:56:37.290939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f6d08d-54a6fdf5-1691035c-b52f0034_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:37.287633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2281 partition: 0 MaxSeqNo: 42 sessionId: src_id|d4f6d08d-54a6fdf5-1691035c-b52f0034_0
2025-09-30T14:56:37.301437Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:37.301461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:37.301463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:37.301465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:37.301476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896293720240922:10437]
2025-09-30T14:56:37.301480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896293720240922:10437]
2025-09-30T14:56:37.301485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896293720240922:10437]
2025-09-30T14:56:37.301527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:37.301533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:37.301539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.301540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:37.301542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:37.301544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:37.301689Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:37.311174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2281 sessionId: src_id|d4f6d08d-54a6fdf5-1691035c-b52f0034_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:37.314110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:37.361888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896293810014072:3180]
2025-09-30T14:56:37.362196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2280, pipe: [1:7555896293810014072:3180]
2025-09-30T14:56:37.421633Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:37.421987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:37.422004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:37.422024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896293810014072:3180], now have 1 active actors on pipe
2025-09-30T14:56:37.422307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896293810014072:3180]
2025-09-30T14:56:37.422322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:37.422351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:37.422265Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:37.422427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2281 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d4f6d08d-54a6fdf5-1691035c-b52f0034_0
2025-09-30T14:56:37.422651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2281 sessionId: src_id|d4f6d08d-54a6fdf5-1691035c-b52f0034_0 is DEAD
2025-09-30T14:56:37.422788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f6d08d-54a6fdf5-1691035c-b52f0034_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:37.422800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f6d08d-54a6fdf5-1691035c-b52f0034_0] Write session will restart in 0.008121s
2025-09-30T14:56:37.422824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f6d08d-54a6fdf5-1691035c-b52f0034_0] Write session: Do CDS request
2025-09-30T14:56:37.422830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f6d08d-54a6fdf5-1691035c-b52f0034_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:37.431790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f6d08d-54a6fdf5-1691035c-b52f0034_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:37.431860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:37.431882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2282
2025-09-30T14:56:37.432027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2282 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:37.432063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2282 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:37.432074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2282 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:37.432079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:37.432534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2282 sessionId:  describe result for acl check
2025-09-30T14:56:37.432575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:37.432584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:37.432586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:37.432592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896293810014138:4043] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:37.433145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896293810014138:4043] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:37.434438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:37.435865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896293810014138:4043] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:37.436465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:37.436679Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:37.436691Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:37.436703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:37.436760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:37.436804Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896293720241045:10439]
2025-09-30T14:56:37.437482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:37.437844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:37.437912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:37.438297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:37.438370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:37.438376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:37.438377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:37.438378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:37.438380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:37.438381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:37.438382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:37.438383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:37.438385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:37.438386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:37.438388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.438389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.438390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.438392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:37.438393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:37.438399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:37.438432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896293810014138:4043] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:37.438449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896293810014138:4043] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:37.438410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:37.438414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:37.438419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:37.438455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896293810014138:4043] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:37.438423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:37.438464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2282 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:37.438428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:37.438432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:37.438436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:37.438440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:37.438444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:37.438448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.438452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.438456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.438460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:37.438464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:37.438471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:37.438479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:37.438485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:37.438492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:37.438498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:37.438503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:37.438507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:37.438511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:37.438516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:37.438522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:37.438527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:37.438531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:37.438536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:37.438541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:37.438546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:37.438551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:37.438559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:37.438565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:37.438571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:37.438577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:37.438581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.438587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.438602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.438609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.438613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.438619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.438624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:37.438630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:37.438635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:37.438640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:37.438682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:37.444548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:37.445457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:37.445474Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:37.445478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:37.445489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:37.445497Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2281 [2:7555896293720241045:10439]
2025-09-30T14:56:37.445514Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:37.445530Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:37.445538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:37.445541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:37.445544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:37.445561Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:37.445573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:37.445585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:37.445645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.445652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.445655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.445659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:37.445662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:37.445742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:37.445750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.445764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.445784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.445808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:37.445831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896293810014192:4043], now have 1 active actors on pipe
2025-09-30T14:56:37.445840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896293810014073:2454], now have 1 active actors on pipe
2025-09-30T14:56:37.445847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896293720241040:10439]
2025-09-30T14:56:37.445853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896293720241040:10439]
2025-09-30T14:56:37.445856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896293720241040:10439]
2025-09-30T14:56:37.445870Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:37.445882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:37.445888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:37.445894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:37.445896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:37.445905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:37.445909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:37.445911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2281
2025-09-30T14:56:37.445945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896293720241040:10439]
2025-09-30T14:56:37.445928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2281
2025-09-30T14:56:37.445954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:37.445957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:37.445974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:37.445983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:37.446030Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d260c259-5abe42e8-a57c7c6c-d1baeee2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:37.446041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:37.446045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:37.446047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:37.446056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:37.446069Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:37.446090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:37.446244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:37.446253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:37.446265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:37.446350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2282 partition: 0 MaxSeqNo: 42 sessionId: src_id|d260c259-5abe42e8-a57c7c6c-d1baeee2_0
2025-09-30T14:56:37.446743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f6d08d-54a6fdf5-1691035c-b52f0034_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d260c259-5abe42e8-a57c7c6c-d1baeee2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:37.449770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d260c259-5abe42e8-a57c7c6c-d1baeee2_0] Write session: try to update token
2025-09-30T14:56:37.449794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d260c259-5abe42e8-a57c7c6c-d1baeee2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:37.458577Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:37.458599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:37.458601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:37.458604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:37.458613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896293720241040:10439]
2025-09-30T14:56:37.458617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896293720241040:10439]
2025-09-30T14:56:37.458621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896293720241040:10439]
2025-09-30T14:56:37.458663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:37.458675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.458675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:37.458681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:37.458682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:37.458685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:37.458873Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:37.465682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2282 sessionId: src_id|d260c259-5abe42e8-a57c7c6c-d1baeee2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:37.468648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:37.522622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896293810014202:3180]
2025-09-30T14:56:37.522937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2281, pipe: [1:7555896293810014202:3180]
2025-09-30T14:56:37.578701Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:37.579217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:37.579236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:37.579273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896293810014202:3180], now have 1 active actors on pipe
2025-09-30T14:56:37.579898Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:37.580447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896293810014202:3180]
2025-09-30T14:56:37.580478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:37.580513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:37.580581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2282 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d260c259-5abe42e8-a57c7c6c-d1baeee2_0
2025-09-30T14:56:37.580759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2282 sessionId: src_id|d260c259-5abe42e8-a57c7c6c-d1baeee2_0 is DEAD
2025-09-30T14:56:37.581204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d260c259-5abe42e8-a57c7c6c-d1baeee2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:37.581216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d260c259-5abe42e8-a57c7c6c-d1baeee2_0] Write session will restart in 0.006457s
2025-09-30T14:56:37.581241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d260c259-5abe42e8-a57c7c6c-d1baeee2_0] Write session: Do CDS request
2025-09-30T14:56:37.581247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d260c259-5abe42e8-a57c7c6c-d1baeee2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:37.588783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d260c259-5abe42e8-a57c7c6c-d1baeee2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:37.588898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:37.588922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2283
2025-09-30T14:56:37.589319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2283 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:37.589366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2283 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:37.589380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2283 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:37.589385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:37.589898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2283 sessionId:  describe result for acl check
2025-09-30T14:56:37.589939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:37.589947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:37.589949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:37.589955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896293810014258:4074] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:37.590485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896293810014258:4074] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:37.592653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896293810014258:4074] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:37.593257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:37.596137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896293810014258:4074] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:37.596160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896293810014258:4074] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:37.596163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896293810014258:4074] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:37.596172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2283 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:37.595672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:37.595957Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:37.595962Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:37.595977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:37.596133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:37.596202Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896293720241204:10450]
2025-09-30T14:56:37.596848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:37.597169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:37.597218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:37.597555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:37.597623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:37.597629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:37.597630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:37.597631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:37.597633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:37.597634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:37.597635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:37.597637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:37.597638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:37.597639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:37.597641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.597642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.597643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.597644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:37.597645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:37.597651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:37.597660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:37.597664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:37.597668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:37.597671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:37.597676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:37.597679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:37.597683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:37.597687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:37.597691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:37.597695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.597698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.597702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.597705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:37.597709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:37.597717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:37.597726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:37.597732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:37.597737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:37.597742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:37.597747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:37.597752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:37.597757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:37.597762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:37.597767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:37.597772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:37.597777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:37.597783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:37.597788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:37.597794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:37.597804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:37.597809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:37.597813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:37.597822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:37.597828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:37.597832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.597837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.597841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.597851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.597856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.597860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.597867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:37.597876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:37.597880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:37.597885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:37.597933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:37.607230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:37.608427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:37.608446Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:37.608449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:37.608453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:37.608461Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2282 [2:7555896293720241204:10450]
2025-09-30T14:56:37.608478Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:37.608498Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:37.608506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:37.608509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:37.608511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:37.608529Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:37.608544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:37.608563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:37.608633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.608636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.608638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.608641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:37.608644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:37.608719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:37.608729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.608746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.608764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.608789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:37.608806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896293720241198:10450]
2025-09-30T14:56:37.608809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896293720241198:10450]
2025-09-30T14:56:37.608812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896293720241198:10450]
2025-09-30T14:56:37.608827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:37.608842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:37.608861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:37.608864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:37.608910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896293720241198:10450]
2025-09-30T14:56:37.608910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:37.608914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:37.608917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:37.608917Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:37.608925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:37.609131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896293810014227:2454], now have 1 active actors on pipe
2025-09-30T14:56:37.609141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896293810014342:4074], now have 1 active actors on pipe
2025-09-30T14:56:37.609183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2282
2025-09-30T14:56:37.609210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2282
2025-09-30T14:56:37.609350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:37.609363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:37.609390Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db4f5c02-4cad1793-b281df27-26a41198_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:37.609399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:37.609403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:37.609405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:37.609417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:37.609429Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:37.609447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:37.609683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:37.609693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:37.609713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:37.609845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2283 partition: 0 MaxSeqNo: 42 sessionId: src_id|db4f5c02-4cad1793-b281df27-26a41198_0
2025-09-30T14:56:37.610230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d260c259-5abe42e8-a57c7c6c-d1baeee2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|db4f5c02-4cad1793-b281df27-26a41198_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:37.613206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db4f5c02-4cad1793-b281df27-26a41198_0] Write session: try to update token
2025-09-30T14:56:37.613229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db4f5c02-4cad1793-b281df27-26a41198_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:37.622771Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:37.622798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:37.622807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896293720241198:10450]
2025-09-30T14:56:37.622852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:37.622862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:37.623046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:37.623210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:37.623396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:37.623561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:37.623780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:37.623833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:37.633513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2283 sessionId: src_id|db4f5c02-4cad1793-b281df27-26a41198_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:37.636678Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:37.636701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:37.636703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:37.636705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:37.636715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896293720241198:10450]
2025-09-30T14:56:37.636722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896293720241198:10450]
2025-09-30T14:56:37.636726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896293720241198:10450]
2025-09-30T14:56:37.636766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:37.636772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:37.636774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:37.636776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:37.636784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:37.636802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:37.636813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.636816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:37.637002Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:37.636446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:37.680842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896293810014357:3180]
2025-09-30T14:56:37.681224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2282, pipe: [1:7555896293810014357:3180]
2025-09-30T14:56:37.754004Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:37.754448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896293810014357:3180], now have 1 active actors on pipe
2025-09-30T14:56:37.754744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896293810014357:3180]
2025-09-30T14:56:37.754751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:37.754784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:37.754868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2283 reason: status is not ok: tablet will be restarted right now sessionId: src_id|db4f5c02-4cad1793-b281df27-26a41198_0
2025-09-30T14:56:37.755058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2283 sessionId: src_id|db4f5c02-4cad1793-b281df27-26a41198_0 is DEAD
2025-09-30T14:56:37.754721Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:37.755198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db4f5c02-4cad1793-b281df27-26a41198_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:37.755211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db4f5c02-4cad1793-b281df27-26a41198_0] Write session will restart in 0.005792s
2025-09-30T14:56:37.755234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db4f5c02-4cad1793-b281df27-26a41198_0] Write session: Do CDS request
2025-09-30T14:56:37.755239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db4f5c02-4cad1793-b281df27-26a41198_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:37.761761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db4f5c02-4cad1793-b281df27-26a41198_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:37.761898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:37.761916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2284
2025-09-30T14:56:37.762044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2284 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:37.762075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2284 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:37.762086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2284 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:37.762089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:37.762539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2284 sessionId:  describe result for acl check
2025-09-30T14:56:37.762581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:37.762588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:37.762590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:37.762595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896293810014367:4070] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:37.763134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896293810014367:4070] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:37.765231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896293810014367:4070] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:37.767976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896293810014367:4070] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:37.767998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896293810014367:4070] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:37.768002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896293810014367:4070] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:37.768009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2284 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:37.770135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:37.772132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:37.772338Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:37.772346Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:37.772356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:37.772417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:37.772462Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896293720241327:10456]
2025-09-30T14:56:37.773116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:37.773438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:37.773491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:37.773828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:37.773898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:37.773904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:37.773905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:37.773907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:37.773908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:37.773909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:37.773911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:37.773912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:37.773914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:37.773915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:37.773917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.773918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.773919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.773920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:37.773922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:37.773927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:37.773936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:37.773941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:37.773945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:37.773950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:37.773954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:37.773958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:37.773962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:37.773966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:37.773971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:37.773975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.773979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.773983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.773987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:37.773991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:37.773999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:37.774008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:37.774014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:37.774019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:37.774024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:37.774028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:37.774033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:37.774037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:37.774042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:37.774047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:37.774051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:37.774056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:37.774060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:37.774066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:37.774070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:37.774074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:37.774079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:37.774083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:37.774090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:37.774100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:37.774105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.774113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.774117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.774137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.774142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.774146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.774150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:37.774155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:37.774160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:37.774165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:37.774211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:37.779960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:37.781094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:37.781116Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:37.781120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:37.781124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:37.781131Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2283 [2:7555896293720241327:10456]
2025-09-30T14:56:37.781147Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:37.781165Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:37.781168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:37.781171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:37.781173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:37.781191Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:37.781203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:37.781210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:37.781293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.781301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.781303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.781307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:37.781309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:37.781402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:37.781409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.781421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.781428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.781437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:37.781452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896293720241322:10456]
2025-09-30T14:56:37.781457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896293720241322:10456]
2025-09-30T14:56:37.781458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896293720241322:10456]
2025-09-30T14:56:37.781465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:37.781477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:37.781479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896293810014453:4070], now have 1 active actors on pipe
2025-09-30T14:56:37.781481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:37.781483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896293810014359:2454], now have 1 active actors on pipe
2025-09-30T14:56:37.781483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:37.781491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:37.781506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:37.781513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:37.781544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896293720241322:10456]
2025-09-30T14:56:37.781553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:37.781561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:37.781612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2283
2025-09-30T14:56:37.781611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2283
2025-09-30T14:56:37.781710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:37.781723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:37.781764Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df91e826-c18b9b31-7bc1aed7-5ff26a46_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:37.781781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:37.781786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:37.781788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:37.781799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:37.781825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:37.781852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:37.782047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:37.782058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:37.782074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:37.782158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2284 partition: 0 MaxSeqNo: 42 sessionId: src_id|df91e826-c18b9b31-7bc1aed7-5ff26a46_0
2025-09-30T14:56:37.782520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db4f5c02-4cad1793-b281df27-26a41198_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|df91e826-c18b9b31-7bc1aed7-5ff26a46_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:37.785568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df91e826-c18b9b31-7bc1aed7-5ff26a46_0] Write session: try to update token
2025-09-30T14:56:37.785591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df91e826-c18b9b31-7bc1aed7-5ff26a46_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:37.794466Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:37.794489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:37.794500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896293720241322:10456]
2025-09-30T14:56:37.794543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:37.794546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:37.794751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:37.794980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:37.795146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:37.795341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:37.795570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:37.795612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:37.801799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2284 sessionId: src_id|df91e826-c18b9b31-7bc1aed7-5ff26a46_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:37.804768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:37.806128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:37.806151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:37.806174Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:37.806177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:37.806180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:37.806181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:37.806193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896293720241322:10456]
2025-09-30T14:56:37.806198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896293720241322:10456]
2025-09-30T14:56:37.806203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896293720241322:10456]
2025-09-30T14:56:37.806250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:37.806249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:37.806255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:37.806259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:37.806261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.806263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:37.806428Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:37.854917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896293810014489:3180]
2025-09-30T14:56:37.855308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2283, pipe: [1:7555896293810014489:3180]
2025-09-30T14:56:37.919970Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:37.920255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:37.920293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896293810014489:3180], now have 1 active actors on pipe
2025-09-30T14:56:37.920411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:37.920518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896293810014489:3180]
2025-09-30T14:56:37.920560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:37.932369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:37.932390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:37.932418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2284 reason: error at write: Disconnected sessionId: src_id|df91e826-c18b9b31-7bc1aed7-5ff26a46_0
2025-09-30T14:56:37.932571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2284 sessionId: src_id|df91e826-c18b9b31-7bc1aed7-5ff26a46_0 is DEAD
2025-09-30T14:56:37.932709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df91e826-c18b9b31-7bc1aed7-5ff26a46_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:37.932720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df91e826-c18b9b31-7bc1aed7-5ff26a46_0] Write session will restart in 0.008497s
2025-09-30T14:56:37.932748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df91e826-c18b9b31-7bc1aed7-5ff26a46_0] Write session: Do CDS request
2025-09-30T14:56:37.932753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df91e826-c18b9b31-7bc1aed7-5ff26a46_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:37.939437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:37.941385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:37.941585Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:37.941595Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:37.941606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:37.941656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:37.941761Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896293720241463:10459]
2025-09-30T14:56:37.942433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:37.942758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df91e826-c18b9b31-7bc1aed7-5ff26a46_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:37.942796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:37.942848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:37.942858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:37.942886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2285
2025-09-30T14:56:37.943029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2285 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:37.943064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2285 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:37.943071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2285 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:37.943075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:37.943191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:37.943277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:37.943283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:37.943284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:37.943286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:37.943288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:37.943289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:37.943290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:37.943292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:37.943293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:37.943295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:37.943296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.943298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.943299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.943300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:37.943302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:37.943307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:37.943316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:37.943320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:37.943324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:37.943328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:37.943333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:37.943337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:37.943342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:37.943346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:37.943350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:37.943354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.943359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.943363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.943367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:37.943371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:37.943378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:37.943386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:37.943393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:37.943399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:37.943404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:37.943410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:37.943415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:37.943421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:37.943426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:37.943432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:37.943436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:37.943442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:37.943447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:37.943453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:37.943457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:37.943469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:37.943475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:37.943484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:37.943489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:37.943499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:37.943504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.943508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.943514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.943518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.943520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.943524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.943526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:37.943507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2285 sessionId:  describe result for acl check
2025-09-30T14:56:37.943530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:37.943533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:37.943537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:37.943546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:37.943563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:37.943553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:37.943558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:37.943563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896293810014579:4081] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:37.944086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896293810014579:4081] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:37.946276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896293810014579:4081] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:37.949340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:37.949439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896293810014579:4081] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:37.949458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896293810014579:4081] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:37.949462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896293810014579:4081] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:37.949470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2285 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:37.950414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:37.950435Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:37.950438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:37.950442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:37.950449Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2284 [2:7555896293720241463:10459]
2025-09-30T14:56:37.950465Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:37.950482Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:37.950485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:37.950488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:37.950491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:37.950506Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:37.950513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:37.950530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:37.950591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.950593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.950596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.950600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:37.950602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:37.950671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:37.950673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.950686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:37.950696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:37.950710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:37.950727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896293720241458:10459]
2025-09-30T14:56:37.950730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896293720241458:10459]
2025-09-30T14:56:37.950733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896293720241458:10459]
2025-09-30T14:56:37.950740Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:37.950754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:37.950768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:37.950772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:37.950807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896293720241458:10459]
2025-09-30T14:56:37.950810Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:37.950888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:37.950892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:37.950895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:37.950901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:37.951133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896293810014490:2454], now have 1 active actors on pipe
2025-09-30T14:56:37.951147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896293810014615:4081], now have 1 active actors on pipe
2025-09-30T14:56:37.951140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2284
2025-09-30T14:56:37.951162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2284
2025-09-30T14:56:37.951304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:37.951318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:37.951347Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5426078f-a57c6c99-865a8452-f06d276d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:37.951364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:37.951369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:37.951371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:37.951392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:37.951404Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:37.951420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:37.951633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:37.951647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:37.951663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:37.951734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2285 partition: 0 MaxSeqNo: 42 sessionId: src_id|5426078f-a57c6c99-865a8452-f06d276d_0
2025-09-30T14:56:37.952076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df91e826-c18b9b31-7bc1aed7-5ff26a46_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5426078f-a57c6c99-865a8452-f06d276d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:37.954929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5426078f-a57c6c99-865a8452-f06d276d_0] Write session: try to update token
2025-09-30T14:56:37.954950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5426078f-a57c6c99-865a8452-f06d276d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:37.963556Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:37.963578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:37.963589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896293720241458:10459]
2025-09-30T14:56:37.963641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:37.963644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:37.963856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:37.964012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:37.964168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:37.964331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:37.964536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:37.964589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:37.970079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2285 sessionId: src_id|5426078f-a57c6c99-865a8452-f06d276d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:37.972958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:37.974319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:37.974343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:37.974364Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:37.974367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:37.974370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:37.974372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:37.974385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896293720241458:10459]
2025-09-30T14:56:37.974389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896293720241458:10459]
2025-09-30T14:56:37.974392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896293720241458:10459]
2025-09-30T14:56:37.974437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:37.974438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:37.974445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:37.974446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:37.974447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:37.974449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:37.974580Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:38.020846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896298104981919:3180]
2025-09-30T14:56:38.021190Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2284, pipe: [1:7555896298104981919:3180]
2025-09-30T14:56:38.087970Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:38.088432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:38.088470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896298104981919:3180], now have 1 active actors on pipe
2025-09-30T14:56:38.088619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:38.088759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:38.088767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:38.088843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2285 reason: error at write: Disconnected sessionId: src_id|5426078f-a57c6c99-865a8452-f06d276d_0
2025-09-30T14:56:38.089034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2285 sessionId: src_id|5426078f-a57c6c99-865a8452-f06d276d_0 is DEAD
2025-09-30T14:56:38.089112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:38.089149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5426078f-a57c6c99-865a8452-f06d276d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:38.089160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5426078f-a57c6c99-865a8452-f06d276d_0] Write session will restart in 0.008154s
2025-09-30T14:56:38.089167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896298104981919:3180]
2025-09-30T14:56:38.089186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5426078f-a57c6c99-865a8452-f06d276d_0] Write session: Do CDS request
2025-09-30T14:56:38.089192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5426078f-a57c6c99-865a8452-f06d276d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:38.098727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5426078f-a57c6c99-865a8452-f06d276d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:38.098777Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:38.098798Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2286
2025-09-30T14:56:38.099005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2286 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:38.099043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2286 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:38.099049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2286 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:38.099053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:38.100526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2286 sessionId:  describe result for acl check
2025-09-30T14:56:38.100568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:38.100571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:38.100573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:38.100579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896298104982018:4086] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:38.101259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896298104982018:4086] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:38.102019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:38.103863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896298104982018:4086] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:38.104981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:38.105198Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:38.105207Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:38.105218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:38.105292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:38.105335Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896298015208883:10462]
2025-09-30T14:56:38.106021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:38.106600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896298104982018:4086] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:38.106618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896298104982018:4086] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:38.106621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896298104982018:4086] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:38.106629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2286 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:38.107052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:38.107103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:38.107455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:38.107588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:38.107597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:38.107598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:38.107600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:38.107602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:38.107603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:38.107604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:38.107605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:38.107607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:38.107607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:38.107609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.107610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.107611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.107612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:38.107613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:38.107619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:38.107628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:38.107632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:38.107636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:38.107639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:38.107643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:38.107648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:38.107651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:38.107655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:38.107660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:38.107664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.107667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.107671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.107675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:38.107679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:38.107688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:38.107696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:38.107701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:38.107706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:38.107711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:38.107716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:38.107720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:38.107725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:38.107743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:38.107753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:38.107758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:38.107763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:38.107768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:38.107775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:38.107780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:38.107790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:38.107794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:38.107804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:38.107808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:38.107814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:38.107823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.107828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.107838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.107843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.107848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.107857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.107861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:38.107866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:38.107875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:38.107879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:38.107918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:38.113834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:38.115285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:38.115303Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:38.115307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:38.115311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:38.115319Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2285 [2:7555896298015208883:10462]
2025-09-30T14:56:38.115338Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:38.115356Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:38.115359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:38.115363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:38.115365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:38.115383Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:38.115400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:38.115408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:38.115477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.115486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.115489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.115493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:38.115496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:38.115569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:38.115582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.115598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.115611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.115629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:38.115649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896298104982055:4086], now have 1 active actors on pipe
2025-09-30T14:56:38.115659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896298104981932:2454], now have 1 active actors on pipe
2025-09-30T14:56:38.115666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896298015208878:10462]
2025-09-30T14:56:38.115668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896298015208878:10462]
2025-09-30T14:56:38.115671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896298015208878:10462]
2025-09-30T14:56:38.115685Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:38.115703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:38.115706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:38.115710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:38.115712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:38.115725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:38.115728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:38.115771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2285
2025-09-30T14:56:38.115816Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2285
2025-09-30T14:56:38.115764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896298015208878:10462]
2025-09-30T14:56:38.115775Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:38.115797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:38.115930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:38.115936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:38.115973Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df5e31db-ed37f47f-fba7120c-ddb87702_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:38.115986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:38.115990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:38.115993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:38.116004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:38.116015Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:38.116179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:38.116382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:38.116391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:38.116405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:38.116505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2286 partition: 0 MaxSeqNo: 42 sessionId: src_id|df5e31db-ed37f47f-fba7120c-ddb87702_0
2025-09-30T14:56:38.116919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5426078f-a57c6c99-865a8452-f06d276d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|df5e31db-ed37f47f-fba7120c-ddb87702_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:38.119870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df5e31db-ed37f47f-fba7120c-ddb87702_0] Write session: try to update token
2025-09-30T14:56:38.119892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df5e31db-ed37f47f-fba7120c-ddb87702_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:38.130328Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:38.130354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:38.130357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:38.130359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:38.130370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896298015208878:10462]
2025-09-30T14:56:38.130375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896298015208878:10462]
2025-09-30T14:56:38.130380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896298015208878:10462]
2025-09-30T14:56:38.130425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:38.130433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.130433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:38.130435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:38.130440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:38.130444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:38.130626Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:38.137272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2286 sessionId: src_id|df5e31db-ed37f47f-fba7120c-ddb87702_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:38.140216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:38.189266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896298104982071:3180]
2025-09-30T14:56:38.189612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2285, pipe: [1:7555896298104982071:3180]
2025-09-30T14:56:38.250133Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:38.250546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:38.250562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:38.250605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896298104982071:3180], now have 1 active actors on pipe
2025-09-30T14:56:38.250929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896298104982071:3180]
2025-09-30T14:56:38.250967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:38.250971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:38.251054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2286 reason: status is not ok: tablet will be restarted right now sessionId: src_id|df5e31db-ed37f47f-fba7120c-ddb87702_0
2025-09-30T14:56:38.250852Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:38.251278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2286 sessionId: src_id|df5e31db-ed37f47f-fba7120c-ddb87702_0 is DEAD
2025-09-30T14:56:38.251414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df5e31db-ed37f47f-fba7120c-ddb87702_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:38.251427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df5e31db-ed37f47f-fba7120c-ddb87702_0] Write session will restart in 0.007676s
2025-09-30T14:56:38.251452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df5e31db-ed37f47f-fba7120c-ddb87702_0] Write session: Do CDS request
2025-09-30T14:56:38.251458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df5e31db-ed37f47f-fba7120c-ddb87702_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:38.260813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df5e31db-ed37f47f-fba7120c-ddb87702_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:38.260926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:38.260948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2287
2025-09-30T14:56:38.261086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2287 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:38.261119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2287 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:38.261130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2287 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:38.261134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:38.261552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2287 sessionId:  describe result for acl check
2025-09-30T14:56:38.261586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:38.261589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:38.261592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:38.261598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896298104982109:4101] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:38.262148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896298104982109:4101] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:38.264749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896298104982109:4101] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:38.265399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:38.267548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:38.267794Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:38.267807Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:38.267820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:38.267880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:38.267937Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896298015209008:10464]
2025-09-30T14:56:38.267981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896298104982109:4101] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:38.268006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896298104982109:4101] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:38.268011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896298104982109:4101] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:38.268022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2287 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:38.268610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:38.269015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:38.269070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:38.269464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:38.269540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:38.269547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:38.269549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:38.269550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:38.269551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:38.269553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:38.269554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:38.269556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:38.269557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:38.269559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:38.269560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.269561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.269563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.269564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:38.269565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:38.269572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:38.269584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:38.269588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:38.269593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:38.269597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:38.269601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:38.269605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:38.269610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:38.269615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:38.269619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:38.269623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.269628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.269632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.269636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:38.269641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:38.269648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:38.269657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:38.269663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:38.269669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:38.269673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:38.269678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:38.269683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:38.269689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:38.269694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:38.269700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:38.269706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:38.269713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:38.269725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:38.269731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:38.269735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:38.269759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:38.269768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:38.269774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:38.269783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:38.269789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:38.269799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.269804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.269813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.269819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.269829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.269834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.269843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:38.269848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:38.269854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:38.269864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:38.269919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:38.275798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:38.276920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:38.276940Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:38.276944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:38.276948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:38.276955Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2286 [2:7555896298015209008:10464]
2025-09-30T14:56:38.276975Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:38.276991Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:38.276995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:38.276998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:38.277000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:38.277018Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:38.277026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:38.277033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:38.277105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.277113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.277117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.277120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:38.277123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:38.277198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:38.277206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.277219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.277236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.277261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:38.277300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896298104982075:2454], now have 1 active actors on pipe
2025-09-30T14:56:38.277307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896298104982199:4101], now have 1 active actors on pipe
2025-09-30T14:56:38.277313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896298015209003:10464]
2025-09-30T14:56:38.277315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896298015209003:10464]
2025-09-30T14:56:38.277317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896298015209003:10464]
2025-09-30T14:56:38.277336Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:38.277357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:38.277359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:38.277363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:38.277365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:38.277378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:38.277381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:38.277421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896298015209003:10464]
2025-09-30T14:56:38.277437Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:38.277460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:38.277477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:38.277482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:38.277510Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e76a82dc-2a796454-d38358a-e3a56374_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:38.277529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:38.277533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:38.277535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:38.277545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:38.277556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:38.277571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:38.277855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:38.277866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:38.277880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:38.278325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df5e31db-ed37f47f-fba7120c-ddb87702_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e76a82dc-2a796454-d38358a-e3a56374_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:38.277368Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2286
2025-09-30T14:56:38.277430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2286
2025-09-30T14:56:38.277960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2287 partition: 0 MaxSeqNo: 42 sessionId: src_id|e76a82dc-2a796454-d38358a-e3a56374_0
2025-09-30T14:56:38.281179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e76a82dc-2a796454-d38358a-e3a56374_0] Write session: try to update token
2025-09-30T14:56:38.281199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e76a82dc-2a796454-d38358a-e3a56374_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:38.291005Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:38.291028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:38.291038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896298015209003:10464]
2025-09-30T14:56:38.291079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:38.291082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:38.291414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:38.291570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:38.291716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:38.291862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:38.292070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:38.292120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:38.298055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2287 sessionId: src_id|e76a82dc-2a796454-d38358a-e3a56374_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:38.301097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:38.301474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:38.301501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:38.301544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:38.301666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:38.303753Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:38.303775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:38.303778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:38.303780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:38.303792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896298015209003:10464]
2025-09-30T14:56:38.303796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896298015209003:10464]
2025-09-30T14:56:38.303801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896298015209003:10464]
2025-09-30T14:56:38.303844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:38.303854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.303857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:38.303858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:38.303867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:38.303871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:38.304004Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:38.351175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896298104982211:3180]
2025-09-30T14:56:38.351809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2286, pipe: [1:7555896298104982211:3180]
2025-09-30T14:56:38.420859Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:38.429638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:38.429671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:38.429870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:38.429949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:38.430025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:38.430099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:38.430154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:38.430168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:38.430241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:38.430310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:38.430380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:38.430458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:38.430503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:38.430506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:38.430584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:38.430649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:38.430715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:38.430782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:38.431487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:38.431502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:38.434073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:38.434092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:38.434092Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:38.434126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2287 reason: error at write: Disconnected sessionId: src_id|e76a82dc-2a796454-d38358a-e3a56374_0
2025-09-30T14:56:38.434142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896298104982211:3180]
2025-09-30T14:56:38.434521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e76a82dc-2a796454-d38358a-e3a56374_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:38.434532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e76a82dc-2a796454-d38358a-e3a56374_0] Write session will restart in 0.006901s
2025-09-30T14:56:38.434559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e76a82dc-2a796454-d38358a-e3a56374_0] Write session: Do CDS request
2025-09-30T14:56:38.434564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e76a82dc-2a796454-d38358a-e3a56374_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:38.434314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2287 sessionId: src_id|e76a82dc-2a796454-d38358a-e3a56374_0 is DEAD
2025-09-30T14:56:38.431584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:38.431663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:38.431721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:38.431778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:38.431816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:38.431819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:38.431892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:38.431953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:38.432016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:38.432089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:38.432136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:38.432139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:38.432218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:38.432273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:38.432334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:38.432400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:38.432452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:38.432455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:38.432530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:38.432594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:38.432665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:38.432734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:38.432774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:38.432776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:38.432848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:38.432911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:38.432977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:38.433041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:38.433086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:38.433089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:38.433163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:38.433224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:38.433304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:38.433367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:38.433407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:38.433409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:38.433481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:38.433542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:38.433600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:38.433668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:38.433715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:38.433725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:38.433802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896298104982211:3180], now have 1 active actors on pipe
2025-09-30T14:56:38.434428Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:38.442886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e76a82dc-2a796454-d38358a-e3a56374_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:38.443020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:38.443039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2288
2025-09-30T14:56:38.443429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2288 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:38.443476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2288 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:38.443489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2288 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:38.443494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:38.444001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2288 sessionId:  describe result for acl check
2025-09-30T14:56:38.444039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:38.444048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:38.444049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:38.444056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896298104982228:4107] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:38.444605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896298104982228:4107] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:38.449062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:38.451745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896298104982228:4107] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:38.451991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:38.452210Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:38.452225Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:38.452237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:38.452301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:38.452344Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896298015209134:10466]
2025-09-30T14:56:38.452978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:38.453352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:38.453406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:38.453747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:38.453813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:38.453819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:38.453821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:38.453822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:38.453823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:38.453824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:38.453825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:38.453827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:38.453828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:38.453829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:38.453830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.453831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.453832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.453833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:38.453834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:38.453840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:38.453850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:38.453853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:38.453857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:38.453860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:38.453864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:38.453867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:38.453870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:38.453874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:38.453878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:38.453882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.453885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.453888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.453891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:38.453895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:38.453903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:38.453910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:38.453915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:38.453920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:38.453924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:38.453929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:38.453936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:38.453940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:38.453945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:38.453949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:38.453953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:38.453958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:38.453963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:38.453967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:38.453971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:38.453975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:38.453981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:38.453985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:38.453989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:38.453993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:38.453997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.454004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.454009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.454013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.454017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.454022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.454026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:38.454031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:38.454036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:38.454040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:38.454081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:38.454821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896298104982228:4107] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:38.454845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896298104982228:4107] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:38.454850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896298104982228:4107] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:38.454860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2288 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:38.460955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:38.462126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:38.462149Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:38.462152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:38.462156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:38.462164Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2287 [2:7555896298015209134:10466]
2025-09-30T14:56:38.462183Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:38.462200Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:38.462203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:38.462207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:38.462210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:38.462227Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:38.462244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:38.462252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:38.462330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.462339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.462341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.462347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:38.462351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:38.462424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:38.462435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.462447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.462458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.462473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:38.462495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896298104982340:4107], now have 1 active actors on pipe
2025-09-30T14:56:38.462498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896298104982213:2454], now have 1 active actors on pipe
2025-09-30T14:56:38.462504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896298015209128:10466]
2025-09-30T14:56:38.462506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896298015209128:10466]
2025-09-30T14:56:38.462508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896298015209128:10466]
2025-09-30T14:56:38.462516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:38.462522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:38.462525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:38.462526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:38.462531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:38.462546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:38.462549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:38.462585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896298015209128:10466]
2025-09-30T14:56:38.462592Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:38.462598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:38.462643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:38.462598Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2287
2025-09-30T14:56:38.462648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:38.462600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2287
2025-09-30T14:56:38.462679Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18be3257-aec8e7df-4a37f275-aa2692a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:38.462690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:38.462694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:38.462696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:38.462710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:38.462719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:38.462733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:38.462940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:38.462950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:38.462966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:38.463056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2288 partition: 0 MaxSeqNo: 42 sessionId: src_id|18be3257-aec8e7df-4a37f275-aa2692a7_0
2025-09-30T14:56:38.463674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e76a82dc-2a796454-d38358a-e3a56374_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|18be3257-aec8e7df-4a37f275-aa2692a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:38.466821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18be3257-aec8e7df-4a37f275-aa2692a7_0] Write session: try to update token
2025-09-30T14:56:38.466842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18be3257-aec8e7df-4a37f275-aa2692a7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:38.476628Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:38.476651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:38.476654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:38.476656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:38.476671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896298015209128:10466]
2025-09-30T14:56:38.476676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896298015209128:10466]
2025-09-30T14:56:38.476680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896298015209128:10466]
2025-09-30T14:56:38.476721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:38.476728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.476731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:38.476734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:38.476742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:38.476748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:38.476892Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:38.486322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2288 sessionId: src_id|18be3257-aec8e7df-4a37f275-aa2692a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:38.489302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:38.534341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896298104982348:3180]
2025-09-30T14:56:38.534671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2287, pipe: [1:7555896298104982348:3180]
2025-09-30T14:56:38.594706Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:38.595025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:38.595043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:38.595064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896298104982348:3180], now have 1 active actors on pipe
2025-09-30T14:56:38.595340Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:38.595669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896298104982348:3180]
2025-09-30T14:56:38.595726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:38.595806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2288 reason: status is not ok: tablet will be restarted right now sessionId: src_id|18be3257-aec8e7df-4a37f275-aa2692a7_0
2025-09-30T14:56:38.596000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2288 sessionId: src_id|18be3257-aec8e7df-4a37f275-aa2692a7_0 is DEAD
2025-09-30T14:56:38.596169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18be3257-aec8e7df-4a37f275-aa2692a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:38.596182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18be3257-aec8e7df-4a37f275-aa2692a7_0] Write session will restart in 0.005315s
2025-09-30T14:56:38.596208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18be3257-aec8e7df-4a37f275-aa2692a7_0] Write session: Do CDS request
2025-09-30T14:56:38.596224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18be3257-aec8e7df-4a37f275-aa2692a7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:38.596208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:38.603015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18be3257-aec8e7df-4a37f275-aa2692a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:38.603119Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:38.603138Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2289
2025-09-30T14:56:38.603267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2289 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:38.603299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2289 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:38.603308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2289 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:38.603312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:38.603719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2289 sessionId:  describe result for acl check
2025-09-30T14:56:38.603752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:38.603760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:38.603762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:38.603768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896298104982377:4124] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:38.604323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896298104982377:4124] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:38.609161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896298104982377:4124] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:38.610102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:38.611913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:38.612116Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:38.612127Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:38.612138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:38.612191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:38.612236Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896298015209276:10475]
2025-09-30T14:56:38.612290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896298104982377:4124] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:38.612312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896298104982377:4124] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:38.612316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896298104982377:4124] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:38.612324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2289 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:38.612891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:38.613198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:38.613249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:38.613577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:38.613649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:38.613655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:38.613656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:38.613658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:38.613659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:38.613660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:38.613662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:38.613663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:38.613664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:38.613665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:38.613667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.613668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.613669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.613670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:38.613671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:38.613676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:38.613687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:38.613692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:38.613697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:38.613701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:38.613705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:38.613708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:38.613711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:38.613714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:38.613718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:38.613721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.613724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.613727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.613731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:38.613735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:38.613743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:38.613749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:38.613755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:38.613761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:38.613767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:38.613771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:38.613775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:38.613780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:38.613785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:38.613790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:38.613795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:38.613800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:38.613805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:38.613810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:38.613814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:38.613820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:38.613824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:38.613830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:38.613839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:38.613844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:38.613855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.613861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.613869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.613874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.613878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.613882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.613886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:38.613900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:38.613905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:38.613909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:38.613957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:38.619738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:38.620639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:38.620660Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:38.620663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:38.620668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:38.620675Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2288 [2:7555896298015209276:10475]
2025-09-30T14:56:38.620692Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:38.620709Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:38.620722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:38.620725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:38.620728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:38.620745Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:38.620751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:38.620758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:38.620819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.620829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.620831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.620835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:38.620837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:38.621060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:38.621070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.621084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.621099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.621125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:38.621148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896298104982484:4124], now have 1 active actors on pipe
2025-09-30T14:56:38.621157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896298104982362:2454], now have 1 active actors on pipe
2025-09-30T14:56:38.621164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896298015209271:10475]
2025-09-30T14:56:38.621166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896298015209271:10475]
2025-09-30T14:56:38.621169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896298015209271:10475]
2025-09-30T14:56:38.621092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2288
2025-09-30T14:56:38.621133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2288
2025-09-30T14:56:38.621181Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:38.621200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:38.621202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:38.621204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:38.621205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:38.621210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:38.621227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:38.621246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:38.621254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:38.621310Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b17a78d9-7bc16c13-12221029-e03219ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:38.621321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:38.621326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:38.621333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:38.621342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:38.621356Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:38.621367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896298015209271:10475]
2025-09-30T14:56:38.621377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:38.621393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:38.621407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:38.621923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:38.621936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:38.621954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:38.622075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2289 partition: 0 MaxSeqNo: 42 sessionId: src_id|b17a78d9-7bc16c13-12221029-e03219ba_0
2025-09-30T14:56:38.622481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18be3257-aec8e7df-4a37f275-aa2692a7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b17a78d9-7bc16c13-12221029-e03219ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:38.626249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b17a78d9-7bc16c13-12221029-e03219ba_0] Write session: try to update token
2025-09-30T14:56:38.626281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b17a78d9-7bc16c13-12221029-e03219ba_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:38.635856Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:38.635879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:38.635888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896298015209271:10475]
2025-09-30T14:56:38.635924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:38.635933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:38.636113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:38.636266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:38.636421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:38.636578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:38.636865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:38.636910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:38.645134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2289 sessionId: src_id|b17a78d9-7bc16c13-12221029-e03219ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:38.648025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:38.648812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:38.648842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:38.648862Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:38.648865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:38.648867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:38.648869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:38.648878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896298015209271:10475]
2025-09-30T14:56:38.648883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896298015209271:10475]
2025-09-30T14:56:38.648890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896298015209271:10475]
2025-09-30T14:56:38.648929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:38.648939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:38.648948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.648950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:38.648952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:38.648956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:38.649087Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:38.696101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896298104982508:3180]
2025-09-30T14:56:38.696430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2288, pipe: [1:7555896298104982508:3180]
2025-09-30T14:56:38.769326Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:38.769683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:38.769741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896298104982508:3180], now have 1 active actors on pipe
2025-09-30T14:56:38.769870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:38.770052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896298104982508:3180]
2025-09-30T14:56:38.770079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:38.782120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b17a78d9-7bc16c13-12221029-e03219ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:38.782136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b17a78d9-7bc16c13-12221029-e03219ba_0] Write session will restart in 0.005367s
2025-09-30T14:56:38.782161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b17a78d9-7bc16c13-12221029-e03219ba_0] Write session: Do CDS request
2025-09-30T14:56:38.782167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b17a78d9-7bc16c13-12221029-e03219ba_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:38.781733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:38.781752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:38.781775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2289 reason: error at write: Disconnected sessionId: src_id|b17a78d9-7bc16c13-12221029-e03219ba_0
2025-09-30T14:56:38.781942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2289 sessionId: src_id|b17a78d9-7bc16c13-12221029-e03219ba_0 is DEAD
2025-09-30T14:56:38.788803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b17a78d9-7bc16c13-12221029-e03219ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:38.793629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:38.791432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:38.791452Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2290
2025-09-30T14:56:38.791612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2290 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:38.791640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2290 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:38.791646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2290 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:38.791651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:38.793042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2290 sessionId:  describe result for acl check
2025-09-30T14:56:38.793073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:38.793077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:38.793079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:38.793085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896298104982600:4134] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:38.793663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896298104982600:4134] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:38.795793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:38.795988Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:38.795992Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:38.796002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:38.796049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:38.796084Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896298015209427:10483]
2025-09-30T14:56:38.796692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:38.797219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:38.797267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:38.797584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:38.797640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:38.797641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:38.797643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:38.797644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:38.797648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:38.797649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:38.797650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:38.797651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:38.797652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:38.797652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:38.797653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.797655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.797655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.797656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:38.797658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:38.797663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:38.797672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:38.797675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:38.797679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:38.797682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:38.797685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:38.797688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:38.797692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:38.797695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:38.797699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:38.797702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.797706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.797709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.797712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:38.797716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:38.797725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:38.797732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:38.797738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:38.797742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:38.797747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:38.797755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:38.797760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:38.797765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:38.797770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:38.797774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:38.797779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:38.797783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:38.797788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:38.797793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:38.797797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:38.797802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:38.797806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:38.797810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:38.797815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:38.797819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:38.797824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.797830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.797833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.797838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.797842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.797847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.797851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:38.797855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:38.797859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:38.797864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:38.797923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:38.796822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896298104982600:4134] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:38.803582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:38.804555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:38.804573Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:38.804577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:38.804581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:38.804587Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2289 [2:7555896298015209427:10483]
2025-09-30T14:56:38.804604Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:38.804622Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:38.804631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:38.804635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:38.804637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:38.804653Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:38.804659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:38.804666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:38.804725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.804736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.804738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.804741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:38.804744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:38.804806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:38.804814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.804827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.804843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.804866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:38.804888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896298015209422:10483]
2025-09-30T14:56:38.804895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896298015209422:10483]
2025-09-30T14:56:38.804897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896298015209422:10483]
2025-09-30T14:56:38.804910Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:38.804916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:38.804920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:38.804923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:38.804924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896298104982509:2454], now have 1 active actors on pipe
2025-09-30T14:56:38.804929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896298104982639:4134], now have 1 active actors on pipe
2025-09-30T14:56:38.804937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:38.804952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:38.804957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:38.804989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896298015209422:10483]
2025-09-30T14:56:38.805000Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:38.805200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:38.805323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:38.805335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:38.805364Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f780ca9-47c647f8-9f250ed8-6091c343_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:38.805377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:38.805382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:38.805384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:38.805395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:38.805415Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:38.805429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:38.805770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:38.805778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:38.805793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:38.806288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b17a78d9-7bc16c13-12221029-e03219ba_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9f780ca9-47c647f8-9f250ed8-6091c343_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:38.803674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896298104982600:4134] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:38.803696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896298104982600:4134] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:38.803700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896298104982600:4134] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:38.803711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2290 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:38.805042Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2289
2025-09-30T14:56:38.805069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2289
2025-09-30T14:56:38.805928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2290 partition: 0 MaxSeqNo: 42 sessionId: src_id|9f780ca9-47c647f8-9f250ed8-6091c343_0
2025-09-30T14:56:38.809105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f780ca9-47c647f8-9f250ed8-6091c343_0] Write session: try to update token
2025-09-30T14:56:38.809124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f780ca9-47c647f8-9f250ed8-6091c343_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:38.824261Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:38.824287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:38.824290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:38.824292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:38.824302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896298015209422:10483]
2025-09-30T14:56:38.824308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896298015209422:10483]
2025-09-30T14:56:38.824312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896298015209422:10483]
2025-09-30T14:56:38.824353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:38.824361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.824364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:38.824527Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:38.827438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:38.827463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:38.827468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:38.834542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2290 sessionId: src_id|9f780ca9-47c647f8-9f250ed8-6091c343_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:38.837545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:38.870214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896298104982647:3180]
2025-09-30T14:56:38.870496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2289, pipe: [1:7555896298104982647:3180]
2025-09-30T14:56:38.948210Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:38.948641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:38.948664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:38.948724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896298104982647:3180], now have 1 active actors on pipe
2025-09-30T14:56:38.949016Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:38.948980Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:38.949067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896298104982647:3180]
2025-09-30T14:56:38.949088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:38.949091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:38.949173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2290 reason: error at write: Disconnected sessionId: src_id|9f780ca9-47c647f8-9f250ed8-6091c343_0
2025-09-30T14:56:38.949399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2290 sessionId: src_id|9f780ca9-47c647f8-9f250ed8-6091c343_0 is DEAD
2025-09-30T14:56:38.949795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f780ca9-47c647f8-9f250ed8-6091c343_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:38.949807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f780ca9-47c647f8-9f250ed8-6091c343_0] Write session will restart in 0.005423s
2025-09-30T14:56:38.949832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f780ca9-47c647f8-9f250ed8-6091c343_0] Write session: Do CDS request
2025-09-30T14:56:38.949841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f780ca9-47c647f8-9f250ed8-6091c343_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:38.956838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f780ca9-47c647f8-9f250ed8-6091c343_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:38.957210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:38.957229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2291
2025-09-30T14:56:38.957360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2291 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:38.957391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2291 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:38.957403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2291 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:38.957407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:38.957878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2291 sessionId:  describe result for acl check
2025-09-30T14:56:38.957924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:38.957931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:38.957933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:38.957939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896298104982666:4136] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:38.958604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896298104982666:4136] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:38.961393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896298104982666:4136] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:38.963410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:38.965702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:38.965943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896298104982666:4136] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:38.965963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896298104982666:4136] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:38.965967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896298104982666:4136] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:38.965977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2291 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:38.966021Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:38.966031Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:38.966041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:38.966117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:38.966172Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896298015209570:10487]
2025-09-30T14:56:38.966833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:38.967147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:38.967209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:38.967526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:38.967595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:38.967601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:38.967602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:38.967603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:38.967605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:38.967617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:38.967618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:38.967619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:38.967620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:38.967622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:38.967623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.967624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.967626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.967627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:38.967629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:38.967635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:38.967642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:38.967645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:38.967647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:38.967650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:38.967652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:38.967654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:38.967656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:38.967661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:38.967664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:38.967666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.967668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.967671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.967673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:38.967675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:38.967682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:38.967687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:38.967691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:38.967694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:38.967697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:38.967700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:38.967702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:38.967705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:38.967708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:38.967712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:38.967715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:38.967718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:38.967720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:38.967723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:38.967725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:38.967728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:38.967732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:38.967737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:38.967740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:38.967743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:38.967752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.967757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.967768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.967775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.967780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.967785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.967790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:38.967796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:38.967800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:38.967805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:38.967849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:38.973542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:38.974737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:38.974756Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:38.974759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:38.974763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:38.974769Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2290 [2:7555896298015209570:10487]
2025-09-30T14:56:38.974784Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:38.974800Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:38.974809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:38.974812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:38.974815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:38.974834Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:38.974847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:38.974854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:38.974915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.974923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.974926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.974929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:38.974932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:38.975008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:38.975015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.975030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:38.975046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:38.975069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:38.975093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896298104982773:4136], now have 1 active actors on pipe
2025-09-30T14:56:38.975102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896298104982648:2454], now have 1 active actors on pipe
2025-09-30T14:56:38.975109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896298015209565:10487]
2025-09-30T14:56:38.975111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896298015209565:10487]
2025-09-30T14:56:38.975114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896298015209565:10487]
2025-09-30T14:56:38.975129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:38.975147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:38.975154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:38.975157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:38.975160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:38.975166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:38.975169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:38.975210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896298015209565:10487]
2025-09-30T14:56:38.975201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2290
2025-09-30T14:56:38.975224Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:38.975209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2290
2025-09-30T14:56:38.975268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:38.975274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:38.975278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:38.975307Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18d995f2-c2e3e23a-4ef32870-82daa5ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:38.975323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:38.975332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:38.975334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:38.975344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:38.975353Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:38.975371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:38.975517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:38.975526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:38.975539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:38.975616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2291 partition: 0 MaxSeqNo: 42 sessionId: src_id|18d995f2-c2e3e23a-4ef32870-82daa5ed_0
2025-09-30T14:56:38.975984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f780ca9-47c647f8-9f250ed8-6091c343_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|18d995f2-c2e3e23a-4ef32870-82daa5ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:38.978921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18d995f2-c2e3e23a-4ef32870-82daa5ed_0] Write session: try to update token
2025-09-30T14:56:38.978941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18d995f2-c2e3e23a-4ef32870-82daa5ed_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:38.987952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:38.987974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:38.987976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:38.987978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:38.987988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896298015209565:10487]
2025-09-30T14:56:38.987992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896298015209565:10487]
2025-09-30T14:56:38.987996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896298015209565:10487]
2025-09-30T14:56:38.988036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:38.988043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:38.988046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:38.988045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:38.988052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:38.988056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:38.988245Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:38.994703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2291 sessionId: src_id|18d995f2-c2e3e23a-4ef32870-82daa5ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:38.997684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:39.048913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896302399950082:3180]
2025-09-30T14:56:39.049320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2290, pipe: [1:7555896302399950082:3180]
2025-09-30T14:56:39.104091Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:39.104420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:39.104434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:39.104468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896302399950082:3180], now have 1 active actors on pipe
2025-09-30T14:56:39.104667Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:39.104707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896302399950082:3180]
2025-09-30T14:56:39.104715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:39.104719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:39.104752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:39.104792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2291 reason: error at write: Disconnected sessionId: src_id|18d995f2-c2e3e23a-4ef32870-82daa5ed_0
2025-09-30T14:56:39.104966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2291 sessionId: src_id|18d995f2-c2e3e23a-4ef32870-82daa5ed_0 is DEAD
2025-09-30T14:56:39.105109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18d995f2-c2e3e23a-4ef32870-82daa5ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:39.105122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18d995f2-c2e3e23a-4ef32870-82daa5ed_0] Write session will restart in 0.007493s
2025-09-30T14:56:39.105153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18d995f2-c2e3e23a-4ef32870-82daa5ed_0] Write session: Do CDS request
2025-09-30T14:56:39.105160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18d995f2-c2e3e23a-4ef32870-82daa5ed_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:39.113859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18d995f2-c2e3e23a-4ef32870-82daa5ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:39.113936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:39.113953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2292
2025-09-30T14:56:39.114121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2292 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:39.114166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2292 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:39.114184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2292 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:39.114189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:39.114600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2292 sessionId:  describe result for acl check
2025-09-30T14:56:39.114629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:39.114635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:39.114639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:39.114644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896302399950110:4161] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:39.115164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896302399950110:4161] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:39.119163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896302399950110:4161] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:39.123358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896302399950110:4161] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:39.123389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896302399950110:4161] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:39.123393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896302399950110:4161] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:39.123403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2292 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:39.125251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:39.127163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:39.127413Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:39.127424Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:39.127434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:39.127485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:39.127525Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896302310176997:10489]
2025-09-30T14:56:39.128246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:39.128898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:39.128964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:39.129367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:39.129442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:39.129450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:39.129452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:39.129453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:39.129454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:39.129455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:39.129457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:39.129459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:39.129461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:39.129462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:39.129464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.129465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:39.129467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:39.129468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:39.129469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:39.129476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:39.129487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:39.129492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:39.129496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:39.129500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:39.129504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:39.129508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:39.129512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:39.129516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:39.129520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:39.129523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.129526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:39.129530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:39.129533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:39.129536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:39.129546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:39.129554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:39.129562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:39.129569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:39.129575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:39.129581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:39.129587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:39.129593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:39.129598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:39.129603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:39.129608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:39.129614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:39.129620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:39.129625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:39.129632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:39.129638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:39.129643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:39.129654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:39.129659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:39.129669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:39.129673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.129678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.129684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:39.129689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:39.129699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:39.129704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:39.129717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:39.129723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:39.129728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:39.129738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:39.129787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:39.135672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:39.136802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:39.136822Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:39.136825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:39.136833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:39.136841Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2291 [2:7555896302310176997:10489]
2025-09-30T14:56:39.136859Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:39.136877Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:39.136880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:39.136884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:39.136887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:39.136904Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:39.136918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:39.136925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:39.136989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.136999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:39.137001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:39.137007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:39.137010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:39.137082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:39.137093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.137105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:39.137117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:39.137141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:39.137167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896302399950219:4161], now have 1 active actors on pipe
2025-09-30T14:56:39.137176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896302399950095:2454], now have 1 active actors on pipe
2025-09-30T14:56:39.137183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896302310176992:10489]
2025-09-30T14:56:39.137185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896302310176992:10489]
2025-09-30T14:56:39.137187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896302310176992:10489]
2025-09-30T14:56:39.137204Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:39.137225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:39.137240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:39.137243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:39.137259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:39.137270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:39.137235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2291
2025-09-30T14:56:39.137240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2291
2025-09-30T14:56:39.137283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:39.137301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896302310176992:10489]
2025-09-30T14:56:39.137305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:39.137320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:39.137348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:39.137352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:39.137377Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62289b9d-f12bad5e-347a5390-5c7b4f97_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:39.137385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:39.137401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:39.137403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:39.137415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:39.137425Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:39.137439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:39.137633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:39.137645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:39.137661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:39.137754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2292 partition: 0 MaxSeqNo: 42 sessionId: src_id|62289b9d-f12bad5e-347a5390-5c7b4f97_0
2025-09-30T14:56:39.138188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18d995f2-c2e3e23a-4ef32870-82daa5ed_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|62289b9d-f12bad5e-347a5390-5c7b4f97_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:39.141033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62289b9d-f12bad5e-347a5390-5c7b4f97_0] Write session: try to update token
2025-09-30T14:56:39.141055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62289b9d-f12bad5e-347a5390-5c7b4f97_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:39.150410Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:39.150432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:39.150443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896302310176992:10489]
2025-09-30T14:56:39.150493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:39.150496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:39.150670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:39.150836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:39.150998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:39.151188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:39.151413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:39.151459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:39.164127Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:39.164153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:39.164155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:39.164157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:39.164168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896302310176992:10489]
2025-09-30T14:56:39.164174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896302310176992:10489]
2025-09-30T14:56:39.164178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896302310176992:10489]
2025-09-30T14:56:39.164224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:39.164237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.164241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:39.164397Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:39.164908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:39.164923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:39.164927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:39.165395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2292 sessionId: src_id|62289b9d-f12bad5e-347a5390-5c7b4f97_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:39.168418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:39.205106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896302399950241:3180]
2025-09-30T14:56:39.205547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2291, pipe: [1:7555896302399950241:3180]
2025-09-30T14:56:39.280365Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:39.280849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:39.280863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:39.280886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896302399950241:3180], now have 1 active actors on pipe
2025-09-30T14:56:39.281122Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:39.283155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62289b9d-f12bad5e-347a5390-5c7b4f97_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:39.283168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62289b9d-f12bad5e-347a5390-5c7b4f97_0] Write session will restart in 0.005167s
2025-09-30T14:56:39.283193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62289b9d-f12bad5e-347a5390-5c7b4f97_0] Write session: Do CDS request
2025-09-30T14:56:39.283200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62289b9d-f12bad5e-347a5390-5c7b4f97_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:39.282038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896302399950241:3180]
2025-09-30T14:56:39.282090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:39.282175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2292 reason: status is not ok: tablet will be restarted right now sessionId: src_id|62289b9d-f12bad5e-347a5390-5c7b4f97_0
2025-09-30T14:56:39.282399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2292 sessionId: src_id|62289b9d-f12bad5e-347a5390-5c7b4f97_0 is DEAD
2025-09-30T14:56:39.282603Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:39.290411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62289b9d-f12bad5e-347a5390-5c7b4f97_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:39.291694Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:39.291722Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2293
2025-09-30T14:56:39.291941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2293 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:39.291985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2293 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:39.291995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2293 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:39.292001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:39.292525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2293 sessionId:  describe result for acl check
2025-09-30T14:56:39.292561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:39.292564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:39.292566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:39.292572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896302399950258:4165] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:39.293244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896302399950258:4165] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:39.298197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896302399950258:4165] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:39.308106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896302399950258:4165] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:39.308131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896302399950258:4165] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:39.308135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896302399950258:4165] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:39.308145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2293 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:39.308271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:39.311155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:39.311559Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:39.311575Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:39.311589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:39.311669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:39.311707Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896302310177128:10491]
2025-09-30T14:56:39.312381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:39.312852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:39.312924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:39.313326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:39.313437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:39.313448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:39.313449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:39.313451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:39.313452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:39.313454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:39.313455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:39.313457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:39.313458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:39.313460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:39.313461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.313463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:39.313464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:39.313466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:39.313467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:39.313473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:39.313485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:39.313490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:39.313495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:39.313500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:39.313505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:39.313509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:39.313514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:39.313519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:39.313524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:39.313528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.313533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:39.313537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:39.313542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:39.313546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:39.313555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:39.313564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:39.313571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:39.313578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:39.313584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:39.313591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:39.313597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:39.313603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:39.313609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:39.313615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:39.313621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:39.313626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:39.313633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:39.313639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:39.313645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:39.313651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:39.313657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:39.313663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:39.313669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:39.313675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:39.313681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.313688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.313693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:39.313700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:39.313719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:39.313726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:39.313731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:39.313737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:39.313743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:39.313750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:39.313805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:39.320182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:39.321296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:39.321302Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:39.321305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:39.321310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:39.321318Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2292 [2:7555896302310177128:10491]
2025-09-30T14:56:39.321336Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:39.321355Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:39.321358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:39.321362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:39.321365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:39.321383Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:39.321391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:39.321398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:39.321466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.321468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:39.321470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:39.321475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:39.321477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:39.321551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:39.321554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.321566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:39.321578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:39.321598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:39.321615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896302310177121:10491]
2025-09-30T14:56:39.321618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896302310177121:10491]
2025-09-30T14:56:39.321621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896302310177121:10491]
2025-09-30T14:56:39.321630Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:39.321641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:39.321646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:39.321648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896302399950373:4165], now have 1 active actors on pipe
2025-09-30T14:56:39.321648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:39.321654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:39.321670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:39.321673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:39.321679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896302399950245:2454], now have 1 active actors on pipe
2025-09-30T14:56:39.321712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896302310177121:10491]
2025-09-30T14:56:39.321722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:39.321728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:39.325264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:39.325310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:39.325345Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8208cb-81332b24-a4d9e36f-4677748d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:39.325363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:39.325369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:39.325372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:39.325387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:39.325412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:39.325438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:39.325683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:39.325697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:39.325723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:39.324974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2292
2025-09-30T14:56:39.324989Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2292
2025-09-30T14:56:39.325867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2293 partition: 0 MaxSeqNo: 42 sessionId: src_id|f8208cb-81332b24-a4d9e36f-4677748d_0
2025-09-30T14:56:39.327226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62289b9d-f12bad5e-347a5390-5c7b4f97_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f8208cb-81332b24-a4d9e36f-4677748d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:39.330857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8208cb-81332b24-a4d9e36f-4677748d_0] Write session: try to update token
2025-09-30T14:56:39.330892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8208cb-81332b24-a4d9e36f-4677748d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:39.339096Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:39.339122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:39.339134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896302310177121:10491]
2025-09-30T14:56:39.339186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:39.339419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:39.339592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:39.339761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:39.339926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:39.340141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:39.340194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:39.340479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:39.359304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2293 sessionId: src_id|f8208cb-81332b24-a4d9e36f-4677748d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:39.360450Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:39.360477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:39.360480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:39.360483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:39.360493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896302310177121:10491]
2025-09-30T14:56:39.360502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896302310177121:10491]
2025-09-30T14:56:39.360507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896302310177121:10491]
2025-09-30T14:56:39.360552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:39.360565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.360569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:39.360587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:39.360604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:39.360609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:39.360724Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:39.363475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:39.385520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896302399950386:3180]
2025-09-30T14:56:39.385869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2292, pipe: [1:7555896302399950386:3180]
2025-09-30T14:56:39.484569Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:39.484992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:39.485010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:39.485031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896302399950386:3180], now have 1 active actors on pipe
2025-09-30T14:56:39.485290Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:39.485644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:39.485660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:39.485725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2293 reason: error at write: Disconnected sessionId: src_id|f8208cb-81332b24-a4d9e36f-4677748d_0
2025-09-30T14:56:39.485907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2293 sessionId: src_id|f8208cb-81332b24-a4d9e36f-4677748d_0 is DEAD
2025-09-30T14:56:39.486040Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:39.486084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896302399950386:3180]
2025-09-30T14:56:39.486819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8208cb-81332b24-a4d9e36f-4677748d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:39.486832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8208cb-81332b24-a4d9e36f-4677748d_0] Write session will restart in 0.009985s
2025-09-30T14:56:39.486856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8208cb-81332b24-a4d9e36f-4677748d_0] Write session: Do CDS request
2025-09-30T14:56:39.486865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8208cb-81332b24-a4d9e36f-4677748d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:39.497818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8208cb-81332b24-a4d9e36f-4677748d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:39.499444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:39.499467Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2294
2025-09-30T14:56:39.499686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2294 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:39.499748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2294 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:39.499759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2294 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:39.499763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:39.500284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2294 sessionId:  describe result for acl check
2025-09-30T14:56:39.500322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:39.500325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:39.500326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:39.500335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896302399950402:4168] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:39.500918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896302399950402:4168] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:39.502785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896302399950402:4168] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:39.508095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896302399950402:4168] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:39.508114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896302399950402:4168] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:39.508118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896302399950402:4168] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:39.508127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2294 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:39.511935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:39.517528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:39.517784Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:39.517796Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:39.517808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:39.517877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:39.517920Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896302310177262:10494]
2025-09-30T14:56:39.518743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:39.519124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:39.519174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:39.519546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:39.519624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:39.519631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:39.519632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:39.519633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:39.519635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:39.519636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:39.519638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:39.519639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:39.519640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:39.519642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:39.519643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.519644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:39.519645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:39.519647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:39.519649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:39.519654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:39.519664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:39.519669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:39.519673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:39.519677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:39.519680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:39.519685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:39.519690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:39.519694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:39.519700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:39.519705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.519709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:39.519713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:39.519717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:39.519720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:39.519728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:39.519738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:39.519746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:39.519752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:39.519757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:39.519764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:39.519769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:39.519776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:39.519782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:39.519786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:39.519791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:39.519798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:39.519802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:39.519808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:39.519813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:39.519819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:39.519825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:39.519840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:39.519846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:39.519852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:39.519858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.519863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.519868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:39.519873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:39.519888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:39.519894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:39.519897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:39.519903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:39.519908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:39.519914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:39.519967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:39.528836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:39.530215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:39.530236Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:39.530239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:39.530243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:39.530251Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2293 [2:7555896302310177262:10494]
2025-09-30T14:56:39.530272Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:39.530290Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:39.530295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:39.530299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:39.530301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:39.530319Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:39.530331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:39.530338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:39.530412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.530420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:39.530422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:39.530425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:39.530428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:39.530495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:39.530502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.530517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:39.530528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:39.530545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:39.530568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896302310177257:10494]
2025-09-30T14:56:39.530578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896302310177257:10494]
2025-09-30T14:56:39.530580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896302310177257:10494]
2025-09-30T14:56:39.530595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:39.530612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896302399950388:2454], now have 1 active actors on pipe
2025-09-30T14:56:39.530616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896302399950514:4168], now have 1 active actors on pipe
2025-09-30T14:56:39.530624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:39.530628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:39.530632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:39.530635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:39.530643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:39.530646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:39.530684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896302310177257:10494]
2025-09-30T14:56:39.530696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:39.530703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:39.530699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2293
2025-09-30T14:56:39.530749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2293
2025-09-30T14:56:39.530920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:39.530934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:39.530962Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f004d2fc-cab90487-5b54e537-fcc9ebc8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:39.530975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:39.530979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:39.530983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:39.530993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:39.531006Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:39.531032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:39.531332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:39.531352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:39.531379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:39.531501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2294 partition: 0 MaxSeqNo: 42 sessionId: src_id|f004d2fc-cab90487-5b54e537-fcc9ebc8_0
2025-09-30T14:56:39.531842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8208cb-81332b24-a4d9e36f-4677748d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f004d2fc-cab90487-5b54e537-fcc9ebc8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:39.535129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f004d2fc-cab90487-5b54e537-fcc9ebc8_0] Write session: try to update token
2025-09-30T14:56:39.535150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f004d2fc-cab90487-5b54e537-fcc9ebc8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:39.560471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2294 sessionId: src_id|f004d2fc-cab90487-5b54e537-fcc9ebc8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:39.563489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:39.564775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:39.564803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:39.566018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:39.566062Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:39.566065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:39.566075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896302310177257:10494]
2025-09-30T14:56:39.566111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:39.566115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:39.566302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:39.566453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:39.566606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:39.566756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:39.566967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:39.567010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:39.566163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:39.577167Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:39.577192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:39.577195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:39.577197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:39.577214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896302310177257:10494]
2025-09-30T14:56:39.577221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896302310177257:10494]
2025-09-30T14:56:39.577229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896302310177257:10494]
2025-09-30T14:56:39.577283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:39.577298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.577301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:39.577291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:39.577311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:39.577316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:39.577440Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:39.586477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896302399950529:3180]
2025-09-30T14:56:39.586745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2293, pipe: [1:7555896302399950529:3180]
2025-09-30T14:56:39.692865Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:39.693145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896302399950529:3180], now have 1 active actors on pipe
2025-09-30T14:56:39.701719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:39.701753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:39.701930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:39.701989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:39.702050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:39.702112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:39.702593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:39.702599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:39.702675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:39.702745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:39.702814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:39.702883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:39.702926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:39.702930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:39.703011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:39.703070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:39.703136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:39.703204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:39.703402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:39.703415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:39.703487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:39.703556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:39.703666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:39.703739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:39.703784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:39.703791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:39.703859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:39.703921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:39.703989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:39.704057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:39.704110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:39.704114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:39.704184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:39.704244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:39.704306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:39.704369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:39.704414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:39.704416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:39.704486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:39.704544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:39.704609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:39.704671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:39.704731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:39.704736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:39.704803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:39.704855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:39.704910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:39.704965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:39.705010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:39.705013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:39.705079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:39.705144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:39.705211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:39.705298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:39.705346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:39.705348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:39.705417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:39.705477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:39.705540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:39.705601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:39.705664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:39.705666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:39.706764Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:39.706528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:39.706547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:39.706576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2294 reason: error at write: Disconnected sessionId: src_id|f004d2fc-cab90487-5b54e537-fcc9ebc8_0
2025-09-30T14:56:39.706758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2294 sessionId: src_id|f004d2fc-cab90487-5b54e537-fcc9ebc8_0 is DEAD
2025-09-30T14:56:39.706922Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:39.707131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896302399950529:3180]
2025-09-30T14:56:39.707210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f004d2fc-cab90487-5b54e537-fcc9ebc8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:39.707221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f004d2fc-cab90487-5b54e537-fcc9ebc8_0] Write session will restart in 0.007011s
2025-09-30T14:56:39.707261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f004d2fc-cab90487-5b54e537-fcc9ebc8_0] Write session: Do CDS request
2025-09-30T14:56:39.707267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f004d2fc-cab90487-5b54e537-fcc9ebc8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:39.715722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f004d2fc-cab90487-5b54e537-fcc9ebc8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:39.715829Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:39.715849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2295
2025-09-30T14:56:39.715976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2295 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:39.716008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2295 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:39.716018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2295 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:39.716022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:39.716653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2295 sessionId:  describe result for acl check
2025-09-30T14:56:39.716703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:39.716711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:39.716713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:39.716719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896302399950583:4205] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:39.717289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896302399950583:4205] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:39.720432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896302399950583:4205] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:39.723532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896302399950583:4205] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:39.723548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896302399950583:4205] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:39.723552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896302399950583:4205] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:39.723565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2295 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:39.724867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:39.726596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:39.726788Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:39.726798Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:39.726809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:39.726860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:39.726902Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896302310177431:10508]
2025-09-30T14:56:39.727581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:39.727894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:39.727939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:39.728272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:39.728339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:39.728340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:39.728342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:39.728343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:39.728344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:39.728346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:39.728347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:39.728349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:39.728350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:39.728351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:39.728353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.728354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:39.728355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:39.728357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:39.728358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:39.728364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:39.728374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:39.728379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:39.728384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:39.728388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:39.728393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:39.728397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:39.728401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:39.728406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:39.728410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:39.728414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.728419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:39.728423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:39.728427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:39.728430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:39.728440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:39.728448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:39.728455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:39.728460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:39.728465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:39.728471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:39.728475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:39.728481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:39.728486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:39.728491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:39.728496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:39.728501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:39.728507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:39.728512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:39.728517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:39.728523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:39.728528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:39.728534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:39.728539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:39.728544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:39.728549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.728556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.728560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:39.728565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:39.728570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:39.728575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:39.728579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:39.728584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:39.728589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:39.728595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:39.728640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:39.734364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:39.735279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:39.735297Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:39.735300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:39.735304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:39.735312Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2294 [2:7555896302310177431:10508]
2025-09-30T14:56:39.735330Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:39.735348Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:39.735355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:39.735359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:39.735364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:39.735383Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:39.735397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:39.735405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:39.735477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.735485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:39.735487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:39.735492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:39.735495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:39.735829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2294
2025-09-30T14:56:39.735817Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2294
2025-09-30T14:56:39.735723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:39.735734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.735748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:39.735759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:39.735777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:39.735799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896302399950684:4205], now have 1 active actors on pipe
2025-09-30T14:56:39.735803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896302399950559:2454], now have 1 active actors on pipe
2025-09-30T14:56:39.735810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896302310177426:10508]
2025-09-30T14:56:39.735812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896302310177426:10508]
2025-09-30T14:56:39.735814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896302310177426:10508]
2025-09-30T14:56:39.735825Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:39.735844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:39.735857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:39.735861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:39.735897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896302310177426:10508]
2025-09-30T14:56:39.735900Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:39.736033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:39.736042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:39.736044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:39.736049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:39.736265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:39.736276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:39.736302Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49c38acb-1a2e2472-4a17ec4a-b43cbbb9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:39.736310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:39.736314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:39.736316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:39.736328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:39.736338Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:39.736353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:39.736714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:39.736725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:39.736744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:39.739495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2295 partition: 0 MaxSeqNo: 42 sessionId: src_id|49c38acb-1a2e2472-4a17ec4a-b43cbbb9_0
2025-09-30T14:56:39.739955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f004d2fc-cab90487-5b54e537-fcc9ebc8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|49c38acb-1a2e2472-4a17ec4a-b43cbbb9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:39.742994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49c38acb-1a2e2472-4a17ec4a-b43cbbb9_0] Write session: try to update token
2025-09-30T14:56:39.743020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49c38acb-1a2e2472-4a17ec4a-b43cbbb9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:39.749105Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:39.749129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:39.749131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:39.749133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:39.749145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896302310177426:10508]
2025-09-30T14:56:39.749149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896302310177426:10508]
2025-09-30T14:56:39.749153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896302310177426:10508]
2025-09-30T14:56:39.749191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:39.749192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:39.749199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.749202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:39.749202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:39.749205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:39.749354Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:39.768367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2295 sessionId: src_id|49c38acb-1a2e2472-4a17ec4a-b43cbbb9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:39.771275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:39.806661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896302399950697:3180]
2025-09-30T14:56:39.806958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2294, pipe: [1:7555896302399950697:3180]
2025-09-30T14:56:39.864402Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:39.864808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:39.864829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:39.864848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896302399950697:3180], now have 1 active actors on pipe
2025-09-30T14:56:39.865085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:39.865104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:39.865132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896302399950697:3180]
2025-09-30T14:56:39.865158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2295 reason: error at write: Disconnected sessionId: src_id|49c38acb-1a2e2472-4a17ec4a-b43cbbb9_0
2025-09-30T14:56:39.865158Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:39.865361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2295 sessionId: src_id|49c38acb-1a2e2472-4a17ec4a-b43cbbb9_0 is DEAD
2025-09-30T14:56:39.865678Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:39.865964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49c38acb-1a2e2472-4a17ec4a-b43cbbb9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:39.865975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49c38acb-1a2e2472-4a17ec4a-b43cbbb9_0] Write session will restart in 0.006518s
2025-09-30T14:56:39.865999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49c38acb-1a2e2472-4a17ec4a-b43cbbb9_0] Write session: Do CDS request
2025-09-30T14:56:39.866008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49c38acb-1a2e2472-4a17ec4a-b43cbbb9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:39.874618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49c38acb-1a2e2472-4a17ec4a-b43cbbb9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:39.874755Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:39.874787Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2296
2025-09-30T14:56:39.874930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2296 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:39.874976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2296 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:39.874986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2296 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:39.874991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:39.875495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2296 sessionId:  describe result for acl check
2025-09-30T14:56:39.875540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:39.875547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:39.875548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:39.875556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896302399950744:4192] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:39.876247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896302399950744:4192] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:39.878020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896302399950744:4192] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:39.878511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:39.880540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:39.880751Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:39.880766Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:39.880778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:39.880852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:39.880899Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896302310177576:10510]
2025-09-30T14:56:39.880886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896302399950744:4192] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:39.880902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896302399950744:4192] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:39.880905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896302399950744:4192] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:39.880915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2296 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:39.881581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:39.881950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:39.882011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:39.882352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:39.882444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:39.882453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:39.882454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:39.882455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:39.882457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:39.882458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:39.882459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:39.882461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:39.882462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:39.882464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:39.882465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.882466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:39.882468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:39.882469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:39.882471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:39.882477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:39.882488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:39.882493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:39.882498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:39.882503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:39.882507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:39.882511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:39.882521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:39.882525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:39.882535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:39.882539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.882543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:39.882552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:39.882556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:39.882561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:39.882570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:39.882583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:39.882594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:39.882605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:39.882615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:39.882625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:39.882633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:39.882640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:39.882650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:39.882655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:39.882665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:39.882675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:39.882685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:39.882690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:39.882697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:39.882703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:39.882708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:39.882719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:39.882727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:39.882732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:39.882736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.882742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.882753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:39.882763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:39.882773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:39.882783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:39.882792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:39.882802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:39.882812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:39.882822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:39.882872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:39.888548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:39.889519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:39.889537Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:39.889540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:39.889544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:39.889551Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2295 [2:7555896302310177576:10510]
2025-09-30T14:56:39.889568Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:39.889582Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:39.889585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:39.889589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:39.889591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:39.889608Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:39.889621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:39.889629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:39.889692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.889700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:39.889702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:39.889706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:39.889709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:39.889777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:39.889784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.889796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:39.889806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:39.889821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:39.889845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896302399950831:4192], now have 1 active actors on pipe
2025-09-30T14:56:39.889853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896302399950700:2454], now have 1 active actors on pipe
2025-09-30T14:56:39.889859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896302310177571:10510]
2025-09-30T14:56:39.889861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896302310177571:10510]
2025-09-30T14:56:39.889863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896302310177571:10510]
2025-09-30T14:56:39.889875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:39.889888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:39.889898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:39.889902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:39.889904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:39.889907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:39.889910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:39.889943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896302310177571:10510]
2025-09-30T14:56:39.889954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:39.889913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2295
2025-09-30T14:56:39.889957Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2295
2025-09-30T14:56:39.889961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:39.889979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:39.889988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:39.890020Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47001599-b9c1c6f5-2d7d6745-30ac51d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:39.890031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:39.890035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:39.890037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:39.890047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:39.890056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:39.890084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:39.890252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:39.890260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:39.890272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:39.890365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2296 partition: 0 MaxSeqNo: 42 sessionId: src_id|47001599-b9c1c6f5-2d7d6745-30ac51d7_0
2025-09-30T14:56:39.890712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49c38acb-1a2e2472-4a17ec4a-b43cbbb9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|47001599-b9c1c6f5-2d7d6745-30ac51d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:39.893506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47001599-b9c1c6f5-2d7d6745-30ac51d7_0] Write session: try to update token
2025-09-30T14:56:39.893526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47001599-b9c1c6f5-2d7d6745-30ac51d7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:39.902442Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:39.902460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:39.902463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:39.902465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:39.902475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896302310177571:10510]
2025-09-30T14:56:39.902479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896302310177571:10510]
2025-09-30T14:56:39.902483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896302310177571:10510]
2025-09-30T14:56:39.902526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:39.902534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:39.902537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:39.902537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:39.902544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:39.902548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:39.902687Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:39.908090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2296 sessionId: src_id|47001599-b9c1c6f5-2d7d6745-30ac51d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:39.911128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:39.965344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896302399950842:3180]
2025-09-30T14:56:39.965689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2295, pipe: [1:7555896302399950842:3180]
2025-09-30T14:56:40.019329Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:40.019807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:40.019821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:40.019860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896302399950842:3180], now have 1 active actors on pipe
2025-09-30T14:56:40.020130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:40.020149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:40.020188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896302399950842:3180]
2025-09-30T14:56:40.020218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:40.020231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2296 reason: error at write: Disconnected sessionId: src_id|47001599-b9c1c6f5-2d7d6745-30ac51d7_0
2025-09-30T14:56:40.020344Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:40.020407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2296 sessionId: src_id|47001599-b9c1c6f5-2d7d6745-30ac51d7_0 is DEAD
2025-09-30T14:56:40.020574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47001599-b9c1c6f5-2d7d6745-30ac51d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:40.020584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47001599-b9c1c6f5-2d7d6745-30ac51d7_0] Write session will restart in 0.007474s
2025-09-30T14:56:40.020618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47001599-b9c1c6f5-2d7d6745-30ac51d7_0] Write session: Do CDS request
2025-09-30T14:56:40.020624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47001599-b9c1c6f5-2d7d6745-30ac51d7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:40.028777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47001599-b9c1c6f5-2d7d6745-30ac51d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:40.028912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:40.028934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2297
2025-09-30T14:56:40.029066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2297 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:40.029101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2297 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:40.029111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2297 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:40.029117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:40.029591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2297 sessionId:  describe result for acl check
2025-09-30T14:56:40.029624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:40.029632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:40.029634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:40.029640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896306694918155:5572] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:40.030179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896306694918155:5572] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:40.032360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896306694918155:5572] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:40.035404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896306694918155:5572] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:40.035431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896306694918155:5572] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:40.035435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896306694918155:5572] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:40.035443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2297 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:40.036556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:40.038531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:40.038736Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:40.038749Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:40.038760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:40.038812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:40.038856Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896306605145010:10514]
2025-09-30T14:56:40.039512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:40.039935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:40.039975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:40.040293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:40.040340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:40.040342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:40.040343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:40.040344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:40.040345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:40.040347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:40.040348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:40.040349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:40.040350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:40.040351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:40.040353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.040354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.040355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.040356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:40.040357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:40.040363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:40.040372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:40.040376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:40.040380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:40.040384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:40.040388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:40.040391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:40.040396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:40.040399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:40.040403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:40.040406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.040410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.040413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.040416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:40.040419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:40.040426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:40.040433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:40.040439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:40.040444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:40.040449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:40.040454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:40.040458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:40.040462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:40.040467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:40.040472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:40.040476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:40.040481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:40.040485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:40.040490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:40.040494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:40.040500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:40.040506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:40.040511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:40.040517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:40.040521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:40.040526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.040531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.040535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.040540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.040544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.040549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.040553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:40.040558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:40.040562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:40.040566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:40.040606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:40.046716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:40.047696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:40.047718Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:40.047721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:40.047726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:40.047732Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2296 [2:7555896306605145010:10514]
2025-09-30T14:56:40.047750Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:40.047768Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:40.047771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:40.047774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:40.047777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:40.047794Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:40.047812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:40.047819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:40.047885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.047894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.047897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.047900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:40.047905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:40.047989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:40.047998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.048012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.048024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.048041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:40.048060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896306694918269:5572], now have 1 active actors on pipe
2025-09-30T14:56:40.048070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896306694918140:2454], now have 1 active actors on pipe
2025-09-30T14:56:40.048076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896306605145005:10514]
2025-09-30T14:56:40.048080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896306605145005:10514]
2025-09-30T14:56:40.048082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896306605145005:10514]
2025-09-30T14:56:40.048100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:40.048119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:40.048139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:40.048146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:40.048179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896306605145005:10514]
2025-09-30T14:56:40.048186Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:40.048145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2296
2025-09-30T14:56:40.048204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:40.048214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:40.048215Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2296
2025-09-30T14:56:40.048216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:40.048234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:40.048443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:40.048454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:40.048482Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22ff91d7-4f925f51-247c2f64-cc12168d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:40.048497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:40.048502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:40.048504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:40.048515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:40.048526Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:40.048542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:40.048819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:40.048834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:40.048856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:40.048999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2297 partition: 0 MaxSeqNo: 42 sessionId: src_id|22ff91d7-4f925f51-247c2f64-cc12168d_0
2025-09-30T14:56:40.049398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47001599-b9c1c6f5-2d7d6745-30ac51d7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|22ff91d7-4f925f51-247c2f64-cc12168d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:40.052316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22ff91d7-4f925f51-247c2f64-cc12168d_0] Write session: try to update token
2025-09-30T14:56:40.052337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22ff91d7-4f925f51-247c2f64-cc12168d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:40.060973Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:40.060991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:40.060993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:40.060995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:40.061007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896306605145005:10514]
2025-09-30T14:56:40.061011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896306605145005:10514]
2025-09-30T14:56:40.061014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896306605145005:10514]
2025-09-30T14:56:40.061058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:40.061063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.061066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:40.061088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:40.061096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:40.061100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:40.061204Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:40.067985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2297 sessionId: src_id|22ff91d7-4f925f51-247c2f64-cc12168d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:40.070679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:40.120630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896306694918295:3180]
2025-09-30T14:56:40.120920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2296, pipe: [1:7555896306694918295:3180]
2025-09-30T14:56:40.174655Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:40.175091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:40.175107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:40.175146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896306694918295:3180], now have 1 active actors on pipe
2025-09-30T14:56:40.175348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896306694918295:3180]
2025-09-30T14:56:40.175366Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:40.175388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:40.175391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:40.175455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2297 reason: error at write: Disconnected sessionId: src_id|22ff91d7-4f925f51-247c2f64-cc12168d_0
2025-09-30T14:56:40.175648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2297 sessionId: src_id|22ff91d7-4f925f51-247c2f64-cc12168d_0 is DEAD
2025-09-30T14:56:40.175721Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:40.175794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22ff91d7-4f925f51-247c2f64-cc12168d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:40.175801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22ff91d7-4f925f51-247c2f64-cc12168d_0] Write session will restart in 0.006458s
2025-09-30T14:56:40.175824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22ff91d7-4f925f51-247c2f64-cc12168d_0] Write session: Do CDS request
2025-09-30T14:56:40.175833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22ff91d7-4f925f51-247c2f64-cc12168d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:40.183890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22ff91d7-4f925f51-247c2f64-cc12168d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:40.183941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:40.183966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2298
2025-09-30T14:56:40.187383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2298 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:40.187440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2298 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:40.187451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2298 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:40.187457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:40.187970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2298 sessionId:  describe result for acl check
2025-09-30T14:56:40.188011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:40.188013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:40.188015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:40.188021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896306694918395:4218] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:40.188558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896306694918395:4218] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:40.189293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:40.190327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896306694918395:4218] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:40.191512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:40.191725Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:40.191736Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:40.191748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:40.191806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:40.191867Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896306605145145:10516]
2025-09-30T14:56:40.192562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:40.192929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:40.192989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:40.193069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896306694918395:4218] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:40.193086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896306694918395:4218] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:40.193089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896306694918395:4218] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:40.193098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2298 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:40.193363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:40.193436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:40.193442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:40.193443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:40.193444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:40.193446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:40.193447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:40.193449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:40.193450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:40.193451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:40.193453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:40.193454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.193455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.193456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.193457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:40.193458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:40.193464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:40.193475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:40.193479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:40.193483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:40.193487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:40.193491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:40.193495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:40.193499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:40.193503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:40.193509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:40.193513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.193517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.193521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.193525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:40.193529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:40.193536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:40.193545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:40.193553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:40.193559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:40.193563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:40.193569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:40.193573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:40.193577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:40.193582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:40.193588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:40.193592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:40.193597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:40.193601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:40.193607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:40.193612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:40.193617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:40.193622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:40.193627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:40.193631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:40.193645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:40.193650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.193661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.193665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.193670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.193675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.193680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.193685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:40.193690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:40.193695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:40.193699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:40.193747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:40.199502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:40.200435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:40.200451Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:40.200454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:40.200459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:40.200466Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2297 [2:7555896306605145145:10516]
2025-09-30T14:56:40.200484Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:40.200501Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:40.200509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:40.200512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:40.200515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:40.200531Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:40.200542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:40.200549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:40.200613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.200622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.200624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.200629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:40.200631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:40.200947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2297
2025-09-30T14:56:40.200704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:40.200963Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2297
2025-09-30T14:56:40.200714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.200726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.200737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.200754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:40.200772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896306605145140:10516]
2025-09-30T14:56:40.200775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896306605145140:10516]
2025-09-30T14:56:40.200778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896306605145140:10516]
2025-09-30T14:56:40.200792Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:40.200808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896306694918434:4218], now have 1 active actors on pipe
2025-09-30T14:56:40.200812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896306694918299:2454], now have 1 active actors on pipe
2025-09-30T14:56:40.200821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:40.200836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:40.200840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:40.200844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:40.200848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:40.200851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:40.200875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896306605145140:10516]
2025-09-30T14:56:40.200885Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:40.200890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:40.201118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:40.201129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:40.201157Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2670ad9a-25ddeb54-9f4e21e1-432fc171_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:40.201170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:40.201174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:40.201183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:40.201193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:40.201202Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:40.201217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:40.201467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:40.201481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:40.201506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:40.201616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2298 partition: 0 MaxSeqNo: 42 sessionId: src_id|2670ad9a-25ddeb54-9f4e21e1-432fc171_0
2025-09-30T14:56:40.201967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22ff91d7-4f925f51-247c2f64-cc12168d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2670ad9a-25ddeb54-9f4e21e1-432fc171_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:40.204822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2670ad9a-25ddeb54-9f4e21e1-432fc171_0] Write session: try to update token
2025-09-30T14:56:40.204844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2670ad9a-25ddeb54-9f4e21e1-432fc171_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:40.213893Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:40.213917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:40.213920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:40.213922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:40.213932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896306605145140:10516]
2025-09-30T14:56:40.213937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896306605145140:10516]
2025-09-30T14:56:40.213941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896306605145140:10516]
2025-09-30T14:56:40.213991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:40.213997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.214000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:40.214007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:40.214014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:40.214019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:40.214155Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:40.221579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2298 sessionId: src_id|2670ad9a-25ddeb54-9f4e21e1-432fc171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:40.224632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:40.275661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896306694918449:3180]
2025-09-30T14:56:40.275981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2297, pipe: [1:7555896306694918449:3180]
2025-09-30T14:56:40.330642Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:40.331281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:40.331297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:40.331318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896306694918449:3180], now have 1 active actors on pipe
2025-09-30T14:56:40.331586Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:40.331984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2670ad9a-25ddeb54-9f4e21e1-432fc171_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:40.332009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2670ad9a-25ddeb54-9f4e21e1-432fc171_0] Write session will restart in 0.005984s
2025-09-30T14:56:40.332033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2670ad9a-25ddeb54-9f4e21e1-432fc171_0] Write session: Do CDS request
2025-09-30T14:56:40.332038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2670ad9a-25ddeb54-9f4e21e1-432fc171_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:40.331583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:40.331602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:40.331665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2298 reason: error at write: Disconnected sessionId: src_id|2670ad9a-25ddeb54-9f4e21e1-432fc171_0
2025-09-30T14:56:40.331875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2298 sessionId: src_id|2670ad9a-25ddeb54-9f4e21e1-432fc171_0 is DEAD
2025-09-30T14:56:40.332022Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:40.332056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896306694918449:3180]
2025-09-30T14:56:40.339794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2670ad9a-25ddeb54-9f4e21e1-432fc171_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:40.344057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:40.344078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2299
2025-09-30T14:56:40.344250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2299 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:40.344278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2299 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:40.344283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2299 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:40.344287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:40.344737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2299 sessionId:  describe result for acl check
2025-09-30T14:56:40.344764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:40.344767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:40.344768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:40.344774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896306694918524:4224] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:40.345325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896306694918524:4224] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:40.349835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:40.352099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:40.352281Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:40.352290Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:40.352297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:40.352344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:40.352381Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896306605145281:10518]
2025-09-30T14:56:40.352852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:40.353162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:40.353194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:40.353481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:40.353527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:40.353528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:40.353529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:40.353530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:40.353531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:40.353532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:40.353533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:40.353534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:40.353535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:40.353536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:40.353537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.353537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.353538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.353539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:40.353540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:40.353543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:40.353551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:40.353554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:40.353556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:40.353559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:40.353561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:40.353564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:40.353566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:40.353569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:40.353571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:40.353574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.353576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.353578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.353581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:40.353584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:40.353590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:40.353595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:40.353599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:40.353603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:40.353606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:40.353610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:40.353613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:40.353616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:40.353621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:40.353625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:40.353628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:40.353631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:40.353634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:40.353637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:40.353640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:40.353643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:40.353646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:40.353650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:40.353652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:40.353656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:40.353658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.353661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.353664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.353667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.353670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.353673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.353676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:40.353679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:40.353682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:40.353685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:40.353713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:40.360806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:40.361812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:40.361819Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:40.361822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:40.361826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:40.361834Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2298 [2:7555896306605145281:10518]
2025-09-30T14:56:40.361852Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:40.361870Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:40.361874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:40.361877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:40.361879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:40.361899Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:40.361905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:40.361912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:40.361974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.361976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.361979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.361983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:40.361985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:40.362059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:40.362061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.362076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.362089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.362106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:40.362126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896306605145276:10518]
2025-09-30T14:56:40.362129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896306605145276:10518]
2025-09-30T14:56:40.362132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896306605145276:10518]
2025-09-30T14:56:40.362140Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:40.362154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:40.362169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:40.362172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:40.362209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896306605145276:10518]
2025-09-30T14:56:40.362211Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:40.362421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:40.362426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:40.362428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:40.362432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:40.360614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896306694918524:4224] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:40.363129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2298
2025-09-30T14:56:40.363459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896306694918450:2454], now have 1 active actors on pipe
2025-09-30T14:56:40.369691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896306694918592:4224], now have 1 active actors on pipe
2025-09-30T14:56:40.369874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:40.369884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:40.369907Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c61df4c-d3f18122-7c44573a-9f6df43d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:40.369916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:40.369920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:40.369922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:40.369933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:40.369945Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:40.369959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:40.370161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:40.370165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:40.370175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:40.370704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2670ad9a-25ddeb54-9f4e21e1-432fc171_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3c61df4c-d3f18122-7c44573a-9f6df43d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:40.368943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896306694918524:4224] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:40.368964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896306694918524:4224] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:40.368966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896306694918524:4224] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:40.368973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2299 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:40.369727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2298
2025-09-30T14:56:40.370301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2299 partition: 0 MaxSeqNo: 42 sessionId: src_id|3c61df4c-d3f18122-7c44573a-9f6df43d_0
2025-09-30T14:56:40.373821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c61df4c-d3f18122-7c44573a-9f6df43d_0] Write session: try to update token
2025-09-30T14:56:40.373844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c61df4c-d3f18122-7c44573a-9f6df43d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:40.376989Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:40.377001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:40.377003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:40.377005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:40.377012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896306605145276:10518]
2025-09-30T14:56:40.377016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896306605145276:10518]
2025-09-30T14:56:40.377020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896306605145276:10518]
2025-09-30T14:56:40.377054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:40.377060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.377062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:40.377073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:40.377081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:40.377086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:40.377187Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:40.396599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2299 sessionId: src_id|3c61df4c-d3f18122-7c44573a-9f6df43d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:40.399503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:40.432850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896306694918596:3180]
2025-09-30T14:56:40.433089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2298, pipe: [1:7555896306694918596:3180]
2025-09-30T14:56:40.491417Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:40.491935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:40.491954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:40.492017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896306694918596:3180], now have 1 active actors on pipe
2025-09-30T14:56:40.492683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c61df4c-d3f18122-7c44573a-9f6df43d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:40.492696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c61df4c-d3f18122-7c44573a-9f6df43d_0] Write session will restart in 0.008420s
2025-09-30T14:56:40.492259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:40.492277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:40.492340Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:40.492348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2299 reason: error at write: Disconnected sessionId: src_id|3c61df4c-d3f18122-7c44573a-9f6df43d_0
2025-09-30T14:56:40.492722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c61df4c-d3f18122-7c44573a-9f6df43d_0] Write session: Do CDS request
2025-09-30T14:56:40.492533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2299 sessionId: src_id|3c61df4c-d3f18122-7c44573a-9f6df43d_0 is DEAD
2025-09-30T14:56:40.492659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896306694918596:3180]
2025-09-30T14:56:40.492673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:40.492758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c61df4c-d3f18122-7c44573a-9f6df43d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:40.502763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c61df4c-d3f18122-7c44573a-9f6df43d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:40.502873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:40.502894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2300
2025-09-30T14:56:40.503027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2300 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:40.503063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2300 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:40.503071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2300 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:40.503075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:40.503528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2300 sessionId:  describe result for acl check
2025-09-30T14:56:40.503577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:40.503579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:40.503581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:40.503586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896306694918646:4230] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:40.504162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896306694918646:4230] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:40.506297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896306694918646:4230] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:40.508916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896306694918646:4230] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:40.508930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896306694918646:4230] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:40.508933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896306694918646:4230] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:40.508942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2300 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:40.510237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:40.512334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:40.512553Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:40.512570Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:40.512582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:40.512641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:40.512680Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896306605145423:10521]
2025-09-30T14:56:40.513384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:40.513727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:40.513788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:40.514098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:40.514175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:40.514181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:40.514183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:40.514184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:40.514185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:40.514187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:40.514188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:40.514189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:40.514190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:40.514191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:40.514193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.514194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.514195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.514196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:40.514197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:40.514203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:40.514211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:40.514214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:40.514217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:40.514219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:40.514222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:40.514224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:40.514226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:40.514229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:40.514232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:40.514234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.514237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.514239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.514241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:40.514243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:40.514250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:40.514255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:40.514260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:40.514263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:40.514268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:40.514274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:40.514279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:40.514285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:40.514290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:40.514295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:40.514300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:40.514306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:40.514310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:40.514316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:40.514321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:40.514327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:40.514331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:40.514337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:40.514342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:40.514347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:40.514352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.514357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.514362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.514369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.514372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.514375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.514378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:40.514381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:40.514384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:40.514387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:40.514413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:40.520016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:40.520901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:40.520917Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:40.520920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:40.520924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:40.520931Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2299 [2:7555896306605145423:10521]
2025-09-30T14:56:40.520950Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:40.520966Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:40.520969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:40.520972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:40.520974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:40.520991Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:40.521003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:40.521017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:40.521076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.521084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.521090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.521094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:40.521097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:40.521166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:40.521174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.521187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.521200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.521219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:40.521243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896306694918597:2454], now have 1 active actors on pipe
2025-09-30T14:56:40.521251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896306694918728:4230], now have 1 active actors on pipe
2025-09-30T14:56:40.521257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896306605145418:10521]
2025-09-30T14:56:40.521260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896306605145418:10521]
2025-09-30T14:56:40.521262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896306605145418:10521]
2025-09-30T14:56:40.521290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:40.521307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:40.521316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:40.521321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:40.521324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:40.521327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:40.521330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:40.521364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896306605145418:10521]
2025-09-30T14:56:40.521373Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:40.521376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:40.521403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:40.521409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:40.521440Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8506daa4-ac24552-299ed564-4c1ce052_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:40.521453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:40.521457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:40.521459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:40.521468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:40.521478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:40.521497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:40.521332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2299
2025-09-30T14:56:40.521350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2299
2025-09-30T14:56:40.521746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:40.521757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:40.521776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:40.521943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2300 partition: 0 MaxSeqNo: 42 sessionId: src_id|8506daa4-ac24552-299ed564-4c1ce052_0
2025-09-30T14:56:40.522314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c61df4c-d3f18122-7c44573a-9f6df43d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8506daa4-ac24552-299ed564-4c1ce052_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:40.525176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8506daa4-ac24552-299ed564-4c1ce052_0] Write session: try to update token
2025-09-30T14:56:40.525196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8506daa4-ac24552-299ed564-4c1ce052_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:40.533829Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:40.533845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:40.533852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:40.533854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:40.533864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896306605145418:10521]
2025-09-30T14:56:40.533869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896306605145418:10521]
2025-09-30T14:56:40.533873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896306605145418:10521]
2025-09-30T14:56:40.533911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:40.533923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.533927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:40.533928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:40.533933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:40.533937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:40.534070Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:40.541082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2300 sessionId: src_id|8506daa4-ac24552-299ed564-4c1ce052_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:40.544075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:40.592616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896306694918747:3180]
2025-09-30T14:56:40.592892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2299, pipe: [1:7555896306694918747:3180]
2025-09-30T14:56:40.648563Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:40.649037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:40.649053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:40.649075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896306694918747:3180], now have 1 active actors on pipe
2025-09-30T14:56:40.649371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:40.649428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896306694918747:3180]
2025-09-30T14:56:40.649449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:40.649457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:40.649517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2300 reason: error at write: Disconnected sessionId: src_id|8506daa4-ac24552-299ed564-4c1ce052_0
2025-09-30T14:56:40.649360Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:40.649723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2300 sessionId: src_id|8506daa4-ac24552-299ed564-4c1ce052_0 is DEAD
2025-09-30T14:56:40.650169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8506daa4-ac24552-299ed564-4c1ce052_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:40.650182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8506daa4-ac24552-299ed564-4c1ce052_0] Write session will restart in 0.006810s
2025-09-30T14:56:40.650206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8506daa4-ac24552-299ed564-4c1ce052_0] Write session: Do CDS request
2025-09-30T14:56:40.650212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8506daa4-ac24552-299ed564-4c1ce052_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:40.657871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8506daa4-ac24552-299ed564-4c1ce052_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:40.657960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:40.657979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2301
2025-09-30T14:56:40.658184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2301 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:40.658219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2301 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:40.658224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2301 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:40.658228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:40.658818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2301 sessionId:  describe result for acl check
2025-09-30T14:56:40.658858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:40.658859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:40.658864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:40.658869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896306694918763:4234] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:40.659483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896306694918763:4234] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:40.666770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896306694918763:4234] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:40.671936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:40.672078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896306694918763:4234] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:40.672103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896306694918763:4234] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:40.672106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896306694918763:4234] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:40.672115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2301 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:40.674782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:40.675025Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:40.675037Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:40.675048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:40.675105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:40.675153Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896306605145562:10523]
2025-09-30T14:56:40.675880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:40.676327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:40.676394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:40.676784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:40.676862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:40.676873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:40.676874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:40.676875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:40.676877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:40.676878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:40.676880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:40.676882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:40.676883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:40.676885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:40.676887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.676888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.676890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.676891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:40.676893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:40.676899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:40.676911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:40.676915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:40.676920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:40.676925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:40.676930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:40.676935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:40.676940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:40.676944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:40.676950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:40.676955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.676960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.676964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.676969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:40.676973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:40.676982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:40.676991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:40.676999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:40.677005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:40.677011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:40.677017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:40.677023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:40.677029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:40.677035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:40.677041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:40.677046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:40.677052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:40.677057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:40.677064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:40.677069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:40.677076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:40.677082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:40.677095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:40.677101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:40.677107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:40.677118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.677124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.677134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.677141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.677146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.677157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.677165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:40.677175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:40.677181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:40.677186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:40.677242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:40.683311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:40.684494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:40.684513Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:40.684516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:40.684521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:40.684528Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2300 [2:7555896306605145562:10523]
2025-09-30T14:56:40.684546Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:40.684563Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:40.684572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:40.684576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:40.684578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:40.684597Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:40.684609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:40.684617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:40.684686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.684694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.684697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.684701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:40.684704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:40.684781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:40.684790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.684804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.684820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.684845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:40.684866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896306605145556:10523]
2025-09-30T14:56:40.684873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896306605145556:10523]
2025-09-30T14:56:40.684876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896306605145556:10523]
2025-09-30T14:56:40.684887Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:40.684904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:40.684906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:40.684914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:40.684917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:40.684922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:40.684926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:40.684937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896306694918883:4234], now have 1 active actors on pipe
2025-09-30T14:56:40.684942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896306694918748:2454], now have 1 active actors on pipe
2025-09-30T14:56:40.684989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896306605145556:10523]
2025-09-30T14:56:40.685004Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:40.685049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:40.685245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2300
2025-09-30T14:56:40.685328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2300
2025-09-30T14:56:40.685601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:40.685613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:40.685646Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64d211ec-68fb0cac-4ecc22a9-ef6556d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:40.685660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:40.685671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:40.685674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:40.685684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:40.685700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:40.685728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:40.686089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:40.686099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:40.686116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:40.686255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2301 partition: 0 MaxSeqNo: 42 sessionId: src_id|64d211ec-68fb0cac-4ecc22a9-ef6556d5_0
2025-09-30T14:56:40.686639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8506daa4-ac24552-299ed564-4c1ce052_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|64d211ec-68fb0cac-4ecc22a9-ef6556d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:40.689598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64d211ec-68fb0cac-4ecc22a9-ef6556d5_0] Write session: try to update token
2025-09-30T14:56:40.689621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64d211ec-68fb0cac-4ecc22a9-ef6556d5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:40.698427Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:40.698442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:40.698444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:40.698446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:40.698454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896306605145556:10523]
2025-09-30T14:56:40.698459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896306605145556:10523]
2025-09-30T14:56:40.698463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896306605145556:10523]
2025-09-30T14:56:40.698507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:40.698513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:40.698515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.698521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:40.698527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:40.698541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:40.698670Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:40.707155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2301 sessionId: src_id|64d211ec-68fb0cac-4ecc22a9-ef6556d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:40.710158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:40.749751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896306694918920:3180]
2025-09-30T14:56:40.749947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2300, pipe: [1:7555896306694918920:3180]
2025-09-30T14:56:40.817289Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:40.817902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:40.817914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:40.817936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896306694918920:3180], now have 1 active actors on pipe
2025-09-30T14:56:40.818408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:40.818411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896306694918920:3180]
2025-09-30T14:56:40.818441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:40.818445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:40.818477Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:56:40.818518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2301 reason: error at write: Disconnected sessionId: src_id|64d211ec-68fb0cac-4ecc22a9-ef6556d5_0
2025-09-30T14:56:40.818590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2301 sessionId: src_id|64d211ec-68fb0cac-4ecc22a9-ef6556d5_0 is DEAD
2025-09-30T14:56:40.818699Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 23 consumer shared/user session shared/user_1_23_15562949610973366798_v1 is DEAD
2025-09-30T14:56:40.818520Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:40.818923Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:56:40.818930Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896233680459956:3157] disconnected; active server actors: 1
2025-09-30T14:56:40.818941Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896233680459956:3157] client user disconnected session shared/user_1_23_15562949610973366798_v1
2025-09-30T14:56:40.819023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64d211ec-68fb0cac-4ecc22a9-ef6556d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:40.819034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64d211ec-68fb0cac-4ecc22a9-ef6556d5_0] Write session will restart in 0.007532s
2025-09-30T14:56:40.819057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64d211ec-68fb0cac-4ecc22a9-ef6556d5_0] Write session: Do CDS request
2025-09-30T14:56:40.819062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64d211ec-68fb0cac-4ecc22a9-ef6556d5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:40.819061Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:56:40.819069Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:56:40.819079Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.008957s
2025-09-30T14:56:40.827815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64d211ec-68fb0cac-4ecc22a9-ef6556d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:40.827927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:40.827949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2302
2025-09-30T14:56:40.828088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2302 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:40.828124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2302 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:40.828137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2302 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:40.828142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:40.828550Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:56:40.828694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2302 sessionId:  describe result for acl check
2025-09-30T14:56:40.828702Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:56:40.828705Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 24
2025-09-30T14:56:40.828734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:40.828743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:40.828745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:40.828751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896306694918945:4266] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:40.828817Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 24 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:56:40.828870Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:56:40.828962Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 auth for : user
2025-09-30T14:56:40.829064Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 Handle describe topics response
2025-09-30T14:56:40.829089Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 auth is DEAD
2025-09-30T14:56:40.829105Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:56:40.829324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896306694918945:4266] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:40.829365Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:56:40.829453Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_24_14968926697881889462_v1
2025-09-30T14:56:40.829655Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896306694918963:4264] connected; active server actors: 1
2025-09-30T14:56:40.829678Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555896306694918963:4264] session shared/user_1_24_14968926697881889462_v1
2025-09-30T14:56:40.829689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:56:40.829710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:56:40.829717Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_24_14968926697881889462_v1" (Sender=[1:7555896306694918946:4264], Pipe=[1:7555896306694918963:4264], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:56:40.829724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:56:40.829736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:56:40.829747Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_24_14968926697881889462_v1" (Sender=[1:7555896306694918946:4264], Pipe=[1:7555896306694918963:4264], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:56:40.829757Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_24_14968926697881889462_v1" sender [1:7555896306694918946:4264] lock partition 0 for ReadingSession "shared/user_1_24_14968926697881889462_v1" (Sender=[1:7555896306694918946:4264], Pipe=[1:7555896306694918963:4264], Partitions=[], ActiveFamilyCount=1) generation 1 step 24
2025-09-30T14:56:40.829765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:56:40.829770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000030s
2025-09-30T14:56:40.830005Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 24 Session: "shared/user_1_24_14968926697881889462_v1" ClientId: "user" PipeClient { RawX1: 7555896306694918963 RawX2: 4503603922342056 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:56:40.830033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:56:40.831887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896306694918945:4266] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:40.833146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:40.835315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:40.835538Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:40.835549Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:40.835561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:40.835629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:40.835671Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896306605145738:10537]
2025-09-30T14:56:40.835733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896306694918945:4266] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:40.835750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896306694918945:4266] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:40.835754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896306694918945:4266] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:40.835763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2302 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:40.836366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:40.836718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:40.836762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:40.837113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:40.837179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:40.837186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:40.837187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:40.837189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:40.837190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:40.837192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:40.837193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:40.837195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:40.837196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:40.837198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:40.837199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.837200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.837201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.837203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:40.837204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:40.837210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:40.837221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:40.837226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:40.837231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:40.837235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:40.837240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:40.837245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:40.837250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:40.837254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:40.837259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:40.837263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.837280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.837285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.837290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:40.837294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:40.837302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:40.837311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:40.837317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:40.837323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:40.837329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:40.837335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:40.837340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:40.837346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:40.837351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:40.837357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:40.837362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:40.837368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:40.837374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:40.837381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:40.837385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:40.837391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:40.837396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:40.837402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:40.837415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:40.837421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:40.837433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.837439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.837448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.837454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.837466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.837472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.837476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:40.837487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:40.837492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:40.837499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:40.837547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:40.843437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:40.844390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:40.844407Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:40.844411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:40.844416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:40.844424Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2301 [2:7555896306605145738:10537]
2025-09-30T14:56:40.844442Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:40.844461Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:40.844465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:40.844468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:40.844472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:40.844487Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:40.844494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:40.844507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:40.844574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.844583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.844586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.844590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:40.844593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:40.844661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:40.844669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.844684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.844700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.844725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:40.844749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896306694918922:2454], now have 1 active actors on pipe
2025-09-30T14:56:40.844758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896306694919066:4266], now have 1 active actors on pipe
2025-09-30T14:56:40.844762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896306694918991:4281], now have 1 active actors on pipe
2025-09-30T14:56:40.844771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896306605145733:10537]
2025-09-30T14:56:40.844777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896306605145733:10537]
2025-09-30T14:56:40.844780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896306605145733:10537]
2025-09-30T14:56:40.844795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:40.844806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:40.844808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:40.844788Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2301
2025-09-30T14:56:40.844813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:40.844816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:40.844822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2301
2025-09-30T14:56:40.844825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:40.844829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:40.844853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2301, pipe: [1:7555896306694918991:4281]
2025-09-30T14:56:40.844878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:40.844887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:40.844900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896306605145733:10537]
2025-09-30T14:56:40.844909Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:40.844918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:40.844932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:40.844939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:40.844946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_24_14968926697881889462_v1 on pipe: [1:7555896306694918991:4281]
2025-09-30T14:56:40.844980Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35969538-212946aa-363eebea-f7979a7b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:40.844989Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_24_14968926697881889462_v1:1 with generation 2301
2025-09-30T14:56:40.844991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:40.844995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:40.844998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:40.845009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:40.845023Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:40.845048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:40.845058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:40.845060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:40.845074Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_24_14968926697881889462_v1
2025-09-30T14:56:40.845077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:40.845102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:40.845130Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:56:40.845248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:40.845259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:40.845288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:40.845395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2302 partition: 0 MaxSeqNo: 42 sessionId: src_id|35969538-212946aa-363eebea-f7979a7b_0
2025-09-30T14:56:40.845790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64d211ec-68fb0cac-4ecc22a9-ef6556d5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|35969538-212946aa-363eebea-f7979a7b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:40.848695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35969538-212946aa-363eebea-f7979a7b_0] Write session: try to update token
2025-09-30T14:56:40.848716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35969538-212946aa-363eebea-f7979a7b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:40.849935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:56:40.849974Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:56:40.849984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:40.849987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:40.849990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:40.849999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:56:40.850013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:56:40.850183Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759244200844 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:56:40.850212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:56:40.850251Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 sending to client partition status
2025-09-30T14:56:40.857945Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:40.857963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:40.857966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:40.857968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:40.857978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896306605145733:10537]
2025-09-30T14:56:40.857982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896306605145733:10537]
2025-09-30T14:56:40.857987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896306605145733:10537]
2025-09-30T14:56:40.858031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:40.858031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:40.858038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:40.858039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.858042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:40.858043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:40.858188Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:40.868705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2302 sessionId: src_id|35969538-212946aa-363eebea-f7979a7b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:40.871567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:40.971945Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:40.972444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:40.972460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:40.972706Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:40.972724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896306694918991:4281]
2025-09-30T14:56:40.972750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:40.972824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2302 reason: status is not ok: tablet will be restarted right now sessionId: src_id|35969538-212946aa-363eebea-f7979a7b_0
2025-09-30T14:56:40.972671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_24_14968926697881889462_v1
2025-09-30T14:56:40.972694Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:40.972716Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_24_14968926697881889462_v1
2025-09-30T14:56:40.972997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2302 sessionId: src_id|35969538-212946aa-363eebea-f7979a7b_0 is DEAD
2025-09-30T14:56:40.973153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35969538-212946aa-363eebea-f7979a7b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:40.973164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35969538-212946aa-363eebea-f7979a7b_0] Write session will restart in 0.009325s
2025-09-30T14:56:40.973186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35969538-212946aa-363eebea-f7979a7b_0] Write session: Do CDS request
2025-09-30T14:56:40.973195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35969538-212946aa-363eebea-f7979a7b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:40.983828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35969538-212946aa-363eebea-f7979a7b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:40.983882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:40.983900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2303
2025-09-30T14:56:40.984082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2303 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:40.984132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2303 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:40.984146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2303 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:40.984151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:40.984638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2303 sessionId:  describe result for acl check
2025-09-30T14:56:40.984679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:40.984682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:40.984684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:40.984701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896306694919165:4283] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:40.985323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896306694919165:4283] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:40.986821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:40.987038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896306694919165:4283] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:40.989032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:40.989337Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:40.989357Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:40.989374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:40.989464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:40.989525Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896306605145896:10541]
2025-09-30T14:56:40.990254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:40.990367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896306694919165:4283] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:40.990384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896306694919165:4283] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:40.990388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896306694919165:4283] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:40.990396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2303 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:40.990609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:40.990656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:40.990953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:40.991017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:40.991023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:40.991024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:40.991025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:40.991026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:40.991028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:40.991029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:40.991031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:40.991033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:40.991034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:40.991035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.991037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.991038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.991039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:40.991040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:40.991047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:40.991058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:40.991062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:40.991067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:40.991071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:40.991075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:40.991079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:40.991083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:40.991087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:40.991092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:40.991096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.991101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.991105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.991109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:40.991113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:40.991120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:40.991129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:40.991135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:40.991141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:40.991146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:40.991151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:40.991156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:40.991168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:40.991173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:40.991178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:40.991187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:40.991192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:40.991197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:40.991207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:40.991211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:40.991217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:40.991224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:40.991228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:40.991231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:40.991234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:40.991237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.991240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.991262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.991268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.991273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.991279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.991284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:40.991289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:40.991297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:40.991307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:40.991354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:40.997031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:40.998224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:40.998239Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:40.998242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:40.998245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:40.998254Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2302 [2:7555896306605145896:10541]
2025-09-30T14:56:40.998273Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:40.998288Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:40.998291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:40.998294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:40.998297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:40.998313Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:40.998320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:40.998327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:40.998390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.998397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.998399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.998402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:40.998405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:40.998469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:40.998477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:40.998487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:40.998493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:40.998502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:40.998520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896306605145891:10541]
2025-09-30T14:56:40.998525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896306605145891:10541]
2025-09-30T14:56:40.998527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896306605145891:10541]
2025-09-30T14:56:40.998536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:40.998547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:40.998554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896306694919083:2454], now have 1 active actors on pipe
2025-09-30T14:56:40.998558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:40.998559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:40.998560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:40.998572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:40.998574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:40.998579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896306694919220:4283], now have 1 active actors on pipe
2025-09-30T14:56:40.998610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896306605145891:10541]
2025-09-30T14:56:40.998622Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:40.998641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2302
2025-09-30T14:56:40.998671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2302
2025-09-30T14:56:40.998657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:40.998842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:40.998851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:40.998870Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ccb7a0a-54cf1eec-4b3ac2a7-d3932e0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:40.998880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:40.998884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:40.998887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:40.998899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:40.998912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:40.998925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:40.999100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:40.999116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:40.999140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:40.999235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2303 partition: 0 MaxSeqNo: 42 sessionId: src_id|8ccb7a0a-54cf1eec-4b3ac2a7-d3932e0c_0
2025-09-30T14:56:40.999624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35969538-212946aa-363eebea-f7979a7b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8ccb7a0a-54cf1eec-4b3ac2a7-d3932e0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:41.002395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ccb7a0a-54cf1eec-4b3ac2a7-d3932e0c_0] Write session: try to update token
2025-09-30T14:56:41.002415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ccb7a0a-54cf1eec-4b3ac2a7-d3932e0c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:41.012772Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:41.012792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:41.012795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:41.012797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:41.012808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896306605145891:10541]
2025-09-30T14:56:41.012813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896306605145891:10541]
2025-09-30T14:56:41.012816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896306605145891:10541]
2025-09-30T14:56:41.012860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:41.012873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.012875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:41.012876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:41.012885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:41.012898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:41.013019Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:41.019773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2303 sessionId: src_id|8ccb7a0a-54cf1eec-4b3ac2a7-d3932e0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:41.022622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:41.072843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896310989886546:4281]
2025-09-30T14:56:41.073138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2302, pipe: [1:7555896310989886546:4281]
2025-09-30T14:56:41.127509Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:41.127882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:41.127897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:41.127937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896310989886546:4281], now have 1 active actors on pipe
2025-09-30T14:56:41.128195Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:41.128208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896310989886546:4281]
2025-09-30T14:56:41.128239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:41.128248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:41.128334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2303 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8ccb7a0a-54cf1eec-4b3ac2a7-d3932e0c_0
2025-09-30T14:56:41.128510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2303 sessionId: src_id|8ccb7a0a-54cf1eec-4b3ac2a7-d3932e0c_0 is DEAD
2025-09-30T14:56:41.128624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ccb7a0a-54cf1eec-4b3ac2a7-d3932e0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:41.128633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ccb7a0a-54cf1eec-4b3ac2a7-d3932e0c_0] Write session will restart in 0.009506s
2025-09-30T14:56:41.128656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ccb7a0a-54cf1eec-4b3ac2a7-d3932e0c_0] Write session: Do CDS request
2025-09-30T14:56:41.128666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ccb7a0a-54cf1eec-4b3ac2a7-d3932e0c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:41.140292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ccb7a0a-54cf1eec-4b3ac2a7-d3932e0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:41.140673Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:41.140691Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2304
2025-09-30T14:56:41.140785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2304 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:41.140826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2304 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:41.140837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2304 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:41.140841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:41.141232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2304 sessionId:  describe result for acl check
2025-09-30T14:56:41.141270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:41.141277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:41.141279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:41.141284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896310989886565:4288] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:41.141717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896310989886565:4288] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:41.148400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896310989886565:4288] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:41.149367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:41.151663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:41.151891Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:41.151901Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:41.151912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:41.151967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:41.152006Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896310900113334:10543]
2025-09-30T14:56:41.152081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896310989886565:4288] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:41.152101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896310989886565:4288] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:41.152105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896310989886565:4288] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:41.152124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2304 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:41.152679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:41.153003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:41.153064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:41.153333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:41.153379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:41.153383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:41.153384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:41.153385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:41.153386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:41.153387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:41.153388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:41.153389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:41.153389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:41.153390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:41.153391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.153392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:41.153393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:41.153394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:41.153395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:41.153400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:41.153408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:41.153410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:41.153413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:41.153415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:41.153418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:41.153420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:41.153423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:41.153425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:41.153428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:41.153430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.153433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:41.153443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:41.153445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:41.153447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:41.153453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:41.153459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:41.153464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:41.153468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:41.153471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:41.153474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:41.153478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:41.153481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:41.153484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:41.153487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:41.153489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:41.153492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:41.153495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:41.153498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:41.153501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:41.153504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:41.153507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:41.153510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:41.153513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:41.153516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:41.153519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.153522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.153525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:41.153531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:41.153535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:41.153540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:41.153545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:41.153549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:41.153555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:41.153559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:41.153592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:41.159227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:41.160147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:41.160162Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:41.160166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:41.160170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:41.160176Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2303 [2:7555896310900113334:10543]
2025-09-30T14:56:41.160194Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:41.160211Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:41.160214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:41.160218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:41.160221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:41.160236Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:41.160242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:41.160250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:41.160309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.160317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:41.160319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:41.160326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:41.160330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:41.160402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:41.160410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.160421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:41.160431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:41.160447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:41.160470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896310989886549:2454], now have 1 active actors on pipe
2025-09-30T14:56:41.160478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896310989886688:4288], now have 1 active actors on pipe
2025-09-30T14:56:41.160484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896310900113329:10543]
2025-09-30T14:56:41.160487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896310900113329:10543]
2025-09-30T14:56:41.160489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896310900113329:10543]
2025-09-30T14:56:41.160503Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:41.160522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:41.160539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:41.160542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:41.160547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:41.160548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:41.160550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:41.160581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896310900113329:10543]
2025-09-30T14:56:41.160590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:41.160599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:41.160529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2303
2025-09-30T14:56:41.160633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:41.160547Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2303
2025-09-30T14:56:41.160642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:41.160712Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1f87a36-5d6fbc19-d90d7831-d9048ab9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:41.160724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:41.160729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:41.160731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:41.160742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:41.160751Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:41.160779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:41.161068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:41.161083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:41.161105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:41.161224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2304 partition: 0 MaxSeqNo: 42 sessionId: src_id|d1f87a36-5d6fbc19-d90d7831-d9048ab9_0
2025-09-30T14:56:41.161628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ccb7a0a-54cf1eec-4b3ac2a7-d3932e0c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d1f87a36-5d6fbc19-d90d7831-d9048ab9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:41.164579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1f87a36-5d6fbc19-d90d7831-d9048ab9_0] Write session: try to update token
2025-09-30T14:56:41.164601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1f87a36-5d6fbc19-d90d7831-d9048ab9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:41.176765Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:41.176785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:41.176788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:41.176790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:41.176801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896310900113329:10543]
2025-09-30T14:56:41.176805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896310900113329:10543]
2025-09-30T14:56:41.176810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896310900113329:10543]
2025-09-30T14:56:41.176858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:41.176865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.176868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:41.176868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:41.176875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:41.176881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:41.177043Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:41.185927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2304 sessionId: src_id|d1f87a36-5d6fbc19-d90d7831-d9048ab9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:41.188756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:41.228515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896310989886705:4281]
2025-09-30T14:56:41.228820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2303, pipe: [1:7555896310989886705:4281]
2025-09-30T14:56:41.292659Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:41.293154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:41.293168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:41.293205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896310989886705:4281], now have 1 active actors on pipe
2025-09-30T14:56:41.293478Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:41.295470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896310989886705:4281]
2025-09-30T14:56:41.295532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:41.295635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2304 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d1f87a36-5d6fbc19-d90d7831-d9048ab9_0
2025-09-30T14:56:41.295649Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:41.295831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2304 sessionId: src_id|d1f87a36-5d6fbc19-d90d7831-d9048ab9_0 is DEAD
2025-09-30T14:56:41.296027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1f87a36-5d6fbc19-d90d7831-d9048ab9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:41.296039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1f87a36-5d6fbc19-d90d7831-d9048ab9_0] Write session will restart in 0.006364s
2025-09-30T14:56:41.296065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1f87a36-5d6fbc19-d90d7831-d9048ab9_0] Write session: Do CDS request
2025-09-30T14:56:41.296071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1f87a36-5d6fbc19-d90d7831-d9048ab9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:41.304077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1f87a36-5d6fbc19-d90d7831-d9048ab9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:41.304224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:41.304257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2305
2025-09-30T14:56:41.304377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2305 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:41.304412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2305 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:41.304422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2305 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:41.304427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:41.305176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2305 sessionId:  describe result for acl check
2025-09-30T14:56:41.305225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:41.305227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:41.305229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:41.305236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896310989886725:4302] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:41.305874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896310989886725:4302] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:41.308836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896310989886725:4302] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:41.310545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:41.313015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:41.315969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896310989886725:4302] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:41.315990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896310989886725:4302] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:41.315997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896310989886725:4302] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:41.316007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2305 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:41.313351Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:41.313364Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:41.313377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:41.313456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:41.313494Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896310900113477:10545]
2025-09-30T14:56:41.314216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:41.317998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:41.318075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:41.318508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:41.318594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:41.318596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:41.318597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:41.318599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:41.318600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:41.318602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:41.318604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:41.318605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:41.318606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:41.318607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:41.318608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.318609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:41.318611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:41.318612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:41.318613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:41.318620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:41.318631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:41.318635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:41.318639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:41.318643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:41.318646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:41.318650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:41.318654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:41.318657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:41.318663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:41.318668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.318673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:41.318678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:41.318682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:41.318686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:41.318696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:41.318706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:41.318712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:41.318718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:41.318723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:41.318728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:41.318732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:41.318738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:41.318745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:41.318750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:41.318755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:41.318761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:41.318767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:41.318774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:41.318779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:41.318785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:41.318791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:41.318796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:41.318801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:41.318807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:41.318812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.318819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.318824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:41.318830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:41.318835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:41.318841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:41.318845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:41.318851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:41.318856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:41.318862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:41.318908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:41.325445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:41.326691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:41.326707Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:41.326710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:41.326714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:41.326721Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2304 [2:7555896310900113477:10545]
2025-09-30T14:56:41.326739Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:41.326755Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:41.326759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:41.326762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:41.326765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:41.326781Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:41.326789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:41.326796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:41.326872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.326880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:41.326882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:41.326886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:41.326890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:41.326962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:41.326970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.326985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:41.327002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:41.327025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:41.327046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896310900113472:10545]
2025-09-30T14:56:41.327053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896310900113472:10545]
2025-09-30T14:56:41.327055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896310900113472:10545]
2025-09-30T14:56:41.327073Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:41.327091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:41.327107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:41.327109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:41.327117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:41.327120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:41.327123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:41.327148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896310900113472:10545]
2025-09-30T14:56:41.327151Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:41.327216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:41.327279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896310989886851:4302], now have 1 active actors on pipe
2025-09-30T14:56:41.327286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896310989886709:2454], now have 1 active actors on pipe
2025-09-30T14:56:41.327421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2304
2025-09-30T14:56:41.327478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2304
2025-09-30T14:56:41.327563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:41.327577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:41.327609Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ae8e6ab-7bb7428d-efd0f17a-f307ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:41.327622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:41.327626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:41.327633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:41.327646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:41.327665Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:41.327686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:41.327855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:41.327868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:41.327889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:41.327985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2305 partition: 0 MaxSeqNo: 42 sessionId: src_id|8ae8e6ab-7bb7428d-efd0f17a-f307ba_0
2025-09-30T14:56:41.328353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1f87a36-5d6fbc19-d90d7831-d9048ab9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8ae8e6ab-7bb7428d-efd0f17a-f307ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:41.331412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ae8e6ab-7bb7428d-efd0f17a-f307ba_0] Write session: try to update token
2025-09-30T14:56:41.331432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ae8e6ab-7bb7428d-efd0f17a-f307ba_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:41.351604Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:41.351626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:41.351638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896310900113472:10545]
2025-09-30T14:56:41.351693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:41.352012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:41.352292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:41.352459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:41.352546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:41.352797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:41.353165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:41.353286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:41.353877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2305 sessionId: src_id|8ae8e6ab-7bb7428d-efd0f17a-f307ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:41.355578Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:41.355592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:41.355595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:41.355597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:41.355607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896310900113472:10545]
2025-09-30T14:56:41.355611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896310900113472:10545]
2025-09-30T14:56:41.355616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896310900113472:10545]
2025-09-30T14:56:41.355653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:41.355661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.355664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:41.355670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:41.355677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:41.355681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:41.355814Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:41.356665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:41.395407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896310989886861:4281]
2025-09-30T14:56:41.395727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2304, pipe: [1:7555896310989886861:4281]
2025-09-30T14:56:41.470450Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:41.470955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:41.470971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:41.470992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896310989886861:4281], now have 1 active actors on pipe
2025-09-30T14:56:41.471306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:41.471318Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:41.471325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:41.471324Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:41.471372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896310989886861:4281]
2025-09-30T14:56:41.471840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ae8e6ab-7bb7428d-efd0f17a-f307ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:41.471859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ae8e6ab-7bb7428d-efd0f17a-f307ba_0] Write session will restart in 0.005907s
2025-09-30T14:56:41.471397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2305 reason: error at write: Disconnected sessionId: src_id|8ae8e6ab-7bb7428d-efd0f17a-f307ba_0
2025-09-30T14:56:41.471586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2305 sessionId: src_id|8ae8e6ab-7bb7428d-efd0f17a-f307ba_0 is DEAD
2025-09-30T14:56:41.471885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ae8e6ab-7bb7428d-efd0f17a-f307ba_0] Write session: Do CDS request
2025-09-30T14:56:41.471892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ae8e6ab-7bb7428d-efd0f17a-f307ba_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:41.478833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ae8e6ab-7bb7428d-efd0f17a-f307ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:41.479020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:41.479044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2306
2025-09-30T14:56:41.479201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2306 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:41.479265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2306 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:41.479276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2306 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:41.479282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:41.479927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2306 sessionId:  describe result for acl check
2025-09-30T14:56:41.479979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:41.479981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:41.479983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:41.479996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896310989886872:4311] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:41.480578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896310989886872:4311] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:41.483504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896310989886872:4311] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:41.486675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896310989886872:4311] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:41.486696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896310989886872:4311] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:41.486700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896310989886872:4311] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:41.486708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2306 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:41.491638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:41.494632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:41.494878Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:41.494883Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:41.494898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:41.494956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:41.494992Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896310900113624:10547]
2025-09-30T14:56:41.495707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:41.496031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:41.496078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:41.496402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:41.496467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:41.496469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:41.496470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:41.496472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:41.496473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:41.496474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:41.496476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:41.496477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:41.496479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:41.496480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:41.496481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.496483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:41.496484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:41.496486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:41.496487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:41.496493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:41.496504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:41.496509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:41.496514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:41.496518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:41.496522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:41.496526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:41.496531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:41.496535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:41.496540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:41.496544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.496548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:41.496552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:41.496556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:41.496560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:41.496569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:41.496577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:41.496583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:41.496589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:41.496594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:41.496599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:41.496604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:41.496610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:41.496615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:41.496620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:41.496624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:41.496630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:41.496634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:41.496640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:41.496644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:41.496650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:41.496655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:41.496660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:41.496665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:41.496671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:41.496677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.496682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.496687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:41.496692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:41.496697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:41.496702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:41.496707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:41.496712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:41.496717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:41.496723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:41.496771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:41.503086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:41.504381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:41.504886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2305
2025-09-30T14:56:41.504400Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:41.504404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:41.504934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2305
2025-09-30T14:56:41.504410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:41.504418Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2305 [2:7555896310900113624:10547]
2025-09-30T14:56:41.504441Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:41.504461Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:41.504464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:41.504469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:41.504472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:41.504492Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:41.504499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:41.504507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:41.504577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.504579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:41.504582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:41.504586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:41.504589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:41.504667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:41.504670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.504685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:41.504699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:41.504719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:41.504739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896310989886862:2454], now have 1 active actors on pipe
2025-09-30T14:56:41.504746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896310900113619:10547]
2025-09-30T14:56:41.504748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896310900113619:10547]
2025-09-30T14:56:41.504750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896310900113619:10547]
2025-09-30T14:56:41.504767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:41.504782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:41.504796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:41.504799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:41.504805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896310989886956:4311], now have 1 active actors on pipe
2025-09-30T14:56:41.504810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:41.504816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:41.504818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:41.504840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896310900113619:10547]
2025-09-30T14:56:41.504843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:41.504846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:41.505112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:41.505124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:41.505150Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58c32426-5f3b6627-52113981-c43c26fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:41.505162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:41.505167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:41.505169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:41.505177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:41.505187Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:41.505202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:41.505404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:41.505414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:41.505430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:41.505557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2306 partition: 0 MaxSeqNo: 42 sessionId: src_id|58c32426-5f3b6627-52113981-c43c26fb_0
2025-09-30T14:56:41.505969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ae8e6ab-7bb7428d-efd0f17a-f307ba_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|58c32426-5f3b6627-52113981-c43c26fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:41.508906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58c32426-5f3b6627-52113981-c43c26fb_0] Write session: try to update token
2025-09-30T14:56:41.508932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58c32426-5f3b6627-52113981-c43c26fb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:41.523786Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:41.523806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:41.523816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896310900113619:10547]
2025-09-30T14:56:41.523863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:41.523869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:41.524037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:41.524182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:41.524319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:41.524457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:41.524679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:41.524711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:41.528622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2306 sessionId: src_id|58c32426-5f3b6627-52113981-c43c26fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:41.531677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:41.532029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:41.531886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:41.531910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:41.531943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:41.536220Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:41.536240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:41.536243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:41.536245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:41.536256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896310900113619:10547]
2025-09-30T14:56:41.536260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896310900113619:10547]
2025-09-30T14:56:41.536266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896310900113619:10547]
2025-09-30T14:56:41.536306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:41.536318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.536321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:41.536326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:41.536332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:41.536337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:41.536468Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:41.571524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896310989887016:4281]
2025-09-30T14:56:41.575971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2305, pipe: [1:7555896310989887016:4281]
2025-09-30T14:56:41.652370Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:41.661186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:41.661220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:41.661424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:41.661496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:41.661575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:41.661652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:41.661703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:41.661715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:41.661788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:41.661855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:41.661932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:41.662012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:41.662056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:41.662064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:41.662139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:41.662207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:41.662279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:41.662355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:41.662405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:41.662413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:41.662487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:41.662556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:41.662627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:41.662695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:41.662741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:41.662750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:41.662826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:41.662897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:41.662972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:41.663047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:41.663097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:41.663105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:41.663182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:41.663290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:41.663373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:41.663452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:41.663507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:41.663517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:41.663591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:41.663661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:41.663733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:41.663805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:41.663949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:41.663958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:41.664035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:41.664104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:41.664180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:41.664252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:41.664302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:41.664309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:41.664382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:41.664450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:41.664522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:41.664598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:41.664648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:41.664656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:41.665450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:41.665469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:41.665500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896310989887016:4281]
2025-09-30T14:56:41.665500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2306 reason: error at write: Disconnected sessionId: src_id|58c32426-5f3b6627-52113981-c43c26fb_0
2025-09-30T14:56:41.665518Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:41.665682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2306 sessionId: src_id|58c32426-5f3b6627-52113981-c43c26fb_0 is DEAD
2025-09-30T14:56:41.666015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c32426-5f3b6627-52113981-c43c26fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:41.666026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c32426-5f3b6627-52113981-c43c26fb_0] Write session will restart in 0.006107s
2025-09-30T14:56:41.666052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c32426-5f3b6627-52113981-c43c26fb_0] Write session: Do CDS request
2025-09-30T14:56:41.666068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c32426-5f3b6627-52113981-c43c26fb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:41.664730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:41.664798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:41.664863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:41.664928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:41.664971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:41.664974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:41.665053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896310989887016:4281], now have 1 active actors on pipe
2025-09-30T14:56:41.666391Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:41.673832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58c32426-5f3b6627-52113981-c43c26fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:41.673929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:41.673968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2307
2025-09-30T14:56:41.674106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2307 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:41.674140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2307 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:41.674145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2307 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:41.674150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:41.674634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2307 sessionId:  describe result for acl check
2025-09-30T14:56:41.674674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:41.674683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:41.674685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:41.674691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896310989887033:4318] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:41.675297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896310989887033:4318] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:41.677953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896310989887033:4318] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:41.684150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:41.684019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896310989887033:4318] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:41.684042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896310989887033:4318] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:41.684045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896310989887033:4318] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:41.684056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2307 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:41.686768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:41.686990Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:41.687013Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:41.687024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:41.687105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:41.687148Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896310900113769:10550]
2025-09-30T14:56:41.687842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:41.688225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:41.688273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:41.688650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:41.688719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:41.688725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:41.688727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:41.688728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:41.688729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:41.688731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:41.688732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:41.688733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:41.688735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:41.688736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:41.688737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.688739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:41.688740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:41.688741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:41.688743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:41.688748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:41.688758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:41.688763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:41.688766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:41.688771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:41.688775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:41.688779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:41.688783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:41.688788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:41.688792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:41.688796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.688800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:41.688805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:41.688809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:41.688813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:41.688821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:41.688829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:41.688836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:41.688841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:41.688847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:41.688853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:41.688858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:41.688863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:41.688868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:41.688875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:41.688885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:41.688891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:41.688896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:41.688900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:41.688904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:41.688908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:41.688913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:41.688922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:41.688928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:41.688933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:41.688939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.688952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.688957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:41.688963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:41.688970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:41.688976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:41.688989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:41.689002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:41.689009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:41.689023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:41.689075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:41.694734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:41.695961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:41.695978Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:41.695980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:41.695984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:41.695992Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2306 [2:7555896310900113769:10550]
2025-09-30T14:56:41.696010Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:41.696027Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:41.696036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:41.696039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:41.696041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:41.696060Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:41.696071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:41.696079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:41.696145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.696155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:41.696157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:41.696162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:41.696164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:41.696241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:41.696249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.696263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:41.696279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:41.696299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:41.696332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896310989887161:4318], now have 1 active actors on pipe
2025-09-30T14:56:41.696341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896310989887018:2454], now have 1 active actors on pipe
2025-09-30T14:56:41.696348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896310900113762:10550]
2025-09-30T14:56:41.696351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896310900113762:10550]
2025-09-30T14:56:41.696353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896310900113762:10550]
2025-09-30T14:56:41.696370Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:41.696385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:41.696404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:41.696407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:41.696411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:41.696415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:41.696417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:41.696443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2306
2025-09-30T14:56:41.696458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2306
2025-09-30T14:56:41.696449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896310900113762:10550]
2025-09-30T14:56:41.696465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:41.696483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:41.696511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:41.696517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:41.696552Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b3dc2de-f2dfdd66-1e2744d7-b949e7d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:41.696559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:41.696563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:41.696566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:41.696578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:41.696589Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:41.696606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:41.696819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:41.696827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:41.696842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:41.696928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2307 partition: 0 MaxSeqNo: 42 sessionId: src_id|2b3dc2de-f2dfdd66-1e2744d7-b949e7d9_0
2025-09-30T14:56:41.697342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c32426-5f3b6627-52113981-c43c26fb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2b3dc2de-f2dfdd66-1e2744d7-b949e7d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:41.700202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3dc2de-f2dfdd66-1e2744d7-b949e7d9_0] Write session: try to update token
2025-09-30T14:56:41.700220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3dc2de-f2dfdd66-1e2744d7-b949e7d9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:41.709296Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:41.709315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:41.709318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:41.709320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:41.709331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896310900113762:10550]
2025-09-30T14:56:41.709336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896310900113762:10550]
2025-09-30T14:56:41.709341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896310900113762:10550]
2025-09-30T14:56:41.709387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:41.709394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.709397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:41.709416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:41.709423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:41.709427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:41.709556Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:41.716226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2307 sessionId: src_id|2b3dc2de-f2dfdd66-1e2744d7-b949e7d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:41.719584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:41.766495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896310989887187:4281]
2025-09-30T14:56:41.766931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2306, pipe: [1:7555896310989887187:4281]
2025-09-30T14:56:41.832445Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:41.832781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:41.832791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:41.832811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896310989887187:4281], now have 1 active actors on pipe
2025-09-30T14:56:41.833113Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:41.833469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:41.833527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896310989887187:4281]
2025-09-30T14:56:41.833552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:41.833622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2307 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2b3dc2de-f2dfdd66-1e2744d7-b949e7d9_0
2025-09-30T14:56:41.833803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2307 sessionId: src_id|2b3dc2de-f2dfdd66-1e2744d7-b949e7d9_0 is DEAD
2025-09-30T14:56:41.834030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3dc2de-f2dfdd66-1e2744d7-b949e7d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:41.834042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3dc2de-f2dfdd66-1e2744d7-b949e7d9_0] Write session will restart in 0.008791s
2025-09-30T14:56:41.834067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3dc2de-f2dfdd66-1e2744d7-b949e7d9_0] Write session: Do CDS request
2025-09-30T14:56:41.834085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3dc2de-f2dfdd66-1e2744d7-b949e7d9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:41.843839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3dc2de-f2dfdd66-1e2744d7-b949e7d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:41.844412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:41.844429Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2308
2025-09-30T14:56:41.844604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2308 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:41.844648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2308 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:41.844652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2308 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:41.844655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:41.845049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2308 sessionId:  describe result for acl check
2025-09-30T14:56:41.845081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:41.845086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:41.845088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:41.845092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896310989887215:4338] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:41.845547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896310989887215:4338] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:41.847189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896310989887215:4338] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:41.850444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896310989887215:4338] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:41.850461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896310989887215:4338] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:41.850465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896310989887215:4338] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:41.850473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2308 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:41.854475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:41.856873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:41.857091Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:41.857104Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:41.857117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:41.857177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:41.857223Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896310900113950:10564]
2025-09-30T14:56:41.857960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:41.858365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:41.858422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:41.858785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:41.858861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:41.858868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:41.858870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:41.858871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:41.858872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:41.858874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:41.858875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:41.858876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:41.858878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:41.858879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:41.858880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.858881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:41.858882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:41.858884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:41.858885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:41.858891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:41.858903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:41.858908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:41.858912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:41.858916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:41.858920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:41.858925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:41.858929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:41.858934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:41.858939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:41.858943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.858947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:41.858951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:41.858956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:41.858960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:41.858970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:41.858980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:41.858986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:41.858992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:41.859004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:41.859011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:41.859020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:41.859026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:41.859037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:41.859043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:41.859053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:41.859059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:41.859065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:41.859075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:41.859080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:41.859088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:41.859113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:41.859123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:41.859129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:41.859139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:41.859144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.859154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.859158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:41.859164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:41.859169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:41.859180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:41.859185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:41.859197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:41.859207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:41.859214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:41.859285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:41.865596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:41.866568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:41.866594Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:41.866598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:41.866602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:41.866611Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2307 [2:7555896310900113950:10564]
2025-09-30T14:56:41.866630Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:41.866650Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:41.866654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:41.866658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:41.866660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:41.866679Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:41.866686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:41.866694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:41.866769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.866781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:41.866784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:41.866787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:41.866790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:41.866862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:41.866871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.866885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:41.866895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:41.866911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:41.866933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896310989887276:4338], now have 1 active actors on pipe
2025-09-30T14:56:41.866947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896310900113945:10564]
2025-09-30T14:56:41.866949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896310900113945:10564]
2025-09-30T14:56:41.866952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896310900113945:10564]
2025-09-30T14:56:41.866964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:41.866979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896310989887200:2454], now have 1 active actors on pipe
2025-09-30T14:56:41.866991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:41.866992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:41.867003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:41.867007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:41.867008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:41.867010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:41.867044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2307
2025-09-30T14:56:41.867079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2307
2025-09-30T14:56:41.867053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896310900113945:10564]
2025-09-30T14:56:41.867066Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:41.867070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:41.867107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:41.867112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:41.867142Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb7b17c9-759508b7-21e71fd3-56afda29_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:41.867149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:41.867153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:41.867155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:41.867165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:41.867176Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:41.867190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:41.867405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:41.867420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:41.867458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:41.867617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2308 partition: 0 MaxSeqNo: 42 sessionId: src_id|bb7b17c9-759508b7-21e71fd3-56afda29_0
2025-09-30T14:56:41.868081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3dc2de-f2dfdd66-1e2744d7-b949e7d9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bb7b17c9-759508b7-21e71fd3-56afda29_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:41.871476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb7b17c9-759508b7-21e71fd3-56afda29_0] Write session: try to update token
2025-09-30T14:56:41.871508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb7b17c9-759508b7-21e71fd3-56afda29_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:41.883407Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:41.883435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:41.883438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:41.883441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:41.883451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896310900113945:10564]
2025-09-30T14:56:41.883456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896310900113945:10564]
2025-09-30T14:56:41.883461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896310900113945:10564]
2025-09-30T14:56:41.883512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:41.883520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:41.883523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:41.883597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:41.883613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:41.883617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:41.883687Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:41.892865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2308 sessionId: src_id|bb7b17c9-759508b7-21e71fd3-56afda29_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:41.895799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:41.933506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896310989887352:4281]
2025-09-30T14:56:41.933774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2307, pipe: [1:7555896310989887352:4281]
2025-09-30T14:56:42.001743Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:42.002154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:42.002165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:42.002207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896310989887352:4281], now have 1 active actors on pipe
2025-09-30T14:56:42.002507Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:42.002681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896310989887352:4281]
2025-09-30T14:56:42.002722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:42.002799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2308 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bb7b17c9-759508b7-21e71fd3-56afda29_0
2025-09-30T14:56:42.002983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2308 sessionId: src_id|bb7b17c9-759508b7-21e71fd3-56afda29_0 is DEAD
2025-09-30T14:56:42.003182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:42.003426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb7b17c9-759508b7-21e71fd3-56afda29_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:42.003437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb7b17c9-759508b7-21e71fd3-56afda29_0] Write session will restart in 0.009411s
2025-09-30T14:56:42.003461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb7b17c9-759508b7-21e71fd3-56afda29_0] Write session: Do CDS request
2025-09-30T14:56:42.003467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb7b17c9-759508b7-21e71fd3-56afda29_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:42.013798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb7b17c9-759508b7-21e71fd3-56afda29_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:42.013940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:42.013964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2309
2025-09-30T14:56:42.014122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2309 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:42.014162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2309 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:42.014173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2309 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:42.014177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:42.014656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2309 sessionId:  describe result for acl check
2025-09-30T14:56:42.014696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:42.014704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:42.014706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:42.014721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896315284854668:4340] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:42.015319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896315284854668:4340] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:42.017681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896315284854668:4340] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:42.020899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896315284854668:4340] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:42.020915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896315284854668:4340] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:42.020919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896315284854668:4340] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:42.020927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2309 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:42.021583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:42.023804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:42.024217Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:42.024231Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:42.024245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:42.024309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:42.024350Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896315195081407:10568]
2025-09-30T14:56:42.024968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:42.025353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:42.025405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:42.025753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:42.025856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:42.025863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:42.025864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:42.025865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:42.025866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:42.025868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:42.025869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:42.025871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:42.025873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:42.025874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:42.025875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.025877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.025878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.025880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:42.025881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:42.025889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:42.025900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:42.025904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:42.025908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:42.025913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:42.025918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:42.025922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:42.025927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:42.025931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:42.025935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:42.025939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.025943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.025947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.025952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:42.025956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:42.025965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:42.025973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:42.025979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:42.025985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:42.025992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:42.025998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:42.026003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:42.026009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:42.026014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:42.026019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:42.026024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:42.026030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:42.026038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:42.026044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:42.026049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:42.026055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:42.026060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:42.026066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:42.026071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:42.026076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:42.026081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.026087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.026091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.026103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.026108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.026121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.026130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:42.026136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:42.026145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:42.026151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:42.026198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:42.032127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:42.033039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:42.033056Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:42.033059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:42.033064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:42.033072Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2308 [2:7555896315195081407:10568]
2025-09-30T14:56:42.033088Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:42.033109Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:42.033117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:42.033121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:42.033123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:42.033140Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:42.033152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:42.033159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:42.033211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.033217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.033223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.033226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:42.033228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:42.033295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:42.033302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.033311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.033318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.033327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:42.033347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896315195081402:10568]
2025-09-30T14:56:42.033355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896315195081402:10568]
2025-09-30T14:56:42.033357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896315195081402:10568]
2025-09-30T14:56:42.033365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:42.033376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:42.033376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:42.033380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:42.033382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:42.033395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:42.033399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:42.033408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896315284854652:2454], now have 1 active actors on pipe
2025-09-30T14:56:42.033416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896315284854792:4340], now have 1 active actors on pipe
2025-09-30T14:56:42.033448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896315195081402:10568]
2025-09-30T14:56:42.033464Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:42.033506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:42.033526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2308
2025-09-30T14:56:42.033629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:42.033639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:42.033662Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|592b75c5-fc46939a-75dcf5d4-420dfb1e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:42.033674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:42.033678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:42.033681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:42.033689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:42.033697Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:42.033698Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2308
2025-09-30T14:56:42.033709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:42.033891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:42.033898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:42.033911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:42.034000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2309 partition: 0 MaxSeqNo: 42 sessionId: src_id|592b75c5-fc46939a-75dcf5d4-420dfb1e_0
2025-09-30T14:56:42.034387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb7b17c9-759508b7-21e71fd3-56afda29_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|592b75c5-fc46939a-75dcf5d4-420dfb1e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:42.037278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|592b75c5-fc46939a-75dcf5d4-420dfb1e_0] Write session: try to update token
2025-09-30T14:56:42.037298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|592b75c5-fc46939a-75dcf5d4-420dfb1e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:42.048866Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:42.048888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:42.048890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:42.048893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:42.048908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896315195081402:10568]
2025-09-30T14:56:42.048912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896315195081402:10568]
2025-09-30T14:56:42.048917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896315195081402:10568]
2025-09-30T14:56:42.048962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:42.048967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:42.048970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.048973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:42.048973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:42.048977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:42.052367Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:42.056652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2309 sessionId: src_id|592b75c5-fc46939a-75dcf5d4-420dfb1e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:42.060193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:42.102979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896315284854817:4281]
2025-09-30T14:56:42.103281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2308, pipe: [1:7555896315284854817:4281]
2025-09-30T14:56:42.166128Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:42.166572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:42.166583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:42.166603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896315284854817:4281], now have 1 active actors on pipe
2025-09-30T14:56:42.166982Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:42.167026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:42.167028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:42.167096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2309 reason: error at write: Disconnected sessionId: src_id|592b75c5-fc46939a-75dcf5d4-420dfb1e_0
2025-09-30T14:56:42.166865Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:42.167371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2309 sessionId: src_id|592b75c5-fc46939a-75dcf5d4-420dfb1e_0 is DEAD
2025-09-30T14:56:42.167495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896315284854817:4281]
2025-09-30T14:56:42.167532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|592b75c5-fc46939a-75dcf5d4-420dfb1e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:42.167548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|592b75c5-fc46939a-75dcf5d4-420dfb1e_0] Write session will restart in 0.005343s
2025-09-30T14:56:42.167582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|592b75c5-fc46939a-75dcf5d4-420dfb1e_0] Write session: Do CDS request
2025-09-30T14:56:42.167589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|592b75c5-fc46939a-75dcf5d4-420dfb1e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:42.175711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|592b75c5-fc46939a-75dcf5d4-420dfb1e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:42.176157Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:42.176178Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2310
2025-09-30T14:56:42.176379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2310 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:42.176416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2310 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:42.176429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2310 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:42.176433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:42.176946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2310 sessionId:  describe result for acl check
2025-09-30T14:56:42.176993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:42.176996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:42.176998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:42.177004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896315284854834:4359] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:42.177612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896315284854834:4359] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:42.180675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896315284854834:4359] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:42.188188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:42.188170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896315284854834:4359] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:42.188201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896315284854834:4359] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:42.188205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896315284854834:4359] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:42.188214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2310 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:42.191175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:42.191471Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:42.191483Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:42.191496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:42.191555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:42.191624Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896315195081554:10570]
2025-09-30T14:56:42.192307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:42.192720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:42.192776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:42.193159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:42.193225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:42.193232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:42.193233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:42.193234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:42.193235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:42.193236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:42.193238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:42.193239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:42.193240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:42.193241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:42.193243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.193244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.193245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.193247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:42.193248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:42.193254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:42.193275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:42.193280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:42.193284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:42.193288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:42.193293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:42.193296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:42.193301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:42.193305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:42.193310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:42.193314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.193317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.193321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.193325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:42.193329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:42.193338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:42.193345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:42.193352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:42.193358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:42.193363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:42.193368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:42.193373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:42.193378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:42.193383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:42.193388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:42.193392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:42.193398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:42.193404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:42.193409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:42.193413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:42.193419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:42.193428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:42.193455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:42.193466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:42.193472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:42.193484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.193490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.193500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.193506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.193517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.193523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.193534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:42.193540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:42.193547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:42.193553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:42.193605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:42.199635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:42.200828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:42.200845Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:42.200848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:42.200853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:42.200861Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2309 [2:7555896315195081554:10570]
2025-09-30T14:56:42.200880Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:42.200897Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:42.200905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:42.200910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:42.200912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:42.200931Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:42.200939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:42.200945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:42.201011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.201020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.201023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.201027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:42.201030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:42.201104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:42.201113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.201129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.201147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.201171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:42.201193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896315195081548:10570]
2025-09-30T14:56:42.201201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896315195081548:10570]
2025-09-30T14:56:42.201203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896315195081548:10570]
2025-09-30T14:56:42.201213Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:42.201222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:42.201226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:42.201231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:42.201233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:42.201250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:42.201360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2309
2025-09-30T14:56:42.201258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:42.201365Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2309
2025-09-30T14:56:42.201282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896315284854821:2454], now have 1 active actors on pipe
2025-09-30T14:56:42.201286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896315284854966:4359], now have 1 active actors on pipe
2025-09-30T14:56:42.201342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896315195081548:10570]
2025-09-30T14:56:42.201351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:42.201358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:42.201626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:42.201641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:42.201673Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b39782ad-7f331126-5bc69728-87b30c40_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:42.201686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:42.201696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:42.201699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:42.201712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:42.201728Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:42.201749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:42.201965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:42.201979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:42.202003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:42.202118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2310 partition: 0 MaxSeqNo: 42 sessionId: src_id|b39782ad-7f331126-5bc69728-87b30c40_0
2025-09-30T14:56:42.202510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|592b75c5-fc46939a-75dcf5d4-420dfb1e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b39782ad-7f331126-5bc69728-87b30c40_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:42.205616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b39782ad-7f331126-5bc69728-87b30c40_0] Write session: try to update token
2025-09-30T14:56:42.205640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b39782ad-7f331126-5bc69728-87b30c40_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:42.214946Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:42.214973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:42.214976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:42.214979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:42.214994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896315195081548:10570]
2025-09-30T14:56:42.214999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896315195081548:10570]
2025-09-30T14:56:42.215004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896315195081548:10570]
2025-09-30T14:56:42.215050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:42.215059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.215069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:42.215073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:42.215080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:42.215088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:42.215224Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:42.224978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2310 sessionId: src_id|b39782ad-7f331126-5bc69728-87b30c40_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:42.228183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:42.266829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896315284854981:4281]
2025-09-30T14:56:42.267203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2309, pipe: [1:7555896315284854981:4281]
2025-09-30T14:56:42.341220Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:42.341725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:42.341747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:42.341769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896315284854981:4281], now have 1 active actors on pipe
2025-09-30T14:56:42.342069Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:42.342142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896315284854981:4281]
2025-09-30T14:56:42.342195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:42.342198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:42.342272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2310 reason: error at write: Disconnected sessionId: src_id|b39782ad-7f331126-5bc69728-87b30c40_0
2025-09-30T14:56:42.342466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2310 sessionId: src_id|b39782ad-7f331126-5bc69728-87b30c40_0 is DEAD
2025-09-30T14:56:42.342628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:42.343716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b39782ad-7f331126-5bc69728-87b30c40_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:42.343734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b39782ad-7f331126-5bc69728-87b30c40_0] Write session will restart in 0.008083s
2025-09-30T14:56:42.343782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b39782ad-7f331126-5bc69728-87b30c40_0] Write session: Do CDS request
2025-09-30T14:56:42.343795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b39782ad-7f331126-5bc69728-87b30c40_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:42.353107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b39782ad-7f331126-5bc69728-87b30c40_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:42.353608Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:42.353631Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2311
2025-09-30T14:56:42.353841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2311 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:42.353883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2311 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:42.353893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2311 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:42.353898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:42.354364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2311 sessionId:  describe result for acl check
2025-09-30T14:56:42.354401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:42.354409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:42.354414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:42.354420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896315284855079:4361] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:42.354993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896315284855079:4361] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:42.357161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:42.358302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896315284855079:4361] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:42.359914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:42.360163Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:42.360174Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:42.360199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:42.360253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:42.360307Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896315195081701:10572]
2025-09-30T14:56:42.360981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:42.361291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:42.361338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:42.361373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896315284855079:4361] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:42.361395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896315284855079:4361] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:42.361399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896315284855079:4361] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:42.361408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2311 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:42.361676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:42.361740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:42.361747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:42.361749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:42.361751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:42.361752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:42.361754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:42.361755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:42.361757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:42.361758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:42.361759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:42.361761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.361762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.361763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.361764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:42.361766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:42.361771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:42.361783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:42.361788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:42.361792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:42.361797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:42.361802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:42.361807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:42.361811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:42.361815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:42.361821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:42.361825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.361830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.361834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.361839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:42.361844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:42.361852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:42.361860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:42.361867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:42.361873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:42.361879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:42.361885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:42.361890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:42.361897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:42.361903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:42.361909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:42.361917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:42.361923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:42.361931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:42.361938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:42.361950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:42.361956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:42.361962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:42.361967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:42.361973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:42.361979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:42.361984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.361990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.362000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.362007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.362017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.362023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.362028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:42.362036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:42.362045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:42.362050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:42.362098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:42.368050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:42.369341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:42.369359Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:42.369363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:42.369366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:42.369373Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2310 [2:7555896315195081701:10572]
2025-09-30T14:56:42.369394Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:42.369413Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:42.369417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:42.369420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:42.369422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:42.369439Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:42.369446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:42.369452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:42.369513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.369526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.369528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.369532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:42.369534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:42.369604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:42.369612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.369626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.369640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.369659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:42.369681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896315195081696:10572]
2025-09-30T14:56:42.369687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896315195081696:10572]
2025-09-30T14:56:42.369689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896315195081696:10572]
2025-09-30T14:56:42.369703Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:42.369718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:42.369735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:42.369741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:42.369776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896315195081696:10572]
2025-09-30T14:56:42.369783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:42.369819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:42.369832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:42.369834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:42.369841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:42.369970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896315284855134:4361], now have 1 active actors on pipe
2025-09-30T14:56:42.369980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896315284854985:2454], now have 1 active actors on pipe
2025-09-30T14:56:42.370075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2310
2025-09-30T14:56:42.370095Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2310
2025-09-30T14:56:42.370203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:42.370216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:42.370244Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4815b011-c7817738-7aefc36-c32be0c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:42.370258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:42.370273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:42.370279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:42.370290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:42.370304Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:42.370328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:42.370513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:42.370527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:42.370546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:42.370637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2311 partition: 0 MaxSeqNo: 42 sessionId: src_id|4815b011-c7817738-7aefc36-c32be0c0_0
2025-09-30T14:56:42.374904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b39782ad-7f331126-5bc69728-87b30c40_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4815b011-c7817738-7aefc36-c32be0c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:42.378069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4815b011-c7817738-7aefc36-c32be0c0_0] Write session: try to update token
2025-09-30T14:56:42.378097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4815b011-c7817738-7aefc36-c32be0c0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:42.391208Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:42.391232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:42.391352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896315195081696:10572]
2025-09-30T14:56:42.391411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:42.391594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:42.391752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:42.391901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:42.392050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:42.392245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:42.392288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:42.392406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:42.398202Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:42.398226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:42.398229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:42.398231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:42.398241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896315195081696:10572]
2025-09-30T14:56:42.398246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896315195081696:10572]
2025-09-30T14:56:42.398250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896315195081696:10572]
2025-09-30T14:56:42.398292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:42.398299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.398302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:42.398315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:42.398323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:42.398328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:42.398443Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:42.408922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2311 sessionId: src_id|4815b011-c7817738-7aefc36-c32be0c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:42.412416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:42.442471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896315284855144:4281]
2025-09-30T14:56:42.448779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2310, pipe: [1:7555896315284855144:4281]
2025-09-30T14:56:42.528297Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:42.528700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:42.528714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:42.528750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896315284855144:4281], now have 1 active actors on pipe
2025-09-30T14:56:42.529067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:42.529099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896315284855144:4281]
2025-09-30T14:56:42.529140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:42.529186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2311 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4815b011-c7817738-7aefc36-c32be0c0_0
2025-09-30T14:56:42.528992Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:42.529473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2311 sessionId: src_id|4815b011-c7817738-7aefc36-c32be0c0_0 is DEAD
2025-09-30T14:56:42.529574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4815b011-c7817738-7aefc36-c32be0c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:42.529586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4815b011-c7817738-7aefc36-c32be0c0_0] Write session will restart in 0.009483s
2025-09-30T14:56:42.529609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4815b011-c7817738-7aefc36-c32be0c0_0] Write session: Do CDS request
2025-09-30T14:56:42.529615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4815b011-c7817738-7aefc36-c32be0c0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:42.540898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4815b011-c7817738-7aefc36-c32be0c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:42.541063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:42.541092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2312
2025-09-30T14:56:42.541293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2312 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:42.541337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2312 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:42.541353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2312 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:42.541363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:42.542022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2312 sessionId:  describe result for acl check
2025-09-30T14:56:42.542073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:42.542080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:42.542083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:42.542101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896315284855233:4373] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:42.542708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896315284855233:4373] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:42.544802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:42.546465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896315284855233:4373] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:42.547271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:42.547512Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:42.547524Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:42.547535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:42.547596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:42.547638Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896315195081852:10575]
2025-09-30T14:56:42.548350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:42.548702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:42.548753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:42.549113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:42.549192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:42.549199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:42.549200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:42.549202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:42.549203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:42.549205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:42.549206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:42.549208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:42.549209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:42.549210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:42.549212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.549213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.549215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.549216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:42.549217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:42.549224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:42.549235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:42.549240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:42.549244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:42.549248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:42.549253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:42.549270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:42.549274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:42.549279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:42.549284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:42.549288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.549292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.549296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.549301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:42.549306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:42.549314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:42.549323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:42.549329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:42.549342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:42.549350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:42.549361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:42.549367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:42.549373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:42.549379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:42.549390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:42.549346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896315284855233:4373] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:42.549395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:42.549406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:42.549412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:42.549377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896315284855233:4373] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:42.549382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896315284855233:4373] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:42.549398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2312 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:42.549419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:42.549429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:42.549435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:42.549441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:42.549447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:42.549451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:42.549457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:42.549468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.549474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.549483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.549489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.549499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.549504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.549514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:42.549520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:42.549530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:42.549537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:42.549591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:42.555292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:42.556433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:42.556453Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:42.556456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:42.556460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:42.556468Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2311 [2:7555896315195081852:10575]
2025-09-30T14:56:42.556485Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:42.556501Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:42.556509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:42.556513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:42.556515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:42.556531Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:42.556546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:42.556552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:42.556615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.556623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.556625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.556631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:42.556633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:42.556892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2311
2025-09-30T14:56:42.556948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2311
2025-09-30T14:56:42.557923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4815b011-c7817738-7aefc36-c32be0c0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|940a717-e4ec976-54ec194c-5f483058_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:42.557521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2312 partition: 0 MaxSeqNo: 42 sessionId: src_id|940a717-e4ec976-54ec194c-5f483058_0
2025-09-30T14:56:42.556703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:42.556715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.556728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.556743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.556762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:42.556782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896315284855147:2454], now have 1 active actors on pipe
2025-09-30T14:56:42.556788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896315195081847:10575]
2025-09-30T14:56:42.556791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896315195081847:10575]
2025-09-30T14:56:42.556793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896315195081847:10575]
2025-09-30T14:56:42.556807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:42.556817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896315284855296:4373], now have 1 active actors on pipe
2025-09-30T14:56:42.556825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:42.556825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:42.556829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:42.556831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:42.556840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:42.556843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:42.556881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896315195081847:10575]
2025-09-30T14:56:42.556889Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:42.556899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:42.557095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:42.557104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:42.557146Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|940a717-e4ec976-54ec194c-5f483058_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:42.557156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:42.557161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:42.557163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:42.557175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:42.557188Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:42.557204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:42.557405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:42.557410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:42.557431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:42.560985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|940a717-e4ec976-54ec194c-5f483058_0] Write session: try to update token
2025-09-30T14:56:42.561006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|940a717-e4ec976-54ec194c-5f483058_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:42.572444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:42.572471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:42.572474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:42.572476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:42.572491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896315195081847:10575]
2025-09-30T14:56:42.572495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896315195081847:10575]
2025-09-30T14:56:42.572500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896315195081847:10575]
2025-09-30T14:56:42.572546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:42.572554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.572557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:42.572721Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:42.573004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:42.573011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:42.573016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:42.585862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2312 sessionId: src_id|940a717-e4ec976-54ec194c-5f483058_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:42.588916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:42.630585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896315284855305:4281]
2025-09-30T14:56:42.630974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2311, pipe: [1:7555896315284855305:4281]
2025-09-30T14:56:42.694094Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:42.694507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:42.694523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:42.694542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896315284855305:4281], now have 1 active actors on pipe
2025-09-30T14:56:42.695204Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:42.695290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:42.695300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:42.695365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2312 reason: error at write: Disconnected sessionId: src_id|940a717-e4ec976-54ec194c-5f483058_0
2025-09-30T14:56:42.695537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2312 sessionId: src_id|940a717-e4ec976-54ec194c-5f483058_0 is DEAD
2025-09-30T14:56:42.695668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896315284855305:4281]
2025-09-30T14:56:42.695767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|940a717-e4ec976-54ec194c-5f483058_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:42.695778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|940a717-e4ec976-54ec194c-5f483058_0] Write session will restart in 0.007889s
2025-09-30T14:56:42.695803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|940a717-e4ec976-54ec194c-5f483058_0] Write session: Do CDS request
2025-09-30T14:56:42.695809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|940a717-e4ec976-54ec194c-5f483058_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:42.694993Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:42.707707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|940a717-e4ec976-54ec194c-5f483058_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:42.707829Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:42.707852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2313
2025-09-30T14:56:42.708052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2313 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:42.708087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2313 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:42.708092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2313 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:42.708096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:42.708699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2313 sessionId:  describe result for acl check
2025-09-30T14:56:42.708738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:42.708744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:42.708746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:42.708753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896315284855371:4381] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:42.709332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896315284855371:4381] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:42.712975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896315284855371:4381] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:42.713525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:42.720073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896315284855371:4381] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:42.720096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896315284855371:4381] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:42.720099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896315284855371:4381] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:42.720108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2313 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:42.719935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:42.720213Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:42.720218Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:42.720229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:42.720287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:42.720326Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896315195082002:10577]
2025-09-30T14:56:42.721007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:42.721516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:42.721599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:42.721991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:42.722067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:42.722076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:42.722077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:42.722079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:42.722081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:42.722082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:42.722083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:42.722085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:42.722086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:42.722088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:42.722089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.722090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.722092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.722093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:42.722095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:42.722102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:42.722113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:42.722118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:42.722123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:42.722128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:42.722132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:42.722137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:42.722141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:42.722146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:42.722151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:42.722155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.722159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.722163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.722168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:42.722172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:42.722180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:42.722189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:42.722195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:42.722202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:42.722223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:42.722235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:42.722246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:42.722253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:42.722259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:42.722265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:42.722270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:42.722276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:42.722281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:42.722287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:42.722292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:42.722298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:42.722309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:42.722316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:42.722320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:42.722326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:42.722333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.722339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.722344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.722349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.722355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.722361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.722366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:42.722371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:42.722386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:42.722392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:42.722441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:42.729297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:42.730594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:42.730609Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:42.730612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:42.730616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:42.730623Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2312 [2:7555896315195082002:10577]
2025-09-30T14:56:42.730643Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:42.730659Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:42.730662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:42.730665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:42.730667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:42.730684Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:42.730700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:42.730707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:42.730770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.730777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.730779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.730782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:42.730785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:42.730856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:42.730865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.730879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.730889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.730905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:42.730924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896315284855457:4381], now have 1 active actors on pipe
2025-09-30T14:56:42.730935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896315195081997:10577]
2025-09-30T14:56:42.730937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896315195081997:10577]
2025-09-30T14:56:42.730939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896315195081997:10577]
2025-09-30T14:56:42.730955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:42.730969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896315284855309:2454], now have 1 active actors on pipe
2025-09-30T14:56:42.730977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:42.730981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:42.730986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:42.730988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:42.730992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:42.730995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:42.731034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896315195081997:10577]
2025-09-30T14:56:42.731049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:42.731070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2312
2025-09-30T14:56:42.731085Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2312
2025-09-30T14:56:42.731058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:42.731275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:42.731282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:42.731316Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfd36d99-98352b3e-3c038cb1-fd207ed9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:42.731333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:42.731337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:42.731339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:42.731350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:42.731361Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:42.731382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:42.731697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:42.731710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:42.731731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:42.731883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2313 partition: 0 MaxSeqNo: 42 sessionId: src_id|cfd36d99-98352b3e-3c038cb1-fd207ed9_0
2025-09-30T14:56:42.732281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|940a717-e4ec976-54ec194c-5f483058_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cfd36d99-98352b3e-3c038cb1-fd207ed9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:42.735533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfd36d99-98352b3e-3c038cb1-fd207ed9_0] Write session: try to update token
2025-09-30T14:56:42.735560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfd36d99-98352b3e-3c038cb1-fd207ed9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:42.745250Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:42.745290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:42.745301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896315195081997:10577]
2025-09-30T14:56:42.745351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:42.745400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:42.745566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:42.745767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:42.745943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:42.746119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:42.746343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:42.746393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:42.757320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2313 sessionId: src_id|cfd36d99-98352b3e-3c038cb1-fd207ed9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:42.757738Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:42.757761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:42.757763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:42.757765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:42.757775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896315195081997:10577]
2025-09-30T14:56:42.757779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896315195081997:10577]
2025-09-30T14:56:42.757784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896315195081997:10577]
2025-09-30T14:56:42.757830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:42.757840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.757843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:42.757981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:42.757994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:42.757994Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:42.757998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:42.760101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:42.793693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896315284855468:4281]
2025-09-30T14:56:42.794005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2312, pipe: [1:7555896315284855468:4281]
2025-09-30T14:56:42.876258Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:42.876560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:42.876573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:42.876591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896315284855468:4281], now have 1 active actors on pipe
2025-09-30T14:56:42.876824Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:42.877156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:42.877241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2313 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cfd36d99-98352b3e-3c038cb1-fd207ed9_0
2025-09-30T14:56:42.877444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2313 sessionId: src_id|cfd36d99-98352b3e-3c038cb1-fd207ed9_0 is DEAD
2025-09-30T14:56:42.877749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896315284855468:4281]
2025-09-30T14:56:42.877762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:42.879499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfd36d99-98352b3e-3c038cb1-fd207ed9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:42.879512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfd36d99-98352b3e-3c038cb1-fd207ed9_0] Write session will restart in 0.008402s
2025-09-30T14:56:42.879535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfd36d99-98352b3e-3c038cb1-fd207ed9_0] Write session: Do CDS request
2025-09-30T14:56:42.879541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfd36d99-98352b3e-3c038cb1-fd207ed9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:42.888803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfd36d99-98352b3e-3c038cb1-fd207ed9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:42.889244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:42.889270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2314
2025-09-30T14:56:42.889402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2314 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:42.889443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2314 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:42.889448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2314 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:42.889451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:42.889847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2314 sessionId:  describe result for acl check
2025-09-30T14:56:42.889880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:42.889882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:42.889885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:42.889890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896315284855510:4406] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:42.890411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896315284855510:4406] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:42.892193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896315284855510:4406] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:42.895699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896315284855510:4406] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:42.895717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896315284855510:4406] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:42.895721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896315284855510:4406] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:42.895730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2314 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:42.899699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:42.901917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:42.902129Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:42.902141Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:42.902151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:42.902202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:42.902248Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896315195082203:10592]
2025-09-30T14:56:42.902941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:42.903304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:42.903350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:42.903744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:42.903809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:42.903815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:42.903816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:42.903817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:42.903819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:42.903820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:42.903821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:42.903822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:42.903824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:42.903825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:42.903826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.903828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.903829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.903831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:42.903832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:42.903838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:42.903850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:42.903855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:42.903860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:42.903864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:42.903869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:42.903873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:42.903877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:42.903882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:42.903887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:42.903890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.903894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.903897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.903901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:42.903905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:42.903913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:42.903921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:42.903928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:42.903934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:42.903941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:42.903948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:42.903953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:42.903961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:42.903966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:42.903971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:42.903976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:42.903983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:42.903991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:42.903998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:42.904007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:42.904014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:42.904023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:42.904029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:42.904039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:42.904044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:42.904054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.904060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.904069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.904075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.904079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.904089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.904094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:42.904100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:42.904110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:42.904116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:42.904167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:42.909692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:42.910839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:42.910857Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:42.910860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:42.910864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:42.910871Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2313 [2:7555896315195082203:10592]
2025-09-30T14:56:42.910887Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:42.910902Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:42.910905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:42.910908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:42.910911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:42.910929Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:42.910936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:42.910942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:42.911012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.911020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.911022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.911026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:42.911028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:42.911096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:42.911307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2313
2025-09-30T14:56:42.911358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2313
2025-09-30T14:56:42.911098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.911111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:42.911123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:42.911140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:42.911156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896315195082198:10592]
2025-09-30T14:56:42.911159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896315195082198:10592]
2025-09-30T14:56:42.911161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896315195082198:10592]
2025-09-30T14:56:42.911169Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:42.911181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:42.911182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896315284855578:4406], now have 1 active actors on pipe
2025-09-30T14:56:42.911184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:42.911186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896315284855495:2454], now have 1 active actors on pipe
2025-09-30T14:56:42.911187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:42.911195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:42.911209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:42.911212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:42.911290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896315195082198:10592]
2025-09-30T14:56:42.911299Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:42.911306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:42.911542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:42.911558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:42.911589Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca9b8adb-a2a75764-b13abed4-d71ea1c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:42.911603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:42.911613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:42.911615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:42.911626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:42.911637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:42.911657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:42.911846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:42.911857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:42.911879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:42.911966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2314 partition: 0 MaxSeqNo: 42 sessionId: src_id|ca9b8adb-a2a75764-b13abed4-d71ea1c0_0
2025-09-30T14:56:42.912343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfd36d99-98352b3e-3c038cb1-fd207ed9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ca9b8adb-a2a75764-b13abed4-d71ea1c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:42.915260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca9b8adb-a2a75764-b13abed4-d71ea1c0_0] Write session: try to update token
2025-09-30T14:56:42.915281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca9b8adb-a2a75764-b13abed4-d71ea1c0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:42.924049Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:42.924073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:42.924076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:42.924078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:42.924087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896315195082198:10592]
2025-09-30T14:56:42.924091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896315195082198:10592]
2025-09-30T14:56:42.924096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896315195082198:10592]
2025-09-30T14:56:42.924138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:42.924146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:42.924148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:42.924161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:42.924170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:42.924178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:42.924296Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:42.930479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2314 sessionId: src_id|ca9b8adb-a2a75764-b13abed4-d71ea1c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:42.933855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:42.977496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896315284855652:4281]
2025-09-30T14:56:42.977914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2313, pipe: [1:7555896315284855652:4281]
2025-09-30T14:56:43.038534Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:43.038861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:43.038874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:43.038907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896315284855652:4281], now have 1 active actors on pipe
2025-09-30T14:56:43.039126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896315284855652:4281]
2025-09-30T14:56:43.039133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:43.039138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:43.039170Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:43.039208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2314 reason: error at write: Disconnected sessionId: src_id|ca9b8adb-a2a75764-b13abed4-d71ea1c0_0
2025-09-30T14:56:43.039279Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:43.039429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2314 sessionId: src_id|ca9b8adb-a2a75764-b13abed4-d71ea1c0_0 is DEAD
2025-09-30T14:56:43.039580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca9b8adb-a2a75764-b13abed4-d71ea1c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:43.039591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca9b8adb-a2a75764-b13abed4-d71ea1c0_0] Write session will restart in 0.008018s
2025-09-30T14:56:43.039616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca9b8adb-a2a75764-b13abed4-d71ea1c0_0] Write session: Do CDS request
2025-09-30T14:56:43.039636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca9b8adb-a2a75764-b13abed4-d71ea1c0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:43.048997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca9b8adb-a2a75764-b13abed4-d71ea1c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:43.049112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:43.049130Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2315
2025-09-30T14:56:43.049313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2315 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:43.049347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2315 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:43.049353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2315 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:43.049357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:43.049847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2315 sessionId:  describe result for acl check
2025-09-30T14:56:43.049890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:43.049896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:43.049899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:43.049906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896319579822966:4408] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:43.050468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896319579822966:4408] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:43.053173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896319579822966:4408] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:43.056168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896319579822966:4408] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:43.056187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896319579822966:4408] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:43.056190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896319579822966:4408] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:43.056199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2315 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:43.057189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:43.059233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:43.059443Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:43.059453Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:43.059474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:43.059521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:43.059553Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896319490049654:10595]
2025-09-30T14:56:43.060138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:43.060406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:43.060452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:43.060776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:43.060965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:43.060972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:43.060974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:43.060975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:43.060976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:43.060977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:43.060978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:43.060980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:43.060981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:43.060982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:43.060983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.060984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.060985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.060987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:43.060988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:43.060993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:43.061004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:43.061008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:43.061012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:43.061017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:43.061021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:43.061025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:43.061029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:43.061034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:43.061038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:43.061042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.061046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.061050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.061054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:43.061058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:43.061065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:43.061074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:43.061080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:43.061086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:43.061092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:43.061098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:43.061102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:43.061108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:43.061112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:43.061117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:43.061122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:43.061127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:43.061131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:43.061137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:43.061141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:43.061146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:43.061151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:43.061156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:43.061161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:43.061166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:43.061170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.061182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.061187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.061192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.061201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.061205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.061209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:43.061214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:43.061219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:43.061224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:43.061276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:43.066814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:43.067707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:43.067734Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:43.067737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:43.067741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:43.067747Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2314 [2:7555896319490049654:10595]
2025-09-30T14:56:43.067773Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:43.067793Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:43.067796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:43.067799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:43.067802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:43.067818Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:43.067825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:43.067832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:43.067887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.067899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.067901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.067905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:43.067907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:43.067976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:43.067985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.067997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.068015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.068033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:43.068057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896319579822951:2454], now have 1 active actors on pipe
2025-09-30T14:56:43.068065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896319579823098:4408], now have 1 active actors on pipe
2025-09-30T14:56:43.068072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896319490049649:10595]
2025-09-30T14:56:43.068075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896319490049649:10595]
2025-09-30T14:56:43.068077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896319490049649:10595]
2025-09-30T14:56:43.068092Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:43.068106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:43.068125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:43.068125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:43.068129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:43.068131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:43.068132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:43.068165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896319490049649:10595]
2025-09-30T14:56:43.068176Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:43.068195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:43.068348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2314
2025-09-30T14:56:43.068387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2314
2025-09-30T14:56:43.068452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:43.068467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:43.068493Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16d79a67-ba2defb6-4d3a07bf-6a64212e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:43.068507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:43.068515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:43.068518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:43.068529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:43.068541Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:43.068557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:43.068719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:43.068746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:43.068772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:43.068880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2315 partition: 0 MaxSeqNo: 42 sessionId: src_id|16d79a67-ba2defb6-4d3a07bf-6a64212e_0
2025-09-30T14:56:43.069275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca9b8adb-a2a75764-b13abed4-d71ea1c0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|16d79a67-ba2defb6-4d3a07bf-6a64212e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:43.072046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16d79a67-ba2defb6-4d3a07bf-6a64212e_0] Write session: try to update token
2025-09-30T14:56:43.072065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16d79a67-ba2defb6-4d3a07bf-6a64212e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:43.080283Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:43.080302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:43.080312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896319490049649:10595]
2025-09-30T14:56:43.080357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:43.080365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:43.080531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:43.080682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:43.080829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:43.080971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:43.081162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:43.081211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:43.087228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2315 sessionId: src_id|16d79a67-ba2defb6-4d3a07bf-6a64212e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:43.090170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:43.090408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:43.090431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:43.091753Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:43.091773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:43.091776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:43.091777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:43.091787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896319490049649:10595]
2025-09-30T14:56:43.091792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896319490049649:10595]
2025-09-30T14:56:43.091796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896319490049649:10595]
2025-09-30T14:56:43.091837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:43.091854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:43.091858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:43.091869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:43.091873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:43.091878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.091881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:43.091964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:43.092022Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:43.139319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896319579823127:4281]
2025-09-30T14:56:43.139633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2314, pipe: [1:7555896319579823127:4281]
2025-09-30T14:56:43.215985Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:43.228673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:43.228709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:43.228899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:43.228978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:43.229053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:43.229135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:43.229186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:43.229196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:43.229294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:43.229367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:43.229443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:43.229511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:43.229554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:43.229557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:43.229628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:43.229694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:43.229755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:43.229815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:43.229854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:43.229858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:43.229937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:43.230011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:43.230075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:43.230138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:43.230180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:43.230184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:43.230259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:43.230321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:43.230384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:43.230447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:43.230595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:43.230599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:43.230669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:43.230728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:43.230788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:43.230851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:43.230892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:43.230895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:43.230969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:43.231039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:43.231113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:43.231180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:43.231226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:43.231229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:43.231499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:43.231573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:43.231643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:43.231714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:43.231761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:43.231769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:43.231842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:43.231908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:43.231976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:43.232046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:43.232091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:43.232100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:43.232173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:43.232241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:43.232315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:43.232387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:43.232428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:43.232431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:43.232504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896319579823127:4281], now have 1 active actors on pipe
2025-09-30T14:56:43.234114Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:43.234159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:43.234163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:43.234171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896319579823127:4281]
2025-09-30T14:56:43.234193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2315 reason: error at write: Disconnected sessionId: src_id|16d79a67-ba2defb6-4d3a07bf-6a64212e_0
2025-09-30T14:56:43.234115Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:43.234384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2315 sessionId: src_id|16d79a67-ba2defb6-4d3a07bf-6a64212e_0 is DEAD
2025-09-30T14:56:43.234543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16d79a67-ba2defb6-4d3a07bf-6a64212e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:43.234556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16d79a67-ba2defb6-4d3a07bf-6a64212e_0] Write session will restart in 0.006370s
2025-09-30T14:56:43.234588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16d79a67-ba2defb6-4d3a07bf-6a64212e_0] Write session: Do CDS request
2025-09-30T14:56:43.234594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16d79a67-ba2defb6-4d3a07bf-6a64212e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:43.243681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16d79a67-ba2defb6-4d3a07bf-6a64212e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:43.245252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:43.245286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2316
2025-09-30T14:56:43.245457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2316 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:43.245504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2316 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:43.245515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2316 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:43.245519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:43.245935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2316 sessionId:  describe result for acl check
2025-09-30T14:56:43.245976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:43.245987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:43.245989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:43.245997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896319579823204:4435] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:43.246545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896319579823204:4435] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:43.249416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:43.249602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896319579823204:4435] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:43.251664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:43.251892Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:43.251904Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:43.251917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:43.251966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:43.252013Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896319490049807:10597]
2025-09-30T14:56:43.252522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:43.252547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896319579823204:4435] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:43.252565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896319579823204:4435] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:43.252569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896319579823204:4435] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:43.252577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2316 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:43.252882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:43.252936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:43.253297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:43.253371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:43.253373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:43.253374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:43.253375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:43.253376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:43.253378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:43.253379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:43.253380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:43.253382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:43.253383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:43.253384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.253386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.253387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.253388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:43.253389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:43.253395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:43.253404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:43.253406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:43.253409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:43.253411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:43.253413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:43.253416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:43.253418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:43.253421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:43.253423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:43.253426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.253428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.253430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.253433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:43.253435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:43.253441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:43.253446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:43.253450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:43.253454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:43.253457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:43.253460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:43.253463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:43.253466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:43.253469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:43.253472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:43.253474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:43.253477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:43.253480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:43.253483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:43.253486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:43.253489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:43.253492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:43.253495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:43.253499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:43.253502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:43.253505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.253510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.253512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.253515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.253518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.253520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.253523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:43.253526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:43.253528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:43.253531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:43.253556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:43.259736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:43.260754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:43.260773Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:43.260776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:43.260780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:43.260787Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2315 [2:7555896319490049807:10597]
2025-09-30T14:56:43.260807Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:43.260823Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:43.260831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:43.260834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:43.260836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:43.260854Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:43.260865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:43.260874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:43.260932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.260944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.260947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.260950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:43.260953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:43.261023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:43.261026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.261039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.261052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.261067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:43.261083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896319490049802:10597]
2025-09-30T14:56:43.261086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896319490049802:10597]
2025-09-30T14:56:43.261089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896319490049802:10597]
2025-09-30T14:56:43.261102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:43.261111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:43.261243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2315
2025-09-30T14:56:43.261248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2315
2025-09-30T14:56:43.261114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:43.261116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:43.261117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896319579823135:2454], now have 1 active actors on pipe
2025-09-30T14:56:43.261121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896319579823285:4435], now have 1 active actors on pipe
2025-09-30T14:56:43.261129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:43.261145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:43.261149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:43.261184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896319490049802:10597]
2025-09-30T14:56:43.261192Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:43.261214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:43.261415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:43.261427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:43.261452Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f921ac4a-93cd57c8-67806979-1165b8e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:43.261461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:43.261470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:43.261472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:43.261487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:43.261502Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:43.261524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:43.261784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:43.261800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:43.261824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:43.261929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2316 partition: 0 MaxSeqNo: 42 sessionId: src_id|f921ac4a-93cd57c8-67806979-1165b8e6_0
2025-09-30T14:56:43.262289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16d79a67-ba2defb6-4d3a07bf-6a64212e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f921ac4a-93cd57c8-67806979-1165b8e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:43.265273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f921ac4a-93cd57c8-67806979-1165b8e6_0] Write session: try to update token
2025-09-30T14:56:43.265300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f921ac4a-93cd57c8-67806979-1165b8e6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:43.273553Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:43.273571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:43.273574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:43.273576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:43.273591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896319490049802:10597]
2025-09-30T14:56:43.273595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896319490049802:10597]
2025-09-30T14:56:43.273600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896319490049802:10597]
2025-09-30T14:56:43.273643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:43.273651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.273651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:43.273654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:43.273657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:43.273661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:43.273811Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:43.281818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2316 sessionId: src_id|f921ac4a-93cd57c8-67806979-1165b8e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:43.284735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:43.334371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896319579823300:4281]
2025-09-30T14:56:43.334677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2315, pipe: [1:7555896319579823300:4281]
2025-09-30T14:56:43.393841Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:43.394196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:43.394215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:43.394236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896319579823300:4281], now have 1 active actors on pipe
2025-09-30T14:56:43.394482Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:43.394938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f921ac4a-93cd57c8-67806979-1165b8e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:43.394948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f921ac4a-93cd57c8-67806979-1165b8e6_0] Write session will restart in 0.005668s
2025-09-30T14:56:43.394972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f921ac4a-93cd57c8-67806979-1165b8e6_0] Write session: Do CDS request
2025-09-30T14:56:43.394977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f921ac4a-93cd57c8-67806979-1165b8e6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:43.394479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:43.394483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:43.394500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:43.394541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896319579823300:4281]
2025-09-30T14:56:43.394579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2316 reason: error at write: Disconnected sessionId: src_id|f921ac4a-93cd57c8-67806979-1165b8e6_0
2025-09-30T14:56:43.394757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2316 sessionId: src_id|f921ac4a-93cd57c8-67806979-1165b8e6_0 is DEAD
2025-09-30T14:56:43.401765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f921ac4a-93cd57c8-67806979-1165b8e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:43.401814Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:43.401835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2317
2025-09-30T14:56:43.401993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2317 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:43.402025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2317 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:43.402044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2317 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:43.402055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:43.402491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2317 sessionId:  describe result for acl check
2025-09-30T14:56:43.402525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:43.402532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:43.402534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:43.402540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896319579823317:4440] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:43.403088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896319579823317:4440] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:43.405621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896319579823317:4440] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:43.408440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896319579823317:4440] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:43.408458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896319579823317:4440] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:43.408472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896319579823317:4440] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:43.408482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2317 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:43.409782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:43.411547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:43.411788Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:43.411793Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:43.411816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:43.411883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:43.411924Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896319490049963:10599]
2025-09-30T14:56:43.412567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:43.413018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:43.413086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:43.413476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:43.413550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:43.413557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:43.413559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:43.413560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:43.413561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:43.413563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:43.413564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:43.413565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:43.413566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:43.413568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:43.413569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.413571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.413572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.413573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:43.413575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:43.413582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:43.413594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:43.413599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:43.413603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:43.413607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:43.413611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:43.413615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:43.413619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:43.413623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:43.413628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:43.413631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.413636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.413640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.413645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:43.413650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:43.413659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:43.413668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:43.413675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:43.413682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:43.413688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:43.413694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:43.413699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:43.413705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:43.413711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:43.413717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:43.413723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:43.413729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:43.413735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:43.413748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:43.413756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:43.413763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:43.413769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:43.413775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:43.413780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:43.413786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:43.413792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.413803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.413808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.413820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.413825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.413831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.413842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:43.413849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:43.413859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:43.413865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:43.413918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:43.419849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:43.420857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:43.420878Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:43.420882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:43.420887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:43.420894Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2316 [2:7555896319490049963:10599]
2025-09-30T14:56:43.420913Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:43.420933Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:43.420944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:43.420947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:43.420950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:43.420969Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:43.420976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:43.420982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:43.421046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.421049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.421052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.421056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:43.421059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:43.421379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:43.421389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.421341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2316
2025-09-30T14:56:43.421403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.421362Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2316
2025-09-30T14:56:43.421416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.421429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:43.421446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896319579823453:4440], now have 1 active actors on pipe
2025-09-30T14:56:43.421448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896319579823302:2454], now have 1 active actors on pipe
2025-09-30T14:56:43.421455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896319490049958:10599]
2025-09-30T14:56:43.421457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896319490049958:10599]
2025-09-30T14:56:43.421460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896319490049958:10599]
2025-09-30T14:56:43.421476Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:43.421491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:43.421501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:43.421506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:43.421508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:43.421513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:43.421517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:43.421556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896319490049958:10599]
2025-09-30T14:56:43.421565Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:43.421581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:43.421601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:43.421609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:43.421635Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bde1ddca-c930e3a1-be8933dd-cdfa3b88_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:43.421647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:43.421653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:43.421660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:43.421671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:43.421686Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:43.421703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:43.421905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:43.421920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:43.421946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:43.422070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2317 partition: 0 MaxSeqNo: 42 sessionId: src_id|bde1ddca-c930e3a1-be8933dd-cdfa3b88_0
2025-09-30T14:56:43.422517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f921ac4a-93cd57c8-67806979-1165b8e6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bde1ddca-c930e3a1-be8933dd-cdfa3b88_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:43.426490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bde1ddca-c930e3a1-be8933dd-cdfa3b88_0] Write session: try to update token
2025-09-30T14:56:43.426513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bde1ddca-c930e3a1-be8933dd-cdfa3b88_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:43.434708Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:43.434739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:43.434743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:43.434746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:43.434757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896319490049958:10599]
2025-09-30T14:56:43.434764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896319490049958:10599]
2025-09-30T14:56:43.434771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896319490049958:10599]
2025-09-30T14:56:43.434820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:43.434825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:43.434827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:43.434831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:43.434832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.434835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:43.435051Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:43.442687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2317 sessionId: src_id|bde1ddca-c930e3a1-be8933dd-cdfa3b88_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:43.445851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:43.494593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896319579823465:4281]
2025-09-30T14:56:43.494894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2316, pipe: [1:7555896319579823465:4281]
2025-09-30T14:56:43.544915Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:43.545286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:43.545302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:43.545323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896319579823465:4281], now have 1 active actors on pipe
2025-09-30T14:56:43.545622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896319579823465:4281]
2025-09-30T14:56:43.545632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:43.545637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:43.545664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:43.545716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2317 reason: error at write: Disconnected sessionId: src_id|bde1ddca-c930e3a1-be8933dd-cdfa3b88_0
2025-09-30T14:56:43.545934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2317 sessionId: src_id|bde1ddca-c930e3a1-be8933dd-cdfa3b88_0 is DEAD
2025-09-30T14:56:43.546106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde1ddca-c930e3a1-be8933dd-cdfa3b88_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:43.546119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde1ddca-c930e3a1-be8933dd-cdfa3b88_0] Write session will restart in 0.005451s
2025-09-30T14:56:43.546155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde1ddca-c930e3a1-be8933dd-cdfa3b88_0] Write session: Do CDS request
2025-09-30T14:56:43.546161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde1ddca-c930e3a1-be8933dd-cdfa3b88_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:43.547088Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:43.553137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bde1ddca-c930e3a1-be8933dd-cdfa3b88_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:43.553197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:43.553231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2318
2025-09-30T14:56:43.553465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2318 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:43.553503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2318 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:43.553512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2318 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:43.553517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:43.554004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2318 sessionId:  describe result for acl check
2025-09-30T14:56:43.554038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:43.554044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:43.554045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:43.554053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896319579823478:4445] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:43.554563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896319579823478:4445] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:43.557092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896319579823478:4445] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:43.560722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896319579823478:4445] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:43.560746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896319579823478:4445] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:43.560750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896319579823478:4445] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:43.560759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2318 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:43.563788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:43.566593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:43.566850Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:43.566855Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:43.566868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:43.566930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:43.566970Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896319490050121:10602]
2025-09-30T14:56:43.567680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:43.568135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:43.568199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:43.568604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:43.568725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:43.568726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:43.568728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:43.568729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:43.568731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:43.568732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:43.568734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:43.568736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:43.568738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:43.568739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:43.568740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.568742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.568744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.568745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:43.568747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:43.568754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:43.568767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:43.568773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:43.568778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:43.568783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:43.568787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:43.568792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:43.568797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:43.568800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:43.568805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:43.568808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.568812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.568815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.568819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:43.568823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:43.568833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:43.568843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:43.568850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:43.568856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:43.568860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:43.568867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:43.568872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:43.568879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:43.568885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:43.568891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:43.568896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:43.568901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:43.568910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:43.568917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:43.568922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:43.568929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:43.568934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:43.568941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:43.568946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:43.568953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:43.568959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.568965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.568971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.568977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.568982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.568988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.568993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:43.568998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:43.569003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:43.569009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:43.569054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:43.576855Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2317
2025-09-30T14:56:43.576870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2317
2025-09-30T14:56:43.575136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:43.576420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:43.576428Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:43.576431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:43.576435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:43.576443Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2317 [2:7555896319490050121:10602]
2025-09-30T14:56:43.576461Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:43.576478Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:43.576482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:43.576485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:43.576488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:43.576506Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:43.576514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:43.576521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:43.576592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.576595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.576597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.576601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:43.576604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:43.576684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:43.576688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.576702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.576715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.576734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:43.576753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896319579823467:2454], now have 1 active actors on pipe
2025-09-30T14:56:43.576756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896319579823589:4445], now have 1 active actors on pipe
2025-09-30T14:56:43.576764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896319490050116:10602]
2025-09-30T14:56:43.576767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896319490050116:10602]
2025-09-30T14:56:43.576769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896319490050116:10602]
2025-09-30T14:56:43.576778Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:43.576793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:43.576800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:43.576809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:43.576813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:43.576832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:43.576836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:43.576852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896319490050116:10602]
2025-09-30T14:56:43.576856Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:43.576881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:43.577122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:43.577141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:43.577171Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf3feb4-53d61508-caf18bc-dabd5e7a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:43.577190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:43.577200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:43.577203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:43.577215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:43.577235Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:43.577272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:43.577530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:43.577544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:43.577566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:43.577705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2318 partition: 0 MaxSeqNo: 42 sessionId: src_id|bf3feb4-53d61508-caf18bc-dabd5e7a_0
2025-09-30T14:56:43.578094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde1ddca-c930e3a1-be8933dd-cdfa3b88_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bf3feb4-53d61508-caf18bc-dabd5e7a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:43.581034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf3feb4-53d61508-caf18bc-dabd5e7a_0] Write session: try to update token
2025-09-30T14:56:43.581056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf3feb4-53d61508-caf18bc-dabd5e7a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:43.594291Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:43.594313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:43.594315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:43.594318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:43.594329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896319490050116:10602]
2025-09-30T14:56:43.594336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896319490050116:10602]
2025-09-30T14:56:43.594341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896319490050116:10602]
2025-09-30T14:56:43.594387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:43.594394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.594397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:43.594421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:43.594440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:43.594449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:43.594549Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:43.599324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2318 sessionId: src_id|bf3feb4-53d61508-caf18bc-dabd5e7a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:43.602274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:43.645640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896319579823631:4281]
2025-09-30T14:56:43.645926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2317, pipe: [1:7555896319579823631:4281]
2025-09-30T14:56:43.711535Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:43.711967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:43.711982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:43.712023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896319579823631:4281], now have 1 active actors on pipe
2025-09-30T14:56:43.712268Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:43.712257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:43.712276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:43.712285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:43.712333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896319579823631:4281]
2025-09-30T14:56:43.712340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2318 reason: error at write: Disconnected sessionId: src_id|bf3feb4-53d61508-caf18bc-dabd5e7a_0
2025-09-30T14:56:43.712522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2318 sessionId: src_id|bf3feb4-53d61508-caf18bc-dabd5e7a_0 is DEAD
2025-09-30T14:56:43.712679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf3feb4-53d61508-caf18bc-dabd5e7a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:43.712689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf3feb4-53d61508-caf18bc-dabd5e7a_0] Write session will restart in 0.009537s
2025-09-30T14:56:43.712724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf3feb4-53d61508-caf18bc-dabd5e7a_0] Write session: Do CDS request
2025-09-30T14:56:43.712729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf3feb4-53d61508-caf18bc-dabd5e7a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:43.723815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf3feb4-53d61508-caf18bc-dabd5e7a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:43.723871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:43.723892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2319
2025-09-30T14:56:43.724054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2319 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:43.724090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2319 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:43.724101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2319 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:43.724105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:43.724555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2319 sessionId:  describe result for acl check
2025-09-30T14:56:43.724597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:43.724604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:43.724606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:43.724612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896319579823710:4468] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:43.725191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896319579823710:4468] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:43.727483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896319579823710:4468] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:43.727643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:43.729843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:43.730056Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:43.730069Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:43.730080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:43.730137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:43.730181Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896319490050277:10604]
2025-09-30T14:56:43.730321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896319579823710:4468] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:43.730338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896319579823710:4468] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:43.730342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896319579823710:4468] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:43.730350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2319 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:43.730913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:43.731308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:43.731364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:43.731717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:43.731787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:43.731795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:43.731797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:43.731798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:43.731800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:43.731801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:43.731803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:43.731804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:43.731806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:43.731807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:43.731809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.731810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.731811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.731813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:43.731814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:43.731821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:43.731832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:43.731837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:43.731842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:43.731847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:43.731852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:43.731857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:43.731861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:43.731866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:43.731871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:43.731876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.731880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.731885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.731889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:43.731893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:43.731903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:43.731911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:43.731918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:43.731925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:43.731935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:43.731942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:43.731947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:43.731958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:43.731964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:43.731973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:43.731978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:43.731984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:43.731992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:43.732001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:43.732012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:43.732018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:43.732028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:43.732034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:43.732039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:43.732046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:43.732051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.732058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.732065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.732070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.732081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.732087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.732092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:43.732103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:43.732108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:43.732116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:43.732163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:43.738023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:43.738932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:43.738951Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:43.738955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:43.738959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:43.738966Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2318 [2:7555896319490050277:10604]
2025-09-30T14:56:43.738984Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:43.739000Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:43.739004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:43.739006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:43.739009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:43.739027Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:43.739034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:43.739049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:43.739116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.739125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.739129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.739132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:43.739135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:43.739208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:43.739217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.739231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.739266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.739287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:43.739313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896319579823789:4468], now have 1 active actors on pipe
2025-09-30T14:56:43.739322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896319579823635:2454], now have 1 active actors on pipe
2025-09-30T14:56:43.739328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896319490050272:10604]
2025-09-30T14:56:43.739331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896319490050272:10604]
2025-09-30T14:56:43.739334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896319490050272:10604]
2025-09-30T14:56:43.739347Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:43.739363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:43.739367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:43.739368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:43.739370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:43.739386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:43.739397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:43.739400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2318
2025-09-30T14:56:43.739410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2318
2025-09-30T14:56:43.739496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896319490050272:10604]
2025-09-30T14:56:43.739514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:43.739540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:43.739549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:43.739554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:43.739592Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d823782-91374be3-fd23c9da-d7c92b8b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:43.739603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:43.739609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:43.739611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:43.739622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:43.739630Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:43.739648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:43.739848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:43.739863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:43.739887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:43.739998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2319 partition: 0 MaxSeqNo: 42 sessionId: src_id|4d823782-91374be3-fd23c9da-d7c92b8b_0
2025-09-30T14:56:43.740385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf3feb4-53d61508-caf18bc-dabd5e7a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4d823782-91374be3-fd23c9da-d7c92b8b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:43.743193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d823782-91374be3-fd23c9da-d7c92b8b_0] Write session: try to update token
2025-09-30T14:56:43.743212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d823782-91374be3-fd23c9da-d7c92b8b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:43.752140Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:43.752168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:43.752170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:43.752173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:43.752185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896319490050272:10604]
2025-09-30T14:56:43.752191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896319490050272:10604]
2025-09-30T14:56:43.752195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896319490050272:10604]
2025-09-30T14:56:43.752236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:43.752243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.752241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:43.752247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:43.752247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:43.752251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:43.752396Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:43.760567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2319 sessionId: src_id|4d823782-91374be3-fd23c9da-d7c92b8b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:43.763593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:43.812575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896319579823801:4281]
2025-09-30T14:56:43.813214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2318, pipe: [1:7555896319579823801:4281]
2025-09-30T14:56:43.873494Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:43.873954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:43.873971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:43.873990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896319579823801:4281], now have 1 active actors on pipe
2025-09-30T14:56:43.874207Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:43.874178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896319579823801:4281]
2025-09-30T14:56:43.874180Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:43.874214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:43.874220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:43.874288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2319 reason: error at write: Disconnected sessionId: src_id|4d823782-91374be3-fd23c9da-d7c92b8b_0
2025-09-30T14:56:43.874486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2319 sessionId: src_id|4d823782-91374be3-fd23c9da-d7c92b8b_0 is DEAD
2025-09-30T14:56:43.875462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d823782-91374be3-fd23c9da-d7c92b8b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:43.875475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d823782-91374be3-fd23c9da-d7c92b8b_0] Write session will restart in 0.008599s
2025-09-30T14:56:43.875498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d823782-91374be3-fd23c9da-d7c92b8b_0] Write session: Do CDS request
2025-09-30T14:56:43.875508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d823782-91374be3-fd23c9da-d7c92b8b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:43.885749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d823782-91374be3-fd23c9da-d7c92b8b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:43.885889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:43.885907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2320
2025-09-30T14:56:43.886153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2320 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:43.886206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2320 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:43.886211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2320 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:43.886215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:43.886623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2320 sessionId:  describe result for acl check
2025-09-30T14:56:43.886659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:43.886666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:43.886668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:43.886674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896319579823920:4477] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:43.887206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896319579823920:4477] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:43.889019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896319579823920:4477] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:43.891823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:43.891892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896319579823920:4477] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:43.891912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896319579823920:4477] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:43.891915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896319579823920:4477] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:43.891924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2320 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:43.894478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:43.894693Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:43.894707Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:43.894719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:43.894781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:43.894821Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896319490050461:10612]
2025-09-30T14:56:43.895508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:43.895870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:43.895924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:43.896273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:43.896344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:43.896350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:43.896352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:43.896353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:43.896354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:43.896356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:43.896357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:43.896358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:43.896359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:43.896360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:43.896362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.896363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.896364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.896365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:43.896367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:43.896373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:43.896384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:43.896388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:43.896392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:43.896397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:43.896402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:43.896407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:43.896411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:43.896416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:43.896420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:43.896424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.896428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.896431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.896435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:43.896438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:43.896445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:43.896453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:43.896458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:43.896462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:43.896467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:43.896472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:43.896476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:43.896481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:43.896485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:43.896490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:43.896494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:43.896499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:43.896503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:43.896507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:43.896511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:43.896515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:43.896519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:43.896524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:43.896528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:43.896533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:43.896537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.896542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.896546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.896551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.896556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.896562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.896570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:43.896576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:43.896587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:43.896593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:43.896635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:43.902225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:43.903395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:43.903412Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:43.903415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:43.903420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:43.903426Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2319 [2:7555896319490050461:10612]
2025-09-30T14:56:43.903443Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:43.903462Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:43.903470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:43.903473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:43.903476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:43.903494Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:43.903506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:43.903512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:43.903571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.903578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.903580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.903584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:43.903587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:43.903661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:43.903669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.903686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:43.903700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:43.903722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:43.903753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896319579823969:4477], now have 1 active actors on pipe
2025-09-30T14:56:43.903757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896319579823803:2454], now have 1 active actors on pipe
2025-09-30T14:56:43.903763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896319490050455:10612]
2025-09-30T14:56:43.903771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896319490050455:10612]
2025-09-30T14:56:43.903773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896319490050455:10612]
2025-09-30T14:56:43.903786Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:43.903799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:43.903806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:43.903810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:43.903812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:43.903818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:43.903822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:43.903856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896319490050455:10612]
2025-09-30T14:56:43.903863Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:43.903866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:43.903832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2319
2025-09-30T14:56:43.903880Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2319
2025-09-30T14:56:43.903880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:43.903891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:43.904046Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bcab3838-6526ce25-647f1ec4-59aa4334_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:43.904079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:43.904083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:43.904085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:43.904095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:43.904106Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:43.904140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:43.904322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:43.904332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:43.904347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:43.904480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2320 partition: 0 MaxSeqNo: 42 sessionId: src_id|bcab3838-6526ce25-647f1ec4-59aa4334_0
2025-09-30T14:56:43.904889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d823782-91374be3-fd23c9da-d7c92b8b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bcab3838-6526ce25-647f1ec4-59aa4334_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:43.907784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcab3838-6526ce25-647f1ec4-59aa4334_0] Write session: try to update token
2025-09-30T14:56:43.907804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcab3838-6526ce25-647f1ec4-59aa4334_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:43.916605Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:43.916641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:43.916643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:43.916646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:43.916656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896319490050455:10612]
2025-09-30T14:56:43.916663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896319490050455:10612]
2025-09-30T14:56:43.916670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896319490050455:10612]
2025-09-30T14:56:43.916721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:43.916720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:43.916727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:43.916731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:43.916735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:43.916737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:43.917010Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:43.923311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2320 sessionId: src_id|bcab3838-6526ce25-647f1ec4-59aa4334_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:43.926240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:43.974305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896319579824000:4281]
2025-09-30T14:56:43.974590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2319, pipe: [1:7555896319579824000:4281]
2025-09-30T14:56:44.032437Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:44.032781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:44.032807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:44.032848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896319579824000:4281], now have 1 active actors on pipe
2025-09-30T14:56:44.033140Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:44.033185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896319579824000:4281]
2025-09-30T14:56:44.033217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:44.033219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:44.033223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:44.033322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2320 reason: error at write: Disconnected sessionId: src_id|bcab3838-6526ce25-647f1ec4-59aa4334_0
2025-09-30T14:56:44.033503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2320 sessionId: src_id|bcab3838-6526ce25-647f1ec4-59aa4334_0 is DEAD
2025-09-30T14:56:44.036252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcab3838-6526ce25-647f1ec4-59aa4334_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:44.036263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcab3838-6526ce25-647f1ec4-59aa4334_0] Write session will restart in 0.007839s
2025-09-30T14:56:44.036288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcab3838-6526ce25-647f1ec4-59aa4334_0] Write session: Do CDS request
2025-09-30T14:56:44.036294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcab3838-6526ce25-647f1ec4-59aa4334_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:44.045806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcab3838-6526ce25-647f1ec4-59aa4334_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:44.045877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:44.045909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2321
2025-09-30T14:56:44.046054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2321 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:44.046097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2321 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:44.046108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2321 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:44.046112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:44.046588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2321 sessionId:  describe result for acl check
2025-09-30T14:56:44.046626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:44.046633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:44.046636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:44.046642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896323874791408:4487] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:44.047192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896323874791408:4487] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:44.048898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:44.050087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896323874791408:4487] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:44.051304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:44.051531Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:44.051540Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:44.051553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:44.051618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:44.051662Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896323785017940:10622]
2025-09-30T14:56:44.052339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:44.052597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:44.052640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:44.052870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896323874791408:4487] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:44.052889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896323874791408:4487] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:44.052893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896323874791408:4487] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:44.052907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2321 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:44.052957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:44.053017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:44.053024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:44.053025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:44.053026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:44.053027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:44.053029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:44.053030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:44.053031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:44.053033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:44.053034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:44.053035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.053036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.053038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.053039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:44.053040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:44.053045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:44.053055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:44.053060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:44.053064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:44.053069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:44.053073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:44.053077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:44.053081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:44.053084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:44.053089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:44.053093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.053097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.053101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.053106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:44.053109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:44.053117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:44.053125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:44.053131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:44.053137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:44.053141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:44.053147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:44.053151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:44.053156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:44.053161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:44.053166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:44.053176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:44.053182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:44.053189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:44.053198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:44.053202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:44.053206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:44.053210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:44.053216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:44.053224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:44.053230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:44.053238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.053244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.053248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.053266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.053271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.053277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.053281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:44.053291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:44.053296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:44.053305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:44.053346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:44.058981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:44.060385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:44.060406Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:44.060409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:44.060413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:44.060421Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2320 [2:7555896323785017940:10622]
2025-09-30T14:56:44.060438Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:44.060455Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:44.060458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:44.060461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:44.060464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:44.060482Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:44.060490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:44.060497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:44.060559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.060561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.060563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.060567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:44.060570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:44.060645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:44.060654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.060668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.060679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.060695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:44.060714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896323785017935:10622]
2025-09-30T14:56:44.060717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896323785017935:10622]
2025-09-30T14:56:44.060719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896323785017935:10622]
2025-09-30T14:56:44.060729Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:44.060742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:44.060746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896323874791298:2454], now have 1 active actors on pipe
2025-09-30T14:56:44.060750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896323874791456:4487], now have 1 active actors on pipe
2025-09-30T14:56:44.060757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:44.060758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:44.060761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:44.060770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:44.060773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:44.060810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896323785017935:10622]
2025-09-30T14:56:44.060827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:44.060908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:44.060919Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2320
2025-09-30T14:56:44.060974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2320
2025-09-30T14:56:44.061903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2321 partition: 0 MaxSeqNo: 42 sessionId: src_id|d5dcb7b3-5bb372ad-4a601277-f6dbd529_0
2025-09-30T14:56:44.062317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcab3838-6526ce25-647f1ec4-59aa4334_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d5dcb7b3-5bb372ad-4a601277-f6dbd529_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:44.065294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5dcb7b3-5bb372ad-4a601277-f6dbd529_0] Write session: try to update token
2025-09-30T14:56:44.065315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5dcb7b3-5bb372ad-4a601277-f6dbd529_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:44.061030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:44.061063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:44.061095Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5dcb7b3-5bb372ad-4a601277-f6dbd529_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:44.061104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:44.061108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:44.061121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:44.061137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:44.061154Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:44.061176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:44.061736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:44.061742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:44.061766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:44.074541Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:44.074563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:44.074566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:44.074568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:44.074577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896323785017935:10622]
2025-09-30T14:56:44.074583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896323785017935:10622]
2025-09-30T14:56:44.074587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896323785017935:10622]
2025-09-30T14:56:44.074628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:44.074635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.074638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:44.074654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:44.074661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:44.074665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:44.074785Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:44.080587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2321 sessionId: src_id|d5dcb7b3-5bb372ad-4a601277-f6dbd529_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:44.083545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:44.133054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896323874791477:4281]
2025-09-30T14:56:44.133350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2320, pipe: [1:7555896323874791477:4281]
2025-09-30T14:56:44.186562Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:44.186976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:44.186993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:44.187034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896323874791477:4281], now have 1 active actors on pipe
2025-09-30T14:56:44.187428Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:44.187820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5dcb7b3-5bb372ad-4a601277-f6dbd529_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:44.187830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5dcb7b3-5bb372ad-4a601277-f6dbd529_0] Write session will restart in 0.007970s
2025-09-30T14:56:44.187853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5dcb7b3-5bb372ad-4a601277-f6dbd529_0] Write session: Do CDS request
2025-09-30T14:56:44.187858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5dcb7b3-5bb372ad-4a601277-f6dbd529_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:44.187337Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:44.187397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896323874791477:4281]
2025-09-30T14:56:44.187424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:44.187427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:44.187496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2321 reason: error at write: Disconnected sessionId: src_id|d5dcb7b3-5bb372ad-4a601277-f6dbd529_0
2025-09-30T14:56:44.187666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2321 sessionId: src_id|d5dcb7b3-5bb372ad-4a601277-f6dbd529_0 is DEAD
2025-09-30T14:56:44.199713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5dcb7b3-5bb372ad-4a601277-f6dbd529_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:44.200054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:44.200075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2322
2025-09-30T14:56:44.200240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2322 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:44.200293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2322 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:44.200304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2322 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:44.200309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:44.200778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2322 sessionId:  describe result for acl check
2025-09-30T14:56:44.200826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:44.200832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:44.200834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:44.200840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896323874791502:4499] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:44.201415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896323874791502:4499] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:44.206669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896323874791502:4499] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:44.209764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:44.212293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:44.212575Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:44.212586Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:44.212598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:44.212665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:44.212716Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896323785018100:10624]
2025-09-30T14:56:44.213408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:44.213803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:44.213861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:44.214249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:44.214312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:44.214318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:44.214319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:44.214320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:44.214322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:44.214323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:44.214324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:44.214325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:44.214327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:44.214328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:44.214329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.214330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.214332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.214333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:44.214334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:44.214339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:44.214350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:44.214355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:44.214359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:44.214363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:44.214368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:44.214372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:44.214376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:44.214380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:44.214385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:44.214389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.214393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.214397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.214401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:44.214405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:44.214415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:44.214424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:44.214430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:44.214436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:44.214440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:44.214453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:44.214457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:44.214463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:44.214467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:44.214472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:44.214477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:44.214483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:44.214488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:44.214494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:44.214499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:44.214504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:44.214509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:44.214514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:44.214516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:44.214520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:44.214525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.214530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.214536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.214543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.214549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.214559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.214564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:44.214570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:44.214574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:44.214580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:44.214628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:44.215546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896323874791502:4499] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:44.215573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896323874791502:4499] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:44.215576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896323874791502:4499] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:44.215585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2322 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:44.222700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2321
2025-09-30T14:56:44.222704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2321
2025-09-30T14:56:44.223207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2322 partition: 0 MaxSeqNo: 42 sessionId: src_id|13cd520f-b34d7dae-b888cd1e-f54ff571_0
2025-09-30T14:56:44.221023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:44.222217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:44.222223Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:44.222225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:44.222230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:44.222237Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2321 [2:7555896323785018100:10624]
2025-09-30T14:56:44.222255Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:44.222272Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:44.222275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:44.222279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:44.222282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:44.222321Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:44.222329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:44.222336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:44.222403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.222405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.222407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.222411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:44.222414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:44.222487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:44.222490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.222503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.222515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.222534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:44.222552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896323785018095:10624]
2025-09-30T14:56:44.222555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896323785018095:10624]
2025-09-30T14:56:44.222558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896323785018095:10624]
2025-09-30T14:56:44.222574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:44.222589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896323874791646:4499], now have 1 active actors on pipe
2025-09-30T14:56:44.222593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896323874791483:2454], now have 1 active actors on pipe
2025-09-30T14:56:44.222601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:44.222617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:44.222617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:44.222620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:44.222621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:44.222624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:44.222657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896323785018095:10624]
2025-09-30T14:56:44.222667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:44.222676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:44.222830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:44.222836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:44.222862Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13cd520f-b34d7dae-b888cd1e-f54ff571_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:44.222869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:44.222873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:44.222876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:44.222887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:44.222898Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:44.222912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:44.223089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:44.223093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:44.223106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:44.223602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5dcb7b3-5bb372ad-4a601277-f6dbd529_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|13cd520f-b34d7dae-b888cd1e-f54ff571_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:44.226470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13cd520f-b34d7dae-b888cd1e-f54ff571_0] Write session: try to update token
2025-09-30T14:56:44.226491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13cd520f-b34d7dae-b888cd1e-f54ff571_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:44.246048Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:44.246076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:44.246087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896323785018095:10624]
2025-09-30T14:56:44.246135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:44.246144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:44.246331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:44.246496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:44.246649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:44.246805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:44.247022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:44.247075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:44.254992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2322 sessionId: src_id|13cd520f-b34d7dae-b888cd1e-f54ff571_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:44.257923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:44.258145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:44.258182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:44.258212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:44.258285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:44.264193Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:44.264218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:44.264221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:44.264223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:44.264233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896323785018095:10624]
2025-09-30T14:56:44.264237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896323785018095:10624]
2025-09-30T14:56:44.264245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896323785018095:10624]
2025-09-30T14:56:44.264288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:44.264300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.264304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:44.264305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:44.264317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:44.264323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:44.264441Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:44.287700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896323874791657:4281]
2025-09-30T14:56:44.288054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2321, pipe: [1:7555896323874791657:4281]
2025-09-30T14:56:44.384748Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:44.393546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:44.393582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:44.393769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:44.393844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:44.393917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:44.393989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:44.394042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:44.394052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:44.394130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:44.394203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:44.394277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:44.394693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:44.394740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:44.394743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:44.394818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:44.394877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:44.394940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:44.395005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:44.395048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:44.395051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:44.395123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:44.395189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:44.398036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896323874791657:4281]
2025-09-30T14:56:44.398043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:44.398047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:44.398078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2322 reason: error at write: Disconnected sessionId: src_id|13cd520f-b34d7dae-b888cd1e-f54ff571_0
2025-09-30T14:56:44.398084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:44.398279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2322 sessionId: src_id|13cd520f-b34d7dae-b888cd1e-f54ff571_0 is DEAD
2025-09-30T14:56:44.398455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13cd520f-b34d7dae-b888cd1e-f54ff571_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:44.398466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13cd520f-b34d7dae-b888cd1e-f54ff571_0] Write session will restart in 0.009426s
2025-09-30T14:56:44.398495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13cd520f-b34d7dae-b888cd1e-f54ff571_0] Write session: Do CDS request
2025-09-30T14:56:44.398502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13cd520f-b34d7dae-b888cd1e-f54ff571_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:44.395371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:44.395442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:44.395682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:44.395685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:44.395759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:44.395824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:44.395891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:44.395954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:44.396002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:44.396005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:44.396082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:44.396146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:44.396210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:44.396276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:44.396343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:44.396347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:44.396423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:44.396487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:44.396557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:44.396620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:44.396684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:44.396691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:44.396768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:44.396832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:44.396899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:44.396971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:44.397017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:44.397020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:44.397096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:44.397157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:44.397221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:44.397304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:44.397349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:44.397352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:44.397433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:44.397501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:44.397573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:44.397642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:44.397686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:44.397689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:44.397776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896323874791657:4281], now have 1 active actors on pipe
2025-09-30T14:56:44.398750Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:44.408753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13cd520f-b34d7dae-b888cd1e-f54ff571_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:44.408872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:44.408894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2323
2025-09-30T14:56:44.409138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2323 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:44.409175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2323 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:44.409180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2323 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:44.409184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:44.409589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2323 sessionId:  describe result for acl check
2025-09-30T14:56:44.409623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:44.409625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:44.409629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:44.409634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896323874791685:4494] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:44.410110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896323874791685:4494] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:44.413008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896323874791685:4494] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:44.422461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896323874791685:4494] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:44.422484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896323874791685:4494] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:44.422489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896323874791685:4494] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:44.422498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2323 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:44.424118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:44.427734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:44.427973Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:44.427977Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:44.427988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:44.428042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:44.428095Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896323785018262:10626]
2025-09-30T14:56:44.428796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:44.429288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:44.429341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:44.429672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:44.429750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:44.429751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:44.429752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:44.429753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:44.429754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:44.429756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:44.429757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:44.429758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:44.429759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:44.429761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:44.429762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.429763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.429765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.429766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:44.429767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:44.429773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:44.429783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:44.429788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:44.429793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:44.429801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:44.429807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:44.429811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:44.429815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:44.429818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:44.429822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:44.429826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.429829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.429833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.429837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:44.429841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:44.429849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:44.429858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:44.429863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:44.429869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:44.429875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:44.429880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:44.429887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:44.429892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:44.429896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:44.429902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:44.429906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:44.429910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:44.429916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:44.429920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:44.429923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:44.429927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:44.429931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:44.429935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:44.429941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:44.429945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:44.429950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.429954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.429959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.429963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.429970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.429974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.429977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:44.429981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:44.429985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:44.429989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:44.430029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:44.439915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:44.441069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:44.441086Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:44.441089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:44.441093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:44.441100Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2322 [2:7555896323785018262:10626]
2025-09-30T14:56:44.441117Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:44.441133Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:44.441136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:44.441140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:44.441143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:44.441160Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:44.441168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:44.441185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:44.441247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.441264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.441266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.441271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:44.441273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:44.441344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:44.441346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.441360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.441373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.441390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:44.441407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896323785018257:10626]
2025-09-30T14:56:44.441411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896323785018257:10626]
2025-09-30T14:56:44.441413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896323785018257:10626]
2025-09-30T14:56:44.441422Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:44.441437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:44.441452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:44.441455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:44.441461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:44.441465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:44.441467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:44.441496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896323874791817:4494], now have 1 active actors on pipe
2025-09-30T14:56:44.441500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896323874791660:2454], now have 1 active actors on pipe
2025-09-30T14:56:44.441503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896323785018257:10626]
2025-09-30T14:56:44.441512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:44.441626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2322
2025-09-30T14:56:44.441657Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2322
2025-09-30T14:56:44.441699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:44.441912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:44.441927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:44.441954Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c08373f-8023108-3c0cf8-c2d147ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:44.441968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:44.441973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:44.441975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:44.441986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:44.442000Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:44.442016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:44.447468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:44.447491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:44.447528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:44.447761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2323 partition: 0 MaxSeqNo: 42 sessionId: src_id|6c08373f-8023108-3c0cf8-c2d147ec_0
2025-09-30T14:56:44.448158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13cd520f-b34d7dae-b888cd1e-f54ff571_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6c08373f-8023108-3c0cf8-c2d147ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:44.450898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c08373f-8023108-3c0cf8-c2d147ec_0] Write session: try to update token
2025-09-30T14:56:44.450917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c08373f-8023108-3c0cf8-c2d147ec_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:44.458325Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:44.458350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:44.458352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:44.458354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:44.458364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896323785018257:10626]
2025-09-30T14:56:44.458369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896323785018257:10626]
2025-09-30T14:56:44.458374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896323785018257:10626]
2025-09-30T14:56:44.458426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:44.458431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:44.458434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.458437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:44.458437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:44.458441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:44.458595Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:44.466630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2323 sessionId: src_id|6c08373f-8023108-3c0cf8-c2d147ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:44.469566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:44.498104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896323874791829:4281]
2025-09-30T14:56:44.498407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2322, pipe: [1:7555896323874791829:4281]
2025-09-30T14:56:44.578344Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:44.578672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:44.578689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:44.578727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896323874791829:4281], now have 1 active actors on pipe
2025-09-30T14:56:44.578965Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:44.579007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:44.579028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:44.579039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896323874791829:4281]
2025-09-30T14:56:44.579065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:44.579102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2323 reason: error at write: Disconnected sessionId: src_id|6c08373f-8023108-3c0cf8-c2d147ec_0
2025-09-30T14:56:44.579316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2323 sessionId: src_id|6c08373f-8023108-3c0cf8-c2d147ec_0 is DEAD
2025-09-30T14:56:44.579449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c08373f-8023108-3c0cf8-c2d147ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:44.579460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c08373f-8023108-3c0cf8-c2d147ec_0] Write session will restart in 0.006200s
2025-09-30T14:56:44.579493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c08373f-8023108-3c0cf8-c2d147ec_0] Write session: Do CDS request
2025-09-30T14:56:44.579503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c08373f-8023108-3c0cf8-c2d147ec_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:44.586786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c08373f-8023108-3c0cf8-c2d147ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:44.586873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:44.586893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2324
2025-09-30T14:56:44.587041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2324 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:44.587086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2324 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:44.587115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2324 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:44.587123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:44.587636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2324 sessionId:  describe result for acl check
2025-09-30T14:56:44.587705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:44.587714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:44.587716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:44.587722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896323874791847:4498] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:44.588390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896323874791847:4498] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:44.591077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896323874791847:4498] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:44.593477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:44.593977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896323874791847:4498] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:44.593994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896323874791847:4498] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:44.593998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896323874791847:4498] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:44.594006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2324 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:44.596404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:44.596663Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:44.596667Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:44.596679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:44.596755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:44.596801Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896323785018426:10629]
2025-09-30T14:56:44.597483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:44.597899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:44.597983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:44.598327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:44.598400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:44.598402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:44.598403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:44.598404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:44.598406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:44.598407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:44.598408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:44.598410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:44.598411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:44.598413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:44.598414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.598415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.598416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.598418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:44.598419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:44.598425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:44.598436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:44.598441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:44.598446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:44.598449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:44.598453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:44.598457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:44.598461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:44.598465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:44.598470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:44.598473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.598477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.598481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.598485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:44.598490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:44.598498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:44.598507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:44.598514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:44.598520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:44.598525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:44.598531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:44.598536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:44.598542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:44.598562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:44.598568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:44.598573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:44.598577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:44.598583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:44.598589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:44.598594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:44.598600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:44.598605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:44.598611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:44.598616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:44.598621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:44.598626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.598631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.598636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.598642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.598647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.598653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.598659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:44.598665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:44.598670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:44.598676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:44.598724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:44.608890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:44.610165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:44.610188Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:44.610192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:44.610195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:44.610202Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2323 [2:7555896323785018426:10629]
2025-09-30T14:56:44.610220Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:44.610238Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:44.610242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:44.610245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:44.610248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:44.610264Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:44.610272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:44.610279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:44.610352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.610360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.610361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.610364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:44.610367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:44.610447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:44.610461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.610478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.610489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.610505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:44.610532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896323874791832:2454], now have 1 active actors on pipe
2025-09-30T14:56:44.610543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896323874791990:4498], now have 1 active actors on pipe
2025-09-30T14:56:44.610551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896323785018420:10629]
2025-09-30T14:56:44.610556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896323785018420:10629]
2025-09-30T14:56:44.610558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896323785018420:10629]
2025-09-30T14:56:44.610579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:44.610604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:44.610621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:44.610627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:44.610632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:44.610634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:44.610637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:44.610678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896323785018420:10629]
2025-09-30T14:56:44.610693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:44.610704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:44.610932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:44.610947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:44.610978Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9983e0-7c4d23dd-82d33a03-57002848_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:44.611008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:44.611018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:44.611021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:44.611033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:44.611050Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:44.611068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:44.610630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2323
2025-09-30T14:56:44.611311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:44.610690Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2323
2025-09-30T14:56:44.611323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:44.611350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:44.611479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2324 partition: 0 MaxSeqNo: 42 sessionId: src_id|e9983e0-7c4d23dd-82d33a03-57002848_0
2025-09-30T14:56:44.615441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c08373f-8023108-3c0cf8-c2d147ec_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e9983e0-7c4d23dd-82d33a03-57002848_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:44.618514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9983e0-7c4d23dd-82d33a03-57002848_0] Write session: try to update token
2025-09-30T14:56:44.618538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9983e0-7c4d23dd-82d33a03-57002848_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:44.623950Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:44.623970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:44.623973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:44.623976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:44.623986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896323785018420:10629]
2025-09-30T14:56:44.623991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896323785018420:10629]
2025-09-30T14:56:44.623998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896323785018420:10629]
2025-09-30T14:56:44.624038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:44.624047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.624048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:44.624050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:44.624055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:44.624060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:44.624205Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:44.637111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2324 sessionId: src_id|e9983e0-7c4d23dd-82d33a03-57002848_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:44.639851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:44.679382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896323874792002:4281]
2025-09-30T14:56:44.679697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2323, pipe: [1:7555896323874792002:4281]
2025-09-30T14:56:44.741843Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:44.742286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:44.742303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:44.742323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896323874792002:4281], now have 1 active actors on pipe
2025-09-30T14:56:44.743112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9983e0-7c4d23dd-82d33a03-57002848_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:44.743125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9983e0-7c4d23dd-82d33a03-57002848_0] Write session will restart in 0.006159s
2025-09-30T14:56:44.743166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9983e0-7c4d23dd-82d33a03-57002848_0] Write session: Do CDS request
2025-09-30T14:56:44.743173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9983e0-7c4d23dd-82d33a03-57002848_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:44.742617Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:44.742661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896323874792002:4281]
2025-09-30T14:56:44.742688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:44.742691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:44.742765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2324 reason: error at write: Disconnected sessionId: src_id|e9983e0-7c4d23dd-82d33a03-57002848_0
2025-09-30T14:56:44.742947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2324 sessionId: src_id|e9983e0-7c4d23dd-82d33a03-57002848_0 is DEAD
2025-09-30T14:56:44.743535Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:44.750802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9983e0-7c4d23dd-82d33a03-57002848_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:44.750869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:44.750890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2325
2025-09-30T14:56:44.751038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2325 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:44.751071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2325 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:44.751082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2325 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:44.751086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:44.751564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2325 sessionId:  describe result for acl check
2025-09-30T14:56:44.751599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:44.751602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:44.751614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:44.751620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896323874792021:4520] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:44.752158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896323874792021:4520] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:44.755365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896323874792021:4520] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:44.758935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:44.759506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896323874792021:4520] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:44.759526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896323874792021:4520] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:44.759530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896323874792021:4520] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:44.759539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2325 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:44.761800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:44.762026Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:44.762037Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:44.762059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:44.762123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:44.762183Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896323785018589:10631]
2025-09-30T14:56:44.762895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:44.763266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:44.763313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:44.763666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:44.763751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:44.763757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:44.763759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:44.763760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:44.763762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:44.763763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:44.763764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:44.763766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:44.763767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:44.763769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:44.763770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.763771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.763772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.763773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:44.763775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:44.763781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:44.763803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:44.763807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:44.763812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:44.763816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:44.763821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:44.763826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:44.763830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:44.763835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:44.763842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:44.763846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.763851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.763855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.763860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:44.763865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:44.763874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:44.763883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:44.763890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:44.763896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:44.763901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:44.763907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:44.763912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:44.763918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:44.763930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:44.763937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:44.763947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:44.763952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:44.763957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:44.763963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:44.763968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:44.763974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:44.763979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:44.763991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:44.763995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:44.764001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:44.764010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.764016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.764026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.764033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.764042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.764048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.764058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:44.764063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:44.764071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:44.764082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:44.764129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:44.769970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:44.770844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:44.770864Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:44.770867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:44.770872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:44.770879Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2324 [2:7555896323785018589:10631]
2025-09-30T14:56:44.770895Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:44.770913Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:44.770916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:44.770919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:44.770921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:44.770938Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:44.770944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:44.770952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:44.771009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.771019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.771021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.771025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:44.771027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:44.771092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:44.771099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.771110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.771125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.771145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:44.771168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896323874792006:2454], now have 1 active actors on pipe
2025-09-30T14:56:44.771176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896323874792166:4520], now have 1 active actors on pipe
2025-09-30T14:56:44.771182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896323785018583:10631]
2025-09-30T14:56:44.771184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896323785018583:10631]
2025-09-30T14:56:44.771186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896323785018583:10631]
2025-09-30T14:56:44.771199Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:44.771212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:44.771216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:44.771224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:44.771226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:44.771230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:44.771233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:44.771276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2324
2025-09-30T14:56:44.771286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2324
2025-09-30T14:56:44.771286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896323785018583:10631]
2025-09-30T14:56:44.771299Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:44.771302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:44.771333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:44.771337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:44.771370Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6cb288bb-8dfb0639-b4896bd-d5cb78d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:44.771382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:44.771385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:44.771387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:44.771397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:44.771410Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:44.771431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:44.771615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:44.771634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:44.771657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:44.772180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9983e0-7c4d23dd-82d33a03-57002848_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6cb288bb-8dfb0639-b4896bd-d5cb78d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:44.771810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2325 partition: 0 MaxSeqNo: 42 sessionId: src_id|6cb288bb-8dfb0639-b4896bd-d5cb78d2_0
2025-09-30T14:56:44.775085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cb288bb-8dfb0639-b4896bd-d5cb78d2_0] Write session: try to update token
2025-09-30T14:56:44.775108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cb288bb-8dfb0639-b4896bd-d5cb78d2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:44.784530Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:44.784557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:44.784560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:44.784562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:44.784572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896323785018583:10631]
2025-09-30T14:56:44.784577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896323785018583:10631]
2025-09-30T14:56:44.784584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896323785018583:10631]
2025-09-30T14:56:44.784639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:44.784646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:44.784650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:44.784862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:44.784869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.784872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:44.785023Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:44.801591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2325 sessionId: src_id|6cb288bb-8dfb0639-b4896bd-d5cb78d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:44.804421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:44.842693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896323874792177:4281]
2025-09-30T14:56:44.843011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2324, pipe: [1:7555896323874792177:4281]
2025-09-30T14:56:44.906498Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:44.906867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:44.906888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:44.906909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896323874792177:4281], now have 1 active actors on pipe
2025-09-30T14:56:44.907135Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:44.907145Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:44.907171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896323874792177:4281]
2025-09-30T14:56:44.907194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:44.907197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:44.907273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2325 reason: error at write: Disconnected sessionId: src_id|6cb288bb-8dfb0639-b4896bd-d5cb78d2_0
2025-09-30T14:56:44.907482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2325 sessionId: src_id|6cb288bb-8dfb0639-b4896bd-d5cb78d2_0 is DEAD
2025-09-30T14:56:44.907683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cb288bb-8dfb0639-b4896bd-d5cb78d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:44.907694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cb288bb-8dfb0639-b4896bd-d5cb78d2_0] Write session will restart in 0.006572s
2025-09-30T14:56:44.907718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cb288bb-8dfb0639-b4896bd-d5cb78d2_0] Write session: Do CDS request
2025-09-30T14:56:44.907729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cb288bb-8dfb0639-b4896bd-d5cb78d2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:44.915809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cb288bb-8dfb0639-b4896bd-d5cb78d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:44.915881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:44.915901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2326
2025-09-30T14:56:44.916051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2326 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:44.916086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2326 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:44.916096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2326 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:44.916100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:44.916568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2326 sessionId:  describe result for acl check
2025-09-30T14:56:44.916608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:44.916610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:44.916612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:44.916618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896323874792203:4528] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:44.917181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896323874792203:4528] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:44.919794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896323874792203:4528] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:44.922830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:44.922865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896323874792203:4528] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:44.922885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896323874792203:4528] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:44.922888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896323874792203:4528] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:44.922897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2326 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:44.925646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:44.925872Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:44.925883Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:44.925893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:44.925949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:44.925986Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896323785018778:10634]
2025-09-30T14:56:44.926682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:44.927006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:44.927061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:44.927417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:44.927483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:44.927491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:44.927493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:44.927494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:44.927495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:44.927496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:44.927498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:44.927499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:44.927501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:44.927502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:44.927503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.927505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.927506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.927507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:44.927508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:44.927523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:44.927531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:44.927535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:44.927539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:44.927544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:44.927548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:44.927553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:44.927557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:44.927561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:44.927565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:44.927569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.927573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.927578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.927582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:44.927586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:44.927593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:44.927601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:44.927607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:44.927613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:44.927617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:44.927622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:44.927627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:44.927632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:44.927637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:44.927642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:44.927647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:44.927652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:44.927657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:44.927663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:44.927667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:44.927673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:44.927678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:44.927683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:44.927687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:44.927694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:44.927699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.927704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.927717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.927723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.927728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.927733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.927738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:44.927743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:44.927750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:44.927766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:44.927814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:44.933387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:44.934703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:44.934721Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:44.934723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:44.934726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:44.934732Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2325 [2:7555896323785018778:10634]
2025-09-30T14:56:44.934749Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:44.934763Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:44.934767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:44.934769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:44.934772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:44.934789Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:44.934801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:44.934809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:44.934863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.934870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.934872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.934876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:44.934879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:44.934937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:44.934944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.934956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:44.934972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:44.934993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:44.935016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896323874792339:4528], now have 1 active actors on pipe
2025-09-30T14:56:44.935027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896323785018772:10634]
2025-09-30T14:56:44.935029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896323785018772:10634]
2025-09-30T14:56:44.935032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896323785018772:10634]
2025-09-30T14:56:44.935044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:44.935058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896323874792179:2454], now have 1 active actors on pipe
2025-09-30T14:56:44.935061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:44.935065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:44.935067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:44.935071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:44.935088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:44.935096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:44.935126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896323785018772:10634]
2025-09-30T14:56:44.935138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:44.935145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:44.935151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2325
2025-09-30T14:56:44.935205Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2325
2025-09-30T14:56:44.935203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:44.935213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:44.935238Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4e24be1-2e37be74-67ab5b52-f4c876bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:44.935267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:44.935271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:44.935274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:44.935283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:44.935293Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:44.935319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:44.935477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:44.935490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:44.935508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:44.935740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2326 partition: 0 MaxSeqNo: 42 sessionId: src_id|b4e24be1-2e37be74-67ab5b52-f4c876bf_0
2025-09-30T14:56:44.936120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cb288bb-8dfb0639-b4896bd-d5cb78d2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b4e24be1-2e37be74-67ab5b52-f4c876bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:44.939093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4e24be1-2e37be74-67ab5b52-f4c876bf_0] Write session: try to update token
2025-09-30T14:56:44.939112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4e24be1-2e37be74-67ab5b52-f4c876bf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:44.951609Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:44.951641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:44.951644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:44.951646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:44.951656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896323785018772:10634]
2025-09-30T14:56:44.951662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896323785018772:10634]
2025-09-30T14:56:44.951666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896323785018772:10634]
2025-09-30T14:56:44.951718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:44.951725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:44.951728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:44.951833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:44.951839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:44.951842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:44.951894Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:44.956923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2326 sessionId: src_id|b4e24be1-2e37be74-67ab5b52-f4c876bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:44.959810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:45.007590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896328169759669:4281]
2025-09-30T14:56:45.007982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2325, pipe: [1:7555896328169759669:4281]
2025-09-30T14:56:45.065929Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:45.066212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:45.066219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:45.066236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896328169759669:4281], now have 1 active actors on pipe
2025-09-30T14:56:45.066451Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:45.067001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:45.067084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2326 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b4e24be1-2e37be74-67ab5b52-f4c876bf_0
2025-09-30T14:56:45.067277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2326 sessionId: src_id|b4e24be1-2e37be74-67ab5b52-f4c876bf_0 is DEAD
2025-09-30T14:56:45.067505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896328169759669:4281]
2025-09-30T14:56:45.067520Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:45.071391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4e24be1-2e37be74-67ab5b52-f4c876bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:45.071407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4e24be1-2e37be74-67ab5b52-f4c876bf_0] Write session will restart in 0.005338s
2025-09-30T14:56:45.071434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4e24be1-2e37be74-67ab5b52-f4c876bf_0] Write session: Do CDS request
2025-09-30T14:56:45.071440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4e24be1-2e37be74-67ab5b52-f4c876bf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:45.079737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4e24be1-2e37be74-67ab5b52-f4c876bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:45.080285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:45.080307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2327
2025-09-30T14:56:45.080825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2327 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:45.080855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2327 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:45.080859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2327 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:45.080864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:45.081561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2327 sessionId:  describe result for acl check
2025-09-30T14:56:45.081591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:45.081594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:45.081596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:45.081602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896328169759691:4554] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:45.082185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896328169759691:4554] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:45.084923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896328169759691:4554] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:45.088368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896328169759691:4554] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:45.088389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896328169759691:4554] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:45.088393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896328169759691:4554] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:45.088401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2327 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:45.097747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:45.100413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:45.100635Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:45.100643Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:45.100654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:45.100705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:45.100752Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896328079986264:10649]
2025-09-30T14:56:45.101475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:45.101850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:45.101897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:45.102239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:45.102306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:45.102312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:45.102313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:45.102315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:45.102316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:45.102318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:45.102319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:45.102321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:45.102322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:45.102323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:45.102325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.102326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.102327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.102329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:45.102330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:45.102336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:45.102346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:45.102350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:45.102355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:45.102359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:45.102364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:45.102368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:45.102373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:45.102377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:45.102382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:45.102386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.102391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.102395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.102400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:45.102404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:45.102413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:45.102421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:45.102427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:45.102435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:45.102439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:45.102444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:45.102449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:45.102454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:45.102458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:45.102464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:45.102467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:45.102472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:45.102480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:45.102485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:45.102490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:45.102495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:45.102500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:45.102506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:45.102510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:45.102516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:45.102521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.102527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.102532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.102538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.102543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.102549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.102554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:45.102559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:45.102563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:45.102569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:45.102614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:45.108277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:45.109388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:45.109406Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:45.109409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:45.109414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:45.109422Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2326 [2:7555896328079986264:10649]
2025-09-30T14:56:45.109440Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:45.109456Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:45.109459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:45.109463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:45.109465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:45.109481Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:45.109488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:45.109495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:45.109563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.109571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.109573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.109578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:45.109580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:45.109654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:45.109664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.109678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.109692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.109710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:45.109730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896328169759733:4554], now have 1 active actors on pipe
2025-09-30T14:56:45.109734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896328169759671:2454], now have 1 active actors on pipe
2025-09-30T14:56:45.109741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896328079986259:10649]
2025-09-30T14:56:45.109744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896328079986259:10649]
2025-09-30T14:56:45.109746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896328079986259:10649]
2025-09-30T14:56:45.109762Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:45.109775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:45.109778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:45.109781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:45.109784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:45.109791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:45.109794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:45.109850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2326
2025-09-30T14:56:45.109871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2326
2025-09-30T14:56:45.109833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896328079986259:10649]
2025-09-30T14:56:45.109846Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:45.109853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:45.115654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:45.115682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:45.115719Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f87c858b-262d40f3-f6020832-12164682_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:45.115734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:45.115745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:45.115749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:45.115766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:45.115789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:45.115814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:45.116135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:45.116154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:45.116197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:45.116331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2327 partition: 0 MaxSeqNo: 42 sessionId: src_id|f87c858b-262d40f3-f6020832-12164682_0
2025-09-30T14:56:45.116724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4e24be1-2e37be74-67ab5b52-f4c876bf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f87c858b-262d40f3-f6020832-12164682_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:45.119735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f87c858b-262d40f3-f6020832-12164682_0] Write session: try to update token
2025-09-30T14:56:45.119756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f87c858b-262d40f3-f6020832-12164682_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:45.124439Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:45.124464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:45.124466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:45.124473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:45.124482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896328079986259:10649]
2025-09-30T14:56:45.124487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896328079986259:10649]
2025-09-30T14:56:45.124491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896328079986259:10649]
2025-09-30T14:56:45.124537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:45.124541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:45.124545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.124549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:45.124548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:45.124553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:45.124690Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:45.139215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2327 sessionId: src_id|f87c858b-262d40f3-f6020832-12164682_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:45.142124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:45.166756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896328169759856:4281]
2025-09-30T14:56:45.167070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2326, pipe: [1:7555896328169759856:4281]
2025-09-30T14:56:45.241031Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:45.241394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:45.241407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:45.241427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896328169759856:4281], now have 1 active actors on pipe
2025-09-30T14:56:45.241644Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:45.241683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:45.241703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896328169759856:4281]
2025-09-30T14:56:45.241705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:45.241722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:45.241771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2327 reason: error at write: Disconnected sessionId: src_id|f87c858b-262d40f3-f6020832-12164682_0
2025-09-30T14:56:45.241949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2327 sessionId: src_id|f87c858b-262d40f3-f6020832-12164682_0 is DEAD
2025-09-30T14:56:45.242111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f87c858b-262d40f3-f6020832-12164682_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:45.242122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f87c858b-262d40f3-f6020832-12164682_0] Write session will restart in 0.006614s
2025-09-30T14:56:45.242146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f87c858b-262d40f3-f6020832-12164682_0] Write session: Do CDS request
2025-09-30T14:56:45.242155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f87c858b-262d40f3-f6020832-12164682_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:45.249753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f87c858b-262d40f3-f6020832-12164682_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:45.249841Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:45.249862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2328
2025-09-30T14:56:45.249977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2328 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:45.250010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2328 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:45.250022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2328 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:45.250026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:45.250496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2328 sessionId:  describe result for acl check
2025-09-30T14:56:45.250535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:45.250543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:45.250545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:45.250551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896328169759880:4561] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:45.251072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896328169759880:4561] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:45.253490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896328169759880:4561] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:45.256896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896328169759880:4561] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:45.256920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896328169759880:4561] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:45.256924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896328169759880:4561] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:45.256945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2328 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:45.257018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:45.259292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:45.259580Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:45.259591Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:45.259603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:45.259662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:45.259707Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896328079986430:10651]
2025-09-30T14:56:45.260391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:45.260830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:45.260922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:45.261375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:45.261496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:45.261512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:45.261514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:45.261515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:45.261517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:45.261518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:45.261519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:45.261520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:45.261522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:45.261523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:45.261525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.261526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.261528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.261529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:45.261531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:45.261539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:45.261552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:45.261557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:45.261562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:45.261567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:45.261572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:45.261576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:45.261581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:45.261585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:45.261590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:45.261593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.261598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.261601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.261605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:45.261610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:45.261621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:45.261631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:45.261638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:45.261643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:45.261650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:45.261657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:45.261664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:45.261669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:45.261676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:45.261682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:45.261688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:45.261694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:45.261701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:45.261708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:45.261714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:45.261720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:45.261726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:45.261735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:45.261751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:45.261756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:45.261762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.261768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.261774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.261779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.261786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.261799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.261805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:45.261817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:45.261823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:45.261829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:45.261882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:45.268126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:45.269393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:45.269423Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:45.269427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:45.269435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:45.269445Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2327 [2:7555896328079986430:10651]
2025-09-30T14:56:45.269467Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:45.269489Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:45.269501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:45.269505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:45.269507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:45.269530Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:45.269545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:45.269560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:45.269652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.269667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.269670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.269674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:45.269676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:45.269780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:45.269800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.269820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.269845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.269869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:45.269953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2327
2025-09-30T14:56:45.269975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2327
2025-09-30T14:56:45.269893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896328169760028:4561], now have 1 active actors on pipe
2025-09-30T14:56:45.269903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896328169759865:2454], now have 1 active actors on pipe
2025-09-30T14:56:45.269911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896328079986424:10651]
2025-09-30T14:56:45.269914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896328079986424:10651]
2025-09-30T14:56:45.269916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896328079986424:10651]
2025-09-30T14:56:45.269931Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:45.269947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:45.269950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:45.269954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:45.269956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:45.269967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:45.269971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:45.270013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896328079986424:10651]
2025-09-30T14:56:45.270021Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:45.270029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:45.270045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:45.270049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:45.270101Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3603b8b2-98aa9ee0-fd703271-20c8d5df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:45.270114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:45.270118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:45.270128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:45.270141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:45.270154Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:45.270191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:45.270372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:45.270386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:45.270408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:45.270531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2328 partition: 0 MaxSeqNo: 42 sessionId: src_id|3603b8b2-98aa9ee0-fd703271-20c8d5df_0
2025-09-30T14:56:45.270985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f87c858b-262d40f3-f6020832-12164682_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3603b8b2-98aa9ee0-fd703271-20c8d5df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:45.274086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3603b8b2-98aa9ee0-fd703271-20c8d5df_0] Write session: try to update token
2025-09-30T14:56:45.274106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3603b8b2-98aa9ee0-fd703271-20c8d5df_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:45.282802Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:45.282827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:45.282830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:45.282832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:45.282843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896328079986424:10651]
2025-09-30T14:56:45.282848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896328079986424:10651]
2025-09-30T14:56:45.282853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896328079986424:10651]
2025-09-30T14:56:45.282895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:45.282902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.282905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:45.282907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:45.282915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:45.282919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:45.283063Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:45.291557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2328 sessionId: src_id|3603b8b2-98aa9ee0-fd703271-20c8d5df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:45.294308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:45.341919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896328169760043:4281]
2025-09-30T14:56:45.342237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2327, pipe: [1:7555896328169760043:4281]
2025-09-30T14:56:45.408485Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:45.409167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:45.409187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:45.409210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896328169760043:4281], now have 1 active actors on pipe
2025-09-30T14:56:45.409468Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:45.411393Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:45.411434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896328169760043:4281]
2025-09-30T14:56:45.411461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:45.411547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2328 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3603b8b2-98aa9ee0-fd703271-20c8d5df_0
2025-09-30T14:56:45.411751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2328 sessionId: src_id|3603b8b2-98aa9ee0-fd703271-20c8d5df_0 is DEAD
2025-09-30T14:56:45.411961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3603b8b2-98aa9ee0-fd703271-20c8d5df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:45.411976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3603b8b2-98aa9ee0-fd703271-20c8d5df_0] Write session will restart in 0.009345s
2025-09-30T14:56:45.412004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3603b8b2-98aa9ee0-fd703271-20c8d5df_0] Write session: Do CDS request
2025-09-30T14:56:45.412011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3603b8b2-98aa9ee0-fd703271-20c8d5df_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:45.422845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3603b8b2-98aa9ee0-fd703271-20c8d5df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:45.422943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:45.422966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2329
2025-09-30T14:56:45.423109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2329 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:45.423160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2329 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:45.423170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2329 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:45.423175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:45.423668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2329 sessionId:  describe result for acl check
2025-09-30T14:56:45.423712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:45.423719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:45.423721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:45.423727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896328169760079:4558] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:45.424289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896328169760079:4558] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:45.427566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896328169760079:4558] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:45.428863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:45.433909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:45.434126Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:45.434136Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:45.434145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:45.434193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:45.434229Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896328079986596:10653]
2025-09-30T14:56:45.434247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896328169760079:4558] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:45.434270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896328169760079:4558] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:45.434274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896328169760079:4558] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:45.434283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2329 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:45.434867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:45.435299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:45.435386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:45.435756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:45.435835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:45.435843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:45.435844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:45.435845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:45.435846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:45.435848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:45.435849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:45.435851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:45.435853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:45.435854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:45.435856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.435857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.435858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.435859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:45.435861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:45.435867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:45.435877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:45.435882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:45.435886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:45.435891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:45.435912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:45.435916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:45.435920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:45.435924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:45.435929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:45.435933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.435937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.435942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.435946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:45.435950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:45.435958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:45.435967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:45.435974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:45.435980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:45.435985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:45.435991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:45.435998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:45.436004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:45.436010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:45.436015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:45.436020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:45.436026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:45.436031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:45.436037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:45.436041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:45.436048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:45.436061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:45.436067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:45.436077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:45.436082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:45.436089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.436094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.436099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.436104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.436109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.436120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.436125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:45.436135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:45.436140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:45.436151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:45.436197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:45.442219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:45.443161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:45.443168Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:45.443171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:45.443176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:45.443184Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2328 [2:7555896328079986596:10653]
2025-09-30T14:56:45.443202Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:45.443221Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:45.443224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:45.443228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:45.443230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:45.443273Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:45.443281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:45.443288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:45.443352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.443355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.443358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.443361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:45.443365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:45.443440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:45.443443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.443456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.443470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.443490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:45.443507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896328079986591:10653]
2025-09-30T14:56:45.443510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896328079986591:10653]
2025-09-30T14:56:45.443513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896328079986591:10653]
2025-09-30T14:56:45.443522Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:45.443538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896328169760045:2454], now have 1 active actors on pipe
2025-09-30T14:56:45.443541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:45.443545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:45.443547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:45.443547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:45.443562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:45.443565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:45.443572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896328169760210:4558], now have 1 active actors on pipe
2025-09-30T14:56:45.443607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896328079986591:10653]
2025-09-30T14:56:45.443618Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:45.443623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:45.443944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2328
2025-09-30T14:56:45.443950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2328
2025-09-30T14:56:45.444198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:45.444212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:45.444244Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6783d052-5af5081b-c7464427-835ef412_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:45.444252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:45.444256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:45.444259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:45.444270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:45.444291Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:45.444307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:45.444734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:45.444743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:45.444760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:45.444865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2329 partition: 0 MaxSeqNo: 42 sessionId: src_id|6783d052-5af5081b-c7464427-835ef412_0
2025-09-30T14:56:45.445232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3603b8b2-98aa9ee0-fd703271-20c8d5df_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6783d052-5af5081b-c7464427-835ef412_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:45.447992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6783d052-5af5081b-c7464427-835ef412_0] Write session: try to update token
2025-09-30T14:56:45.448009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6783d052-5af5081b-c7464427-835ef412_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:45.462471Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:45.462495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:45.462506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896328079986591:10653]
2025-09-30T14:56:45.462568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:45.462576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:45.462753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:45.462912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:45.463068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:45.463226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:45.463480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:45.463530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:45.464103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2329 sessionId: src_id|6783d052-5af5081b-c7464427-835ef412_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:45.467118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:45.467416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:45.467439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:45.467458Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:45.467461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:45.467464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:45.467466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:45.467475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896328079986591:10653]
2025-09-30T14:56:45.467480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896328079986591:10653]
2025-09-30T14:56:45.467484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896328079986591:10653]
2025-09-30T14:56:45.467528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:45.467531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:45.467537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.467540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:45.467554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:45.467559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:45.467679Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:45.511322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896328169760221:4281]
2025-09-30T14:56:45.511657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2328, pipe: [1:7555896328169760221:4281]
2025-09-30T14:56:45.584772Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:45.585127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:45.585159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896328169760221:4281], now have 1 active actors on pipe
2025-09-30T14:56:45.585287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:45.585377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896328169760221:4281]
2025-09-30T14:56:45.585395Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:45.585409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:45.585412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:45.585481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2329 reason: error at write: Disconnected sessionId: src_id|6783d052-5af5081b-c7464427-835ef412_0
2025-09-30T14:56:45.585631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2329 sessionId: src_id|6783d052-5af5081b-c7464427-835ef412_0 is DEAD
2025-09-30T14:56:45.585768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6783d052-5af5081b-c7464427-835ef412_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:45.585775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6783d052-5af5081b-c7464427-835ef412_0] Write session will restart in 0.009814s
2025-09-30T14:56:45.585798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6783d052-5af5081b-c7464427-835ef412_0] Write session: Do CDS request
2025-09-30T14:56:45.585804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6783d052-5af5081b-c7464427-835ef412_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:45.596737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6783d052-5af5081b-c7464427-835ef412_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:45.596856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:45.596879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2330
2025-09-30T14:56:45.596964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2330 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:45.597007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2330 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:45.597017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2330 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:45.597022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:45.597434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2330 sessionId:  describe result for acl check
2025-09-30T14:56:45.597468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:45.597474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:45.597476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:45.597482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896328169760275:4569] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:45.598044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896328169760275:4569] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:45.600549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896328169760275:4569] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:45.602623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:45.605094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:45.605374Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:45.605396Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:45.605414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:45.605428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896328169760275:4569] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:45.605450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896328169760275:4569] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:45.605455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896328169760275:4569] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:45.605464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2330 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:45.605491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:45.605554Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896328079986766:10656]
2025-09-30T14:56:45.606268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:45.606619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:45.606692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:45.607074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:45.607152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:45.607158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:45.607159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:45.607161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:45.607162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:45.607163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:45.607165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:45.607166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:45.607167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:45.607169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:45.607187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.607192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.607194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.607195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:45.607196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:45.607202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:45.607224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:45.607232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:45.607237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:45.607241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:45.607273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:45.607281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:45.607285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:45.607288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:45.607293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:45.607297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.607301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.607305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.607309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:45.607314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:45.607323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:45.607331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:45.607338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:45.607348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:45.607356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:45.607366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:45.607376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:45.607386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:45.607395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:45.607401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:45.607410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:45.607414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:45.607422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:45.607427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:45.607434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:45.607440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:45.607445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:45.607451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:45.607462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:45.607468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:45.607473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.607479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.607484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.607489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.607494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.607499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.607504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:45.607509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:45.607514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:45.607533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:45.607585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:45.613287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:45.614375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:45.614398Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:45.614402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:45.614407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:45.614415Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2329 [2:7555896328079986766:10656]
2025-09-30T14:56:45.614435Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:45.614456Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:45.614460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:45.614464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:45.614467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:45.614484Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:45.614501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:45.614508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:45.614587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.614597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.614600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.614604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:45.614607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:45.614705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:45.614721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.614738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.614751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.614772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:45.614795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896328169760388:4569], now have 1 active actors on pipe
2025-09-30T14:56:45.614810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896328169760223:2454], now have 1 active actors on pipe
2025-09-30T14:56:45.614819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896328079986761:10656]
2025-09-30T14:56:45.614827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896328079986761:10656]
2025-09-30T14:56:45.614833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896328079986761:10656]
2025-09-30T14:56:45.614852Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:45.614869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:45.614873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:45.614880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:45.614882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:45.614892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:45.614896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:45.614870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2329
2025-09-30T14:56:45.614876Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2329
2025-09-30T14:56:45.614940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896328079986761:10656]
2025-09-30T14:56:45.614954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:45.614956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:45.614986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:45.614998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:45.615038Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5e352a7-b55e8401-cc5edde4-eca112a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:45.615052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:45.615057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:45.615060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:45.615071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:45.615082Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:45.615109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:45.615315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:45.615329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:45.615352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:45.615448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2330 partition: 0 MaxSeqNo: 42 sessionId: src_id|f5e352a7-b55e8401-cc5edde4-eca112a5_0
2025-09-30T14:56:45.615835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6783d052-5af5081b-c7464427-835ef412_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f5e352a7-b55e8401-cc5edde4-eca112a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:45.618870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e352a7-b55e8401-cc5edde4-eca112a5_0] Write session: try to update token
2025-09-30T14:56:45.618893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e352a7-b55e8401-cc5edde4-eca112a5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:45.628004Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:45.628029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:45.628032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:45.628034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:45.628044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896328079986761:10656]
2025-09-30T14:56:45.628048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896328079986761:10656]
2025-09-30T14:56:45.628054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896328079986761:10656]
2025-09-30T14:56:45.628103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:45.628108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:45.628115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:45.628115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.628119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:45.628120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:45.628272Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:45.638016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2330 sessionId: src_id|f5e352a7-b55e8401-cc5edde4-eca112a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:45.641020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:45.685450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896328169760402:4281]
2025-09-30T14:56:45.685781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2329, pipe: [1:7555896328169760402:4281]
2025-09-30T14:56:45.749935Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:45.750588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:45.750610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:45.750632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896328169760402:4281], now have 1 active actors on pipe
2025-09-30T14:56:45.750864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:45.750883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:45.750892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896328169760402:4281]
2025-09-30T14:56:45.750914Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:45.750962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2330 reason: error at write: Disconnected sessionId: src_id|f5e352a7-b55e8401-cc5edde4-eca112a5_0
2025-09-30T14:56:45.751160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2330 sessionId: src_id|f5e352a7-b55e8401-cc5edde4-eca112a5_0 is DEAD
2025-09-30T14:56:45.750880Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:45.751320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e352a7-b55e8401-cc5edde4-eca112a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:45.751331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e352a7-b55e8401-cc5edde4-eca112a5_0] Write session will restart in 0.009832s
2025-09-30T14:56:45.751354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e352a7-b55e8401-cc5edde4-eca112a5_0] Write session: Do CDS request
2025-09-30T14:56:45.751363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e352a7-b55e8401-cc5edde4-eca112a5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:45.762811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e352a7-b55e8401-cc5edde4-eca112a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:45.762844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:45.762863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2331
2025-09-30T14:56:45.763014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2331 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:45.763048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2331 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:45.763059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2331 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:45.763063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:45.763539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2331 sessionId:  describe result for acl check
2025-09-30T14:56:45.763584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:45.763590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:45.763593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:45.763598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896328169760525:4576] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:45.764144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896328169760525:4576] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:45.765622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:45.766138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896328169760525:4576] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:45.767974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:45.768193Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:45.768204Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:45.768217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:45.768275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:45.768316Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896328079986935:10658]
2025-09-30T14:56:45.768405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896328169760525:4576] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:45.768420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896328169760525:4576] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:45.768423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896328169760525:4576] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:45.768431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2331 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:45.768969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:45.769263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:45.769304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:45.769622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:45.769680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:45.769686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:45.769687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:45.769688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:45.769689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:45.769690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:45.769691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:45.769693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:45.769694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:45.769695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:45.769696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.769697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.769698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.769699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:45.769700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:45.769705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:45.769714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:45.769719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:45.769723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:45.769727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:45.769731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:45.769735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:45.769739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:45.769743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:45.769748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:45.769752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.769756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.769760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.769764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:45.769769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:45.769776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:45.769784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:45.769790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:45.769794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:45.769798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:45.769803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:45.769806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:45.769811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:45.769817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:45.769822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:45.769827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:45.769832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:45.769837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:45.769842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:45.769847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:45.769853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:45.769857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:45.769863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:45.769867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:45.769872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:45.769877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.769882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.769886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.769892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.769896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.769901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.769913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:45.769919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:45.769924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:45.769929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:45.769982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:45.775508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:45.776617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:45.776637Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:45.776640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:45.776644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:45.776651Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2330 [2:7555896328079986935:10658]
2025-09-30T14:56:45.776669Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:45.776685Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:45.776689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:45.776692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:45.776694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:45.776710Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:45.776716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:45.776723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:45.776789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.776798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.776801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.776804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:45.776807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:45.776882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:45.776889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.776904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.776917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.776940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:45.776962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896328079986930:10658]
2025-09-30T14:56:45.776969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896328079986930:10658]
2025-09-30T14:56:45.776971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896328079986930:10658]
2025-09-30T14:56:45.776985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:45.776999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896328169760570:4576], now have 1 active actors on pipe
2025-09-30T14:56:45.776999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:45.777004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:45.777007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:45.777008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896328169760404:2454], now have 1 active actors on pipe
2025-09-30T14:56:45.777015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:45.777029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:45.777032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:45.777065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896328079986930:10658]
2025-09-30T14:56:45.777080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:45.777109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:45.777091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2330
2025-09-30T14:56:45.777103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2330
2025-09-30T14:56:45.777173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:45.777186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:45.777210Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b7583bb-742c7477-49cd8a33-359a6c53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:45.777222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:45.777225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:45.777227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:45.777236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:45.777261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:45.777275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:45.777446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:45.777455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:45.777469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:45.777564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2331 partition: 0 MaxSeqNo: 42 sessionId: src_id|5b7583bb-742c7477-49cd8a33-359a6c53_0
2025-09-30T14:56:45.777987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e352a7-b55e8401-cc5edde4-eca112a5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5b7583bb-742c7477-49cd8a33-359a6c53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:45.780914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b7583bb-742c7477-49cd8a33-359a6c53_0] Write session: try to update token
2025-09-30T14:56:45.780936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b7583bb-742c7477-49cd8a33-359a6c53_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:45.789375Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:45.789402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:45.789412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896328079986930:10658]
2025-09-30T14:56:45.789456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:45.789468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:45.789635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:45.789791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:45.789974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:45.790132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:45.790455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:45.790507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:45.796246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2331 sessionId: src_id|5b7583bb-742c7477-49cd8a33-359a6c53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:45.799050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:45.800824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:45.800848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:45.800867Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:45.800869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:45.800871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:45.800872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:45.800880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896328079986930:10658]
2025-09-30T14:56:45.800884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896328079986930:10658]
2025-09-30T14:56:45.800887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896328079986930:10658]
2025-09-30T14:56:45.800926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:45.800931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:45.800939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.800941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:45.800942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:45.800945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:45.801070Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:45.850844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896328169760581:4281]
2025-09-30T14:56:45.851172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2330, pipe: [1:7555896328169760581:4281]
2025-09-30T14:56:45.911893Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:45.912309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:45.912341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896328169760581:4281], now have 1 active actors on pipe
2025-09-30T14:56:45.912469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:45.912502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:45.912550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896328169760581:4281]
2025-09-30T14:56:45.912585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:45.912588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:45.912658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2331 reason: error at write: Disconnected sessionId: src_id|5b7583bb-742c7477-49cd8a33-359a6c53_0
2025-09-30T14:56:45.912872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2331 sessionId: src_id|5b7583bb-742c7477-49cd8a33-359a6c53_0 is DEAD
2025-09-30T14:56:45.913028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b7583bb-742c7477-49cd8a33-359a6c53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:45.913039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b7583bb-742c7477-49cd8a33-359a6c53_0] Write session will restart in 0.009091s
2025-09-30T14:56:45.913061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b7583bb-742c7477-49cd8a33-359a6c53_0] Write session: Do CDS request
2025-09-30T14:56:45.913067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b7583bb-742c7477-49cd8a33-359a6c53_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:45.923798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b7583bb-742c7477-49cd8a33-359a6c53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:45.923858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:45.923873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2332
2025-09-30T14:56:45.924021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2332 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:45.924053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2332 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:45.924063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2332 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:45.924068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:45.924501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2332 sessionId:  describe result for acl check
2025-09-30T14:56:45.924536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:45.924544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:45.924546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:45.924552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896328169760658:4572] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:45.925034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896328169760658:4572] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:45.927030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896328169760658:4572] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:45.928275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:45.930633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:45.930889Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:45.930901Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:45.930912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:45.930972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:45.931016Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896328079987117:10661]
2025-09-30T14:56:45.931077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896328169760658:4572] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:45.931094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896328169760658:4572] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:45.931098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896328169760658:4572] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:45.931106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2332 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:45.931664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:45.931964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:45.932014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:45.932330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:45.932394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:45.932401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:45.932402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:45.932403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:45.932404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:45.932406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:45.932407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:45.932408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:45.932409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:45.932410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:45.932411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.932412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.932413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.932415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:45.932416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:45.932421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:45.932431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:45.932435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:45.932439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:45.932443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:45.932446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:45.932450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:45.932453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:45.932457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:45.932461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:45.932465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.932469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.932473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.932476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:45.932479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:45.932487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:45.932495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:45.932502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:45.932507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:45.932512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:45.932517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:45.932520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:45.932525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:45.932529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:45.932534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:45.932538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:45.932543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:45.932548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:45.932552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:45.932556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:45.932561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:45.932566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:45.932570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:45.932574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:45.932580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:45.932584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.932589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.932593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.932597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.932601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.932606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.932610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:45.932614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:45.932619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:45.932625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:45.932665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:45.938362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:45.939687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:45.939706Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:45.939709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:45.939713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:45.939726Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2331 [2:7555896328079987117:10661]
2025-09-30T14:56:45.939747Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:45.939764Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:45.939767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:45.939771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:45.939774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:45.939790Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:45.939804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:45.939811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:45.939881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.939888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.939891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.939895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:45.939897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:45.939968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:45.939976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.939991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:45.940003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:45.940022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:45.940046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896328079987112:10661]
2025-09-30T14:56:45.940049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896328079987112:10661]
2025-09-30T14:56:45.940051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896328079987112:10661]
2025-09-30T14:56:45.940065Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:45.940080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896328169760750:4572], now have 1 active actors on pipe
2025-09-30T14:56:45.940084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896328169760583:2454], now have 1 active actors on pipe
2025-09-30T14:56:45.940093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:45.940107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:45.940111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:45.940116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:45.940116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:45.940119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:45.940163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2331
2025-09-30T14:56:45.940196Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2331
2025-09-30T14:56:45.940157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896328079987112:10661]
2025-09-30T14:56:45.940171Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:45.940198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:45.940226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:45.940231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:45.940259Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d756039-98abe1ca-52fbc8d3-e77e4dcd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:45.940266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:45.940269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:45.940271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:45.940281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:45.940291Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:45.940311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:45.940510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:45.940529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:45.940566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:45.940665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2332 partition: 0 MaxSeqNo: 42 sessionId: src_id|1d756039-98abe1ca-52fbc8d3-e77e4dcd_0
2025-09-30T14:56:45.941025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b7583bb-742c7477-49cd8a33-359a6c53_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1d756039-98abe1ca-52fbc8d3-e77e4dcd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:45.944119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d756039-98abe1ca-52fbc8d3-e77e4dcd_0] Write session: try to update token
2025-09-30T14:56:45.944142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d756039-98abe1ca-52fbc8d3-e77e4dcd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:45.953646Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:45.953675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:45.953687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896328079987112:10661]
2025-09-30T14:56:45.953734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:45.953733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:45.953923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:45.954081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:45.954236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:45.954386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:45.954590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:45.954639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:45.960799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2332 sessionId: src_id|1d756039-98abe1ca-52fbc8d3-e77e4dcd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:45.963718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:45.964006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:45.964039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:45.965297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:45.965334Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:45.965338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:45.965340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:45.965343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:45.965354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896328079987112:10661]
2025-09-30T14:56:45.965358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896328079987112:10661]
2025-09-30T14:56:45.965361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896328079987112:10661]
2025-09-30T14:56:45.965388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:45.965392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:45.965398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:45.965401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:45.965403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:45.965406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:45.965550Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:45.965649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:46.012582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896332464728070:4281]
2025-09-30T14:56:46.012830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2331, pipe: [1:7555896332464728070:4281]
2025-09-30T14:56:46.083786Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:46.092396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:46.092431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:46.092620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:46.092683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:46.092749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:46.092810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:46.093105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:46.093110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:46.093181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:46.093260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:46.093323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:46.093390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:46.093430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:46.093433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:46.093503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:46.093560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:46.093618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:46.093678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:46.093720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:46.093723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:46.093793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:46.093856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:46.093917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:46.093979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:46.094017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:46.094023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:46.094094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:46.094152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:46.094212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:46.094274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:46.094315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:46.094318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:46.094387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:46.094446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:46.094508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:46.094570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:46.094614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:46.094617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:46.094685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:46.094747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:46.094811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:46.094874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:46.094915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:46.094920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:46.094989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:46.095045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:46.095105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:46.095167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:46.095208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:46.095210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:46.095548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:46.095618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:46.095687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:46.095753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:46.095810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:46.095821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:46.095888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:46.095949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:46.096014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:46.096080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:46.096129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:46.096139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:46.096208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896332464728070:4281], now have 1 active actors on pipe
2025-09-30T14:56:46.096456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896332464728070:4281]
2025-09-30T14:56:46.096457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:46.096461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:46.096484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:46.096493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2332 reason: error at write: Disconnected sessionId: src_id|1d756039-98abe1ca-52fbc8d3-e77e4dcd_0
2025-09-30T14:56:46.096793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2332 sessionId: src_id|1d756039-98abe1ca-52fbc8d3-e77e4dcd_0 is DEAD
2025-09-30T14:56:46.096856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d756039-98abe1ca-52fbc8d3-e77e4dcd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:46.096864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d756039-98abe1ca-52fbc8d3-e77e4dcd_0] Write session will restart in 0.006829s
2025-09-30T14:56:46.096890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d756039-98abe1ca-52fbc8d3-e77e4dcd_0] Write session: Do CDS request
2025-09-30T14:56:46.096896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d756039-98abe1ca-52fbc8d3-e77e4dcd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:46.097185Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:46.104829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d756039-98abe1ca-52fbc8d3-e77e4dcd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:46.104922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:46.104937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2333
2025-09-30T14:56:46.105072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2333 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:46.105104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2333 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:46.105114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2333 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:46.105118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:46.105617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2333 sessionId:  describe result for acl check
2025-09-30T14:56:46.105653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:46.105659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:46.105660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:46.105666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896332464728109:4607] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:46.106241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896332464728109:4607] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:46.109364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896332464728109:4607] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:46.112592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896332464728109:4607] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:46.112606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896332464728109:4607] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:46.112610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896332464728109:4607] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:46.112618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2333 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:46.112721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:46.115235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:46.115515Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:46.115529Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:46.115539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:46.115599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:46.115645Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896332374954623:10676]
2025-09-30T14:56:46.116320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:46.116619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:46.116662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:46.117000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:46.117062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:46.117068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:46.117069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:46.117070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:46.117071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:46.117072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:46.117073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:46.117074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:46.117076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:46.117077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:46.117078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.117079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.117080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.117081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:46.117082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:46.117088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:46.117099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:46.117103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:46.117108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:46.117112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:46.117116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:46.117120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:46.117125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:46.117129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:46.117133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:46.117137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.117142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.117146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.117150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:46.117154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:46.117162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:46.117175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:46.117185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:46.117191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:46.117201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:46.117207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:46.117216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:46.117221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:46.117231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:46.117236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:46.117257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:46.117268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:46.117273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:46.117282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:46.117287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:46.117292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:46.117299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:46.117309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:46.117315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:46.117321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:46.117325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.117335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.117340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.117345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.117355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.117361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.117369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:46.117374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:46.117379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:46.117389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:46.117429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:46.123056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:46.124284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:46.124302Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:46.124305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:46.124309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:46.124315Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2332 [2:7555896332374954623:10676]
2025-09-30T14:56:46.124333Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:46.124351Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:46.124359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:46.124363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:46.124366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:46.124381Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:46.124394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:46.124404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:46.124477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.124484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.124486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.124489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:46.124492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:46.124559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:46.124568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.124582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.124595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.124614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:46.124634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896332464728261:4607], now have 1 active actors on pipe
2025-09-30T14:56:46.124646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896332464728094:2454], now have 1 active actors on pipe
2025-09-30T14:56:46.124652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896332374954617:10676]
2025-09-30T14:56:46.124655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896332374954617:10676]
2025-09-30T14:56:46.124657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896332374954617:10676]
2025-09-30T14:56:46.124673Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:46.124688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:46.124692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:46.124696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:46.124699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:46.124703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:46.124706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:46.124741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896332374954617:10676]
2025-09-30T14:56:46.124754Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:46.124773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:46.124740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2332
2025-09-30T14:56:46.124756Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2332
2025-09-30T14:56:46.124810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:46.124820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:46.124849Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1cb91f2f-a3b55ad-a9040606-61895d24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:46.124861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:46.124865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:46.124873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:46.124884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:46.124893Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:46.124913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:46.125048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:46.125056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:46.125069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:46.125182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2333 partition: 0 MaxSeqNo: 42 sessionId: src_id|1cb91f2f-a3b55ad-a9040606-61895d24_0
2025-09-30T14:56:46.125593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d756039-98abe1ca-52fbc8d3-e77e4dcd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1cb91f2f-a3b55ad-a9040606-61895d24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:46.128661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cb91f2f-a3b55ad-a9040606-61895d24_0] Write session: try to update token
2025-09-30T14:56:46.128682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cb91f2f-a3b55ad-a9040606-61895d24_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:46.137400Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:46.137427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:46.137439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896332374954617:10676]
2025-09-30T14:56:46.137485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:46.137495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:46.137679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:46.137841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:46.137996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:46.138153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:46.138390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:46.138436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:46.145239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2333 sessionId: src_id|1cb91f2f-a3b55ad-a9040606-61895d24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:46.148095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:46.148434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:46.148463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:46.148483Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:46.148486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:46.148489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:46.148491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:46.148501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896332374954617:10676]
2025-09-30T14:56:46.148505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896332374954617:10676]
2025-09-30T14:56:46.148509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896332374954617:10676]
2025-09-30T14:56:46.148552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:46.148558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:46.148564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.148567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:46.148665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:46.148675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:46.148704Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:46.196399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896332464728276:4281]
2025-09-30T14:56:46.196784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2332, pipe: [1:7555896332464728276:4281]
2025-09-30T14:56:46.255664Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:46.256188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:46.256228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896332464728276:4281], now have 1 active actors on pipe
2025-09-30T14:56:46.256389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:46.256520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896332464728276:4281]
2025-09-30T14:56:46.256544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:46.269179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:46.269193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:46.269217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2333 reason: error at write: Disconnected sessionId: src_id|1cb91f2f-a3b55ad-a9040606-61895d24_0
2025-09-30T14:56:46.269396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2333 sessionId: src_id|1cb91f2f-a3b55ad-a9040606-61895d24_0 is DEAD
2025-09-30T14:56:46.269561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cb91f2f-a3b55ad-a9040606-61895d24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:46.269569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cb91f2f-a3b55ad-a9040606-61895d24_0] Write session will restart in 0.008489s
2025-09-30T14:56:46.269594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cb91f2f-a3b55ad-a9040606-61895d24_0] Write session: Do CDS request
2025-09-30T14:56:46.269600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cb91f2f-a3b55ad-a9040606-61895d24_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:46.280005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:46.280150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cb91f2f-a3b55ad-a9040606-61895d24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:46.280249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:46.280264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2334
2025-09-30T14:56:46.280419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2334 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:46.280455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2334 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:46.280467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2334 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:46.280471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:46.280917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2334 sessionId:  describe result for acl check
2025-09-30T14:56:46.280951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:46.280957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:46.280960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:46.280965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896332464728419:4613] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:46.281540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896332464728419:4613] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:46.282714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:46.282937Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:46.282949Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:46.282960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:46.283012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:46.283055Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896332374954794:10678]
2025-09-30T14:56:46.283764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:46.284170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:46.284241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:46.284430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896332464728419:4613] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:46.284736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:46.284820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:46.284826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:46.284828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:46.284829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:46.284830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:46.284832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:46.284833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:46.284834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:46.284836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:46.284837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:46.284838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.284840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.284841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.284843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:46.284844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:46.284850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:46.284861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:46.284865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:46.284869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:46.284872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:46.284876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:46.284881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:46.284886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:46.284890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:46.284896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:46.284901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.284905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.284909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.284913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:46.284926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:46.284934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:46.284942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:46.284947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:46.284953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:46.284958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:46.284969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:46.284973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:46.284979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:46.284988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:46.284994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:46.285013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:46.285024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:46.285029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:46.285039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:46.285044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:46.285049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:46.285059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:46.285066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:46.285075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:46.285081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:46.285086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.285091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.285096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.285101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.285106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.285115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.285119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:46.285125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:46.285134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:46.285139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:46.285190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:46.290495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896332464728419:4613] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:46.290514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896332464728419:4613] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:46.290518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896332464728419:4613] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:46.290526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2334 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:46.291141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:46.292494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:46.292514Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:46.292516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:46.292521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:46.292528Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2333 [2:7555896332374954794:10678]
2025-09-30T14:56:46.292548Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:46.292564Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:46.292572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:46.292575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:46.292578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:46.292595Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:46.292607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:46.292619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:46.292690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.292701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.292703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.292707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:46.292710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:46.292787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:46.292794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.292809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.292827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.292849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:46.292872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896332464728457:4613], now have 1 active actors on pipe
2025-09-30T14:56:46.292881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896332464728280:2454], now have 1 active actors on pipe
2025-09-30T14:56:46.292888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896332374954789:10678]
2025-09-30T14:56:46.292894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896332374954789:10678]
2025-09-30T14:56:46.292897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896332374954789:10678]
2025-09-30T14:56:46.292913Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:46.292930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:46.292940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:46.292945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:46.292946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:46.292951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:46.292954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:46.292947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2333
2025-09-30T14:56:46.292947Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2333
2025-09-30T14:56:46.292994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896332374954789:10678]
2025-09-30T14:56:46.293002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:46.293003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:46.293042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:46.293051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:46.293077Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0bcee2f-11643c39-77cf829e-b9144d0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:46.293088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:46.293091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:46.293093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:46.293103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:46.293116Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:46.293129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:46.293317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:46.293328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:46.293345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:46.293429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2334 partition: 0 MaxSeqNo: 42 sessionId: src_id|c0bcee2f-11643c39-77cf829e-b9144d0c_0
2025-09-30T14:56:46.293808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cb91f2f-a3b55ad-a9040606-61895d24_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c0bcee2f-11643c39-77cf829e-b9144d0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:46.296718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0bcee2f-11643c39-77cf829e-b9144d0c_0] Write session: try to update token
2025-09-30T14:56:46.296738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0bcee2f-11643c39-77cf829e-b9144d0c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:46.305558Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:46.305586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:46.305591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:46.305594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:46.305603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896332374954789:10678]
2025-09-30T14:56:46.305607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896332374954789:10678]
2025-09-30T14:56:46.305611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896332374954789:10678]
2025-09-30T14:56:46.305655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:46.305663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.305666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:46.305695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:46.305714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:46.305718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:46.305818Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:46.314302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2334 sessionId: src_id|c0bcee2f-11643c39-77cf829e-b9144d0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:46.317498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:46.356739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896332464728465:4281]
2025-09-30T14:56:46.356985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2333, pipe: [1:7555896332464728465:4281]
2025-09-30T14:56:46.422547Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:46.422900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:46.422918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:46.422939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896332464728465:4281], now have 1 active actors on pipe
2025-09-30T14:56:46.423189Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:46.423270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896332464728465:4281]
2025-09-30T14:56:46.423307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:46.423385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2334 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c0bcee2f-11643c39-77cf829e-b9144d0c_0
2025-09-30T14:56:46.423499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:46.423596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2334 sessionId: src_id|c0bcee2f-11643c39-77cf829e-b9144d0c_0 is DEAD
2025-09-30T14:56:46.423752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0bcee2f-11643c39-77cf829e-b9144d0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:46.423763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0bcee2f-11643c39-77cf829e-b9144d0c_0] Write session will restart in 0.009666s
2025-09-30T14:56:46.423787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0bcee2f-11643c39-77cf829e-b9144d0c_0] Write session: Do CDS request
2025-09-30T14:56:46.423793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0bcee2f-11643c39-77cf829e-b9144d0c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:46.434826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0bcee2f-11643c39-77cf829e-b9144d0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:46.434942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:46.434959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2335
2025-09-30T14:56:46.435099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2335 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:46.435137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2335 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:46.435143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2335 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:46.435155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:46.435706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2335 sessionId:  describe result for acl check
2025-09-30T14:56:46.435743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:46.435760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:46.435762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:46.435769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896332464728550:4625] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:46.436335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896332464728550:4625] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:46.438862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896332464728550:4625] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:46.439589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:46.442017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:46.442397Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:46.442420Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:46.442433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:46.442422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896332464728550:4625] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:46.442440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896332464728550:4625] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:46.442444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896332464728550:4625] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:46.442451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2335 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:46.442499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:46.442543Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896332374954967:10680]
2025-09-30T14:56:46.443223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:46.443572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:46.443615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:46.443938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:46.444026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:46.444034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:46.444035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:46.444037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:46.444038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:46.444039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:46.444040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:46.444042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:46.444043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:46.444044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:46.444046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.444047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.444048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.444050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:46.444051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:46.444057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:46.444069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:46.444073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:46.444078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:46.444082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:46.444086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:46.444091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:46.444095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:46.444100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:46.444103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:46.444106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.444110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.444114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.444118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:46.444122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:46.444131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:46.444145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:46.444156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:46.444167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:46.444172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:46.444182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:46.444187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:46.444198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:46.444203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:46.444214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:46.444219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:46.444225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:46.444237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:46.444247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:46.444253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:46.444258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:46.444268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:46.444278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:46.444282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:46.444293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:46.444302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.444308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.444317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.444323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.444327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.444332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.444337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:46.444343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:46.444347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:46.444353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:46.444403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:46.449940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:46.451086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:46.451106Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:46.451109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:46.451113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:46.451121Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2334 [2:7555896332374954967:10680]
2025-09-30T14:56:46.451140Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:46.451157Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:46.451166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:46.451169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:46.451172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:46.451189Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:46.451201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:46.451208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:46.451297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.451304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.451307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.451311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:46.451314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:46.451383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:46.451391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.451404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.451416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.451438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:46.451455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896332374954962:10680]
2025-09-30T14:56:46.451462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896332374954962:10680]
2025-09-30T14:56:46.451464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896332374954962:10680]
2025-09-30T14:56:46.451473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:46.451484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:46.451489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896332464728636:4625], now have 1 active actors on pipe
2025-09-30T14:56:46.451494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:46.451497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:46.451500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:46.451510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:46.451513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:46.451518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896332464728466:2454], now have 1 active actors on pipe
2025-09-30T14:56:46.451556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896332374954962:10680]
2025-09-30T14:56:46.451568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:46.451598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:46.451611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2334
2025-09-30T14:56:46.451615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2334
2025-09-30T14:56:46.451696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:46.451706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:46.451734Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|224f02a0-2f07f7d7-ff8f308f-cf41e38b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:46.451740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:46.451744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:46.451746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:46.451757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:46.451766Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:46.451779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:46.452111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:46.452119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:46.452133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:46.452262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2335 partition: 0 MaxSeqNo: 42 sessionId: src_id|224f02a0-2f07f7d7-ff8f308f-cf41e38b_0
2025-09-30T14:56:46.452610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0bcee2f-11643c39-77cf829e-b9144d0c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|224f02a0-2f07f7d7-ff8f308f-cf41e38b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:46.455595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|224f02a0-2f07f7d7-ff8f308f-cf41e38b_0] Write session: try to update token
2025-09-30T14:56:46.455617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|224f02a0-2f07f7d7-ff8f308f-cf41e38b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:46.465326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:46.465349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:46.465352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:46.465354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:46.465369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896332374954962:10680]
2025-09-30T14:56:46.465374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896332374954962:10680]
2025-09-30T14:56:46.465378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896332374954962:10680]
2025-09-30T14:56:46.465417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:46.465422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:46.465425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:46.465429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:46.465431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.465435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:46.465581Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:46.473325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2335 sessionId: src_id|224f02a0-2f07f7d7-ff8f308f-cf41e38b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:46.476072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:46.526027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896332464728648:4281]
2025-09-30T14:56:46.526428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2334, pipe: [1:7555896332464728648:4281]
2025-09-30T14:56:46.580594Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:46.581044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:46.581063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:46.581113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896332464728648:4281], now have 1 active actors on pipe
2025-09-30T14:56:46.581381Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:46.581530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896332464728648:4281]
2025-09-30T14:56:46.581554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:46.581565Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:46.581636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2335 reason: status is not ok: tablet will be restarted right now sessionId: src_id|224f02a0-2f07f7d7-ff8f308f-cf41e38b_0
2025-09-30T14:56:46.581834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2335 sessionId: src_id|224f02a0-2f07f7d7-ff8f308f-cf41e38b_0 is DEAD
2025-09-30T14:56:46.581999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|224f02a0-2f07f7d7-ff8f308f-cf41e38b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:46.582011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|224f02a0-2f07f7d7-ff8f308f-cf41e38b_0] Write session will restart in 0.007394s
2025-09-30T14:56:46.582036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|224f02a0-2f07f7d7-ff8f308f-cf41e38b_0] Write session: Do CDS request
2025-09-30T14:56:46.582042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|224f02a0-2f07f7d7-ff8f308f-cf41e38b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:46.590772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|224f02a0-2f07f7d7-ff8f308f-cf41e38b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:46.590922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:46.590936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2336
2025-09-30T14:56:46.591125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2336 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:46.591173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2336 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:46.591179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2336 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:46.591184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:46.591692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2336 sessionId:  describe result for acl check
2025-09-30T14:56:46.591734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:46.591742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:46.591744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:46.591750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896332464728682:4636] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:46.592411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896332464728682:4636] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:46.595221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896332464728682:4636] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:46.597352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:46.600120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:46.600258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896332464728682:4636] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:46.600274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896332464728682:4636] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:46.600277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896332464728682:4636] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:46.600287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2336 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:46.600349Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:46.600364Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:46.600376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:46.600434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:46.600471Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896332374955143:10683]
2025-09-30T14:56:46.601170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:46.601558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:46.601656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:46.602047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:46.602140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:46.602150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:46.602151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:46.602153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:46.602154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:46.602155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:46.602157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:46.602159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:46.602160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:46.602162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:46.602163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.602165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.602166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.602168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:46.602169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:46.602177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:46.602189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:46.602194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:46.602199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:46.602204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:46.602209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:46.602213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:46.602217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:46.602222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:46.602227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:46.602232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.602237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.602241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.602246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:46.602250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:46.602259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:46.602268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:46.602276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:46.602282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:46.602288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:46.602295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:46.602299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:46.602305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:46.602311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:46.602318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:46.602323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:46.602328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:46.602333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:46.602339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:46.602343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:46.602349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:46.602355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:46.602362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:46.602367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:46.602374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:46.602379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.602385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.602390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.602396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.602403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.602409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.602414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:46.602419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:46.602425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:46.602431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:46.602489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:46.608408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:46.609769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:46.609787Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:46.609790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:46.609794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:46.609802Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2335 [2:7555896332374955143:10683]
2025-09-30T14:56:46.609822Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:46.609840Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:46.609845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:46.609849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:46.609852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:46.609870Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:46.609876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:46.609885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:46.609963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.609977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.609979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.609983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:46.609988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:46.610063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:46.610074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.610088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.610100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.610117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:46.610144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896332464728821:4636], now have 1 active actors on pipe
2025-09-30T14:56:46.610147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896332464728650:2454], now have 1 active actors on pipe
2025-09-30T14:56:46.610154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896332374955138:10683]
2025-09-30T14:56:46.610156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896332374955138:10683]
2025-09-30T14:56:46.610158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896332374955138:10683]
2025-09-30T14:56:46.610169Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:46.610183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:46.610185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:46.610189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:46.610191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:46.610206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:46.610209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:46.610248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896332374955138:10683]
2025-09-30T14:56:46.610262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:46.610271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:46.612002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2335
2025-09-30T14:56:46.612003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2335
2025-09-30T14:56:46.612203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:46.612225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:46.612275Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|351584e1-8958007e-56bec616-8173f761_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:46.612293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:46.612302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:46.612320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:46.612334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:46.612356Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:46.612394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:46.612640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:46.612652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:46.612672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:46.612776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2336 partition: 0 MaxSeqNo: 42 sessionId: src_id|351584e1-8958007e-56bec616-8173f761_0
2025-09-30T14:56:46.613172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|224f02a0-2f07f7d7-ff8f308f-cf41e38b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|351584e1-8958007e-56bec616-8173f761_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:46.616242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|351584e1-8958007e-56bec616-8173f761_0] Write session: try to update token
2025-09-30T14:56:46.616266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|351584e1-8958007e-56bec616-8173f761_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:46.624496Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:46.624518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:46.624529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896332374955138:10683]
2025-09-30T14:56:46.624578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:46.624582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:46.624762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:46.624911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:46.625062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:46.625212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:46.625442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:46.625494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:46.632091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2336 sessionId: src_id|351584e1-8958007e-56bec616-8173f761_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:46.634926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:46.635755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:46.635788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:46.635807Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:46.635811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:46.635816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:46.635818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:46.635829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896332374955138:10683]
2025-09-30T14:56:46.635836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896332374955138:10683]
2025-09-30T14:56:46.635840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896332374955138:10683]
2025-09-30T14:56:46.635884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:46.635895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:46.635900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:46.635903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.635904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:46.635905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:46.636060Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:46.681789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896332464728834:4281]
2025-09-30T14:56:46.682037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2335, pipe: [1:7555896332464728834:4281]
2025-09-30T14:56:46.751677Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:46.752020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:46.752071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896332464728834:4281], now have 1 active actors on pipe
2025-09-30T14:56:46.752422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:46.752461Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:46.752508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896332464728834:4281]
2025-09-30T14:56:46.752542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:46.752545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:46.752625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2336 reason: error at write: Disconnected sessionId: src_id|351584e1-8958007e-56bec616-8173f761_0
2025-09-30T14:56:46.752774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2336 sessionId: src_id|351584e1-8958007e-56bec616-8173f761_0 is DEAD
2025-09-30T14:56:46.752925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|351584e1-8958007e-56bec616-8173f761_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:46.752932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|351584e1-8958007e-56bec616-8173f761_0] Write session will restart in 0.009239s
2025-09-30T14:56:46.752963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|351584e1-8958007e-56bec616-8173f761_0] Write session: Do CDS request
2025-09-30T14:56:46.752968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|351584e1-8958007e-56bec616-8173f761_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:46.763830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|351584e1-8958007e-56bec616-8173f761_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:46.763913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:46.763931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2337
2025-09-30T14:56:46.764133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2337 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:46.764170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2337 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:46.764177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2337 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:46.764181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:46.764796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2337 sessionId:  describe result for acl check
2025-09-30T14:56:46.764862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:46.764873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:46.764876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:46.764883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896332464728897:4640] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:46.765641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896332464728897:4640] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:46.769124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896332464728897:4640] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:46.770966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:46.774333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:46.774550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896332464728897:4640] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:46.774567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896332464728897:4640] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:46.774570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896332464728897:4640] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:46.774580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2337 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:46.774833Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:46.774848Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:46.774861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:46.774928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:46.774973Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896332374955320:10685]
2025-09-30T14:56:46.775625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:46.775982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:46.776058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:46.776396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:46.776483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:46.776491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:46.776492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:46.776493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:46.776495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:46.776496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:46.776497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:46.776498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:46.776500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:46.776501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:46.776502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.776504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.776506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.776507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:46.776508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:46.776515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:46.776526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:46.776531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:46.776536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:46.776539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:46.776544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:46.776548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:46.776553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:46.776557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:46.776562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:46.776566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.776570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.776574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.776579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:46.776583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:46.776593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:46.776602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:46.776610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:46.776616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:46.776621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:46.776632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:46.776637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:46.776647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:46.776652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:46.776656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:46.776666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:46.776672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:46.776682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:46.776688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:46.776693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:46.776698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:46.776708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:46.776714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:46.776723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:46.776728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:46.776734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.776740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.776744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.776750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.776755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.776767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.776772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:46.776778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:46.776783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:46.776789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:46.776838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:46.782601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:46.783848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:46.783868Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:46.783871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:46.783875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:46.783882Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2336 [2:7555896332374955320:10685]
2025-09-30T14:56:46.783901Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:46.783919Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:46.783924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:46.783928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:46.783930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:46.783947Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:46.783957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:46.783972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:46.784036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.784038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.784040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.784044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:46.784047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:46.784125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:46.784133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.784147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.784165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.784182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:46.784202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896332464729010:4640], now have 1 active actors on pipe
2025-09-30T14:56:46.784211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896332464728836:2454], now have 1 active actors on pipe
2025-09-30T14:56:46.784217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896332374955314:10685]
2025-09-30T14:56:46.784220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896332374955314:10685]
2025-09-30T14:56:46.784222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896332374955314:10685]
2025-09-30T14:56:46.784238Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:46.784256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:46.784278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:46.784281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:46.784294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2336
2025-09-30T14:56:46.784319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896332374955314:10685]
2025-09-30T14:56:46.784293Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2336
2025-09-30T14:56:46.784326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:46.784336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:46.784340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:46.784343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:46.784349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:46.784501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:46.784513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:46.784542Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dcbb9c78-defacdc1-fccb6712-c5f8b09f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:46.784555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:46.784562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:46.784565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:46.784576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:46.784587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:46.784603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:46.784810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:46.784819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:46.784834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:46.784969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2337 partition: 0 MaxSeqNo: 42 sessionId: src_id|dcbb9c78-defacdc1-fccb6712-c5f8b09f_0
2025-09-30T14:56:46.785399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|351584e1-8958007e-56bec616-8173f761_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dcbb9c78-defacdc1-fccb6712-c5f8b09f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:46.788378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcbb9c78-defacdc1-fccb6712-c5f8b09f_0] Write session: try to update token
2025-09-30T14:56:46.788401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcbb9c78-defacdc1-fccb6712-c5f8b09f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:46.797699Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:46.797733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:46.797736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:46.797738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:46.797749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896332374955314:10685]
2025-09-30T14:56:46.797754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896332374955314:10685]
2025-09-30T14:56:46.797758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896332374955314:10685]
2025-09-30T14:56:46.797808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:46.797816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.797820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:46.797820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:46.797827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:46.797841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:46.797998Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:46.805967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2337 sessionId: src_id|dcbb9c78-defacdc1-fccb6712-c5f8b09f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:46.818196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:46.818990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-09-30T14:56:46.819009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 13
2025-09-30T14:56:46.851317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896332464729024:4281]
2025-09-30T14:56:46.851628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2336, pipe: [1:7555896332464729024:4281]
2025-09-30T14:56:46.916366Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:46.916702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:46.916717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:46.916764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896332464729024:4281], now have 1 active actors on pipe
2025-09-30T14:56:46.917037Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:46.917111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:46.917125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:46.917191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2337 reason: error at write: Disconnected sessionId: src_id|dcbb9c78-defacdc1-fccb6712-c5f8b09f_0
2025-09-30T14:56:46.917396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2337 sessionId: src_id|dcbb9c78-defacdc1-fccb6712-c5f8b09f_0 is DEAD
2025-09-30T14:56:46.917554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:46.917564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 13
2025-09-30T14:56:46.917590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896332464729024:4281]
2025-09-30T14:56:46.919047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcbb9c78-defacdc1-fccb6712-c5f8b09f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:46.919065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcbb9c78-defacdc1-fccb6712-c5f8b09f_0] Write session will restart in 0.009844s
2025-09-30T14:56:46.919099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcbb9c78-defacdc1-fccb6712-c5f8b09f_0] Write session: Do CDS request
2025-09-30T14:56:46.919105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcbb9c78-defacdc1-fccb6712-c5f8b09f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:46.929630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcbb9c78-defacdc1-fccb6712-c5f8b09f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:46.929953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:46.929965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2338
2025-09-30T14:56:46.930193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2338 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:46.930221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2338 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:46.930227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2338 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:46.930231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:46.930660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2338 sessionId:  describe result for acl check
2025-09-30T14:56:46.930688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:46.930693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:46.930696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:46.930703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896332464729116:4650] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:46.931232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896332464729116:4650] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:46.942169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896332464729116:4650] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:46.944398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:46.946077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896332464729116:4650] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:46.946091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896332464729116:4650] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:46.946094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896332464729116:4650] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:46.946103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2338 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:46.945680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:46.945941Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:46.945946Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:46.945957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:46.946026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:46.946061Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896332374955510:10689]
2025-09-30T14:56:46.946702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:46.947073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:46.947136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:46.947674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:46.947748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:46.947749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:46.947750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:46.947752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:46.947753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:46.947755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:46.947756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:46.947757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:46.947759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:46.947760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:46.947763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.947764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.947765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.947766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:46.947767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:46.947774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:46.947785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:46.947789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:46.947793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:46.947797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:46.947802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:46.947806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:46.947810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:46.947814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:46.947819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:46.947823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.947827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.947831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.947835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:46.947839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:46.947847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:46.947855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:46.947864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:46.947871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:46.947876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:46.947881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:46.947886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:46.947891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:46.947896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:46.947901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:46.947907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:46.947915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:46.947920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:46.947925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:46.947929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:46.947934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:46.947939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:46.947944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:46.947949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:46.947954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:46.947959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.947964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.947969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.947975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.947979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.947986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.947991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:46.947996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:46.948001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:46.948006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:46.948054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:46.956051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:46.957628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:46.957640Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:46.957644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:46.957649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:46.957658Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2337 [2:7555896332374955510:10689]
2025-09-30T14:56:46.957680Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:46.957704Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:46.957709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:46.957713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:46.957716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:46.957744Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:46.957753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:46.957762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:46.957849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.957851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.957854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.957857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:46.957860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:46.957960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:46.957963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.957981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:46.957993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:46.958011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:46.958029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896332374955504:10689]
2025-09-30T14:56:46.958031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896332374955504:10689]
2025-09-30T14:56:46.958034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896332374955504:10689]
2025-09-30T14:56:46.958053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:46.958068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:46.958083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:46.958087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:46.958130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896332374955504:10689]
2025-09-30T14:56:46.958132Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:46.959000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2337
2025-09-30T14:56:46.959043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2337
2025-09-30T14:56:46.958521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:46.958534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:46.958536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:46.958542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:46.958848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896332464729322:4650], now have 1 active actors on pipe
2025-09-30T14:56:46.958857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896332464729027:2454], now have 1 active actors on pipe
2025-09-30T14:56:46.959326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:46.959346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:46.959393Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f40483ad-af4a2dc4-31e37bb0-3d635a7d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:46.959403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:46.959409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:46.959412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:46.959433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:46.959449Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:46.959502Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 85826639 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:56:46.959541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:46.959782Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 16 DataSize: 85826639 UsedReserveSize: 0
2025-09-30T14:56:46.959819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:56:46.960129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:46.960154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:46.960178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:46.960852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcbb9c78-defacdc1-fccb6712-c5f8b09f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f40483ad-af4a2dc4-31e37bb0-3d635a7d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:46.960502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2338 partition: 0 MaxSeqNo: 42 sessionId: src_id|f40483ad-af4a2dc4-31e37bb0-3d635a7d_0
2025-09-30T14:56:46.963664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f40483ad-af4a2dc4-31e37bb0-3d635a7d_0] Write session: try to update token
2025-09-30T14:56:46.963685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f40483ad-af4a2dc4-31e37bb0-3d635a7d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:46.977125Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:46.977148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:46.977151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:46.977153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:46.977164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896332374955504:10689]
2025-09-30T14:56:46.977169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896332374955504:10689]
2025-09-30T14:56:46.977173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896332374955504:10689]
2025-09-30T14:56:46.977213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:46.977220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:46.977224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:46.977397Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:46.978254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:46.978262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:46.978266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:46.993781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2338 sessionId: src_id|f40483ad-af4a2dc4-31e37bb0-3d635a7d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:46.996663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:47.019732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896336759696633:4281]
2025-09-30T14:56:47.021354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2337, pipe: [1:7555896336759696633:4281]
2025-09-30T14:56:47.102677Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:47.103098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:47.103108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:47.103128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896336759696633:4281], now have 1 active actors on pipe
2025-09-30T14:56:47.103412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:47.103424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:47.103486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2338 reason: error at write: Disconnected sessionId: src_id|f40483ad-af4a2dc4-31e37bb0-3d635a7d_0
2025-09-30T14:56:47.103692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2338 sessionId: src_id|f40483ad-af4a2dc4-31e37bb0-3d635a7d_0 is DEAD
2025-09-30T14:56:47.103819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896336759696633:4281]
2025-09-30T14:56:47.103841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f40483ad-af4a2dc4-31e37bb0-3d635a7d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:47.103866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f40483ad-af4a2dc4-31e37bb0-3d635a7d_0] Write session will restart in 0.008751s
2025-09-30T14:56:47.103854Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:47.103890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f40483ad-af4a2dc4-31e37bb0-3d635a7d_0] Write session: Do CDS request
2025-09-30T14:56:47.103896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f40483ad-af4a2dc4-31e37bb0-3d635a7d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:47.103416Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:47.113762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f40483ad-af4a2dc4-31e37bb0-3d635a7d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:47.115388Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:47.115413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2339
2025-09-30T14:56:47.115616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2339 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:47.115672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2339 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:47.115685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2339 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:47.115689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:47.116126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2339 sessionId:  describe result for acl check
2025-09-30T14:56:47.116156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:47.116164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:47.116166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:47.116173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896336759696756:4686] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:47.116711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896336759696756:4686] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:47.119069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896336759696756:4686] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:47.122012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896336759696756:4686] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:47.122027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896336759696756:4686] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:47.122030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896336759696756:4686] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:47.122038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2339 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:47.123180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:47.124108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:47.124300Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:47.124316Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:47.124326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:47.124374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:47.124417Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896336669923020:10705]
2025-09-30T14:56:47.125093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:47.125479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:47.125528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:47.125865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:47.125933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:47.125940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:47.125941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:47.125942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:47.125943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:47.125945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:47.125946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:47.125947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:47.125949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:47.125950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:47.125952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.125953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.125954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.125955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:47.125957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:47.125962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:47.125973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:47.125976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:47.125981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:47.125984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:47.125988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:47.125992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:47.125996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:47.126000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:47.126006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:47.126009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.126013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.126017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.126021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:47.126025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:47.126034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:47.126042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:47.126048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:47.126054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:47.126059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:47.126064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:47.126069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:47.126075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:47.126079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:47.126085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:47.126090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:47.126095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:47.126100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:47.126104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:47.126109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:47.126114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:47.126119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:47.126124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:47.126128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:47.126133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:47.126138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.126144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.126150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.126162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.126167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.126172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.126178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:47.126183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:47.126189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:47.126194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:47.126237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:47.132047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:47.133234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:47.133268Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:47.133271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:47.133275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:47.133282Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2338 [2:7555896336669923020:10705]
2025-09-30T14:56:47.133299Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:47.133316Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:47.133325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:47.133329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:47.133332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:47.133349Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:47.133362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:47.133369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:47.133434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.133445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.133447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.133451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:47.133454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:47.133530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:47.133538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.133553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.133569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.133588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:47.133614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896336669923015:10705]
2025-09-30T14:56:47.133621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896336669923015:10705]
2025-09-30T14:56:47.133623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896336669923015:10705]
2025-09-30T14:56:47.133633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:47.133644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:47.133647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:47.133662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:47.133665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:47.133669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:47.133671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:47.133675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896336759696674:2454], now have 1 active actors on pipe
2025-09-30T14:56:47.133680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896336759696962:4686], now have 1 active actors on pipe
2025-09-30T14:56:47.133717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896336669923015:10705]
2025-09-30T14:56:47.133732Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:47.133742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:47.133812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2338
2025-09-30T14:56:47.133834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2338
2025-09-30T14:56:47.134006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:47.134031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:47.134065Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2598850f-624717a0-97289d8b-2e6d4167_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:47.134080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:47.134084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:47.134086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:47.134107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:47.134123Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:47.134144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:47.134706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2339 partition: 0 MaxSeqNo: 42 sessionId: src_id|2598850f-624717a0-97289d8b-2e6d4167_0
2025-09-30T14:56:47.135088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f40483ad-af4a2dc4-31e37bb0-3d635a7d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2598850f-624717a0-97289d8b-2e6d4167_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:47.134506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:47.134518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:47.134538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:47.138084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2598850f-624717a0-97289d8b-2e6d4167_0] Write session: try to update token
2025-09-30T14:56:47.138107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2598850f-624717a0-97289d8b-2e6d4167_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:47.149381Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:47.149413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:47.149428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896336669923015:10705]
2025-09-30T14:56:47.149494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:47.149500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:47.150122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:47.150690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:47.150891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:47.151067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:47.151414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:47.151480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:47.156079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2339 sessionId: src_id|2598850f-624717a0-97289d8b-2e6d4167_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:47.159126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:47.159189Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:47.159213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:47.159216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:47.159218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:47.159228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896336669923015:10705]
2025-09-30T14:56:47.159232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896336669923015:10705]
2025-09-30T14:56:47.159237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896336669923015:10705]
2025-09-30T14:56:47.159305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:47.159315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.159318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:47.159418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:47.159433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:47.159439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:47.159601Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:47.204052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896336759696982:4281]
2025-09-30T14:56:47.204430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2338, pipe: [1:7555896336759696982:4281]
2025-09-30T14:56:47.284994Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:47.285591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:47.285610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:47.285632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896336759696982:4281], now have 1 active actors on pipe
2025-09-30T14:56:47.285888Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:47.285897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:47.285965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896336759696982:4281]
2025-09-30T14:56:47.285970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:47.285973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:47.286051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2339 reason: error at write: Disconnected sessionId: src_id|2598850f-624717a0-97289d8b-2e6d4167_0
2025-09-30T14:56:47.286227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2339 sessionId: src_id|2598850f-624717a0-97289d8b-2e6d4167_0 is DEAD
2025-09-30T14:56:47.286385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2598850f-624717a0-97289d8b-2e6d4167_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:47.286397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2598850f-624717a0-97289d8b-2e6d4167_0] Write session will restart in 0.007145s
2025-09-30T14:56:47.286420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2598850f-624717a0-97289d8b-2e6d4167_0] Write session: Do CDS request
2025-09-30T14:56:47.286429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2598850f-624717a0-97289d8b-2e6d4167_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:47.294843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2598850f-624717a0-97289d8b-2e6d4167_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:47.294936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:47.294955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2340
2025-09-30T14:56:47.295120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2340 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:47.295153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2340 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:47.295164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2340 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:47.295167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:47.295742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2340 sessionId:  describe result for acl check
2025-09-30T14:56:47.295793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:47.295798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:47.295800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:47.295831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896336759697045:4687] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:47.296486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896336759697045:4687] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:47.299105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896336759697045:4687] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:47.301587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896336759697045:4687] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:47.301600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896336759697045:4687] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:47.301603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896336759697045:4687] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:47.301611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2340 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:47.303884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:47.304936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:47.305139Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:47.305152Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:47.305163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:47.305214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:47.305275Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896336669923197:10707]
2025-09-30T14:56:47.305948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:47.306221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:47.306266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:47.306591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:47.306655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:47.306664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:47.306665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:47.306666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:47.306667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:47.306668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:47.306670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:47.306671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:47.306673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:47.306674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:47.306675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.306676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.306678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.306679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:47.306680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:47.306685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:47.306696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:47.306700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:47.306705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:47.306709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:47.306713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:47.306717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:47.306721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:47.306725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:47.306731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:47.306736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.306740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.306744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.306747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:47.306752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:47.306761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:47.306769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:47.306775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:47.306781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:47.306786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:47.306793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:47.306799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:47.306804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:47.306810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:47.306816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:47.306821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:47.306826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:47.306839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:47.306845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:47.306850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:47.306855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:47.306862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:47.306872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:47.306875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:47.306880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:47.306884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.306894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.306898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.306902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.306906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.306911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.306915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:47.306920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:47.306926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:47.306931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:47.306978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:47.312717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:47.314142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:47.314162Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:47.314166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:47.314169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:47.314177Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2339 [2:7555896336669923197:10707]
2025-09-30T14:56:47.314194Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:47.314209Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:47.314218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:47.314221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:47.314223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:47.314239Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:47.314251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:47.314262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:47.314332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.314340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.314342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.314346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:47.314348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:47.314417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:47.314425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.314438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.314457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.314482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:47.314507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896336759697260:4687], now have 1 active actors on pipe
2025-09-30T14:56:47.314515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896336759696987:2454], now have 1 active actors on pipe
2025-09-30T14:56:47.314522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896336669923192:10707]
2025-09-30T14:56:47.314525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896336669923192:10707]
2025-09-30T14:56:47.314528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896336669923192:10707]
2025-09-30T14:56:47.314542Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:47.314558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:47.314560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:47.314566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:47.314576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:47.314579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:47.314580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:47.314561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2339
2025-09-30T14:56:47.314593Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2339
2025-09-30T14:56:47.314618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896336669923192:10707]
2025-09-30T14:56:47.314630Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:47.314645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:47.314653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:47.314658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:47.314708Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26987573-705a34bc-955f046f-3b71ce0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:47.314721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:47.314730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:47.314733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:47.314743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:47.314757Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:47.314783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:47.314948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:47.314958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:47.314972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:47.315119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2340 partition: 0 MaxSeqNo: 42 sessionId: src_id|26987573-705a34bc-955f046f-3b71ce0e_0
2025-09-30T14:56:47.315567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2598850f-624717a0-97289d8b-2e6d4167_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|26987573-705a34bc-955f046f-3b71ce0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:47.318459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26987573-705a34bc-955f046f-3b71ce0e_0] Write session: try to update token
2025-09-30T14:56:47.318477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26987573-705a34bc-955f046f-3b71ce0e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:47.327438Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:47.327465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:47.327469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:47.327471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:47.327484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896336669923192:10707]
2025-09-30T14:56:47.327496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896336669923192:10707]
2025-09-30T14:56:47.327501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896336669923192:10707]
2025-09-30T14:56:47.327554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:47.327561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:47.327563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.327566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:47.327578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:47.327583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:47.327742Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:47.334483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2340 sessionId: src_id|26987573-705a34bc-955f046f-3b71ce0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:47.337501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:47.385827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896336759697294:4281]
2025-09-30T14:56:47.386195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2339, pipe: [1:7555896336759697294:4281]
2025-09-30T14:56:47.444436Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:47.444910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:47.444927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:47.444948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896336759697294:4281], now have 1 active actors on pipe
2025-09-30T14:56:47.445212Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:47.445235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896336759697294:4281]
2025-09-30T14:56:47.445254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:47.445259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:47.445278Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:47.445336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2340 reason: error at write: Disconnected sessionId: src_id|26987573-705a34bc-955f046f-3b71ce0e_0
2025-09-30T14:56:47.445526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2340 sessionId: src_id|26987573-705a34bc-955f046f-3b71ce0e_0 is DEAD
2025-09-30T14:56:47.445683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26987573-705a34bc-955f046f-3b71ce0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:47.445695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26987573-705a34bc-955f046f-3b71ce0e_0] Write session will restart in 0.009651s
2025-09-30T14:56:47.445718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26987573-705a34bc-955f046f-3b71ce0e_0] Write session: Do CDS request
2025-09-30T14:56:47.445726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26987573-705a34bc-955f046f-3b71ce0e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:47.456836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26987573-705a34bc-955f046f-3b71ce0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:47.456891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:47.456908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2341
2025-09-30T14:56:47.457097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2341 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:47.457139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2341 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:47.457150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2341 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:47.457155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:47.457630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2341 sessionId:  describe result for acl check
2025-09-30T14:56:47.457664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:47.457666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:47.457668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:47.457675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896336759697506:4693] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:47.458223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896336759697506:4693] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:47.460380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896336759697506:4693] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:47.460788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:47.461576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:47.461763Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:47.461772Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:47.461783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:47.461833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:47.461870Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896336669923374:10709]
2025-09-30T14:56:47.462523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:47.462726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896336759697506:4693] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:47.462743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896336759697506:4693] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:47.462746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896336759697506:4693] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:47.462753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2341 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:47.462851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:47.462896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:47.463226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:47.463310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:47.463318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:47.463319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:47.463321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:47.463322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:47.463324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:47.463325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:47.463326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:47.463327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:47.463328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:47.463329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.463331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.463332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.463333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:47.463334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:47.463340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:47.463350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:47.463354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:47.463358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:47.463362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:47.463366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:47.463370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:47.463373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:47.463377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:47.463382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:47.463386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.463389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.463393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.463397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:47.463401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:47.463409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:47.463416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:47.463422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:47.463427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:47.463432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:47.463438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:47.463443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:47.463449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:47.463454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:47.463459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:47.463463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:47.463469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:47.463474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:47.463479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:47.463484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:47.463489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:47.463495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:47.463500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:47.463505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:47.463517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:47.463522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.463531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.463535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.463541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.463551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.463556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.463566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:47.463571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:47.463575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:47.463581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:47.463626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:47.469285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:47.471002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:47.471025Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:47.471029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:47.471034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:47.471041Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2340 [2:7555896336669923374:10709]
2025-09-30T14:56:47.471060Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:47.471087Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:47.471096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:47.471099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:47.471102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:47.471120Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:47.471129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:47.471137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:47.471218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.471232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.471235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.471239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:47.471265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:47.471362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:47.471376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.471392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.471405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.471422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:47.471450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896336759697295:2454], now have 1 active actors on pipe
2025-09-30T14:56:47.471455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896336759697593:4693], now have 1 active actors on pipe
2025-09-30T14:56:47.471465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896336669923369:10709]
2025-09-30T14:56:47.471468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896336669923369:10709]
2025-09-30T14:56:47.471470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896336669923369:10709]
2025-09-30T14:56:47.471492Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:47.471511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:47.471525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:47.471527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:47.471530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:47.471531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:47.471532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:47.471543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2340
2025-09-30T14:56:47.471543Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2340
2025-09-30T14:56:47.471574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896336669923369:10709]
2025-09-30T14:56:47.471590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:47.471607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:47.471636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:47.471641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:47.471676Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c93011-d0b3815b-3038b2fd-53b4b40b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:47.471685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:47.471690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:47.471693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:47.471708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:47.471719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:47.471737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:47.472147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:47.472165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:47.472190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:47.472331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2341 partition: 0 MaxSeqNo: 42 sessionId: src_id|3c93011-d0b3815b-3038b2fd-53b4b40b_0
2025-09-30T14:56:47.472699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26987573-705a34bc-955f046f-3b71ce0e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3c93011-d0b3815b-3038b2fd-53b4b40b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:47.475537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c93011-d0b3815b-3038b2fd-53b4b40b_0] Write session: try to update token
2025-09-30T14:56:47.475559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c93011-d0b3815b-3038b2fd-53b4b40b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:47.484455Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:47.484484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:47.484487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:47.484490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:47.484499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896336669923369:10709]
2025-09-30T14:56:47.484504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896336669923369:10709]
2025-09-30T14:56:47.484508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896336669923369:10709]
2025-09-30T14:56:47.484548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:47.484556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.484564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:47.484563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:47.484570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:47.484574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:47.484714Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:47.491142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2341 sessionId: src_id|3c93011-d0b3815b-3038b2fd-53b4b40b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:47.493910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:47.545561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896336759697603:4281]
2025-09-30T14:56:47.545896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2340, pipe: [1:7555896336759697603:4281]
2025-09-30T14:56:47.605772Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:47.606136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:47.606171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:47.606222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896336759697603:4281], now have 1 active actors on pipe
2025-09-30T14:56:47.606577Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:47.606585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896336759697603:4281]
2025-09-30T14:56:47.606620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:47.606624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:47.606689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2341 reason: error at write: Disconnected sessionId: src_id|3c93011-d0b3815b-3038b2fd-53b4b40b_0
2025-09-30T14:56:47.606890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2341 sessionId: src_id|3c93011-d0b3815b-3038b2fd-53b4b40b_0 is DEAD
2025-09-30T14:56:47.606534Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:47.607037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c93011-d0b3815b-3038b2fd-53b4b40b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:47.607077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c93011-d0b3815b-3038b2fd-53b4b40b_0] Write session will restart in 0.006414s
2025-09-30T14:56:47.607103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c93011-d0b3815b-3038b2fd-53b4b40b_0] Write session: Do CDS request
2025-09-30T14:56:47.607109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c93011-d0b3815b-3038b2fd-53b4b40b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:47.614857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c93011-d0b3815b-3038b2fd-53b4b40b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:47.614944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:47.614961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2342
2025-09-30T14:56:47.615103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2342 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:47.615131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2342 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:47.615138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2342 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:47.615143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:47.615596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2342 sessionId:  describe result for acl check
2025-09-30T14:56:47.615636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:47.615638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:47.615640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:47.615647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896336759697619:4694] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:47.616220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896336759697619:4694] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:47.618529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896336759697619:4694] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:47.621283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896336759697619:4694] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:47.621302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896336759697619:4694] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:47.621306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896336759697619:4694] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:47.621317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2342 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:47.624773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:47.626144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:47.626392Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:47.626408Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:47.626421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:47.626480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:47.626527Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896336669923556:10712]
2025-09-30T14:56:47.627338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:47.627880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:47.627948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:47.628431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:47.628539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:47.628557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:47.628559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:47.628560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:47.628562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:47.628564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:47.628565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:47.628567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:47.628568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:47.628569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:47.628570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.628572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.628573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.628574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:47.628576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:47.628583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:47.628595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:47.628599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:47.628603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:47.628608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:47.628612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:47.628616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:47.628620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:47.628624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:47.628628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:47.628632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.628636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.628641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.628645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:47.628649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:47.628662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:47.628670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:47.628678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:47.628685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:47.628691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:47.628696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:47.628701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:47.628708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:47.628715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:47.628721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:47.628727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:47.628732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:47.628739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:47.628744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:47.628749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:47.628754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:47.628761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:47.628767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:47.628773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:47.628778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:47.628791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.628797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.628802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.628808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.628814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.628819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.628824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:47.628829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:47.628834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:47.628840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:47.628893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:47.635162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:47.636772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:47.636794Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:47.636798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:47.636803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:47.636812Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2341 [2:7555896336669923556:10712]
2025-09-30T14:56:47.636834Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:47.636855Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:47.636860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:47.636864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:47.636867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:47.636889Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:47.636898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:47.636909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:47.636994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.637008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.637011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.637016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:47.637019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:47.637111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:47.637128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.637145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.637156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.637174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:47.637198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896336669923551:10712]
2025-09-30T14:56:47.637209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896336669923551:10712]
2025-09-30T14:56:47.637212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896336669923551:10712]
2025-09-30T14:56:47.637225Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:47.637249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:47.637255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:47.637272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:47.637273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:47.637276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:47.637276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:47.637289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896336759697604:2454], now have 1 active actors on pipe
2025-09-30T14:56:47.637294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896336759697849:4694], now have 1 active actors on pipe
2025-09-30T14:56:47.637342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896336669923551:10712]
2025-09-30T14:56:47.637362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:47.637358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2341
2025-09-30T14:56:47.637382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2341
2025-09-30T14:56:47.637410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:47.637726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:47.637750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:47.637786Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ac7db62-721f7b22-cb5ab855-e9362c9f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:47.637807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:47.637812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:47.637825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:47.637840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:47.637857Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:47.637882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:47.638157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:47.638175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:47.638208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:47.638334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2342 partition: 0 MaxSeqNo: 42 sessionId: src_id|3ac7db62-721f7b22-cb5ab855-e9362c9f_0
2025-09-30T14:56:47.638728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c93011-d0b3815b-3038b2fd-53b4b40b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3ac7db62-721f7b22-cb5ab855-e9362c9f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:47.641601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ac7db62-721f7b22-cb5ab855-e9362c9f_0] Write session: try to update token
2025-09-30T14:56:47.641624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ac7db62-721f7b22-cb5ab855-e9362c9f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:47.650337Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:47.650362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:47.650365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:47.650367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:47.650378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896336669923551:10712]
2025-09-30T14:56:47.650383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896336669923551:10712]
2025-09-30T14:56:47.650387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896336669923551:10712]
2025-09-30T14:56:47.650435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:47.650442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.650445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:47.650445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:47.650454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:47.650459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:47.650600Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:47.657944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2342 sessionId: src_id|3ac7db62-721f7b22-cb5ab855-e9362c9f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:47.660918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:47.707940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896336759697915:4281]
2025-09-30T14:56:47.709510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2341, pipe: [1:7555896336759697915:4281]
2025-09-30T14:56:47.762681Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:47.763178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:47.763198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:47.763219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896336759697915:4281], now have 1 active actors on pipe
2025-09-30T14:56:47.763498Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:47.764045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896336759697915:4281]
2025-09-30T14:56:47.764069Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:47.764104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:47.764167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2342 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3ac7db62-721f7b22-cb5ab855-e9362c9f_0
2025-09-30T14:56:47.764331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2342 sessionId: src_id|3ac7db62-721f7b22-cb5ab855-e9362c9f_0 is DEAD
2025-09-30T14:56:47.764647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ac7db62-721f7b22-cb5ab855-e9362c9f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:47.764663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ac7db62-721f7b22-cb5ab855-e9362c9f_0] Write session will restart in 0.008718s
2025-09-30T14:56:47.764701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ac7db62-721f7b22-cb5ab855-e9362c9f_0] Write session: Do CDS request
2025-09-30T14:56:47.764709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ac7db62-721f7b22-cb5ab855-e9362c9f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:47.774823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ac7db62-721f7b22-cb5ab855-e9362c9f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:47.774882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:47.774897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2343
2025-09-30T14:56:47.775074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2343 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:47.775137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2343 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:47.775147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2343 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:47.775152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:47.775683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2343 sessionId:  describe result for acl check
2025-09-30T14:56:47.775723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:47.775732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:47.775734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:47.775740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896336759698129:4723] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:47.776313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896336759698129:4723] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:47.778908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896336759698129:4723] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:47.779701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:47.780966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:47.781160Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:47.781175Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:47.781185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:47.781247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:47.781312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896336759698129:4723] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:47.781326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896336759698129:4723] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:47.781330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896336759698129:4723] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:47.781339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2343 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:47.781289Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896336669923735:10714]
2025-09-30T14:56:47.781991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:47.782260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:47.782311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:47.782658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:47.782726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:47.782733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:47.782734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:47.782735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:47.782736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:47.782738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:47.782740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:47.782741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:47.782742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:47.782744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:47.782745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.782747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.782748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.782749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:47.782750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:47.782756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:47.782766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:47.782771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:47.782776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:47.782781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:47.782786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:47.782790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:47.782795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:47.782799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:47.782804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:47.782809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.782814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.782819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.782824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:47.782828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:47.782838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:47.782846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:47.782853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:47.782859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:47.782865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:47.782871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:47.782876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:47.782882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:47.782887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:47.782892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:47.782897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:47.782903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:47.782916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:47.782922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:47.782927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:47.782938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:47.782943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:47.782955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:47.782960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:47.782970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:47.782976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.782987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.782992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.783003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.783009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.783019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.783024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:47.783034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:47.783040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:47.783050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:47.783100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:47.789611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:47.790722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:47.790738Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:47.790742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:47.790747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:47.790754Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2342 [2:7555896336669923735:10714]
2025-09-30T14:56:47.790771Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:47.790788Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:47.790791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:47.790795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:47.790797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:47.790816Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:47.790823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:47.790831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:47.790895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.790903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.790905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.790909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:47.790913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:47.790982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:47.790991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.791005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.791019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.791036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:47.791061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896336759698213:4723], now have 1 active actors on pipe
2025-09-30T14:56:47.791065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896336759697916:2454], now have 1 active actors on pipe
2025-09-30T14:56:47.791071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896336669923730:10714]
2025-09-30T14:56:47.791074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896336669923730:10714]
2025-09-30T14:56:47.791076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896336669923730:10714]
2025-09-30T14:56:47.791088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:47.791101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:47.791103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:47.791106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:47.791117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:47.791122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:47.791125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:47.791160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896336669923730:10714]
2025-09-30T14:56:47.791171Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:47.791170Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2342
2025-09-30T14:56:47.791200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:47.791175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2342
2025-09-30T14:56:47.791303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:47.791321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:47.791358Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bcdcd7e-d843dc25-cd0594f5-9c50be5d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:47.791371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:47.791379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:47.791381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:47.791393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:47.791410Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:47.791431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:47.791607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:47.791620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:47.791642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:47.791744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2343 partition: 0 MaxSeqNo: 42 sessionId: src_id|bcdcd7e-d843dc25-cd0594f5-9c50be5d_0
2025-09-30T14:56:47.792078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ac7db62-721f7b22-cb5ab855-e9362c9f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bcdcd7e-d843dc25-cd0594f5-9c50be5d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:47.794924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcdcd7e-d843dc25-cd0594f5-9c50be5d_0] Write session: try to update token
2025-09-30T14:56:47.794946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcdcd7e-d843dc25-cd0594f5-9c50be5d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:47.804405Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:47.804431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:47.804442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896336669923730:10714]
2025-09-30T14:56:47.804489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:47.804497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:47.804695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:47.805047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:47.805210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:47.805381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:47.805593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:47.805644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:47.815469Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:47.815495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:47.815498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:47.815499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:47.815510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896336669923730:10714]
2025-09-30T14:56:47.815519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896336669923730:10714]
2025-09-30T14:56:47.815524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896336669923730:10714]
2025-09-30T14:56:47.815568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:47.815574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:47.815581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:47.815585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:47.815586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.815589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:47.815734Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:47.821760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2343 sessionId: src_id|bcdcd7e-d843dc25-cd0594f5-9c50be5d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:47.824786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:47.864012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896336759698226:4281]
2025-09-30T14:56:47.864391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2342, pipe: [1:7555896336759698226:4281]
2025-09-30T14:56:47.929922Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:47.930355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:47.930367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:47.930385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896336759698226:4281], now have 1 active actors on pipe
2025-09-30T14:56:47.931128Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:47.930683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:47.930756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896336759698226:4281]
2025-09-30T14:56:47.930785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:47.930788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:47.930921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2343 reason: error at write: Disconnected sessionId: src_id|bcdcd7e-d843dc25-cd0594f5-9c50be5d_0
2025-09-30T14:56:47.931111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2343 sessionId: src_id|bcdcd7e-d843dc25-cd0594f5-9c50be5d_0 is DEAD
2025-09-30T14:56:47.931464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcdcd7e-d843dc25-cd0594f5-9c50be5d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:47.931475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcdcd7e-d843dc25-cd0594f5-9c50be5d_0] Write session will restart in 0.005335s
2025-09-30T14:56:47.931499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcdcd7e-d843dc25-cd0594f5-9c50be5d_0] Write session: Do CDS request
2025-09-30T14:56:47.931504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcdcd7e-d843dc25-cd0594f5-9c50be5d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:47.937768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcdcd7e-d843dc25-cd0594f5-9c50be5d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:47.937908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:47.937928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2344
2025-09-30T14:56:47.939744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2344 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:47.939795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2344 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:47.939801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2344 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:47.939807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:47.940459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2344 sessionId:  describe result for acl check
2025-09-30T14:56:47.940510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:47.940516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:47.940518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:47.940526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896336759698332:4727] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:47.941099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896336759698332:4727] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:47.943507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896336759698332:4727] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:47.945996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896336759698332:4727] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:47.946011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896336759698332:4727] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:47.946015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896336759698332:4727] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:47.946025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2344 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:47.954578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:47.956020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:47.956238Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:47.956250Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:47.956263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:47.956320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:47.956363Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896336669923931:10717]
2025-09-30T14:56:47.957078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:47.957488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:47.957545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:47.957926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:47.957993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:47.958000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:47.958002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:47.958003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:47.958005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:47.958006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:47.958008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:47.958009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:47.958010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:47.958012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:47.958013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.958015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.958016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.958017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:47.958018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:47.958025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:47.958037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:47.958042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:47.958047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:47.958051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:47.958056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:47.958060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:47.958065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:47.958069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:47.958073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:47.958078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.958090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.958094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.958099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:47.958104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:47.958111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:47.958120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:47.958127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:47.958134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:47.958145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:47.958149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:47.958154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:47.958164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:47.958169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:47.958179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:47.958188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:47.958199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:47.958208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:47.958228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:47.958237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:47.958247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:47.958258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:47.958268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:47.958277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:47.958283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:47.958293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.958299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.958308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.958315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.958325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.958331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.958336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:47.958342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:47.958352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:47.958363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:47.958416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:47.964642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:47.965812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:47.965835Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:47.965838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:47.965842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:47.965850Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2343 [2:7555896336669923931:10717]
2025-09-30T14:56:47.965866Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:47.965883Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:47.965886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:47.965889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:47.965891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:47.965907Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:47.965924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:47.965932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:47.966000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.966003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.966004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.966008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:47.966011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:47.966078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:47.966081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.966094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:47.966104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:47.966122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:47.966138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896336669923926:10717]
2025-09-30T14:56:47.966148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896336669923926:10717]
2025-09-30T14:56:47.966150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896336669923926:10717]
2025-09-30T14:56:47.966158Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:47.966173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:47.966167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:47.966178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:47.966180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:47.966187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:47.966189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:47.966200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896336759698420:4727], now have 1 active actors on pipe
2025-09-30T14:56:47.966204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896336759698227:2454], now have 1 active actors on pipe
2025-09-30T14:56:47.966239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896336669923926:10717]
2025-09-30T14:56:47.966250Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:47.966255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:47.966316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:47.966326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:47.966351Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88f24918-a4fa0382-798b55c6-f25fb677_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:47.966358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:47.966362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:47.966364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:47.966374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:47.966383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:47.966397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:47.966695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:47.966706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:47.966724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:47.967298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcdcd7e-d843dc25-cd0594f5-9c50be5d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|88f24918-a4fa0382-798b55c6-f25fb677_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:47.970287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88f24918-a4fa0382-798b55c6-f25fb677_0] Write session: try to update token
2025-09-30T14:56:47.970308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88f24918-a4fa0382-798b55c6-f25fb677_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:47.966271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2343
2025-09-30T14:56:47.966309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2343
2025-09-30T14:56:47.966868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2344 partition: 0 MaxSeqNo: 42 sessionId: src_id|88f24918-a4fa0382-798b55c6-f25fb677_0
2025-09-30T14:56:47.978919Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:47.978943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:47.978946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:47.978947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:47.978958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896336669923926:10717]
2025-09-30T14:56:47.978963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896336669923926:10717]
2025-09-30T14:56:47.978968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896336669923926:10717]
2025-09-30T14:56:47.979012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:47.979019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:47.979022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:47.979023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:47.979030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:47.979035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:47.979167Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:47.991101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2344 sessionId: src_id|88f24918-a4fa0382-798b55c6-f25fb677_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:47.994124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:48.027342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896341054665834:4281]
2025-09-30T14:56:48.027648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2343, pipe: [1:7555896341054665834:4281]
2025-09-30T14:56:48.095894Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:48.096799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:48.096819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:48.096840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896341054665834:4281], now have 1 active actors on pipe
2025-09-30T14:56:48.097069Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:48.097197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:48.097301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2344 reason: status is not ok: tablet will be restarted right now sessionId: src_id|88f24918-a4fa0382-798b55c6-f25fb677_0
2025-09-30T14:56:48.097475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2344 sessionId: src_id|88f24918-a4fa0382-798b55c6-f25fb677_0 is DEAD
2025-09-30T14:56:48.097661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:48.097700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896341054665834:4281]
2025-09-30T14:56:48.097747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88f24918-a4fa0382-798b55c6-f25fb677_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:48.097764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88f24918-a4fa0382-798b55c6-f25fb677_0] Write session will restart in 0.005754s
2025-09-30T14:56:48.097797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88f24918-a4fa0382-798b55c6-f25fb677_0] Write session: Do CDS request
2025-09-30T14:56:48.097805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88f24918-a4fa0382-798b55c6-f25fb677_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:48.105215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88f24918-a4fa0382-798b55c6-f25fb677_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:48.105476Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:48.105492Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2345
2025-09-30T14:56:48.105612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2345 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:48.105642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2345 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:48.105652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2345 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:48.105656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:48.106042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2345 sessionId:  describe result for acl check
2025-09-30T14:56:48.106070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:48.106073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:48.106074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:48.106079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896341054665954:4749] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:48.106595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896341054665954:4749] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:48.108991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896341054665954:4749] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:48.112135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896341054665954:4749] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:48.112150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896341054665954:4749] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:48.112155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896341054665954:4749] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:48.112178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2345 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:48.113328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:48.115337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:48.115599Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:48.115611Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:48.115623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:48.115682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:48.115732Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896340964891422:10726]
2025-09-30T14:56:48.116299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:48.116694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:48.116774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:48.117174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:48.117298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:48.117312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:48.117313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:48.117315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:48.117316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:48.117317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:48.117318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:48.117319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:48.117321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:48.117322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:48.117323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.117324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:48.117326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:48.117327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:48.117328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:48.117336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:48.117347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:48.117351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:48.117355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:48.117359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:48.117363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:48.117367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:48.117371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:48.117375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:48.117380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:48.117383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.117387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:48.117391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:48.117395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:48.117398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:48.117411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:48.117435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:48.117445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:48.117451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:48.117456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:48.117463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:48.117468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:48.117473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:48.117478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:48.117483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:48.117488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:48.117493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:48.117508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:48.117513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:48.117518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:48.117523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:48.117528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:48.117533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:48.117538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:48.117543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:48.117548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.117553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.117558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:48.117564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:48.117581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:48.117594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:48.117599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:48.117605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:48.117609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:48.117615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:48.117656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:48.124490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:48.126330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:48.126363Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:48.126367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:48.126371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:48.126378Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2344 [2:7555896340964891422:10726]
2025-09-30T14:56:48.126394Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:48.126412Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:48.126416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:48.126419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:48.126421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:48.126439Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:48.126448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:48.126456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:48.126522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.126532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:48.126534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:48.126537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:48.126539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:48.126617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:48.126626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.126641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:48.126656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:48.126677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:48.126705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896341054666159:4749], now have 1 active actors on pipe
2025-09-30T14:56:48.126708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896341054665860:2454], now have 1 active actors on pipe
2025-09-30T14:56:48.126715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896340964891417:10726]
2025-09-30T14:56:48.126717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896340964891417:10726]
2025-09-30T14:56:48.126720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896340964891417:10726]
2025-09-30T14:56:48.126732Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:48.126746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:48.126747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:48.126758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:48.126760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:48.126760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:48.126763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:48.126801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896340964891417:10726]
2025-09-30T14:56:48.126811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:48.126812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:48.126828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:48.126834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:48.126887Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0440297-3285e79f-4e33c29f-b53fd63e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:48.126903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:48.126912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:48.126914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:48.126924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:48.126933Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:48.126958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:48.127459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:48.127474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:48.127495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:48.126766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2344
2025-09-30T14:56:48.126798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2344
2025-09-30T14:56:48.127649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2345 partition: 0 MaxSeqNo: 42 sessionId: src_id|e0440297-3285e79f-4e33c29f-b53fd63e_0
2025-09-30T14:56:48.131360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88f24918-a4fa0382-798b55c6-f25fb677_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e0440297-3285e79f-4e33c29f-b53fd63e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:48.134208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0440297-3285e79f-4e33c29f-b53fd63e_0] Write session: try to update token
2025-09-30T14:56:48.134227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0440297-3285e79f-4e33c29f-b53fd63e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:48.140524Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:48.140552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:48.140555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:48.140557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:48.140565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896340964891417:10726]
2025-09-30T14:56:48.140569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896340964891417:10726]
2025-09-30T14:56:48.140573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896340964891417:10726]
2025-09-30T14:56:48.140611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:48.140619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.140621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:48.140629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:48.140635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:48.140641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:48.140755Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:48.150403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2345 sessionId: src_id|e0440297-3285e79f-4e33c29f-b53fd63e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:48.153203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:48.197812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896341054666186:4281]
2025-09-30T14:56:48.198259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2344, pipe: [1:7555896341054666186:4281]
2025-09-30T14:56:48.258033Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:48.258482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:48.258500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:48.258520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896341054666186:4281], now have 1 active actors on pipe
2025-09-30T14:56:48.258754Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:48.258858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896341054666186:4281]
2025-09-30T14:56:48.258894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:48.259446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0440297-3285e79f-4e33c29f-b53fd63e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:48.259465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0440297-3285e79f-4e33c29f-b53fd63e_0] Write session will restart in 0.007931s
2025-09-30T14:56:48.259507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0440297-3285e79f-4e33c29f-b53fd63e_0] Write session: Do CDS request
2025-09-30T14:56:48.259514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0440297-3285e79f-4e33c29f-b53fd63e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:48.258992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2345 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e0440297-3285e79f-4e33c29f-b53fd63e_0
2025-09-30T14:56:48.259033Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:48.259187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2345 sessionId: src_id|e0440297-3285e79f-4e33c29f-b53fd63e_0 is DEAD
2025-09-30T14:56:48.271905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0440297-3285e79f-4e33c29f-b53fd63e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:48.274184Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:48.274200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2346
2025-09-30T14:56:48.275029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2346 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:48.275087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2346 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:48.275092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2346 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:48.275097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:48.275542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2346 sessionId:  describe result for acl check
2025-09-30T14:56:48.275582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:48.275585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:48.275587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:48.275593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896341054666416:4767] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:48.276191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896341054666416:4767] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:48.278834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896341054666416:4767] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:48.280251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:48.282285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896341054666416:4767] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:48.282300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896341054666416:4767] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:48.282304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896341054666416:4767] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:48.282312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2346 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:48.281832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:48.282059Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:48.282063Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:48.282075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:48.282138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:48.282176Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896340964891628:10734]
2025-09-30T14:56:48.282790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:48.283086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:48.283136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:48.283512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:48.283595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:48.283597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:48.283598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:48.283599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:48.283600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:48.283602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:48.283603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:48.283604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:48.283606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:48.283607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:48.283608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.283609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:48.283611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:48.283612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:48.283613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:48.283619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:48.283630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:48.283634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:48.283639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:48.283643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:48.283648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:48.283652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:48.283656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:48.283661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:48.283665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:48.283669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.283674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:48.283677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:48.283682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:48.283686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:48.283693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:48.283701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:48.283707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:48.283713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:48.283718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:48.283724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:48.283730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:48.283736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:48.283741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:48.283746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:48.283750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:48.283756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:48.283761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:48.283767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:48.283772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:48.283778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:48.283782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:48.283787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:48.283792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:48.283798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:48.283805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.283810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.283815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:48.283820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:48.283825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:48.283831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:48.283836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:48.283841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:48.283846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:48.283852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:48.283899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:48.292110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:48.293417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:48.293438Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:48.293441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:48.293445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:48.293452Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2345 [2:7555896340964891628:10734]
2025-09-30T14:56:48.293471Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:48.293488Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:48.293491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:48.293494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:48.293497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:48.293512Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:48.293519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:48.293527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:48.293592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.293594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:48.293596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:48.293600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:48.293602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:48.293666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:48.293676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.293692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:48.293704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:48.293722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:48.293743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896340964891623:10734]
2025-09-30T14:56:48.293749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896340964891623:10734]
2025-09-30T14:56:48.293752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896340964891623:10734]
2025-09-30T14:56:48.293766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:48.293780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:48.293797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:48.293800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:48.293827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:48.293837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:48.293839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896340964891623:10734]
2025-09-30T14:56:48.293842Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:48.293842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:48.293848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:48.294092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2345
2025-09-30T14:56:48.294126Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2345
2025-09-30T14:56:48.294092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896341054666494:4767], now have 1 active actors on pipe
2025-09-30T14:56:48.294103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896341054666190:2454], now have 1 active actors on pipe
2025-09-30T14:56:48.294310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:48.294321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:48.294348Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|585fed06-8d55a55c-577725a7-c477088b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:48.294361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:48.294364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:48.294367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:48.294381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:48.294391Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:48.294411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:48.294630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:48.294638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:48.294652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:48.294772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2346 partition: 0 MaxSeqNo: 42 sessionId: src_id|585fed06-8d55a55c-577725a7-c477088b_0
2025-09-30T14:56:48.295219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0440297-3285e79f-4e33c29f-b53fd63e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|585fed06-8d55a55c-577725a7-c477088b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:48.298757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|585fed06-8d55a55c-577725a7-c477088b_0] Write session: try to update token
2025-09-30T14:56:48.298786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|585fed06-8d55a55c-577725a7-c477088b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:48.315757Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:48.315780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:48.315792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896340964891623:10734]
2025-09-30T14:56:48.315842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:48.315858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:48.316038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:48.316199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:48.316354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:48.316510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:48.316719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:48.316766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:48.321717Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:48.321737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:48.321740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:48.321742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:48.321753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896340964891623:10734]
2025-09-30T14:56:48.321758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896340964891623:10734]
2025-09-30T14:56:48.321762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896340964891623:10734]
2025-09-30T14:56:48.321801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:48.321808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.321811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:48.321818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:48.321829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:48.321834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:48.321886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2346 sessionId: src_id|585fed06-8d55a55c-577725a7-c477088b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:48.321960Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:48.325431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:48.359186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896341054666507:4281]
2025-09-30T14:56:48.359818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2345, pipe: [1:7555896341054666507:4281]
2025-09-30T14:56:48.439893Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:48.440339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:48.440361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:48.440383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896341054666507:4281], now have 1 active actors on pipe
2025-09-30T14:56:48.440671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896341054666507:4281]
2025-09-30T14:56:48.440744Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:48.440710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:48.440713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:48.440783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2346 reason: error at write: Disconnected sessionId: src_id|585fed06-8d55a55c-577725a7-c477088b_0
2025-09-30T14:56:48.440945Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:48.440958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2346 sessionId: src_id|585fed06-8d55a55c-577725a7-c477088b_0 is DEAD
2025-09-30T14:56:48.441305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|585fed06-8d55a55c-577725a7-c477088b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:48.441317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|585fed06-8d55a55c-577725a7-c477088b_0] Write session will restart in 0.008775s
2025-09-30T14:56:48.441356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|585fed06-8d55a55c-577725a7-c477088b_0] Write session: Do CDS request
2025-09-30T14:56:48.441362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|585fed06-8d55a55c-577725a7-c477088b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:48.451761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|585fed06-8d55a55c-577725a7-c477088b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:48.451842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:48.451864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2347
2025-09-30T14:56:48.452037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2347 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:48.452073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2347 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:48.452085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2347 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:48.452089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:48.452497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2347 sessionId:  describe result for acl check
2025-09-30T14:56:48.452538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:48.452541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:48.452542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:48.452551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896341054666702:4773] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:48.453102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896341054666702:4773] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:48.455407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896341054666702:4773] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:48.457663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896341054666702:4773] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:48.457669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896341054666702:4773] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:48.457673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896341054666702:4773] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:48.457681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2347 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:48.461848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:48.462922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:48.463140Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:48.463153Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:48.463165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:48.463220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:48.463286Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896340964891815:10736]
2025-09-30T14:56:48.463996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:48.464354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:48.464408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:48.464776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:48.464859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:48.464866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:48.464867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:48.464868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:48.464869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:48.464870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:48.464871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:48.464873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:48.464874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:48.464875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:48.464876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.464877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:48.464878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:48.464879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:48.464880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:48.464886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:48.464896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:48.464900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:48.464905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:48.464909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:48.464912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:48.464916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:48.464919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:48.464923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:48.464927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:48.464930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.464934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:48.464937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:48.464940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:48.464944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:48.464952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:48.464959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:48.464965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:48.464970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:48.464976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:48.464981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:48.464985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:48.464989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:48.464995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:48.464999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:48.465003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:48.465009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:48.465013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:48.465018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:48.465022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:48.465026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:48.465031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:48.465035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:48.465039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:48.465044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:48.465048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.465053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.465057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:48.465062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:48.465067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:48.465071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:48.465075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:48.465080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:48.465084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:48.465089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:48.465128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:48.470885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:48.472158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:48.472179Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:48.472182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:48.472186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:48.472194Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2346 [2:7555896340964891815:10736]
2025-09-30T14:56:48.472210Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:48.472229Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:48.472238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:48.472242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:48.472244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:48.472261Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:48.472269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:48.472281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:48.472353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.472360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:48.472363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:48.472367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:48.472370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:48.472449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:48.472460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.472476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:48.472488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:48.472506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:48.472524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896341054666508:2454], now have 1 active actors on pipe
2025-09-30T14:56:48.472532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896341054666810:4773], now have 1 active actors on pipe
2025-09-30T14:56:48.472539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896340964891809:10736]
2025-09-30T14:56:48.472541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896340964891809:10736]
2025-09-30T14:56:48.472543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896340964891809:10736]
2025-09-30T14:56:48.472559Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:48.472577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:48.472587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:48.472591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:48.472591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:48.472593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:48.472594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:48.472632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896340964891809:10736]
2025-09-30T14:56:48.472641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:48.472643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:48.472703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:48.472714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:48.472740Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dae01a4d-b75c44f-65c4d10a-9f346f2e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:48.472751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:48.472755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:48.472758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:48.472772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:48.472785Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:48.472806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:48.472971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:48.472979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:48.472993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:48.473451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|585fed06-8d55a55c-577725a7-c477088b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dae01a4d-b75c44f-65c4d10a-9f346f2e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:48.472598Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2346
2025-09-30T14:56:48.472653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2346
2025-09-30T14:56:48.473061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2347 partition: 0 MaxSeqNo: 42 sessionId: src_id|dae01a4d-b75c44f-65c4d10a-9f346f2e_0
2025-09-30T14:56:48.476721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dae01a4d-b75c44f-65c4d10a-9f346f2e_0] Write session: try to update token
2025-09-30T14:56:48.476743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dae01a4d-b75c44f-65c4d10a-9f346f2e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:48.484906Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:48.484926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:48.484936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896340964891809:10736]
2025-09-30T14:56:48.484986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:48.484991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:48.485159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:48.485333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:48.485482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:48.485632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:48.485832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:48.485876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:48.500444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2347 sessionId: src_id|dae01a4d-b75c44f-65c4d10a-9f346f2e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:48.503221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:48.504205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:48.504231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:48.504252Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:48.504255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:48.504259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:48.504261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:48.504271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896340964891809:10736]
2025-09-30T14:56:48.504275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896340964891809:10736]
2025-09-30T14:56:48.504280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896340964891809:10736]
2025-09-30T14:56:48.504332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:48.504334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:48.504341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:48.504345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.504347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:48.504347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:48.504492Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:48.543328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896341054666825:4281]
2025-09-30T14:56:48.543721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2346, pipe: [1:7555896341054666825:4281]
2025-09-30T14:56:48.623510Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:48.624101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:48.624140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896341054666825:4281], now have 1 active actors on pipe
2025-09-30T14:56:48.624332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:48.624854Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:48.624911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896341054666825:4281]
2025-09-30T14:56:48.636895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:48.639596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dae01a4d-b75c44f-65c4d10a-9f346f2e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:48.639631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dae01a4d-b75c44f-65c4d10a-9f346f2e_0] Write session will restart in 0.005471s
2025-09-30T14:56:48.639666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dae01a4d-b75c44f-65c4d10a-9f346f2e_0] Write session: Do CDS request
2025-09-30T14:56:48.639672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dae01a4d-b75c44f-65c4d10a-9f346f2e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:48.636911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:48.636938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2347 reason: error at write: Disconnected sessionId: src_id|dae01a4d-b75c44f-65c4d10a-9f346f2e_0
2025-09-30T14:56:48.637083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2347 sessionId: src_id|dae01a4d-b75c44f-65c4d10a-9f346f2e_0 is DEAD
2025-09-30T14:56:48.647094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dae01a4d-b75c44f-65c4d10a-9f346f2e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:48.647933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:48.647950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2348
2025-09-30T14:56:48.648129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2348 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:48.648176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2348 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:48.648181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2348 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:48.648186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:48.648696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2348 sessionId:  describe result for acl check
2025-09-30T14:56:48.648723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:48.648727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:48.648731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:48.648738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896341054666957:4786] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:48.649296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896341054666957:4786] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:48.653154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896341054666957:4786] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:48.656521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896341054666957:4786] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:48.656545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896341054666957:4786] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:48.656548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896341054666957:4786] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:48.656560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2348 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:48.656806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:48.657992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:48.658193Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:48.658208Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:48.658220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:48.658276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:48.658321Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896340964892003:10739]
2025-09-30T14:56:48.658931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:48.659334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:48.659411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:48.659837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:48.659922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:48.659928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:48.659930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:48.659931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:48.659932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:48.659934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:48.659935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:48.659936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:48.659938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:48.659939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:48.659940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.659942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:48.659943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:48.659944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:48.659945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:48.659951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:48.659962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:48.659966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:48.659970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:48.659974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:48.659978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:48.659982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:48.659986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:48.659991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:48.659995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:48.660000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.660004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:48.660008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:48.660013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:48.660017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:48.660026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:48.660034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:48.660053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:48.660060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:48.660065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:48.660070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:48.660074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:48.660079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:48.660084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:48.660090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:48.660094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:48.660100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:48.660105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:48.660110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:48.660116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:48.660132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:48.660138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:48.660143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:48.660147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:48.660153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:48.660158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.660162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.660167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:48.660173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:48.660178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:48.660183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:48.660188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:48.660194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:48.660199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:48.660204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:48.660266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:48.665905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:48.667172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:48.667193Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:48.667196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:48.667201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:48.667208Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2347 [2:7555896340964892003:10739]
2025-09-30T14:56:48.667227Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:48.667266Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:48.667275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:48.667279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:48.667281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:48.667298Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:48.667310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:48.667317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:48.667389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.667398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:48.667400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:48.667404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:48.667407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:48.667480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:48.667490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.667503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:48.667521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:48.667545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:48.667573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896341054667130:4786], now have 1 active actors on pipe
2025-09-30T14:56:48.667577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896341054666828:2454], now have 1 active actors on pipe
2025-09-30T14:56:48.667584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896340964891997:10739]
2025-09-30T14:56:48.667586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896340964891997:10739]
2025-09-30T14:56:48.667588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896340964891997:10739]
2025-09-30T14:56:48.667603Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:48.667618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:48.667621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:48.667625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:48.667627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:48.667640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:48.667643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:48.667680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896340964891997:10739]
2025-09-30T14:56:48.667688Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:48.667665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2347
2025-09-30T14:56:48.667691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:48.667674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2347
2025-09-30T14:56:48.667717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:48.667723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:48.667768Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6cee361d-1c8d5ad3-b4b20eec-3c950f80_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:48.667780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:48.667784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:48.667786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:48.667798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:48.667808Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:48.667830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:48.667990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:48.668000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:48.668014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:48.668107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2348 partition: 0 MaxSeqNo: 42 sessionId: src_id|6cee361d-1c8d5ad3-b4b20eec-3c950f80_0
2025-09-30T14:56:48.668623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dae01a4d-b75c44f-65c4d10a-9f346f2e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6cee361d-1c8d5ad3-b4b20eec-3c950f80_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:48.671641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cee361d-1c8d5ad3-b4b20eec-3c950f80_0] Write session: try to update token
2025-09-30T14:56:48.671666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cee361d-1c8d5ad3-b4b20eec-3c950f80_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:48.680729Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:48.680746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:48.680748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:48.680749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:48.680759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896340964891997:10739]
2025-09-30T14:56:48.680763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896340964891997:10739]
2025-09-30T14:56:48.680766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896340964891997:10739]
2025-09-30T14:56:48.680805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:48.680813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.680815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:48.680828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:48.680835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:48.680840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:48.680961Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:48.690608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2348 sessionId: src_id|6cee361d-1c8d5ad3-b4b20eec-3c950f80_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:48.693550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:48.724680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896341054667145:4281]
2025-09-30T14:56:48.725913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2347, pipe: [1:7555896341054667145:4281]
2025-09-30T14:56:48.797205Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:48.797764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:48.797783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:48.797837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896341054667145:4281], now have 1 active actors on pipe
2025-09-30T14:56:48.798152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:48.798165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:48.798262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2348 reason: error at write: Disconnected sessionId: src_id|6cee361d-1c8d5ad3-b4b20eec-3c950f80_0
2025-09-30T14:56:48.798345Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:48.798456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2348 sessionId: src_id|6cee361d-1c8d5ad3-b4b20eec-3c950f80_0 is DEAD
2025-09-30T14:56:48.798513Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:48.798562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896341054667145:4281]
2025-09-30T14:56:48.798863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cee361d-1c8d5ad3-b4b20eec-3c950f80_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:48.798872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cee361d-1c8d5ad3-b4b20eec-3c950f80_0] Write session will restart in 0.008659s
2025-09-30T14:56:48.798909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cee361d-1c8d5ad3-b4b20eec-3c950f80_0] Write session: Do CDS request
2025-09-30T14:56:48.798920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cee361d-1c8d5ad3-b4b20eec-3c950f80_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:48.811751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cee361d-1c8d5ad3-b4b20eec-3c950f80_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:48.811832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:48.811845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2349
2025-09-30T14:56:48.812007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2349 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:48.812038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2349 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:48.812044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2349 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:48.812048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:48.812568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2349 sessionId:  describe result for acl check
2025-09-30T14:56:48.812621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:48.812628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:48.812630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:48.812636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896341054667197:4797] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:48.813215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896341054667197:4797] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:48.815145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896341054667197:4797] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:48.820104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896341054667197:4797] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:48.820121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896341054667197:4797] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:48.820125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896341054667197:4797] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:48.820134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2349 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:48.829161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:48.830452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:48.830621Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:48.830630Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:48.830639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:48.830680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:48.830723Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896340964892190:10741]
2025-09-30T14:56:48.831377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:48.831707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:48.831746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:48.832055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:48.832115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:48.832120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:48.832121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:48.832123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:48.832124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:48.832125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:48.832126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:48.832127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:48.832128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:48.832130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:48.832131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.832132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:48.832133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:48.832134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:48.832135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:48.832140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:48.832150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:48.832154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:48.832157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:48.832160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:48.832164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:48.832168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:48.832171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:48.832175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:48.832179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:48.832182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.832186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:48.832189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:48.832192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:48.832196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:48.832204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:48.832216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:48.832222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:48.832227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:48.832234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:48.832239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:48.832243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:48.832248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:48.832256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:48.832261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:48.832265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:48.832269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:48.832274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:48.832278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:48.832282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:48.832287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:48.832291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:48.832296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:48.832300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:48.832305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:48.832309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.832314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.832318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:48.832331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:48.832335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:48.832352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:48.832363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:48.832369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:48.832373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:48.832378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:48.832415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:48.837927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:48.839057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:48.839074Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:48.839077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:48.839082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:48.839089Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2348 [2:7555896340964892190:10741]
2025-09-30T14:56:48.839108Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:48.839123Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:48.839127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:48.839130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:48.839132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:48.839147Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:48.839159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:48.839167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:48.839234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.839241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:48.839259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:48.839263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:48.839266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:48.839334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:48.839342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.839356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:48.839368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:48.839386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:48.839405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896341054667264:4797], now have 1 active actors on pipe
2025-09-30T14:56:48.839409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896341054667147:2454], now have 1 active actors on pipe
2025-09-30T14:56:48.839415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896340964892185:10741]
2025-09-30T14:56:48.839418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896340964892185:10741]
2025-09-30T14:56:48.839421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896340964892185:10741]
2025-09-30T14:56:48.839434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:48.839447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:48.839449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:48.839452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:48.839454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:48.839467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:48.839470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:48.839513Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2348
2025-09-30T14:56:48.839516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2348
2025-09-30T14:56:48.839504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896340964892185:10741]
2025-09-30T14:56:48.839520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:48.839538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:48.839561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:48.839566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:48.839599Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8be0b0d-67a502d8-1e50bac0-4b8b9089_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:48.839605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:48.839610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:48.839613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:48.839621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:48.839630Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:48.839645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:48.839798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:48.839811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:48.839833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:48.839927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2349 partition: 0 MaxSeqNo: 42 sessionId: src_id|d8be0b0d-67a502d8-1e50bac0-4b8b9089_0
2025-09-30T14:56:48.840318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cee361d-1c8d5ad3-b4b20eec-3c950f80_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d8be0b0d-67a502d8-1e50bac0-4b8b9089_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:48.843181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8be0b0d-67a502d8-1e50bac0-4b8b9089_0] Write session: try to update token
2025-09-30T14:56:48.843200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8be0b0d-67a502d8-1e50bac0-4b8b9089_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:48.851789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:48.851806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:48.851816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896340964892185:10741]
2025-09-30T14:56:48.851864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:48.851871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:48.852043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:48.852195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:48.852346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:48.852498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:48.852729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:48.852770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:48.859299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2349 sessionId: src_id|d8be0b0d-67a502d8-1e50bac0-4b8b9089_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:48.861954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:48.862777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:48.862803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:48.862823Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:48.862826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:48.862829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:48.862831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:48.862839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896340964892185:10741]
2025-09-30T14:56:48.862843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896340964892185:10741]
2025-09-30T14:56:48.862846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896340964892185:10741]
2025-09-30T14:56:48.862904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:48.862918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:48.862921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:48.863048Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:48.867295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:48.867313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:48.867318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:48.898261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896341054667462:4281]
2025-09-30T14:56:48.898662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2348, pipe: [1:7555896341054667462:4281]
2025-09-30T14:56:48.992393Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:48.992795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:48.992833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896341054667462:4281], now have 1 active actors on pipe
2025-09-30T14:56:48.992952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:48.993061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:48.993063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:48.993069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:48.993119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896341054667462:4281]
2025-09-30T14:56:48.993141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2349 reason: error at write: Disconnected sessionId: src_id|d8be0b0d-67a502d8-1e50bac0-4b8b9089_0
2025-09-30T14:56:48.993364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2349 sessionId: src_id|d8be0b0d-67a502d8-1e50bac0-4b8b9089_0 is DEAD
2025-09-30T14:56:48.993433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8be0b0d-67a502d8-1e50bac0-4b8b9089_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:48.993441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8be0b0d-67a502d8-1e50bac0-4b8b9089_0] Write session will restart in 0.007599s
2025-09-30T14:56:48.993463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8be0b0d-67a502d8-1e50bac0-4b8b9089_0] Write session: Do CDS request
2025-09-30T14:56:48.993469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8be0b0d-67a502d8-1e50bac0-4b8b9089_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:49.001818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8be0b0d-67a502d8-1e50bac0-4b8b9089_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:49.001916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:49.001930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2350
2025-09-30T14:56:49.002061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2350 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:49.002092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2350 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:49.002098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2350 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:49.002102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:49.002578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2350 sessionId:  describe result for acl check
2025-09-30T14:56:49.002615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:49.002617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:49.002618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:49.002624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896345349634817:4801] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:49.003192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896345349634817:4801] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:49.005097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896345349634817:4801] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:49.007540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896345349634817:4801] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:49.007556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896345349634817:4801] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:49.007559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896345349634817:4801] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:49.007567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2350 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:49.010085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:49.011344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:49.011616Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:49.011627Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:49.011639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:49.011693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:49.011732Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896345259859688:10745]
2025-09-30T14:56:49.012287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:49.012671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:49.012711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:49.013000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:49.013059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:49.013065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:49.013066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:49.013067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:49.013068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:49.013069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:49.013070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:49.013071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:49.013072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:49.013073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:49.013075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.013076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.013077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.013078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:49.013079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:49.013084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:49.013093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:49.013097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:49.013100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:49.013103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:49.013107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:49.013111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:49.013114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:49.013117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:49.013121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:49.013124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.013127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.013131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.013134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:49.013137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:49.013143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:49.013150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:49.013156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:49.013160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:49.013164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:49.013168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:49.013172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:49.013177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:49.013180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:49.013185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:49.013189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:49.013193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:49.013197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:49.013202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:49.013206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:49.013211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:49.013215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:49.013219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:49.013223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:49.013227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:49.013246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.013250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.013254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.013258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.013262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.013266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.013270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:49.013274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:49.013277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:49.013282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:49.013319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:49.018667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:49.019771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:49.019787Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:49.019789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:49.019793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:49.019798Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2349 [2:7555896345259859688:10745]
2025-09-30T14:56:49.019814Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:49.019830Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:49.019833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:49.019836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:49.019837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:49.019854Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:49.019861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:49.019872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:49.019927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.019934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.019936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.019940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:49.019942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:49.020011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:49.020018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.020028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.020042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.020057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:49.020077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896345259859683:10745]
2025-09-30T14:56:49.020083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896345259859683:10745]
2025-09-30T14:56:49.020085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896345259859683:10745]
2025-09-30T14:56:49.020094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:49.020104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:49.020107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896345349635026:4801], now have 1 active actors on pipe
2025-09-30T14:56:49.020111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896341054667467:2454], now have 1 active actors on pipe
2025-09-30T14:56:49.020114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:49.020116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:49.020119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:49.020131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:49.020134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:49.020165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896345259859683:10745]
2025-09-30T14:56:49.020182Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:49.020202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:49.020185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2349
2025-09-30T14:56:49.020190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2349
2025-09-30T14:56:49.020334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:49.020344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:49.020373Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da0ab641-df6499da-2b74c73a-11d9d16_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:49.020386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:49.020389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:49.020391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:49.020400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:49.020409Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:49.020422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:49.020617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:49.020631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:49.020653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:49.020777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2350 partition: 0 MaxSeqNo: 42 sessionId: src_id|da0ab641-df6499da-2b74c73a-11d9d16_0
2025-09-30T14:56:49.021179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8be0b0d-67a502d8-1e50bac0-4b8b9089_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|da0ab641-df6499da-2b74c73a-11d9d16_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:49.024080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da0ab641-df6499da-2b74c73a-11d9d16_0] Write session: try to update token
2025-09-30T14:56:49.024101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da0ab641-df6499da-2b74c73a-11d9d16_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:49.032607Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:49.032624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:49.032627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:49.032630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:49.032640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896345259859683:10745]
2025-09-30T14:56:49.032645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896345259859683:10745]
2025-09-30T14:56:49.032649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896345259859683:10745]
2025-09-30T14:56:49.032682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:49.032687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.032689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:49.032703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:49.032721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:49.032728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:49.032837Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:49.039253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2350 sessionId: src_id|da0ab641-df6499da-2b74c73a-11d9d16_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:49.042122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:49.093312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896345349635088:4281]
2025-09-30T14:56:49.093584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2349, pipe: [1:7555896345349635088:4281]
2025-09-30T14:56:49.146431Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:49.146886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:49.146900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:49.146921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896345349635088:4281], now have 1 active actors on pipe
2025-09-30T14:56:49.147189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:49.147212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896345349635088:4281]
2025-09-30T14:56:49.147259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:49.147262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:49.147335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2350 reason: error at write: Disconnected sessionId: src_id|da0ab641-df6499da-2b74c73a-11d9d16_0
2025-09-30T14:56:49.147541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2350 sessionId: src_id|da0ab641-df6499da-2b74c73a-11d9d16_0 is DEAD
2025-09-30T14:56:49.147676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0ab641-df6499da-2b74c73a-11d9d16_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:49.147687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0ab641-df6499da-2b74c73a-11d9d16_0] Write session will restart in 0.009668s
2025-09-30T14:56:49.147721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0ab641-df6499da-2b74c73a-11d9d16_0] Write session: Do CDS request
2025-09-30T14:56:49.147726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0ab641-df6499da-2b74c73a-11d9d16_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:49.147712Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:49.158733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da0ab641-df6499da-2b74c73a-11d9d16_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:49.159091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:49.159107Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2351
2025-09-30T14:56:49.159221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2351 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:49.159273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2351 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:49.159282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2351 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:49.159293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:49.159845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2351 sessionId:  describe result for acl check
2025-09-30T14:56:49.159879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:49.159881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:49.159883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:49.159889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896345349635138:4809] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:49.160427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896345349635138:4809] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:49.162696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896345349635138:4809] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:49.166238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896345349635138:4809] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:49.166255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896345349635138:4809] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:49.166258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896345349635138:4809] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:49.166266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2351 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:49.170263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:49.171762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:49.171951Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:49.171962Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:49.171973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:49.172027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:49.172071Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896345259859890:10747]
2025-09-30T14:56:49.172685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:49.173011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:49.173063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:49.173545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:49.173628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:49.173635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:49.173637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:49.173638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:49.173639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:49.173641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:49.173642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:49.173644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:49.173645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:49.173646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:49.173647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.173648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.173649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.173650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:49.173652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:49.173658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:49.173667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:49.173670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:49.173674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:49.173678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:49.173682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:49.173686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:49.173690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:49.173693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:49.173697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:49.173701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.173705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.173708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.173711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:49.173715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:49.173723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:49.173731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:49.173736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:49.173742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:49.173746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:49.173750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:49.173755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:49.173759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:49.173764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:49.173769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:49.173773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:49.173778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:49.173783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:49.173787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:49.173792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:49.173797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:49.173801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:49.173806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:49.173810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:49.173815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:49.173820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.173825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.173830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.173835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.173840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.173845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.173849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:49.173854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:49.173859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:49.173865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:49.173905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:49.179637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:49.180882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:49.180897Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:49.180900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:49.180904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:49.180911Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2350 [2:7555896345259859890:10747]
2025-09-30T14:56:49.180926Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:49.180941Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:49.180944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:49.180947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:49.180949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:49.180965Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:49.180972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:49.180979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:49.181040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.181042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.181044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.181047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:49.181050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:49.181122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:49.181125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.181138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.181148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.181163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:49.181181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896345349635339:4809], now have 1 active actors on pipe
2025-09-30T14:56:49.181184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896345349635091:2454], now have 1 active actors on pipe
2025-09-30T14:56:49.181190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896345259859885:10747]
2025-09-30T14:56:49.181192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896345259859885:10747]
2025-09-30T14:56:49.181194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896345259859885:10747]
2025-09-30T14:56:49.181210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:49.181223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:49.181242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:49.181245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:49.181247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:49.181252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:49.181255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:49.181289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896345259859885:10747]
2025-09-30T14:56:49.181296Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:49.181301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:49.182279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2350
2025-09-30T14:56:49.182317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2350
2025-09-30T14:56:49.182684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:49.182700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:49.182736Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f0d7c60-a7068686-1a39c720-d203f3e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:49.182753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:49.182759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:49.182766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:49.182777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:49.182795Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:49.182816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:49.183029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:49.183037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:49.183051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:49.183191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2351 partition: 0 MaxSeqNo: 42 sessionId: src_id|1f0d7c60-a7068686-1a39c720-d203f3e0_0
2025-09-30T14:56:49.183630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0ab641-df6499da-2b74c73a-11d9d16_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1f0d7c60-a7068686-1a39c720-d203f3e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:49.186474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f0d7c60-a7068686-1a39c720-d203f3e0_0] Write session: try to update token
2025-09-30T14:56:49.186496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f0d7c60-a7068686-1a39c720-d203f3e0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:49.205195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2351 sessionId: src_id|1f0d7c60-a7068686-1a39c720-d203f3e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:49.205736Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:49.205760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:49.205763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:49.205765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:49.205775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896345259859885:10747]
2025-09-30T14:56:49.205779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896345259859885:10747]
2025-09-30T14:56:49.205783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896345259859885:10747]
2025-09-30T14:56:49.205830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:49.205830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:49.205836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:49.205844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.205847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:49.205962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:49.206058Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:49.207972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:49.247435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896345349635435:4281]
2025-09-30T14:56:49.247721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2350, pipe: [1:7555896345349635435:4281]
2025-09-30T14:56:49.319831Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:49.320233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:49.320252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:49.320293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896345349635435:4281], now have 1 active actors on pipe
2025-09-30T14:56:49.320505Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:49.320543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896345349635435:4281]
2025-09-30T14:56:49.320570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:49.320575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:49.320649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2351 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1f0d7c60-a7068686-1a39c720-d203f3e0_0
2025-09-30T14:56:49.320845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2351 sessionId: src_id|1f0d7c60-a7068686-1a39c720-d203f3e0_0 is DEAD
2025-09-30T14:56:49.321032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f0d7c60-a7068686-1a39c720-d203f3e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:49.321043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f0d7c60-a7068686-1a39c720-d203f3e0_0] Write session will restart in 0.008626s
2025-09-30T14:56:49.321068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f0d7c60-a7068686-1a39c720-d203f3e0_0] Write session: Do CDS request
2025-09-30T14:56:49.321086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f0d7c60-a7068686-1a39c720-d203f3e0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:49.330793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f0d7c60-a7068686-1a39c720-d203f3e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:49.330884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:49.330910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2352
2025-09-30T14:56:49.331064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2352 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:49.331094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2352 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:49.331106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2352 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:49.331110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:49.331589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2352 sessionId:  describe result for acl check
2025-09-30T14:56:49.331628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:49.331635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:49.331637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:49.331644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896345349635618:4823] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:49.332202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896345349635618:4823] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:49.334656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896345349635618:4823] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:49.335720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:49.336939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:49.337263Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:49.337276Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:49.337289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:49.337354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:49.337353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896345349635618:4823] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:49.337368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896345349635618:4823] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:49.337372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896345349635618:4823] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:49.337398Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896345259860102:10761]
2025-09-30T14:56:49.337380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2352 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:49.338065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:49.338351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:49.338402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:49.338736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:49.338796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:49.338801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:49.338802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:49.338803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:49.338804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:49.338805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:49.338806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:49.338807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:49.338808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:49.338808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:49.338809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.338810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.338810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.338811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:49.338812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:49.338816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:49.338822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:49.338824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:49.338827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:49.338829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:49.338832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:49.338834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:49.338837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:49.338840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:49.338842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:49.338845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.338847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.338860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.338862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:49.338865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:49.338870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:49.338876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:49.338880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:49.338883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:49.338886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:49.338891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:49.338893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:49.338896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:49.338899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:49.338902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:49.338904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:49.338907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:49.338910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:49.338913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:49.338916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:49.338919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:49.338922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:49.338925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:49.338927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:49.338930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:49.338932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.338935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.338937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.338940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.338943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.338946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.338948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:49.338951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:49.338954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:49.338957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:49.338981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:49.344622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:49.345689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:49.345705Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:49.345709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:49.345713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:49.345721Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2351 [2:7555896345259860102:10761]
2025-09-30T14:56:49.345740Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:49.345765Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:49.345773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:49.345777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:49.345779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:49.345795Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:49.345808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:49.345815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:49.345887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.345894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.345896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.345900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:49.345903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:49.345974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:49.345983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.345995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.346005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.346025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:49.346048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896345349635748:4823], now have 1 active actors on pipe
2025-09-30T14:56:49.346057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896345349635440:2454], now have 1 active actors on pipe
2025-09-30T14:56:49.346064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896345259860097:10761]
2025-09-30T14:56:49.346066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896345259860097:10761]
2025-09-30T14:56:49.346068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896345259860097:10761]
2025-09-30T14:56:49.346080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:49.346094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:49.346096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:49.346101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:49.346103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:49.346108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:49.346114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:49.346124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2351
2025-09-30T14:56:49.346150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896345259860097:10761]
2025-09-30T14:56:49.346159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:49.346138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2351
2025-09-30T14:56:49.346170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:49.346194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:49.346199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:49.346227Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2bae8e37-ddf52b4f-8f724d57-1f78e4f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:49.346239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:49.346243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:49.346250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:49.346259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:49.346269Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:49.346287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:49.346482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:49.346497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:49.346534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:49.346625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2352 partition: 0 MaxSeqNo: 42 sessionId: src_id|2bae8e37-ddf52b4f-8f724d57-1f78e4f1_0
2025-09-30T14:56:49.347004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f0d7c60-a7068686-1a39c720-d203f3e0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2bae8e37-ddf52b4f-8f724d57-1f78e4f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:49.349836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bae8e37-ddf52b4f-8f724d57-1f78e4f1_0] Write session: try to update token
2025-09-30T14:56:49.349859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bae8e37-ddf52b4f-8f724d57-1f78e4f1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:49.358762Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:49.358783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:49.358785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:49.358787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:49.358800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896345259860097:10761]
2025-09-30T14:56:49.358806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896345259860097:10761]
2025-09-30T14:56:49.358811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896345259860097:10761]
2025-09-30T14:56:49.358858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:49.358874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.358874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:49.358881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:49.358885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:49.358892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:49.359075Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:49.365037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2352 sessionId: src_id|2bae8e37-ddf52b4f-8f724d57-1f78e4f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:49.367899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:49.421055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896345349635759:4281]
2025-09-30T14:56:49.421437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2351, pipe: [1:7555896345349635759:4281]
2025-09-30T14:56:49.472118Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:49.472583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:49.472596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:49.472618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896345349635759:4281], now have 1 active actors on pipe
2025-09-30T14:56:49.472841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:49.472853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:49.472860Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:49.472875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:49.472910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2352 reason: error at write: Disconnected sessionId: src_id|2bae8e37-ddf52b4f-8f724d57-1f78e4f1_0
2025-09-30T14:56:49.472922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896345349635759:4281]
2025-09-30T14:56:49.473082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2352 sessionId: src_id|2bae8e37-ddf52b4f-8f724d57-1f78e4f1_0 is DEAD
2025-09-30T14:56:49.473250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bae8e37-ddf52b4f-8f724d57-1f78e4f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:49.473260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bae8e37-ddf52b4f-8f724d57-1f78e4f1_0] Write session will restart in 0.008226s
2025-09-30T14:56:49.473284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bae8e37-ddf52b4f-8f724d57-1f78e4f1_0] Write session: Do CDS request
2025-09-30T14:56:49.473289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bae8e37-ddf52b4f-8f724d57-1f78e4f1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:49.482857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bae8e37-ddf52b4f-8f724d57-1f78e4f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:49.482930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:49.482947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2353
2025-09-30T14:56:49.483162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2353 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:49.483210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2353 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:49.483227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2353 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:49.483237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:49.483709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2353 sessionId:  describe result for acl check
2025-09-30T14:56:49.483747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:49.483751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:49.483754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:49.483760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896345349635935:4831] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:49.484351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896345349635935:4831] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:49.486429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896345349635935:4831] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:49.491511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:49.492625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:49.492813Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:49.492822Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:49.492833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:49.492896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:49.492948Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896345259860295:10763]
2025-09-30T14:56:49.493389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896345349635935:4831] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:49.493403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896345349635935:4831] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:49.493407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896345349635935:4831] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:49.493426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2353 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:49.493656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:49.493955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:49.493998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:49.494325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:49.494383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:49.494389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:49.494390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:49.494391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:49.494393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:49.494394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:49.494395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:49.494397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:49.494398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:49.494399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:49.494401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.494402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.494403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.494405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:49.494406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:49.494411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:49.494422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:49.494425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:49.494429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:49.494432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:49.494435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:49.494439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:49.494442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:49.494446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:49.494450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:49.494455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.494459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.494463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.494467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:49.494471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:49.494478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:49.494486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:49.494492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:49.494498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:49.494509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:49.494519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:49.494528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:49.494534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:49.494543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:49.494553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:49.494562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:49.494572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:49.494581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:49.494586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:49.494596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:49.494602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:49.494607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:49.494612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:49.494621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:49.494626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:49.494634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.494640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.494648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.494653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.494658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.494668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.494676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:49.494681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:49.494690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:49.494696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:49.494745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:49.500358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:49.501580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:49.501593Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:49.501599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:49.501602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:49.501610Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2352 [2:7555896345259860295:10763]
2025-09-30T14:56:49.501626Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:49.501642Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:49.501646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:49.501649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:49.501651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:49.501668Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:49.501674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:49.501682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:49.501742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.501751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.501753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.501756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:49.501759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:49.501825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:49.501834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.501846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.501862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.501880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:49.501903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896345349636069:4831], now have 1 active actors on pipe
2025-09-30T14:56:49.501916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896345259860290:10763]
2025-09-30T14:56:49.501923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896345259860290:10763]
2025-09-30T14:56:49.501924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896345259860290:10763]
2025-09-30T14:56:49.501938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:49.501951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896345349635761:2454], now have 1 active actors on pipe
2025-09-30T14:56:49.501950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:49.501960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:49.501964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:49.501966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:49.501974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:49.501977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:49.502010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896345259860290:10763]
2025-09-30T14:56:49.502017Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:49.502021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:49.501997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2352
2025-09-30T14:56:49.502045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:49.501998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2352
2025-09-30T14:56:49.502054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:49.502092Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd60d4f4-7c96742d-88d55fd3-cc0480b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:49.502104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:49.502112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:49.502115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:49.502126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:49.502140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:49.502167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:49.502349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:49.502359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:49.502376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:49.502496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2353 partition: 0 MaxSeqNo: 42 sessionId: src_id|cd60d4f4-7c96742d-88d55fd3-cc0480b3_0
2025-09-30T14:56:49.502941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bae8e37-ddf52b4f-8f724d57-1f78e4f1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cd60d4f4-7c96742d-88d55fd3-cc0480b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:49.505934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd60d4f4-7c96742d-88d55fd3-cc0480b3_0] Write session: try to update token
2025-09-30T14:56:49.505964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd60d4f4-7c96742d-88d55fd3-cc0480b3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:49.514762Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:49.514783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:49.514786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:49.514788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:49.514798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896345259860290:10763]
2025-09-30T14:56:49.514802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896345259860290:10763]
2025-09-30T14:56:49.514807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896345259860290:10763]
2025-09-30T14:56:49.514847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:49.514851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:49.514853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:49.514856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:49.514858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.514861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:49.515013Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:49.522761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2353 sessionId: src_id|cd60d4f4-7c96742d-88d55fd3-cc0480b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:49.525723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:49.573082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896345349636080:4281]
2025-09-30T14:56:49.573479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2352, pipe: [1:7555896345349636080:4281]
2025-09-30T14:56:49.632304Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:49.632642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:49.632658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:49.632677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896345349636080:4281], now have 1 active actors on pipe
2025-09-30T14:56:49.632949Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:49.632959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896345349636080:4281]
2025-09-30T14:56:49.632973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:49.632978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:49.633007Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:49.633054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2353 reason: error at write: Disconnected sessionId: src_id|cd60d4f4-7c96742d-88d55fd3-cc0480b3_0
2025-09-30T14:56:49.633258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2353 sessionId: src_id|cd60d4f4-7c96742d-88d55fd3-cc0480b3_0 is DEAD
2025-09-30T14:56:49.633438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd60d4f4-7c96742d-88d55fd3-cc0480b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:49.633450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd60d4f4-7c96742d-88d55fd3-cc0480b3_0] Write session will restart in 0.008074s
2025-09-30T14:56:49.633485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd60d4f4-7c96742d-88d55fd3-cc0480b3_0] Write session: Do CDS request
2025-09-30T14:56:49.633495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd60d4f4-7c96742d-88d55fd3-cc0480b3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:49.642809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd60d4f4-7c96742d-88d55fd3-cc0480b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:49.642893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:49.642909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2354
2025-09-30T14:56:49.643087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2354 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:49.643133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2354 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:49.643142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2354 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:49.643146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:49.643657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2354 sessionId:  describe result for acl check
2025-09-30T14:56:49.643703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:49.643711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:49.643713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:49.643721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896345349636135:4838] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:49.644385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896345349636135:4838] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:49.648213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896345349636135:4838] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:49.651369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896345349636135:4838] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:49.651388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896345349636135:4838] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:49.651392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896345349636135:4838] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:49.651402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2354 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:49.659622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:49.661464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:49.661693Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:49.661707Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:49.661719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:49.661773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:49.661817Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896345259860488:10766]
2025-09-30T14:56:49.662495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:49.662865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:49.662929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:49.663712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:49.663863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:49.663871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:49.663872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:49.663873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:49.663875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:49.663876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:49.663877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:49.663878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:49.663880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:49.663881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:49.663882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.663883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.663885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.663886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:49.663887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:49.663893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:49.663903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:49.663907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:49.663911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:49.663915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:49.663919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:49.663923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:49.663927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:49.663931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:49.663935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:49.663938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.663941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.663945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.663948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:49.663952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:49.663962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:49.663971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:49.663976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:49.663981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:49.663986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:49.663991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:49.663996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:49.664001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:49.664006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:49.664011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:49.664015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:49.664020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:49.664025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:49.664031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:49.664036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:49.664042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:49.664046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:49.664052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:49.664059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:49.664065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:49.664070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.664075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.664080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.664085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.664090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.664096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.664101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:49.664105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:49.664115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:49.664121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:49.664164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:49.670034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:49.671371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:49.671386Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:49.671389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:49.671393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:49.671400Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2353 [2:7555896345259860488:10766]
2025-09-30T14:56:49.671418Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:49.671435Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:49.671438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:49.671442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:49.671444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:49.671461Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:49.671469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:49.671476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:49.671549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.671560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.671562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.671566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:49.671569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:49.671645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:49.671655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.671668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.671686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.671703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:49.671729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896345349636307:4838], now have 1 active actors on pipe
2025-09-30T14:56:49.671739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896345349636082:2454], now have 1 active actors on pipe
2025-09-30T14:56:49.671747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896345259860483:10766]
2025-09-30T14:56:49.671753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896345259860483:10766]
2025-09-30T14:56:49.671756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896345259860483:10766]
2025-09-30T14:56:49.671770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:49.671789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:49.671799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:49.671804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:49.671806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:49.671812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:49.671815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:49.671854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896345259860483:10766]
2025-09-30T14:56:49.671867Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:49.671873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:49.671903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2353
2025-09-30T14:56:49.672054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2353
2025-09-30T14:56:49.672141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:49.672154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:49.672197Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7fca91e-d2b4247b-d7c9883a-5391dd17_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:49.672209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:49.672216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:49.672220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:49.672232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:49.672248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:49.672267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:49.672494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:49.672503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:49.672517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:49.672645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2354 partition: 0 MaxSeqNo: 42 sessionId: src_id|d7fca91e-d2b4247b-d7c9883a-5391dd17_0
2025-09-30T14:56:49.673036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd60d4f4-7c96742d-88d55fd3-cc0480b3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d7fca91e-d2b4247b-d7c9883a-5391dd17_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:49.676123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7fca91e-d2b4247b-d7c9883a-5391dd17_0] Write session: try to update token
2025-09-30T14:56:49.676145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7fca91e-d2b4247b-d7c9883a-5391dd17_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:49.685679Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:49.685706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:49.685710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:49.685712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:49.685726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896345259860483:10766]
2025-09-30T14:56:49.685732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896345259860483:10766]
2025-09-30T14:56:49.685738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896345259860483:10766]
2025-09-30T14:56:49.685793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:49.685795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:49.685803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.685805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:49.685806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:49.685811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:49.685986Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:49.692380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2354 sessionId: src_id|d7fca91e-d2b4247b-d7c9883a-5391dd17_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:49.695395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:49.733304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896345349636404:4281]
2025-09-30T14:56:49.733621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2353, pipe: [1:7555896345349636404:4281]
2025-09-30T14:56:49.801374Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:49.801786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:49.801805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:49.801846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896345349636404:4281], now have 1 active actors on pipe
2025-09-30T14:56:49.802123Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:49.802631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7fca91e-d2b4247b-d7c9883a-5391dd17_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:49.802645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7fca91e-d2b4247b-d7c9883a-5391dd17_0] Write session will restart in 0.008243s
2025-09-30T14:56:49.802669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7fca91e-d2b4247b-d7c9883a-5391dd17_0] Write session: Do CDS request
2025-09-30T14:56:49.802675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7fca91e-d2b4247b-d7c9883a-5391dd17_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:49.802178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:49.802193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:49.802201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:49.802256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896345349636404:4281]
2025-09-30T14:56:49.802272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2354 reason: error at write: Disconnected sessionId: src_id|d7fca91e-d2b4247b-d7c9883a-5391dd17_0
2025-09-30T14:56:49.802487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2354 sessionId: src_id|d7fca91e-d2b4247b-d7c9883a-5391dd17_0 is DEAD
2025-09-30T14:56:49.811854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7fca91e-d2b4247b-d7c9883a-5391dd17_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:49.814144Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:49.814164Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2355
2025-09-30T14:56:49.814356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2355 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:49.814396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2355 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:49.814401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2355 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:49.814405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:49.814952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2355 sessionId:  describe result for acl check
2025-09-30T14:56:49.814995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:49.815002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:49.815004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:49.815011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896345349636495:4846] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:49.815675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896345349636495:4846] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:49.817891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896345349636495:4846] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:49.822031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896345349636495:4846] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:49.822045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896345349636495:4846] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:49.822053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896345349636495:4846] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:49.822062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2355 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:49.826175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:49.827360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:49.827717Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:49.827728Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:49.827740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:49.827805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:49.827848Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896345259860681:10768]
2025-09-30T14:56:49.828524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:49.831829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:49.831937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:49.832435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:49.832537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:49.832538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:49.832540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:49.832542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:49.832543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:49.832545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:49.832547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:49.832549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:49.832551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:49.832553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:49.832555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.832557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.832558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.832560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:49.832562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:49.832570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:49.832583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:49.832588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:49.832594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:49.832598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:49.832603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:49.832607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:49.832612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:49.832617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:49.832621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:49.832626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.832631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.832635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.832640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:49.832644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:49.832658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:49.832668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:49.832676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:49.832683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:49.832689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:49.832696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:49.832703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:49.832709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:49.832716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:49.832723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:49.832729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:49.832735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:49.832741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:49.832747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:49.832753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:49.832759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:49.832768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:49.832775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:49.832780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:49.832787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:49.832793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.832799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.832805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.832812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.832821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.832827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.832833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:49.832839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:49.832844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:49.832850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:49.832902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:49.840622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:49.842081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:49.842099Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:49.842102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:49.842107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:49.842116Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2354 [2:7555896345259860681:10768]
2025-09-30T14:56:49.842139Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:49.842168Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:49.842177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:49.842181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:49.842183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:49.842207Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:49.842215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:49.842225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:49.842316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.842331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.842339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.842343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:49.842346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:49.842442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:49.842450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.842465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:49.842476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:49.842492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:49.842514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896345259860676:10768]
2025-09-30T14:56:49.842517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896345259860676:10768]
2025-09-30T14:56:49.842519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896345259860676:10768]
2025-09-30T14:56:49.842529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:49.842545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:49.842549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896345349636668:4846], now have 1 active actors on pipe
2025-09-30T14:56:49.842550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:49.842552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:49.842552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896345349636406:2454], now have 1 active actors on pipe
2025-09-30T14:56:49.842562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:49.842580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:49.842585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:49.842635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896345259860676:10768]
2025-09-30T14:56:49.842642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:49.842649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:49.842635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2354
2025-09-30T14:56:49.842653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2354
2025-09-30T14:56:49.842855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:49.842866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:49.842905Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b23b9ed8-23db9cc2-5037787f-2d55381e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:49.842919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:49.842930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:49.842933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:49.842949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:49.842967Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:49.842992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:49.843236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:49.843262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:49.843282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:49.843411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2355 partition: 0 MaxSeqNo: 42 sessionId: src_id|b23b9ed8-23db9cc2-5037787f-2d55381e_0
2025-09-30T14:56:49.843836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7fca91e-d2b4247b-d7c9883a-5391dd17_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b23b9ed8-23db9cc2-5037787f-2d55381e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:49.846940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b23b9ed8-23db9cc2-5037787f-2d55381e_0] Write session: try to update token
2025-09-30T14:56:49.846962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b23b9ed8-23db9cc2-5037787f-2d55381e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:49.857171Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:49.857193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:49.857204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:49.857206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:49.857216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896345259860676:10768]
2025-09-30T14:56:49.857222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896345259860676:10768]
2025-09-30T14:56:49.857240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896345259860676:10768]
2025-09-30T14:56:49.857296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:49.857305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:49.857309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:49.857308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:49.857317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:49.857323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:49.857497Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:49.864482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2355 sessionId: src_id|b23b9ed8-23db9cc2-5037787f-2d55381e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:49.867515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:49.902244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896345349636728:4281]
2025-09-30T14:56:49.902565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2354, pipe: [1:7555896345349636728:4281]
2025-09-30T14:56:49.978998Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:49.979000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:49.979005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:49.979068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896345349636728:4281]
2025-09-30T14:56:49.979087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2355 reason: error at write: Disconnected sessionId: src_id|b23b9ed8-23db9cc2-5037787f-2d55381e_0
2025-09-30T14:56:49.978128Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:49.979289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2355 sessionId: src_id|b23b9ed8-23db9cc2-5037787f-2d55381e_0 is DEAD
2025-09-30T14:56:49.978614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:49.978624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:49.978667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896345349636728:4281], now have 1 active actors on pipe
2025-09-30T14:56:49.978980Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:49.979462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b23b9ed8-23db9cc2-5037787f-2d55381e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:49.979475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b23b9ed8-23db9cc2-5037787f-2d55381e_0] Write session will restart in 0.008698s
2025-09-30T14:56:49.979499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b23b9ed8-23db9cc2-5037787f-2d55381e_0] Write session: Do CDS request
2025-09-30T14:56:49.979505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b23b9ed8-23db9cc2-5037787f-2d55381e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:49.989833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b23b9ed8-23db9cc2-5037787f-2d55381e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:49.989895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:49.989911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2356
2025-09-30T14:56:49.990093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2356 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:49.990126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2356 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:49.990142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2356 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:49.990147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:49.990815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2356 sessionId:  describe result for acl check
2025-09-30T14:56:49.990855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:49.990866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:49.990868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:49.990874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896345349636839:4852] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:49.991519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896345349636839:4852] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:49.994403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896345349636839:4852] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:49.998245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896345349636839:4852] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:49.998260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896345349636839:4852] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:49.998266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896345349636839:4852] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:49.998276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2356 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:50.008326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:50.010490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:50.010785Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:50.010802Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:50.010816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:50.010894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:50.010942Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896349554828185:10772]
2025-09-30T14:56:50.011666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:50.012058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:50.012106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:50.012458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:50.012531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:50.012533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:50.012534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:50.012535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:50.012537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:50.012538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:50.012540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:50.012541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:50.012543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:50.012544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:50.012545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.012547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.012548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.012549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:50.012551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:50.012558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:50.012568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:50.012573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:50.012576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:50.012581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:50.012585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:50.012602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:50.012607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:50.012610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:50.012615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:50.012619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.012623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.012627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.012631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:50.012634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:50.012645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:50.012653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:50.012659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:50.012665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:50.012671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:50.012676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:50.012680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:50.012686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:50.012701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:50.012707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:50.012713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:50.012718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:50.012724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:50.012729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:50.012734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:50.012739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:50.012745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:50.012751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:50.012756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:50.012761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:50.012769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.012774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.012779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.012784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.012789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.012794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.012798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:50.012803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:50.012811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:50.012817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:50.012860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:50.023342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:50.024646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:50.024668Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:50.024670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:50.024675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:50.024683Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2355 [2:7555896349554828185:10772]
2025-09-30T14:56:50.024702Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:50.024721Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:50.024725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:50.024728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:50.024731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:50.024749Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:50.024756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:50.024763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:50.024833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.024836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.024838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.024842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:50.024845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:50.024920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:50.024923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.024936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.024948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.024965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:50.024983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896349554828180:10772]
2025-09-30T14:56:50.024986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896349554828180:10772]
2025-09-30T14:56:50.024988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896349554828180:10772]
2025-09-30T14:56:50.025008Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:50.025022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:50.025037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:50.025039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:50.025077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896349554828180:10772]
2025-09-30T14:56:50.025080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:50.025186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:50.025190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:50.025193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:50.025200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:50.025306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2355
2025-09-30T14:56:50.025351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2355
2025-09-30T14:56:50.025481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896345349637019:4852], now have 1 active actors on pipe
2025-09-30T14:56:50.025492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896345349636733:2454], now have 1 active actors on pipe
2025-09-30T14:56:50.025507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:50.025513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:50.025547Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fcbfff84-9476ab96-a678949c-4ce953ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:50.025558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:50.025572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:50.025575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:50.025587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:50.025600Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:50.025621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:50.025873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:50.025886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:50.025909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:50.026118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2356 partition: 0 MaxSeqNo: 42 sessionId: src_id|fcbfff84-9476ab96-a678949c-4ce953ab_0
2025-09-30T14:56:50.026543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b23b9ed8-23db9cc2-5037787f-2d55381e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fcbfff84-9476ab96-a678949c-4ce953ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:50.029574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcbfff84-9476ab96-a678949c-4ce953ab_0] Write session: try to update token
2025-09-30T14:56:50.029597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcbfff84-9476ab96-a678949c-4ce953ab_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:50.038964Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:50.038983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:50.038986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:50.038988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:50.038997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896349554828180:10772]
2025-09-30T14:56:50.039002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896349554828180:10772]
2025-09-30T14:56:50.039006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896349554828180:10772]
2025-09-30T14:56:50.039048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:50.039055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.039058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:50.039201Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:50.043413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:50.043432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:50.043437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:50.059677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2356 sessionId: src_id|fcbfff84-9476ab96-a678949c-4ce953ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:50.062593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:50.078900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896349644604348:4281]
2025-09-30T14:56:50.079274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2355, pipe: [1:7555896349644604348:4281]
2025-09-30T14:56:50.160866Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:50.161402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:50.161417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:50.161436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896349644604348:4281], now have 1 active actors on pipe
2025-09-30T14:56:50.161663Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:50.161678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:50.161824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:50.161843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:50.161931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2356 reason: error at write: Disconnected sessionId: src_id|fcbfff84-9476ab96-a678949c-4ce953ab_0
2025-09-30T14:56:50.162057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896349644604348:4281]
2025-09-30T14:56:50.162137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2356 sessionId: src_id|fcbfff84-9476ab96-a678949c-4ce953ab_0 is DEAD
2025-09-30T14:56:50.162284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcbfff84-9476ab96-a678949c-4ce953ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:50.162295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcbfff84-9476ab96-a678949c-4ce953ab_0] Write session will restart in 0.005715s
2025-09-30T14:56:50.162319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcbfff84-9476ab96-a678949c-4ce953ab_0] Write session: Do CDS request
2025-09-30T14:56:50.162326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcbfff84-9476ab96-a678949c-4ce953ab_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:50.168817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcbfff84-9476ab96-a678949c-4ce953ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:50.168896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:50.168911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2357
2025-09-30T14:56:50.169070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2357 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:50.169104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2357 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:50.169115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2357 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:50.169120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:50.169625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2357 sessionId:  describe result for acl check
2025-09-30T14:56:50.169665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:50.169671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:50.169673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:50.169680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896349644604399:4860] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:50.170261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896349644604399:4860] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:50.172625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896349644604399:4860] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:50.175742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896349644604399:4860] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:50.175759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896349644604399:4860] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:50.175762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896349644604399:4860] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:50.175770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2357 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:50.178077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:50.179410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:50.179585Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:50.179604Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:50.179615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:50.179668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:50.179709Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896349554828380:10774]
2025-09-30T14:56:50.180354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:50.180680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:50.180732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:50.181066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:50.181122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:50.181129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:50.181131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:50.181132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:50.181133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:50.181134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:50.181135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:50.181136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:50.181138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:50.181139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:50.181140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.181141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.181143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.181144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:50.181145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:50.181150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:50.181161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:50.181165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:50.181170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:50.181174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:50.181178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:50.181182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:50.181186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:50.181190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:50.181195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:50.181199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.181203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.181207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.181212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:50.181215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:50.181234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:50.181243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:50.181250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:50.181256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:50.181261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:50.181267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:50.181272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:50.181277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:50.181281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:50.181286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:50.181291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:50.181297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:50.181302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:50.181315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:50.181320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:50.181326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:50.181330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:50.181336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:50.181345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:50.181351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:50.181356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.181367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.181371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.181380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.181385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.181391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.181395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:50.181405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:50.181409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:50.181415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:50.181460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:50.188375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:50.189516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:50.189529Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:50.189532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:50.189536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:50.189543Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2356 [2:7555896349554828380:10774]
2025-09-30T14:56:50.189557Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:50.189572Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:50.189574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:50.189576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:50.189578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:50.189592Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:50.189598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:50.189604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:50.189674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.189681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.189683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.189686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:50.189689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:50.189764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:50.189776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.189789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.189801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.189817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:50.189835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896349644604363:2454], now have 1 active actors on pipe
2025-09-30T14:56:50.189844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896349644604671:4860], now have 1 active actors on pipe
2025-09-30T14:56:50.189850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896349554828375:10774]
2025-09-30T14:56:50.189853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896349554828375:10774]
2025-09-30T14:56:50.189855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896349554828375:10774]
2025-09-30T14:56:50.189868Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:50.189883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:50.189883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:50.189891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:50.189894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:50.189897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:50.189901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:50.189940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896349554828375:10774]
2025-09-30T14:56:50.189953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:50.189962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:50.189966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2356
2025-09-30T14:56:50.190013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:50.189977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2356
2025-09-30T14:56:50.190022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:50.190053Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b221f01b-cd4999d6-3e60cd5-cad545c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:50.190063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:50.190068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:50.190070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:50.190083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:50.190092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:50.190109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:50.190255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:50.190265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:50.190280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:50.190416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2357 partition: 0 MaxSeqNo: 42 sessionId: src_id|b221f01b-cd4999d6-3e60cd5-cad545c0_0
2025-09-30T14:56:50.190855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcbfff84-9476ab96-a678949c-4ce953ab_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b221f01b-cd4999d6-3e60cd5-cad545c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:50.193932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b221f01b-cd4999d6-3e60cd5-cad545c0_0] Write session: try to update token
2025-09-30T14:56:50.193956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b221f01b-cd4999d6-3e60cd5-cad545c0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:50.209541Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:50.209562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:50.209576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896349554828375:10774]
2025-09-30T14:56:50.209628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:50.209634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:50.209810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:50.209975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:50.210141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:50.210302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:50.210538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:50.210589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:50.214124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2357 sessionId: src_id|b221f01b-cd4999d6-3e60cd5-cad545c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:50.217386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:50.217731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:50.217757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:50.217779Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:50.217781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:50.217784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:50.217786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:50.217795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896349554828375:10774]
2025-09-30T14:56:50.217800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896349554828375:10774]
2025-09-30T14:56:50.217804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896349554828375:10774]
2025-09-30T14:56:50.217858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:50.217871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.217873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:50.217892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:50.217906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:50.217923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:50.218016Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:50.262189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896349644604708:4281]
2025-09-30T14:56:50.262937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2356, pipe: [1:7555896349644604708:4281]
2025-09-30T14:56:50.338039Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:50.338495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:50.338542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896349644604708:4281], now have 1 active actors on pipe
2025-09-30T14:56:50.338682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:50.338735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:50.338780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:50.338783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896349644604708:4281]
2025-09-30T14:56:50.338788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:50.338875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2357 reason: error at write: Disconnected sessionId: src_id|b221f01b-cd4999d6-3e60cd5-cad545c0_0
2025-09-30T14:56:50.339035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2357 sessionId: src_id|b221f01b-cd4999d6-3e60cd5-cad545c0_0 is DEAD
2025-09-30T14:56:50.339420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b221f01b-cd4999d6-3e60cd5-cad545c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:50.339432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b221f01b-cd4999d6-3e60cd5-cad545c0_0] Write session will restart in 0.008303s
2025-09-30T14:56:50.339455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b221f01b-cd4999d6-3e60cd5-cad545c0_0] Write session: Do CDS request
2025-09-30T14:56:50.339461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b221f01b-cd4999d6-3e60cd5-cad545c0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:50.348762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b221f01b-cd4999d6-3e60cd5-cad545c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:50.348797Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:50.348809Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2358
2025-09-30T14:56:50.349055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2358 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:50.349092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2358 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:50.349097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2358 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:50.349102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:50.349537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2358 sessionId:  describe result for acl check
2025-09-30T14:56:50.349574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:50.349581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:50.349583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:50.349590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896349644604834:4885] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:50.350129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896349644604834:4885] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:50.352935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896349644604834:4885] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:50.356448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896349644604834:4885] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:50.356466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896349644604834:4885] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:50.356469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896349644604834:4885] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:50.356477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2358 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:50.359879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:50.361455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:50.361668Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:50.361678Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:50.361689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:50.361745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:50.361787Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896349554828612:10788]
2025-09-30T14:56:50.362463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:50.362794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:50.362841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:50.363175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:50.363264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:50.363271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:50.363272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:50.363273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:50.363274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:50.363276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:50.363277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:50.363279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:50.363280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:50.363281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:50.363282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.363284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.363285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.363286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:50.363287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:50.363294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:50.363304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:50.363308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:50.363313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:50.363317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:50.363321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:50.363325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:50.363329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:50.363333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:50.363338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:50.363341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.363345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.363349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.363353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:50.363356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:50.363366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:50.363374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:50.363380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:50.363386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:50.363391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:50.363397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:50.363401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:50.363406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:50.363412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:50.363417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:50.363421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:50.363427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:50.363432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:50.363437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:50.363442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:50.363447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:50.363453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:50.363458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:50.363463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:50.363467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:50.363472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.363477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.363482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.363486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.363491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.363496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.363501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:50.363507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:50.363512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:50.363527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:50.363578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:50.369015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:50.370243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:50.370261Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:50.370264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:50.370268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:50.370276Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2357 [2:7555896349554828612:10788]
2025-09-30T14:56:50.370294Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:50.370309Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:50.370313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:50.370316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:50.370319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:50.370335Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:50.370342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:50.370349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:50.370420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.370428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.370431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.370435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:50.370439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:50.370695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:50.370704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.370683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2357
2025-09-30T14:56:50.370701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2357
2025-09-30T14:56:50.370719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.370740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.370773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:50.370799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896349644604993:4885], now have 1 active actors on pipe
2025-09-30T14:56:50.370810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896349644604719:2454], now have 1 active actors on pipe
2025-09-30T14:56:50.370828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:50.370839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:50.370853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896349554828607:10788]
2025-09-30T14:56:50.370856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896349554828607:10788]
2025-09-30T14:56:50.370859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896349554828607:10788]
2025-09-30T14:56:50.370871Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:50.370886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:50.370902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:50.370907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:50.370910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:50.370913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:50.370915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:50.370927Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2eb4aaf2-ce0cd9f7-f1ba9ea6-3df0a1d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:50.370934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:50.370937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:50.370940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:50.370950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:50.370959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:50.370997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896349554828607:10788]
2025-09-30T14:56:50.371010Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:50.371019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:50.371028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:50.371222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:50.371230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:50.371261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:50.371367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2358 partition: 0 MaxSeqNo: 42 sessionId: src_id|2eb4aaf2-ce0cd9f7-f1ba9ea6-3df0a1d7_0
2025-09-30T14:56:50.371744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b221f01b-cd4999d6-3e60cd5-cad545c0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2eb4aaf2-ce0cd9f7-f1ba9ea6-3df0a1d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:50.374431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2eb4aaf2-ce0cd9f7-f1ba9ea6-3df0a1d7_0] Write session: try to update token
2025-09-30T14:56:50.374449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2eb4aaf2-ce0cd9f7-f1ba9ea6-3df0a1d7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:50.383470Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:50.383489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:50.383498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896349554828607:10788]
2025-09-30T14:56:50.383549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:50.383548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:50.383747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:50.383919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:50.384081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:50.384234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:50.384445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:50.384492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:50.393899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2358 sessionId: src_id|2eb4aaf2-ce0cd9f7-f1ba9ea6-3df0a1d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:50.396010Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:50.396030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:50.396032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:50.396034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:50.396047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896349554828607:10788]
2025-09-30T14:56:50.396051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896349554828607:10788]
2025-09-30T14:56:50.396055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896349554828607:10788]
2025-09-30T14:56:50.396099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:50.396106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.396109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:50.396124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:50.396139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:50.396144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:50.396265Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:50.396786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:50.438817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896349644605043:4281]
2025-09-30T14:56:50.439131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2357, pipe: [1:7555896349644605043:4281]
2025-09-30T14:56:50.508583Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:50.508953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:50.508974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:50.508999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896349644605043:4281], now have 1 active actors on pipe
2025-09-30T14:56:50.509219Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:50.509288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:50.509301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:50.509367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2358 reason: error at write: Disconnected sessionId: src_id|2eb4aaf2-ce0cd9f7-f1ba9ea6-3df0a1d7_0
2025-09-30T14:56:50.509556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2358 sessionId: src_id|2eb4aaf2-ce0cd9f7-f1ba9ea6-3df0a1d7_0 is DEAD
2025-09-30T14:56:50.509630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:50.509680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896349644605043:4281]
2025-09-30T14:56:50.510028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eb4aaf2-ce0cd9f7-f1ba9ea6-3df0a1d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:50.510040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eb4aaf2-ce0cd9f7-f1ba9ea6-3df0a1d7_0] Write session will restart in 0.005643s
2025-09-30T14:56:50.510063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eb4aaf2-ce0cd9f7-f1ba9ea6-3df0a1d7_0] Write session: Do CDS request
2025-09-30T14:56:50.510068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eb4aaf2-ce0cd9f7-f1ba9ea6-3df0a1d7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:50.516818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2eb4aaf2-ce0cd9f7-f1ba9ea6-3df0a1d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:50.517094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:50.517118Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2359
2025-09-30T14:56:50.517319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2359 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:50.517353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2359 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:50.517363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2359 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:50.517367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:50.517887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2359 sessionId:  describe result for acl check
2025-09-30T14:56:50.517927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:50.517936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:50.517938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:50.517944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896349644605078:4890] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:50.518492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896349644605078:4890] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:50.520858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896349644605078:4890] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:50.523525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896349644605078:4890] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:50.523541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896349644605078:4890] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:50.523544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896349644605078:4890] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:50.523553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2359 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:50.530433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:50.532273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:50.532501Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:50.532514Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:50.532527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:50.532589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:50.532637Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896349554828811:10791]
2025-09-30T14:56:50.533361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:50.533707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:50.533762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:50.534165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:50.534227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:50.534233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:50.534234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:50.534236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:50.534237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:50.534238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:50.534239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:50.534241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:50.534242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:50.534243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:50.534244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.534246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.534247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.534248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:50.534249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:50.534255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:50.534266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:50.534270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:50.534274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:50.534279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:50.534283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:50.534287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:50.534291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:50.534295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:50.534300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:50.534304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.534308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.534312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.534316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:50.534320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:50.534328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:50.534336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:50.534342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:50.534348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:50.534353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:50.534357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:50.534362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:50.534367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:50.534377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:50.534383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:50.534387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:50.534400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:50.534404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:50.534409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:50.534414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:50.534420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:50.534424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:50.534430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:50.534434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:50.534439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:50.534444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.534450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.534456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.534466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.534471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.534476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.534483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:50.534492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:50.534502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:50.534512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:50.534562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:50.540202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:50.541447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:50.541463Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:50.541466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:50.541470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:50.541477Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2358 [2:7555896349554828811:10791]
2025-09-30T14:56:50.541495Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:50.541511Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:50.541514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:50.541518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:50.541520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:50.541538Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:50.541551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:50.541557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:50.541627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.541640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.541641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.541645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:50.541647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:50.541723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:50.541731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.541746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.541763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.541783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:50.541810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896349644605322:4890], now have 1 active actors on pipe
2025-09-30T14:56:50.541814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896349644605045:2454], now have 1 active actors on pipe
2025-09-30T14:56:50.541821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896349554828806:10791]
2025-09-30T14:56:50.541824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896349554828806:10791]
2025-09-30T14:56:50.541827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896349554828806:10791]
2025-09-30T14:56:50.541842Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:50.541857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:50.541867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:50.541870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:50.541872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:50.541873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:50.541876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:50.541915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896349554828806:10791]
2025-09-30T14:56:50.541923Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:50.541905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2358
2025-09-30T14:56:50.541906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2358
2025-09-30T14:56:50.541964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:50.541971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:50.541976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:50.542002Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d4c72f6-aef86d6c-8a63bfe0-694e31ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:50.542020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:50.542023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:50.542025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:50.542039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:50.542054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:50.542073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:50.542329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:50.542340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:50.542369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:50.542515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2359 partition: 0 MaxSeqNo: 42 sessionId: src_id|7d4c72f6-aef86d6c-8a63bfe0-694e31ff_0
2025-09-30T14:56:50.542916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eb4aaf2-ce0cd9f7-f1ba9ea6-3df0a1d7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7d4c72f6-aef86d6c-8a63bfe0-694e31ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:50.546010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4c72f6-aef86d6c-8a63bfe0-694e31ff_0] Write session: try to update token
2025-09-30T14:56:50.546035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4c72f6-aef86d6c-8a63bfe0-694e31ff_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:50.555690Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:50.555710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:50.555720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896349554828806:10791]
2025-09-30T14:56:50.555768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:50.555781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:50.555967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:50.556142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:50.556302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:50.556462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:50.556674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:50.556716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:50.563184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2359 sessionId: src_id|7d4c72f6-aef86d6c-8a63bfe0-694e31ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:50.566148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:50.567041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:50.567068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:50.567091Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:50.567094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:50.567097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:50.567099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:50.567108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896349554828806:10791]
2025-09-30T14:56:50.567112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896349554828806:10791]
2025-09-30T14:56:50.567120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896349554828806:10791]
2025-09-30T14:56:50.567166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:50.567171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:50.567174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:50.567178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.567178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:50.567180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:50.567358Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:50.609871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896349644605371:4281]
2025-09-30T14:56:50.610220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2358, pipe: [1:7555896349644605371:4281]
2025-09-30T14:56:50.683476Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:50.683913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:50.683952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896349644605371:4281], now have 1 active actors on pipe
2025-09-30T14:56:50.684045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:50.684171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896349644605371:4281]
2025-09-30T14:56:50.684206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:50.697244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4c72f6-aef86d6c-8a63bfe0-694e31ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:50.696863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:50.697259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4c72f6-aef86d6c-8a63bfe0-694e31ff_0] Write session will restart in 0.005945s
2025-09-30T14:56:50.696881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:50.696903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2359 reason: error at write: Disconnected sessionId: src_id|7d4c72f6-aef86d6c-8a63bfe0-694e31ff_0
2025-09-30T14:56:50.697039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2359 sessionId: src_id|7d4c72f6-aef86d6c-8a63bfe0-694e31ff_0 is DEAD
2025-09-30T14:56:50.697303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4c72f6-aef86d6c-8a63bfe0-694e31ff_0] Write session: Do CDS request
2025-09-30T14:56:50.697309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4c72f6-aef86d6c-8a63bfe0-694e31ff_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:50.704778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4c72f6-aef86d6c-8a63bfe0-694e31ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:50.704906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:50.704929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2360
2025-09-30T14:56:50.705086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2360 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:50.705132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2360 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:50.705143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2360 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:50.705161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:50.705659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2360 sessionId:  describe result for acl check
2025-09-30T14:56:50.705721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:50.705726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:50.705728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:50.705734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896349644605504:4905] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:50.706300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896349644605504:4905] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:50.709474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896349644605504:4905] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:50.712453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896349644605504:4905] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:50.712467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896349644605504:4905] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:50.712473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896349644605504:4905] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:50.712497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2360 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:50.719436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:50.719994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:50.720370Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:50.720391Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:50.720404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:50.720472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:50.720521Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896349554829010:10793]
2025-09-30T14:56:50.721287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:50.721673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:50.721730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:50.722082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:50.722150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:50.722157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:50.722158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:50.722160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:50.722161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:50.722163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:50.722164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:50.722165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:50.722167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:50.722168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:50.722170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.722171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.722172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.722173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:50.722175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:50.722181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:50.722192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:50.722196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:50.722201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:50.722205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:50.722209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:50.722213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:50.722217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:50.722221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:50.722226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:50.722230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.722234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.722238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.722243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:50.722247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:50.722257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:50.722264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:50.722271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:50.722277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:50.722283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:50.722288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:50.722292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:50.722298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:50.722303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:50.722308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:50.722313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:50.722319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:50.722324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:50.722330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:50.722334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:50.722340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:50.722345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:50.722351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:50.722356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:50.722361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:50.722366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.722374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.722379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.722384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.722389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.722401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.722405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:50.722411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:50.722416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:50.722421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:50.722466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:50.728204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:50.729342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:50.729355Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:50.729358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:50.729362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:50.729370Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2359 [2:7555896349554829010:10793]
2025-09-30T14:56:50.729388Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:50.729405Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:50.729408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:50.729411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:50.729414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:50.729431Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:50.729439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:50.729451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:50.729519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.729525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.729528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.729532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:50.729534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:50.729711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:50.729718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.729730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.729743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.729764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:50.729788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896349644605612:4905], now have 1 active actors on pipe
2025-09-30T14:56:50.729795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896349644605375:2454], now have 1 active actors on pipe
2025-09-30T14:56:50.729802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896349554829005:10793]
2025-09-30T14:56:50.729807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896349554829005:10793]
2025-09-30T14:56:50.729811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896349554829005:10793]
2025-09-30T14:56:50.729826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:50.729799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2359
2025-09-30T14:56:50.729840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:50.729839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2359
2025-09-30T14:56:50.729853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:50.729860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:50.729863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:50.729864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:50.729866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:50.729903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896349554829005:10793]
2025-09-30T14:56:50.729915Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:50.729927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:50.729935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:50.729940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:50.729982Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5776ce9-f6fb5f3e-730c672-b9bf838c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:50.729993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:50.730000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:50.730002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:50.730012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:50.730021Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:50.730041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:50.730358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:50.730371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:50.730394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:50.730556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2360 partition: 0 MaxSeqNo: 42 sessionId: src_id|e5776ce9-f6fb5f3e-730c672-b9bf838c_0
2025-09-30T14:56:50.730924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4c72f6-aef86d6c-8a63bfe0-694e31ff_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e5776ce9-f6fb5f3e-730c672-b9bf838c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:50.733795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5776ce9-f6fb5f3e-730c672-b9bf838c_0] Write session: try to update token
2025-09-30T14:56:50.733815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5776ce9-f6fb5f3e-730c672-b9bf838c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:50.745105Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:50.745137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:50.745139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:50.745142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:50.745156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896349554829005:10793]
2025-09-30T14:56:50.745162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896349554829005:10793]
2025-09-30T14:56:50.745168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896349554829005:10793]
2025-09-30T14:56:50.745214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:50.745219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:50.745222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.745234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:50.745249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:50.745254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:50.745389Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:50.760195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2360 sessionId: src_id|e5776ce9-f6fb5f3e-730c672-b9bf838c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:50.762966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:50.787717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896349644605702:4281]
2025-09-30T14:56:50.788080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2359, pipe: [1:7555896349644605702:4281]
2025-09-30T14:56:50.858172Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:50.858646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:50.858663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:50.858682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896349644605702:4281], now have 1 active actors on pipe
2025-09-30T14:56:50.858896Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:50.858897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:50.858901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:50.858929Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:50.858956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896349644605702:4281]
2025-09-30T14:56:50.858958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2360 reason: error at write: Disconnected sessionId: src_id|e5776ce9-f6fb5f3e-730c672-b9bf838c_0
2025-09-30T14:56:50.859129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2360 sessionId: src_id|e5776ce9-f6fb5f3e-730c672-b9bf838c_0 is DEAD
2025-09-30T14:56:50.859442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5776ce9-f6fb5f3e-730c672-b9bf838c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:50.859450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5776ce9-f6fb5f3e-730c672-b9bf838c_0] Write session will restart in 0.006409s
2025-09-30T14:56:50.859474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5776ce9-f6fb5f3e-730c672-b9bf838c_0] Write session: Do CDS request
2025-09-30T14:56:50.859484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5776ce9-f6fb5f3e-730c672-b9bf838c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:50.867003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5776ce9-f6fb5f3e-730c672-b9bf838c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:50.867682Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:50.867697Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2361
2025-09-30T14:56:50.868085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2361 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:50.868121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2361 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:50.868131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2361 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:50.868135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:50.868636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2361 sessionId:  describe result for acl check
2025-09-30T14:56:50.868667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:50.868669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:50.868671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:50.868678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896349644605786:4911] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:50.869269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896349644605786:4911] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:50.871579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896349644605786:4911] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:50.874425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896349644605786:4911] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:50.874439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896349644605786:4911] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:50.874442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896349644605786:4911] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:50.874461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2361 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:50.879179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:50.880918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:50.881126Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:50.881137Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:50.881148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:50.881199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:50.881256Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896349554829209:10795]
2025-09-30T14:56:50.881988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:50.882328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:50.882373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:50.882720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:50.882782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:50.882789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:50.882791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:50.882792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:50.882793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:50.882794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:50.882796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:50.882797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:50.882799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:50.882800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:50.882802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.882803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.882804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.882806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:50.882807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:50.882813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:50.882825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:50.882829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:50.882834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:50.882838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:50.882843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:50.882848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:50.882852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:50.882857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:50.882861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:50.882866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.882870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.882875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.882879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:50.882884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:50.882894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:50.882903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:50.882909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:50.882915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:50.882921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:50.882926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:50.882932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:50.882938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:50.882943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:50.882949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:50.882955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:50.882967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:50.882972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:50.882978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:50.882988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:50.882994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:50.882999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:50.883009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:50.883014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:50.883024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:50.883029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.883039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.883044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.883054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.883060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.883069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.883074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:50.883080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:50.883086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:50.883092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:50.883146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:50.888955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:50.890125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:50.890143Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:50.890145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:50.890150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:50.890157Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2360 [2:7555896349554829209:10795]
2025-09-30T14:56:50.890179Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:50.890196Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:50.890200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:50.890203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:50.890206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:50.890222Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:50.890234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:50.890241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:50.890309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.890322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.890324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.890327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:50.890330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:50.890397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:50.890405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.890417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:50.890428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:50.890450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:50.890474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896349644605920:4911], now have 1 active actors on pipe
2025-09-30T14:56:50.890482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896349644605704:2454], now have 1 active actors on pipe
2025-09-30T14:56:50.890488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896349554829204:10795]
2025-09-30T14:56:50.890491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896349554829204:10795]
2025-09-30T14:56:50.890493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896349554829204:10795]
2025-09-30T14:56:50.890505Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:50.890519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:50.890530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:50.890534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:50.890537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:50.890540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:50.890542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:50.890572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896349554829204:10795]
2025-09-30T14:56:50.890587Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:50.890609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:50.890592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2360
2025-09-30T14:56:50.890599Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2360
2025-09-30T14:56:50.890675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:50.890685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:50.890710Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0000498-eeb8d556-76f97037-b3e6554f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:50.890721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:50.890724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:50.890726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:50.890736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:50.890748Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:50.890766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:50.890905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:50.890913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:50.890925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:50.891033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2361 partition: 0 MaxSeqNo: 42 sessionId: src_id|f0000498-eeb8d556-76f97037-b3e6554f_0
2025-09-30T14:56:50.891652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5776ce9-f6fb5f3e-730c672-b9bf838c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f0000498-eeb8d556-76f97037-b3e6554f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:50.894610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0000498-eeb8d556-76f97037-b3e6554f_0] Write session: try to update token
2025-09-30T14:56:50.894630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0000498-eeb8d556-76f97037-b3e6554f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:50.903305Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:50.903323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:50.903325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:50.903328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:50.903338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896349554829204:10795]
2025-09-30T14:56:50.903342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896349554829204:10795]
2025-09-30T14:56:50.903347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896349554829204:10795]
2025-09-30T14:56:50.903390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:50.903398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:50.903398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:50.903401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:50.903405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:50.903409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:50.903557Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:50.915188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2361 sessionId: src_id|f0000498-eeb8d556-76f97037-b3e6554f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:50.918098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:50.959085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896349644606032:4281]
2025-09-30T14:56:50.959354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2360, pipe: [1:7555896349644606032:4281]
2025-09-30T14:56:51.026785Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:51.027193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:51.027203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:51.027321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896349644606032:4281], now have 1 active actors on pipe
2025-09-30T14:56:51.027595Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:51.028148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0000498-eeb8d556-76f97037-b3e6554f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:51.028161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0000498-eeb8d556-76f97037-b3e6554f_0] Write session will restart in 0.006407s
2025-09-30T14:56:51.027642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896349644606032:4281]
2025-09-30T14:56:51.028185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0000498-eeb8d556-76f97037-b3e6554f_0] Write session: Do CDS request
2025-09-30T14:56:51.028204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0000498-eeb8d556-76f97037-b3e6554f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:51.027677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:51.027714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:51.027801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2361 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f0000498-eeb8d556-76f97037-b3e6554f_0
2025-09-30T14:56:51.027971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2361 sessionId: src_id|f0000498-eeb8d556-76f97037-b3e6554f_0 is DEAD
2025-09-30T14:56:51.035755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0000498-eeb8d556-76f97037-b3e6554f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:51.038574Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:51.038588Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2362
2025-09-30T14:56:51.038741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2362 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:51.038788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2362 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:51.038799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2362 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:51.038803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:51.039221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2362 sessionId:  describe result for acl check
2025-09-30T14:56:51.039277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:51.039279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:51.039281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:51.039290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896353939573506:4924] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:51.039872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896353939573506:4924] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:51.042106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896353939573506:4924] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:51.045777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896353939573506:4924] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:51.045797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896353939573506:4924] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:51.045801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896353939573506:4924] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:51.045815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2362 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:51.045885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:51.048130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:51.048526Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:51.048547Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:51.048568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:51.048653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:51.048704Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896353849796720:10799]
2025-09-30T14:56:51.049368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:51.049732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:51.049788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:51.050162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:51.050228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:51.050234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:51.050235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:51.050237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:51.050238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:51.050239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:51.050240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:51.050242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:51.050244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:51.050245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:51.050246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.050248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.050249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.050250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:51.050251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:51.050258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:51.050270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:51.050274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:51.050278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:51.050281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:51.050286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:51.050290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:51.050294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:51.050299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:51.050303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:51.050307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.050311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.050314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.050318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:51.050321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:51.050330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:51.050338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:51.050345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:51.050351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:51.050357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:51.050362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:51.050368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:51.050373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:51.050378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:51.050384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:51.050388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:51.050393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:51.050398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:51.050403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:51.050408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:51.050413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:51.050418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:51.050423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:51.050430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:51.050435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:51.050439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.050444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.050448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.050453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.050462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.050468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.050472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:51.050482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:51.050487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:51.050492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:51.050552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:51.058382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:51.059528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:51.059542Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:51.059544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:51.059547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:51.059553Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2361 [2:7555896353849796720:10799]
2025-09-30T14:56:51.059567Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:51.059583Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:51.059586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:51.059588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:51.059589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:51.059602Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:51.059608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:51.059613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:51.059672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.059680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.059683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.059685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:51.059687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:51.059746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:51.059751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.059761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.059767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.059778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:51.059792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896353849796714:10799]
2025-09-30T14:56:51.059799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896353849796714:10799]
2025-09-30T14:56:51.059801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896353849796714:10799]
2025-09-30T14:56:51.059809Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:51.059821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:51.059831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:51.059833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:51.059842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:51.059846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:51.059850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:51.059871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896353939573649:4924], now have 1 active actors on pipe
2025-09-30T14:56:51.059875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896353849796714:10799]
2025-09-30T14:56:51.059881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:51.059885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896353939573333:2454], now have 1 active actors on pipe
2025-09-30T14:56:51.059889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:51.060399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2361
2025-09-30T14:56:51.060430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2361
2025-09-30T14:56:51.060680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:51.060693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:51.060726Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de448d3f-630e01d5-fd276210-64fe0a11_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:51.060740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:51.060748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:51.060755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:51.060767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:51.060779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:51.060795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:51.061375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:51.061388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:51.061409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:51.061536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2362 partition: 0 MaxSeqNo: 42 sessionId: src_id|de448d3f-630e01d5-fd276210-64fe0a11_0
2025-09-30T14:56:51.061950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0000498-eeb8d556-76f97037-b3e6554f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|de448d3f-630e01d5-fd276210-64fe0a11_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:51.064943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de448d3f-630e01d5-fd276210-64fe0a11_0] Write session: try to update token
2025-09-30T14:56:51.064969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de448d3f-630e01d5-fd276210-64fe0a11_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:51.075185Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:51.075209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:51.075212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:51.075215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:51.075226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896353849796714:10799]
2025-09-30T14:56:51.075232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896353849796714:10799]
2025-09-30T14:56:51.075236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896353849796714:10799]
2025-09-30T14:56:51.075304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:51.075313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.075316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:51.075481Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:51.079372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:51.079382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:51.079388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:51.083568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2362 sessionId: src_id|de448d3f-630e01d5-fd276210-64fe0a11_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:51.086373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:51.127510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896353939573675:4281]
2025-09-30T14:56:51.127855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2361, pipe: [1:7555896353939573675:4281]
2025-09-30T14:56:51.195783Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:51.196326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:51.196346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:51.196393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896353939573675:4281], now have 1 active actors on pipe
2025-09-30T14:56:51.196638Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:51.196694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896353939573675:4281]
2025-09-30T14:56:51.196729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:51.196817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2362 reason: status is not ok: tablet will be restarted right now sessionId: src_id|de448d3f-630e01d5-fd276210-64fe0a11_0
2025-09-30T14:56:51.197000Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:51.197019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2362 sessionId: src_id|de448d3f-630e01d5-fd276210-64fe0a11_0 is DEAD
2025-09-30T14:56:51.198344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de448d3f-630e01d5-fd276210-64fe0a11_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:51.198357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de448d3f-630e01d5-fd276210-64fe0a11_0] Write session will restart in 0.008603s
2025-09-30T14:56:51.198382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de448d3f-630e01d5-fd276210-64fe0a11_0] Write session: Do CDS request
2025-09-30T14:56:51.198388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de448d3f-630e01d5-fd276210-64fe0a11_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:51.208088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de448d3f-630e01d5-fd276210-64fe0a11_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:51.208224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:51.208240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2363
2025-09-30T14:56:51.208624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2363 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:51.208669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2363 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:51.208679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2363 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:51.208685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:51.209412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2363 sessionId:  describe result for acl check
2025-09-30T14:56:51.209452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:51.209455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:51.209456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:51.209462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896353939573773:4941] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:51.210063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896353939573773:4941] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:51.213008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896353939573773:4941] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:51.216534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896353939573773:4941] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:51.216555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896353939573773:4941] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:51.216559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896353939573773:4941] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:51.216567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2363 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:51.219985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:51.221369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:51.221621Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:51.221630Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:51.221642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:51.221698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:51.221748Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896353849796921:10801]
2025-09-30T14:56:51.222480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:51.222836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:51.222908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:51.223313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:51.223586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:51.223595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:51.223597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:51.223598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:51.223601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:51.223603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:51.223604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:51.223606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:51.223607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:51.223609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:51.223610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.223612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.223613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.223615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:51.223616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:51.223624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:51.223637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:51.223641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:51.223647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:51.223652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:51.223657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:51.223661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:51.223666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:51.223671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:51.223676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:51.223680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.223685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.223690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.223696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:51.223700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:51.223711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:51.223720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:51.223727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:51.223734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:51.223739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:51.223746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:51.223752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:51.223758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:51.223764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:51.223771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:51.223776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:51.223782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:51.223787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:51.223793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:51.223797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:51.223804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:51.223810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:51.223822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:51.223828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:51.223834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:51.223842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.223853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.223859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.223870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.223875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.223885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.223890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:51.223901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:51.223906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:51.223918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:51.223969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:51.229895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:51.230896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:51.230919Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:51.230923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:51.230929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:51.230938Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2362 [2:7555896353849796921:10801]
2025-09-30T14:56:51.230962Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:51.230993Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:51.230998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:51.231002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:51.231006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:51.231025Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:51.231033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:51.231041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:51.231118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.231129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.231132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.231136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:51.231140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:51.231227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:51.231262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.231280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.231292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.231313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:51.231335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896353939573681:2454], now have 1 active actors on pipe
2025-09-30T14:56:51.231340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896353939573974:4941], now have 1 active actors on pipe
2025-09-30T14:56:51.231348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896353849796916:10801]
2025-09-30T14:56:51.231350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896353849796916:10801]
2025-09-30T14:56:51.231353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896353849796916:10801]
2025-09-30T14:56:51.231370Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:51.231386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:51.231400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:51.231403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:51.231407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:51.231409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:51.231411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:51.231454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896353849796916:10801]
2025-09-30T14:56:51.231468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:51.231491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:51.231446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2362
2025-09-30T14:56:51.231523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2362
2025-09-30T14:56:51.231682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:51.231694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:51.231722Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd926a60-52981251-78ce7ef3-eccb90aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:51.231745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:51.231749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:51.231751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:51.231764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:51.231776Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:51.231798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:51.232041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:51.232057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:51.232095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:51.232260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2363 partition: 0 MaxSeqNo: 42 sessionId: src_id|fd926a60-52981251-78ce7ef3-eccb90aa_0
2025-09-30T14:56:51.232649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de448d3f-630e01d5-fd276210-64fe0a11_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fd926a60-52981251-78ce7ef3-eccb90aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:51.235697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd926a60-52981251-78ce7ef3-eccb90aa_0] Write session: try to update token
2025-09-30T14:56:51.235722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd926a60-52981251-78ce7ef3-eccb90aa_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:51.250946Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:51.250987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:51.251004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896353849796916:10801]
2025-09-30T14:56:51.251067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:51.251077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:51.251522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:51.251815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:51.252110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:51.252397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:51.252806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:51.252889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:51.256500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2363 sessionId: src_id|fd926a60-52981251-78ce7ef3-eccb90aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:51.256687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:51.256707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:51.256709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:51.256711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:51.256722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896353849796916:10801]
2025-09-30T14:56:51.256727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896353849796916:10801]
2025-09-30T14:56:51.256732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896353849796916:10801]
2025-09-30T14:56:51.256777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:51.256789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.256792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:51.256939Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:51.258668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:51.258689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:51.258694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:51.259843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:51.296935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896353939574031:4281]
2025-09-30T14:56:51.297430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2362, pipe: [1:7555896353939574031:4281]
2025-09-30T14:56:51.370573Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:51.370960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:51.370979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:51.371002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896353939574031:4281], now have 1 active actors on pipe
2025-09-30T14:56:51.371238Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:51.371263Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:51.371276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:51.371281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:51.371327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896353939574031:4281]
2025-09-30T14:56:51.371364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2363 reason: error at write: Disconnected sessionId: src_id|fd926a60-52981251-78ce7ef3-eccb90aa_0
2025-09-30T14:56:51.371569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2363 sessionId: src_id|fd926a60-52981251-78ce7ef3-eccb90aa_0 is DEAD
2025-09-30T14:56:51.371749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd926a60-52981251-78ce7ef3-eccb90aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:51.371761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd926a60-52981251-78ce7ef3-eccb90aa_0] Write session will restart in 0.005875s
2025-09-30T14:56:51.371805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd926a60-52981251-78ce7ef3-eccb90aa_0] Write session: Do CDS request
2025-09-30T14:56:51.371815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd926a60-52981251-78ce7ef3-eccb90aa_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:51.378753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd926a60-52981251-78ce7ef3-eccb90aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:51.378864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:51.378879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2364
2025-09-30T14:56:51.379065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2364 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:51.379116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2364 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:51.379127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2364 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:51.379132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:51.379603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2364 sessionId:  describe result for acl check
2025-09-30T14:56:51.379641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:51.379648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:51.379650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:51.379657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896353939574085:4962] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:51.380203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896353939574085:4962] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:51.383787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896353939574085:4962] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:51.387601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896353939574085:4962] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:51.387620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896353939574085:4962] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:51.387624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896353939574085:4962] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:51.387633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2364 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:51.400567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:51.401573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:51.401814Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:51.401824Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:51.401836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:51.401901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:51.401963Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896353849797160:10815]
2025-09-30T14:56:51.402639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:51.402999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:51.403044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:51.403789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:51.403874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:51.403880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:51.403882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:51.403883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:51.403884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:51.403886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:51.403888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:51.403889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:51.403890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:51.403891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:51.403892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.403893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.403894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.403895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:51.403896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:51.403902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:51.403914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:51.403919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:51.403923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:51.403927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:51.403931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:51.403935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:51.403940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:51.403944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:51.403949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:51.403953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.403957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.403960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.403963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:51.403966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:51.403975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:51.403984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:51.403989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:51.403994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:51.403998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:51.404003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:51.404007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:51.404012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:51.404017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:51.404022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:51.404027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:51.404032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:51.404038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:51.404044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:51.404049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:51.404056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:51.404062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:51.404067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:51.404072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:51.404078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:51.404084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.404089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.404094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.404099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.404104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.404109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.404114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:51.404120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:51.404125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:51.404131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:51.404179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:51.413077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:51.414116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:51.414135Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:51.414139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:51.414143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:51.414153Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2363 [2:7555896353849797160:10815]
2025-09-30T14:56:51.414173Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:51.414191Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:51.414194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:51.414198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:51.414201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:51.414221Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:51.414229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:51.414237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:51.414315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.414318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.414320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.414324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:51.414327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:51.414407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:51.414411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.414426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.414438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.414455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:51.414474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896353849797155:10815]
2025-09-30T14:56:51.414477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896353849797155:10815]
2025-09-30T14:56:51.414480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896353849797155:10815]
2025-09-30T14:56:51.414489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:51.414503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:51.414507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:51.414507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:51.414511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:51.414524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:51.414527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:51.414539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896353939574326:4962], now have 1 active actors on pipe
2025-09-30T14:56:51.414544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896353939574041:2454], now have 1 active actors on pipe
2025-09-30T14:56:51.414588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896353849797155:10815]
2025-09-30T14:56:51.414601Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:51.414627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:51.416447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:51.416467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:51.416515Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55e7f7c-7abec7f2-d830982-ead7e7e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:51.416531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:51.416536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:51.416548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:51.416561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:51.416575Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:51.416600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:51.417334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:51.417349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:51.417374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:51.417916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd926a60-52981251-78ce7ef3-eccb90aa_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|55e7f7c-7abec7f2-d830982-ead7e7e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:51.416221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2363
2025-09-30T14:56:51.416263Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2363
2025-09-30T14:56:51.417513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2364 partition: 0 MaxSeqNo: 42 sessionId: src_id|55e7f7c-7abec7f2-d830982-ead7e7e1_0
2025-09-30T14:56:51.421146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55e7f7c-7abec7f2-d830982-ead7e7e1_0] Write session: try to update token
2025-09-30T14:56:51.421165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55e7f7c-7abec7f2-d830982-ead7e7e1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:51.428300Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:51.428323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:51.428334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896353849797155:10815]
2025-09-30T14:56:51.428382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:51.428570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:51.428720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:51.428874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:51.429028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:51.429248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:51.429285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:51.429561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:51.439139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2364 sessionId: src_id|55e7f7c-7abec7f2-d830982-ead7e7e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:51.440572Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:51.440592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:51.440595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:51.440597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:51.440607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896353849797155:10815]
2025-09-30T14:56:51.440612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896353849797155:10815]
2025-09-30T14:56:51.440617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896353849797155:10815]
2025-09-30T14:56:51.440658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:51.440665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.440665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:51.440668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:51.440671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:51.440676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:51.440823Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:51.442110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:51.473892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896353939574373:4281]
2025-09-30T14:56:51.474453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2363, pipe: [1:7555896353939574373:4281]
2025-09-30T14:56:51.561406Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:51.561843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:51.561861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:51.561881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896353939574373:4281], now have 1 active actors on pipe
2025-09-30T14:56:51.562144Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:51.562389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896353939574373:4281]
2025-09-30T14:56:51.562427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:51.562508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2364 reason: status is not ok: tablet will be restarted right now sessionId: src_id|55e7f7c-7abec7f2-d830982-ead7e7e1_0
2025-09-30T14:56:51.562518Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:51.562685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2364 sessionId: src_id|55e7f7c-7abec7f2-d830982-ead7e7e1_0 is DEAD
2025-09-30T14:56:51.563043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e7f7c-7abec7f2-d830982-ead7e7e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:51.563055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e7f7c-7abec7f2-d830982-ead7e7e1_0] Write session will restart in 0.006964s
2025-09-30T14:56:51.563078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e7f7c-7abec7f2-d830982-ead7e7e1_0] Write session: Do CDS request
2025-09-30T14:56:51.563085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e7f7c-7abec7f2-d830982-ead7e7e1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:51.570757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55e7f7c-7abec7f2-d830982-ead7e7e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:51.570889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:51.570903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2365
2025-09-30T14:56:51.571018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2365 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:51.571051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2365 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:51.571061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2365 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:51.571065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:51.571582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2365 sessionId:  describe result for acl check
2025-09-30T14:56:51.571618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:51.571621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:51.571623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:51.571631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896353939574426:4967] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:51.572149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896353939574426:4967] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:51.574682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896353939574426:4967] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:51.578359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896353939574426:4967] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:51.578374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896353939574426:4967] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:51.578377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896353939574426:4967] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:51.578386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2365 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:51.582539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:51.584153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:51.584440Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:51.584450Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:51.584461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:51.584516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:51.584561Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896353849797364:10818]
2025-09-30T14:56:51.585050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:51.585482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:51.585554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:51.585928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:51.586004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:51.586010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:51.586011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:51.586013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:51.586014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:51.586015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:51.586016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:51.586017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:51.586019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:51.586020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:51.586022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.586023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.586024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.586025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:51.586027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:51.586033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:51.586043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:51.586046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:51.586049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:51.586051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:51.586054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:51.586056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:51.586062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:51.586064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:51.586067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:51.586069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.586072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.586074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.586077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:51.586079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:51.586085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:51.586090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:51.586094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:51.586099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:51.586103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:51.586109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:51.586113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:51.586118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:51.586123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:51.586128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:51.586132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:51.586136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:51.586142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:51.586148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:51.586152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:51.586158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:51.586163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:51.586167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:51.586170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:51.586174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:51.586177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.586181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.586186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.586192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.586197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.586203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.586208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:51.586214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:51.586217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:51.586220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:51.586245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:51.591732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:51.592900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:51.592911Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:51.592914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:51.592918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:51.592925Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2364 [2:7555896353849797364:10818]
2025-09-30T14:56:51.592943Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:51.592960Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:51.592972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:51.592975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:51.592977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:51.592994Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:51.593000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:51.593006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:51.593057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.593063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.593064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.593067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:51.593069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:51.593130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:51.593138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.593146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.593153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.593162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:51.593175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896353849797359:10818]
2025-09-30T14:56:51.593181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896353849797359:10818]
2025-09-30T14:56:51.593183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896353849797359:10818]
2025-09-30T14:56:51.593189Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:51.593200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896353939574375:2454], now have 1 active actors on pipe
2025-09-30T14:56:51.593200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:51.593204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:51.593206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:51.593211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896353939574627:4967], now have 1 active actors on pipe
2025-09-30T14:56:51.593217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:51.593240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:51.593248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:51.593285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896353849797359:10818]
2025-09-30T14:56:51.593299Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:51.593322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:51.593356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:51.593370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:51.593394Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a319c96-ddc1edf7-a2362fad-2f23d3c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:51.593407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:51.593416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:51.593418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:51.593430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:51.593443Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:51.593459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:51.593613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:51.593620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:51.593634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:51.594119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e7f7c-7abec7f2-d830982-ead7e7e1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5a319c96-ddc1edf7-a2362fad-2f23d3c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:51.593321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2364
2025-09-30T14:56:51.593455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2364
2025-09-30T14:56:51.593738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2365 partition: 0 MaxSeqNo: 42 sessionId: src_id|5a319c96-ddc1edf7-a2362fad-2f23d3c9_0
2025-09-30T14:56:51.596970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a319c96-ddc1edf7-a2362fad-2f23d3c9_0] Write session: try to update token
2025-09-30T14:56:51.596988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a319c96-ddc1edf7-a2362fad-2f23d3c9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:51.606510Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:51.606528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:51.606539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896353849797359:10818]
2025-09-30T14:56:51.606585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:51.606587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:51.606763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:51.606912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:51.607052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:51.607184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:51.607413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:51.607458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:51.614022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2365 sessionId: src_id|5a319c96-ddc1edf7-a2362fad-2f23d3c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:51.616787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:51.617039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:51.617063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:51.617099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:51.617300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:51.620644Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:51.620660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:51.620667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:51.620668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:51.620678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896353849797359:10818]
2025-09-30T14:56:51.620682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896353849797359:10818]
2025-09-30T14:56:51.620686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896353849797359:10818]
2025-09-30T14:56:51.620730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:51.620738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.620740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:51.620741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:51.620752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:51.620756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:51.620921Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:51.662000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896353939574707:4281]
2025-09-30T14:56:51.662284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2364, pipe: [1:7555896353939574707:4281]
2025-09-30T14:56:51.734376Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:51.742818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:51.742848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:51.743028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:51.743092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:51.743157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:51.743220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:51.743284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:51.743295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:51.743367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:51.743435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:51.743503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:51.743571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:51.743614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:51.743627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:51.743703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:51.746546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:51.746612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896353939574707:4281]
2025-09-30T14:56:51.746639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:51.746644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:51.746683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2365 reason: error at write: Disconnected sessionId: src_id|5a319c96-ddc1edf7-a2362fad-2f23d3c9_0
2025-09-30T14:56:51.746881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2365 sessionId: src_id|5a319c96-ddc1edf7-a2362fad-2f23d3c9_0 is DEAD
2025-09-30T14:56:51.743765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:51.743841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:51.743903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:51.743943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:51.743946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:51.744017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:51.744087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:51.744153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:51.744214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:51.744260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:51.744263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:51.744334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:51.744392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:51.744454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:51.744524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:51.744564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:51.744569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:51.744637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:51.744694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:51.744758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:51.744823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:51.744866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:51.744869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:51.744943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:51.745001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:51.745066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:51.745127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:51.745169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:51.745173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:51.745259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:51.745324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:51.745384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:51.745449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:51.745494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:51.745497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:51.745564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:51.745624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:51.745689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:51.745750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:51.745817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:51.745821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:51.745892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:51.745952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:51.746015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:51.746077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:51.746122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:51.746124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:51.746208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896353939574707:4281], now have 1 active actors on pipe
2025-09-30T14:56:51.747387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a319c96-ddc1edf7-a2362fad-2f23d3c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:51.747399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a319c96-ddc1edf7-a2362fad-2f23d3c9_0] Write session will restart in 0.005068s
2025-09-30T14:56:51.747424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a319c96-ddc1edf7-a2362fad-2f23d3c9_0] Write session: Do CDS request
2025-09-30T14:56:51.747430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a319c96-ddc1edf7-a2362fad-2f23d3c9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:51.747427Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:51.753795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a319c96-ddc1edf7-a2362fad-2f23d3c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:51.753892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:51.753908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2366
2025-09-30T14:56:51.754027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2366 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:51.754060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2366 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:51.754078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2366 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:51.754083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:51.754488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2366 sessionId:  describe result for acl check
2025-09-30T14:56:51.754522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:51.754529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:51.754531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:51.754537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896353939574744:4980] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:51.755071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896353939574744:4980] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:51.758187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896353939574744:4980] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:51.761089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896353939574744:4980] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:51.761103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896353939574744:4980] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:51.761109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896353939574744:4980] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:51.761118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2366 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:51.764106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:51.765477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:51.765716Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:51.765728Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:51.765740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:51.765794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:51.765835Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896353849797567:10820]
2025-09-30T14:56:51.766516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:51.766841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:51.766885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:51.767216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:51.767312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:51.767319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:51.767320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:51.767321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:51.767322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:51.767324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:51.767325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:51.767326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:51.767328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:51.767329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:51.767331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.767332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.767334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.767335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:51.767336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:51.767341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:51.767353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:51.767358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:51.767363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:51.767367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:51.767372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:51.767377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:51.767381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:51.767386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:51.767391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:51.767396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.767400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.767405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.767409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:51.767414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:51.767422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:51.767429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:51.767436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:51.767443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:51.767448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:51.767454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:51.767459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:51.767465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:51.767471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:51.767483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:51.767487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:51.767494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:51.767502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:51.767508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:51.767517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:51.767523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:51.767528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:51.767538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:51.767543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:51.767554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:51.767559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.767570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.767575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.767580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.767589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.767595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.767600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:51.767610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:51.767615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:51.767627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:51.767669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:51.773233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:51.774441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:51.774458Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:51.774461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:51.774465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:51.774472Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2365 [2:7555896353849797567:10820]
2025-09-30T14:56:51.774489Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:51.774505Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:51.774508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:51.774512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:51.774515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:51.774531Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:51.774542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:51.774550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:51.774619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.774627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.774629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.774633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:51.774636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:51.774700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:51.774709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.774722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.774740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.774764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:51.774788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896353939575003:4980], now have 1 active actors on pipe
2025-09-30T14:56:51.774798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896353939574711:2454], now have 1 active actors on pipe
2025-09-30T14:56:51.774804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896353849797562:10820]
2025-09-30T14:56:51.774807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896353849797562:10820]
2025-09-30T14:56:51.774809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896353849797562:10820]
2025-09-30T14:56:51.774823Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:51.774837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:51.774839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:51.774842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:51.774845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:51.774860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:51.774864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:51.774839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2365
2025-09-30T14:56:51.774895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896353849797562:10820]
2025-09-30T14:56:51.774850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2365
2025-09-30T14:56:51.774903Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:51.774905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:51.774935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:51.774944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:51.774979Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|714d136c-80c2868b-839c0c21-f82643f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:51.774990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:51.774994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:51.774996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:51.775006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:51.775016Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:51.775033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:51.775381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:51.775392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:51.775414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:51.775537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2366 partition: 0 MaxSeqNo: 42 sessionId: src_id|714d136c-80c2868b-839c0c21-f82643f7_0
2025-09-30T14:56:51.775916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a319c96-ddc1edf7-a2362fad-2f23d3c9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|714d136c-80c2868b-839c0c21-f82643f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:51.778707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|714d136c-80c2868b-839c0c21-f82643f7_0] Write session: try to update token
2025-09-30T14:56:51.778727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|714d136c-80c2868b-839c0c21-f82643f7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:51.787118Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:51.787141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:51.787144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:51.787146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:51.787157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896353849797562:10820]
2025-09-30T14:56:51.787162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896353849797562:10820]
2025-09-30T14:56:51.787166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896353849797562:10820]
2025-09-30T14:56:51.787205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:51.787214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.787217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:51.787216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:51.787223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:51.787226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:51.787377Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:51.794926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2366 sessionId: src_id|714d136c-80c2868b-839c0c21-f82643f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:51.797846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:51.846868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896353939575044:4281]
2025-09-30T14:56:51.847545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2365, pipe: [1:7555896353939575044:4281]
2025-09-30T14:56:51.900637Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:51.901072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:51.901084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:51.901100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896353939575044:4281], now have 1 active actors on pipe
2025-09-30T14:56:51.901278Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:51.901391Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:51.901398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:51.901455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896353939575044:4281]
2025-09-30T14:56:51.901481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2366 reason: status is not ok: tablet will be restarted right now sessionId: src_id|714d136c-80c2868b-839c0c21-f82643f7_0
2025-09-30T14:56:51.901665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2366 sessionId: src_id|714d136c-80c2868b-839c0c21-f82643f7_0 is DEAD
2025-09-30T14:56:51.901836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|714d136c-80c2868b-839c0c21-f82643f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:51.901857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|714d136c-80c2868b-839c0c21-f82643f7_0] Write session will restart in 0.006265s
2025-09-30T14:56:51.901883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|714d136c-80c2868b-839c0c21-f82643f7_0] Write session: Do CDS request
2025-09-30T14:56:51.901889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|714d136c-80c2868b-839c0c21-f82643f7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:51.909775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|714d136c-80c2868b-839c0c21-f82643f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:51.909808Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:51.909822Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2367
2025-09-30T14:56:51.910017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2367 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:51.910052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2367 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:51.910057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2367 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:51.910061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:51.910464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2367 sessionId:  describe result for acl check
2025-09-30T14:56:51.910500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:51.910506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:51.910508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:51.910513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896353939575190:4990] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:51.911064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896353939575190:4990] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:51.912858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896353939575190:4990] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:51.915650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896353939575190:4990] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:51.915665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896353939575190:4990] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:51.915670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896353939575190:4990] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:51.915678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2367 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:51.916078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:51.917426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:51.917613Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:51.917624Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:51.917634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:51.917693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:51.917740Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896353849797783:10822]
2025-09-30T14:56:51.918368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:51.918681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:51.918722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:51.919037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:51.919103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:51.919109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:51.919110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:51.919111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:51.919113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:51.919114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:51.919115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:51.919116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:51.919117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:51.919118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:51.919120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.919121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.919122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.919123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:51.919124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:51.919129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:51.919139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:51.919143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:51.919147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:51.919152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:51.919155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:51.919159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:51.919163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:51.919167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:51.919171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:51.919175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.919179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.919183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.919186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:51.919190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:51.919200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:51.919207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:51.919213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:51.919218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:51.919223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:51.919228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:51.919232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:51.919238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:51.919260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:51.919265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:51.919269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:51.919274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:51.919279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:51.919284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:51.919289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:51.919295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:51.919299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:51.919310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:51.919315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:51.919320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:51.919329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.919334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.919338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.919343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.919353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.919359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.919363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:51.919368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:51.919373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:51.919379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:51.919425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:51.924805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:51.925659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:51.925672Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:51.925674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:51.925677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:51.925683Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2366 [2:7555896353849797783:10822]
2025-09-30T14:56:51.925696Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:51.925713Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:51.925721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:51.925725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:51.925728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:51.925741Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:51.925746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:51.925756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:51.925803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.925809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.925811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.925813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:51.925815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:51.925993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:51.926000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.926008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:51.926016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:51.926027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:51.926047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896353939575045:2454], now have 1 active actors on pipe
2025-09-30T14:56:51.926056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896353939575365:4990], now have 1 active actors on pipe
2025-09-30T14:56:51.926062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896353849797778:10822]
2025-09-30T14:56:51.926064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896353849797778:10822]
2025-09-30T14:56:51.926066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896353849797778:10822]
2025-09-30T14:56:51.926034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2366
2025-09-30T14:56:51.926039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2366
2025-09-30T14:56:51.926074Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:51.926083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:51.926086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:51.926087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:51.926093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:51.926109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:51.926117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:51.926138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:51.926147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:51.926181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896353849797778:10822]
2025-09-30T14:56:51.926192Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:51.926206Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|beb17762-b0ae15d3-8a199913-384e27eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:51.926211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:51.926217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:51.926221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:51.926224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:51.926233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:51.926247Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:51.926286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:51.926430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:51.926438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:51.926451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:51.926549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2367 partition: 0 MaxSeqNo: 42 sessionId: src_id|beb17762-b0ae15d3-8a199913-384e27eb_0
2025-09-30T14:56:51.926911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|714d136c-80c2868b-839c0c21-f82643f7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|beb17762-b0ae15d3-8a199913-384e27eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:51.929801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|beb17762-b0ae15d3-8a199913-384e27eb_0] Write session: try to update token
2025-09-30T14:56:51.929819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|beb17762-b0ae15d3-8a199913-384e27eb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:51.938409Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:51.938431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:51.938433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:51.938436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:51.938447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896353849797778:10822]
2025-09-30T14:56:51.938453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896353849797778:10822]
2025-09-30T14:56:51.938457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896353849797778:10822]
2025-09-30T14:56:51.938498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:51.938497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:51.938504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:51.938508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:51.938513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:51.938517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:51.938691Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:51.944735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2367 sessionId: src_id|beb17762-b0ae15d3-8a199913-384e27eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:51.947427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:52.001480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896358234542676:4281]
2025-09-30T14:56:52.001779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2366, pipe: [1:7555896358234542676:4281]
2025-09-30T14:56:52.052968Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:52.053663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:52.053681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:52.053701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896358234542676:4281], now have 1 active actors on pipe
2025-09-30T14:56:52.053933Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:52.054012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896358234542676:4281]
2025-09-30T14:56:52.054013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:52.054018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:52.054043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:52.054084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2367 reason: error at write: Disconnected sessionId: src_id|beb17762-b0ae15d3-8a199913-384e27eb_0
2025-09-30T14:56:52.054263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2367 sessionId: src_id|beb17762-b0ae15d3-8a199913-384e27eb_0 is DEAD
2025-09-30T14:56:52.054539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beb17762-b0ae15d3-8a199913-384e27eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:52.054562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beb17762-b0ae15d3-8a199913-384e27eb_0] Write session will restart in 0.007736s
2025-09-30T14:56:52.054586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beb17762-b0ae15d3-8a199913-384e27eb_0] Write session: Do CDS request
2025-09-30T14:56:52.054596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beb17762-b0ae15d3-8a199913-384e27eb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:52.063692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|beb17762-b0ae15d3-8a199913-384e27eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:52.063817Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:52.063832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2368
2025-09-30T14:56:52.063960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2368 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:52.063988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2368 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:52.063997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2368 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:52.064002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:52.064503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2368 sessionId:  describe result for acl check
2025-09-30T14:56:52.064553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:52.064559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:52.064562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:52.064568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896358234542874:4998] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:52.065157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896358234542874:4998] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:52.067671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896358234542874:4998] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:52.068831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:52.070318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:52.070504Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:52.070516Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:52.070527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:52.070575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:52.070613Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896358144765285:10826]
2025-09-30T14:56:52.070626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896358234542874:4998] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:52.070641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896358234542874:4998] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:52.070645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896358234542874:4998] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:52.070654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2368 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:52.071298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:52.071693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:52.071761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:52.072145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:52.072219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:52.072226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:52.072227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:52.072229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:52.072230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:52.072231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:52.072232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:52.072234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:52.072235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:52.072236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:52.072237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.072238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.072240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.072241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:52.072242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:52.072248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:52.072259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:52.072263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:52.072267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:52.072271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:52.072275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:52.072278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:52.072282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:52.072285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:52.072288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:52.072292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.072295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.072298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.072302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:52.072305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:52.072313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:52.072321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:52.072326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:52.072332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:52.072336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:52.072340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:52.072345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:52.072350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:52.072355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:52.072361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:52.072365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:52.072377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:52.072382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:52.072392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:52.072397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:52.072406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:52.072412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:52.072417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:52.072421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:52.072426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:52.072430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.072435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.072439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.072444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.072448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.072458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.072462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:52.072466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:52.072470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:52.072475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:52.072527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:52.077977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:52.078835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:52.078852Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:52.078855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:52.078859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:52.078867Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2367 [2:7555896358144765285:10826]
2025-09-30T14:56:52.078884Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:52.078902Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:52.078905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:52.078908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:52.078910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:52.078927Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:52.078939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:52.078947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:52.079013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.079021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.079023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.079028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:52.079031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:52.079096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:52.079103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.079115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.079133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.079155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:52.079177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896358234542677:2454], now have 1 active actors on pipe
2025-09-30T14:56:52.079185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896358234543000:4998], now have 1 active actors on pipe
2025-09-30T14:56:52.079192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896358144765280:10826]
2025-09-30T14:56:52.079195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896358144765280:10826]
2025-09-30T14:56:52.079197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896358144765280:10826]
2025-09-30T14:56:52.079213Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:52.079231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:52.079232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:52.079236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:52.079238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:52.079268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:52.079272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:52.079307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896358144765280:10826]
2025-09-30T14:56:52.079315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:52.079318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:52.079269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2367
2025-09-30T14:56:52.079345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:52.079354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:52.079278Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2367
2025-09-30T14:56:52.079385Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed0dd8e1-7ed349f4-7451578c-288760ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:52.079396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:52.079400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:52.079403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:52.079412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:52.079424Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:52.079446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:52.079598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:52.079610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:52.079624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:52.079713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2368 partition: 0 MaxSeqNo: 42 sessionId: src_id|ed0dd8e1-7ed349f4-7451578c-288760ed_0
2025-09-30T14:56:52.080107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beb17762-b0ae15d3-8a199913-384e27eb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ed0dd8e1-7ed349f4-7451578c-288760ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:52.082902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed0dd8e1-7ed349f4-7451578c-288760ed_0] Write session: try to update token
2025-09-30T14:56:52.082919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed0dd8e1-7ed349f4-7451578c-288760ed_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:52.091381Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:52.091402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:52.091405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:52.091407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:52.091418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896358144765280:10826]
2025-09-30T14:56:52.091423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896358144765280:10826]
2025-09-30T14:56:52.091427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896358144765280:10826]
2025-09-30T14:56:52.091469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:52.091476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.091479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:52.091482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:52.091504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:52.091509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:52.091616Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:52.097954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2368 sessionId: src_id|ed0dd8e1-7ed349f4-7451578c-288760ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:52.100751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:52.154060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896358234543024:4281]
2025-09-30T14:56:52.154368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2367, pipe: [1:7555896358234543024:4281]
2025-09-30T14:56:52.211356Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:52.212097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:52.212113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:52.212153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896358234543024:4281], now have 1 active actors on pipe
2025-09-30T14:56:52.212399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:52.212425Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:52.212430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896358234543024:4281]
2025-09-30T14:56:52.212451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:52.212453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:52.212528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2368 reason: error at write: Disconnected sessionId: src_id|ed0dd8e1-7ed349f4-7451578c-288760ed_0
2025-09-30T14:56:52.212708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2368 sessionId: src_id|ed0dd8e1-7ed349f4-7451578c-288760ed_0 is DEAD
2025-09-30T14:56:52.212895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed0dd8e1-7ed349f4-7451578c-288760ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:52.212906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed0dd8e1-7ed349f4-7451578c-288760ed_0] Write session will restart in 0.009239s
2025-09-30T14:56:52.212928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed0dd8e1-7ed349f4-7451578c-288760ed_0] Write session: Do CDS request
2025-09-30T14:56:52.212937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed0dd8e1-7ed349f4-7451578c-288760ed_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:52.223767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed0dd8e1-7ed349f4-7451578c-288760ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:52.223879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:52.223892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2369
2025-09-30T14:56:52.224008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2369 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:52.224037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2369 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:52.224040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2369 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:52.224044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:52.224459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2369 sessionId:  describe result for acl check
2025-09-30T14:56:52.224499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:52.224507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:52.224510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:52.224516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896358234543184:5011] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:52.225120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896358234543184:5011] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:52.228942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896358234543184:5011] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:52.229550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:52.230897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:52.231098Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:52.231108Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:52.231118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:52.231168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:52.231210Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896358144765491:10828]
2025-09-30T14:56:52.231526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896358234543184:5011] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:52.231541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896358234543184:5011] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:52.231544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896358234543184:5011] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:52.231553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2369 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:52.231950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:52.232260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:52.232323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:52.232719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:52.232800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:52.232806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:52.232807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:52.232808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:52.232810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:52.232811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:52.232813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:52.232814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:52.232816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:52.232817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:52.232818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.232820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.232821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.232822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:52.232823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:52.232829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:52.232840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:52.232844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:52.232848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:52.232853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:52.232857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:52.232862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:52.232867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:52.232870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:52.232875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:52.232879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.232883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.232887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.232891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:52.232895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:52.232902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:52.232911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:52.232917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:52.232932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:52.232937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:52.232942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:52.232948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:52.232958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:52.232963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:52.232969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:52.232973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:52.232979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:52.232987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:52.232992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:52.233001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:52.233007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:52.233016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:52.233022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:52.233031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:52.233037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:52.233048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.233053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.233062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.233066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.233071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.233081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.233085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:52.233094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:52.233100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:52.233105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:52.233156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:52.238755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:52.239827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:52.239847Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:52.239850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:52.239854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:52.239863Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2368 [2:7555896358144765491:10828]
2025-09-30T14:56:52.239881Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:52.239899Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:52.239907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:52.239910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:52.239913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:52.239931Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:52.239944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:52.239956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:52.240025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.240033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.240036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.240039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:52.240042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:52.240123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:52.240131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.240145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.240160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.240184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:52.240208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896358234543030:2454], now have 1 active actors on pipe
2025-09-30T14:56:52.240216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896358234543354:5011], now have 1 active actors on pipe
2025-09-30T14:56:52.240224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896358144765486:10828]
2025-09-30T14:56:52.240231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896358144765486:10828]
2025-09-30T14:56:52.240234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896358144765486:10828]
2025-09-30T14:56:52.240248Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:52.240267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:52.240283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:52.240288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:52.240291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:52.240295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:52.240298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:52.240288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2368
2025-09-30T14:56:52.240289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2368
2025-09-30T14:56:52.240342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896358144765486:10828]
2025-09-30T14:56:52.240358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:52.240373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:52.240392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:52.240396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:52.240740Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c5c5f1c-ee04ae62-fe4c07e3-3bd74d45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:52.240753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:52.240757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:52.240760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:52.240769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:52.240784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:52.240816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:52.240996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:52.241010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:52.241035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:52.241146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2369 partition: 0 MaxSeqNo: 42 sessionId: src_id|8c5c5f1c-ee04ae62-fe4c07e3-3bd74d45_0
2025-09-30T14:56:52.241555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed0dd8e1-7ed349f4-7451578c-288760ed_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8c5c5f1c-ee04ae62-fe4c07e3-3bd74d45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:52.244480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c5c5f1c-ee04ae62-fe4c07e3-3bd74d45_0] Write session: try to update token
2025-09-30T14:56:52.244502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c5c5f1c-ee04ae62-fe4c07e3-3bd74d45_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:52.253434Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:52.253459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:52.253461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:52.253463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:52.253474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896358144765486:10828]
2025-09-30T14:56:52.253480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896358144765486:10828]
2025-09-30T14:56:52.253484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896358144765486:10828]
2025-09-30T14:56:52.253532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:52.253541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.253542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:52.253545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:52.253550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:52.253555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:52.253792Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:52.259918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2369 sessionId: src_id|8c5c5f1c-ee04ae62-fe4c07e3-3bd74d45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:52.262946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:52.312796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896358234543369:4281]
2025-09-30T14:56:52.313192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2368, pipe: [1:7555896358234543369:4281]
2025-09-30T14:56:52.373617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c5c5f1c-ee04ae62-fe4c07e3-3bd74d45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:52.373632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c5c5f1c-ee04ae62-fe4c07e3-3bd74d45_0] Write session will restart in 0.005181s
2025-09-30T14:56:52.373656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c5c5f1c-ee04ae62-fe4c07e3-3bd74d45_0] Write session: Do CDS request
2025-09-30T14:56:52.373662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c5c5f1c-ee04ae62-fe4c07e3-3bd74d45_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:52.373158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:52.373172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:52.373180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896358234543369:4281]
2025-09-30T14:56:52.373197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:52.373255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2369 reason: error at write: Disconnected sessionId: src_id|8c5c5f1c-ee04ae62-fe4c07e3-3bd74d45_0
2025-09-30T14:56:52.373436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2369 sessionId: src_id|8c5c5f1c-ee04ae62-fe4c07e3-3bd74d45_0 is DEAD
2025-09-30T14:56:52.372243Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:52.372787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:52.372796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:52.372816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896358234543369:4281], now have 1 active actors on pipe
2025-09-30T14:56:52.373211Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:52.382667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c5c5f1c-ee04ae62-fe4c07e3-3bd74d45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:52.382892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:52.382912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2370
2025-09-30T14:56:52.383057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2370 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:52.383102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2370 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:52.383108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2370 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:52.383113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:52.383610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2370 sessionId:  describe result for acl check
2025-09-30T14:56:52.383655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:52.383663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:52.383666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:52.383671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896358234543410:5038] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:52.384301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896358234543410:5038] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:52.386099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896358234543410:5038] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:52.388951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896358234543410:5038] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:52.388967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896358234543410:5038] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:52.388970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896358234543410:5038] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:52.388987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2370 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:52.405725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:52.407366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:52.407589Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:52.407600Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:52.407612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:52.407670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:52.407719Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896358144765736:10839]
2025-09-30T14:56:52.408425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:52.408792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:52.408838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:52.409176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:52.409362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:52.409370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:52.409372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:52.409373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:52.409374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:52.409376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:52.409377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:52.409379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:52.409381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:52.409382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:52.409384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.409385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.409387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.409388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:52.409389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:52.409396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:52.409408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:52.409413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:52.409418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:52.409423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:52.409427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:52.409432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:52.409437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:52.409441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:52.409448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:52.409452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.409456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.409461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.409466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:52.409471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:52.409482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:52.409492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:52.409499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:52.409505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:52.409517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:52.409524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:52.409534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:52.409540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:52.409547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:52.409554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:52.409563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:52.409570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:52.409576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:52.409583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:52.409591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:52.409596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:52.409601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:52.409610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:52.409615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:52.409620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:52.409629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.409635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.409644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.409650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.409660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.409665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.409674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:52.409681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:52.409686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:52.409696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:52.409744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:52.416769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:52.418866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:52.418888Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:52.418891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:52.418896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:52.418903Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2369 [2:7555896358144765736:10839]
2025-09-30T14:56:52.418921Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:52.418939Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:52.418943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:52.418946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:52.418949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:52.418966Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:52.418973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:52.418980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:52.419049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.419059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.419061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.419064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:52.419067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:52.419145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:52.419157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.419171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.419185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.419205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:52.419226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896358144765731:10839]
2025-09-30T14:56:52.419233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896358144765731:10839]
2025-09-30T14:56:52.419235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896358144765731:10839]
2025-09-30T14:56:52.419431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:52.419439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:52.419441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:52.419715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:52.419739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:52.419760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:52.419768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:52.419824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896358144765731:10839]
2025-09-30T14:56:52.419835Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:52.420207Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2369
2025-09-30T14:56:52.420266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2369
2025-09-30T14:56:52.419896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:52.420201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896358234543442:5038], now have 1 active actors on pipe
2025-09-30T14:56:52.420210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896358234543386:2454], now have 1 active actors on pipe
2025-09-30T14:56:52.420601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:52.420607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:52.420635Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae52e4ca-faeb7928-baf29930-1b375622_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:52.420652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:52.420657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:52.420660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:52.420677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:52.420691Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:52.420707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:52.421243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:52.421250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:52.421269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:52.421394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2370 partition: 0 MaxSeqNo: 42 sessionId: src_id|ae52e4ca-faeb7928-baf29930-1b375622_0
2025-09-30T14:56:52.423403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c5c5f1c-ee04ae62-fe4c07e3-3bd74d45_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ae52e4ca-faeb7928-baf29930-1b375622_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:52.426406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae52e4ca-faeb7928-baf29930-1b375622_0] Write session: try to update token
2025-09-30T14:56:52.426434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae52e4ca-faeb7928-baf29930-1b375622_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:52.438223Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:52.438247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:52.438250Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:52.438252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:52.438261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896358144765731:10839]
2025-09-30T14:56:52.438266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896358144765731:10839]
2025-09-30T14:56:52.438270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896358144765731:10839]
2025-09-30T14:56:52.438312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:52.438320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.438328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:52.438464Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:52.443474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:52.443496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:52.443501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:52.451296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2370 sessionId: src_id|ae52e4ca-faeb7928-baf29930-1b375622_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:52.454064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:52.473066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896358234543729:4281]
2025-09-30T14:56:52.473427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2369, pipe: [1:7555896358234543729:4281]
2025-09-30T14:56:52.563815Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:52.564157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:52.564174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:52.564214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896358234543729:4281], now have 1 active actors on pipe
2025-09-30T14:56:52.564506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:52.564510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:52.564520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:52.564567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896358234543729:4281]
2025-09-30T14:56:52.564594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2370 reason: error at write: Disconnected sessionId: src_id|ae52e4ca-faeb7928-baf29930-1b375622_0
2025-09-30T14:56:52.564910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae52e4ca-faeb7928-baf29930-1b375622_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:52.564923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae52e4ca-faeb7928-baf29930-1b375622_0] Write session will restart in 0.007546s
2025-09-30T14:56:52.564948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae52e4ca-faeb7928-baf29930-1b375622_0] Write session: Do CDS request
2025-09-30T14:56:52.564953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae52e4ca-faeb7928-baf29930-1b375622_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:52.564446Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:52.564761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2370 sessionId: src_id|ae52e4ca-faeb7928-baf29930-1b375622_0 is DEAD
2025-09-30T14:56:52.573795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae52e4ca-faeb7928-baf29930-1b375622_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:52.573907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:52.573922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2371
2025-09-30T14:56:52.574130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2371 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:52.574167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2371 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:52.574172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2371 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:52.574175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:52.574606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2371 sessionId:  describe result for acl check
2025-09-30T14:56:52.574640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:52.574648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:52.574650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:52.574656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896358234543818:5033] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:52.575214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896358234543818:5033] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:52.577170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896358234543818:5033] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:52.579870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896358234543818:5033] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:52.579884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896358234543818:5033] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:52.579888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896358234543818:5033] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:52.579898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2371 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:52.581594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:52.583885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:52.584137Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:52.584150Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:52.584164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:52.584227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:52.584270Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896358144765947:10845]
2025-09-30T14:56:52.584955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:52.585283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:52.585328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:52.585667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:52.585731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:52.585738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:52.585739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:52.585740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:52.585742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:52.585743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:52.585744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:52.585746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:52.585748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:52.585749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:52.585750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.585751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.585752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.585754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:52.585756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:52.585761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:52.585771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:52.585776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:52.585780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:52.585784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:52.585788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:52.585793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:52.585796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:52.585800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:52.585806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:52.585810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.585814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.585818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.585822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:52.585826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:52.585834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:52.585842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:52.585847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:52.585852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:52.585856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:52.585861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:52.585867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:52.585873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:52.585877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:52.585884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:52.585888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:52.585892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:52.585896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:52.585901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:52.585905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:52.585909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:52.585914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:52.585926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:52.585930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:52.585934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:52.585939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.585948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.585952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.585956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.585961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.585966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.585975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:52.585981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:52.585985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:52.585990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:52.586038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:52.591558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:52.592439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:52.592454Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:52.592457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:52.592461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:52.592468Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2370 [2:7555896358144765947:10845]
2025-09-30T14:56:52.592486Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:52.592507Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:52.592516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:52.592519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:52.592522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:52.592537Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:52.592545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:52.592552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:52.592616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.592624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.592627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.592630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:52.592633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:52.592718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:52.592726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.592738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.592754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.592772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:52.592799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896358234544054:5033], now have 1 active actors on pipe
2025-09-30T14:56:52.592808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896358234543731:2454], now have 1 active actors on pipe
2025-09-30T14:56:52.592815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896358144765942:10845]
2025-09-30T14:56:52.592817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896358144765942:10845]
2025-09-30T14:56:52.592819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896358144765942:10845]
2025-09-30T14:56:52.592830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:52.592845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:52.592852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:52.592856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:52.592864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:52.592867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:52.592868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:52.592902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896358144765942:10845]
2025-09-30T14:56:52.592915Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:52.592900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2370
2025-09-30T14:56:52.592904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2370
2025-09-30T14:56:52.592973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:52.593302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:52.593316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:52.593341Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|921bae39-def9404f-b42a72a1-531a80c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:52.593348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:52.593351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:52.593353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:52.593365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:52.593374Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:52.593391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:52.593564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:52.593575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:52.593590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:52.593678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2371 partition: 0 MaxSeqNo: 42 sessionId: src_id|921bae39-def9404f-b42a72a1-531a80c3_0
2025-09-30T14:56:52.594068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae52e4ca-faeb7928-baf29930-1b375622_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|921bae39-def9404f-b42a72a1-531a80c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:52.596901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|921bae39-def9404f-b42a72a1-531a80c3_0] Write session: try to update token
2025-09-30T14:56:52.596919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|921bae39-def9404f-b42a72a1-531a80c3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:52.605403Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:52.605422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:52.605424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:52.605426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:52.605435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896358144765942:10845]
2025-09-30T14:56:52.605441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896358144765942:10845]
2025-09-30T14:56:52.605445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896358144765942:10845]
2025-09-30T14:56:52.605488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:52.605496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.605498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:52.605510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:52.605518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:52.605523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:52.605634Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:52.613459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2371 sessionId: src_id|921bae39-def9404f-b42a72a1-531a80c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:52.616611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:52.666014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896358234544069:4281]
2025-09-30T14:56:52.666294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2370, pipe: [1:7555896358234544069:4281]
2025-09-30T14:56:52.721049Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:52.721401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:52.721415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:52.721435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896358234544069:4281], now have 1 active actors on pipe
2025-09-30T14:56:52.721678Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:52.722162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|921bae39-def9404f-b42a72a1-531a80c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:52.722184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|921bae39-def9404f-b42a72a1-531a80c3_0] Write session will restart in 0.009814s
2025-09-30T14:56:52.722208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|921bae39-def9404f-b42a72a1-531a80c3_0] Write session: Do CDS request
2025-09-30T14:56:52.722214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|921bae39-def9404f-b42a72a1-531a80c3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:52.721678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896358234544069:4281]
2025-09-30T14:56:52.721704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:52.721720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:52.721723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:52.721807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2371 reason: error at write: Disconnected sessionId: src_id|921bae39-def9404f-b42a72a1-531a80c3_0
2025-09-30T14:56:52.721997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2371 sessionId: src_id|921bae39-def9404f-b42a72a1-531a80c3_0 is DEAD
2025-09-30T14:56:52.734261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|921bae39-def9404f-b42a72a1-531a80c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:52.734611Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:52.734627Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2372
2025-09-30T14:56:52.734730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2372 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:52.734762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2372 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:52.734772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2372 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:52.734776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:52.735137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2372 sessionId:  describe result for acl check
2025-09-30T14:56:52.735162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:52.735163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:52.735165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:52.735169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896358234544125:5045] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:52.735703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896358234544125:5045] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:52.737529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896358234544125:5045] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:52.740617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896358234544125:5045] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:52.740631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896358234544125:5045] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:52.740634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896358234544125:5045] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:52.740642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2372 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:52.748461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:52.750675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:52.750933Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:52.750943Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:52.750955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:52.751011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:52.751056Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896358144766157:10847]
2025-09-30T14:56:52.751780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:52.752131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:52.752182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:52.752534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:52.752601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:52.752607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:52.752609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:52.752611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:52.752612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:52.752613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:52.752614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:52.752616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:52.752617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:52.752619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:52.752620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.752621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.752623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.752624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:52.752625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:52.752631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:52.752641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:52.752646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:52.752651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:52.752655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:52.752659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:52.752663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:52.752667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:52.752672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:52.752676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:52.752680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.752683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.752687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.752691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:52.752695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:52.752703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:52.752711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:52.752718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:52.752724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:52.752729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:52.752735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:52.752739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:52.752745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:52.752750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:52.752756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:52.752761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:52.752766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:52.752775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:52.752780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:52.752784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:52.752790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:52.752795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:52.752801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:52.752805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:52.752811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:52.752816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.752831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.752836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.752841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.752846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.752851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.752856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:52.752862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:52.752867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:52.752872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:52.752917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:52.758747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:52.760103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:52.760120Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:52.760122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:52.760126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:52.760134Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2371 [2:7555896358144766157:10847]
2025-09-30T14:56:52.760152Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:52.760169Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:52.760172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:52.760174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:52.760177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:52.760192Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:52.760200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:52.760208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:52.760269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.760281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.760283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.760286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:52.760289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:52.760357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:52.760365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.760379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.760391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.760406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:52.760426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896358234544307:5045], now have 1 active actors on pipe
2025-09-30T14:56:52.760435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896358234544072:2454], now have 1 active actors on pipe
2025-09-30T14:56:52.760442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896358144766152:10847]
2025-09-30T14:56:52.760444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896358144766152:10847]
2025-09-30T14:56:52.760446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896358144766152:10847]
2025-09-30T14:56:52.760455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:52.760465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:52.760469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:52.760469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:52.760471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:52.760484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:52.760487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:52.760525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896358144766152:10847]
2025-09-30T14:56:52.760537Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:52.760555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:52.763363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2371
2025-09-30T14:56:52.763408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2371
2025-09-30T14:56:52.763484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:52.763505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:52.763538Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b49eacb0-917b99dd-451dee56-bbb385d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:52.763555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:52.763565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:52.763568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:52.763583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:52.763599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:52.763633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:52.763871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:52.763884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:52.763916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:52.764057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2372 partition: 0 MaxSeqNo: 42 sessionId: src_id|b49eacb0-917b99dd-451dee56-bbb385d0_0
2025-09-30T14:56:52.764460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|921bae39-def9404f-b42a72a1-531a80c3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b49eacb0-917b99dd-451dee56-bbb385d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:52.767610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b49eacb0-917b99dd-451dee56-bbb385d0_0] Write session: try to update token
2025-09-30T14:56:52.767635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b49eacb0-917b99dd-451dee56-bbb385d0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:52.773117Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:52.773142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:52.773153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896358144766152:10847]
2025-09-30T14:56:52.773203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:52.773210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:52.773411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:52.773560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:52.773718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:52.773893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:52.774086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:52.774122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:52.789455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2372 sessionId: src_id|b49eacb0-917b99dd-451dee56-bbb385d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:52.791887Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:52.791910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:52.791913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:52.791916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:52.791928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896358144766152:10847]
2025-09-30T14:56:52.791932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896358144766152:10847]
2025-09-30T14:56:52.791938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896358144766152:10847]
2025-09-30T14:56:52.791987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:52.791996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.791999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:52.792011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:52.792024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:52.792029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:52.792152Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:52.792445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:52.821703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896358234544411:4281]
2025-09-30T14:56:52.822007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2371, pipe: [1:7555896358234544411:4281]
2025-09-30T14:56:52.912750Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:52.913387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:52.913399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:52.913420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896358234544411:4281], now have 1 active actors on pipe
2025-09-30T14:56:52.913704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:52.913718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:52.913762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896358234544411:4281]
2025-09-30T14:56:52.913783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2372 reason: error at write: Disconnected sessionId: src_id|b49eacb0-917b99dd-451dee56-bbb385d0_0
2025-09-30T14:56:52.913787Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:52.913941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2372 sessionId: src_id|b49eacb0-917b99dd-451dee56-bbb385d0_0 is DEAD
2025-09-30T14:56:52.914585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b49eacb0-917b99dd-451dee56-bbb385d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:52.914599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b49eacb0-917b99dd-451dee56-bbb385d0_0] Write session will restart in 0.009551s
2025-09-30T14:56:52.914622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b49eacb0-917b99dd-451dee56-bbb385d0_0] Write session: Do CDS request
2025-09-30T14:56:52.914628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b49eacb0-917b99dd-451dee56-bbb385d0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:52.913968Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:52.927779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b49eacb0-917b99dd-451dee56-bbb385d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:52.927894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:52.927909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2373
2025-09-30T14:56:52.928107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2373 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:52.928137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2373 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:52.928143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2373 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:52.928146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:52.928683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2373 sessionId:  describe result for acl check
2025-09-30T14:56:52.928712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:52.928714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:52.928715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:52.928722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896358234544501:5053] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:52.929255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896358234544501:5053] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:52.936248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896358234544501:5053] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:52.945349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896358234544501:5053] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:52.945370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896358234544501:5053] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:52.945373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896358234544501:5053] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:52.945383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2373 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:52.958569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:52.959286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:52.959487Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:52.959491Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:52.959502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:52.959557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:52.959597Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896358144766382:10850]
2025-09-30T14:56:52.960294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:52.960912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:52.960972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:52.961344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:52.961422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:52.961423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:52.961425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:52.961426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:52.961427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:52.961429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:52.961431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:52.961432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:52.961434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:52.961435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:52.961437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.961438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.961440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.961441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:52.961443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:52.961450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:52.961461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:52.961466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:52.961470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:52.961475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:52.961480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:52.961485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:52.961489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:52.961494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:52.961499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:52.961504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.961509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.961514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.961519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:52.961524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:52.961533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:52.961560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:52.961568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:52.961575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:52.961581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:52.961587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:52.961595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:52.961601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:52.961606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:52.961612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:52.961617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:52.961622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:52.961629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:52.961635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:52.961640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:52.961646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:52.961650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:52.961655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:52.961660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:52.961665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:52.961671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.961677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.961681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.961686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.961691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.961697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.961702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:52.961708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:52.961715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:52.961721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:52.961769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:52.969014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:52.969948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:52.969956Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:52.969959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:52.969963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:52.969971Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2372 [2:7555896358144766382:10850]
2025-09-30T14:56:52.969990Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:52.970007Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:52.970011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:52.970014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:52.970017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:52.970032Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:52.970040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:52.970048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:52.970115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.970117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.970120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.970124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:52.970127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:52.970467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:52.970471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.970487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:52.970502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:52.970523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:52.970541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896358144766377:10850]
2025-09-30T14:56:52.970545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896358144766377:10850]
2025-09-30T14:56:52.970549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896358144766377:10850]
2025-09-30T14:56:52.970570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:52.970585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:52.970601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:52.970605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:52.970642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896358144766377:10850]
2025-09-30T14:56:52.970646Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:52.971416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2372
2025-09-30T14:56:52.971465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2372
2025-09-30T14:56:52.971025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:52.971033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:52.971036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:52.971041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:52.975393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896358234544413:2454], now have 1 active actors on pipe
2025-09-30T14:56:52.975414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896358234544676:5053], now have 1 active actors on pipe
2025-09-30T14:56:52.975445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:52.975452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:52.975486Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e3f7a75-9fa8c85f-a72f8a37-fa5e1f09_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:52.975499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:52.975503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:52.975506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:52.975520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:52.975536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:52.975553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:52.975949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:52.975956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:52.975972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:52.977513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2373 partition: 0 MaxSeqNo: 42 sessionId: src_id|5e3f7a75-9fa8c85f-a72f8a37-fa5e1f09_0
2025-09-30T14:56:52.977892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b49eacb0-917b99dd-451dee56-bbb385d0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5e3f7a75-9fa8c85f-a72f8a37-fa5e1f09_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:52.980779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e3f7a75-9fa8c85f-a72f8a37-fa5e1f09_0] Write session: try to update token
2025-09-30T14:56:52.980802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e3f7a75-9fa8c85f-a72f8a37-fa5e1f09_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:52.988814Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:52.988838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:52.988841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:52.988843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:52.988853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896358144766377:10850]
2025-09-30T14:56:52.988857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896358144766377:10850]
2025-09-30T14:56:52.988863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896358144766377:10850]
2025-09-30T14:56:52.988911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:52.988918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:52.988929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:52.989084Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:52.991547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:52.991566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:52.991571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:53.013992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2373 sessionId: src_id|5e3f7a75-9fa8c85f-a72f8a37-fa5e1f09_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:53.015046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896362529512049:4281]
2025-09-30T14:56:53.016811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:53.017233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2372, pipe: [1:7555896362529512049:4281]
2025-09-30T14:56:53.122715Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:53.123362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:53.123377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:53.123398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896362529512049:4281], now have 1 active actors on pipe
2025-09-30T14:56:53.123619Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:53.123912Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:53.123969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896362529512049:4281]
2025-09-30T14:56:53.123998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:53.124083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2373 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5e3f7a75-9fa8c85f-a72f8a37-fa5e1f09_0
2025-09-30T14:56:53.124278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2373 sessionId: src_id|5e3f7a75-9fa8c85f-a72f8a37-fa5e1f09_0 is DEAD
2025-09-30T14:56:53.124415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e3f7a75-9fa8c85f-a72f8a37-fa5e1f09_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:53.124426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e3f7a75-9fa8c85f-a72f8a37-fa5e1f09_0] Write session will restart in 0.009331s
2025-09-30T14:56:53.124462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e3f7a75-9fa8c85f-a72f8a37-fa5e1f09_0] Write session: Do CDS request
2025-09-30T14:56:53.124467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e3f7a75-9fa8c85f-a72f8a37-fa5e1f09_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:53.135272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e3f7a75-9fa8c85f-a72f8a37-fa5e1f09_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:53.135388Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:53.135404Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2374
2025-09-30T14:56:53.135687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2374 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:53.135743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2374 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:53.135754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2374 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:53.135758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:53.136301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2374 sessionId:  describe result for acl check
2025-09-30T14:56:53.136337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:53.136339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:53.136341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:53.136348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896362529512100:5071] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:53.136924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896362529512100:5071] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:53.140084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896362529512100:5071] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:53.144252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896362529512100:5071] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:53.144270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896362529512100:5071] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:53.144274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896362529512100:5071] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:53.144283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2374 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:53.157111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:53.159045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:53.159311Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:53.159334Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:53.159348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:53.159415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:53.159460Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896362439733890:10853]
2025-09-30T14:56:53.160145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:53.160555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:53.160638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:53.161011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:53.161079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:53.161080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:53.161082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:53.161083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:53.161085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:53.161086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:53.161101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:53.161102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:53.161104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:53.161105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:53.161107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.161108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:53.161109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:53.161111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:53.161112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:53.161119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:53.161131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:53.161136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:53.161141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:53.161145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:53.161150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:53.161154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:53.161159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:53.161164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:53.161168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:53.161172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.161176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:53.161180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:53.161184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:53.161188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:53.161197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:53.161207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:53.161227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:53.161233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:53.161239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:53.161245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:53.161250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:53.161256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:53.161262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:53.161268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:53.161275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:53.161281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:53.161287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:53.161302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:53.161308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:53.161313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:53.161319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:53.161324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:53.161329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:53.161335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:53.161340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.161345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.161351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:53.161357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:53.161364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:53.161370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:53.161375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:53.161381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:53.161386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:53.161392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:53.161439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:53.167390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:53.168624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:53.168642Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:53.168645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:53.168649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:53.168657Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2373 [2:7555896362439733890:10853]
2025-09-30T14:56:53.168675Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:53.168691Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:53.168695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:53.168698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:53.168701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:53.168717Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:53.168724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:53.168740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:53.168800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.168808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:53.168811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:53.168814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:53.168817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:53.168891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:53.168902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.168916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:53.168929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:53.168947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:53.168971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896362529512066:2454], now have 1 active actors on pipe
2025-09-30T14:56:53.168981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896362529512201:5071], now have 1 active actors on pipe
2025-09-30T14:56:53.168989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896362439733885:10853]
2025-09-30T14:56:53.168995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896362439733885:10853]
2025-09-30T14:56:53.168998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896362439733885:10853]
2025-09-30T14:56:53.169014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:53.169033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:53.169039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:53.169043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:53.169046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:53.169053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:53.169056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:53.169093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896362439733885:10853]
2025-09-30T14:56:53.169104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:53.169115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:53.169135Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2373
2025-09-30T14:56:53.169180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2373
2025-09-30T14:56:53.169320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:53.169334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:53.169360Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|745cb6e4-18a3fa16-c2bc3922-9baa9acf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:53.169369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:53.169373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:53.169376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:53.169385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:53.169400Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:53.169419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:53.169649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:53.169657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:53.169671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:53.169790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2374 partition: 0 MaxSeqNo: 42 sessionId: src_id|745cb6e4-18a3fa16-c2bc3922-9baa9acf_0
2025-09-30T14:56:53.171363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e3f7a75-9fa8c85f-a72f8a37-fa5e1f09_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|745cb6e4-18a3fa16-c2bc3922-9baa9acf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:53.174232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|745cb6e4-18a3fa16-c2bc3922-9baa9acf_0] Write session: try to update token
2025-09-30T14:56:53.174257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|745cb6e4-18a3fa16-c2bc3922-9baa9acf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:53.181706Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:53.181736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:53.181751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896362439733885:10853]
2025-09-30T14:56:53.181814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:53.182143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:53.182402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:53.182646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:53.182844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:53.183198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:53.183292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:53.183399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:53.191124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2374 sessionId: src_id|745cb6e4-18a3fa16-c2bc3922-9baa9acf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:53.193790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:53.193817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:53.193820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:53.193822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:53.193833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896362439733885:10853]
2025-09-30T14:56:53.193837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896362439733885:10853]
2025-09-30T14:56:53.193842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896362439733885:10853]
2025-09-30T14:56:53.193887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:53.193895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.193895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:53.193897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:53.193904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:53.193908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:53.194070Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:53.194274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:53.224104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896362529512412:4281]
2025-09-30T14:56:53.228735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2373, pipe: [1:7555896362529512412:4281]
2025-09-30T14:56:53.315855Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:53.316306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:53.316324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:53.316345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896362529512412:4281], now have 1 active actors on pipe
2025-09-30T14:56:53.316691Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:53.320004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896362529512412:4281]
2025-09-30T14:56:53.320037Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:53.320078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:53.320158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2374 reason: status is not ok: tablet will be restarted right now sessionId: src_id|745cb6e4-18a3fa16-c2bc3922-9baa9acf_0
2025-09-30T14:56:53.320351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2374 sessionId: src_id|745cb6e4-18a3fa16-c2bc3922-9baa9acf_0 is DEAD
2025-09-30T14:56:53.321553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|745cb6e4-18a3fa16-c2bc3922-9baa9acf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:53.321563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|745cb6e4-18a3fa16-c2bc3922-9baa9acf_0] Write session will restart in 0.008679s
2025-09-30T14:56:53.321581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|745cb6e4-18a3fa16-c2bc3922-9baa9acf_0] Write session: Do CDS request
2025-09-30T14:56:53.321585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|745cb6e4-18a3fa16-c2bc3922-9baa9acf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:53.331613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|745cb6e4-18a3fa16-c2bc3922-9baa9acf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:53.333899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:53.333913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2375
2025-09-30T14:56:53.334112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2375 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:53.334141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2375 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:53.334146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2375 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:53.334150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:53.334698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2375 sessionId:  describe result for acl check
2025-09-30T14:56:53.334738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:53.334740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:53.334742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:53.334748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896362529512576:5078] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:53.335339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896362529512576:5078] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:53.337807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896362529512576:5078] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:53.342154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896362529512576:5078] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:53.342176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896362529512576:5078] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:53.342183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896362529512576:5078] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:53.342194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2375 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:53.344784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:53.346594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:53.346853Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:53.346871Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:53.346884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:53.346957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:53.347008Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896362439734103:10855]
2025-09-30T14:56:53.347737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:53.348152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:53.348211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:53.348547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:53.348601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:53.348607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:53.348608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:53.348609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:53.348609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:53.348610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:53.348611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:53.348612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:53.348613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:53.348614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:53.348615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.348616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:53.348617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:53.348617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:53.348618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:53.348623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:53.348630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:53.348633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:53.348636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:53.348638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:53.348640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:53.348643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:53.348646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:53.348648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:53.348651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:53.348654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.348656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:53.348659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:53.348661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:53.348664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:53.348680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:53.348686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:53.348692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:53.348698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:53.348703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:53.348709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:53.348713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:53.348719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:53.348724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:53.348730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:53.348735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:53.348738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:53.348741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:53.348744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:53.348747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:53.348750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:53.348753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:53.348758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:53.348763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:53.348768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:53.348773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.348779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.348784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:53.348790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:53.348794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:53.348798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:53.348803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:53.348805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:53.348811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:53.348814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:53.348837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:53.354832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:53.356006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:53.356026Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:53.356030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:53.356035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:53.356043Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2374 [2:7555896362439734103:10855]
2025-09-30T14:56:53.356077Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:53.356107Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:53.356115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:53.356119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:53.356123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:53.356138Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:53.356144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:53.356151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:53.356211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.356218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:53.356219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:53.356223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:53.356225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:53.356285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:53.356291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.356303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:53.356313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:53.356323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:53.356341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896362439734098:10855]
2025-09-30T14:56:53.356347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896362439734098:10855]
2025-09-30T14:56:53.356349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896362439734098:10855]
2025-09-30T14:56:53.356358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:53.356370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:53.356374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:53.356378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:53.356380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:53.356384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:53.356386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:53.356394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896362529512418:2454], now have 1 active actors on pipe
2025-09-30T14:56:53.356433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896362529512741:5078], now have 1 active actors on pipe
2025-09-30T14:56:53.356440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896362439734098:10855]
2025-09-30T14:56:53.356450Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:53.356475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:53.356550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2374
2025-09-30T14:56:53.356611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2374
2025-09-30T14:56:53.356873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:53.356881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:53.356905Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2b069a6-f9a4270e-7305fd40-396faf8a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:53.356912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:53.356915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:53.356918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:53.356931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:53.356943Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:53.356968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:53.357182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:53.357192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:53.357208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:53.357302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2375 partition: 0 MaxSeqNo: 42 sessionId: src_id|c2b069a6-f9a4270e-7305fd40-396faf8a_0
2025-09-30T14:56:53.357650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|745cb6e4-18a3fa16-c2bc3922-9baa9acf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c2b069a6-f9a4270e-7305fd40-396faf8a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:53.360566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b069a6-f9a4270e-7305fd40-396faf8a_0] Write session: try to update token
2025-09-30T14:56:53.360586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b069a6-f9a4270e-7305fd40-396faf8a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:53.371070Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:53.371096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:53.371099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:53.371101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:53.371112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896362439734098:10855]
2025-09-30T14:56:53.371118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896362439734098:10855]
2025-09-30T14:56:53.371126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896362439734098:10855]
2025-09-30T14:56:53.371173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:53.371180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.371183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:53.371366Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:53.371943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:53.371961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:53.371965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:53.378110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2375 sessionId: src_id|c2b069a6-f9a4270e-7305fd40-396faf8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:53.381142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:53.420214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896362529512772:4281]
2025-09-30T14:56:53.423823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2374, pipe: [1:7555896362529512772:4281]
2025-09-30T14:56:53.505694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896362529512772:4281]
2025-09-30T14:56:53.505736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:53.505740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:53.505857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2375 reason: error at write: Disconnected sessionId: src_id|c2b069a6-f9a4270e-7305fd40-396faf8a_0
2025-09-30T14:56:53.506050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:53.506086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2375 sessionId: src_id|c2b069a6-f9a4270e-7305fd40-396faf8a_0 is DEAD
2025-09-30T14:56:53.506726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b069a6-f9a4270e-7305fd40-396faf8a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:53.506740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b069a6-f9a4270e-7305fd40-396faf8a_0] Write session will restart in 0.009303s
2025-09-30T14:56:53.506765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b069a6-f9a4270e-7305fd40-396faf8a_0] Write session: Do CDS request
2025-09-30T14:56:53.506771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b069a6-f9a4270e-7305fd40-396faf8a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:53.504835Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:53.505364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:53.505375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:53.505396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896362529512772:4281], now have 1 active actors on pipe
2025-09-30T14:56:53.506622Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:53.518874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b069a6-f9a4270e-7305fd40-396faf8a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:53.518941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:53.518954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2376
2025-09-30T14:56:53.519139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2376 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:53.519167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2376 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:53.519174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2376 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:53.519178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:53.519548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2376 sessionId:  describe result for acl check
2025-09-30T14:56:53.519569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:53.519571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:53.519572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:53.519576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896362529512798:5108] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:53.520122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896362529512798:5108] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:53.525101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896362529512798:5108] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:53.527683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896362529512798:5108] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:53.527697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896362529512798:5108] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:53.527701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896362529512798:5108] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:53.527711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2376 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:53.538378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:53.540988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:53.541188Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:53.541191Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:53.541200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:53.541261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:53.541298Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896362439734355:10870]
2025-09-30T14:56:53.541953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:53.542435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:53.542489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:53.542854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:53.542913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:53.542915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:53.542917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:53.542918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:53.542919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:53.542921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:53.542922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:53.542924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:53.542925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:53.542926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:53.542928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.542930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:53.542931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:53.542932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:53.542934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:53.542940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:53.542951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:53.542955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:53.542960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:53.542965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:53.542969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:53.542974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:53.542978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:53.542983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:53.542988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:53.542992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.542996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:53.543001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:53.543178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:53.543188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:53.543198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:53.543207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:53.543214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:53.543220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:53.543225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:53.543232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:53.543237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:53.543326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:53.543337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:53.543343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:53.543349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:53.543354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:53.543360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:53.543367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:53.543372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:53.543378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:53.543383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:53.543389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:53.543394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:53.543400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:53.543406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.543412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.543418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:53.543423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:53.543429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:53.543435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:53.543440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:53.543447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:53.543453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:53.543459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:53.543510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:53.555849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:53.557277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:53.557286Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:53.557289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:53.557293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:53.557300Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2375 [2:7555896362439734355:10870]
2025-09-30T14:56:53.557319Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:53.557338Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:53.557343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:53.557346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:53.557349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:53.557367Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:53.557376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:53.557383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:53.557473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.557475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:53.557477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:53.557480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:53.557482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:53.557560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:53.557564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.557578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:53.557588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:53.557604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:53.557623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896362439734349:10870]
2025-09-30T14:56:53.557626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896362439734349:10870]
2025-09-30T14:56:53.557629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896362439734349:10870]
2025-09-30T14:56:53.557644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:53.557658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:53.557674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:53.557677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:53.557717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896362439734349:10870]
2025-09-30T14:56:53.557720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:53.559386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:53.559401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:53.559407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:53.559415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:53.559444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896362529512921:5108], now have 1 active actors on pipe
2025-09-30T14:56:53.559534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2375
2025-09-30T14:56:53.559580Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2375
2025-09-30T14:56:53.559454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896362529512784:2454], now have 1 active actors on pipe
2025-09-30T14:56:53.559683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:53.559699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:53.559747Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70efe2cb-7b210496-12623b0f-54de1237_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:53.559758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:53.559762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:53.559766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:53.559782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:53.559797Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:53.559818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:53.560363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:53.560369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:53.560402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:53.560784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2376 partition: 0 MaxSeqNo: 42 sessionId: src_id|70efe2cb-7b210496-12623b0f-54de1237_0
2025-09-30T14:56:53.561181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b069a6-f9a4270e-7305fd40-396faf8a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|70efe2cb-7b210496-12623b0f-54de1237_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:53.564244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70efe2cb-7b210496-12623b0f-54de1237_0] Write session: try to update token
2025-09-30T14:56:53.564265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70efe2cb-7b210496-12623b0f-54de1237_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:53.583559Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:53.583582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:53.583585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:53.583588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:53.583598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896362439734349:10870]
2025-09-30T14:56:53.583605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896362439734349:10870]
2025-09-30T14:56:53.583610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896362439734349:10870]
2025-09-30T14:56:53.583654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:53.583664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.583672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:53.583832Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:53.587635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:53.587652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:53.587657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:53.593181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2376 sessionId: src_id|70efe2cb-7b210496-12623b0f-54de1237_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:53.595971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:53.607580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896362529513126:4281]
2025-09-30T14:56:53.607995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2375, pipe: [1:7555896362529513126:4281]
2025-09-30T14:56:53.698676Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:53.699216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:53.699236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:53.699273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896362529513126:4281], now have 1 active actors on pipe
2025-09-30T14:56:53.699557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:53.699561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:53.699573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:53.699620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896362529513126:4281]
2025-09-30T14:56:53.699657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2376 reason: error at write: Disconnected sessionId: src_id|70efe2cb-7b210496-12623b0f-54de1237_0
2025-09-30T14:56:53.699848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2376 sessionId: src_id|70efe2cb-7b210496-12623b0f-54de1237_0 is DEAD
2025-09-30T14:56:53.699525Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:53.700212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70efe2cb-7b210496-12623b0f-54de1237_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:53.700224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70efe2cb-7b210496-12623b0f-54de1237_0] Write session will restart in 0.005496s
2025-09-30T14:56:53.700248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70efe2cb-7b210496-12623b0f-54de1237_0] Write session: Do CDS request
2025-09-30T14:56:53.700258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70efe2cb-7b210496-12623b0f-54de1237_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:53.706890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70efe2cb-7b210496-12623b0f-54de1237_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:53.706937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:53.706956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2377
2025-09-30T14:56:53.707134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2377 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:53.707181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2377 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:53.707192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2377 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:53.707196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:53.707747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2377 sessionId:  describe result for acl check
2025-09-30T14:56:53.707783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:53.707785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:53.707786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:53.707792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896362529513146:5117] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:53.708341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896362529513146:5117] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:53.710793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896362529513146:5117] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:53.714040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896362529513146:5117] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:53.714059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896362529513146:5117] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:53.714063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896362529513146:5117] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:53.714072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2377 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:53.724220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:53.726306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:53.726504Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:53.726512Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:53.726519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:53.726563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:53.726598Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896362439734572:10872]
2025-09-30T14:56:53.727080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:53.727461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:53.727529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:53.727832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:53.727898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:53.727905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:53.727906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:53.727907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:53.727908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:53.727910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:53.727911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:53.727912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:53.727914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:53.727915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:53.727916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.727918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:53.727919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:53.727920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:53.727921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:53.727928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:53.727939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:53.727942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:53.727946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:53.727949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:53.727953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:53.727957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:53.727960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:53.727964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:53.727968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:53.727971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.727974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:53.727978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:53.727982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:53.727985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:53.727994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:53.728002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:53.728008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:53.728013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:53.728018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:53.728023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:53.728027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:53.728034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:53.728039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:53.728044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:53.728048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:53.728054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:53.728059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:53.728064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:53.728071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:53.728075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:53.728080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:53.728084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:53.728088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:53.728093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:53.728098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.728104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.728109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:53.728115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:53.728119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:53.728135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:53.728141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:53.728150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:53.728157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:53.728161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:53.728201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:53.735753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:53.737280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:53.737299Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:53.737302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:53.737307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:53.737313Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2376 [2:7555896362439734572:10872]
2025-09-30T14:56:53.737332Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:53.737348Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:53.737352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:53.737355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:53.737358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:53.737375Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:53.737382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:53.737390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:53.737460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.737463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:53.737465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:53.737469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:53.737471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:53.737545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:53.737765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2376
2025-09-30T14:56:53.737555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.737569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:53.737791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2376
2025-09-30T14:56:53.737582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:53.737599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:53.737618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896362439734567:10872]
2025-09-30T14:56:53.737621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896362439734567:10872]
2025-09-30T14:56:53.737623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896362439734567:10872]
2025-09-30T14:56:53.737633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:53.737644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:53.737648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:53.737649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:53.737650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:53.737664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:53.737667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:53.737678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896362529513131:2454], now have 1 active actors on pipe
2025-09-30T14:56:53.737682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896362529513347:5117], now have 1 active actors on pipe
2025-09-30T14:56:53.737720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896362439734567:10872]
2025-09-30T14:56:53.737733Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:53.737744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:53.737991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:53.738006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:53.738034Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc1e37f6-4590069a-d3b31b13-3476ecac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:53.738047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:53.738052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:53.738055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:53.738078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:53.738090Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:53.738107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:53.739133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2377 partition: 0 MaxSeqNo: 42 sessionId: src_id|bc1e37f6-4590069a-d3b31b13-3476ecac_0
2025-09-30T14:56:53.738965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:53.738977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:53.738997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:53.739551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70efe2cb-7b210496-12623b0f-54de1237_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bc1e37f6-4590069a-d3b31b13-3476ecac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:53.742401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc1e37f6-4590069a-d3b31b13-3476ecac_0] Write session: try to update token
2025-09-30T14:56:53.742418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc1e37f6-4590069a-d3b31b13-3476ecac_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:53.750762Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:53.750783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:53.750786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:53.750789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:53.750799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896362439734567:10872]
2025-09-30T14:56:53.750805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896362439734567:10872]
2025-09-30T14:56:53.750809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896362439734567:10872]
2025-09-30T14:56:53.750854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:53.750870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.750875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:53.751036Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:53.755310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:53.755339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:53.755349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:53.759524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2377 sessionId: src_id|bc1e37f6-4590069a-d3b31b13-3476ecac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:53.762406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:53.799869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896362529513474:4281]
2025-09-30T14:56:53.800290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2376, pipe: [1:7555896362529513474:4281]
2025-09-30T14:56:53.872911Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:53.873269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:53.873284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:53.873304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896362529513474:4281], now have 1 active actors on pipe
2025-09-30T14:56:53.873535Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:53.873608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896362529513474:4281]
2025-09-30T14:56:53.873637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:53.873642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:53.873729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2377 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bc1e37f6-4590069a-d3b31b13-3476ecac_0
2025-09-30T14:56:53.873891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2377 sessionId: src_id|bc1e37f6-4590069a-d3b31b13-3476ecac_0 is DEAD
2025-09-30T14:56:53.875345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc1e37f6-4590069a-d3b31b13-3476ecac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:53.875359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc1e37f6-4590069a-d3b31b13-3476ecac_0] Write session will restart in 0.005307s
2025-09-30T14:56:53.875385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc1e37f6-4590069a-d3b31b13-3476ecac_0] Write session: Do CDS request
2025-09-30T14:56:53.875391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc1e37f6-4590069a-d3b31b13-3476ecac_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:53.883136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc1e37f6-4590069a-d3b31b13-3476ecac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:53.883512Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:53.883527Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2378
2025-09-30T14:56:53.883658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2378 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:53.883687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2378 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:53.883693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2378 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:53.883698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:53.884846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2378 sessionId:  describe result for acl check
2025-09-30T14:56:53.884875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:53.884876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:53.884878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:53.884882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896362529513499:5119] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:53.885362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896362529513499:5119] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:53.889969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896362529513499:5119] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:53.894234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896362529513499:5119] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:53.894253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896362529513499:5119] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:53.894258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896362529513499:5119] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:53.894268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2378 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:53.902415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:53.904823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:53.905039Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:53.905053Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:53.905064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:53.905117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:53.905163Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896362439734788:10874]
2025-09-30T14:56:53.905875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:53.906254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:53.906318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:53.906674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:53.906727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:53.906728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:53.906729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:53.906731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:53.906732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:53.906734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:53.906735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:53.906736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:53.906738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:53.906740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:53.906741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.906743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:53.906744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:53.906745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:53.906747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:53.906753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:53.906764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:53.906768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:53.906773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:53.906778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:53.906782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:53.906787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:53.906804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:53.906809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:53.906814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:53.906819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.906823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:53.906827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:53.906832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:53.906837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:53.906845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:53.906854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:53.906861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:53.906868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:53.906872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:53.906879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:53.906884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:53.906890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:53.906896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:53.906902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:53.906907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:53.906914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:53.906919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:53.906925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:53.906930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:53.906936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:53.906944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:53.906950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:53.906956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:53.906962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:53.906967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.906974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.906980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:53.906985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:53.906991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:53.906997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:53.907001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:53.907007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:53.907014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:53.907020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:53.907071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:53.913709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:53.915028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:53.915053Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:53.915056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:53.915060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:53.915066Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2377 [2:7555896362439734788:10874]
2025-09-30T14:56:53.915086Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:53.915100Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:53.915104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:53.915107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:53.915110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:53.915125Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:53.915142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:53.915149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:53.915209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.915219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:53.915221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:53.915224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:53.915227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:53.915316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:53.915324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.915337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:53.915348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:53.915371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:53.915394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896362439734783:10874]
2025-09-30T14:56:53.915401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896362439734783:10874]
2025-09-30T14:56:53.915404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896362439734783:10874]
2025-09-30T14:56:53.915413Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:53.915423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:53.915426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:53.915429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:53.915432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:53.915448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:53.915457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:53.915466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896362529513476:2454], now have 1 active actors on pipe
2025-09-30T14:56:53.915475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896362529513722:5119], now have 1 active actors on pipe
2025-09-30T14:56:53.915504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896362439734783:10874]
2025-09-30T14:56:53.915517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:53.915551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:53.916055Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2377
2025-09-30T14:56:53.916105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2377
2025-09-30T14:56:53.919963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:53.919983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:53.920014Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d61ec226-d8d1aa6-703cfa74-103a8c9c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:53.920024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:53.920028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:53.920031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:53.920043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:53.920057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:53.920072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:53.920583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:53.920609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:53.920633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:53.920852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2378 partition: 0 MaxSeqNo: 42 sessionId: src_id|d61ec226-d8d1aa6-703cfa74-103a8c9c_0
2025-09-30T14:56:53.921317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc1e37f6-4590069a-d3b31b13-3476ecac_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d61ec226-d8d1aa6-703cfa74-103a8c9c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:53.924290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d61ec226-d8d1aa6-703cfa74-103a8c9c_0] Write session: try to update token
2025-09-30T14:56:53.924316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d61ec226-d8d1aa6-703cfa74-103a8c9c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:53.938146Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:53.938176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:53.938191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896362439734783:10874]
2025-09-30T14:56:53.938241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:53.938551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:53.938716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:53.938800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:53.938867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:53.939062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:53.939593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:53.939653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:53.948668Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:53.948687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:53.948689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:53.948690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:53.948698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896362439734783:10874]
2025-09-30T14:56:53.948701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896362439734783:10874]
2025-09-30T14:56:53.948705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896362439734783:10874]
2025-09-30T14:56:53.948739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:53.948745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:53.948747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:53.948766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:53.948774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:53.948784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:53.948884Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:53.953461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2378 sessionId: src_id|d61ec226-d8d1aa6-703cfa74-103a8c9c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:53.956597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:53.973857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896362529513821:4281]
2025-09-30T14:56:53.974689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2377, pipe: [1:7555896362529513821:4281]
2025-09-30T14:56:54.066983Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:54.068231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:54.068251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:54.068273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896362529513821:4281], now have 1 active actors on pipe
2025-09-30T14:56:54.068734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:54.068749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896362529513821:4281]
2025-09-30T14:56:54.068779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:54.068782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:54.068569Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:54.068867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2378 reason: error at write: Disconnected sessionId: src_id|d61ec226-d8d1aa6-703cfa74-103a8c9c_0
2025-09-30T14:56:54.069070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2378 sessionId: src_id|d61ec226-d8d1aa6-703cfa74-103a8c9c_0 is DEAD
2025-09-30T14:56:54.071525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d61ec226-d8d1aa6-703cfa74-103a8c9c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:54.071539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d61ec226-d8d1aa6-703cfa74-103a8c9c_0] Write session will restart in 0.008715s
2025-09-30T14:56:54.071571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d61ec226-d8d1aa6-703cfa74-103a8c9c_0] Write session: Do CDS request
2025-09-30T14:56:54.071584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d61ec226-d8d1aa6-703cfa74-103a8c9c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:54.081880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d61ec226-d8d1aa6-703cfa74-103a8c9c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:54.082016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:54.082032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2379
2025-09-30T14:56:54.083454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2379 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:54.083509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2379 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:54.083536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2379 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:54.083544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:54.084384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2379 sessionId:  describe result for acl check
2025-09-30T14:56:54.084441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:54.084448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:54.084450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:54.084456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896366824481193:5129] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:54.085096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896366824481193:5129] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:54.087722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896366824481193:5129] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:54.090799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896366824481193:5129] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:54.090812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896366824481193:5129] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:54.090816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896366824481193:5129] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:54.090825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2379 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:54.095065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:54.096590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:54.096842Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:54.096850Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:54.096857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:54.096909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:54.096954Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896366734702315:10878]
2025-09-30T14:56:54.097472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:54.097764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:54.097798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:54.098056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:54.098117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:54.098124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:54.098125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:54.098125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:54.098126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:54.098127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:54.098128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:54.098129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:54.098129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:54.098130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:54.098131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.098131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:54.098133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:54.098133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:54.098134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:54.098138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:54.098145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:54.098147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:54.098150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:54.098152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:54.098155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:54.098158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:54.098160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:54.098163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:54.098165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:54.098168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.098170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:54.098173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:54.098177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:54.098182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:54.098192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:54.098201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:54.098207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:54.098213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:54.098217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:54.098222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:54.098225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:54.098228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:54.098231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:54.098235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:54.098237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:54.098240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:54.098243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:54.098246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:54.098249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:54.098252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:54.098255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:54.098258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:54.098260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:54.098265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:54.098268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.098271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.098274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:54.098277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:54.098279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:54.098282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:54.098285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:54.098289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:54.098292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:54.098294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:54.098320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:54.103880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:54.105461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:54.105474Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:54.105476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:54.105481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:54.105488Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2378 [2:7555896366734702315:10878]
2025-09-30T14:56:54.105505Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:54.105522Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:54.105526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:54.105529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:54.105531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:54.105547Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:54.105554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:54.105561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:54.105629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.105642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:54.105644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:54.105648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:54.105651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:54.105724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:54.105732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.105747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:54.105764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:54.105786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:54.105813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896366824481396:5129], now have 1 active actors on pipe
2025-09-30T14:56:54.105820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896366824481120:2454], now have 1 active actors on pipe
2025-09-30T14:56:54.105826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896366734702310:10878]
2025-09-30T14:56:54.105828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896366734702310:10878]
2025-09-30T14:56:54.105831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896366734702310:10878]
2025-09-30T14:56:54.105844Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:54.105863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:54.105866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:54.105869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:54.105871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:54.105881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:54.105884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:54.105874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2378
2025-09-30T14:56:54.105885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2378
2025-09-30T14:56:54.105926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896366734702310:10878]
2025-09-30T14:56:54.105941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:54.105960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:54.106165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:54.106181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:54.106221Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc4032c9-2b6f33ce-ec24183e-d9d060ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:54.106237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:54.106242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:54.106244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:54.106254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:54.106265Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:54.106282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:54.106463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:54.106474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:54.106493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:54.106590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2379 partition: 0 MaxSeqNo: 42 sessionId: src_id|dc4032c9-2b6f33ce-ec24183e-d9d060ba_0
2025-09-30T14:56:54.106967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d61ec226-d8d1aa6-703cfa74-103a8c9c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dc4032c9-2b6f33ce-ec24183e-d9d060ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:54.113095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc4032c9-2b6f33ce-ec24183e-d9d060ba_0] Write session: try to update token
2025-09-30T14:56:54.113123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc4032c9-2b6f33ce-ec24183e-d9d060ba_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:54.123683Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:54.123702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:54.123705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:54.123707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:54.123717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896366734702310:10878]
2025-09-30T14:56:54.123721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896366734702310:10878]
2025-09-30T14:56:54.123726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896366734702310:10878]
2025-09-30T14:56:54.123769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:54.123776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.123778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:54.124200Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:54.127332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:54.127341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:54.127347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:54.134378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2379 sessionId: src_id|dc4032c9-2b6f33ce-ec24183e-d9d060ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:54.137340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:54.166742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896366824481480:4281]
2025-09-30T14:56:54.167051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2378, pipe: [1:7555896366824481480:4281]
2025-09-30T14:56:54.238119Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:54.238422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:54.238435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:54.238455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896366824481480:4281], now have 1 active actors on pipe
2025-09-30T14:56:54.238809Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:54.238835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896366824481480:4281]
2025-09-30T14:56:54.238864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:54.238874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:54.238879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:54.238939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2379 reason: error at write: Disconnected sessionId: src_id|dc4032c9-2b6f33ce-ec24183e-d9d060ba_0
2025-09-30T14:56:54.239121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2379 sessionId: src_id|dc4032c9-2b6f33ce-ec24183e-d9d060ba_0 is DEAD
2025-09-30T14:56:54.239559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc4032c9-2b6f33ce-ec24183e-d9d060ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:54.239569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc4032c9-2b6f33ce-ec24183e-d9d060ba_0] Write session will restart in 0.006703s
2025-09-30T14:56:54.239595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc4032c9-2b6f33ce-ec24183e-d9d060ba_0] Write session: Do CDS request
2025-09-30T14:56:54.239604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc4032c9-2b6f33ce-ec24183e-d9d060ba_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:54.247716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc4032c9-2b6f33ce-ec24183e-d9d060ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:54.248002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:54.248016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2380
2025-09-30T14:56:54.248160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2380 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:54.248187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2380 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:54.248191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2380 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:54.248194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:54.250510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2380 sessionId:  describe result for acl check
2025-09-30T14:56:54.250556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:54.250559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:54.250563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:54.250569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896366824481574:5137] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:54.251125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896366824481574:5137] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:54.255464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896366824481574:5137] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:54.260252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896366824481574:5137] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:54.260274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896366824481574:5137] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:54.260278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896366824481574:5137] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:54.260288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2380 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:54.265094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:54.267130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:54.267427Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:54.267439Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:54.267451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:54.267514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:54.267556Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896366734702533:10880]
2025-09-30T14:56:54.268253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:54.268614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:54.268673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:54.269051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:54.269120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:54.269129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:54.269130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:54.269131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:54.269132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:54.269133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:54.269134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:54.269134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:54.269136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:54.269137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:54.269138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.269138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:54.269139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:54.269140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:54.269141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:54.269145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:54.269152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:54.269155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:54.269158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:54.269160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:54.269163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:54.269165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:54.269168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:54.269170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:54.269173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:54.269176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.269178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:54.269181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:54.269183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:54.269185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:54.269194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:54.269199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:54.269203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:54.269222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:54.269230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:54.269235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:54.269240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:54.269245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:54.269250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:54.269255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:54.269260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:54.269265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:54.269270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:54.269275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:54.269280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:54.269286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:54.269292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:54.269297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:54.269299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:54.269302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:54.269306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.269311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.269313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:54.269316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:54.269320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:54.269323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:54.269326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:54.269329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:54.269332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:54.269335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:54.269363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:54.275586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:54.276923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:54.276938Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:54.276941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:54.276945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:54.276953Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2379 [2:7555896366734702533:10880]
2025-09-30T14:56:54.276973Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:54.276993Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:54.276997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:54.277000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:54.277003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:54.277021Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:54.277034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:54.277043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:54.277120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.277129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:54.277131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:54.277135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:54.277137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:54.277236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:54.277246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.277262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:54.277281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:54.277306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:54.277331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896366824481770:5137], now have 1 active actors on pipe
2025-09-30T14:56:54.277340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896366824481486:2454], now have 1 active actors on pipe
2025-09-30T14:56:54.277347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896366734702528:10880]
2025-09-30T14:56:54.277350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896366734702528:10880]
2025-09-30T14:56:54.277353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896366734702528:10880]
2025-09-30T14:56:54.277369Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:54.277382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:54.277385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:54.277388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:54.277388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:54.277403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2379
2025-09-30T14:56:54.277407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2379
2025-09-30T14:56:54.277406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:54.277414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:54.277456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896366734702528:10880]
2025-09-30T14:56:54.277466Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:54.277481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:54.277490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:54.277495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:54.277551Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|447511db-9b9b37dc-eeacd671-ab401ba9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:54.277563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:54.277568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:54.277573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:54.277585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:54.277600Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:54.277626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:54.277799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:54.277822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:54.277850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:54.277944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2380 partition: 0 MaxSeqNo: 42 sessionId: src_id|447511db-9b9b37dc-eeacd671-ab401ba9_0
2025-09-30T14:56:54.278373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc4032c9-2b6f33ce-ec24183e-d9d060ba_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|447511db-9b9b37dc-eeacd671-ab401ba9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:54.281317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|447511db-9b9b37dc-eeacd671-ab401ba9_0] Write session: try to update token
2025-09-30T14:56:54.281341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|447511db-9b9b37dc-eeacd671-ab401ba9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:54.289950Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:54.289971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:54.289974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:54.289976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:54.289989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896366734702528:10880]
2025-09-30T14:56:54.289994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896366734702528:10880]
2025-09-30T14:56:54.289998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896366734702528:10880]
2025-09-30T14:56:54.290038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:54.290045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.290048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:54.290093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:54.290112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:54.290116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:54.290198Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:54.303310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2380 sessionId: src_id|447511db-9b9b37dc-eeacd671-ab401ba9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:54.306275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:54.338778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896366824481837:4281]
2025-09-30T14:56:54.339068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2379, pipe: [1:7555896366824481837:4281]
2025-09-30T14:56:54.408595Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:54.409091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:54.409100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:54.409118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896366824481837:4281], now have 1 active actors on pipe
2025-09-30T14:56:54.409446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:54.409455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896366824481837:4281]
2025-09-30T14:56:54.409480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:54.409483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:54.409552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2380 reason: error at write: Disconnected sessionId: src_id|447511db-9b9b37dc-eeacd671-ab401ba9_0
2025-09-30T14:56:54.409728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2380 sessionId: src_id|447511db-9b9b37dc-eeacd671-ab401ba9_0 is DEAD
2025-09-30T14:56:54.411396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|447511db-9b9b37dc-eeacd671-ab401ba9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:54.411419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|447511db-9b9b37dc-eeacd671-ab401ba9_0] Write session will restart in 0.009334s
2025-09-30T14:56:54.411451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|447511db-9b9b37dc-eeacd671-ab401ba9_0] Write session: Do CDS request
2025-09-30T14:56:54.411458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|447511db-9b9b37dc-eeacd671-ab401ba9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:54.415504Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:54.421839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|447511db-9b9b37dc-eeacd671-ab401ba9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:54.422016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:54.422041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2381
2025-09-30T14:56:54.422450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2381 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:54.422497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2381 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:54.422509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2381 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:54.422513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:54.423025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2381 sessionId:  describe result for acl check
2025-09-30T14:56:54.423061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:54.423070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:54.423072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:54.423081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896366824481864:5142] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:54.423697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896366824481864:5142] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:54.428819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896366824481864:5142] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:54.433528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896366824481864:5142] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:54.433545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896366824481864:5142] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:54.433550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896366824481864:5142] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:54.433559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2381 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:54.443857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:54.446662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:54.446920Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:54.446933Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:54.446948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:54.447029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:54.447077Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896366734702765:10882]
2025-09-30T14:56:54.447799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:54.448251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:54.448304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:54.448648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:54.448707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:54.448709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:54.448710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:54.448711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:54.448713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:54.448714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:54.448716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:54.448718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:54.448719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:54.448720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:54.448722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.448723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:54.448724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:54.448725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:54.448727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:54.448732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:54.448742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:54.448747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:54.448752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:54.448756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:54.448761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:54.448764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:54.448768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:54.448772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:54.448777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:54.448780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.448784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:54.448788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:54.448792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:54.448796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:54.448803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:54.448812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:54.448819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:54.448824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:54.448830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:54.448836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:54.448840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:54.448846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:54.448853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:54.448859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:54.448864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:54.448869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:54.448875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:54.448881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:54.448886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:54.448891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:54.448896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:54.448901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:54.448906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:54.448912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:54.448916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.448922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.448927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:54.448932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:54.448937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:54.448942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:54.448946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:54.448952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:54.448957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:54.448962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:54.449006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:54.458649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|447511db-9b9b37dc-eeacd671-ab401ba9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1feec2f3-4be91d7b-619fd721-ddeac7a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:54.456866Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2380
2025-09-30T14:56:54.456911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2380
2025-09-30T14:56:54.457935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2381 partition: 0 MaxSeqNo: 42 sessionId: src_id|1feec2f3-4be91d7b-619fd721-ddeac7a5_0
2025-09-30T14:56:54.455392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:54.456355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:54.456359Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:54.456362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:54.456365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:54.456371Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2380 [2:7555896366734702765:10882]
2025-09-30T14:56:54.456384Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:54.456397Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:54.456400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:54.456403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:54.456406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:54.456423Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:54.456431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:54.456439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:54.456489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.456491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:54.456493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:54.456496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:54.456498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:54.456570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:54.456573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.456585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:54.456595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:54.456609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:54.456626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896366734702759:10882]
2025-09-30T14:56:54.456628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896366734702759:10882]
2025-09-30T14:56:54.456631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896366734702759:10882]
2025-09-30T14:56:54.456639Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:54.456653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:54.456667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:54.456670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:54.456671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:54.456674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:54.456676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:54.456714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896366824481838:2454], now have 1 active actors on pipe
2025-09-30T14:56:54.456717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896366734702759:10882]
2025-09-30T14:56:54.456725Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:54.456731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896366824482078:5142], now have 1 active actors on pipe
2025-09-30T14:56:54.457020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:54.457246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:54.457254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:54.457289Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1feec2f3-4be91d7b-619fd721-ddeac7a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:54.457298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:54.457302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:54.457305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:54.457316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:54.457328Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:54.457346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:54.457577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:54.457582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:54.457607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:54.461587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1feec2f3-4be91d7b-619fd721-ddeac7a5_0] Write session: try to update token
2025-09-30T14:56:54.461608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1feec2f3-4be91d7b-619fd721-ddeac7a5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:54.470979Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:54.470999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:54.471002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:54.471004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:54.471012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896366734702759:10882]
2025-09-30T14:56:54.471016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896366734702759:10882]
2025-09-30T14:56:54.471021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896366734702759:10882]
2025-09-30T14:56:54.471062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:54.471070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.471072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:54.471221Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:54.471311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:54.471327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:54.471332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:54.482761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2381 sessionId: src_id|1feec2f3-4be91d7b-619fd721-ddeac7a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:54.485666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:54.509774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896366824482209:4281]
2025-09-30T14:56:54.510066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2380, pipe: [1:7555896366824482209:4281]
2025-09-30T14:56:54.604423Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:54.604811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:54.604832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:54.604855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896366824482209:4281], now have 1 active actors on pipe
2025-09-30T14:56:54.605069Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:54.605111Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:54.605140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:54.605148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:54.605170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896366824482209:4281]
2025-09-30T14:56:54.605230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2381 reason: error at write: Disconnected sessionId: src_id|1feec2f3-4be91d7b-619fd721-ddeac7a5_0
2025-09-30T14:56:54.605560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1feec2f3-4be91d7b-619fd721-ddeac7a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:54.605571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1feec2f3-4be91d7b-619fd721-ddeac7a5_0] Write session will restart in 0.008245s
2025-09-30T14:56:54.605600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1feec2f3-4be91d7b-619fd721-ddeac7a5_0] Write session: Do CDS request
2025-09-30T14:56:54.605607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1feec2f3-4be91d7b-619fd721-ddeac7a5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:54.605404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2381 sessionId: src_id|1feec2f3-4be91d7b-619fd721-ddeac7a5_0 is DEAD
2025-09-30T14:56:54.614828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1feec2f3-4be91d7b-619fd721-ddeac7a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:54.614910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:54.614925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2382
2025-09-30T14:56:54.615132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2382 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:54.615167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2382 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:54.615172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2382 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:54.615177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:54.615675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2382 sessionId:  describe result for acl check
2025-09-30T14:56:54.615709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:54.615715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:54.615718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:54.615724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896366824482294:5166] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:54.616278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896366824482294:5166] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:54.618871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896366824482294:5166] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:54.622143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896366824482294:5166] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:54.622161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896366824482294:5166] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:54.622164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896366824482294:5166] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:54.622174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2382 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:54.625334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:54.629505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:54.629765Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:54.629770Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:54.629782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:54.629857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:54.629898Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896366734703010:10897]
2025-09-30T14:56:54.630587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:54.630995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:54.631067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:54.631474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:54.631549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:54.631557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:54.631559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:54.631560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:54.631561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:54.631563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:54.631564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:54.631565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:54.631567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:54.631568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:54.631570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.631571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:54.631573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:54.631574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:54.631575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:54.631582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:54.631603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:54.631608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:54.631612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:54.631617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:54.631621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:54.631625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:54.631629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:54.631634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:54.631639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:54.631644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.631647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:54.631651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:54.631655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:54.631660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:54.631671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:54.631680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:54.631687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:54.631693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:54.631699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:54.631705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:54.631710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:54.631717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:54.631723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:54.631729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:54.631735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:54.631741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:54.631747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:54.631753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:54.631758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:54.631765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:54.631770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:54.631776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:54.631781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:54.631788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:54.631793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.631800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.631804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:54.631812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:54.631818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:54.631825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:54.631831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:54.631837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:54.631842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:54.631848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:54.631902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:54.639325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2381
2025-09-30T14:56:54.639385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2381
2025-09-30T14:56:54.637740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:54.638810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:54.638818Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:54.638821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:54.638827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:54.638835Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2381 [2:7555896366734703010:10897]
2025-09-30T14:56:54.638855Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:54.638874Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:54.638878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:54.638882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:54.638884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:54.638903Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:54.638911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:54.638918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:54.638997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.638999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:54.639001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:54.639005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:54.639008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:54.639100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:54.639103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.639118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:54.639128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:54.639145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:54.639165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896366734703005:10897]
2025-09-30T14:56:54.639168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896366734703005:10897]
2025-09-30T14:56:54.639171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896366734703005:10897]
2025-09-30T14:56:54.639184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:54.639196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:54.639200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:54.639202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:54.639203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:54.639219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:54.639224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:54.639236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896366824482211:2454], now have 1 active actors on pipe
2025-09-30T14:56:54.639304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896366824482514:5166], now have 1 active actors on pipe
2025-09-30T14:56:54.639351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896366734703005:10897]
2025-09-30T14:56:54.639371Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:54.639459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:54.639746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:54.639767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:54.639798Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28196cd5-f3981e5-1d602628-17b8da4a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:54.639820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:54.639824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:54.639827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:54.639840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:54.639860Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:54.639884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:54.640195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:54.640210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:54.640232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:54.640886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1feec2f3-4be91d7b-619fd721-ddeac7a5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|28196cd5-f3981e5-1d602628-17b8da4a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:54.640412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2382 partition: 0 MaxSeqNo: 42 sessionId: src_id|28196cd5-f3981e5-1d602628-17b8da4a_0
2025-09-30T14:56:54.643899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28196cd5-f3981e5-1d602628-17b8da4a_0] Write session: try to update token
2025-09-30T14:56:54.643924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28196cd5-f3981e5-1d602628-17b8da4a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:54.655066Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:54.655087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:54.655098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896366734703005:10897]
2025-09-30T14:56:54.655147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:54.655367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:54.655579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:54.655795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:54.655930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:54.656118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:54.656161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:54.656305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:54.668716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2382 sessionId: src_id|28196cd5-f3981e5-1d602628-17b8da4a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:54.670714Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:54.670737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:54.670740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:54.670742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:54.670754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896366734703005:10897]
2025-09-30T14:56:54.670758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896366734703005:10897]
2025-09-30T14:56:54.670766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896366734703005:10897]
2025-09-30T14:56:54.670806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:54.670813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.670816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:54.670824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:54.670831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:54.670836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:54.670966Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:54.671569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:54.707320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896366824482562:4281]
2025-09-30T14:56:54.707737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2381, pipe: [1:7555896366824482562:4281]
2025-09-30T14:56:54.786684Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:54.787169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:54.787187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:54.787208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896366824482562:4281], now have 1 active actors on pipe
2025-09-30T14:56:54.787851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896366824482562:4281]
2025-09-30T14:56:54.787895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:54.787898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:54.787956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2382 reason: error at write: Disconnected sessionId: src_id|28196cd5-f3981e5-1d602628-17b8da4a_0
2025-09-30T14:56:54.788123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2382 sessionId: src_id|28196cd5-f3981e5-1d602628-17b8da4a_0 is DEAD
2025-09-30T14:56:54.787577Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:54.788296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:54.788417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28196cd5-f3981e5-1d602628-17b8da4a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:54.788428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28196cd5-f3981e5-1d602628-17b8da4a_0] Write session will restart in 0.005755s
2025-09-30T14:56:54.788453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28196cd5-f3981e5-1d602628-17b8da4a_0] Write session: Do CDS request
2025-09-30T14:56:54.788461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28196cd5-f3981e5-1d602628-17b8da4a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:54.795792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28196cd5-f3981e5-1d602628-17b8da4a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:54.795859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:54.795878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2383
2025-09-30T14:56:54.796162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2383 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:54.796218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2383 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:54.796229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2383 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:54.796233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:54.796716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2383 sessionId:  describe result for acl check
2025-09-30T14:56:54.796754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:54.796761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:54.796763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:54.796769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896366824482594:5181] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:54.797368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896366824482594:5181] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:54.799487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896366824482594:5181] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:54.802371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896366824482594:5181] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:54.802389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896366824482594:5181] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:54.802393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896366824482594:5181] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:54.802402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2383 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:54.815989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:54.818376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:54.818619Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:54.818630Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:54.818641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:54.818699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:54.818747Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896366734703231:10899]
2025-09-30T14:56:54.819459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:54.819911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:54.819971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:54.820361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:54.820432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:54.820438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:54.820440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:54.820441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:54.820442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:54.820443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:54.820445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:54.820447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:54.820448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:54.820450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:54.820451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.820452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:54.820453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:54.820455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:54.820456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:54.820462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:54.820473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:54.820478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:54.820482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:54.820487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:54.820491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:54.820495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:54.820499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:54.820503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:54.820508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:54.820512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.820516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:54.820520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:54.820524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:54.820528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:54.820536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:54.820545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:54.820552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:54.820557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:54.820563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:54.820568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:54.820573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:54.820579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:54.820584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:54.820589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:54.820594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:54.820602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:54.820607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:54.820612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:54.820617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:54.820622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:54.820628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:54.820634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:54.820638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:54.820644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:54.820649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.820655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.820660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:54.820666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:54.820671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:54.820677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:54.820682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:54.820689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:54.820719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:54.820729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:54.820777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:54.830034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2382
2025-09-30T14:56:54.830072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2382
2025-09-30T14:56:54.827558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:54.828916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:54.828924Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:54.828926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:54.828931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:54.828940Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2382 [2:7555896366734703231:10899]
2025-09-30T14:56:54.828959Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:54.828977Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:54.828982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:54.828985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:54.828988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:54.829005Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:54.829013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:54.831042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2383 partition: 0 MaxSeqNo: 42 sessionId: src_id|7733935-592171f8-74f63e93-3241c53e_0
2025-09-30T14:56:54.829021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:54.829095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.829097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:54.829098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:54.829103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:54.829105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:54.829189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:54.829191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.829218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:54.829230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:54.829247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:54.829266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896366734703226:10899]
2025-09-30T14:56:54.829268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896366734703226:10899]
2025-09-30T14:56:54.829271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896366734703226:10899]
2025-09-30T14:56:54.829283Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:54.829298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:54.829308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:54.829312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:54.829313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:54.829315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:54.829316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:54.829365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896366824482564:2454], now have 1 active actors on pipe
2025-09-30T14:56:54.829370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896366824482771:5181], now have 1 active actors on pipe
2025-09-30T14:56:54.829373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896366734703226:10899]
2025-09-30T14:56:54.829385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:54.829391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:54.830392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:54.830401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:54.830432Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7733935-592171f8-74f63e93-3241c53e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:54.830442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:54.830446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:54.830449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:54.830462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:54.830476Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:54.830491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:54.830739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:54.830743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:54.830760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:54.833474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28196cd5-f3981e5-1d602628-17b8da4a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7733935-592171f8-74f63e93-3241c53e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:54.836297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7733935-592171f8-74f63e93-3241c53e_0] Write session: try to update token
2025-09-30T14:56:54.836318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7733935-592171f8-74f63e93-3241c53e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:54.844943Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:54.844968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:54.844970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:54.844973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:54.844982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896366734703226:10899]
2025-09-30T14:56:54.844987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896366734703226:10899]
2025-09-30T14:56:54.844991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896366734703226:10899]
2025-09-30T14:56:54.845039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:54.845043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:54.845046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:54.845048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:54.845049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:54.845054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:54.845189Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:54.855158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2383 sessionId: src_id|7733935-592171f8-74f63e93-3241c53e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:54.858006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:54.888362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896366824482914:4281]
2025-09-30T14:56:54.888807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2382, pipe: [1:7555896366824482914:4281]
2025-09-30T14:56:54.966688Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:54.967258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:54.967280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:54.967303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896366824482914:4281], now have 1 active actors on pipe
2025-09-30T14:56:54.967546Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:54.968198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7733935-592171f8-74f63e93-3241c53e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:54.968210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7733935-592171f8-74f63e93-3241c53e_0] Write session will restart in 0.006665s
2025-09-30T14:56:54.968235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7733935-592171f8-74f63e93-3241c53e_0] Write session: Do CDS request
2025-09-30T14:56:54.968240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7733935-592171f8-74f63e93-3241c53e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:54.967740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:54.967788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:54.967861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2383 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7733935-592171f8-74f63e93-3241c53e_0
2025-09-30T14:56:54.968032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2383 sessionId: src_id|7733935-592171f8-74f63e93-3241c53e_0 is DEAD
2025-09-30T14:56:54.968265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896366824482914:4281]
2025-09-30T14:56:54.979690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7733935-592171f8-74f63e93-3241c53e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:54.983100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:54.983117Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2384
2025-09-30T14:56:54.983306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2384 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:54.983333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2384 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:54.983337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2384 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:54.983341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:54.984290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2384 sessionId:  describe result for acl check
2025-09-30T14:56:54.984329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:54.984335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:54.984340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:54.984347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896366824482953:8190] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:54.984929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896366824482953:8190] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:54.989700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896366824482953:8190] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:55.000188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896366824482953:8190] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:55.000207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896366824482953:8190] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:55.000211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896366824482953:8190] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:55.000220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2384 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:55.021096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:55.023227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:55.023524Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:55.023528Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:55.023540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:55.023600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:55.023634Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896371029670763:10903]
2025-09-30T14:56:55.024280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:55.024696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:55.024746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:55.025107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:55.025174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:55.025180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:55.025182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:55.025183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:55.025185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:55.025185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:55.025186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:55.025190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:55.025191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:55.025192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:55.025194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.025195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.025196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.025197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:55.025198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:55.025213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:55.025224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:55.025228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:55.025232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:55.025237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:55.025241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:55.025245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:55.025248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:55.025252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:55.025257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:55.025260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.025264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.025268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.025273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:55.025277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:55.025287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:55.025299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:55.025306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:55.025312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:55.025318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:55.025328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:55.025337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:55.025342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:55.025349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:55.025355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:55.025361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:55.025366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:55.025371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:55.025377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:55.025382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:55.025393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:55.025398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:55.025405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:55.025409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:55.025415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:55.025420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.025426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.025434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.025440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.025447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.025452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.025456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:55.025462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:55.025467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:55.025472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:55.025520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:55.039143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:55.040475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:55.040494Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:55.040497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:55.040502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:55.040510Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2383 [2:7555896371029670763:10903]
2025-09-30T14:56:55.040531Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:55.040548Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:55.040551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:55.040554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:55.040556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:55.040573Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:55.040581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:55.040589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:55.040656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.040659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.040661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.040665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:55.040667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:55.040734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:55.040737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.040752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.040762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.040778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:55.040795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896371029670758:10903]
2025-09-30T14:56:55.040798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896371029670758:10903]
2025-09-30T14:56:55.040800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896371029670758:10903]
2025-09-30T14:56:55.040815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:55.040832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:55.040846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:55.040849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:55.040885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896371029670758:10903]
2025-09-30T14:56:55.040884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:55.040888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:55.040897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:55.040900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:55.040905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:55.041064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896366824482918:2454], now have 1 active actors on pipe
2025-09-30T14:56:55.041072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896371119450411:8190], now have 1 active actors on pipe
2025-09-30T14:56:55.041457Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2383
2025-09-30T14:56:55.041501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2383
2025-09-30T14:56:55.047318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:55.047351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:55.047388Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e12fc875-fb29d25c-ed36b847-c5d17479_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:55.047410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:55.047421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:55.047425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:55.047446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:55.047464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:55.047486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:55.048320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:55.048332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:55.048353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:55.048905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7733935-592171f8-74f63e93-3241c53e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e12fc875-fb29d25c-ed36b847-c5d17479_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:55.048480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2384 partition: 0 MaxSeqNo: 42 sessionId: src_id|e12fc875-fb29d25c-ed36b847-c5d17479_0
2025-09-30T14:56:55.051712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e12fc875-fb29d25c-ed36b847-c5d17479_0] Write session: try to update token
2025-09-30T14:56:55.051736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e12fc875-fb29d25c-ed36b847-c5d17479_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:55.055004Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:55.055025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:55.055028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:55.055030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:55.055040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896371029670758:10903]
2025-09-30T14:56:55.055046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896371029670758:10903]
2025-09-30T14:56:55.055051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896371029670758:10903]
2025-09-30T14:56:55.055094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:55.055101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.055104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:55.055265Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:55.055328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:55.055342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:55.055346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:55.067376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896371119450562:4281]
2025-09-30T14:56:55.067874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2383, pipe: [1:7555896371119450562:4281]
2025-09-30T14:56:55.077977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2384 sessionId: src_id|e12fc875-fb29d25c-ed36b847-c5d17479_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:55.080680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:55.184325Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:55.184720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896371119450562:4281], now have 1 active actors on pipe
2025-09-30T14:56:55.184744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:55.184754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:55.184942Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:55.185985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e12fc875-fb29d25c-ed36b847-c5d17479_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:55.185998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e12fc875-fb29d25c-ed36b847-c5d17479_0] Write session will restart in 0.009116s
2025-09-30T14:56:55.186022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e12fc875-fb29d25c-ed36b847-c5d17479_0] Write session: Do CDS request
2025-09-30T14:56:55.186028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e12fc875-fb29d25c-ed36b847-c5d17479_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:55.185517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896371119450562:4281]
2025-09-30T14:56:55.185558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:55.185568Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:55.185642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2384 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e12fc875-fb29d25c-ed36b847-c5d17479_0
2025-09-30T14:56:55.185813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2384 sessionId: src_id|e12fc875-fb29d25c-ed36b847-c5d17479_0 is DEAD
2025-09-30T14:56:55.196824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e12fc875-fb29d25c-ed36b847-c5d17479_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:55.199410Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:55.199434Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2385
2025-09-30T14:56:55.203373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2385 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:55.203425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2385 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:55.203430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2385 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:55.203435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:55.206475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:55.203963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2385 sessionId:  describe result for acl check
2025-09-30T14:56:55.204003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:55.204022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:55.204024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:55.204030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896371119450874:8183] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:55.204594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896371119450874:8183] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:55.208161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:55.208392Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:55.208403Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:55.208414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:55.208466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:55.208509Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896371029670985:10905]
2025-09-30T14:56:55.209182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:55.209469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:55.209515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:55.209857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:55.209920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:55.209921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:55.209922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:55.209924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:55.209926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:55.209927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:55.209928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:55.209929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:55.209930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:55.209932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:55.209933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.209934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.209935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.209937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:55.209938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:55.209943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:55.209955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:55.209960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:55.209965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:55.209970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:55.209974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:55.209979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:55.209983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:55.209988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:55.209993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:55.209997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.210001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.210005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.210010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:55.210014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:55.210023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:55.210032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:55.210039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:55.210046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:55.210051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:55.210056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:55.210061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:55.210066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:55.210072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:55.210078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:55.210082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:55.210088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:55.210093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:55.210099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:55.210104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:55.210109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:55.210114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:55.210119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:55.210124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:55.210130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:55.210135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.210143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.210148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.210154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.210160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.210165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.210170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:55.210176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:55.210181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:55.210186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:55.210230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:55.208302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896371119450874:8183] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:55.215490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896371119450874:8183] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:55.215509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896371119450874:8183] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:55.215513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896371119450874:8183] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:55.215523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2385 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:55.216238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:55.217642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:55.217659Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:55.217662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:55.217666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:55.217673Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2384 [2:7555896371029670985:10905]
2025-09-30T14:56:55.217688Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:55.217704Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:55.217707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:55.217710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:55.217713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:55.217729Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:55.217741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:55.217748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:55.218075Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2384
2025-09-30T14:56:55.218128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2384
2025-09-30T14:56:55.217809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.217827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.217829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.217833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:55.217835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:55.217902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:55.217905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.217918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.217933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.217951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:55.217968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896371029670980:10905]
2025-09-30T14:56:55.217971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896371029670980:10905]
2025-09-30T14:56:55.217973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896371029670980:10905]
2025-09-30T14:56:55.217987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:55.217992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:55.217996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:55.217998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:55.218000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896371119450579:2454], now have 1 active actors on pipe
2025-09-30T14:56:55.218005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896371119450926:8183], now have 1 active actors on pipe
2025-09-30T14:56:55.218013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:55.218029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:55.218032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:55.218064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896371029670980:10905]
2025-09-30T14:56:55.218072Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:55.218078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:55.218309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:55.218314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:55.218340Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0fb1a31-f0274a33-c280576-b0a55321_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:55.218346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:55.218350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:55.218353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:55.218362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:55.218372Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:55.218385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:55.218583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:55.218590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:55.218612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:55.218711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2385 partition: 0 MaxSeqNo: 42 sessionId: src_id|d0fb1a31-f0274a33-c280576-b0a55321_0
2025-09-30T14:56:55.219104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e12fc875-fb29d25c-ed36b847-c5d17479_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d0fb1a31-f0274a33-c280576-b0a55321_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:55.222072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0fb1a31-f0274a33-c280576-b0a55321_0] Write session: try to update token
2025-09-30T14:56:55.222095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0fb1a31-f0274a33-c280576-b0a55321_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:55.232846Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:55.232869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:55.232872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:55.232874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:55.232884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896371029670980:10905]
2025-09-30T14:56:55.232888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896371029670980:10905]
2025-09-30T14:56:55.232894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896371029670980:10905]
2025-09-30T14:56:55.232937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:55.232944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:55.232949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:55.232952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:55.232954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.232957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:55.233091Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:55.252823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2385 sessionId: src_id|d0fb1a31-f0274a33-c280576-b0a55321_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:55.256800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:55.287456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896371119450936:4281]
2025-09-30T14:56:55.287920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2384, pipe: [1:7555896371119450936:4281]
2025-09-30T14:56:55.360483Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:55.360829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:55.360847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:55.360878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896371119450936:4281], now have 1 active actors on pipe
2025-09-30T14:56:55.361326Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:55.361321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896371119450936:4281]
2025-09-30T14:56:55.361354Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:55.361389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:55.361404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:55.361463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2385 reason: error at write: Disconnected sessionId: src_id|d0fb1a31-f0274a33-c280576-b0a55321_0
2025-09-30T14:56:55.361649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2385 sessionId: src_id|d0fb1a31-f0274a33-c280576-b0a55321_0 is DEAD
2025-09-30T14:56:55.363598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0fb1a31-f0274a33-c280576-b0a55321_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:55.363610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0fb1a31-f0274a33-c280576-b0a55321_0] Write session will restart in 0.007180s
2025-09-30T14:56:55.363637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0fb1a31-f0274a33-c280576-b0a55321_0] Write session: Do CDS request
2025-09-30T14:56:55.363644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0fb1a31-f0274a33-c280576-b0a55321_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:55.371833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0fb1a31-f0274a33-c280576-b0a55321_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:55.371969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:55.371984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2386
2025-09-30T14:56:55.373028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2386 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:55.373074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2386 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:55.373084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2386 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:55.373090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:55.373542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2386 sessionId:  describe result for acl check
2025-09-30T14:56:55.373575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:55.373583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:55.373586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:55.373594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896371119450967:8175] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:55.374148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896371119450967:8175] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:55.384272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896371119450967:8175] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:55.391632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896371119450967:8175] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:55.391649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896371119450967:8175] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:55.391653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896371119450967:8175] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:55.391662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2386 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:55.394390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:55.395132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:55.395337Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:55.395342Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:55.395352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:55.395405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:55.395442Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896371029671212:10907]
2025-09-30T14:56:55.396191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:55.396567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:55.396623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:55.396960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:55.397041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:55.397053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:55.397055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:55.397056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:55.397057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:55.397059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:55.397060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:55.397061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:55.397063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:55.397064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:55.397065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.397066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.397067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.397068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:55.397070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:55.397075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:55.397085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:55.397089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:55.397093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:55.397097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:55.397101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:55.397105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:55.397109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:55.397112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:55.397117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:55.397121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.397125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.397129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.397132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:55.397136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:55.397146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:55.397155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:55.397161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:55.397167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:55.397173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:55.397178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:55.397183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:55.397189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:55.397193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:55.397199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:55.397216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:55.397221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:55.397227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:55.397233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:55.397240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:55.397245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:55.397252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:55.397259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:55.397264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:55.397269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:55.397274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.397279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.397283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.397288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.397292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.397297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.397301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:55.397306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:55.397311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:55.397315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:55.397359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:55.404339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:55.405255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:55.405279Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:55.405284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:55.405288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:55.405296Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2385 [2:7555896371029671212:10907]
2025-09-30T14:56:55.405315Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:55.405334Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:55.405337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:55.405341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:55.405344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:55.405361Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:55.405375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:55.405389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:55.405458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.405466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.405468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.405472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:55.405475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:55.405548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:55.405557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.405573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.405593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.405620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:55.405640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896371029671207:10907]
2025-09-30T14:56:55.405648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896371029671207:10907]
2025-09-30T14:56:55.405651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896371029671207:10907]
2025-09-30T14:56:55.405660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:55.405672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:55.405678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:55.405683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:55.405686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:55.405698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:55.405702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:55.405713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896371119451278:8175], now have 1 active actors on pipe
2025-09-30T14:56:55.405717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896371119450938:2454], now have 1 active actors on pipe
2025-09-30T14:56:55.405820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2385
2025-09-30T14:56:55.405856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2385
2025-09-30T14:56:55.405754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896371029671207:10907]
2025-09-30T14:56:55.405774Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:55.405779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:55.406001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:55.406028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:55.406062Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|504e2002-5317207e-47bb0013-44ff0f84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:55.406077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:55.406081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:55.406084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:55.406096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:55.406108Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:55.406126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:55.406306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:55.406316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:55.406331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:55.407357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2386 partition: 0 MaxSeqNo: 42 sessionId: src_id|504e2002-5317207e-47bb0013-44ff0f84_0
2025-09-30T14:56:55.410366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0fb1a31-f0274a33-c280576-b0a55321_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|504e2002-5317207e-47bb0013-44ff0f84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:55.413439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|504e2002-5317207e-47bb0013-44ff0f84_0] Write session: try to update token
2025-09-30T14:56:55.413466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|504e2002-5317207e-47bb0013-44ff0f84_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:55.429748Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:55.429773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:55.429785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896371029671207:10907]
2025-09-30T14:56:55.429838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:55.430030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:55.430200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:55.430356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:55.430511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:55.430815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:55.430870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:55.431371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:55.438877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2386 sessionId: src_id|504e2002-5317207e-47bb0013-44ff0f84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:55.441690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:55.442024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:55.442048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:55.442091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:55.442172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:55.450813Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:55.450837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:55.450840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:55.450841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:55.450853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896371029671207:10907]
2025-09-30T14:56:55.450873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896371029671207:10907]
2025-09-30T14:56:55.450878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896371029671207:10907]
2025-09-30T14:56:55.450921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:55.450928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.450926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:55.450931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:55.450933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:55.450936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:55.451142Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:55.461077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896371119451291:4281]
2025-09-30T14:56:55.461358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2385, pipe: [1:7555896371119451291:4281]
E0930 14:56:55.505699122 2221263 chttp2_transport.cc:1143]             ipv4:127.0.0.1:11802: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 2500ms
2025-09-30T14:56:55.564972Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:55.565539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896371119451291:4281], now have 1 active actors on pipe
2025-09-30T14:56:55.573876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:55.573908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:55.574093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:55.574160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:55.574228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:55.574303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:55.574345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:55.574350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:55.574421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:55.574486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:55.574552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:55.574619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:55.574660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:55.574663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:55.574736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:55.574798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:55.574860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:55.574922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:55.574963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:55.574966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:55.575036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:55.575099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:55.575204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:55.575453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:55.577901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:55.577917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:55.577950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2386 reason: error at write: Disconnected sessionId: src_id|504e2002-5317207e-47bb0013-44ff0f84_0
2025-09-30T14:56:55.578163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2386 sessionId: src_id|504e2002-5317207e-47bb0013-44ff0f84_0 is DEAD
2025-09-30T14:56:55.578319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|504e2002-5317207e-47bb0013-44ff0f84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:55.578334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|504e2002-5317207e-47bb0013-44ff0f84_0] Write session will restart in 0.006112s
2025-09-30T14:56:55.578360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|504e2002-5317207e-47bb0013-44ff0f84_0] Write session: Do CDS request
2025-09-30T14:56:55.578365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|504e2002-5317207e-47bb0013-44ff0f84_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:55.578750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896371119451291:4281]
2025-09-30T14:56:55.578773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:55.575507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:55.575514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:55.575585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:55.575649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:55.575711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:55.575772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:55.575815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:55.575818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:55.575888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:55.575948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:55.576011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:55.576072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:55.576113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:55.576116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:55.576190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:55.576250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:55.576314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:55.576378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:55.576418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:55.576421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:55.576491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:55.576550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:55.576610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:55.576671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:55.576713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:55.576716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:55.576786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:55.576845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:55.576906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:55.576968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:55.577019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:55.577021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:55.577088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:55.577149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:55.577228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:55.577297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:55.577355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:55.577359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:55.578747Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:55.586242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|504e2002-5317207e-47bb0013-44ff0f84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:55.586498Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:55.586513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2387
2025-09-30T14:56:55.586637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2387 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:55.586673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2387 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:55.586679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2387 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:55.586685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:55.587429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2387 sessionId:  describe result for acl check
2025-09-30T14:56:55.587467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:55.587475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:55.587477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:55.587482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896371119451327:8162] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:55.588053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896371119451327:8162] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:55.592774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896371119451327:8162] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:55.596506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896371119451327:8162] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:55.596523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896371119451327:8162] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:55.596526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896371119451327:8162] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:55.596536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2387 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:55.608986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:55.611232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:55.611482Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:55.611486Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:55.611497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:55.611552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:55.611597Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896371029671475:10922]
2025-09-30T14:56:55.612271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:55.612685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:55.612742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:55.613088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:55.613162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:55.613169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:55.613171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:55.613172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:55.613174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:55.613176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:55.613177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:55.613178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:55.613180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:55.613182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:55.613183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.613184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.613185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.613187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:55.613188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:55.613194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:55.613221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:55.613225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:55.613229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:55.613234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:55.613237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:55.613241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:55.613246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:55.613250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:55.613254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:55.613259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.613264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.613267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.613271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:55.613275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:55.613284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:55.613292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:55.613306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:55.613313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:55.613323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:55.613328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:55.613337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:55.613344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:55.613348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:55.613354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:55.613363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:55.613368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:55.613379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:55.613385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:55.613394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:55.613400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:55.613418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:55.613429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:55.613441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:55.613447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:55.613456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.613462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.613471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.613476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.613485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.613491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.613499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:55.613505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:55.613509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:55.613515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:55.613562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:55.623044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:55.624269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:55.624284Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:55.624287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:55.624291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:55.624299Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2386 [2:7555896371029671475:10922]
2025-09-30T14:56:55.624315Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:55.624332Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:55.624335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:55.624339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:55.624341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:55.624359Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:55.624366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:55.624375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:55.624444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.624453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.624455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.624459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:55.624462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:55.624531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:55.624539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.624553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.624572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.624594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:55.624619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896371029671470:10922]
2025-09-30T14:56:55.624622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896371029671470:10922]
2025-09-30T14:56:55.624624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896371029671470:10922]
2025-09-30T14:56:55.624635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:55.624646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:55.624655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896371119451456:8162], now have 1 active actors on pipe
2025-09-30T14:56:55.624659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896371119451319:2454], now have 1 active actors on pipe
2025-09-30T14:56:55.624659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:55.624662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:55.624667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:55.624682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:55.624685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:55.624721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896371029671470:10922]
2025-09-30T14:56:55.624735Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:55.624758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:55.624776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2386
2025-09-30T14:56:55.624948Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2386
2025-09-30T14:56:55.624992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:55.625004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:55.625034Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b636ddc-769e6f51-26e63488-2b738452_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:55.625046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:55.625051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:55.625053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:55.625065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:55.625079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:55.625103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:55.625366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:55.625382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:55.625404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:55.625559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2387 partition: 0 MaxSeqNo: 42 sessionId: src_id|b636ddc-769e6f51-26e63488-2b738452_0
2025-09-30T14:56:55.625953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|504e2002-5317207e-47bb0013-44ff0f84_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b636ddc-769e6f51-26e63488-2b738452_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:55.628809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b636ddc-769e6f51-26e63488-2b738452_0] Write session: try to update token
2025-09-30T14:56:55.628830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b636ddc-769e6f51-26e63488-2b738452_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:55.639905Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:55.639930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:55.639933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:55.639935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:55.639946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896371029671470:10922]
2025-09-30T14:56:55.639951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896371029671470:10922]
2025-09-30T14:56:55.639956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896371029671470:10922]
2025-09-30T14:56:55.640002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:55.640010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.640013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:55.640037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:55.640045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:55.640050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:55.640164Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:55.650997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2387 sessionId: src_id|b636ddc-769e6f51-26e63488-2b738452_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:55.653895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:55.678312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896371119451670:4281]
2025-09-30T14:56:55.678671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2386, pipe: [1:7555896371119451670:4281]
2025-09-30T14:56:55.766523Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:55.767126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:55.767142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:55.767163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896371119451670:4281], now have 1 active actors on pipe
2025-09-30T14:56:55.767419Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:55.767492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:55.767677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896371119451670:4281]
2025-09-30T14:56:55.767701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:55.767784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2387 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b636ddc-769e6f51-26e63488-2b738452_0
2025-09-30T14:56:55.767953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2387 sessionId: src_id|b636ddc-769e6f51-26e63488-2b738452_0 is DEAD
2025-09-30T14:56:55.771446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b636ddc-769e6f51-26e63488-2b738452_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:55.771461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b636ddc-769e6f51-26e63488-2b738452_0] Write session will restart in 0.006269s
2025-09-30T14:56:55.771486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b636ddc-769e6f51-26e63488-2b738452_0] Write session: Do CDS request
2025-09-30T14:56:55.771492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b636ddc-769e6f51-26e63488-2b738452_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:55.778786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b636ddc-769e6f51-26e63488-2b738452_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:55.779458Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:55.779482Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2388
2025-09-30T14:56:55.779652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2388 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:55.779696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2388 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:55.779715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2388 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:55.779725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:55.780511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2388 sessionId:  describe result for acl check
2025-09-30T14:56:55.780544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:55.780547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:55.780548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:55.780553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896371119451734:8157] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:55.781102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896371119451734:8157] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:55.785602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896371119451734:8157] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:55.788844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896371119451734:8157] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:55.788862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896371119451734:8157] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:55.788866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896371119451734:8157] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:55.788875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2388 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:55.791709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:55.793368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:55.793577Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:55.793587Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:55.793599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:55.793649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:55.793697Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896371029671701:10924]
2025-09-30T14:56:55.794341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:55.794671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:55.794739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:55.795109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:55.795188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:55.795195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:55.795196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:55.795197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:55.795198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:55.795200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:55.795201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:55.795202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:55.795204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:55.795205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:55.795206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.795208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.795209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.795211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:55.795212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:55.795218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:55.795229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:55.795234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:55.795238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:55.795273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:55.795277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:55.795280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:55.795284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:55.795288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:55.795292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:55.795295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.795299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.795302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.795306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:55.795309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:55.795318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:55.795333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:55.795345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:55.795351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:55.795360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:55.795366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:55.795376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:55.795383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:55.795393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:55.795399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:55.795403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:55.795409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:55.795415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:55.795421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:55.795426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:55.795432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:55.795442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:55.795448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:55.795457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:55.795463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:55.795473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.795479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.795488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.795494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.795503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.795509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.795519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:55.795534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:55.795544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:55.795550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:55.795595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:55.801477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:55.802374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:55.802393Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:55.802396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:55.802400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:55.802408Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2387 [2:7555896371029671701:10924]
2025-09-30T14:56:55.802427Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:55.802442Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:55.802446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:55.802450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:55.802453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:55.802470Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:55.802477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:55.802485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:55.802550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.802552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.802555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.802560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:55.802563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:55.802633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:55.802636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.802651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.802665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.802683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:55.802700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896371029671696:10924]
2025-09-30T14:56:55.802703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896371029671696:10924]
2025-09-30T14:56:55.802706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896371029671696:10924]
2025-09-30T14:56:55.802715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:55.802730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:55.802729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:55.802733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:55.802736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:55.802746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:55.802749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:55.802760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896371119451674:2454], now have 1 active actors on pipe
2025-09-30T14:56:55.802764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896371119451992:8157], now have 1 active actors on pipe
2025-09-30T14:56:55.802798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896371029671696:10924]
2025-09-30T14:56:55.802810Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:55.802817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:55.802852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2387
2025-09-30T14:56:55.802874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2387
2025-09-30T14:56:55.803055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:55.803068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:55.803099Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61c17b44-683374a7-aadc39f1-eb012417_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:55.803106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:55.803110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:55.803113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:55.803124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:55.803133Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:55.803153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:55.803682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:55.803695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:55.803717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:55.803844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2388 partition: 0 MaxSeqNo: 42 sessionId: src_id|61c17b44-683374a7-aadc39f1-eb012417_0
2025-09-30T14:56:55.804236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b636ddc-769e6f51-26e63488-2b738452_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|61c17b44-683374a7-aadc39f1-eb012417_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:55.807129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61c17b44-683374a7-aadc39f1-eb012417_0] Write session: try to update token
2025-09-30T14:56:55.807152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61c17b44-683374a7-aadc39f1-eb012417_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:55.815725Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:55.815745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:55.815748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:55.815750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:55.815759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896371029671696:10924]
2025-09-30T14:56:55.815764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896371029671696:10924]
2025-09-30T14:56:55.815768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896371029671696:10924]
2025-09-30T14:56:55.815830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:55.815838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.815836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:55.815841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:55.815844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:55.815849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:55.815988Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:55.829300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2388 sessionId: src_id|61c17b44-683374a7-aadc39f1-eb012417_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:55.832249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:55.867616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896371119452029:4281]
2025-09-30T14:56:55.868815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2387, pipe: [1:7555896371119452029:4281]
2025-09-30T14:56:55.933355Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:55.934103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:55.934127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:55.934147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896371119452029:4281], now have 1 active actors on pipe
2025-09-30T14:56:55.934364Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:55.935362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896371119452029:4281]
2025-09-30T14:56:55.935394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:55.935909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61c17b44-683374a7-aadc39f1-eb012417_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:55.935935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61c17b44-683374a7-aadc39f1-eb012417_0] Write session will restart in 0.005315s
2025-09-30T14:56:55.935971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61c17b44-683374a7-aadc39f1-eb012417_0] Write session: Do CDS request
2025-09-30T14:56:55.935979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61c17b44-683374a7-aadc39f1-eb012417_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:55.935428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:55.935495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2388 reason: status is not ok: tablet will be restarted right now sessionId: src_id|61c17b44-683374a7-aadc39f1-eb012417_0
2025-09-30T14:56:55.935673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2388 sessionId: src_id|61c17b44-683374a7-aadc39f1-eb012417_0 is DEAD
2025-09-30T14:56:55.947285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61c17b44-683374a7-aadc39f1-eb012417_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:55.951369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:55.951383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2389
2025-09-30T14:56:55.951606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2389 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:55.951646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2389 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:55.951653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2389 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:55.951658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:55.952172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2389 sessionId:  describe result for acl check
2025-09-30T14:56:55.952200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:55.952202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:55.952203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:55.952211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896371119452284:8151] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:55.952757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896371119452284:8151] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:55.955051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896371119452284:8151] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:55.956258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:55.959043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:55.959278Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:55.959283Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:55.959295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:55.959380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:55.959428Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896371029671941:10927]
2025-09-30T14:56:55.959563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896371119452284:8151] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:55.959582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896371119452284:8151] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:55.959585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896371119452284:8151] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:55.959592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2389 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:55.960073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:55.960443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:55.960494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:55.960830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:55.960896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:55.960903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:55.960904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:55.960906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:55.960907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:55.960909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:55.960922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:55.960924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:55.960925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:55.960926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:55.960928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.960929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.960930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.960931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:55.960932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:55.960938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:55.960948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:55.960953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:55.960957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:55.960961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:55.960964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:55.960967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:55.960971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:55.960974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:55.960978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:55.960981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.960985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.960988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.960992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:55.960995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:55.961002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:55.961010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:55.961015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:55.961021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:55.961025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:55.961029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:55.961033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:55.961037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:55.961041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:55.961046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:55.961050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:55.961054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:55.961058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:55.961063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:55.961067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:55.961072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:55.961076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:55.961080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:55.961084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:55.961089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:55.961093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.961098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.961102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.961107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.961111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.961115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.961119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:55.961125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:55.961130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:55.961134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:55.961175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:55.966564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:55.967976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:55.967994Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:55.967996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:55.968001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:55.968007Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2388 [2:7555896371029671941:10927]
2025-09-30T14:56:55.968025Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:55.968040Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:55.968043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:55.968047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:55.968051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:55.968067Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:55.968081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:55.968089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:55.968153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.968163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.968166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.968169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:55.968172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:55.968241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:55.968250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.968263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:55.968277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:55.968295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:55.968315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896371029671936:10927]
2025-09-30T14:56:55.968318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896371029671936:10927]
2025-09-30T14:56:55.968320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896371029671936:10927]
2025-09-30T14:56:55.968334Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:55.968347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:55.968350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896371119452032:2454], now have 1 active actors on pipe
2025-09-30T14:56:55.968354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896371119452374:8151], now have 1 active actors on pipe
2025-09-30T14:56:55.968359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:55.968361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:55.968362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:55.968375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:55.968378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:55.968414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896371029671936:10927]
2025-09-30T14:56:55.968426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:55.968433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:55.968452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:55.968461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:55.968496Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d4f2f51-97180be2-915a2843-a4f8c3f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:55.968508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:55.968511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:55.968514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:55.968523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:55.968532Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:55.968549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:55.968699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:55.968706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:55.968718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:55.969165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61c17b44-683374a7-aadc39f1-eb012417_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7d4f2f51-97180be2-915a2843-a4f8c3f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:55.968413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2388
2025-09-30T14:56:55.968432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2388
2025-09-30T14:56:55.968796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2389 partition: 0 MaxSeqNo: 42 sessionId: src_id|7d4f2f51-97180be2-915a2843-a4f8c3f7_0
2025-09-30T14:56:55.972302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4f2f51-97180be2-915a2843-a4f8c3f7_0] Write session: try to update token
2025-09-30T14:56:55.972326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4f2f51-97180be2-915a2843-a4f8c3f7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:55.984487Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:55.984508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:55.984511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:55.984514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:55.984523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896371029671936:10927]
2025-09-30T14:56:55.984528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896371029671936:10927]
2025-09-30T14:56:55.984533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896371029671936:10927]
2025-09-30T14:56:55.984578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:55.984588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:55.984594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:55.984595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:55.984601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:55.984605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:55.984746Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:55.986958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2389 sessionId: src_id|7d4f2f51-97180be2-915a2843-a4f8c3f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:55.989748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:56.035553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896375414419682:4281]
2025-09-30T14:56:56.035904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2388, pipe: [1:7555896375414419682:4281]
2025-09-30T14:56:56.099342Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:56.099797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:56.099813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:56.099853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896375414419682:4281], now have 1 active actors on pipe
2025-09-30T14:56:56.100123Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:56.100114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896375414419682:4281]
2025-09-30T14:56:56.100158Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:56.100174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:56.100178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:56.100239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2389 reason: error at write: Disconnected sessionId: src_id|7d4f2f51-97180be2-915a2843-a4f8c3f7_0
2025-09-30T14:56:56.100422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2389 sessionId: src_id|7d4f2f51-97180be2-915a2843-a4f8c3f7_0 is DEAD
2025-09-30T14:56:56.100586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4f2f51-97180be2-915a2843-a4f8c3f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:56.100596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4f2f51-97180be2-915a2843-a4f8c3f7_0] Write session will restart in 0.005874s
2025-09-30T14:56:56.100620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4f2f51-97180be2-915a2843-a4f8c3f7_0] Write session: Do CDS request
2025-09-30T14:56:56.100646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4f2f51-97180be2-915a2843-a4f8c3f7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:56.107803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4f2f51-97180be2-915a2843-a4f8c3f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:56.108102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:56.108118Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2390
2025-09-30T14:56:56.108764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2390 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:56.108810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2390 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:56.108816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2390 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:56.108820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:56.109977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2390 sessionId:  describe result for acl check
2025-09-30T14:56:56.110015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:56.110023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:56.110025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:56.110031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896375414419748:8140] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:56.110547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896375414419748:8140] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:56.114518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896375414419748:8140] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:56.117955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896375414419748:8140] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:56.117963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896375414419748:8140] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:56.117969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896375414419748:8140] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:56.117977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2390 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:56.123062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:56.124629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:56.124825Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:56.124837Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:56.124848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:56.124898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:56.124941Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896375324639466:10930]
2025-09-30T14:56:56.125518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:56.125866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:56.125917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:56.126242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:56.126310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:56.126316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:56.126317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:56.126318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:56.126319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:56.126321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:56.126322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:56.126323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:56.126324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:56.126326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:56.126327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.126329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:56.126330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:56.126331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:56.126332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:56.126338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:56.126349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:56.126354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:56.126358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:56.126362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:56.126366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:56.126371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:56.126375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:56.126379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:56.126383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:56.126388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.126392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:56.126396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:56.126400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:56.126404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:56.126412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:56.126420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:56.126427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:56.126433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:56.126437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:56.126443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:56.126448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:56.126454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:56.126459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:56.126465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:56.126469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:56.126475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:56.126485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:56.126490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:56.126494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:56.126500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:56.126505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:56.126510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:56.126520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:56.126525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:56.126530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.126542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.126547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:56.126553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:56.126558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:56.126563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:56.126567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:56.126573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:56.126577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:56.126587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:56.126636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:56.133909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2389
2025-09-30T14:56:56.132279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:56.133923Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2389
2025-09-30T14:56:56.133416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:56.133424Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:56.133428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:56.133432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:56.133453Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2389 [2:7555896375324639466:10930]
2025-09-30T14:56:56.133473Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:56.133491Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:56.133495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:56.133499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:56.133502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:56.133519Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:56.133525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:56.133534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:56.133608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.133611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:56.133613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:56.133617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:56.133620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:56.133703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:56.133707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.133721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:56.133734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:56.133752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:56.133774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896375414419685:2454], now have 1 active actors on pipe
2025-09-30T14:56:56.133778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896375414419953:8140], now have 1 active actors on pipe
2025-09-30T14:56:56.133784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896375324639461:10930]
2025-09-30T14:56:56.133786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896375324639461:10930]
2025-09-30T14:56:56.133789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896375324639461:10930]
2025-09-30T14:56:56.133807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:56.133821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:56.133837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:56.133841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:56.133875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:56.133879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:56.133881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896375324639461:10930]
2025-09-30T14:56:56.133882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:56.133884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:56.133889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:56.134056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:56.134066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:56.134098Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7a7ea3e-e4fb8a28-7f968f00-d34863df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:56.134108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:56.134113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:56.134115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:56.134127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:56.134140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:56.134167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:56.134318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:56.134329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:56.134344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:56.134438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2390 partition: 0 MaxSeqNo: 42 sessionId: src_id|e7a7ea3e-e4fb8a28-7f968f00-d34863df_0
2025-09-30T14:56:56.134820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4f2f51-97180be2-915a2843-a4f8c3f7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e7a7ea3e-e4fb8a28-7f968f00-d34863df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:56.137736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7a7ea3e-e4fb8a28-7f968f00-d34863df_0] Write session: try to update token
2025-09-30T14:56:56.137761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7a7ea3e-e4fb8a28-7f968f00-d34863df_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:56.149695Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:56.149722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:56.149725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:56.149727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:56.149737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896375324639461:10930]
2025-09-30T14:56:56.149746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896375324639461:10930]
2025-09-30T14:56:56.149750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896375324639461:10930]
2025-09-30T14:56:56.149784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:56.149792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.149795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:56.150009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:56.150022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:56.150027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:56.150212Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:56.156570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2390 sessionId: src_id|e7a7ea3e-e4fb8a28-7f968f00-d34863df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:56.159810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:56.200400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896375414420058:4281]
2025-09-30T14:56:56.200727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2389, pipe: [1:7555896375414420058:4281]
2025-09-30T14:56:56.269294Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:56.269814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:56.269831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:56.269869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896375414420058:4281], now have 1 active actors on pipe
2025-09-30T14:56:56.270127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896375414420058:4281]
2025-09-30T14:56:56.270151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:56.270172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:56.270177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:56.270144Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:56.270260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2390 reason: error at write: Disconnected sessionId: src_id|e7a7ea3e-e4fb8a28-7f968f00-d34863df_0
2025-09-30T14:56:56.270454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2390 sessionId: src_id|e7a7ea3e-e4fb8a28-7f968f00-d34863df_0 is DEAD
2025-09-30T14:56:56.270851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7a7ea3e-e4fb8a28-7f968f00-d34863df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:56.270871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7a7ea3e-e4fb8a28-7f968f00-d34863df_0] Write session will restart in 0.008685s
2025-09-30T14:56:56.270895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7a7ea3e-e4fb8a28-7f968f00-d34863df_0] Write session: Do CDS request
2025-09-30T14:56:56.270907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7a7ea3e-e4fb8a28-7f968f00-d34863df_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:56.280810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7a7ea3e-e4fb8a28-7f968f00-d34863df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:56.280908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:56.280926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2391
2025-09-30T14:56:56.281150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2391 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:56.281196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2391 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:56.281215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2391 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:56.281219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:56.281649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2391 sessionId:  describe result for acl check
2025-09-30T14:56:56.281676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:56.281681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:56.281683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:56.281854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896375414420099:8135] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:56.282493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896375414420099:8135] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:56.285602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896375414420099:8135] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:56.290498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896375414420099:8135] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:56.290513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896375414420099:8135] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:56.290521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896375414420099:8135] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:56.290529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2391 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:56.302864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:56.305134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:56.305434Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:56.305453Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:56.305469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:56.305549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:56.305606Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896375324639695:10932]
2025-09-30T14:56:56.306163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:56.306555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:56.306619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:56.307005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:56.307191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:56.307198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:56.307199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:56.307200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:56.307201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:56.307202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:56.307204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:56.307206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:56.307207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:56.307208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:56.307210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.307211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:56.307213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:56.307214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:56.307215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:56.307222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:56.307232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:56.307236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:56.307239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:56.307263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:56.307266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:56.307270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:56.307275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:56.307278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:56.307283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:56.307286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.307290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:56.307293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:56.307297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:56.307300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:56.307309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:56.307317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:56.307323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:56.307328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:56.307333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:56.307338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:56.307343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:56.307348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:56.307354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:56.307359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:56.307371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:56.307377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:56.307381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:56.307386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:56.307390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:56.307395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:56.307400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:56.307404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:56.307411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:56.307416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:56.307420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.307426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.307430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:56.307434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:56.307439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:56.307444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:56.307448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:56.307452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:56.307457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:56.307462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:56.307510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:56.313947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:56.315152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:56.315172Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:56.315175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:56.315179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:56.315186Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2390 [2:7555896375324639695:10932]
2025-09-30T14:56:56.315207Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:56.315229Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:56.315237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:56.315265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:56.315273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:56.315289Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:56.315301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:56.315312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:56.315386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.315393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:56.315396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:56.315400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:56.315402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:56.315470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:56.315480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.315494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:56.315507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:56.315526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:56.315545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896375414420062:2454], now have 1 active actors on pipe
2025-09-30T14:56:56.315549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896375414420276:8135], now have 1 active actors on pipe
2025-09-30T14:56:56.315556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896375324639690:10932]
2025-09-30T14:56:56.315558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896375324639690:10932]
2025-09-30T14:56:56.315560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896375324639690:10932]
2025-09-30T14:56:56.315575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:56.315583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:56.315589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:56.315592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:56.315594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:56.315606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:56.315610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:56.315646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896375324639690:10932]
2025-09-30T14:56:56.315653Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:56.315657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:56.317663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2390
2025-09-30T14:56:56.317705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2390
2025-09-30T14:56:56.317848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:56.317866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:56.317896Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d334238c-d4692265-fc9ce06e-308ddb41_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:56.317913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:56.317918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:56.317921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:56.317933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:56.317949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:56.317967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:56.318486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:56.318495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:56.318514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:56.318600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2391 partition: 0 MaxSeqNo: 42 sessionId: src_id|d334238c-d4692265-fc9ce06e-308ddb41_0
2025-09-30T14:56:56.318984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7a7ea3e-e4fb8a28-7f968f00-d34863df_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d334238c-d4692265-fc9ce06e-308ddb41_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:56.321774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d334238c-d4692265-fc9ce06e-308ddb41_0] Write session: try to update token
2025-09-30T14:56:56.321793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d334238c-d4692265-fc9ce06e-308ddb41_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:56.328009Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:56.328028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:56.328037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896375324639690:10932]
2025-09-30T14:56:56.328078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:56.328157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:56.328253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:56.328405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:56.328553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:56.328698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:56.328882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:56.328915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:56.339058Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:56.339079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:56.339081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:56.339083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:56.339093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896375324639690:10932]
2025-09-30T14:56:56.339097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896375324639690:10932]
2025-09-30T14:56:56.339100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896375324639690:10932]
2025-09-30T14:56:56.339134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:56.339141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.339144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:56.339162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:56.339171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:56.339176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:56.339305Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:56.342390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2391 sessionId: src_id|d334238c-d4692265-fc9ce06e-308ddb41_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:56.345286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:56.370367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896375414420424:4281]
2025-09-30T14:56:56.371678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2390, pipe: [1:7555896375414420424:4281]
2025-09-30T14:56:56.450608Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:56.451069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:56.451091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:56.451114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896375414420424:4281], now have 1 active actors on pipe
2025-09-30T14:56:56.451367Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:56.451859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:56.451907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896375414420424:4281]
2025-09-30T14:56:56.451931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:56.452000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2391 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d334238c-d4692265-fc9ce06e-308ddb41_0
2025-09-30T14:56:56.452179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2391 sessionId: src_id|d334238c-d4692265-fc9ce06e-308ddb41_0 is DEAD
2025-09-30T14:56:56.452543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d334238c-d4692265-fc9ce06e-308ddb41_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:56.452559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d334238c-d4692265-fc9ce06e-308ddb41_0] Write session will restart in 0.009711s
2025-09-30T14:56:56.452585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d334238c-d4692265-fc9ce06e-308ddb41_0] Write session: Do CDS request
2025-09-30T14:56:56.452592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d334238c-d4692265-fc9ce06e-308ddb41_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:56.467722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d334238c-d4692265-fc9ce06e-308ddb41_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:56.467841Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:56.467863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2392
2025-09-30T14:56:56.468110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2392 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:56.468145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2392 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:56.468156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2392 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:56.468160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:56.468695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2392 sessionId:  describe result for acl check
2025-09-30T14:56:56.468742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:56.468750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:56.468752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:56.468758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896375414420514:8126] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:56.469341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896375414420514:8126] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:56.471763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896375414420514:8126] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:56.474568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896375414420514:8126] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:56.474590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896375414420514:8126] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:56.474594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896375414420514:8126] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:56.474602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2392 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:56.480399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:56.482575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:56.482764Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:56.482768Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:56.482778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:56.482825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:56.482863Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896375324639925:10934]
2025-09-30T14:56:56.483465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:56.484181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:56.484234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:56.484565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:56.484632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:56.484634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:56.484635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:56.484636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:56.484637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:56.484638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:56.484639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:56.484640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:56.484642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:56.484643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:56.484644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.484645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:56.484646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:56.484647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:56.484648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:56.484654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:56.484667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:56.484671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:56.484676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:56.484680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:56.484684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:56.484688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:56.484692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:56.484696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:56.484701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:56.484705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.484710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:56.484714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:56.484718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:56.484722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:56.484731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:56.484739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:56.484745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:56.484751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:56.484756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:56.484762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:56.484766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:56.484772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:56.484777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:56.484783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:56.484788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:56.484793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:56.484799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:56.484804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:56.484810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:56.484815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:56.484821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:56.484827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:56.484834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:56.484840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:56.484845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.484851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.484855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:56.484861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:56.484867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:56.484872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:56.484876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:56.484882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:56.484888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:56.484893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:56.484967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:56.497024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:56.497932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:56.497951Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:56.497955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:56.497959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:56.497967Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2391 [2:7555896375324639925:10934]
2025-09-30T14:56:56.497985Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:56.498004Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:56.498008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:56.498011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:56.498014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:56.498032Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:56.498039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:56.498048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:56.498116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.498119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:56.498122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:56.498126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:56.498129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:56.498206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:56.498209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.498223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:56.498237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:56.498257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:56.498273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896375324639920:10934]
2025-09-30T14:56:56.498276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896375324639920:10934]
2025-09-30T14:56:56.498278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896375324639920:10934]
2025-09-30T14:56:56.498725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2391
2025-09-30T14:56:56.498761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2391
2025-09-30T14:56:56.498298Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:56.498321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:56.498337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:56.498340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:56.498378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896375324639920:10934]
2025-09-30T14:56:56.498380Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:56.498455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:56.498460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:56.498462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:56.498469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:56.498630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896375414420672:8126], now have 1 active actors on pipe
2025-09-30T14:56:56.498639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896375414420426:2454], now have 1 active actors on pipe
2025-09-30T14:56:56.498956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:56.498965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:56.499013Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|472c96f6-ea8ae1e2-8efb3b9c-9fbfd685_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:56.499022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:56.499027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:56.499029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:56.499042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:56.499054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:56.499073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:56.499279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:56.499289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:56.499309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:56.499448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2392 partition: 0 MaxSeqNo: 42 sessionId: src_id|472c96f6-ea8ae1e2-8efb3b9c-9fbfd685_0
2025-09-30T14:56:56.499805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d334238c-d4692265-fc9ce06e-308ddb41_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|472c96f6-ea8ae1e2-8efb3b9c-9fbfd685_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:56.502509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|472c96f6-ea8ae1e2-8efb3b9c-9fbfd685_0] Write session: try to update token
2025-09-30T14:56:56.502532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|472c96f6-ea8ae1e2-8efb3b9c-9fbfd685_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:56.513616Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:56.513639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:56.513641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:56.513644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:56.513653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896375324639920:10934]
2025-09-30T14:56:56.513658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896375324639920:10934]
2025-09-30T14:56:56.513662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896375324639920:10934]
2025-09-30T14:56:56.513705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:56.513715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.513717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:56.513857Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:56.519350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:56.519381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:56.519386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:56.528589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2392 sessionId: src_id|472c96f6-ea8ae1e2-8efb3b9c-9fbfd685_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:56.531444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:56.552167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896375414420785:4281]
2025-09-30T14:56:56.552471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2391, pipe: [1:7555896375414420785:4281]
2025-09-30T14:56:56.627790Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:56.628388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:56.628408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:56.628432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896375414420785:4281], now have 1 active actors on pipe
2025-09-30T14:56:56.629060Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:56.629239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896375414420785:4281]
2025-09-30T14:56:56.629286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:56.629293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:56.629379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2392 reason: error at write: Disconnected sessionId: src_id|472c96f6-ea8ae1e2-8efb3b9c-9fbfd685_0
2025-09-30T14:56:56.629605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2392 sessionId: src_id|472c96f6-ea8ae1e2-8efb3b9c-9fbfd685_0 is DEAD
2025-09-30T14:56:56.629891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:56.635345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|472c96f6-ea8ae1e2-8efb3b9c-9fbfd685_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:56.635360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|472c96f6-ea8ae1e2-8efb3b9c-9fbfd685_0] Write session will restart in 0.006607s
2025-09-30T14:56:56.635384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|472c96f6-ea8ae1e2-8efb3b9c-9fbfd685_0] Write session: Do CDS request
2025-09-30T14:56:56.635393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|472c96f6-ea8ae1e2-8efb3b9c-9fbfd685_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:56.642736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|472c96f6-ea8ae1e2-8efb3b9c-9fbfd685_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:56.643084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:56.643098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2393
2025-09-30T14:56:56.643231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2393 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:56.643279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2393 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:56.643285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2393 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:56.643289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:56.644130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2393 sessionId:  describe result for acl check
2025-09-30T14:56:56.644175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:56.644178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:56.644180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:56.644186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896375414420953:8104] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:56.644746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896375414420953:8104] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:56.646861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896375414420953:8104] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:56.649810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896375414420953:8104] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:56.649823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896375414420953:8104] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:56.649827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896375414420953:8104] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:56.649833Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2393 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:56.653523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:56.655509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:56.655856Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:56.655868Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:56.655878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:56.655923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:56.655955Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896375324640193:10949]
2025-09-30T14:56:56.656478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:56.656805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:56.656884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:56.657254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:56.657324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:56.657333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:56.657335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:56.657336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:56.657338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:56.657339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:56.657341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:56.657342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:56.657343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:56.657345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:56.657346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.657347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:56.657349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:56.657350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:56.657351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:56.657357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:56.657369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:56.657373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:56.657377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:56.657382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:56.657386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:56.657390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:56.657394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:56.657398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:56.657403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:56.657408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.657412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:56.657417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:56.657421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:56.657425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:56.657433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:56.657443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:56.657449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:56.657455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:56.657461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:56.657467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:56.657473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:56.657479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:56.657484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:56.657490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:56.657496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:56.657502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:56.657507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:56.657514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:56.657519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:56.657525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:56.657530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:56.657536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:56.657541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:56.657547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:56.657553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.657558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.657563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:56.657570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:56.657576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:56.657593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:56.657598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:56.657605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:56.657610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:56.657616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:56.657665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:56.663398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:56.664511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:56.664526Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:56.664529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:56.664533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:56.664541Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2392 [2:7555896375324640193:10949]
2025-09-30T14:56:56.664557Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:56.664572Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:56.664576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:56.664579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:56.664582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:56.664598Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:56.664606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:56.664619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:56.664676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.664686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:56.664689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:56.664692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:56.664695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:56.664767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:56.664774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.664787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:56.664809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:56.664827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:56.664846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896375414420812:2454], now have 1 active actors on pipe
2025-09-30T14:56:56.664855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896375414421098:8104], now have 1 active actors on pipe
2025-09-30T14:56:56.664862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896375324640188:10949]
2025-09-30T14:56:56.664868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896375324640188:10949]
2025-09-30T14:56:56.664871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896375324640188:10949]
2025-09-30T14:56:56.664883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:56.664899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:56.664901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:56.664910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:56.664913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:56.664916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:56.664919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:56.664950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896375324640188:10949]
2025-09-30T14:56:56.664934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2392
2025-09-30T14:56:56.664953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:56.664952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2392
2025-09-30T14:56:56.664967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:56.664989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:56.664998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:56.665022Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab8d86f9-9aba157d-983fdb78-33781e84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:56.665033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:56.665038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:56.665045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:56.665054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:56.665067Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:56.665081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:56.665291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:56.665313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:56.665336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:56.665426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2393 partition: 0 MaxSeqNo: 42 sessionId: src_id|ab8d86f9-9aba157d-983fdb78-33781e84_0
2025-09-30T14:56:56.665792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|472c96f6-ea8ae1e2-8efb3b9c-9fbfd685_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ab8d86f9-9aba157d-983fdb78-33781e84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:56.668463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab8d86f9-9aba157d-983fdb78-33781e84_0] Write session: try to update token
2025-09-30T14:56:56.668479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab8d86f9-9aba157d-983fdb78-33781e84_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:56.677585Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:56.677606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:56.677608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:56.677610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:56.677619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896375324640188:10949]
2025-09-30T14:56:56.677622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896375324640188:10949]
2025-09-30T14:56:56.677626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896375324640188:10949]
2025-09-30T14:56:56.677666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:56.677674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.677676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:56.677677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:56.677684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:56.677689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:56.677816Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:56.685016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2393 sessionId: src_id|ab8d86f9-9aba157d-983fdb78-33781e84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:56.687677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:56.729327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896375414421170:4281]
2025-09-30T14:56:56.729665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2392, pipe: [1:7555896375414421170:4281]
2025-09-30T14:56:56.792417Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:56.792838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:56.792848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:56.792886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896375414421170:4281], now have 1 active actors on pipe
2025-09-30T14:56:56.793174Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:56.793934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab8d86f9-9aba157d-983fdb78-33781e84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:56.793953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab8d86f9-9aba157d-983fdb78-33781e84_0] Write session will restart in 0.006922s
2025-09-30T14:56:56.793986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab8d86f9-9aba157d-983fdb78-33781e84_0] Write session: Do CDS request
2025-09-30T14:56:56.794012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab8d86f9-9aba157d-983fdb78-33781e84_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:56.793241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896375414421170:4281]
2025-09-30T14:56:56.793283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:56.793317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:56.793386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2393 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ab8d86f9-9aba157d-983fdb78-33781e84_0
2025-09-30T14:56:56.793579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2393 sessionId: src_id|ab8d86f9-9aba157d-983fdb78-33781e84_0 is DEAD
2025-09-30T14:56:56.803675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab8d86f9-9aba157d-983fdb78-33781e84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:56.806702Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:56.806721Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2394
2025-09-30T14:56:56.806971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2394 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:56.807017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2394 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:56.807030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2394 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:56.807043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:56.807597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2394 sessionId:  describe result for acl check
2025-09-30T14:56:56.807636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:56.807643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:56.807645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:56.807651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896375414421206:10241] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:56.808269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896375414421206:10241] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:56.811950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896375414421206:10241] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:56.816688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896375414421206:10241] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:56.816704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896375414421206:10241] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:56.816708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896375414421206:10241] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:56.816715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2394 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:56.851378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:56.854586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:56.854822Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:56.854825Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:56.854833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:56.854890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:56.854915Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896375324640425:10951]
2025-09-30T14:56:56.855476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:56.857243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:56.857358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:56.858168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:56.858283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:56.858284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:56.858286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:56.858287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:56.858290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:56.858292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:56.858293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:56.858295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:56.858297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:56.858298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:56.858300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.858302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:56.858303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:56.858305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:56.858307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:56.858315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:56.858327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:56.858333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:56.858338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:56.858341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:56.858346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:56.858351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:56.858355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:56.858359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:56.858364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:56.858369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.858374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:56.858397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:56.858403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:56.858407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:56.858421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:56.858433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:56.858441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:56.858447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:56.858453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:56.858460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:56.858466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:56.858472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:56.858478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:56.858485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:56.858491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:56.858497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:56.858508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:56.858515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:56.858522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:56.858528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:56.858533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:56.858542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:56.858547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:56.858554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:56.858559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.858566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.858571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:56.858577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:56.858583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:56.858589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:56.858594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:56.858600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:56.858606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:56.858612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:56.858664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:56.868264Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2393
2025-09-30T14:56:56.868290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2393
2025-09-30T14:56:56.866228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:56.867073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:56.867079Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:56.867081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:56.867090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:56.867098Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2393 [2:7555896375324640425:10951]
2025-09-30T14:56:56.867114Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:56.867131Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:56.867135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:56.867139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:56.867142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:56.867159Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:56.867166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:56.867174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:56.867263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.867265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:56.867268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:56.867271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:56.867274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:56.867351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:56.867354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.867368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:56.867382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:56.867401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:56.867418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896375324640420:10951]
2025-09-30T14:56:56.867422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896375324640420:10951]
2025-09-30T14:56:56.867424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896375324640420:10951]
2025-09-30T14:56:56.867442Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:56.867455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:56.867471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:56.867474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:56.867631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896375324640420:10951]
2025-09-30T14:56:56.867634Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:56.867855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:56.867858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:56.867860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:56.867865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:56.868674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896375414421172:2454], now have 1 active actors on pipe
2025-09-30T14:56:56.868681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896375414421262:10241], now have 1 active actors on pipe
2025-09-30T14:56:56.868712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:56.868718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:56.868747Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa0e5c33-e91f6360-c626bbcd-6fca22de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:56.868756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:56.868760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:56.868763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:56.868776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:56.868789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:56.868805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:56.869249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:56.869254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:56.869272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:56.869418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2394 partition: 0 MaxSeqNo: 42 sessionId: src_id|fa0e5c33-e91f6360-c626bbcd-6fca22de_0
2025-09-30T14:56:56.869812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab8d86f9-9aba157d-983fdb78-33781e84_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fa0e5c33-e91f6360-c626bbcd-6fca22de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:56.872827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa0e5c33-e91f6360-c626bbcd-6fca22de_0] Write session: try to update token
2025-09-30T14:56:56.872851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa0e5c33-e91f6360-c626bbcd-6fca22de_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:56.881923Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:56.881949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:56.881960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896375324640420:10951]
2025-09-30T14:56:56.882010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:56.882198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:56.882341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:56.882491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:56.882642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:56.882825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:56.882863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:56.883602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:56.893637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896375414421533:4281]
2025-09-30T14:56:56.894878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2393, pipe: [1:7555896375414421533:4281]
2025-09-30T14:56:56.894831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896375414421533:4281], now have 1 active actors on pipe
2025-09-30T14:56:56.896786Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:56.896805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:56.896807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:56.896809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:56.896819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896375324640420:10951]
2025-09-30T14:56:56.896826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896375324640420:10951]
2025-09-30T14:56:56.896830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896375324640420:10951]
2025-09-30T14:56:56.896868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:56.896874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:56.896876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:56.897019Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:56.899425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:56.899434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:56.899439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:56.900199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2394 sessionId: src_id|fa0e5c33-e91f6360-c626bbcd-6fca22de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:56.903020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:57.017256Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:57.017707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:57.017732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:57.018009Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:57.017986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:57.018025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896375414421533:4281]
2025-09-30T14:56:57.018059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:57.018065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:57.018122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2394 reason: error at write: Disconnected sessionId: src_id|fa0e5c33-e91f6360-c626bbcd-6fca22de_0
2025-09-30T14:56:57.018300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2394 sessionId: src_id|fa0e5c33-e91f6360-c626bbcd-6fca22de_0 is DEAD
2025-09-30T14:56:57.018527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa0e5c33-e91f6360-c626bbcd-6fca22de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:57.018538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa0e5c33-e91f6360-c626bbcd-6fca22de_0] Write session will restart in 0.006040s
2025-09-30T14:56:57.018561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa0e5c33-e91f6360-c626bbcd-6fca22de_0] Write session: Do CDS request
2025-09-30T14:56:57.018566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa0e5c33-e91f6360-c626bbcd-6fca22de_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:57.026136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa0e5c33-e91f6360-c626bbcd-6fca22de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:57.026247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:57.026263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2395
2025-09-30T14:56:57.026375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2395 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:57.026406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2395 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:57.026413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2395 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:57.026417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:57.026953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2395 sessionId:  describe result for acl check
2025-09-30T14:56:57.026993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:57.026999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:57.027001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:57.027007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896379709388877:10245] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:57.027637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896379709388877:10245] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:57.029670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896379709388877:10245] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:57.036074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896379709388877:10245] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:57.036092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896379709388877:10245] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:57.036096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896379709388877:10245] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:57.036105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2395 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:57.047201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:57.049860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:57.050108Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:57.050118Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:57.050130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:57.050182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:57.050510Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896379619607967:10955]
2025-09-30T14:56:57.051194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:57.051618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:57.051673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:57.052011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:57.052091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:57.052101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:57.052102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:57.052103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:57.052105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:57.052106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:57.052107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:57.052108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:57.052110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:57.052111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:57.052112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.052114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.052115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.052116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:57.052117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:57.052124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:57.052135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:57.052139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:57.052143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:57.052148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:57.052152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:57.052157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:57.052161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:57.052164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:57.052169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:57.052173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.052177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.052182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.052185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:57.052189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:57.052200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:57.052207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:57.052213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:57.052218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:57.052227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:57.052231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:57.052236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:57.052253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:57.052259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:57.052266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:57.052269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:57.052275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:57.052279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:57.052283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:57.052287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:57.052292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:57.052296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:57.052301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:57.052312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:57.052317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:57.052320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.052325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.052330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.052339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.052343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.052348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.052356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:57.052361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:57.052364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:57.052369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:57.052412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:57.058055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:57.058924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:57.058942Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:57.058945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:57.058949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:57.058957Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2394 [2:7555896379619607967:10955]
2025-09-30T14:56:57.058975Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:57.058993Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:57.059002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:57.059006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:57.059008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:57.059024Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:57.059031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:57.059039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:57.059101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.059111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.059114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.059118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:57.059120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:57.059195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:57.059205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.059222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.059236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.059272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:57.059300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896379709388931:10245], now have 1 active actors on pipe
2025-09-30T14:56:57.059310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896379709388835:2454], now have 1 active actors on pipe
2025-09-30T14:56:57.059316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896379619607961:10955]
2025-09-30T14:56:57.059318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896379619607961:10955]
2025-09-30T14:56:57.059321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896379619607961:10955]
2025-09-30T14:56:57.059335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:57.059355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:57.059356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:57.059362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:57.059364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:57.059375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:57.059379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:57.059415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896379619607961:10955]
2025-09-30T14:56:57.059423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:57.059448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:57.059602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2394
2025-09-30T14:56:57.059648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2394
2025-09-30T14:56:57.059801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:57.059813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:57.059839Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8440ff2-4f643b78-4b8a8124-ba0805c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:57.059851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:57.059860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:57.059862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:57.059872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:57.059888Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:57.059907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:57.060082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:57.060092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:57.060104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:57.060202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2395 partition: 0 MaxSeqNo: 42 sessionId: src_id|d8440ff2-4f643b78-4b8a8124-ba0805c2_0
2025-09-30T14:56:57.060571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa0e5c33-e91f6360-c626bbcd-6fca22de_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d8440ff2-4f643b78-4b8a8124-ba0805c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:57.063433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8440ff2-4f643b78-4b8a8124-ba0805c2_0] Write session: try to update token
2025-09-30T14:56:57.063456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8440ff2-4f643b78-4b8a8124-ba0805c2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:57.072315Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:57.072342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:57.072344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:57.072347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:57.072357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896379619607961:10955]
2025-09-30T14:56:57.072363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896379619607961:10955]
2025-09-30T14:56:57.072367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896379619607961:10955]
2025-09-30T14:56:57.072415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:57.072427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:57.072433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.072434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:57.072436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:57.072438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:57.072588Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:57.084128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2395 sessionId: src_id|d8440ff2-4f643b78-4b8a8124-ba0805c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:57.086948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:57.118417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896379709389214:4281]
2025-09-30T14:56:57.118766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2394, pipe: [1:7555896379709389214:4281]
2025-09-30T14:56:57.190394Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:57.190688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:57.190703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:57.190723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896379709389214:4281], now have 1 active actors on pipe
2025-09-30T14:56:57.190949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896379709389214:4281]
2025-09-30T14:56:57.191092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:57.191102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:57.191140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:57.191170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2395 reason: error at write: Disconnected sessionId: src_id|d8440ff2-4f643b78-4b8a8124-ba0805c2_0
2025-09-30T14:56:57.190927Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:57.191386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2395 sessionId: src_id|d8440ff2-4f643b78-4b8a8124-ba0805c2_0 is DEAD
2025-09-30T14:56:57.191490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8440ff2-4f643b78-4b8a8124-ba0805c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:57.191498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8440ff2-4f643b78-4b8a8124-ba0805c2_0] Write session will restart in 0.009319s
2025-09-30T14:56:57.191521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8440ff2-4f643b78-4b8a8124-ba0805c2_0] Write session: Do CDS request
2025-09-30T14:56:57.191527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8440ff2-4f643b78-4b8a8124-ba0805c2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:57.201808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8440ff2-4f643b78-4b8a8124-ba0805c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:57.201954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:57.201970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2396
2025-09-30T14:56:57.202115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2396 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:57.202156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2396 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:57.202167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2396 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:57.202172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:57.202706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2396 sessionId:  describe result for acl check
2025-09-30T14:56:57.202744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:57.202751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:57.202753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:57.202759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896379709389297:10251] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:57.203342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896379709389297:10251] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:57.205648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896379709389297:10251] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:57.209034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896379709389297:10251] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:57.209049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896379709389297:10251] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:57.209053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896379709389297:10251] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:57.209062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2396 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:57.212787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:57.214683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:57.214878Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:57.214882Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:57.214892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:57.214948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:57.215110Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896379619608200:10957]
2025-09-30T14:56:57.215789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:57.216826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:57.216880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:57.217246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:57.217318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:57.217324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:57.217325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:57.217327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:57.217328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:57.217329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:57.217331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:57.217332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:57.217333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:57.217334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:57.217336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.217337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.217338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.217339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:57.217340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:57.217346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:57.217357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:57.217361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:57.217364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:57.217368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:57.217372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:57.217376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:57.217380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:57.217383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:57.217387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:57.217391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.217395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.217399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.217404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:57.217408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:57.217484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:57.217499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:57.217506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:57.217513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:57.217522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:57.217528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:57.217538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:57.217543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:57.217548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:57.217558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:57.217563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:57.217574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:57.217579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:57.217588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:57.217593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:57.217598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:57.217608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:57.217613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:57.217622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:57.217627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:57.217632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.217637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.217642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.217812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.217826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.217832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.217837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:57.217842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:57.217847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:57.217853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:57.217909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:57.223893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:57.225182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:57.225211Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:57.225214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:57.225218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:57.225227Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2395 [2:7555896379619608200:10957]
2025-09-30T14:56:57.225247Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:57.225265Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:57.225273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:57.225275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:57.225278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:57.225294Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:57.225306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:57.225312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:57.225374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.225381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.225385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.225389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:57.225392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:57.225463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:57.225470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.225485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.225502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.225524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:57.225544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896379619608195:10957]
2025-09-30T14:56:57.225551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896379619608195:10957]
2025-09-30T14:56:57.225553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896379619608195:10957]
2025-09-30T14:56:57.225562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:57.225575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:57.225589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:57.225598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:57.225602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:57.225606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:57.225609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:57.225637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896379619608195:10957]
2025-09-30T14:56:57.225645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:57.225647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:57.225655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896379709389220:2454], now have 1 active actors on pipe
2025-09-30T14:56:57.225664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896379709389532:10251], now have 1 active actors on pipe
2025-09-30T14:56:57.226359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2395
2025-09-30T14:56:57.226349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2395
2025-09-30T14:56:57.226560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:57.226573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:57.226607Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8e43a4e-14d883e7-cbe684a2-b97b29e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:57.226622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:57.226631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:57.226633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:57.226643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:57.226658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:57.226691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:57.226877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:57.226885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:57.226900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:57.226979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2396 partition: 0 MaxSeqNo: 42 sessionId: src_id|b8e43a4e-14d883e7-cbe684a2-b97b29e4_0
2025-09-30T14:56:57.227421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8440ff2-4f643b78-4b8a8124-ba0805c2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b8e43a4e-14d883e7-cbe684a2-b97b29e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:57.230257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e43a4e-14d883e7-cbe684a2-b97b29e4_0] Write session: try to update token
2025-09-30T14:56:57.230278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e43a4e-14d883e7-cbe684a2-b97b29e4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:57.239837Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:57.239858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:57.239861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:57.239863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:57.239873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896379619608195:10957]
2025-09-30T14:56:57.239878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896379619608195:10957]
2025-09-30T14:56:57.239882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896379619608195:10957]
2025-09-30T14:56:57.239924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:57.239933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.239936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:57.240087Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:57.241361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:57.241380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:57.241385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:57.255675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2396 sessionId: src_id|b8e43a4e-14d883e7-cbe684a2-b97b29e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:57.258507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:57.290947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896379709389588:4281]
2025-09-30T14:56:57.291420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2395, pipe: [1:7555896379709389588:4281]
2025-09-30T14:56:57.359359Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:57.359731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:57.359748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:57.359770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896379709389588:4281], now have 1 active actors on pipe
2025-09-30T14:56:57.360354Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:57.360385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:57.360912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e43a4e-14d883e7-cbe684a2-b97b29e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:57.360924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e43a4e-14d883e7-cbe684a2-b97b29e4_0] Write session will restart in 0.006384s
2025-09-30T14:56:57.360949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e43a4e-14d883e7-cbe684a2-b97b29e4_0] Write session: Do CDS request
2025-09-30T14:56:57.360964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e43a4e-14d883e7-cbe684a2-b97b29e4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:57.360441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896379709389588:4281]
2025-09-30T14:56:57.360469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:57.360552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2396 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b8e43a4e-14d883e7-cbe684a2-b97b29e4_0
2025-09-30T14:56:57.360739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2396 sessionId: src_id|b8e43a4e-14d883e7-cbe684a2-b97b29e4_0 is DEAD
2025-09-30T14:56:57.368765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e43a4e-14d883e7-cbe684a2-b97b29e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:57.368889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:57.368916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2397
2025-09-30T14:56:57.369026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2397 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:57.369069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2397 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:57.369075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2397 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:57.369079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:57.369576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2397 sessionId:  describe result for acl check
2025-09-30T14:56:57.369622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:57.369624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:57.369626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:57.369631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896379709389605:10255] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:57.370185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896379709389605:10255] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:57.372639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896379709389605:10255] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:57.375791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896379709389605:10255] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:57.375801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896379709389605:10255] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:57.375805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896379709389605:10255] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:57.375813Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2397 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:57.382715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:57.384780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:57.385123Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:57.385136Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:57.385149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:57.385231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:57.385294Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896379619608434:10959]
2025-09-30T14:56:57.385908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:57.386217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:57.386277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:57.386623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:57.386704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:57.386713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:57.386715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:57.386716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:57.386717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:57.386719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:57.386720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:57.386722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:57.386723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:57.386724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:57.386725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.386727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.386728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.386729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:57.386730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:57.386737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:57.386747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:57.386750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:57.386754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:57.386758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:57.386761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:57.386765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:57.386769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:57.386773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:57.386778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:57.386781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.386785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.386789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.386792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:57.386796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:57.386807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:57.386814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:57.386821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:57.386826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:57.386831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:57.386836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:57.386841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:57.386846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:57.386851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:57.386855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:57.386859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:57.386863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:57.386868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:57.386873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:57.386878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:57.386883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:57.386891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:57.386897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:57.386902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:57.386907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:57.386912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.386917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.386921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.386926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.386931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.386936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.386941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:57.386945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:57.386949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:57.386953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:57.386990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:57.392753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:57.394082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:57.394105Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:57.394108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:57.394113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:57.394121Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2396 [2:7555896379619608434:10959]
2025-09-30T14:56:57.394139Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:57.394157Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:57.394166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:57.394170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:57.394172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:57.394189Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:57.394202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:57.394214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:57.394291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.394299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.394301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.394305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:57.394309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:57.394382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:57.394391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.394410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.394423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.394441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:57.394470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896379709389590:2454], now have 1 active actors on pipe
2025-09-30T14:56:57.394474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896379709389782:10255], now have 1 active actors on pipe
2025-09-30T14:56:57.394481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896379619608429:10959]
2025-09-30T14:56:57.394483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896379619608429:10959]
2025-09-30T14:56:57.394485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896379619608429:10959]
2025-09-30T14:56:57.394503Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:57.394517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:57.394533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:57.394537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:57.394536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:57.394540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:57.394543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:57.394579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896379619608429:10959]
2025-09-30T14:56:57.394587Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:57.394605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:57.394700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2396
2025-09-30T14:56:57.394752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2396
2025-09-30T14:56:57.394891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:57.394903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:57.394934Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d264cd8-b5f737f6-f6c9f226-d8d88ee5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:57.394946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:57.394956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:57.394958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:57.394969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:57.394980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:57.395001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:57.395205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:57.395215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:57.395229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:57.395338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2397 partition: 0 MaxSeqNo: 42 sessionId: src_id|8d264cd8-b5f737f6-f6c9f226-d8d88ee5_0
2025-09-30T14:56:57.395707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e43a4e-14d883e7-cbe684a2-b97b29e4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8d264cd8-b5f737f6-f6c9f226-d8d88ee5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:57.398751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d264cd8-b5f737f6-f6c9f226-d8d88ee5_0] Write session: try to update token
2025-09-30T14:56:57.398773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d264cd8-b5f737f6-f6c9f226-d8d88ee5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:57.407901Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:57.407925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:57.407937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896379619608429:10959]
2025-09-30T14:56:57.407992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:57.408187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:57.408346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:57.408500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:57.408573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:57.408663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:57.408838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:57.408874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:57.423819Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:57.423841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:57.423843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:57.423845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:57.423856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896379619608429:10959]
2025-09-30T14:56:57.423860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896379619608429:10959]
2025-09-30T14:56:57.423863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896379619608429:10959]
2025-09-30T14:56:57.423905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:57.423912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.423915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:57.423923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:57.423932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:57.423937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:57.424072Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:57.433620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2397 sessionId: src_id|8d264cd8-b5f737f6-f6c9f226-d8d88ee5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:57.436570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:57.463323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896379709389953:4281]
2025-09-30T14:56:57.467567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2396, pipe: [1:7555896379709389953:4281]
2025-09-30T14:56:57.537908Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:57.538406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:57.538416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:57.538436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896379709389953:4281], now have 1 active actors on pipe
2025-09-30T14:56:57.538661Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:57.539177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:57.539178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896379709389953:4281]
2025-09-30T14:56:57.539210Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:57.539295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2397 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8d264cd8-b5f737f6-f6c9f226-d8d88ee5_0
2025-09-30T14:56:57.539464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2397 sessionId: src_id|8d264cd8-b5f737f6-f6c9f226-d8d88ee5_0 is DEAD
2025-09-30T14:56:57.543970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d264cd8-b5f737f6-f6c9f226-d8d88ee5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:57.543985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d264cd8-b5f737f6-f6c9f226-d8d88ee5_0] Write session will restart in 0.007804s
2025-09-30T14:56:57.544010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d264cd8-b5f737f6-f6c9f226-d8d88ee5_0] Write session: Do CDS request
2025-09-30T14:56:57.544016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d264cd8-b5f737f6-f6c9f226-d8d88ee5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:57.552802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d264cd8-b5f737f6-f6c9f226-d8d88ee5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:57.552880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:57.552904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2398
2025-09-30T14:56:57.553046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2398 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:57.553082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2398 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:57.553086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2398 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:57.553091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:57.553574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2398 sessionId:  describe result for acl check
2025-09-30T14:56:57.553606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:57.553613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:57.553615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:57.553620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896379709390026:10259] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:57.554165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896379709390026:10259] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:57.556906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896379709390026:10259] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:57.561651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896379709390026:10259] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:57.561670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896379709390026:10259] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:57.561673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896379709390026:10259] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:57.561683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2398 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:57.571269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:57.573929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:57.574111Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:57.574115Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:57.574125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:57.574190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:57.574240Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896379619608672:10962]
2025-09-30T14:56:57.574867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:57.575213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:57.575279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:57.575620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:57.575709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:57.575717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:57.575718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:57.575720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:57.575721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:57.575723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:57.575724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:57.575726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:57.575727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:57.575728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:57.575730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.575731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.575732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.575733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:57.575735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:57.575741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:57.575753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:57.575757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:57.575762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:57.575766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:57.575770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:57.575774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:57.575778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:57.575782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:57.575787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:57.575791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.575795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.575799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.575803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:57.575807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:57.575816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:57.575824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:57.575831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:57.575836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:57.575841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:57.575846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:57.575851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:57.575856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:57.575861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:57.575866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:57.575870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:57.575875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:57.575880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:57.575886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:57.575891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:57.575900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:57.575905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:57.575916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:57.575921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:57.575927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:57.575936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.575944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.575954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.575959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.575964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.575975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.575979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:57.575990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:57.575995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:57.576000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:57.576049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:57.582381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:57.584070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:57.584096Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:57.584099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:57.584103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:57.584111Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2397 [2:7555896379619608672:10962]
2025-09-30T14:56:57.584133Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:57.584151Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:57.584155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:57.584158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:57.584160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:57.584180Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:57.584187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:57.584195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:57.584271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.584280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.584282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.584286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:57.584288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:57.584366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:57.584375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.584393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.584405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.584422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:57.584441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896379619608667:10962]
2025-09-30T14:56:57.584447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896379619608667:10962]
2025-09-30T14:56:57.584450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896379619608667:10962]
2025-09-30T14:56:57.584460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:57.584482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:57.584485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:57.584499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:57.584500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:57.584504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:57.584510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:57.584515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896379709389956:2454], now have 1 active actors on pipe
2025-09-30T14:56:57.584519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896379709390197:10259], now have 1 active actors on pipe
2025-09-30T14:56:57.584561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896379619608667:10962]
2025-09-30T14:56:57.584576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:57.584599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:57.584653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2397
2025-09-30T14:56:57.584705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2397
2025-09-30T14:56:57.584771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:57.584782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:57.584809Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d4a820f-680421e4-4b848fe1-68bd06ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:57.584821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:57.584829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:57.584833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:57.584846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:57.584861Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:57.584880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:57.585042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:57.585051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:57.585070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:57.585147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2398 partition: 0 MaxSeqNo: 42 sessionId: src_id|8d4a820f-680421e4-4b848fe1-68bd06ce_0
2025-09-30T14:56:57.585564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d264cd8-b5f737f6-f6c9f226-d8d88ee5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8d4a820f-680421e4-4b848fe1-68bd06ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:57.588746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d4a820f-680421e4-4b848fe1-68bd06ce_0] Write session: try to update token
2025-09-30T14:56:57.588769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d4a820f-680421e4-4b848fe1-68bd06ce_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:57.598141Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:57.598171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:57.598175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:57.598178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:57.598190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896379619608667:10962]
2025-09-30T14:56:57.598196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896379619608667:10962]
2025-09-30T14:56:57.598202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896379619608667:10962]
2025-09-30T14:56:57.598257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:57.598267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.598270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:57.598278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:57.598285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:57.598289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:57.598463Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:57.614750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2398 sessionId: src_id|8d4a820f-680421e4-4b848fe1-68bd06ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:57.617663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:57.639619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896379709390333:4281]
2025-09-30T14:56:57.639912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2397, pipe: [1:7555896379709390333:4281]
2025-09-30T14:56:57.716802Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:57.717291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:57.717299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:57.717317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896379709390333:4281], now have 1 active actors on pipe
2025-09-30T14:56:57.717574Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:57.718057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896379709390333:4281]
2025-09-30T14:56:57.718088Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:57.718125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:57.718209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2398 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8d4a820f-680421e4-4b848fe1-68bd06ce_0
2025-09-30T14:56:57.718567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d4a820f-680421e4-4b848fe1-68bd06ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:57.718577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d4a820f-680421e4-4b848fe1-68bd06ce_0] Write session will restart in 0.009777s
2025-09-30T14:56:57.718601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d4a820f-680421e4-4b848fe1-68bd06ce_0] Write session: Do CDS request
2025-09-30T14:56:57.718608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d4a820f-680421e4-4b848fe1-68bd06ce_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:57.718860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2398 sessionId: src_id|8d4a820f-680421e4-4b848fe1-68bd06ce_0 is DEAD
2025-09-30T14:56:57.729762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d4a820f-680421e4-4b848fe1-68bd06ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:57.729838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:57.729854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2399
2025-09-30T14:56:57.731484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2399 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:57.731539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2399 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:57.731545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2399 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:57.731551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:57.732661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2399 sessionId:  describe result for acl check
2025-09-30T14:56:57.732698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:57.732705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:57.732707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:57.732713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896379709390445:10271] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:57.733280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896379709390445:10271] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:57.735398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896379709390445:10271] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:57.738420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896379709390445:10271] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:57.738436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896379709390445:10271] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:57.738440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896379709390445:10271] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:57.738448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2399 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:57.742498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:57.744545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:57.744797Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:57.744829Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:57.744851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:57.744948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:57.745008Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896379619608945:10976]
2025-09-30T14:56:57.745799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:57.746175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:57.746253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:57.746622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:57.746693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:57.746700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:57.746701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:57.746702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:57.746704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:57.746705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:57.746706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:57.746707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:57.746709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:57.746710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:57.746711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.746713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.746714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.746715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:57.746716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:57.746722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:57.746733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:57.746738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:57.746742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:57.746746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:57.746750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:57.746754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:57.746759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:57.746763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:57.746768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:57.746772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.746776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.746781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.746785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:57.746789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:57.746797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:57.746805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:57.746812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:57.746818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:57.746823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:57.746828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:57.746834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:57.746839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:57.746844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:57.746850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:57.746855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:57.746860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:57.746868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:57.746878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:57.746881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:57.746884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:57.746886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:57.746890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:57.746892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:57.746895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:57.746898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.746901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.746904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.746907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.746910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.746915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.746917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:57.746920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:57.746923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:57.746926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:57.746960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:57.752708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:57.754058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:57.754077Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:57.754080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:57.754084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:57.754092Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2398 [2:7555896379619608945:10976]
2025-09-30T14:56:57.754109Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:57.754126Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:57.754130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:57.754133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:57.754135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:57.754156Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:57.754168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:57.754175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:57.754231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.754238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.754239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.754242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:57.754244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:57.754302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:57.754308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.754317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.754328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.754338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:57.754357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896379709390645:10271], now have 1 active actors on pipe
2025-09-30T14:56:57.754363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896379709390346:2454], now have 1 active actors on pipe
2025-09-30T14:56:57.754369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896379619608940:10976]
2025-09-30T14:56:57.754371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896379619608940:10976]
2025-09-30T14:56:57.754372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896379619608940:10976]
2025-09-30T14:56:57.754378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:57.754387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:57.754397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:57.754396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:57.754399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:57.754400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:57.754402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:57.754427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896379619608940:10976]
2025-09-30T14:56:57.754442Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:57.754456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:57.754467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2398
2025-09-30T14:56:57.754579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:57.754594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:57.754622Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63e6753b-fb1689f6-889031f8-8333d172_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:57.754635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:57.754639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:57.754646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:57.754658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:57.754674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:57.754697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:57.754846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:57.754854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:57.754869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:57.754894Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2398
2025-09-30T14:56:57.754949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2399 partition: 0 MaxSeqNo: 42 sessionId: src_id|63e6753b-fb1689f6-889031f8-8333d172_0
2025-09-30T14:56:57.755368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d4a820f-680421e4-4b848fe1-68bd06ce_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|63e6753b-fb1689f6-889031f8-8333d172_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:57.758259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63e6753b-fb1689f6-889031f8-8333d172_0] Write session: try to update token
2025-09-30T14:56:57.758280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63e6753b-fb1689f6-889031f8-8333d172_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:57.767295Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:57.767316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:57.767326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896379619608940:10976]
2025-09-30T14:56:57.767376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:57.767379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:57.767563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:57.767717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:57.767863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:57.768009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:57.768210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:57.768247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:57.773944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2399 sessionId: src_id|63e6753b-fb1689f6-889031f8-8333d172_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:57.776842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:57.777066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:57.777090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:57.777127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:57.777210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:57.779563Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:57.779588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:57.779591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:57.779593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:57.779607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896379619608940:10976]
2025-09-30T14:56:57.779611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896379619608940:10976]
2025-09-30T14:56:57.779615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896379619608940:10976]
2025-09-30T14:56:57.779655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:57.779662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.779665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:57.779673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:57.779679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:57.779683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:57.779816Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:57.818317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896379709390712:4281]
2025-09-30T14:56:57.818614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2398, pipe: [1:7555896379709390712:4281]
2025-09-30T14:56:57.897715Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:57.905889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:57.905921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:57.906101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:57.906174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:57.906249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:57.906318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:57.906367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:57.906377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:57.906453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:57.906521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:57.906588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:57.906655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:57.906698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:57.906707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:57.906775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:57.906838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:57.906905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:57.906972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:57.907023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:57.907032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:57.907108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:57.907175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:57.907238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:57.907327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:57.907373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:57.907380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:57.907455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:57.907540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:57.907616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:57.907688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:57.907738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:57.907747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:57.907823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:57.907915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:57.907988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:57.908064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:57.908116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:57.908125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:57.908197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:57.908269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:57.908343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:57.908416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:57.908468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:57.908476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:57.908554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:57.908649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:57.908723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:57.908794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:57.908841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:57.908848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:57.908947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:57.909013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:57.909077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:57.909156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:57.909233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:57.909241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:57.909312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:56:57.909378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:56:57.909442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:56:57.909515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:56:57.909563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:56:57.909578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:56:57.909653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896379709390712:4281], now have 1 active actors on pipe
2025-09-30T14:56:57.910030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:57.910042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:57.910047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:57.910078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2399 reason: error at write: Disconnected sessionId: src_id|63e6753b-fb1689f6-889031f8-8333d172_0
2025-09-30T14:56:57.910106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896379709390712:4281]
2025-09-30T14:56:57.910287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2399 sessionId: src_id|63e6753b-fb1689f6-889031f8-8333d172_0 is DEAD
2025-09-30T14:56:57.910445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63e6753b-fb1689f6-889031f8-8333d172_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:57.910456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63e6753b-fb1689f6-889031f8-8333d172_0] Write session will restart in 0.007911s
2025-09-30T14:56:57.910479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63e6753b-fb1689f6-889031f8-8333d172_0] Write session: Do CDS request
2025-09-30T14:56:57.910485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63e6753b-fb1689f6-889031f8-8333d172_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:57.911101Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:57.919769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63e6753b-fb1689f6-889031f8-8333d172_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:57.919878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:57.919895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2400
2025-09-30T14:56:57.920044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2400 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:57.920078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2400 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:57.920088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2400 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:57.920092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:57.920548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2400 sessionId:  describe result for acl check
2025-09-30T14:56:57.920584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:57.920586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:57.920588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:57.920594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896379709390812:10275] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:57.921158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896379709390812:10275] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:57.923693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896379709390812:10275] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:57.926762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896379709390812:10275] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:57.926776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896379709390812:10275] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:57.926780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896379709390812:10275] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:57.926788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2400 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:57.930880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:57.932769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:57.932962Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:57.932971Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:57.932981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:57.933030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:57.933062Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896379619609195:10978]
2025-09-30T14:56:57.933682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:57.934033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:57.934087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:57.934456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:57.934523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:57.934529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:57.934530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:57.934532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:57.934533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:57.934534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:57.934535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:57.934536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:57.934538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:57.934539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:57.934541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.934542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.934543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.934544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:57.934546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:57.934552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:57.934562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:57.934566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:57.934570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:57.934575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:57.934577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:57.934580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:57.934582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:57.934584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:57.934587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:57.934589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.934592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.934594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.934597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:57.934599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:57.934606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:57.934612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:57.934616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:57.934619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:57.934622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:57.934625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:57.934628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:57.934630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:57.934633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:57.934636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:57.934639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:57.934642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:57.934645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:57.934648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:57.934650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:57.934653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:57.934656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:57.934660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:57.934662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:57.934665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:57.934668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.934672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.934674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.934677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.934680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.934682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.934685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:57.934687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:57.934690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:57.934693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:57.934716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:57.940120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:57.941163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:57.941181Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:57.941184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:57.941189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:57.941213Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2399 [2:7555896379619609195:10978]
2025-09-30T14:56:57.941231Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:57.941251Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:57.941259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:57.941262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:57.941267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:57.941284Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:57.941296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:57.941305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:57.941373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.941381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.941384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.941388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:57.941391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:57.941459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:57.941469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.941481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:57.941492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:57.941516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:57.941539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896379709390715:2454], now have 1 active actors on pipe
2025-09-30T14:56:57.941546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896379709391012:10275], now have 1 active actors on pipe
2025-09-30T14:56:57.941552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896379619609190:10978]
2025-09-30T14:56:57.941555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896379619609190:10978]
2025-09-30T14:56:57.941557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896379619609190:10978]
2025-09-30T14:56:57.941569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:57.941581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:57.941589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:57.941589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:57.941591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:57.941604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:57.941608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:57.941643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896379619609190:10978]
2025-09-30T14:56:57.941655Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:57.941661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:57.941687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2399
2025-09-30T14:56:57.941702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:57.941726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2399
2025-09-30T14:56:57.941712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:57.941736Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2e09274-c72d49f-834df4c7-340cd3d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:57.941743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:57.941749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:57.941756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:57.941766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:57.941779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:57.941803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:57.941980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:57.941997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:57.942040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:57.942174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2400 partition: 0 MaxSeqNo: 42 sessionId: src_id|c2e09274-c72d49f-834df4c7-340cd3d6_0
2025-09-30T14:56:57.942560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63e6753b-fb1689f6-889031f8-8333d172_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c2e09274-c72d49f-834df4c7-340cd3d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:57.945536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2e09274-c72d49f-834df4c7-340cd3d6_0] Write session: try to update token
2025-09-30T14:56:57.945557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2e09274-c72d49f-834df4c7-340cd3d6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:57.954148Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:57.954170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:57.954173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:57.954175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:57.954185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896379619609190:10978]
2025-09-30T14:56:57.954188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896379619609190:10978]
2025-09-30T14:56:57.954192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896379619609190:10978]
2025-09-30T14:56:57.954229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:57.954236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:57.954239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:57.954239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:57.954245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:57.954250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:57.954380Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:57.963876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2400 sessionId: src_id|c2e09274-c72d49f-834df4c7-340cd3d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:57.966456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:58.010298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896384004358378:4281]
2025-09-30T14:56:58.010677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2399, pipe: [1:7555896384004358378:4281]
2025-09-30T14:56:58.068255Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:58.068800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:58.068814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:58.068833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896384004358378:4281], now have 1 active actors on pipe
2025-09-30T14:56:58.069058Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:58.069587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2e09274-c72d49f-834df4c7-340cd3d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:58.069599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2e09274-c72d49f-834df4c7-340cd3d6_0] Write session will restart in 0.005327s
2025-09-30T14:56:58.069621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2e09274-c72d49f-834df4c7-340cd3d6_0] Write session: Do CDS request
2025-09-30T14:56:58.069628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2e09274-c72d49f-834df4c7-340cd3d6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:58.069094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:58.069153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:58.069163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896384004358378:4281]
2025-09-30T14:56:58.069251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2400 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c2e09274-c72d49f-834df4c7-340cd3d6_0
2025-09-30T14:56:58.069440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2400 sessionId: src_id|c2e09274-c72d49f-834df4c7-340cd3d6_0 is DEAD
2025-09-30T14:56:58.075743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2e09274-c72d49f-834df4c7-340cd3d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:58.075843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:58.075859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2401
2025-09-30T14:56:58.075979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2401 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:58.076029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2401 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:58.076041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2401 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:58.076046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:58.076507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2401 sessionId:  describe result for acl check
2025-09-30T14:56:58.076541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:58.076547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:58.076549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:58.076555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896384004358394:10279] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:58.077098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896384004358394:10279] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:58.079227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896384004358394:10279] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:58.081715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896384004358394:10279] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:58.081729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896384004358394:10279] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:58.081733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896384004358394:10279] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:58.081740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2401 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:58.088733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:58.090501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:58.090690Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:58.090701Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:58.090711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:58.090762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:58.090805Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896383914576732:10982]
2025-09-30T14:56:58.091516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:58.091922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:58.091996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:58.092392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:58.092461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:58.092467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:58.092468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:58.092470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:58.092471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:58.092472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:58.092474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:58.092475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:58.092477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:58.092478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:58.092479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.092481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.092482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.092483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:58.092484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:58.092490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:58.092501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:58.092505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:58.092510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:58.092514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:58.092518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:58.092522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:58.092527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:58.092531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:58.092535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:58.092540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.092544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.092548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.092552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:58.092556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:58.092563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:58.092572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:58.092577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:58.092584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:58.092587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:58.092591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:58.092593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:58.092597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:58.092600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:58.092604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:58.092608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:58.092614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:58.092621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:58.092626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:58.092631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:58.092641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:58.092644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:58.092658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:58.092664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:58.092669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:58.092672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.092675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.092678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.092681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.092684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.092687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.092690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:58.092693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:58.092695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:58.092712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:58.092744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:58.098324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:58.099690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:58.099705Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:58.099708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:58.099712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:58.099719Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2400 [2:7555896383914576732:10982]
2025-09-30T14:56:58.099736Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:58.099751Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:58.099754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:58.099757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:58.099759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:58.099776Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:58.099782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:58.099789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:58.099853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.099861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.099864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.099867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:58.099870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:58.099939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:58.099949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.099961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.099974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.099992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:58.100008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896383914576727:10982]
2025-09-30T14:56:58.100011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896383914576727:10982]
2025-09-30T14:56:58.100013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896383914576727:10982]
2025-09-30T14:56:58.100024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:58.100034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:58.100038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896384004358542:10279], now have 1 active actors on pipe
2025-09-30T14:56:58.100042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896384004358379:2454], now have 1 active actors on pipe
2025-09-30T14:56:58.100050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:58.100055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:58.100058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:58.100064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:58.100067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:58.100099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896383914576727:10982]
2025-09-30T14:56:58.100112Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:58.100120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:58.100123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2400
2025-09-30T14:56:58.100140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2400
2025-09-30T14:56:58.100233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:58.100250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:58.100283Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f2298f9-87a57a39-368086b5-5993c8d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:58.100297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:58.100302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:58.100304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:58.100316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:58.100329Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:58.100350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:58.100541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:58.100555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:58.100579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:58.100681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2401 partition: 0 MaxSeqNo: 42 sessionId: src_id|7f2298f9-87a57a39-368086b5-5993c8d8_0
2025-09-30T14:56:58.101046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2e09274-c72d49f-834df4c7-340cd3d6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7f2298f9-87a57a39-368086b5-5993c8d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:58.103969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f2298f9-87a57a39-368086b5-5993c8d8_0] Write session: try to update token
2025-09-30T14:56:58.103989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f2298f9-87a57a39-368086b5-5993c8d8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:58.112325Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:58.112346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:58.112348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:58.112351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:58.112360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896383914576727:10982]
2025-09-30T14:56:58.112366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896383914576727:10982]
2025-09-30T14:56:58.112370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896383914576727:10982]
2025-09-30T14:56:58.112415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:58.112419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:58.112422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.112424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:58.112426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:58.112430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:58.112572Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:58.119009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2401 sessionId: src_id|7f2298f9-87a57a39-368086b5-5993c8d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:58.121826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:58.168498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896384004358762:4281]
2025-09-30T14:56:58.168777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2400, pipe: [1:7555896384004358762:4281]
2025-09-30T14:56:58.226005Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:58.226446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:58.226466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:58.226490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896384004358762:4281], now have 1 active actors on pipe
2025-09-30T14:56:58.226756Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:58.226755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:58.226802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896384004358762:4281]
2025-09-30T14:56:58.226810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:58.226820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:58.226822Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:56:58.226879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2401 reason: error at write: Disconnected sessionId: src_id|7f2298f9-87a57a39-368086b5-5993c8d8_0
2025-09-30T14:56:58.226941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2401 sessionId: src_id|7f2298f9-87a57a39-368086b5-5993c8d8_0 is DEAD
2025-09-30T14:56:58.227037Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 24 consumer shared/user session shared/user_1_24_14968926697881889462_v1 is DEAD
2025-09-30T14:56:58.227165Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896306694918963:4264] disconnected; active server actors: 1
2025-09-30T14:56:58.227173Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896306694918963:4264] client user disconnected session shared/user_1_24_14968926697881889462_v1
2025-09-30T14:56:58.227434Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:56:58.227443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f2298f9-87a57a39-368086b5-5993c8d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:58.227455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f2298f9-87a57a39-368086b5-5993c8d8_0] Write session will restart in 0.005244s
2025-09-30T14:56:58.227479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f2298f9-87a57a39-368086b5-5993c8d8_0] Write session: Do CDS request
2025-09-30T14:56:58.227485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f2298f9-87a57a39-368086b5-5993c8d8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:58.227549Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:56:58.227555Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:56:58.227561Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.006244s
2025-09-30T14:56:58.233805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f2298f9-87a57a39-368086b5-5993c8d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:58.233913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:58.233929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2402
2025-09-30T14:56:58.234070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2402 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:58.234105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2402 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:58.234111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2402 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:58.234115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:58.234568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2402 sessionId:  describe result for acl check
2025-09-30T14:56:58.234897Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:56:58.234602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:58.234610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:58.234612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:58.234619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896384004358775:10287] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:58.235169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896384004358775:10287] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:58.235960Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:56:58.235968Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 25
2025-09-30T14:56:58.236131Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 25 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:56:58.236177Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:56:58.236258Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 auth for : user
2025-09-30T14:56:58.236432Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 Handle describe topics response
2025-09-30T14:56:58.236463Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 auth is DEAD
2025-09-30T14:56:58.236465Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:56:58.236692Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:56:58.236797Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896384004358795:10290] connected; active server actors: 1
2025-09-30T14:56:58.236820Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555896384004358795:10290] session shared/user_1_25_8737291799463228422_v1
2025-09-30T14:56:58.236829Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:56:58.236842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:56:58.236849Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_25_8737291799463228422_v1" (Sender=[1:7555896384004358783:10290], Pipe=[1:7555896384004358795:10290], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:56:58.236853Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:56:58.237361Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_25_8737291799463228422_v1
2025-09-30T14:56:58.236864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:56:58.236878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_25_8737291799463228422_v1" (Sender=[1:7555896384004358783:10290], Pipe=[1:7555896384004358795:10290], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:56:58.236888Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_25_8737291799463228422_v1" sender [1:7555896384004358783:10290] lock partition 0 for ReadingSession "shared/user_1_25_8737291799463228422_v1" (Sender=[1:7555896384004358783:10290], Pipe=[1:7555896384004358795:10290], Partitions=[], ActiveFamilyCount=1) generation 1 step 25
2025-09-30T14:56:58.236897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:56:58.236901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000029s
2025-09-30T14:56:58.237130Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 25 Session: "shared/user_1_25_8737291799463228422_v1" ClientId: "user" PipeClient { RawX1: 7555896384004358795 RawX2: 4503603922348082 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:56:58.237146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:56:58.237805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896384004358775:10287] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:58.243933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896384004358775:10287] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:58.243950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896384004358775:10287] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:58.243953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896384004358775:10287] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:58.243961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2402 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:58.254096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:58.256360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:58.256581Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:58.256595Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:58.256605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:58.256656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:58.256699Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896383914576973:10984]
2025-09-30T14:56:58.257355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:58.257690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:58.257734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:58.258047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:58.258403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:58.258411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:58.258413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:58.258414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:58.258415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:58.258416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:58.258417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:58.258418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:58.258420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:58.258421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:58.258422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.258423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.258425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.258426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:58.258427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:58.258433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:58.258443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:58.258447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:58.258452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:58.258455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:58.258459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:58.258463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:58.258467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:58.258470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:58.258474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:58.258478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.258482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.258486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.258489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:58.258493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:58.258504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:58.258513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:58.258518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:58.258524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:58.258528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:58.258533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:58.258536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:58.258541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:58.258545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:58.258550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:58.258554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:58.258560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:58.258565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:58.258570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:58.258574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:58.258578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:58.258583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:58.258587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:58.258591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:58.258597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:58.258601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.258613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.258617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.258622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.258626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.258636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.258640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:58.258646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:58.258655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:58.258660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:58.258707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:58.264301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:58.265170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:58.265188Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:58.265207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:58.265212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:58.265219Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2401 [2:7555896383914576973:10984]
2025-09-30T14:56:58.265238Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:58.265255Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:58.265263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:58.265266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:58.265269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:58.265285Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:58.265296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:58.265303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:58.265363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.265371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.265373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.265377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:58.265380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:58.265449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:58.265460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.265471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.265483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.265499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:58.265518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896384004358861:10287], now have 1 active actors on pipe
2025-09-30T14:56:58.265528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896384004358805:10294], now have 1 active actors on pipe
2025-09-30T14:56:58.265531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896384004358768:2454], now have 1 active actors on pipe
2025-09-30T14:56:58.265537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896383914576968:10984]
2025-09-30T14:56:58.265539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896383914576968:10984]
2025-09-30T14:56:58.265542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896383914576968:10984]
2025-09-30T14:56:58.265556Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:58.265570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:58.265589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:58.265587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:58.265592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:58.265594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:58.265597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:58.265578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2401
2025-09-30T14:56:58.265598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2401, pipe: [1:7555896384004358805:10294]
2025-09-30T14:56:58.265615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2401
2025-09-30T14:56:58.265630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896383914576968:10984]
2025-09-30T14:56:58.265643Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:58.265645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:58.265673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:58.265678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:58.265688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_25_8737291799463228422_v1 on pipe: [1:7555896384004358805:10294]
2025-09-30T14:56:58.265705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:58.265708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:58.265715Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_25_8737291799463228422_v1:1 with generation 2401
2025-09-30T14:56:58.265742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:58.265746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:58.265749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:58.265767Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_25_8737291799463228422_v1
2025-09-30T14:56:58.265770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:58.265801Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a97c420-fd1df12b-21b394da-3ab5d96f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:58.265806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:56:58.265818Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:56:58.267944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:56:58.267976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:56:58.267984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:58.267989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:58.267992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:58.268003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:58.268014Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:58.268025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:56:58.268040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:56:58.268059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:58.268181Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759244218265 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:56:58.268200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:56:58.268259Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 sending to client partition status
2025-09-30T14:56:58.268320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:58.268336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:58.268376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:58.268474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2402 partition: 0 MaxSeqNo: 42 sessionId: src_id|1a97c420-fd1df12b-21b394da-3ab5d96f_0
2025-09-30T14:56:58.268740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f2298f9-87a57a39-368086b5-5993c8d8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1a97c420-fd1df12b-21b394da-3ab5d96f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:58.271797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a97c420-fd1df12b-21b394da-3ab5d96f_0] Write session: try to update token
2025-09-30T14:56:58.271818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a97c420-fd1df12b-21b394da-3ab5d96f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:58.277736Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:58.277756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:58.277762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:58.277765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:58.277773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896383914576968:10984]
2025-09-30T14:56:58.277779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896383914576968:10984]
2025-09-30T14:56:58.277783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896383914576968:10984]
2025-09-30T14:56:58.277824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:58.277830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.277833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:58.277892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:58.277910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:58.277914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:58.277974Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:58.287827Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2402 sessionId: src_id|1a97c420-fd1df12b-21b394da-3ab5d96f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:58.290345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:58.398002Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:58.398653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:58.398670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:58.398892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_25_8737291799463228422_v1
2025-09-30T14:56:58.398914Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:58.398888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:58.398941Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_25_8737291799463228422_v1
2025-09-30T14:56:58.398920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:58.398924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:58.398935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896384004358805:10294]
2025-09-30T14:56:58.398991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2402 reason: error at write: Disconnected sessionId: src_id|1a97c420-fd1df12b-21b394da-3ab5d96f_0
2025-09-30T14:56:58.399177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2402 sessionId: src_id|1a97c420-fd1df12b-21b394da-3ab5d96f_0 is DEAD
2025-09-30T14:56:58.399325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a97c420-fd1df12b-21b394da-3ab5d96f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:58.399336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a97c420-fd1df12b-21b394da-3ab5d96f_0] Write session will restart in 0.005930s
2025-09-30T14:56:58.399363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a97c420-fd1df12b-21b394da-3ab5d96f_0] Write session: Do CDS request
2025-09-30T14:56:58.399369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a97c420-fd1df12b-21b394da-3ab5d96f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:58.406784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a97c420-fd1df12b-21b394da-3ab5d96f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:58.406873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:58.406888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2403
2025-09-30T14:56:58.407016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2403 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:58.407042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2403 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:58.407050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2403 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:58.407055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:58.407660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2403 sessionId:  describe result for acl check
2025-09-30T14:56:58.407695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:58.407701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:58.407703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:58.407709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896384004359204:10295] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:58.408258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896384004359204:10295] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:58.410152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896384004359204:10295] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:58.413584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896384004359204:10295] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:58.413603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896384004359204:10295] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:58.413607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896384004359204:10295] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:58.413617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2403 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:58.419596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:58.421739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:58.421950Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:58.421960Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:58.421970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:58.422019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:58.422063Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896383914577216:10986]
2025-09-30T14:56:58.422752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:58.423084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:58.423134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:58.423413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:58.423461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:58.423466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:58.423468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:58.423469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:58.423469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:58.423470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:58.423471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:58.423472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:58.423472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:58.423473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:58.423474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.423475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.423476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.423476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:58.423477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:58.423482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:58.423488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:58.423490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:58.423493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:58.423495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:58.423498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:58.423500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:58.423502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:58.423505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:58.423508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:58.423510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.423512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.423515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.423517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:58.423520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:58.423526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:58.423532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:58.423536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:58.423540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:58.423543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:58.423546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:58.423549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:58.423552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:58.423556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:58.423559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:58.423562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:58.423565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:58.423569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:58.423574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:58.423579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:58.423583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:58.423591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:58.423595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:58.423599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:58.423604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:58.423608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.423613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.423617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.423622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.423627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.423631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.423637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:58.423642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:58.423646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:58.423651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:58.423692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:58.429109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:58.430105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:58.430117Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:58.430119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:58.430122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:58.430127Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2402 [2:7555896383914577216:10986]
2025-09-30T14:56:58.430139Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:58.430151Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:58.430153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:58.430157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:58.430159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:58.430174Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:58.430182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:58.430194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:58.430248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.430256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.430258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.430262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:58.430264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:58.430451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2402
2025-09-30T14:56:58.430451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2402
2025-09-30T14:56:58.430607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:58.430616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.430629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.430643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.430662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:58.430685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896384004359148:2454], now have 1 active actors on pipe
2025-09-30T14:56:58.430693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896384004359397:10295], now have 1 active actors on pipe
2025-09-30T14:56:58.430710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:58.430715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:58.430737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896383914577211:10986]
2025-09-30T14:56:58.430744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896383914577211:10986]
2025-09-30T14:56:58.430746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896383914577211:10986]
2025-09-30T14:56:58.430759Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:58.430776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:58.430779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:58.430787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:58.430788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:58.430794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:58.430797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:58.430813Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c7fd2b4-5e0e01f8-273d4be7-fa6d0a68_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:58.430820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:58.430823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:58.430826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:58.430835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:58.430849Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:58.430889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896383914577211:10986]
2025-09-30T14:56:58.430901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:58.430915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:58.430916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:58.431339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:58.431352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:58.431370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:58.431461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2403 partition: 0 MaxSeqNo: 42 sessionId: src_id|1c7fd2b4-5e0e01f8-273d4be7-fa6d0a68_0
2025-09-30T14:56:58.431881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a97c420-fd1df12b-21b394da-3ab5d96f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1c7fd2b4-5e0e01f8-273d4be7-fa6d0a68_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:58.434663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c7fd2b4-5e0e01f8-273d4be7-fa6d0a68_0] Write session: try to update token
2025-09-30T14:56:58.434680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c7fd2b4-5e0e01f8-273d4be7-fa6d0a68_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:58.443109Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:58.443133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:58.443143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896383914577211:10986]
2025-09-30T14:56:58.443184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:58.443196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:58.443388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:58.443542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:58.443697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:58.443849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:58.444059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:58.444110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:58.454333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2403 sessionId: src_id|1c7fd2b4-5e0e01f8-273d4be7-fa6d0a68_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:58.454712Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:58.454731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:58.454733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:58.454735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:58.454742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896383914577211:10986]
2025-09-30T14:56:58.454744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896383914577211:10986]
2025-09-30T14:56:58.454747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896383914577211:10986]
2025-09-30T14:56:58.454778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:58.454782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.454784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:58.454872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:58.454889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:58.454893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:58.454912Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:58.457044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:58.499270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896384004359519:10294]
2025-09-30T14:56:58.499547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2402, pipe: [1:7555896384004359519:10294]
2025-09-30T14:56:58.568786Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:58.569177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:58.569204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:58.569226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896384004359519:10294], now have 1 active actors on pipe
2025-09-30T14:56:58.569441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:58.569494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:58.569494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896384004359519:10294]
2025-09-30T14:56:58.569440Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:58.569569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2403 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1c7fd2b4-5e0e01f8-273d4be7-fa6d0a68_0
2025-09-30T14:56:58.569745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2403 sessionId: src_id|1c7fd2b4-5e0e01f8-273d4be7-fa6d0a68_0 is DEAD
2025-09-30T14:56:58.569903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c7fd2b4-5e0e01f8-273d4be7-fa6d0a68_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:58.569914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c7fd2b4-5e0e01f8-273d4be7-fa6d0a68_0] Write session will restart in 0.009081s
2025-09-30T14:56:58.569951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c7fd2b4-5e0e01f8-273d4be7-fa6d0a68_0] Write session: Do CDS request
2025-09-30T14:56:58.569957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c7fd2b4-5e0e01f8-273d4be7-fa6d0a68_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:58.582753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c7fd2b4-5e0e01f8-273d4be7-fa6d0a68_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:58.582854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:58.582871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2404
2025-09-30T14:56:58.583055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2404 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:58.583095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2404 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:58.583102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2404 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:58.583122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:58.583687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2404 sessionId:  describe result for acl check
2025-09-30T14:56:58.583734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:58.583745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:58.583747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:58.583754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896384004359760:10299] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:58.584437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896384004359760:10299] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:58.587330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896384004359760:10299] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:58.588319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:58.590658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:58.590918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896384004359760:10299] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:58.590946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896384004359760:10299] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:58.590951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896384004359760:10299] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:58.590961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2404 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:58.591010Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:58.591025Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:58.591040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:58.591128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:58.591173Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896383914577459:10989]
2025-09-30T14:56:58.591853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:58.592477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:58.592557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:58.592910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:58.592976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:58.593002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:58.593008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:58.593010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:58.593012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:58.593013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:58.593015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:58.593016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:58.593018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:58.593020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:58.593021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.593022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.593024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.593025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:58.593026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:58.593031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:58.593038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:58.593041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:58.593043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:58.593046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:58.593048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:58.593050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:58.593053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:58.593055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:58.593060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:58.593062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.593065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.593067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.593069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:58.593072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:58.593080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:58.593085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:58.593089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:58.593092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:58.593095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:58.593099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:58.593101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:58.593104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:58.593108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:58.593114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:58.593118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:58.593124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:58.593130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:58.593135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:58.593140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:58.593145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:58.593150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:58.593155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:58.593157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:58.593160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:58.593163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.593166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.593169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.593172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.593177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.593180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.593183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:58.593199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:58.593204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:58.593210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:58.593251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:58.598973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:58.600304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:58.600328Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:58.600330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:58.600335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:58.600346Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2403 [2:7555896383914577459:10989]
2025-09-30T14:56:58.600364Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:58.600383Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:58.600393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:58.600397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:58.600400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:58.600417Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:58.600424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:58.600433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:58.600507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.600515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.600517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.600521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:58.600524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:58.600598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:58.600605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.600620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.600638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.600661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:58.600685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896384004359880:10299], now have 1 active actors on pipe
2025-09-30T14:56:58.600697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896383914577454:10989]
2025-09-30T14:56:58.600700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896383914577454:10989]
2025-09-30T14:56:58.600702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896383914577454:10989]
2025-09-30T14:56:58.600771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2403
2025-09-30T14:56:58.600833Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2403
2025-09-30T14:56:58.600717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:58.600737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896384004359520:2454], now have 1 active actors on pipe
2025-09-30T14:56:58.600745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:58.600755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:58.600760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:58.600760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:58.600763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:58.600763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:58.600802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896383914577454:10989]
2025-09-30T14:56:58.600805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:58.600817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:58.600833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:58.600837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:58.600874Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8ab213-99975172-168f75f5-d55f9375_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:58.600881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:58.600885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:58.600887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:58.600897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:58.600906Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:58.600925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:58.601125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:58.601134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:58.601149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:58.601255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2404 partition: 0 MaxSeqNo: 42 sessionId: src_id|e8ab213-99975172-168f75f5-d55f9375_0
2025-09-30T14:56:58.601636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c7fd2b4-5e0e01f8-273d4be7-fa6d0a68_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e8ab213-99975172-168f75f5-d55f9375_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:58.604618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8ab213-99975172-168f75f5-d55f9375_0] Write session: try to update token
2025-09-30T14:56:58.604641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8ab213-99975172-168f75f5-d55f9375_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:58.613541Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:58.613566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:58.613638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:58.613647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:58.613657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896383914577454:10989]
2025-09-30T14:56:58.613663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896383914577454:10989]
2025-09-30T14:56:58.613667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896383914577454:10989]
2025-09-30T14:56:58.613711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:58.613719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:58.613723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.613726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:58.613729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:58.613733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:58.613893Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:58.625920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2404 sessionId: src_id|e8ab213-99975172-168f75f5-d55f9375_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:58.628847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:58.669757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896384004359905:10294]
2025-09-30T14:56:58.670036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2403, pipe: [1:7555896384004359905:10294]
2025-09-30T14:56:58.728359Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:58.728791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:58.728807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:58.728829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896384004359905:10294], now have 1 active actors on pipe
2025-09-30T14:56:58.729057Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:58.729034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:58.729062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:58.729067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:58.729107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896384004359905:10294]
2025-09-30T14:56:58.729136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2404 reason: error at write: Disconnected sessionId: src_id|e8ab213-99975172-168f75f5-d55f9375_0
2025-09-30T14:56:58.729324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2404 sessionId: src_id|e8ab213-99975172-168f75f5-d55f9375_0 is DEAD
2025-09-30T14:56:58.729466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8ab213-99975172-168f75f5-d55f9375_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:58.729485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8ab213-99975172-168f75f5-d55f9375_0] Write session will restart in 0.009242s
2025-09-30T14:56:58.729510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8ab213-99975172-168f75f5-d55f9375_0] Write session: Do CDS request
2025-09-30T14:56:58.729516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8ab213-99975172-168f75f5-d55f9375_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:58.739809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8ab213-99975172-168f75f5-d55f9375_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:58.739896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:58.739922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2405
2025-09-30T14:56:58.740039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2405 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:58.740086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2405 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:58.740095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2405 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:58.740100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:58.740566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2405 sessionId:  describe result for acl check
2025-09-30T14:56:58.740608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:58.740610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:58.740613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:58.740620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896384004360046:10311] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:58.741226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896384004360046:10311] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:58.743909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896384004360046:10311] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:58.747419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896384004360046:10311] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:58.747433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896384004360046:10311] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:58.747437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896384004360046:10311] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:58.747446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2405 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:58.748389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:58.750670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:58.751043Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:58.751055Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:58.751067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:58.751136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:58.751175Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896383914577739:11003]
2025-09-30T14:56:58.751853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:58.752175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:58.752216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:58.752537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:58.752604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:58.752609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:58.752610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:58.752611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:58.752612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:58.752613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:58.752614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:58.752616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:58.752617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:58.752618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:58.752619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.752620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.752622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.752623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:58.752624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:58.752630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:58.752640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:58.752644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:58.752648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:58.752652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:58.752655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:58.752659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:58.752663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:58.752666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:58.752670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:58.752674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.752678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.752681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.752684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:58.752688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:58.752695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:58.752702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:58.752708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:58.752713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:58.752717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:58.752721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:58.752726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:58.752731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:58.752735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:58.752740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:58.752744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:58.752750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:58.752754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:58.752759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:58.752762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:58.752767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:58.752777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:58.752781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:58.752785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:58.752790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:58.752794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.752803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.752811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.752816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.752824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.752829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.752838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:58.752843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:58.752848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:58.752855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:58.752901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:58.758549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:58.759427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:58.759444Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:58.759447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:58.759451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:58.759459Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2404 [2:7555896383914577739:11003]
2025-09-30T14:56:58.759478Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:58.759493Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:58.759503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:58.759506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:58.759509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:58.759525Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:58.759537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:58.759548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:58.759615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.759625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.759627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.759631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:58.759633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:58.759913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:58.759923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.759936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.759909Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2404
2025-09-30T14:56:58.759955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.759916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2404
2025-09-30T14:56:58.759980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:58.760003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896384004360275:10311], now have 1 active actors on pipe
2025-09-30T14:56:58.760013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896384004359920:2454], now have 1 active actors on pipe
2025-09-30T14:56:58.760032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:58.760040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:58.760056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896383914577734:11003]
2025-09-30T14:56:58.760062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896383914577734:11003]
2025-09-30T14:56:58.760065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896383914577734:11003]
2025-09-30T14:56:58.760077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:58.760091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:58.760095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:58.760096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:58.760097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:58.760113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:58.760116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:58.760135Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|338eb7e1-8bb6f1bf-adc1d133-d5753d43_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:58.760147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:58.760150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:58.760157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:58.760168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:58.760182Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:58.760222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896383914577734:11003]
2025-09-30T14:56:58.760236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:58.760248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:58.760254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:58.760434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:58.760447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:58.760473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:58.760582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2405 partition: 0 MaxSeqNo: 42 sessionId: src_id|338eb7e1-8bb6f1bf-adc1d133-d5753d43_0
2025-09-30T14:56:58.761596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8ab213-99975172-168f75f5-d55f9375_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|338eb7e1-8bb6f1bf-adc1d133-d5753d43_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:58.764466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|338eb7e1-8bb6f1bf-adc1d133-d5753d43_0] Write session: try to update token
2025-09-30T14:56:58.764490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|338eb7e1-8bb6f1bf-adc1d133-d5753d43_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:58.779004Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:58.779033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:58.779048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896383914577734:11003]
2025-09-30T14:56:58.779104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:58.779112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:58.779399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:58.779651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:58.779903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:58.780094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:58.780588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:58.780666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:58.781437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2405 sessionId: src_id|338eb7e1-8bb6f1bf-adc1d133-d5753d43_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:58.784200Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:58.784224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:58.784226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:58.784229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:58.784240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896383914577734:11003]
2025-09-30T14:56:58.784244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896383914577734:11003]
2025-09-30T14:56:58.784249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896383914577734:11003]
2025-09-30T14:56:58.784293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:58.784297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:58.784301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.784304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:58.784304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:58.784309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:58.784455Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:58.784577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:58.828985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896384004360289:10294]
2025-09-30T14:56:58.829224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2404, pipe: [1:7555896384004360289:10294]
2025-09-30T14:56:58.898142Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:58.898576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:58.898591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:58.898608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896384004360289:10294], now have 1 active actors on pipe
2025-09-30T14:56:58.898754Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:58.898855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896384004360289:10294]
2025-09-30T14:56:58.898859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:58.898863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:58.898885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:58.898942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2405 reason: error at write: Disconnected sessionId: src_id|338eb7e1-8bb6f1bf-adc1d133-d5753d43_0
2025-09-30T14:56:58.899106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2405 sessionId: src_id|338eb7e1-8bb6f1bf-adc1d133-d5753d43_0 is DEAD
2025-09-30T14:56:58.899266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|338eb7e1-8bb6f1bf-adc1d133-d5753d43_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:58.899276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|338eb7e1-8bb6f1bf-adc1d133-d5753d43_0] Write session will restart in 0.007322s
2025-09-30T14:56:58.899299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|338eb7e1-8bb6f1bf-adc1d133-d5753d43_0] Write session: Do CDS request
2025-09-30T14:56:58.899307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|338eb7e1-8bb6f1bf-adc1d133-d5753d43_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:58.907703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|338eb7e1-8bb6f1bf-adc1d133-d5753d43_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:58.907802Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:58.907817Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2406
2025-09-30T14:56:58.907919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2406 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:58.907950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2406 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:58.907960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2406 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:58.907973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:58.908480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2406 sessionId:  describe result for acl check
2025-09-30T14:56:58.908519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:58.908527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:58.908529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:58.908536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896384004360405:10315] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:58.909133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896384004360405:10315] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:58.911591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896384004360405:10315] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:58.914115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896384004360405:10315] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:58.914138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896384004360405:10315] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:58.914142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896384004360405:10315] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:58.914149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2406 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:58.918962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:58.919490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:58.919680Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:58.919688Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:58.919697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:58.919736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:58.919768Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896383914577983:11005]
2025-09-30T14:56:58.920280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:58.920570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:58.920604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:58.920821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:58.920862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:58.920869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:58.920870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:58.920871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:58.920871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:58.920872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:58.920873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:58.920874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:58.920874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:58.920875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:58.920876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.920877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.920878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.920878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:58.920879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:58.920891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:58.920898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:58.920901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:58.920904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:58.920906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:58.920909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:58.920911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:58.920914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:58.920916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:58.920918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:58.920921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.920924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.920926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.920928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:58.920931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:58.920937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:58.920942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:58.920946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:58.920949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:58.920952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:58.920955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:58.920958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:58.920961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:58.920964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:58.920966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:58.920969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:58.920971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:58.920974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:58.920977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:58.920979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:58.920984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:58.920989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:58.920994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:58.920998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:58.921003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:58.921007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.921011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.921018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.921022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.921026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.921031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.921035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:58.921040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:58.921045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:58.921049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:58.921073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:58.926360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:58.927508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:58.927526Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:58.927529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:58.927533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:58.927541Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2405 [2:7555896383914577983:11005]
2025-09-30T14:56:58.927557Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:58.927575Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:58.927578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:58.927582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:58.927585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:58.927601Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:58.927608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:58.927620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:58.927681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.927689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.927691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.927694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:58.927697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:58.927767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:58.927775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.927788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:58.927806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:58.927831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:58.927854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896384004360620:10315], now have 1 active actors on pipe
2025-09-30T14:56:58.927862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896384004360291:2454], now have 1 active actors on pipe
2025-09-30T14:56:58.927869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896383914577978:11005]
2025-09-30T14:56:58.927876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896383914577978:11005]
2025-09-30T14:56:58.927878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896383914577978:11005]
2025-09-30T14:56:58.927892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:58.927908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:58.927909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:58.927918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:58.927921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:58.927925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:58.927928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:58.927963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896383914577978:11005]
2025-09-30T14:56:58.927971Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:58.927975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:58.927930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2405
2025-09-30T14:56:58.927932Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2405
2025-09-30T14:56:58.927997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:58.928007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:58.928043Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7cb93240-c9fa442c-d6099420-e4cb837b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:58.928055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:58.928060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:58.928063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:58.928072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:58.928085Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:58.928103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:58.928268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:58.928280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:58.928304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:58.928412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2406 partition: 0 MaxSeqNo: 42 sessionId: src_id|7cb93240-c9fa442c-d6099420-e4cb837b_0
2025-09-30T14:56:58.928773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|338eb7e1-8bb6f1bf-adc1d133-d5753d43_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7cb93240-c9fa442c-d6099420-e4cb837b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:58.931590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb93240-c9fa442c-d6099420-e4cb837b_0] Write session: try to update token
2025-09-30T14:56:58.931608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb93240-c9fa442c-d6099420-e4cb837b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:58.940196Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:58.940215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:58.940218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:58.940220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:58.940230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896383914577978:11005]
2025-09-30T14:56:58.940234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896383914577978:11005]
2025-09-30T14:56:58.940239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896383914577978:11005]
2025-09-30T14:56:58.940278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:58.940286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:58.940289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:58.940291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:58.940293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:58.940294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:58.940491Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:58.945541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2406 sessionId: src_id|7cb93240-c9fa442c-d6099420-e4cb837b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:58.948398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:58.998973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896384004360664:10294]
2025-09-30T14:56:58.999278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2405, pipe: [1:7555896384004360664:10294]
2025-09-30T14:56:59.055085Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:59.055851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:59.055867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:59.055907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896384004360664:10294], now have 1 active actors on pipe
2025-09-30T14:56:59.056324Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:59.056167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:59.056178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:59.056181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:59.056229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896384004360664:10294]
2025-09-30T14:56:59.056255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2406 reason: error at write: Disconnected sessionId: src_id|7cb93240-c9fa442c-d6099420-e4cb837b_0
2025-09-30T14:56:59.056436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2406 sessionId: src_id|7cb93240-c9fa442c-d6099420-e4cb837b_0 is DEAD
2025-09-30T14:56:59.059472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb93240-c9fa442c-d6099420-e4cb837b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:59.059485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb93240-c9fa442c-d6099420-e4cb837b_0] Write session will restart in 0.006682s
2025-09-30T14:56:59.059509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb93240-c9fa442c-d6099420-e4cb837b_0] Write session: Do CDS request
2025-09-30T14:56:59.059517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb93240-c9fa442c-d6099420-e4cb837b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:59.067855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb93240-c9fa442c-d6099420-e4cb837b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:59.067939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:59.067956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2407
2025-09-30T14:56:59.068097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2407 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:59.068130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2407 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:59.068140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2407 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:59.068145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:59.068636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2407 sessionId:  describe result for acl check
2025-09-30T14:56:59.068674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:59.068676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:59.068678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:59.068684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896388299327971:10319] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:59.069233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896388299327971:10319] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:59.071354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896388299327971:10319] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:59.074165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896388299327971:10319] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:59.074184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896388299327971:10319] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:59.074188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896388299327971:10319] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:59.074196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2407 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:59.084817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:59.087467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:59.087683Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:59.087695Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:59.087704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:59.087754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:59.087796Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896388209545538:11009]
2025-09-30T14:56:59.088289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:59.088685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:59.088765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:59.089168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:59.089259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:59.089268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:59.089269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:59.089271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:59.089272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:59.089274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:59.089276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:59.089277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:59.089279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:59.089280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:59.089282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.089283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.089285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.089286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:59.089287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:59.089294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:59.089306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:59.089311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:59.089316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:59.089321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:59.089325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:59.089330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:59.089334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:59.089339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:59.089344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:59.089348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.089352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.089356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.089361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:59.089365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:59.089374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:59.089383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:59.089389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:59.089396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:59.089402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:59.089409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:59.089420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:59.089427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:59.089432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:59.089438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:59.089448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:59.089454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:59.089473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:59.089484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:59.089489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:59.089497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:59.089503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:59.089513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:59.089518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:59.089529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:59.089535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.089545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.089550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.089561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.089567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.089575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.089579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:59.089585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:59.089598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:59.089604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:59.089654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:59.095310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:59.096590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:59.096606Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:59.096609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:59.096613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:59.096620Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2406 [2:7555896388209545538:11009]
2025-09-30T14:56:59.096637Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:59.096653Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:59.096657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:59.096660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:59.096661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:59.096673Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:59.096678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:59.096685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:59.096731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.096737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.096740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.096742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:59.096745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:59.096809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:59.096817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.096829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.096845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.096865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:59.096886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896388209545533:11009]
2025-09-30T14:56:59.096892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896388209545533:11009]
2025-09-30T14:56:59.096894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896388209545533:11009]
2025-09-30T14:56:59.096908Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:59.096923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896388299327961:2454], now have 1 active actors on pipe
2025-09-30T14:56:59.096932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896388299328049:10319], now have 1 active actors on pipe
2025-09-30T14:56:59.096933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:59.096937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:59.096940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:59.096940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:59.096955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:59.096958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:59.096994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896388209545533:11009]
2025-09-30T14:56:59.097003Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:59.097015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:59.096994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2406
2025-09-30T14:56:59.097079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2406
2025-09-30T14:56:59.097157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:59.097174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:59.097216Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d93f06cf-615b0128-b19cb3ea-3b03b56a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:59.097231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:59.097241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:59.097243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:59.097255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:59.097270Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:59.097290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:59.097553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:59.097564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:59.097580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:59.097937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2407 partition: 0 MaxSeqNo: 42 sessionId: src_id|d93f06cf-615b0128-b19cb3ea-3b03b56a_0
2025-09-30T14:56:59.098325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb93240-c9fa442c-d6099420-e4cb837b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d93f06cf-615b0128-b19cb3ea-3b03b56a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:59.101278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d93f06cf-615b0128-b19cb3ea-3b03b56a_0] Write session: try to update token
2025-09-30T14:56:59.101299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d93f06cf-615b0128-b19cb3ea-3b03b56a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:59.116315Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:59.116339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:59.116350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896388209545533:11009]
2025-09-30T14:56:59.116405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:59.116425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:59.116590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:59.116753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:59.116904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:59.117050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:59.117280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:59.117325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:59.118010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2407 sessionId: src_id|d93f06cf-615b0128-b19cb3ea-3b03b56a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:59.120712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:59.121503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:59.121528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:59.121547Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:59.121551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:59.121553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:59.121555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:59.121564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896388209545533:11009]
2025-09-30T14:56:59.121568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896388209545533:11009]
2025-09-30T14:56:59.121572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896388209545533:11009]
2025-09-30T14:56:59.121619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:59.121629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.121632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:59.121770Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:59.123346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:59.123353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:59.123357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:59.156181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896388299328346:10294]
2025-09-30T14:56:59.156492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2406, pipe: [1:7555896388299328346:10294]
2025-09-30T14:56:59.241839Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:59.242302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:56:59.242333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896388299328346:10294], now have 1 active actors on pipe
2025-09-30T14:56:59.243038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d93f06cf-615b0128-b19cb3ea-3b03b56a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:59.243049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d93f06cf-615b0128-b19cb3ea-3b03b56a_0] Write session will restart in 0.005073s
2025-09-30T14:56:59.243071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d93f06cf-615b0128-b19cb3ea-3b03b56a_0] Write session: Do CDS request
2025-09-30T14:56:59.242630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:59.243078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d93f06cf-615b0128-b19cb3ea-3b03b56a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:59.242640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:59.242687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896388299328346:10294]
2025-09-30T14:56:59.242713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:59.242715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:59.242772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2407 reason: error at write: Disconnected sessionId: src_id|d93f06cf-615b0128-b19cb3ea-3b03b56a_0
2025-09-30T14:56:59.242898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2407 sessionId: src_id|d93f06cf-615b0128-b19cb3ea-3b03b56a_0 is DEAD
2025-09-30T14:56:59.251221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d93f06cf-615b0128-b19cb3ea-3b03b56a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:59.251366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:59.251382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2408
2025-09-30T14:56:59.251680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2408 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:59.251730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2408 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:59.251739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2408 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:59.251744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:59.252173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2408 sessionId:  describe result for acl check
2025-09-30T14:56:59.252210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:59.252217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:59.252218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:59.252224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896388299328361:10325] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:59.252765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896388299328361:10325] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:59.255091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896388299328361:10325] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:59.258367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896388299328361:10325] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:59.258380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896388299328361:10325] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:59.258383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896388299328361:10325] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:59.258391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2408 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:59.284740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:59.286638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:59.286845Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:59.286849Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:59.286860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:59.286922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:59.286966Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896388209545784:11011]
2025-09-30T14:56:59.287648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:59.287985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:59.288035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:59.288369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:59.288438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:59.288439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:59.288440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:59.288441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:59.288443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:59.288444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:59.288445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:59.288447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:59.288448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:59.288449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:59.288450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.288452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.288453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.288454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:59.288455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:59.288460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:59.288471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:59.288475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:59.288479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:59.288482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:59.288487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:59.288491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:59.288496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:59.288500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:59.288504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:59.288508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.288512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.288516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.288520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:59.288524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:59.288534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:59.288544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:59.288550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:59.288556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:59.288561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:59.288566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:59.288571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:59.288577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:59.288581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:59.288586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:59.288591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:59.288596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:59.288601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:59.288607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:59.288611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:59.288616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:59.288621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:59.288626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:59.288632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:59.288638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:59.288642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.288648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.288653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.288658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.288662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.288667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.288671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:59.288676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:59.288680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:59.288686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:59.288730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:59.294455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:59.295599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:59.295615Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:59.295618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:59.295622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:59.295630Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2407 [2:7555896388209545784:11011]
2025-09-30T14:56:59.295646Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:59.295663Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:59.295668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:59.295672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:59.295682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:59.295699Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:59.295706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:59.295714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:59.295776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.295784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.295786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.295789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:59.295792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:59.295860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:59.295880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.295895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.295908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.295928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:59.295946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896388209545779:11011]
2025-09-30T14:56:59.295948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896388209545779:11011]
2025-09-30T14:56:59.295950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896388209545779:11011]
2025-09-30T14:56:59.295966Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:59.295982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:59.295997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:59.296000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:59.296012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:59.296015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:59.296017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:59.296036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896388209545779:11011]
2025-09-30T14:56:59.296045Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:59.296107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:59.296329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896388299328403:10325], now have 1 active actors on pipe
2025-09-30T14:56:59.296339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896388299328354:2454], now have 1 active actors on pipe
2025-09-30T14:56:59.296352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:59.296357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:59.296259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2407
2025-09-30T14:56:59.296295Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2407
2025-09-30T14:56:59.296381Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9069c085-a1cbf278-5b9a0f0e-2540fe0f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:59.296393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:59.296396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:59.296400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:59.296410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:59.296419Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:59.296432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:59.296729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:59.296744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:59.296766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:59.296995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2408 partition: 0 MaxSeqNo: 42 sessionId: src_id|9069c085-a1cbf278-5b9a0f0e-2540fe0f_0
2025-09-30T14:56:59.297426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d93f06cf-615b0128-b19cb3ea-3b03b56a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9069c085-a1cbf278-5b9a0f0e-2540fe0f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:59.300298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9069c085-a1cbf278-5b9a0f0e-2540fe0f_0] Write session: try to update token
2025-09-30T14:56:59.300315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9069c085-a1cbf278-5b9a0f0e-2540fe0f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:59.308646Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:56:59.308667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:59.308675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896388209545779:11011]
2025-09-30T14:56:59.308713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:56:59.308878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:56:59.309001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:59.309132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:59.309273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:56:59.309449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:56:59.309489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:56:59.309683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:56:59.324000Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:59.324029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:59.324031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:59.324033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:59.324044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896388209545779:11011]
2025-09-30T14:56:59.324049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896388209545779:11011]
2025-09-30T14:56:59.324054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896388209545779:11011]
2025-09-30T14:56:59.324097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:59.324104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.324107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:59.324111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:59.324122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:59.324127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:59.324258Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:59.324362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2408 sessionId: src_id|9069c085-a1cbf278-5b9a0f0e-2540fe0f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:59.327077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:59.343062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896388299328732:10294]
2025-09-30T14:56:59.343409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2407, pipe: [1:7555896388299328732:10294]
2025-09-30T14:56:59.445251Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:59.445667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:59.445685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:59.445705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896388299328732:10294], now have 1 active actors on pipe
2025-09-30T14:56:59.445944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:59.445953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:59.445958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:59.446000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896388299328732:10294]
2025-09-30T14:56:59.446020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2408 reason: error at write: Disconnected sessionId: src_id|9069c085-a1cbf278-5b9a0f0e-2540fe0f_0
2025-09-30T14:56:59.446191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2408 sessionId: src_id|9069c085-a1cbf278-5b9a0f0e-2540fe0f_0 is DEAD
2025-09-30T14:56:59.446397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9069c085-a1cbf278-5b9a0f0e-2540fe0f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:59.446406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9069c085-a1cbf278-5b9a0f0e-2540fe0f_0] Write session will restart in 0.005448s
2025-09-30T14:56:59.446423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9069c085-a1cbf278-5b9a0f0e-2540fe0f_0] Write session: Do CDS request
2025-09-30T14:56:59.446427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9069c085-a1cbf278-5b9a0f0e-2540fe0f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:59.446160Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:59.452732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9069c085-a1cbf278-5b9a0f0e-2540fe0f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:59.453161Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:59.453177Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2409
2025-09-30T14:56:59.453299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2409 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:59.453327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2409 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:59.453333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2409 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:59.453337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:59.453927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2409 sessionId:  describe result for acl check
2025-09-30T14:56:59.453975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:59.453977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:59.453979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:59.453985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896388299328745:10329] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:59.454556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896388299328745:10329] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:59.457086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896388299328745:10329] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:59.461304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896388299328745:10329] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:59.461324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896388299328745:10329] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:59.461330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896388299328745:10329] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:59.461341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2409 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:59.478360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:59.483762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:59.484046Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:59.484055Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:59.484064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:59.484110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:59.484143Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896388209546031:11013]
2025-09-30T14:56:59.484597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:59.485369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:59.485421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:59.485753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:59.485816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:59.485817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:59.485818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:59.485820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:59.485821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:59.485822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:59.485824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:59.485825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:59.485826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:59.485827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:59.485828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.485829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.485831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.485832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:59.485833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:59.485839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:59.485849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:59.485853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:59.485858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:59.485861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:59.485865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:59.485869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:59.485873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:59.485878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:59.485882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:59.485886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.485889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.485893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.485897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:59.485901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:59.485909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:59.485917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:59.485924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:59.485930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:59.485935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:59.485940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:59.485945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:59.485950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:59.485955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:59.485960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:59.485965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:59.485971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:59.485976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:59.485982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:59.485986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:59.485993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:59.485997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:59.486003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:59.486007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:59.486014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:59.486019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.486025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.486029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.486034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.486039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.486045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.486049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:59.486054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:59.486059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:59.486064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:59.486109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:59.492075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:59.493267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:59.493284Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:59.493287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:59.493290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:59.493297Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2408 [2:7555896388209546031:11013]
2025-09-30T14:56:59.493314Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:59.493328Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:59.493333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:59.493337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:59.493339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:59.493355Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:59.493365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:59.493376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:59.493438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.493446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.493449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.493453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:59.493456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:59.493527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:59.493535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.493549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.493564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.493588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:59.493609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896388209546026:11013]
2025-09-30T14:56:59.493616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896388209546026:11013]
2025-09-30T14:56:59.493619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896388209546026:11013]
2025-09-30T14:56:59.493636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:59.493653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:59.493674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:59.493676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:59.493711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896388209546026:11013]
2025-09-30T14:56:59.493719Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:59.493803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:59.493812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:59.493814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:59.493820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:59.494167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2408
2025-09-30T14:56:59.494217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2408
2025-09-30T14:56:59.494578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896388299328734:2454], now have 1 active actors on pipe
2025-09-30T14:56:59.494602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896388299328820:10329], now have 1 active actors on pipe
2025-09-30T14:56:59.494626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:59.494631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:59.494668Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d491db5-22df890e-9695dea4-110a3a44_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:59.494681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:59.494685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:59.494687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:59.494699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:59.494726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:59.494745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:59.494996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:59.495008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:59.495030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:59.495153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2409 partition: 0 MaxSeqNo: 42 sessionId: src_id|6d491db5-22df890e-9695dea4-110a3a44_0
2025-09-30T14:56:59.495626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9069c085-a1cbf278-5b9a0f0e-2540fe0f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6d491db5-22df890e-9695dea4-110a3a44_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:59.498609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d491db5-22df890e-9695dea4-110a3a44_0] Write session: try to update token
2025-09-30T14:56:59.498629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d491db5-22df890e-9695dea4-110a3a44_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:59.507340Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:59.507359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:59.507361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:59.507364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:59.507373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896388209546026:11013]
2025-09-30T14:56:59.507380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896388209546026:11013]
2025-09-30T14:56:59.507384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896388209546026:11013]
2025-09-30T14:56:59.507420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:59.507426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.507429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:59.507464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:59.507484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:59.507492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:59.507573Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:59.515708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2409 sessionId: src_id|6d491db5-22df890e-9695dea4-110a3a44_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:59.518484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:59.546321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896388299329110:10294]
2025-09-30T14:56:59.546608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2408, pipe: [1:7555896388299329110:10294]
2025-09-30T14:56:59.627370Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:59.627961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:59.627980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:59.628001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896388299329110:10294], now have 1 active actors on pipe
2025-09-30T14:56:59.628388Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:59.628454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896388299329110:10294]
2025-09-30T14:56:59.628477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:56:59.628582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2409 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6d491db5-22df890e-9695dea4-110a3a44_0
2025-09-30T14:56:59.628776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2409 sessionId: src_id|6d491db5-22df890e-9695dea4-110a3a44_0 is DEAD
2025-09-30T14:56:59.628924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d491db5-22df890e-9695dea4-110a3a44_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:56:59.628935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d491db5-22df890e-9695dea4-110a3a44_0] Write session will restart in 0.008081s
2025-09-30T14:56:59.628960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d491db5-22df890e-9695dea4-110a3a44_0] Write session: Do CDS request
2025-09-30T14:56:59.628966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d491db5-22df890e-9695dea4-110a3a44_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:59.628368Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:59.637787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d491db5-22df890e-9695dea4-110a3a44_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:59.637860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:59.637874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2410
2025-09-30T14:56:59.638022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2410 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:59.638057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2410 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:59.638062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2410 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:59.638067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:59.638550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2410 sessionId:  describe result for acl check
2025-09-30T14:56:59.638590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:59.638598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:59.638603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:59.638608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896388299329149:10333] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:59.639179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896388299329149:10333] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:59.641754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896388299329149:10333] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:59.644898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896388299329149:10333] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:59.644911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896388299329149:10333] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:59.644915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896388299329149:10333] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:59.644923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2410 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:59.649664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:59.651950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:59.652465Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:59.652481Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:59.652496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:59.652569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:59.652616Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896388209546281:11016]
2025-09-30T14:56:59.653159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:59.653524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:59.653604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:59.653979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:59.654054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:59.654062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:59.654063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:59.654065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:59.654066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:59.654067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:59.654069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:59.654070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:59.654071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:59.654072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:59.654073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.654075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.654076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.654077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:59.654078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:59.654085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:59.654096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:59.654101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:59.654105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:59.654110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:59.654115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:59.654119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:59.654124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:59.654128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:59.654132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:59.654137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.654141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.654146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.654151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:59.654155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:59.654164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:59.654174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:59.654180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:59.654187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:59.654192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:59.654198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:59.654204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:59.654210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:59.654215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:59.654222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:59.654227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:59.654233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:59.654238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:59.654244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:59.654249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:59.654255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:59.654260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:59.654266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:59.654273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:59.654280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:59.654286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.654291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.654296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.654308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.654313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.654319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.654329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:59.654334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:59.654344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:59.654350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:59.654403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:59.659939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:59.660903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:59.660923Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:59.660926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:59.660931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:59.660939Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2409 [2:7555896388209546281:11016]
2025-09-30T14:56:59.660956Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:59.660978Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:59.660986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:59.660989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:59.660992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:59.661011Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:59.661018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:59.661025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:59.661091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.661101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.661103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.661107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:59.661110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:59.661180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:59.661201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.661215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.661228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.661245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:59.661272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896388299329112:2454], now have 1 active actors on pipe
2025-09-30T14:56:59.661281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896388299329387:10333], now have 1 active actors on pipe
2025-09-30T14:56:59.661288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896388209546276:11016]
2025-09-30T14:56:59.661291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896388209546276:11016]
2025-09-30T14:56:59.661294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896388209546276:11016]
2025-09-30T14:56:59.661307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:59.661323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:59.661327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:59.661327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:59.661330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:59.661345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:59.661355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:59.661374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2409
2025-09-30T14:56:59.661390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896388209546276:11016]
2025-09-30T14:56:59.661379Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2409
2025-09-30T14:56:59.661398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:59.661403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:59.661433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:59.661438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:59.661466Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|badc3113-c2b90bf2-c3ab78b0-84bf85ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:59.661479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:59.661488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:59.661490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:59.661501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:59.661516Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:59.661539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:59.661720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:59.661733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:59.661757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:59.661862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2410 partition: 0 MaxSeqNo: 42 sessionId: src_id|badc3113-c2b90bf2-c3ab78b0-84bf85ff_0
2025-09-30T14:56:59.662248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d491db5-22df890e-9695dea4-110a3a44_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|badc3113-c2b90bf2-c3ab78b0-84bf85ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:59.665587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|badc3113-c2b90bf2-c3ab78b0-84bf85ff_0] Write session: try to update token
2025-09-30T14:56:59.665609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|badc3113-c2b90bf2-c3ab78b0-84bf85ff_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:59.673734Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:59.673759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:59.673762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:59.673765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:59.673774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896388209546276:11016]
2025-09-30T14:56:59.673778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896388209546276:11016]
2025-09-30T14:56:59.673784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896388209546276:11016]
2025-09-30T14:56:59.673827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:59.673835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.673837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:59.673839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:59.673846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:59.673850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:59.673985Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:59.680773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2410 sessionId: src_id|badc3113-c2b90bf2-c3ab78b0-84bf85ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:59.683713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:59.728580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896388299329504:10294]
2025-09-30T14:56:59.728872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2409, pipe: [1:7555896388299329504:10294]
2025-09-30T14:56:59.789125Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:59.789667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:59.789684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:59.789725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896388299329504:10294], now have 1 active actors on pipe
2025-09-30T14:56:59.790008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:59.790030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896388299329504:10294]
2025-09-30T14:56:59.790068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:59.790071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:59.790146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2410 reason: error at write: Disconnected sessionId: src_id|badc3113-c2b90bf2-c3ab78b0-84bf85ff_0
2025-09-30T14:56:59.790204Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:59.790333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2410 sessionId: src_id|badc3113-c2b90bf2-c3ab78b0-84bf85ff_0 is DEAD
2025-09-30T14:56:59.790533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|badc3113-c2b90bf2-c3ab78b0-84bf85ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:59.790547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|badc3113-c2b90bf2-c3ab78b0-84bf85ff_0] Write session will restart in 0.006869s
2025-09-30T14:56:59.790574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|badc3113-c2b90bf2-c3ab78b0-84bf85ff_0] Write session: Do CDS request
2025-09-30T14:56:59.790585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|badc3113-c2b90bf2-c3ab78b0-84bf85ff_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:59.799301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|badc3113-c2b90bf2-c3ab78b0-84bf85ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:59.799365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:59.799385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2411
2025-09-30T14:56:59.799563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2411 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:59.799599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2411 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:59.799605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2411 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:59.799609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:59.800086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2411 sessionId:  describe result for acl check
2025-09-30T14:56:59.800125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:59.800128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:59.800130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:59.800136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896388299329572:10345] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:59.800713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896388299329572:10345] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:59.803555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896388299329572:10345] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:59.806978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896388299329572:10345] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:59.806999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896388299329572:10345] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:59.807003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896388299329572:10345] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:59.807012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2411 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:59.810717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:59.813171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:59.813427Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:59.813439Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:59.813450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:59.813505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:59.813546Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896388209546566:11030]
2025-09-30T14:56:59.814217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:59.814585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:59.814646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:59.814929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:59.814982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:59.814987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:59.814988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:59.814989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:59.814989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:59.814990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:59.814991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:59.814992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:59.814993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:59.814994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:59.814994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.814995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.814996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.814996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:59.814997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:59.815001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:59.815008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:59.815010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:59.815013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:59.815015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:59.815018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:59.815020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:59.815022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:59.815025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:59.815028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:59.815031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.815034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.815036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.815038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:59.815041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:59.815048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:59.815053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:59.815057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:59.815061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:59.815064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:59.815067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:59.815070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:59.815073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:59.815076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:59.815079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:59.815081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:59.815084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:59.815087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:59.815091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:59.815094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:59.815097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:59.815100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:59.815104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:59.815107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:59.815110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:59.815113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.815116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.815118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.815121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.815124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.815127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.815129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:59.815132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:59.815135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:59.815138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:59.815164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:59.820747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:59.822065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:59.822082Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:59.822084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:59.822087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:59.822093Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2410 [2:7555896388209546566:11030]
2025-09-30T14:56:59.822109Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:59.822123Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:59.822125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:59.822127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:59.822129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:59.822144Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:59.822151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:59.822159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:59.822222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.822230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.822232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.822236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:59.822239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:59.822301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:59.822309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.822323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.822340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.822362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:59.822389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896388299329823:10345], now have 1 active actors on pipe
2025-09-30T14:56:59.822393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896388299329517:2454], now have 1 active actors on pipe
2025-09-30T14:56:59.822400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896388209546561:11030]
2025-09-30T14:56:59.822402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896388209546561:11030]
2025-09-30T14:56:59.822404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896388209546561:11030]
2025-09-30T14:56:59.822418Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:59.822436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:59.822437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:59.822441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:59.822443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:59.822458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:59.822462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:59.822478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2410
2025-09-30T14:56:59.822484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2410
2025-09-30T14:56:59.822494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896388209546561:11030]
2025-09-30T14:56:59.822506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:59.822516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:59.822549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:59.822553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:59.822589Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf5c57b-3e42799d-86cda4a6-e88b522c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:59.822601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:59.822605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:59.822607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:59.822618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:59.822627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:59.822646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:59.822807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:59.822819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:59.822839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:59.822925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2411 partition: 0 MaxSeqNo: 42 sessionId: src_id|bf5c57b-3e42799d-86cda4a6-e88b522c_0
2025-09-30T14:56:59.823297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|badc3113-c2b90bf2-c3ab78b0-84bf85ff_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bf5c57b-3e42799d-86cda4a6-e88b522c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:59.826200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf5c57b-3e42799d-86cda4a6-e88b522c_0] Write session: try to update token
2025-09-30T14:56:59.826222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf5c57b-3e42799d-86cda4a6-e88b522c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:56:59.835629Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:56:59.835651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:56:59.835653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:56:59.835656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:56:59.835667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896388209546561:11030]
2025-09-30T14:56:59.835672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896388209546561:11030]
2025-09-30T14:56:59.835676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896388209546561:11030]
2025-09-30T14:56:59.835723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:56:59.835730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.835733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:56:59.835739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:56:59.835748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:56:59.835753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:56:59.835886Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:56:59.844860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2411 sessionId: src_id|bf5c57b-3e42799d-86cda4a6-e88b522c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:56:59.847659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:56:59.890380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896388299329892:10294]
2025-09-30T14:56:59.890799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2410, pipe: [1:7555896388299329892:10294]
2025-09-30T14:56:59.950279Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:56:59.950828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:59.950842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:59.950900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896388299329892:10294], now have 1 active actors on pipe
2025-09-30T14:56:59.951239Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:56:59.951204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:56:59.951217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:56:59.951298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2411 reason: error at write: Disconnected sessionId: src_id|bf5c57b-3e42799d-86cda4a6-e88b522c_0
2025-09-30T14:56:59.951479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2411 sessionId: src_id|bf5c57b-3e42799d-86cda4a6-e88b522c_0 is DEAD
2025-09-30T14:56:59.951646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:56:59.951691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896388299329892:10294]
2025-09-30T14:56:59.951991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf5c57b-3e42799d-86cda4a6-e88b522c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:56:59.952001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf5c57b-3e42799d-86cda4a6-e88b522c_0] Write session will restart in 0.007076s
2025-09-30T14:56:59.952049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf5c57b-3e42799d-86cda4a6-e88b522c_0] Write session: Do CDS request
2025-09-30T14:56:59.952054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf5c57b-3e42799d-86cda4a6-e88b522c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:56:59.960779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf5c57b-3e42799d-86cda4a6-e88b522c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:59.960813Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:56:59.960845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2412
2025-09-30T14:56:59.961019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2412 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:56:59.961051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2412 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:56:59.961056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2412 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:56:59.961060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:56:59.961514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2412 sessionId:  describe result for acl check
2025-09-30T14:56:59.961550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:56:59.961559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:56:59.961561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:56:59.961566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896388299329979:10349] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:56:59.962096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896388299329979:10349] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:56:59.964122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896388299329979:10349] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:56:59.966941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896388299329979:10349] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:56:59.966969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896388299329979:10349] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:56:59.966973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896388299329979:10349] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:56:59.966981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2412 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:56:59.974368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:56:59.977685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:56:59.977925Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:56:59.977936Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:56:59.977947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:56:59.977999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:56:59.978054Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896388209546830:11034]
2025-09-30T14:56:59.978731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:56:59.979134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:56:59.979208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:56:59.979594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:56:59.979668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:59.979678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:59.979680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:59.979681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:59.979683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:59.979684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:59.979685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:59.979687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:59.979688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:59.979690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:59.979692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.979693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.979695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.979696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:59.979697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:59.979705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:59.979716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:59.979722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:59.979726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:59.979731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:59.979736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:59.979741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:59.979745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:59.979750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:59.979755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:59.979759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.979763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.979768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.979772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:59.979777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:59.979785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:59.979794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:56:59.979802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:59.979809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:56:59.979814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:59.979821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:56:59.979828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:59.979835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:56:59.979840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:59.979847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:56:59.979853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:59.979862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:56:59.979873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:59.979879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:56:59.979889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:59.979895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:56:59.979906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:59.979912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:56:59.979922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:59.979928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:56:59.979938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.979944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.979949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.979955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.979960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.979966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.979970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:59.979976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:56:59.979989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:59.979999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:56:59.980048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:56:59.985765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:56:59.986695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:56:59.986716Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:56:59.986720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:56:59.986724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:56:59.986732Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2411 [2:7555896388209546830:11034]
2025-09-30T14:56:59.986751Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:56:59.986769Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:56:59.986772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:59.986776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:59.986779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:59.986797Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:56:59.986806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:56:59.986814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:56:59.986883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.986894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.986897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.986900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:56:59.986904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:56:59.986974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:56:59.986984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:56:59.986999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:56:59.987013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:56:59.987033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:56:59.987058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896388299330118:10349], now have 1 active actors on pipe
2025-09-30T14:56:59.987067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896388299329897:2454], now have 1 active actors on pipe
2025-09-30T14:56:59.987074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896388209546825:11034]
2025-09-30T14:56:59.987083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896388209546825:11034]
2025-09-30T14:56:59.987086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896388209546825:11034]
2025-09-30T14:56:59.987105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:56:59.987125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:56:59.987138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:56:59.987142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:56:59.987146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:56:59.987152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:56:59.987155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:56:59.987186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896388209546825:11034]
2025-09-30T14:56:59.987170Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2411
2025-09-30T14:56:59.987183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2411
2025-09-30T14:56:59.987204Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:56:59.987234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:56:59.987331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:59.987350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:59.987395Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e566137-5250d4e9-84ad720f-254135be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:56:59.987409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:56:59.987414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:56:59.987416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:56:59.987431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:56:59.987448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:56:59.987481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:59.987645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:56:59.987653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:56:59.987666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:56:59.987758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2412 partition: 0 MaxSeqNo: 42 sessionId: src_id|9e566137-5250d4e9-84ad720f-254135be_0
2025-09-30T14:56:59.988188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf5c57b-3e42799d-86cda4a6-e88b522c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9e566137-5250d4e9-84ad720f-254135be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:56:59.991190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e566137-5250d4e9-84ad720f-254135be_0] Write session: try to update token
2025-09-30T14:56:59.991213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e566137-5250d4e9-84ad720f-254135be_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:00.000584Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:00.000611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:00.000622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896388209546825:11034]
2025-09-30T14:57:00.000671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:00.000673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:00.000860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:00.001029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:00.001217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:00.001377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:00.001617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:00.001676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:00.010848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2412 sessionId: src_id|9e566137-5250d4e9-84ad720f-254135be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:00.013684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:00.014372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:00.014404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:00.014425Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:00.014428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:00.014431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:00.014433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:00.014442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896388209546825:11034]
2025-09-30T14:57:00.014446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896388209546825:11034]
2025-09-30T14:57:00.014450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896388209546825:11034]
2025-09-30T14:57:00.014496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:00.014502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:00.014508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.014511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:00.014513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:00.014518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:00.014661Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:00.051693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896392594297569:10294]
2025-09-30T14:57:00.052033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2411, pipe: [1:7555896392594297569:10294]
2025-09-30T14:57:00.128254Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:00.128720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:00.128750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896392594297569:10294], now have 1 active actors on pipe
2025-09-30T14:57:00.128859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:00.128913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896392594297569:10294]
2025-09-30T14:57:00.128933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:00.128963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:00.128972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:00.129041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2412 reason: error at write: Disconnected sessionId: src_id|9e566137-5250d4e9-84ad720f-254135be_0
2025-09-30T14:57:00.129231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2412 sessionId: src_id|9e566137-5250d4e9-84ad720f-254135be_0 is DEAD
2025-09-30T14:57:00.129374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e566137-5250d4e9-84ad720f-254135be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:00.129385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e566137-5250d4e9-84ad720f-254135be_0] Write session will restart in 0.005190s
2025-09-30T14:57:00.129408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e566137-5250d4e9-84ad720f-254135be_0] Write session: Do CDS request
2025-09-30T14:57:00.129414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e566137-5250d4e9-84ad720f-254135be_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:00.135792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e566137-5250d4e9-84ad720f-254135be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:00.135931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:00.135962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2413
2025-09-30T14:57:00.136152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2413 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:00.136195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2413 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:00.136207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2413 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:00.136212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:00.136689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2413 sessionId:  describe result for acl check
2025-09-30T14:57:00.136726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:00.136729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:00.136730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:00.136736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896392594297613:10354] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:00.137287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896392594297613:10354] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:00.139930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896392594297613:10354] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:00.143235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896392594297613:10354] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:00.143271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896392594297613:10354] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:00.143274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896392594297613:10354] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:00.143284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2413 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:00.149285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:00.151757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:00.151992Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:00.152004Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:00.152014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:00.152067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:00.152110Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896392504514377:11036]
2025-09-30T14:57:00.152814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:00.153159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:00.153216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:00.153580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:00.153649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:00.153660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:00.153662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:00.153663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:00.153664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:00.153665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:00.153667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:00.153668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:00.153670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:00.153671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:00.153672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.153674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:00.153675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:00.153676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:00.153678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:00.153683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:00.153693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:00.153698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:00.153702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:00.153706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:00.153710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:00.153714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:00.153718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:00.153723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:00.153728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:00.153732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.153737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:00.153741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:00.153745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:00.153750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:00.153758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:00.153767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:00.153774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:00.153781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:00.153791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:00.153798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:00.153809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:00.153815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:00.153822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:00.153828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:00.153838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:00.153845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:00.153853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:00.153865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:00.153869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:00.153875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:00.153881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:00.153887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:00.153896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:00.153901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:00.153910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.153916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.153922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:00.153932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:00.153937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:00.153942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:00.153947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:00.153952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:00.153958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:00.153965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:00.154013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:00.159714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:00.160603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:00.160722Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:00.160733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:00.160737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:00.160746Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2412 [2:7555896392504514377:11036]
2025-09-30T14:57:00.160766Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:00.160785Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:00.160794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:00.160798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:00.160802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:00.160821Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:00.160834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:00.160847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:00.160925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.160938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:00.160940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:00.160944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:00.160947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:00.161223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:00.161234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.161249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:00.161263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:00.161230Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2412
2025-09-30T14:57:00.161244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2412
2025-09-30T14:57:00.161289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:00.161314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896392594297583:2454], now have 1 active actors on pipe
2025-09-30T14:57:00.161324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896392594297818:10354], now have 1 active actors on pipe
2025-09-30T14:57:00.161338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896392504514372:11036]
2025-09-30T14:57:00.161345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896392504514372:11036]
2025-09-30T14:57:00.161349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896392504514372:11036]
2025-09-30T14:57:00.161364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:00.161382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:00.161389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:00.161394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:00.161394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:00.161396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:00.161413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:00.161429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:00.161440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:00.161493Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b32bb39f-310a71f-56f559c3-9dacdc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:00.161505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:00.161508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:00.161511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:00.161523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:00.161533Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:00.161546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896392504514372:11036]
2025-09-30T14:57:00.161559Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:00.161565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:00.161589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:00.161750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:00.161759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:00.161774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:00.161913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2413 partition: 0 MaxSeqNo: 42 sessionId: src_id|b32bb39f-310a71f-56f559c3-9dacdc_0
2025-09-30T14:57:00.162336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e566137-5250d4e9-84ad720f-254135be_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b32bb39f-310a71f-56f559c3-9dacdc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:00.166223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b32bb39f-310a71f-56f559c3-9dacdc_0] Write session: try to update token
2025-09-30T14:57:00.166248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b32bb39f-310a71f-56f559c3-9dacdc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:00.174139Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:00.174159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:00.174162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:00.174164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:00.174173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896392504514372:11036]
2025-09-30T14:57:00.174179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896392504514372:11036]
2025-09-30T14:57:00.174183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896392504514372:11036]
2025-09-30T14:57:00.174228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:00.174229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:00.174237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:00.174241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:00.174242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.174245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:00.174399Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:00.182027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2413 sessionId: src_id|b32bb39f-310a71f-56f559c3-9dacdc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:00.185030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:00.229324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896392594297968:10294]
2025-09-30T14:57:00.229624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2412, pipe: [1:7555896392594297968:10294]
2025-09-30T14:57:00.288988Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:00.289722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:00.289742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:00.289763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896392594297968:10294], now have 1 active actors on pipe
2025-09-30T14:57:00.290300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:00.290308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:00.290312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:00.289985Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:00.290371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896392594297968:10294]
2025-09-30T14:57:00.290385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2413 reason: error at write: Disconnected sessionId: src_id|b32bb39f-310a71f-56f559c3-9dacdc_0
2025-09-30T14:57:00.290698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b32bb39f-310a71f-56f559c3-9dacdc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:00.290706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b32bb39f-310a71f-56f559c3-9dacdc_0] Write session will restart in 0.008383s
2025-09-30T14:57:00.290731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b32bb39f-310a71f-56f559c3-9dacdc_0] Write session: Do CDS request
2025-09-30T14:57:00.290736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b32bb39f-310a71f-56f559c3-9dacdc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:00.290578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2413 sessionId: src_id|b32bb39f-310a71f-56f559c3-9dacdc_0 is DEAD
2025-09-30T14:57:00.300881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b32bb39f-310a71f-56f559c3-9dacdc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:00.300954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:00.300972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2414
2025-09-30T14:57:00.301161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2414 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:00.301210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2414 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:00.301215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2414 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:00.301221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:00.301730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2414 sessionId:  describe result for acl check
2025-09-30T14:57:00.301772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:00.301774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:00.301778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:00.301785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896392594297991:10359] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:00.302388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896392594297991:10359] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:00.304859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896392594297991:10359] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:00.308219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896392594297991:10359] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:00.308235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896392594297991:10359] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:00.308238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896392594297991:10359] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:00.308247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2414 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:00.316837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:00.319630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:00.319885Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:00.319897Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:00.319909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:00.319971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:00.320022Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896392504514629:11038]
2025-09-30T14:57:00.320719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:00.321110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:00.321207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:00.321614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:00.321712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:00.321720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:00.321721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:00.321723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:00.321724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:00.321726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:00.321727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:00.321729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:00.321730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:00.321732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:00.321733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.321735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:00.321736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:00.321738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:00.321739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:00.321745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:00.321756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:00.321760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:00.321764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:00.321769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:00.321774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:00.321779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:00.321783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:00.321787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:00.321792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:00.321795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.321799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:00.321803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:00.321807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:00.321812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:00.321821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:00.321830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:00.321836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:00.321842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:00.321847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:00.321853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:00.321859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:00.321864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:00.321875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:00.321881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:00.321891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:00.321897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:00.321908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:00.321915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:00.321920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:00.321926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:00.321936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:00.321942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:00.321952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:00.321958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:00.321969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.321975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.321984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:00.321989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:00.321994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:00.322005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:00.322010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:00.322020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:00.322025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:00.322030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:00.322081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:00.327791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:00.328833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:00.328851Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:00.328854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:00.328859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:00.328866Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2413 [2:7555896392504514629:11038]
2025-09-30T14:57:00.328885Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:00.328906Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:00.328914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:00.328918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:00.328920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:00.328937Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:00.328949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:00.328961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:00.329031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.329043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:00.329045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:00.329049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:00.329052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:00.329124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:00.329133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.329146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:00.329159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:00.329178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:00.329207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896392504514624:11038]
2025-09-30T14:57:00.329215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896392504514624:11038]
2025-09-30T14:57:00.329217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896392504514624:11038]
2025-09-30T14:57:00.329227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:00.329235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:00.329239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:00.329241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:00.329242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:00.329257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:00.329265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:00.329276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896392594297972:2454], now have 1 active actors on pipe
2025-09-30T14:57:00.329285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896392594298138:10359], now have 1 active actors on pipe
2025-09-30T14:57:00.329321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896392504514624:11038]
2025-09-30T14:57:00.329338Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:00.329376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:00.329353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2413
2025-09-30T14:57:00.329370Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2413
2025-09-30T14:57:00.329606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:00.329624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:00.329656Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb6b8e00-72d5ab30-62d74b85-c0f6c378_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:00.329666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:00.329677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:00.329680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:00.329692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:00.329709Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:00.329731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:00.330278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:00.330293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:00.330317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:00.330467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2414 partition: 0 MaxSeqNo: 42 sessionId: src_id|cb6b8e00-72d5ab30-62d74b85-c0f6c378_0
2025-09-30T14:57:00.330915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b32bb39f-310a71f-56f559c3-9dacdc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cb6b8e00-72d5ab30-62d74b85-c0f6c378_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:00.334217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb6b8e00-72d5ab30-62d74b85-c0f6c378_0] Write session: try to update token
2025-09-30T14:57:00.334248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb6b8e00-72d5ab30-62d74b85-c0f6c378_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:00.342888Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:00.342912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:00.342915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:00.342917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:00.342930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896392504514624:11038]
2025-09-30T14:57:00.342934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896392504514624:11038]
2025-09-30T14:57:00.342939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896392504514624:11038]
2025-09-30T14:57:00.342982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:00.342989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.342992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:00.342997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:00.343005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:00.343009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:00.343141Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:00.352035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2414 sessionId: src_id|cb6b8e00-72d5ab30-62d74b85-c0f6c378_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:00.355114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:00.390096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896392594298353:10294]
2025-09-30T14:57:00.390496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2413, pipe: [1:7555896392594298353:10294]
2025-09-30T14:57:00.458609Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:00.458965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:00.458982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:00.459002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896392594298353:10294], now have 1 active actors on pipe
2025-09-30T14:57:00.459267Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:00.459212Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:00.459230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:00.459234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:00.459293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896392594298353:10294]
2025-09-30T14:57:00.459335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2414 reason: error at write: Disconnected sessionId: src_id|cb6b8e00-72d5ab30-62d74b85-c0f6c378_0
2025-09-30T14:57:00.459503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2414 sessionId: src_id|cb6b8e00-72d5ab30-62d74b85-c0f6c378_0 is DEAD
2025-09-30T14:57:00.459850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb6b8e00-72d5ab30-62d74b85-c0f6c378_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:00.459861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb6b8e00-72d5ab30-62d74b85-c0f6c378_0] Write session will restart in 0.009458s
2025-09-30T14:57:00.459885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb6b8e00-72d5ab30-62d74b85-c0f6c378_0] Write session: Do CDS request
2025-09-30T14:57:00.459890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb6b8e00-72d5ab30-62d74b85-c0f6c378_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:00.470853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb6b8e00-72d5ab30-62d74b85-c0f6c378_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:00.470930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:00.470949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2415
2025-09-30T14:57:00.471143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2415 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:00.471190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2415 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:00.471202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2415 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:00.471207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:00.471716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2415 sessionId:  describe result for acl check
2025-09-30T14:57:00.471753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:00.471761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:00.471764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:00.471771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896392594298516:10363] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:00.472332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896392594298516:10363] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:00.476254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896392594298516:10363] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:00.479539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896392594298516:10363] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:00.479555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896392594298516:10363] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:00.479558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896392594298516:10363] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:00.479567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2415 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:00.481410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:00.483671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:00.483894Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:00.483904Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:00.483915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:00.483983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:00.484025Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896392504514882:11040]
2025-09-30T14:57:00.484665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:00.485078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:00.485125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:00.485473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:00.485559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:00.485565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:00.485567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:00.485568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:00.485569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:00.485570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:00.485572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:00.485573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:00.485574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:00.485576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:00.485577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.485578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:00.485579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:00.485581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:00.485582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:00.485587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:00.485598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:00.485602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:00.485607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:00.485611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:00.485616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:00.485621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:00.485626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:00.485631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:00.485635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:00.485638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.485642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:00.485646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:00.485650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:00.485655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:00.485662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:00.485671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:00.485678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:00.485684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:00.485692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:00.485698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:00.485703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:00.485715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:00.485721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:00.485726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:00.485731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:00.485736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:00.485742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:00.485747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:00.485752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:00.485758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:00.485764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:00.485770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:00.485774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:00.485780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:00.485785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.485790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.485800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:00.485805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:00.485810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:00.485821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:00.485825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:00.485831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:00.485838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:00.485843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:00.485887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:00.491909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:00.492941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:00.492959Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:00.492962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:00.492967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:00.492974Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2414 [2:7555896392504514882:11040]
2025-09-30T14:57:00.492993Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:00.493016Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:00.493019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:00.493023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:00.493026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:00.493043Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:00.493050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:00.493057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:00.493132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.493143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:00.493145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:00.493150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:00.493152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:00.493436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2414
2025-09-30T14:57:00.493451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2414
2025-09-30T14:57:00.493609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:00.493622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.493638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:00.493653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:00.493677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:00.493704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896392594298721:10363], now have 1 active actors on pipe
2025-09-30T14:57:00.493709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896392594298354:2454], now have 1 active actors on pipe
2025-09-30T14:57:00.493728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:00.493738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:00.493755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896392504514877:11040]
2025-09-30T14:57:00.493762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896392504514877:11040]
2025-09-30T14:57:00.493764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896392504514877:11040]
2025-09-30T14:57:00.493780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:00.493797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:00.493809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:00.493814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:00.493817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:00.493822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:00.493824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:00.493835Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|514b7e36-a7c3de9a-4492dd1f-f648cb6e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:00.493843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:00.493847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:00.493849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:00.493859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:00.493869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:00.493915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896392504514877:11040]
2025-09-30T14:57:00.493928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:00.493937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:00.493941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:00.494132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:00.494142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:00.494158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:00.494258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2415 partition: 0 MaxSeqNo: 42 sessionId: src_id|514b7e36-a7c3de9a-4492dd1f-f648cb6e_0
2025-09-30T14:57:00.494701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb6b8e00-72d5ab30-62d74b85-c0f6c378_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|514b7e36-a7c3de9a-4492dd1f-f648cb6e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:00.497787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|514b7e36-a7c3de9a-4492dd1f-f648cb6e_0] Write session: try to update token
2025-09-30T14:57:00.497808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|514b7e36-a7c3de9a-4492dd1f-f648cb6e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:00.507024Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:00.507045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:00.507055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896392504514877:11040]
2025-09-30T14:57:00.507107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:00.507122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:00.507345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:00.507520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:00.507688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:00.507861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:00.508087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:00.508144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:00.514910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2415 sessionId: src_id|514b7e36-a7c3de9a-4492dd1f-f648cb6e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:00.517914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:00.518278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:00.518309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:00.518329Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:00.518332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:00.518335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:00.518337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:00.518347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896392504514877:11040]
2025-09-30T14:57:00.518352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896392504514877:11040]
2025-09-30T14:57:00.518357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896392504514877:11040]
2025-09-30T14:57:00.518402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:00.518408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:00.518410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:00.518417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.518417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:00.518420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:00.518565Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:00.559568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896392594298737:10294]
2025-09-30T14:57:00.559875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2414, pipe: [1:7555896392594298737:10294]
2025-09-30T14:57:00.636103Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:00.636583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:00.636632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896392594298737:10294], now have 1 active actors on pipe
2025-09-30T14:57:00.636759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:00.636890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896392594298737:10294]
2025-09-30T14:57:00.636931Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:00.650122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:00.650138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:00.650164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2415 reason: error at write: Disconnected sessionId: src_id|514b7e36-a7c3de9a-4492dd1f-f648cb6e_0
2025-09-30T14:57:00.650307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2415 sessionId: src_id|514b7e36-a7c3de9a-4492dd1f-f648cb6e_0 is DEAD
2025-09-30T14:57:00.650478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|514b7e36-a7c3de9a-4492dd1f-f648cb6e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:00.650490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|514b7e36-a7c3de9a-4492dd1f-f648cb6e_0] Write session will restart in 0.006474s
2025-09-30T14:57:00.650528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|514b7e36-a7c3de9a-4492dd1f-f648cb6e_0] Write session: Do CDS request
2025-09-30T14:57:00.650534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|514b7e36-a7c3de9a-4492dd1f-f648cb6e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:00.657778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|514b7e36-a7c3de9a-4492dd1f-f648cb6e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:00.657927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:00.657945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2416
2025-09-30T14:57:00.658205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2416 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:00.658256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2416 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:00.658267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2416 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:00.658272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:00.658814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2416 sessionId:  describe result for acl check
2025-09-30T14:57:00.658857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:00.658866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:00.658869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:00.658876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896392594298827:10367] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:00.659569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896392594298827:10367] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:00.663347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896392594298827:10367] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:00.667136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896392594298827:10367] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:00.667156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896392594298827:10367] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:00.667160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896392594298827:10367] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:00.667170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2416 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:00.675302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:00.677099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:00.677337Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:00.677348Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:00.677359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:00.677414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:00.677458Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896392504515139:11043]
2025-09-30T14:57:00.677949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:00.678275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:00.678344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:00.678699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:00.678766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:00.678774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:00.678775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:00.678776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:00.678778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:00.678779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:00.678780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:00.678782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:00.678783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:00.678784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:00.678785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.678787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:00.678788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:00.678790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:00.678791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:00.678797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:00.678807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:00.678812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:00.678817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:00.678821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:00.678826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:00.678831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:00.678835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:00.678839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:00.678844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:00.678848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.678853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:00.678857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:00.678861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:00.678865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:00.678873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:00.678882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:00.678889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:00.678895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:00.678901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:00.678907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:00.678912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:00.678917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:00.678929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:00.678935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:00.678941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:00.678946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:00.678951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:00.678962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:00.678969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:00.678980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:00.678985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:00.678991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:00.678996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:00.679007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:00.679012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.679022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.679028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:00.679033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:00.679043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:00.679049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:00.679058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:00.679064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:00.679069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:00.679075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:00.679127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:00.684732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:00.686122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:00.686145Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:00.686148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:00.686152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:00.686158Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2415 [2:7555896392504515139:11043]
2025-09-30T14:57:00.686175Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:00.686192Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:00.686197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:00.686200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:00.686203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:00.686221Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:00.686229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:00.686235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:00.686311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.686320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:00.686322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:00.686326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:00.686328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:00.686394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:00.686399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.686419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:00.686434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:00.686453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:00.686475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896392594298738:2454], now have 1 active actors on pipe
2025-09-30T14:57:00.686483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896392594299007:10367], now have 1 active actors on pipe
2025-09-30T14:57:00.686489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896392504515134:11043]
2025-09-30T14:57:00.686491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896392504515134:11043]
2025-09-30T14:57:00.686493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896392504515134:11043]
2025-09-30T14:57:00.686506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:00.686524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:00.686542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:00.686545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:00.686569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:00.686582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896392504515134:11043]
2025-09-30T14:57:00.686582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:00.686584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:00.686585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:00.686594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:00.686593Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2415
2025-09-30T14:57:00.686601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2415
2025-09-30T14:57:00.686669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:00.686679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:00.686706Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9562e3-384ab383-84a950c0-f89db26e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:00.686719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:00.686725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:00.686727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:00.686737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:00.686749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:00.686764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:00.686988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:00.687002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:00.687025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:00.687118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2416 partition: 0 MaxSeqNo: 42 sessionId: src_id|9562e3-384ab383-84a950c0-f89db26e_0
2025-09-30T14:57:00.687538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|514b7e36-a7c3de9a-4492dd1f-f648cb6e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9562e3-384ab383-84a950c0-f89db26e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:00.690949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9562e3-384ab383-84a950c0-f89db26e_0] Write session: try to update token
2025-09-30T14:57:00.690974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9562e3-384ab383-84a950c0-f89db26e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:00.705545Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:00.705573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:00.705585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896392504515134:11043]
2025-09-30T14:57:00.705639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:00.705666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:00.705844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:00.706014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:00.706181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:00.706338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:00.706563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:00.706622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:00.707261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2416 sessionId: src_id|9562e3-384ab383-84a950c0-f89db26e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:00.710175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:00.710217Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:00.710240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:00.710243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:00.710245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:00.710256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896392504515134:11043]
2025-09-30T14:57:00.710261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896392504515134:11043]
2025-09-30T14:57:00.710266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896392504515134:11043]
2025-09-30T14:57:00.710303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:00.710317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.710326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:00.710322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:00.710339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:00.710343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:00.710475Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:00.737216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896392594299124:10294]
2025-09-30T14:57:00.737593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2415, pipe: [1:7555896392594299124:10294]
2025-09-30T14:57:00.833177Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:00.833572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:00.833588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:00.833611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896392594299124:10294], now have 1 active actors on pipe
2025-09-30T14:57:00.833869Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:00.834383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9562e3-384ab383-84a950c0-f89db26e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:00.834394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9562e3-384ab383-84a950c0-f89db26e_0] Write session will restart in 0.008594s
2025-09-30T14:57:00.833908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896392594299124:10294]
2025-09-30T14:57:00.834418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9562e3-384ab383-84a950c0-f89db26e_0] Write session: Do CDS request
2025-09-30T14:57:00.833908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:00.833944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:00.834433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9562e3-384ab383-84a950c0-f89db26e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:00.834020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2416 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9562e3-384ab383-84a950c0-f89db26e_0
2025-09-30T14:57:00.834206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2416 sessionId: src_id|9562e3-384ab383-84a950c0-f89db26e_0 is DEAD
2025-09-30T14:57:00.843820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9562e3-384ab383-84a950c0-f89db26e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:00.843904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:00.843919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2417
2025-09-30T14:57:00.844081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2417 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:00.844121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2417 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:00.844132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2417 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:00.844137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:00.844575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2417 sessionId:  describe result for acl check
2025-09-30T14:57:00.844607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:00.844615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:00.844617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:00.844623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896392594299161:10379] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:00.845198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896392594299161:10379] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:00.847472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896392594299161:10379] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:00.850727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896392594299161:10379] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:00.850743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896392594299161:10379] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:00.850746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896392594299161:10379] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:00.850755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2417 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:00.864598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:00.867345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:00.867810Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:00.867821Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:00.867835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:00.867904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:00.867950Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896392504515430:11057]
2025-09-30T14:57:00.868646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:00.869006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:00.869059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:00.869441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:00.869516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:00.869524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:00.869526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:00.869527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:00.869529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:00.869530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:00.869531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:00.869533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:00.869534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:00.869535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:00.869537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.869538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:00.869539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:00.869540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:00.869542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:00.869547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:00.869557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:00.869561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:00.869566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:00.869570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:00.869575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:00.869579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:00.869583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:00.869587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:00.869593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:00.869597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.869600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:00.869604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:00.869608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:00.869612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:00.869621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:00.869629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:00.869635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:00.869641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:00.869647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:00.869652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:00.869657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:00.869661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:00.869667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:00.869673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:00.869678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:00.869684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:00.869688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:00.869693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:00.869698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:00.869704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:00.869711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:00.869716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:00.869720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:00.869726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:00.869735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.869741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.869746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:00.869751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:00.869756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:00.869761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:00.869765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:00.869770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:00.869784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:00.869789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:00.869835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:00.875523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:00.876746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:00.876766Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:00.876769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:00.876773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:00.876780Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2416 [2:7555896392504515430:11057]
2025-09-30T14:57:00.876798Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:00.876819Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:00.876822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:00.876827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:00.876829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:00.876848Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:00.876860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:00.876868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:00.876938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.876950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:00.876952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:00.876955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:00.876958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:00.877036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:00.877043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.877058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:00.877073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:00.877096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:00.877119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896392594299254:10379], now have 1 active actors on pipe
2025-09-30T14:57:00.877129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896392594299150:2454], now have 1 active actors on pipe
2025-09-30T14:57:00.877135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896392504515425:11057]
2025-09-30T14:57:00.877138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896392504515425:11057]
2025-09-30T14:57:00.877140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896392504515425:11057]
2025-09-30T14:57:00.877152Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:00.877169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:00.877188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:00.877192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:00.877194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:00.877201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:00.877204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:00.877242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896392504515425:11057]
2025-09-30T14:57:00.877257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:00.877242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2416
2025-09-30T14:57:00.877275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:00.877345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:00.877354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:00.877368Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2416
2025-09-30T14:57:00.877379Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d86552be-31bb0067-6b9ec97a-19416067_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:00.877391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:00.877400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:00.877401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:00.877412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:00.877428Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:00.877452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:00.877574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:00.877581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:00.877593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:00.877696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2417 partition: 0 MaxSeqNo: 42 sessionId: src_id|d86552be-31bb0067-6b9ec97a-19416067_0
2025-09-30T14:57:00.878113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9562e3-384ab383-84a950c0-f89db26e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d86552be-31bb0067-6b9ec97a-19416067_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:00.881087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d86552be-31bb0067-6b9ec97a-19416067_0] Write session: try to update token
2025-09-30T14:57:00.881106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d86552be-31bb0067-6b9ec97a-19416067_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:00.890176Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:00.890204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:00.890207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:00.890209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:00.890219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896392504515425:11057]
2025-09-30T14:57:00.890224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896392504515425:11057]
2025-09-30T14:57:00.890229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896392504515425:11057]
2025-09-30T14:57:00.890270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:00.890279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:00.890281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:00.890449Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:00.891308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:00.891326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:00.891331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:00.898388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2417 sessionId: src_id|d86552be-31bb0067-6b9ec97a-19416067_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:00.901166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:00.934343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896392594299532:10294]
2025-09-30T14:57:00.934720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2416, pipe: [1:7555896392594299532:10294]
2025-09-30T14:57:01.004847Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:01.005359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:01.005384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:01.005407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896392594299532:10294], now have 1 active actors on pipe
2025-09-30T14:57:01.005636Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:01.005657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:01.005674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:01.005680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:01.006126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d86552be-31bb0067-6b9ec97a-19416067_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:01.005724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896392594299532:10294]
2025-09-30T14:57:01.006144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d86552be-31bb0067-6b9ec97a-19416067_0] Write session will restart in 0.008647s
2025-09-30T14:57:01.005750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2417 reason: error at write: Disconnected sessionId: src_id|d86552be-31bb0067-6b9ec97a-19416067_0
2025-09-30T14:57:01.005933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2417 sessionId: src_id|d86552be-31bb0067-6b9ec97a-19416067_0 is DEAD
2025-09-30T14:57:01.006197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d86552be-31bb0067-6b9ec97a-19416067_0] Write session: Do CDS request
2025-09-30T14:57:01.006207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d86552be-31bb0067-6b9ec97a-19416067_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:01.017762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d86552be-31bb0067-6b9ec97a-19416067_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:01.018190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:01.018211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2418
2025-09-30T14:57:01.018349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2418 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:01.018381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2418 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:01.018387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2418 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:01.018392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:01.018912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2418 sessionId:  describe result for acl check
2025-09-30T14:57:01.018951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:01.018953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:01.018955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:01.018961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896396889266942:10383] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:01.019560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896396889266942:10383] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:01.022042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896396889266942:10383] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:01.025922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896396889266942:10383] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:01.025938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896396889266942:10383] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:01.025942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896396889266942:10383] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:01.025951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2418 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:01.032454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:01.034626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:01.034854Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:01.034867Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:01.034879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:01.034941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:01.034990Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896396799482997:11061]
2025-09-30T14:57:01.035676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:01.036049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:01.036097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:01.036441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:01.036509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:01.036517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:01.036518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:01.036520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:01.036521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:01.036522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:01.036523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:01.036524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:01.036525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:01.036526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:01.036527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.036529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:01.036530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:01.036531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:01.036532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:01.036537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:01.036547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:01.036551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:01.036555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:01.036558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:01.036562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:01.036566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:01.036569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:01.036573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:01.036576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:01.036580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.036584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:01.036587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:01.036591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:01.036594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:01.036604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:01.036612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:01.036619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:01.036626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:01.036630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:01.036636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:01.036640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:01.036645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:01.036650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:01.036655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:01.036660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:01.036666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:01.036671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:01.036677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:01.036681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:01.036687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:01.036692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:01.036697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:01.036701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:01.036707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:01.036712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.036718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.036722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:01.036727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:01.036732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:01.036737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:01.036741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:01.036746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:01.036751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:01.036755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:01.036811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:01.042533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:01.044054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:01.044071Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:01.044074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:01.044079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:01.044086Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2417 [2:7555896396799482997:11061]
2025-09-30T14:57:01.044106Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:01.044122Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:01.044126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:01.044129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:01.044132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:01.044149Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:01.044156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:01.044164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:01.044247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.044255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:01.044257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:01.044261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:01.044264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:01.044340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:01.044349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.044365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:01.044378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:01.044400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:01.044425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896396889266836:2454], now have 1 active actors on pipe
2025-09-30T14:57:01.044434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896396889267106:10383], now have 1 active actors on pipe
2025-09-30T14:57:01.044440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896396799482992:11061]
2025-09-30T14:57:01.044443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896396799482992:11061]
2025-09-30T14:57:01.044445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896396799482992:11061]
2025-09-30T14:57:01.044457Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:01.044470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:01.044478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:01.044482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:01.044484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:01.044489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:01.044492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:01.044532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896396799482992:11061]
2025-09-30T14:57:01.044540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:01.044524Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2417
2025-09-30T14:57:01.044564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:01.044553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2417
2025-09-30T14:57:01.044581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:01.044591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:01.044616Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5732210-e43c4c9e-ac61d2f9-22a323f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:01.044628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:01.044637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:01.044640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:01.044650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:01.044663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:01.044685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:01.044847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:01.044857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:01.044870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:01.045133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2418 partition: 0 MaxSeqNo: 42 sessionId: src_id|d5732210-e43c4c9e-ac61d2f9-22a323f0_0
2025-09-30T14:57:01.045537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d86552be-31bb0067-6b9ec97a-19416067_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d5732210-e43c4c9e-ac61d2f9-22a323f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:01.048520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5732210-e43c4c9e-ac61d2f9-22a323f0_0] Write session: try to update token
2025-09-30T14:57:01.048539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5732210-e43c4c9e-ac61d2f9-22a323f0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:01.056937Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:01.056956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:01.056965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896396799482992:11061]
2025-09-30T14:57:01.057010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:01.057012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:01.057198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:01.057345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:01.057493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:01.057644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:01.057848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:01.057893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:01.064929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2418 sessionId: src_id|d5732210-e43c4c9e-ac61d2f9-22a323f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:01.067837Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:01.067860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:01.067863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:01.067873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:01.067865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:01.067876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896396799482992:11061]
2025-09-30T14:57:01.067880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896396799482992:11061]
2025-09-30T14:57:01.067884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896396799482992:11061]
2025-09-30T14:57:01.067926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:01.067930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:01.067933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.067935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:01.067935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:01.067938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:01.068107Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:01.105839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896396889267218:10294]
2025-09-30T14:57:01.106199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2417, pipe: [1:7555896396889267218:10294]
2025-09-30T14:57:01.190497Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:01.191007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:01.191030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:01.191059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896396889267218:10294], now have 1 active actors on pipe
2025-09-30T14:57:01.191367Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:01.191830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5732210-e43c4c9e-ac61d2f9-22a323f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:01.191842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5732210-e43c4c9e-ac61d2f9-22a323f0_0] Write session will restart in 0.008811s
2025-09-30T14:57:01.191865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5732210-e43c4c9e-ac61d2f9-22a323f0_0] Write session: Do CDS request
2025-09-30T14:57:01.191871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5732210-e43c4c9e-ac61d2f9-22a323f0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:01.191379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:01.191395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:01.191421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:01.191473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2418 reason: error at write: Disconnected sessionId: src_id|d5732210-e43c4c9e-ac61d2f9-22a323f0_0
2025-09-30T14:57:01.191474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896396889267218:10294]
2025-09-30T14:57:01.191672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2418 sessionId: src_id|d5732210-e43c4c9e-ac61d2f9-22a323f0_0 is DEAD
2025-09-30T14:57:01.201884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5732210-e43c4c9e-ac61d2f9-22a323f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:01.201948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:01.201966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2419
2025-09-30T14:57:01.202169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2419 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:01.202203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2419 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:01.202210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2419 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:01.202215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:01.202838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2419 sessionId:  describe result for acl check
2025-09-30T14:57:01.202874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:01.202876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:01.202880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:01.202886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896396889267330:10389] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:01.203498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896396889267330:10389] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:01.205625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896396889267330:10389] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:01.210463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896396889267330:10389] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:01.210479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896396889267330:10389] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:01.210484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896396889267330:10389] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:01.210493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2419 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:01.219600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:01.222226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:01.222596Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:01.222610Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:01.222624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:01.222696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:01.222732Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896396799483254:11063]
2025-09-30T14:57:01.223390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:01.223839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:01.223923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:01.224296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:01.224364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:01.224371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:01.224372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:01.224373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:01.224375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:01.224376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:01.224378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:01.224379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:01.224381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:01.224382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:01.224384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.224385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:01.224387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:01.224388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:01.224389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:01.224395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:01.224406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:01.224411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:01.224416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:01.224420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:01.224425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:01.224430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:01.224434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:01.224439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:01.224444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:01.224448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.224452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:01.224456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:01.224461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:01.224466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:01.224476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:01.224485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:01.224492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:01.224498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:01.224503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:01.224510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:01.224514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:01.224520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:01.224525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:01.224531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:01.224536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:01.224542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:01.224548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:01.224559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:01.224564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:01.224570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:01.224575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:01.224582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:01.224587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:01.224594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:01.224599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.224605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.224611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:01.224617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:01.224623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:01.224629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:01.224634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:01.224640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:01.224648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:01.224659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:01.224708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:01.230881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:01.232244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:01.232267Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:01.232269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:01.232273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:01.232283Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2418 [2:7555896396799483254:11063]
2025-09-30T14:57:01.232300Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:01.232318Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:01.232326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:01.232330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:01.232332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:01.232348Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:01.232357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:01.232369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:01.232436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.232444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:01.232447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:01.232450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:01.232453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:01.232530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:01.232538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.232553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:01.232576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:01.232596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:01.232620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896396889267516:10389], now have 1 active actors on pipe
2025-09-30T14:57:01.232628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896396889267235:2454], now have 1 active actors on pipe
2025-09-30T14:57:01.232635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896396799483249:11063]
2025-09-30T14:57:01.232646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896396799483249:11063]
2025-09-30T14:57:01.232649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896396799483249:11063]
2025-09-30T14:57:01.232662Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:01.232676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:01.232680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:01.232683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:01.232686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:01.232697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:01.232700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:01.232738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896396799483249:11063]
2025-09-30T14:57:01.232745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:01.232728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2418
2025-09-30T14:57:01.232741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2418
2025-09-30T14:57:01.232768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:01.232805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:01.232811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:01.232841Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc90d23f-750610c-c1b69a30-7b62f7c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:01.232855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:01.232859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:01.232861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:01.232871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:01.232879Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:01.232894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:01.233053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:01.233065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:01.233080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:01.233199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2419 partition: 0 MaxSeqNo: 42 sessionId: src_id|cc90d23f-750610c-c1b69a30-7b62f7c0_0
2025-09-30T14:57:01.233583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5732210-e43c4c9e-ac61d2f9-22a323f0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cc90d23f-750610c-c1b69a30-7b62f7c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:01.236568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc90d23f-750610c-c1b69a30-7b62f7c0_0] Write session: try to update token
2025-09-30T14:57:01.236594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc90d23f-750610c-c1b69a30-7b62f7c0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:01.245067Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:01.245096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:01.245107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896396799483249:11063]
2025-09-30T14:57:01.245156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:01.245170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:01.245357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:01.245520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:01.245680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:01.245840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:01.246051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:01.246105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:01.253378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2419 sessionId: src_id|cc90d23f-750610c-c1b69a30-7b62f7c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:01.256096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:01.256999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:01.257030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:01.257050Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:01.257053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:01.257056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:01.257059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:01.257069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896396799483249:11063]
2025-09-30T14:57:01.257074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896396799483249:11063]
2025-09-30T14:57:01.257078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896396799483249:11063]
2025-09-30T14:57:01.257130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:01.257135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:01.257142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.257144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:01.257147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:01.257151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:01.257301Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:01.291740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896396889267626:10294]
2025-09-30T14:57:01.292089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2418, pipe: [1:7555896396889267626:10294]
2025-09-30T14:57:01.379442Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:01.380127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:01.380167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896396889267626:10294], now have 1 active actors on pipe
2025-09-30T14:57:01.383402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:01.383513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:01.383523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:01.383600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2419 reason: error at write: Disconnected sessionId: src_id|cc90d23f-750610c-c1b69a30-7b62f7c0_0
2025-09-30T14:57:01.383762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2419 sessionId: src_id|cc90d23f-750610c-c1b69a30-7b62f7c0_0 is DEAD
2025-09-30T14:57:01.383952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896396889267626:10294]
2025-09-30T14:57:01.383966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:01.384186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc90d23f-750610c-c1b69a30-7b62f7c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:01.384198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc90d23f-750610c-c1b69a30-7b62f7c0_0] Write session will restart in 0.006321s
2025-09-30T14:57:01.384225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc90d23f-750610c-c1b69a30-7b62f7c0_0] Write session: Do CDS request
2025-09-30T14:57:01.384231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc90d23f-750610c-c1b69a30-7b62f7c0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:01.395763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc90d23f-750610c-c1b69a30-7b62f7c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:01.399274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:01.399293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2420
2025-09-30T14:57:01.399723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2420 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:01.399766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2420 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:01.399777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2420 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:01.399782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:01.400304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2420 sessionId:  describe result for acl check
2025-09-30T14:57:01.400340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:01.400342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:01.400344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:01.400350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896396889267643:10393] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:01.400905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896396889267643:10393] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:01.405915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896396889267643:10393] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:01.410804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896396889267643:10393] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:01.410834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896396889267643:10393] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:01.410838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896396889267643:10393] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:01.410850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2420 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:01.435974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:01.438856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:01.439132Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:01.439143Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:01.439154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:01.439208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:01.439266Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896396799483514:11065]
2025-09-30T14:57:01.440168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:01.440714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:01.440780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:01.441214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:01.441302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:01.441311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:01.441313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:01.441314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:01.441315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:01.441316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:01.441317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:01.441319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:01.441320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:01.441321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:01.441322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.441324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:01.441325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:01.441326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:01.441327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:01.441334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:01.441345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:01.441348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:01.441352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:01.441356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:01.441360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:01.441364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:01.441368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:01.441371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:01.441378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:01.441381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.441386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:01.441390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:01.441393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:01.441397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:01.441406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:01.441415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:01.441420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:01.441426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:01.441431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:01.441436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:01.441441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:01.441446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:01.441452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:01.441458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:01.441464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:01.441469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:01.441475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:01.441505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:01.441509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:01.441514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:01.441520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:01.441533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:01.441537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:01.441542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:01.441547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.441552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.441556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:01.441563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:01.441568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:01.441573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:01.441583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:01.441589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:01.441593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:01.441599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:01.441647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:01.448196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:01.449561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:01.449567Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:01.449569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:01.449573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:01.449580Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2419 [2:7555896396799483514:11065]
2025-09-30T14:57:01.449598Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:01.449615Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:01.449619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:01.449622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:01.449624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:01.449642Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:01.449648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:01.449656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:01.449721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.449723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:01.449726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:01.449729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:01.449731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:01.449806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:01.449809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.449823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:01.449833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:01.449847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:01.449863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896396799483509:11065]
2025-09-30T14:57:01.449866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896396799483509:11065]
2025-09-30T14:57:01.449867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896396799483509:11065]
2025-09-30T14:57:01.449888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:01.449900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:01.449914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:01.449916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:01.449939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:01.449944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:01.449946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:01.449970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896396799483509:11065]
2025-09-30T14:57:01.449973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:01.450047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:01.450212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896396889267697:10393], now have 1 active actors on pipe
2025-09-30T14:57:01.450216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896396889267631:2454], now have 1 active actors on pipe
2025-09-30T14:57:01.451121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2419
2025-09-30T14:57:01.451143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2419
2025-09-30T14:57:01.451636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:01.451656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:01.451687Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b03f264b-73ab4c51-8dd74f97-11c59c84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:01.451698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:01.451703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:01.451706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:01.451720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:01.451735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:01.451752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:01.452102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:01.452110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:01.452126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:01.452248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2420 partition: 0 MaxSeqNo: 42 sessionId: src_id|b03f264b-73ab4c51-8dd74f97-11c59c84_0
2025-09-30T14:57:01.455399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc90d23f-750610c-c1b69a30-7b62f7c0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b03f264b-73ab4c51-8dd74f97-11c59c84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:01.467508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b03f264b-73ab4c51-8dd74f97-11c59c84_0] Write session: try to update token
2025-09-30T14:57:01.467539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b03f264b-73ab4c51-8dd74f97-11c59c84_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:01.480442Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:01.480470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:01.480483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896396799483509:11065]
2025-09-30T14:57:01.480541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:01.480548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:01.480718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:01.481058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:01.481227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:01.481375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:01.481582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:01.481632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:01.484179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896396889268015:10294]
2025-09-30T14:57:01.484668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2419, pipe: [1:7555896396889268015:10294]
2025-09-30T14:57:01.485125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896396889268015:10294], now have 1 active actors on pipe
2025-09-30T14:57:01.487661Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:01.487685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:01.487688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:01.487690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:01.487699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896396799483509:11065]
2025-09-30T14:57:01.487703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896396799483509:11065]
2025-09-30T14:57:01.487708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896396799483509:11065]
2025-09-30T14:57:01.487751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:01.487759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.487762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:01.487921Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:01.489638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:01.489653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:01.489662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:01.493938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2420 sessionId: src_id|b03f264b-73ab4c51-8dd74f97-11c59c84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:01.496691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:01.610326Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:01.611116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:01.611129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:01.611381Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:01.612127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b03f264b-73ab4c51-8dd74f97-11c59c84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:01.612139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b03f264b-73ab4c51-8dd74f97-11c59c84_0] Write session will restart in 0.006133s
2025-09-30T14:57:01.612179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b03f264b-73ab4c51-8dd74f97-11c59c84_0] Write session: Do CDS request
2025-09-30T14:57:01.612185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b03f264b-73ab4c51-8dd74f97-11c59c84_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:01.611713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:01.611737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:01.611738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896396889268015:10294]
2025-09-30T14:57:01.611759Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:01.611807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2420 reason: error at write: Disconnected sessionId: src_id|b03f264b-73ab4c51-8dd74f97-11c59c84_0
2025-09-30T14:57:01.612011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2420 sessionId: src_id|b03f264b-73ab4c51-8dd74f97-11c59c84_0 is DEAD
2025-09-30T14:57:01.619876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b03f264b-73ab4c51-8dd74f97-11c59c84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:01.619954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:01.619972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2421
2025-09-30T14:57:01.620138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2421 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:01.620185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2421 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:01.620195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2421 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:01.620200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:01.620808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2421 sessionId:  describe result for acl check
2025-09-30T14:57:01.620846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:01.620853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:01.620855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:01.620862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896396889268033:10397] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:01.621436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896396889268033:10397] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:01.623725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896396889268033:10397] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:01.628884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896396889268033:10397] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:01.628905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896396889268033:10397] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:01.628908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896396889268033:10397] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:01.628919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2421 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:01.642862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:01.646735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:01.647006Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:01.647010Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:01.647023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:01.647086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:01.647128Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896396799483775:11068]
2025-09-30T14:57:01.647659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:01.648060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:01.648105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:01.648375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:01.648419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:01.648420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:01.648421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:01.648422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:01.648423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:01.648424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:01.648425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:01.648426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:01.648427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:01.648428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:01.648429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.648430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:01.648431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:01.648431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:01.648432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:01.648436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:01.648443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:01.648446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:01.648448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:01.648451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:01.648453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:01.648456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:01.648459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:01.648461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:01.648464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:01.648466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.648469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:01.648471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:01.648473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:01.648476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:01.648481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:01.648486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:01.648491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:01.648495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:01.648498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:01.648501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:01.648504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:01.648508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:01.648511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:01.648514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:01.648518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:01.648521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:01.648524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:01.648527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:01.648530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:01.648533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:01.648536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:01.648539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:01.648541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:01.648544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:01.648549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.648553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.648556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:01.648559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:01.648562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:01.648565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:01.648568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:01.648571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:01.648574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:01.648577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:01.648621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:01.654651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:01.655824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:01.655843Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:01.655847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:01.655851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:01.655858Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2420 [2:7555896396799483775:11068]
2025-09-30T14:57:01.655881Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:01.655899Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:01.655902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:01.655906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:01.655908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:01.655926Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:01.655940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:01.655949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:01.656017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.656027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:01.656029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:01.656033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:01.656035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:01.656109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:01.656118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.656131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:01.656148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:01.656166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:01.656183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896396799483770:11068]
2025-09-30T14:57:01.656186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896396799483770:11068]
2025-09-30T14:57:01.656188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896396799483770:11068]
2025-09-30T14:57:01.656196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:01.656214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:01.656216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:01.656219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:01.656222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:01.656229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:01.656233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:01.656245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896396889268018:2454], now have 1 active actors on pipe
2025-09-30T14:57:01.656248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896396889268161:10397], now have 1 active actors on pipe
2025-09-30T14:57:01.656294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896396799483770:11068]
2025-09-30T14:57:01.656311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:01.656374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2420
2025-09-30T14:57:01.656422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2420
2025-09-30T14:57:01.656441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:01.656609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:01.656615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:01.656641Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3845e809-26487a5c-ca674a31-2649b934_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:01.656650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:01.656655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:01.656657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:01.656668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:01.656681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:01.656702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:01.656902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:01.656914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:01.656929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:01.657043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2421 partition: 0 MaxSeqNo: 42 sessionId: src_id|3845e809-26487a5c-ca674a31-2649b934_0
2025-09-30T14:57:01.657625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b03f264b-73ab4c51-8dd74f97-11c59c84_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3845e809-26487a5c-ca674a31-2649b934_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:01.660684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3845e809-26487a5c-ca674a31-2649b934_0] Write session: try to update token
2025-09-30T14:57:01.660710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3845e809-26487a5c-ca674a31-2649b934_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:01.680898Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:01.680923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:01.680926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:01.680928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:01.680939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896396799483770:11068]
2025-09-30T14:57:01.680943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896396799483770:11068]
2025-09-30T14:57:01.680948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896396799483770:11068]
2025-09-30T14:57:01.680994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:01.681002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.681005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:01.681009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:01.681017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:01.681021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:01.681166Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:01.685916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2421 sessionId: src_id|3845e809-26487a5c-ca674a31-2649b934_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:01.688962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:01.715394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896396889268408:10294]
2025-09-30T14:57:01.715863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2420, pipe: [1:7555896396889268408:10294]
2025-09-30T14:57:01.801126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896396889268408:10294]
2025-09-30T14:57:01.801159Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:01.801208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:01.801211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:01.801658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3845e809-26487a5c-ca674a31-2649b934_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:01.801671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3845e809-26487a5c-ca674a31-2649b934_0] Write session will restart in 0.006091s
2025-09-30T14:57:01.801697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3845e809-26487a5c-ca674a31-2649b934_0] Write session: Do CDS request
2025-09-30T14:57:01.801703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3845e809-26487a5c-ca674a31-2649b934_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:01.801273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2421 reason: error at write: Disconnected sessionId: src_id|3845e809-26487a5c-ca674a31-2649b934_0
2025-09-30T14:57:01.801472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2421 sessionId: src_id|3845e809-26487a5c-ca674a31-2649b934_0 is DEAD
2025-09-30T14:57:01.799735Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:01.800681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:01.800693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:01.800741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896396889268408:10294], now have 1 active actors on pipe
2025-09-30T14:57:01.801043Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:01.808733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3845e809-26487a5c-ca674a31-2649b934_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:01.808816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:01.808832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2422
2025-09-30T14:57:01.811460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2422 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:01.811511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2422 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:01.811517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2422 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:01.811522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:01.812680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2422 sessionId:  describe result for acl check
2025-09-30T14:57:01.812719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:01.812727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:01.812729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:01.812735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896396889268480:10404] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:01.813397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896396889268480:10404] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:01.817164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896396889268480:10404] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:01.829505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896396889268480:10404] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:01.829528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896396889268480:10404] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:01.829532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896396889268480:10404] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:01.829541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2422 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:01.854946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:01.857438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:01.857704Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:01.857710Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:01.857722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:01.857786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:01.857829Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896396799484048:11070]
2025-09-30T14:57:01.858522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:01.859216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:01.859302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:01.859890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:01.859994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:01.859996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:01.859997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:01.859998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:01.860000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:01.860001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:01.860002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:01.860003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:01.860005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:01.860006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:01.860007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.860009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:01.860010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:01.860011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:01.860013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:01.860020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:01.860030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:01.860035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:01.860039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:01.860043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:01.860047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:01.860051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:01.860055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:01.860059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:01.860063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:01.860067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.860071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:01.860074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:01.860078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:01.860081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:01.860092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:01.860103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:01.860110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:01.860116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:01.860123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:01.860129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:01.860134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:01.860140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:01.860146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:01.860152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:01.860157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:01.860163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:01.860169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:01.860175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:01.860182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:01.860187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:01.860193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:01.860199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:01.860204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:01.860211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:01.860217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.860223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.860228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:01.860233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:01.860240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:01.860247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:01.860252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:01.860258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:01.860264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:01.860270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:01.860319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:01.868779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:01.870095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:01.870117Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:01.870120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:01.870124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:01.870132Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2421 [2:7555896396799484048:11070]
2025-09-30T14:57:01.870149Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:01.870167Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:01.870171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:01.870174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:01.870177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:01.870194Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:01.870204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:01.870214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:01.870284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.870293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:01.870295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:01.870300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:01.870303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:01.870380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:01.870383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.870399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:01.870413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:01.870438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:01.870454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896396799484042:11070]
2025-09-30T14:57:01.870457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896396799484042:11070]
2025-09-30T14:57:01.870459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896396799484042:11070]
2025-09-30T14:57:01.870468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:01.870482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:01.870498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:01.870502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:01.870517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:01.870520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:01.870522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:01.870541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896396799484042:11070]
2025-09-30T14:57:01.870545Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:01.870555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896396889268656:10404], now have 1 active actors on pipe
2025-09-30T14:57:01.870560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896396889268410:2454], now have 1 active actors on pipe
2025-09-30T14:57:01.870562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:01.870959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2421
2025-09-30T14:57:01.870996Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2421
2025-09-30T14:57:01.871693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:01.871710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:01.871745Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5bdadac0-217ba308-c1b5c8c5-84bfa448_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:01.871755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:01.871760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:01.871764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:01.871775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:01.871787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:01.871809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:01.872112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:01.872126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:01.872156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:01.872733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3845e809-26487a5c-ca674a31-2649b934_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5bdadac0-217ba308-c1b5c8c5-84bfa448_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:01.872302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2422 partition: 0 MaxSeqNo: 42 sessionId: src_id|5bdadac0-217ba308-c1b5c8c5-84bfa448_0
2025-09-30T14:57:01.875794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bdadac0-217ba308-c1b5c8c5-84bfa448_0] Write session: try to update token
2025-09-30T14:57:01.875813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bdadac0-217ba308-c1b5c8c5-84bfa448_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:01.889070Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:01.889098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:01.889100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:01.889103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:01.889115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896396799484042:11070]
2025-09-30T14:57:01.889121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896396799484042:11070]
2025-09-30T14:57:01.889126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896396799484042:11070]
2025-09-30T14:57:01.889199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:01.889208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:01.889212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:01.889437Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:01.891445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:01.891466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:01.891469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:01.903322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896396889268841:10294]
2025-09-30T14:57:01.903568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2422 sessionId: src_id|5bdadac0-217ba308-c1b5c8c5-84bfa448_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:01.906556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:01.906841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2421, pipe: [1:7555896396889268841:10294]
2025-09-30T14:57:02.017578Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:02.017924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:02.017946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:02.017970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896396889268841:10294], now have 1 active actors on pipe
2025-09-30T14:57:02.018224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896396889268841:10294]
2025-09-30T14:57:02.018248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:02.018253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:02.018260Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:02.018320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2422 reason: error at write: Disconnected sessionId: src_id|5bdadac0-217ba308-c1b5c8c5-84bfa448_0
2025-09-30T14:57:02.018225Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:02.018536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2422 sessionId: src_id|5bdadac0-217ba308-c1b5c8c5-84bfa448_0 is DEAD
2025-09-30T14:57:02.018702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bdadac0-217ba308-c1b5c8c5-84bfa448_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:02.018714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bdadac0-217ba308-c1b5c8c5-84bfa448_0] Write session will restart in 0.005547s
2025-09-30T14:57:02.018748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bdadac0-217ba308-c1b5c8c5-84bfa448_0] Write session: Do CDS request
2025-09-30T14:57:02.018757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bdadac0-217ba308-c1b5c8c5-84bfa448_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:02.025806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bdadac0-217ba308-c1b5c8c5-84bfa448_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:02.025955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:02.025973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2423
2025-09-30T14:57:02.026134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2423 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:02.026185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2423 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:02.026195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2423 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:02.026200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:02.026719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2423 sessionId:  describe result for acl check
2025-09-30T14:57:02.026759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:02.026766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:02.026768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:02.026775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896401184236176:10413] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:02.027364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896401184236176:10413] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:02.029614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896401184236176:10413] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:02.032749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896401184236176:10413] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:02.032764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896401184236176:10413] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:02.032769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896401184236176:10413] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:02.032776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2423 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:02.038864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:02.041381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:02.041620Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:02.041631Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:02.041642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:02.041697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:02.041813Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896401094451641:11086]
2025-09-30T14:57:02.042537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:02.042913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:02.042961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:02.043354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:02.043428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:02.043435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:02.043437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:02.043438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:02.043439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:02.043441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:02.043442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:02.043444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:02.043445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:02.043447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:02.043449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.043450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.043451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.043453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:02.043454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:02.043460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:02.043471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:02.043476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:02.043481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:02.043485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:02.043490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:02.043494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:02.043499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:02.043503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:02.043510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:02.043514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.043518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.043523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.043527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:02.043532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:02.043540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:02.043548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:02.043555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:02.043561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:02.043572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:02.043579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:02.043584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:02.043590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:02.043596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:02.043602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:02.043612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:02.043618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:02.043624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:02.043635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:02.043640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:02.043646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:02.043660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:02.043666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:02.043670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:02.043676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:02.043681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.043688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.043693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.043699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.043703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.043709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.043714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:02.043721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:02.043726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:02.043732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:02.043781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:02.049663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:02.051196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:02.051219Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:02.051222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:02.051227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:02.051234Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2422 [2:7555896401094451641:11086]
2025-09-30T14:57:02.051268Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:02.051285Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:02.051289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:02.051292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:02.051295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:02.051313Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:02.051327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:02.051335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:02.051400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.051408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.051411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.051414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:02.051417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:02.051494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:02.051506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.051521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.051535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.051555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:02.051579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896401184236143:2454], now have 1 active actors on pipe
2025-09-30T14:57:02.051595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896401094451636:11086]
2025-09-30T14:57:02.051598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896401094451636:11086]
2025-09-30T14:57:02.051601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896401094451636:11086]
2025-09-30T14:57:02.051615Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:02.051630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896401184236389:10413], now have 1 active actors on pipe
2025-09-30T14:57:02.051630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:02.051634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:02.051636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:02.051639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:02.051657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:02.051660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:02.051665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2422
2025-09-30T14:57:02.051685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2422
2025-09-30T14:57:02.051697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896401094451636:11086]
2025-09-30T14:57:02.051707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:02.051708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:02.051739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:02.051750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:02.051795Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3df4d2c-d00a399c-42505580-5296009_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:02.051808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:02.051817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:02.051820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:02.051830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:02.051845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:02.051874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:02.052180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:02.052197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:02.052222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:02.052338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2423 partition: 0 MaxSeqNo: 42 sessionId: src_id|f3df4d2c-d00a399c-42505580-5296009_0
2025-09-30T14:57:02.052739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bdadac0-217ba308-c1b5c8c5-84bfa448_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f3df4d2c-d00a399c-42505580-5296009_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:02.055828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3df4d2c-d00a399c-42505580-5296009_0] Write session: try to update token
2025-09-30T14:57:02.055849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3df4d2c-d00a399c-42505580-5296009_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:02.064447Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:02.064473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:02.064475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:02.064478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:02.064492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896401094451636:11086]
2025-09-30T14:57:02.064497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896401094451636:11086]
2025-09-30T14:57:02.064501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896401094451636:11086]
2025-09-30T14:57:02.064545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:02.064551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:02.064557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.064558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:02.064560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:02.064563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:02.064726Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:02.075749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2423 sessionId: src_id|f3df4d2c-d00a399c-42505580-5296009_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:02.078809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:02.118595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896401184236530:10294]
2025-09-30T14:57:02.118881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2422, pipe: [1:7555896401184236530:10294]
2025-09-30T14:57:02.180465Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:02.181053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:02.181070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:02.181089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896401184236530:10294], now have 1 active actors on pipe
2025-09-30T14:57:02.181320Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:02.181341Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:02.181395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896401184236530:10294]
2025-09-30T14:57:02.181418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:02.181510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2423 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f3df4d2c-d00a399c-42505580-5296009_0
2025-09-30T14:57:02.181712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2423 sessionId: src_id|f3df4d2c-d00a399c-42505580-5296009_0 is DEAD
2025-09-30T14:57:02.181878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3df4d2c-d00a399c-42505580-5296009_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:02.181890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3df4d2c-d00a399c-42505580-5296009_0] Write session will restart in 0.005278s
2025-09-30T14:57:02.181927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3df4d2c-d00a399c-42505580-5296009_0] Write session: Do CDS request
2025-09-30T14:57:02.181933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3df4d2c-d00a399c-42505580-5296009_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:02.189663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3df4d2c-d00a399c-42505580-5296009_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:02.189746Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:02.189773Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2424
2025-09-30T14:57:02.189913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2424 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:02.189946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2424 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:02.189956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2424 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:02.189960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:02.190397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2424 sessionId:  describe result for acl check
2025-09-30T14:57:02.190432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:02.190439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:02.190441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:02.190447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896401184236560:10419] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:02.191078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896401184236560:10419] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:02.193956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896401184236560:10419] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:02.199668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896401184236560:10419] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:02.199689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896401184236560:10419] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:02.199694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896401184236560:10419] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:02.199704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2424 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:02.216251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:02.218970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:02.219268Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:02.219283Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:02.219297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:02.219374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:02.219447Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896401094451902:11088]
2025-09-30T14:57:02.220109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:02.221156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:02.221239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:02.221641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:02.221719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:02.221730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:02.221731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:02.221732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:02.221734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:02.221735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:02.221736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:02.221738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:02.221739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:02.221740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:02.221741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.221743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.221744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.221745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:02.221749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:02.221756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:02.221765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:02.221769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:02.221773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:02.221777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:02.221781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:02.221785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:02.221789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:02.221793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:02.221797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:02.221801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.221804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.221809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.221812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:02.221815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:02.221823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:02.221832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:02.221838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:02.221843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:02.221848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:02.221854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:02.221859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:02.221865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:02.221871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:02.221876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:02.221881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:02.221886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:02.221891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:02.221897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:02.221903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:02.221909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:02.221915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:02.221921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:02.221926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:02.221934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:02.221939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.221945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.221950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.221975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.221991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.221998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.222003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:02.222009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:02.222014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:02.222021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:02.222067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:02.229325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:02.230502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:02.230527Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:02.230530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:02.230535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:02.230542Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2423 [2:7555896401094451902:11088]
2025-09-30T14:57:02.230559Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:02.230581Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:02.230589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:02.230592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:02.230596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:02.230613Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:02.230625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:02.230633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:02.230708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.230716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.230719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.230722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:02.230725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:02.230804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:02.230813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.230827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.230839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.231510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2423
2025-09-30T14:57:02.231546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2423
2025-09-30T14:57:02.231743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:02.231780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896401184236598:10419], now have 1 active actors on pipe
2025-09-30T14:57:02.231785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896401184236548:2454], now have 1 active actors on pipe
2025-09-30T14:57:02.231800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:02.231806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:02.231833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896401094451897:11088]
2025-09-30T14:57:02.231836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896401094451897:11088]
2025-09-30T14:57:02.231838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896401094451897:11088]
2025-09-30T14:57:02.231850Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:02.231867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:02.231883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:02.231888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:02.231905Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54e159b2-fe632e3b-a7cb4d7-57e51cb9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:02.231916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:02.231919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:02.231922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:02.231934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:02.231947Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:02.231991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896401094451897:11088]
2025-09-30T14:57:02.231995Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:02.232007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:02.232048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:02.232052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:02.232054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:02.232061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:02.235301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:02.235328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:02.235368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:02.236010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3df4d2c-d00a399c-42505580-5296009_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|54e159b2-fe632e3b-a7cb4d7-57e51cb9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:02.239066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54e159b2-fe632e3b-a7cb4d7-57e51cb9_0] Write session: try to update token
2025-09-30T14:57:02.239089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54e159b2-fe632e3b-a7cb4d7-57e51cb9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:02.235596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2424 partition: 0 MaxSeqNo: 42 sessionId: src_id|54e159b2-fe632e3b-a7cb4d7-57e51cb9_0
2025-09-30T14:57:02.246287Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:02.246326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:02.246329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:02.246330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:02.246338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896401094451897:11088]
2025-09-30T14:57:02.246342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896401094451897:11088]
2025-09-30T14:57:02.246345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896401094451897:11088]
2025-09-30T14:57:02.246383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:02.246383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:02.246389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.246390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:02.246391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:02.246395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:02.246518Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:02.260625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2424 sessionId: src_id|54e159b2-fe632e3b-a7cb4d7-57e51cb9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:02.263648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:02.281914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896401184236944:10294]
2025-09-30T14:57:02.282407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2423, pipe: [1:7555896401184236944:10294]
2025-09-30T14:57:02.363551Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:02.364430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:02.364449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:02.364469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896401184236944:10294], now have 1 active actors on pipe
2025-09-30T14:57:02.364665Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:02.364803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:02.364909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2424 reason: status is not ok: tablet will be restarted right now sessionId: src_id|54e159b2-fe632e3b-a7cb4d7-57e51cb9_0
2025-09-30T14:57:02.364978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:02.365035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896401184236944:10294]
2025-09-30T14:57:02.365104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2424 sessionId: src_id|54e159b2-fe632e3b-a7cb4d7-57e51cb9_0 is DEAD
2025-09-30T14:57:02.365482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54e159b2-fe632e3b-a7cb4d7-57e51cb9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:02.365493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54e159b2-fe632e3b-a7cb4d7-57e51cb9_0] Write session will restart in 0.007710s
2025-09-30T14:57:02.365523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54e159b2-fe632e3b-a7cb4d7-57e51cb9_0] Write session: Do CDS request
2025-09-30T14:57:02.365530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54e159b2-fe632e3b-a7cb4d7-57e51cb9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:02.374825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54e159b2-fe632e3b-a7cb4d7-57e51cb9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:02.374932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:02.374949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2425
2025-09-30T14:57:02.375131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2425 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:02.375166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2425 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:02.375179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2425 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:02.375183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:02.375666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2425 sessionId:  describe result for acl check
2025-09-30T14:57:02.375699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:02.375701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:02.375703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:02.375710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896401184236998:10423] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:02.376299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896401184236998:10423] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:02.379169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896401184236998:10423] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:02.383204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896401184236998:10423] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:02.383222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896401184236998:10423] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:02.383226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896401184236998:10423] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:02.383235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2425 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:02.392904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:02.395478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:02.395783Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:02.395796Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:02.395810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:02.395873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:02.395925Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896401094452164:11090]
2025-09-30T14:57:02.396632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:02.396971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:02.397018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:02.397382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:02.397457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:02.397465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:02.397466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:02.397468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:02.397470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:02.397471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:02.397473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:02.397474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:02.397476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:02.397477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:02.397479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.397480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.397482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.397483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:02.397485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:02.397490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:02.397502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:02.397507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:02.397512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:02.397517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:02.397521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:02.397526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:02.397531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:02.397536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:02.397541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:02.397545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.397550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.397555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.397559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:02.397564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:02.397572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:02.397580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:02.397588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:02.397594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:02.397600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:02.397606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:02.397612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:02.397617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:02.397624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:02.397630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:02.397635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:02.397642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:02.397648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:02.397654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:02.397659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:02.397666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:02.397681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:02.397687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:02.397694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:02.397700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:02.397706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.397712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.397717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.397723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.397728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.397733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.397739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:02.397744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:02.397749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:02.397755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:02.397804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:02.404900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:02.405971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:02.405993Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:02.405997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:02.406001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:02.406008Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2424 [2:7555896401094452164:11090]
2025-09-30T14:57:02.406026Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:02.406045Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:02.406049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:02.406052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:02.406055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:02.406072Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:02.406078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:02.406085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:02.406418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2424
2025-09-30T14:57:02.406455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2424
2025-09-30T14:57:02.406155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.406169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.406172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.406176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:02.406179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:02.406250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:02.406253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.406266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.406277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.406291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:02.406308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896401094452159:11090]
2025-09-30T14:57:02.406311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896401094452159:11090]
2025-09-30T14:57:02.406313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896401094452159:11090]
2025-09-30T14:57:02.406323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:02.406332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:02.406335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:02.406337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896401184236947:2454], now have 1 active actors on pipe
2025-09-30T14:57:02.406338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:02.406344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896401184237180:10423], now have 1 active actors on pipe
2025-09-30T14:57:02.406350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:02.406365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:02.406369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:02.406406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896401094452159:11090]
2025-09-30T14:57:02.406421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:02.406452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:02.406706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:02.406733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:02.406766Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b6a9b69-7d68e4ef-3a15a737-b580401c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:02.406781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:02.406786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:02.406788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:02.406798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:02.406810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:02.406827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:02.407016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:02.407028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:02.407045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:02.407221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2425 partition: 0 MaxSeqNo: 42 sessionId: src_id|3b6a9b69-7d68e4ef-3a15a737-b580401c_0
2025-09-30T14:57:02.407702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54e159b2-fe632e3b-a7cb4d7-57e51cb9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3b6a9b69-7d68e4ef-3a15a737-b580401c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:02.410716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b6a9b69-7d68e4ef-3a15a737-b580401c_0] Write session: try to update token
2025-09-30T14:57:02.410735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b6a9b69-7d68e4ef-3a15a737-b580401c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:02.419467Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:02.419492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:02.419496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:02.419498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:02.419507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896401094452159:11090]
2025-09-30T14:57:02.419513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896401094452159:11090]
2025-09-30T14:57:02.419517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896401094452159:11090]
2025-09-30T14:57:02.419561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:02.419568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.419570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:02.419584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:02.419593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:02.419598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:02.419792Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:02.435146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2425 sessionId: src_id|3b6a9b69-7d68e4ef-3a15a737-b580401c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:02.438066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:02.465260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896401184237338:10294]
2025-09-30T14:57:02.465674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2424, pipe: [1:7555896401184237338:10294]
2025-09-30T14:57:02.537054Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:02.537847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:02.537862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:02.537883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896401184237338:10294], now have 1 active actors on pipe
2025-09-30T14:57:02.538101Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:02.539065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:02.539079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896401184237338:10294]
2025-09-30T14:57:02.539108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:02.539224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2425 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3b6a9b69-7d68e4ef-3a15a737-b580401c_0
2025-09-30T14:57:02.539413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2425 sessionId: src_id|3b6a9b69-7d68e4ef-3a15a737-b580401c_0 is DEAD
2025-09-30T14:57:02.539586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b6a9b69-7d68e4ef-3a15a737-b580401c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:02.539598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b6a9b69-7d68e4ef-3a15a737-b580401c_0] Write session will restart in 0.006484s
2025-09-30T14:57:02.539622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b6a9b69-7d68e4ef-3a15a737-b580401c_0] Write session: Do CDS request
2025-09-30T14:57:02.539628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b6a9b69-7d68e4ef-3a15a737-b580401c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:02.548151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b6a9b69-7d68e4ef-3a15a737-b580401c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:02.548306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:02.548328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2426
2025-09-30T14:57:02.548508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2426 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:02.548570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2426 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:02.548578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2426 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:02.548583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:02.549120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2426 sessionId:  describe result for acl check
2025-09-30T14:57:02.549170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:02.549195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:02.549198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:02.549224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896401184237356:10427] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:02.549956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896401184237356:10427] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:02.552478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896401184237356:10427] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:02.555382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896401184237356:10427] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:02.555400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896401184237356:10427] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:02.555404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896401184237356:10427] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:02.555414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2426 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:02.573731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:02.576334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:02.576696Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:02.576706Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:02.576719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:02.576800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:02.576844Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896401094452429:11093]
2025-09-30T14:57:02.577548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:02.577912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:02.577978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:02.578343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:02.578427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:02.578436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:02.578438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:02.578439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:02.578440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:02.578441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:02.578443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:02.578445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:02.578446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:02.578447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:02.578448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.578450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.578451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.578452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:02.578453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:02.578460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:02.578471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:02.578475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:02.578479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:02.578482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:02.578486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:02.578489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:02.578493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:02.578497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:02.578501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:02.578505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.578508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.578512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.578516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:02.578519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:02.578528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:02.578537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:02.578543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:02.578548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:02.578553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:02.578558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:02.578563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:02.578568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:02.578572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:02.578577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:02.578585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:02.578589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:02.578595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:02.578600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:02.578604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:02.578611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:02.578617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:02.578621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:02.578626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:02.578631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:02.578636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.578641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.578645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.578650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.578660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.578665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.578670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:02.578675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:02.578679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:02.578684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:02.578724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:02.584632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:02.586260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:02.586274Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:02.586276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:02.586281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:02.586287Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2425 [2:7555896401094452429:11093]
2025-09-30T14:57:02.586307Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:02.586322Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:02.586330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:02.586334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:02.586336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:02.586353Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:02.586361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:02.586368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:02.586432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.586439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.586441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.586444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:02.586447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:02.586528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:02.586537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.586552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.586564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.586582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:02.586601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896401184237426:10427], now have 1 active actors on pipe
2025-09-30T14:57:02.586605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896401184237340:2454], now have 1 active actors on pipe
2025-09-30T14:57:02.586610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896401094452424:11093]
2025-09-30T14:57:02.586612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896401094452424:11093]
2025-09-30T14:57:02.586614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896401094452424:11093]
2025-09-30T14:57:02.586628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:02.586643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:02.586659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:02.586661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:02.586664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:02.586669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:02.586672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:02.586700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896401094452424:11093]
2025-09-30T14:57:02.586713Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:02.586722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2425
2025-09-30T14:57:02.586763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2425
2025-09-30T14:57:02.586852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:02.586864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:02.586867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:02.586896Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e2f77a9-1cbd3da2-2669d086-c4e95932_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:02.586910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:02.586915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:02.586917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:02.586927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:02.586943Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:02.586965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:02.587136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:02.587144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:02.587160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:02.587296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2426 partition: 0 MaxSeqNo: 42 sessionId: src_id|2e2f77a9-1cbd3da2-2669d086-c4e95932_0
2025-09-30T14:57:02.587676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b6a9b69-7d68e4ef-3a15a737-b580401c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2e2f77a9-1cbd3da2-2669d086-c4e95932_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:02.590752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e2f77a9-1cbd3da2-2669d086-c4e95932_0] Write session: try to update token
2025-09-30T14:57:02.590771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e2f77a9-1cbd3da2-2669d086-c4e95932_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:02.599376Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:02.599394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:02.599397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:02.599399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:02.599409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896401094452424:11093]
2025-09-30T14:57:02.599413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896401094452424:11093]
2025-09-30T14:57:02.599422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896401094452424:11093]
2025-09-30T14:57:02.599465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:02.599472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.599474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:02.599476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:02.599482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:02.599486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:02.599637Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:02.612010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2426 sessionId: src_id|2e2f77a9-1cbd3da2-2669d086-c4e95932_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:02.615039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:02.639321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896401184237733:10294]
2025-09-30T14:57:02.639721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2425, pipe: [1:7555896401184237733:10294]
2025-09-30T14:57:02.715860Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:02.716228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:02.716246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:02.716268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896401184237733:10294], now have 1 active actors on pipe
2025-09-30T14:57:02.716552Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:02.716522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:02.717034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e2f77a9-1cbd3da2-2669d086-c4e95932_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:02.716539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:02.717046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e2f77a9-1cbd3da2-2669d086-c4e95932_0] Write session will restart in 0.008232s
2025-09-30T14:57:02.716557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896401184237733:10294]
2025-09-30T14:57:02.716590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:02.716627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2426 reason: error at write: Disconnected sessionId: src_id|2e2f77a9-1cbd3da2-2669d086-c4e95932_0
2025-09-30T14:57:02.716813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2426 sessionId: src_id|2e2f77a9-1cbd3da2-2669d086-c4e95932_0 is DEAD
2025-09-30T14:57:02.717072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e2f77a9-1cbd3da2-2669d086-c4e95932_0] Write session: Do CDS request
2025-09-30T14:57:02.717078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e2f77a9-1cbd3da2-2669d086-c4e95932_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:02.726832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e2f77a9-1cbd3da2-2669d086-c4e95932_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:02.726938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:02.726958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2427
2025-09-30T14:57:02.727107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2427 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:02.727145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2427 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:02.727156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2427 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:02.727160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:02.727709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2427 sessionId:  describe result for acl check
2025-09-30T14:57:02.727750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:02.727757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:02.727759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:02.727766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896401184237829:10432] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:02.728362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896401184237829:10432] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:02.730530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896401184237829:10432] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:02.732641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896401184237829:10432] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:02.732656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896401184237829:10432] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:02.732658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896401184237829:10432] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:02.732665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2427 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:02.742491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:02.744858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:02.745082Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:02.745094Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:02.745105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:02.745165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:02.745222Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896401094452693:11095]
2025-09-30T14:57:02.745932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:02.746224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:02.746273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:02.746610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:02.746685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:02.746691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:02.746692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:02.746694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:02.746695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:02.746697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:02.746699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:02.746700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:02.746702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:02.746703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:02.746704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.746705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.746706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.746707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:02.746709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:02.746714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:02.746726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:02.746731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:02.746735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:02.746740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:02.746743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:02.746748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:02.746752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:02.746756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:02.746761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:02.746765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.746770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.746774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.746777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:02.746781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:02.746790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:02.746799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:02.746806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:02.746817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:02.746830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:02.746841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:02.746851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:02.746862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:02.746868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:02.746875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:02.746880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:02.746886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:02.746892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:02.746899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:02.746904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:02.746909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:02.746915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:02.746923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:02.746931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:02.746936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:02.746944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.746949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.746953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.746958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.746962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.746967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.746973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:02.746978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:02.746983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:02.746994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:02.747040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:02.752586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:02.753839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:02.753854Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:02.753856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:02.753859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:02.753864Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2426 [2:7555896401094452693:11095]
2025-09-30T14:57:02.753876Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:02.753891Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:02.753893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:02.753895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:02.753897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:02.753912Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:02.753921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:02.753927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:02.753984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.753992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.753995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.753999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:02.754003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:02.754074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:02.754084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.754096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.754103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.754112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:02.754132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896401184237737:2454], now have 1 active actors on pipe
2025-09-30T14:57:02.754138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896401094452688:11095]
2025-09-30T14:57:02.754140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896401094452688:11095]
2025-09-30T14:57:02.754141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896401094452688:11095]
2025-09-30T14:57:02.754154Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:02.754166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896401184237926:10432], now have 1 active actors on pipe
2025-09-30T14:57:02.754176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:02.754187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:02.754194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:02.754197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:02.754202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:02.754204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:02.754226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896401094452688:11095]
2025-09-30T14:57:02.754233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:02.754242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:02.754258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2426
2025-09-30T14:57:02.754259Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2426
2025-09-30T14:57:02.754378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:02.754388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:02.754417Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43618371-ff40f33d-f8699e1e-7de4d148_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:02.754430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:02.754433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:02.754435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:02.754443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:02.754452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:02.754464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:02.754617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:02.754628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:02.754641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:02.754743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2427 partition: 0 MaxSeqNo: 42 sessionId: src_id|43618371-ff40f33d-f8699e1e-7de4d148_0
2025-09-30T14:57:02.755168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e2f77a9-1cbd3da2-2669d086-c4e95932_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|43618371-ff40f33d-f8699e1e-7de4d148_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:02.758108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43618371-ff40f33d-f8699e1e-7de4d148_0] Write session: try to update token
2025-09-30T14:57:02.758128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43618371-ff40f33d-f8699e1e-7de4d148_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:02.770516Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:02.770535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:02.770538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:02.770540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:02.770550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896401094452688:11095]
2025-09-30T14:57:02.770555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896401094452688:11095]
2025-09-30T14:57:02.770560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896401094452688:11095]
2025-09-30T14:57:02.770600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:02.770608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.770612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:02.770616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:02.770616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:02.770627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:02.770762Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:02.774808Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2427 sessionId: src_id|43618371-ff40f33d-f8699e1e-7de4d148_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:02.777817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:02.816981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896401184238131:10294]
2025-09-30T14:57:02.817342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2426, pipe: [1:7555896401184238131:10294]
2025-09-30T14:57:02.894162Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:02.894630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:02.894643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:02.894685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896401184238131:10294], now have 1 active actors on pipe
2025-09-30T14:57:02.894919Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:02.895322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:02.895375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:02.895445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2427 reason: status is not ok: tablet will be restarted right now sessionId: src_id|43618371-ff40f33d-f8699e1e-7de4d148_0
2025-09-30T14:57:02.895660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2427 sessionId: src_id|43618371-ff40f33d-f8699e1e-7de4d148_0 is DEAD
2025-09-30T14:57:02.895786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43618371-ff40f33d-f8699e1e-7de4d148_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:02.895796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43618371-ff40f33d-f8699e1e-7de4d148_0] Write session will restart in 0.006633s
2025-09-30T14:57:02.895821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43618371-ff40f33d-f8699e1e-7de4d148_0] Write session: Do CDS request
2025-09-30T14:57:02.895826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43618371-ff40f33d-f8699e1e-7de4d148_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:02.895897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896401184238131:10294]
2025-09-30T14:57:02.904960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43618371-ff40f33d-f8699e1e-7de4d148_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:02.905556Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:02.905572Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2428
2025-09-30T14:57:02.905732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2428 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:02.905778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2428 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:02.905787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2428 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:02.905792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:02.906211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2428 sessionId:  describe result for acl check
2025-09-30T14:57:02.906245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:02.906248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:02.906249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:02.906255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896401184238221:10442] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:02.906838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896401184238221:10442] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:02.909823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896401184238221:10442] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:02.914163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896401184238221:10442] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:02.914184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896401184238221:10442] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:02.914187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896401184238221:10442] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:02.914194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2428 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:02.924409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:02.927048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:02.927482Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:02.927496Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:02.927511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:02.927583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:02.927627Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896401094452980:11097]
2025-09-30T14:57:02.928313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:02.928744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:02.928802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:02.929159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:02.929249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:02.929255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:02.929257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:02.929259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:02.929260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:02.929261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:02.929263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:02.929264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:02.929266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:02.929267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:02.929269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.929270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.929271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.929273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:02.929274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:02.929280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:02.929292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:02.929297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:02.929302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:02.929307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:02.929312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:02.929316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:02.929321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:02.929326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:02.929331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:02.929335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.929340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.929345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.929349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:02.929354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:02.929364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:02.929379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:02.929391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:02.929398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:02.929407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:02.929413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:02.929418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:02.929424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:02.929428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:02.929434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:02.929440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:02.929455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:02.929465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:02.929471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:02.929481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:02.929487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:02.929497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:02.929502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:02.929512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:02.929517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:02.929523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.929528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.929533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.929539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.929543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.929554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.929559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:02.929569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:02.929575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:02.929585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:02.929633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:02.935487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:02.936767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:02.936788Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:02.936791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:02.936795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:02.936802Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2427 [2:7555896401094452980:11097]
2025-09-30T14:57:02.936819Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:02.936837Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:02.936842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:02.936845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:02.936848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:02.936864Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:02.936876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:02.936889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:02.936972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.936979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.936981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.936985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:02.936987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:02.937060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:02.937067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.937083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:02.937101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:02.937121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:02.937142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896401094452974:11097]
2025-09-30T14:57:02.937151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896401094452974:11097]
2025-09-30T14:57:02.937153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896401094452974:11097]
2025-09-30T14:57:02.937161Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:02.937190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:02.937193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:02.937200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:02.937202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:02.937209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:02.937212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:02.937224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896401184238146:2454], now have 1 active actors on pipe
2025-09-30T14:57:02.937228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896401184238384:10442], now have 1 active actors on pipe
2025-09-30T14:57:02.937266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896401094452974:11097]
2025-09-30T14:57:02.937279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:02.937298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:02.937688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:02.937703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:02.937736Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31376479-7a253947-7f25d577-1e9036ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:02.937759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:02.937768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:02.937773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:02.937783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:02.937800Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:02.937821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:02.938223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:02.938234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:02.938259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:02.937348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2427
2025-09-30T14:57:02.937358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2427
2025-09-30T14:57:02.938394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2428 partition: 0 MaxSeqNo: 42 sessionId: src_id|31376479-7a253947-7f25d577-1e9036ba_0
2025-09-30T14:57:02.939559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43618371-ff40f33d-f8699e1e-7de4d148_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|31376479-7a253947-7f25d577-1e9036ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:02.942591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31376479-7a253947-7f25d577-1e9036ba_0] Write session: try to update token
2025-09-30T14:57:02.942610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31376479-7a253947-7f25d577-1e9036ba_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:02.950357Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:02.950380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:02.950383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:02.950385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:02.950395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896401094452974:11097]
2025-09-30T14:57:02.950400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896401094452974:11097]
2025-09-30T14:57:02.950404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896401094452974:11097]
2025-09-30T14:57:02.950450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:02.950459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:02.950462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:02.950620Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:02.950970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:02.950975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:02.950979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:02.963679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2428 sessionId: src_id|31376479-7a253947-7f25d577-1e9036ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:02.966904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:02.996182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896401184238550:10294]
2025-09-30T14:57:02.996546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2427, pipe: [1:7555896401184238550:10294]
2025-09-30T14:57:03.089284Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:03.089637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:03.089669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:03.089717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896401184238550:10294], now have 1 active actors on pipe
2025-09-30T14:57:03.089982Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:03.090024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896401184238550:10294]
2025-09-30T14:57:03.090061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:03.090061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:03.090144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2428 reason: status is not ok: tablet will be restarted right now sessionId: src_id|31376479-7a253947-7f25d577-1e9036ba_0
2025-09-30T14:57:03.090342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2428 sessionId: src_id|31376479-7a253947-7f25d577-1e9036ba_0 is DEAD
2025-09-30T14:57:03.090524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31376479-7a253947-7f25d577-1e9036ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:03.090533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31376479-7a253947-7f25d577-1e9036ba_0] Write session will restart in 0.006155s
2025-09-30T14:57:03.090558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31376479-7a253947-7f25d577-1e9036ba_0] Write session: Do CDS request
2025-09-30T14:57:03.090564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31376479-7a253947-7f25d577-1e9036ba_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:03.097783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31376479-7a253947-7f25d577-1e9036ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:03.098180Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:03.098198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2429
2025-09-30T14:57:03.098305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2429 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:03.098348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2429 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:03.098354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2429 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:03.098359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:03.098795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2429 sessionId:  describe result for acl check
2025-09-30T14:57:03.098822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:03.098824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:03.098826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:03.098841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896405479205864:10447] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:03.099423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896405479205864:10447] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:03.102008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896405479205864:10447] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:03.105529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896405479205864:10447] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:03.105547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896405479205864:10447] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:03.105552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896405479205864:10447] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:03.105560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2429 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:03.128697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:03.132368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:03.132938Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:03.132970Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:03.132988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:03.133073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:03.133127Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896405389420573:11113]
2025-09-30T14:57:03.133822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:03.134199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:03.134261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:03.134623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:03.134708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:03.134718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:03.134719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:03.134720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:03.134722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:03.134724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:03.134725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:03.134727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:03.134728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:03.134730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:03.134731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.134732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:03.134734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:03.134735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:03.134737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:03.134743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:03.134755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:03.134759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:03.134764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:03.134768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:03.134773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:03.134778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:03.134782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:03.134786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:03.134794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:03.134797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.134801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:03.134806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:03.134810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:03.134814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:03.134822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:03.134831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:03.134838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:03.134846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:03.134851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:03.134856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:03.134861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:03.134866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:03.134871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:03.134877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:03.134882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:03.134887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:03.134892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:03.134898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:03.134902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:03.134908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:03.134916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:03.134921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:03.134927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:03.134932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:03.134939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.134945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.134951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:03.134957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:03.134962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:03.134968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:03.134974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:03.134979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:03.134984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:03.134989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:03.135034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:03.141046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:03.142303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:03.142324Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:03.142326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:03.142331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:03.142339Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2428 [2:7555896405389420573:11113]
2025-09-30T14:57:03.142358Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:03.142377Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:03.142381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:03.142384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:03.142387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:03.142405Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:03.142422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:03.142429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:03.142516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.142525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:03.142526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:03.142530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:03.142533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:03.142769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:03.142782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.142797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:03.142821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:03.142842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:03.142822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2428
2025-09-30T14:57:03.142866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896405479206002:10447], now have 1 active actors on pipe
2025-09-30T14:57:03.142832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2428
2025-09-30T14:57:03.142876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896405479205849:2454], now have 1 active actors on pipe
2025-09-30T14:57:03.142884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896405389420567:11113]
2025-09-30T14:57:03.142887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896405389420567:11113]
2025-09-30T14:57:03.142889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896405389420567:11113]
2025-09-30T14:57:03.142906Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:03.142926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:03.142947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:03.142952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:03.142955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:03.142956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:03.142959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:03.142999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896405389420567:11113]
2025-09-30T14:57:03.143009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:03.143014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:03.143039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:03.143051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:03.143093Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e0e4060-a9393380-1f6b156-ecc6eefe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:03.143105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:03.143109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:03.143113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:03.143124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:03.143135Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:03.143166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:03.143478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:03.143488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:03.143507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:03.143609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2429 partition: 0 MaxSeqNo: 42 sessionId: src_id|2e0e4060-a9393380-1f6b156-ecc6eefe_0
2025-09-30T14:57:03.148653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31376479-7a253947-7f25d577-1e9036ba_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2e0e4060-a9393380-1f6b156-ecc6eefe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:03.151757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e0e4060-a9393380-1f6b156-ecc6eefe_0] Write session: try to update token
2025-09-30T14:57:03.151780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e0e4060-a9393380-1f6b156-ecc6eefe_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:03.159154Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:03.159173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:03.159176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:03.159179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:03.159189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896405389420567:11113]
2025-09-30T14:57:03.159194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896405389420567:11113]
2025-09-30T14:57:03.159198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896405389420567:11113]
2025-09-30T14:57:03.159279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:03.159281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:03.159293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:03.159294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.159297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:03.159297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:03.159453Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:03.170180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2429 sessionId: src_id|2e0e4060-a9393380-1f6b156-ecc6eefe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:03.173275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:03.190211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896405479206263:10294]
2025-09-30T14:57:03.190485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2428, pipe: [1:7555896405479206263:10294]
2025-09-30T14:57:03.276696Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:03.277081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:03.277101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:03.277124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896405479206263:10294], now have 1 active actors on pipe
2025-09-30T14:57:03.277422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896405479206263:10294]
2025-09-30T14:57:03.277457Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:03.278147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e0e4060-a9393380-1f6b156-ecc6eefe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:03.278155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e0e4060-a9393380-1f6b156-ecc6eefe_0] Write session will restart in 0.006168s
2025-09-30T14:57:03.278182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e0e4060-a9393380-1f6b156-ecc6eefe_0] Write session: Do CDS request
2025-09-30T14:57:03.278188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e0e4060-a9393380-1f6b156-ecc6eefe_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:03.277467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:03.277470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:03.277529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:03.277535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2429 reason: error at write: Disconnected sessionId: src_id|2e0e4060-a9393380-1f6b156-ecc6eefe_0
2025-09-30T14:57:03.277735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2429 sessionId: src_id|2e0e4060-a9393380-1f6b156-ecc6eefe_0 is DEAD
2025-09-30T14:57:03.285928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e0e4060-a9393380-1f6b156-ecc6eefe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:03.287924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:03.287942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2430
2025-09-30T14:57:03.288131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2430 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:03.288165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2430 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:03.288171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2430 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:03.288175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:03.288730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2430 sessionId:  describe result for acl check
2025-09-30T14:57:03.288769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:03.288771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:03.288772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:03.288779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896405479206304:10455] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:03.289341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896405479206304:10455] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:03.291731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896405479206304:10455] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:03.294893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896405479206304:10455] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:03.294917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896405479206304:10455] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:03.294921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896405479206304:10455] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:03.294930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2430 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:03.311857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:03.315061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:03.315314Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:03.315326Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:03.315338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:03.315387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:03.315431Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896405389420841:11115]
2025-09-30T14:57:03.316120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:03.316567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:03.316612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:03.316974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:03.317038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:03.317044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:03.317046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:03.317047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:03.317048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:03.317049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:03.317051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:03.317052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:03.317053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:03.317055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:03.317056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.317058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:03.317059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:03.317060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:03.317061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:03.317067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:03.317076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:03.317080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:03.317084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:03.317088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:03.317091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:03.317096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:03.317099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:03.317102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:03.317109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:03.317112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.317116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:03.317119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:03.317123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:03.317126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:03.317134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:03.317141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:03.317147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:03.317152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:03.317157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:03.317161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:03.317165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:03.317182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:03.317188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:03.317193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:03.317197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:03.317202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:03.317207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:03.317213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:03.317217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:03.317221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:03.317226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:03.317231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:03.317235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:03.317240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:03.317245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.317249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.317254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:03.317259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:03.317263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:03.317267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:03.317271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:03.317276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:03.317280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:03.317285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:03.317327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:03.323549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:03.324863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:03.324882Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:03.324885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:03.324890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:03.324897Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2429 [2:7555896405389420841:11115]
2025-09-30T14:57:03.324914Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:03.324934Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:03.324937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:03.324940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:03.324943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:03.324961Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:03.324968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:03.324976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:03.325064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.325066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:03.325069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:03.325073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:03.325075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:03.325151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:03.325153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.325166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:03.325193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:03.325209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:03.325227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896405389420836:11115]
2025-09-30T14:57:03.325229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896405389420836:11115]
2025-09-30T14:57:03.325231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896405389420836:11115]
2025-09-30T14:57:03.325241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:03.325254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:03.325258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896405479206412:10455], now have 1 active actors on pipe
2025-09-30T14:57:03.325265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:03.325266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:03.325268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:03.325278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:03.325281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:03.325288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896405479206268:2454], now have 1 active actors on pipe
2025-09-30T14:57:03.325325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896405389420836:11115]
2025-09-30T14:57:03.325339Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:03.325348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:03.325478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2429
2025-09-30T14:57:03.325515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2429
2025-09-30T14:57:03.325601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:03.325613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:03.325643Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|141c1797-76813de7-39901506-da0731af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:03.325657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:03.325661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:03.325663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:03.325673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:03.325684Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:03.325701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:03.325846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:03.325854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:03.325867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:03.325948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2430 partition: 0 MaxSeqNo: 42 sessionId: src_id|141c1797-76813de7-39901506-da0731af_0
2025-09-30T14:57:03.326320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e0e4060-a9393380-1f6b156-ecc6eefe_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|141c1797-76813de7-39901506-da0731af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:03.329585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|141c1797-76813de7-39901506-da0731af_0] Write session: try to update token
2025-09-30T14:57:03.329610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|141c1797-76813de7-39901506-da0731af_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:03.346251Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:03.346271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:03.346283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896405389420836:11115]
2025-09-30T14:57:03.346340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:03.346356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:03.346540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:03.346711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:03.346879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:03.347049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:03.347300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:03.347352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:03.350271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2430 sessionId: src_id|141c1797-76813de7-39901506-da0731af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:03.352946Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:03.352967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:03.352970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:03.352972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:03.352986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896405389420836:11115]
2025-09-30T14:57:03.352990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896405389420836:11115]
2025-09-30T14:57:03.352995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896405389420836:11115]
2025-09-30T14:57:03.353041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:03.353049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.353053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:03.353074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:03.353083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:03.353086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:03.353234Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:03.353623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:03.377660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896405479206668:10294]
2025-09-30T14:57:03.379529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2429, pipe: [1:7555896405479206668:10294]
2025-09-30T14:57:03.471372Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:03.472263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:03.472284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:03.472312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896405479206668:10294], now have 1 active actors on pipe
2025-09-30T14:57:03.472558Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:03.473151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896405479206668:10294]
2025-09-30T14:57:03.473203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:03.473267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2430 reason: status is not ok: tablet will be restarted right now sessionId: src_id|141c1797-76813de7-39901506-da0731af_0
2025-09-30T14:57:03.473448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2430 sessionId: src_id|141c1797-76813de7-39901506-da0731af_0 is DEAD
2025-09-30T14:57:03.473584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|141c1797-76813de7-39901506-da0731af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:03.473592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|141c1797-76813de7-39901506-da0731af_0] Write session will restart in 0.006235s
2025-09-30T14:57:03.473616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|141c1797-76813de7-39901506-da0731af_0] Write session: Do CDS request
2025-09-30T14:57:03.473622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|141c1797-76813de7-39901506-da0731af_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:03.473606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:03.480833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|141c1797-76813de7-39901506-da0731af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:03.480908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:03.480928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2431
2025-09-30T14:57:03.481135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2431 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:03.481188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2431 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:03.481208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2431 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:03.481213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:03.481658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2431 sessionId:  describe result for acl check
2025-09-30T14:57:03.481703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:03.481711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:03.481712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:03.481718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896405479206679:10459] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:03.482337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896405479206679:10459] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:03.484382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896405479206679:10459] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:03.487726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896405479206679:10459] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:03.487745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896405479206679:10459] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:03.487749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896405479206679:10459] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:03.487758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2431 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:03.517513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:03.521989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:03.522292Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:03.522304Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:03.522318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:03.522394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:03.522454Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896405389421112:11117]
2025-09-30T14:57:03.523172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:03.523649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:03.523713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:03.524105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:03.524182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:03.524190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:03.524191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:03.524193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:03.524195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:03.524197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:03.524198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:03.524201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:03.524202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:03.524204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:03.524206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.524207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:03.524209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:03.524210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:03.524212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:03.524219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:03.524232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:03.524237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:03.524242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:03.524247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:03.524252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:03.524257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:03.524261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:03.524266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:03.524271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:03.524275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.524280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:03.524285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:03.524289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:03.524294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:03.524303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:03.524313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:03.524331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:03.524337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:03.524343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:03.524350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:03.524355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:03.524388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:03.524395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:03.524402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:03.524409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:03.524416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:03.524430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:03.524436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:03.524442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:03.524448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:03.524453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:03.524459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:03.524472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:03.524478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:03.524483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.524495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.524500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:03.524506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:03.524513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:03.524518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:03.524523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:03.524529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:03.524533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:03.524538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:03.524584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:03.531298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:03.532296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:03.532316Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:03.532320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:03.532325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:03.532333Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2430 [2:7555896405389421112:11117]
2025-09-30T14:57:03.532352Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:03.532372Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:03.532383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:03.532387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:03.532390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:03.532408Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:03.532421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:03.532429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:03.532512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.532521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:03.532524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:03.532528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:03.532531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:03.532717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:03.532728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.532745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:03.532762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:03.532786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:03.532810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896405389421106:11117]
2025-09-30T14:57:03.532818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896405389421106:11117]
2025-09-30T14:57:03.532821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896405389421106:11117]
2025-09-30T14:57:03.533426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2430
2025-09-30T14:57:03.533476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2430
2025-09-30T14:57:03.532840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:03.532861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:03.532878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:03.532882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:03.532909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:03.532913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:03.532915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:03.532933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896405389421106:11117]
2025-09-30T14:57:03.532936Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:03.533022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:03.533182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896405479206670:2454], now have 1 active actors on pipe
2025-09-30T14:57:03.533187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896405479206720:10459], now have 1 active actors on pipe
2025-09-30T14:57:03.533632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:03.533637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:03.533668Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5889ca7e-3549493f-ff4476ed-c5f27e18_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:03.533678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:03.533683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:03.533686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:03.533701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:03.533715Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:03.533731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:03.534146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:03.534159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:03.534189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:03.534332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2431 partition: 0 MaxSeqNo: 42 sessionId: src_id|5889ca7e-3549493f-ff4476ed-c5f27e18_0
2025-09-30T14:57:03.538497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|141c1797-76813de7-39901506-da0731af_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5889ca7e-3549493f-ff4476ed-c5f27e18_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:03.541652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5889ca7e-3549493f-ff4476ed-c5f27e18_0] Write session: try to update token
2025-09-30T14:57:03.541681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5889ca7e-3549493f-ff4476ed-c5f27e18_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:03.547103Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:03.547124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:03.547126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:03.547128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:03.547138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896405389421106:11117]
2025-09-30T14:57:03.547143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896405389421106:11117]
2025-09-30T14:57:03.547148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896405389421106:11117]
2025-09-30T14:57:03.547193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:03.547199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:03.547202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.547205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:03.547206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:03.547211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:03.547387Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:03.564735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2431 sessionId: src_id|5889ca7e-3549493f-ff4476ed-c5f27e18_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:03.569272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:03.570116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896405479207068:10294]
2025-09-30T14:57:03.570439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2430, pipe: [1:7555896405479207068:10294]
2025-09-30T14:57:03.669603Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:03.670320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:03.670340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:03.670377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896405479207068:10294], now have 1 active actors on pipe
2025-09-30T14:57:03.670646Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:03.670649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896405479207068:10294]
2025-09-30T14:57:03.670701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:03.670705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:03.670786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2431 reason: error at write: Disconnected sessionId: src_id|5889ca7e-3549493f-ff4476ed-c5f27e18_0
2025-09-30T14:57:03.670811Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:03.670977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2431 sessionId: src_id|5889ca7e-3549493f-ff4476ed-c5f27e18_0 is DEAD
2025-09-30T14:57:03.671155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5889ca7e-3549493f-ff4476ed-c5f27e18_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:03.671168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5889ca7e-3549493f-ff4476ed-c5f27e18_0] Write session will restart in 0.007457s
2025-09-30T14:57:03.671194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5889ca7e-3549493f-ff4476ed-c5f27e18_0] Write session: Do CDS request
2025-09-30T14:57:03.671203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5889ca7e-3549493f-ff4476ed-c5f27e18_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:03.679741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5889ca7e-3549493f-ff4476ed-c5f27e18_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:03.679886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:03.679906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2432
2025-09-30T14:57:03.680097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2432 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:03.680159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2432 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:03.680165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2432 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:03.680171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:03.680752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2432 sessionId:  describe result for acl check
2025-09-30T14:57:03.680796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:03.680799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:03.680812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:03.680818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896405479207077:10463] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:03.681466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896405479207077:10463] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:03.684020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896405479207077:10463] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:03.688136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896405479207077:10463] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:03.688155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896405479207077:10463] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:03.688159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896405479207077:10463] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:03.688168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2432 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:03.711768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:03.714825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:03.715080Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:03.715095Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:03.715107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:03.715169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:03.715211Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896405389421382:11120]
2025-09-30T14:57:03.715939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:03.716426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:03.716480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:03.716838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:03.716907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:03.716908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:03.716910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:03.716911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:03.716913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:03.716915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:03.716917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:03.716919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:03.716921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:03.716923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:03.716925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.716926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:03.716928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:03.716930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:03.716931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:03.716937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:03.716949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:03.716954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:03.716959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:03.716964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:03.716969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:03.716973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:03.716978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:03.716983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:03.716988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:03.716992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.716997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:03.717002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:03.717007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:03.717012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:03.717023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:03.717039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:03.717045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:03.717052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:03.717057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:03.717071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:03.717077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:03.717083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:03.717089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:03.717096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:03.717101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:03.717109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:03.717114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:03.717120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:03.717131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:03.717141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:03.717152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:03.717164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:03.717187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:03.717193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:03.717198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.717205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.717214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:03.717219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:03.717228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:03.717234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:03.717240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:03.717246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:03.717251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:03.717263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:03.717318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:03.724209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:03.726023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2431
2025-09-30T14:57:03.726065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2431
2025-09-30T14:57:03.725583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:03.725606Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:03.725610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:03.725615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:03.725622Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2431 [2:7555896405389421382:11120]
2025-09-30T14:57:03.725641Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:03.725660Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:03.725663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:03.725667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:03.725670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:03.725687Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:03.725695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:03.725703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:03.725778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.725781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:03.725783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:03.725786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:03.725789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:03.725865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:03.725869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.725884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:03.725896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:03.725915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:03.725935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896405479207121:10463], now have 1 active actors on pipe
2025-09-30T14:57:03.725939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896405479207070:2454], now have 1 active actors on pipe
2025-09-30T14:57:03.725946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896405389421377:11120]
2025-09-30T14:57:03.725949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896405389421377:11120]
2025-09-30T14:57:03.725952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896405389421377:11120]
2025-09-30T14:57:03.725964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:03.725975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:03.725979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:03.725979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:03.725982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:03.725995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:03.725998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:03.726041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896405389421377:11120]
2025-09-30T14:57:03.726050Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:03.726106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:03.726356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:03.726364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:03.726401Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d10546d-bdb6fc9a-cc78fa55-dae29925_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:03.726414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:03.726423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:03.726426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:03.726440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:03.726454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:03.726478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:03.726954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:03.726965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:03.726992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:03.727121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2432 partition: 0 MaxSeqNo: 42 sessionId: src_id|8d10546d-bdb6fc9a-cc78fa55-dae29925_0
2025-09-30T14:57:03.727588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5889ca7e-3549493f-ff4476ed-c5f27e18_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8d10546d-bdb6fc9a-cc78fa55-dae29925_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:03.730760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d10546d-bdb6fc9a-cc78fa55-dae29925_0] Write session: try to update token
2025-09-30T14:57:03.730784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d10546d-bdb6fc9a-cc78fa55-dae29925_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:03.739839Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:03.739857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:03.739859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:03.739862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:03.739872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896405389421377:11120]
2025-09-30T14:57:03.739876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896405389421377:11120]
2025-09-30T14:57:03.739881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896405389421377:11120]
2025-09-30T14:57:03.739925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:03.739933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.739937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:03.739937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:03.739944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:03.739950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:03.740086Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:03.751448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2432 sessionId: src_id|8d10546d-bdb6fc9a-cc78fa55-dae29925_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:03.754403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:03.770852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896405479207471:10294]
2025-09-30T14:57:03.771397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2431, pipe: [1:7555896405479207471:10294]
2025-09-30T14:57:03.856738Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:03.857459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:03.857477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:03.857500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896405479207471:10294], now have 1 active actors on pipe
2025-09-30T14:57:03.857997Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:03.858171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d10546d-bdb6fc9a-cc78fa55-dae29925_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:03.858184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d10546d-bdb6fc9a-cc78fa55-dae29925_0] Write session will restart in 0.008527s
2025-09-30T14:57:03.858220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d10546d-bdb6fc9a-cc78fa55-dae29925_0] Write session: Do CDS request
2025-09-30T14:57:03.858226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d10546d-bdb6fc9a-cc78fa55-dae29925_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:03.857733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:03.857751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:03.857828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2432 reason: error at write: Disconnected sessionId: src_id|8d10546d-bdb6fc9a-cc78fa55-dae29925_0
2025-09-30T14:57:03.858026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2432 sessionId: src_id|8d10546d-bdb6fc9a-cc78fa55-dae29925_0 is DEAD
2025-09-30T14:57:03.858173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896405479207471:10294]
2025-09-30T14:57:03.858192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:03.867813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d10546d-bdb6fc9a-cc78fa55-dae29925_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:03.868243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:03.868262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2433
2025-09-30T14:57:03.868423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2433 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:03.868469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2433 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:03.868475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2433 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:03.868479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:03.868963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2433 sessionId:  describe result for acl check
2025-09-30T14:57:03.869001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:03.869004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:03.869006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:03.869012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896405479207489:10468] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:03.869618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896405479207489:10468] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:03.872203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896405479207489:10468] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:03.875234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896405479207489:10468] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:03.875268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896405479207489:10468] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:03.875271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896405479207489:10468] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:03.875281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2433 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:03.896116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:03.899041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:03.899313Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:03.899327Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:03.899341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:03.899411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:03.899547Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896405389421653:11122]
2025-09-30T14:57:03.900263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:03.900686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:03.900742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:03.901104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:03.901191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:03.901193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:03.901194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:03.901196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:03.901197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:03.901198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:03.901200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:03.901201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:03.901202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:03.901203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:03.901205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.901206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:03.901207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:03.901209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:03.901210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:03.901217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:03.901228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:03.901233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:03.901238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:03.901243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:03.901248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:03.901253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:03.901258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:03.901263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:03.901268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:03.901273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.901277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:03.901283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:03.901287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:03.901292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:03.901302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:03.901312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:03.901318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:03.901325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:03.901331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:03.901337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:03.901341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:03.901346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:03.901353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:03.901358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:03.901362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:03.901369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:03.901373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:03.901379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:03.901386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:03.901391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:03.901396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:03.901401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:03.901406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:03.901411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:03.901416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.901421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.901427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:03.901432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:03.901436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:03.901441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:03.901445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:03.901451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:03.901456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:03.901462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:03.901513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:03.907379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:03.908941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:03.908963Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:03.908966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:03.908970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:03.908977Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2432 [2:7555896405389421653:11122]
2025-09-30T14:57:03.908996Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:03.909014Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:03.909018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:03.909021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:03.909024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:03.909042Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:03.909057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:03.909065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:03.909140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.909148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:03.909151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:03.909155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:03.909158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:03.909250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:03.909259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.909274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:03.909287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:03.909309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:03.909333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896405479207542:10468], now have 1 active actors on pipe
2025-09-30T14:57:03.909344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896405479207474:2454], now have 1 active actors on pipe
2025-09-30T14:57:03.909350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896405389421648:11122]
2025-09-30T14:57:03.909360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896405389421648:11122]
2025-09-30T14:57:03.909363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896405389421648:11122]
2025-09-30T14:57:03.909378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:03.909394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:03.909396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:03.909397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:03.909400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:03.909411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:03.909414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:03.909425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2432
2025-09-30T14:57:03.909456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896405389421648:11122]
2025-09-30T14:57:03.909472Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:03.909479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:03.909507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2432
2025-09-30T14:57:03.909628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:03.909638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:03.909665Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|873f608f-9460b4d1-ec721d0-379cbbff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:03.909677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:03.909681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:03.909684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:03.909697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:03.909713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:03.909734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:03.910346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:03.910363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:03.910390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:03.910520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2433 partition: 0 MaxSeqNo: 42 sessionId: src_id|873f608f-9460b4d1-ec721d0-379cbbff_0
2025-09-30T14:57:03.910996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d10546d-bdb6fc9a-cc78fa55-dae29925_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|873f608f-9460b4d1-ec721d0-379cbbff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:03.914244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|873f608f-9460b4d1-ec721d0-379cbbff_0] Write session: try to update token
2025-09-30T14:57:03.914272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|873f608f-9460b4d1-ec721d0-379cbbff_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:03.924418Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:03.924439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:03.924451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896405389421648:11122]
2025-09-30T14:57:03.924506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:03.924509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:03.924704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:03.924867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:03.925058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:03.925226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:03.925437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:03.925475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:03.936861Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:03.936885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:03.936888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:03.936890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:03.936901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896405389421648:11122]
2025-09-30T14:57:03.936907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896405389421648:11122]
2025-09-30T14:57:03.936911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896405389421648:11122]
2025-09-30T14:57:03.936956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:03.936964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:03.936963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:03.936967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:03.936971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:03.936976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:03.937121Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:03.937237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2433 sessionId: src_id|873f608f-9460b4d1-ec721d0-379cbbff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:03.940864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:03.959792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896405479207886:10294]
2025-09-30T14:57:03.960106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2432, pipe: [1:7555896405479207886:10294]
2025-09-30T14:57:04.062663Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:04.063113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:04.063133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:04.063156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896405479207886:10294], now have 1 active actors on pipe
2025-09-30T14:57:04.063432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896405479207886:10294]
2025-09-30T14:57:04.063464Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:04.063441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:04.063474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:04.063477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:04.063565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2433 reason: error at write: Disconnected sessionId: src_id|873f608f-9460b4d1-ec721d0-379cbbff_0
2025-09-30T14:57:04.063747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2433 sessionId: src_id|873f608f-9460b4d1-ec721d0-379cbbff_0 is DEAD
2025-09-30T14:57:04.063929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|873f608f-9460b4d1-ec721d0-379cbbff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:04.063942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|873f608f-9460b4d1-ec721d0-379cbbff_0] Write session will restart in 0.007964s
2025-09-30T14:57:04.063966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|873f608f-9460b4d1-ec721d0-379cbbff_0] Write session: Do CDS request
2025-09-30T14:57:04.063976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|873f608f-9460b4d1-ec721d0-379cbbff_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:04.072801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|873f608f-9460b4d1-ec721d0-379cbbff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:04.072909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:04.072929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2434
2025-09-30T14:57:04.073048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2434 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:04.073084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2434 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:04.073095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2434 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:04.073099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:04.073519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2434 sessionId:  describe result for acl check
2025-09-30T14:57:04.073555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:04.073563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:04.073565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:04.073572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896409774175229:10479] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:04.074114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896409774175229:10479] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:04.077136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896409774175229:10479] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:04.084114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896409774175229:10479] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:04.084132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896409774175229:10479] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:04.084135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896409774175229:10479] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:04.084142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2434 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:04.099848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:04.100663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:04.100874Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:04.100886Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:04.100897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:04.100954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:04.101001Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896409684389273:11138]
2025-09-30T14:57:04.101642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:04.102905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:04.102966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:04.103420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:04.103505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:04.103512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:04.103513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:04.103515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:04.103516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:04.103518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:04.103519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:04.103521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:04.103522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:04.103524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:04.103525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.103526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:04.103528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:04.103529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:04.103530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:04.103538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:04.103551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:04.103556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:04.103560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:04.103565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:04.103571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:04.103575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:04.103580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:04.103585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:04.103590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:04.103594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.103599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:04.103604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:04.103609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:04.103613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:04.103622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:04.103631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:04.103639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:04.103645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:04.103653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:04.103660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:04.103665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:04.103679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:04.103684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:04.103690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:04.103695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:04.103701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:04.103711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:04.103716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:04.103725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:04.103731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:04.103737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:04.103743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:04.103748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:04.103759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:04.103764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.103775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.103781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:04.103791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:04.103796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:04.103805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:04.103811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:04.103817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:04.103827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:04.103832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:04.103886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:04.110147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:04.111496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:04.111520Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:04.111523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:04.111527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:04.111535Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2433 [2:7555896409684389273:11138]
2025-09-30T14:57:04.111553Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:04.111572Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:04.111583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:04.111586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:04.111589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:04.111607Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:04.111619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:04.111627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:04.111701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.111710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:04.111712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:04.111716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:04.111719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:04.111802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:04.111812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.111828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:04.111837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:04.111855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:04.111877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896409774175322:10479], now have 1 active actors on pipe
2025-09-30T14:57:04.111887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896409774175196:2454], now have 1 active actors on pipe
2025-09-30T14:57:04.111894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896409684389268:11138]
2025-09-30T14:57:04.111897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896409684389268:11138]
2025-09-30T14:57:04.111899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896409684389268:11138]
2025-09-30T14:57:04.111913Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:04.111934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:04.111944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:04.111944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:04.111947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:04.111961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:04.111965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:04.112006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896409684389268:11138]
2025-09-30T14:57:04.112016Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:04.112021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:04.115468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2433
2025-09-30T14:57:04.115515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2433
2025-09-30T14:57:04.115596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:04.115617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:04.115655Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4dc1b8e8-9cfed16e-4a1ec630-cea04d53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:04.115682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:04.115694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:04.115697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:04.115711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:04.115741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:04.115767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:04.119966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:04.119987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:04.120028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:04.120175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2434 partition: 0 MaxSeqNo: 42 sessionId: src_id|4dc1b8e8-9cfed16e-4a1ec630-cea04d53_0
2025-09-30T14:57:04.120598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|873f608f-9460b4d1-ec721d0-379cbbff_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4dc1b8e8-9cfed16e-4a1ec630-cea04d53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:04.123683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dc1b8e8-9cfed16e-4a1ec630-cea04d53_0] Write session: try to update token
2025-09-30T14:57:04.123707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dc1b8e8-9cfed16e-4a1ec630-cea04d53_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:04.130750Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:04.130772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:04.130782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896409684389268:11138]
2025-09-30T14:57:04.130834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:04.130836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:04.131031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:04.131197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:04.131384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:04.131543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:04.131759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:04.131809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:04.148343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2434 sessionId: src_id|4dc1b8e8-9cfed16e-4a1ec630-cea04d53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:04.149825Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:04.149845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:04.149847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:04.149849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:04.149858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896409684389268:11138]
2025-09-30T14:57:04.149862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896409684389268:11138]
2025-09-30T14:57:04.149865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896409684389268:11138]
2025-09-30T14:57:04.149899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:04.149905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.149909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:04.149909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:04.149916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:04.149925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:04.150067Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:04.151154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:04.163537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896409774175605:10294]
2025-09-30T14:57:04.163804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2433, pipe: [1:7555896409774175605:10294]
2025-09-30T14:57:04.268113Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:04.268583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:04.268604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:04.268624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896409774175605:10294], now have 1 active actors on pipe
2025-09-30T14:57:04.268873Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:04.270115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dc1b8e8-9cfed16e-4a1ec630-cea04d53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:04.270126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dc1b8e8-9cfed16e-4a1ec630-cea04d53_0] Write session will restart in 0.007320s
2025-09-30T14:57:04.270151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dc1b8e8-9cfed16e-4a1ec630-cea04d53_0] Write session: Do CDS request
2025-09-30T14:57:04.270157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dc1b8e8-9cfed16e-4a1ec630-cea04d53_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:04.269650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:04.269735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2434 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4dc1b8e8-9cfed16e-4a1ec630-cea04d53_0
2025-09-30T14:57:04.269934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2434 sessionId: src_id|4dc1b8e8-9cfed16e-4a1ec630-cea04d53_0 is DEAD
2025-09-30T14:57:04.270069Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:04.270103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896409774175605:10294]
2025-09-30T14:57:04.278715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dc1b8e8-9cfed16e-4a1ec630-cea04d53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:04.282811Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:04.282832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2435
2025-09-30T14:57:04.284304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2435 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:04.284366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2435 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:04.284377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2435 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:04.284383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:04.284802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2435 sessionId:  describe result for acl check
2025-09-30T14:57:04.284838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:04.284845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:04.284847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:04.284854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896409774175650:10485] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:04.285448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896409774175650:10485] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:04.293477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896409774175650:10485] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:04.300583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896409774175650:10485] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:04.300604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896409774175650:10485] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:04.300610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896409774175650:10485] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:04.300619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2435 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:04.301065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:04.303357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:04.303607Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:04.303632Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:04.303644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:04.303709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:04.303753Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896409684389546:11140]
2025-09-30T14:57:04.304520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:04.304865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:04.304912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:04.305310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:04.305382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:04.305393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:04.305394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:04.305396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:04.305397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:04.305399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:04.305400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:04.305402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:04.305404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:04.305405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:04.305407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.305408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:04.305409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:04.305410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:04.305411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:04.305418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:04.305430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:04.305435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:04.305440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:04.305444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:04.305450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:04.305454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:04.305459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:04.305464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:04.305469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:04.305474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.305479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:04.305483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:04.305488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:04.305492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:04.305503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:04.305512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:04.305517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:04.305524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:04.305528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:04.305534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:04.305539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:04.305545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:04.305550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:04.305556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:04.305562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:04.305568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:04.305575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:04.305581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:04.305587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:04.305594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:04.305599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:04.305605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:04.305614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:04.305620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:04.305626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.305632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.305637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:04.305642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:04.305649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:04.305655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:04.305660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:04.305666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:04.305674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:04.305680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:04.305730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:04.312643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:04.313933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:04.313956Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:04.313959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:04.313963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:04.313972Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2434 [2:7555896409684389546:11140]
2025-09-30T14:57:04.313990Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:04.314010Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:04.314014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:04.314018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:04.314020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:04.314038Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:04.314045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:04.314053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:04.314138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.314149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:04.314151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:04.314155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:04.314158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:04.314233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:04.314242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.314256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:04.314269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:04.314293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:04.314318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896409774175613:2454], now have 1 active actors on pipe
2025-09-30T14:57:04.314326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896409684389541:11140]
2025-09-30T14:57:04.314333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896409684389541:11140]
2025-09-30T14:57:04.314335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896409684389541:11140]
2025-09-30T14:57:04.314348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:04.314365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896409774176005:10485], now have 1 active actors on pipe
2025-09-30T14:57:04.314372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:04.314377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:04.314377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:04.314379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:04.314393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:04.314396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:04.314435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896409684389541:11140]
2025-09-30T14:57:04.314448Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:04.314449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2434
2025-09-30T14:57:04.314472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:04.314502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2434
2025-09-30T14:57:04.314614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:04.314630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:04.314656Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ae90e44-88590ac7-7ce7c280-16e5d9cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:04.314670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:04.314680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:04.314683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:04.314696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:04.314713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:04.314735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:04.314939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:04.314950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:04.314984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:04.315082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2435 partition: 0 MaxSeqNo: 42 sessionId: src_id|2ae90e44-88590ac7-7ce7c280-16e5d9cf_0
2025-09-30T14:57:04.319434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dc1b8e8-9cfed16e-4a1ec630-cea04d53_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2ae90e44-88590ac7-7ce7c280-16e5d9cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:04.322432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ae90e44-88590ac7-7ce7c280-16e5d9cf_0] Write session: try to update token
2025-09-30T14:57:04.322459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ae90e44-88590ac7-7ce7c280-16e5d9cf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:04.329550Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:04.329573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:04.329576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:04.329578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:04.329588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896409684389541:11140]
2025-09-30T14:57:04.329593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896409684389541:11140]
2025-09-30T14:57:04.329599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896409684389541:11140]
2025-09-30T14:57:04.329644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:04.329652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.329655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:04.329660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:04.329667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:04.329671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:04.329804Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:04.342735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2435 sessionId: src_id|2ae90e44-88590ac7-7ce7c280-16e5d9cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:04.345883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:04.370399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896409774176018:10294]
2025-09-30T14:57:04.370851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2434, pipe: [1:7555896409774176018:10294]
2025-09-30T14:57:04.451001Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:04.451593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:04.451613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:04.451669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896409774176018:10294], now have 1 active actors on pipe
2025-09-30T14:57:04.451970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896409774176018:10294]
2025-09-30T14:57:04.452009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:04.452046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:04.452144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2435 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2ae90e44-88590ac7-7ce7c280-16e5d9cf_0
2025-09-30T14:57:04.451983Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:04.452333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2435 sessionId: src_id|2ae90e44-88590ac7-7ce7c280-16e5d9cf_0 is DEAD
2025-09-30T14:57:04.455579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ae90e44-88590ac7-7ce7c280-16e5d9cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:04.455597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ae90e44-88590ac7-7ce7c280-16e5d9cf_0] Write session will restart in 0.006101s
2025-09-30T14:57:04.455631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ae90e44-88590ac7-7ce7c280-16e5d9cf_0] Write session: Do CDS request
2025-09-30T14:57:04.455639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ae90e44-88590ac7-7ce7c280-16e5d9cf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:04.463833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ae90e44-88590ac7-7ce7c280-16e5d9cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:04.464347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:04.464364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2436
2025-09-30T14:57:04.464540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2436 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:04.464573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2436 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:04.464584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2436 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:04.464588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:04.465053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2436 sessionId:  describe result for acl check
2025-09-30T14:57:04.465094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:04.465096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:04.465100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:04.465106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896409774176145:10489] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:04.465658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896409774176145:10489] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:04.468415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896409774176145:10489] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:04.471867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896409774176145:10489] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:04.471883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896409774176145:10489] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:04.471887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896409774176145:10489] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:04.471896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2436 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:04.480071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:04.483173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:04.483607Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:04.483618Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:04.483631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:04.483697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:04.483750Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896409684389820:11142]
2025-09-30T14:57:04.484482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:04.484858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:04.484922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:04.485292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:04.485368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:04.485374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:04.485375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:04.485376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:04.485377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:04.485378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:04.485380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:04.485381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:04.485382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:04.485384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:04.485385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.485386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:04.485387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:04.485388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:04.485390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:04.485396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:04.485405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:04.485409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:04.485412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:04.485415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:04.485419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:04.485422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:04.485425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:04.485429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:04.485432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:04.485436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.485439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:04.485442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:04.485445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:04.485448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:04.485457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:04.485464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:04.485471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:04.485475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:04.485479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:04.485484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:04.485489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:04.485494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:04.485499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:04.485504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:04.485508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:04.485513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:04.485517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:04.485522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:04.485526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:04.485531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:04.485541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:04.485547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:04.485551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:04.485555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:04.485559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.485564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.485567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:04.485571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:04.485575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:04.485579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:04.485583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:04.485587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:04.485591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:04.485595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:04.485632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:04.491728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:04.493036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:04.493056Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:04.493059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:04.493063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:04.493071Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2435 [2:7555896409684389820:11142]
2025-09-30T14:57:04.493088Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:04.493107Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:04.493116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:04.493120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:04.493122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:04.493139Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:04.493152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:04.493159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:04.493242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.493251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:04.493253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:04.493256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:04.493258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:04.493331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:04.493339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.493353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:04.493365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:04.493386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:04.493412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896409774176019:2454], now have 1 active actors on pipe
2025-09-30T14:57:04.493431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896409684389815:11142]
2025-09-30T14:57:04.493433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896409684389815:11142]
2025-09-30T14:57:04.493436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896409684389815:11142]
2025-09-30T14:57:04.493449Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:04.493463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:04.493465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896409774176316:10489], now have 1 active actors on pipe
2025-09-30T14:57:04.493474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:04.493476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:04.493485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:04.493503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:04.493506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:04.493553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896409684389815:11142]
2025-09-30T14:57:04.493562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:04.493569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:04.493911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2435
2025-09-30T14:57:04.494008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2435
2025-09-30T14:57:04.494023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:04.494038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:04.494065Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1628ccad-e1a596ae-c232c7b5-df42d432_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:04.494090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:04.494099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:04.494102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:04.494114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:04.494131Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:04.494158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:04.494424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:04.494439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:04.494463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:04.494583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2436 partition: 0 MaxSeqNo: 42 sessionId: src_id|1628ccad-e1a596ae-c232c7b5-df42d432_0
2025-09-30T14:57:04.495618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ae90e44-88590ac7-7ce7c280-16e5d9cf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1628ccad-e1a596ae-c232c7b5-df42d432_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:04.499098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1628ccad-e1a596ae-c232c7b5-df42d432_0] Write session: try to update token
2025-09-30T14:57:04.499122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1628ccad-e1a596ae-c232c7b5-df42d432_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:04.506018Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:04.506040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:04.506050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896409684389815:11142]
2025-09-30T14:57:04.506097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:04.506099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:04.506284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:04.506446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:04.506599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:04.506774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:04.506997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:04.507059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:04.518044Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:04.518065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:04.518067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:04.518070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:04.518082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896409684389815:11142]
2025-09-30T14:57:04.518087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896409684389815:11142]
2025-09-30T14:57:04.518091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896409684389815:11142]
2025-09-30T14:57:04.518128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:04.518136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.518139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:04.518140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:04.518147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:04.518160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:04.518290Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:04.525466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2436 sessionId: src_id|1628ccad-e1a596ae-c232c7b5-df42d432_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:04.528227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:04.552141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896409774176423:10294]
2025-09-30T14:57:04.552625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2435, pipe: [1:7555896409774176423:10294]
2025-09-30T14:57:04.635049Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:04.635781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:04.635804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:04.635826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896409774176423:10294], now have 1 active actors on pipe
2025-09-30T14:57:04.636069Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:04.636145Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:04.636201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896409774176423:10294]
2025-09-30T14:57:04.636227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:04.636304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2436 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1628ccad-e1a596ae-c232c7b5-df42d432_0
2025-09-30T14:57:04.636536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2436 sessionId: src_id|1628ccad-e1a596ae-c232c7b5-df42d432_0 is DEAD
2025-09-30T14:57:04.636780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1628ccad-e1a596ae-c232c7b5-df42d432_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:04.636798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1628ccad-e1a596ae-c232c7b5-df42d432_0] Write session will restart in 0.006764s
2025-09-30T14:57:04.636834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1628ccad-e1a596ae-c232c7b5-df42d432_0] Write session: Do CDS request
2025-09-30T14:57:04.636842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1628ccad-e1a596ae-c232c7b5-df42d432_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:04.645024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1628ccad-e1a596ae-c232c7b5-df42d432_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:04.645192Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:04.645221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2437
2025-09-30T14:57:04.645385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2437 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:04.645429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2437 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:04.645443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2437 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:04.645453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:04.646053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2437 sessionId:  describe result for acl check
2025-09-30T14:57:04.646105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:04.646113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:04.646116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:04.646136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896409774176476:10493] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:04.646844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896409774176476:10493] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:04.649457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896409774176476:10493] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:04.652667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896409774176476:10493] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:04.652685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896409774176476:10493] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:04.652690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896409774176476:10493] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:04.652698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2437 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:04.660127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:04.662733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:04.662964Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:04.662975Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:04.662986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:04.663039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:04.663081Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896409684390097:11145]
2025-09-30T14:57:04.663741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:04.664089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:04.664130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:04.664458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:04.664521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:04.664527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:04.664528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:04.664529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:04.664530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:04.664531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:04.664532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:04.664533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:04.664535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:04.664536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:04.664537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.664538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:04.664539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:04.664541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:04.664543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:04.664548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:04.664557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:04.664562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:04.664566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:04.664569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:04.664572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:04.664576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:04.664580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:04.664583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:04.664588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:04.664592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.664595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:04.664599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:04.664602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:04.664606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:04.664613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:04.664621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:04.664626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:04.664632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:04.664637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:04.664641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:04.664645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:04.664651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:04.664655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:04.664659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:04.664663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:04.664668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:04.664673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:04.664678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:04.664682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:04.664688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:04.664693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:04.664698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:04.664703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:04.664707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:04.664711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.664716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.664721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:04.664731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:04.664735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:04.664739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:04.664743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:04.664753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:04.664759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:04.664764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:04.664806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:04.670685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:04.672051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:04.672069Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:04.672072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:04.672077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:04.672083Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2436 [2:7555896409684390097:11145]
2025-09-30T14:57:04.672100Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:04.672117Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:04.672121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:04.672125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:04.672127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:04.672145Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:04.672156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:04.672163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:04.672233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.672240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:04.672243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:04.672247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:04.672249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:04.672326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:04.672337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.672350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:04.672361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:04.672378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:04.672396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896409774176633:10493], now have 1 active actors on pipe
2025-09-30T14:57:04.672406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896409774176425:2454], now have 1 active actors on pipe
2025-09-30T14:57:04.672413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896409684390092:11145]
2025-09-30T14:57:04.672415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896409684390092:11145]
2025-09-30T14:57:04.672418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896409684390092:11145]
2025-09-30T14:57:04.672431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:04.672446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:04.672450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:04.672455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:04.672457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:04.672466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:04.672469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:04.672506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896409684390092:11145]
2025-09-30T14:57:04.672516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:04.672522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:04.672563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2436
2025-09-30T14:57:04.672573Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2436
2025-09-30T14:57:04.672659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:04.672669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:04.672696Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aaea8151-9efa249f-b348e318-da971908_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:04.672708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:04.672718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:04.672720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:04.672731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:04.672744Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:04.672766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:04.673020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:04.673033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:04.673057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:04.673153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2437 partition: 0 MaxSeqNo: 42 sessionId: src_id|aaea8151-9efa249f-b348e318-da971908_0
2025-09-30T14:57:04.673629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1628ccad-e1a596ae-c232c7b5-df42d432_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|aaea8151-9efa249f-b348e318-da971908_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:04.677131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaea8151-9efa249f-b348e318-da971908_0] Write session: try to update token
2025-09-30T14:57:04.677160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaea8151-9efa249f-b348e318-da971908_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:04.684601Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:04.684622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:04.684631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896409684390092:11145]
2025-09-30T14:57:04.684673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:04.684675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:04.684852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:04.685012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:04.685204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:04.685364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:04.685570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:04.685616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:04.693374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2437 sessionId: src_id|aaea8151-9efa249f-b348e318-da971908_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:04.696334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:04.696616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:04.696642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:04.696663Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:04.696666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:04.696669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:04.696671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:04.696680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896409684390092:11145]
2025-09-30T14:57:04.696685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896409684390092:11145]
2025-09-30T14:57:04.696689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896409684390092:11145]
2025-09-30T14:57:04.696733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:04.696737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:04.696744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.696746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:04.696746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:04.696750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:04.696890Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:04.736477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896409774176831:10294]
2025-09-30T14:57:04.736789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2436, pipe: [1:7555896409774176831:10294]
2025-09-30T14:57:04.811394Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:04.811865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:04.811904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896409774176831:10294], now have 1 active actors on pipe
2025-09-30T14:57:04.812018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:04.812082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:04.812133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896409774176831:10294]
2025-09-30T14:57:04.812143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:04.812147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:04.812220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2437 reason: error at write: Disconnected sessionId: src_id|aaea8151-9efa249f-b348e318-da971908_0
2025-09-30T14:57:04.812442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2437 sessionId: src_id|aaea8151-9efa249f-b348e318-da971908_0 is DEAD
2025-09-30T14:57:04.812529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaea8151-9efa249f-b348e318-da971908_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:04.812541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaea8151-9efa249f-b348e318-da971908_0] Write session will restart in 0.006944s
2025-09-30T14:57:04.812573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaea8151-9efa249f-b348e318-da971908_0] Write session: Do CDS request
2025-09-30T14:57:04.812579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaea8151-9efa249f-b348e318-da971908_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:04.820844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaea8151-9efa249f-b348e318-da971908_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:04.820968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:04.820987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2438
2025-09-30T14:57:04.821207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2438 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:04.821243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2438 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:04.821249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2438 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:04.821253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:04.821839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2438 sessionId:  describe result for acl check
2025-09-30T14:57:04.821885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:04.821892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:04.821896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:04.821902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896409774176866:10498] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:04.822509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896409774176866:10498] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:04.825384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896409774176866:10498] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:04.828596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896409774176866:10498] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:04.828614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896409774176866:10498] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:04.828617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896409774176866:10498] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:04.828627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2438 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:04.839849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:04.842705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:04.842966Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:04.842978Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:04.842990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:04.843048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:04.843092Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896409684390373:11147]
2025-09-30T14:57:04.843802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:04.844153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:04.844204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:04.844552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:04.844628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:04.844634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:04.844636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:04.844637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:04.844639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:04.844640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:04.844641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:04.844642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:04.844644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:04.844645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:04.844646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.844648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:04.844649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:04.844650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:04.844651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:04.844657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:04.844668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:04.844672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:04.844676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:04.844680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:04.844684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:04.844689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:04.844692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:04.844696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:04.844700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:04.844704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.844708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:04.844712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:04.844716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:04.844720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:04.844729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:04.844737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:04.844743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:04.844749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:04.844754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:04.844760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:04.844764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:04.844770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:04.844775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:04.844780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:04.844785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:04.844790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:04.844795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:04.844800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:04.844805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:04.844810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:04.844816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:04.844821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:04.844833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:04.844838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:04.844842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.844852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.844856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:04.844860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:04.844865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:04.844870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:04.844874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:04.844879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:04.844890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:04.844896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:04.844944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:04.850578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:04.852011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:04.852028Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:04.852031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:04.852035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:04.852042Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2437 [2:7555896409684390373:11147]
2025-09-30T14:57:04.852057Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:04.852090Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:04.852093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:04.852097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:04.852099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:04.852117Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:04.852130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:04.852138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:04.852204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.852210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:04.852213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:04.852216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:04.852219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:04.852287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:04.852294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.852307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:04.852317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:04.852332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:04.852352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896409774177030:10498], now have 1 active actors on pipe
2025-09-30T14:57:04.852355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896409774176832:2454], now have 1 active actors on pipe
2025-09-30T14:57:04.852361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896409684390368:11147]
2025-09-30T14:57:04.852363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896409684390368:11147]
2025-09-30T14:57:04.852365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896409684390368:11147]
2025-09-30T14:57:04.852383Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:04.852395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:04.852413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:04.852421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:04.852455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896409684390368:11147]
2025-09-30T14:57:04.852462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:04.852463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:04.852467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:04.852470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:04.852477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:04.852480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2437
2025-09-30T14:57:04.852517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2437
2025-09-30T14:57:04.852659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:04.852689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:04.852726Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85eb14c3-8f176b59-3769f2c2-b711aecf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:04.852737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:04.852742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:04.852744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:04.852756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:04.852768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:04.852785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:04.853000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:04.853008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:04.853025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:04.853118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2438 partition: 0 MaxSeqNo: 42 sessionId: src_id|85eb14c3-8f176b59-3769f2c2-b711aecf_0
2025-09-30T14:57:04.853539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaea8151-9efa249f-b348e318-da971908_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|85eb14c3-8f176b59-3769f2c2-b711aecf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:04.856988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85eb14c3-8f176b59-3769f2c2-b711aecf_0] Write session: try to update token
2025-09-30T14:57:04.857011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85eb14c3-8f176b59-3769f2c2-b711aecf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:04.868624Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:04.868644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:04.868654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896409684390368:11147]
2025-09-30T14:57:04.868701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:04.868707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:04.868886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:04.869033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:04.869199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:04.869355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:04.869563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:04.869607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:04.886478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2438 sessionId: src_id|85eb14c3-8f176b59-3769f2c2-b711aecf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:04.888704Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:04.888730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:04.888733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:04.888735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:04.888745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896409684390368:11147]
2025-09-30T14:57:04.888750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896409684390368:11147]
2025-09-30T14:57:04.888754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896409684390368:11147]
2025-09-30T14:57:04.888798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:04.888804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:04.888805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:04.888807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:04.888811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:04.888816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:04.888965Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:04.889439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:04.912091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896409774177238:10294]
2025-09-30T14:57:04.912435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2437, pipe: [1:7555896409774177238:10294]
2025-09-30T14:57:05.005950Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:05.006624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:05.006646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:05.006670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896409774177238:10294], now have 1 active actors on pipe
2025-09-30T14:57:05.006914Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:05.006913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:05.006930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:05.006996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2438 reason: error at write: Disconnected sessionId: src_id|85eb14c3-8f176b59-3769f2c2-b711aecf_0
2025-09-30T14:57:05.007221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2438 sessionId: src_id|85eb14c3-8f176b59-3769f2c2-b711aecf_0 is DEAD
2025-09-30T14:57:05.007339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896409774177238:10294]
2025-09-30T14:57:05.007378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:05.007412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85eb14c3-8f176b59-3769f2c2-b711aecf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:05.007424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85eb14c3-8f176b59-3769f2c2-b711aecf_0] Write session will restart in 0.006842s
2025-09-30T14:57:05.007457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85eb14c3-8f176b59-3769f2c2-b711aecf_0] Write session: Do CDS request
2025-09-30T14:57:05.007466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85eb14c3-8f176b59-3769f2c2-b711aecf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:05.015794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85eb14c3-8f176b59-3769f2c2-b711aecf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:05.015846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:05.015864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2439
2025-09-30T14:57:05.017783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2439 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:05.017851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2439 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:05.017860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2439 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:05.017864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:05.018310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2439 sessionId:  describe result for acl check
2025-09-30T14:57:05.018353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:05.018363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:05.018370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:05.018376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896414069144567:10508] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:05.018948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896414069144567:10508] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:05.023208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896414069144567:10508] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:05.027843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896414069144567:10508] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:05.027863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896414069144567:10508] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:05.027869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896414069144567:10508] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:05.027879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2439 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:05.060415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:05.061767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:05.061979Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:05.061995Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:05.062008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:05.062073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:05.062118Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896413979357980:11151]
2025-09-30T14:57:05.062824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:05.063470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:05.063536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:05.063916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:05.063981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:05.063982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:05.063983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:05.063984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:05.063985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:05.063986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:05.063987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:05.063988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:05.063989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:05.063991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:05.063992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.063993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:05.063994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:05.063995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:05.063996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:05.064003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:05.064012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:05.064017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:05.064021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:05.064025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:05.064029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:05.064034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:05.064039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:05.064042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:05.064046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:05.064051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.064055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:05.064059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:05.064064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:05.064068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:05.064077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:05.064086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:05.064092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:05.064099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:05.064105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:05.064109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:05.064114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:05.064119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:05.064125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:05.064131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:05.064136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:05.064141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:05.064146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:05.064151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:05.064156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:05.064165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:05.064170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:05.064175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:05.064181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:05.064187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:05.064194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.064199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.064204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:05.064209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:05.064215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:05.064220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:05.064224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:05.064232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:05.064236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:05.064242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:05.064287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:05.070493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:05.071810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:05.071830Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:05.071834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:05.071838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:05.071846Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2438 [2:7555896413979357980:11151]
2025-09-30T14:57:05.071863Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:05.071880Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:05.071884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:05.071887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:05.071890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:05.071908Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:05.071916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:05.071928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:05.071994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.072002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:05.072004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:05.072008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:05.072011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:05.072182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2438
2025-09-30T14:57:05.072182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2438
2025-09-30T14:57:05.072201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:05.072209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.072224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:05.072236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:05.072254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:05.072274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896414069144652:10508], now have 1 active actors on pipe
2025-09-30T14:57:05.072278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896414069144538:2454], now have 1 active actors on pipe
2025-09-30T14:57:05.072293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:05.072305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:05.072325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896413979357968:11151]
2025-09-30T14:57:05.072333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896413979357968:11151]
2025-09-30T14:57:05.072336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896413979357968:11151]
2025-09-30T14:57:05.072345Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:05.072353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:05.072358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:05.072364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:05.072367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:05.072374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:05.072377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:05.072393Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d51ad9b4-89be091a-de185774-b33c272a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:05.072400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:05.072408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:05.072410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:05.072422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:05.072431Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:05.072485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896413979357968:11151]
2025-09-30T14:57:05.072493Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:05.072506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:05.072516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:05.072733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:05.072740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:05.072761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:05.072887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2439 partition: 0 MaxSeqNo: 42 sessionId: src_id|d51ad9b4-89be091a-de185774-b33c272a_0
2025-09-30T14:57:05.073311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85eb14c3-8f176b59-3769f2c2-b711aecf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d51ad9b4-89be091a-de185774-b33c272a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:05.076578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d51ad9b4-89be091a-de185774-b33c272a_0] Write session: try to update token
2025-09-30T14:57:05.076601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d51ad9b4-89be091a-de185774-b33c272a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:05.087566Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:05.087586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:05.087589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:05.087591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:05.087601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896413979357968:11151]
2025-09-30T14:57:05.087606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896413979357968:11151]
2025-09-30T14:57:05.087611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896413979357968:11151]
2025-09-30T14:57:05.087655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:05.087663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.087665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:05.087821Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:05.089305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:05.089313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:05.089318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:05.102357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2439 sessionId: src_id|d51ad9b4-89be091a-de185774-b33c272a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:05.105371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:05.107828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896414069144963:10294]
2025-09-30T14:57:05.108119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2438, pipe: [1:7555896414069144963:10294]
2025-09-30T14:57:05.204634Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:05.205473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:05.205484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:05.205504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896414069144963:10294], now have 1 active actors on pipe
2025-09-30T14:57:05.205875Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:05.206370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d51ad9b4-89be091a-de185774-b33c272a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:05.206383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d51ad9b4-89be091a-de185774-b33c272a_0] Write session will restart in 0.007823s
2025-09-30T14:57:05.206410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d51ad9b4-89be091a-de185774-b33c272a_0] Write session: Do CDS request
2025-09-30T14:57:05.206416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d51ad9b4-89be091a-de185774-b33c272a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:05.205908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:05.205928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896414069144963:10294]
2025-09-30T14:57:05.205961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:05.205964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:05.206026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2439 reason: error at write: Disconnected sessionId: src_id|d51ad9b4-89be091a-de185774-b33c272a_0
2025-09-30T14:57:05.206206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2439 sessionId: src_id|d51ad9b4-89be091a-de185774-b33c272a_0 is DEAD
2025-09-30T14:57:05.215772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d51ad9b4-89be091a-de185774-b33c272a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:05.216155Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:05.216176Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2440
2025-09-30T14:57:05.216372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2440 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:05.216407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2440 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:05.216413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2440 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:05.216417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:05.216968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2440 sessionId:  describe result for acl check
2025-09-30T14:57:05.217011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:05.217017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:05.217019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:05.217026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896414069145016:10515] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:05.217615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896414069145016:10515] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:05.221400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896414069145016:10515] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:05.228612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896414069145016:10515] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:05.228632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896414069145016:10515] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:05.228636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896414069145016:10515] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:05.228646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2440 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:05.249867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:05.253009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:05.253244Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:05.253254Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:05.253264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:05.253344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:05.253390Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896413979358274:11165]
2025-09-30T14:57:05.254066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:05.254375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:05.254440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:05.254789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:05.254855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:05.254861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:05.254862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:05.254864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:05.254865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:05.254866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:05.254868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:05.254869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:05.254871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:05.254872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:05.254873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.254875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:05.254876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:05.254877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:05.254879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:05.254885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:05.254896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:05.254900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:05.254905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:05.254909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:05.254913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:05.254918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:05.254922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:05.254926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:05.254930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:05.254935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.254939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:05.254943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:05.254947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:05.254951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:05.254961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:05.254967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:05.254971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:05.254974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:05.254978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:05.254981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:05.254984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:05.254987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:05.254990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:05.254993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:05.254998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:05.255003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:05.255008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:05.255013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:05.255017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:05.255023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:05.255027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:05.255030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:05.255035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:05.255040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:05.255045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.255051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.255056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:05.255062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:05.255068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:05.255071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:05.255073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:05.255076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:05.255079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:05.255082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:05.255107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:05.262966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:05.264326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:05.264349Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:05.264352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:05.264356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:05.264369Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2439 [2:7555896413979358274:11165]
2025-09-30T14:57:05.264390Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:05.264415Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:05.264419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:05.264423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:05.264426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:05.264446Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:05.265238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2439
2025-09-30T14:57:05.264454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:05.264474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:05.265281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2439
2025-09-30T14:57:05.264572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.264575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:05.264579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:05.264583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:05.264587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:05.264676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:05.264680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.264695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:05.264710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:05.264730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:05.264754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896413979358269:11165]
2025-09-30T14:57:05.264757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896413979358269:11165]
2025-09-30T14:57:05.264760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896413979358269:11165]
2025-09-30T14:57:05.264780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:05.264798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:05.264816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:05.264820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:05.264868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896413979358269:11165]
2025-09-30T14:57:05.264873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:05.265034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:05.265037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:05.265040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:05.265046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:05.265507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896414069145104:10515], now have 1 active actors on pipe
2025-09-30T14:57:05.265521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896414069144980:2454], now have 1 active actors on pipe
2025-09-30T14:57:05.265535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:05.265541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:05.265575Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10196324-e5c9bc63-ef28e6b5-116505e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:05.265590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:05.265595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:05.265597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:05.265612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:05.265630Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:05.265648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:05.265858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:05.265865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:05.265877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:05.266100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2440 partition: 0 MaxSeqNo: 42 sessionId: src_id|10196324-e5c9bc63-ef28e6b5-116505e3_0
2025-09-30T14:57:05.266507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d51ad9b4-89be091a-de185774-b33c272a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|10196324-e5c9bc63-ef28e6b5-116505e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:05.269510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10196324-e5c9bc63-ef28e6b5-116505e3_0] Write session: try to update token
2025-09-30T14:57:05.269532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10196324-e5c9bc63-ef28e6b5-116505e3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:05.282131Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:05.282153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:05.282156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:05.282158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:05.282168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896413979358269:11165]
2025-09-30T14:57:05.282173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896413979358269:11165]
2025-09-30T14:57:05.282177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896413979358269:11165]
2025-09-30T14:57:05.282218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:05.282226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.282225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:05.282229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:05.282230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:05.282234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:05.282371Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:05.294456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2440 sessionId: src_id|10196324-e5c9bc63-ef28e6b5-116505e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:05.297585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:05.305797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896414069145392:10294]
2025-09-30T14:57:05.306283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2439, pipe: [1:7555896414069145392:10294]
2025-09-30T14:57:05.414053Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:05.414725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:05.414740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:05.414782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896414069145392:10294], now have 1 active actors on pipe
2025-09-30T14:57:05.415292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896414069145392:10294]
2025-09-30T14:57:05.415326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:05.415002Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:05.415370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:05.415457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2440 reason: status is not ok: tablet will be restarted right now sessionId: src_id|10196324-e5c9bc63-ef28e6b5-116505e3_0
2025-09-30T14:57:05.415625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2440 sessionId: src_id|10196324-e5c9bc63-ef28e6b5-116505e3_0 is DEAD
2025-09-30T14:57:05.416024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10196324-e5c9bc63-ef28e6b5-116505e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:05.416036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10196324-e5c9bc63-ef28e6b5-116505e3_0] Write session will restart in 0.005040s
2025-09-30T14:57:05.416061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10196324-e5c9bc63-ef28e6b5-116505e3_0] Write session: Do CDS request
2025-09-30T14:57:05.416080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10196324-e5c9bc63-ef28e6b5-116505e3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:05.424067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10196324-e5c9bc63-ef28e6b5-116505e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:05.424393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:05.424411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2441
2025-09-30T14:57:05.429278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2441 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:05.429343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2441 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:05.429354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2441 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:05.429360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:05.429827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2441 sessionId:  describe result for acl check
2025-09-30T14:57:05.429860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:05.429862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:05.429866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:05.429874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896414069145490:10519] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:05.430472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896414069145490:10519] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:05.438604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896414069145490:10519] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:05.442883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896414069145490:10519] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:05.442901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896414069145490:10519] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:05.442903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896414069145490:10519] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:05.442909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2441 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:05.450183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:05.452717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:05.452943Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:05.452969Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:05.452981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:05.453048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:05.453092Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896413979358555:11167]
2025-09-30T14:57:05.453601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:05.454088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:05.454147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:05.454515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:05.454589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:05.454591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:05.454592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:05.454593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:05.454595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:05.454596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:05.454598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:05.454599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:05.454600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:05.454602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:05.454603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.454604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:05.454606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:05.454607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:05.454608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:05.454614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:05.454626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:05.454630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:05.454635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:05.454639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:05.454644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:05.454648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:05.454653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:05.454658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:05.454662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:05.454667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.454671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:05.454676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:05.454680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:05.454685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:05.454695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:05.454705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:05.454711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:05.454718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:05.454724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:05.454730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:05.454735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:05.454741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:05.454747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:05.454753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:05.454758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:05.454764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:05.454770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:05.454777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:05.454781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:05.454787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:05.454793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:05.454802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:05.454806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:05.454812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:05.454818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.454823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.454828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:05.454833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:05.454838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:05.454845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:05.454849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:05.454855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:05.454862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:05.454867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:05.454916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:05.461317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:05.463034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2440
2025-09-30T14:57:05.463042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2440
2025-09-30T14:57:05.462313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:05.462329Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:05.462333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:05.462337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:05.462344Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2440 [2:7555896413979358555:11167]
2025-09-30T14:57:05.462361Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:05.462378Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:05.462381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:05.462384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:05.462387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:05.462406Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:05.462413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:05.462421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:05.462519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.462522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:05.462525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:05.462529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:05.462532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:05.462607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:05.462610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.462624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:05.462638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:05.462658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:05.462676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896413979358550:11167]
2025-09-30T14:57:05.462679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896413979358550:11167]
2025-09-30T14:57:05.462682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896413979358550:11167]
2025-09-30T14:57:05.462696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:05.462710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:05.462726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:05.462730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:05.462767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896413979358550:11167]
2025-09-30T14:57:05.462770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:05.462907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:05.462909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:05.462912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:05.462917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:05.463204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896414069145395:2454], now have 1 active actors on pipe
2025-09-30T14:57:05.463209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896414069145669:10519], now have 1 active actors on pipe
2025-09-30T14:57:05.463228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:05.463232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:05.463280Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88a3439b-982e2e24-ba27e0a5-d1dd3204_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:05.463288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:05.463292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:05.463294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:05.463306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:05.463318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:05.463333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:05.463620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:05.463624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:05.463638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:05.464817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2441 partition: 0 MaxSeqNo: 42 sessionId: src_id|88a3439b-982e2e24-ba27e0a5-d1dd3204_0
2025-09-30T14:57:05.467383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10196324-e5c9bc63-ef28e6b5-116505e3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|88a3439b-982e2e24-ba27e0a5-d1dd3204_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:05.470139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88a3439b-982e2e24-ba27e0a5-d1dd3204_0] Write session: try to update token
2025-09-30T14:57:05.470157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88a3439b-982e2e24-ba27e0a5-d1dd3204_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:05.476673Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:05.476699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:05.476702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:05.476705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:05.476715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896413979358550:11167]
2025-09-30T14:57:05.476720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896413979358550:11167]
2025-09-30T14:57:05.476725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896413979358550:11167]
2025-09-30T14:57:05.476778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:05.476787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.476791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:05.476795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:05.476804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:05.476809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:05.476970Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:05.487872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2441 sessionId: src_id|88a3439b-982e2e24-ba27e0a5-d1dd3204_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:05.490661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:05.515709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896414069145801:10294]
2025-09-30T14:57:05.519548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2440, pipe: [1:7555896414069145801:10294]
2025-09-30T14:57:05.598738Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:05.599447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:05.599462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:05.599480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896414069145801:10294], now have 1 active actors on pipe
2025-09-30T14:57:05.599843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:05.599902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:05.599906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:05.599978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2441 reason: error at write: Disconnected sessionId: src_id|88a3439b-982e2e24-ba27e0a5-d1dd3204_0
2025-09-30T14:57:05.600180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2441 sessionId: src_id|88a3439b-982e2e24-ba27e0a5-d1dd3204_0 is DEAD
2025-09-30T14:57:05.600375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896414069145801:10294]
2025-09-30T14:57:05.600610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a3439b-982e2e24-ba27e0a5-d1dd3204_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:05.600622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a3439b-982e2e24-ba27e0a5-d1dd3204_0] Write session will restart in 0.007971s
2025-09-30T14:57:05.600646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a3439b-982e2e24-ba27e0a5-d1dd3204_0] Write session: Do CDS request
2025-09-30T14:57:05.600652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a3439b-982e2e24-ba27e0a5-d1dd3204_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:05.599944Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:05.611470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88a3439b-982e2e24-ba27e0a5-d1dd3204_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:05.611594Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:05.611612Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2442
2025-09-30T14:57:05.611737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2442 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:05.611771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2442 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:05.611785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2442 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:05.611790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:05.612208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2442 sessionId:  describe result for acl check
2025-09-30T14:57:05.612242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:05.612251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:05.612253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:05.612258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896414069145854:10523] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:05.612825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896414069145854:10523] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:05.615549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896414069145854:10523] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:05.618726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896414069145854:10523] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:05.618755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896414069145854:10523] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:05.618759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896414069145854:10523] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:05.618769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2442 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:05.626127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:05.629070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:05.629363Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:05.629375Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:05.629389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:05.629460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:05.629512Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896413979358837:11170]
2025-09-30T14:57:05.630228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:05.630658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:05.630724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:05.631125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:05.631193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:05.631198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:05.631200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:05.631200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:05.631201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:05.631202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:05.631203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:05.631204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:05.631206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:05.631207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:05.631208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.631209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:05.631210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:05.631211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:05.631211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:05.631217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:05.631225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:05.631227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:05.631230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:05.631233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:05.631236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:05.631240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:05.631276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:05.631281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:05.631286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:05.631289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.631293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:05.631297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:05.631301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:05.631305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:05.631315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:05.631324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:05.631330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:05.631334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:05.631359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:05.631381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:05.631391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:05.631397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:05.631408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:05.631413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:05.631423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:05.631429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:05.631440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:05.631446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:05.631451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:05.631457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:05.631462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:05.631467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:05.631472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:05.631477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:05.631483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.631488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.631493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:05.631498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:05.631503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:05.631510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:05.631514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:05.631519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:05.631525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:05.631531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:05.631582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:05.637707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:05.639220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:05.639261Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:05.639264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:05.639269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:05.639277Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2441 [2:7555896413979358837:11170]
2025-09-30T14:57:05.639296Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:05.639315Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:05.639319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:05.639323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:05.639325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:05.639343Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:05.639351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:05.639367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:05.639440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.639445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:05.639448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:05.639452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:05.639455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:05.639529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:05.639539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.639555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:05.639569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:05.639589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:05.639611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896414069145803:2454], now have 1 active actors on pipe
2025-09-30T14:57:05.639625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896414069146049:10523], now have 1 active actors on pipe
2025-09-30T14:57:05.639634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896413979358832:11170]
2025-09-30T14:57:05.639636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896413979358832:11170]
2025-09-30T14:57:05.639639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896413979358832:11170]
2025-09-30T14:57:05.639652Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:05.639665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:05.639667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:05.639670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:05.639672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:05.639687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:05.639690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:05.639699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2441
2025-09-30T14:57:05.639735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896413979358832:11170]
2025-09-30T14:57:05.639713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2441
2025-09-30T14:57:05.639745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:05.639752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:05.639794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:05.639805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:05.639841Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a265621a-87b2facc-85cb22af-be04404d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:05.639853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:05.639859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:05.639861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:05.639875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:05.639891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:05.639913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:05.640111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:05.640120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:05.640136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:05.640232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2442 partition: 0 MaxSeqNo: 42 sessionId: src_id|a265621a-87b2facc-85cb22af-be04404d_0
2025-09-30T14:57:05.640631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a3439b-982e2e24-ba27e0a5-d1dd3204_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a265621a-87b2facc-85cb22af-be04404d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:05.643797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a265621a-87b2facc-85cb22af-be04404d_0] Write session: try to update token
2025-09-30T14:57:05.643821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a265621a-87b2facc-85cb22af-be04404d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:05.652857Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:05.652878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:05.652880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:05.652883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:05.652893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896413979358832:11170]
2025-09-30T14:57:05.652898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896413979358832:11170]
2025-09-30T14:57:05.652903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896413979358832:11170]
2025-09-30T14:57:05.652947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:05.652955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.652958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:05.652961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:05.652969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:05.652973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:05.653102Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:05.660571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2442 sessionId: src_id|a265621a-87b2facc-85cb22af-be04404d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:05.663522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:05.700683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896414069146214:10294]
2025-09-30T14:57:05.702337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2441, pipe: [1:7555896414069146214:10294]
2025-09-30T14:57:05.770860Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:05.771283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:05.771300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:05.771324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896414069146214:10294], now have 1 active actors on pipe
2025-09-30T14:57:05.771576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:05.771592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:05.771664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2442 reason: error at write: Disconnected sessionId: src_id|a265621a-87b2facc-85cb22af-be04404d_0
2025-09-30T14:57:05.771844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2442 sessionId: src_id|a265621a-87b2facc-85cb22af-be04404d_0 is DEAD
2025-09-30T14:57:05.771883Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:05.771928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896414069146214:10294]
2025-09-30T14:57:05.772016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a265621a-87b2facc-85cb22af-be04404d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:05.772027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a265621a-87b2facc-85cb22af-be04404d_0] Write session will restart in 0.007885s
2025-09-30T14:57:05.772051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a265621a-87b2facc-85cb22af-be04404d_0] Write session: Do CDS request
2025-09-30T14:57:05.772056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a265621a-87b2facc-85cb22af-be04404d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:05.771581Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:05.780860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a265621a-87b2facc-85cb22af-be04404d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:05.781006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:05.781024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2443
2025-09-30T14:57:05.781186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2443 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:05.781225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2443 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:05.781231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2443 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:05.781235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:05.781748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2443 sessionId:  describe result for acl check
2025-09-30T14:57:05.781790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:05.781800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:05.781803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:05.781811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896414069146261:10528] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:05.782407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896414069146261:10528] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:05.784452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896414069146261:10528] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:05.787422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896414069146261:10528] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:05.787437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896414069146261:10528] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:05.787441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896414069146261:10528] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:05.787448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2443 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:05.800781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:05.803156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:05.803389Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:05.803397Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:05.803409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:05.803475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:05.803519Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896413979359118:11172]
2025-09-30T14:57:05.804223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:05.804602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:05.804646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:05.804947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:05.804999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:05.805001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:05.805002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:05.805003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:05.805004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:05.805005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:05.805007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:05.805008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:05.805009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:05.805010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:05.805011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.805013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:05.805014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:05.805015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:05.805016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:05.805021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:05.805032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:05.805036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:05.805040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:05.805044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:05.805049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:05.805052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:05.805055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:05.805059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:05.805063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:05.805066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.805069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:05.805072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:05.805076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:05.805079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:05.805086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:05.805093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:05.805100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:05.805105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:05.805110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:05.805115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:05.805119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:05.805125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:05.805129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:05.805134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:05.805138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:05.805143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:05.805150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:05.805155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:05.805171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:05.805176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:05.805180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:05.805185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:05.805189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:05.805194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:05.805201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.805207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.805212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:05.805217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:05.805221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:05.805226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:05.805230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:05.805234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:05.805239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:05.805244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:05.805282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:05.811088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:05.812061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:05.812079Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:05.812082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:05.812086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:05.812094Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2442 [2:7555896413979359118:11172]
2025-09-30T14:57:05.812113Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:05.812135Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:05.812142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:05.812146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:05.812149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:05.812167Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:05.812182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:05.812190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:05.812253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.812262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:05.812264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:05.812268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:05.812272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:05.812355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:05.812362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.812377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:05.812392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:05.812411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:05.812434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896414069146215:2454], now have 1 active actors on pipe
2025-09-30T14:57:05.812441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896414069146385:10528], now have 1 active actors on pipe
2025-09-30T14:57:05.812448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896413979359113:11172]
2025-09-30T14:57:05.812451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896413979359113:11172]
2025-09-30T14:57:05.812454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896413979359113:11172]
2025-09-30T14:57:05.812467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:05.812482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:05.812485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:05.812500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:05.812500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:05.812503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:05.812504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:05.812541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896413979359113:11172]
2025-09-30T14:57:05.812553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:05.812558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:05.812545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2442
2025-09-30T14:57:05.812569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2442
2025-09-30T14:57:05.812790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:05.812800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:05.812828Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4723926-3c10f86c-a2b0aac9-131bf7f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:05.812838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:05.812847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:05.812850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:05.812862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:05.812876Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:05.812895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:05.813043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:05.813051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:05.813064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:05.813180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2443 partition: 0 MaxSeqNo: 42 sessionId: src_id|a4723926-3c10f86c-a2b0aac9-131bf7f9_0
2025-09-30T14:57:05.813591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a265621a-87b2facc-85cb22af-be04404d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a4723926-3c10f86c-a2b0aac9-131bf7f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:05.816762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4723926-3c10f86c-a2b0aac9-131bf7f9_0] Write session: try to update token
2025-09-30T14:57:05.816788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4723926-3c10f86c-a2b0aac9-131bf7f9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:05.825390Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:05.825413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:05.825428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896413979359113:11172]
2025-09-30T14:57:05.825478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:05.825485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:05.825671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:05.825861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:05.826033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:05.826210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:05.826566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:05.826627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:05.834439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2443 sessionId: src_id|a4723926-3c10f86c-a2b0aac9-131bf7f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:05.837467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:05.837713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:05.837741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:05.837790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:05.837880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:05.839394Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:05.839411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:05.839413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:05.839415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:05.839425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896413979359113:11172]
2025-09-30T14:57:05.839430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896413979359113:11172]
2025-09-30T14:57:05.839433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896413979359113:11172]
2025-09-30T14:57:05.839475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:05.839482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:05.839486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:05.839489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:05.839489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:05.839493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:05.839641Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:05.875333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896414069146626:10294]
2025-09-30T14:57:05.882186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2442, pipe: [1:7555896414069146626:10294]
2025-09-30T14:57:05.954763Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:05.964277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:05.964310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:05.964533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:05.964623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:05.964707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:05.964784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:05.964832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:05.964844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:05.964922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:05.964996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:05.965067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:05.965154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:05.965223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:05.965227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:05.965316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:05.965388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:05.965456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:05.965530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:05.965602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:05.965613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:05.965701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:05.965784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:05.965859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:05.965934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:05.965986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:05.965995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:05.966074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:05.966150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:05.966221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:05.966298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:05.966347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:05.966354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:05.966426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:05.966496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:05.966566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:05.966640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:05.966694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:05.966701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:05.966784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:05.966847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:05.966915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:05.966987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:05.967045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:05.967052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:05.967144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:05.967270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:05.967347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:05.967427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:05.967482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:05.967490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:05.967574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:05.967671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:05.969611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:05.969682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:05.969685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:05.969721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2443 reason: error at write: Disconnected sessionId: src_id|a4723926-3c10f86c-a2b0aac9-131bf7f9_0
2025-09-30T14:57:05.970025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2443 sessionId: src_id|a4723926-3c10f86c-a2b0aac9-131bf7f9_0 is DEAD
2025-09-30T14:57:05.970033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896414069146626:10294]
2025-09-30T14:57:05.970121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4723926-3c10f86c-a2b0aac9-131bf7f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:05.970140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4723926-3c10f86c-a2b0aac9-131bf7f9_0] Write session will restart in 0.007827s
2025-09-30T14:57:05.970166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4723926-3c10f86c-a2b0aac9-131bf7f9_0] Write session: Do CDS request
2025-09-30T14:57:05.967787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:05.970173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4723926-3c10f86c-a2b0aac9-131bf7f9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:05.967907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:05.967994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:05.967998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:05.968110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:05.968215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:05.968313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:05.968428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:05.968510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:05.968514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:05.968609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896414069146626:10294], now have 1 active actors on pipe
2025-09-30T14:57:05.970169Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:05.978734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4723926-3c10f86c-a2b0aac9-131bf7f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:05.979080Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:05.979097Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2444
2025-09-30T14:57:05.979276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2444 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:05.979327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2444 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:05.979342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2444 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:05.979370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:05.979997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2444 sessionId:  describe result for acl check
2025-09-30T14:57:05.980052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:05.980054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:05.980056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:05.980062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896414069146663:10532] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:05.980658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896414069146663:10532] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:05.985033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896414069146663:10532] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:05.990159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896414069146663:10532] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:05.990179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896414069146663:10532] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:05.990184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896414069146663:10532] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:05.990194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2444 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:06.006330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:06.009524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:06.009780Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:06.009791Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:06.009803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:06.009867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:06.009924Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896418274326710:11176]
2025-09-30T14:57:06.010614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:06.011007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:06.011058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:06.011416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:06.011506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:06.011512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:06.011514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:06.011516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:06.011517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:06.011519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:06.011520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:06.011522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:06.011524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:06.011525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:06.011527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.011529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.011530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.011532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:06.011533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:06.011540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:06.011553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:06.011558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:06.011563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:06.011567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:06.011571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:06.011576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:06.011580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:06.011585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:06.011590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:06.011594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.011599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.011604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.011608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:06.011613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:06.011623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:06.011636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:06.011647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:06.011653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:06.011659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:06.011665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:06.011671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:06.011682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:06.011689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:06.011699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:06.011707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:06.011717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:06.011724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:06.011734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:06.011744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:06.011750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:06.011769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:06.011779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:06.011785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:06.011793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:06.011801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.011808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.011816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.011822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.011830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.011839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.011848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:06.011855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:06.011864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:06.011873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:06.011923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:06.018100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:06.019541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:06.019560Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:06.019563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:06.019568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:06.019577Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2443 [2:7555896418274326710:11176]
2025-09-30T14:57:06.019597Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:06.019617Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:06.019620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:06.019625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:06.019627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:06.019646Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:06.019658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:06.019669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:06.019741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.019747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.019750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.019755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:06.019758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:06.019839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:06.019847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.019864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.019882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.019906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:06.019930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896414069146840:10532], now have 1 active actors on pipe
2025-09-30T14:57:06.019938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896414069146630:2454], now have 1 active actors on pipe
2025-09-30T14:57:06.019944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896418274326705:11176]
2025-09-30T14:57:06.019947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896418274326705:11176]
2025-09-30T14:57:06.019950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896418274326705:11176]
2025-09-30T14:57:06.019967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:06.019984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:06.019986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:06.019990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:06.019992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:06.020007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:06.020011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:06.020054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896418274326705:11176]
2025-09-30T14:57:06.020066Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:06.020080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:06.020111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:06.020122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:06.020050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2443
2025-09-30T14:57:06.020153Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c9146fb-8cb5030f-cbf37976-36a5c5ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:06.020105Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2443
2025-09-30T14:57:06.020163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:06.020167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:06.020169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:06.020182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:06.020193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:06.020214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:06.020448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:06.020456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:06.020472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:06.020614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2444 partition: 0 MaxSeqNo: 42 sessionId: src_id|9c9146fb-8cb5030f-cbf37976-36a5c5ed_0
2025-09-30T14:57:06.021017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4723926-3c10f86c-a2b0aac9-131bf7f9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9c9146fb-8cb5030f-cbf37976-36a5c5ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:06.024199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c9146fb-8cb5030f-cbf37976-36a5c5ed_0] Write session: try to update token
2025-09-30T14:57:06.024223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c9146fb-8cb5030f-cbf37976-36a5c5ed_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:06.034221Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:06.034247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:06.034250Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:06.034252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:06.034263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896418274326705:11176]
2025-09-30T14:57:06.034268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896418274326705:11176]
2025-09-30T14:57:06.034272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896418274326705:11176]
2025-09-30T14:57:06.034321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:06.034328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.034331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:06.034344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:06.034351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:06.034355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:06.034500Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:06.047024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2444 sessionId: src_id|9c9146fb-8cb5030f-cbf37976-36a5c5ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:06.050164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:06.070176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896418364114351:10294]
2025-09-30T14:57:06.070435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2443, pipe: [1:7555896418364114351:10294]
2025-09-30T14:57:06.152162Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:06.152944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:06.152962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:06.152983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896418364114351:10294], now have 1 active actors on pipe
2025-09-30T14:57:06.153267Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:06.153274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896418364114351:10294]
2025-09-30T14:57:06.153323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:06.153329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:06.153392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2444 reason: error at write: Disconnected sessionId: src_id|9c9146fb-8cb5030f-cbf37976-36a5c5ed_0
2025-09-30T14:57:06.153581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2444 sessionId: src_id|9c9146fb-8cb5030f-cbf37976-36a5c5ed_0 is DEAD
2025-09-30T14:57:06.153775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c9146fb-8cb5030f-cbf37976-36a5c5ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:06.153783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c9146fb-8cb5030f-cbf37976-36a5c5ed_0] Write session will restart in 0.008788s
2025-09-30T14:57:06.153809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c9146fb-8cb5030f-cbf37976-36a5c5ed_0] Write session: Do CDS request
2025-09-30T14:57:06.153815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c9146fb-8cb5030f-cbf37976-36a5c5ed_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:06.153762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:06.163874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c9146fb-8cb5030f-cbf37976-36a5c5ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:06.163963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:06.163981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2445
2025-09-30T14:57:06.164231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2445 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:06.164280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2445 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:06.164294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2445 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:06.164299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:06.164777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2445 sessionId:  describe result for acl check
2025-09-30T14:57:06.164812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:06.164818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:06.164820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:06.164826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896418364114416:10544] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:06.165408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896418364114416:10544] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:06.168435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896418364114416:10544] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:06.173111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896418364114416:10544] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:06.173130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896418364114416:10544] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:06.173134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896418364114416:10544] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:06.173143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2445 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:06.183015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:06.186664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:06.186929Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:06.186942Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:06.186955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:06.187026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:06.187078Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896418274327028:11190]
2025-09-30T14:57:06.187769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:06.188232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:06.188283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:06.188617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:06.188684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:06.188689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:06.188691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:06.188692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:06.188693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:06.188694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:06.188695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:06.188696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:06.188698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:06.188699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:06.188700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.188702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.188703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.188704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:06.188705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:06.188711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:06.188722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:06.188726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:06.188730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:06.188734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:06.188738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:06.188742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:06.188746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:06.188749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:06.188753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:06.188757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.188761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.188765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.188769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:06.188772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:06.188781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:06.188790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:06.188796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:06.188801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:06.188807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:06.188812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:06.188817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:06.188822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:06.188827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:06.188831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:06.188835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:06.188840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:06.188845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:06.188850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:06.188854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:06.188860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:06.188865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:06.188872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:06.188876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:06.188880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:06.188885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.188889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.188894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.188899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.188903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.188908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.188912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:06.188917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:06.188922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:06.188926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:06.188969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:06.200464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:06.201470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:06.201489Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:06.201493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:06.201498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:06.201505Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2444 [2:7555896418274327028:11190]
2025-09-30T14:57:06.201525Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:06.201543Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:06.201552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:06.201556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:06.201558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:06.201578Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:06.201594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:06.201601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:06.201677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.201679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.201682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.201685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:06.201688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:06.201769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:06.201773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.201787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.201800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.201816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:06.201833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896418274327023:11190]
2025-09-30T14:57:06.201837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896418274327023:11190]
2025-09-30T14:57:06.201839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896418274327023:11190]
2025-09-30T14:57:06.201849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:06.201866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:06.201880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:06.201883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:06.201883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:06.201890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:06.201893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:06.201898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896418364114608:10544], now have 1 active actors on pipe
2025-09-30T14:57:06.201903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896418364114377:2454], now have 1 active actors on pipe
2025-09-30T14:57:06.201950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896418274327023:11190]
2025-09-30T14:57:06.201961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:06.201986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:06.203427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2444
2025-09-30T14:57:06.203466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2444
2025-09-30T14:57:06.203748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:06.203789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:06.203847Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|713f9e92-78da968-c7817cc1-962c0545_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:06.203880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:06.203894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:06.203898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:06.203924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:06.203954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:06.203985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:06.204695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:06.204713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:06.204743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:06.204864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2445 partition: 0 MaxSeqNo: 42 sessionId: src_id|713f9e92-78da968-c7817cc1-962c0545_0
2025-09-30T14:57:06.206180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c9146fb-8cb5030f-cbf37976-36a5c5ed_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|713f9e92-78da968-c7817cc1-962c0545_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:06.209153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|713f9e92-78da968-c7817cc1-962c0545_0] Write session: try to update token
2025-09-30T14:57:06.209194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|713f9e92-78da968-c7817cc1-962c0545_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:06.217995Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:06.218015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:06.218018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:06.218021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:06.218032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896418274327023:11190]
2025-09-30T14:57:06.218037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896418274327023:11190]
2025-09-30T14:57:06.218044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896418274327023:11190]
2025-09-30T14:57:06.218097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:06.218106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.218109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:06.218117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:06.218129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:06.218134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:06.218309Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:06.227564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2445 sessionId: src_id|713f9e92-78da968-c7817cc1-962c0545_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:06.231152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:06.253557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896418364114792:10294]
2025-09-30T14:57:06.253972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2444, pipe: [1:7555896418364114792:10294]
2025-09-30T14:57:06.347008Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:06.347570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:06.347590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:06.347621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896418364114792:10294], now have 1 active actors on pipe
2025-09-30T14:57:06.348019Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:06.348523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896418364114792:10294]
2025-09-30T14:57:06.348593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:06.348678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2445 reason: status is not ok: tablet will be restarted right now sessionId: src_id|713f9e92-78da968-c7817cc1-962c0545_0
2025-09-30T14:57:06.348862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2445 sessionId: src_id|713f9e92-78da968-c7817cc1-962c0545_0 is DEAD
2025-09-30T14:57:06.349019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|713f9e92-78da968-c7817cc1-962c0545_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:06.349036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|713f9e92-78da968-c7817cc1-962c0545_0] Write session will restart in 0.005930s
2025-09-30T14:57:06.349070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|713f9e92-78da968-c7817cc1-962c0545_0] Write session: Do CDS request
2025-09-30T14:57:06.349076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|713f9e92-78da968-c7817cc1-962c0545_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:06.349094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:06.359958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|713f9e92-78da968-c7817cc1-962c0545_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:06.359983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:06.360008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2446
2025-09-30T14:57:06.360213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2446 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:06.360255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2446 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:06.360269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2446 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:06.360275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:06.360778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2446 sessionId:  describe result for acl check
2025-09-30T14:57:06.360818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:06.360828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:06.360830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:06.360836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896418364114811:10549] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:06.361469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896418364114811:10549] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:06.370231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896418364114811:10549] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:06.376057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896418364114811:10549] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:06.376081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896418364114811:10549] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:06.376085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896418364114811:10549] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:06.376096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2446 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:06.382999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:06.387499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:06.387825Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:06.387841Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:06.387860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:06.387942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:06.388013Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896418274327311:11192]
2025-09-30T14:57:06.388827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:06.389491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:06.389570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:06.390020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:06.390119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:06.390127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:06.390128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:06.390130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:06.390132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:06.390133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:06.390135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:06.390137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:06.390138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:06.390140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:06.390141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.390143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.390145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.390146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:06.390148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:06.390156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:06.390170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:06.390174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:06.390179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:06.390183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:06.390188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:06.390193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:06.390197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:06.390202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:06.390207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:06.390212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.390216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.390220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.390225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:06.390230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:06.390241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:06.390251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:06.390258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:06.390265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:06.390270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:06.390276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:06.390282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:06.390288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:06.390294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:06.390301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:06.390307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:06.390313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:06.390318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:06.390323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:06.390337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:06.390348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:06.390354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:06.390377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:06.390383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:06.390389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:06.390395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.390401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.390406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.390412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.390422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.390428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.390434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:06.390444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:06.390460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:06.390474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:06.390524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:06.401429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:06.403915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:06.403938Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:06.403942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:06.403946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:06.403955Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2445 [2:7555896418274327311:11192]
2025-09-30T14:57:06.403982Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:06.404005Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:06.404011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:06.404015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:06.404018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:06.404041Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:06.404059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:06.404069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:06.404172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.404181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.404184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.404188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:06.404192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:06.404293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:06.404301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.404325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.404343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.404367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:06.404400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896418274327306:11192]
2025-09-30T14:57:06.404403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896418274327306:11192]
2025-09-30T14:57:06.404406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896418274327306:11192]
2025-09-30T14:57:06.404418Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:06.404437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:06.404454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:06.404462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:06.404465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:06.404483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:06.404486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:06.404526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896418364115090:10549], now have 1 active actors on pipe
2025-09-30T14:57:06.404534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896418364114797:2454], now have 1 active actors on pipe
2025-09-30T14:57:06.404536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896418274327306:11192]
2025-09-30T14:57:06.404546Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:06.404569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:06.404614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2445
2025-09-30T14:57:06.404618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2445
2025-09-30T14:57:06.404975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:06.404990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:06.405026Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9a3c57d-76ab522-7e1e4fca-7c562bf5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:06.405057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:06.405063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:06.405067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:06.405083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:06.405097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:06.405120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:06.405353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:06.405365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:06.405398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:06.405503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2446 partition: 0 MaxSeqNo: 42 sessionId: src_id|d9a3c57d-76ab522-7e1e4fca-7c562bf5_0
2025-09-30T14:57:06.407400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|713f9e92-78da968-c7817cc1-962c0545_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d9a3c57d-76ab522-7e1e4fca-7c562bf5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:06.410437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9a3c57d-76ab522-7e1e4fca-7c562bf5_0] Write session: try to update token
2025-09-30T14:57:06.410465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9a3c57d-76ab522-7e1e4fca-7c562bf5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:06.419219Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:06.419241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:06.419258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:06.419260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:06.419272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896418274327306:11192]
2025-09-30T14:57:06.419278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896418274327306:11192]
2025-09-30T14:57:06.419285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896418274327306:11192]
2025-09-30T14:57:06.419340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:06.419347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.419349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:06.419375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:06.419400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:06.419406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:06.419538Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:06.434476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2446 sessionId: src_id|d9a3c57d-76ab522-7e1e4fca-7c562bf5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:06.437440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:06.448610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896418364115210:10294]
2025-09-30T14:57:06.450272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2445, pipe: [1:7555896418364115210:10294]
2025-09-30T14:57:06.547001Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:06.548590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:06.548615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:06.548639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896418364115210:10294], now have 1 active actors on pipe
2025-09-30T14:57:06.548984Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:06.549299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:06.549390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2446 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d9a3c57d-76ab522-7e1e4fca-7c562bf5_0
2025-09-30T14:57:06.549571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2446 sessionId: src_id|d9a3c57d-76ab522-7e1e4fca-7c562bf5_0 is DEAD
2025-09-30T14:57:06.549721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896418364115210:10294]
2025-09-30T14:57:06.549735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:06.551351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9a3c57d-76ab522-7e1e4fca-7c562bf5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:06.551366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9a3c57d-76ab522-7e1e4fca-7c562bf5_0] Write session will restart in 0.006295s
2025-09-30T14:57:06.551394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9a3c57d-76ab522-7e1e4fca-7c562bf5_0] Write session: Do CDS request
2025-09-30T14:57:06.551401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9a3c57d-76ab522-7e1e4fca-7c562bf5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:06.558894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9a3c57d-76ab522-7e1e4fca-7c562bf5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:06.559308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:06.559326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2447
2025-09-30T14:57:06.559584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2447 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:06.559634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2447 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:06.559646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2447 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:06.559651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:06.560197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2447 sessionId:  describe result for acl check
2025-09-30T14:57:06.560235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:06.560240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:06.560247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:06.560253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896418364115228:10553] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:06.560896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896418364115228:10553] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:06.566601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896418364115228:10553] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:06.574342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896418364115228:10553] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:06.574369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896418364115228:10553] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:06.574372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896418364115228:10553] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:06.574382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2447 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:06.597764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:06.602123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:06.602408Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:06.602420Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:06.602433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:06.602500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:06.602553Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896418274327597:11195]
2025-09-30T14:57:06.603234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:06.603691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:06.603780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:06.604193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:06.604279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:06.604281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:06.604283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:06.604284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:06.604285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:06.604288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:06.604289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:06.604291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:06.604292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:06.604293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:06.604295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.604296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.604298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.604299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:06.604301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:06.604308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:06.604320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:06.604325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:06.604330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:06.604335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:06.604339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:06.604344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:06.604348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:06.604353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:06.604358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:06.604362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.604367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.604371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.604376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:06.604380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:06.604390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:06.604400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:06.604408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:06.604415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:06.604422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:06.604429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:06.604434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:06.604441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:06.604446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:06.604453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:06.604458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:06.604465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:06.604471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:06.604478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:06.604482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:06.604488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:06.604494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:06.604500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:06.604505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:06.604512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:06.604517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.604524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.604529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.604537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.604543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.604549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.604555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:06.604561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:06.604566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:06.604572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:06.604625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:06.611057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:06.612099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:06.612119Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:06.612123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:06.612128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:06.612137Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2446 [2:7555896418274327597:11195]
2025-09-30T14:57:06.612157Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:06.612177Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:06.612181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:06.612184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:06.612187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:06.612207Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:06.612221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:06.612229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:06.612303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.612312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.612315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.612319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:06.612323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:06.612954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:06.612966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.612983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.613004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.613032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:06.613062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896418364115213:2454], now have 1 active actors on pipe
2025-09-30T14:57:06.613072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896418364115388:10553], now have 1 active actors on pipe
2025-09-30T14:57:06.613080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896418274327592:11195]
2025-09-30T14:57:06.613088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896418274327592:11195]
2025-09-30T14:57:06.613091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896418274327592:11195]
2025-09-30T14:57:06.613106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:06.613124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:06.613130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:06.613133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:06.613135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:06.613147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:06.613151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:06.613207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896418274327592:11195]
2025-09-30T14:57:06.613223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:06.613229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:06.614739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2446
2025-09-30T14:57:06.614795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2446
2025-09-30T14:57:06.614832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:06.614850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:06.614894Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83ec033a-57f42097-ff81a706-eabf1fc3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:06.614906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:06.614912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:06.614915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:06.614931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:06.614950Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:06.614978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:06.615175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:06.615184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:06.615201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:06.615365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2447 partition: 0 MaxSeqNo: 42 sessionId: src_id|83ec033a-57f42097-ff81a706-eabf1fc3_0
2025-09-30T14:57:06.615788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9a3c57d-76ab522-7e1e4fca-7c562bf5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|83ec033a-57f42097-ff81a706-eabf1fc3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:06.618951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83ec033a-57f42097-ff81a706-eabf1fc3_0] Write session: try to update token
2025-09-30T14:57:06.618979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83ec033a-57f42097-ff81a706-eabf1fc3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:06.628015Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:06.628046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:06.628059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896418274327592:11195]
2025-09-30T14:57:06.628115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:06.628117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:06.628333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:06.628511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:06.628685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:06.628854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:06.629095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:06.629150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:06.638514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2447 sessionId: src_id|83ec033a-57f42097-ff81a706-eabf1fc3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:06.640063Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:06.640089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:06.640093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:06.640095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:06.640105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896418274327592:11195]
2025-09-30T14:57:06.640111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896418274327592:11195]
2025-09-30T14:57:06.640116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896418274327592:11195]
2025-09-30T14:57:06.640161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:06.640169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.640173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:06.640174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:06.640181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:06.640186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:06.642202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:06.640326Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:06.650170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896418364115626:10294]
2025-09-30T14:57:06.650844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2446, pipe: [1:7555896418364115626:10294]
2025-09-30T14:57:06.762689Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:06.763124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:06.763153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:06.763184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896418364115626:10294], now have 1 active actors on pipe
2025-09-30T14:57:06.763464Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:06.763472Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:06.763491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:06.763496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:06.763547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896418364115626:10294]
2025-09-30T14:57:06.763587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2447 reason: error at write: Disconnected sessionId: src_id|83ec033a-57f42097-ff81a706-eabf1fc3_0
2025-09-30T14:57:06.763806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2447 sessionId: src_id|83ec033a-57f42097-ff81a706-eabf1fc3_0 is DEAD
2025-09-30T14:57:06.763969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83ec033a-57f42097-ff81a706-eabf1fc3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:06.763981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83ec033a-57f42097-ff81a706-eabf1fc3_0] Write session will restart in 0.008988s
2025-09-30T14:57:06.764006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83ec033a-57f42097-ff81a706-eabf1fc3_0] Write session: Do CDS request
2025-09-30T14:57:06.764016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83ec033a-57f42097-ff81a706-eabf1fc3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:06.773814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83ec033a-57f42097-ff81a706-eabf1fc3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:06.773928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:06.773950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2448
2025-09-30T14:57:06.774170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2448 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:06.774218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2448 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:06.774225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2448 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:06.774229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:06.775307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2448 sessionId:  describe result for acl check
2025-09-30T14:57:06.775351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:06.775358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:06.775360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:06.775366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896418364115684:10558] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:06.775975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896418364115684:10558] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:06.780037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896418364115684:10558] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:06.784301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896418364115684:10558] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:06.784320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896418364115684:10558] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:06.784324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896418364115684:10558] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:06.784334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2448 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:06.793551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:06.796525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:06.796906Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:06.796918Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:06.796933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:06.797006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:06.797059Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896418274327882:11197]
2025-09-30T14:57:06.797747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:06.798092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:06.798142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:06.798507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:06.798585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:06.798593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:06.798594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:06.798596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:06.798597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:06.798598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:06.798599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:06.798601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:06.798602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:06.798603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:06.798605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.798606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.798607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.798609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:06.798610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:06.798616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:06.798626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:06.798630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:06.798635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:06.798638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:06.798642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:06.798646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:06.798650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:06.798653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:06.798660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:06.798665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.798669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.798673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.798677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:06.798681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:06.798691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:06.798699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:06.798705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:06.798710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:06.798716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:06.798722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:06.798727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:06.798733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:06.798744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:06.798749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:06.798754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:06.798760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:06.798767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:06.798777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:06.798781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:06.798786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:06.798793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:06.798798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:06.798803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:06.798808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:06.798813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.798820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.798829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.798835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.798850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.798860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.798866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:06.798885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:06.798893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:06.798899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:06.798942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:06.804887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:06.806314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:06.806332Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:06.806334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:06.806337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:06.806343Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2447 [2:7555896418274327882:11197]
2025-09-30T14:57:06.806356Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:06.806369Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:06.806372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:06.806373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:06.806375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:06.806389Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:06.806402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:06.806410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:06.806474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.806482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.806484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.806489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:06.806491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:06.806568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:06.806575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.806591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.806608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.806632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:06.806653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896418274327877:11197]
2025-09-30T14:57:06.806659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896418274327877:11197]
2025-09-30T14:57:06.806662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896418274327877:11197]
2025-09-30T14:57:06.806671Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:06.806685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:06.806688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:06.806697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:06.806700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:06.806707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:06.806711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:06.806722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896418364115631:2454], now have 1 active actors on pipe
2025-09-30T14:57:06.806733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896418364115882:10558], now have 1 active actors on pipe
2025-09-30T14:57:06.806770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896418274327877:11197]
2025-09-30T14:57:06.806782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:06.806820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:06.806812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2447
2025-09-30T14:57:06.806813Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2447
2025-09-30T14:57:06.807071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:06.807086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:06.807117Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c99a2ffa-212bd5ed-9f42db6d-e3fa22c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:06.807131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:06.807140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:06.807143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:06.807156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:06.807170Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:06.807192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:06.807451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:06.807462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:06.807485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:06.807606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2448 partition: 0 MaxSeqNo: 42 sessionId: src_id|c99a2ffa-212bd5ed-9f42db6d-e3fa22c0_0
2025-09-30T14:57:06.808086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83ec033a-57f42097-ff81a706-eabf1fc3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c99a2ffa-212bd5ed-9f42db6d-e3fa22c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:06.812424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c99a2ffa-212bd5ed-9f42db6d-e3fa22c0_0] Write session: try to update token
2025-09-30T14:57:06.812457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c99a2ffa-212bd5ed-9f42db6d-e3fa22c0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:06.819746Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:06.819766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:06.819769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:06.819772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:06.819782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896418274327877:11197]
2025-09-30T14:57:06.819788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896418274327877:11197]
2025-09-30T14:57:06.819792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896418274327877:11197]
2025-09-30T14:57:06.819836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:06.819841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:06.819846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.819848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:06.819850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:06.819852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:06.820012Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:06.830769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2448 sessionId: src_id|c99a2ffa-212bd5ed-9f42db6d-e3fa22c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:06.833638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:06.863828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896418364116047:10294]
2025-09-30T14:57:06.864142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2447, pipe: [1:7555896418364116047:10294]
2025-09-30T14:57:06.941023Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:06.941683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:06.941693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:06.941716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896418364116047:10294], now have 1 active actors on pipe
2025-09-30T14:57:06.942016Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:06.942037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:06.942042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:06.942087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896418364116047:10294]
2025-09-30T14:57:06.942105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2448 reason: error at write: Disconnected sessionId: src_id|c99a2ffa-212bd5ed-9f42db6d-e3fa22c0_0
2025-09-30T14:57:06.942282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2448 sessionId: src_id|c99a2ffa-212bd5ed-9f42db6d-e3fa22c0_0 is DEAD
2025-09-30T14:57:06.942027Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:06.943347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c99a2ffa-212bd5ed-9f42db6d-e3fa22c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:06.943360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c99a2ffa-212bd5ed-9f42db6d-e3fa22c0_0] Write session will restart in 0.009357s
2025-09-30T14:57:06.943390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c99a2ffa-212bd5ed-9f42db6d-e3fa22c0_0] Write session: Do CDS request
2025-09-30T14:57:06.943397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c99a2ffa-212bd5ed-9f42db6d-e3fa22c0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:06.953809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c99a2ffa-212bd5ed-9f42db6d-e3fa22c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:06.953930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:06.953947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2449
2025-09-30T14:57:06.954064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2449 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:06.954094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2449 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:06.954104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2449 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:06.954109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:06.954605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2449 sessionId:  describe result for acl check
2025-09-30T14:57:06.954639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:06.954647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:06.954649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:06.954655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896418364116067:10562] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:06.955217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896418364116067:10562] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:06.959427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896418364116067:10562] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:06.965638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896418364116067:10562] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:06.965659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896418364116067:10562] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:06.965664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896418364116067:10562] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:06.965673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2449 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:06.980472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:06.984034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:06.984453Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:06.984464Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:06.984487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:06.984564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:06.984614Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896418274328184:11199]
2025-09-30T14:57:06.985349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:06.985796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:06.985873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:06.986278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:06.986365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:06.986373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:06.986375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:06.986376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:06.986378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:06.986379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:06.986380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:06.986381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:06.986383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:06.986384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:06.986386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.986387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.986388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.986390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:06.986391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:06.986398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:06.986408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:06.986413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:06.986417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:06.986422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:06.986426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:06.986430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:06.986434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:06.986437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:06.986441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:06.986444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.986448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.986451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.986454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:06.986458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:06.986470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:06.986478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:06.986485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:06.986491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:06.986496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:06.986501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:06.986507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:06.986512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:06.986517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:06.986524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:06.986529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:06.986534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:06.986539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:06.986545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:06.986548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:06.986554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:06.986559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:06.986564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:06.986569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:06.986590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:06.986597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.986602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.986607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.986613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.986617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.986623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.986628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:06.986634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:06.986639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:06.986645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:06.986700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:06.992739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:06.994161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:06.994178Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:06.994181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:06.994186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:06.994193Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2448 [2:7555896418274328184:11199]
2025-09-30T14:57:06.994212Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:06.994228Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:06.994232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:06.994235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:06.994238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:06.994256Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:06.994264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:06.994272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:06.994343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.994346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.994348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.994351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:06.994355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:06.994436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:06.994439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:06.994456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:06.994479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:06.994499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:06.994522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896418274328178:11199]
2025-09-30T14:57:06.994531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896418274328178:11199]
2025-09-30T14:57:06.994533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896418274328178:11199]
2025-09-30T14:57:06.994543Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:06.994562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:06.994564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:06.994567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:06.994569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:06.994583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:06.994586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:06.994598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896418364116048:2454], now have 1 active actors on pipe
2025-09-30T14:57:06.994602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896418364116258:10562], now have 1 active actors on pipe
2025-09-30T14:57:06.994640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896418274328178:11199]
2025-09-30T14:57:06.994656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:06.994743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:06.994859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2448
2025-09-30T14:57:06.994903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2448
2025-09-30T14:57:06.995089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:06.995102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:06.995131Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79b58c0-cb551b1d-43da8065-f43f6a33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:06.995139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:06.995143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:06.995146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:06.995157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:06.995168Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:06.995184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:06.995368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:06.995378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:06.995398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:06.996210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2449 partition: 0 MaxSeqNo: 42 sessionId: src_id|79b58c0-cb551b1d-43da8065-f43f6a33_0
2025-09-30T14:57:06.996706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c99a2ffa-212bd5ed-9f42db6d-e3fa22c0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|79b58c0-cb551b1d-43da8065-f43f6a33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:06.999612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79b58c0-cb551b1d-43da8065-f43f6a33_0] Write session: try to update token
2025-09-30T14:57:06.999634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79b58c0-cb551b1d-43da8065-f43f6a33_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:07.009504Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:07.009523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:07.009532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896418274328178:11199]
2025-09-30T14:57:07.009583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:07.009590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:07.009775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:07.009934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:07.010088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:07.010254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:07.010476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:07.010521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:07.020892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2449 sessionId: src_id|79b58c0-cb551b1d-43da8065-f43f6a33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:07.021045Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:07.021077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:07.021081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:07.021084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:07.021096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896418274328178:11199]
2025-09-30T14:57:07.021101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896418274328178:11199]
2025-09-30T14:57:07.021107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896418274328178:11199]
2025-09-30T14:57:07.021196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:07.021213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.021216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:07.021217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:07.021222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:07.021228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:07.021443Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:07.023995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:07.042497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896422659083760:10294]
2025-09-30T14:57:07.042893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2448, pipe: [1:7555896422659083760:10294]
2025-09-30T14:57:07.142274Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:07.142958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:07.142977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:07.142998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896422659083760:10294], now have 1 active actors on pipe
2025-09-30T14:57:07.143363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:07.143378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:07.143449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2449 reason: error at write: Disconnected sessionId: src_id|79b58c0-cb551b1d-43da8065-f43f6a33_0
2025-09-30T14:57:07.143648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2449 sessionId: src_id|79b58c0-cb551b1d-43da8065-f43f6a33_0 is DEAD
2025-09-30T14:57:07.143804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896422659083760:10294]
2025-09-30T14:57:07.143820Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:07.143398Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:07.144182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79b58c0-cb551b1d-43da8065-f43f6a33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:07.144194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79b58c0-cb551b1d-43da8065-f43f6a33_0] Write session will restart in 0.005062s
2025-09-30T14:57:07.144221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79b58c0-cb551b1d-43da8065-f43f6a33_0] Write session: Do CDS request
2025-09-30T14:57:07.144230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79b58c0-cb551b1d-43da8065-f43f6a33_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:07.150928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79b58c0-cb551b1d-43da8065-f43f6a33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:07.151149Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:07.151178Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2450
2025-09-30T14:57:07.151349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2450 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:07.151383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2450 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:07.151388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2450 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:07.151394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:07.151823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2450 sessionId:  describe result for acl check
2025-09-30T14:57:07.151862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:07.151864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:07.151866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:07.151880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896422659083802:10573] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:07.152447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896422659083802:10573] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:07.155315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896422659083802:10573] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:07.158740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896422659083802:10573] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:07.158758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896422659083802:10573] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:07.158762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896422659083802:10573] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:07.158771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2450 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:07.186346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:07.190024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:07.190276Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:07.190289Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:07.190302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:07.190364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:07.190411Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896422569295804:11209]
2025-09-30T14:57:07.191111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:07.191551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:07.191609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:07.191993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:07.192064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:07.192076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:07.192078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:07.192079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:07.192081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:07.192083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:07.192084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:07.192086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:07.192088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:07.192090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:07.192091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.192093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:07.192094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:07.192095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:07.192100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:07.192107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:07.192119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:07.192124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:07.192128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:07.192132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:07.192138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:07.192142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:07.192146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:07.192151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:07.192157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:07.192161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.192166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:07.192170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:07.192174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:07.192179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:07.192189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:07.192198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:07.192207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:07.192213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:07.192218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:07.192224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:07.192229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:07.192235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:07.192241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:07.192247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:07.192252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:07.192257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:07.192263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:07.192268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:07.192274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:07.192282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:07.192292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:07.192298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:07.192302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:07.192316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:07.192321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.192333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.192338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:07.192349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:07.192354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:07.192365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:07.192370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:07.192381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:07.192386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:07.192397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:07.192447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:07.201401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2449
2025-09-30T14:57:07.201405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2449
2025-09-30T14:57:07.199562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:07.200872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:07.200880Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:07.200883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:07.200888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:07.200897Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2449 [2:7555896422569295804:11209]
2025-09-30T14:57:07.200916Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:07.200932Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:07.200941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:07.200945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:07.200947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:07.200965Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:07.200973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:07.200981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:07.201050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.201052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:07.201055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:07.201058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:07.201062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:07.201146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:07.201150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.201182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:07.201196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:07.201215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:07.201236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896422659083898:10573], now have 1 active actors on pipe
2025-09-30T14:57:07.201244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896422569295787:11209]
2025-09-30T14:57:07.201246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896422569295787:11209]
2025-09-30T14:57:07.201249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896422569295787:11209]
2025-09-30T14:57:07.201263Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:07.201278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896422659083779:2454], now have 1 active actors on pipe
2025-09-30T14:57:07.201280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:07.201285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:07.201287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:07.201287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:07.201305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:07.201310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:07.201354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896422569295787:11209]
2025-09-30T14:57:07.201368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:07.201430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:07.201707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:07.201716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:07.201745Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2da31ee8-ebbf2a5-82674cd3-ddfefc6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:07.201755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:07.201762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:07.201765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:07.201778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:07.201792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:07.201811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:07.202143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:07.202155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:07.202174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:07.203636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79b58c0-cb551b1d-43da8065-f43f6a33_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2da31ee8-ebbf2a5-82674cd3-ddfefc6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:07.202328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2450 partition: 0 MaxSeqNo: 42 sessionId: src_id|2da31ee8-ebbf2a5-82674cd3-ddfefc6_0
2025-09-30T14:57:07.206710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2da31ee8-ebbf2a5-82674cd3-ddfefc6_0] Write session: try to update token
2025-09-30T14:57:07.206732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2da31ee8-ebbf2a5-82674cd3-ddfefc6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:07.217956Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:07.217982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:07.217984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:07.217987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:07.217997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896422569295787:11209]
2025-09-30T14:57:07.218003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896422569295787:11209]
2025-09-30T14:57:07.218007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896422569295787:11209]
2025-09-30T14:57:07.218050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:07.218058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.218061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:07.218072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:07.218081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:07.218087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:07.218220Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:07.234176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2450 sessionId: src_id|2da31ee8-ebbf2a5-82674cd3-ddfefc6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:07.237476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:07.243774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896422659084218:10294]
2025-09-30T14:57:07.244202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2449, pipe: [1:7555896422659084218:10294]
2025-09-30T14:57:07.343990Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:07.344363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:07.344372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:07.344393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896422659084218:10294], now have 1 active actors on pipe
2025-09-30T14:57:07.345123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896422659084218:10294]
2025-09-30T14:57:07.345175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:07.345247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2450 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2da31ee8-ebbf2a5-82674cd3-ddfefc6_0
2025-09-30T14:57:07.345423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2450 sessionId: src_id|2da31ee8-ebbf2a5-82674cd3-ddfefc6_0 is DEAD
2025-09-30T14:57:07.345563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:07.345869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2da31ee8-ebbf2a5-82674cd3-ddfefc6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:07.345878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2da31ee8-ebbf2a5-82674cd3-ddfefc6_0] Write session will restart in 0.006049s
2025-09-30T14:57:07.345901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2da31ee8-ebbf2a5-82674cd3-ddfefc6_0] Write session: Do CDS request
2025-09-30T14:57:07.345908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2da31ee8-ebbf2a5-82674cd3-ddfefc6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:07.344817Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:07.352925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2da31ee8-ebbf2a5-82674cd3-ddfefc6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:07.353031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:07.353048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2451
2025-09-30T14:57:07.353218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2451 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:07.353254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2451 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:07.353260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2451 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:07.353265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:07.353724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2451 sessionId:  describe result for acl check
2025-09-30T14:57:07.353752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:07.353754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:07.353756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:07.353762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896422659084238:10579] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:07.354342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896422659084238:10579] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:07.356713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896422659084238:10579] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:07.362830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896422659084238:10579] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:07.362852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896422659084238:10579] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:07.362856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896422659084238:10579] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:07.362865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2451 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:07.372016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:07.374249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:07.374531Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:07.374545Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:07.374557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:07.374618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:07.374662Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896422569296093:11217]
2025-09-30T14:57:07.375197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:07.375602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:07.375662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:07.376069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:07.376146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:07.376154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:07.376155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:07.376157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:07.376159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:07.376160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:07.376162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:07.376164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:07.376165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:07.376166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:07.376168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.376170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:07.376171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:07.376172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:07.376174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:07.376180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:07.376192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:07.376197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:07.376202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:07.376206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:07.376211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:07.376216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:07.376220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:07.376225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:07.376230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:07.376234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.376239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:07.376244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:07.376249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:07.376253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:07.376261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:07.376269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:07.376277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:07.376283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:07.376289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:07.376295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:07.376301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:07.376308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:07.376314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:07.376321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:07.376327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:07.376333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:07.376339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:07.376345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:07.376351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:07.376357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:07.376381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:07.376388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:07.376393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:07.376405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:07.376412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.376423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.376431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:07.376441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:07.376447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:07.376457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:07.376462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:07.376474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:07.376485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:07.376491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:07.376550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:07.382402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:07.384062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:07.384081Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:07.384084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:07.384089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:07.384097Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2450 [2:7555896422569296093:11217]
2025-09-30T14:57:07.384118Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:07.384143Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:07.384148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:07.384151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:07.384154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:07.384172Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:07.384181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:07.384189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:07.384263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.384274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:07.384276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:07.384280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:07.384283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:07.384360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:07.384370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.384385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:07.384404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:07.384423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:07.384445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896422569296088:11217]
2025-09-30T14:57:07.384453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896422569296088:11217]
2025-09-30T14:57:07.384455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896422569296088:11217]
2025-09-30T14:57:07.384465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:07.384475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:07.384478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:07.384480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:07.384485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:07.384584Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2450
2025-09-30T14:57:07.384610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2450
2025-09-30T14:57:07.384501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:07.384512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:07.384522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896422659084488:10579], now have 1 active actors on pipe
2025-09-30T14:57:07.384527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896422659084223:2454], now have 1 active actors on pipe
2025-09-30T14:57:07.384567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896422569296088:11217]
2025-09-30T14:57:07.384575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:07.384580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:07.384631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:07.384636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:07.384667Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0eba475-1fa90370-99cdc3bc-563476b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:07.384675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:07.384680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:07.384682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:07.384693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:07.384704Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:07.384720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:07.384870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:07.384880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:07.384893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:07.384988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2451 partition: 0 MaxSeqNo: 42 sessionId: src_id|e0eba475-1fa90370-99cdc3bc-563476b2_0
2025-09-30T14:57:07.385392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2da31ee8-ebbf2a5-82674cd3-ddfefc6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e0eba475-1fa90370-99cdc3bc-563476b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:07.388468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0eba475-1fa90370-99cdc3bc-563476b2_0] Write session: try to update token
2025-09-30T14:57:07.388489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0eba475-1fa90370-99cdc3bc-563476b2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:07.397980Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:07.398003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:07.398013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896422569296088:11217]
2025-09-30T14:57:07.398068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:07.398075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:07.398263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:07.398428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:07.398597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:07.398759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:07.398975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:07.399029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:07.405146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2451 sessionId: src_id|e0eba475-1fa90370-99cdc3bc-563476b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:07.408335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:07.409054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:07.409079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:07.409099Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:07.409102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:07.409104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:07.409107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:07.409116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896422569296088:11217]
2025-09-30T14:57:07.409121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896422569296088:11217]
2025-09-30T14:57:07.409125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896422569296088:11217]
2025-09-30T14:57:07.409175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:07.409184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:07.409191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:07.409191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.409193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:07.409195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:07.409333Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:07.445452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896422659084641:10294]
2025-09-30T14:57:07.445784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2450, pipe: [1:7555896422659084641:10294]
2025-09-30T14:57:07.521407Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:07.522169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:07.522214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896422659084641:10294], now have 1 active actors on pipe
2025-09-30T14:57:07.522298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:07.522417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896422659084641:10294]
2025-09-30T14:57:07.522449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:07.535457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:07.535478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:07.535505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2451 reason: error at write: Disconnected sessionId: src_id|e0eba475-1fa90370-99cdc3bc-563476b2_0
2025-09-30T14:57:07.535685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2451 sessionId: src_id|e0eba475-1fa90370-99cdc3bc-563476b2_0 is DEAD
2025-09-30T14:57:07.535845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0eba475-1fa90370-99cdc3bc-563476b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:07.535857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0eba475-1fa90370-99cdc3bc-563476b2_0] Write session will restart in 0.009104s
2025-09-30T14:57:07.535889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0eba475-1fa90370-99cdc3bc-563476b2_0] Write session: Do CDS request
2025-09-30T14:57:07.535896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0eba475-1fa90370-99cdc3bc-563476b2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:07.545839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0eba475-1fa90370-99cdc3bc-563476b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:07.545942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:07.545960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2452
2025-09-30T14:57:07.546129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2452 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:07.546167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2452 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:07.546188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2452 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:07.546198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:07.547199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2452 sessionId:  describe result for acl check
2025-09-30T14:57:07.547260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:07.547267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:07.547269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:07.547275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896422659084838:10583] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:07.547805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896422659084838:10583] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:07.551427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896422659084838:10583] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:07.554534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896422659084838:10583] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:07.554550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896422659084838:10583] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:07.554554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896422659084838:10583] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:07.554564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2452 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:07.560393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:07.563719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:07.563949Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:07.563959Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:07.563967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:07.564022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:07.564070Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896422569296385:11220]
2025-09-30T14:57:07.564737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:07.565124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:07.565198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:07.565550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:07.565651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:07.565653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:07.565654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:07.565655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:07.565656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:07.565657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:07.565659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:07.565660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:07.565661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:07.565663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:07.565665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.565666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:07.565667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:07.565669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:07.565670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:07.565677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:07.565688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:07.565693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:07.565697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:07.565702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:07.565707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:07.565711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:07.565715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:07.565719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:07.565724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:07.565728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.565731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:07.565734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:07.565738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:07.565741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:07.565751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:07.565759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:07.565766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:07.565771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:07.565777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:07.565783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:07.565787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:07.565793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:07.565798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:07.565803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:07.565809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:07.565814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:07.565820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:07.565825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:07.565830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:07.565835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:07.565840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:07.565846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:07.565852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:07.565857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:07.565864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.565869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.565874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:07.565880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:07.565893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:07.565898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:07.565903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:07.565908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:07.565913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:07.565919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:07.565969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:07.572816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:07.573901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:07.573919Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:07.573922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:07.573926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:07.573933Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2451 [2:7555896422569296385:11220]
2025-09-30T14:57:07.573954Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:07.573973Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:07.573981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:07.573985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:07.573987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:07.574005Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:07.574017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:07.574024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:07.574102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.574109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:07.574111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:07.574116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:07.574118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:07.574191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:07.574199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.574214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:07.574225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:07.574246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:07.574272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896422659085048:10583], now have 1 active actors on pipe
2025-09-30T14:57:07.574284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896422569296380:11220]
2025-09-30T14:57:07.574290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896422569296380:11220]
2025-09-30T14:57:07.574292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896422569296380:11220]
2025-09-30T14:57:07.574306Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:07.574322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896422659084643:2454], now have 1 active actors on pipe
2025-09-30T14:57:07.574322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:07.574326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:07.574329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:07.574338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:07.574352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:07.574356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:07.574393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896422569296380:11220]
2025-09-30T14:57:07.574400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:07.574406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:07.574441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2451
2025-09-30T14:57:07.574485Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2451
2025-09-30T14:57:07.574677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:07.574691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:07.574727Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9b9cb80-fa1a62ab-df04a5e-f22a76e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:07.574740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:07.574763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:07.574770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:07.574789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:07.574804Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:07.574827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:07.575013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:07.575031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:07.575048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:07.575135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2452 partition: 0 MaxSeqNo: 42 sessionId: src_id|c9b9cb80-fa1a62ab-df04a5e-f22a76e7_0
2025-09-30T14:57:07.575605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0eba475-1fa90370-99cdc3bc-563476b2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c9b9cb80-fa1a62ab-df04a5e-f22a76e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:07.578786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b9cb80-fa1a62ab-df04a5e-f22a76e7_0] Write session: try to update token
2025-09-30T14:57:07.578807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b9cb80-fa1a62ab-df04a5e-f22a76e7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:07.587432Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:07.587454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:07.587457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:07.587459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:07.587469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896422569296380:11220]
2025-09-30T14:57:07.587473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896422569296380:11220]
2025-09-30T14:57:07.587477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896422569296380:11220]
2025-09-30T14:57:07.587519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:07.587526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.587529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:07.587528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:07.587536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:07.587540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:07.587693Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:07.595566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2452 sessionId: src_id|c9b9cb80-fa1a62ab-df04a5e-f22a76e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:07.598521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:07.622616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896422659085062:10294]
2025-09-30T14:57:07.622992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2451, pipe: [1:7555896422659085062:10294]
2025-09-30T14:57:07.632670Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:11802 } ]
2025-09-30T14:57:07.703748Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:07.704301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:07.704308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:07.704327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896422659085062:10294], now have 1 active actors on pipe
2025-09-30T14:57:07.704631Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:07.705134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:07.705236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2452 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c9b9cb80-fa1a62ab-df04a5e-f22a76e7_0
2025-09-30T14:57:07.706388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b9cb80-fa1a62ab-df04a5e-f22a76e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:07.706402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b9cb80-fa1a62ab-df04a5e-f22a76e7_0] Write session will restart in 0.008719s
2025-09-30T14:57:07.705444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2452 sessionId: src_id|c9b9cb80-fa1a62ab-df04a5e-f22a76e7_0 is DEAD
2025-09-30T14:57:07.705638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896422659085062:10294]
2025-09-30T14:57:07.705652Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:07.706427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b9cb80-fa1a62ab-df04a5e-f22a76e7_0] Write session: Do CDS request
2025-09-30T14:57:07.706433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b9cb80-fa1a62ab-df04a5e-f22a76e7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:07.716846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b9cb80-fa1a62ab-df04a5e-f22a76e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:07.716987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:07.717005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2453
2025-09-30T14:57:07.717222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2453 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:07.717272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2453 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:07.717279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2453 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:07.717284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:07.718736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2453 sessionId:  describe result for acl check
2025-09-30T14:57:07.718785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:07.718787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:07.718789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:07.718796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896422659085119:10588] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:07.719393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896422659085119:10588] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:07.723847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896422659085119:10588] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:07.727039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896422659085119:10588] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:07.727059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896422659085119:10588] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:07.727062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896422659085119:10588] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:07.727072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2453 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:07.744471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:07.748890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:07.749605Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:07.749621Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:07.749637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:07.749714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:07.749773Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896422569296676:11222]
2025-09-30T14:57:07.750485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:07.750907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:07.750976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:07.751372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:07.751446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:07.751455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:07.751457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:07.751458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:07.751460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:07.751462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:07.751463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:07.751465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:07.751466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:07.751467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:07.751469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.751470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:07.751472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:07.751473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:07.751475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:07.751481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:07.751493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:07.751499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:07.751504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:07.751509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:07.751514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:07.751518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:07.751523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:07.751528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:07.751552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:07.751557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.751561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:07.751565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:07.751570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:07.751574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:07.751583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:07.751592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:07.751602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:07.751609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:07.751615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:07.751621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:07.751639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:07.751644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:07.751650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:07.751656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:07.751661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:07.751666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:07.751672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:07.751677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:07.751682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:07.751687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:07.751692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:07.751699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:07.751704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:07.751712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:07.751718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.751724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.751731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:07.751737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:07.751745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:07.751751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:07.751757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:07.751763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:07.751768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:07.751774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:07.751823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:07.762149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2452
2025-09-30T14:57:07.762203Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2452
2025-09-30T14:57:07.759905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:07.761645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:07.761655Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:07.761658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:07.761663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:07.761670Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2452 [2:7555896422569296676:11222]
2025-09-30T14:57:07.761690Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:07.761708Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:07.761712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:07.761715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:07.761716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:07.761736Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:07.761743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:07.761752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:07.761832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.761834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:07.761836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:07.761841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:07.761843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:07.761932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:07.761935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.761950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:07.761960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:07.761974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:07.761991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896422569296671:11222]
2025-09-30T14:57:07.761993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896422569296671:11222]
2025-09-30T14:57:07.761996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896422569296671:11222]
2025-09-30T14:57:07.762005Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:07.762020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896422659085066:2454], now have 1 active actors on pipe
2025-09-30T14:57:07.762024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896422659085270:10588], now have 1 active actors on pipe
2025-09-30T14:57:07.762032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:07.762031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:07.762036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:07.762039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:07.762047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:07.762051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:07.762091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896422569296671:11222]
2025-09-30T14:57:07.762102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:07.762108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:07.762344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:07.762350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:07.762381Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6fff3290-230ce3f9-c16e2fe3-5a788b45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:07.762389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:07.762394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:07.762395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:07.762408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:07.762420Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:07.762437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:07.762738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:07.762743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:07.762762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:07.762885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2453 partition: 0 MaxSeqNo: 42 sessionId: src_id|6fff3290-230ce3f9-c16e2fe3-5a788b45_0
2025-09-30T14:57:07.763319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b9cb80-fa1a62ab-df04a5e-f22a76e7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6fff3290-230ce3f9-c16e2fe3-5a788b45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:07.766345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fff3290-230ce3f9-c16e2fe3-5a788b45_0] Write session: try to update token
2025-09-30T14:57:07.766367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fff3290-230ce3f9-c16e2fe3-5a788b45_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:07.782552Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:07.782577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:07.782588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896422569296671:11222]
2025-09-30T14:57:07.782651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:07.782664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:07.782870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:07.783045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:07.783207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:07.783543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:07.783750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:07.783788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:07.787229Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:07.787236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:07.787238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:07.787313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:07.787329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896422569296671:11222]
2025-09-30T14:57:07.787334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896422569296671:11222]
2025-09-30T14:57:07.787340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896422569296671:11222]
2025-09-30T14:57:07.787393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:07.787402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.787405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:07.787627Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:07.786489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2453 sessionId: src_id|6fff3290-230ce3f9-c16e2fe3-5a788b45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:07.789949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:07.790105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:07.790126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:07.790131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:07.805912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896422659085486:10294]
2025-09-30T14:57:07.806245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2452, pipe: [1:7555896422659085486:10294]
2025-09-30T14:57:07.905257Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:07.905738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:07.905755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:07.905777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896422659085486:10294], now have 1 active actors on pipe
2025-09-30T14:57:07.905984Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:07.906152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896422659085486:10294]
2025-09-30T14:57:07.906166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:07.906184Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:07.906246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2453 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6fff3290-230ce3f9-c16e2fe3-5a788b45_0
2025-09-30T14:57:07.906452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2453 sessionId: src_id|6fff3290-230ce3f9-c16e2fe3-5a788b45_0 is DEAD
2025-09-30T14:57:07.907472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fff3290-230ce3f9-c16e2fe3-5a788b45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:07.907480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fff3290-230ce3f9-c16e2fe3-5a788b45_0] Write session will restart in 0.006014s
2025-09-30T14:57:07.907519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fff3290-230ce3f9-c16e2fe3-5a788b45_0] Write session: Do CDS request
2025-09-30T14:57:07.907526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fff3290-230ce3f9-c16e2fe3-5a788b45_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:07.914967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fff3290-230ce3f9-c16e2fe3-5a788b45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:07.915311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:07.915330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2454
2025-09-30T14:57:07.915473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2454 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:07.915508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2454 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:07.915519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2454 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:07.915524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:07.916030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2454 sessionId:  describe result for acl check
2025-09-30T14:57:07.916073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:07.916080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:07.916082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:07.916089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896422659085522:10592] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:07.916671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896422659085522:10592] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:07.919091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896422659085522:10592] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:07.924483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896422659085522:10592] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:07.924501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896422659085522:10592] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:07.924505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896422659085522:10592] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:07.924514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2454 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:07.933625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:07.936636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:07.936876Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:07.936888Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:07.936900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:07.936958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:07.937010Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896422569296968:11224]
2025-09-30T14:57:07.937727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:07.938157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:07.938236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:07.938632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:07.938718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:07.938725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:07.938727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:07.938728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:07.938730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:07.938732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:07.938733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:07.938734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:07.938736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:07.938737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:07.938739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.938740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:07.938741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:07.938743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:07.938744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:07.938751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:07.938762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:07.938765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:07.938769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:07.938773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:07.938777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:07.938780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:07.938784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:07.938789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:07.938794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:07.938798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.938802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:07.938806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:07.938810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:07.938815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:07.938823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:07.938832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:07.938838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:07.938845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:07.938849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:07.938855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:07.938860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:07.938866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:07.938871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:07.938877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:07.938882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:07.938888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:07.938893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:07.938899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:07.938905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:07.938911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:07.938916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:07.938922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:07.938926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:07.938933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:07.938939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.938944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.938948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:07.938954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:07.938959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:07.938964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:07.938969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:07.938975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:07.938980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:07.938985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:07.939047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:07.944803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:07.946411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:07.946436Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:07.946439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:07.946443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:07.946451Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2453 [2:7555896422569296968:11224]
2025-09-30T14:57:07.946473Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:07.946489Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:07.946499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:07.946502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:07.946504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:07.946521Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:07.946533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:07.946541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:07.946615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.946625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:07.946628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:07.946632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:07.946636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:07.946708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:07.946718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.946734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:07.946748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:07.946769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:07.946873Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2453
2025-09-30T14:57:07.946901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2453
2025-09-30T14:57:07.946791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896422659085489:2454], now have 1 active actors on pipe
2025-09-30T14:57:07.946801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896422659085742:10592], now have 1 active actors on pipe
2025-09-30T14:57:07.946808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896422569296963:11224]
2025-09-30T14:57:07.946810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896422569296963:11224]
2025-09-30T14:57:07.946813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896422569296963:11224]
2025-09-30T14:57:07.946828Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:07.946842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:07.946857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:07.946858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:07.946860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:07.946861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:07.946862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:07.946904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896422569296963:11224]
2025-09-30T14:57:07.946912Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:07.946933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:07.947086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:07.947092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:07.947118Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b68e0559-73a80d12-e189b4f3-48cfbd90_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:07.947127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:07.947130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:07.947133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:07.947143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:07.947157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:07.947172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:07.947653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:07.947672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:07.947697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:07.947960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2454 partition: 0 MaxSeqNo: 42 sessionId: src_id|b68e0559-73a80d12-e189b4f3-48cfbd90_0
2025-09-30T14:57:07.948346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fff3290-230ce3f9-c16e2fe3-5a788b45_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b68e0559-73a80d12-e189b4f3-48cfbd90_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:07.951337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b68e0559-73a80d12-e189b4f3-48cfbd90_0] Write session: try to update token
2025-09-30T14:57:07.951358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b68e0559-73a80d12-e189b4f3-48cfbd90_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:07.959770Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:07.959798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:07.959808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896422569296963:11224]
2025-09-30T14:57:07.959858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:07.959864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:07.960046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:07.960211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:07.960368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:07.960522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:07.960742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:07.960797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:07.968826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2454 sessionId: src_id|b68e0559-73a80d12-e189b4f3-48cfbd90_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:07.971773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:07.972396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:07.972422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:07.972443Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:07.972446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:07.972449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:07.972451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:07.972459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896422569296963:11224]
2025-09-30T14:57:07.972470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896422569296963:11224]
2025-09-30T14:57:07.972474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896422569296963:11224]
2025-09-30T14:57:07.972518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:07.972524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:07.972531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:07.972533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:07.972534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:07.972537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:07.972675Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:08.006104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896426954053205:10294]
2025-09-30T14:57:08.006426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2453, pipe: [1:7555896426954053205:10294]
2025-09-30T14:57:08.092179Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:08.092645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:08.092684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896426954053205:10294], now have 1 active actors on pipe
2025-09-30T14:57:08.093318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b68e0559-73a80d12-e189b4f3-48cfbd90_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:08.093329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b68e0559-73a80d12-e189b4f3-48cfbd90_0] Write session will restart in 0.005525s
2025-09-30T14:57:08.093353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b68e0559-73a80d12-e189b4f3-48cfbd90_0] Write session: Do CDS request
2025-09-30T14:57:08.093360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b68e0559-73a80d12-e189b4f3-48cfbd90_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:08.092804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:08.092893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896426954053205:10294]
2025-09-30T14:57:08.092913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:08.092917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:08.092920Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:08.092998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2454 reason: error at write: Disconnected sessionId: src_id|b68e0559-73a80d12-e189b4f3-48cfbd90_0
2025-09-30T14:57:08.093142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2454 sessionId: src_id|b68e0559-73a80d12-e189b4f3-48cfbd90_0 is DEAD
2025-09-30T14:57:08.099748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b68e0559-73a80d12-e189b4f3-48cfbd90_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:08.099852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:08.099870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2455
2025-09-30T14:57:08.100008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2455 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:08.100045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2455 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:08.100056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2455 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:08.100062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:08.100671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2455 sessionId:  describe result for acl check
2025-09-30T14:57:08.100727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:08.100729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:08.100731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:08.100738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896426954053223:10596] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:08.101346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896426954053223:10596] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:08.103928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896426954053223:10596] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:08.106780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896426954053223:10596] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:08.106796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896426954053223:10596] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:08.106799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896426954053223:10596] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:08.106807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2455 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:08.118254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:08.121238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:08.121484Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:08.121495Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:08.121506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:08.121558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:08.121603Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896426864264571:11228]
2025-09-30T14:57:08.122305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:08.122706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:08.122766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:08.123115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:08.123182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:08.123189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:08.123190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:08.123191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:08.123192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:08.123194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:08.123195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:08.123197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:08.123198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:08.123199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:08.123201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.123202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:08.123203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:08.123204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:08.123205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:08.123212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:08.123223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:08.123227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:08.123230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:08.123234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:08.123238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:08.123255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:08.123259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:08.123262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:08.123266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:08.123270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.123273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:08.123277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:08.123280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:08.123284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:08.123293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:08.123301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:08.123307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:08.123313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:08.123318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:08.123323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:08.123328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:08.123333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:08.123338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:08.123344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:08.123350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:08.123355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:08.123359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:08.123364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:08.123369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:08.123374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:08.123378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:08.123384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:08.123396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:08.123402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:08.123407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.123412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.123416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:08.123422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:08.123427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:08.123433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:08.123438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:08.123448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:08.123453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:08.123458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:08.123502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:08.129621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:08.130610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:08.130618Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:08.130621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:08.130627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:08.130636Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2454 [2:7555896426864264571:11228]
2025-09-30T14:57:08.130655Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:08.130675Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:08.130679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:08.130682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:08.130685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:08.130704Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:08.130712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:08.130720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:08.130793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.130796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:08.130799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:08.130803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:08.130806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:08.130882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:08.130885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.130901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:08.130914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:08.130932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:08.130951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896426864264566:11228]
2025-09-30T14:57:08.130954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896426864264566:11228]
2025-09-30T14:57:08.130956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896426864264566:11228]
2025-09-30T14:57:08.130973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:08.130987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:08.131003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:08.131006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:08.131044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896426864264566:11228]
2025-09-30T14:57:08.131047Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:08.131301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:08.131311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:08.131313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:08.131320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:08.131513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896426954053383:10596], now have 1 active actors on pipe
2025-09-30T14:57:08.131520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896426954053208:2454], now have 1 active actors on pipe
2025-09-30T14:57:08.131643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2454
2025-09-30T14:57:08.131686Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2454
2025-09-30T14:57:08.131722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:08.131732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:08.131760Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22b2a7f5-5642bb32-eca2cd04-8cf9ef2f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:08.131770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:08.131780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:08.131783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:08.131796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:08.131809Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:08.131832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:08.137221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:08.137245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:08.137283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:08.139351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2455 partition: 0 MaxSeqNo: 42 sessionId: src_id|22b2a7f5-5642bb32-eca2cd04-8cf9ef2f_0
2025-09-30T14:57:08.139943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b68e0559-73a80d12-e189b4f3-48cfbd90_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|22b2a7f5-5642bb32-eca2cd04-8cf9ef2f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:08.143004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22b2a7f5-5642bb32-eca2cd04-8cf9ef2f_0] Write session: try to update token
2025-09-30T14:57:08.143024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22b2a7f5-5642bb32-eca2cd04-8cf9ef2f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:08.150385Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:08.150407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:08.150417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896426864264566:11228]
2025-09-30T14:57:08.150462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:08.150466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:08.150640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:08.150790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:08.150938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:08.151089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:08.151318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:08.151364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:08.165649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2455 sessionId: src_id|22b2a7f5-5642bb32-eca2cd04-8cf9ef2f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:08.168662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:08.169742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:08.169770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:08.171349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:08.171381Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:08.171384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:08.171387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:08.171389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:08.171401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896426864264566:11228]
2025-09-30T14:57:08.171406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896426864264566:11228]
2025-09-30T14:57:08.171411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896426864264566:11228]
2025-09-30T14:57:08.171442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:08.171447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:08.171449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:08.171453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:08.171455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.171458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:08.171629Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:08.171551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:08.192924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896426954053652:10294]
2025-09-30T14:57:08.203473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2454, pipe: [1:7555896426954053652:10294]
2025-09-30T14:57:08.299722Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:08.300053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896426954053652:10294], now have 1 active actors on pipe
2025-09-30T14:57:08.309658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:08.309689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:08.309855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:08.309924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:08.309992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:08.310059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:08.310105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:08.310113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:08.310180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:08.310247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:08.310312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:08.310382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:08.310423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:08.310425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:08.310499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:08.310555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:08.310618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:08.310678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:08.310719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:08.310721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:08.310787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:08.310850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:08.310947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:08.311008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:08.311053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:08.311055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:08.311123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:08.311184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:08.311310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:08.311383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:08.311429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:08.311442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:08.311529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:08.311606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:08.311673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:08.311738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:08.311796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:08.311806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:08.311883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:08.311953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:08.312033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:08.312109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:08.312157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:08.312160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:08.312237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:08.312302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:08.312368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:08.312436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:08.312503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:08.312508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:08.312585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:08.312649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:08.312716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:08.312782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:08.312830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:08.312834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:08.312910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:08.312974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:08.313045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:08.313114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:08.313182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:08.313186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:08.314516Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:08.315048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:08.315111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896426954053652:10294]
2025-09-30T14:57:08.315131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:08.315169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2455 reason: status is not ok: tablet will be restarted right now sessionId: src_id|22b2a7f5-5642bb32-eca2cd04-8cf9ef2f_0
2025-09-30T14:57:08.315448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2455 sessionId: src_id|22b2a7f5-5642bb32-eca2cd04-8cf9ef2f_0 is DEAD
2025-09-30T14:57:08.315543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22b2a7f5-5642bb32-eca2cd04-8cf9ef2f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:08.315555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22b2a7f5-5642bb32-eca2cd04-8cf9ef2f_0] Write session will restart in 0.009665s
2025-09-30T14:57:08.315580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22b2a7f5-5642bb32-eca2cd04-8cf9ef2f_0] Write session: Do CDS request
2025-09-30T14:57:08.315587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22b2a7f5-5642bb32-eca2cd04-8cf9ef2f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:08.329865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22b2a7f5-5642bb32-eca2cd04-8cf9ef2f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:08.330284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:08.330304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2456
2025-09-30T14:57:08.330569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2456 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:08.330615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2456 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:08.330625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2456 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:08.330630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:08.331119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2456 sessionId:  describe result for acl check
2025-09-30T14:57:08.331155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:08.331164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:08.331167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:08.331173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896426954053697:10611] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:08.331753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896426954053697:10611] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:08.334127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896426954053697:10611] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:08.336799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896426954053697:10611] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:08.336817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896426954053697:10611] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:08.336823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896426954053697:10611] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:08.336831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2456 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:08.357198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:08.360243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:08.360644Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:08.360655Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:08.360666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:08.360734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:08.360781Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896426864264903:11242]
2025-09-30T14:57:08.361375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:08.361968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:08.362024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:08.362427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:08.362527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:08.362537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:08.362538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:08.362540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:08.362541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:08.362542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:08.362544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:08.362545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:08.362546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:08.362548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:08.362549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.362550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:08.362552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:08.362553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:08.362554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:08.362562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:08.362575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:08.362580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:08.362584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:08.362588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:08.362593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:08.362597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:08.362602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:08.362605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:08.362609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:08.362613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.362617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:08.362620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:08.362624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:08.362628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:08.362637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:08.362647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:08.362654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:08.362660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:08.362665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:08.362670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:08.362675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:08.362681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:08.362687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:08.362693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:08.362698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:08.362703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:08.362709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:08.362714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:08.362719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:08.362725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:08.362729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:08.362735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:08.362740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:08.362745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:08.362751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.362756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.362762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:08.362767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:08.362773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:08.362785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:08.362793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:08.362799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:08.362808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:08.362813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:08.362860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:08.373391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:08.375153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:08.375181Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:08.375184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:08.375188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:08.375197Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2455 [2:7555896426864264903:11242]
2025-09-30T14:57:08.375217Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:08.375238Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:08.375260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:08.375264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:08.375266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:08.375287Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:08.375297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:08.375317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:08.375416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.375430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:08.375432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:08.375437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:08.375440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:08.375530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:08.375540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.375556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:08.375574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:08.375591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:08.375615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896426864264898:11242]
2025-09-30T14:57:08.375623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896426864264898:11242]
2025-09-30T14:57:08.375625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896426864264898:11242]
2025-09-30T14:57:08.375639Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:08.375648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:08.375652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:08.375654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:08.375659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:08.375678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:08.375689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:08.375706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896426954053728:10611], now have 1 active actors on pipe
2025-09-30T14:57:08.375720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896426954053681:2454], now have 1 active actors on pipe
2025-09-30T14:57:08.375764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896426864264898:11242]
2025-09-30T14:57:08.375779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:08.375784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:08.375866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2455
2025-09-30T14:57:08.375909Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2455
2025-09-30T14:57:08.375983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:08.375998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:08.376046Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3981143a-b6f1b997-a9a9aac3-1b931bf2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:08.376060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:08.376066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:08.376069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:08.376084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:08.376105Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:08.376124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:08.376306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:08.376318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:08.376337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:08.376476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2456 partition: 0 MaxSeqNo: 42 sessionId: src_id|3981143a-b6f1b997-a9a9aac3-1b931bf2_0
2025-09-30T14:57:08.376900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22b2a7f5-5642bb32-eca2cd04-8cf9ef2f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3981143a-b6f1b997-a9a9aac3-1b931bf2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:08.379956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3981143a-b6f1b997-a9a9aac3-1b931bf2_0] Write session: try to update token
2025-09-30T14:57:08.379982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3981143a-b6f1b997-a9a9aac3-1b931bf2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:08.394636Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:08.394661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:08.394672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896426864264898:11242]
2025-09-30T14:57:08.394720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:08.394733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:08.394910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:08.395080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:08.395278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:08.395456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:08.395696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:08.395739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:08.401469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2456 sessionId: src_id|3981143a-b6f1b997-a9a9aac3-1b931bf2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:08.404622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:08.404860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:08.404890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:08.404932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:08.405069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:08.408736Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:08.408761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:08.408763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:08.408765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:08.408775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896426864264898:11242]
2025-09-30T14:57:08.408780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896426864264898:11242]
2025-09-30T14:57:08.408785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896426864264898:11242]
2025-09-30T14:57:08.408825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:08.408831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:08.408834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.408836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:08.408836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:08.408840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:08.408983Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:08.415370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896426954054101:10294]
2025-09-30T14:57:08.418423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2455, pipe: [1:7555896426954054101:10294]
2025-09-30T14:57:08.527087Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:08.527590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896426954054101:10294], now have 1 active actors on pipe
2025-09-30T14:57:08.536522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:08.536555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:08.536739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:08.536809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:08.536885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:08.536955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:08.536998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:08.537003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:08.537078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:08.537159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:08.537226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:08.537290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:08.537348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:08.537351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:08.537424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:08.537483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:08.537550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:08.537620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:08.537660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:08.537663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:08.537737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:08.537807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:08.537871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:08.537935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:08.537977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:08.537980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:08.538057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:08.538118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:08.538190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:08.538260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:08.538304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:08.538307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:08.538381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:08.538439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:08.538501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:08.538567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:08.538617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:08.538621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:08.538699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:08.538760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:08.538824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:08.538888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:08.538953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:08.538956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:08.539025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:08.539089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:08.539160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:08.539228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:08.539299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:08.539302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:08.539379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:08.539440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:08.539503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:08.539576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:08.539638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:08.539647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:08.539721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:08.539789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:08.539864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:08.539932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:08.539991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:08.539994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:08.541527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:08.541540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:08.541565Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:08.541567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2456 reason: error at write: Disconnected sessionId: src_id|3981143a-b6f1b997-a9a9aac3-1b931bf2_0
2025-09-30T14:57:08.541605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896426954054101:10294]
2025-09-30T14:57:08.541656Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:08.541717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2456 sessionId: src_id|3981143a-b6f1b997-a9a9aac3-1b931bf2_0 is DEAD
2025-09-30T14:57:08.541884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3981143a-b6f1b997-a9a9aac3-1b931bf2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:08.541896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3981143a-b6f1b997-a9a9aac3-1b931bf2_0] Write session will restart in 0.009064s
2025-09-30T14:57:08.541920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3981143a-b6f1b997-a9a9aac3-1b931bf2_0] Write session: Do CDS request
2025-09-30T14:57:08.541926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3981143a-b6f1b997-a9a9aac3-1b931bf2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:08.552670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3981143a-b6f1b997-a9a9aac3-1b931bf2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:08.552909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:08.552928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2457
2025-09-30T14:57:08.553050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2457 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:08.553083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2457 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:08.553094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2457 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:08.553098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:08.553514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2457 sessionId:  describe result for acl check
2025-09-30T14:57:08.553549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:08.553561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:08.553563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:08.553569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896426954054119:10615] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:08.554123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896426954054119:10615] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:08.556674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896426954054119:10615] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:08.562493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896426954054119:10615] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:08.562512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896426954054119:10615] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:08.562516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896426954054119:10615] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:08.562525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2457 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:08.579284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:08.582030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:08.582259Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:08.582271Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:08.582282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:08.582333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:08.582376Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896426864265200:11245]
2025-09-30T14:57:08.583086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:08.583475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:08.583562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:08.583929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:08.583995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:08.584002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:08.584004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:08.584006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:08.584007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:08.584008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:08.584010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:08.584011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:08.584013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:08.584014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:08.584015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.584017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:08.584018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:08.584019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:08.584021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:08.584027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:08.584038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:08.584042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:08.584047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:08.584052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:08.584057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:08.584061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:08.584066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:08.584071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:08.584075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:08.584080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.584084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:08.584089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:08.584093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:08.584098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:08.584106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:08.584115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:08.584122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:08.584129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:08.584133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:08.584139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:08.584144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:08.584151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:08.584156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:08.584162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:08.584167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:08.584171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:08.584177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:08.584183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:08.584188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:08.584194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:08.584205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:08.584210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:08.584215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:08.584239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:08.584250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.584256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.584268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:08.584274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:08.584283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:08.584289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:08.584299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:08.584305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:08.584318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:08.584324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:08.584382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:08.590316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:08.591209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:08.591226Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:08.591230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:08.591235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:08.591263Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2456 [2:7555896426864265200:11245]
2025-09-30T14:57:08.591282Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:08.591304Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:08.591312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:08.591316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:08.591319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:08.591336Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:08.591343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:08.591355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:08.591420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.591428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:08.591431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:08.591435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:08.591438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:08.591513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:08.591521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.591535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:08.591548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:08.591573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:08.591597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896426954054230:10615], now have 1 active actors on pipe
2025-09-30T14:57:08.591604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896426954054104:2454], now have 1 active actors on pipe
2025-09-30T14:57:08.591612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896426864265195:11245]
2025-09-30T14:57:08.591615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896426864265195:11245]
2025-09-30T14:57:08.591618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896426864265195:11245]
2025-09-30T14:57:08.591632Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:08.591646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:08.591663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:08.591667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:08.591700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896426864265195:11245]
2025-09-30T14:57:08.591703Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:08.591673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2456
2025-09-30T14:57:08.591750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:08.591762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:08.591765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:08.591775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:08.592081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2456
2025-09-30T14:57:08.592168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:08.592178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:08.592204Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e348731f-8546a752-40ac8d35-98ecb7a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:08.592217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:08.592221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:08.592224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:08.592236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:08.592252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:08.592269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:08.592565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:08.592579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:08.592604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:08.592714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2457 partition: 0 MaxSeqNo: 42 sessionId: src_id|e348731f-8546a752-40ac8d35-98ecb7a6_0
2025-09-30T14:57:08.593110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3981143a-b6f1b997-a9a9aac3-1b931bf2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e348731f-8546a752-40ac8d35-98ecb7a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:08.596000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e348731f-8546a752-40ac8d35-98ecb7a6_0] Write session: try to update token
2025-09-30T14:57:08.596022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e348731f-8546a752-40ac8d35-98ecb7a6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:08.604516Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:08.604547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:08.604558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896426864265195:11245]
2025-09-30T14:57:08.604608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:08.604617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:08.604823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:08.604998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:08.605179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:08.605340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:08.605563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:08.605618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:08.615898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2457 sessionId: src_id|e348731f-8546a752-40ac8d35-98ecb7a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:08.617368Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:08.617390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:08.617393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:08.617396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:08.617408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896426864265195:11245]
2025-09-30T14:57:08.617413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896426864265195:11245]
2025-09-30T14:57:08.617418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896426864265195:11245]
2025-09-30T14:57:08.617467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:08.617480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.617483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:08.617509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:08.617526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:08.617531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:08.617635Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:08.618931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:08.642000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896426954054527:10294]
2025-09-30T14:57:08.642239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2456, pipe: [1:7555896426954054527:10294]
2025-09-30T14:57:08.740814Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:08.741570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:08.741590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:08.741613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896426954054527:10294], now have 1 active actors on pipe
2025-09-30T14:57:08.741951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:08.741970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896426954054527:10294]
2025-09-30T14:57:08.741973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:08.741995Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:08.742047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2457 reason: error at write: Disconnected sessionId: src_id|e348731f-8546a752-40ac8d35-98ecb7a6_0
2025-09-30T14:57:08.742427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e348731f-8546a752-40ac8d35-98ecb7a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:08.742439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e348731f-8546a752-40ac8d35-98ecb7a6_0] Write session will restart in 0.009477s
2025-09-30T14:57:08.742471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e348731f-8546a752-40ac8d35-98ecb7a6_0] Write session: Do CDS request
2025-09-30T14:57:08.742477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e348731f-8546a752-40ac8d35-98ecb7a6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:08.742269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2457 sessionId: src_id|e348731f-8546a752-40ac8d35-98ecb7a6_0 is DEAD
2025-09-30T14:57:08.741846Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:08.752833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e348731f-8546a752-40ac8d35-98ecb7a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:08.753015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:08.753033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2458
2025-09-30T14:57:08.753264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2458 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:08.753304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2458 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:08.753310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2458 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:08.753315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:08.753824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2458 sessionId:  describe result for acl check
2025-09-30T14:57:08.753865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:08.753873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:08.753875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:08.753881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896426954054547:10620] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:08.754525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896426954054547:10620] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:08.756835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896426954054547:10620] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:08.759693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896426954054547:10620] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:08.759712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896426954054547:10620] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:08.759717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896426954054547:10620] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:08.759726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2458 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:08.780579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:08.783132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:08.783399Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:08.783411Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:08.783422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:08.783482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:08.783527Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896426864265496:11247]
2025-09-30T14:57:08.784273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:08.784816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:08.784882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:08.785252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:08.785332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:08.785339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:08.785341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:08.785342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:08.785344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:08.785345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:08.785347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:08.785348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:08.785349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:08.785351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:08.785352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.785354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:08.785355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:08.785356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:08.785357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:08.785363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:08.785373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:08.785377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:08.785382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:08.785386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:08.785390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:08.785395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:08.785399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:08.785403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:08.785408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:08.785412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.785416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:08.785419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:08.785423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:08.785428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:08.785436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:08.785445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:08.785452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:08.785458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:08.785464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:08.785474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:08.785479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:08.785490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:08.785496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:08.785506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:08.785511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:08.785520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:08.785526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:08.785536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:08.785540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:08.785546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:08.785551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:08.785556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:08.785561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:08.785572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:08.785577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.785582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.785591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:08.785597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:08.785619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:08.785628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:08.785632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:08.785637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:08.785642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:08.785650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:08.785696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:08.792015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:08.793280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:08.793299Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:08.793302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:08.793306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:08.793313Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2457 [2:7555896426864265496:11247]
2025-09-30T14:57:08.793334Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:08.793354Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:08.793357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:08.793360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:08.793362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:08.793382Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:08.793389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:08.793408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:08.793479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.793488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:08.793490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:08.793495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:08.793498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:08.793575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:08.793586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.793601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:08.793611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:08.793626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:08.793646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896426954054532:2454], now have 1 active actors on pipe
2025-09-30T14:57:08.793650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896426954054634:10620], now have 1 active actors on pipe
2025-09-30T14:57:08.793657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896426864265491:11247]
2025-09-30T14:57:08.793659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896426864265491:11247]
2025-09-30T14:57:08.793661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896426864265491:11247]
2025-09-30T14:57:08.793675Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:08.793690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:08.793692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:08.793695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:08.793698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:08.793706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:08.793709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:08.793748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896426864265491:11247]
2025-09-30T14:57:08.793717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2457
2025-09-30T14:57:08.793752Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:08.793736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2457
2025-09-30T14:57:08.793755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:08.793777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:08.793782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:08.793832Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc008a54-cc424ddc-4d6bfd51-3e0c9b1a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:08.793839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:08.793843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:08.793846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:08.793856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:08.793864Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:08.793881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:08.794044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:08.794053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:08.794066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:08.794149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2458 partition: 0 MaxSeqNo: 42 sessionId: src_id|fc008a54-cc424ddc-4d6bfd51-3e0c9b1a_0
2025-09-30T14:57:08.794599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e348731f-8546a752-40ac8d35-98ecb7a6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fc008a54-cc424ddc-4d6bfd51-3e0c9b1a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:08.797636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc008a54-cc424ddc-4d6bfd51-3e0c9b1a_0] Write session: try to update token
2025-09-30T14:57:08.797658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc008a54-cc424ddc-4d6bfd51-3e0c9b1a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:08.815936Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:08.815958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:08.815961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:08.815963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:08.815973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896426864265491:11247]
2025-09-30T14:57:08.815979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896426864265491:11247]
2025-09-30T14:57:08.815984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896426864265491:11247]
2025-09-30T14:57:08.816033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:08.816041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.816043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:08.816213Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:08.815843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2458 sessionId: src_id|fc008a54-cc424ddc-4d6bfd51-3e0c9b1a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:08.819135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:08.819302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:08.819324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:08.819329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:08.842172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896426954054956:10294]
2025-09-30T14:57:08.842507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2457, pipe: [1:7555896426954054956:10294]
2025-09-30T14:57:08.938766Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:08.939562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:08.939581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:08.939628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896426954054956:10294], now have 1 active actors on pipe
2025-09-30T14:57:08.939863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:08.939936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896426954054956:10294]
2025-09-30T14:57:08.939968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:08.939899Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:08.940254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2458 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fc008a54-cc424ddc-4d6bfd51-3e0c9b1a_0
2025-09-30T14:57:08.940598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc008a54-cc424ddc-4d6bfd51-3e0c9b1a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:08.940611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc008a54-cc424ddc-4d6bfd51-3e0c9b1a_0] Write session will restart in 0.008130s
2025-09-30T14:57:08.940449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2458 sessionId: src_id|fc008a54-cc424ddc-4d6bfd51-3e0c9b1a_0 is DEAD
2025-09-30T14:57:08.940648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc008a54-cc424ddc-4d6bfd51-3e0c9b1a_0] Write session: Do CDS request
2025-09-30T14:57:08.940655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc008a54-cc424ddc-4d6bfd51-3e0c9b1a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:08.950912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc008a54-cc424ddc-4d6bfd51-3e0c9b1a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:08.951573Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:08.951589Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2459
2025-09-30T14:57:08.951779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2459 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:08.951829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2459 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:08.951840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2459 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:08.951844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:08.952355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2459 sessionId:  describe result for acl check
2025-09-30T14:57:08.952394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:08.952401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:08.952403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:08.952410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896426954055013:10624] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:08.952964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896426954055013:10624] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:08.955914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896426954055013:10624] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:08.959316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896426954055013:10624] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:08.959332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896426954055013:10624] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:08.959336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896426954055013:10624] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:08.959346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2459 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:08.976101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:08.979629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:08.979924Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:08.979939Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:08.979951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:08.980014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:08.980060Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896426864265808:11249]
2025-09-30T14:57:08.980703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:08.981112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:08.981188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:08.981565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:08.981651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:08.981658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:08.981659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:08.981661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:08.981662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:08.981664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:08.981665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:08.981667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:08.981668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:08.981669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:08.981671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.981673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:08.981674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:08.981676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:08.981677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:08.981683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:08.981696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:08.981700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:08.981705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:08.981709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:08.981713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:08.981718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:08.981722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:08.981726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:08.981731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:08.981735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.981740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:08.981744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:08.981748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:08.981753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:08.981761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:08.981770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:08.981776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:08.981782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:08.981787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:08.981793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:08.981798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:08.981804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:08.981809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:08.981814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:08.981819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:08.981825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:08.981830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:08.981835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:08.981840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:08.981845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:08.981851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:08.981856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:08.981861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:08.981867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:08.981871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.981877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.981886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:08.981892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:08.981901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:08.981906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:08.981916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:08.981922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:08.981926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:08.981932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:08.981981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:08.987803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:08.988715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:08.988733Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:08.988737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:08.988741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:08.988748Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2458 [2:7555896426864265808:11249]
2025-09-30T14:57:08.988769Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:08.988786Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:08.988790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:08.988793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:08.988796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:08.988813Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:08.988820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:08.988828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:08.988890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.988900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:08.988902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:08.988906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:08.988909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:08.988978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:08.988985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:08.988999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:08.989017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:08.989035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:08.989058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896426954055156:10624], now have 1 active actors on pipe
2025-09-30T14:57:08.989067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896426954054959:2454], now have 1 active actors on pipe
2025-09-30T14:57:08.989074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896426864265803:11249]
2025-09-30T14:57:08.989078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896426864265803:11249]
2025-09-30T14:57:08.989080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896426864265803:11249]
2025-09-30T14:57:08.989096Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:08.989114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:08.989123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:08.989127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:08.989130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:08.989135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:08.989138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:08.989188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896426864265803:11249]
2025-09-30T14:57:08.989200Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:08.989243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:08.990287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2458
2025-09-30T14:57:08.990325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2458
2025-09-30T14:57:08.990505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:08.990520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:08.990553Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e7ffbb1-541dc40d-97eb6e25-b9b4f26e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:08.990568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:08.990588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:08.990596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:08.990609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:08.990628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:08.990651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:08.991317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:08.991330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:08.991350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:08.991488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2459 partition: 0 MaxSeqNo: 42 sessionId: src_id|6e7ffbb1-541dc40d-97eb6e25-b9b4f26e_0
2025-09-30T14:57:08.991862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc008a54-cc424ddc-4d6bfd51-3e0c9b1a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6e7ffbb1-541dc40d-97eb6e25-b9b4f26e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:08.994828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e7ffbb1-541dc40d-97eb6e25-b9b4f26e_0] Write session: try to update token
2025-09-30T14:57:08.994854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e7ffbb1-541dc40d-97eb6e25-b9b4f26e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:09.002770Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:09.002793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:09.002796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:09.002798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:09.002808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896426864265803:11249]
2025-09-30T14:57:09.002813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896426864265803:11249]
2025-09-30T14:57:09.002818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896426864265803:11249]
2025-09-30T14:57:09.002863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:09.002872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:09.002875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.002879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:09.002879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:09.002883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:09.003026Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:09.011604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2459 sessionId: src_id|6e7ffbb1-541dc40d-97eb6e25-b9b4f26e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:09.014491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:09.039813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896431249022681:10294]
2025-09-30T14:57:09.040093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2458, pipe: [1:7555896431249022681:10294]
2025-09-30T14:57:09.124362Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:09.125266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:09.125276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:09.125297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896431249022681:10294], now have 1 active actors on pipe
2025-09-30T14:57:09.125522Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:09.125532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896431249022681:10294]
2025-09-30T14:57:09.125565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:09.125567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:09.125621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2459 reason: error at write: Disconnected sessionId: src_id|6e7ffbb1-541dc40d-97eb6e25-b9b4f26e_0
2025-09-30T14:57:09.125770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2459 sessionId: src_id|6e7ffbb1-541dc40d-97eb6e25-b9b4f26e_0 is DEAD
2025-09-30T14:57:09.125888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:09.125902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e7ffbb1-541dc40d-97eb6e25-b9b4f26e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:09.125912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e7ffbb1-541dc40d-97eb6e25-b9b4f26e_0] Write session will restart in 0.006397s
2025-09-30T14:57:09.125934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e7ffbb1-541dc40d-97eb6e25-b9b4f26e_0] Write session: Do CDS request
2025-09-30T14:57:09.125944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e7ffbb1-541dc40d-97eb6e25-b9b4f26e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:09.133812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e7ffbb1-541dc40d-97eb6e25-b9b4f26e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:09.133924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:09.133940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2460
2025-09-30T14:57:09.134064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2460 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:09.134104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2460 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:09.134114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2460 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:09.134119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:09.134589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2460 sessionId:  describe result for acl check
2025-09-30T14:57:09.134629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:09.134636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:09.134639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:09.134644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896431249022696:10628] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:09.135223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896431249022696:10628] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:09.137627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896431249022696:10628] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:09.141675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896431249022696:10628] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:09.141696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896431249022696:10628] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:09.141701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896431249022696:10628] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:09.141710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2460 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:09.167378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:09.171391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:09.171599Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:09.171603Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:09.171613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:09.171656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:09.171683Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896431159233402:11253]
2025-09-30T14:57:09.172190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:09.172520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:09.172551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:09.172792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:09.172831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:09.172832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:09.172833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:09.172834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:09.172835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:09.172836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:09.172838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:09.172839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:09.172840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:09.172841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:09.172843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.172844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:09.172845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:09.172846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:09.172847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:09.172852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:09.172863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:09.172867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:09.172871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:09.172874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:09.172877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:09.172881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:09.172885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:09.172888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:09.172892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:09.172896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.172899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:09.172903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:09.172907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:09.172910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:09.172917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:09.172925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:09.172932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:09.172938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:09.172943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:09.172950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:09.172955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:09.172960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:09.172963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:09.172966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:09.172969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:09.172975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:09.172978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:09.172981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:09.172983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:09.172986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:09.172989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:09.172992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:09.172995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:09.172998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:09.173001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.173004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.173007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:09.173010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:09.173014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:09.173016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:09.173020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:09.173023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:09.173026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:09.173029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:09.173057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:09.178727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:09.180341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:09.180368Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:09.180370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:09.180375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:09.180382Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2459 [2:7555896431159233402:11253]
2025-09-30T14:57:09.180400Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:09.180418Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:09.180427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:09.180430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:09.180433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:09.180453Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:09.180461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:09.180473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:09.180538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.180545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:09.180549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:09.180552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:09.180555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:09.180633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:09.180640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.180655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:09.180671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:09.180690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:09.180717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896431249022798:10628], now have 1 active actors on pipe
2025-09-30T14:57:09.180728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896431159233397:11253]
2025-09-30T14:57:09.180731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896431159233397:11253]
2025-09-30T14:57:09.180733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896431159233397:11253]
2025-09-30T14:57:09.180811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2459
2025-09-30T14:57:09.180853Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2459
2025-09-30T14:57:09.180747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:09.180761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896431249022683:2454], now have 1 active actors on pipe
2025-09-30T14:57:09.180764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:09.180767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:09.180769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:09.180770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:09.180782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:09.180785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:09.180824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896431159233397:11253]
2025-09-30T14:57:09.180833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:09.180850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:09.180870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:09.180875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:09.180903Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e814dd2-cb6d3d64-55d446a8-89fe703_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:09.180909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:09.180912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:09.180915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:09.180926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:09.180937Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:09.180959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:09.181156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:09.181165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:09.181178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:09.181285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2460 partition: 0 MaxSeqNo: 42 sessionId: src_id|2e814dd2-cb6d3d64-55d446a8-89fe703_0
2025-09-30T14:57:09.181694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e7ffbb1-541dc40d-97eb6e25-b9b4f26e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2e814dd2-cb6d3d64-55d446a8-89fe703_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:09.184557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e814dd2-cb6d3d64-55d446a8-89fe703_0] Write session: try to update token
2025-09-30T14:57:09.184577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e814dd2-cb6d3d64-55d446a8-89fe703_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:09.193338Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:09.193357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:09.193359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:09.193360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:09.193367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896431159233397:11253]
2025-09-30T14:57:09.193370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896431159233397:11253]
2025-09-30T14:57:09.193374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896431159233397:11253]
2025-09-30T14:57:09.193406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:09.193412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.193415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:09.193548Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:09.195307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:09.195322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:09.195325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:09.209351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2460 sessionId: src_id|2e814dd2-cb6d3d64-55d446a8-89fe703_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:09.212400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:09.225687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896431249023129:10294]
2025-09-30T14:57:09.226018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2459, pipe: [1:7555896431249023129:10294]
2025-09-30T14:57:09.310646Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:09.311231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:09.311366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:09.311393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896431249023129:10294], now have 1 active actors on pipe
2025-09-30T14:57:09.311650Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:09.312226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896431249023129:10294]
2025-09-30T14:57:09.312276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:09.312358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2460 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2e814dd2-cb6d3d64-55d446a8-89fe703_0
2025-09-30T14:57:09.312541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2460 sessionId: src_id|2e814dd2-cb6d3d64-55d446a8-89fe703_0 is DEAD
2025-09-30T14:57:09.312727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e814dd2-cb6d3d64-55d446a8-89fe703_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:09.312738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e814dd2-cb6d3d64-55d446a8-89fe703_0] Write session will restart in 0.009486s
2025-09-30T14:57:09.312764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e814dd2-cb6d3d64-55d446a8-89fe703_0] Write session: Do CDS request
2025-09-30T14:57:09.312770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e814dd2-cb6d3d64-55d446a8-89fe703_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:09.312680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:09.323779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e814dd2-cb6d3d64-55d446a8-89fe703_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:09.326268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:09.326289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2461
2025-09-30T14:57:09.326793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2461 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:09.326828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2461 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:09.326832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2461 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:09.326838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:09.327568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2461 sessionId:  describe result for acl check
2025-09-30T14:57:09.327603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:09.327605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:09.327607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:09.327612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896431249023329:10640] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:09.328111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896431249023329:10640] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:09.331174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896431249023329:10640] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:09.335260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896431249023329:10640] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:09.335285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896431249023329:10640] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:09.335291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896431249023329:10640] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:09.335314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2461 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:09.344413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:09.348099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:09.348364Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:09.348368Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:09.348382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:09.348447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:09.348506Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896431159233737:11261]
2025-09-30T14:57:09.349218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:09.349653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:09.349708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:09.350061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:09.350147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:09.350153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:09.350154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:09.350156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:09.350157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:09.350158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:09.350159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:09.350160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:09.350162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:09.350163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:09.350164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.350165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:09.350166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:09.350167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:09.350168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:09.350174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:09.350184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:09.350188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:09.350192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:09.350195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:09.350198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:09.350202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:09.350206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:09.350209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:09.350213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:09.350217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.350221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:09.350224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:09.350227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:09.350231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:09.350240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:09.350246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:09.350252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:09.350257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:09.350262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:09.350267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:09.350271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:09.350275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:09.350279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:09.350284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:09.350287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:09.350291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:09.350297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:09.350301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:09.350305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:09.350309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:09.350313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:09.350318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:09.350325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:09.350329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:09.350334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.350338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.350345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:09.350349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:09.350353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:09.350358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:09.350362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:09.350367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:09.350371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:09.350376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:09.350418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:09.356321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:09.357444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:09.357463Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:09.357467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:09.357471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:09.357478Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2460 [2:7555896431159233737:11261]
2025-09-30T14:57:09.357496Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:09.357518Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:09.357522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:09.357525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:09.357528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:09.357544Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:09.357552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:09.357560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:09.357631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.357640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:09.357642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:09.357646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:09.357649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:09.357731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:09.357739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.357753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:09.357763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:09.357779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:09.357797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896431159233732:11261]
2025-09-30T14:57:09.357804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896431159233732:11261]
2025-09-30T14:57:09.357806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896431159233732:11261]
2025-09-30T14:57:09.357816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:09.357831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:09.357840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:09.357843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:09.357845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:09.357852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:09.357855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:09.357901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896431249023507:10640], now have 1 active actors on pipe
2025-09-30T14:57:09.357914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896431249023147:2454], now have 1 active actors on pipe
2025-09-30T14:57:09.357917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896431159233732:11261]
2025-09-30T14:57:09.357927Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:09.357987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2460
2025-09-30T14:57:09.357957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:09.358152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2460
2025-09-30T14:57:09.358312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:09.358330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:09.358361Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5bba9216-553e31a3-872c5c7-e00b7e34_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:09.358371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:09.358375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:09.358379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:09.358394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:09.358412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:09.358430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:09.361680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:09.361704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:09.361755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:09.361898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2461 partition: 0 MaxSeqNo: 42 sessionId: src_id|5bba9216-553e31a3-872c5c7-e00b7e34_0
2025-09-30T14:57:09.362347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e814dd2-cb6d3d64-55d446a8-89fe703_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5bba9216-553e31a3-872c5c7-e00b7e34_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:09.365464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bba9216-553e31a3-872c5c7-e00b7e34_0] Write session: try to update token
2025-09-30T14:57:09.365484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bba9216-553e31a3-872c5c7-e00b7e34_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:09.372570Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:09.372593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:09.372596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:09.372598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:09.372608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896431159233732:11261]
2025-09-30T14:57:09.372613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896431159233732:11261]
2025-09-30T14:57:09.372617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896431159233732:11261]
2025-09-30T14:57:09.372664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:09.372673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.372677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:09.372825Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:09.375172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:09.375196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:09.375201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:09.386801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2461 sessionId: src_id|5bba9216-553e31a3-872c5c7-e00b7e34_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:09.390211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:09.412570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896431249023584:10294]
2025-09-30T14:57:09.412893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2460, pipe: [1:7555896431249023584:10294]
2025-09-30T14:57:09.498170Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:09.498502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:09.498520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:09.498540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896431249023584:10294], now have 1 active actors on pipe
2025-09-30T14:57:09.498773Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:09.498789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896431249023584:10294]
2025-09-30T14:57:09.498831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:09.498833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:09.498894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2461 reason: error at write: Disconnected sessionId: src_id|5bba9216-553e31a3-872c5c7-e00b7e34_0
2025-09-30T14:57:09.499077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2461 sessionId: src_id|5bba9216-553e31a3-872c5c7-e00b7e34_0 is DEAD
2025-09-30T14:57:09.499113Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:09.501909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bba9216-553e31a3-872c5c7-e00b7e34_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:09.501925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bba9216-553e31a3-872c5c7-e00b7e34_0] Write session will restart in 0.008104s
2025-09-30T14:57:09.501949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bba9216-553e31a3-872c5c7-e00b7e34_0] Write session: Do CDS request
2025-09-30T14:57:09.501958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bba9216-553e31a3-872c5c7-e00b7e34_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:09.510800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bba9216-553e31a3-872c5c7-e00b7e34_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:09.511085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:09.511104Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2462
2025-09-30T14:57:09.511279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2462 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:09.511322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2462 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:09.511328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2462 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:09.511332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:09.511939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2462 sessionId:  describe result for acl check
2025-09-30T14:57:09.511977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:09.511983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:09.511987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:09.512002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896431249023692:10645] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:09.512574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896431249023692:10645] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:09.514970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896431249023692:10645] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:09.524649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896431249023692:10645] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:09.524669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896431249023692:10645] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:09.524673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896431249023692:10645] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:09.524683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2462 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:09.527228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:09.529840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:09.530012Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:09.530023Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:09.530033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:09.530100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:09.530142Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896431159234040:11269]
2025-09-30T14:57:09.530688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:09.531027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:09.531083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:09.531479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:09.531545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:09.531552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:09.531553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:09.531554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:09.531556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:09.531557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:09.531558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:09.531559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:09.531561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:09.531562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:09.531563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.531564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:09.531566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:09.531568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:09.531569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:09.531575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:09.531586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:09.531591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:09.531596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:09.531600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:09.531605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:09.531609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:09.531613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:09.531618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:09.531623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:09.531628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.531632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:09.531636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:09.531641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:09.531645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:09.531655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:09.531664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:09.531671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:09.531677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:09.531682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:09.531689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:09.531694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:09.531705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:09.531711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:09.531717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:09.531726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:09.531733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:09.531738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:09.531744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:09.531749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:09.531754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:09.531764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:09.531770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:09.531780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:09.531786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:09.531796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.531802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.531807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:09.531813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:09.531819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:09.531825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:09.531830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:09.531835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:09.531841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:09.531848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:09.531900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:09.537437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:09.538896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:09.538914Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:09.538917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:09.538921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:09.538928Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2461 [2:7555896431159234040:11269]
2025-09-30T14:57:09.538947Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:09.538962Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:09.538965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:09.538968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:09.538971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:09.538987Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:09.538999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:09.539004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:09.539052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.539058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:09.539059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:09.539062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:09.539064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:09.539116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:09.539123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.539132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:09.539139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:09.539148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:09.539163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896431159234035:11269]
2025-09-30T14:57:09.539169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896431159234035:11269]
2025-09-30T14:57:09.539171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896431159234035:11269]
2025-09-30T14:57:09.539178Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:09.539188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:09.539199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:09.539201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:09.539208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:09.539217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:09.539219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:09.539230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896431159234035:11269]
2025-09-30T14:57:09.539233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:09.539236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:09.539278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896431249023586:2454], now have 1 active actors on pipe
2025-09-30T14:57:09.539284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896431249023988:10645], now have 1 active actors on pipe
2025-09-30T14:57:09.539375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2461
2025-09-30T14:57:09.539429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2461
2025-09-30T14:57:09.539524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:09.539536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:09.539555Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d9ef223-b72f3067-210b7991-3af05d2e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:09.539565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:09.539567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:09.539569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:09.539576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:09.539591Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:09.539610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:09.539759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:09.539767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:09.539781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:09.539909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2462 partition: 0 MaxSeqNo: 42 sessionId: src_id|3d9ef223-b72f3067-210b7991-3af05d2e_0
2025-09-30T14:57:09.540290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bba9216-553e31a3-872c5c7-e00b7e34_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3d9ef223-b72f3067-210b7991-3af05d2e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:09.543269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d9ef223-b72f3067-210b7991-3af05d2e_0] Write session: try to update token
2025-09-30T14:57:09.543293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d9ef223-b72f3067-210b7991-3af05d2e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:09.553253Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:09.553272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:09.553275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:09.553277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:09.553288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896431159234035:11269]
2025-09-30T14:57:09.553294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896431159234035:11269]
2025-09-30T14:57:09.553299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896431159234035:11269]
2025-09-30T14:57:09.553347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:09.553355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.553354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:09.553358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:09.553360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:09.553363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:09.553529Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:09.559278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2462 sessionId: src_id|3d9ef223-b72f3067-210b7991-3af05d2e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:09.562206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:09.598946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896431249024015:10294]
2025-09-30T14:57:09.599310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2461, pipe: [1:7555896431249024015:10294]
2025-09-30T14:57:09.666700Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:09.667029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:09.667039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:09.667078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896431249024015:10294], now have 1 active actors on pipe
2025-09-30T14:57:09.667325Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:09.667358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:09.667421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896431249024015:10294]
2025-09-30T14:57:09.667441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:09.667529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2462 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3d9ef223-b72f3067-210b7991-3af05d2e_0
2025-09-30T14:57:09.667719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2462 sessionId: src_id|3d9ef223-b72f3067-210b7991-3af05d2e_0 is DEAD
2025-09-30T14:57:09.670864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d9ef223-b72f3067-210b7991-3af05d2e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:09.670876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d9ef223-b72f3067-210b7991-3af05d2e_0] Write session will restart in 0.008058s
2025-09-30T14:57:09.670912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d9ef223-b72f3067-210b7991-3af05d2e_0] Write session: Do CDS request
2025-09-30T14:57:09.670919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d9ef223-b72f3067-210b7991-3af05d2e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:09.679781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d9ef223-b72f3067-210b7991-3af05d2e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:09.679916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:09.679931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2463
2025-09-30T14:57:09.680444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2463 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:09.680490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2463 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:09.680506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2463 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:09.680513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:09.681049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2463 sessionId:  describe result for acl check
2025-09-30T14:57:09.681084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:09.681090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:09.681092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:09.681098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896431249024163:10649] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:09.681671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896431249024163:10649] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:09.684507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896431249024163:10649] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:09.687775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896431249024163:10649] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:09.687790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896431249024163:10649] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:09.687796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896431249024163:10649] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:09.687806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2463 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:09.693224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:09.695715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:09.695923Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:09.695933Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:09.695943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:09.695994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:09.696037Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896431159234341:11272]
2025-09-30T14:57:09.696742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:09.697098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:09.697181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:09.697549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:09.697627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:09.697634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:09.697635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:09.697636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:09.697637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:09.697639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:09.697640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:09.697641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:09.697642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:09.697643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:09.697644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.697645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:09.697647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:09.697648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:09.697649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:09.697655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:09.697667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:09.697671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:09.697676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:09.697680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:09.697684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:09.697688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:09.697693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:09.697697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:09.697702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:09.697706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.697710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:09.697714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:09.697718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:09.697722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:09.697730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:09.697739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:09.697745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:09.697751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:09.697756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:09.697762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:09.697772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:09.697778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:09.697783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:09.697793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:09.697798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:09.697803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:09.697812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:09.697818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:09.697823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:09.697832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:09.697838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:09.697847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:09.697852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:09.697857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:09.697862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.697868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.697872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:09.697878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:09.697882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:09.697887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:09.697892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:09.697897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:09.697902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:09.697909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:09.697961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:09.704705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:09.705607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:09.705627Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:09.705630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:09.705634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:09.705641Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2462 [2:7555896431159234341:11272]
2025-09-30T14:57:09.705659Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:09.705675Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:09.705678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:09.705681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:09.705684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:09.705700Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:09.705716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:09.705725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:09.705797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.705806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:09.705809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:09.705813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:09.705816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:09.705889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:09.705897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.705911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:09.705922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:09.705941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:09.705966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896431249024016:2454], now have 1 active actors on pipe
2025-09-30T14:57:09.705975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896431249024361:10649], now have 1 active actors on pipe
2025-09-30T14:57:09.705982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896431159234335:11272]
2025-09-30T14:57:09.705989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896431159234335:11272]
2025-09-30T14:57:09.705992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896431159234335:11272]
2025-09-30T14:57:09.706006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:09.706025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:09.706026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:09.706030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:09.706032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:09.706044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:09.706048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:09.706084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896431159234335:11272]
2025-09-30T14:57:09.706102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:09.706115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:09.706088Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2462
2025-09-30T14:57:09.706150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2462
2025-09-30T14:57:09.706238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:09.706261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:09.706293Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ba69465-4a73e5f4-83ad73b0-1b14f97a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:09.706305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:09.706311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:09.706314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:09.706328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:09.706380Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:09.706402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:09.706609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:09.706617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:09.706634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:09.706775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2463 partition: 0 MaxSeqNo: 42 sessionId: src_id|5ba69465-4a73e5f4-83ad73b0-1b14f97a_0
2025-09-30T14:57:09.707164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d9ef223-b72f3067-210b7991-3af05d2e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5ba69465-4a73e5f4-83ad73b0-1b14f97a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:09.710130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ba69465-4a73e5f4-83ad73b0-1b14f97a_0] Write session: try to update token
2025-09-30T14:57:09.710153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ba69465-4a73e5f4-83ad73b0-1b14f97a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:09.721652Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:09.721673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:09.721676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:09.721678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:09.721688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896431159234335:11272]
2025-09-30T14:57:09.721693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896431159234335:11272]
2025-09-30T14:57:09.721698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896431159234335:11272]
2025-09-30T14:57:09.721740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:09.721748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.721751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:09.721752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:09.721759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:09.721763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:09.721894Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:09.740368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2463 sessionId: src_id|5ba69465-4a73e5f4-83ad73b0-1b14f97a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:09.743519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:09.769027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896431249024449:10294]
2025-09-30T14:57:09.769374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2462, pipe: [1:7555896431249024449:10294]
2025-09-30T14:57:09.841302Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:09.841862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:09.841878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:09.841897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896431249024449:10294], now have 1 active actors on pipe
2025-09-30T14:57:09.842105Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:09.842611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:09.842703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:09.842708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2463 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5ba69465-4a73e5f4-83ad73b0-1b14f97a_0
2025-09-30T14:57:09.842764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896431249024449:10294]
2025-09-30T14:57:09.842868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2463 sessionId: src_id|5ba69465-4a73e5f4-83ad73b0-1b14f97a_0 is DEAD
2025-09-30T14:57:09.843097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ba69465-4a73e5f4-83ad73b0-1b14f97a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:09.843109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ba69465-4a73e5f4-83ad73b0-1b14f97a_0] Write session will restart in 0.006314s
2025-09-30T14:57:09.843133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ba69465-4a73e5f4-83ad73b0-1b14f97a_0] Write session: Do CDS request
2025-09-30T14:57:09.843139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ba69465-4a73e5f4-83ad73b0-1b14f97a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:09.850819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ba69465-4a73e5f4-83ad73b0-1b14f97a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:09.852386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:09.852413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2464
2025-09-30T14:57:09.852661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2464 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:09.852709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2464 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:09.852715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2464 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:09.852719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:09.853387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2464 sessionId:  describe result for acl check
2025-09-30T14:57:09.853426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:09.853428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:09.853431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:09.853437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896431249024484:10654] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:09.853998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896431249024484:10654] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:09.857658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896431249024484:10654] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:09.861000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896431249024484:10654] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:09.861015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896431249024484:10654] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:09.861019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896431249024484:10654] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:09.861028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2464 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:09.873915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:09.877379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:09.877618Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:09.877630Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:09.877642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:09.877697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:09.877743Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896431159234643:11274]
2025-09-30T14:57:09.878443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:09.878808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:09.878862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:09.879228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:09.879316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:09.879324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:09.879326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:09.879327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:09.879328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:09.879329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:09.879331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:09.879333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:09.879334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:09.879335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:09.879337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.879339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:09.879340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:09.879341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:09.879342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:09.879349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:09.879360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:09.879365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:09.879370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:09.879375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:09.879380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:09.879384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:09.879388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:09.879393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:09.879398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:09.879403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.879408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:09.879412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:09.879417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:09.879421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:09.879431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:09.879439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:09.879446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:09.879453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:09.879464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:09.879470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:09.879477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:09.879489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:09.879495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:09.879505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:09.879511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:09.879517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:09.879528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:09.879535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:09.879546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:09.879552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:09.879561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:09.879567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:09.879572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:09.879578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:09.879584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.879590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.879599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:09.879605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:09.879612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:09.879619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:09.879629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:09.879634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:09.879648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:09.879659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:09.879704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:09.885385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:09.886607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:09.886624Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:09.886627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:09.886631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:09.886638Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2463 [2:7555896431159234643:11274]
2025-09-30T14:57:09.886655Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:09.886670Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:09.886673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:09.886676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:09.886679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:09.886696Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:09.886708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:09.886715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:09.886778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.886787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:09.886790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:09.886794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:09.886797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:09.886870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:09.886878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.887006Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2463
2025-09-30T14:57:09.887054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2463
2025-09-30T14:57:09.886892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:09.886912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:09.886932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:09.886952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896431249024450:2454], now have 1 active actors on pipe
2025-09-30T14:57:09.886956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896431249024645:10654], now have 1 active actors on pipe
2025-09-30T14:57:09.886963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896431159234638:11274]
2025-09-30T14:57:09.886965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896431159234638:11274]
2025-09-30T14:57:09.886969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896431159234638:11274]
2025-09-30T14:57:09.886982Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:09.886996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:09.886996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:09.887000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:09.887002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:09.887012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:09.887015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:09.887047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896431159234638:11274]
2025-09-30T14:57:09.887054Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:09.887065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:09.887213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:09.887218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:09.887277Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6dbeaa2-60ee8a3c-92d7f14f-c1eb1255_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:09.887285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:09.887289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:09.887291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:09.887301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:09.887312Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:09.887327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:09.887576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:09.887585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:09.887600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:09.887708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2464 partition: 0 MaxSeqNo: 42 sessionId: src_id|d6dbeaa2-60ee8a3c-92d7f14f-c1eb1255_0
2025-09-30T14:57:09.888099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ba69465-4a73e5f4-83ad73b0-1b14f97a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d6dbeaa2-60ee8a3c-92d7f14f-c1eb1255_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:09.890851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6dbeaa2-60ee8a3c-92d7f14f-c1eb1255_0] Write session: try to update token
2025-09-30T14:57:09.890868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6dbeaa2-60ee8a3c-92d7f14f-c1eb1255_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:09.899585Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:09.899615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:09.899637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:09.899640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:09.899655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896431159234638:11274]
2025-09-30T14:57:09.899662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896431159234638:11274]
2025-09-30T14:57:09.899669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896431159234638:11274]
2025-09-30T14:57:09.899716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:09.899725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:09.899730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:09.899751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:09.899761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:09.899768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:09.899937Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:09.909607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2464 sessionId: src_id|d6dbeaa2-60ee8a3c-92d7f14f-c1eb1255_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:09.912246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:09.942964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896431249024882:10294]
2025-09-30T14:57:09.943260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2463, pipe: [1:7555896431249024882:10294]
2025-09-30T14:57:10.025185Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:10.025946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:10.025957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:10.025976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896431249024882:10294], now have 1 active actors on pipe
2025-09-30T14:57:10.026691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:10.026744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896431249024882:10294]
2025-09-30T14:57:10.026762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:10.026765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:10.026818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2464 reason: error at write: Disconnected sessionId: src_id|d6dbeaa2-60ee8a3c-92d7f14f-c1eb1255_0
2025-09-30T14:57:10.026604Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:10.026975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2464 sessionId: src_id|d6dbeaa2-60ee8a3c-92d7f14f-c1eb1255_0 is DEAD
2025-09-30T14:57:10.028669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6dbeaa2-60ee8a3c-92d7f14f-c1eb1255_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:10.028682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6dbeaa2-60ee8a3c-92d7f14f-c1eb1255_0] Write session will restart in 0.005359s
2025-09-30T14:57:10.028706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6dbeaa2-60ee8a3c-92d7f14f-c1eb1255_0] Write session: Do CDS request
2025-09-30T14:57:10.028713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6dbeaa2-60ee8a3c-92d7f14f-c1eb1255_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:10.034679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6dbeaa2-60ee8a3c-92d7f14f-c1eb1255_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:10.035062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:10.035081Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2465
2025-09-30T14:57:10.035328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2465 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:10.035375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2465 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:10.035381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2465 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:10.035394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:10.035876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2465 sessionId:  describe result for acl check
2025-09-30T14:57:10.035916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:10.035922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:10.035925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:10.035930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896435543992189:10658] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:10.036514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896435543992189:10658] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:10.038420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896435543992189:10658] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:10.044121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896435543992189:10658] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:10.044137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896435543992189:10658] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:10.044141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896435543992189:10658] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:10.044150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2465 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:10.088076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:10.091410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:10.091642Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:10.091651Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:10.091661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:10.091712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:10.091752Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896435454202256:11278]
2025-09-30T14:57:10.092342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:10.092681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:10.092727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:10.093063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:10.093130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:10.093137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:10.093149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:10.093150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:10.093151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:10.093153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:10.093154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:10.093156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:10.093157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:10.093159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:10.093160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.093161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.093163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.093164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:10.093165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:10.093171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:10.093182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:10.093187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:10.093191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:10.093194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:10.093198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:10.093203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:10.093206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:10.093209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:10.093215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:10.093219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.093223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.093226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.093230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:10.093234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:10.093242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:10.093251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:10.093257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:10.093263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:10.093268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:10.093274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:10.093279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:10.093286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:10.093291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:10.093296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:10.093301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:10.093307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:10.093312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:10.093318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:10.093327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:10.093333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:10.093343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:10.093348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:10.093353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:10.093360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:10.093368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.093372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.093376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.093380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.093387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.093392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.093397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:10.093402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:10.093408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:10.093414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:10.093458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:10.099311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:10.100542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:10.100562Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:10.100565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:10.100569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:10.100576Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2464 [2:7555896435454202256:11278]
2025-09-30T14:57:10.100595Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:10.100612Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:10.100625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:10.100628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:10.100631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:10.100649Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:10.100656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:10.100664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:10.100737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.100746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.100749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.100753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:10.100756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:10.101306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:10.101322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.101340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.101356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.101382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:10.101410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896435454202251:11278]
2025-09-30T14:57:10.101413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896435454202251:11278]
2025-09-30T14:57:10.101416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896435454202251:11278]
2025-09-30T14:57:10.101434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:10.101457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:10.101461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:10.101467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:10.101469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:10.101480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:10.101484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:10.101531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896435454202251:11278]
2025-09-30T14:57:10.101541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:10.101572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:10.101794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2464
2025-09-30T14:57:10.101823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896435543992231:10658], now have 1 active actors on pipe
2025-09-30T14:57:10.101833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896435543992180:2454], now have 1 active actors on pipe
2025-09-30T14:57:10.101862Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2464
2025-09-30T14:57:10.101952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:10.101962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:10.101989Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3bba4cd6-88e2436-2c1f5723-34fe4e92_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:10.102003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:10.102013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:10.102015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:10.102027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:10.102042Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:10.102064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:10.102418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:10.102429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:10.102447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:10.102596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2465 partition: 0 MaxSeqNo: 42 sessionId: src_id|3bba4cd6-88e2436-2c1f5723-34fe4e92_0
2025-09-30T14:57:10.103030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6dbeaa2-60ee8a3c-92d7f14f-c1eb1255_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3bba4cd6-88e2436-2c1f5723-34fe4e92_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:10.105889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bba4cd6-88e2436-2c1f5723-34fe4e92_0] Write session: try to update token
2025-09-30T14:57:10.105913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bba4cd6-88e2436-2c1f5723-34fe4e92_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:10.119630Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:10.119651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:10.119661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896435454202251:11278]
2025-09-30T14:57:10.119707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:10.119882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:10.120023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:10.120160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:10.120296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:10.120497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:10.120531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:10.120743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:10.123958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2465 sessionId: src_id|3bba4cd6-88e2436-2c1f5723-34fe4e92_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:10.126675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:10.126982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:10.127009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:10.127044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:10.128665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896435543992612:10294], now have 1 active actors on pipe
2025-09-30T14:57:10.127197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:10.128295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896435543992612:10294]
2025-09-30T14:57:10.128567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2464, pipe: [1:7555896435543992612:10294]
2025-09-30T14:57:10.132998Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:10.133021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:10.133023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:10.133025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:10.133036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896435454202251:11278]
2025-09-30T14:57:10.133040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896435454202251:11278]
2025-09-30T14:57:10.133044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896435454202251:11278]
2025-09-30T14:57:10.133086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:10.133090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:10.133093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.133095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:10.133098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:10.133103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:10.133351Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:10.245946Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:10.253677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:10.253706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:10.253888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:10.253965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:10.254041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:10.254119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:10.254163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:10.254177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:10.254255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:10.254330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:10.254397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:10.254474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:10.254519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:10.254522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:10.254606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:10.254672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:10.254745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:10.254817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:10.254857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:10.254861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:10.254943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:10.255020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:10.255089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:10.255161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:10.255202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:10.255205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:10.255335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:10.255405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:10.255483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:10.255553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:10.255601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:10.255609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:10.255700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:10.257607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:10.257622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:10.257622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:10.257653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2465 reason: error at write: Disconnected sessionId: src_id|3bba4cd6-88e2436-2c1f5723-34fe4e92_0
2025-09-30T14:57:10.257688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896435543992612:10294]
2025-09-30T14:57:10.257829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2465 sessionId: src_id|3bba4cd6-88e2436-2c1f5723-34fe4e92_0 is DEAD
2025-09-30T14:57:10.257989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bba4cd6-88e2436-2c1f5723-34fe4e92_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:10.258000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bba4cd6-88e2436-2c1f5723-34fe4e92_0] Write session will restart in 0.005716s
2025-09-30T14:57:10.258024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bba4cd6-88e2436-2c1f5723-34fe4e92_0] Write session: Do CDS request
2025-09-30T14:57:10.258029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bba4cd6-88e2436-2c1f5723-34fe4e92_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:10.255773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:10.255845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:10.255906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:10.255952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:10.255956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:10.256029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:10.256087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:10.256149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:10.256212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:10.256259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:10.256262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:10.256333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:10.256395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:10.256466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:10.256533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:10.256578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:10.256581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:10.256661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:10.256728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:10.256798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:10.256868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:10.256912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:10.256915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:10.256996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:10.257063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:10.257134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:10.257219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:10.257266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:10.257269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:10.258652Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:10.267772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bba4cd6-88e2436-2c1f5723-34fe4e92_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:10.268138Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:10.268152Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2466
2025-09-30T14:57:10.268298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2466 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:10.268336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2466 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:10.268341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2466 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:10.268345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:10.268867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2466 sessionId:  describe result for acl check
2025-09-30T14:57:10.268907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:10.268909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:10.268911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:10.268928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896435543992677:10664] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:10.269527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896435543992677:10664] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:10.274826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896435543992677:10664] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:10.277878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896435543992677:10664] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:10.277898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896435543992677:10664] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:10.277911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896435543992677:10664] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:10.277919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2466 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:10.291534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:10.294497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:10.294723Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:10.294734Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:10.294745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:10.294800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:10.294846Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896435454202560:11280]
2025-09-30T14:57:10.295560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:10.295998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:10.296076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:10.296486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:10.296573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:10.296585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:10.296587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:10.296588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:10.296590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:10.296592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:10.296593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:10.296594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:10.296596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:10.296597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:10.296598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.296600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.296601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.296602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:10.296604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:10.296610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:10.296621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:10.296625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:10.296630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:10.296633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:10.296636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:10.296639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:10.296642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:10.296646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:10.296650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:10.296654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.296658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.296661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.296665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:10.296669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:10.296677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:10.296685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:10.296692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:10.296698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:10.296703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:10.296710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:10.296714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:10.296720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:10.296726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:10.296731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:10.296735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:10.296741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:10.296745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:10.296751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:10.296762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:10.296768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:10.296772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:10.296778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:10.296783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:10.296788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:10.296798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.296803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.296808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.296812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.296816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.296821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.296824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:10.296829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:10.296834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:10.296839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:10.296884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:10.306042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2465
2025-09-30T14:57:10.306053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2465
2025-09-30T14:57:10.304738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:10.305617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:10.305623Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:10.305627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:10.305631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:10.305639Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2465 [2:7555896435454202560:11280]
2025-09-30T14:57:10.305657Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:10.305674Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:10.305678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:10.305681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:10.305684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:10.305700Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:10.305708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:10.305715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:10.305778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.305781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.305783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.305787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:10.305790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:10.305865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:10.305868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.305881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.305894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.305911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:10.305930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896435543992849:10664], now have 1 active actors on pipe
2025-09-30T14:57:10.305937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896435454202555:11280]
2025-09-30T14:57:10.305939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896435454202555:11280]
2025-09-30T14:57:10.305942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896435454202555:11280]
2025-09-30T14:57:10.305950Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:10.305960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896435543992632:2454], now have 1 active actors on pipe
2025-09-30T14:57:10.305967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:10.305982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:10.305985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:10.305988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:10.306002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:10.306005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:10.306022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896435454202555:11280]
2025-09-30T14:57:10.306025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:10.306028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:10.306319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:10.306335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:10.306366Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|73882519-ed7c924-d0848c1-6184668a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:10.306374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:10.306377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:10.306380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:10.306390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:10.306400Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:10.306415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:10.306751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:10.306758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:10.306772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:10.306861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2466 partition: 0 MaxSeqNo: 42 sessionId: src_id|73882519-ed7c924-d0848c1-6184668a_0
2025-09-30T14:57:10.307342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bba4cd6-88e2436-2c1f5723-34fe4e92_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|73882519-ed7c924-d0848c1-6184668a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:10.310243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73882519-ed7c924-d0848c1-6184668a_0] Write session: try to update token
2025-09-30T14:57:10.310263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73882519-ed7c924-d0848c1-6184668a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:10.319379Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:10.319399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:10.319402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:10.319404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:10.319414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896435454202555:11280]
2025-09-30T14:57:10.319419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896435454202555:11280]
2025-09-30T14:57:10.319423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896435454202555:11280]
2025-09-30T14:57:10.319466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:10.319473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.319476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:10.319484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:10.319492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:10.319500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:10.319623Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:10.330234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2466 sessionId: src_id|73882519-ed7c924-d0848c1-6184668a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:10.333182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:10.357692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896435543993080:10294]
2025-09-30T14:57:10.358086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2465, pipe: [1:7555896435543993080:10294]
2025-09-30T14:57:10.436354Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:10.437025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:10.437045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:10.437066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896435543993080:10294], now have 1 active actors on pipe
2025-09-30T14:57:10.438156Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:10.437718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:10.437743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:10.437808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2466 reason: error at write: Disconnected sessionId: src_id|73882519-ed7c924-d0848c1-6184668a_0
2025-09-30T14:57:10.437987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2466 sessionId: src_id|73882519-ed7c924-d0848c1-6184668a_0 is DEAD
2025-09-30T14:57:10.438168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:10.438212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896435543993080:10294]
2025-09-30T14:57:10.438961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73882519-ed7c924-d0848c1-6184668a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:10.438970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73882519-ed7c924-d0848c1-6184668a_0] Write session will restart in 0.008719s
2025-09-30T14:57:10.438996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73882519-ed7c924-d0848c1-6184668a_0] Write session: Do CDS request
2025-09-30T14:57:10.439003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73882519-ed7c924-d0848c1-6184668a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:10.448768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73882519-ed7c924-d0848c1-6184668a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:10.448882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:10.448900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2467
2025-09-30T14:57:10.449004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2467 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:10.449037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2467 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:10.449043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2467 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:10.449048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:10.449574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2467 sessionId:  describe result for acl check
2025-09-30T14:57:10.449615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:10.449617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:10.449619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:10.449625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896435543993102:10675] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:10.450159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896435543993102:10675] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:10.452453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896435543993102:10675] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:10.456662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896435543993102:10675] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:10.456677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896435543993102:10675] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:10.456680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896435543993102:10675] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:10.456687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2467 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:10.474923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:10.478505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:10.479097Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:10.479112Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:10.479124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:10.479182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:10.479226Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896435454202908:11294]
2025-09-30T14:57:10.479958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:10.480305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:10.480353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:10.480696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:10.480758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:10.480766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:10.480768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:10.480769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:10.480771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:10.480772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:10.480774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:10.480775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:10.480777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:10.480779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:10.480780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.480781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.480783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.480784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:10.480785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:10.480791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:10.480803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:10.480808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:10.480813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:10.480818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:10.480822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:10.480827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:10.480832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:10.480836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:10.480841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:10.480845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.480850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.480855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.480859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:10.480863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:10.480871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:10.480879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:10.480885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:10.480891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:10.480897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:10.480903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:10.480908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:10.480914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:10.480919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:10.480925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:10.480930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:10.480937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:10.480943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:10.480949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:10.480953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:10.480960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:10.480976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:10.480983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:10.480988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:10.480994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:10.481000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.481005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.481010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.481022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.481029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.481035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.481040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:10.481046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:10.481051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:10.481058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:10.481111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:10.492652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:10.493724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:10.493740Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:10.493743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:10.493748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:10.493755Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2466 [2:7555896435454202908:11294]
2025-09-30T14:57:10.493774Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:10.493794Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:10.493803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:10.493806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:10.493809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:10.493825Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:10.493839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:10.493847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:10.493915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.493923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.493925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.493929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:10.493932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:10.494001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:10.494008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.494022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.494037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.494062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:10.494084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896435454202895:11294]
2025-09-30T14:57:10.494091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896435454202895:11294]
2025-09-30T14:57:10.494094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896435454202895:11294]
2025-09-30T14:57:10.494103Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:10.494115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:10.494124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:10.494128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:10.494130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:10.494141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:10.494144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:10.494153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896435543993094:2454], now have 1 active actors on pipe
2025-09-30T14:57:10.494163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896435543993176:10675], now have 1 active actors on pipe
2025-09-30T14:57:10.494198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896435454202895:11294]
2025-09-30T14:57:10.494211Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:10.494244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:10.494277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2466
2025-09-30T14:57:10.494321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2466
2025-09-30T14:57:10.494449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:10.494474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:10.494507Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f81241ad-db4def81-18150f5f-cb361e82_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:10.494515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:10.494519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:10.494521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:10.494533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:10.494544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:10.494560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:10.494805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:10.494812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:10.494827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:10.494927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2467 partition: 0 MaxSeqNo: 42 sessionId: src_id|f81241ad-db4def81-18150f5f-cb361e82_0
2025-09-30T14:57:10.495375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73882519-ed7c924-d0848c1-6184668a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f81241ad-db4def81-18150f5f-cb361e82_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:10.498147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f81241ad-db4def81-18150f5f-cb361e82_0] Write session: try to update token
2025-09-30T14:57:10.498163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f81241ad-db4def81-18150f5f-cb361e82_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:10.515753Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:10.515777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:10.515787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896435454202895:11294]
2025-09-30T14:57:10.515835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:10.515841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:10.516012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:10.516154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:10.516292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:10.516438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:10.516667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:10.516719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:10.519304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2467 sessionId: src_id|f81241ad-db4def81-18150f5f-cb361e82_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:10.522081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:10.522559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:10.522582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:10.522617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:10.522728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:10.538444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896435543993535:10294]
2025-09-30T14:57:10.540359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2466, pipe: [1:7555896435543993535:10294]
2025-09-30T14:57:10.540696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896435543993535:10294], now have 1 active actors on pipe
2025-09-30T14:57:10.541884Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:10.541901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:10.541903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:10.541905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:10.541914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896435454202895:11294]
2025-09-30T14:57:10.541920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896435454202895:11294]
2025-09-30T14:57:10.541924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896435454202895:11294]
2025-09-30T14:57:10.541963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:10.541970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.541972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:10.541984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:10.541994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:10.541997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:10.542105Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:10.653182Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:10.662552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:10.662581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:10.662763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:10.662829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:10.662898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:10.662959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:10.663149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:10.663157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:10.663220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:10.663307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:10.663372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:10.663435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:10.663485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:10.663492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:10.663555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:10.663612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:10.663675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:10.663753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:10.663798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:10.663807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:10.663883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:10.663951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:10.664015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:10.664075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:10.664118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:10.664125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:10.664188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:10.664248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:10.664304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:10.664372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:10.664417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:10.664420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:10.664485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:10.664536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:10.664597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:10.664663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:10.664706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:10.664709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:10.667168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:10.667228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896435543993535:10294]
2025-09-30T14:57:10.667267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:10.667270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:10.664780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:10.664840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:10.664911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:10.664976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:10.665017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:10.665020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:10.665090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:10.665164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:10.665226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:10.665288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:10.665328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:10.665333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:10.665406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:10.665465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:10.665522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:10.665580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:10.667298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2467 reason: error at write: Disconnected sessionId: src_id|f81241ad-db4def81-18150f5f-cb361e82_0
2025-09-30T14:57:10.665624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:10.665626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:10.665694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:10.665748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:10.665805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:10.665869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:10.665913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:10.665915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:10.667215Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:10.667492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2467 sessionId: src_id|f81241ad-db4def81-18150f5f-cb361e82_0 is DEAD
2025-09-30T14:57:10.667642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f81241ad-db4def81-18150f5f-cb361e82_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:10.667653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f81241ad-db4def81-18150f5f-cb361e82_0] Write session will restart in 0.006682s
2025-09-30T14:57:10.667678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f81241ad-db4def81-18150f5f-cb361e82_0] Write session: Do CDS request
2025-09-30T14:57:10.667683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f81241ad-db4def81-18150f5f-cb361e82_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:10.674927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:10.675847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f81241ad-db4def81-18150f5f-cb361e82_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:10.675993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:10.676010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2468
2025-09-30T14:57:10.676385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:10.676622Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:10.676642Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:10.676654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:10.676712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:10.676759Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896435454202967:11297]
2025-09-30T14:57:10.677476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:10.677857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:10.677907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:10.678263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:10.678331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:10.678344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:10.678346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:10.678347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:10.678348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:10.678350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:10.678351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:10.678353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:10.678355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:10.678356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:10.678357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.678358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.678360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.678361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:10.678363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:10.678370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:10.678381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:10.678385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:10.678389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:10.678394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:10.678399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:10.678404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:10.678409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:10.678413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:10.678422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:10.678426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.678431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.678435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.678440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:10.678444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:10.678453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:10.678460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:10.678467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:10.678473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:10.678481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:10.678488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:10.678493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:10.678499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:10.678504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:10.678510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:10.678517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:10.678524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:10.678529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:10.678545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:10.678550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:10.678556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:10.678562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:10.678566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:10.678571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:10.678577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:10.678583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.678587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.678707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.678724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.678729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.678735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.678740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:10.678746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:10.678751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:10.678771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:10.678829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:10.679485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2468 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:10.679534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2468 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:10.679539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2468 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:10.679544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:10.680056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2468 sessionId:  describe result for acl check
2025-09-30T14:57:10.680088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:10.680093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:10.680095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:10.680101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896435543993563:10679] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:10.680636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896435543993563:10679] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:10.685055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:10.685647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896435543993563:10679] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:10.685958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:10.685977Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:10.685980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:10.685984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:10.685991Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2467 [2:7555896435454202967:11297]
2025-09-30T14:57:10.686009Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:10.686026Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:10.686030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:10.686033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:10.686036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:10.686051Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:10.686058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:10.686066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:10.686136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.686147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.686149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.686155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:10.686159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:10.686226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:10.686234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.686246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.686257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.686273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:10.686293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896435543993538:2454], now have 1 active actors on pipe
2025-09-30T14:57:10.686305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896435454202962:11297]
2025-09-30T14:57:10.686313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896435454202962:11297]
2025-09-30T14:57:10.686316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896435454202962:11297]
2025-09-30T14:57:10.686330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:10.686350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:10.686364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:10.686367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:10.686378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2467
2025-09-30T14:57:10.686389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:10.686399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:10.686401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:10.686404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896435454202962:11297]
2025-09-30T14:57:10.686406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:10.686409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:10.691995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896435543993563:10679] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:10.692014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896435543993563:10679] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:10.692018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896435543993563:10679] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:10.692027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2468 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:10.692332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896435543993601:10679], now have 1 active actors on pipe
2025-09-30T14:57:10.692430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2467
2025-09-30T14:57:10.692509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:10.692525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:10.692563Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a413d813-3ee436e7-94ae051f-b3bbcf1d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:10.692576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:10.692582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:10.692585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:10.692602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:10.692618Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:10.692646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:10.692808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:10.692818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:10.692831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:10.692904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2468 partition: 0 MaxSeqNo: 42 sessionId: src_id|a413d813-3ee436e7-94ae051f-b3bbcf1d_0
2025-09-30T14:57:10.693290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f81241ad-db4def81-18150f5f-cb361e82_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a413d813-3ee436e7-94ae051f-b3bbcf1d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:10.696303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a413d813-3ee436e7-94ae051f-b3bbcf1d_0] Write session: try to update token
2025-09-30T14:57:10.696328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a413d813-3ee436e7-94ae051f-b3bbcf1d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:10.699355Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:10.699381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:10.699398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896435454202962:11297]
2025-09-30T14:57:10.699464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:10.699472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:10.699752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:10.699993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:10.700221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:10.700397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:10.700653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:10.700702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:10.711280Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:10.711300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:10.711303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:10.711305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:10.711316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896435454202962:11297]
2025-09-30T14:57:10.711320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896435454202962:11297]
2025-09-30T14:57:10.711324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896435454202962:11297]
2025-09-30T14:57:10.711364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:10.711375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:10.711382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.711383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:10.711384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:10.711399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:10.711532Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:10.721466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2468 sessionId: src_id|a413d813-3ee436e7-94ae051f-b3bbcf1d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:10.724155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:10.767331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896435543993606:10294]
2025-09-30T14:57:10.767666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2467, pipe: [1:7555896435543993606:10294]
2025-09-30T14:57:10.830386Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:10.830834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:10.830849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:10.830872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896435543993606:10294], now have 1 active actors on pipe
2025-09-30T14:57:10.831118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:10.831126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896435543993606:10294]
2025-09-30T14:57:10.831162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:10.831172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:10.831252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2468 reason: error at write: Disconnected sessionId: src_id|a413d813-3ee436e7-94ae051f-b3bbcf1d_0
2025-09-30T14:57:10.831456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2468 sessionId: src_id|a413d813-3ee436e7-94ae051f-b3bbcf1d_0 is DEAD
2025-09-30T14:57:10.831533Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:10.831822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a413d813-3ee436e7-94ae051f-b3bbcf1d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:10.831835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a413d813-3ee436e7-94ae051f-b3bbcf1d_0] Write session will restart in 0.008235s
2025-09-30T14:57:10.831859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a413d813-3ee436e7-94ae051f-b3bbcf1d_0] Write session: Do CDS request
2025-09-30T14:57:10.831865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a413d813-3ee436e7-94ae051f-b3bbcf1d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:10.838486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:10.840148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:10.840364Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:10.840379Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:10.840390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:10.840444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:10.840479Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896435454203024:11299]
2025-09-30T14:57:10.841216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:10.841559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:10.841603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:10.841775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a413d813-3ee436e7-94ae051f-b3bbcf1d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:10.841832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:10.841851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2469
2025-09-30T14:57:10.841971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2469 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:10.841977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:10.842006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2469 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:10.842012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2469 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:10.842016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:10.842044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:10.842063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:10.842068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:10.842069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:10.842070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:10.842071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:10.842073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:10.842074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:10.842075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:10.842077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:10.842078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.842080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.842081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.842082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:10.842084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:10.842090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:10.842101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:10.842106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:10.842117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:10.842125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:10.842133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:10.842142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:10.842146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:10.842150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:10.842157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:10.842161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.842165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.842169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.842174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:10.842178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:10.842186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:10.842194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:10.842200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:10.842207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:10.842211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:10.842217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:10.842223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:10.842229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:10.842234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:10.842240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:10.842245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:10.842251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:10.842256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:10.842262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:10.842266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:10.842271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:10.842283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:10.842287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:10.842291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:10.842296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:10.842300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.842305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.842309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.842313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.842317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.842322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.842325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:10.842329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:10.842349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:10.842354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:10.842405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:10.842438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2469 sessionId:  describe result for acl check
2025-09-30T14:57:10.842472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:10.842479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:10.842481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:10.842486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896435543993630:10684] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:10.843016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896435543993630:10684] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:10.844880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896435543993630:10684] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:10.847431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896435543993630:10684] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:10.847446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896435543993630:10684] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:10.847451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896435543993630:10684] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:10.847459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2469 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:10.847822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:10.848656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:10.848672Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:10.848674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:10.848679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:10.848687Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2468 [2:7555896435454203024:11299]
2025-09-30T14:57:10.848704Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:10.848719Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:10.848726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:10.848730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:10.848732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:10.848748Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:10.848756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:10.848768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:10.848832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.848840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.848842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.848845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:10.848847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:10.848914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:10.848921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.848932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.848945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.848962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:10.848983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896435454203019:11299]
2025-09-30T14:57:10.848987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896435454203019:11299]
2025-09-30T14:57:10.848988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896435454203019:11299]
2025-09-30T14:57:10.849004Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:10.849020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:10.849036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:10.849042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:10.849054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:10.849066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:10.849070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:10.849073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896435454203019:11299]
2025-09-30T14:57:10.849076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:10.849164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:10.849222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896435543993608:2454], now have 1 active actors on pipe
2025-09-30T14:57:10.849231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896435543993666:10684], now have 1 active actors on pipe
2025-09-30T14:57:10.849295Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2468
2025-09-30T14:57:10.849305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2468
2025-09-30T14:57:10.849366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:10.849383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:10.849415Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5fd931b-475804d7-ae620fc2-1dfe8424_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:10.849439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:10.849447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:10.849450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:10.849461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:10.849479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:10.849500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:10.849721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:10.849732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:10.849749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:10.849834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2469 partition: 0 MaxSeqNo: 42 sessionId: src_id|b5fd931b-475804d7-ae620fc2-1dfe8424_0
2025-09-30T14:57:10.850166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a413d813-3ee436e7-94ae051f-b3bbcf1d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b5fd931b-475804d7-ae620fc2-1dfe8424_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:10.852959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5fd931b-475804d7-ae620fc2-1dfe8424_0] Write session: try to update token
2025-09-30T14:57:10.852981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5fd931b-475804d7-ae620fc2-1dfe8424_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:10.861452Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:10.861477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:10.861479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:10.861482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:10.861492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896435454203019:11299]
2025-09-30T14:57:10.861496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896435454203019:11299]
2025-09-30T14:57:10.861500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896435454203019:11299]
2025-09-30T14:57:10.861540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:10.861545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:10.861550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.861552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:10.861554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:10.861557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:10.861693Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:10.870416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2469 sessionId: src_id|b5fd931b-475804d7-ae620fc2-1dfe8424_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:10.873309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:10.931151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896435543993675:10294]
2025-09-30T14:57:10.931458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2468, pipe: [1:7555896435543993675:10294]
2025-09-30T14:57:10.973056Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:10.973513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:10.973534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:10.973553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896435543993675:10294], now have 1 active actors on pipe
2025-09-30T14:57:10.973689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:10.973707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896435543993675:10294]
2025-09-30T14:57:10.973715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:10.973737Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:10.973747Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:10.973768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2469 reason: error at write: Disconnected sessionId: src_id|b5fd931b-475804d7-ae620fc2-1dfe8424_0
2025-09-30T14:57:10.973934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2469 sessionId: src_id|b5fd931b-475804d7-ae620fc2-1dfe8424_0 is DEAD
2025-09-30T14:57:10.974064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5fd931b-475804d7-ae620fc2-1dfe8424_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:10.974071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5fd931b-475804d7-ae620fc2-1dfe8424_0] Write session will restart in 0.009414s
2025-09-30T14:57:10.974095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5fd931b-475804d7-ae620fc2-1dfe8424_0] Write session: Do CDS request
2025-09-30T14:57:10.974104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5fd931b-475804d7-ae620fc2-1dfe8424_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:10.981526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:10.983024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:10.983219Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:10.983230Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:10.983255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:10.983313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:10.983353Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896435454203096:11303]
2025-09-30T14:57:10.983992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:10.984326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:10.984373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:10.984618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:10.984671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:10.984679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:10.984683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:10.984685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:10.984686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:10.984687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:10.984688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:10.984689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:10.984691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:10.984692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:10.984693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.984694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.984695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.984697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:10.984698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:10.984704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:10.984714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:10.984717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:10.984719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:10.984721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:10.984723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:10.984726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:10.984728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:10.984730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:10.984733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:10.984735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.984738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.984741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.984743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:10.984745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:10.984751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:10.984757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:10.984760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:10.984765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:10.984767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:10.984770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:10.984773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:10.984775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:10.984780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:10.984785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:10.984802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:10.984806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:10.984810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:10.984814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:10.984818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:10.984822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:10.984828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:10.984832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:10.984838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:10.984844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:10.984849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.984854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.984858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.984864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.984867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.984869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.984872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:10.984875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:10.984878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:10.984881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:10.984916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:10.987737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5fd931b-475804d7-ae620fc2-1dfe8424_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:10.987826Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:10.987842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2470
2025-09-30T14:57:10.988004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2470 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:10.988038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2470 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:10.988049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2470 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:10.988053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:10.988495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2470 sessionId:  describe result for acl check
2025-09-30T14:57:10.988528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:10.988534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:10.988536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:10.988542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896435543993703:10688] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:10.989084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896435543993703:10688] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:10.990260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:10.991130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:10.991147Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:10.991149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:10.991153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:10.991162Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2469 [2:7555896435454203096:11303]
2025-09-30T14:57:10.991178Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:10.991191Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:10.991199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:10.991202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:10.991204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:10.991219Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:10.991230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:10.991236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:10.991314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.991322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.991324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.991328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:10.991330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:10.991391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:10.991399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:10.991413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:10.991428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:10.991452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:10.991473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896435543993677:2454], now have 1 active actors on pipe
2025-09-30T14:57:10.991484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896435454203091:11303]
2025-09-30T14:57:10.991491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896435454203091:11303]
2025-09-30T14:57:10.991494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896435454203091:11303]
2025-09-30T14:57:10.991510Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:10.991518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:10.991522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:10.991363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896435543993703:10688] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:10.991524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:10.991468Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2469
2025-09-30T14:57:10.991527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:10.991543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:10.991551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:10.991588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896435454203091:11303]
2025-09-30T14:57:10.991603Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:10.991610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:10.997307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896435543993703:10688] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:10.997327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896435543993703:10688] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:10.997331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896435543993703:10688] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:10.997340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2470 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:10.997676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2469
2025-09-30T14:57:10.997624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896435543993754:10688], now have 1 active actors on pipe
2025-09-30T14:57:10.997753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:10.997762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:10.997798Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a1df456-c1a2447d-291b9178-ddd2a386_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:10.997809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:10.997815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:10.997818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:10.997830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:10.997845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:10.997866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:10.998055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:10.998065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:10.998079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:10.998172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2470 partition: 0 MaxSeqNo: 42 sessionId: src_id|1a1df456-c1a2447d-291b9178-ddd2a386_0
2025-09-30T14:57:10.998528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5fd931b-475804d7-ae620fc2-1dfe8424_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1a1df456-c1a2447d-291b9178-ddd2a386_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:11.001368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a1df456-c1a2447d-291b9178-ddd2a386_0] Write session: try to update token
2025-09-30T14:57:11.001392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a1df456-c1a2447d-291b9178-ddd2a386_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:11.004355Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:11.004377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:11.004389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896435454203091:11303]
2025-09-30T14:57:11.004440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:11.004443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:11.004730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:11.004938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:11.005103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:11.005298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:11.005549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:11.005603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:11.015939Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:11.015960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:11.015962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:11.015969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:11.015979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896435454203091:11303]
2025-09-30T14:57:11.015983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896435454203091:11303]
2025-09-30T14:57:11.015987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896435454203091:11303]
2025-09-30T14:57:11.016019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:11.016025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.016031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:11.016041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:11.016047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:11.016051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:11.016188Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:11.016608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2470 sessionId: src_id|1a1df456-c1a2447d-291b9178-ddd2a386_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:11.019164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:11.073990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896439838961059:10294]
2025-09-30T14:57:11.074224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2469, pipe: [1:7555896439838961059:10294]
2025-09-30T14:57:11.129125Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:11.129531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:11.129547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:11.129566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896439838961059:10294], now have 1 active actors on pipe
2025-09-30T14:57:11.129836Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:11.129822Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:11.129885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:11.129891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:11.130267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a1df456-c1a2447d-291b9178-ddd2a386_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:11.130276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a1df456-c1a2447d-291b9178-ddd2a386_0] Write session will restart in 0.008774s
2025-09-30T14:57:11.130299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a1df456-c1a2447d-291b9178-ddd2a386_0] Write session: Do CDS request
2025-09-30T14:57:11.130307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a1df456-c1a2447d-291b9178-ddd2a386_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:11.129952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2470 reason: error at write: Disconnected sessionId: src_id|1a1df456-c1a2447d-291b9178-ddd2a386_0
2025-09-30T14:57:11.129996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896439838961059:10294]
2025-09-30T14:57:11.130122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2470 sessionId: src_id|1a1df456-c1a2447d-291b9178-ddd2a386_0 is DEAD
2025-09-30T14:57:11.138795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:11.139833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a1df456-c1a2447d-291b9178-ddd2a386_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:11.139846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:11.139865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2471
2025-09-30T14:57:11.140056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2471 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:11.140095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2471 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:11.140100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2471 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:11.140105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:11.140361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:11.140547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2471 sessionId:  describe result for acl check
2025-09-30T14:57:11.140574Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:11.140583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:11.140586Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:11.140590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:11.140592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:11.140598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896439838961083:10692] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:11.140598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:11.140657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:11.140706Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896439749170451:11305]
2025-09-30T14:57:11.141119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896439838961083:10692] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:11.141409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:11.141775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:11.141827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:11.142191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:11.142258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:11.142264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:11.142267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:11.142268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:11.142270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:11.142271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:11.142272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:11.142274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:11.142285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:11.142287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:11.142288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.142289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.142290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.142291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:11.142296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:11.142302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:11.142313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:11.142317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:11.142321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:11.142326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:11.142330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:11.142334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:11.142338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:11.142342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:11.142347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:11.142351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.142359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.142363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.142371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:11.142376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:11.142384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:11.142396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:11.142406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:11.142411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:11.142416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:11.142422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:11.142427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:11.142437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:11.142441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:11.142447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:11.142451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:11.142457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:11.142465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:11.142471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:11.142479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:11.142485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:11.142494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:11.142499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:11.142505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:11.142511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:11.142519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.142525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.142533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.142538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.142541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.142546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.142550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:11.142554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:11.142560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:11.142564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:11.142611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:11.143063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896439838961083:10692] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:11.147882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896439838961083:10692] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:11.147900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896439838961083:10692] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:11.147907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896439838961083:10692] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:11.147916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2471 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:11.148721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:11.149954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2470
2025-09-30T14:57:11.149974Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2470
2025-09-30T14:57:11.149588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:11.149605Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:11.149610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:11.149614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:11.149620Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2470 [2:7555896439749170451:11305]
2025-09-30T14:57:11.149636Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:11.149650Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:11.149653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:11.149656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:11.149658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:11.149673Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:11.149683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:11.149689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:11.149743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.149745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.149747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.149750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:11.149752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:11.149820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:11.149822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.149833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.149843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.149857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:11.149872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896439749170446:11305]
2025-09-30T14:57:11.149874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896439749170446:11305]
2025-09-30T14:57:11.149876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896439749170446:11305]
2025-09-30T14:57:11.149883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:11.149896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:11.149897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:11.149899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:11.149901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:11.149910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:11.149912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:11.149921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896439838961061:2454], now have 1 active actors on pipe
2025-09-30T14:57:11.149925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896439838961122:10692], now have 1 active actors on pipe
2025-09-30T14:57:11.149955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896439749170446:11305]
2025-09-30T14:57:11.149965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:11.150002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:11.150072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:11.150079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:11.150111Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|367053ba-640043bc-766852b-e0e464e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:11.150120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:11.150127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:11.150129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:11.150140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:11.150151Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:11.150166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:11.150357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:11.150367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:11.150386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:11.150464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2471 partition: 0 MaxSeqNo: 42 sessionId: src_id|367053ba-640043bc-766852b-e0e464e2_0
2025-09-30T14:57:11.150814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a1df456-c1a2447d-291b9178-ddd2a386_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|367053ba-640043bc-766852b-e0e464e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:11.153628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|367053ba-640043bc-766852b-e0e464e2_0] Write session: try to update token
2025-09-30T14:57:11.153649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|367053ba-640043bc-766852b-e0e464e2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:11.162284Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:11.162306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:11.162308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:11.162310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:11.162319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896439749170446:11305]
2025-09-30T14:57:11.162325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896439749170446:11305]
2025-09-30T14:57:11.162329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896439749170446:11305]
2025-09-30T14:57:11.162369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:11.162372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:11.162376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.162377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:11.162378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:11.162381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:11.162526Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:11.170880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2471 sessionId: src_id|367053ba-640043bc-766852b-e0e464e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:11.174151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:11.230163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896439838961147:10294]
2025-09-30T14:57:11.230468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2470, pipe: [1:7555896439838961147:10294]
2025-09-30T14:57:11.278011Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:11.278509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:11.278528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:11.278563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896439838961147:10294], now have 1 active actors on pipe
2025-09-30T14:57:11.278809Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:11.279238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:11.279361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2471 reason: status is not ok: tablet will be restarted right now sessionId: src_id|367053ba-640043bc-766852b-e0e464e2_0
2025-09-30T14:57:11.279534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2471 sessionId: src_id|367053ba-640043bc-766852b-e0e464e2_0 is DEAD
2025-09-30T14:57:11.279683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896439838961147:10294]
2025-09-30T14:57:11.279696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:11.283504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|367053ba-640043bc-766852b-e0e464e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:11.283529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|367053ba-640043bc-766852b-e0e464e2_0] Write session will restart in 0.008749s
2025-09-30T14:57:11.283554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|367053ba-640043bc-766852b-e0e464e2_0] Write session: Do CDS request
2025-09-30T14:57:11.283560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|367053ba-640043bc-766852b-e0e464e2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:11.288357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:11.290153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:11.290375Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:11.290387Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:11.290399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:11.290452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:11.290496Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896439749170511:11307]
2025-09-30T14:57:11.291182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:11.291496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:11.291547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:11.291881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:11.291965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:11.291971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:11.291973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:11.291974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:11.291976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:11.291977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:11.291979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:11.291980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:11.291981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:11.291983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:11.291984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.291985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.291986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.291988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:11.291989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:11.291994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:11.292005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:11.292009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:11.292014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:11.292018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:11.292022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:11.292026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:11.292032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:11.292036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:11.292040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:11.292045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.292048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.292052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.292056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:11.292060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:11.292071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:11.292079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:11.292085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:11.292091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:11.292095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:11.292100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:11.292104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:11.292110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:11.292115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:11.292120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:11.292125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:11.292130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:11.292136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:11.292142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:11.292146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:11.292151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:11.292157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:11.292162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:11.292166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:11.292170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:11.292173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.292177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.292179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.292182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.292185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.292187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.292190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:11.292192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:11.292195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:11.292198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:11.292225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:11.293793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|367053ba-640043bc-766852b-e0e464e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:11.295579Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:11.295598Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2472
2025-09-30T14:57:11.295719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2472 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:11.295754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2472 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:11.295760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2472 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:11.295765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:11.296238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2472 sessionId:  describe result for acl check
2025-09-30T14:57:11.296279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:11.296286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:11.296289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:11.296296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896439838961177:10698] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:11.296978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896439838961177:10698] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:11.298367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:11.299317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:11.299337Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:11.299340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:11.299344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:11.299350Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2471 [2:7555896439749170511:11307]
2025-09-30T14:57:11.299368Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:11.299382Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:11.299385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:11.299389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:11.299391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:11.299408Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:11.299416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:11.299422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:11.299478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.299489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.299491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.299495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:11.299500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:11.299570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:11.299578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.299589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.299601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.299616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:11.299634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896439838961148:2454], now have 1 active actors on pipe
2025-09-30T14:57:11.299647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896439749170506:11307]
2025-09-30T14:57:11.299653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896439749170506:11307]
2025-09-30T14:57:11.299655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896439749170506:11307]
2025-09-30T14:57:11.299665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:11.299676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:11.299687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:11.299689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:11.299691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:11.299701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:11.299704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:11.299746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896439749170506:11307]
2025-09-30T14:57:11.299690Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2471
2025-09-30T14:57:11.299767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:11.299773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:11.299983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896439838961177:10698] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:11.307314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896439838961177:10698] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:11.307335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896439838961177:10698] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:11.307339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896439838961177:10698] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:11.307348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2472 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:11.307743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896439838961218:10698], now have 1 active actors on pipe
2025-09-30T14:57:11.307815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2471
2025-09-30T14:57:11.307875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:11.307905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:11.307936Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23f7d479-fec2847a-3ce23afb-93ac12e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:11.307953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:11.307959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:11.307962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:11.307980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:11.308002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:11.308024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:11.308231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:11.308240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:11.308257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:11.308378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2472 partition: 0 MaxSeqNo: 42 sessionId: src_id|23f7d479-fec2847a-3ce23afb-93ac12e3_0
2025-09-30T14:57:11.308781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|367053ba-640043bc-766852b-e0e464e2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|23f7d479-fec2847a-3ce23afb-93ac12e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:11.311928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23f7d479-fec2847a-3ce23afb-93ac12e3_0] Write session: try to update token
2025-09-30T14:57:11.311956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23f7d479-fec2847a-3ce23afb-93ac12e3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:11.312117Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:11.312147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:11.312162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896439749170506:11307]
2025-09-30T14:57:11.312216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:11.312422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:11.312582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:11.312738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:11.312897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:11.313121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:11.313206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:11.313293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:11.324047Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:11.324069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:11.324076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:11.324078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:11.324090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896439749170506:11307]
2025-09-30T14:57:11.324094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896439749170506:11307]
2025-09-30T14:57:11.324099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896439749170506:11307]
2025-09-30T14:57:11.324140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:11.324148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.324152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:11.324164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:11.324171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:11.324176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:11.324300Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:11.328247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2472 sessionId: src_id|23f7d479-fec2847a-3ce23afb-93ac12e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:11.330965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:11.379681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896439838961221:10294]
2025-09-30T14:57:11.380054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2471, pipe: [1:7555896439838961221:10294]
2025-09-30T14:57:11.438835Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:11.439762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:11.439837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2472 reason: status is not ok: tablet will be restarted right now sessionId: src_id|23f7d479-fec2847a-3ce23afb-93ac12e3_0
2025-09-30T14:57:11.439973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2472 sessionId: src_id|23f7d479-fec2847a-3ce23afb-93ac12e3_0 is DEAD
2025-09-30T14:57:11.440087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896439838961221:10294]
2025-09-30T14:57:11.440098Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:11.439410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:11.439425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:11.439445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896439838961221:10294], now have 1 active actors on pipe
2025-09-30T14:57:11.439644Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:11.443523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f7d479-fec2847a-3ce23afb-93ac12e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:11.443535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f7d479-fec2847a-3ce23afb-93ac12e3_0] Write session will restart in 0.008011s
2025-09-30T14:57:11.443569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f7d479-fec2847a-3ce23afb-93ac12e3_0] Write session: Do CDS request
2025-09-30T14:57:11.443576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f7d479-fec2847a-3ce23afb-93ac12e3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:11.446794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:11.448422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:11.448642Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:11.448646Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:11.448657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:11.448726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:11.448756Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896439749170589:11317]
2025-09-30T14:57:11.449287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:11.449776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:11.449818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:11.450141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:11.450204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:11.450205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:11.450207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:11.450208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:11.450209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:11.450211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:11.450212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:11.450213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:11.450214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:11.450216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:11.450219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.450220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.450221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.450222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:11.450224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:11.450229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:11.450237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:11.450241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:11.450245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:11.450248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:11.450252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:11.450257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:11.450260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:11.450263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:11.450267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:11.450271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.450274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.450277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.450281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:11.450284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:11.450293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:11.450300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:11.450305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:11.450310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:11.450315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:11.450320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:11.450323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:11.450328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:11.450333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:11.450337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:11.450341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:11.450347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:11.450352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:11.450356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:11.450360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:11.450365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:11.450371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:11.450376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:11.450380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:11.450385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:11.450390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.450394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.450399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.450404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.450409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.450414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.450418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:11.450422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:11.450426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:11.450431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:11.450474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:11.452765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23f7d479-fec2847a-3ce23afb-93ac12e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:11.456915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:11.457902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:11.457919Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:11.457922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:11.457926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:11.457932Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2472 [2:7555896439749170589:11317]
2025-09-30T14:57:11.457947Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:11.457961Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:11.457969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:11.457973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:11.457975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:11.457989Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:11.457993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:11.457998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:11.458045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.458052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.458053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.458056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:11.458058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:11.458112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:11.458117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.458127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.458135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.458144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:11.458162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896439749170584:11317]
2025-09-30T14:57:11.458169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896439749170584:11317]
2025-09-30T14:57:11.458170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896439749170584:11317]
2025-09-30T14:57:11.458183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:11.458194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:11.458208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:11.458211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:11.458243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896439749170584:11317]
2025-09-30T14:57:11.458249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:11.458449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:11.458458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:11.458460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:11.458464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:11.458958Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2472
2025-09-30T14:57:11.458641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896439838961235:2454], now have 1 active actors on pipe
2025-09-30T14:57:11.459389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:11.459397Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2473
2025-09-30T14:57:11.460026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2473 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:11.460069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2473 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:11.460079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2473 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:11.460084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:11.460556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2473 sessionId:  describe result for acl check
2025-09-30T14:57:11.460591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:11.460594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:11.460595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:11.460601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896439838961277:10709] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:11.461102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896439838961277:10709] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:11.464331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896439838961277:10709] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:11.472431Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:11.472452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:11.472454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:11.472455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:11.472463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896439749170584:11317]
2025-09-30T14:57:11.472467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896439749170584:11317]
2025-09-30T14:57:11.472470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896439749170584:11317]
2025-09-30T14:57:11.472507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:11.472513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.472516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:11.472648Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:11.472716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:11.472741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:11.472749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:11.475448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896439838961277:10709] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:11.475471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896439838961277:10709] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:11.475476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896439838961277:10709] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:11.475485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2473 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:11.479833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2472
2025-09-30T14:57:11.539934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896439838961314:10294]
2025-09-30T14:57:11.543695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2472, pipe: [1:7555896439838961314:10294]
2025-09-30T14:57:11.588888Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:11.589945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896439838961312:10709], now have 1 active actors on pipe
2025-09-30T14:57:11.589986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:11.589993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:11.590029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896439838961314:10294], now have 1 active actors on pipe
2025-09-30T14:57:11.590233Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:11.590343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:11.590354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896439838961314:10294]
2025-09-30T14:57:11.590383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2473 reason: pipe to partition's 0 tablet is dead #2 sessionId: 
2025-09-30T14:57:11.590391Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:11.590612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2473 sessionId:  is DEAD
2025-09-30T14:57:11.590797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f7d479-fec2847a-3ce23afb-93ac12e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-09-30T14:57:11.590805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f7d479-fec2847a-3ce23afb-93ac12e3_0] Write session will restart in 0.011981s
2025-09-30T14:57:11.590836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f7d479-fec2847a-3ce23afb-93ac12e3_0] Write session: Do CDS request
2025-09-30T14:57:11.590845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f7d479-fec2847a-3ce23afb-93ac12e3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:11.600725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:11.602300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:11.602498Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:11.602509Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:11.602531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:11.602581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:11.602621Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896439749170677:11326]
2025-09-30T14:57:11.603311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:11.603619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:11.603663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:11.604012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:11.604048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23f7d479-fec2847a-3ce23afb-93ac12e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:11.604094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:11.604102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:11.604103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:11.604105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:11.604106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:11.604107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:11.604109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:11.604110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:11.604112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:11.604113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:11.604115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.604116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.604117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.604118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:11.604119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:11.604125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:11.604134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:11.604138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:11.604142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:11.604146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:11.604150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:11.604154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:11.604158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:11.604166Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:11.604162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:11.604166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:11.604171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.604183Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2474
2025-09-30T14:57:11.604174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.604177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.604181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:11.604184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:11.604193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:11.604202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:11.604208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:11.604214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:11.604219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:11.604224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:11.604229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:11.604234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:11.604239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:11.604245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:11.604249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:11.604254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:11.604259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:11.604265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:11.604269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:11.604274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:11.604279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:11.604284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:11.604289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:11.604294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:11.604301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.604307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.604311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.604316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.604321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.604326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.604330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:11.604336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:11.604340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:11.604346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:11.604301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2474 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:11.604332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2474 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:11.604338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2474 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:11.604342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:11.604388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:11.604828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2474 sessionId:  describe result for acl check
2025-09-30T14:57:11.604864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:11.604866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:11.604869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:11.604876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896439838961345:10713] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:11.605466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896439838961345:10713] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:11.607401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896439838961345:10713] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:11.609881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:11.610273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896439838961345:10713] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:11.610287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896439838961345:10713] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:11.610290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896439838961345:10713] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:11.610298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2474 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:11.610766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:11.610784Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:11.610787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:11.610791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:11.610798Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2473 [2:7555896439749170677:11326]
2025-09-30T14:57:11.610813Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:11.610830Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:11.610840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:11.610843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:11.610845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:11.610859Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:11.610865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:11.610871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:11.610930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.610937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.610939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.610942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:11.610945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:11.611005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:11.611013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.611025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.611034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.611048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:11.611066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896439838961378:10713], now have 1 active actors on pipe
2025-09-30T14:57:11.611069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896439838961315:2454], now have 1 active actors on pipe
2025-09-30T14:57:11.611075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896439749170672:11326]
2025-09-30T14:57:11.611077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896439749170672:11326]
2025-09-30T14:57:11.611080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896439749170672:11326]
2025-09-30T14:57:11.611091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:11.611107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:11.611119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:11.611119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:11.611122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:11.611123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:11.611126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:11.611150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896439749170672:11326]
2025-09-30T14:57:11.611186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2473
2025-09-30T14:57:11.611159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:11.611227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2473
2025-09-30T14:57:11.611184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:11.611367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:11.611385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:11.611427Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58c3d124-e04c95c6-a94a7f51-a9e21a15_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:11.611441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:11.611450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:11.611453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:11.611467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:11.611485Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:11.611504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:11.611706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:11.611720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:11.611738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:11.611841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2474 partition: 0 MaxSeqNo: 42 sessionId: src_id|58c3d124-e04c95c6-a94a7f51-a9e21a15_0
2025-09-30T14:57:11.612207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f7d479-fec2847a-3ce23afb-93ac12e3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|58c3d124-e04c95c6-a94a7f51-a9e21a15_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:11.615623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58c3d124-e04c95c6-a94a7f51-a9e21a15_0] Write session: try to update token
2025-09-30T14:57:11.615648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58c3d124-e04c95c6-a94a7f51-a9e21a15_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:11.623964Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:11.623989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:11.623998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896439749170672:11326]
2025-09-30T14:57:11.624044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:11.624043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:11.624220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:11.624390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:11.624533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:11.624671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:11.624857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:11.624898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:11.634129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2474 sessionId: src_id|58c3d124-e04c95c6-a94a7f51-a9e21a15_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:11.635558Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:11.635583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:11.635585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:11.635587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:11.635598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896439749170672:11326]
2025-09-30T14:57:11.635606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896439749170672:11326]
2025-09-30T14:57:11.635610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896439749170672:11326]
2025-09-30T14:57:11.635637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:11.635644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:11.635645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:11.635648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:11.635653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.635656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:11.635802Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:11.637474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:11.690457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896439838961387:10294]
2025-09-30T14:57:11.690824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2473, pipe: [1:7555896439838961387:10294]
2025-09-30T14:57:11.752038Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:11.752515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:11.752531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:11.752552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896439838961387:10294], now have 1 active actors on pipe
2025-09-30T14:57:11.752844Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:11.752893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896439838961387:10294]
2025-09-30T14:57:11.752931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:11.752935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:11.753000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2474 reason: error at write: Disconnected sessionId: src_id|58c3d124-e04c95c6-a94a7f51-a9e21a15_0
2025-09-30T14:57:11.753186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:11.753195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2474 sessionId: src_id|58c3d124-e04c95c6-a94a7f51-a9e21a15_0 is DEAD
2025-09-30T14:57:11.753470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c3d124-e04c95c6-a94a7f51-a9e21a15_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:11.753484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c3d124-e04c95c6-a94a7f51-a9e21a15_0] Write session will restart in 0.005506s
2025-09-30T14:57:11.753508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c3d124-e04c95c6-a94a7f51-a9e21a15_0] Write session: Do CDS request
2025-09-30T14:57:11.753513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c3d124-e04c95c6-a94a7f51-a9e21a15_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:11.759758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58c3d124-e04c95c6-a94a7f51-a9e21a15_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:11.759845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:11.759862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2475
2025-09-30T14:57:11.760057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2475 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:11.760101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2475 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:11.760106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2475 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:11.760111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:11.760528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2475 sessionId:  describe result for acl check
2025-09-30T14:57:11.760561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:11.760569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:11.760571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:11.760577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896439838961405:10718] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:11.761088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896439838961405:10718] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:11.762939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896439838961405:10718] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:11.763234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:11.764769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:11.764936Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:11.764945Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:11.764956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:11.765007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:11.765049Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896439749170741:11328]
2025-09-30T14:57:11.765451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896439838961405:10718] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:11.765466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896439838961405:10718] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:11.765470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896439838961405:10718] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:11.765477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2475 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:11.765766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:11.766020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:11.766062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:11.766418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:11.766486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:11.766492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:11.766494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:11.766495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:11.766496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:11.766498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:11.766499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:11.766501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:11.766502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:11.766503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:11.766506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.766507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.766508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.766509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:11.766510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:11.766515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:11.766525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:11.766528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:11.766533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:11.766537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:11.766540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:11.766544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:11.766547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:11.766551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:11.766555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:11.766559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.766562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.766566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.766570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:11.766573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:11.766580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:11.766587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:11.766593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:11.766598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:11.766604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:11.766609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:11.766613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:11.766619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:11.766623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:11.766628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:11.766632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:11.766638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:11.766643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:11.766647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:11.766656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:11.766660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:11.766664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:11.766669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:11.766673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:11.766677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:11.766681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.766688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.766691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.766696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.766703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.766707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.766727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:11.766732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:11.766736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:11.766740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:11.766778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:11.772141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:11.772994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:11.773011Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:11.773014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:11.773018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:11.773027Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2474 [2:7555896439749170741:11328]
2025-09-30T14:57:11.773039Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:11.773056Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:11.773062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:11.773064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:11.773065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:11.773078Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:11.773083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:11.773089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:11.773144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.773150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.773152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.773155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:11.773158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:11.773213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:11.773219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.773227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.773233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.773247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:11.773258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896439749170736:11328]
2025-09-30T14:57:11.773263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896439749170736:11328]
2025-09-30T14:57:11.773265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896439749170736:11328]
2025-09-30T14:57:11.773273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:11.773284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:11.773287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:11.773287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:11.773289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:11.773300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:11.773304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:11.773313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896439838961451:10718], now have 1 active actors on pipe
2025-09-30T14:57:11.773323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896439838961390:2454], now have 1 active actors on pipe
2025-09-30T14:57:11.773354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896439749170736:11328]
2025-09-30T14:57:11.773367Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:11.773426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2474
2025-09-30T14:57:11.773429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2474
2025-09-30T14:57:11.773499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:11.773609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:11.773619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:11.773643Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97712a08-3940244d-fe3de8c6-747102bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:11.773655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:11.773658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:11.773660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:11.773670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:11.773679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:11.773697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:11.773871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:11.773890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:11.773926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:11.774044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2475 partition: 0 MaxSeqNo: 42 sessionId: src_id|97712a08-3940244d-fe3de8c6-747102bf_0
2025-09-30T14:57:11.774453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c3d124-e04c95c6-a94a7f51-a9e21a15_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|97712a08-3940244d-fe3de8c6-747102bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:11.777257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97712a08-3940244d-fe3de8c6-747102bf_0] Write session: try to update token
2025-09-30T14:57:11.777277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97712a08-3940244d-fe3de8c6-747102bf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:11.787779Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:11.787804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:11.787810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:11.787813Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:11.787823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896439749170736:11328]
2025-09-30T14:57:11.787828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896439749170736:11328]
2025-09-30T14:57:11.787833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896439749170736:11328]
2025-09-30T14:57:11.787876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:11.787882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.787885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:11.787889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:11.787908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:11.787912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:11.788024Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:11.808081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2475 sessionId: src_id|97712a08-3940244d-fe3de8c6-747102bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:11.810896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:11.850169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896439838961464:10294]
2025-09-30T14:57:11.850522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2474, pipe: [1:7555896439838961464:10294]
2025-09-30T14:57:11.907001Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:11.907442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:11.907459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:11.907479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896439838961464:10294], now have 1 active actors on pipe
2025-09-30T14:57:11.907700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:11.907718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:11.907782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2475 reason: error at write: Disconnected sessionId: src_id|97712a08-3940244d-fe3de8c6-747102bf_0
2025-09-30T14:57:11.907967Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:11.907982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2475 sessionId: src_id|97712a08-3940244d-fe3de8c6-747102bf_0 is DEAD
2025-09-30T14:57:11.907987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896439838961464:10294]
2025-09-30T14:57:11.908003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:11.908091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97712a08-3940244d-fe3de8c6-747102bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:11.908116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97712a08-3940244d-fe3de8c6-747102bf_0] Write session will restart in 0.007908s
2025-09-30T14:57:11.908139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97712a08-3940244d-fe3de8c6-747102bf_0] Write session: Do CDS request
2025-09-30T14:57:11.908148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97712a08-3940244d-fe3de8c6-747102bf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:11.916948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97712a08-3940244d-fe3de8c6-747102bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:11.917026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:11.917042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2476
2025-09-30T14:57:11.917275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2476 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:11.917309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2476 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:11.917319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2476 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:11.917323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:11.917824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2476 sessionId:  describe result for acl check
2025-09-30T14:57:11.917862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:11.917864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:11.917870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:11.917876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896439838961480:10722] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:11.918423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896439838961480:10722] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:11.921118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896439838961480:10722] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:11.923602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896439838961480:10722] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:11.923616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896439838961480:10722] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:11.923619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896439838961480:10722] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:11.923627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2476 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:11.923780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:11.925552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:11.925789Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:11.925797Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:11.925809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:11.925876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:11.925916Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896439749170808:11330]
2025-09-30T14:57:11.926573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:11.926941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:11.926991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:11.927363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:11.927443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:11.927449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:11.927451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:11.927452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:11.927453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:11.927454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:11.927456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:11.927457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:11.927458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:11.927459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:11.927460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.927461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.927462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.927463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:11.927464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:11.927469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:11.927479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:11.927483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:11.927487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:11.927490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:11.927494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:11.927498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:11.927501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:11.927505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:11.927510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:11.927514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.927517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.927521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.927524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:11.927530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:11.927537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:11.927545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:11.927550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:11.927555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:11.927560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:11.927564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:11.927568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:11.927572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:11.927577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:11.927581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:11.927586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:11.927590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:11.927597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:11.927601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:11.927605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:11.927610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:11.927614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:11.927618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:11.927622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:11.927626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:11.927630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.927635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.927639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.927644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.927648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.927653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.927657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:11.927662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:11.927667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:11.927671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:11.927708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:11.933233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:11.934084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:11.934102Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:11.934104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:11.934107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:11.934112Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2475 [2:7555896439749170808:11330]
2025-09-30T14:57:11.934124Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:11.934136Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:11.934138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:11.934141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:11.934142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:11.934155Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:11.934161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:11.934168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:11.934228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.934238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.934240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.934244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:11.934258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:11.934323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:11.934330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.934346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:11.934362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:11.934376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:11.934394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896439749170802:11330]
2025-09-30T14:57:11.934399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896439749170802:11330]
2025-09-30T14:57:11.934402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896439749170802:11330]
2025-09-30T14:57:11.934408Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:11.934422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896439838961465:2454], now have 1 active actors on pipe
2025-09-30T14:57:11.934425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:11.934428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:11.934431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:11.934432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:11.934446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:11.934450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:11.934457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896439838961526:10722], now have 1 active actors on pipe
2025-09-30T14:57:11.934486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896439749170802:11330]
2025-09-30T14:57:11.934497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:11.934538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2475
2025-09-30T14:57:11.934542Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2475
2025-09-30T14:57:11.934523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:11.934638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:11.934646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:11.934674Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ea39a2a-c1f743dc-8b625941-18c30bb5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:11.934682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:11.934685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:11.934688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:11.934709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:11.934730Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:11.934751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:11.934947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:11.934959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:11.934982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:11.935079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2476 partition: 0 MaxSeqNo: 42 sessionId: src_id|2ea39a2a-c1f743dc-8b625941-18c30bb5_0
2025-09-30T14:57:11.935499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97712a08-3940244d-fe3de8c6-747102bf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2ea39a2a-c1f743dc-8b625941-18c30bb5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:11.939043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea39a2a-c1f743dc-8b625941-18c30bb5_0] Write session: try to update token
2025-09-30T14:57:11.939069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea39a2a-c1f743dc-8b625941-18c30bb5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:11.946926Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:11.946947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:11.946949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:11.946951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:11.946961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896439749170802:11330]
2025-09-30T14:57:11.946971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896439749170802:11330]
2025-09-30T14:57:11.946975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896439749170802:11330]
2025-09-30T14:57:11.947019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:11.947021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:11.947026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:11.947028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:11.947029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:11.947033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:11.947182Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:11.964721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2476 sessionId: src_id|2ea39a2a-c1f743dc-8b625941-18c30bb5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:11.967649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:12.008502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896444133928836:10294]
2025-09-30T14:57:12.008984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2475, pipe: [1:7555896444133928836:10294]
2025-09-30T14:57:12.062667Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:12.063066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:12.063076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:12.063091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896444133928836:10294], now have 1 active actors on pipe
2025-09-30T14:57:12.063443Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:12.063470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:12.063509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896444133928836:10294]
2025-09-30T14:57:12.063548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2476 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2ea39a2a-c1f743dc-8b625941-18c30bb5_0
2025-09-30T14:57:12.063729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2476 sessionId: src_id|2ea39a2a-c1f743dc-8b625941-18c30bb5_0 is DEAD
2025-09-30T14:57:12.063411Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:12.063883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea39a2a-c1f743dc-8b625941-18c30bb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:12.063922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea39a2a-c1f743dc-8b625941-18c30bb5_0] Write session will restart in 0.009461s
2025-09-30T14:57:12.063948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea39a2a-c1f743dc-8b625941-18c30bb5_0] Write session: Do CDS request
2025-09-30T14:57:12.063954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea39a2a-c1f743dc-8b625941-18c30bb5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:12.071853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:12.073505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:12.073711Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:12.073725Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:12.073736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:12.073793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:12.073835Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896444044138182:11334]
2025-09-30T14:57:12.074503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:12.074826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea39a2a-c1f743dc-8b625941-18c30bb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:12.074823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:12.074873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:12.074896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:12.074912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2477
2025-09-30T14:57:12.075082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2477 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:12.075121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2477 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:12.075126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2477 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:12.075130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:12.075221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:12.075325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:12.075335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:12.075337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:12.075337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:12.075339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:12.075340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:12.075341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:12.075342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:12.075343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:12.075345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:12.075346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.075348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.075349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.075350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:12.075351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:12.075358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:12.075369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:12.075373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:12.075378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:12.075382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:12.075388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:12.075392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:12.075396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:12.075400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:12.075405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:12.075409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.075413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.075417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.075422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:12.075426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:12.075434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:12.075443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:12.075449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:12.075454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:12.075459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:12.075465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:12.075470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:12.075475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:12.075480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:12.075486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:12.075491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:12.075497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:12.075502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:12.075507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:12.075512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:12.075518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:12.075521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:12.075526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:12.075531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:12.075535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:12.075540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.075547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.075552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.075558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.075563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.075577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.075582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:12.075587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:12.075593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:12.075598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:12.075572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2477 sessionId:  describe result for acl check
2025-09-30T14:57:12.075611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:12.075613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:12.075615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:12.075622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896444133928868:10726] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:12.075666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:12.076217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896444133928868:10726] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:12.078426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896444133928868:10726] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:12.081997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896444133928868:10726] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:12.082013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896444133928868:10726] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:12.082017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896444133928868:10726] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:12.082025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2477 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:12.082546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:12.083508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:12.083529Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:12.083532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:12.083536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:12.083542Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2476 [2:7555896444044138182:11334]
2025-09-30T14:57:12.083559Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:12.083574Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:12.083578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:12.083582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:12.083585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:12.083601Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:12.083616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:12.083622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:12.083686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.083695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.083699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.083702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:12.083705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:12.083776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:12.083784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.083798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.083816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.083852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:12.083875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896444044138177:11334]
2025-09-30T14:57:12.083878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896444044138177:11334]
2025-09-30T14:57:12.083879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896444044138177:11334]
2025-09-30T14:57:12.083894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:12.083908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:12.083922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:12.083931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:12.083944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:12.083958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:12.083961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:12.083969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896444044138177:11334]
2025-09-30T14:57:12.083972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:12.084050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:12.084172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896444133928837:2454], now have 1 active actors on pipe
2025-09-30T14:57:12.084185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896444133928903:10726], now have 1 active actors on pipe
2025-09-30T14:57:12.084357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:12.084369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:12.084393Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e65a936f-38e247f4-c0754f54-c48240b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:12.084406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:12.084414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:12.084416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:12.084428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:12.084449Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:12.084468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:12.084726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:12.084734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:12.084762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:12.085234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea39a2a-c1f743dc-8b625941-18c30bb5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e65a936f-38e247f4-c0754f54-c48240b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:12.084161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2476
2025-09-30T14:57:12.084199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2476
2025-09-30T14:57:12.084881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2477 partition: 0 MaxSeqNo: 42 sessionId: src_id|e65a936f-38e247f4-c0754f54-c48240b2_0
2025-09-30T14:57:12.088603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e65a936f-38e247f4-c0754f54-c48240b2_0] Write session: try to update token
2025-09-30T14:57:12.088623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e65a936f-38e247f4-c0754f54-c48240b2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:12.097574Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:12.097599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:12.097608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896444044138177:11334]
2025-09-30T14:57:12.097651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:12.097829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:12.097975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:12.098134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:12.098280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:12.098478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:12.098512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:12.098672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:12.109560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2477 sessionId: src_id|e65a936f-38e247f4-c0754f54-c48240b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:12.114033Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:12.114060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:12.114063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:12.114065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:12.114077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896444044138177:11334]
2025-09-30T14:57:12.114081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896444044138177:11334]
2025-09-30T14:57:12.114086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896444044138177:11334]
2025-09-30T14:57:12.114138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:12.114148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.114157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:12.114167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:12.114326Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:12.114352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:12.114374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:12.114386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:12.163564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896444133928912:10294]
2025-09-30T14:57:12.163919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2476, pipe: [1:7555896444133928912:10294]
2025-09-30T14:57:12.230142Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:12.230541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:12.230552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:12.230576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896444133928912:10294], now have 1 active actors on pipe
2025-09-30T14:57:12.230963Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:12.231027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896444133928912:10294]
2025-09-30T14:57:12.231048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:12.231051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:12.231111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2477 reason: error at write: Disconnected sessionId: src_id|e65a936f-38e247f4-c0754f54-c48240b2_0
2025-09-30T14:57:12.230869Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:12.231478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2477 sessionId: src_id|e65a936f-38e247f4-c0754f54-c48240b2_0 is DEAD
2025-09-30T14:57:12.233995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e65a936f-38e247f4-c0754f54-c48240b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:12.234007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e65a936f-38e247f4-c0754f54-c48240b2_0] Write session will restart in 0.006717s
2025-09-30T14:57:12.234033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e65a936f-38e247f4-c0754f54-c48240b2_0] Write session: Do CDS request
2025-09-30T14:57:12.234042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e65a936f-38e247f4-c0754f54-c48240b2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:12.241828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e65a936f-38e247f4-c0754f54-c48240b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:12.242915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:12.243385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:12.243406Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2478
2025-09-30T14:57:12.243569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2478 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:12.243611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2478 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:12.243617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2478 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:12.243621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:12.244004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2478 sessionId:  describe result for acl check
2025-09-30T14:57:12.244028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:12.244030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:12.244032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:12.244037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896444133928960:10732] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:12.244559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896444133928960:10732] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:12.245763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:12.246018Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:12.246033Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:12.246059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:12.246125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:12.246170Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896444044138250:11336]
2025-09-30T14:57:12.246729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896444133928960:10732] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:12.246844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:12.247122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:12.247172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:12.247534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:12.247634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:12.247644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:12.247645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:12.247646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:12.247648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:12.247649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:12.247651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:12.247652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:12.247653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:12.247655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:12.247656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.247659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.247660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.247661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:12.247663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:12.247669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:12.247679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:12.247682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:12.247686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:12.247690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:12.247694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:12.247697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:12.247701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:12.247705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:12.247712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:12.247716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.247719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.247722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.247726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:12.247729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:12.247740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:12.247747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:12.247753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:12.247759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:12.247764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:12.247770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:12.247776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:12.247782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:12.247787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:12.247793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:12.247798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:12.247804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:12.247809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:12.247816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:12.247821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:12.247827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:12.247832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:12.247837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:12.247843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:12.247848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:12.247854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.247860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.247864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.247870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.247875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.247881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.247885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:12.247890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:12.247895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:12.247899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:12.247947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:12.253115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896444133928960:10732] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:12.253149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896444133928960:10732] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:12.253156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896444133928960:10732] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:12.253165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2478 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:12.253423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:12.254381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:12.254401Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:12.254404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:12.254408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:12.254416Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2477 [2:7555896444044138250:11336]
2025-09-30T14:57:12.254433Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:12.254453Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:12.254461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:12.254465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:12.254469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:12.254486Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:12.254499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:12.254505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:12.254573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.254582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.254584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.254592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:12.254600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:12.254667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:12.254675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.254689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.254701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.254728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:12.254749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896444133928999:10732], now have 1 active actors on pipe
2025-09-30T14:57:12.254754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896444133928930:2454], now have 1 active actors on pipe
2025-09-30T14:57:12.254760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896444044138244:11336]
2025-09-30T14:57:12.254763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896444044138244:11336]
2025-09-30T14:57:12.254765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896444044138244:11336]
2025-09-30T14:57:12.254780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:12.254793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:12.254803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:12.254806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:12.254808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:12.254809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:12.254812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:12.254806Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2477
2025-09-30T14:57:12.254812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2477
2025-09-30T14:57:12.254848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896444044138244:11336]
2025-09-30T14:57:12.254865Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:12.254878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:12.254921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:12.254932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:12.254958Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f6ccdc0-78bd7823-ddeb873e-d838b253_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:12.254972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:12.254976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:12.254978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:12.254987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:12.254997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:12.255017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:12.255220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:12.255230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:12.255260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:12.255368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2478 partition: 0 MaxSeqNo: 42 sessionId: src_id|6f6ccdc0-78bd7823-ddeb873e-d838b253_0
2025-09-30T14:57:12.255750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e65a936f-38e247f4-c0754f54-c48240b2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6f6ccdc0-78bd7823-ddeb873e-d838b253_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:12.258746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f6ccdc0-78bd7823-ddeb873e-d838b253_0] Write session: try to update token
2025-09-30T14:57:12.258768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f6ccdc0-78bd7823-ddeb873e-d838b253_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:12.268220Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:12.268247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:12.268262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896444044138244:11336]
2025-09-30T14:57:12.268313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:12.268514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:12.268674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:12.268680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:12.268831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:12.268992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:12.269220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:12.269270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:12.276626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2478 sessionId: src_id|6f6ccdc0-78bd7823-ddeb873e-d838b253_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:12.279486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:12.279922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:12.279951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:12.279988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:12.280223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:12.281889Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:12.281912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:12.281915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:12.281918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:12.281931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896444044138244:11336]
2025-09-30T14:57:12.281936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896444044138244:11336]
2025-09-30T14:57:12.281941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896444044138244:11336]
2025-09-30T14:57:12.281982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:12.281990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.281990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:12.281994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:12.281999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:12.281998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:12.282157Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:12.330968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896444133929010:10294]
2025-09-30T14:57:12.331291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2477, pipe: [1:7555896444133929010:10294]
2025-09-30T14:57:12.394630Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:12.403189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:12.403224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:12.403467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:12.403539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:12.403608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:12.403687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:12.403742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:12.403754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:12.403829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:12.403897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:12.403969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:12.404038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:12.404082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:12.404089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:12.404161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:12.404222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:12.404291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:12.404355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:12.404399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:12.404407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:12.404484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:12.404558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:12.404619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:12.404684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:12.404724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:12.404730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:12.404804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:12.404872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:12.404936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:12.405004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:12.405056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:12.405064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:12.405176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:12.405241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:12.405309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:12.405382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:12.405437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:12.405444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:12.405517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:12.405585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:12.405653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:12.405718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:12.405777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:12.405785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:12.405854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:12.405910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:12.405968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:12.406029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:12.406080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:12.406087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:12.406154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:12.406215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:12.406274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:12.406350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:12.406398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:12.406406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:12.406480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:12.406552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:12.406621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:12.406707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:12.406756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:12.406764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:12.406837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896444133929010:10294], now have 1 active actors on pipe
2025-09-30T14:57:12.407572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896444133929010:10294]
2025-09-30T14:57:12.407613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:12.407616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:12.407648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2478 reason: error at write: Disconnected sessionId: src_id|6f6ccdc0-78bd7823-ddeb873e-d838b253_0
2025-09-30T14:57:12.407839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2478 sessionId: src_id|6f6ccdc0-78bd7823-ddeb873e-d838b253_0 is DEAD
2025-09-30T14:57:12.407984Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:12.408096Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:12.411393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f6ccdc0-78bd7823-ddeb873e-d838b253_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:12.411411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f6ccdc0-78bd7823-ddeb873e-d838b253_0] Write session will restart in 0.008917s
2025-09-30T14:57:12.411446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f6ccdc0-78bd7823-ddeb873e-d838b253_0] Write session: Do CDS request
2025-09-30T14:57:12.411454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f6ccdc0-78bd7823-ddeb873e-d838b253_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:12.416460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:12.421023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:12.421348Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:12.421362Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:12.421376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:12.421441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:12.421499Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896444044138318:11338]
2025-09-30T14:57:12.422194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:12.422810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:12.422874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:12.423234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:12.423340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:12.423347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:12.423349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:12.423350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:12.423352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:12.423353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:12.423355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:12.423356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:12.423358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:12.423359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:12.423363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.423364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.423366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.423367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:12.423369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:12.423375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:12.423386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:12.423390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:12.423394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:12.423398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:12.423403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:12.423407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:12.423411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:12.423415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:12.423419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:12.423423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.423427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.423431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.423435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:12.423439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:12.423447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:12.423454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:12.423461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:12.423466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:12.423471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:12.423477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:12.423481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:12.423487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:12.423491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:12.423497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:12.423502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:12.423508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:12.423520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:12.423525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:12.423529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:12.423534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:12.423540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:12.423546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:12.423550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:12.423556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:12.423561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.423566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.423570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.423575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.423581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.423586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.423589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:12.423594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:12.423598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:12.423603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:12.423649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:12.423831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f6ccdc0-78bd7823-ddeb873e-d838b253_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:12.424289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:12.424305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2479
2025-09-30T14:57:12.424552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2479 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:12.424596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2479 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:12.424601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2479 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:12.424606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:12.425230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2479 sessionId:  describe result for acl check
2025-09-30T14:57:12.425269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:12.425271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:12.425273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:12.425279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896444133929046:10736] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:12.425859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896444133929046:10736] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:12.429293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896444133929046:10736] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:12.431549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:12.432449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:12.432469Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:12.432471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:12.432474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:12.432479Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2478 [2:7555896444044138318:11338]
2025-09-30T14:57:12.432493Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:12.432508Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:12.432510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:12.432512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:12.432514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:12.432530Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:12.432535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:12.432540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:12.432588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.432594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.432596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.432598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:12.432600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:12.432655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:12.432666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.432678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.432690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.432701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:12.432714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896444044138313:11338]
2025-09-30T14:57:12.432716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896444044138313:11338]
2025-09-30T14:57:12.432717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896444044138313:11338]
2025-09-30T14:57:12.432724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:12.432736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896444133929011:2454], now have 1 active actors on pipe
2025-09-30T14:57:12.432737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:12.432740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:12.432742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:12.432750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:12.432765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:12.432768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:12.432801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896444044138313:11338]
2025-09-30T14:57:12.432814Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:12.432824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:12.432830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2478
2025-09-30T14:57:12.433683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896444133929046:10736] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:12.433701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896444133929046:10736] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:12.433705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896444133929046:10736] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:12.433715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2479 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:12.433976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896444133929082:10736], now have 1 active actors on pipe
2025-09-30T14:57:12.433996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2478
2025-09-30T14:57:12.434077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:12.434092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:12.434117Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fee15250-4c379157-4a52a55-eaf93af6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:12.434136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:12.434145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:12.434147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:12.434158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:12.434175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:12.434197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:12.434346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:12.434353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:12.434366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:12.434454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2479 partition: 0 MaxSeqNo: 42 sessionId: src_id|fee15250-4c379157-4a52a55-eaf93af6_0
2025-09-30T14:57:12.434876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f6ccdc0-78bd7823-ddeb873e-d838b253_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fee15250-4c379157-4a52a55-eaf93af6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:12.438540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fee15250-4c379157-4a52a55-eaf93af6_0] Write session: try to update token
2025-09-30T14:57:12.438570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fee15250-4c379157-4a52a55-eaf93af6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:12.444637Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:12.444662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:12.444674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896444044138313:11338]
2025-09-30T14:57:12.444716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:12.444720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:12.444910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:12.445070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:12.445249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:12.445406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:12.445619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:12.445666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:12.455792Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:12.455818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:12.455820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:12.455823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:12.455834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896444044138313:11338]
2025-09-30T14:57:12.455840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896444044138313:11338]
2025-09-30T14:57:12.455844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896444044138313:11338]
2025-09-30T14:57:12.455892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:12.455896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:12.455902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.455903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:12.455906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:12.455907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:12.456063Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:12.463404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2479 sessionId: src_id|fee15250-4c379157-4a52a55-eaf93af6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:12.466174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:12.507637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896444133929101:10294]
2025-09-30T14:57:12.507996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2478, pipe: [1:7555896444133929101:10294]
2025-09-30T14:57:12.576922Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:12.577344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:12.577364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:12.577384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896444133929101:10294], now have 1 active actors on pipe
2025-09-30T14:57:12.577612Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:12.577899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896444133929101:10294]
2025-09-30T14:57:12.577903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:12.577908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:12.577934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:12.577973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2479 reason: error at write: Disconnected sessionId: src_id|fee15250-4c379157-4a52a55-eaf93af6_0
2025-09-30T14:57:12.578187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2479 sessionId: src_id|fee15250-4c379157-4a52a55-eaf93af6_0 is DEAD
2025-09-30T14:57:12.579035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fee15250-4c379157-4a52a55-eaf93af6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:12.579052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fee15250-4c379157-4a52a55-eaf93af6_0] Write session will restart in 0.007537s
2025-09-30T14:57:12.579086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fee15250-4c379157-4a52a55-eaf93af6_0] Write session: Do CDS request
2025-09-30T14:57:12.579098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fee15250-4c379157-4a52a55-eaf93af6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:12.586283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:12.587917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fee15250-4c379157-4a52a55-eaf93af6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:12.587963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:12.588182Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:12.588193Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:12.588203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:12.588258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:12.588307Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896444044138424:11353]
2025-09-30T14:57:12.588352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:12.588371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2480
2025-09-30T14:57:12.588590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2480 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:12.588636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2480 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:12.588643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2480 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:12.588647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:12.588960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:12.589075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2480 sessionId:  describe result for acl check
2025-09-30T14:57:12.589108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:12.589114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:12.589116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:12.589121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896444133929142:10747] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:12.589321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:12.589375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:12.589714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:12.589787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:12.589794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:12.589798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:12.589799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:12.589800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:12.589802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:12.589803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:12.589804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:12.589805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:12.589807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:12.589808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.589809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.589810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.589812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:12.589813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:12.589820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:12.589829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:12.589834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:12.589838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:12.589842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:12.589846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:12.589850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:12.589855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:12.589859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:12.589863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:12.589868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.589873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.589876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.589880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:12.589884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:12.589892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:12.589905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:12.589915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:12.589927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:12.589935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:12.589950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:12.589954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:12.589959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:12.589964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:12.589975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:12.589980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:12.589985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:12.589994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:12.590004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:12.590013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:12.590018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:12.590023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:12.590033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:12.590037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:12.590046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:12.590050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.590054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.590062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.590067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.590077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.590087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.590095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:12.590085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896444133929142:10747] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:12.590105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:12.590113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:12.590118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:12.590163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:12.591899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896444133929142:10747] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:12.595302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896444133929142:10747] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:12.595318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896444133929142:10747] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:12.595322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896444133929142:10747] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:12.595332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2480 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:12.600157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:12.601045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:12.601062Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:12.601064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:12.601067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:12.601074Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2479 [2:7555896444044138424:11353]
2025-09-30T14:57:12.601095Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:12.601125Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:12.601139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:12.601143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:12.601146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:12.601164Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:12.601171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:12.601177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:12.601247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.601256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.601258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.601261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:12.601263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:12.601344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:12.601352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.601367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.601386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.601405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:12.601430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896444133929181:10747], now have 1 active actors on pipe
2025-09-30T14:57:12.601437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896444133929111:2454], now have 1 active actors on pipe
2025-09-30T14:57:12.601442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896444044138419:11353]
2025-09-30T14:57:12.601444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896444044138419:11353]
2025-09-30T14:57:12.601445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896444044138419:11353]
2025-09-30T14:57:12.601455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:12.601468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:12.601472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:12.601478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:12.601480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:12.601484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:12.601486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:12.601512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896444044138419:11353]
2025-09-30T14:57:12.601520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:12.601531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:12.601551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:12.601560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:12.601598Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8dccf317-bea9178-129ae9d1-bb43bc79_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:12.601610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:12.601617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:12.601619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:12.601629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:12.601479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2479
2025-09-30T14:57:12.601644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:12.601668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:12.601494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2479
2025-09-30T14:57:12.601801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:12.601808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:12.601821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:12.601915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2480 partition: 0 MaxSeqNo: 42 sessionId: src_id|8dccf317-bea9178-129ae9d1-bb43bc79_0
2025-09-30T14:57:12.602559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fee15250-4c379157-4a52a55-eaf93af6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8dccf317-bea9178-129ae9d1-bb43bc79_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:12.606006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dccf317-bea9178-129ae9d1-bb43bc79_0] Write session: try to update token
2025-09-30T14:57:12.606037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dccf317-bea9178-129ae9d1-bb43bc79_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:12.614022Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:12.614049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:12.614051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:12.614053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:12.614062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896444044138419:11353]
2025-09-30T14:57:12.614066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896444044138419:11353]
2025-09-30T14:57:12.614070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896444044138419:11353]
2025-09-30T14:57:12.614106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:12.614115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.614115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:12.614122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:12.614122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:12.614126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:12.614370Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:12.633692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2480 sessionId: src_id|8dccf317-bea9178-129ae9d1-bb43bc79_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:12.637004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:12.678068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896444133929189:10294]
2025-09-30T14:57:12.678440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2479, pipe: [1:7555896444133929189:10294]
2025-09-30T14:57:12.726054Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:12.726463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:12.726480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:12.726500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896444133929189:10294], now have 1 active actors on pipe
2025-09-30T14:57:12.726749Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:12.727273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dccf317-bea9178-129ae9d1-bb43bc79_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:12.727296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dccf317-bea9178-129ae9d1-bb43bc79_0] Write session will restart in 0.008661s
2025-09-30T14:57:12.727339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dccf317-bea9178-129ae9d1-bb43bc79_0] Write session: Do CDS request
2025-09-30T14:57:12.727347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dccf317-bea9178-129ae9d1-bb43bc79_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:12.726807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:12.726813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896444133929189:10294]
2025-09-30T14:57:12.726824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:12.726840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:12.726898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2480 reason: error at write: Disconnected sessionId: src_id|8dccf317-bea9178-129ae9d1-bb43bc79_0
2025-09-30T14:57:12.727055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2480 sessionId: src_id|8dccf317-bea9178-129ae9d1-bb43bc79_0 is DEAD
2025-09-30T14:57:12.735719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:12.737479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:12.737664Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:12.737675Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:12.737685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:12.737738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:12.737780Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896444044138494:11355]
2025-09-30T14:57:12.738460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:12.738734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:12.738774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:12.739117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:12.739181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:12.739188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:12.739192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:12.739193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:12.739194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:12.739195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:12.739197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:12.739198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:12.739199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:12.739200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:12.739202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.739203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.739204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.739205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:12.739206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:12.739212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:12.739222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:12.739226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:12.739230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:12.739234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:12.739238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:12.739258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:12.739261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:12.739265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:12.739271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:12.739275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.739279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.739283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.739286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:12.739290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:12.739297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:12.739306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:12.739312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:12.739318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:12.739323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:12.739328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:12.739332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:12.739337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:12.739343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:12.739348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:12.739353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:12.739357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:12.739362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:12.739366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:12.739370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:12.739382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:12.739386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:12.739396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:12.739400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:12.739409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:12.739414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.739423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.739428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.739432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.739438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.739447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.739451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:12.739456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:12.739464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:12.739469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:12.739513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:12.739910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dccf317-bea9178-129ae9d1-bb43bc79_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:12.740333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:12.740355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2481
2025-09-30T14:57:12.740656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2481 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:12.740715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2481 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:12.740725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2481 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:12.740730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:12.741222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2481 sessionId:  describe result for acl check
2025-09-30T14:57:12.741265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:12.741274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:12.741276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:12.741283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896444133929229:10752] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:12.741867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896444133929229:10752] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:12.744218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896444133929229:10752] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:12.745037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:12.745990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:12.746010Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:12.746014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:12.746017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:12.746027Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2480 [2:7555896444044138494:11355]
2025-09-30T14:57:12.746042Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:12.746057Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:12.746063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:12.746065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:12.746068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:12.746083Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:12.746089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:12.746095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:12.746157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.746167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.746169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.746172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:12.746174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:12.746240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:12.746250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.746263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.746274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.746290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:12.746306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896444044138489:11355]
2025-09-30T14:57:12.746310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896444044138489:11355]
2025-09-30T14:57:12.746314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896444044138489:11355]
2025-09-30T14:57:12.746325Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:12.746344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:12.746349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:12.746353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:12.746355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:12.746363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:12.746366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:12.746399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896444133929192:2454], now have 1 active actors on pipe
2025-09-30T14:57:12.746407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896444044138489:11355]
2025-09-30T14:57:12.746412Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:12.746422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:12.746413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2480
2025-09-30T14:57:12.747117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896444133929229:10752] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:12.747131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896444133929229:10752] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:12.747135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896444133929229:10752] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:12.747143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2481 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:12.747599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896444133929265:10752], now have 1 active actors on pipe
2025-09-30T14:57:12.747634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2480
2025-09-30T14:57:12.747706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:12.747724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:12.747762Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66c422b1-1d3a95b9-3fcfe1f4-82b91cfd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:12.747778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:12.747797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:12.747801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:12.747811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:12.747823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:12.747840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:12.748031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:12.748039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:12.748052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:12.748155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2481 partition: 0 MaxSeqNo: 42 sessionId: src_id|66c422b1-1d3a95b9-3fcfe1f4-82b91cfd_0
2025-09-30T14:57:12.749588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dccf317-bea9178-129ae9d1-bb43bc79_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|66c422b1-1d3a95b9-3fcfe1f4-82b91cfd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:12.753399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66c422b1-1d3a95b9-3fcfe1f4-82b91cfd_0] Write session: try to update token
2025-09-30T14:57:12.753429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66c422b1-1d3a95b9-3fcfe1f4-82b91cfd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:12.758920Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:12.758946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:12.758956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896444044138489:11355]
2025-09-30T14:57:12.758999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:12.759184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:12.759391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:12.759537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:12.759678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:12.759873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:12.759908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:12.760239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:12.770529Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:12.770553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:12.770555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:12.770557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:12.770572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896444044138489:11355]
2025-09-30T14:57:12.770576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896444044138489:11355]
2025-09-30T14:57:12.770580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896444044138489:11355]
2025-09-30T14:57:12.770618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:12.770624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.770629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:12.770675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:12.770681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:12.770686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:12.770781Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:12.786503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2481 sessionId: src_id|66c422b1-1d3a95b9-3fcfe1f4-82b91cfd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:12.789952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:12.827121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896444133929271:10294]
2025-09-30T14:57:12.827513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2480, pipe: [1:7555896444133929271:10294]
2025-09-30T14:57:12.884894Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:12.885344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:12.885362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:12.885383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896444133929271:10294], now have 1 active actors on pipe
2025-09-30T14:57:12.885615Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:12.885751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:12.885804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:12.885901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896444133929271:10294]
2025-09-30T14:57:12.885961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2481 reason: status is not ok: tablet will be restarted right now sessionId: src_id|66c422b1-1d3a95b9-3fcfe1f4-82b91cfd_0
2025-09-30T14:57:12.886171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2481 sessionId: src_id|66c422b1-1d3a95b9-3fcfe1f4-82b91cfd_0 is DEAD
2025-09-30T14:57:12.886320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66c422b1-1d3a95b9-3fcfe1f4-82b91cfd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:12.886327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66c422b1-1d3a95b9-3fcfe1f4-82b91cfd_0] Write session will restart in 0.006013s
2025-09-30T14:57:12.886367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66c422b1-1d3a95b9-3fcfe1f4-82b91cfd_0] Write session: Do CDS request
2025-09-30T14:57:12.886373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66c422b1-1d3a95b9-3fcfe1f4-82b91cfd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:12.893795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66c422b1-1d3a95b9-3fcfe1f4-82b91cfd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:12.893982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:12.894015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2482
2025-09-30T14:57:12.894237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2482 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:12.894285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2482 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:12.894304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2482 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:12.894311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:12.894854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2482 sessionId:  describe result for acl check
2025-09-30T14:57:12.894855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:12.894895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:12.894904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:12.894907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:12.894913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896444133929304:10756] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:12.895478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896444133929304:10756] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:12.896501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:12.897509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896444133929304:10756] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:12.896726Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:12.896738Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:12.896751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:12.896808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:12.896847Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896444044138565:11357]
2025-09-30T14:57:12.897483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:12.897836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:12.897909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:12.898262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:12.898339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:12.898347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:12.898348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:12.898349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:12.898351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:12.898352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:12.898353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:12.898354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:12.898355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:12.898357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:12.898359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.898360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.898361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.898362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:12.898363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:12.898369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:12.898379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:12.898383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:12.898387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:12.898391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:12.898396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:12.898400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:12.898404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:12.898408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:12.898412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:12.898417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.898422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.898426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.898429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:12.898433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:12.898440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:12.898447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:12.898453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:12.898459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:12.898464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:12.898469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:12.898486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:12.898498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:12.898503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:12.898508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:12.898512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:12.898517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:12.898522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:12.898527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:12.898531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:12.898537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:12.898542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:12.898547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:12.898550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:12.898555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:12.898566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.898570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.898575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.898579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.898584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.898591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.898595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:12.898601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:12.898605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:12.898609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:12.898649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:12.903845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896444133929304:10756] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:12.903865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896444133929304:10756] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:12.903870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896444133929304:10756] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:12.903879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2482 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:12.904227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:12.905165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:12.905185Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:12.905188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:12.905192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:12.905199Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2481 [2:7555896444044138565:11357]
2025-09-30T14:57:12.905215Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:12.905244Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:12.905246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:12.905249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:12.905252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:12.905268Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:12.905276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:12.905285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:12.905353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.905362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.905364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.905368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:12.905371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:12.905452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:12.905462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.905479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:12.905506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:12.905530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:12.905555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896444133929344:10756], now have 1 active actors on pipe
2025-09-30T14:57:12.905559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896444133929272:2454], now have 1 active actors on pipe
2025-09-30T14:57:12.905565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896444044138560:11357]
2025-09-30T14:57:12.905567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896444044138560:11357]
2025-09-30T14:57:12.905569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896444044138560:11357]
2025-09-30T14:57:12.905603Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2481
2025-09-30T14:57:12.905625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2481
2025-09-30T14:57:12.905583Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:12.905599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:12.905602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:12.905602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:12.905605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:12.905614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:12.905617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:12.905652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896444044138560:11357]
2025-09-30T14:57:12.905654Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:12.905657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:12.905676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:12.905681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:12.905728Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31ac2a58-f0a96f0e-2bfbb285-e004a05b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:12.905744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:12.905748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:12.905750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:12.905758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:12.905768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:12.905786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:12.905991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:12.906000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:12.906013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:12.906110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2482 partition: 0 MaxSeqNo: 42 sessionId: src_id|31ac2a58-f0a96f0e-2bfbb285-e004a05b_0
2025-09-30T14:57:12.906455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66c422b1-1d3a95b9-3fcfe1f4-82b91cfd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|31ac2a58-f0a96f0e-2bfbb285-e004a05b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:12.909619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31ac2a58-f0a96f0e-2bfbb285-e004a05b_0] Write session: try to update token
2025-09-30T14:57:12.909642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31ac2a58-f0a96f0e-2bfbb285-e004a05b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:12.918302Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:12.918327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:12.918330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:12.918333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:12.918348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896444044138560:11357]
2025-09-30T14:57:12.918353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896444044138560:11357]
2025-09-30T14:57:12.918357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896444044138560:11357]
2025-09-30T14:57:12.918397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:12.918404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:12.918407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:12.918413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:12.918420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:12.918425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:12.918544Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:12.926049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2482 sessionId: src_id|31ac2a58-f0a96f0e-2bfbb285-e004a05b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:12.928849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:12.986308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896444133929352:10294]
2025-09-30T14:57:12.986695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2481, pipe: [1:7555896444133929352:10294]
2025-09-30T14:57:13.050485Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:13.050912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:13.050929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:13.050947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896444133929352:10294], now have 1 active actors on pipe
2025-09-30T14:57:13.051299Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:13.051689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31ac2a58-f0a96f0e-2bfbb285-e004a05b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:13.051699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31ac2a58-f0a96f0e-2bfbb285-e004a05b_0] Write session will restart in 0.005477s
2025-09-30T14:57:13.051716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31ac2a58-f0a96f0e-2bfbb285-e004a05b_0] Write session: Do CDS request
2025-09-30T14:57:13.051721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31ac2a58-f0a96f0e-2bfbb285-e004a05b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:13.051212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896444133929352:10294]
2025-09-30T14:57:13.051260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:13.051263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:13.051340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2482 reason: error at write: Disconnected sessionId: src_id|31ac2a58-f0a96f0e-2bfbb285-e004a05b_0
2025-09-30T14:57:13.051458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:13.051505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2482 sessionId: src_id|31ac2a58-f0a96f0e-2bfbb285-e004a05b_0 is DEAD
2025-09-30T14:57:13.058933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31ac2a58-f0a96f0e-2bfbb285-e004a05b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:13.059040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:13.059057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2483
2025-09-30T14:57:13.059223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2483 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:13.059278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2483 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:13.059284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2483 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:13.059288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:13.059720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2483 sessionId:  describe result for acl check
2025-09-30T14:57:13.059747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:13.059750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:13.059751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:13.059760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896448428896656:10760] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:13.060304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896448428896656:10760] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:13.062282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896448428896656:10760] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:13.064992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896448428896656:10760] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:13.065008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896448428896656:10760] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:13.065015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896448428896656:10760] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:13.065024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2483 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:13.065915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:13.067528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:13.067713Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:13.067723Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:13.067733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:13.067791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:13.067837Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896448339105949:11361]
2025-09-30T14:57:13.068434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:13.068765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:13.068807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:13.069108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:13.069188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:13.069189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:13.069190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:13.069191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:13.069193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:13.069194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:13.069195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:13.069196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:13.069197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:13.069199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:13.069200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.069201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.069202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.069205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:13.069206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:13.069211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:13.069221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:13.069225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:13.069229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:13.069233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:13.069236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:13.069240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:13.069243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:13.069247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:13.069250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:13.069254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.069257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.069260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.069264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:13.069267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:13.069274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:13.069281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:13.069287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:13.069292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:13.069296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:13.069301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:13.069305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:13.069309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:13.069314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:13.069319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:13.069322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:13.069327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:13.069331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:13.069335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:13.069342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:13.069347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:13.069351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:13.069355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:13.069359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:13.069363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:13.069367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.069371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.069375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.069379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.069383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.069387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.069391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:13.069395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:13.069401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:13.069405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:13.069446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:13.074938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:13.075860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:13.075882Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:13.075885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:13.075889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:13.075898Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2482 [2:7555896448339105949:11361]
2025-09-30T14:57:13.075915Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:13.075933Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:13.075942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:13.075946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:13.075948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:13.075964Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:13.075976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:13.075986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:13.076046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.076054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.076056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.076059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:13.076062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:13.076202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:13.076211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.076224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.076242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.076267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:13.076292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896448428896649:2454], now have 1 active actors on pipe
2025-09-30T14:57:13.076302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896448428896716:10760], now have 1 active actors on pipe
2025-09-30T14:57:13.076308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896448339105944:11361]
2025-09-30T14:57:13.076316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896448339105944:11361]
2025-09-30T14:57:13.076319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896448339105944:11361]
2025-09-30T14:57:13.076289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2482
2025-09-30T14:57:13.076290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2482
2025-09-30T14:57:13.076328Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:13.076337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:13.076340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:13.076342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:13.076346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:13.076361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:13.076365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:13.076392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:13.076401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:13.076455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896448339105944:11361]
2025-09-30T14:57:13.076468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:13.076474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:13.076489Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7aa8a089-5d42ab07-87c9e918-3f799daf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:13.076500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:13.076504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:13.076509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:13.076518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:13.076531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:13.076578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:13.076744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:13.076751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:13.076765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:13.076844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2483 partition: 0 MaxSeqNo: 42 sessionId: src_id|7aa8a089-5d42ab07-87c9e918-3f799daf_0
2025-09-30T14:57:13.077285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31ac2a58-f0a96f0e-2bfbb285-e004a05b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7aa8a089-5d42ab07-87c9e918-3f799daf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:13.080896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7aa8a089-5d42ab07-87c9e918-3f799daf_0] Write session: try to update token
2025-09-30T14:57:13.080927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7aa8a089-5d42ab07-87c9e918-3f799daf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:13.088855Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:13.088873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:13.088875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:13.088876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:13.088884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896448339105944:11361]
2025-09-30T14:57:13.088887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896448339105944:11361]
2025-09-30T14:57:13.088889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896448339105944:11361]
2025-09-30T14:57:13.088920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:13.088926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.088927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:13.088939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:13.088946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:13.088951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:13.089090Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:13.104198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2483 sessionId: src_id|7aa8a089-5d42ab07-87c9e918-3f799daf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:13.106961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:13.151160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896448428896733:10294]
2025-09-30T14:57:13.151634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2482, pipe: [1:7555896448428896733:10294]
2025-09-30T14:57:13.203205Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:13.203577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:13.203593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:13.203614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896448428896733:10294], now have 1 active actors on pipe
2025-09-30T14:57:13.204019Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:13.208897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7aa8a089-5d42ab07-87c9e918-3f799daf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:13.208917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7aa8a089-5d42ab07-87c9e918-3f799daf_0] Write session will restart in 0.005433s
2025-09-30T14:57:13.208964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7aa8a089-5d42ab07-87c9e918-3f799daf_0] Write session: Do CDS request
2025-09-30T14:57:13.208380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:13.208974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7aa8a089-5d42ab07-87c9e918-3f799daf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:13.208432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896448428896733:10294]
2025-09-30T14:57:13.208457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:13.208549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2483 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7aa8a089-5d42ab07-87c9e918-3f799daf_0
2025-09-30T14:57:13.208745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2483 sessionId: src_id|7aa8a089-5d42ab07-87c9e918-3f799daf_0 is DEAD
2025-09-30T14:57:13.215923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7aa8a089-5d42ab07-87c9e918-3f799daf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:13.216021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:13.216039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2484
2025-09-30T14:57:13.216205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2484 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:13.216234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2484 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:13.216239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2484 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:13.216244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:13.216722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2484 sessionId:  describe result for acl check
2025-09-30T14:57:13.216750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:13.216752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:13.216754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:13.216760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896448428896757:10768] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:13.217333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896448428896757:10768] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:13.219152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896448428896757:10768] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:13.223984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896448428896757:10768] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:13.224002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896448428896757:10768] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:13.224006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896448428896757:10768] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:13.224014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2484 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:13.223926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:13.226315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:13.226530Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:13.226544Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:13.226570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:13.226641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:13.226686Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896448339106022:11363]
2025-09-30T14:57:13.227325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:13.227733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:13.227788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:13.228151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:13.228236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:13.228243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:13.228244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:13.228245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:13.228247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:13.228248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:13.228250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:13.228251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:13.228252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:13.228253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:13.228255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.228256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.228257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.228259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:13.228260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:13.228266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:13.228277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:13.228281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:13.228285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:13.228290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:13.228294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:13.228299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:13.228303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:13.228307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:13.228315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:13.228318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.228322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.228327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.228331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:13.228335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:13.228343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:13.228350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:13.228356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:13.228362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:13.228367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:13.228373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:13.228378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:13.228383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:13.228388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:13.228393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:13.228398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:13.228404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:13.228412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:13.228417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:13.228422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:13.228427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:13.228431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:13.228447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:13.228451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:13.228455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:13.228460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.228464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.228469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.228475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.228479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.228485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.228489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:13.228493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:13.228498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:13.228505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:13.228551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:13.237336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:13.238266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:13.238284Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:13.238287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:13.238293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:13.238303Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2483 [2:7555896448339106022:11363]
2025-09-30T14:57:13.238321Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:13.238339Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:13.238342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:13.238345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:13.238348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:13.238366Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:13.238375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:13.238388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:13.238457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.238464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.238467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.238472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:13.238475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:13.238546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:13.238554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.238567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.238579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.238600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:13.238623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896448428896817:10768], now have 1 active actors on pipe
2025-09-30T14:57:13.238627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896448428896748:2454], now have 1 active actors on pipe
2025-09-30T14:57:13.238636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896448339106016:11363]
2025-09-30T14:57:13.238643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896448339106016:11363]
2025-09-30T14:57:13.238645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896448339106016:11363]
2025-09-30T14:57:13.238658Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:13.238673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:13.238683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:13.238685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:13.238700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:13.238716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:13.238724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:13.238761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896448339106016:11363]
2025-09-30T14:57:13.238772Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:13.238816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:13.239005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2483
2025-09-30T14:57:13.239060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2483
2025-09-30T14:57:13.239053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:13.239064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:13.239088Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87d803f4-e60e630d-6b1410af-fcde9b74_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:13.239106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:13.239109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:13.239111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:13.239122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:13.239136Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:13.239158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:13.239423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:13.239456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:13.239484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:13.239634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2484 partition: 0 MaxSeqNo: 42 sessionId: src_id|87d803f4-e60e630d-6b1410af-fcde9b74_0
2025-09-30T14:57:13.240026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7aa8a089-5d42ab07-87c9e918-3f799daf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|87d803f4-e60e630d-6b1410af-fcde9b74_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:13.243111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87d803f4-e60e630d-6b1410af-fcde9b74_0] Write session: try to update token
2025-09-30T14:57:13.243131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87d803f4-e60e630d-6b1410af-fcde9b74_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:13.254771Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:13.254793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:13.254797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:13.254804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:13.254814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896448339106016:11363]
2025-09-30T14:57:13.254817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896448339106016:11363]
2025-09-30T14:57:13.254823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896448339106016:11363]
2025-09-30T14:57:13.254862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:13.254869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.254872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:13.254874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:13.254881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:13.254884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:13.255022Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:13.266121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2484 sessionId: src_id|87d803f4-e60e630d-6b1410af-fcde9b74_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:13.269196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:13.308377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896448428896836:10294]
2025-09-30T14:57:13.308678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2483, pipe: [1:7555896448428896836:10294]
2025-09-30T14:57:13.371748Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:13.372115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:13.372131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:13.372152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896448428896836:10294], now have 1 active actors on pipe
2025-09-30T14:57:13.372451Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:13.372381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:13.372397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:13.372476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2484 reason: error at write: Disconnected sessionId: src_id|87d803f4-e60e630d-6b1410af-fcde9b74_0
2025-09-30T14:57:13.372483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896448428896836:10294]
2025-09-30T14:57:13.372501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:13.372665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2484 sessionId: src_id|87d803f4-e60e630d-6b1410af-fcde9b74_0 is DEAD
2025-09-30T14:57:13.375381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d803f4-e60e630d-6b1410af-fcde9b74_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:13.375400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d803f4-e60e630d-6b1410af-fcde9b74_0] Write session will restart in 0.005485s
2025-09-30T14:57:13.375429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d803f4-e60e630d-6b1410af-fcde9b74_0] Write session: Do CDS request
2025-09-30T14:57:13.375439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d803f4-e60e630d-6b1410af-fcde9b74_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:13.383821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87d803f4-e60e630d-6b1410af-fcde9b74_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:13.383946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:13.384430Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:13.384455Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2485
2025-09-30T14:57:13.384661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2485 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:13.384704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2485 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:13.384710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2485 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:13.384716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:13.385276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2485 sessionId:  describe result for acl check
2025-09-30T14:57:13.385308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:13.385309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:13.385311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:13.385317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896448428896873:10772] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:13.385919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896448428896873:10772] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:13.385213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:13.385409Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:13.385414Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:13.385423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:13.385476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:13.385517Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896448339106094:11365]
2025-09-30T14:57:13.386145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:13.386709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:13.386759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:13.387109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:13.387168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:13.387170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:13.387171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:13.387172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:13.387173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:13.387175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:13.387176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:13.387177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:13.387179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:13.387180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:13.387182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.387183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.387184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.387185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:13.387187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:13.387193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:13.387203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:13.387208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:13.387212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:13.387217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:13.387221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:13.387225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:13.387229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:13.387234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:13.387239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:13.387260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.387265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.387269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.387273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:13.387277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:13.387286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:13.387295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:13.387301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:13.387307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:13.387312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:13.387317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:13.387324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:13.387329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:13.387334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:13.387341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:13.387346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:13.387351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:13.387356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:13.387361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:13.387366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:13.387371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:13.387376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:13.387383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:13.387390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:13.387395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:13.387400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.387405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.387409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.387413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.387417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.387421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.387425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:13.387429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:13.387433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:13.387437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:13.387481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:13.390954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896448428896873:10772] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:13.398301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896448428896873:10772] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:13.398319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896448428896873:10772] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:13.398332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896448428896873:10772] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:13.398343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2485 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:13.400125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:13.401928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:13.401939Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:13.401942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:13.401947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:13.401955Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2484 [2:7555896448339106094:11365]
2025-09-30T14:57:13.401988Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:13.402012Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:13.402016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:13.402019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:13.402022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:13.402049Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:13.402057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:13.402064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:13.402151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.402154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.402157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.402162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:13.402164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:13.402256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:13.402259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.402276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.402288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.402305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:13.402327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896448339106089:11365]
2025-09-30T14:57:13.402334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896448339106089:11365]
2025-09-30T14:57:13.402337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896448339106089:11365]
2025-09-30T14:57:13.402356Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:13.402380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:13.402398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:13.402402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:13.402455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896448339106089:11365]
2025-09-30T14:57:13.402462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:13.402641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:13.402644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:13.402647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:13.402654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:13.403052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896448428896912:10772], now have 1 active actors on pipe
2025-09-30T14:57:13.403057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896448428896837:2454], now have 1 active actors on pipe
2025-09-30T14:57:13.404005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2484
2025-09-30T14:57:13.404041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2484
2025-09-30T14:57:13.407658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:13.407690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:13.407735Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|655f831b-3f22f889-84772ff2-72d149e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:13.407756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:13.407761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:13.407766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:13.407783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:13.407802Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:13.407825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:13.413791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2485 partition: 0 MaxSeqNo: 42 sessionId: src_id|655f831b-3f22f889-84772ff2-72d149e5_0
2025-09-30T14:57:13.414396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d803f4-e60e630d-6b1410af-fcde9b74_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|655f831b-3f22f889-84772ff2-72d149e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:13.413040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:13.413058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:13.413087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:13.418076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|655f831b-3f22f889-84772ff2-72d149e5_0] Write session: try to update token
2025-09-30T14:57:13.418106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|655f831b-3f22f889-84772ff2-72d149e5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:13.417795Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:13.417809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:13.417817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896448339106089:11365]
2025-09-30T14:57:13.417854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:13.418032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:13.418184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:13.418323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:13.418474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:13.418681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:13.418714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:13.418794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:13.430957Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:13.430977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:13.430981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:13.430983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:13.430995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896448339106089:11365]
2025-09-30T14:57:13.431000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896448339106089:11365]
2025-09-30T14:57:13.431004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896448339106089:11365]
2025-09-30T14:57:13.431049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:13.431057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.431060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:13.431063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:13.431071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:13.431077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:13.431220Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:13.444244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2485 sessionId: src_id|655f831b-3f22f889-84772ff2-72d149e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:13.447616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:13.472731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896448428896921:10294]
2025-09-30T14:57:13.473021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2484, pipe: [1:7555896448428896921:10294]
2025-09-30T14:57:13.549019Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:13.549387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:13.549405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:13.549425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896448428896921:10294], now have 1 active actors on pipe
2025-09-30T14:57:13.549611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:13.549627Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:13.549626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:13.549721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2485 reason: error at write: Disconnected sessionId: src_id|655f831b-3f22f889-84772ff2-72d149e5_0
2025-09-30T14:57:13.549922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2485 sessionId: src_id|655f831b-3f22f889-84772ff2-72d149e5_0 is DEAD
2025-09-30T14:57:13.550098Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:13.550146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896448428896921:10294]
2025-09-30T14:57:13.550319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|655f831b-3f22f889-84772ff2-72d149e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:13.550336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|655f831b-3f22f889-84772ff2-72d149e5_0] Write session will restart in 0.009605s
2025-09-30T14:57:13.550378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|655f831b-3f22f889-84772ff2-72d149e5_0] Write session: Do CDS request
2025-09-30T14:57:13.550390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|655f831b-3f22f889-84772ff2-72d149e5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:13.560910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|655f831b-3f22f889-84772ff2-72d149e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:13.561090Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:13.561116Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2486
2025-09-30T14:57:13.561310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2486 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:13.561362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2486 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:13.561371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2486 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:13.561375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:13.561785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2486 sessionId:  describe result for acl check
2025-09-30T14:57:13.561818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:13.561823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:13.561825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:13.561830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896448428896971:10782] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:13.562379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896448428896971:10782] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:13.563714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:13.565720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:13.566134Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:13.566146Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:13.566161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:13.566234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:13.566269Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896448339106185:11374]
2025-09-30T14:57:13.566520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896448428896971:10782] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:13.566896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:13.567457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:13.567509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:13.567855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:13.568110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:13.568112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:13.568113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:13.568114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:13.568115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:13.568116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:13.568117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:13.568118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:13.568119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:13.568121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:13.568123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.568123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.568125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.568126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:13.568127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:13.568134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:13.568143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:13.568147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:13.568150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:13.568154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:13.568157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:13.568161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:13.568164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:13.568167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:13.568171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:13.568175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.568179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.568183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.568186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:13.568190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:13.568199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:13.568207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:13.568212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:13.568217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:13.568224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:13.568229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:13.568233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:13.568237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:13.568242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:13.568247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:13.568251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:13.568257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:13.568261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:13.568266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:13.568271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:13.568276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:13.568281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:13.568286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:13.568290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:13.568296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:13.568300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.568306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.568310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.568314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.568318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.568324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.568328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:13.568333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:13.568337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:13.568343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:13.568381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:13.569424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896448428896971:10782] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:13.569441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896448428896971:10782] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:13.569447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896448428896971:10782] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:13.569455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2486 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:13.574486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:13.575732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:13.575751Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:13.575753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:13.575756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:13.575763Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2485 [2:7555896448339106185:11374]
2025-09-30T14:57:13.575778Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:13.575793Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:13.575796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:13.575799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:13.575801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:13.575816Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:13.575825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:13.575831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:13.575892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.575900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.575902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.575905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:13.575908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:13.575980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:13.575987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.576001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.576015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.576034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:13.576056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896448428897011:10782], now have 1 active actors on pipe
2025-09-30T14:57:13.576060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896448428896935:2454], now have 1 active actors on pipe
2025-09-30T14:57:13.576067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896448339106180:11374]
2025-09-30T14:57:13.576074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896448339106180:11374]
2025-09-30T14:57:13.576076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896448339106180:11374]
2025-09-30T14:57:13.576088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:13.576102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:13.576107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:13.576111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:13.576113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:13.576122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:13.576125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:13.576110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2485
2025-09-30T14:57:13.576135Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2485
2025-09-30T14:57:13.576290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896448339106180:11374]
2025-09-30T14:57:13.576305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:13.576322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:13.576324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:13.576329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:13.576388Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b202a9ff-f198e27f-2c320fab-5a76e68e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:13.576401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:13.576409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:13.576411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:13.576421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:13.576436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:13.576469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:13.576696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:13.576703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:13.576717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:13.576791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2486 partition: 0 MaxSeqNo: 42 sessionId: src_id|b202a9ff-f198e27f-2c320fab-5a76e68e_0
2025-09-30T14:57:13.577210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|655f831b-3f22f889-84772ff2-72d149e5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b202a9ff-f198e27f-2c320fab-5a76e68e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:13.580545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b202a9ff-f198e27f-2c320fab-5a76e68e_0] Write session: try to update token
2025-09-30T14:57:13.580569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b202a9ff-f198e27f-2c320fab-5a76e68e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:13.588387Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:13.588405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:13.588408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:13.588410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:13.588419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896448339106180:11374]
2025-09-30T14:57:13.588424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896448339106180:11374]
2025-09-30T14:57:13.588429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896448339106180:11374]
2025-09-30T14:57:13.588467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:13.588473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.588476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:13.588474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:13.588480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:13.588485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:13.588605Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:13.601886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2486 sessionId: src_id|b202a9ff-f198e27f-2c320fab-5a76e68e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:13.604925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:13.650375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896448428897029:10294]
2025-09-30T14:57:13.650734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2485, pipe: [1:7555896448428897029:10294]
2025-09-30T14:57:13.699680Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:13.700057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:13.700073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:13.700092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896448428897029:10294], now have 1 active actors on pipe
2025-09-30T14:57:13.700396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896448428897029:10294]
2025-09-30T14:57:13.700427Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:13.700430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:13.700432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:13.700502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2486 reason: error at write: Disconnected sessionId: src_id|b202a9ff-f198e27f-2c320fab-5a76e68e_0
2025-09-30T14:57:13.700678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2486 sessionId: src_id|b202a9ff-f198e27f-2c320fab-5a76e68e_0 is DEAD
2025-09-30T14:57:13.700959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b202a9ff-f198e27f-2c320fab-5a76e68e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:13.700420Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:13.700973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b202a9ff-f198e27f-2c320fab-5a76e68e_0] Write session will restart in 0.007147s
2025-09-30T14:57:13.700996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b202a9ff-f198e27f-2c320fab-5a76e68e_0] Write session: Do CDS request
2025-09-30T14:57:13.701002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b202a9ff-f198e27f-2c320fab-5a76e68e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:13.708610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:13.710279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:13.710480Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:13.710491Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:13.710502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:13.710560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:13.710604Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896448339106284:11382]
2025-09-30T14:57:13.711330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:13.711673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b202a9ff-f198e27f-2c320fab-5a76e68e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:13.711685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:13.711749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:13.711882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:13.711898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2487
2025-09-30T14:57:13.712329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2487 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:13.712372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2487 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:13.712382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2487 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:13.712387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:13.712813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2487 sessionId:  describe result for acl check
2025-09-30T14:57:13.712853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:13.712855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:13.712859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:13.712866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896448428897083:10788] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:13.712107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:13.713456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896448428897083:10788] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:13.712189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:13.712190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:13.712191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:13.712193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:13.712194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:13.712195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:13.712196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:13.712197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:13.712199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:13.712200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:13.712201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.712203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.712204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.712205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:13.712206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:13.712211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:13.712221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:13.712225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:13.712228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:13.712232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:13.712236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:13.712240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:13.712244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:13.712250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:13.712254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:13.712257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.712261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.712264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.712268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:13.712271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:13.712280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:13.712287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:13.712292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:13.712298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:13.712304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:13.712309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:13.712313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:13.712318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:13.712323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:13.712330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:13.712334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:13.712339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:13.712344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:13.712349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:13.712353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:13.712358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:13.712363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:13.712368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:13.712371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:13.712378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:13.712382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.712387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.712391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.712395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.712402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.712406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.712409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:13.712414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:13.712418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:13.712424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:13.712471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:13.715642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896448428897083:10788] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:13.718131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:13.719073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:13.719078Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:13.719080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:13.719084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:13.719091Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2486 [2:7555896448339106284:11382]
2025-09-30T14:57:13.719106Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:13.719120Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:13.719123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:13.719127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:13.719128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:13.719143Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:13.719150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:13.719156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:13.719216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.719218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.719222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.719225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:13.719227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:13.719316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:13.719318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.719331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.719342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.719358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:13.719136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896448428897083:10788] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:13.719150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896448428897083:10788] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:13.719153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896448428897083:10788] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:13.719161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2487 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:13.719374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896448339106279:11382]
2025-09-30T14:57:13.719387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896448339106279:11382]
2025-09-30T14:57:13.719391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896448339106279:11382]
2025-09-30T14:57:13.719399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:13.719404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:13.719408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:13.719409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:13.719415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:13.719428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:13.719431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:13.719442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896448428897032:2454], now have 1 active actors on pipe
2025-09-30T14:57:13.719445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896448428897117:10788], now have 1 active actors on pipe
2025-09-30T14:57:13.719477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896448339106279:11382]
2025-09-30T14:57:13.719489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:13.719472Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2486
2025-09-30T14:57:13.719503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:13.719481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2486
2025-09-30T14:57:13.719534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:13.719543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:13.719566Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3fce8a05-ff04aeed-7573489d-d774a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:13.719576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:13.719582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:13.719588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:13.719596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:13.719611Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:13.719631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:13.719816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:13.719823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:13.719837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:13.719951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2487 partition: 0 MaxSeqNo: 42 sessionId: src_id|3fce8a05-ff04aeed-7573489d-d774a4_0
2025-09-30T14:57:13.720277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b202a9ff-f198e27f-2c320fab-5a76e68e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3fce8a05-ff04aeed-7573489d-d774a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:13.723309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fce8a05-ff04aeed-7573489d-d774a4_0] Write session: try to update token
2025-09-30T14:57:13.723327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fce8a05-ff04aeed-7573489d-d774a4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:13.732740Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:13.732755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:13.732761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:13.732763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:13.732774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896448339106279:11382]
2025-09-30T14:57:13.732779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896448339106279:11382]
2025-09-30T14:57:13.732782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896448339106279:11382]
2025-09-30T14:57:13.732819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:13.732826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.732829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:13.732833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:13.732840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:13.732845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:13.732955Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:13.739871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2487 sessionId: src_id|3fce8a05-ff04aeed-7573489d-d774a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:13.742581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:13.800408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896448428897124:10294]
2025-09-30T14:57:13.800722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2486, pipe: [1:7555896448428897124:10294]
2025-09-30T14:57:13.846535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:13.846585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:13.846588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:13.846591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896448428897124:10294]
2025-09-30T14:57:13.846650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2487 reason: error at write: Disconnected sessionId: src_id|3fce8a05-ff04aeed-7573489d-d774a4_0
2025-09-30T14:57:13.846802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2487 sessionId: src_id|3fce8a05-ff04aeed-7573489d-d774a4_0 is DEAD
2025-09-30T14:57:13.846985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fce8a05-ff04aeed-7573489d-d774a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:13.846996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fce8a05-ff04aeed-7573489d-d774a4_0] Write session will restart in 0.005715s
2025-09-30T14:57:13.847020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fce8a05-ff04aeed-7573489d-d774a4_0] Write session: Do CDS request
2025-09-30T14:57:13.847026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fce8a05-ff04aeed-7573489d-d774a4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:13.845851Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:13.846247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:13.846256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:13.846279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896448428897124:10294], now have 1 active actors on pipe
2025-09-30T14:57:13.846865Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:13.853718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fce8a05-ff04aeed-7573489d-d774a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:13.853800Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:13.853817Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2488
2025-09-30T14:57:13.854126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2488 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:13.854190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2488 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:13.854211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2488 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:13.854216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:13.854659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2488 sessionId:  describe result for acl check
2025-09-30T14:57:13.854692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:13.854700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:13.854701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:13.854707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896448428897164:10792] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:13.855227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896448428897164:10792] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:13.854604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:13.857241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896448428897164:10792] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:13.856171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:13.856370Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:13.856374Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:13.856384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:13.856434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:13.856464Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896448339106360:11384]
2025-09-30T14:57:13.857008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:13.857339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:13.857404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:13.857746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:13.857804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:13.857806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:13.857808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:13.857821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:13.857823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:13.857825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:13.857826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:13.857829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:13.857830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:13.857831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:13.857833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.857834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.857835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.857836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:13.857837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:13.857843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:13.857854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:13.857859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:13.857863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:13.857868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:13.857872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:13.857877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:13.857881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:13.857886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:13.857891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:13.857896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.857900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.857905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.857909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:13.857913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:13.857922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:13.857930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:13.857936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:13.857943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:13.857948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:13.857954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:13.857959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:13.857965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:13.857972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:13.857978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:13.857983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:13.857989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:13.857994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:13.858000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:13.858004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:13.858010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:13.858015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:13.858021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:13.858026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:13.858032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:13.858037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.858044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.858048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.858054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.858059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.858065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.858070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:13.858076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:13.858081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:13.858088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:13.858136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:13.864129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896448428897164:10792] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:13.864148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896448428897164:10792] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:13.864152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896448428897164:10792] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:13.864162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2488 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:13.865924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2487
2025-09-30T14:57:13.865957Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2487
2025-09-30T14:57:13.866398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2488 partition: 0 MaxSeqNo: 42 sessionId: src_id|de5ebb66-91eb4407-be7fd5ab-a5a19dcb_0
2025-09-30T14:57:13.866743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fce8a05-ff04aeed-7573489d-d774a4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|de5ebb66-91eb4407-be7fd5ab-a5a19dcb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:13.864483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:13.865512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:13.865520Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:13.865523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:13.865528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:13.865535Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2487 [2:7555896448339106360:11384]
2025-09-30T14:57:13.865555Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:13.865572Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:13.865575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:13.865579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:13.865581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:13.865597Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:13.865604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:13.865612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:13.865671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.865673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.865675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.865679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:13.865681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:13.865752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:13.865755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.865769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:13.865782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:13.865801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:13.865819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896448428897204:10792], now have 1 active actors on pipe
2025-09-30T14:57:13.865823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896448428897126:2454], now have 1 active actors on pipe
2025-09-30T14:57:13.865829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896448339106354:11384]
2025-09-30T14:57:13.865831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896448339106354:11384]
2025-09-30T14:57:13.865833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896448339106354:11384]
2025-09-30T14:57:13.865850Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:13.865866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:13.865882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:13.865885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:13.865901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:13.865905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:13.865918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:13.865921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896448339106354:11384]
2025-09-30T14:57:13.865924Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:13.865927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:13.865965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:13.865970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:13.865997Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de5ebb66-91eb4407-be7fd5ab-a5a19dcb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:13.866004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:13.866012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:13.866015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:13.866024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:13.866033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:13.866049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:13.866268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:13.866272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:13.866287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:13.869720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de5ebb66-91eb4407-be7fd5ab-a5a19dcb_0] Write session: try to update token
2025-09-30T14:57:13.869741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de5ebb66-91eb4407-be7fd5ab-a5a19dcb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:13.878086Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:13.878108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:13.878118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896448339106354:11384]
2025-09-30T14:57:13.878165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:13.878337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:13.878492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:13.878638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:13.878777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:13.878974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:13.879016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:13.880079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:13.889173Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:13.889190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:13.889197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:13.889199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:13.889212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896448339106354:11384]
2025-09-30T14:57:13.889216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896448339106354:11384]
2025-09-30T14:57:13.889218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896448339106354:11384]
2025-09-30T14:57:13.889259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:13.889266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:13.889268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:13.889268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:13.889273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:13.889278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:13.889413Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:13.888650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2488 sessionId: src_id|de5ebb66-91eb4407-be7fd5ab-a5a19dcb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:13.891463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:13.946824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896448428897211:10294]
2025-09-30T14:57:13.947346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2487, pipe: [1:7555896448428897211:10294]
2025-09-30T14:57:14.009912Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:14.010234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:14.010254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:14.010277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896448428897211:10294], now have 1 active actors on pipe
2025-09-30T14:57:14.010512Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:14.010514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:14.010519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:14.010566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896448428897211:10294]
2025-09-30T14:57:14.010557Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:14.010583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2488 reason: error at write: Disconnected sessionId: src_id|de5ebb66-91eb4407-be7fd5ab-a5a19dcb_0
2025-09-30T14:57:14.010755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2488 sessionId: src_id|de5ebb66-91eb4407-be7fd5ab-a5a19dcb_0 is DEAD
2025-09-30T14:57:14.010913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de5ebb66-91eb4407-be7fd5ab-a5a19dcb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:14.010921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de5ebb66-91eb4407-be7fd5ab-a5a19dcb_0] Write session will restart in 0.005874s
2025-09-30T14:57:14.010945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de5ebb66-91eb4407-be7fd5ab-a5a19dcb_0] Write session: Do CDS request
2025-09-30T14:57:14.010951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de5ebb66-91eb4407-be7fd5ab-a5a19dcb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:14.017759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de5ebb66-91eb4407-be7fd5ab-a5a19dcb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:14.017821Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:14.017837Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2489
2025-09-30T14:57:14.017979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2489 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:14.018012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2489 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:14.018017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2489 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:14.018021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:14.018268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:14.018431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2489 sessionId:  describe result for acl check
2025-09-30T14:57:14.018466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:14.018468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:14.018470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:14.018476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896452723864548:10796] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:14.019030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896452723864548:10796] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:14.019823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:14.020047Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:14.020057Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:14.020068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:14.020125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:14.020165Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896452634073747:11388]
2025-09-30T14:57:14.020665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896452723864548:10796] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:14.020798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:14.021085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:14.021138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:14.021469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:14.021559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:14.021560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:14.021561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:14.021562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:14.021564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:14.021565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:14.021566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:14.021567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:14.021569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:14.021569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:14.021571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.021572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.021573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.021574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:14.021575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:14.021580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:14.021590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:14.021593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:14.021597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:14.021601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:14.021605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:14.021609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:14.021612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:14.021616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:14.021620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:14.021624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.021627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.021633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.021636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:14.021639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:14.021646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:14.021654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:14.021659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:14.021664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:14.021668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:14.021672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:14.021676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:14.021682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:14.021685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:14.021690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:14.021694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:14.021700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:14.021703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:14.021707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:14.021711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:14.021715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:14.021719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:14.021724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:14.021727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:14.021731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:14.021737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.021741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.021744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.021748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.021754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.021758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.021762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:14.021766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:14.021774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:14.021779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:14.021820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:14.026905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896452723864548:10796] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:14.026926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896452723864548:10796] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:14.026930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896452723864548:10796] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:14.026939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2489 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:14.027131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:14.028085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:14.028099Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:14.028102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:14.028106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:14.028113Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2488 [2:7555896452634073747:11388]
2025-09-30T14:57:14.028134Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:14.028148Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:14.028155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:14.028158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:14.028161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:14.028177Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:14.028187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:14.028196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:14.028271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.028280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.028282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.028285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:14.028288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:14.028349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:14.028357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.028370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.028386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.028408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:14.028428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896452723864587:10796], now have 1 active actors on pipe
2025-09-30T14:57:14.028435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896452723864509:2454], now have 1 active actors on pipe
2025-09-30T14:57:14.028441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896452634073742:11388]
2025-09-30T14:57:14.028443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896452634073742:11388]
2025-09-30T14:57:14.028445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896452634073742:11388]
2025-09-30T14:57:14.028458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:14.028471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:14.028473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:14.028480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:14.028482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:14.028487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:14.028491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:14.028522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896452634073742:11388]
2025-09-30T14:57:14.028537Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:14.028498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2488
2025-09-30T14:57:14.028528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2488
2025-09-30T14:57:14.028563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:14.028669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:14.028681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:14.028712Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27b67a41-fd88237a-774e90f2-c53f4a1b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:14.028724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:14.028729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:14.028736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:14.028746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:14.028759Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:14.028773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:14.029078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:14.029086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:14.029098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:14.029193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2489 partition: 0 MaxSeqNo: 42 sessionId: src_id|27b67a41-fd88237a-774e90f2-c53f4a1b_0
2025-09-30T14:57:14.029553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de5ebb66-91eb4407-be7fd5ab-a5a19dcb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|27b67a41-fd88237a-774e90f2-c53f4a1b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:14.032194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27b67a41-fd88237a-774e90f2-c53f4a1b_0] Write session: try to update token
2025-09-30T14:57:14.032210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27b67a41-fd88237a-774e90f2-c53f4a1b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:14.040641Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:14.040665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:14.040676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896452634073742:11388]
2025-09-30T14:57:14.040720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:14.040721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:14.040897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:14.041047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:14.041193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:14.041338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:14.041546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:14.041588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:14.047334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2489 sessionId: src_id|27b67a41-fd88237a-774e90f2-c53f4a1b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:14.050277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:14.051161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:14.051187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:14.051205Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:14.051207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:14.051209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:14.051210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:14.051217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896452634073742:11388]
2025-09-30T14:57:14.051219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896452634073742:11388]
2025-09-30T14:57:14.051222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896452634073742:11388]
2025-09-30T14:57:14.051278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:14.051283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:14.051287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:14.051287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:14.051295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.051304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:14.051435Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:14.110675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896452723864595:10294]
2025-09-30T14:57:14.110962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2488, pipe: [1:7555896452723864595:10294]
2025-09-30T14:57:14.159872Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:14.160200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:14.160233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896452723864595:10294], now have 1 active actors on pipe
2025-09-30T14:57:14.160364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:14.160415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896452723864595:10294]
2025-09-30T14:57:14.160436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:14.160482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:14.160490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:14.160556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2489 reason: error at write: Disconnected sessionId: src_id|27b67a41-fd88237a-774e90f2-c53f4a1b_0
2025-09-30T14:57:14.160694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2489 sessionId: src_id|27b67a41-fd88237a-774e90f2-c53f4a1b_0 is DEAD
2025-09-30T14:57:14.160852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27b67a41-fd88237a-774e90f2-c53f4a1b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:14.160864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27b67a41-fd88237a-774e90f2-c53f4a1b_0] Write session will restart in 0.009511s
2025-09-30T14:57:14.160887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27b67a41-fd88237a-774e90f2-c53f4a1b_0] Write session: Do CDS request
2025-09-30T14:57:14.160893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27b67a41-fd88237a-774e90f2-c53f4a1b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:14.168004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:14.169301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:14.169473Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:14.169484Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:14.169495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:14.169543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:14.169593Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896452634073826:11390]
2025-09-30T14:57:14.170127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:14.170372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:14.170401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:14.170659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:14.170707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:14.170714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:14.170716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:14.170717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:14.170718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:14.170720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:14.170721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:14.170722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:14.170723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:14.170724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:14.170725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.170726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.170727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.170728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:14.170729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:14.170734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:14.170746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:14.170751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:14.170755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:14.170759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:14.170764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:14.170768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:14.170772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:14.170776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:14.170781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:14.170785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.170789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.170793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.170796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:14.170798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:14.170804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:14.170810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:14.170813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:14.170817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:14.170819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:14.170822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:14.170824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:14.170827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:14.170830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:14.170833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:14.170835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:14.170838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:14.170841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:14.170843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:14.170846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:14.170849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:14.170853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:14.170856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:14.170859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:14.170861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:14.170864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.170866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.170869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.170872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.170874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.170877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.170879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:14.170882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:14.170884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:14.170887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:14.170911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:14.171732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27b67a41-fd88237a-774e90f2-c53f4a1b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:14.171835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:14.171853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2490
2025-09-30T14:57:14.172118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2490 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:14.172154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2490 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:14.172162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2490 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:14.172173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:14.172522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2490 sessionId:  describe result for acl check
2025-09-30T14:57:14.172562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:14.172569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:14.172571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:14.172576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896452723864650:10800] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:14.173050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896452723864650:10800] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:14.174578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896452723864650:10800] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:14.176143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:14.176881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896452723864650:10800] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:14.176893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896452723864650:10800] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:14.176896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896452723864650:10800] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:14.176904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2490 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:14.177146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:14.177162Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:14.177164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:14.177168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:14.177179Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2489 [2:7555896452634073826:11390]
2025-09-30T14:57:14.177196Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:14.177208Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:14.177211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:14.177214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:14.177217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:14.177233Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:14.177239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:14.177245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:14.177302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.177309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.177311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.177313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:14.177316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:14.177375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:14.177383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.177394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.177403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.177424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:14.177446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896452723864597:2454], now have 1 active actors on pipe
2025-09-30T14:57:14.177455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896452723864688:10800], now have 1 active actors on pipe
2025-09-30T14:57:14.177460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896452634073821:11390]
2025-09-30T14:57:14.177462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896452634073821:11390]
2025-09-30T14:57:14.177464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896452634073821:11390]
2025-09-30T14:57:14.177476Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:14.177495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:14.177497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:14.177506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:14.177508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:14.177511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:14.177514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:14.177487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2489
2025-09-30T14:57:14.177491Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2489
2025-09-30T14:57:14.177545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896452634073821:11390]
2025-09-30T14:57:14.177557Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:14.177559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:14.177575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:14.177579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:14.177623Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d694860-8ebf0b14-36fb0-3dc7c308_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:14.177635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:14.177638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:14.177640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:14.177649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:14.177658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:14.177682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:14.177804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:14.177812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:14.177824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:14.177907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2490 partition: 0 MaxSeqNo: 42 sessionId: src_id|3d694860-8ebf0b14-36fb0-3dc7c308_0
2025-09-30T14:57:14.178254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27b67a41-fd88237a-774e90f2-c53f4a1b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3d694860-8ebf0b14-36fb0-3dc7c308_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:14.181078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d694860-8ebf0b14-36fb0-3dc7c308_0] Write session: try to update token
2025-09-30T14:57:14.181099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d694860-8ebf0b14-36fb0-3dc7c308_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:14.189729Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:14.189745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:14.189750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:14.189752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:14.189761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896452634073821:11390]
2025-09-30T14:57:14.189766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896452634073821:11390]
2025-09-30T14:57:14.189770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896452634073821:11390]
2025-09-30T14:57:14.189809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:14.189816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.189816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:14.189819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:14.189821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:14.189825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:14.189969Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:14.195786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2490 sessionId: src_id|3d694860-8ebf0b14-36fb0-3dc7c308_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:14.198749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:14.263352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896452723864703:10294]
2025-09-30T14:57:14.263633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2489, pipe: [1:7555896452723864703:10294]
2025-09-30T14:57:14.306304Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:14.306699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:14.306714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:14.306752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896452723864703:10294], now have 1 active actors on pipe
2025-09-30T14:57:14.307022Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:14.307050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:14.307055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:14.307076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896452723864703:10294]
2025-09-30T14:57:14.307126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2490 reason: error at write: Disconnected sessionId: src_id|3d694860-8ebf0b14-36fb0-3dc7c308_0
2025-09-30T14:57:14.307143Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:14.307365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2490 sessionId: src_id|3d694860-8ebf0b14-36fb0-3dc7c308_0 is DEAD
2025-09-30T14:57:14.307496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d694860-8ebf0b14-36fb0-3dc7c308_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:14.307508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d694860-8ebf0b14-36fb0-3dc7c308_0] Write session will restart in 0.006401s
2025-09-30T14:57:14.307531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d694860-8ebf0b14-36fb0-3dc7c308_0] Write session: Do CDS request
2025-09-30T14:57:14.307537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d694860-8ebf0b14-36fb0-3dc7c308_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:14.314800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d694860-8ebf0b14-36fb0-3dc7c308_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:14.314870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:14.314887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2491
2025-09-30T14:57:14.315017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2491 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:14.315050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2491 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:14.315061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2491 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:14.315067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:14.315940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:14.315515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2491 sessionId:  describe result for acl check
2025-09-30T14:57:14.315553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:14.315557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:14.315559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:14.315566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896452723864749:10806] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:14.316136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896452723864749:10806] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:14.318128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:14.318350Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:14.318365Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:14.318376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:14.318452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:14.318498Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896452634073906:11392]
2025-09-30T14:57:14.319176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:14.319602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:14.319649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:14.320008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:14.320077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:14.320083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:14.320085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:14.320086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:14.320088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:14.320089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:14.320091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:14.320092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:14.320094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:14.320095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:14.320096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.320098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.320102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.320103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:14.320104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:14.320110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:14.320119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:14.320123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:14.320127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:14.320131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:14.320135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:14.320139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:14.320143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:14.320148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:14.320153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:14.320157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.320162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.320166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.320170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:14.320175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:14.320184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:14.320192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:14.320199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:14.320205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:14.320210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:14.320216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:14.320221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:14.320228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:14.320233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:14.320239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:14.320244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:14.320251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:14.320256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:14.320262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:14.320275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:14.320283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:14.320292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:14.320299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:14.320307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:14.320312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:14.320323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.320330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.320339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.320345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.320372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.320378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.320382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:14.320388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:14.320393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:14.320398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:14.320447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:14.320933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896452723864749:10806] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:14.325817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896452723864749:10806] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:14.325837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896452723864749:10806] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:14.325841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896452723864749:10806] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:14.325850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2491 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:14.326111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:14.327534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2490
2025-09-30T14:57:14.327546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2490
2025-09-30T14:57:14.327069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:14.327086Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:14.327089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:14.327093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:14.327100Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2490 [2:7555896452634073906:11392]
2025-09-30T14:57:14.327119Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:14.327137Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:14.327143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:14.327145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:14.327148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:14.327165Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:14.327174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:14.327180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:14.327241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.327300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.327302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.327305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:14.327307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:14.327376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:14.327378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.327392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.327403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.327423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:14.327440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896452723864708:2454], now have 1 active actors on pipe
2025-09-30T14:57:14.327448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896452634073901:11392]
2025-09-30T14:57:14.327450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896452634073901:11392]
2025-09-30T14:57:14.327451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896452634073901:11392]
2025-09-30T14:57:14.327465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:14.327476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896452723864789:10806], now have 1 active actors on pipe
2025-09-30T14:57:14.327486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:14.327489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:14.327494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:14.327496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:14.327499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:14.327502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:14.327535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896452634073901:11392]
2025-09-30T14:57:14.327544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:14.327557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:14.327717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:14.327722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:14.327749Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2fded981-d1812d1d-940ed16c-1a85e41d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:14.327756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:14.327760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:14.327762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:14.327772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:14.327782Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:14.327794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:14.328038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:14.328043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:14.328060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:14.328140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2491 partition: 0 MaxSeqNo: 42 sessionId: src_id|2fded981-d1812d1d-940ed16c-1a85e41d_0
2025-09-30T14:57:14.328533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d694860-8ebf0b14-36fb0-3dc7c308_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2fded981-d1812d1d-940ed16c-1a85e41d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:14.331525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fded981-d1812d1d-940ed16c-1a85e41d_0] Write session: try to update token
2025-09-30T14:57:14.331546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fded981-d1812d1d-940ed16c-1a85e41d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:14.342535Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:14.342552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:14.342561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896452634073901:11392]
2025-09-30T14:57:14.342606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:14.342624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:14.342781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:14.342922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:14.343052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:14.343179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:14.343397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:14.343438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:14.348914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2491 sessionId: src_id|2fded981-d1812d1d-940ed16c-1a85e41d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:14.351712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:14.351959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:14.351985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:14.352027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:14.352144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:14.357392Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:14.357416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:14.357418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:14.357421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:14.357431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896452634073901:11392]
2025-09-30T14:57:14.357435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896452634073901:11392]
2025-09-30T14:57:14.357442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896452634073901:11392]
2025-09-30T14:57:14.357483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:14.357491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.357490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:14.357494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:14.357499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:14.357503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:14.357634Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:14.407104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896452723864796:10294]
2025-09-30T14:57:14.407438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2490, pipe: [1:7555896452723864796:10294]
2025-09-30T14:57:14.476847Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:14.485467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:14.485495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:14.485668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:14.485737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:14.485810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:14.485885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:14.486204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:14.486219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:14.486296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:14.486364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:14.486434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:14.486778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:14.486832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:14.486841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:14.486914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:14.486997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:14.487067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:14.487132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:14.487190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:14.487199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:14.487314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:14.487399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:14.487473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:14.487545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:14.487599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:14.487607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:14.487680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:14.487751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:14.487821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:14.487900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:14.487956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:14.487960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:14.488043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:14.488109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:14.488174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:14.488245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:14.488292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:14.488295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:14.488372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:14.488433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:14.488504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:14.488571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:14.488617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:14.488620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:14.488695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:14.488763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:14.488830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:14.488897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:14.488944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:14.488946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:14.489027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:14.489093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:14.489176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:14.489249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:14.489298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:14.489301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:14.489376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:14.489439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:14.489503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:14.489574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:14.489622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:14.489625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:14.489731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896452723864796:10294], now have 1 active actors on pipe
2025-09-30T14:57:14.489984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896452723864796:10294]
2025-09-30T14:57:14.490019Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:14.490163Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:14.490502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:14.490549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2491 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2fded981-d1812d1d-940ed16c-1a85e41d_0
2025-09-30T14:57:14.490759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2491 sessionId: src_id|2fded981-d1812d1d-940ed16c-1a85e41d_0 is DEAD
2025-09-30T14:57:14.490865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fded981-d1812d1d-940ed16c-1a85e41d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:14.490875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fded981-d1812d1d-940ed16c-1a85e41d_0] Write session will restart in 0.009289s
2025-09-30T14:57:14.490899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fded981-d1812d1d-940ed16c-1a85e41d_0] Write session: Do CDS request
2025-09-30T14:57:14.490905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fded981-d1812d1d-940ed16c-1a85e41d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:14.500854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:14.501806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fded981-d1812d1d-940ed16c-1a85e41d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:14.501875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:14.501892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2492
2025-09-30T14:57:14.502058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2492 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:14.502118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2492 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:14.502129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2492 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:14.502133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:14.502407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:14.502604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2492 sessionId:  describe result for acl check
2025-09-30T14:57:14.502635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:14.502636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:14.502639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:14.502645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896452723864843:10810] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:14.502612Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:14.502628Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:14.502640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:14.502706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:14.502751Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896452634073988:11394]
2025-09-30T14:57:14.503194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896452723864843:10810] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:14.503473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:14.503846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:14.503899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:14.504321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:14.504401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:14.504408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:14.504409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:14.504411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:14.504412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:14.504414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:14.504418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:14.504419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:14.504420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:14.504421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:14.504423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.504424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.504425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.504426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:14.504428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:14.504433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:14.504444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:14.504448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:14.504452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:14.504456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:14.504460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:14.504464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:14.504468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:14.504471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:14.504476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:14.504481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.504485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.504489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.504492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:14.504497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:14.504504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:14.504512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:14.504518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:14.504526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:14.504532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:14.504542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:14.504547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:14.504554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:14.504560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:14.504569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:14.504574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:14.504580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:14.504600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:14.504610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:14.504615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:14.504620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:14.504626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:14.504631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:14.504636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:14.504641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:14.504648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.504653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.504657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.504662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.504667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.504672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.504677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:14.504687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:14.504693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:14.504703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:14.504749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:14.505763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896452723864843:10810] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:14.509949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896452723864843:10810] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:14.509972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896452723864843:10810] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:14.509976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896452723864843:10810] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:14.509987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2492 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:14.510320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:14.511351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:14.511368Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:14.511371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:14.511375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:14.511382Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2491 [2:7555896452634073988:11394]
2025-09-30T14:57:14.511401Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:14.511415Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:14.511420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:14.511423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:14.511425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:14.511443Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:14.511455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:14.511461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:14.511533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.511540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.511541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.511544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:14.511547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:14.511629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:14.511637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.511650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.511663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.511680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:14.511707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896452723864881:10810], now have 1 active actors on pipe
2025-09-30T14:57:14.511716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896452723864798:2454], now have 1 active actors on pipe
2025-09-30T14:57:14.511723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896452634073982:11394]
2025-09-30T14:57:14.511724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896452634073982:11394]
2025-09-30T14:57:14.511726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896452634073982:11394]
2025-09-30T14:57:14.511734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:14.511747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:14.511735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2491
2025-09-30T14:57:14.511745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2491
2025-09-30T14:57:14.511760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:14.511769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:14.511769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:14.511773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:14.511775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:14.511811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896452634073982:11394]
2025-09-30T14:57:14.511824Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:14.511831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:14.511841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:14.511849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:14.511898Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|819861a0-9fd8b48a-a495ac53-d434bb06_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:14.511909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:14.511912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:14.511914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:14.511922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:14.511935Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:14.511960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:14.512172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:14.512182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:14.512194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:14.512292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2492 partition: 0 MaxSeqNo: 42 sessionId: src_id|819861a0-9fd8b48a-a495ac53-d434bb06_0
2025-09-30T14:57:14.512705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fded981-d1812d1d-940ed16c-1a85e41d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|819861a0-9fd8b48a-a495ac53-d434bb06_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:14.515477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|819861a0-9fd8b48a-a495ac53-d434bb06_0] Write session: try to update token
2025-09-30T14:57:14.515498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|819861a0-9fd8b48a-a495ac53-d434bb06_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:14.524853Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:14.524869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:14.524873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:14.524875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:14.524883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896452634073982:11394]
2025-09-30T14:57:14.524886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896452634073982:11394]
2025-09-30T14:57:14.524889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896452634073982:11394]
2025-09-30T14:57:14.524927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:14.524933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:14.524934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.524937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:14.524938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:14.524942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:14.525070Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:14.534154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2492 sessionId: src_id|819861a0-9fd8b48a-a495ac53-d434bb06_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:14.537186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:14.585771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896452723864901:10294]
2025-09-30T14:57:14.586054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2491, pipe: [1:7555896452723864901:10294]
2025-09-30T14:57:14.645514Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:14.645870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:14.645887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:14.645908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896452723864901:10294], now have 1 active actors on pipe
2025-09-30T14:57:14.646163Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:14.646220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:14.646240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:14.646312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2492 reason: error at write: Disconnected sessionId: src_id|819861a0-9fd8b48a-a495ac53-d434bb06_0
2025-09-30T14:57:14.646495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2492 sessionId: src_id|819861a0-9fd8b48a-a495ac53-d434bb06_0 is DEAD
2025-09-30T14:57:14.646663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|819861a0-9fd8b48a-a495ac53-d434bb06_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:14.646675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|819861a0-9fd8b48a-a495ac53-d434bb06_0] Write session will restart in 0.009210s
2025-09-30T14:57:14.646667Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:14.646728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|819861a0-9fd8b48a-a495ac53-d434bb06_0] Write session: Do CDS request
2025-09-30T14:57:14.646721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896452723864901:10294]
2025-09-30T14:57:14.646743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|819861a0-9fd8b48a-a495ac53-d434bb06_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:14.655553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:14.656875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|819861a0-9fd8b48a-a495ac53-d434bb06_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:14.657004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:14.657031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2493
2025-09-30T14:57:14.657204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2493 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:14.657250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2493 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:14.657261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2493 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:14.657266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:14.657579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:14.657777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2493 sessionId:  describe result for acl check
2025-09-30T14:57:14.657817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:14.657819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:14.657821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:14.657820Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:14.657830Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:14.657827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896452723864956:10821] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:14.657853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:14.657928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:14.657977Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896452634074108:11409]
2025-09-30T14:57:14.658450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896452723864956:10821] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:14.658647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:14.658900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:14.658956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:14.659347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:14.659421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:14.659427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:14.659429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:14.659430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:14.659431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:14.659433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:14.659434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:14.659435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:14.659437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:14.659438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:14.659439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.659443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.659444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.659445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:14.659446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:14.659451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:14.659460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:14.659463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:14.659466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:14.659470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:14.659474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:14.659477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:14.659480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:14.659484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:14.659488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:14.659491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.659495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.659498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.659502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:14.659505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:14.659512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:14.659520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:14.659527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:14.659532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:14.659537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:14.659542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:14.659546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:14.659551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:14.659556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:14.659560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:14.659565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:14.659569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:14.659574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:14.659580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:14.659585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:14.659590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:14.659595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:14.659601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:14.659612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:14.659616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:14.659621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.659625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.659629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.659634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.659640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.659644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.659648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:14.659654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:14.659658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:14.659663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:14.659705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:14.660832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896452723864956:10821] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:14.666354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896452723864956:10821] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:14.666373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896452723864956:10821] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:14.666380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896452723864956:10821] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:14.666389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2493 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:14.668023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:14.668886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:14.668907Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:14.668910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:14.668914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:14.668921Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2492 [2:7555896452634074108:11409]
2025-09-30T14:57:14.668938Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:14.668956Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:14.668964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:14.668967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:14.668969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:14.668987Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:14.668993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:14.669005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:14.669059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.669066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.669068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.669071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:14.669074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:14.669158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:14.669165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.669179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.669191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.669212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:14.669231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896452634074103:11409]
2025-09-30T14:57:14.669238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896452634074103:11409]
2025-09-30T14:57:14.669239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896452634074103:11409]
2025-09-30T14:57:14.669248Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:14.669259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:14.669267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896452723864994:10821], now have 1 active actors on pipe
2025-09-30T14:57:14.669269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:14.669271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896452723864912:2454], now have 1 active actors on pipe
2025-09-30T14:57:14.669272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:14.669279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:14.669295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:14.669303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:14.669342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896452634074103:11409]
2025-09-30T14:57:14.669353Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:14.669347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2492
2025-09-30T14:57:14.669368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:14.669355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2492
2025-09-30T14:57:14.669517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:14.669530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:14.669559Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d519c72-402e91b1-f117c872-847880ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:14.669575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:14.669582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:14.669583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:14.669593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:14.669607Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:14.669626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:14.669801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:14.669809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:14.669823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:14.669914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2493 partition: 0 MaxSeqNo: 42 sessionId: src_id|1d519c72-402e91b1-f117c872-847880ce_0
2025-09-30T14:57:14.670304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|819861a0-9fd8b48a-a495ac53-d434bb06_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1d519c72-402e91b1-f117c872-847880ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:14.673370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d519c72-402e91b1-f117c872-847880ce_0] Write session: try to update token
2025-09-30T14:57:14.673391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d519c72-402e91b1-f117c872-847880ce_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:14.685698Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:14.685719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:14.685721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:14.685723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:14.685733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896452634074103:11409]
2025-09-30T14:57:14.685738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896452634074103:11409]
2025-09-30T14:57:14.685742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896452634074103:11409]
2025-09-30T14:57:14.685780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:14.685787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:14.685789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.685791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:14.685793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:14.685798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:14.685949Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:14.691393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2493 sessionId: src_id|1d519c72-402e91b1-f117c872-847880ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:14.694213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:14.747060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896452723865004:10294]
2025-09-30T14:57:14.747388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2492, pipe: [1:7555896452723865004:10294]
2025-09-30T14:57:14.798294Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:14.798600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:14.798615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:14.798647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896452723865004:10294], now have 1 active actors on pipe
2025-09-30T14:57:14.798783Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:14.798854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896452723865004:10294]
2025-09-30T14:57:14.798864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:14.798885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:14.798942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2493 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1d519c72-402e91b1-f117c872-847880ce_0
2025-09-30T14:57:14.799131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2493 sessionId: src_id|1d519c72-402e91b1-f117c872-847880ce_0 is DEAD
2025-09-30T14:57:14.799303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d519c72-402e91b1-f117c872-847880ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:14.799314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d519c72-402e91b1-f117c872-847880ce_0] Write session will restart in 0.009422s
2025-09-30T14:57:14.799338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d519c72-402e91b1-f117c872-847880ce_0] Write session: Do CDS request
2025-09-30T14:57:14.799344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d519c72-402e91b1-f117c872-847880ce_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:14.807521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:14.809581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:14.809798Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:14.809811Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:14.809823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:14.809880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:14.809949Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896452634074191:11411]
2025-09-30T14:57:14.809980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d519c72-402e91b1-f117c872-847880ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:14.810043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:14.810062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2494
2025-09-30T14:57:14.810241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2494 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:14.810273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2494 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:14.810278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2494 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:14.810283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:14.810613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:14.810903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:14.810954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:14.811335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:14.811413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:14.811420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:14.811421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:14.811422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:14.811424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:14.811425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:14.811426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:14.811428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:14.811429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:14.811430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:14.811431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.811435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.811436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.811437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:14.811438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:14.811445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:14.811454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:14.811459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:14.811463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:14.811467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:14.811472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:14.811476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:14.811480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:14.811484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:14.811488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:14.811492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.811496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.811500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.811504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:14.811508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:14.811515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:14.811523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:14.811529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:14.811535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:14.811540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:14.811546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:14.811552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:14.811558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:14.810749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2494 sessionId:  describe result for acl check
2025-09-30T14:57:14.811563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:14.810785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:14.811568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:14.810787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:14.811573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:14.811578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:14.810789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:14.811584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:14.810795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896452723865054:10826] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:14.811589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:14.811371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896452723865054:10826] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:14.811594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:14.811599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:14.811605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:14.811610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:14.811615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:14.811620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:14.811625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.811629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.811634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.811639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.811650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.811656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.811660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:14.811664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:14.811673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:14.811678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:14.811731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:14.813906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896452723865054:10826] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:14.818233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:14.819098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:14.819113Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:14.819116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:14.819121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:14.819129Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2493 [2:7555896452634074191:11411]
2025-09-30T14:57:14.819147Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:14.819164Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:14.819174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:14.819177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:14.819180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:14.819200Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:14.819207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:14.819214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:14.819294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.819302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.819304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.819308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:14.819313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:14.819393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:14.819400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.819412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:14.819425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:14.819449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:14.819466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896452634074186:11411]
2025-09-30T14:57:14.819473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896452634074186:11411]
2025-09-30T14:57:14.819475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896452634074186:11411]
2025-09-30T14:57:14.819483Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:14.819494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:14.819497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:14.819500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:14.819508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896452723865005:2454], now have 1 active actors on pipe
2025-09-30T14:57:14.819514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:14.819527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:14.819535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:14.819572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896452634074186:11411]
2025-09-30T14:57:14.819586Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:14.819627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:14.819685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2493
2025-09-30T14:57:14.819991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896452723865054:10826] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:14.819998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896452723865054:10826] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:14.820001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896452723865054:10826] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:14.820009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2494 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:14.820364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896452723865092:10826], now have 1 active actors on pipe
2025-09-30T14:57:14.820368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2493
2025-09-30T14:57:14.820458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:14.820467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:14.820500Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0294f3a-c174e3f-7af45e4d-f0604ad0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:14.820512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:14.820516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:14.820520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:14.820532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:14.820542Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:14.820561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:14.820686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:14.820693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:14.820705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:14.820847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2494 partition: 0 MaxSeqNo: 42 sessionId: src_id|c0294f3a-c174e3f-7af45e4d-f0604ad0_0
2025-09-30T14:57:14.821259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d519c72-402e91b1-f117c872-847880ce_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c0294f3a-c174e3f-7af45e4d-f0604ad0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:14.824372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0294f3a-c174e3f-7af45e4d-f0604ad0_0] Write session: try to update token
2025-09-30T14:57:14.824393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0294f3a-c174e3f-7af45e4d-f0604ad0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:14.834414Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:14.834438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:14.834448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896452634074186:11411]
2025-09-30T14:57:14.834493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:14.834503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:14.834674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:14.834836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:14.834985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:14.835134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:14.835441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:14.835494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:14.843184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2494 sessionId: src_id|c0294f3a-c174e3f-7af45e4d-f0604ad0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:14.845890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:14.846217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:14.846242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:14.846283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:14.846530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:14.847961Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:14.847984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:14.847987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:14.847989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:14.847999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896452634074186:11411]
2025-09-30T14:57:14.848008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896452634074186:11411]
2025-09-30T14:57:14.848013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896452634074186:11411]
2025-09-30T14:57:14.848053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:14.848063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:14.848066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:14.848068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:14.848071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:14.848075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:14.848230Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:14.899199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896452723865097:10294]
2025-09-30T14:57:14.899576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2493, pipe: [1:7555896452723865097:10294]
2025-09-30T14:57:14.969950Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:14.978429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:14.978455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:14.978642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:14.978714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:14.978790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:14.978863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:14.978918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:14.978930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:14.979007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:14.979074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:14.979147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:14.979221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:14.979290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:14.979305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:14.979375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:14.979440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:14.979516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:14.979585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:14.979634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:14.979642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:14.979717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:14.979786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:14.979858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:14.979929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:14.979978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:14.979987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:14.980059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:14.980128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:14.980196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:14.980265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:14.980315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:14.980323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:14.980394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:14.980464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:14.982398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:14.982411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:14.982442Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:14.982447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2494 reason: error at write: Disconnected sessionId: src_id|c0294f3a-c174e3f-7af45e4d-f0604ad0_0
2025-09-30T14:57:14.982494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896452723865097:10294]
2025-09-30T14:57:14.982634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2494 sessionId: src_id|c0294f3a-c174e3f-7af45e4d-f0604ad0_0 is DEAD
2025-09-30T14:57:14.980536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:14.980603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:14.980648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:14.980651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:14.980719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:14.980778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:14.980843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:14.980904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:14.980950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:14.980954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:14.981026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:14.981085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:14.981161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:14.981224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:14.981369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:14.981373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:14.981439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:14.981494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:14.981560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:14.981621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:14.981664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:14.981668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:14.981736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:14.981797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:14.981861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:14.981924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:14.981967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:14.981970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:14.982069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896452723865097:10294], now have 1 active actors on pipe
2025-09-30T14:57:14.982585Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:14.982872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0294f3a-c174e3f-7af45e4d-f0604ad0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:14.982882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0294f3a-c174e3f-7af45e4d-f0604ad0_0] Write session will restart in 0.008044s
2025-09-30T14:57:14.982906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0294f3a-c174e3f-7af45e4d-f0604ad0_0] Write session: Do CDS request
2025-09-30T14:57:14.982912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0294f3a-c174e3f-7af45e4d-f0604ad0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:14.991705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0294f3a-c174e3f-7af45e4d-f0604ad0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:14.992043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:14.992059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2495
2025-09-30T14:57:14.992178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2495 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:14.992220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2495 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:14.992230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2495 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:14.992234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:14.992742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2495 sessionId:  describe result for acl check
2025-09-30T14:57:14.992796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:14.992803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:14.992805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:14.992813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896452723865126:10830] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:14.993394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896452723865126:10830] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:14.996571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896452723865126:10830] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:15.000346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:15.000356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896452723865126:10830] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:15.000374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896452723865126:10830] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:15.000378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896452723865126:10830] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:15.000386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2495 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:15.002704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:15.002937Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:15.002950Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:15.002962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:15.003023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:15.003064Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896456929041587:11415]
2025-09-30T14:57:15.003795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:15.004192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:15.004243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:15.004597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:15.004663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:15.004670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:15.004671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:15.004672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:15.004674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:15.004678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:15.004679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:15.004681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:15.004682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:15.004683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:15.004684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.004685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.004687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.004688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:15.004689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:15.004695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:15.004706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:15.004710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:15.004715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:15.004719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:15.004723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:15.004727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:15.004731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:15.004735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:15.004740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:15.004744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.004748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.004752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.004756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:15.004760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:15.004768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:15.004776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:15.004783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:15.004789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:15.004794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:15.004799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:15.004805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:15.004810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:15.004815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:15.004820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:15.004824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:15.004829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:15.004834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:15.004839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:15.004844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:15.004850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:15.004854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:15.004859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:15.004864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:15.004869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:15.004874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.004880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.004885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.004891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.004896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.004902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.004914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:15.004921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:15.004926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:15.004932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:15.004981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:15.013674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:15.015002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:15.015031Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:15.015036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:15.015041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:15.015050Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2494 [2:7555896456929041587:11415]
2025-09-30T14:57:15.015073Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:15.015100Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:15.015113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:15.015118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:15.015121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:15.015148Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:15.015163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:15.015174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:15.015329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.015340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.015342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.015346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:15.015349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:15.015443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:15.015453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.015471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.015490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.015529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:15.015563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896452634074285:11415]
2025-09-30T14:57:15.015572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896452634074285:11415]
2025-09-30T14:57:15.015574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896452634074285:11415]
2025-09-30T14:57:15.015586Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:15.015603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:15.015624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:15.015628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:15.015683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896452634074285:11415]
2025-09-30T14:57:15.015693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:15.015724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:15.015730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896452723865102:2454], now have 1 active actors on pipe
2025-09-30T14:57:15.015736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896457018832475:10830], now have 1 active actors on pipe
2025-09-30T14:57:15.015742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:15.015745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:15.015755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:15.016164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2494
2025-09-30T14:57:15.016212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2494
2025-09-30T14:57:15.016461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:15.016479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:15.016517Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e5556df-f4f544a9-f3bee2dd-189c4d6e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:15.016534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:15.016546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:15.016548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:15.016563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:15.016579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:15.016605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:15.016839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:15.016852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:15.016870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:15.016991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2495 partition: 0 MaxSeqNo: 42 sessionId: src_id|5e5556df-f4f544a9-f3bee2dd-189c4d6e_0
2025-09-30T14:57:15.017418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0294f3a-c174e3f-7af45e4d-f0604ad0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5e5556df-f4f544a9-f3bee2dd-189c4d6e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:15.020365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e5556df-f4f544a9-f3bee2dd-189c4d6e_0] Write session: try to update token
2025-09-30T14:57:15.020397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e5556df-f4f544a9-f3bee2dd-189c4d6e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:15.042032Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:15.042053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:15.042056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:15.042059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:15.042069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896452634074285:11415]
2025-09-30T14:57:15.042073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896452634074285:11415]
2025-09-30T14:57:15.042078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896452634074285:11415]
2025-09-30T14:57:15.042122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:15.042130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.042130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:15.042135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:15.042138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:15.042157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:15.042280Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:15.050772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2495 sessionId: src_id|5e5556df-f4f544a9-f3bee2dd-189c4d6e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:15.054125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:15.083351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896457018832487:10294]
2025-09-30T14:57:15.091447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2494, pipe: [1:7555896457018832487:10294]
2025-09-30T14:57:15.167041Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:15.167434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:15.167456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:15.167518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896457018832487:10294], now have 1 active actors on pipe
2025-09-30T14:57:15.168004Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:15.168049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896457018832487:10294]
2025-09-30T14:57:15.168083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:15.168118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:15.168187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2495 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5e5556df-f4f544a9-f3bee2dd-189c4d6e_0
2025-09-30T14:57:15.168359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2495 sessionId: src_id|5e5556df-f4f544a9-f3bee2dd-189c4d6e_0 is DEAD
2025-09-30T14:57:15.168736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e5556df-f4f544a9-f3bee2dd-189c4d6e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:15.168747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e5556df-f4f544a9-f3bee2dd-189c4d6e_0] Write session will restart in 0.006464s
2025-09-30T14:57:15.168772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e5556df-f4f544a9-f3bee2dd-189c4d6e_0] Write session: Do CDS request
2025-09-30T14:57:15.168778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e5556df-f4f544a9-f3bee2dd-189c4d6e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:15.176729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e5556df-f4f544a9-f3bee2dd-189c4d6e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:15.177998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:15.178018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2496
2025-09-30T14:57:15.178178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2496 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:15.178223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2496 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:15.178233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2496 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:15.178236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:15.178666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2496 sessionId:  describe result for acl check
2025-09-30T14:57:15.178697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:15.178704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:15.178706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:15.178712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896457018832509:10835] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:15.179200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896457018832509:10835] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:15.181250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896457018832509:10835] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:15.184047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896457018832509:10835] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:15.184069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896457018832509:10835] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:15.184072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896457018832509:10835] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:15.184081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2496 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:15.186836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:15.188806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:15.188987Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:15.188991Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:15.189002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:15.189089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:15.189136Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896456929041672:11417]
2025-09-30T14:57:15.189804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:15.190102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:15.190151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:15.190462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:15.190519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:15.190520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:15.190521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:15.190523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:15.190524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:15.190525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:15.190526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:15.190527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:15.190529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:15.190530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:15.190531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.190532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.190533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.190534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:15.190535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:15.190541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:15.190551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:15.190555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:15.190559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:15.190566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:15.190570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:15.190574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:15.190578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:15.190583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:15.190588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:15.190592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.190596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.190600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.190604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:15.190608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:15.190615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:15.190622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:15.190628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:15.190633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:15.190638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:15.190643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:15.190647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:15.190652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:15.190656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:15.190661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:15.190665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:15.190669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:15.190674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:15.190678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:15.190682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:15.190687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:15.190692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:15.190696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:15.190700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:15.190704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:15.190712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.190716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.190720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.190725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.190732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.190736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.190741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:15.190746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:15.190750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:15.190754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:15.190792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:15.198437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:15.199395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:15.199412Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:15.199415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:15.199419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:15.199426Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2495 [2:7555896456929041672:11417]
2025-09-30T14:57:15.199446Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:15.199462Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:15.199465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:15.199470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:15.199472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:15.199489Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:15.199503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:15.199510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:15.199579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.199587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.199589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.199592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:15.199597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:15.199663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:15.199671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.199683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.199696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.199719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:15.199742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896457018832551:10835], now have 1 active actors on pipe
2025-09-30T14:57:15.199746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896457018832490:2454], now have 1 active actors on pipe
2025-09-30T14:57:15.199753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896456929041667:11417]
2025-09-30T14:57:15.199755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896456929041667:11417]
2025-09-30T14:57:15.199757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896456929041667:11417]
2025-09-30T14:57:15.199770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:15.199786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:15.199801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:15.199806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:15.199806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:15.199809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:15.199809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:15.199828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2495
2025-09-30T14:57:15.199842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896456929041667:11417]
2025-09-30T14:57:15.199856Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:15.199873Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2495
2025-09-30T14:57:15.199910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:15.199951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:15.199962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:15.199988Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1343b01-9762a03d-15a8fb26-c5f0d348_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:15.199994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:15.200002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:15.200004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:15.200014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:15.200023Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:15.200042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:15.200201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:15.200217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:15.200243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:15.200321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2496 partition: 0 MaxSeqNo: 42 sessionId: src_id|b1343b01-9762a03d-15a8fb26-c5f0d348_0
2025-09-30T14:57:15.200702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e5556df-f4f544a9-f3bee2dd-189c4d6e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b1343b01-9762a03d-15a8fb26-c5f0d348_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:15.203615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1343b01-9762a03d-15a8fb26-c5f0d348_0] Write session: try to update token
2025-09-30T14:57:15.203633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1343b01-9762a03d-15a8fb26-c5f0d348_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:15.215279Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:15.215298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:15.215301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:15.215303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:15.215313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896456929041667:11417]
2025-09-30T14:57:15.215319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896456929041667:11417]
2025-09-30T14:57:15.215323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896456929041667:11417]
2025-09-30T14:57:15.215371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:15.215378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.215383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:15.215428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:15.215445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:15.215454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:15.215557Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:15.219562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2496 sessionId: src_id|b1343b01-9762a03d-15a8fb26-c5f0d348_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:15.222488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:15.268309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896457018832602:10294]
2025-09-30T14:57:15.268683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2495, pipe: [1:7555896457018832602:10294]
2025-09-30T14:57:15.334678Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:15.334997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:15.335013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:15.335065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896457018832602:10294], now have 1 active actors on pipe
2025-09-30T14:57:15.335306Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:15.335376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896457018832602:10294]
2025-09-30T14:57:15.335413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:15.335500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2496 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b1343b01-9762a03d-15a8fb26-c5f0d348_0
2025-09-30T14:57:15.335668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2496 sessionId: src_id|b1343b01-9762a03d-15a8fb26-c5f0d348_0 is DEAD
2025-09-30T14:57:15.335861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1343b01-9762a03d-15a8fb26-c5f0d348_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:15.335872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1343b01-9762a03d-15a8fb26-c5f0d348_0] Write session will restart in 0.007961s
2025-09-30T14:57:15.335895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1343b01-9762a03d-15a8fb26-c5f0d348_0] Write session: Do CDS request
2025-09-30T14:57:15.335882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:15.335901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1343b01-9762a03d-15a8fb26-c5f0d348_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:15.344795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1343b01-9762a03d-15a8fb26-c5f0d348_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:15.344878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:15.344894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2497
2025-09-30T14:57:15.345076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2497 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:15.345147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2497 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:15.345158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2497 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:15.345165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:15.345668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2497 sessionId:  describe result for acl check
2025-09-30T14:57:15.345731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:15.345742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:15.345744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:15.345750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896457018832652:10840] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:15.346313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896457018832652:10840] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:15.346716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:15.348978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896457018832652:10840] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:15.348711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:15.348951Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:15.348957Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:15.348973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:15.349041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:15.349078Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896456929041757:11419]
2025-09-30T14:57:15.349829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:15.350185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:15.350239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:15.350558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:15.350627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:15.350628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:15.350629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:15.350630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:15.350632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:15.350633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:15.350634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:15.350635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:15.350636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:15.350637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:15.350638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.350640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.350641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.350642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:15.350643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:15.350650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:15.350661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:15.350664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:15.350668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:15.350672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:15.350675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:15.350678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:15.350681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:15.350685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:15.350688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:15.350691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.350694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.350697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.350700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:15.350703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:15.350711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:15.350719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:15.350725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:15.350731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:15.350735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:15.350740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:15.350744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:15.350749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:15.350754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:15.350758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:15.350762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:15.350767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:15.350772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:15.350777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:15.350781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:15.350786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:15.350792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:15.350797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:15.350801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:15.350806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:15.350811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.350816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.350820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.350825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.350832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.350838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.350842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:15.350847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:15.350851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:15.350856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:15.350913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:15.354649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896457018832652:10840] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:15.354666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896457018832652:10840] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:15.354670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896457018832652:10840] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:15.354681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2497 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:15.358578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:15.360152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2496
2025-09-30T14:57:15.360177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2496
2025-09-30T14:57:15.359697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:15.359716Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:15.359720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:15.359725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:15.359732Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2496 [2:7555896456929041757:11419]
2025-09-30T14:57:15.359754Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:15.359775Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:15.359779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:15.359786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:15.359788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:15.359809Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:15.359816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:15.359824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:15.359900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.359905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.359907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.359911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:15.359913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:15.359988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:15.359990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.360006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.360018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.360037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:15.360057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896457018832607:2454], now have 1 active actors on pipe
2025-09-30T14:57:15.360060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896457018832694:10840], now have 1 active actors on pipe
2025-09-30T14:57:15.360068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896456929041751:11419]
2025-09-30T14:57:15.360070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896456929041751:11419]
2025-09-30T14:57:15.360072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896456929041751:11419]
2025-09-30T14:57:15.360086Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:15.360101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:15.360106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:15.360110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:15.360117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:15.360120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:15.360125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:15.360161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896456929041751:11419]
2025-09-30T14:57:15.360168Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:15.360204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:15.360227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:15.360231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:15.360257Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3565ef8-2da813f0-8f0ae8f3-7a28363b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:15.360265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:15.360273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:15.360278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:15.360289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:15.360299Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:15.360314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:15.360822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:15.360828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:15.360848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:15.361131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2497 partition: 0 MaxSeqNo: 42 sessionId: src_id|e3565ef8-2da813f0-8f0ae8f3-7a28363b_0
2025-09-30T14:57:15.361518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1343b01-9762a03d-15a8fb26-c5f0d348_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e3565ef8-2da813f0-8f0ae8f3-7a28363b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:15.364609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3565ef8-2da813f0-8f0ae8f3-7a28363b_0] Write session: try to update token
2025-09-30T14:57:15.364634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3565ef8-2da813f0-8f0ae8f3-7a28363b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:15.378156Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:15.378178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:15.378180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:15.378182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:15.378194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896456929041751:11419]
2025-09-30T14:57:15.378199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896456929041751:11419]
2025-09-30T14:57:15.378204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896456929041751:11419]
2025-09-30T14:57:15.378255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:15.378263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.378266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:15.378285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:15.378301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:15.378306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:15.378420Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:15.386537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2497 sessionId: src_id|e3565ef8-2da813f0-8f0ae8f3-7a28363b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:15.389268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:15.435717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896457018832702:10294]
2025-09-30T14:57:15.436102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2496, pipe: [1:7555896457018832702:10294]
2025-09-30T14:57:15.501113Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:15.501470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:15.501483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:15.501521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896457018832702:10294], now have 1 active actors on pipe
2025-09-30T14:57:15.501754Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:15.501834Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:15.501860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:15.501899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896457018832702:10294]
2025-09-30T14:57:15.501952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2497 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e3565ef8-2da813f0-8f0ae8f3-7a28363b_0
2025-09-30T14:57:15.502161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2497 sessionId: src_id|e3565ef8-2da813f0-8f0ae8f3-7a28363b_0 is DEAD
2025-09-30T14:57:15.502288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3565ef8-2da813f0-8f0ae8f3-7a28363b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:15.502298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3565ef8-2da813f0-8f0ae8f3-7a28363b_0] Write session will restart in 0.008768s
2025-09-30T14:57:15.502323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3565ef8-2da813f0-8f0ae8f3-7a28363b_0] Write session: Do CDS request
2025-09-30T14:57:15.502343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3565ef8-2da813f0-8f0ae8f3-7a28363b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:15.511293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:15.512828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3565ef8-2da813f0-8f0ae8f3-7a28363b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:15.512931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:15.512957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2498
2025-09-30T14:57:15.513283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:15.513300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2498 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:15.513351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2498 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:15.513356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2498 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:15.513360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:15.513508Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:15.513518Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:15.513530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:15.513790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2498 sessionId:  describe result for acl check
2025-09-30T14:57:15.513836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:15.513838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:15.513840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:15.513847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896457018832754:10844] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:15.514419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896457018832754:10844] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:15.513590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:15.513639Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896456929041843:11421]
2025-09-30T14:57:15.514231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:15.515411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:15.515461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:15.515820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:15.515879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:15.515880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:15.515881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:15.515882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:15.515885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:15.515886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:15.515887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:15.515888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:15.515889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:15.515890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:15.515891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.515892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.515893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.515894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:15.515895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:15.515901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:15.515909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:15.515913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:15.515917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:15.515920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:15.515924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:15.515927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:15.515931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:15.515934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:15.515938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:15.515941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.515944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.515947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.515950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:15.515954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:15.515960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:15.515967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:15.515972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:15.515977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:15.515981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:15.515989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:15.515993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:15.515999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:15.516003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:15.516008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:15.516012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:15.516017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:15.516021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:15.516026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:15.516029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:15.516034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:15.516038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:15.516043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:15.516046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:15.516051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:15.516056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.516061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.516065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.516071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.516076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.516081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.516085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:15.516090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:15.516094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:15.516098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:15.516140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:15.516467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896457018832754:10844] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:15.521388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896457018832754:10844] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:15.521404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896457018832754:10844] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:15.521406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896457018832754:10844] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:15.521414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2498 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:15.521743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:15.522636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:15.522654Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:15.522657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:15.522662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:15.522669Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2497 [2:7555896456929041843:11421]
2025-09-30T14:57:15.522694Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:15.522717Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:15.522725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:15.522729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:15.522731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:15.522747Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:15.522753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:15.522765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:15.522829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.522837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.522840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.522844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:15.522848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:15.522915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:15.522926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.522940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.522953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.522972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:15.522995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896457018832793:10844], now have 1 active actors on pipe
2025-09-30T14:57:15.523004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896457018832704:2454], now have 1 active actors on pipe
2025-09-30T14:57:15.523010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896456929041838:11421]
2025-09-30T14:57:15.523018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896456929041838:11421]
2025-09-30T14:57:15.523020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896456929041838:11421]
2025-09-30T14:57:15.523032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:15.523047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:15.523050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:15.523051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:15.523053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:15.523067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:15.523071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:15.523059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2497
2025-09-30T14:57:15.523071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2497
2025-09-30T14:57:15.523106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896456929041838:11421]
2025-09-30T14:57:15.523124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:15.523148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:15.523337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:15.523348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:15.523377Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7782e0a-14f281e0-376cf841-ef2fcff3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:15.523384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:15.523389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:15.523391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:15.523400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:15.523413Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:15.523429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:15.523621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:15.523633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:15.523654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:15.523779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2498 partition: 0 MaxSeqNo: 42 sessionId: src_id|e7782e0a-14f281e0-376cf841-ef2fcff3_0
2025-09-30T14:57:15.524197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3565ef8-2da813f0-8f0ae8f3-7a28363b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e7782e0a-14f281e0-376cf841-ef2fcff3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:15.527330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7782e0a-14f281e0-376cf841-ef2fcff3_0] Write session: try to update token
2025-09-30T14:57:15.527348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7782e0a-14f281e0-376cf841-ef2fcff3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:15.541145Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:15.541163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:15.541169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:15.541171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:15.541180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896456929041838:11421]
2025-09-30T14:57:15.541184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896456929041838:11421]
2025-09-30T14:57:15.541192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896456929041838:11421]
2025-09-30T14:57:15.541236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:15.541248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.541250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:15.541250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:15.541257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:15.541281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:15.541401Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:15.549064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2498 sessionId: src_id|e7782e0a-14f281e0-376cf841-ef2fcff3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:15.551916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:15.602100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896457018832800:10294]
2025-09-30T14:57:15.602622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2497, pipe: [1:7555896457018832800:10294]
2025-09-30T14:57:15.663630Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:15.664696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:15.664706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:15.664747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896457018832800:10294], now have 1 active actors on pipe
2025-09-30T14:57:15.664914Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:15.665396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:15.665477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2498 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e7782e0a-14f281e0-376cf841-ef2fcff3_0
2025-09-30T14:57:15.665788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7782e0a-14f281e0-376cf841-ef2fcff3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:15.665798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7782e0a-14f281e0-376cf841-ef2fcff3_0] Write session will restart in 0.008631s
2025-09-30T14:57:15.665821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7782e0a-14f281e0-376cf841-ef2fcff3_0] Write session: Do CDS request
2025-09-30T14:57:15.665829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7782e0a-14f281e0-376cf841-ef2fcff3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:15.665648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2498 sessionId: src_id|e7782e0a-14f281e0-376cf841-ef2fcff3_0 is DEAD
2025-09-30T14:57:15.665787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896457018832800:10294]
2025-09-30T14:57:15.665802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:15.675780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7782e0a-14f281e0-376cf841-ef2fcff3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:15.675884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:15.675900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2499
2025-09-30T14:57:15.676027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2499 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:15.676068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2499 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:15.676077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2499 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:15.676081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:15.676453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2499 sessionId:  describe result for acl check
2025-09-30T14:57:15.676486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:15.676488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:15.676490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:15.676495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896457018832853:10855] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:15.676997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896457018832853:10855] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:15.678376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896457018832853:10855] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:15.679349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:15.681285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:15.681502Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:15.681524Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:15.681535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:15.681591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:15.681637Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896456929041969:11431]
2025-09-30T14:57:15.681713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896457018832853:10855] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:15.681731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896457018832853:10855] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:15.681734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896457018832853:10855] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:15.681742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2499 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:15.682342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:15.682717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:15.682776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:15.683124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:15.683200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:15.683207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:15.683208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:15.683210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:15.683212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:15.683213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:15.683216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:15.683217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:15.683219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:15.683220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:15.683221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.683222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.683223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.683224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:15.683225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:15.683230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:15.683240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:15.683262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:15.683266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:15.683269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:15.683273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:15.683277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:15.683281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:15.683285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:15.683290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:15.683294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.683298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.683302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.683306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:15.683310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:15.683317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:15.683326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:15.683332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:15.683337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:15.683343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:15.683349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:15.683353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:15.683360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:15.683365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:15.683371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:15.683374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:15.683380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:15.683388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:15.683392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:15.683399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:15.683404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:15.683407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:15.683420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:15.683425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:15.683430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:15.683439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.683445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.683449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.683453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.683457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.683462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.683470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:15.683474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:15.683478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:15.683483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:15.683522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:15.689474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:15.690528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:15.690546Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:15.690549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:15.690553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:15.690561Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2498 [2:7555896456929041969:11431]
2025-09-30T14:57:15.690579Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:15.690595Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:15.690598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:15.690601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:15.690604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:15.690619Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:15.690625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:15.690632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:15.690689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.690697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.690699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.690703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:15.690705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:15.690773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:15.690780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.690794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.690811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.690829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:15.690852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896457018832815:2454], now have 1 active actors on pipe
2025-09-30T14:57:15.690860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896457018832908:10855], now have 1 active actors on pipe
2025-09-30T14:57:15.690866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896456929041964:11431]
2025-09-30T14:57:15.690868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896456929041964:11431]
2025-09-30T14:57:15.690870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896456929041964:11431]
2025-09-30T14:57:15.690882Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:15.690901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:15.690901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:15.690905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:15.690907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:15.690920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:15.690924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:15.690959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896456929041964:11431]
2025-09-30T14:57:15.690970Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:15.690944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2498
2025-09-30T14:57:15.690979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:15.690963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2498
2025-09-30T14:57:15.691128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:15.691138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:15.691162Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8947eb9a-7e1e4adb-a2f97f6-a1d64d03_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:15.691170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:15.691173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:15.691175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:15.691185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:15.691198Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:15.691215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:15.691386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:15.691399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:15.691413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:15.691525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2499 partition: 0 MaxSeqNo: 42 sessionId: src_id|8947eb9a-7e1e4adb-a2f97f6-a1d64d03_0
2025-09-30T14:57:15.691875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7782e0a-14f281e0-376cf841-ef2fcff3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8947eb9a-7e1e4adb-a2f97f6-a1d64d03_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:15.695494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8947eb9a-7e1e4adb-a2f97f6-a1d64d03_0] Write session: try to update token
2025-09-30T14:57:15.695523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8947eb9a-7e1e4adb-a2f97f6-a1d64d03_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:15.711759Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:15.711779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:15.711789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896456929041964:11431]
2025-09-30T14:57:15.711831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:15.711836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:15.712015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:15.712065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2499 sessionId: src_id|8947eb9a-7e1e4adb-a2f97f6-a1d64d03_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:15.712163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:15.712309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:15.712455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:15.712677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:15.712728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:15.714873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:15.715091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:15.715110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:15.715149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:15.715232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:15.725247Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:15.725266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:15.725269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:15.725271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:15.725281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896456929041964:11431]
2025-09-30T14:57:15.725286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896456929041964:11431]
2025-09-30T14:57:15.725290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896456929041964:11431]
2025-09-30T14:57:15.725332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:15.725334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:15.725340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:15.725341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.725344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:15.725344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:15.725470Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:15.766032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896457018832922:10294]
2025-09-30T14:57:15.766490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2498, pipe: [1:7555896457018832922:10294]
2025-09-30T14:57:15.838169Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:15.847015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:15.847047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:15.847234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:15.847324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:15.847399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:15.847476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:15.848024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:15.848040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:15.848117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:15.848189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:15.848258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:15.848328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:15.848435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:15.848443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:15.848510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:15.848574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:15.848644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:15.848714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:15.848759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:15.848766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:15.848837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:15.848908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:15.848968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:15.849041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:15.849193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:15.849197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:15.849271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:15.849331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:15.849389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:15.849452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:15.849492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:15.849495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:15.849562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:15.849631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:15.849691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:15.849759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:15.849802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:15.849805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:15.849875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:15.849957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:15.850026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:15.850095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:15.850133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:15.850137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:15.850206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:15.850272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:15.850337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:15.850402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:15.850461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:15.850464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:15.850534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:15.850603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:15.850664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:15.850720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:15.850767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:15.850770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:15.850842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:15.850903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:15.850959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:15.851014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:15.851062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:15.851066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:15.851136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896457018832922:10294], now have 1 active actors on pipe
2025-09-30T14:57:15.851941Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:15.851431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:15.851487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896457018832922:10294]
2025-09-30T14:57:15.851510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:15.851514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:15.851542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2499 reason: error at write: Disconnected sessionId: src_id|8947eb9a-7e1e4adb-a2f97f6-a1d64d03_0
2025-09-30T14:57:15.852183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2499 sessionId: src_id|8947eb9a-7e1e4adb-a2f97f6-a1d64d03_0 is DEAD
2025-09-30T14:57:15.855488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8947eb9a-7e1e4adb-a2f97f6-a1d64d03_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:15.855500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8947eb9a-7e1e4adb-a2f97f6-a1d64d03_0] Write session will restart in 0.006140s
2025-09-30T14:57:15.855525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8947eb9a-7e1e4adb-a2f97f6-a1d64d03_0] Write session: Do CDS request
2025-09-30T14:57:15.855530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8947eb9a-7e1e4adb-a2f97f6-a1d64d03_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:15.862782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8947eb9a-7e1e4adb-a2f97f6-a1d64d03_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:15.862843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:15.862862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2500
2025-09-30T14:57:15.863034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2500 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:15.863072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2500 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:15.863078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2500 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:15.863082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:15.863582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2500 sessionId:  describe result for acl check
2025-09-30T14:57:15.863618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:15.863620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:15.863623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:15.863629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896457018832933:10860] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:15.864168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896457018832933:10860] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:15.868891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896457018832933:10860] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:15.876022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896457018832933:10860] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:15.876036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896457018832933:10860] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:15.876040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896457018832933:10860] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:15.876048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2500 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:15.878820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:15.881249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:15.881462Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:15.881472Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:15.881483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:15.881533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:15.881734Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896456929042059:11438]
2025-09-30T14:57:15.882430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:15.883047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:15.883119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:15.883939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:15.884015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:15.884017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:15.884018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:15.884020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:15.884021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:15.884023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:15.884024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:15.884027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:15.884028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:15.884030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:15.884031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.884032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.884034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.884035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:15.884036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:15.884042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:15.884053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:15.884058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:15.884063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:15.884067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:15.884072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:15.884076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:15.884080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:15.884085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:15.884090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:15.884106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.884111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.884115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.884120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:15.884124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:15.884134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:15.884144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:15.884150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:15.884157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:15.884162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:15.884169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:15.884174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:15.884180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:15.884186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:15.884194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:15.884198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:15.884206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:15.884210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:15.884213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:15.884217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:15.884221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:15.884226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:15.884232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:15.884236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:15.884242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:15.884247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.884254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.884258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.884264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.884269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.884275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.884279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:15.884285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:15.884291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:15.884308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:15.884356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:15.891656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:15.892669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:15.892688Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:15.892691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:15.892695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:15.892705Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2499 [2:7555896456929042059:11438]
2025-09-30T14:57:15.892721Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:15.892739Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:15.892742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:15.892745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:15.892748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:15.892763Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:15.892770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:15.892777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:15.892837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.892847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.892849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.892852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:15.892855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:15.892923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:15.892933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.892945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:15.892956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:15.892975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:15.892997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896456929042054:11438]
2025-09-30T14:57:15.893002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896456929042054:11438]
2025-09-30T14:57:15.893004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896456929042054:11438]
2025-09-30T14:57:15.893023Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:15.893043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:15.893062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:15.893071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:15.893105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896456929042054:11438]
2025-09-30T14:57:15.893111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:15.893123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:15.893126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:15.893132Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:15.893142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896457018833001:10860], now have 1 active actors on pipe
2025-09-30T14:57:15.893185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:15.893378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896457018832925:2454], now have 1 active actors on pipe
2025-09-30T14:57:15.893496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2499
2025-09-30T14:57:15.893501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2499
2025-09-30T14:57:15.893684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:15.893696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:15.893725Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3594c12-32e9b67f-b2508a54-b6c72ecc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:15.893742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:15.893756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:15.893759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:15.893770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:15.893782Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:15.893804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:15.894123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:15.894135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:15.894150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:15.894291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2500 partition: 0 MaxSeqNo: 42 sessionId: src_id|c3594c12-32e9b67f-b2508a54-b6c72ecc_0
2025-09-30T14:57:15.896730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8947eb9a-7e1e4adb-a2f97f6-a1d64d03_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c3594c12-32e9b67f-b2508a54-b6c72ecc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:15.899488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3594c12-32e9b67f-b2508a54-b6c72ecc_0] Write session: try to update token
2025-09-30T14:57:15.899508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3594c12-32e9b67f-b2508a54-b6c72ecc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:15.926972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2500 sessionId: src_id|c3594c12-32e9b67f-b2508a54-b6c72ecc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:15.929870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:15.930712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:15.930742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:15.930761Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:15.930764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:15.930766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:15.930768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:15.930776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896456929042054:11438]
2025-09-30T14:57:15.930781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896456929042054:11438]
2025-09-30T14:57:15.930784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896456929042054:11438]
2025-09-30T14:57:15.930839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:15.930846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:15.930849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:15.930981Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:15.935353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:15.935375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:15.935379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:15.951400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896457018833022:10294]
2025-09-30T14:57:15.955584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2499, pipe: [1:7555896457018833022:10294]
2025-09-30T14:57:16.063179Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:16.063528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:16.063620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896457018833022:10294], now have 1 active actors on pipe
2025-09-30T14:57:16.064639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:16.064745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:16.064754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:16.064831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2500 reason: error at write: Disconnected sessionId: src_id|c3594c12-32e9b67f-b2508a54-b6c72ecc_0
2025-09-30T14:57:16.064972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2500 sessionId: src_id|c3594c12-32e9b67f-b2508a54-b6c72ecc_0 is DEAD
2025-09-30T14:57:16.065026Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:16.065074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896457018833022:10294]
2025-09-30T14:57:16.066529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3594c12-32e9b67f-b2508a54-b6c72ecc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:16.066541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3594c12-32e9b67f-b2508a54-b6c72ecc_0] Write session will restart in 0.007117s
2025-09-30T14:57:16.066565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3594c12-32e9b67f-b2508a54-b6c72ecc_0] Write session: Do CDS request
2025-09-30T14:57:16.066580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3594c12-32e9b67f-b2508a54-b6c72ecc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:16.074864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3594c12-32e9b67f-b2508a54-b6c72ecc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:16.074962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:16.074981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2501
2025-09-30T14:57:16.075129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2501 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:16.075173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2501 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:16.075184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2501 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:16.075189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:16.075802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2501 sessionId:  describe result for acl check
2025-09-30T14:57:16.075848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:16.075856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:16.075858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:16.075864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896461313800370:10864] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:16.076412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896461313800370:10864] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:16.077934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:16.080083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:16.080293Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:16.080304Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:16.080316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:16.080370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:16.080414Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896461224009457:11442]
2025-09-30T14:57:16.081005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896461313800370:10864] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:16.081106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:16.081426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:16.081471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:16.081812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:16.081873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:16.081880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:16.081881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:16.081882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:16.081884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:16.081885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:16.081886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:16.081888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:16.081890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:16.081891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:16.081892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.081894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:16.081897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:16.081898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:16.081900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:16.081906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:16.081917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:16.081922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:16.081926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:16.081931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:16.081936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:16.081940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:16.081945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:16.081949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:16.081954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:16.081958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.081962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:16.081967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:16.081972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:16.081977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:16.081989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:16.081999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:16.082010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:16.082016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:16.082027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:16.082033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:16.082042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:16.082048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:16.082058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:16.082064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:16.082073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:16.082079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:16.082089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:16.082096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:16.082105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:16.082111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:16.082125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:16.082135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:16.082140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:16.082149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:16.082154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.082164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.082168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:16.082178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:16.082183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:16.082191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:16.082195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:16.082200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:16.082210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:16.082216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:16.082267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:16.087567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896461313800370:10864] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:16.087586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896461313800370:10864] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:16.087591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896461313800370:10864] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:16.087601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2501 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:16.090599Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2500
2025-09-30T14:57:16.090650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2500
2025-09-30T14:57:16.089125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:16.090219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:16.090226Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:16.090228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:16.090233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:16.090239Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2500 [2:7555896461224009457:11442]
2025-09-30T14:57:16.090256Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:16.090274Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:16.090277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:16.090281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:16.090283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:16.090300Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:16.090307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:16.090314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:16.090375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.090377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:16.090379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:16.090383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:16.090387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:16.090452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:16.090455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.090468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:16.090480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:16.090496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:16.090514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896461313800410:10864], now have 1 active actors on pipe
2025-09-30T14:57:16.090518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896461313800321:2454], now have 1 active actors on pipe
2025-09-30T14:57:16.090524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896461224009452:11442]
2025-09-30T14:57:16.090526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896461224009452:11442]
2025-09-30T14:57:16.090527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896461224009452:11442]
2025-09-30T14:57:16.090541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:16.090554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:16.090567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:16.090568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:16.090570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:16.090571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:16.090574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:16.090606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896461224009452:11442]
2025-09-30T14:57:16.090613Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:16.090649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:16.090844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:16.090855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:16.090881Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|982ed3c5-85d80136-fb91cf7b-ddef80d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:16.090888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:16.090894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:16.090897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:16.090907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:16.090915Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:16.090929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:16.091156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:16.091164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:16.091180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:16.091365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2501 partition: 0 MaxSeqNo: 42 sessionId: src_id|982ed3c5-85d80136-fb91cf7b-ddef80d1_0
2025-09-30T14:57:16.093168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3594c12-32e9b67f-b2508a54-b6c72ecc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|982ed3c5-85d80136-fb91cf7b-ddef80d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:16.095963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|982ed3c5-85d80136-fb91cf7b-ddef80d1_0] Write session: try to update token
2025-09-30T14:57:16.095982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|982ed3c5-85d80136-fb91cf7b-ddef80d1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:16.118042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2501 sessionId: src_id|982ed3c5-85d80136-fb91cf7b-ddef80d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:16.121040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:16.121745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:16.121768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:16.122959Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:16.122963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:16.122972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896461224009452:11442]
2025-09-30T14:57:16.123009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:16.123031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:16.123217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:16.124208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:16.123391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:16.123552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:16.123704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:16.123916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:16.123949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:16.124090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:16.143924Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:16.143946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:16.143949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:16.143955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:16.143965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896461224009452:11442]
2025-09-30T14:57:16.143969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896461224009452:11442]
2025-09-30T14:57:16.143973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896461224009452:11442]
2025-09-30T14:57:16.144014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:16.144021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.144023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:16.144065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:16.144081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:16.144088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:16.144155Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:16.165298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896461313800419:10294]
2025-09-30T14:57:16.166120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2500, pipe: [1:7555896461313800419:10294]
2025-09-30T14:57:16.270204Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:16.281651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:16.281976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:16.282184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:16.282251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:16.282319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:16.282385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:16.282737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:16.282743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:16.282817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:16.282877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:16.282939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:16.283010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:16.283050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:16.283053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:16.283125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:16.283186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:16.283277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:16.283357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:16.283404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:16.283407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:16.283483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:16.283554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:16.283622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:16.283694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:16.283742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:16.283744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:16.283813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:16.286850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|982ed3c5-85d80136-fb91cf7b-ddef80d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:16.286865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|982ed3c5-85d80136-fb91cf7b-ddef80d1_0] Write session will restart in 0.008580s
2025-09-30T14:57:16.286900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|982ed3c5-85d80136-fb91cf7b-ddef80d1_0] Write session: Do CDS request
2025-09-30T14:57:16.286910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|982ed3c5-85d80136-fb91cf7b-ddef80d1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:16.286384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:16.283874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:16.283954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:16.284016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:16.284059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:16.284063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:16.284134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:16.284201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:16.284266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:16.284329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:16.284372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:16.284374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:16.284445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:16.284555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:16.284625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:16.284690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:16.284733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:16.284736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:16.284808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:16.284870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:16.284936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:16.285003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:16.285047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:16.285050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:16.285142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:16.285228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:16.285299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:16.285364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:16.285413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:16.285416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:16.285534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:16.285595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:16.285657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:16.285728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:16.285769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:16.285772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:16.285861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896461313800419:10294], now have 1 active actors on pipe
2025-09-30T14:57:16.286439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896461313800419:10294]
2025-09-30T14:57:16.286462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:16.286465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:16.286504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2501 reason: error at write: Disconnected sessionId: src_id|982ed3c5-85d80136-fb91cf7b-ddef80d1_0
2025-09-30T14:57:16.286690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2501 sessionId: src_id|982ed3c5-85d80136-fb91cf7b-ddef80d1_0 is DEAD
2025-09-30T14:57:16.286696Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:57:16.286838Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 25 consumer shared/user session shared/user_1_25_8737291799463228422_v1 is DEAD
2025-09-30T14:57:16.287588Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:57:16.287796Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:57:16.287807Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:57:16.287818Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.006237s
2025-09-30T14:57:16.287391Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:16.288073Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896384004358795:10290] disconnected; active server actors: 1
2025-09-30T14:57:16.288085Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896384004358795:10290] client user disconnected session shared/user_1_25_8737291799463228422_v1
2025-09-30T14:57:16.295566Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:57:16.295917Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:57:16.295931Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 26
2025-09-30T14:57:16.296102Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 26 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:57:16.296157Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:57:16.296244Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 auth for : user
2025-09-30T14:57:16.296479Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 Handle describe topics response
2025-09-30T14:57:16.296512Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 auth is DEAD
2025-09-30T14:57:16.296533Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:57:16.296844Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:57:16.297028Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_26_18204771942114758210_v1
2025-09-30T14:57:16.297257Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896461313800452:10870] connected; active server actors: 1
2025-09-30T14:57:16.297339Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555896461313800452:10870] session shared/user_1_26_18204771942114758210_v1
2025-09-30T14:57:16.297352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:57:16.297363Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:57:16.297370Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_26_18204771942114758210_v1" (Sender=[1:7555896461313800446:10870], Pipe=[1:7555896461313800452:10870], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:57:16.297374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:57:16.297385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:57:16.297394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_26_18204771942114758210_v1" (Sender=[1:7555896461313800446:10870], Pipe=[1:7555896461313800452:10870], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:57:16.297406Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_26_18204771942114758210_v1" sender [1:7555896461313800446:10870] lock partition 0 for ReadingSession "shared/user_1_26_18204771942114758210_v1" (Sender=[1:7555896461313800446:10870], Pipe=[1:7555896461313800452:10870], Partitions=[], ActiveFamilyCount=1) generation 1 step 26
2025-09-30T14:57:16.297420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:57:16.297424Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000036s
2025-09-30T14:57:16.297684Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 26 Session: "shared/user_1_26_18204771942114758210_v1" ClientId: "user" PipeClient { RawX1: 7555896461313800452 RawX2: 4503603922348662 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:57:16.297719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:57:16.298992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|982ed3c5-85d80136-fb91cf7b-ddef80d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:16.299395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:16.299406Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2502
2025-09-30T14:57:16.299542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2502 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:16.299570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2502 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:16.299574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2502 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:16.299579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:16.299967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2502 sessionId:  describe result for acl check
2025-09-30T14:57:16.299992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:16.299994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:16.299996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:16.300002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896461313800462:10874] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:16.300538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896461313800462:10874] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:16.304397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896461313800462:10874] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:16.309243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896461313800462:10874] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:16.309265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896461313800462:10874] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:16.309269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896461313800462:10874] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:16.309278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2502 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:16.315145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:16.316693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:16.316885Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:16.316889Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:16.316899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:16.316959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:16.316998Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896461224009549:11444]
2025-09-30T14:57:16.317707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:16.318051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:16.318113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:16.318472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:16.318532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:16.318538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:16.318539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:16.318541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:16.318542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:16.318544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:16.318545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:16.318546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:16.318548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:16.318549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:16.318550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.318551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:16.318552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:16.318553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:16.318554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:16.318561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:16.318572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:16.318577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:16.318581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:16.318586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:16.318591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:16.318595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:16.318600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:16.318604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:16.318609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:16.318614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.318618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:16.318623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:16.318629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:16.318633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:16.318643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:16.318650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:16.318657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:16.318663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:16.318672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:16.318678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:16.318684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:16.318690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:16.318702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:16.318708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:16.318712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:16.318717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:16.318723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:16.318729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:16.318734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:16.318740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:16.318744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:16.318750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:16.318755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:16.318760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:16.318765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.318771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.318775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:16.318781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:16.318786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:16.318792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:16.318796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:16.318801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:16.318806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:16.318811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:16.318856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:16.324852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:16.325915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:16.325931Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:16.325933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:16.325940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:16.325947Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2501 [2:7555896461224009549:11444]
2025-09-30T14:57:16.325967Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:16.325983Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:16.325985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:16.325989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:16.325991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:16.326466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2501
2025-09-30T14:57:16.326517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2501
2025-09-30T14:57:16.326555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2501, pipe: [1:7555896461313800455:10873]
2025-09-30T14:57:16.326008Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:16.326023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:16.326030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:16.326094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.326096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:16.326098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:16.326102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:16.326104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:16.326184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:16.326187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.326199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:16.326209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:16.326225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:16.326243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896461224009544:11444]
2025-09-30T14:57:16.326245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896461224009544:11444]
2025-09-30T14:57:16.326249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896461224009544:11444]
2025-09-30T14:57:16.326257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:16.326270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:16.326271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:16.326276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:16.326278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:16.326283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:16.326286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:16.326301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896461313800439:2454], now have 1 active actors on pipe
2025-09-30T14:57:16.326304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896461313800516:10874], now have 1 active actors on pipe
2025-09-30T14:57:16.326307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896461313800455:10873], now have 1 active actors on pipe
2025-09-30T14:57:16.326337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896461224009544:11444]
2025-09-30T14:57:16.326344Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:16.326485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:16.326968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:16.326978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:16.326995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:16.326997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:16.327004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_26_18204771942114758210_v1 on pipe: [1:7555896461313800455:10873]
2025-09-30T14:57:16.327047Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be372e6b-fd2156a0-8566b655-1265fd84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:16.327049Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_26_18204771942114758210_v1:1 with generation 2501
2025-09-30T14:57:16.327055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:16.327058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:16.327060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:16.327069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:16.327080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:16.327092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:16.327096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:16.327097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:16.327115Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_26_18204771942114758210_v1
2025-09-30T14:57:16.327116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:16.327144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:16.327161Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:57:16.327911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:16.327921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:16.327945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:16.328108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2502 partition: 0 MaxSeqNo: 42 sessionId: src_id|be372e6b-fd2156a0-8566b655-1265fd84_0
2025-09-30T14:57:16.328541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|982ed3c5-85d80136-fb91cf7b-ddef80d1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|be372e6b-fd2156a0-8566b655-1265fd84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:16.331457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be372e6b-fd2156a0-8566b655-1265fd84_0] Write session: try to update token
2025-09-30T14:57:16.331484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be372e6b-fd2156a0-8566b655-1265fd84_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:16.335491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:57:16.335535Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:57:16.335545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:16.335547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:16.335550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:16.335560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:57:16.335572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:57:16.339696Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759244236327 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:57:16.339733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:57:16.339775Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 sending to client partition status
2025-09-30T14:57:16.345929Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:16.345947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:16.345950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:16.345952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:16.345965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896461224009544:11444]
2025-09-30T14:57:16.345970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896461224009544:11444]
2025-09-30T14:57:16.345973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896461224009544:11444]
2025-09-30T14:57:16.346012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:16.346017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:16.346019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.346022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:16.346022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:16.346026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:16.346160Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:16.356914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2502 sessionId: src_id|be372e6b-fd2156a0-8566b655-1265fd84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:16.359915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:16.473482Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:16.473861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:16.473883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:16.474351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_26_18204771942114758210_v1
2025-09-30T14:57:16.474379Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:16.474422Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_26_18204771942114758210_v1
2025-09-30T14:57:16.474528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:16.474585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:16.474591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:16.474651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2502 reason: error at write: Disconnected sessionId: src_id|be372e6b-fd2156a0-8566b655-1265fd84_0
2025-09-30T14:57:16.475168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be372e6b-fd2156a0-8566b655-1265fd84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:16.475180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be372e6b-fd2156a0-8566b655-1265fd84_0] Write session will restart in 0.009606s
2025-09-30T14:57:16.475203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be372e6b-fd2156a0-8566b655-1265fd84_0] Write session: Do CDS request
2025-09-30T14:57:16.475209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be372e6b-fd2156a0-8566b655-1265fd84_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:16.474827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2502 sessionId: src_id|be372e6b-fd2156a0-8566b655-1265fd84_0 is DEAD
2025-09-30T14:57:16.475065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896461313800455:10873]
2025-09-30T14:57:16.485792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be372e6b-fd2156a0-8566b655-1265fd84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:16.485881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:16.485899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2503
2025-09-30T14:57:16.486083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2503 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:16.486118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2503 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:16.486127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2503 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:16.486132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:16.486735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2503 sessionId:  describe result for acl check
2025-09-30T14:57:16.486783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:16.486791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:16.486793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:16.486800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896461313800604:10878] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:16.487425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896461313800604:10878] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:16.488624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:16.490209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896461313800604:10878] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:16.491456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:16.491821Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:16.491829Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:16.491849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:16.491944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:16.492005Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896461224009641:11446]
2025-09-30T14:57:16.492928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:16.493678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896461313800604:10878] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:16.493694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896461313800604:10878] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:16.493697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896461313800604:10878] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:16.493706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2503 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:16.493365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:16.493438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:16.493895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:16.494001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:16.494002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:16.494004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:16.494005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:16.494006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:16.494008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:16.494009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:16.494011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:16.494012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:16.494013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:16.494014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.494015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:16.494017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:16.494018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:16.494019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:16.494026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:16.494042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:16.494047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:16.494051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:16.494054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:16.494059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:16.494062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:16.494067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:16.494070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:16.494074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:16.494077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.494080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:16.494083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:16.494087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:16.494091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:16.494101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:16.494109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:16.494119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:16.494124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:16.494129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:16.494134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:16.494139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:16.494144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:16.494150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:16.494155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:16.494161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:16.494166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:16.494171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:16.494177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:16.494181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:16.494186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:16.494190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:16.494200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:16.494225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:16.494231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:16.494237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.494246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.494251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:16.494256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:16.494262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:16.494268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:16.494272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:16.494276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:16.494278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:16.494282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:16.494312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:16.500816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:16.501945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:16.501962Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:16.501966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:16.501971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:16.501980Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2502 [2:7555896461224009641:11446]
2025-09-30T14:57:16.502005Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:16.502027Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:16.502031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:16.502034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:16.502037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:16.502059Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:16.502068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:16.502076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:16.502159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.502161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:16.502164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:16.502167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:16.502171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:16.502381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:16.502413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.502438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:16.502448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:16.502462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:16.502495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896461313800642:10878], now have 1 active actors on pipe
2025-09-30T14:57:16.502518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896461313800551:2454], now have 1 active actors on pipe
2025-09-30T14:57:16.502532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896461224009635:11446]
2025-09-30T14:57:16.502542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896461224009635:11446]
2025-09-30T14:57:16.502545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896461224009635:11446]
2025-09-30T14:57:16.502562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:16.502525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2502
2025-09-30T14:57:16.502580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:16.502590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:16.502593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:16.502596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:16.502537Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2502
2025-09-30T14:57:16.502608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:16.502612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:16.502665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:16.502678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:16.502695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896461224009635:11446]
2025-09-30T14:57:16.502713Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:16.502726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:16.502758Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e0bd66f-d5228b05-f8a5697b-f7b60d5e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:16.502775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:16.502779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:16.502782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:16.502797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:16.502810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:16.502845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:16.503081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:16.503102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:16.503129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:16.503313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2503 partition: 0 MaxSeqNo: 42 sessionId: src_id|2e0bd66f-d5228b05-f8a5697b-f7b60d5e_0
2025-09-30T14:57:16.504054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be372e6b-fd2156a0-8566b655-1265fd84_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2e0bd66f-d5228b05-f8a5697b-f7b60d5e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:16.506861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e0bd66f-d5228b05-f8a5697b-f7b60d5e_0] Write session: try to update token
2025-09-30T14:57:16.506880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e0bd66f-d5228b05-f8a5697b-f7b60d5e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:16.515398Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:16.515420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:16.515423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:16.515425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:16.515439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896461224009635:11446]
2025-09-30T14:57:16.515448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896461224009635:11446]
2025-09-30T14:57:16.515453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896461224009635:11446]
2025-09-30T14:57:16.515496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:16.515499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:16.515506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.515510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:16.515518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:16.515523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:16.515664Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:16.526202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2503 sessionId: src_id|2e0bd66f-d5228b05-f8a5697b-f7b60d5e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:16.529785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:16.575476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896461313800652:10873]
2025-09-30T14:57:16.576324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2502, pipe: [1:7555896461313800652:10873]
2025-09-30T14:57:16.636729Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:16.637305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:16.637318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:16.637343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896461313800652:10873], now have 1 active actors on pipe
2025-09-30T14:57:16.638012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:16.638093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896461313800652:10873]
2025-09-30T14:57:16.638132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:16.638140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:16.638205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2503 reason: error at write: Disconnected sessionId: src_id|2e0bd66f-d5228b05-f8a5697b-f7b60d5e_0
2025-09-30T14:57:16.638433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2503 sessionId: src_id|2e0bd66f-d5228b05-f8a5697b-f7b60d5e_0 is DEAD
2025-09-30T14:57:16.638576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e0bd66f-d5228b05-f8a5697b-f7b60d5e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:16.638587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e0bd66f-d5228b05-f8a5697b-f7b60d5e_0] Write session will restart in 0.005723s
2025-09-30T14:57:16.638611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e0bd66f-d5228b05-f8a5697b-f7b60d5e_0] Write session: Do CDS request
2025-09-30T14:57:16.638617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e0bd66f-d5228b05-f8a5697b-f7b60d5e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:16.639144Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:16.647784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e0bd66f-d5228b05-f8a5697b-f7b60d5e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:16.649960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:16.651469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:16.651493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2504
2025-09-30T14:57:16.651957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:16.652154Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:16.652159Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:16.652169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:16.652217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:16.652257Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896461224009736:11449]
2025-09-30T14:57:16.652779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:16.653300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:16.653342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:16.653591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:16.653632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:16.653633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:16.653634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:16.653635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:16.653636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:16.653639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:16.653640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:16.653641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:16.653642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:16.653642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:16.653643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.653643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:16.653644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:16.653645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:16.653645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:16.653649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:16.653656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:16.653658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:16.653661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:16.653663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:16.653666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:16.653669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:16.653673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:16.653677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:16.653681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:16.653685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.653689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:16.653693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:16.653697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:16.653701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:16.653709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:16.653716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:16.653720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:16.653723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:16.653726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:16.653729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:16.653734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:16.653737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:16.653740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:16.653743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:16.653746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:16.653752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:16.653757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:16.653762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:16.653768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:16.653773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:16.653778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:16.653784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:16.653789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:16.653792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:16.653795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.653799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.653801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:16.653804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:16.653808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:16.653811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:16.653814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:16.653816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:16.653819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:16.653822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:16.653848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:16.655554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2504 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:16.655633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2504 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:16.655649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2504 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:16.655656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:16.656360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2504 sessionId:  describe result for acl check
2025-09-30T14:57:16.656415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:16.656424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:16.656426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:16.656435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896461313800715:10882] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:16.657265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896461313800715:10882] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:16.662519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:16.663653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:16.663669Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:16.663673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:16.663677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:16.663687Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2503 [2:7555896461224009736:11449]
2025-09-30T14:57:16.663704Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:16.663719Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:16.663722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:16.663726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:16.663728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:16.663745Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:16.663752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:16.663759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:16.663822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.663824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:16.663826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:16.663830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:16.663832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:16.663906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:16.663910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.663923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:16.663934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:16.663949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:16.663966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896461224009731:11449]
2025-09-30T14:57:16.663969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896461224009731:11449]
2025-09-30T14:57:16.663972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896461224009731:11449]
2025-09-30T14:57:16.663989Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:16.664003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:16.664016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:16.664018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:16.664057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896461224009731:11449]
2025-09-30T14:57:16.664060Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:16.664163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:16.664165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:16.664167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:16.664174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:16.664372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896461313800653:2454], now have 1 active actors on pipe
2025-09-30T14:57:16.664445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2503
2025-09-30T14:57:16.666205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896461313800715:10882] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:16.673225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896461313800715:10882] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:16.673257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896461313800715:10882] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:16.673262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896461313800715:10882] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:16.673274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2504 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:16.675477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896461313800752:10882], now have 1 active actors on pipe
2025-09-30T14:57:16.675762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2503
2025-09-30T14:57:16.675985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:16.676002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:16.676032Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ef31783-92a52b66-920e31e7-7d8f20f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:16.676047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:16.676051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:16.676054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:16.676068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:16.676086Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:16.676108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:16.677524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:16.677539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:16.678703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:16.678731Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:16.678734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:16.678742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896461224009731:11449]
2025-09-30T14:57:16.678777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:16.678962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:16.679113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:16.679283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:16.679798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:16.681301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2504 partition: 0 MaxSeqNo: 42 sessionId: src_id|4ef31783-92a52b66-920e31e7-7d8f20f3_0
2025-09-30T14:57:16.683484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e0bd66f-d5228b05-f8a5697b-f7b60d5e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4ef31783-92a52b66-920e31e7-7d8f20f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:16.686264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef31783-92a52b66-920e31e7-7d8f20f3_0] Write session: try to update token
2025-09-30T14:57:16.686281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef31783-92a52b66-920e31e7-7d8f20f3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:16.686297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:16.686542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:16.686593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:16.696508Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:16.696534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:16.696537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:16.696539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:16.696549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896461224009731:11449]
2025-09-30T14:57:16.696555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896461224009731:11449]
2025-09-30T14:57:16.696559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896461224009731:11449]
2025-09-30T14:57:16.696605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:16.696619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.696622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:16.696622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:16.696630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:16.696635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:16.696760Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:16.708626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2504 sessionId: src_id|4ef31783-92a52b66-920e31e7-7d8f20f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:16.711571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:16.737427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896461313800771:10873]
2025-09-30T14:57:16.737671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2503, pipe: [1:7555896461313800771:10873]
2025-09-30T14:57:16.819695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-09-30T14:57:16.819734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 14
2025-09-30T14:57:16.833175Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:16.833853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:16.833871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:16.833893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896461313800771:10873], now have 1 active actors on pipe
2025-09-30T14:57:16.834168Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:16.834169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896461313800771:10873]
2025-09-30T14:57:16.834220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:16.834228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:16.834293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2504 reason: error at write: Disconnected sessionId: src_id|4ef31783-92a52b66-920e31e7-7d8f20f3_0
2025-09-30T14:57:16.834464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:16.834483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 14
2025-09-30T14:57:16.834491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2504 sessionId: src_id|4ef31783-92a52b66-920e31e7-7d8f20f3_0 is DEAD
2025-09-30T14:57:16.834829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef31783-92a52b66-920e31e7-7d8f20f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:16.834838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef31783-92a52b66-920e31e7-7d8f20f3_0] Write session will restart in 0.009784s
2025-09-30T14:57:16.834866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef31783-92a52b66-920e31e7-7d8f20f3_0] Write session: Do CDS request
2025-09-30T14:57:16.834872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef31783-92a52b66-920e31e7-7d8f20f3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:16.843787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:16.845476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:16.845697Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:16.845709Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:16.845719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:16.845767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef31783-92a52b66-920e31e7-7d8f20f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:16.845771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:16.845811Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896461224009866:11464]
2025-09-30T14:57:16.845840Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:16.845857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2505
2025-09-30T14:57:16.846035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2505 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:16.846078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2505 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:16.846088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2505 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:16.846093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:16.846483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:16.846705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:16.846749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:16.847069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:16.847127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:16.847134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:16.847135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:16.847137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:16.847138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:16.847139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:16.847141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:16.847142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:16.847143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:16.847145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:16.847146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.847147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:16.847149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:16.847150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:16.847151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:16.847156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:16.847166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:16.847171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:16.847175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:16.847180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:16.847184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:16.847188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:16.847193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:16.847197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:16.847202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:16.847207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.847212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:16.847216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:16.847220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:16.847224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:16.847230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:16.847239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:16.847261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:16.847267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:16.847272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:16.847278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:16.847282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:16.847288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:16.847301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:16.847306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:16.847311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:16.847317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:16.847321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:16.847327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:16.847331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:16.847337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:16.847342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:16.847348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:16.847353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:16.847359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:16.847368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.847373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.847382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:16.847388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:16.846558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2505 sessionId:  describe result for acl check
2025-09-30T14:57:16.846611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:16.846613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:16.846616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:16.846621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896461313800842:10894] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:16.847184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896461313800842:10894] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:16.847394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:16.847401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:16.847405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:16.847412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:16.847417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:16.847423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:16.847472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:16.849710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896461313800842:10894] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:16.852574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896461313800842:10894] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:16.852587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896461313800842:10894] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:16.852590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896461313800842:10894] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:16.852597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2505 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:16.852905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:16.853937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:16.853952Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:16.853955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:16.853959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:16.853966Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2504 [2:7555896461224009866:11464]
2025-09-30T14:57:16.853981Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:16.853995Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:16.853998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:16.854001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:16.854003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:16.854018Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:16.854026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:16.854037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:16.854104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.854111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:16.854113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:16.854117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:16.854119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:16.854183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:16.854190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.854201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:16.854216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:16.854238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:16.854260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896461313800785:2454], now have 1 active actors on pipe
2025-09-30T14:57:16.854268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896461313800880:10894], now have 1 active actors on pipe
2025-09-30T14:57:16.854274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896461224009861:11464]
2025-09-30T14:57:16.854278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896461224009861:11464]
2025-09-30T14:57:16.854280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896461224009861:11464]
2025-09-30T14:57:16.854294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:16.854311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:16.854332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:16.854336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:16.854343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:16.854337Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2504
2025-09-30T14:57:16.854382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2504
2025-09-30T14:57:16.854347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:16.854350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:16.854367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896461224009861:11464]
2025-09-30T14:57:16.854370Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:16.854393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:16.854438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:16.854448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:16.854506Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 85826639 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:57:16.854538Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4bc73a4-710057f8-2fe96450-f2078029_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:16.854551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:16.854555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:16.854557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:16.854566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:16.854577Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:16.854589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:16.854777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 17 DataSize: 85826639 UsedReserveSize: 0
2025-09-30T14:57:16.854810Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:57:16.854959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:16.854974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:16.854995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:16.855095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2505 partition: 0 MaxSeqNo: 42 sessionId: src_id|4bc73a4-710057f8-2fe96450-f2078029_0
2025-09-30T14:57:16.855442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef31783-92a52b66-920e31e7-7d8f20f3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4bc73a4-710057f8-2fe96450-f2078029_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:16.858302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bc73a4-710057f8-2fe96450-f2078029_0] Write session: try to update token
2025-09-30T14:57:16.858322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bc73a4-710057f8-2fe96450-f2078029_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:16.866612Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:16.866631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:16.866638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896461224009861:11464]
2025-09-30T14:57:16.866680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:16.866832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:16.866834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:16.867023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:16.867194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:16.867417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:16.867598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:16.867634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:16.877760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2505 sessionId: src_id|4bc73a4-710057f8-2fe96450-f2078029_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:16.879313Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:16.879333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:16.879336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:16.879342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:16.879352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896461224009861:11464]
2025-09-30T14:57:16.879356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896461224009861:11464]
2025-09-30T14:57:16.879360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896461224009861:11464]
2025-09-30T14:57:16.879404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:16.879411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:16.879414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:16.879417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:16.879424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:16.879428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:16.879556Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:16.880408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:16.934353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896461313800890:10873]
2025-09-30T14:57:16.934640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2504, pipe: [1:7555896461313800890:10873]
2025-09-30T14:57:16.992724Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:16.993282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:16.993297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:16.993316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896461313800890:10873], now have 1 active actors on pipe
2025-09-30T14:57:16.993564Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:16.994081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bc73a4-710057f8-2fe96450-f2078029_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:16.994092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bc73a4-710057f8-2fe96450-f2078029_0] Write session will restart in 0.005788s
2025-09-30T14:57:16.994116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bc73a4-710057f8-2fe96450-f2078029_0] Write session: Do CDS request
2025-09-30T14:57:16.994121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bc73a4-710057f8-2fe96450-f2078029_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:16.993634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896461313800890:10873]
2025-09-30T14:57:16.993670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:16.993673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:16.993753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2505 reason: error at write: Disconnected sessionId: src_id|4bc73a4-710057f8-2fe96450-f2078029_0
2025-09-30T14:57:16.993925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2505 sessionId: src_id|4bc73a4-710057f8-2fe96450-f2078029_0 is DEAD
2025-09-30T14:57:16.994030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:16.994045Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 0
2025-09-30T14:57:17.000740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bc73a4-710057f8-2fe96450-f2078029_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:17.000847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:17.000865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2506
2025-09-30T14:57:17.001418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2506 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:17.001452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2506 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:17.001457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2506 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:17.001461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:17.001859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2506 sessionId:  describe result for acl check
2025-09-30T14:57:17.001887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:17.001889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:17.001891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:17.001897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896461313800910:10898] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:17.002436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896461313800910:10898] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:17.005082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896461313800910:10898] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:17.009755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:17.011416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:17.011619Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:17.011629Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:17.011641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:17.011689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:17.011731Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896465518977275:11468]
2025-09-30T14:57:17.012426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:17.012738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:17.012781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:17.013180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:17.013242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:17.013253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:17.013255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:17.013256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:17.013258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:17.013259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:17.013260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:17.013262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:17.013263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:17.013264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:17.013265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.013267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.013268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.013269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:17.013270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:17.013276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:17.013287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:17.013292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:17.013296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:17.013303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:17.013307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:17.013312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:17.013316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:17.013320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:17.013325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:17.013330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.013334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.013338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.013342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:17.013346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:17.013355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:17.013363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:17.013374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:17.013380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:17.013385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:17.013394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:17.013400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:17.013406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:17.013415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:17.013421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:17.013426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:17.013436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:17.013441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:17.013451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:17.013457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:17.013467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:17.013472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:17.013480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:17.013484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:17.013495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:17.013500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.013510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.013515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.013525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.013530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.013535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.013544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:17.013550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:17.013555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:17.013565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:17.013614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:17.008474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896461313800910:10898] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:17.008489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896461313800910:10898] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:17.008493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896461313800910:10898] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:17.008502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2506 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:17.019214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:17.020219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:17.020237Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:17.020239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:17.020244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:17.020251Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2505 [2:7555896465518977275:11468]
2025-09-30T14:57:17.020268Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:17.020284Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:17.020288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:17.020291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:17.020293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:17.020310Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:17.020317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:17.020323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:17.020383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.020393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.020396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.020399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:17.020402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:17.020472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:17.020480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.020494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.020513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.020536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:17.020559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896461313800895:2454], now have 1 active actors on pipe
2025-09-30T14:57:17.020567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896465608768279:10898], now have 1 active actors on pipe
2025-09-30T14:57:17.020574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896465518977269:11468]
2025-09-30T14:57:17.020576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896465518977269:11468]
2025-09-30T14:57:17.020580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896465518977269:11468]
2025-09-30T14:57:17.020592Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:17.020606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:17.020608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:17.020616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:17.020619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:17.020624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:17.020627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:17.020657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896465518977269:11468]
2025-09-30T14:57:17.020667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:17.020651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2505
2025-09-30T14:57:17.020704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:17.020652Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2505
2025-09-30T14:57:17.020869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:17.020884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:17.020941Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 85826639 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:57:17.020981Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d0f342a-5055c409-2e803769-308ee725_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:17.020989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:17.020993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:17.020995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:17.021005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:17.021018Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:17.021031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:17.021179Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 18 DataSize: 85826639 UsedReserveSize: 0
2025-09-30T14:57:17.021231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:17.021244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:17.021265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:17.021221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:57:17.021404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2506 partition: 0 MaxSeqNo: 42 sessionId: src_id|9d0f342a-5055c409-2e803769-308ee725_0
2025-09-30T14:57:17.021801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bc73a4-710057f8-2fe96450-f2078029_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9d0f342a-5055c409-2e803769-308ee725_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:17.024849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d0f342a-5055c409-2e803769-308ee725_0] Write session: try to update token
2025-09-30T14:57:17.024870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d0f342a-5055c409-2e803769-308ee725_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:17.033454Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:17.033475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:17.033484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896465518977269:11468]
2025-09-30T14:57:17.033533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:17.033700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:17.033847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:17.033995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:17.034129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:17.034313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:17.034348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:17.034446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:17.048390Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:17.048412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:17.048415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:17.048418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:17.048428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896465518977269:11468]
2025-09-30T14:57:17.048433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896465518977269:11468]
2025-09-30T14:57:17.048437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896465518977269:11468]
2025-09-30T14:57:17.048482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:17.048485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:17.048489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.048492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:17.048493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:17.048496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:17.048627Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:17.052555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2506 sessionId: src_id|9d0f342a-5055c409-2e803769-308ee725_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:17.055136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:17.093562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896465608768295:10873]
2025-09-30T14:57:17.093895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2505, pipe: [1:7555896465608768295:10873]
2025-09-30T14:57:17.164163Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:17.164664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:17.164680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:17.164702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896465608768295:10873], now have 1 active actors on pipe
2025-09-30T14:57:17.164926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:17.164929Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:17.165428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d0f342a-5055c409-2e803769-308ee725_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:17.165437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d0f342a-5055c409-2e803769-308ee725_0] Write session will restart in 0.006621s
2025-09-30T14:57:17.165461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d0f342a-5055c409-2e803769-308ee725_0] Write session: Do CDS request
2025-09-30T14:57:17.164989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:17.165466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d0f342a-5055c409-2e803769-308ee725_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:17.165080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2506 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9d0f342a-5055c409-2e803769-308ee725_0
2025-09-30T14:57:17.165274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2506 sessionId: src_id|9d0f342a-5055c409-2e803769-308ee725_0 is DEAD
2025-09-30T14:57:17.165276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896465608768295:10873]
2025-09-30T14:57:17.174419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d0f342a-5055c409-2e803769-308ee725_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:17.174494Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:17.174511Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2507
2025-09-30T14:57:17.174689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2507 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:17.174746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2507 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:17.174757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2507 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:17.174761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:17.175365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2507 sessionId:  describe result for acl check
2025-09-30T14:57:17.175401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:17.175408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:17.175410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:17.175416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896465608768356:10902] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:17.175951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896465608768356:10902] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:17.177703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:17.179869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:17.180098Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:17.180112Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:17.180125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:17.180187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:17.180229Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896465518977371:11472]
2025-09-30T14:57:17.180881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:17.181158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896465608768356:10902] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:17.181295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:17.181353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:17.181708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:17.181793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:17.181801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:17.181802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:17.181804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:17.181805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:17.181806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:17.181808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:17.181809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:17.181811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:17.181812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:17.181813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.181815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.181816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.181817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:17.181818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:17.181825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:17.181835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:17.181839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:17.181844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:17.181849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:17.181854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:17.181858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:17.181863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:17.181867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:17.181873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:17.181877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.181881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.181885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.181889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:17.181893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:17.181904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:17.181913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:17.181919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:17.181926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:17.181931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:17.181936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:17.181948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:17.181953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:17.181964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:17.181970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:17.181980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:17.181985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:17.181991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:17.182002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:17.182007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:17.182017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:17.182023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:17.182035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:17.182044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:17.182050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:17.182060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.182081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.182091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.182097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.182107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.182113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.182122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:17.182128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:17.182138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:17.182144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:17.182196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:17.185184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896465608768356:10902] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:17.185201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896465608768356:10902] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:17.185205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896465608768356:10902] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:17.185213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2507 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:17.188338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:17.189316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:17.189333Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:17.189337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:17.189341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:17.189348Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2506 [2:7555896465518977371:11472]
2025-09-30T14:57:17.189368Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:17.189384Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:17.189394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:17.189397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:17.189400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:17.189418Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:17.189424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:17.189441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:17.189503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.189511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.189514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.189518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:17.189521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:17.189590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:17.189598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.189613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.189632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.189657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:17.189682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896465608768409:10902], now have 1 active actors on pipe
2025-09-30T14:57:17.189693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896465608768300:2454], now have 1 active actors on pipe
2025-09-30T14:57:17.189700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896465518977366:11472]
2025-09-30T14:57:17.189707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896465518977366:11472]
2025-09-30T14:57:17.189710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896465518977366:11472]
2025-09-30T14:57:17.189723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:17.189737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:17.189742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:17.189748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:17.189750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:17.189760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:17.189764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:17.189734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2506
2025-09-30T14:57:17.189735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2506
2025-09-30T14:57:17.189801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896465518977366:11472]
2025-09-30T14:57:17.189815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:17.189820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:17.189833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:17.189840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:17.189893Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9db68649-d755ce8a-8b0d05c3-b7be259b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:17.189906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:17.189910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:17.189912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:17.189923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:17.189933Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:17.189954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:17.190203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:17.190218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:17.190242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:17.190344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2507 partition: 0 MaxSeqNo: 42 sessionId: src_id|9db68649-d755ce8a-8b0d05c3-b7be259b_0
2025-09-30T14:57:17.190757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d0f342a-5055c409-2e803769-308ee725_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9db68649-d755ce8a-8b0d05c3-b7be259b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:17.193639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9db68649-d755ce8a-8b0d05c3-b7be259b_0] Write session: try to update token
2025-09-30T14:57:17.193659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9db68649-d755ce8a-8b0d05c3-b7be259b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:17.202439Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:17.202461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:17.202464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:17.202469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:17.202478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896465518977366:11472]
2025-09-30T14:57:17.202483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896465518977366:11472]
2025-09-30T14:57:17.202488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896465518977366:11472]
2025-09-30T14:57:17.202530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:17.202541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.202543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:17.202542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:17.202550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:17.202554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:17.202692Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:17.211950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2507 sessionId: src_id|9db68649-d755ce8a-8b0d05c3-b7be259b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:17.214894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:17.265617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896465608768422:10873]
2025-09-30T14:57:17.265899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2506, pipe: [1:7555896465608768422:10873]
2025-09-30T14:57:17.323353Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:17.323699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:17.323716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:17.323737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896465608768422:10873], now have 1 active actors on pipe
2025-09-30T14:57:17.323969Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:17.324764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9db68649-d755ce8a-8b0d05c3-b7be259b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:17.324777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9db68649-d755ce8a-8b0d05c3-b7be259b_0] Write session will restart in 0.008583s
2025-09-30T14:57:17.324800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9db68649-d755ce8a-8b0d05c3-b7be259b_0] Write session: Do CDS request
2025-09-30T14:57:17.324806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9db68649-d755ce8a-8b0d05c3-b7be259b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:17.324330Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:17.324384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:17.324458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2507 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9db68649-d755ce8a-8b0d05c3-b7be259b_0
2025-09-30T14:57:17.324636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2507 sessionId: src_id|9db68649-d755ce8a-8b0d05c3-b7be259b_0 is DEAD
2025-09-30T14:57:17.324813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896465608768422:10873]
2025-09-30T14:57:17.335191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:17.337258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:17.337464Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:17.337469Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:17.337480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:17.337535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:17.337582Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896465518977468:11474]
2025-09-30T14:57:17.338264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:17.338556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:17.338605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:17.338948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:17.339016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:17.339022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:17.339023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:17.339025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:17.339027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:17.339028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:17.339029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:17.339031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:17.339032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:17.339033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:17.339035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.339036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.339037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.339038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:17.339039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:17.339045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:17.339056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:17.339060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:17.339065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:17.339069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:17.339074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:17.339078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:17.339083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:17.339087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:17.339092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:17.339097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.339102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.339106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.339110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:17.339114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:17.339125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:17.339134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:17.339140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:17.339146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:17.339151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:17.339161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:17.339166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:17.339172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:17.339178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:17.339189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:17.339194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:17.339206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:17.339211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:17.339221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:17.339225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:17.339231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:17.339240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:17.339263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9db68649-d755ce8a-8b0d05c3-b7be259b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:17.339262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:17.339272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:17.339276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:17.339281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.339285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.339293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.339298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.339302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.339308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.339317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:17.339323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:17.339328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:17.339339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:17.339389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:17.339389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:17.339405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2508
2025-09-30T14:57:17.343511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2508 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:17.343574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2508 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:17.343579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2508 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:17.343594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:17.344191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2508 sessionId:  describe result for acl check
2025-09-30T14:57:17.344229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:17.344231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:17.344233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:17.344241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896465608768491:10908] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:17.344813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896465608768491:10908] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:17.346116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:17.347167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:17.347187Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:17.347190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:17.347194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:17.347201Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2507 [2:7555896465518977468:11474]
2025-09-30T14:57:17.347221Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:17.347238Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:17.347241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:17.347580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:17.347582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:17.347600Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:17.347607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:17.347613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:17.347684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.347698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.347700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.347704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:17.347706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:17.347767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:17.347775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.347791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.347809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.347833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:17.347855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896465608768427:2454], now have 1 active actors on pipe
2025-09-30T14:57:17.347862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896465518977463:11474]
2025-09-30T14:57:17.347869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896465518977463:11474]
2025-09-30T14:57:17.347871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896465518977463:11474]
2025-09-30T14:57:17.347887Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:17.347901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:17.347922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:17.347927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:17.347964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896465518977463:11474]
2025-09-30T14:57:17.347967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:17.348037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:17.348046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:17.348049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:17.348054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:17.348200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2507
2025-09-30T14:57:17.350028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896465608768491:10908] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:17.355723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896465608768491:10908] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:17.355742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896465608768491:10908] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:17.355746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896465608768491:10908] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:17.355756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2508 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:17.356097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2507
2025-09-30T14:57:17.356109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896465608768530:10908], now have 1 active actors on pipe
2025-09-30T14:57:17.356161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:17.356169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:17.356199Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d44855c3-1438acf9-8579af94-befe5bf7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:17.356217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:17.356223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:17.356226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:17.356239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:17.356260Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:17.356280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:17.356461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:17.356471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:17.356489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:17.356569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2508 partition: 0 MaxSeqNo: 42 sessionId: src_id|d44855c3-1438acf9-8579af94-befe5bf7_0
2025-09-30T14:57:17.356954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9db68649-d755ce8a-8b0d05c3-b7be259b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d44855c3-1438acf9-8579af94-befe5bf7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:17.359700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d44855c3-1438acf9-8579af94-befe5bf7_0] Write session: try to update token
2025-09-30T14:57:17.359719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d44855c3-1438acf9-8579af94-befe5bf7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:17.363046Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:17.363068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:17.363070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:17.363072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:17.363082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896465518977463:11474]
2025-09-30T14:57:17.363087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896465518977463:11474]
2025-09-30T14:57:17.363091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896465518977463:11474]
2025-09-30T14:57:17.363116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:17.363122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:17.363124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:17.363126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:17.363131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.363134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:17.363308Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:17.379136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2508 sessionId: src_id|d44855c3-1438acf9-8579af94-befe5bf7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:17.381924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:17.424854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896465608768533:10873]
2025-09-30T14:57:17.425195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2507, pipe: [1:7555896465608768533:10873]
2025-09-30T14:57:17.479757Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:17.480116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:17.480134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:17.480155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896465608768533:10873], now have 1 active actors on pipe
2025-09-30T14:57:17.480418Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:17.480432Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:17.480470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896465608768533:10873]
2025-09-30T14:57:17.480485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:17.480488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:17.480548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2508 reason: error at write: Disconnected sessionId: src_id|d44855c3-1438acf9-8579af94-befe5bf7_0
2025-09-30T14:57:17.480744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2508 sessionId: src_id|d44855c3-1438acf9-8579af94-befe5bf7_0 is DEAD
2025-09-30T14:57:17.480913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d44855c3-1438acf9-8579af94-befe5bf7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:17.480920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d44855c3-1438acf9-8579af94-befe5bf7_0] Write session will restart in 0.006881s
2025-09-30T14:57:17.480944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d44855c3-1438acf9-8579af94-befe5bf7_0] Write session: Do CDS request
2025-09-30T14:57:17.480954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d44855c3-1438acf9-8579af94-befe5bf7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:17.488795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d44855c3-1438acf9-8579af94-befe5bf7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:17.488888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:17.488906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2509
2025-09-30T14:57:17.489023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2509 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:17.489070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2509 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:17.489080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2509 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:17.489085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:17.489566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2509 sessionId:  describe result for acl check
2025-09-30T14:57:17.489610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:17.489612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:17.489614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:17.489619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896465608768592:10912] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:17.490151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896465608768592:10912] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:17.490847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:17.492566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896465608768592:10912] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:17.493132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:17.493351Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:17.493370Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:17.493380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:17.493439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:17.493477Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896465518977566:11476]
2025-09-30T14:57:17.494128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:17.494477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:17.494552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:17.494898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:17.494972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:17.494979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:17.494980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:17.494981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:17.494983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:17.494984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:17.494986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:17.494987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:17.494988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:17.494989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:17.494991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.494992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.494993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.494994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:17.494995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:17.495001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:17.495012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:17.495016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:17.495021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:17.495025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:17.495030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:17.495035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:17.495039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:17.495043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:17.495048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:17.495052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.495056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.495061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.495065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:17.495069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:17.495077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:17.495085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:17.495097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:17.495103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:17.495113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:17.495119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:17.495123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:17.495129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:17.495134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:17.495144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:17.495149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:17.495159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:17.495164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:17.495170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:17.495174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:17.495180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:17.495190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:17.495196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:17.495205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:17.495210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:17.495220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.495226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.495235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.495258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.495266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.495271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.495280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:17.495285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:17.495296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:17.495301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:17.495354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:17.495377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896465608768592:10912] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:17.495392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896465608768592:10912] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:17.495396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896465608768592:10912] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:17.495404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2509 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:17.500715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:17.501850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:17.501871Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:17.501876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:17.501881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:17.501888Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2508 [2:7555896465518977566:11476]
2025-09-30T14:57:17.501903Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:17.501922Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:17.501931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:17.501935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:17.501938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:17.501956Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:17.501964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:17.501970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:17.502032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.502040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.502043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.502047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:17.502049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:17.502118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:17.502126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.502142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.502162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.502187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:17.502210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896465608768632:10912], now have 1 active actors on pipe
2025-09-30T14:57:17.502220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896465608768534:2454], now have 1 active actors on pipe
2025-09-30T14:57:17.502226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896465518977560:11476]
2025-09-30T14:57:17.502232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896465518977560:11476]
2025-09-30T14:57:17.502241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896465518977560:11476]
2025-09-30T14:57:17.502258Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:17.502268Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2508
2025-09-30T14:57:17.502277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2508
2025-09-30T14:57:17.502271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:17.502278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:17.502279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:17.502282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:17.502295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:17.502298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:17.502330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896465518977560:11476]
2025-09-30T14:57:17.502333Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:17.502336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:17.502353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:17.502363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:17.502412Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3b86969-3cfd08b3-6e301b20-1a92c66a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:17.502424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:17.502427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:17.502429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:17.502437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:17.502446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:17.502466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:17.502642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:17.502650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:17.502665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:17.502745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2509 partition: 0 MaxSeqNo: 42 sessionId: src_id|e3b86969-3cfd08b3-6e301b20-1a92c66a_0
2025-09-30T14:57:17.503123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d44855c3-1438acf9-8579af94-befe5bf7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e3b86969-3cfd08b3-6e301b20-1a92c66a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:17.505993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3b86969-3cfd08b3-6e301b20-1a92c66a_0] Write session: try to update token
2025-09-30T14:57:17.506013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3b86969-3cfd08b3-6e301b20-1a92c66a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:17.514309Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:17.514332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:17.514335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:17.514338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:17.514348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896465518977560:11476]
2025-09-30T14:57:17.514355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896465518977560:11476]
2025-09-30T14:57:17.514360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896465518977560:11476]
2025-09-30T14:57:17.514399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:17.514408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.514407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:17.514411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:17.514414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:17.514418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:17.514548Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:17.520843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2509 sessionId: src_id|e3b86969-3cfd08b3-6e301b20-1a92c66a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:17.523628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:17.580509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896465608768641:10873]
2025-09-30T14:57:17.581167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2508, pipe: [1:7555896465608768641:10873]
2025-09-30T14:57:17.634397Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:17.634770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:17.634786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:17.634807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896465608768641:10873], now have 1 active actors on pipe
2025-09-30T14:57:17.635057Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:17.635152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896465608768641:10873]
2025-09-30T14:57:17.635309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:17.635342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:17.635345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:17.635407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2509 reason: error at write: Disconnected sessionId: src_id|e3b86969-3cfd08b3-6e301b20-1a92c66a_0
2025-09-30T14:57:17.635590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2509 sessionId: src_id|e3b86969-3cfd08b3-6e301b20-1a92c66a_0 is DEAD
2025-09-30T14:57:17.635983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3b86969-3cfd08b3-6e301b20-1a92c66a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:17.635991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3b86969-3cfd08b3-6e301b20-1a92c66a_0] Write session will restart in 0.006935s
2025-09-30T14:57:17.636015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3b86969-3cfd08b3-6e301b20-1a92c66a_0] Write session: Do CDS request
2025-09-30T14:57:17.636022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3b86969-3cfd08b3-6e301b20-1a92c66a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:17.647743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3b86969-3cfd08b3-6e301b20-1a92c66a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:17.651449Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:17.651468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2510
2025-09-30T14:57:17.652358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:17.655397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2510 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:17.655461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2510 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:17.655468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2510 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:17.655481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:17.656015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2510 sessionId:  describe result for acl check
2025-09-30T14:57:17.656052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:17.656058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:17.656060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:17.656066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896465608768705:10916] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:17.656694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896465608768705:10916] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:17.659562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896465608768705:10916] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:17.661919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:17.662150Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:17.662161Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:17.662173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:17.662245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:17.662287Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896465518977667:11479]
2025-09-30T14:57:17.662968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:17.663326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:17.663377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:17.663683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:17.663771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:17.663779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:17.663780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:17.663781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:17.663782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:17.663783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:17.663785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:17.663786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:17.663787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:17.663788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:17.663789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.663790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.663791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.663792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:17.663793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:17.663798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:17.663807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:17.663811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:17.663815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:17.663818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:17.663822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:17.663825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:17.663829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:17.663832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:17.663837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:17.663841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.663844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.663850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.663853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:17.663856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:17.663863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:17.663871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:17.663876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:17.663881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:17.663886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:17.663891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:17.663895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:17.663900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:17.663904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:17.663909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:17.663913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:17.663918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:17.663923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:17.663928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:17.663932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:17.663937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:17.663942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:17.663948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:17.663952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:17.663957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:17.663962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.663967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.663971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.663976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.663980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.663984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.663990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:17.663994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:17.663999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:17.664003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:17.664048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:17.667099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896465608768705:10916] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:17.667116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896465608768705:10916] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:17.667119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896465608768705:10916] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:17.667128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2510 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:17.669760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:17.670650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:17.670665Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:17.670668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:17.670672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:17.670678Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2509 [2:7555896465518977667:11479]
2025-09-30T14:57:17.670694Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:17.670709Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:17.670717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:17.670720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:17.670722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:17.670738Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:17.670750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:17.670757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:17.670820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.670828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.670830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.670834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:17.670837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:17.670902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:17.670909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.670921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.670938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.670959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:17.670979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896465608768642:2454], now have 1 active actors on pipe
2025-09-30T14:57:17.670992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896465608768742:10916], now have 1 active actors on pipe
2025-09-30T14:57:17.670998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896465518977662:11479]
2025-09-30T14:57:17.671000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896465518977662:11479]
2025-09-30T14:57:17.671002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896465518977662:11479]
2025-09-30T14:57:17.671014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:17.671028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:17.671041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:17.671044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:17.671057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:17.671071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:17.671073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:17.671077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896465518977662:11479]
2025-09-30T14:57:17.671080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:17.671083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:17.671114Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2509
2025-09-30T14:57:17.671150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2509
2025-09-30T14:57:17.671272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:17.671283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:17.671308Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20abc55e-20a3798c-1d907bad-b0d32b8a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:17.671319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:17.671323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:17.671326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:17.671339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:17.671353Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:17.671373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:17.671519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:17.671529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:17.671544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:17.671648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2510 partition: 0 MaxSeqNo: 42 sessionId: src_id|20abc55e-20a3798c-1d907bad-b0d32b8a_0
2025-09-30T14:57:17.672052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3b86969-3cfd08b3-6e301b20-1a92c66a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|20abc55e-20a3798c-1d907bad-b0d32b8a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:17.674799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20abc55e-20a3798c-1d907bad-b0d32b8a_0] Write session: try to update token
2025-09-30T14:57:17.674819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20abc55e-20a3798c-1d907bad-b0d32b8a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:17.684429Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:17.684456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:17.684467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896465518977662:11479]
2025-09-30T14:57:17.684509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:17.684519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:17.684691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:17.684844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:17.685011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:17.685177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:17.685386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:17.685430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:17.690638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2510 sessionId: src_id|20abc55e-20a3798c-1d907bad-b0d32b8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:17.693464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:17.693724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:17.693752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:17.693789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:17.693869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:17.695356Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:17.695371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:17.695374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:17.695376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:17.695385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896465518977662:11479]
2025-09-30T14:57:17.695389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896465518977662:11479]
2025-09-30T14:57:17.695394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896465518977662:11479]
2025-09-30T14:57:17.695434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:17.695440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:17.695445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.695446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:17.695448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:17.695451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:17.695587Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:17.737065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896465608768752:10873]
2025-09-30T14:57:17.737470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2509, pipe: [1:7555896465608768752:10873]
2025-09-30T14:57:17.810708Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:17.819283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:17.819310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:17.819483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:17.819554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:17.819626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:17.819685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:17.820106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:17.820112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:17.820185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:17.820245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:17.820310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:17.820378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:17.820422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:17.820425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:17.820494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:17.820555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:17.820617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:17.820681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:17.820726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:17.820729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:17.820798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:17.820859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:17.820924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:17.820987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:17.821031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:17.821034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:17.821123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:17.821182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:17.821246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:17.821312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:17.821358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:17.821361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:17.821431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:17.821495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:17.821559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:17.821618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:17.821656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:17.821658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:17.821728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:17.821790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:17.821852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:17.821919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:17.821964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:17.821967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:17.822034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:17.822085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:17.822142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:17.822196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:17.822235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:17.822237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:17.822298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:17.822351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:17.822409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:17.822470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:17.822629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:17.822633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:17.822701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:17.822756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:17.822813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:17.822875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:17.822917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:17.822920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:17.822990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896465608768752:10873], now have 1 active actors on pipe
2025-09-30T14:57:17.823594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:17.823609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:17.823638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2510 reason: error at write: Disconnected sessionId: src_id|20abc55e-20a3798c-1d907bad-b0d32b8a_0
2025-09-30T14:57:17.823809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2510 sessionId: src_id|20abc55e-20a3798c-1d907bad-b0d32b8a_0 is DEAD
2025-09-30T14:57:17.823828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:17.823868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896465608768752:10873]
2025-09-30T14:57:17.824051Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:17.824219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20abc55e-20a3798c-1d907bad-b0d32b8a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:17.824229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20abc55e-20a3798c-1d907bad-b0d32b8a_0] Write session will restart in 0.008459s
2025-09-30T14:57:17.824252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20abc55e-20a3798c-1d907bad-b0d32b8a_0] Write session: Do CDS request
2025-09-30T14:57:17.824258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20abc55e-20a3798c-1d907bad-b0d32b8a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:17.833806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20abc55e-20a3798c-1d907bad-b0d32b8a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:17.835620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:17.838162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:17.838384Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:17.838394Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:17.838405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:17.838460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:17.838511Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896465518977803:11493]
2025-09-30T14:57:17.839161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:17.839538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:17.839579Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:17.839606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:17.839594Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2511
2025-09-30T14:57:17.839734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2511 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:17.839772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2511 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:17.839784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2511 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:17.839788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:17.839949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:17.840031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:17.840038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:17.840039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:17.840040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:17.840041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:17.840042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:17.840044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:17.840045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:17.840046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:17.840048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:17.840049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.840050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.840052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.840053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:17.840054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:17.840060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:17.840070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:17.840075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:17.840079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:17.840083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:17.840087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:17.840092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:17.840096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:17.840100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:17.840104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:17.840109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.840113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.840117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.840121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:17.840125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:17.840132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:17.840140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:17.840145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:17.840150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:17.840155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:17.840162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:17.840166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:17.840172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:17.840177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:17.840182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:17.840187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:17.840192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:17.840197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:17.840202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:17.840206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:17.840212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:17.840217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:17.840222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:17.840226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:17.840231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:17.840236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.840241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.840245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.840256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.840244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2511 sessionId:  describe result for acl check
2025-09-30T14:57:17.840261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.840266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.840270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:17.840275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:17.840279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:17.840284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:17.840278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:17.840284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:17.840286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:17.840292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896465608768844:10928] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:17.840329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:17.840836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896465608768844:10928] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:17.843371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896465608768844:10928] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:17.845801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:17.846684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:17.846701Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:17.846704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:17.846709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:17.846716Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2510 [2:7555896465518977803:11493]
2025-09-30T14:57:17.846734Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:17.846754Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:17.846757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:17.846760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:17.846762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:17.846780Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:17.846787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:17.846793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:17.846850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.846857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.846859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.846862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:17.846865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:17.846935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:17.846944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.846957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:17.846974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:17.846984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:17.846997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896465608768779:2454], now have 1 active actors on pipe
2025-09-30T14:57:17.847008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896465518977797:11493]
2025-09-30T14:57:17.847010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896465518977797:11493]
2025-09-30T14:57:17.847012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896465518977797:11493]
2025-09-30T14:57:17.847023Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:17.847037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:17.847041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:17.847048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:17.847050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:17.847056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:17.847059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:17.847049Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2510
2025-09-30T14:57:17.847095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896465518977797:11493]
2025-09-30T14:57:17.847103Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:17.847105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:17.847984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896465608768844:10928] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:17.847997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896465608768844:10928] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:17.848001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896465608768844:10928] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:17.848009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2511 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:17.848542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896465608768878:10928], now have 1 active actors on pipe
2025-09-30T14:57:17.848623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2510
2025-09-30T14:57:17.848717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:17.848731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:17.848757Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f134607-7b3b44ac-fa07232-56b46b03_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:17.848768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:17.848772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:17.848774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:17.848795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:17.848814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:17.848833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:17.849091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:17.849100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:17.849126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:17.849266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2511 partition: 0 MaxSeqNo: 42 sessionId: src_id|5f134607-7b3b44ac-fa07232-56b46b03_0
2025-09-30T14:57:17.849640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20abc55e-20a3798c-1d907bad-b0d32b8a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5f134607-7b3b44ac-fa07232-56b46b03_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:17.852575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f134607-7b3b44ac-fa07232-56b46b03_0] Write session: try to update token
2025-09-30T14:57:17.852594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f134607-7b3b44ac-fa07232-56b46b03_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:17.866334Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:17.866357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:17.866368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896465518977797:11493]
2025-09-30T14:57:17.866418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:17.866603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:17.866675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:17.866764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:17.866912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:17.867055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:17.867313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:17.867361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:17.875321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2511 sessionId: src_id|5f134607-7b3b44ac-fa07232-56b46b03_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:17.878251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:17.879933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:17.878538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:17.878562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:17.879756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:17.879778Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:17.879783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:17.879786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:17.879788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:17.879798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896465518977797:11493]
2025-09-30T14:57:17.879805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896465518977797:11493]
2025-09-30T14:57:17.879808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896465518977797:11493]
2025-09-30T14:57:17.879848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:17.879852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:17.879857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:17.879857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:17.879860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:17.879861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:17.879997Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:17.924029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896465608768884:10873]
2025-09-30T14:57:17.924524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2510, pipe: [1:7555896465608768884:10873]
2025-09-30T14:57:17.998620Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:18.008969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:18.008999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:18.009185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:18.009255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:18.009329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:18.009395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:18.009747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:18.009761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:18.009834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:18.009896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:18.009962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:18.010030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:18.010077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:18.010090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:18.010162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:18.010225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:18.010288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:18.010353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:18.010399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:18.010406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:18.010477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:18.010541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:18.010610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:18.010683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:18.010726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:18.010728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:18.010801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:18.010862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:18.010927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:18.010995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:18.011039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:18.011042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:18.011115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:18.011177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:18.011740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:18.011831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:18.011887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:18.011906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:18.011982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:18.012087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:18.012160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:18.012225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:18.012271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:18.012278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:18.012348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:18.012415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:18.012483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:18.012551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:18.012596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:18.012604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:18.012674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:18.012738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:18.012807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:18.012872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:18.012914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:18.012917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:18.012989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:18.013049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:18.013127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:18.013189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:18.013229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:18.013232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:18.013304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896465608768884:10873], now have 1 active actors on pipe
2025-09-30T14:57:18.014352Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:18.015845Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:18.015895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896465608768884:10873]
2025-09-30T14:57:18.015916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:18.015954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2511 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5f134607-7b3b44ac-fa07232-56b46b03_0
2025-09-30T14:57:18.016125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2511 sessionId: src_id|5f134607-7b3b44ac-fa07232-56b46b03_0 is DEAD
2025-09-30T14:57:18.019634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f134607-7b3b44ac-fa07232-56b46b03_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:18.019645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f134607-7b3b44ac-fa07232-56b46b03_0] Write session will restart in 0.008656s
2025-09-30T14:57:18.019669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f134607-7b3b44ac-fa07232-56b46b03_0] Write session: Do CDS request
2025-09-30T14:57:18.019675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f134607-7b3b44ac-fa07232-56b46b03_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:18.031707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f134607-7b3b44ac-fa07232-56b46b03_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:18.032041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:18.032060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2512
2025-09-30T14:57:18.032205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2512 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:18.032239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2512 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:18.032247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2512 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:18.032250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:18.032689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2512 sessionId:  describe result for acl check
2025-09-30T14:57:18.032730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:18.032739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:18.032741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:18.032748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896469903736244:10932] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:18.033261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896469903736244:10932] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:18.034671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:18.035152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:18.035356Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:18.035368Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:18.035379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:18.035430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:18.035466Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896469813945215:11497]
2025-09-30T14:57:18.036125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:18.036254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896469903736244:10932] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:18.036789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:18.036848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:18.037243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:18.037313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:18.037320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:18.037321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:18.037322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:18.037323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:18.037324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:18.037326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:18.037327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:18.037328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:18.037329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:18.037330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.037331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.037333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.037334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:18.037335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:18.037341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:18.037351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:18.037355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:18.037359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:18.037363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:18.037367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:18.037372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:18.037376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:18.037381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:18.037385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:18.037390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.037394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.037399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.037403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:18.037407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:18.037414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:18.037422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:18.037429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:18.037436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:18.037441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:18.037446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:18.037459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:18.037464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:18.037469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:18.037475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:18.037485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:18.037491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:18.037497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:18.037506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:18.037511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:18.037517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:18.037528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:18.037533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:18.037538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:18.037549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:18.037559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.037564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.037572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.037578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.037588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.037593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.037602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:18.037607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:18.037617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:18.037622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:18.037676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:18.040900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896469903736244:10932] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:18.040967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896469903736244:10932] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:18.040975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896469903736244:10932] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:18.040984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2512 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:18.045232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:18.046487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:18.046504Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:18.046507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:18.046511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:18.046518Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2511 [2:7555896469813945215:11497]
2025-09-30T14:57:18.046535Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:18.046551Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:18.046554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:18.046557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:18.046559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:18.046577Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:18.046589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:18.046596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:18.046657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.046667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.046669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.046673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:18.046676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:18.046748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:18.046756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.046772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.046790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.046822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:18.046845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896469903736284:10932], now have 1 active actors on pipe
2025-09-30T14:57:18.046854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896469903736185:2454], now have 1 active actors on pipe
2025-09-30T14:57:18.046860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896469813945210:11497]
2025-09-30T14:57:18.046863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896469813945210:11497]
2025-09-30T14:57:18.046865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896469813945210:11497]
2025-09-30T14:57:18.046878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:18.046899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:18.046914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:18.046917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:18.046953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896469813945210:11497]
2025-09-30T14:57:18.046955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:18.047002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:18.047016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:18.047018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:18.046915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2511
2025-09-30T14:57:18.046959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2511
2025-09-30T14:57:18.047027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:18.047231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:18.047241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:18.047286Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91e1f76f-cf61c123-1aeadb7a-8cdc42e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:18.047298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:18.047303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:18.047310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:18.047319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:18.047343Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:18.047364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:18.047579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:18.047587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:18.047600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:18.047745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2512 partition: 0 MaxSeqNo: 42 sessionId: src_id|91e1f76f-cf61c123-1aeadb7a-8cdc42e8_0
2025-09-30T14:57:18.048157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f134607-7b3b44ac-fa07232-56b46b03_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|91e1f76f-cf61c123-1aeadb7a-8cdc42e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:18.051139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91e1f76f-cf61c123-1aeadb7a-8cdc42e8_0] Write session: try to update token
2025-09-30T14:57:18.051160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91e1f76f-cf61c123-1aeadb7a-8cdc42e8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:18.074096Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:18.074117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:18.074119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:18.074121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:18.074135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896469813945210:11497]
2025-09-30T14:57:18.074139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896469813945210:11497]
2025-09-30T14:57:18.074142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896469813945210:11497]
2025-09-30T14:57:18.074183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:18.074191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.074199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:18.074247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:18.074254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:18.074259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:18.074346Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:18.076335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2512 sessionId: src_id|91e1f76f-cf61c123-1aeadb7a-8cdc42e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:18.079575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:18.115509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896469903736303:10873]
2025-09-30T14:57:18.115798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2511, pipe: [1:7555896469903736303:10873]
2025-09-30T14:57:18.193252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896469903736303:10873]
2025-09-30T14:57:18.193294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:18.193297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:18.193354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2512 reason: error at write: Disconnected sessionId: src_id|91e1f76f-cf61c123-1aeadb7a-8cdc42e8_0
2025-09-30T14:57:18.193534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2512 sessionId: src_id|91e1f76f-cf61c123-1aeadb7a-8cdc42e8_0 is DEAD
2025-09-30T14:57:18.193672Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:18.192215Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:18.192534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:18.192543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:18.192583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896469903736303:10873], now have 1 active actors on pipe
2025-09-30T14:57:18.193706Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:18.196908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91e1f76f-cf61c123-1aeadb7a-8cdc42e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:18.196924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91e1f76f-cf61c123-1aeadb7a-8cdc42e8_0] Write session will restart in 0.008291s
2025-09-30T14:57:18.196944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91e1f76f-cf61c123-1aeadb7a-8cdc42e8_0] Write session: Do CDS request
2025-09-30T14:57:18.196952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91e1f76f-cf61c123-1aeadb7a-8cdc42e8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:18.207493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91e1f76f-cf61c123-1aeadb7a-8cdc42e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:18.207588Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:18.207605Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2513
2025-09-30T14:57:18.207827Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2513 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:18.207858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2513 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:18.207864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2513 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:18.207868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:18.208269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2513 sessionId:  describe result for acl check
2025-09-30T14:57:18.208310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:18.208312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:18.208314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:18.208320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896469903736381:10946] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:18.208846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896469903736381:10946] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:18.209994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:18.211207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896469903736381:10946] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:18.214104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896469903736381:10946] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:18.214121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896469903736381:10946] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:18.214125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896469903736381:10946] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:18.214133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2513 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:18.215133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:18.215385Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:18.215397Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:18.215408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:18.215473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:18.215510Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896469813945318:11499]
2025-09-30T14:57:18.216183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:18.216523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:18.216566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:18.216907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:18.216973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:18.216980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:18.216981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:18.216983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:18.216985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:18.216987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:18.216988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:18.216990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:18.216991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:18.216992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:18.216994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.216995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.216996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.216998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:18.217000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:18.217006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:18.217018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:18.217023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:18.217027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:18.217032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:18.217036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:18.217041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:18.217046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:18.217051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:18.217056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:18.217060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.217065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.217069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.217074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:18.217079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:18.217087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:18.217096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:18.217116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:18.217124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:18.217131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:18.217136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:18.217143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:18.217149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:18.217154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:18.217160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:18.217165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:18.217172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:18.217177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:18.217183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:18.217188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:18.217194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:18.217203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:18.217208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:18.217213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:18.217219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:18.217224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.217230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.217235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.217241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.217246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.217251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.217256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:18.217262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:18.217267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:18.217273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:18.217330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:18.222793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:18.223915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:18.223933Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:18.223937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:18.223941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:18.223950Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2512 [2:7555896469813945318:11499]
2025-09-30T14:57:18.223967Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:18.223984Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:18.223989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:18.223992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:18.223994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:18.224011Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:18.224019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:18.224034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:18.224101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.224109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.224112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.224116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:18.224118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:18.224192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:18.224200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.224227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.224247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.224266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:18.224292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896469903736320:2454], now have 1 active actors on pipe
2025-09-30T14:57:18.224300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896469903736418:10946], now have 1 active actors on pipe
2025-09-30T14:57:18.224307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896469813945311:11499]
2025-09-30T14:57:18.224309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896469813945311:11499]
2025-09-30T14:57:18.224312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896469813945311:11499]
2025-09-30T14:57:18.224327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:18.224346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:18.224363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:18.224371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:18.224360Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2512
2025-09-30T14:57:18.224381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2512
2025-09-30T14:57:18.224403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896469813945311:11499]
2025-09-30T14:57:18.224410Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:18.224419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:18.224423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:18.224426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:18.224432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:18.224465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:18.224477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:18.224507Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|46827543-4294f0f8-f8869ccb-bc9cc3e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:18.224518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:18.224522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:18.224524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:18.224534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:18.224543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:18.224562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:18.224789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:18.224803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:18.224826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:18.224970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2513 partition: 0 MaxSeqNo: 42 sessionId: src_id|46827543-4294f0f8-f8869ccb-bc9cc3e6_0
2025-09-30T14:57:18.225411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91e1f76f-cf61c123-1aeadb7a-8cdc42e8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|46827543-4294f0f8-f8869ccb-bc9cc3e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:18.228399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46827543-4294f0f8-f8869ccb-bc9cc3e6_0] Write session: try to update token
2025-09-30T14:57:18.228425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46827543-4294f0f8-f8869ccb-bc9cc3e6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:18.237229Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:18.237253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:18.237263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896469813945311:11499]
2025-09-30T14:57:18.237305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:18.237325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:18.237480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:18.237625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:18.237771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:18.237920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:18.238132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:18.238180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:18.254870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2513 sessionId: src_id|46827543-4294f0f8-f8869ccb-bc9cc3e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:18.257674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:18.257948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:18.257974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:18.258020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:18.258385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:18.276517Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:18.276543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:18.276546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:18.276548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:18.276559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896469813945311:11499]
2025-09-30T14:57:18.276563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896469813945311:11499]
2025-09-30T14:57:18.276568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896469813945311:11499]
2025-09-30T14:57:18.276608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:18.276616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.276619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:18.276767Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:18.278061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:18.278089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:18.278092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:18.295487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896469903736432:10873]
2025-09-30T14:57:18.295978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2512, pipe: [1:7555896469903736432:10873]
2025-09-30T14:57:18.401888Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:18.402404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896469903736432:10873], now have 1 active actors on pipe
2025-09-30T14:57:18.410098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:18.410128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:18.410308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:18.410373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:18.410445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:18.410521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:18.410570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:18.410576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:18.410948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:18.411008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:18.411074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:18.411138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:18.411177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:18.411180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:18.411399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:18.411485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:18.411561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:18.411632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:18.411676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:18.411680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:18.411760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:18.411828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:18.411904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:18.411974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:18.412020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:18.412038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:18.412110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:18.412177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:18.412263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:18.412335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:18.412382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:18.412386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:18.412477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:18.412567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:18.412725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:18.412817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:18.412874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:18.412878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:18.412984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:18.413129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:18.413224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:18.413313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:18.413362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:18.413370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:18.413461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:18.413527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:18.413593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:18.413664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:18.413728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:18.413731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:18.413804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:18.413864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:18.413926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:18.413994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:18.414040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:18.414043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:18.414115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:18.414447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:18.414562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:18.414632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:18.414676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:18.414679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:18.419597Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:18.419742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896469903736432:10873]
2025-09-30T14:57:18.419770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:18.419812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:18.419814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:18.419842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2513 reason: error at write: Disconnected sessionId: src_id|46827543-4294f0f8-f8869ccb-bc9cc3e6_0
2025-09-30T14:57:18.420023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2513 sessionId: src_id|46827543-4294f0f8-f8869ccb-bc9cc3e6_0 is DEAD
2025-09-30T14:57:18.420483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46827543-4294f0f8-f8869ccb-bc9cc3e6_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 195 BytesWritten: 94617674 MessagesWritten: 42 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 13516812 MessagesInflight: 10 }
2025-09-30T14:57:18.420518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46827543-4294f0f8-f8869ccb-bc9cc3e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:18.420523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46827543-4294f0f8-f8869ccb-bc9cc3e6_0] Write session will restart in 0.005002s
2025-09-30T14:57:18.420549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46827543-4294f0f8-f8869ccb-bc9cc3e6_0] Write session: Do CDS request
2025-09-30T14:57:18.420557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46827543-4294f0f8-f8869ccb-bc9cc3e6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:18.426766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46827543-4294f0f8-f8869ccb-bc9cc3e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:18.427216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:18.427233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2514
2025-09-30T14:57:18.427380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2514 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:18.427409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2514 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:18.427415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2514 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:18.427420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:18.428418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2514 sessionId:  describe result for acl check
2025-09-30T14:57:18.428451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:18.428453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:18.428454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:18.428461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896469903736445:10950] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:18.429008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896469903736445:10950] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:18.432183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896469903736445:10950] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:18.435553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896469903736445:10950] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:18.435573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896469903736445:10950] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:18.435576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896469903736445:10950] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:18.435585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2514 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:18.448752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:18.451168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:18.451425Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:18.451438Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:18.451450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:18.451516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:18.451574Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896469813945422:11501]
2025-09-30T14:57:18.452304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:18.452694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:18.452750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:18.453051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:18.453100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:18.453101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:18.453115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:18.453116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:18.453118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:18.453119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:18.453120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:18.453121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:18.453122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:18.453123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:18.453124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.453124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.453125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.453126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:18.453127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:18.453132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:18.453140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:18.453143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:18.453146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:18.453148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:18.453151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:18.453153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:18.453156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:18.453159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:18.453162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:18.453164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.453166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.453169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.453171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:18.453174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:18.453181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:18.453186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:18.453190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:18.453194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:18.453197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:18.453202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:18.453207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:18.453213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:18.453218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:18.453224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:18.453229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:18.453235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:18.453241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:18.453247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:18.453252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:18.453258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:18.453265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:18.453271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:18.453277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:18.453282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:18.453287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.453292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.453297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.453302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.453307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.453313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.453318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:18.453323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:18.453328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:18.453334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:18.453382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:18.461074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:18.461975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:18.461994Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:18.461997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:18.462002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:18.462009Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2513 [2:7555896469813945422:11501]
2025-09-30T14:57:18.462030Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:18.462047Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:18.462051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:18.462055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:18.462058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:18.462076Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:18.462083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:18.462091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:18.462161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.462170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.462172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.462176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:18.462179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:18.462257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:18.462264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.462279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.462290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.462309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:18.462326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896469813945417:11501]
2025-09-30T14:57:18.462330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896469813945417:11501]
2025-09-30T14:57:18.462332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896469813945417:11501]
2025-09-30T14:57:18.462345Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:18.462361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:18.462380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:18.462382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:18.462421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896469813945417:11501]
2025-09-30T14:57:18.462423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:18.462450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:18.462455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:18.462457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:18.462468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:18.462862Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2513
2025-09-30T14:57:18.462873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2513
2025-09-30T14:57:18.463221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896469903736438:2454], now have 1 active actors on pipe
2025-09-30T14:57:18.463234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896469903736482:10950], now have 1 active actors on pipe
2025-09-30T14:57:18.463267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:18.463272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:18.463298Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c1d3899-a8b9f92c-28775857-e5e87454_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:18.463308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:18.463312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:18.463314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:18.463327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:18.463340Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:18.463354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:18.463783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:18.463792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:18.463810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:18.465064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2514 partition: 0 MaxSeqNo: 42 sessionId: src_id|9c1d3899-a8b9f92c-28775857-e5e87454_0
2025-09-30T14:57:18.465449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46827543-4294f0f8-f8869ccb-bc9cc3e6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9c1d3899-a8b9f92c-28775857-e5e87454_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:18.468168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1d3899-a8b9f92c-28775857-e5e87454_0] Write session: try to update token
2025-09-30T14:57:18.468184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1d3899-a8b9f92c-28775857-e5e87454_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:18.479756Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:18.479780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:18.479782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:18.479785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:18.479794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896469813945417:11501]
2025-09-30T14:57:18.479799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896469813945417:11501]
2025-09-30T14:57:18.479803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896469813945417:11501]
2025-09-30T14:57:18.479890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:18.479895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:18.479899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:18.479963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:18.479971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.479974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:18.480115Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:18.485286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2514 sessionId: src_id|9c1d3899-a8b9f92c-28775857-e5e87454_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:18.487916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:18.524522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896469903736550:10873]
2025-09-30T14:57:18.527075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2513, pipe: [1:7555896469903736550:10873]
2025-09-30T14:57:18.597747Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:18.598083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:18.598114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:18.598163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896469903736550:10873], now have 1 active actors on pipe
2025-09-30T14:57:18.598457Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:18.599114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1d3899-a8b9f92c-28775857-e5e87454_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:18.599124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1d3899-a8b9f92c-28775857-e5e87454_0] Write session will restart in 0.006531s
2025-09-30T14:57:18.599148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1d3899-a8b9f92c-28775857-e5e87454_0] Write session: Do CDS request
2025-09-30T14:57:18.599154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1d3899-a8b9f92c-28775857-e5e87454_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:18.598451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896469903736550:10873]
2025-09-30T14:57:18.598484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:18.598525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:18.598528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:18.598600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2514 reason: error at write: Disconnected sessionId: src_id|9c1d3899-a8b9f92c-28775857-e5e87454_0
2025-09-30T14:57:18.598771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2514 sessionId: src_id|9c1d3899-a8b9f92c-28775857-e5e87454_0 is DEAD
2025-09-30T14:57:18.606758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1d3899-a8b9f92c-28775857-e5e87454_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:18.606864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:18.606882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2515
2025-09-30T14:57:18.607002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2515 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:18.607037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2515 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:18.607042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2515 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:18.607046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:18.607759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2515 sessionId:  describe result for acl check
2025-09-30T14:57:18.607796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:18.607803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:18.607807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:18.607815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896469903736576:10954] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:18.608378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896469903736576:10954] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:18.611104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896469903736576:10954] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:18.611332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:18.613343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:18.613562Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:18.613576Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:18.613587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:18.613646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:18.613696Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896469813945527:11504]
2025-09-30T14:57:18.614360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:18.614756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:18.614834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:18.614528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896469903736576:10954] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:18.614548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896469903736576:10954] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:18.614551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896469903736576:10954] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:18.614560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2515 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:18.615217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:18.615297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:18.615304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:18.615305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:18.615307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:18.615308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:18.615310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:18.615311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:18.615312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:18.615314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:18.615315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:18.615317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.615318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.615320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.615321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:18.615322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:18.615329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:18.615341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:18.615346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:18.615351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:18.615355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:18.615360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:18.615365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:18.615370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:18.615374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:18.615379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:18.615384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.615389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.615393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.615398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:18.615402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:18.615411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:18.615420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:18.615431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:18.615442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:18.615448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:18.615459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:18.615464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:18.615475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:18.615481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:18.615493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:18.615498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:18.615509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:18.615514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:18.615525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:18.615530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:18.615541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:18.615546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:18.615556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:18.615562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:18.615572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:18.615577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.615587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.615593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.615599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.615609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.615615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.615625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:18.615631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:18.615640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:18.615645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:18.615691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:18.624233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:18.625306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:18.625325Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:18.625329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:18.625334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:18.625341Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2514 [2:7555896469813945527:11504]
2025-09-30T14:57:18.625360Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:18.625376Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:18.625380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:18.625383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:18.625386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:18.625403Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:18.625419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:18.625426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:18.625491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.625501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.625503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.625506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:18.625509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:18.625584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:18.625592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.625608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.625627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.625646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:18.625668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896469813945522:11504]
2025-09-30T14:57:18.625675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896469813945522:11504]
2025-09-30T14:57:18.625678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896469813945522:11504]
2025-09-30T14:57:18.625688Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:18.625698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:18.625702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:18.625710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:18.625713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:18.625717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:18.625719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:18.625729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896469903736654:10954], now have 1 active actors on pipe
2025-09-30T14:57:18.625733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896469903736552:2454], now have 1 active actors on pipe
2025-09-30T14:57:18.625766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896469813945522:11504]
2025-09-30T14:57:18.625778Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:18.625813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:18.625864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2514
2025-09-30T14:57:18.625897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2514
2025-09-30T14:57:18.626057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:18.626068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:18.626095Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da5bfe1-25a98bca-acd612d3-cd770aae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:18.626102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:18.626106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:18.626109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:18.626118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:18.626127Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:18.626141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:18.626384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:18.626391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:18.626405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:18.626491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2515 partition: 0 MaxSeqNo: 42 sessionId: src_id|da5bfe1-25a98bca-acd612d3-cd770aae_0
2025-09-30T14:57:18.626885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1d3899-a8b9f92c-28775857-e5e87454_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|da5bfe1-25a98bca-acd612d3-cd770aae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:18.629811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da5bfe1-25a98bca-acd612d3-cd770aae_0] Write session: try to update token
2025-09-30T14:57:18.629834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da5bfe1-25a98bca-acd612d3-cd770aae_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:18.645427Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:18.645451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:18.645462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896469813945522:11504]
2025-09-30T14:57:18.645515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:18.645701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:18.645858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:18.646004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:18.646149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:18.646481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:18.646518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:18.647325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:18.649945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2515 sessionId: src_id|da5bfe1-25a98bca-acd612d3-cd770aae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:18.652702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:18.655404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:18.655434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:18.655490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:18.656688Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:18.656705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:18.656708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:18.656710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:18.656719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896469813945522:11504]
2025-09-30T14:57:18.656723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896469813945522:11504]
2025-09-30T14:57:18.656734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896469813945522:11504]
2025-09-30T14:57:18.656768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:18.656772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:18.656777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:18.656778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.656781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:18.656781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:18.656923Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:18.655576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:18.698696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896469903736665:10873]
2025-09-30T14:57:18.698999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2514, pipe: [1:7555896469903736665:10873]
2025-09-30T14:57:18.769826Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:18.778103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:18.778131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:18.778314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:18.778380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:18.778448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:18.778514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:18.778563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:18.778571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:18.778648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:18.778712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:18.778771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:18.779178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:18.779221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:18.779225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:18.779425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:18.779493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:18.779561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:18.779631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:18.779675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:18.779682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:18.779756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:18.779832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:18.779902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:18.779969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:18.780021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:18.780029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:18.780103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:18.780174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:18.780244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:18.780317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:18.780386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:18.780395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:18.780465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:18.780529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:18.780600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:18.780674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:18.780726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:18.780734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:18.780807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:18.780877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:18.780955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:18.781022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:18.781072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:18.781083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:18.781166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:18.781231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:18.781302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:18.781373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:18.781423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:18.781434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:18.781503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:18.781570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:18.781633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:18.781701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:18.781745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:18.781753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:18.781820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:18.781885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:18.781949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:18.782022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:18.782072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:18.782082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:18.782155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896469903736665:10873], now have 1 active actors on pipe
2025-09-30T14:57:18.782440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:18.782443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896469903736665:10873]
2025-09-30T14:57:18.782477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:18.782480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:18.782511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2515 reason: error at write: Disconnected sessionId: src_id|da5bfe1-25a98bca-acd612d3-cd770aae_0
2025-09-30T14:57:18.782708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2515 sessionId: src_id|da5bfe1-25a98bca-acd612d3-cd770aae_0 is DEAD
2025-09-30T14:57:18.782841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da5bfe1-25a98bca-acd612d3-cd770aae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:18.782849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da5bfe1-25a98bca-acd612d3-cd770aae_0] Write session will restart in 0.009188s
2025-09-30T14:57:18.782872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da5bfe1-25a98bca-acd612d3-cd770aae_0] Write session: Do CDS request
2025-09-30T14:57:18.782877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da5bfe1-25a98bca-acd612d3-cd770aae_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:18.782918Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:18.792919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da5bfe1-25a98bca-acd612d3-cd770aae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:18.793011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:18.793029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2516
2025-09-30T14:57:18.793200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2516 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:18.793243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2516 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:18.793249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2516 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:18.793256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:18.793835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2516 sessionId:  describe result for acl check
2025-09-30T14:57:18.793863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:18.793865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:18.793867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:18.793871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896469903736711:10959] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:18.794340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896469903736711:10959] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:18.798863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896469903736711:10959] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:18.799650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:18.801943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:18.802214Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:18.802226Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:18.802239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:18.802319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:18.802371Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896469813945632:11506]
2025-09-30T14:57:18.802396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896469903736711:10959] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:18.802415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896469903736711:10959] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:18.802419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896469903736711:10959] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:18.802439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2516 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:18.803023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:18.803330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:18.803370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:18.803672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:18.803805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:18.803814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:18.803815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:18.803816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:18.803818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:18.803819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:18.803821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:18.803822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:18.803823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:18.803825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:18.803826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.803828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.803830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.803831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:18.803833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:18.803840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:18.803847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:18.803850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:18.803852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:18.803855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:18.803858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:18.803861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:18.803864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:18.803866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:18.803869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:18.803871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.803874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.803876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.803879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:18.803881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:18.803888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:18.803893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:18.803898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:18.803901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:18.803904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:18.803908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:18.803910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:18.803915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:18.803918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:18.803922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:18.803925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:18.803928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:18.803931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:18.803934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:18.803937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:18.803941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:18.803944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:18.803947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:18.803950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:18.803953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:18.803956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.803959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.803962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.803973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.803976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.803979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.803982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:18.803985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:18.803988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:18.803993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:18.804035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:18.810754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:18.811729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:18.811759Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:18.811763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:18.811767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:18.811774Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2515 [2:7555896469813945632:11506]
2025-09-30T14:57:18.811793Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:18.811815Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:18.811818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:18.811821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:18.811824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:18.811841Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:18.811855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:18.811863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:18.811935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.811945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.811947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.811950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:18.811953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:18.812042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:18.812051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.812066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.812083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.812118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:18.812141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896469813945627:11506]
2025-09-30T14:57:18.812148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896469813945627:11506]
2025-09-30T14:57:18.812151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896469813945627:11506]
2025-09-30T14:57:18.812160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:18.812177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:18.812192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:18.812199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:18.812203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:18.812206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:18.812206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:18.812254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896469903736771:10959], now have 1 active actors on pipe
2025-09-30T14:57:18.812263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896469903736669:2454], now have 1 active actors on pipe
2025-09-30T14:57:18.812266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896469813945627:11506]
2025-09-30T14:57:18.812275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:18.812288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:18.812658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:18.812685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:18.812723Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8f00a2d-27c8ef4e-6c8b3e09-593fb4a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:18.812737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:18.812746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:18.812749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:18.812761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:18.812778Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:18.812813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:18.812569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2515
2025-09-30T14:57:18.812609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2515
2025-09-30T14:57:18.813434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:18.813459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:18.813480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:18.816293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da5bfe1-25a98bca-acd612d3-cd770aae_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a8f00a2d-27c8ef4e-6c8b3e09-593fb4a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:18.813570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2516 partition: 0 MaxSeqNo: 42 sessionId: src_id|a8f00a2d-27c8ef4e-6c8b3e09-593fb4a7_0
2025-09-30T14:57:18.819133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8f00a2d-27c8ef4e-6c8b3e09-593fb4a7_0] Write session: try to update token
2025-09-30T14:57:18.819154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8f00a2d-27c8ef4e-6c8b3e09-593fb4a7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:18.837391Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:18.837417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:18.837425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:18.837428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:18.837439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896469813945627:11506]
2025-09-30T14:57:18.837444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896469813945627:11506]
2025-09-30T14:57:18.837449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896469813945627:11506]
2025-09-30T14:57:18.837492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:18.837498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:18.837506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.837508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:18.837509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:18.837513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:18.837714Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:18.841498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2516 sessionId: src_id|a8f00a2d-27c8ef4e-6c8b3e09-593fb4a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:18.844223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:18.882706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896469903736804:10873]
2025-09-30T14:57:18.883105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2515, pipe: [1:7555896469903736804:10873]
2025-09-30T14:57:18.971339Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:18.971723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:18.971738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:18.971780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896469903736804:10873], now have 1 active actors on pipe
2025-09-30T14:57:18.972087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:18.972110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:18.972126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896469903736804:10873]
2025-09-30T14:57:18.972160Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:18.972175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2516 reason: error at write: Disconnected sessionId: src_id|a8f00a2d-27c8ef4e-6c8b3e09-593fb4a7_0
2025-09-30T14:57:18.972178Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:18.972350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2516 sessionId: src_id|a8f00a2d-27c8ef4e-6c8b3e09-593fb4a7_0 is DEAD
2025-09-30T14:57:18.972571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8f00a2d-27c8ef4e-6c8b3e09-593fb4a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:18.972582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8f00a2d-27c8ef4e-6c8b3e09-593fb4a7_0] Write session will restart in 0.008813s
2025-09-30T14:57:18.972621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8f00a2d-27c8ef4e-6c8b3e09-593fb4a7_0] Write session: Do CDS request
2025-09-30T14:57:18.972630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8f00a2d-27c8ef4e-6c8b3e09-593fb4a7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:18.983110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:18.985059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:18.985281Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:18.985292Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:18.985303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:18.985358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:18.985403Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896469813945776:11521]
2025-09-30T14:57:18.985962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:18.986293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:18.986380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:18.986659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8f00a2d-27c8ef4e-6c8b3e09-593fb4a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:18.986738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:18.986793Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:18.986809Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2517
2025-09-30T14:57:18.986819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:18.986826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:18.986827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:18.986828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:18.986829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:18.986830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:18.986831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:18.986833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:18.986834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:18.986836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:18.986837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.986838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.986839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.986840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:18.986841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:18.986847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:18.986857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:18.986862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:18.986867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:18.986871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:18.986875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:18.986880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:18.986884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:18.986888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:18.986893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:18.986897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.986901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.986905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.986909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:18.986913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:18.986923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:18.986931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:18.986941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:18.986947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:18.986956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:18.986938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2517 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:18.986962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:18.986971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:18.986975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2517 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:18.986982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2517 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:18.986977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:18.986986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:18.986982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:18.986992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:18.986997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:18.987007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:18.987013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:18.987022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:18.987027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:18.987037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:18.987042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:18.987051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:18.987056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:18.987065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:18.987070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.987075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:18.987083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.987088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:18.987092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.987101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:18.987106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:18.987111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:18.987120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:18.987127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:18.987176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:18.987463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2517 sessionId:  describe result for acl check
2025-09-30T14:57:18.987498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:18.987505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:18.987507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:18.987513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896469903736882:10970] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:18.988153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896469903736882:10970] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:18.991685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896469903736882:10970] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:18.998589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896469903736882:10970] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:18.998608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896469903736882:10970] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:18.998612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896469903736882:10970] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:18.998621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2517 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:18.999518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:19.000577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:19.000598Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:19.000602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:19.000606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:19.000614Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2516 [2:7555896469813945776:11521]
2025-09-30T14:57:19.000632Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:19.000649Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:19.000652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:19.000656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:19.000658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:19.000675Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:19.000690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:19.000700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:19.000771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.000779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:19.000781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:19.000785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:19.000787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:19.000864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:19.000879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.000895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:19.001036Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2516
2025-09-30T14:57:19.001070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2516
2025-09-30T14:57:19.000915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:19.000945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:19.000965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896469903736809:2454], now have 1 active actors on pipe
2025-09-30T14:57:19.000970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896469903736913:10970], now have 1 active actors on pipe
2025-09-30T14:57:19.000976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896469813945770:11521]
2025-09-30T14:57:19.000979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896469813945770:11521]
2025-09-30T14:57:19.000981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896469813945770:11521]
2025-09-30T14:57:19.000996Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:19.001010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:19.001012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:19.001017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:19.001019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:19.001028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:19.001031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:19.001070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896469813945770:11521]
2025-09-30T14:57:19.001078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:19.001087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:19.001221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:19.001230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:19.001260Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5d8aa0d-9c615ff7-72650ca9-19b0cbe8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:19.001277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:19.001284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:19.001286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:19.001297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:19.001309Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:19.001325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:19.001606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:19.001611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:19.001632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:19.002097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2517 partition: 0 MaxSeqNo: 42 sessionId: src_id|f5d8aa0d-9c615ff7-72650ca9-19b0cbe8_0
2025-09-30T14:57:19.002523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8f00a2d-27c8ef4e-6c8b3e09-593fb4a7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f5d8aa0d-9c615ff7-72650ca9-19b0cbe8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:19.013933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5d8aa0d-9c615ff7-72650ca9-19b0cbe8_0] Write session: try to update token
2025-09-30T14:57:19.013955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5d8aa0d-9c615ff7-72650ca9-19b0cbe8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:19.016544Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:19.016569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:19.016571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:19.016574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:19.016585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896469813945770:11521]
2025-09-30T14:57:19.016591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896469813945770:11521]
2025-09-30T14:57:19.016596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896469813945770:11521]
2025-09-30T14:57:19.016645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:19.016653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.016655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:19.016657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:19.016665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:19.016671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:19.016817Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:19.036887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2517 sessionId: src_id|f5d8aa0d-9c615ff7-72650ca9-19b0cbe8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:19.043935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:19.075044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896474198704217:10873]
2025-09-30T14:57:19.075647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2516, pipe: [1:7555896474198704217:10873]
2025-09-30T14:57:19.138150Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:19.138501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:19.138519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:19.138539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896474198704217:10873], now have 1 active actors on pipe
2025-09-30T14:57:19.138733Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:19.139220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5d8aa0d-9c615ff7-72650ca9-19b0cbe8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:19.139232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5d8aa0d-9c615ff7-72650ca9-19b0cbe8_0] Write session will restart in 0.006184s
2025-09-30T14:57:19.138755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896474198704217:10873]
2025-09-30T14:57:19.139281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5d8aa0d-9c615ff7-72650ca9-19b0cbe8_0] Write session: Do CDS request
2025-09-30T14:57:19.138785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:19.138816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:19.138891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2517 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f5d8aa0d-9c615ff7-72650ca9-19b0cbe8_0
2025-09-30T14:57:19.139059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2517 sessionId: src_id|f5d8aa0d-9c615ff7-72650ca9-19b0cbe8_0 is DEAD
2025-09-30T14:57:19.139319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5d8aa0d-9c615ff7-72650ca9-19b0cbe8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:19.146805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5d8aa0d-9c615ff7-72650ca9-19b0cbe8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:19.146845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:19.146864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2518
2025-09-30T14:57:19.147040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2518 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:19.147070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2518 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:19.147080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2518 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:19.147084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:19.147583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2518 sessionId:  describe result for acl check
2025-09-30T14:57:19.147624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:19.147627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:19.147630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:19.147637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896474198704286:10974] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:19.148190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896474198704286:10974] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:19.148543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:19.150067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896474198704286:10974] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:19.150269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:19.150485Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:19.150498Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:19.150511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:19.150579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:19.150624Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896474108913191:11524]
2025-09-30T14:57:19.151276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:19.151562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:19.151627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:19.151971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:19.152044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:19.152051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:19.152053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:19.152054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:19.152055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:19.152057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:19.152058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:19.152060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:19.152061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:19.152062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:19.152063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.152064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:19.152065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:19.152066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:19.152068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:19.152074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:19.152084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:19.152088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:19.152093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:19.152097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:19.152101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:19.152105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:19.152109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:19.152113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:19.152117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:19.152122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.152126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:19.152130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:19.152134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:19.152137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:19.152144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:19.152152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:19.152158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:19.152163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:19.152167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:19.152172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:19.152177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:19.152181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:19.152186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:19.152191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:19.152195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:19.152206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:19.152210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:19.152215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:19.152225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:19.152230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:19.152234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:19.152239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:19.152248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:19.152252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:19.152256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.152267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.152271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:19.152276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:19.152284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:19.152288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:19.152293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:19.152297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:19.152305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:19.152310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:19.152365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:19.152515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896474198704286:10974] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:19.152532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896474198704286:10974] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:19.152535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896474198704286:10974] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:19.152543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2518 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:19.159489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:19.160409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:19.160430Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:19.160433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:19.160438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:19.160445Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2517 [2:7555896474108913191:11524]
2025-09-30T14:57:19.160461Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:19.160477Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:19.160480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:19.160484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:19.160487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:19.160505Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:19.160518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:19.160526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:19.160608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.160618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:19.160620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:19.160623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:19.160625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:19.160696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:19.160704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.160719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:19.160732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:19.160754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:19.160776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896474108913185:11524]
2025-09-30T14:57:19.160783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896474108913185:11524]
2025-09-30T14:57:19.160786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896474108913185:11524]
2025-09-30T14:57:19.160798Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:19.160815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:19.160829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:19.160832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:19.160847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:19.160856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:19.160858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:19.160867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896474108913185:11524]
2025-09-30T14:57:19.160869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:19.160942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:19.161060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896474198704326:10974], now have 1 active actors on pipe
2025-09-30T14:57:19.161070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896474198704219:2454], now have 1 active actors on pipe
2025-09-30T14:57:19.161213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2517
2025-09-30T14:57:19.161214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2517
2025-09-30T14:57:19.161403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:19.161416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:19.161445Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5dd559b6-9ed8c88f-fa332036-df35f1aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:19.161458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:19.161462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:19.161465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:19.161477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:19.161491Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:19.161512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:19.161752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:19.161762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:19.161777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:19.161887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2518 partition: 0 MaxSeqNo: 42 sessionId: src_id|5dd559b6-9ed8c88f-fa332036-df35f1aa_0
2025-09-30T14:57:19.162288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5d8aa0d-9c615ff7-72650ca9-19b0cbe8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5dd559b6-9ed8c88f-fa332036-df35f1aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:19.165242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd559b6-9ed8c88f-fa332036-df35f1aa_0] Write session: try to update token
2025-09-30T14:57:19.165262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd559b6-9ed8c88f-fa332036-df35f1aa_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:19.180738Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:19.180759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:19.180770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896474108913185:11524]
2025-09-30T14:57:19.180838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:19.180940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:19.181036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:19.181199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:19.181336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:19.181472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:19.181666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:19.181698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:19.186009Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:19.186030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:19.186033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:19.186035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:19.186045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896474108913185:11524]
2025-09-30T14:57:19.186049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896474108913185:11524]
2025-09-30T14:57:19.186053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896474108913185:11524]
2025-09-30T14:57:19.186091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:19.186102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.186105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:19.186152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:19.186166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:19.186170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:19.186241Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:19.185603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2518 sessionId: src_id|5dd559b6-9ed8c88f-fa332036-df35f1aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:19.189750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:19.238998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896474198704352:10873]
2025-09-30T14:57:19.239525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2517, pipe: [1:7555896474198704352:10873]
2025-09-30T14:57:19.300623Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:19.301027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:19.301037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:19.301058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896474198704352:10873], now have 1 active actors on pipe
2025-09-30T14:57:19.301412Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:19.301339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896474198704352:10873]
2025-09-30T14:57:19.301342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:19.301346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:19.301373Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:19.301413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2518 reason: error at write: Disconnected sessionId: src_id|5dd559b6-9ed8c88f-fa332036-df35f1aa_0
2025-09-30T14:57:19.301590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2518 sessionId: src_id|5dd559b6-9ed8c88f-fa332036-df35f1aa_0 is DEAD
2025-09-30T14:57:19.301938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd559b6-9ed8c88f-fa332036-df35f1aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:19.301950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd559b6-9ed8c88f-fa332036-df35f1aa_0] Write session will restart in 0.008636s
2025-09-30T14:57:19.301976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd559b6-9ed8c88f-fa332036-df35f1aa_0] Write session: Do CDS request
2025-09-30T14:57:19.301982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd559b6-9ed8c88f-fa332036-df35f1aa_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:19.313070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd559b6-9ed8c88f-fa332036-df35f1aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:19.313163Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:19.313181Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2519
2025-09-30T14:57:19.313309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2519 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:19.313342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2519 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:19.313353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2519 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:19.313357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:19.313438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:19.313898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2519 sessionId:  describe result for acl check
2025-09-30T14:57:19.313936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:19.313943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:19.313945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:19.313951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896474198704427:10980] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:19.314508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896474198704427:10980] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:19.314803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:19.314992Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:19.315002Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:19.315012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:19.315060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:19.315107Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896474108913299:11526]
2025-09-30T14:57:19.315790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:19.316088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:19.316133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:19.316460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896474198704427:10980] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:19.316452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:19.316523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:19.316524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:19.316526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:19.316527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:19.316528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:19.316530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:19.316531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:19.316532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:19.316534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:19.316535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:19.316536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.316537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:19.316539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:19.316540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:19.316541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:19.316546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:19.316556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:19.316561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:19.316565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:19.316569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:19.316574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:19.316578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:19.316582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:19.316586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:19.316591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:19.316595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.316599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:19.316603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:19.316607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:19.316611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:19.316618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:19.316626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:19.316632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:19.316638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:19.316643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:19.316648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:19.316653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:19.316659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:19.316663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:19.316669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:19.316673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:19.316678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:19.316683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:19.316689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:19.316693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:19.316699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:19.316704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:19.316709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:19.316714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:19.316719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:19.316751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.316757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.316762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:19.316768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:19.316773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:19.316778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:19.316783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:19.316788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:19.316793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:19.316799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:19.316843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:19.323120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896474198704427:10980] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:19.323145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896474198704427:10980] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:19.323149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896474198704427:10980] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:19.323162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2519 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:19.323421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:19.324337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:19.324358Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:19.324361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:19.324365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:19.324372Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2518 [2:7555896474108913299:11526]
2025-09-30T14:57:19.324385Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:19.324399Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:19.324408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:19.324411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:19.324413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:19.324431Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:19.324441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:19.324453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:19.324508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.324513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:19.324515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:19.324519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:19.324521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:19.324576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:19.324583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.324591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:19.324597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:19.324607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:19.324620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896474108913293:11526]
2025-09-30T14:57:19.324621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896474108913293:11526]
2025-09-30T14:57:19.324622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896474108913293:11526]
2025-09-30T14:57:19.324629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:19.324642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896474198704353:2454], now have 1 active actors on pipe
2025-09-30T14:57:19.324641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:19.324645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:19.324647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:19.324648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:19.324662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:19.324665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:19.324700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896474198704465:10980], now have 1 active actors on pipe
2025-09-30T14:57:19.324709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896474108913293:11526]
2025-09-30T14:57:19.324716Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:19.324729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:19.324727Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2518
2025-09-30T14:57:19.324745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2518
2025-09-30T14:57:19.324816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:19.324828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:19.324851Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d36a4784-f31fa595-743ec295-b6c7198c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:19.324862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:19.324866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:19.324868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:19.324880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:19.324890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:19.324909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:19.325076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:19.325086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:19.325105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:19.325180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2519 partition: 0 MaxSeqNo: 42 sessionId: src_id|d36a4784-f31fa595-743ec295-b6c7198c_0
2025-09-30T14:57:19.325551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd559b6-9ed8c88f-fa332036-df35f1aa_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d36a4784-f31fa595-743ec295-b6c7198c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:19.328572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d36a4784-f31fa595-743ec295-b6c7198c_0] Write session: try to update token
2025-09-30T14:57:19.328592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d36a4784-f31fa595-743ec295-b6c7198c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:19.336816Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:19.336841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:19.336851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896474108913293:11526]
2025-09-30T14:57:19.336899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:19.336912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:19.337070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:19.337246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:19.337406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:19.337553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:19.337755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:19.337793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:19.344095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2519 sessionId: src_id|d36a4784-f31fa595-743ec295-b6c7198c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:19.346916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:19.349578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:19.349606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:19.349625Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:19.349627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:19.349629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:19.349630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:19.349638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896474108913293:11526]
2025-09-30T14:57:19.349641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896474108913293:11526]
2025-09-30T14:57:19.349645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896474108913293:11526]
2025-09-30T14:57:19.349692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:19.349696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:19.349702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.349706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:19.349712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:19.349717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:19.349833Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:19.401698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896474198704473:10873]
2025-09-30T14:57:19.402080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2518, pipe: [1:7555896474198704473:10873]
2025-09-30T14:57:19.463185Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:19.463616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:19.463648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896474198704473:10873], now have 1 active actors on pipe
2025-09-30T14:57:19.463846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:19.464130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896474198704473:10873]
2025-09-30T14:57:19.464153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:19.476053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:19.476070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:19.476097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2519 reason: error at write: Disconnected sessionId: src_id|d36a4784-f31fa595-743ec295-b6c7198c_0
2025-09-30T14:57:19.476225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2519 sessionId: src_id|d36a4784-f31fa595-743ec295-b6c7198c_0 is DEAD
2025-09-30T14:57:19.476383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d36a4784-f31fa595-743ec295-b6c7198c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:19.476395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d36a4784-f31fa595-743ec295-b6c7198c_0] Write session will restart in 0.009368s
2025-09-30T14:57:19.476420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d36a4784-f31fa595-743ec295-b6c7198c_0] Write session: Do CDS request
2025-09-30T14:57:19.476426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d36a4784-f31fa595-743ec295-b6c7198c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:19.486816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d36a4784-f31fa595-743ec295-b6c7198c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:19.487176Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:19.487195Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2520
2025-09-30T14:57:19.488380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2520 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:19.488430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2520 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:19.488436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2520 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:19.488442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:19.488937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2520 sessionId:  describe result for acl check
2025-09-30T14:57:19.488986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:19.488994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:19.488996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:19.489003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896474198704484:10984] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:19.489589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896474198704484:10984] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:19.492886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896474198704484:10984] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:19.496888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896474198704484:10984] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:19.496903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896474198704484:10984] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:19.496911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896474198704484:10984] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:19.496919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2520 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:19.499377Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] Counters: { Errors: 25 CurrentSessionLifetimeMs: 421543 BytesRead: 38297624 MessagesRead: 17 BytesReadCompressed: 38297624 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 2252802 BytesInflightTotal: 4505604 MessagesInflight: 2 }
2025-09-30T14:57:19.517610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:19.519933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:19.520164Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:19.520168Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:19.520179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:19.520231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:19.520265Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896474108913409:11528]
2025-09-30T14:57:19.520874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:19.521318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:19.521363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:19.521670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:19.521726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:19.521728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:19.521729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:19.521730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:19.521732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:19.521733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:19.521734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:19.521736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:19.521737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:19.521738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:19.521739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.521740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:19.521742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:19.521743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:19.521744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:19.521749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:19.521758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:19.521762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:19.521766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:19.521769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:19.521773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:19.521776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:19.521780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:19.521783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:19.521787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:19.521790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.521793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:19.521796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:19.521799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:19.521803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:19.521810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:19.521819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:19.521825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:19.521830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:19.521835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:19.521840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:19.521844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:19.521849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:19.521853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:19.521858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:19.521862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:19.521866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:19.521870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:19.521874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:19.521879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:19.521883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:19.521888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:19.521893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:19.521897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:19.521902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:19.521907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.521913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.521917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:19.521922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:19.521928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:19.521933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:19.521937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:19.521943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:19.521950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:19.521956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:19.522002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:19.528953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:19.529868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:19.529886Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:19.529890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:19.529894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:19.529900Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2519 [2:7555896474108913409:11528]
2025-09-30T14:57:19.529919Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:19.529935Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:19.529939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:19.529943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:19.529946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:19.529963Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:19.529975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:19.529983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:19.530053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.530064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:19.530066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:19.530070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:19.530072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:19.530145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:19.530153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.530166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:19.530179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:19.530200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:19.530226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896474198704520:10984], now have 1 active actors on pipe
2025-09-30T14:57:19.530235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896474198704474:2454], now have 1 active actors on pipe
2025-09-30T14:57:19.530242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896474108913404:11528]
2025-09-30T14:57:19.530244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896474108913404:11528]
2025-09-30T14:57:19.530246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896474108913404:11528]
2025-09-30T14:57:19.530261Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:19.530280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:19.530296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:19.530300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:19.530339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896474108913404:11528]
2025-09-30T14:57:19.530341Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:19.530353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:19.530357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:19.530359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:19.530366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:19.530334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2519
2025-09-30T14:57:19.530374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2519
2025-09-30T14:57:19.530444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:19.530474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:19.530506Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24571b0f-c73f4e8c-ff143256-5cc2e8c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:19.530518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:19.530522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:19.530524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:19.530535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:19.530550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:19.530564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:19.530844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:19.530859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:19.530881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:19.530982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2520 partition: 0 MaxSeqNo: 42 sessionId: src_id|24571b0f-c73f4e8c-ff143256-5cc2e8c4_0
2025-09-30T14:57:19.531402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d36a4784-f31fa595-743ec295-b6c7198c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|24571b0f-c73f4e8c-ff143256-5cc2e8c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:19.534338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24571b0f-c73f4e8c-ff143256-5cc2e8c4_0] Write session: try to update token
2025-09-30T14:57:19.534360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24571b0f-c73f4e8c-ff143256-5cc2e8c4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:19.550011Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:19.550033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:19.550043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896474108913404:11528]
2025-09-30T14:57:19.550088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:19.550093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:19.550250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:19.550405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:19.550561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:19.550717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:19.550902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:19.550943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:19.554213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2520 sessionId: src_id|24571b0f-c73f4e8c-ff143256-5cc2e8c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:19.557305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:19.557691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:19.557716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:19.557765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:19.557955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:19.563977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896474198704593:10873]
2025-09-30T14:57:19.564523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896474198704593:10873], now have 1 active actors on pipe
2025-09-30T14:57:19.566103Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:19.566122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:19.566125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:19.566127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:19.566138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896474108913404:11528]
2025-09-30T14:57:19.566145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896474108913404:11528]
2025-09-30T14:57:19.566157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896474108913404:11528]
2025-09-30T14:57:19.566205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:19.566213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.566216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:19.566237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:19.566243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:19.566249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:19.567411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2519, pipe: [1:7555896474198704593:10873]
2025-09-30T14:57:19.566417Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:19.685340Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:19.693622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:19.693655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:19.693832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:19.693897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:19.693962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:19.694031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:19.694082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:19.694092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:19.694163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:19.694273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:19.694405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:19.694539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:19.694609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:19.694618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:19.694741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:19.694859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:19.694975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:19.695037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:19.695081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:19.695083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:19.695157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:19.695219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:19.695387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:19.695459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:19.695507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:19.695520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:19.695590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:19.695661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:19.695733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:19.695804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:19.695853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:19.695856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:19.695929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:19.696005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:19.696076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:19.696143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:19.698385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24571b0f-c73f4e8c-ff143256-5cc2e8c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:19.698397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24571b0f-c73f4e8c-ff143256-5cc2e8c4_0] Write session will restart in 0.008763s
2025-09-30T14:57:19.698422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24571b0f-c73f4e8c-ff143256-5cc2e8c4_0] Write session: Do CDS request
2025-09-30T14:57:19.698428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24571b0f-c73f4e8c-ff143256-5cc2e8c4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:19.697943Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:19.698007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896474198704593:10873]
2025-09-30T14:57:19.698029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:19.698034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:19.698063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2520 reason: error at write: Disconnected sessionId: src_id|24571b0f-c73f4e8c-ff143256-5cc2e8c4_0
2025-09-30T14:57:19.698237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2520 sessionId: src_id|24571b0f-c73f4e8c-ff143256-5cc2e8c4_0 is DEAD
2025-09-30T14:57:19.696191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:19.696201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:19.696267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:19.696322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:19.696386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:19.696454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:19.696503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:19.696507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:19.696576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:19.696638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:19.696701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:19.696761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:19.696803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:19.696806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:19.696873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:19.696930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:19.696987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:19.697047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:19.697177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:19.697180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:19.697243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:19.697298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:19.697359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:19.697418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:19.697458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:19.697461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:19.698658Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:19.708832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24571b0f-c73f4e8c-ff143256-5cc2e8c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:19.708997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:19.709016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2521
2025-09-30T14:57:19.709140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2521 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:19.709169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2521 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:19.709174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2521 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:19.709178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:19.709646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2521 sessionId:  describe result for acl check
2025-09-30T14:57:19.709677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:19.709681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:19.709683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:19.709689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896474198704668:10989] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:19.710239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896474198704668:10989] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:19.710784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:19.713057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:19.713279Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:19.713289Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:19.713299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:19.713350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:19.713379Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896474108913521:11531]
2025-09-30T14:57:19.713884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:19.714336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:19.714393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:19.714756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:19.714824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:19.714833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:19.714834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:19.714836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:19.714837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:19.714839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:19.714840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:19.714841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:19.714842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:19.714843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:19.714845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.714846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:19.714847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:19.714849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:19.714880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896474198704668:10989] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:19.714850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:19.714855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:19.714865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:19.714870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:19.714875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:19.714878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:19.714883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:19.714888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:19.714891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:19.714894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:19.714899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:19.714903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.714908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:19.714912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:19.714916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:19.714921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:19.714928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:19.714938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:19.714943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:19.714950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:19.714955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:19.714961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:19.714966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:19.714972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:19.714976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:19.714981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:19.714986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:19.714992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:19.714997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:19.715003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:19.715008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:19.715021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:19.715026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:19.715035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:19.715040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:19.715049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:19.715057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.715066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.715075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:19.715081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:19.715089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:19.715098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:19.715103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:19.715113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:19.715118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:19.715127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:19.715177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:19.720169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896474198704668:10989] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:19.720188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896474198704668:10989] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:19.720192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896474198704668:10989] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:19.720200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2521 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:19.720509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:19.721638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:19.721657Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:19.721661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:19.721665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:19.721671Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2520 [2:7555896474108913521:11531]
2025-09-30T14:57:19.721689Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:19.721704Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:19.721712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:19.721715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:19.721718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:19.721735Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:19.721746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:19.721752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:19.721826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.721836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:19.721838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:19.721840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:19.721843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:19.721905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:19.721916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.721927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:19.721938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:19.721954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:19.722044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2520
2025-09-30T14:57:19.722087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2520
2025-09-30T14:57:19.721974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896474198704596:2454], now have 1 active actors on pipe
2025-09-30T14:57:19.721984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896474108913516:11531]
2025-09-30T14:57:19.721988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896474108913516:11531]
2025-09-30T14:57:19.721989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896474108913516:11531]
2025-09-30T14:57:19.722000Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:19.722009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896474198704709:10989], now have 1 active actors on pipe
2025-09-30T14:57:19.722015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:19.722018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:19.722018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:19.722019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:19.722031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:19.722036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:19.722067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896474108913516:11531]
2025-09-30T14:57:19.722070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:19.722072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:19.722229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:19.722239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:19.722264Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a3e9c9c-f681fd62-fd20461a-731c6d03_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:19.722276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:19.722280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:19.722282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:19.722292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:19.722303Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:19.722317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:19.722490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:19.722513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:19.722540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:19.722655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2521 partition: 0 MaxSeqNo: 42 sessionId: src_id|2a3e9c9c-f681fd62-fd20461a-731c6d03_0
2025-09-30T14:57:19.723007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24571b0f-c73f4e8c-ff143256-5cc2e8c4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2a3e9c9c-f681fd62-fd20461a-731c6d03_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:19.725829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a3e9c9c-f681fd62-fd20461a-731c6d03_0] Write session: try to update token
2025-09-30T14:57:19.725849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a3e9c9c-f681fd62-fd20461a-731c6d03_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:19.734671Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:19.734698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:19.734700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:19.734702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:19.734712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896474108913516:11531]
2025-09-30T14:57:19.734716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896474108913516:11531]
2025-09-30T14:57:19.734720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896474108913516:11531]
2025-09-30T14:57:19.734759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:19.734760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:19.734765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:19.734769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.734770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:19.734771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:19.734915Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:19.743347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2521 sessionId: src_id|2a3e9c9c-f681fd62-fd20461a-731c6d03_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:19.745921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:19.797959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896474198704716:10873]
2025-09-30T14:57:19.798313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2520, pipe: [1:7555896474198704716:10873]
2025-09-30T14:57:19.849346Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:19.849735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:19.849752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:19.849771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896474198704716:10873], now have 1 active actors on pipe
2025-09-30T14:57:19.850665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:19.850692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:19.850707Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:19.850753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896474198704716:10873]
2025-09-30T14:57:19.850755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2521 reason: error at write: Disconnected sessionId: src_id|2a3e9c9c-f681fd62-fd20461a-731c6d03_0
2025-09-30T14:57:19.850939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2521 sessionId: src_id|2a3e9c9c-f681fd62-fd20461a-731c6d03_0 is DEAD
2025-09-30T14:57:19.851092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a3e9c9c-f681fd62-fd20461a-731c6d03_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:19.851102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a3e9c9c-f681fd62-fd20461a-731c6d03_0] Write session will restart in 0.006197s
2025-09-30T14:57:19.851126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a3e9c9c-f681fd62-fd20461a-731c6d03_0] Write session: Do CDS request
2025-09-30T14:57:19.851132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a3e9c9c-f681fd62-fd20461a-731c6d03_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:19.850699Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:19.858735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a3e9c9c-f681fd62-fd20461a-731c6d03_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:19.859182Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:19.859198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2522
2025-09-30T14:57:19.859322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2522 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:19.859350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2522 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:19.859358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2522 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:19.859362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:19.860033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2522 sessionId:  describe result for acl check
2025-09-30T14:57:19.860067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:19.860069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:19.860071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:19.860076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896474198704777:10993] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:19.860484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896474198704777:10993] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:19.866100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:19.866993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896474198704777:10993] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:19.870513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896474198704777:10993] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:19.870530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896474198704777:10993] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:19.870534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896474198704777:10993] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:19.870543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2522 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:19.870686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:19.870896Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:19.870900Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:19.870911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:19.870963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:19.870994Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896474108913637:11533]
2025-09-30T14:57:19.871619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:19.871911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:19.871966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:19.872189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:19.872228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:19.872228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:19.872229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:19.872230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:19.872230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:19.872231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:19.872232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:19.872232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:19.872233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:19.872234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:19.872236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.872237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:19.872238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:19.872238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:19.872239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:19.872243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:19.872248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:19.872251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:19.872253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:19.872255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:19.872258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:19.872260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:19.872262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:19.872265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:19.872267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:19.872269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.872271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:19.872274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:19.872276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:19.872278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:19.872283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:19.872288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:19.872291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:19.872294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:19.872296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:19.872299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:19.872302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:19.872305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:19.872307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:19.872310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:19.872312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:19.872316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:19.872318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:19.872321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:19.872323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:19.872326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:19.872329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:19.872332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:19.872334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:19.872339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:19.872342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.872345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.872347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:19.872350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:19.872353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:19.872356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:19.872358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:19.872361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:19.872363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:19.872365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:19.872388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:19.879854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:19.880949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:19.880973Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:19.880976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:19.880980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:19.880987Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2521 [2:7555896474108913637:11533]
2025-09-30T14:57:19.881005Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:19.881021Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:19.881025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:19.881028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:19.881030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:19.881047Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:19.881054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:19.881061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:19.881139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.881150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:19.881152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:19.881156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:19.881159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:19.881239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:19.881247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.881263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:19.881281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:19.881297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:19.881444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2521
2025-09-30T14:57:19.881478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2521
2025-09-30T14:57:19.881321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896474108913625:11533]
2025-09-30T14:57:19.881328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896474108913625:11533]
2025-09-30T14:57:19.881330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896474108913625:11533]
2025-09-30T14:57:19.881339Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:19.881349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:19.881353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:19.881354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896474198704824:10993], now have 1 active actors on pipe
2025-09-30T14:57:19.881355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:19.881362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896474198704718:2454], now have 1 active actors on pipe
2025-09-30T14:57:19.881367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:19.881381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:19.881383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:19.881421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896474108913625:11533]
2025-09-30T14:57:19.881430Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:19.881438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:19.881637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:19.881643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:19.881670Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96f2471b-cabb8692-10ec19a3-a1d75bb8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:19.881677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:19.881681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:19.881683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:19.881693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:19.881705Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:19.881721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:19.881861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:19.881864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:19.881878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:19.881998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2522 partition: 0 MaxSeqNo: 42 sessionId: src_id|96f2471b-cabb8692-10ec19a3-a1d75bb8_0
2025-09-30T14:57:19.882342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a3e9c9c-f681fd62-fd20461a-731c6d03_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|96f2471b-cabb8692-10ec19a3-a1d75bb8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:19.885228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96f2471b-cabb8692-10ec19a3-a1d75bb8_0] Write session: try to update token
2025-09-30T14:57:19.885251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96f2471b-cabb8692-10ec19a3-a1d75bb8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:19.895683Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:19.895704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:19.895706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:19.895708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:19.895717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896474108913625:11533]
2025-09-30T14:57:19.895721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896474108913625:11533]
2025-09-30T14:57:19.895725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896474108913625:11533]
2025-09-30T14:57:19.895762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:19.895771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:19.895773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:19.895775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:19.895782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:19.895787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:19.895904Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:19.908256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2522 sessionId: src_id|96f2471b-cabb8692-10ec19a3-a1d75bb8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:19.910783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:19.950632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896474198704858:10873]
2025-09-30T14:57:19.951014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2521, pipe: [1:7555896474198704858:10873]
2025-09-30T14:57:20.013480Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:20.013933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:20.013949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:20.013970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896474198704858:10873], now have 1 active actors on pipe
2025-09-30T14:57:20.014193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:20.014202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:20.014207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:20.014255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896474198704858:10873]
2025-09-30T14:57:20.014285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2522 reason: error at write: Disconnected sessionId: src_id|96f2471b-cabb8692-10ec19a3-a1d75bb8_0
2025-09-30T14:57:20.014237Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:20.014466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2522 sessionId: src_id|96f2471b-cabb8692-10ec19a3-a1d75bb8_0 is DEAD
2025-09-30T14:57:20.015542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96f2471b-cabb8692-10ec19a3-a1d75bb8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:20.015559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96f2471b-cabb8692-10ec19a3-a1d75bb8_0] Write session will restart in 0.009325s
2025-09-30T14:57:20.015592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96f2471b-cabb8692-10ec19a3-a1d75bb8_0] Write session: Do CDS request
2025-09-30T14:57:20.015599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96f2471b-cabb8692-10ec19a3-a1d75bb8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:20.025774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:20.027789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96f2471b-cabb8692-10ec19a3-a1d75bb8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:20.027955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:20.027971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:20.027988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2523
2025-09-30T14:57:20.028128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2523 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:20.028165Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:20.028174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2523 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:20.028175Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:20.028184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2523 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:20.028186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:20.028188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:20.028235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:20.028278Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896478403881088:11549]
2025-09-30T14:57:20.028651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2523 sessionId:  describe result for acl check
2025-09-30T14:57:20.028693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:20.028700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:20.028702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:20.028713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896478493672231:11004] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:20.028927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:20.029254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:20.029330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896478493672231:11004] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:20.029293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:20.029626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:20.029687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:20.029694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:20.029696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:20.029697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:20.029698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:20.029700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:20.029701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:20.029702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:20.029703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:20.029704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:20.029706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.029707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.029708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.029710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:20.029711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:20.029716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:20.029725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:20.029730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:20.029734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:20.029737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:20.029742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:20.029745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:20.029749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:20.029753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:20.029757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:20.029761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.029765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.029768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.029772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:20.029776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:20.029783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:20.029791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:20.029797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:20.029803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:20.029806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:20.029811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:20.029815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:20.029820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:20.029825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:20.029830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:20.029834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:20.029840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:20.029844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:20.029849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:20.029853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:20.029859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:20.029870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:20.029875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:20.029879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:20.029884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:20.029890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.029894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.029898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.029903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.029907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.029912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.029916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:20.029920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:20.029925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:20.029929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:20.029971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:20.031655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896478493672231:11004] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:20.035216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896478493672231:11004] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:20.035232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896478493672231:11004] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:20.035237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896478493672231:11004] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:20.035271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2523 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:20.035718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:20.036917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:20.036937Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:20.036940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:20.036945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:20.036954Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2522 [2:7555896478403881088:11549]
2025-09-30T14:57:20.036975Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:20.037002Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:20.037010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:20.037014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:20.037017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:20.037034Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:20.037041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:20.037053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:20.037138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.037147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.037149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.037152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:20.037155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:20.037229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:20.037237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.037250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.037265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.037287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:20.037322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896478493672156:2454], now have 1 active actors on pipe
2025-09-30T14:57:20.037335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896478493672269:11004], now have 1 active actors on pipe
2025-09-30T14:57:20.037350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896478403881082:11549]
2025-09-30T14:57:20.037361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896478403881082:11549]
2025-09-30T14:57:20.037365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896478403881082:11549]
2025-09-30T14:57:20.037391Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:20.037425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:20.037447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:20.037453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:20.037516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896478403881082:11549]
2025-09-30T14:57:20.037522Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:20.037565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:20.037587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:20.037590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:20.037596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:20.037577Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2522
2025-09-30T14:57:20.037627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2522
2025-09-30T14:57:20.037699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:20.037715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:20.037766Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41a52761-ea8d35b9-e444686-f00b69e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:20.037779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:20.037783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:20.037785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:20.037808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:20.037824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:20.037844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:20.038036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:20.038044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:20.038057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:20.038142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2523 partition: 0 MaxSeqNo: 42 sessionId: src_id|41a52761-ea8d35b9-e444686-f00b69e8_0
2025-09-30T14:57:20.038535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96f2471b-cabb8692-10ec19a3-a1d75bb8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|41a52761-ea8d35b9-e444686-f00b69e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:20.041385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41a52761-ea8d35b9-e444686-f00b69e8_0] Write session: try to update token
2025-09-30T14:57:20.041406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41a52761-ea8d35b9-e444686-f00b69e8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:20.052718Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:20.052741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:20.052743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:20.052745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:20.052754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896478403881082:11549]
2025-09-30T14:57:20.052759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896478403881082:11549]
2025-09-30T14:57:20.052763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896478403881082:11549]
2025-09-30T14:57:20.052802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:20.052809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.052812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:20.052844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:20.052869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:20.052874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:20.052945Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:20.068479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2523 sessionId: src_id|41a52761-ea8d35b9-e444686-f00b69e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:20.071334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:20.114411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896478493672276:10873]
2025-09-30T14:57:20.114713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2522, pipe: [1:7555896478493672276:10873]
2025-09-30T14:57:20.168953Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:20.169462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:20.169481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:20.169501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896478493672276:10873], now have 1 active actors on pipe
2025-09-30T14:57:20.169870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:20.169887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896478493672276:10873]
2025-09-30T14:57:20.169915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:20.169918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:20.169936Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:20.169987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2523 reason: error at write: Disconnected sessionId: src_id|41a52761-ea8d35b9-e444686-f00b69e8_0
2025-09-30T14:57:20.170357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41a52761-ea8d35b9-e444686-f00b69e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:20.170369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41a52761-ea8d35b9-e444686-f00b69e8_0] Write session will restart in 0.009029s
2025-09-30T14:57:20.170393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41a52761-ea8d35b9-e444686-f00b69e8_0] Write session: Do CDS request
2025-09-30T14:57:20.170399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41a52761-ea8d35b9-e444686-f00b69e8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:20.170170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2523 sessionId: src_id|41a52761-ea8d35b9-e444686-f00b69e8_0 is DEAD
2025-09-30T14:57:20.183738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41a52761-ea8d35b9-e444686-f00b69e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:20.184091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:20.184109Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2524
2025-09-30T14:57:20.184285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2524 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:20.184315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2524 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:20.184320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2524 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:20.184324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:20.185005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2524 sessionId:  describe result for acl check
2025-09-30T14:57:20.185041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:20.185043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:20.185047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:20.185052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896478493672322:11008] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:20.185576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896478493672322:11008] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:20.189322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:20.194115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:20.194385Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:20.194398Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:20.194412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:20.194494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:20.194535Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896478403881200:11551]
2025-09-30T14:57:20.194513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896478493672322:11008] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:20.195216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:20.195900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:20.195984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:20.196406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:20.196488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:20.196496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:20.196497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:20.196498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:20.196500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:20.196501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:20.196502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:20.196504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:20.196505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:20.196506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:20.196508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.196509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.196511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.196512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:20.196513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:20.196520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:20.196530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:20.196535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:20.196539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:20.196543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:20.196548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:20.196553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:20.196557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:20.196562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:20.196568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:20.196573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.196577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.196581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.196585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:20.196589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:20.196597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:20.196606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:20.196612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:20.196618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:20.196623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:20.196630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:20.196635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:20.196641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:20.196646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:20.196652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:20.196657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:20.196662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:20.196668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:20.196674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:20.196678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:20.196684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:20.196689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:20.196695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:20.196700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:20.196705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:20.196712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.196718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.196723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.196729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.196734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.196750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.196756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:20.196761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:20.196766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:20.196772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:20.196819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:20.201862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896478493672322:11008] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:20.201893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896478493672322:11008] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:20.201896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896478493672322:11008] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:20.201907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2524 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:20.204477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:20.205674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:20.205691Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:20.205693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:20.205697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:20.205705Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2523 [2:7555896478403881200:11551]
2025-09-30T14:57:20.205722Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:20.205741Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:20.205745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:20.205748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:20.205750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:20.205769Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:20.205776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:20.205783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:20.205848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.205857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.205859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.205863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:20.205865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:20.205936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:20.205944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.205959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.205972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.205987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:20.206003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896478403881194:11551]
2025-09-30T14:57:20.206009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896478403881194:11551]
2025-09-30T14:57:20.206012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896478403881194:11551]
2025-09-30T14:57:20.206021Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:20.206034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:20.206048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:20.206053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:20.206057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:20.206061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:20.206063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:20.206085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896478403881194:11551]
2025-09-30T14:57:20.206088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:20.206115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896478493672407:11008], now have 1 active actors on pipe
2025-09-30T14:57:20.206118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:20.206122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896478493672278:2454], now have 1 active actors on pipe
2025-09-30T14:57:20.206305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:20.206310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:20.206334Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dff0a731-4e94c138-3138b99c-1367907c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:20.206341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:20.206345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:20.206347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:20.206358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:20.206369Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:20.206385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:20.206245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2523
2025-09-30T14:57:20.206287Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2523
2025-09-30T14:57:20.206622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:20.206637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:20.206671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:20.206787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2524 partition: 0 MaxSeqNo: 42 sessionId: src_id|dff0a731-4e94c138-3138b99c-1367907c_0
2025-09-30T14:57:20.207347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41a52761-ea8d35b9-e444686-f00b69e8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dff0a731-4e94c138-3138b99c-1367907c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:20.210204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dff0a731-4e94c138-3138b99c-1367907c_0] Write session: try to update token
2025-09-30T14:57:20.210227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dff0a731-4e94c138-3138b99c-1367907c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:20.219694Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:20.219723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:20.219733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896478403881194:11551]
2025-09-30T14:57:20.219780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:20.219863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:20.219962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:20.220111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:20.220266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:20.220404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:20.220609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:20.220646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:20.236463Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:20.236493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:20.236497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:20.236499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:20.236511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896478403881194:11551]
2025-09-30T14:57:20.236516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896478403881194:11551]
2025-09-30T14:57:20.236521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896478403881194:11551]
2025-09-30T14:57:20.236564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:20.236573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.236575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:20.236579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:20.236587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:20.236594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:20.236785Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:20.243678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2524 sessionId: src_id|dff0a731-4e94c138-3138b99c-1367907c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:20.246466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:20.271399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896478493672418:10873]
2025-09-30T14:57:20.271769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2523, pipe: [1:7555896478493672418:10873]
2025-09-30T14:57:20.365945Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:20.366448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:20.366465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:20.366487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896478493672418:10873], now have 1 active actors on pipe
2025-09-30T14:57:20.369687Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:20.370138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dff0a731-4e94c138-3138b99c-1367907c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:20.370154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dff0a731-4e94c138-3138b99c-1367907c_0] Write session will restart in 0.008342s
2025-09-30T14:57:20.370179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dff0a731-4e94c138-3138b99c-1367907c_0] Write session: Do CDS request
2025-09-30T14:57:20.370184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dff0a731-4e94c138-3138b99c-1367907c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:20.369702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:20.369720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:20.369805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2524 reason: error at write: Disconnected sessionId: src_id|dff0a731-4e94c138-3138b99c-1367907c_0
2025-09-30T14:57:20.369970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2524 sessionId: src_id|dff0a731-4e94c138-3138b99c-1367907c_0 is DEAD
2025-09-30T14:57:20.370154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:20.370186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896478493672418:10873]
2025-09-30T14:57:20.379757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dff0a731-4e94c138-3138b99c-1367907c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:20.379933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:20.379952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2525
2025-09-30T14:57:20.380225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2525 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:20.380277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2525 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:20.380287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2525 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:20.380292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:20.380715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2525 sessionId:  describe result for acl check
2025-09-30T14:57:20.380747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:20.380749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:20.380751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:20.380757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896478493672476:11014] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:20.381346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896478493672476:11014] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:20.383979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896478493672476:11014] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:20.385170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:20.387499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:20.387724Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:20.387740Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:20.387753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:20.387821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:20.387875Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896478403881314:11553]
2025-09-30T14:57:20.387893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896478493672476:11014] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:20.387909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896478493672476:11014] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:20.387913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896478493672476:11014] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:20.387922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2525 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:20.388554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:20.388886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:20.388940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:20.389295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:20.389360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:20.389361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:20.389363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:20.389364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:20.389366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:20.389367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:20.389368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:20.389370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:20.389371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:20.389372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:20.389373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.389374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.389376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.389377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:20.389378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:20.389386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:20.389396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:20.389401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:20.389406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:20.389410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:20.389414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:20.389418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:20.389423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:20.389427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:20.389431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:20.389435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.389439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.389442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.389446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:20.389450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:20.389457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:20.389466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:20.389472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:20.389479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:20.389484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:20.389490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:20.389494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:20.389500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:20.389506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:20.389511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:20.389516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:20.389521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:20.389529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:20.389535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:20.389540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:20.389546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:20.389552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:20.389558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:20.389564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:20.389569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:20.389574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.389579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.389584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.389590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.389595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.389601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.389606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:20.389612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:20.389618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:20.389624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:20.389670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:20.396487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:20.397926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:20.397946Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:20.397949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:20.397953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:20.397960Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2524 [2:7555896478403881314:11553]
2025-09-30T14:57:20.397977Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:20.397993Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:20.397999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:20.398003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:20.398005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:20.398021Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:20.398037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:20.398044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:20.398104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.398107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.398109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.398113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:20.398116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:20.398196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:20.398200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.398215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.398228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.398246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:20.398263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896478403881308:11553]
2025-09-30T14:57:20.398266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896478403881308:11553]
2025-09-30T14:57:20.398268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896478403881308:11553]
2025-09-30T14:57:20.398283Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:20.398300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:20.398316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:20.398319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:20.398334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:20.398338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:20.398341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:20.398352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896478403881308:11553]
2025-09-30T14:57:20.398359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:20.398422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:20.398474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896478493672424:2454], now have 1 active actors on pipe
2025-09-30T14:57:20.398478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896478493672533:11014], now have 1 active actors on pipe
2025-09-30T14:57:20.398797Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2524
2025-09-30T14:57:20.398842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2524
2025-09-30T14:57:20.398906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:20.398920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:20.398947Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f65ff4a-ff6cd52-f18bdadf-498dc078_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:20.398961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:20.398965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:20.398967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:20.398979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:20.398988Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:20.399004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:20.401808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:20.401826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:20.401852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:20.401961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2525 partition: 0 MaxSeqNo: 42 sessionId: src_id|5f65ff4a-ff6cd52-f18bdadf-498dc078_0
2025-09-30T14:57:20.402382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dff0a731-4e94c138-3138b99c-1367907c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5f65ff4a-ff6cd52-f18bdadf-498dc078_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:20.405263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f65ff4a-ff6cd52-f18bdadf-498dc078_0] Write session: try to update token
2025-09-30T14:57:20.405285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f65ff4a-ff6cd52-f18bdadf-498dc078_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:20.426132Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:20.426157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:20.426161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:20.426163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:20.426173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896478403881308:11553]
2025-09-30T14:57:20.426177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896478403881308:11553]
2025-09-30T14:57:20.426185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896478403881308:11553]
2025-09-30T14:57:20.426227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:20.426234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.426236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:20.426264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:20.426280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:20.426286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:20.426392Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:20.430100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2525 sessionId: src_id|5f65ff4a-ff6cd52-f18bdadf-498dc078_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:20.433027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:20.470212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896478493672545:10873]
2025-09-30T14:57:20.470546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2524, pipe: [1:7555896478493672545:10873]
2025-09-30T14:57:20.543305Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:20.543644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:20.543657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:20.543691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896478493672545:10873], now have 1 active actors on pipe
2025-09-30T14:57:20.543952Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:20.546872Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:20.546936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896478493672545:10873]
2025-09-30T14:57:20.546966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:20.547062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2525 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5f65ff4a-ff6cd52-f18bdadf-498dc078_0
2025-09-30T14:57:20.547259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2525 sessionId: src_id|5f65ff4a-ff6cd52-f18bdadf-498dc078_0 is DEAD
2025-09-30T14:57:20.551411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f65ff4a-ff6cd52-f18bdadf-498dc078_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:20.551425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f65ff4a-ff6cd52-f18bdadf-498dc078_0] Write session will restart in 0.008114s
2025-09-30T14:57:20.551453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f65ff4a-ff6cd52-f18bdadf-498dc078_0] Write session: Do CDS request
2025-09-30T14:57:20.551459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f65ff4a-ff6cd52-f18bdadf-498dc078_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:20.563713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f65ff4a-ff6cd52-f18bdadf-498dc078_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:20.563801Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:20.563822Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2526
2025-09-30T14:57:20.563991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2526 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:20.564027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2526 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:20.564038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2526 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:20.564043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:20.564604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2526 sessionId:  describe result for acl check
2025-09-30T14:57:20.564642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:20.564649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:20.564651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:20.564657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896478493672600:11018] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:20.565238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896478493672600:11018] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:20.568788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:20.570493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:20.570685Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:20.570688Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:20.570699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:20.570746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:20.570778Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896478403881430:11556]
2025-09-30T14:57:20.571634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896478493672600:11018] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:20.571386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:20.572769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:20.572813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:20.573182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:20.573236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:20.573237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:20.573238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:20.573240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:20.573241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:20.573242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:20.573243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:20.573244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:20.573246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:20.573247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:20.573248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.573249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.573250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.573252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:20.573253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:20.573260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:20.573270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:20.573274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:20.573278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:20.573283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:20.573287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:20.573291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:20.573296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:20.573300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:20.573305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:20.573309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.573313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.573317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.573321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:20.573325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:20.573333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:20.573342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:20.573348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:20.573354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:20.573359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:20.573365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:20.573370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:20.573375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:20.573380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:20.573387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:20.573391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:20.573397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:20.573402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:20.573407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:20.573412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:20.573418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:20.573423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:20.573428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:20.573432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:20.573436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:20.573440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.573445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.573450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.573455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.573462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.573468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.573473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:20.573478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:20.573483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:20.573489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:20.573535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:20.579685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896478493672600:11018] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:20.579706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896478493672600:11018] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:20.579714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896478493672600:11018] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:20.579723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2526 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:20.580151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:20.581186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:20.581202Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:20.581204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:20.581207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:20.581213Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2525 [2:7555896478403881430:11556]
2025-09-30T14:57:20.581228Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:20.581241Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:20.581243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:20.581245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:20.581247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:20.581259Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:20.581264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:20.581270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:20.581324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.581330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.581331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.581334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:20.581336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:20.581399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:20.581407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.581420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.581436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.581457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:20.581478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896478493672663:11018], now have 1 active actors on pipe
2025-09-30T14:57:20.581481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896478493672547:2454], now have 1 active actors on pipe
2025-09-30T14:57:20.581487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896478403881425:11556]
2025-09-30T14:57:20.581489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896478403881425:11556]
2025-09-30T14:57:20.581491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896478403881425:11556]
2025-09-30T14:57:20.581502Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:20.581513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:20.581516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:20.581516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:20.581518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:20.581530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:20.581532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:20.581566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896478403881425:11556]
2025-09-30T14:57:20.581579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:20.581641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:20.584579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2525
2025-09-30T14:57:20.584616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2525
2025-09-30T14:57:20.587069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:20.587090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:20.587124Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c1f51-2f093034-7350b55f-b2495da3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:20.587134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:20.587138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:20.587141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:20.587154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:20.587168Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:20.587185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:20.589192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:20.589208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:20.589233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:20.589713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2526 partition: 0 MaxSeqNo: 42 sessionId: src_id|2c1f51-2f093034-7350b55f-b2495da3_0
2025-09-30T14:57:20.594166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f65ff4a-ff6cd52-f18bdadf-498dc078_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2c1f51-2f093034-7350b55f-b2495da3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:20.596967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1f51-2f093034-7350b55f-b2495da3_0] Write session: try to update token
2025-09-30T14:57:20.596989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1f51-2f093034-7350b55f-b2495da3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:20.594742Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:20.594760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:20.594762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:20.594763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:20.594770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896478403881425:11556]
2025-09-30T14:57:20.594774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896478403881425:11556]
2025-09-30T14:57:20.594777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896478403881425:11556]
2025-09-30T14:57:20.594816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:20.594821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:20.594823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.594826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:20.594826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:20.594830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:20.594964Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:20.619312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2526 sessionId: src_id|2c1f51-2f093034-7350b55f-b2495da3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:20.622031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:20.646866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896478493672671:10873]
2025-09-30T14:57:20.647206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2525, pipe: [1:7555896478493672671:10873]
2025-09-30T14:57:20.708048Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:20.708437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:20.708456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:20.708476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896478493672671:10873], now have 1 active actors on pipe
2025-09-30T14:57:20.708742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896478493672671:10873]
2025-09-30T14:57:20.708745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:20.708749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:20.708775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:20.708826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2526 reason: error at write: Disconnected sessionId: src_id|2c1f51-2f093034-7350b55f-b2495da3_0
2025-09-30T14:57:20.708735Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:20.709013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2526 sessionId: src_id|2c1f51-2f093034-7350b55f-b2495da3_0 is DEAD
2025-09-30T14:57:20.711396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1f51-2f093034-7350b55f-b2495da3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:20.711408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1f51-2f093034-7350b55f-b2495da3_0] Write session will restart in 0.008616s
2025-09-30T14:57:20.711433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1f51-2f093034-7350b55f-b2495da3_0] Write session: Do CDS request
2025-09-30T14:57:20.711441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1f51-2f093034-7350b55f-b2495da3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:20.720722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1f51-2f093034-7350b55f-b2495da3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:20.723718Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:20.723736Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2527
2025-09-30T14:57:20.723885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2527 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:20.723922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2527 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:20.723932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2527 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:20.723936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:20.724081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:20.724386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2527 sessionId:  describe result for acl check
2025-09-30T14:57:20.724426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:20.724434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:20.724436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:20.724442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896478493672753:11023] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:20.725018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896478493672753:11023] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:20.726439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:20.726649Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:20.726663Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:20.726674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:20.726726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:20.726772Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896478403881545:11558]
2025-09-30T14:57:20.727107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896478493672753:11023] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:20.727490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:20.730021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896478493672753:11023] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:20.730035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896478493672753:11023] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:20.730039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896478493672753:11023] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:20.730047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2527 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:20.730547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:20.730612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:20.731034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:20.731118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:20.731120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:20.731122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:20.731123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:20.731124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:20.731126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:20.731127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:20.731128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:20.731130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:20.731131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:20.731133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.731134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.731135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.731137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:20.731138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:20.731146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:20.731157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:20.731161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:20.731166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:20.731170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:20.731175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:20.731179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:20.731183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:20.731186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:20.731191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:20.731194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.731198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.731202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.731205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:20.731209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:20.731217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:20.731226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:20.731232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:20.731238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:20.731260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:20.731266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:20.731271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:20.731277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:20.731282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:20.731288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:20.731292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:20.731298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:20.731304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:20.731320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:20.731325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:20.731331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:20.731335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:20.731350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:20.731355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:20.731361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:20.731366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.731372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.731377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.731382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.731389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.731393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.731397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:20.731403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:20.731407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:20.731413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:20.731465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:20.743048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:20.744060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:20.744079Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:20.744082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:20.744087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:20.744094Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2526 [2:7555896478403881545:11558]
2025-09-30T14:57:20.744112Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:20.744131Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:20.744139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:20.744144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:20.744146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:20.744165Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:20.744178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:20.744190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:20.744255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.744263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.744265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.744269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:20.744272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:20.744346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:20.744353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.744367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.744384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.744407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:20.744430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896478403881540:11558]
2025-09-30T14:57:20.744438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896478403881540:11558]
2025-09-30T14:57:20.744441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896478403881540:11558]
2025-09-30T14:57:20.744457Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:20.744471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:20.744491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:20.744497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:20.744534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896478403881540:11558]
2025-09-30T14:57:20.744534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:20.744538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:20.744540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:20.744542Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:20.744546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:20.744819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896478493672788:11023], now have 1 active actors on pipe
2025-09-30T14:57:20.744831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896478493672673:2454], now have 1 active actors on pipe
2025-09-30T14:57:20.745209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2526
2025-09-30T14:57:20.745242Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2526
2025-09-30T14:57:20.745915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2527 partition: 0 MaxSeqNo: 42 sessionId: src_id|11a3f34-fc1aaceb-95fb66a0-1638d980_0
2025-09-30T14:57:20.746309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1f51-2f093034-7350b55f-b2495da3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|11a3f34-fc1aaceb-95fb66a0-1638d980_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:20.745490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:20.745508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:20.745555Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11a3f34-fc1aaceb-95fb66a0-1638d980_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:20.745565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:20.745569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:20.745572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:20.745584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:20.745597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:20.745614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:20.745784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:20.745788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:20.745805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:20.749337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11a3f34-fc1aaceb-95fb66a0-1638d980_0] Write session: try to update token
2025-09-30T14:57:20.749356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11a3f34-fc1aaceb-95fb66a0-1638d980_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:20.768113Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:20.768135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:20.768145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896478403881540:11558]
2025-09-30T14:57:20.768200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:20.768207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:20.768391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:20.768544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:20.768686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:20.768823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:20.769024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:20.769062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:20.773923Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:20.773946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:20.773949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:20.773951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:20.773964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896478403881540:11558]
2025-09-30T14:57:20.773968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896478403881540:11558]
2025-09-30T14:57:20.773972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896478403881540:11558]
2025-09-30T14:57:20.774014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:20.774018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:20.774022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.774024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:20.774035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:20.774039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:20.774173Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:20.778714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2527 sessionId: src_id|11a3f34-fc1aaceb-95fb66a0-1638d980_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:20.781537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:20.809168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896478493672799:10873]
2025-09-30T14:57:20.811801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2526, pipe: [1:7555896478493672799:10873]
2025-09-30T14:57:20.891593Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:20.892056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:20.892066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:20.892088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896478493672799:10873], now have 1 active actors on pipe
2025-09-30T14:57:20.892485Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:20.892916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11a3f34-fc1aaceb-95fb66a0-1638d980_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:20.892928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11a3f34-fc1aaceb-95fb66a0-1638d980_0] Write session will restart in 0.006085s
2025-09-30T14:57:20.892953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11a3f34-fc1aaceb-95fb66a0-1638d980_0] Write session: Do CDS request
2025-09-30T14:57:20.892538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:20.892553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:20.892958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11a3f34-fc1aaceb-95fb66a0-1638d980_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:20.892617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2527 reason: error at write: Disconnected sessionId: src_id|11a3f34-fc1aaceb-95fb66a0-1638d980_0
2025-09-30T14:57:20.892689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896478493672799:10873]
2025-09-30T14:57:20.892713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:20.892782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2527 sessionId: src_id|11a3f34-fc1aaceb-95fb66a0-1638d980_0 is DEAD
2025-09-30T14:57:20.900735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11a3f34-fc1aaceb-95fb66a0-1638d980_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:20.903651Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:20.903673Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2528
2025-09-30T14:57:20.903824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2528 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:20.903863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2528 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:20.903876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2528 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:20.903881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:20.904389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2528 sessionId:  describe result for acl check
2025-09-30T14:57:20.904425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:20.904441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:20.904443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:20.904452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896478493672879:11027] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:20.904948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896478493672879:11027] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:20.905894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:20.908686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:20.908910Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:20.908923Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:20.908935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:20.908997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:20.909042Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896478403881661:11560]
2025-09-30T14:57:20.909076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896478493672879:11027] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:20.909783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:20.910329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:20.910404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:20.910768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:20.910839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:20.910848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:20.910849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:20.910851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:20.910852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:20.910854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:20.910855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:20.910857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:20.910858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:20.910860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:20.910861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.910862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.910863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.910865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:20.910866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:20.910873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:20.910884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:20.910888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:20.910894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:20.910899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:20.910903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:20.910908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:20.910912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:20.910916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:20.910920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:20.910924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.910929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.910932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.910936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:20.910940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:20.910948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:20.910957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:20.910963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:20.910967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:20.910972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:20.910977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:20.910982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:20.910988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:20.910993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:20.910999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:20.911004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:20.911010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:20.911015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:20.911021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:20.911026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:20.911031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:20.911037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:20.911043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:20.911047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:20.911053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:20.911060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.911066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.911070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.911075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.911081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.911086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.911092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:20.911098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:20.911103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:20.911109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:20.911156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:20.917442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896478493672879:11027] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:20.917460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896478493672879:11027] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:20.917464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896478493672879:11027] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:20.917473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2528 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:20.921162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:20.922052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:20.922057Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:20.922060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:20.922063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:20.922069Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2527 [2:7555896478403881661:11560]
2025-09-30T14:57:20.922083Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:20.922099Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:20.922101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:20.922103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:20.922105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:20.922119Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:20.922125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:20.922130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:20.922181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.922182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.922184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.922187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:20.922189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:20.922256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:20.922260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.922269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:20.922277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:20.922287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:20.922301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896478403881656:11560]
2025-09-30T14:57:20.922303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896478403881656:11560]
2025-09-30T14:57:20.922305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896478403881656:11560]
2025-09-30T14:57:20.922318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:20.922334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:20.922346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:20.922348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:20.922385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896478403881656:11560]
2025-09-30T14:57:20.922388Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:20.922971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2527
2025-09-30T14:57:20.922981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2527
2025-09-30T14:57:20.922704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:20.922711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:20.922713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:20.922717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:20.923316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896478493672920:11027], now have 1 active actors on pipe
2025-09-30T14:57:20.923327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896478493672801:2454], now have 1 active actors on pipe
2025-09-30T14:57:20.923345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:20.923351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:20.923378Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72ed025d-be1add22-ddd79646-42663d01_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:20.923386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:20.923390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:20.923393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:20.923403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:20.923417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:20.923434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:20.923669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:20.923676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:20.923691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:20.923832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2528 partition: 0 MaxSeqNo: 42 sessionId: src_id|72ed025d-be1add22-ddd79646-42663d01_0
2025-09-30T14:57:20.927081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11a3f34-fc1aaceb-95fb66a0-1638d980_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|72ed025d-be1add22-ddd79646-42663d01_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:20.929840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72ed025d-be1add22-ddd79646-42663d01_0] Write session: try to update token
2025-09-30T14:57:20.929862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72ed025d-be1add22-ddd79646-42663d01_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:20.939616Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:20.939644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:20.939647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:20.939649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:20.939658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896478403881656:11560]
2025-09-30T14:57:20.939663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896478403881656:11560]
2025-09-30T14:57:20.939667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896478403881656:11560]
2025-09-30T14:57:20.939713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:20.939720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:20.939722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:20.939729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:20.939737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:20.939740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:20.939912Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:20.957360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2528 sessionId: src_id|72ed025d-be1add22-ddd79646-42663d01_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:20.960040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:20.995450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896478493672945:10873]
2025-09-30T14:57:20.996269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2527, pipe: [1:7555896478493672945:10873]
2025-09-30T14:57:21.056351Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:21.056778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:21.056788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:21.056828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896478493672945:10873], now have 1 active actors on pipe
2025-09-30T14:57:21.057881Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:21.057860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896478493672945:10873]
2025-09-30T14:57:21.057896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:21.057899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:21.057942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:21.057962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2528 reason: error at write: Disconnected sessionId: src_id|72ed025d-be1add22-ddd79646-42663d01_0
2025-09-30T14:57:21.058130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2528 sessionId: src_id|72ed025d-be1add22-ddd79646-42663d01_0 is DEAD
2025-09-30T14:57:21.058555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72ed025d-be1add22-ddd79646-42663d01_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:21.058565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72ed025d-be1add22-ddd79646-42663d01_0] Write session will restart in 0.009200s
2025-09-30T14:57:21.058590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72ed025d-be1add22-ddd79646-42663d01_0] Write session: Do CDS request
2025-09-30T14:57:21.058595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72ed025d-be1add22-ddd79646-42663d01_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:21.068796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72ed025d-be1add22-ddd79646-42663d01_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:21.069165Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:21.069189Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2529
2025-09-30T14:57:21.069330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2529 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:21.069366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2529 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:21.069377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2529 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:21.069382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:21.069785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2529 sessionId:  describe result for acl check
2025-09-30T14:57:21.069831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:21.069833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:21.069835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:21.069841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896482788640330:11038] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:21.070400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896482788640330:11038] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:21.071940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:21.072177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896482788640330:11038] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:21.074319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:21.074596Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:21.074608Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:21.074620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:21.074685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:21.074730Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896482698849126:11576]
2025-09-30T14:57:21.075159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896482788640330:11038] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:21.075176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896482788640330:11038] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:21.075179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896482788640330:11038] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:21.075188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2529 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:21.075408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:21.075696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:21.075742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:21.076097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:21.076165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:21.076171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:21.076173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:21.076174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:21.076176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:21.076177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:21.076179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:21.076180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:21.076181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:21.076183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:21.076184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.076185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.076187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.076188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:21.076189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:21.076195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:21.076206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:21.076211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:21.076215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:21.076219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:21.076223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:21.076228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:21.076232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:21.076236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:21.076240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:21.076245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.076249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.076253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.076257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:21.076273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:21.076280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:21.076289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:21.076295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:21.076301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:21.076306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:21.076312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:21.076317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:21.076323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:21.076328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:21.076334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:21.076339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:21.076344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:21.076349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:21.076355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:21.076359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:21.076382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:21.076388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:21.076394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:21.076400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:21.076405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:21.076410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.076415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.076420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.076432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.076437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.076447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.076452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:21.076461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:21.076466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:21.076471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:21.076513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:21.082098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:21.083260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:21.083277Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:21.083279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:21.083284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:21.083292Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2528 [2:7555896482698849126:11576]
2025-09-30T14:57:21.083309Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:21.083326Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:21.083329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:21.083333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:21.083335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:21.083354Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:21.083360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:21.083373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:21.083434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.083456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.083459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.083462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:21.083465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:21.083541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:21.083549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.083563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.083582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.083606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:21.083628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896482788640367:11038], now have 1 active actors on pipe
2025-09-30T14:57:21.083637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896482788640251:2454], now have 1 active actors on pipe
2025-09-30T14:57:21.083644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896482698849121:11576]
2025-09-30T14:57:21.083646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896482698849121:11576]
2025-09-30T14:57:21.083648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896482698849121:11576]
2025-09-30T14:57:21.083661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:21.083676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:21.083696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:21.083699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:21.083703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:21.083703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:21.083705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:21.083736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896482698849121:11576]
2025-09-30T14:57:21.083746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:21.083752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:21.083762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2528
2025-09-30T14:57:21.083798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2528
2025-09-30T14:57:21.083935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:21.083945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:21.083974Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0921a58-4927b5bc-da5327a8-5da72cf7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:21.083985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:21.083989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:21.083992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:21.084002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:21.084012Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:21.084030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:21.084195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:21.084203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:21.084216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:21.084322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2529 partition: 0 MaxSeqNo: 42 sessionId: src_id|e0921a58-4927b5bc-da5327a8-5da72cf7_0
2025-09-30T14:57:21.084695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72ed025d-be1add22-ddd79646-42663d01_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e0921a58-4927b5bc-da5327a8-5da72cf7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:21.087692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0921a58-4927b5bc-da5327a8-5da72cf7_0] Write session: try to update token
2025-09-30T14:57:21.087711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0921a58-4927b5bc-da5327a8-5da72cf7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:21.095890Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:21.095908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:21.095918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896482698849121:11576]
2025-09-30T14:57:21.095965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:21.095969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:21.096226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:21.096429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:21.096578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:21.096751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:21.096960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:21.097001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:21.104301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2529 sessionId: src_id|e0921a58-4927b5bc-da5327a8-5da72cf7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:21.106797Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:21.106816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:21.106819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:21.106821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:21.106832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896482698849121:11576]
2025-09-30T14:57:21.106836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896482698849121:11576]
2025-09-30T14:57:21.106844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896482698849121:11576]
2025-09-30T14:57:21.106882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:21.106889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.106892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:21.106891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:21.106898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:21.106903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:21.107022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:21.107063Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:21.157822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896482788640378:10873]
2025-09-30T14:57:21.158096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2528, pipe: [1:7555896482788640378:10873]
2025-09-30T14:57:21.222292Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:21.222726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:21.222735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:21.222755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896482788640378:10873], now have 1 active actors on pipe
2025-09-30T14:57:21.227212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:21.227233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:21.227320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2529 reason: error at write: Disconnected sessionId: src_id|e0921a58-4927b5bc-da5327a8-5da72cf7_0
2025-09-30T14:57:21.227819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0921a58-4927b5bc-da5327a8-5da72cf7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:21.227831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0921a58-4927b5bc-da5327a8-5da72cf7_0] Write session will restart in 0.006840s
2025-09-30T14:57:21.227858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0921a58-4927b5bc-da5327a8-5da72cf7_0] Write session: Do CDS request
2025-09-30T14:57:21.227864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0921a58-4927b5bc-da5327a8-5da72cf7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:21.230736Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:21.227491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2529 sessionId: src_id|e0921a58-4927b5bc-da5327a8-5da72cf7_0 is DEAD
2025-09-30T14:57:21.227668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:21.227699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896482788640378:10873]
2025-09-30T14:57:21.235758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0921a58-4927b5bc-da5327a8-5da72cf7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:21.236579Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:21.236600Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2530
2025-09-30T14:57:21.236809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2530 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:21.236844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2530 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:21.236849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2530 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:21.236854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:21.237272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2530 sessionId:  describe result for acl check
2025-09-30T14:57:21.237298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:21.237311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:21.237313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:21.237319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896482788640415:11044] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:21.237880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896482788640415:11044] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:21.243818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896482788640415:11044] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:21.248969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896482788640415:11044] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:21.248995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896482788640415:11044] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:21.248998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896482788640415:11044] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:21.249007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2530 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:21.251726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:21.251986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:21.252237Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:21.252248Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:21.252259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:21.252321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:21.252364Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896482698849246:11578]
2025-09-30T14:57:21.253042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:21.253377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:21.253442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:21.253803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:21.253877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:21.253892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:21.253898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:21.253899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:21.253901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:21.253902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:21.253903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:21.253904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:21.253905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:21.253906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:21.253908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.253909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.253910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.253911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:21.253912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:21.253918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:21.253928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:21.253932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:21.253937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:21.253940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:21.253944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:21.253948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:21.253951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:21.253955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:21.253959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:21.253963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.253967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.253971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.253974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:21.253978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:21.253988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:21.253995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:21.254001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:21.254006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:21.254014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:21.254024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:21.254029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:21.254039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:21.254045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:21.254054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:21.254059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:21.254063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:21.254069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:21.254080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:21.254084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:21.254094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:21.254098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:21.254103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:21.254107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:21.254112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:21.254117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.254122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.254127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.254132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.254142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.254147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.254155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:21.254161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:21.254165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:21.254170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:21.254215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:21.260233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:21.261235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:21.261248Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:21.261251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:21.261255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:21.261262Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2529 [2:7555896482698849246:11578]
2025-09-30T14:57:21.261279Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:21.261296Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:21.261304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:21.261307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:21.261314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:21.261331Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:21.261342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:21.261349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:21.261413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.261419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.261422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.261426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:21.261428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:21.261500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:21.261510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.261524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.261535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.261550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:21.261569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896482788640397:2454], now have 1 active actors on pipe
2025-09-30T14:57:21.261577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896482788640515:11044], now have 1 active actors on pipe
2025-09-30T14:57:21.261584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896482698849239:11578]
2025-09-30T14:57:21.261586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896482698849239:11578]
2025-09-30T14:57:21.261588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896482698849239:11578]
2025-09-30T14:57:21.261604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:21.261611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:21.261617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:21.261619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:21.261621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:21.261636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:21.261643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:21.261649Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2529
2025-09-30T14:57:21.261698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2529
2025-09-30T14:57:21.261678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896482698849239:11578]
2025-09-30T14:57:21.261687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:21.261688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:21.261790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:21.261800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:21.261823Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d2deffe7-87ef3da7-e64409d3-28e3168c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:21.261834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:21.261838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:21.261840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:21.261850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:21.261859Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:21.261878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:21.262046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:21.262055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:21.262070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:21.262150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2530 partition: 0 MaxSeqNo: 42 sessionId: src_id|d2deffe7-87ef3da7-e64409d3-28e3168c_0
2025-09-30T14:57:21.263340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0921a58-4927b5bc-da5327a8-5da72cf7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d2deffe7-87ef3da7-e64409d3-28e3168c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:21.266147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2deffe7-87ef3da7-e64409d3-28e3168c_0] Write session: try to update token
2025-09-30T14:57:21.266163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2deffe7-87ef3da7-e64409d3-28e3168c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:21.275000Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:21.275024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:21.275026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:21.275029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:21.275042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896482698849239:11578]
2025-09-30T14:57:21.275050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896482698849239:11578]
2025-09-30T14:57:21.275055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896482698849239:11578]
2025-09-30T14:57:21.275099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:21.275106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.275109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:21.275119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:21.275138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:21.275143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:21.275275Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:21.286842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2530 sessionId: src_id|d2deffe7-87ef3da7-e64409d3-28e3168c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:21.289886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:21.327785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896482788640531:10873]
2025-09-30T14:57:21.328606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2529, pipe: [1:7555896482788640531:10873]
2025-09-30T14:57:21.389006Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:21.389387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:21.389404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:21.389428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896482788640531:10873], now have 1 active actors on pipe
2025-09-30T14:57:21.390163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2deffe7-87ef3da7-e64409d3-28e3168c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:21.390175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2deffe7-87ef3da7-e64409d3-28e3168c_0] Write session will restart in 0.006053s
2025-09-30T14:57:21.389695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:21.390199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2deffe7-87ef3da7-e64409d3-28e3168c_0] Write session: Do CDS request
2025-09-30T14:57:21.389746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:21.389758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:21.390206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2deffe7-87ef3da7-e64409d3-28e3168c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:21.389823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2530 reason: error at write: Disconnected sessionId: src_id|d2deffe7-87ef3da7-e64409d3-28e3168c_0
2025-09-30T14:57:21.390002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2530 sessionId: src_id|d2deffe7-87ef3da7-e64409d3-28e3168c_0 is DEAD
2025-09-30T14:57:21.390023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896482788640531:10873]
2025-09-30T14:57:21.389695Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:21.401690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2deffe7-87ef3da7-e64409d3-28e3168c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:21.401904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:21.401931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2531
2025-09-30T14:57:21.402891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:21.402272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2531 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:21.402317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2531 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:21.402322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2531 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:21.402326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:21.402743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2531 sessionId:  describe result for acl check
2025-09-30T14:57:21.402769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:21.402772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:21.402774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:21.402780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896482788640615:11048] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:21.403374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896482788640615:11048] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:21.404955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:21.405344Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:21.405352Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:21.405371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:21.405469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:21.405541Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896482698849366:11580]
2025-09-30T14:57:21.406163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:21.406692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:21.406728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:21.407054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:21.407124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:21.407126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:21.407127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:21.407129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:21.407130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:21.407131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:21.407133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:21.407134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:21.407135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:21.407137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:21.407138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.407139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.407141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.407142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:21.407143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:21.407149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:21.407159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:21.407163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:21.407168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:21.407172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:21.407176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:21.407181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:21.407185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:21.407189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:21.407193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:21.407197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.407201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.407205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.407209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:21.407213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:21.407220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:21.407230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:21.407236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:21.407259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:21.407265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:21.407270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:21.407275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:21.407281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:21.407287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:21.407292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:21.407297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:21.407302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:21.407306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:21.407311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:21.407316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:21.407321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:21.407326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:21.407332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:21.407337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:21.407343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:21.407348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.407354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.407358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.407366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.407371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.407376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.407381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:21.407386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:21.407391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:21.407396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:21.407443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:21.409105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896482788640615:11048] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:21.413197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896482788640615:11048] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:21.413220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896482788640615:11048] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:21.413223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896482788640615:11048] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:21.413230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2531 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:21.413598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:21.414633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:21.414647Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:21.414650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:21.414654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:21.414660Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2530 [2:7555896482698849366:11580]
2025-09-30T14:57:21.414678Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:21.414694Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:21.414697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:21.414700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:21.414703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:21.414718Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:21.414725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:21.414735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:21.414795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.414802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.414805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.414808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:21.414811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:21.414874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:21.414882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.414896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.414915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.414938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:21.414961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896482788640654:11048], now have 1 active actors on pipe
2025-09-30T14:57:21.414970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896482788640533:2454], now have 1 active actors on pipe
2025-09-30T14:57:21.414976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896482698849361:11580]
2025-09-30T14:57:21.414980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896482698849361:11580]
2025-09-30T14:57:21.414982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896482698849361:11580]
2025-09-30T14:57:21.414994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:21.415008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:21.415012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:21.415016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:21.415018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:21.415030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:21.415033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:21.415069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896482698849361:11580]
2025-09-30T14:57:21.415077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:21.415080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:21.415094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:21.415103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:21.415033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2530
2025-09-30T14:57:21.415066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2530
2025-09-30T14:57:21.415274Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c55c438f-c5003860-27ae91b2-3914953f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:21.415287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:21.415292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:21.415294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:21.415306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:21.415315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:21.415344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:21.415545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:21.415553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:21.415567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:21.415672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2531 partition: 0 MaxSeqNo: 42 sessionId: src_id|c55c438f-c5003860-27ae91b2-3914953f_0
2025-09-30T14:57:21.416055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2deffe7-87ef3da7-e64409d3-28e3168c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c55c438f-c5003860-27ae91b2-3914953f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:21.419142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c55c438f-c5003860-27ae91b2-3914953f_0] Write session: try to update token
2025-09-30T14:57:21.419166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c55c438f-c5003860-27ae91b2-3914953f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:21.429492Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:21.429513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:21.429515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:21.429517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:21.429527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896482698849361:11580]
2025-09-30T14:57:21.429534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896482698849361:11580]
2025-09-30T14:57:21.429537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896482698849361:11580]
2025-09-30T14:57:21.429579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:21.429586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.429589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:21.429602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:21.429610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:21.429614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:21.429733Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:21.438644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2531 sessionId: src_id|c55c438f-c5003860-27ae91b2-3914953f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:21.441730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:21.490115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896482788640661:10873]
2025-09-30T14:57:21.490427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2530, pipe: [1:7555896482788640661:10873]
2025-09-30T14:57:21.555940Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:21.556309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:21.556327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:21.556370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896482788640661:10873], now have 1 active actors on pipe
2025-09-30T14:57:21.556597Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:21.556616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:21.556634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:21.556712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2531 reason: error at write: Disconnected sessionId: src_id|c55c438f-c5003860-27ae91b2-3914953f_0
2025-09-30T14:57:21.556771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896482788640661:10873]
2025-09-30T14:57:21.556798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:21.556893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2531 sessionId: src_id|c55c438f-c5003860-27ae91b2-3914953f_0 is DEAD
2025-09-30T14:57:21.557062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c55c438f-c5003860-27ae91b2-3914953f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:21.557074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c55c438f-c5003860-27ae91b2-3914953f_0] Write session will restart in 0.009343s
2025-09-30T14:57:21.557112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c55c438f-c5003860-27ae91b2-3914953f_0] Write session: Do CDS request
2025-09-30T14:57:21.557118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c55c438f-c5003860-27ae91b2-3914953f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:21.568785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c55c438f-c5003860-27ae91b2-3914953f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:21.568781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:21.568926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:21.568946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2532
2025-09-30T14:57:21.569132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2532 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:21.569169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2532 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:21.569175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2532 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:21.569179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:21.569654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2532 sessionId:  describe result for acl check
2025-09-30T14:57:21.569691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:21.569698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:21.569700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:21.569706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896482788640747:11052] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:21.570272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896482788640747:11052] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:21.572648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896482788640747:11052] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:21.572281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:21.572515Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:21.572520Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:21.572531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:21.572610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:21.572647Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896482698849489:11583]
2025-09-30T14:57:21.573510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:21.573894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:21.573947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:21.574309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:21.574377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:21.574378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:21.574379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:21.574380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:21.574382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:21.574383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:21.574384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:21.574386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:21.574387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:21.574389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:21.574390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.574391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.574393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.574394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:21.574395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:21.574402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:21.574413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:21.574418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:21.574423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:21.574427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:21.574432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:21.574436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:21.574440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:21.574445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:21.574450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:21.574455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.574459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.574463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.574467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:21.574472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:21.574479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:21.574487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:21.574494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:21.574500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:21.574506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:21.574512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:21.574516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:21.574522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:21.574528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:21.574533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:21.574538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:21.574544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:21.574549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:21.574555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:21.574559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:21.574565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:21.574570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:21.574576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:21.574581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:21.574587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:21.574593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.574599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.574605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.574611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.574616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.574621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.574626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:21.574631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:21.574638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:21.574645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:21.574691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:21.582406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896482788640747:11052] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:21.582427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896482788640747:11052] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:21.582431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896482788640747:11052] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:21.582439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2532 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:21.585715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:21.587070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2531
2025-09-30T14:57:21.587112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2531
2025-09-30T14:57:21.586645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:21.586663Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:21.586667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:21.586671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:21.586678Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2531 [2:7555896482698849489:11583]
2025-09-30T14:57:21.586698Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:21.586715Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:21.586719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:21.586722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:21.586725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:21.586742Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:21.586748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:21.586755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:21.586819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.586822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.586824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.586828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:21.586831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:21.586914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:21.586918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.586933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.586945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.586963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:21.586984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896482788640785:11052], now have 1 active actors on pipe
2025-09-30T14:57:21.586988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896482788640663:2454], now have 1 active actors on pipe
2025-09-30T14:57:21.587009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896482698849484:11583]
2025-09-30T14:57:21.587013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896482698849484:11583]
2025-09-30T14:57:21.587015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896482698849484:11583]
2025-09-30T14:57:21.587030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:21.587048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:21.587049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:21.587054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:21.587057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:21.587065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:21.587082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:21.587122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896482698849484:11583]
2025-09-30T14:57:21.587130Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:21.587140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:21.587454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:21.587471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:21.587508Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed799ba5-e2abef79-f330ca30-7502b5f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:21.587517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:21.587542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:21.587549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:21.587561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:21.587577Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:21.587599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:21.587852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:21.587869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:21.587892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:21.588011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2532 partition: 0 MaxSeqNo: 42 sessionId: src_id|ed799ba5-e2abef79-f330ca30-7502b5f9_0
2025-09-30T14:57:21.588390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c55c438f-c5003860-27ae91b2-3914953f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ed799ba5-e2abef79-f330ca30-7502b5f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:21.591274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed799ba5-e2abef79-f330ca30-7502b5f9_0] Write session: try to update token
2025-09-30T14:57:21.591294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed799ba5-e2abef79-f330ca30-7502b5f9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:21.613462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2532 sessionId: src_id|ed799ba5-e2abef79-f330ca30-7502b5f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:21.613658Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:21.613675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:21.613685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896482698849484:11583]
2025-09-30T14:57:21.613727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:21.613758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:21.613907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:21.614080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:21.614228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:21.614376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:21.614576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:21.614624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:21.616307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:21.616557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:21.616578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:21.616613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:21.616715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:21.618866Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:21.618887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:21.618891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:21.618893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:21.618905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896482698849484:11583]
2025-09-30T14:57:21.618911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896482698849484:11583]
2025-09-30T14:57:21.618915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896482698849484:11583]
2025-09-30T14:57:21.618966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:21.618967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:21.618973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:21.618977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:21.618981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.618984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:21.619156Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:21.657040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896482788640792:10873]
2025-09-30T14:57:21.657404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2531, pipe: [1:7555896482788640792:10873]
2025-09-30T14:57:21.738802Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:21.750936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:21.750973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:21.751181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:21.751476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:21.751746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:21.751815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:21.752107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:21.752120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:21.752190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:21.752266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:21.752546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:21.752824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:21.752873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:21.752882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:21.752953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:21.753017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:21.753078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:21.753156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:21.753209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:21.753217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:21.753461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:21.754000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:21.754069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:21.754333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:21.754465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:21.754475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:21.754732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:21.754797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:21.754881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:21.754987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:21.755052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:21.755060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:21.755128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:21.755191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:21.755280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:21.755348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:21.755396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:21.755404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:21.755665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:21.755727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:21.755802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:21.755870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:21.755919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:21.755927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:21.756030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:21.756132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:21.756240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:21.756317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:21.756366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:21.756373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:21.756468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:21.756536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:21.756603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:21.756745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:21.756812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:21.756820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:21.756973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:21.757041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:21.757117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:21.757394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:21.757444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:21.757453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:21.757523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896482788640792:10873], now have 1 active actors on pipe
2025-09-30T14:57:21.757736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:21.757781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:21.757794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896482788640792:10873]
2025-09-30T14:57:21.757804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:21.757835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2532 reason: error at write: Disconnected sessionId: src_id|ed799ba5-e2abef79-f330ca30-7502b5f9_0
2025-09-30T14:57:21.758043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2532 sessionId: src_id|ed799ba5-e2abef79-f330ca30-7502b5f9_0 is DEAD
2025-09-30T14:57:21.758205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed799ba5-e2abef79-f330ca30-7502b5f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:21.758214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed799ba5-e2abef79-f330ca30-7502b5f9_0] Write session will restart in 0.009260s
2025-09-30T14:57:21.758238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed799ba5-e2abef79-f330ca30-7502b5f9_0] Write session: Do CDS request
2025-09-30T14:57:21.758243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed799ba5-e2abef79-f330ca30-7502b5f9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:21.758305Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:21.768831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed799ba5-e2abef79-f330ca30-7502b5f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:21.768922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:21.768943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2533
2025-09-30T14:57:21.769463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2533 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:21.769506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2533 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:21.769518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2533 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:21.769528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:21.769606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:21.769925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2533 sessionId:  describe result for acl check
2025-09-30T14:57:21.769958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:21.769961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:21.769963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:21.769969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896482788640881:11057] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:21.770568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896482788640881:11057] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:21.771854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:21.772089Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:21.772094Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:21.772107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:21.772174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:21.772218Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896482698849611:11585]
2025-09-30T14:57:21.772847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:21.773216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:21.773218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896482788640881:11057] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:21.773266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:21.773638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:21.773714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:21.773720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:21.773721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:21.773723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:21.773724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:21.773726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:21.773727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:21.773728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:21.773730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:21.773731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:21.773732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.773734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.773735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.773736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:21.773738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:21.773743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:21.773754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:21.773758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:21.773762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:21.773766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:21.773770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:21.773774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:21.773778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:21.773782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:21.773787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:21.773791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.773795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.773799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.773804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:21.773808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:21.773816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:21.773825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:21.773831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:21.773836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:21.773841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:21.773847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:21.773852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:21.773857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:21.773862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:21.773868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:21.773872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:21.773877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:21.773883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:21.773888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:21.773898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:21.773903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:21.773908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:21.773914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:21.773923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:21.773931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:21.773935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.773941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.773947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.773956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.773962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.773967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.773972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:21.773983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:21.773988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:21.773994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:21.774038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:21.779213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896482788640881:11057] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:21.779232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896482788640881:11057] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:21.779236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896482788640881:11057] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:21.779261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2533 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:21.779554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:21.780514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:21.780528Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:21.780531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:21.780535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:21.780542Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2532 [2:7555896482698849611:11585]
2025-09-30T14:57:21.780558Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:21.780575Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:21.780578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:21.780581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:21.780583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:21.780599Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:21.780605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:21.780612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:21.780668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.780680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.780681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.780686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:21.780688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:21.780759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:21.780767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.780780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.780795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.780816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:21.780838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896482788640920:11057], now have 1 active actors on pipe
2025-09-30T14:57:21.780842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896482788640797:2454], now have 1 active actors on pipe
2025-09-30T14:57:21.780849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896482698849605:11585]
2025-09-30T14:57:21.780851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896482698849605:11585]
2025-09-30T14:57:21.780853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896482698849605:11585]
2025-09-30T14:57:21.780866Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:21.780869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:21.780874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:21.780876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:21.780885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:21.780899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:21.780861Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2532
2025-09-30T14:57:21.780902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:21.780868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2532
2025-09-30T14:57:21.780935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896482698849605:11585]
2025-09-30T14:57:21.780950Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:21.780964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:21.780969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:21.780974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:21.781016Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|46497ff1-447a0716-7c98a98b-aabd9b5a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:21.781028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:21.781031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:21.781033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:21.781045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:21.781058Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:21.781085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:21.781367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:21.781376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:21.781392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:21.781476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2533 partition: 0 MaxSeqNo: 42 sessionId: src_id|46497ff1-447a0716-7c98a98b-aabd9b5a_0
2025-09-30T14:57:21.781887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed799ba5-e2abef79-f330ca30-7502b5f9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|46497ff1-447a0716-7c98a98b-aabd9b5a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:21.784781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46497ff1-447a0716-7c98a98b-aabd9b5a_0] Write session: try to update token
2025-09-30T14:57:21.784803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46497ff1-447a0716-7c98a98b-aabd9b5a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:21.794424Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:21.794446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:21.794448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:21.794451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:21.794463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896482698849605:11585]
2025-09-30T14:57:21.794467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896482698849605:11585]
2025-09-30T14:57:21.794471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896482698849605:11585]
2025-09-30T14:57:21.794513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:21.794521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.794523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:21.794590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:21.794604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:21.794610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:21.794662Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:21.806941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2533 sessionId: src_id|46497ff1-447a0716-7c98a98b-aabd9b5a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:21.809823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:21.857734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896482788640928:10873]
2025-09-30T14:57:21.858040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2532, pipe: [1:7555896482788640928:10873]
2025-09-30T14:57:21.907993Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:21.908471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:21.908484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:21.908504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896482788640928:10873], now have 1 active actors on pipe
2025-09-30T14:57:21.908730Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:21.908774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:21.908795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896482788640928:10873]
2025-09-30T14:57:21.908823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:21.908841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:21.908903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2533 reason: error at write: Disconnected sessionId: src_id|46497ff1-447a0716-7c98a98b-aabd9b5a_0
2025-09-30T14:57:21.909100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2533 sessionId: src_id|46497ff1-447a0716-7c98a98b-aabd9b5a_0 is DEAD
2025-09-30T14:57:21.909255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46497ff1-447a0716-7c98a98b-aabd9b5a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:21.909265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46497ff1-447a0716-7c98a98b-aabd9b5a_0] Write session will restart in 0.007609s
2025-09-30T14:57:21.909295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46497ff1-447a0716-7c98a98b-aabd9b5a_0] Write session: Do CDS request
2025-09-30T14:57:21.909304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46497ff1-447a0716-7c98a98b-aabd9b5a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:21.917805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46497ff1-447a0716-7c98a98b-aabd9b5a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:21.917912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:21.917932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2534
2025-09-30T14:57:21.918090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2534 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:21.918134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2534 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:21.918143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2534 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:21.918151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:21.918546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2534 sessionId:  describe result for acl check
2025-09-30T14:57:21.918582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:21.918584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:21.918586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:21.918591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896482788640980:11061] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:21.919216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896482788640980:11061] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:21.921200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896482788640980:11061] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:21.921504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:21.923893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:21.924111Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:21.924121Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:21.924131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:21.924183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:21.924204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896482788640980:11061] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:21.924220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896482788640980:11061] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:21.924223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896482788640980:11061] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:21.924232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2534 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:21.924220Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896482698849734:11587]
2025-09-30T14:57:21.924872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:21.925201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:21.925263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:21.925623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:21.925701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:21.925707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:21.925708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:21.925709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:21.925711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:21.925713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:21.925714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:21.925715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:21.925716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:21.925718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:21.925719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.925720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.925722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.925723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:21.925724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:21.925730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:21.925741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:21.925746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:21.925750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:21.925754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:21.925759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:21.925763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:21.925768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:21.925772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:21.925776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:21.925780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.925784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.925789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.925793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:21.925797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:21.925805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:21.925814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:21.925820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:21.925827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:21.925831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:21.925837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:21.925842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:21.925848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:21.925853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:21.925858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:21.925862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:21.925867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:21.925871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:21.925876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:21.925881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:21.925894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:21.925899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:21.925904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:21.925909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:21.925914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:21.925919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.925925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.925929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.925934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.925939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.925949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.925954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:21.925960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:21.925965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:21.925974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:21.926021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:21.931937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:21.932962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:21.932975Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:21.932980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:21.932984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:21.932991Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2533 [2:7555896482698849734:11587]
2025-09-30T14:57:21.933010Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:21.933028Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:21.933039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:21.933042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:21.933045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:21.933063Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:21.933070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:21.933077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:21.933175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.933183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.933186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.933190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:21.933193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:21.933263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:21.933271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.933285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:21.933303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:21.933326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:21.933347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896482698849729:11587]
2025-09-30T14:57:21.933354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896482698849729:11587]
2025-09-30T14:57:21.933357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896482698849729:11587]
2025-09-30T14:57:21.933375Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:21.933405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:21.933426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:21.933430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:21.933434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:21.933441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:21.933443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:21.933465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896482698849729:11587]
2025-09-30T14:57:21.933473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:21.933530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:21.933683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896482788640929:2454], now have 1 active actors on pipe
2025-09-30T14:57:21.933695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896482788641048:11061], now have 1 active actors on pipe
2025-09-30T14:57:21.933825Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2533
2025-09-30T14:57:21.933869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2533
2025-09-30T14:57:21.933996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:21.934005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:21.934034Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7105a09-b7378a65-4b55b21c-ef97084d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:21.934044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:21.934049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:21.934052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:21.934064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:21.934077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:21.934094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:21.934624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:21.934635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:21.934655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:21.937993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2534 partition: 0 MaxSeqNo: 42 sessionId: src_id|e7105a09-b7378a65-4b55b21c-ef97084d_0
2025-09-30T14:57:21.939345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46497ff1-447a0716-7c98a98b-aabd9b5a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e7105a09-b7378a65-4b55b21c-ef97084d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:21.942169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7105a09-b7378a65-4b55b21c-ef97084d_0] Write session: try to update token
2025-09-30T14:57:21.942189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7105a09-b7378a65-4b55b21c-ef97084d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:21.946852Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:21.946871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:21.946874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:21.946876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:21.946886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896482698849729:11587]
2025-09-30T14:57:21.946891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896482698849729:11587]
2025-09-30T14:57:21.946897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896482698849729:11587]
2025-09-30T14:57:21.946936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:21.946941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:21.946943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:21.946945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:21.946947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:21.946952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:21.947089Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:21.967303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2534 sessionId: src_id|e7105a09-b7378a65-4b55b21c-ef97084d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:21.970065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:22.015162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896487083608369:10873]
2025-09-30T14:57:22.015785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2533, pipe: [1:7555896487083608369:10873]
2025-09-30T14:57:22.077887Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:22.078227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:22.078241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:22.078262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896487083608369:10873], now have 1 active actors on pipe
2025-09-30T14:57:22.079232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7105a09-b7378a65-4b55b21c-ef97084d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:22.079268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7105a09-b7378a65-4b55b21c-ef97084d_0] Write session will restart in 0.006996s
2025-09-30T14:57:22.079291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7105a09-b7378a65-4b55b21c-ef97084d_0] Write session: Do CDS request
2025-09-30T14:57:22.079297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7105a09-b7378a65-4b55b21c-ef97084d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:22.079363Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:22.078706Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:22.078763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896487083608369:10873]
2025-09-30T14:57:22.078781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:22.078783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:22.078852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2534 reason: error at write: Disconnected sessionId: src_id|e7105a09-b7378a65-4b55b21c-ef97084d_0
2025-09-30T14:57:22.079019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2534 sessionId: src_id|e7105a09-b7378a65-4b55b21c-ef97084d_0 is DEAD
2025-09-30T14:57:22.090074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7105a09-b7378a65-4b55b21c-ef97084d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:22.091406Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:22.091425Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2535
2025-09-30T14:57:22.091781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2535 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:22.091823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2535 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:22.091829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2535 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:22.091833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:22.092270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2535 sessionId:  describe result for acl check
2025-09-30T14:57:22.092297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:22.092299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:22.092301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:22.092309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896487083608449:11072] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:22.092872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896487083608449:11072] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:22.096787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:22.099159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:22.101201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896487083608449:11072] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:22.099437Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:22.099450Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:22.099462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:22.099555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:22.099598Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896486993817204:11603]
2025-09-30T14:57:22.100175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:22.100478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:22.100509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:22.100764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:22.100806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:22.100807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:22.100808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:22.100809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:22.100809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:22.100810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:22.100811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:22.100812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:22.100813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:22.100813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:22.100814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.100815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.100816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.100817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:22.100818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:22.100821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:22.100828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:22.100831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:22.100834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:22.100836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:22.100839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:22.100841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:22.100843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:22.100846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:22.100849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:22.100851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.100854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.100856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.100858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:22.100860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:22.100865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:22.100870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:22.100874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:22.100878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:22.100882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:22.100886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:22.100888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:22.100892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:22.100895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:22.100898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:22.100901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:22.100905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:22.100910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:22.100916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:22.100919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:22.100924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:22.100928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:22.100933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:22.100937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:22.100943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:22.100948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.100953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.100958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.100964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.100967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.100971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.100973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:22.100976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:22.100979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:22.100982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:22.101010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:22.107510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:22.108523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:22.108539Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:22.108543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:22.108547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:22.108554Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2534 [2:7555896486993817204:11603]
2025-09-30T14:57:22.108570Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:22.108586Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:22.108595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:22.108598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:22.108601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:22.108617Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:22.108629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:22.108636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:22.108704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.108711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.108714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.108718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:22.108720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:22.108943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:22.108952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.108969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.108982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.109005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:22.109025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896486993817198:11603]
2025-09-30T14:57:22.109033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896486993817198:11603]
2025-09-30T14:57:22.109035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896486993817198:11603]
2025-09-30T14:57:22.109049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:22.109067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:22.109085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:22.109109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:22.109147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896486993817198:11603]
2025-09-30T14:57:22.109155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:22.109299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:22.109308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:22.109310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:22.109315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:22.109422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896487083608383:2454], now have 1 active actors on pipe
2025-09-30T14:57:22.109534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896487083608505:11072], now have 1 active actors on pipe
2025-09-30T14:57:22.109589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:22.109600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:22.109624Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0e1bc91-ae2e29da-b3019e2-55e7051a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:22.109638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:22.109647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:22.109649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:22.109659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:22.109675Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:22.109710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:22.109971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:22.109996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:22.110016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:22.110465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7105a09-b7378a65-4b55b21c-ef97084d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f0e1bc91-ae2e29da-b3019e2-55e7051a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:22.108958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896487083608449:11072] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:22.108980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896487083608449:11072] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:22.108983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896487083608449:11072] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:22.108992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2535 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:22.109503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2534
2025-09-30T14:57:22.109532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2534
2025-09-30T14:57:22.110119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2535 partition: 0 MaxSeqNo: 42 sessionId: src_id|f0e1bc91-ae2e29da-b3019e2-55e7051a_0
2025-09-30T14:57:22.113452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0e1bc91-ae2e29da-b3019e2-55e7051a_0] Write session: try to update token
2025-09-30T14:57:22.113474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0e1bc91-ae2e29da-b3019e2-55e7051a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:22.122444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:22.122463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:22.122466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:22.122468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:22.122478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896486993817198:11603]
2025-09-30T14:57:22.122483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896486993817198:11603]
2025-09-30T14:57:22.122489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896486993817198:11603]
2025-09-30T14:57:22.122530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:22.122538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.122542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:22.122555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:22.122571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:22.122575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:22.122778Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:22.130813Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2535 sessionId: src_id|f0e1bc91-ae2e29da-b3019e2-55e7051a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:22.133634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:22.175670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896487083608512:10873]
2025-09-30T14:57:22.175970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2534, pipe: [1:7555896487083608512:10873]
2025-09-30T14:57:22.246475Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:22.246813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:22.246829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:22.246871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896487083608512:10873], now have 1 active actors on pipe
2025-09-30T14:57:22.247660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0e1bc91-ae2e29da-b3019e2-55e7051a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:22.247673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0e1bc91-ae2e29da-b3019e2-55e7051a_0] Write session will restart in 0.009406s
2025-09-30T14:57:22.247172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896487083608512:10873]
2025-09-30T14:57:22.247221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:22.247222Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:22.247699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0e1bc91-ae2e29da-b3019e2-55e7051a_0] Write session: Do CDS request
2025-09-30T14:57:22.247224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:22.247305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2535 reason: error at write: Disconnected sessionId: src_id|f0e1bc91-ae2e29da-b3019e2-55e7051a_0
2025-09-30T14:57:22.247726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0e1bc91-ae2e29da-b3019e2-55e7051a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:22.247495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2535 sessionId: src_id|f0e1bc91-ae2e29da-b3019e2-55e7051a_0 is DEAD
2025-09-30T14:57:22.248704Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:22.258806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0e1bc91-ae2e29da-b3019e2-55e7051a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:22.259000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:22.259021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2536
2025-09-30T14:57:22.259158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2536 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:22.259191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2536 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:22.259201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2536 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:22.259206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:22.259619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2536 sessionId:  describe result for acl check
2025-09-30T14:57:22.259651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:22.259658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:22.259660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:22.259667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896487083608619:11078] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:22.259890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:22.260181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896487083608619:11078] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:22.262014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:22.262206Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:22.262219Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:22.262229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:22.262273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896487083608619:11078] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:22.262303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:22.262344Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896486993817329:11605]
2025-09-30T14:57:22.262989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:22.263378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:22.263431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:22.263775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:22.263846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:22.263852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:22.263853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:22.263855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:22.263856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:22.263857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:22.263858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:22.263859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:22.263861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:22.263862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:22.263863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.263864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.263865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.263866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:22.263867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:22.263873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:22.263882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:22.263886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:22.263890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:22.263893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:22.263897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:22.263900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:22.263904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:22.263907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:22.263911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:22.263915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.263918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.263921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.263926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:22.263930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:22.263938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:22.263946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:22.263953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:22.263960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:22.263965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:22.263971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:22.263976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:22.263982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:22.263987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:22.263993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:22.264005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:22.264011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:22.264020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:22.264025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:22.264029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:22.264033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:22.264038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:22.264043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:22.264050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:22.264054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:22.264058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.264063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.264067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.264072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.264077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.264082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.264085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:22.264090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:22.264101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:22.264106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:22.264155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:22.266132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896487083608619:11078] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:22.266154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896487083608619:11078] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:22.266157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896487083608619:11078] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:22.266168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2536 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:22.270610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:22.271514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:22.271528Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:22.271531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:22.271534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:22.271539Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2535 [2:7555896486993817329:11605]
2025-09-30T14:57:22.271553Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:22.271566Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:22.271568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:22.271571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:22.271573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:22.271589Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:22.271596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:22.271614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:22.271679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.271687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.271689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.271693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:22.271696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:22.271773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:22.271781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.271794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.271811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.271838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:22.271857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896487083608532:2454], now have 1 active actors on pipe
2025-09-30T14:57:22.271861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896487083608657:11078], now have 1 active actors on pipe
2025-09-30T14:57:22.271867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896486993817324:11605]
2025-09-30T14:57:22.271869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896486993817324:11605]
2025-09-30T14:57:22.271872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896486993817324:11605]
2025-09-30T14:57:22.271887Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:22.271900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:22.271903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:22.271907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:22.271910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:22.271918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:22.271922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:22.271957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896486993817324:11605]
2025-09-30T14:57:22.271966Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:22.271969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:22.271934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2535
2025-09-30T14:57:22.272030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2535
2025-09-30T14:57:22.272134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:22.272144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:22.272168Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd4f3f3-4f8716a6-a5185ed-f502125e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:22.272180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:22.272185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:22.272187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:22.272198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:22.272208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:22.272226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:22.272406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:22.272417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:22.272431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:22.272536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2536 partition: 0 MaxSeqNo: 42 sessionId: src_id|dd4f3f3-4f8716a6-a5185ed-f502125e_0
2025-09-30T14:57:22.272929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0e1bc91-ae2e29da-b3019e2-55e7051a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dd4f3f3-4f8716a6-a5185ed-f502125e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:22.276059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd4f3f3-4f8716a6-a5185ed-f502125e_0] Write session: try to update token
2025-09-30T14:57:22.276084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd4f3f3-4f8716a6-a5185ed-f502125e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:22.284902Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:22.284924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:22.284934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896486993817324:11605]
2025-09-30T14:57:22.284987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:22.284989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:22.285190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:22.285363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:22.285537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:22.285702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:22.285930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:22.285980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:22.296108Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:22.296129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:22.296132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:22.296135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:22.296146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896486993817324:11605]
2025-09-30T14:57:22.296150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896486993817324:11605]
2025-09-30T14:57:22.296156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896486993817324:11605]
2025-09-30T14:57:22.296200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:22.296211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.296214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:22.296220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:22.296228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:22.296232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:22.296361Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:22.298997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2536 sessionId: src_id|dd4f3f3-4f8716a6-a5185ed-f502125e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:22.301828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:22.347213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896487083608668:10873]
2025-09-30T14:57:22.347569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2535, pipe: [1:7555896487083608668:10873]
2025-09-30T14:57:22.410723Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:22.411223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:22.411233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:22.411327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896487083608668:10873], now have 1 active actors on pipe
2025-09-30T14:57:22.411572Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:22.411651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:22.411678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:22.411755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2536 reason: error at write: Disconnected sessionId: src_id|dd4f3f3-4f8716a6-a5185ed-f502125e_0
2025-09-30T14:57:22.411967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2536 sessionId: src_id|dd4f3f3-4f8716a6-a5185ed-f502125e_0 is DEAD
2025-09-30T14:57:22.412202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896487083608668:10873]
2025-09-30T14:57:22.412224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:22.412277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd4f3f3-4f8716a6-a5185ed-f502125e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:22.412288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd4f3f3-4f8716a6-a5185ed-f502125e_0] Write session will restart in 0.006891s
2025-09-30T14:57:22.412315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd4f3f3-4f8716a6-a5185ed-f502125e_0] Write session: Do CDS request
2025-09-30T14:57:22.412323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd4f3f3-4f8716a6-a5185ed-f502125e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:22.420843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd4f3f3-4f8716a6-a5185ed-f502125e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:22.420924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:22.420953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2537
2025-09-30T14:57:22.421134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2537 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:22.421171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2537 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:22.421188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2537 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:22.421193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:22.421673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2537 sessionId:  describe result for acl check
2025-09-30T14:57:22.421713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:22.421721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:22.421723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:22.421730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896487083608680:11082] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:22.422344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896487083608680:11082] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:22.424523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896487083608680:11082] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:22.431931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896487083608680:11082] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:22.431950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896487083608680:11082] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:22.431953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896487083608680:11082] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:22.431961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2537 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:22.433162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:22.435002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:22.435197Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:22.435206Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:22.435214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:22.435275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:22.435324Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896486993817456:11607]
2025-09-30T14:57:22.435937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:22.436306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:22.436368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:22.436733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:22.436806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:22.436813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:22.436814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:22.436815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:22.436817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:22.436818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:22.436819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:22.436820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:22.436821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:22.436822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:22.436823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.436824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.436825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.436827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:22.436828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:22.436834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:22.436845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:22.436848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:22.436853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:22.436856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:22.436860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:22.436864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:22.436868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:22.436871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:22.436876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:22.436879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.436882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.436887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.436890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:22.436893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:22.436901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:22.436910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:22.436916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:22.436921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:22.436926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:22.436932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:22.436936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:22.436941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:22.436946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:22.436951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:22.436955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:22.436960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:22.436965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:22.436969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:22.436975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:22.436980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:22.436985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:22.436991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:22.436995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:22.437001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:22.437005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.437011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.437015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.437020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.437026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.437030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.437034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:22.437040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:22.437044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:22.437049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:22.437120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:22.444885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:22.446061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:22.446080Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:22.446082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:22.446086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:22.446092Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2536 [2:7555896486993817456:11607]
2025-09-30T14:57:22.446107Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:22.446121Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:22.446123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:22.446125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:22.446127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:22.446141Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:22.446146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:22.446152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:22.446204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.446211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.446212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.446216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:22.446217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:22.446287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:22.446295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.446310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.446321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.446341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:22.446371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896487083608670:2454], now have 1 active actors on pipe
2025-09-30T14:57:22.446378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896486993817451:11607]
2025-09-30T14:57:22.446380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896486993817451:11607]
2025-09-30T14:57:22.446382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896486993817451:11607]
2025-09-30T14:57:22.446396Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:22.446409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896487083608789:11082], now have 1 active actors on pipe
2025-09-30T14:57:22.446414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:22.446436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:22.446438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:22.446441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:22.446444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:22.446444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:22.446484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896486993817451:11607]
2025-09-30T14:57:22.446492Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:22.446493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:22.446468Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2536
2025-09-30T14:57:22.446470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2536
2025-09-30T14:57:22.446526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:22.446535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:22.446569Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c46a7caf-2924c06b-f978d9a5-8cf26783_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:22.446581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:22.446585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:22.446587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:22.446598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:22.446614Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:22.446634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:22.446822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:22.446831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:22.446845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:22.446952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2537 partition: 0 MaxSeqNo: 42 sessionId: src_id|c46a7caf-2924c06b-f978d9a5-8cf26783_0
2025-09-30T14:57:22.447343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd4f3f3-4f8716a6-a5185ed-f502125e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c46a7caf-2924c06b-f978d9a5-8cf26783_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:22.450319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c46a7caf-2924c06b-f978d9a5-8cf26783_0] Write session: try to update token
2025-09-30T14:57:22.450339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c46a7caf-2924c06b-f978d9a5-8cf26783_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:22.460496Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:22.460514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:22.460518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:22.460520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:22.460532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896486993817451:11607]
2025-09-30T14:57:22.460537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896486993817451:11607]
2025-09-30T14:57:22.460542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896486993817451:11607]
2025-09-30T14:57:22.460584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:22.460591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.460591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:22.460594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:22.460598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:22.460603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:22.460741Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:22.470506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2537 sessionId: src_id|c46a7caf-2924c06b-f978d9a5-8cf26783_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:22.473332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:22.514037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896487083608804:10873]
2025-09-30T14:57:22.515835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2536, pipe: [1:7555896487083608804:10873]
2025-09-30T14:57:22.576788Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:22.577173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:22.577192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:22.577213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896487083608804:10873], now have 1 active actors on pipe
2025-09-30T14:57:22.577447Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:22.577874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896487083608804:10873]
2025-09-30T14:57:22.577926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:22.577945Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:22.577989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2537 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c46a7caf-2924c06b-f978d9a5-8cf26783_0
2025-09-30T14:57:22.578170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2537 sessionId: src_id|c46a7caf-2924c06b-f978d9a5-8cf26783_0 is DEAD
2025-09-30T14:57:22.578332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c46a7caf-2924c06b-f978d9a5-8cf26783_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:22.578343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c46a7caf-2924c06b-f978d9a5-8cf26783_0] Write session will restart in 0.008481s
2025-09-30T14:57:22.578365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c46a7caf-2924c06b-f978d9a5-8cf26783_0] Write session: Do CDS request
2025-09-30T14:57:22.578370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c46a7caf-2924c06b-f978d9a5-8cf26783_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:22.587737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c46a7caf-2924c06b-f978d9a5-8cf26783_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:22.591567Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:22.591589Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2538
2025-09-30T14:57:22.595378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2538 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:22.595436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2538 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:22.595448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2538 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:22.595452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:22.595966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2538 sessionId:  describe result for acl check
2025-09-30T14:57:22.596004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:22.596006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:22.596011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:22.596017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896487083608823:11086] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:22.596606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896487083608823:11086] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:22.599807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896487083608823:11086] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:22.603149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896487083608823:11086] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:22.603170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896487083608823:11086] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:22.603173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896487083608823:11086] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:22.603187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2538 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:22.603112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:22.605981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:22.606195Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:22.606201Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:22.606213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:22.606276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:22.606313Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896486993817585:11610]
2025-09-30T14:57:22.606844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:22.607201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:22.607279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:22.607699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:22.607777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:22.607785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:22.607786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:22.607787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:22.607789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:22.607790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:22.607791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:22.607793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:22.607795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:22.607796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:22.607797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.607799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.607802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.607804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:22.607805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:22.607812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:22.607822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:22.607826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:22.607833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:22.607838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:22.607843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:22.607847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:22.607851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:22.607855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:22.607861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:22.607866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.607870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.607875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.607878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:22.607882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:22.607892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:22.607900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:22.607911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:22.607918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:22.607922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:22.607928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:22.607937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:22.607942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:22.607947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:22.607958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:22.607963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:22.607971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:22.607980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:22.607986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:22.607991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:22.608001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:22.608006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:22.608012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:22.608017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:22.608023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:22.608029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.608039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.608044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.608051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.608061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.608066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.608070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:22.608076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:22.608085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:22.608091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:22.608138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:22.614453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:22.615866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:22.615888Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:22.615892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:22.615897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:22.615904Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2537 [2:7555896486993817585:11610]
2025-09-30T14:57:22.615925Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:22.615945Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:22.615956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:22.615960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:22.615963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:22.615982Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:22.615999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:22.616008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:22.616091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.616106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.616111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.616115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:22.616119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:22.616233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:22.616244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.616261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.616280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.616312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:22.616342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896487083608806:2454], now have 1 active actors on pipe
2025-09-30T14:57:22.616352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896487083608931:11086], now have 1 active actors on pipe
2025-09-30T14:57:22.616360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896486993817579:11610]
2025-09-30T14:57:22.616363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896486993817579:11610]
2025-09-30T14:57:22.616366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896486993817579:11610]
2025-09-30T14:57:22.616384Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:22.616405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:22.616408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:22.616416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:22.616419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:22.616426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:22.616431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:22.616481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896486993817579:11610]
2025-09-30T14:57:22.616504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:22.616632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2537
2025-09-30T14:57:22.616685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2537
2025-09-30T14:57:22.616585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:22.617006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:22.617020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:22.617047Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c5b54ec-65f504bb-3ce549be-be430762_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:22.617068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:22.617077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:22.617080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:22.617106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:22.617124Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:22.617148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:22.618634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:22.618648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:22.618673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:22.618856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2538 partition: 0 MaxSeqNo: 42 sessionId: src_id|3c5b54ec-65f504bb-3ce549be-be430762_0
2025-09-30T14:57:22.619761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c46a7caf-2924c06b-f978d9a5-8cf26783_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3c5b54ec-65f504bb-3ce549be-be430762_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:22.622642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c5b54ec-65f504bb-3ce549be-be430762_0] Write session: try to update token
2025-09-30T14:57:22.622660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c5b54ec-65f504bb-3ce549be-be430762_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:22.630633Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:22.630654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:22.630656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:22.630658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:22.630667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896486993817579:11610]
2025-09-30T14:57:22.630672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896486993817579:11610]
2025-09-30T14:57:22.630681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896486993817579:11610]
2025-09-30T14:57:22.630725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:22.630738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.630741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:22.630745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:22.630764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:22.630787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:22.631052Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:22.646068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2538 sessionId: src_id|3c5b54ec-65f504bb-3ce549be-be430762_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:22.649028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:22.677919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896487083608942:10873]
2025-09-30T14:57:22.678219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2537, pipe: [1:7555896487083608942:10873]
2025-09-30T14:57:22.755577Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:22.755941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:22.755959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:22.755979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896487083608942:10873], now have 1 active actors on pipe
2025-09-30T14:57:22.756391Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:22.756571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:22.756630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896487083608942:10873]
2025-09-30T14:57:22.756650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:22.756652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:22.756709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2538 reason: error at write: Disconnected sessionId: src_id|3c5b54ec-65f504bb-3ce549be-be430762_0
2025-09-30T14:57:22.757593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c5b54ec-65f504bb-3ce549be-be430762_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:22.757605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c5b54ec-65f504bb-3ce549be-be430762_0] Write session will restart in 0.006791s
2025-09-30T14:57:22.757641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c5b54ec-65f504bb-3ce549be-be430762_0] Write session: Do CDS request
2025-09-30T14:57:22.757647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c5b54ec-65f504bb-3ce549be-be430762_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:22.756879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2538 sessionId: src_id|3c5b54ec-65f504bb-3ce549be-be430762_0 is DEAD
2025-09-30T14:57:22.765806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c5b54ec-65f504bb-3ce549be-be430762_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:22.765984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:22.766006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2539
2025-09-30T14:57:22.766240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2539 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:22.766294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2539 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:22.766305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2539 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:22.766311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:22.766943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2539 sessionId:  describe result for acl check
2025-09-30T14:57:22.766992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:22.766994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:22.766996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:22.767006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896487083608971:11091] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:22.767634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896487083608971:11091] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:22.770501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896487083608971:11091] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:22.774723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896487083608971:11091] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:22.774744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896487083608971:11091] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:22.774748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896487083608971:11091] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:22.774757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2539 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:22.774723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:22.777231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:22.777477Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:22.777482Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:22.777494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:22.777550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:22.777587Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896486993817713:11612]
2025-09-30T14:57:22.778259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:22.778633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:22.778693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:22.779032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:22.779084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:22.779085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:22.779087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:22.779088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:22.779089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:22.779091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:22.779092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:22.779094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:22.779095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:22.779096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:22.779098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.779099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.779100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.779102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:22.779103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:22.779109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:22.779120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:22.779126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:22.779131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:22.779135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:22.779140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:22.779145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:22.779149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:22.779154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:22.779159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:22.779163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.779168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.779172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.779177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:22.779182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:22.779189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:22.779198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:22.779204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:22.779210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:22.779216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:22.779222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:22.779227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:22.779234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:22.779239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:22.779262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:22.779267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:22.779276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:22.779282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:22.779288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:22.779293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:22.779298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:22.779303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:22.779309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:22.779313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:22.779319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:22.779327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.779333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.779338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.779344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.779349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.779355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.779360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:22.779366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:22.779371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:22.779377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:22.779424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:22.789303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:22.790378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:22.790398Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:22.790402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:22.790406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:22.790415Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2538 [2:7555896486993817713:11612]
2025-09-30T14:57:22.790433Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:22.790451Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:22.790461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:22.790464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:22.790466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:22.790483Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:22.790490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:22.790498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:22.790567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.790575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.790578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.790581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:22.790584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:22.790656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:22.790664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.790681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.790697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.790720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:22.790740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896486993817707:11612]
2025-09-30T14:57:22.790749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896486993817707:11612]
2025-09-30T14:57:22.790754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896486993817707:11612]
2025-09-30T14:57:22.790766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:22.790775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:22.790780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:22.790782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:22.790787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:22.790800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:22.790808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:22.790818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896487083609070:11091], now have 1 active actors on pipe
2025-09-30T14:57:22.790826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896487083608946:2454], now have 1 active actors on pipe
2025-09-30T14:57:22.790877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896486993817707:11612]
2025-09-30T14:57:22.790893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:22.791029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:22.791188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2538
2025-09-30T14:57:22.791235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2538
2025-09-30T14:57:22.791462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:22.791480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:22.791519Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5361767c-ee54d0c0-50e02626-357ae2cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:22.791533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:22.791537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:22.791540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:22.791552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:22.791564Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:22.791582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:22.791796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:22.791805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:22.791819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:22.791930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2539 partition: 0 MaxSeqNo: 42 sessionId: src_id|5361767c-ee54d0c0-50e02626-357ae2cf_0
2025-09-30T14:57:22.792748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c5b54ec-65f504bb-3ce549be-be430762_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5361767c-ee54d0c0-50e02626-357ae2cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:22.795637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5361767c-ee54d0c0-50e02626-357ae2cf_0] Write session: try to update token
2025-09-30T14:57:22.795658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5361767c-ee54d0c0-50e02626-357ae2cf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:22.809989Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:22.810012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:22.810022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896486993817707:11612]
2025-09-30T14:57:22.810067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:22.810240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:22.810392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:22.810524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:22.810655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:22.810849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:22.810883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:22.811263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:22.825733Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:22.825752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:22.825754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:22.825757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:22.825767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896486993817707:11612]
2025-09-30T14:57:22.825772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896486993817707:11612]
2025-09-30T14:57:22.825776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896486993817707:11612]
2025-09-30T14:57:22.825818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:22.825829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.825831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:22.825831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:22.825839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:22.825842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:22.826019Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:22.821638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2539 sessionId: src_id|5361767c-ee54d0c0-50e02626-357ae2cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:22.825711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:22.856187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896487083609084:10873]
2025-09-30T14:57:22.856529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2538, pipe: [1:7555896487083609084:10873]
2025-09-30T14:57:22.938456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:22.938480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:22.938508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896487083609084:10873]
2025-09-30T14:57:22.938526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:22.939055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5361767c-ee54d0c0-50e02626-357ae2cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:22.939070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5361767c-ee54d0c0-50e02626-357ae2cf_0] Write session will restart in 0.009017s
2025-09-30T14:57:22.938548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2539 reason: error at write: Disconnected sessionId: src_id|5361767c-ee54d0c0-50e02626-357ae2cf_0
2025-09-30T14:57:22.938728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2539 sessionId: src_id|5361767c-ee54d0c0-50e02626-357ae2cf_0 is DEAD
2025-09-30T14:57:22.939086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5361767c-ee54d0c0-50e02626-357ae2cf_0] Write session: Do CDS request
2025-09-30T14:57:22.939103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5361767c-ee54d0c0-50e02626-357ae2cf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:22.937791Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:22.938076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:22.938085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:22.938102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896487083609084:10873], now have 1 active actors on pipe
2025-09-30T14:57:22.938533Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:22.948830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5361767c-ee54d0c0-50e02626-357ae2cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:22.951407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:22.951427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2540
2025-09-30T14:57:22.955391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2540 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:22.955446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2540 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:22.955452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2540 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:22.955456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:22.955859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2540 sessionId:  describe result for acl check
2025-09-30T14:57:22.955893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:22.955895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:22.955899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:22.955905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896487083609105:11095] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:22.956428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896487083609105:11095] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:22.959458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896487083609105:11095] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:22.963570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896487083609105:11095] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:22.963594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896487083609105:11095] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:22.963598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896487083609105:11095] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:22.963606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2540 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:22.964649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:22.966491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:22.966681Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:22.966685Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:22.966696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:22.966747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:22.966781Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896486993817842:11614]
2025-09-30T14:57:22.967457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:22.968936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:22.968990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:22.969256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:22.969295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:22.969296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:22.969297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:22.969298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:22.969299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:22.969300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:22.969301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:22.969301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:22.969302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:22.969303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:22.969303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.969304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.969305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.969305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:22.969306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:22.969311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:22.969317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:22.969320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:22.969322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:22.969325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:22.969327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:22.969330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:22.969332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:22.969334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:22.969337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:22.969340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.969344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.969347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.969351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:22.969355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:22.969364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:22.969372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:22.969378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:22.969382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:22.969384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:22.969387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:22.969390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:22.969394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:22.969397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:22.969400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:22.969402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:22.969405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:22.969409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:22.969412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:22.969415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:22.969417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:22.969420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:22.969423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:22.969425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:22.969428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:22.969431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.969434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.969437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.969440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.969442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.969445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.969448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:22.969450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:22.969454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:22.969457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:22.969483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:22.974926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:22.976026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:22.976043Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:22.976046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:22.976050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:22.976056Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2539 [2:7555896486993817842:11614]
2025-09-30T14:57:22.976075Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:22.976090Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:22.976100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:22.976103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:22.976106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:22.976121Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:22.976131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:22.976137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:22.976197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.976203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.976206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.976210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:22.976212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:22.976283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:22.976291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:22.976303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:22.976314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:22.976330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:22.976348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896487083609086:2454], now have 1 active actors on pipe
2025-09-30T14:57:22.976356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896487083609209:11095], now have 1 active actors on pipe
2025-09-30T14:57:22.976362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896486993817836:11614]
2025-09-30T14:57:22.976365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896486993817836:11614]
2025-09-30T14:57:22.976367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896486993817836:11614]
2025-09-30T14:57:22.976378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:22.976389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:22.976391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:22.976393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:22.976397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:22.976410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:22.976417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:22.976448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896486993817836:11614]
2025-09-30T14:57:22.976458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:22.976463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:22.976615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2539
2025-09-30T14:57:22.976625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2539
2025-09-30T14:57:22.976677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:22.976691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:22.976725Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e85d409-f37dff96-b2e0ef55-5d703c76_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:22.976737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:22.976741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:22.976744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:22.976755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:22.976781Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:22.976796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:22.977002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:22.977012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:22.977026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:22.977123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2540 partition: 0 MaxSeqNo: 42 sessionId: src_id|2e85d409-f37dff96-b2e0ef55-5d703c76_0
2025-09-30T14:57:22.977551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5361767c-ee54d0c0-50e02626-357ae2cf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2e85d409-f37dff96-b2e0ef55-5d703c76_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:22.980472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e85d409-f37dff96-b2e0ef55-5d703c76_0] Write session: try to update token
2025-09-30T14:57:22.980492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e85d409-f37dff96-b2e0ef55-5d703c76_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:22.988736Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:22.988756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:22.988766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896486993817836:11614]
2025-09-30T14:57:22.988814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:22.988829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:22.989003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:22.989194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:22.989386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:22.989537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:22.989749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:22.989795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:22.999301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2540 sessionId: src_id|2e85d409-f37dff96-b2e0ef55-5d703c76_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:23.002332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:23.000572Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:23.000592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:23.000594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:23.000600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:23.000690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896486993817836:11614]
2025-09-30T14:57:23.000696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896486993817836:11614]
2025-09-30T14:57:23.000701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896486993817836:11614]
2025-09-30T14:57:23.000744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:23.000744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:23.000751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:23.000755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.000757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:23.000759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:23.000910Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:23.038899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896491378576520:10873]
2025-09-30T14:57:23.039261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2539, pipe: [1:7555896491378576520:10873]
2025-09-30T14:57:23.116833Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:23.116877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:23.116879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:23.116932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2540 reason: error at write: Disconnected sessionId: src_id|2e85d409-f37dff96-b2e0ef55-5d703c76_0
2025-09-30T14:57:23.117036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2540 sessionId: src_id|2e85d409-f37dff96-b2e0ef55-5d703c76_0 is DEAD
2025-09-30T14:57:23.117181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896491378576520:10873]
2025-09-30T14:57:23.116309Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:23.116612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:23.116622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:23.116642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896491378576520:10873], now have 1 active actors on pipe
2025-09-30T14:57:23.116859Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:23.118164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e85d409-f37dff96-b2e0ef55-5d703c76_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:23.118178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e85d409-f37dff96-b2e0ef55-5d703c76_0] Write session will restart in 0.007260s
2025-09-30T14:57:23.118202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e85d409-f37dff96-b2e0ef55-5d703c76_0] Write session: Do CDS request
2025-09-30T14:57:23.118208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e85d409-f37dff96-b2e0ef55-5d703c76_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:23.126760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e85d409-f37dff96-b2e0ef55-5d703c76_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:23.126852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:23.126870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2541
2025-09-30T14:57:23.127262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2541 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:23.127315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2541 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:23.127322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2541 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:23.127326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:23.127829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2541 sessionId:  describe result for acl check
2025-09-30T14:57:23.127866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:23.127872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:23.127875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:23.127880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896491378576564:11108] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:23.128403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896491378576564:11108] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:23.130467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896491378576564:11108] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:23.134343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896491378576564:11108] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:23.134362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896491378576564:11108] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:23.134365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896491378576564:11108] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:23.134374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2541 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:23.139524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:23.141630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:23.141847Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:23.141862Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:23.141874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:23.141925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:23.141966Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896491288785318:11630]
2025-09-30T14:57:23.142675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:23.143145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:23.143207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:23.143567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:23.143644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:23.143650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:23.143652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:23.143653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:23.143654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:23.143655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:23.143656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:23.143657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:23.143659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:23.143660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:23.143661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.143662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:23.143663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:23.143665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:23.143666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:23.143671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:23.143684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:23.143688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:23.143692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:23.143696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:23.143700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:23.143703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:23.143707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:23.143711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:23.143715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:23.143719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.143723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:23.143726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:23.143729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:23.143733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:23.143740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:23.143747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:23.143753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:23.143758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:23.143762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:23.143768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:23.143773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:23.143778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:23.143782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:23.143787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:23.143791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:23.143796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:23.143801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:23.143807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:23.143812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:23.143816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:23.143820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:23.143825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:23.143829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:23.143834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:23.143839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.143845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.143851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:23.143860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:23.143865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:23.143869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:23.143873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:23.143880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:23.143885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:23.143890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:23.143931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:23.150510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:23.151803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:23.151825Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:23.151827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:23.151832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:23.151838Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2540 [2:7555896491288785318:11630]
2025-09-30T14:57:23.151855Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:23.151870Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:23.151873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:23.151876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:23.151879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:23.151894Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:23.151901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:23.151909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:23.151976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.151991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:23.151992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:23.151995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:23.151998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:23.152069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:23.152077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.152090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:23.152107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:23.152123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:23.152146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896491378576622:11108], now have 1 active actors on pipe
2025-09-30T14:57:23.152158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896491378576543:2454], now have 1 active actors on pipe
2025-09-30T14:57:23.152165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896491288785313:11630]
2025-09-30T14:57:23.152167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896491288785313:11630]
2025-09-30T14:57:23.152170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896491288785313:11630]
2025-09-30T14:57:23.152188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:23.152202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:23.152213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:23.152216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:23.152216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:23.152218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:23.152219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:23.152254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896491288785313:11630]
2025-09-30T14:57:23.152269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:23.152242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2540
2025-09-30T14:57:23.152279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2540
2025-09-30T14:57:23.152285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:23.152453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:23.152464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:23.152492Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52c07137-b6e1e740-27461194-9c99849_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:23.152504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:23.152511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:23.152517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:23.152527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:23.152541Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:23.152556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:23.152789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:23.152796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:23.152810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:23.152914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2541 partition: 0 MaxSeqNo: 42 sessionId: src_id|52c07137-b6e1e740-27461194-9c99849_0
2025-09-30T14:57:23.153335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e85d409-f37dff96-b2e0ef55-5d703c76_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|52c07137-b6e1e740-27461194-9c99849_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:23.156225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52c07137-b6e1e740-27461194-9c99849_0] Write session: try to update token
2025-09-30T14:57:23.156245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52c07137-b6e1e740-27461194-9c99849_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:23.165625Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:23.165650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:23.165653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:23.165656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:23.165667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896491288785313:11630]
2025-09-30T14:57:23.165671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896491288785313:11630]
2025-09-30T14:57:23.165676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896491288785313:11630]
2025-09-30T14:57:23.165723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:23.165730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.165733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:23.165737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:23.165745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:23.165749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:23.165883Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:23.176817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2541 sessionId: src_id|52c07137-b6e1e740-27461194-9c99849_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:23.179879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:23.219377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896491378576699:10873]
2025-09-30T14:57:23.219805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2540, pipe: [1:7555896491378576699:10873]
2025-09-30T14:57:23.288237Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:23.288623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:23.288634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:23.288664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896491378576699:10873], now have 1 active actors on pipe
2025-09-30T14:57:23.289071Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:23.288975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:23.288984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896491378576699:10873]
2025-09-30T14:57:23.288994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:23.289005Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:23.289063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2541 reason: error at write: Disconnected sessionId: src_id|52c07137-b6e1e740-27461194-9c99849_0
2025-09-30T14:57:23.289263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2541 sessionId: src_id|52c07137-b6e1e740-27461194-9c99849_0 is DEAD
2025-09-30T14:57:23.289685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52c07137-b6e1e740-27461194-9c99849_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:23.289696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52c07137-b6e1e740-27461194-9c99849_0] Write session will restart in 0.005709s
2025-09-30T14:57:23.289724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52c07137-b6e1e740-27461194-9c99849_0] Write session: Do CDS request
2025-09-30T14:57:23.289733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52c07137-b6e1e740-27461194-9c99849_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:23.296804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52c07137-b6e1e740-27461194-9c99849_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:23.296951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:23.296970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2542
2025-09-30T14:57:23.297258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2542 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:23.297308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2542 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:23.297314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2542 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:23.297318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:23.297729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2542 sessionId:  describe result for acl check
2025-09-30T14:57:23.297758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:23.297761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:23.297763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:23.297770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896491378576715:11114] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:23.298313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896491378576715:11114] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:23.300666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896491378576715:11114] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:23.304251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896491378576715:11114] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:23.304273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896491378576715:11114] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:23.304277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896491378576715:11114] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:23.304285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2542 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:23.307670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:23.309912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:23.310167Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:23.310178Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:23.310189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:23.310245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:23.310290Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896491288785449:11632]
2025-09-30T14:57:23.311008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:23.311997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:23.312070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:23.312489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:23.312550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:23.312551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:23.312553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:23.312554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:23.312555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:23.312557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:23.312559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:23.312560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:23.312562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:23.312563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:23.312565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.312566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:23.312568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:23.312569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:23.312570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:23.312576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:23.312588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:23.312592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:23.312597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:23.312601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:23.312606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:23.312611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:23.312616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:23.312620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:23.312625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:23.312629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.312634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:23.312638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:23.312643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:23.312647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:23.312655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:23.312665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:23.312671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:23.312678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:23.312684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:23.312690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:23.312695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:23.312701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:23.312707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:23.312713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:23.312719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:23.312725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:23.312731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:23.312737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:23.312742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:23.312748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:23.312754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:23.312760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:23.312765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:23.312771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:23.312776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.312784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.312789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:23.312794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:23.312799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:23.312805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:23.312810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:23.312816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:23.312822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:23.312829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:23.312880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:23.318741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:23.320270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2541
2025-09-30T14:57:23.320306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2541
2025-09-30T14:57:23.319842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:23.319859Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:23.319862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:23.319866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:23.319874Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2541 [2:7555896491288785449:11632]
2025-09-30T14:57:23.319891Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:23.319907Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:23.319910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:23.319914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:23.319917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:23.319934Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:23.319942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:23.319949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:23.320013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.320016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:23.320018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:23.320022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:23.320025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:23.320097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:23.320099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.320113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:23.320126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:23.320142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:23.320161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896491378576784:11114], now have 1 active actors on pipe
2025-09-30T14:57:23.320165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896491378576704:2454], now have 1 active actors on pipe
2025-09-30T14:57:23.320171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896491288785444:11632]
2025-09-30T14:57:23.320174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896491288785444:11632]
2025-09-30T14:57:23.320177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896491288785444:11632]
2025-09-30T14:57:23.320190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:23.320204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:23.320205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:23.320209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:23.320211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:23.320221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:23.320225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:23.320258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896491288785444:11632]
2025-09-30T14:57:23.320265Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:23.320272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:23.321801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2542 partition: 0 MaxSeqNo: 42 sessionId: src_id|3a55005b-5cfa680b-39e938e5-cc5cb185_0
2025-09-30T14:57:23.322191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52c07137-b6e1e740-27461194-9c99849_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3a55005b-5cfa680b-39e938e5-cc5cb185_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:23.325296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a55005b-5cfa680b-39e938e5-cc5cb185_0] Write session: try to update token
2025-09-30T14:57:23.325321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a55005b-5cfa680b-39e938e5-cc5cb185_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:23.320751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:23.320767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:23.320797Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a55005b-5cfa680b-39e938e5-cc5cb185_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:23.320806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:23.320810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:23.320813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:23.320827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:23.320838Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:23.320865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:23.321615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:23.321623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:23.321648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:23.333127Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:23.333146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:23.333159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896491288785444:11632]
2025-09-30T14:57:23.333204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:23.333216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:23.333395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:23.333554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:23.333708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:23.333861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:23.334072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:23.334114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:23.348061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2542 sessionId: src_id|3a55005b-5cfa680b-39e938e5-cc5cb185_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:23.351217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:23.349800Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:23.349818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:23.349820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:23.349821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:23.349832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896491288785444:11632]
2025-09-30T14:57:23.349835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896491288785444:11632]
2025-09-30T14:57:23.349838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896491288785444:11632]
2025-09-30T14:57:23.349876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:23.349882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.349883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:23.349897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:23.349905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:23.349910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:23.350054Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:23.388664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896491378576847:10873]
2025-09-30T14:57:23.389049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2541, pipe: [1:7555896491378576847:10873]
2025-09-30T14:57:23.464973Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:23.465460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:23.465472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:23.465494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896491378576847:10873], now have 1 active actors on pipe
2025-09-30T14:57:23.466253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a55005b-5cfa680b-39e938e5-cc5cb185_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:23.466262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a55005b-5cfa680b-39e938e5-cc5cb185_0] Write session will restart in 0.005011s
2025-09-30T14:57:23.466283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a55005b-5cfa680b-39e938e5-cc5cb185_0] Write session: Do CDS request
2025-09-30T14:57:23.466287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a55005b-5cfa680b-39e938e5-cc5cb185_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:23.465811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:23.465829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:23.465904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2542 reason: error at write: Disconnected sessionId: src_id|3a55005b-5cfa680b-39e938e5-cc5cb185_0
2025-09-30T14:57:23.466117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2542 sessionId: src_id|3a55005b-5cfa680b-39e938e5-cc5cb185_0 is DEAD
2025-09-30T14:57:23.466148Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:23.466188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896491378576847:10873]
2025-09-30T14:57:23.465756Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:23.472801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a55005b-5cfa680b-39e938e5-cc5cb185_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:23.473193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:23.473209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2543
2025-09-30T14:57:23.473347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2543 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:23.473394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2543 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:23.473398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2543 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:23.473402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:23.473899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2543 sessionId:  describe result for acl check
2025-09-30T14:57:23.473935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:23.473937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:23.473940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:23.473954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896491378576856:11118] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:23.474507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896491378576856:11118] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:23.479406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896491378576856:11118] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:23.492116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896491378576856:11118] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:23.492138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896491378576856:11118] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:23.492144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896491378576856:11118] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:23.492155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2543 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:23.502116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:23.504276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:23.504508Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:23.504519Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:23.504530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:23.504585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:23.504627Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896491288785581:11634]
2025-09-30T14:57:23.505336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:23.505689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:23.505732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:23.506053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:23.506128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:23.506135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:23.506136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:23.506137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:23.506138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:23.506140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:23.506141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:23.506142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:23.506144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:23.506145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:23.506146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.506147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:23.506148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:23.506149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:23.506150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:23.506155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:23.506166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:23.506170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:23.506174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:23.506179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:23.506183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:23.506187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:23.506190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:23.506194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:23.506198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:23.506201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.506205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:23.506209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:23.506212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:23.506215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:23.506223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:23.506233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:23.506238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:23.506244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:23.506248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:23.506253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:23.506257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:23.506262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:23.506266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:23.506271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:23.506275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:23.506280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:23.506287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:23.506292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:23.506298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:23.506302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:23.506306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:23.506311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:23.506314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:23.506319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:23.506323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.506327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.506337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:23.506342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:23.506346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:23.506355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:23.506359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:23.506364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:23.506367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:23.506372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:23.506414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:23.512353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:23.513431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:23.513445Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:23.513448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:23.513451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:23.513456Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2542 [2:7555896491288785581:11634]
2025-09-30T14:57:23.513469Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:23.513485Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:23.513489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:23.513492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:23.513495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:23.513509Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:23.513517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:23.513525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:23.513588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.513597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:23.513599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:23.513602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:23.513605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:23.513671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:23.513681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.513694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:23.513706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:23.513723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:23.513740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896491378576898:11118], now have 1 active actors on pipe
2025-09-30T14:57:23.513747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896491378576848:2454], now have 1 active actors on pipe
2025-09-30T14:57:23.513752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896491288785576:11634]
2025-09-30T14:57:23.513753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896491288785576:11634]
2025-09-30T14:57:23.513756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896491288785576:11634]
2025-09-30T14:57:23.513770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:23.513786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:23.513791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:23.513795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:23.513797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:23.513804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:23.513808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:23.513846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896491288785576:11634]
2025-09-30T14:57:23.513854Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:23.513831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2542
2025-09-30T14:57:23.513881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:23.513883Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2542
2025-09-30T14:57:23.513894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:23.513898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:23.513925Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55551a3c-4b6c5c3-30d0a1a4-4e636741_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:23.513938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:23.513943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:23.513950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:23.513961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:23.513975Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:23.513999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:23.514156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:23.514170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:23.514195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:23.514332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2543 partition: 0 MaxSeqNo: 42 sessionId: src_id|55551a3c-4b6c5c3-30d0a1a4-4e636741_0
2025-09-30T14:57:23.514708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a55005b-5cfa680b-39e938e5-cc5cb185_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|55551a3c-4b6c5c3-30d0a1a4-4e636741_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:23.517645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55551a3c-4b6c5c3-30d0a1a4-4e636741_0] Write session: try to update token
2025-09-30T14:57:23.517667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55551a3c-4b6c5c3-30d0a1a4-4e636741_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:23.526732Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:23.526749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:23.526752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:23.526754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:23.526764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896491288785576:11634]
2025-09-30T14:57:23.526769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896491288785576:11634]
2025-09-30T14:57:23.526773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896491288785576:11634]
2025-09-30T14:57:23.526812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:23.526819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.526824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:23.526834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:23.526847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:23.526851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:23.526954Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:23.537790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2543 sessionId: src_id|55551a3c-4b6c5c3-30d0a1a4-4e636741_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:23.540879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:23.566288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896491378576990:10873]
2025-09-30T14:57:23.566560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2542, pipe: [1:7555896491378576990:10873]
2025-09-30T14:57:23.644069Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:23.644464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:23.644478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:23.644498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896491378576990:10873], now have 1 active actors on pipe
2025-09-30T14:57:23.644776Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:23.644811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:23.644828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:23.644896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2543 reason: error at write: Disconnected sessionId: src_id|55551a3c-4b6c5c3-30d0a1a4-4e636741_0
2025-09-30T14:57:23.645066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2543 sessionId: src_id|55551a3c-4b6c5c3-30d0a1a4-4e636741_0 is DEAD
2025-09-30T14:57:23.645398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:23.645439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896491378576990:10873]
2025-09-30T14:57:23.647472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55551a3c-4b6c5c3-30d0a1a4-4e636741_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:23.647484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55551a3c-4b6c5c3-30d0a1a4-4e636741_0] Write session will restart in 0.009208s
2025-09-30T14:57:23.647510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55551a3c-4b6c5c3-30d0a1a4-4e636741_0] Write session: Do CDS request
2025-09-30T14:57:23.647516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55551a3c-4b6c5c3-30d0a1a4-4e636741_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:23.655564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:23.657489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:23.657778Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:23.657798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55551a3c-4b6c5c3-30d0a1a4-4e636741_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:23.657789Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:23.657800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:23.657859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:23.657901Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896491288785715:11637]
2025-09-30T14:57:23.657903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:23.657920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2544
2025-09-30T14:57:23.658066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2544 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:23.658108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2544 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:23.658126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2544 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:23.658139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:23.658605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2544 sessionId:  describe result for acl check
2025-09-30T14:57:23.658658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:23.658632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:23.658668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:23.658670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:23.658676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896491378577088:11122] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:23.659049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:23.659124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:23.659530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:23.659604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:23.659613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:23.659614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:23.659616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:23.659617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:23.659618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:23.659619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:23.659620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:23.659622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:23.659623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:23.659625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.659626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:23.659627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:23.659628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:23.659630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:23.659637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:23.659648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:23.659653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:23.659658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:23.659663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:23.659668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:23.659673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:23.659677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:23.659682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:23.659453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896491378577088:11122] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:23.659688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:23.659693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.659697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:23.659702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:23.659706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:23.659711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:23.659719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:23.659728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:23.659736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:23.659743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:23.659749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:23.659755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:23.659760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:23.659766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:23.659772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:23.659778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:23.659790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:23.659796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:23.659802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:23.659808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:23.659813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:23.659819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:23.659829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:23.659836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:23.659846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:23.659852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:23.659857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.659863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.659868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:23.659873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:23.659883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:23.659889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:23.659899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:23.659905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:23.659910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:23.659916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:23.659967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:23.661557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896491378577088:11122] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:23.664950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896491378577088:11122] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:23.664968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896491378577088:11122] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:23.664973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896491378577088:11122] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:23.664982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2544 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:23.665346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:23.666421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:23.666439Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:23.666444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:23.666448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:23.666454Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2543 [2:7555896491288785715:11637]
2025-09-30T14:57:23.666470Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:23.666485Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:23.666488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:23.666491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:23.666493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:23.666510Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:23.666523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:23.666531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:23.666597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.666605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:23.666607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:23.666610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:23.666613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:23.666676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:23.666683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.666696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:23.666713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:23.666733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:23.666757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896491378577126:11122], now have 1 active actors on pipe
2025-09-30T14:57:23.666765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896491378576992:2454], now have 1 active actors on pipe
2025-09-30T14:57:23.666771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896491288785709:11637]
2025-09-30T14:57:23.666773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896491288785709:11637]
2025-09-30T14:57:23.666775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896491288785709:11637]
2025-09-30T14:57:23.666789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:23.666803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:23.666816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:23.666819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:23.666822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:23.666825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:23.666828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:23.666865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896491288785709:11637]
2025-09-30T14:57:23.666875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:23.666877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:23.666891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:23.666895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:23.666817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2543
2025-09-30T14:57:23.666830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2543
2025-09-30T14:57:23.666950Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c62ec55-71ec3b31-faf77020-59a8a62c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:23.666963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:23.666967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:23.666969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:23.666980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:23.667005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:23.667031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:23.667211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:23.667222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:23.667236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:23.667340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2544 partition: 0 MaxSeqNo: 42 sessionId: src_id|5c62ec55-71ec3b31-faf77020-59a8a62c_0
2025-09-30T14:57:23.667760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55551a3c-4b6c5c3-30d0a1a4-4e636741_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5c62ec55-71ec3b31-faf77020-59a8a62c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:23.671170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c62ec55-71ec3b31-faf77020-59a8a62c_0] Write session: try to update token
2025-09-30T14:57:23.671192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c62ec55-71ec3b31-faf77020-59a8a62c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:23.682013Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:23.682039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:23.682041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:23.682043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:23.682054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896491288785709:11637]
2025-09-30T14:57:23.682058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896491288785709:11637]
2025-09-30T14:57:23.682062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896491288785709:11637]
2025-09-30T14:57:23.682114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:23.682122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:23.682129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.682130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:23.682132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:23.682134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:23.682302Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:23.687994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2544 sessionId: src_id|5c62ec55-71ec3b31-faf77020-59a8a62c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:23.690851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:23.745491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896491378577136:10873]
2025-09-30T14:57:23.745874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2543, pipe: [1:7555896491378577136:10873]
2025-09-30T14:57:23.798172Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:23.798574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:23.798592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:23.798634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896491378577136:10873], now have 1 active actors on pipe
2025-09-30T14:57:23.798836Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:23.799430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c62ec55-71ec3b31-faf77020-59a8a62c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:23.799444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c62ec55-71ec3b31-faf77020-59a8a62c_0] Write session will restart in 0.008315s
2025-09-30T14:57:23.799468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c62ec55-71ec3b31-faf77020-59a8a62c_0] Write session: Do CDS request
2025-09-30T14:57:23.799473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c62ec55-71ec3b31-faf77020-59a8a62c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:23.798937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:23.799036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2544 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5c62ec55-71ec3b31-faf77020-59a8a62c_0
2025-09-30T14:57:23.799219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:23.799227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2544 sessionId: src_id|5c62ec55-71ec3b31-faf77020-59a8a62c_0 is DEAD
2025-09-30T14:57:23.799279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896491378577136:10873]
2025-09-30T14:57:23.808817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c62ec55-71ec3b31-faf77020-59a8a62c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:23.809193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:23.809214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2545
2025-09-30T14:57:23.809348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2545 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:23.809380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2545 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:23.809390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2545 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:23.809395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:23.809782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2545 sessionId:  describe result for acl check
2025-09-30T14:57:23.809818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:23.809824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:23.809826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:23.809833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896491378577218:11127] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:23.810390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896491378577218:11127] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:23.811943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:23.812504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896491378577218:11127] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:23.814166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:23.814495Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:23.814508Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:23.814521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:23.814583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:23.814624Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896491288785849:11639]
2025-09-30T14:57:23.815351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:23.815437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896491378577218:11127] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:23.815454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896491378577218:11127] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:23.815458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896491378577218:11127] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:23.815467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2545 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:23.815907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:23.815956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:23.816320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:23.816372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:23.816385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:23.816386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:23.816388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:23.816389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:23.816390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:23.816391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:23.816393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:23.816394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:23.816396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:23.816397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.816398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:23.816399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:23.816401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:23.816402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:23.816408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:23.816419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:23.816426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:23.816431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:23.816436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:23.816441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:23.816445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:23.816449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:23.816453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:23.816458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:23.816462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.816466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:23.816482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:23.816486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:23.816490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:23.816498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:23.816506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:23.816513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:23.816519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:23.816524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:23.816530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:23.816546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:23.816553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:23.816558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:23.816566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:23.816571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:23.816576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:23.816581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:23.816587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:23.816592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:23.816598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:23.816604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:23.816610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:23.816615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:23.816630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:23.816635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.816640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.816644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:23.816649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:23.816654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:23.816659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:23.816677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:23.816683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:23.816689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:23.816694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:23.816743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:23.822534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:23.823541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:23.823547Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:23.823551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:23.823555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:23.823994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2544
2025-09-30T14:57:23.823994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2544
2025-09-30T14:57:23.823562Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2544 [2:7555896491288785849:11639]
2025-09-30T14:57:23.823578Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:23.823595Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:23.823598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:23.823602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:23.823603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:23.823619Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:23.823628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:23.823635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:23.823706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.823708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:23.823710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:23.823713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:23.823716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:23.823792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:23.823795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.823808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:23.823817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:23.823832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:23.823848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896491288785844:11639]
2025-09-30T14:57:23.823851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896491288785844:11639]
2025-09-30T14:57:23.823853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896491288785844:11639]
2025-09-30T14:57:23.823861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:23.823878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:23.823878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:23.823881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:23.823883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:23.823890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:23.823892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:23.823904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896491378577268:11127], now have 1 active actors on pipe
2025-09-30T14:57:23.823907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896491378577137:2454], now have 1 active actors on pipe
2025-09-30T14:57:23.823942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896491288785844:11639]
2025-09-30T14:57:23.823951Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:23.823959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:23.824654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:23.824668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:23.824693Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a97536ab-16440b9a-4b3728aa-e739f949_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:23.824704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:23.824712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:23.824715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:23.824725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:23.824743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:23.824756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:23.825452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2545 partition: 0 MaxSeqNo: 42 sessionId: src_id|a97536ab-16440b9a-4b3728aa-e739f949_0
2025-09-30T14:57:23.825312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:23.825320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:23.825336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:23.825934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c62ec55-71ec3b31-faf77020-59a8a62c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a97536ab-16440b9a-4b3728aa-e739f949_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:23.828808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a97536ab-16440b9a-4b3728aa-e739f949_0] Write session: try to update token
2025-09-30T14:57:23.828828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a97536ab-16440b9a-4b3728aa-e739f949_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:23.844431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2545 sessionId: src_id|a97536ab-16440b9a-4b3728aa-e739f949_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:23.844009Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:23.844028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:23.844030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:23.844032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:23.844044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896491288785844:11639]
2025-09-30T14:57:23.844049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896491288785844:11639]
2025-09-30T14:57:23.844052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896491288785844:11639]
2025-09-30T14:57:23.844091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:23.844097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:23.844101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:23.844102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:23.844110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:23.844115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:23.844281Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:23.847061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:23.900239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896491378577280:10873]
2025-09-30T14:57:23.902218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2544, pipe: [1:7555896491378577280:10873]
2025-09-30T14:57:23.971441Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:23.971844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:23.971870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:23.971918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896491378577280:10873], now have 1 active actors on pipe
2025-09-30T14:57:23.972196Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:23.972250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:23.972268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:23.972345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2545 reason: error at write: Disconnected sessionId: src_id|a97536ab-16440b9a-4b3728aa-e739f949_0
2025-09-30T14:57:23.972516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2545 sessionId: src_id|a97536ab-16440b9a-4b3728aa-e739f949_0 is DEAD
2025-09-30T14:57:23.972674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:23.972708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896491378577280:10873]
2025-09-30T14:57:23.975490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a97536ab-16440b9a-4b3728aa-e739f949_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:23.975502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a97536ab-16440b9a-4b3728aa-e739f949_0] Write session will restart in 0.006833s
2025-09-30T14:57:23.975526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a97536ab-16440b9a-4b3728aa-e739f949_0] Write session: Do CDS request
2025-09-30T14:57:23.975534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a97536ab-16440b9a-4b3728aa-e739f949_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:23.987721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a97536ab-16440b9a-4b3728aa-e739f949_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:23.987816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:23.987834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2546
2025-09-30T14:57:23.987980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2546 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:23.988026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2546 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:23.988032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2546 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:23.988037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:23.988468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2546 sessionId:  describe result for acl check
2025-09-30T14:57:23.988496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:23.988499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:23.988501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:23.988507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896491378577300:11131] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:23.989036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896491378577300:11131] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:23.991765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896491378577300:11131] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:23.996201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:23.996281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896491378577300:11131] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:23.996305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896491378577300:11131] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:23.996309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896491378577300:11131] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:23.996318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2546 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:24.002930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:24.003183Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:24.003193Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:24.003205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:24.003281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:24.003330Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896495583753283:11641]
2025-09-30T14:57:24.003995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:24.007869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:24.007980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:24.008494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:24.008598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:24.008607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:24.008609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:24.008611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:24.008613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:24.008615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:24.008618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:24.008620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:24.008621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:24.008623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:24.008624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.008626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.008628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.008630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:24.008632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:24.008640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:24.008652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:24.008658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:24.008662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:24.008667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:24.008672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:24.008676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:24.008681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:24.008685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:24.008690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:24.008695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.008699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.008703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.008706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:24.008710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:24.008723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:24.008733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:24.008740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:24.008756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:24.008763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:24.008769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:24.008776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:24.008782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:24.008788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:24.008795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:24.008801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:24.008807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:24.008818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:24.008825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:24.008831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:24.008837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:24.008843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:24.008852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:24.008858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:24.008864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:24.008870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.008875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.008884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.008890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.008896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.008902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.008907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:24.008912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:24.008918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:24.008924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:24.008971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:24.020217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:24.021370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:24.021379Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:24.021383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:24.021388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:24.021397Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2545 [2:7555896495583753283:11641]
2025-09-30T14:57:24.021419Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:24.021443Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:24.021447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:24.021451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:24.021455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:24.021478Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:24.021488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:24.021497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:24.021593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.021596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.021600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.021604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:24.021608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:24.021998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:24.022003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.022018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.022033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.022053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:24.022080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896491288785979:11641]
2025-09-30T14:57:24.022083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896491288785979:11641]
2025-09-30T14:57:24.022089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896491288785979:11641]
2025-09-30T14:57:24.022107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:24.022127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:24.022142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:24.022146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:24.022197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896491288785979:11641]
2025-09-30T14:57:24.022200Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:24.023016Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2545
2025-09-30T14:57:24.023021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2545
2025-09-30T14:57:24.022520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:24.022529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:24.022532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:24.022538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:24.022891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896491378577411:11131], now have 1 active actors on pipe
2025-09-30T14:57:24.022901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896491378577284:2454], now have 1 active actors on pipe
2025-09-30T14:57:24.023776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:24.023791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:24.023828Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e02b395d-9aaae9bb-481d4b2a-9ac92576_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:24.023840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:24.023845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:24.023849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:24.023865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:24.023883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:24.023907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:24.024317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:24.024326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:24.024346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:24.024572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2546 partition: 0 MaxSeqNo: 42 sessionId: src_id|e02b395d-9aaae9bb-481d4b2a-9ac92576_0
2025-09-30T14:57:24.025054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a97536ab-16440b9a-4b3728aa-e739f949_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e02b395d-9aaae9bb-481d4b2a-9ac92576_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:24.028055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e02b395d-9aaae9bb-481d4b2a-9ac92576_0] Write session: try to update token
2025-09-30T14:57:24.028077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e02b395d-9aaae9bb-481d4b2a-9ac92576_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:24.036729Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:24.036759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:24.036763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:24.036765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:24.036775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896491288785979:11641]
2025-09-30T14:57:24.036780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896491288785979:11641]
2025-09-30T14:57:24.036785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896491288785979:11641]
2025-09-30T14:57:24.036831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:24.036839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.036843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:24.037007Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:24.039414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:24.039427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:24.039432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:24.045190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2546 sessionId: src_id|e02b395d-9aaae9bb-481d4b2a-9ac92576_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:24.048105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:24.075157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896495673544721:10873]
2025-09-30T14:57:24.075505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2545, pipe: [1:7555896495673544721:10873]
2025-09-30T14:57:24.176887Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:24.177270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:24.177288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:24.177336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896495673544721:10873], now have 1 active actors on pipe
2025-09-30T14:57:24.178437Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:24.183350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896495673544721:10873]
2025-09-30T14:57:24.183406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:24.183524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2546 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e02b395d-9aaae9bb-481d4b2a-9ac92576_0
2025-09-30T14:57:24.183983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2546 sessionId: src_id|e02b395d-9aaae9bb-481d4b2a-9ac92576_0 is DEAD
2025-09-30T14:57:24.184290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:24.186377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e02b395d-9aaae9bb-481d4b2a-9ac92576_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:24.186391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e02b395d-9aaae9bb-481d4b2a-9ac92576_0] Write session will restart in 0.007673s
2025-09-30T14:57:24.186422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e02b395d-9aaae9bb-481d4b2a-9ac92576_0] Write session: Do CDS request
2025-09-30T14:57:24.186429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e02b395d-9aaae9bb-481d4b2a-9ac92576_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:24.198358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e02b395d-9aaae9bb-481d4b2a-9ac92576_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:24.198422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:24.198444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2547
2025-09-30T14:57:24.198612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2547 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:24.198648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2547 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:24.198658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2547 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:24.198662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:24.199388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2547 sessionId:  describe result for acl check
2025-09-30T14:57:24.199440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:24.199443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:24.199447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:24.199453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896495673544827:11143] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:24.199997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896495673544827:11143] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:24.202986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896495673544827:11143] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:24.205749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:24.208522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896495673544827:11143] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:24.208547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896495673544827:11143] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:24.208550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896495673544827:11143] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:24.208560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2547 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:24.208345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:24.208585Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:24.208590Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:24.208602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:24.208661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:24.208696Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896495583753467:11655]
2025-09-30T14:57:24.209152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:24.209561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:24.209625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:24.209980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:24.210078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:24.210079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:24.210080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:24.210081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:24.210082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:24.210083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:24.210084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:24.210085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:24.210086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:24.210088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:24.210089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.210090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.210091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.210092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:24.210093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:24.210100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:24.210112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:24.210116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:24.210119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:24.210123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:24.210127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:24.210130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:24.210134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:24.210137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:24.210142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:24.210145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.210149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.210152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.210156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:24.210160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:24.210170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:24.210177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:24.210182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:24.210187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:24.210191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:24.210196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:24.210199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:24.210204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:24.210208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:24.210213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:24.210216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:24.210221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:24.210224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:24.210229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:24.210233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:24.210238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:24.210242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:24.210249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:24.210254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:24.210260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:24.210266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.210271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.210275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.210279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.210283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.210288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.210292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:24.210296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:24.210300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:24.210304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:24.210345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:24.217006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:24.217963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:24.217969Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:24.217972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:24.217975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:24.217983Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2546 [2:7555896495583753467:11655]
2025-09-30T14:57:24.218000Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:24.218017Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:24.218021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:24.218025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:24.218027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:24.218043Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:24.218050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:24.218057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:24.218125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.218127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.218129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.218730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2546
2025-09-30T14:57:24.218763Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2546
2025-09-30T14:57:24.218132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:24.218135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:24.218211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:24.218214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.218228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.218238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.218255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:24.218272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896495583753462:11655]
2025-09-30T14:57:24.218275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896495583753462:11655]
2025-09-30T14:57:24.218277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896495583753462:11655]
2025-09-30T14:57:24.218286Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:24.218300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:24.218316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:24.218319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:24.218354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896495583753462:11655]
2025-09-30T14:57:24.218357Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:24.218608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:24.218612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:24.218614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:24.218619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:24.218718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896495673544880:11143], now have 1 active actors on pipe
2025-09-30T14:57:24.218722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896495673544741:2454], now have 1 active actors on pipe
2025-09-30T14:57:24.218953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:24.218960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:24.218986Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|250a19ce-7dd33a0f-ab9491c9-a0f21d89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:24.218992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:24.218995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:24.218997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:24.219004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:24.219014Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:24.219025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:24.220643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2547 partition: 0 MaxSeqNo: 42 sessionId: src_id|250a19ce-7dd33a0f-ab9491c9-a0f21d89_0
2025-09-30T14:57:24.221008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e02b395d-9aaae9bb-481d4b2a-9ac92576_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|250a19ce-7dd33a0f-ab9491c9-a0f21d89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:24.220414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:24.220427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:24.220459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:24.224012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|250a19ce-7dd33a0f-ab9491c9-a0f21d89_0] Write session: try to update token
2025-09-30T14:57:24.224030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|250a19ce-7dd33a0f-ab9491c9-a0f21d89_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:24.233179Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:24.233201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:24.233204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:24.233207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:24.233217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896495583753462:11655]
2025-09-30T14:57:24.233226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896495583753462:11655]
2025-09-30T14:57:24.233231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896495583753462:11655]
2025-09-30T14:57:24.233279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:24.233286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.233288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:24.233446Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:24.235472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:24.235487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:24.235492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:24.255532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2547 sessionId: src_id|250a19ce-7dd33a0f-ab9491c9-a0f21d89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:24.258345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:24.283543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896495673544906:10873]
2025-09-30T14:57:24.283873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2546, pipe: [1:7555896495673544906:10873]
2025-09-30T14:57:24.355879Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:24.356296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:24.356308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:24.356331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896495673544906:10873], now have 1 active actors on pipe
2025-09-30T14:57:24.356843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:24.356909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896495673544906:10873]
2025-09-30T14:57:24.356932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:24.356943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:24.357018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2547 reason: error at write: Disconnected sessionId: src_id|250a19ce-7dd33a0f-ab9491c9-a0f21d89_0
2025-09-30T14:57:24.357237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2547 sessionId: src_id|250a19ce-7dd33a0f-ab9491c9-a0f21d89_0 is DEAD
2025-09-30T14:57:24.357508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|250a19ce-7dd33a0f-ab9491c9-a0f21d89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:24.357518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|250a19ce-7dd33a0f-ab9491c9-a0f21d89_0] Write session will restart in 0.006436s
2025-09-30T14:57:24.357544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|250a19ce-7dd33a0f-ab9491c9-a0f21d89_0] Write session: Do CDS request
2025-09-30T14:57:24.357555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|250a19ce-7dd33a0f-ab9491c9-a0f21d89_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:24.357520Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:24.364835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|250a19ce-7dd33a0f-ab9491c9-a0f21d89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:24.365054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:24.365088Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2548
2025-09-30T14:57:24.365236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2548 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:24.365283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2548 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:24.365296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2548 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:24.365302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:24.365792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2548 sessionId:  describe result for acl check
2025-09-30T14:57:24.365837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:24.365840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:24.365845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:24.365862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896495673544919:11148] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:24.366449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896495673544919:11148] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:24.369658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896495673544919:11148] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:24.373257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896495673544919:11148] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:24.373279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896495673544919:11148] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:24.373283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896495673544919:11148] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:24.373293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2548 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:24.385559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:24.387854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:24.388124Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:24.388140Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:24.388153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:24.388221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:24.388271Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896495583753605:11659]
2025-09-30T14:57:24.388968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:24.389955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:24.390023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:24.390420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:24.390505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:24.390507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:24.390508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:24.390509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:24.390511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:24.390513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:24.390514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:24.390515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:24.390516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:24.390517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:24.390519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.390520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.390521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.390523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:24.390524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:24.390531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:24.390540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:24.390545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:24.390548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:24.390552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:24.390556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:24.390560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:24.390564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:24.390568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:24.390572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:24.390576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.390580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.390584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.390588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:24.390593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:24.390602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:24.390611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:24.390616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:24.390623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:24.390628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:24.390633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:24.390640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:24.390646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:24.390651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:24.390657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:24.390661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:24.390668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:24.390674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:24.390678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:24.390683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:24.390689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:24.390694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:24.390699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:24.390704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:24.390710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:24.390717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.390722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.390727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.390735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.390740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.390746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.390751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:24.390757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:24.390763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:24.390768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:24.390818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:24.397152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:24.398286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:24.398293Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:24.398296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:24.398300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:24.398308Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2547 [2:7555896495583753605:11659]
2025-09-30T14:57:24.398323Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:24.398339Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:24.398342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:24.398345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:24.398348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:24.398365Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:24.398371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:24.398379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:24.398446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.398448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.398451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.398455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:24.398457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:24.398753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2547
2025-09-30T14:57:24.398802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2547
2025-09-30T14:57:24.398538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:24.398542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.398556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.398570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.398589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:24.398605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896495583753600:11659]
2025-09-30T14:57:24.398609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896495583753600:11659]
2025-09-30T14:57:24.398612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896495583753600:11659]
2025-09-30T14:57:24.398621Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:24.398636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:24.398635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:24.398643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:24.398646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:24.398651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:24.398655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:24.398665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896495673544961:11148], now have 1 active actors on pipe
2025-09-30T14:57:24.398669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896495673544911:2454], now have 1 active actors on pipe
2025-09-30T14:57:24.398705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896495583753600:11659]
2025-09-30T14:57:24.398716Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:24.398961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:24.399108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:24.399120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:24.399149Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90b0d132-7d0f3acf-abb9ed11-9e36df20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:24.399159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:24.399163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:24.399165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:24.399176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:24.399186Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:24.399201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:24.402896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:24.402917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:24.402950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:24.403192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2548 partition: 0 MaxSeqNo: 42 sessionId: src_id|90b0d132-7d0f3acf-abb9ed11-9e36df20_0
2025-09-30T14:57:24.405198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|250a19ce-7dd33a0f-ab9491c9-a0f21d89_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|90b0d132-7d0f3acf-abb9ed11-9e36df20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:24.408241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90b0d132-7d0f3acf-abb9ed11-9e36df20_0] Write session: try to update token
2025-09-30T14:57:24.408266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90b0d132-7d0f3acf-abb9ed11-9e36df20_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:24.421516Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:24.421541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:24.421544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:24.421546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:24.421557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896495583753600:11659]
2025-09-30T14:57:24.421562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896495583753600:11659]
2025-09-30T14:57:24.421566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896495583753600:11659]
2025-09-30T14:57:24.421619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:24.421627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.421630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:24.421627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:24.421635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:24.421640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:24.422009Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:24.444194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2548 sessionId: src_id|90b0d132-7d0f3acf-abb9ed11-9e36df20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:24.447080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:24.457364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896495673545057:10873]
2025-09-30T14:57:24.460162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2547, pipe: [1:7555896495673545057:10873]
2025-09-30T14:57:24.545880Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:24.546305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:24.546315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:24.546335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896495673545057:10873], now have 1 active actors on pipe
2025-09-30T14:57:24.547679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896495673545057:10873]
2025-09-30T14:57:24.547713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:24.547716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:24.547776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2548 reason: error at write: Disconnected sessionId: src_id|90b0d132-7d0f3acf-abb9ed11-9e36df20_0
2025-09-30T14:57:24.547969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2548 sessionId: src_id|90b0d132-7d0f3acf-abb9ed11-9e36df20_0 is DEAD
2025-09-30T14:57:24.548153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:24.547691Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:24.551560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90b0d132-7d0f3acf-abb9ed11-9e36df20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:24.551573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90b0d132-7d0f3acf-abb9ed11-9e36df20_0] Write session will restart in 0.009908s
2025-09-30T14:57:24.551597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90b0d132-7d0f3acf-abb9ed11-9e36df20_0] Write session: Do CDS request
2025-09-30T14:57:24.551607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90b0d132-7d0f3acf-abb9ed11-9e36df20_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:24.569005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90b0d132-7d0f3acf-abb9ed11-9e36df20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:24.569500Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:24.569517Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2549
2025-09-30T14:57:24.569684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2549 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:24.569726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2549 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:24.569732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2549 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:24.569736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:24.570374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2549 sessionId:  describe result for acl check
2025-09-30T14:57:24.570408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:24.570410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:24.570412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:24.570417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896495673545076:11152] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:24.570952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896495673545076:11152] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:24.582244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896495673545076:11152] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:24.592634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:24.595288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:24.595495Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:24.595510Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:24.595521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:24.595579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:24.595615Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896495583753745:11662]
2025-09-30T14:57:24.596287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:24.595536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896495673545076:11152] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:24.595551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896495673545076:11152] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:24.595554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896495673545076:11152] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:24.595562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2549 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:24.596654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:24.596707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:24.597056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:24.597146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:24.597147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:24.597148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:24.597150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:24.597151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:24.597152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:24.597154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:24.597155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:24.597156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:24.597157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:24.597159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.597160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.597161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.597162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:24.597164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:24.597170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:24.597181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:24.597186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:24.597190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:24.597195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:24.597200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:24.597205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:24.597209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:24.597214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:24.597219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:24.597223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.597227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.597230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.597234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:24.597238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:24.597245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:24.597253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:24.597260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:24.597267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:24.597272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:24.597278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:24.597282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:24.597289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:24.597295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:24.597300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:24.597305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:24.597310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:24.597315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:24.597321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:24.597325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:24.597331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:24.597336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:24.597342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:24.597346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:24.597352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:24.597357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.597362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.597367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.597372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.597377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.597383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.597389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:24.597394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:24.597401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:24.597407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:24.597451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:24.604745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:24.605679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:24.605686Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:24.605690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:24.605694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:24.605702Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2548 [2:7555896495583753745:11662]
2025-09-30T14:57:24.605719Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:24.605735Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:24.605739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:24.605742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:24.605745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:24.605762Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:24.605770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:24.605777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:24.605844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.605847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.605850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.605854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:24.605857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:24.605931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:24.605934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.605949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.605962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.605982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:24.605999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896495583753740:11662]
2025-09-30T14:57:24.606003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896495583753740:11662]
2025-09-30T14:57:24.606005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896495583753740:11662]
2025-09-30T14:57:24.606025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:24.606038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:24.606054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:24.606057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:24.606093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896495583753740:11662]
2025-09-30T14:57:24.606096Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:24.606100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:24.606105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:24.606107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:24.606114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:24.606833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2548
2025-09-30T14:57:24.606868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2548
2025-09-30T14:57:24.607681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896495673545194:11152], now have 1 active actors on pipe
2025-09-30T14:57:24.607701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896495673545060:2454], now have 1 active actors on pipe
2025-09-30T14:57:24.607723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:24.607729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:24.607761Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19f53ecb-b0b50b5b-15a75987-c7700fda_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:24.607778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:24.607788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:24.607791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:24.607803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:24.607822Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:24.607845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:24.611668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:24.611703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:24.611736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:24.615427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2549 partition: 0 MaxSeqNo: 42 sessionId: src_id|19f53ecb-b0b50b5b-15a75987-c7700fda_0
2025-09-30T14:57:24.615827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90b0d132-7d0f3acf-abb9ed11-9e36df20_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|19f53ecb-b0b50b5b-15a75987-c7700fda_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:24.618645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19f53ecb-b0b50b5b-15a75987-c7700fda_0] Write session: try to update token
2025-09-30T14:57:24.618670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19f53ecb-b0b50b5b-15a75987-c7700fda_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:24.624644Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:24.624668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:24.624672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:24.624674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:24.624683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896495583753740:11662]
2025-09-30T14:57:24.624689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896495583753740:11662]
2025-09-30T14:57:24.624693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896495583753740:11662]
2025-09-30T14:57:24.624736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:24.624743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.624746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:24.624751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:24.624758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:24.624763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:24.624931Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:24.642725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2549 sessionId: src_id|19f53ecb-b0b50b5b-15a75987-c7700fda_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:24.645398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:24.647592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896495673545206:10873]
2025-09-30T14:57:24.651312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2548, pipe: [1:7555896495673545206:10873]
2025-09-30T14:57:24.756175Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:24.756511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:24.756529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:24.756572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896495673545206:10873], now have 1 active actors on pipe
2025-09-30T14:57:24.758152Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:24.762923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19f53ecb-b0b50b5b-15a75987-c7700fda_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:24.762955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19f53ecb-b0b50b5b-15a75987-c7700fda_0] Write session will restart in 0.009608s
2025-09-30T14:57:24.762981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19f53ecb-b0b50b5b-15a75987-c7700fda_0] Write session: Do CDS request
2025-09-30T14:57:24.762987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19f53ecb-b0b50b5b-15a75987-c7700fda_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:24.762502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:24.762605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2549 reason: status is not ok: tablet will be restarted right now sessionId: src_id|19f53ecb-b0b50b5b-15a75987-c7700fda_0
2025-09-30T14:57:24.762769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2549 sessionId: src_id|19f53ecb-b0b50b5b-15a75987-c7700fda_0 is DEAD
2025-09-30T14:57:24.763053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:24.763087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896495673545206:10873]
2025-09-30T14:57:24.773818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19f53ecb-b0b50b5b-15a75987-c7700fda_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:24.773882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:24.773901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2550
2025-09-30T14:57:24.774111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2550 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:24.774155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2550 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:24.774166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2550 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:24.774171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:24.774657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2550 sessionId:  describe result for acl check
2025-09-30T14:57:24.774706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:24.774713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:24.774715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:24.774722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896495673545310:11157] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:24.775361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896495673545310:11157] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:24.777771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:24.781034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896495673545310:11157] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:24.781119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:24.781366Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:24.781374Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:24.781386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:24.781446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:24.781486Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896495583753884:11664]
2025-09-30T14:57:24.782157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:24.782500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:24.782558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:24.782921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:24.782995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:24.783002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:24.783003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:24.783004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:24.783005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:24.783006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:24.783008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:24.783009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:24.783010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:24.783012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:24.783013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.783015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.783016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.783017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:24.783018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:24.783024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:24.783034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:24.783037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:24.783041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:24.783044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:24.783048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:24.783052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:24.783056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:24.783060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:24.783064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:24.783068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.783071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.783091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.783095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:24.783099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:24.783108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:24.783117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:24.783123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:24.783129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:24.783133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:24.783138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:24.783142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:24.783148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:24.783153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:24.783169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:24.783179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:24.783184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:24.783188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:24.783192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:24.783196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:24.783200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:24.783220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:24.783229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:24.783233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:24.783238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:24.783273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.783283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.783287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.783291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.783297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.783307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.783311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:24.783316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:24.783325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:24.783331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:24.783380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:24.783519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896495673545310:11157] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:24.783534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896495673545310:11157] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:24.783538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896495673545310:11157] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:24.783546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2550 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:24.789471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:24.790358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:24.790376Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:24.790379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:24.790384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:24.790391Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2549 [2:7555896495583753884:11664]
2025-09-30T14:57:24.790409Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:24.790427Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:24.790436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:24.790440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:24.790442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:24.790458Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:24.790465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:24.790474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:24.790538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.790549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.790551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.790555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:24.790558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:24.790624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:24.790631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.790643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.790657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.790680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:24.790699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896495673545218:2454], now have 1 active actors on pipe
2025-09-30T14:57:24.790703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896495673545346:11157], now have 1 active actors on pipe
2025-09-30T14:57:24.790709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896495583753878:11664]
2025-09-30T14:57:24.790711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896495583753878:11664]
2025-09-30T14:57:24.790713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896495583753878:11664]
2025-09-30T14:57:24.790725Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:24.790740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:24.790743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:24.790746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:24.790747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:24.790762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:24.790767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:24.790824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2549
2025-09-30T14:57:24.790858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2549
2025-09-30T14:57:24.790807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896495583753878:11664]
2025-09-30T14:57:24.790820Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:24.790826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:24.791145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:24.791157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:24.791185Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84578597-b2cd24f2-bd6e412a-2cc2d5c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:24.791198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:24.791201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:24.791203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:24.791214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:24.791224Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:24.791239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:24.791482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:24.791492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:24.791509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:24.791749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2550 partition: 0 MaxSeqNo: 42 sessionId: src_id|84578597-b2cd24f2-bd6e412a-2cc2d5c9_0
2025-09-30T14:57:24.792096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19f53ecb-b0b50b5b-15a75987-c7700fda_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|84578597-b2cd24f2-bd6e412a-2cc2d5c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:24.794897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84578597-b2cd24f2-bd6e412a-2cc2d5c9_0] Write session: try to update token
2025-09-30T14:57:24.794918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84578597-b2cd24f2-bd6e412a-2cc2d5c9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:24.809575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2550 sessionId: src_id|84578597-b2cd24f2-bd6e412a-2cc2d5c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:24.809642Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:24.809661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:24.809669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896495583753878:11664]
2025-09-30T14:57:24.809716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:24.809725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:24.809933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:24.810098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:24.810255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:24.810405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:24.810621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:24.810668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:24.812421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:24.812632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:24.812646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:24.812671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:24.812764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:24.814726Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:24.814743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:24.814746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:24.814748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:24.814756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896495583753878:11664]
2025-09-30T14:57:24.814761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896495583753878:11664]
2025-09-30T14:57:24.814765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896495583753878:11664]
2025-09-30T14:57:24.814798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:24.814812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.814814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:24.814816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:24.814820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:24.814824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:24.814960Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:24.864163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896495673545356:10873]
2025-09-30T14:57:24.864424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2549, pipe: [1:7555896495673545356:10873]
2025-09-30T14:57:24.929663Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:24.938809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:24.942984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896495673545356:10873]
2025-09-30T14:57:24.943017Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:24.943031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:24.943034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:24.943064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2550 reason: error at write: Disconnected sessionId: src_id|84578597-b2cd24f2-bd6e412a-2cc2d5c9_0
2025-09-30T14:57:24.943268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2550 sessionId: src_id|84578597-b2cd24f2-bd6e412a-2cc2d5c9_0 is DEAD
2025-09-30T14:57:24.938915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:24.939128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:24.939193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:24.939286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:24.939356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:24.939407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:24.939413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:24.939496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:24.939559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:24.939628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:24.939706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:24.939758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:24.939761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:24.939848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:24.939919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:24.939992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:24.940066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:24.940117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:24.940124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:24.940207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:24.940276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:24.940344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:24.940443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:24.940490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:24.940497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:24.940576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:24.940650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:24.940768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:24.940840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:24.940889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:24.940892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:24.940973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:24.941042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:24.941131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:24.941194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:24.941252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:24.941254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:24.941327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:24.941391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:24.941450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:24.941505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:24.941546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:24.941548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:24.941620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:24.941674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:24.941730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:24.941795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:24.943422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84578597-b2cd24f2-bd6e412a-2cc2d5c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:24.943441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84578597-b2cd24f2-bd6e412a-2cc2d5c9_0] Write session will restart in 0.007571s
2025-09-30T14:57:24.943473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84578597-b2cd24f2-bd6e412a-2cc2d5c9_0] Write session: Do CDS request
2025-09-30T14:57:24.943479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84578597-b2cd24f2-bd6e412a-2cc2d5c9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:24.941850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:24.941854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:24.941921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:24.941977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:24.942041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:24.942114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:24.942239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:24.942241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:24.942305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:24.942364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:24.942425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:24.942481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:24.942530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:24.942532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:24.942618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896495673545356:10873], now have 1 active actors on pipe
2025-09-30T14:57:24.943997Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:24.951845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84578597-b2cd24f2-bd6e412a-2cc2d5c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:24.952234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:24.952254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2551
2025-09-30T14:57:24.952484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2551 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:24.952532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2551 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:24.952543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2551 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:24.952548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:24.952936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2551 sessionId:  describe result for acl check
2025-09-30T14:57:24.952975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:24.952982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:24.952984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:24.952990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896495673545376:11161] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:24.953759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896495673545376:11161] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:24.957603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896495673545376:11161] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:24.960505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:24.960676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896495673545376:11161] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:24.960693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896495673545376:11161] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:24.960699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896495673545376:11161] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:24.960707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2551 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:24.962722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:24.962925Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:24.962935Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:24.962946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:24.963011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:24.963053Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896495583754025:11666]
2025-09-30T14:57:24.963764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:24.964055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:24.964098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:24.964436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:24.964513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:24.964520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:24.964521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:24.964523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:24.964524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:24.964525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:24.964527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:24.964528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:24.964529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:24.964530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:24.964532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.964533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.964535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.964537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:24.964538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:24.964544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:24.964556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:24.964560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:24.964565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:24.964570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:24.964575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:24.964579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:24.964584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:24.964588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:24.964593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:24.964597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.964601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.964606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.964610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:24.964615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:24.964622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:24.964630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:24.964641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:24.964647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:24.964656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:24.964662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:24.964671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:24.964677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:24.964682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:24.964688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:24.964695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:24.964704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:24.964714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:24.964720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:24.964729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:24.964754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:24.964765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:24.964771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:24.964776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:24.964782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:24.964791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.964801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.964805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.964815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.964824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.964833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.964837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:24.964842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:24.964851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:24.964856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:24.964903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:24.970609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:24.971697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:24.971715Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:24.971718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:24.971723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:24.971730Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2550 [2:7555896495583754025:11666]
2025-09-30T14:57:24.971748Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:24.971772Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:24.971775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:24.971778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:24.971780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:24.971797Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:24.971804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:24.971814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:24.971877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.971886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.971888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.971892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:24.971895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:24.971969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:24.971978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.971992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:24.972003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:24.972022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:24.972046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896495673545496:11161], now have 1 active actors on pipe
2025-09-30T14:57:24.972055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896495673545358:2454], now have 1 active actors on pipe
2025-09-30T14:57:24.972062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896495583754019:11666]
2025-09-30T14:57:24.972067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896495583754019:11666]
2025-09-30T14:57:24.972070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896495583754019:11666]
2025-09-30T14:57:24.972085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:24.972106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:24.972110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:24.972122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:24.972124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:24.972126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:24.972129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:24.972167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896495583754019:11666]
2025-09-30T14:57:24.972175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:24.972185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:24.972127Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2550
2025-09-30T14:57:24.972142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2550
2025-09-30T14:57:24.972210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:24.972221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:24.972253Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb5755a4-54024ae9-fba92ae6-253ab3d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:24.972267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:24.972271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:24.972273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:24.972287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:24.972454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:24.972477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:24.972931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:24.972945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:24.972966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:24.973092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2551 partition: 0 MaxSeqNo: 42 sessionId: src_id|cb5755a4-54024ae9-fba92ae6-253ab3d4_0
2025-09-30T14:57:24.973765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84578597-b2cd24f2-bd6e412a-2cc2d5c9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cb5755a4-54024ae9-fba92ae6-253ab3d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:24.976776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb5755a4-54024ae9-fba92ae6-253ab3d4_0] Write session: try to update token
2025-09-30T14:57:24.976796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb5755a4-54024ae9-fba92ae6-253ab3d4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:24.986439Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:24.986461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:24.986463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:24.986465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:24.986476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896495583754019:11666]
2025-09-30T14:57:24.986480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896495583754019:11666]
2025-09-30T14:57:24.986484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896495583754019:11666]
2025-09-30T14:57:24.986521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:24.986529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:24.986531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:24.986542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:24.986550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:24.986568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:24.986674Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:24.994841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2551 sessionId: src_id|cb5755a4-54024ae9-fba92ae6-253ab3d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:24.997918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:25.043408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896499968512804:10873]
2025-09-30T14:57:25.043728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2550, pipe: [1:7555896499968512804:10873]
2025-09-30T14:57:25.104088Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:25.104439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:25.104450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:25.104482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896499968512804:10873], now have 1 active actors on pipe
2025-09-30T14:57:25.104735Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:25.105817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb5755a4-54024ae9-fba92ae6-253ab3d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:25.105829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb5755a4-54024ae9-fba92ae6-253ab3d4_0] Write session will restart in 0.008984s
2025-09-30T14:57:25.105853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb5755a4-54024ae9-fba92ae6-253ab3d4_0] Write session: Do CDS request
2025-09-30T14:57:25.105859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb5755a4-54024ae9-fba92ae6-253ab3d4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:25.105232Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:25.105281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896499968512804:10873]
2025-09-30T14:57:25.105297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:25.105469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2551 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cb5755a4-54024ae9-fba92ae6-253ab3d4_0
2025-09-30T14:57:25.105662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2551 sessionId: src_id|cb5755a4-54024ae9-fba92ae6-253ab3d4_0 is DEAD
2025-09-30T14:57:25.115745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb5755a4-54024ae9-fba92ae6-253ab3d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:25.115887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:25.115911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2552
2025-09-30T14:57:25.116063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2552 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:25.116102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2552 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:25.116114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2552 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:25.116118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:25.116956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2552 sessionId:  describe result for acl check
2025-09-30T14:57:25.117010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:25.117018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:25.117020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:25.117026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896499968512884:11165] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:25.117602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896499968512884:11165] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:25.120166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896499968512884:11165] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:25.123574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:25.125224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896499968512884:11165] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:25.125244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896499968512884:11165] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:25.125248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896499968512884:11165] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:25.125257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2552 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:25.125168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:25.125429Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:25.125434Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:25.125446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:25.125512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:25.125551Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896499878721475:11670]
2025-09-30T14:57:25.126169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:25.126550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:25.126616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:25.127000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:25.127067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:25.127073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:25.127074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:25.127075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:25.127077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:25.127078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:25.127079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:25.127080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:25.127082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:25.127083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:25.127084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.127085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:25.127087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:25.127088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:25.127089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:25.127095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:25.127105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:25.127109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:25.127114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:25.127118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:25.127132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:25.127136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:25.127140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:25.127145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:25.127150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:25.127154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.127157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:25.127162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:25.127166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:25.127170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:25.127178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:25.127187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:25.127193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:25.127199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:25.127204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:25.127209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:25.127215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:25.127221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:25.127230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:25.127235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:25.127240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:25.127259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:25.127264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:25.127270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:25.127275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:25.127280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:25.127285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:25.127290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:25.127294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:25.127299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:25.127309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.127314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.127323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:25.127327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:25.127331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:25.127336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:25.127341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:25.127352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:25.127357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:25.127362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:25.127408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:25.133001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:25.133932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:25.133938Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:25.133942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:25.133946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:25.133954Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2551 [2:7555896499878721475:11670]
2025-09-30T14:57:25.133973Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:25.133990Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:25.133994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:25.133998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:25.134001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:25.134017Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:25.134024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:25.134032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:25.134101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.134103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:25.134106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:25.134112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:25.134115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:25.134191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:25.134195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.134207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:25.134222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:25.134241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:25.134274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896499968512943:11165], now have 1 active actors on pipe
2025-09-30T14:57:25.134278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896499968512805:2454], now have 1 active actors on pipe
2025-09-30T14:57:25.134285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896499878721470:11670]
2025-09-30T14:57:25.134288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896499878721470:11670]
2025-09-30T14:57:25.134290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896499878721470:11670]
2025-09-30T14:57:25.134304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:25.134318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:25.134324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:25.134327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:25.134331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:25.134335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:25.134338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:25.134371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896499878721470:11670]
2025-09-30T14:57:25.134379Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:25.134383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:25.135012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2551
2025-09-30T14:57:25.135048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2551
2025-09-30T14:57:25.135189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:25.135205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:25.135237Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85d9e60c-c6139535-ea4da974-2d82944c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:25.135258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:25.135262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:25.135265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:25.135276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:25.135289Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:25.135312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:25.135574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:25.135583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:25.135601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:25.135854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2552 partition: 0 MaxSeqNo: 42 sessionId: src_id|85d9e60c-c6139535-ea4da974-2d82944c_0
2025-09-30T14:57:25.136222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb5755a4-54024ae9-fba92ae6-253ab3d4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|85d9e60c-c6139535-ea4da974-2d82944c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:25.139053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85d9e60c-c6139535-ea4da974-2d82944c_0] Write session: try to update token
2025-09-30T14:57:25.139072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85d9e60c-c6139535-ea4da974-2d82944c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:25.149095Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:25.149115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:25.149125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896499878721470:11670]
2025-09-30T14:57:25.149172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:25.149351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:25.149502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:25.149647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:25.149801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:25.150005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:25.150053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:25.150206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:25.161555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2552 sessionId: src_id|85d9e60c-c6139535-ea4da974-2d82944c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:25.161702Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:25.161721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:25.161724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:25.161726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:25.161736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896499878721470:11670]
2025-09-30T14:57:25.161740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896499878721470:11670]
2025-09-30T14:57:25.161744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896499878721470:11670]
2025-09-30T14:57:25.161790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:25.161802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.161808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:25.162005Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:25.163369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:25.163385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:25.163390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:25.164317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:25.204653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896499968512962:10873]
2025-09-30T14:57:25.204973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2551, pipe: [1:7555896499968512962:10873]
2025-09-30T14:57:25.281934Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:25.282275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:25.282297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:25.282320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896499968512962:10873], now have 1 active actors on pipe
2025-09-30T14:57:25.282614Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:25.282593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:25.282611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:25.282676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2552 reason: error at write: Disconnected sessionId: src_id|85d9e60c-c6139535-ea4da974-2d82944c_0
2025-09-30T14:57:25.282869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2552 sessionId: src_id|85d9e60c-c6139535-ea4da974-2d82944c_0 is DEAD
2025-09-30T14:57:25.282908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:25.282952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896499968512962:10873]
2025-09-30T14:57:25.283390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85d9e60c-c6139535-ea4da974-2d82944c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:25.283401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85d9e60c-c6139535-ea4da974-2d82944c_0] Write session will restart in 0.006470s
2025-09-30T14:57:25.283434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85d9e60c-c6139535-ea4da974-2d82944c_0] Write session: Do CDS request
2025-09-30T14:57:25.283443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85d9e60c-c6139535-ea4da974-2d82944c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:25.291689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85d9e60c-c6139535-ea4da974-2d82944c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:25.295728Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:25.295750Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2553
2025-09-30T14:57:25.295926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2553 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:25.295976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2553 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:25.295988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2553 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:25.295992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:25.296422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2553 sessionId:  describe result for acl check
2025-09-30T14:57:25.296460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:25.296464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:25.296466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:25.296474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896499968513015:11178] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:25.297029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896499968513015:11178] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:25.301251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896499968513015:11178] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:25.305645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896499968513015:11178] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:25.305664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896499968513015:11178] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:25.305668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896499968513015:11178] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:25.305676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2553 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:25.307027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:25.309879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:25.310142Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:25.310146Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:25.310157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:25.310225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:25.310265Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896499878721654:11684]
2025-09-30T14:57:25.310985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:25.311383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:25.311443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:25.311836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:25.311918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:25.311919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:25.311921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:25.311922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:25.311924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:25.311926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:25.311927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:25.311929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:25.311931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:25.311932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:25.311933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.311934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:25.311935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:25.311937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:25.311938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:25.311945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:25.311956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:25.311960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:25.311965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:25.311969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:25.311974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:25.311977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:25.311981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:25.311985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:25.311989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:25.311992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.311996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:25.312000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:25.312004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:25.312008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:25.312018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:25.312026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:25.312032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:25.312038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:25.312043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:25.312048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:25.312053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:25.312059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:25.312064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:25.312070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:25.312075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:25.312081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:25.312087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:25.312111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:25.312117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:25.312123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:25.312130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:25.312135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:25.312140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:25.312146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:25.312152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.312159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.312164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:25.312169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:25.312175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:25.312181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:25.312189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:25.312195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:25.312201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:25.312207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:25.312262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:25.320585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:25.321746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:25.321766Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:25.321768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:25.321772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:25.321780Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2552 [2:7555896499878721654:11684]
2025-09-30T14:57:25.321798Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:25.321817Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:25.321822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:25.321825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:25.321827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:25.321845Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:25.321858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:25.321865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:25.322139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.322154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:25.322157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:25.322162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:25.322164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:25.322236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:25.322245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.322259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:25.322275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:25.322296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:25.322322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896499968513131:11178], now have 1 active actors on pipe
2025-09-30T14:57:25.322338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896499878721649:11684]
2025-09-30T14:57:25.322345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896499878721649:11684]
2025-09-30T14:57:25.322347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896499878721649:11684]
2025-09-30T14:57:25.322361Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:25.322376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896499968512999:2454], now have 1 active actors on pipe
2025-09-30T14:57:25.322376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:25.322379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:25.322381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:25.322389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:25.322405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:25.322413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:25.322461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896499878721649:11684]
2025-09-30T14:57:25.322473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:25.322482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:25.322856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:25.322872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:25.322906Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eaaf1be-fc13aa0-ad116d1a-fb6f2080_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:25.322921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:25.322928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:25.322931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:25.322942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:25.322958Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:25.322976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:25.323208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:25.323219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:25.323239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:25.322570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2552
2025-09-30T14:57:25.322611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2552
2025-09-30T14:57:25.323413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2553 partition: 0 MaxSeqNo: 42 sessionId: src_id|eaaf1be-fc13aa0-ad116d1a-fb6f2080_0
2025-09-30T14:57:25.327365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85d9e60c-c6139535-ea4da974-2d82944c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|eaaf1be-fc13aa0-ad116d1a-fb6f2080_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:25.330295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaaf1be-fc13aa0-ad116d1a-fb6f2080_0] Write session: try to update token
2025-09-30T14:57:25.330317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaaf1be-fc13aa0-ad116d1a-fb6f2080_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:25.337687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:25.337709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:25.337719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896499878721649:11684]
2025-09-30T14:57:25.337765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:25.337775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:25.337940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:25.338094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:25.338235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:25.338382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:25.338584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:25.338649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:25.350321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2553 sessionId: src_id|eaaf1be-fc13aa0-ad116d1a-fb6f2080_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:25.353499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:25.352474Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:25.352496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:25.352499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:25.352501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:25.352516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896499878721649:11684]
2025-09-30T14:57:25.352520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896499878721649:11684]
2025-09-30T14:57:25.352525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896499878721649:11684]
2025-09-30T14:57:25.352568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:25.352576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.352578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:25.352588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:25.352595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:25.352600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:25.352719Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:25.383396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896499968513150:10873]
2025-09-30T14:57:25.383688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2552, pipe: [1:7555896499968513150:10873]
2025-09-30T14:57:25.470082Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:25.470554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:25.470569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:25.470588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896499968513150:10873], now have 1 active actors on pipe
2025-09-30T14:57:25.470847Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:25.470877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:25.470907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896499968513150:10873]
2025-09-30T14:57:25.470951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2553 reason: status is not ok: tablet will be restarted right now sessionId: src_id|eaaf1be-fc13aa0-ad116d1a-fb6f2080_0
2025-09-30T14:57:25.471136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2553 sessionId: src_id|eaaf1be-fc13aa0-ad116d1a-fb6f2080_0 is DEAD
2025-09-30T14:57:25.470827Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:25.471494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaaf1be-fc13aa0-ad116d1a-fb6f2080_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:25.471504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaaf1be-fc13aa0-ad116d1a-fb6f2080_0] Write session will restart in 0.008539s
2025-09-30T14:57:25.471528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaaf1be-fc13aa0-ad116d1a-fb6f2080_0] Write session: Do CDS request
2025-09-30T14:57:25.471534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaaf1be-fc13aa0-ad116d1a-fb6f2080_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:25.480793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaaf1be-fc13aa0-ad116d1a-fb6f2080_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:25.480905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:25.480923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2554
2025-09-30T14:57:25.481044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2554 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:25.481101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2554 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:25.481112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2554 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:25.481116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:25.481621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2554 sessionId:  describe result for acl check
2025-09-30T14:57:25.481655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:25.481657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:25.481659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:25.481664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896499968513167:11182] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:25.482217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896499968513167:11182] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:25.484354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896499968513167:11182] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:25.488475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896499968513167:11182] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:25.488494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896499968513167:11182] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:25.488498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896499968513167:11182] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:25.488507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2554 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:25.491988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:25.494495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:25.494708Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:25.494712Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:25.494723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:25.494775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:25.494811Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896499878721797:11686]
2025-09-30T14:57:25.495550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:25.496049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:25.496103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:25.496423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:25.496502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:25.496511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:25.496512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:25.496513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:25.496515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:25.496516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:25.496517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:25.496518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:25.496520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:25.496521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:25.496523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.496524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:25.496525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:25.496526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:25.496528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:25.496533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:25.496556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:25.496560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:25.496563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:25.496566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:25.496570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:25.496573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:25.496576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:25.496579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:25.496583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:25.496586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.496590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:25.496593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:25.496596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:25.496599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:25.496609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:25.496616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:25.496624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:25.496628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:25.496632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:25.496636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:25.496645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:25.496649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:25.496654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:25.496659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:25.496663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:25.496667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:25.496671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:25.496679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:25.496684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:25.496688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:25.496693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:25.496697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:25.496706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:25.496714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:25.496723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.496728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.496733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:25.496737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:25.496742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:25.496747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:25.496751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:25.496756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:25.496761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:25.496766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:25.496813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:25.502512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:25.503330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:25.503346Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:25.503348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:25.503352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:25.503357Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2553 [2:7555896499878721797:11686]
2025-09-30T14:57:25.503370Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:25.503383Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:25.503385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:25.503388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:25.503389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:25.503402Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:25.503408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:25.503416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:25.503484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.503493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:25.503496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:25.503500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:25.503502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:25.503567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:25.503575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.503586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:25.503598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:25.503614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:25.503637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896499968513152:2454], now have 1 active actors on pipe
2025-09-30T14:57:25.503646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896499968513288:11182], now have 1 active actors on pipe
2025-09-30T14:57:25.503653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896499878721791:11686]
2025-09-30T14:57:25.503655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896499878721791:11686]
2025-09-30T14:57:25.503657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896499878721791:11686]
2025-09-30T14:57:25.503670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:25.503678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:25.503681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:25.503683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:25.503689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:25.503703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:25.503711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:25.503693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2553
2025-09-30T14:57:25.503753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896499878721791:11686]
2025-09-30T14:57:25.503746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2553
2025-09-30T14:57:25.503769Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:25.503773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:25.503805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:25.503814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:25.503839Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|895aa1d1-5efc392a-d5ec5a21-b1edb288_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:25.503852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:25.503856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:25.503858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:25.503867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:25.503877Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:25.503889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:25.504008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:25.504015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:25.504028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:25.504117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2554 partition: 0 MaxSeqNo: 42 sessionId: src_id|895aa1d1-5efc392a-d5ec5a21-b1edb288_0
2025-09-30T14:57:25.504471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaaf1be-fc13aa0-ad116d1a-fb6f2080_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|895aa1d1-5efc392a-d5ec5a21-b1edb288_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:25.507118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|895aa1d1-5efc392a-d5ec5a21-b1edb288_0] Write session: try to update token
2025-09-30T14:57:25.507133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|895aa1d1-5efc392a-d5ec5a21-b1edb288_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:25.516466Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:25.516487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:25.516490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:25.516492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:25.516501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896499878721791:11686]
2025-09-30T14:57:25.516506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896499878721791:11686]
2025-09-30T14:57:25.516511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896499878721791:11686]
2025-09-30T14:57:25.516550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:25.516558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.516560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:25.516560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:25.516566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:25.516571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:25.516704Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:25.527220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2554 sessionId: src_id|895aa1d1-5efc392a-d5ec5a21-b1edb288_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:25.530088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:25.571292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896499968513304:10873]
2025-09-30T14:57:25.574120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2553, pipe: [1:7555896499968513304:10873]
2025-09-30T14:57:25.632669Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:25.633271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:25.633287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:25.633308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896499968513304:10873], now have 1 active actors on pipe
2025-09-30T14:57:25.635386Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:25.635461Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:25.635549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896499968513304:10873]
2025-09-30T14:57:25.635575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:25.635578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:25.635652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2554 reason: error at write: Disconnected sessionId: src_id|895aa1d1-5efc392a-d5ec5a21-b1edb288_0
2025-09-30T14:57:25.635859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2554 sessionId: src_id|895aa1d1-5efc392a-d5ec5a21-b1edb288_0 is DEAD
2025-09-30T14:57:25.636282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|895aa1d1-5efc392a-d5ec5a21-b1edb288_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:25.636295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|895aa1d1-5efc392a-d5ec5a21-b1edb288_0] Write session will restart in 0.008143s
2025-09-30T14:57:25.636319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|895aa1d1-5efc392a-d5ec5a21-b1edb288_0] Write session: Do CDS request
2025-09-30T14:57:25.636332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|895aa1d1-5efc392a-d5ec5a21-b1edb288_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:25.645852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|895aa1d1-5efc392a-d5ec5a21-b1edb288_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:25.645985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:25.646005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2555
2025-09-30T14:57:25.646160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2555 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:25.646209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2555 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:25.646214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2555 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:25.646218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:25.646761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2555 sessionId:  describe result for acl check
2025-09-30T14:57:25.646801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:25.646803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:25.646804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:25.646810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896499968513332:11186] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:25.647520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896499968513332:11186] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:25.650731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896499968513332:11186] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:25.657678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896499968513332:11186] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:25.657705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896499968513332:11186] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:25.657709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896499968513332:11186] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:25.657721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2555 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:25.657194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:25.661925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:25.662195Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:25.662200Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:25.662212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:25.662276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:25.662314Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896499878721943:11689]
2025-09-30T14:57:25.663034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:25.663675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:25.663745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:25.664137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:25.664210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:25.664212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:25.664214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:25.664216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:25.664218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:25.664219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:25.664220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:25.664222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:25.664224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:25.664225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:25.664227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.664228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:25.664230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:25.664232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:25.664233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:25.664239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:25.664251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:25.664256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:25.664261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:25.664265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:25.664271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:25.664276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:25.664280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:25.664284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:25.664289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:25.664293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.664298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:25.664303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:25.664308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:25.664312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:25.664321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:25.664329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:25.664335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:25.664340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:25.664347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:25.664352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:25.664356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:25.664361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:25.664366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:25.664372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:25.664376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:25.664382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:25.664387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:25.664392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:25.664397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:25.664402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:25.664408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:25.664413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:25.664418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:25.664426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:25.664432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.664438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.664443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:25.664449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:25.664454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:25.664459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:25.664464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:25.664471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:25.664476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:25.664482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:25.664532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:25.671526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:25.672614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:25.672635Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:25.672638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:25.672642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:25.672649Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2554 [2:7555896499878721943:11689]
2025-09-30T14:57:25.672665Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:25.672681Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:25.672685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:25.672688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:25.672690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:25.672707Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:25.672714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:25.672734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:25.672803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.672810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:25.672812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:25.672816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:25.672818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:25.672888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:25.672895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.672908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:25.672923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:25.672937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:25.672960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896499968513305:2454], now have 1 active actors on pipe
2025-09-30T14:57:25.672967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896499968513444:11186], now have 1 active actors on pipe
2025-09-30T14:57:25.672973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896499878721937:11689]
2025-09-30T14:57:25.672977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896499878721937:11689]
2025-09-30T14:57:25.672979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896499878721937:11689]
2025-09-30T14:57:25.672991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:25.673010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:25.673011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:25.673025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:25.673028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:25.673028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:25.673034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:25.673081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896499878721937:11689]
2025-09-30T14:57:25.673093Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:25.673098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:25.673094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2554
2025-09-30T14:57:25.673145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2554
2025-09-30T14:57:25.673262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:25.673276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:25.673303Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4535d4f-7d43a207-135db87f-2de9cc4c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:25.673317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:25.673322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:25.673329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:25.673340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:25.673356Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:25.673378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:25.673593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:25.673603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:25.673628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:25.673758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2555 partition: 0 MaxSeqNo: 42 sessionId: src_id|b4535d4f-7d43a207-135db87f-2de9cc4c_0
2025-09-30T14:57:25.674104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|895aa1d1-5efc392a-d5ec5a21-b1edb288_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b4535d4f-7d43a207-135db87f-2de9cc4c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:25.677506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4535d4f-7d43a207-135db87f-2de9cc4c_0] Write session: try to update token
2025-09-30T14:57:25.677532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4535d4f-7d43a207-135db87f-2de9cc4c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:25.685711Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:25.685732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:25.685743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896499878721937:11689]
2025-09-30T14:57:25.685786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:25.685788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:25.685968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:25.686127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:25.686284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:25.686442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:25.686769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:25.686818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:25.697051Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:25.697089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:25.697093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:25.697095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:25.697106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896499878721937:11689]
2025-09-30T14:57:25.697112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896499878721937:11689]
2025-09-30T14:57:25.697116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896499878721937:11689]
2025-09-30T14:57:25.697160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:25.697167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.697170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:25.697175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:25.697183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:25.697188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:25.697321Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:25.698265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2555 sessionId: src_id|b4535d4f-7d43a207-135db87f-2de9cc4c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:25.701132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:25.735640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896499968513460:10873]
2025-09-30T14:57:25.735953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2554, pipe: [1:7555896499968513460:10873]
2025-09-30T14:57:25.817320Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:25.817709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:25.817719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:25.817740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896499968513460:10873], now have 1 active actors on pipe
2025-09-30T14:57:25.818376Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:25.818835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4535d4f-7d43a207-135db87f-2de9cc4c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:25.818850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4535d4f-7d43a207-135db87f-2de9cc4c_0] Write session will restart in 0.009279s
2025-09-30T14:57:25.818876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4535d4f-7d43a207-135db87f-2de9cc4c_0] Write session: Do CDS request
2025-09-30T14:57:25.818881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4535d4f-7d43a207-135db87f-2de9cc4c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:25.818386Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:25.818437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:25.818439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:25.818507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2555 reason: error at write: Disconnected sessionId: src_id|b4535d4f-7d43a207-135db87f-2de9cc4c_0
2025-09-30T14:57:25.818659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2555 sessionId: src_id|b4535d4f-7d43a207-135db87f-2de9cc4c_0 is DEAD
2025-09-30T14:57:25.818764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896499968513460:10873]
2025-09-30T14:57:25.829756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4535d4f-7d43a207-135db87f-2de9cc4c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:25.829920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:25.829938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2556
2025-09-30T14:57:25.830086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2556 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:25.830119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2556 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:25.830125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2556 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:25.830136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:25.830552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2556 sessionId:  describe result for acl check
2025-09-30T14:57:25.830585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:25.830591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:25.830593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:25.830599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896499968513496:11191] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:25.831136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896499968513496:11191] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:25.834680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896499968513496:11191] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:25.835568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:25.837959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896499968513496:11191] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:25.837979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896499968513496:11191] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:25.837983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896499968513496:11191] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:25.837991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2556 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:25.837681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:25.837903Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:25.837908Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:25.837921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:25.837986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:25.838024Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896499878722087:11691]
2025-09-30T14:57:25.838676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:25.838991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:25.839049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:25.839399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:25.839482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:25.839483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:25.839484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:25.839486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:25.839487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:25.839488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:25.839490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:25.839491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:25.839492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:25.839494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:25.839495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.839496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:25.839498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:25.839499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:25.839500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:25.839506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:25.839516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:25.839519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:25.839523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:25.839528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:25.839532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:25.839536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:25.839540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:25.839544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:25.839549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:25.839553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.839557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:25.839561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:25.839565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:25.839568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:25.839578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:25.839587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:25.839594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:25.839600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:25.839605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:25.839612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:25.839617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:25.839622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:25.839628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:25.839634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:25.839639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:25.839644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:25.839650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:25.839656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:25.839660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:25.839666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:25.839670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:25.839675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:25.839680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:25.839686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:25.839691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.839698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.839703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:25.839709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:25.839714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:25.839719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:25.839722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:25.839728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:25.839732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:25.839738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:25.839788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:25.845615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:25.846513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:25.846534Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:25.846537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:25.846541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:25.846548Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2555 [2:7555896499878722087:11691]
2025-09-30T14:57:25.846568Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:25.846584Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:25.846588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:25.846592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:25.846594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:25.846611Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:25.846618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:25.846626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:25.846693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.846695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:25.846698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:25.846702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:25.846704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:25.846782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:25.846785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.846799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:25.846812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:25.846831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:25.846848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896499878722082:11691]
2025-09-30T14:57:25.846851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896499878722082:11691]
2025-09-30T14:57:25.846854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896499878722082:11691]
2025-09-30T14:57:25.846873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:25.846890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:25.846906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:25.846909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:25.846934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:25.846939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:25.846941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:25.846943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896499878722082:11691]
2025-09-30T14:57:25.846947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:25.847023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:25.847176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2555
2025-09-30T14:57:25.847184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2555
2025-09-30T14:57:25.847200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896499968513462:2454], now have 1 active actors on pipe
2025-09-30T14:57:25.847212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896499968513604:11191], now have 1 active actors on pipe
2025-09-30T14:57:25.847382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:25.847389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:25.847413Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d28ef7dd-f9d30673-59172b56-7e2e1f55_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:25.847421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:25.847424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:25.847427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:25.847437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:25.847448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:25.847461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:25.847759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:25.847766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:25.847781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:25.847908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2556 partition: 0 MaxSeqNo: 42 sessionId: src_id|d28ef7dd-f9d30673-59172b56-7e2e1f55_0
2025-09-30T14:57:25.848263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4535d4f-7d43a207-135db87f-2de9cc4c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d28ef7dd-f9d30673-59172b56-7e2e1f55_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:25.851113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d28ef7dd-f9d30673-59172b56-7e2e1f55_0] Write session: try to update token
2025-09-30T14:57:25.851134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d28ef7dd-f9d30673-59172b56-7e2e1f55_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:25.872369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2556 sessionId: src_id|d28ef7dd-f9d30673-59172b56-7e2e1f55_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:25.873538Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:25.873558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:25.873560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:25.873562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:25.873570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896499878722082:11691]
2025-09-30T14:57:25.873574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896499878722082:11691]
2025-09-30T14:57:25.873577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896499878722082:11691]
2025-09-30T14:57:25.873612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:25.873618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:25.873620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:25.873636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:25.873666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:25.873671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:25.873759Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:25.875057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:25.919387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896499968513616:10873]
2025-09-30T14:57:25.927358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2555, pipe: [1:7555896499968513616:10873]
2025-09-30T14:57:25.987335Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:25.987723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:25.987733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:25.987773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896499968513616:10873], now have 1 active actors on pipe
2025-09-30T14:57:25.988005Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:25.989353Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:25.989374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896499968513616:10873]
2025-09-30T14:57:25.991185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:25.991286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2556 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d28ef7dd-f9d30673-59172b56-7e2e1f55_0
2025-09-30T14:57:25.991464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2556 sessionId: src_id|d28ef7dd-f9d30673-59172b56-7e2e1f55_0 is DEAD
2025-09-30T14:57:25.991634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d28ef7dd-f9d30673-59172b56-7e2e1f55_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:25.991646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d28ef7dd-f9d30673-59172b56-7e2e1f55_0] Write session will restart in 0.006808s
2025-09-30T14:57:25.991669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d28ef7dd-f9d30673-59172b56-7e2e1f55_0] Write session: Do CDS request
2025-09-30T14:57:25.991675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d28ef7dd-f9d30673-59172b56-7e2e1f55_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:26.003878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d28ef7dd-f9d30673-59172b56-7e2e1f55_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:26.007545Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:26.007564Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2557
2025-09-30T14:57:26.007993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:26.011057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:26.011381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2557 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:26.011437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2557 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:26.011443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2557 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:26.011449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:26.011911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2557 sessionId:  describe result for acl check
2025-09-30T14:57:26.011957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:26.011959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:26.011960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:26.011965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896504263481023:11195] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:26.011311Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:26.011324Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:26.011337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:26.011409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:26.011449Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896504173689531:11693]
2025-09-30T14:57:26.012112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:26.012512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896504263481023:11195] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:26.014252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:26.015117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896504263481023:11195] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:26.014311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:26.014678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:26.014734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:26.014736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:26.014737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:26.014739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:26.014741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:26.014742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:26.014743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:26.014745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:26.014746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:26.014748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:26.014749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.014751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.014752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.014754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:26.014755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:26.014762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:26.014773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:26.014778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:26.014783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:26.014788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:26.014793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:26.014798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:26.014803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:26.014807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:26.014814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:26.014819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.014823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.014827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.014831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:26.014836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:26.014845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:26.014854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:26.014860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:26.014867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:26.014873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:26.014879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:26.014885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:26.014890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:26.014897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:26.014902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:26.014907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:26.014912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:26.014917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:26.014922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:26.014927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:26.014931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:26.014936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:26.014941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:26.014945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:26.014951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:26.014956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.014961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.014967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.014991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.014996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.015002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.015007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:26.015013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:26.015018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:26.015024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:26.015086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:26.021116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896504263481023:11195] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:26.021137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896504263481023:11195] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:26.021141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896504263481023:11195] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:26.021150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2557 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:26.023198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2556
2025-09-30T14:57:26.023229Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2556
2025-09-30T14:57:26.021466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:26.022861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:26.022867Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:26.022872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:26.022877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:26.022884Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2556 [2:7555896504173689531:11693]
2025-09-30T14:57:26.022901Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:26.022915Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:26.022919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:26.022922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:26.022924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:26.022940Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:26.022947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:26.022953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:26.023013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.023014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.023018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.023021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:26.023023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:26.023107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:26.023111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.023124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.023135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.023152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:26.023172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896499968513617:2454], now have 1 active actors on pipe
2025-09-30T14:57:26.023177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896504263481060:11195], now have 1 active actors on pipe
2025-09-30T14:57:26.023184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896504173689525:11693]
2025-09-30T14:57:26.023186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896504173689525:11693]
2025-09-30T14:57:26.023187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896504173689525:11693]
2025-09-30T14:57:26.023204Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:26.023219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:26.023225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:26.023229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:26.023231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:26.023235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:26.023239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:26.023308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896504173689525:11693]
2025-09-30T14:57:26.023313Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:26.023318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:26.023335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:26.023344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:26.023401Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed601a7d-1208c78b-602cade9-cbc4bfdc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:26.023410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:26.023414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:26.023415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:26.023426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:26.023437Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:26.023468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:26.023820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:26.023834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:26.023854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:26.025552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2557 partition: 0 MaxSeqNo: 42 sessionId: src_id|ed601a7d-1208c78b-602cade9-cbc4bfdc_0
2025-09-30T14:57:26.027633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d28ef7dd-f9d30673-59172b56-7e2e1f55_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ed601a7d-1208c78b-602cade9-cbc4bfdc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:26.030374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed601a7d-1208c78b-602cade9-cbc4bfdc_0] Write session: try to update token
2025-09-30T14:57:26.030395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed601a7d-1208c78b-602cade9-cbc4bfdc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:26.042104Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:26.042128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:26.042131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:26.042133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:26.042143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896504173689525:11693]
2025-09-30T14:57:26.042148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896504173689525:11693]
2025-09-30T14:57:26.042152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896504173689525:11693]
2025-09-30T14:57:26.042205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:26.042214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.042217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:26.042215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:26.042222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:26.042226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:26.042366Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:26.063299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2557 sessionId: src_id|ed601a7d-1208c78b-602cade9-cbc4bfdc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:26.065980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:26.091522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896504263481071:10873]
2025-09-30T14:57:26.091930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2556, pipe: [1:7555896504263481071:10873]
2025-09-30T14:57:26.181779Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:26.182125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:26.182160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:26.182182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896504263481071:10873], now have 1 active actors on pipe
2025-09-30T14:57:26.182421Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:26.182889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed601a7d-1208c78b-602cade9-cbc4bfdc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:26.182896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed601a7d-1208c78b-602cade9-cbc4bfdc_0] Write session will restart in 0.006234s
2025-09-30T14:57:26.182401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896504263481071:10873]
2025-09-30T14:57:26.182469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:26.182472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:26.182920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed601a7d-1208c78b-602cade9-cbc4bfdc_0] Write session: Do CDS request
2025-09-30T14:57:26.182948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed601a7d-1208c78b-602cade9-cbc4bfdc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:26.182484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:26.182550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2557 reason: error at write: Disconnected sessionId: src_id|ed601a7d-1208c78b-602cade9-cbc4bfdc_0
2025-09-30T14:57:26.182723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2557 sessionId: src_id|ed601a7d-1208c78b-602cade9-cbc4bfdc_0 is DEAD
2025-09-30T14:57:26.190766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed601a7d-1208c78b-602cade9-cbc4bfdc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:26.190847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:26.190871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2558
2025-09-30T14:57:26.191002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2558 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:26.191034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2558 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:26.191040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2558 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:26.191045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:26.191512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2558 sessionId:  describe result for acl check
2025-09-30T14:57:26.191543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:26.191545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:26.191548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:26.191554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896504263481090:11199] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:26.192105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896504263481090:11199] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:26.195302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896504263481090:11199] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:26.198871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896504263481090:11199] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:26.198887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896504263481090:11199] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:26.198891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896504263481090:11199] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:26.198899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2558 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:26.201867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:26.203316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:26.203598Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:26.203615Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:26.203630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:26.203696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:26.203743Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896504173689691:11697]
2025-09-30T14:57:26.204266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:26.204613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:26.204668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:26.205022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:26.205109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:26.205111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:26.205112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:26.205113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:26.205115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:26.205117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:26.205118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:26.205120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:26.205121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:26.205122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:26.205123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.205124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.205125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.205127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:26.205128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:26.205135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:26.205145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:26.205149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:26.205153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:26.205157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:26.205161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:26.205165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:26.205169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:26.205173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:26.205180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:26.205184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.205188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.205192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.205196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:26.205200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:26.205211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:26.205219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:26.205226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:26.205233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:26.205238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:26.205244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:26.205248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:26.205254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:26.205259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:26.205264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:26.205268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:26.205273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:26.205278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:26.205283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:26.205287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:26.205292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:26.205297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:26.205303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:26.205308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:26.205313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:26.205320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.205326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.205331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.205336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.205344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.205349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.205354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:26.205360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:26.205365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:26.205369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:26.205425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:26.211669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:26.212817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:26.212837Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:26.212839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:26.212844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:26.212852Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2557 [2:7555896504173689691:11697]
2025-09-30T14:57:26.212870Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:26.212888Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:26.212892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:26.212896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:26.212899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:26.212916Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:26.212929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:26.212943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:26.213019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.213028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.213031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.213034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:26.213037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:26.213133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:26.213141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.213156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.213169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.213189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:26.213208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896504263481218:11199], now have 1 active actors on pipe
2025-09-30T14:57:26.213221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896504173689686:11697]
2025-09-30T14:57:26.213229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896504173689686:11697]
2025-09-30T14:57:26.213232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896504173689686:11697]
2025-09-30T14:57:26.213248Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:26.213259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896504263481073:2454], now have 1 active actors on pipe
2025-09-30T14:57:26.213272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:26.213271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:26.213287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:26.213293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:26.213293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:26.213301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:26.213308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2557
2025-09-30T14:57:26.213327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2557
2025-09-30T14:57:26.213343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896504173689686:11697]
2025-09-30T14:57:26.213353Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:26.213355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:26.213375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:26.213380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:26.213429Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a59bda89-1c78e8af-3bc8231c-f94b8aa8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:26.213441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:26.213445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:26.213447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:26.213458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:26.213471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:26.213494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:26.213849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:26.213866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:26.213891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:26.214127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2558 partition: 0 MaxSeqNo: 42 sessionId: src_id|a59bda89-1c78e8af-3bc8231c-f94b8aa8_0
2025-09-30T14:57:26.214476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed601a7d-1208c78b-602cade9-cbc4bfdc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a59bda89-1c78e8af-3bc8231c-f94b8aa8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:26.217474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a59bda89-1c78e8af-3bc8231c-f94b8aa8_0] Write session: try to update token
2025-09-30T14:57:26.217496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a59bda89-1c78e8af-3bc8231c-f94b8aa8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:26.227477Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:26.227498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:26.227501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:26.227503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:26.227513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896504173689686:11697]
2025-09-30T14:57:26.227518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896504173689686:11697]
2025-09-30T14:57:26.227522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896504173689686:11697]
2025-09-30T14:57:26.227567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:26.227579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.227582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:26.227740Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:26.231423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:26.231443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:26.231447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:26.244954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2558 sessionId: src_id|a59bda89-1c78e8af-3bc8231c-f94b8aa8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:26.247917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:26.284250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896504263481261:10873]
2025-09-30T14:57:26.287934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2557, pipe: [1:7555896504263481261:10873]
2025-09-30T14:57:26.361101Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:26.361510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:26.361521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:26.361542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896504263481261:10873], now have 1 active actors on pipe
2025-09-30T14:57:26.362282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a59bda89-1c78e8af-3bc8231c-f94b8aa8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:26.362295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a59bda89-1c78e8af-3bc8231c-f94b8aa8_0] Write session will restart in 0.009254s
2025-09-30T14:57:26.362318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a59bda89-1c78e8af-3bc8231c-f94b8aa8_0] Write session: Do CDS request
2025-09-30T14:57:26.362323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a59bda89-1c78e8af-3bc8231c-f94b8aa8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:26.362333Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:26.361856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:26.361864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:26.361875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:26.361918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896504263481261:10873]
2025-09-30T14:57:26.361949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2558 reason: error at write: Disconnected sessionId: src_id|a59bda89-1c78e8af-3bc8231c-f94b8aa8_0
2025-09-30T14:57:26.362121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2558 sessionId: src_id|a59bda89-1c78e8af-3bc8231c-f94b8aa8_0 is DEAD
2025-09-30T14:57:26.375196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a59bda89-1c78e8af-3bc8231c-f94b8aa8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:26.375288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:26.375307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2559
2025-09-30T14:57:26.375417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2559 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:26.375450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2559 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:26.375463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2559 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:26.375468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:26.375926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2559 sessionId:  describe result for acl check
2025-09-30T14:57:26.375969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:26.375971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:26.375973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:26.375979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896504263481292:11212] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:26.377006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896504263481292:11212] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:26.379900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896504263481292:11212] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:26.384095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:26.384255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896504263481292:11212] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:26.384272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896504263481292:11212] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:26.384276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896504263481292:11212] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:26.384284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2559 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:26.386719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:26.387189Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:26.387203Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:26.387218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:26.387313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:26.387363Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896504173689875:11711]
2025-09-30T14:57:26.388009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:26.388466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:26.388522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:26.388862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:26.388931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:26.388937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:26.388938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:26.388939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:26.388940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:26.388941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:26.388942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:26.388943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:26.388944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:26.388945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:26.388946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.388947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.388948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.388949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:26.388950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:26.388956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:26.388965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:26.388969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:26.388974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:26.388977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:26.388980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:26.388984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:26.388987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:26.388990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:26.388994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:26.388998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.389002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.389005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.389008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:26.389012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:26.389021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:26.389030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:26.389035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:26.389040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:26.389048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:26.389052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:26.389056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:26.389061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:26.389065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:26.389083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:26.389087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:26.389092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:26.389096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:26.389102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:26.389105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:26.389110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:26.389115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:26.389120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:26.389124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:26.389128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:26.389133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.389137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.389141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.389145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.389149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.389154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.389163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:26.389167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:26.389172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:26.389176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:26.389218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:26.395465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:26.396538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:26.396555Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:26.396558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:26.396562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:26.396569Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2558 [2:7555896504173689875:11711]
2025-09-30T14:57:26.396588Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:26.396607Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:26.396610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:26.396614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:26.396616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:26.396632Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:26.396640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:26.396652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:26.396716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.396724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.396726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.396729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:26.396732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:26.396802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:26.396810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.396823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.396834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.396851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:26.396873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896504173689869:11711]
2025-09-30T14:57:26.396880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896504173689869:11711]
2025-09-30T14:57:26.396882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896504173689869:11711]
2025-09-30T14:57:26.396893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:26.396904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:26.396907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:26.396909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:26.396912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896504263481275:2454], now have 1 active actors on pipe
2025-09-30T14:57:26.396916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896504263481420:11212], now have 1 active actors on pipe
2025-09-30T14:57:26.396925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:26.396940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:26.396944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:26.396982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896504173689869:11711]
2025-09-30T14:57:26.396993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:26.397014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:26.397213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2558
2025-09-30T14:57:26.397265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2558
2025-09-30T14:57:26.397446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:26.397462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:26.397488Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|251bc525-2450884f-745610f3-9dc9b2c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:26.397501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:26.397508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:26.397510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:26.397522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:26.397546Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:26.397567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:26.397738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:26.397753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:26.397778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:26.397874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2559 partition: 0 MaxSeqNo: 42 sessionId: src_id|251bc525-2450884f-745610f3-9dc9b2c1_0
2025-09-30T14:57:26.398295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a59bda89-1c78e8af-3bc8231c-f94b8aa8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|251bc525-2450884f-745610f3-9dc9b2c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:26.401430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|251bc525-2450884f-745610f3-9dc9b2c1_0] Write session: try to update token
2025-09-30T14:57:26.401456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|251bc525-2450884f-745610f3-9dc9b2c1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:26.410102Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:26.410125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:26.410135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896504173689869:11711]
2025-09-30T14:57:26.410177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:26.410185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:26.410350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:26.410502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:26.410654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:26.410800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:26.410999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:26.411047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:26.425653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2559 sessionId: src_id|251bc525-2450884f-745610f3-9dc9b2c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:26.428479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:26.428751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:26.428777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:26.428867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:26.429100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:26.431851Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:26.431881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:26.431884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:26.431886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:26.431899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896504173689869:11711]
2025-09-30T14:57:26.431904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896504173689869:11711]
2025-09-30T14:57:26.431911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896504173689869:11711]
2025-09-30T14:57:26.431960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:26.431965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:26.431968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:26.431969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:26.431977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.431981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:26.432146Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:26.462187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896504263481432:10873]
2025-09-30T14:57:26.471886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2558, pipe: [1:7555896504263481432:10873]
2025-09-30T14:57:26.553388Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:26.553894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896504263481432:10873], now have 1 active actors on pipe
2025-09-30T14:57:26.570913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:26.570945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:26.571140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:26.571208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:26.571300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:26.571371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:26.571748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:26.571761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:26.571837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:26.571907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:26.571976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:26.572048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:26.572095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:26.572103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:26.572171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:26.572237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:26.572303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:26.572371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:26.572417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:26.572424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:26.572498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:26.572567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:26.572634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:26.572732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:26.572781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:26.572790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:26.572863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:26.572931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:26.573000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:26.573084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:26.573134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:26.573143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:26.573217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:26.573284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:26.573354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:26.573425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:26.573479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:26.573490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:26.573564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:26.573630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:26.573700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:26.573784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:26.573834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:26.573843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:26.573914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:26.573978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:26.574049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:26.574121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:26.574178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:26.574186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:26.574258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:26.574321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:26.574388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:26.574459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:26.574510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:26.574518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:26.574588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:26.574653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:26.574719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:26.574790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:26.574898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:26.574911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:26.575412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:26.575420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896504263481432:10873]
2025-09-30T14:57:26.575468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:26.575471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:26.575511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2559 reason: error at write: Disconnected sessionId: src_id|251bc525-2450884f-745610f3-9dc9b2c1_0
2025-09-30T14:57:26.575731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2559 sessionId: src_id|251bc525-2450884f-745610f3-9dc9b2c1_0 is DEAD
2025-09-30T14:57:26.575858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|251bc525-2450884f-745610f3-9dc9b2c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:26.575878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|251bc525-2450884f-745610f3-9dc9b2c1_0] Write session will restart in 0.009999s
2025-09-30T14:57:26.575903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|251bc525-2450884f-745610f3-9dc9b2c1_0] Write session: Do CDS request
2025-09-30T14:57:26.575909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|251bc525-2450884f-745610f3-9dc9b2c1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:26.575866Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:26.586771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|251bc525-2450884f-745610f3-9dc9b2c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:26.586840Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:26.586860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2560
2025-09-30T14:57:26.587005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2560 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:26.587050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2560 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:26.587061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2560 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:26.587065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:26.587545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2560 sessionId:  describe result for acl check
2025-09-30T14:57:26.587593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:26.587600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:26.587602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:26.587608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896504263481469:11216] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:26.588120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896504263481469:11216] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:26.591860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896504263481469:11216] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:26.595834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:26.595776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896504263481469:11216] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:26.595795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896504263481469:11216] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:26.595799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896504263481469:11216] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:26.595808Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2560 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:26.598499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:26.598729Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:26.598749Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:26.598761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:26.598820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:26.598878Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896504173690028:11714]
2025-09-30T14:57:26.599609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:26.599979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:26.600049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:26.600430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:26.600500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:26.600506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:26.600507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:26.600508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:26.600509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:26.600510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:26.600512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:26.600514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:26.600516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:26.600517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:26.600518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.600519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.600520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.600522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:26.600524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:26.600530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:26.600542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:26.600546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:26.600550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:26.600553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:26.600558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:26.600563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:26.600567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:26.600572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:26.600576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:26.600580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.600585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.600589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.600593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:26.600597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:26.600608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:26.600620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:26.600631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:26.600642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:26.600647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:26.600653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:26.600660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:26.600666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:26.600672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:26.600681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:26.600686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:26.600692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:26.600698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:26.600708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:26.600717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:26.600723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:26.600732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:26.600738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:26.600747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:26.600753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:26.600762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.600767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.600771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.600777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.600783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.600789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.600796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:26.600801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:26.600806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:26.600812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:26.600859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:26.606651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:26.607639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:26.607653Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:26.607656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:26.607661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:26.607670Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2559 [2:7555896504173690028:11714]
2025-09-30T14:57:26.607688Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:26.607707Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:26.607715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:26.607718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:26.607721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:26.607738Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:26.607748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:26.607755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:26.607821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.607823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.607825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.607829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:26.607832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:26.607905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:26.607909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.607923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.607933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.607950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:26.607967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896504173690022:11714]
2025-09-30T14:57:26.607970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896504173690022:11714]
2025-09-30T14:57:26.607973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896504173690022:11714]
2025-09-30T14:57:26.607988Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:26.608005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:26.608020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:26.608023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:26.608046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:26.608051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:26.608054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:26.608065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896504173690022:11714]
2025-09-30T14:57:26.608069Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:26.608140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:26.608202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896504263481579:11216], now have 1 active actors on pipe
2025-09-30T14:57:26.608209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896504263481435:2454], now have 1 active actors on pipe
2025-09-30T14:57:26.608472Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2559
2025-09-30T14:57:26.608475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2559
2025-09-30T14:57:26.608925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:26.608941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:26.608967Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d353f31-261b75ab-3600ace0-c75f36a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:26.608981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:26.608989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:26.608992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:26.609004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:26.609023Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:26.609038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:26.609680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2560 partition: 0 MaxSeqNo: 42 sessionId: src_id|9d353f31-261b75ab-3600ace0-c75f36a6_0
2025-09-30T14:57:26.610052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|251bc525-2450884f-745610f3-9dc9b2c1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9d353f31-261b75ab-3600ace0-c75f36a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:26.609480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:26.609492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:26.609522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:26.613141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d353f31-261b75ab-3600ace0-c75f36a6_0] Write session: try to update token
2025-09-30T14:57:26.613157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d353f31-261b75ab-3600ace0-c75f36a6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:26.628012Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:26.628040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:26.628043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:26.628045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:26.628054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896504173690022:11714]
2025-09-30T14:57:26.628059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896504173690022:11714]
2025-09-30T14:57:26.628064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896504173690022:11714]
2025-09-30T14:57:26.628107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:26.628114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.628117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:26.628125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:26.628143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:26.628147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:26.628260Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:26.636687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2560 sessionId: src_id|9d353f31-261b75ab-3600ace0-c75f36a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:26.639370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:26.674647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896504263481592:10873]
2025-09-30T14:57:26.687529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2559, pipe: [1:7555896504263481592:10873]
2025-09-30T14:57:26.744141Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:26.744470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:26.744478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:26.744515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896504263481592:10873], now have 1 active actors on pipe
2025-09-30T14:57:26.744911Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:26.744892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896504263481592:10873]
2025-09-30T14:57:26.744932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:26.744936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:26.744998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2560 reason: error at write: Disconnected sessionId: src_id|9d353f31-261b75ab-3600ace0-c75f36a6_0
2025-09-30T14:57:26.745169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2560 sessionId: src_id|9d353f31-261b75ab-3600ace0-c75f36a6_0 is DEAD
2025-09-30T14:57:26.745281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:26.751530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d353f31-261b75ab-3600ace0-c75f36a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:26.751546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d353f31-261b75ab-3600ace0-c75f36a6_0] Write session will restart in 0.007750s
2025-09-30T14:57:26.751572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d353f31-261b75ab-3600ace0-c75f36a6_0] Write session: Do CDS request
2025-09-30T14:57:26.751578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d353f31-261b75ab-3600ace0-c75f36a6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:26.763986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d353f31-261b75ab-3600ace0-c75f36a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:26.771382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:26.771404Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2561
2025-09-30T14:57:26.779329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2561 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:26.779401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2561 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:26.779409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2561 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:26.779415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:26.779966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2561 sessionId:  describe result for acl check
2025-09-30T14:57:26.780002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:26.780005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:26.780007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:26.780013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896504263481710:11221] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:26.780555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896504263481710:11221] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:26.782794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:26.783042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:26.783223Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:26.783226Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:26.783238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:26.783316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:26.783359Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896504173690177:11716]
2025-09-30T14:57:26.784066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:26.784739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:26.784794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:26.785166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:26.785228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:26.785230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:26.785231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:26.785232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:26.785234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:26.785236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:26.785238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:26.785239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:26.785241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:26.785242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:26.785243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.785245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.785246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.785248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:26.785258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:26.785266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:26.785276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:26.785281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:26.785286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:26.785290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:26.785295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:26.785299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:26.785304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:26.785309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:26.785313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:26.785317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.785322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.785326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.785329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:26.785333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:26.785343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:26.785353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:26.785359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:26.785366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:26.785372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:26.785379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:26.785384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:26.785390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:26.785395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:26.785401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:26.785408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:26.785414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:26.785419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:26.785425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:26.785431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:26.785437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:26.785444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:26.785449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:26.785454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:26.785460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:26.785466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.785472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.785476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.785482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.785487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.785493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.785497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:26.785503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:26.785508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:26.785514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:26.785563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:26.791266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:26.792215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:26.792221Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:26.792224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:26.792228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:26.792236Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2560 [2:7555896504173690177:11716]
2025-09-30T14:57:26.792254Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:26.792270Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:26.792273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:26.792277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:26.792279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:26.792296Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:26.792304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:26.792312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:26.792374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.792377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.792380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.792383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:26.792386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:26.792464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:26.792468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.792483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.792497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.792515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:26.792533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896504263481597:2454], now have 1 active actors on pipe
2025-09-30T14:57:26.792540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896504173690172:11716]
2025-09-30T14:57:26.792543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896504173690172:11716]
2025-09-30T14:57:26.792545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896504173690172:11716]
2025-09-30T14:57:26.792561Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:26.792576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:26.792586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:26.792591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:26.792592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:26.792594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:26.792596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:26.792631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896504173690172:11716]
2025-09-30T14:57:26.792640Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:26.792645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:26.792805Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2560
2025-09-30T14:57:26.793720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896504263481710:11221] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:26.806292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896504263481710:11221] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:26.806314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896504263481710:11221] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:26.806319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896504263481710:11221] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:26.806328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2561 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:26.806749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2560
2025-09-30T14:57:26.813385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896504263481755:11221], now have 1 active actors on pipe
2025-09-30T14:57:26.813427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:26.813437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:26.813457Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:26.813460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:26.813469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896504173690172:11716]
2025-09-30T14:57:26.813524Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dcfbdf08-1fb35d7b-e4e62661-72a94eeb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:26.813535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:26.813540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:26.813538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:26.813543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:26.813556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:26.813573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:26.813589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:26.813767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:26.813908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:26.814042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:26.814173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:26.814360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:26.814395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:26.814422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:26.816771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:26.816790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:26.816816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:26.817117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2561 partition: 0 MaxSeqNo: 42 sessionId: src_id|dcfbdf08-1fb35d7b-e4e62661-72a94eeb_0
2025-09-30T14:57:26.817827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d353f31-261b75ab-3600ace0-c75f36a6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dcfbdf08-1fb35d7b-e4e62661-72a94eeb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZI